2023-09-30T22:12:14.578 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T22:12:14.579 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047 --verbose --description fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}} --name dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi --owner scheduled_dparmar@teuthology -- /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047/orig.config.yaml 2023-09-30T22:12:14.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T22:12:14.716 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047 branch: fix-nfs-apply-err-reporting description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}} email: null first_in_suite: false job_id: '7408047' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: fix-nfs-apply-err-reporting ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: dry_run: true install: ceph: flavor: default sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62953 sha1: 6973b24e3d99fd494b753449d2ea12077599cbd6 owner: scheduled_dparmar@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 seed: 2683 sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 sleep_before_teardown: 0 suite: fs:upgrade suite_branch: wip-62953 suite_path: /home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa suite_relpath: qa suite_repo: https://github.com/dparmar18/ceph suite_sha1: 6973b24e3d99fd494b753449d2ea12077599cbd6 targets: smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIMwVFfiBhlkzOu4g+g0RWhCOo1THv7YOS3ipFvq4AFSMFuLm6CNt7BJUsep0edEsgkOCT3cbPkShu/9VMlr3Cc= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNQ3uQNH5jbGJ/ypFNhMzqTxPsHHQZ7d+koYJTzU5lZ+41WZj39huXoH4smYp2oD/153Z1NXXCDG3Qje4x6bWDQ= tasks: - install: branch: pacific exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs - ceph-volume extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs extra_system_packages: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - print: '**** done installing pacific' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client pacific - print: '**** done ceph' - ceph-fuse: null - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: branch: reef - print: '**** done install.upgrade the host' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph osd dump -f json-pretty - ceph versions - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph osd require-osd-release reef - ceph.healthy: null - print: '**** done ceph.restart' - ceph-fuse: client.0: mounted: false - print: '**** done unmount client.0' - install.upgrade: client.0: null - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: null - print: '**** done remount client.0' - workunit: clients: all: - suites/iozone.sh teuthology: branch: pacific fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end - if not is_fuse() then reject() end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-30_21:53:45 tube: smithi user: dparmar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-30T22:12:14.717 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa; will attempt to use it 2023-09-30T22:12:14.717 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks 2023-09-30T22:12:14.717 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-30T22:12:14.719 INFO:teuthology.task.internal:Checking packages... 2023-09-30T22:12:14.742 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d6eb91756d99e822eeed7c6b783104a6ad86054' 2023-09-30T22:12:14.742 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:12:14.742 INFO:teuthology.packaging:ref: None 2023-09-30T22:12:14.742 INFO:teuthology.packaging:tag: None 2023-09-30T22:12:14.742 INFO:teuthology.packaging:branch: fix-nfs-apply-err-reporting 2023-09-30T22:12:14.743 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:12:14.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=fix-nfs-apply-err-reporting 2023-09-30T22:12:14.964 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5795.g3d6eb917 2023-09-30T22:12:14.964 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-30T22:12:14.971 INFO:teuthology.task.internal:no buildpackages task found 2023-09-30T22:12:14.971 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-30T22:12:14.980 INFO:teuthology.task.internal:Saving configuration 2023-09-30T22:12:15.000 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-30T22:12:15.005 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T22:12:15.030 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 22:07:16.538453', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIMwVFfiBhlkzOu4g+g0RWhCOo1THv7YOS3ipFvq4AFSMFuLm6CNt7BJUsep0edEsgkOCT3cbPkShu/9VMlr3Cc='} 2023-09-30T22:12:15.051 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 22:07:16.540206', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNQ3uQNH5jbGJ/ypFNhMzqTxPsHHQZ7d+koYJTzU5lZ+41WZj39huXoH4smYp2oD/153Z1NXXCDG3Qje4x6bWDQ='} 2023-09-30T22:12:15.051 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-30T22:12:15.056 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-09-30T22:12:15.057 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['client.0'] 2023-09-30T22:12:15.057 INFO:teuthology.run_tasks:Running task console_log... 2023-09-30T22:12:15.128 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f36a34f5f70>, signals=[15]) 2023-09-30T22:12:15.129 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-30T22:12:15.134 INFO:teuthology.task.internal:Opening connections... 2023-09-30T22:12:15.134 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2023-09-30T22:12:15.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:12:15.206 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2023-09-30T22:12:15.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:12:15.275 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-30T22:12:15.282 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-09-30T22:12:15.305 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-09-30T22:12:15.306 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-09-30T22:12:15.367 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2023-09-30T22:12:15.368 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8" 2023-09-30T22:12:15.368 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2023-09-30T22:12:15.368 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2023-09-30T22:12:15.368 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8" 2023-09-30T22:12:15.368 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-09-30T22:12:15.368 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-30T22:12:15.368 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-09-30T22:12:15.368 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-30T22:12:15.368 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2023-09-30T22:12:15.369 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T22:12:15.369 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T22:12:15.369 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T22:12:15.370 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-09-30T22:12:15.396 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-09-30T22:12:15.418 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-09-30T22:12:15.418 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-09-30T22:12:15.479 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2023-09-30T22:12:15.480 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2023-09-30T22:12:15.480 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2023-09-30T22:12:15.480 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2023-09-30T22:12:15.480 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2023-09-30T22:12:15.480 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-09-30T22:12:15.480 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-30T22:12:15.480 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-09-30T22:12:15.480 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-30T22:12:15.480 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2023-09-30T22:12:15.481 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T22:12:15.481 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T22:12:15.481 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T22:12:15.481 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-09-30T22:12:15.504 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-30T22:12:15.513 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-30T22:12:15.520 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-30T22:12:15.520 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2023-09-30T22:12:15.523 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2023-09-30T22:12:15.544 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-30T22:12:15.550 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-30T22:12:15.550 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2023-09-30T22:12:15.585 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2023-09-30T22:12:15.618 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-30T22:12:15.671 INFO:teuthology.run_tasks:Running task kernel... 2023-09-30T22:12:15.686 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-09-30T22:12:15.686 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-09-30T22:12:15.686 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T22:12:15.687 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T22:12:15.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:12:15.708 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2023-09-30T22:12:15.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:12:15.709 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2023-09-30T22:12:15.768 INFO:teuthology.orchestra.run.smithi191.stdout:4.18.0-489.el8.x86_64 2023-09-30T22:12:15.769 INFO:teuthology.task.kernel:Running kernel on smithi191: 4.18.0-489.el8.x86_64 2023-09-30T22:12:15.769 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum install -y kernel 2023-09-30T22:12:15.770 INFO:teuthology.orchestra.run.smithi059.stdout:4.18.0-489.el8.x86_64 2023-09-30T22:12:15.770 INFO:teuthology.task.kernel:Running kernel on smithi059: 4.18.0-489.el8.x86_64 2023-09-30T22:12:15.770 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum install -y kernel 2023-09-30T22:12:20.526 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 8 - AppStream 15 MB/s | 33 MB 00:02 2023-09-30T22:12:20.665 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - AppStream 15 MB/s | 33 MB 00:02 2023-09-30T22:12:30.276 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 48 MB 00:03 2023-09-30T22:12:31.490 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - BaseOS 11 MB/s | 48 MB 00:04 2023-09-30T22:12:37.459 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 8 - Extras 53 kB/s | 18 kB 00:00 2023-09-30T22:12:38.027 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.9 kB 00:00 2023-09-30T22:12:38.304 INFO:teuthology.orchestra.run.smithi191.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-09-30T22:12:39.006 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - Extras 94 kB/s | 18 kB 00:00 2023-09-30T22:12:39.174 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-09-30T22:12:39.632 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.9 kB 00:00 2023-09-30T22:12:39.942 INFO:teuthology.orchestra.run.smithi059.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-09-30T22:12:42.127 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 16 MB 00:02 2023-09-30T22:12:42.964 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 444 kB/s | 24 kB 00:00 2023-09-30T22:12:46.176 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 416 kB/s | 24 kB 00:00 2023-09-30T22:12:46.463 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-09-30T22:12:46.463 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-09-30T22:12:46.712 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2023-09-30T22:12:46.713 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2023-09-30T22:12:46.713 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2023-09-30T22:12:46.713 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2023-09-30T22:12:46.713 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2023-09-30T22:12:46.713 INFO:teuthology.orchestra.run.smithi191.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-09-30T22:12:46.713 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2023-09-30T22:12:46.713 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-09-30T22:12:46.713 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-09-30T22:12:46.714 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:12:46.714 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2023-09-30T22:12:46.714 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2023-09-30T22:12:46.714 INFO:teuthology.orchestra.run.smithi191.stdout:Install 3 Packages 2023-09-30T22:12:46.714 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:12:46.714 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 88 M 2023-09-30T22:12:46.715 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 96 M 2023-09-30T22:12:46.715 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2023-09-30T22:12:49.900 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-09-30T22:12:49.901 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-09-30T22:12:50.180 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-09-30T22:12:50.181 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-09-30T22:12:50.181 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2023-09-30T22:12:50.181 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-09-30T22:12:50.181 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2023-09-30T22:12:50.181 INFO:teuthology.orchestra.run.smithi059.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-09-30T22:12:50.181 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2023-09-30T22:12:50.181 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-09-30T22:12:50.181 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-09-30T22:12:50.181 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:12:50.182 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2023-09-30T22:12:50.182 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-09-30T22:12:50.182 INFO:teuthology.orchestra.run.smithi059.stdout:Install 3 Packages 2023-09-30T22:12:50.182 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:12:50.182 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 88 M 2023-09-30T22:12:50.183 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 96 M 2023-09-30T22:12:50.183 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2023-09-30T22:12:53.231 INFO:teuthology.orchestra.run.smithi191.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 1.6 MB/s | 10 MB 00:06 2023-09-30T22:12:54.246 INFO:teuthology.orchestra.run.smithi059.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 2.5 MB/s | 10 MB 00:04 2023-09-30T22:12:58.810 INFO:teuthology.orchestra.run.smithi059.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 4.1 MB/s | 35 MB 00:08 2023-09-30T22:12:59.697 INFO:teuthology.orchestra.run.smithi191.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 2.8 MB/s | 35 MB 00:12 2023-09-30T22:13:00.052 INFO:teuthology.orchestra.run.smithi059.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 4.3 MB/s | 43 MB 00:09 2023-09-30T22:13:00.053 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:13:00.053 INFO:teuthology.orchestra.run.smithi059.stdout:Total 8.9 MB/s | 88 MB 00:09 2023-09-30T22:13:00.751 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2023-09-30T22:13:00.906 INFO:teuthology.orchestra.run.smithi191.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 3.0 MB/s | 43 MB 00:13 2023-09-30T22:13:00.906 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:13:00.906 INFO:teuthology.orchestra.run.smithi191.stdout:Total 6.2 MB/s | 88 MB 00:14 2023-09-30T22:13:01.202 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2023-09-30T22:13:01.202 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2023-09-30T22:13:01.578 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2023-09-30T22:13:02.014 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2023-09-30T22:13:02.014 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2023-09-30T22:13:02.484 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2023-09-30T22:13:02.510 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2023-09-30T22:13:03.245 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2023-09-30T22:13:03.269 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2023-09-30T22:13:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2023-09-30T22:13:06.019 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:13:06.042 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2023-09-30T22:13:06.903 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:13:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:13:10.168 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:13:10.427 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:13:10.844 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:13:13.800 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:13:14.110 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:13:14.221 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:13:14.567 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:13:36.177 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:13:36.201 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:13:36.567 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:13:36.567 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:13:36.568 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:13:37.303 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:13:37.303 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:13:37.303 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2023-09-30T22:13:37.303 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-09-30T22:13:37.303 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-09-30T22:13:37.304 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:13:37.304 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2023-09-30T22:13:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:13:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:13:37.429 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T22:13:37.689 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-4.18.0-514.el8.x86_64 2023-09-30T22:13:37.689 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-09-30T22:13:37.689 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-09-30T22:13:37.690 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-30T22:13:37.690 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-30T22:13:37.690 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-09-30T22:13:37.690 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi191.front.sepia.ceph.com, path=None, version=distro) 2023-09-30T22:13:37.690 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T22:13:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:13:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:13:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:13:37.899 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-4.18.0-514.el8.x86_64 2023-09-30T22:13:37.899 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-09-30T22:13:37.899 DEBUG:teuthology.orchestra.run.smithi191:> sudo rpm -qi grub2-tools 2023-09-30T22:13:37.932 INFO:teuthology.orchestra.run.smithi191.stdout:Name : grub2-tools 2023-09-30T22:13:37.933 INFO:teuthology.orchestra.run.smithi191.stdout:Epoch : 1 2023-09-30T22:13:37.933 INFO:teuthology.orchestra.run.smithi191.stdout:Version : 2.02 2023-09-30T22:13:37.933 INFO:teuthology.orchestra.run.smithi191.stdout:Release : 129.el8 2023-09-30T22:13:37.933 INFO:teuthology.orchestra.run.smithi191.stdout:Architecture: x86_64 2023-09-30T22:13:37.933 INFO:teuthology.orchestra.run.smithi191.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-09-30T22:13:37.933 INFO:teuthology.orchestra.run.smithi191.stdout:Group : System Environment/Base 2023-09-30T22:13:37.933 INFO:teuthology.orchestra.run.smithi191.stdout:Size : 9265586 2023-09-30T22:13:37.933 INFO:teuthology.orchestra.run.smithi191.stdout:License : GPLv3+ 2023-09-30T22:13:37.933 INFO:teuthology.orchestra.run.smithi191.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-09-30T22:13:37.933 INFO:teuthology.orchestra.run.smithi191.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-09-30T22:13:37.933 INFO:teuthology.orchestra.run.smithi191.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-09-30T22:13:37.934 INFO:teuthology.orchestra.run.smithi191.stdout:Build Host : kbuilder.bsys.centos.org 2023-09-30T22:13:37.934 INFO:teuthology.orchestra.run.smithi191.stdout:Relocations : (not relocatable) 2023-09-30T22:13:37.934 INFO:teuthology.orchestra.run.smithi191.stdout:Packager : CentOS BuildSystem 2023-09-30T22:13:37.934 INFO:teuthology.orchestra.run.smithi191.stdout:Vendor : CentOS 2023-09-30T22:13:37.934 INFO:teuthology.orchestra.run.smithi191.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-30T22:13:37.934 INFO:teuthology.orchestra.run.smithi191.stdout:Summary : Support tools for GRUB. 2023-09-30T22:13:37.934 INFO:teuthology.orchestra.run.smithi191.stdout:Description : 2023-09-30T22:13:37.934 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:13:37.934 INFO:teuthology.orchestra.run.smithi191.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-30T22:13:37.934 INFO:teuthology.orchestra.run.smithi191.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-30T22:13:37.934 INFO:teuthology.orchestra.run.smithi191.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-30T22:13:37.934 INFO:teuthology.orchestra.run.smithi191.stdout:hardware devices. 2023-09-30T22:13:37.935 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:13:37.935 INFO:teuthology.orchestra.run.smithi191.stdout:This subpackage provides tools for support of all platforms. 2023-09-30T22:13:37.935 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-30T22:13:37.935 INFO:teuthology.task.kernel:Updating grub on smithi191 to boot 4.18.0-514.el8.x86_64 2023-09-30T22:13:37.936 DEBUG:teuthology.orchestra.run.smithi191:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-30T22:13:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:13:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:13:38.830 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2023-09-30T22:13:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-09-30T22:13:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-09-30T22:13:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:13:38.830 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-09-30T22:13:38.988 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T22:13:39.209 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-4.18.0-514.el8.x86_64 2023-09-30T22:13:39.210 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-09-30T22:13:39.210 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-09-30T22:13:39.210 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-30T22:13:39.210 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-30T22:13:39.210 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-09-30T22:13:39.210 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi059.front.sepia.ceph.com, path=None, version=distro) 2023-09-30T22:13:39.210 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T22:13:39.427 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-4.18.0-514.el8.x86_64 2023-09-30T22:13:39.428 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-09-30T22:13:39.428 DEBUG:teuthology.orchestra.run.smithi059:> sudo rpm -qi grub2-tools 2023-09-30T22:13:39.462 INFO:teuthology.orchestra.run.smithi059.stdout:Name : grub2-tools 2023-09-30T22:13:39.462 INFO:teuthology.orchestra.run.smithi059.stdout:Epoch : 1 2023-09-30T22:13:39.462 INFO:teuthology.orchestra.run.smithi059.stdout:Version : 2.02 2023-09-30T22:13:39.463 INFO:teuthology.orchestra.run.smithi059.stdout:Release : 129.el8 2023-09-30T22:13:39.463 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: x86_64 2023-09-30T22:13:39.463 INFO:teuthology.orchestra.run.smithi059.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-09-30T22:13:39.463 INFO:teuthology.orchestra.run.smithi059.stdout:Group : System Environment/Base 2023-09-30T22:13:39.463 INFO:teuthology.orchestra.run.smithi059.stdout:Size : 9265586 2023-09-30T22:13:39.463 INFO:teuthology.orchestra.run.smithi059.stdout:License : GPLv3+ 2023-09-30T22:13:39.463 INFO:teuthology.orchestra.run.smithi059.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-09-30T22:13:39.463 INFO:teuthology.orchestra.run.smithi059.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-09-30T22:13:39.463 INFO:teuthology.orchestra.run.smithi059.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-09-30T22:13:39.463 INFO:teuthology.orchestra.run.smithi059.stdout:Build Host : kbuilder.bsys.centos.org 2023-09-30T22:13:39.463 INFO:teuthology.orchestra.run.smithi059.stdout:Relocations : (not relocatable) 2023-09-30T22:13:39.463 INFO:teuthology.orchestra.run.smithi059.stdout:Packager : CentOS BuildSystem 2023-09-30T22:13:39.464 INFO:teuthology.orchestra.run.smithi059.stdout:Vendor : CentOS 2023-09-30T22:13:39.464 INFO:teuthology.orchestra.run.smithi059.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-30T22:13:39.464 INFO:teuthology.orchestra.run.smithi059.stdout:Summary : Support tools for GRUB. 2023-09-30T22:13:39.464 INFO:teuthology.orchestra.run.smithi059.stdout:Description : 2023-09-30T22:13:39.464 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:13:39.464 INFO:teuthology.orchestra.run.smithi059.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-30T22:13:39.464 INFO:teuthology.orchestra.run.smithi059.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-30T22:13:39.464 INFO:teuthology.orchestra.run.smithi059.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-30T22:13:39.464 INFO:teuthology.orchestra.run.smithi059.stdout:hardware devices. 2023-09-30T22:13:39.464 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:13:39.464 INFO:teuthology.orchestra.run.smithi059.stdout:This subpackage provides tools for support of all platforms. 2023-09-30T22:13:39.465 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-30T22:13:39.465 INFO:teuthology.task.kernel:Updating grub on smithi059 to boot 4.18.0-514.el8.x86_64 2023-09-30T22:13:39.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-30T22:13:39.474 INFO:teuthology.orchestra.run.smithi191.stderr:Generating grub configuration file ... 2023-09-30T22:13:40.837 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2023-09-30T22:13:41.629 INFO:teuthology.orchestra.run.smithi191.stderr:done 2023-09-30T22:13:41.631 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2023-09-30T22:13:41.669 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.hDIP4Ikl8C 2023-09-30T22:13:41.670 DEBUG:teuthology.orchestra.run.smithi191:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hDIP4Ikl8C 2023-09-30T22:13:41.744 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.hDIP4Ikl8C 2023-09-30T22:13:41.886 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.hDIP4Ikl8C is 6KB 2023-09-30T22:13:41.934 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.hDIP4Ikl8C 2023-09-30T22:13:41.951 DEBUG:teuthology.orchestra.run.smithi191:> sudo /bin/ls /boot/loader/entries || true 2023-09-30T22:13:42.025 INFO:teuthology.orchestra.run.smithi191.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-09-30T22:13:42.025 INFO:teuthology.orchestra.run.smithi191.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-09-30T22:13:42.025 INFO:teuthology.orchestra.run.smithi191.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-09-30T22:13:42.025 INFO:teuthology.orchestra.run.smithi191.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-09-30T22:13:42.026 DEBUG:teuthology.orchestra.run.smithi191:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-09-30T22:13:42.193 DEBUG:teuthology.orchestra.run.smithi191:> sudo shutdown -r now 2023-09-30T22:13:43.347 INFO:teuthology.orchestra.run.smithi059.stderr:done 2023-09-30T22:13:43.349 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2023-09-30T22:13:43.378 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.sdD4v3v6ME 2023-09-30T22:13:43.378 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.sdD4v3v6ME 2023-09-30T22:13:43.453 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.sdD4v3v6ME 2023-09-30T22:13:43.620 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.sdD4v3v6ME is 6KB 2023-09-30T22:13:43.669 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.sdD4v3v6ME 2023-09-30T22:13:43.687 DEBUG:teuthology.orchestra.run.smithi059:> sudo /bin/ls /boot/loader/entries || true 2023-09-30T22:13:43.753 INFO:teuthology.orchestra.run.smithi059.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-09-30T22:13:43.754 INFO:teuthology.orchestra.run.smithi059.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-09-30T22:13:43.754 INFO:teuthology.orchestra.run.smithi059.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-09-30T22:13:43.754 INFO:teuthology.orchestra.run.smithi059.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-09-30T22:13:43.755 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-09-30T22:13:43.906 DEBUG:teuthology.orchestra.run.smithi059:> sudo shutdown -r now 2023-09-30T22:14:12.222 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-09-30T22:14:12.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-09-30T22:14:12.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:14:13.908 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-09-30T22:14:13.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-09-30T22:14:13.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:15:12.284 DEBUG:teuthology.orchestra.remote:timed out 2023-09-30T22:15:13.912 DEBUG:teuthology.orchestra.remote:timed out 2023-09-30T22:15:21.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-09-30T22:15:21.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:15:21.666 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-09-30T22:15:21.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-09-30T22:15:21.974 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-514.el8.x86_64"... 2023-09-30T22:15:21.974 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2023-09-30T22:15:21.991 INFO:teuthology.orchestra.run.smithi191.stdout:4.18.0-514.el8.x86_64 2023-09-30T22:15:21.991 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-09-30T22:15:21.991 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-30T22:15:21.991 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-30T22:15:22.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-09-30T22:15:22.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:15:22.995 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-09-30T22:15:22.995 DEBUG:teuthology.orchestra.run.smithi191:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T22:15:23.061 INFO:teuthology.orchestra.run.smithi191.stdout:ttyS1 2023-09-30T22:15:23.074 DEBUG:teuthology.parallel:result is None 2023-09-30T22:15:23.216 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-09-30T22:15:23.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-09-30T22:15:23.550 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-514.el8.x86_64"... 2023-09-30T22:15:23.550 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2023-09-30T22:15:23.570 INFO:teuthology.orchestra.run.smithi059.stdout:4.18.0-514.el8.x86_64 2023-09-30T22:15:23.571 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-09-30T22:15:23.571 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-30T22:15:23.571 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-30T22:15:24.571 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-09-30T22:15:24.572 DEBUG:teuthology.orchestra.run.smithi059:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T22:15:24.646 INFO:teuthology.orchestra.run.smithi059.stdout:ttyS1 2023-09-30T22:15:24.663 DEBUG:teuthology.parallel:result is None 2023-09-30T22:15:24.663 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-30T22:15:24.670 INFO:teuthology.task.internal:Creating test directory... 2023-09-30T22:15:24.670 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T22:15:24.672 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T22:15:24.707 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-30T22:15:24.713 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-30T22:15:24.723 INFO:teuthology.task.internal:Creating archive directory... 2023-09-30T22:15:24.723 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T22:15:24.736 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T22:15:24.803 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-30T22:15:24.810 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-30T22:15:24.810 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T22:15:24.813 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T22:15:24.853 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:15:24.866 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:15:24.889 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:15:24.982 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:15:24.994 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-30T22:15:25.001 INFO:teuthology.task.internal:Configuring sudo... 2023-09-30T22:15:25.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T22:15:25.003 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T22:15:25.601 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-30T22:15:25.610 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-30T22:15:25.610 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:15:25.612 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:15:26.076 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:15:26.125 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:15:26.191 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:15:26.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:15:26.343 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:15:26.343 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T22:15:26.420 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:15:26.464 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:15:26.514 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:15:26.598 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:15:26.641 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-09-30T22:15:26.641 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T22:15:26.707 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2023-09-30T22:15:26.710 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2023-09-30T22:15:26.802 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:15:26.911 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:15:27.336 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-30T22:15:27.344 INFO:teuthology.task.internal:Starting timer... 2023-09-30T22:15:27.344 INFO:teuthology.run_tasks:Running task pcp... 2023-09-30T22:15:27.375 INFO:teuthology.run_tasks:Running task selinux... 2023-09-30T22:15:27.383 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-09-30T22:15:27.383 DEBUG:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2023-09-30T22:15:28.229 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: 2023-09-30T22:15:28.241 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2023-09-30T22:15:28.315 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2023-09-30T22:15:28.316 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-30T22:15:28.316 DEBUG:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2023-09-30T22:15:28.695 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2023-09-30T22:15:28.695 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2023-09-30T22:15:28.717 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2023-09-30T22:15:28.717 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi059.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2023-09-30T22:15:28.717 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:15:28.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:15:28.776 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:15:28.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:15:28.805 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-30T22:15:28.805 DEBUG:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2023-09-30T22:15:28.837 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2023-09-30T22:15:28.872 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-30T22:15:28.884 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-09-30T22:15:28.884 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-30T22:15:28.900 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-30T22:15:28.901 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi059.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-30T22:23:35.327 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2023-09-30T22:23:35.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-09-30T22:23:35.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:23:35.402 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-09-30T22:23:35.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-09-30T22:23:35.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-09-30T22:23:35.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:23:35.501 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-09-30T22:23:35.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-09-30T22:23:35.569 INFO:teuthology.run_tasks:Running task clock... 2023-09-30T22:23:35.579 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-30T22:23:35.580 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T22:23:35.580 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:23:35.582 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T22:23:35.582 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:23:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T22:23:35.637 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T22:23:35.641 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T22:23:35.656 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T22:23:35.710 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2023-09-30T22:23:35.724 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2023-09-30T22:23:35.724 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2023-09-30T22:23:35.736 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2023-09-30T22:23:35.741 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T22:23:35.750 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T22:23:35.756 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T22:23:35.763 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T22:23:35.831 INFO:teuthology.orchestra.run.smithi059.stderr:bash: ntpq: command not found 2023-09-30T22:23:35.835 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:23:35.836 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2023-09-30T22:23:35.836 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:23:35.836 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:23:35.836 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:23:35.836 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:23:35.843 INFO:teuthology.orchestra.run.smithi191.stderr:bash: ntpq: command not found 2023-09-30T22:23:35.846 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:23:35.846 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2023-09-30T22:23:35.846 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:23:35.847 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:23:35.847 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:23:35.847 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:23:35.848 INFO:teuthology.run_tasks:Running task install... 2023-09-30T22:23:35.856 DEBUG:teuthology.task.install:project ceph 2023-09-30T22:23:35.857 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}} 2023-09-30T22:23:35.857 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-09-30T22:23:35.857 INFO:teuthology.task.install:Using flavor: default 2023-09-30T22:23:35.864 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-30T22:23:35.864 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2023-09-30T22:23:35.865 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-09-30T22:23:35.865 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:23:35.865 INFO:teuthology.packaging:ref: None 2023-09-30T22:23:35.865 INFO:teuthology.packaging:tag: None 2023-09-30T22:23:35.865 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:23:35.865 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:23:35.866 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:23:35.868 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-09-30T22:23:35.868 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:23:35.868 INFO:teuthology.packaging:ref: None 2023-09-30T22:23:35.868 INFO:teuthology.packaging:tag: None 2023-09-30T22:23:35.868 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:23:35.869 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:23:35.869 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:23:36.162 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-09-30T22:23:36.163 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-09-30T22:23:36.210 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-09-30T22:23:36.211 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-09-30T22:23:36.335 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T22:23:36.336 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:23:36.336 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T22:23:36.371 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-09-30T22:23:36.371 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:23:36.371 INFO:teuthology.packaging:ref: None 2023-09-30T22:23:36.371 INFO:teuthology.packaging:tag: None 2023-09-30T22:23:36.372 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:23:36.372 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:23:36.372 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T22:23:36.377 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T22:23:36.378 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-09-30T22:23:36.378 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T22:23:36.407 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-09-30T22:23:36.407 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:23:36.407 INFO:teuthology.packaging:ref: None 2023-09-30T22:23:36.407 INFO:teuthology.packaging:tag: None 2023-09-30T22:23:36.407 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:23:36.407 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:23:36.407 DEBUG:teuthology.orchestra.run.smithi191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T22:23:36.448 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T22:23:36.477 DEBUG:teuthology.orchestra.run.smithi191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T22:23:36.537 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T22:23:36.554 DEBUG:teuthology.orchestra.run.smithi191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T22:23:36.570 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2023-09-30T22:23:36.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2023-09-30T22:23:36.621 INFO:teuthology.orchestra.run.smithi191.stdout:check_obsoletes = 1 2023-09-30T22:23:36.622 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum clean all 2023-09-30T22:23:36.877 INFO:teuthology.orchestra.run.smithi059.stdout:76 files removed 2023-09-30T22:23:36.897 INFO:teuthology.orchestra.run.smithi191.stdout:76 files removed 2023-09-30T22:23:36.909 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-09-30T22:23:36.925 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-09-30T22:23:37.580 INFO:teuthology.orchestra.run.smithi191.stdout:ceph packages for x86_64 307 kB/s | 76 kB 00:00 2023-09-30T22:23:37.648 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 283 kB/s | 76 kB 00:00 2023-09-30T22:23:37.872 INFO:teuthology.orchestra.run.smithi191.stdout:ceph noarch packages 60 kB/s | 15 kB 00:00 2023-09-30T22:23:38.041 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 44 kB/s | 15 kB 00:00 2023-09-30T22:23:38.231 INFO:teuthology.orchestra.run.smithi191.stdout:ceph source packages 4.3 kB/s | 1.4 kB 00:00 2023-09-30T22:23:38.391 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 4.5 kB/s | 1.4 kB 00:00 2023-09-30T22:23:40.498 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 8 - AppStream 15 MB/s | 33 MB 00:02 2023-09-30T22:23:40.574 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - AppStream 15 MB/s | 33 MB 00:02 2023-09-30T22:23:50.223 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 48 MB 00:03 2023-09-30T22:23:50.783 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - BaseOS 14 MB/s | 48 MB 00:03 2023-09-30T22:23:57.249 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 8 - Extras 104 kB/s | 18 kB 00:00 2023-09-30T22:23:57.982 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.9 kB 00:00 2023-09-30T22:23:58.550 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 8 - PowerTools 15 MB/s | 6.5 MB 00:00 2023-09-30T22:23:58.709 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - Extras 59 kB/s | 18 kB 00:00 2023-09-30T22:23:59.301 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.9 kB 00:00 2023-09-30T22:23:59.902 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - PowerTools 15 MB/s | 6.5 MB 00:00 2023-09-30T22:23:59.935 INFO:teuthology.orchestra.run.smithi191.stdout:Copr repo for python3-asyncssh owned by ceph 30 kB/s | 3.5 kB 00:00 2023-09-30T22:24:01.579 INFO:teuthology.orchestra.run.smithi059.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-09-30T22:24:01.769 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 9.4 MB/s | 16 MB 00:01 2023-09-30T22:24:02.488 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-09-30T22:24:05.702 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 520 kB/s | 24 kB 00:00 2023-09-30T22:24:06.746 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 325 kB/s | 24 kB 00:00 2023-09-30T22:24:09.997 INFO:teuthology.orchestra.run.smithi191.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:24:09.998 INFO:teuthology.orchestra.run.smithi191.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:24:10.024 INFO:teuthology.orchestra.run.smithi191.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-09-30T22:24:10.024 INFO:teuthology.orchestra.run.smithi191.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-09-30T22:24:10.025 INFO:teuthology.orchestra.run.smithi191.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-09-30T22:24:10.026 INFO:teuthology.orchestra.run.smithi191.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-09-30T22:24:10.234 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2023-09-30T22:24:10.245 INFO:teuthology.orchestra.run.smithi191.stdout:==================================================================================================== 2023-09-30T22:24:10.245 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2023-09-30T22:24:10.246 INFO:teuthology.orchestra.run.smithi191.stdout:==================================================================================================== 2023-09-30T22:24:10.246 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2023-09-30T22:24:10.246 INFO:teuthology.orchestra.run.smithi191.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-09-30T22:24:10.246 INFO:teuthology.orchestra.run.smithi191.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-09-30T22:24:10.246 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-09-30T22:24:10.246 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-09-30T22:24:10.246 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-09-30T22:24:10.246 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-09-30T22:24:10.246 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-09-30T22:24:10.246 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-09-30T22:24:10.247 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-09-30T22:24:10.247 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-09-30T22:24:10.247 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-09-30T22:24:10.247 INFO:teuthology.orchestra.run.smithi191.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-09-30T22:24:10.247 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-09-30T22:24:10.247 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-09-30T22:24:10.247 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-09-30T22:24:10.247 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-09-30T22:24:10.247 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-09-30T22:24:10.247 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-09-30T22:24:10.247 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-09-30T22:24:10.248 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-09-30T22:24:10.248 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-09-30T22:24:10.248 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:24:10.248 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-09-30T22:24:10.248 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2023-09-30T22:24:10.248 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-09-30T22:24:10.248 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-09-30T22:24:10.248 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-09-30T22:24:10.248 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-09-30T22:24:10.248 INFO:teuthology.orchestra.run.smithi191.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-09-30T22:24:10.248 INFO:teuthology.orchestra.run.smithi191.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-09-30T22:24:10.249 INFO:teuthology.orchestra.run.smithi191.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-09-30T22:24:10.249 INFO:teuthology.orchestra.run.smithi191.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-09-30T22:24:10.249 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:24:10.249 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-09-30T22:24:10.249 INFO:teuthology.orchestra.run.smithi191.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-09-30T22:24:10.249 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-09-30T22:24:10.249 INFO:teuthology.orchestra.run.smithi191.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-09-30T22:24:10.249 INFO:teuthology.orchestra.run.smithi191.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-09-30T22:24:10.249 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2023-09-30T22:24:10.249 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-09-30T22:24:10.249 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-09-30T22:24:10.249 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-09-30T22:24:10.249 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-09-30T22:24:10.250 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-09-30T22:24:10.250 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-09-30T22:24:10.250 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-09-30T22:24:10.250 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-09-30T22:24:10.250 INFO:teuthology.orchestra.run.smithi191.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-09-30T22:24:10.250 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-30T22:24:10.250 INFO:teuthology.orchestra.run.smithi191.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-09-30T22:24:10.250 INFO:teuthology.orchestra.run.smithi191.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-09-30T22:24:10.250 INFO:teuthology.orchestra.run.smithi191.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-09-30T22:24:10.250 INFO:teuthology.orchestra.run.smithi191.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-09-30T22:24:10.250 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-09-30T22:24:10.251 INFO:teuthology.orchestra.run.smithi191.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-09-30T22:24:10.251 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-09-30T22:24:10.251 INFO:teuthology.orchestra.run.smithi191.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-30T22:24:10.251 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-09-30T22:24:10.251 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-09-30T22:24:10.251 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-09-30T22:24:10.251 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-09-30T22:24:10.251 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-09-30T22:24:10.251 INFO:teuthology.orchestra.run.smithi191.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-09-30T22:24:10.252 INFO:teuthology.orchestra.run.smithi191.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-09-30T22:24:10.252 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-30T22:24:10.252 INFO:teuthology.orchestra.run.smithi191.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-09-30T22:24:10.252 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-09-30T22:24:10.252 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-09-30T22:24:10.252 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-09-30T22:24:10.252 INFO:teuthology.orchestra.run.smithi191.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-09-30T22:24:10.252 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-09-30T22:24:10.252 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-09-30T22:24:10.252 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-09-30T22:24:10.252 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-09-30T22:24:10.252 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-30T22:24:10.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-30T22:24:10.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-30T22:24:10.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-09-30T22:24:10.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-09-30T22:24:10.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-30T22:24:10.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-09-30T22:24:10.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-30T22:24:10.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-30T22:24:10.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-09-30T22:24:10.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-30T22:24:10.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-30T22:24:10.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-30T22:24:10.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-09-30T22:24:10.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-09-30T22:24:10.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-09-30T22:24:10.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-30T22:24:10.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-30T22:24:10.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-09-30T22:24:10.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-09-30T22:24:10.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-30T22:24:10.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-09-30T22:24:10.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-09-30T22:24:10.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-09-30T22:24:10.255 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-30T22:24:10.255 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-30T22:24:10.255 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-09-30T22:24:10.255 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-09-30T22:24:10.255 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-09-30T22:24:10.259 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-09-30T22:24:10.259 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-09-30T22:24:10.259 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-09-30T22:24:10.259 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-30T22:24:10.260 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-09-30T22:24:10.260 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-30T22:24:10.260 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-30T22:24:10.260 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-09-30T22:24:10.260 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-30T22:24:10.260 INFO:teuthology.orchestra.run.smithi191.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-30T22:24:10.260 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-30T22:24:10.260 INFO:teuthology.orchestra.run.smithi191.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-30T22:24:10.260 INFO:teuthology.orchestra.run.smithi191.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-30T22:24:10.260 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-30T22:24:10.260 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-30T22:24:10.260 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-30T22:24:10.260 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-09-30T22:24:10.261 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-30T22:24:10.261 INFO:teuthology.orchestra.run.smithi191.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-09-30T22:24:10.261 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-09-30T22:24:10.261 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-09-30T22:24:10.261 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:24:10.261 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2023-09-30T22:24:10.261 INFO:teuthology.orchestra.run.smithi191.stdout:==================================================================================================== 2023-09-30T22:24:10.261 INFO:teuthology.orchestra.run.smithi191.stdout:Install 108 Packages 2023-09-30T22:24:10.261 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 14 Packages 2023-09-30T22:24:10.261 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:24:10.262 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 200 M 2023-09-30T22:24:10.262 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2023-09-30T22:24:11.436 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:24:11.437 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:24:11.464 INFO:teuthology.orchestra.run.smithi059.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-09-30T22:24:11.464 INFO:teuthology.orchestra.run.smithi059.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-09-30T22:24:11.465 INFO:teuthology.orchestra.run.smithi059.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-09-30T22:24:11.466 INFO:teuthology.orchestra.run.smithi059.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-09-30T22:24:11.699 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-09-30T22:24:11.711 INFO:teuthology.orchestra.run.smithi059.stdout:==================================================================================================== 2023-09-30T22:24:11.712 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2023-09-30T22:24:11.712 INFO:teuthology.orchestra.run.smithi059.stdout:==================================================================================================== 2023-09-30T22:24:11.712 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2023-09-30T22:24:11.712 INFO:teuthology.orchestra.run.smithi059.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-09-30T22:24:11.712 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-09-30T22:24:11.712 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-09-30T22:24:11.712 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-09-30T22:24:11.712 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-09-30T22:24:11.712 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-09-30T22:24:11.712 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-09-30T22:24:11.713 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-09-30T22:24:11.713 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-09-30T22:24:11.713 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-09-30T22:24:11.713 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-09-30T22:24:11.713 INFO:teuthology.orchestra.run.smithi059.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-09-30T22:24:11.713 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-09-30T22:24:11.713 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-09-30T22:24:11.713 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-09-30T22:24:11.713 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-09-30T22:24:11.713 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-09-30T22:24:11.714 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-09-30T22:24:11.714 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-09-30T22:24:11.714 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-09-30T22:24:11.714 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-09-30T22:24:11.714 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:24:11.714 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-09-30T22:24:11.714 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2023-09-30T22:24:11.714 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-09-30T22:24:11.714 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-09-30T22:24:11.714 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-09-30T22:24:11.715 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-09-30T22:24:11.715 INFO:teuthology.orchestra.run.smithi059.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-09-30T22:24:11.715 INFO:teuthology.orchestra.run.smithi059.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-09-30T22:24:11.715 INFO:teuthology.orchestra.run.smithi059.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-09-30T22:24:11.715 INFO:teuthology.orchestra.run.smithi059.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-09-30T22:24:11.715 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:24:11.715 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-09-30T22:24:11.715 INFO:teuthology.orchestra.run.smithi059.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-09-30T22:24:11.715 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-09-30T22:24:11.715 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-09-30T22:24:11.715 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-09-30T22:24:11.716 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2023-09-30T22:24:11.716 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-09-30T22:24:11.716 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-09-30T22:24:11.716 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-09-30T22:24:11.716 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-09-30T22:24:11.716 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-09-30T22:24:11.716 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-09-30T22:24:11.716 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-09-30T22:24:11.716 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-09-30T22:24:11.716 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-09-30T22:24:11.717 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-30T22:24:11.717 INFO:teuthology.orchestra.run.smithi059.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-09-30T22:24:11.717 INFO:teuthology.orchestra.run.smithi059.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-09-30T22:24:11.717 INFO:teuthology.orchestra.run.smithi059.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-09-30T22:24:11.717 INFO:teuthology.orchestra.run.smithi059.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-09-30T22:24:11.717 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-09-30T22:24:11.717 INFO:teuthology.orchestra.run.smithi059.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-09-30T22:24:11.717 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-09-30T22:24:11.717 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-30T22:24:11.717 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-09-30T22:24:11.718 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-09-30T22:24:11.718 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-09-30T22:24:11.718 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-09-30T22:24:11.718 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-09-30T22:24:11.718 INFO:teuthology.orchestra.run.smithi059.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-09-30T22:24:11.718 INFO:teuthology.orchestra.run.smithi059.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-09-30T22:24:11.718 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-30T22:24:11.718 INFO:teuthology.orchestra.run.smithi059.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-09-30T22:24:11.718 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-09-30T22:24:11.718 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-09-30T22:24:11.719 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-09-30T22:24:11.719 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-09-30T22:24:11.719 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-09-30T22:24:11.719 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-09-30T22:24:11.719 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-09-30T22:24:11.719 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-09-30T22:24:11.719 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-30T22:24:11.719 INFO:teuthology.orchestra.run.smithi059.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-30T22:24:11.719 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-30T22:24:11.719 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-09-30T22:24:11.719 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-09-30T22:24:11.720 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-30T22:24:11.720 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-09-30T22:24:11.720 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-30T22:24:11.720 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-30T22:24:11.720 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-09-30T22:24:11.720 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-30T22:24:11.720 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-30T22:24:11.720 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-30T22:24:11.720 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-09-30T22:24:11.720 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-09-30T22:24:11.721 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-09-30T22:24:11.721 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-30T22:24:11.721 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-30T22:24:11.721 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-09-30T22:24:11.721 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-09-30T22:24:11.721 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-30T22:24:11.721 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-09-30T22:24:11.721 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-09-30T22:24:11.721 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-09-30T22:24:11.721 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-30T22:24:11.721 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-30T22:24:11.721 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-09-30T22:24:11.721 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-09-30T22:24:11.722 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-09-30T22:24:11.722 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-09-30T22:24:11.722 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-09-30T22:24:11.722 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-09-30T22:24:11.722 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-30T22:24:11.722 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-09-30T22:24:11.722 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-30T22:24:11.722 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-30T22:24:11.722 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-09-30T22:24:11.722 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-30T22:24:11.722 INFO:teuthology.orchestra.run.smithi059.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-30T22:24:11.723 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-30T22:24:11.723 INFO:teuthology.orchestra.run.smithi059.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-30T22:24:11.723 INFO:teuthology.orchestra.run.smithi059.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-30T22:24:11.723 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-30T22:24:11.723 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-30T22:24:11.723 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-30T22:24:11.723 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-09-30T22:24:11.723 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-30T22:24:11.723 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-09-30T22:24:11.723 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-09-30T22:24:11.723 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-09-30T22:24:11.723 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:24:11.723 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2023-09-30T22:24:11.724 INFO:teuthology.orchestra.run.smithi059.stdout:==================================================================================================== 2023-09-30T22:24:11.724 INFO:teuthology.orchestra.run.smithi059.stdout:Install 108 Packages 2023-09-30T22:24:11.724 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 14 Packages 2023-09-30T22:24:11.724 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:24:11.725 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 200 M 2023-09-30T22:24:11.725 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2023-09-30T22:24:12.389 INFO:teuthology.orchestra.run.smithi059.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 52 kB/s | 6.4 kB 00:00 2023-09-30T22:24:12.611 INFO:teuthology.orchestra.run.smithi191.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 27 kB/s | 6.4 kB 00:00 2023-09-30T22:24:12.890 INFO:teuthology.orchestra.run.smithi059.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 1.8 MB/s | 910 kB 00:00 2023-09-30T22:24:12.973 INFO:teuthology.orchestra.run.smithi059.stdout:(3/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 8.6 MB/s | 6.1 MB 00:00 2023-09-30T22:24:13.457 INFO:teuthology.orchestra.run.smithi059.stdout:(4/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 3.3 MB/s | 1.6 MB 00:00 2023-09-30T22:24:13.690 INFO:teuthology.orchestra.run.smithi059.stdout:(5/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 3.1 MB/s | 2.4 MB 00:00 2023-09-30T22:24:13.953 INFO:teuthology.orchestra.run.smithi191.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 679 kB/s | 910 kB 00:01 2023-09-30T22:24:14.099 INFO:teuthology.orchestra.run.smithi059.stdout:(6/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 13 MB/s | 24 MB 00:01 2023-09-30T22:24:14.849 INFO:teuthology.orchestra.run.smithi059.stdout:(7/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 3.6 MB/s | 5.0 MB 00:01 2023-09-30T22:24:14.961 INFO:teuthology.orchestra.run.smithi191.stdout:(3/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 2.3 MB/s | 6.1 MB 00:02 2023-09-30T22:24:14.975 INFO:teuthology.orchestra.run.smithi059.stdout:(8/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8. 13 MB/s | 12 MB 00:00 2023-09-30T22:24:15.000 INFO:teuthology.orchestra.run.smithi059.stdout:(9/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 171 kB/s | 26 kB 00:00 2023-09-30T22:24:15.092 INFO:teuthology.orchestra.run.smithi059.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 279 kB/s | 25 kB 00:00 2023-09-30T22:24:15.434 INFO:teuthology.orchestra.run.smithi059.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 2.4 MB/s | 824 kB 00:00 2023-09-30T22:24:15.542 INFO:teuthology.orchestra.run.smithi059.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 1.6 MB/s | 174 kB 00:00 2023-09-30T22:24:15.651 INFO:teuthology.orchestra.run.smithi059.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 1.2 MB/s | 131 kB 00:00 2023-09-30T22:24:15.712 INFO:teuthology.orchestra.run.smithi191.stdout:(4/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 2.1 MB/s | 1.6 MB 00:00 2023-09-30T22:24:15.851 INFO:teuthology.orchestra.run.smithi059.stdout:(14/122): libradosstriper1-16.2.14-44.geeb13ac9 2.4 MB/s | 493 kB 00:00 2023-09-30T22:24:15.904 INFO:teuthology.orchestra.run.smithi191.stdout:(5/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 1.3 MB/s | 2.4 MB 00:01 2023-09-30T22:24:16.993 INFO:teuthology.orchestra.run.smithi059.stdout:(15/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 3.3 MB/s | 3.8 MB 00:01 2023-09-30T22:24:17.093 INFO:teuthology.orchestra.run.smithi059.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 451 kB/s | 45 kB 00:00 2023-09-30T22:24:17.193 INFO:teuthology.orchestra.run.smithi059.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 989 kB/s | 99 kB 00:00 2023-09-30T22:24:17.294 INFO:teuthology.orchestra.run.smithi059.stdout:(18/122): python3-cephfs-16.2.14-44.geeb13ac9.e 2.1 MB/s | 215 kB 00:00 2023-09-30T22:24:17.478 INFO:teuthology.orchestra.run.smithi059.stdout:(19/122): python3-rados-16.2.14-44.geeb13ac9.el 2.1 MB/s | 390 kB 00:00 2023-09-30T22:24:17.653 INFO:teuthology.orchestra.run.smithi059.stdout:(20/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 2.1 MB/s | 369 kB 00:00 2023-09-30T22:24:17.753 INFO:teuthology.orchestra.run.smithi059.stdout:(21/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.1 MB/s | 114 kB 00:00 2023-09-30T22:24:17.836 INFO:teuthology.orchestra.run.smithi059.stdout:(22/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.0 MB/s | 88 kB 00:00 2023-09-30T22:24:18.797 INFO:teuthology.orchestra.run.smithi191.stdout:(6/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 3.8 MB/s | 24 MB 00:06 2023-09-30T22:24:18.803 INFO:teuthology.orchestra.run.smithi059.stdout:(23/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 3.8 MB/s | 3.7 MB 00:00 2023-09-30T22:24:18.895 INFO:teuthology.orchestra.run.smithi059.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 1.9 MB/s | 173 kB 00:00 2023-09-30T22:24:18.979 INFO:teuthology.orchestra.run.smithi059.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 292 kB/s | 24 kB 00:00 2023-09-30T22:24:19.362 INFO:teuthology.orchestra.run.smithi191.stdout:(7/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 1.4 MB/s | 5.0 MB 00:03 2023-09-30T22:24:19.437 INFO:teuthology.orchestra.run.smithi191.stdout:(8/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 343 kB/s | 26 kB 00:00 2023-09-30T22:24:19.988 INFO:teuthology.orchestra.run.smithi059.stdout:(26/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 3.1 MB/s | 3.1 MB 00:01 2023-09-30T22:24:20.421 INFO:teuthology.orchestra.run.smithi059.stdout:(27/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 9.5 MB/s | 52 MB 00:05 2023-09-30T22:24:20.957 INFO:teuthology.orchestra.run.smithi059.stdout:(28/122): ceph-mgr-modules-core-16.2.14-44.geeb 457 kB/s | 244 kB 00:00 2023-09-30T22:24:21.097 INFO:teuthology.orchestra.run.smithi059.stdout:(29/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 196 kB/s | 27 kB 00:00 2023-09-30T22:24:21.189 INFO:teuthology.orchestra.run.smithi059.stdout:(30/122): ceph-prometheus-alerts-16.2.14-44.gee 162 kB/s | 15 kB 00:00 2023-09-30T22:24:21.689 INFO:teuthology.orchestra.run.smithi059.stdout:(31/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86 2.3 MB/s | 18 MB 00:07 2023-09-30T22:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout:(32/122): bison-3.0.4-10.el8.x86_64.rpm 918 kB/s | 688 kB 00:00 2023-09-30T22:24:22.093 INFO:teuthology.orchestra.run.smithi059.stdout:(33/122): jq-1.6-7.el8.x86_64.rpm 1.3 MB/s | 202 kB 00:00 2023-09-30T22:24:22.240 INFO:teuthology.orchestra.run.smithi059.stdout:(34/122): librdkafka-0.11.4-3.el8.x86_64.rpm 2.4 MB/s | 354 kB 00:00 2023-09-30T22:24:22.265 INFO:teuthology.orchestra.run.smithi059.stdout:(35/122): flex-2.6.1-9.el8.x86_64.rpm 555 kB/s | 320 kB 00:00 2023-09-30T22:24:22.374 INFO:teuthology.orchestra.run.smithi059.stdout:(36/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2023-09-30T22:24:22.399 INFO:teuthology.orchestra.run.smithi059.stdout:(37/122): oniguruma-6.8.2-2.el8.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-09-30T22:24:22.684 INFO:teuthology.orchestra.run.smithi191.stdout:(9/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8. 3.0 MB/s | 12 MB 00:03 2023-09-30T22:24:22.787 INFO:teuthology.orchestra.run.smithi191.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 248 kB/s | 25 kB 00:00 2023-09-30T22:24:22.791 INFO:teuthology.orchestra.run.smithi059.stdout:(38/122): openblas-0.3.15-4.el8.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2023-09-30T22:24:22.900 INFO:teuthology.orchestra.run.smithi059.stdout:(39/122): openblas-threads-0.3.15-4.el8.x86_64. 9.7 MB/s | 4.9 MB 00:00 2023-09-30T22:24:22.925 INFO:teuthology.orchestra.run.smithi059.stdout:(40/122): python3-jsonpatch-1.21-2.el8.noarch.r 199 kB/s | 27 kB 00:00 2023-09-30T22:24:23.009 INFO:teuthology.orchestra.run.smithi059.stdout:(41/122): python3-jsonpointer-1.10-11.el8.noarc 184 kB/s | 20 kB 00:00 2023-09-30T22:24:23.034 INFO:teuthology.orchestra.run.smithi059.stdout:(42/122): python3-mako-1.0.6-14.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2023-09-30T22:24:23.104 INFO:teuthology.orchestra.run.smithi191.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 2.5 MB/s | 824 kB 00:00 2023-09-30T22:24:23.109 INFO:teuthology.orchestra.run.smithi059.stdout:(43/122): python3-markupsafe-0.23-19.el8.x86_64 387 kB/s | 39 kB 00:00 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi191.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 1.6 MB/s | 174 kB 00:00 2023-09-30T22:24:23.235 INFO:teuthology.orchestra.run.smithi059.stdout:(44/122): ceph-mgr-diskprediction-local-16.2.14 2.6 MB/s | 8.6 MB 00:03 2023-09-30T22:24:23.260 INFO:teuthology.orchestra.run.smithi059.stdout:(45/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.5 MB/s | 225 kB 00:00 2023-09-30T22:24:23.327 INFO:teuthology.orchestra.run.smithi059.stdout:(46/122): python3-numpy-1.14.3-10.el8.x86_64.rp 13 MB/s | 3.7 MB 00:00 2023-09-30T22:24:23.330 INFO:teuthology.orchestra.run.smithi191.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 1.1 MB/s | 131 kB 00:00 2023-09-30T22:24:23.369 INFO:teuthology.orchestra.run.smithi059.stdout:(47/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 954 kB/s | 103 kB 00:00 2023-09-30T22:24:23.436 INFO:teuthology.orchestra.run.smithi059.stdout:(48/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-09-30T22:24:23.469 INFO:teuthology.orchestra.run.smithi059.stdout:(49/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.1 MB/s | 110 kB 00:00 2023-09-30T22:24:23.536 INFO:teuthology.orchestra.run.smithi059.stdout:(50/122): python3-pytz-2017.2-11.el8.noarch.rpm 568 kB/s | 57 kB 00:00 2023-09-30T22:24:23.578 INFO:teuthology.orchestra.run.smithi059.stdout:(51/122): python3-prettytable-0.7.2-14.el8.noar 128 kB/s | 44 kB 00:00 2023-09-30T22:24:23.597 INFO:teuthology.orchestra.run.smithi191.stdout:(14/122): libradosstriper1-16.2.14-44.geeb13ac9 1.8 MB/s | 493 kB 00:00 2023-09-30T22:24:23.670 INFO:teuthology.orchestra.run.smithi059.stdout:(52/122): python3-werkzeug-0.12.2-4.el8.noarch. 3.3 MB/s | 457 kB 00:00 2023-09-30T22:24:23.779 INFO:teuthology.orchestra.run.smithi059.stdout:(53/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 653 kB/s | 71 kB 00:00 2023-09-30T22:24:23.912 INFO:teuthology.orchestra.run.smithi059.stdout:(54/122): elfutils-libelf-devel-0.189-3.el8.x86 463 kB/s | 62 kB 00:00 2023-09-30T22:24:23.938 INFO:teuthology.orchestra.run.smithi059.stdout:(55/122): socat-1.7.4.1-1.el8.x86_64.rpm 899 kB/s | 323 kB 00:00 2023-09-30T22:24:24.105 INFO:teuthology.orchestra.run.smithi059.stdout:(56/122): python3-scipy-1.0.0-21.module_el8.5.0 22 MB/s | 14 MB 00:00 2023-09-30T22:24:24.130 INFO:teuthology.orchestra.run.smithi059.stdout:(57/122): fuse-2.9.7-17.el8.x86_64.rpm 382 kB/s | 83 kB 00:00 2023-09-30T22:24:24.214 INFO:teuthology.orchestra.run.smithi059.stdout:(58/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 174 kB/s | 48 kB 00:00 2023-09-30T22:24:24.239 INFO:teuthology.orchestra.run.smithi059.stdout:(59/122): libcom_err-devel-1.45.6-5.el8.x86_64. 357 kB/s | 39 kB 00:00 2023-09-30T22:24:24.272 INFO:teuthology.orchestra.run.smithi059.stdout:(60/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.3 MB/s | 561 kB 00:00 2023-09-30T22:24:24.322 INFO:teuthology.orchestra.run.smithi059.stdout:(61/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 946 kB/s | 47 kB 00:00 2023-09-30T22:24:24.348 INFO:teuthology.orchestra.run.smithi059.stdout:(62/122): libquadmath-8.5.0-20.el8.x86_64.rpm 1.5 MB/s | 172 kB 00:00 2023-09-30T22:24:24.406 INFO:teuthology.orchestra.run.smithi059.stdout:(63/122): libselinux-devel-2.9-8.el8.x86_64.rpm 2.3 MB/s | 200 kB 00:00 2023-09-30T22:24:24.433 INFO:teuthology.orchestra.run.smithi059.stdout:(64/122): libgfortran-8.5.0-20.el8.x86_64.rpm 2.9 MB/s | 645 kB 00:00 2023-09-30T22:24:24.457 INFO:teuthology.orchestra.run.smithi059.stdout:(65/122): libsepol-devel-2.9-3.el8.x86_64.rpm 799 kB/s | 87 kB 00:00 2023-09-30T22:24:24.474 INFO:teuthology.orchestra.run.smithi059.stdout:(66/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 268 kB/s | 18 kB 00:00 2023-09-30T22:24:24.499 INFO:teuthology.orchestra.run.smithi059.stdout:(67/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-09-30T22:24:24.558 INFO:teuthology.orchestra.run.smithi059.stdout:(68/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-09-30T22:24:24.583 INFO:teuthology.orchestra.run.smithi059.stdout:(69/122): pcre2-devel-10.32-3.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-09-30T22:24:24.617 INFO:teuthology.orchestra.run.smithi059.stdout:(70/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-09-30T22:24:24.642 INFO:teuthology.orchestra.run.smithi059.stdout:(71/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.2 MB/s | 249 kB 00:00 2023-09-30T22:24:24.683 INFO:teuthology.orchestra.run.smithi059.stdout:(72/122): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-09-30T22:24:24.726 INFO:teuthology.orchestra.run.smithi059.stdout:(73/122): python3-cryptography-3.2.1-6.el8.x86_ 5.8 MB/s | 641 kB 00:00 2023-09-30T22:24:24.751 INFO:teuthology.orchestra.run.smithi059.stdout:(74/122): python3-oauthlib-2.1.0-1.el8.noarch.r 2.3 MB/s | 155 kB 00:00 2023-09-30T22:24:24.784 INFO:teuthology.orchestra.run.smithi059.stdout:(75/122): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-09-30T22:24:24.810 INFO:teuthology.orchestra.run.smithi059.stdout:(76/122): python3-requests-oauthlib-1.0.0-1.el8 727 kB/s | 43 kB 00:00 2023-09-30T22:24:24.835 INFO:teuthology.orchestra.run.smithi059.stdout:(77/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-09-30T22:24:24.919 INFO:teuthology.orchestra.run.smithi059.stdout:(78/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 6.9 MB/s | 3.2 MB 00:00 2023-09-30T22:24:25.122 INFO:teuthology.orchestra.run.smithi191.stdout:(15/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 2.5 MB/s | 3.8 MB 00:01 2023-09-30T22:24:25.164 INFO:teuthology.orchestra.run.smithi059.stdout:(79/122): liboath-2.6.2-3.el8.x86_64.rpm 240 kB/s | 59 kB 00:00 2023-09-30T22:24:25.219 INFO:teuthology.orchestra.run.smithi059.stdout:(80/122): leveldb-1.22-1.el8.x86_64.rpm 471 kB/s | 181 kB 00:00 2023-09-30T22:24:25.239 INFO:teuthology.orchestra.run.smithi191.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 387 kB/s | 45 kB 00:00 2023-09-30T22:24:25.244 INFO:teuthology.orchestra.run.smithi059.stdout:(81/122): gperftools-libs-2.7-9.el8.x86_64.rpm 705 kB/s | 306 kB 00:00 2023-09-30T22:24:25.278 INFO:teuthology.orchestra.run.smithi059.stdout:(82/122): libunwind-1.3.1-3.el8.x86_64.rpm 660 kB/s | 75 kB 00:00 2023-09-30T22:24:25.339 INFO:teuthology.orchestra.run.smithi191.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 988 kB/s | 99 kB 00:00 2023-09-30T22:24:25.345 INFO:teuthology.orchestra.run.smithi059.stdout:(83/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 347 kB/s | 44 kB 00:00 2023-09-30T22:24:25.370 INFO:teuthology.orchestra.run.smithi059.stdout:(84/122): python3-cachetools-3.1.1-4.el8.noarch 358 kB/s | 33 kB 00:00 2023-09-30T22:24:25.404 INFO:teuthology.orchestra.run.smithi059.stdout:(85/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2023-09-30T22:24:25.429 INFO:teuthology.orchestra.run.smithi059.stdout:(86/122): python3-certifi-2018.10.15-7.el8.noar 195 kB/s | 16 kB 00:00 2023-09-30T22:24:25.464 INFO:teuthology.orchestra.run.smithi191.stdout:(18/122): python3-cephfs-16.2.14-44.geeb13ac9.e 1.7 MB/s | 215 kB 00:00 2023-09-30T22:24:25.479 INFO:teuthology.orchestra.run.smithi059.stdout:(87/122): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2023-09-30T22:24:25.521 INFO:teuthology.orchestra.run.smithi059.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 883 kB/s | 81 kB 00:00 2023-09-30T22:24:25.555 INFO:teuthology.orchestra.run.smithi059.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-09-30T22:24:25.597 INFO:teuthology.orchestra.run.smithi059.stdout:(90/122): python3-jaraco-functools-2.0-4.el8.no 234 kB/s | 18 kB 00:00 2023-09-30T22:24:25.622 INFO:teuthology.orchestra.run.smithi059.stdout:(91/122): python3-cherrypy-18.4.0-1.el8.noarch. 1.7 MB/s | 384 kB 00:00 2023-09-30T22:24:25.680 INFO:teuthology.orchestra.run.smithi059.stdout:(92/122): python3-logutils-0.3.5-11.el8.noarch. 583 kB/s | 49 kB 00:00 2023-09-30T22:24:25.690 INFO:teuthology.orchestra.run.smithi191.stdout:(19/122): python3-rados-16.2.14-44.geeb13ac9.el 1.7 MB/s | 390 kB 00:00 2023-09-30T22:24:25.714 INFO:teuthology.orchestra.run.smithi059.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 638 kB/s | 59 kB 00:00 2023-09-30T22:24:25.789 INFO:teuthology.orchestra.run.smithi059.stdout:(94/122): python3-kubernetes-11.0.0-6.el8.noarc 5.0 MB/s | 1.2 MB 00:00 2023-09-30T22:24:25.814 INFO:teuthology.orchestra.run.smithi059.stdout:(95/122): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-09-30T22:24:25.840 INFO:teuthology.orchestra.run.smithi059.stdout:(96/122): python3-portend-2.6-1.el8.noarch.rpm 124 kB/s | 16 kB 00:00 2023-09-30T22:24:25.890 INFO:teuthology.orchestra.run.smithi191.stdout:(20/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 1.8 MB/s | 369 kB 00:00 2023-09-30T22:24:25.890 INFO:teuthology.orchestra.run.smithi059.stdout:(97/122): python3-repoze-lru-0.7-6.el8.noarch.r 334 kB/s | 34 kB 00:00 2023-09-30T22:24:25.941 INFO:teuthology.orchestra.run.smithi059.stdout:(98/122): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-09-30T22:24:25.966 INFO:teuthology.orchestra.run.smithi059.stdout:(99/122): python3-rsa-4.9-2.el8.noarch.rpm 511 kB/s | 64 kB 00:00 2023-09-30T22:24:25.991 INFO:teuthology.orchestra.run.smithi059.stdout:(100/122): python3-simplegeneric-0.8.1-17.el8.n 186 kB/s | 19 kB 00:00 2023-09-30T22:24:26.015 INFO:teuthology.orchestra.run.smithi191.stdout:(21/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 915 kB/s | 114 kB 00:00 2023-09-30T22:24:26.016 INFO:teuthology.orchestra.run.smithi059.stdout:(101/122): python3-singledispatch-3.4.0.3-18.el 317 kB/s | 24 kB 00:00 2023-09-30T22:24:26.050 INFO:teuthology.orchestra.run.smithi059.stdout:(102/122): python3-tempora-1.14.1-5.el8.noarch. 348 kB/s | 29 kB 00:00 2023-09-30T22:24:26.084 INFO:teuthology.orchestra.run.smithi059.stdout:(103/122): python3-trustme-0.6.0-4.el8.noarch.r 299 kB/s | 27 kB 00:00 2023-09-30T22:24:26.124 INFO:teuthology.orchestra.run.smithi191.stdout:(22/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 816 kB/s | 88 kB 00:00 2023-09-30T22:24:26.125 INFO:teuthology.orchestra.run.smithi059.stdout:(104/122): python3-waitress-1.4.3-1.el8.noarch. 2.3 MB/s | 255 kB 00:00 2023-09-30T22:24:26.159 INFO:teuthology.orchestra.run.smithi059.stdout:(105/122): python3-websocket-client-0.56.0-5.el 814 kB/s | 61 kB 00:00 2023-09-30T22:24:26.184 INFO:teuthology.orchestra.run.smithi059.stdout:(106/122): python3-webob-1.8.5-1.el8.1.noarch.r 1.8 MB/s | 251 kB 00:00 2023-09-30T22:24:26.210 INFO:teuthology.orchestra.run.smithi059.stdout:(107/122): python3-webtest-2.0.33-1.el8.noarch. 1.0 MB/s | 85 kB 00:00 2023-09-30T22:24:26.310 INFO:teuthology.orchestra.run.smithi059.stdout:(108/122): python3-zc-lockfile-2.0-2.el8.noarch 152 kB/s | 23 kB 00:00 2023-09-30T22:24:26.502 INFO:teuthology.orchestra.run.smithi059.stdout:(109/122): NetworkManager-initscripts-updown-1. 750 kB/s | 143 kB 00:00 2023-09-30T22:24:26.560 INFO:teuthology.orchestra.run.smithi059.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 1.3 MB/s | 76 kB 00:00 2023-09-30T22:24:26.636 INFO:teuthology.orchestra.run.smithi059.stdout:(111/122): elfutils-libelf-0.189-3.el8.x86_64.r 3.0 MB/s | 232 kB 00:00 2023-09-30T22:24:26.719 INFO:teuthology.orchestra.run.smithi059.stdout:(112/122): elfutils-libs-0.189-3.el8.x86_64.rpm 3.6 MB/s | 303 kB 00:00 2023-09-30T22:24:26.870 INFO:teuthology.orchestra.run.smithi059.stdout:(113/122): iproute-6.2.0-2.el8.x86_64.rpm 5.7 MB/s | 880 kB 00:00 2023-09-30T22:24:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:(114/122): libblkid-2.32.1-43.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-09-30T22:24:26.987 INFO:teuthology.orchestra.run.smithi059.stdout:(115/122): libfdisk-2.32.1-43.el8.x86_64.rpm 4.2 MB/s | 254 kB 00:00 2023-09-30T22:24:27.045 INFO:teuthology.orchestra.run.smithi059.stdout:(116/122): libmount-2.32.1-43.el8.x86_64.rpm 4.0 MB/s | 236 kB 00:00 2023-09-30T22:24:27.104 INFO:teuthology.orchestra.run.smithi059.stdout:(117/122): libsmartcols-2.32.1-43.el8.x86_64.rp 3.0 MB/s | 179 kB 00:00 2023-09-30T22:24:27.162 INFO:teuthology.orchestra.run.smithi059.stdout:(118/122): libuuid-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 99 kB 00:00 2023-09-30T22:24:27.207 INFO:teuthology.orchestra.run.smithi191.stdout:(23/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 3.4 MB/s | 3.7 MB 00:01 2023-09-30T22:24:27.308 INFO:teuthology.orchestra.run.smithi191.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 1.7 MB/s | 173 kB 00:00 2023-09-30T22:24:27.424 INFO:teuthology.orchestra.run.smithi191.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 209 kB/s | 24 kB 00:00 2023-09-30T22:24:27.496 INFO:teuthology.orchestra.run.smithi059.stdout:(119/122): util-linux-2.32.1-43.el8.x86_64.rpm 7.4 MB/s | 2.5 MB 00:00 2023-09-30T22:24:27.538 INFO:teuthology.orchestra.run.smithi059.stdout:(120/122): util-linux-user-2.32.1-43.el8.x86_64 2.4 MB/s | 103 kB 00:00 2023-09-30T22:24:27.647 INFO:teuthology.orchestra.run.smithi059.stdout:(121/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 2.9 MB/s | 4.2 MB 00:01 2023-09-30T22:24:28.188 INFO:teuthology.orchestra.run.smithi059.stdout:(122/122): librados2-16.2.14-44.geeb13ac9.el8.x 1.9 MB/s | 3.7 MB 00:02 2023-09-30T22:24:28.191 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:24:28.191 INFO:teuthology.orchestra.run.smithi059.stdout:Total 12 MB/s | 200 MB 00:16 2023-09-30T22:24:28.791 INFO:teuthology.orchestra.run.smithi191.stdout:(26/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 2.3 MB/s | 3.1 MB 00:01 2023-09-30T22:24:28.984 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2023-09-30T22:24:29.240 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2023-09-30T22:24:29.240 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2023-09-30T22:24:30.242 INFO:teuthology.orchestra.run.smithi191.stdout:(27/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86 1.3 MB/s | 18 MB 00:14 2023-09-30T22:24:30.442 INFO:teuthology.orchestra.run.smithi191.stdout:(28/122): ceph-mgr-modules-core-16.2.14-44.geeb 1.2 MB/s | 244 kB 00:00 2023-09-30T22:24:30.558 INFO:teuthology.orchestra.run.smithi191.stdout:(29/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 235 kB/s | 27 kB 00:00 2023-09-30T22:24:30.685 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2023-09-30T22:24:30.689 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2023-09-30T22:24:30.690 INFO:teuthology.orchestra.run.smithi191.stdout:(30/122): ceph-prometheus-alerts-16.2.14-44.gee 113 kB/s | 15 kB 00:00 2023-09-30T22:24:31.368 INFO:teuthology.orchestra.run.smithi191.stdout:(31/122): bison-3.0.4-10.el8.x86_64.rpm 1.0 MB/s | 688 kB 00:00 2023-09-30T22:24:31.501 INFO:teuthology.orchestra.run.smithi191.stdout:(32/122): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2023-09-30T22:24:31.618 INFO:teuthology.orchestra.run.smithi191.stdout:(33/122): jq-1.6-7.el8.x86_64.rpm 1.7 MB/s | 202 kB 00:00 2023-09-30T22:24:31.752 INFO:teuthology.orchestra.run.smithi191.stdout:(34/122): librdkafka-0.11.4-3.el8.x86_64.rpm 2.6 MB/s | 354 kB 00:00 2023-09-30T22:24:31.877 INFO:teuthology.orchestra.run.smithi191.stdout:(35/122): ceph-mgr-diskprediction-local-16.2.14 2.8 MB/s | 8.6 MB 00:03 2023-09-30T22:24:31.902 INFO:teuthology.orchestra.run.smithi191.stdout:(36/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.7 MB/s | 259 kB 00:00 2023-09-30T22:24:32.411 INFO:teuthology.orchestra.run.smithi191.stdout:(37/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 4.0 MB/s | 52 MB 00:12 2023-09-30T22:24:32.811 INFO:teuthology.orchestra.run.smithi191.stdout:(38/122): oniguruma-6.8.2-2.el8.x86_64.rpm 201 kB/s | 187 kB 00:00 2023-09-30T22:24:32.895 INFO:teuthology.orchestra.run.smithi191.stdout:(39/122): openblas-0.3.15-4.el8.x86_64.rpm 4.8 MB/s | 4.7 MB 00:00 2023-09-30T22:24:32.920 INFO:teuthology.orchestra.run.smithi191.stdout:(40/122): python3-jsonpatch-1.21-2.el8.noarch.r 245 kB/s | 27 kB 00:00 2023-09-30T22:24:32.995 INFO:teuthology.orchestra.run.smithi191.stdout:(41/122): python3-jsonpointer-1.10-11.el8.noarc 199 kB/s | 20 kB 00:00 2023-09-30T22:24:33.062 INFO:teuthology.orchestra.run.smithi191.stdout:(42/122): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2023-09-30T22:24:33.104 INFO:teuthology.orchestra.run.smithi191.stdout:(43/122): python3-markupsafe-0.23-19.el8.x86_64 357 kB/s | 39 kB 00:00 2023-09-30T22:24:33.238 INFO:teuthology.orchestra.run.smithi191.stdout:(44/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.6 MB/s | 225 kB 00:00 2023-09-30T22:24:33.371 INFO:teuthology.orchestra.run.smithi191.stdout:(45/122): python3-prettytable-0.7.2-14.el8.noar 329 kB/s | 44 kB 00:00 2023-09-30T22:24:33.438 INFO:teuthology.orchestra.run.smithi191.stdout:(46/122): openblas-threads-0.3.15-4.el8.x86_64. 4.7 MB/s | 4.9 MB 00:01 2023-09-30T22:24:33.480 INFO:teuthology.orchestra.run.smithi191.stdout:(47/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 952 kB/s | 103 kB 00:00 2023-09-30T22:24:33.572 INFO:teuthology.orchestra.run.smithi191.stdout:(48/122): python3-numpy-1.14.3-10.el8.x86_64.rp 7.3 MB/s | 3.7 MB 00:00 2023-09-30T22:24:33.597 INFO:teuthology.orchestra.run.smithi191.stdout:(49/122): python3-pyasn1-modules-0.3.7-6.el8.no 942 kB/s | 110 kB 00:00 2023-09-30T22:24:33.623 INFO:teuthology.orchestra.run.smithi191.stdout:(50/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 686 kB/s | 126 kB 00:00 2023-09-30T22:24:33.673 INFO:teuthology.orchestra.run.smithi191.stdout:(51/122): python3-pytz-2017.2-11.el8.noarch.rpm 568 kB/s | 57 kB 00:00 2023-09-30T22:24:33.732 INFO:teuthology.orchestra.run.smithi191.stdout:(52/122): python3-werkzeug-0.12.2-4.el8.noarch. 4.1 MB/s | 457 kB 00:00 2023-09-30T22:24:33.782 INFO:teuthology.orchestra.run.smithi191.stdout:(53/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2023-09-30T22:24:33.849 INFO:teuthology.orchestra.run.smithi191.stdout:(54/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 604 kB/s | 71 kB 00:00 2023-09-30T22:24:33.958 INFO:teuthology.orchestra.run.smithi191.stdout:(55/122): elfutils-libelf-devel-0.189-3.el8.x86 352 kB/s | 62 kB 00:00 2023-09-30T22:24:33.983 INFO:teuthology.orchestra.run.smithi191.stdout:(56/122): fuse-2.9.7-17.el8.x86_64.rpm 622 kB/s | 83 kB 00:00 2023-09-30T22:24:34.008 INFO:teuthology.orchestra.run.smithi191.stdout:(57/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 961 kB/s | 48 kB 00:00 2023-09-30T22:24:34.058 INFO:teuthology.orchestra.run.smithi191.stdout:(58/122): libcom_err-devel-1.45.6-5.el8.x86_64. 779 kB/s | 39 kB 00:00 2023-09-30T22:24:34.117 INFO:teuthology.orchestra.run.smithi191.stdout:(59/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 4.1 MB/s | 561 kB 00:00 2023-09-30T22:24:34.176 INFO:teuthology.orchestra.run.smithi191.stdout:(60/122): libquadmath-8.5.0-20.el8.x86_64.rpm 2.9 MB/s | 172 kB 00:00 2023-09-30T22:24:34.201 INFO:teuthology.orchestra.run.smithi191.stdout:(61/122): libgfortran-8.5.0-20.el8.x86_64.rpm 4.4 MB/s | 645 kB 00:00 2023-09-30T22:24:34.226 INFO:teuthology.orchestra.run.smithi191.stdout:(62/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 939 kB/s | 47 kB 00:00 2023-09-30T22:24:34.260 INFO:teuthology.orchestra.run.smithi191.stdout:(63/122): libselinux-devel-2.9-8.el8.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2023-09-30T22:24:34.285 INFO:teuthology.orchestra.run.smithi191.stdout:(64/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-09-30T22:24:34.333 INFO:teuthology.orchestra.run.smithi191.stdout:(65/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 247 kB/s | 18 kB 00:00 2023-09-30T22:24:34.361 INFO:teuthology.orchestra.run.smithi191.stdout:(66/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 583 kB/s | 44 kB 00:00 2023-09-30T22:24:34.470 INFO:teuthology.orchestra.run.smithi191.stdout:(67/122): pcre2-devel-10.32-3.el8.x86_64.rpm 5.5 MB/s | 605 kB 00:00 2023-09-30T22:24:34.528 INFO:teuthology.orchestra.run.smithi191.stdout:(68/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.9 MB/s | 229 kB 00:00 2023-09-30T22:24:34.661 INFO:teuthology.orchestra.run.smithi191.stdout:(69/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.6 MB/s | 220 kB 00:00 2023-09-30T22:24:34.853 INFO:teuthology.orchestra.run.smithi191.stdout:(70/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.3 MB/s | 249 kB 00:00 2023-09-30T22:24:34.912 INFO:teuthology.orchestra.run.smithi191.stdout:(71/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 5.5 MB/s | 3.2 MB 00:00 2023-09-30T22:24:35.054 INFO:teuthology.orchestra.run.smithi191.stdout:(72/122): python3-scipy-1.0.0-21.module_el8.5.0 9.4 MB/s | 14 MB 00:01 2023-09-30T22:24:35.071 INFO:teuthology.orchestra.run.smithi191.stdout:(73/122): python3-jwt-1.6.1-2.el8.noarch.rpm 269 kB/s | 43 kB 00:00 2023-09-30T22:24:35.105 INFO:teuthology.orchestra.run.smithi191.stdout:(74/122): python3-cryptography-3.2.1-6.el8.x86_ 2.5 MB/s | 641 kB 00:00 2023-09-30T22:24:35.130 INFO:teuthology.orchestra.run.smithi191.stdout:(75/122): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-09-30T22:24:35.147 INFO:teuthology.orchestra.run.smithi191.stdout:(76/122): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2023-09-30T22:24:35.172 INFO:teuthology.orchestra.run.smithi191.stdout:(77/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2023-09-30T22:24:35.239 INFO:teuthology.orchestra.run.smithi191.stdout:(78/122): python3-oauthlib-2.1.0-1.el8.noarch.r 840 kB/s | 155 kB 00:00 2023-09-30T22:24:35.356 INFO:teuthology.orchestra.run.smithi191.stdout:(79/122): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-09-30T22:24:35.381 INFO:teuthology.orchestra.run.smithi191.stdout:(80/122): liboath-2.6.2-3.el8.x86_64.rpm 417 kB/s | 59 kB 00:00 2023-09-30T22:24:35.407 INFO:teuthology.orchestra.run.smithi191.stdout:(81/122): leveldb-1.22-1.el8.x86_64.rpm 789 kB/s | 181 kB 00:00 2023-09-30T22:24:35.432 INFO:teuthology.orchestra.run.smithi191.stdout:(82/122): libunwind-1.3.1-3.el8.x86_64.rpm 996 kB/s | 75 kB 00:00 2023-09-30T22:24:35.457 INFO:teuthology.orchestra.run.smithi191.stdout:(83/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 577 kB/s | 44 kB 00:00 2023-09-30T22:24:35.482 INFO:teuthology.orchestra.run.smithi191.stdout:(84/122): python3-cachetools-3.1.1-4.el8.noarch 657 kB/s | 33 kB 00:00 2023-09-30T22:24:35.508 INFO:teuthology.orchestra.run.smithi191.stdout:(85/122): python3-certifi-2018.10.15-7.el8.noar 325 kB/s | 16 kB 00:00 2023-09-30T22:24:35.533 INFO:teuthology.orchestra.run.smithi191.stdout:(86/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-09-30T22:24:35.558 INFO:teuthology.orchestra.run.smithi191.stdout:(87/122): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-09-30T22:24:35.584 INFO:teuthology.orchestra.run.smithi191.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-09-30T22:24:35.618 INFO:teuthology.orchestra.run.smithi191.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 189 kB/s | 11 kB 00:00 2023-09-30T22:24:35.643 INFO:teuthology.orchestra.run.smithi191.stdout:(90/122): python3-jaraco-functools-2.0-4.el8.no 299 kB/s | 18 kB 00:00 2023-09-30T22:24:35.668 INFO:teuthology.orchestra.run.smithi191.stdout:(91/122): python3-cherrypy-18.4.0-1.el8.noarch. 2.3 MB/s | 384 kB 00:00 2023-09-30T22:24:35.693 INFO:teuthology.orchestra.run.smithi191.stdout:(92/122): python3-logutils-0.3.5-11.el8.noarch. 973 kB/s | 49 kB 00:00 2023-09-30T22:24:35.714 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2023-09-30T22:24:35.718 INFO:teuthology.orchestra.run.smithi191.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-09-30T22:24:35.754 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-09-30T22:24:35.760 INFO:teuthology.orchestra.run.smithi191.stdout:(94/122): python3-kubernetes-11.0.0-6.el8.noarc 8.2 MB/s | 1.2 MB 00:00 2023-09-30T22:24:35.786 INFO:teuthology.orchestra.run.smithi191.stdout:(95/122): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-09-30T22:24:35.811 INFO:teuthology.orchestra.run.smithi191.stdout:(96/122): python3-portend-2.6-1.el8.noarch.rpm 169 kB/s | 16 kB 00:00 2023-09-30T22:24:35.858 INFO:teuthology.orchestra.run.smithi191.stdout:(97/122): python3-repoze-lru-0.7-6.el8.noarch.r 345 kB/s | 34 kB 00:00 2023-09-30T22:24:35.878 INFO:teuthology.orchestra.run.smithi191.stdout:(98/122): python3-rsa-4.9-2.el8.noarch.rpm 965 kB/s | 64 kB 00:00 2023-09-30T22:24:35.903 INFO:teuthology.orchestra.run.smithi191.stdout:(99/122): python3-simplegeneric-0.8.1-17.el8.no 418 kB/s | 19 kB 00:00 2023-09-30T22:24:35.928 INFO:teuthology.orchestra.run.smithi191.stdout:(100/122): python3-singledispatch-3.4.0.3-18.el 477 kB/s | 24 kB 00:00 2023-09-30T22:24:35.941 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-09-30T22:24:35.954 INFO:teuthology.orchestra.run.smithi191.stdout:(101/122): python3-routes-2.4.1-12.el8.noarch.r 1.3 MB/s | 196 kB 00:00 2023-09-30T22:24:35.979 INFO:teuthology.orchestra.run.smithi191.stdout:(102/122): python3-tempora-1.14.1-5.el8.noarch. 388 kB/s | 29 kB 00:00 2023-09-30T22:24:36.004 INFO:teuthology.orchestra.run.smithi191.stdout:(103/122): python3-trustme-0.6.0-4.el8.noarch.r 365 kB/s | 27 kB 00:00 2023-09-30T22:24:36.029 INFO:teuthology.orchestra.run.smithi191.stdout:(104/122): python3-waitress-1.4.3-1.el8.noarch. 3.3 MB/s | 255 kB 00:00 2023-09-30T22:24:36.055 INFO:teuthology.orchestra.run.smithi191.stdout:(105/122): python3-webob-1.8.5-1.el8.1.noarch.r 3.3 MB/s | 251 kB 00:00 2023-09-30T22:24:36.080 INFO:teuthology.orchestra.run.smithi191.stdout:(106/122): python3-websocket-client-0.56.0-5.el 811 kB/s | 61 kB 00:00 2023-09-30T22:24:36.105 INFO:teuthology.orchestra.run.smithi191.stdout:(107/122): python3-zc-lockfile-2.0-2.el8.noarch 456 kB/s | 23 kB 00:00 2023-09-30T22:24:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-09-30T22:24:36.131 INFO:teuthology.orchestra.run.smithi191.stdout:(108/122): python3-webtest-2.0.33-1.el8.noarch. 846 kB/s | 85 kB 00:00 2023-09-30T22:24:36.254 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:24:36.273 INFO:teuthology.orchestra.run.smithi191.stdout:(109/122): NetworkManager-initscripts-updown-1. 1.0 MB/s | 143 kB 00:00 2023-09-30T22:24:36.315 INFO:teuthology.orchestra.run.smithi191.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 1.8 MB/s | 76 kB 00:00 2023-09-30T22:24:36.334 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:24:36.381 INFO:teuthology.orchestra.run.smithi191.stdout:(111/122): elfutils-libelf-0.189-3.el8.x86_64.r 3.4 MB/s | 232 kB 00:00 2023-09-30T22:24:36.465 INFO:teuthology.orchestra.run.smithi191.stdout:(112/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 12 MB/s | 4.2 MB 00:00 2023-09-30T22:24:36.499 INFO:teuthology.orchestra.run.smithi191.stdout:(113/122): elfutils-libs-0.189-3.el8.x86_64.rpm 2.5 MB/s | 303 kB 00:00 2023-09-30T22:24:36.504 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:24:36.557 INFO:teuthology.orchestra.run.smithi191.stdout:(114/122): libblkid-2.32.1-43.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-09-30T22:24:36.590 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:24:36.641 INFO:teuthology.orchestra.run.smithi191.stdout:(115/122): libfdisk-2.32.1-43.el8.x86_64.rpm 3.0 MB/s | 254 kB 00:00 2023-09-30T22:24:36.700 INFO:teuthology.orchestra.run.smithi191.stdout:(116/122): libmount-2.32.1-43.el8.x86_64.rpm 4.0 MB/s | 236 kB 00:00 2023-09-30T22:24:36.725 INFO:teuthology.orchestra.run.smithi191.stdout:(117/122): iproute-6.2.0-2.el8.x86_64.rpm 3.3 MB/s | 880 kB 00:00 2023-09-30T22:24:36.758 INFO:teuthology.orchestra.run.smithi191.stdout:(118/122): libsmartcols-2.32.1-43.el8.x86_64.rp 3.0 MB/s | 179 kB 00:00 2023-09-30T22:24:36.768 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-09-30T22:24:36.784 INFO:teuthology.orchestra.run.smithi191.stdout:(119/122): libuuid-2.32.1-43.el8.x86_64.rpm 1.6 MB/s | 99 kB 00:00 2023-09-30T22:24:36.872 INFO:teuthology.orchestra.run.smithi191.stdout:(120/122): util-linux-user-2.32.1-43.el8.x86_64 1.1 MB/s | 103 kB 00:00 2023-09-30T22:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-09-30T22:24:37.126 INFO:teuthology.orchestra.run.smithi191.stdout:(121/122): util-linux-2.32.1-43.el8.x86_64.rpm 6.7 MB/s | 2.5 MB 00:00 2023-09-30T22:24:37.129 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:24:37.260 INFO:teuthology.orchestra.run.smithi191.stdout:(122/122): librados2-16.2.14-44.geeb13ac9.el8.x 3.2 MB/s | 3.7 MB 00:01 2023-09-30T22:24:37.264 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:24:37.265 INFO:teuthology.orchestra.run.smithi191.stdout:Total 7.4 MB/s | 200 MB 00:27 2023-09-30T22:24:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:24:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:24:37.973 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2023-09-30T22:24:38.195 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2023-09-30T22:24:38.196 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2023-09-30T22:24:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:24:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:24:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:24:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:24:38.956 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:24:39.190 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:24:39.346 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:24:39.529 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2023-09-30T22:24:39.532 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2023-09-30T22:24:39.758 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:24:39.887 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:24:39.952 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:24:40.161 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-09-30T22:24:40.346 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-09-30T22:24:40.470 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:24:40.620 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:24:40.745 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:24:40.876 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:24:41.061 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-09-30T22:24:41.208 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-09-30T22:24:41.354 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:24:41.493 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:24:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:24:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:24:42.454 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:24:43.136 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:24:43.279 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:24:44.052 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:24:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2023-09-30T22:24:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-09-30T22:24:44.359 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-09-30T22:24:44.542 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-09-30T22:24:44.591 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-09-30T22:24:44.751 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-09-30T22:24:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-09-30T22:24:44.935 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:24:44.987 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-09-30T22:24:45.011 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:24:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:24:45.240 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-09-30T22:24:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:24:45.395 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:24:45.499 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-09-30T22:24:45.740 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-09-30T22:24:45.969 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:24:46.349 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:24:46.543 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:24:46.936 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:24:47.135 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:24:47.260 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:24:47.399 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:24:47.477 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:24:47.580 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:24:47.709 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-09-30T22:24:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:24:47.912 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-09-30T22:24:47.993 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:24:48.117 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-09-30T22:24:48.375 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:24:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-09-30T22:24:48.534 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:24:48.559 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-09-30T22:24:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:24:48.773 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-09-30T22:24:48.830 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-09-30T22:24:48.933 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-09-30T22:24:49.083 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-09-30T22:24:49.138 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-09-30T22:24:49.226 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:24:49.311 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:24:49.317 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:24:49.388 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:24:49.484 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:24:49.561 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:24:49.591 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:24:49.634 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:24:49.790 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-09-30T22:24:49.811 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:24:49.984 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-09-30T22:24:50.117 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:24:50.253 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:24:50.363 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:24:50.426 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:24:50.653 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:24:50.672 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:24:50.844 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-09-30T22:24:51.084 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-09-30T22:24:51.180 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-09-30T22:24:51.417 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:24:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-09-30T22:24:51.682 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-09-30T22:24:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-09-30T22:24:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:24:52.109 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-09-30T22:24:52.217 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:24:52.264 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-09-30T22:24:52.434 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-09-30T22:24:52.604 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-09-30T22:24:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-09-30T22:24:52.895 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:24:53.007 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-09-30T22:24:53.227 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-09-30T22:24:53.479 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-09-30T22:24:53.556 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-09-30T22:24:53.681 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-09-30T22:24:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-09-30T22:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-09-30T22:24:54.113 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-09-30T22:24:54.142 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-09-30T22:24:54.300 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:24:54.347 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-09-30T22:24:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-09-30T22:24:54.949 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-09-30T22:24:55.334 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-09-30T22:24:55.468 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-09-30T22:24:55.704 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-09-30T22:24:55.955 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-09-30T22:24:56.083 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:24:56.370 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-09-30T22:24:56.567 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-09-30T22:24:56.795 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-09-30T22:24:57.084 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-09-30T22:24:57.137 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-09-30T22:24:57.287 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-09-30T22:24:57.354 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-09-30T22:24:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-09-30T22:24:57.588 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-09-30T22:24:57.748 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-09-30T22:24:57.788 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-09-30T22:24:57.958 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-09-30T22:24:58.024 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-09-30T22:24:58.149 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:24:58.231 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:24:58.242 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-09-30T22:24:58.416 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:24:58.495 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:24:58.539 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-09-30T22:24:58.666 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:24:58.749 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-09-30T22:24:58.887 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-09-30T22:24:59.080 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-09-30T22:24:59.192 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:24:59.376 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-09-30T22:24:59.475 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:24:59.491 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:24:59.590 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-09-30T22:24:59.677 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-09-30T22:24:59.775 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-09-30T22:24:59.952 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-09-30T22:24:59.984 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-09-30T22:25:00.171 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-09-30T22:25:00.231 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-09-30T22:25:00.347 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-09-30T22:25:00.462 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-09-30T22:25:00.618 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-09-30T22:25:00.644 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-09-30T22:25:00.794 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-09-30T22:25:00.843 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-09-30T22:25:00.949 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-09-30T22:25:01.069 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-09-30T22:25:01.244 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-09-30T22:25:01.458 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-09-30T22:25:01.472 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-09-30T22:25:01.632 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-09-30T22:25:01.712 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-09-30T22:25:01.799 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-09-30T22:25:01.868 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-09-30T22:25:02.033 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-09-30T22:25:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-09-30T22:25:02.502 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-09-30T22:25:02.733 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-09-30T22:25:02.986 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-09-30T22:25:03.215 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-09-30T22:25:03.422 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-09-30T22:25:03.814 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-09-30T22:25:04.130 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-09-30T22:25:04.325 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-09-30T22:25:04.573 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:25:04.577 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-09-30T22:25:04.768 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:25:04.811 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-09-30T22:25:05.555 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:25:05.894 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-09-30T22:25:05.899 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:25:06.022 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:25:06.156 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-09-30T22:25:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:25:06.406 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-09-30T22:25:06.641 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-09-30T22:25:06.901 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-09-30T22:25:07.143 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-09-30T22:25:07.449 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-09-30T22:25:07.686 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-09-30T22:25:07.842 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-09-30T22:25:08.045 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-09-30T22:25:08.342 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-09-30T22:25:08.618 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-09-30T22:25:08.778 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-09-30T22:25:09.015 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-09-30T22:25:09.233 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-09-30T22:25:09.425 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-09-30T22:25:09.738 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-09-30T22:25:09.949 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-09-30T22:25:10.144 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-09-30T22:25:10.345 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-09-30T22:25:10.660 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-09-30T22:25:10.939 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-09-30T22:25:11.114 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-09-30T22:25:13.742 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:25:13.972 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:25:14.677 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:25:14.997 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:25:15.117 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:25:15.296 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:25:27.218 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:25:27.218 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2023-09-30T22:25:27.218 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2023-09-30T22:25:27.218 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /dev 2023-09-30T22:25:27.219 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /run 2023-09-30T22:25:27.219 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2023-09-30T22:25:27.219 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2023-09-30T22:25:27.219 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2023-09-30T22:25:27.219 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2023-09-30T22:25:27.219 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /dev 2023-09-30T22:25:27.219 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:25:27.696 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:25:28.174 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:25:28.348 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:25:29.995 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:25:30.190 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:25:30.231 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:25:30.455 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-09-30T22:25:30.784 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-09-30T22:25:31.064 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-09-30T22:25:31.265 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-09-30T22:25:31.605 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-09-30T22:25:31.739 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:25:31.820 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:25:31.984 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-09-30T22:25:32.105 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-09-30T22:25:33.301 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-09-30T22:25:33.544 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:25:33.732 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:25:33.733 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /sys 2023-09-30T22:25:33.733 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /proc 2023-09-30T22:25:33.733 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /dev 2023-09-30T22:25:33.733 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /run 2023-09-30T22:25:33.733 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /mnt 2023-09-30T22:25:33.733 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /var/tmp 2023-09-30T22:25:33.733 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /home 2023-09-30T22:25:33.733 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /tmp 2023-09-30T22:25:33.733 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /dev 2023-09-30T22:25:33.733 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:25:34.167 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:25:34.604 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:25:34.702 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:25:34.826 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:25:34.888 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:25:34.993 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:25:35.393 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-09-30T22:25:35.578 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:25:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:25:35.780 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:25:35.794 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:25:36.309 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:25:36.526 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:25:36.560 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:25:36.770 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-09-30T22:25:37.110 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-09-30T22:25:37.432 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-09-30T22:25:37.650 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-09-30T22:25:37.929 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-09-30T22:25:38.084 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:25:38.164 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:25:38.370 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-09-30T22:25:38.516 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-09-30T22:25:39.556 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-09-30T22:25:39.850 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:25:40.889 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:25:40.912 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-09-30T22:25:41.108 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:25:41.199 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:25:41.608 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-09-30T22:25:41.842 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:25:41.868 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:25:42.050 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:25:42.061 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:25:42.218 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:25:42.452 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:25:42.895 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:25:43.105 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:25:43.210 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:25:44.188 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-09-30T22:25:44.426 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-09-30T22:25:44.650 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-09-30T22:25:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-09-30T22:25:44.996 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-09-30T22:25:45.179 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-09-30T22:25:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-09-30T22:25:45.765 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 119/136 2023-09-30T22:25:45.929 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:25:45.998 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:25:46.246 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:25:46.339 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:25:46.521 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:25:46.535 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:25:46.672 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-09-30T22:25:46.699 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-09-30T22:25:46.812 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-09-30T22:25:46.812 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:25:47.056 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:25:47.063 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:25:47.183 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:25:47.183 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:25:47.437 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:25:47.633 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-09-30T22:25:47.827 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-09-30T22:25:47.947 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:25:48.022 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:25:48.022 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:25:48.199 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:25:48.231 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:25:48.232 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:25:48.457 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:25:48.457 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:25:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:25:48.648 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:25:48.649 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:25:48.824 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:25:48.824 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:25:48.841 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:25:48.934 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:25:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:25:49.147 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:25:49.791 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-09-30T22:25:49.853 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:25:49.853 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-09-30T22:25:49.853 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-09-30T22:25:49.853 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-09-30T22:25:49.853 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-09-30T22:25:49.853 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-09-30T22:25:49.853 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-09-30T22:25:49.853 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-09-30T22:25:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:25:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:25:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:25:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:25:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-09-30T22:25:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:25:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-09-30T22:25:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-09-30T22:25:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-09-30T22:25:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-09-30T22:25:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-09-30T22:25:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-09-30T22:25:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-09-30T22:25:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-09-30T22:25:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-09-30T22:25:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-09-30T22:25:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-09-30T22:25:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-09-30T22:25:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-09-30T22:25:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-09-30T22:25:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-09-30T22:25:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-09-30T22:25:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-09-30T22:25:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-09-30T22:25:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-09-30T22:25:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-09-30T22:25:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-09-30T22:25:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-09-30T22:25:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-09-30T22:25:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-09-30T22:25:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-09-30T22:25:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-09-30T22:25:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-09-30T22:25:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-09-30T22:25:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-09-30T22:25:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-09-30T22:25:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-09-30T22:25:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-09-30T22:25:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-09-30T22:25:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-09-30T22:25:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-09-30T22:25:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-09-30T22:25:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-09-30T22:25:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-09-30T22:25:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-09-30T22:25:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-09-30T22:25:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-09-30T22:25:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-09-30T22:25:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-09-30T22:25:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-09-30T22:25:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-09-30T22:25:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-09-30T22:25:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-09-30T22:25:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-09-30T22:25:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-09-30T22:25:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-09-30T22:25:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-09-30T22:25:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-09-30T22:25:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-09-30T22:25:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-09-30T22:25:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-09-30T22:25:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-09-30T22:25:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-09-30T22:25:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-09-30T22:25:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-09-30T22:25:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-09-30T22:25:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-09-30T22:25:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-09-30T22:25:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-09-30T22:25:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-09-30T22:25:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-09-30T22:25:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-09-30T22:25:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-09-30T22:25:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-09-30T22:25:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-09-30T22:25:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-09-30T22:25:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-09-30T22:25:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-09-30T22:25:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-09-30T22:25:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-09-30T22:25:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-09-30T22:25:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-09-30T22:25:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-09-30T22:25:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-09-30T22:25:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-09-30T22:25:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-09-30T22:25:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-09-30T22:25:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-09-30T22:25:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-09-30T22:25:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-09-30T22:25:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-09-30T22:25:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-09-30T22:25:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-09-30T22:25:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-09-30T22:25:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-09-30T22:25:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-09-30T22:25:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-09-30T22:25:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-09-30T22:25:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-09-30T22:25:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-09-30T22:25:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-09-30T22:25:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:25:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-09-30T22:25:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:25:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-09-30T22:25:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-09-30T22:25:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-09-30T22:25:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-09-30T22:25:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-09-30T22:25:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-09-30T22:25:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-09-30T22:25:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-09-30T22:25:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-09-30T22:25:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 121/136 2023-09-30T22:25:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-09-30T22:25:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-09-30T22:25:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-09-30T22:25:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-09-30T22:25:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-09-30T22:25:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-09-30T22:25:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-09-30T22:25:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-09-30T22:25:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:25:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-09-30T22:25:49.865 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:25:49.865 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-09-30T22:25:49.865 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:25:49.865 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-09-30T22:25:50.086 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-09-30T22:25:50.335 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-09-30T22:25:50.510 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-09-30T22:25:50.690 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-09-30T22:25:50.905 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-09-30T22:25:51.212 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-09-30T22:25:51.484 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 119/136 2023-09-30T22:25:51.632 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:25:51.701 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:25:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-09-30T22:25:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:25:51.862 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2023-09-30T22:25:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-09-30T22:25:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-09-30T22:25:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-09-30T22:25:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-09-30T22:25:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: iproute-6.2.0-2.el8.x86_64 2023-09-30T22:25:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: libblkid-2.32.1-43.el8.x86_64 2023-09-30T22:25:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-09-30T22:25:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: libmount-2.32.1-43.el8.x86_64 2023-09-30T22:25:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-09-30T22:25:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-2.32.1-43.el8.x86_64 2023-09-30T22:25:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux-2.32.1-43.el8.x86_64 2023-09-30T22:25:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-09-30T22:25:51.863 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2023-09-30T22:25:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: bison-3.0.4-10.el8.x86_64 2023-09-30T22:25:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:25:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:25:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:25:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:25:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:25:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:25:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-09-30T22:25:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: flex-2.6.1-9.el8.x86_64 2023-09-30T22:25:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: fuse-2.9.7-17.el8.x86_64 2023-09-30T22:25:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-30T22:25:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: jq-1.6-7.el8.x86_64 2023-09-30T22:25:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-30T22:25:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-09-30T22:25:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: leveldb-1.22-1.el8.x86_64 2023-09-30T22:25:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-09-30T22:25:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-09-30T22:25:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-30T22:25:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-09-30T22:25:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-09-30T22:25:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-30T22:25:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-09-30T22:25:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-30T22:25:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-30T22:25:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-09-30T22:25:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-09-30T22:25:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-30T22:25:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-30T22:25:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.15-4.el8.x86_64 2023-09-30T22:25:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-09-30T22:25:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-09-30T22:25:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-09-30T22:25:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-09-30T22:25:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-09-30T22:25:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-30T22:25:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-30T22:25:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-30T22:25:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-30T22:25:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-09-30T22:25:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-30T22:25:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-30T22:25:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-09-30T22:25:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-30T22:25:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-30T22:25:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-30T22:25:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-30T22:25:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-30T22:25:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-30T22:25:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-30T22:25:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-30T22:25:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.0.6-14.el8.noarch 2023-09-30T22:25:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-30T22:25:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-30T22:25:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-30T22:25:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-30T22:25:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-30T22:25:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-30T22:25:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-2.6-1.el8.noarch 2023-09-30T22:25:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-30T22:25:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-30T22:25:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-30T22:25:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-30T22:25:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-30T22:25:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2017.2-11.el8.noarch 2023-09-30T22:25:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-30T22:25:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-30T22:25:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-30T22:25:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-30T22:25:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-09-30T22:25:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-30T22:25:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-30T22:25:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-30T22:25:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-30T22:25:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-30T22:25:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-30T22:25:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-30T22:25:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-30T22:25:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-30T22:25:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-30T22:25:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-30T22:25:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-30T22:25:51.874 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-09-30T22:25:51.874 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:25:51.874 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-09-30T22:25:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:25:52.051 DEBUG:teuthology.parallel:result is None 2023-09-30T22:25:52.066 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:25:52.291 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:25:52.305 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:25:52.500 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-09-30T22:25:52.658 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-09-30T22:25:52.658 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:25:52.917 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:25:52.922 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:25:53.060 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:25:53.060 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:25:53.312 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:25:53.497 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-09-30T22:25:53.665 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-09-30T22:25:53.899 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:25:53.900 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:25:54.117 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:25:54.118 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:25:54.342 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:25:54.342 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:25:54.550 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:25:54.551 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:25:54.750 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:25:54.751 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:25:54.975 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:25:55.140 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:25:55.717 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:25:55.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-09-30T22:25:55.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-09-30T22:25:55.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-09-30T22:25:55.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-09-30T22:25:55.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-09-30T22:25:55.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-09-30T22:25:55.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-09-30T22:25:55.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:25:55.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:25:55.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:25:55.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:25:55.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-09-30T22:25:55.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:25:55.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-09-30T22:25:55.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-09-30T22:25:55.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-09-30T22:25:55.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-09-30T22:25:55.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-09-30T22:25:55.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-09-30T22:25:55.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-09-30T22:25:55.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-09-30T22:25:55.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-09-30T22:25:55.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-09-30T22:25:55.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-09-30T22:25:55.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-09-30T22:25:55.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-09-30T22:25:55.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-09-30T22:25:55.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-09-30T22:25:55.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-09-30T22:25:55.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-09-30T22:25:55.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-09-30T22:25:55.730 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-09-30T22:25:55.730 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-09-30T22:25:55.730 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-09-30T22:25:55.731 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-09-30T22:25:55.731 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-09-30T22:25:55.731 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-09-30T22:25:55.731 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-09-30T22:25:55.731 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-09-30T22:25:55.731 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-09-30T22:25:55.731 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-09-30T22:25:55.731 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-09-30T22:25:55.731 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-09-30T22:25:55.731 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-09-30T22:25:55.731 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-09-30T22:25:55.732 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-09-30T22:25:55.732 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-09-30T22:25:55.732 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-09-30T22:25:55.732 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-09-30T22:25:55.732 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-09-30T22:25:55.732 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-09-30T22:25:55.732 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-09-30T22:25:55.732 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-09-30T22:25:55.732 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-09-30T22:25:55.732 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-09-30T22:25:55.732 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-09-30T22:25:55.732 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-09-30T22:25:55.733 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-09-30T22:25:55.733 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-09-30T22:25:55.733 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-09-30T22:25:55.733 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-09-30T22:25:55.733 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-09-30T22:25:55.733 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-09-30T22:25:55.733 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-09-30T22:25:55.733 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-09-30T22:25:55.733 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-09-30T22:25:55.733 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-09-30T22:25:55.733 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-09-30T22:25:55.734 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-09-30T22:25:55.734 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-09-30T22:25:55.734 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-09-30T22:25:55.734 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-09-30T22:25:55.734 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-09-30T22:25:55.734 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-09-30T22:25:55.734 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-09-30T22:25:55.734 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-09-30T22:25:55.734 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-09-30T22:25:55.734 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-09-30T22:25:55.734 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-09-30T22:25:55.735 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-09-30T22:25:55.735 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-09-30T22:25:55.735 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-09-30T22:25:55.735 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-09-30T22:25:55.735 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-09-30T22:25:55.735 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-09-30T22:25:55.735 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-09-30T22:25:55.735 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-09-30T22:25:55.735 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-09-30T22:25:55.735 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-09-30T22:25:55.735 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-09-30T22:25:55.735 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-09-30T22:25:55.736 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-09-30T22:25:55.736 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-09-30T22:25:55.736 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-09-30T22:25:55.736 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-09-30T22:25:55.736 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-09-30T22:25:55.736 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-09-30T22:25:55.736 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-09-30T22:25:55.736 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-09-30T22:25:55.736 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-09-30T22:25:55.736 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-09-30T22:25:55.736 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-09-30T22:25:55.736 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-09-30T22:25:55.737 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-09-30T22:25:55.737 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-09-30T22:25:55.737 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-09-30T22:25:55.737 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-09-30T22:25:55.737 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-09-30T22:25:55.737 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:25:55.737 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-09-30T22:25:55.737 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:25:55.737 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-09-30T22:25:55.737 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-09-30T22:25:55.737 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-09-30T22:25:55.737 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-09-30T22:25:55.738 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-09-30T22:25:55.738 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-09-30T22:25:55.738 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-09-30T22:25:55.738 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-09-30T22:25:55.738 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-09-30T22:25:55.738 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 121/136 2023-09-30T22:25:55.738 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-09-30T22:25:55.738 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-09-30T22:25:55.738 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-09-30T22:25:55.738 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-09-30T22:25:55.738 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-09-30T22:25:55.739 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-09-30T22:25:55.739 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-09-30T22:25:55.739 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-09-30T22:25:55.739 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:25:55.739 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-09-30T22:25:55.739 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:25:55.739 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-09-30T22:25:55.739 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:25:55.739 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-09-30T22:25:57.760 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-09-30T22:25:57.761 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:25:57.761 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2023-09-30T22:25:57.761 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-09-30T22:25:57.761 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-09-30T22:25:57.761 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-09-30T22:25:57.761 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-09-30T22:25:57.762 INFO:teuthology.orchestra.run.smithi191.stdout: iproute-6.2.0-2.el8.x86_64 2023-09-30T22:25:57.762 INFO:teuthology.orchestra.run.smithi191.stdout: libblkid-2.32.1-43.el8.x86_64 2023-09-30T22:25:57.762 INFO:teuthology.orchestra.run.smithi191.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-09-30T22:25:57.762 INFO:teuthology.orchestra.run.smithi191.stdout: libmount-2.32.1-43.el8.x86_64 2023-09-30T22:25:57.762 INFO:teuthology.orchestra.run.smithi191.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.762 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.763 INFO:teuthology.orchestra.run.smithi191.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-09-30T22:25:57.763 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-2.32.1-43.el8.x86_64 2023-09-30T22:25:57.763 INFO:teuthology.orchestra.run.smithi191.stdout: util-linux-2.32.1-43.el8.x86_64 2023-09-30T22:25:57.763 INFO:teuthology.orchestra.run.smithi191.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-09-30T22:25:57.763 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2023-09-30T22:25:57.763 INFO:teuthology.orchestra.run.smithi191.stdout: bison-3.0.4-10.el8.x86_64 2023-09-30T22:25:57.764 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.764 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.764 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.764 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.764 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:25:57.764 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.765 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.765 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:25:57.765 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:25:57.765 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:25:57.765 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:25:57.765 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.766 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.766 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:25:57.766 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.766 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.767 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.767 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-09-30T22:25:57.767 INFO:teuthology.orchestra.run.smithi191.stdout: flex-2.6.1-9.el8.x86_64 2023-09-30T22:25:57.767 INFO:teuthology.orchestra.run.smithi191.stdout: fuse-2.9.7-17.el8.x86_64 2023-09-30T22:25:57.767 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-30T22:25:57.767 INFO:teuthology.orchestra.run.smithi191.stdout: jq-1.6-7.el8.x86_64 2023-09-30T22:25:57.767 INFO:teuthology.orchestra.run.smithi191.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-30T22:25:57.768 INFO:teuthology.orchestra.run.smithi191.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-09-30T22:25:57.768 INFO:teuthology.orchestra.run.smithi191.stdout: leveldb-1.22-1.el8.x86_64 2023-09-30T22:25:57.768 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.768 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.768 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.768 INFO:teuthology.orchestra.run.smithi191.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-09-30T22:25:57.769 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-09-30T22:25:57.769 INFO:teuthology.orchestra.run.smithi191.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-30T22:25:57.769 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-09-30T22:25:57.769 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-09-30T22:25:57.769 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.769 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.770 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-30T22:25:57.770 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.770 INFO:teuthology.orchestra.run.smithi191.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-09-30T22:25:57.770 INFO:teuthology.orchestra.run.smithi191.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-30T22:25:57.770 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-30T22:25:57.770 INFO:teuthology.orchestra.run.smithi191.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-09-30T22:25:57.771 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-09-30T22:25:57.771 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-30T22:25:57.771 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-30T22:25:57.771 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-0.3.15-4.el8.x86_64 2023-09-30T22:25:57.771 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-09-30T22:25:57.773 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-09-30T22:25:57.773 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-09-30T22:25:57.773 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-09-30T22:25:57.774 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-09-30T22:25:57.774 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-30T22:25:57.774 INFO:teuthology.orchestra.run.smithi191.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-30T22:25:57.774 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-30T22:25:57.774 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.774 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.774 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.775 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-30T22:25:57.775 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-09-30T22:25:57.775 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-30T22:25:57.775 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-30T22:25:57.775 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-09-30T22:25:57.775 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-30T22:25:57.775 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-30T22:25:57.775 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-30T22:25:57.775 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-30T22:25:57.775 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-30T22:25:57.776 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-30T22:25:57.776 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-30T22:25:57.776 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-30T22:25:57.776 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako-1.0.6-14.el8.noarch 2023-09-30T22:25:57.776 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-30T22:25:57.776 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-30T22:25:57.776 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-30T22:25:57.776 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-30T22:25:57.776 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-30T22:25:57.776 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-30T22:25:57.776 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend-2.6-1.el8.noarch 2023-09-30T22:25:57.776 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-30T22:25:57.777 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-30T22:25:57.777 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-30T22:25:57.777 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-30T22:25:57.777 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-30T22:25:57.777 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz-2017.2-11.el8.noarch 2023-09-30T22:25:57.777 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.777 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.777 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-30T22:25:57.777 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-30T22:25:57.777 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.777 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-30T22:25:57.777 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-30T22:25:57.778 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-09-30T22:25:57.778 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-30T22:25:57.778 INFO:teuthology.orchestra.run.smithi191.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-30T22:25:57.778 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-30T22:25:57.778 INFO:teuthology.orchestra.run.smithi191.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-30T22:25:57.778 INFO:teuthology.orchestra.run.smithi191.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-30T22:25:57.779 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-30T22:25:57.779 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-30T22:25:57.779 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-30T22:25:57.779 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-30T22:25:57.779 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-30T22:25:57.780 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.780 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.780 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:25:57.780 INFO:teuthology.orchestra.run.smithi191.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-30T22:25:57.780 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-30T22:25:57.781 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-09-30T22:25:57.781 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:25:57.781 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2023-09-30T22:25:58.045 DEBUG:teuthology.parallel:result is None 2023-09-30T22:25:58.045 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:25:58.045 INFO:teuthology.packaging:ref: None 2023-09-30T22:25:58.045 INFO:teuthology.packaging:tag: None 2023-09-30T22:25:58.045 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:25:58.046 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:25:58.046 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:25:58.373 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:25:58.404 INFO:teuthology.orchestra.run.smithi059.stdout:16.2.14-44.geeb13ac9.el8 2023-09-30T22:25:58.404 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-09-30T22:25:58.404 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-09-30T22:25:58.405 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:25:58.405 INFO:teuthology.packaging:ref: None 2023-09-30T22:25:58.405 INFO:teuthology.packaging:tag: None 2023-09-30T22:25:58.405 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:25:58.405 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:25:58.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:25:58.699 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:25:58.724 INFO:teuthology.orchestra.run.smithi191.stdout:16.2.14-44.geeb13ac9.el8 2023-09-30T22:25:58.724 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-09-30T22:25:58.724 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-09-30T22:25:58.724 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-30T22:25:58.724 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:25:58.724 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T22:25:58.763 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-09-30T22:25:58.763 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T22:25:58.797 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-30T22:25:58.798 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:25:58.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T22:25:58.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T22:25:58.915 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-09-30T22:25:58.915 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T22:25:58.943 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T22:25:59.011 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-30T22:25:59.011 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:25:59.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T22:25:59.046 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T22:25:59.122 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-09-30T22:25:59.122 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T22:25:59.149 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T22:25:59.215 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-30T22:25:59.216 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:25:59.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T22:25:59.251 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T22:25:59.327 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-09-30T22:25:59.327 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T22:25:59.354 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T22:25:59.421 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:25:59.430 INFO:teuthology.task.print:**** done installing pacific 2023-09-30T22:25:59.430 INFO:teuthology.run_tasks:Running task ceph... 2023-09-30T22:25:59.542 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-30T22:25:59.543 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /var/log/ceph 2023-09-30T22:25:59.545 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /var/log/ceph 2023-09-30T22:25:59.577 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-30T22:25:59.578 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T22:25:59.620 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T22:25:59.652 INFO:tasks.ceph:Creating extra log directories... 2023-09-30T22:25:59.652 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T22:25:59.695 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T22:25:59.739 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-30T22:25:59.739 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-30T22:25:59.740 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047', 'branch': 'fix-nfs-apply-err-reporting', 'description': 'fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}}', 'email': None, 'first_in_suite': False, 'job_id': '7408047', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'fix-nfs-apply-err-reporting'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'dry_run': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62953', 'sha1': '6973b24e3d99fd494b753449d2ea12077599cbd6'}}, 'owner': 'scheduled_dparmar@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0']], 'seed': 2683, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'sleep_before_teardown': 0, 'suite': 'fs:upgrade', 'suite_branch': 'wip-62953', 'suite_path': '/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/dparmar18/ceph', 'suite_sha1': '6973b24e3d99fd494b753449d2ea12077599cbd6', 'targets': {'smithi059.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIMwVFfiBhlkzOu4g+g0RWhCOo1THv7YOS3ipFvq4AFSMFuLm6CNt7BJUsep0edEsgkOCT3cbPkShu/9VMlr3Cc=', 'smithi191.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNQ3uQNH5jbGJ/ypFNhMzqTxPsHHQZ7d+koYJTzU5lZ+41WZj39huXoH4smYp2oD/153Z1NXXCDG3Qje4x6bWDQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, {'print': '**** done installing pacific'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'flavor': 'default', 'fs': 'xfs', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client pacific']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': {'branch': 'reef'}}}, {'print': '**** done install.upgrade the host'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph osd dump -f json-pretty', 'ceph versions', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done', 'ceph osd require-osd-release reef']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'ceph-fuse': {'client.0': {'mounted': False}}}, {'print': '**** done unmount client.0'}, {'install.upgrade': {'client.0': None}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.0': None}}, {'print': '**** done remount client.0'}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology': {'branch': 'pacific', 'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end", 'if not is_fuse() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-30_21:53:45', 'tube': 'smithi', 'user': 'dparmar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-30T22:25:59.741 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T22:25:59.771 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T22:25:59.792 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T22:25:59.835 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T22:25:59.867 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:25:59.868 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2023-09-30T22:25:59.931 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-30T22:25:59.931 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2023-09-30T22:25:59.995 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-30T22:25:59.995 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:25:59.995 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 393407 Links: 1 2023-09-30T22:25:59.995 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:25:59.995 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:25:59.995 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-09-30 22:25:49.405858541 +0000 2023-09-30T22:25:59.995 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-09-30 22:22:55.707740681 +0000 2023-09-30T22:25:59.996 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-09-30 22:22:55.707740681 +0000 2023-09-30T22:25:59.996 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-09-30T22:25:59.996 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-30T22:26:00.071 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-09-30T22:26:00.072 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-09-30T22:26:00.072 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000233861 s, 2.2 MB/s 2023-09-30T22:26:00.073 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-30T22:26:00.137 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2023-09-30T22:26:00.201 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-30T22:26:00.201 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:26:00.201 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 392868 Links: 1 2023-09-30T22:26:00.201 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:26:00.202 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:26:00.202 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-09-30 22:25:49.406858529 +0000 2023-09-30T22:26:00.202 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-09-30 22:22:56.276733838 +0000 2023-09-30T22:26:00.202 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-09-30 22:22:56.276733838 +0000 2023-09-30T22:26:00.202 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-09-30T22:26:00.202 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-30T22:26:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-09-30T22:26:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-09-30T22:26:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000235389 s, 2.2 MB/s 2023-09-30T22:26:00.275 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-30T22:26:00.340 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2023-09-30T22:26:00.404 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-30T22:26:00.404 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:26:00.404 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 392922 Links: 1 2023-09-30T22:26:00.404 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:26:00.404 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:26:00.404 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-09-30 22:25:49.406858529 +0000 2023-09-30T22:26:00.404 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-09-30 22:22:56.857726851 +0000 2023-09-30T22:26:00.404 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-09-30 22:22:56.857726851 +0000 2023-09-30T22:26:00.405 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-09-30T22:26:00.405 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-30T22:26:00.477 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-09-30T22:26:00.478 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-09-30T22:26:00.478 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000235827 s, 2.2 MB/s 2023-09-30T22:26:00.479 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-30T22:26:00.543 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2023-09-30T22:26:00.607 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-30T22:26:00.607 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:26:00.607 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 389108 Links: 1 2023-09-30T22:26:00.607 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:26:00.607 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:26:00.607 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-09-30 22:25:49.406858529 +0000 2023-09-30T22:26:00.607 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-09-30 22:22:57.445719780 +0000 2023-09-30T22:26:00.607 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-09-30 22:22:57.445719780 +0000 2023-09-30T22:26:00.607 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-09-30T22:26:00.608 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-30T22:26:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-09-30T22:26:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-09-30T22:26:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000229959 s, 2.2 MB/s 2023-09-30T22:26:00.681 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-30T22:26:00.744 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:26:00.744 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-09-30T22:26:00.745 INFO:tasks.ceph:Generating config... 2023-09-30T22:26:00.746 INFO:tasks.ceph:[global] mon warn on pool no app = False 2023-09-30T22:26:00.746 INFO:tasks.ceph:[global] ms bind msgr2 = False 2023-09-30T22:26:00.746 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2023-09-30T22:26:00.746 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2023-09-30T22:26:00.746 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-09-30T22:26:00.746 INFO:tasks.ceph:[client] client mount timeout = 600 2023-09-30T22:26:00.746 INFO:tasks.ceph:[client] debug client = 20 2023-09-30T22:26:00.746 INFO:tasks.ceph:[client] debug ms = 1 2023-09-30T22:26:00.746 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-09-30T22:26:00.746 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-09-30T22:26:00.747 INFO:tasks.ceph:[mds] debug mds = 20 2023-09-30T22:26:00.747 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-09-30T22:26:00.747 INFO:tasks.ceph:[mds] debug ms = 1 2023-09-30T22:26:00.747 INFO:tasks.ceph:[mds] mds debug frag = True 2023-09-30T22:26:00.747 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-09-30T22:26:00.747 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-09-30T22:26:00.747 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-09-30T22:26:00.747 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-09-30T22:26:00.747 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-09-30T22:26:00.747 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-09-30T22:26:00.747 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-30T22:26:00.748 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-30T22:26:00.748 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-30T22:26:00.748 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-30T22:26:00.748 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-30T22:26:00.748 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-09-30T22:26:00.748 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2023-09-30T22:26:00.748 INFO:tasks.ceph:[osd] bdev async discard = True 2023-09-30T22:26:00.748 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-09-30T22:26:00.748 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-09-30T22:26:00.748 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-30T22:26:00.748 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-30T22:26:00.748 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-09-30T22:26:00.748 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-09-30T22:26:00.749 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-30T22:26:00.749 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-30T22:26:00.749 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-09-30T22:26:00.749 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-30T22:26:00.749 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-30T22:26:00.749 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-30T22:26:00.749 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-30T22:26:00.749 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-30T22:26:00.749 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-09-30T22:26:00.749 INFO:tasks.ceph:Setting up mon.a... 2023-09-30T22:26:00.750 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-30T22:26:00.902 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.keyring 2023-09-30T22:26:00.905 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-30T22:26:00.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T22:26:00.990 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.59'), ('mon.b', '[v2:172.21.15.59:3301,v1:172.21.15.59:6790]'), ('mon.c', '[v2:172.21.15.59:3302,v1:172.21.15.59:6791]')] 2023-09-30T22:26:00.990 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790],[v2:172.21.15.59:3302,v1:172.21.15.59:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-09-30T22:26:00.991 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:26:00.991 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T22:26:01.053 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.59 --addv b '[v2:172.21.15.59:3301,v1:172.21.15.59:6790]' --addv c '[v2:172.21.15.59:3302,v1:172.21.15.59:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:26:01.146 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:26:01.147 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: generated fsid 4ab45aad-c596-4cc8-9318-aa2f9d41daac 2023-09-30T22:26:01.147 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 0 2023-09-30T22:26:01.147 INFO:teuthology.orchestra.run.smithi059.stdout:fsid 4ab45aad-c596-4cc8-9318-aa2f9d41daac 2023-09-30T22:26:01.147 INFO:teuthology.orchestra.run.smithi059.stdout:last_changed 2023-09-30T22:26:01.147407+0000 2023-09-30T22:26:01.147 INFO:teuthology.orchestra.run.smithi059.stdout:created 2023-09-30T22:26:01.147407+0000 2023-09-30T22:26:01.147 INFO:teuthology.orchestra.run.smithi059.stdout:min_mon_release 0 (unknown) 2023-09-30T22:26:01.148 INFO:teuthology.orchestra.run.smithi059.stdout:election_strategy: 1 2023-09-30T22:26:01.148 INFO:teuthology.orchestra.run.smithi059.stdout:0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2023-09-30T22:26:01.148 INFO:teuthology.orchestra.run.smithi059.stdout:1: [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] mon.b 2023-09-30T22:26:01.148 INFO:teuthology.orchestra.run.smithi059.stdout:2: [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] mon.c 2023-09-30T22:26:01.148 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-30T22:26:01.149 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T22:26:01.170 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4ab45aad-c596-4cc8-9318-aa2f9d41daac... 2023-09-30T22:26:01.171 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T22:26:01.212 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T22:26:01.266 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2023-09-30T22:26:01.266 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2023-09-30T22:26:01.266 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T22:26:01.266 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2023-09-30T22:26:01.266 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2023-09-30T22:26:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2023-09-30T22:26:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2023-09-30T22:26:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2023-09-30T22:26:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2023-09-30T22:26:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2023-09-30T22:26:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T22:26:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2023-09-30T22:26:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T22:26:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T22:26:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2023-09-30T22:26:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2023-09-30T22:26:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2023-09-30T22:26:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2023-09-30T22:26:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2023-09-30T22:26:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2023-09-30T22:26:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2023-09-30T22:26:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2023-09-30T22:26:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T22:26:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T22:26:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2023-09-30T22:26:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T22:26:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2023-09-30T22:26:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2023-09-30T22:26:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2023-09-30T22:26:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2023-09-30T22:26:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2023-09-30T22:26:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790],[v2:172.21.15.59:3302,v1:172.21.15.59:6791]" 2023-09-30T22:26:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on pool no app = False 2023-09-30T22:26:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: ms bind msgr2 = False 2023-09-30T22:26:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore warn on legacy statfs = False 2023-09-30T22:26:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore warn on no per pool omap = False 2023-09-30T22:26:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn min per osd = 0 2023-09-30T22:26:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = 4ab45aad-c596-4cc8-9318-aa2f9d41daac 2023-09-30T22:26:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.270 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2023-09-30T22:26:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2023-09-30T22:26:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2023-09-30T22:26:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2023-09-30T22:26:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2023-09-30T22:26:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2023-09-30T22:26:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2023-09-30T22:26:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2023-09-30T22:26:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2023-09-30T22:26:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2023-09-30T22:26:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2023-09-30T22:26:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2023-09-30T22:26:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2023-09-30T22:26:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2023-09-30T22:26:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2023-09-30T22:26:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2023-09-30T22:26:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2023-09-30T22:26:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2023-09-30T22:26:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2023-09-30T22:26:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: bdev async discard = True 2023-09-30T22:26:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: bdev enable discard = True 2023-09-30T22:26:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore allocator = bitmap 2023-09-30T22:26:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2023-09-30T22:26:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2023-09-30T22:26:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 1/20 2023-09-30T22:26:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 1/20 2023-09-30T22:26:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-09-30T22:26:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2023-09-30T22:26:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 4/10 2023-09-30T22:26:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T22:26:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2023-09-30T22:26:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2023-09-30T22:26:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2023-09-30T22:26:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2023-09-30T22:26:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2023-09-30T22:26:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.274 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2023-09-30T22:26:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-09-30T22:26:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2023-09-30T22:26:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2023-09-30T22:26:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2023-09-30T22:26:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:26:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:26:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2023-09-30T22:26:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.275 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2023-09-30T22:26:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-09-30T22:26:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2023-09-30T22:26:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2023-09-30T22:26:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2023-09-30T22:26:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2023-09-30T22:26:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2023-09-30T22:26:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:26:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2023-09-30T22:26:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2023-09-30T22:26:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:26:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T22:26:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T22:26:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T22:26:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T22:26:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T22:26:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T22:26:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2023-09-30T22:26:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2023-09-30T22:26:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2023-09-30T22:26:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2023-09-30T22:26:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = False 2023-09-30T22:26:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:01.277 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2023-09-30T22:26:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2023-09-30T22:26:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2023-09-30T22:26:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2023-09-30T22:26:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T22:26:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T22:26:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2023-09-30T22:26:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2023-09-30T22:26:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-09-30T22:26:01.278 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2023-09-30T22:26:01.278 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2023-09-30T22:26:01.278 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2023-09-30T22:26:01.278 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2023-09-30T22:26:01.278 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2023-09-30T22:26:01.278 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2023-09-30T22:26:01.278 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2023-09-30T22:26:01.278 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2023-09-30T22:26:01.278 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds balancer = 20 2023-09-30T22:26:01.278 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-09-30T22:26:01.278 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2023-09-30T22:26:01.278 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = True 2023-09-30T22:26:01.279 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2023-09-30T22:26:01.279 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = True 2023-09-30T22:26:01.279 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2023-09-30T22:26:01.279 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2023-09-30T22:26:01.279 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2023-09-30T22:26:01.281 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2023-09-30T22:26:01.281 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2023-09-30T22:26:01.281 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T22:26:01.282 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2023-09-30T22:26:01.282 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.282 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2023-09-30T22:26:01.282 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.283 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2023-09-30T22:26:01.283 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.283 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2023-09-30T22:26:01.283 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2023-09-30T22:26:01.284 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.284 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2023-09-30T22:26:01.284 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2023-09-30T22:26:01.284 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.284 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T22:26:01.284 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2023-09-30T22:26:01.285 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.285 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T22:26:01.285 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T22:26:01.285 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.285 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2023-09-30T22:26:01.285 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.286 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2023-09-30T22:26:01.286 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2023-09-30T22:26:01.286 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2023-09-30T22:26:01.286 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2023-09-30T22:26:01.286 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2023-09-30T22:26:01.286 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2023-09-30T22:26:01.287 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2023-09-30T22:26:01.287 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T22:26:01.287 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T22:26:01.287 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2023-09-30T22:26:01.287 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.287 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T22:26:01.288 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.288 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2023-09-30T22:26:01.288 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.288 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2023-09-30T22:26:01.288 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.289 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2023-09-30T22:26:01.289 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2023-09-30T22:26:01.289 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2023-09-30T22:26:01.289 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = "172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790],[v2:172.21.15.59:3302,v1:172.21.15.59:6791]" 2023-09-30T22:26:01.289 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on pool no app = False 2023-09-30T22:26:01.289 INFO:teuthology.orchestra.run.smithi191.stdout: ms bind msgr2 = False 2023-09-30T22:26:01.290 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore warn on legacy statfs = False 2023-09-30T22:26:01.290 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore warn on no per pool omap = False 2023-09-30T22:26:01.290 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn min per osd = 0 2023-09-30T22:26:01.290 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = 4ab45aad-c596-4cc8-9318-aa2f9d41daac 2023-09-30T22:26:01.290 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.291 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2023-09-30T22:26:01.291 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2023-09-30T22:26:01.291 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.291 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2023-09-30T22:26:01.291 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2023-09-30T22:26:01.291 INFO:teuthology.orchestra.run.smithi191.stdout: osd mclock profile = high_recovery_ops 2023-09-30T22:26:01.291 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.292 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2023-09-30T22:26:01.292 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2023-09-30T22:26:01.292 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.292 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2023-09-30T22:26:01.292 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2023-09-30T22:26:01.292 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2023-09-30T22:26:01.293 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.293 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2023-09-30T22:26:01.293 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2023-09-30T22:26:01.293 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.293 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2023-09-30T22:26:01.294 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.294 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2023-09-30T22:26:01.294 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.295 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2023-09-30T22:26:01.295 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.296 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2023-09-30T22:26:01.296 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2023-09-30T22:26:01.296 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.296 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2023-09-30T22:26:01.296 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2023-09-30T22:26:01.296 INFO:teuthology.orchestra.run.smithi191.stdout: bdev async discard = True 2023-09-30T22:26:01.296 INFO:teuthology.orchestra.run.smithi191.stdout: bdev enable discard = True 2023-09-30T22:26:01.296 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore allocator = bitmap 2023-09-30T22:26:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore block size = 96636764160 2023-09-30T22:26:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore fsck on mount = True 2023-09-30T22:26:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluefs = 1/20 2023-09-30T22:26:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluestore = 1/20 2023-09-30T22:26:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-09-30T22:26:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2023-09-30T22:26:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: debug rocksdb = 4/10 2023-09-30T22:26:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T22:26:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd full ratio = 0.9 2023-09-30T22:26:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd nearfull ratio = 0.8 2023-09-30T22:26:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: osd failsafe full ratio = 0.95 2023-09-30T22:26:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: osd objectstore = bluestore 2023-09-30T22:26:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-09-30T22:26:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.298 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2023-09-30T22:26:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-09-30T22:26:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2023-09-30T22:26:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-09-30T22:26:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-09-30T22:26:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:26:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:26:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2023-09-30T22:26:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.298 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2023-09-30T22:26:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-09-30T22:26:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-09-30T22:26:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2023-09-30T22:26:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-09-30T22:26:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2023-09-30T22:26:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2023-09-30T22:26:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:26:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2023-09-30T22:26:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2023-09-30T22:26:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:26:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T22:26:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T22:26:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T22:26:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T22:26:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T22:26:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T22:26:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2023-09-30T22:26:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2023-09-30T22:26:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2023-09-30T22:26:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: mon op complaint time = 120 2023-09-30T22:26:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = False 2023-09-30T22:26:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-30T22:26:01.301 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2023-09-30T22:26:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2023-09-30T22:26:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2023-09-30T22:26:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2023-09-30T22:26:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T22:26:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T22:26:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: client mount timeout = 600 2023-09-30T22:26:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: debug client = 20 2023-09-30T22:26:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-09-30T22:26:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-09-30T22:26:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-09-30T22:26:01.302 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2023-09-30T22:26:01.302 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.b] 2023-09-30T22:26:01.302 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.c] 2023-09-30T22:26:01.302 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2023-09-30T22:26:01.302 INFO:teuthology.orchestra.run.smithi191.stdout:[mds] 2023-09-30T22:26:01.302 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds = 20 2023-09-30T22:26:01.302 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds balancer = 20 2023-09-30T22:26:01.302 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-09-30T22:26:01.302 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug frag = True 2023-09-30T22:26:01.302 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug scatterstat = True 2023-09-30T22:26:01.302 INFO:teuthology.orchestra.run.smithi191.stdout: mds op complaint time = 180 2023-09-30T22:26:01.302 INFO:teuthology.orchestra.run.smithi191.stdout: mds verify scatter = True 2023-09-30T22:26:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-09-30T22:26:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-09-30T22:26:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-09-30T22:26:01.303 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-30T22:26:01.303 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-30T22:26:01.385 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-30T22:26:01.386 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:26:01.386 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-30T22:26:01.407 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:26:01.407 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-30T22:26:01.470 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi059.front.sepia.ceph.com 2023-09-30T22:26:01.470 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:26:01.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T22:26:01.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T22:26:01.557 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:26:01.558 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:26:01.621 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi191.front.sepia.ceph.com 2023-09-30T22:26:01.621 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-09-30T22:26:01.621 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T22:26:01.621 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T22:26:01.665 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-09-30T22:26:01.666 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:26:01.725 INFO:tasks.ceph:Setting up mon nodes... 2023-09-30T22:26:01.725 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-30T22:26:01.725 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T22:26:01.789 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T22:26:01.791 INFO:tasks.ceph:Setting up mds nodes... 2023-09-30T22:26:01.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T22:26:01.850 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T22:26:01.853 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-30T22:26:01.885 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-30T22:26:01.885 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-30T22:26:02.002 INFO:teuthology.orchestra.run.smithi191.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-30T22:26:02.015 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-30T22:26:02.016 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-09-30T22:26:02.016 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-30T22:26:02.052 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:26:02.052 INFO:tasks.ceph:role: osd.0 2023-09-30T22:26:02.052 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com 2023-09-30T22:26:02.052 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-30T22:26:02.134 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:26:02.135 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:26:02.135 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:26:02.135 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:26:02.135 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:26:02.135 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:26:02.135 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:26:02.135 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:26:02.135 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:26:02.135 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:26:02.562 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-09-30T22:26:02.564 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-09-30T22:26:02.564 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-30T22:26:02.747 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-30T22:26:02.788 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-30T22:26:02.864 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:26:02.864 INFO:tasks.ceph:role: osd.1 2023-09-30T22:26:02.864 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com 2023-09-30T22:26:02.865 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-30T22:26:02.947 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:26:02.947 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:26:02.947 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:26:02.948 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:26:02.948 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:26:02.948 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:26:02.948 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:26:02.948 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:26:02.948 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:26:02.948 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:26:03.345 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-09-30T22:26:03.347 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-09-30T22:26:03.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-30T22:26:03.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-30T22:26:03.503 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-30T22:26:03.579 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:26:03.580 INFO:tasks.ceph:role: osd.2 2023-09-30T22:26:03.580 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com 2023-09-30T22:26:03.580 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-30T22:26:03.663 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:26:03.664 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:26:03.664 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:26:03.664 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:26:03.664 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:26:03.664 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:26:03.664 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:26:03.664 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:26:03.665 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:26:03.665 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:26:04.112 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-09-30T22:26:04.114 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-09-30T22:26:04.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-30T22:26:04.284 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-30T22:26:04.326 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-30T22:26:04.403 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:26:04.403 INFO:tasks.ceph:role: osd.3 2023-09-30T22:26:04.403 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com 2023-09-30T22:26:04.403 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-30T22:26:04.485 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:26:04.485 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:26:04.485 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:26:04.486 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:26:04.486 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:26:04.486 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:26:04.486 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:26:04.486 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:26:04.486 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:26:04.486 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:26:04.919 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-09-30T22:26:04.921 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-09-30T22:26:04.921 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-30T22:26:05.072 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-30T22:26:05.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:26:05.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:05.212+0000 7f0f10f1f200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-30T22:26:05.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:05.212+0000 7f0f10f1f200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-30T22:26:05.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:05.212+0000 7f0f10f1f200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T22:26:05.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:05.212+0000 7f0f10f1f200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T22:26:05.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:05.212+0000 7f0f10f1f200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T22:26:05.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:05.212+0000 7f0f10f1f200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-30T22:26:08.057 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-30T22:26:08.093 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:26:08.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:08.187+0000 7f7c16e08200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-30T22:26:08.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:08.187+0000 7f7c16e08200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-30T22:26:08.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:08.187+0000 7f7c16e08200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T22:26:08.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:08.187+0000 7f7c16e08200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T22:26:08.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:08.187+0000 7f7c16e08200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T22:26:08.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:08.188+0000 7f7c16e08200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-30T22:26:11.042 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-30T22:26:11.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:26:11.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:11.171+0000 7f5c3f80e200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-30T22:26:11.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:11.171+0000 7f5c3f80e200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-30T22:26:11.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:11.171+0000 7f5c3f80e200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T22:26:11.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:11.171+0000 7f5c3f80e200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T22:26:11.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:11.171+0000 7f5c3f80e200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T22:26:11.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:11.172+0000 7f5c3f80e200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-30T22:26:14.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-30T22:26:14.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:26:14.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:14.143+0000 7fe6dc356200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-30T22:26:14.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:14.143+0000 7fe6dc356200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-30T22:26:14.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:14.143+0000 7fe6dc356200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T22:26:14.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:14.143+0000 7fe6dc356200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T22:26:14.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:14.143+0000 7fe6dc356200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T22:26:14.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:14.143+0000 7fe6dc356200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-09-30T22:26:16.987 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-30T22:26:17.021 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-30T22:26:17.022 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:26:17.022 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-30T22:26:17.097 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:26:17.097 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-30T22:26:17.172 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:26:17.172 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-30T22:26:17.247 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:26:17.247 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-30T22:26:17.322 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:26:17.323 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-30T22:26:17.398 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:26:17.398 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-30T22:26:17.473 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-09-30T22:26:17.474 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-30T22:26:17.496 INFO:tasks.ceph:Adding keys to all mons... 2023-09-30T22:26:17.497 DEBUG:teuthology.orchestra.run.smithi059:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-30T22:26:17.547 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.x] 2023-09-30T22:26:17.547 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQB5oBhlIwQVLxAAfiJzgw60z2SXTpaWiVuMQw== 2023-09-30T22:26:17.548 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2023-09-30T22:26:17.548 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQB5oBhlMca8MhAA7qUzqI98nGnBDwtO13o18A== 2023-09-30T22:26:17.548 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.0] 2023-09-30T22:26:17.548 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQB9oBhlQsW8DBAAK7u9FCmzf7YPtRpJ/fA83g== 2023-09-30T22:26:17.548 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.1] 2023-09-30T22:26:17.548 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCAoBhl1xZDCxAAczt9ZtRnTtopH3OlTGVdNw== 2023-09-30T22:26:17.548 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.2] 2023-09-30T22:26:17.548 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCDoBhl6wlOChAA2W3USm8qGMl9sxGo4aVOuQ== 2023-09-30T22:26:17.549 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.3] 2023-09-30T22:26:17.549 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCGoBhlFnWPCBAAEq/Od1g6B8441sO2YQQQTw== 2023-09-30T22:26:17.549 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2023-09-30T22:26:17.549 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQB6oBhlGoYyABAACLXahSoa6jDR2xs8Ldi5Ig== 2023-09-30T22:26:17.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T22:26:17.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T22:26:17.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:26:17.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:26:17.823 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:26:17.879 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:26:17.935 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T22:26:17.993 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-30T22:26:17.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-30T22:26:18.024 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T22:26:18.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-30T22:26:18.160 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-30T22:26:18.233 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T22:26:18.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-30T22:26:18.374 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-30T22:26:18.450 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T22:26:18.557 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-30T22:26:18.589 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:26:18.652 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-30T22:26:18.652 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-30T22:26:18.652 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-30T22:26:18.695 INFO:tasks.ceph.mon.a:Started 2023-09-30T22:26:18.695 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-30T22:26:18.696 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-30T22:26:18.697 INFO:tasks.ceph.mon.b:Started 2023-09-30T22:26:18.698 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-30T22:26:18.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-30T22:26:18.700 INFO:tasks.ceph.mon.c:Started 2023-09-30T22:26:18.700 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-30T22:26:18.700 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-30T22:26:18.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-30T22:26:18.702 INFO:tasks.ceph.mgr.x:Started 2023-09-30T22:26:18.702 INFO:tasks.ceph:Setting crush tunables to default 2023-09-30T22:26:18.703 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd crush tunables default 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.871+0000 7fa2507bc700 1 Processor -- start 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.871+0000 7fa2507bc700 1 -- start start 2023-09-30T22:26:18.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa2507bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2480937b0 0x7fa2480953f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:18.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa2507bc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa2480958e0 0x7fa248095cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:18.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa2507bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa24812c1c0 0x7fa24812e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:18.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa2507bc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa248093b90 con 0x7fa2480958e0 2023-09-30T22:26:18.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa2507bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa248094f40 con 0x7fa2480937b0 2023-09-30T22:26:18.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa2507bc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480967f0 con 0x7fa24812c1c0 2023-09-30T22:26:18.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa24e558700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2480937b0 0x7fa2480953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:18.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa24e558700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2480937b0 0x7fa2480953f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36428/0 (socket says 172.21.15.59:36428) 2023-09-30T22:26:18.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa24e558700 1 -- 172.21.15.59:0/2486940549 learned_addr learned my addr 172.21.15.59:0/2486940549 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:18.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa24dd57700 1 --2- 172.21.15.59:0/2486940549 >> v2:172.21.15.59:3300/0 conn(0x7fa2480958e0 0x7fa248095cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:18.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa24dd57700 1 -- 172.21.15.59:0/2486940549 >> v2:172.21.15.59:3300/0 conn(0x7fa2480958e0 msgr2=0x7fa248095cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:26:18.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa24dd57700 1 -- 172.21.15.59:0/2486940549 >> v2:172.21.15.59:3300/0 conn(0x7fa2480958e0 msgr2=0x7fa248095cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:26:18.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa24dd57700 1 --2- 172.21.15.59:0/2486940549 >> v2:172.21.15.59:3300/0 conn(0x7fa2480958e0 0x7fa248095cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:26:18.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa24dd57700 1 --2- 172.21.15.59:0/2486940549 >> v2:172.21.15.59:3300/0 conn(0x7fa2480958e0 0x7fa248095cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:26:18.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa24e558700 1 -- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2480937b0 msgr2=0x7fa2480953f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:26:18.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa24e558700 1 -- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2480937b0 msgr2=0x7fa2480953f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:26:18.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa24e558700 1 --2- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2480937b0 0x7fa2480953f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:26:18.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.872+0000 7fa24e558700 1 --2- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2480937b0 0x7fa2480953f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:26:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.873+0000 7fa24ed59700 1 --2- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa24812c1c0 0x7fa24812e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.873+0000 7fa24ed59700 1 -- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa24812c1c0 msgr2=0x7fa24812e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:26:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.873+0000 7fa24ed59700 1 -- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa24812c1c0 msgr2=0x7fa24812e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:26:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.873+0000 7fa24ed59700 1 --2- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa24812c1c0 0x7fa24812e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:26:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:18.873+0000 7fa24ed59700 1 --2- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa24812c1c0 0x7fa24812e5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:26:19.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.073+0000 7fa24e558700 1 --2- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2480937b0 0x7fa2480953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:19.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.073+0000 7fa24dd57700 1 --2- 172.21.15.59:0/2486940549 >> v2:172.21.15.59:3300/0 conn(0x7fa2480958e0 0x7fa248095cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:19.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.073+0000 7fa24e558700 1 -- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa24812c1c0 msgr2=0x7fa24812e5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:26:19.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.073+0000 7fa24e558700 1 --2- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa24812c1c0 0x7fa24812e5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.073+0000 7fa24e558700 1 -- 172.21.15.59:0/2486940549 >> v2:172.21.15.59:3300/0 conn(0x7fa2480958e0 msgr2=0x7fa248095cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:19.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.073+0000 7fa24e558700 1 --2- 172.21.15.59:0/2486940549 >> v2:172.21.15.59:3300/0 conn(0x7fa2480958e0 0x7fa248095cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.073+0000 7fa24e558700 1 -- 172.21.15.59:0/2486940549 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa248096fe0 con 0x7fa2480937b0 2023-09-30T22:26:19.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.073+0000 7fa24dd57700 1 --2- 172.21.15.59:0/2486940549 >> v2:172.21.15.59:3300/0 conn(0x7fa2480958e0 0x7fa248095cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:19.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.073+0000 7fa24e558700 1 --2- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2480937b0 0x7fa2480953f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fa24400bbc0 tx=0x7fa24400b1c0).ready entity=mon.1 client_cookie=4c1fb8f03ccf9a0e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:19.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.073+0000 7fa24d556700 1 -- 172.21.15.59:0/2486940549 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244009dc0 con 0x7fa2480937b0 2023-09-30T22:26:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.074+0000 7fa24d556700 1 -- 172.21.15.59:0/2486940549 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa244011040 con 0x7fa2480937b0 2023-09-30T22:26:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.074+0000 7fa24d556700 1 -- 172.21.15.59:0/2486940549 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244016650 con 0x7fa2480937b0 2023-09-30T22:26:19.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.074+0000 7fa2507bc700 1 -- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2480937b0 msgr2=0x7fa2480953f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.074+0000 7fa2507bc700 1 --2- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2480937b0 0x7fa2480953f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fa24400bbc0 tx=0x7fa24400b1c0).stop 2023-09-30T22:26:19.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.074+0000 7fa2507bc700 1 -- 172.21.15.59:0/2486940549 shutdown_connections 2023-09-30T22:26:19.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.074+0000 7fa2507bc700 1 --2- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa24812c1c0 0x7fa24812e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.074+0000 7fa2507bc700 1 --2- 172.21.15.59:0/2486940549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2480937b0 0x7fa2480953f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.074+0000 7fa2507bc700 1 --2- 172.21.15.59:0/2486940549 >> v2:172.21.15.59:3300/0 conn(0x7fa2480958e0 0x7fa248095cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.074+0000 7fa2507bc700 1 -- 172.21.15.59:0/2486940549 >> 172.21.15.59:0/2486940549 conn(0x7fa2480974f0 msgr2=0x7fa248097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:19.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.074+0000 7fa2507bc700 1 -- 172.21.15.59:0/2486940549 shutdown_connections 2023-09-30T22:26:19.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.074+0000 7fa2507bc700 1 -- 172.21.15.59:0/2486940549 wait complete. 2023-09-30T22:26:19.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.075+0000 7fa2507bc700 1 Processor -- start 2023-09-30T22:26:19.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.075+0000 7fa2507bc700 1 -- start start 2023-09-30T22:26:19.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa2507bc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2480937b0 0x7fa24811a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa2507bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2480958e0 0x7fa24811a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa2507bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa24812c1c0 0x7fa24811ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa2507bc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24811b0f0 con 0x7fa2480937b0 2023-09-30T22:26:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa2507bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24811d7b0 con 0x7fa24812c1c0 2023-09-30T22:26:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa2507bc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa24811be40 con 0x7fa2480958e0 2023-09-30T22:26:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa24ed59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa24812c1c0 0x7fa24811ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa24dd57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2480958e0 0x7fa24811a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa24ed59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa24812c1c0 0x7fa24811ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36462/0 (socket says 172.21.15.59:36462) 2023-09-30T22:26:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa24dd57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2480958e0 0x7fa24811a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37104/0 (socket says 172.21.15.59:37104) 2023-09-30T22:26:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa24ed59700 1 -- 172.21.15.59:0/1684951181 learned_addr learned my addr 172.21.15.59:0/1684951181 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa24e558700 1 --2- 172.21.15.59:0/1684951181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2480937b0 0x7fa24811a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa24e558700 1 -- 172.21.15.59:0/1684951181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2480958e0 msgr2=0x7fa24811a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa24e558700 1 --2- 172.21.15.59:0/1684951181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2480958e0 0x7fa24811a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa24e558700 1 -- 172.21.15.59:0/1684951181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa24812c1c0 msgr2=0x7fa24811ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa24e558700 1 --2- 172.21.15.59:0/1684951181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa24812c1c0 0x7fa24811ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.076+0000 7fa24e558700 1 -- 172.21.15.59:0/1684951181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23800e040 con 0x7fa2480937b0 2023-09-30T22:26:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.077+0000 7fa24ed59700 1 --2- 172.21.15.59:0/1684951181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa24812c1c0 0x7fa24811ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.077+0000 7fa24e558700 1 --2- 172.21.15.59:0/1684951181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2480937b0 0x7fa24811a220 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fa244016000 tx=0x7fa244019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.077+0000 7fa23e7fc700 1 -- 172.21.15.59:0/1684951181 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244016690 con 0x7fa2480937b0 2023-09-30T22:26:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.077+0000 7fa23e7fc700 1 -- 172.21.15.59:0/1684951181 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa244016a80 con 0x7fa2480937b0 2023-09-30T22:26:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.077+0000 7fa2507bc700 1 -- 172.21.15.59:0/1684951181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24400b480 con 0x7fa2480937b0 2023-09-30T22:26:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.077+0000 7fa23e7fc700 1 -- 172.21.15.59:0/1684951181 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244016e20 con 0x7fa2480937b0 2023-09-30T22:26:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.077+0000 7fa2507bc700 1 -- 172.21.15.59:0/1684951181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24806a4b0 con 0x7fa2480937b0 2023-09-30T22:26:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.077+0000 7fa23e7fc700 1 -- 172.21.15.59:0/1684951181 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fa24401f860 con 0x7fa2480937b0 2023-09-30T22:26:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.077+0000 7fa23e7fc700 1 -- 172.21.15.59:0/1684951181 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa244028740 con 0x7fa2480937b0 2023-09-30T22:26:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.078+0000 7fa2507bc700 1 -- 172.21.15.59:0/1684951181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24805a260 con 0x7fa2480937b0 2023-09-30T22:26:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.081+0000 7fa23e7fc700 1 -- 172.21.15.59:0/1684951181 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa244024070 con 0x7fa2480937b0 2023-09-30T22:26:19.148 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:19.148+0000 7ff5d3b59680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T22:26:19.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.158+0000 7fa2507bc700 1 -- 172.21.15.59:0/1684951181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa248046c20 con 0x7fa2480937b0 2023-09-30T22:26:19.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.163+0000 7fa23e7fc700 1 -- 172.21.15.59:0/1684951181 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa24401b040 con 0x7fa2480937b0 2023-09-30T22:26:19.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.164+0000 7fa2507bc700 1 -- 172.21.15.59:0/1684951181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2480937b0 msgr2=0x7fa24811a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.164+0000 7fa2507bc700 1 --2- 172.21.15.59:0/1684951181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2480937b0 0x7fa24811a220 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fa244016000 tx=0x7fa244019000).stop 2023-09-30T22:26:19.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.164+0000 7fa2507bc700 1 -- 172.21.15.59:0/1684951181 shutdown_connections 2023-09-30T22:26:19.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.164+0000 7fa2507bc700 1 --2- 172.21.15.59:0/1684951181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa24812c1c0 0x7fa24811ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.164+0000 7fa2507bc700 1 --2- 172.21.15.59:0/1684951181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2480937b0 0x7fa24811a220 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.164+0000 7fa2507bc700 1 --2- 172.21.15.59:0/1684951181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2480958e0 0x7fa24811a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.164+0000 7fa2507bc700 1 -- 172.21.15.59:0/1684951181 >> 172.21.15.59:0/1684951181 conn(0x7fa2480974f0 msgr2=0x7fa2480689c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:19.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.164+0000 7fa2507bc700 1 -- 172.21.15.59:0/1684951181 shutdown_connections 2023-09-30T22:26:19.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.164+0000 7fa2507bc700 1 -- 172.21.15.59:0/1684951181 wait complete. 2023-09-30T22:26:19.165 INFO:teuthology.orchestra.run.smithi059.stderr:adjusted tunables profile to default 2023-09-30T22:26:19.178 INFO:tasks.ceph:check_enable_crimson: False 2023-09-30T22:26:19.178 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-30T22:26:19.178 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:26:19.179 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-30T22:26:19.212 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:26:19.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-30T22:26:19.235 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:19.235+0000 7ff5d3b59680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T22:26:19.264 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:26:19.264 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-30T22:26:19.334 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:19.334+0000 7ff5d3b59680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T22:26:19.337 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:26:19.337 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-30T22:26:19.407 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new d0b434cc-ff57-487c-b74e-732daf83db21 0 2023-09-30T22:26:19.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.577+0000 7f7e2bc14700 1 Processor -- start 2023-09-30T22:26:19.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.577+0000 7f7e2bc14700 1 -- start start 2023-09-30T22:26:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.577+0000 7f7e2bc14700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e24091d30 0x7f7e24096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.577+0000 7f7e2bc14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e24096b10 0x7f7e24096ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.577+0000 7f7e2bc14700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e24093f70 con 0x7f7e240973e0 2023-09-30T22:26:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.577+0000 7f7e2bc14700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e24092110 con 0x7f7e24091d30 2023-09-30T22:26:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.577+0000 7f7e2bc14700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240927f0 con 0x7f7e24096b10 2023-09-30T22:26:19.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.578+0000 7f7e299b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e24091d30 0x7f7e24096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:19.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.578+0000 7f7e2a1b1700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7e240973e0 0x7f7e2412f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49642/0 (socket says 172.21.15.59:49642) 2023-09-30T22:26:19.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.578+0000 7f7e2a1b1700 1 -- 172.21.15.59:0/4232843919 learned_addr learned my addr 172.21.15.59:0/4232843919 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:19.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.578+0000 7f7e291af700 1 --2- 172.21.15.59:0/4232843919 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e24096b10 0x7f7e24096ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:19.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.578+0000 7f7e291af700 1 -- 172.21.15.59:0/4232843919 >> v2:172.21.15.59:3300/0 conn(0x7f7e24091d30 msgr2=0x7f7e24096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:19.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.578+0000 7f7e291af700 1 --2- 172.21.15.59:0/4232843919 >> v2:172.21.15.59:3300/0 conn(0x7f7e24091d30 0x7f7e24096620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.578+0000 7f7e291af700 1 -- 172.21.15.59:0/4232843919 >> v1:172.21.15.59:6789/0 conn(0x7f7e240973e0 legacy=0x7f7e2412f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.578+0000 7f7e289ae700 1 -- 172.21.15.59:0/4232843919 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682440052 0 0) 0x7f7e24093f70 con 0x7f7e240973e0 2023-09-30T22:26:19.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.578+0000 7f7e291af700 1 -- 172.21.15.59:0/4232843919 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e24095c40 con 0x7f7e24096b10 2023-09-30T22:26:19.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.578+0000 7f7e299b0700 1 --2- 172.21.15.59:0/4232843919 >> v2:172.21.15.59:3300/0 conn(0x7f7e24091d30 0x7f7e24096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:19.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.578+0000 7f7e291af700 1 --2- 172.21.15.59:0/4232843919 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e24096b10 0x7f7e24096ef0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7e14009790 tx=0x7f7e14009060).ready entity=mon.1 client_cookie=b9764d2825b0d2a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:19.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.578+0000 7f7e289ae700 1 -- 172.21.15.59:0/4232843919 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1400f510 con 0x7f7e24096b10 2023-09-30T22:26:19.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.578+0000 7f7e289ae700 1 -- 172.21.15.59:0/4232843919 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1400f670 con 0x7f7e24096b10 2023-09-30T22:26:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.578+0000 7f7e289ae700 1 -- 172.21.15.59:0/4232843919 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1400f9f0 con 0x7f7e24096b10 2023-09-30T22:26:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.579+0000 7f7e2bc14700 1 -- 172.21.15.59:0/4232843919 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e24096b10 msgr2=0x7f7e24096ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.579+0000 7f7e2bc14700 1 --2- 172.21.15.59:0/4232843919 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e24096b10 0x7f7e24096ef0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7e14009790 tx=0x7f7e14009060).stop 2023-09-30T22:26:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.579+0000 7f7e2bc14700 1 -- 172.21.15.59:0/4232843919 shutdown_connections 2023-09-30T22:26:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.579+0000 7f7e2bc14700 1 --2- 172.21.15.59:0/4232843919 >> v2:172.21.15.59:3300/0 conn(0x7f7e24091d30 0x7f7e24096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.579+0000 7f7e2bc14700 1 --2- 172.21.15.59:0/4232843919 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e24096b10 0x7f7e24096ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.579+0000 7f7e2bc14700 1 -- 172.21.15.59:0/4232843919 >> 172.21.15.59:0/4232843919 conn(0x7f7e24098720 msgr2=0x7f7e24098b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.579+0000 7f7e2bc14700 1 -- 172.21.15.59:0/4232843919 shutdown_connections 2023-09-30T22:26:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.579+0000 7f7e2bc14700 1 -- 172.21.15.59:0/4232843919 wait complete. 2023-09-30T22:26:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.580+0000 7f7e2bc14700 1 Processor -- start 2023-09-30T22:26:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.580+0000 7f7e2bc14700 1 -- start start 2023-09-30T22:26:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.580+0000 7f7e2bc14700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e24091d30 0x7f7e241382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.580+0000 7f7e2bc14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e24096b10 0x7f7e241387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e2bc14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e240973e0 0x7f7e24138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e2bc14700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2411c050 con 0x7f7e24091d30 2023-09-30T22:26:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e2bc14700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2406a710 con 0x7f7e24096b10 2023-09-30T22:26:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e2bc14700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2406a420 con 0x7f7e240973e0 2023-09-30T22:26:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e299b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e24091d30 0x7f7e241382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e2a1b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e240973e0 0x7f7e24138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e299b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e24091d30 0x7f7e241382e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34616/0 (socket says 172.21.15.59:34616) 2023-09-30T22:26:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e299b0700 1 -- 172.21.15.59:0/4140444846 learned_addr learned my addr 172.21.15.59:0/4140444846 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e291af700 1 --2- 172.21.15.59:0/4140444846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e24096b10 0x7f7e241387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e299b0700 1 -- 172.21.15.59:0/4140444846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e240973e0 msgr2=0x7f7e24138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e299b0700 1 --2- 172.21.15.59:0/4140444846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e240973e0 0x7f7e24138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e299b0700 1 -- 172.21.15.59:0/4140444846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e24096b10 msgr2=0x7f7e241387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e299b0700 1 --2- 172.21.15.59:0/4140444846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e24096b10 0x7f7e241387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e299b0700 1 -- 172.21.15.59:0/4140444846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e200092a0 con 0x7f7e24091d30 2023-09-30T22:26:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e291af700 1 --2- 172.21.15.59:0/4140444846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e24096b10 0x7f7e241387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e299b0700 1 --2- 172.21.15.59:0/4140444846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e24091d30 0x7f7e241382e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7e2000ea50 tx=0x7f7e20009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e19ffb700 1 -- 172.21.15.59:0/4140444846 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2000ee90 con 0x7f7e24091d30 2023-09-30T22:26:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e19ffb700 1 -- 172.21.15.59:0/4140444846 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2000c850 con 0x7f7e24091d30 2023-09-30T22:26:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e19ffb700 1 -- 172.21.15.59:0/4140444846 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2000cbd0 con 0x7f7e24091d30 2023-09-30T22:26:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.581+0000 7f7e2bc14700 1 -- 172.21.15.59:0/4140444846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e140092a0 con 0x7f7e24091d30 2023-09-30T22:26:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.582+0000 7f7e19ffb700 1 -- 172.21.15.59:0/4140444846 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f7e2001b660 con 0x7f7e24091d30 2023-09-30T22:26:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.582+0000 7f7e2bc14700 1 -- 172.21.15.59:0/4140444846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2411c860 con 0x7f7e24091d30 2023-09-30T22:26:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.582+0000 7f7e19ffb700 1 -- 172.21.15.59:0/4140444846 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7e200123f0 con 0x7f7e24091d30 2023-09-30T22:26:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.583+0000 7f7e2bc14700 1 -- 172.21.15.59:0/4140444846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e240949a0 con 0x7f7e24091d30 2023-09-30T22:26:19.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.585+0000 7f7e19ffb700 1 -- 172.21.15.59:0/4140444846 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f7e2003ae50 con 0x7f7e24091d30 2023-09-30T22:26:19.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.670+0000 7f7e2bc14700 1 -- 172.21.15.59:0/4140444846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d0b434cc-ff57-487c-b74e-732daf83db21", "id": 0} v 0) v1 -- 0x7f7e2405a260 con 0x7f7e24091d30 2023-09-30T22:26:19.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.675+0000 7f7e19ffb700 1 -- 172.21.15.59:0/4140444846 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d0b434cc-ff57-487c-b74e-732daf83db21", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7e20029030 con 0x7f7e24091d30 2023-09-30T22:26:19.675 INFO:teuthology.orchestra.run.smithi059.stdout:0 2023-09-30T22:26:19.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.676+0000 7f7e2bc14700 1 -- 172.21.15.59:0/4140444846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e24091d30 msgr2=0x7f7e241382e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.676+0000 7f7e2bc14700 1 --2- 172.21.15.59:0/4140444846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e24091d30 0x7f7e241382e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7e2000ea50 tx=0x7f7e20009060).stop 2023-09-30T22:26:19.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.676+0000 7f7e2bc14700 1 -- 172.21.15.59:0/4140444846 shutdown_connections 2023-09-30T22:26:19.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.676+0000 7f7e2bc14700 1 --2- 172.21.15.59:0/4140444846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e240973e0 0x7f7e24138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.676+0000 7f7e2bc14700 1 --2- 172.21.15.59:0/4140444846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e24091d30 0x7f7e241382e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.676+0000 7f7e2bc14700 1 --2- 172.21.15.59:0/4140444846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e24096b10 0x7f7e241387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.676+0000 7f7e2bc14700 1 -- 172.21.15.59:0/4140444846 >> 172.21.15.59:0/4140444846 conn(0x7f7e24098720 msgr2=0x7f7e24099ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.676+0000 7f7e2bc14700 1 -- 172.21.15.59:0/4140444846 shutdown_connections 2023-09-30T22:26:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.676+0000 7f7e2bc14700 1 -- 172.21.15.59:0/4140444846 wait complete. 2023-09-30T22:26:19.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new be6a19ee-8eef-4d1a-aa98-0a9665822d8b 1 2023-09-30T22:26:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.818+0000 7ff77f198700 1 Processor -- start 2023-09-30T22:26:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.818+0000 7ff77f198700 1 -- start start 2023-09-30T22:26:19.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.819+0000 7ff77f198700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff778096c20 0x7ff7781288b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:19.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.819+0000 7ff77f198700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff7781292f0 0x7ff778094300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.819+0000 7ff77f198700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff778096210 con 0x7ff778128ed0 2023-09-30T22:26:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.819+0000 7ff77f198700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7780964b0 con 0x7ff7781292f0 2023-09-30T22:26:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.819+0000 7ff77f198700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff778095790 con 0x7ff778096c20 2023-09-30T22:26:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.819+0000 7ff77cf34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff778096c20 0x7ff7781288b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.819+0000 7ff77d735700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff7781292f0 0x7ff778094300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.819+0000 7ff77cf34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff778096c20 0x7ff7781288b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36506/0 (socket says 172.21.15.59:36506) 2023-09-30T22:26:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.819+0000 7ff77cf34700 1 -- 172.21.15.59:0/3053370560 learned_addr learned my addr 172.21.15.59:0/3053370560 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.819+0000 7ff777fff700 1 --1- 172.21.15.59:0/3053370560 >> v1:172.21.15.59:6789/0 conn(0x7ff778128ed0 0x7ff778093bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49656/0 (socket says 172.21.15.59:49656) 2023-09-30T22:26:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.819+0000 7ff77d735700 1 -- 172.21.15.59:0/3053370560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff778096c20 msgr2=0x7ff7781288b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.819+0000 7ff77d735700 1 --2- 172.21.15.59:0/3053370560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff778096c20 0x7ff7781288b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.819+0000 7ff77d735700 1 -- 172.21.15.59:0/3053370560 >> v1:172.21.15.59:6789/0 conn(0x7ff778128ed0 legacy=0x7ff778093bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.820+0000 7ff7777fe700 1 -- 172.21.15.59:0/3053370560 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947732261 0 0) 0x7ff778096210 con 0x7ff778128ed0 2023-09-30T22:26:19.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.820+0000 7ff77d735700 1 -- 172.21.15.59:0/3053370560 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff778097000 con 0x7ff7781292f0 2023-09-30T22:26:19.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.820+0000 7ff77cf34700 1 --2- 172.21.15.59:0/3053370560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff778096c20 0x7ff7781288b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:19.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.820+0000 7ff77d735700 1 --2- 172.21.15.59:0/3053370560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7781292f0 0x7ff778094300 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff770009e60 tx=0x7ff770009780).ready entity=mon.0 client_cookie=f7b38db47b6e23e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:19.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.820+0000 7ff7777fe700 1 -- 172.21.15.59:0/3053370560 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000e070 con 0x7ff7781292f0 2023-09-30T22:26:19.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.820+0000 7ff7777fe700 1 -- 172.21.15.59:0/3053370560 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77000bb60 con 0x7ff7781292f0 2023-09-30T22:26:19.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.820+0000 7ff7777fe700 1 -- 172.21.15.59:0/3053370560 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff770012410 con 0x7ff7781292f0 2023-09-30T22:26:19.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.820+0000 7ff77f198700 1 -- 172.21.15.59:0/3053370560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7781292f0 msgr2=0x7ff778094300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.820+0000 7ff77f198700 1 --2- 172.21.15.59:0/3053370560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7781292f0 0x7ff778094300 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff770009e60 tx=0x7ff770009780).stop 2023-09-30T22:26:19.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.821+0000 7ff77f198700 1 -- 172.21.15.59:0/3053370560 shutdown_connections 2023-09-30T22:26:19.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.821+0000 7ff77f198700 1 --2- 172.21.15.59:0/3053370560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7781292f0 0x7ff778094300 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.821+0000 7ff77f198700 1 --2- 172.21.15.59:0/3053370560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff778096c20 0x7ff7781288b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.821+0000 7ff77f198700 1 -- 172.21.15.59:0/3053370560 >> 172.21.15.59:0/3053370560 conn(0x7ff7780974f0 msgr2=0x7ff778097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:19.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.821+0000 7ff77f198700 1 -- 172.21.15.59:0/3053370560 shutdown_connections 2023-09-30T22:26:19.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.821+0000 7ff77f198700 1 -- 172.21.15.59:0/3053370560 wait complete. 2023-09-30T22:26:19.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.822+0000 7ff77f198700 1 Processor -- start 2023-09-30T22:26:19.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.822+0000 7ff77f198700 1 -- start start 2023-09-30T22:26:19.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.823+0000 7ff77f198700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff778096c20 0x7ff7781259b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:19.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.823+0000 7ff77f198700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff778128ed0 0x7ff7781148a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:19.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.823+0000 7ff77f198700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7781292f0 0x7ff778114d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:19.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.823+0000 7ff77f198700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7780959c0 con 0x7ff778128ed0 2023-09-30T22:26:19.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.823+0000 7ff77f198700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff778115d10 con 0x7ff7781292f0 2023-09-30T22:26:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.823+0000 7ff77f198700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff778118380 con 0x7ff778096c20 2023-09-30T22:26:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.823+0000 7ff777fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff778128ed0 0x7ff7781148a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.823+0000 7ff777fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff778128ed0 0x7ff7781148a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34628/0 (socket says 172.21.15.59:34628) 2023-09-30T22:26:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.823+0000 7ff777fff700 1 -- 172.21.15.59:0/1079782855 learned_addr learned my addr 172.21.15.59:0/1079782855 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.823+0000 7ff77d735700 1 --2- 172.21.15.59:0/1079782855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7781292f0 0x7ff778114d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.823+0000 7ff77cf34700 1 --2- 172.21.15.59:0/1079782855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff778096c20 0x7ff7781259b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.823+0000 7ff77d735700 1 -- 172.21.15.59:0/1079782855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff778096c20 msgr2=0x7ff7781259b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.823+0000 7ff77d735700 1 --2- 172.21.15.59:0/1079782855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff778096c20 0x7ff7781259b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.824+0000 7ff77d735700 1 -- 172.21.15.59:0/1079782855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff778128ed0 msgr2=0x7ff7781148a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.824+0000 7ff77d735700 1 --2- 172.21.15.59:0/1079782855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff778128ed0 0x7ff7781148a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.824+0000 7ff77d735700 1 -- 172.21.15.59:0/1079782855 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c009370 con 0x7ff7781292f0 2023-09-30T22:26:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.824+0000 7ff777fff700 1 --2- 172.21.15.59:0/1079782855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff778128ed0 0x7ff7781148a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.824+0000 7ff77d735700 1 --2- 172.21.15.59:0/1079782855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7781292f0 0x7ff778114d90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff778098350 tx=0x7ff770009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.824+0000 7ff774ff9700 1 -- 172.21.15.59:0/1079782855 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff770012410 con 0x7ff7781292f0 2023-09-30T22:26:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.824+0000 7ff774ff9700 1 -- 172.21.15.59:0/1079782855 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77001d630 con 0x7ff7781292f0 2023-09-30T22:26:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.824+0000 7ff77f198700 1 -- 172.21.15.59:0/1079782855 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff770009a20 con 0x7ff7781292f0 2023-09-30T22:26:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.824+0000 7ff774ff9700 1 -- 172.21.15.59:0/1079782855 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7700070e0 con 0x7ff7781292f0 2023-09-30T22:26:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.824+0000 7ff77f198700 1 -- 172.21.15.59:0/1079782855 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff778125ea0 con 0x7ff7781292f0 2023-09-30T22:26:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.824+0000 7ff774ff9700 1 -- 172.21.15.59:0/1079782855 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff770003040 con 0x7ff7781292f0 2023-09-30T22:26:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.824+0000 7ff774ff9700 1 -- 172.21.15.59:0/1079782855 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7ff770027d00 con 0x7ff7781292f0 2023-09-30T22:26:19.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.825+0000 7ff77f198700 1 -- 172.21.15.59:0/1079782855 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff778126980 con 0x7ff7781292f0 2023-09-30T22:26:19.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.828+0000 7ff774ff9700 1 -- 172.21.15.59:0/1079782855 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ff770017070 con 0x7ff7781292f0 2023-09-30T22:26:19.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.913+0000 7ff77f198700 1 -- 172.21.15.59:0/1079782855 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd new", "uuid": "be6a19ee-8eef-4d1a-aa98-0a9665822d8b", "id": 1} v 0) v1 -- 0x7ff77805a260 con 0x7ff7781292f0 2023-09-30T22:26:19.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.918+0000 7ff774ff9700 1 -- 172.21.15.59:0/1079782855 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be6a19ee-8eef-4d1a-aa98-0a9665822d8b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff770027460 con 0x7ff7781292f0 2023-09-30T22:26:19.918 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-09-30T22:26:19.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.919+0000 7ff77f198700 1 -- 172.21.15.59:0/1079782855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7781292f0 msgr2=0x7ff778114d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.919+0000 7ff77f198700 1 --2- 172.21.15.59:0/1079782855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7781292f0 0x7ff778114d90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff778098350 tx=0x7ff770009780).stop 2023-09-30T22:26:19.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.919+0000 7ff77f198700 1 -- 172.21.15.59:0/1079782855 shutdown_connections 2023-09-30T22:26:19.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.919+0000 7ff77f198700 1 --2- 172.21.15.59:0/1079782855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff778096c20 0x7ff7781259b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.919+0000 7ff77f198700 1 --2- 172.21.15.59:0/1079782855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7781292f0 0x7ff778114d90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.919+0000 7ff77f198700 1 --2- 172.21.15.59:0/1079782855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff778128ed0 0x7ff7781148a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:19.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.919+0000 7ff77f198700 1 -- 172.21.15.59:0/1079782855 >> 172.21.15.59:0/1079782855 conn(0x7ff7780974f0 msgr2=0x7ff778098800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:19.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.920+0000 7ff77f198700 1 -- 172.21.15.59:0/1079782855 shutdown_connections 2023-09-30T22:26:19.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:19.920+0000 7ff77f198700 1 -- 172.21.15.59:0/1079782855 wait complete. 2023-09-30T22:26:19.933 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new e23ec521-1072-4f90-9c51-51470aa9b4bf 2 2023-09-30T22:26:20.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.076+0000 7f0834c71700 1 Processor -- start 2023-09-30T22:26:20.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.076+0000 7f0834c71700 1 -- start start 2023-09-30T22:26:20.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.078+0000 7f0834c71700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f08300939b0 0x7f0830097ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:20.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.078+0000 7f0834c71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0830098410 0x7f083012e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:20.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.078+0000 7f0834c71700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0830092f10 con 0x7f0830097fb0 2023-09-30T22:26:20.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.078+0000 7f0834c71700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0830093d90 con 0x7f08300939b0 2023-09-30T22:26:20.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.078+0000 7f0834c71700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083006a2b0 con 0x7f0830098410 2023-09-30T22:26:20.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.078+0000 7f082e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f08300939b0 0x7f0830097ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:20.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.078+0000 7f082e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f08300939b0 0x7f0830097ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34642/0 (socket says 172.21.15.59:34642) 2023-09-30T22:26:20.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.078+0000 7f082e59c700 1 -- 172.21.15.59:0/4227738579 learned_addr learned my addr 172.21.15.59:0/4227738579 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:20.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.078+0000 7f082ed9d700 1 --2- 172.21.15.59:0/4227738579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0830098410 0x7f083012e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:20.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.079+0000 7f082d59a700 1 -- 172.21.15.59:0/4227738579 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790543061 0 0) 0x7f0830092f10 con 0x7f0830097fb0 2023-09-30T22:26:20.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.079+0000 7f082d59a700 1 -- 172.21.15.59:0/4227738579 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0818007800 con 0x7f0830097fb0 2023-09-30T22:26:20.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.079+0000 7f082ed9d700 1 -- 172.21.15.59:0/4227738579 >> v2:172.21.15.59:3300/0 conn(0x7f08300939b0 msgr2=0x7f0830097ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:20.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.079+0000 7f082ed9d700 1 --2- 172.21.15.59:0/4227738579 >> v2:172.21.15.59:3300/0 conn(0x7f08300939b0 0x7f0830097ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.079+0000 7f082ed9d700 1 -- 172.21.15.59:0/4227738579 >> v1:172.21.15.59:6789/0 conn(0x7f0830097fb0 legacy=0x7f083012b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.079+0000 7f082ed9d700 1 -- 172.21.15.59:0/4227738579 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0830092ca0 con 0x7f0830098410 2023-09-30T22:26:20.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.079+0000 7f082ed9d700 1 --2- 172.21.15.59:0/4227738579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0830098410 0x7f083012e7f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f0828009e60 tx=0x7f0828009780).ready entity=mon.1 client_cookie=4288cb463b90df14 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.080+0000 7f082d59a700 1 -- 172.21.15.59:0/4227738579 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082800e070 con 0x7f0830098410 2023-09-30T22:26:20.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.080+0000 7f082d59a700 1 -- 172.21.15.59:0/4227738579 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082800bab0 con 0x7f0830098410 2023-09-30T22:26:20.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.080+0000 7f082d59a700 1 -- 172.21.15.59:0/4227738579 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082800be30 con 0x7f0830098410 2023-09-30T22:26:20.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.081+0000 7f0834c71700 1 -- 172.21.15.59:0/4227738579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0830098410 msgr2=0x7f083012e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.081+0000 7f0834c71700 1 --2- 172.21.15.59:0/4227738579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0830098410 0x7f083012e7f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f0828009e60 tx=0x7f0828009780).stop 2023-09-30T22:26:20.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.081+0000 7f0834c71700 1 -- 172.21.15.59:0/4227738579 shutdown_connections 2023-09-30T22:26:20.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.081+0000 7f0834c71700 1 --2- 172.21.15.59:0/4227738579 >> v2:172.21.15.59:3300/0 conn(0x7f08300939b0 0x7f0830097ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.081+0000 7f0834c71700 1 --2- 172.21.15.59:0/4227738579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0830098410 0x7f083012e7f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.081+0000 7f0834c71700 1 -- 172.21.15.59:0/4227738579 >> 172.21.15.59:0/4227738579 conn(0x7f0830059b40 msgr2=0x7f08300998d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.082+0000 7f0834c71700 1 -- 172.21.15.59:0/4227738579 shutdown_connections 2023-09-30T22:26:20.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.082+0000 7f0834c71700 1 -- 172.21.15.59:0/4227738579 wait complete. 2023-09-30T22:26:20.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.083+0000 7f0834c71700 1 Processor -- start 2023-09-30T22:26:20.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.084+0000 7f0834c71700 1 -- start start 2023-09-30T22:26:20.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.085+0000 7f0834c71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08300939b0 0x7f08301357c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:20.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.085+0000 7f0834c71700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0830097fb0 0x7f0830135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:20.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.085+0000 7f0834c71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0830098410 0x7f08301361a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:20.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.085+0000 7f0834c71700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0830119530 con 0x7f0830097fb0 2023-09-30T22:26:20.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.085+0000 7f0834c71700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0830092880 con 0x7f08300939b0 2023-09-30T22:26:20.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.085+0000 7f0834c71700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0830096570 con 0x7f0830098410 2023-09-30T22:26:20.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.085+0000 7f082ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0830098410 0x7f08301361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:20.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.085+0000 7f082dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0830097fb0 0x7f0830135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:20.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.085+0000 7f082ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0830098410 0x7f08301361a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37128/0 (socket says 172.21.15.59:37128) 2023-09-30T22:26:20.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.085+0000 7f082ed9d700 1 -- 172.21.15.59:0/3232627066 learned_addr learned my addr 172.21.15.59:0/3232627066 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:20.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.085+0000 7f082e59c700 1 --2- 172.21.15.59:0/3232627066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08300939b0 0x7f08301357c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:20.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.086+0000 7f082dd9b700 1 -- 172.21.15.59:0/3232627066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0830098410 msgr2=0x7f08301361a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.086+0000 7f082dd9b700 1 --2- 172.21.15.59:0/3232627066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0830098410 0x7f08301361a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.086+0000 7f082dd9b700 1 -- 172.21.15.59:0/3232627066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08300939b0 msgr2=0x7f08301357c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.086+0000 7f082dd9b700 1 --2- 172.21.15.59:0/3232627066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08300939b0 0x7f08301357c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.086+0000 7f082dd9b700 1 -- 172.21.15.59:0/3232627066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0828009a20 con 0x7f0830097fb0 2023-09-30T22:26:20.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.086+0000 7f082ed9d700 1 --2- 172.21.15.59:0/3232627066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0830098410 0x7f08301361a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:20.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.086+0000 7f082dd9b700 1 --2- 172.21.15.59:0/3232627066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0830097fb0 0x7f0830135cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f082400c450 tx=0x7f0824007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.087+0000 7f081e7fc700 1 -- 172.21.15.59:0/3232627066 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0824012400 con 0x7f0830097fb0 2023-09-30T22:26:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.087+0000 7f081e7fc700 1 -- 172.21.15.59:0/3232627066 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0824012560 con 0x7f0830097fb0 2023-09-30T22:26:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.087+0000 7f0834c71700 1 -- 172.21.15.59:0/3232627066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0830117fc0 con 0x7f0830097fb0 2023-09-30T22:26:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.087+0000 7f081e7fc700 1 -- 172.21.15.59:0/3232627066 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0824012900 con 0x7f0830097fb0 2023-09-30T22:26:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.087+0000 7f0834c71700 1 -- 172.21.15.59:0/3232627066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08301175d0 con 0x7f0830097fb0 2023-09-30T22:26:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.087+0000 7f081e7fc700 1 -- 172.21.15.59:0/3232627066 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f082401c440 con 0x7f0830097fb0 2023-09-30T22:26:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.087+0000 7f081e7fc700 1 -- 172.21.15.59:0/3232627066 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f082401b7e0 con 0x7f0830097fb0 2023-09-30T22:26:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.089+0000 7f0834c71700 1 -- 172.21.15.59:0/3232627066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f083005a260 con 0x7f0830097fb0 2023-09-30T22:26:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.094+0000 7f081e7fc700 1 -- 172.21.15.59:0/3232627066 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f0824021060 con 0x7f0830097fb0 2023-09-30T22:26:20.151 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:20.151+0000 7ff5d3b59680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T22:26:20.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.198+0000 7f0834c71700 1 -- 172.21.15.59:0/3232627066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e23ec521-1072-4f90-9c51-51470aa9b4bf", "id": 2} v 0) v1 -- 0x7f0830119120 con 0x7f0830097fb0 2023-09-30T22:26:20.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.203+0000 7f081e7fc700 1 -- 172.21.15.59:0/3232627066 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e23ec521-1072-4f90-9c51-51470aa9b4bf", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0824017070 con 0x7f0830097fb0 2023-09-30T22:26:20.204 INFO:teuthology.orchestra.run.smithi059.stdout:2 2023-09-30T22:26:20.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.205+0000 7f0834c71700 1 -- 172.21.15.59:0/3232627066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0830097fb0 msgr2=0x7f0830135cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.205+0000 7f0834c71700 1 --2- 172.21.15.59:0/3232627066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0830097fb0 0x7f0830135cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f082400c450 tx=0x7f0824007bd0).stop 2023-09-30T22:26:20.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.205+0000 7f0834c71700 1 -- 172.21.15.59:0/3232627066 shutdown_connections 2023-09-30T22:26:20.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.205+0000 7f0834c71700 1 --2- 172.21.15.59:0/3232627066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0830098410 0x7f08301361a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.205+0000 7f0834c71700 1 --2- 172.21.15.59:0/3232627066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08300939b0 0x7f08301357c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.205+0000 7f0834c71700 1 --2- 172.21.15.59:0/3232627066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0830097fb0 0x7f0830135cb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.205+0000 7f0834c71700 1 -- 172.21.15.59:0/3232627066 >> 172.21.15.59:0/3232627066 conn(0x7f0830059b40 msgr2=0x7f0830068120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.205+0000 7f0834c71700 1 -- 172.21.15.59:0/3232627066 shutdown_connections 2023-09-30T22:26:20.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.205+0000 7f0834c71700 1 -- 172.21.15.59:0/3232627066 wait complete. 2023-09-30T22:26:20.218 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 287c081f-a40d-4dd9-8484-0262965ca8bb 3 2023-09-30T22:26:20.276 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:20.276+0000 7ff5d3b59680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T22:26:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.346+0000 7f1e5c8b0700 1 Processor -- start 2023-09-30T22:26:20.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.346+0000 7f1e5c8b0700 1 -- start start 2023-09-30T22:26:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.347+0000 7f1e5c8b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e58095b00 0x7f1e58095ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.347+0000 7f1e5c8b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e5812d1d0 0x7f1e5812f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.347+0000 7f1e5c8b0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e58096fe0 con 0x7f1e580937b0 2023-09-30T22:26:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.347+0000 7f1e5c8b0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e58093b90 con 0x7f1e5812d1d0 2023-09-30T22:26:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.347+0000 7f1e5c8b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e58094f40 con 0x7f1e58095b00 2023-09-30T22:26:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.347+0000 7f1e56d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e5812d1d0 0x7f1e5812f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.347+0000 7f1e55d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e58095b00 0x7f1e58095ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.347+0000 7f1e5659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1e580937b0 0x7f1e580953f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49678/0 (socket says 172.21.15.59:49678) 2023-09-30T22:26:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.347+0000 7f1e56d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e5812d1d0 0x7f1e5812f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34672/0 (socket says 172.21.15.59:34672) 2023-09-30T22:26:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.347+0000 7f1e5659c700 1 -- 172.21.15.59:0/1735910661 learned_addr learned my addr 172.21.15.59:0/1735910661 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.347+0000 7f1e55d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e58095b00 0x7f1e58095ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36556/0 (socket says 172.21.15.59:36556) 2023-09-30T22:26:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.348+0000 7f1e55d9b700 1 -- 172.21.15.59:0/1735910661 >> v2:172.21.15.59:3300/0 conn(0x7f1e5812d1d0 msgr2=0x7f1e5812f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.348+0000 7f1e55d9b700 1 --2- 172.21.15.59:0/1735910661 >> v2:172.21.15.59:3300/0 conn(0x7f1e5812d1d0 0x7f1e5812f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.348+0000 7f1e55d9b700 1 -- 172.21.15.59:0/1735910661 >> v1:172.21.15.59:6789/0 conn(0x7f1e580937b0 legacy=0x7f1e580953f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.348+0000 7f1e5559a700 1 -- 172.21.15.59:0/1735910661 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820498319 0 0) 0x7f1e58096fe0 con 0x7f1e580937b0 2023-09-30T22:26:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.348+0000 7f1e55d9b700 1 -- 172.21.15.59:0/1735910661 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e58094b10 con 0x7f1e58095b00 2023-09-30T22:26:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.348+0000 7f1e56d9d700 1 --2- 172.21.15.59:0/1735910661 >> v2:172.21.15.59:3300/0 conn(0x7f1e5812d1d0 0x7f1e5812f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.348+0000 7f1e55d9b700 1 --2- 172.21.15.59:0/1735910661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e58095b00 0x7f1e58095ee0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1e40009790 tx=0x7f1e40009060).ready entity=mon.1 client_cookie=b4ae6d0ffc3d7d26 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.348+0000 7f1e5559a700 1 -- 172.21.15.59:0/1735910661 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000f510 con 0x7f1e58095b00 2023-09-30T22:26:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.348+0000 7f1e5559a700 1 -- 172.21.15.59:0/1735910661 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4000f670 con 0x7f1e58095b00 2023-09-30T22:26:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.348+0000 7f1e5559a700 1 -- 172.21.15.59:0/1735910661 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000f9f0 con 0x7f1e58095b00 2023-09-30T22:26:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.349+0000 7f1e5c8b0700 1 -- 172.21.15.59:0/1735910661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e58095b00 msgr2=0x7f1e58095ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.349+0000 7f1e5c8b0700 1 --2- 172.21.15.59:0/1735910661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e58095b00 0x7f1e58095ee0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1e40009790 tx=0x7f1e40009060).stop 2023-09-30T22:26:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.349+0000 7f1e5c8b0700 1 -- 172.21.15.59:0/1735910661 shutdown_connections 2023-09-30T22:26:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.349+0000 7f1e5c8b0700 1 --2- 172.21.15.59:0/1735910661 >> v2:172.21.15.59:3300/0 conn(0x7f1e5812d1d0 0x7f1e5812f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.349+0000 7f1e5c8b0700 1 --2- 172.21.15.59:0/1735910661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e58095b00 0x7f1e58095ee0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.349+0000 7f1e5c8b0700 1 -- 172.21.15.59:0/1735910661 >> 172.21.15.59:0/1735910661 conn(0x7f1e580974f0 msgr2=0x7f1e58097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.349+0000 7f1e5c8b0700 1 -- 172.21.15.59:0/1735910661 shutdown_connections 2023-09-30T22:26:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.349+0000 7f1e5c8b0700 1 -- 172.21.15.59:0/1735910661 wait complete. 2023-09-30T22:26:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.350+0000 7f1e5c8b0700 1 Processor -- start 2023-09-30T22:26:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.350+0000 7f1e5c8b0700 1 -- start start 2023-09-30T22:26:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.350+0000 7f1e5c8b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e580937b0 0x7f1e5811bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.350+0000 7f1e5c8b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e58095b00 0x7f1e58117e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e5c8b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5812d1d0 0x7f1e58118300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e5c8b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5806a4b0 con 0x7f1e58095b00 2023-09-30T22:26:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e5c8b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5811b5d0 con 0x7f1e5812d1d0 2023-09-30T22:26:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e5c8b0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5811b310 con 0x7f1e580937b0 2023-09-30T22:26:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e55d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e58095b00 0x7f1e58117e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e55d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e58095b00 0x7f1e58117e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34678/0 (socket says 172.21.15.59:34678) 2023-09-30T22:26:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e55d9b700 1 -- 172.21.15.59:0/1992070754 learned_addr learned my addr 172.21.15.59:0/1992070754 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e5659c700 1 --2- 172.21.15.59:0/1992070754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e580937b0 0x7f1e5811bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e55d9b700 1 -- 172.21.15.59:0/1992070754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e580937b0 msgr2=0x7f1e5811bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e55d9b700 1 --2- 172.21.15.59:0/1992070754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e580937b0 0x7f1e5811bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e55d9b700 1 -- 172.21.15.59:0/1992070754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5812d1d0 msgr2=0x7f1e58118300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e55d9b700 1 --2- 172.21.15.59:0/1992070754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5812d1d0 0x7f1e58118300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e55d9b700 1 -- 172.21.15.59:0/1992070754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e500092a0 con 0x7f1e58095b00 2023-09-30T22:26:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e5659c700 1 --2- 172.21.15.59:0/1992070754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e580937b0 0x7f1e5811bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e55d9b700 1 --2- 172.21.15.59:0/1992070754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e58095b00 0x7f1e58117e10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f1e58097240 tx=0x7f1e40017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e4e7fc700 1 -- 172.21.15.59:0/1992070754 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000f7e0 con 0x7f1e58095b00 2023-09-30T22:26:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e4e7fc700 1 -- 172.21.15.59:0/1992070754 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4000f940 con 0x7f1e58095b00 2023-09-30T22:26:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e4e7fc700 1 -- 172.21.15.59:0/1992070754 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4001b660 con 0x7f1e58095b00 2023-09-30T22:26:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e5c8b0700 1 -- 172.21.15.59:0/1992070754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e400092a0 con 0x7f1e58095b00 2023-09-30T22:26:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.351+0000 7f1e5c8b0700 1 -- 172.21.15.59:0/1992070754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e581199a0 con 0x7f1e58095b00 2023-09-30T22:26:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.352+0000 7f1e4e7fc700 1 -- 172.21.15.59:0/1992070754 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f1e4001bc70 con 0x7f1e58095b00 2023-09-30T22:26:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.352+0000 7f1e4e7fc700 1 -- 172.21.15.59:0/1992070754 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f1e40024b70 con 0x7f1e58095b00 2023-09-30T22:26:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.353+0000 7f1e5c8b0700 1 -- 172.21.15.59:0/1992070754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e58119b60 con 0x7f1e58095b00 2023-09-30T22:26:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.355+0000 7f1e4e7fc700 1 -- 172.21.15.59:0/1992070754 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f1e40029060 con 0x7f1e58095b00 2023-09-30T22:26:20.430 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:20.430+0000 7ff5d3b59680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T22:26:20.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.440+0000 7f1e5c8b0700 1 -- 172.21.15.59:0/1992070754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "287c081f-a40d-4dd9-8484-0262965ca8bb", "id": 3} v 0) v1 -- 0x7f1e5811b810 con 0x7f1e58095b00 2023-09-30T22:26:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.446+0000 7f1e4e7fc700 1 -- 172.21.15.59:0/1992070754 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "287c081f-a40d-4dd9-8484-0262965ca8bb", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1e4001f070 con 0x7f1e58095b00 2023-09-30T22:26:20.446 INFO:teuthology.orchestra.run.smithi059.stdout:3 2023-09-30T22:26:20.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.447+0000 7f1e5c8b0700 1 -- 172.21.15.59:0/1992070754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e58095b00 msgr2=0x7f1e58117e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.447+0000 7f1e5c8b0700 1 --2- 172.21.15.59:0/1992070754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e58095b00 0x7f1e58117e10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f1e58097240 tx=0x7f1e40017000).stop 2023-09-30T22:26:20.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.447+0000 7f1e5c8b0700 1 -- 172.21.15.59:0/1992070754 shutdown_connections 2023-09-30T22:26:20.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.447+0000 7f1e5c8b0700 1 --2- 172.21.15.59:0/1992070754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e580937b0 0x7f1e5811bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.447+0000 7f1e5c8b0700 1 --2- 172.21.15.59:0/1992070754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5812d1d0 0x7f1e58118300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.447+0000 7f1e5c8b0700 1 --2- 172.21.15.59:0/1992070754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e58095b00 0x7f1e58117e10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.447+0000 7f1e5c8b0700 1 -- 172.21.15.59:0/1992070754 >> 172.21.15.59:0/1992070754 conn(0x7f1e580974f0 msgr2=0x7f1e58068a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.447+0000 7f1e5c8b0700 1 -- 172.21.15.59:0/1992070754 shutdown_connections 2023-09-30T22:26:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.447+0000 7f1e5c8b0700 1 -- 172.21.15.59:0/1992070754 wait complete. 2023-09-30T22:26:20.459 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-30T22:26:20.460 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-30T22:26:20.462 INFO:tasks.ceph.osd.0:Started 2023-09-30T22:26:20.462 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-30T22:26:20.462 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-30T22:26:20.464 INFO:tasks.ceph.osd.1:Started 2023-09-30T22:26:20.464 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-30T22:26:20.464 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-30T22:26:20.466 INFO:tasks.ceph.osd.2:Started 2023-09-30T22:26:20.466 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-30T22:26:20.466 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-30T22:26:20.468 INFO:tasks.ceph.osd.3:Started 2023-09-30T22:26:20.468 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:26:20.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.635+0000 7f2eddeeb700 1 Processor -- start 2023-09-30T22:26:20.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.636+0000 7f2eddeeb700 1 -- start start 2023-09-30T22:26:20.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.636+0000 7f2eddeeb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ed8096380 0x7f2ed8094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:20.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.636+0000 7f2eddeeb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed8094c20 0x7f2ed8127d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:20.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.636+0000 7f2eddeeb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed8096760 con 0x7f2ed8091b00 2023-09-30T22:26:20.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.636+0000 7f2eddeeb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed8091ff0 con 0x7f2ed8096380 2023-09-30T22:26:20.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.636+0000 7f2eddeeb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8092c80 con 0x7f2ed8094c20 2023-09-30T22:26:20.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.636+0000 7f2ed77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ed8096380 0x7f2ed8094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:20.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.636+0000 7f2ed7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed8094c20 0x7f2ed8127d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:20.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.636+0000 7f2ed6ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2ed8091b00 0x7f2ed8127600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49712/0 (socket says 172.21.15.59:49712) 2023-09-30T22:26:20.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.636+0000 7f2ed6ffd700 1 -- 172.21.15.59:0/4084091421 learned_addr learned my addr 172.21.15.59:0/4084091421 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:20.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.637+0000 7f2ed7fff700 1 -- 172.21.15.59:0/4084091421 >> v2:172.21.15.59:3300/0 conn(0x7f2ed8096380 msgr2=0x7f2ed8094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:20.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.637+0000 7f2ed7fff700 1 --2- 172.21.15.59:0/4084091421 >> v2:172.21.15.59:3300/0 conn(0x7f2ed8096380 0x7f2ed8094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.637+0000 7f2ed7fff700 1 -- 172.21.15.59:0/4084091421 >> v1:172.21.15.59:6789/0 conn(0x7f2ed8091b00 legacy=0x7f2ed8127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.637+0000 7f2ed7fff700 1 -- 172.21.15.59:0/4084091421 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed8093900 con 0x7f2ed8094c20 2023-09-30T22:26:20.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.637+0000 7f2ed77fe700 1 --2- 172.21.15.59:0/4084091421 >> v2:172.21.15.59:3300/0 conn(0x7f2ed8096380 0x7f2ed8094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:20.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.637+0000 7f2ed7fff700 1 --2- 172.21.15.59:0/4084091421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed8094c20 0x7f2ed8127d10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2ed0009e60 tx=0x7f2ed0009780).ready entity=mon.2 client_cookie=66b730e86efcce50 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.637+0000 7f2ed67fc700 1 -- 172.21.15.59:0/4084091421 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000e070 con 0x7f2ed8094c20 2023-09-30T22:26:20.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.637+0000 7f2ed67fc700 1 -- 172.21.15.59:0/4084091421 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed000bb60 con 0x7f2ed8094c20 2023-09-30T22:26:20.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.637+0000 7f2ed67fc700 1 -- 172.21.15.59:0/4084091421 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0012410 con 0x7f2ed8094c20 2023-09-30T22:26:20.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.638+0000 7f2eddeeb700 1 -- 172.21.15.59:0/4084091421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed8094c20 msgr2=0x7f2ed8127d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.638+0000 7f2eddeeb700 1 --2- 172.21.15.59:0/4084091421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed8094c20 0x7f2ed8127d10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2ed0009e60 tx=0x7f2ed0009780).stop 2023-09-30T22:26:20.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.638+0000 7f2eddeeb700 1 -- 172.21.15.59:0/4084091421 shutdown_connections 2023-09-30T22:26:20.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.638+0000 7f2eddeeb700 1 --2- 172.21.15.59:0/4084091421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed8094c20 0x7f2ed8127d10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.638+0000 7f2eddeeb700 1 --2- 172.21.15.59:0/4084091421 >> v2:172.21.15.59:3300/0 conn(0x7f2ed8096380 0x7f2ed8094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.638+0000 7f2eddeeb700 1 -- 172.21.15.59:0/4084091421 >> 172.21.15.59:0/4084091421 conn(0x7f2ed8097470 msgr2=0x7f2ed8097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.638+0000 7f2eddeeb700 1 -- 172.21.15.59:0/4084091421 shutdown_connections 2023-09-30T22:26:20.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.638+0000 7f2eddeeb700 1 -- 172.21.15.59:0/4084091421 wait complete. 2023-09-30T22:26:20.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.639+0000 7f2eddeeb700 1 Processor -- start 2023-09-30T22:26:20.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.639+0000 7f2eddeeb700 1 -- start start 2023-09-30T22:26:20.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.639+0000 7f2eddeeb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed8091b00 0x7f2ed8112e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:20.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.639+0000 7f2eddeeb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed8094c20 0x7f2ed8113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.639+0000 7f2eddeeb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8096380 0x7f2ed8113870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.639+0000 7f2eddeeb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8113d60 con 0x7f2ed8096380 2023-09-30T22:26:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.639+0000 7f2eddeeb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8127f60 con 0x7f2ed8094c20 2023-09-30T22:26:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.639+0000 7f2eddeeb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed806a520 con 0x7f2ed8091b00 2023-09-30T22:26:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2ed7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8096380 0x7f2ed8113870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2ed6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed8094c20 0x7f2ed8113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2ed7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8096380 0x7f2ed8113870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34712/0 (socket says 172.21.15.59:34712) 2023-09-30T22:26:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2ed7fff700 1 -- 172.21.15.59:0/3805040659 learned_addr learned my addr 172.21.15.59:0/3805040659 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2ed77fe700 1 --2- 172.21.15.59:0/3805040659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed8091b00 0x7f2ed8112e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2ed7fff700 1 -- 172.21.15.59:0/3805040659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed8091b00 msgr2=0x7f2ed8112e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2ed7fff700 1 --2- 172.21.15.59:0/3805040659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed8091b00 0x7f2ed8112e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2ed7fff700 1 -- 172.21.15.59:0/3805040659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed8094c20 msgr2=0x7f2ed8113380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2ed7fff700 1 --2- 172.21.15.59:0/3805040659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed8094c20 0x7f2ed8113380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2ed7fff700 1 -- 172.21.15.59:0/3805040659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec80092a0 con 0x7f2ed8096380 2023-09-30T22:26:20.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2ed6ffd700 1 --2- 172.21.15.59:0/3805040659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed8094c20 0x7f2ed8113380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:20.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2ed7fff700 1 --2- 172.21.15.59:0/3805040659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8096380 0x7f2ed8113870 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f2ed000b6c0 tx=0x7f2ed0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2ebf7fe700 1 -- 172.21.15.59:0/3805040659 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed001d630 con 0x7f2ed8096380 2023-09-30T22:26:20.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2eddeeb700 1 -- 172.21.15.59:0/3805040659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed0009a20 con 0x7f2ed8096380 2023-09-30T22:26:20.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2ebf7fe700 1 -- 172.21.15.59:0/3805040659 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed001d790 con 0x7f2ed8096380 2023-09-30T22:26:20.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2ebf7fe700 1 -- 172.21.15.59:0/3805040659 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed001db50 con 0x7f2ed8096380 2023-09-30T22:26:20.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.640+0000 7f2eddeeb700 1 -- 172.21.15.59:0/3805040659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed8116350 con 0x7f2ed8096380 2023-09-30T22:26:20.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.641+0000 7f2ebf7fe700 1 -- 172.21.15.59:0/3805040659 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f2ed0003040 con 0x7f2ed8096380 2023-09-30T22:26:20.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.641+0000 7f2ebf7fe700 1 -- 172.21.15.59:0/3805040659 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f2ed00088b0 con 0x7f2ed8096380 2023-09-30T22:26:20.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.641+0000 7f2eddeeb700 1 -- 172.21.15.59:0/3805040659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed8098900 con 0x7f2ed8096380 2023-09-30T22:26:20.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.644+0000 7f2ebf7fe700 1 -- 172.21.15.59:0/3805040659 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f2ed0017070 con 0x7f2ed8096380 2023-09-30T22:26:20.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.715+0000 7f2eddeeb700 1 -- 172.21.15.59:0/3805040659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ed8116850 con 0x7f2ed8096380 2023-09-30T22:26:20.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.716+0000 7f2ebf7fe700 1 -- 172.21.15.59:0/3805040659 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7f2ed0026850 con 0x7f2ed8096380 2023-09-30T22:26:20.716 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:20.716 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:26:20.441845+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:26:20.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.717+0000 7f2eddeeb700 1 -- 172.21.15.59:0/3805040659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8096380 msgr2=0x7f2ed8113870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.717+0000 7f2eddeeb700 1 --2- 172.21.15.59:0/3805040659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8096380 0x7f2ed8113870 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f2ed000b6c0 tx=0x7f2ed0009780).stop 2023-09-30T22:26:20.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.717+0000 7f2eddeeb700 1 -- 172.21.15.59:0/3805040659 shutdown_connections 2023-09-30T22:26:20.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.717+0000 7f2eddeeb700 1 --2- 172.21.15.59:0/3805040659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed8091b00 0x7f2ed8112e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.717+0000 7f2eddeeb700 1 --2- 172.21.15.59:0/3805040659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8096380 0x7f2ed8113870 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.717+0000 7f2eddeeb700 1 --2- 172.21.15.59:0/3805040659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed8094c20 0x7f2ed8113380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:20.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.717+0000 7f2eddeeb700 1 -- 172.21.15.59:0/3805040659 >> 172.21.15.59:0/3805040659 conn(0x7f2ed8097470 msgr2=0x7f2ed8059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.717+0000 7f2eddeeb700 1 -- 172.21.15.59:0/3805040659 shutdown_connections 2023-09-30T22:26:20.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:20.717+0000 7f2eddeeb700 1 -- 172.21.15.59:0/3805040659 wait complete. 2023-09-30T22:26:20.730 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-30T22:26:20.730 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-30T22:26:20.948 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:20.948+0000 7ff5d3b59680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T22:26:21.079 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-30T22:26:21.079+0000 7f1485e2a200 -1 Falling back to public interface 2023-09-30T22:26:21.101 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-30T22:26:21.101+0000 7f17b5095200 -1 Falling back to public interface 2023-09-30T22:26:21.110 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-30T22:26:21.110+0000 7f6018b53200 -1 Falling back to public interface 2023-09-30T22:26:21.113 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-30T22:26:21.114+0000 7fde77795200 -1 Falling back to public interface 2023-09-30T22:26:21.133 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T22:26:21.153 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:21.153+0000 7ff5d3b59680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:26:21.229 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:21.229+0000 7ff5d3b59680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T22:26:21.252 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.252+0000 7f173055e700 1 Processor -- start 2023-09-30T22:26:21.253 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.253+0000 7f173055e700 1 -- start start 2023-09-30T22:26:21.255 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.253+0000 7f173055e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17280629b0 0x7f17281253f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:21.255 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.253+0000 7f173055e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17281259a0 0x7f1728125d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:21.255 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.253+0000 7f173055e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17280634d0 con 0x7f1728093bf0 2023-09-30T22:26:21.256 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.253+0000 7f173055e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1728062d90 con 0x7f17280629b0 2023-09-30T22:26:21.256 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.253+0000 7f173055e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f172806aa10 con 0x7f17281259a0 2023-09-30T22:26:21.256 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.253+0000 7f172daf9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17281259a0 0x7f1728125d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:21.256 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.253+0000 7f172eafb700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1728093bf0 0x7f1728094080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49726/0 (socket says 172.21.15.59:49726) 2023-09-30T22:26:21.256 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.253+0000 7f172e2fa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17280629b0 0x7f17281253f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:21.256 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.253+0000 7f172eafb700 1 -- 172.21.15.59:0/3822657461 learned_addr learned my addr 172.21.15.59:0/3822657461 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:21.256 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.254+0000 7f172daf9700 1 -- 172.21.15.59:0/3822657461 >> v2:172.21.15.59:3300/0 conn(0x7f17280629b0 msgr2=0x7f17281253f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:21.256 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.254+0000 7f172daf9700 1 --2- 172.21.15.59:0/3822657461 >> v2:172.21.15.59:3300/0 conn(0x7f17280629b0 0x7f17281253f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:21.257 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.254+0000 7f172daf9700 1 -- 172.21.15.59:0/3822657461 >> v1:172.21.15.59:6789/0 conn(0x7f1728093bf0 legacy=0x7f1728094080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.257 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.254+0000 7f172daf9700 1 -- 172.21.15.59:0/3822657461 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1728097330 con 0x7f17281259a0 2023-09-30T22:26:21.257 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.254+0000 7f172e2fa700 1 --2- 172.21.15.59:0/3822657461 >> v2:172.21.15.59:3300/0 conn(0x7f17280629b0 0x7f17281253f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:21.257 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.254+0000 7f172daf9700 1 --2- 172.21.15.59:0/3822657461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17281259a0 0x7f1728125d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f1718009760 tx=0x7f1718009060).ready entity=mon.2 client_cookie=503ffcadf0cd6d36 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.257 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.254+0000 7f172d2f8700 1 -- 172.21.15.59:0/3822657461 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17180090d0 con 0x7f17281259a0 2023-09-30T22:26:21.257 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.254+0000 7f172d2f8700 1 -- 172.21.15.59:0/3822657461 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171800f510 con 0x7f17281259a0 2023-09-30T22:26:21.257 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.254+0000 7f172d2f8700 1 -- 172.21.15.59:0/3822657461 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171800f890 con 0x7f17281259a0 2023-09-30T22:26:21.257 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.255+0000 7f173055e700 1 -- 172.21.15.59:0/3822657461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17281259a0 msgr2=0x7f1728125d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.257 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.255+0000 7f173055e700 1 --2- 172.21.15.59:0/3822657461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17281259a0 0x7f1728125d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f1718009760 tx=0x7f1718009060).stop 2023-09-30T22:26:21.257 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.255+0000 7f173055e700 1 -- 172.21.15.59:0/3822657461 shutdown_connections 2023-09-30T22:26:21.257 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.255+0000 7f173055e700 1 --2- 172.21.15.59:0/3822657461 >> v2:172.21.15.59:3300/0 conn(0x7f17280629b0 0x7f17281253f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:21.258 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.255+0000 7f173055e700 1 --2- 172.21.15.59:0/3822657461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17281259a0 0x7f1728125d80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:21.258 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.255+0000 7f173055e700 1 -- 172.21.15.59:0/3822657461 >> 172.21.15.59:0/3822657461 conn(0x7f172809ab90 msgr2=0x7f172809afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.258 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.255+0000 7f173055e700 1 -- 172.21.15.59:0/3822657461 shutdown_connections 2023-09-30T22:26:21.258 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.255+0000 7f173055e700 1 -- 172.21.15.59:0/3822657461 wait complete. 2023-09-30T22:26:21.260 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.256+0000 7f173055e700 1 Processor -- start 2023-09-30T22:26:21.260 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.256+0000 7f173055e700 1 -- start start 2023-09-30T22:26:21.260 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.256+0000 7f173055e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17280629b0 0x7f1728122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:21.260 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.256+0000 7f173055e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1728093bf0 0x7f1728091a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:21.260 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.256+0000 7f173055e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17281259a0 0x7f1728091f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:21.260 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.256+0000 7f173055e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1728117130 con 0x7f1728093bf0 2023-09-30T22:26:21.260 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.256+0000 7f173055e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1728123400 con 0x7f17280629b0 2023-09-30T22:26:21.260 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.256+0000 7f173055e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1728095e40 con 0x7f17281259a0 2023-09-30T22:26:21.261 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f172eafb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17281259a0 0x7f1728091f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:21.261 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f172e2fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17280629b0 0x7f1728122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:21.261 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f172daf9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1728093bf0 0x7f1728091a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:21.261 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f172e2fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17280629b0 0x7f1728122c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36592/0 (socket says 172.21.15.59:36592) 2023-09-30T22:26:21.261 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f172eafb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17281259a0 0x7f1728091f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37178/0 (socket says 172.21.15.59:37178) 2023-09-30T22:26:21.261 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f172e2fa700 1 -- 172.21.15.59:0/3957543194 learned_addr learned my addr 172.21.15.59:0/3957543194 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:21.261 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f172daf9700 1 -- 172.21.15.59:0/3957543194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17281259a0 msgr2=0x7f1728091f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.261 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f172daf9700 1 --2- 172.21.15.59:0/3957543194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17281259a0 0x7f1728091f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:21.261 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f172daf9700 1 -- 172.21.15.59:0/3957543194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17280629b0 msgr2=0x7f1728122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.261 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f172daf9700 1 --2- 172.21.15.59:0/3957543194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17280629b0 0x7f1728122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:21.261 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f172daf9700 1 -- 172.21.15.59:0/3957543194 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17240092a0 con 0x7f1728093bf0 2023-09-30T22:26:21.262 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f172daf9700 1 --2- 172.21.15.59:0/3957543194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1728093bf0 0x7f1728091a10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f1718014000 tx=0x7f1718017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.262 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f171e7fc700 1 -- 172.21.15.59:0/3957543194 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171800f890 con 0x7f1728093bf0 2023-09-30T22:26:21.262 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f171e7fc700 1 -- 172.21.15.59:0/3957543194 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718006950 con 0x7f1728093bf0 2023-09-30T22:26:21.262 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f173055e700 1 -- 172.21.15.59:0/3957543194 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17180092a0 con 0x7f1728093bf0 2023-09-30T22:26:21.262 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f171e7fc700 1 -- 172.21.15.59:0/3957543194 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171800fea0 con 0x7f1728093bf0 2023-09-30T22:26:21.262 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.257+0000 7f173055e700 1 -- 172.21.15.59:0/3957543194 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1728117d00 con 0x7f1728093bf0 2023-09-30T22:26:21.262 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.258+0000 7f171e7fc700 1 -- 172.21.15.59:0/3957543194 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f1718005ae0 con 0x7f1728093bf0 2023-09-30T22:26:21.262 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.258+0000 7f171e7fc700 1 -- 172.21.15.59:0/3957543194 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f171801c630 con 0x7f1728093bf0 2023-09-30T22:26:21.262 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.258+0000 7f173055e700 1 -- 172.21.15.59:0/3957543194 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1728096590 con 0x7f1728093bf0 2023-09-30T22:26:21.263 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.261+0000 7f171e7fc700 1 -- 172.21.15.59:0/3957543194 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f1718020020 con 0x7f1728093bf0 2023-09-30T22:26:21.319 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:21.319+0000 7ff5d3b59680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T22:26:21.331 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.331+0000 7f173055e700 1 -- 172.21.15.59:0/3957543194 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f172805a260 con 0x7f1728093bf0 2023-09-30T22:26:21.331 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.332+0000 7f171e7fc700 1 -- 172.21.15.59:0/3957543194 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7f17180062f0 con 0x7f1728093bf0 2023-09-30T22:26:21.332 INFO:teuthology.misc.health.smithi059.stdout: 2023-09-30T22:26:21.332 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":6,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:26:20.441845+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:26:21.333 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.332+0000 7f173055e700 1 -- 172.21.15.59:0/3957543194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1728093bf0 msgr2=0x7f1728091a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.333 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.332+0000 7f173055e700 1 --2- 172.21.15.59:0/3957543194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1728093bf0 0x7f1728091a10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f1718014000 tx=0x7f1718017000).stop 2023-09-30T22:26:21.333 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.333+0000 7f173055e700 1 -- 172.21.15.59:0/3957543194 shutdown_connections 2023-09-30T22:26:21.333 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.333+0000 7f173055e700 1 --2- 172.21.15.59:0/3957543194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17281259a0 0x7f1728091f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:21.333 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.333+0000 7f173055e700 1 --2- 172.21.15.59:0/3957543194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17280629b0 0x7f1728122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:21.333 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.333+0000 7f173055e700 1 --2- 172.21.15.59:0/3957543194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1728093bf0 0x7f1728091a10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:21.333 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.333+0000 7f173055e700 1 -- 172.21.15.59:0/3957543194 >> 172.21.15.59:0/3957543194 conn(0x7f172809ab90 msgr2=0x7f1728129000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.333 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.333+0000 7f173055e700 1 -- 172.21.15.59:0/3957543194 shutdown_connections 2023-09-30T22:26:21.333 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:21.333+0000 7f173055e700 1 -- 172.21.15.59:0/3957543194 wait complete. 2023-09-30T22:26:21.344 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-09-30T22:26:21.400 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:21.401+0000 7ff5d3b59680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T22:26:21.798 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:21.798+0000 7ff5d3b59680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T22:26:21.895 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:21.895+0000 7ff5d3b59680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T22:26:22.618 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:22.618+0000 7ff5d3b59680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-30T22:26:22.696 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:22.696+0000 7ff5d3b59680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T22:26:22.784 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:22.784+0000 7ff5d3b59680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T22:26:23.117 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:23.117+0000 7ff5d3b59680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T22:26:23.197 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:23.197+0000 7ff5d3b59680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T22:26:23.329 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:23.329+0000 7ff5d3b59680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T22:26:23.450 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:23.450+0000 7ff5d3b59680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:26:23.622 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:23.622+0000 7ff5d3b59680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T22:26:23.701 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:23.701+0000 7ff5d3b59680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T22:26:24.603 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-30T22:26:24.603+0000 7f6018b53200 -1 osd.3 0 log_to_monitors {default=true} 2023-09-30T22:26:24.725 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:24.725+0000 7ff58a596700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-30T22:26:24.725 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:26:24.725+0000 7ff58a596700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-30T22:26:24.821 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-30T22:26:24.821+0000 7f1485e2a200 -1 osd.1 0 log_to_monitors {default=true} 2023-09-30T22:26:24.859 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-30T22:26:24.860+0000 7f17b5095200 -1 osd.0 0 log_to_monitors {default=true} 2023-09-30T22:26:24.873 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-30T22:26:24.873+0000 7fde77795200 -1 osd.2 0 log_to_monitors {default=true} 2023-09-30T22:26:25.840 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-30T22:26:25.840+0000 7f600f4f4700 -1 osd.3 0 waiting for initial osdmap 2023-09-30T22:26:25.843 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-30T22:26:25.843+0000 7f147c7cb700 -1 osd.1 0 waiting for initial osdmap 2023-09-30T22:26:25.845 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-30T22:26:25.846+0000 7f600bc70700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:26:25.846 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-30T22:26:25.847+0000 7f1478f47700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:26:26.843 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-30T22:26:26.843+0000 7f17aba36700 -1 osd.0 0 waiting for initial osdmap 2023-09-30T22:26:26.844 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-30T22:26:26.843+0000 7fde6e136700 -1 osd.2 0 waiting for initial osdmap 2023-09-30T22:26:26.848 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-30T22:26:26.848+0000 7fde6a8b2700 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:26:26.848 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-30T22:26:26.848+0000 7f17a81b2700 -1 osd.0 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:26:27.748 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T22:26:27.881 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.881+0000 7fabafe40700 1 Processor -- start 2023-09-30T22:26:27.881 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.881+0000 7fabafe40700 1 -- start start 2023-09-30T22:26:27.884 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.881+0000 7fabafe40700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faba8094a60 0x7faba80958e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:27.884 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.881+0000 7fabafe40700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faba8095dd0 0x7faba80961d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:27.884 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.882+0000 7fabafe40700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba8096d40 con 0x7faba812c1c0 2023-09-30T22:26:27.884 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.882+0000 7fabafe40700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba8094e40 con 0x7faba8095dd0 2023-09-30T22:26:27.884 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.882+0000 7fabafe40700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faba8091b90 con 0x7faba8094a60 2023-09-30T22:26:27.884 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.882+0000 7fabae3dd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faba812c1c0 0x7faba812e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54818/0 (socket says 172.21.15.59:54818) 2023-09-30T22:26:27.884 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.882+0000 7fabadbdc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faba8094a60 0x7faba80958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:27.884 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.882+0000 7fabae3dd700 1 -- 172.21.15.59:0/881831043 learned_addr learned my addr 172.21.15.59:0/881831043 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:27.885 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.882+0000 7fabad3db700 1 --2- 172.21.15.59:0/881831043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faba8095dd0 0x7faba80961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:27.885 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.882+0000 7fabacbda700 1 -- 172.21.15.59:0/881831043 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973608921 0 0) 0x7faba8096d40 con 0x7faba812c1c0 2023-09-30T22:26:27.885 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.882+0000 7fabacbda700 1 -- 172.21.15.59:0/881831043 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab940033f0 con 0x7faba812c1c0 2023-09-30T22:26:27.885 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.882+0000 7fabadbdc700 1 -- 172.21.15.59:0/881831043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faba8095dd0 msgr2=0x7faba80961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:27.885 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.882+0000 7fabadbdc700 1 --2- 172.21.15.59:0/881831043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faba8095dd0 0x7faba80961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:27.885 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.882+0000 7fabadbdc700 1 -- 172.21.15.59:0/881831043 >> v1:172.21.15.59:6789/0 conn(0x7faba812c1c0 legacy=0x7faba812e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.885 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.882+0000 7fabadbdc700 1 -- 172.21.15.59:0/881831043 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba80934f0 con 0x7faba8094a60 2023-09-30T22:26:27.885 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.882+0000 7fabad3db700 1 --2- 172.21.15.59:0/881831043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faba8095dd0 0x7faba80961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:27.885 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.882+0000 7fabadbdc700 1 --2- 172.21.15.59:0/881831043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faba8094a60 0x7faba80958e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7faba4009790 tx=0x7faba4009060).ready entity=mon.2 client_cookie=a6da64e27cc3c950 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:27.885 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.883+0000 7fabacbda700 1 -- 172.21.15.59:0/881831043 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba400f510 con 0x7faba8094a60 2023-09-30T22:26:27.885 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.883+0000 7fabacbda700 1 -- 172.21.15.59:0/881831043 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba400f670 con 0x7faba8094a60 2023-09-30T22:26:27.886 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.883+0000 7fabacbda700 1 -- 172.21.15.59:0/881831043 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba400f9f0 con 0x7faba8094a60 2023-09-30T22:26:27.886 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.883+0000 7fabafe40700 1 -- 172.21.15.59:0/881831043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faba8094a60 msgr2=0x7faba80958e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.886 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.883+0000 7fabafe40700 1 --2- 172.21.15.59:0/881831043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faba8094a60 0x7faba80958e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7faba4009790 tx=0x7faba4009060).stop 2023-09-30T22:26:27.886 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.883+0000 7fabafe40700 1 -- 172.21.15.59:0/881831043 shutdown_connections 2023-09-30T22:26:27.886 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.883+0000 7fabafe40700 1 --2- 172.21.15.59:0/881831043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faba8094a60 0x7faba80958e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:27.886 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.883+0000 7fabafe40700 1 --2- 172.21.15.59:0/881831043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faba8095dd0 0x7faba80961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:27.886 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.883+0000 7fabafe40700 1 -- 172.21.15.59:0/881831043 >> 172.21.15.59:0/881831043 conn(0x7faba809ab90 msgr2=0x7faba809afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:27.886 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.883+0000 7fabafe40700 1 -- 172.21.15.59:0/881831043 shutdown_connections 2023-09-30T22:26:27.886 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.883+0000 7fabafe40700 1 -- 172.21.15.59:0/881831043 wait complete. 2023-09-30T22:26:27.888 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.884+0000 7fabafe40700 1 Processor -- start 2023-09-30T22:26:27.888 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.884+0000 7fabafe40700 1 -- start start 2023-09-30T22:26:27.888 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabafe40700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faba8094a60 0x7faba812a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:27.889 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabafe40700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faba8095dd0 0x7faba812b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:27.889 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabafe40700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faba812c1c0 0x7faba812b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:27.889 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabafe40700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba8129e90 con 0x7faba812c1c0 2023-09-30T22:26:27.889 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabafe40700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba81289e0 con 0x7faba8095dd0 2023-09-30T22:26:27.889 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabafe40700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faba8127c70 con 0x7faba8094a60 2023-09-30T22:26:27.889 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabadbdc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faba8094a60 0x7faba812a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:27.889 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabae3dd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faba812c1c0 0x7faba812b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:27.889 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabadbdc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faba8094a60 0x7faba812a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60170/0 (socket says 172.21.15.59:60170) 2023-09-30T22:26:27.889 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabadbdc700 1 -- 172.21.15.59:0/1742777433 learned_addr learned my addr 172.21.15.59:0/1742777433 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:27.889 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabad3db700 1 --2- 172.21.15.59:0/1742777433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faba8095dd0 0x7faba812b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:27.889 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabadbdc700 1 -- 172.21.15.59:0/1742777433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faba8095dd0 msgr2=0x7faba812b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.890 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabadbdc700 1 --2- 172.21.15.59:0/1742777433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faba8095dd0 0x7faba812b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:27.890 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabadbdc700 1 -- 172.21.15.59:0/1742777433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faba812c1c0 msgr2=0x7faba812b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.890 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabadbdc700 1 --2- 172.21.15.59:0/1742777433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faba812c1c0 0x7faba812b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:27.890 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabadbdc700 1 -- 172.21.15.59:0/1742777433 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab980092a0 con 0x7faba8094a60 2023-09-30T22:26:27.890 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.885+0000 7fabadbdc700 1 --2- 172.21.15.59:0/1742777433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faba8094a60 0x7faba812a670 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7faba4009d80 tx=0x7faba4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:27.890 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.886+0000 7fab9dffb700 1 -- 172.21.15.59:0/1742777433 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba400f7e0 con 0x7faba8094a60 2023-09-30T22:26:27.890 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.886+0000 7fab9dffb700 1 -- 172.21.15.59:0/1742777433 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba400f940 con 0x7faba8094a60 2023-09-30T22:26:27.890 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.886+0000 7fabafe40700 1 -- 172.21.15.59:0/1742777433 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba40092a0 con 0x7faba8094a60 2023-09-30T22:26:27.890 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.886+0000 7fab9dffb700 1 -- 172.21.15.59:0/1742777433 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba401b660 con 0x7faba8094a60 2023-09-30T22:26:27.890 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.886+0000 7fabafe40700 1 -- 172.21.15.59:0/1742777433 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba80924d0 con 0x7faba8094a60 2023-09-30T22:26:27.890 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.887+0000 7fab9dffb700 1 -- 172.21.15.59:0/1742777433 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7faba401ba50 con 0x7faba8094a60 2023-09-30T22:26:27.891 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.887+0000 7fab9dffb700 1 -- 172.21.15.59:0/1742777433 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2461+0+0 (secure 0 0 0) 0x7faba403c2b0 con 0x7faba8094a60 2023-09-30T22:26:27.891 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.887+0000 7fabafe40700 1 -- 172.21.15.59:0/1742777433 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba8129cf0 con 0x7faba8094a60 2023-09-30T22:26:27.892 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:27.892+0000 7fab9dffb700 1 -- 172.21.15.59:0/1742777433 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7faba8129cf0 con 0x7faba8094a60 2023-09-30T22:26:28.069 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:28.070+0000 7fabafe40700 1 -- 172.21.15.59:0/1742777433 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faba8129cf0 con 0x7faba8094a60 2023-09-30T22:26:28.070 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:28.070+0000 7fab9dffb700 1 -- 172.21.15.59:0/1742777433 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6553 (secure 0 0 0) 0x7faba8129cf0 con 0x7faba8094a60 2023-09-30T22:26:28.070 INFO:teuthology.misc.health.smithi059.stdout: 2023-09-30T22:26:28.070 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":10,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:26:27.842299+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:26:26.893716+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:26:28.073 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:28.072+0000 7fabafe40700 1 -- 172.21.15.59:0/1742777433 >> v1:172.21.15.59:6816/118188 conn(0x7fab8c02bb60 legacy=0x7fab8c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.073 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:28.072+0000 7fabafe40700 1 -- 172.21.15.59:0/1742777433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faba8094a60 msgr2=0x7faba812a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.073 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:28.072+0000 7fabafe40700 1 --2- 172.21.15.59:0/1742777433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faba8094a60 0x7faba812a670 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7faba4009d80 tx=0x7faba4017000).stop 2023-09-30T22:26:28.073 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:28.072+0000 7fabafe40700 1 -- 172.21.15.59:0/1742777433 shutdown_connections 2023-09-30T22:26:28.073 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:28.072+0000 7fabafe40700 1 --2- 172.21.15.59:0/1742777433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faba8094a60 0x7faba812a670 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:28.073 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:28.072+0000 7fabafe40700 1 --2- 172.21.15.59:0/1742777433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faba812c1c0 0x7faba812b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:28.073 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:28.072+0000 7fabafe40700 1 --2- 172.21.15.59:0/1742777433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faba8095dd0 0x7faba812b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:28.073 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:28.072+0000 7fabafe40700 1 -- 172.21.15.59:0/1742777433 >> 172.21.15.59:0/1742777433 conn(0x7faba809ab90 msgr2=0x7faba8098800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.073 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:28.073+0000 7fabafe40700 1 -- 172.21.15.59:0/1742777433 shutdown_connections 2023-09-30T22:26:28.073 INFO:teuthology.misc.health.smithi059.stderr:2023-09-30T22:26:28.073+0000 7fabafe40700 1 -- 172.21.15.59:0/1742777433 wait complete. 2023-09-30T22:26:28.084 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-09-30T22:26:28.085 INFO:tasks.ceph:Creating RBD pool 2023-09-30T22:26:28.085 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd pool create rbd 8 2023-09-30T22:26:28.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.213+0000 7fd4f01ba700 1 Processor -- start 2023-09-30T22:26:28.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.214+0000 7fd4f01ba700 1 -- start start 2023-09-30T22:26:28.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.214+0000 7fd4f01ba700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4e80926d0 0x7fd4e81275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:28.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.214+0000 7fd4f01ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4e8127be0 0x7fd4e8128000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:28.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.214+0000 7fd4f01ba700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e8091c80 con 0x7fd4e812a9a0 2023-09-30T22:26:28.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.214+0000 7fd4f01ba700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e8099dd0 con 0x7fd4e80926d0 2023-09-30T22:26:28.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.214+0000 7fd4f01ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80999d0 con 0x7fd4e8127be0 2023-09-30T22:26:28.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.214+0000 7fd4edf56700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4e80926d0 0x7fd4e81275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:28.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.214+0000 7fd4ed755700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4e8127be0 0x7fd4e8128000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:28.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.214+0000 7fd4ed755700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4e8127be0 0x7fd4e8128000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46120/0 (socket says 172.21.15.59:46120) 2023-09-30T22:26:28.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.214+0000 7fd4edf56700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4e80926d0 0x7fd4e81275c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36132/0 (socket says 172.21.15.59:36132) 2023-09-30T22:26:28.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.214+0000 7fd4ed755700 1 -- 172.21.15.59:0/1150528257 learned_addr learned my addr 172.21.15.59:0/1150528257 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:28.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.214+0000 7fd4ee757700 1 --1- 172.21.15.59:0/1150528257 >> v1:172.21.15.59:6789/0 conn(0x7fd4e812a9a0 0x7fd4e812ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54832/0 (socket says 172.21.15.59:54832) 2023-09-30T22:26:28.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.215+0000 7fd4ed755700 1 -- 172.21.15.59:0/1150528257 >> v2:172.21.15.59:3300/0 conn(0x7fd4e80926d0 msgr2=0x7fd4e81275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:28.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.215+0000 7fd4ed755700 1 --2- 172.21.15.59:0/1150528257 >> v2:172.21.15.59:3300/0 conn(0x7fd4e80926d0 0x7fd4e81275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:28.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.215+0000 7fd4ed755700 1 -- 172.21.15.59:0/1150528257 >> v1:172.21.15.59:6789/0 conn(0x7fd4e812a9a0 legacy=0x7fd4e812ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.215+0000 7fd4ed755700 1 -- 172.21.15.59:0/1150528257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e809a280 con 0x7fd4e8127be0 2023-09-30T22:26:28.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.215+0000 7fd4ecf54700 1 -- 172.21.15.59:0/1150528257 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106007743 0 0) 0x7fd4e8091c80 con 0x7fd4e812a9a0 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.215+0000 7fd4edf56700 1 --2- 172.21.15.59:0/1150528257 >> v2:172.21.15.59:3300/0 conn(0x7fd4e80926d0 0x7fd4e81275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.215+0000 7fd4ed755700 1 --2- 172.21.15.59:0/1150528257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4e8127be0 0x7fd4e8128000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd4e4009830 tx=0x7fd4e40090f0).ready entity=mon.1 client_cookie=720684b74bce00c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.215+0000 7fd4ecf54700 1 -- 172.21.15.59:0/1150528257 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e400b580 con 0x7fd4e8127be0 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.215+0000 7fd4ecf54700 1 -- 172.21.15.59:0/1150528257 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e400b6e0 con 0x7fd4e8127be0 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.215+0000 7fd4ecf54700 1 -- 172.21.15.59:0/1150528257 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e400ba60 con 0x7fd4e8127be0 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.216+0000 7fd4f01ba700 1 -- 172.21.15.59:0/1150528257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4e8127be0 msgr2=0x7fd4e8128000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.216+0000 7fd4f01ba700 1 --2- 172.21.15.59:0/1150528257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4e8127be0 0x7fd4e8128000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd4e4009830 tx=0x7fd4e40090f0).stop 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.216+0000 7fd4f01ba700 1 -- 172.21.15.59:0/1150528257 shutdown_connections 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.216+0000 7fd4f01ba700 1 --2- 172.21.15.59:0/1150528257 >> v2:172.21.15.59:3300/0 conn(0x7fd4e80926d0 0x7fd4e81275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.216+0000 7fd4f01ba700 1 --2- 172.21.15.59:0/1150528257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4e8127be0 0x7fd4e8128000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.216+0000 7fd4f01ba700 1 -- 172.21.15.59:0/1150528257 >> 172.21.15.59:0/1150528257 conn(0x7fd4e8097480 msgr2=0x7fd4e8097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.216+0000 7fd4f01ba700 1 -- 172.21.15.59:0/1150528257 shutdown_connections 2023-09-30T22:26:28.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.216+0000 7fd4f01ba700 1 -- 172.21.15.59:0/1150528257 wait complete. 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.217+0000 7fd4f01ba700 1 Processor -- start 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.217+0000 7fd4f01ba700 1 -- start start 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.217+0000 7fd4f01ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4e80926d0 0x7fd4e8117aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.217+0000 7fd4f01ba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e8127be0 0x7fd4e8113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.217+0000 7fd4f01ba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4e812a9a0 0x7fd4e8113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.217+0000 7fd4f01ba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e8124bd0 con 0x7fd4e8127be0 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.217+0000 7fd4f01ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e809a4b0 con 0x7fd4e80926d0 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.217+0000 7fd4f01ba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e8125060 con 0x7fd4e812a9a0 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.217+0000 7fd4edf56700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4e80926d0 0x7fd4e8117aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.217+0000 7fd4ed755700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e8127be0 0x7fd4e8113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.217+0000 7fd4edf56700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4e80926d0 0x7fd4e8117aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46128/0 (socket says 172.21.15.59:46128) 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.217+0000 7fd4edf56700 1 -- 172.21.15.59:0/3846879935 learned_addr learned my addr 172.21.15.59:0/3846879935 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.217+0000 7fd4ee757700 1 --2- 172.21.15.59:0/3846879935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4e812a9a0 0x7fd4e8113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.218+0000 7fd4edf56700 1 -- 172.21.15.59:0/3846879935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4e812a9a0 msgr2=0x7fd4e8113ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.218+0000 7fd4edf56700 1 --2- 172.21.15.59:0/3846879935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4e812a9a0 0x7fd4e8113ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.218+0000 7fd4edf56700 1 -- 172.21.15.59:0/3846879935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e8127be0 msgr2=0x7fd4e8113b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.218+0000 7fd4edf56700 1 --2- 172.21.15.59:0/3846879935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e8127be0 0x7fd4e8113b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.218+0000 7fd4edf56700 1 -- 172.21.15.59:0/3846879935 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4dc0092a0 con 0x7fd4e80926d0 2023-09-30T22:26:28.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.218+0000 7fd4ed755700 1 --2- 172.21.15.59:0/3846879935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e8127be0 0x7fd4e8113b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:28.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.218+0000 7fd4edf56700 1 --2- 172.21.15.59:0/3846879935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4e80926d0 0x7fd4e8117aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fd4dc00ea20 tx=0x7fd4dc009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.218+0000 7fd4d9ffb700 1 -- 172.21.15.59:0/3846879935 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc00ee60 con 0x7fd4e80926d0 2023-09-30T22:26:28.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.218+0000 7fd4d9ffb700 1 -- 172.21.15.59:0/3846879935 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc00c850 con 0x7fd4e80926d0 2023-09-30T22:26:28.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.218+0000 7fd4f01ba700 1 -- 172.21.15.59:0/3846879935 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e4009370 con 0x7fd4e80926d0 2023-09-30T22:26:28.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.218+0000 7fd4d9ffb700 1 -- 172.21.15.59:0/3846879935 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc00cbd0 con 0x7fd4e80926d0 2023-09-30T22:26:28.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.218+0000 7fd4f01ba700 1 -- 172.21.15.59:0/3846879935 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e8117000 con 0x7fd4e80926d0 2023-09-30T22:26:28.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.219+0000 7fd4d9ffb700 1 -- 172.21.15.59:0/3846879935 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd4dc01b400 con 0x7fd4e80926d0 2023-09-30T22:26:28.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.219+0000 7fd4d9ffb700 1 -- 172.21.15.59:0/3846879935 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2461+0+0 (secure 0 0 0) 0x7fd4dc03b170 con 0x7fd4e80926d0 2023-09-30T22:26:28.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.220+0000 7fd4f01ba700 1 -- 172.21.15.59:0/3846879935 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e805a260 con 0x7fd4e80926d0 2023-09-30T22:26:28.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.224+0000 7fd4d9ffb700 1 -- 172.21.15.59:0/3846879935 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd4dc019900 con 0x7fd4e80926d0 2023-09-30T22:26:28.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.401+0000 7fd4f01ba700 1 -- 172.21.15.59:0/3846879935 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fd4e8046c20 con 0x7fd4e80926d0 2023-09-30T22:26:28.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.859+0000 7fd4d9ffb700 1 -- 172.21.15.59:0/3846879935 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v11) v1 ==== 109+0+0 (secure 0 0 0) 0x7fd4dc02a0a0 con 0x7fd4e80926d0 2023-09-30T22:26:28.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.863+0000 7fd4f01ba700 1 -- 172.21.15.59:0/3846879935 >> v1:172.21.15.59:6816/118188 conn(0x7fd4cc02bb60 legacy=0x7fd4cc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.863+0000 7fd4f01ba700 1 -- 172.21.15.59:0/3846879935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4e80926d0 msgr2=0x7fd4e8117aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.863+0000 7fd4f01ba700 1 --2- 172.21.15.59:0/3846879935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4e80926d0 0x7fd4e8117aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fd4dc00ea20 tx=0x7fd4dc009060).stop 2023-09-30T22:26:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.864+0000 7fd4f01ba700 1 -- 172.21.15.59:0/3846879935 shutdown_connections 2023-09-30T22:26:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.864+0000 7fd4f01ba700 1 --2- 172.21.15.59:0/3846879935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4e812a9a0 0x7fd4e8113ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.864+0000 7fd4f01ba700 1 --2- 172.21.15.59:0/3846879935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4e80926d0 0x7fd4e8117aa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.864+0000 7fd4f01ba700 1 --2- 172.21.15.59:0/3846879935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e8127be0 0x7fd4e8113b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.864+0000 7fd4f01ba700 1 -- 172.21.15.59:0/3846879935 >> 172.21.15.59:0/3846879935 conn(0x7fd4e8097480 msgr2=0x7fd4e8095d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.864+0000 7fd4f01ba700 1 -- 172.21.15.59:0/3846879935 shutdown_connections 2023-09-30T22:26:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:28.864+0000 7fd4f01ba700 1 -- 172.21.15.59:0/3846879935 wait complete. 2023-09-30T22:26:28.865 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'rbd' created 2023-09-30T22:26:28.880 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-09-30T22:26:29.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.017+0000 7ff8d1d44700 1 Processor -- start 2023-09-30T22:26:29.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.017+0000 7ff8d1d44700 1 -- start start 2023-09-30T22:26:29.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.017+0000 7ff8d1d44700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc093840 0x7ff8cc0952a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:29.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.017+0000 7ff8d1d44700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8cc095790 0x7ff8cc095b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:29.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.017+0000 7ff8d1d44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc12c150 0x7ff8cc12e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:29.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.017+0000 7ff8d1d44700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8cc091eb0 con 0x7ff8cc095790 2023-09-30T22:26:29.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.017+0000 7ff8d1d44700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc092ad0 con 0x7ff8cc12c150 2023-09-30T22:26:29.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.017+0000 7ff8d1d44700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc092d80 con 0x7ff8cc093840 2023-09-30T22:26:29.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.018+0000 7ff8cb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc093840 0x7ff8cc0952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:29.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.018+0000 7ff8cb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc093840 0x7ff8cc0952a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60192/0 (socket says 172.21.15.59:60192) 2023-09-30T22:26:29.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.018+0000 7ff8cb7fe700 1 -- 172.21.15.59:0/865516616 learned_addr learned my addr 172.21.15.59:0/865516616 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:29.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.018+0000 7ff8cbfff700 1 --2- 172.21.15.59:0/865516616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc12c150 0x7ff8cc12e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:29.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.018+0000 7ff8caffd700 1 --2- 172.21.15.59:0/865516616 >> v2:172.21.15.59:3300/0 conn(0x7ff8cc095790 0x7ff8cc095b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.018+0000 7ff8cb7fe700 1 -- 172.21.15.59:0/865516616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc12c150 msgr2=0x7ff8cc12e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.018+0000 7ff8cb7fe700 1 --2- 172.21.15.59:0/865516616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc12c150 0x7ff8cc12e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.018+0000 7ff8cb7fe700 1 -- 172.21.15.59:0/865516616 >> v2:172.21.15.59:3300/0 conn(0x7ff8cc095790 msgr2=0x7ff8cc095b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.018+0000 7ff8cb7fe700 1 --2- 172.21.15.59:0/865516616 >> v2:172.21.15.59:3300/0 conn(0x7ff8cc095790 0x7ff8cc095b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.018+0000 7ff8cb7fe700 1 -- 172.21.15.59:0/865516616 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc094b10 con 0x7ff8cc093840 2023-09-30T22:26:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.018+0000 7ff8cbfff700 1 --2- 172.21.15.59:0/865516616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc12c150 0x7ff8cc12e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.018+0000 7ff8cb7fe700 1 --2- 172.21.15.59:0/865516616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc093840 0x7ff8cc0952a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff8bc006fd0 tx=0x7ff8bc0090f0).ready entity=mon.2 client_cookie=9dca977fc818b866 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.018+0000 7ff8ca7fc700 1 -- 172.21.15.59:0/865516616 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00f510 con 0x7ff8cc093840 2023-09-30T22:26:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.018+0000 7ff8ca7fc700 1 -- 172.21.15.59:0/865516616 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc00f670 con 0x7ff8cc093840 2023-09-30T22:26:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.018+0000 7ff8ca7fc700 1 -- 172.21.15.59:0/865516616 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00fa10 con 0x7ff8cc093840 2023-09-30T22:26:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.019+0000 7ff8d1d44700 1 -- 172.21.15.59:0/865516616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc093840 msgr2=0x7ff8cc0952a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.019+0000 7ff8d1d44700 1 --2- 172.21.15.59:0/865516616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc093840 0x7ff8cc0952a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff8bc006fd0 tx=0x7ff8bc0090f0).stop 2023-09-30T22:26:29.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.019+0000 7ff8d1d44700 1 -- 172.21.15.59:0/865516616 shutdown_connections 2023-09-30T22:26:29.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.019+0000 7ff8d1d44700 1 --2- 172.21.15.59:0/865516616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc12c150 0x7ff8cc12e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:29.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.019+0000 7ff8d1d44700 1 --2- 172.21.15.59:0/865516616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc093840 0x7ff8cc0952a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:29.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.019+0000 7ff8d1d44700 1 --2- 172.21.15.59:0/865516616 >> v2:172.21.15.59:3300/0 conn(0x7ff8cc095790 0x7ff8cc095b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:29.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.019+0000 7ff8d1d44700 1 -- 172.21.15.59:0/865516616 >> 172.21.15.59:0/865516616 conn(0x7ff8cc097560 msgr2=0x7ff8cc097970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:29.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.019+0000 7ff8d1d44700 1 -- 172.21.15.59:0/865516616 shutdown_connections 2023-09-30T22:26:29.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.019+0000 7ff8d1d44700 1 -- 172.21.15.59:0/865516616 wait complete. 2023-09-30T22:26:29.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.020+0000 7ff8d1d44700 1 Processor -- start 2023-09-30T22:26:29.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.020+0000 7ff8d1d44700 1 -- start start 2023-09-30T22:26:29.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.020+0000 7ff8d1d44700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc093840 0x7ff8cc12af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:29.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.020+0000 7ff8d1d44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc095790 0x7ff8cc12b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:29.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.020+0000 7ff8d1d44700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc12c150 0x7ff8cc116ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:29.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8d1d44700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc117fe0 con 0x7ff8cc093840 2023-09-30T22:26:29.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8d1d44700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc11e6c0 con 0x7ff8cc095790 2023-09-30T22:26:29.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8d1d44700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc064ef0 con 0x7ff8cc12c150 2023-09-30T22:26:29.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8cb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc093840 0x7ff8cc12af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:29.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8caffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc095790 0x7ff8cc12b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:29.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8cb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc093840 0x7ff8cc12af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36160/0 (socket says 172.21.15.59:36160) 2023-09-30T22:26:29.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8cbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc12c150 0x7ff8cc116ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:29.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8caffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc095790 0x7ff8cc12b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46144/0 (socket says 172.21.15.59:46144) 2023-09-30T22:26:29.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8cb7fe700 1 -- 172.21.15.59:0/2022460650 learned_addr learned my addr 172.21.15.59:0/2022460650 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:29.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8caffd700 1 -- 172.21.15.59:0/2022460650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc12c150 msgr2=0x7ff8cc116ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8caffd700 1 --2- 172.21.15.59:0/2022460650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc12c150 0x7ff8cc116ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:29.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8caffd700 1 -- 172.21.15.59:0/2022460650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc093840 msgr2=0x7ff8cc12af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8caffd700 1 --2- 172.21.15.59:0/2022460650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc093840 0x7ff8cc12af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:29.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8caffd700 1 -- 172.21.15.59:0/2022460650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4009a20 con 0x7ff8cc095790 2023-09-30T22:26:29.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8caffd700 1 --2- 172.21.15.59:0/2022460650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc095790 0x7ff8cc12b3f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff8b400e900 tx=0x7ff8b4009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:29.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8c37fe700 1 -- 172.21.15.59:0/2022460650 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4009450 con 0x7ff8cc095790 2023-09-30T22:26:29.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8c37fe700 1 -- 172.21.15.59:0/2022460650 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b4012600 con 0x7ff8cc095790 2023-09-30T22:26:29.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8d1d44700 1 -- 172.21.15.59:0/2022460650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8bc009370 con 0x7ff8cc095790 2023-09-30T22:26:29.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8c37fe700 1 -- 172.21.15.59:0/2022460650 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4012980 con 0x7ff8cc095790 2023-09-30T22:26:29.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.021+0000 7ff8d1d44700 1 -- 172.21.15.59:0/2022460650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc11e9f0 con 0x7ff8cc095790 2023-09-30T22:26:29.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.022+0000 7ff8c37fe700 1 -- 172.21.15.59:0/2022460650 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff8b401b400 con 0x7ff8cc095790 2023-09-30T22:26:29.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.022+0000 7ff8c37fe700 1 -- 172.21.15.59:0/2022460650 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2827+0+0 (secure 0 0 0) 0x7ff8b403b0f0 con 0x7ff8cc095790 2023-09-30T22:26:29.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.022+0000 7ff8d1d44700 1 -- 172.21.15.59:0/2022460650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc05a260 con 0x7ff8cc095790 2023-09-30T22:26:29.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.027+0000 7ff8c37fe700 1 -- 172.21.15.59:0/2022460650 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff8b4011b40 con 0x7ff8cc095790 2023-09-30T22:26:29.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.203+0000 7ff8d1d44700 1 -- 172.21.15.59:0/2022460650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff8cc0966a0 con 0x7ff8cc095790 2023-09-30T22:26:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.854+0000 7ff8c37fe700 1 -- 172.21.15.59:0/2022460650 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v12) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff8b4023350 con 0x7ff8cc095790 2023-09-30T22:26:29.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.857+0000 7ff8d1d44700 1 -- 172.21.15.59:0/2022460650 >> v1:172.21.15.59:6816/118188 conn(0x7ff8ac02bb60 legacy=0x7ff8ac02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.857+0000 7ff8d1d44700 1 -- 172.21.15.59:0/2022460650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc095790 msgr2=0x7ff8cc12b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.857+0000 7ff8d1d44700 1 --2- 172.21.15.59:0/2022460650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc095790 0x7ff8cc12b3f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff8b400e900 tx=0x7ff8b4009060).stop 2023-09-30T22:26:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.857+0000 7ff8d1d44700 1 -- 172.21.15.59:0/2022460650 shutdown_connections 2023-09-30T22:26:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.857+0000 7ff8d1d44700 1 --2- 172.21.15.59:0/2022460650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc12c150 0x7ff8cc116ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.857+0000 7ff8d1d44700 1 --2- 172.21.15.59:0/2022460650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc093840 0x7ff8cc12af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.857+0000 7ff8d1d44700 1 --2- 172.21.15.59:0/2022460650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc095790 0x7ff8cc12b3f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.857+0000 7ff8d1d44700 1 -- 172.21.15.59:0/2022460650 >> 172.21.15.59:0/2022460650 conn(0x7ff8cc097560 msgr2=0x7ff8cc110fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.857+0000 7ff8d1d44700 1 -- 172.21.15.59:0/2022460650 shutdown_connections 2023-09-30T22:26:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:29.858+0000 7ff8d1d44700 1 -- 172.21.15.59:0/2022460650 wait complete. 2023-09-30T22:26:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:enabled application 'rbd' on pool 'rbd' 2023-09-30T22:26:29.875 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-30T22:26:29.876 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:26:29.876 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:26:29.878 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:26:29.878 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-30T22:26:29.879 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:26:29.964 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2023-09-30T22:26:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.014+0000 7f0f3a169700 1 Processor -- start 2023-09-30T22:26:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.014+0000 7f0f3a169700 1 -- start start 2023-09-30T22:26:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.014+0000 7f0f3a169700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f34127390 0x7f0f3412fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.014+0000 7f0f3a169700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34127fa0 0x7f0f34132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.014+0000 7f0f3a169700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f34096900 con 0x7f0f34059070 2023-09-30T22:26:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.014+0000 7f0f3a169700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f34059c00 con 0x7f0f34127390 2023-09-30T22:26:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.014+0000 7f0f3a169700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34091b60 con 0x7f0f34127fa0 2023-09-30T22:26:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.014+0000 7f0f33fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34127fa0 0x7f0f34132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.014+0000 7f0f32ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f34127390 0x7f0f3412fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.015+0000 7f0f32ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f34127390 0x7f0f3412fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36186/0 (socket says 172.21.15.59:36186) 2023-09-30T22:26:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.015+0000 7f0f33fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34127fa0 0x7f0f34132170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60208/0 (socket says 172.21.15.59:60208) 2023-09-30T22:26:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.015+0000 7f0f337fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0f34059070 0x7f0f34127890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54850/0 (socket says 172.21.15.59:54850) 2023-09-30T22:26:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.015+0000 7f0f32ffd700 1 -- 172.21.15.59:0/1398957933 learned_addr learned my addr 172.21.15.59:0/1398957933 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:30.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.015+0000 7f0f33fff700 1 -- 172.21.15.59:0/1398957933 >> v2:172.21.15.59:3300/0 conn(0x7f0f34127390 msgr2=0x7f0f3412fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:30.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.015+0000 7f0f33fff700 1 --2- 172.21.15.59:0/1398957933 >> v2:172.21.15.59:3300/0 conn(0x7f0f34127390 0x7f0f3412fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.015+0000 7f0f33fff700 1 -- 172.21.15.59:0/1398957933 >> v1:172.21.15.59:6789/0 conn(0x7f0f34059070 legacy=0x7f0f34127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.015+0000 7f0f33fff700 1 -- 172.21.15.59:0/1398957933 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f34092a10 con 0x7f0f34127fa0 2023-09-30T22:26:30.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.015+0000 7f0f327fc700 1 -- 172.21.15.59:0/1398957933 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520991129 0 0) 0x7f0f34096900 con 0x7f0f34059070 2023-09-30T22:26:30.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.015+0000 7f0f32ffd700 1 --2- 172.21.15.59:0/1398957933 >> v2:172.21.15.59:3300/0 conn(0x7f0f34127390 0x7f0f3412fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:30.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.015+0000 7f0f33fff700 1 --2- 172.21.15.59:0/1398957933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34127fa0 0x7f0f34132170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0f2c009e60 tx=0x7f0f2c009780).ready entity=mon.2 client_cookie=28501b21a50aa8d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:30.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.015+0000 7f0f327fc700 1 -- 172.21.15.59:0/1398957933 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00e070 con 0x7f0f34127fa0 2023-09-30T22:26:30.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.015+0000 7f0f327fc700 1 -- 172.21.15.59:0/1398957933 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c00bb60 con 0x7f0f34127fa0 2023-09-30T22:26:30.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.015+0000 7f0f327fc700 1 -- 172.21.15.59:0/1398957933 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c012410 con 0x7f0f34127fa0 2023-09-30T22:26:30.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.016+0000 7f0f3a169700 1 -- 172.21.15.59:0/1398957933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34127fa0 msgr2=0x7f0f34132170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.016+0000 7f0f3a169700 1 --2- 172.21.15.59:0/1398957933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34127fa0 0x7f0f34132170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0f2c009e60 tx=0x7f0f2c009780).stop 2023-09-30T22:26:30.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.016+0000 7f0f3a169700 1 -- 172.21.15.59:0/1398957933 shutdown_connections 2023-09-30T22:26:30.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.016+0000 7f0f3a169700 1 --2- 172.21.15.59:0/1398957933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34127fa0 0x7f0f34132170 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.016+0000 7f0f3a169700 1 --2- 172.21.15.59:0/1398957933 >> v2:172.21.15.59:3300/0 conn(0x7f0f34127390 0x7f0f3412fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.016+0000 7f0f3a169700 1 -- 172.21.15.59:0/1398957933 >> 172.21.15.59:0/1398957933 conn(0x7f0f34097470 msgr2=0x7f0f34097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.016+0000 7f0f3a169700 1 -- 172.21.15.59:0/1398957933 shutdown_connections 2023-09-30T22:26:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.016+0000 7f0f3a169700 1 -- 172.21.15.59:0/1398957933 wait complete. 2023-09-30T22:26:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.017+0000 7f0f3a169700 1 Processor -- start 2023-09-30T22:26:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.017+0000 7f0f3a169700 1 -- start start 2023-09-30T22:26:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.017+0000 7f0f3a169700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f34059070 0x7f0f34125cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f3a169700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34127390 0x7f0f3412e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f3a169700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34127fa0 0x7f0f3412ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f3a169700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3412fe20 con 0x7f0f34059070 2023-09-30T22:26:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f3a169700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34111380 con 0x7f0f34127fa0 2023-09-30T22:26:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f3a169700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34130ac0 con 0x7f0f34127390 2023-09-30T22:26:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f32ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34127390 0x7f0f3412e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f32ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34127390 0x7f0f3412e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60212/0 (socket says 172.21.15.59:60212) 2023-09-30T22:26:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f32ffd700 1 -- 172.21.15.59:0/264759398 learned_addr learned my addr 172.21.15.59:0/264759398 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f33fff700 1 --2- 172.21.15.59:0/264759398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34127fa0 0x7f0f3412ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f337fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f34059070 0x7f0f34125cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f32ffd700 1 -- 172.21.15.59:0/264759398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34127fa0 msgr2=0x7f0f3412ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f32ffd700 1 --2- 172.21.15.59:0/264759398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34127fa0 0x7f0f3412ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f32ffd700 1 -- 172.21.15.59:0/264759398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f34059070 msgr2=0x7f0f34125cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f32ffd700 1 --2- 172.21.15.59:0/264759398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f34059070 0x7f0f34125cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f32ffd700 1 -- 172.21.15.59:0/264759398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f28009370 con 0x7f0f34127390 2023-09-30T22:26:30.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f32ffd700 1 --2- 172.21.15.59:0/264759398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34127390 0x7f0f3412e980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0f2800ea50 tx=0x7f0f280090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f1b7fe700 1 -- 172.21.15.59:0/264759398 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28009650 con 0x7f0f34127390 2023-09-30T22:26:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f1b7fe700 1 -- 172.21.15.59:0/264759398 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2800ee90 con 0x7f0f34127390 2023-09-30T22:26:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f3a169700 1 -- 172.21.15.59:0/264759398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f2c009a20 con 0x7f0f34127390 2023-09-30T22:26:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f1b7fe700 1 -- 172.21.15.59:0/264759398 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2800ca60 con 0x7f0f34127390 2023-09-30T22:26:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.018+0000 7f0f3a169700 1 -- 172.21.15.59:0/264759398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f34130510 con 0x7f0f34127390 2023-09-30T22:26:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.019+0000 7f0f1b7fe700 1 -- 172.21.15.59:0/264759398 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0f2801b400 con 0x7f0f34127390 2023-09-30T22:26:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.019+0000 7f0f1b7fe700 1 -- 172.21.15.59:0/264759398 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f0f2803b130 con 0x7f0f34127390 2023-09-30T22:26:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.020+0000 7f0f3a169700 1 -- 172.21.15.59:0/264759398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3405a260 con 0x7f0f34127390 2023-09-30T22:26:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.024+0000 7f0f1b7fe700 1 -- 172.21.15.59:0/264759398 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0f28016070 con 0x7f0f34127390 2023-09-30T22:26:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.200+0000 7f0f3a169700 1 -- 172.21.15.59:0/264759398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f3412f780 con 0x7f0f34127390 2023-09-30T22:26:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.201+0000 7f0f1b7fe700 1 -- 172.21.15.59:0/264759398 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+8139 (secure 0 0 0) 0x7f0f28029090 con 0x7f0f34127390 2023-09-30T22:26:30.201 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:30.201 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":12,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:26:29.850288+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:26:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.203+0000 7f0f3a169700 1 -- 172.21.15.59:0/264759398 >> v1:172.21.15.59:6816/118188 conn(0x7f0f2002bb60 legacy=0x7f0f2002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.203+0000 7f0f3a169700 1 -- 172.21.15.59:0/264759398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34127390 msgr2=0x7f0f3412e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.203+0000 7f0f3a169700 1 --2- 172.21.15.59:0/264759398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34127390 0x7f0f3412e980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0f2800ea50 tx=0x7f0f280090f0).stop 2023-09-30T22:26:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.203+0000 7f0f3a169700 1 -- 172.21.15.59:0/264759398 shutdown_connections 2023-09-30T22:26:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.203+0000 7f0f3a169700 1 --2- 172.21.15.59:0/264759398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34127fa0 0x7f0f3412ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.203+0000 7f0f3a169700 1 --2- 172.21.15.59:0/264759398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f34059070 0x7f0f34125cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.203+0000 7f0f3a169700 1 --2- 172.21.15.59:0/264759398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34127390 0x7f0f3412e980 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.203+0000 7f0f3a169700 1 -- 172.21.15.59:0/264759398 >> 172.21.15.59:0/264759398 conn(0x7f0f34097470 msgr2=0x7f0f3412a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.203+0000 7f0f3a169700 1 -- 172.21.15.59:0/264759398 shutdown_connections 2023-09-30T22:26:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.203+0000 7f0f3a169700 1 -- 172.21.15.59:0/264759398 wait complete. 2023-09-30T22:26:30.216 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:26:26.893716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:26:28.448775+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:26:30.217 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:26:30.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.350+0000 7f981f222700 1 Processor -- start 2023-09-30T22:26:30.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.350+0000 7f981f222700 1 -- start start 2023-09-30T22:26:30.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.350+0000 7f981f222700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9818099230 0x7f981812dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:30.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.350+0000 7f981f222700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981812e0d0 0x7f98181304c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:30.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.350+0000 7f981f222700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9818095270 con 0x7f9818098740 2023-09-30T22:26:30.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.350+0000 7f981f222700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9818094d20 con 0x7f981812e0d0 2023-09-30T22:26:30.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.350+0000 7f981f222700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9818096520 con 0x7f9818099230 2023-09-30T22:26:30.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.350+0000 7f981d7bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981812e0d0 0x7f98181304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:30.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.350+0000 7f981cfbe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9818098740 0x7f9818098b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54856/0 (socket says 172.21.15.59:54856) 2023-09-30T22:26:30.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.351+0000 7f981cfbe700 1 -- 172.21.15.59:0/1657037429 learned_addr learned my addr 172.21.15.59:0/1657037429 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:30.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.351+0000 7f9817fff700 1 --2- 172.21.15.59:0/1657037429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9818099230 0x7f981812dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:30.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.351+0000 7f98177fe700 1 -- 172.21.15.59:0/1657037429 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974729553 0 0) 0x7f9818095270 con 0x7f9818098740 2023-09-30T22:26:30.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.351+0000 7f98177fe700 1 -- 172.21.15.59:0/1657037429 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98040033f0 con 0x7f9818098740 2023-09-30T22:26:30.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.351+0000 7f981d7bf700 1 -- 172.21.15.59:0/1657037429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9818099230 msgr2=0x7f981812dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:30.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.351+0000 7f981d7bf700 1 --2- 172.21.15.59:0/1657037429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9818099230 0x7f981812dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.351+0000 7f981d7bf700 1 -- 172.21.15.59:0/1657037429 >> v1:172.21.15.59:6789/0 conn(0x7f9818098740 legacy=0x7f9818098b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.351+0000 7f981d7bf700 1 -- 172.21.15.59:0/1657037429 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9818094870 con 0x7f981812e0d0 2023-09-30T22:26:30.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.351+0000 7f9817fff700 1 --2- 172.21.15.59:0/1657037429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9818099230 0x7f981812dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:30.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.351+0000 7f981d7bf700 1 --2- 172.21.15.59:0/1657037429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981812e0d0 0x7f98181304c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9810009e90 tx=0x7f9810009780).ready entity=mon.1 client_cookie=28558e387082b281 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:30.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.351+0000 7f98177fe700 1 -- 172.21.15.59:0/1657037429 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000e070 con 0x7f981812e0d0 2023-09-30T22:26:30.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.351+0000 7f98177fe700 1 -- 172.21.15.59:0/1657037429 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981000bab0 con 0x7f981812e0d0 2023-09-30T22:26:30.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.351+0000 7f98177fe700 1 -- 172.21.15.59:0/1657037429 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000be30 con 0x7f981812e0d0 2023-09-30T22:26:30.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.352+0000 7f981f222700 1 -- 172.21.15.59:0/1657037429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981812e0d0 msgr2=0x7f98181304c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.352+0000 7f981f222700 1 --2- 172.21.15.59:0/1657037429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981812e0d0 0x7f98181304c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9810009e90 tx=0x7f9810009780).stop 2023-09-30T22:26:30.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.352+0000 7f981f222700 1 -- 172.21.15.59:0/1657037429 shutdown_connections 2023-09-30T22:26:30.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.352+0000 7f981f222700 1 --2- 172.21.15.59:0/1657037429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981812e0d0 0x7f98181304c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.352+0000 7f981f222700 1 --2- 172.21.15.59:0/1657037429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9818099230 0x7f981812dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.352+0000 7f981f222700 1 -- 172.21.15.59:0/1657037429 >> 172.21.15.59:0/1657037429 conn(0x7f981809a1c0 msgr2=0x7f981809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:30.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.352+0000 7f981f222700 1 -- 172.21.15.59:0/1657037429 shutdown_connections 2023-09-30T22:26:30.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.352+0000 7f981f222700 1 -- 172.21.15.59:0/1657037429 wait complete. 2023-09-30T22:26:30.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.353+0000 7f981f222700 1 Processor -- start 2023-09-30T22:26:30.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.353+0000 7f981f222700 1 -- start start 2023-09-30T22:26:30.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.354+0000 7f981f222700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9818098740 0x7f981811db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:30.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.354+0000 7f981f222700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9818099230 0x7f981812c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:30.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.354+0000 7f981f222700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981812e0d0 0x7f981812cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:30.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.354+0000 7f981f222700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981812dc00 con 0x7f981812e0d0 2023-09-30T22:26:30.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.354+0000 7f981f222700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9818094f70 con 0x7f9818098740 2023-09-30T22:26:30.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.354+0000 7f981f222700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f981811e2d0 con 0x7f9818099230 2023-09-30T22:26:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.354+0000 7f981cfbe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9818098740 0x7f981811db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.354+0000 7f981cfbe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9818098740 0x7f981811db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46178/0 (socket says 172.21.15.59:46178) 2023-09-30T22:26:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.354+0000 7f981cfbe700 1 -- 172.21.15.59:0/2889192156 learned_addr learned my addr 172.21.15.59:0/2889192156 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.354+0000 7f9817fff700 1 --2- 172.21.15.59:0/2889192156 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9818099230 0x7f981812c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.354+0000 7f981d7bf700 1 --2- 172.21.15.59:0/2889192156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981812e0d0 0x7f981812cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.355+0000 7f981cfbe700 1 -- 172.21.15.59:0/2889192156 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9818099230 msgr2=0x7f981812c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.355+0000 7f981cfbe700 1 --2- 172.21.15.59:0/2889192156 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9818099230 0x7f981812c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.355+0000 7f981cfbe700 1 -- 172.21.15.59:0/2889192156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981812e0d0 msgr2=0x7f981812cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.355+0000 7f981cfbe700 1 --2- 172.21.15.59:0/2889192156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981812e0d0 0x7f981812cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.355+0000 7f981cfbe700 1 -- 172.21.15.59:0/2889192156 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98000092a0 con 0x7f9818098740 2023-09-30T22:26:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.355+0000 7f9817fff700 1 --2- 172.21.15.59:0/2889192156 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9818099230 0x7f981812c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:30.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.355+0000 7f981cfbe700 1 --2- 172.21.15.59:0/2889192156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9818098740 0x7f981811db50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f980800c5c0 tx=0x7f9808007c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:30.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.355+0000 7f9814ff9700 1 -- 172.21.15.59:0/2889192156 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98080072e0 con 0x7f9818098740 2023-09-30T22:26:30.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.355+0000 7f9814ff9700 1 -- 172.21.15.59:0/2889192156 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9808007440 con 0x7f9818098740 2023-09-30T22:26:30.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.355+0000 7f981f222700 1 -- 172.21.15.59:0/2889192156 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9810009a20 con 0x7f9818098740 2023-09-30T22:26:30.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.355+0000 7f9814ff9700 1 -- 172.21.15.59:0/2889192156 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98080057a0 con 0x7f9818098740 2023-09-30T22:26:30.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.355+0000 7f981f222700 1 -- 172.21.15.59:0/2889192156 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9818093460 con 0x7f9818098740 2023-09-30T22:26:30.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.356+0000 7f9814ff9700 1 -- 172.21.15.59:0/2889192156 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9808005b90 con 0x7f9818098740 2023-09-30T22:26:30.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.356+0000 7f9814ff9700 1 -- 172.21.15.59:0/2889192156 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f980803a3e0 con 0x7f9818098740 2023-09-30T22:26:30.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.356+0000 7f981f222700 1 -- 172.21.15.59:0/2889192156 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981805a260 con 0x7f9818098740 2023-09-30T22:26:30.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.361+0000 7f9814ff9700 1 -- 172.21.15.59:0/2889192156 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9808013970 con 0x7f9818098740 2023-09-30T22:26:30.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.534+0000 7f981f222700 1 -- 172.21.15.59:0/2889192156 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9818094540 con 0x7f9818098740 2023-09-30T22:26:30.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.534+0000 7f9814ff9700 1 -- 172.21.15.59:0/2889192156 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v12) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9808018020 con 0x7f9818098740 2023-09-30T22:26:30.534 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-30T22:26:30.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.536+0000 7f981f222700 1 -- 172.21.15.59:0/2889192156 >> v1:172.21.15.59:6816/118188 conn(0x7f97f802bb60 legacy=0x7f97f802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.536+0000 7f981f222700 1 -- 172.21.15.59:0/2889192156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9818098740 msgr2=0x7f981811db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.536+0000 7f981f222700 1 --2- 172.21.15.59:0/2889192156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9818098740 0x7f981811db50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f980800c5c0 tx=0x7f9808007c80).stop 2023-09-30T22:26:30.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.536+0000 7f981f222700 1 -- 172.21.15.59:0/2889192156 shutdown_connections 2023-09-30T22:26:30.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.536+0000 7f981f222700 1 --2- 172.21.15.59:0/2889192156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981812e0d0 0x7f981812cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.536+0000 7f981f222700 1 --2- 172.21.15.59:0/2889192156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9818098740 0x7f981811db50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.536+0000 7f981f222700 1 --2- 172.21.15.59:0/2889192156 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9818099230 0x7f981812c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.536+0000 7f981f222700 1 -- 172.21.15.59:0/2889192156 >> 172.21.15.59:0/2889192156 conn(0x7f981809a1c0 msgr2=0x7f9818065d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:30.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.536+0000 7f981f222700 1 -- 172.21.15.59:0/2889192156 shutdown_connections 2023-09-30T22:26:30.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.536+0000 7f981f222700 1 -- 172.21.15.59:0/2889192156 wait complete. 2023-09-30T22:26:30.549 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:26:30.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.682+0000 7f06e8eaf700 1 Processor -- start 2023-09-30T22:26:30.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.682+0000 7f06e8eaf700 1 -- start start 2023-09-30T22:26:30.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.683+0000 7f06e8eaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e4093840 0x7f06e4098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:30.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.683+0000 7f06e8eaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4098c80 0x7f06e4099060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:30.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.683+0000 7f06e8eaf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e4092d80 con 0x7f06e412c150 2023-09-30T22:26:30.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.683+0000 7f06e8eaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4093c20 con 0x7f06e4098c80 2023-09-30T22:26:30.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.683+0000 7f06e8eaf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4092b90 con 0x7f06e4093840 2023-09-30T22:26:30.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.683+0000 7f06e1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4098c80 0x7f06e4099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:30.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.683+0000 7f06e259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e4093840 0x7f06e4098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:30.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.683+0000 7f06e2d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f06e412c150 0x7f06e412e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54870/0 (socket says 172.21.15.59:54870) 2023-09-30T22:26:30.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.683+0000 7f06e2d9d700 1 -- 172.21.15.59:0/3375192397 learned_addr learned my addr 172.21.15.59:0/3375192397 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:30.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.683+0000 7f06e259c700 1 -- 172.21.15.59:0/3375192397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4098c80 msgr2=0x7f06e4099060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:30.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.683+0000 7f06e159a700 1 -- 172.21.15.59:0/3375192397 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480689303 0 0) 0x7f06e4092d80 con 0x7f06e412c150 2023-09-30T22:26:30.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.683+0000 7f06e259c700 1 --2- 172.21.15.59:0/3375192397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4098c80 0x7f06e4099060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.683+0000 7f06e259c700 1 -- 172.21.15.59:0/3375192397 >> v1:172.21.15.59:6789/0 conn(0x7f06e412c150 legacy=0x7f06e412e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.683+0000 7f06e259c700 1 -- 172.21.15.59:0/3375192397 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e4099b70 con 0x7f06e4093840 2023-09-30T22:26:30.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.683+0000 7f06e1d9b700 1 --2- 172.21.15.59:0/3375192397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4098c80 0x7f06e4099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:30.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.684+0000 7f06e259c700 1 --2- 172.21.15.59:0/3375192397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e4093840 0x7f06e4098790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f06d4009790 tx=0x7f06d4009060).ready entity=mon.2 client_cookie=43ecc8c5cd3065dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:30.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.684+0000 7f06e159a700 1 -- 172.21.15.59:0/3375192397 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d400f510 con 0x7f06e4093840 2023-09-30T22:26:30.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.684+0000 7f06e159a700 1 -- 172.21.15.59:0/3375192397 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d400f670 con 0x7f06e4093840 2023-09-30T22:26:30.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.684+0000 7f06e159a700 1 -- 172.21.15.59:0/3375192397 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d400f9f0 con 0x7f06e4093840 2023-09-30T22:26:30.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.684+0000 7f06e8eaf700 1 -- 172.21.15.59:0/3375192397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e4093840 msgr2=0x7f06e4098790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.684+0000 7f06e8eaf700 1 --2- 172.21.15.59:0/3375192397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e4093840 0x7f06e4098790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f06d4009790 tx=0x7f06d4009060).stop 2023-09-30T22:26:30.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.684+0000 7f06e8eaf700 1 -- 172.21.15.59:0/3375192397 shutdown_connections 2023-09-30T22:26:30.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.684+0000 7f06e8eaf700 1 --2- 172.21.15.59:0/3375192397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e4093840 0x7f06e4098790 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.684+0000 7f06e8eaf700 1 --2- 172.21.15.59:0/3375192397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4098c80 0x7f06e4099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.684+0000 7f06e8eaf700 1 -- 172.21.15.59:0/3375192397 >> 172.21.15.59:0/3375192397 conn(0x7f06e4097480 msgr2=0x7f06e4097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:30.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.684+0000 7f06e8eaf700 1 -- 172.21.15.59:0/3375192397 shutdown_connections 2023-09-30T22:26:30.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.684+0000 7f06e8eaf700 1 -- 172.21.15.59:0/3375192397 wait complete. 2023-09-30T22:26:30.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.686+0000 7f06e8eaf700 1 Processor -- start 2023-09-30T22:26:30.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.686+0000 7f06e8eaf700 1 -- start start 2023-09-30T22:26:30.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.686+0000 7f06e8eaf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e4093840 0x7f06e4111b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:30.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.686+0000 7f06e8eaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e4098c80 0x7f06e4112080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:30.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.686+0000 7f06e8eaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e412c150 0x7f06e4112570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:30.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.686+0000 7f06e8eaf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4114a70 con 0x7f06e4093840 2023-09-30T22:26:30.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.686+0000 7f06e8eaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4064e30 con 0x7f06e412c150 2023-09-30T22:26:30.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.686+0000 7f06e8eaf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06e406a520 con 0x7f06e4098c80 2023-09-30T22:26:30.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06e259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e4093840 0x7f06e4111b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:30.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06e259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e4093840 0x7f06e4111b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36206/0 (socket says 172.21.15.59:36206) 2023-09-30T22:26:30.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06e259c700 1 -- 172.21.15.59:0/630829669 learned_addr learned my addr 172.21.15.59:0/630829669 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:30.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06e2d9d700 1 --2- 172.21.15.59:0/630829669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e412c150 0x7f06e4112570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:30.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06e1d9b700 1 --2- 172.21.15.59:0/630829669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e4098c80 0x7f06e4112080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:30.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06e2d9d700 1 -- 172.21.15.59:0/630829669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e4098c80 msgr2=0x7f06e4112080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06e2d9d700 1 --2- 172.21.15.59:0/630829669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e4098c80 0x7f06e4112080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06e2d9d700 1 -- 172.21.15.59:0/630829669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e4093840 msgr2=0x7f06e4111b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06e2d9d700 1 --2- 172.21.15.59:0/630829669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e4093840 0x7f06e4111b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06e2d9d700 1 -- 172.21.15.59:0/630829669 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc0092a0 con 0x7f06e412c150 2023-09-30T22:26:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06e1d9b700 1 --2- 172.21.15.59:0/630829669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e4098c80 0x7f06e4112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06e259c700 1 --2- 172.21.15.59:0/630829669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e4093840 0x7f06e4111b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06e2d9d700 1 --2- 172.21.15.59:0/630829669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e412c150 0x7f06e4112570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f06dc002230 tx=0x7f06dc007eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06da7fc700 1 -- 172.21.15.59:0/630829669 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc005d30 con 0x7f06e412c150 2023-09-30T22:26:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06da7fc700 1 -- 172.21.15.59:0/630829669 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc007110 con 0x7f06e412c150 2023-09-30T22:26:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06e8eaf700 1 -- 172.21.15.59:0/630829669 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d40092a0 con 0x7f06e412c150 2023-09-30T22:26:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06da7fc700 1 -- 172.21.15.59:0/630829669 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0074d0 con 0x7f06e412c150 2023-09-30T22:26:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.687+0000 7f06e8eaf700 1 -- 172.21.15.59:0/630829669 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e41158b0 con 0x7f06e412c150 2023-09-30T22:26:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.688+0000 7f06da7fc700 1 -- 172.21.15.59:0/630829669 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f06dc013410 con 0x7f06e412c150 2023-09-30T22:26:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.688+0000 7f06da7fc700 1 -- 172.21.15.59:0/630829669 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f06dc03aa40 con 0x7f06e412c150 2023-09-30T22:26:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.688+0000 7f06e8eaf700 1 -- 172.21.15.59:0/630829669 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e4112a60 con 0x7f06e412c150 2023-09-30T22:26:30.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.693+0000 7f06da7fc700 1 -- 172.21.15.59:0/630829669 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f06dc0136c0 con 0x7f06e412c150 2023-09-30T22:26:30.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.866+0000 7f06e8eaf700 1 -- 172.21.15.59:0/630829669 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f06e41158b0 con 0x7f06e412c150 2023-09-30T22:26:30.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.866+0000 7f06da7fc700 1 -- 172.21.15.59:0/630829669 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v13) v1 ==== 92+0+10 (secure 0 0 0) 0x7f06e41158b0 con 0x7f06e412c150 2023-09-30T22:26:30.867 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-09-30T22:26:30.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.868+0000 7f06e8eaf700 1 -- 172.21.15.59:0/630829669 >> v1:172.21.15.59:6816/118188 conn(0x7f06c402bb60 legacy=0x7f06c402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.868+0000 7f06e8eaf700 1 -- 172.21.15.59:0/630829669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e412c150 msgr2=0x7f06e4112570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.868+0000 7f06e8eaf700 1 --2- 172.21.15.59:0/630829669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e412c150 0x7f06e4112570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f06dc002230 tx=0x7f06dc007eb0).stop 2023-09-30T22:26:30.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.869+0000 7f06e8eaf700 1 -- 172.21.15.59:0/630829669 shutdown_connections 2023-09-30T22:26:30.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.869+0000 7f06e8eaf700 1 --2- 172.21.15.59:0/630829669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e412c150 0x7f06e4112570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.869+0000 7f06e8eaf700 1 --2- 172.21.15.59:0/630829669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e4093840 0x7f06e4111b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.869+0000 7f06e8eaf700 1 --2- 172.21.15.59:0/630829669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e4098c80 0x7f06e4112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:30.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.869+0000 7f06e8eaf700 1 -- 172.21.15.59:0/630829669 >> 172.21.15.59:0/630829669 conn(0x7f06e4097480 msgr2=0x7f06e4069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:30.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.869+0000 7f06e8eaf700 1 -- 172.21.15.59:0/630829669 shutdown_connections 2023-09-30T22:26:30.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:30.869+0000 7f06e8eaf700 1 -- 172.21.15.59:0/630829669 wait complete. 2023-09-30T22:26:30.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:26:31.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.015+0000 7f1008d0d700 1 Processor -- start 2023-09-30T22:26:31.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.015+0000 7f1008d0d700 1 -- start start 2023-09-30T22:26:31.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.016+0000 7f1008d0d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1004096be0 0x7f10041251c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:31.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.016+0000 7f1008d0d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f100412da60 0x7f100412fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:31.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.016+0000 7f1008d0d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1004095ea0 con 0x7f1004125770 2023-09-30T22:26:31.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.016+0000 7f1008d0d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10040956a0 con 0x7f1004096be0 2023-09-30T22:26:31.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.016+0000 7f1008d0d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1004096fc0 con 0x7f100412da60 2023-09-30T22:26:31.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.016+0000 7f100259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1004096be0 0x7f10041251c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:31.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.016+0000 7f1002d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f100412da60 0x7f100412fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:31.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.016+0000 7f1001d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1004125770 0x7f1004125b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54882/0 (socket says 172.21.15.59:54882) 2023-09-30T22:26:31.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.016+0000 7f1001d9b700 1 -- 172.21.15.59:0/1318729799 learned_addr learned my addr 172.21.15.59:0/1318729799 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:31.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.016+0000 7f100259c700 1 -- 172.21.15.59:0/1318729799 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f100412da60 msgr2=0x7f100412fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:31.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.016+0000 7f100259c700 1 --2- 172.21.15.59:0/1318729799 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f100412da60 0x7f100412fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.016+0000 7f100259c700 1 -- 172.21.15.59:0/1318729799 >> v1:172.21.15.59:6789/0 conn(0x7f1004125770 legacy=0x7f1004125b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.016+0000 7f100259c700 1 -- 172.21.15.59:0/1318729799 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1004096120 con 0x7f1004096be0 2023-09-30T22:26:31.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.016+0000 7f100159a700 1 -- 172.21.15.59:0/1318729799 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982938042 0 0) 0x7f1004095ea0 con 0x7f1004125770 2023-09-30T22:26:31.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.016+0000 7f1002d9d700 1 --2- 172.21.15.59:0/1318729799 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f100412da60 0x7f100412fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:31.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.017+0000 7f100259c700 1 --2- 172.21.15.59:0/1318729799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1004096be0 0x7f10041251c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f0ff4009760 tx=0x7f0ff4009060).ready entity=mon.0 client_cookie=d71e3bc7a7580cf6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.017+0000 7f100159a700 1 -- 172.21.15.59:0/1318729799 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff400f510 con 0x7f1004096be0 2023-09-30T22:26:31.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.017+0000 7f100159a700 1 -- 172.21.15.59:0/1318729799 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff400f670 con 0x7f1004096be0 2023-09-30T22:26:31.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.017+0000 7f100159a700 1 -- 172.21.15.59:0/1318729799 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff400f9f0 con 0x7f1004096be0 2023-09-30T22:26:31.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.017+0000 7f1008d0d700 1 -- 172.21.15.59:0/1318729799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1004096be0 msgr2=0x7f10041251c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.017+0000 7f1008d0d700 1 --2- 172.21.15.59:0/1318729799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1004096be0 0x7f10041251c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f0ff4009760 tx=0x7f0ff4009060).stop 2023-09-30T22:26:31.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.017+0000 7f1008d0d700 1 -- 172.21.15.59:0/1318729799 shutdown_connections 2023-09-30T22:26:31.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.017+0000 7f1008d0d700 1 --2- 172.21.15.59:0/1318729799 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f100412da60 0x7f100412fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.017+0000 7f1008d0d700 1 --2- 172.21.15.59:0/1318729799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1004096be0 0x7f10041251c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.017+0000 7f1008d0d700 1 -- 172.21.15.59:0/1318729799 >> 172.21.15.59:0/1318729799 conn(0x7f1004097470 msgr2=0x7f1004097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.018+0000 7f1008d0d700 1 -- 172.21.15.59:0/1318729799 shutdown_connections 2023-09-30T22:26:31.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.018+0000 7f1008d0d700 1 -- 172.21.15.59:0/1318729799 wait complete. 2023-09-30T22:26:31.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.018+0000 7f1008d0d700 1 Processor -- start 2023-09-30T22:26:31.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.018+0000 7f1008d0d700 1 -- start start 2023-09-30T22:26:31.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f1008d0d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1004096be0 0x7f100412d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:31.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f1008d0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1004125770 0x7f100412bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:31.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f1008d0d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f100412da60 0x7f100412c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:31.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f1008d0d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1004069dd0 con 0x7f1004096be0 2023-09-30T22:26:31.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f1008d0d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1004069fc0 con 0x7f1004125770 2023-09-30T22:26:31.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f1008d0d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1004124ef0 con 0x7f100412da60 2023-09-30T22:26:31.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f1002d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f100412da60 0x7f100412c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:31.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f100259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1004096be0 0x7f100412d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:31.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f1002d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f100412da60 0x7f100412c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60264/0 (socket says 172.21.15.59:60264) 2023-09-30T22:26:31.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f1002d9d700 1 -- 172.21.15.59:0/2470413139 learned_addr learned my addr 172.21.15.59:0/2470413139 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:31.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f1001d9b700 1 --2- 172.21.15.59:0/2470413139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1004125770 0x7f100412bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:31.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f100259c700 1 -- 172.21.15.59:0/2470413139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f100412da60 msgr2=0x7f100412c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f100259c700 1 --2- 172.21.15.59:0/2470413139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f100412da60 0x7f100412c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f100259c700 1 -- 172.21.15.59:0/2470413139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1004125770 msgr2=0x7f100412bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f100259c700 1 --2- 172.21.15.59:0/2470413139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1004125770 0x7f100412bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f100259c700 1 -- 172.21.15.59:0/2470413139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc009a20 con 0x7f1004096be0 2023-09-30T22:26:31.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.019+0000 7f1002d9d700 1 --2- 172.21.15.59:0/2470413139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f100412da60 0x7f100412c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:31.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.020+0000 7f100259c700 1 --2- 172.21.15.59:0/2470413139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1004096be0 0x7f100412d4f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1004098390 tx=0x7f0ff4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.020+0000 7f0ff27fc700 1 -- 172.21.15.59:0/2470413139 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff400f7e0 con 0x7f1004096be0 2023-09-30T22:26:31.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.020+0000 7f0ff27fc700 1 -- 172.21.15.59:0/2470413139 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff400f940 con 0x7f1004096be0 2023-09-30T22:26:31.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.020+0000 7f0ff27fc700 1 -- 172.21.15.59:0/2470413139 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff401b660 con 0x7f1004096be0 2023-09-30T22:26:31.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.020+0000 7f1008d0d700 1 -- 172.21.15.59:0/2470413139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff40092a0 con 0x7f1004096be0 2023-09-30T22:26:31.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.020+0000 7f1008d0d700 1 -- 172.21.15.59:0/2470413139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100412b980 con 0x7f1004096be0 2023-09-30T22:26:31.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.020+0000 7f0ff27fc700 1 -- 172.21.15.59:0/2470413139 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0ff401ba10 con 0x7f1004096be0 2023-09-30T22:26:31.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.021+0000 7f0ff27fc700 1 -- 172.21.15.59:0/2470413139 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f0ff403c4c0 con 0x7f1004096be0 2023-09-30T22:26:31.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.021+0000 7f1008d0d700 1 -- 172.21.15.59:0/2470413139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100405a260 con 0x7f1004096be0 2023-09-30T22:26:31.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.026+0000 7f0ff27fc700 1 -- 172.21.15.59:0/2470413139 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0ff401f080 con 0x7f1004096be0 2023-09-30T22:26:31.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.243+0000 7f1008d0d700 1 -- 172.21.15.59:0/2470413139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10040697a0 con 0x7f1004096be0 2023-09-30T22:26:31.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.243+0000 7f0ff27fc700 1 -- 172.21.15.59:0/2470413139 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1196 (secure 0 0 0) 0x7f0ff4029020 con 0x7f1004096be0 2023-09-30T22:26:31.244 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:31.244 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6817/2103029646","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":2103029646}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-09-30T22:26:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.245+0000 7f1008d0d700 1 -- 172.21.15.59:0/2470413139 >> v1:172.21.15.59:6816/118188 conn(0x7f0fe402bb60 legacy=0x7f0fe402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.245+0000 7f1008d0d700 1 -- 172.21.15.59:0/2470413139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1004096be0 msgr2=0x7f100412d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.245+0000 7f1008d0d700 1 --2- 172.21.15.59:0/2470413139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1004096be0 0x7f100412d4f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1004098390 tx=0x7f0ff4017000).stop 2023-09-30T22:26:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.245+0000 7f1008d0d700 1 -- 172.21.15.59:0/2470413139 shutdown_connections 2023-09-30T22:26:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.245+0000 7f1008d0d700 1 --2- 172.21.15.59:0/2470413139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f100412da60 0x7f100412c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.245+0000 7f1008d0d700 1 --2- 172.21.15.59:0/2470413139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1004096be0 0x7f100412d4f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.245+0000 7f1008d0d700 1 --2- 172.21.15.59:0/2470413139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1004125770 0x7f100412bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.246+0000 7f1008d0d700 1 -- 172.21.15.59:0/2470413139 >> 172.21.15.59:0/2470413139 conn(0x7f1004097470 msgr2=0x7f100412de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.246+0000 7f1008d0d700 1 -- 172.21.15.59:0/2470413139 shutdown_connections 2023-09-30T22:26:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.246+0000 7f1008d0d700 1 -- 172.21.15.59:0/2470413139 wait complete. 2023-09-30T22:26:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 2 2023-09-30T22:26:31.259 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:26:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.389+0000 7f5ed2b8d700 1 Processor -- start 2023-09-30T22:26:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.389+0000 7f5ed2b8d700 1 -- start start 2023-09-30T22:26:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ed2b8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ecc096380 0x7f5ecc094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ed2b8d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ecc091b00 0x7f5ecc127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ed2b8d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc096760 con 0x7f5ecc094c20 2023-09-30T22:26:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ed2b8d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc091ff0 con 0x7f5ecc096380 2023-09-30T22:26:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ed2b8d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc092c80 con 0x7f5ecc091b00 2023-09-30T22:26:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ecbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ecc091b00 0x7f5ecc127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:31.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ed112a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5ecc094c20 0x7f5ecc127af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54886/0 (socket says 172.21.15.59:54886) 2023-09-30T22:26:31.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ed0929700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ecc096380 0x7f5ecc094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:31.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ed112a700 1 -- 172.21.15.59:0/314436556 learned_addr learned my addr 172.21.15.59:0/314436556 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:31.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ecb7fe700 1 -- 172.21.15.59:0/314436556 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575127118 0 0) 0x7f5ecc096760 con 0x7f5ecc094c20 2023-09-30T22:26:31.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ed0929700 1 -- 172.21.15.59:0/314436556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ecc091b00 msgr2=0x7f5ecc127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:31.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ed0929700 1 --2- 172.21.15.59:0/314436556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ecc091b00 0x7f5ecc127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ed0929700 1 -- 172.21.15.59:0/314436556 >> v1:172.21.15.59:6789/0 conn(0x7f5ecc094c20 legacy=0x7f5ecc127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ed0929700 1 -- 172.21.15.59:0/314436556 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc093900 con 0x7f5ecc096380 2023-09-30T22:26:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ecbfff700 1 --2- 172.21.15.59:0/314436556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ecc091b00 0x7f5ecc127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.390+0000 7f5ed0929700 1 --2- 172.21.15.59:0/314436556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ecc096380 0x7f5ecc094730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5ebc009790 tx=0x7f5ebc009060).ready entity=mon.1 client_cookie=1fdc851a8ddbad24 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.391+0000 7f5ecb7fe700 1 -- 172.21.15.59:0/314436556 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc00f510 con 0x7f5ecc096380 2023-09-30T22:26:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.391+0000 7f5ecb7fe700 1 -- 172.21.15.59:0/314436556 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc00f670 con 0x7f5ecc096380 2023-09-30T22:26:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.391+0000 7f5ecb7fe700 1 -- 172.21.15.59:0/314436556 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc00f9f0 con 0x7f5ecc096380 2023-09-30T22:26:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.391+0000 7f5ed2b8d700 1 -- 172.21.15.59:0/314436556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ecc096380 msgr2=0x7f5ecc094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.391+0000 7f5ed2b8d700 1 --2- 172.21.15.59:0/314436556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ecc096380 0x7f5ecc094730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5ebc009790 tx=0x7f5ebc009060).stop 2023-09-30T22:26:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.391+0000 7f5ed2b8d700 1 -- 172.21.15.59:0/314436556 shutdown_connections 2023-09-30T22:26:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.391+0000 7f5ed2b8d700 1 --2- 172.21.15.59:0/314436556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ecc096380 0x7f5ecc094730 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.391+0000 7f5ed2b8d700 1 --2- 172.21.15.59:0/314436556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ecc091b00 0x7f5ecc127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.391+0000 7f5ed2b8d700 1 -- 172.21.15.59:0/314436556 >> 172.21.15.59:0/314436556 conn(0x7f5ecc097470 msgr2=0x7f5ecc097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.391+0000 7f5ed2b8d700 1 -- 172.21.15.59:0/314436556 shutdown_connections 2023-09-30T22:26:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.391+0000 7f5ed2b8d700 1 -- 172.21.15.59:0/314436556 wait complete. 2023-09-30T22:26:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.392+0000 7f5ed2b8d700 1 Processor -- start 2023-09-30T22:26:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.392+0000 7f5ed2b8d700 1 -- start start 2023-09-30T22:26:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed2b8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ecc091b00 0x7f5ecc11aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed2b8d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ecc094c20 0x7f5ecc125510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed2b8d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ecc096380 0x7f5ecc125a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed2b8d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc06a520 con 0x7f5ecc094c20 2023-09-30T22:26:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed2b8d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc11a760 con 0x7f5ecc091b00 2023-09-30T22:26:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed2b8d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc127150 con 0x7f5ecc096380 2023-09-30T22:26:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed112a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ecc096380 0x7f5ecc125a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed0929700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ecc091b00 0x7f5ecc11aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed0929700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ecc091b00 0x7f5ecc11aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46228/0 (socket says 172.21.15.59:46228) 2023-09-30T22:26:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed0929700 1 -- 172.21.15.59:0/967809223 learned_addr learned my addr 172.21.15.59:0/967809223 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed112a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ecc096380 0x7f5ecc125a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60284/0 (socket says 172.21.15.59:60284) 2023-09-30T22:26:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ecbfff700 1 --2- 172.21.15.59:0/967809223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ecc094c20 0x7f5ecc125510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed0929700 1 -- 172.21.15.59:0/967809223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ecc096380 msgr2=0x7f5ecc125a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed0929700 1 --2- 172.21.15.59:0/967809223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ecc096380 0x7f5ecc125a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed0929700 1 -- 172.21.15.59:0/967809223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ecc094c20 msgr2=0x7f5ecc125510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed0929700 1 --2- 172.21.15.59:0/967809223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ecc094c20 0x7f5ecc125510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed0929700 1 -- 172.21.15.59:0/967809223 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb40092a0 con 0x7f5ecc091b00 2023-09-30T22:26:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ed112a700 1 --2- 172.21.15.59:0/967809223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ecc096380 0x7f5ecc125a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.393+0000 7f5ecbfff700 1 --2- 172.21.15.59:0/967809223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ecc094c20 0x7f5ecc125510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.394+0000 7f5ed0929700 1 --2- 172.21.15.59:0/967809223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ecc091b00 0x7f5ecc11aed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5ebc009e30 tx=0x7f5ebc017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.394+0000 7f5ec8ff9700 1 -- 172.21.15.59:0/967809223 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc00fe80 con 0x7f5ecc091b00 2023-09-30T22:26:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.394+0000 7f5ec8ff9700 1 -- 172.21.15.59:0/967809223 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc00f7e0 con 0x7f5ecc091b00 2023-09-30T22:26:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.394+0000 7f5ed2b8d700 1 -- 172.21.15.59:0/967809223 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ebc0092a0 con 0x7f5ecc091b00 2023-09-30T22:26:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.394+0000 7f5ec8ff9700 1 -- 172.21.15.59:0/967809223 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc01c650 con 0x7f5ecc091b00 2023-09-30T22:26:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.394+0000 7f5ed2b8d700 1 -- 172.21.15.59:0/967809223 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc11a030 con 0x7f5ecc091b00 2023-09-30T22:26:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.394+0000 7f5ec8ff9700 1 -- 172.21.15.59:0/967809223 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5ebc01ca00 con 0x7f5ecc091b00 2023-09-30T22:26:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.395+0000 7f5ec8ff9700 1 -- 172.21.15.59:0/967809223 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f5ebc03c930 con 0x7f5ecc091b00 2023-09-30T22:26:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.395+0000 7f5ed2b8d700 1 -- 172.21.15.59:0/967809223 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ecc064f30 con 0x7f5ecc091b00 2023-09-30T22:26:31.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.400+0000 7f5ec8ff9700 1 -- 172.21.15.59:0/967809223 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5ebc020070 con 0x7f5ecc091b00 2023-09-30T22:26:31.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.576+0000 7f5ed2b8d700 1 -- 172.21.15.59:0/967809223 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ecc05a260 con 0x7f5ecc091b00 2023-09-30T22:26:31.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.577+0000 7f5ec8ff9700 1 -- 172.21.15.59:0/967809223 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8139 (secure 0 0 0) 0x7f5ebc020020 con 0x7f5ecc091b00 2023-09-30T22:26:31.577 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:31.577 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":13,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:26:30.851593+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:26:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.579+0000 7f5ed2b8d700 1 -- 172.21.15.59:0/967809223 >> v1:172.21.15.59:6816/118188 conn(0x7f5eac02bb60 legacy=0x7f5eac02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.579+0000 7f5ed2b8d700 1 -- 172.21.15.59:0/967809223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ecc091b00 msgr2=0x7f5ecc11aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.579+0000 7f5ed2b8d700 1 --2- 172.21.15.59:0/967809223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ecc091b00 0x7f5ecc11aed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5ebc009e30 tx=0x7f5ebc017000).stop 2023-09-30T22:26:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.579+0000 7f5ed2b8d700 1 -- 172.21.15.59:0/967809223 shutdown_connections 2023-09-30T22:26:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.579+0000 7f5ed2b8d700 1 --2- 172.21.15.59:0/967809223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ecc096380 0x7f5ecc125a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.579+0000 7f5ed2b8d700 1 --2- 172.21.15.59:0/967809223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ecc091b00 0x7f5ecc11aed0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.579+0000 7f5ed2b8d700 1 --2- 172.21.15.59:0/967809223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ecc094c20 0x7f5ecc125510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.579+0000 7f5ed2b8d700 1 -- 172.21.15.59:0/967809223 >> 172.21.15.59:0/967809223 conn(0x7f5ecc097470 msgr2=0x7f5ecc0684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.579+0000 7f5ed2b8d700 1 -- 172.21.15.59:0/967809223 shutdown_connections 2023-09-30T22:26:31.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.579+0000 7f5ed2b8d700 1 -- 172.21.15.59:0/967809223 wait complete. 2023-09-30T22:26:31.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:26:26.893716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:26:28.448775+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:26:31.593 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:26:31.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.726+0000 7f991a368700 1 Processor -- start 2023-09-30T22:26:31.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.726+0000 7f991a368700 1 -- start start 2023-09-30T22:26:31.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.727+0000 7f991a368700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9914125f00 0x7f991412db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:31.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.727+0000 7f991a368700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99141252b0 0x7f9914130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:31.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.727+0000 7f991a368700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9914098790 con 0x7f991406a520 2023-09-30T22:26:31.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.727+0000 7f991a368700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991406a900 con 0x7f9914125f00 2023-09-30T22:26:31.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.727+0000 7f991a368700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99140996f0 con 0x7f99141252b0 2023-09-30T22:26:31.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.727+0000 7f99137fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9914125f00 0x7f991412db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:31.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.727+0000 7f9918905700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99141252b0 0x7f9914130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:31.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.727+0000 7f9913fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f991406a520 0x7f99141257f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54896/0 (socket says 172.21.15.59:54896) 2023-09-30T22:26:31.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.727+0000 7f9913fff700 1 -- 172.21.15.59:0/2960315637 learned_addr learned my addr 172.21.15.59:0/2960315637 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:31.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.727+0000 7f9918905700 1 -- 172.21.15.59:0/2960315637 >> v2:172.21.15.59:3300/0 conn(0x7f9914125f00 msgr2=0x7f991412db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:31.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.727+0000 7f9918905700 1 --2- 172.21.15.59:0/2960315637 >> v2:172.21.15.59:3300/0 conn(0x7f9914125f00 0x7f991412db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.727+0000 7f9918905700 1 -- 172.21.15.59:0/2960315637 >> v1:172.21.15.59:6789/0 conn(0x7f991406a520 legacy=0x7f99141257f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.727+0000 7f9918905700 1 -- 172.21.15.59:0/2960315637 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9914059d70 con 0x7f99141252b0 2023-09-30T22:26:31.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.727+0000 7f9912ffd700 1 -- 172.21.15.59:0/2960315637 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354827364 0 0) 0x7f9914098790 con 0x7f991406a520 2023-09-30T22:26:31.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.727+0000 7f99137fe700 1 --2- 172.21.15.59:0/2960315637 >> v2:172.21.15.59:3300/0 conn(0x7f9914125f00 0x7f991412db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:31.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.728+0000 7f9918905700 1 --2- 172.21.15.59:0/2960315637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99141252b0 0x7f9914130040 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f990c009e60 tx=0x7f990c009780).ready entity=mon.2 client_cookie=29d31dfd1f5fd055 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.728+0000 7f9912ffd700 1 -- 172.21.15.59:0/2960315637 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c00e070 con 0x7f99141252b0 2023-09-30T22:26:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.728+0000 7f9912ffd700 1 -- 172.21.15.59:0/2960315637 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c00bb60 con 0x7f99141252b0 2023-09-30T22:26:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.728+0000 7f9912ffd700 1 -- 172.21.15.59:0/2960315637 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c012410 con 0x7f99141252b0 2023-09-30T22:26:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.728+0000 7f991a368700 1 -- 172.21.15.59:0/2960315637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99141252b0 msgr2=0x7f9914130040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.728+0000 7f991a368700 1 --2- 172.21.15.59:0/2960315637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99141252b0 0x7f9914130040 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f990c009e60 tx=0x7f990c009780).stop 2023-09-30T22:26:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.728+0000 7f991a368700 1 -- 172.21.15.59:0/2960315637 shutdown_connections 2023-09-30T22:26:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.728+0000 7f991a368700 1 --2- 172.21.15.59:0/2960315637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99141252b0 0x7f9914130040 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.728+0000 7f991a368700 1 --2- 172.21.15.59:0/2960315637 >> v2:172.21.15.59:3300/0 conn(0x7f9914125f00 0x7f991412db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.728+0000 7f991a368700 1 -- 172.21.15.59:0/2960315637 >> 172.21.15.59:0/2960315637 conn(0x7f9914097480 msgr2=0x7f9914097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.728+0000 7f991a368700 1 -- 172.21.15.59:0/2960315637 shutdown_connections 2023-09-30T22:26:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.728+0000 7f991a368700 1 -- 172.21.15.59:0/2960315637 wait complete. 2023-09-30T22:26:31.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.730+0000 7f991a368700 1 Processor -- start 2023-09-30T22:26:31.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.730+0000 7f991a368700 1 -- start start 2023-09-30T22:26:31.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.730+0000 7f991a368700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f991406a520 0x7f991412a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:31.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.730+0000 7f991a368700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99141252b0 0x7f991412da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:31.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f991a368700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9914125f00 0x7f991412df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:31.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f991a368700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991412af50 con 0x7f99141252b0 2023-09-30T22:26:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f991a368700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9914098ea0 con 0x7f9914125f00 2023-09-30T22:26:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f991a368700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f991412fd20 con 0x7f991406a520 2023-09-30T22:26:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f9913fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f991406a520 0x7f991412a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f99137fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99141252b0 0x7f991412da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f9913fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f991406a520 0x7f991412a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60302/0 (socket says 172.21.15.59:60302) 2023-09-30T22:26:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f9913fff700 1 -- 172.21.15.59:0/3065670484 learned_addr learned my addr 172.21.15.59:0/3065670484 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f9918905700 1 --2- 172.21.15.59:0/3065670484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9914125f00 0x7f991412df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f9913fff700 1 -- 172.21.15.59:0/3065670484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9914125f00 msgr2=0x7f991412df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f9913fff700 1 --2- 172.21.15.59:0/3065670484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9914125f00 0x7f991412df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f9913fff700 1 -- 172.21.15.59:0/3065670484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99141252b0 msgr2=0x7f991412da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f9913fff700 1 --2- 172.21.15.59:0/3065670484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99141252b0 0x7f991412da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f9913fff700 1 -- 172.21.15.59:0/3065670484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99040092a0 con 0x7f991406a520 2023-09-30T22:26:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f9913fff700 1 --2- 172.21.15.59:0/3065670484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f991406a520 0x7f991412a920 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f990800c4c0 tx=0x7f9908007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f98fbfff700 1 -- 172.21.15.59:0/3065670484 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800ce30 con 0x7f991406a520 2023-09-30T22:26:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f98fbfff700 1 -- 172.21.15.59:0/3065670484 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99080072e0 con 0x7f991406a520 2023-09-30T22:26:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f991a368700 1 -- 172.21.15.59:0/3065670484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990c009a20 con 0x7f991406a520 2023-09-30T22:26:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f98fbfff700 1 -- 172.21.15.59:0/3065670484 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99080057a0 con 0x7f991406a520 2023-09-30T22:26:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.731+0000 7f991a368700 1 -- 172.21.15.59:0/3065670484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991412ceb0 con 0x7f991406a520 2023-09-30T22:26:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.732+0000 7f98fbfff700 1 -- 172.21.15.59:0/3065670484 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9908005bd0 con 0x7f991406a520 2023-09-30T22:26:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.732+0000 7f98fbfff700 1 -- 172.21.15.59:0/3065670484 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f990803a1c0 con 0x7f991406a520 2023-09-30T22:26:31.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.732+0000 7f991a368700 1 -- 172.21.15.59:0/3065670484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991412ceb0 con 0x7f991406a520 2023-09-30T22:26:31.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.737+0000 7f98fbfff700 1 -- 172.21.15.59:0/3065670484 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f991412ceb0 con 0x7f991406a520 2023-09-30T22:26:31.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.912+0000 7f991a368700 1 -- 172.21.15.59:0/3065670484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f991412ceb0 con 0x7f991406a520 2023-09-30T22:26:31.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.913+0000 7f98fbfff700 1 -- 172.21.15.59:0/3065670484 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v14) v1 ==== 110+0+10 (secure 0 0 0) 0x7f991412ceb0 con 0x7f991406a520 2023-09-30T22:26:31.913 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-30T22:26:31.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.914+0000 7f991a368700 1 -- 172.21.15.59:0/3065670484 >> v1:172.21.15.59:6816/118188 conn(0x7f990002bb60 legacy=0x7f990002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.914+0000 7f991a368700 1 -- 172.21.15.59:0/3065670484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f991406a520 msgr2=0x7f991412a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.914+0000 7f991a368700 1 --2- 172.21.15.59:0/3065670484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f991406a520 0x7f991412a920 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f990800c4c0 tx=0x7f9908007c10).stop 2023-09-30T22:26:31.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.915+0000 7f991a368700 1 -- 172.21.15.59:0/3065670484 shutdown_connections 2023-09-30T22:26:31.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.915+0000 7f991a368700 1 --2- 172.21.15.59:0/3065670484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f991406a520 0x7f991412a920 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.915+0000 7f991a368700 1 --2- 172.21.15.59:0/3065670484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9914125f00 0x7f991412df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.915+0000 7f991a368700 1 --2- 172.21.15.59:0/3065670484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99141252b0 0x7f991412da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:31.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.915+0000 7f991a368700 1 -- 172.21.15.59:0/3065670484 >> 172.21.15.59:0/3065670484 conn(0x7f9914097480 msgr2=0x7f9914096950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.915+0000 7f991a368700 1 -- 172.21.15.59:0/3065670484 shutdown_connections 2023-09-30T22:26:31.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:31.915+0000 7f991a368700 1 -- 172.21.15.59:0/3065670484 wait complete. 2023-09-30T22:26:31.928 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:26:32.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.063+0000 7f6c26de2700 1 Processor -- start 2023-09-30T22:26:32.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.063+0000 7f6c26de2700 1 -- start start 2023-09-30T22:26:32.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.064+0000 7f6c26de2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c200613a0 0x7f6c2012ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:32.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.064+0000 7f6c26de2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c2012b230 0x7f6c20068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:32.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.064+0000 7f6c26de2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c200985c0 con 0x7f6c2012b610 2023-09-30T22:26:32.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.064+0000 7f6c26de2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c20061780 con 0x7f6c2012b230 2023-09-30T22:26:32.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.064+0000 7f6c26de2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c20091dd0 con 0x7f6c200613a0 2023-09-30T22:26:32.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.064+0000 7f6c1ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c2012b230 0x7f6c20068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:32.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.064+0000 7f6c24b7e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c200613a0 0x7f6c2012ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:32.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.064+0000 7f6c2537f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6c2012b610 0x7f6c20069210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54904/0 (socket says 172.21.15.59:54904) 2023-09-30T22:26:32.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.064+0000 7f6c2537f700 1 -- 172.21.15.59:0/4043181359 learned_addr learned my addr 172.21.15.59:0/4043181359 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:32.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c24b7e700 1 -- 172.21.15.59:0/4043181359 >> v2:172.21.15.59:3300/0 conn(0x7f6c2012b230 msgr2=0x7f6c20068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:32.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c24b7e700 1 --2- 172.21.15.59:0/4043181359 >> v2:172.21.15.59:3300/0 conn(0x7f6c2012b230 0x7f6c20068d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c24b7e700 1 -- 172.21.15.59:0/4043181359 >> v1:172.21.15.59:6789/0 conn(0x7f6c2012b610 legacy=0x7f6c20069210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c24b7e700 1 -- 172.21.15.59:0/4043181359 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c200996a0 con 0x7f6c200613a0 2023-09-30T22:26:32.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c1ffff700 1 --2- 172.21.15.59:0/4043181359 >> v2:172.21.15.59:3300/0 conn(0x7f6c2012b230 0x7f6c20068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c1f7fe700 1 -- 172.21.15.59:0/4043181359 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197324333 0 0) 0x7f6c200985c0 con 0x7f6c2012b610 2023-09-30T22:26:32.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c24b7e700 1 --2- 172.21.15.59:0/4043181359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c200613a0 0x7f6c2012ad40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f6c10009790 tx=0x7f6c10009060).ready entity=mon.1 client_cookie=36ef048c306bf1c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c1f7fe700 1 -- 172.21.15.59:0/4043181359 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000f510 con 0x7f6c200613a0 2023-09-30T22:26:32.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c1f7fe700 1 -- 172.21.15.59:0/4043181359 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1000f670 con 0x7f6c200613a0 2023-09-30T22:26:32.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c1f7fe700 1 -- 172.21.15.59:0/4043181359 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000f9f0 con 0x7f6c200613a0 2023-09-30T22:26:32.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c26de2700 1 -- 172.21.15.59:0/4043181359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c200613a0 msgr2=0x7f6c2012ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c26de2700 1 --2- 172.21.15.59:0/4043181359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c200613a0 0x7f6c2012ad40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f6c10009790 tx=0x7f6c10009060).stop 2023-09-30T22:26:32.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c26de2700 1 -- 172.21.15.59:0/4043181359 shutdown_connections 2023-09-30T22:26:32.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c26de2700 1 --2- 172.21.15.59:0/4043181359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c200613a0 0x7f6c2012ad40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c26de2700 1 --2- 172.21.15.59:0/4043181359 >> v2:172.21.15.59:3300/0 conn(0x7f6c2012b230 0x7f6c20068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.065+0000 7f6c26de2700 1 -- 172.21.15.59:0/4043181359 >> 172.21.15.59:0/4043181359 conn(0x7f6c2009a1c0 msgr2=0x7f6c2009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.066+0000 7f6c26de2700 1 -- 172.21.15.59:0/4043181359 shutdown_connections 2023-09-30T22:26:32.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.066+0000 7f6c26de2700 1 -- 172.21.15.59:0/4043181359 wait complete. 2023-09-30T22:26:32.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.067+0000 7f6c26de2700 1 Processor -- start 2023-09-30T22:26:32.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.067+0000 7f6c26de2700 1 -- start start 2023-09-30T22:26:32.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c26de2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c200613a0 0x7f6c201153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c26de2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c2012b230 0x7f6c201158d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c26de2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2012b610 0x7f6c2013a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c26de2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c20118510 con 0x7f6c2012b610 2023-09-30T22:26:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c26de2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200938f0 con 0x7f6c2012b230 2023-09-30T22:26:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c26de2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c201181c0 con 0x7f6c200613a0 2023-09-30T22:26:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c24b7e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c200613a0 0x7f6c201153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c2537f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2012b610 0x7f6c2013a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c1ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c2012b230 0x7f6c201158d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c2537f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2012b610 0x7f6c2013a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36272/0 (socket says 172.21.15.59:36272) 2023-09-30T22:26:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c2537f700 1 -- 172.21.15.59:0/891860125 learned_addr learned my addr 172.21.15.59:0/891860125 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c24b7e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c200613a0 0x7f6c201153e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60314/0 (socket says 172.21.15.59:60314) 2023-09-30T22:26:32.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c1ffff700 1 -- 172.21.15.59:0/891860125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c200613a0 msgr2=0x7f6c201153e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c1ffff700 1 --2- 172.21.15.59:0/891860125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c200613a0 0x7f6c201153e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c1ffff700 1 -- 172.21.15.59:0/891860125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2012b610 msgr2=0x7f6c2013a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c1ffff700 1 --2- 172.21.15.59:0/891860125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2012b610 0x7f6c2013a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c1ffff700 1 -- 172.21.15.59:0/891860125 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c080092a0 con 0x7f6c2012b230 2023-09-30T22:26:32.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c24b7e700 1 --2- 172.21.15.59:0/891860125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c200613a0 0x7f6c201153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c2537f700 1 --2- 172.21.15.59:0/891860125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2012b610 0x7f6c2013a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.068+0000 7f6c1ffff700 1 --2- 172.21.15.59:0/891860125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c2012b230 0x7f6c201158d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6c0800e950 tx=0x7f6c08009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.069+0000 7f6c1cff9700 1 -- 172.21.15.59:0/891860125 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c08012600 con 0x7f6c2012b230 2023-09-30T22:26:32.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.069+0000 7f6c1cff9700 1 -- 172.21.15.59:0/891860125 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c08012760 con 0x7f6c2012b230 2023-09-30T22:26:32.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.069+0000 7f6c26de2700 1 -- 172.21.15.59:0/891860125 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c100092a0 con 0x7f6c2012b230 2023-09-30T22:26:32.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.069+0000 7f6c1cff9700 1 -- 172.21.15.59:0/891860125 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c08012b00 con 0x7f6c2012b230 2023-09-30T22:26:32.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.069+0000 7f6c26de2700 1 -- 172.21.15.59:0/891860125 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c201151a0 con 0x7f6c2012b230 2023-09-30T22:26:32.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.069+0000 7f6c1cff9700 1 -- 172.21.15.59:0/891860125 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6c0801b400 con 0x7f6c2012b230 2023-09-30T22:26:32.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.070+0000 7f6c1cff9700 1 -- 172.21.15.59:0/891860125 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f6c0803af80 con 0x7f6c2012b230 2023-09-30T22:26:32.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.070+0000 7f6c26de2700 1 -- 172.21.15.59:0/891860125 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c201151a0 con 0x7f6c2012b230 2023-09-30T22:26:32.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.074+0000 7f6c1cff9700 1 -- 172.21.15.59:0/891860125 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6c201151a0 con 0x7f6c2012b230 2023-09-30T22:26:32.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.247+0000 7f6c26de2700 1 -- 172.21.15.59:0/891860125 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6c201151a0 con 0x7f6c2012b230 2023-09-30T22:26:32.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.248+0000 7f6c1cff9700 1 -- 172.21.15.59:0/891860125 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v14) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6c201151a0 con 0x7f6c2012b230 2023-09-30T22:26:32.248 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-09-30T22:26:32.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.250+0000 7f6c26de2700 1 -- 172.21.15.59:0/891860125 >> v1:172.21.15.59:6816/118188 conn(0x7f6c0002bb60 legacy=0x7f6c0002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.250+0000 7f6c26de2700 1 -- 172.21.15.59:0/891860125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c2012b230 msgr2=0x7f6c201158d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.250+0000 7f6c26de2700 1 --2- 172.21.15.59:0/891860125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c2012b230 0x7f6c201158d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6c0800e950 tx=0x7f6c08009060).stop 2023-09-30T22:26:32.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.250+0000 7f6c26de2700 1 -- 172.21.15.59:0/891860125 shutdown_connections 2023-09-30T22:26:32.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.250+0000 7f6c26de2700 1 --2- 172.21.15.59:0/891860125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c200613a0 0x7f6c201153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.250+0000 7f6c26de2700 1 --2- 172.21.15.59:0/891860125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c2012b610 0x7f6c2013a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.250+0000 7f6c26de2700 1 --2- 172.21.15.59:0/891860125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c2012b230 0x7f6c201158d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.250+0000 7f6c26de2700 1 -- 172.21.15.59:0/891860125 >> 172.21.15.59:0/891860125 conn(0x7f6c2009a1c0 msgr2=0x7f6c20066b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.250+0000 7f6c26de2700 1 -- 172.21.15.59:0/891860125 shutdown_connections 2023-09-30T22:26:32.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.250+0000 7f6c26de2700 1 -- 172.21.15.59:0/891860125 wait complete. 2023-09-30T22:26:32.263 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T22:26:32.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.393+0000 7f6025946700 1 Processor -- start 2023-09-30T22:26:32.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.393+0000 7f6025946700 1 -- start start 2023-09-30T22:26:32.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.394+0000 7f6025946700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200965e0 0x7f60200969c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:32.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.394+0000 7f6025946700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6020096eb0 0x7f6020067de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:32.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.394+0000 7f6025946700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60200933b0 con 0x7f60200682d0 2023-09-30T22:26:32.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.394+0000 7f6025946700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6020092190 con 0x7f6020096eb0 2023-09-30T22:26:32.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.394+0000 7f6025946700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6020069a20 con 0x7f60200965e0 2023-09-30T22:26:32.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.394+0000 7f601effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200965e0 0x7f60200969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:32.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.394+0000 7f601f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f60200682d0 0x7f602012ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54918/0 (socket says 172.21.15.59:54918) 2023-09-30T22:26:32.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.394+0000 7f601f7fe700 1 -- 172.21.15.59:0/678561318 learned_addr learned my addr 172.21.15.59:0/678561318 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:32.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.394+0000 7f601e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6020096eb0 0x7f6020067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:32.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.395+0000 7f601dffb700 1 -- 172.21.15.59:0/678561318 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283312774 0 0) 0x7f60200933b0 con 0x7f60200682d0 2023-09-30T22:26:32.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.395+0000 7f601dffb700 1 -- 172.21.15.59:0/678561318 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f600c0033f0 con 0x7f60200682d0 2023-09-30T22:26:32.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.395+0000 7f601e7fc700 1 -- 172.21.15.59:0/678561318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200965e0 msgr2=0x7f60200969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:32.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.395+0000 7f601e7fc700 1 --2- 172.21.15.59:0/678561318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200965e0 0x7f60200969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.395+0000 7f601e7fc700 1 -- 172.21.15.59:0/678561318 >> v1:172.21.15.59:6789/0 conn(0x7f60200682d0 legacy=0x7f602012ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.395+0000 7f601e7fc700 1 -- 172.21.15.59:0/678561318 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6020069ca0 con 0x7f6020096eb0 2023-09-30T22:26:32.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.395+0000 7f601effd700 1 --2- 172.21.15.59:0/678561318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200965e0 0x7f60200969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.395+0000 7f601e7fc700 1 --2- 172.21.15.59:0/678561318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6020096eb0 0x7f6020067de0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f6008009790 tx=0x7f6008009060).ready entity=mon.1 client_cookie=348cc7b0bae2055e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.395+0000 7f601dffb700 1 -- 172.21.15.59:0/678561318 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600800f510 con 0x7f6020096eb0 2023-09-30T22:26:32.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.395+0000 7f601dffb700 1 -- 172.21.15.59:0/678561318 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600800f670 con 0x7f6020096eb0 2023-09-30T22:26:32.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.395+0000 7f601dffb700 1 -- 172.21.15.59:0/678561318 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600800f9f0 con 0x7f6020096eb0 2023-09-30T22:26:32.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.396+0000 7f6025946700 1 -- 172.21.15.59:0/678561318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6020096eb0 msgr2=0x7f6020067de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.396+0000 7f6025946700 1 --2- 172.21.15.59:0/678561318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6020096eb0 0x7f6020067de0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f6008009790 tx=0x7f6008009060).stop 2023-09-30T22:26:32.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.396+0000 7f6025946700 1 -- 172.21.15.59:0/678561318 shutdown_connections 2023-09-30T22:26:32.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.396+0000 7f6025946700 1 --2- 172.21.15.59:0/678561318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200965e0 0x7f60200969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.396+0000 7f6025946700 1 --2- 172.21.15.59:0/678561318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6020096eb0 0x7f6020067de0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.396+0000 7f6025946700 1 -- 172.21.15.59:0/678561318 >> 172.21.15.59:0/678561318 conn(0x7f602009a220 msgr2=0x7f602009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.396+0000 7f6025946700 1 -- 172.21.15.59:0/678561318 shutdown_connections 2023-09-30T22:26:32.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.396+0000 7f6025946700 1 -- 172.21.15.59:0/678561318 wait complete. 2023-09-30T22:26:32.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.397+0000 7f6025946700 1 Processor -- start 2023-09-30T22:26:32.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.397+0000 7f6025946700 1 -- start start 2023-09-30T22:26:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.397+0000 7f6025946700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200682d0 0x7f6020116450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.397+0000 7f6025946700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60200965e0 0x7f6020116940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.397+0000 7f6025946700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6020096eb0 0x7f6020116e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.397+0000 7f6025946700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6020119330 con 0x7f6020096eb0 2023-09-30T22:26:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.397+0000 7f6025946700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60201161b0 con 0x7f60200965e0 2023-09-30T22:26:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.397+0000 7f6025946700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6020066d10 con 0x7f60200682d0 2023-09-30T22:26:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.397+0000 7f601effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200682d0 0x7f6020116450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.397+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6020096eb0 0x7f6020116e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.397+0000 7f601effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200682d0 0x7f6020116450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60340/0 (socket says 172.21.15.59:60340) 2023-09-30T22:26:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.397+0000 7f601effd700 1 -- 172.21.15.59:0/3207497076 learned_addr learned my addr 172.21.15.59:0/3207497076 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.397+0000 7f601e7fc700 1 --2- 172.21.15.59:0/3207497076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60200965e0 0x7f6020116940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.398+0000 7f601e7fc700 1 -- 172.21.15.59:0/3207497076 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200682d0 msgr2=0x7f6020116450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.398+0000 7f601e7fc700 1 --2- 172.21.15.59:0/3207497076 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200682d0 0x7f6020116450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.398+0000 7f601e7fc700 1 -- 172.21.15.59:0/3207497076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6020096eb0 msgr2=0x7f6020116e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.398+0000 7f601e7fc700 1 --2- 172.21.15.59:0/3207497076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6020096eb0 0x7f6020116e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.398+0000 7f601e7fc700 1 -- 172.21.15.59:0/3207497076 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60100092a0 con 0x7f60200965e0 2023-09-30T22:26:32.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.398+0000 7f601effd700 1 --2- 172.21.15.59:0/3207497076 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200682d0 0x7f6020116450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.398+0000 7f601e7fc700 1 --2- 172.21.15.59:0/3207497076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60200965e0 0x7f6020116940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f6008014000 tx=0x7f6008017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.398+0000 7f6016ffd700 1 -- 172.21.15.59:0/3207497076 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600800f7e0 con 0x7f60200965e0 2023-09-30T22:26:32.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.398+0000 7f6016ffd700 1 -- 172.21.15.59:0/3207497076 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600800f940 con 0x7f60200965e0 2023-09-30T22:26:32.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.398+0000 7f6025946700 1 -- 172.21.15.59:0/3207497076 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60080092a0 con 0x7f60200965e0 2023-09-30T22:26:32.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.398+0000 7f6016ffd700 1 -- 172.21.15.59:0/3207497076 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600801c670 con 0x7f60200965e0 2023-09-30T22:26:32.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.398+0000 7f6025946700 1 -- 172.21.15.59:0/3207497076 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6020119fb0 con 0x7f60200965e0 2023-09-30T22:26:32.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.399+0000 7f6016ffd700 1 -- 172.21.15.59:0/3207497076 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f600801c9e0 con 0x7f60200965e0 2023-09-30T22:26:32.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.399+0000 7f6016ffd700 1 -- 172.21.15.59:0/3207497076 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f600803c1b0 con 0x7f60200965e0 2023-09-30T22:26:32.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.399+0000 7f6025946700 1 -- 172.21.15.59:0/3207497076 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60200660c0 con 0x7f60200965e0 2023-09-30T22:26:32.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.404+0000 7f6016ffd700 1 -- 172.21.15.59:0/3207497076 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6008020020 con 0x7f60200965e0 2023-09-30T22:26:32.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.583+0000 7f6025946700 1 -- 172.21.15.59:0/3207497076 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f602005a260 con 0x7f60200965e0 2023-09-30T22:26:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.584+0000 7f6016ffd700 1 -- 172.21.15.59:0/3207497076 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v14) v1 ==== 84+0+143 (secure 0 0 0) 0x7f60080222c0 con 0x7f60200965e0 2023-09-30T22:26:32.584 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:32.584 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2023-09-30T22:26:32.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:26:32.584 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2023-09-30T22:26:32.584 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": "device_health_metrics" 2023-09-30T22:26:32.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:26:32.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:26:32.585 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 2, 2023-09-30T22:26:32.585 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": "rbd" 2023-09-30T22:26:32.585 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:26:32.585 INFO:teuthology.orchestra.run.smithi059.stdout:] 2023-09-30T22:26:32.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.585+0000 7f6025946700 1 -- 172.21.15.59:0/3207497076 >> v1:172.21.15.59:6816/118188 conn(0x7f600002bb60 legacy=0x7f600002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.585+0000 7f6025946700 1 -- 172.21.15.59:0/3207497076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60200965e0 msgr2=0x7f6020116940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.585+0000 7f6025946700 1 --2- 172.21.15.59:0/3207497076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60200965e0 0x7f6020116940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f6008014000 tx=0x7f6008017000).stop 2023-09-30T22:26:32.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.586+0000 7f6025946700 1 -- 172.21.15.59:0/3207497076 shutdown_connections 2023-09-30T22:26:32.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.586+0000 7f6025946700 1 --2- 172.21.15.59:0/3207497076 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200682d0 0x7f6020116450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.586+0000 7f6025946700 1 --2- 172.21.15.59:0/3207497076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6020096eb0 0x7f6020116e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.586+0000 7f6025946700 1 --2- 172.21.15.59:0/3207497076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60200965e0 0x7f6020116940 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.586+0000 7f6025946700 1 -- 172.21.15.59:0/3207497076 >> 172.21.15.59:0/3207497076 conn(0x7f602009a220 msgr2=0x7f6020099000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.586+0000 7f6025946700 1 -- 172.21.15.59:0/3207497076 shutdown_connections 2023-09-30T22:26:32.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.586+0000 7f6025946700 1 -- 172.21.15.59:0/3207497076 wait complete. 2023-09-30T22:26:32.599 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T22:26:32.599 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T22:26:32.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.733+0000 7f0f62d88700 1 Processor -- start 2023-09-30T22:26:32.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.733+0000 7f0f62d88700 1 -- start start 2023-09-30T22:26:32.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.733+0000 7f0f62d88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5c059070 0x7f0f5c1277f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:32.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.733+0000 7f0f62d88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f5c1280e0 0x7f0f5c12b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:32.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.733+0000 7f0f62d88700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5c092b60 con 0x7f0f5c127ce0 2023-09-30T22:26:32.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.733+0000 7f0f62d88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c059450 con 0x7f0f5c059070 2023-09-30T22:26:32.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.733+0000 7f0f62d88700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c091c10 con 0x7f0f5c1280e0 2023-09-30T22:26:32.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.733+0000 7f0f61325700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f5c1280e0 0x7f0f5c12b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:32.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.733+0000 7f0f5bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0f5c127ce0 0x7f0f5c12a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54934/0 (socket says 172.21.15.59:54934) 2023-09-30T22:26:32.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.733+0000 7f0f5bfff700 1 -- 172.21.15.59:0/3205208947 learned_addr learned my addr 172.21.15.59:0/3205208947 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:32.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.733+0000 7f0f60b24700 1 --2- 172.21.15.59:0/3205208947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5c059070 0x7f0f5c1277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:32.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.734+0000 7f0f5b7fe700 1 -- 172.21.15.59:0/3205208947 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780032452 0 0) 0x7f0f5c092b60 con 0x7f0f5c127ce0 2023-09-30T22:26:32.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.734+0000 7f0f61325700 1 -- 172.21.15.59:0/3205208947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5c059070 msgr2=0x7f0f5c1277f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:32.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.734+0000 7f0f61325700 1 --2- 172.21.15.59:0/3205208947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5c059070 0x7f0f5c1277f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.734+0000 7f0f61325700 1 -- 172.21.15.59:0/3205208947 >> v1:172.21.15.59:6789/0 conn(0x7f0f5c127ce0 legacy=0x7f0f5c12a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.734+0000 7f0f61325700 1 -- 172.21.15.59:0/3205208947 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c096810 con 0x7f0f5c1280e0 2023-09-30T22:26:32.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.734+0000 7f0f60b24700 1 --2- 172.21.15.59:0/3205208947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5c059070 0x7f0f5c1277f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.734+0000 7f0f61325700 1 --2- 172.21.15.59:0/3205208947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f5c1280e0 0x7f0f5c12b0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0f54009e90 tx=0x7f0f54009780).ready entity=mon.2 client_cookie=37afe4129a8e2144 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.734+0000 7f0f5b7fe700 1 -- 172.21.15.59:0/3205208947 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400e070 con 0x7f0f5c1280e0 2023-09-30T22:26:32.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.734+0000 7f0f5b7fe700 1 -- 172.21.15.59:0/3205208947 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5400bb00 con 0x7f0f5c1280e0 2023-09-30T22:26:32.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.734+0000 7f0f5b7fe700 1 -- 172.21.15.59:0/3205208947 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400be80 con 0x7f0f5c1280e0 2023-09-30T22:26:32.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.735+0000 7f0f62d88700 1 -- 172.21.15.59:0/3205208947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f5c1280e0 msgr2=0x7f0f5c12b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.735+0000 7f0f62d88700 1 --2- 172.21.15.59:0/3205208947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f5c1280e0 0x7f0f5c12b0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0f54009e90 tx=0x7f0f54009780).stop 2023-09-30T22:26:32.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.735+0000 7f0f62d88700 1 -- 172.21.15.59:0/3205208947 shutdown_connections 2023-09-30T22:26:32.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.735+0000 7f0f62d88700 1 --2- 172.21.15.59:0/3205208947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f5c1280e0 0x7f0f5c12b0b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.735+0000 7f0f62d88700 1 --2- 172.21.15.59:0/3205208947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5c059070 0x7f0f5c1277f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.735+0000 7f0f62d88700 1 -- 172.21.15.59:0/3205208947 >> 172.21.15.59:0/3205208947 conn(0x7f0f5c097560 msgr2=0x7f0f5c097970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.735+0000 7f0f62d88700 1 -- 172.21.15.59:0/3205208947 shutdown_connections 2023-09-30T22:26:32.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.735+0000 7f0f62d88700 1 -- 172.21.15.59:0/3205208947 wait complete. 2023-09-30T22:26:32.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.735+0000 7f0f62d88700 1 Processor -- start 2023-09-30T22:26:32.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.736+0000 7f0f62d88700 1 -- start start 2023-09-30T22:26:32.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.736+0000 7f0f62d88700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f5c059070 0x7f0f5c1139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:32.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.736+0000 7f0f62d88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5c127ce0 0x7f0f5c113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:32.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.736+0000 7f0f62d88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f5c1280e0 0x7f0f5c114380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:32.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.736+0000 7f0f62d88700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0936e0 con 0x7f0f5c059070 2023-09-30T22:26:32.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.736+0000 7f0f62d88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c096ef0 con 0x7f0f5c127ce0 2023-09-30T22:26:32.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.736+0000 7f0f62d88700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c124fd0 con 0x7f0f5c1280e0 2023-09-30T22:26:32.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.736+0000 7f0f61325700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f5c1280e0 0x7f0f5c114380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:32.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.736+0000 7f0f5bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5c127ce0 0x7f0f5c113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:32.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.736+0000 7f0f60b24700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f5c059070 0x7f0f5c1139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:32.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.736+0000 7f0f61325700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f5c1280e0 0x7f0f5c114380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60352/0 (socket says 172.21.15.59:60352) 2023-09-30T22:26:32.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.736+0000 7f0f60b24700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f5c059070 0x7f0f5c1139a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36284/0 (socket says 172.21.15.59:36284) 2023-09-30T22:26:32.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.736+0000 7f0f61325700 1 -- 172.21.15.59:0/1645527270 learned_addr learned my addr 172.21.15.59:0/1645527270 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:32.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.737+0000 7f0f5bfff700 1 -- 172.21.15.59:0/1645527270 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f5c1280e0 msgr2=0x7f0f5c114380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.737+0000 7f0f5bfff700 1 --2- 172.21.15.59:0/1645527270 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f5c1280e0 0x7f0f5c114380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.737+0000 7f0f5bfff700 1 -- 172.21.15.59:0/1645527270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f5c059070 msgr2=0x7f0f5c1139a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.737+0000 7f0f5bfff700 1 --2- 172.21.15.59:0/1645527270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f5c059070 0x7f0f5c1139a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:32.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.737+0000 7f0f5bfff700 1 -- 172.21.15.59:0/1645527270 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c0092a0 con 0x7f0f5c127ce0 2023-09-30T22:26:32.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.737+0000 7f0f61325700 1 --2- 172.21.15.59:0/1645527270 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f5c1280e0 0x7f0f5c114380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.737+0000 7f0f60b24700 1 --2- 172.21.15.59:0/1645527270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f5c059070 0x7f0f5c1139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.737+0000 7f0f5bfff700 1 --2- 172.21.15.59:0/1645527270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5c127ce0 0x7f0f5c113e90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f0f5c063d30 tx=0x7f0f44007bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.737+0000 7f0f58ff9700 1 -- 172.21.15.59:0/1645527270 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f440070d0 con 0x7f0f5c127ce0 2023-09-30T22:26:32.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.737+0000 7f0f58ff9700 1 -- 172.21.15.59:0/1645527270 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f44007250 con 0x7f0f5c127ce0 2023-09-30T22:26:32.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.737+0000 7f0f62d88700 1 -- 172.21.15.59:0/1645527270 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f54009a20 con 0x7f0f5c127ce0 2023-09-30T22:26:32.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.737+0000 7f0f58ff9700 1 -- 172.21.15.59:0/1645527270 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44007610 con 0x7f0f5c127ce0 2023-09-30T22:26:32.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.737+0000 7f0f62d88700 1 -- 172.21.15.59:0/1645527270 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c117d70 con 0x7f0f5c127ce0 2023-09-30T22:26:32.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.738+0000 7f0f58ff9700 1 -- 172.21.15.59:0/1645527270 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0f440059b0 con 0x7f0f5c127ce0 2023-09-30T22:26:32.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.738+0000 7f0f58ff9700 1 -- 172.21.15.59:0/1645527270 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f0f4403a130 con 0x7f0f5c127ce0 2023-09-30T22:26:32.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.738+0000 7f0f62d88700 1 -- 172.21.15.59:0/1645527270 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c117d70 con 0x7f0f5c127ce0 2023-09-30T22:26:32.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.743+0000 7f0f58ff9700 1 -- 172.21.15.59:0/1645527270 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0f5c117d70 con 0x7f0f5c127ce0 2023-09-30T22:26:32.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.917+0000 7f0f62d88700 1 -- 172.21.15.59:0/1645527270 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0f5c117d70 con 0x7f0f5c127ce0 2023-09-30T22:26:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:32.996+0000 7f0f58ff9700 1 -- 172.21.15.59:0/1645527270 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v15) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0f5c117d70 con 0x7f0f5c127ce0 2023-09-30T22:26:33.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.000+0000 7f0f62d88700 1 -- 172.21.15.59:0/1645527270 >> v1:172.21.15.59:6816/118188 conn(0x7f0f3c02bb60 legacy=0x7f0f3c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.000+0000 7f0f62d88700 1 -- 172.21.15.59:0/1645527270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5c127ce0 msgr2=0x7f0f5c113e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.000+0000 7f0f62d88700 1 --2- 172.21.15.59:0/1645527270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5c127ce0 0x7f0f5c113e90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f0f5c063d30 tx=0x7f0f44007bb0).stop 2023-09-30T22:26:33.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.000+0000 7f0f62d88700 1 -- 172.21.15.59:0/1645527270 shutdown_connections 2023-09-30T22:26:33.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.000+0000 7f0f62d88700 1 --2- 172.21.15.59:0/1645527270 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f5c1280e0 0x7f0f5c114380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:33.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.000+0000 7f0f62d88700 1 --2- 172.21.15.59:0/1645527270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f5c059070 0x7f0f5c1139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:33.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.000+0000 7f0f62d88700 1 --2- 172.21.15.59:0/1645527270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5c127ce0 0x7f0f5c113e90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:33.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.000+0000 7f0f62d88700 1 -- 172.21.15.59:0/1645527270 >> 172.21.15.59:0/1645527270 conn(0x7f0f5c097560 msgr2=0x7f0f5c129d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:33.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.001+0000 7f0f62d88700 1 -- 172.21.15.59:0/1645527270 shutdown_connections 2023-09-30T22:26:33.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.001+0000 7f0f62d88700 1 -- 172.21.15.59:0/1645527270 wait complete. 2023-09-30T22:26:33.006 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2023-09-30T22:26:33.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T22:26:33.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.154+0000 7f4999ccb700 1 Processor -- start 2023-09-30T22:26:33.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.154+0000 7f4999ccb700 1 -- start start 2023-09-30T22:26:33.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.154+0000 7f4999ccb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4994067e90 0x7f4994068270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:33.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f4999ccb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49941282b0 0x7f499412fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:33.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f4999ccb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49940690b0 con 0x7f4994068760 2023-09-30T22:26:33.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f4999ccb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49940920e0 con 0x7f4994067e90 2023-09-30T22:26:33.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f4999ccb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4994092330 con 0x7f49941282b0 2023-09-30T22:26:33.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f49937fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4994067e90 0x7f4994068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:33.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f4992ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4994068760 0x7f4994127ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54946/0 (socket says 172.21.15.59:54946) 2023-09-30T22:26:33.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f4993fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49941282b0 0x7f499412fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:33.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f4992ffd700 1 -- 172.21.15.59:0/3958786100 learned_addr learned my addr 172.21.15.59:0/3958786100 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f49937fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4994067e90 0x7f4994068270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46294/0 (socket says 172.21.15.59:46294) 2023-09-30T22:26:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f49937fe700 1 -- 172.21.15.59:0/3958786100 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49941282b0 msgr2=0x7f499412fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f49927fc700 1 -- 172.21.15.59:0/3958786100 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999750469 0 0) 0x7f49940690b0 con 0x7f4994068760 2023-09-30T22:26:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f49937fe700 1 --2- 172.21.15.59:0/3958786100 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49941282b0 0x7f499412fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f49937fe700 1 -- 172.21.15.59:0/3958786100 >> v1:172.21.15.59:6789/0 conn(0x7f4994068760 legacy=0x7f4994127ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f49937fe700 1 -- 172.21.15.59:0/3958786100 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4994069b20 con 0x7f4994067e90 2023-09-30T22:26:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f4993fff700 1 --2- 172.21.15.59:0/3958786100 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49941282b0 0x7f499412fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f49937fe700 1 --2- 172.21.15.59:0/3958786100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4994067e90 0x7f4994068270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f497c00c8b0 tx=0x7f497c0090f0).ready entity=mon.1 client_cookie=b3b061bf3304055d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f49927fc700 1 -- 172.21.15.59:0/3958786100 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c00b790 con 0x7f4994067e90 2023-09-30T22:26:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f49927fc700 1 -- 172.21.15.59:0/3958786100 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c00b8f0 con 0x7f4994067e90 2023-09-30T22:26:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.155+0000 7f49927fc700 1 -- 172.21.15.59:0/3958786100 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c00bc70 con 0x7f4994067e90 2023-09-30T22:26:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.156+0000 7f4999ccb700 1 -- 172.21.15.59:0/3958786100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4994067e90 msgr2=0x7f4994068270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.156+0000 7f4999ccb700 1 --2- 172.21.15.59:0/3958786100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4994067e90 0x7f4994068270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f497c00c8b0 tx=0x7f497c0090f0).stop 2023-09-30T22:26:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.156+0000 7f4999ccb700 1 -- 172.21.15.59:0/3958786100 shutdown_connections 2023-09-30T22:26:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.156+0000 7f4999ccb700 1 --2- 172.21.15.59:0/3958786100 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49941282b0 0x7f499412fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.156+0000 7f4999ccb700 1 --2- 172.21.15.59:0/3958786100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4994067e90 0x7f4994068270 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.156+0000 7f4999ccb700 1 -- 172.21.15.59:0/3958786100 >> 172.21.15.59:0/3958786100 conn(0x7f499409a3d0 msgr2=0x7f499409a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.156+0000 7f4999ccb700 1 -- 172.21.15.59:0/3958786100 shutdown_connections 2023-09-30T22:26:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.156+0000 7f4999ccb700 1 -- 172.21.15.59:0/3958786100 wait complete. 2023-09-30T22:26:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.158+0000 7f4999ccb700 1 Processor -- start 2023-09-30T22:26:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.158+0000 7f4999ccb700 1 -- start start 2023-09-30T22:26:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.158+0000 7f4999ccb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4994067e90 0x7f4994119390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.158+0000 7f4999ccb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4994068760 0x7f49941153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.158+0000 7f4999ccb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49941282b0 0x7f49941158a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:33.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.158+0000 7f4999ccb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49941274d0 con 0x7f4994067e90 2023-09-30T22:26:33.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.158+0000 7f4999ccb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4994118e90 con 0x7f49941282b0 2023-09-30T22:26:33.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.158+0000 7f4999ccb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4994066e20 con 0x7f4994068760 2023-09-30T22:26:33.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.158+0000 7f4992ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4994068760 0x7f49941153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:33.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.158+0000 7f49937fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4994067e90 0x7f4994119390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:33.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.158+0000 7f4993fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49941282b0 0x7f49941158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:33.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.158+0000 7f49937fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4994067e90 0x7f4994119390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36298/0 (socket says 172.21.15.59:36298) 2023-09-30T22:26:33.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.159+0000 7f49937fe700 1 -- 172.21.15.59:0/4019287373 learned_addr learned my addr 172.21.15.59:0/4019287373 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:33.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.158+0000 7f4993fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49941282b0 0x7f49941158a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46304/0 (socket says 172.21.15.59:46304) 2023-09-30T22:26:33.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.159+0000 7f4992ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4994068760 0x7f49941153b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60364/0 (socket says 172.21.15.59:60364) 2023-09-30T22:26:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.159+0000 7f4992ffd700 1 -- 172.21.15.59:0/4019287373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49941282b0 msgr2=0x7f49941158a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.159+0000 7f4992ffd700 1 --2- 172.21.15.59:0/4019287373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49941282b0 0x7f49941158a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.159+0000 7f4992ffd700 1 -- 172.21.15.59:0/4019287373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4994067e90 msgr2=0x7f4994119390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.159+0000 7f4992ffd700 1 --2- 172.21.15.59:0/4019287373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4994067e90 0x7f4994119390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.159+0000 7f4992ffd700 1 -- 172.21.15.59:0/4019287373 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c00de30 con 0x7f4994068760 2023-09-30T22:26:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.159+0000 7f4993fff700 1 --2- 172.21.15.59:0/4019287373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49941282b0 0x7f49941158a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.159+0000 7f49937fe700 1 --2- 172.21.15.59:0/4019287373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4994067e90 0x7f4994119390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.159+0000 7f4992ffd700 1 --2- 172.21.15.59:0/4019287373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4994068760 0x7f49941153b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4984000c00 tx=0x7f4984007b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.159+0000 7f498b7fe700 1 -- 172.21.15.59:0/4019287373 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49840070d0 con 0x7f4994068760 2023-09-30T22:26:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.159+0000 7f498b7fe700 1 -- 172.21.15.59:0/4019287373 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4984007250 con 0x7f4994068760 2023-09-30T22:26:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.159+0000 7f4999ccb700 1 -- 172.21.15.59:0/4019287373 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497c00c3c0 con 0x7f4994068760 2023-09-30T22:26:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.159+0000 7f498b7fe700 1 -- 172.21.15.59:0/4019287373 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984007610 con 0x7f4994068760 2023-09-30T22:26:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.159+0000 7f4999ccb700 1 -- 172.21.15.59:0/4019287373 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4994116f80 con 0x7f4994068760 2023-09-30T22:26:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.160+0000 7f498b7fe700 1 -- 172.21.15.59:0/4019287373 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f49840059b0 con 0x7f4994068760 2023-09-30T22:26:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.160+0000 7f498b7fe700 1 -- 172.21.15.59:0/4019287373 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3208+0+0 (secure 0 0 0) 0x7f498403a3c0 con 0x7f4994068760 2023-09-30T22:26:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.160+0000 7f4999ccb700 1 -- 172.21.15.59:0/4019287373 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49940999d0 con 0x7f4994068760 2023-09-30T22:26:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.165+0000 7f498b7fe700 1 -- 172.21.15.59:0/4019287373 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4984013970 con 0x7f4994068760 2023-09-30T22:26:33.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:33.343+0000 7f4999ccb700 1 -- 172.21.15.59:0/4019287373 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4994118ab0 con 0x7f4994068760 2023-09-30T22:26:34.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.010+0000 7f498b7fe700 1 -- 172.21.15.59:0/4019287373 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v16) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4984010300 con 0x7f4994068760 2023-09-30T22:26:34.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.016+0000 7f4999ccb700 1 -- 172.21.15.59:0/4019287373 >> v1:172.21.15.59:6816/118188 conn(0x7f497402bb60 legacy=0x7f497402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.016+0000 7f4999ccb700 1 -- 172.21.15.59:0/4019287373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4994068760 msgr2=0x7f49941153b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.016+0000 7f4999ccb700 1 --2- 172.21.15.59:0/4019287373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4994068760 0x7f49941153b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4984000c00 tx=0x7f4984007b90).stop 2023-09-30T22:26:34.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.016+0000 7f4999ccb700 1 -- 172.21.15.59:0/4019287373 shutdown_connections 2023-09-30T22:26:34.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.016+0000 7f4999ccb700 1 --2- 172.21.15.59:0/4019287373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49941282b0 0x7f49941158a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.016+0000 7f4999ccb700 1 --2- 172.21.15.59:0/4019287373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4994067e90 0x7f4994119390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.016+0000 7f4999ccb700 1 --2- 172.21.15.59:0/4019287373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4994068760 0x7f49941153b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.016+0000 7f4999ccb700 1 -- 172.21.15.59:0/4019287373 >> 172.21.15.59:0/4019287373 conn(0x7f499409a3d0 msgr2=0x7f4994096ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.018+0000 7f4999ccb700 1 -- 172.21.15.59:0/4019287373 shutdown_connections 2023-09-30T22:26:34.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.018+0000 7f4999ccb700 1 -- 172.21.15.59:0/4019287373 wait complete. 2023-09-30T22:26:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2023-09-30T22:26:34.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T22:26:34.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.183+0000 7f162cb7e700 1 Processor -- start 2023-09-30T22:26:34.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.183+0000 7f162cb7e700 1 -- start start 2023-09-30T22:26:34.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f162cb7e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16281281a0 0x7f162812fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:34.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f162cb7e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1628127550 0x7f1628132260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:34.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f162cb7e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1628099c00 con 0x7f1628059070 2023-09-30T22:26:34.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f162cb7e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162809a280 con 0x7f1628127550 2023-09-30T22:26:34.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f162cb7e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1628091ed0 con 0x7f16281281a0 2023-09-30T22:26:34.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f1626d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1628127550 0x7f1628132260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:34.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f1625d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16281281a0 0x7f162812fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:34.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f162659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1628059070 0x7f1628127a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54954/0 (socket says 172.21.15.59:54954) 2023-09-30T22:26:34.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f1626d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1628127550 0x7f1628132260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36308/0 (socket says 172.21.15.59:36308) 2023-09-30T22:26:34.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f1625d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16281281a0 0x7f162812fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46310/0 (socket says 172.21.15.59:46310) 2023-09-30T22:26:34.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f162659c700 1 -- 172.21.15.59:0/343219392 learned_addr learned my addr 172.21.15.59:0/343219392 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:34.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f1625d9b700 1 -- 172.21.15.59:0/343219392 >> v2:172.21.15.59:3300/0 conn(0x7f1628127550 msgr2=0x7f1628132260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:34.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f1625d9b700 1 --2- 172.21.15.59:0/343219392 >> v2:172.21.15.59:3300/0 conn(0x7f1628127550 0x7f1628132260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f1625d9b700 1 -- 172.21.15.59:0/343219392 >> v1:172.21.15.59:6789/0 conn(0x7f1628059070 legacy=0x7f1628127a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f1625d9b700 1 -- 172.21.15.59:0/343219392 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16280999a0 con 0x7f16281281a0 2023-09-30T22:26:34.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f162559a700 1 -- 172.21.15.59:0/343219392 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161614088 0 0) 0x7f1628099c00 con 0x7f1628059070 2023-09-30T22:26:34.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.184+0000 7f1626d9d700 1 --2- 172.21.15.59:0/343219392 >> v2:172.21.15.59:3300/0 conn(0x7f1628127550 0x7f1628132260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:34.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.185+0000 7f1625d9b700 1 --2- 172.21.15.59:0/343219392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16281281a0 0x7f162812fd60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f1610009760 tx=0x7f1610009060).ready entity=mon.1 client_cookie=35ab9bbfd44effda server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.185+0000 7f162559a700 1 -- 172.21.15.59:0/343219392 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16100090d0 con 0x7f16281281a0 2023-09-30T22:26:34.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.185+0000 7f162559a700 1 -- 172.21.15.59:0/343219392 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161000f510 con 0x7f16281281a0 2023-09-30T22:26:34.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.185+0000 7f162559a700 1 -- 172.21.15.59:0/343219392 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000f890 con 0x7f16281281a0 2023-09-30T22:26:34.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.185+0000 7f162cb7e700 1 -- 172.21.15.59:0/343219392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16281281a0 msgr2=0x7f162812fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.185+0000 7f162cb7e700 1 --2- 172.21.15.59:0/343219392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16281281a0 0x7f162812fd60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f1610009760 tx=0x7f1610009060).stop 2023-09-30T22:26:34.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.185+0000 7f162cb7e700 1 -- 172.21.15.59:0/343219392 shutdown_connections 2023-09-30T22:26:34.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.185+0000 7f162cb7e700 1 --2- 172.21.15.59:0/343219392 >> v2:172.21.15.59:3300/0 conn(0x7f1628127550 0x7f1628132260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.185+0000 7f162cb7e700 1 --2- 172.21.15.59:0/343219392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16281281a0 0x7f162812fd60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.185+0000 7f162cb7e700 1 -- 172.21.15.59:0/343219392 >> 172.21.15.59:0/343219392 conn(0x7f1628097480 msgr2=0x7f1628097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.185+0000 7f162cb7e700 1 -- 172.21.15.59:0/343219392 shutdown_connections 2023-09-30T22:26:34.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.185+0000 7f162cb7e700 1 -- 172.21.15.59:0/343219392 wait complete. 2023-09-30T22:26:34.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.186+0000 7f162cb7e700 1 Processor -- start 2023-09-30T22:26:34.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.186+0000 7f162cb7e700 1 -- start start 2023-09-30T22:26:34.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f162cb7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1628059070 0x7f1628110fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:34.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f162cb7e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1628127550 0x7f162812dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:34.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f162cb7e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16281281a0 0x7f162812e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:34.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f162cb7e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16281315b0 con 0x7f1628059070 2023-09-30T22:26:34.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f162cb7e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1628130e60 con 0x7f16281281a0 2023-09-30T22:26:34.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f162cb7e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1628131fd0 con 0x7f1628127550 2023-09-30T22:26:34.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f162659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1628059070 0x7f1628110fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:34.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f162659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1628059070 0x7f1628110fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36316/0 (socket says 172.21.15.59:36316) 2023-09-30T22:26:34.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f162659c700 1 -- 172.21.15.59:0/972539998 learned_addr learned my addr 172.21.15.59:0/972539998 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:34.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f1625d9b700 1 --2- 172.21.15.59:0/972539998 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1628127550 0x7f162812dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:34.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f1626d9d700 1 --2- 172.21.15.59:0/972539998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16281281a0 0x7f162812e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:34.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f162659c700 1 -- 172.21.15.59:0/972539998 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1628127550 msgr2=0x7f162812dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f162659c700 1 --2- 172.21.15.59:0/972539998 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1628127550 0x7f162812dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f162659c700 1 -- 172.21.15.59:0/972539998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16281281a0 msgr2=0x7f162812e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f162659c700 1 --2- 172.21.15.59:0/972539998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16281281a0 0x7f162812e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f162659c700 1 -- 172.21.15.59:0/972539998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1620009a20 con 0x7f1628059070 2023-09-30T22:26:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.187+0000 7f162659c700 1 --2- 172.21.15.59:0/972539998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1628059070 0x7f1628110fc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f161800c4c0 tx=0x7f1618007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.188+0000 7f161e7fc700 1 -- 172.21.15.59:0/972539998 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180072e0 con 0x7f1628059070 2023-09-30T22:26:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.188+0000 7f161e7fc700 1 -- 172.21.15.59:0/972539998 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1618007460 con 0x7f1628059070 2023-09-30T22:26:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.188+0000 7f161e7fc700 1 -- 172.21.15.59:0/972539998 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180059f0 con 0x7f1628059070 2023-09-30T22:26:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.188+0000 7f162cb7e700 1 -- 172.21.15.59:0/972539998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16100092a0 con 0x7f1628059070 2023-09-30T22:26:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.188+0000 7f162cb7e700 1 -- 172.21.15.59:0/972539998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1628130100 con 0x7f1628059070 2023-09-30T22:26:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.188+0000 7f161e7fc700 1 -- 172.21.15.59:0/972539998 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1618013450 con 0x7f1628059070 2023-09-30T22:26:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.189+0000 7f161e7fc700 1 -- 172.21.15.59:0/972539998 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3590+0+0 (secure 0 0 0) 0x7f161803a600 con 0x7f1628059070 2023-09-30T22:26:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.189+0000 7f162cb7e700 1 -- 172.21.15.59:0/972539998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162805a260 con 0x7f1628059070 2023-09-30T22:26:34.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.194+0000 7f161e7fc700 1 -- 172.21.15.59:0/972539998 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f16180075d0 con 0x7f1628059070 2023-09-30T22:26:34.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.411+0000 7f162cb7e700 1 -- 172.21.15.59:0/972539998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f162812ece0 con 0x7f1628059070 2023-09-30T22:26:34.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.418+0000 7f161e7fc700 1 -- 172.21.15.59:0/972539998 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1618010300 con 0x7f1628059070 2023-09-30T22:26:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.423+0000 7f162cb7e700 1 -- 172.21.15.59:0/972539998 >> v1:172.21.15.59:6816/118188 conn(0x7f160802bb90 legacy=0x7f160802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.423+0000 7f162cb7e700 1 -- 172.21.15.59:0/972539998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1628059070 msgr2=0x7f1628110fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.423+0000 7f162cb7e700 1 --2- 172.21.15.59:0/972539998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1628059070 0x7f1628110fc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f161800c4c0 tx=0x7f1618007c10).stop 2023-09-30T22:26:34.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.423+0000 7f162cb7e700 1 -- 172.21.15.59:0/972539998 shutdown_connections 2023-09-30T22:26:34.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.423+0000 7f162cb7e700 1 --2- 172.21.15.59:0/972539998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16281281a0 0x7f162812e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.423+0000 7f162cb7e700 1 --2- 172.21.15.59:0/972539998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1628059070 0x7f1628110fc0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0x7f161800c4c0 tx=0x7f1618007c10).stop 2023-09-30T22:26:34.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.423+0000 7f162cb7e700 1 --2- 172.21.15.59:0/972539998 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1628127550 0x7f162812dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.424+0000 7f162cb7e700 1 -- 172.21.15.59:0/972539998 >> 172.21.15.59:0/972539998 conn(0x7f1628097480 msgr2=0x7f1628095320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.424+0000 7f162cb7e700 1 -- 172.21.15.59:0/972539998 shutdown_connections 2023-09-30T22:26:34.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.427+0000 7f162cb7e700 1 -- 172.21.15.59:0/972539998 wait complete. 2023-09-30T22:26:34.440 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 3 and data pool 4 2023-09-30T22:26:34.453 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:26:34.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.593+0000 7f5b2c76d700 1 Processor -- start 2023-09-30T22:26:34.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.593+0000 7f5b2c76d700 1 -- start start 2023-09-30T22:26:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.593+0000 7f5b2c76d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b24059070 0x7f5b24127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.593+0000 7f5b2c76d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b24127390 0x7f5b24127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b2c76d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b24096900 con 0x7f5b24095370 2023-09-30T22:26:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b2c76d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b24059c00 con 0x7f5b24059070 2023-09-30T22:26:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b2c76d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b24091b60 con 0x7f5b24127390 2023-09-30T22:26:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b2a509700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b24059070 0x7f5b24127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b29d08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b24127390 0x7f5b24127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b2ad0a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5b24095370 0x7f5b240957f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44980/0 (socket says 172.21.15.59:44980) 2023-09-30T22:26:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b2ad0a700 1 -- 172.21.15.59:0/2495200849 learned_addr learned my addr 172.21.15.59:0/2495200849 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b29507700 1 -- 172.21.15.59:0/2495200849 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766144369 0 0) 0x7f5b24096900 con 0x7f5b24095370 2023-09-30T22:26:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b29507700 1 -- 172.21.15.59:0/2495200849 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b100033f0 con 0x7f5b24095370 2023-09-30T22:26:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b2a509700 1 -- 172.21.15.59:0/2495200849 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b24127390 msgr2=0x7f5b24127d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b2a509700 1 --2- 172.21.15.59:0/2495200849 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b24127390 0x7f5b24127d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b2a509700 1 -- 172.21.15.59:0/2495200849 >> v1:172.21.15.59:6789/0 conn(0x7f5b24095370 legacy=0x7f5b240957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b2a509700 1 -- 172.21.15.59:0/2495200849 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b24092a10 con 0x7f5b24059070 2023-09-30T22:26:34.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b29d08700 1 --2- 172.21.15.59:0/2495200849 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b24127390 0x7f5b24127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:34.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b2a509700 1 --2- 172.21.15.59:0/2495200849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b24059070 0x7f5b24127890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5b20009790 tx=0x7f5b20009060).ready entity=mon.1 client_cookie=18973d6880249495 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b29507700 1 -- 172.21.15.59:0/2495200849 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200090d0 con 0x7f5b24059070 2023-09-30T22:26:34.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b29507700 1 -- 172.21.15.59:0/2495200849 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2000f510 con 0x7f5b24059070 2023-09-30T22:26:34.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.594+0000 7f5b29507700 1 -- 172.21.15.59:0/2495200849 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2000f890 con 0x7f5b24059070 2023-09-30T22:26:34.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.595+0000 7f5b2c76d700 1 -- 172.21.15.59:0/2495200849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b24059070 msgr2=0x7f5b24127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.595+0000 7f5b2c76d700 1 --2- 172.21.15.59:0/2495200849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b24059070 0x7f5b24127890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5b20009790 tx=0x7f5b20009060).stop 2023-09-30T22:26:34.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.595+0000 7f5b2c76d700 1 -- 172.21.15.59:0/2495200849 shutdown_connections 2023-09-30T22:26:34.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.595+0000 7f5b2c76d700 1 --2- 172.21.15.59:0/2495200849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b24059070 0x7f5b24127890 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.595+0000 7f5b2c76d700 1 --2- 172.21.15.59:0/2495200849 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b24127390 0x7f5b24127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.595+0000 7f5b2c76d700 1 -- 172.21.15.59:0/2495200849 >> 172.21.15.59:0/2495200849 conn(0x7f5b24097470 msgr2=0x7f5b24097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.595+0000 7f5b2c76d700 1 -- 172.21.15.59:0/2495200849 shutdown_connections 2023-09-30T22:26:34.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.595+0000 7f5b2c76d700 1 -- 172.21.15.59:0/2495200849 wait complete. 2023-09-30T22:26:34.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.596+0000 7f5b2c76d700 1 Processor -- start 2023-09-30T22:26:34.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.596+0000 7f5b2c76d700 1 -- start start 2023-09-30T22:26:34.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2c76d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b24059070 0x7f5b241177f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:34.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2c76d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b24095370 0x7f5b241137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:34.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2c76d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b24127390 0x7f5b24113cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:34.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2c76d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b24124920 con 0x7f5b24095370 2023-09-30T22:26:34.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2c76d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b241253c0 con 0x7f5b24059070 2023-09-30T22:26:34.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2c76d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b24096f00 con 0x7f5b24127390 2023-09-30T22:26:34.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2a509700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b24059070 0x7f5b241177f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:34.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b29d08700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b24095370 0x7f5b241137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:34.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2a509700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b24059070 0x7f5b241177f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44870/0 (socket says 172.21.15.59:44870) 2023-09-30T22:26:34.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2a509700 1 -- 172.21.15.59:0/4018996207 learned_addr learned my addr 172.21.15.59:0/4018996207 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:34.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2ad0a700 1 --2- 172.21.15.59:0/4018996207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b24127390 0x7f5b24113cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:34.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2a509700 1 -- 172.21.15.59:0/4018996207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b24127390 msgr2=0x7f5b24113cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2a509700 1 --2- 172.21.15.59:0/4018996207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b24127390 0x7f5b24113cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2a509700 1 -- 172.21.15.59:0/4018996207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b24095370 msgr2=0x7f5b241137c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2a509700 1 --2- 172.21.15.59:0/4018996207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b24095370 0x7f5b241137c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2a509700 1 -- 172.21.15.59:0/4018996207 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b140092a0 con 0x7f5b24059070 2023-09-30T22:26:34.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b29d08700 1 --2- 172.21.15.59:0/4018996207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b24095370 0x7f5b241137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:34.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2a509700 1 --2- 172.21.15.59:0/4018996207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b24059070 0x7f5b241177f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5b2000fa00 tx=0x7f5b20017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b1a7fc700 1 -- 172.21.15.59:0/4018996207 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20011990 con 0x7f5b24059070 2023-09-30T22:26:34.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b1a7fc700 1 -- 172.21.15.59:0/4018996207 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b20011b10 con 0x7f5b24059070 2023-09-30T22:26:34.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b2c76d700 1 -- 172.21.15.59:0/4018996207 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b200092a0 con 0x7f5b24059070 2023-09-30T22:26:34.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.597+0000 7f5b1a7fc700 1 -- 172.21.15.59:0/4018996207 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2001b440 con 0x7f5b24059070 2023-09-30T22:26:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.598+0000 7f5b2c76d700 1 -- 172.21.15.59:0/4018996207 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b241153e0 con 0x7f5b24059070 2023-09-30T22:26:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.598+0000 7f5b1a7fc700 1 -- 172.21.15.59:0/4018996207 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5b2001b7b0 con 0x7f5b24059070 2023-09-30T22:26:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.598+0000 7f5b1a7fc700 1 -- 172.21.15.59:0/4018996207 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5b2003c290 con 0x7f5b24059070 2023-09-30T22:26:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.599+0000 7f5b2c76d700 1 -- 172.21.15.59:0/4018996207 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b24115570 con 0x7f5b24059070 2023-09-30T22:26:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.603+0000 7f5b1a7fc700 1 -- 172.21.15.59:0/4018996207 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5b2001ba60 con 0x7f5b24059070 2023-09-30T22:26:34.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.778+0000 7f5b2c76d700 1 -- 172.21.15.59:0/4018996207 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b2405a260 con 0x7f5b24059070 2023-09-30T22:26:34.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.779+0000 7f5b1a7fc700 1 -- 172.21.15.59:0/4018996207 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11356 (secure 0 0 0) 0x7f5b20018920 con 0x7f5b24059070 2023-09-30T22:26:34.779 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:34.779 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:26:34.412272+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:26:34.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.781+0000 7f5b2c76d700 1 -- 172.21.15.59:0/4018996207 >> v1:172.21.15.59:6816/118188 conn(0x7f5b0802bb60 legacy=0x7f5b0802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.781+0000 7f5b2c76d700 1 -- 172.21.15.59:0/4018996207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b24059070 msgr2=0x7f5b241177f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.781+0000 7f5b2c76d700 1 --2- 172.21.15.59:0/4018996207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b24059070 0x7f5b241177f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5b2000fa00 tx=0x7f5b20017000).stop 2023-09-30T22:26:34.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.781+0000 7f5b2c76d700 1 -- 172.21.15.59:0/4018996207 shutdown_connections 2023-09-30T22:26:34.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.781+0000 7f5b2c76d700 1 --2- 172.21.15.59:0/4018996207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b24127390 0x7f5b24113cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.781+0000 7f5b2c76d700 1 --2- 172.21.15.59:0/4018996207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b24059070 0x7f5b241177f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.781+0000 7f5b2c76d700 1 --2- 172.21.15.59:0/4018996207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b24095370 0x7f5b241137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.781+0000 7f5b2c76d700 1 -- 172.21.15.59:0/4018996207 >> 172.21.15.59:0/4018996207 conn(0x7f5b24097470 msgr2=0x7f5b24094180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.781+0000 7f5b2c76d700 1 -- 172.21.15.59:0/4018996207 shutdown_connections 2023-09-30T22:26:34.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.781+0000 7f5b2c76d700 1 -- 172.21.15.59:0/4018996207 wait complete. 2023-09-30T22:26:34.795 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:26:34.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.925+0000 7fbfe3a55700 1 Processor -- start 2023-09-30T22:26:34.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.925+0000 7fbfe3a55700 1 -- start start 2023-09-30T22:26:34.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.926+0000 7fbfe3a55700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfdc0654a0 0x7fbfdc098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:34.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.926+0000 7fbfe3a55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfdc098fa0 0x7fbfdc132ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:34.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.926+0000 7fbfe3a55700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc065ed0 con 0x7fbfdc098b30 2023-09-30T22:26:34.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.926+0000 7fbfe3a55700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc095880 con 0x7fbfdc0654a0 2023-09-30T22:26:34.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.926+0000 7fbfe3a55700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc096120 con 0x7fbfdc098fa0 2023-09-30T22:26:34.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.926+0000 7fbfe17f1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfdc0654a0 0x7fbfdc098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:34.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.926+0000 7fbfe0ff0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbfdc098b30 0x7fbfdc12f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44986/0 (socket says 172.21.15.59:44986) 2023-09-30T22:26:34.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.926+0000 7fbfe0ff0700 1 -- 172.21.15.59:0/2561215370 learned_addr learned my addr 172.21.15.59:0/2561215370 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:34.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.926+0000 7fbfe1ff2700 1 --2- 172.21.15.59:0/2561215370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfdc098fa0 0x7fbfdc132ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:34.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.926+0000 7fbfe17f1700 1 -- 172.21.15.59:0/2561215370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfdc098fa0 msgr2=0x7fbfdc132ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:34.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.926+0000 7fbfe17f1700 1 --2- 172.21.15.59:0/2561215370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfdc098fa0 0x7fbfdc132ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.926+0000 7fbfe17f1700 1 -- 172.21.15.59:0/2561215370 >> v1:172.21.15.59:6789/0 conn(0x7fbfdc098b30 legacy=0x7fbfdc12f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.926+0000 7fbfe17f1700 1 -- 172.21.15.59:0/2561215370 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc066280 con 0x7fbfdc0654a0 2023-09-30T22:26:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.926+0000 7fbfe1ff2700 1 --2- 172.21.15.59:0/2561215370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfdc098fa0 0x7fbfdc132ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.927+0000 7fbfe17f1700 1 --2- 172.21.15.59:0/2561215370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfdc0654a0 0x7fbfdc098640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fbfd0009760 tx=0x7fbfd0009060).ready entity=mon.0 client_cookie=ddb1c68a8dfff913 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.927+0000 7fbfcffff700 1 -- 172.21.15.59:0/2561215370 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd000f510 con 0x7fbfdc0654a0 2023-09-30T22:26:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.927+0000 7fbfcffff700 1 -- 172.21.15.59:0/2561215370 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd000f670 con 0x7fbfdc0654a0 2023-09-30T22:26:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.927+0000 7fbfcffff700 1 -- 172.21.15.59:0/2561215370 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd000f9f0 con 0x7fbfdc0654a0 2023-09-30T22:26:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.927+0000 7fbfe3a55700 1 -- 172.21.15.59:0/2561215370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfdc0654a0 msgr2=0x7fbfdc098640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.927+0000 7fbfe3a55700 1 --2- 172.21.15.59:0/2561215370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfdc0654a0 0x7fbfdc098640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fbfd0009760 tx=0x7fbfd0009060).stop 2023-09-30T22:26:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.927+0000 7fbfe3a55700 1 -- 172.21.15.59:0/2561215370 shutdown_connections 2023-09-30T22:26:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.927+0000 7fbfe3a55700 1 --2- 172.21.15.59:0/2561215370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfdc0654a0 0x7fbfdc098640 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.927+0000 7fbfe3a55700 1 --2- 172.21.15.59:0/2561215370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfdc098fa0 0x7fbfdc132ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.927+0000 7fbfe3a55700 1 -- 172.21.15.59:0/2561215370 >> 172.21.15.59:0/2561215370 conn(0x7fbfdc09a740 msgr2=0x7fbfdc09ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.928+0000 7fbfe3a55700 1 -- 172.21.15.59:0/2561215370 shutdown_connections 2023-09-30T22:26:34.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.928+0000 7fbfe3a55700 1 -- 172.21.15.59:0/2561215370 wait complete. 2023-09-30T22:26:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.928+0000 7fbfe3a55700 1 Processor -- start 2023-09-30T22:26:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.928+0000 7fbfe3a55700 1 -- start start 2023-09-30T22:26:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.929+0000 7fbfe3a55700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfdc0654a0 0x7fbfdc13a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.929+0000 7fbfe3a55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfdc098b30 0x7fbfdc13ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.929+0000 7fbfe3a55700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfdc098fa0 0x7fbfdc13b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.929+0000 7fbfe3a55700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc11da70 con 0x7fbfdc0654a0 2023-09-30T22:26:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.929+0000 7fbfe3a55700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc11c100 con 0x7fbfdc098b30 2023-09-30T22:26:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.929+0000 7fbfe3a55700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc09cfa0 con 0x7fbfdc098fa0 2023-09-30T22:26:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.929+0000 7fbfe17f1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfdc0654a0 0x7fbfdc13a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:34.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.929+0000 7fbfe17f1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfdc0654a0 0x7fbfdc13a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54022/0 (socket says 172.21.15.59:54022) 2023-09-30T22:26:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.929+0000 7fbfe17f1700 1 -- 172.21.15.59:0/2799605751 learned_addr learned my addr 172.21.15.59:0/2799605751 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.929+0000 7fbfe1ff2700 1 --2- 172.21.15.59:0/2799605751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfdc098fa0 0x7fbfdc13b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.929+0000 7fbfe0ff0700 1 --2- 172.21.15.59:0/2799605751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfdc098b30 0x7fbfdc13ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.930+0000 7fbfe17f1700 1 -- 172.21.15.59:0/2799605751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfdc098fa0 msgr2=0x7fbfdc13b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.930+0000 7fbfe17f1700 1 --2- 172.21.15.59:0/2799605751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfdc098fa0 0x7fbfdc13b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.930+0000 7fbfe17f1700 1 -- 172.21.15.59:0/2799605751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfdc098b30 msgr2=0x7fbfdc13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.930+0000 7fbfe17f1700 1 --2- 172.21.15.59:0/2799605751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfdc098b30 0x7fbfdc13ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.930+0000 7fbfe17f1700 1 -- 172.21.15.59:0/2799605751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4009a20 con 0x7fbfdc0654a0 2023-09-30T22:26:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.930+0000 7fbfe1ff2700 1 --2- 172.21.15.59:0/2799605751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfdc098fa0 0x7fbfdc13b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.930+0000 7fbfe17f1700 1 --2- 172.21.15.59:0/2799605751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfdc0654a0 0x7fbfdc13a830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fbfd0009e00 tx=0x7fbfd0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.930+0000 7fbfcd7fa700 1 -- 172.21.15.59:0/2799605751 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd000f7e0 con 0x7fbfdc0654a0 2023-09-30T22:26:34.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.930+0000 7fbfcd7fa700 1 -- 172.21.15.59:0/2799605751 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd000f960 con 0x7fbfdc0654a0 2023-09-30T22:26:34.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.930+0000 7fbfe3a55700 1 -- 172.21.15.59:0/2799605751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd00092a0 con 0x7fbfdc0654a0 2023-09-30T22:26:34.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.930+0000 7fbfcd7fa700 1 -- 172.21.15.59:0/2799605751 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd001b660 con 0x7fbfdc0654a0 2023-09-30T22:26:34.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.930+0000 7fbfe3a55700 1 -- 172.21.15.59:0/2799605751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc11d790 con 0x7fbfdc0654a0 2023-09-30T22:26:34.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.931+0000 7fbfcd7fa700 1 -- 172.21.15.59:0/2799605751 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fbfd001ba10 con 0x7fbfdc0654a0 2023-09-30T22:26:34.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.931+0000 7fbfcd7fa700 1 -- 172.21.15.59:0/2799605751 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fbfd003c940 con 0x7fbfdc0654a0 2023-09-30T22:26:34.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.932+0000 7fbfe3a55700 1 -- 172.21.15.59:0/2799605751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc05a260 con 0x7fbfdc0654a0 2023-09-30T22:26:34.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:34.936+0000 7fbfcd7fa700 1 -- 172.21.15.59:0/2799605751 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fbfd001f080 con 0x7fbfdc0654a0 2023-09-30T22:26:35.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.114+0000 7fbfe3a55700 1 -- 172.21.15.59:0/2799605751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfdc097400 con 0x7fbfdc0654a0 2023-09-30T22:26:35.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.115+0000 7fbfcd7fa700 1 -- 172.21.15.59:0/2799605751 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11356 (secure 0 0 0) 0x7fbfd0029020 con 0x7fbfdc0654a0 2023-09-30T22:26:35.115 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:35.115 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:26:34.412272+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:26:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.116+0000 7fbfe3a55700 1 -- 172.21.15.59:0/2799605751 >> v1:172.21.15.59:6816/118188 conn(0x7fbfc002bb60 legacy=0x7fbfc002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.116+0000 7fbfe3a55700 1 -- 172.21.15.59:0/2799605751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfdc0654a0 msgr2=0x7fbfdc13a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.116+0000 7fbfe3a55700 1 --2- 172.21.15.59:0/2799605751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfdc0654a0 0x7fbfdc13a830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fbfd0009e00 tx=0x7fbfd0017000).stop 2023-09-30T22:26:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.117+0000 7fbfe3a55700 1 -- 172.21.15.59:0/2799605751 shutdown_connections 2023-09-30T22:26:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.117+0000 7fbfe3a55700 1 --2- 172.21.15.59:0/2799605751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfdc098fa0 0x7fbfdc13b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.117+0000 7fbfe3a55700 1 --2- 172.21.15.59:0/2799605751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfdc0654a0 0x7fbfdc13a830 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.117+0000 7fbfe3a55700 1 --2- 172.21.15.59:0/2799605751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfdc098b30 0x7fbfdc13ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.117+0000 7fbfe3a55700 1 -- 172.21.15.59:0/2799605751 >> 172.21.15.59:0/2799605751 conn(0x7fbfdc09a740 msgr2=0x7fbfdc1142e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.117+0000 7fbfe3a55700 1 -- 172.21.15.59:0/2799605751 shutdown_connections 2023-09-30T22:26:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.117+0000 7fbfe3a55700 1 -- 172.21.15.59:0/2799605751 wait complete. 2023-09-30T22:26:35.130 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T22:26:35.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.263+0000 7f3e8dca7700 1 Processor -- start 2023-09-30T22:26:35.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.263+0000 7f3e8dca7700 1 -- start start 2023-09-30T22:26:35.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.263+0000 7f3e8dca7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e880653a0 0x7f3e88098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:35.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.263+0000 7f3e8dca7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e88130440 0x7f3e88132830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:35.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.263+0000 7f3e8dca7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e880663b0 con 0x7f3e88098b30 2023-09-30T22:26:35.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.263+0000 7f3e8dca7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e88065e80 con 0x7f3e880653a0 2023-09-30T22:26:35.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.263+0000 7f3e8dca7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e88065780 con 0x7f3e88130440 2023-09-30T22:26:35.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.263+0000 7f3e877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e880653a0 0x7f3e88098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:35.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.263+0000 7f3e86ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3e88098b30 0x7f3e88098f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44988/0 (socket says 172.21.15.59:44988) 2023-09-30T22:26:35.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.263+0000 7f3e86ffd700 1 -- 172.21.15.59:0/557033808 learned_addr learned my addr 172.21.15.59:0/557033808 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:35.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.263+0000 7f3e87fff700 1 --2- 172.21.15.59:0/557033808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e88130440 0x7f3e88132830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:35.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.264+0000 7f3e867fc700 1 -- 172.21.15.59:0/557033808 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448025787 0 0) 0x7f3e880663b0 con 0x7f3e88098b30 2023-09-30T22:26:35.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.264+0000 7f3e877fe700 1 -- 172.21.15.59:0/557033808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e88130440 msgr2=0x7f3e88132830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:35.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.264+0000 7f3e877fe700 1 --2- 172.21.15.59:0/557033808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e88130440 0x7f3e88132830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:35.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.264+0000 7f3e877fe700 1 -- 172.21.15.59:0/557033808 >> v1:172.21.15.59:6789/0 conn(0x7f3e88098b30 legacy=0x7f3e88098f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.264+0000 7f3e877fe700 1 -- 172.21.15.59:0/557033808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e88096180 con 0x7f3e880653a0 2023-09-30T22:26:35.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.264+0000 7f3e87fff700 1 --2- 172.21.15.59:0/557033808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e88130440 0x7f3e88132830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:35.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.264+0000 7f3e877fe700 1 --2- 172.21.15.59:0/557033808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e880653a0 0x7f3e88098640 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3e700097c0 tx=0x7f3e70009060).ready entity=mon.1 client_cookie=e499f1605b07a25f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.264+0000 7f3e867fc700 1 -- 172.21.15.59:0/557033808 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000f510 con 0x7f3e880653a0 2023-09-30T22:26:35.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.264+0000 7f3e867fc700 1 -- 172.21.15.59:0/557033808 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7000f670 con 0x7f3e880653a0 2023-09-30T22:26:35.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.264+0000 7f3e867fc700 1 -- 172.21.15.59:0/557033808 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000fa40 con 0x7f3e880653a0 2023-09-30T22:26:35.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.265+0000 7f3e8dca7700 1 -- 172.21.15.59:0/557033808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e880653a0 msgr2=0x7f3e88098640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.265+0000 7f3e8dca7700 1 --2- 172.21.15.59:0/557033808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e880653a0 0x7f3e88098640 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3e700097c0 tx=0x7f3e70009060).stop 2023-09-30T22:26:35.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.265+0000 7f3e8dca7700 1 -- 172.21.15.59:0/557033808 shutdown_connections 2023-09-30T22:26:35.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.265+0000 7f3e8dca7700 1 --2- 172.21.15.59:0/557033808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e88130440 0x7f3e88132830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:35.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.265+0000 7f3e8dca7700 1 --2- 172.21.15.59:0/557033808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e880653a0 0x7f3e88098640 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:35.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.265+0000 7f3e8dca7700 1 -- 172.21.15.59:0/557033808 >> 172.21.15.59:0/557033808 conn(0x7f3e8809dc20 msgr2=0x7f3e8809e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.265+0000 7f3e8dca7700 1 -- 172.21.15.59:0/557033808 shutdown_connections 2023-09-30T22:26:35.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.265+0000 7f3e8dca7700 1 -- 172.21.15.59:0/557033808 wait complete. 2023-09-30T22:26:35.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.266+0000 7f3e8dca7700 1 Processor -- start 2023-09-30T22:26:35.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.266+0000 7f3e8dca7700 1 -- start start 2023-09-30T22:26:35.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.266+0000 7f3e8dca7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e880653a0 0x7f3e8813a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:35.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.266+0000 7f3e8dca7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e88098b30 0x7f3e8813ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:35.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.266+0000 7f3e8dca7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e88130440 0x7f3e8813b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:35.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.266+0000 7f3e8dca7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8811c050 con 0x7f3e88130440 2023-09-30T22:26:35.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.266+0000 7f3e8dca7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8809cc00 con 0x7f3e88098b30 2023-09-30T22:26:35.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.266+0000 7f3e8dca7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e88095d30 con 0x7f3e880653a0 2023-09-30T22:26:35.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.266+0000 7f3e87fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e88130440 0x7f3e8813b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:35.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.266+0000 7f3e877fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e880653a0 0x7f3e8813a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:35.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.266+0000 7f3e86ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e88098b30 0x7f3e8813ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:35.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e87fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e88130440 0x7f3e8813b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54024/0 (socket says 172.21.15.59:54024) 2023-09-30T22:26:35.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e86ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e88098b30 0x7f3e8813ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44906/0 (socket says 172.21.15.59:44906) 2023-09-30T22:26:35.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e87fff700 1 -- 172.21.15.59:0/2982622363 learned_addr learned my addr 172.21.15.59:0/2982622363 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:35.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e877fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e880653a0 0x7f3e8813a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42274/0 (socket says 172.21.15.59:42274) 2023-09-30T22:26:35.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e87fff700 1 -- 172.21.15.59:0/2982622363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e880653a0 msgr2=0x7f3e8813a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e87fff700 1 --2- 172.21.15.59:0/2982622363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e880653a0 0x7f3e8813a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:35.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e87fff700 1 -- 172.21.15.59:0/2982622363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e88098b30 msgr2=0x7f3e8813ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e87fff700 1 --2- 172.21.15.59:0/2982622363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e88098b30 0x7f3e8813ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:35.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e87fff700 1 -- 172.21.15.59:0/2982622363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e80009a20 con 0x7f3e88130440 2023-09-30T22:26:35.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e877fe700 1 --2- 172.21.15.59:0/2982622363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e880653a0 0x7f3e8813a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:35.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e86ffd700 1 --2- 172.21.15.59:0/2982622363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e88098b30 0x7f3e8813ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:35.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e87fff700 1 --2- 172.21.15.59:0/2982622363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e88130440 0x7f3e8813b380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3e8000ef90 tx=0x7f3e8000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e7f7fe700 1 -- 172.21.15.59:0/2982622363 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8000cbd0 con 0x7f3e88130440 2023-09-30T22:26:35.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e7f7fe700 1 -- 172.21.15.59:0/2982622363 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8000f040 con 0x7f3e88130440 2023-09-30T22:26:35.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e7f7fe700 1 -- 172.21.15.59:0/2982622363 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e80013400 con 0x7f3e88130440 2023-09-30T22:26:35.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e8dca7700 1 -- 172.21.15.59:0/2982622363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e700092a0 con 0x7f3e88130440 2023-09-30T22:26:35.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.267+0000 7f3e8dca7700 1 -- 172.21.15.59:0/2982622363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8811d6a0 con 0x7f3e88130440 2023-09-30T22:26:35.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.268+0000 7f3e7f7fe700 1 -- 172.21.15.59:0/2982622363 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3e80013830 con 0x7f3e88130440 2023-09-30T22:26:35.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.268+0000 7f3e7f7fe700 1 -- 172.21.15.59:0/2982622363 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3e8003b890 con 0x7f3e88130440 2023-09-30T22:26:35.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.268+0000 7f3e8dca7700 1 -- 172.21.15.59:0/2982622363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8805a260 con 0x7f3e88130440 2023-09-30T22:26:35.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.273+0000 7f3e7f7fe700 1 -- 172.21.15.59:0/2982622363 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3e8001bdc0 con 0x7f3e88130440 2023-09-30T22:26:35.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:35.492+0000 7f3e8dca7700 1 -- 172.21.15.59:0/2982622363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3e88097400 con 0x7f3e88130440 2023-09-30T22:26:36.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.428+0000 7f3e7f7fe700 1 -- 172.21.15.59:0/2982622363 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3e8001b360 con 0x7f3e88130440 2023-09-30T22:26:36.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.431+0000 7f3e8dca7700 1 -- 172.21.15.59:0/2982622363 >> v1:172.21.15.59:6816/118188 conn(0x7f3e6802bb60 legacy=0x7f3e6802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.431+0000 7f3e8dca7700 1 -- 172.21.15.59:0/2982622363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e88130440 msgr2=0x7f3e8813b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.431+0000 7f3e8dca7700 1 --2- 172.21.15.59:0/2982622363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e88130440 0x7f3e8813b380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3e8000ef90 tx=0x7f3e8000b040).stop 2023-09-30T22:26:36.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.431+0000 7f3e8dca7700 1 -- 172.21.15.59:0/2982622363 shutdown_connections 2023-09-30T22:26:36.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.431+0000 7f3e8dca7700 1 --2- 172.21.15.59:0/2982622363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e880653a0 0x7f3e8813a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:36.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.431+0000 7f3e8dca7700 1 --2- 172.21.15.59:0/2982622363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e88130440 0x7f3e8813b380 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:36.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.431+0000 7f3e8dca7700 1 --2- 172.21.15.59:0/2982622363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e88098b30 0x7f3e8813ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:36.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.431+0000 7f3e8dca7700 1 -- 172.21.15.59:0/2982622363 >> 172.21.15.59:0/2982622363 conn(0x7f3e8809dc20 msgr2=0x7f3e881142a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:36.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.431+0000 7f3e8dca7700 1 -- 172.21.15.59:0/2982622363 shutdown_connections 2023-09-30T22:26:36.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.431+0000 7f3e8dca7700 1 -- 172.21.15.59:0/2982622363 wait complete. 2023-09-30T22:26:36.445 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-30T22:26:36.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:26:36.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.582+0000 7f79c494c700 1 Processor -- start 2023-09-30T22:26:36.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.582+0000 7f79c494c700 1 -- start start 2023-09-30T22:26:36.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79c494c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79c00919e0 0x7f79c0091dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:36.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79c494c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79c00922b0 0x7f79c0127990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:36.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79c494c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79c0127e80 0x7f79c0128330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:36.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79c494c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c0128820 con 0x7f79c00919e0 2023-09-30T22:26:36.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79c494c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0092c00 con 0x7f79c00922b0 2023-09-30T22:26:36.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79c494c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00941a0 con 0x7f79c0127e80 2023-09-30T22:26:36.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79be59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79c00919e0 0x7f79c0091dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:36.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79bdd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79c00922b0 0x7f79c0127990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:36.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79bed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79c0127e80 0x7f79c0128330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:36.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79bdd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79c00922b0 0x7f79c0127990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44912/0 (socket says 172.21.15.59:44912) 2023-09-30T22:26:36.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79be59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79c00919e0 0x7f79c0091dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54040/0 (socket says 172.21.15.59:54040) 2023-09-30T22:26:36.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79bdd9b700 1 -- 172.21.15.59:0/2717083818 learned_addr learned my addr 172.21.15.59:0/2717083818 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:36.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79bdd9b700 1 -- 172.21.15.59:0/2717083818 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79c0127e80 msgr2=0x7f79c0128330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:36.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79bdd9b700 1 --2- 172.21.15.59:0/2717083818 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79c0127e80 0x7f79c0128330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:36.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79bdd9b700 1 -- 172.21.15.59:0/2717083818 >> v2:172.21.15.59:3300/0 conn(0x7f79c00919e0 msgr2=0x7f79c0091dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:36.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79bdd9b700 1 --2- 172.21.15.59:0/2717083818 >> v2:172.21.15.59:3300/0 conn(0x7f79c00919e0 0x7f79c0091dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:36.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79bdd9b700 1 -- 172.21.15.59:0/2717083818 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c0094420 con 0x7f79c00922b0 2023-09-30T22:26:36.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79be59c700 1 --2- 172.21.15.59:0/2717083818 >> v2:172.21.15.59:3300/0 conn(0x7f79c00919e0 0x7f79c0091dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:36.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.583+0000 7f79bed9d700 1 --2- 172.21.15.59:0/2717083818 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79c0127e80 0x7f79c0128330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:36.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.584+0000 7f79bdd9b700 1 --2- 172.21.15.59:0/2717083818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79c00922b0 0x7f79c0127990 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f79a800bad0 tx=0x7f79a800b3b0).ready entity=mon.1 client_cookie=92a9503889007bd0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:36.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.584+0000 7f79bd59a700 1 -- 172.21.15.59:0/2717083818 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a800da30 con 0x7f79c00922b0 2023-09-30T22:26:36.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.584+0000 7f79bd59a700 1 -- 172.21.15.59:0/2717083818 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a800db90 con 0x7f79c00922b0 2023-09-30T22:26:36.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.584+0000 7f79bd59a700 1 -- 172.21.15.59:0/2717083818 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8010470 con 0x7f79c00922b0 2023-09-30T22:26:36.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.584+0000 7f79c494c700 1 -- 172.21.15.59:0/2717083818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79c00922b0 msgr2=0x7f79c0127990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.584+0000 7f79c494c700 1 --2- 172.21.15.59:0/2717083818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79c00922b0 0x7f79c0127990 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f79a800bad0 tx=0x7f79a800b3b0).stop 2023-09-30T22:26:36.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.584+0000 7f79c494c700 1 -- 172.21.15.59:0/2717083818 shutdown_connections 2023-09-30T22:26:36.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.584+0000 7f79c494c700 1 --2- 172.21.15.59:0/2717083818 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79c0127e80 0x7f79c0128330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:36.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.584+0000 7f79c494c700 1 --2- 172.21.15.59:0/2717083818 >> v2:172.21.15.59:3300/0 conn(0x7f79c00919e0 0x7f79c0091dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:36.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.584+0000 7f79c494c700 1 --2- 172.21.15.59:0/2717083818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79c00922b0 0x7f79c0127990 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:36.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.584+0000 7f79c494c700 1 -- 172.21.15.59:0/2717083818 >> 172.21.15.59:0/2717083818 conn(0x7f79c009a1c0 msgr2=0x7f79c009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:36.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.585+0000 7f79c494c700 1 -- 172.21.15.59:0/2717083818 shutdown_connections 2023-09-30T22:26:36.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.585+0000 7f79c494c700 1 -- 172.21.15.59:0/2717083818 wait complete. 2023-09-30T22:26:36.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.585+0000 7f79c494c700 1 Processor -- start 2023-09-30T22:26:36.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79c494c700 1 -- start start 2023-09-30T22:26:36.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79c494c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79c00919e0 0x7f79c011d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:36.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79c494c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79c00922b0 0x7f79c0119470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:36.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79c494c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79c0127e80 0x7f79c0119960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:36.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79c494c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0098030 con 0x7f79c00922b0 2023-09-30T22:26:36.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79c494c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0093d10 con 0x7f79c0127e80 2023-09-30T22:26:36.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79c494c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79c011c8c0 con 0x7f79c00919e0 2023-09-30T22:26:36.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79bdd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79c00922b0 0x7f79c0119470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:36.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79bed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79c0127e80 0x7f79c0119960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:36.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79bdd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79c00922b0 0x7f79c0119470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54046/0 (socket says 172.21.15.59:54046) 2023-09-30T22:26:36.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79be59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79c00919e0 0x7f79c011d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:36.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79bdd9b700 1 -- 172.21.15.59:0/900101623 learned_addr learned my addr 172.21.15.59:0/900101623 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:36.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79bdd9b700 1 -- 172.21.15.59:0/900101623 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79c00919e0 msgr2=0x7f79c011d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79bdd9b700 1 --2- 172.21.15.59:0/900101623 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79c00919e0 0x7f79c011d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:36.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79bdd9b700 1 -- 172.21.15.59:0/900101623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79c0127e80 msgr2=0x7f79c0119960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79bdd9b700 1 --2- 172.21.15.59:0/900101623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79c0127e80 0x7f79c0119960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:36.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79bdd9b700 1 -- 172.21.15.59:0/900101623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b00092a0 con 0x7f79c00922b0 2023-09-30T22:26:36.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.586+0000 7f79bed9d700 1 --2- 172.21.15.59:0/900101623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79c0127e80 0x7f79c0119960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:36.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.587+0000 7f79bdd9b700 1 --2- 172.21.15.59:0/900101623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79c00922b0 0x7f79c0119470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f79a800a000 tx=0x7f79a800b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:36.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.587+0000 7f79b67fc700 1 -- 172.21.15.59:0/900101623 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8006910 con 0x7f79c00922b0 2023-09-30T22:26:36.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.587+0000 7f79b67fc700 1 -- 172.21.15.59:0/900101623 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a8019450 con 0x7f79c00922b0 2023-09-30T22:26:36.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.587+0000 7f79c494c700 1 -- 172.21.15.59:0/900101623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b8009a20 con 0x7f79c00922b0 2023-09-30T22:26:36.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.587+0000 7f79b67fc700 1 -- 172.21.15.59:0/900101623 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a80197d0 con 0x7f79c00922b0 2023-09-30T22:26:36.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.587+0000 7f79c494c700 1 -- 172.21.15.59:0/900101623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a800b610 con 0x7f79c00922b0 2023-09-30T22:26:36.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.588+0000 7f79b67fc700 1 -- 172.21.15.59:0/900101623 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f79a8019b40 con 0x7f79c00922b0 2023-09-30T22:26:36.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.588+0000 7f79b67fc700 1 -- 172.21.15.59:0/900101623 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f79a803c6e0 con 0x7f79c00922b0 2023-09-30T22:26:36.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.588+0000 7f79c494c700 1 -- 172.21.15.59:0/900101623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c005a260 con 0x7f79c00922b0 2023-09-30T22:26:36.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.593+0000 7f79b67fc700 1 -- 172.21.15.59:0/900101623 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f79a8028020 con 0x7f79c00922b0 2023-09-30T22:26:36.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:36.811+0000 7f79c494c700 1 -- 172.21.15.59:0/900101623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f79c0046c20 con 0x7f79c00922b0 2023-09-30T22:26:37.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.430+0000 7f79b67fc700 1 -- 172.21.15.59:0/900101623 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f79a800f3d0 con 0x7f79c00922b0 2023-09-30T22:26:37.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.433+0000 7f79c494c700 1 -- 172.21.15.59:0/900101623 >> v1:172.21.15.59:6816/118188 conn(0x7f79a002bb60 legacy=0x7f79a002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.433+0000 7f79c494c700 1 -- 172.21.15.59:0/900101623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79c00922b0 msgr2=0x7f79c0119470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.433+0000 7f79c494c700 1 --2- 172.21.15.59:0/900101623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79c00922b0 0x7f79c0119470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f79a800a000 tx=0x7f79a800b3b0).stop 2023-09-30T22:26:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.433+0000 7f79c494c700 1 -- 172.21.15.59:0/900101623 shutdown_connections 2023-09-30T22:26:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.433+0000 7f79c494c700 1 --2- 172.21.15.59:0/900101623 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79c00919e0 0x7f79c011d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.433+0000 7f79c494c700 1 --2- 172.21.15.59:0/900101623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79c0127e80 0x7f79c0119960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.433+0000 7f79c494c700 1 --2- 172.21.15.59:0/900101623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79c00922b0 0x7f79c0119470 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.433+0000 7f79c494c700 1 -- 172.21.15.59:0/900101623 >> 172.21.15.59:0/900101623 conn(0x7f79c009a1c0 msgr2=0x7f79c00690c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.433+0000 7f79c494c700 1 -- 172.21.15.59:0/900101623 shutdown_connections 2023-09-30T22:26:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.433+0000 7f79c494c700 1 -- 172.21.15.59:0/900101623 wait complete. 2023-09-30T22:26:37.447 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-30T22:26:37.448 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:26:37.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.582+0000 7fc4322cf700 1 Processor -- start 2023-09-30T22:26:37.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.582+0000 7fc4322cf700 1 -- start start 2023-09-30T22:26:37.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.583+0000 7fc4322cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc42c096820 0x7fc42c096c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:37.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.583+0000 7fc4322cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc42c067940 0x7fc42c0970f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:37.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.583+0000 7fc4322cf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42c068df0 con 0x7fc42c0975e0 2023-09-30T22:26:37.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.583+0000 7fc4322cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c06a4c0 con 0x7fc42c096820 2023-09-30T22:26:37.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.583+0000 7fc4322cf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c098260 con 0x7fc42c067940 2023-09-30T22:26:37.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.583+0000 7fc42b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc42c067940 0x7fc42c0970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:37.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.583+0000 7fc42bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc42c096820 0x7fc42c096c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:37.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.583+0000 7fc42b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc42c067940 0x7fc42c0970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42294/0 (socket says 172.21.15.59:42294) 2023-09-30T22:26:37.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.583+0000 7fc42b7fe700 1 -- 172.21.15.59:0/329317721 learned_addr learned my addr 172.21.15.59:0/329317721 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:37.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.583+0000 7fc42b7fe700 1 -- 172.21.15.59:0/329317721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc42c096820 msgr2=0x7fc42c096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:37.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.583+0000 7fc42b7fe700 1 --2- 172.21.15.59:0/329317721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc42c096820 0x7fc42c096c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.583+0000 7fc42affd700 1 -- 172.21.15.59:0/329317721 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059013110 0 0) 0x7fc42c068df0 con 0x7fc42c0975e0 2023-09-30T22:26:37.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.583+0000 7fc42b7fe700 1 -- 172.21.15.59:0/329317721 >> v1:172.21.15.59:6789/0 conn(0x7fc42c0975e0 legacy=0x7fc42c12f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.583+0000 7fc42b7fe700 1 -- 172.21.15.59:0/329317721 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c095e60 con 0x7fc42c067940 2023-09-30T22:26:37.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.583+0000 7fc42bfff700 1 --2- 172.21.15.59:0/329317721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc42c096820 0x7fc42c096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:37.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.584+0000 7fc42b7fe700 1 --2- 172.21.15.59:0/329317721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc42c067940 0x7fc42c0970f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc41c009830 tx=0x7fc41c0090f0).ready entity=mon.2 client_cookie=2a425315a7b0b35c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:37.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.584+0000 7fc42affd700 1 -- 172.21.15.59:0/329317721 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00b580 con 0x7fc42c067940 2023-09-30T22:26:37.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.584+0000 7fc42affd700 1 -- 172.21.15.59:0/329317721 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41c00b6e0 con 0x7fc42c067940 2023-09-30T22:26:37.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.584+0000 7fc42affd700 1 -- 172.21.15.59:0/329317721 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00ba60 con 0x7fc42c067940 2023-09-30T22:26:37.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.584+0000 7fc4322cf700 1 -- 172.21.15.59:0/329317721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc42c067940 msgr2=0x7fc42c0970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.584+0000 7fc4322cf700 1 --2- 172.21.15.59:0/329317721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc42c067940 0x7fc42c0970f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc41c009830 tx=0x7fc41c0090f0).stop 2023-09-30T22:26:37.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.584+0000 7fc4322cf700 1 -- 172.21.15.59:0/329317721 shutdown_connections 2023-09-30T22:26:37.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.584+0000 7fc4322cf700 1 --2- 172.21.15.59:0/329317721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc42c096820 0x7fc42c096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.584+0000 7fc4322cf700 1 --2- 172.21.15.59:0/329317721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc42c067940 0x7fc42c0970f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.584+0000 7fc4322cf700 1 -- 172.21.15.59:0/329317721 >> 172.21.15.59:0/329317721 conn(0x7fc42c09ba50 msgr2=0x7fc42c09be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:37.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.584+0000 7fc4322cf700 1 -- 172.21.15.59:0/329317721 shutdown_connections 2023-09-30T22:26:37.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.584+0000 7fc4322cf700 1 -- 172.21.15.59:0/329317721 wait complete. 2023-09-30T22:26:37.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.586+0000 7fc4322cf700 1 Processor -- start 2023-09-30T22:26:37.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.586+0000 7fc4322cf700 1 -- start start 2023-09-30T22:26:37.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.586+0000 7fc4322cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc42c067940 0x7fc42c1381f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:37.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.586+0000 7fc4322cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc42c096820 0x7fc42c1386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:37.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc4322cf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42c0975e0 0x7fc42c138bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:37.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc4322cf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c1390c0 con 0x7fc42c0975e0 2023-09-30T22:26:37.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc4322cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c11bf60 con 0x7fc42c096820 2023-09-30T22:26:37.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc4322cf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c067e30 con 0x7fc42c067940 2023-09-30T22:26:37.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc42bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc42c067940 0x7fc42c1381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:37.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc42b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc42c096820 0x7fc42c1386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:37.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc42bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc42c067940 0x7fc42c1381f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42310/0 (socket says 172.21.15.59:42310) 2023-09-30T22:26:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc42bfff700 1 -- 172.21.15.59:0/4134193224 learned_addr learned my addr 172.21.15.59:0/4134193224 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc43086c700 1 --2- 172.21.15.59:0/4134193224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42c0975e0 0x7fc42c138bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc42b7fe700 1 -- 172.21.15.59:0/4134193224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc42c067940 msgr2=0x7fc42c1381f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc42b7fe700 1 --2- 172.21.15.59:0/4134193224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc42c067940 0x7fc42c1381f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc42b7fe700 1 -- 172.21.15.59:0/4134193224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42c0975e0 msgr2=0x7fc42c138bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc42b7fe700 1 --2- 172.21.15.59:0/4134193224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42c0975e0 0x7fc42c138bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc42b7fe700 1 -- 172.21.15.59:0/4134193224 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4140092a0 con 0x7fc42c096820 2023-09-30T22:26:37.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc42bfff700 1 --2- 172.21.15.59:0/4134193224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc42c067940 0x7fc42c1381f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:37.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc42b7fe700 1 --2- 172.21.15.59:0/4134193224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc42c096820 0x7fc42c1386e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc42c06aa30 tx=0x7fc41c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:37.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc423fff700 1 -- 172.21.15.59:0/4134193224 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c006d90 con 0x7fc42c096820 2023-09-30T22:26:37.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc423fff700 1 -- 172.21.15.59:0/4134193224 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41c000bc0 con 0x7fc42c096820 2023-09-30T22:26:37.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc4322cf700 1 -- 172.21.15.59:0/4134193224 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41c009370 con 0x7fc42c096820 2023-09-30T22:26:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc423fff700 1 -- 172.21.15.59:0/4134193224 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c01c420 con 0x7fc42c096820 2023-09-30T22:26:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.587+0000 7fc4322cf700 1 -- 172.21.15.59:0/4134193224 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc42c11c5b0 con 0x7fc42c096820 2023-09-30T22:26:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.588+0000 7fc423fff700 1 -- 172.21.15.59:0/4134193224 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc41c01c9e0 con 0x7fc42c096820 2023-09-30T22:26:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.588+0000 7fc423fff700 1 -- 172.21.15.59:0/4134193224 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc41c03cee0 con 0x7fc42c096820 2023-09-30T22:26:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.588+0000 7fc4322cf700 1 -- 172.21.15.59:0/4134193224 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42c091b70 con 0x7fc42c096820 2023-09-30T22:26:37.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.593+0000 7fc423fff700 1 -- 172.21.15.59:0/4134193224 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc41c020020 con 0x7fc42c096820 2023-09-30T22:26:37.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.819+0000 7fc4322cf700 1 -- 172.21.15.59:0/4134193224 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc42c05a260 con 0x7fc42c096820 2023-09-30T22:26:37.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.820+0000 7fc423fff700 1 -- 172.21.15.59:0/4134193224 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7fc41c01cc90 con 0x7fc42c096820 2023-09-30T22:26:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:37.820 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:26:34.412591+0000","modified":"2023-09-30T22:26:37.427658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/2103029646","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":2103029646}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:26:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.822+0000 7fc4322cf700 1 -- 172.21.15.59:0/4134193224 >> v1:172.21.15.59:6816/118188 conn(0x7fc40c02bb90 legacy=0x7fc40c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.822+0000 7fc4322cf700 1 -- 172.21.15.59:0/4134193224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc42c096820 msgr2=0x7fc42c1386e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.822+0000 7fc4322cf700 1 --2- 172.21.15.59:0/4134193224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc42c096820 0x7fc42c1386e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc42c06aa30 tx=0x7fc41c017000).stop 2023-09-30T22:26:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.822+0000 7fc4322cf700 1 -- 172.21.15.59:0/4134193224 shutdown_connections 2023-09-30T22:26:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.822+0000 7fc4322cf700 1 --2- 172.21.15.59:0/4134193224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc42c067940 0x7fc42c1381f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.822+0000 7fc4322cf700 1 --2- 172.21.15.59:0/4134193224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc42c0975e0 0x7fc42c138bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.822+0000 7fc4322cf700 1 --2- 172.21.15.59:0/4134193224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc42c096820 0x7fc42c1386e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.822+0000 7fc4322cf700 1 -- 172.21.15.59:0/4134193224 >> 172.21.15.59:0/4134193224 conn(0x7fc42c09ba50 msgr2=0x7fc42c0998d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.822+0000 7fc4322cf700 1 -- 172.21.15.59:0/4134193224 shutdown_connections 2023-09-30T22:26:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.822+0000 7fc4322cf700 1 -- 172.21.15.59:0/4134193224 wait complete. 2023-09-30T22:26:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 6 2023-09-30T22:26:37.835 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:26:37.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.965+0000 7f1faeb19700 1 Processor -- start 2023-09-30T22:26:37.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.966+0000 7f1faeb19700 1 -- start start 2023-09-30T22:26:37.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.966+0000 7f1faeb19700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1fa8059070 0x7f1fa81256c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:37.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.966+0000 7f1faeb19700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa81251c0 0x7f1fa8125bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:37.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.966+0000 7f1faeb19700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8093bf0 0x7f1fa8094050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:37.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.966+0000 7f1faeb19700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa8059450 con 0x7f1fa8059070 2023-09-30T22:26:37.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.966+0000 7f1faeb19700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8095f00 con 0x7f1fa8093bf0 2023-09-30T22:26:37.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.966+0000 7f1faeb19700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8096190 con 0x7f1fa81251c0 2023-09-30T22:26:37.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.966+0000 7f1fa7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa81251c0 0x7f1fa8125bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:37.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.966+0000 7f1fad0b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8093bf0 0x7f1fa8094050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:37.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.966+0000 7f1fac8b5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1fa8059070 0x7f1fa81256c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:37.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.966+0000 7f1fa7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa81251c0 0x7f1fa8125bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42318/0 (socket says 172.21.15.59:42318) 2023-09-30T22:26:37.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.966+0000 7f1fad0b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8093bf0 0x7f1fa8094050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44950/0 (socket says 172.21.15.59:44950) 2023-09-30T22:26:37.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.966+0000 7f1fa7fff700 1 -- 172.21.15.59:0/1381793612 learned_addr learned my addr 172.21.15.59:0/1381793612 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:37.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.967+0000 7f1fac8b5700 1 -- 172.21.15.59:0/1381793612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa81251c0 msgr2=0x7f1fa8125bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:37.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.967+0000 7f1fac8b5700 1 --2- 172.21.15.59:0/1381793612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa81251c0 0x7f1fa8125bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.967+0000 7f1fac8b5700 1 -- 172.21.15.59:0/1381793612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8093bf0 msgr2=0x7f1fa8094050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:37.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.967+0000 7f1fac8b5700 1 --2- 172.21.15.59:0/1381793612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8093bf0 0x7f1fa8094050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.967+0000 7f1fac8b5700 1 -- 172.21.15.59:0/1381793612 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa81260a0 con 0x7f1fa8059070 2023-09-30T22:26:37.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.967+0000 7f1fad0b6700 1 --2- 172.21.15.59:0/1381793612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8093bf0 0x7f1fa8094050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:37.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.967+0000 7f1fac8b5700 1 --2- 172.21.15.59:0/1381793612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa8059070 0x7f1fa81256c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1f98009760 tx=0x7f1f98009060).ready entity=mon.0 client_cookie=42b291ada82b2faa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:37.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.967+0000 7f1fa77fe700 1 -- 172.21.15.59:0/1381793612 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800d4a0 con 0x7f1fa8059070 2023-09-30T22:26:37.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.967+0000 7f1fa77fe700 1 -- 172.21.15.59:0/1381793612 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9800d600 con 0x7f1fa8059070 2023-09-30T22:26:37.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.967+0000 7f1fa77fe700 1 -- 172.21.15.59:0/1381793612 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800d980 con 0x7f1fa8059070 2023-09-30T22:26:37.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.968+0000 7f1faeb19700 1 -- 172.21.15.59:0/1381793612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa8059070 msgr2=0x7f1fa81256c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.968+0000 7f1faeb19700 1 --2- 172.21.15.59:0/1381793612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa8059070 0x7f1fa81256c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1f98009760 tx=0x7f1f98009060).stop 2023-09-30T22:26:37.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.968+0000 7f1faeb19700 1 -- 172.21.15.59:0/1381793612 shutdown_connections 2023-09-30T22:26:37.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.968+0000 7f1faeb19700 1 --2- 172.21.15.59:0/1381793612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8093bf0 0x7f1fa8094050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.968+0000 7f1faeb19700 1 --2- 172.21.15.59:0/1381793612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa8059070 0x7f1fa81256c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.968+0000 7f1faeb19700 1 --2- 172.21.15.59:0/1381793612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa81251c0 0x7f1fa8125bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.968+0000 7f1faeb19700 1 -- 172.21.15.59:0/1381793612 >> 172.21.15.59:0/1381793612 conn(0x7f1fa8097470 msgr2=0x7f1fa8097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:37.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.968+0000 7f1faeb19700 1 -- 172.21.15.59:0/1381793612 shutdown_connections 2023-09-30T22:26:37.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.968+0000 7f1faeb19700 1 -- 172.21.15.59:0/1381793612 wait complete. 2023-09-30T22:26:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.968+0000 7f1faeb19700 1 Processor -- start 2023-09-30T22:26:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.969+0000 7f1faeb19700 1 -- start start 2023-09-30T22:26:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.969+0000 7f1faeb19700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa8059070 0x7f1fa8122c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.969+0000 7f1faeb19700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8093bf0 0x7f1fa8091a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.969+0000 7f1faeb19700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa81251c0 0x7f1fa8091f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.969+0000 7f1faeb19700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8117bf0 con 0x7f1fa8059070 2023-09-30T22:26:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.969+0000 7f1faeb19700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa80958d0 con 0x7f1fa8093bf0 2023-09-30T22:26:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.969+0000 7f1faeb19700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8117150 con 0x7f1fa81251c0 2023-09-30T22:26:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.969+0000 7f1fa7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8093bf0 0x7f1fa8091a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:37.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.969+0000 7f1fac8b5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa8059070 0x7f1fa8122c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:37.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.969+0000 7f1fad0b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa81251c0 0x7f1fa8091f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:37.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.969+0000 7f1fa7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8093bf0 0x7f1fa8091a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44960/0 (socket says 172.21.15.59:44960) 2023-09-30T22:26:37.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.969+0000 7f1fac8b5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa8059070 0x7f1fa8122c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54070/0 (socket says 172.21.15.59:54070) 2023-09-30T22:26:37.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.969+0000 7f1fa7fff700 1 -- 172.21.15.59:0/2293982627 learned_addr learned my addr 172.21.15.59:0/2293982627 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:37.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.970+0000 7f1fad0b6700 1 -- 172.21.15.59:0/2293982627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8093bf0 msgr2=0x7f1fa8091a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.970+0000 7f1fad0b6700 1 --2- 172.21.15.59:0/2293982627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8093bf0 0x7f1fa8091a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.970+0000 7f1fad0b6700 1 -- 172.21.15.59:0/2293982627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa8059070 msgr2=0x7f1fa8122c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.970+0000 7f1fad0b6700 1 --2- 172.21.15.59:0/2293982627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa8059070 0x7f1fa8122c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:37.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.970+0000 7f1fad0b6700 1 -- 172.21.15.59:0/2293982627 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa0009a20 con 0x7f1fa81251c0 2023-09-30T22:26:37.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.970+0000 7f1fa7fff700 1 --2- 172.21.15.59:0/2293982627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8093bf0 0x7f1fa8091a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:37.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.970+0000 7f1fac8b5700 1 --2- 172.21.15.59:0/2293982627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa8059070 0x7f1fa8122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:37.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.970+0000 7f1fad0b6700 1 --2- 172.21.15.59:0/2293982627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa81251c0 0x7f1fa8091f00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f1fa0009f10 tx=0x7f1fa000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:37.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.970+0000 7f1fa4ff9700 1 -- 172.21.15.59:0/2293982627 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa000cb70 con 0x7f1fa81251c0 2023-09-30T22:26:37.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.970+0000 7f1fa4ff9700 1 -- 172.21.15.59:0/2293982627 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa000f040 con 0x7f1fa81251c0 2023-09-30T22:26:37.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.970+0000 7f1faeb19700 1 -- 172.21.15.59:0/2293982627 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f980092a0 con 0x7f1fa81251c0 2023-09-30T22:26:37.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.970+0000 7f1fa4ff9700 1 -- 172.21.15.59:0/2293982627 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0013400 con 0x7f1fa81251c0 2023-09-30T22:26:37.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.970+0000 7f1faeb19700 1 -- 172.21.15.59:0/2293982627 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa8117490 con 0x7f1fa81251c0 2023-09-30T22:26:37.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.971+0000 7f1fa4ff9700 1 -- 172.21.15.59:0/2293982627 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1fa00137f0 con 0x7f1fa81251c0 2023-09-30T22:26:37.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.971+0000 7f1fa4ff9700 1 -- 172.21.15.59:0/2293982627 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f1fa003b840 con 0x7f1fa81251c0 2023-09-30T22:26:37.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.971+0000 7f1faeb19700 1 -- 172.21.15.59:0/2293982627 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa8123330 con 0x7f1fa81251c0 2023-09-30T22:26:37.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:37.976+0000 7f1fa4ff9700 1 -- 172.21.15.59:0/2293982627 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1fa0013aa0 con 0x7f1fa81251c0 2023-09-30T22:26:38.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.153+0000 7f1faeb19700 1 -- 172.21.15.59:0/2293982627 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fa805a260 con 0x7f1fa81251c0 2023-09-30T22:26:38.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.154+0000 7f1fa4ff9700 1 -- 172.21.15.59:0/2293982627 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11343 (secure 0 0 0) 0x7f1fa001b7e0 con 0x7f1fa81251c0 2023-09-30T22:26:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:38.154 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":18,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:26:35.416181+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:26:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.156+0000 7f1faeb19700 1 -- 172.21.15.59:0/2293982627 >> v1:172.21.15.59:6816/118188 conn(0x7f1f8802bb60 legacy=0x7f1f8802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.156+0000 7f1faeb19700 1 -- 172.21.15.59:0/2293982627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa81251c0 msgr2=0x7f1fa8091f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.156+0000 7f1faeb19700 1 --2- 172.21.15.59:0/2293982627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa81251c0 0x7f1fa8091f00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f1fa0009f10 tx=0x7f1fa000b040).stop 2023-09-30T22:26:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.156+0000 7f1faeb19700 1 -- 172.21.15.59:0/2293982627 shutdown_connections 2023-09-30T22:26:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.156+0000 7f1faeb19700 1 --2- 172.21.15.59:0/2293982627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa81251c0 0x7f1fa8091f00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.156+0000 7f1faeb19700 1 --2- 172.21.15.59:0/2293982627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa8059070 0x7f1fa8122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.156+0000 7f1faeb19700 1 --2- 172.21.15.59:0/2293982627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8093bf0 0x7f1fa8091a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.156+0000 7f1faeb19700 1 -- 172.21.15.59:0/2293982627 >> 172.21.15.59:0/2293982627 conn(0x7f1fa8097470 msgr2=0x7f1fa8128d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.156+0000 7f1faeb19700 1 -- 172.21.15.59:0/2293982627 shutdown_connections 2023-09-30T22:26:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.156+0000 7f1faeb19700 1 -- 172.21.15.59:0/2293982627 wait complete. 2023-09-30T22:26:38.169 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T22:26:38.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:26:38.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.299+0000 7fb654d4f700 1 Processor -- start 2023-09-30T22:26:38.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.299+0000 7fb654d4f700 1 -- start start 2023-09-30T22:26:38.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.299+0000 7fb654d4f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6500613a0 0x7fb65012ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:38.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.299+0000 7fb654d4f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb65012b2f0 0x7fb65012b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:38.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.299+0000 7fb654d4f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb650095df0 0x7fb650096270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:38.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.299+0000 7fb654d4f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb650061780 con 0x7fb6500613a0 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.299+0000 7fb654d4f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65012abd0 con 0x7fb650095df0 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.299+0000 7fb654d4f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb650067530 con 0x7fb65012b2f0 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb65012b2f0 0x7fb65012b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb650095df0 0x7fb650096270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6500613a0 0x7fb65012ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb65012b2f0 0x7fb65012b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42334/0 (socket says 172.21.15.59:42334) 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64dd9b700 1 -- 172.21.15.59:0/2728781096 learned_addr learned my addr 172.21.15.59:0/2728781096 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64dd9b700 1 -- 172.21.15.59:0/2728781096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb650095df0 msgr2=0x7fb650096270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64dd9b700 1 --2- 172.21.15.59:0/2728781096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb650095df0 0x7fb650096270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64dd9b700 1 -- 172.21.15.59:0/2728781096 >> v2:172.21.15.59:3300/0 conn(0x7fb6500613a0 msgr2=0x7fb65012ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64dd9b700 1 --2- 172.21.15.59:0/2728781096 >> v2:172.21.15.59:3300/0 conn(0x7fb6500613a0 0x7fb65012ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64dd9b700 1 -- 172.21.15.59:0/2728781096 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6500683c0 con 0x7fb65012b2f0 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64ed9d700 1 --2- 172.21.15.59:0/2728781096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb650095df0 0x7fb650096270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64e59c700 1 --2- 172.21.15.59:0/2728781096 >> v2:172.21.15.59:3300/0 conn(0x7fb6500613a0 0x7fb65012ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64dd9b700 1 --2- 172.21.15.59:0/2728781096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb65012b2f0 0x7fb65012b6d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb644006fd0 tx=0x7fb6440090f0).ready entity=mon.2 client_cookie=74b2cb6939c788f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64d59a700 1 -- 172.21.15.59:0/2728781096 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64400f510 con 0x7fb65012b2f0 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64d59a700 1 -- 172.21.15.59:0/2728781096 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64400f670 con 0x7fb65012b2f0 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.300+0000 7fb64d59a700 1 -- 172.21.15.59:0/2728781096 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64400f9f0 con 0x7fb65012b2f0 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.301+0000 7fb654d4f700 1 -- 172.21.15.59:0/2728781096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb65012b2f0 msgr2=0x7fb65012b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.301+0000 7fb654d4f700 1 --2- 172.21.15.59:0/2728781096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb65012b2f0 0x7fb65012b6d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb644006fd0 tx=0x7fb6440090f0).stop 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.301+0000 7fb654d4f700 1 -- 172.21.15.59:0/2728781096 shutdown_connections 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.301+0000 7fb654d4f700 1 --2- 172.21.15.59:0/2728781096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb650095df0 0x7fb650096270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.301+0000 7fb654d4f700 1 --2- 172.21.15.59:0/2728781096 >> v2:172.21.15.59:3300/0 conn(0x7fb6500613a0 0x7fb65012ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.301+0000 7fb654d4f700 1 --2- 172.21.15.59:0/2728781096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb65012b2f0 0x7fb65012b6d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.301+0000 7fb654d4f700 1 -- 172.21.15.59:0/2728781096 >> 172.21.15.59:0/2728781096 conn(0x7fb65009a220 msgr2=0x7fb65009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.301+0000 7fb654d4f700 1 -- 172.21.15.59:0/2728781096 shutdown_connections 2023-09-30T22:26:38.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.301+0000 7fb654d4f700 1 -- 172.21.15.59:0/2728781096 wait complete. 2023-09-30T22:26:38.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.302+0000 7fb654d4f700 1 Processor -- start 2023-09-30T22:26:38.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.302+0000 7fb654d4f700 1 -- start start 2023-09-30T22:26:38.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb654d4f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6500613a0 0x7fb65013a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:38.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb654d4f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb650095df0 0x7fb65013ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:38.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb654d4f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb65012b2f0 0x7fb650113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:38.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb654d4f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb650115010 con 0x7fb65012b2f0 2023-09-30T22:26:38.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb654d4f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65012f4d0 con 0x7fb6500613a0 2023-09-30T22:26:38.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb654d4f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb650098bc0 con 0x7fb650095df0 2023-09-30T22:26:38.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb64e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6500613a0 0x7fb65013a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:38.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb64dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb650095df0 0x7fb65013ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:38.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb64ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb65012b2f0 0x7fb650113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:38.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb64e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6500613a0 0x7fb65013a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44974/0 (socket says 172.21.15.59:44974) 2023-09-30T22:26:38.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb64e59c700 1 -- 172.21.15.59:0/1522918023 learned_addr learned my addr 172.21.15.59:0/1522918023 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:38.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb64dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb650095df0 0x7fb65013ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42348/0 (socket says 172.21.15.59:42348) 2023-09-30T22:26:38.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb64e59c700 1 -- 172.21.15.59:0/1522918023 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb650095df0 msgr2=0x7fb65013ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb64e59c700 1 --2- 172.21.15.59:0/1522918023 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb650095df0 0x7fb65013ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb64e59c700 1 -- 172.21.15.59:0/1522918023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb65012b2f0 msgr2=0x7fb650113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb64e59c700 1 --2- 172.21.15.59:0/1522918023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb65012b2f0 0x7fb650113ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb64e59c700 1 -- 172.21.15.59:0/1522918023 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6400092a0 con 0x7fb6500613a0 2023-09-30T22:26:38.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb64dd9b700 1 --2- 172.21.15.59:0/1522918023 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb650095df0 0x7fb65013ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:38.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb64e59c700 1 --2- 172.21.15.59:0/1522918023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6500613a0 0x7fb65013a780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb64000ea20 tx=0x7fb640009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb63e7fc700 1 -- 172.21.15.59:0/1522918023 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64000c850 con 0x7fb6500613a0 2023-09-30T22:26:38.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb63e7fc700 1 -- 172.21.15.59:0/1522918023 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64000c9b0 con 0x7fb6500613a0 2023-09-30T22:26:38.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb654d4f700 1 -- 172.21.15.59:0/1522918023 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb648009a20 con 0x7fb6500613a0 2023-09-30T22:26:38.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb63e7fc700 1 -- 172.21.15.59:0/1522918023 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64000cd30 con 0x7fb6500613a0 2023-09-30T22:26:38.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.303+0000 7fb654d4f700 1 -- 172.21.15.59:0/1522918023 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb644009370 con 0x7fb6500613a0 2023-09-30T22:26:38.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.304+0000 7fb63e7fc700 1 -- 172.21.15.59:0/1522918023 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb640012600 con 0x7fb6500613a0 2023-09-30T22:26:38.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.304+0000 7fb63e7fc700 1 -- 172.21.15.59:0/1522918023 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb64003b5b0 con 0x7fb6500613a0 2023-09-30T22:26:38.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.304+0000 7fb654d4f700 1 -- 172.21.15.59:0/1522918023 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65005a260 con 0x7fb6500613a0 2023-09-30T22:26:38.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.309+0000 7fb63e7fc700 1 -- 172.21.15.59:0/1522918023 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb64001b400 con 0x7fb6500613a0 2023-09-30T22:26:38.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.484+0000 7fb654d4f700 1 -- 172.21.15.59:0/1522918023 --> v1:172.21.15.59:6816/118188 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb650117310 con 0x7fb63002bb90 2023-09-30T22:26:38.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.491+0000 7fb63e7fc700 1 -- 172.21.15.59:0/1522918023 <== mgr.4103 v1:172.21.15.59:6816/118188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+244491 (unknown 2965378022 0 395515892) 0x7fb64400fd60 con 0x7fb63002bb90 2023-09-30T22:26:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.494+0000 7fb654d4f700 1 -- 172.21.15.59:0/1522918023 >> v1:172.21.15.59:6816/118188 conn(0x7fb63002bb90 legacy=0x7fb63002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.494+0000 7fb654d4f700 1 -- 172.21.15.59:0/1522918023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6500613a0 msgr2=0x7fb65013a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.494+0000 7fb654d4f700 1 --2- 172.21.15.59:0/1522918023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6500613a0 0x7fb65013a780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb64000ea20 tx=0x7fb640009060).stop 2023-09-30T22:26:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.494+0000 7fb654d4f700 1 -- 172.21.15.59:0/1522918023 shutdown_connections 2023-09-30T22:26:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.494+0000 7fb654d4f700 1 --2- 172.21.15.59:0/1522918023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb65012b2f0 0x7fb650113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.494+0000 7fb654d4f700 1 --2- 172.21.15.59:0/1522918023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6500613a0 0x7fb65013a780 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.494+0000 7fb654d4f700 1 --2- 172.21.15.59:0/1522918023 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb650095df0 0x7fb65013ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.494+0000 7fb654d4f700 1 -- 172.21.15.59:0/1522918023 >> 172.21.15.59:0/1522918023 conn(0x7fb65009a220 msgr2=0x7fb650065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.494+0000 7fb654d4f700 1 -- 172.21.15.59:0/1522918023 shutdown_connections 2023-09-30T22:26:38.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.494+0000 7fb654d4f700 1 -- 172.21.15.59:0/1522918023 wait complete. 2023-09-30T22:26:38.497 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-09-30T22:26:38.507 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-09-30T22:26:37.725492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":90,"acting":90,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298460,"statfs":{"total":386547056640,"available":385329623040,"internally_reserved":0,"allocated":528384,"data_stored":149447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471021+0000","last_change":"2023-09-30T22:26:34.463260+0000","last_active":"2023-09-30T22:26:34.471021+0000","last_peered":"2023-09-30T22:26:34.471021+0000","last_clean":"2023-09-30T22:26:34.471021+0000","last_became_active":"2023-09-30T22:26:34.462981+0000","last_became_peered":"2023-09-30T22:26:34.462981+0000","last_unstale":"2023-09-30T22:26:34.471021+0000","last_undegraded":"2023-09-30T22:26:34.471021+0000","last_fullsized":"2023-09-30T22:26:34.471021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461140+0000","last_change":"2023-09-30T22:26:34.454512+0000","last_active":"2023-09-30T22:26:34.461140+0000","last_peered":"2023-09-30T22:26:34.461140+0000","last_clean":"2023-09-30T22:26:34.461140+0000","last_became_active":"2023-09-30T22:26:34.454222+0000","last_became_peered":"2023-09-30T22:26:34.454222+0000","last_unstale":"2023-09-30T22:26:34.461140+0000","last_undegraded":"2023-09-30T22:26:34.461140+0000","last_fullsized":"2023-09-30T22:26:34.461140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462004+0000","last_change":"2023-09-30T22:26:34.454698+0000","last_active":"2023-09-30T22:26:34.462004+0000","last_peered":"2023-09-30T22:26:34.462004+0000","last_clean":"2023-09-30T22:26:34.462004+0000","last_became_active":"2023-09-30T22:26:34.454060+0000","last_became_peered":"2023-09-30T22:26:34.454060+0000","last_unstale":"2023-09-30T22:26:34.462004+0000","last_undegraded":"2023-09-30T22:26:34.462004+0000","last_fullsized":"2023-09-30T22:26:34.462004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462123+0000","last_change":"2023-09-30T22:26:34.450497+0000","last_active":"2023-09-30T22:26:34.462123+0000","last_peered":"2023-09-30T22:26:34.462123+0000","last_clean":"2023-09-30T22:26:34.462123+0000","last_became_active":"2023-09-30T22:26:34.444267+0000","last_became_peered":"2023-09-30T22:26:34.444267+0000","last_unstale":"2023-09-30T22:26:34.462123+0000","last_undegraded":"2023-09-30T22:26:34.462123+0000","last_fullsized":"2023-09-30T22:26:34.462123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460680+0000","last_change":"2023-09-30T22:26:34.453484+0000","last_active":"2023-09-30T22:26:34.460680+0000","last_peered":"2023-09-30T22:26:34.460680+0000","last_clean":"2023-09-30T22:26:34.460680+0000","last_became_active":"2023-09-30T22:26:34.453179+0000","last_became_peered":"2023-09-30T22:26:34.453179+0000","last_unstale":"2023-09-30T22:26:34.460680+0000","last_undegraded":"2023-09-30T22:26:34.460680+0000","last_fullsized":"2023-09-30T22:26:34.460680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.468703+0000","last_change":"2023-09-30T22:26:34.457382+0000","last_active":"2023-09-30T22:26:34.468703+0000","last_peered":"2023-09-30T22:26:34.468703+0000","last_clean":"2023-09-30T22:26:34.468703+0000","last_became_active":"2023-09-30T22:26:34.457077+0000","last_became_peered":"2023-09-30T22:26:34.457077+0000","last_unstale":"2023-09-30T22:26:34.468703+0000","last_undegraded":"2023-09-30T22:26:34.468703+0000","last_fullsized":"2023-09-30T22:26:34.468703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470966+0000","last_change":"2023-09-30T22:26:34.463255+0000","last_active":"2023-09-30T22:26:34.470966+0000","last_peered":"2023-09-30T22:26:34.470966+0000","last_clean":"2023-09-30T22:26:34.470966+0000","last_became_active":"2023-09-30T22:26:34.462962+0000","last_became_peered":"2023-09-30T22:26:34.462962+0000","last_unstale":"2023-09-30T22:26:34.470966+0000","last_undegraded":"2023-09-30T22:26:34.470966+0000","last_fullsized":"2023-09-30T22:26:34.470966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470761+0000","last_change":"2023-09-30T22:26:34.458476+0000","last_active":"2023-09-30T22:26:34.470761+0000","last_peered":"2023-09-30T22:26:34.470761+0000","last_clean":"2023-09-30T22:26:34.470761+0000","last_became_active":"2023-09-30T22:26:34.458195+0000","last_became_peered":"2023-09-30T22:26:34.458195+0000","last_unstale":"2023-09-30T22:26:34.470761+0000","last_undegraded":"2023-09-30T22:26:34.470761+0000","last_fullsized":"2023-09-30T22:26:34.470761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.450508+0000","last_change":"2023-09-30T22:26:34.441003+0000","last_active":"2023-09-30T22:26:34.450508+0000","last_peered":"2023-09-30T22:26:34.450508+0000","last_clean":"2023-09-30T22:26:34.450508+0000","last_became_active":"2023-09-30T22:26:34.440470+0000","last_became_peered":"2023-09-30T22:26:34.440470+0000","last_unstale":"2023-09-30T22:26:34.450508+0000","last_undegraded":"2023-09-30T22:26:34.450508+0000","last_fullsized":"2023-09-30T22:26:34.450508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471250+0000","last_change":"2023-09-30T22:26:34.031319+0000","last_active":"2023-09-30T22:26:34.471250+0000","last_peered":"2023-09-30T22:26:34.471250+0000","last_clean":"2023-09-30T22:26:34.471250+0000","last_became_active":"2023-09-30T22:26:34.030475+0000","last_became_peered":"2023-09-30T22:26:34.030475+0000","last_unstale":"2023-09-30T22:26:34.471250+0000","last_undegraded":"2023-09-30T22:26:34.471250+0000","last_fullsized":"2023-09-30T22:26:34.471250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.428859+0000","last_change":"2023-09-30T22:26:34.036944+0000","last_active":"2023-09-30T22:26:34.428859+0000","last_peered":"2023-09-30T22:26:34.428859+0000","last_clean":"2023-09-30T22:26:34.428859+0000","last_became_active":"2023-09-30T22:26:34.036564+0000","last_became_peered":"2023-09-30T22:26:34.036564+0000","last_unstale":"2023-09-30T22:26:34.428859+0000","last_undegraded":"2023-09-30T22:26:34.428859+0000","last_fullsized":"2023-09-30T22:26:34.428859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.999358+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:33.002914+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998233+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470919+0000","last_change":"2023-09-30T22:26:34.462289+0000","last_active":"2023-09-30T22:26:34.470919+0000","last_peered":"2023-09-30T22:26:34.470919+0000","last_clean":"2023-09-30T22:26:34.470919+0000","last_became_active":"2023-09-30T22:26:34.461927+0000","last_became_peered":"2023-09-30T22:26:34.461927+0000","last_unstale":"2023-09-30T22:26:34.470919+0000","last_undegraded":"2023-09-30T22:26:34.470919+0000","last_fullsized":"2023-09-30T22:26:34.470919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998165+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471717+0000","last_change":"2023-09-30T22:26:34.041826+0000","last_active":"2023-09-30T22:26:34.471717+0000","last_peered":"2023-09-30T22:26:34.471717+0000","last_clean":"2023-09-30T22:26:34.471717+0000","last_became_active":"2023-09-30T22:26:34.041527+0000","last_became_peered":"2023-09-30T22:26:34.041527+0000","last_unstale":"2023-09-30T22:26:34.471717+0000","last_undegraded":"2023-09-30T22:26:34.471717+0000","last_fullsized":"2023-09-30T22:26:34.471717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998926+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:33.004406+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461265+0000","last_change":"2023-09-30T22:26:34.453594+0000","last_active":"2023-09-30T22:26:34.461265+0000","last_peered":"2023-09-30T22:26:34.461265+0000","last_clean":"2023-09-30T22:26:34.461265+0000","last_became_active":"2023-09-30T22:26:34.453288+0000","last_became_peered":"2023-09-30T22:26:34.453288+0000","last_unstale":"2023-09-30T22:26:34.461265+0000","last_undegraded":"2023-09-30T22:26:34.461265+0000","last_fullsized":"2023-09-30T22:26:34.461265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998177+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471281+0000","last_change":"2023-09-30T22:26:34.466480+0000","last_active":"2023-09-30T22:26:34.471281+0000","last_peered":"2023-09-30T22:26:34.471281+0000","last_clean":"2023-09-30T22:26:34.471281+0000","last_became_active":"2023-09-30T22:26:34.466187+0000","last_became_peered":"2023-09-30T22:26:34.466187+0000","last_unstale":"2023-09-30T22:26:34.471281+0000","last_undegraded":"2023-09-30T22:26:34.471281+0000","last_fullsized":"2023-09-30T22:26:34.471281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.440724+0000","last_change":"2023-09-30T22:26:30.873307+0000","last_active":"2023-09-30T22:26:34.440724+0000","last_peered":"2023-09-30T22:26:34.440724+0000","last_clean":"2023-09-30T22:26:34.440724+0000","last_became_active":"2023-09-30T22:26:30.872872+0000","last_became_peered":"2023-09-30T22:26:30.872872+0000","last_unstale":"2023-09-30T22:26:34.440724+0000","last_undegraded":"2023-09-30T22:26:34.440724+0000","last_fullsized":"2023-09-30T22:26:34.440724+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:33.002845+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470943+0000","last_change":"2023-09-30T22:26:34.462485+0000","last_active":"2023-09-30T22:26:34.470943+0000","last_peered":"2023-09-30T22:26:34.470943+0000","last_clean":"2023-09-30T22:26:34.470943+0000","last_became_active":"2023-09-30T22:26:34.454284+0000","last_became_peered":"2023-09-30T22:26:34.454284+0000","last_unstale":"2023-09-30T22:26:34.470943+0000","last_undegraded":"2023-09-30T22:26:34.470943+0000","last_fullsized":"2023-09-30T22:26:34.470943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-09-30T22:26:30.858397+0000","last_change":"2023-09-30T22:26:29.861644+0000","last_active":"2023-09-30T22:26:30.858397+0000","last_peered":"2023-09-30T22:26:30.858397+0000","last_clean":"2023-09-30T22:26:30.858397+0000","last_became_active":"2023-09-30T22:26:29.861261+0000","last_became_peered":"2023-09-30T22:26:29.861261+0000","last_unstale":"2023-09-30T22:26:30.858397+0000","last_undegraded":"2023-09-30T22:26:30.858397+0000","last_fullsized":"2023-09-30T22:26:30.858397+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.997254+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460658+0000","last_change":"2023-09-30T22:26:34.444993+0000","last_active":"2023-09-30T22:26:34.460658+0000","last_peered":"2023-09-30T22:26:34.460658+0000","last_clean":"2023-09-30T22:26:34.460658+0000","last_became_active":"2023-09-30T22:26:34.444739+0000","last_became_peered":"2023-09-30T22:26:34.444739+0000","last_unstale":"2023-09-30T22:26:34.460658+0000","last_undegraded":"2023-09-30T22:26:34.460658+0000","last_fullsized":"2023-09-30T22:26:34.460658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T22:26:31.856372+0000","last_change":"2023-09-30T22:26:29.858340+0000","last_active":"2023-09-30T22:26:31.856372+0000","last_peered":"2023-09-30T22:26:31.856372+0000","last_clean":"2023-09-30T22:26:31.856372+0000","last_became_active":"2023-09-30T22:26:29.857989+0000","last_became_peered":"2023-09-30T22:26:29.857989+0000","last_unstale":"2023-09-30T22:26:31.856372+0000","last_undegraded":"2023-09-30T22:26:31.856372+0000","last_fullsized":"2023-09-30T22:26:31.856372+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429669+0000","last_change":"2023-09-30T22:26:34.031173+0000","last_active":"2023-09-30T22:26:34.429669+0000","last_peered":"2023-09-30T22:26:34.429669+0000","last_clean":"2023-09-30T22:26:34.429669+0000","last_became_active":"2023-09-30T22:26:34.030863+0000","last_became_peered":"2023-09-30T22:26:34.030863+0000","last_unstale":"2023-09-30T22:26:34.429669+0000","last_undegraded":"2023-09-30T22:26:34.429669+0000","last_fullsized":"2023-09-30T22:26:34.429669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462678+0000","last_change":"2023-09-30T22:26:34.456017+0000","last_active":"2023-09-30T22:26:34.462678+0000","last_peered":"2023-09-30T22:26:34.462678+0000","last_clean":"2023-09-30T22:26:34.462678+0000","last_became_active":"2023-09-30T22:26:34.455744+0000","last_became_peered":"2023-09-30T22:26:34.455744+0000","last_unstale":"2023-09-30T22:26:34.462678+0000","last_undegraded":"2023-09-30T22:26:34.462678+0000","last_fullsized":"2023-09-30T22:26:34.462678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-09-30T22:26:30.858403+0000","last_change":"2023-09-30T22:26:29.859074+0000","last_active":"2023-09-30T22:26:30.858403+0000","last_peered":"2023-09-30T22:26:30.858403+0000","last_clean":"2023-09-30T22:26:30.858403+0000","last_became_active":"2023-09-30T22:26:29.858669+0000","last_became_peered":"2023-09-30T22:26:29.858669+0000","last_unstale":"2023-09-30T22:26:30.858403+0000","last_undegraded":"2023-09-30T22:26:30.858403+0000","last_fullsized":"2023-09-30T22:26:30.858403+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429553+0000","last_change":"2023-09-30T22:26:28.864097+0000","last_active":"2023-09-30T22:26:34.429553+0000","last_peered":"2023-09-30T22:26:34.429553+0000","last_clean":"2023-09-30T22:26:34.429553+0000","last_became_active":"2023-09-30T22:26:28.863723+0000","last_became_peered":"2023-09-30T22:26:28.863723+0000","last_unstale":"2023-09-30T22:26:34.429553+0000","last_undegraded":"2023-09-30T22:26:34.429553+0000","last_fullsized":"2023-09-30T22:26:34.429553+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_clean_scrub_stamp":"2023-09-30T22:26:27.842299+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-09-30T22:26:30.858388+0000","last_change":"2023-09-30T22:26:29.861337+0000","last_active":"2023-09-30T22:26:30.858388+0000","last_peered":"2023-09-30T22:26:30.858388+0000","last_clean":"2023-09-30T22:26:30.858388+0000","last_became_active":"2023-09-30T22:26:29.861003+0000","last_became_peered":"2023-09-30T22:26:29.861003+0000","last_unstale":"2023-09-30T22:26:30.858388+0000","last_undegraded":"2023-09-30T22:26:30.858388+0000","last_fullsized":"2023-09-30T22:26:30.858388+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.997647+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-09-30T22:26:30.878878+0000","last_change":"2023-09-30T22:26:30.874397+0000","last_active":"2023-09-30T22:26:30.878878+0000","last_peered":"2023-09-30T22:26:30.878878+0000","last_clean":"2023-09-30T22:26:30.878878+0000","last_became_active":"2023-09-30T22:26:30.874057+0000","last_became_peered":"2023-09-30T22:26:30.874057+0000","last_unstale":"2023-09-30T22:26:30.878878+0000","last_undegraded":"2023-09-30T22:26:30.878878+0000","last_fullsized":"2023-09-30T22:26:30.878878+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429371+0000","last_change":"2023-09-30T22:26:34.037126+0000","last_active":"2023-09-30T22:26:34.429371+0000","last_peered":"2023-09-30T22:26:34.429371+0000","last_clean":"2023-09-30T22:26:34.429371+0000","last_became_active":"2023-09-30T22:26:34.036825+0000","last_became_peered":"2023-09-30T22:26:34.036825+0000","last_unstale":"2023-09-30T22:26:34.429371+0000","last_undegraded":"2023-09-30T22:26:34.429371+0000","last_fullsized":"2023-09-30T22:26:34.429371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429047+0000","last_change":"2023-09-30T22:26:30.873252+0000","last_active":"2023-09-30T22:26:34.429047+0000","last_peered":"2023-09-30T22:26:34.429047+0000","last_clean":"2023-09-30T22:26:34.429047+0000","last_became_active":"2023-09-30T22:26:30.872894+0000","last_became_peered":"2023-09-30T22:26:30.872894+0000","last_unstale":"2023-09-30T22:26:34.429047+0000","last_undegraded":"2023-09-30T22:26:34.429047+0000","last_fullsized":"2023-09-30T22:26:34.429047+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-09-30T22:26:30.878898+0000","last_change":"2023-09-30T22:26:30.874887+0000","last_active":"2023-09-30T22:26:30.878898+0000","last_peered":"2023-09-30T22:26:30.878898+0000","last_clean":"2023-09-30T22:26:30.878898+0000","last_became_active":"2023-09-30T22:26:30.874533+0000","last_became_peered":"2023-09-30T22:26:30.874533+0000","last_unstale":"2023-09-30T22:26:30.878898+0000","last_undegraded":"2023-09-30T22:26:30.878898+0000","last_fullsized":"2023-09-30T22:26:30.878898+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998608+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998715+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471263+0000","last_change":"2023-09-30T22:26:34.045553+0000","last_active":"2023-09-30T22:26:34.471263+0000","last_peered":"2023-09-30T22:26:34.471263+0000","last_clean":"2023-09-30T22:26:34.471263+0000","last_became_active":"2023-09-30T22:26:34.045206+0000","last_became_peered":"2023-09-30T22:26:34.045206+0000","last_unstale":"2023-09-30T22:26:34.471263+0000","last_undegraded":"2023-09-30T22:26:34.471263+0000","last_fullsized":"2023-09-30T22:26:34.471263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:33.000124+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.451360+0000","last_change":"2023-09-30T22:26:34.441075+0000","last_active":"2023-09-30T22:26:34.451360+0000","last_peered":"2023-09-30T22:26:34.451360+0000","last_clean":"2023-09-30T22:26:34.451360+0000","last_became_active":"2023-09-30T22:26:34.440633+0000","last_became_peered":"2023-09-30T22:26:34.440633+0000","last_unstale":"2023-09-30T22:26:34.451360+0000","last_undegraded":"2023-09-30T22:26:34.451360+0000","last_fullsized":"2023-09-30T22:26:34.451360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.451971+0000","last_change":"2023-09-30T22:26:34.444740+0000","last_active":"2023-09-30T22:26:34.451971+0000","last_peered":"2023-09-30T22:26:34.451971+0000","last_clean":"2023-09-30T22:26:34.451971+0000","last_became_active":"2023-09-30T22:26:34.444385+0000","last_became_peered":"2023-09-30T22:26:34.444385+0000","last_unstale":"2023-09-30T22:26:34.451971+0000","last_undegraded":"2023-09-30T22:26:34.451971+0000","last_fullsized":"2023-09-30T22:26:34.451971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":38,"acting":38,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672962,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297212,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074628,"statfs":{"total":96636764160,"available":96332419072,"internally_reserved":0,"allocated":118784,"data_stored":32417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":0,"up_from":10,"seq":42949672962,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297212,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074628,"statfs":{"total":96636764160,"available":96332419072,"internally_reserved":0,"allocated":118784,"data_stored":32417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":51127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297216,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074624,"statfs":{"total":96636764160,"available":96332414976,"internally_reserved":0,"allocated":122880,"data_stored":33486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:26:38.514 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:26:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.680+0000 7fa3353a6700 1 Processor -- start 2023-09-30T22:26:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.680+0000 7fa3353a6700 1 -- start start 2023-09-30T22:26:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.680+0000 7fa3353a6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa330059070 0x7fa33012ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.680+0000 7fa3353a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa33012b130 0x7fa330127380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.680+0000 7fa3353a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa33012b530 0x7fa330127870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.680+0000 7fa3353a6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa330091ed0 con 0x7fa330059070 2023-09-30T22:26:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.680+0000 7fa3353a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa330092b00 con 0x7fa33012b130 2023-09-30T22:26:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.680+0000 7fa3353a6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa330091c10 con 0x7fa33012b530 2023-09-30T22:26:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa33012b130 0x7fa330127380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa330059070 0x7fa33012ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa33012b530 0x7fa330127870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa330059070 0x7fa33012ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54096/0 (socket says 172.21.15.59:54096) 2023-09-30T22:26:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa33012b130 0x7fa330127380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44988/0 (socket says 172.21.15.59:44988) 2023-09-30T22:26:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32effd700 1 -- 172.21.15.59:0/2271707847 learned_addr learned my addr 172.21.15.59:0/2271707847 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa33012b530 0x7fa330127870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42350/0 (socket says 172.21.15.59:42350) 2023-09-30T22:26:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32effd700 1 -- 172.21.15.59:0/2271707847 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa33012b530 msgr2=0x7fa330127870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32effd700 1 --2- 172.21.15.59:0/2271707847 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa33012b530 0x7fa330127870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32effd700 1 -- 172.21.15.59:0/2271707847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa33012b130 msgr2=0x7fa330127380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32effd700 1 --2- 172.21.15.59:0/2271707847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa33012b130 0x7fa330127380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32effd700 1 -- 172.21.15.59:0/2271707847 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330096d00 con 0x7fa330059070 2023-09-30T22:26:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32e7fc700 1 --2- 172.21.15.59:0/2271707847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa33012b130 0x7fa330127380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32effd700 1 --2- 172.21.15.59:0/2271707847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa330059070 0x7fa33012ac40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa320006fd0 tx=0x7fa3200090f0).ready entity=mon.0 client_cookie=3ff3ebaece1d727c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32dffb700 1 -- 172.21.15.59:0/2271707847 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000f510 con 0x7fa330059070 2023-09-30T22:26:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32dffb700 1 -- 172.21.15.59:0/2271707847 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32000f670 con 0x7fa330059070 2023-09-30T22:26:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.681+0000 7fa32dffb700 1 -- 172.21.15.59:0/2271707847 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000f9f0 con 0x7fa330059070 2023-09-30T22:26:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.682+0000 7fa3353a6700 1 -- 172.21.15.59:0/2271707847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa330059070 msgr2=0x7fa33012ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.682+0000 7fa3353a6700 1 --2- 172.21.15.59:0/2271707847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa330059070 0x7fa33012ac40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa320006fd0 tx=0x7fa3200090f0).stop 2023-09-30T22:26:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.682+0000 7fa3353a6700 1 -- 172.21.15.59:0/2271707847 shutdown_connections 2023-09-30T22:26:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.682+0000 7fa3353a6700 1 --2- 172.21.15.59:0/2271707847 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa33012b530 0x7fa330127870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.682+0000 7fa3353a6700 1 --2- 172.21.15.59:0/2271707847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa330059070 0x7fa33012ac40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.682+0000 7fa3353a6700 1 --2- 172.21.15.59:0/2271707847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa33012b130 0x7fa330127380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.682+0000 7fa3353a6700 1 -- 172.21.15.59:0/2271707847 >> 172.21.15.59:0/2271707847 conn(0x7fa33009a8e0 msgr2=0x7fa33009acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.682+0000 7fa3353a6700 1 -- 172.21.15.59:0/2271707847 shutdown_connections 2023-09-30T22:26:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.682+0000 7fa3353a6700 1 -- 172.21.15.59:0/2271707847 wait complete. 2023-09-30T22:26:38.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.683+0000 7fa3353a6700 1 Processor -- start 2023-09-30T22:26:38.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.683+0000 7fa3353a6700 1 -- start start 2023-09-30T22:26:38.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.683+0000 7fa3353a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa330059070 0x7fa3301269c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:38.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.683+0000 7fa3353a6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa33012b130 0x7fa330115860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:38.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.683+0000 7fa3353a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa33012b530 0x7fa330115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa3353a6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa330096f30 con 0x7fa33012b130 2023-09-30T22:26:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa3353a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa330119390 con 0x7fa330059070 2023-09-30T22:26:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa3353a6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa330127440 con 0x7fa33012b530 2023-09-30T22:26:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa32f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa33012b530 0x7fa330115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa32effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa330059070 0x7fa3301269c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa32e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa33012b130 0x7fa330115860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa32f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa33012b530 0x7fa330115d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42352/0 (socket says 172.21.15.59:42352) 2023-09-30T22:26:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa32f7fe700 1 -- 172.21.15.59:0/711548134 learned_addr learned my addr 172.21.15.59:0/711548134 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa32e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa33012b130 0x7fa330115860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54098/0 (socket says 172.21.15.59:54098) 2023-09-30T22:26:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa32effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa330059070 0x7fa3301269c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44996/0 (socket says 172.21.15.59:44996) 2023-09-30T22:26:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa32f7fe700 1 -- 172.21.15.59:0/711548134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa330059070 msgr2=0x7fa3301269c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa32f7fe700 1 --2- 172.21.15.59:0/711548134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa330059070 0x7fa3301269c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa32f7fe700 1 -- 172.21.15.59:0/711548134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa33012b130 msgr2=0x7fa330115860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa32f7fe700 1 --2- 172.21.15.59:0/711548134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa33012b130 0x7fa330115860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa32f7fe700 1 -- 172.21.15.59:0/711548134 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3240092a0 con 0x7fa33012b530 2023-09-30T22:26:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa32effd700 1 --2- 172.21.15.59:0/711548134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa330059070 0x7fa3301269c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa32e7fc700 1 --2- 172.21.15.59:0/711548134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa33012b130 0x7fa330115860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa32f7fe700 1 --2- 172.21.15.59:0/711548134 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa33012b530 0x7fa330115d50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa328009ef0 tx=0x7fa32800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa316ffd700 1 -- 172.21.15.59:0/711548134 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32800cb70 con 0x7fa33012b530 2023-09-30T22:26:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa316ffd700 1 -- 172.21.15.59:0/711548134 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32800f040 con 0x7fa33012b530 2023-09-30T22:26:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa3353a6700 1 -- 172.21.15.59:0/711548134 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa320009370 con 0x7fa33012b530 2023-09-30T22:26:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa316ffd700 1 -- 172.21.15.59:0/711548134 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328013400 con 0x7fa33012b530 2023-09-30T22:26:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.684+0000 7fa3353a6700 1 -- 172.21.15.59:0/711548134 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa330119a70 con 0x7fa33012b530 2023-09-30T22:26:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.685+0000 7fa316ffd700 1 -- 172.21.15.59:0/711548134 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa3280137b0 con 0x7fa33012b530 2023-09-30T22:26:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.685+0000 7fa316ffd700 1 -- 172.21.15.59:0/711548134 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa32803b7d0 con 0x7fa33012b530 2023-09-30T22:26:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.686+0000 7fa3353a6700 1 -- 172.21.15.59:0/711548134 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33005a260 con 0x7fa33012b530 2023-09-30T22:26:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.690+0000 7fa316ffd700 1 -- 172.21.15.59:0/711548134 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa328013a60 con 0x7fa33012b530 2023-09-30T22:26:38.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.863+0000 7fa3353a6700 1 -- 172.21.15.59:0/711548134 --> v1:172.21.15.59:6816/118188 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa330118f80 con 0x7fa31c02bb60 2023-09-30T22:26:38.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.870+0000 7fa316ffd700 1 -- 172.21.15.59:0/711548134 <== mgr.4103 v1:172.21.15.59:6816/118188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+244491 (unknown 2965378022 0 395515892) 0x7fa330118f80 con 0x7fa31c02bb60 2023-09-30T22:26:38.873 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.873+0000 7fa3353a6700 1 -- 172.21.15.59:0/711548134 >> v1:172.21.15.59:6816/118188 conn(0x7fa31c02bb60 legacy=0x7fa31c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.873+0000 7fa3353a6700 1 -- 172.21.15.59:0/711548134 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa33012b530 msgr2=0x7fa330115d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.873+0000 7fa3353a6700 1 --2- 172.21.15.59:0/711548134 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa33012b530 0x7fa330115d50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa328009ef0 tx=0x7fa32800b040).stop 2023-09-30T22:26:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.873+0000 7fa3353a6700 1 -- 172.21.15.59:0/711548134 shutdown_connections 2023-09-30T22:26:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.873+0000 7fa3353a6700 1 --2- 172.21.15.59:0/711548134 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa33012b530 0x7fa330115d50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.873+0000 7fa3353a6700 1 --2- 172.21.15.59:0/711548134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa330059070 0x7fa3301269c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.873+0000 7fa3353a6700 1 --2- 172.21.15.59:0/711548134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa33012b130 0x7fa330115860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.873+0000 7fa3353a6700 1 -- 172.21.15.59:0/711548134 >> 172.21.15.59:0/711548134 conn(0x7fa33009a8e0 msgr2=0x7fa3300940c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.873+0000 7fa3353a6700 1 -- 172.21.15.59:0/711548134 shutdown_connections 2023-09-30T22:26:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:38.873+0000 7fa3353a6700 1 -- 172.21.15.59:0/711548134 wait complete. 2023-09-30T22:26:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-09-30T22:26:38.886 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-09-30T22:26:37.725492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":90,"acting":90,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298460,"statfs":{"total":386547056640,"available":385329623040,"internally_reserved":0,"allocated":528384,"data_stored":149447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471021+0000","last_change":"2023-09-30T22:26:34.463260+0000","last_active":"2023-09-30T22:26:34.471021+0000","last_peered":"2023-09-30T22:26:34.471021+0000","last_clean":"2023-09-30T22:26:34.471021+0000","last_became_active":"2023-09-30T22:26:34.462981+0000","last_became_peered":"2023-09-30T22:26:34.462981+0000","last_unstale":"2023-09-30T22:26:34.471021+0000","last_undegraded":"2023-09-30T22:26:34.471021+0000","last_fullsized":"2023-09-30T22:26:34.471021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461140+0000","last_change":"2023-09-30T22:26:34.454512+0000","last_active":"2023-09-30T22:26:34.461140+0000","last_peered":"2023-09-30T22:26:34.461140+0000","last_clean":"2023-09-30T22:26:34.461140+0000","last_became_active":"2023-09-30T22:26:34.454222+0000","last_became_peered":"2023-09-30T22:26:34.454222+0000","last_unstale":"2023-09-30T22:26:34.461140+0000","last_undegraded":"2023-09-30T22:26:34.461140+0000","last_fullsized":"2023-09-30T22:26:34.461140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462004+0000","last_change":"2023-09-30T22:26:34.454698+0000","last_active":"2023-09-30T22:26:34.462004+0000","last_peered":"2023-09-30T22:26:34.462004+0000","last_clean":"2023-09-30T22:26:34.462004+0000","last_became_active":"2023-09-30T22:26:34.454060+0000","last_became_peered":"2023-09-30T22:26:34.454060+0000","last_unstale":"2023-09-30T22:26:34.462004+0000","last_undegraded":"2023-09-30T22:26:34.462004+0000","last_fullsized":"2023-09-30T22:26:34.462004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462123+0000","last_change":"2023-09-30T22:26:34.450497+0000","last_active":"2023-09-30T22:26:34.462123+0000","last_peered":"2023-09-30T22:26:34.462123+0000","last_clean":"2023-09-30T22:26:34.462123+0000","last_became_active":"2023-09-30T22:26:34.444267+0000","last_became_peered":"2023-09-30T22:26:34.444267+0000","last_unstale":"2023-09-30T22:26:34.462123+0000","last_undegraded":"2023-09-30T22:26:34.462123+0000","last_fullsized":"2023-09-30T22:26:34.462123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460680+0000","last_change":"2023-09-30T22:26:34.453484+0000","last_active":"2023-09-30T22:26:34.460680+0000","last_peered":"2023-09-30T22:26:34.460680+0000","last_clean":"2023-09-30T22:26:34.460680+0000","last_became_active":"2023-09-30T22:26:34.453179+0000","last_became_peered":"2023-09-30T22:26:34.453179+0000","last_unstale":"2023-09-30T22:26:34.460680+0000","last_undegraded":"2023-09-30T22:26:34.460680+0000","last_fullsized":"2023-09-30T22:26:34.460680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.468703+0000","last_change":"2023-09-30T22:26:34.457382+0000","last_active":"2023-09-30T22:26:34.468703+0000","last_peered":"2023-09-30T22:26:34.468703+0000","last_clean":"2023-09-30T22:26:34.468703+0000","last_became_active":"2023-09-30T22:26:34.457077+0000","last_became_peered":"2023-09-30T22:26:34.457077+0000","last_unstale":"2023-09-30T22:26:34.468703+0000","last_undegraded":"2023-09-30T22:26:34.468703+0000","last_fullsized":"2023-09-30T22:26:34.468703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470966+0000","last_change":"2023-09-30T22:26:34.463255+0000","last_active":"2023-09-30T22:26:34.470966+0000","last_peered":"2023-09-30T22:26:34.470966+0000","last_clean":"2023-09-30T22:26:34.470966+0000","last_became_active":"2023-09-30T22:26:34.462962+0000","last_became_peered":"2023-09-30T22:26:34.462962+0000","last_unstale":"2023-09-30T22:26:34.470966+0000","last_undegraded":"2023-09-30T22:26:34.470966+0000","last_fullsized":"2023-09-30T22:26:34.470966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470761+0000","last_change":"2023-09-30T22:26:34.458476+0000","last_active":"2023-09-30T22:26:34.470761+0000","last_peered":"2023-09-30T22:26:34.470761+0000","last_clean":"2023-09-30T22:26:34.470761+0000","last_became_active":"2023-09-30T22:26:34.458195+0000","last_became_peered":"2023-09-30T22:26:34.458195+0000","last_unstale":"2023-09-30T22:26:34.470761+0000","last_undegraded":"2023-09-30T22:26:34.470761+0000","last_fullsized":"2023-09-30T22:26:34.470761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.450508+0000","last_change":"2023-09-30T22:26:34.441003+0000","last_active":"2023-09-30T22:26:34.450508+0000","last_peered":"2023-09-30T22:26:34.450508+0000","last_clean":"2023-09-30T22:26:34.450508+0000","last_became_active":"2023-09-30T22:26:34.440470+0000","last_became_peered":"2023-09-30T22:26:34.440470+0000","last_unstale":"2023-09-30T22:26:34.450508+0000","last_undegraded":"2023-09-30T22:26:34.450508+0000","last_fullsized":"2023-09-30T22:26:34.450508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471250+0000","last_change":"2023-09-30T22:26:34.031319+0000","last_active":"2023-09-30T22:26:34.471250+0000","last_peered":"2023-09-30T22:26:34.471250+0000","last_clean":"2023-09-30T22:26:34.471250+0000","last_became_active":"2023-09-30T22:26:34.030475+0000","last_became_peered":"2023-09-30T22:26:34.030475+0000","last_unstale":"2023-09-30T22:26:34.471250+0000","last_undegraded":"2023-09-30T22:26:34.471250+0000","last_fullsized":"2023-09-30T22:26:34.471250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.428859+0000","last_change":"2023-09-30T22:26:34.036944+0000","last_active":"2023-09-30T22:26:34.428859+0000","last_peered":"2023-09-30T22:26:34.428859+0000","last_clean":"2023-09-30T22:26:34.428859+0000","last_became_active":"2023-09-30T22:26:34.036564+0000","last_became_peered":"2023-09-30T22:26:34.036564+0000","last_unstale":"2023-09-30T22:26:34.428859+0000","last_undegraded":"2023-09-30T22:26:34.428859+0000","last_fullsized":"2023-09-30T22:26:34.428859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.999358+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:33.002914+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998233+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470919+0000","last_change":"2023-09-30T22:26:34.462289+0000","last_active":"2023-09-30T22:26:34.470919+0000","last_peered":"2023-09-30T22:26:34.470919+0000","last_clean":"2023-09-30T22:26:34.470919+0000","last_became_active":"2023-09-30T22:26:34.461927+0000","last_became_peered":"2023-09-30T22:26:34.461927+0000","last_unstale":"2023-09-30T22:26:34.470919+0000","last_undegraded":"2023-09-30T22:26:34.470919+0000","last_fullsized":"2023-09-30T22:26:34.470919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998165+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471717+0000","last_change":"2023-09-30T22:26:34.041826+0000","last_active":"2023-09-30T22:26:34.471717+0000","last_peered":"2023-09-30T22:26:34.471717+0000","last_clean":"2023-09-30T22:26:34.471717+0000","last_became_active":"2023-09-30T22:26:34.041527+0000","last_became_peered":"2023-09-30T22:26:34.041527+0000","last_unstale":"2023-09-30T22:26:34.471717+0000","last_undegraded":"2023-09-30T22:26:34.471717+0000","last_fullsized":"2023-09-30T22:26:34.471717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998926+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:33.004406+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461265+0000","last_change":"2023-09-30T22:26:34.453594+0000","last_active":"2023-09-30T22:26:34.461265+0000","last_peered":"2023-09-30T22:26:34.461265+0000","last_clean":"2023-09-30T22:26:34.461265+0000","last_became_active":"2023-09-30T22:26:34.453288+0000","last_became_peered":"2023-09-30T22:26:34.453288+0000","last_unstale":"2023-09-30T22:26:34.461265+0000","last_undegraded":"2023-09-30T22:26:34.461265+0000","last_fullsized":"2023-09-30T22:26:34.461265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998177+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471281+0000","last_change":"2023-09-30T22:26:34.466480+0000","last_active":"2023-09-30T22:26:34.471281+0000","last_peered":"2023-09-30T22:26:34.471281+0000","last_clean":"2023-09-30T22:26:34.471281+0000","last_became_active":"2023-09-30T22:26:34.466187+0000","last_became_peered":"2023-09-30T22:26:34.466187+0000","last_unstale":"2023-09-30T22:26:34.471281+0000","last_undegraded":"2023-09-30T22:26:34.471281+0000","last_fullsized":"2023-09-30T22:26:34.471281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.440724+0000","last_change":"2023-09-30T22:26:30.873307+0000","last_active":"2023-09-30T22:26:34.440724+0000","last_peered":"2023-09-30T22:26:34.440724+0000","last_clean":"2023-09-30T22:26:34.440724+0000","last_became_active":"2023-09-30T22:26:30.872872+0000","last_became_peered":"2023-09-30T22:26:30.872872+0000","last_unstale":"2023-09-30T22:26:34.440724+0000","last_undegraded":"2023-09-30T22:26:34.440724+0000","last_fullsized":"2023-09-30T22:26:34.440724+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:33.002845+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470943+0000","last_change":"2023-09-30T22:26:34.462485+0000","last_active":"2023-09-30T22:26:34.470943+0000","last_peered":"2023-09-30T22:26:34.470943+0000","last_clean":"2023-09-30T22:26:34.470943+0000","last_became_active":"2023-09-30T22:26:34.454284+0000","last_became_peered":"2023-09-30T22:26:34.454284+0000","last_unstale":"2023-09-30T22:26:34.470943+0000","last_undegraded":"2023-09-30T22:26:34.470943+0000","last_fullsized":"2023-09-30T22:26:34.470943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-09-30T22:26:30.858397+0000","last_change":"2023-09-30T22:26:29.861644+0000","last_active":"2023-09-30T22:26:30.858397+0000","last_peered":"2023-09-30T22:26:30.858397+0000","last_clean":"2023-09-30T22:26:30.858397+0000","last_became_active":"2023-09-30T22:26:29.861261+0000","last_became_peered":"2023-09-30T22:26:29.861261+0000","last_unstale":"2023-09-30T22:26:30.858397+0000","last_undegraded":"2023-09-30T22:26:30.858397+0000","last_fullsized":"2023-09-30T22:26:30.858397+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.997254+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460658+0000","last_change":"2023-09-30T22:26:34.444993+0000","last_active":"2023-09-30T22:26:34.460658+0000","last_peered":"2023-09-30T22:26:34.460658+0000","last_clean":"2023-09-30T22:26:34.460658+0000","last_became_active":"2023-09-30T22:26:34.444739+0000","last_became_peered":"2023-09-30T22:26:34.444739+0000","last_unstale":"2023-09-30T22:26:34.460658+0000","last_undegraded":"2023-09-30T22:26:34.460658+0000","last_fullsized":"2023-09-30T22:26:34.460658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T22:26:31.856372+0000","last_change":"2023-09-30T22:26:29.858340+0000","last_active":"2023-09-30T22:26:31.856372+0000","last_peered":"2023-09-30T22:26:31.856372+0000","last_clean":"2023-09-30T22:26:31.856372+0000","last_became_active":"2023-09-30T22:26:29.857989+0000","last_became_peered":"2023-09-30T22:26:29.857989+0000","last_unstale":"2023-09-30T22:26:31.856372+0000","last_undegraded":"2023-09-30T22:26:31.856372+0000","last_fullsized":"2023-09-30T22:26:31.856372+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429669+0000","last_change":"2023-09-30T22:26:34.031173+0000","last_active":"2023-09-30T22:26:34.429669+0000","last_peered":"2023-09-30T22:26:34.429669+0000","last_clean":"2023-09-30T22:26:34.429669+0000","last_became_active":"2023-09-30T22:26:34.030863+0000","last_became_peered":"2023-09-30T22:26:34.030863+0000","last_unstale":"2023-09-30T22:26:34.429669+0000","last_undegraded":"2023-09-30T22:26:34.429669+0000","last_fullsized":"2023-09-30T22:26:34.429669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462678+0000","last_change":"2023-09-30T22:26:34.456017+0000","last_active":"2023-09-30T22:26:34.462678+0000","last_peered":"2023-09-30T22:26:34.462678+0000","last_clean":"2023-09-30T22:26:34.462678+0000","last_became_active":"2023-09-30T22:26:34.455744+0000","last_became_peered":"2023-09-30T22:26:34.455744+0000","last_unstale":"2023-09-30T22:26:34.462678+0000","last_undegraded":"2023-09-30T22:26:34.462678+0000","last_fullsized":"2023-09-30T22:26:34.462678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-09-30T22:26:30.858403+0000","last_change":"2023-09-30T22:26:29.859074+0000","last_active":"2023-09-30T22:26:30.858403+0000","last_peered":"2023-09-30T22:26:30.858403+0000","last_clean":"2023-09-30T22:26:30.858403+0000","last_became_active":"2023-09-30T22:26:29.858669+0000","last_became_peered":"2023-09-30T22:26:29.858669+0000","last_unstale":"2023-09-30T22:26:30.858403+0000","last_undegraded":"2023-09-30T22:26:30.858403+0000","last_fullsized":"2023-09-30T22:26:30.858403+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429553+0000","last_change":"2023-09-30T22:26:28.864097+0000","last_active":"2023-09-30T22:26:34.429553+0000","last_peered":"2023-09-30T22:26:34.429553+0000","last_clean":"2023-09-30T22:26:34.429553+0000","last_became_active":"2023-09-30T22:26:28.863723+0000","last_became_peered":"2023-09-30T22:26:28.863723+0000","last_unstale":"2023-09-30T22:26:34.429553+0000","last_undegraded":"2023-09-30T22:26:34.429553+0000","last_fullsized":"2023-09-30T22:26:34.429553+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_clean_scrub_stamp":"2023-09-30T22:26:27.842299+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-09-30T22:26:30.858388+0000","last_change":"2023-09-30T22:26:29.861337+0000","last_active":"2023-09-30T22:26:30.858388+0000","last_peered":"2023-09-30T22:26:30.858388+0000","last_clean":"2023-09-30T22:26:30.858388+0000","last_became_active":"2023-09-30T22:26:29.861003+0000","last_became_peered":"2023-09-30T22:26:29.861003+0000","last_unstale":"2023-09-30T22:26:30.858388+0000","last_undegraded":"2023-09-30T22:26:30.858388+0000","last_fullsized":"2023-09-30T22:26:30.858388+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.997647+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-09-30T22:26:30.878878+0000","last_change":"2023-09-30T22:26:30.874397+0000","last_active":"2023-09-30T22:26:30.878878+0000","last_peered":"2023-09-30T22:26:30.878878+0000","last_clean":"2023-09-30T22:26:30.878878+0000","last_became_active":"2023-09-30T22:26:30.874057+0000","last_became_peered":"2023-09-30T22:26:30.874057+0000","last_unstale":"2023-09-30T22:26:30.878878+0000","last_undegraded":"2023-09-30T22:26:30.878878+0000","last_fullsized":"2023-09-30T22:26:30.878878+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429371+0000","last_change":"2023-09-30T22:26:34.037126+0000","last_active":"2023-09-30T22:26:34.429371+0000","last_peered":"2023-09-30T22:26:34.429371+0000","last_clean":"2023-09-30T22:26:34.429371+0000","last_became_active":"2023-09-30T22:26:34.036825+0000","last_became_peered":"2023-09-30T22:26:34.036825+0000","last_unstale":"2023-09-30T22:26:34.429371+0000","last_undegraded":"2023-09-30T22:26:34.429371+0000","last_fullsized":"2023-09-30T22:26:34.429371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429047+0000","last_change":"2023-09-30T22:26:30.873252+0000","last_active":"2023-09-30T22:26:34.429047+0000","last_peered":"2023-09-30T22:26:34.429047+0000","last_clean":"2023-09-30T22:26:34.429047+0000","last_became_active":"2023-09-30T22:26:30.872894+0000","last_became_peered":"2023-09-30T22:26:30.872894+0000","last_unstale":"2023-09-30T22:26:34.429047+0000","last_undegraded":"2023-09-30T22:26:34.429047+0000","last_fullsized":"2023-09-30T22:26:34.429047+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-09-30T22:26:30.878898+0000","last_change":"2023-09-30T22:26:30.874887+0000","last_active":"2023-09-30T22:26:30.878898+0000","last_peered":"2023-09-30T22:26:30.878898+0000","last_clean":"2023-09-30T22:26:30.878898+0000","last_became_active":"2023-09-30T22:26:30.874533+0000","last_became_peered":"2023-09-30T22:26:30.874533+0000","last_unstale":"2023-09-30T22:26:30.878898+0000","last_undegraded":"2023-09-30T22:26:30.878898+0000","last_fullsized":"2023-09-30T22:26:30.878898+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998608+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998715+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471263+0000","last_change":"2023-09-30T22:26:34.045553+0000","last_active":"2023-09-30T22:26:34.471263+0000","last_peered":"2023-09-30T22:26:34.471263+0000","last_clean":"2023-09-30T22:26:34.471263+0000","last_became_active":"2023-09-30T22:26:34.045206+0000","last_became_peered":"2023-09-30T22:26:34.045206+0000","last_unstale":"2023-09-30T22:26:34.471263+0000","last_undegraded":"2023-09-30T22:26:34.471263+0000","last_fullsized":"2023-09-30T22:26:34.471263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:33.000124+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.451360+0000","last_change":"2023-09-30T22:26:34.441075+0000","last_active":"2023-09-30T22:26:34.451360+0000","last_peered":"2023-09-30T22:26:34.451360+0000","last_clean":"2023-09-30T22:26:34.451360+0000","last_became_active":"2023-09-30T22:26:34.440633+0000","last_became_peered":"2023-09-30T22:26:34.440633+0000","last_unstale":"2023-09-30T22:26:34.451360+0000","last_undegraded":"2023-09-30T22:26:34.451360+0000","last_fullsized":"2023-09-30T22:26:34.451360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.451971+0000","last_change":"2023-09-30T22:26:34.444740+0000","last_active":"2023-09-30T22:26:34.451971+0000","last_peered":"2023-09-30T22:26:34.451971+0000","last_clean":"2023-09-30T22:26:34.451971+0000","last_became_active":"2023-09-30T22:26:34.444385+0000","last_became_peered":"2023-09-30T22:26:34.444385+0000","last_unstale":"2023-09-30T22:26:34.451971+0000","last_undegraded":"2023-09-30T22:26:34.451971+0000","last_fullsized":"2023-09-30T22:26:34.451971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":38,"acting":38,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672962,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297212,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074628,"statfs":{"total":96636764160,"available":96332419072,"internally_reserved":0,"allocated":118784,"data_stored":32417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":0,"up_from":10,"seq":42949672962,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297212,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074628,"statfs":{"total":96636764160,"available":96332419072,"internally_reserved":0,"allocated":118784,"data_stored":32417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":51127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297216,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074624,"statfs":{"total":96636764160,"available":96332414976,"internally_reserved":0,"allocated":122880,"data_stored":33486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:26:38.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:26:39.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.059+0000 7f49e68d1700 1 Processor -- start 2023-09-30T22:26:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.059+0000 7f49e68d1700 1 -- start start 2023-09-30T22:26:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.059+0000 7f49e68d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e00965e0 0x7f49e00969c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49e68d1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49e0096eb0 0x7f49e0067de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49e68d1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e00933b0 con 0x7f49e00682d0 2023-09-30T22:26:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49e68d1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e0092190 con 0x7f49e0096eb0 2023-09-30T22:26:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49e68d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e0069a20 con 0x7f49e00965e0 2023-09-30T22:26:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49dffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e00965e0 0x7f49e00969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49df7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49e0096eb0 0x7f49e0067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49e4e6e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f49e00682d0 0x7f49e012ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45004/0 (socket says 172.21.15.59:45004) 2023-09-30T22:26:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49e4e6e700 1 -- 172.21.15.59:0/1364393849 learned_addr learned my addr 172.21.15.59:0/1364393849 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49df7fe700 1 -- 172.21.15.59:0/1364393849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e00965e0 msgr2=0x7f49e00969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49df7fe700 1 --2- 172.21.15.59:0/1364393849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e00965e0 0x7f49e00969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49df7fe700 1 -- 172.21.15.59:0/1364393849 >> v1:172.21.15.59:6789/0 conn(0x7f49e00682d0 legacy=0x7f49e012ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49deffd700 1 -- 172.21.15.59:0/1364393849 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584436568 0 0) 0x7f49e00933b0 con 0x7f49e00682d0 2023-09-30T22:26:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49df7fe700 1 -- 172.21.15.59:0/1364393849 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e0069ca0 con 0x7f49e0096eb0 2023-09-30T22:26:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49dffff700 1 --2- 172.21.15.59:0/1364393849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e00965e0 0x7f49e00969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49df7fe700 1 --2- 172.21.15.59:0/1364393849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e0096eb0 0x7f49e0067de0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f49c8009760 tx=0x7f49c8009060).ready entity=mon.0 client_cookie=2d606e61f65cc02c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49deffd700 1 -- 172.21.15.59:0/1364393849 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c800f510 con 0x7f49e0096eb0 2023-09-30T22:26:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49deffd700 1 -- 172.21.15.59:0/1364393849 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c800f670 con 0x7f49e0096eb0 2023-09-30T22:26:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.060+0000 7f49deffd700 1 -- 172.21.15.59:0/1364393849 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c800f9f0 con 0x7f49e0096eb0 2023-09-30T22:26:39.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.061+0000 7f49e68d1700 1 -- 172.21.15.59:0/1364393849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e0096eb0 msgr2=0x7f49e0067de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.061+0000 7f49e68d1700 1 --2- 172.21.15.59:0/1364393849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e0096eb0 0x7f49e0067de0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f49c8009760 tx=0x7f49c8009060).stop 2023-09-30T22:26:39.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.061+0000 7f49e68d1700 1 -- 172.21.15.59:0/1364393849 shutdown_connections 2023-09-30T22:26:39.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.061+0000 7f49e68d1700 1 --2- 172.21.15.59:0/1364393849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e00965e0 0x7f49e00969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.061+0000 7f49e68d1700 1 --2- 172.21.15.59:0/1364393849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e0096eb0 0x7f49e0067de0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.061+0000 7f49e68d1700 1 -- 172.21.15.59:0/1364393849 >> 172.21.15.59:0/1364393849 conn(0x7f49e009a220 msgr2=0x7f49e009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.061+0000 7f49e68d1700 1 -- 172.21.15.59:0/1364393849 shutdown_connections 2023-09-30T22:26:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.061+0000 7f49e68d1700 1 -- 172.21.15.59:0/1364393849 wait complete. 2023-09-30T22:26:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.062+0000 7f49e68d1700 1 Processor -- start 2023-09-30T22:26:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.062+0000 7f49e68d1700 1 -- start start 2023-09-30T22:26:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49e68d1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e00682d0 0x7f49e0138720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49e68d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49e00965e0 0x7f49e0138c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49e68d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e0096eb0 0x7f49e0115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49e68d1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e0132570 con 0x7f49e00682d0 2023-09-30T22:26:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49e68d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e0066720 con 0x7f49e0096eb0 2023-09-30T22:26:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49e68d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49e0091bf0 con 0x7f49e00965e0 2023-09-30T22:26:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49dffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e00682d0 0x7f49e0138720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49dffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e00682d0 0x7f49e0138720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54112/0 (socket says 172.21.15.59:54112) 2023-09-30T22:26:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49e4e6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e0096eb0 0x7f49e0115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49dffff700 1 -- 172.21.15.59:0/3452618022 learned_addr learned my addr 172.21.15.59:0/3452618022 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49df7fe700 1 --2- 172.21.15.59:0/3452618022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49e00965e0 0x7f49e0138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49dffff700 1 -- 172.21.15.59:0/3452618022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49e00965e0 msgr2=0x7f49e0138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49dffff700 1 --2- 172.21.15.59:0/3452618022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49e00965e0 0x7f49e0138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49dffff700 1 -- 172.21.15.59:0/3452618022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e0096eb0 msgr2=0x7f49e0115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49dffff700 1 --2- 172.21.15.59:0/3452618022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e0096eb0 0x7f49e0115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49dffff700 1 -- 172.21.15.59:0/3452618022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d00092a0 con 0x7f49e00682d0 2023-09-30T22:26:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49e4e6e700 1 --2- 172.21.15.59:0/3452618022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e0096eb0 0x7f49e0115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49dffff700 1 --2- 172.21.15.59:0/3452618022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e00682d0 0x7f49e0138720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f49d000ea20 tx=0x7f49d0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.063+0000 7f49d7fff700 1 -- 172.21.15.59:0/3452618022 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d000ee60 con 0x7f49e00682d0 2023-09-30T22:26:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.064+0000 7f49d7fff700 1 -- 172.21.15.59:0/3452618022 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d000c850 con 0x7f49e00682d0 2023-09-30T22:26:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.064+0000 7f49e68d1700 1 -- 172.21.15.59:0/3452618022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c80092a0 con 0x7f49e00682d0 2023-09-30T22:26:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.064+0000 7f49d7fff700 1 -- 172.21.15.59:0/3452618022 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d000cbd0 con 0x7f49e00682d0 2023-09-30T22:26:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.064+0000 7f49e68d1700 1 -- 172.21.15.59:0/3452618022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e0117910 con 0x7f49e00682d0 2023-09-30T22:26:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.064+0000 7f49d7fff700 1 -- 172.21.15.59:0/3452618022 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f49d001b400 con 0x7f49e00682d0 2023-09-30T22:26:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.065+0000 7f49d7fff700 1 -- 172.21.15.59:0/3452618022 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f49d003b4c0 con 0x7f49e00682d0 2023-09-30T22:26:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.065+0000 7f49e68d1700 1 -- 172.21.15.59:0/3452618022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e0119780 con 0x7f49e00682d0 2023-09-30T22:26:39.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.069+0000 7f49d7fff700 1 -- 172.21.15.59:0/3452618022 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f49d0019900 con 0x7f49e00682d0 2023-09-30T22:26:39.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.239+0000 7f49e68d1700 1 -- 172.21.15.59:0/3452618022 --> v1:172.21.15.59:6816/118188 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f49e005a260 con 0x7f49c002bb90 2023-09-30T22:26:39.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.246+0000 7f49d7fff700 1 -- 172.21.15.59:0/3452618022 <== mgr.4103 v1:172.21.15.59:6816/118188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+244491 (unknown 2965378022 0 395515892) 0x7f49e005a260 con 0x7f49c002bb90 2023-09-30T22:26:39.249 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:39.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.249+0000 7f49e68d1700 1 -- 172.21.15.59:0/3452618022 >> v1:172.21.15.59:6816/118188 conn(0x7f49c002bb90 legacy=0x7f49c002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.249+0000 7f49e68d1700 1 -- 172.21.15.59:0/3452618022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e00682d0 msgr2=0x7f49e0138720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.249+0000 7f49e68d1700 1 --2- 172.21.15.59:0/3452618022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e00682d0 0x7f49e0138720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f49d000ea20 tx=0x7f49d0009060).stop 2023-09-30T22:26:39.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.249+0000 7f49e68d1700 1 -- 172.21.15.59:0/3452618022 shutdown_connections 2023-09-30T22:26:39.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.249+0000 7f49e68d1700 1 --2- 172.21.15.59:0/3452618022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e0096eb0 0x7f49e0115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.249+0000 7f49e68d1700 1 --2- 172.21.15.59:0/3452618022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e00682d0 0x7f49e0138720 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.249+0000 7f49e68d1700 1 --2- 172.21.15.59:0/3452618022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49e00965e0 0x7f49e0138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.249+0000 7f49e68d1700 1 -- 172.21.15.59:0/3452618022 >> 172.21.15.59:0/3452618022 conn(0x7f49e009a220 msgr2=0x7f49e0099000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.249+0000 7f49e68d1700 1 -- 172.21.15.59:0/3452618022 shutdown_connections 2023-09-30T22:26:39.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.249+0000 7f49e68d1700 1 -- 172.21.15.59:0/3452618022 wait complete. 2023-09-30T22:26:39.252 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-09-30T22:26:39.262 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-09-30T22:26:37.725492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":90,"acting":90,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298460,"statfs":{"total":386547056640,"available":385329623040,"internally_reserved":0,"allocated":528384,"data_stored":149447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471021+0000","last_change":"2023-09-30T22:26:34.463260+0000","last_active":"2023-09-30T22:26:34.471021+0000","last_peered":"2023-09-30T22:26:34.471021+0000","last_clean":"2023-09-30T22:26:34.471021+0000","last_became_active":"2023-09-30T22:26:34.462981+0000","last_became_peered":"2023-09-30T22:26:34.462981+0000","last_unstale":"2023-09-30T22:26:34.471021+0000","last_undegraded":"2023-09-30T22:26:34.471021+0000","last_fullsized":"2023-09-30T22:26:34.471021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461140+0000","last_change":"2023-09-30T22:26:34.454512+0000","last_active":"2023-09-30T22:26:34.461140+0000","last_peered":"2023-09-30T22:26:34.461140+0000","last_clean":"2023-09-30T22:26:34.461140+0000","last_became_active":"2023-09-30T22:26:34.454222+0000","last_became_peered":"2023-09-30T22:26:34.454222+0000","last_unstale":"2023-09-30T22:26:34.461140+0000","last_undegraded":"2023-09-30T22:26:34.461140+0000","last_fullsized":"2023-09-30T22:26:34.461140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462004+0000","last_change":"2023-09-30T22:26:34.454698+0000","last_active":"2023-09-30T22:26:34.462004+0000","last_peered":"2023-09-30T22:26:34.462004+0000","last_clean":"2023-09-30T22:26:34.462004+0000","last_became_active":"2023-09-30T22:26:34.454060+0000","last_became_peered":"2023-09-30T22:26:34.454060+0000","last_unstale":"2023-09-30T22:26:34.462004+0000","last_undegraded":"2023-09-30T22:26:34.462004+0000","last_fullsized":"2023-09-30T22:26:34.462004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462123+0000","last_change":"2023-09-30T22:26:34.450497+0000","last_active":"2023-09-30T22:26:34.462123+0000","last_peered":"2023-09-30T22:26:34.462123+0000","last_clean":"2023-09-30T22:26:34.462123+0000","last_became_active":"2023-09-30T22:26:34.444267+0000","last_became_peered":"2023-09-30T22:26:34.444267+0000","last_unstale":"2023-09-30T22:26:34.462123+0000","last_undegraded":"2023-09-30T22:26:34.462123+0000","last_fullsized":"2023-09-30T22:26:34.462123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460680+0000","last_change":"2023-09-30T22:26:34.453484+0000","last_active":"2023-09-30T22:26:34.460680+0000","last_peered":"2023-09-30T22:26:34.460680+0000","last_clean":"2023-09-30T22:26:34.460680+0000","last_became_active":"2023-09-30T22:26:34.453179+0000","last_became_peered":"2023-09-30T22:26:34.453179+0000","last_unstale":"2023-09-30T22:26:34.460680+0000","last_undegraded":"2023-09-30T22:26:34.460680+0000","last_fullsized":"2023-09-30T22:26:34.460680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.468703+0000","last_change":"2023-09-30T22:26:34.457382+0000","last_active":"2023-09-30T22:26:34.468703+0000","last_peered":"2023-09-30T22:26:34.468703+0000","last_clean":"2023-09-30T22:26:34.468703+0000","last_became_active":"2023-09-30T22:26:34.457077+0000","last_became_peered":"2023-09-30T22:26:34.457077+0000","last_unstale":"2023-09-30T22:26:34.468703+0000","last_undegraded":"2023-09-30T22:26:34.468703+0000","last_fullsized":"2023-09-30T22:26:34.468703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470966+0000","last_change":"2023-09-30T22:26:34.463255+0000","last_active":"2023-09-30T22:26:34.470966+0000","last_peered":"2023-09-30T22:26:34.470966+0000","last_clean":"2023-09-30T22:26:34.470966+0000","last_became_active":"2023-09-30T22:26:34.462962+0000","last_became_peered":"2023-09-30T22:26:34.462962+0000","last_unstale":"2023-09-30T22:26:34.470966+0000","last_undegraded":"2023-09-30T22:26:34.470966+0000","last_fullsized":"2023-09-30T22:26:34.470966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470761+0000","last_change":"2023-09-30T22:26:34.458476+0000","last_active":"2023-09-30T22:26:34.470761+0000","last_peered":"2023-09-30T22:26:34.470761+0000","last_clean":"2023-09-30T22:26:34.470761+0000","last_became_active":"2023-09-30T22:26:34.458195+0000","last_became_peered":"2023-09-30T22:26:34.458195+0000","last_unstale":"2023-09-30T22:26:34.470761+0000","last_undegraded":"2023-09-30T22:26:34.470761+0000","last_fullsized":"2023-09-30T22:26:34.470761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.450508+0000","last_change":"2023-09-30T22:26:34.441003+0000","last_active":"2023-09-30T22:26:34.450508+0000","last_peered":"2023-09-30T22:26:34.450508+0000","last_clean":"2023-09-30T22:26:34.450508+0000","last_became_active":"2023-09-30T22:26:34.440470+0000","last_became_peered":"2023-09-30T22:26:34.440470+0000","last_unstale":"2023-09-30T22:26:34.450508+0000","last_undegraded":"2023-09-30T22:26:34.450508+0000","last_fullsized":"2023-09-30T22:26:34.450508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471250+0000","last_change":"2023-09-30T22:26:34.031319+0000","last_active":"2023-09-30T22:26:34.471250+0000","last_peered":"2023-09-30T22:26:34.471250+0000","last_clean":"2023-09-30T22:26:34.471250+0000","last_became_active":"2023-09-30T22:26:34.030475+0000","last_became_peered":"2023-09-30T22:26:34.030475+0000","last_unstale":"2023-09-30T22:26:34.471250+0000","last_undegraded":"2023-09-30T22:26:34.471250+0000","last_fullsized":"2023-09-30T22:26:34.471250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.428859+0000","last_change":"2023-09-30T22:26:34.036944+0000","last_active":"2023-09-30T22:26:34.428859+0000","last_peered":"2023-09-30T22:26:34.428859+0000","last_clean":"2023-09-30T22:26:34.428859+0000","last_became_active":"2023-09-30T22:26:34.036564+0000","last_became_peered":"2023-09-30T22:26:34.036564+0000","last_unstale":"2023-09-30T22:26:34.428859+0000","last_undegraded":"2023-09-30T22:26:34.428859+0000","last_fullsized":"2023-09-30T22:26:34.428859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.999358+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:33.002914+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998233+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470919+0000","last_change":"2023-09-30T22:26:34.462289+0000","last_active":"2023-09-30T22:26:34.470919+0000","last_peered":"2023-09-30T22:26:34.470919+0000","last_clean":"2023-09-30T22:26:34.470919+0000","last_became_active":"2023-09-30T22:26:34.461927+0000","last_became_peered":"2023-09-30T22:26:34.461927+0000","last_unstale":"2023-09-30T22:26:34.470919+0000","last_undegraded":"2023-09-30T22:26:34.470919+0000","last_fullsized":"2023-09-30T22:26:34.470919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998165+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471717+0000","last_change":"2023-09-30T22:26:34.041826+0000","last_active":"2023-09-30T22:26:34.471717+0000","last_peered":"2023-09-30T22:26:34.471717+0000","last_clean":"2023-09-30T22:26:34.471717+0000","last_became_active":"2023-09-30T22:26:34.041527+0000","last_became_peered":"2023-09-30T22:26:34.041527+0000","last_unstale":"2023-09-30T22:26:34.471717+0000","last_undegraded":"2023-09-30T22:26:34.471717+0000","last_fullsized":"2023-09-30T22:26:34.471717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998926+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:33.004406+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461265+0000","last_change":"2023-09-30T22:26:34.453594+0000","last_active":"2023-09-30T22:26:34.461265+0000","last_peered":"2023-09-30T22:26:34.461265+0000","last_clean":"2023-09-30T22:26:34.461265+0000","last_became_active":"2023-09-30T22:26:34.453288+0000","last_became_peered":"2023-09-30T22:26:34.453288+0000","last_unstale":"2023-09-30T22:26:34.461265+0000","last_undegraded":"2023-09-30T22:26:34.461265+0000","last_fullsized":"2023-09-30T22:26:34.461265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998177+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471281+0000","last_change":"2023-09-30T22:26:34.466480+0000","last_active":"2023-09-30T22:26:34.471281+0000","last_peered":"2023-09-30T22:26:34.471281+0000","last_clean":"2023-09-30T22:26:34.471281+0000","last_became_active":"2023-09-30T22:26:34.466187+0000","last_became_peered":"2023-09-30T22:26:34.466187+0000","last_unstale":"2023-09-30T22:26:34.471281+0000","last_undegraded":"2023-09-30T22:26:34.471281+0000","last_fullsized":"2023-09-30T22:26:34.471281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.440724+0000","last_change":"2023-09-30T22:26:30.873307+0000","last_active":"2023-09-30T22:26:34.440724+0000","last_peered":"2023-09-30T22:26:34.440724+0000","last_clean":"2023-09-30T22:26:34.440724+0000","last_became_active":"2023-09-30T22:26:30.872872+0000","last_became_peered":"2023-09-30T22:26:30.872872+0000","last_unstale":"2023-09-30T22:26:34.440724+0000","last_undegraded":"2023-09-30T22:26:34.440724+0000","last_fullsized":"2023-09-30T22:26:34.440724+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:33.002845+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470943+0000","last_change":"2023-09-30T22:26:34.462485+0000","last_active":"2023-09-30T22:26:34.470943+0000","last_peered":"2023-09-30T22:26:34.470943+0000","last_clean":"2023-09-30T22:26:34.470943+0000","last_became_active":"2023-09-30T22:26:34.454284+0000","last_became_peered":"2023-09-30T22:26:34.454284+0000","last_unstale":"2023-09-30T22:26:34.470943+0000","last_undegraded":"2023-09-30T22:26:34.470943+0000","last_fullsized":"2023-09-30T22:26:34.470943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-09-30T22:26:30.858397+0000","last_change":"2023-09-30T22:26:29.861644+0000","last_active":"2023-09-30T22:26:30.858397+0000","last_peered":"2023-09-30T22:26:30.858397+0000","last_clean":"2023-09-30T22:26:30.858397+0000","last_became_active":"2023-09-30T22:26:29.861261+0000","last_became_peered":"2023-09-30T22:26:29.861261+0000","last_unstale":"2023-09-30T22:26:30.858397+0000","last_undegraded":"2023-09-30T22:26:30.858397+0000","last_fullsized":"2023-09-30T22:26:30.858397+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.997254+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460658+0000","last_change":"2023-09-30T22:26:34.444993+0000","last_active":"2023-09-30T22:26:34.460658+0000","last_peered":"2023-09-30T22:26:34.460658+0000","last_clean":"2023-09-30T22:26:34.460658+0000","last_became_active":"2023-09-30T22:26:34.444739+0000","last_became_peered":"2023-09-30T22:26:34.444739+0000","last_unstale":"2023-09-30T22:26:34.460658+0000","last_undegraded":"2023-09-30T22:26:34.460658+0000","last_fullsized":"2023-09-30T22:26:34.460658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T22:26:31.856372+0000","last_change":"2023-09-30T22:26:29.858340+0000","last_active":"2023-09-30T22:26:31.856372+0000","last_peered":"2023-09-30T22:26:31.856372+0000","last_clean":"2023-09-30T22:26:31.856372+0000","last_became_active":"2023-09-30T22:26:29.857989+0000","last_became_peered":"2023-09-30T22:26:29.857989+0000","last_unstale":"2023-09-30T22:26:31.856372+0000","last_undegraded":"2023-09-30T22:26:31.856372+0000","last_fullsized":"2023-09-30T22:26:31.856372+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429669+0000","last_change":"2023-09-30T22:26:34.031173+0000","last_active":"2023-09-30T22:26:34.429669+0000","last_peered":"2023-09-30T22:26:34.429669+0000","last_clean":"2023-09-30T22:26:34.429669+0000","last_became_active":"2023-09-30T22:26:34.030863+0000","last_became_peered":"2023-09-30T22:26:34.030863+0000","last_unstale":"2023-09-30T22:26:34.429669+0000","last_undegraded":"2023-09-30T22:26:34.429669+0000","last_fullsized":"2023-09-30T22:26:34.429669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462678+0000","last_change":"2023-09-30T22:26:34.456017+0000","last_active":"2023-09-30T22:26:34.462678+0000","last_peered":"2023-09-30T22:26:34.462678+0000","last_clean":"2023-09-30T22:26:34.462678+0000","last_became_active":"2023-09-30T22:26:34.455744+0000","last_became_peered":"2023-09-30T22:26:34.455744+0000","last_unstale":"2023-09-30T22:26:34.462678+0000","last_undegraded":"2023-09-30T22:26:34.462678+0000","last_fullsized":"2023-09-30T22:26:34.462678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-09-30T22:26:30.858403+0000","last_change":"2023-09-30T22:26:29.859074+0000","last_active":"2023-09-30T22:26:30.858403+0000","last_peered":"2023-09-30T22:26:30.858403+0000","last_clean":"2023-09-30T22:26:30.858403+0000","last_became_active":"2023-09-30T22:26:29.858669+0000","last_became_peered":"2023-09-30T22:26:29.858669+0000","last_unstale":"2023-09-30T22:26:30.858403+0000","last_undegraded":"2023-09-30T22:26:30.858403+0000","last_fullsized":"2023-09-30T22:26:30.858403+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429553+0000","last_change":"2023-09-30T22:26:28.864097+0000","last_active":"2023-09-30T22:26:34.429553+0000","last_peered":"2023-09-30T22:26:34.429553+0000","last_clean":"2023-09-30T22:26:34.429553+0000","last_became_active":"2023-09-30T22:26:28.863723+0000","last_became_peered":"2023-09-30T22:26:28.863723+0000","last_unstale":"2023-09-30T22:26:34.429553+0000","last_undegraded":"2023-09-30T22:26:34.429553+0000","last_fullsized":"2023-09-30T22:26:34.429553+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_clean_scrub_stamp":"2023-09-30T22:26:27.842299+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-09-30T22:26:30.858388+0000","last_change":"2023-09-30T22:26:29.861337+0000","last_active":"2023-09-30T22:26:30.858388+0000","last_peered":"2023-09-30T22:26:30.858388+0000","last_clean":"2023-09-30T22:26:30.858388+0000","last_became_active":"2023-09-30T22:26:29.861003+0000","last_became_peered":"2023-09-30T22:26:29.861003+0000","last_unstale":"2023-09-30T22:26:30.858388+0000","last_undegraded":"2023-09-30T22:26:30.858388+0000","last_fullsized":"2023-09-30T22:26:30.858388+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.997647+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-09-30T22:26:30.878878+0000","last_change":"2023-09-30T22:26:30.874397+0000","last_active":"2023-09-30T22:26:30.878878+0000","last_peered":"2023-09-30T22:26:30.878878+0000","last_clean":"2023-09-30T22:26:30.878878+0000","last_became_active":"2023-09-30T22:26:30.874057+0000","last_became_peered":"2023-09-30T22:26:30.874057+0000","last_unstale":"2023-09-30T22:26:30.878878+0000","last_undegraded":"2023-09-30T22:26:30.878878+0000","last_fullsized":"2023-09-30T22:26:30.878878+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429371+0000","last_change":"2023-09-30T22:26:34.037126+0000","last_active":"2023-09-30T22:26:34.429371+0000","last_peered":"2023-09-30T22:26:34.429371+0000","last_clean":"2023-09-30T22:26:34.429371+0000","last_became_active":"2023-09-30T22:26:34.036825+0000","last_became_peered":"2023-09-30T22:26:34.036825+0000","last_unstale":"2023-09-30T22:26:34.429371+0000","last_undegraded":"2023-09-30T22:26:34.429371+0000","last_fullsized":"2023-09-30T22:26:34.429371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429047+0000","last_change":"2023-09-30T22:26:30.873252+0000","last_active":"2023-09-30T22:26:34.429047+0000","last_peered":"2023-09-30T22:26:34.429047+0000","last_clean":"2023-09-30T22:26:34.429047+0000","last_became_active":"2023-09-30T22:26:30.872894+0000","last_became_peered":"2023-09-30T22:26:30.872894+0000","last_unstale":"2023-09-30T22:26:34.429047+0000","last_undegraded":"2023-09-30T22:26:34.429047+0000","last_fullsized":"2023-09-30T22:26:34.429047+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-09-30T22:26:30.878898+0000","last_change":"2023-09-30T22:26:30.874887+0000","last_active":"2023-09-30T22:26:30.878898+0000","last_peered":"2023-09-30T22:26:30.878898+0000","last_clean":"2023-09-30T22:26:30.878898+0000","last_became_active":"2023-09-30T22:26:30.874533+0000","last_became_peered":"2023-09-30T22:26:30.874533+0000","last_unstale":"2023-09-30T22:26:30.878898+0000","last_undegraded":"2023-09-30T22:26:30.878898+0000","last_fullsized":"2023-09-30T22:26:30.878898+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998608+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.998715+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471263+0000","last_change":"2023-09-30T22:26:34.045553+0000","last_active":"2023-09-30T22:26:34.471263+0000","last_peered":"2023-09-30T22:26:34.471263+0000","last_clean":"2023-09-30T22:26:34.471263+0000","last_became_active":"2023-09-30T22:26:34.045206+0000","last_became_peered":"2023-09-30T22:26:34.045206+0000","last_unstale":"2023-09-30T22:26:34.471263+0000","last_undegraded":"2023-09-30T22:26:34.471263+0000","last_fullsized":"2023-09-30T22:26:34.471263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:32.990555+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:26:32.990555+0000","last_change":"2023-09-30T22:26:33.000124+0000","last_active":"2023-09-30T22:26:32.990555+0000","last_peered":"2023-09-30T22:26:32.990555+0000","last_clean":"2023-09-30T22:26:32.990555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:32.990555+0000","last_undegraded":"2023-09-30T22:26:32.990555+0000","last_fullsized":"2023-09-30T22:26:32.990555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.451360+0000","last_change":"2023-09-30T22:26:34.441075+0000","last_active":"2023-09-30T22:26:34.451360+0000","last_peered":"2023-09-30T22:26:34.451360+0000","last_clean":"2023-09-30T22:26:34.451360+0000","last_became_active":"2023-09-30T22:26:34.440633+0000","last_became_peered":"2023-09-30T22:26:34.440633+0000","last_unstale":"2023-09-30T22:26:34.451360+0000","last_undegraded":"2023-09-30T22:26:34.451360+0000","last_fullsized":"2023-09-30T22:26:34.451360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:26:33.994923+0000","last_change":"2023-09-30T22:26:33.994923+0000","last_active":"2023-09-30T22:26:33.994923+0000","last_peered":"2023-09-30T22:26:33.994923+0000","last_clean":"2023-09-30T22:26:33.994923+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:26:33.994923+0000","last_undegraded":"2023-09-30T22:26:33.994923+0000","last_fullsized":"2023-09-30T22:26:33.994923+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.451971+0000","last_change":"2023-09-30T22:26:34.444740+0000","last_active":"2023-09-30T22:26:34.451971+0000","last_peered":"2023-09-30T22:26:34.451971+0000","last_clean":"2023-09-30T22:26:34.451971+0000","last_became_active":"2023-09-30T22:26:34.444385+0000","last_became_peered":"2023-09-30T22:26:34.444385+0000","last_unstale":"2023-09-30T22:26:34.451971+0000","last_undegraded":"2023-09-30T22:26:34.451971+0000","last_fullsized":"2023-09-30T22:26:34.451971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":38,"acting":38,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672962,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297212,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074628,"statfs":{"total":96636764160,"available":96332419072,"internally_reserved":0,"allocated":118784,"data_stored":32417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":0,"up_from":10,"seq":42949672962,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297212,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074628,"statfs":{"total":96636764160,"available":96332419072,"internally_reserved":0,"allocated":118784,"data_stored":32417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":51127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297216,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074624,"statfs":{"total":96636764160,"available":96332414976,"internally_reserved":0,"allocated":122880,"data_stored":33486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:26:39.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-09-30T22:26:39.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-09-30T22:26:39.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-09-30T22:26:39.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-09-30T22:26:39.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2023-09-30T22:26:39.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-09-30T22:26:39.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-09-30T22:26:39.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2023-09-30T22:26:39.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-09-30T22:26:39.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-09-30T22:26:39.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-09-30T22:26:39.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-09-30T22:26:39.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2023-09-30T22:26:39.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-09-30T22:26:39.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-09-30T22:26:39.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2023-09-30T22:26:39.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-09-30T22:26:39.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-09-30T22:26:39.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-09-30T22:26:39.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-09-30T22:26:39.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-09-30T22:26:39.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.990555+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-09-30T22:26:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-09-30T22:26:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.999358+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:26:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-09-30T22:26:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-09-30T22:26:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:33.002914+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-30T22:26:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-09-30T22:26:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-09-30T22:26:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.998233+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:26:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-09-30T22:26:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.990555+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-09-30T22:26:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-09-30T22:26:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.990555+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-09-30T22:26:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-09-30T22:26:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.998165+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:26:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-09-30T22:26:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-09-30T22:26:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.990555+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-09-30T22:26:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-09-30T22:26:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-09-30T22:26:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.998926+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:26:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-09-30T22:26:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-09-30T22:26:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:33.004406+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-30T22:26:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-09-30T22:26:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.990555+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-09-30T22:26:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-09-30T22:26:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.998177+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:26:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-09-30T22:26:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-09-30T22:26:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.990555+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-09-30T22:26:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-09-30T22:26:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.990555+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-09-30T22:26:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-09-30T22:26:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.990555+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-09-30T22:26:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-09-30T22:26:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.990555+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-09-30T22:26:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:33.002845+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-30T22:26:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-09-30T22:26:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.997254+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:26:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-09-30T22:26:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.990555+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-09-30T22:26:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-09-30T22:26:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.997647+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:26:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-09-30T22:26:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-09-30T22:26:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-09-30T22:26:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.990555+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-09-30T22:26:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-09-30T22:26:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.998608+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:26:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-09-30T22:26:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-09-30T22:26:39.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.998715+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:26:39.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-09-30T22:26:39.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-09-30T22:26:39.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-09-30T22:26:39.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.990555+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-09-30T22:26:39.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-09-30T22:26:39.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:32.990555+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-09-30T22:26:39.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-09-30T22:26:39.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:26:32.990555+0000', 'last_change': '2023-09-30T22:26:33.000124+0000', 'last_active': '2023-09-30T22:26:32.990555+0000', 'last_peered': '2023-09-30T22:26:32.990555+0000', 'last_clean': '2023-09-30T22:26:32.990555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:32.990555+0000', 'last_undegraded': '2023-09-30T22:26:32.990555+0000', 'last_fullsized': '2023-09-30T22:26:32.990555+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:32.990555+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:26:39.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-09-30T22:26:39.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-09-30T22:26:39.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-09-30T22:26:39.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-09-30T22:26:39.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:26:33.994923+0000', 'last_change': '2023-09-30T22:26:33.994923+0000', 'last_active': '2023-09-30T22:26:33.994923+0000', 'last_peered': '2023-09-30T22:26:33.994923+0000', 'last_clean': '2023-09-30T22:26:33.994923+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:26:33.994923+0000', 'last_undegraded': '2023-09-30T22:26:33.994923+0000', 'last_fullsized': '2023-09-30T22:26:33.994923+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'last_clean_scrub_stamp': '2023-09-30T22:26:33.994923+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:26:39.285 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-30T22:26:39.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.432+0000 7f2d9f6a0700 1 Processor -- start 2023-09-30T22:26:39.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.432+0000 7f2d9f6a0700 1 -- start start 2023-09-30T22:26:39.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.432+0000 7f2d9f6a0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d98091b00 0x7f2d9812c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:39.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.432+0000 7f2d9f6a0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d9812ce60 0x7f2d9812f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:39.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.432+0000 7f2d9f6a0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d98096760 con 0x7f2d98096380 2023-09-30T22:26:39.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.432+0000 7f2d9f6a0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d98091ff0 con 0x7f2d9812ce60 2023-09-30T22:26:39.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.432+0000 7f2d9f6a0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d98092c80 con 0x7f2d98091b00 2023-09-30T22:26:39.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.432+0000 7f2d9cc3b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d98091b00 0x7f2d9812c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:39.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.432+0000 7f2d9dc3d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d9812ce60 0x7f2d9812f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:39.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.433+0000 7f2d9cc3b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d98091b00 0x7f2d9812c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42372/0 (socket says 172.21.15.59:42372) 2023-09-30T22:26:39.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.433+0000 7f2d9dc3d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d9812ce60 0x7f2d9812f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54126/0 (socket says 172.21.15.59:54126) 2023-09-30T22:26:39.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.433+0000 7f2d9d43c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2d98096380 0x7f2d98094730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45006/0 (socket says 172.21.15.59:45006) 2023-09-30T22:26:39.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.433+0000 7f2d9cc3b700 1 -- 172.21.15.59:0/2603420938 learned_addr learned my addr 172.21.15.59:0/2603420938 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:39.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.433+0000 7f2d9dc3d700 1 -- 172.21.15.59:0/2603420938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d98091b00 msgr2=0x7f2d9812c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:39.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.433+0000 7f2d9dc3d700 1 --2- 172.21.15.59:0/2603420938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d98091b00 0x7f2d9812c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.433+0000 7f2d9dc3d700 1 -- 172.21.15.59:0/2603420938 >> v1:172.21.15.59:6789/0 conn(0x7f2d98096380 legacy=0x7f2d98094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.433+0000 7f2d8ffff700 1 -- 172.21.15.59:0/2603420938 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234677248 0 0) 0x7f2d98096760 con 0x7f2d98096380 2023-09-30T22:26:39.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.433+0000 7f2d9dc3d700 1 -- 172.21.15.59:0/2603420938 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d98094e40 con 0x7f2d9812ce60 2023-09-30T22:26:39.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.433+0000 7f2d9cc3b700 1 --2- 172.21.15.59:0/2603420938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d98091b00 0x7f2d9812c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:39.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.433+0000 7f2d9dc3d700 1 --2- 172.21.15.59:0/2603420938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9812ce60 0x7f2d9812f250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2d90009e60 tx=0x7f2d90009780).ready entity=mon.0 client_cookie=3d65d788dcbc2ae1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.433+0000 7f2d8ffff700 1 -- 172.21.15.59:0/2603420938 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000e070 con 0x7f2d9812ce60 2023-09-30T22:26:39.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.433+0000 7f2d8ffff700 1 -- 172.21.15.59:0/2603420938 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9000bb60 con 0x7f2d9812ce60 2023-09-30T22:26:39.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.433+0000 7f2d8ffff700 1 -- 172.21.15.59:0/2603420938 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90012410 con 0x7f2d9812ce60 2023-09-30T22:26:39.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.434+0000 7f2d9f6a0700 1 -- 172.21.15.59:0/2603420938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9812ce60 msgr2=0x7f2d9812f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.434+0000 7f2d9f6a0700 1 --2- 172.21.15.59:0/2603420938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9812ce60 0x7f2d9812f250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2d90009e60 tx=0x7f2d90009780).stop 2023-09-30T22:26:39.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.434+0000 7f2d9f6a0700 1 -- 172.21.15.59:0/2603420938 shutdown_connections 2023-09-30T22:26:39.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.434+0000 7f2d9f6a0700 1 --2- 172.21.15.59:0/2603420938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9812ce60 0x7f2d9812f250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.434+0000 7f2d9f6a0700 1 --2- 172.21.15.59:0/2603420938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d98091b00 0x7f2d9812c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.434+0000 7f2d9f6a0700 1 -- 172.21.15.59:0/2603420938 >> 172.21.15.59:0/2603420938 conn(0x7f2d98097470 msgr2=0x7f2d98097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.434+0000 7f2d9f6a0700 1 -- 172.21.15.59:0/2603420938 shutdown_connections 2023-09-30T22:26:39.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.434+0000 7f2d9f6a0700 1 -- 172.21.15.59:0/2603420938 wait complete. 2023-09-30T22:26:39.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.435+0000 7f2d9f6a0700 1 Processor -- start 2023-09-30T22:26:39.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.435+0000 7f2d9f6a0700 1 -- start start 2023-09-30T22:26:39.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.435+0000 7f2d9f6a0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d98091b00 0x7f2d981297f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:39.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.435+0000 7f2d9f6a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d98096380 0x7f2d98129ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:39.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9f6a0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9812ce60 0x7f2d9812a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9f6a0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9812a6c0 con 0x7f2d9812ce60 2023-09-30T22:26:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9f6a0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9812ac90 con 0x7f2d98096380 2023-09-30T22:26:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9f6a0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d981157d0 con 0x7f2d98091b00 2023-09-30T22:26:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9d43c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d98091b00 0x7f2d981297f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9dc3d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9812ce60 0x7f2d9812a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9d43c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d98091b00 0x7f2d981297f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42382/0 (socket says 172.21.15.59:42382) 2023-09-30T22:26:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9d43c700 1 -- 172.21.15.59:0/1239313831 learned_addr learned my addr 172.21.15.59:0/1239313831 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9cc3b700 1 --2- 172.21.15.59:0/1239313831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d98096380 0x7f2d98129ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9dc3d700 1 -- 172.21.15.59:0/1239313831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d98091b00 msgr2=0x7f2d981297f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9dc3d700 1 --2- 172.21.15.59:0/1239313831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d98091b00 0x7f2d981297f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9dc3d700 1 -- 172.21.15.59:0/1239313831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d98096380 msgr2=0x7f2d98129ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9dc3d700 1 --2- 172.21.15.59:0/1239313831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d98096380 0x7f2d98129ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9dc3d700 1 -- 172.21.15.59:0/1239313831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8800b610 con 0x7f2d9812ce60 2023-09-30T22:26:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9d43c700 1 --2- 172.21.15.59:0/1239313831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d98091b00 0x7f2d981297f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9cc3b700 1 --2- 172.21.15.59:0/1239313831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d98096380 0x7f2d98129ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9dc3d700 1 --2- 172.21.15.59:0/1239313831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9812ce60 0x7f2d9812a1d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2d90014000 tx=0x7f2d90009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d8d7fa700 1 -- 172.21.15.59:0/1239313831 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90012410 con 0x7f2d9812ce60 2023-09-30T22:26:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d8d7fa700 1 -- 172.21.15.59:0/1239313831 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9001d630 con 0x7f2d9812ce60 2023-09-30T22:26:39.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d8d7fa700 1 -- 172.21.15.59:0/1239313831 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9001d9d0 con 0x7f2d9812ce60 2023-09-30T22:26:39.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9f6a0700 1 -- 172.21.15.59:0/1239313831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d90009a20 con 0x7f2d9812ce60 2023-09-30T22:26:39.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.436+0000 7f2d9f6a0700 1 -- 172.21.15.59:0/1239313831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d98116710 con 0x7f2d9812ce60 2023-09-30T22:26:39.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.437+0000 7f2d8d7fa700 1 -- 172.21.15.59:0/1239313831 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2d90003040 con 0x7f2d9812ce60 2023-09-30T22:26:39.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.437+0000 7f2d8d7fa700 1 -- 172.21.15.59:0/1239313831 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2d9003cad0 con 0x7f2d9812ce60 2023-09-30T22:26:39.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.438+0000 7f2d9f6a0700 1 -- 172.21.15.59:0/1239313831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d98116710 con 0x7f2d9812ce60 2023-09-30T22:26:39.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.442+0000 7f2d8d7fa700 1 -- 172.21.15.59:0/1239313831 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2d98116710 con 0x7f2d9812ce60 2023-09-30T22:26:39.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.685+0000 7f2d9f6a0700 1 -- 172.21.15.59:0/1239313831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2d98115ad0 con 0x7f2d9812ce60 2023-09-30T22:26:39.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.685+0000 7f2d8d7fa700 1 -- 172.21.15.59:0/1239313831 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1107 (secure 0 0 0) 0x7f2d98115ad0 con 0x7f2d9812ce60 2023-09-30T22:26:39.685 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:39.686 INFO:teuthology.orchestra.run.smithi059.stdout:{"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":20,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":18,"num_osds":4,"num_up_osds":4,"osd_up_since":1696112787,"num_in_osds":4,"osd_in_since":1696112780,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":60},{"state_name":"active+clean","count":32},{"state_name":"creating+peering","count":13}],"num_pgs":105,"num_pools":4,"num_objects":5,"data_bytes":0,"bytes_used":1217433600,"bytes_avail":385329623040,"bytes_total":386547056640,"unknown_pgs_ratio":0.57142859697341919,"inactive_pgs_ratio":0.12380952388048172},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4181}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-09-30T22:26:18.890064+0000","services":{}},"progress_events":{}} 2023-09-30T22:26:39.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.687+0000 7f2d9f6a0700 1 -- 172.21.15.59:0/1239313831 >> v1:172.21.15.59:6816/118188 conn(0x7f2d7c02bb90 legacy=0x7f2d7c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.687+0000 7f2d9f6a0700 1 -- 172.21.15.59:0/1239313831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9812ce60 msgr2=0x7f2d9812a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.687+0000 7f2d9f6a0700 1 --2- 172.21.15.59:0/1239313831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9812ce60 0x7f2d9812a1d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2d90014000 tx=0x7f2d90009780).stop 2023-09-30T22:26:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.687+0000 7f2d9f6a0700 1 -- 172.21.15.59:0/1239313831 shutdown_connections 2023-09-30T22:26:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.687+0000 7f2d9f6a0700 1 --2- 172.21.15.59:0/1239313831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d98091b00 0x7f2d981297f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.687+0000 7f2d9f6a0700 1 --2- 172.21.15.59:0/1239313831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9812ce60 0x7f2d9812a1d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.687+0000 7f2d9f6a0700 1 --2- 172.21.15.59:0/1239313831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d98096380 0x7f2d98129ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.687+0000 7f2d9f6a0700 1 -- 172.21.15.59:0/1239313831 >> 172.21.15.59:0/1239313831 conn(0x7f2d98097470 msgr2=0x7f2d98059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.687+0000 7f2d9f6a0700 1 -- 172.21.15.59:0/1239313831 shutdown_connections 2023-09-30T22:26:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.687+0000 7f2d9f6a0700 1 -- 172.21.15.59:0/1239313831 wait complete. 2023-09-30T22:26:39.700 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-09-30T22:26:39.701 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:26:39.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.832+0000 7f8f4776a700 1 Processor -- start 2023-09-30T22:26:39.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.832+0000 7f8f4776a700 1 -- start start 2023-09-30T22:26:39.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f4776a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f40096380 0x7f8f40094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:39.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f4776a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f40094c20 0x7f8f40127d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f4776a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f40096760 con 0x7f8f40091b00 2023-09-30T22:26:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f4776a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f40091ff0 con 0x7f8f40094c20 2023-09-30T22:26:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f4776a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f40092c80 con 0x7f8f40096380 2023-09-30T22:26:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f45506700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f40096380 0x7f8f40094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f45d07700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f40094c20 0x7f8f40127d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f44d05700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8f40091b00 0x7f8f40127600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45018/0 (socket says 172.21.15.59:45018) 2023-09-30T22:26:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f45506700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f40096380 0x7f8f40094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42396/0 (socket says 172.21.15.59:42396) 2023-09-30T22:26:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f44d05700 1 -- 172.21.15.59:0/722625864 learned_addr learned my addr 172.21.15.59:0/722625864 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f33fff700 1 -- 172.21.15.59:0/722625864 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267619375 0 0) 0x7f8f40096760 con 0x7f8f40091b00 2023-09-30T22:26:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f33fff700 1 -- 172.21.15.59:0/722625864 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f2c0033f0 con 0x7f8f40091b00 2023-09-30T22:26:39.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f45d07700 1 -- 172.21.15.59:0/722625864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f40096380 msgr2=0x7f8f40094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:39.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f45d07700 1 --2- 172.21.15.59:0/722625864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f40096380 0x7f8f40094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f45d07700 1 -- 172.21.15.59:0/722625864 >> v1:172.21.15.59:6789/0 conn(0x7f8f40091b00 legacy=0x7f8f40127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f45d07700 1 -- 172.21.15.59:0/722625864 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f40093900 con 0x7f8f40094c20 2023-09-30T22:26:39.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.833+0000 7f8f45506700 1 --2- 172.21.15.59:0/722625864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f40096380 0x7f8f40094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:39.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.834+0000 7f8f45d07700 1 --2- 172.21.15.59:0/722625864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f40094c20 0x7f8f40127d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8f38009e90 tx=0x7f8f38009780).ready entity=mon.0 client_cookie=350d672e31ad58a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.834+0000 7f8f33fff700 1 -- 172.21.15.59:0/722625864 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3800e070 con 0x7f8f40094c20 2023-09-30T22:26:39.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.834+0000 7f8f33fff700 1 -- 172.21.15.59:0/722625864 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3800ba70 con 0x7f8f40094c20 2023-09-30T22:26:39.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.834+0000 7f8f33fff700 1 -- 172.21.15.59:0/722625864 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3800bdf0 con 0x7f8f40094c20 2023-09-30T22:26:39.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.834+0000 7f8f4776a700 1 -- 172.21.15.59:0/722625864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f40094c20 msgr2=0x7f8f40127d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.834+0000 7f8f4776a700 1 --2- 172.21.15.59:0/722625864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f40094c20 0x7f8f40127d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8f38009e90 tx=0x7f8f38009780).stop 2023-09-30T22:26:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.834+0000 7f8f4776a700 1 -- 172.21.15.59:0/722625864 shutdown_connections 2023-09-30T22:26:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.834+0000 7f8f4776a700 1 --2- 172.21.15.59:0/722625864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f40094c20 0x7f8f40127d10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.834+0000 7f8f4776a700 1 --2- 172.21.15.59:0/722625864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f40096380 0x7f8f40094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.834+0000 7f8f4776a700 1 -- 172.21.15.59:0/722625864 >> 172.21.15.59:0/722625864 conn(0x7f8f40097470 msgr2=0x7f8f40097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.834+0000 7f8f4776a700 1 -- 172.21.15.59:0/722625864 shutdown_connections 2023-09-30T22:26:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.834+0000 7f8f4776a700 1 -- 172.21.15.59:0/722625864 wait complete. 2023-09-30T22:26:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.835+0000 7f8f4776a700 1 Processor -- start 2023-09-30T22:26:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.835+0000 7f8f4776a700 1 -- start start 2023-09-30T22:26:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.836+0000 7f8f4776a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f40091b00 0x7f8f40123f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.836+0000 7f8f4776a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f40094c20 0x7f8f40124480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.836+0000 7f8f4776a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f40096380 0x7f8f40125510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.836+0000 7f8f4776a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f40127b90 con 0x7f8f40096380 2023-09-30T22:26:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.836+0000 7f8f4776a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4006a520 con 0x7f8f40094c20 2023-09-30T22:26:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.836+0000 7f8f4776a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4011bb20 con 0x7f8f40091b00 2023-09-30T22:26:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.836+0000 7f8f45506700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f40091b00 0x7f8f40123f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.836+0000 7f8f44d05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f40094c20 0x7f8f40124480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.836+0000 7f8f45506700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f40091b00 0x7f8f40123f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42408/0 (socket says 172.21.15.59:42408) 2023-09-30T22:26:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.836+0000 7f8f45d07700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f40096380 0x7f8f40125510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.836+0000 7f8f45506700 1 -- 172.21.15.59:0/511382517 learned_addr learned my addr 172.21.15.59:0/511382517 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.836+0000 7f8f45506700 1 -- 172.21.15.59:0/511382517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f40094c20 msgr2=0x7f8f40124480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.836+0000 7f8f45506700 1 --2- 172.21.15.59:0/511382517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f40094c20 0x7f8f40124480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.836+0000 7f8f45506700 1 -- 172.21.15.59:0/511382517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f40096380 msgr2=0x7f8f40125510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.836+0000 7f8f45506700 1 --2- 172.21.15.59:0/511382517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f40096380 0x7f8f40125510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.837+0000 7f8f45506700 1 -- 172.21.15.59:0/511382517 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c0092a0 con 0x7f8f40091b00 2023-09-30T22:26:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.837+0000 7f8f45d07700 1 --2- 172.21.15.59:0/511382517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f40096380 0x7f8f40125510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.837+0000 7f8f45506700 1 --2- 172.21.15.59:0/511382517 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f40091b00 0x7f8f40123f90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f8f3c00ea50 tx=0x7f8f3c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.837+0000 7f8f317fa700 1 -- 172.21.15.59:0/511382517 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00ee90 con 0x7f8f40091b00 2023-09-30T22:26:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.837+0000 7f8f317fa700 1 -- 172.21.15.59:0/511382517 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c009600 con 0x7f8f40091b00 2023-09-30T22:26:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.837+0000 7f8f4776a700 1 -- 172.21.15.59:0/511382517 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f38009a20 con 0x7f8f40091b00 2023-09-30T22:26:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.837+0000 7f8f317fa700 1 -- 172.21.15.59:0/511382517 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00ca60 con 0x7f8f40091b00 2023-09-30T22:26:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.837+0000 7f8f4776a700 1 -- 172.21.15.59:0/511382517 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f401269a0 con 0x7f8f40091b00 2023-09-30T22:26:39.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.838+0000 7f8f4776a700 1 -- 172.21.15.59:0/511382517 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4011aa20 con 0x7f8f40091b00 2023-09-30T22:26:39.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.839+0000 7f8f317fa700 1 -- 172.21.15.59:0/511382517 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8f3c01b400 con 0x7f8f40091b00 2023-09-30T22:26:39.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.839+0000 7f8f317fa700 1 -- 172.21.15.59:0/511382517 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8f3c03b8a0 con 0x7f8f40091b00 2023-09-30T22:26:39.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:39.845+0000 7f8f317fa700 1 -- 172.21.15.59:0/511382517 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8f3c011350 con 0x7f8f40091b00 2023-09-30T22:26:39.987 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-09-30T22:26:39.987+0000 7f576bcbd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:26:40.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:40.018+0000 7f8f4776a700 1 -- 172.21.15.59:0/511382517 --> v1:172.21.15.59:6816/118188 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8f4005a260 con 0x7f8f2402bb60 2023-09-30T22:26:40.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:40.025+0000 7f8f317fa700 1 -- 172.21.15.59:0/511382517 <== mgr.4103 v1:172.21.15.59:6816/118188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250018 (unknown 2965378022 0 969977904) 0x7f8f4005a260 con 0x7f8f2402bb60 2023-09-30T22:26:40.031 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:40.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:40.028+0000 7f8f4776a700 1 -- 172.21.15.59:0/511382517 >> v1:172.21.15.59:6816/118188 conn(0x7f8f2402bb60 legacy=0x7f8f2402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:40.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:40.028+0000 7f8f4776a700 1 -- 172.21.15.59:0/511382517 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f40091b00 msgr2=0x7f8f40123f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:40.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:40.028+0000 7f8f4776a700 1 --2- 172.21.15.59:0/511382517 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f40091b00 0x7f8f40123f90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f8f3c00ea50 tx=0x7f8f3c009060).stop 2023-09-30T22:26:40.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:40.028+0000 7f8f4776a700 1 -- 172.21.15.59:0/511382517 shutdown_connections 2023-09-30T22:26:40.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:40.028+0000 7f8f4776a700 1 --2- 172.21.15.59:0/511382517 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f40091b00 0x7f8f40123f90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:40.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:40.028+0000 7f8f4776a700 1 --2- 172.21.15.59:0/511382517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f40096380 0x7f8f40125510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:40.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:40.028+0000 7f8f4776a700 1 --2- 172.21.15.59:0/511382517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f40094c20 0x7f8f40124480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:40.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:40.028+0000 7f8f4776a700 1 -- 172.21.15.59:0/511382517 >> 172.21.15.59:0/511382517 conn(0x7f8f40097470 msgr2=0x7f8f400684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:40.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:40.028+0000 7f8f4776a700 1 -- 172.21.15.59:0/511382517 shutdown_connections 2023-09-30T22:26:40.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:40.028+0000 7f8f4776a700 1 -- 172.21.15.59:0/511382517 wait complete. 2023-09-30T22:26:40.037 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-09-30T22:26:40.041 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-09-30T22:26:39.725841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189040,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298320,"statfs":{"total":386547056640,"available":385329479680,"internally_reserved":0,"allocated":671744,"data_stored":200125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000348"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460233+0000","last_change":"2023-09-30T22:26:34.447805+0000","last_active":"2023-09-30T22:26:34.460233+0000","last_peered":"2023-09-30T22:26:34.460233+0000","last_clean":"2023-09-30T22:26:34.460233+0000","last_became_active":"2023-09-30T22:26:34.447480+0000","last_became_peered":"2023-09-30T22:26:34.447480+0000","last_unstale":"2023-09-30T22:26:34.460233+0000","last_undegraded":"2023-09-30T22:26:34.460233+0000","last_fullsized":"2023-09-30T22:26:34.460233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.441095+0000","last_change":"2023-09-30T22:26:34.440046+0000","last_active":"2023-09-30T22:26:34.441095+0000","last_peered":"2023-09-30T22:26:34.441095+0000","last_clean":"2023-09-30T22:26:34.441095+0000","last_became_active":"2023-09-30T22:26:34.439718+0000","last_became_peered":"2023-09-30T22:26:34.439718+0000","last_unstale":"2023-09-30T22:26:34.441095+0000","last_undegraded":"2023-09-30T22:26:34.441095+0000","last_fullsized":"2023-09-30T22:26:34.441095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460661+0000","last_change":"2023-09-30T22:26:34.457031+0000","last_active":"2023-09-30T22:26:34.460661+0000","last_peered":"2023-09-30T22:26:34.460661+0000","last_clean":"2023-09-30T22:26:34.460661+0000","last_became_active":"2023-09-30T22:26:34.456552+0000","last_became_peered":"2023-09-30T22:26:34.456552+0000","last_unstale":"2023-09-30T22:26:34.460661+0000","last_undegraded":"2023-09-30T22:26:34.460661+0000","last_fullsized":"2023-09-30T22:26:34.460661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459584+0000","last_change":"2023-09-30T22:26:34.456744+0000","last_active":"2023-09-30T22:26:34.459584+0000","last_peered":"2023-09-30T22:26:34.459584+0000","last_clean":"2023-09-30T22:26:34.459584+0000","last_became_active":"2023-09-30T22:26:34.456441+0000","last_became_peered":"2023-09-30T22:26:34.456441+0000","last_unstale":"2023-09-30T22:26:34.459584+0000","last_undegraded":"2023-09-30T22:26:34.459584+0000","last_fullsized":"2023-09-30T22:26:34.459584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459464+0000","last_change":"2023-09-30T22:26:34.454395+0000","last_active":"2023-09-30T22:26:34.459464+0000","last_peered":"2023-09-30T22:26:34.459464+0000","last_clean":"2023-09-30T22:26:34.459464+0000","last_became_active":"2023-09-30T22:26:34.454106+0000","last_became_peered":"2023-09-30T22:26:34.454106+0000","last_unstale":"2023-09-30T22:26:34.459464+0000","last_undegraded":"2023-09-30T22:26:34.459464+0000","last_fullsized":"2023-09-30T22:26:34.459464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454476+0000","last_change":"2023-09-30T22:26:34.446348+0000","last_active":"2023-09-30T22:26:34.454476+0000","last_peered":"2023-09-30T22:26:34.454476+0000","last_clean":"2023-09-30T22:26:34.454476+0000","last_became_active":"2023-09-30T22:26:34.444457+0000","last_became_peered":"2023-09-30T22:26:34.444457+0000","last_unstale":"2023-09-30T22:26:34.454476+0000","last_undegraded":"2023-09-30T22:26:34.454476+0000","last_fullsized":"2023-09-30T22:26:34.454476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454968+0000","last_change":"2023-09-30T22:26:34.450051+0000","last_active":"2023-09-30T22:26:34.454968+0000","last_peered":"2023-09-30T22:26:34.454968+0000","last_clean":"2023-09-30T22:26:34.454968+0000","last_became_active":"2023-09-30T22:26:34.449264+0000","last_became_peered":"2023-09-30T22:26:34.449264+0000","last_unstale":"2023-09-30T22:26:34.454968+0000","last_undegraded":"2023-09-30T22:26:34.454968+0000","last_fullsized":"2023-09-30T22:26:34.454968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471021+0000","last_change":"2023-09-30T22:26:34.463260+0000","last_active":"2023-09-30T22:26:34.471021+0000","last_peered":"2023-09-30T22:26:34.471021+0000","last_clean":"2023-09-30T22:26:34.471021+0000","last_became_active":"2023-09-30T22:26:34.462981+0000","last_became_peered":"2023-09-30T22:26:34.462981+0000","last_unstale":"2023-09-30T22:26:34.471021+0000","last_undegraded":"2023-09-30T22:26:34.471021+0000","last_fullsized":"2023-09-30T22:26:34.471021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.455028+0000","last_change":"2023-09-30T22:26:34.451111+0000","last_active":"2023-09-30T22:26:34.455028+0000","last_peered":"2023-09-30T22:26:34.455028+0000","last_clean":"2023-09-30T22:26:34.455028+0000","last_became_active":"2023-09-30T22:26:34.450521+0000","last_became_peered":"2023-09-30T22:26:34.450521+0000","last_unstale":"2023-09-30T22:26:34.455028+0000","last_undegraded":"2023-09-30T22:26:34.455028+0000","last_fullsized":"2023-09-30T22:26:34.455028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461140+0000","last_change":"2023-09-30T22:26:34.454512+0000","last_active":"2023-09-30T22:26:34.461140+0000","last_peered":"2023-09-30T22:26:34.461140+0000","last_clean":"2023-09-30T22:26:34.461140+0000","last_became_active":"2023-09-30T22:26:34.454222+0000","last_became_peered":"2023-09-30T22:26:34.454222+0000","last_unstale":"2023-09-30T22:26:34.461140+0000","last_undegraded":"2023-09-30T22:26:34.461140+0000","last_fullsized":"2023-09-30T22:26:34.461140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462004+0000","last_change":"2023-09-30T22:26:34.454698+0000","last_active":"2023-09-30T22:26:34.462004+0000","last_peered":"2023-09-30T22:26:34.462004+0000","last_clean":"2023-09-30T22:26:34.462004+0000","last_became_active":"2023-09-30T22:26:34.454060+0000","last_became_peered":"2023-09-30T22:26:34.454060+0000","last_unstale":"2023-09-30T22:26:34.462004+0000","last_undegraded":"2023-09-30T22:26:34.462004+0000","last_fullsized":"2023-09-30T22:26:34.462004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460500+0000","last_change":"2023-09-30T22:26:34.447740+0000","last_active":"2023-09-30T22:26:34.460500+0000","last_peered":"2023-09-30T22:26:34.460500+0000","last_clean":"2023-09-30T22:26:34.460500+0000","last_became_active":"2023-09-30T22:26:34.447444+0000","last_became_peered":"2023-09-30T22:26:34.447444+0000","last_unstale":"2023-09-30T22:26:34.460500+0000","last_undegraded":"2023-09-30T22:26:34.460500+0000","last_fullsized":"2023-09-30T22:26:34.460500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460341+0000","last_change":"2023-09-30T22:26:34.454342+0000","last_active":"2023-09-30T22:26:34.460341+0000","last_peered":"2023-09-30T22:26:34.460341+0000","last_clean":"2023-09-30T22:26:34.460341+0000","last_became_active":"2023-09-30T22:26:34.454063+0000","last_became_peered":"2023-09-30T22:26:34.454063+0000","last_unstale":"2023-09-30T22:26:34.460341+0000","last_undegraded":"2023-09-30T22:26:34.460341+0000","last_fullsized":"2023-09-30T22:26:34.460341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462123+0000","last_change":"2023-09-30T22:26:34.450497+0000","last_active":"2023-09-30T22:26:34.462123+0000","last_peered":"2023-09-30T22:26:34.462123+0000","last_clean":"2023-09-30T22:26:34.462123+0000","last_became_active":"2023-09-30T22:26:34.444267+0000","last_became_peered":"2023-09-30T22:26:34.444267+0000","last_unstale":"2023-09-30T22:26:34.462123+0000","last_undegraded":"2023-09-30T22:26:34.462123+0000","last_fullsized":"2023-09-30T22:26:34.462123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459426+0000","last_change":"2023-09-30T22:26:34.455898+0000","last_active":"2023-09-30T22:26:34.459426+0000","last_peered":"2023-09-30T22:26:34.459426+0000","last_clean":"2023-09-30T22:26:34.459426+0000","last_became_active":"2023-09-30T22:26:34.455631+0000","last_became_peered":"2023-09-30T22:26:34.455631+0000","last_unstale":"2023-09-30T22:26:34.459426+0000","last_undegraded":"2023-09-30T22:26:34.459426+0000","last_fullsized":"2023-09-30T22:26:34.459426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.452608+0000","last_change":"2023-09-30T22:26:34.447910+0000","last_active":"2023-09-30T22:26:34.452608+0000","last_peered":"2023-09-30T22:26:34.452608+0000","last_clean":"2023-09-30T22:26:34.452608+0000","last_became_active":"2023-09-30T22:26:34.447627+0000","last_became_peered":"2023-09-30T22:26:34.447627+0000","last_unstale":"2023-09-30T22:26:34.452608+0000","last_undegraded":"2023-09-30T22:26:34.452608+0000","last_fullsized":"2023-09-30T22:26:34.452608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.455048+0000","last_change":"2023-09-30T22:26:34.451250+0000","last_active":"2023-09-30T22:26:34.455048+0000","last_peered":"2023-09-30T22:26:34.455048+0000","last_clean":"2023-09-30T22:26:34.455048+0000","last_became_active":"2023-09-30T22:26:34.450879+0000","last_became_peered":"2023-09-30T22:26:34.450879+0000","last_unstale":"2023-09-30T22:26:34.455048+0000","last_undegraded":"2023-09-30T22:26:34.455048+0000","last_fullsized":"2023-09-30T22:26:34.455048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.446179+0000","last_change":"2023-09-30T22:26:34.440788+0000","last_active":"2023-09-30T22:26:34.446179+0000","last_peered":"2023-09-30T22:26:34.446179+0000","last_clean":"2023-09-30T22:26:34.446179+0000","last_became_active":"2023-09-30T22:26:34.440404+0000","last_became_peered":"2023-09-30T22:26:34.440404+0000","last_unstale":"2023-09-30T22:26:34.446179+0000","last_undegraded":"2023-09-30T22:26:34.446179+0000","last_fullsized":"2023-09-30T22:26:34.446179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459186+0000","last_change":"2023-09-30T22:26:34.445791+0000","last_active":"2023-09-30T22:26:34.459186+0000","last_peered":"2023-09-30T22:26:34.459186+0000","last_clean":"2023-09-30T22:26:34.459186+0000","last_became_active":"2023-09-30T22:26:34.445478+0000","last_became_peered":"2023-09-30T22:26:34.445478+0000","last_unstale":"2023-09-30T22:26:34.459186+0000","last_undegraded":"2023-09-30T22:26:34.459186+0000","last_fullsized":"2023-09-30T22:26:34.459186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460680+0000","last_change":"2023-09-30T22:26:34.453484+0000","last_active":"2023-09-30T22:26:34.460680+0000","last_peered":"2023-09-30T22:26:34.460680+0000","last_clean":"2023-09-30T22:26:34.460680+0000","last_became_active":"2023-09-30T22:26:34.453179+0000","last_became_peered":"2023-09-30T22:26:34.453179+0000","last_unstale":"2023-09-30T22:26:34.460680+0000","last_undegraded":"2023-09-30T22:26:34.460680+0000","last_fullsized":"2023-09-30T22:26:34.460680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.468703+0000","last_change":"2023-09-30T22:26:34.457382+0000","last_active":"2023-09-30T22:26:34.468703+0000","last_peered":"2023-09-30T22:26:34.468703+0000","last_clean":"2023-09-30T22:26:34.468703+0000","last_became_active":"2023-09-30T22:26:34.457077+0000","last_became_peered":"2023-09-30T22:26:34.457077+0000","last_unstale":"2023-09-30T22:26:34.468703+0000","last_undegraded":"2023-09-30T22:26:34.468703+0000","last_fullsized":"2023-09-30T22:26:34.468703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470286+0000","last_change":"2023-09-30T22:26:34.465060+0000","last_active":"2023-09-30T22:26:34.470286+0000","last_peered":"2023-09-30T22:26:34.470286+0000","last_clean":"2023-09-30T22:26:34.470286+0000","last_became_active":"2023-09-30T22:26:34.464780+0000","last_became_peered":"2023-09-30T22:26:34.464780+0000","last_unstale":"2023-09-30T22:26:34.470286+0000","last_undegraded":"2023-09-30T22:26:34.470286+0000","last_fullsized":"2023-09-30T22:26:34.470286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454945+0000","last_change":"2023-09-30T22:26:34.449871+0000","last_active":"2023-09-30T22:26:34.454945+0000","last_peered":"2023-09-30T22:26:34.454945+0000","last_clean":"2023-09-30T22:26:34.454945+0000","last_became_active":"2023-09-30T22:26:34.448901+0000","last_became_peered":"2023-09-30T22:26:34.448901+0000","last_unstale":"2023-09-30T22:26:34.454945+0000","last_undegraded":"2023-09-30T22:26:34.454945+0000","last_fullsized":"2023-09-30T22:26:34.454945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470966+0000","last_change":"2023-09-30T22:26:34.463255+0000","last_active":"2023-09-30T22:26:34.470966+0000","last_peered":"2023-09-30T22:26:34.470966+0000","last_clean":"2023-09-30T22:26:34.470966+0000","last_became_active":"2023-09-30T22:26:34.462962+0000","last_became_peered":"2023-09-30T22:26:34.462962+0000","last_unstale":"2023-09-30T22:26:34.470966+0000","last_undegraded":"2023-09-30T22:26:34.470966+0000","last_fullsized":"2023-09-30T22:26:34.470966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470761+0000","last_change":"2023-09-30T22:26:34.458476+0000","last_active":"2023-09-30T22:26:34.470761+0000","last_peered":"2023-09-30T22:26:34.470761+0000","last_clean":"2023-09-30T22:26:34.470761+0000","last_became_active":"2023-09-30T22:26:34.458195+0000","last_became_peered":"2023-09-30T22:26:34.458195+0000","last_unstale":"2023-09-30T22:26:34.470761+0000","last_undegraded":"2023-09-30T22:26:34.470761+0000","last_fullsized":"2023-09-30T22:26:34.470761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.450508+0000","last_change":"2023-09-30T22:26:34.441003+0000","last_active":"2023-09-30T22:26:34.450508+0000","last_peered":"2023-09-30T22:26:34.450508+0000","last_clean":"2023-09-30T22:26:34.450508+0000","last_became_active":"2023-09-30T22:26:34.440470+0000","last_became_peered":"2023-09-30T22:26:34.440470+0000","last_unstale":"2023-09-30T22:26:34.450508+0000","last_undegraded":"2023-09-30T22:26:34.450508+0000","last_fullsized":"2023-09-30T22:26:34.450508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.456686+0000","last_change":"2023-09-30T22:26:34.448801+0000","last_active":"2023-09-30T22:26:34.456686+0000","last_peered":"2023-09-30T22:26:34.456686+0000","last_clean":"2023-09-30T22:26:34.456686+0000","last_became_active":"2023-09-30T22:26:34.448176+0000","last_became_peered":"2023-09-30T22:26:34.448176+0000","last_unstale":"2023-09-30T22:26:34.456686+0000","last_undegraded":"2023-09-30T22:26:34.456686+0000","last_fullsized":"2023-09-30T22:26:34.456686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471250+0000","last_change":"2023-09-30T22:26:34.031319+0000","last_active":"2023-09-30T22:26:34.471250+0000","last_peered":"2023-09-30T22:26:34.471250+0000","last_clean":"2023-09-30T22:26:34.471250+0000","last_became_active":"2023-09-30T22:26:34.030475+0000","last_became_peered":"2023-09-30T22:26:34.030475+0000","last_unstale":"2023-09-30T22:26:34.471250+0000","last_undegraded":"2023-09-30T22:26:34.471250+0000","last_fullsized":"2023-09-30T22:26:34.471250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463494+0000","last_change":"2023-09-30T22:26:34.459834+0000","last_active":"2023-09-30T22:26:34.463494+0000","last_peered":"2023-09-30T22:26:34.463494+0000","last_clean":"2023-09-30T22:26:34.463494+0000","last_became_active":"2023-09-30T22:26:34.459291+0000","last_became_peered":"2023-09-30T22:26:34.459291+0000","last_unstale":"2023-09-30T22:26:34.463494+0000","last_undegraded":"2023-09-30T22:26:34.463494+0000","last_fullsized":"2023-09-30T22:26:34.463494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.428859+0000","last_change":"2023-09-30T22:26:34.036944+0000","last_active":"2023-09-30T22:26:34.428859+0000","last_peered":"2023-09-30T22:26:34.428859+0000","last_clean":"2023-09-30T22:26:34.428859+0000","last_became_active":"2023-09-30T22:26:34.036564+0000","last_became_peered":"2023-09-30T22:26:34.036564+0000","last_unstale":"2023-09-30T22:26:34.428859+0000","last_undegraded":"2023-09-30T22:26:34.428859+0000","last_fullsized":"2023-09-30T22:26:34.428859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.468638+0000","last_change":"2023-09-30T22:26:34.464712+0000","last_active":"2023-09-30T22:26:34.468638+0000","last_peered":"2023-09-30T22:26:34.468638+0000","last_clean":"2023-09-30T22:26:34.468638+0000","last_became_active":"2023-09-30T22:26:34.464032+0000","last_became_peered":"2023-09-30T22:26:34.464032+0000","last_unstale":"2023-09-30T22:26:34.468638+0000","last_undegraded":"2023-09-30T22:26:34.468638+0000","last_fullsized":"2023-09-30T22:26:34.468638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423659+0000","last_change":"2023-09-30T22:26:34.041116+0000","last_active":"2023-09-30T22:26:34.423659+0000","last_peered":"2023-09-30T22:26:34.423659+0000","last_clean":"2023-09-30T22:26:34.423659+0000","last_became_active":"2023-09-30T22:26:34.040484+0000","last_became_peered":"2023-09-30T22:26:34.040484+0000","last_unstale":"2023-09-30T22:26:34.423659+0000","last_undegraded":"2023-09-30T22:26:34.423659+0000","last_fullsized":"2023-09-30T22:26:34.423659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466426+0000","last_change":"2023-09-30T22:26:34.461558+0000","last_active":"2023-09-30T22:26:34.466426+0000","last_peered":"2023-09-30T22:26:34.466426+0000","last_clean":"2023-09-30T22:26:34.466426+0000","last_became_active":"2023-09-30T22:26:34.461274+0000","last_became_peered":"2023-09-30T22:26:34.461274+0000","last_unstale":"2023-09-30T22:26:34.466426+0000","last_undegraded":"2023-09-30T22:26:34.466426+0000","last_fullsized":"2023-09-30T22:26:34.466426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423512+0000","last_change":"2023-09-30T22:26:34.026179+0000","last_active":"2023-09-30T22:26:34.423512+0000","last_peered":"2023-09-30T22:26:34.423512+0000","last_clean":"2023-09-30T22:26:34.423512+0000","last_became_active":"2023-09-30T22:26:34.025896+0000","last_became_peered":"2023-09-30T22:26:34.025896+0000","last_unstale":"2023-09-30T22:26:34.423512+0000","last_undegraded":"2023-09-30T22:26:34.423512+0000","last_fullsized":"2023-09-30T22:26:34.423512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.469966+0000","last_change":"2023-09-30T22:26:34.461868+0000","last_active":"2023-09-30T22:26:34.469966+0000","last_peered":"2023-09-30T22:26:34.469966+0000","last_clean":"2023-09-30T22:26:34.469966+0000","last_became_active":"2023-09-30T22:26:34.458462+0000","last_became_peered":"2023-09-30T22:26:34.458462+0000","last_unstale":"2023-09-30T22:26:34.469966+0000","last_undegraded":"2023-09-30T22:26:34.469966+0000","last_fullsized":"2023-09-30T22:26:34.469966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.431770+0000","last_change":"2023-09-30T22:26:34.034800+0000","last_active":"2023-09-30T22:26:34.431770+0000","last_peered":"2023-09-30T22:26:34.431770+0000","last_clean":"2023-09-30T22:26:34.431770+0000","last_became_active":"2023-09-30T22:26:34.034161+0000","last_became_peered":"2023-09-30T22:26:34.034161+0000","last_unstale":"2023-09-30T22:26:34.431770+0000","last_undegraded":"2023-09-30T22:26:34.431770+0000","last_fullsized":"2023-09-30T22:26:34.431770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454988+0000","last_change":"2023-09-30T22:26:34.450219+0000","last_active":"2023-09-30T22:26:34.454988+0000","last_peered":"2023-09-30T22:26:34.454988+0000","last_clean":"2023-09-30T22:26:34.454988+0000","last_became_active":"2023-09-30T22:26:34.449611+0000","last_became_peered":"2023-09-30T22:26:34.449611+0000","last_unstale":"2023-09-30T22:26:34.454988+0000","last_undegraded":"2023-09-30T22:26:34.454988+0000","last_fullsized":"2023-09-30T22:26:34.454988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460602+0000","last_change":"2023-09-30T22:26:34.037459+0000","last_active":"2023-09-30T22:26:34.460602+0000","last_peered":"2023-09-30T22:26:34.460602+0000","last_clean":"2023-09-30T22:26:34.460602+0000","last_became_active":"2023-09-30T22:26:34.037268+0000","last_became_peered":"2023-09-30T22:26:34.037268+0000","last_unstale":"2023-09-30T22:26:34.460602+0000","last_undegraded":"2023-09-30T22:26:34.460602+0000","last_fullsized":"2023-09-30T22:26:34.460602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470919+0000","last_change":"2023-09-30T22:26:34.462289+0000","last_active":"2023-09-30T22:26:34.470919+0000","last_peered":"2023-09-30T22:26:34.470919+0000","last_clean":"2023-09-30T22:26:34.470919+0000","last_became_active":"2023-09-30T22:26:34.461927+0000","last_became_peered":"2023-09-30T22:26:34.461927+0000","last_unstale":"2023-09-30T22:26:34.470919+0000","last_undegraded":"2023-09-30T22:26:34.470919+0000","last_fullsized":"2023-09-30T22:26:34.470919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470074+0000","last_change":"2023-09-30T22:26:34.040307+0000","last_active":"2023-09-30T22:26:34.470074+0000","last_peered":"2023-09-30T22:26:34.470074+0000","last_clean":"2023-09-30T22:26:34.470074+0000","last_became_active":"2023-09-30T22:26:34.040017+0000","last_became_peered":"2023-09-30T22:26:34.040017+0000","last_unstale":"2023-09-30T22:26:34.470074+0000","last_undegraded":"2023-09-30T22:26:34.470074+0000","last_fullsized":"2023-09-30T22:26:34.470074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460303+0000","last_change":"2023-09-30T22:26:34.453373+0000","last_active":"2023-09-30T22:26:34.460303+0000","last_peered":"2023-09-30T22:26:34.460303+0000","last_clean":"2023-09-30T22:26:34.460303+0000","last_became_active":"2023-09-30T22:26:34.453075+0000","last_became_peered":"2023-09-30T22:26:34.453075+0000","last_unstale":"2023-09-30T22:26:34.460303+0000","last_undegraded":"2023-09-30T22:26:34.460303+0000","last_fullsized":"2023-09-30T22:26:34.460303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460377+0000","last_change":"2023-09-30T22:26:34.042269+0000","last_active":"2023-09-30T22:26:34.460377+0000","last_peered":"2023-09-30T22:26:34.460377+0000","last_clean":"2023-09-30T22:26:34.460377+0000","last_became_active":"2023-09-30T22:26:34.040124+0000","last_became_peered":"2023-09-30T22:26:34.040124+0000","last_unstale":"2023-09-30T22:26:34.460377+0000","last_undegraded":"2023-09-30T22:26:34.460377+0000","last_fullsized":"2023-09-30T22:26:34.460377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.465633+0000","last_change":"2023-09-30T22:26:34.459725+0000","last_active":"2023-09-30T22:26:34.465633+0000","last_peered":"2023-09-30T22:26:34.465633+0000","last_clean":"2023-09-30T22:26:34.465633+0000","last_became_active":"2023-09-30T22:26:34.459414+0000","last_became_peered":"2023-09-30T22:26:34.459414+0000","last_unstale":"2023-09-30T22:26:34.465633+0000","last_undegraded":"2023-09-30T22:26:34.465633+0000","last_fullsized":"2023-09-30T22:26:34.465633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.424477+0000","last_change":"2023-09-30T22:26:34.024931+0000","last_active":"2023-09-30T22:26:34.424477+0000","last_peered":"2023-09-30T22:26:34.424477+0000","last_clean":"2023-09-30T22:26:34.424477+0000","last_became_active":"2023-09-30T22:26:34.024616+0000","last_became_peered":"2023-09-30T22:26:34.024616+0000","last_unstale":"2023-09-30T22:26:34.424477+0000","last_undegraded":"2023-09-30T22:26:34.424477+0000","last_fullsized":"2023-09-30T22:26:34.424477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.456615+0000","last_change":"2023-09-30T22:26:34.451564+0000","last_active":"2023-09-30T22:26:34.456615+0000","last_peered":"2023-09-30T22:26:34.456615+0000","last_clean":"2023-09-30T22:26:34.456615+0000","last_became_active":"2023-09-30T22:26:34.448514+0000","last_became_peered":"2023-09-30T22:26:34.448514+0000","last_unstale":"2023-09-30T22:26:34.456615+0000","last_undegraded":"2023-09-30T22:26:34.456615+0000","last_fullsized":"2023-09-30T22:26:34.456615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.425637+0000","last_change":"2023-09-30T22:26:34.040402+0000","last_active":"2023-09-30T22:26:34.425637+0000","last_peered":"2023-09-30T22:26:34.425637+0000","last_clean":"2023-09-30T22:26:34.425637+0000","last_became_active":"2023-09-30T22:26:34.039702+0000","last_became_peered":"2023-09-30T22:26:34.039702+0000","last_unstale":"2023-09-30T22:26:34.425637+0000","last_undegraded":"2023-09-30T22:26:34.425637+0000","last_fullsized":"2023-09-30T22:26:34.425637+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454847+0000","last_change":"2023-09-30T22:26:34.450058+0000","last_active":"2023-09-30T22:26:34.454847+0000","last_peered":"2023-09-30T22:26:34.454847+0000","last_clean":"2023-09-30T22:26:34.454847+0000","last_became_active":"2023-09-30T22:26:34.449698+0000","last_became_peered":"2023-09-30T22:26:34.449698+0000","last_unstale":"2023-09-30T22:26:34.454847+0000","last_undegraded":"2023-09-30T22:26:34.454847+0000","last_fullsized":"2023-09-30T22:26:34.454847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471717+0000","last_change":"2023-09-30T22:26:34.041826+0000","last_active":"2023-09-30T22:26:34.471717+0000","last_peered":"2023-09-30T22:26:34.471717+0000","last_clean":"2023-09-30T22:26:34.471717+0000","last_became_active":"2023-09-30T22:26:34.041527+0000","last_became_peered":"2023-09-30T22:26:34.041527+0000","last_unstale":"2023-09-30T22:26:34.471717+0000","last_undegraded":"2023-09-30T22:26:34.471717+0000","last_fullsized":"2023-09-30T22:26:34.471717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466408+0000","last_change":"2023-09-30T22:26:34.461435+0000","last_active":"2023-09-30T22:26:34.466408+0000","last_peered":"2023-09-30T22:26:34.466408+0000","last_clean":"2023-09-30T22:26:34.466408+0000","last_became_active":"2023-09-30T22:26:34.461089+0000","last_became_peered":"2023-09-30T22:26:34.461089+0000","last_unstale":"2023-09-30T22:26:34.466408+0000","last_undegraded":"2023-09-30T22:26:34.466408+0000","last_fullsized":"2023-09-30T22:26:34.466408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471028+0000","last_change":"2023-09-30T22:26:34.030071+0000","last_active":"2023-09-30T22:26:34.471028+0000","last_peered":"2023-09-30T22:26:34.471028+0000","last_clean":"2023-09-30T22:26:34.471028+0000","last_became_active":"2023-09-30T22:26:34.029419+0000","last_became_peered":"2023-09-30T22:26:34.029419+0000","last_unstale":"2023-09-30T22:26:34.471028+0000","last_undegraded":"2023-09-30T22:26:34.471028+0000","last_fullsized":"2023-09-30T22:26:34.471028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470012+0000","last_change":"2023-09-30T22:26:34.462138+0000","last_active":"2023-09-30T22:26:34.470012+0000","last_peered":"2023-09-30T22:26:34.470012+0000","last_clean":"2023-09-30T22:26:34.470012+0000","last_became_active":"2023-09-30T22:26:34.461046+0000","last_became_peered":"2023-09-30T22:26:34.461046+0000","last_unstale":"2023-09-30T22:26:34.470012+0000","last_undegraded":"2023-09-30T22:26:34.470012+0000","last_fullsized":"2023-09-30T22:26:34.470012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.446894+0000","last_change":"2023-09-30T22:26:34.024286+0000","last_active":"2023-09-30T22:26:34.446894+0000","last_peered":"2023-09-30T22:26:34.446894+0000","last_clean":"2023-09-30T22:26:34.446894+0000","last_became_active":"2023-09-30T22:26:34.022989+0000","last_became_peered":"2023-09-30T22:26:34.022989+0000","last_unstale":"2023-09-30T22:26:34.446894+0000","last_undegraded":"2023-09-30T22:26:34.446894+0000","last_fullsized":"2023-09-30T22:26:34.446894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461265+0000","last_change":"2023-09-30T22:26:34.453594+0000","last_active":"2023-09-30T22:26:34.461265+0000","last_peered":"2023-09-30T22:26:34.461265+0000","last_clean":"2023-09-30T22:26:34.461265+0000","last_became_active":"2023-09-30T22:26:34.453288+0000","last_became_peered":"2023-09-30T22:26:34.453288+0000","last_unstale":"2023-09-30T22:26:34.461265+0000","last_undegraded":"2023-09-30T22:26:34.461265+0000","last_fullsized":"2023-09-30T22:26:34.461265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.465754+0000","last_change":"2023-09-30T22:26:34.042026+0000","last_active":"2023-09-30T22:26:34.465754+0000","last_peered":"2023-09-30T22:26:34.465754+0000","last_clean":"2023-09-30T22:26:34.465754+0000","last_became_active":"2023-09-30T22:26:34.041309+0000","last_became_peered":"2023-09-30T22:26:34.041309+0000","last_unstale":"2023-09-30T22:26:34.465754+0000","last_undegraded":"2023-09-30T22:26:34.465754+0000","last_fullsized":"2023-09-30T22:26:34.465754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460615+0000","last_change":"2023-09-30T22:26:34.448356+0000","last_active":"2023-09-30T22:26:34.460615+0000","last_peered":"2023-09-30T22:26:34.460615+0000","last_clean":"2023-09-30T22:26:34.460615+0000","last_became_active":"2023-09-30T22:26:34.447744+0000","last_became_peered":"2023-09-30T22:26:34.447744+0000","last_unstale":"2023-09-30T22:26:34.460615+0000","last_undegraded":"2023-09-30T22:26:34.460615+0000","last_fullsized":"2023-09-30T22:26:34.460615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.422389+0000","last_change":"2023-09-30T22:26:34.025526+0000","last_active":"2023-09-30T22:26:34.422389+0000","last_peered":"2023-09-30T22:26:34.422389+0000","last_clean":"2023-09-30T22:26:34.422389+0000","last_became_active":"2023-09-30T22:26:34.025214+0000","last_became_peered":"2023-09-30T22:26:34.025214+0000","last_unstale":"2023-09-30T22:26:34.422389+0000","last_undegraded":"2023-09-30T22:26:34.422389+0000","last_fullsized":"2023-09-30T22:26:34.422389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459520+0000","last_change":"2023-09-30T22:26:34.457634+0000","last_active":"2023-09-30T22:26:34.459520+0000","last_peered":"2023-09-30T22:26:34.459520+0000","last_clean":"2023-09-30T22:26:34.459520+0000","last_became_active":"2023-09-30T22:26:34.457314+0000","last_became_peered":"2023-09-30T22:26:34.457314+0000","last_unstale":"2023-09-30T22:26:34.459520+0000","last_undegraded":"2023-09-30T22:26:34.459520+0000","last_fullsized":"2023-09-30T22:26:34.459520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461205+0000","last_change":"2023-09-30T22:26:34.042476+0000","last_active":"2023-09-30T22:26:34.461205+0000","last_peered":"2023-09-30T22:26:34.461205+0000","last_clean":"2023-09-30T22:26:34.461205+0000","last_became_active":"2023-09-30T22:26:34.040552+0000","last_became_peered":"2023-09-30T22:26:34.040552+0000","last_unstale":"2023-09-30T22:26:34.461205+0000","last_undegraded":"2023-09-30T22:26:34.461205+0000","last_fullsized":"2023-09-30T22:26:34.461205+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454805+0000","last_change":"2023-09-30T22:26:34.451427+0000","last_active":"2023-09-30T22:26:34.454805+0000","last_peered":"2023-09-30T22:26:34.454805+0000","last_clean":"2023-09-30T22:26:34.454805+0000","last_became_active":"2023-09-30T22:26:34.451149+0000","last_became_peered":"2023-09-30T22:26:34.451149+0000","last_unstale":"2023-09-30T22:26:34.454805+0000","last_undegraded":"2023-09-30T22:26:34.454805+0000","last_fullsized":"2023-09-30T22:26:34.454805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423902+0000","last_change":"2023-09-30T22:26:34.039863+0000","last_active":"2023-09-30T22:26:34.423902+0000","last_peered":"2023-09-30T22:26:34.423902+0000","last_clean":"2023-09-30T22:26:34.423902+0000","last_became_active":"2023-09-30T22:26:34.039536+0000","last_became_peered":"2023-09-30T22:26:34.039536+0000","last_unstale":"2023-09-30T22:26:34.423902+0000","last_undegraded":"2023-09-30T22:26:34.423902+0000","last_fullsized":"2023-09-30T22:26:34.423902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463474+0000","last_change":"2023-09-30T22:26:34.459623+0000","last_active":"2023-09-30T22:26:34.463474+0000","last_peered":"2023-09-30T22:26:34.463474+0000","last_clean":"2023-09-30T22:26:34.463474+0000","last_became_active":"2023-09-30T22:26:34.457887+0000","last_became_peered":"2023-09-30T22:26:34.457887+0000","last_unstale":"2023-09-30T22:26:34.463474+0000","last_undegraded":"2023-09-30T22:26:34.463474+0000","last_fullsized":"2023-09-30T22:26:34.463474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.425122+0000","last_change":"2023-09-30T22:26:34.040793+0000","last_active":"2023-09-30T22:26:34.425122+0000","last_peered":"2023-09-30T22:26:34.425122+0000","last_clean":"2023-09-30T22:26:34.425122+0000","last_became_active":"2023-09-30T22:26:34.040437+0000","last_became_peered":"2023-09-30T22:26:34.040437+0000","last_unstale":"2023-09-30T22:26:34.425122+0000","last_undegraded":"2023-09-30T22:26:34.425122+0000","last_fullsized":"2023-09-30T22:26:34.425122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460680+0000","last_change":"2023-09-30T22:26:34.446474+0000","last_active":"2023-09-30T22:26:34.460680+0000","last_peered":"2023-09-30T22:26:34.460680+0000","last_clean":"2023-09-30T22:26:34.460680+0000","last_became_active":"2023-09-30T22:26:34.445499+0000","last_became_peered":"2023-09-30T22:26:34.445499+0000","last_unstale":"2023-09-30T22:26:34.460680+0000","last_undegraded":"2023-09-30T22:26:34.460680+0000","last_fullsized":"2023-09-30T22:26:34.460680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423262+0000","last_change":"2023-09-30T22:26:34.040910+0000","last_active":"2023-09-30T22:26:34.423262+0000","last_peered":"2023-09-30T22:26:34.423262+0000","last_clean":"2023-09-30T22:26:34.423262+0000","last_became_active":"2023-09-30T22:26:34.040077+0000","last_became_peered":"2023-09-30T22:26:34.040077+0000","last_unstale":"2023-09-30T22:26:34.423262+0000","last_undegraded":"2023-09-30T22:26:34.423262+0000","last_fullsized":"2023-09-30T22:26:34.423262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471281+0000","last_change":"2023-09-30T22:26:34.466480+0000","last_active":"2023-09-30T22:26:34.471281+0000","last_peered":"2023-09-30T22:26:34.471281+0000","last_clean":"2023-09-30T22:26:34.471281+0000","last_became_active":"2023-09-30T22:26:34.466187+0000","last_became_peered":"2023-09-30T22:26:34.466187+0000","last_unstale":"2023-09-30T22:26:34.471281+0000","last_undegraded":"2023-09-30T22:26:34.471281+0000","last_fullsized":"2023-09-30T22:26:34.471281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.440724+0000","last_change":"2023-09-30T22:26:30.873307+0000","last_active":"2023-09-30T22:26:34.440724+0000","last_peered":"2023-09-30T22:26:34.440724+0000","last_clean":"2023-09-30T22:26:34.440724+0000","last_became_active":"2023-09-30T22:26:30.872872+0000","last_became_peered":"2023-09-30T22:26:30.872872+0000","last_unstale":"2023-09-30T22:26:34.440724+0000","last_undegraded":"2023-09-30T22:26:34.440724+0000","last_fullsized":"2023-09-30T22:26:34.440724+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.428047+0000","last_change":"2023-09-30T22:26:34.037332+0000","last_active":"2023-09-30T22:26:34.428047+0000","last_peered":"2023-09-30T22:26:34.428047+0000","last_clean":"2023-09-30T22:26:34.428047+0000","last_became_active":"2023-09-30T22:26:34.037114+0000","last_became_peered":"2023-09-30T22:26:34.037114+0000","last_unstale":"2023-09-30T22:26:34.428047+0000","last_undegraded":"2023-09-30T22:26:34.428047+0000","last_fullsized":"2023-09-30T22:26:34.428047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470943+0000","last_change":"2023-09-30T22:26:34.462485+0000","last_active":"2023-09-30T22:26:34.470943+0000","last_peered":"2023-09-30T22:26:34.470943+0000","last_clean":"2023-09-30T22:26:34.470943+0000","last_became_active":"2023-09-30T22:26:34.454284+0000","last_became_peered":"2023-09-30T22:26:34.454284+0000","last_unstale":"2023-09-30T22:26:34.470943+0000","last_undegraded":"2023-09-30T22:26:34.470943+0000","last_fullsized":"2023-09-30T22:26:34.470943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.424003+0000","last_change":"2023-09-30T22:26:29.861644+0000","last_active":"2023-09-30T22:26:34.424003+0000","last_peered":"2023-09-30T22:26:34.424003+0000","last_clean":"2023-09-30T22:26:34.424003+0000","last_became_active":"2023-09-30T22:26:29.861261+0000","last_became_peered":"2023-09-30T22:26:29.861261+0000","last_unstale":"2023-09-30T22:26:34.424003+0000","last_undegraded":"2023-09-30T22:26:34.424003+0000","last_fullsized":"2023-09-30T22:26:34.424003+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.432400+0000","last_change":"2023-09-30T22:26:34.024242+0000","last_active":"2023-09-30T22:26:34.432400+0000","last_peered":"2023-09-30T22:26:34.432400+0000","last_clean":"2023-09-30T22:26:34.432400+0000","last_became_active":"2023-09-30T22:26:34.023935+0000","last_became_peered":"2023-09-30T22:26:34.023935+0000","last_unstale":"2023-09-30T22:26:34.432400+0000","last_undegraded":"2023-09-30T22:26:34.432400+0000","last_fullsized":"2023-09-30T22:26:34.432400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460658+0000","last_change":"2023-09-30T22:26:34.444993+0000","last_active":"2023-09-30T22:26:34.460658+0000","last_peered":"2023-09-30T22:26:34.460658+0000","last_clean":"2023-09-30T22:26:34.460658+0000","last_became_active":"2023-09-30T22:26:34.444739+0000","last_became_peered":"2023-09-30T22:26:34.444739+0000","last_unstale":"2023-09-30T22:26:34.460658+0000","last_undegraded":"2023-09-30T22:26:34.460658+0000","last_fullsized":"2023-09-30T22:26:34.460658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.427254+0000","last_change":"2023-09-30T22:26:29.858340+0000","last_active":"2023-09-30T22:26:34.427254+0000","last_peered":"2023-09-30T22:26:34.427254+0000","last_clean":"2023-09-30T22:26:34.427254+0000","last_became_active":"2023-09-30T22:26:29.857989+0000","last_became_peered":"2023-09-30T22:26:29.857989+0000","last_unstale":"2023-09-30T22:26:34.427254+0000","last_undegraded":"2023-09-30T22:26:34.427254+0000","last_fullsized":"2023-09-30T22:26:34.427254+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429669+0000","last_change":"2023-09-30T22:26:34.031173+0000","last_active":"2023-09-30T22:26:34.429669+0000","last_peered":"2023-09-30T22:26:34.429669+0000","last_clean":"2023-09-30T22:26:34.429669+0000","last_became_active":"2023-09-30T22:26:34.030863+0000","last_became_peered":"2023-09-30T22:26:34.030863+0000","last_unstale":"2023-09-30T22:26:34.429669+0000","last_undegraded":"2023-09-30T22:26:34.429669+0000","last_fullsized":"2023-09-30T22:26:34.429669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462678+0000","last_change":"2023-09-30T22:26:34.456017+0000","last_active":"2023-09-30T22:26:34.462678+0000","last_peered":"2023-09-30T22:26:34.462678+0000","last_clean":"2023-09-30T22:26:34.462678+0000","last_became_active":"2023-09-30T22:26:34.455744+0000","last_became_peered":"2023-09-30T22:26:34.455744+0000","last_unstale":"2023-09-30T22:26:34.462678+0000","last_undegraded":"2023-09-30T22:26:34.462678+0000","last_fullsized":"2023-09-30T22:26:34.462678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423631+0000","last_change":"2023-09-30T22:26:29.859074+0000","last_active":"2023-09-30T22:26:34.423631+0000","last_peered":"2023-09-30T22:26:34.423631+0000","last_clean":"2023-09-30T22:26:34.423631+0000","last_became_active":"2023-09-30T22:26:29.858669+0000","last_became_peered":"2023-09-30T22:26:29.858669+0000","last_unstale":"2023-09-30T22:26:34.423631+0000","last_undegraded":"2023-09-30T22:26:34.423631+0000","last_fullsized":"2023-09-30T22:26:34.423631+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429553+0000","last_change":"2023-09-30T22:26:28.864097+0000","last_active":"2023-09-30T22:26:34.429553+0000","last_peered":"2023-09-30T22:26:34.429553+0000","last_clean":"2023-09-30T22:26:34.429553+0000","last_became_active":"2023-09-30T22:26:28.863723+0000","last_became_peered":"2023-09-30T22:26:28.863723+0000","last_unstale":"2023-09-30T22:26:34.429553+0000","last_undegraded":"2023-09-30T22:26:34.429553+0000","last_fullsized":"2023-09-30T22:26:34.429553+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_clean_scrub_stamp":"2023-09-30T22:26:27.842299+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423778+0000","last_change":"2023-09-30T22:26:34.040465+0000","last_active":"2023-09-30T22:26:34.423778+0000","last_peered":"2023-09-30T22:26:34.423778+0000","last_clean":"2023-09-30T22:26:34.423778+0000","last_became_active":"2023-09-30T22:26:34.039806+0000","last_became_peered":"2023-09-30T22:26:34.039806+0000","last_unstale":"2023-09-30T22:26:34.423778+0000","last_undegraded":"2023-09-30T22:26:34.423778+0000","last_fullsized":"2023-09-30T22:26:34.423778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463514+0000","last_change":"2023-09-30T22:26:34.459817+0000","last_active":"2023-09-30T22:26:34.463514+0000","last_peered":"2023-09-30T22:26:34.463514+0000","last_clean":"2023-09-30T22:26:34.463514+0000","last_became_active":"2023-09-30T22:26:34.458434+0000","last_became_peered":"2023-09-30T22:26:34.458434+0000","last_unstale":"2023-09-30T22:26:34.463514+0000","last_undegraded":"2023-09-30T22:26:34.463514+0000","last_fullsized":"2023-09-30T22:26:34.463514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423531+0000","last_change":"2023-09-30T22:26:29.861337+0000","last_active":"2023-09-30T22:26:34.423531+0000","last_peered":"2023-09-30T22:26:34.423531+0000","last_clean":"2023-09-30T22:26:34.423531+0000","last_became_active":"2023-09-30T22:26:29.861003+0000","last_became_peered":"2023-09-30T22:26:29.861003+0000","last_unstale":"2023-09-30T22:26:34.423531+0000","last_undegraded":"2023-09-30T22:26:34.423531+0000","last_fullsized":"2023-09-30T22:26:34.423531+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.426034+0000","last_change":"2023-09-30T22:26:34.022924+0000","last_active":"2023-09-30T22:26:34.426034+0000","last_peered":"2023-09-30T22:26:34.426034+0000","last_clean":"2023-09-30T22:26:34.426034+0000","last_became_active":"2023-09-30T22:26:34.022592+0000","last_became_peered":"2023-09-30T22:26:34.022592+0000","last_unstale":"2023-09-30T22:26:34.426034+0000","last_undegraded":"2023-09-30T22:26:34.426034+0000","last_fullsized":"2023-09-30T22:26:34.426034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470264+0000","last_change":"2023-09-30T22:26:34.464915+0000","last_active":"2023-09-30T22:26:34.470264+0000","last_peered":"2023-09-30T22:26:34.470264+0000","last_clean":"2023-09-30T22:26:34.470264+0000","last_became_active":"2023-09-30T22:26:34.464406+0000","last_became_peered":"2023-09-30T22:26:34.464406+0000","last_unstale":"2023-09-30T22:26:34.470264+0000","last_undegraded":"2023-09-30T22:26:34.470264+0000","last_fullsized":"2023-09-30T22:26:34.470264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.426359+0000","last_change":"2023-09-30T22:26:30.874397+0000","last_active":"2023-09-30T22:26:34.426359+0000","last_peered":"2023-09-30T22:26:34.426359+0000","last_clean":"2023-09-30T22:26:34.426359+0000","last_became_active":"2023-09-30T22:26:30.874057+0000","last_became_peered":"2023-09-30T22:26:30.874057+0000","last_unstale":"2023-09-30T22:26:34.426359+0000","last_undegraded":"2023-09-30T22:26:34.426359+0000","last_fullsized":"2023-09-30T22:26:34.426359+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429371+0000","last_change":"2023-09-30T22:26:34.037126+0000","last_active":"2023-09-30T22:26:34.429371+0000","last_peered":"2023-09-30T22:26:34.429371+0000","last_clean":"2023-09-30T22:26:34.429371+0000","last_became_active":"2023-09-30T22:26:34.036825+0000","last_became_peered":"2023-09-30T22:26:34.036825+0000","last_unstale":"2023-09-30T22:26:34.429371+0000","last_undegraded":"2023-09-30T22:26:34.429371+0000","last_fullsized":"2023-09-30T22:26:34.429371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.446597+0000","last_change":"2023-09-30T22:26:34.443381+0000","last_active":"2023-09-30T22:26:34.446597+0000","last_peered":"2023-09-30T22:26:34.446597+0000","last_clean":"2023-09-30T22:26:34.446597+0000","last_became_active":"2023-09-30T22:26:34.443094+0000","last_became_peered":"2023-09-30T22:26:34.443094+0000","last_unstale":"2023-09-30T22:26:34.446597+0000","last_undegraded":"2023-09-30T22:26:34.446597+0000","last_fullsized":"2023-09-30T22:26:34.446597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466600+0000","last_change":"2023-09-30T22:26:34.041060+0000","last_active":"2023-09-30T22:26:34.466600+0000","last_peered":"2023-09-30T22:26:34.466600+0000","last_clean":"2023-09-30T22:26:34.466600+0000","last_became_active":"2023-09-30T22:26:34.040742+0000","last_became_peered":"2023-09-30T22:26:34.040742+0000","last_unstale":"2023-09-30T22:26:34.466600+0000","last_undegraded":"2023-09-30T22:26:34.466600+0000","last_fullsized":"2023-09-30T22:26:34.466600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429047+0000","last_change":"2023-09-30T22:26:30.873252+0000","last_active":"2023-09-30T22:26:34.429047+0000","last_peered":"2023-09-30T22:26:34.429047+0000","last_clean":"2023-09-30T22:26:34.429047+0000","last_became_active":"2023-09-30T22:26:30.872894+0000","last_became_peered":"2023-09-30T22:26:30.872894+0000","last_unstale":"2023-09-30T22:26:34.429047+0000","last_undegraded":"2023-09-30T22:26:34.429047+0000","last_fullsized":"2023-09-30T22:26:34.429047+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.469989+0000","last_change":"2023-09-30T22:26:34.462059+0000","last_active":"2023-09-30T22:26:34.469989+0000","last_peered":"2023-09-30T22:26:34.469989+0000","last_clean":"2023-09-30T22:26:34.469989+0000","last_became_active":"2023-09-30T22:26:34.461415+0000","last_became_peered":"2023-09-30T22:26:34.461415+0000","last_unstale":"2023-09-30T22:26:34.469989+0000","last_undegraded":"2023-09-30T22:26:34.469989+0000","last_fullsized":"2023-09-30T22:26:34.469989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.424541+0000","last_change":"2023-09-30T22:26:30.874887+0000","last_active":"2023-09-30T22:26:34.424541+0000","last_peered":"2023-09-30T22:26:34.424541+0000","last_clean":"2023-09-30T22:26:34.424541+0000","last_became_active":"2023-09-30T22:26:30.874533+0000","last_became_peered":"2023-09-30T22:26:30.874533+0000","last_unstale":"2023-09-30T22:26:34.424541+0000","last_undegraded":"2023-09-30T22:26:34.424541+0000","last_fullsized":"2023-09-30T22:26:34.424541+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.435269+0000","last_change":"2023-09-30T22:26:34.029291+0000","last_active":"2023-09-30T22:26:34.435269+0000","last_peered":"2023-09-30T22:26:34.435269+0000","last_clean":"2023-09-30T22:26:34.435269+0000","last_became_active":"2023-09-30T22:26:34.028983+0000","last_became_peered":"2023-09-30T22:26:34.028983+0000","last_unstale":"2023-09-30T22:26:34.435269+0000","last_undegraded":"2023-09-30T22:26:34.435269+0000","last_fullsized":"2023-09-30T22:26:34.435269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460262+0000","last_change":"2023-09-30T22:26:34.453608+0000","last_active":"2023-09-30T22:26:34.460262+0000","last_peered":"2023-09-30T22:26:34.460262+0000","last_clean":"2023-09-30T22:26:34.460262+0000","last_became_active":"2023-09-30T22:26:34.453255+0000","last_became_peered":"2023-09-30T22:26:34.453255+0000","last_unstale":"2023-09-30T22:26:34.460262+0000","last_undegraded":"2023-09-30T22:26:34.460262+0000","last_fullsized":"2023-09-30T22:26:34.460262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454524+0000","last_change":"2023-09-30T22:26:34.026874+0000","last_active":"2023-09-30T22:26:34.454524+0000","last_peered":"2023-09-30T22:26:34.454524+0000","last_clean":"2023-09-30T22:26:34.454524+0000","last_became_active":"2023-09-30T22:26:34.024536+0000","last_became_peered":"2023-09-30T22:26:34.024536+0000","last_unstale":"2023-09-30T22:26:34.454524+0000","last_undegraded":"2023-09-30T22:26:34.454524+0000","last_fullsized":"2023-09-30T22:26:34.454524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460574+0000","last_change":"2023-09-30T22:26:34.452982+0000","last_active":"2023-09-30T22:26:34.460574+0000","last_peered":"2023-09-30T22:26:34.460574+0000","last_clean":"2023-09-30T22:26:34.460574+0000","last_became_active":"2023-09-30T22:26:34.452695+0000","last_became_peered":"2023-09-30T22:26:34.452695+0000","last_unstale":"2023-09-30T22:26:34.460574+0000","last_undegraded":"2023-09-30T22:26:34.460574+0000","last_fullsized":"2023-09-30T22:26:34.460574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471263+0000","last_change":"2023-09-30T22:26:34.045553+0000","last_active":"2023-09-30T22:26:34.471263+0000","last_peered":"2023-09-30T22:26:34.471263+0000","last_clean":"2023-09-30T22:26:34.471263+0000","last_became_active":"2023-09-30T22:26:34.045206+0000","last_became_peered":"2023-09-30T22:26:34.045206+0000","last_unstale":"2023-09-30T22:26:34.471263+0000","last_undegraded":"2023-09-30T22:26:34.471263+0000","last_fullsized":"2023-09-30T22:26:34.471263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460323+0000","last_change":"2023-09-30T22:26:34.454158+0000","last_active":"2023-09-30T22:26:34.460323+0000","last_peered":"2023-09-30T22:26:34.460323+0000","last_clean":"2023-09-30T22:26:34.460323+0000","last_became_active":"2023-09-30T22:26:34.453928+0000","last_became_peered":"2023-09-30T22:26:34.453928+0000","last_unstale":"2023-09-30T22:26:34.460323+0000","last_undegraded":"2023-09-30T22:26:34.460323+0000","last_fullsized":"2023-09-30T22:26:34.460323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461491+0000","last_change":"2023-09-30T22:26:34.045717+0000","last_active":"2023-09-30T22:26:34.461491+0000","last_peered":"2023-09-30T22:26:34.461491+0000","last_clean":"2023-09-30T22:26:34.461491+0000","last_became_active":"2023-09-30T22:26:34.045395+0000","last_became_peered":"2023-09-30T22:26:34.045395+0000","last_unstale":"2023-09-30T22:26:34.461491+0000","last_undegraded":"2023-09-30T22:26:34.461491+0000","last_fullsized":"2023-09-30T22:26:34.461491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460634+0000","last_change":"2023-09-30T22:26:34.448542+0000","last_active":"2023-09-30T22:26:34.460634+0000","last_peered":"2023-09-30T22:26:34.460634+0000","last_clean":"2023-09-30T22:26:34.460634+0000","last_became_active":"2023-09-30T22:26:34.448081+0000","last_became_peered":"2023-09-30T22:26:34.448081+0000","last_unstale":"2023-09-30T22:26:34.460634+0000","last_undegraded":"2023-09-30T22:26:34.460634+0000","last_fullsized":"2023-09-30T22:26:34.460634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462279+0000","last_change":"2023-09-30T22:26:34.039959+0000","last_active":"2023-09-30T22:26:34.462279+0000","last_peered":"2023-09-30T22:26:34.462279+0000","last_clean":"2023-09-30T22:26:34.462279+0000","last_became_active":"2023-09-30T22:26:34.039615+0000","last_became_peered":"2023-09-30T22:26:34.039615+0000","last_unstale":"2023-09-30T22:26:34.462279+0000","last_undegraded":"2023-09-30T22:26:34.462279+0000","last_fullsized":"2023-09-30T22:26:34.462279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.450313+0000","last_change":"2023-09-30T22:26:34.442775+0000","last_active":"2023-09-30T22:26:34.450313+0000","last_peered":"2023-09-30T22:26:34.450313+0000","last_clean":"2023-09-30T22:26:34.450313+0000","last_became_active":"2023-09-30T22:26:34.442406+0000","last_became_peered":"2023-09-30T22:26:34.442406+0000","last_unstale":"2023-09-30T22:26:34.450313+0000","last_undegraded":"2023-09-30T22:26:34.450313+0000","last_fullsized":"2023-09-30T22:26:34.450313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466261+0000","last_change":"2023-09-30T22:26:34.030292+0000","last_active":"2023-09-30T22:26:34.466261+0000","last_peered":"2023-09-30T22:26:34.466261+0000","last_clean":"2023-09-30T22:26:34.466261+0000","last_became_active":"2023-09-30T22:26:34.029782+0000","last_became_peered":"2023-09-30T22:26:34.029782+0000","last_unstale":"2023-09-30T22:26:34.466261+0000","last_undegraded":"2023-09-30T22:26:34.466261+0000","last_fullsized":"2023-09-30T22:26:34.466261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459154+0000","last_change":"2023-09-30T22:26:34.446235+0000","last_active":"2023-09-30T22:26:34.459154+0000","last_peered":"2023-09-30T22:26:34.459154+0000","last_clean":"2023-09-30T22:26:34.459154+0000","last_became_active":"2023-09-30T22:26:34.445921+0000","last_became_peered":"2023-09-30T22:26:34.445921+0000","last_unstale":"2023-09-30T22:26:34.459154+0000","last_undegraded":"2023-09-30T22:26:34.459154+0000","last_fullsized":"2023-09-30T22:26:34.459154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.451360+0000","last_change":"2023-09-30T22:26:34.441075+0000","last_active":"2023-09-30T22:26:34.451360+0000","last_peered":"2023-09-30T22:26:34.451360+0000","last_clean":"2023-09-30T22:26:34.451360+0000","last_became_active":"2023-09-30T22:26:34.440633+0000","last_became_peered":"2023-09-30T22:26:34.440633+0000","last_unstale":"2023-09-30T22:26:34.451360+0000","last_undegraded":"2023-09-30T22:26:34.451360+0000","last_fullsized":"2023-09-30T22:26:34.451360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463443+0000","last_change":"2023-09-30T22:26:34.458062+0000","last_active":"2023-09-30T22:26:34.463443+0000","last_peered":"2023-09-30T22:26:34.463443+0000","last_clean":"2023-09-30T22:26:34.463443+0000","last_became_active":"2023-09-30T22:26:34.457757+0000","last_became_peered":"2023-09-30T22:26:34.457757+0000","last_unstale":"2023-09-30T22:26:34.463443+0000","last_undegraded":"2023-09-30T22:26:34.463443+0000","last_fullsized":"2023-09-30T22:26:34.463443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.455136+0000","last_change":"2023-09-30T22:26:34.450865+0000","last_active":"2023-09-30T22:26:34.455136+0000","last_peered":"2023-09-30T22:26:34.455136+0000","last_clean":"2023-09-30T22:26:34.455136+0000","last_became_active":"2023-09-30T22:26:34.450568+0000","last_became_peered":"2023-09-30T22:26:34.450568+0000","last_unstale":"2023-09-30T22:26:34.455136+0000","last_undegraded":"2023-09-30T22:26:34.455136+0000","last_fullsized":"2023-09-30T22:26:34.455136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.467022+0000","last_change":"2023-09-30T22:26:34.461553+0000","last_active":"2023-09-30T22:26:34.467022+0000","last_peered":"2023-09-30T22:26:34.467022+0000","last_clean":"2023-09-30T22:26:34.467022+0000","last_became_active":"2023-09-30T22:26:34.459154+0000","last_became_peered":"2023-09-30T22:26:34.459154+0000","last_unstale":"2023-09-30T22:26:34.467022+0000","last_undegraded":"2023-09-30T22:26:34.467022+0000","last_fullsized":"2023-09-30T22:26:34.467022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.451971+0000","last_change":"2023-09-30T22:26:34.444740+0000","last_active":"2023-09-30T22:26:34.451971+0000","last_peered":"2023-09-30T22:26:34.451971+0000","last_clean":"2023-09-30T22:26:34.451971+0000","last_became_active":"2023-09-30T22:26:34.444385+0000","last_became_peered":"2023-09-30T22:26:34.444385+0000","last_unstale":"2023-09-30T22:26:34.451971+0000","last_undegraded":"2023-09-30T22:26:34.451971+0000","last_fullsized":"2023-09-30T22:26:34.451971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672963,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":50948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]}]},{"osd":0,"up_from":10,"seq":42949672963,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":51127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":47938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:26:43.050 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:26:43.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.189+0000 7f4242cc5700 1 Processor -- start 2023-09-30T22:26:43.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.190+0000 7f4242cc5700 1 -- start start 2023-09-30T22:26:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.190+0000 7f4242cc5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f423c096380 0x7f423c094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.190+0000 7f4242cc5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f423c091b00 0x7f423c127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.190+0000 7f4242cc5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423c096760 con 0x7f423c094c20 2023-09-30T22:26:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.190+0000 7f4242cc5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c091ff0 con 0x7f423c096380 2023-09-30T22:26:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.190+0000 7f4242cc5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f423c092c80 con 0x7f423c091b00 2023-09-30T22:26:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.190+0000 7f423bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f423c091b00 0x7f423c127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.190+0000 7f4240a61700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f423c096380 0x7f423c094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.190+0000 7f4241262700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f423c094c20 0x7f423c127af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45030/0 (socket says 172.21.15.59:45030) 2023-09-30T22:26:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.190+0000 7f4241262700 1 -- 172.21.15.59:0/4108736776 learned_addr learned my addr 172.21.15.59:0/4108736776 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.190+0000 7f423bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f423c091b00 0x7f423c127600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42414/0 (socket says 172.21.15.59:42414) 2023-09-30T22:26:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.191+0000 7f423bfff700 1 -- 172.21.15.59:0/4108736776 >> v2:172.21.15.59:3300/0 conn(0x7f423c096380 msgr2=0x7f423c094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.191+0000 7f423bfff700 1 --2- 172.21.15.59:0/4108736776 >> v2:172.21.15.59:3300/0 conn(0x7f423c096380 0x7f423c094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.191+0000 7f423bfff700 1 -- 172.21.15.59:0/4108736776 >> v1:172.21.15.59:6789/0 conn(0x7f423c094c20 legacy=0x7f423c127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.191+0000 7f423bfff700 1 -- 172.21.15.59:0/4108736776 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c093900 con 0x7f423c091b00 2023-09-30T22:26:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.191+0000 7f423b7fe700 1 -- 172.21.15.59:0/4108736776 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741259301 0 0) 0x7f423c096760 con 0x7f423c094c20 2023-09-30T22:26:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.191+0000 7f4240a61700 1 --2- 172.21.15.59:0/4108736776 >> v2:172.21.15.59:3300/0 conn(0x7f423c096380 0x7f423c094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.191+0000 7f423bfff700 1 --2- 172.21.15.59:0/4108736776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f423c091b00 0x7f423c127600 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f4224009790 tx=0x7f4224009060).ready entity=mon.2 client_cookie=d45b8b8abae1e17f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.191+0000 7f423b7fe700 1 -- 172.21.15.59:0/4108736776 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400f510 con 0x7f423c091b00 2023-09-30T22:26:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.191+0000 7f423b7fe700 1 -- 172.21.15.59:0/4108736776 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422400f670 con 0x7f423c091b00 2023-09-30T22:26:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.191+0000 7f423b7fe700 1 -- 172.21.15.59:0/4108736776 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400f9f0 con 0x7f423c091b00 2023-09-30T22:26:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.191+0000 7f4242cc5700 1 -- 172.21.15.59:0/4108736776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f423c091b00 msgr2=0x7f423c127600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.191+0000 7f4242cc5700 1 --2- 172.21.15.59:0/4108736776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f423c091b00 0x7f423c127600 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f4224009790 tx=0x7f4224009060).stop 2023-09-30T22:26:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.192+0000 7f4242cc5700 1 -- 172.21.15.59:0/4108736776 shutdown_connections 2023-09-30T22:26:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.192+0000 7f4242cc5700 1 --2- 172.21.15.59:0/4108736776 >> v2:172.21.15.59:3300/0 conn(0x7f423c096380 0x7f423c094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.192+0000 7f4242cc5700 1 --2- 172.21.15.59:0/4108736776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f423c091b00 0x7f423c127600 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.192+0000 7f4242cc5700 1 -- 172.21.15.59:0/4108736776 >> 172.21.15.59:0/4108736776 conn(0x7f423c097470 msgr2=0x7f423c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.192+0000 7f4242cc5700 1 -- 172.21.15.59:0/4108736776 shutdown_connections 2023-09-30T22:26:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.192+0000 7f4242cc5700 1 -- 172.21.15.59:0/4108736776 wait complete. 2023-09-30T22:26:43.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.192+0000 7f4242cc5700 1 Processor -- start 2023-09-30T22:26:43.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.193+0000 7f4242cc5700 1 -- start start 2023-09-30T22:26:43.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.193+0000 7f4242cc5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f423c091b00 0x7f423c1168f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.193+0000 7f4242cc5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f423c094c20 0x7f423c112950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.193+0000 7f4242cc5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f423c096380 0x7f423c112e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.193+0000 7f4242cc5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c06a520 con 0x7f423c091b00 2023-09-30T22:26:43.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.193+0000 7f4242cc5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c124a30 con 0x7f423c096380 2023-09-30T22:26:43.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.193+0000 7f4242cc5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f423c1163f0 con 0x7f423c094c20 2023-09-30T22:26:43.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.193+0000 7f4240a61700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f423c091b00 0x7f423c1168f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.193+0000 7f4240a61700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f423c091b00 0x7f423c1168f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54168/0 (socket says 172.21.15.59:54168) 2023-09-30T22:26:43.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.193+0000 7f4240a61700 1 -- 172.21.15.59:0/2908502269 learned_addr learned my addr 172.21.15.59:0/2908502269 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:43.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.193+0000 7f423bfff700 1 --2- 172.21.15.59:0/2908502269 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f423c094c20 0x7f423c112950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.193+0000 7f4241262700 1 --2- 172.21.15.59:0/2908502269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f423c096380 0x7f423c112e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.194+0000 7f4240a61700 1 -- 172.21.15.59:0/2908502269 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f423c094c20 msgr2=0x7f423c112950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.194+0000 7f4240a61700 1 --2- 172.21.15.59:0/2908502269 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f423c094c20 0x7f423c112950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.194+0000 7f4240a61700 1 -- 172.21.15.59:0/2908502269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f423c096380 msgr2=0x7f423c112e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.194+0000 7f4240a61700 1 --2- 172.21.15.59:0/2908502269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f423c096380 0x7f423c112e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.194+0000 7f4240a61700 1 -- 172.21.15.59:0/2908502269 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c0092a0 con 0x7f423c091b00 2023-09-30T22:26:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.194+0000 7f4240a61700 1 --2- 172.21.15.59:0/2908502269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f423c091b00 0x7f423c1168f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f422c00ea20 tx=0x7f422c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.194+0000 7f4238ff9700 1 -- 172.21.15.59:0/2908502269 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c00ee60 con 0x7f423c091b00 2023-09-30T22:26:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.194+0000 7f4238ff9700 1 -- 172.21.15.59:0/2908502269 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c00c7f0 con 0x7f423c091b00 2023-09-30T22:26:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.194+0000 7f4242cc5700 1 -- 172.21.15.59:0/2908502269 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42240092a0 con 0x7f423c091b00 2023-09-30T22:26:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.194+0000 7f4238ff9700 1 -- 172.21.15.59:0/2908502269 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c00cb70 con 0x7f423c091b00 2023-09-30T22:26:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.194+0000 7f4242cc5700 1 -- 172.21.15.59:0/2908502269 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423c113d50 con 0x7f423c091b00 2023-09-30T22:26:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.195+0000 7f4238ff9700 1 -- 172.21.15.59:0/2908502269 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f422c01b400 con 0x7f423c091b00 2023-09-30T22:26:43.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.195+0000 7f4238ff9700 1 -- 172.21.15.59:0/2908502269 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f422c03b530 con 0x7f423c091b00 2023-09-30T22:26:43.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.195+0000 7f4242cc5700 1 -- 172.21.15.59:0/2908502269 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423c098850 con 0x7f423c091b00 2023-09-30T22:26:43.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.200+0000 7f4238ff9700 1 -- 172.21.15.59:0/2908502269 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f422c019900 con 0x7f423c091b00 2023-09-30T22:26:43.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.370+0000 7f4242cc5700 1 -- 172.21.15.59:0/2908502269 --> v1:172.21.15.59:6816/118188 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f423c116070 con 0x7f421c02bb60 2023-09-30T22:26:43.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.377+0000 7f4238ff9700 1 -- 172.21.15.59:0/2908502269 <== mgr.4103 v1:172.21.15.59:6816/118188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250018 (unknown 2965378022 0 3401675125) 0x7f422400fdb0 con 0x7f421c02bb60 2023-09-30T22:26:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:43.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.380+0000 7f4242cc5700 1 -- 172.21.15.59:0/2908502269 >> v1:172.21.15.59:6816/118188 conn(0x7f421c02bb60 legacy=0x7f421c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.380+0000 7f4242cc5700 1 -- 172.21.15.59:0/2908502269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f423c091b00 msgr2=0x7f423c1168f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.380+0000 7f4242cc5700 1 --2- 172.21.15.59:0/2908502269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f423c091b00 0x7f423c1168f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f422c00ea20 tx=0x7f422c009060).stop 2023-09-30T22:26:43.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.380+0000 7f4242cc5700 1 -- 172.21.15.59:0/2908502269 shutdown_connections 2023-09-30T22:26:43.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.380+0000 7f4242cc5700 1 --2- 172.21.15.59:0/2908502269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f423c096380 0x7f423c112e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.380+0000 7f4242cc5700 1 --2- 172.21.15.59:0/2908502269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f423c091b00 0x7f423c1168f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.380+0000 7f4242cc5700 1 --2- 172.21.15.59:0/2908502269 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f423c094c20 0x7f423c112950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.380+0000 7f4242cc5700 1 -- 172.21.15.59:0/2908502269 >> 172.21.15.59:0/2908502269 conn(0x7f423c097470 msgr2=0x7f423c126cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:43.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.380+0000 7f4242cc5700 1 -- 172.21.15.59:0/2908502269 shutdown_connections 2023-09-30T22:26:43.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.380+0000 7f4242cc5700 1 -- 172.21.15.59:0/2908502269 wait complete. 2023-09-30T22:26:43.383 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-09-30T22:26:43.393 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-09-30T22:26:41.726375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189040,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298320,"statfs":{"total":386547056640,"available":385329479680,"internally_reserved":0,"allocated":671744,"data_stored":200125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000883"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460233+0000","last_change":"2023-09-30T22:26:34.447805+0000","last_active":"2023-09-30T22:26:34.460233+0000","last_peered":"2023-09-30T22:26:34.460233+0000","last_clean":"2023-09-30T22:26:34.460233+0000","last_became_active":"2023-09-30T22:26:34.447480+0000","last_became_peered":"2023-09-30T22:26:34.447480+0000","last_unstale":"2023-09-30T22:26:34.460233+0000","last_undegraded":"2023-09-30T22:26:34.460233+0000","last_fullsized":"2023-09-30T22:26:34.460233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.441095+0000","last_change":"2023-09-30T22:26:34.440046+0000","last_active":"2023-09-30T22:26:34.441095+0000","last_peered":"2023-09-30T22:26:34.441095+0000","last_clean":"2023-09-30T22:26:34.441095+0000","last_became_active":"2023-09-30T22:26:34.439718+0000","last_became_peered":"2023-09-30T22:26:34.439718+0000","last_unstale":"2023-09-30T22:26:34.441095+0000","last_undegraded":"2023-09-30T22:26:34.441095+0000","last_fullsized":"2023-09-30T22:26:34.441095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460661+0000","last_change":"2023-09-30T22:26:34.457031+0000","last_active":"2023-09-30T22:26:34.460661+0000","last_peered":"2023-09-30T22:26:34.460661+0000","last_clean":"2023-09-30T22:26:34.460661+0000","last_became_active":"2023-09-30T22:26:34.456552+0000","last_became_peered":"2023-09-30T22:26:34.456552+0000","last_unstale":"2023-09-30T22:26:34.460661+0000","last_undegraded":"2023-09-30T22:26:34.460661+0000","last_fullsized":"2023-09-30T22:26:34.460661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459584+0000","last_change":"2023-09-30T22:26:34.456744+0000","last_active":"2023-09-30T22:26:34.459584+0000","last_peered":"2023-09-30T22:26:34.459584+0000","last_clean":"2023-09-30T22:26:34.459584+0000","last_became_active":"2023-09-30T22:26:34.456441+0000","last_became_peered":"2023-09-30T22:26:34.456441+0000","last_unstale":"2023-09-30T22:26:34.459584+0000","last_undegraded":"2023-09-30T22:26:34.459584+0000","last_fullsized":"2023-09-30T22:26:34.459584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459464+0000","last_change":"2023-09-30T22:26:34.454395+0000","last_active":"2023-09-30T22:26:34.459464+0000","last_peered":"2023-09-30T22:26:34.459464+0000","last_clean":"2023-09-30T22:26:34.459464+0000","last_became_active":"2023-09-30T22:26:34.454106+0000","last_became_peered":"2023-09-30T22:26:34.454106+0000","last_unstale":"2023-09-30T22:26:34.459464+0000","last_undegraded":"2023-09-30T22:26:34.459464+0000","last_fullsized":"2023-09-30T22:26:34.459464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454476+0000","last_change":"2023-09-30T22:26:34.446348+0000","last_active":"2023-09-30T22:26:34.454476+0000","last_peered":"2023-09-30T22:26:34.454476+0000","last_clean":"2023-09-30T22:26:34.454476+0000","last_became_active":"2023-09-30T22:26:34.444457+0000","last_became_peered":"2023-09-30T22:26:34.444457+0000","last_unstale":"2023-09-30T22:26:34.454476+0000","last_undegraded":"2023-09-30T22:26:34.454476+0000","last_fullsized":"2023-09-30T22:26:34.454476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454968+0000","last_change":"2023-09-30T22:26:34.450051+0000","last_active":"2023-09-30T22:26:34.454968+0000","last_peered":"2023-09-30T22:26:34.454968+0000","last_clean":"2023-09-30T22:26:34.454968+0000","last_became_active":"2023-09-30T22:26:34.449264+0000","last_became_peered":"2023-09-30T22:26:34.449264+0000","last_unstale":"2023-09-30T22:26:34.454968+0000","last_undegraded":"2023-09-30T22:26:34.454968+0000","last_fullsized":"2023-09-30T22:26:34.454968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471021+0000","last_change":"2023-09-30T22:26:34.463260+0000","last_active":"2023-09-30T22:26:34.471021+0000","last_peered":"2023-09-30T22:26:34.471021+0000","last_clean":"2023-09-30T22:26:34.471021+0000","last_became_active":"2023-09-30T22:26:34.462981+0000","last_became_peered":"2023-09-30T22:26:34.462981+0000","last_unstale":"2023-09-30T22:26:34.471021+0000","last_undegraded":"2023-09-30T22:26:34.471021+0000","last_fullsized":"2023-09-30T22:26:34.471021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.455028+0000","last_change":"2023-09-30T22:26:34.451111+0000","last_active":"2023-09-30T22:26:34.455028+0000","last_peered":"2023-09-30T22:26:34.455028+0000","last_clean":"2023-09-30T22:26:34.455028+0000","last_became_active":"2023-09-30T22:26:34.450521+0000","last_became_peered":"2023-09-30T22:26:34.450521+0000","last_unstale":"2023-09-30T22:26:34.455028+0000","last_undegraded":"2023-09-30T22:26:34.455028+0000","last_fullsized":"2023-09-30T22:26:34.455028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461140+0000","last_change":"2023-09-30T22:26:34.454512+0000","last_active":"2023-09-30T22:26:34.461140+0000","last_peered":"2023-09-30T22:26:34.461140+0000","last_clean":"2023-09-30T22:26:34.461140+0000","last_became_active":"2023-09-30T22:26:34.454222+0000","last_became_peered":"2023-09-30T22:26:34.454222+0000","last_unstale":"2023-09-30T22:26:34.461140+0000","last_undegraded":"2023-09-30T22:26:34.461140+0000","last_fullsized":"2023-09-30T22:26:34.461140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462004+0000","last_change":"2023-09-30T22:26:34.454698+0000","last_active":"2023-09-30T22:26:34.462004+0000","last_peered":"2023-09-30T22:26:34.462004+0000","last_clean":"2023-09-30T22:26:34.462004+0000","last_became_active":"2023-09-30T22:26:34.454060+0000","last_became_peered":"2023-09-30T22:26:34.454060+0000","last_unstale":"2023-09-30T22:26:34.462004+0000","last_undegraded":"2023-09-30T22:26:34.462004+0000","last_fullsized":"2023-09-30T22:26:34.462004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460500+0000","last_change":"2023-09-30T22:26:34.447740+0000","last_active":"2023-09-30T22:26:34.460500+0000","last_peered":"2023-09-30T22:26:34.460500+0000","last_clean":"2023-09-30T22:26:34.460500+0000","last_became_active":"2023-09-30T22:26:34.447444+0000","last_became_peered":"2023-09-30T22:26:34.447444+0000","last_unstale":"2023-09-30T22:26:34.460500+0000","last_undegraded":"2023-09-30T22:26:34.460500+0000","last_fullsized":"2023-09-30T22:26:34.460500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460341+0000","last_change":"2023-09-30T22:26:34.454342+0000","last_active":"2023-09-30T22:26:34.460341+0000","last_peered":"2023-09-30T22:26:34.460341+0000","last_clean":"2023-09-30T22:26:34.460341+0000","last_became_active":"2023-09-30T22:26:34.454063+0000","last_became_peered":"2023-09-30T22:26:34.454063+0000","last_unstale":"2023-09-30T22:26:34.460341+0000","last_undegraded":"2023-09-30T22:26:34.460341+0000","last_fullsized":"2023-09-30T22:26:34.460341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462123+0000","last_change":"2023-09-30T22:26:34.450497+0000","last_active":"2023-09-30T22:26:34.462123+0000","last_peered":"2023-09-30T22:26:34.462123+0000","last_clean":"2023-09-30T22:26:34.462123+0000","last_became_active":"2023-09-30T22:26:34.444267+0000","last_became_peered":"2023-09-30T22:26:34.444267+0000","last_unstale":"2023-09-30T22:26:34.462123+0000","last_undegraded":"2023-09-30T22:26:34.462123+0000","last_fullsized":"2023-09-30T22:26:34.462123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459426+0000","last_change":"2023-09-30T22:26:34.455898+0000","last_active":"2023-09-30T22:26:34.459426+0000","last_peered":"2023-09-30T22:26:34.459426+0000","last_clean":"2023-09-30T22:26:34.459426+0000","last_became_active":"2023-09-30T22:26:34.455631+0000","last_became_peered":"2023-09-30T22:26:34.455631+0000","last_unstale":"2023-09-30T22:26:34.459426+0000","last_undegraded":"2023-09-30T22:26:34.459426+0000","last_fullsized":"2023-09-30T22:26:34.459426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.452608+0000","last_change":"2023-09-30T22:26:34.447910+0000","last_active":"2023-09-30T22:26:34.452608+0000","last_peered":"2023-09-30T22:26:34.452608+0000","last_clean":"2023-09-30T22:26:34.452608+0000","last_became_active":"2023-09-30T22:26:34.447627+0000","last_became_peered":"2023-09-30T22:26:34.447627+0000","last_unstale":"2023-09-30T22:26:34.452608+0000","last_undegraded":"2023-09-30T22:26:34.452608+0000","last_fullsized":"2023-09-30T22:26:34.452608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.455048+0000","last_change":"2023-09-30T22:26:34.451250+0000","last_active":"2023-09-30T22:26:34.455048+0000","last_peered":"2023-09-30T22:26:34.455048+0000","last_clean":"2023-09-30T22:26:34.455048+0000","last_became_active":"2023-09-30T22:26:34.450879+0000","last_became_peered":"2023-09-30T22:26:34.450879+0000","last_unstale":"2023-09-30T22:26:34.455048+0000","last_undegraded":"2023-09-30T22:26:34.455048+0000","last_fullsized":"2023-09-30T22:26:34.455048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.446179+0000","last_change":"2023-09-30T22:26:34.440788+0000","last_active":"2023-09-30T22:26:34.446179+0000","last_peered":"2023-09-30T22:26:34.446179+0000","last_clean":"2023-09-30T22:26:34.446179+0000","last_became_active":"2023-09-30T22:26:34.440404+0000","last_became_peered":"2023-09-30T22:26:34.440404+0000","last_unstale":"2023-09-30T22:26:34.446179+0000","last_undegraded":"2023-09-30T22:26:34.446179+0000","last_fullsized":"2023-09-30T22:26:34.446179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459186+0000","last_change":"2023-09-30T22:26:34.445791+0000","last_active":"2023-09-30T22:26:34.459186+0000","last_peered":"2023-09-30T22:26:34.459186+0000","last_clean":"2023-09-30T22:26:34.459186+0000","last_became_active":"2023-09-30T22:26:34.445478+0000","last_became_peered":"2023-09-30T22:26:34.445478+0000","last_unstale":"2023-09-30T22:26:34.459186+0000","last_undegraded":"2023-09-30T22:26:34.459186+0000","last_fullsized":"2023-09-30T22:26:34.459186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460680+0000","last_change":"2023-09-30T22:26:34.453484+0000","last_active":"2023-09-30T22:26:34.460680+0000","last_peered":"2023-09-30T22:26:34.460680+0000","last_clean":"2023-09-30T22:26:34.460680+0000","last_became_active":"2023-09-30T22:26:34.453179+0000","last_became_peered":"2023-09-30T22:26:34.453179+0000","last_unstale":"2023-09-30T22:26:34.460680+0000","last_undegraded":"2023-09-30T22:26:34.460680+0000","last_fullsized":"2023-09-30T22:26:34.460680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.468703+0000","last_change":"2023-09-30T22:26:34.457382+0000","last_active":"2023-09-30T22:26:34.468703+0000","last_peered":"2023-09-30T22:26:34.468703+0000","last_clean":"2023-09-30T22:26:34.468703+0000","last_became_active":"2023-09-30T22:26:34.457077+0000","last_became_peered":"2023-09-30T22:26:34.457077+0000","last_unstale":"2023-09-30T22:26:34.468703+0000","last_undegraded":"2023-09-30T22:26:34.468703+0000","last_fullsized":"2023-09-30T22:26:34.468703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470286+0000","last_change":"2023-09-30T22:26:34.465060+0000","last_active":"2023-09-30T22:26:34.470286+0000","last_peered":"2023-09-30T22:26:34.470286+0000","last_clean":"2023-09-30T22:26:34.470286+0000","last_became_active":"2023-09-30T22:26:34.464780+0000","last_became_peered":"2023-09-30T22:26:34.464780+0000","last_unstale":"2023-09-30T22:26:34.470286+0000","last_undegraded":"2023-09-30T22:26:34.470286+0000","last_fullsized":"2023-09-30T22:26:34.470286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454945+0000","last_change":"2023-09-30T22:26:34.449871+0000","last_active":"2023-09-30T22:26:34.454945+0000","last_peered":"2023-09-30T22:26:34.454945+0000","last_clean":"2023-09-30T22:26:34.454945+0000","last_became_active":"2023-09-30T22:26:34.448901+0000","last_became_peered":"2023-09-30T22:26:34.448901+0000","last_unstale":"2023-09-30T22:26:34.454945+0000","last_undegraded":"2023-09-30T22:26:34.454945+0000","last_fullsized":"2023-09-30T22:26:34.454945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470966+0000","last_change":"2023-09-30T22:26:34.463255+0000","last_active":"2023-09-30T22:26:34.470966+0000","last_peered":"2023-09-30T22:26:34.470966+0000","last_clean":"2023-09-30T22:26:34.470966+0000","last_became_active":"2023-09-30T22:26:34.462962+0000","last_became_peered":"2023-09-30T22:26:34.462962+0000","last_unstale":"2023-09-30T22:26:34.470966+0000","last_undegraded":"2023-09-30T22:26:34.470966+0000","last_fullsized":"2023-09-30T22:26:34.470966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470761+0000","last_change":"2023-09-30T22:26:34.458476+0000","last_active":"2023-09-30T22:26:34.470761+0000","last_peered":"2023-09-30T22:26:34.470761+0000","last_clean":"2023-09-30T22:26:34.470761+0000","last_became_active":"2023-09-30T22:26:34.458195+0000","last_became_peered":"2023-09-30T22:26:34.458195+0000","last_unstale":"2023-09-30T22:26:34.470761+0000","last_undegraded":"2023-09-30T22:26:34.470761+0000","last_fullsized":"2023-09-30T22:26:34.470761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.450508+0000","last_change":"2023-09-30T22:26:34.441003+0000","last_active":"2023-09-30T22:26:34.450508+0000","last_peered":"2023-09-30T22:26:34.450508+0000","last_clean":"2023-09-30T22:26:34.450508+0000","last_became_active":"2023-09-30T22:26:34.440470+0000","last_became_peered":"2023-09-30T22:26:34.440470+0000","last_unstale":"2023-09-30T22:26:34.450508+0000","last_undegraded":"2023-09-30T22:26:34.450508+0000","last_fullsized":"2023-09-30T22:26:34.450508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.456686+0000","last_change":"2023-09-30T22:26:34.448801+0000","last_active":"2023-09-30T22:26:34.456686+0000","last_peered":"2023-09-30T22:26:34.456686+0000","last_clean":"2023-09-30T22:26:34.456686+0000","last_became_active":"2023-09-30T22:26:34.448176+0000","last_became_peered":"2023-09-30T22:26:34.448176+0000","last_unstale":"2023-09-30T22:26:34.456686+0000","last_undegraded":"2023-09-30T22:26:34.456686+0000","last_fullsized":"2023-09-30T22:26:34.456686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471250+0000","last_change":"2023-09-30T22:26:34.031319+0000","last_active":"2023-09-30T22:26:34.471250+0000","last_peered":"2023-09-30T22:26:34.471250+0000","last_clean":"2023-09-30T22:26:34.471250+0000","last_became_active":"2023-09-30T22:26:34.030475+0000","last_became_peered":"2023-09-30T22:26:34.030475+0000","last_unstale":"2023-09-30T22:26:34.471250+0000","last_undegraded":"2023-09-30T22:26:34.471250+0000","last_fullsized":"2023-09-30T22:26:34.471250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463494+0000","last_change":"2023-09-30T22:26:34.459834+0000","last_active":"2023-09-30T22:26:34.463494+0000","last_peered":"2023-09-30T22:26:34.463494+0000","last_clean":"2023-09-30T22:26:34.463494+0000","last_became_active":"2023-09-30T22:26:34.459291+0000","last_became_peered":"2023-09-30T22:26:34.459291+0000","last_unstale":"2023-09-30T22:26:34.463494+0000","last_undegraded":"2023-09-30T22:26:34.463494+0000","last_fullsized":"2023-09-30T22:26:34.463494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.428859+0000","last_change":"2023-09-30T22:26:34.036944+0000","last_active":"2023-09-30T22:26:34.428859+0000","last_peered":"2023-09-30T22:26:34.428859+0000","last_clean":"2023-09-30T22:26:34.428859+0000","last_became_active":"2023-09-30T22:26:34.036564+0000","last_became_peered":"2023-09-30T22:26:34.036564+0000","last_unstale":"2023-09-30T22:26:34.428859+0000","last_undegraded":"2023-09-30T22:26:34.428859+0000","last_fullsized":"2023-09-30T22:26:34.428859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.468638+0000","last_change":"2023-09-30T22:26:34.464712+0000","last_active":"2023-09-30T22:26:34.468638+0000","last_peered":"2023-09-30T22:26:34.468638+0000","last_clean":"2023-09-30T22:26:34.468638+0000","last_became_active":"2023-09-30T22:26:34.464032+0000","last_became_peered":"2023-09-30T22:26:34.464032+0000","last_unstale":"2023-09-30T22:26:34.468638+0000","last_undegraded":"2023-09-30T22:26:34.468638+0000","last_fullsized":"2023-09-30T22:26:34.468638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423659+0000","last_change":"2023-09-30T22:26:34.041116+0000","last_active":"2023-09-30T22:26:34.423659+0000","last_peered":"2023-09-30T22:26:34.423659+0000","last_clean":"2023-09-30T22:26:34.423659+0000","last_became_active":"2023-09-30T22:26:34.040484+0000","last_became_peered":"2023-09-30T22:26:34.040484+0000","last_unstale":"2023-09-30T22:26:34.423659+0000","last_undegraded":"2023-09-30T22:26:34.423659+0000","last_fullsized":"2023-09-30T22:26:34.423659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466426+0000","last_change":"2023-09-30T22:26:34.461558+0000","last_active":"2023-09-30T22:26:34.466426+0000","last_peered":"2023-09-30T22:26:34.466426+0000","last_clean":"2023-09-30T22:26:34.466426+0000","last_became_active":"2023-09-30T22:26:34.461274+0000","last_became_peered":"2023-09-30T22:26:34.461274+0000","last_unstale":"2023-09-30T22:26:34.466426+0000","last_undegraded":"2023-09-30T22:26:34.466426+0000","last_fullsized":"2023-09-30T22:26:34.466426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423512+0000","last_change":"2023-09-30T22:26:34.026179+0000","last_active":"2023-09-30T22:26:34.423512+0000","last_peered":"2023-09-30T22:26:34.423512+0000","last_clean":"2023-09-30T22:26:34.423512+0000","last_became_active":"2023-09-30T22:26:34.025896+0000","last_became_peered":"2023-09-30T22:26:34.025896+0000","last_unstale":"2023-09-30T22:26:34.423512+0000","last_undegraded":"2023-09-30T22:26:34.423512+0000","last_fullsized":"2023-09-30T22:26:34.423512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.469966+0000","last_change":"2023-09-30T22:26:34.461868+0000","last_active":"2023-09-30T22:26:34.469966+0000","last_peered":"2023-09-30T22:26:34.469966+0000","last_clean":"2023-09-30T22:26:34.469966+0000","last_became_active":"2023-09-30T22:26:34.458462+0000","last_became_peered":"2023-09-30T22:26:34.458462+0000","last_unstale":"2023-09-30T22:26:34.469966+0000","last_undegraded":"2023-09-30T22:26:34.469966+0000","last_fullsized":"2023-09-30T22:26:34.469966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.431770+0000","last_change":"2023-09-30T22:26:34.034800+0000","last_active":"2023-09-30T22:26:34.431770+0000","last_peered":"2023-09-30T22:26:34.431770+0000","last_clean":"2023-09-30T22:26:34.431770+0000","last_became_active":"2023-09-30T22:26:34.034161+0000","last_became_peered":"2023-09-30T22:26:34.034161+0000","last_unstale":"2023-09-30T22:26:34.431770+0000","last_undegraded":"2023-09-30T22:26:34.431770+0000","last_fullsized":"2023-09-30T22:26:34.431770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454988+0000","last_change":"2023-09-30T22:26:34.450219+0000","last_active":"2023-09-30T22:26:34.454988+0000","last_peered":"2023-09-30T22:26:34.454988+0000","last_clean":"2023-09-30T22:26:34.454988+0000","last_became_active":"2023-09-30T22:26:34.449611+0000","last_became_peered":"2023-09-30T22:26:34.449611+0000","last_unstale":"2023-09-30T22:26:34.454988+0000","last_undegraded":"2023-09-30T22:26:34.454988+0000","last_fullsized":"2023-09-30T22:26:34.454988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460602+0000","last_change":"2023-09-30T22:26:34.037459+0000","last_active":"2023-09-30T22:26:34.460602+0000","last_peered":"2023-09-30T22:26:34.460602+0000","last_clean":"2023-09-30T22:26:34.460602+0000","last_became_active":"2023-09-30T22:26:34.037268+0000","last_became_peered":"2023-09-30T22:26:34.037268+0000","last_unstale":"2023-09-30T22:26:34.460602+0000","last_undegraded":"2023-09-30T22:26:34.460602+0000","last_fullsized":"2023-09-30T22:26:34.460602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470919+0000","last_change":"2023-09-30T22:26:34.462289+0000","last_active":"2023-09-30T22:26:34.470919+0000","last_peered":"2023-09-30T22:26:34.470919+0000","last_clean":"2023-09-30T22:26:34.470919+0000","last_became_active":"2023-09-30T22:26:34.461927+0000","last_became_peered":"2023-09-30T22:26:34.461927+0000","last_unstale":"2023-09-30T22:26:34.470919+0000","last_undegraded":"2023-09-30T22:26:34.470919+0000","last_fullsized":"2023-09-30T22:26:34.470919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470074+0000","last_change":"2023-09-30T22:26:34.040307+0000","last_active":"2023-09-30T22:26:34.470074+0000","last_peered":"2023-09-30T22:26:34.470074+0000","last_clean":"2023-09-30T22:26:34.470074+0000","last_became_active":"2023-09-30T22:26:34.040017+0000","last_became_peered":"2023-09-30T22:26:34.040017+0000","last_unstale":"2023-09-30T22:26:34.470074+0000","last_undegraded":"2023-09-30T22:26:34.470074+0000","last_fullsized":"2023-09-30T22:26:34.470074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460303+0000","last_change":"2023-09-30T22:26:34.453373+0000","last_active":"2023-09-30T22:26:34.460303+0000","last_peered":"2023-09-30T22:26:34.460303+0000","last_clean":"2023-09-30T22:26:34.460303+0000","last_became_active":"2023-09-30T22:26:34.453075+0000","last_became_peered":"2023-09-30T22:26:34.453075+0000","last_unstale":"2023-09-30T22:26:34.460303+0000","last_undegraded":"2023-09-30T22:26:34.460303+0000","last_fullsized":"2023-09-30T22:26:34.460303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460377+0000","last_change":"2023-09-30T22:26:34.042269+0000","last_active":"2023-09-30T22:26:34.460377+0000","last_peered":"2023-09-30T22:26:34.460377+0000","last_clean":"2023-09-30T22:26:34.460377+0000","last_became_active":"2023-09-30T22:26:34.040124+0000","last_became_peered":"2023-09-30T22:26:34.040124+0000","last_unstale":"2023-09-30T22:26:34.460377+0000","last_undegraded":"2023-09-30T22:26:34.460377+0000","last_fullsized":"2023-09-30T22:26:34.460377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.465633+0000","last_change":"2023-09-30T22:26:34.459725+0000","last_active":"2023-09-30T22:26:34.465633+0000","last_peered":"2023-09-30T22:26:34.465633+0000","last_clean":"2023-09-30T22:26:34.465633+0000","last_became_active":"2023-09-30T22:26:34.459414+0000","last_became_peered":"2023-09-30T22:26:34.459414+0000","last_unstale":"2023-09-30T22:26:34.465633+0000","last_undegraded":"2023-09-30T22:26:34.465633+0000","last_fullsized":"2023-09-30T22:26:34.465633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.424477+0000","last_change":"2023-09-30T22:26:34.024931+0000","last_active":"2023-09-30T22:26:34.424477+0000","last_peered":"2023-09-30T22:26:34.424477+0000","last_clean":"2023-09-30T22:26:34.424477+0000","last_became_active":"2023-09-30T22:26:34.024616+0000","last_became_peered":"2023-09-30T22:26:34.024616+0000","last_unstale":"2023-09-30T22:26:34.424477+0000","last_undegraded":"2023-09-30T22:26:34.424477+0000","last_fullsized":"2023-09-30T22:26:34.424477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.456615+0000","last_change":"2023-09-30T22:26:34.451564+0000","last_active":"2023-09-30T22:26:34.456615+0000","last_peered":"2023-09-30T22:26:34.456615+0000","last_clean":"2023-09-30T22:26:34.456615+0000","last_became_active":"2023-09-30T22:26:34.448514+0000","last_became_peered":"2023-09-30T22:26:34.448514+0000","last_unstale":"2023-09-30T22:26:34.456615+0000","last_undegraded":"2023-09-30T22:26:34.456615+0000","last_fullsized":"2023-09-30T22:26:34.456615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.425637+0000","last_change":"2023-09-30T22:26:34.040402+0000","last_active":"2023-09-30T22:26:34.425637+0000","last_peered":"2023-09-30T22:26:34.425637+0000","last_clean":"2023-09-30T22:26:34.425637+0000","last_became_active":"2023-09-30T22:26:34.039702+0000","last_became_peered":"2023-09-30T22:26:34.039702+0000","last_unstale":"2023-09-30T22:26:34.425637+0000","last_undegraded":"2023-09-30T22:26:34.425637+0000","last_fullsized":"2023-09-30T22:26:34.425637+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454847+0000","last_change":"2023-09-30T22:26:34.450058+0000","last_active":"2023-09-30T22:26:34.454847+0000","last_peered":"2023-09-30T22:26:34.454847+0000","last_clean":"2023-09-30T22:26:34.454847+0000","last_became_active":"2023-09-30T22:26:34.449698+0000","last_became_peered":"2023-09-30T22:26:34.449698+0000","last_unstale":"2023-09-30T22:26:34.454847+0000","last_undegraded":"2023-09-30T22:26:34.454847+0000","last_fullsized":"2023-09-30T22:26:34.454847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471717+0000","last_change":"2023-09-30T22:26:34.041826+0000","last_active":"2023-09-30T22:26:34.471717+0000","last_peered":"2023-09-30T22:26:34.471717+0000","last_clean":"2023-09-30T22:26:34.471717+0000","last_became_active":"2023-09-30T22:26:34.041527+0000","last_became_peered":"2023-09-30T22:26:34.041527+0000","last_unstale":"2023-09-30T22:26:34.471717+0000","last_undegraded":"2023-09-30T22:26:34.471717+0000","last_fullsized":"2023-09-30T22:26:34.471717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466408+0000","last_change":"2023-09-30T22:26:34.461435+0000","last_active":"2023-09-30T22:26:34.466408+0000","last_peered":"2023-09-30T22:26:34.466408+0000","last_clean":"2023-09-30T22:26:34.466408+0000","last_became_active":"2023-09-30T22:26:34.461089+0000","last_became_peered":"2023-09-30T22:26:34.461089+0000","last_unstale":"2023-09-30T22:26:34.466408+0000","last_undegraded":"2023-09-30T22:26:34.466408+0000","last_fullsized":"2023-09-30T22:26:34.466408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471028+0000","last_change":"2023-09-30T22:26:34.030071+0000","last_active":"2023-09-30T22:26:34.471028+0000","last_peered":"2023-09-30T22:26:34.471028+0000","last_clean":"2023-09-30T22:26:34.471028+0000","last_became_active":"2023-09-30T22:26:34.029419+0000","last_became_peered":"2023-09-30T22:26:34.029419+0000","last_unstale":"2023-09-30T22:26:34.471028+0000","last_undegraded":"2023-09-30T22:26:34.471028+0000","last_fullsized":"2023-09-30T22:26:34.471028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470012+0000","last_change":"2023-09-30T22:26:34.462138+0000","last_active":"2023-09-30T22:26:34.470012+0000","last_peered":"2023-09-30T22:26:34.470012+0000","last_clean":"2023-09-30T22:26:34.470012+0000","last_became_active":"2023-09-30T22:26:34.461046+0000","last_became_peered":"2023-09-30T22:26:34.461046+0000","last_unstale":"2023-09-30T22:26:34.470012+0000","last_undegraded":"2023-09-30T22:26:34.470012+0000","last_fullsized":"2023-09-30T22:26:34.470012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.446894+0000","last_change":"2023-09-30T22:26:34.024286+0000","last_active":"2023-09-30T22:26:34.446894+0000","last_peered":"2023-09-30T22:26:34.446894+0000","last_clean":"2023-09-30T22:26:34.446894+0000","last_became_active":"2023-09-30T22:26:34.022989+0000","last_became_peered":"2023-09-30T22:26:34.022989+0000","last_unstale":"2023-09-30T22:26:34.446894+0000","last_undegraded":"2023-09-30T22:26:34.446894+0000","last_fullsized":"2023-09-30T22:26:34.446894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461265+0000","last_change":"2023-09-30T22:26:34.453594+0000","last_active":"2023-09-30T22:26:34.461265+0000","last_peered":"2023-09-30T22:26:34.461265+0000","last_clean":"2023-09-30T22:26:34.461265+0000","last_became_active":"2023-09-30T22:26:34.453288+0000","last_became_peered":"2023-09-30T22:26:34.453288+0000","last_unstale":"2023-09-30T22:26:34.461265+0000","last_undegraded":"2023-09-30T22:26:34.461265+0000","last_fullsized":"2023-09-30T22:26:34.461265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.465754+0000","last_change":"2023-09-30T22:26:34.042026+0000","last_active":"2023-09-30T22:26:34.465754+0000","last_peered":"2023-09-30T22:26:34.465754+0000","last_clean":"2023-09-30T22:26:34.465754+0000","last_became_active":"2023-09-30T22:26:34.041309+0000","last_became_peered":"2023-09-30T22:26:34.041309+0000","last_unstale":"2023-09-30T22:26:34.465754+0000","last_undegraded":"2023-09-30T22:26:34.465754+0000","last_fullsized":"2023-09-30T22:26:34.465754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460615+0000","last_change":"2023-09-30T22:26:34.448356+0000","last_active":"2023-09-30T22:26:34.460615+0000","last_peered":"2023-09-30T22:26:34.460615+0000","last_clean":"2023-09-30T22:26:34.460615+0000","last_became_active":"2023-09-30T22:26:34.447744+0000","last_became_peered":"2023-09-30T22:26:34.447744+0000","last_unstale":"2023-09-30T22:26:34.460615+0000","last_undegraded":"2023-09-30T22:26:34.460615+0000","last_fullsized":"2023-09-30T22:26:34.460615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.422389+0000","last_change":"2023-09-30T22:26:34.025526+0000","last_active":"2023-09-30T22:26:34.422389+0000","last_peered":"2023-09-30T22:26:34.422389+0000","last_clean":"2023-09-30T22:26:34.422389+0000","last_became_active":"2023-09-30T22:26:34.025214+0000","last_became_peered":"2023-09-30T22:26:34.025214+0000","last_unstale":"2023-09-30T22:26:34.422389+0000","last_undegraded":"2023-09-30T22:26:34.422389+0000","last_fullsized":"2023-09-30T22:26:34.422389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459520+0000","last_change":"2023-09-30T22:26:34.457634+0000","last_active":"2023-09-30T22:26:34.459520+0000","last_peered":"2023-09-30T22:26:34.459520+0000","last_clean":"2023-09-30T22:26:34.459520+0000","last_became_active":"2023-09-30T22:26:34.457314+0000","last_became_peered":"2023-09-30T22:26:34.457314+0000","last_unstale":"2023-09-30T22:26:34.459520+0000","last_undegraded":"2023-09-30T22:26:34.459520+0000","last_fullsized":"2023-09-30T22:26:34.459520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461205+0000","last_change":"2023-09-30T22:26:34.042476+0000","last_active":"2023-09-30T22:26:34.461205+0000","last_peered":"2023-09-30T22:26:34.461205+0000","last_clean":"2023-09-30T22:26:34.461205+0000","last_became_active":"2023-09-30T22:26:34.040552+0000","last_became_peered":"2023-09-30T22:26:34.040552+0000","last_unstale":"2023-09-30T22:26:34.461205+0000","last_undegraded":"2023-09-30T22:26:34.461205+0000","last_fullsized":"2023-09-30T22:26:34.461205+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454805+0000","last_change":"2023-09-30T22:26:34.451427+0000","last_active":"2023-09-30T22:26:34.454805+0000","last_peered":"2023-09-30T22:26:34.454805+0000","last_clean":"2023-09-30T22:26:34.454805+0000","last_became_active":"2023-09-30T22:26:34.451149+0000","last_became_peered":"2023-09-30T22:26:34.451149+0000","last_unstale":"2023-09-30T22:26:34.454805+0000","last_undegraded":"2023-09-30T22:26:34.454805+0000","last_fullsized":"2023-09-30T22:26:34.454805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423902+0000","last_change":"2023-09-30T22:26:34.039863+0000","last_active":"2023-09-30T22:26:34.423902+0000","last_peered":"2023-09-30T22:26:34.423902+0000","last_clean":"2023-09-30T22:26:34.423902+0000","last_became_active":"2023-09-30T22:26:34.039536+0000","last_became_peered":"2023-09-30T22:26:34.039536+0000","last_unstale":"2023-09-30T22:26:34.423902+0000","last_undegraded":"2023-09-30T22:26:34.423902+0000","last_fullsized":"2023-09-30T22:26:34.423902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463474+0000","last_change":"2023-09-30T22:26:34.459623+0000","last_active":"2023-09-30T22:26:34.463474+0000","last_peered":"2023-09-30T22:26:34.463474+0000","last_clean":"2023-09-30T22:26:34.463474+0000","last_became_active":"2023-09-30T22:26:34.457887+0000","last_became_peered":"2023-09-30T22:26:34.457887+0000","last_unstale":"2023-09-30T22:26:34.463474+0000","last_undegraded":"2023-09-30T22:26:34.463474+0000","last_fullsized":"2023-09-30T22:26:34.463474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.425122+0000","last_change":"2023-09-30T22:26:34.040793+0000","last_active":"2023-09-30T22:26:34.425122+0000","last_peered":"2023-09-30T22:26:34.425122+0000","last_clean":"2023-09-30T22:26:34.425122+0000","last_became_active":"2023-09-30T22:26:34.040437+0000","last_became_peered":"2023-09-30T22:26:34.040437+0000","last_unstale":"2023-09-30T22:26:34.425122+0000","last_undegraded":"2023-09-30T22:26:34.425122+0000","last_fullsized":"2023-09-30T22:26:34.425122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460680+0000","last_change":"2023-09-30T22:26:34.446474+0000","last_active":"2023-09-30T22:26:34.460680+0000","last_peered":"2023-09-30T22:26:34.460680+0000","last_clean":"2023-09-30T22:26:34.460680+0000","last_became_active":"2023-09-30T22:26:34.445499+0000","last_became_peered":"2023-09-30T22:26:34.445499+0000","last_unstale":"2023-09-30T22:26:34.460680+0000","last_undegraded":"2023-09-30T22:26:34.460680+0000","last_fullsized":"2023-09-30T22:26:34.460680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423262+0000","last_change":"2023-09-30T22:26:34.040910+0000","last_active":"2023-09-30T22:26:34.423262+0000","last_peered":"2023-09-30T22:26:34.423262+0000","last_clean":"2023-09-30T22:26:34.423262+0000","last_became_active":"2023-09-30T22:26:34.040077+0000","last_became_peered":"2023-09-30T22:26:34.040077+0000","last_unstale":"2023-09-30T22:26:34.423262+0000","last_undegraded":"2023-09-30T22:26:34.423262+0000","last_fullsized":"2023-09-30T22:26:34.423262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471281+0000","last_change":"2023-09-30T22:26:34.466480+0000","last_active":"2023-09-30T22:26:34.471281+0000","last_peered":"2023-09-30T22:26:34.471281+0000","last_clean":"2023-09-30T22:26:34.471281+0000","last_became_active":"2023-09-30T22:26:34.466187+0000","last_became_peered":"2023-09-30T22:26:34.466187+0000","last_unstale":"2023-09-30T22:26:34.471281+0000","last_undegraded":"2023-09-30T22:26:34.471281+0000","last_fullsized":"2023-09-30T22:26:34.471281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.440724+0000","last_change":"2023-09-30T22:26:30.873307+0000","last_active":"2023-09-30T22:26:34.440724+0000","last_peered":"2023-09-30T22:26:34.440724+0000","last_clean":"2023-09-30T22:26:34.440724+0000","last_became_active":"2023-09-30T22:26:30.872872+0000","last_became_peered":"2023-09-30T22:26:30.872872+0000","last_unstale":"2023-09-30T22:26:34.440724+0000","last_undegraded":"2023-09-30T22:26:34.440724+0000","last_fullsized":"2023-09-30T22:26:34.440724+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.428047+0000","last_change":"2023-09-30T22:26:34.037332+0000","last_active":"2023-09-30T22:26:34.428047+0000","last_peered":"2023-09-30T22:26:34.428047+0000","last_clean":"2023-09-30T22:26:34.428047+0000","last_became_active":"2023-09-30T22:26:34.037114+0000","last_became_peered":"2023-09-30T22:26:34.037114+0000","last_unstale":"2023-09-30T22:26:34.428047+0000","last_undegraded":"2023-09-30T22:26:34.428047+0000","last_fullsized":"2023-09-30T22:26:34.428047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470943+0000","last_change":"2023-09-30T22:26:34.462485+0000","last_active":"2023-09-30T22:26:34.470943+0000","last_peered":"2023-09-30T22:26:34.470943+0000","last_clean":"2023-09-30T22:26:34.470943+0000","last_became_active":"2023-09-30T22:26:34.454284+0000","last_became_peered":"2023-09-30T22:26:34.454284+0000","last_unstale":"2023-09-30T22:26:34.470943+0000","last_undegraded":"2023-09-30T22:26:34.470943+0000","last_fullsized":"2023-09-30T22:26:34.470943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.424003+0000","last_change":"2023-09-30T22:26:29.861644+0000","last_active":"2023-09-30T22:26:34.424003+0000","last_peered":"2023-09-30T22:26:34.424003+0000","last_clean":"2023-09-30T22:26:34.424003+0000","last_became_active":"2023-09-30T22:26:29.861261+0000","last_became_peered":"2023-09-30T22:26:29.861261+0000","last_unstale":"2023-09-30T22:26:34.424003+0000","last_undegraded":"2023-09-30T22:26:34.424003+0000","last_fullsized":"2023-09-30T22:26:34.424003+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.432400+0000","last_change":"2023-09-30T22:26:34.024242+0000","last_active":"2023-09-30T22:26:34.432400+0000","last_peered":"2023-09-30T22:26:34.432400+0000","last_clean":"2023-09-30T22:26:34.432400+0000","last_became_active":"2023-09-30T22:26:34.023935+0000","last_became_peered":"2023-09-30T22:26:34.023935+0000","last_unstale":"2023-09-30T22:26:34.432400+0000","last_undegraded":"2023-09-30T22:26:34.432400+0000","last_fullsized":"2023-09-30T22:26:34.432400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460658+0000","last_change":"2023-09-30T22:26:34.444993+0000","last_active":"2023-09-30T22:26:34.460658+0000","last_peered":"2023-09-30T22:26:34.460658+0000","last_clean":"2023-09-30T22:26:34.460658+0000","last_became_active":"2023-09-30T22:26:34.444739+0000","last_became_peered":"2023-09-30T22:26:34.444739+0000","last_unstale":"2023-09-30T22:26:34.460658+0000","last_undegraded":"2023-09-30T22:26:34.460658+0000","last_fullsized":"2023-09-30T22:26:34.460658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.427254+0000","last_change":"2023-09-30T22:26:29.858340+0000","last_active":"2023-09-30T22:26:34.427254+0000","last_peered":"2023-09-30T22:26:34.427254+0000","last_clean":"2023-09-30T22:26:34.427254+0000","last_became_active":"2023-09-30T22:26:29.857989+0000","last_became_peered":"2023-09-30T22:26:29.857989+0000","last_unstale":"2023-09-30T22:26:34.427254+0000","last_undegraded":"2023-09-30T22:26:34.427254+0000","last_fullsized":"2023-09-30T22:26:34.427254+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429669+0000","last_change":"2023-09-30T22:26:34.031173+0000","last_active":"2023-09-30T22:26:34.429669+0000","last_peered":"2023-09-30T22:26:34.429669+0000","last_clean":"2023-09-30T22:26:34.429669+0000","last_became_active":"2023-09-30T22:26:34.030863+0000","last_became_peered":"2023-09-30T22:26:34.030863+0000","last_unstale":"2023-09-30T22:26:34.429669+0000","last_undegraded":"2023-09-30T22:26:34.429669+0000","last_fullsized":"2023-09-30T22:26:34.429669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462678+0000","last_change":"2023-09-30T22:26:34.456017+0000","last_active":"2023-09-30T22:26:34.462678+0000","last_peered":"2023-09-30T22:26:34.462678+0000","last_clean":"2023-09-30T22:26:34.462678+0000","last_became_active":"2023-09-30T22:26:34.455744+0000","last_became_peered":"2023-09-30T22:26:34.455744+0000","last_unstale":"2023-09-30T22:26:34.462678+0000","last_undegraded":"2023-09-30T22:26:34.462678+0000","last_fullsized":"2023-09-30T22:26:34.462678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423631+0000","last_change":"2023-09-30T22:26:29.859074+0000","last_active":"2023-09-30T22:26:34.423631+0000","last_peered":"2023-09-30T22:26:34.423631+0000","last_clean":"2023-09-30T22:26:34.423631+0000","last_became_active":"2023-09-30T22:26:29.858669+0000","last_became_peered":"2023-09-30T22:26:29.858669+0000","last_unstale":"2023-09-30T22:26:34.423631+0000","last_undegraded":"2023-09-30T22:26:34.423631+0000","last_fullsized":"2023-09-30T22:26:34.423631+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429553+0000","last_change":"2023-09-30T22:26:28.864097+0000","last_active":"2023-09-30T22:26:34.429553+0000","last_peered":"2023-09-30T22:26:34.429553+0000","last_clean":"2023-09-30T22:26:34.429553+0000","last_became_active":"2023-09-30T22:26:28.863723+0000","last_became_peered":"2023-09-30T22:26:28.863723+0000","last_unstale":"2023-09-30T22:26:34.429553+0000","last_undegraded":"2023-09-30T22:26:34.429553+0000","last_fullsized":"2023-09-30T22:26:34.429553+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_clean_scrub_stamp":"2023-09-30T22:26:27.842299+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423778+0000","last_change":"2023-09-30T22:26:34.040465+0000","last_active":"2023-09-30T22:26:34.423778+0000","last_peered":"2023-09-30T22:26:34.423778+0000","last_clean":"2023-09-30T22:26:34.423778+0000","last_became_active":"2023-09-30T22:26:34.039806+0000","last_became_peered":"2023-09-30T22:26:34.039806+0000","last_unstale":"2023-09-30T22:26:34.423778+0000","last_undegraded":"2023-09-30T22:26:34.423778+0000","last_fullsized":"2023-09-30T22:26:34.423778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463514+0000","last_change":"2023-09-30T22:26:34.459817+0000","last_active":"2023-09-30T22:26:34.463514+0000","last_peered":"2023-09-30T22:26:34.463514+0000","last_clean":"2023-09-30T22:26:34.463514+0000","last_became_active":"2023-09-30T22:26:34.458434+0000","last_became_peered":"2023-09-30T22:26:34.458434+0000","last_unstale":"2023-09-30T22:26:34.463514+0000","last_undegraded":"2023-09-30T22:26:34.463514+0000","last_fullsized":"2023-09-30T22:26:34.463514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423531+0000","last_change":"2023-09-30T22:26:29.861337+0000","last_active":"2023-09-30T22:26:34.423531+0000","last_peered":"2023-09-30T22:26:34.423531+0000","last_clean":"2023-09-30T22:26:34.423531+0000","last_became_active":"2023-09-30T22:26:29.861003+0000","last_became_peered":"2023-09-30T22:26:29.861003+0000","last_unstale":"2023-09-30T22:26:34.423531+0000","last_undegraded":"2023-09-30T22:26:34.423531+0000","last_fullsized":"2023-09-30T22:26:34.423531+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.426034+0000","last_change":"2023-09-30T22:26:34.022924+0000","last_active":"2023-09-30T22:26:34.426034+0000","last_peered":"2023-09-30T22:26:34.426034+0000","last_clean":"2023-09-30T22:26:34.426034+0000","last_became_active":"2023-09-30T22:26:34.022592+0000","last_became_peered":"2023-09-30T22:26:34.022592+0000","last_unstale":"2023-09-30T22:26:34.426034+0000","last_undegraded":"2023-09-30T22:26:34.426034+0000","last_fullsized":"2023-09-30T22:26:34.426034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470264+0000","last_change":"2023-09-30T22:26:34.464915+0000","last_active":"2023-09-30T22:26:34.470264+0000","last_peered":"2023-09-30T22:26:34.470264+0000","last_clean":"2023-09-30T22:26:34.470264+0000","last_became_active":"2023-09-30T22:26:34.464406+0000","last_became_peered":"2023-09-30T22:26:34.464406+0000","last_unstale":"2023-09-30T22:26:34.470264+0000","last_undegraded":"2023-09-30T22:26:34.470264+0000","last_fullsized":"2023-09-30T22:26:34.470264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.426359+0000","last_change":"2023-09-30T22:26:30.874397+0000","last_active":"2023-09-30T22:26:34.426359+0000","last_peered":"2023-09-30T22:26:34.426359+0000","last_clean":"2023-09-30T22:26:34.426359+0000","last_became_active":"2023-09-30T22:26:30.874057+0000","last_became_peered":"2023-09-30T22:26:30.874057+0000","last_unstale":"2023-09-30T22:26:34.426359+0000","last_undegraded":"2023-09-30T22:26:34.426359+0000","last_fullsized":"2023-09-30T22:26:34.426359+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429371+0000","last_change":"2023-09-30T22:26:34.037126+0000","last_active":"2023-09-30T22:26:34.429371+0000","last_peered":"2023-09-30T22:26:34.429371+0000","last_clean":"2023-09-30T22:26:34.429371+0000","last_became_active":"2023-09-30T22:26:34.036825+0000","last_became_peered":"2023-09-30T22:26:34.036825+0000","last_unstale":"2023-09-30T22:26:34.429371+0000","last_undegraded":"2023-09-30T22:26:34.429371+0000","last_fullsized":"2023-09-30T22:26:34.429371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.446597+0000","last_change":"2023-09-30T22:26:34.443381+0000","last_active":"2023-09-30T22:26:34.446597+0000","last_peered":"2023-09-30T22:26:34.446597+0000","last_clean":"2023-09-30T22:26:34.446597+0000","last_became_active":"2023-09-30T22:26:34.443094+0000","last_became_peered":"2023-09-30T22:26:34.443094+0000","last_unstale":"2023-09-30T22:26:34.446597+0000","last_undegraded":"2023-09-30T22:26:34.446597+0000","last_fullsized":"2023-09-30T22:26:34.446597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466600+0000","last_change":"2023-09-30T22:26:34.041060+0000","last_active":"2023-09-30T22:26:34.466600+0000","last_peered":"2023-09-30T22:26:34.466600+0000","last_clean":"2023-09-30T22:26:34.466600+0000","last_became_active":"2023-09-30T22:26:34.040742+0000","last_became_peered":"2023-09-30T22:26:34.040742+0000","last_unstale":"2023-09-30T22:26:34.466600+0000","last_undegraded":"2023-09-30T22:26:34.466600+0000","last_fullsized":"2023-09-30T22:26:34.466600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429047+0000","last_change":"2023-09-30T22:26:30.873252+0000","last_active":"2023-09-30T22:26:34.429047+0000","last_peered":"2023-09-30T22:26:34.429047+0000","last_clean":"2023-09-30T22:26:34.429047+0000","last_became_active":"2023-09-30T22:26:30.872894+0000","last_became_peered":"2023-09-30T22:26:30.872894+0000","last_unstale":"2023-09-30T22:26:34.429047+0000","last_undegraded":"2023-09-30T22:26:34.429047+0000","last_fullsized":"2023-09-30T22:26:34.429047+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.469989+0000","last_change":"2023-09-30T22:26:34.462059+0000","last_active":"2023-09-30T22:26:34.469989+0000","last_peered":"2023-09-30T22:26:34.469989+0000","last_clean":"2023-09-30T22:26:34.469989+0000","last_became_active":"2023-09-30T22:26:34.461415+0000","last_became_peered":"2023-09-30T22:26:34.461415+0000","last_unstale":"2023-09-30T22:26:34.469989+0000","last_undegraded":"2023-09-30T22:26:34.469989+0000","last_fullsized":"2023-09-30T22:26:34.469989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.424541+0000","last_change":"2023-09-30T22:26:30.874887+0000","last_active":"2023-09-30T22:26:34.424541+0000","last_peered":"2023-09-30T22:26:34.424541+0000","last_clean":"2023-09-30T22:26:34.424541+0000","last_became_active":"2023-09-30T22:26:30.874533+0000","last_became_peered":"2023-09-30T22:26:30.874533+0000","last_unstale":"2023-09-30T22:26:34.424541+0000","last_undegraded":"2023-09-30T22:26:34.424541+0000","last_fullsized":"2023-09-30T22:26:34.424541+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.435269+0000","last_change":"2023-09-30T22:26:34.029291+0000","last_active":"2023-09-30T22:26:34.435269+0000","last_peered":"2023-09-30T22:26:34.435269+0000","last_clean":"2023-09-30T22:26:34.435269+0000","last_became_active":"2023-09-30T22:26:34.028983+0000","last_became_peered":"2023-09-30T22:26:34.028983+0000","last_unstale":"2023-09-30T22:26:34.435269+0000","last_undegraded":"2023-09-30T22:26:34.435269+0000","last_fullsized":"2023-09-30T22:26:34.435269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460262+0000","last_change":"2023-09-30T22:26:34.453608+0000","last_active":"2023-09-30T22:26:34.460262+0000","last_peered":"2023-09-30T22:26:34.460262+0000","last_clean":"2023-09-30T22:26:34.460262+0000","last_became_active":"2023-09-30T22:26:34.453255+0000","last_became_peered":"2023-09-30T22:26:34.453255+0000","last_unstale":"2023-09-30T22:26:34.460262+0000","last_undegraded":"2023-09-30T22:26:34.460262+0000","last_fullsized":"2023-09-30T22:26:34.460262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454524+0000","last_change":"2023-09-30T22:26:34.026874+0000","last_active":"2023-09-30T22:26:34.454524+0000","last_peered":"2023-09-30T22:26:34.454524+0000","last_clean":"2023-09-30T22:26:34.454524+0000","last_became_active":"2023-09-30T22:26:34.024536+0000","last_became_peered":"2023-09-30T22:26:34.024536+0000","last_unstale":"2023-09-30T22:26:34.454524+0000","last_undegraded":"2023-09-30T22:26:34.454524+0000","last_fullsized":"2023-09-30T22:26:34.454524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460574+0000","last_change":"2023-09-30T22:26:34.452982+0000","last_active":"2023-09-30T22:26:34.460574+0000","last_peered":"2023-09-30T22:26:34.460574+0000","last_clean":"2023-09-30T22:26:34.460574+0000","last_became_active":"2023-09-30T22:26:34.452695+0000","last_became_peered":"2023-09-30T22:26:34.452695+0000","last_unstale":"2023-09-30T22:26:34.460574+0000","last_undegraded":"2023-09-30T22:26:34.460574+0000","last_fullsized":"2023-09-30T22:26:34.460574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471263+0000","last_change":"2023-09-30T22:26:34.045553+0000","last_active":"2023-09-30T22:26:34.471263+0000","last_peered":"2023-09-30T22:26:34.471263+0000","last_clean":"2023-09-30T22:26:34.471263+0000","last_became_active":"2023-09-30T22:26:34.045206+0000","last_became_peered":"2023-09-30T22:26:34.045206+0000","last_unstale":"2023-09-30T22:26:34.471263+0000","last_undegraded":"2023-09-30T22:26:34.471263+0000","last_fullsized":"2023-09-30T22:26:34.471263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460323+0000","last_change":"2023-09-30T22:26:34.454158+0000","last_active":"2023-09-30T22:26:34.460323+0000","last_peered":"2023-09-30T22:26:34.460323+0000","last_clean":"2023-09-30T22:26:34.460323+0000","last_became_active":"2023-09-30T22:26:34.453928+0000","last_became_peered":"2023-09-30T22:26:34.453928+0000","last_unstale":"2023-09-30T22:26:34.460323+0000","last_undegraded":"2023-09-30T22:26:34.460323+0000","last_fullsized":"2023-09-30T22:26:34.460323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461491+0000","last_change":"2023-09-30T22:26:34.045717+0000","last_active":"2023-09-30T22:26:34.461491+0000","last_peered":"2023-09-30T22:26:34.461491+0000","last_clean":"2023-09-30T22:26:34.461491+0000","last_became_active":"2023-09-30T22:26:34.045395+0000","last_became_peered":"2023-09-30T22:26:34.045395+0000","last_unstale":"2023-09-30T22:26:34.461491+0000","last_undegraded":"2023-09-30T22:26:34.461491+0000","last_fullsized":"2023-09-30T22:26:34.461491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460634+0000","last_change":"2023-09-30T22:26:34.448542+0000","last_active":"2023-09-30T22:26:34.460634+0000","last_peered":"2023-09-30T22:26:34.460634+0000","last_clean":"2023-09-30T22:26:34.460634+0000","last_became_active":"2023-09-30T22:26:34.448081+0000","last_became_peered":"2023-09-30T22:26:34.448081+0000","last_unstale":"2023-09-30T22:26:34.460634+0000","last_undegraded":"2023-09-30T22:26:34.460634+0000","last_fullsized":"2023-09-30T22:26:34.460634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462279+0000","last_change":"2023-09-30T22:26:34.039959+0000","last_active":"2023-09-30T22:26:34.462279+0000","last_peered":"2023-09-30T22:26:34.462279+0000","last_clean":"2023-09-30T22:26:34.462279+0000","last_became_active":"2023-09-30T22:26:34.039615+0000","last_became_peered":"2023-09-30T22:26:34.039615+0000","last_unstale":"2023-09-30T22:26:34.462279+0000","last_undegraded":"2023-09-30T22:26:34.462279+0000","last_fullsized":"2023-09-30T22:26:34.462279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.450313+0000","last_change":"2023-09-30T22:26:34.442775+0000","last_active":"2023-09-30T22:26:34.450313+0000","last_peered":"2023-09-30T22:26:34.450313+0000","last_clean":"2023-09-30T22:26:34.450313+0000","last_became_active":"2023-09-30T22:26:34.442406+0000","last_became_peered":"2023-09-30T22:26:34.442406+0000","last_unstale":"2023-09-30T22:26:34.450313+0000","last_undegraded":"2023-09-30T22:26:34.450313+0000","last_fullsized":"2023-09-30T22:26:34.450313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466261+0000","last_change":"2023-09-30T22:26:34.030292+0000","last_active":"2023-09-30T22:26:34.466261+0000","last_peered":"2023-09-30T22:26:34.466261+0000","last_clean":"2023-09-30T22:26:34.466261+0000","last_became_active":"2023-09-30T22:26:34.029782+0000","last_became_peered":"2023-09-30T22:26:34.029782+0000","last_unstale":"2023-09-30T22:26:34.466261+0000","last_undegraded":"2023-09-30T22:26:34.466261+0000","last_fullsized":"2023-09-30T22:26:34.466261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459154+0000","last_change":"2023-09-30T22:26:34.446235+0000","last_active":"2023-09-30T22:26:34.459154+0000","last_peered":"2023-09-30T22:26:34.459154+0000","last_clean":"2023-09-30T22:26:34.459154+0000","last_became_active":"2023-09-30T22:26:34.445921+0000","last_became_peered":"2023-09-30T22:26:34.445921+0000","last_unstale":"2023-09-30T22:26:34.459154+0000","last_undegraded":"2023-09-30T22:26:34.459154+0000","last_fullsized":"2023-09-30T22:26:34.459154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.451360+0000","last_change":"2023-09-30T22:26:34.441075+0000","last_active":"2023-09-30T22:26:34.451360+0000","last_peered":"2023-09-30T22:26:34.451360+0000","last_clean":"2023-09-30T22:26:34.451360+0000","last_became_active":"2023-09-30T22:26:34.440633+0000","last_became_peered":"2023-09-30T22:26:34.440633+0000","last_unstale":"2023-09-30T22:26:34.451360+0000","last_undegraded":"2023-09-30T22:26:34.451360+0000","last_fullsized":"2023-09-30T22:26:34.451360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463443+0000","last_change":"2023-09-30T22:26:34.458062+0000","last_active":"2023-09-30T22:26:34.463443+0000","last_peered":"2023-09-30T22:26:34.463443+0000","last_clean":"2023-09-30T22:26:34.463443+0000","last_became_active":"2023-09-30T22:26:34.457757+0000","last_became_peered":"2023-09-30T22:26:34.457757+0000","last_unstale":"2023-09-30T22:26:34.463443+0000","last_undegraded":"2023-09-30T22:26:34.463443+0000","last_fullsized":"2023-09-30T22:26:34.463443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.455136+0000","last_change":"2023-09-30T22:26:34.450865+0000","last_active":"2023-09-30T22:26:34.455136+0000","last_peered":"2023-09-30T22:26:34.455136+0000","last_clean":"2023-09-30T22:26:34.455136+0000","last_became_active":"2023-09-30T22:26:34.450568+0000","last_became_peered":"2023-09-30T22:26:34.450568+0000","last_unstale":"2023-09-30T22:26:34.455136+0000","last_undegraded":"2023-09-30T22:26:34.455136+0000","last_fullsized":"2023-09-30T22:26:34.455136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.467022+0000","last_change":"2023-09-30T22:26:34.461553+0000","last_active":"2023-09-30T22:26:34.467022+0000","last_peered":"2023-09-30T22:26:34.467022+0000","last_clean":"2023-09-30T22:26:34.467022+0000","last_became_active":"2023-09-30T22:26:34.459154+0000","last_became_peered":"2023-09-30T22:26:34.459154+0000","last_unstale":"2023-09-30T22:26:34.467022+0000","last_undegraded":"2023-09-30T22:26:34.467022+0000","last_fullsized":"2023-09-30T22:26:34.467022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.451971+0000","last_change":"2023-09-30T22:26:34.444740+0000","last_active":"2023-09-30T22:26:34.451971+0000","last_peered":"2023-09-30T22:26:34.451971+0000","last_clean":"2023-09-30T22:26:34.451971+0000","last_became_active":"2023-09-30T22:26:34.444385+0000","last_became_peered":"2023-09-30T22:26:34.444385+0000","last_unstale":"2023-09-30T22:26:34.451971+0000","last_undegraded":"2023-09-30T22:26:34.451971+0000","last_fullsized":"2023-09-30T22:26:34.451971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672963,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":50948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]}]},{"osd":0,"up_from":10,"seq":42949672963,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":51127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":47938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:26:43.399 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T22:26:43.400 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T22:26:43.400 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T22:26:43.400 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T22:26:43.400 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-30T22:26:43.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.566+0000 7f9d833c3700 1 Processor -- start 2023-09-30T22:26:43.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.566+0000 7f9d833c3700 1 -- start start 2023-09-30T22:26:43.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.566+0000 7f9d833c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7c059070 0x7f9d7c12f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.566+0000 7f9d833c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7c12ecd0 0x7f9d7c12f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d833c3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c059ba0 con 0x7f9d7c095370 2023-09-30T22:26:43.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d833c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0969b0 con 0x7f9d7c059070 2023-09-30T22:26:43.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d833c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c092320 con 0x7f9d7c12ecd0 2023-09-30T22:26:43.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d8095e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7c12ecd0 0x7f9d7c12f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d8115f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7c059070 0x7f9d7c12f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d81960700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9d7c095370 0x7f9d7c095820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45044/0 (socket says 172.21.15.59:45044) 2023-09-30T22:26:43.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d81960700 1 -- 172.21.15.59:0/1775766153 learned_addr learned my addr 172.21.15.59:0/1775766153 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:43.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d73fff700 1 -- 172.21.15.59:0/1775766153 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286768875 0 0) 0x7f9d7c059ba0 con 0x7f9d7c095370 2023-09-30T22:26:43.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d8115f700 1 -- 172.21.15.59:0/1775766153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7c12ecd0 msgr2=0x7f9d7c12f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:43.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d8115f700 1 --2- 172.21.15.59:0/1775766153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7c12ecd0 0x7f9d7c12f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d8115f700 1 -- 172.21.15.59:0/1775766153 >> v1:172.21.15.59:6789/0 conn(0x7f9d7c095370 legacy=0x7f9d7c095820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d8115f700 1 -- 172.21.15.59:0/1775766153 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c091c10 con 0x7f9d7c059070 2023-09-30T22:26:43.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d8095e700 1 --2- 172.21.15.59:0/1775766153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7c12ecd0 0x7f9d7c12f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:43.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d8115f700 1 --2- 172.21.15.59:0/1775766153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7c059070 0x7f9d7c12f160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9d78009790 tx=0x7f9d78009060).ready entity=mon.1 client_cookie=44918effce416149 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d73fff700 1 -- 172.21.15.59:0/1775766153 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d780090d0 con 0x7f9d7c059070 2023-09-30T22:26:43.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d73fff700 1 -- 172.21.15.59:0/1775766153 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7800f510 con 0x7f9d7c059070 2023-09-30T22:26:43.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.567+0000 7f9d73fff700 1 -- 172.21.15.59:0/1775766153 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800f890 con 0x7f9d7c059070 2023-09-30T22:26:43.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.568+0000 7f9d833c3700 1 -- 172.21.15.59:0/1775766153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7c059070 msgr2=0x7f9d7c12f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.568+0000 7f9d833c3700 1 --2- 172.21.15.59:0/1775766153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7c059070 0x7f9d7c12f160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9d78009790 tx=0x7f9d78009060).stop 2023-09-30T22:26:43.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.568+0000 7f9d833c3700 1 -- 172.21.15.59:0/1775766153 shutdown_connections 2023-09-30T22:26:43.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.568+0000 7f9d833c3700 1 --2- 172.21.15.59:0/1775766153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7c059070 0x7f9d7c12f160 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.568+0000 7f9d833c3700 1 --2- 172.21.15.59:0/1775766153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7c12ecd0 0x7f9d7c12f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.568+0000 7f9d833c3700 1 -- 172.21.15.59:0/1775766153 >> 172.21.15.59:0/1775766153 conn(0x7f9d7c097470 msgr2=0x7f9d7c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:43.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.568+0000 7f9d833c3700 1 -- 172.21.15.59:0/1775766153 shutdown_connections 2023-09-30T22:26:43.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.568+0000 7f9d833c3700 1 -- 172.21.15.59:0/1775766153 wait complete. 2023-09-30T22:26:43.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.569+0000 7f9d833c3700 1 Processor -- start 2023-09-30T22:26:43.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.569+0000 7f9d833c3700 1 -- start start 2023-09-30T22:26:43.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d833c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7c059070 0x7f9d7c12c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d833c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7c095370 0x7f9d7c11b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d833c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d7c11bb00 0x7f9d7c11bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d833c3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c09a1f0 con 0x7f9d7c11bb00 2023-09-30T22:26:43.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d833c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c06a520 con 0x7f9d7c095370 2023-09-30T22:26:43.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d833c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c11f700 con 0x7f9d7c059070 2023-09-30T22:26:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d8115f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7c059070 0x7f9d7c12c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d8095e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7c095370 0x7f9d7c11b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d81960700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d7c11bb00 0x7f9d7c11bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d8095e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7c095370 0x7f9d7c11b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45062/0 (socket says 172.21.15.59:45062) 2023-09-30T22:26:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d8115f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7c059070 0x7f9d7c12c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42442/0 (socket says 172.21.15.59:42442) 2023-09-30T22:26:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d81960700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d7c11bb00 0x7f9d7c11bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54172/0 (socket says 172.21.15.59:54172) 2023-09-30T22:26:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d8095e700 1 -- 172.21.15.59:0/4013520511 learned_addr learned my addr 172.21.15.59:0/4013520511 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d8115f700 1 -- 172.21.15.59:0/4013520511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7c095370 msgr2=0x7f9d7c11b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d8115f700 1 --2- 172.21.15.59:0/4013520511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7c095370 0x7f9d7c11b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d8115f700 1 -- 172.21.15.59:0/4013520511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d7c11bb00 msgr2=0x7f9d7c11bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d8115f700 1 --2- 172.21.15.59:0/4013520511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d7c11bb00 0x7f9d7c11bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d8115f700 1 -- 172.21.15.59:0/4013520511 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c0092a0 con 0x7f9d7c059070 2023-09-30T22:26:43.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d8095e700 1 --2- 172.21.15.59:0/4013520511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7c095370 0x7f9d7c11b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:43.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d81960700 1 --2- 172.21.15.59:0/4013520511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d7c11bb00 0x7f9d7c11bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:43.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.570+0000 7f9d8115f700 1 --2- 172.21.15.59:0/4013520511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7c059070 0x7f9d7c12c6d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f9d7c091b40 tx=0x7f9d78017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.571+0000 7f9d717fa700 1 -- 172.21.15.59:0/4013520511 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800f890 con 0x7f9d7c059070 2023-09-30T22:26:43.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.571+0000 7f9d717fa700 1 -- 172.21.15.59:0/4013520511 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d78000d10 con 0x7f9d7c059070 2023-09-30T22:26:43.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.571+0000 7f9d833c3700 1 -- 172.21.15.59:0/4013520511 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d780092a0 con 0x7f9d7c059070 2023-09-30T22:26:43.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.571+0000 7f9d717fa700 1 -- 172.21.15.59:0/4013520511 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800fea0 con 0x7f9d7c059070 2023-09-30T22:26:43.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.571+0000 7f9d833c3700 1 -- 172.21.15.59:0/4013520511 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c11eba0 con 0x7f9d7c059070 2023-09-30T22:26:43.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.572+0000 7f9d717fa700 1 -- 172.21.15.59:0/4013520511 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9d7801b620 con 0x7f9d7c059070 2023-09-30T22:26:43.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.572+0000 7f9d717fa700 1 -- 172.21.15.59:0/4013520511 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9d7803c850 con 0x7f9d7c059070 2023-09-30T22:26:43.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.572+0000 7f9d833c3700 1 -- 172.21.15.59:0/4013520511 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c11eda0 con 0x7f9d7c059070 2023-09-30T22:26:43.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.577+0000 7f9d717fa700 1 -- 172.21.15.59:0/4013520511 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9d7c11eda0 con 0x7f9d7c059070 2023-09-30T22:26:43.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.797+0000 7f9d833c3700 1 -- 172.21.15.59:0/4013520511 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9d7c11eda0 con 0x7f9d7c059070 2023-09-30T22:26:43.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.798+0000 7f9d717fa700 1 -- 172.21.15.59:0/4013520511 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+64130 (secure 0 0 0) 0x7f9d7c11eda0 con 0x7f9d7c059070 2023-09-30T22:26:43.799 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:43.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.800+0000 7f9d833c3700 1 -- 172.21.15.59:0/4013520511 >> v1:172.21.15.59:6816/118188 conn(0x7f9d6002bb60 legacy=0x7f9d6002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.801+0000 7f9d833c3700 1 -- 172.21.15.59:0/4013520511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7c059070 msgr2=0x7f9d7c12c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.801+0000 7f9d833c3700 1 --2- 172.21.15.59:0/4013520511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7c059070 0x7f9d7c12c6d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f9d7c091b40 tx=0x7f9d78017000).stop 2023-09-30T22:26:43.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.801+0000 7f9d833c3700 1 -- 172.21.15.59:0/4013520511 shutdown_connections 2023-09-30T22:26:43.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.801+0000 7f9d833c3700 1 --2- 172.21.15.59:0/4013520511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7c059070 0x7f9d7c12c6d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.801+0000 7f9d833c3700 1 --2- 172.21.15.59:0/4013520511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d7c11bb00 0x7f9d7c11bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.801+0000 7f9d833c3700 1 --2- 172.21.15.59:0/4013520511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7c095370 0x7f9d7c11b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.801+0000 7f9d833c3700 1 -- 172.21.15.59:0/4013520511 >> 172.21.15.59:0/4013520511 conn(0x7f9d7c097470 msgr2=0x7f9d7c099280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:43.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.801+0000 7f9d833c3700 1 -- 172.21.15.59:0/4013520511 shutdown_connections 2023-09-30T22:26:43.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.801+0000 7f9d833c3700 1 -- 172.21.15.59:0/4013520511 wait complete. 2023-09-30T22:26:43.813 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":4,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6816","nonce":118188}]},"active_addr":"172.21.15.59:6816/118188","active_change":"2023-09-30T22:26:23.716187+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":3882222550}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":1346763106}]}]} 2023-09-30T22:26:43.816 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T22:26:43.816 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:26:43.816 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:26:43.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.949+0000 7f30976ca700 1 Processor -- start 2023-09-30T22:26:43.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.950+0000 7f30976ca700 1 -- start start 2023-09-30T22:26:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.950+0000 7f30976ca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3090096820 0x7f3090096c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.950+0000 7f30976ca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3090067940 0x7f30900970f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.950+0000 7f30976ca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30900975e0 0x7f309012f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.950+0000 7f30976ca700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3090068df0 con 0x7f3090096820 2023-09-30T22:26:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.950+0000 7f30976ca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309006a4c0 con 0x7f30900975e0 2023-09-30T22:26:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.950+0000 7f30976ca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3090098260 con 0x7f3090067940 2023-09-30T22:26:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.950+0000 7f3095c67700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30900975e0 0x7f309012f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.950+0000 7f3094c65700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3090067940 0x7f30900970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.950+0000 7f3095466700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3090096820 0x7f3090096c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.950+0000 7f3094c65700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3090067940 0x7f30900970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42448/0 (socket says 172.21.15.59:42448) 2023-09-30T22:26:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.950+0000 7f3095c67700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30900975e0 0x7f309012f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45064/0 (socket says 172.21.15.59:45064) 2023-09-30T22:26:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.951+0000 7f3094c65700 1 -- 172.21.15.59:0/2826363340 learned_addr learned my addr 172.21.15.59:0/2826363340 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.951+0000 7f3095c67700 1 -- 172.21.15.59:0/2826363340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3090067940 msgr2=0x7f30900970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.951+0000 7f3095c67700 1 --2- 172.21.15.59:0/2826363340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3090067940 0x7f30900970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.951+0000 7f3095c67700 1 -- 172.21.15.59:0/2826363340 >> v2:172.21.15.59:3300/0 conn(0x7f3090096820 msgr2=0x7f3090096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.951+0000 7f3095c67700 1 --2- 172.21.15.59:0/2826363340 >> v2:172.21.15.59:3300/0 conn(0x7f3090096820 0x7f3090096c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.951+0000 7f3095c67700 1 -- 172.21.15.59:0/2826363340 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3090095e60 con 0x7f30900975e0 2023-09-30T22:26:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.951+0000 7f3095466700 1 --2- 172.21.15.59:0/2826363340 >> v2:172.21.15.59:3300/0 conn(0x7f3090096820 0x7f3090096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.951+0000 7f3094c65700 1 --2- 172.21.15.59:0/2826363340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3090067940 0x7f30900970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.951+0000 7f3095c67700 1 --2- 172.21.15.59:0/2826363340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30900975e0 0x7f309012f270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3088009e60 tx=0x7f3088009780).ready entity=mon.1 client_cookie=1875d9ca6083eec7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.951+0000 7f3083fff700 1 -- 172.21.15.59:0/2826363340 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308800e070 con 0x7f30900975e0 2023-09-30T22:26:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.951+0000 7f3083fff700 1 -- 172.21.15.59:0/2826363340 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308800bab0 con 0x7f30900975e0 2023-09-30T22:26:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.951+0000 7f3083fff700 1 -- 172.21.15.59:0/2826363340 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308800be30 con 0x7f30900975e0 2023-09-30T22:26:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.952+0000 7f30976ca700 1 -- 172.21.15.59:0/2826363340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30900975e0 msgr2=0x7f309012f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.952+0000 7f30976ca700 1 --2- 172.21.15.59:0/2826363340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30900975e0 0x7f309012f270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3088009e60 tx=0x7f3088009780).stop 2023-09-30T22:26:43.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.952+0000 7f30976ca700 1 -- 172.21.15.59:0/2826363340 shutdown_connections 2023-09-30T22:26:43.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.952+0000 7f30976ca700 1 --2- 172.21.15.59:0/2826363340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30900975e0 0x7f309012f270 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.952+0000 7f30976ca700 1 --2- 172.21.15.59:0/2826363340 >> v2:172.21.15.59:3300/0 conn(0x7f3090096820 0x7f3090096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.952+0000 7f30976ca700 1 --2- 172.21.15.59:0/2826363340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3090067940 0x7f30900970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.952+0000 7f30976ca700 1 -- 172.21.15.59:0/2826363340 >> 172.21.15.59:0/2826363340 conn(0x7f309009ba50 msgr2=0x7f309009be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:43.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.952+0000 7f30976ca700 1 -- 172.21.15.59:0/2826363340 shutdown_connections 2023-09-30T22:26:43.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.952+0000 7f30976ca700 1 -- 172.21.15.59:0/2826363340 wait complete. 2023-09-30T22:26:43.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.953+0000 7f30976ca700 1 Processor -- start 2023-09-30T22:26:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.953+0000 7f30976ca700 1 -- start start 2023-09-30T22:26:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.953+0000 7f30976ca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3090067940 0x7f3090064bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.953+0000 7f30976ca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3090096820 0x7f30900650c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.953+0000 7f30976ca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30900975e0 0x7f30900655b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.953+0000 7f30976ca700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3090067e30 con 0x7f3090067940 2023-09-30T22:26:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.953+0000 7f30976ca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30900919e0 con 0x7f3090096820 2023-09-30T22:26:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.953+0000 7f30976ca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f309011c8a0 con 0x7f30900975e0 2023-09-30T22:26:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f3095466700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3090067940 0x7f3090064bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f3095466700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3090067940 0x7f3090064bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54192/0 (socket says 172.21.15.59:54192) 2023-09-30T22:26:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f3095466700 1 -- 172.21.15.59:0/4019430092 learned_addr learned my addr 172.21.15.59:0/4019430092 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f3094c65700 1 --2- 172.21.15.59:0/4019430092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3090096820 0x7f30900650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f3095c67700 1 --2- 172.21.15.59:0/4019430092 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30900975e0 0x7f30900655b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f3095466700 1 -- 172.21.15.59:0/4019430092 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30900975e0 msgr2=0x7f30900655b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f3095466700 1 --2- 172.21.15.59:0/4019430092 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30900975e0 0x7f30900655b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f3095466700 1 -- 172.21.15.59:0/4019430092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3090096820 msgr2=0x7f30900650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f3095466700 1 --2- 172.21.15.59:0/4019430092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3090096820 0x7f30900650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f3095466700 1 -- 172.21.15.59:0/4019430092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308c009370 con 0x7f3090067940 2023-09-30T22:26:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f3094c65700 1 --2- 172.21.15.59:0/4019430092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3090096820 0x7f30900650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f3095466700 1 --2- 172.21.15.59:0/4019430092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3090067940 0x7f3090064bd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f308400ea20 tx=0x7f3084009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f30817fa700 1 -- 172.21.15.59:0/4019430092 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308400ee60 con 0x7f3090067940 2023-09-30T22:26:43.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f30817fa700 1 -- 172.21.15.59:0/4019430092 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308400c850 con 0x7f3090067940 2023-09-30T22:26:43.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f30817fa700 1 -- 172.21.15.59:0/4019430092 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308400cbd0 con 0x7f3090067940 2023-09-30T22:26:43.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f30976ca700 1 -- 172.21.15.59:0/4019430092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30840092a0 con 0x7f3090067940 2023-09-30T22:26:43.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.954+0000 7f30976ca700 1 -- 172.21.15.59:0/4019430092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3088009a20 con 0x7f3090067940 2023-09-30T22:26:43.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.955+0000 7f30817fa700 1 -- 172.21.15.59:0/4019430092 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f308401b400 con 0x7f3090067940 2023-09-30T22:26:43.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.955+0000 7f30817fa700 1 -- 172.21.15.59:0/4019430092 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f308403b510 con 0x7f3090067940 2023-09-30T22:26:43.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.956+0000 7f30976ca700 1 -- 172.21.15.59:0/4019430092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309005a260 con 0x7f3090067940 2023-09-30T22:26:43.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:43.960+0000 7f30817fa700 1 -- 172.21.15.59:0/4019430092 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3084019900 con 0x7f3090067940 2023-09-30T22:26:44.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.134+0000 7f30976ca700 1 -- 172.21.15.59:0/4019430092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3090069860 con 0x7f3090067940 2023-09-30T22:26:44.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.134+0000 7f30817fa700 1 -- 172.21.15.59:0/4019430092 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11343 (secure 0 0 0) 0x7f308402a090 con 0x7f3090067940 2023-09-30T22:26:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:44.135 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":18,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:26:35.416181+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:26:44.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.136+0000 7f30976ca700 1 -- 172.21.15.59:0/4019430092 >> v1:172.21.15.59:6816/118188 conn(0x7f307402bb60 legacy=0x7f307402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.136+0000 7f30976ca700 1 -- 172.21.15.59:0/4019430092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3090067940 msgr2=0x7f3090064bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.136+0000 7f30976ca700 1 --2- 172.21.15.59:0/4019430092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3090067940 0x7f3090064bd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f308400ea20 tx=0x7f3084009060).stop 2023-09-30T22:26:44.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.136+0000 7f30976ca700 1 -- 172.21.15.59:0/4019430092 shutdown_connections 2023-09-30T22:26:44.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.136+0000 7f30976ca700 1 --2- 172.21.15.59:0/4019430092 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30900975e0 0x7f30900655b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.136+0000 7f30976ca700 1 --2- 172.21.15.59:0/4019430092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3090067940 0x7f3090064bd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.136+0000 7f30976ca700 1 --2- 172.21.15.59:0/4019430092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3090096820 0x7f30900650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.136+0000 7f30976ca700 1 -- 172.21.15.59:0/4019430092 >> 172.21.15.59:0/4019430092 conn(0x7f309009ba50 msgr2=0x7f3090099880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.136+0000 7f30976ca700 1 -- 172.21.15.59:0/4019430092 shutdown_connections 2023-09-30T22:26:44.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.136+0000 7f30976ca700 1 -- 172.21.15.59:0/4019430092 wait complete. 2023-09-30T22:26:44.149 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:26:44.150 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:26:44.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.280+0000 7f5ecd733700 1 Processor -- start 2023-09-30T22:26:44.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.280+0000 7f5ecd733700 1 -- start start 2023-09-30T22:26:44.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.280+0000 7f5ecd733700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ec8097c30 0x7f5ec8098db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.280+0000 7f5ecd733700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ec80992a0 0x7f5ec8132480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.280+0000 7f5ecd733700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec8096160 con 0x7f5ec80650f0 2023-09-30T22:26:44.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.280+0000 7f5ecd733700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec80654d0 con 0x7f5ec8097c30 2023-09-30T22:26:44.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.280+0000 7f5ecd733700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec8065dd0 con 0x7f5ec80992a0 2023-09-30T22:26:44.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.280+0000 7f5ec77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ec80992a0 0x7f5ec8132480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.280+0000 7f5ec67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ec8097c30 0x7f5ec8098db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.280+0000 7f5ec6ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5ec80650f0 0x7f5ec80986a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45048/0 (socket says 172.21.15.59:45048) 2023-09-30T22:26:44.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.281+0000 7f5ec6ffd700 1 -- 172.21.15.59:0/220684085 learned_addr learned my addr 172.21.15.59:0/220684085 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.281+0000 7f5ec5ffb700 1 -- 172.21.15.59:0/220684085 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874555593 0 0) 0x7f5ec8096160 con 0x7f5ec80650f0 2023-09-30T22:26:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.281+0000 7f5ec77fe700 1 -- 172.21.15.59:0/220684085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ec8097c30 msgr2=0x7f5ec8098db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.281+0000 7f5ec77fe700 1 --2- 172.21.15.59:0/220684085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ec8097c30 0x7f5ec8098db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.281+0000 7f5ec77fe700 1 -- 172.21.15.59:0/220684085 >> v1:172.21.15.59:6789/0 conn(0x7f5ec80650f0 legacy=0x7f5ec80986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.281+0000 7f5ec77fe700 1 -- 172.21.15.59:0/220684085 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec8099790 con 0x7f5ec80992a0 2023-09-30T22:26:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.281+0000 7f5ec67fc700 1 --2- 172.21.15.59:0/220684085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ec8097c30 0x7f5ec8098db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.281+0000 7f5ec77fe700 1 --2- 172.21.15.59:0/220684085 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ec80992a0 0x7f5ec8132480 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5ec0009e90 tx=0x7f5ec0009780).ready entity=mon.2 client_cookie=248f78b47c3dea7a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.281+0000 7f5ec5ffb700 1 -- 172.21.15.59:0/220684085 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec000e070 con 0x7f5ec80992a0 2023-09-30T22:26:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.281+0000 7f5ec5ffb700 1 -- 172.21.15.59:0/220684085 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec000bb60 con 0x7f5ec80992a0 2023-09-30T22:26:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.281+0000 7f5ec5ffb700 1 -- 172.21.15.59:0/220684085 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0012410 con 0x7f5ec80992a0 2023-09-30T22:26:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.282+0000 7f5ecd733700 1 -- 172.21.15.59:0/220684085 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ec80992a0 msgr2=0x7f5ec8132480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.282+0000 7f5ecd733700 1 --2- 172.21.15.59:0/220684085 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ec80992a0 0x7f5ec8132480 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5ec0009e90 tx=0x7f5ec0009780).stop 2023-09-30T22:26:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.282+0000 7f5ecd733700 1 -- 172.21.15.59:0/220684085 shutdown_connections 2023-09-30T22:26:44.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.282+0000 7f5ecd733700 1 --2- 172.21.15.59:0/220684085 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ec80992a0 0x7f5ec8132480 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.282+0000 7f5ecd733700 1 --2- 172.21.15.59:0/220684085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ec8097c30 0x7f5ec8098db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.282+0000 7f5ecd733700 1 -- 172.21.15.59:0/220684085 >> 172.21.15.59:0/220684085 conn(0x7f5ec809dc70 msgr2=0x7f5ec809e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.282+0000 7f5ecd733700 1 -- 172.21.15.59:0/220684085 shutdown_connections 2023-09-30T22:26:44.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.282+0000 7f5ecd733700 1 -- 172.21.15.59:0/220684085 wait complete. 2023-09-30T22:26:44.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.283+0000 7f5ecd733700 1 Processor -- start 2023-09-30T22:26:44.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.283+0000 7f5ecd733700 1 -- start start 2023-09-30T22:26:44.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.283+0000 7f5ecd733700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ec80650f0 0x7f5ec811e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.283+0000 7f5ecd733700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ec80992a0 0x7f5ec811a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ecd733700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ec811aae0 0x7f5ec811af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ecd733700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec809c680 con 0x7f5ec80992a0 2023-09-30T22:26:44.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ecd733700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec8099a80 con 0x7f5ec80650f0 2023-09-30T22:26:44.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ecd733700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec811b9f0 con 0x7f5ec811aae0 2023-09-30T22:26:44.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ec6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ec80650f0 0x7f5ec811e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ec67fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ec80992a0 0x7f5ec811a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ec67fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ec80992a0 0x7f5ec811a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54206/0 (socket says 172.21.15.59:54206) 2023-09-30T22:26:44.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ec6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ec80650f0 0x7f5ec811e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45094/0 (socket says 172.21.15.59:45094) 2023-09-30T22:26:44.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ec67fc700 1 -- 172.21.15.59:0/1226785660 learned_addr learned my addr 172.21.15.59:0/1226785660 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:44.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ec77fe700 1 --2- 172.21.15.59:0/1226785660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ec811aae0 0x7f5ec811af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ec67fc700 1 -- 172.21.15.59:0/1226785660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ec811aae0 msgr2=0x7f5ec811af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ec67fc700 1 --2- 172.21.15.59:0/1226785660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ec811aae0 0x7f5ec811af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ec67fc700 1 -- 172.21.15.59:0/1226785660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ec80650f0 msgr2=0x7f5ec811e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ec67fc700 1 --2- 172.21.15.59:0/1226785660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ec80650f0 0x7f5ec811e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ec67fc700 1 -- 172.21.15.59:0/1226785660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb80092a0 con 0x7f5ec80992a0 2023-09-30T22:26:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ec6ffd700 1 --2- 172.21.15.59:0/1226785660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ec80650f0 0x7f5ec811e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ec77fe700 1 --2- 172.21.15.59:0/1226785660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ec811aae0 0x7f5ec811af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ec67fc700 1 --2- 172.21.15.59:0/1226785660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ec80992a0 0x7f5ec811a5f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5eb800e960 tx=0x7f5eb8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5eaeffd700 1 -- 172.21.15.59:0/1226785660 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8009580 con 0x7f5ec80992a0 2023-09-30T22:26:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5eaeffd700 1 -- 172.21.15.59:0/1226785660 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb8012600 con 0x7f5ec80992a0 2023-09-30T22:26:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ecd733700 1 -- 172.21.15.59:0/1226785660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec0009a20 con 0x7f5ec80992a0 2023-09-30T22:26:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5eaeffd700 1 -- 172.21.15.59:0/1226785660 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8012980 con 0x7f5ec80992a0 2023-09-30T22:26:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.284+0000 7f5ecd733700 1 -- 172.21.15.59:0/1226785660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec811c800 con 0x7f5ec80992a0 2023-09-30T22:26:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.285+0000 7f5eaeffd700 1 -- 172.21.15.59:0/1226785660 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5eb8012cf0 con 0x7f5ec80992a0 2023-09-30T22:26:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.285+0000 7f5eaeffd700 1 -- 172.21.15.59:0/1226785660 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5eb803b410 con 0x7f5ec80992a0 2023-09-30T22:26:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.286+0000 7f5ecd733700 1 -- 172.21.15.59:0/1226785660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec811dc10 con 0x7f5ec80992a0 2023-09-30T22:26:44.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.290+0000 7f5eaeffd700 1 -- 172.21.15.59:0/1226785660 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5eb8016070 con 0x7f5ec80992a0 2023-09-30T22:26:44.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.468+0000 7f5ecd733700 1 -- 172.21.15.59:0/1226785660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ec805a260 con 0x7f5ec80992a0 2023-09-30T22:26:44.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.469+0000 7f5eaeffd700 1 -- 172.21.15.59:0/1226785660 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11343 (secure 0 0 0) 0x7f5eb8029090 con 0x7f5ec80992a0 2023-09-30T22:26:44.469 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:44.469 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":18,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:26:35.416181+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:26:44.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.471+0000 7f5ecd733700 1 -- 172.21.15.59:0/1226785660 >> v1:172.21.15.59:6816/118188 conn(0x7f5eb402bb60 legacy=0x7f5eb402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.471+0000 7f5ecd733700 1 -- 172.21.15.59:0/1226785660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ec80992a0 msgr2=0x7f5ec811a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.471+0000 7f5ecd733700 1 --2- 172.21.15.59:0/1226785660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ec80992a0 0x7f5ec811a5f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5eb800e960 tx=0x7f5eb8009060).stop 2023-09-30T22:26:44.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.471+0000 7f5ecd733700 1 -- 172.21.15.59:0/1226785660 shutdown_connections 2023-09-30T22:26:44.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.471+0000 7f5ecd733700 1 --2- 172.21.15.59:0/1226785660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ec811aae0 0x7f5ec811af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.471+0000 7f5ecd733700 1 --2- 172.21.15.59:0/1226785660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ec80650f0 0x7f5ec811e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.471+0000 7f5ecd733700 1 --2- 172.21.15.59:0/1226785660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ec80992a0 0x7f5ec811a5f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.471+0000 7f5ecd733700 1 -- 172.21.15.59:0/1226785660 >> 172.21.15.59:0/1226785660 conn(0x7f5ec809dc70 msgr2=0x7f5ec809a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.471+0000 7f5ecd733700 1 -- 172.21.15.59:0/1226785660 shutdown_connections 2023-09-30T22:26:44.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.471+0000 7f5ecd733700 1 -- 172.21.15.59:0/1226785660 wait complete. 2023-09-30T22:26:44.484 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T22:26:44.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T22:26:44.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T22:26:44.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T22:26:44.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.625+0000 7ff311ec0700 1 Processor -- start 2023-09-30T22:26:44.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.625+0000 7f7ad3037700 1 Processor -- start 2023-09-30T22:26:44.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.625+0000 7ff311ec0700 1 -- start start 2023-09-30T22:26:44.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.625+0000 7f7ad3037700 1 -- start start 2023-09-30T22:26:44.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7ff311ec0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30c096380 0x7ff30c094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7ff311ec0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff30c091b00 0x7ff30c127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7f7ad3037700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7acc0650f0 0x7f7acc0986a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7f7ad3037700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7acc097c30 0x7f7acc098b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7f7ad3037700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7acc099080 0x7f7acc131470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7f7ad3037700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7acc0654d0 con 0x7f7acc097c30 2023-09-30T22:26:44.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7f7ad3037700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc099530 con 0x7f7acc0650f0 2023-09-30T22:26:44.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7f7ad3037700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc096160 con 0x7f7acc099080 2023-09-30T22:26:44.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7ff311ec0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30c096760 con 0x7ff30c094c20 2023-09-30T22:26:44.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7ff311ec0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff30c091ff0 con 0x7ff30c091b00 2023-09-30T22:26:44.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7ff311ec0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c092c80 con 0x7ff30c096380 2023-09-30T22:26:44.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7f7ad0dd3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7acc0650f0 0x7f7acc0986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7f7acbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7acc097c30 0x7f7acc098b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7f7ad0dd3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7acc0650f0 0x7f7acc0986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41638/0 (socket says 172.21.15.59:41638) 2023-09-30T22:26:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7f7ad0dd3700 1 -- 172.21.15.59:0/495984639 learned_addr learned my addr 172.21.15.59:0/495984639 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.626+0000 7ff30affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff30c091b00 0x7ff30c127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7ff30affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff30c091b00 0x7ff30c127600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52958/0 (socket says 172.21.15.59:52958) 2023-09-30T22:26:44.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7ff30affd700 1 -- 172.21.15.59:0/4242145853 learned_addr learned my addr 172.21.15.59:0/4242145853 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:44.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7f7ad15d4700 1 --2- 172.21.15.59:0/495984639 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7acc099080 0x7f7acc131470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7ff30b7fe700 1 --2- 172.21.15.59:0/4242145853 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30c096380 0x7ff30c094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7f7ad0dd3700 1 -- 172.21.15.59:0/495984639 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7acc099080 msgr2=0x7f7acc131470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:44.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7f7ad0dd3700 1 --2- 172.21.15.59:0/495984639 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7acc099080 0x7f7acc131470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7f7ad0dd3700 1 -- 172.21.15.59:0/495984639 >> v2:172.21.15.59:3300/0 conn(0x7f7acc097c30 msgr2=0x7f7acc098b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:44.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7f7ad0dd3700 1 --2- 172.21.15.59:0/495984639 >> v2:172.21.15.59:3300/0 conn(0x7f7acc097c30 0x7f7acc098b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7f7ad0dd3700 1 -- 172.21.15.59:0/495984639 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc099790 con 0x7f7acc0650f0 2023-09-30T22:26:44.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7f7ad0dd3700 1 --2- 172.21.15.59:0/495984639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7acc0650f0 0x7f7acc0986a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7ac0009830 tx=0x7f7ac00090f0).ready entity=mon.1 client_cookie=c66a70dcd288d140 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7f7acb7fe700 1 -- 172.21.15.59:0/495984639 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000b580 con 0x7f7acc0650f0 2023-09-30T22:26:44.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7ff30affd700 1 -- 172.21.15.59:0/4242145853 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30c096380 msgr2=0x7ff30c094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:44.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7ff30affd700 1 --2- 172.21.15.59:0/4242145853 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30c096380 0x7ff30c094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7ff30affd700 1 -- 172.21.15.59:0/4242145853 >> v1:172.21.15.59:6789/0 conn(0x7ff30c094c20 legacy=0x7ff30c127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:44.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7ff30affd700 1 -- 172.21.15.59:0/4242145853 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30c093900 con 0x7ff30c091b00 2023-09-30T22:26:44.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.627+0000 7ff30affd700 1 --2- 172.21.15.59:0/4242145853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c091b00 0x7ff30c127600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff300009830 tx=0x7ff3000090f0).ready entity=mon.0 client_cookie=34799aab654d3133 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.628+0000 7f7acb7fe700 1 -- 172.21.15.59:0/495984639 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac000b6e0 con 0x7f7acc0650f0 2023-09-30T22:26:44.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.628+0000 7f7acb7fe700 1 -- 172.21.15.59:0/495984639 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000ba60 con 0x7f7acc0650f0 2023-09-30T22:26:44.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.628+0000 7ff30a7fc700 1 -- 172.21.15.59:0/4242145853 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3000108a0 con 0x7ff30c091b00 2023-09-30T22:26:44.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.628+0000 7ff30a7fc700 1 -- 172.21.15.59:0/4242145853 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff300010a00 con 0x7ff30c091b00 2023-09-30T22:26:44.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.628+0000 7ff30a7fc700 1 -- 172.21.15.59:0/4242145853 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300010d80 con 0x7ff30c091b00 2023-09-30T22:26:44.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7ff311ec0700 1 -- 172.21.15.59:0/4242145853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c091b00 msgr2=0x7ff30c127600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7ff311ec0700 1 --2- 172.21.15.59:0/4242145853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c091b00 0x7ff30c127600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff300009830 tx=0x7ff3000090f0).stop 2023-09-30T22:26:44.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7f7ad3037700 1 -- 172.21.15.59:0/495984639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7acc0650f0 msgr2=0x7f7acc0986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7ff311ec0700 1 -- 172.21.15.59:0/4242145853 shutdown_connections 2023-09-30T22:26:44.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7ff311ec0700 1 --2- 172.21.15.59:0/4242145853 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30c096380 0x7ff30c094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7ff311ec0700 1 --2- 172.21.15.59:0/4242145853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c091b00 0x7ff30c127600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7ff311ec0700 1 -- 172.21.15.59:0/4242145853 >> 172.21.15.59:0/4242145853 conn(0x7ff30c097470 msgr2=0x7ff30c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7f7ad3037700 1 --2- 172.21.15.59:0/495984639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7acc0650f0 0x7f7acc0986a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7ac0009830 tx=0x7f7ac00090f0).stop 2023-09-30T22:26:44.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7f7ad3037700 1 -- 172.21.15.59:0/495984639 shutdown_connections 2023-09-30T22:26:44.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7f7ad3037700 1 --2- 172.21.15.59:0/495984639 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7acc099080 0x7f7acc131470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7f7ad3037700 1 --2- 172.21.15.59:0/495984639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7acc0650f0 0x7f7acc0986a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7f7ad3037700 1 --2- 172.21.15.59:0/495984639 >> v2:172.21.15.59:3300/0 conn(0x7f7acc097c30 0x7f7acc098b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7f7ad3037700 1 -- 172.21.15.59:0/495984639 >> 172.21.15.59:0/495984639 conn(0x7f7acc09dc70 msgr2=0x7f7acc09e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7ff311ec0700 1 -- 172.21.15.59:0/4242145853 shutdown_connections 2023-09-30T22:26:44.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7f7ad3037700 1 -- 172.21.15.59:0/495984639 shutdown_connections 2023-09-30T22:26:44.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7ff311ec0700 1 -- 172.21.15.59:0/4242145853 wait complete. 2023-09-30T22:26:44.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.629+0000 7f7ad3037700 1 -- 172.21.15.59:0/495984639 wait complete. 2023-09-30T22:26:44.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.630+0000 7f7ad3037700 1 Processor -- start 2023-09-30T22:26:44.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.630+0000 7f7ad3037700 1 -- start start 2023-09-30T22:26:44.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.630+0000 7ff311ec0700 1 Processor -- start 2023-09-30T22:26:44.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.630+0000 7ff311ec0700 1 -- start start 2023-09-30T22:26:44.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7f7ad3037700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7acc0650f0 0x7f7acc13a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7f7ad3037700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7acc099080 0x7f7acc13aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7f7ad3037700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7acc13b3d0 0x7f7acc11a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7f7ad3037700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc12f7b0 con 0x7f7acc13b3d0 2023-09-30T22:26:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7f7ad3037700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc11cd40 con 0x7f7acc0650f0 2023-09-30T22:26:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7f7ad3037700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc099a80 con 0x7f7acc099080 2023-09-30T22:26:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7f7ad15d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7acc13b3d0 0x7f7acc11a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7f7ad15d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7acc13b3d0 0x7f7acc11a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52982/0 (socket says 172.21.15.59:52982) 2023-09-30T22:26:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7f7ad15d4700 1 -- 172.21.15.59:0/2132296569 learned_addr learned my addr 172.21.15.59:0/2132296569 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7ff311ec0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff30c091b00 0x7ff30c124ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7ff311ec0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30c094c20 0x7ff30c1129f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7ff311ec0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c096380 0x7ff30c112ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7ff311ec0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c124fb0 con 0x7ff30c096380 2023-09-30T22:26:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7ff311ec0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c113e30 con 0x7ff30c091b00 2023-09-30T22:26:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7ff311ec0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c06a4e0 con 0x7ff30c094c20 2023-09-30T22:26:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7f7ad0dd3700 1 --2- 172.21.15.59:0/2132296569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7acc0650f0 0x7f7acc13a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7ff30b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff30c091b00 0x7ff30c124ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7ff30b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff30c091b00 0x7ff30c124ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41648/0 (socket says 172.21.15.59:41648) 2023-09-30T22:26:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7ff30b7fe700 1 -- 172.21.15.59:0/2022630022 learned_addr learned my addr 172.21.15.59:0/2022630022 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.631+0000 7ff30bfff700 1 --2- 172.21.15.59:0/2022630022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c096380 0x7ff30c112ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7f7ad15d4700 1 -- 172.21.15.59:0/2132296569 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7acc099080 msgr2=0x7f7acc13aee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:44.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7f7ad15d4700 1 --2- 172.21.15.59:0/2132296569 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7acc099080 0x7f7acc13aee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:44.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7f7ad15d4700 1 -- 172.21.15.59:0/2132296569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7acc0650f0 msgr2=0x7f7acc13a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7f7ad15d4700 1 --2- 172.21.15.59:0/2132296569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7acc0650f0 0x7f7acc13a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7f7ad15d4700 1 -- 172.21.15.59:0/2132296569 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac0009370 con 0x7f7acc13b3d0 2023-09-30T22:26:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7ff30affd700 1 --2- 172.21.15.59:0/2022630022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30c094c20 0x7ff30c1129f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7ff30bfff700 1 -- 172.21.15.59:0/2022630022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30c094c20 msgr2=0x7ff30c1129f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7ff30bfff700 1 --2- 172.21.15.59:0/2022630022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30c094c20 0x7ff30c1129f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7ff30bfff700 1 -- 172.21.15.59:0/2022630022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff30c091b00 msgr2=0x7ff30c124ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7ff30bfff700 1 --2- 172.21.15.59:0/2022630022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff30c091b00 0x7ff30c124ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7ff30bfff700 1 -- 172.21.15.59:0/2022630022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff300009370 con 0x7ff30c096380 2023-09-30T22:26:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7f7ad15d4700 1 --2- 172.21.15.59:0/2132296569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7acc13b3d0 0x7f7acc11a6d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f7ac4009fd0 tx=0x7f7ac4009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7f7ad0dd3700 1 --2- 172.21.15.59:0/2132296569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7acc0650f0 0x7f7acc13a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7ff30b7fe700 1 --2- 172.21.15.59:0/2022630022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff30c091b00 0x7ff30c124ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7ff30bfff700 1 --2- 172.21.15.59:0/2022630022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c096380 0x7ff30c112ee0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ff30400b810 tx=0x7ff304009250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7f7ac8ff9700 1 -- 172.21.15.59:0/2132296569 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400eca0 con 0x7f7acc13b3d0 2023-09-30T22:26:44.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7f7ac8ff9700 1 -- 172.21.15.59:0/2132296569 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac400ee00 con 0x7f7acc13b3d0 2023-09-30T22:26:44.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7f7ac8ff9700 1 -- 172.21.15.59:0/2132296569 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4014610 con 0x7f7acc13b3d0 2023-09-30T22:26:44.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7ff2f37fe700 1 -- 172.21.15.59:0/2022630022 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304001500 con 0x7ff30c096380 2023-09-30T22:26:44.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7ff2f37fe700 1 -- 172.21.15.59:0/2022630022 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff304001680 con 0x7ff30c096380 2023-09-30T22:26:44.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7ff311ec0700 1 -- 172.21.15.59:0/2022630022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30c115ee0 con 0x7ff30c096380 2023-09-30T22:26:44.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7ff2f37fe700 1 -- 172.21.15.59:0/2022630022 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304001a40 con 0x7ff30c096380 2023-09-30T22:26:44.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7f7ad3037700 1 -- 172.21.15.59:0/2132296569 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7acc11dc10 con 0x7f7acc13b3d0 2023-09-30T22:26:44.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.632+0000 7f7ad3037700 1 -- 172.21.15.59:0/2132296569 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7acc11e870 con 0x7f7acc13b3d0 2023-09-30T22:26:44.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.633+0000 7ff311ec0700 1 -- 172.21.15.59:0/2022630022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30c116d20 con 0x7ff30c096380 2023-09-30T22:26:44.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.633+0000 7ff2f37fe700 1 -- 172.21.15.59:0/2022630022 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff304011460 con 0x7ff30c096380 2023-09-30T22:26:44.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.634+0000 7ff2f37fe700 1 -- 172.21.15.59:0/2022630022 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff30403e1e0 con 0x7ff30c096380 2023-09-30T22:26:44.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.634+0000 7f7ac8ff9700 1 -- 172.21.15.59:0/2132296569 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7ac40149c0 con 0x7f7acc13b3d0 2023-09-30T22:26:44.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.634+0000 7f7ac8ff9700 1 -- 172.21.15.59:0/2132296569 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7ac403b6b0 con 0x7f7acc13b3d0 2023-09-30T22:26:44.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.634+0000 7f7ad3037700 1 -- 172.21.15.59:0/2132296569 --> v1:172.21.15.59:6804/118795 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7acc09b230 con 0x7f7acc097c30 2023-09-30T22:26:44.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.634+0000 7ff311ec0700 1 -- 172.21.15.59:0/2022630022 --> v1:172.21.15.59:6812/118803 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff30c069500 con 0x7ff30c1256b0 2023-09-30T22:26:44.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.636+0000 7f7ac8ff9700 1 -- 172.21.15.59:0/2132296569 <== osd.0 v1:172.21.15.59:6804/118795 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f7acc09b230 con 0x7f7acc097c30 2023-09-30T22:26:44.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.636+0000 7ff2f37fe700 1 -- 172.21.15.59:0/2022630022 <== osd.2 v1:172.21.15.59:6812/118803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7ff30c069500 con 0x7ff30c1256b0 2023-09-30T22:26:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.637+0000 7fcf14c35700 1 Processor -- start 2023-09-30T22:26:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.637+0000 7fcf14c35700 1 -- start start 2023-09-30T22:26:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.637+0000 7f497e8eb700 1 Processor -- start 2023-09-30T22:26:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.637+0000 7f497e8eb700 1 -- start start 2023-09-30T22:26:44.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7fcf14c35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf10096380 0x7fcf10094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7f497e8eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49780965e0 0x7f49780969c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7f497e8eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4978096eb0 0x7f4978067de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7f497e8eb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49780682d0 0x7f4978068720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7f497e8eb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4978068c10 con 0x7f49780682d0 2023-09-30T22:26:44.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7f497e8eb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49780933b0 con 0x7f4978096eb0 2023-09-30T22:26:44.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7f497e8eb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4978092190 con 0x7f49780965e0 2023-09-30T22:26:44.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7fcf14c35700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf10091b00 0x7fcf10127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7fcf14c35700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf10096760 con 0x7fcf10094c20 2023-09-30T22:26:44.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7fcf14c35700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf10091ff0 con 0x7fcf10091b00 2023-09-30T22:26:44.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7fcf14c35700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf10092c80 con 0x7fcf10096380 2023-09-30T22:26:44.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7fcf0e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf10096380 0x7fcf10094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7fcf0e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf10096380 0x7fcf10094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57204/0 (socket says 172.21.15.59:57204) 2023-09-30T22:26:44.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7fcf0e59c700 1 -- 172.21.15.59:0/2495991103 learned_addr learned my addr 172.21.15.59:0/2495991103 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:44.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7fcf0dd9b700 1 --2- 172.21.15.59:0/2495991103 >> v2:172.21.15.59:3300/0 conn(0x7fcf10091b00 0x7fcf10127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.639+0000 7fcf0e59c700 1 -- 172.21.15.59:0/2495991103 >> v2:172.21.15.59:3300/0 conn(0x7fcf10091b00 msgr2=0x7fcf10127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:44.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.639+0000 7fcf0e59c700 1 --2- 172.21.15.59:0/2495991103 >> v2:172.21.15.59:3300/0 conn(0x7fcf10091b00 0x7fcf10127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.639+0000 7fcf0e59c700 1 -- 172.21.15.59:0/2495991103 >> v1:172.21.15.59:6789/0 conn(0x7fcf10094c20 legacy=0x7fcf10127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.639+0000 7fcf0e59c700 1 -- 172.21.15.59:0/2495991103 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10093900 con 0x7fcf10096380 2023-09-30T22:26:44.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.639+0000 7fcf0e59c700 1 --2- 172.21.15.59:0/2495991103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf10096380 0x7fcf10094730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fcf00009830 tx=0x7fcf000090f0).ready entity=mon.2 client_cookie=f08300ae0f3b0523 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7f49777fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4978096eb0 0x7f4978067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7f49777fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4978096eb0 0x7f4978067de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41652/0 (socket says 172.21.15.59:41652) 2023-09-30T22:26:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7f49777fe700 1 -- 172.21.15.59:0/3571736967 learned_addr learned my addr 172.21.15.59:0/3571736967 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.638+0000 7f497ce88700 1 --2- 172.21.15.59:0/3571736967 >> v2:172.21.15.59:3300/0 conn(0x7f49780682d0 0x7f4978068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.639+0000 7f4977fff700 1 --2- 172.21.15.59:0/3571736967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49780965e0 0x7f49780969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.639+0000 7f49777fe700 1 -- 172.21.15.59:0/3571736967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49780965e0 msgr2=0x7f49780969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.639+0000 7f49777fe700 1 --2- 172.21.15.59:0/3571736967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49780965e0 0x7f49780969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.639+0000 7f49777fe700 1 -- 172.21.15.59:0/3571736967 >> v2:172.21.15.59:3300/0 conn(0x7f49780682d0 msgr2=0x7f4978068720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.639+0000 7f49777fe700 1 --2- 172.21.15.59:0/3571736967 >> v2:172.21.15.59:3300/0 conn(0x7f49780682d0 0x7f4978068720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.639+0000 7f49777fe700 1 -- 172.21.15.59:0/3571736967 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4978069a20 con 0x7f4978096eb0 2023-09-30T22:26:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.639+0000 7f49777fe700 1 --2- 172.21.15.59:0/3571736967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4978096eb0 0x7f4978067de0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f496c006fd0 tx=0x7f496c0090f0).ready entity=mon.1 client_cookie=555a0d34c0cb4e78 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.639+0000 7fcf0d59a700 1 -- 172.21.15.59:0/2495991103 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0000b580 con 0x7fcf10096380 2023-09-30T22:26:44.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.639+0000 7fcf0d59a700 1 -- 172.21.15.59:0/2495991103 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0000b6e0 con 0x7fcf10096380 2023-09-30T22:26:44.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.639+0000 7fcf0d59a700 1 -- 172.21.15.59:0/2495991103 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0000ba60 con 0x7fcf10096380 2023-09-30T22:26:44.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.640+0000 7f4976ffd700 1 -- 172.21.15.59:0/3571736967 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c00b600 con 0x7f4978096eb0 2023-09-30T22:26:44.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.640+0000 7f4976ffd700 1 -- 172.21.15.59:0/3571736967 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c00b760 con 0x7f4978096eb0 2023-09-30T22:26:44.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.640+0000 7f4976ffd700 1 -- 172.21.15.59:0/3571736967 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c00bae0 con 0x7f4978096eb0 2023-09-30T22:26:44.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.640+0000 7fcf14c35700 1 -- 172.21.15.59:0/2495991103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf10096380 msgr2=0x7fcf10094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.640+0000 7fcf14c35700 1 --2- 172.21.15.59:0/2495991103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf10096380 0x7fcf10094730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fcf00009830 tx=0x7fcf000090f0).stop 2023-09-30T22:26:44.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.640+0000 7fcf14c35700 1 -- 172.21.15.59:0/2495991103 shutdown_connections 2023-09-30T22:26:44.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.640+0000 7fcf14c35700 1 --2- 172.21.15.59:0/2495991103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf10096380 0x7fcf10094730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.640+0000 7fcf14c35700 1 --2- 172.21.15.59:0/2495991103 >> v2:172.21.15.59:3300/0 conn(0x7fcf10091b00 0x7fcf10127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.640+0000 7fcf14c35700 1 -- 172.21.15.59:0/2495991103 >> 172.21.15.59:0/2495991103 conn(0x7fcf10097470 msgr2=0x7fcf10097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.640+0000 7fcf14c35700 1 -- 172.21.15.59:0/2495991103 shutdown_connections 2023-09-30T22:26:44.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.640+0000 7fcf14c35700 1 -- 172.21.15.59:0/2495991103 wait complete. 2023-09-30T22:26:44.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.642+0000 7fcf14c35700 1 Processor -- start 2023-09-30T22:26:44.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.642+0000 7fcf14c35700 1 -- start start 2023-09-30T22:26:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.641+0000 7f497e8eb700 1 -- 172.21.15.59:0/3571736967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4978096eb0 msgr2=0x7f4978067de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.641+0000 7f497e8eb700 1 --2- 172.21.15.59:0/3571736967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4978096eb0 0x7f4978067de0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f496c006fd0 tx=0x7f496c0090f0).stop 2023-09-30T22:26:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.641+0000 7f497e8eb700 1 -- 172.21.15.59:0/3571736967 shutdown_connections 2023-09-30T22:26:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.641+0000 7f497e8eb700 1 --2- 172.21.15.59:0/3571736967 >> v2:172.21.15.59:3300/0 conn(0x7f49780682d0 0x7f4978068720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.641+0000 7f497e8eb700 1 --2- 172.21.15.59:0/3571736967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49780965e0 0x7f49780969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.641+0000 7f497e8eb700 1 --2- 172.21.15.59:0/3571736967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4978096eb0 0x7f4978067de0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.641+0000 7f497e8eb700 1 -- 172.21.15.59:0/3571736967 >> 172.21.15.59:0/3571736967 conn(0x7f497809a220 msgr2=0x7f497809a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.641+0000 7f497e8eb700 1 -- 172.21.15.59:0/3571736967 shutdown_connections 2023-09-30T22:26:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.641+0000 7f497e8eb700 1 -- 172.21.15.59:0/3571736967 wait complete. 2023-09-30T22:26:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.642+0000 7f497e8eb700 1 Processor -- start 2023-09-30T22:26:44.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.642+0000 7fcf14c35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf10091b00 0x7fcf10068170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.642+0000 7fcf14c35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf10094c20 0x7fcf10068660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.642+0000 7fcf14c35700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf10096380 0x7fcf10068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.642+0000 7fcf14c35700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf10067f60 con 0x7fcf10096380 2023-09-30T22:26:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.642+0000 7fcf14c35700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1006a520 con 0x7fcf10091b00 2023-09-30T22:26:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.642+0000 7fcf14c35700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf10127cb0 con 0x7fcf10094c20 2023-09-30T22:26:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7fcf0e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf10091b00 0x7fcf10068170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7fcf0e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf10091b00 0x7fcf10068170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41654/0 (socket says 172.21.15.59:41654) 2023-09-30T22:26:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7fcf0e59c700 1 -- 172.21.15.59:0/197400553 learned_addr learned my addr 172.21.15.59:0/197400553 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7fcf0ed9d700 1 --2- 172.21.15.59:0/197400553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf10096380 0x7fcf10068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7fcf0dd9b700 1 --2- 172.21.15.59:0/197400553 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf10094c20 0x7fcf10068660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.642+0000 7f497e8eb700 1 -- start start 2023-09-30T22:26:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7fcf0e59c700 1 -- 172.21.15.59:0/197400553 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf10094c20 msgr2=0x7fcf10068660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7fcf0e59c700 1 --2- 172.21.15.59:0/197400553 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf10094c20 0x7fcf10068660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7fcf0e59c700 1 -- 172.21.15.59:0/197400553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf10096380 msgr2=0x7fcf10068b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7fcf0e59c700 1 --2- 172.21.15.59:0/197400553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf10096380 0x7fcf10068b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7fcf0e59c700 1 -- 172.21.15.59:0/197400553 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf00009370 con 0x7fcf10091b00 2023-09-30T22:26:44.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7f497e8eb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49780682d0 0x7f4978115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7f497e8eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49780965e0 0x7f4978115d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7f497e8eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4978096eb0 0x7f4978116210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7f497e8eb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4978091bf0 con 0x7f49780682d0 2023-09-30T22:26:44.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7f497e8eb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4978115570 con 0x7f4978096eb0 2023-09-30T22:26:44.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.643+0000 7f497e8eb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4978118680 con 0x7f49780965e0 2023-09-30T22:26:44.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.644+0000 7f49777fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49780965e0 0x7f4978115d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.644+0000 7f49777fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49780965e0 0x7f4978115d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57208/0 (socket says 172.21.15.59:57208) 2023-09-30T22:26:44.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.644+0000 7f49777fe700 1 -- 172.21.15.59:0/407791132 learned_addr learned my addr 172.21.15.59:0/407791132 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:44.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.644+0000 7f4977fff700 1 --2- 172.21.15.59:0/407791132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49780682d0 0x7f4978115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.644+0000 7f497ce88700 1 --2- 172.21.15.59:0/407791132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4978096eb0 0x7f4978116210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.644+0000 7f497ce88700 1 -- 172.21.15.59:0/407791132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49780965e0 msgr2=0x7f4978115d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.644+0000 7f497ce88700 1 --2- 172.21.15.59:0/407791132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49780965e0 0x7f4978115d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.644+0000 7f497ce88700 1 -- 172.21.15.59:0/407791132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49780682d0 msgr2=0x7f4978115830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.644+0000 7f497ce88700 1 --2- 172.21.15.59:0/407791132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49780682d0 0x7f4978115830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.644+0000 7f497ce88700 1 -- 172.21.15.59:0/407791132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c009370 con 0x7f4978096eb0 2023-09-30T22:26:44.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.644+0000 7f4977fff700 1 --2- 172.21.15.59:0/407791132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49780682d0 0x7f4978115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:44.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.644+0000 7fcf0e59c700 1 --2- 172.21.15.59:0/197400553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf10091b00 0x7fcf10068170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fcf10092dc0 tx=0x7fcf00017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.644+0000 7f497ce88700 1 --2- 172.21.15.59:0/407791132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4978096eb0 0x7f4978116210 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4970007ed0 tx=0x7f4970009850).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.644+0000 7f495ffff700 1 -- 172.21.15.59:0/407791132 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497000eb90 con 0x7f4978096eb0 2023-09-30T22:26:44.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.645+0000 7f495ffff700 1 -- 172.21.15.59:0/407791132 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497000ecf0 con 0x7f4978096eb0 2023-09-30T22:26:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.645+0000 7f495ffff700 1 -- 172.21.15.59:0/407791132 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970014630 con 0x7f4978096eb0 2023-09-30T22:26:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.645+0000 7fcefe7fc700 1 -- 172.21.15.59:0/197400553 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00000bc0 con 0x7fcf10091b00 2023-09-30T22:26:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.645+0000 7f497e8eb700 1 -- 172.21.15.59:0/407791132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4978118940 con 0x7f4978096eb0 2023-09-30T22:26:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.645+0000 7f497e8eb700 1 -- 172.21.15.59:0/407791132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49781194c0 con 0x7f4978096eb0 2023-09-30T22:26:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.645+0000 7fcefe7fc700 1 -- 172.21.15.59:0/197400553 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0000b850 con 0x7fcf10091b00 2023-09-30T22:26:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.645+0000 7fcefe7fc700 1 -- 172.21.15.59:0/197400553 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00000d20 con 0x7fcf10091b00 2023-09-30T22:26:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.646+0000 7fcf14c35700 1 -- 172.21.15.59:0/197400553 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf10069cd0 con 0x7fcf10091b00 2023-09-30T22:26:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.646+0000 7fcf14c35700 1 -- 172.21.15.59:0/197400553 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1011f3c0 con 0x7fcf10091b00 2023-09-30T22:26:44.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.646+0000 7f495ffff700 1 -- 172.21.15.59:0/407791132 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f497001d3b0 con 0x7f4978096eb0 2023-09-30T22:26:44.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.646+0000 7f495ffff700 1 -- 172.21.15.59:0/407791132 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f497003b150 con 0x7f4978096eb0 2023-09-30T22:26:44.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.647+0000 7fcf14c35700 1 -- 172.21.15.59:0/197400553 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf100999f0 con 0x7fcf10091b00 2023-09-30T22:26:44.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.647+0000 7f497e8eb700 1 -- 172.21.15.59:0/407791132 --> v1:172.21.15.59:6808/118802 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f497805f0a0 con 0x7f4978138650 2023-09-30T22:26:44.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.648+0000 7fcefe7fc700 1 -- 172.21.15.59:0/197400553 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fcf0001d870 con 0x7fcf10091b00 2023-09-30T22:26:44.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.648+0000 7fcefe7fc700 1 -- 172.21.15.59:0/197400553 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fcf0003d470 con 0x7fcf10091b00 2023-09-30T22:26:44.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.648+0000 7fcefe7fc700 1 -- 172.21.15.59:0/197400553 --> v1:172.21.15.59:6800/118786 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcef00384e0 con 0x7fcef00347f0 2023-09-30T22:26:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.648+0000 7fcefe7fc700 1 -- 172.21.15.59:0/197400553 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf0003d760 con 0x7fcf10091b00 2023-09-30T22:26:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.649+0000 7f495ffff700 1 -- 172.21.15.59:0/407791132 <== osd.3 v1:172.21.15.59:6808/118802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f497805f0a0 con 0x7f4978138650 2023-09-30T22:26:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.653+0000 7fcefe7fc700 1 -- 172.21.15.59:0/197400553 <== osd.1 v1:172.21.15.59:6800/118786 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fcef00384e0 con 0x7fcef00347f0 2023-09-30T22:26:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.656+0000 7f7ad3037700 1 -- 172.21.15.59:0/2132296569 --> v1:172.21.15.59:6804/118795 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7acc05a260 con 0x7f7acc097c30 2023-09-30T22:26:44.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.657+0000 7f7ac8ff9700 1 -- 172.21.15.59:0/2132296569 <== osd.0 v1:172.21.15.59:6804/118795 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 4260788100) 0x7f7acc05a260 con 0x7f7acc097c30 2023-09-30T22:26:44.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.660+0000 7f7ad3037700 1 -- 172.21.15.59:0/2132296569 >> v1:172.21.15.59:6804/118795 conn(0x7f7acc097c30 legacy=0x7f7acc05e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.660+0000 7f7ad3037700 1 -- 172.21.15.59:0/2132296569 >> v1:172.21.15.59:6816/118188 conn(0x7f7ab002bb60 legacy=0x7f7ab002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.660+0000 7f7ad3037700 1 -- 172.21.15.59:0/2132296569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7acc13b3d0 msgr2=0x7f7acc11a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.660+0000 7f7ad3037700 1 --2- 172.21.15.59:0/2132296569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7acc13b3d0 0x7f7acc11a6d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f7ac4009fd0 tx=0x7f7ac4009900).stop 2023-09-30T22:26:44.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.661+0000 7f7ad15d4700 1 -- 172.21.15.59:0/2132296569 reap_dead start 2023-09-30T22:26:44.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.661+0000 7f7ad3037700 1 -- 172.21.15.59:0/2132296569 shutdown_connections 2023-09-30T22:26:44.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.661+0000 7f7ad3037700 1 -- 172.21.15.59:0/2132296569 >> 172.21.15.59:0/2132296569 conn(0x7f7acc09dc70 msgr2=0x7f7acc1142d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.661+0000 7f7ad3037700 1 -- 172.21.15.59:0/2132296569 shutdown_connections 2023-09-30T22:26:44.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.661+0000 7f7ad3037700 1 -- 172.21.15.59:0/2132296569 wait complete. 2023-09-30T22:26:44.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.664+0000 7ff311ec0700 1 -- 172.21.15.59:0/2022630022 --> v1:172.21.15.59:6812/118803 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff30c0942e0 con 0x7ff30c1256b0 2023-09-30T22:26:44.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.664+0000 7ff2f37fe700 1 -- 172.21.15.59:0/2022630022 <== osd.2 v1:172.21.15.59:6812/118803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 4260788100) 0x7ff30c0942e0 con 0x7ff30c1256b0 2023-09-30T22:26:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.665+0000 7ff311ec0700 1 -- 172.21.15.59:0/2022630022 >> v1:172.21.15.59:6812/118803 conn(0x7ff30c1256b0 legacy=0x7ff30c05e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.665+0000 7ff311ec0700 1 -- 172.21.15.59:0/2022630022 >> v1:172.21.15.59:6816/118188 conn(0x7ff2f802bbb0 legacy=0x7ff2f802e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.665+0000 7ff311ec0700 1 -- 172.21.15.59:0/2022630022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c096380 msgr2=0x7ff30c112ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.665+0000 7ff311ec0700 1 --2- 172.21.15.59:0/2022630022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30c096380 0x7ff30c112ee0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ff30400b810 tx=0x7ff304009250).stop 2023-09-30T22:26:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.665+0000 7ff30bfff700 1 -- 172.21.15.59:0/2022630022 reap_dead start 2023-09-30T22:26:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.665+0000 7ff311ec0700 1 -- 172.21.15.59:0/2022630022 shutdown_connections 2023-09-30T22:26:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.665+0000 7ff311ec0700 1 -- 172.21.15.59:0/2022630022 >> 172.21.15.59:0/2022630022 conn(0x7ff30c097470 msgr2=0x7ff30c126db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.666+0000 7ff311ec0700 1 -- 172.21.15.59:0/2022630022 shutdown_connections 2023-09-30T22:26:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.666+0000 7ff311ec0700 1 -- 172.21.15.59:0/2022630022 wait complete. 2023-09-30T22:26:44.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.670+0000 7fcf14c35700 1 -- 172.21.15.59:0/197400553 --> v1:172.21.15.59:6800/118786 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcf1011f3c0 con 0x7fcef00347f0 2023-09-30T22:26:44.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.670+0000 7fcefe7fc700 1 -- 172.21.15.59:0/197400553 <== osd.1 v1:172.21.15.59:6800/118786 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7fcf1011f3c0 con 0x7fcef00347f0 2023-09-30T22:26:44.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.671+0000 7fcf14c35700 1 -- 172.21.15.59:0/197400553 >> v1:172.21.15.59:6800/118786 conn(0x7fcef00347f0 legacy=0x7fcef0036c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.671+0000 7fcf14c35700 1 -- 172.21.15.59:0/197400553 >> v1:172.21.15.59:6816/118188 conn(0x7fcef002bb60 legacy=0x7fcef002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.671+0000 7fcf14c35700 1 -- 172.21.15.59:0/197400553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf10091b00 msgr2=0x7fcf10068170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.671+0000 7fcf14c35700 1 --2- 172.21.15.59:0/197400553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf10091b00 0x7fcf10068170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fcf10092dc0 tx=0x7fcf00017000).stop 2023-09-30T22:26:44.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.671+0000 7fcf0ed9d700 1 -- 172.21.15.59:0/197400553 reap_dead start 2023-09-30T22:26:44.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.671+0000 7fcf14c35700 1 -- 172.21.15.59:0/197400553 shutdown_connections 2023-09-30T22:26:44.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.671+0000 7fcf14c35700 1 -- 172.21.15.59:0/197400553 >> 172.21.15.59:0/197400553 conn(0x7fcf10097470 msgr2=0x7fcf10098f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.671+0000 7fcf14c35700 1 -- 172.21.15.59:0/197400553 shutdown_connections 2023-09-30T22:26:44.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.671+0000 7fcf14c35700 1 -- 172.21.15.59:0/197400553 wait complete. 2023-09-30T22:26:44.678 INFO:teuthology.orchestra.run.smithi059.stdout:42949672965 2023-09-30T22:26:44.679 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:44.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.678+0000 7f497e8eb700 1 -- 172.21.15.59:0/407791132 --> v1:172.21.15.59:6808/118802 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4978117c40 con 0x7f4978138650 2023-09-30T22:26:44.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.679+0000 7f495ffff700 1 -- 172.21.15.59:0/407791132 <== osd.3 v1:172.21.15.59:6808/118802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f496c006bb0 con 0x7f4978138650 2023-09-30T22:26:44.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.679+0000 7f497e8eb700 1 -- 172.21.15.59:0/407791132 >> v1:172.21.15.59:6808/118802 conn(0x7f4978138650 legacy=0x7f4978138a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.679+0000 7f497e8eb700 1 -- 172.21.15.59:0/407791132 >> v1:172.21.15.59:6816/118188 conn(0x7f496402bb60 legacy=0x7f496402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.679+0000 7f497e8eb700 1 -- 172.21.15.59:0/407791132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4978096eb0 msgr2=0x7f4978116210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.679+0000 7f497e8eb700 1 --2- 172.21.15.59:0/407791132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4978096eb0 0x7f4978116210 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4970007ed0 tx=0x7f4970009850).stop 2023-09-30T22:26:44.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.679+0000 7f497ce88700 1 -- 172.21.15.59:0/407791132 reap_dead start 2023-09-30T22:26:44.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.679+0000 7f497e8eb700 1 -- 172.21.15.59:0/407791132 shutdown_connections 2023-09-30T22:26:44.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.679+0000 7f497e8eb700 1 -- 172.21.15.59:0/407791132 >> 172.21.15.59:0/407791132 conn(0x7f497809a220 msgr2=0x7f497812e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.679+0000 7f497e8eb700 1 -- 172.21.15.59:0/407791132 shutdown_connections 2023-09-30T22:26:44.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.679+0000 7f497e8eb700 1 -- 172.21.15.59:0/407791132 wait complete. 2023-09-30T22:26:44.685 INFO:teuthology.orchestra.run.smithi059.stdout:42949672965 2023-09-30T22:26:44.685 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:44.686 INFO:teuthology.orchestra.run.smithi059.stdout:38654705669 2023-09-30T22:26:44.686 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:44.694 INFO:teuthology.orchestra.run.smithi059.stdout:38654705669 2023-09-30T22:26:44.694 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:44.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.821+0000 7f478b473700 1 Processor -- start 2023-09-30T22:26:44.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.821+0000 7f478b473700 1 -- start start 2023-09-30T22:26:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.821+0000 7f478b473700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47840654a0 0x7f4784098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.822+0000 7f478b473700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4784098fa0 0x7f4784132ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.822+0000 7f478b473700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4784065ed0 con 0x7f4784098b30 2023-09-30T22:26:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.822+0000 7f478b473700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4784095880 con 0x7f47840654a0 2023-09-30T22:26:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.822+0000 7f478b473700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4784096120 con 0x7f4784098fa0 2023-09-30T22:26:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.822+0000 7f478920f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47840654a0 0x7f4784098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.822+0000 7f4788a0e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4784098b30 0x7f478412f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49360/0 (socket says 172.21.15.59:49360) 2023-09-30T22:26:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.822+0000 7f4788a0e700 1 -- 172.21.15.59:0/596273794 learned_addr learned my addr 172.21.15.59:0/596273794 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.822+0000 7f4789a10700 1 --2- 172.21.15.59:0/596273794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4784098fa0 0x7f4784132ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.822+0000 7f478920f700 1 -- 172.21.15.59:0/596273794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4784098fa0 msgr2=0x7f4784132ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.822+0000 7f478920f700 1 --2- 172.21.15.59:0/596273794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4784098fa0 0x7f4784132ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.822+0000 7f478920f700 1 -- 172.21.15.59:0/596273794 >> v1:172.21.15.59:6789/0 conn(0x7f4784098b30 legacy=0x7f478412f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.822+0000 7f477bfff700 1 -- 172.21.15.59:0/596273794 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398976561 0 0) 0x7f4784065ed0 con 0x7f4784098b30 2023-09-30T22:26:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.822+0000 7f478920f700 1 -- 172.21.15.59:0/596273794 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4784066280 con 0x7f47840654a0 2023-09-30T22:26:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.822+0000 7f478920f700 1 --2- 172.21.15.59:0/596273794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47840654a0 0x7f4784098640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4780009760 tx=0x7f4780009060).ready entity=mon.0 client_cookie=b10875ca00bb2d2c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.823+0000 7f477bfff700 1 -- 172.21.15.59:0/596273794 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478000b580 con 0x7f47840654a0 2023-09-30T22:26:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.823+0000 7f477bfff700 1 -- 172.21.15.59:0/596273794 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478000b6e0 con 0x7f47840654a0 2023-09-30T22:26:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.823+0000 7f477bfff700 1 -- 172.21.15.59:0/596273794 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478000ba60 con 0x7f47840654a0 2023-09-30T22:26:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.823+0000 7f478b473700 1 -- 172.21.15.59:0/596273794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47840654a0 msgr2=0x7f4784098640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.823+0000 7f478b473700 1 --2- 172.21.15.59:0/596273794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47840654a0 0x7f4784098640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4780009760 tx=0x7f4780009060).stop 2023-09-30T22:26:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.823+0000 7f478b473700 1 -- 172.21.15.59:0/596273794 shutdown_connections 2023-09-30T22:26:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.823+0000 7f478b473700 1 --2- 172.21.15.59:0/596273794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4784098fa0 0x7f4784132ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.823+0000 7f478b473700 1 --2- 172.21.15.59:0/596273794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47840654a0 0x7f4784098640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.823+0000 7f478b473700 1 -- 172.21.15.59:0/596273794 >> 172.21.15.59:0/596273794 conn(0x7f478409a740 msgr2=0x7f478409ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.824+0000 7f478b473700 1 -- 172.21.15.59:0/596273794 shutdown_connections 2023-09-30T22:26:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.824+0000 7f478b473700 1 -- 172.21.15.59:0/596273794 wait complete. 2023-09-30T22:26:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.825+0000 7f478b473700 1 Processor -- start 2023-09-30T22:26:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.825+0000 7f478b473700 1 -- start start 2023-09-30T22:26:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.825+0000 7f478b473700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47840654a0 0x7f478413a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.825+0000 7f478b473700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4784098b30 0x7f478413ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.825+0000 7f478b473700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4784098fa0 0x7f478413b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.825+0000 7f478b473700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478411da70 con 0x7f4784098b30 2023-09-30T22:26:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.825+0000 7f478b473700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478411c100 con 0x7f4784098fa0 2023-09-30T22:26:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.825+0000 7f478b473700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f478409cbd0 con 0x7f47840654a0 2023-09-30T22:26:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.825+0000 7f4788a0e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4784098b30 0x7f478413ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.826+0000 7f4788a0e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4784098b30 0x7f478413ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53036/0 (socket says 172.21.15.59:53036) 2023-09-30T22:26:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.826+0000 7f4788a0e700 1 -- 172.21.15.59:0/3170157350 learned_addr learned my addr 172.21.15.59:0/3170157350 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.826+0000 7f478920f700 1 --2- 172.21.15.59:0/3170157350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47840654a0 0x7f478413a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.826+0000 7f4788a0e700 1 -- 172.21.15.59:0/3170157350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47840654a0 msgr2=0x7f478413a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.826+0000 7f4788a0e700 1 --2- 172.21.15.59:0/3170157350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47840654a0 0x7f478413a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.826+0000 7f4788a0e700 1 -- 172.21.15.59:0/3170157350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4784098fa0 msgr2=0x7f478413b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.826+0000 7f4788a0e700 1 --2- 172.21.15.59:0/3170157350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4784098fa0 0x7f478413b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.826+0000 7f4788a0e700 1 -- 172.21.15.59:0/3170157350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47800092a0 con 0x7f4784098b30 2023-09-30T22:26:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.826+0000 7f4788a0e700 1 --2- 172.21.15.59:0/3170157350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4784098b30 0x7f478413ada0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f477400c4c0 tx=0x7f4774007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.826+0000 7f47797fa700 1 -- 172.21.15.59:0/3170157350 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740072e0 con 0x7f4784098b30 2023-09-30T22:26:44.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.826+0000 7f47797fa700 1 -- 172.21.15.59:0/3170157350 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4774007440 con 0x7f4784098b30 2023-09-30T22:26:44.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.826+0000 7f478b473700 1 -- 172.21.15.59:0/3170157350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4784099b00 con 0x7f4784098b30 2023-09-30T22:26:44.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.826+0000 7f478b473700 1 -- 172.21.15.59:0/3170157350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478411e6f0 con 0x7f4784098b30 2023-09-30T22:26:44.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.827+0000 7f47797fa700 1 -- 172.21.15.59:0/3170157350 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740057a0 con 0x7f4784098b30 2023-09-30T22:26:44.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.827+0000 7f47797fa700 1 -- 172.21.15.59:0/3170157350 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4774005bd0 con 0x7f4784098b30 2023-09-30T22:26:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.827+0000 7f47797fa700 1 -- 172.21.15.59:0/3170157350 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f477403a800 con 0x7f4784098b30 2023-09-30T22:26:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.828+0000 7f478b473700 1 -- 172.21.15.59:0/3170157350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4764005120 con 0x7f4784098b30 2023-09-30T22:26:44.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.836+0000 7f47797fa700 1 -- 172.21.15.59:0/3170157350 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4774018030 con 0x7f4784098b30 2023-09-30T22:26:44.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.869+0000 7f81cf15d700 1 Processor -- start 2023-09-30T22:26:44.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.869+0000 7f81cf15d700 1 -- start start 2023-09-30T22:26:44.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.870+0000 7f81cf15d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81c8096bc0 0x7f81c8125160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.870+0000 7f81cf15d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81c8125780 0x7f81c8125b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.870+0000 7f81cf15d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c8096120 con 0x7f81c8093bf0 2023-09-30T22:26:44.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.870+0000 7f81cf15d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80956a0 con 0x7f81c8125780 2023-09-30T22:26:44.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.870+0000 7f81cf15d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8126050 con 0x7f81c8096bc0 2023-09-30T22:26:44.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.870+0000 7f81cd6fa700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f81c8093bf0 0x7f81c8094060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49368/0 (socket says 172.21.15.59:49368) 2023-09-30T22:26:44.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.870+0000 7f81cd6fa700 1 -- 172.21.15.59:0/4050822434 learned_addr learned my addr 172.21.15.59:0/4050822434 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:44.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.870+0000 7f81ccef9700 1 --2- 172.21.15.59:0/4050822434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81c8096bc0 0x7f81c8125160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.870+0000 7f81c7fff700 1 --2- 172.21.15.59:0/4050822434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81c8125780 0x7f81c8125b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.870+0000 7f81ccef9700 1 -- 172.21.15.59:0/4050822434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81c8125780 msgr2=0x7f81c8125b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:44.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.870+0000 7f81ccef9700 1 --2- 172.21.15.59:0/4050822434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81c8125780 0x7f81c8125b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.870+0000 7f81ccef9700 1 -- 172.21.15.59:0/4050822434 >> v1:172.21.15.59:6789/0 conn(0x7f81c8093bf0 legacy=0x7f81c8094060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.870+0000 7f81ccef9700 1 -- 172.21.15.59:0/4050822434 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8096fa0 con 0x7f81c8096bc0 2023-09-30T22:26:44.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.870+0000 7f81c7fff700 1 --2- 172.21.15.59:0/4050822434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81c8125780 0x7f81c8125b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:44.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.871+0000 7f81ccef9700 1 --2- 172.21.15.59:0/4050822434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81c8096bc0 0x7f81c8125160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f81bc009790 tx=0x7f81bc009060).ready entity=mon.2 client_cookie=bfdb336fa0b2005d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.871+0000 7f81c77fe700 1 -- 172.21.15.59:0/4050822434 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc00f510 con 0x7f81c8096bc0 2023-09-30T22:26:44.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.871+0000 7f81c77fe700 1 -- 172.21.15.59:0/4050822434 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81bc00f670 con 0x7f81c8096bc0 2023-09-30T22:26:44.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.871+0000 7f81c77fe700 1 -- 172.21.15.59:0/4050822434 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc00f9f0 con 0x7f81c8096bc0 2023-09-30T22:26:44.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.872+0000 7f81cf15d700 1 -- 172.21.15.59:0/4050822434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81c8096bc0 msgr2=0x7f81c8125160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.872+0000 7f81cf15d700 1 --2- 172.21.15.59:0/4050822434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81c8096bc0 0x7f81c8125160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f81bc009790 tx=0x7f81bc009060).stop 2023-09-30T22:26:44.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.872+0000 7f81cf15d700 1 -- 172.21.15.59:0/4050822434 shutdown_connections 2023-09-30T22:26:44.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.872+0000 7f81cf15d700 1 --2- 172.21.15.59:0/4050822434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81c8096bc0 0x7f81c8125160 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.872+0000 7f81cf15d700 1 --2- 172.21.15.59:0/4050822434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81c8125780 0x7f81c8125b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.872+0000 7f81cf15d700 1 -- 172.21.15.59:0/4050822434 >> 172.21.15.59:0/4050822434 conn(0x7f81c8097470 msgr2=0x7f81c8097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.872+0000 7f81cf15d700 1 -- 172.21.15.59:0/4050822434 shutdown_connections 2023-09-30T22:26:44.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.872+0000 7f81cf15d700 1 -- 172.21.15.59:0/4050822434 wait complete. 2023-09-30T22:26:44.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.873+0000 7f81cf15d700 1 Processor -- start 2023-09-30T22:26:44.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.873+0000 7f81cf15d700 1 -- start start 2023-09-30T22:26:44.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81cf15d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81c8093bf0 0x7f81c81179f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81cf15d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81c8096bc0 0x7f81c81139c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81cf15d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81c8125780 0x7f81c8113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81cf15d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8115eb0 con 0x7f81c8125780 2023-09-30T22:26:44.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81cf15d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8124b50 con 0x7f81c8093bf0 2023-09-30T22:26:44.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81cf15d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80958d0 con 0x7f81c8096bc0 2023-09-30T22:26:44.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81cd6fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81c8125780 0x7f81c8113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81cd6fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81c8125780 0x7f81c8113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53050/0 (socket says 172.21.15.59:53050) 2023-09-30T22:26:44.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81cd6fa700 1 -- 172.21.15.59:0/2379844533 learned_addr learned my addr 172.21.15.59:0/2379844533 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:44.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81c7fff700 1 --2- 172.21.15.59:0/2379844533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81c8096bc0 0x7f81c81139c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81ccef9700 1 --2- 172.21.15.59:0/2379844533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81c8093bf0 0x7f81c81179f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81cd6fa700 1 -- 172.21.15.59:0/2379844533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81c8096bc0 msgr2=0x7f81c81139c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81cd6fa700 1 --2- 172.21.15.59:0/2379844533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81c8096bc0 0x7f81c81139c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81cd6fa700 1 -- 172.21.15.59:0/2379844533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81c8093bf0 msgr2=0x7f81c81179f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81cd6fa700 1 --2- 172.21.15.59:0/2379844533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81c8093bf0 0x7f81c81179f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.874+0000 7f81cd6fa700 1 -- 172.21.15.59:0/2379844533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b40092a0 con 0x7f81c8125780 2023-09-30T22:26:44.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.875+0000 7f81c7fff700 1 --2- 172.21.15.59:0/2379844533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81c8096bc0 0x7f81c81139c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:44.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.875+0000 7f81ccef9700 1 --2- 172.21.15.59:0/2379844533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81c8093bf0 0x7f81c81179f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:44.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.875+0000 7f81cd6fa700 1 --2- 172.21.15.59:0/2379844533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81c8125780 0x7f81c8113eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f81c000c790 tx=0x7f81c00015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.875+0000 7f81c4ff9700 1 -- 172.21.15.59:0/2379844533 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0005d30 con 0x7f81c8125780 2023-09-30T22:26:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.875+0000 7f81c4ff9700 1 -- 172.21.15.59:0/2379844533 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c0005e90 con 0x7f81c8125780 2023-09-30T22:26:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.875+0000 7f81cf15d700 1 -- 172.21.15.59:0/2379844533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81bc0092a0 con 0x7f81c8125780 2023-09-30T22:26:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.875+0000 7f81c4ff9700 1 -- 172.21.15.59:0/2379844533 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0007320 con 0x7f81c8125780 2023-09-30T22:26:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.875+0000 7f81cf15d700 1 -- 172.21.15.59:0/2379844533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c8116f50 con 0x7f81c8125780 2023-09-30T22:26:44.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.877+0000 7f81cf15d700 1 -- 172.21.15.59:0/2379844533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c8117140 con 0x7f81c8125780 2023-09-30T22:26:44.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.878+0000 7f81c4ff9700 1 -- 172.21.15.59:0/2379844533 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f81c00076d0 con 0x7f81c8125780 2023-09-30T22:26:44.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.878+0000 7f81c4ff9700 1 -- 172.21.15.59:0/2379844533 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f81c003b540 con 0x7f81c8125780 2023-09-30T22:26:44.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.883+0000 7f81c4ff9700 1 -- 172.21.15.59:0/2379844533 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f81c0007980 con 0x7f81c8125780 2023-09-30T22:26:44.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.892+0000 7f1a8015b700 1 Processor -- start 2023-09-30T22:26:44.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.893+0000 7f1a8015b700 1 -- start start 2023-09-30T22:26:44.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.893+0000 7f1a8015b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a78059070 0x7f1a781277b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.893+0000 7f1a8015b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a78127320 0x7f1a78127ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.893+0000 7f1a8015b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a78096920 con 0x7f1a780963c0 2023-09-30T22:26:44.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.893+0000 7f1a8015b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78059450 con 0x7f1a78127320 2023-09-30T22:26:44.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.893+0000 7f1a8015b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78096cf0 con 0x7f1a78059070 2023-09-30T22:26:44.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.893+0000 7f1a7d6f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a78127320 0x7f1a78127ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.893+0000 7f1a7def7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a78059070 0x7f1a781277b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.894+0000 7f1a7d6f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a78127320 0x7f1a78127ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41692/0 (socket says 172.21.15.59:41692) 2023-09-30T22:26:44.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.894+0000 7f1a7d6f6700 1 -- 172.21.15.59:0/2692985406 learned_addr learned my addr 172.21.15.59:0/2692985406 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:44.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.894+0000 7f1a7def7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a78059070 0x7f1a781277b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57252/0 (socket says 172.21.15.59:57252) 2023-09-30T22:26:44.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.894+0000 7f1a7d6f6700 1 -- 172.21.15.59:0/2692985406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a78059070 msgr2=0x7f1a781277b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:44.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.894+0000 7f1a7d6f6700 1 --2- 172.21.15.59:0/2692985406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a78059070 0x7f1a781277b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.894+0000 7f1a7d6f6700 1 -- 172.21.15.59:0/2692985406 >> v1:172.21.15.59:6789/0 conn(0x7f1a780963c0 legacy=0x7f1a78095370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:44.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.894+0000 7f1a7d6f6700 1 -- 172.21.15.59:0/2692985406 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a780929d0 con 0x7f1a78127320 2023-09-30T22:26:44.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.894+0000 7f1a7def7700 1 --2- 172.21.15.59:0/2692985406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a78059070 0x7f1a781277b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:44.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.894+0000 7f1a7d6f6700 1 --2- 172.21.15.59:0/2692985406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a78127320 0x7f1a78127ca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1a68009830 tx=0x7f1a680090f0).ready entity=mon.1 client_cookie=ceb0b9f2ae403c19 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.894+0000 7f1a7cef5700 1 -- 172.21.15.59:0/2692985406 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800b580 con 0x7f1a78127320 2023-09-30T22:26:44.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.894+0000 7f1a7cef5700 1 -- 172.21.15.59:0/2692985406 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6800b6e0 con 0x7f1a78127320 2023-09-30T22:26:44.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.894+0000 7f1a7cef5700 1 -- 172.21.15.59:0/2692985406 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800ba60 con 0x7f1a78127320 2023-09-30T22:26:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.895+0000 7f1a8015b700 1 -- 172.21.15.59:0/2692985406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a78127320 msgr2=0x7f1a78127ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.895+0000 7f1a8015b700 1 --2- 172.21.15.59:0/2692985406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a78127320 0x7f1a78127ca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1a68009830 tx=0x7f1a680090f0).stop 2023-09-30T22:26:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.895+0000 7f1a8015b700 1 -- 172.21.15.59:0/2692985406 shutdown_connections 2023-09-30T22:26:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.895+0000 7f1a8015b700 1 --2- 172.21.15.59:0/2692985406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a78059070 0x7f1a781277b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.895+0000 7f1a8015b700 1 --2- 172.21.15.59:0/2692985406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a78127320 0x7f1a78127ca0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.895+0000 7f1a8015b700 1 -- 172.21.15.59:0/2692985406 >> 172.21.15.59:0/2692985406 conn(0x7f1a78097470 msgr2=0x7f1a78097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.895+0000 7f1a8015b700 1 -- 172.21.15.59:0/2692985406 shutdown_connections 2023-09-30T22:26:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.895+0000 7f1a8015b700 1 -- 172.21.15.59:0/2692985406 wait complete. 2023-09-30T22:26:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.896+0000 7f1a8015b700 1 Processor -- start 2023-09-30T22:26:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.896+0000 7f1a8015b700 1 -- start start 2023-09-30T22:26:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.897+0000 7f1a8015b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a78059070 0x7f1a78125b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.897+0000 7f1a8015b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a780963c0 0x7f1a78114af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.897+0000 7f1a8015b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a78114fe0 0x7f1a78115460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.897+0000 7f1a8015b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78118620 con 0x7f1a78114fe0 2023-09-30T22:26:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.897+0000 7f1a8015b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78098990 con 0x7f1a78059070 2023-09-30T22:26:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.897+0000 7f1a8015b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78096f20 con 0x7f1a780963c0 2023-09-30T22:26:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.897+0000 7f1a7def7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a78059070 0x7f1a78125b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.897+0000 7f1a7def7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a78059070 0x7f1a78125b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41706/0 (socket says 172.21.15.59:41706) 2023-09-30T22:26:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.897+0000 7f1a7def7700 1 -- 172.21.15.59:0/2218506383 learned_addr learned my addr 172.21.15.59:0/2218506383 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.897+0000 7f1a7def7700 1 -- 172.21.15.59:0/2218506383 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a780963c0 msgr2=0x7f1a78114af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.897+0000 7f1a7def7700 1 --2- 172.21.15.59:0/2218506383 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a780963c0 0x7f1a78114af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.897+0000 7f1a7def7700 1 -- 172.21.15.59:0/2218506383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a78114fe0 msgr2=0x7f1a78115460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.897+0000 7f1a7def7700 1 --2- 172.21.15.59:0/2218506383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a78114fe0 0x7f1a78115460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:44.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.897+0000 7f1a7def7700 1 -- 172.21.15.59:0/2218506383 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a740092a0 con 0x7f1a78059070 2023-09-30T22:26:44.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.897+0000 7f1a7def7700 1 --2- 172.21.15.59:0/2218506383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a78059070 0x7f1a78125b20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1a7400ea50 tx=0x7f1a74009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.898+0000 7f1a6dffb700 1 -- 172.21.15.59:0/2218506383 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400c850 con 0x7f1a78059070 2023-09-30T22:26:44.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.898+0000 7f1a6dffb700 1 -- 172.21.15.59:0/2218506383 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7400c9b0 con 0x7f1a78059070 2023-09-30T22:26:44.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.898+0000 7f1a6dffb700 1 -- 172.21.15.59:0/2218506383 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400cd30 con 0x7f1a78059070 2023-09-30T22:26:44.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.898+0000 7f1a8015b700 1 -- 172.21.15.59:0/2218506383 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a68009370 con 0x7f1a78059070 2023-09-30T22:26:44.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.898+0000 7f1a8015b700 1 -- 172.21.15.59:0/2218506383 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a78115ef0 con 0x7f1a78059070 2023-09-30T22:26:44.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.899+0000 7f1a8015b700 1 -- 172.21.15.59:0/2218506383 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a78118c20 con 0x7f1a78059070 2023-09-30T22:26:44.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.900+0000 7f1a6dffb700 1 -- 172.21.15.59:0/2218506383 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1a74012600 con 0x7f1a78059070 2023-09-30T22:26:44.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.900+0000 7f1a6dffb700 1 -- 172.21.15.59:0/2218506383 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f1a7403bd00 con 0x7f1a78059070 2023-09-30T22:26:44.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.904+0000 7f1a6dffb700 1 -- 172.21.15.59:0/2218506383 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1a74011760 con 0x7f1a78059070 2023-09-30T22:26:44.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.912+0000 7fea92b60700 1 Processor -- start 2023-09-30T22:26:44.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.913+0000 7fea92b60700 1 -- start start 2023-09-30T22:26:44.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.913+0000 7fea92b60700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea8c059070 0x7fea8c12f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.913+0000 7fea92b60700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea8c12ecd0 0x7fea8c12f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.913+0000 7fea92b60700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea8c059ba0 con 0x7fea8c095370 2023-09-30T22:26:44.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.913+0000 7fea92b60700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8c0969b0 con 0x7fea8c059070 2023-09-30T22:26:44.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.913+0000 7fea92b60700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c092320 con 0x7fea8c12ecd0 2023-09-30T22:26:44.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.913+0000 7fea910fd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fea8c095370 0x7fea8c095800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49382/0 (socket says 172.21.15.59:49382) 2023-09-30T22:26:44.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.913+0000 7fea910fd700 1 -- 172.21.15.59:0/689750563 learned_addr learned my addr 172.21.15.59:0/689750563 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:44.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.913+0000 7fea8bfff700 1 --2- 172.21.15.59:0/689750563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea8c12ecd0 0x7fea8c12f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.914+0000 7fea908fc700 1 --2- 172.21.15.59:0/689750563 >> v2:172.21.15.59:3300/0 conn(0x7fea8c059070 0x7fea8c12f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.914+0000 7fea8b7fe700 1 -- 172.21.15.59:0/689750563 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270502041 0 0) 0x7fea8c059ba0 con 0x7fea8c095370 2023-09-30T22:26:44.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.914+0000 7fea8b7fe700 1 -- 172.21.15.59:0/689750563 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea7c0033f0 con 0x7fea8c095370 2023-09-30T22:26:44.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.914+0000 7fea8bfff700 1 -- 172.21.15.59:0/689750563 >> v2:172.21.15.59:3300/0 conn(0x7fea8c059070 msgr2=0x7fea8c12f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:44.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.914+0000 7fea8bfff700 1 --2- 172.21.15.59:0/689750563 >> v2:172.21.15.59:3300/0 conn(0x7fea8c059070 0x7fea8c12f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.914+0000 7fea8bfff700 1 -- 172.21.15.59:0/689750563 >> v1:172.21.15.59:6789/0 conn(0x7fea8c095370 legacy=0x7fea8c095800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.914+0000 7fea8bfff700 1 -- 172.21.15.59:0/689750563 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c091c10 con 0x7fea8c12ecd0 2023-09-30T22:26:44.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.914+0000 7fea8bfff700 1 --2- 172.21.15.59:0/689750563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea8c12ecd0 0x7fea8c12f650 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fea78009790 tx=0x7fea78009060).ready entity=mon.2 client_cookie=ac5165fc76ba6e6f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.914+0000 7fea8b7fe700 1 -- 172.21.15.59:0/689750563 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780090d0 con 0x7fea8c12ecd0 2023-09-30T22:26:44.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.914+0000 7fea8b7fe700 1 -- 172.21.15.59:0/689750563 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7800f510 con 0x7fea8c12ecd0 2023-09-30T22:26:44.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.914+0000 7fea8b7fe700 1 -- 172.21.15.59:0/689750563 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7800f890 con 0x7fea8c12ecd0 2023-09-30T22:26:44.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.915+0000 7fea92b60700 1 -- 172.21.15.59:0/689750563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea8c12ecd0 msgr2=0x7fea8c12f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.915+0000 7fea92b60700 1 --2- 172.21.15.59:0/689750563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea8c12ecd0 0x7fea8c12f650 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fea78009790 tx=0x7fea78009060).stop 2023-09-30T22:26:44.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.915+0000 7fea92b60700 1 -- 172.21.15.59:0/689750563 shutdown_connections 2023-09-30T22:26:44.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.915+0000 7fea92b60700 1 --2- 172.21.15.59:0/689750563 >> v2:172.21.15.59:3300/0 conn(0x7fea8c059070 0x7fea8c12f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.915+0000 7fea92b60700 1 --2- 172.21.15.59:0/689750563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea8c12ecd0 0x7fea8c12f650 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.915+0000 7fea92b60700 1 -- 172.21.15.59:0/689750563 >> 172.21.15.59:0/689750563 conn(0x7fea8c097470 msgr2=0x7fea8c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.915+0000 7fea92b60700 1 -- 172.21.15.59:0/689750563 shutdown_connections 2023-09-30T22:26:44.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.915+0000 7fea92b60700 1 -- 172.21.15.59:0/689750563 wait complete. 2023-09-30T22:26:44.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.916+0000 7fea92b60700 1 Processor -- start 2023-09-30T22:26:44.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.916+0000 7fea92b60700 1 -- start start 2023-09-30T22:26:44.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.917+0000 7fea92b60700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea8c059070 0x7fea8c069be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.917+0000 7fea92b60700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8c095370 0x7fea8c12c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.917+0000 7fea92b60700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea8c12aa10 0x7fea8c12ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:44.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.917+0000 7fea92b60700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c12c170 con 0x7fea8c095370 2023-09-30T22:26:44.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.917+0000 7fea92b60700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c12cd00 con 0x7fea8c059070 2023-09-30T22:26:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.917+0000 7fea92b60700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c06a520 con 0x7fea8c12aa10 2023-09-30T22:26:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.917+0000 7fea908fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea8c059070 0x7fea8c069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.917+0000 7fea908fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea8c059070 0x7fea8c069be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41710/0 (socket says 172.21.15.59:41710) 2023-09-30T22:26:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.917+0000 7fea908fc700 1 -- 172.21.15.59:0/3461301171 learned_addr learned my addr 172.21.15.59:0/3461301171 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.917+0000 7fea8bfff700 1 --2- 172.21.15.59:0/3461301171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8c095370 0x7fea8c12c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.917+0000 7fea910fd700 1 --2- 172.21.15.59:0/3461301171 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea8c12aa10 0x7fea8c12ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.918+0000 7fea908fc700 1 -- 172.21.15.59:0/3461301171 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea8c12aa10 msgr2=0x7fea8c12ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.918+0000 7fea908fc700 1 --2- 172.21.15.59:0/3461301171 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea8c12aa10 0x7fea8c12ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.918+0000 7fea908fc700 1 -- 172.21.15.59:0/3461301171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8c095370 msgr2=0x7fea8c12c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.918+0000 7fea908fc700 1 --2- 172.21.15.59:0/3461301171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8c095370 0x7fea8c12c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.918+0000 7fea908fc700 1 -- 172.21.15.59:0/3461301171 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea780092a0 con 0x7fea8c059070 2023-09-30T22:26:44.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.918+0000 7fea908fc700 1 --2- 172.21.15.59:0/3461301171 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea8c059070 0x7fea8c069be0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fea8000c880 tx=0x7fea80008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.918+0000 7fea88ff9700 1 -- 172.21.15.59:0/3461301171 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea80010580 con 0x7fea8c059070 2023-09-30T22:26:44.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.918+0000 7fea88ff9700 1 -- 172.21.15.59:0/3461301171 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea800106e0 con 0x7fea8c059070 2023-09-30T22:26:44.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.918+0000 7fea92b60700 1 -- 172.21.15.59:0/3461301171 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8c131d20 con 0x7fea8c059070 2023-09-30T22:26:44.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.918+0000 7fea88ff9700 1 -- 172.21.15.59:0/3461301171 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea80010a60 con 0x7fea8c059070 2023-09-30T22:26:44.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.919+0000 7fea88ff9700 1 -- 172.21.15.59:0/3461301171 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fea8001b460 con 0x7fea8c059070 2023-09-30T22:26:44.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.919+0000 7fea92b60700 1 -- 172.21.15.59:0/3461301171 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8c132830 con 0x7fea8c059070 2023-09-30T22:26:44.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.919+0000 7fea88ff9700 1 -- 172.21.15.59:0/3461301171 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fea80010e10 con 0x7fea8c059070 2023-09-30T22:26:44.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.920+0000 7fea92b60700 1 -- 172.21.15.59:0/3461301171 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8c131b80 con 0x7fea8c059070 2023-09-30T22:26:44.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:44.925+0000 7fea88ff9700 1 -- 172.21.15.59:0/3461301171 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fea8c131b80 con 0x7fea8c059070 2023-09-30T22:26:45.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.073+0000 7f478b473700 1 -- 172.21.15.59:0/3170157350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f47640057f0 con 0x7f4784098b30 2023-09-30T22:26:45.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.073+0000 7f47797fa700 1 -- 172.21.15.59:0/3170157350 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f477401cb50 con 0x7f4784098b30 2023-09-30T22:26:45.073 INFO:teuthology.orchestra.run.smithi059.stdout:42949672963 2023-09-30T22:26:45.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.075+0000 7f478b473700 1 -- 172.21.15.59:0/3170157350 >> v1:172.21.15.59:6816/118188 conn(0x7f476802bb60 legacy=0x7f476802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.075+0000 7f478b473700 1 -- 172.21.15.59:0/3170157350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4784098b30 msgr2=0x7f478413ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.075+0000 7f478b473700 1 --2- 172.21.15.59:0/3170157350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4784098b30 0x7f478413ada0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f477400c4c0 tx=0x7f4774007c10).stop 2023-09-30T22:26:45.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.075+0000 7f478b473700 1 -- 172.21.15.59:0/3170157350 shutdown_connections 2023-09-30T22:26:45.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.075+0000 7f478b473700 1 --2- 172.21.15.59:0/3170157350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47840654a0 0x7f478413a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:45.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.075+0000 7f478b473700 1 --2- 172.21.15.59:0/3170157350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4784098fa0 0x7f478413b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:45.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.075+0000 7f478b473700 1 --2- 172.21.15.59:0/3170157350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4784098b30 0x7f478413ada0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:45.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.075+0000 7f478b473700 1 -- 172.21.15.59:0/3170157350 >> 172.21.15.59:0/3170157350 conn(0x7f478409a740 msgr2=0x7f478409bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.075+0000 7f478b473700 1 -- 172.21.15.59:0/3170157350 shutdown_connections 2023-09-30T22:26:45.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.075+0000 7f478b473700 1 -- 172.21.15.59:0/3170157350 wait complete. 2023-09-30T22:26:45.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672963 for osd.0 2023-09-30T22:26:45.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.090+0000 7f1a8015b700 1 -- 172.21.15.59:0/2218506383 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a78118210 con 0x7f1a78059070 2023-09-30T22:26:45.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.090+0000 7f1a6dffb700 1 -- 172.21.15.59:0/2218506383 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a74029020 con 0x7f1a78059070 2023-09-30T22:26:45.090 INFO:teuthology.orchestra.run.smithi059.stdout:38654705668 2023-09-30T22:26:45.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.093+0000 7f1a8015b700 1 -- 172.21.15.59:0/2218506383 >> v1:172.21.15.59:6816/118188 conn(0x7f1a5c02bb90 legacy=0x7f1a5c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.093+0000 7f1a8015b700 1 -- 172.21.15.59:0/2218506383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a78059070 msgr2=0x7f1a78125b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.093+0000 7f1a8015b700 1 --2- 172.21.15.59:0/2218506383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a78059070 0x7f1a78125b20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1a7400ea50 tx=0x7f1a74009060).stop 2023-09-30T22:26:45.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.094+0000 7f1a8015b700 1 -- 172.21.15.59:0/2218506383 shutdown_connections 2023-09-30T22:26:45.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.094+0000 7f1a8015b700 1 --2- 172.21.15.59:0/2218506383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a78114fe0 0x7f1a78115460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:45.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.094+0000 7f1a8015b700 1 --2- 172.21.15.59:0/2218506383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a78059070 0x7f1a78125b20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:45.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.094+0000 7f1a8015b700 1 --2- 172.21.15.59:0/2218506383 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a780963c0 0x7f1a78114af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:45.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.094+0000 7f1a8015b700 1 -- 172.21.15.59:0/2218506383 >> 172.21.15.59:0/2218506383 conn(0x7f1a78097470 msgr2=0x7f1a780941f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.094+0000 7f1a8015b700 1 -- 172.21.15.59:0/2218506383 shutdown_connections 2023-09-30T22:26:45.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.094+0000 7f1a8015b700 1 -- 172.21.15.59:0/2218506383 wait complete. 2023-09-30T22:26:45.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.103+0000 7f81cf15d700 1 -- 172.21.15.59:0/2379844533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f81c80999f0 con 0x7f81c8125780 2023-09-30T22:26:45.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.103+0000 7f81c4ff9700 1 -- 172.21.15.59:0/2379844533 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f81c0011b50 con 0x7f81c8125780 2023-09-30T22:26:45.103 INFO:teuthology.orchestra.run.smithi059.stdout:42949672963 2023-09-30T22:26:45.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.105+0000 7f81cf15d700 1 -- 172.21.15.59:0/2379844533 >> v1:172.21.15.59:6816/118188 conn(0x7f81ac02bb60 legacy=0x7f81ac02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.105+0000 7f81cf15d700 1 -- 172.21.15.59:0/2379844533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81c8125780 msgr2=0x7f81c8113eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.105+0000 7f81cf15d700 1 --2- 172.21.15.59:0/2379844533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81c8125780 0x7f81c8113eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f81c000c790 tx=0x7f81c00015e0).stop 2023-09-30T22:26:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.105+0000 7f81cf15d700 1 -- 172.21.15.59:0/2379844533 shutdown_connections 2023-09-30T22:26:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.105+0000 7f81cf15d700 1 --2- 172.21.15.59:0/2379844533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81c8125780 0x7f81c8113eb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.105+0000 7f81cf15d700 1 --2- 172.21.15.59:0/2379844533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81c8093bf0 0x7f81c81179f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.105+0000 7f81cf15d700 1 --2- 172.21.15.59:0/2379844533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81c8096bc0 0x7f81c81139c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.105+0000 7f81cf15d700 1 -- 172.21.15.59:0/2379844533 >> 172.21.15.59:0/2379844533 conn(0x7f81c8097470 msgr2=0x7f81c8127e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.105+0000 7f81cf15d700 1 -- 172.21.15.59:0/2379844533 shutdown_connections 2023-09-30T22:26:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.106+0000 7f81cf15d700 1 -- 172.21.15.59:0/2379844533 wait complete. 2023-09-30T22:26:45.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2023-09-30T22:26:45.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.115+0000 7fea92b60700 1 -- 172.21.15.59:0/3461301171 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fea8c131b80 con 0x7fea8c059070 2023-09-30T22:26:45.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.116+0000 7fea88ff9700 1 -- 172.21.15.59:0/3461301171 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea8c131b80 con 0x7fea8c059070 2023-09-30T22:26:45.116 INFO:teuthology.orchestra.run.smithi059.stdout:38654705668 2023-09-30T22:26:45.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.118+0000 7fea92b60700 1 -- 172.21.15.59:0/3461301171 >> v1:172.21.15.59:6816/118188 conn(0x7fea7002bb60 legacy=0x7fea7002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.118+0000 7fea92b60700 1 -- 172.21.15.59:0/3461301171 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea8c059070 msgr2=0x7fea8c069be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.118+0000 7fea92b60700 1 --2- 172.21.15.59:0/3461301171 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea8c059070 0x7fea8c069be0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fea8000c880 tx=0x7fea80008040).stop 2023-09-30T22:26:45.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.118+0000 7fea92b60700 1 -- 172.21.15.59:0/3461301171 shutdown_connections 2023-09-30T22:26:45.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.118+0000 7fea92b60700 1 --2- 172.21.15.59:0/3461301171 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea8c12aa10 0x7fea8c12ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:45.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.118+0000 7fea92b60700 1 --2- 172.21.15.59:0/3461301171 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea8c059070 0x7fea8c069be0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:45.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.118+0000 7fea92b60700 1 --2- 172.21.15.59:0/3461301171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8c095370 0x7fea8c12c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:45.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.118+0000 7fea92b60700 1 -- 172.21.15.59:0/3461301171 >> 172.21.15.59:0/3461301171 conn(0x7fea8c097470 msgr2=0x7fea8c11e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.118+0000 7fea92b60700 1 -- 172.21.15.59:0/3461301171 shutdown_connections 2023-09-30T22:26:45.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:45.118+0000 7fea92b60700 1 -- 172.21.15.59:0/3461301171 wait complete. 2023-09-30T22:26:45.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672963 for osd.2 2023-09-30T22:26:45.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2023-09-30T22:26:46.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:46.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:46.121 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:46.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:46.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.242+0000 7f6b62b17700 1 Processor -- start 2023-09-30T22:26:46.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.242+0000 7f6b62b17700 1 -- start start 2023-09-30T22:26:46.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.242+0000 7f6b62b17700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b5c0970d0 0x7f6b5c12cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.242+0000 7f6b62b17700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b5c12d120 0x7f6b5c12f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.242+0000 7f6b62b17700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5c0919e0 con 0x7f6b5c0965e0 2023-09-30T22:26:46.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.242+0000 7f6b5bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b5c0970d0 0x7f6b5c12cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.242+0000 7f6b608b3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6b5c0965e0 0x7f6b5c0969c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49388/0 (socket says 172.21.15.59:49388) 2023-09-30T22:26:46.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.242+0000 7f6b608b3700 1 -- 172.21.15.59:0/367521136 learned_addr learned my addr 172.21.15.59:0/367521136 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:46.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.243+0000 7f6b610b4700 1 --2- 172.21.15.59:0/367521136 >> v2:172.21.15.59:3300/0 conn(0x7f6b5c12d120 0x7f6b5c12f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.243+0000 7f6b62b17700 1 -- 172.21.15.59:0/367521136 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b5c0933b0 con 0x7f6b5c12d120 2023-09-30T22:26:46.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.243+0000 7f6b62b17700 1 -- 172.21.15.59:0/367521136 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c092190 con 0x7f6b5c0970d0 2023-09-30T22:26:46.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.243+0000 7f6b5bfff700 1 -- 172.21.15.59:0/367521136 >> v2:172.21.15.59:3300/0 conn(0x7f6b5c12d120 msgr2=0x7f6b5c12f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.243+0000 7f6b5bfff700 1 --2- 172.21.15.59:0/367521136 >> v2:172.21.15.59:3300/0 conn(0x7f6b5c12d120 0x7f6b5c12f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.243+0000 7f6b5bfff700 1 -- 172.21.15.59:0/367521136 >> v1:172.21.15.59:6789/0 conn(0x7f6b5c0965e0 legacy=0x7f6b5c0969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.243+0000 7f6b5bfff700 1 -- 172.21.15.59:0/367521136 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c069a20 con 0x7f6b5c0970d0 2023-09-30T22:26:46.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.243+0000 7f6b5bfff700 1 --2- 172.21.15.59:0/367521136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b5c0970d0 0x7f6b5c12cc30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6b48009760 tx=0x7f6b48009060).ready entity=mon.1 client_cookie=a37bb2900e240282 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.243+0000 7f6b5b7fe700 1 -- 172.21.15.59:0/367521136 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4800b580 con 0x7f6b5c0970d0 2023-09-30T22:26:46.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.243+0000 7f6b5b7fe700 1 -- 172.21.15.59:0/367521136 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4800b6e0 con 0x7f6b5c0970d0 2023-09-30T22:26:46.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.244+0000 7f6b5b7fe700 1 -- 172.21.15.59:0/367521136 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4800ba60 con 0x7f6b5c0970d0 2023-09-30T22:26:46.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.244+0000 7f6b62b17700 1 -- 172.21.15.59:0/367521136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b5c0970d0 msgr2=0x7f6b5c12cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.244+0000 7f6b62b17700 1 --2- 172.21.15.59:0/367521136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b5c0970d0 0x7f6b5c12cc30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6b48009760 tx=0x7f6b48009060).stop 2023-09-30T22:26:46.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.245+0000 7f6b62b17700 1 -- 172.21.15.59:0/367521136 shutdown_connections 2023-09-30T22:26:46.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.245+0000 7f6b62b17700 1 --2- 172.21.15.59:0/367521136 >> v2:172.21.15.59:3300/0 conn(0x7f6b5c12d120 0x7f6b5c12f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.245+0000 7f6b62b17700 1 --2- 172.21.15.59:0/367521136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b5c0970d0 0x7f6b5c12cc30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.245+0000 7f6b62b17700 1 -- 172.21.15.59:0/367521136 >> 172.21.15.59:0/367521136 conn(0x7f6b5c09a220 msgr2=0x7f6b5c09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.245+0000 7f6b62b17700 1 -- 172.21.15.59:0/367521136 shutdown_connections 2023-09-30T22:26:46.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.245+0000 7f6b62b17700 1 -- 172.21.15.59:0/367521136 wait complete. 2023-09-30T22:26:46.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.246+0000 7f6b62b17700 1 Processor -- start 2023-09-30T22:26:46.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.246+0000 7f6b62b17700 1 -- start start 2023-09-30T22:26:46.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.247+0000 7f6b62b17700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b5c0965e0 0x7f6b5c13a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.247+0000 7f6b62b17700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b5c0970d0 0x7f6b5c13ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.247+0000 7f6b62b17700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b5c12d120 0x7f6b5c113d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.247+0000 7f6b62b17700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c12f730 con 0x7f6b5c0970d0 2023-09-30T22:26:46.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.247+0000 7f6b62b17700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c098470 con 0x7f6b5c0965e0 2023-09-30T22:26:46.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.247+0000 7f6b62b17700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c091bf0 con 0x7f6b5c12d120 2023-09-30T22:26:46.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.247+0000 7f6b608b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b5c0965e0 0x7f6b5c13a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.247+0000 7f6b608b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b5c0965e0 0x7f6b5c13a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41730/0 (socket says 172.21.15.59:41730) 2023-09-30T22:26:46.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.247+0000 7f6b608b3700 1 -- 172.21.15.59:0/1121839015 learned_addr learned my addr 172.21.15.59:0/1121839015 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:46.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.247+0000 7f6b610b4700 1 --2- 172.21.15.59:0/1121839015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b5c12d120 0x7f6b5c113d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.247+0000 7f6b5bfff700 1 --2- 172.21.15.59:0/1121839015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b5c0970d0 0x7f6b5c13ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.248+0000 7f6b608b3700 1 -- 172.21.15.59:0/1121839015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b5c12d120 msgr2=0x7f6b5c113d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.248+0000 7f6b608b3700 1 --2- 172.21.15.59:0/1121839015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b5c12d120 0x7f6b5c113d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.248+0000 7f6b608b3700 1 -- 172.21.15.59:0/1121839015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b5c0970d0 msgr2=0x7f6b5c13ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.248+0000 7f6b608b3700 1 --2- 172.21.15.59:0/1121839015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b5c0970d0 0x7f6b5c13ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.248+0000 7f6b608b3700 1 -- 172.21.15.59:0/1121839015 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b480092a0 con 0x7f6b5c0965e0 2023-09-30T22:26:46.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.248+0000 7f6b610b4700 1 --2- 172.21.15.59:0/1121839015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b5c12d120 0x7f6b5c113d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:46.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.248+0000 7f6b608b3700 1 --2- 172.21.15.59:0/1121839015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b5c0965e0 0x7f6b5c13a930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6b50007fd0 tx=0x7f6b50007df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.248+0000 7f6b58ff9700 1 -- 172.21.15.59:0/1121839015 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500072e0 con 0x7f6b5c0965e0 2023-09-30T22:26:46.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.248+0000 7f6b58ff9700 1 -- 172.21.15.59:0/1121839015 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b50007440 con 0x7f6b5c0965e0 2023-09-30T22:26:46.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.248+0000 7f6b58ff9700 1 -- 172.21.15.59:0/1121839015 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500057a0 con 0x7f6b5c0965e0 2023-09-30T22:26:46.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.249+0000 7f6b62b17700 1 -- 172.21.15.59:0/1121839015 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5c117450 con 0x7f6b5c0965e0 2023-09-30T22:26:46.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.249+0000 7f6b62b17700 1 -- 172.21.15.59:0/1121839015 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5c1171f0 con 0x7f6b5c0965e0 2023-09-30T22:26:46.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.250+0000 7f6b58ff9700 1 -- 172.21.15.59:0/1121839015 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6b50005b90 con 0x7f6b5c0965e0 2023-09-30T22:26:46.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.250+0000 7f6b62b17700 1 -- 172.21.15.59:0/1121839015 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b5c05a260 con 0x7f6b5c0965e0 2023-09-30T22:26:46.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.250+0000 7f6b58ff9700 1 -- 172.21.15.59:0/1121839015 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6b5003a530 con 0x7f6b5c0965e0 2023-09-30T22:26:46.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.259+0000 7f6b58ff9700 1 -- 172.21.15.59:0/1121839015 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6b50005e40 con 0x7f6b5c0965e0 2023-09-30T22:26:46.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.279+0000 7f329163d700 1 Processor -- start 2023-09-30T22:26:46.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.279+0000 7f329163d700 1 -- start start 2023-09-30T22:26:46.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.280+0000 7f329163d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c127390 0x7f328c12fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.280+0000 7f329163d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f328c127fa0 0x7f328c132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.280+0000 7f329163d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328c091b60 con 0x7f328c059070 2023-09-30T22:26:46.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.280+0000 7f329163d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328c096940 con 0x7f328c127390 2023-09-30T22:26:46.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.280+0000 7f329163d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f328c059c00 con 0x7f328c127fa0 2023-09-30T22:26:46.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.280+0000 7f328affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f328c059070 0x7f328c127890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49402/0 (socket says 172.21.15.59:49402) 2023-09-30T22:26:46.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.280+0000 7f328affd700 1 -- 172.21.15.59:0/3280369021 learned_addr learned my addr 172.21.15.59:0/3280369021 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:46.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.280+0000 7f32827fc700 1 --2- 172.21.15.59:0/3280369021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c127390 0x7f328c12fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.281+0000 7f328b7fe700 1 --2- 172.21.15.59:0/3280369021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f328c127fa0 0x7f328c132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.281+0000 7f328b7fe700 1 -- 172.21.15.59:0/3280369021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c127390 msgr2=0x7f328c12fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.281+0000 7f328b7fe700 1 --2- 172.21.15.59:0/3280369021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c127390 0x7f328c12fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.281+0000 7f328b7fe700 1 -- 172.21.15.59:0/3280369021 >> v1:172.21.15.59:6789/0 conn(0x7f328c059070 legacy=0x7f328c127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.281+0000 7f328a7fc700 1 -- 172.21.15.59:0/3280369021 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966875422 0 0) 0x7f328c091b60 con 0x7f328c059070 2023-09-30T22:26:46.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.281+0000 7f328b7fe700 1 -- 172.21.15.59:0/3280369021 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c0929d0 con 0x7f328c127fa0 2023-09-30T22:26:46.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.281+0000 7f328b7fe700 1 --2- 172.21.15.59:0/3280369021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f328c127fa0 0x7f328c132170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3284009e90 tx=0x7f3284009780).ready entity=mon.2 client_cookie=e05a120871470693 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.281+0000 7f328a7fc700 1 -- 172.21.15.59:0/3280369021 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328400e070 con 0x7f328c127fa0 2023-09-30T22:26:46.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.281+0000 7f328a7fc700 1 -- 172.21.15.59:0/3280369021 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328400bb60 con 0x7f328c127fa0 2023-09-30T22:26:46.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.281+0000 7f328a7fc700 1 -- 172.21.15.59:0/3280369021 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284012410 con 0x7f328c127fa0 2023-09-30T22:26:46.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.282+0000 7f329163d700 1 -- 172.21.15.59:0/3280369021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f328c127fa0 msgr2=0x7f328c132170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.282+0000 7f329163d700 1 --2- 172.21.15.59:0/3280369021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f328c127fa0 0x7f328c132170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3284009e90 tx=0x7f3284009780).stop 2023-09-30T22:26:46.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.282+0000 7f329163d700 1 -- 172.21.15.59:0/3280369021 shutdown_connections 2023-09-30T22:26:46.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.282+0000 7f329163d700 1 --2- 172.21.15.59:0/3280369021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f328c127fa0 0x7f328c132170 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.282+0000 7f329163d700 1 --2- 172.21.15.59:0/3280369021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c127390 0x7f328c12fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.282+0000 7f329163d700 1 -- 172.21.15.59:0/3280369021 >> 172.21.15.59:0/3280369021 conn(0x7f328c097470 msgr2=0x7f328c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.282+0000 7f329163d700 1 -- 172.21.15.59:0/3280369021 shutdown_connections 2023-09-30T22:26:46.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.282+0000 7f329163d700 1 -- 172.21.15.59:0/3280369021 wait complete. 2023-09-30T22:26:46.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.284+0000 7f9869ce0700 1 Processor -- start 2023-09-30T22:26:46.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.284+0000 7f329163d700 1 Processor -- start 2023-09-30T22:26:46.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.284+0000 7f329163d700 1 -- start start 2023-09-30T22:26:46.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.284+0000 7f9869ce0700 1 -- start start 2023-09-30T22:26:46.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f9869ce0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98640965e0 0x7f98640969c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f9869ce0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9864096eb0 0x7f9864067de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f9869ce0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98640682d0 0x7f9864068720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f9869ce0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9864068c10 con 0x7f98640682d0 2023-09-30T22:26:46.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f9869ce0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98640933b0 con 0x7f9864096eb0 2023-09-30T22:26:46.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f9869ce0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9864092190 con 0x7f98640965e0 2023-09-30T22:26:46.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f98637fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98640965e0 0x7f98640969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f98637fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98640965e0 0x7f98640969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57304/0 (socket says 172.21.15.59:57304) 2023-09-30T22:26:46.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f98637fe700 1 -- 172.21.15.59:0/817257805 learned_addr learned my addr 172.21.15.59:0/817257805 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:46.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f9862ffd700 1 --2- 172.21.15.59:0/817257805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9864096eb0 0x7f9864067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f329163d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f328c059070 0x7f328c12d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f329163d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f328c127390 0x7f328c12de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f329163d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c127fa0 0x7f328c12e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f329163d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c12e870 con 0x7f328c127390 2023-09-30T22:26:46.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f329163d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328c096f20 con 0x7f328c127fa0 2023-09-30T22:26:46.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f329163d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f328c12ee10 con 0x7f328c059070 2023-09-30T22:26:46.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f32827fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f328c127390 0x7f328c12de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f32827fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f328c127390 0x7f328c12de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53116/0 (socket says 172.21.15.59:53116) 2023-09-30T22:26:46.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f32827fc700 1 -- 172.21.15.59:0/3692924925 learned_addr learned my addr 172.21.15.59:0/3692924925 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:46.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f328b7fe700 1 --2- 172.21.15.59:0/3692924925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c127fa0 0x7f328c12e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f98637fe700 1 -- 172.21.15.59:0/817257805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9864096eb0 msgr2=0x7f9864067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f98637fe700 1 --2- 172.21.15.59:0/817257805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9864096eb0 0x7f9864067de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f98637fe700 1 -- 172.21.15.59:0/817257805 >> v2:172.21.15.59:3300/0 conn(0x7f98640682d0 msgr2=0x7f9864068720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f98637fe700 1 --2- 172.21.15.59:0/817257805 >> v2:172.21.15.59:3300/0 conn(0x7f98640682d0 0x7f9864068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:46.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.285+0000 7f98637fe700 1 -- 172.21.15.59:0/817257805 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9864069a20 con 0x7f98640965e0 2023-09-30T22:26:46.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.286+0000 7f32827fc700 1 -- 172.21.15.59:0/3692924925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f328c059070 msgr2=0x7f328c12d9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:46.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.286+0000 7f32827fc700 1 --2- 172.21.15.59:0/3692924925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f328c059070 0x7f328c12d9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:46.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.286+0000 7f32827fc700 1 -- 172.21.15.59:0/3692924925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c127fa0 msgr2=0x7f328c12e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.286+0000 7f32827fc700 1 --2- 172.21.15.59:0/3692924925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c127fa0 0x7f328c12e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.286+0000 7f32827fc700 1 -- 172.21.15.59:0/3692924925 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3284009a20 con 0x7f328c127390 2023-09-30T22:26:46.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.286+0000 7f98637fe700 1 --2- 172.21.15.59:0/817257805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98640965e0 0x7f98640969c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9854006fd0 tx=0x7f98540090f0).ready entity=mon.2 client_cookie=267e58af47e7da5e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.286+0000 7f32827fc700 1 --2- 172.21.15.59:0/3692924925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f328c127390 0x7f328c12de90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f327400b1c0 tx=0x7f3274009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.286+0000 7f98627fc700 1 -- 172.21.15.59:0/817257805 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985400b600 con 0x7f98640965e0 2023-09-30T22:26:46.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.286+0000 7f98627fc700 1 -- 172.21.15.59:0/817257805 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985400b760 con 0x7f98640965e0 2023-09-30T22:26:46.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.286+0000 7f98627fc700 1 -- 172.21.15.59:0/817257805 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985400bae0 con 0x7f98640965e0 2023-09-30T22:26:46.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.286+0000 7f32837fe700 1 -- 172.21.15.59:0/3692924925 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274019070 con 0x7f328c127390 2023-09-30T22:26:46.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.286+0000 7f32837fe700 1 -- 172.21.15.59:0/3692924925 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327400bd50 con 0x7f328c127390 2023-09-30T22:26:46.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.286+0000 7f32837fe700 1 -- 172.21.15.59:0/3692924925 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327401e630 con 0x7f328c127390 2023-09-30T22:26:46.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.286+0000 7f329163d700 1 -- 172.21.15.59:0/3692924925 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328c12f5c0 con 0x7f328c127390 2023-09-30T22:26:46.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.286+0000 7f329163d700 1 -- 172.21.15.59:0/3692924925 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328c1319d0 con 0x7f328c127390 2023-09-30T22:26:46.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.287+0000 7f9869ce0700 1 -- 172.21.15.59:0/817257805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98640965e0 msgr2=0x7f98640969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.287+0000 7f9869ce0700 1 --2- 172.21.15.59:0/817257805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98640965e0 0x7f98640969c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9854006fd0 tx=0x7f98540090f0).stop 2023-09-30T22:26:46.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.287+0000 7f9869ce0700 1 -- 172.21.15.59:0/817257805 shutdown_connections 2023-09-30T22:26:46.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.287+0000 7f9869ce0700 1 --2- 172.21.15.59:0/817257805 >> v2:172.21.15.59:3300/0 conn(0x7f98640682d0 0x7f9864068720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:46.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.287+0000 7f9869ce0700 1 --2- 172.21.15.59:0/817257805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98640965e0 0x7f98640969c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.287+0000 7f9869ce0700 1 --2- 172.21.15.59:0/817257805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9864096eb0 0x7f9864067de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.287+0000 7f9869ce0700 1 -- 172.21.15.59:0/817257805 >> 172.21.15.59:0/817257805 conn(0x7f986409a220 msgr2=0x7f986409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.287+0000 7f32837fe700 1 -- 172.21.15.59:0/3692924925 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3274027440 con 0x7f328c127390 2023-09-30T22:26:46.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.287+0000 7f32837fe700 1 -- 172.21.15.59:0/3692924925 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3274043380 con 0x7f328c127390 2023-09-30T22:26:46.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.287+0000 7f6360896700 1 Processor -- start 2023-09-30T22:26:46.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.288+0000 7f329163d700 1 -- 172.21.15.59:0/3692924925 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328c131520 con 0x7f328c127390 2023-09-30T22:26:46.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.288+0000 7f9869ce0700 1 -- 172.21.15.59:0/817257805 shutdown_connections 2023-09-30T22:26:46.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.288+0000 7f9869ce0700 1 -- 172.21.15.59:0/817257805 wait complete. 2023-09-30T22:26:46.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.288+0000 7f6360896700 1 -- start start 2023-09-30T22:26:46.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.289+0000 7f6360896700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f635c066cd0 0x7f635c0670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.289+0000 7f6360896700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f635c0675a0 0x7f635c12f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.289+0000 7f6360896700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f635c12f6e0 0x7f635c12fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.289+0000 7f6360896700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f635c068b90 con 0x7f635c0675a0 2023-09-30T22:26:46.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.289+0000 7f6360896700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635c0921c0 con 0x7f635c066cd0 2023-09-30T22:26:46.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.289+0000 7f6360896700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f635c098000 con 0x7f635c12f6e0 2023-09-30T22:26:46.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.289+0000 7f6359d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f635c0675a0 0x7f635c12f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.289+0000 7f6359d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f635c0675a0 0x7f635c12f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53118/0 (socket says 172.21.15.59:53118) 2023-09-30T22:26:46.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.289+0000 7f6359d9b700 1 -- 172.21.15.59:0/1942535083 learned_addr learned my addr 172.21.15.59:0/1942535083 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:46.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.289+0000 7f635ad9d700 1 --2- 172.21.15.59:0/1942535083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f635c12f6e0 0x7f635c12fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.289+0000 7f9869ce0700 1 Processor -- start 2023-09-30T22:26:46.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.289+0000 7f9869ce0700 1 -- start start 2023-09-30T22:26:46.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f635ad9d700 1 -- 172.21.15.59:0/1942535083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f635c066cd0 msgr2=0x7f635c0670b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:26:46.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f635ad9d700 1 --2- 172.21.15.59:0/1942535083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f635c066cd0 0x7f635c0670b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:46.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f635ad9d700 1 -- 172.21.15.59:0/1942535083 >> v2:172.21.15.59:3300/0 conn(0x7f635c0675a0 msgr2=0x7f635c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f635ad9d700 1 --2- 172.21.15.59:0/1942535083 >> v2:172.21.15.59:3300/0 conn(0x7f635c0675a0 0x7f635c12f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f635ad9d700 1 -- 172.21.15.59:0/1942535083 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c130060 con 0x7f635c12f6e0 2023-09-30T22:26:46.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f635ad9d700 1 --2- 172.21.15.59:0/1942535083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f635c12f6e0 0x7f635c12fb70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6350009790 tx=0x7f6350009060).ready entity=mon.2 client_cookie=2d14e0ba3708d54e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f9869ce0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98640682d0 0x7f986411ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f9869ce0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98640965e0 0x7f986411f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f9869ce0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9864096eb0 0x7f986411f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f9869ce0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986411fcd0 con 0x7f98640965e0 2023-09-30T22:26:46.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f9869ce0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986406a1c0 con 0x7f9864096eb0 2023-09-30T22:26:46.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f9869ce0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9864121f90 con 0x7f98640682d0 2023-09-30T22:26:46.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f9863fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9864096eb0 0x7f986411f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f98637fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98640682d0 0x7f986411ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f98637fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98640682d0 0x7f986411ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57334/0 (socket says 172.21.15.59:57334) 2023-09-30T22:26:46.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f98637fe700 1 -- 172.21.15.59:0/1212559415 learned_addr learned my addr 172.21.15.59:0/1212559415 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:46.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f9863fff700 1 --2- 172.21.15.59:0/1212559415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9864096eb0 0x7f986411f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41778/0 (socket says 172.21.15.59:41778) 2023-09-30T22:26:46.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f98637fe700 1 -- 172.21.15.59:0/1212559415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9864096eb0 msgr2=0x7f986411f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f98637fe700 1 --2- 172.21.15.59:0/1212559415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9864096eb0 0x7f986411f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f98637fe700 1 -- 172.21.15.59:0/1212559415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98640965e0 msgr2=0x7f986411f2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:46.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f98637fe700 1 --2- 172.21.15.59:0/1212559415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98640965e0 0x7f986411f2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:46.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f98637fe700 1 -- 172.21.15.59:0/1212559415 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9854009370 con 0x7f98640682d0 2023-09-30T22:26:46.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f9863fff700 1 --2- 172.21.15.59:0/1212559415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9864096eb0 0x7f986411f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:46.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f98637fe700 1 --2- 172.21.15.59:0/1212559415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98640682d0 0x7f986411ee00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9864092320 tx=0x7f9854017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f635959a700 1 -- 172.21.15.59:0/1942535083 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635000b580 con 0x7f635c12f6e0 2023-09-30T22:26:46.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f635959a700 1 -- 172.21.15.59:0/1942535083 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635000b6e0 con 0x7f635c12f6e0 2023-09-30T22:26:46.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.290+0000 7f635959a700 1 -- 172.21.15.59:0/1942535083 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635000ba60 con 0x7f635c12f6e0 2023-09-30T22:26:46.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f984b7fe700 1 -- 172.21.15.59:0/1212559415 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985400b8d0 con 0x7f98640682d0 2023-09-30T22:26:46.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f984b7fe700 1 -- 172.21.15.59:0/1212559415 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985400ba30 con 0x7f98640682d0 2023-09-30T22:26:46.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f9869ce0700 1 -- 172.21.15.59:0/1212559415 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98641233f0 con 0x7f98640682d0 2023-09-30T22:26:46.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f984b7fe700 1 -- 172.21.15.59:0/1212559415 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985401c670 con 0x7f98640682d0 2023-09-30T22:26:46.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f9869ce0700 1 -- 172.21.15.59:0/1212559415 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9864122530 con 0x7f98640682d0 2023-09-30T22:26:46.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f6360896700 1 -- 172.21.15.59:0/1942535083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f635c12f6e0 msgr2=0x7f635c12fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f6360896700 1 --2- 172.21.15.59:0/1942535083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f635c12f6e0 0x7f635c12fb70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6350009790 tx=0x7f6350009060).stop 2023-09-30T22:26:46.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f6360896700 1 -- 172.21.15.59:0/1942535083 shutdown_connections 2023-09-30T22:26:46.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f6360896700 1 --2- 172.21.15.59:0/1942535083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f635c12f6e0 0x7f635c12fb70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f6360896700 1 --2- 172.21.15.59:0/1942535083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f635c066cd0 0x7f635c0670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:46.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f6360896700 1 --2- 172.21.15.59:0/1942535083 >> v2:172.21.15.59:3300/0 conn(0x7f635c0675a0 0x7f635c12f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f6360896700 1 -- 172.21.15.59:0/1942535083 >> 172.21.15.59:0/1942535083 conn(0x7f635c09a220 msgr2=0x7f635c09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.291+0000 7f6360896700 1 -- 172.21.15.59:0/1942535083 shutdown_connections 2023-09-30T22:26:46.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.292+0000 7f6360896700 1 -- 172.21.15.59:0/1942535083 wait complete. 2023-09-30T22:26:46.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.292+0000 7f984b7fe700 1 -- 172.21.15.59:0/1212559415 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f985401c9e0 con 0x7f98640682d0 2023-09-30T22:26:46.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.293+0000 7f6360896700 1 Processor -- start 2023-09-30T22:26:46.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.293+0000 7f984b7fe700 1 -- 172.21.15.59:0/1212559415 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f985403cdd0 con 0x7f98640682d0 2023-09-30T22:26:46.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.293+0000 7f6360896700 1 -- start start 2023-09-30T22:26:46.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.293+0000 7f6360896700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f635c066cd0 0x7f635c113080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.293+0000 7f6360896700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f635c0675a0 0x7f635c133cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.293+0000 7f6360896700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f635c12f6e0 0x7f635c1341b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.293+0000 7f6360896700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c12f2a0 con 0x7f635c12f6e0 2023-09-30T22:26:46.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.293+0000 7f6360896700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635c111710 con 0x7f635c0675a0 2023-09-30T22:26:46.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.293+0000 7f6360896700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f635c069270 con 0x7f635c066cd0 2023-09-30T22:26:46.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.293+0000 7f635a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f635c066cd0 0x7f635c113080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.293+0000 7f635a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f635c066cd0 0x7f635c113080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57340/0 (socket says 172.21.15.59:57340) 2023-09-30T22:26:46.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.293+0000 7f635a59c700 1 -- 172.21.15.59:0/1999931721 learned_addr learned my addr 172.21.15.59:0/1999931721 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:46.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.293+0000 7f6359d9b700 1 --2- 172.21.15.59:0/1999931721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f635c0675a0 0x7f635c133cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.294+0000 7f635a59c700 1 -- 172.21.15.59:0/1999931721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f635c0675a0 msgr2=0x7f635c133cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.294+0000 7f635a59c700 1 --2- 172.21.15.59:0/1999931721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f635c0675a0 0x7f635c133cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.294+0000 7f635a59c700 1 -- 172.21.15.59:0/1999931721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f635c12f6e0 msgr2=0x7f635c1341b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.294+0000 7f635a59c700 1 --2- 172.21.15.59:0/1999931721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f635c12f6e0 0x7f635c1341b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:46.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.294+0000 7f635a59c700 1 -- 172.21.15.59:0/1999931721 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63500092a0 con 0x7f635c066cd0 2023-09-30T22:26:46.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.294+0000 7f6359d9b700 1 --2- 172.21.15.59:0/1999931721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f635c0675a0 0x7f635c133cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:46.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.294+0000 7f635a59c700 1 --2- 172.21.15.59:0/1999931721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f635c066cd0 0x7f635c113080 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f635400bc30 tx=0x7f6354009820).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.294+0000 7f9869ce0700 1 -- 172.21.15.59:0/1212559415 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98641220d0 con 0x7f98640682d0 2023-09-30T22:26:46.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.294+0000 7f634a7fc700 1 -- 172.21.15.59:0/1999931721 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635400c950 con 0x7f635c066cd0 2023-09-30T22:26:46.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.294+0000 7f634a7fc700 1 -- 172.21.15.59:0/1999931721 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635400cad0 con 0x7f635c066cd0 2023-09-30T22:26:46.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.294+0000 7f634a7fc700 1 -- 172.21.15.59:0/1999931721 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635400cc80 con 0x7f635c066cd0 2023-09-30T22:26:46.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.294+0000 7f32837fe700 1 -- 172.21.15.59:0/3692924925 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f327401b8c0 con 0x7f328c127390 2023-09-30T22:26:46.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.294+0000 7f6360896700 1 -- 172.21.15.59:0/1999931721 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635c1125e0 con 0x7f635c066cd0 2023-09-30T22:26:46.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.294+0000 7f6360896700 1 -- 172.21.15.59:0/1999931721 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635c110c70 con 0x7f635c066cd0 2023-09-30T22:26:46.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.295+0000 7f6360896700 1 -- 172.21.15.59:0/1999931721 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f635c068830 con 0x7f635c066cd0 2023-09-30T22:26:46.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.299+0000 7f984b7fe700 1 -- 172.21.15.59:0/1212559415 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f98641220d0 con 0x7f98640682d0 2023-09-30T22:26:46.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.301+0000 7f634a7fc700 1 -- 172.21.15.59:0/1999931721 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6354012020 con 0x7f635c066cd0 2023-09-30T22:26:46.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.301+0000 7f634a7fc700 1 -- 172.21.15.59:0/1999931721 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f635403b830 con 0x7f635c066cd0 2023-09-30T22:26:46.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.304+0000 7f634a7fc700 1 -- 172.21.15.59:0/1999931721 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6354015e30 con 0x7f635c066cd0 2023-09-30T22:26:46.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.480+0000 7f9869ce0700 1 -- 172.21.15.59:0/1212559415 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f98641220d0 con 0x7f98640682d0 2023-09-30T22:26:46.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.480+0000 7f984b7fe700 1 -- 172.21.15.59:0/1212559415 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f98641220d0 con 0x7f98640682d0 2023-09-30T22:26:46.481 INFO:teuthology.orchestra.run.smithi059.stdout:38654705669 2023-09-30T22:26:46.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.482+0000 7f6360896700 1 -- 172.21.15.59:0/1999931721 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f635c05a260 con 0x7f635c066cd0 2023-09-30T22:26:46.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.482+0000 7f634a7fc700 1 -- 172.21.15.59:0/1999931721 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63540143d0 con 0x7f635c066cd0 2023-09-30T22:26:46.482 INFO:teuthology.orchestra.run.smithi059.stdout:42949672965 2023-09-30T22:26:46.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.483+0000 7f9869ce0700 1 -- 172.21.15.59:0/1212559415 >> v1:172.21.15.59:6816/118188 conn(0x7f985002bb60 legacy=0x7f985002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.483+0000 7f9869ce0700 1 -- 172.21.15.59:0/1212559415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98640682d0 msgr2=0x7f986411ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.483+0000 7f9869ce0700 1 --2- 172.21.15.59:0/1212559415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98640682d0 0x7f986411ee00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9864092320 tx=0x7f9854017000).stop 2023-09-30T22:26:46.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.483+0000 7f9869ce0700 1 -- 172.21.15.59:0/1212559415 shutdown_connections 2023-09-30T22:26:46.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.483+0000 7f9869ce0700 1 --2- 172.21.15.59:0/1212559415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98640682d0 0x7f986411ee00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.483+0000 7f9869ce0700 1 --2- 172.21.15.59:0/1212559415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9864096eb0 0x7f986411f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.483+0000 7f9869ce0700 1 --2- 172.21.15.59:0/1212559415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98640965e0 0x7f986411f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:46.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.483+0000 7f9869ce0700 1 -- 172.21.15.59:0/1212559415 >> 172.21.15.59:0/1212559415 conn(0x7f986409a220 msgr2=0x7f9864093570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.483+0000 7f9869ce0700 1 -- 172.21.15.59:0/1212559415 shutdown_connections 2023-09-30T22:26:46.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.483+0000 7f9869ce0700 1 -- 172.21.15.59:0/1212559415 wait complete. 2023-09-30T22:26:46.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.485+0000 7f6360896700 1 -- 172.21.15.59:0/1999931721 >> v1:172.21.15.59:6816/118188 conn(0x7f633c02bb90 legacy=0x7f633c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.485+0000 7f6360896700 1 -- 172.21.15.59:0/1999931721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f635c066cd0 msgr2=0x7f635c113080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.485+0000 7f6360896700 1 --2- 172.21.15.59:0/1999931721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f635c066cd0 0x7f635c113080 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f635400bc30 tx=0x7f6354009820).stop 2023-09-30T22:26:46.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.486+0000 7f6360896700 1 -- 172.21.15.59:0/1999931721 shutdown_connections 2023-09-30T22:26:46.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.486+0000 7f6360896700 1 --2- 172.21.15.59:0/1999931721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f635c066cd0 0x7f635c113080 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.486+0000 7f6360896700 1 --2- 172.21.15.59:0/1999931721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f635c12f6e0 0x7f635c1341b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:46.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.486+0000 7f6360896700 1 --2- 172.21.15.59:0/1999931721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f635c0675a0 0x7f635c133cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.486+0000 7f6360896700 1 -- 172.21.15.59:0/1999931721 >> 172.21.15.59:0/1999931721 conn(0x7f635c09a220 msgr2=0x7f635c135ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.486+0000 7f6360896700 1 -- 172.21.15.59:0/1999931721 shutdown_connections 2023-09-30T22:26:46.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.486+0000 7f6360896700 1 -- 172.21.15.59:0/1999931721 wait complete. 2023-09-30T22:26:46.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.486+0000 7f6b62b17700 1 -- 172.21.15.59:0/1121839015 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b5c069210 con 0x7f6b5c0965e0 2023-09-30T22:26:46.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.487+0000 7f6b58ff9700 1 -- 172.21.15.59:0/1121839015 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6b5001c350 con 0x7f6b5c0965e0 2023-09-30T22:26:46.489 INFO:teuthology.orchestra.run.smithi059.stdout:42949672965 2023-09-30T22:26:46.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.489+0000 7f6b62b17700 1 -- 172.21.15.59:0/1121839015 >> v1:172.21.15.59:6816/118188 conn(0x7f6b4002bb60 legacy=0x7f6b4002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.489+0000 7f6b62b17700 1 -- 172.21.15.59:0/1121839015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b5c0965e0 msgr2=0x7f6b5c13a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.489+0000 7f6b62b17700 1 --2- 172.21.15.59:0/1121839015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b5c0965e0 0x7f6b5c13a930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6b50007fd0 tx=0x7f6b50007df0).stop 2023-09-30T22:26:46.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.489+0000 7f6b62b17700 1 -- 172.21.15.59:0/1121839015 shutdown_connections 2023-09-30T22:26:46.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.489+0000 7f6b62b17700 1 --2- 172.21.15.59:0/1121839015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b5c12d120 0x7f6b5c113d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.489+0000 7f6b62b17700 1 --2- 172.21.15.59:0/1121839015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b5c0965e0 0x7f6b5c13a930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.489+0000 7f6b62b17700 1 --2- 172.21.15.59:0/1121839015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b5c0970d0 0x7f6b5c13ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.489+0000 7f6b62b17700 1 -- 172.21.15.59:0/1121839015 >> 172.21.15.59:0/1121839015 conn(0x7f6b5c09a220 msgr2=0x7f6b5c066410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.490+0000 7f6b62b17700 1 -- 172.21.15.59:0/1121839015 shutdown_connections 2023-09-30T22:26:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.490+0000 7f6b62b17700 1 -- 172.21.15.59:0/1121839015 wait complete. 2023-09-30T22:26:46.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2023-09-30T22:26:46.500 DEBUG:teuthology.parallel:result is None 2023-09-30T22:26:46.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.2 2023-09-30T22:26:46.502 DEBUG:teuthology.parallel:result is None 2023-09-30T22:26:46.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.0 2023-09-30T22:26:46.506 DEBUG:teuthology.parallel:result is None 2023-09-30T22:26:46.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.515+0000 7f329163d700 1 -- 172.21.15.59:0/3692924925 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f328c05a260 con 0x7f328c127390 2023-09-30T22:26:46.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.515+0000 7f32837fe700 1 -- 172.21.15.59:0/3692924925 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f32740263a0 con 0x7f328c127390 2023-09-30T22:26:46.515 INFO:teuthology.orchestra.run.smithi059.stdout:38654705669 2023-09-30T22:26:46.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.517+0000 7f329163d700 1 -- 172.21.15.59:0/3692924925 >> v1:172.21.15.59:6816/118188 conn(0x7f326c02bb90 legacy=0x7f326c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.517+0000 7f329163d700 1 -- 172.21.15.59:0/3692924925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f328c127390 msgr2=0x7f328c12de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.517+0000 7f329163d700 1 --2- 172.21.15.59:0/3692924925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f328c127390 0x7f328c12de90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f327400b1c0 tx=0x7f3274009060).stop 2023-09-30T22:26:46.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.517+0000 7f329163d700 1 -- 172.21.15.59:0/3692924925 shutdown_connections 2023-09-30T22:26:46.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.517+0000 7f329163d700 1 --2- 172.21.15.59:0/3692924925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f328c059070 0x7f328c12d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:46.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.517+0000 7f329163d700 1 --2- 172.21.15.59:0/3692924925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c127fa0 0x7f328c12e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.517+0000 7f329163d700 1 --2- 172.21.15.59:0/3692924925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f328c127390 0x7f328c12de90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.517+0000 7f329163d700 1 -- 172.21.15.59:0/3692924925 >> 172.21.15.59:0/3692924925 conn(0x7f328c097470 msgr2=0x7f328c098780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.517+0000 7f329163d700 1 -- 172.21.15.59:0/3692924925 shutdown_connections 2023-09-30T22:26:46.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.517+0000 7f329163d700 1 -- 172.21.15.59:0/3692924925 wait complete. 2023-09-30T22:26:46.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2023-09-30T22:26:46.530 DEBUG:teuthology.parallel:result is None 2023-09-30T22:26:46.530 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:26:46.531 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:26:46.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.703+0000 7f9877771700 1 Processor -- start 2023-09-30T22:26:46.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.703+0000 7f9877771700 1 -- start start 2023-09-30T22:26:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.704+0000 7f9877771700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9870096380 0x7f9870094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.704+0000 7f9877771700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9870091b00 0x7f9870127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.704+0000 7f9877771700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9870094c20 0x7f9870127af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.704+0000 7f9877771700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9870096760 con 0x7f9870094c20 2023-09-30T22:26:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.704+0000 7f9877771700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9870091ff0 con 0x7f9870091b00 2023-09-30T22:26:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.704+0000 7f9877771700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9870092c80 con 0x7f9870096380 2023-09-30T22:26:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.704+0000 7f987550d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9870096380 0x7f9870094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.704+0000 7f9875d0e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9870094c20 0x7f9870127af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.704+0000 7f9875d0e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9870094c20 0x7f9870127af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53150/0 (socket says 172.21.15.59:53150) 2023-09-30T22:26:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.704+0000 7f987550d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9870096380 0x7f9870094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57350/0 (socket says 172.21.15.59:57350) 2023-09-30T22:26:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.704+0000 7f9875d0e700 1 -- 172.21.15.59:0/643537159 learned_addr learned my addr 172.21.15.59:0/643537159 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.704+0000 7f9874d0c700 1 --2- 172.21.15.59:0/643537159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9870091b00 0x7f9870127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.704+0000 7f987550d700 1 -- 172.21.15.59:0/643537159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9870091b00 msgr2=0x7f9870127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.704+0000 7f987550d700 1 --2- 172.21.15.59:0/643537159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9870091b00 0x7f9870127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.705+0000 7f987550d700 1 -- 172.21.15.59:0/643537159 >> v2:172.21.15.59:3300/0 conn(0x7f9870094c20 msgr2=0x7f9870127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.705+0000 7f987550d700 1 --2- 172.21.15.59:0/643537159 >> v2:172.21.15.59:3300/0 conn(0x7f9870094c20 0x7f9870127af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.705+0000 7f987550d700 1 -- 172.21.15.59:0/643537159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9870093900 con 0x7f9870096380 2023-09-30T22:26:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.705+0000 7f9875d0e700 1 --2- 172.21.15.59:0/643537159 >> v2:172.21.15.59:3300/0 conn(0x7f9870094c20 0x7f9870127af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.705+0000 7f987550d700 1 --2- 172.21.15.59:0/643537159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9870096380 0x7f9870094730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f986c009790 tx=0x7f986c009060).ready entity=mon.2 client_cookie=29cbeddb6faac21f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.705+0000 7f9863fff700 1 -- 172.21.15.59:0/643537159 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c00d4a0 con 0x7f9870096380 2023-09-30T22:26:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.705+0000 7f9863fff700 1 -- 172.21.15.59:0/643537159 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c00d600 con 0x7f9870096380 2023-09-30T22:26:46.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.705+0000 7f9863fff700 1 -- 172.21.15.59:0/643537159 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c00d980 con 0x7f9870096380 2023-09-30T22:26:46.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.705+0000 7f9877771700 1 -- 172.21.15.59:0/643537159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9870096380 msgr2=0x7f9870094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.705+0000 7f9877771700 1 --2- 172.21.15.59:0/643537159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9870096380 0x7f9870094730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f986c009790 tx=0x7f986c009060).stop 2023-09-30T22:26:46.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.705+0000 7f9877771700 1 -- 172.21.15.59:0/643537159 shutdown_connections 2023-09-30T22:26:46.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.705+0000 7f9877771700 1 --2- 172.21.15.59:0/643537159 >> v2:172.21.15.59:3300/0 conn(0x7f9870094c20 0x7f9870127af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.705+0000 7f9877771700 1 --2- 172.21.15.59:0/643537159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9870096380 0x7f9870094730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.705+0000 7f9877771700 1 --2- 172.21.15.59:0/643537159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9870091b00 0x7f9870127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.706+0000 7f9877771700 1 -- 172.21.15.59:0/643537159 >> 172.21.15.59:0/643537159 conn(0x7f9870097470 msgr2=0x7f9870097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.706+0000 7f9877771700 1 -- 172.21.15.59:0/643537159 shutdown_connections 2023-09-30T22:26:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.706+0000 7f9877771700 1 -- 172.21.15.59:0/643537159 wait complete. 2023-09-30T22:26:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.707+0000 7f9877771700 1 Processor -- start 2023-09-30T22:26:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.707+0000 7f9877771700 1 -- start start 2023-09-30T22:26:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f9877771700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9870091b00 0x7f9870123ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f9877771700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9870094c20 0x7f98701243b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f9877771700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9870096380 0x7f9870114230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f9877771700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9870117dd0 con 0x7f9870091b00 2023-09-30T22:26:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f9877771700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98701255e0 con 0x7f9870094c20 2023-09-30T22:26:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f9877771700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f987006a520 con 0x7f9870096380 2023-09-30T22:26:46.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f9875d0e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9870096380 0x7f9870114230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f987550d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9870091b00 0x7f9870123ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f9875d0e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9870096380 0x7f9870114230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57362/0 (socket says 172.21.15.59:57362) 2023-09-30T22:26:46.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f9875d0e700 1 -- 172.21.15.59:0/3945012061 learned_addr learned my addr 172.21.15.59:0/3945012061 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f9874d0c700 1 --2- 172.21.15.59:0/3945012061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9870094c20 0x7f98701243b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f9875d0e700 1 -- 172.21.15.59:0/3945012061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9870094c20 msgr2=0x7f98701243b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f9875d0e700 1 --2- 172.21.15.59:0/3945012061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9870094c20 0x7f98701243b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f9875d0e700 1 -- 172.21.15.59:0/3945012061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9870091b00 msgr2=0x7f9870123ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f9875d0e700 1 --2- 172.21.15.59:0/3945012061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9870091b00 0x7f9870123ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f9875d0e700 1 -- 172.21.15.59:0/3945012061 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9868009ae0 con 0x7f9870096380 2023-09-30T22:26:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.708+0000 7f987550d700 1 --2- 172.21.15.59:0/3945012061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9870091b00 0x7f9870123ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.709+0000 7f9875d0e700 1 --2- 172.21.15.59:0/3945012061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9870096380 0x7f9870114230 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f986800c0f0 tx=0x7f986800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.709+0000 7f98617fa700 1 -- 172.21.15.59:0/3945012061 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98680092e0 con 0x7f9870096380 2023-09-30T22:26:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.709+0000 7f98617fa700 1 -- 172.21.15.59:0/3945012061 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986800f040 con 0x7f9870096380 2023-09-30T22:26:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.709+0000 7f9877771700 1 -- 172.21.15.59:0/3945012061 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c0092a0 con 0x7f9870096380 2023-09-30T22:26:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.709+0000 7f98617fa700 1 -- 172.21.15.59:0/3945012061 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986800cc30 con 0x7f9870096380 2023-09-30T22:26:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.709+0000 7f9877771700 1 -- 172.21.15.59:0/3945012061 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9870118440 con 0x7f9870096380 2023-09-30T22:26:46.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.709+0000 7f98617fa700 1 -- 172.21.15.59:0/3945012061 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9868007400 con 0x7f9870096380 2023-09-30T22:26:46.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.710+0000 7f98617fa700 1 -- 172.21.15.59:0/3945012061 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f986803b020 con 0x7f9870096380 2023-09-30T22:26:46.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.710+0000 7f9877771700 1 -- 172.21.15.59:0/3945012061 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98701179e0 con 0x7f9870096380 2023-09-30T22:26:46.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.714+0000 7f98617fa700 1 -- 172.21.15.59:0/3945012061 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f98680112c0 con 0x7f9870096380 2023-09-30T22:26:46.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.887+0000 7f9877771700 1 -- 172.21.15.59:0/3945012061 --> v1:172.21.15.59:6816/118188 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f987005a260 con 0x7f985402bb60 2023-09-30T22:26:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.893+0000 7f98617fa700 1 -- 172.21.15.59:0/3945012061 <== mgr.4103 v1:172.21.15.59:6816/118188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249929 (unknown 2965378022 0 1597713222) 0x7f987005a260 con 0x7f985402bb60 2023-09-30T22:26:46.896 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:46.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.896+0000 7f9877771700 1 -- 172.21.15.59:0/3945012061 >> v1:172.21.15.59:6816/118188 conn(0x7f985402bb60 legacy=0x7f985402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.896+0000 7f9877771700 1 -- 172.21.15.59:0/3945012061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9870096380 msgr2=0x7f9870114230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.896+0000 7f9877771700 1 --2- 172.21.15.59:0/3945012061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9870096380 0x7f9870114230 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f986800c0f0 tx=0x7f986800b040).stop 2023-09-30T22:26:46.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.897+0000 7f9877771700 1 -- 172.21.15.59:0/3945012061 shutdown_connections 2023-09-30T22:26:46.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.897+0000 7f9877771700 1 --2- 172.21.15.59:0/3945012061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9870096380 0x7f9870114230 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.897+0000 7f9877771700 1 --2- 172.21.15.59:0/3945012061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9870091b00 0x7f9870123ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.897+0000 7f9877771700 1 --2- 172.21.15.59:0/3945012061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9870094c20 0x7f98701243b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:46.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.897+0000 7f9877771700 1 -- 172.21.15.59:0/3945012061 >> 172.21.15.59:0/3945012061 conn(0x7f9870097470 msgr2=0x7f98701269b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.897+0000 7f9877771700 1 -- 172.21.15.59:0/3945012061 shutdown_connections 2023-09-30T22:26:46.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:46.897+0000 7f9877771700 1 -- 172.21.15.59:0/3945012061 wait complete. 2023-09-30T22:26:46.899 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-09-30T22:26:46.910 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-09-30T22:26:45.727266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189048,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298312,"statfs":{"total":386547056640,"available":385329471488,"internally_reserved":0,"allocated":679936,"data_stored":204398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001773"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460233+0000","last_change":"2023-09-30T22:26:34.447805+0000","last_active":"2023-09-30T22:26:34.460233+0000","last_peered":"2023-09-30T22:26:34.460233+0000","last_clean":"2023-09-30T22:26:34.460233+0000","last_became_active":"2023-09-30T22:26:34.447480+0000","last_became_peered":"2023-09-30T22:26:34.447480+0000","last_unstale":"2023-09-30T22:26:34.460233+0000","last_undegraded":"2023-09-30T22:26:34.460233+0000","last_fullsized":"2023-09-30T22:26:34.460233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.441095+0000","last_change":"2023-09-30T22:26:34.440046+0000","last_active":"2023-09-30T22:26:34.441095+0000","last_peered":"2023-09-30T22:26:34.441095+0000","last_clean":"2023-09-30T22:26:34.441095+0000","last_became_active":"2023-09-30T22:26:34.439718+0000","last_became_peered":"2023-09-30T22:26:34.439718+0000","last_unstale":"2023-09-30T22:26:34.441095+0000","last_undegraded":"2023-09-30T22:26:34.441095+0000","last_fullsized":"2023-09-30T22:26:34.441095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460661+0000","last_change":"2023-09-30T22:26:34.457031+0000","last_active":"2023-09-30T22:26:34.460661+0000","last_peered":"2023-09-30T22:26:34.460661+0000","last_clean":"2023-09-30T22:26:34.460661+0000","last_became_active":"2023-09-30T22:26:34.456552+0000","last_became_peered":"2023-09-30T22:26:34.456552+0000","last_unstale":"2023-09-30T22:26:34.460661+0000","last_undegraded":"2023-09-30T22:26:34.460661+0000","last_fullsized":"2023-09-30T22:26:34.460661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459584+0000","last_change":"2023-09-30T22:26:34.456744+0000","last_active":"2023-09-30T22:26:34.459584+0000","last_peered":"2023-09-30T22:26:34.459584+0000","last_clean":"2023-09-30T22:26:34.459584+0000","last_became_active":"2023-09-30T22:26:34.456441+0000","last_became_peered":"2023-09-30T22:26:34.456441+0000","last_unstale":"2023-09-30T22:26:34.459584+0000","last_undegraded":"2023-09-30T22:26:34.459584+0000","last_fullsized":"2023-09-30T22:26:34.459584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459464+0000","last_change":"2023-09-30T22:26:34.454395+0000","last_active":"2023-09-30T22:26:34.459464+0000","last_peered":"2023-09-30T22:26:34.459464+0000","last_clean":"2023-09-30T22:26:34.459464+0000","last_became_active":"2023-09-30T22:26:34.454106+0000","last_became_peered":"2023-09-30T22:26:34.454106+0000","last_unstale":"2023-09-30T22:26:34.459464+0000","last_undegraded":"2023-09-30T22:26:34.459464+0000","last_fullsized":"2023-09-30T22:26:34.459464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454476+0000","last_change":"2023-09-30T22:26:34.446348+0000","last_active":"2023-09-30T22:26:34.454476+0000","last_peered":"2023-09-30T22:26:34.454476+0000","last_clean":"2023-09-30T22:26:34.454476+0000","last_became_active":"2023-09-30T22:26:34.444457+0000","last_became_peered":"2023-09-30T22:26:34.444457+0000","last_unstale":"2023-09-30T22:26:34.454476+0000","last_undegraded":"2023-09-30T22:26:34.454476+0000","last_fullsized":"2023-09-30T22:26:34.454476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454968+0000","last_change":"2023-09-30T22:26:34.450051+0000","last_active":"2023-09-30T22:26:34.454968+0000","last_peered":"2023-09-30T22:26:34.454968+0000","last_clean":"2023-09-30T22:26:34.454968+0000","last_became_active":"2023-09-30T22:26:34.449264+0000","last_became_peered":"2023-09-30T22:26:34.449264+0000","last_unstale":"2023-09-30T22:26:34.454968+0000","last_undegraded":"2023-09-30T22:26:34.454968+0000","last_fullsized":"2023-09-30T22:26:34.454968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471021+0000","last_change":"2023-09-30T22:26:34.463260+0000","last_active":"2023-09-30T22:26:34.471021+0000","last_peered":"2023-09-30T22:26:34.471021+0000","last_clean":"2023-09-30T22:26:34.471021+0000","last_became_active":"2023-09-30T22:26:34.462981+0000","last_became_peered":"2023-09-30T22:26:34.462981+0000","last_unstale":"2023-09-30T22:26:34.471021+0000","last_undegraded":"2023-09-30T22:26:34.471021+0000","last_fullsized":"2023-09-30T22:26:34.471021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.455028+0000","last_change":"2023-09-30T22:26:34.451111+0000","last_active":"2023-09-30T22:26:34.455028+0000","last_peered":"2023-09-30T22:26:34.455028+0000","last_clean":"2023-09-30T22:26:34.455028+0000","last_became_active":"2023-09-30T22:26:34.450521+0000","last_became_peered":"2023-09-30T22:26:34.450521+0000","last_unstale":"2023-09-30T22:26:34.455028+0000","last_undegraded":"2023-09-30T22:26:34.455028+0000","last_fullsized":"2023-09-30T22:26:34.455028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461140+0000","last_change":"2023-09-30T22:26:34.454512+0000","last_active":"2023-09-30T22:26:34.461140+0000","last_peered":"2023-09-30T22:26:34.461140+0000","last_clean":"2023-09-30T22:26:34.461140+0000","last_became_active":"2023-09-30T22:26:34.454222+0000","last_became_peered":"2023-09-30T22:26:34.454222+0000","last_unstale":"2023-09-30T22:26:34.461140+0000","last_undegraded":"2023-09-30T22:26:34.461140+0000","last_fullsized":"2023-09-30T22:26:34.461140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462004+0000","last_change":"2023-09-30T22:26:34.454698+0000","last_active":"2023-09-30T22:26:34.462004+0000","last_peered":"2023-09-30T22:26:34.462004+0000","last_clean":"2023-09-30T22:26:34.462004+0000","last_became_active":"2023-09-30T22:26:34.454060+0000","last_became_peered":"2023-09-30T22:26:34.454060+0000","last_unstale":"2023-09-30T22:26:34.462004+0000","last_undegraded":"2023-09-30T22:26:34.462004+0000","last_fullsized":"2023-09-30T22:26:34.462004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460500+0000","last_change":"2023-09-30T22:26:34.447740+0000","last_active":"2023-09-30T22:26:34.460500+0000","last_peered":"2023-09-30T22:26:34.460500+0000","last_clean":"2023-09-30T22:26:34.460500+0000","last_became_active":"2023-09-30T22:26:34.447444+0000","last_became_peered":"2023-09-30T22:26:34.447444+0000","last_unstale":"2023-09-30T22:26:34.460500+0000","last_undegraded":"2023-09-30T22:26:34.460500+0000","last_fullsized":"2023-09-30T22:26:34.460500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460341+0000","last_change":"2023-09-30T22:26:34.454342+0000","last_active":"2023-09-30T22:26:34.460341+0000","last_peered":"2023-09-30T22:26:34.460341+0000","last_clean":"2023-09-30T22:26:34.460341+0000","last_became_active":"2023-09-30T22:26:34.454063+0000","last_became_peered":"2023-09-30T22:26:34.454063+0000","last_unstale":"2023-09-30T22:26:34.460341+0000","last_undegraded":"2023-09-30T22:26:34.460341+0000","last_fullsized":"2023-09-30T22:26:34.460341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462123+0000","last_change":"2023-09-30T22:26:34.450497+0000","last_active":"2023-09-30T22:26:34.462123+0000","last_peered":"2023-09-30T22:26:34.462123+0000","last_clean":"2023-09-30T22:26:34.462123+0000","last_became_active":"2023-09-30T22:26:34.444267+0000","last_became_peered":"2023-09-30T22:26:34.444267+0000","last_unstale":"2023-09-30T22:26:34.462123+0000","last_undegraded":"2023-09-30T22:26:34.462123+0000","last_fullsized":"2023-09-30T22:26:34.462123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459426+0000","last_change":"2023-09-30T22:26:34.455898+0000","last_active":"2023-09-30T22:26:34.459426+0000","last_peered":"2023-09-30T22:26:34.459426+0000","last_clean":"2023-09-30T22:26:34.459426+0000","last_became_active":"2023-09-30T22:26:34.455631+0000","last_became_peered":"2023-09-30T22:26:34.455631+0000","last_unstale":"2023-09-30T22:26:34.459426+0000","last_undegraded":"2023-09-30T22:26:34.459426+0000","last_fullsized":"2023-09-30T22:26:34.459426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.452608+0000","last_change":"2023-09-30T22:26:34.447910+0000","last_active":"2023-09-30T22:26:34.452608+0000","last_peered":"2023-09-30T22:26:34.452608+0000","last_clean":"2023-09-30T22:26:34.452608+0000","last_became_active":"2023-09-30T22:26:34.447627+0000","last_became_peered":"2023-09-30T22:26:34.447627+0000","last_unstale":"2023-09-30T22:26:34.452608+0000","last_undegraded":"2023-09-30T22:26:34.452608+0000","last_fullsized":"2023-09-30T22:26:34.452608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.455048+0000","last_change":"2023-09-30T22:26:34.451250+0000","last_active":"2023-09-30T22:26:34.455048+0000","last_peered":"2023-09-30T22:26:34.455048+0000","last_clean":"2023-09-30T22:26:34.455048+0000","last_became_active":"2023-09-30T22:26:34.450879+0000","last_became_peered":"2023-09-30T22:26:34.450879+0000","last_unstale":"2023-09-30T22:26:34.455048+0000","last_undegraded":"2023-09-30T22:26:34.455048+0000","last_fullsized":"2023-09-30T22:26:34.455048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.446179+0000","last_change":"2023-09-30T22:26:34.440788+0000","last_active":"2023-09-30T22:26:34.446179+0000","last_peered":"2023-09-30T22:26:34.446179+0000","last_clean":"2023-09-30T22:26:34.446179+0000","last_became_active":"2023-09-30T22:26:34.440404+0000","last_became_peered":"2023-09-30T22:26:34.440404+0000","last_unstale":"2023-09-30T22:26:34.446179+0000","last_undegraded":"2023-09-30T22:26:34.446179+0000","last_fullsized":"2023-09-30T22:26:34.446179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459186+0000","last_change":"2023-09-30T22:26:34.445791+0000","last_active":"2023-09-30T22:26:34.459186+0000","last_peered":"2023-09-30T22:26:34.459186+0000","last_clean":"2023-09-30T22:26:34.459186+0000","last_became_active":"2023-09-30T22:26:34.445478+0000","last_became_peered":"2023-09-30T22:26:34.445478+0000","last_unstale":"2023-09-30T22:26:34.459186+0000","last_undegraded":"2023-09-30T22:26:34.459186+0000","last_fullsized":"2023-09-30T22:26:34.459186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460680+0000","last_change":"2023-09-30T22:26:34.453484+0000","last_active":"2023-09-30T22:26:34.460680+0000","last_peered":"2023-09-30T22:26:34.460680+0000","last_clean":"2023-09-30T22:26:34.460680+0000","last_became_active":"2023-09-30T22:26:34.453179+0000","last_became_peered":"2023-09-30T22:26:34.453179+0000","last_unstale":"2023-09-30T22:26:34.460680+0000","last_undegraded":"2023-09-30T22:26:34.460680+0000","last_fullsized":"2023-09-30T22:26:34.460680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.468703+0000","last_change":"2023-09-30T22:26:34.457382+0000","last_active":"2023-09-30T22:26:34.468703+0000","last_peered":"2023-09-30T22:26:34.468703+0000","last_clean":"2023-09-30T22:26:34.468703+0000","last_became_active":"2023-09-30T22:26:34.457077+0000","last_became_peered":"2023-09-30T22:26:34.457077+0000","last_unstale":"2023-09-30T22:26:34.468703+0000","last_undegraded":"2023-09-30T22:26:34.468703+0000","last_fullsized":"2023-09-30T22:26:34.468703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470286+0000","last_change":"2023-09-30T22:26:34.465060+0000","last_active":"2023-09-30T22:26:34.470286+0000","last_peered":"2023-09-30T22:26:34.470286+0000","last_clean":"2023-09-30T22:26:34.470286+0000","last_became_active":"2023-09-30T22:26:34.464780+0000","last_became_peered":"2023-09-30T22:26:34.464780+0000","last_unstale":"2023-09-30T22:26:34.470286+0000","last_undegraded":"2023-09-30T22:26:34.470286+0000","last_fullsized":"2023-09-30T22:26:34.470286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454945+0000","last_change":"2023-09-30T22:26:34.449871+0000","last_active":"2023-09-30T22:26:34.454945+0000","last_peered":"2023-09-30T22:26:34.454945+0000","last_clean":"2023-09-30T22:26:34.454945+0000","last_became_active":"2023-09-30T22:26:34.448901+0000","last_became_peered":"2023-09-30T22:26:34.448901+0000","last_unstale":"2023-09-30T22:26:34.454945+0000","last_undegraded":"2023-09-30T22:26:34.454945+0000","last_fullsized":"2023-09-30T22:26:34.454945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470966+0000","last_change":"2023-09-30T22:26:34.463255+0000","last_active":"2023-09-30T22:26:34.470966+0000","last_peered":"2023-09-30T22:26:34.470966+0000","last_clean":"2023-09-30T22:26:34.470966+0000","last_became_active":"2023-09-30T22:26:34.462962+0000","last_became_peered":"2023-09-30T22:26:34.462962+0000","last_unstale":"2023-09-30T22:26:34.470966+0000","last_undegraded":"2023-09-30T22:26:34.470966+0000","last_fullsized":"2023-09-30T22:26:34.470966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470761+0000","last_change":"2023-09-30T22:26:34.458476+0000","last_active":"2023-09-30T22:26:34.470761+0000","last_peered":"2023-09-30T22:26:34.470761+0000","last_clean":"2023-09-30T22:26:34.470761+0000","last_became_active":"2023-09-30T22:26:34.458195+0000","last_became_peered":"2023-09-30T22:26:34.458195+0000","last_unstale":"2023-09-30T22:26:34.470761+0000","last_undegraded":"2023-09-30T22:26:34.470761+0000","last_fullsized":"2023-09-30T22:26:34.470761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.450508+0000","last_change":"2023-09-30T22:26:34.441003+0000","last_active":"2023-09-30T22:26:34.450508+0000","last_peered":"2023-09-30T22:26:34.450508+0000","last_clean":"2023-09-30T22:26:34.450508+0000","last_became_active":"2023-09-30T22:26:34.440470+0000","last_became_peered":"2023-09-30T22:26:34.440470+0000","last_unstale":"2023-09-30T22:26:34.450508+0000","last_undegraded":"2023-09-30T22:26:34.450508+0000","last_fullsized":"2023-09-30T22:26:34.450508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.456686+0000","last_change":"2023-09-30T22:26:34.448801+0000","last_active":"2023-09-30T22:26:34.456686+0000","last_peered":"2023-09-30T22:26:34.456686+0000","last_clean":"2023-09-30T22:26:34.456686+0000","last_became_active":"2023-09-30T22:26:34.448176+0000","last_became_peered":"2023-09-30T22:26:34.448176+0000","last_unstale":"2023-09-30T22:26:34.456686+0000","last_undegraded":"2023-09-30T22:26:34.456686+0000","last_fullsized":"2023-09-30T22:26:34.456686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471250+0000","last_change":"2023-09-30T22:26:34.031319+0000","last_active":"2023-09-30T22:26:34.471250+0000","last_peered":"2023-09-30T22:26:34.471250+0000","last_clean":"2023-09-30T22:26:34.471250+0000","last_became_active":"2023-09-30T22:26:34.030475+0000","last_became_peered":"2023-09-30T22:26:34.030475+0000","last_unstale":"2023-09-30T22:26:34.471250+0000","last_undegraded":"2023-09-30T22:26:34.471250+0000","last_fullsized":"2023-09-30T22:26:34.471250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463494+0000","last_change":"2023-09-30T22:26:34.459834+0000","last_active":"2023-09-30T22:26:34.463494+0000","last_peered":"2023-09-30T22:26:34.463494+0000","last_clean":"2023-09-30T22:26:34.463494+0000","last_became_active":"2023-09-30T22:26:34.459291+0000","last_became_peered":"2023-09-30T22:26:34.459291+0000","last_unstale":"2023-09-30T22:26:34.463494+0000","last_undegraded":"2023-09-30T22:26:34.463494+0000","last_fullsized":"2023-09-30T22:26:34.463494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.428859+0000","last_change":"2023-09-30T22:26:34.036944+0000","last_active":"2023-09-30T22:26:34.428859+0000","last_peered":"2023-09-30T22:26:34.428859+0000","last_clean":"2023-09-30T22:26:34.428859+0000","last_became_active":"2023-09-30T22:26:34.036564+0000","last_became_peered":"2023-09-30T22:26:34.036564+0000","last_unstale":"2023-09-30T22:26:34.428859+0000","last_undegraded":"2023-09-30T22:26:34.428859+0000","last_fullsized":"2023-09-30T22:26:34.428859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.468638+0000","last_change":"2023-09-30T22:26:34.464712+0000","last_active":"2023-09-30T22:26:34.468638+0000","last_peered":"2023-09-30T22:26:34.468638+0000","last_clean":"2023-09-30T22:26:34.468638+0000","last_became_active":"2023-09-30T22:26:34.464032+0000","last_became_peered":"2023-09-30T22:26:34.464032+0000","last_unstale":"2023-09-30T22:26:34.468638+0000","last_undegraded":"2023-09-30T22:26:34.468638+0000","last_fullsized":"2023-09-30T22:26:34.468638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423659+0000","last_change":"2023-09-30T22:26:34.041116+0000","last_active":"2023-09-30T22:26:34.423659+0000","last_peered":"2023-09-30T22:26:34.423659+0000","last_clean":"2023-09-30T22:26:34.423659+0000","last_became_active":"2023-09-30T22:26:34.040484+0000","last_became_peered":"2023-09-30T22:26:34.040484+0000","last_unstale":"2023-09-30T22:26:34.423659+0000","last_undegraded":"2023-09-30T22:26:34.423659+0000","last_fullsized":"2023-09-30T22:26:34.423659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466426+0000","last_change":"2023-09-30T22:26:34.461558+0000","last_active":"2023-09-30T22:26:34.466426+0000","last_peered":"2023-09-30T22:26:34.466426+0000","last_clean":"2023-09-30T22:26:34.466426+0000","last_became_active":"2023-09-30T22:26:34.461274+0000","last_became_peered":"2023-09-30T22:26:34.461274+0000","last_unstale":"2023-09-30T22:26:34.466426+0000","last_undegraded":"2023-09-30T22:26:34.466426+0000","last_fullsized":"2023-09-30T22:26:34.466426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423512+0000","last_change":"2023-09-30T22:26:34.026179+0000","last_active":"2023-09-30T22:26:34.423512+0000","last_peered":"2023-09-30T22:26:34.423512+0000","last_clean":"2023-09-30T22:26:34.423512+0000","last_became_active":"2023-09-30T22:26:34.025896+0000","last_became_peered":"2023-09-30T22:26:34.025896+0000","last_unstale":"2023-09-30T22:26:34.423512+0000","last_undegraded":"2023-09-30T22:26:34.423512+0000","last_fullsized":"2023-09-30T22:26:34.423512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.469966+0000","last_change":"2023-09-30T22:26:34.461868+0000","last_active":"2023-09-30T22:26:34.469966+0000","last_peered":"2023-09-30T22:26:34.469966+0000","last_clean":"2023-09-30T22:26:34.469966+0000","last_became_active":"2023-09-30T22:26:34.458462+0000","last_became_peered":"2023-09-30T22:26:34.458462+0000","last_unstale":"2023-09-30T22:26:34.469966+0000","last_undegraded":"2023-09-30T22:26:34.469966+0000","last_fullsized":"2023-09-30T22:26:34.469966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.431770+0000","last_change":"2023-09-30T22:26:34.034800+0000","last_active":"2023-09-30T22:26:34.431770+0000","last_peered":"2023-09-30T22:26:34.431770+0000","last_clean":"2023-09-30T22:26:34.431770+0000","last_became_active":"2023-09-30T22:26:34.034161+0000","last_became_peered":"2023-09-30T22:26:34.034161+0000","last_unstale":"2023-09-30T22:26:34.431770+0000","last_undegraded":"2023-09-30T22:26:34.431770+0000","last_fullsized":"2023-09-30T22:26:34.431770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454988+0000","last_change":"2023-09-30T22:26:34.450219+0000","last_active":"2023-09-30T22:26:34.454988+0000","last_peered":"2023-09-30T22:26:34.454988+0000","last_clean":"2023-09-30T22:26:34.454988+0000","last_became_active":"2023-09-30T22:26:34.449611+0000","last_became_peered":"2023-09-30T22:26:34.449611+0000","last_unstale":"2023-09-30T22:26:34.454988+0000","last_undegraded":"2023-09-30T22:26:34.454988+0000","last_fullsized":"2023-09-30T22:26:34.454988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460602+0000","last_change":"2023-09-30T22:26:34.037459+0000","last_active":"2023-09-30T22:26:34.460602+0000","last_peered":"2023-09-30T22:26:34.460602+0000","last_clean":"2023-09-30T22:26:34.460602+0000","last_became_active":"2023-09-30T22:26:34.037268+0000","last_became_peered":"2023-09-30T22:26:34.037268+0000","last_unstale":"2023-09-30T22:26:34.460602+0000","last_undegraded":"2023-09-30T22:26:34.460602+0000","last_fullsized":"2023-09-30T22:26:34.460602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470919+0000","last_change":"2023-09-30T22:26:34.462289+0000","last_active":"2023-09-30T22:26:34.470919+0000","last_peered":"2023-09-30T22:26:34.470919+0000","last_clean":"2023-09-30T22:26:34.470919+0000","last_became_active":"2023-09-30T22:26:34.461927+0000","last_became_peered":"2023-09-30T22:26:34.461927+0000","last_unstale":"2023-09-30T22:26:34.470919+0000","last_undegraded":"2023-09-30T22:26:34.470919+0000","last_fullsized":"2023-09-30T22:26:34.470919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470074+0000","last_change":"2023-09-30T22:26:34.040307+0000","last_active":"2023-09-30T22:26:34.470074+0000","last_peered":"2023-09-30T22:26:34.470074+0000","last_clean":"2023-09-30T22:26:34.470074+0000","last_became_active":"2023-09-30T22:26:34.040017+0000","last_became_peered":"2023-09-30T22:26:34.040017+0000","last_unstale":"2023-09-30T22:26:34.470074+0000","last_undegraded":"2023-09-30T22:26:34.470074+0000","last_fullsized":"2023-09-30T22:26:34.470074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460303+0000","last_change":"2023-09-30T22:26:34.453373+0000","last_active":"2023-09-30T22:26:34.460303+0000","last_peered":"2023-09-30T22:26:34.460303+0000","last_clean":"2023-09-30T22:26:34.460303+0000","last_became_active":"2023-09-30T22:26:34.453075+0000","last_became_peered":"2023-09-30T22:26:34.453075+0000","last_unstale":"2023-09-30T22:26:34.460303+0000","last_undegraded":"2023-09-30T22:26:34.460303+0000","last_fullsized":"2023-09-30T22:26:34.460303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460377+0000","last_change":"2023-09-30T22:26:34.042269+0000","last_active":"2023-09-30T22:26:34.460377+0000","last_peered":"2023-09-30T22:26:34.460377+0000","last_clean":"2023-09-30T22:26:34.460377+0000","last_became_active":"2023-09-30T22:26:34.040124+0000","last_became_peered":"2023-09-30T22:26:34.040124+0000","last_unstale":"2023-09-30T22:26:34.460377+0000","last_undegraded":"2023-09-30T22:26:34.460377+0000","last_fullsized":"2023-09-30T22:26:34.460377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.465633+0000","last_change":"2023-09-30T22:26:34.459725+0000","last_active":"2023-09-30T22:26:34.465633+0000","last_peered":"2023-09-30T22:26:34.465633+0000","last_clean":"2023-09-30T22:26:34.465633+0000","last_became_active":"2023-09-30T22:26:34.459414+0000","last_became_peered":"2023-09-30T22:26:34.459414+0000","last_unstale":"2023-09-30T22:26:34.465633+0000","last_undegraded":"2023-09-30T22:26:34.465633+0000","last_fullsized":"2023-09-30T22:26:34.465633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.424477+0000","last_change":"2023-09-30T22:26:34.024931+0000","last_active":"2023-09-30T22:26:34.424477+0000","last_peered":"2023-09-30T22:26:34.424477+0000","last_clean":"2023-09-30T22:26:34.424477+0000","last_became_active":"2023-09-30T22:26:34.024616+0000","last_became_peered":"2023-09-30T22:26:34.024616+0000","last_unstale":"2023-09-30T22:26:34.424477+0000","last_undegraded":"2023-09-30T22:26:34.424477+0000","last_fullsized":"2023-09-30T22:26:34.424477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.456615+0000","last_change":"2023-09-30T22:26:34.451564+0000","last_active":"2023-09-30T22:26:34.456615+0000","last_peered":"2023-09-30T22:26:34.456615+0000","last_clean":"2023-09-30T22:26:34.456615+0000","last_became_active":"2023-09-30T22:26:34.448514+0000","last_became_peered":"2023-09-30T22:26:34.448514+0000","last_unstale":"2023-09-30T22:26:34.456615+0000","last_undegraded":"2023-09-30T22:26:34.456615+0000","last_fullsized":"2023-09-30T22:26:34.456615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.425637+0000","last_change":"2023-09-30T22:26:34.040402+0000","last_active":"2023-09-30T22:26:34.425637+0000","last_peered":"2023-09-30T22:26:34.425637+0000","last_clean":"2023-09-30T22:26:34.425637+0000","last_became_active":"2023-09-30T22:26:34.039702+0000","last_became_peered":"2023-09-30T22:26:34.039702+0000","last_unstale":"2023-09-30T22:26:34.425637+0000","last_undegraded":"2023-09-30T22:26:34.425637+0000","last_fullsized":"2023-09-30T22:26:34.425637+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454847+0000","last_change":"2023-09-30T22:26:34.450058+0000","last_active":"2023-09-30T22:26:34.454847+0000","last_peered":"2023-09-30T22:26:34.454847+0000","last_clean":"2023-09-30T22:26:34.454847+0000","last_became_active":"2023-09-30T22:26:34.449698+0000","last_became_peered":"2023-09-30T22:26:34.449698+0000","last_unstale":"2023-09-30T22:26:34.454847+0000","last_undegraded":"2023-09-30T22:26:34.454847+0000","last_fullsized":"2023-09-30T22:26:34.454847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471717+0000","last_change":"2023-09-30T22:26:34.041826+0000","last_active":"2023-09-30T22:26:34.471717+0000","last_peered":"2023-09-30T22:26:34.471717+0000","last_clean":"2023-09-30T22:26:34.471717+0000","last_became_active":"2023-09-30T22:26:34.041527+0000","last_became_peered":"2023-09-30T22:26:34.041527+0000","last_unstale":"2023-09-30T22:26:34.471717+0000","last_undegraded":"2023-09-30T22:26:34.471717+0000","last_fullsized":"2023-09-30T22:26:34.471717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466408+0000","last_change":"2023-09-30T22:26:34.461435+0000","last_active":"2023-09-30T22:26:34.466408+0000","last_peered":"2023-09-30T22:26:34.466408+0000","last_clean":"2023-09-30T22:26:34.466408+0000","last_became_active":"2023-09-30T22:26:34.461089+0000","last_became_peered":"2023-09-30T22:26:34.461089+0000","last_unstale":"2023-09-30T22:26:34.466408+0000","last_undegraded":"2023-09-30T22:26:34.466408+0000","last_fullsized":"2023-09-30T22:26:34.466408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471028+0000","last_change":"2023-09-30T22:26:34.030071+0000","last_active":"2023-09-30T22:26:34.471028+0000","last_peered":"2023-09-30T22:26:34.471028+0000","last_clean":"2023-09-30T22:26:34.471028+0000","last_became_active":"2023-09-30T22:26:34.029419+0000","last_became_peered":"2023-09-30T22:26:34.029419+0000","last_unstale":"2023-09-30T22:26:34.471028+0000","last_undegraded":"2023-09-30T22:26:34.471028+0000","last_fullsized":"2023-09-30T22:26:34.471028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470012+0000","last_change":"2023-09-30T22:26:34.462138+0000","last_active":"2023-09-30T22:26:34.470012+0000","last_peered":"2023-09-30T22:26:34.470012+0000","last_clean":"2023-09-30T22:26:34.470012+0000","last_became_active":"2023-09-30T22:26:34.461046+0000","last_became_peered":"2023-09-30T22:26:34.461046+0000","last_unstale":"2023-09-30T22:26:34.470012+0000","last_undegraded":"2023-09-30T22:26:34.470012+0000","last_fullsized":"2023-09-30T22:26:34.470012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.446894+0000","last_change":"2023-09-30T22:26:34.024286+0000","last_active":"2023-09-30T22:26:34.446894+0000","last_peered":"2023-09-30T22:26:34.446894+0000","last_clean":"2023-09-30T22:26:34.446894+0000","last_became_active":"2023-09-30T22:26:34.022989+0000","last_became_peered":"2023-09-30T22:26:34.022989+0000","last_unstale":"2023-09-30T22:26:34.446894+0000","last_undegraded":"2023-09-30T22:26:34.446894+0000","last_fullsized":"2023-09-30T22:26:34.446894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461265+0000","last_change":"2023-09-30T22:26:34.453594+0000","last_active":"2023-09-30T22:26:34.461265+0000","last_peered":"2023-09-30T22:26:34.461265+0000","last_clean":"2023-09-30T22:26:34.461265+0000","last_became_active":"2023-09-30T22:26:34.453288+0000","last_became_peered":"2023-09-30T22:26:34.453288+0000","last_unstale":"2023-09-30T22:26:34.461265+0000","last_undegraded":"2023-09-30T22:26:34.461265+0000","last_fullsized":"2023-09-30T22:26:34.461265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.465754+0000","last_change":"2023-09-30T22:26:34.042026+0000","last_active":"2023-09-30T22:26:34.465754+0000","last_peered":"2023-09-30T22:26:34.465754+0000","last_clean":"2023-09-30T22:26:34.465754+0000","last_became_active":"2023-09-30T22:26:34.041309+0000","last_became_peered":"2023-09-30T22:26:34.041309+0000","last_unstale":"2023-09-30T22:26:34.465754+0000","last_undegraded":"2023-09-30T22:26:34.465754+0000","last_fullsized":"2023-09-30T22:26:34.465754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460615+0000","last_change":"2023-09-30T22:26:34.448356+0000","last_active":"2023-09-30T22:26:34.460615+0000","last_peered":"2023-09-30T22:26:34.460615+0000","last_clean":"2023-09-30T22:26:34.460615+0000","last_became_active":"2023-09-30T22:26:34.447744+0000","last_became_peered":"2023-09-30T22:26:34.447744+0000","last_unstale":"2023-09-30T22:26:34.460615+0000","last_undegraded":"2023-09-30T22:26:34.460615+0000","last_fullsized":"2023-09-30T22:26:34.460615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.422389+0000","last_change":"2023-09-30T22:26:34.025526+0000","last_active":"2023-09-30T22:26:34.422389+0000","last_peered":"2023-09-30T22:26:34.422389+0000","last_clean":"2023-09-30T22:26:34.422389+0000","last_became_active":"2023-09-30T22:26:34.025214+0000","last_became_peered":"2023-09-30T22:26:34.025214+0000","last_unstale":"2023-09-30T22:26:34.422389+0000","last_undegraded":"2023-09-30T22:26:34.422389+0000","last_fullsized":"2023-09-30T22:26:34.422389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459520+0000","last_change":"2023-09-30T22:26:34.457634+0000","last_active":"2023-09-30T22:26:34.459520+0000","last_peered":"2023-09-30T22:26:34.459520+0000","last_clean":"2023-09-30T22:26:34.459520+0000","last_became_active":"2023-09-30T22:26:34.457314+0000","last_became_peered":"2023-09-30T22:26:34.457314+0000","last_unstale":"2023-09-30T22:26:34.459520+0000","last_undegraded":"2023-09-30T22:26:34.459520+0000","last_fullsized":"2023-09-30T22:26:34.459520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461205+0000","last_change":"2023-09-30T22:26:34.042476+0000","last_active":"2023-09-30T22:26:34.461205+0000","last_peered":"2023-09-30T22:26:34.461205+0000","last_clean":"2023-09-30T22:26:34.461205+0000","last_became_active":"2023-09-30T22:26:34.040552+0000","last_became_peered":"2023-09-30T22:26:34.040552+0000","last_unstale":"2023-09-30T22:26:34.461205+0000","last_undegraded":"2023-09-30T22:26:34.461205+0000","last_fullsized":"2023-09-30T22:26:34.461205+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454805+0000","last_change":"2023-09-30T22:26:34.451427+0000","last_active":"2023-09-30T22:26:34.454805+0000","last_peered":"2023-09-30T22:26:34.454805+0000","last_clean":"2023-09-30T22:26:34.454805+0000","last_became_active":"2023-09-30T22:26:34.451149+0000","last_became_peered":"2023-09-30T22:26:34.451149+0000","last_unstale":"2023-09-30T22:26:34.454805+0000","last_undegraded":"2023-09-30T22:26:34.454805+0000","last_fullsized":"2023-09-30T22:26:34.454805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423902+0000","last_change":"2023-09-30T22:26:34.039863+0000","last_active":"2023-09-30T22:26:34.423902+0000","last_peered":"2023-09-30T22:26:34.423902+0000","last_clean":"2023-09-30T22:26:34.423902+0000","last_became_active":"2023-09-30T22:26:34.039536+0000","last_became_peered":"2023-09-30T22:26:34.039536+0000","last_unstale":"2023-09-30T22:26:34.423902+0000","last_undegraded":"2023-09-30T22:26:34.423902+0000","last_fullsized":"2023-09-30T22:26:34.423902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463474+0000","last_change":"2023-09-30T22:26:34.459623+0000","last_active":"2023-09-30T22:26:34.463474+0000","last_peered":"2023-09-30T22:26:34.463474+0000","last_clean":"2023-09-30T22:26:34.463474+0000","last_became_active":"2023-09-30T22:26:34.457887+0000","last_became_peered":"2023-09-30T22:26:34.457887+0000","last_unstale":"2023-09-30T22:26:34.463474+0000","last_undegraded":"2023-09-30T22:26:34.463474+0000","last_fullsized":"2023-09-30T22:26:34.463474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.425122+0000","last_change":"2023-09-30T22:26:34.040793+0000","last_active":"2023-09-30T22:26:34.425122+0000","last_peered":"2023-09-30T22:26:34.425122+0000","last_clean":"2023-09-30T22:26:34.425122+0000","last_became_active":"2023-09-30T22:26:34.040437+0000","last_became_peered":"2023-09-30T22:26:34.040437+0000","last_unstale":"2023-09-30T22:26:34.425122+0000","last_undegraded":"2023-09-30T22:26:34.425122+0000","last_fullsized":"2023-09-30T22:26:34.425122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460680+0000","last_change":"2023-09-30T22:26:34.446474+0000","last_active":"2023-09-30T22:26:34.460680+0000","last_peered":"2023-09-30T22:26:34.460680+0000","last_clean":"2023-09-30T22:26:34.460680+0000","last_became_active":"2023-09-30T22:26:34.445499+0000","last_became_peered":"2023-09-30T22:26:34.445499+0000","last_unstale":"2023-09-30T22:26:34.460680+0000","last_undegraded":"2023-09-30T22:26:34.460680+0000","last_fullsized":"2023-09-30T22:26:34.460680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423262+0000","last_change":"2023-09-30T22:26:34.040910+0000","last_active":"2023-09-30T22:26:34.423262+0000","last_peered":"2023-09-30T22:26:34.423262+0000","last_clean":"2023-09-30T22:26:34.423262+0000","last_became_active":"2023-09-30T22:26:34.040077+0000","last_became_peered":"2023-09-30T22:26:34.040077+0000","last_unstale":"2023-09-30T22:26:34.423262+0000","last_undegraded":"2023-09-30T22:26:34.423262+0000","last_fullsized":"2023-09-30T22:26:34.423262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471281+0000","last_change":"2023-09-30T22:26:34.466480+0000","last_active":"2023-09-30T22:26:34.471281+0000","last_peered":"2023-09-30T22:26:34.471281+0000","last_clean":"2023-09-30T22:26:34.471281+0000","last_became_active":"2023-09-30T22:26:34.466187+0000","last_became_peered":"2023-09-30T22:26:34.466187+0000","last_unstale":"2023-09-30T22:26:34.471281+0000","last_undegraded":"2023-09-30T22:26:34.471281+0000","last_fullsized":"2023-09-30T22:26:34.471281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.440724+0000","last_change":"2023-09-30T22:26:30.873307+0000","last_active":"2023-09-30T22:26:34.440724+0000","last_peered":"2023-09-30T22:26:34.440724+0000","last_clean":"2023-09-30T22:26:34.440724+0000","last_became_active":"2023-09-30T22:26:30.872872+0000","last_became_peered":"2023-09-30T22:26:30.872872+0000","last_unstale":"2023-09-30T22:26:34.440724+0000","last_undegraded":"2023-09-30T22:26:34.440724+0000","last_fullsized":"2023-09-30T22:26:34.440724+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.428047+0000","last_change":"2023-09-30T22:26:34.037332+0000","last_active":"2023-09-30T22:26:34.428047+0000","last_peered":"2023-09-30T22:26:34.428047+0000","last_clean":"2023-09-30T22:26:34.428047+0000","last_became_active":"2023-09-30T22:26:34.037114+0000","last_became_peered":"2023-09-30T22:26:34.037114+0000","last_unstale":"2023-09-30T22:26:34.428047+0000","last_undegraded":"2023-09-30T22:26:34.428047+0000","last_fullsized":"2023-09-30T22:26:34.428047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470943+0000","last_change":"2023-09-30T22:26:34.462485+0000","last_active":"2023-09-30T22:26:34.470943+0000","last_peered":"2023-09-30T22:26:34.470943+0000","last_clean":"2023-09-30T22:26:34.470943+0000","last_became_active":"2023-09-30T22:26:34.454284+0000","last_became_peered":"2023-09-30T22:26:34.454284+0000","last_unstale":"2023-09-30T22:26:34.470943+0000","last_undegraded":"2023-09-30T22:26:34.470943+0000","last_fullsized":"2023-09-30T22:26:34.470943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.424003+0000","last_change":"2023-09-30T22:26:29.861644+0000","last_active":"2023-09-30T22:26:34.424003+0000","last_peered":"2023-09-30T22:26:34.424003+0000","last_clean":"2023-09-30T22:26:34.424003+0000","last_became_active":"2023-09-30T22:26:29.861261+0000","last_became_peered":"2023-09-30T22:26:29.861261+0000","last_unstale":"2023-09-30T22:26:34.424003+0000","last_undegraded":"2023-09-30T22:26:34.424003+0000","last_fullsized":"2023-09-30T22:26:34.424003+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.432400+0000","last_change":"2023-09-30T22:26:34.024242+0000","last_active":"2023-09-30T22:26:34.432400+0000","last_peered":"2023-09-30T22:26:34.432400+0000","last_clean":"2023-09-30T22:26:34.432400+0000","last_became_active":"2023-09-30T22:26:34.023935+0000","last_became_peered":"2023-09-30T22:26:34.023935+0000","last_unstale":"2023-09-30T22:26:34.432400+0000","last_undegraded":"2023-09-30T22:26:34.432400+0000","last_fullsized":"2023-09-30T22:26:34.432400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460658+0000","last_change":"2023-09-30T22:26:34.444993+0000","last_active":"2023-09-30T22:26:34.460658+0000","last_peered":"2023-09-30T22:26:34.460658+0000","last_clean":"2023-09-30T22:26:34.460658+0000","last_became_active":"2023-09-30T22:26:34.444739+0000","last_became_peered":"2023-09-30T22:26:34.444739+0000","last_unstale":"2023-09-30T22:26:34.460658+0000","last_undegraded":"2023-09-30T22:26:34.460658+0000","last_fullsized":"2023-09-30T22:26:34.460658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.427254+0000","last_change":"2023-09-30T22:26:29.858340+0000","last_active":"2023-09-30T22:26:34.427254+0000","last_peered":"2023-09-30T22:26:34.427254+0000","last_clean":"2023-09-30T22:26:34.427254+0000","last_became_active":"2023-09-30T22:26:29.857989+0000","last_became_peered":"2023-09-30T22:26:29.857989+0000","last_unstale":"2023-09-30T22:26:34.427254+0000","last_undegraded":"2023-09-30T22:26:34.427254+0000","last_fullsized":"2023-09-30T22:26:34.427254+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429669+0000","last_change":"2023-09-30T22:26:34.031173+0000","last_active":"2023-09-30T22:26:34.429669+0000","last_peered":"2023-09-30T22:26:34.429669+0000","last_clean":"2023-09-30T22:26:34.429669+0000","last_became_active":"2023-09-30T22:26:34.030863+0000","last_became_peered":"2023-09-30T22:26:34.030863+0000","last_unstale":"2023-09-30T22:26:34.429669+0000","last_undegraded":"2023-09-30T22:26:34.429669+0000","last_fullsized":"2023-09-30T22:26:34.429669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462678+0000","last_change":"2023-09-30T22:26:34.456017+0000","last_active":"2023-09-30T22:26:34.462678+0000","last_peered":"2023-09-30T22:26:34.462678+0000","last_clean":"2023-09-30T22:26:34.462678+0000","last_became_active":"2023-09-30T22:26:34.455744+0000","last_became_peered":"2023-09-30T22:26:34.455744+0000","last_unstale":"2023-09-30T22:26:34.462678+0000","last_undegraded":"2023-09-30T22:26:34.462678+0000","last_fullsized":"2023-09-30T22:26:34.462678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423631+0000","last_change":"2023-09-30T22:26:29.859074+0000","last_active":"2023-09-30T22:26:34.423631+0000","last_peered":"2023-09-30T22:26:34.423631+0000","last_clean":"2023-09-30T22:26:34.423631+0000","last_became_active":"2023-09-30T22:26:29.858669+0000","last_became_peered":"2023-09-30T22:26:29.858669+0000","last_unstale":"2023-09-30T22:26:34.423631+0000","last_undegraded":"2023-09-30T22:26:34.423631+0000","last_fullsized":"2023-09-30T22:26:34.423631+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429553+0000","last_change":"2023-09-30T22:26:28.864097+0000","last_active":"2023-09-30T22:26:34.429553+0000","last_peered":"2023-09-30T22:26:34.429553+0000","last_clean":"2023-09-30T22:26:34.429553+0000","last_became_active":"2023-09-30T22:26:28.863723+0000","last_became_peered":"2023-09-30T22:26:28.863723+0000","last_unstale":"2023-09-30T22:26:34.429553+0000","last_undegraded":"2023-09-30T22:26:34.429553+0000","last_fullsized":"2023-09-30T22:26:34.429553+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_clean_scrub_stamp":"2023-09-30T22:26:27.842299+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423778+0000","last_change":"2023-09-30T22:26:34.040465+0000","last_active":"2023-09-30T22:26:34.423778+0000","last_peered":"2023-09-30T22:26:34.423778+0000","last_clean":"2023-09-30T22:26:34.423778+0000","last_became_active":"2023-09-30T22:26:34.039806+0000","last_became_peered":"2023-09-30T22:26:34.039806+0000","last_unstale":"2023-09-30T22:26:34.423778+0000","last_undegraded":"2023-09-30T22:26:34.423778+0000","last_fullsized":"2023-09-30T22:26:34.423778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463514+0000","last_change":"2023-09-30T22:26:34.459817+0000","last_active":"2023-09-30T22:26:34.463514+0000","last_peered":"2023-09-30T22:26:34.463514+0000","last_clean":"2023-09-30T22:26:34.463514+0000","last_became_active":"2023-09-30T22:26:34.458434+0000","last_became_peered":"2023-09-30T22:26:34.458434+0000","last_unstale":"2023-09-30T22:26:34.463514+0000","last_undegraded":"2023-09-30T22:26:34.463514+0000","last_fullsized":"2023-09-30T22:26:34.463514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423531+0000","last_change":"2023-09-30T22:26:29.861337+0000","last_active":"2023-09-30T22:26:34.423531+0000","last_peered":"2023-09-30T22:26:34.423531+0000","last_clean":"2023-09-30T22:26:34.423531+0000","last_became_active":"2023-09-30T22:26:29.861003+0000","last_became_peered":"2023-09-30T22:26:29.861003+0000","last_unstale":"2023-09-30T22:26:34.423531+0000","last_undegraded":"2023-09-30T22:26:34.423531+0000","last_fullsized":"2023-09-30T22:26:34.423531+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.426034+0000","last_change":"2023-09-30T22:26:34.022924+0000","last_active":"2023-09-30T22:26:34.426034+0000","last_peered":"2023-09-30T22:26:34.426034+0000","last_clean":"2023-09-30T22:26:34.426034+0000","last_became_active":"2023-09-30T22:26:34.022592+0000","last_became_peered":"2023-09-30T22:26:34.022592+0000","last_unstale":"2023-09-30T22:26:34.426034+0000","last_undegraded":"2023-09-30T22:26:34.426034+0000","last_fullsized":"2023-09-30T22:26:34.426034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470264+0000","last_change":"2023-09-30T22:26:34.464915+0000","last_active":"2023-09-30T22:26:34.470264+0000","last_peered":"2023-09-30T22:26:34.470264+0000","last_clean":"2023-09-30T22:26:34.470264+0000","last_became_active":"2023-09-30T22:26:34.464406+0000","last_became_peered":"2023-09-30T22:26:34.464406+0000","last_unstale":"2023-09-30T22:26:34.470264+0000","last_undegraded":"2023-09-30T22:26:34.470264+0000","last_fullsized":"2023-09-30T22:26:34.470264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.426359+0000","last_change":"2023-09-30T22:26:30.874397+0000","last_active":"2023-09-30T22:26:34.426359+0000","last_peered":"2023-09-30T22:26:34.426359+0000","last_clean":"2023-09-30T22:26:34.426359+0000","last_became_active":"2023-09-30T22:26:30.874057+0000","last_became_peered":"2023-09-30T22:26:30.874057+0000","last_unstale":"2023-09-30T22:26:34.426359+0000","last_undegraded":"2023-09-30T22:26:34.426359+0000","last_fullsized":"2023-09-30T22:26:34.426359+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429371+0000","last_change":"2023-09-30T22:26:34.037126+0000","last_active":"2023-09-30T22:26:34.429371+0000","last_peered":"2023-09-30T22:26:34.429371+0000","last_clean":"2023-09-30T22:26:34.429371+0000","last_became_active":"2023-09-30T22:26:34.036825+0000","last_became_peered":"2023-09-30T22:26:34.036825+0000","last_unstale":"2023-09-30T22:26:34.429371+0000","last_undegraded":"2023-09-30T22:26:34.429371+0000","last_fullsized":"2023-09-30T22:26:34.429371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.446597+0000","last_change":"2023-09-30T22:26:34.443381+0000","last_active":"2023-09-30T22:26:34.446597+0000","last_peered":"2023-09-30T22:26:34.446597+0000","last_clean":"2023-09-30T22:26:34.446597+0000","last_became_active":"2023-09-30T22:26:34.443094+0000","last_became_peered":"2023-09-30T22:26:34.443094+0000","last_unstale":"2023-09-30T22:26:34.446597+0000","last_undegraded":"2023-09-30T22:26:34.446597+0000","last_fullsized":"2023-09-30T22:26:34.446597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466600+0000","last_change":"2023-09-30T22:26:34.041060+0000","last_active":"2023-09-30T22:26:34.466600+0000","last_peered":"2023-09-30T22:26:34.466600+0000","last_clean":"2023-09-30T22:26:34.466600+0000","last_became_active":"2023-09-30T22:26:34.040742+0000","last_became_peered":"2023-09-30T22:26:34.040742+0000","last_unstale":"2023-09-30T22:26:34.466600+0000","last_undegraded":"2023-09-30T22:26:34.466600+0000","last_fullsized":"2023-09-30T22:26:34.466600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429047+0000","last_change":"2023-09-30T22:26:30.873252+0000","last_active":"2023-09-30T22:26:34.429047+0000","last_peered":"2023-09-30T22:26:34.429047+0000","last_clean":"2023-09-30T22:26:34.429047+0000","last_became_active":"2023-09-30T22:26:30.872894+0000","last_became_peered":"2023-09-30T22:26:30.872894+0000","last_unstale":"2023-09-30T22:26:34.429047+0000","last_undegraded":"2023-09-30T22:26:34.429047+0000","last_fullsized":"2023-09-30T22:26:34.429047+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.469989+0000","last_change":"2023-09-30T22:26:34.462059+0000","last_active":"2023-09-30T22:26:34.469989+0000","last_peered":"2023-09-30T22:26:34.469989+0000","last_clean":"2023-09-30T22:26:34.469989+0000","last_became_active":"2023-09-30T22:26:34.461415+0000","last_became_peered":"2023-09-30T22:26:34.461415+0000","last_unstale":"2023-09-30T22:26:34.469989+0000","last_undegraded":"2023-09-30T22:26:34.469989+0000","last_fullsized":"2023-09-30T22:26:34.469989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.424541+0000","last_change":"2023-09-30T22:26:30.874887+0000","last_active":"2023-09-30T22:26:34.424541+0000","last_peered":"2023-09-30T22:26:34.424541+0000","last_clean":"2023-09-30T22:26:34.424541+0000","last_became_active":"2023-09-30T22:26:30.874533+0000","last_became_peered":"2023-09-30T22:26:30.874533+0000","last_unstale":"2023-09-30T22:26:34.424541+0000","last_undegraded":"2023-09-30T22:26:34.424541+0000","last_fullsized":"2023-09-30T22:26:34.424541+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T22:26:36.892429+0000","last_change":"2023-09-30T22:26:34.029291+0000","last_active":"2023-09-30T22:26:36.892429+0000","last_peered":"2023-09-30T22:26:36.892429+0000","last_clean":"2023-09-30T22:26:36.892429+0000","last_became_active":"2023-09-30T22:26:34.028983+0000","last_became_peered":"2023-09-30T22:26:34.028983+0000","last_unstale":"2023-09-30T22:26:36.892429+0000","last_undegraded":"2023-09-30T22:26:36.892429+0000","last_fullsized":"2023-09-30T22:26:36.892429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460262+0000","last_change":"2023-09-30T22:26:34.453608+0000","last_active":"2023-09-30T22:26:34.460262+0000","last_peered":"2023-09-30T22:26:34.460262+0000","last_clean":"2023-09-30T22:26:34.460262+0000","last_became_active":"2023-09-30T22:26:34.453255+0000","last_became_peered":"2023-09-30T22:26:34.453255+0000","last_unstale":"2023-09-30T22:26:34.460262+0000","last_undegraded":"2023-09-30T22:26:34.460262+0000","last_fullsized":"2023-09-30T22:26:34.460262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454524+0000","last_change":"2023-09-30T22:26:34.026874+0000","last_active":"2023-09-30T22:26:34.454524+0000","last_peered":"2023-09-30T22:26:34.454524+0000","last_clean":"2023-09-30T22:26:34.454524+0000","last_became_active":"2023-09-30T22:26:34.024536+0000","last_became_peered":"2023-09-30T22:26:34.024536+0000","last_unstale":"2023-09-30T22:26:34.454524+0000","last_undegraded":"2023-09-30T22:26:34.454524+0000","last_fullsized":"2023-09-30T22:26:34.454524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460574+0000","last_change":"2023-09-30T22:26:34.452982+0000","last_active":"2023-09-30T22:26:34.460574+0000","last_peered":"2023-09-30T22:26:34.460574+0000","last_clean":"2023-09-30T22:26:34.460574+0000","last_became_active":"2023-09-30T22:26:34.452695+0000","last_became_peered":"2023-09-30T22:26:34.452695+0000","last_unstale":"2023-09-30T22:26:34.460574+0000","last_undegraded":"2023-09-30T22:26:34.460574+0000","last_fullsized":"2023-09-30T22:26:34.460574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471263+0000","last_change":"2023-09-30T22:26:34.045553+0000","last_active":"2023-09-30T22:26:34.471263+0000","last_peered":"2023-09-30T22:26:34.471263+0000","last_clean":"2023-09-30T22:26:34.471263+0000","last_became_active":"2023-09-30T22:26:34.045206+0000","last_became_peered":"2023-09-30T22:26:34.045206+0000","last_unstale":"2023-09-30T22:26:34.471263+0000","last_undegraded":"2023-09-30T22:26:34.471263+0000","last_fullsized":"2023-09-30T22:26:34.471263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460323+0000","last_change":"2023-09-30T22:26:34.454158+0000","last_active":"2023-09-30T22:26:34.460323+0000","last_peered":"2023-09-30T22:26:34.460323+0000","last_clean":"2023-09-30T22:26:34.460323+0000","last_became_active":"2023-09-30T22:26:34.453928+0000","last_became_peered":"2023-09-30T22:26:34.453928+0000","last_unstale":"2023-09-30T22:26:34.460323+0000","last_undegraded":"2023-09-30T22:26:34.460323+0000","last_fullsized":"2023-09-30T22:26:34.460323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461491+0000","last_change":"2023-09-30T22:26:34.045717+0000","last_active":"2023-09-30T22:26:34.461491+0000","last_peered":"2023-09-30T22:26:34.461491+0000","last_clean":"2023-09-30T22:26:34.461491+0000","last_became_active":"2023-09-30T22:26:34.045395+0000","last_became_peered":"2023-09-30T22:26:34.045395+0000","last_unstale":"2023-09-30T22:26:34.461491+0000","last_undegraded":"2023-09-30T22:26:34.461491+0000","last_fullsized":"2023-09-30T22:26:34.461491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460634+0000","last_change":"2023-09-30T22:26:34.448542+0000","last_active":"2023-09-30T22:26:34.460634+0000","last_peered":"2023-09-30T22:26:34.460634+0000","last_clean":"2023-09-30T22:26:34.460634+0000","last_became_active":"2023-09-30T22:26:34.448081+0000","last_became_peered":"2023-09-30T22:26:34.448081+0000","last_unstale":"2023-09-30T22:26:34.460634+0000","last_undegraded":"2023-09-30T22:26:34.460634+0000","last_fullsized":"2023-09-30T22:26:34.460634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462279+0000","last_change":"2023-09-30T22:26:34.039959+0000","last_active":"2023-09-30T22:26:34.462279+0000","last_peered":"2023-09-30T22:26:34.462279+0000","last_clean":"2023-09-30T22:26:34.462279+0000","last_became_active":"2023-09-30T22:26:34.039615+0000","last_became_peered":"2023-09-30T22:26:34.039615+0000","last_unstale":"2023-09-30T22:26:34.462279+0000","last_undegraded":"2023-09-30T22:26:34.462279+0000","last_fullsized":"2023-09-30T22:26:34.462279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.450313+0000","last_change":"2023-09-30T22:26:34.442775+0000","last_active":"2023-09-30T22:26:34.450313+0000","last_peered":"2023-09-30T22:26:34.450313+0000","last_clean":"2023-09-30T22:26:34.450313+0000","last_became_active":"2023-09-30T22:26:34.442406+0000","last_became_peered":"2023-09-30T22:26:34.442406+0000","last_unstale":"2023-09-30T22:26:34.450313+0000","last_undegraded":"2023-09-30T22:26:34.450313+0000","last_fullsized":"2023-09-30T22:26:34.450313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466261+0000","last_change":"2023-09-30T22:26:34.030292+0000","last_active":"2023-09-30T22:26:34.466261+0000","last_peered":"2023-09-30T22:26:34.466261+0000","last_clean":"2023-09-30T22:26:34.466261+0000","last_became_active":"2023-09-30T22:26:34.029782+0000","last_became_peered":"2023-09-30T22:26:34.029782+0000","last_unstale":"2023-09-30T22:26:34.466261+0000","last_undegraded":"2023-09-30T22:26:34.466261+0000","last_fullsized":"2023-09-30T22:26:34.466261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459154+0000","last_change":"2023-09-30T22:26:34.446235+0000","last_active":"2023-09-30T22:26:34.459154+0000","last_peered":"2023-09-30T22:26:34.459154+0000","last_clean":"2023-09-30T22:26:34.459154+0000","last_became_active":"2023-09-30T22:26:34.445921+0000","last_became_peered":"2023-09-30T22:26:34.445921+0000","last_unstale":"2023-09-30T22:26:34.459154+0000","last_undegraded":"2023-09-30T22:26:34.459154+0000","last_fullsized":"2023-09-30T22:26:34.459154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.451360+0000","last_change":"2023-09-30T22:26:34.441075+0000","last_active":"2023-09-30T22:26:34.451360+0000","last_peered":"2023-09-30T22:26:34.451360+0000","last_clean":"2023-09-30T22:26:34.451360+0000","last_became_active":"2023-09-30T22:26:34.440633+0000","last_became_peered":"2023-09-30T22:26:34.440633+0000","last_unstale":"2023-09-30T22:26:34.451360+0000","last_undegraded":"2023-09-30T22:26:34.451360+0000","last_fullsized":"2023-09-30T22:26:34.451360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463443+0000","last_change":"2023-09-30T22:26:34.458062+0000","last_active":"2023-09-30T22:26:34.463443+0000","last_peered":"2023-09-30T22:26:34.463443+0000","last_clean":"2023-09-30T22:26:34.463443+0000","last_became_active":"2023-09-30T22:26:34.457757+0000","last_became_peered":"2023-09-30T22:26:34.457757+0000","last_unstale":"2023-09-30T22:26:34.463443+0000","last_undegraded":"2023-09-30T22:26:34.463443+0000","last_fullsized":"2023-09-30T22:26:34.463443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.455136+0000","last_change":"2023-09-30T22:26:34.450865+0000","last_active":"2023-09-30T22:26:34.455136+0000","last_peered":"2023-09-30T22:26:34.455136+0000","last_clean":"2023-09-30T22:26:34.455136+0000","last_became_active":"2023-09-30T22:26:34.450568+0000","last_became_peered":"2023-09-30T22:26:34.450568+0000","last_unstale":"2023-09-30T22:26:34.455136+0000","last_undegraded":"2023-09-30T22:26:34.455136+0000","last_fullsized":"2023-09-30T22:26:34.455136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.467022+0000","last_change":"2023-09-30T22:26:34.461553+0000","last_active":"2023-09-30T22:26:34.467022+0000","last_peered":"2023-09-30T22:26:34.467022+0000","last_clean":"2023-09-30T22:26:34.467022+0000","last_became_active":"2023-09-30T22:26:34.459154+0000","last_became_peered":"2023-09-30T22:26:34.459154+0000","last_unstale":"2023-09-30T22:26:34.467022+0000","last_undegraded":"2023-09-30T22:26:34.467022+0000","last_fullsized":"2023-09-30T22:26:34.467022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.451971+0000","last_change":"2023-09-30T22:26:34.444740+0000","last_active":"2023-09-30T22:26:34.451971+0000","last_peered":"2023-09-30T22:26:34.451971+0000","last_clean":"2023-09-30T22:26:34.451971+0000","last_became_active":"2023-09-30T22:26:34.444385+0000","last_became_peered":"2023-09-30T22:26:34.444385+0000","last_unstale":"2023-09-30T22:26:34.451971+0000","last_undegraded":"2023-09-30T22:26:34.451971+0000","last_fullsized":"2023-09-30T22:26:34.451971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":50948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]}]},{"osd":0,"up_from":10,"seq":42949672965,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":51127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":52211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:26:46.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:26:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.083+0000 7f01deb3d700 1 Processor -- start 2023-09-30T22:26:47.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.083+0000 7f01deb3d700 1 -- start start 2023-09-30T22:26:47.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.084+0000 7f01deb3d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d8097cb0 0x7f01d812b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:47.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.084+0000 7f01deb3d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d812fe50 0x7f01d8132240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:47.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.084+0000 7f01deb3d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d8067530 con 0x7f01d80613a0 2023-09-30T22:26:47.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.084+0000 7f01deb3d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d8061780 con 0x7f01d8097cb0 2023-09-30T22:26:47.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.084+0000 7f01deb3d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01d8066ee0 con 0x7f01d812fe50 2023-09-30T22:26:47.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.084+0000 7f01dd0da700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d812fe50 0x7f01d8132240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:47.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.084+0000 7f01dc8d9700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f01d80613a0 0x7f01d812ac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49414/0 (socket says 172.21.15.59:49414) 2023-09-30T22:26:47.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.084+0000 7f01dc8d9700 1 -- 172.21.15.59:0/3904067784 learned_addr learned my addr 172.21.15.59:0/3904067784 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:47.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.084+0000 7f01d7fff700 1 --2- 172.21.15.59:0/3904067784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d8097cb0 0x7f01d812b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:47.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.084+0000 7f01dd0da700 1 -- 172.21.15.59:0/3904067784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d8097cb0 msgr2=0x7f01d812b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:47.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.084+0000 7f01dd0da700 1 --2- 172.21.15.59:0/3904067784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d8097cb0 0x7f01d812b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.084+0000 7f01d77fe700 1 -- 172.21.15.59:0/3904067784 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336720257 0 0) 0x7f01d8067530 con 0x7f01d80613a0 2023-09-30T22:26:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.084+0000 7f01dd0da700 1 -- 172.21.15.59:0/3904067784 >> v1:172.21.15.59:6789/0 conn(0x7f01d80613a0 legacy=0x7f01d812ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.084+0000 7f01dd0da700 1 -- 172.21.15.59:0/3904067784 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d812b880 con 0x7f01d812fe50 2023-09-30T22:26:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.084+0000 7f01d7fff700 1 --2- 172.21.15.59:0/3904067784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d8097cb0 0x7f01d812b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.085+0000 7f01dd0da700 1 --2- 172.21.15.59:0/3904067784 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d812fe50 0x7f01d8132240 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f01d0009e90 tx=0x7f01d0009780).ready entity=mon.2 client_cookie=ff18a4d3597b343 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.085+0000 7f01d77fe700 1 -- 172.21.15.59:0/3904067784 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d000e070 con 0x7f01d812fe50 2023-09-30T22:26:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.085+0000 7f01d77fe700 1 -- 172.21.15.59:0/3904067784 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d000bb60 con 0x7f01d812fe50 2023-09-30T22:26:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.085+0000 7f01d77fe700 1 -- 172.21.15.59:0/3904067784 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d0012410 con 0x7f01d812fe50 2023-09-30T22:26:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.085+0000 7f01deb3d700 1 -- 172.21.15.59:0/3904067784 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d812fe50 msgr2=0x7f01d8132240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.085+0000 7f01deb3d700 1 --2- 172.21.15.59:0/3904067784 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d812fe50 0x7f01d8132240 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f01d0009e90 tx=0x7f01d0009780).stop 2023-09-30T22:26:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.085+0000 7f01deb3d700 1 -- 172.21.15.59:0/3904067784 shutdown_connections 2023-09-30T22:26:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.085+0000 7f01deb3d700 1 --2- 172.21.15.59:0/3904067784 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d812fe50 0x7f01d8132240 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.085+0000 7f01deb3d700 1 --2- 172.21.15.59:0/3904067784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d8097cb0 0x7f01d812b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.085+0000 7f01deb3d700 1 -- 172.21.15.59:0/3904067784 >> 172.21.15.59:0/3904067784 conn(0x7f01d809a220 msgr2=0x7f01d809a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.085+0000 7f01deb3d700 1 -- 172.21.15.59:0/3904067784 shutdown_connections 2023-09-30T22:26:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.085+0000 7f01deb3d700 1 -- 172.21.15.59:0/3904067784 wait complete. 2023-09-30T22:26:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.086+0000 7f01deb3d700 1 Processor -- start 2023-09-30T22:26:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01deb3d700 1 -- start start 2023-09-30T22:26:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01deb3d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d80613a0 0x7f01d8116360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01deb3d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d8097cb0 0x7f01d8112410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01deb3d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01d812fe50 0x7f01d8112900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01deb3d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d812a910 con 0x7f01d812fe50 2023-09-30T22:26:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01deb3d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d812a500 con 0x7f01d8097cb0 2023-09-30T22:26:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01deb3d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01d81149f0 con 0x7f01d80613a0 2023-09-30T22:26:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01d7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d8097cb0 0x7f01d8112410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01d7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d8097cb0 0x7f01d8112410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41818/0 (socket says 172.21.15.59:41818) 2023-09-30T22:26:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01dd0da700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01d812fe50 0x7f01d8112900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01d7fff700 1 -- 172.21.15.59:0/3149262351 learned_addr learned my addr 172.21.15.59:0/3149262351 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01dc8d9700 1 --2- 172.21.15.59:0/3149262351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d80613a0 0x7f01d8116360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01dd0da700 1 -- 172.21.15.59:0/3149262351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d80613a0 msgr2=0x7f01d8116360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01dd0da700 1 --2- 172.21.15.59:0/3149262351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d80613a0 0x7f01d8116360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01dd0da700 1 -- 172.21.15.59:0/3149262351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d8097cb0 msgr2=0x7f01d8112410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01dd0da700 1 --2- 172.21.15.59:0/3149262351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d8097cb0 0x7f01d8112410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01dd0da700 1 -- 172.21.15.59:0/3149262351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc0092a0 con 0x7f01d812fe50 2023-09-30T22:26:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01d7fff700 1 --2- 172.21.15.59:0/3149262351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d8097cb0 0x7f01d8112410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.087+0000 7f01dc8d9700 1 --2- 172.21.15.59:0/3149262351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d80613a0 0x7f01d8116360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.088+0000 7f01dd0da700 1 --2- 172.21.15.59:0/3149262351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01d812fe50 0x7f01d8112900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f01d0014000 tx=0x7f01d0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.088+0000 7f01d4ff9700 1 -- 172.21.15.59:0/3149262351 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d001d630 con 0x7f01d812fe50 2023-09-30T22:26:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.088+0000 7f01d4ff9700 1 -- 172.21.15.59:0/3149262351 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d001d790 con 0x7f01d812fe50 2023-09-30T22:26:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.088+0000 7f01d4ff9700 1 -- 172.21.15.59:0/3149262351 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d001db50 con 0x7f01d812fe50 2023-09-30T22:26:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.088+0000 7f01deb3d700 1 -- 172.21.15.59:0/3149262351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d0009a20 con 0x7f01d812fe50 2023-09-30T22:26:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.088+0000 7f01deb3d700 1 -- 172.21.15.59:0/3149262351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d81158c0 con 0x7f01d812fe50 2023-09-30T22:26:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.089+0000 7f01deb3d700 1 -- 172.21.15.59:0/3149262351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d81323f0 con 0x7f01d812fe50 2023-09-30T22:26:47.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.089+0000 7f01d4ff9700 1 -- 172.21.15.59:0/3149262351 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f01d0003040 con 0x7f01d812fe50 2023-09-30T22:26:47.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.090+0000 7f01d4ff9700 1 -- 172.21.15.59:0/3149262351 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f01d003d7e0 con 0x7f01d812fe50 2023-09-30T22:26:47.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.094+0000 7f01d4ff9700 1 -- 172.21.15.59:0/3149262351 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f01d0010310 con 0x7f01d812fe50 2023-09-30T22:26:47.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.262+0000 7f01deb3d700 1 -- 172.21.15.59:0/3149262351 --> v1:172.21.15.59:6816/118188 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01d805a260 con 0x7f01c402bb90 2023-09-30T22:26:47.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.269+0000 7f01d4ff9700 1 -- 172.21.15.59:0/3149262351 <== mgr.4103 v1:172.21.15.59:6816/118188 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249929 (unknown 2965378022 0 1597713222) 0x7f01d805a260 con 0x7f01c402bb90 2023-09-30T22:26:47.272 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:47.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.272+0000 7f01deb3d700 1 -- 172.21.15.59:0/3149262351 >> v1:172.21.15.59:6816/118188 conn(0x7f01c402bb90 legacy=0x7f01c402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.272+0000 7f01deb3d700 1 -- 172.21.15.59:0/3149262351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01d812fe50 msgr2=0x7f01d8112900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.272+0000 7f01deb3d700 1 --2- 172.21.15.59:0/3149262351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01d812fe50 0x7f01d8112900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f01d0014000 tx=0x7f01d0009780).stop 2023-09-30T22:26:47.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.272+0000 7f01deb3d700 1 -- 172.21.15.59:0/3149262351 shutdown_connections 2023-09-30T22:26:47.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.272+0000 7f01deb3d700 1 --2- 172.21.15.59:0/3149262351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d80613a0 0x7f01d8116360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.272+0000 7f01deb3d700 1 --2- 172.21.15.59:0/3149262351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01d812fe50 0x7f01d8112900 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.272+0000 7f01deb3d700 1 --2- 172.21.15.59:0/3149262351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d8097cb0 0x7f01d8112410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.272+0000 7f01deb3d700 1 -- 172.21.15.59:0/3149262351 >> 172.21.15.59:0/3149262351 conn(0x7f01d809a220 msgr2=0x7f01d8131a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:47.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.272+0000 7f01deb3d700 1 -- 172.21.15.59:0/3149262351 shutdown_connections 2023-09-30T22:26:47.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.272+0000 7f01deb3d700 1 -- 172.21.15.59:0/3149262351 wait complete. 2023-09-30T22:26:47.276 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-09-30T22:26:47.285 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-09-30T22:26:45.727266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189048,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298312,"statfs":{"total":386547056640,"available":385329471488,"internally_reserved":0,"allocated":679936,"data_stored":204398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001773"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460233+0000","last_change":"2023-09-30T22:26:34.447805+0000","last_active":"2023-09-30T22:26:34.460233+0000","last_peered":"2023-09-30T22:26:34.460233+0000","last_clean":"2023-09-30T22:26:34.460233+0000","last_became_active":"2023-09-30T22:26:34.447480+0000","last_became_peered":"2023-09-30T22:26:34.447480+0000","last_unstale":"2023-09-30T22:26:34.460233+0000","last_undegraded":"2023-09-30T22:26:34.460233+0000","last_fullsized":"2023-09-30T22:26:34.460233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.441095+0000","last_change":"2023-09-30T22:26:34.440046+0000","last_active":"2023-09-30T22:26:34.441095+0000","last_peered":"2023-09-30T22:26:34.441095+0000","last_clean":"2023-09-30T22:26:34.441095+0000","last_became_active":"2023-09-30T22:26:34.439718+0000","last_became_peered":"2023-09-30T22:26:34.439718+0000","last_unstale":"2023-09-30T22:26:34.441095+0000","last_undegraded":"2023-09-30T22:26:34.441095+0000","last_fullsized":"2023-09-30T22:26:34.441095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460661+0000","last_change":"2023-09-30T22:26:34.457031+0000","last_active":"2023-09-30T22:26:34.460661+0000","last_peered":"2023-09-30T22:26:34.460661+0000","last_clean":"2023-09-30T22:26:34.460661+0000","last_became_active":"2023-09-30T22:26:34.456552+0000","last_became_peered":"2023-09-30T22:26:34.456552+0000","last_unstale":"2023-09-30T22:26:34.460661+0000","last_undegraded":"2023-09-30T22:26:34.460661+0000","last_fullsized":"2023-09-30T22:26:34.460661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459584+0000","last_change":"2023-09-30T22:26:34.456744+0000","last_active":"2023-09-30T22:26:34.459584+0000","last_peered":"2023-09-30T22:26:34.459584+0000","last_clean":"2023-09-30T22:26:34.459584+0000","last_became_active":"2023-09-30T22:26:34.456441+0000","last_became_peered":"2023-09-30T22:26:34.456441+0000","last_unstale":"2023-09-30T22:26:34.459584+0000","last_undegraded":"2023-09-30T22:26:34.459584+0000","last_fullsized":"2023-09-30T22:26:34.459584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459464+0000","last_change":"2023-09-30T22:26:34.454395+0000","last_active":"2023-09-30T22:26:34.459464+0000","last_peered":"2023-09-30T22:26:34.459464+0000","last_clean":"2023-09-30T22:26:34.459464+0000","last_became_active":"2023-09-30T22:26:34.454106+0000","last_became_peered":"2023-09-30T22:26:34.454106+0000","last_unstale":"2023-09-30T22:26:34.459464+0000","last_undegraded":"2023-09-30T22:26:34.459464+0000","last_fullsized":"2023-09-30T22:26:34.459464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454476+0000","last_change":"2023-09-30T22:26:34.446348+0000","last_active":"2023-09-30T22:26:34.454476+0000","last_peered":"2023-09-30T22:26:34.454476+0000","last_clean":"2023-09-30T22:26:34.454476+0000","last_became_active":"2023-09-30T22:26:34.444457+0000","last_became_peered":"2023-09-30T22:26:34.444457+0000","last_unstale":"2023-09-30T22:26:34.454476+0000","last_undegraded":"2023-09-30T22:26:34.454476+0000","last_fullsized":"2023-09-30T22:26:34.454476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454968+0000","last_change":"2023-09-30T22:26:34.450051+0000","last_active":"2023-09-30T22:26:34.454968+0000","last_peered":"2023-09-30T22:26:34.454968+0000","last_clean":"2023-09-30T22:26:34.454968+0000","last_became_active":"2023-09-30T22:26:34.449264+0000","last_became_peered":"2023-09-30T22:26:34.449264+0000","last_unstale":"2023-09-30T22:26:34.454968+0000","last_undegraded":"2023-09-30T22:26:34.454968+0000","last_fullsized":"2023-09-30T22:26:34.454968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471021+0000","last_change":"2023-09-30T22:26:34.463260+0000","last_active":"2023-09-30T22:26:34.471021+0000","last_peered":"2023-09-30T22:26:34.471021+0000","last_clean":"2023-09-30T22:26:34.471021+0000","last_became_active":"2023-09-30T22:26:34.462981+0000","last_became_peered":"2023-09-30T22:26:34.462981+0000","last_unstale":"2023-09-30T22:26:34.471021+0000","last_undegraded":"2023-09-30T22:26:34.471021+0000","last_fullsized":"2023-09-30T22:26:34.471021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.455028+0000","last_change":"2023-09-30T22:26:34.451111+0000","last_active":"2023-09-30T22:26:34.455028+0000","last_peered":"2023-09-30T22:26:34.455028+0000","last_clean":"2023-09-30T22:26:34.455028+0000","last_became_active":"2023-09-30T22:26:34.450521+0000","last_became_peered":"2023-09-30T22:26:34.450521+0000","last_unstale":"2023-09-30T22:26:34.455028+0000","last_undegraded":"2023-09-30T22:26:34.455028+0000","last_fullsized":"2023-09-30T22:26:34.455028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461140+0000","last_change":"2023-09-30T22:26:34.454512+0000","last_active":"2023-09-30T22:26:34.461140+0000","last_peered":"2023-09-30T22:26:34.461140+0000","last_clean":"2023-09-30T22:26:34.461140+0000","last_became_active":"2023-09-30T22:26:34.454222+0000","last_became_peered":"2023-09-30T22:26:34.454222+0000","last_unstale":"2023-09-30T22:26:34.461140+0000","last_undegraded":"2023-09-30T22:26:34.461140+0000","last_fullsized":"2023-09-30T22:26:34.461140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462004+0000","last_change":"2023-09-30T22:26:34.454698+0000","last_active":"2023-09-30T22:26:34.462004+0000","last_peered":"2023-09-30T22:26:34.462004+0000","last_clean":"2023-09-30T22:26:34.462004+0000","last_became_active":"2023-09-30T22:26:34.454060+0000","last_became_peered":"2023-09-30T22:26:34.454060+0000","last_unstale":"2023-09-30T22:26:34.462004+0000","last_undegraded":"2023-09-30T22:26:34.462004+0000","last_fullsized":"2023-09-30T22:26:34.462004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460500+0000","last_change":"2023-09-30T22:26:34.447740+0000","last_active":"2023-09-30T22:26:34.460500+0000","last_peered":"2023-09-30T22:26:34.460500+0000","last_clean":"2023-09-30T22:26:34.460500+0000","last_became_active":"2023-09-30T22:26:34.447444+0000","last_became_peered":"2023-09-30T22:26:34.447444+0000","last_unstale":"2023-09-30T22:26:34.460500+0000","last_undegraded":"2023-09-30T22:26:34.460500+0000","last_fullsized":"2023-09-30T22:26:34.460500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460341+0000","last_change":"2023-09-30T22:26:34.454342+0000","last_active":"2023-09-30T22:26:34.460341+0000","last_peered":"2023-09-30T22:26:34.460341+0000","last_clean":"2023-09-30T22:26:34.460341+0000","last_became_active":"2023-09-30T22:26:34.454063+0000","last_became_peered":"2023-09-30T22:26:34.454063+0000","last_unstale":"2023-09-30T22:26:34.460341+0000","last_undegraded":"2023-09-30T22:26:34.460341+0000","last_fullsized":"2023-09-30T22:26:34.460341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462123+0000","last_change":"2023-09-30T22:26:34.450497+0000","last_active":"2023-09-30T22:26:34.462123+0000","last_peered":"2023-09-30T22:26:34.462123+0000","last_clean":"2023-09-30T22:26:34.462123+0000","last_became_active":"2023-09-30T22:26:34.444267+0000","last_became_peered":"2023-09-30T22:26:34.444267+0000","last_unstale":"2023-09-30T22:26:34.462123+0000","last_undegraded":"2023-09-30T22:26:34.462123+0000","last_fullsized":"2023-09-30T22:26:34.462123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459426+0000","last_change":"2023-09-30T22:26:34.455898+0000","last_active":"2023-09-30T22:26:34.459426+0000","last_peered":"2023-09-30T22:26:34.459426+0000","last_clean":"2023-09-30T22:26:34.459426+0000","last_became_active":"2023-09-30T22:26:34.455631+0000","last_became_peered":"2023-09-30T22:26:34.455631+0000","last_unstale":"2023-09-30T22:26:34.459426+0000","last_undegraded":"2023-09-30T22:26:34.459426+0000","last_fullsized":"2023-09-30T22:26:34.459426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.452608+0000","last_change":"2023-09-30T22:26:34.447910+0000","last_active":"2023-09-30T22:26:34.452608+0000","last_peered":"2023-09-30T22:26:34.452608+0000","last_clean":"2023-09-30T22:26:34.452608+0000","last_became_active":"2023-09-30T22:26:34.447627+0000","last_became_peered":"2023-09-30T22:26:34.447627+0000","last_unstale":"2023-09-30T22:26:34.452608+0000","last_undegraded":"2023-09-30T22:26:34.452608+0000","last_fullsized":"2023-09-30T22:26:34.452608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.455048+0000","last_change":"2023-09-30T22:26:34.451250+0000","last_active":"2023-09-30T22:26:34.455048+0000","last_peered":"2023-09-30T22:26:34.455048+0000","last_clean":"2023-09-30T22:26:34.455048+0000","last_became_active":"2023-09-30T22:26:34.450879+0000","last_became_peered":"2023-09-30T22:26:34.450879+0000","last_unstale":"2023-09-30T22:26:34.455048+0000","last_undegraded":"2023-09-30T22:26:34.455048+0000","last_fullsized":"2023-09-30T22:26:34.455048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.446179+0000","last_change":"2023-09-30T22:26:34.440788+0000","last_active":"2023-09-30T22:26:34.446179+0000","last_peered":"2023-09-30T22:26:34.446179+0000","last_clean":"2023-09-30T22:26:34.446179+0000","last_became_active":"2023-09-30T22:26:34.440404+0000","last_became_peered":"2023-09-30T22:26:34.440404+0000","last_unstale":"2023-09-30T22:26:34.446179+0000","last_undegraded":"2023-09-30T22:26:34.446179+0000","last_fullsized":"2023-09-30T22:26:34.446179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459186+0000","last_change":"2023-09-30T22:26:34.445791+0000","last_active":"2023-09-30T22:26:34.459186+0000","last_peered":"2023-09-30T22:26:34.459186+0000","last_clean":"2023-09-30T22:26:34.459186+0000","last_became_active":"2023-09-30T22:26:34.445478+0000","last_became_peered":"2023-09-30T22:26:34.445478+0000","last_unstale":"2023-09-30T22:26:34.459186+0000","last_undegraded":"2023-09-30T22:26:34.459186+0000","last_fullsized":"2023-09-30T22:26:34.459186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460680+0000","last_change":"2023-09-30T22:26:34.453484+0000","last_active":"2023-09-30T22:26:34.460680+0000","last_peered":"2023-09-30T22:26:34.460680+0000","last_clean":"2023-09-30T22:26:34.460680+0000","last_became_active":"2023-09-30T22:26:34.453179+0000","last_became_peered":"2023-09-30T22:26:34.453179+0000","last_unstale":"2023-09-30T22:26:34.460680+0000","last_undegraded":"2023-09-30T22:26:34.460680+0000","last_fullsized":"2023-09-30T22:26:34.460680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.468703+0000","last_change":"2023-09-30T22:26:34.457382+0000","last_active":"2023-09-30T22:26:34.468703+0000","last_peered":"2023-09-30T22:26:34.468703+0000","last_clean":"2023-09-30T22:26:34.468703+0000","last_became_active":"2023-09-30T22:26:34.457077+0000","last_became_peered":"2023-09-30T22:26:34.457077+0000","last_unstale":"2023-09-30T22:26:34.468703+0000","last_undegraded":"2023-09-30T22:26:34.468703+0000","last_fullsized":"2023-09-30T22:26:34.468703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470286+0000","last_change":"2023-09-30T22:26:34.465060+0000","last_active":"2023-09-30T22:26:34.470286+0000","last_peered":"2023-09-30T22:26:34.470286+0000","last_clean":"2023-09-30T22:26:34.470286+0000","last_became_active":"2023-09-30T22:26:34.464780+0000","last_became_peered":"2023-09-30T22:26:34.464780+0000","last_unstale":"2023-09-30T22:26:34.470286+0000","last_undegraded":"2023-09-30T22:26:34.470286+0000","last_fullsized":"2023-09-30T22:26:34.470286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454945+0000","last_change":"2023-09-30T22:26:34.449871+0000","last_active":"2023-09-30T22:26:34.454945+0000","last_peered":"2023-09-30T22:26:34.454945+0000","last_clean":"2023-09-30T22:26:34.454945+0000","last_became_active":"2023-09-30T22:26:34.448901+0000","last_became_peered":"2023-09-30T22:26:34.448901+0000","last_unstale":"2023-09-30T22:26:34.454945+0000","last_undegraded":"2023-09-30T22:26:34.454945+0000","last_fullsized":"2023-09-30T22:26:34.454945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470966+0000","last_change":"2023-09-30T22:26:34.463255+0000","last_active":"2023-09-30T22:26:34.470966+0000","last_peered":"2023-09-30T22:26:34.470966+0000","last_clean":"2023-09-30T22:26:34.470966+0000","last_became_active":"2023-09-30T22:26:34.462962+0000","last_became_peered":"2023-09-30T22:26:34.462962+0000","last_unstale":"2023-09-30T22:26:34.470966+0000","last_undegraded":"2023-09-30T22:26:34.470966+0000","last_fullsized":"2023-09-30T22:26:34.470966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470761+0000","last_change":"2023-09-30T22:26:34.458476+0000","last_active":"2023-09-30T22:26:34.470761+0000","last_peered":"2023-09-30T22:26:34.470761+0000","last_clean":"2023-09-30T22:26:34.470761+0000","last_became_active":"2023-09-30T22:26:34.458195+0000","last_became_peered":"2023-09-30T22:26:34.458195+0000","last_unstale":"2023-09-30T22:26:34.470761+0000","last_undegraded":"2023-09-30T22:26:34.470761+0000","last_fullsized":"2023-09-30T22:26:34.470761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.450508+0000","last_change":"2023-09-30T22:26:34.441003+0000","last_active":"2023-09-30T22:26:34.450508+0000","last_peered":"2023-09-30T22:26:34.450508+0000","last_clean":"2023-09-30T22:26:34.450508+0000","last_became_active":"2023-09-30T22:26:34.440470+0000","last_became_peered":"2023-09-30T22:26:34.440470+0000","last_unstale":"2023-09-30T22:26:34.450508+0000","last_undegraded":"2023-09-30T22:26:34.450508+0000","last_fullsized":"2023-09-30T22:26:34.450508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.456686+0000","last_change":"2023-09-30T22:26:34.448801+0000","last_active":"2023-09-30T22:26:34.456686+0000","last_peered":"2023-09-30T22:26:34.456686+0000","last_clean":"2023-09-30T22:26:34.456686+0000","last_became_active":"2023-09-30T22:26:34.448176+0000","last_became_peered":"2023-09-30T22:26:34.448176+0000","last_unstale":"2023-09-30T22:26:34.456686+0000","last_undegraded":"2023-09-30T22:26:34.456686+0000","last_fullsized":"2023-09-30T22:26:34.456686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471250+0000","last_change":"2023-09-30T22:26:34.031319+0000","last_active":"2023-09-30T22:26:34.471250+0000","last_peered":"2023-09-30T22:26:34.471250+0000","last_clean":"2023-09-30T22:26:34.471250+0000","last_became_active":"2023-09-30T22:26:34.030475+0000","last_became_peered":"2023-09-30T22:26:34.030475+0000","last_unstale":"2023-09-30T22:26:34.471250+0000","last_undegraded":"2023-09-30T22:26:34.471250+0000","last_fullsized":"2023-09-30T22:26:34.471250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463494+0000","last_change":"2023-09-30T22:26:34.459834+0000","last_active":"2023-09-30T22:26:34.463494+0000","last_peered":"2023-09-30T22:26:34.463494+0000","last_clean":"2023-09-30T22:26:34.463494+0000","last_became_active":"2023-09-30T22:26:34.459291+0000","last_became_peered":"2023-09-30T22:26:34.459291+0000","last_unstale":"2023-09-30T22:26:34.463494+0000","last_undegraded":"2023-09-30T22:26:34.463494+0000","last_fullsized":"2023-09-30T22:26:34.463494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.428859+0000","last_change":"2023-09-30T22:26:34.036944+0000","last_active":"2023-09-30T22:26:34.428859+0000","last_peered":"2023-09-30T22:26:34.428859+0000","last_clean":"2023-09-30T22:26:34.428859+0000","last_became_active":"2023-09-30T22:26:34.036564+0000","last_became_peered":"2023-09-30T22:26:34.036564+0000","last_unstale":"2023-09-30T22:26:34.428859+0000","last_undegraded":"2023-09-30T22:26:34.428859+0000","last_fullsized":"2023-09-30T22:26:34.428859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.468638+0000","last_change":"2023-09-30T22:26:34.464712+0000","last_active":"2023-09-30T22:26:34.468638+0000","last_peered":"2023-09-30T22:26:34.468638+0000","last_clean":"2023-09-30T22:26:34.468638+0000","last_became_active":"2023-09-30T22:26:34.464032+0000","last_became_peered":"2023-09-30T22:26:34.464032+0000","last_unstale":"2023-09-30T22:26:34.468638+0000","last_undegraded":"2023-09-30T22:26:34.468638+0000","last_fullsized":"2023-09-30T22:26:34.468638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423659+0000","last_change":"2023-09-30T22:26:34.041116+0000","last_active":"2023-09-30T22:26:34.423659+0000","last_peered":"2023-09-30T22:26:34.423659+0000","last_clean":"2023-09-30T22:26:34.423659+0000","last_became_active":"2023-09-30T22:26:34.040484+0000","last_became_peered":"2023-09-30T22:26:34.040484+0000","last_unstale":"2023-09-30T22:26:34.423659+0000","last_undegraded":"2023-09-30T22:26:34.423659+0000","last_fullsized":"2023-09-30T22:26:34.423659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466426+0000","last_change":"2023-09-30T22:26:34.461558+0000","last_active":"2023-09-30T22:26:34.466426+0000","last_peered":"2023-09-30T22:26:34.466426+0000","last_clean":"2023-09-30T22:26:34.466426+0000","last_became_active":"2023-09-30T22:26:34.461274+0000","last_became_peered":"2023-09-30T22:26:34.461274+0000","last_unstale":"2023-09-30T22:26:34.466426+0000","last_undegraded":"2023-09-30T22:26:34.466426+0000","last_fullsized":"2023-09-30T22:26:34.466426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423512+0000","last_change":"2023-09-30T22:26:34.026179+0000","last_active":"2023-09-30T22:26:34.423512+0000","last_peered":"2023-09-30T22:26:34.423512+0000","last_clean":"2023-09-30T22:26:34.423512+0000","last_became_active":"2023-09-30T22:26:34.025896+0000","last_became_peered":"2023-09-30T22:26:34.025896+0000","last_unstale":"2023-09-30T22:26:34.423512+0000","last_undegraded":"2023-09-30T22:26:34.423512+0000","last_fullsized":"2023-09-30T22:26:34.423512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.469966+0000","last_change":"2023-09-30T22:26:34.461868+0000","last_active":"2023-09-30T22:26:34.469966+0000","last_peered":"2023-09-30T22:26:34.469966+0000","last_clean":"2023-09-30T22:26:34.469966+0000","last_became_active":"2023-09-30T22:26:34.458462+0000","last_became_peered":"2023-09-30T22:26:34.458462+0000","last_unstale":"2023-09-30T22:26:34.469966+0000","last_undegraded":"2023-09-30T22:26:34.469966+0000","last_fullsized":"2023-09-30T22:26:34.469966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.431770+0000","last_change":"2023-09-30T22:26:34.034800+0000","last_active":"2023-09-30T22:26:34.431770+0000","last_peered":"2023-09-30T22:26:34.431770+0000","last_clean":"2023-09-30T22:26:34.431770+0000","last_became_active":"2023-09-30T22:26:34.034161+0000","last_became_peered":"2023-09-30T22:26:34.034161+0000","last_unstale":"2023-09-30T22:26:34.431770+0000","last_undegraded":"2023-09-30T22:26:34.431770+0000","last_fullsized":"2023-09-30T22:26:34.431770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454988+0000","last_change":"2023-09-30T22:26:34.450219+0000","last_active":"2023-09-30T22:26:34.454988+0000","last_peered":"2023-09-30T22:26:34.454988+0000","last_clean":"2023-09-30T22:26:34.454988+0000","last_became_active":"2023-09-30T22:26:34.449611+0000","last_became_peered":"2023-09-30T22:26:34.449611+0000","last_unstale":"2023-09-30T22:26:34.454988+0000","last_undegraded":"2023-09-30T22:26:34.454988+0000","last_fullsized":"2023-09-30T22:26:34.454988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460602+0000","last_change":"2023-09-30T22:26:34.037459+0000","last_active":"2023-09-30T22:26:34.460602+0000","last_peered":"2023-09-30T22:26:34.460602+0000","last_clean":"2023-09-30T22:26:34.460602+0000","last_became_active":"2023-09-30T22:26:34.037268+0000","last_became_peered":"2023-09-30T22:26:34.037268+0000","last_unstale":"2023-09-30T22:26:34.460602+0000","last_undegraded":"2023-09-30T22:26:34.460602+0000","last_fullsized":"2023-09-30T22:26:34.460602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470919+0000","last_change":"2023-09-30T22:26:34.462289+0000","last_active":"2023-09-30T22:26:34.470919+0000","last_peered":"2023-09-30T22:26:34.470919+0000","last_clean":"2023-09-30T22:26:34.470919+0000","last_became_active":"2023-09-30T22:26:34.461927+0000","last_became_peered":"2023-09-30T22:26:34.461927+0000","last_unstale":"2023-09-30T22:26:34.470919+0000","last_undegraded":"2023-09-30T22:26:34.470919+0000","last_fullsized":"2023-09-30T22:26:34.470919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470074+0000","last_change":"2023-09-30T22:26:34.040307+0000","last_active":"2023-09-30T22:26:34.470074+0000","last_peered":"2023-09-30T22:26:34.470074+0000","last_clean":"2023-09-30T22:26:34.470074+0000","last_became_active":"2023-09-30T22:26:34.040017+0000","last_became_peered":"2023-09-30T22:26:34.040017+0000","last_unstale":"2023-09-30T22:26:34.470074+0000","last_undegraded":"2023-09-30T22:26:34.470074+0000","last_fullsized":"2023-09-30T22:26:34.470074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460303+0000","last_change":"2023-09-30T22:26:34.453373+0000","last_active":"2023-09-30T22:26:34.460303+0000","last_peered":"2023-09-30T22:26:34.460303+0000","last_clean":"2023-09-30T22:26:34.460303+0000","last_became_active":"2023-09-30T22:26:34.453075+0000","last_became_peered":"2023-09-30T22:26:34.453075+0000","last_unstale":"2023-09-30T22:26:34.460303+0000","last_undegraded":"2023-09-30T22:26:34.460303+0000","last_fullsized":"2023-09-30T22:26:34.460303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460377+0000","last_change":"2023-09-30T22:26:34.042269+0000","last_active":"2023-09-30T22:26:34.460377+0000","last_peered":"2023-09-30T22:26:34.460377+0000","last_clean":"2023-09-30T22:26:34.460377+0000","last_became_active":"2023-09-30T22:26:34.040124+0000","last_became_peered":"2023-09-30T22:26:34.040124+0000","last_unstale":"2023-09-30T22:26:34.460377+0000","last_undegraded":"2023-09-30T22:26:34.460377+0000","last_fullsized":"2023-09-30T22:26:34.460377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.465633+0000","last_change":"2023-09-30T22:26:34.459725+0000","last_active":"2023-09-30T22:26:34.465633+0000","last_peered":"2023-09-30T22:26:34.465633+0000","last_clean":"2023-09-30T22:26:34.465633+0000","last_became_active":"2023-09-30T22:26:34.459414+0000","last_became_peered":"2023-09-30T22:26:34.459414+0000","last_unstale":"2023-09-30T22:26:34.465633+0000","last_undegraded":"2023-09-30T22:26:34.465633+0000","last_fullsized":"2023-09-30T22:26:34.465633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.424477+0000","last_change":"2023-09-30T22:26:34.024931+0000","last_active":"2023-09-30T22:26:34.424477+0000","last_peered":"2023-09-30T22:26:34.424477+0000","last_clean":"2023-09-30T22:26:34.424477+0000","last_became_active":"2023-09-30T22:26:34.024616+0000","last_became_peered":"2023-09-30T22:26:34.024616+0000","last_unstale":"2023-09-30T22:26:34.424477+0000","last_undegraded":"2023-09-30T22:26:34.424477+0000","last_fullsized":"2023-09-30T22:26:34.424477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.456615+0000","last_change":"2023-09-30T22:26:34.451564+0000","last_active":"2023-09-30T22:26:34.456615+0000","last_peered":"2023-09-30T22:26:34.456615+0000","last_clean":"2023-09-30T22:26:34.456615+0000","last_became_active":"2023-09-30T22:26:34.448514+0000","last_became_peered":"2023-09-30T22:26:34.448514+0000","last_unstale":"2023-09-30T22:26:34.456615+0000","last_undegraded":"2023-09-30T22:26:34.456615+0000","last_fullsized":"2023-09-30T22:26:34.456615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.425637+0000","last_change":"2023-09-30T22:26:34.040402+0000","last_active":"2023-09-30T22:26:34.425637+0000","last_peered":"2023-09-30T22:26:34.425637+0000","last_clean":"2023-09-30T22:26:34.425637+0000","last_became_active":"2023-09-30T22:26:34.039702+0000","last_became_peered":"2023-09-30T22:26:34.039702+0000","last_unstale":"2023-09-30T22:26:34.425637+0000","last_undegraded":"2023-09-30T22:26:34.425637+0000","last_fullsized":"2023-09-30T22:26:34.425637+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454847+0000","last_change":"2023-09-30T22:26:34.450058+0000","last_active":"2023-09-30T22:26:34.454847+0000","last_peered":"2023-09-30T22:26:34.454847+0000","last_clean":"2023-09-30T22:26:34.454847+0000","last_became_active":"2023-09-30T22:26:34.449698+0000","last_became_peered":"2023-09-30T22:26:34.449698+0000","last_unstale":"2023-09-30T22:26:34.454847+0000","last_undegraded":"2023-09-30T22:26:34.454847+0000","last_fullsized":"2023-09-30T22:26:34.454847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471717+0000","last_change":"2023-09-30T22:26:34.041826+0000","last_active":"2023-09-30T22:26:34.471717+0000","last_peered":"2023-09-30T22:26:34.471717+0000","last_clean":"2023-09-30T22:26:34.471717+0000","last_became_active":"2023-09-30T22:26:34.041527+0000","last_became_peered":"2023-09-30T22:26:34.041527+0000","last_unstale":"2023-09-30T22:26:34.471717+0000","last_undegraded":"2023-09-30T22:26:34.471717+0000","last_fullsized":"2023-09-30T22:26:34.471717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466408+0000","last_change":"2023-09-30T22:26:34.461435+0000","last_active":"2023-09-30T22:26:34.466408+0000","last_peered":"2023-09-30T22:26:34.466408+0000","last_clean":"2023-09-30T22:26:34.466408+0000","last_became_active":"2023-09-30T22:26:34.461089+0000","last_became_peered":"2023-09-30T22:26:34.461089+0000","last_unstale":"2023-09-30T22:26:34.466408+0000","last_undegraded":"2023-09-30T22:26:34.466408+0000","last_fullsized":"2023-09-30T22:26:34.466408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471028+0000","last_change":"2023-09-30T22:26:34.030071+0000","last_active":"2023-09-30T22:26:34.471028+0000","last_peered":"2023-09-30T22:26:34.471028+0000","last_clean":"2023-09-30T22:26:34.471028+0000","last_became_active":"2023-09-30T22:26:34.029419+0000","last_became_peered":"2023-09-30T22:26:34.029419+0000","last_unstale":"2023-09-30T22:26:34.471028+0000","last_undegraded":"2023-09-30T22:26:34.471028+0000","last_fullsized":"2023-09-30T22:26:34.471028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470012+0000","last_change":"2023-09-30T22:26:34.462138+0000","last_active":"2023-09-30T22:26:34.470012+0000","last_peered":"2023-09-30T22:26:34.470012+0000","last_clean":"2023-09-30T22:26:34.470012+0000","last_became_active":"2023-09-30T22:26:34.461046+0000","last_became_peered":"2023-09-30T22:26:34.461046+0000","last_unstale":"2023-09-30T22:26:34.470012+0000","last_undegraded":"2023-09-30T22:26:34.470012+0000","last_fullsized":"2023-09-30T22:26:34.470012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.446894+0000","last_change":"2023-09-30T22:26:34.024286+0000","last_active":"2023-09-30T22:26:34.446894+0000","last_peered":"2023-09-30T22:26:34.446894+0000","last_clean":"2023-09-30T22:26:34.446894+0000","last_became_active":"2023-09-30T22:26:34.022989+0000","last_became_peered":"2023-09-30T22:26:34.022989+0000","last_unstale":"2023-09-30T22:26:34.446894+0000","last_undegraded":"2023-09-30T22:26:34.446894+0000","last_fullsized":"2023-09-30T22:26:34.446894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461265+0000","last_change":"2023-09-30T22:26:34.453594+0000","last_active":"2023-09-30T22:26:34.461265+0000","last_peered":"2023-09-30T22:26:34.461265+0000","last_clean":"2023-09-30T22:26:34.461265+0000","last_became_active":"2023-09-30T22:26:34.453288+0000","last_became_peered":"2023-09-30T22:26:34.453288+0000","last_unstale":"2023-09-30T22:26:34.461265+0000","last_undegraded":"2023-09-30T22:26:34.461265+0000","last_fullsized":"2023-09-30T22:26:34.461265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.465754+0000","last_change":"2023-09-30T22:26:34.042026+0000","last_active":"2023-09-30T22:26:34.465754+0000","last_peered":"2023-09-30T22:26:34.465754+0000","last_clean":"2023-09-30T22:26:34.465754+0000","last_became_active":"2023-09-30T22:26:34.041309+0000","last_became_peered":"2023-09-30T22:26:34.041309+0000","last_unstale":"2023-09-30T22:26:34.465754+0000","last_undegraded":"2023-09-30T22:26:34.465754+0000","last_fullsized":"2023-09-30T22:26:34.465754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460615+0000","last_change":"2023-09-30T22:26:34.448356+0000","last_active":"2023-09-30T22:26:34.460615+0000","last_peered":"2023-09-30T22:26:34.460615+0000","last_clean":"2023-09-30T22:26:34.460615+0000","last_became_active":"2023-09-30T22:26:34.447744+0000","last_became_peered":"2023-09-30T22:26:34.447744+0000","last_unstale":"2023-09-30T22:26:34.460615+0000","last_undegraded":"2023-09-30T22:26:34.460615+0000","last_fullsized":"2023-09-30T22:26:34.460615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.422389+0000","last_change":"2023-09-30T22:26:34.025526+0000","last_active":"2023-09-30T22:26:34.422389+0000","last_peered":"2023-09-30T22:26:34.422389+0000","last_clean":"2023-09-30T22:26:34.422389+0000","last_became_active":"2023-09-30T22:26:34.025214+0000","last_became_peered":"2023-09-30T22:26:34.025214+0000","last_unstale":"2023-09-30T22:26:34.422389+0000","last_undegraded":"2023-09-30T22:26:34.422389+0000","last_fullsized":"2023-09-30T22:26:34.422389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459520+0000","last_change":"2023-09-30T22:26:34.457634+0000","last_active":"2023-09-30T22:26:34.459520+0000","last_peered":"2023-09-30T22:26:34.459520+0000","last_clean":"2023-09-30T22:26:34.459520+0000","last_became_active":"2023-09-30T22:26:34.457314+0000","last_became_peered":"2023-09-30T22:26:34.457314+0000","last_unstale":"2023-09-30T22:26:34.459520+0000","last_undegraded":"2023-09-30T22:26:34.459520+0000","last_fullsized":"2023-09-30T22:26:34.459520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461205+0000","last_change":"2023-09-30T22:26:34.042476+0000","last_active":"2023-09-30T22:26:34.461205+0000","last_peered":"2023-09-30T22:26:34.461205+0000","last_clean":"2023-09-30T22:26:34.461205+0000","last_became_active":"2023-09-30T22:26:34.040552+0000","last_became_peered":"2023-09-30T22:26:34.040552+0000","last_unstale":"2023-09-30T22:26:34.461205+0000","last_undegraded":"2023-09-30T22:26:34.461205+0000","last_fullsized":"2023-09-30T22:26:34.461205+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454805+0000","last_change":"2023-09-30T22:26:34.451427+0000","last_active":"2023-09-30T22:26:34.454805+0000","last_peered":"2023-09-30T22:26:34.454805+0000","last_clean":"2023-09-30T22:26:34.454805+0000","last_became_active":"2023-09-30T22:26:34.451149+0000","last_became_peered":"2023-09-30T22:26:34.451149+0000","last_unstale":"2023-09-30T22:26:34.454805+0000","last_undegraded":"2023-09-30T22:26:34.454805+0000","last_fullsized":"2023-09-30T22:26:34.454805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423902+0000","last_change":"2023-09-30T22:26:34.039863+0000","last_active":"2023-09-30T22:26:34.423902+0000","last_peered":"2023-09-30T22:26:34.423902+0000","last_clean":"2023-09-30T22:26:34.423902+0000","last_became_active":"2023-09-30T22:26:34.039536+0000","last_became_peered":"2023-09-30T22:26:34.039536+0000","last_unstale":"2023-09-30T22:26:34.423902+0000","last_undegraded":"2023-09-30T22:26:34.423902+0000","last_fullsized":"2023-09-30T22:26:34.423902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463474+0000","last_change":"2023-09-30T22:26:34.459623+0000","last_active":"2023-09-30T22:26:34.463474+0000","last_peered":"2023-09-30T22:26:34.463474+0000","last_clean":"2023-09-30T22:26:34.463474+0000","last_became_active":"2023-09-30T22:26:34.457887+0000","last_became_peered":"2023-09-30T22:26:34.457887+0000","last_unstale":"2023-09-30T22:26:34.463474+0000","last_undegraded":"2023-09-30T22:26:34.463474+0000","last_fullsized":"2023-09-30T22:26:34.463474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.425122+0000","last_change":"2023-09-30T22:26:34.040793+0000","last_active":"2023-09-30T22:26:34.425122+0000","last_peered":"2023-09-30T22:26:34.425122+0000","last_clean":"2023-09-30T22:26:34.425122+0000","last_became_active":"2023-09-30T22:26:34.040437+0000","last_became_peered":"2023-09-30T22:26:34.040437+0000","last_unstale":"2023-09-30T22:26:34.425122+0000","last_undegraded":"2023-09-30T22:26:34.425122+0000","last_fullsized":"2023-09-30T22:26:34.425122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460680+0000","last_change":"2023-09-30T22:26:34.446474+0000","last_active":"2023-09-30T22:26:34.460680+0000","last_peered":"2023-09-30T22:26:34.460680+0000","last_clean":"2023-09-30T22:26:34.460680+0000","last_became_active":"2023-09-30T22:26:34.445499+0000","last_became_peered":"2023-09-30T22:26:34.445499+0000","last_unstale":"2023-09-30T22:26:34.460680+0000","last_undegraded":"2023-09-30T22:26:34.460680+0000","last_fullsized":"2023-09-30T22:26:34.460680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423262+0000","last_change":"2023-09-30T22:26:34.040910+0000","last_active":"2023-09-30T22:26:34.423262+0000","last_peered":"2023-09-30T22:26:34.423262+0000","last_clean":"2023-09-30T22:26:34.423262+0000","last_became_active":"2023-09-30T22:26:34.040077+0000","last_became_peered":"2023-09-30T22:26:34.040077+0000","last_unstale":"2023-09-30T22:26:34.423262+0000","last_undegraded":"2023-09-30T22:26:34.423262+0000","last_fullsized":"2023-09-30T22:26:34.423262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471281+0000","last_change":"2023-09-30T22:26:34.466480+0000","last_active":"2023-09-30T22:26:34.471281+0000","last_peered":"2023-09-30T22:26:34.471281+0000","last_clean":"2023-09-30T22:26:34.471281+0000","last_became_active":"2023-09-30T22:26:34.466187+0000","last_became_peered":"2023-09-30T22:26:34.466187+0000","last_unstale":"2023-09-30T22:26:34.471281+0000","last_undegraded":"2023-09-30T22:26:34.471281+0000","last_fullsized":"2023-09-30T22:26:34.471281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.440724+0000","last_change":"2023-09-30T22:26:30.873307+0000","last_active":"2023-09-30T22:26:34.440724+0000","last_peered":"2023-09-30T22:26:34.440724+0000","last_clean":"2023-09-30T22:26:34.440724+0000","last_became_active":"2023-09-30T22:26:30.872872+0000","last_became_peered":"2023-09-30T22:26:30.872872+0000","last_unstale":"2023-09-30T22:26:34.440724+0000","last_undegraded":"2023-09-30T22:26:34.440724+0000","last_fullsized":"2023-09-30T22:26:34.440724+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.428047+0000","last_change":"2023-09-30T22:26:34.037332+0000","last_active":"2023-09-30T22:26:34.428047+0000","last_peered":"2023-09-30T22:26:34.428047+0000","last_clean":"2023-09-30T22:26:34.428047+0000","last_became_active":"2023-09-30T22:26:34.037114+0000","last_became_peered":"2023-09-30T22:26:34.037114+0000","last_unstale":"2023-09-30T22:26:34.428047+0000","last_undegraded":"2023-09-30T22:26:34.428047+0000","last_fullsized":"2023-09-30T22:26:34.428047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470943+0000","last_change":"2023-09-30T22:26:34.462485+0000","last_active":"2023-09-30T22:26:34.470943+0000","last_peered":"2023-09-30T22:26:34.470943+0000","last_clean":"2023-09-30T22:26:34.470943+0000","last_became_active":"2023-09-30T22:26:34.454284+0000","last_became_peered":"2023-09-30T22:26:34.454284+0000","last_unstale":"2023-09-30T22:26:34.470943+0000","last_undegraded":"2023-09-30T22:26:34.470943+0000","last_fullsized":"2023-09-30T22:26:34.470943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.424003+0000","last_change":"2023-09-30T22:26:29.861644+0000","last_active":"2023-09-30T22:26:34.424003+0000","last_peered":"2023-09-30T22:26:34.424003+0000","last_clean":"2023-09-30T22:26:34.424003+0000","last_became_active":"2023-09-30T22:26:29.861261+0000","last_became_peered":"2023-09-30T22:26:29.861261+0000","last_unstale":"2023-09-30T22:26:34.424003+0000","last_undegraded":"2023-09-30T22:26:34.424003+0000","last_fullsized":"2023-09-30T22:26:34.424003+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.432400+0000","last_change":"2023-09-30T22:26:34.024242+0000","last_active":"2023-09-30T22:26:34.432400+0000","last_peered":"2023-09-30T22:26:34.432400+0000","last_clean":"2023-09-30T22:26:34.432400+0000","last_became_active":"2023-09-30T22:26:34.023935+0000","last_became_peered":"2023-09-30T22:26:34.023935+0000","last_unstale":"2023-09-30T22:26:34.432400+0000","last_undegraded":"2023-09-30T22:26:34.432400+0000","last_fullsized":"2023-09-30T22:26:34.432400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460658+0000","last_change":"2023-09-30T22:26:34.444993+0000","last_active":"2023-09-30T22:26:34.460658+0000","last_peered":"2023-09-30T22:26:34.460658+0000","last_clean":"2023-09-30T22:26:34.460658+0000","last_became_active":"2023-09-30T22:26:34.444739+0000","last_became_peered":"2023-09-30T22:26:34.444739+0000","last_unstale":"2023-09-30T22:26:34.460658+0000","last_undegraded":"2023-09-30T22:26:34.460658+0000","last_fullsized":"2023-09-30T22:26:34.460658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.427254+0000","last_change":"2023-09-30T22:26:29.858340+0000","last_active":"2023-09-30T22:26:34.427254+0000","last_peered":"2023-09-30T22:26:34.427254+0000","last_clean":"2023-09-30T22:26:34.427254+0000","last_became_active":"2023-09-30T22:26:29.857989+0000","last_became_peered":"2023-09-30T22:26:29.857989+0000","last_unstale":"2023-09-30T22:26:34.427254+0000","last_undegraded":"2023-09-30T22:26:34.427254+0000","last_fullsized":"2023-09-30T22:26:34.427254+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429669+0000","last_change":"2023-09-30T22:26:34.031173+0000","last_active":"2023-09-30T22:26:34.429669+0000","last_peered":"2023-09-30T22:26:34.429669+0000","last_clean":"2023-09-30T22:26:34.429669+0000","last_became_active":"2023-09-30T22:26:34.030863+0000","last_became_peered":"2023-09-30T22:26:34.030863+0000","last_unstale":"2023-09-30T22:26:34.429669+0000","last_undegraded":"2023-09-30T22:26:34.429669+0000","last_fullsized":"2023-09-30T22:26:34.429669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462678+0000","last_change":"2023-09-30T22:26:34.456017+0000","last_active":"2023-09-30T22:26:34.462678+0000","last_peered":"2023-09-30T22:26:34.462678+0000","last_clean":"2023-09-30T22:26:34.462678+0000","last_became_active":"2023-09-30T22:26:34.455744+0000","last_became_peered":"2023-09-30T22:26:34.455744+0000","last_unstale":"2023-09-30T22:26:34.462678+0000","last_undegraded":"2023-09-30T22:26:34.462678+0000","last_fullsized":"2023-09-30T22:26:34.462678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423631+0000","last_change":"2023-09-30T22:26:29.859074+0000","last_active":"2023-09-30T22:26:34.423631+0000","last_peered":"2023-09-30T22:26:34.423631+0000","last_clean":"2023-09-30T22:26:34.423631+0000","last_became_active":"2023-09-30T22:26:29.858669+0000","last_became_peered":"2023-09-30T22:26:29.858669+0000","last_unstale":"2023-09-30T22:26:34.423631+0000","last_undegraded":"2023-09-30T22:26:34.423631+0000","last_fullsized":"2023-09-30T22:26:34.423631+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429553+0000","last_change":"2023-09-30T22:26:28.864097+0000","last_active":"2023-09-30T22:26:34.429553+0000","last_peered":"2023-09-30T22:26:34.429553+0000","last_clean":"2023-09-30T22:26:34.429553+0000","last_became_active":"2023-09-30T22:26:28.863723+0000","last_became_peered":"2023-09-30T22:26:28.863723+0000","last_unstale":"2023-09-30T22:26:34.429553+0000","last_undegraded":"2023-09-30T22:26:34.429553+0000","last_fullsized":"2023-09-30T22:26:34.429553+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_clean_scrub_stamp":"2023-09-30T22:26:27.842299+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423778+0000","last_change":"2023-09-30T22:26:34.040465+0000","last_active":"2023-09-30T22:26:34.423778+0000","last_peered":"2023-09-30T22:26:34.423778+0000","last_clean":"2023-09-30T22:26:34.423778+0000","last_became_active":"2023-09-30T22:26:34.039806+0000","last_became_peered":"2023-09-30T22:26:34.039806+0000","last_unstale":"2023-09-30T22:26:34.423778+0000","last_undegraded":"2023-09-30T22:26:34.423778+0000","last_fullsized":"2023-09-30T22:26:34.423778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463514+0000","last_change":"2023-09-30T22:26:34.459817+0000","last_active":"2023-09-30T22:26:34.463514+0000","last_peered":"2023-09-30T22:26:34.463514+0000","last_clean":"2023-09-30T22:26:34.463514+0000","last_became_active":"2023-09-30T22:26:34.458434+0000","last_became_peered":"2023-09-30T22:26:34.458434+0000","last_unstale":"2023-09-30T22:26:34.463514+0000","last_undegraded":"2023-09-30T22:26:34.463514+0000","last_fullsized":"2023-09-30T22:26:34.463514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.423531+0000","last_change":"2023-09-30T22:26:29.861337+0000","last_active":"2023-09-30T22:26:34.423531+0000","last_peered":"2023-09-30T22:26:34.423531+0000","last_clean":"2023-09-30T22:26:34.423531+0000","last_became_active":"2023-09-30T22:26:29.861003+0000","last_became_peered":"2023-09-30T22:26:29.861003+0000","last_unstale":"2023-09-30T22:26:34.423531+0000","last_undegraded":"2023-09-30T22:26:34.423531+0000","last_fullsized":"2023-09-30T22:26:34.423531+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.426034+0000","last_change":"2023-09-30T22:26:34.022924+0000","last_active":"2023-09-30T22:26:34.426034+0000","last_peered":"2023-09-30T22:26:34.426034+0000","last_clean":"2023-09-30T22:26:34.426034+0000","last_became_active":"2023-09-30T22:26:34.022592+0000","last_became_peered":"2023-09-30T22:26:34.022592+0000","last_unstale":"2023-09-30T22:26:34.426034+0000","last_undegraded":"2023-09-30T22:26:34.426034+0000","last_fullsized":"2023-09-30T22:26:34.426034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.470264+0000","last_change":"2023-09-30T22:26:34.464915+0000","last_active":"2023-09-30T22:26:34.470264+0000","last_peered":"2023-09-30T22:26:34.470264+0000","last_clean":"2023-09-30T22:26:34.470264+0000","last_became_active":"2023-09-30T22:26:34.464406+0000","last_became_peered":"2023-09-30T22:26:34.464406+0000","last_unstale":"2023-09-30T22:26:34.470264+0000","last_undegraded":"2023-09-30T22:26:34.470264+0000","last_fullsized":"2023-09-30T22:26:34.470264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.426359+0000","last_change":"2023-09-30T22:26:30.874397+0000","last_active":"2023-09-30T22:26:34.426359+0000","last_peered":"2023-09-30T22:26:34.426359+0000","last_clean":"2023-09-30T22:26:34.426359+0000","last_became_active":"2023-09-30T22:26:30.874057+0000","last_became_peered":"2023-09-30T22:26:30.874057+0000","last_unstale":"2023-09-30T22:26:34.426359+0000","last_undegraded":"2023-09-30T22:26:34.426359+0000","last_fullsized":"2023-09-30T22:26:34.426359+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429371+0000","last_change":"2023-09-30T22:26:34.037126+0000","last_active":"2023-09-30T22:26:34.429371+0000","last_peered":"2023-09-30T22:26:34.429371+0000","last_clean":"2023-09-30T22:26:34.429371+0000","last_became_active":"2023-09-30T22:26:34.036825+0000","last_became_peered":"2023-09-30T22:26:34.036825+0000","last_unstale":"2023-09-30T22:26:34.429371+0000","last_undegraded":"2023-09-30T22:26:34.429371+0000","last_fullsized":"2023-09-30T22:26:34.429371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.446597+0000","last_change":"2023-09-30T22:26:34.443381+0000","last_active":"2023-09-30T22:26:34.446597+0000","last_peered":"2023-09-30T22:26:34.446597+0000","last_clean":"2023-09-30T22:26:34.446597+0000","last_became_active":"2023-09-30T22:26:34.443094+0000","last_became_peered":"2023-09-30T22:26:34.443094+0000","last_unstale":"2023-09-30T22:26:34.446597+0000","last_undegraded":"2023-09-30T22:26:34.446597+0000","last_fullsized":"2023-09-30T22:26:34.446597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466600+0000","last_change":"2023-09-30T22:26:34.041060+0000","last_active":"2023-09-30T22:26:34.466600+0000","last_peered":"2023-09-30T22:26:34.466600+0000","last_clean":"2023-09-30T22:26:34.466600+0000","last_became_active":"2023-09-30T22:26:34.040742+0000","last_became_peered":"2023-09-30T22:26:34.040742+0000","last_unstale":"2023-09-30T22:26:34.466600+0000","last_undegraded":"2023-09-30T22:26:34.466600+0000","last_fullsized":"2023-09-30T22:26:34.466600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.429047+0000","last_change":"2023-09-30T22:26:30.873252+0000","last_active":"2023-09-30T22:26:34.429047+0000","last_peered":"2023-09-30T22:26:34.429047+0000","last_clean":"2023-09-30T22:26:34.429047+0000","last_became_active":"2023-09-30T22:26:30.872894+0000","last_became_peered":"2023-09-30T22:26:30.872894+0000","last_unstale":"2023-09-30T22:26:34.429047+0000","last_undegraded":"2023-09-30T22:26:34.429047+0000","last_fullsized":"2023-09-30T22:26:34.429047+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.469989+0000","last_change":"2023-09-30T22:26:34.462059+0000","last_active":"2023-09-30T22:26:34.469989+0000","last_peered":"2023-09-30T22:26:34.469989+0000","last_clean":"2023-09-30T22:26:34.469989+0000","last_became_active":"2023-09-30T22:26:34.461415+0000","last_became_peered":"2023-09-30T22:26:34.461415+0000","last_unstale":"2023-09-30T22:26:34.469989+0000","last_undegraded":"2023-09-30T22:26:34.469989+0000","last_fullsized":"2023-09-30T22:26:34.469989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.424541+0000","last_change":"2023-09-30T22:26:30.874887+0000","last_active":"2023-09-30T22:26:34.424541+0000","last_peered":"2023-09-30T22:26:34.424541+0000","last_clean":"2023-09-30T22:26:34.424541+0000","last_became_active":"2023-09-30T22:26:30.874533+0000","last_became_peered":"2023-09-30T22:26:30.874533+0000","last_unstale":"2023-09-30T22:26:34.424541+0000","last_undegraded":"2023-09-30T22:26:34.424541+0000","last_fullsized":"2023-09-30T22:26:34.424541+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T22:26:36.892429+0000","last_change":"2023-09-30T22:26:34.029291+0000","last_active":"2023-09-30T22:26:36.892429+0000","last_peered":"2023-09-30T22:26:36.892429+0000","last_clean":"2023-09-30T22:26:36.892429+0000","last_became_active":"2023-09-30T22:26:34.028983+0000","last_became_peered":"2023-09-30T22:26:34.028983+0000","last_unstale":"2023-09-30T22:26:36.892429+0000","last_undegraded":"2023-09-30T22:26:36.892429+0000","last_fullsized":"2023-09-30T22:26:36.892429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460262+0000","last_change":"2023-09-30T22:26:34.453608+0000","last_active":"2023-09-30T22:26:34.460262+0000","last_peered":"2023-09-30T22:26:34.460262+0000","last_clean":"2023-09-30T22:26:34.460262+0000","last_became_active":"2023-09-30T22:26:34.453255+0000","last_became_peered":"2023-09-30T22:26:34.453255+0000","last_unstale":"2023-09-30T22:26:34.460262+0000","last_undegraded":"2023-09-30T22:26:34.460262+0000","last_fullsized":"2023-09-30T22:26:34.460262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.454524+0000","last_change":"2023-09-30T22:26:34.026874+0000","last_active":"2023-09-30T22:26:34.454524+0000","last_peered":"2023-09-30T22:26:34.454524+0000","last_clean":"2023-09-30T22:26:34.454524+0000","last_became_active":"2023-09-30T22:26:34.024536+0000","last_became_peered":"2023-09-30T22:26:34.024536+0000","last_unstale":"2023-09-30T22:26:34.454524+0000","last_undegraded":"2023-09-30T22:26:34.454524+0000","last_fullsized":"2023-09-30T22:26:34.454524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460574+0000","last_change":"2023-09-30T22:26:34.452982+0000","last_active":"2023-09-30T22:26:34.460574+0000","last_peered":"2023-09-30T22:26:34.460574+0000","last_clean":"2023-09-30T22:26:34.460574+0000","last_became_active":"2023-09-30T22:26:34.452695+0000","last_became_peered":"2023-09-30T22:26:34.452695+0000","last_unstale":"2023-09-30T22:26:34.460574+0000","last_undegraded":"2023-09-30T22:26:34.460574+0000","last_fullsized":"2023-09-30T22:26:34.460574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.471263+0000","last_change":"2023-09-30T22:26:34.045553+0000","last_active":"2023-09-30T22:26:34.471263+0000","last_peered":"2023-09-30T22:26:34.471263+0000","last_clean":"2023-09-30T22:26:34.471263+0000","last_became_active":"2023-09-30T22:26:34.045206+0000","last_became_peered":"2023-09-30T22:26:34.045206+0000","last_unstale":"2023-09-30T22:26:34.471263+0000","last_undegraded":"2023-09-30T22:26:34.471263+0000","last_fullsized":"2023-09-30T22:26:34.471263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460323+0000","last_change":"2023-09-30T22:26:34.454158+0000","last_active":"2023-09-30T22:26:34.460323+0000","last_peered":"2023-09-30T22:26:34.460323+0000","last_clean":"2023-09-30T22:26:34.460323+0000","last_became_active":"2023-09-30T22:26:34.453928+0000","last_became_peered":"2023-09-30T22:26:34.453928+0000","last_unstale":"2023-09-30T22:26:34.460323+0000","last_undegraded":"2023-09-30T22:26:34.460323+0000","last_fullsized":"2023-09-30T22:26:34.460323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.461491+0000","last_change":"2023-09-30T22:26:34.045717+0000","last_active":"2023-09-30T22:26:34.461491+0000","last_peered":"2023-09-30T22:26:34.461491+0000","last_clean":"2023-09-30T22:26:34.461491+0000","last_became_active":"2023-09-30T22:26:34.045395+0000","last_became_peered":"2023-09-30T22:26:34.045395+0000","last_unstale":"2023-09-30T22:26:34.461491+0000","last_undegraded":"2023-09-30T22:26:34.461491+0000","last_fullsized":"2023-09-30T22:26:34.461491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.460634+0000","last_change":"2023-09-30T22:26:34.448542+0000","last_active":"2023-09-30T22:26:34.460634+0000","last_peered":"2023-09-30T22:26:34.460634+0000","last_clean":"2023-09-30T22:26:34.460634+0000","last_became_active":"2023-09-30T22:26:34.448081+0000","last_became_peered":"2023-09-30T22:26:34.448081+0000","last_unstale":"2023-09-30T22:26:34.460634+0000","last_undegraded":"2023-09-30T22:26:34.460634+0000","last_fullsized":"2023-09-30T22:26:34.460634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.462279+0000","last_change":"2023-09-30T22:26:34.039959+0000","last_active":"2023-09-30T22:26:34.462279+0000","last_peered":"2023-09-30T22:26:34.462279+0000","last_clean":"2023-09-30T22:26:34.462279+0000","last_became_active":"2023-09-30T22:26:34.039615+0000","last_became_peered":"2023-09-30T22:26:34.039615+0000","last_unstale":"2023-09-30T22:26:34.462279+0000","last_undegraded":"2023-09-30T22:26:34.462279+0000","last_fullsized":"2023-09-30T22:26:34.462279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.450313+0000","last_change":"2023-09-30T22:26:34.442775+0000","last_active":"2023-09-30T22:26:34.450313+0000","last_peered":"2023-09-30T22:26:34.450313+0000","last_clean":"2023-09-30T22:26:34.450313+0000","last_became_active":"2023-09-30T22:26:34.442406+0000","last_became_peered":"2023-09-30T22:26:34.442406+0000","last_unstale":"2023-09-30T22:26:34.450313+0000","last_undegraded":"2023-09-30T22:26:34.450313+0000","last_fullsized":"2023-09-30T22:26:34.450313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.466261+0000","last_change":"2023-09-30T22:26:34.030292+0000","last_active":"2023-09-30T22:26:34.466261+0000","last_peered":"2023-09-30T22:26:34.466261+0000","last_clean":"2023-09-30T22:26:34.466261+0000","last_became_active":"2023-09-30T22:26:34.029782+0000","last_became_peered":"2023-09-30T22:26:34.029782+0000","last_unstale":"2023-09-30T22:26:34.466261+0000","last_undegraded":"2023-09-30T22:26:34.466261+0000","last_fullsized":"2023-09-30T22:26:34.466261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.459154+0000","last_change":"2023-09-30T22:26:34.446235+0000","last_active":"2023-09-30T22:26:34.459154+0000","last_peered":"2023-09-30T22:26:34.459154+0000","last_clean":"2023-09-30T22:26:34.459154+0000","last_became_active":"2023-09-30T22:26:34.445921+0000","last_became_peered":"2023-09-30T22:26:34.445921+0000","last_unstale":"2023-09-30T22:26:34.459154+0000","last_undegraded":"2023-09-30T22:26:34.459154+0000","last_fullsized":"2023-09-30T22:26:34.459154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.451360+0000","last_change":"2023-09-30T22:26:34.441075+0000","last_active":"2023-09-30T22:26:34.451360+0000","last_peered":"2023-09-30T22:26:34.451360+0000","last_clean":"2023-09-30T22:26:34.451360+0000","last_became_active":"2023-09-30T22:26:34.440633+0000","last_became_peered":"2023-09-30T22:26:34.440633+0000","last_unstale":"2023-09-30T22:26:34.451360+0000","last_undegraded":"2023-09-30T22:26:34.451360+0000","last_fullsized":"2023-09-30T22:26:34.451360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.463443+0000","last_change":"2023-09-30T22:26:34.458062+0000","last_active":"2023-09-30T22:26:34.463443+0000","last_peered":"2023-09-30T22:26:34.463443+0000","last_clean":"2023-09-30T22:26:34.463443+0000","last_became_active":"2023-09-30T22:26:34.457757+0000","last_became_peered":"2023-09-30T22:26:34.457757+0000","last_unstale":"2023-09-30T22:26:34.463443+0000","last_undegraded":"2023-09-30T22:26:34.463443+0000","last_fullsized":"2023-09-30T22:26:34.463443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.455136+0000","last_change":"2023-09-30T22:26:34.450865+0000","last_active":"2023-09-30T22:26:34.455136+0000","last_peered":"2023-09-30T22:26:34.455136+0000","last_clean":"2023-09-30T22:26:34.455136+0000","last_became_active":"2023-09-30T22:26:34.450568+0000","last_became_peered":"2023-09-30T22:26:34.450568+0000","last_unstale":"2023-09-30T22:26:34.455136+0000","last_undegraded":"2023-09-30T22:26:34.455136+0000","last_fullsized":"2023-09-30T22:26:34.455136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.467022+0000","last_change":"2023-09-30T22:26:34.461553+0000","last_active":"2023-09-30T22:26:34.467022+0000","last_peered":"2023-09-30T22:26:34.467022+0000","last_clean":"2023-09-30T22:26:34.467022+0000","last_became_active":"2023-09-30T22:26:34.459154+0000","last_became_peered":"2023-09-30T22:26:34.459154+0000","last_unstale":"2023-09-30T22:26:34.467022+0000","last_undegraded":"2023-09-30T22:26:34.467022+0000","last_fullsized":"2023-09-30T22:26:34.467022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:26:34.451971+0000","last_change":"2023-09-30T22:26:34.444740+0000","last_active":"2023-09-30T22:26:34.451971+0000","last_peered":"2023-09-30T22:26:34.451971+0000","last_clean":"2023-09-30T22:26:34.451971+0000","last_became_active":"2023-09-30T22:26:34.444385+0000","last_became_peered":"2023-09-30T22:26:34.444385+0000","last_unstale":"2023-09-30T22:26:34.451971+0000","last_undegraded":"2023-09-30T22:26:34.451971+0000","last_fullsized":"2023-09-30T22:26:34.451971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":50948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]}]},{"osd":0,"up_from":10,"seq":42949672965,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":51127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":52211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:26:47.291 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T22:26:47.291 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-30T22:26:47.291 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-30T22:26:47.291 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T22:26:47.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.456+0000 7f334faeb700 1 Processor -- start 2023-09-30T22:26:47.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.457+0000 7f334faeb700 1 -- start start 2023-09-30T22:26:47.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.457+0000 7f334faeb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3348096380 0x7f3348094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:47.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.457+0000 7f334faeb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3348094c20 0x7f3348127d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.457+0000 7f334faeb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3348096760 con 0x7f3348091b00 2023-09-30T22:26:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.457+0000 7f334faeb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3348091ff0 con 0x7f3348096380 2023-09-30T22:26:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.457+0000 7f334faeb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3348092c80 con 0x7f3348094c20 2023-09-30T22:26:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.457+0000 7f334e088700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3348094c20 0x7f3348127d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.457+0000 7f334d887700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3348096380 0x7f3348094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.457+0000 7f334e088700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3348094c20 0x7f3348127d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57390/0 (socket says 172.21.15.59:57390) 2023-09-30T22:26:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.457+0000 7f334e088700 1 -- 172.21.15.59:0/4135660841 learned_addr learned my addr 172.21.15.59:0/4135660841 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.457+0000 7f334d086700 1 --1- 172.21.15.59:0/4135660841 >> v1:172.21.15.59:6789/0 conn(0x7f3348091b00 0x7f3348127600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49426/0 (socket says 172.21.15.59:49426) 2023-09-30T22:26:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.458+0000 7f334e088700 1 -- 172.21.15.59:0/4135660841 >> v2:172.21.15.59:3300/0 conn(0x7f3348096380 msgr2=0x7f3348094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.458+0000 7f334e088700 1 --2- 172.21.15.59:0/4135660841 >> v2:172.21.15.59:3300/0 conn(0x7f3348096380 0x7f3348094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.458+0000 7f334e088700 1 -- 172.21.15.59:0/4135660841 >> v1:172.21.15.59:6789/0 conn(0x7f3348091b00 legacy=0x7f3348127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.458+0000 7f334e088700 1 -- 172.21.15.59:0/4135660841 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3348093900 con 0x7f3348094c20 2023-09-30T22:26:47.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.458+0000 7f334c885700 1 -- 172.21.15.59:0/4135660841 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451043659 0 0) 0x7f3348096760 con 0x7f3348091b00 2023-09-30T22:26:47.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.458+0000 7f334d887700 1 --2- 172.21.15.59:0/4135660841 >> v2:172.21.15.59:3300/0 conn(0x7f3348096380 0x7f3348094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:47.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.458+0000 7f334e088700 1 --2- 172.21.15.59:0/4135660841 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3348094c20 0x7f3348127d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3340009f20 tx=0x7f3340009840).ready entity=mon.2 client_cookie=2e0ea339cdc28f4f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:47.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.458+0000 7f334c885700 1 -- 172.21.15.59:0/4135660841 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334000e070 con 0x7f3348094c20 2023-09-30T22:26:47.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.458+0000 7f334c885700 1 -- 172.21.15.59:0/4135660841 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334000b9d0 con 0x7f3348094c20 2023-09-30T22:26:47.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.458+0000 7f334c885700 1 -- 172.21.15.59:0/4135660841 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334000bd50 con 0x7f3348094c20 2023-09-30T22:26:47.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.459+0000 7f334faeb700 1 -- 172.21.15.59:0/4135660841 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3348094c20 msgr2=0x7f3348127d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.459+0000 7f334faeb700 1 --2- 172.21.15.59:0/4135660841 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3348094c20 0x7f3348127d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3340009f20 tx=0x7f3340009840).stop 2023-09-30T22:26:47.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.459+0000 7f334faeb700 1 -- 172.21.15.59:0/4135660841 shutdown_connections 2023-09-30T22:26:47.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.459+0000 7f334faeb700 1 --2- 172.21.15.59:0/4135660841 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3348094c20 0x7f3348127d10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.459+0000 7f334faeb700 1 --2- 172.21.15.59:0/4135660841 >> v2:172.21.15.59:3300/0 conn(0x7f3348096380 0x7f3348094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.459+0000 7f334faeb700 1 -- 172.21.15.59:0/4135660841 >> 172.21.15.59:0/4135660841 conn(0x7f3348097470 msgr2=0x7f3348097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:47.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.459+0000 7f334faeb700 1 -- 172.21.15.59:0/4135660841 shutdown_connections 2023-09-30T22:26:47.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.459+0000 7f334faeb700 1 -- 172.21.15.59:0/4135660841 wait complete. 2023-09-30T22:26:47.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.460+0000 7f334faeb700 1 Processor -- start 2023-09-30T22:26:47.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.460+0000 7f334faeb700 1 -- start start 2023-09-30T22:26:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.460+0000 7f334faeb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3348091b00 0x7f3348124b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.460+0000 7f334faeb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3348094c20 0x7f3348125510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.460+0000 7f334faeb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3348096380 0x7f3348125a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.460+0000 7f334faeb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334811a720 con 0x7f3348091b00 2023-09-30T22:26:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.460+0000 7f334faeb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334806a520 con 0x7f3348094c20 2023-09-30T22:26:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.460+0000 7f334faeb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f334811a0f0 con 0x7f3348096380 2023-09-30T22:26:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.460+0000 7f334d887700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3348091b00 0x7f3348124b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:47.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.460+0000 7f334d887700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3348091b00 0x7f3348124b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53178/0 (socket says 172.21.15.59:53178) 2023-09-30T22:26:47.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.460+0000 7f334d887700 1 -- 172.21.15.59:0/4265699504 learned_addr learned my addr 172.21.15.59:0/4265699504 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:47.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.460+0000 7f334e088700 1 --2- 172.21.15.59:0/4265699504 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3348096380 0x7f3348125a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:47.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.460+0000 7f334d086700 1 --2- 172.21.15.59:0/4265699504 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3348094c20 0x7f3348125510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:47.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.461+0000 7f334e088700 1 -- 172.21.15.59:0/4265699504 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3348094c20 msgr2=0x7f3348125510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.461+0000 7f334e088700 1 --2- 172.21.15.59:0/4265699504 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3348094c20 0x7f3348125510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.461+0000 7f334e088700 1 -- 172.21.15.59:0/4265699504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3348091b00 msgr2=0x7f3348124b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.461+0000 7f334e088700 1 --2- 172.21.15.59:0/4265699504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3348091b00 0x7f3348124b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.461+0000 7f334e088700 1 -- 172.21.15.59:0/4265699504 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440092a0 con 0x7f3348096380 2023-09-30T22:26:47.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.461+0000 7f334d887700 1 --2- 172.21.15.59:0/4265699504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3348091b00 0x7f3348124b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:47.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.461+0000 7f334e088700 1 --2- 172.21.15.59:0/4265699504 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3348096380 0x7f3348125a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3340013000 tx=0x7f3340009840).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:47.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.461+0000 7f333dffb700 1 -- 172.21.15.59:0/4265699504 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33400092e0 con 0x7f3348096380 2023-09-30T22:26:47.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.461+0000 7f333dffb700 1 -- 172.21.15.59:0/4265699504 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334001e470 con 0x7f3348096380 2023-09-30T22:26:47.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.461+0000 7f334faeb700 1 -- 172.21.15.59:0/4265699504 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3340009ae0 con 0x7f3348096380 2023-09-30T22:26:47.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.461+0000 7f333dffb700 1 -- 172.21.15.59:0/4265699504 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334001e830 con 0x7f3348096380 2023-09-30T22:26:47.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.461+0000 7f334faeb700 1 -- 172.21.15.59:0/4265699504 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3348126910 con 0x7f3348096380 2023-09-30T22:26:47.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.462+0000 7f333dffb700 1 -- 172.21.15.59:0/4265699504 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3340003040 con 0x7f3348096380 2023-09-30T22:26:47.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.462+0000 7f333dffb700 1 -- 172.21.15.59:0/4265699504 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f334003c400 con 0x7f3348096380 2023-09-30T22:26:47.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.462+0000 7f334faeb700 1 -- 172.21.15.59:0/4265699504 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f334811ad20 con 0x7f3348096380 2023-09-30T22:26:47.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.467+0000 7f333dffb700 1 -- 172.21.15.59:0/4265699504 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3340011370 con 0x7f3348096380 2023-09-30T22:26:47.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.678+0000 7f334faeb700 1 -- 172.21.15.59:0/4265699504 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f334805a260 con 0x7f3348096380 2023-09-30T22:26:47.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.678+0000 7f333dffb700 1 -- 172.21.15.59:0/4265699504 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f334001dbc0 con 0x7f3348096380 2023-09-30T22:26:47.679 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:47.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.680+0000 7f334faeb700 1 -- 172.21.15.59:0/4265699504 >> v1:172.21.15.59:6816/118188 conn(0x7f332c02bb60 legacy=0x7f332c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.680+0000 7f334faeb700 1 -- 172.21.15.59:0/4265699504 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3348096380 msgr2=0x7f3348125a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.680+0000 7f334faeb700 1 --2- 172.21.15.59:0/4265699504 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3348096380 0x7f3348125a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3340013000 tx=0x7f3340009840).stop 2023-09-30T22:26:47.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.681+0000 7f334faeb700 1 -- 172.21.15.59:0/4265699504 shutdown_connections 2023-09-30T22:26:47.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.681+0000 7f334faeb700 1 --2- 172.21.15.59:0/4265699504 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3348096380 0x7f3348125a00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.681+0000 7f334faeb700 1 --2- 172.21.15.59:0/4265699504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3348091b00 0x7f3348124b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.681+0000 7f334faeb700 1 --2- 172.21.15.59:0/4265699504 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3348094c20 0x7f3348125510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.681+0000 7f334faeb700 1 -- 172.21.15.59:0/4265699504 >> 172.21.15.59:0/4265699504 conn(0x7f3348097470 msgr2=0x7f3348069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:47.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.681+0000 7f334faeb700 1 -- 172.21.15.59:0/4265699504 shutdown_connections 2023-09-30T22:26:47.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.681+0000 7f334faeb700 1 -- 172.21.15.59:0/4265699504 wait complete. 2023-09-30T22:26:47.694 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-30T22:26:47.694 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-30T22:26:47.694 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:26:47.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.824+0000 7f3113454700 1 Processor -- start 2023-09-30T22:26:47.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.825+0000 7f3113454700 1 -- start start 2023-09-30T22:26:47.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.825+0000 7f3113454700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310c096820 0x7f310c096c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:47.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.825+0000 7f3113454700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310c097800 0x7f310c130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:47.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.825+0000 7f3113454700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310c068df0 con 0x7f310c067940 2023-09-30T22:26:47.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.825+0000 7f3113454700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310c097c90 con 0x7f310c097800 2023-09-30T22:26:47.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.825+0000 7f3113454700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f310c06a4c0 con 0x7f310c096820 2023-09-30T22:26:47.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f31111f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310c096820 0x7f310c096c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:47.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f31119f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310c097800 0x7f310c130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:47.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f31119f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310c097800 0x7f310c130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41836/0 (socket says 172.21.15.59:41836) 2023-09-30T22:26:47.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f31111f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310c096820 0x7f310c096c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57408/0 (socket says 172.21.15.59:57408) 2023-09-30T22:26:47.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f31119f1700 1 -- 172.21.15.59:0/299432139 learned_addr learned my addr 172.21.15.59:0/299432139 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:47.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f31109ef700 1 --1- 172.21.15.59:0/299432139 >> v1:172.21.15.59:6789/0 conn(0x7f310c067940 0x7f310c0970f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49438/0 (socket says 172.21.15.59:49438) 2023-09-30T22:26:47.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f31119f1700 1 -- 172.21.15.59:0/299432139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310c096820 msgr2=0x7f310c096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:47.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f31119f1700 1 --2- 172.21.15.59:0/299432139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310c096820 0x7f310c096c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f31119f1700 1 -- 172.21.15.59:0/299432139 >> v1:172.21.15.59:6789/0 conn(0x7f310c067940 legacy=0x7f310c0970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f3103fff700 1 -- 172.21.15.59:0/299432139 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863158587 0 0) 0x7f310c068df0 con 0x7f310c067940 2023-09-30T22:26:47.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f31119f1700 1 -- 172.21.15.59:0/299432139 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c098260 con 0x7f310c097800 2023-09-30T22:26:47.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f31111f0700 1 --2- 172.21.15.59:0/299432139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310c096820 0x7f310c096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:47.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f31119f1700 1 --2- 172.21.15.59:0/299432139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310c097800 0x7f310c130280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3104009f50 tx=0x7f3104009840).ready entity=mon.1 client_cookie=44e0ed13025817b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:47.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f3103fff700 1 -- 172.21.15.59:0/299432139 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310400e070 con 0x7f310c097800 2023-09-30T22:26:47.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f3103fff700 1 -- 172.21.15.59:0/299432139 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310400ba00 con 0x7f310c097800 2023-09-30T22:26:47.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.826+0000 7f3103fff700 1 -- 172.21.15.59:0/299432139 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310400bdd0 con 0x7f310c097800 2023-09-30T22:26:47.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.827+0000 7f3113454700 1 -- 172.21.15.59:0/299432139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310c097800 msgr2=0x7f310c130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.827+0000 7f3113454700 1 --2- 172.21.15.59:0/299432139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310c097800 0x7f310c130280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3104009f50 tx=0x7f3104009840).stop 2023-09-30T22:26:47.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.827+0000 7f3113454700 1 -- 172.21.15.59:0/299432139 shutdown_connections 2023-09-30T22:26:47.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.827+0000 7f3113454700 1 --2- 172.21.15.59:0/299432139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310c096820 0x7f310c096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.827+0000 7f3113454700 1 --2- 172.21.15.59:0/299432139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310c097800 0x7f310c130280 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.827+0000 7f3113454700 1 -- 172.21.15.59:0/299432139 >> 172.21.15.59:0/299432139 conn(0x7f310c09ba50 msgr2=0x7f310c09be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:47.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.827+0000 7f3113454700 1 -- 172.21.15.59:0/299432139 shutdown_connections 2023-09-30T22:26:47.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.827+0000 7f3113454700 1 -- 172.21.15.59:0/299432139 wait complete. 2023-09-30T22:26:47.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.828+0000 7f3113454700 1 Processor -- start 2023-09-30T22:26:47.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.828+0000 7f3113454700 1 -- start start 2023-09-30T22:26:47.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f3113454700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310c067940 0x7f310c12ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:47.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f3113454700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310c096820 0x7f310c117e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:47.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f3113454700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310c097800 0x7f310c1182f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:47.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f3113454700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c067e30 con 0x7f310c097800 2023-09-30T22:26:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f3113454700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310c11b390 con 0x7f310c096820 2023-09-30T22:26:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f3113454700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f310c11b930 con 0x7f310c067940 2023-09-30T22:26:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f31109ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310c096820 0x7f310c117e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f31111f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310c067940 0x7f310c12ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f31109ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310c096820 0x7f310c117e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41846/0 (socket says 172.21.15.59:41846) 2023-09-30T22:26:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f31119f1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310c097800 0x7f310c1182f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f31109ef700 1 -- 172.21.15.59:0/2333490885 learned_addr learned my addr 172.21.15.59:0/2333490885 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:47.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f31111f0700 1 -- 172.21.15.59:0/2333490885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310c096820 msgr2=0x7f310c117e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f31111f0700 1 --2- 172.21.15.59:0/2333490885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310c096820 0x7f310c117e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f31111f0700 1 -- 172.21.15.59:0/2333490885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310c097800 msgr2=0x7f310c1182f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f31111f0700 1 --2- 172.21.15.59:0/2333490885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310c097800 0x7f310c1182f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:47.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f31111f0700 1 -- 172.21.15.59:0/2333490885 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31080092a0 con 0x7f310c067940 2023-09-30T22:26:47.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f31111f0700 1 --2- 172.21.15.59:0/2333490885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310c067940 0x7f310c12ffd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f310800e980 tx=0x7f3108009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:47.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f31017fa700 1 -- 172.21.15.59:0/2333490885 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108012600 con 0x7f310c067940 2023-09-30T22:26:47.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f31017fa700 1 -- 172.21.15.59:0/2333490885 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3108012760 con 0x7f310c067940 2023-09-30T22:26:47.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f3113454700 1 -- 172.21.15.59:0/2333490885 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3104009ae0 con 0x7f310c067940 2023-09-30T22:26:47.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.829+0000 7f31017fa700 1 -- 172.21.15.59:0/2333490885 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108012ae0 con 0x7f310c067940 2023-09-30T22:26:47.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.830+0000 7f3113454700 1 -- 172.21.15.59:0/2333490885 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310c1304c0 con 0x7f310c067940 2023-09-30T22:26:47.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.830+0000 7f31017fa700 1 -- 172.21.15.59:0/2333490885 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f310801b400 con 0x7f310c067940 2023-09-30T22:26:47.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.830+0000 7f31017fa700 1 -- 172.21.15.59:0/2333490885 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f310803b480 con 0x7f310c067940 2023-09-30T22:26:47.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.831+0000 7f3113454700 1 -- 172.21.15.59:0/2333490885 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310c05a260 con 0x7f310c067940 2023-09-30T22:26:47.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:47.835+0000 7f31017fa700 1 -- 172.21.15.59:0/2333490885 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3108016070 con 0x7f310c067940 2023-09-30T22:26:48.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.018+0000 7f3113454700 1 -- 172.21.15.59:0/2333490885 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f310c0697b0 con 0x7f310c067940 2023-09-30T22:26:48.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.019+0000 7f31017fa700 1 -- 172.21.15.59:0/2333490885 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11343 (secure 0 0 0) 0x7f3108029090 con 0x7f310c067940 2023-09-30T22:26:48.019 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:48.019 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":18,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:26:35.416181+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:26:48.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.021+0000 7f3113454700 1 -- 172.21.15.59:0/2333490885 >> v1:172.21.15.59:6816/118188 conn(0x7f30f002bb60 legacy=0x7f30f002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.021+0000 7f3113454700 1 -- 172.21.15.59:0/2333490885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310c067940 msgr2=0x7f310c12ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.021+0000 7f3113454700 1 --2- 172.21.15.59:0/2333490885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310c067940 0x7f310c12ffd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f310800e980 tx=0x7f3108009060).stop 2023-09-30T22:26:48.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.021+0000 7f3113454700 1 -- 172.21.15.59:0/2333490885 shutdown_connections 2023-09-30T22:26:48.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.021+0000 7f3113454700 1 --2- 172.21.15.59:0/2333490885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310c067940 0x7f310c12ffd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.021+0000 7f3113454700 1 --2- 172.21.15.59:0/2333490885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310c097800 0x7f310c1182f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.021+0000 7f3113454700 1 --2- 172.21.15.59:0/2333490885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310c096820 0x7f310c117e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.021+0000 7f3113454700 1 -- 172.21.15.59:0/2333490885 >> 172.21.15.59:0/2333490885 conn(0x7f310c09ba50 msgr2=0x7f310c1120d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.021+0000 7f3113454700 1 -- 172.21.15.59:0/2333490885 shutdown_connections 2023-09-30T22:26:48.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.021+0000 7f3113454700 1 -- 172.21.15.59:0/2333490885 wait complete. 2023-09-30T22:26:48.034 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:26:26.893716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:26:28.448775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:26:32.964075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:26:33.390842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:26:48.035 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:26:48.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.168+0000 7f926a82d700 1 Processor -- start 2023-09-30T22:26:48.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.168+0000 7f926a82d700 1 -- start start 2023-09-30T22:26:48.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.168+0000 7f926a82d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9264098ea0 0x7f92640992b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:48.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.168+0000 7f926a82d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f926412d160 0x7f926412f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:48.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.168+0000 7f926a82d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9264092d80 con 0x7f9264093840 2023-09-30T22:26:48.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.168+0000 7f926a82d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9264093c20 con 0x7f9264098ea0 2023-09-30T22:26:48.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.168+0000 7f926a82d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9264092b90 con 0x7f926412d160 2023-09-30T22:26:48.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.169+0000 7f9268dca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f926412d160 0x7f926412f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:48.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.169+0000 7f92637fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9264098ea0 0x7f92640992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:48.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.169+0000 7f9268dca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f926412d160 0x7f926412f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57424/0 (socket says 172.21.15.59:57424) 2023-09-30T22:26:48.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.169+0000 7f92637fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9264098ea0 0x7f92640992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53192/0 (socket says 172.21.15.59:53192) 2023-09-30T22:26:48.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.169+0000 7f9268dca700 1 -- 172.21.15.59:0/1857045646 learned_addr learned my addr 172.21.15.59:0/1857045646 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.169+0000 7f9268dca700 1 -- 172.21.15.59:0/1857045646 >> v2:172.21.15.59:3300/0 conn(0x7f9264098ea0 msgr2=0x7f92640992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.169+0000 7f9268dca700 1 --2- 172.21.15.59:0/1857045646 >> v2:172.21.15.59:3300/0 conn(0x7f9264098ea0 0x7f92640992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.169+0000 7f9268dca700 1 -- 172.21.15.59:0/1857045646 >> v1:172.21.15.59:6789/0 conn(0x7f9264093840 legacy=0x7f9264098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.169+0000 7f9268dca700 1 -- 172.21.15.59:0/1857045646 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9264099b70 con 0x7f926412d160 2023-09-30T22:26:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.169+0000 7f92637fe700 1 --2- 172.21.15.59:0/1857045646 >> v2:172.21.15.59:3300/0 conn(0x7f9264098ea0 0x7f92640992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.169+0000 7f9268dca700 1 --2- 172.21.15.59:0/1857045646 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f926412d160 0x7f926412f550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f925c009f20 tx=0x7f925c009840).ready entity=mon.2 client_cookie=f8229fbaf1c2adb7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.169+0000 7f9262ffd700 1 -- 172.21.15.59:0/1857045646 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00e070 con 0x7f926412d160 2023-09-30T22:26:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.169+0000 7f9262ffd700 1 -- 172.21.15.59:0/1857045646 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c00b9d0 con 0x7f926412d160 2023-09-30T22:26:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.169+0000 7f9262ffd700 1 -- 172.21.15.59:0/1857045646 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00bd50 con 0x7f926412d160 2023-09-30T22:26:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.170+0000 7f926a82d700 1 -- 172.21.15.59:0/1857045646 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f926412d160 msgr2=0x7f926412f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.170+0000 7f926a82d700 1 --2- 172.21.15.59:0/1857045646 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f926412d160 0x7f926412f550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f925c009f20 tx=0x7f925c009840).stop 2023-09-30T22:26:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.170+0000 7f926a82d700 1 -- 172.21.15.59:0/1857045646 shutdown_connections 2023-09-30T22:26:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.170+0000 7f926a82d700 1 --2- 172.21.15.59:0/1857045646 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f926412d160 0x7f926412f550 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.170+0000 7f926a82d700 1 --2- 172.21.15.59:0/1857045646 >> v2:172.21.15.59:3300/0 conn(0x7f9264098ea0 0x7f92640992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.170+0000 7f926a82d700 1 -- 172.21.15.59:0/1857045646 >> 172.21.15.59:0/1857045646 conn(0x7f9264097480 msgr2=0x7f9264097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.170+0000 7f926a82d700 1 -- 172.21.15.59:0/1857045646 shutdown_connections 2023-09-30T22:26:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.170+0000 7f926a82d700 1 -- 172.21.15.59:0/1857045646 wait complete. 2023-09-30T22:26:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.171+0000 7f926a82d700 1 Processor -- start 2023-09-30T22:26:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.171+0000 7f926a82d700 1 -- start start 2023-09-30T22:26:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f926a82d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9264093840 0x7f926412ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f926a82d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9264098ea0 0x7f9264110fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f926a82d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f926412d160 0x7f92641114b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f926a82d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926406a550 con 0x7f9264098ea0 2023-09-30T22:26:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f926a82d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9264113080 con 0x7f926412d160 2023-09-30T22:26:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f926a82d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92640960d0 con 0x7f9264093840 2023-09-30T22:26:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f9263fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9264093840 0x7f926412ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f92637fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9264098ea0 0x7f9264110fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f92637fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9264098ea0 0x7f9264110fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53194/0 (socket says 172.21.15.59:53194) 2023-09-30T22:26:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f9268dca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f926412d160 0x7f92641114b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f92637fe700 1 -- 172.21.15.59:0/355414933 learned_addr learned my addr 172.21.15.59:0/355414933 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f9263fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9264093840 0x7f926412ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57428/0 (socket says 172.21.15.59:57428) 2023-09-30T22:26:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f92637fe700 1 -- 172.21.15.59:0/355414933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9264093840 msgr2=0x7f926412ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f92637fe700 1 --2- 172.21.15.59:0/355414933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9264093840 0x7f926412ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f92637fe700 1 -- 172.21.15.59:0/355414933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f926412d160 msgr2=0x7f92641114b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f92637fe700 1 --2- 172.21.15.59:0/355414933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f926412d160 0x7f92641114b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f92637fe700 1 -- 172.21.15.59:0/355414933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c0092a0 con 0x7f9264098ea0 2023-09-30T22:26:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f9263fff700 1 --2- 172.21.15.59:0/355414933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9264093840 0x7f926412ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f9268dca700 1 --2- 172.21.15.59:0/355414933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f926412d160 0x7f92641114b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.172+0000 7f92637fe700 1 --2- 172.21.15.59:0/355414933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9264098ea0 0x7f9264110fc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f924c00ea20 tx=0x7f924c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.173+0000 7f925bfff700 1 -- 172.21.15.59:0/355414933 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c00ee60 con 0x7f9264098ea0 2023-09-30T22:26:48.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.173+0000 7f926a82d700 1 -- 172.21.15.59:0/355414933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925c009ae0 con 0x7f9264098ea0 2023-09-30T22:26:48.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.173+0000 7f925bfff700 1 -- 172.21.15.59:0/355414933 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c009600 con 0x7f9264098ea0 2023-09-30T22:26:48.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.173+0000 7f925bfff700 1 -- 172.21.15.59:0/355414933 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c00ca60 con 0x7f9264098ea0 2023-09-30T22:26:48.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.173+0000 7f926a82d700 1 -- 172.21.15.59:0/355414933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9264113340 con 0x7f9264098ea0 2023-09-30T22:26:48.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.173+0000 7f925bfff700 1 -- 172.21.15.59:0/355414933 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f924c01b400 con 0x7f9264098ea0 2023-09-30T22:26:48.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.173+0000 7f925bfff700 1 -- 172.21.15.59:0/355414933 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f924c03b520 con 0x7f9264098ea0 2023-09-30T22:26:48.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.174+0000 7f926a82d700 1 -- 172.21.15.59:0/355414933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926405a260 con 0x7f9264098ea0 2023-09-30T22:26:48.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.179+0000 7f925bfff700 1 -- 172.21.15.59:0/355414933 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f924c016070 con 0x7f9264098ea0 2023-09-30T22:26:48.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.351+0000 7f926a82d700 1 -- 172.21.15.59:0/355414933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9264111dc0 con 0x7f9264098ea0 2023-09-30T22:26:48.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.351+0000 7f925bfff700 1 -- 172.21.15.59:0/355414933 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f924c016020 con 0x7f9264098ea0 2023-09-30T22:26:48.351 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-30T22:26:48.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.353+0000 7f926a82d700 1 -- 172.21.15.59:0/355414933 >> v1:172.21.15.59:6816/118188 conn(0x7f924402bb60 legacy=0x7f924402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.353+0000 7f926a82d700 1 -- 172.21.15.59:0/355414933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9264098ea0 msgr2=0x7f9264110fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.353+0000 7f926a82d700 1 --2- 172.21.15.59:0/355414933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9264098ea0 0x7f9264110fc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f924c00ea20 tx=0x7f924c009060).stop 2023-09-30T22:26:48.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.353+0000 7f926a82d700 1 -- 172.21.15.59:0/355414933 shutdown_connections 2023-09-30T22:26:48.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.353+0000 7f926a82d700 1 --2- 172.21.15.59:0/355414933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9264093840 0x7f926412ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.353+0000 7f926a82d700 1 --2- 172.21.15.59:0/355414933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f926412d160 0x7f92641114b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.353+0000 7f926a82d700 1 --2- 172.21.15.59:0/355414933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9264098ea0 0x7f9264110fc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.353+0000 7f926a82d700 1 -- 172.21.15.59:0/355414933 >> 172.21.15.59:0/355414933 conn(0x7f9264097480 msgr2=0x7f9264059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.353+0000 7f926a82d700 1 -- 172.21.15.59:0/355414933 shutdown_connections 2023-09-30T22:26:48.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.353+0000 7f926a82d700 1 -- 172.21.15.59:0/355414933 wait complete. 2023-09-30T22:26:48.366 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:26:48.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.499+0000 7f2e07274700 1 Processor -- start 2023-09-30T22:26:48.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.499+0000 7f2e07274700 1 -- start start 2023-09-30T22:26:48.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.500+0000 7f2e07274700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e00066110 0x7f2e00097420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:48.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.500+0000 7f2e07274700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0012fd70 0x7f2e00132160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.500+0000 7f2e07274700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e00064e00 con 0x7f2e0012add0 2023-09-30T22:26:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.500+0000 7f2e07274700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e000664f0 con 0x7f2e00066110 2023-09-30T22:26:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.500+0000 7f2e07274700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e00065d80 con 0x7f2e0012fd70 2023-09-30T22:26:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.500+0000 7f2e05811700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0012fd70 0x7f2e00132160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.500+0000 7f2e05010700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e00066110 0x7f2e00097420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.500+0000 7f2e05811700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0012fd70 0x7f2e00132160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41862/0 (socket says 172.21.15.59:41862) 2023-09-30T22:26:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.500+0000 7f2e05811700 1 -- 172.21.15.59:0/1958681494 learned_addr learned my addr 172.21.15.59:0/1958681494 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.500+0000 7f2e05811700 1 -- 172.21.15.59:0/1958681494 >> v2:172.21.15.59:3300/0 conn(0x7f2e00066110 msgr2=0x7f2e00097420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.500+0000 7f2e05811700 1 --2- 172.21.15.59:0/1958681494 >> v2:172.21.15.59:3300/0 conn(0x7f2e00066110 0x7f2e00097420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.500+0000 7f2e05811700 1 -- 172.21.15.59:0/1958681494 >> v1:172.21.15.59:6789/0 conn(0x7f2e0012add0 legacy=0x7f2e0012b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.500+0000 7f2e05811700 1 -- 172.21.15.59:0/1958681494 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e00065910 con 0x7f2e0012fd70 2023-09-30T22:26:48.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.500+0000 7f2e05010700 1 --2- 172.21.15.59:0/1958681494 >> v2:172.21.15.59:3300/0 conn(0x7f2e00066110 0x7f2e00097420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:48.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.500+0000 7f2e05811700 1 --2- 172.21.15.59:0/1958681494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0012fd70 0x7f2e00132160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2df8009f20 tx=0x7f2df8009840).ready entity=mon.1 client_cookie=6a8f31af93d2e0c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.501+0000 7f2df3fff700 1 -- 172.21.15.59:0/1958681494 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800e070 con 0x7f2e0012fd70 2023-09-30T22:26:48.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.501+0000 7f2df3fff700 1 -- 172.21.15.59:0/1958681494 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df800b9d0 con 0x7f2e0012fd70 2023-09-30T22:26:48.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.501+0000 7f2df3fff700 1 -- 172.21.15.59:0/1958681494 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800bd50 con 0x7f2e0012fd70 2023-09-30T22:26:48.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.501+0000 7f2e07274700 1 -- 172.21.15.59:0/1958681494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0012fd70 msgr2=0x7f2e00132160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.501+0000 7f2e07274700 1 --2- 172.21.15.59:0/1958681494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0012fd70 0x7f2e00132160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2df8009f20 tx=0x7f2df8009840).stop 2023-09-30T22:26:48.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.501+0000 7f2e07274700 1 -- 172.21.15.59:0/1958681494 shutdown_connections 2023-09-30T22:26:48.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.501+0000 7f2e07274700 1 --2- 172.21.15.59:0/1958681494 >> v2:172.21.15.59:3300/0 conn(0x7f2e00066110 0x7f2e00097420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.501+0000 7f2e07274700 1 --2- 172.21.15.59:0/1958681494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0012fd70 0x7f2e00132160 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.501+0000 7f2e07274700 1 -- 172.21.15.59:0/1958681494 >> 172.21.15.59:0/1958681494 conn(0x7f2e0009ba60 msgr2=0x7f2e0009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.501+0000 7f2e07274700 1 -- 172.21.15.59:0/1958681494 shutdown_connections 2023-09-30T22:26:48.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.501+0000 7f2e07274700 1 -- 172.21.15.59:0/1958681494 wait complete. 2023-09-30T22:26:48.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.503+0000 7f2e07274700 1 Processor -- start 2023-09-30T22:26:48.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.503+0000 7f2e07274700 1 -- start start 2023-09-30T22:26:48.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e07274700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e00066110 0x7f2e00069c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:48.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e07274700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0012add0 0x7f2e0013a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:48.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e07274700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e0012fd70 0x7f2e0013aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:48.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e07274700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0012f640 con 0x7f2e0012fd70 2023-09-30T22:26:48.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e07274700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0012cc60 con 0x7f2e00066110 2023-09-30T22:26:48.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e07274700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e00129b60 con 0x7f2e0012add0 2023-09-30T22:26:48.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e05010700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e00066110 0x7f2e00069c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:48.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e05010700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e00066110 0x7f2e00069c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41874/0 (socket says 172.21.15.59:41874) 2023-09-30T22:26:48.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e05010700 1 -- 172.21.15.59:0/181468979 learned_addr learned my addr 172.21.15.59:0/181468979 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:48.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e0480f700 1 --2- 172.21.15.59:0/181468979 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0012add0 0x7f2e0013a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:48.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e05811700 1 --2- 172.21.15.59:0/181468979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e0012fd70 0x7f2e0013aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:48.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e05010700 1 -- 172.21.15.59:0/181468979 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0012add0 msgr2=0x7f2e0013a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e05010700 1 --2- 172.21.15.59:0/181468979 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0012add0 0x7f2e0013a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e05010700 1 -- 172.21.15.59:0/181468979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e0012fd70 msgr2=0x7f2e0013aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e05010700 1 --2- 172.21.15.59:0/181468979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e0012fd70 0x7f2e0013aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e05010700 1 -- 172.21.15.59:0/181468979 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc0092a0 con 0x7f2e00066110 2023-09-30T22:26:48.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e05010700 1 --2- 172.21.15.59:0/181468979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e00066110 0x7f2e00069c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2dfc00ea20 tx=0x7f2dfc009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2df17fa700 1 -- 172.21.15.59:0/181468979 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc00ee60 con 0x7f2e00066110 2023-09-30T22:26:48.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2df17fa700 1 -- 172.21.15.59:0/181468979 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc009600 con 0x7f2e00066110 2023-09-30T22:26:48.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2e07274700 1 -- 172.21.15.59:0/181468979 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df8009ae0 con 0x7f2e00066110 2023-09-30T22:26:48.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.504+0000 7f2df17fa700 1 -- 172.21.15.59:0/181468979 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc00ca60 con 0x7f2e00066110 2023-09-30T22:26:48.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.505+0000 7f2e07274700 1 -- 172.21.15.59:0/181468979 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0012d580 con 0x7f2e00066110 2023-09-30T22:26:48.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.505+0000 7f2df17fa700 1 -- 172.21.15.59:0/181468979 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2dfc01b400 con 0x7f2e00066110 2023-09-30T22:26:48.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.505+0000 7f2df17fa700 1 -- 172.21.15.59:0/181468979 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2dfc03b480 con 0x7f2e00066110 2023-09-30T22:26:48.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.506+0000 7f2e07274700 1 -- 172.21.15.59:0/181468979 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0012f7b0 con 0x7f2e00066110 2023-09-30T22:26:48.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.510+0000 7f2df17fa700 1 -- 172.21.15.59:0/181468979 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2e0012f7b0 con 0x7f2e00066110 2023-09-30T22:26:48.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.684+0000 7f2e07274700 1 -- 172.21.15.59:0/181468979 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2e0012f7b0 con 0x7f2e00066110 2023-09-30T22:26:48.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.684+0000 7f2df17fa700 1 -- 172.21.15.59:0/181468979 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2e0012f7b0 con 0x7f2e00066110 2023-09-30T22:26:48.684 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-09-30T22:26:48.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.686+0000 7f2e07274700 1 -- 172.21.15.59:0/181468979 >> v1:172.21.15.59:6816/118188 conn(0x7f2de402bb60 legacy=0x7f2de402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.686+0000 7f2e07274700 1 -- 172.21.15.59:0/181468979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e00066110 msgr2=0x7f2e00069c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.686+0000 7f2e07274700 1 --2- 172.21.15.59:0/181468979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e00066110 0x7f2e00069c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2dfc00ea20 tx=0x7f2dfc009060).stop 2023-09-30T22:26:48.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.686+0000 7f2e07274700 1 -- 172.21.15.59:0/181468979 shutdown_connections 2023-09-30T22:26:48.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.686+0000 7f2e07274700 1 --2- 172.21.15.59:0/181468979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e0012fd70 0x7f2e0013aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.686+0000 7f2e07274700 1 --2- 172.21.15.59:0/181468979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e00066110 0x7f2e00069c70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.686+0000 7f2e07274700 1 --2- 172.21.15.59:0/181468979 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0012add0 0x7f2e0013a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.686+0000 7f2e07274700 1 -- 172.21.15.59:0/181468979 >> 172.21.15.59:0/181468979 conn(0x7f2e0009ba60 msgr2=0x7f2e0009a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.686+0000 7f2e07274700 1 -- 172.21.15.59:0/181468979 shutdown_connections 2023-09-30T22:26:48.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.686+0000 7f2e07274700 1 -- 172.21.15.59:0/181468979 wait complete. 2023-09-30T22:26:48.699 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:26:48.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.832+0000 7fdfd91af700 1 Processor -- start 2023-09-30T22:26:48.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.832+0000 7fdfd91af700 1 -- start start 2023-09-30T22:26:48.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd91af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfd4094380 0x7fdfd4069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:48.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd91af700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdfd412ddf0 0x7fdfd41301e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:48.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd91af700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd40964a0 con 0x7fdfd4068d20 2023-09-30T22:26:48.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd91af700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd4096160 con 0x7fdfd412ddf0 2023-09-30T22:26:48.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd91af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd4095510 con 0x7fdfd4094380 2023-09-30T22:26:48.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdfd412ddf0 0x7fdfd41301e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:48.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfd4094380 0x7fdfd4069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:48.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd2d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdfd4068d20 0x7fdfd4069100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49472/0 (socket says 172.21.15.59:49472) 2023-09-30T22:26:48.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdfd412ddf0 0x7fdfd41301e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53238/0 (socket says 172.21.15.59:53238) 2023-09-30T22:26:48.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd2d9d700 1 -- 172.21.15.59:0/101126390 learned_addr learned my addr 172.21.15.59:0/101126390 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:48.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd359e700 1 -- 172.21.15.59:0/101126390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfd4094380 msgr2=0x7fdfd4069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:48.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd359e700 1 --2- 172.21.15.59:0/101126390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfd4094380 0x7fdfd4069810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd359e700 1 -- 172.21.15.59:0/101126390 >> v1:172.21.15.59:6789/0 conn(0x7fdfd4068d20 legacy=0x7fdfd4069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd359e700 1 -- 172.21.15.59:0/101126390 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd4094ce0 con 0x7fdfd412ddf0 2023-09-30T22:26:48.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd1d9b700 1 -- 172.21.15.59:0/101126390 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893621475 0 0) 0x7fdfd40964a0 con 0x7fdfd4068d20 2023-09-30T22:26:48.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd259c700 1 --2- 172.21.15.59:0/101126390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfd4094380 0x7fdfd4069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:48.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.833+0000 7fdfd359e700 1 --2- 172.21.15.59:0/101126390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfd412ddf0 0x7fdfd41301e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdfcc009e90 tx=0x7fdfcc009780).ready entity=mon.0 client_cookie=2c642b761732a2f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.834+0000 7fdfd1d9b700 1 -- 172.21.15.59:0/101126390 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00e070 con 0x7fdfd412ddf0 2023-09-30T22:26:48.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.834+0000 7fdfd1d9b700 1 -- 172.21.15.59:0/101126390 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc00bb20 con 0x7fdfd412ddf0 2023-09-30T22:26:48.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.834+0000 7fdfd1d9b700 1 -- 172.21.15.59:0/101126390 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00bea0 con 0x7fdfd412ddf0 2023-09-30T22:26:48.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.834+0000 7fdfd91af700 1 -- 172.21.15.59:0/101126390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfd412ddf0 msgr2=0x7fdfd41301e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.834+0000 7fdfd91af700 1 --2- 172.21.15.59:0/101126390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfd412ddf0 0x7fdfd41301e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdfcc009e90 tx=0x7fdfcc009780).stop 2023-09-30T22:26:48.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.834+0000 7fdfd91af700 1 -- 172.21.15.59:0/101126390 shutdown_connections 2023-09-30T22:26:48.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.834+0000 7fdfd91af700 1 --2- 172.21.15.59:0/101126390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfd412ddf0 0x7fdfd41301e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.834+0000 7fdfd91af700 1 --2- 172.21.15.59:0/101126390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfd4094380 0x7fdfd4069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:48.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.834+0000 7fdfd91af700 1 -- 172.21.15.59:0/101126390 >> 172.21.15.59:0/101126390 conn(0x7fdfd409a1c0 msgr2=0x7fdfd409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.834+0000 7fdfd91af700 1 -- 172.21.15.59:0/101126390 shutdown_connections 2023-09-30T22:26:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.834+0000 7fdfd91af700 1 -- 172.21.15.59:0/101126390 wait complete. 2023-09-30T22:26:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.836+0000 7fdfd91af700 1 Processor -- start 2023-09-30T22:26:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.836+0000 7fdfd91af700 1 -- start start 2023-09-30T22:26:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.836+0000 7fdfd91af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfd4068d20 0x7fdfd41159d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.836+0000 7fdfd91af700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfd4094380 0x7fdfd4115ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.836+0000 7fdfd91af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfd412ddf0 0x7fdfd41163b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.836+0000 7fdfd91af700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd41168a0 con 0x7fdfd4094380 2023-09-30T22:26:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.836+0000 7fdfd91af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd4094f30 con 0x7fdfd412ddf0 2023-09-30T22:26:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.836+0000 7fdfd91af700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd4116e40 con 0x7fdfd4068d20 2023-09-30T22:26:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.837+0000 7fdfd2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfd4068d20 0x7fdfd41159d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.837+0000 7fdfd2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfd4068d20 0x7fdfd41159d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57436/0 (socket says 172.21.15.59:57436) 2023-09-30T22:26:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.837+0000 7fdfd2d9d700 1 -- 172.21.15.59:0/4233728297 learned_addr learned my addr 172.21.15.59:0/4233728297 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.837+0000 7fdfd2d9d700 1 -- 172.21.15.59:0/4233728297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfd412ddf0 msgr2=0x7fdfd41163b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.837+0000 7fdfd2d9d700 1 --2- 172.21.15.59:0/4233728297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfd412ddf0 0x7fdfd41163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.837+0000 7fdfd2d9d700 1 -- 172.21.15.59:0/4233728297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfd4094380 msgr2=0x7fdfd4115ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.837+0000 7fdfd2d9d700 1 --2- 172.21.15.59:0/4233728297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfd4094380 0x7fdfd4115ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.837+0000 7fdfd2d9d700 1 -- 172.21.15.59:0/4233728297 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc800d740 con 0x7fdfd4068d20 2023-09-30T22:26:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.837+0000 7fdfd2d9d700 1 --2- 172.21.15.59:0/4233728297 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfd4068d20 0x7fdfd41159d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdfc400c4f0 tx=0x7fdfc4007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.837+0000 7fdfbaffd700 1 -- 172.21.15.59:0/4233728297 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40072e0 con 0x7fdfd4068d20 2023-09-30T22:26:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.837+0000 7fdfbaffd700 1 -- 172.21.15.59:0/4233728297 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc4007440 con 0x7fdfd4068d20 2023-09-30T22:26:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.837+0000 7fdfd91af700 1 -- 172.21.15.59:0/4233728297 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc009a20 con 0x7fdfd4068d20 2023-09-30T22:26:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.837+0000 7fdfbaffd700 1 -- 172.21.15.59:0/4233728297 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40057a0 con 0x7fdfd4068d20 2023-09-30T22:26:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.837+0000 7fdfd91af700 1 -- 172.21.15.59:0/4233728297 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd4118e30 con 0x7fdfd4068d20 2023-09-30T22:26:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.838+0000 7fdfbaffd700 1 -- 172.21.15.59:0/4233728297 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fdfc4005b90 con 0x7fdfd4068d20 2023-09-30T22:26:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.838+0000 7fdfbaffd700 1 -- 172.21.15.59:0/4233728297 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fdfc403a850 con 0x7fdfd4068d20 2023-09-30T22:26:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.839+0000 7fdfd91af700 1 -- 172.21.15.59:0/4233728297 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd40937c0 con 0x7fdfd4068d20 2023-09-30T22:26:48.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:48.843+0000 7fdfbaffd700 1 -- 172.21.15.59:0/4233728297 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fdfc4005e40 con 0x7fdfd4068d20 2023-09-30T22:26:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.017+0000 7fdfd91af700 1 -- 172.21.15.59:0/4233728297 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdfd4119210 con 0x7fdfd4068d20 2023-09-30T22:26:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.017+0000 7fdfbaffd700 1 -- 172.21.15.59:0/4233728297 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdfc4010ab0 con 0x7fdfd4068d20 2023-09-30T22:26:49.018 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-30T22:26:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.019+0000 7fdfd91af700 1 -- 172.21.15.59:0/4233728297 >> v1:172.21.15.59:6816/118188 conn(0x7fdfc002bb60 legacy=0x7fdfc002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.019+0000 7fdfd91af700 1 -- 172.21.15.59:0/4233728297 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfd4068d20 msgr2=0x7fdfd41159d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.019+0000 7fdfd91af700 1 --2- 172.21.15.59:0/4233728297 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfd4068d20 0x7fdfd41159d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdfc400c4f0 tx=0x7fdfc4007c10).stop 2023-09-30T22:26:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.019+0000 7fdfd91af700 1 -- 172.21.15.59:0/4233728297 shutdown_connections 2023-09-30T22:26:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.019+0000 7fdfd91af700 1 --2- 172.21.15.59:0/4233728297 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfd4068d20 0x7fdfd41159d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.019+0000 7fdfd91af700 1 --2- 172.21.15.59:0/4233728297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfd412ddf0 0x7fdfd41163b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.019+0000 7fdfd91af700 1 --2- 172.21.15.59:0/4233728297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfd4094380 0x7fdfd4115ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:26:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.019+0000 7fdfd91af700 1 -- 172.21.15.59:0/4233728297 >> 172.21.15.59:0/4233728297 conn(0x7fdfd409a1c0 msgr2=0x7fdfd40984b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.019+0000 7fdfd91af700 1 -- 172.21.15.59:0/4233728297 shutdown_connections 2023-09-30T22:26:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.019+0000 7fdfd91af700 1 -- 172.21.15.59:0/4233728297 wait complete. 2023-09-30T22:26:49.032 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:26:49.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.166+0000 7fdd7e824700 1 Processor -- start 2023-09-30T22:26:49.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.166+0000 7fdd7e824700 1 -- start start 2023-09-30T22:26:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.166+0000 7fdd7e824700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd780926d0 0x7fdd781275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.166+0000 7fdd7e824700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd78127be0 0x7fdd78128000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.166+0000 7fdd7e824700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd78091c80 con 0x7fdd7812a9a0 2023-09-30T22:26:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.166+0000 7fdd7e824700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd78099dd0 con 0x7fdd78127be0 2023-09-30T22:26:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.166+0000 7fdd7e824700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780999d0 con 0x7fdd780926d0 2023-09-30T22:26:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.167+0000 7fdd777fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd78127be0 0x7fdd78128000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.167+0000 7fdd77fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd780926d0 0x7fdd781275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.167+0000 7fdd7cdc1700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdd7812a9a0 0x7fdd7812ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49478/0 (socket says 172.21.15.59:49478) 2023-09-30T22:26:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.167+0000 7fdd7cdc1700 1 -- 172.21.15.59:0/883169742 learned_addr learned my addr 172.21.15.59:0/883169742 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.167+0000 7fdd76ffd700 1 -- 172.21.15.59:0/883169742 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468885900 0 0) 0x7fdd78091c80 con 0x7fdd7812a9a0 2023-09-30T22:26:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.167+0000 7fdd77fff700 1 -- 172.21.15.59:0/883169742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd78127be0 msgr2=0x7fdd78128000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.167+0000 7fdd77fff700 1 --2- 172.21.15.59:0/883169742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd78127be0 0x7fdd78128000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.167+0000 7fdd77fff700 1 -- 172.21.15.59:0/883169742 >> v1:172.21.15.59:6789/0 conn(0x7fdd7812a9a0 legacy=0x7fdd7812ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.167+0000 7fdd77fff700 1 -- 172.21.15.59:0/883169742 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7809a280 con 0x7fdd780926d0 2023-09-30T22:26:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.167+0000 7fdd777fe700 1 --2- 172.21.15.59:0/883169742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd78127be0 0x7fdd78128000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.167+0000 7fdd77fff700 1 --2- 172.21.15.59:0/883169742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd780926d0 0x7fdd781275c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fdd68009790 tx=0x7fdd68009060).ready entity=mon.2 client_cookie=13597f3be3fad0d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.167+0000 7fdd76ffd700 1 -- 172.21.15.59:0/883169742 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6800f510 con 0x7fdd780926d0 2023-09-30T22:26:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.167+0000 7fdd76ffd700 1 -- 172.21.15.59:0/883169742 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6800f670 con 0x7fdd780926d0 2023-09-30T22:26:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.167+0000 7fdd76ffd700 1 -- 172.21.15.59:0/883169742 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6800f9f0 con 0x7fdd780926d0 2023-09-30T22:26:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.168+0000 7fdd7e824700 1 -- 172.21.15.59:0/883169742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd780926d0 msgr2=0x7fdd781275c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.168+0000 7fdd7e824700 1 --2- 172.21.15.59:0/883169742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd780926d0 0x7fdd781275c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fdd68009790 tx=0x7fdd68009060).stop 2023-09-30T22:26:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.168+0000 7fdd7e824700 1 -- 172.21.15.59:0/883169742 shutdown_connections 2023-09-30T22:26:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.168+0000 7fdd7e824700 1 --2- 172.21.15.59:0/883169742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd780926d0 0x7fdd781275c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.168+0000 7fdd7e824700 1 --2- 172.21.15.59:0/883169742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd78127be0 0x7fdd78128000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.168+0000 7fdd7e824700 1 -- 172.21.15.59:0/883169742 >> 172.21.15.59:0/883169742 conn(0x7fdd78097480 msgr2=0x7fdd78097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.168+0000 7fdd7e824700 1 -- 172.21.15.59:0/883169742 shutdown_connections 2023-09-30T22:26:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.168+0000 7fdd7e824700 1 -- 172.21.15.59:0/883169742 wait complete. 2023-09-30T22:26:49.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.169+0000 7fdd7e824700 1 Processor -- start 2023-09-30T22:26:49.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.169+0000 7fdd7e824700 1 -- start start 2023-09-30T22:26:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.169+0000 7fdd7e824700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd780926d0 0x7fdd78113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.169+0000 7fdd7e824700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd78127be0 0x7fdd78114410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.169+0000 7fdd7e824700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd7812a9a0 0x7fdd78114900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.169+0000 7fdd7e824700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd78114df0 con 0x7fdd7812a9a0 2023-09-30T22:26:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.169+0000 7fdd7e824700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd78115ab0 con 0x7fdd78127be0 2023-09-30T22:26:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd7e824700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7809a4b0 con 0x7fdd780926d0 2023-09-30T22:26:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd77fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd780926d0 0x7fdd78113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd777fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd78127be0 0x7fdd78114410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd77fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd780926d0 0x7fdd78113f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57458/0 (socket says 172.21.15.59:57458) 2023-09-30T22:26:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd7cdc1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd7812a9a0 0x7fdd78114900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd777fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd78127be0 0x7fdd78114410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41912/0 (socket says 172.21.15.59:41912) 2023-09-30T22:26:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd77fff700 1 -- 172.21.15.59:0/311719769 learned_addr learned my addr 172.21.15.59:0/311719769 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd77fff700 1 -- 172.21.15.59:0/311719769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd78127be0 msgr2=0x7fdd78114410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd77fff700 1 --2- 172.21.15.59:0/311719769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd78127be0 0x7fdd78114410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd77fff700 1 -- 172.21.15.59:0/311719769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd7812a9a0 msgr2=0x7fdd78114900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd77fff700 1 --2- 172.21.15.59:0/311719769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd7812a9a0 0x7fdd78114900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd77fff700 1 -- 172.21.15.59:0/311719769 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c0092a0 con 0x7fdd780926d0 2023-09-30T22:26:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd777fe700 1 --2- 172.21.15.59:0/311719769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd78127be0 0x7fdd78114410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd7cdc1700 1 --2- 172.21.15.59:0/311719769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd7812a9a0 0x7fdd78114900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd77fff700 1 --2- 172.21.15.59:0/311719769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd780926d0 0x7fdd78113f20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fdd68009e30 tx=0x7fdd68017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.170+0000 7fdd5ffff700 1 -- 172.21.15.59:0/311719769 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd680116e0 con 0x7fdd780926d0 2023-09-30T22:26:49.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.171+0000 7fdd5ffff700 1 -- 172.21.15.59:0/311719769 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd68011840 con 0x7fdd780926d0 2023-09-30T22:26:49.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.171+0000 7fdd7e824700 1 -- 172.21.15.59:0/311719769 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd680092a0 con 0x7fdd780926d0 2023-09-30T22:26:49.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.171+0000 7fdd5ffff700 1 -- 172.21.15.59:0/311719769 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68011c00 con 0x7fdd780926d0 2023-09-30T22:26:49.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.171+0000 7fdd7e824700 1 -- 172.21.15.59:0/311719769 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd781176e0 con 0x7fdd780926d0 2023-09-30T22:26:49.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.172+0000 7fdd7e824700 1 -- 172.21.15.59:0/311719769 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd780937b0 con 0x7fdd780926d0 2023-09-30T22:26:49.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.172+0000 7fdd5ffff700 1 -- 172.21.15.59:0/311719769 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fdd68033440 con 0x7fdd780926d0 2023-09-30T22:26:49.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.172+0000 7fdd5ffff700 1 -- 172.21.15.59:0/311719769 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fdd68044c30 con 0x7fdd780926d0 2023-09-30T22:26:49.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.176+0000 7fdd5ffff700 1 -- 172.21.15.59:0/311719769 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fdd780937b0 con 0x7fdd780926d0 2023-09-30T22:26:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.351+0000 7fdd7e824700 1 -- 172.21.15.59:0/311719769 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdd780937b0 con 0x7fdd780926d0 2023-09-30T22:26:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.351+0000 7fdd5ffff700 1 -- 172.21.15.59:0/311719769 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdd780937b0 con 0x7fdd780926d0 2023-09-30T22:26:49.351 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-30T22:26:49.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.353+0000 7fdd7e824700 1 -- 172.21.15.59:0/311719769 >> v1:172.21.15.59:6816/118188 conn(0x7fdd6402bb90 legacy=0x7fdd6402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.353+0000 7fdd7e824700 1 -- 172.21.15.59:0/311719769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd780926d0 msgr2=0x7fdd78113f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.353+0000 7fdd7e824700 1 --2- 172.21.15.59:0/311719769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd780926d0 0x7fdd78113f20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fdd68009e30 tx=0x7fdd68017000).stop 2023-09-30T22:26:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.353+0000 7fdd7e824700 1 -- 172.21.15.59:0/311719769 shutdown_connections 2023-09-30T22:26:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.353+0000 7fdd7e824700 1 --2- 172.21.15.59:0/311719769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd780926d0 0x7fdd78113f20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.353+0000 7fdd7e824700 1 --2- 172.21.15.59:0/311719769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd7812a9a0 0x7fdd78114900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.353+0000 7fdd7e824700 1 --2- 172.21.15.59:0/311719769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd78127be0 0x7fdd78114410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.353+0000 7fdd7e824700 1 -- 172.21.15.59:0/311719769 >> 172.21.15.59:0/311719769 conn(0x7fdd78097480 msgr2=0x7fdd780969b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.353+0000 7fdd7e824700 1 -- 172.21.15.59:0/311719769 shutdown_connections 2023-09-30T22:26:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.353+0000 7fdd7e824700 1 -- 172.21.15.59:0/311719769 wait complete. 2023-09-30T22:26:49.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:26:49.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.496+0000 7f093cd30700 1 Processor -- start 2023-09-30T22:26:49.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.496+0000 7f093cd30700 1 -- start start 2023-09-30T22:26:49.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.497+0000 7f093cd30700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0938096380 0x7f0938094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:49.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.497+0000 7f093cd30700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0938091b00 0x7f0938127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.497+0000 7f093cd30700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0938096760 con 0x7f0938094c20 2023-09-30T22:26:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.497+0000 7f093cd30700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0938091ff0 con 0x7f0938091b00 2023-09-30T22:26:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.497+0000 7f093cd30700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0938092c80 con 0x7f0938096380 2023-09-30T22:26:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.497+0000 7f093659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0938096380 0x7f0938094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.497+0000 7f0935d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0938091b00 0x7f0938127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.497+0000 7f0936d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0938094c20 0x7f0938127af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49484/0 (socket says 172.21.15.59:49484) 2023-09-30T22:26:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.497+0000 7f0936d9d700 1 -- 172.21.15.59:0/807109830 learned_addr learned my addr 172.21.15.59:0/807109830 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.497+0000 7f093659c700 1 -- 172.21.15.59:0/807109830 >> v2:172.21.15.59:3300/0 conn(0x7f0938091b00 msgr2=0x7f0938127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.497+0000 7f093659c700 1 --2- 172.21.15.59:0/807109830 >> v2:172.21.15.59:3300/0 conn(0x7f0938091b00 0x7f0938127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.497+0000 7f093659c700 1 -- 172.21.15.59:0/807109830 >> v1:172.21.15.59:6789/0 conn(0x7f0938094c20 legacy=0x7f0938127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.497+0000 7f093659c700 1 -- 172.21.15.59:0/807109830 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0938093900 con 0x7f0938096380 2023-09-30T22:26:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.497+0000 7f093559a700 1 -- 172.21.15.59:0/807109830 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619536572 0 0) 0x7f0938096760 con 0x7f0938094c20 2023-09-30T22:26:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.497+0000 7f0935d9b700 1 --2- 172.21.15.59:0/807109830 >> v2:172.21.15.59:3300/0 conn(0x7f0938091b00 0x7f0938127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.498+0000 7f093659c700 1 --2- 172.21.15.59:0/807109830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0938096380 0x7f0938094730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0928009790 tx=0x7f0928009060).ready entity=mon.2 client_cookie=29a279952d2f1213 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.498+0000 7f093559a700 1 -- 172.21.15.59:0/807109830 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092800f510 con 0x7f0938096380 2023-09-30T22:26:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.498+0000 7f093559a700 1 -- 172.21.15.59:0/807109830 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092800f670 con 0x7f0938096380 2023-09-30T22:26:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.498+0000 7f093559a700 1 -- 172.21.15.59:0/807109830 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092800f9f0 con 0x7f0938096380 2023-09-30T22:26:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.498+0000 7f093cd30700 1 -- 172.21.15.59:0/807109830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0938096380 msgr2=0x7f0938094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.498+0000 7f093cd30700 1 --2- 172.21.15.59:0/807109830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0938096380 0x7f0938094730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0928009790 tx=0x7f0928009060).stop 2023-09-30T22:26:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.498+0000 7f093cd30700 1 -- 172.21.15.59:0/807109830 shutdown_connections 2023-09-30T22:26:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.498+0000 7f093cd30700 1 --2- 172.21.15.59:0/807109830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0938096380 0x7f0938094730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.498+0000 7f093cd30700 1 --2- 172.21.15.59:0/807109830 >> v2:172.21.15.59:3300/0 conn(0x7f0938091b00 0x7f0938127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.498+0000 7f093cd30700 1 -- 172.21.15.59:0/807109830 >> 172.21.15.59:0/807109830 conn(0x7f0938097470 msgr2=0x7f0938097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.498+0000 7f093cd30700 1 -- 172.21.15.59:0/807109830 shutdown_connections 2023-09-30T22:26:49.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.498+0000 7f093cd30700 1 -- 172.21.15.59:0/807109830 wait complete. 2023-09-30T22:26:49.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.499+0000 7f093cd30700 1 Processor -- start 2023-09-30T22:26:49.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.499+0000 7f093cd30700 1 -- start start 2023-09-30T22:26:49.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f093cd30700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0938091b00 0x7f09381169c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:49.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f093cd30700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0938094c20 0x7f0938112990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:49.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f093cd30700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0938096380 0x7f0938112e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:49.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f093cd30700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0938124b00 con 0x7f0938096380 2023-09-30T22:26:49.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f093cd30700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093806a520 con 0x7f0938091b00 2023-09-30T22:26:49.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f093cd30700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09381164c0 con 0x7f0938094c20 2023-09-30T22:26:49.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f093659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0938091b00 0x7f09381169c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:49.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f0936d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0938096380 0x7f0938112e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:49.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f0935d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0938094c20 0x7f0938112990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:49.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f093659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0938091b00 0x7f09381169c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41924/0 (socket says 172.21.15.59:41924) 2023-09-30T22:26:49.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f093659c700 1 -- 172.21.15.59:0/2621437837 learned_addr learned my addr 172.21.15.59:0/2621437837 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:49.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f0935d9b700 1 -- 172.21.15.59:0/2621437837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0938091b00 msgr2=0x7f09381169c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f0935d9b700 1 --2- 172.21.15.59:0/2621437837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0938091b00 0x7f09381169c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f0935d9b700 1 -- 172.21.15.59:0/2621437837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0938096380 msgr2=0x7f0938112e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f0935d9b700 1 --2- 172.21.15.59:0/2621437837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0938096380 0x7f0938112e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f0935d9b700 1 -- 172.21.15.59:0/2621437837 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092000d740 con 0x7f0938094c20 2023-09-30T22:26:49.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f093659c700 1 --2- 172.21.15.59:0/2621437837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0938091b00 0x7f09381169c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.500+0000 7f0936d9d700 1 --2- 172.21.15.59:0/2621437837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0938096380 0x7f0938112e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.501+0000 7f0935d9b700 1 --2- 172.21.15.59:0/2621437837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0938094c20 0x7f0938112990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0920012ce0 tx=0x7f092000f040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.501+0000 7f092e7fc700 1 -- 172.21.15.59:0/2621437837 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092000da20 con 0x7f0938094c20 2023-09-30T22:26:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.501+0000 7f092e7fc700 1 -- 172.21.15.59:0/2621437837 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0920013040 con 0x7f0938094c20 2023-09-30T22:26:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.501+0000 7f093cd30700 1 -- 172.21.15.59:0/2621437837 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09280092a0 con 0x7f0938094c20 2023-09-30T22:26:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.501+0000 7f092e7fc700 1 -- 172.21.15.59:0/2621437837 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09200108f0 con 0x7f0938094c20 2023-09-30T22:26:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.501+0000 7f093cd30700 1 -- 172.21.15.59:0/2621437837 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0938114770 con 0x7f0938094c20 2023-09-30T22:26:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.501+0000 7f092e7fc700 1 -- 172.21.15.59:0/2621437837 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0920010ca0 con 0x7f0938094c20 2023-09-30T22:26:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.502+0000 7f092e7fc700 1 -- 172.21.15.59:0/2621437837 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f092003ecb0 con 0x7f0938094c20 2023-09-30T22:26:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.502+0000 7f093cd30700 1 -- 172.21.15.59:0/2621437837 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0938065120 con 0x7f0938094c20 2023-09-30T22:26:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.506+0000 7f092e7fc700 1 -- 172.21.15.59:0/2621437837 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f092000b970 con 0x7f0938094c20 2023-09-30T22:26:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.725+0000 7f093cd30700 1 -- 172.21.15.59:0/2621437837 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0938113790 con 0x7f0938094c20 2023-09-30T22:26:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.725+0000 7f092e7fc700 1 -- 172.21.15.59:0/2621437837 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f0920016b50 con 0x7f0938094c20 2023-09-30T22:26:49.725 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:49.726 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:26:34.412591+0000","modified":"2023-09-30T22:26:37.427658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/2103029646","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":2103029646}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:26:49.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.727+0000 7f093cd30700 1 -- 172.21.15.59:0/2621437837 >> v1:172.21.15.59:6816/118188 conn(0x7f091802bb60 legacy=0x7f091802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.727+0000 7f093cd30700 1 -- 172.21.15.59:0/2621437837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0938094c20 msgr2=0x7f0938112990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.727+0000 7f093cd30700 1 --2- 172.21.15.59:0/2621437837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0938094c20 0x7f0938112990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0920012ce0 tx=0x7f092000f040).stop 2023-09-30T22:26:49.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.727+0000 7f093cd30700 1 -- 172.21.15.59:0/2621437837 shutdown_connections 2023-09-30T22:26:49.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.727+0000 7f093cd30700 1 --2- 172.21.15.59:0/2621437837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0938096380 0x7f0938112e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.727+0000 7f093cd30700 1 --2- 172.21.15.59:0/2621437837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0938091b00 0x7f09381169c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.727+0000 7f093cd30700 1 --2- 172.21.15.59:0/2621437837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0938094c20 0x7f0938112990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.728+0000 7f093cd30700 1 -- 172.21.15.59:0/2621437837 >> 172.21.15.59:0/2621437837 conn(0x7f0938097470 msgr2=0x7f0938126b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.728+0000 7f093cd30700 1 -- 172.21.15.59:0/2621437837 shutdown_connections 2023-09-30T22:26:49.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.728+0000 7f093cd30700 1 -- 172.21.15.59:0/2621437837 wait complete. 2023-09-30T22:26:49.729 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 6 2023-09-30T22:26:49.741 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:26:49.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.870+0000 7f0d1fe59700 1 Processor -- start 2023-09-30T22:26:49.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.871+0000 7f0d1fe59700 1 -- start start 2023-09-30T22:26:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.871+0000 7f0d1fe59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d18098d50 0x7f0d18130480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.871+0000 7f0d1fe59700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d18099190 0x7f0d18132980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.871+0000 7f0d1fe59700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d18065ed0 con 0x7f0d180654a0 2023-09-30T22:26:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.871+0000 7f0d1fe59700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d18095880 con 0x7f0d18098d50 2023-09-30T22:26:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.871+0000 7f0d1fe59700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d18096120 con 0x7f0d18099190 2023-09-30T22:26:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.871+0000 7f0d1dbf5700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0d180654a0 0x7f0d18098640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49500/0 (socket says 172.21.15.59:49500) 2023-09-30T22:26:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.871+0000 7f0d1dbf5700 1 -- 172.21.15.59:0/4009294514 learned_addr learned my addr 172.21.15.59:0/4009294514 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.871+0000 7f0d1e3f6700 1 --2- 172.21.15.59:0/4009294514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d18099190 0x7f0d18132980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.871+0000 7f0d1d3f4700 1 --2- 172.21.15.59:0/4009294514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d18098d50 0x7f0d18130480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.872+0000 7f0d1cbf3700 1 -- 172.21.15.59:0/4009294514 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173123054 0 0) 0x7f0d18065ed0 con 0x7f0d180654a0 2023-09-30T22:26:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.872+0000 7f0d1cbf3700 1 -- 172.21.15.59:0/4009294514 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d040033f0 con 0x7f0d180654a0 2023-09-30T22:26:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.872+0000 7f0d1e3f6700 1 -- 172.21.15.59:0/4009294514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d18098d50 msgr2=0x7f0d18130480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.872+0000 7f0d1e3f6700 1 --2- 172.21.15.59:0/4009294514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d18098d50 0x7f0d18130480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.872+0000 7f0d1e3f6700 1 -- 172.21.15.59:0/4009294514 >> v1:172.21.15.59:6789/0 conn(0x7f0d180654a0 legacy=0x7f0d18098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.872+0000 7f0d1e3f6700 1 -- 172.21.15.59:0/4009294514 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d18066280 con 0x7f0d18099190 2023-09-30T22:26:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.872+0000 7f0d1e3f6700 1 --2- 172.21.15.59:0/4009294514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d18099190 0x7f0d18132980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0d10009e90 tx=0x7f0d10009780).ready entity=mon.2 client_cookie=db467de474cfc2f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.872+0000 7f0d1cbf3700 1 -- 172.21.15.59:0/4009294514 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1000e070 con 0x7f0d18099190 2023-09-30T22:26:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.872+0000 7f0d1cbf3700 1 -- 172.21.15.59:0/4009294514 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1000bab0 con 0x7f0d18099190 2023-09-30T22:26:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.872+0000 7f0d1cbf3700 1 -- 172.21.15.59:0/4009294514 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1000be30 con 0x7f0d18099190 2023-09-30T22:26:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.873+0000 7f0d1fe59700 1 -- 172.21.15.59:0/4009294514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d18099190 msgr2=0x7f0d18132980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.873+0000 7f0d1fe59700 1 --2- 172.21.15.59:0/4009294514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d18099190 0x7f0d18132980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0d10009e90 tx=0x7f0d10009780).stop 2023-09-30T22:26:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.873+0000 7f0d1fe59700 1 -- 172.21.15.59:0/4009294514 shutdown_connections 2023-09-30T22:26:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.873+0000 7f0d1fe59700 1 --2- 172.21.15.59:0/4009294514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d18099190 0x7f0d18132980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.873+0000 7f0d1fe59700 1 --2- 172.21.15.59:0/4009294514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d18098d50 0x7f0d18130480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.873+0000 7f0d1fe59700 1 -- 172.21.15.59:0/4009294514 >> 172.21.15.59:0/4009294514 conn(0x7f0d1809a740 msgr2=0x7f0d1809ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.873+0000 7f0d1fe59700 1 -- 172.21.15.59:0/4009294514 shutdown_connections 2023-09-30T22:26:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.873+0000 7f0d1fe59700 1 -- 172.21.15.59:0/4009294514 wait complete. 2023-09-30T22:26:49.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.874+0000 7f0d1fe59700 1 Processor -- start 2023-09-30T22:26:49.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.874+0000 7f0d1fe59700 1 -- start start 2023-09-30T22:26:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.874+0000 7f0d1fe59700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d180654a0 0x7f0d1813a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.874+0000 7f0d1fe59700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d18098d50 0x7f0d1813a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.874+0000 7f0d1fe59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d18099190 0x7f0d1813ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.874+0000 7f0d1fe59700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1811de90 con 0x7f0d180654a0 2023-09-30T22:26:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.874+0000 7f0d1fe59700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d18099b00 con 0x7f0d18099190 2023-09-30T22:26:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.874+0000 7f0d1fe59700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1809c7b0 con 0x7f0d18098d50 2023-09-30T22:26:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.874+0000 7f0d1dbf5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d180654a0 0x7f0d1813a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.874+0000 7f0d1dbf5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d180654a0 0x7f0d1813a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53270/0 (socket says 172.21.15.59:53270) 2023-09-30T22:26:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.874+0000 7f0d1dbf5700 1 -- 172.21.15.59:0/138462586 learned_addr learned my addr 172.21.15.59:0/138462586 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.875+0000 7f0d1d3f4700 1 --2- 172.21.15.59:0/138462586 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d18098d50 0x7f0d1813a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:49.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.875+0000 7f0d1e3f6700 1 --2- 172.21.15.59:0/138462586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d18099190 0x7f0d1813ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:49.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.875+0000 7f0d1dbf5700 1 -- 172.21.15.59:0/138462586 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d18098d50 msgr2=0x7f0d1813a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.875+0000 7f0d1dbf5700 1 --2- 172.21.15.59:0/138462586 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d18098d50 0x7f0d1813a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.875+0000 7f0d1dbf5700 1 -- 172.21.15.59:0/138462586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d18099190 msgr2=0x7f0d1813ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.875+0000 7f0d1dbf5700 1 --2- 172.21.15.59:0/138462586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d18099190 0x7f0d1813ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:49.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.875+0000 7f0d1dbf5700 1 -- 172.21.15.59:0/138462586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d10009a20 con 0x7f0d180654a0 2023-09-30T22:26:49.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.875+0000 7f0d1dbf5700 1 --2- 172.21.15.59:0/138462586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d180654a0 0x7f0d1813a120 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f0d1400c5c0 tx=0x7f0d14007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.876+0000 7f0d0dffb700 1 -- 172.21.15.59:0/138462586 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d140072e0 con 0x7f0d180654a0 2023-09-30T22:26:49.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.876+0000 7f0d0dffb700 1 -- 172.21.15.59:0/138462586 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d14007440 con 0x7f0d180654a0 2023-09-30T22:26:49.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.876+0000 7f0d0dffb700 1 -- 172.21.15.59:0/138462586 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d140057a0 con 0x7f0d180654a0 2023-09-30T22:26:49.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.876+0000 7f0d1fe59700 1 -- 172.21.15.59:0/138462586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1811c920 con 0x7f0d180654a0 2023-09-30T22:26:49.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.877+0000 7f0d1fe59700 1 -- 172.21.15.59:0/138462586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1811bf30 con 0x7f0d180654a0 2023-09-30T22:26:49.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.877+0000 7f0d0dffb700 1 -- 172.21.15.59:0/138462586 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0d14005bd0 con 0x7f0d180654a0 2023-09-30T22:26:49.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.877+0000 7f0d0dffb700 1 -- 172.21.15.59:0/138462586 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f0d1403a7e0 con 0x7f0d180654a0 2023-09-30T22:26:49.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.878+0000 7f0d1fe59700 1 -- 172.21.15.59:0/138462586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1805a260 con 0x7f0d180654a0 2023-09-30T22:26:49.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:49.883+0000 7f0d0dffb700 1 -- 172.21.15.59:0/138462586 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0d140123b0 con 0x7f0d180654a0 2023-09-30T22:26:50.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.063+0000 7f0d1fe59700 1 -- 172.21.15.59:0/138462586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d1811da80 con 0x7f0d180654a0 2023-09-30T22:26:50.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.064+0000 7f0d0dffb700 1 -- 172.21.15.59:0/138462586 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11343 (secure 0 0 0) 0x7f0d1401b300 con 0x7f0d180654a0 2023-09-30T22:26:50.064 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:50.064 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":18,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:26:35.416181+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:26:50.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.066+0000 7f0d1fe59700 1 -- 172.21.15.59:0/138462586 >> v1:172.21.15.59:6816/118188 conn(0x7f0cfc02bb60 legacy=0x7f0cfc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.066+0000 7f0d1fe59700 1 -- 172.21.15.59:0/138462586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d180654a0 msgr2=0x7f0d1813a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.066+0000 7f0d1fe59700 1 --2- 172.21.15.59:0/138462586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d180654a0 0x7f0d1813a120 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f0d1400c5c0 tx=0x7f0d14007c80).stop 2023-09-30T22:26:50.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.066+0000 7f0d1fe59700 1 -- 172.21.15.59:0/138462586 shutdown_connections 2023-09-30T22:26:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.066+0000 7f0d1fe59700 1 --2- 172.21.15.59:0/138462586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d18099190 0x7f0d1813ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.066+0000 7f0d1fe59700 1 --2- 172.21.15.59:0/138462586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d180654a0 0x7f0d1813a120 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.066+0000 7f0d1fe59700 1 --2- 172.21.15.59:0/138462586 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d18098d50 0x7f0d1813a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.066+0000 7f0d1fe59700 1 -- 172.21.15.59:0/138462586 >> 172.21.15.59:0/138462586 conn(0x7f0d1809a740 msgr2=0x7f0d1809dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.066+0000 7f0d1fe59700 1 -- 172.21.15.59:0/138462586 shutdown_connections 2023-09-30T22:26:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.066+0000 7f0d1fe59700 1 -- 172.21.15.59:0/138462586 wait complete. 2023-09-30T22:26:50.079 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:26:26.893716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:26:28.448775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:26:32.964075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:26:33.390842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:26:50.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:26:50.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.213+0000 7f5170bfc700 1 Processor -- start 2023-09-30T22:26:50.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.213+0000 7f5170bfc700 1 -- start start 2023-09-30T22:26:50.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.213+0000 7f5170bfc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f516c093840 0x7f516c098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.213+0000 7f5170bfc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f516c098c80 0x7f516c099060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.213+0000 7f5170bfc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f516c12c150 0x7f516c12e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.213+0000 7f5170bfc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516c093c20 con 0x7f516c098c80 2023-09-30T22:26:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.213+0000 7f5170bfc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516c092b90 con 0x7f516c093840 2023-09-30T22:26:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.213+0000 7f5170bfc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f516c092d80 con 0x7f516c12c150 2023-09-30T22:26:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.213+0000 7f516a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f516c093840 0x7f516c098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.213+0000 7f5169d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f516c098c80 0x7f516c099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.213+0000 7f516ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f516c12c150 0x7f516c12e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.213+0000 7f5169d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f516c098c80 0x7f516c099060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53274/0 (socket says 172.21.15.59:53274) 2023-09-30T22:26:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.213+0000 7f516a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f516c093840 0x7f516c098790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41962/0 (socket says 172.21.15.59:41962) 2023-09-30T22:26:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.214+0000 7f516ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f516c12c150 0x7f516c12e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57494/0 (socket says 172.21.15.59:57494) 2023-09-30T22:26:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.214+0000 7f5169d9b700 1 -- 172.21.15.59:0/1225361156 learned_addr learned my addr 172.21.15.59:0/1225361156 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.214+0000 7f5169d9b700 1 -- 172.21.15.59:0/1225361156 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f516c12c150 msgr2=0x7f516c12e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.214+0000 7f5169d9b700 1 --2- 172.21.15.59:0/1225361156 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f516c12c150 0x7f516c12e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.214+0000 7f5169d9b700 1 -- 172.21.15.59:0/1225361156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f516c093840 msgr2=0x7f516c098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.214+0000 7f5169d9b700 1 --2- 172.21.15.59:0/1225361156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f516c093840 0x7f516c098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.214+0000 7f5169d9b700 1 -- 172.21.15.59:0/1225361156 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c099b70 con 0x7f516c098c80 2023-09-30T22:26:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.214+0000 7f516ad9d700 1 --2- 172.21.15.59:0/1225361156 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f516c12c150 0x7f516c12e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.214+0000 7f516a59c700 1 --2- 172.21.15.59:0/1225361156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f516c093840 0x7f516c098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.214+0000 7f5169d9b700 1 --2- 172.21.15.59:0/1225361156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c098c80 0x7f516c099060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5160006fd0 tx=0x7f51600090f0).ready entity=mon.0 client_cookie=c598b138c0d67f01 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.214+0000 7f516959a700 1 -- 172.21.15.59:0/1225361156 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516000f510 con 0x7f516c098c80 2023-09-30T22:26:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.214+0000 7f516959a700 1 -- 172.21.15.59:0/1225361156 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516000f670 con 0x7f516c098c80 2023-09-30T22:26:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.214+0000 7f516959a700 1 -- 172.21.15.59:0/1225361156 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516000f9f0 con 0x7f516c098c80 2023-09-30T22:26:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.215+0000 7f5170bfc700 1 -- 172.21.15.59:0/1225361156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c098c80 msgr2=0x7f516c099060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.215+0000 7f5170bfc700 1 --2- 172.21.15.59:0/1225361156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c098c80 0x7f516c099060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5160006fd0 tx=0x7f51600090f0).stop 2023-09-30T22:26:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.215+0000 7f5170bfc700 1 -- 172.21.15.59:0/1225361156 shutdown_connections 2023-09-30T22:26:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.215+0000 7f5170bfc700 1 --2- 172.21.15.59:0/1225361156 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f516c12c150 0x7f516c12e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.215+0000 7f5170bfc700 1 --2- 172.21.15.59:0/1225361156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f516c093840 0x7f516c098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.215+0000 7f5170bfc700 1 --2- 172.21.15.59:0/1225361156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c098c80 0x7f516c099060 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.215+0000 7f5170bfc700 1 -- 172.21.15.59:0/1225361156 >> 172.21.15.59:0/1225361156 conn(0x7f516c097480 msgr2=0x7f516c097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.215+0000 7f5170bfc700 1 -- 172.21.15.59:0/1225361156 shutdown_connections 2023-09-30T22:26:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.215+0000 7f5170bfc700 1 -- 172.21.15.59:0/1225361156 wait complete. 2023-09-30T22:26:50.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.216+0000 7f5170bfc700 1 Processor -- start 2023-09-30T22:26:50.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.216+0000 7f5170bfc700 1 -- start start 2023-09-30T22:26:50.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.216+0000 7f5170bfc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c093840 0x7f516c066510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.216+0000 7f5170bfc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f516c098c80 0x7f516c066a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.216+0000 7f5170bfc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f516c12c150 0x7f516c066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.216+0000 7f5170bfc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c0673e0 con 0x7f516c093840 2023-09-30T22:26:50.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.216+0000 7f5170bfc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516c11da80 con 0x7f516c12c150 2023-09-30T22:26:50.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.216+0000 7f5170bfc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f516c11e940 con 0x7f516c098c80 2023-09-30T22:26:50.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.216+0000 7f5169d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f516c098c80 0x7f516c066a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.216+0000 7f516ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f516c12c150 0x7f516c066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.216+0000 7f516ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f516c12c150 0x7f516c066ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41978/0 (socket says 172.21.15.59:41978) 2023-09-30T22:26:50.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.216+0000 7f516ad9d700 1 -- 172.21.15.59:0/3330803918 learned_addr learned my addr 172.21.15.59:0/3330803918 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:50.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.216+0000 7f516a59c700 1 --2- 172.21.15.59:0/3330803918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c093840 0x7f516c066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.216+0000 7f5169d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f516c098c80 0x7f516c066a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57508/0 (socket says 172.21.15.59:57508) 2023-09-30T22:26:50.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.217+0000 7f516a59c700 1 -- 172.21.15.59:0/3330803918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f516c098c80 msgr2=0x7f516c066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.217+0000 7f516a59c700 1 --2- 172.21.15.59:0/3330803918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f516c098c80 0x7f516c066a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.217+0000 7f516a59c700 1 -- 172.21.15.59:0/3330803918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f516c12c150 msgr2=0x7f516c066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.217+0000 7f516a59c700 1 --2- 172.21.15.59:0/3330803918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f516c12c150 0x7f516c066ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.217+0000 7f516a59c700 1 -- 172.21.15.59:0/3330803918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c0092a0 con 0x7f516c093840 2023-09-30T22:26:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.217+0000 7f516ad9d700 1 --2- 172.21.15.59:0/3330803918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f516c12c150 0x7f516c066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.217+0000 7f516a59c700 1 --2- 172.21.15.59:0/3330803918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c093840 0x7f516c066510 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f515c00e9b0 tx=0x7f515c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.217+0000 7f515a7fc700 1 -- 172.21.15.59:0/3330803918 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c009580 con 0x7f516c093840 2023-09-30T22:26:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.217+0000 7f515a7fc700 1 -- 172.21.15.59:0/3330803918 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c012600 con 0x7f516c093840 2023-09-30T22:26:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.217+0000 7f5170bfc700 1 -- 172.21.15.59:0/3330803918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5164009a20 con 0x7f516c093840 2023-09-30T22:26:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.217+0000 7f515a7fc700 1 -- 172.21.15.59:0/3330803918 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c012980 con 0x7f516c093840 2023-09-30T22:26:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.217+0000 7f5170bfc700 1 -- 172.21.15.59:0/3330803918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5160009370 con 0x7f516c093840 2023-09-30T22:26:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.218+0000 7f515a7fc700 1 -- 172.21.15.59:0/3330803918 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f515c01b400 con 0x7f516c093840 2023-09-30T22:26:50.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.218+0000 7f515a7fc700 1 -- 172.21.15.59:0/3330803918 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f515c03b370 con 0x7f516c093840 2023-09-30T22:26:50.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.218+0000 7f5170bfc700 1 -- 172.21.15.59:0/3330803918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516c11d500 con 0x7f516c093840 2023-09-30T22:26:50.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.223+0000 7f515a7fc700 1 -- 172.21.15.59:0/3330803918 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f515c016020 con 0x7f516c093840 2023-09-30T22:26:50.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.394+0000 7f5170bfc700 1 -- 172.21.15.59:0/3330803918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f516c05a260 con 0x7f516c093840 2023-09-30T22:26:50.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.395+0000 7f515a7fc700 1 -- 172.21.15.59:0/3330803918 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f515c019310 con 0x7f516c093840 2023-09-30T22:26:50.395 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-30T22:26:50.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.397+0000 7f5170bfc700 1 -- 172.21.15.59:0/3330803918 >> v1:172.21.15.59:6816/118188 conn(0x7f514c02bb60 legacy=0x7f514c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.397+0000 7f5170bfc700 1 -- 172.21.15.59:0/3330803918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c093840 msgr2=0x7f516c066510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.397+0000 7f5170bfc700 1 --2- 172.21.15.59:0/3330803918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c093840 0x7f516c066510 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f515c00e9b0 tx=0x7f515c009060).stop 2023-09-30T22:26:50.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.397+0000 7f5170bfc700 1 -- 172.21.15.59:0/3330803918 shutdown_connections 2023-09-30T22:26:50.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.397+0000 7f5170bfc700 1 --2- 172.21.15.59:0/3330803918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f516c12c150 0x7f516c066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.397+0000 7f5170bfc700 1 --2- 172.21.15.59:0/3330803918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f516c093840 0x7f516c066510 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.397+0000 7f5170bfc700 1 --2- 172.21.15.59:0/3330803918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f516c098c80 0x7f516c066a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.397+0000 7f5170bfc700 1 -- 172.21.15.59:0/3330803918 >> 172.21.15.59:0/3330803918 conn(0x7f516c097480 msgr2=0x7f516c059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.397+0000 7f5170bfc700 1 -- 172.21.15.59:0/3330803918 shutdown_connections 2023-09-30T22:26:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.397+0000 7f5170bfc700 1 -- 172.21.15.59:0/3330803918 wait complete. 2023-09-30T22:26:50.410 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:26:50.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.547+0000 7f351d3b1700 1 Processor -- start 2023-09-30T22:26:50.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.547+0000 7f351d3b1700 1 -- start start 2023-09-30T22:26:50.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.547+0000 7f351d3b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35180653a0 0x7f3518098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.547+0000 7f351d3b1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3518098b30 0x7f3518098f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.547+0000 7f351d3b1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35180663b0 con 0x7f351812f430 2023-09-30T22:26:50.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.547+0000 7f351d3b1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3518065e80 con 0x7f3518098b30 2023-09-30T22:26:50.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.547+0000 7f351d3b1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3518065780 con 0x7f35180653a0 2023-09-30T22:26:50.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.547+0000 7f35167fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3518098b30 0x7f3518098f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.547+0000 7f3516ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35180653a0 0x7f3518098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.547+0000 7f35167fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3518098b30 0x7f3518098f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53290/0 (socket says 172.21.15.59:53290) 2023-09-30T22:26:50.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.547+0000 7f35177fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f351812f430 0x7f3518131820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49516/0 (socket says 172.21.15.59:49516) 2023-09-30T22:26:50.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.547+0000 7f35167fc700 1 -- 172.21.15.59:0/135367768 learned_addr learned my addr 172.21.15.59:0/135367768 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:50.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.547+0000 7f3516ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35180653a0 0x7f3518098640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41988/0 (socket says 172.21.15.59:41988) 2023-09-30T22:26:50.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.548+0000 7f35167fc700 1 -- 172.21.15.59:0/135367768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35180653a0 msgr2=0x7f3518098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:50.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.548+0000 7f35167fc700 1 --2- 172.21.15.59:0/135367768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35180653a0 0x7f3518098640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.548+0000 7f35167fc700 1 -- 172.21.15.59:0/135367768 >> v1:172.21.15.59:6789/0 conn(0x7f351812f430 legacy=0x7f3518131820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.548+0000 7f35167fc700 1 -- 172.21.15.59:0/135367768 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3518096180 con 0x7f3518098b30 2023-09-30T22:26:50.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.548+0000 7f3515ffb700 1 -- 172.21.15.59:0/135367768 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511693417 0 0) 0x7f35180663b0 con 0x7f351812f430 2023-09-30T22:26:50.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.548+0000 7f3516ffd700 1 --2- 172.21.15.59:0/135367768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35180653a0 0x7f3518098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:50.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.548+0000 7f35167fc700 1 --2- 172.21.15.59:0/135367768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3518098b30 0x7f3518098f10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f350c009830 tx=0x7f350c0090f0).ready entity=mon.0 client_cookie=7b1d77a32abf064b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.548+0000 7f3515ffb700 1 -- 172.21.15.59:0/135367768 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c00b580 con 0x7f3518098b30 2023-09-30T22:26:50.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.548+0000 7f3515ffb700 1 -- 172.21.15.59:0/135367768 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c00b6e0 con 0x7f3518098b30 2023-09-30T22:26:50.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.548+0000 7f3515ffb700 1 -- 172.21.15.59:0/135367768 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c00ba60 con 0x7f3518098b30 2023-09-30T22:26:50.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.549+0000 7f351d3b1700 1 -- 172.21.15.59:0/135367768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3518098b30 msgr2=0x7f3518098f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.549+0000 7f351d3b1700 1 --2- 172.21.15.59:0/135367768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3518098b30 0x7f3518098f10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f350c009830 tx=0x7f350c0090f0).stop 2023-09-30T22:26:50.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.549+0000 7f351d3b1700 1 -- 172.21.15.59:0/135367768 shutdown_connections 2023-09-30T22:26:50.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.549+0000 7f351d3b1700 1 --2- 172.21.15.59:0/135367768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35180653a0 0x7f3518098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.549+0000 7f351d3b1700 1 --2- 172.21.15.59:0/135367768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3518098b30 0x7f3518098f10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.549+0000 7f351d3b1700 1 -- 172.21.15.59:0/135367768 >> 172.21.15.59:0/135367768 conn(0x7f351809dc20 msgr2=0x7f351809e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:50.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.549+0000 7f351d3b1700 1 -- 172.21.15.59:0/135367768 shutdown_connections 2023-09-30T22:26:50.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.549+0000 7f351d3b1700 1 -- 172.21.15.59:0/135367768 wait complete. 2023-09-30T22:26:50.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.550+0000 7f351d3b1700 1 Processor -- start 2023-09-30T22:26:50.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.550+0000 7f351d3b1700 1 -- start start 2023-09-30T22:26:50.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.550+0000 7f351d3b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35180653a0 0x7f351811e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.550+0000 7f351d3b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3518098b30 0x7f351811a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.550+0000 7f351d3b1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351812f430 0x7f351811a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.550+0000 7f351d3b1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351811ea80 con 0x7f351812f430 2023-09-30T22:26:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.550+0000 7f351d3b1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3518099a90 con 0x7f35180653a0 2023-09-30T22:26:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.550+0000 7f351d3b1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f351811de00 con 0x7f3518098b30 2023-09-30T22:26:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.550+0000 7f35177fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351812f430 0x7f351811a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.550+0000 7f35167fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3518098b30 0x7f351811a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.550+0000 7f3516ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35180653a0 0x7f351811e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.550+0000 7f35167fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3518098b30 0x7f351811a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57512/0 (socket says 172.21.15.59:57512) 2023-09-30T22:26:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.550+0000 7f35177fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351812f430 0x7f351811a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53306/0 (socket says 172.21.15.59:53306) 2023-09-30T22:26:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.550+0000 7f35167fc700 1 -- 172.21.15.59:0/2863175781 learned_addr learned my addr 172.21.15.59:0/2863175781 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.551+0000 7f3516ffd700 1 -- 172.21.15.59:0/2863175781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3518098b30 msgr2=0x7f351811a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.551+0000 7f3516ffd700 1 --2- 172.21.15.59:0/2863175781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3518098b30 0x7f351811a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.551+0000 7f3516ffd700 1 -- 172.21.15.59:0/2863175781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351812f430 msgr2=0x7f351811a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.551+0000 7f3516ffd700 1 --2- 172.21.15.59:0/2863175781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351812f430 0x7f351811a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.551+0000 7f3516ffd700 1 -- 172.21.15.59:0/2863175781 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35080092a0 con 0x7f35180653a0 2023-09-30T22:26:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.551+0000 7f3516ffd700 1 --2- 172.21.15.59:0/2863175781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35180653a0 0x7f351811e300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f350800e980 tx=0x7f3508009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.551+0000 7f34feffd700 1 -- 172.21.15.59:0/2863175781 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508009580 con 0x7f35180653a0 2023-09-30T22:26:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.551+0000 7f34feffd700 1 -- 172.21.15.59:0/2863175781 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3508012600 con 0x7f35180653a0 2023-09-30T22:26:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.551+0000 7f351d3b1700 1 -- 172.21.15.59:0/2863175781 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c009370 con 0x7f35180653a0 2023-09-30T22:26:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.551+0000 7f34feffd700 1 -- 172.21.15.59:0/2863175781 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508012980 con 0x7f35180653a0 2023-09-30T22:26:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.551+0000 7f351d3b1700 1 -- 172.21.15.59:0/2863175781 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351811bef0 con 0x7f35180653a0 2023-09-30T22:26:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.552+0000 7f34feffd700 1 -- 172.21.15.59:0/2863175781 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3508012d30 con 0x7f35180653a0 2023-09-30T22:26:50.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.552+0000 7f34feffd700 1 -- 172.21.15.59:0/2863175781 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f350803b490 con 0x7f35180653a0 2023-09-30T22:26:50.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.552+0000 7f351d3b1700 1 -- 172.21.15.59:0/2863175781 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351805a260 con 0x7f35180653a0 2023-09-30T22:26:50.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.557+0000 7f34feffd700 1 -- 172.21.15.59:0/2863175781 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3508016020 con 0x7f35180653a0 2023-09-30T22:26:50.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.732+0000 7f351d3b1700 1 -- 172.21.15.59:0/2863175781 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f351811b1d0 con 0x7f35180653a0 2023-09-30T22:26:50.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.732+0000 7f34feffd700 1 -- 172.21.15.59:0/2863175781 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f350802a0a0 con 0x7f35180653a0 2023-09-30T22:26:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-09-30T22:26:50.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.734+0000 7f351d3b1700 1 -- 172.21.15.59:0/2863175781 >> v1:172.21.15.59:6816/118188 conn(0x7f350402bb60 legacy=0x7f350402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.734+0000 7f351d3b1700 1 -- 172.21.15.59:0/2863175781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35180653a0 msgr2=0x7f351811e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.734+0000 7f351d3b1700 1 --2- 172.21.15.59:0/2863175781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35180653a0 0x7f351811e300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f350800e980 tx=0x7f3508009060).stop 2023-09-30T22:26:50.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.734+0000 7f351d3b1700 1 -- 172.21.15.59:0/2863175781 shutdown_connections 2023-09-30T22:26:50.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.734+0000 7f351d3b1700 1 --2- 172.21.15.59:0/2863175781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351812f430 0x7f351811a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.734+0000 7f351d3b1700 1 --2- 172.21.15.59:0/2863175781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35180653a0 0x7f351811e300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.734+0000 7f351d3b1700 1 --2- 172.21.15.59:0/2863175781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3518098b30 0x7f351811a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.734+0000 7f351d3b1700 1 -- 172.21.15.59:0/2863175781 >> 172.21.15.59:0/2863175781 conn(0x7f351809dc20 msgr2=0x7f351809bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:50.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.734+0000 7f351d3b1700 1 -- 172.21.15.59:0/2863175781 shutdown_connections 2023-09-30T22:26:50.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.734+0000 7f351d3b1700 1 -- 172.21.15.59:0/2863175781 wait complete. 2023-09-30T22:26:50.747 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:26:50.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.880+0000 7fb627506700 1 Processor -- start 2023-09-30T22:26:50.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.880+0000 7fb627506700 1 -- start start 2023-09-30T22:26:50.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.880+0000 7fb627506700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6200926d0 0x7fb6201275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.880+0000 7fb627506700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb620127be0 0x7fb620128000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.880+0000 7fb627506700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb620091c80 con 0x7fb62012a9a0 2023-09-30T22:26:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.880+0000 7fb627506700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb620099dd0 con 0x7fb6200926d0 2023-09-30T22:26:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.880+0000 7fb627506700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6200999d0 con 0x7fb620127be0 2023-09-30T22:26:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.881+0000 7fb6252a2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6200926d0 0x7fb6201275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.881+0000 7fb624aa1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb620127be0 0x7fb620128000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.881+0000 7fb625aa3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb62012a9a0 0x7fb62012ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49530/0 (socket says 172.21.15.59:49530) 2023-09-30T22:26:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.881+0000 7fb625aa3700 1 -- 172.21.15.59:0/3268297665 learned_addr learned my addr 172.21.15.59:0/3268297665 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.881+0000 7fb6252a2700 1 -- 172.21.15.59:0/3268297665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb620127be0 msgr2=0x7fb620128000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.881+0000 7fb6252a2700 1 --2- 172.21.15.59:0/3268297665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb620127be0 0x7fb620128000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.881+0000 7fb6252a2700 1 -- 172.21.15.59:0/3268297665 >> v1:172.21.15.59:6789/0 conn(0x7fb62012a9a0 legacy=0x7fb62012ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.881+0000 7fb6252a2700 1 -- 172.21.15.59:0/3268297665 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62009a280 con 0x7fb6200926d0 2023-09-30T22:26:50.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.881+0000 7fb61ffff700 1 -- 172.21.15.59:0/3268297665 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604832557 0 0) 0x7fb620091c80 con 0x7fb62012a9a0 2023-09-30T22:26:50.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.881+0000 7fb6252a2700 1 --2- 172.21.15.59:0/3268297665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6200926d0 0x7fb6201275c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb610009760 tx=0x7fb610009060).ready entity=mon.0 client_cookie=414e7c270a3921dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.881+0000 7fb61ffff700 1 -- 172.21.15.59:0/3268297665 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61000f510 con 0x7fb6200926d0 2023-09-30T22:26:50.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.881+0000 7fb61ffff700 1 -- 172.21.15.59:0/3268297665 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61000f670 con 0x7fb6200926d0 2023-09-30T22:26:50.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.881+0000 7fb61ffff700 1 -- 172.21.15.59:0/3268297665 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61000f9f0 con 0x7fb6200926d0 2023-09-30T22:26:50.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.882+0000 7fb627506700 1 -- 172.21.15.59:0/3268297665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6200926d0 msgr2=0x7fb6201275c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.882+0000 7fb627506700 1 --2- 172.21.15.59:0/3268297665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6200926d0 0x7fb6201275c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb610009760 tx=0x7fb610009060).stop 2023-09-30T22:26:50.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.882+0000 7fb627506700 1 -- 172.21.15.59:0/3268297665 shutdown_connections 2023-09-30T22:26:50.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.882+0000 7fb627506700 1 --2- 172.21.15.59:0/3268297665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6200926d0 0x7fb6201275c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.882+0000 7fb627506700 1 --2- 172.21.15.59:0/3268297665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb620127be0 0x7fb620128000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.882+0000 7fb627506700 1 -- 172.21.15.59:0/3268297665 >> 172.21.15.59:0/3268297665 conn(0x7fb620097480 msgr2=0x7fb620097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:50.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.882+0000 7fb627506700 1 -- 172.21.15.59:0/3268297665 shutdown_connections 2023-09-30T22:26:50.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.882+0000 7fb627506700 1 -- 172.21.15.59:0/3268297665 wait complete. 2023-09-30T22:26:50.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.883+0000 7fb627506700 1 Processor -- start 2023-09-30T22:26:50.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.883+0000 7fb627506700 1 -- start start 2023-09-30T22:26:50.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb627506700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6200926d0 0x7fb6200666d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb627506700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb620127be0 0x7fb620066bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb627506700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb62012a9a0 0x7fb6200670b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:50.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb627506700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62009a4b0 con 0x7fb620127be0 2023-09-30T22:26:50.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb627506700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6200936d0 con 0x7fb62012a9a0 2023-09-30T22:26:50.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb627506700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb620069650 con 0x7fb6200926d0 2023-09-30T22:26:50.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb624aa1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb620127be0 0x7fb620066bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb6252a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6200926d0 0x7fb6200666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb624aa1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb620127be0 0x7fb620066bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53324/0 (socket says 172.21.15.59:53324) 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb624aa1700 1 -- 172.21.15.59:0/1633280302 learned_addr learned my addr 172.21.15.59:0/1633280302 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb625aa3700 1 --2- 172.21.15.59:0/1633280302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb62012a9a0 0x7fb6200670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb624aa1700 1 -- 172.21.15.59:0/1633280302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6200926d0 msgr2=0x7fb6200666d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb624aa1700 1 --2- 172.21.15.59:0/1633280302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6200926d0 0x7fb6200666d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb624aa1700 1 -- 172.21.15.59:0/1633280302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb62012a9a0 msgr2=0x7fb6200670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb624aa1700 1 --2- 172.21.15.59:0/1633280302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb62012a9a0 0x7fb6200670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb624aa1700 1 -- 172.21.15.59:0/1633280302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6100092a0 con 0x7fb620127be0 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.884+0000 7fb624aa1700 1 --2- 172.21.15.59:0/1633280302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb620127be0 0x7fb620066bc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb61400e900 tx=0x7fb614009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.885+0000 7fb61d7fa700 1 -- 172.21.15.59:0/1633280302 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614009510 con 0x7fb620127be0 2023-09-30T22:26:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.885+0000 7fb627506700 1 -- 172.21.15.59:0/1633280302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb620069a10 con 0x7fb620127be0 2023-09-30T22:26:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.885+0000 7fb61d7fa700 1 -- 172.21.15.59:0/1633280302 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb614012600 con 0x7fb620127be0 2023-09-30T22:26:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.885+0000 7fb61d7fa700 1 -- 172.21.15.59:0/1633280302 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614012980 con 0x7fb620127be0 2023-09-30T22:26:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.885+0000 7fb627506700 1 -- 172.21.15.59:0/1633280302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6200680a0 con 0x7fb620127be0 2023-09-30T22:26:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.886+0000 7fb61d7fa700 1 -- 172.21.15.59:0/1633280302 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb614012d30 con 0x7fb620127be0 2023-09-30T22:26:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.886+0000 7fb61d7fa700 1 -- 172.21.15.59:0/1633280302 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb61403b4a0 con 0x7fb620127be0 2023-09-30T22:26:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.887+0000 7fb627506700 1 -- 172.21.15.59:0/1633280302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62005a260 con 0x7fb620127be0 2023-09-30T22:26:50.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:50.891+0000 7fb61d7fa700 1 -- 172.21.15.59:0/1633280302 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb614011b00 con 0x7fb620127be0 2023-09-30T22:26:51.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.068+0000 7fb627506700 1 -- 172.21.15.59:0/1633280302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb620046c20 con 0x7fb620127be0 2023-09-30T22:26:51.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.069+0000 7fb61d7fa700 1 -- 172.21.15.59:0/1633280302 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb614029020 con 0x7fb620127be0 2023-09-30T22:26:51.069 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-30T22:26:51.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.070+0000 7fb627506700 1 -- 172.21.15.59:0/1633280302 >> v1:172.21.15.59:6816/118188 conn(0x7fb60c02bb30 legacy=0x7fb60c02dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.070+0000 7fb627506700 1 -- 172.21.15.59:0/1633280302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb620127be0 msgr2=0x7fb620066bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.070+0000 7fb627506700 1 --2- 172.21.15.59:0/1633280302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb620127be0 0x7fb620066bc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb61400e900 tx=0x7fb614009060).stop 2023-09-30T22:26:51.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.070+0000 7fb627506700 1 -- 172.21.15.59:0/1633280302 shutdown_connections 2023-09-30T22:26:51.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.070+0000 7fb627506700 1 --2- 172.21.15.59:0/1633280302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6200926d0 0x7fb6200666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.070+0000 7fb627506700 1 --2- 172.21.15.59:0/1633280302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb62012a9a0 0x7fb6200670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.070+0000 7fb627506700 1 --2- 172.21.15.59:0/1633280302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb620127be0 0x7fb620066bc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.070+0000 7fb627506700 1 -- 172.21.15.59:0/1633280302 >> 172.21.15.59:0/1633280302 conn(0x7fb620097480 msgr2=0x7fb620095dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:51.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.070+0000 7fb627506700 1 -- 172.21.15.59:0/1633280302 shutdown_connections 2023-09-30T22:26:51.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.070+0000 7fb627506700 1 -- 172.21.15.59:0/1633280302 wait complete. 2023-09-30T22:26:51.083 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:26:51.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.216+0000 7f995e944700 1 Processor -- start 2023-09-30T22:26:51.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.216+0000 7f995e944700 1 -- start start 2023-09-30T22:26:51.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f995e944700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9958059070 0x7f995812ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f995e944700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f995812a9b0 0x7f995812b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f995e944700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9958127400 0x7f9958127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f995e944700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9958059450 con 0x7f9958059070 2023-09-30T22:26:51.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f995e944700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9958091ed0 con 0x7f9958127400 2023-09-30T22:26:51.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f995e944700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f995809a770 con 0x7f995812a9b0 2023-09-30T22:26:51.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f99577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f995812a9b0 0x7f995812b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f995cee1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9958127400 0x7f9958127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f9957fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9958059070 0x7f995812ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f99577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f995812a9b0 0x7f995812b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57540/0 (socket says 172.21.15.59:57540) 2023-09-30T22:26:51.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f9957fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9958059070 0x7f995812ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53332/0 (socket says 172.21.15.59:53332) 2023-09-30T22:26:51.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f99577fe700 1 -- 172.21.15.59:0/378680338 learned_addr learned my addr 172.21.15.59:0/378680338 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:51.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f995cee1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9958127400 0x7f9958127890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42022/0 (socket says 172.21.15.59:42022) 2023-09-30T22:26:51.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f99577fe700 1 -- 172.21.15.59:0/378680338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9958127400 msgr2=0x7f9958127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:51.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f99577fe700 1 --2- 172.21.15.59:0/378680338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9958127400 0x7f9958127890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f99577fe700 1 -- 172.21.15.59:0/378680338 >> v2:172.21.15.59:3300/0 conn(0x7f9958059070 msgr2=0x7f995812ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:51.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.217+0000 7f99577fe700 1 --2- 172.21.15.59:0/378680338 >> v2:172.21.15.59:3300/0 conn(0x7f9958059070 0x7f995812ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.218+0000 7f99577fe700 1 -- 172.21.15.59:0/378680338 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9958091c10 con 0x7f995812a9b0 2023-09-30T22:26:51.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.218+0000 7f995cee1700 1 --2- 172.21.15.59:0/378680338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9958127400 0x7f9958127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:51.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.218+0000 7f99577fe700 1 --2- 172.21.15.59:0/378680338 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f995812a9b0 0x7f995812b330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f994c009830 tx=0x7f994c0090f0).ready entity=mon.2 client_cookie=2b400729c42cfe28 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:51.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.218+0000 7f9956ffd700 1 -- 172.21.15.59:0/378680338 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c00f510 con 0x7f995812a9b0 2023-09-30T22:26:51.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.218+0000 7f9956ffd700 1 -- 172.21.15.59:0/378680338 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c00f670 con 0x7f995812a9b0 2023-09-30T22:26:51.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.218+0000 7f9956ffd700 1 -- 172.21.15.59:0/378680338 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c00fa10 con 0x7f995812a9b0 2023-09-30T22:26:51.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.218+0000 7f995e944700 1 -- 172.21.15.59:0/378680338 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f995812a9b0 msgr2=0x7f995812b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.218+0000 7f995e944700 1 --2- 172.21.15.59:0/378680338 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f995812a9b0 0x7f995812b330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f994c009830 tx=0x7f994c0090f0).stop 2023-09-30T22:26:51.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.218+0000 7f995e944700 1 -- 172.21.15.59:0/378680338 shutdown_connections 2023-09-30T22:26:51.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.218+0000 7f995e944700 1 --2- 172.21.15.59:0/378680338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9958127400 0x7f9958127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.218+0000 7f995e944700 1 --2- 172.21.15.59:0/378680338 >> v2:172.21.15.59:3300/0 conn(0x7f9958059070 0x7f995812ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.218+0000 7f995e944700 1 --2- 172.21.15.59:0/378680338 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f995812a9b0 0x7f995812b330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.218+0000 7f995e944700 1 -- 172.21.15.59:0/378680338 >> 172.21.15.59:0/378680338 conn(0x7f9958097480 msgr2=0x7f9958097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:51.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.218+0000 7f995e944700 1 -- 172.21.15.59:0/378680338 shutdown_connections 2023-09-30T22:26:51.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.219+0000 7f995e944700 1 -- 172.21.15.59:0/378680338 wait complete. 2023-09-30T22:26:51.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.219+0000 7f995e944700 1 Processor -- start 2023-09-30T22:26:51.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f995e944700 1 -- start start 2023-09-30T22:26:51.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f995e944700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9958059070 0x7f9958117ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f995e944700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9958127400 0x7f9958113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f995e944700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9958113fa0 0x7f9958114400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f995e944700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9958124c10 con 0x7f9958127400 2023-09-30T22:26:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f995e944700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995809a460 con 0x7f9958059070 2023-09-30T22:26:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f995e944700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9958117040 con 0x7f9958113fa0 2023-09-30T22:26:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f9957fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9958059070 0x7f9958117ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f995cee1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9958113fa0 0x7f9958114400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f9957fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9958059070 0x7f9958117ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42024/0 (socket says 172.21.15.59:42024) 2023-09-30T22:26:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f99577fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9958127400 0x7f9958113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f9957fff700 1 -- 172.21.15.59:0/2630537711 learned_addr learned my addr 172.21.15.59:0/2630537711 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f9957fff700 1 -- 172.21.15.59:0/2630537711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9958113fa0 msgr2=0x7f9958114400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f9957fff700 1 --2- 172.21.15.59:0/2630537711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9958113fa0 0x7f9958114400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f9957fff700 1 -- 172.21.15.59:0/2630537711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9958127400 msgr2=0x7f9958113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f9957fff700 1 --2- 172.21.15.59:0/2630537711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9958127400 0x7f9958113ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f9957fff700 1 -- 172.21.15.59:0/2630537711 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9950009a20 con 0x7f9958059070 2023-09-30T22:26:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.220+0000 7f995cee1700 1 --2- 172.21.15.59:0/2630537711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9958113fa0 0x7f9958114400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.221+0000 7f9957fff700 1 --2- 172.21.15.59:0/2630537711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9958059070 0x7f9958117ae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f994800e960 tx=0x7f9948009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.221+0000 7f993ffff700 1 -- 172.21.15.59:0/2630537711 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994800c6a0 con 0x7f9958059070 2023-09-30T22:26:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.221+0000 7f993ffff700 1 -- 172.21.15.59:0/2630537711 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994800c800 con 0x7f9958059070 2023-09-30T22:26:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.221+0000 7f995e944700 1 -- 172.21.15.59:0/2630537711 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994c009370 con 0x7f9958059070 2023-09-30T22:26:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.221+0000 7f993ffff700 1 -- 172.21.15.59:0/2630537711 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994800cb80 con 0x7f9958059070 2023-09-30T22:26:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.221+0000 7f995e944700 1 -- 172.21.15.59:0/2630537711 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9958115f30 con 0x7f9958059070 2023-09-30T22:26:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.222+0000 7f993ffff700 1 -- 172.21.15.59:0/2630537711 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f994801b400 con 0x7f9958059070 2023-09-30T22:26:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.222+0000 7f993ffff700 1 -- 172.21.15.59:0/2630537711 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f994803b5e0 con 0x7f9958059070 2023-09-30T22:26:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.222+0000 7f995e944700 1 -- 172.21.15.59:0/2630537711 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9958117520 con 0x7f9958059070 2023-09-30T22:26:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.226+0000 7f993ffff700 1 -- 172.21.15.59:0/2630537711 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9948019900 con 0x7f9958059070 2023-09-30T22:26:51.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.400+0000 7f995e944700 1 -- 172.21.15.59:0/2630537711 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f995805a260 con 0x7f9958059070 2023-09-30T22:26:51.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.400+0000 7f993ffff700 1 -- 172.21.15.59:0/2630537711 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9948023350 con 0x7f9958059070 2023-09-30T22:26:51.401 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-30T22:26:51.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.402+0000 7f995e944700 1 -- 172.21.15.59:0/2630537711 >> v1:172.21.15.59:6816/118188 conn(0x7f994402bb60 legacy=0x7f994402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.402+0000 7f995e944700 1 -- 172.21.15.59:0/2630537711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9958059070 msgr2=0x7f9958117ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.402+0000 7f995e944700 1 --2- 172.21.15.59:0/2630537711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9958059070 0x7f9958117ae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f994800e960 tx=0x7f9948009060).stop 2023-09-30T22:26:51.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.402+0000 7f995e944700 1 -- 172.21.15.59:0/2630537711 shutdown_connections 2023-09-30T22:26:51.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.402+0000 7f995e944700 1 --2- 172.21.15.59:0/2630537711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9958113fa0 0x7f9958114400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.402+0000 7f995e944700 1 --2- 172.21.15.59:0/2630537711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9958059070 0x7f9958117ae0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.402+0000 7f995e944700 1 --2- 172.21.15.59:0/2630537711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9958127400 0x7f9958113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.402+0000 7f995e944700 1 -- 172.21.15.59:0/2630537711 >> 172.21.15.59:0/2630537711 conn(0x7f9958097480 msgr2=0x7f99580937f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:51.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.403+0000 7f995e944700 1 -- 172.21.15.59:0/2630537711 shutdown_connections 2023-09-30T22:26:51.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.403+0000 7f995e944700 1 -- 172.21.15.59:0/2630537711 wait complete. 2023-09-30T22:26:51.416 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:26:51.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.545+0000 7fad6babe700 1 Processor -- start 2023-09-30T22:26:51.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.546+0000 7fad6babe700 1 -- start start 2023-09-30T22:26:51.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.546+0000 7fad6babe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad64096380 0x7fad64094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.546+0000 7fad6babe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad64091b00 0x7fad64127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.546+0000 7fad6babe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad64094c20 0x7fad64127af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.546+0000 7fad6babe700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad64096760 con 0x7fad64091b00 2023-09-30T22:26:51.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.546+0000 7fad6babe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad64091ff0 con 0x7fad64096380 2023-09-30T22:26:51.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.546+0000 7fad6babe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad64092c80 con 0x7fad64094c20 2023-09-30T22:26:51.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.546+0000 7fad6985a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad64096380 0x7fad64094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.546+0000 7fad6a05b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad64094c20 0x7fad64127af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.546+0000 7fad69059700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad64091b00 0x7fad64127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.546+0000 7fad6a05b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad64094c20 0x7fad64127af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57552/0 (socket says 172.21.15.59:57552) 2023-09-30T22:26:51.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.546+0000 7fad6985a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad64096380 0x7fad64094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42038/0 (socket says 172.21.15.59:42038) 2023-09-30T22:26:51.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.546+0000 7fad6a05b700 1 -- 172.21.15.59:0/1261296788 learned_addr learned my addr 172.21.15.59:0/1261296788 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:51.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.546+0000 7fad69059700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad64091b00 0x7fad64127600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53356/0 (socket says 172.21.15.59:53356) 2023-09-30T22:26:51.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.547+0000 7fad6a05b700 1 -- 172.21.15.59:0/1261296788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad64096380 msgr2=0x7fad64094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:51.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.547+0000 7fad6a05b700 1 --2- 172.21.15.59:0/1261296788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad64096380 0x7fad64094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.547+0000 7fad6a05b700 1 -- 172.21.15.59:0/1261296788 >> v2:172.21.15.59:3300/0 conn(0x7fad64091b00 msgr2=0x7fad64127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:51.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.547+0000 7fad6a05b700 1 --2- 172.21.15.59:0/1261296788 >> v2:172.21.15.59:3300/0 conn(0x7fad64091b00 0x7fad64127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.547+0000 7fad6a05b700 1 -- 172.21.15.59:0/1261296788 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad64093900 con 0x7fad64094c20 2023-09-30T22:26:51.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.547+0000 7fad69059700 1 --2- 172.21.15.59:0/1261296788 >> v2:172.21.15.59:3300/0 conn(0x7fad64091b00 0x7fad64127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:51.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.547+0000 7fad6a05b700 1 --2- 172.21.15.59:0/1261296788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad64094c20 0x7fad64127af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fad5c009f20 tx=0x7fad5c009840).ready entity=mon.2 client_cookie=ecff9a2c4dcb1b9a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:51.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.547+0000 7fad68858700 1 -- 172.21.15.59:0/1261296788 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00e070 con 0x7fad64094c20 2023-09-30T22:26:51.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.547+0000 7fad68858700 1 -- 172.21.15.59:0/1261296788 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c00b970 con 0x7fad64094c20 2023-09-30T22:26:51.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.547+0000 7fad68858700 1 -- 172.21.15.59:0/1261296788 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00bcf0 con 0x7fad64094c20 2023-09-30T22:26:51.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.548+0000 7fad6babe700 1 -- 172.21.15.59:0/1261296788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad64094c20 msgr2=0x7fad64127af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.548+0000 7fad6babe700 1 --2- 172.21.15.59:0/1261296788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad64094c20 0x7fad64127af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fad5c009f20 tx=0x7fad5c009840).stop 2023-09-30T22:26:51.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.548+0000 7fad6babe700 1 -- 172.21.15.59:0/1261296788 shutdown_connections 2023-09-30T22:26:51.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.548+0000 7fad6babe700 1 --2- 172.21.15.59:0/1261296788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad64094c20 0x7fad64127af0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.548+0000 7fad6babe700 1 --2- 172.21.15.59:0/1261296788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad64096380 0x7fad64094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.548+0000 7fad6babe700 1 --2- 172.21.15.59:0/1261296788 >> v2:172.21.15.59:3300/0 conn(0x7fad64091b00 0x7fad64127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.548+0000 7fad6babe700 1 -- 172.21.15.59:0/1261296788 >> 172.21.15.59:0/1261296788 conn(0x7fad64097470 msgr2=0x7fad64097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:51.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.548+0000 7fad6babe700 1 -- 172.21.15.59:0/1261296788 shutdown_connections 2023-09-30T22:26:51.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.548+0000 7fad6babe700 1 -- 172.21.15.59:0/1261296788 wait complete. 2023-09-30T22:26:51.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.549+0000 7fad6babe700 1 Processor -- start 2023-09-30T22:26:51.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.549+0000 7fad6babe700 1 -- start start 2023-09-30T22:26:51.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.549+0000 7fad6babe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad64091b00 0x7fad64113920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.549+0000 7fad6babe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad64094c20 0x7fad64113e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.549+0000 7fad6babe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad64096380 0x7fad64114300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.549+0000 7fad6babe700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6406a520 con 0x7fad64091b00 2023-09-30T22:26:51.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.549+0000 7fad6babe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad64124a80 con 0x7fad64094c20 2023-09-30T22:26:51.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.549+0000 7fad6babe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad64117450 con 0x7fad64096380 2023-09-30T22:26:51.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.549+0000 7fad6985a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad64091b00 0x7fad64113920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.549+0000 7fad69059700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad64094c20 0x7fad64113e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.549+0000 7fad6985a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad64091b00 0x7fad64113920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53368/0 (socket says 172.21.15.59:53368) 2023-09-30T22:26:51.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.549+0000 7fad6985a700 1 -- 172.21.15.59:0/1365297705 learned_addr learned my addr 172.21.15.59:0/1365297705 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:51.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.549+0000 7fad6a05b700 1 --2- 172.21.15.59:0/1365297705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad64096380 0x7fad64114300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.550+0000 7fad69059700 1 -- 172.21.15.59:0/1365297705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad64096380 msgr2=0x7fad64114300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.550+0000 7fad69059700 1 --2- 172.21.15.59:0/1365297705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad64096380 0x7fad64114300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.550+0000 7fad69059700 1 -- 172.21.15.59:0/1365297705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad64091b00 msgr2=0x7fad64113920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.550+0000 7fad69059700 1 --2- 172.21.15.59:0/1365297705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad64091b00 0x7fad64113920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.550+0000 7fad69059700 1 -- 172.21.15.59:0/1365297705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad540092a0 con 0x7fad64094c20 2023-09-30T22:26:51.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.550+0000 7fad6985a700 1 --2- 172.21.15.59:0/1365297705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad64091b00 0x7fad64113920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:51.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.550+0000 7fad69059700 1 --2- 172.21.15.59:0/1365297705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad64094c20 0x7fad64113e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fad5400e9b0 tx=0x7fad54009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:51.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.550+0000 7fad59ffb700 1 -- 172.21.15.59:0/1365297705 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54012600 con 0x7fad64094c20 2023-09-30T22:26:51.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.550+0000 7fad59ffb700 1 -- 172.21.15.59:0/1365297705 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad54012760 con 0x7fad64094c20 2023-09-30T22:26:51.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.550+0000 7fad6babe700 1 -- 172.21.15.59:0/1365297705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5c009ae0 con 0x7fad64094c20 2023-09-30T22:26:51.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.550+0000 7fad59ffb700 1 -- 172.21.15.59:0/1365297705 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54012ae0 con 0x7fad64094c20 2023-09-30T22:26:51.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.550+0000 7fad6babe700 1 -- 172.21.15.59:0/1365297705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad64117cf0 con 0x7fad64094c20 2023-09-30T22:26:51.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.551+0000 7fad59ffb700 1 -- 172.21.15.59:0/1365297705 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fad5401b400 con 0x7fad64094c20 2023-09-30T22:26:51.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.551+0000 7fad59ffb700 1 -- 172.21.15.59:0/1365297705 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fad5403b350 con 0x7fad64094c20 2023-09-30T22:26:51.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.551+0000 7fad6babe700 1 -- 172.21.15.59:0/1365297705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad64117cf0 con 0x7fad64094c20 2023-09-30T22:26:51.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.556+0000 7fad59ffb700 1 -- 172.21.15.59:0/1365297705 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fad64117cf0 con 0x7fad64094c20 2023-09-30T22:26:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.774+0000 7fad6babe700 1 -- 172.21.15.59:0/1365297705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad64117cf0 con 0x7fad64094c20 2023-09-30T22:26:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.774+0000 7fad59ffb700 1 -- 172.21.15.59:0/1365297705 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7fad54016880 con 0x7fad64094c20 2023-09-30T22:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:26:34.412591+0000","modified":"2023-09-30T22:26:37.427658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/2103029646","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":2103029646}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:26:51.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.776+0000 7fad6babe700 1 -- 172.21.15.59:0/1365297705 >> v1:172.21.15.59:6816/118188 conn(0x7fad4802bb60 legacy=0x7fad4802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.776+0000 7fad6babe700 1 -- 172.21.15.59:0/1365297705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad64094c20 msgr2=0x7fad64113e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.776+0000 7fad6babe700 1 --2- 172.21.15.59:0/1365297705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad64094c20 0x7fad64113e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fad5400e9b0 tx=0x7fad54009060).stop 2023-09-30T22:26:51.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.777+0000 7fad6babe700 1 -- 172.21.15.59:0/1365297705 shutdown_connections 2023-09-30T22:26:51.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.777+0000 7fad6babe700 1 --2- 172.21.15.59:0/1365297705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad64096380 0x7fad64114300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.777+0000 7fad6babe700 1 --2- 172.21.15.59:0/1365297705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad64091b00 0x7fad64113920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.777+0000 7fad6babe700 1 --2- 172.21.15.59:0/1365297705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad64094c20 0x7fad64113e10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.777+0000 7fad6babe700 1 -- 172.21.15.59:0/1365297705 >> 172.21.15.59:0/1365297705 conn(0x7fad64097470 msgr2=0x7fad64126980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:51.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.777+0000 7fad6babe700 1 -- 172.21.15.59:0/1365297705 shutdown_connections 2023-09-30T22:26:51.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.777+0000 7fad6babe700 1 -- 172.21.15.59:0/1365297705 wait complete. 2023-09-30T22:26:51.778 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 6 2023-09-30T22:26:51.790 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:26:51.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.922+0000 7fd4c6da9700 1 Processor -- start 2023-09-30T22:26:51.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.922+0000 7fd4c6da9700 1 -- start start 2023-09-30T22:26:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4c6da9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4c0127390 0x7fd4c012fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4c6da9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c0127fa0 0x7fd4c0132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4c6da9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c0091b60 con 0x7fd4c0059070 2023-09-30T22:26:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4c6da9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c0096940 con 0x7fd4c0127390 2023-09-30T22:26:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4c6da9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0059c00 con 0x7fd4c0127fa0 2023-09-30T22:26:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4bffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4c0127390 0x7fd4c012fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4c4b45700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd4c0059070 0x7fd4c0127890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49536/0 (socket says 172.21.15.59:49536) 2023-09-30T22:26:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4c4b45700 1 -- 172.21.15.59:0/2427506137 learned_addr learned my addr 172.21.15.59:0/2427506137 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4c5346700 1 --2- 172.21.15.59:0/2427506137 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c0127fa0 0x7fd4c0132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4bffff700 1 -- 172.21.15.59:0/2427506137 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c0127fa0 msgr2=0x7fd4c0132170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4bffff700 1 --2- 172.21.15.59:0/2427506137 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c0127fa0 0x7fd4c0132170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4bffff700 1 -- 172.21.15.59:0/2427506137 >> v1:172.21.15.59:6789/0 conn(0x7fd4c0059070 legacy=0x7fd4c0127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4bffff700 1 -- 172.21.15.59:0/2427506137 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c00929d0 con 0x7fd4c0127390 2023-09-30T22:26:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4bf7fe700 1 -- 172.21.15.59:0/2427506137 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167653340 0 0) 0x7fd4c0091b60 con 0x7fd4c0059070 2023-09-30T22:26:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4bffff700 1 --2- 172.21.15.59:0/2427506137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c0127390 0x7fd4c012fc70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd4ac009760 tx=0x7fd4ac009060).ready entity=mon.0 client_cookie=dd485d9bfed4d35 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4bf7fe700 1 -- 172.21.15.59:0/2427506137 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac0090d0 con 0x7fd4c0127390 2023-09-30T22:26:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4bf7fe700 1 -- 172.21.15.59:0/2427506137 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac00f510 con 0x7fd4c0127390 2023-09-30T22:26:51.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.923+0000 7fd4bf7fe700 1 -- 172.21.15.59:0/2427506137 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00f890 con 0x7fd4c0127390 2023-09-30T22:26:51.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.924+0000 7fd4c6da9700 1 -- 172.21.15.59:0/2427506137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c0127390 msgr2=0x7fd4c012fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.924+0000 7fd4c6da9700 1 --2- 172.21.15.59:0/2427506137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c0127390 0x7fd4c012fc70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd4ac009760 tx=0x7fd4ac009060).stop 2023-09-30T22:26:51.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.924+0000 7fd4c6da9700 1 -- 172.21.15.59:0/2427506137 shutdown_connections 2023-09-30T22:26:51.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.924+0000 7fd4c6da9700 1 --2- 172.21.15.59:0/2427506137 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c0127fa0 0x7fd4c0132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.924+0000 7fd4c6da9700 1 --2- 172.21.15.59:0/2427506137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c0127390 0x7fd4c012fc70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.924+0000 7fd4c6da9700 1 -- 172.21.15.59:0/2427506137 >> 172.21.15.59:0/2427506137 conn(0x7fd4c0097470 msgr2=0x7fd4c0097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:51.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.924+0000 7fd4c6da9700 1 -- 172.21.15.59:0/2427506137 shutdown_connections 2023-09-30T22:26:51.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.924+0000 7fd4c6da9700 1 -- 172.21.15.59:0/2427506137 wait complete. 2023-09-30T22:26:51.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.925+0000 7fd4c6da9700 1 Processor -- start 2023-09-30T22:26:51.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.925+0000 7fd4c6da9700 1 -- start start 2023-09-30T22:26:51.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4c6da9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4c0059070 0x7fd4c0124a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4c6da9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c0127390 0x7fd4c012ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4c6da9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c0127fa0 0x7fd4c012bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4c6da9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c012d970 con 0x7fd4c0127fa0 2023-09-30T22:26:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4c6da9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c012cff0 con 0x7fd4c0059070 2023-09-30T22:26:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4c6da9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0096f20 con 0x7fd4c0127390 2023-09-30T22:26:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4bffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c0127390 0x7fd4c012ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4c5346700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c0127fa0 0x7fd4c012bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4c4b45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4c0059070 0x7fd4c0124a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4bffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c0127390 0x7fd4c012ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57594/0 (socket says 172.21.15.59:57594) 2023-09-30T22:26:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4c5346700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c0127fa0 0x7fd4c012bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53384/0 (socket says 172.21.15.59:53384) 2023-09-30T22:26:51.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4bffff700 1 -- 172.21.15.59:0/3149600293 learned_addr learned my addr 172.21.15.59:0/3149600293 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:51.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4c4b45700 1 -- 172.21.15.59:0/3149600293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c0127390 msgr2=0x7fd4c012ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4c4b45700 1 --2- 172.21.15.59:0/3149600293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c0127390 0x7fd4c012ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4c4b45700 1 -- 172.21.15.59:0/3149600293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c0127fa0 msgr2=0x7fd4c012bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4c4b45700 1 --2- 172.21.15.59:0/3149600293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c0127fa0 0x7fd4c012bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:51.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4c4b45700 1 -- 172.21.15.59:0/3149600293 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac0092a0 con 0x7fd4c0059070 2023-09-30T22:26:51.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4c4b45700 1 --2- 172.21.15.59:0/3149600293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4c0059070 0x7fd4c0124a80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fd4b400c490 tx=0x7fd4b4007db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:51.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.926+0000 7fd4bcff9700 1 -- 172.21.15.59:0/3149600293 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40070d0 con 0x7fd4c0059070 2023-09-30T22:26:51.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.927+0000 7fd4bcff9700 1 -- 172.21.15.59:0/3149600293 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b4007250 con 0x7fd4c0059070 2023-09-30T22:26:51.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.927+0000 7fd4c6da9700 1 -- 172.21.15.59:0/3149600293 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c0131db0 con 0x7fd4c0059070 2023-09-30T22:26:51.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.927+0000 7fd4bcff9700 1 -- 172.21.15.59:0/3149600293 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4007610 con 0x7fd4c0059070 2023-09-30T22:26:51.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.927+0000 7fd4c6da9700 1 -- 172.21.15.59:0/3149600293 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c01254e0 con 0x7fd4c0059070 2023-09-30T22:26:51.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.928+0000 7fd4c6da9700 1 -- 172.21.15.59:0/3149600293 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c009a410 con 0x7fd4c0059070 2023-09-30T22:26:51.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.928+0000 7fd4bcff9700 1 -- 172.21.15.59:0/3149600293 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd4b40059b0 con 0x7fd4c0059070 2023-09-30T22:26:51.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.928+0000 7fd4bcff9700 1 -- 172.21.15.59:0/3149600293 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd4b403aaf0 con 0x7fd4c0059070 2023-09-30T22:26:51.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:51.932+0000 7fd4bcff9700 1 -- 172.21.15.59:0/3149600293 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd4b4005e40 con 0x7fd4c0059070 2023-09-30T22:26:52.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.110+0000 7fd4c6da9700 1 -- 172.21.15.59:0/3149600293 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4c0064f80 con 0x7fd4c0059070 2023-09-30T22:26:52.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.110+0000 7fd4bcff9700 1 -- 172.21.15.59:0/3149600293 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11343 (secure 0 0 0) 0x7fd4b4010300 con 0x7fd4c0059070 2023-09-30T22:26:52.111 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:52.111 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":18,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:26:35.416181+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:26:52.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.112+0000 7fd4c6da9700 1 -- 172.21.15.59:0/3149600293 >> v1:172.21.15.59:6816/118188 conn(0x7fd4a402bb60 legacy=0x7fd4a402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.112+0000 7fd4c6da9700 1 -- 172.21.15.59:0/3149600293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4c0059070 msgr2=0x7fd4c0124a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.112+0000 7fd4c6da9700 1 --2- 172.21.15.59:0/3149600293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4c0059070 0x7fd4c0124a80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fd4b400c490 tx=0x7fd4b4007db0).stop 2023-09-30T22:26:52.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.112+0000 7fd4c6da9700 1 -- 172.21.15.59:0/3149600293 shutdown_connections 2023-09-30T22:26:52.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.112+0000 7fd4c6da9700 1 --2- 172.21.15.59:0/3149600293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c0127fa0 0x7fd4c012bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.112+0000 7fd4c6da9700 1 --2- 172.21.15.59:0/3149600293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4c0059070 0x7fd4c0124a80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.112+0000 7fd4c6da9700 1 --2- 172.21.15.59:0/3149600293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c0127390 0x7fd4c012ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.112+0000 7fd4c6da9700 1 -- 172.21.15.59:0/3149600293 >> 172.21.15.59:0/3149600293 conn(0x7fd4c0097470 msgr2=0x7fd4c0098780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.113+0000 7fd4c6da9700 1 -- 172.21.15.59:0/3149600293 shutdown_connections 2023-09-30T22:26:52.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.113+0000 7fd4c6da9700 1 -- 172.21.15.59:0/3149600293 wait complete. 2023-09-30T22:26:52.126 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:26:52.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.255+0000 7f1a0d901700 1 Processor -- start 2023-09-30T22:26:52.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.255+0000 7f1a0d901700 1 -- start start 2023-09-30T22:26:52.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.256+0000 7f1a0d901700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a080650f0 0x7f1a080986a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.256+0000 7f1a0d901700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a080992a0 0x7f1a08132480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.256+0000 7f1a0d901700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a08096160 con 0x7f1a08097c30 2023-09-30T22:26:52.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.256+0000 7f1a0d901700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a080654d0 con 0x7f1a080650f0 2023-09-30T22:26:52.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.256+0000 7f1a0d901700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a08065dd0 con 0x7f1a080992a0 2023-09-30T22:26:52.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.256+0000 7f1a077fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a080992a0 0x7f1a08132480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.256+0000 7f1a06ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a080650f0 0x7f1a080986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.256+0000 7f1a067fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1a08097c30 0x7f1a08098b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49548/0 (socket says 172.21.15.59:49548) 2023-09-30T22:26:52.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.256+0000 7f1a067fc700 1 -- 172.21.15.59:0/3481689848 learned_addr learned my addr 172.21.15.59:0/3481689848 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:52.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.256+0000 7f1a077fe700 1 -- 172.21.15.59:0/3481689848 >> v2:172.21.15.59:3300/0 conn(0x7f1a080650f0 msgr2=0x7f1a080986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.256+0000 7f1a077fe700 1 --2- 172.21.15.59:0/3481689848 >> v2:172.21.15.59:3300/0 conn(0x7f1a080650f0 0x7f1a080986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a077fe700 1 -- 172.21.15.59:0/3481689848 >> v1:172.21.15.59:6789/0 conn(0x7f1a08097c30 legacy=0x7f1a08098b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a05ffb700 1 -- 172.21.15.59:0/3481689848 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218471541 0 0) 0x7f1a08096160 con 0x7f1a08097c30 2023-09-30T22:26:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a077fe700 1 -- 172.21.15.59:0/3481689848 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a08099790 con 0x7f1a080992a0 2023-09-30T22:26:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a06ffd700 1 --2- 172.21.15.59:0/3481689848 >> v2:172.21.15.59:3300/0 conn(0x7f1a080650f0 0x7f1a080986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a077fe700 1 --2- 172.21.15.59:0/3481689848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a080992a0 0x7f1a08132480 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1a00009e60 tx=0x7f1a00009780).ready entity=mon.1 client_cookie=12ca6fc885b83e62 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a05ffb700 1 -- 172.21.15.59:0/3481689848 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0000e070 con 0x7f1a080992a0 2023-09-30T22:26:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a05ffb700 1 -- 172.21.15.59:0/3481689848 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0000bb60 con 0x7f1a080992a0 2023-09-30T22:26:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a05ffb700 1 -- 172.21.15.59:0/3481689848 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00012410 con 0x7f1a080992a0 2023-09-30T22:26:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a0d901700 1 -- 172.21.15.59:0/3481689848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a080992a0 msgr2=0x7f1a08132480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a0d901700 1 --2- 172.21.15.59:0/3481689848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a080992a0 0x7f1a08132480 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1a00009e60 tx=0x7f1a00009780).stop 2023-09-30T22:26:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a0d901700 1 -- 172.21.15.59:0/3481689848 shutdown_connections 2023-09-30T22:26:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a0d901700 1 --2- 172.21.15.59:0/3481689848 >> v2:172.21.15.59:3300/0 conn(0x7f1a080650f0 0x7f1a080986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a0d901700 1 --2- 172.21.15.59:0/3481689848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a080992a0 0x7f1a08132480 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a0d901700 1 -- 172.21.15.59:0/3481689848 >> 172.21.15.59:0/3481689848 conn(0x7f1a0809dc70 msgr2=0x7f1a0809e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a0d901700 1 -- 172.21.15.59:0/3481689848 shutdown_connections 2023-09-30T22:26:52.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.257+0000 7f1a0d901700 1 -- 172.21.15.59:0/3481689848 wait complete. 2023-09-30T22:26:52.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.258+0000 7f1a0d901700 1 Processor -- start 2023-09-30T22:26:52.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.259+0000 7f1a0d901700 1 -- start start 2023-09-30T22:26:52.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.259+0000 7f1a0d901700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a080650f0 0x7f1a0811e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.259+0000 7f1a0d901700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a080992a0 0x7f1a0811a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.259+0000 7f1a0d901700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a0811a750 0x7f1a0811abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.259+0000 7f1a0d901700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a081323a0 con 0x7f1a080650f0 2023-09-30T22:26:52.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.259+0000 7f1a0d901700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0811dd00 con 0x7f1a080992a0 2023-09-30T22:26:52.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.259+0000 7f1a0d901700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0809c5e0 con 0x7f1a0811a750 2023-09-30T22:26:52.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.259+0000 7f1a067fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a080992a0 0x7f1a0811a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.259+0000 7f1a077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a0811a750 0x7f1a0811abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.259+0000 7f1a06ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a080650f0 0x7f1a0811e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.259+0000 7f1a067fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a080992a0 0x7f1a0811a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42078/0 (socket says 172.21.15.59:42078) 2023-09-30T22:26:52.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.259+0000 7f1a067fc700 1 -- 172.21.15.59:0/2248708371 learned_addr learned my addr 172.21.15.59:0/2248708371 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:52.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.260+0000 7f1a067fc700 1 -- 172.21.15.59:0/2248708371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a0811a750 msgr2=0x7f1a0811abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.260+0000 7f1a067fc700 1 --2- 172.21.15.59:0/2248708371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a0811a750 0x7f1a0811abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.260+0000 7f1a067fc700 1 -- 172.21.15.59:0/2248708371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a080650f0 msgr2=0x7f1a0811e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.260+0000 7f1a067fc700 1 --2- 172.21.15.59:0/2248708371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a080650f0 0x7f1a0811e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.260+0000 7f1a067fc700 1 -- 172.21.15.59:0/2248708371 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f80092a0 con 0x7f1a080992a0 2023-09-30T22:26:52.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.260+0000 7f1a077fe700 1 --2- 172.21.15.59:0/2248708371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a0811a750 0x7f1a0811abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.260+0000 7f1a06ffd700 1 --2- 172.21.15.59:0/2248708371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a080650f0 0x7f1a0811e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.260+0000 7f1a067fc700 1 --2- 172.21.15.59:0/2248708371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a080992a0 0x7f1a0811a260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f19fc00c4c0 tx=0x7f19fc007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.260+0000 7f19eeffd700 1 -- 172.21.15.59:0/2248708371 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc00ce30 con 0x7f1a080992a0 2023-09-30T22:26:52.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.260+0000 7f19eeffd700 1 -- 172.21.15.59:0/2248708371 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc0072e0 con 0x7f1a080992a0 2023-09-30T22:26:52.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.260+0000 7f1a0d901700 1 -- 172.21.15.59:0/2248708371 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a00009a20 con 0x7f1a080992a0 2023-09-30T22:26:52.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.260+0000 7f19eeffd700 1 -- 172.21.15.59:0/2248708371 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0057a0 con 0x7f1a080992a0 2023-09-30T22:26:52.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.260+0000 7f1a0d901700 1 -- 172.21.15.59:0/2248708371 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0811d760 con 0x7f1a080992a0 2023-09-30T22:26:52.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.261+0000 7f19eeffd700 1 -- 172.21.15.59:0/2248708371 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f19fc005bd0 con 0x7f1a080992a0 2023-09-30T22:26:52.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.261+0000 7f19eeffd700 1 -- 172.21.15.59:0/2248708371 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f19fc03a760 con 0x7f1a080992a0 2023-09-30T22:26:52.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.261+0000 7f1a0d901700 1 -- 172.21.15.59:0/2248708371 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0811d960 con 0x7f1a080992a0 2023-09-30T22:26:52.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.266+0000 7f19eeffd700 1 -- 172.21.15.59:0/2248708371 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1a0811d960 con 0x7f1a080992a0 2023-09-30T22:26:52.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.480+0000 7f1a0d901700 1 -- 172.21.15.59:0/2248708371 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a0811d960 con 0x7f1a080992a0 2023-09-30T22:26:52.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.480+0000 7f19eeffd700 1 -- 172.21.15.59:0/2248708371 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f1a0811d960 con 0x7f1a080992a0 2023-09-30T22:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:26:34.412591+0000","modified":"2023-09-30T22:26:37.427658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/2103029646","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":2103029646}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:26:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.482+0000 7f1a0d901700 1 -- 172.21.15.59:0/2248708371 >> v1:172.21.15.59:6816/118188 conn(0x7f19f402bb60 legacy=0x7f19f402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.482+0000 7f1a0d901700 1 -- 172.21.15.59:0/2248708371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a080992a0 msgr2=0x7f1a0811a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.482+0000 7f1a0d901700 1 --2- 172.21.15.59:0/2248708371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a080992a0 0x7f1a0811a260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f19fc00c4c0 tx=0x7f19fc007c10).stop 2023-09-30T22:26:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.482+0000 7f1a0d901700 1 -- 172.21.15.59:0/2248708371 shutdown_connections 2023-09-30T22:26:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.482+0000 7f1a0d901700 1 --2- 172.21.15.59:0/2248708371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a0811a750 0x7f1a0811abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.482+0000 7f1a0d901700 1 --2- 172.21.15.59:0/2248708371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a080650f0 0x7f1a0811e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.482+0000 7f1a0d901700 1 --2- 172.21.15.59:0/2248708371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a080992a0 0x7f1a0811a260 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.482+0000 7f1a0d901700 1 -- 172.21.15.59:0/2248708371 >> 172.21.15.59:0/2248708371 conn(0x7f1a0809dc70 msgr2=0x7f1a0809a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.482+0000 7f1a0d901700 1 -- 172.21.15.59:0/2248708371 shutdown_connections 2023-09-30T22:26:52.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.482+0000 7f1a0d901700 1 -- 172.21.15.59:0/2248708371 wait complete. 2023-09-30T22:26:52.484 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 6 2023-09-30T22:26:52.596 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:26:34.412591+0000', 'modified': '2023-09-30T22:26:37.427658+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4181}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4181': {'gid': 4181, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6817/2103029646', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.59:6817', 'nonce': 2103029646}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:26:52.597 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:26:52.597 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:26:52.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.734+0000 7f9838a7d700 1 Processor -- start 2023-09-30T22:26:52.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.734+0000 7f9838a7d700 1 -- start start 2023-09-30T22:26:52.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.734+0000 7f9838a7d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9834096820 0x7f9834096c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.734+0000 7f9838a7d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9834097800 0x7f9834130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.734+0000 7f9838a7d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9834068df0 con 0x7f9834067940 2023-09-30T22:26:52.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.734+0000 7f9838a7d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9834097c90 con 0x7f9834097800 2023-09-30T22:26:52.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.734+0000 7f9838a7d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f983406a4c0 con 0x7f9834096820 2023-09-30T22:26:52.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.735+0000 7f9832d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9834097800 0x7f9834130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.735+0000 7f983259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9834096820 0x7f9834096c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.735+0000 7f9831d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9834067940 0x7f98340970f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49558/0 (socket says 172.21.15.59:49558) 2023-09-30T22:26:52.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.735+0000 7f9831d9b700 1 -- 172.21.15.59:0/1409360792 learned_addr learned my addr 172.21.15.59:0/1409360792 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:52.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.735+0000 7f9832d9d700 1 -- 172.21.15.59:0/1409360792 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9834096820 msgr2=0x7f9834096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.735+0000 7f9832d9d700 1 --2- 172.21.15.59:0/1409360792 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9834096820 0x7f9834096c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.735+0000 7f9832d9d700 1 -- 172.21.15.59:0/1409360792 >> v1:172.21.15.59:6789/0 conn(0x7f9834067940 legacy=0x7f98340970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.735+0000 7f9832d9d700 1 -- 172.21.15.59:0/1409360792 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9834098260 con 0x7f9834097800 2023-09-30T22:26:52.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.735+0000 7f983159a700 1 -- 172.21.15.59:0/1409360792 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497188170 0 0) 0x7f9834068df0 con 0x7f9834067940 2023-09-30T22:26:52.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.735+0000 7f983259c700 1 --2- 172.21.15.59:0/1409360792 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9834096820 0x7f9834096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.735+0000 7f9832d9d700 1 --2- 172.21.15.59:0/1409360792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9834097800 0x7f9834130280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f982c009e90 tx=0x7f982c009780).ready entity=mon.1 client_cookie=206e1b0cb7abdbad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.735+0000 7f983159a700 1 -- 172.21.15.59:0/1409360792 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c00e070 con 0x7f9834097800 2023-09-30T22:26:52.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.735+0000 7f983159a700 1 -- 172.21.15.59:0/1409360792 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c00bb60 con 0x7f9834097800 2023-09-30T22:26:52.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.735+0000 7f983159a700 1 -- 172.21.15.59:0/1409360792 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c012410 con 0x7f9834097800 2023-09-30T22:26:52.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.736+0000 7f9838a7d700 1 -- 172.21.15.59:0/1409360792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9834097800 msgr2=0x7f9834130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.736+0000 7f9838a7d700 1 --2- 172.21.15.59:0/1409360792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9834097800 0x7f9834130280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f982c009e90 tx=0x7f982c009780).stop 2023-09-30T22:26:52.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.736+0000 7f9838a7d700 1 -- 172.21.15.59:0/1409360792 shutdown_connections 2023-09-30T22:26:52.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.736+0000 7f9838a7d700 1 --2- 172.21.15.59:0/1409360792 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9834096820 0x7f9834096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.736+0000 7f9838a7d700 1 --2- 172.21.15.59:0/1409360792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9834097800 0x7f9834130280 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.736+0000 7f9838a7d700 1 -- 172.21.15.59:0/1409360792 >> 172.21.15.59:0/1409360792 conn(0x7f983409ba50 msgr2=0x7f983409be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.736+0000 7f9838a7d700 1 -- 172.21.15.59:0/1409360792 shutdown_connections 2023-09-30T22:26:52.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.736+0000 7f9838a7d700 1 -- 172.21.15.59:0/1409360792 wait complete. 2023-09-30T22:26:52.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.737+0000 7f9838a7d700 1 Processor -- start 2023-09-30T22:26:52.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.737+0000 7f9838a7d700 1 -- start start 2023-09-30T22:26:52.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.737+0000 7f9838a7d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9834067940 0x7f983412ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.737+0000 7f9838a7d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9834096820 0x7f9834117e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.737+0000 7f9838a7d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9834097800 0x7f98341182f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.737+0000 7f9838a7d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9834067e30 con 0x7f9834097800 2023-09-30T22:26:52.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.737+0000 7f9838a7d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983411b390 con 0x7f9834067940 2023-09-30T22:26:52.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.737+0000 7f9838a7d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f983411b930 con 0x7f9834096820 2023-09-30T22:26:52.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.737+0000 7f983259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9834067940 0x7f983412ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.737+0000 7f9831d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9834096820 0x7f9834117e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f983259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9834067940 0x7f983412ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42094/0 (socket says 172.21.15.59:42094) 2023-09-30T22:26:52.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f983259c700 1 -- 172.21.15.59:0/1754486769 learned_addr learned my addr 172.21.15.59:0/1754486769 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:52.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f9832d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9834097800 0x7f98341182f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f983259c700 1 -- 172.21.15.59:0/1754486769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9834096820 msgr2=0x7f9834117e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f983259c700 1 --2- 172.21.15.59:0/1754486769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9834096820 0x7f9834117e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f983259c700 1 -- 172.21.15.59:0/1754486769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9834097800 msgr2=0x7f98341182f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f983259c700 1 --2- 172.21.15.59:0/1754486769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9834097800 0x7f98341182f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f983259c700 1 -- 172.21.15.59:0/1754486769 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240092a0 con 0x7f9834067940 2023-09-30T22:26:52.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f9831d9b700 1 --2- 172.21.15.59:0/1754486769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9834096820 0x7f9834117e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f9832d9d700 1 --2- 172.21.15.59:0/1754486769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9834097800 0x7f98341182f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f983259c700 1 --2- 172.21.15.59:0/1754486769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9834067940 0x7f983412ffd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9824009d30 tx=0x7f9824009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f98227fc700 1 -- 172.21.15.59:0/1754486769 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824015070 con 0x7f9834067940 2023-09-30T22:26:52.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f98227fc700 1 -- 172.21.15.59:0/1754486769 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9824009e90 con 0x7f9834067940 2023-09-30T22:26:52.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f9838a7d700 1 -- 172.21.15.59:0/1754486769 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982c009a20 con 0x7f9834067940 2023-09-30T22:26:52.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f98227fc700 1 -- 172.21.15.59:0/1754486769 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982400bd30 con 0x7f9834067940 2023-09-30T22:26:52.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.738+0000 7f9838a7d700 1 -- 172.21.15.59:0/1754486769 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98341304c0 con 0x7f9834067940 2023-09-30T22:26:52.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.739+0000 7f98227fc700 1 -- 172.21.15.59:0/1754486769 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f98240243f0 con 0x7f9834067940 2023-09-30T22:26:52.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.739+0000 7f98227fc700 1 -- 172.21.15.59:0/1754486769 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f982403eda0 con 0x7f9834067940 2023-09-30T22:26:52.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.742+0000 7f984a430b80 1 Processor -- start 2023-09-30T22:26:52.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.742+0000 7f984a430b80 1 -- start start 2023-09-30T22:26:52.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f984a430b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c75170 0x5649f2c75550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f984a430b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2c9f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f984a430b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c9f5b0 0x5649f2ca19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f984a430b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649f2c3f610 con 0x5649f2c9f5b0 2023-09-30T22:26:52.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f984a430b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649f2bb5db0 con 0x5649f2c75a40 2023-09-30T22:26:52.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f984a430b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x5649f2bcb030 con 0x5649f2c75170 2023-09-30T22:26:52.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f983259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c75170 0x5649f2c75550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f983259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c75170 0x5649f2c75550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57634/0 (socket says 172.21.15.59:57634) 2023-09-30T22:26:52.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f9832d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c9f5b0 0x5649f2ca19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f983259c700 1 -- 172.21.15.59:0/400852936 learned_addr learned my addr 172.21.15.59:0/400852936 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:52.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f9831d9b700 1 --2- 172.21.15.59:0/400852936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2c9f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f9832d9d700 1 -- 172.21.15.59:0/400852936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c75170 msgr2=0x5649f2c75550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f9832d9d700 1 --2- 172.21.15.59:0/400852936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c75170 0x5649f2c75550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f9832d9d700 1 -- 172.21.15.59:0/400852936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 msgr2=0x5649f2c9f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f9832d9d700 1 --2- 172.21.15.59:0/400852936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2c9f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f9832d9d700 1 -- 172.21.15.59:0/400852936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649f2a66710 con 0x5649f2c9f5b0 2023-09-30T22:26:52.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.743+0000 7f983259c700 1 --2- 172.21.15.59:0/400852936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c75170 0x5649f2c75550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.744+0000 7f9832d9d700 1 --2- 172.21.15.59:0/400852936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c9f5b0 0x5649f2ca19a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f983409b960 tx=0x7f98340694f0).ready entity=mon.0 client_cookie=e676708339d34d66 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.744+0000 7f98137fe700 1 -- 172.21.15.59:0/400852936 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c00bcd0 con 0x5649f2c9f5b0 2023-09-30T22:26:52.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.744+0000 7f98137fe700 1 -- 172.21.15.59:0/400852936 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c00be30 con 0x5649f2c9f5b0 2023-09-30T22:26:52.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.744+0000 7f98137fe700 1 -- 172.21.15.59:0/400852936 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c013b50 con 0x5649f2c9f5b0 2023-09-30T22:26:52.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.744+0000 7f984a430b80 1 -- 172.21.15.59:0/400852936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c9f5b0 msgr2=0x5649f2ca19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.744+0000 7f984a430b80 1 --2- 172.21.15.59:0/400852936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c9f5b0 0x5649f2ca19a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f983409b960 tx=0x7f98340694f0).stop 2023-09-30T22:26:52.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.745+0000 7f984a430b80 1 -- 172.21.15.59:0/400852936 shutdown_connections 2023-09-30T22:26:52.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.745+0000 7f984a430b80 1 --2- 172.21.15.59:0/400852936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c75170 0x5649f2c75550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.745+0000 7f984a430b80 1 --2- 172.21.15.59:0/400852936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c9f5b0 0x5649f2ca19a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.745+0000 7f984a430b80 1 --2- 172.21.15.59:0/400852936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2c9f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.745+0000 7f984a430b80 1 -- 172.21.15.59:0/400852936 >> 172.21.15.59:0/400852936 conn(0x5649f2ae3940 msgr2=0x5649f2c95cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.745+0000 7f984a430b80 1 -- 172.21.15.59:0/400852936 shutdown_connections 2023-09-30T22:26:52.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.745+0000 7f984a430b80 1 -- 172.21.15.59:0/400852936 wait complete. 2023-09-30T22:26:52.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.745+0000 7f984a430b80 1 -- start start 2023-09-30T22:26:52.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.745+0000 7f984a430b80 1 Processor -- start 2023-09-30T22:26:52.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.746+0000 7f984a430b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c9a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.746+0000 7f984a430b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2c9ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.746+0000 7f984a430b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 0x5649f2c9b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.746+0000 7f984a430b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649f2bcb170 con 0x5649f2c75170 2023-09-30T22:26:52.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.746+0000 7f984a430b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649f2bcb3f0 con 0x5649f2c75a40 2023-09-30T22:26:52.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.746+0000 7f984a430b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x5649f2b96920 con 0x5649f2c9f5b0 2023-09-30T22:26:52.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.746+0000 7f984a430b80 10 client.0 ll_register_callbacks cb 0x5649f2b6bce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:26:52.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.746+0000 7f983259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c9a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.746+0000 7f9831d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2c9ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.746+0000 7f983259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c9a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53428/0 (socket says 172.21.15.59:53428) 2023-09-30T22:26:52.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.746+0000 7f983259c700 1 -- 172.21.15.59:0/747097527 learned_addr learned my addr 172.21.15.59:0/747097527 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:52.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f9832d9d700 1 --2- 172.21.15.59:0/747097527 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 0x5649f2c9b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f983259c700 1 -- 172.21.15.59:0/747097527 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 msgr2=0x5649f2c9b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f983259c700 1 --2- 172.21.15.59:0/747097527 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 0x5649f2c9b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f983259c700 1 -- 172.21.15.59:0/747097527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 msgr2=0x5649f2c9ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f983259c700 1 --2- 172.21.15.59:0/747097527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2c9ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f983259c700 1 -- 172.21.15.59:0/747097527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9834098260 con 0x5649f2c75170 2023-09-30T22:26:52.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f983259c700 1 --2- 172.21.15.59:0/747097527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c9a990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f982403f0d0 tx=0x7f982401c000).ready entity=mon.0 client_cookie=b2fb49e0d37442d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f9810ff9700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-09-30T22:26:52.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f9810ff9700 1 -- 172.21.15.59:0/747097527 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98240226c0 con 0x5649f2c75170 2023-09-30T22:26:52.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f9810ff9700 1 -- 172.21.15.59:0/747097527 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9824024880 con 0x5649f2c75170 2023-09-30T22:26:52.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f984a430b80 1 -- 172.21.15.59:0/747097527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5649f2c6df20 con 0x5649f2c75170 2023-09-30T22:26:52.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f9810ff9700 1 -- 172.21.15.59:0/747097527 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98240224e0 con 0x5649f2c75170 2023-09-30T22:26:52.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f984a430b80 10 client.4617 fetch_fsmap learned FSMap version 6 2023-09-30T22:26:52.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f984a430b80 1 -- 172.21.15.59:0/747097527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5649f2b9db00 con 0x5649f2c75170 2023-09-30T22:26:52.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f9810ff9700 1 -- 172.21.15.59:0/747097527 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9824040020 con 0x5649f2c75170 2023-09-30T22:26:52.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f9810ff9700 1 -- 172.21.15.59:0/747097527 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 6) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f9824017660 con 0x5649f2c75170 2023-09-30T22:26:52.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.747+0000 7f984a430b80 10 client.4617 fetch_fsmap finished waiting for FSMap version 6 2023-09-30T22:26:52.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.748+0000 7f984a430b80 10 client.4617 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:26:52.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.748+0000 7f984a430b80 20 client.4617 populate_metadata read hostname 'smithi059' 2023-09-30T22:26:52.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.748+0000 7f984a430b80 4 client.4617 mds_command: new command op to 4181 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:26:52.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.748+0000 7f984a430b80 1 -- 172.21.15.59:0/747097527 --> v1:172.21.15.59:6817/2103029646 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5649f2c43250 con 0x5649f2c8fac0 2023-09-30T22:26:52.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.748+0000 7f9810ff9700 10 client.4617 ms_handle_connect on v1:172.21.15.59:6817/2103029646 2023-09-30T22:26:52.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.749+0000 7f9810ff9700 1 -- 172.21.15.59:0/747097527 <== mds.0 v1:172.21.15.59:6817/2103029646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x5649f2c43250 con 0x5649f2c8fac0 2023-09-30T22:26:52.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.749+0000 7f9810ff9700 10 client.4617 handle_command_reply: tid=0 2023-09-30T22:26:52.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.749+0000 7f984a430b80 1 client.4617 shutdown 2023-09-30T22:26:52.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.749+0000 7f984a430b80 1 -- 172.21.15.59:0/747097527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 msgr2=0x5649f2c9a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.749+0000 7f984a430b80 1 --2- 172.21.15.59:0/747097527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c9a990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f982403f0d0 tx=0x7f982401c000).stop 2023-09-30T22:26:52.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.749+0000 7f984a430b80 1 -- 172.21.15.59:0/747097527 shutdown_connections 2023-09-30T22:26:52.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.749+0000 7f984a430b80 1 --2- 172.21.15.59:0/747097527 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 0x5649f2c9b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.749+0000 7f984a430b80 1 --2- 172.21.15.59:0/747097527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c9a990 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.749+0000 7f9810ff9700 0 client.4617 ms_handle_reset on v1:172.21.15.59:6817/2103029646 2023-09-30T22:26:52.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.749+0000 7f984a430b80 1 --2- 172.21.15.59:0/747097527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2c9ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.749+0000 7f984a430b80 1 -- 172.21.15.59:0/747097527 >> 172.21.15.59:0/747097527 conn(0x5649f2ae3940 msgr2=0x5649f2c95c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.749+0000 7f984a430b80 1 -- 172.21.15.59:0/747097527 shutdown_connections 2023-09-30T22:26:52.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.749+0000 7f984a430b80 1 -- 172.21.15.59:0/747097527 wait complete. 2023-09-30T22:26:52.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.749+0000 7f984a430b80 20 client.4617 trim_cache size 0 max 16384 2023-09-30T22:26:52.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.766+0000 7f984a430b80 1 Processor -- start 2023-09-30T22:26:52.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.766+0000 7f984a430b80 1 -- start start 2023-09-30T22:26:52.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f984a430b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c71610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f984a430b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2cb0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f984a430b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 0x5649f2c9ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f984a430b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649f2c9e360 con 0x5649f2c75170 2023-09-30T22:26:52.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f984a430b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649f2c8f510 con 0x5649f2c75a40 2023-09-30T22:26:52.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f984a430b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x5649f2c9cdc0 con 0x5649f2c9f5b0 2023-09-30T22:26:52.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f983259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c71610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f9832d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 0x5649f2c9ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f983259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c71610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53438/0 (socket says 172.21.15.59:53438) 2023-09-30T22:26:52.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f983259c700 1 -- 172.21.15.59:0/570946546 learned_addr learned my addr 172.21.15.59:0/570946546 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:52.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f9831d9b700 1 --2- 172.21.15.59:0/570946546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2cb0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f9832d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 0x5649f2c9ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57658/0 (socket says 172.21.15.59:57658) 2023-09-30T22:26:52.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f983259c700 1 -- 172.21.15.59:0/570946546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 msgr2=0x5649f2c9ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f983259c700 1 --2- 172.21.15.59:0/570946546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 0x5649f2c9ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f983259c700 1 -- 172.21.15.59:0/570946546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 msgr2=0x5649f2cb0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f983259c700 1 --2- 172.21.15.59:0/570946546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2cb0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f983259c700 1 -- 172.21.15.59:0/570946546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98341304c0 con 0x5649f2c75170 2023-09-30T22:26:52.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f9831d9b700 1 --2- 172.21.15.59:0/570946546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2cb0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f983259c700 1 --2- 172.21.15.59:0/570946546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c71610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f982403d3a0 tx=0x7f9824034000).ready entity=mon.0 client_cookie=bfcd4abffe9aad6e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f9813fff700 1 -- 172.21.15.59:0/570946546 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824022300 con 0x5649f2c75170 2023-09-30T22:26:52.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f9813fff700 1 -- 172.21.15.59:0/570946546 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5649f2c6df20 con 0x5649f2c75170 2023-09-30T22:26:52.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.767+0000 7f9813fff700 1 -- 172.21.15.59:0/570946546 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98240226c0 con 0x5649f2c75170 2023-09-30T22:26:52.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.768+0000 7f984a430b80 1 -- 172.21.15.59:0/570946546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 msgr2=0x5649f2c71610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.768+0000 7f984a430b80 1 --2- 172.21.15.59:0/570946546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c71610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f982403d3a0 tx=0x7f9824034000).stop 2023-09-30T22:26:52.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.768+0000 7f984a430b80 1 -- 172.21.15.59:0/570946546 shutdown_connections 2023-09-30T22:26:52.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.768+0000 7f984a430b80 1 --2- 172.21.15.59:0/570946546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 0x5649f2c9ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.768+0000 7f984a430b80 1 --2- 172.21.15.59:0/570946546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c71610 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.768+0000 7f984a430b80 1 --2- 172.21.15.59:0/570946546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2cb0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.768+0000 7f984a430b80 1 -- 172.21.15.59:0/570946546 >> 172.21.15.59:0/570946546 conn(0x5649f2ae3940 msgr2=0x5649f2c95b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.768+0000 7f984a430b80 1 -- 172.21.15.59:0/570946546 shutdown_connections 2023-09-30T22:26:52.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.768+0000 7f984a430b80 1 -- 172.21.15.59:0/570946546 wait complete. 2023-09-30T22:26:52.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.768+0000 7f984a430b80 1 -- start start 2023-09-30T22:26:52.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.769+0000 7f984a430b80 1 Processor -- start 2023-09-30T22:26:52.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.769+0000 7f984a430b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c9a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.769+0000 7f984a430b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2c9aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.769+0000 7f984a430b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 0x5649f2cf9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.769+0000 7f984a430b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649f2cddef0 con 0x5649f2c75170 2023-09-30T22:26:52.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.769+0000 7f984a430b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649f2c9a1c0 con 0x5649f2c75a40 2023-09-30T22:26:52.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.769+0000 7f984a430b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x5649f2c9a430 con 0x5649f2c9f5b0 2023-09-30T22:26:52.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.769+0000 7f984a430b80 10 client.0 ll_register_callbacks cb 0x5649f2b6bce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:26:52.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.769+0000 7f983259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c9a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.769+0000 7f9831d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2c9aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.769+0000 7f983259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c9a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53444/0 (socket says 172.21.15.59:53444) 2023-09-30T22:26:52.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.769+0000 7f983259c700 1 -- 172.21.15.59:0/2867450566 learned_addr learned my addr 172.21.15.59:0/2867450566 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:52.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f9832d9d700 1 --2- 172.21.15.59:0/2867450566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 0x5649f2cf9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f983259c700 1 -- 172.21.15.59:0/2867450566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 msgr2=0x5649f2cf9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f983259c700 1 --2- 172.21.15.59:0/2867450566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 0x5649f2cf9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f983259c700 1 -- 172.21.15.59:0/2867450566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 msgr2=0x5649f2c9aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f983259c700 1 --2- 172.21.15.59:0/2867450566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2c9aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f983259c700 1 -- 172.21.15.59:0/2867450566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982800f040 con 0x5649f2c75170 2023-09-30T22:26:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f9831d9b700 1 --2- 172.21.15.59:0/2867450566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2c9aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f9832d9d700 1 --2- 172.21.15.59:0/2867450566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 0x5649f2cf9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f983259c700 1 --2- 172.21.15.59:0/2867450566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c9a7b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f982403b040 tx=0x7f982401d040).ready entity=mon.0 client_cookie=c4a47ee984818631 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f9810ff9700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-09-30T22:26:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f9810ff9700 1 -- 172.21.15.59:0/2867450566 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98240224e0 con 0x5649f2c75170 2023-09-30T22:26:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f9810ff9700 1 -- 172.21.15.59:0/2867450566 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9824041080 con 0x5649f2c75170 2023-09-30T22:26:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f984a430b80 1 -- 172.21.15.59:0/2867450566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5649f2c74c50 con 0x5649f2c75170 2023-09-30T22:26:52.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f9810ff9700 1 -- 172.21.15.59:0/2867450566 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98240228f0 con 0x5649f2c75170 2023-09-30T22:26:52.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f984a430b80 10 client.4623 fetch_fsmap learned FSMap version 6 2023-09-30T22:26:52.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f984a430b80 1 -- 172.21.15.59:0/2867450566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5649f2b9db00 con 0x5649f2c75170 2023-09-30T22:26:52.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.770+0000 7f9810ff9700 1 -- 172.21.15.59:0/2867450566 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5649f2c74c50 con 0x5649f2c75170 2023-09-30T22:26:52.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f9810ff9700 1 -- 172.21.15.59:0/2867450566 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 6) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f982404c050 con 0x5649f2c75170 2023-09-30T22:26:52.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f984a430b80 10 client.4623 fetch_fsmap finished waiting for FSMap version 6 2023-09-30T22:26:52.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f984a430b80 10 client.4623 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:26:52.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f984a430b80 20 client.4623 populate_metadata read hostname 'smithi059' 2023-09-30T22:26:52.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f984a430b80 4 client.4623 mds_command: new command op to 4181 tid=0[{"prefix": "status"}] 2023-09-30T22:26:52.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f984a430b80 1 -- 172.21.15.59:0/2867450566 --> v1:172.21.15.59:6817/2103029646 -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f982c00be30 con 0x5649f2cf9e50 2023-09-30T22:26:52.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f9810ff9700 10 client.4623 ms_handle_connect on v1:172.21.15.59:6817/2103029646 2023-09-30T22:26:52.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f9810ff9700 1 -- 172.21.15.59:0/2867450566 <== mds.0 v1:172.21.15.59:6817/2103029646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 719383671) 0x7f982c00be30 con 0x5649f2cf9e50 2023-09-30T22:26:52.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f9810ff9700 10 client.4623 handle_command_reply: tid=0 2023-09-30T22:26:52.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f984a430b80 1 client.4623 shutdown 2023-09-30T22:26:52.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f984a430b80 1 -- 172.21.15.59:0/2867450566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 msgr2=0x5649f2c9a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f984a430b80 1 --2- 172.21.15.59:0/2867450566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c9a7b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f982403b040 tx=0x7f982401d040).stop 2023-09-30T22:26:52.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f984a430b80 1 -- 172.21.15.59:0/2867450566 shutdown_connections 2023-09-30T22:26:52.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f984a430b80 1 --2- 172.21.15.59:0/2867450566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x5649f2c9f5b0 0x5649f2cf9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f984a430b80 1 --2- 172.21.15.59:0/2867450566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5649f2c75170 0x5649f2c9a7b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f9810ff9700 0 client.4623 ms_handle_reset on v1:172.21.15.59:6817/2103029646 2023-09-30T22:26:52.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f984a430b80 1 --2- 172.21.15.59:0/2867450566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5649f2c75a40 0x5649f2c9aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.771+0000 7f984a430b80 1 -- 172.21.15.59:0/2867450566 >> 172.21.15.59:0/2867450566 conn(0x5649f2ae3940 msgr2=0x5649f2c91030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.772+0000 7f984a430b80 1 -- 172.21.15.59:0/2867450566 shutdown_connections 2023-09-30T22:26:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.772+0000 7f984a430b80 1 -- 172.21.15.59:0/2867450566 wait complete. 2023-09-30T22:26:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.772+0000 7f984a430b80 20 client.4623 trim_cache size 0 max 16384 2023-09-30T22:26:52.785 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-09-30T22:26:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "4ab45aad-c596-4cc8-9318-aa2f9d41daac", 2023-09-30T22:26:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2023-09-30T22:26:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4181, 2023-09-30T22:26:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2023-09-30T22:26:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2023-09-30T22:26:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2023-09-30T22:26:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 18.355004872999999, 2023-09-30T22:26:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 6, 2023-09-30T22:26:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 18, 2023-09-30T22:26:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 18, 2023-09-30T22:26:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 22.806483456999999 2023-09-30T22:26:52.787 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-09-30T22:26:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.772+0000 7f9838a7d700 1 -- 172.21.15.59:0/1754486769 >> v1:172.21.15.59:6816/118188 conn(0x7f981402bb60 legacy=0x7f981402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.772+0000 7f9838a7d700 1 -- 172.21.15.59:0/1754486769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9834067940 msgr2=0x7f983412ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.772+0000 7f9838a7d700 1 --2- 172.21.15.59:0/1754486769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9834067940 0x7f983412ffd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9824009d30 tx=0x7f9824009060).stop 2023-09-30T22:26:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.772+0000 7f9838a7d700 1 -- 172.21.15.59:0/1754486769 shutdown_connections 2023-09-30T22:26:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.772+0000 7f9838a7d700 1 --2- 172.21.15.59:0/1754486769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9834097800 0x7f98341182f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.772+0000 7f9838a7d700 1 --2- 172.21.15.59:0/1754486769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9834067940 0x7f983412ffd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.772+0000 7f9838a7d700 1 --2- 172.21.15.59:0/1754486769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9834096820 0x7f9834117e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.772+0000 7f9838a7d700 1 -- 172.21.15.59:0/1754486769 >> 172.21.15.59:0/1754486769 conn(0x7f983409ba50 msgr2=0x7f98341120d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.772+0000 7f9838a7d700 1 -- 172.21.15.59:0/1754486769 shutdown_connections 2023-09-30T22:26:52.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.772+0000 7f9838a7d700 1 -- 172.21.15.59:0/1754486769 wait complete. 2023-09-30T22:26:52.791 INFO:teuthology.run_tasks:Running task exec... 2023-09-30T22:26:52.801 INFO:teuthology.task.exec:Executing custom commands... 2023-09-30T22:26:52.801 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi059.front.sepia.ceph.com 2023-09-30T22:26:52.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client pacific' 2023-09-30T22:26:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.932+0000 7f3e940e2700 1 Processor -- start 2023-09-30T22:26:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.932+0000 7f3e940e2700 1 -- start start 2023-09-30T22:26:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.932+0000 7f3e940e2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3e8c062650 0x7f3e8c1277d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.932+0000 7f3e940e2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8c127cc0 0x7f3e8c098810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.932+0000 7f3e940e2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e8c098d00 0x7f3e8c0991b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.932+0000 7f3e940e2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8c062a30 con 0x7f3e8c062650 2023-09-30T22:26:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.932+0000 7f3e940e2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c09a6b0 con 0x7f3e8c127cc0 2023-09-30T22:26:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.932+0000 7f3e940e2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c0996a0 con 0x7f3e8c098d00 2023-09-30T22:26:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e9167d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8c127cc0 0x7f3e8c098810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e91e7e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3e8c062650 0x7f3e8c1277d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e9267f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e8c098d00 0x7f3e8c0991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e9167d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8c127cc0 0x7f3e8c098810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42138/0 (socket says 172.21.15.59:42138) 2023-09-30T22:26:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e9167d700 1 -- 172.21.15.59:0/1619023466 learned_addr learned my addr 172.21.15.59:0/1619023466 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e91e7e700 1 -- 172.21.15.59:0/1619023466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e8c098d00 msgr2=0x7f3e8c0991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e91e7e700 1 --2- 172.21.15.59:0/1619023466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e8c098d00 0x7f3e8c0991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e91e7e700 1 -- 172.21.15.59:0/1619023466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8c127cc0 msgr2=0x7f3e8c098810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e91e7e700 1 --2- 172.21.15.59:0/1619023466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8c127cc0 0x7f3e8c098810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e91e7e700 1 -- 172.21.15.59:0/1619023466 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c09a190 con 0x7f3e8c062650 2023-09-30T22:26:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e9267f700 1 --2- 172.21.15.59:0/1619023466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e8c098d00 0x7f3e8c0991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e9167d700 1 --2- 172.21.15.59:0/1619023466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8c127cc0 0x7f3e8c098810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e91e7e700 1 --2- 172.21.15.59:0/1619023466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8c062650 0x7f3e8c1277d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f3e88009760 tx=0x7f3e88009060).ready entity=mon.0 client_cookie=fdf4ed303e303827 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e90e7c700 1 -- 172.21.15.59:0/1619023466 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8800d4a0 con 0x7f3e8c062650 2023-09-30T22:26:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e90e7c700 1 -- 172.21.15.59:0/1619023466 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8800d600 con 0x7f3e8c062650 2023-09-30T22:26:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.933+0000 7f3e90e7c700 1 -- 172.21.15.59:0/1619023466 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8800d980 con 0x7f3e8c062650 2023-09-30T22:26:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.934+0000 7f3e940e2700 1 -- 172.21.15.59:0/1619023466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8c062650 msgr2=0x7f3e8c1277d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.934+0000 7f3e940e2700 1 --2- 172.21.15.59:0/1619023466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8c062650 0x7f3e8c1277d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f3e88009760 tx=0x7f3e88009060).stop 2023-09-30T22:26:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.934+0000 7f3e940e2700 1 -- 172.21.15.59:0/1619023466 shutdown_connections 2023-09-30T22:26:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.934+0000 7f3e940e2700 1 --2- 172.21.15.59:0/1619023466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e8c098d00 0x7f3e8c0991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.934+0000 7f3e940e2700 1 --2- 172.21.15.59:0/1619023466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8c062650 0x7f3e8c1277d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.934+0000 7f3e940e2700 1 --2- 172.21.15.59:0/1619023466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8c127cc0 0x7f3e8c098810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.934+0000 7f3e940e2700 1 -- 172.21.15.59:0/1619023466 >> 172.21.15.59:0/1619023466 conn(0x7f3e8c097410 msgr2=0x7f3e8c097820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.934+0000 7f3e940e2700 1 -- 172.21.15.59:0/1619023466 shutdown_connections 2023-09-30T22:26:52.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.934+0000 7f3e940e2700 1 -- 172.21.15.59:0/1619023466 wait complete. 2023-09-30T22:26:52.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.935+0000 7f3e940e2700 1 Processor -- start 2023-09-30T22:26:52.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.935+0000 7f3e940e2700 1 -- start start 2023-09-30T22:26:52.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.936+0000 7f3e940e2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8c062650 0x7f3e8c117c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.936+0000 7f3e940e2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e8c098d00 0x7f3e8c113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.936+0000 7f3e940e2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8c127cc0 0x7f3e8c114160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:52.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.936+0000 7f3e940e2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c1177d0 con 0x7f3e8c062650 2023-09-30T22:26:52.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.936+0000 7f3e940e2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c115070 con 0x7f3e8c127cc0 2023-09-30T22:26:52.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.936+0000 7f3e940e2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c09a3c0 con 0x7f3e8c098d00 2023-09-30T22:26:52.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.936+0000 7f3e91e7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8c062650 0x7f3e8c117c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.936+0000 7f3e91e7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8c062650 0x7f3e8c117c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53448/0 (socket says 172.21.15.59:53448) 2023-09-30T22:26:52.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.936+0000 7f3e91e7e700 1 -- 172.21.15.59:0/337238224 learned_addr learned my addr 172.21.15.59:0/337238224 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:52.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.936+0000 7f3e9267f700 1 --2- 172.21.15.59:0/337238224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8c127cc0 0x7f3e8c114160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.936+0000 7f3e9167d700 1 --2- 172.21.15.59:0/337238224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e8c098d00 0x7f3e8c113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:52.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.936+0000 7f3e91e7e700 1 -- 172.21.15.59:0/337238224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e8c098d00 msgr2=0x7f3e8c113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.937+0000 7f3e91e7e700 1 --2- 172.21.15.59:0/337238224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e8c098d00 0x7f3e8c113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.937+0000 7f3e91e7e700 1 -- 172.21.15.59:0/337238224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8c127cc0 msgr2=0x7f3e8c114160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.937+0000 7f3e91e7e700 1 --2- 172.21.15.59:0/337238224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8c127cc0 0x7f3e8c114160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:52.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.937+0000 7f3e91e7e700 1 -- 172.21.15.59:0/337238224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84009a20 con 0x7f3e8c062650 2023-09-30T22:26:52.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.937+0000 7f3e9267f700 1 --2- 172.21.15.59:0/337238224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8c127cc0 0x7f3e8c114160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.937+0000 7f3e91e7e700 1 --2- 172.21.15.59:0/337238224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8c062650 0x7f3e8c117c60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3e88009d50 tx=0x7f3e88016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.937+0000 7f3e81ffb700 1 -- 172.21.15.59:0/337238224 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8800dd30 con 0x7f3e8c062650 2023-09-30T22:26:52.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.937+0000 7f3e81ffb700 1 -- 172.21.15.59:0/337238224 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8800de90 con 0x7f3e8c062650 2023-09-30T22:26:52.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.937+0000 7f3e940e2700 1 -- 172.21.15.59:0/337238224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7c009370 con 0x7f3e8c062650 2023-09-30T22:26:52.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.937+0000 7f3e81ffb700 1 -- 172.21.15.59:0/337238224 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8800d980 con 0x7f3e8c062650 2023-09-30T22:26:52.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.937+0000 7f3e940e2700 1 -- 172.21.15.59:0/337238224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e880092a0 con 0x7f3e8c062650 2023-09-30T22:26:52.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.938+0000 7f3e81ffb700 1 -- 172.21.15.59:0/337238224 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3e8801d640 con 0x7f3e8c062650 2023-09-30T22:26:52.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.938+0000 7f3e81ffb700 1 -- 172.21.15.59:0/337238224 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3e8803c710 con 0x7f3e8c062650 2023-09-30T22:26:52.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.938+0000 7f3e940e2700 1 -- 172.21.15.59:0/337238224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8c124df0 con 0x7f3e8c062650 2023-09-30T22:26:52.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:52.943+0000 7f3e81ffb700 1 -- 172.21.15.59:0/337238224 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3e8801d8f0 con 0x7f3e8c062650 2023-09-30T22:26:53.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:53.130+0000 7f3e940e2700 1 -- 172.21.15.59:0/337238224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "pacific"} v 0) v1 -- 0x7f3e8c0978e0 con 0x7f3e8c062650 2023-09-30T22:26:53.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:53.902+0000 7f3e81ffb700 1 -- 172.21.15.59:0/337238224 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "pacific"}]=0 set require_min_compat_client to pacific v19) v1 ==== 143+0+0 (secure 0 0 0) 0x7f3e88018350 con 0x7f3e8c062650 2023-09-30T22:26:53.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:53.905+0000 7f3e940e2700 1 -- 172.21.15.59:0/337238224 >> v1:172.21.15.59:6816/118188 conn(0x7f3e7002bb60 legacy=0x7f3e7002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:53.905+0000 7f3e940e2700 1 -- 172.21.15.59:0/337238224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8c062650 msgr2=0x7f3e8c117c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:53.905+0000 7f3e940e2700 1 --2- 172.21.15.59:0/337238224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8c062650 0x7f3e8c117c60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3e88009d50 tx=0x7f3e88016000).stop 2023-09-30T22:26:53.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:53.906+0000 7f3e940e2700 1 -- 172.21.15.59:0/337238224 shutdown_connections 2023-09-30T22:26:53.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:53.906+0000 7f3e940e2700 1 --2- 172.21.15.59:0/337238224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8c127cc0 0x7f3e8c114160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:53.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:53.906+0000 7f3e940e2700 1 --2- 172.21.15.59:0/337238224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8c062650 0x7f3e8c117c60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:53.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:53.906+0000 7f3e940e2700 1 --2- 172.21.15.59:0/337238224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e8c098d00 0x7f3e8c113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:53.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:53.906+0000 7f3e940e2700 1 -- 172.21.15.59:0/337238224 >> 172.21.15.59:0/337238224 conn(0x7f3e8c097410 msgr2=0x7f3e8c1261b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:53.906+0000 7f3e940e2700 1 -- 172.21.15.59:0/337238224 shutdown_connections 2023-09-30T22:26:53.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:53.906+0000 7f3e940e2700 1 -- 172.21.15.59:0/337238224 wait complete. 2023-09-30T22:26:53.907 INFO:teuthology.orchestra.run.smithi059.stderr:set require_min_compat_client to pacific 2023-09-30T22:26:53.920 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:26:53.929 INFO:teuthology.task.print:**** done ceph 2023-09-30T22:26:53.930 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-09-30T22:26:54.033 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-09-30T22:26:54.033 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-09-30T22:26:54.033 INFO:tasks.ceph_fuse:client.0 config is {} 2023-09-30T22:26:54.033 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-30T22:26:54.033 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:26:54.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:54.033 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2023-09-30T22:26:54.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:54.056 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2023-09-30T22:26:54.132 INFO:teuthology.orchestra.run.smithi191.stderr:Cannot find device "ceph-brx" 2023-09-30T22:26:54.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:26:54.134 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-09-30T22:26:54.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:26:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.271+0000 7fc89a5e9700 1 Processor -- start 2023-09-30T22:26:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.271+0000 7fc89a5e9700 1 -- start start 2023-09-30T22:26:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.272+0000 7fc89a5e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc894067940 0x7fc894097310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.272+0000 7fc89a5e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc894097800 0x7fc894130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.272+0000 7fc89a5e9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc894068df0 con 0x7fc894096820 2023-09-30T22:26:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.272+0000 7fc89a5e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc894097c90 con 0x7fc894067940 2023-09-30T22:26:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.272+0000 7fc89a5e9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc89406a4c0 con 0x7fc894097800 2023-09-30T22:26:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.272+0000 7fc898b86700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc894097800 0x7fc894130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.272+0000 7fc8937fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc894067940 0x7fc894097310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.272+0000 7fc893fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc894096820 0x7fc894096c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49562/0 (socket says 172.21.15.59:49562) 2023-09-30T22:26:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.272+0000 7fc893fff700 1 -- 172.21.15.59:0/68433604 learned_addr learned my addr 172.21.15.59:0/68433604 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc898b86700 1 -- 172.21.15.59:0/68433604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc894067940 msgr2=0x7fc894097310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc898b86700 1 --2- 172.21.15.59:0/68433604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc894067940 0x7fc894097310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc892ffd700 1 -- 172.21.15.59:0/68433604 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080565125 0 0) 0x7fc894068df0 con 0x7fc894096820 2023-09-30T22:26:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc898b86700 1 -- 172.21.15.59:0/68433604 >> v1:172.21.15.59:6789/0 conn(0x7fc894096820 legacy=0x7fc894096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:54.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc898b86700 1 -- 172.21.15.59:0/68433604 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc894098260 con 0x7fc894097800 2023-09-30T22:26:54.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc8937fe700 1 --2- 172.21.15.59:0/68433604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc894067940 0x7fc894097310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:54.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc898b86700 1 --2- 172.21.15.59:0/68433604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc894097800 0x7fc894130280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc88c009e90 tx=0x7fc88c009780).ready entity=mon.2 client_cookie=491a0dfef6b2da4b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:54.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc892ffd700 1 -- 172.21.15.59:0/68433604 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c00e070 con 0x7fc894097800 2023-09-30T22:26:54.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc892ffd700 1 -- 172.21.15.59:0/68433604 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c00bb00 con 0x7fc894097800 2023-09-30T22:26:54.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc892ffd700 1 -- 172.21.15.59:0/68433604 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c00be80 con 0x7fc894097800 2023-09-30T22:26:54.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc89a5e9700 1 -- 172.21.15.59:0/68433604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc894097800 msgr2=0x7fc894130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:54.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc89a5e9700 1 --2- 172.21.15.59:0/68433604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc894097800 0x7fc894130280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc88c009e90 tx=0x7fc88c009780).stop 2023-09-30T22:26:54.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc89a5e9700 1 -- 172.21.15.59:0/68433604 shutdown_connections 2023-09-30T22:26:54.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc89a5e9700 1 --2- 172.21.15.59:0/68433604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc894097800 0x7fc894130280 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:54.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc89a5e9700 1 --2- 172.21.15.59:0/68433604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc894067940 0x7fc894097310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:54.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.273+0000 7fc89a5e9700 1 -- 172.21.15.59:0/68433604 >> 172.21.15.59:0/68433604 conn(0x7fc89409ba50 msgr2=0x7fc89409be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:54.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.274+0000 7fc89a5e9700 1 -- 172.21.15.59:0/68433604 shutdown_connections 2023-09-30T22:26:54.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.274+0000 7fc89a5e9700 1 -- 172.21.15.59:0/68433604 wait complete. 2023-09-30T22:26:54.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.274+0000 7fc89a5e9700 1 Processor -- start 2023-09-30T22:26:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.275+0000 7fc89a5e9700 1 -- start start 2023-09-30T22:26:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.275+0000 7fc89a5e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc894067940 0x7fc894118510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.275+0000 7fc89a5e9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc894096820 0x7fc8941155d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.275+0000 7fc89a5e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc894097800 0x7fc894115ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.275+0000 7fc89a5e9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc894067e30 con 0x7fc894096820 2023-09-30T22:26:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.275+0000 7fc89a5e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc894119570 con 0x7fc894097800 2023-09-30T22:26:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.275+0000 7fc89a5e9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8941197f0 con 0x7fc894067940 2023-09-30T22:26:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.275+0000 7fc893fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc894067940 0x7fc894118510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.275+0000 7fc898b86700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc894097800 0x7fc894115ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.275+0000 7fc893fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc894067940 0x7fc894118510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57700/0 (socket says 172.21.15.59:57700) 2023-09-30T22:26:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.275+0000 7fc893fff700 1 -- 172.21.15.59:0/3911783202 learned_addr learned my addr 172.21.15.59:0/3911783202 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.275+0000 7fc898b86700 1 --2- 172.21.15.59:0/3911783202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc894097800 0x7fc894115ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42152/0 (socket says 172.21.15.59:42152) 2023-09-30T22:26:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.275+0000 7fc8937fe700 1 --2- 172.21.15.59:0/3911783202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc894096820 0x7fc8941155d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.276+0000 7fc893fff700 1 -- 172.21.15.59:0/3911783202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc894097800 msgr2=0x7fc894115ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.276+0000 7fc893fff700 1 --2- 172.21.15.59:0/3911783202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc894097800 0x7fc894115ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.276+0000 7fc893fff700 1 -- 172.21.15.59:0/3911783202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc894096820 msgr2=0x7fc8941155d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.276+0000 7fc893fff700 1 --2- 172.21.15.59:0/3911783202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc894096820 0x7fc8941155d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.276+0000 7fc893fff700 1 -- 172.21.15.59:0/3911783202 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8880092a0 con 0x7fc894067940 2023-09-30T22:26:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.276+0000 7fc898b86700 1 --2- 172.21.15.59:0/3911783202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc894097800 0x7fc894115ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.276+0000 7fc8937fe700 1 --2- 172.21.15.59:0/3911783202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc894096820 0x7fc8941155d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.276+0000 7fc893fff700 1 --2- 172.21.15.59:0/3911783202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc894067940 0x7fc894118510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc88400c4c0 tx=0x7fc884007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.276+0000 7fc87bfff700 1 -- 172.21.15.59:0/3911783202 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88400ce30 con 0x7fc894067940 2023-09-30T22:26:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.276+0000 7fc87bfff700 1 -- 172.21.15.59:0/3911783202 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8840072e0 con 0x7fc894067940 2023-09-30T22:26:54.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.276+0000 7fc89a5e9700 1 -- 172.21.15.59:0/3911783202 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88c009a20 con 0x7fc894067940 2023-09-30T22:26:54.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.276+0000 7fc87bfff700 1 -- 172.21.15.59:0/3911783202 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8840057a0 con 0x7fc894067940 2023-09-30T22:26:54.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.276+0000 7fc89a5e9700 1 -- 172.21.15.59:0/3911783202 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc894117160 con 0x7fc894067940 2023-09-30T22:26:54.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.277+0000 7fc89a5e9700 1 -- 172.21.15.59:0/3911783202 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc894118f50 con 0x7fc894067940 2023-09-30T22:26:54.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.278+0000 7fc87bfff700 1 -- 172.21.15.59:0/3911783202 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc884005bd0 con 0x7fc894067940 2023-09-30T22:26:54.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.278+0000 7fc87bfff700 1 -- 172.21.15.59:0/3911783202 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc88403ac80 con 0x7fc894067940 2023-09-30T22:26:54.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.282+0000 7fc87bfff700 1 -- 172.21.15.59:0/3911783202 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc884013630 con 0x7fc894067940 2023-09-30T22:26:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.500+0000 7fc89a5e9700 1 -- 172.21.15.59:0/3911783202 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc8941172f0 con 0x7fc894067940 2023-09-30T22:26:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.500+0000 7fc87bfff700 1 -- 172.21.15.59:0/3911783202 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc88401c350 con 0x7fc894067940 2023-09-30T22:26:54.500 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:26:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.502+0000 7fc89a5e9700 1 -- 172.21.15.59:0/3911783202 >> v1:172.21.15.59:6816/118188 conn(0x7fc88002bb30 legacy=0x7fc88002dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.502+0000 7fc89a5e9700 1 -- 172.21.15.59:0/3911783202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc894067940 msgr2=0x7fc894118510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.502+0000 7fc89a5e9700 1 --2- 172.21.15.59:0/3911783202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc894067940 0x7fc894118510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc88400c4c0 tx=0x7fc884007c10).stop 2023-09-30T22:26:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.502+0000 7fc89a5e9700 1 -- 172.21.15.59:0/3911783202 shutdown_connections 2023-09-30T22:26:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.502+0000 7fc89a5e9700 1 --2- 172.21.15.59:0/3911783202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc894067940 0x7fc894118510 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.502+0000 7fc89a5e9700 1 --2- 172.21.15.59:0/3911783202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc894097800 0x7fc894115ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.502+0000 7fc89a5e9700 1 --2- 172.21.15.59:0/3911783202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc894096820 0x7fc8941155d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.502+0000 7fc89a5e9700 1 -- 172.21.15.59:0/3911783202 >> 172.21.15.59:0/3911783202 conn(0x7fc89409ba50 msgr2=0x7fc894099880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.502+0000 7fc89a5e9700 1 -- 172.21.15.59:0/3911783202 shutdown_connections 2023-09-30T22:26:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:54.502+0000 7fc89a5e9700 1 -- 172.21.15.59:0/3911783202 wait complete. 2023-09-30T22:26:54.515 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T22:26:54.515 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:26:54.515 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi191.front.sepia.ceph.com 2023-09-30T22:26:54.515 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T22:26:54.515 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:26:54.515 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T22:26:54.515 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T22:26:54.516 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:26:54.516 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:26:54.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:54.516 DEBUG:teuthology.orchestra.run.smithi191:> ip addr 2023-09-30T22:26:54.538 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:26:54.538 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:26:54.539 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:26:54.539 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:26:54.539 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2023-09-30T22:26:54.539 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:26:54.539 INFO:teuthology.orchestra.run.smithi191.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:26:54.539 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f6 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:26:54.539 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f0 2023-09-30T22:26:54.539 INFO:teuthology.orchestra.run.smithi191.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:26:54.539 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f7 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:26:54.539 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f1 2023-09-30T22:26:54.539 INFO:teuthology.orchestra.run.smithi191.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:26:54.540 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:10 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:26:54.540 INFO:teuthology.orchestra.run.smithi191.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:26:54.540 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:11 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:26:54.540 INFO:teuthology.orchestra.run.smithi191.stdout: inet 172.21.15.191/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:26:54.540 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft 42503sec preferred_lft 42503sec 2023-09-30T22:26:54.540 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::ec4:7aff:fe88:7211/64 scope link 2023-09-30T22:26:54.540 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:26:54.540 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-30T22:26:54.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:54.541 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-09-30T22:26:54.541 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-09-30T22:26:54.541 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add name ceph-brx type bridge 2023-09-30T22:26:54.541 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip addr flush dev ceph-brx 2023-09-30T22:26:54.541 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set ceph-brx up 2023-09-30T22:26:54.541 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-30T22:26:54.541 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-09-30T22:26:54.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:54.712 DEBUG:teuthology.orchestra.run.smithi191:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:26:54.745 INFO:teuthology.orchestra.run.smithi191.stdout:1 2023-09-30T22:26:54.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:54.746 DEBUG:teuthology.orchestra.run.smithi191:> route 2023-09-30T22:26:54.828 INFO:teuthology.orchestra.run.smithi191.stdout:Kernel IP routing table 2023-09-30T22:26:54.828 INFO:teuthology.orchestra.run.smithi191.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:26:54.828 INFO:teuthology.orchestra.run.smithi191.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:26:54.828 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:26:54.828 INFO:teuthology.orchestra.run.smithi191.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:26:54.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:54.829 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-09-30T22:26:54.829 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-09-30T22:26:54.829 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:26:54.829 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:26:54.829 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:26:54.829 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-09-30T22:26:55.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:55.092 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2023-09-30T22:26:55.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:55.111 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list-id 2023-09-30T22:26:55.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:55.168 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-09-30T22:26:55.168 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-09-30T22:26:55.168 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:26:55.168 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-30T22:26:55.168 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-09-30T22:26:55.263 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-30T22:26:55.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:55.263 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-09-30T22:26:55.263 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-09-30T22:26:55.263 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-30T22:26:55.263 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-30T22:26:55.264 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-30T22:26:55.264 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-30T22:26:55.264 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-30T22:26:55.264 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-09-30T22:26:55.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:55.471 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-09-30T22:26:55.471 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-09-30T22:26:55.471 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set brx.0 up 2023-09-30T22:26:55.471 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set dev brx.0 master ceph-brx 2023-09-30T22:26:55.471 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-09-30T22:26:55.569 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-09-30T22:26:55.569 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:26:55.569 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T22:26:55.587 INFO:teuthology.orchestra.run.smithi191.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:26:55.587 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:26:55.587 DEBUG:teuthology.orchestra.run.smithi191:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:26:55.645 DEBUG:teuthology.orchestra.run.smithi191:> sudo modprobe fuse 2023-09-30T22:26:55.713 DEBUG:teuthology.orchestra.run.smithi191:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T22:26:55.772 INFO:teuthology.orchestra.run.smithi191.stdout:/sys 2023-09-30T22:26:55.772 INFO:teuthology.orchestra.run.smithi191.stdout:/proc 2023-09-30T22:26:55.772 INFO:teuthology.orchestra.run.smithi191.stdout:/dev 2023-09-30T22:26:55.772 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/security 2023-09-30T22:26:55.772 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/shm 2023-09-30T22:26:55.772 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/pts 2023-09-30T22:26:55.772 INFO:teuthology.orchestra.run.smithi191.stdout:/run 2023-09-30T22:26:55.772 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup 2023-09-30T22:26:55.773 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/systemd 2023-09-30T22:26:55.773 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/pstore 2023-09-30T22:26:55.773 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/bpf 2023-09-30T22:26:55.773 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-09-30T22:26:55.773 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/memory 2023-09-30T22:26:55.773 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/freezer 2023-09-30T22:26:55.773 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/hugetlb 2023-09-30T22:26:55.773 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-09-30T22:26:55.773 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/perf_event 2023-09-30T22:26:55.773 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/devices 2023-09-30T22:26:55.774 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/rdma 2023-09-30T22:26:55.774 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/blkio 2023-09-30T22:26:55.774 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/cpuset 2023-09-30T22:26:55.774 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/pids 2023-09-30T22:26:55.774 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/tracing 2023-09-30T22:26:55.774 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/config 2023-09-30T22:26:55.774 INFO:teuthology.orchestra.run.smithi191.stdout:/ 2023-09-30T22:26:55.774 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/selinux 2023-09-30T22:26:55.774 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/mqueue 2023-09-30T22:26:55.774 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/hugepages 2023-09-30T22:26:55.774 INFO:teuthology.orchestra.run.smithi191.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T22:26:55.774 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/debug 2023-09-30T22:26:55.775 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/fuse/connections 2023-09-30T22:26:55.775 INFO:teuthology.orchestra.run.smithi191.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T22:26:55.775 INFO:teuthology.orchestra.run.smithi191.stdout:/run/user/1000 2023-09-30T22:26:55.775 INFO:teuthology.orchestra.run.smithi191.stdout:/var/lib/ceph 2023-09-30T22:26:55.775 INFO:teuthology.orchestra.run.smithi191.stdout:/run/netns 2023-09-30T22:26:55.775 INFO:teuthology.orchestra.run.smithi191.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:26:55.775 INFO:teuthology.orchestra.run.smithi191.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:26:55.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:55.775 DEBUG:teuthology.orchestra.run.smithi191:> ls /sys/fs/fuse/connections 2023-09-30T22:26:55.830 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-30T22:26:55.830 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-09-30T22:26:55.872 DEBUG:teuthology.orchestra.run.smithi191:> sudo modprobe fuse 2023-09-30T22:26:55.898 DEBUG:teuthology.orchestra.run.smithi191:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T22:26:55.958 INFO:teuthology.orchestra.run.smithi191.stdout:/sys 2023-09-30T22:26:55.959 INFO:teuthology.orchestra.run.smithi191.stdout:/proc 2023-09-30T22:26:55.959 INFO:teuthology.orchestra.run.smithi191.stdout:/dev 2023-09-30T22:26:55.959 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/security 2023-09-30T22:26:55.959 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/shm 2023-09-30T22:26:55.959 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/pts 2023-09-30T22:26:55.959 INFO:teuthology.orchestra.run.smithi191.stdout:/run 2023-09-30T22:26:55.959 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup 2023-09-30T22:26:55.959 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/systemd 2023-09-30T22:26:55.960 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/pstore 2023-09-30T22:26:55.960 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/bpf 2023-09-30T22:26:55.960 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-09-30T22:26:55.960 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/memory 2023-09-30T22:26:55.960 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/freezer 2023-09-30T22:26:55.960 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/hugetlb 2023-09-30T22:26:55.960 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-09-30T22:26:55.960 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/perf_event 2023-09-30T22:26:55.960 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/devices 2023-09-30T22:26:55.960 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/rdma 2023-09-30T22:26:55.961 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/blkio 2023-09-30T22:26:55.961 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/cpuset 2023-09-30T22:26:55.961 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup/pids 2023-09-30T22:26:55.961 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/tracing 2023-09-30T22:26:55.961 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/config 2023-09-30T22:26:55.961 INFO:teuthology.orchestra.run.smithi191.stdout:/ 2023-09-30T22:26:55.961 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/selinux 2023-09-30T22:26:55.961 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/mqueue 2023-09-30T22:26:55.961 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/hugepages 2023-09-30T22:26:55.961 INFO:teuthology.orchestra.run.smithi191.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T22:26:55.961 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/debug 2023-09-30T22:26:55.962 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/fuse/connections 2023-09-30T22:26:55.962 INFO:teuthology.orchestra.run.smithi191.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T22:26:55.962 INFO:teuthology.orchestra.run.smithi191.stdout:/run/user/1000 2023-09-30T22:26:55.962 INFO:teuthology.orchestra.run.smithi191.stdout:/var/lib/ceph 2023-09-30T22:26:55.962 INFO:teuthology.orchestra.run.smithi191.stdout:/run/netns 2023-09-30T22:26:55.962 INFO:teuthology.orchestra.run.smithi191.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:26:55.962 INFO:teuthology.orchestra.run.smithi191.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:26:55.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:55.963 DEBUG:teuthology.orchestra.run.smithi191:> ls /sys/fs/fuse/connections 2023-09-30T22:26:55.967 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi191.stderr:2023-09-30T22:26:55.966+0000 7fc9a246a3c0 -1 init, newargv = 0x5634712b65a0 newargc=15 2023-09-30T22:26:55.967 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi191.stderr:ceph-fuse[112276]: starting ceph client 2023-09-30T22:26:55.972 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi191.stderr:ceph-fuse[112276]: starting fuse 2023-09-30T22:26:55.986 INFO:teuthology.orchestra.run.smithi191.stdout:46 2023-09-30T22:26:55.986 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-09-30T22:26:55.986 DEBUG:teuthology.orchestra.run.smithi191:> sudo stdin-killer -- python3 -c ' 2023-09-30T22:26:55.987 DEBUG:teuthology.orchestra.run.smithi191:> import glob 2023-09-30T22:26:55.987 DEBUG:teuthology.orchestra.run.smithi191:> import re 2023-09-30T22:26:55.987 DEBUG:teuthology.orchestra.run.smithi191:> import os 2023-09-30T22:26:55.987 DEBUG:teuthology.orchestra.run.smithi191:> import subprocess 2023-09-30T22:26:55.987 DEBUG:teuthology.orchestra.run.smithi191:> 2023-09-30T22:26:55.987 DEBUG:teuthology.orchestra.run.smithi191:> def _find_admin_socket(client_name): 2023-09-30T22:26:55.987 DEBUG:teuthology.orchestra.run.smithi191:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-09-30T22:26:55.987 DEBUG:teuthology.orchestra.run.smithi191:> files = glob.glob(asok_path) 2023-09-30T22:26:55.987 DEBUG:teuthology.orchestra.run.smithi191:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-09-30T22:26:55.987 DEBUG:teuthology.orchestra.run.smithi191:> 2023-09-30T22:26:55.987 DEBUG:teuthology.orchestra.run.smithi191:> # Given a non-glob path, it better be there 2023-09-30T22:26:55.988 DEBUG:teuthology.orchestra.run.smithi191:> if "*" not in asok_path: 2023-09-30T22:26:55.988 DEBUG:teuthology.orchestra.run.smithi191:> assert(len(files) == 1) 2023-09-30T22:26:55.988 DEBUG:teuthology.orchestra.run.smithi191:> return files[0] 2023-09-30T22:26:55.988 DEBUG:teuthology.orchestra.run.smithi191:> 2023-09-30T22:26:55.988 DEBUG:teuthology.orchestra.run.smithi191:> for f in files: 2023-09-30T22:26:55.988 DEBUG:teuthology.orchestra.run.smithi191:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T22:26:55.988 DEBUG:teuthology.orchestra.run.smithi191:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T22:26:55.988 DEBUG:teuthology.orchestra.run.smithi191:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T22:26:55.988 DEBUG:teuthology.orchestra.run.smithi191:> contents = proc_f.read() 2023-09-30T22:26:55.988 DEBUG:teuthology.orchestra.run.smithi191:> if mountpoint in contents: 2023-09-30T22:26:55.988 DEBUG:teuthology.orchestra.run.smithi191:> return f 2023-09-30T22:26:55.988 DEBUG:teuthology.orchestra.run.smithi191:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T22:26:55.988 DEBUG:teuthology.orchestra.run.smithi191:> 2023-09-30T22:26:55.989 DEBUG:teuthology.orchestra.run.smithi191:> print(_find_admin_socket("client.0")) 2023-09-30T22:26:55.989 DEBUG:teuthology.orchestra.run.smithi191:> ' 2023-09-30T22:26:56.110 INFO:teuthology.orchestra.run.smithi191.stdout:/var/run/ceph/ceph-client.0.112276.asok 2023-09-30T22:26:56.113 INFO:teuthology.orchestra.run.smithi191.stderr:2023-09-30T22:26:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T22:26:56.120 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.112276.asok 2023-09-30T22:26:56.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:56.120 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.112276.asok status 2023-09-30T22:26:56.272 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2023-09-30T22:26:56.272 INFO:teuthology.orchestra.run.smithi191.stdout: "metadata": { 2023-09-30T22:26:56.273 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_sha1": "eeb13ac974775bd0cce96a2c687e8bcc2faca43d", 2023-09-30T22:26:56.273 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_version": "ceph version 16.2.14-44-geeb13ac9 (eeb13ac974775bd0cce96a2c687e8bcc2faca43d) pacific (stable)", 2023-09-30T22:26:56.273 INFO:teuthology.orchestra.run.smithi191.stdout: "entity_id": "0", 2023-09-30T22:26:56.273 INFO:teuthology.orchestra.run.smithi191.stdout: "hostname": "smithi191", 2023-09-30T22:26:56.273 INFO:teuthology.orchestra.run.smithi191.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-09-30T22:26:56.273 INFO:teuthology.orchestra.run.smithi191.stdout: "pid": "112276", 2023-09-30T22:26:56.273 INFO:teuthology.orchestra.run.smithi191.stdout: "root": "/" 2023-09-30T22:26:56.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-09-30T22:26:56.273 INFO:teuthology.orchestra.run.smithi191.stdout: "dentry_count": 0, 2023-09-30T22:26:56.273 INFO:teuthology.orchestra.run.smithi191.stdout: "dentry_pinned_count": 0, 2023-09-30T22:26:56.273 INFO:teuthology.orchestra.run.smithi191.stdout: "id": 4511, 2023-09-30T22:26:56.273 INFO:teuthology.orchestra.run.smithi191.stdout: "inst": { 2023-09-30T22:26:56.274 INFO:teuthology.orchestra.run.smithi191.stdout: "name": { 2023-09-30T22:26:56.274 INFO:teuthology.orchestra.run.smithi191.stdout: "type": "client", 2023-09-30T22:26:56.274 INFO:teuthology.orchestra.run.smithi191.stdout: "num": 4511 2023-09-30T22:26:56.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-09-30T22:26:56.274 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": { 2023-09-30T22:26:56.274 INFO:teuthology.orchestra.run.smithi191.stdout: "type": "v1", 2023-09-30T22:26:56.274 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": "172.21.15.191:0", 2023-09-30T22:26:56.274 INFO:teuthology.orchestra.run.smithi191.stdout: "nonce": 3851505441 2023-09-30T22:26:56.274 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-09-30T22:26:56.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-09-30T22:26:56.274 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": { 2023-09-30T22:26:56.275 INFO:teuthology.orchestra.run.smithi191.stdout: "type": "v1", 2023-09-30T22:26:56.275 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": "172.21.15.191:0", 2023-09-30T22:26:56.275 INFO:teuthology.orchestra.run.smithi191.stdout: "nonce": 3851505441 2023-09-30T22:26:56.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-09-30T22:26:56.275 INFO:teuthology.orchestra.run.smithi191.stdout: "inst_str": "client.4511 172.21.15.191:0/3851505441", 2023-09-30T22:26:56.275 INFO:teuthology.orchestra.run.smithi191.stdout: "addr_str": "172.21.15.191:0/3851505441", 2023-09-30T22:26:56.275 INFO:teuthology.orchestra.run.smithi191.stdout: "inode_count": 1, 2023-09-30T22:26:56.275 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_epoch": 6, 2023-09-30T22:26:56.275 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_epoch": 19, 2023-09-30T22:26:56.275 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_epoch_barrier": 0, 2023-09-30T22:26:56.275 INFO:teuthology.orchestra.run.smithi191.stdout: "blocklisted": false, 2023-09-30T22:26:56.275 INFO:teuthology.orchestra.run.smithi191.stdout: "fs_name": "cephfs" 2023-09-30T22:26:56.275 INFO:teuthology.orchestra.run.smithi191.stdout:} 2023-09-30T22:26:56.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:56.282 DEBUG:teuthology.orchestra.run.smithi191:> stat --file-system '--printf=%T 2023-09-30T22:26:56.282 DEBUG:teuthology.orchestra.run.smithi191:> ' -- /home/ubuntu/cephtest/mnt.0 2023-09-30T22:26:56.301 INFO:teuthology.orchestra.run.smithi191.stdout:fuseblk 2023-09-30T22:26:56.301 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-09-30T22:26:56.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:26:56.301 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:26:56.369 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2023-09-30T22:26:56.379 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:26:56.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.518+0000 7f47ddc68700 1 Processor -- start 2023-09-30T22:26:56.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.518+0000 7f47ddc68700 1 -- start start 2023-09-30T22:26:56.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.519+0000 7f47ddc68700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47d8096380 0x7f47d8094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:56.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.519+0000 7f47ddc68700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47d8094c20 0x7f47d8127d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:56.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.519+0000 7f47ddc68700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d8096760 con 0x7f47d8091b00 2023-09-30T22:26:56.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.519+0000 7f47ddc68700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8091ff0 con 0x7f47d8096380 2023-09-30T22:26:56.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.519+0000 7f47ddc68700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8092c80 con 0x7f47d8094c20 2023-09-30T22:26:56.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.519+0000 7f47d7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47d8094c20 0x7f47d8127d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:56.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.519+0000 7f47d77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47d8096380 0x7f47d8094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:56.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.519+0000 7f47d6ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f47d8091b00 0x7f47d8127600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49492/0 (socket says 172.21.15.59:49492) 2023-09-30T22:26:56.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.519+0000 7f47d6ffd700 1 -- 172.21.15.59:0/4078661277 learned_addr learned my addr 172.21.15.59:0/4078661277 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:56.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.519+0000 7f47d67fc700 1 -- 172.21.15.59:0/4078661277 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800346013 0 0) 0x7f47d8096760 con 0x7f47d8091b00 2023-09-30T22:26:56.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.519+0000 7f47d67fc700 1 -- 172.21.15.59:0/4078661277 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47c40033f0 con 0x7f47d8091b00 2023-09-30T22:26:56.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.520+0000 7f47d77fe700 1 -- 172.21.15.59:0/4078661277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47d8094c20 msgr2=0x7f47d8127d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:56.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.520+0000 7f47d77fe700 1 --2- 172.21.15.59:0/4078661277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47d8094c20 0x7f47d8127d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:56.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.520+0000 7f47d77fe700 1 -- 172.21.15.59:0/4078661277 >> v1:172.21.15.59:6789/0 conn(0x7f47d8091b00 legacy=0x7f47d8127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.520+0000 7f47d77fe700 1 -- 172.21.15.59:0/4078661277 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d8093900 con 0x7f47d8096380 2023-09-30T22:26:56.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.520+0000 7f47d7fff700 1 --2- 172.21.15.59:0/4078661277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47d8094c20 0x7f47d8127d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:56.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.520+0000 7f47d77fe700 1 --2- 172.21.15.59:0/4078661277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47d8096380 0x7f47d8094730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f47c8009790 tx=0x7f47c8009060).ready entity=mon.1 client_cookie=962508975a1c67d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.520+0000 7f47d67fc700 1 -- 172.21.15.59:0/4078661277 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c800f510 con 0x7f47d8096380 2023-09-30T22:26:56.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.520+0000 7f47d67fc700 1 -- 172.21.15.59:0/4078661277 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c800f670 con 0x7f47d8096380 2023-09-30T22:26:56.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.520+0000 7f47d67fc700 1 -- 172.21.15.59:0/4078661277 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c800f9f0 con 0x7f47d8096380 2023-09-30T22:26:56.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.520+0000 7f47ddc68700 1 -- 172.21.15.59:0/4078661277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47d8096380 msgr2=0x7f47d8094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.520+0000 7f47ddc68700 1 --2- 172.21.15.59:0/4078661277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47d8096380 0x7f47d8094730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f47c8009790 tx=0x7f47c8009060).stop 2023-09-30T22:26:56.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.520+0000 7f47ddc68700 1 -- 172.21.15.59:0/4078661277 shutdown_connections 2023-09-30T22:26:56.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.520+0000 7f47ddc68700 1 --2- 172.21.15.59:0/4078661277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47d8094c20 0x7f47d8127d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:56.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.520+0000 7f47ddc68700 1 --2- 172.21.15.59:0/4078661277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47d8096380 0x7f47d8094730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:56.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.520+0000 7f47ddc68700 1 -- 172.21.15.59:0/4078661277 >> 172.21.15.59:0/4078661277 conn(0x7f47d8097470 msgr2=0x7f47d8097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.521+0000 7f47ddc68700 1 -- 172.21.15.59:0/4078661277 shutdown_connections 2023-09-30T22:26:56.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.521+0000 7f47ddc68700 1 -- 172.21.15.59:0/4078661277 wait complete. 2023-09-30T22:26:56.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.522+0000 7f47ddc68700 1 Processor -- start 2023-09-30T22:26:56.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.522+0000 7f47ddc68700 1 -- start start 2023-09-30T22:26:56.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.522+0000 7f47ddc68700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47d8091b00 0x7f47d8124ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:56.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.522+0000 7f47ddc68700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d8094c20 0x7f47d8110fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:56.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.522+0000 7f47ddc68700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47d8096380 0x7f47d81114a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:56.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.522+0000 7f47ddc68700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8113360 con 0x7f47d8094c20 2023-09-30T22:26:56.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.522+0000 7f47ddc68700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8113f30 con 0x7f47d8091b00 2023-09-30T22:26:56.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.522+0000 7f47ddc68700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8127a30 con 0x7f47d8096380 2023-09-30T22:26:56.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.522+0000 7f47d6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d8094c20 0x7f47d8110fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:56.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.522+0000 7f47d6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d8094c20 0x7f47d8110fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40680/0 (socket says 172.21.15.59:40680) 2023-09-30T22:26:56.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.522+0000 7f47d6ffd700 1 -- 172.21.15.59:0/4290480844 learned_addr learned my addr 172.21.15.59:0/4290480844 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.522+0000 7f47d7fff700 1 --2- 172.21.15.59:0/4290480844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47d8096380 0x7f47d81114a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.522+0000 7f47d77fe700 1 --2- 172.21.15.59:0/4290480844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47d8091b00 0x7f47d8124ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.523+0000 7f47d6ffd700 1 -- 172.21.15.59:0/4290480844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47d8096380 msgr2=0x7f47d81114a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.523+0000 7f47d6ffd700 1 --2- 172.21.15.59:0/4290480844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47d8096380 0x7f47d81114a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.523+0000 7f47d6ffd700 1 -- 172.21.15.59:0/4290480844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47d8091b00 msgr2=0x7f47d8124ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.523+0000 7f47d6ffd700 1 --2- 172.21.15.59:0/4290480844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47d8091b00 0x7f47d8124ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.523+0000 7f47d6ffd700 1 -- 172.21.15.59:0/4290480844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d0009a20 con 0x7f47d8094c20 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.523+0000 7f47d77fe700 1 --2- 172.21.15.59:0/4290480844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47d8091b00 0x7f47d8124ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.523+0000 7f47d6ffd700 1 --2- 172.21.15.59:0/4290480844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d8094c20 0x7f47d8110fb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f47c000c590 tx=0x7f47c0007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.523+0000 7f47cf7fe700 1 -- 172.21.15.59:0/4290480844 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c00072e0 con 0x7f47d8094c20 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.523+0000 7f47cf7fe700 1 -- 172.21.15.59:0/4290480844 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c0007440 con 0x7f47d8094c20 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.523+0000 7f47ddc68700 1 -- 172.21.15.59:0/4290480844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c80092a0 con 0x7f47d8094c20 2023-09-30T22:26:56.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.523+0000 7f47cf7fe700 1 -- 172.21.15.59:0/4290480844 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c00057a0 con 0x7f47d8094c20 2023-09-30T22:26:56.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.523+0000 7f47ddc68700 1 -- 172.21.15.59:0/4290480844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d812e9f0 con 0x7f47d8094c20 2023-09-30T22:26:56.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.524+0000 7f47cf7fe700 1 -- 172.21.15.59:0/4290480844 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f47c0005b90 con 0x7f47d8094c20 2023-09-30T22:26:56.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.524+0000 7f47cf7fe700 1 -- 172.21.15.59:0/4290480844 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f47c003a6f0 con 0x7f47d8094c20 2023-09-30T22:26:56.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.524+0000 7f47ddc68700 1 -- 172.21.15.59:0/4290480844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d805a260 con 0x7f47d8094c20 2023-09-30T22:26:56.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.529+0000 7f47cf7fe700 1 -- 172.21.15.59:0/4290480844 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f47c0005e40 con 0x7f47d8094c20 2023-09-30T22:26:56.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.707+0000 7f47ddc68700 1 -- 172.21.15.59:0/4290480844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47d80942e0 con 0x7f47d8094c20 2023-09-30T22:26:56.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.707+0000 7f47cf7fe700 1 -- 172.21.15.59:0/4290480844 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11342 (secure 0 0 0) 0x7f47c001cb00 con 0x7f47d8094c20 2023-09-30T22:26:56.708 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:56.708 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":19,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:26:53.893967+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:26:56.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.709+0000 7f47ddc68700 1 -- 172.21.15.59:0/4290480844 >> v1:172.21.15.59:6816/118188 conn(0x7f47b802bb30 legacy=0x7f47b802dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.709+0000 7f47ddc68700 1 -- 172.21.15.59:0/4290480844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d8094c20 msgr2=0x7f47d8110fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.709+0000 7f47ddc68700 1 --2- 172.21.15.59:0/4290480844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d8094c20 0x7f47d8110fb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f47c000c590 tx=0x7f47c0007c80).stop 2023-09-30T22:26:56.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.709+0000 7f47ddc68700 1 -- 172.21.15.59:0/4290480844 shutdown_connections 2023-09-30T22:26:56.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.709+0000 7f47ddc68700 1 --2- 172.21.15.59:0/4290480844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47d8096380 0x7f47d81114a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:56.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.709+0000 7f47ddc68700 1 --2- 172.21.15.59:0/4290480844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47d8091b00 0x7f47d8124ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:56.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.709+0000 7f47ddc68700 1 --2- 172.21.15.59:0/4290480844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d8094c20 0x7f47d8110fb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:56.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.709+0000 7f47ddc68700 1 -- 172.21.15.59:0/4290480844 >> 172.21.15.59:0/4290480844 conn(0x7f47d8097470 msgr2=0x7f47d8127050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.710+0000 7f47ddc68700 1 -- 172.21.15.59:0/4290480844 shutdown_connections 2023-09-30T22:26:56.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.710+0000 7f47ddc68700 1 -- 172.21.15.59:0/4290480844 wait complete. 2023-09-30T22:26:56.723 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:26:26.893716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:26:28.448775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:26:32.964075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:26:33.390842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:26:56.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:26:56.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.856+0000 7f56943c8700 1 Processor -- start 2023-09-30T22:26:56.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.856+0000 7f56943c8700 1 -- start start 2023-09-30T22:26:56.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.857+0000 7f56943c8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f568c0694d0 0x7f568c096410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:56.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.857+0000 7f56943c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f568c12e240 0x7f568c130630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:56.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.857+0000 7f56943c8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568c095e60 con 0x7f568c096900 2023-09-30T22:26:56.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.857+0000 7f56943c8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568c068d40 con 0x7f568c0694d0 2023-09-30T22:26:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.857+0000 7f56943c8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c068fb0 con 0x7f568c12e240 2023-09-30T22:26:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.857+0000 7f5692164700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f568c0694d0 0x7f568c096410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.857+0000 7f5692164700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f568c0694d0 0x7f568c096410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40690/0 (socket says 172.21.15.59:40690) 2023-09-30T22:26:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.857+0000 7f5691963700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f568c096900 0x7f568c096d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49504/0 (socket says 172.21.15.59:49504) 2023-09-30T22:26:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.857+0000 7f5692164700 1 -- 172.21.15.59:0/104131596 learned_addr learned my addr 172.21.15.59:0/104131596 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.857+0000 7f5692965700 1 --2- 172.21.15.59:0/104131596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f568c12e240 0x7f568c130630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.858+0000 7f5691162700 1 -- 172.21.15.59:0/104131596 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236932116 0 0) 0x7f568c095e60 con 0x7f568c096900 2023-09-30T22:26:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.858+0000 7f5691162700 1 -- 172.21.15.59:0/104131596 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56780033f0 con 0x7f568c096900 2023-09-30T22:26:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.858+0000 7f5692965700 1 -- 172.21.15.59:0/104131596 >> v2:172.21.15.59:3300/0 conn(0x7f568c0694d0 msgr2=0x7f568c096410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.858+0000 7f5692965700 1 --2- 172.21.15.59:0/104131596 >> v2:172.21.15.59:3300/0 conn(0x7f568c0694d0 0x7f568c096410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.858+0000 7f5692965700 1 -- 172.21.15.59:0/104131596 >> v1:172.21.15.59:6789/0 conn(0x7f568c096900 legacy=0x7f568c096d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.858+0000 7f5692965700 1 -- 172.21.15.59:0/104131596 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c068a10 con 0x7f568c12e240 2023-09-30T22:26:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.858+0000 7f5692164700 1 --2- 172.21.15.59:0/104131596 >> v2:172.21.15.59:3300/0 conn(0x7f568c0694d0 0x7f568c096410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.858+0000 7f5692965700 1 --2- 172.21.15.59:0/104131596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f568c12e240 0x7f568c130630 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f5684009e60 tx=0x7f5684009780).ready entity=mon.1 client_cookie=705e4fb3be0d9fe4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.858+0000 7f5691162700 1 -- 172.21.15.59:0/104131596 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568400e070 con 0x7f568c12e240 2023-09-30T22:26:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.858+0000 7f5691162700 1 -- 172.21.15.59:0/104131596 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568400bab0 con 0x7f568c12e240 2023-09-30T22:26:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.858+0000 7f5691162700 1 -- 172.21.15.59:0/104131596 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568400be30 con 0x7f568c12e240 2023-09-30T22:26:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.859+0000 7f56943c8700 1 -- 172.21.15.59:0/104131596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f568c12e240 msgr2=0x7f568c130630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.859+0000 7f56943c8700 1 --2- 172.21.15.59:0/104131596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f568c12e240 0x7f568c130630 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f5684009e60 tx=0x7f5684009780).stop 2023-09-30T22:26:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.859+0000 7f56943c8700 1 -- 172.21.15.59:0/104131596 shutdown_connections 2023-09-30T22:26:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.859+0000 7f56943c8700 1 --2- 172.21.15.59:0/104131596 >> v2:172.21.15.59:3300/0 conn(0x7f568c0694d0 0x7f568c096410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.859+0000 7f56943c8700 1 --2- 172.21.15.59:0/104131596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f568c12e240 0x7f568c130630 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.859+0000 7f56943c8700 1 -- 172.21.15.59:0/104131596 >> 172.21.15.59:0/104131596 conn(0x7f568c09ba60 msgr2=0x7f568c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.859+0000 7f56943c8700 1 -- 172.21.15.59:0/104131596 shutdown_connections 2023-09-30T22:26:56.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.859+0000 7f56943c8700 1 -- 172.21.15.59:0/104131596 wait complete. 2023-09-30T22:26:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.860+0000 7f56943c8700 1 Processor -- start 2023-09-30T22:26:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.860+0000 7f56943c8700 1 -- start start 2023-09-30T22:26:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.860+0000 7f56943c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f568c0694d0 0x7f568c12da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.860+0000 7f56943c8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f568c096900 0x7f568c117940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.860+0000 7f56943c8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f568c12e240 0x7f568c117e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.860+0000 7f56943c8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c118e00 con 0x7f568c12e240 2023-09-30T22:26:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.860+0000 7f56943c8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c119f70 con 0x7f568c0694d0 2023-09-30T22:26:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.860+0000 7f56943c8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f568c067db0 con 0x7f568c096900 2023-09-30T22:26:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.860+0000 7f5692164700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f568c0694d0 0x7f568c12da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.860+0000 7f5692965700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f568c12e240 0x7f568c117e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.860+0000 7f5692164700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f568c0694d0 0x7f568c12da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55164/0 (socket says 172.21.15.59:55164) 2023-09-30T22:26:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.860+0000 7f5692164700 1 -- 172.21.15.59:0/2004321553 learned_addr learned my addr 172.21.15.59:0/2004321553 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.860+0000 7f5691963700 1 --2- 172.21.15.59:0/2004321553 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f568c096900 0x7f568c117940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.861+0000 7f5692965700 1 -- 172.21.15.59:0/2004321553 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f568c096900 msgr2=0x7f568c117940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.861+0000 7f5692965700 1 --2- 172.21.15.59:0/2004321553 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f568c096900 0x7f568c117940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.861+0000 7f5692965700 1 -- 172.21.15.59:0/2004321553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f568c0694d0 msgr2=0x7f568c12da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.861+0000 7f5692965700 1 --2- 172.21.15.59:0/2004321553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f568c0694d0 0x7f568c12da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.861+0000 7f5692965700 1 -- 172.21.15.59:0/2004321553 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5680009370 con 0x7f568c12e240 2023-09-30T22:26:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.861+0000 7f5692164700 1 --2- 172.21.15.59:0/2004321553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f568c0694d0 0x7f568c12da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.861+0000 7f5692965700 1 --2- 172.21.15.59:0/2004321553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f568c12e240 0x7f568c117e30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f5684014000 tx=0x7f5684009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.861+0000 7f567e7fc700 1 -- 172.21.15.59:0/2004321553 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684013e60 con 0x7f568c12e240 2023-09-30T22:26:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.861+0000 7f567e7fc700 1 -- 172.21.15.59:0/2004321553 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568401d630 con 0x7f568c12e240 2023-09-30T22:26:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.861+0000 7f56943c8700 1 -- 172.21.15.59:0/2004321553 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5684009a20 con 0x7f568c12e240 2023-09-30T22:26:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.861+0000 7f567e7fc700 1 -- 172.21.15.59:0/2004321553 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568401d9b0 con 0x7f568c12e240 2023-09-30T22:26:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.861+0000 7f56943c8700 1 -- 172.21.15.59:0/2004321553 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c12df50 con 0x7f568c12e240 2023-09-30T22:26:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.862+0000 7f567e7fc700 1 -- 172.21.15.59:0/2004321553 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5684027460 con 0x7f568c12e240 2023-09-30T22:26:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.862+0000 7f567e7fc700 1 -- 172.21.15.59:0/2004321553 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f568403cf70 con 0x7f568c12e240 2023-09-30T22:26:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.862+0000 7f56943c8700 1 -- 172.21.15.59:0/2004321553 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568c05a260 con 0x7f568c12e240 2023-09-30T22:26:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:56.867+0000 7f567e7fc700 1 -- 172.21.15.59:0/2004321553 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f568401b310 con 0x7f568c12e240 2023-09-30T22:26:57.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.044+0000 7f56943c8700 1 -- 172.21.15.59:0/2004321553 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f568c118740 con 0x7f568c12e240 2023-09-30T22:26:57.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.045+0000 7f567e7fc700 1 -- 172.21.15.59:0/2004321553 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7f56840360b0 con 0x7f568c12e240 2023-09-30T22:26:57.045 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-30T22:26:57.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.047+0000 7f56943c8700 1 -- 172.21.15.59:0/2004321553 >> v1:172.21.15.59:6816/118188 conn(0x7f567002bb60 legacy=0x7f567002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.047+0000 7f56943c8700 1 -- 172.21.15.59:0/2004321553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f568c12e240 msgr2=0x7f568c117e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.047+0000 7f56943c8700 1 --2- 172.21.15.59:0/2004321553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f568c12e240 0x7f568c117e30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f5684014000 tx=0x7f5684009780).stop 2023-09-30T22:26:57.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.047+0000 7f56943c8700 1 -- 172.21.15.59:0/2004321553 shutdown_connections 2023-09-30T22:26:57.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.047+0000 7f56943c8700 1 --2- 172.21.15.59:0/2004321553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f568c12e240 0x7f568c117e30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.047+0000 7f56943c8700 1 --2- 172.21.15.59:0/2004321553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f568c0694d0 0x7f568c12da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.047+0000 7f56943c8700 1 --2- 172.21.15.59:0/2004321553 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f568c096900 0x7f568c117940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.047+0000 7f56943c8700 1 -- 172.21.15.59:0/2004321553 >> 172.21.15.59:0/2004321553 conn(0x7f568c09ba60 msgr2=0x7f568c094850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.047+0000 7f56943c8700 1 -- 172.21.15.59:0/2004321553 shutdown_connections 2023-09-30T22:26:57.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.047+0000 7f56943c8700 1 -- 172.21.15.59:0/2004321553 wait complete. 2023-09-30T22:26:57.060 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:26:57.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.193+0000 7ff72056e700 1 Processor -- start 2023-09-30T22:26:57.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.193+0000 7ff72056e700 1 -- start start 2023-09-30T22:26:57.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.193+0000 7ff72056e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7181275c0 0x7ff71812fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:57.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.193+0000 7ff72056e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff718130220 0x7ff718132610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:57.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.193+0000 7ff72056e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff718091c80 con 0x7ff7180926d0 2023-09-30T22:26:57.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.193+0000 7ff72056e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7181279e0 con 0x7ff718130220 2023-09-30T22:26:57.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.193+0000 7ff72056e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7180999d0 con 0x7ff7181275c0 2023-09-30T22:26:57.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.194+0000 7ff71db09700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7181275c0 0x7ff71812fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:57.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.194+0000 7ff71eb0b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff718130220 0x7ff718132610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:57.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.194+0000 7ff71e30a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff7180926d0 0x7ff718127be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49510/0 (socket says 172.21.15.59:49510) 2023-09-30T22:26:57.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.194+0000 7ff71e30a700 1 -- 172.21.15.59:0/3177682598 learned_addr learned my addr 172.21.15.59:0/3177682598 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:57.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.194+0000 7ff71db09700 1 -- 172.21.15.59:0/3177682598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff718130220 msgr2=0x7ff718132610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:57.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.194+0000 7ff71db09700 1 --2- 172.21.15.59:0/3177682598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff718130220 0x7ff718132610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.194+0000 7ff71db09700 1 -- 172.21.15.59:0/3177682598 >> v1:172.21.15.59:6789/0 conn(0x7ff7180926d0 legacy=0x7ff718127be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.194+0000 7ff71d308700 1 -- 172.21.15.59:0/3177682598 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043987174 0 0) 0x7ff718091c80 con 0x7ff7180926d0 2023-09-30T22:26:57.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.194+0000 7ff71db09700 1 -- 172.21.15.59:0/3177682598 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71809a280 con 0x7ff7181275c0 2023-09-30T22:26:57.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.194+0000 7ff71db09700 1 --2- 172.21.15.59:0/3177682598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7181275c0 0x7ff71812fd30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff7080097c0 tx=0x7ff708009060).ready entity=mon.2 client_cookie=dfbed7bc559347fc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.194+0000 7ff71d308700 1 -- 172.21.15.59:0/3177682598 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70800f510 con 0x7ff7181275c0 2023-09-30T22:26:57.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.194+0000 7ff71d308700 1 -- 172.21.15.59:0/3177682598 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70800f670 con 0x7ff7181275c0 2023-09-30T22:26:57.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.194+0000 7ff71d308700 1 -- 172.21.15.59:0/3177682598 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70800f9f0 con 0x7ff7181275c0 2023-09-30T22:26:57.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.195+0000 7ff72056e700 1 -- 172.21.15.59:0/3177682598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7181275c0 msgr2=0x7ff71812fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.195+0000 7ff72056e700 1 --2- 172.21.15.59:0/3177682598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7181275c0 0x7ff71812fd30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff7080097c0 tx=0x7ff708009060).stop 2023-09-30T22:26:57.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.195+0000 7ff72056e700 1 -- 172.21.15.59:0/3177682598 shutdown_connections 2023-09-30T22:26:57.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.195+0000 7ff72056e700 1 --2- 172.21.15.59:0/3177682598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff718130220 0x7ff718132610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.195+0000 7ff72056e700 1 --2- 172.21.15.59:0/3177682598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7181275c0 0x7ff71812fd30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.195+0000 7ff72056e700 1 -- 172.21.15.59:0/3177682598 >> 172.21.15.59:0/3177682598 conn(0x7ff718097480 msgr2=0x7ff718097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.195+0000 7ff72056e700 1 -- 172.21.15.59:0/3177682598 shutdown_connections 2023-09-30T22:26:57.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.195+0000 7ff72056e700 1 -- 172.21.15.59:0/3177682598 wait complete. 2023-09-30T22:26:57.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.196+0000 7ff72056e700 1 Processor -- start 2023-09-30T22:26:57.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.196+0000 7ff72056e700 1 -- start start 2023-09-30T22:26:57.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.196+0000 7ff72056e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7180926d0 0x7ff71812df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:57.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.196+0000 7ff72056e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7181275c0 0x7ff71812e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:57.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.196+0000 7ff72056e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff718130220 0x7ff71812e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:57.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.196+0000 7ff72056e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71812ee10 con 0x7ff7181275c0 2023-09-30T22:26:57.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.196+0000 7ff72056e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71812f410 con 0x7ff7180926d0 2023-09-30T22:26:57.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.196+0000 7ff72056e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7181129c0 con 0x7ff718130220 2023-09-30T22:26:57.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.196+0000 7ff71e30a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7180926d0 0x7ff71812df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:57.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.196+0000 7ff71db09700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7181275c0 0x7ff71812e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:57.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.196+0000 7ff71e30a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7180926d0 0x7ff71812df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55180/0 (socket says 172.21.15.59:55180) 2023-09-30T22:26:57.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.196+0000 7ff71db09700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7181275c0 0x7ff71812e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40706/0 (socket says 172.21.15.59:40706) 2023-09-30T22:26:57.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.196+0000 7ff71e30a700 1 -- 172.21.15.59:0/2733572651 learned_addr learned my addr 172.21.15.59:0/2733572651 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:57.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.197+0000 7ff71eb0b700 1 --2- 172.21.15.59:0/2733572651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff718130220 0x7ff71812e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:57.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.197+0000 7ff71db09700 1 -- 172.21.15.59:0/2733572651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff718130220 msgr2=0x7ff71812e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.197+0000 7ff71db09700 1 --2- 172.21.15.59:0/2733572651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff718130220 0x7ff71812e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.197+0000 7ff71db09700 1 -- 172.21.15.59:0/2733572651 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7180926d0 msgr2=0x7ff71812df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.197+0000 7ff71db09700 1 --2- 172.21.15.59:0/2733572651 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7180926d0 0x7ff71812df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.197+0000 7ff71db09700 1 -- 172.21.15.59:0/2733572651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7080092a0 con 0x7ff7181275c0 2023-09-30T22:26:57.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.197+0000 7ff71e30a700 1 --2- 172.21.15.59:0/2733572651 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7180926d0 0x7ff71812df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:57.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.197+0000 7ff71eb0b700 1 --2- 172.21.15.59:0/2733572651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff718130220 0x7ff71812e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:57.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.197+0000 7ff71db09700 1 --2- 172.21.15.59:0/2733572651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7181275c0 0x7ff71812e430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff708014000 tx=0x7ff708017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.197+0000 7ff70e7fc700 1 -- 172.21.15.59:0/2733572651 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70800f7e0 con 0x7ff7181275c0 2023-09-30T22:26:57.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.197+0000 7ff70e7fc700 1 -- 172.21.15.59:0/2733572651 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70800f940 con 0x7ff7181275c0 2023-09-30T22:26:57.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.197+0000 7ff70e7fc700 1 -- 172.21.15.59:0/2733572651 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70801b660 con 0x7ff7181275c0 2023-09-30T22:26:57.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.197+0000 7ff72056e700 1 -- 172.21.15.59:0/2733572651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff718112700 con 0x7ff7181275c0 2023-09-30T22:26:57.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.197+0000 7ff72056e700 1 -- 172.21.15.59:0/2733572651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7181138e0 con 0x7ff7181275c0 2023-09-30T22:26:57.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.198+0000 7ff70e7fc700 1 -- 172.21.15.59:0/2733572651 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff70801ba50 con 0x7ff7181275c0 2023-09-30T22:26:57.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.198+0000 7ff70e7fc700 1 -- 172.21.15.59:0/2733572651 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff70803c690 con 0x7ff7181275c0 2023-09-30T22:26:57.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.198+0000 7ff72056e700 1 -- 172.21.15.59:0/2733572651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff718113880 con 0x7ff7181275c0 2023-09-30T22:26:57.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.203+0000 7ff70e7fc700 1 -- 172.21.15.59:0/2733572651 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff70801f080 con 0x7ff7181275c0 2023-09-30T22:26:57.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.375+0000 7ff72056e700 1 -- 172.21.15.59:0/2733572651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff71805a260 con 0x7ff7181275c0 2023-09-30T22:26:57.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.375+0000 7ff70e7fc700 1 -- 172.21.15.59:0/2733572651 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff708029030 con 0x7ff7181275c0 2023-09-30T22:26:57.376 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-09-30T22:26:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.377+0000 7ff72056e700 1 -- 172.21.15.59:0/2733572651 >> v1:172.21.15.59:6816/118188 conn(0x7ff6fc02bb90 legacy=0x7ff6fc02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.377+0000 7ff72056e700 1 -- 172.21.15.59:0/2733572651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7181275c0 msgr2=0x7ff71812e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.377+0000 7ff72056e700 1 --2- 172.21.15.59:0/2733572651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7181275c0 0x7ff71812e430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff708014000 tx=0x7ff708017000).stop 2023-09-30T22:26:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.377+0000 7ff72056e700 1 -- 172.21.15.59:0/2733572651 shutdown_connections 2023-09-30T22:26:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.377+0000 7ff72056e700 1 --2- 172.21.15.59:0/2733572651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff718130220 0x7ff71812e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.378+0000 7ff72056e700 1 --2- 172.21.15.59:0/2733572651 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7180926d0 0x7ff71812df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.378+0000 7ff72056e700 1 --2- 172.21.15.59:0/2733572651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7181275c0 0x7ff71812e430 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.378+0000 7ff72056e700 1 -- 172.21.15.59:0/2733572651 >> 172.21.15.59:0/2733572651 conn(0x7ff718097480 msgr2=0x7ff718092d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.378+0000 7ff72056e700 1 -- 172.21.15.59:0/2733572651 shutdown_connections 2023-09-30T22:26:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.378+0000 7ff72056e700 1 -- 172.21.15.59:0/2733572651 wait complete. 2023-09-30T22:26:57.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:26:57.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.524+0000 7f4cf30b1700 1 Processor -- start 2023-09-30T22:26:57.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.525+0000 7f4cf30b1700 1 -- start start 2023-09-30T22:26:57.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.525+0000 7f4cf30b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cec0919e0 0x7f4cec091dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:57.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.525+0000 7f4cf30b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cec0922b0 0x7f4cec127990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:57.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.525+0000 7f4cf30b1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec092c00 con 0x7f4cec127e80 2023-09-30T22:26:57.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.525+0000 7f4cf30b1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec0941a0 con 0x7f4cec0922b0 2023-09-30T22:26:57.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.525+0000 7f4cf30b1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec094420 con 0x7f4cec0919e0 2023-09-30T22:26:57.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.525+0000 7f4cf0e4d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cec0919e0 0x7f4cec091dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:57.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.525+0000 7f4cebfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cec0922b0 0x7f4cec127990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:57.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.525+0000 7f4cf0e4d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cec0919e0 0x7f4cec091dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37396/0 (socket says 172.21.15.59:37396) 2023-09-30T22:26:57.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.525+0000 7f4cf164e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4cec127e80 0x7f4cec12edf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49518/0 (socket says 172.21.15.59:49518) 2023-09-30T22:26:57.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.525+0000 7f4cf0e4d700 1 -- 172.21.15.59:0/1772923974 learned_addr learned my addr 172.21.15.59:0/1772923974 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:57.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.526+0000 7f4ceb7fe700 1 -- 172.21.15.59:0/1772923974 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400321408 0 0) 0x7f4cec092c00 con 0x7f4cec127e80 2023-09-30T22:26:57.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.526+0000 7f4cebfff700 1 -- 172.21.15.59:0/1772923974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cec0919e0 msgr2=0x7f4cec091dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:57.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.526+0000 7f4cebfff700 1 --2- 172.21.15.59:0/1772923974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cec0919e0 0x7f4cec091dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.526+0000 7f4cebfff700 1 -- 172.21.15.59:0/1772923974 >> v1:172.21.15.59:6789/0 conn(0x7f4cec127e80 legacy=0x7f4cec12edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.526+0000 7f4cebfff700 1 -- 172.21.15.59:0/1772923974 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec093630 con 0x7f4cec0922b0 2023-09-30T22:26:57.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.526+0000 7f4cf0e4d700 1 --2- 172.21.15.59:0/1772923974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cec0919e0 0x7f4cec091dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:57.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.526+0000 7f4cebfff700 1 --2- 172.21.15.59:0/1772923974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cec0922b0 0x7f4cec127990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4cd8009790 tx=0x7f4cd8009060).ready entity=mon.1 client_cookie=a4f988fd613dc68b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.526+0000 7f4ceb7fe700 1 -- 172.21.15.59:0/1772923974 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd80090d0 con 0x7f4cec0922b0 2023-09-30T22:26:57.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.526+0000 7f4ceb7fe700 1 -- 172.21.15.59:0/1772923974 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd800f510 con 0x7f4cec0922b0 2023-09-30T22:26:57.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.526+0000 7f4ceb7fe700 1 -- 172.21.15.59:0/1772923974 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd800f890 con 0x7f4cec0922b0 2023-09-30T22:26:57.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.527+0000 7f4cf30b1700 1 -- 172.21.15.59:0/1772923974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cec0922b0 msgr2=0x7f4cec127990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.527+0000 7f4cf30b1700 1 --2- 172.21.15.59:0/1772923974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cec0922b0 0x7f4cec127990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4cd8009790 tx=0x7f4cd8009060).stop 2023-09-30T22:26:57.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.527+0000 7f4cf30b1700 1 -- 172.21.15.59:0/1772923974 shutdown_connections 2023-09-30T22:26:57.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.527+0000 7f4cf30b1700 1 --2- 172.21.15.59:0/1772923974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cec0919e0 0x7f4cec091dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.527+0000 7f4cf30b1700 1 --2- 172.21.15.59:0/1772923974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cec0922b0 0x7f4cec127990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.527+0000 7f4cf30b1700 1 -- 172.21.15.59:0/1772923974 >> 172.21.15.59:0/1772923974 conn(0x7f4cec09a1c0 msgr2=0x7f4cec09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.527+0000 7f4cf30b1700 1 -- 172.21.15.59:0/1772923974 shutdown_connections 2023-09-30T22:26:57.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.527+0000 7f4cf30b1700 1 -- 172.21.15.59:0/1772923974 wait complete. 2023-09-30T22:26:57.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.528+0000 7f4cf30b1700 1 Processor -- start 2023-09-30T22:26:57.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.528+0000 7f4cf30b1700 1 -- start start 2023-09-30T22:26:57.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.528+0000 7f4cf30b1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cec0919e0 0x7f4cec12cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:57.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.528+0000 7f4cf30b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cec0922b0 0x7f4cec12d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:57.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.528+0000 7f4cf30b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cec127e80 0x7f4cec12d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:57.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.528+0000 7f4cf30b1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec12dde0 con 0x7f4cec0919e0 2023-09-30T22:26:57.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.528+0000 7f4cf30b1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec115390 con 0x7f4cec0922b0 2023-09-30T22:26:57.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.528+0000 7f4cf30b1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec097890 con 0x7f4cec127e80 2023-09-30T22:26:57.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4cf0e4d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cec0919e0 0x7f4cec12cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:57.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4cf164e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cec127e80 0x7f4cec12d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:57.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4cf0e4d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cec0919e0 0x7f4cec12cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40716/0 (socket says 172.21.15.59:40716) 2023-09-30T22:26:57.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4cf0e4d700 1 -- 172.21.15.59:0/949428632 learned_addr learned my addr 172.21.15.59:0/949428632 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:57.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4cebfff700 1 --2- 172.21.15.59:0/949428632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cec0922b0 0x7f4cec12d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:57.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4cf0e4d700 1 -- 172.21.15.59:0/949428632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cec127e80 msgr2=0x7f4cec12d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4cf0e4d700 1 --2- 172.21.15.59:0/949428632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cec127e80 0x7f4cec12d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4cf0e4d700 1 -- 172.21.15.59:0/949428632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cec0922b0 msgr2=0x7f4cec12d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4cf0e4d700 1 --2- 172.21.15.59:0/949428632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cec0922b0 0x7f4cec12d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4cf0e4d700 1 -- 172.21.15.59:0/949428632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce0009370 con 0x7f4cec0919e0 2023-09-30T22:26:57.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4cf164e700 1 --2- 172.21.15.59:0/949428632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cec127e80 0x7f4cec12d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:57.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4cf0e4d700 1 --2- 172.21.15.59:0/949428632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cec0919e0 0x7f4cec12cf10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f4ce000ea50 tx=0x7f4ce00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4ce8ff9700 1 -- 172.21.15.59:0/949428632 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000ee90 con 0x7f4cec0919e0 2023-09-30T22:26:57.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4ce8ff9700 1 -- 172.21.15.59:0/949428632 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce000c850 con 0x7f4cec0919e0 2023-09-30T22:26:57.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4ce8ff9700 1 -- 172.21.15.59:0/949428632 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000cbd0 con 0x7f4cec0919e0 2023-09-30T22:26:57.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4cf30b1700 1 -- 172.21.15.59:0/949428632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd80092a0 con 0x7f4cec0919e0 2023-09-30T22:26:57.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.529+0000 7f4cf30b1700 1 -- 172.21.15.59:0/949428632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec130030 con 0x7f4cec0919e0 2023-09-30T22:26:57.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.530+0000 7f4ce8ff9700 1 -- 172.21.15.59:0/949428632 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4ce001b400 con 0x7f4cec0919e0 2023-09-30T22:26:57.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.530+0000 7f4ce8ff9700 1 -- 172.21.15.59:0/949428632 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4ce003b5f0 con 0x7f4cec0919e0 2023-09-30T22:26:57.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.531+0000 7f4cf30b1700 1 -- 172.21.15.59:0/949428632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cec130770 con 0x7f4cec0919e0 2023-09-30T22:26:57.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.535+0000 7f4ce8ff9700 1 -- 172.21.15.59:0/949428632 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4ce0016020 con 0x7f4cec0919e0 2023-09-30T22:26:57.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.708+0000 7f4cf30b1700 1 -- 172.21.15.59:0/949428632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4cec05a260 con 0x7f4cec0919e0 2023-09-30T22:26:57.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.708+0000 7f4ce8ff9700 1 -- 172.21.15.59:0/949428632 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ce001be60 con 0x7f4cec0919e0 2023-09-30T22:26:57.708 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-30T22:26:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.710+0000 7f4cf30b1700 1 -- 172.21.15.59:0/949428632 >> v1:172.21.15.59:6816/118188 conn(0x7f4cd002bb60 legacy=0x7f4cd002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.710+0000 7f4cf30b1700 1 -- 172.21.15.59:0/949428632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cec0919e0 msgr2=0x7f4cec12cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.710+0000 7f4cf30b1700 1 --2- 172.21.15.59:0/949428632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cec0919e0 0x7f4cec12cf10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f4ce000ea50 tx=0x7f4ce00090f0).stop 2023-09-30T22:26:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.710+0000 7f4cf30b1700 1 -- 172.21.15.59:0/949428632 shutdown_connections 2023-09-30T22:26:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.710+0000 7f4cf30b1700 1 --2- 172.21.15.59:0/949428632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cec127e80 0x7f4cec12d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.710+0000 7f4cf30b1700 1 --2- 172.21.15.59:0/949428632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cec0919e0 0x7f4cec12cf10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.710+0000 7f4cf30b1700 1 --2- 172.21.15.59:0/949428632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cec0922b0 0x7f4cec12d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.710+0000 7f4cf30b1700 1 -- 172.21.15.59:0/949428632 >> 172.21.15.59:0/949428632 conn(0x7f4cec09a1c0 msgr2=0x7f4cec096370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.710+0000 7f4cf30b1700 1 -- 172.21.15.59:0/949428632 shutdown_connections 2023-09-30T22:26:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.711+0000 7f4cf30b1700 1 -- 172.21.15.59:0/949428632 wait complete. 2023-09-30T22:26:57.724 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:26:57.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.857+0000 7f4ed05a4700 1 Processor -- start 2023-09-30T22:26:57.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.857+0000 7f4ed05a4700 1 -- start start 2023-09-30T22:26:57.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4ed05a4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8059070 0x7f4ec8125250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:57.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4ed05a4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ec812db40 0x7f4ec812ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:57.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4ed05a4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec8098790 con 0x7f4ec81257f0 2023-09-30T22:26:57.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4ed05a4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec8059450 con 0x7f4ec812db40 2023-09-30T22:26:57.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4ed05a4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec8059da0 con 0x7f4ec8059070 2023-09-30T22:26:57.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4eceb41700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ec812db40 0x7f4ec812ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:57.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4ecdb3f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4ec81257f0 0x7f4ec8125c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49520/0 (socket says 172.21.15.59:49520) 2023-09-30T22:26:57.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4ecdb3f700 1 -- 172.21.15.59:0/142871141 learned_addr learned my addr 172.21.15.59:0/142871141 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:57.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4ece340700 1 --2- 172.21.15.59:0/142871141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8059070 0x7f4ec8125250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:57.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4eceb41700 1 -- 172.21.15.59:0/142871141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8059070 msgr2=0x7f4ec8125250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:57.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4eceb41700 1 --2- 172.21.15.59:0/142871141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8059070 0x7f4ec8125250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4eceb41700 1 -- 172.21.15.59:0/142871141 >> v1:172.21.15.59:6789/0 conn(0x7f4ec81257f0 legacy=0x7f4ec8125c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4eceb41700 1 -- 172.21.15.59:0/142871141 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec80996f0 con 0x7f4ec812db40 2023-09-30T22:26:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4ecd33e700 1 -- 172.21.15.59:0/142871141 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517505416 0 0) 0x7f4ec8098790 con 0x7f4ec81257f0 2023-09-30T22:26:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4eceb41700 1 --2- 172.21.15.59:0/142871141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec812db40 0x7f4ec812ff30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f4ec0009e60 tx=0x7f4ec0009780).ready entity=mon.0 client_cookie=cd690bb1215c575a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.858+0000 7f4ecd33e700 1 -- 172.21.15.59:0/142871141 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec000e070 con 0x7f4ec812db40 2023-09-30T22:26:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.859+0000 7f4ecd33e700 1 -- 172.21.15.59:0/142871141 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec000bb60 con 0x7f4ec812db40 2023-09-30T22:26:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.859+0000 7f4ecd33e700 1 -- 172.21.15.59:0/142871141 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0012410 con 0x7f4ec812db40 2023-09-30T22:26:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.859+0000 7f4ed05a4700 1 -- 172.21.15.59:0/142871141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec812db40 msgr2=0x7f4ec812ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.859+0000 7f4ed05a4700 1 --2- 172.21.15.59:0/142871141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec812db40 0x7f4ec812ff30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f4ec0009e60 tx=0x7f4ec0009780).stop 2023-09-30T22:26:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.859+0000 7f4ed05a4700 1 -- 172.21.15.59:0/142871141 shutdown_connections 2023-09-30T22:26:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.859+0000 7f4ed05a4700 1 --2- 172.21.15.59:0/142871141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec812db40 0x7f4ec812ff30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.859+0000 7f4ed05a4700 1 --2- 172.21.15.59:0/142871141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8059070 0x7f4ec8125250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.859+0000 7f4ed05a4700 1 -- 172.21.15.59:0/142871141 >> 172.21.15.59:0/142871141 conn(0x7f4ec8097480 msgr2=0x7f4ec8097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.859+0000 7f4ed05a4700 1 -- 172.21.15.59:0/142871141 shutdown_connections 2023-09-30T22:26:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.859+0000 7f4ed05a4700 1 -- 172.21.15.59:0/142871141 wait complete. 2023-09-30T22:26:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.860+0000 7f4ed05a4700 1 Processor -- start 2023-09-30T22:26:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.860+0000 7f4ed05a4700 1 -- start start 2023-09-30T22:26:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4ed05a4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8059070 0x7f4ec80690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4ed05a4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ec81257f0 0x7f4ec812baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4ed05a4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec812db40 0x7f4ec812bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4ed05a4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec81281e0 con 0x7f4ec812db40 2023-09-30T22:26:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4ed05a4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec8069e30 con 0x7f4ec8059070 2023-09-30T22:26:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4ed05a4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec812a970 con 0x7f4ec81257f0 2023-09-30T22:26:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4ece340700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8059070 0x7f4ec80690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4ece340700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8059070 0x7f4ec80690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55208/0 (socket says 172.21.15.59:55208) 2023-09-30T22:26:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4ece340700 1 -- 172.21.15.59:0/4185880520 learned_addr learned my addr 172.21.15.59:0/4185880520 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4eceb41700 1 --2- 172.21.15.59:0/4185880520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec812db40 0x7f4ec812bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4ecdb3f700 1 --2- 172.21.15.59:0/4185880520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ec81257f0 0x7f4ec812baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4eceb41700 1 -- 172.21.15.59:0/4185880520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ec81257f0 msgr2=0x7f4ec812baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4eceb41700 1 --2- 172.21.15.59:0/4185880520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ec81257f0 0x7f4ec812baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4eceb41700 1 -- 172.21.15.59:0/4185880520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8059070 msgr2=0x7f4ec80690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4eceb41700 1 --2- 172.21.15.59:0/4185880520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8059070 0x7f4ec80690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4eceb41700 1 -- 172.21.15.59:0/4185880520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec0009a20 con 0x7f4ec812db40 2023-09-30T22:26:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4eceb41700 1 --2- 172.21.15.59:0/4185880520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec812db40 0x7f4ec812bfe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f4ec0014000 tx=0x7f4ec0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4eba7fc700 1 -- 172.21.15.59:0/4185880520 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0012410 con 0x7f4ec812db40 2023-09-30T22:26:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4eba7fc700 1 -- 172.21.15.59:0/4185880520 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec001d630 con 0x7f4ec812db40 2023-09-30T22:26:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4eba7fc700 1 -- 172.21.15.59:0/4185880520 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec00070e0 con 0x7f4ec812db40 2023-09-30T22:26:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.861+0000 7f4ed05a4700 1 -- 172.21.15.59:0/4185880520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec812d8a0 con 0x7f4ec812db40 2023-09-30T22:26:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.862+0000 7f4ed05a4700 1 -- 172.21.15.59:0/4185880520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec812b7b0 con 0x7f4ec812db40 2023-09-30T22:26:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.862+0000 7f4eba7fc700 1 -- 172.21.15.59:0/4185880520 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4ec0003040 con 0x7f4ec812db40 2023-09-30T22:26:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.862+0000 7f4eba7fc700 1 -- 172.21.15.59:0/4185880520 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4ec003ca50 con 0x7f4ec812db40 2023-09-30T22:26:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.863+0000 7f4ed05a4700 1 -- 172.21.15.59:0/4185880520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec812b7b0 con 0x7f4ec812db40 2023-09-30T22:26:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:57.867+0000 7f4eba7fc700 1 -- 172.21.15.59:0/4185880520 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4ec812b7b0 con 0x7f4ec812db40 2023-09-30T22:26:58.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.048+0000 7f4ed05a4700 1 -- 172.21.15.59:0/4185880520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ec812b7b0 con 0x7f4ec812db40 2023-09-30T22:26:58.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.048+0000 7f4eba7fc700 1 -- 172.21.15.59:0/4185880520 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ec812b7b0 con 0x7f4ec812db40 2023-09-30T22:26:58.048 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-30T22:26:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.050+0000 7f4ed05a4700 1 -- 172.21.15.59:0/4185880520 >> v1:172.21.15.59:6816/118188 conn(0x7f4eac02bb90 legacy=0x7f4eac02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.050+0000 7f4ed05a4700 1 -- 172.21.15.59:0/4185880520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec812db40 msgr2=0x7f4ec812bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.050+0000 7f4ed05a4700 1 --2- 172.21.15.59:0/4185880520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec812db40 0x7f4ec812bfe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f4ec0014000 tx=0x7f4ec0009780).stop 2023-09-30T22:26:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.050+0000 7f4ed05a4700 1 -- 172.21.15.59:0/4185880520 shutdown_connections 2023-09-30T22:26:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.050+0000 7f4ed05a4700 1 --2- 172.21.15.59:0/4185880520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec812db40 0x7f4ec812bfe0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.050+0000 7f4ed05a4700 1 --2- 172.21.15.59:0/4185880520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8059070 0x7f4ec80690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.050+0000 7f4ed05a4700 1 --2- 172.21.15.59:0/4185880520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ec81257f0 0x7f4ec812baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.050+0000 7f4ed05a4700 1 -- 172.21.15.59:0/4185880520 >> 172.21.15.59:0/4185880520 conn(0x7f4ec8097480 msgr2=0x7f4ec812f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.050+0000 7f4ed05a4700 1 -- 172.21.15.59:0/4185880520 shutdown_connections 2023-09-30T22:26:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.050+0000 7f4ed05a4700 1 -- 172.21.15.59:0/4185880520 wait complete. 2023-09-30T22:26:58.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:26:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.192+0000 7fef383cf700 1 Processor -- start 2023-09-30T22:26:58.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.192+0000 7fef383cf700 1 -- start start 2023-09-30T22:26:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.193+0000 7fef383cf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef30059070 0x7fef301256c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.193+0000 7fef383cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef30125bb0 0x7fef30094300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.193+0000 7fef383cf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef30095f00 con 0x7fef301251c0 2023-09-30T22:26:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.193+0000 7fef383cf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef30059450 con 0x7fef30059070 2023-09-30T22:26:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.193+0000 7fef383cf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef30096190 con 0x7fef30125bb0 2023-09-30T22:26:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.193+0000 7fef3696c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef30125bb0 0x7fef30094300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.193+0000 7fef3616b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef30059070 0x7fef301256c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.193+0000 7fef3596a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fef301251c0 0x7fef30093bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49532/0 (socket says 172.21.15.59:49532) 2023-09-30T22:26:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.193+0000 7fef3596a700 1 -- 172.21.15.59:0/3521310047 learned_addr learned my addr 172.21.15.59:0/3521310047 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.194+0000 7fef3616b700 1 -- 172.21.15.59:0/3521310047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef30125bb0 msgr2=0x7fef30094300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.194+0000 7fef3616b700 1 --2- 172.21.15.59:0/3521310047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef30125bb0 0x7fef30094300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.194+0000 7fef3616b700 1 -- 172.21.15.59:0/3521310047 >> v1:172.21.15.59:6789/0 conn(0x7fef301251c0 legacy=0x7fef30093bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.194+0000 7fef3616b700 1 -- 172.21.15.59:0/3521310047 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef30059dd0 con 0x7fef30059070 2023-09-30T22:26:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.194+0000 7fef35169700 1 -- 172.21.15.59:0/3521310047 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287392919 0 0) 0x7fef30095f00 con 0x7fef301251c0 2023-09-30T22:26:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.194+0000 7fef3696c700 1 --2- 172.21.15.59:0/3521310047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef30125bb0 0x7fef30094300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.194+0000 7fef3616b700 1 --2- 172.21.15.59:0/3521310047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef30059070 0x7fef301256c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fef2c009760 tx=0x7fef2c009060).ready entity=mon.0 client_cookie=84f6ea79495e05e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.194+0000 7fef35169700 1 -- 172.21.15.59:0/3521310047 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00f510 con 0x7fef30059070 2023-09-30T22:26:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.194+0000 7fef35169700 1 -- 172.21.15.59:0/3521310047 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c00f670 con 0x7fef30059070 2023-09-30T22:26:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.194+0000 7fef35169700 1 -- 172.21.15.59:0/3521310047 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00f9f0 con 0x7fef30059070 2023-09-30T22:26:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.194+0000 7fef383cf700 1 -- 172.21.15.59:0/3521310047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef30059070 msgr2=0x7fef301256c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.194+0000 7fef383cf700 1 --2- 172.21.15.59:0/3521310047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef30059070 0x7fef301256c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fef2c009760 tx=0x7fef2c009060).stop 2023-09-30T22:26:58.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.195+0000 7fef383cf700 1 -- 172.21.15.59:0/3521310047 shutdown_connections 2023-09-30T22:26:58.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.195+0000 7fef383cf700 1 --2- 172.21.15.59:0/3521310047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef30125bb0 0x7fef30094300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.195+0000 7fef383cf700 1 --2- 172.21.15.59:0/3521310047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef30059070 0x7fef301256c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.195+0000 7fef383cf700 1 -- 172.21.15.59:0/3521310047 >> 172.21.15.59:0/3521310047 conn(0x7fef30097470 msgr2=0x7fef30097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:58.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.195+0000 7fef383cf700 1 -- 172.21.15.59:0/3521310047 shutdown_connections 2023-09-30T22:26:58.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.195+0000 7fef383cf700 1 -- 172.21.15.59:0/3521310047 wait complete. 2023-09-30T22:26:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.196+0000 7fef383cf700 1 Processor -- start 2023-09-30T22:26:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.196+0000 7fef383cf700 1 -- start start 2023-09-30T22:26:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef383cf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef30059070 0x7fef30116c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef383cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef301251c0 0x7fef30091a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef383cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef30125bb0 0x7fef30091f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef383cf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef30117c70 con 0x7fef30059070 2023-09-30T22:26:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef383cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef301171d0 con 0x7fef30125bb0 2023-09-30T22:26:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef383cf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef30092e50 con 0x7fef301251c0 2023-09-30T22:26:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef3616b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef30059070 0x7fef30116c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef3596a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef301251c0 0x7fef30091a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef3616b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef30059070 0x7fef30116c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40748/0 (socket says 172.21.15.59:40748) 2023-09-30T22:26:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef3616b700 1 -- 172.21.15.59:0/1266202126 learned_addr learned my addr 172.21.15.59:0/1266202126 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef3596a700 1 --2- 172.21.15.59:0/1266202126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef301251c0 0x7fef30091a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37440/0 (socket says 172.21.15.59:37440) 2023-09-30T22:26:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef3696c700 1 --2- 172.21.15.59:0/1266202126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef30125bb0 0x7fef30091f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef3616b700 1 -- 172.21.15.59:0/1266202126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef301251c0 msgr2=0x7fef30091a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef3616b700 1 --2- 172.21.15.59:0/1266202126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef301251c0 0x7fef30091a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef3616b700 1 -- 172.21.15.59:0/1266202126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef30125bb0 msgr2=0x7fef30091f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef3616b700 1 --2- 172.21.15.59:0/1266202126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef30125bb0 0x7fef30091f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef3616b700 1 -- 172.21.15.59:0/1266202126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef28009a20 con 0x7fef30059070 2023-09-30T22:26:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef3616b700 1 --2- 172.21.15.59:0/1266202126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef30059070 0x7fef30116c10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fef2c009e00 tx=0x7fef2c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.197+0000 7fef267fc700 1 -- 172.21.15.59:0/1266202126 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00f7e0 con 0x7fef30059070 2023-09-30T22:26:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.198+0000 7fef267fc700 1 -- 172.21.15.59:0/1266202126 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c00f940 con 0x7fef30059070 2023-09-30T22:26:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.198+0000 7fef267fc700 1 -- 172.21.15.59:0/1266202126 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c01b660 con 0x7fef30059070 2023-09-30T22:26:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.198+0000 7fef383cf700 1 -- 172.21.15.59:0/1266202126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c0092a0 con 0x7fef30059070 2023-09-30T22:26:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.198+0000 7fef383cf700 1 -- 172.21.15.59:0/1266202126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef30117490 con 0x7fef30059070 2023-09-30T22:26:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.198+0000 7fef267fc700 1 -- 172.21.15.59:0/1266202126 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fef2c01b9d0 con 0x7fef30059070 2023-09-30T22:26:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.199+0000 7fef267fc700 1 -- 172.21.15.59:0/1266202126 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fef2c03c910 con 0x7fef30059070 2023-09-30T22:26:58.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.199+0000 7fef383cf700 1 -- 172.21.15.59:0/1266202126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef301233e0 con 0x7fef30059070 2023-09-30T22:26:58.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.203+0000 7fef267fc700 1 -- 172.21.15.59:0/1266202126 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fef2c029080 con 0x7fef30059070 2023-09-30T22:26:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.420+0000 7fef383cf700 1 -- 172.21.15.59:0/1266202126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef30115fa0 con 0x7fef30059070 2023-09-30T22:26:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.421+0000 7fef267fc700 1 -- 172.21.15.59:0/1266202126 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7fef2c01f020 con 0x7fef30059070 2023-09-30T22:26:58.421 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:58.421 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:26:34.412591+0000","modified":"2023-09-30T22:26:37.427658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/2103029646","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":2103029646}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:26:58.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.422+0000 7fef383cf700 1 -- 172.21.15.59:0/1266202126 >> v1:172.21.15.59:6816/118188 conn(0x7fef1402bb60 legacy=0x7fef1402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.422+0000 7fef383cf700 1 -- 172.21.15.59:0/1266202126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef30059070 msgr2=0x7fef30116c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.422+0000 7fef383cf700 1 --2- 172.21.15.59:0/1266202126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef30059070 0x7fef30116c10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fef2c009e00 tx=0x7fef2c017000).stop 2023-09-30T22:26:58.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.422+0000 7fef383cf700 1 -- 172.21.15.59:0/1266202126 shutdown_connections 2023-09-30T22:26:58.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.422+0000 7fef383cf700 1 --2- 172.21.15.59:0/1266202126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef30125bb0 0x7fef30091f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.422+0000 7fef383cf700 1 --2- 172.21.15.59:0/1266202126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef30059070 0x7fef30116c10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.422+0000 7fef383cf700 1 --2- 172.21.15.59:0/1266202126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef301251c0 0x7fef30091a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.422+0000 7fef383cf700 1 -- 172.21.15.59:0/1266202126 >> 172.21.15.59:0/1266202126 conn(0x7fef30097470 msgr2=0x7fef30128be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:58.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.423+0000 7fef383cf700 1 -- 172.21.15.59:0/1266202126 shutdown_connections 2023-09-30T22:26:58.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.423+0000 7fef383cf700 1 -- 172.21.15.59:0/1266202126 wait complete. 2023-09-30T22:26:58.424 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 6 2023-09-30T22:26:58.436 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:26:58.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.567+0000 7fe79213d700 1 Processor -- start 2023-09-30T22:26:58.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.567+0000 7fe79213d700 1 -- start start 2023-09-30T22:26:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.568+0000 7fe79213d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe78c059070 0x7fe78c127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.568+0000 7fe79213d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe78c127390 0x7fe78c127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.568+0000 7fe79213d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78c091b60 con 0x7fe78c095370 2023-09-30T22:26:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.568+0000 7fe79213d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c096940 con 0x7fe78c127390 2023-09-30T22:26:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.568+0000 7fe79213d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c059c00 con 0x7fe78c059070 2023-09-30T22:26:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.568+0000 7fe78b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe78c059070 0x7fe78c127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.568+0000 7fe78affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe78c127390 0x7fe78c127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.568+0000 7fe78bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe78c095370 0x7fe78c095820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49544/0 (socket says 172.21.15.59:49544) 2023-09-30T22:26:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.568+0000 7fe78bfff700 1 -- 172.21.15.59:0/937448583 learned_addr learned my addr 172.21.15.59:0/937448583 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:26:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.568+0000 7fe78affd700 1 -- 172.21.15.59:0/937448583 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe78c059070 msgr2=0x7fe78c127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.568+0000 7fe78affd700 1 --2- 172.21.15.59:0/937448583 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe78c059070 0x7fe78c127890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.568+0000 7fe78affd700 1 -- 172.21.15.59:0/937448583 >> v1:172.21.15.59:6789/0 conn(0x7fe78c095370 legacy=0x7fe78c095820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.568+0000 7fe78affd700 1 -- 172.21.15.59:0/937448583 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c0929d0 con 0x7fe78c127390 2023-09-30T22:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.568+0000 7fe78a7fc700 1 -- 172.21.15.59:0/937448583 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125559631 0 0) 0x7fe78c091b60 con 0x7fe78c095370 2023-09-30T22:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.569+0000 7fe78affd700 1 --2- 172.21.15.59:0/937448583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c127390 0x7fe78c127d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe780009760 tx=0x7fe780009060).ready entity=mon.0 client_cookie=1bf9e3d1f5d0af0d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.569+0000 7fe78a7fc700 1 -- 172.21.15.59:0/937448583 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800090d0 con 0x7fe78c127390 2023-09-30T22:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.569+0000 7fe78a7fc700 1 -- 172.21.15.59:0/937448583 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78000f510 con 0x7fe78c127390 2023-09-30T22:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.569+0000 7fe78a7fc700 1 -- 172.21.15.59:0/937448583 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78000f890 con 0x7fe78c127390 2023-09-30T22:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.569+0000 7fe79213d700 1 -- 172.21.15.59:0/937448583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c127390 msgr2=0x7fe78c127d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.569+0000 7fe79213d700 1 --2- 172.21.15.59:0/937448583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c127390 0x7fe78c127d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe780009760 tx=0x7fe780009060).stop 2023-09-30T22:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.569+0000 7fe79213d700 1 -- 172.21.15.59:0/937448583 shutdown_connections 2023-09-30T22:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.569+0000 7fe79213d700 1 --2- 172.21.15.59:0/937448583 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe78c059070 0x7fe78c127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.569+0000 7fe79213d700 1 --2- 172.21.15.59:0/937448583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c127390 0x7fe78c127d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.569+0000 7fe79213d700 1 -- 172.21.15.59:0/937448583 >> 172.21.15.59:0/937448583 conn(0x7fe78c097470 msgr2=0x7fe78c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:58.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.569+0000 7fe79213d700 1 -- 172.21.15.59:0/937448583 shutdown_connections 2023-09-30T22:26:58.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.569+0000 7fe79213d700 1 -- 172.21.15.59:0/937448583 wait complete. 2023-09-30T22:26:58.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.570+0000 7fe79213d700 1 Processor -- start 2023-09-30T22:26:58.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.570+0000 7fe79213d700 1 -- start start 2023-09-30T22:26:58.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe79213d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe78c059070 0x7fe78c125920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe79213d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c095370 0x7fe78c1149a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe79213d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe78c127390 0x7fe78c114e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe79213d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c116cb0 con 0x7fe78c095370 2023-09-30T22:26:58.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe79213d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c1182f0 con 0x7fe78c127390 2023-09-30T22:26:58.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe79213d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c126960 con 0x7fe78c059070 2023-09-30T22:26:58.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe78affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c095370 0x7fe78c1149a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe78b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe78c059070 0x7fe78c125920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe78affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c095370 0x7fe78c1149a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40764/0 (socket says 172.21.15.59:40764) 2023-09-30T22:26:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe78bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe78c127390 0x7fe78c114e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe78affd700 1 -- 172.21.15.59:0/2287844080 learned_addr learned my addr 172.21.15.59:0/2287844080 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe78affd700 1 -- 172.21.15.59:0/2287844080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe78c059070 msgr2=0x7fe78c125920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe78affd700 1 --2- 172.21.15.59:0/2287844080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe78c059070 0x7fe78c125920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe78affd700 1 -- 172.21.15.59:0/2287844080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe78c127390 msgr2=0x7fe78c114e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe78affd700 1 --2- 172.21.15.59:0/2287844080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe78c127390 0x7fe78c114e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe78affd700 1 -- 172.21.15.59:0/2287844080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7800092a0 con 0x7fe78c095370 2023-09-30T22:26:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.571+0000 7fe78b7fe700 1 --2- 172.21.15.59:0/2287844080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe78c059070 0x7fe78c125920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.572+0000 7fe78affd700 1 --2- 172.21.15.59:0/2287844080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c095370 0x7fe78c1149a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe780009e00 tx=0x7fe780017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:58.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.572+0000 7fe7737fe700 1 -- 172.21.15.59:0/2287844080 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78000f890 con 0x7fe78c095370 2023-09-30T22:26:58.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.572+0000 7fe7737fe700 1 -- 172.21.15.59:0/2287844080 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78000fc50 con 0x7fe78c095370 2023-09-30T22:26:58.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.572+0000 7fe79213d700 1 -- 172.21.15.59:0/2287844080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78c117d50 con 0x7fe78c095370 2023-09-30T22:26:58.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.572+0000 7fe7737fe700 1 -- 172.21.15.59:0/2287844080 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78001b410 con 0x7fe78c095370 2023-09-30T22:26:58.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.572+0000 7fe79213d700 1 -- 172.21.15.59:0/2287844080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78c1189d0 con 0x7fe78c095370 2023-09-30T22:26:58.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.573+0000 7fe7737fe700 1 -- 172.21.15.59:0/2287844080 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe78001b780 con 0x7fe78c095370 2023-09-30T22:26:58.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.573+0000 7fe7737fe700 1 -- 172.21.15.59:0/2287844080 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe78003c8a0 con 0x7fe78c095370 2023-09-30T22:26:58.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.573+0000 7fe79213d700 1 -- 172.21.15.59:0/2287844080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78c096f20 con 0x7fe78c095370 2023-09-30T22:26:58.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.578+0000 7fe7737fe700 1 -- 172.21.15.59:0/2287844080 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe780028070 con 0x7fe78c095370 2023-09-30T22:26:58.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.753+0000 7fe79213d700 1 -- 172.21.15.59:0/2287844080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe78c118110 con 0x7fe78c095370 2023-09-30T22:26:58.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.754+0000 7fe7737fe700 1 -- 172.21.15.59:0/2287844080 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11342 (secure 0 0 0) 0x7fe780028020 con 0x7fe78c095370 2023-09-30T22:26:58.754 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:26:58.754 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":19,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:26:53.893967+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:26:58.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.756+0000 7fe79213d700 1 -- 172.21.15.59:0/2287844080 >> v1:172.21.15.59:6816/118188 conn(0x7fe77802bb90 legacy=0x7fe77802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.756+0000 7fe79213d700 1 -- 172.21.15.59:0/2287844080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c095370 msgr2=0x7fe78c1149a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.756+0000 7fe79213d700 1 --2- 172.21.15.59:0/2287844080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c095370 0x7fe78c1149a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe780009e00 tx=0x7fe780017000).stop 2023-09-30T22:26:58.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.756+0000 7fe79213d700 1 -- 172.21.15.59:0/2287844080 shutdown_connections 2023-09-30T22:26:58.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.756+0000 7fe79213d700 1 --2- 172.21.15.59:0/2287844080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe78c059070 0x7fe78c125920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.756+0000 7fe79213d700 1 --2- 172.21.15.59:0/2287844080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe78c127390 0x7fe78c114e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.756+0000 7fe79213d700 1 --2- 172.21.15.59:0/2287844080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe78c095370 0x7fe78c1149a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.756+0000 7fe79213d700 1 -- 172.21.15.59:0/2287844080 >> 172.21.15.59:0/2287844080 conn(0x7fe78c097470 msgr2=0x7fe78c128710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:58.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.756+0000 7fe79213d700 1 -- 172.21.15.59:0/2287844080 shutdown_connections 2023-09-30T22:26:58.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.756+0000 7fe79213d700 1 -- 172.21.15.59:0/2287844080 wait complete. 2023-09-30T22:26:58.770 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:26:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.905+0000 7f149615f700 1 Processor -- start 2023-09-30T22:26:58.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.905+0000 7f149615f700 1 -- start start 2023-09-30T22:26:58.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.905+0000 7f149615f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1490093840 0x7f1490098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.905+0000 7f149615f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1490098c80 0x7f1490099060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.905+0000 7f149615f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f149012c150 0x7f149012e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.905+0000 7f149615f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1490093c20 con 0x7f1490093840 2023-09-30T22:26:58.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.905+0000 7f149615f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1490092b90 con 0x7f1490098c80 2023-09-30T22:26:58.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.905+0000 7f149615f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1490092d80 con 0x7f149012c150 2023-09-30T22:26:58.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.905+0000 7f1486ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1490098c80 0x7f1490099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.905+0000 7f148f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1490093840 0x7f1490098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.905+0000 7f148ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f149012c150 0x7f149012e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.905+0000 7f1486ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1490098c80 0x7f1490099060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55252/0 (socket says 172.21.15.59:55252) 2023-09-30T22:26:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.905+0000 7f148f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1490093840 0x7f1490098790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40778/0 (socket says 172.21.15.59:40778) 2023-09-30T22:26:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.905+0000 7f1486ffd700 1 -- 172.21.15.59:0/1250727753 learned_addr learned my addr 172.21.15.59:0/1250727753 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.906+0000 7f148ffff700 1 -- 172.21.15.59:0/1250727753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1490098c80 msgr2=0x7f1490099060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.906+0000 7f148ffff700 1 --2- 172.21.15.59:0/1250727753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1490098c80 0x7f1490099060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.906+0000 7f148ffff700 1 -- 172.21.15.59:0/1250727753 >> v2:172.21.15.59:3300/0 conn(0x7f1490093840 msgr2=0x7f1490098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.906+0000 7f148ffff700 1 --2- 172.21.15.59:0/1250727753 >> v2:172.21.15.59:3300/0 conn(0x7f1490093840 0x7f1490098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.906+0000 7f148ffff700 1 -- 172.21.15.59:0/1250727753 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1490099b70 con 0x7f149012c150 2023-09-30T22:26:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.906+0000 7f1486ffd700 1 --2- 172.21.15.59:0/1250727753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1490098c80 0x7f1490099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.906+0000 7f148f7fe700 1 --2- 172.21.15.59:0/1250727753 >> v2:172.21.15.59:3300/0 conn(0x7f1490093840 0x7f1490098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.906+0000 7f148ffff700 1 --2- 172.21.15.59:0/1250727753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f149012c150 0x7f149012e540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1488009e60 tx=0x7f1488009780).ready entity=mon.2 client_cookie=bd369b1a232a3470 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.906+0000 7f148effd700 1 -- 172.21.15.59:0/1250727753 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800e070 con 0x7f149012c150 2023-09-30T22:26:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.906+0000 7f148effd700 1 -- 172.21.15.59:0/1250727753 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148800bab0 con 0x7f149012c150 2023-09-30T22:26:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.906+0000 7f148effd700 1 -- 172.21.15.59:0/1250727753 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800be30 con 0x7f149012c150 2023-09-30T22:26:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.906+0000 7f149615f700 1 -- 172.21.15.59:0/1250727753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f149012c150 msgr2=0x7f149012e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.906+0000 7f149615f700 1 --2- 172.21.15.59:0/1250727753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f149012c150 0x7f149012e540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1488009e60 tx=0x7f1488009780).stop 2023-09-30T22:26:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.907+0000 7f149615f700 1 -- 172.21.15.59:0/1250727753 shutdown_connections 2023-09-30T22:26:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.907+0000 7f149615f700 1 --2- 172.21.15.59:0/1250727753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f149012c150 0x7f149012e540 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.907+0000 7f149615f700 1 --2- 172.21.15.59:0/1250727753 >> v2:172.21.15.59:3300/0 conn(0x7f1490093840 0x7f1490098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.907+0000 7f149615f700 1 --2- 172.21.15.59:0/1250727753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1490098c80 0x7f1490099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.907+0000 7f149615f700 1 -- 172.21.15.59:0/1250727753 >> 172.21.15.59:0/1250727753 conn(0x7f1490097480 msgr2=0x7f1490097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:58.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.907+0000 7f149615f700 1 -- 172.21.15.59:0/1250727753 shutdown_connections 2023-09-30T22:26:58.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.907+0000 7f149615f700 1 -- 172.21.15.59:0/1250727753 wait complete. 2023-09-30T22:26:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.907+0000 7f149615f700 1 Processor -- start 2023-09-30T22:26:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.908+0000 7f149615f700 1 -- start start 2023-09-30T22:26:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.908+0000 7f149615f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1490093840 0x7f149011bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.908+0000 7f149615f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1490098c80 0x7f1490117ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.908+0000 7f149615f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f149012c150 0x7f1490118090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:26:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.908+0000 7f149615f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149012bd30 con 0x7f1490098c80 2023-09-30T22:26:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.908+0000 7f149615f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149011a260 con 0x7f1490093840 2023-09-30T22:26:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.908+0000 7f149615f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f149006a520 con 0x7f149012c150 2023-09-30T22:26:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f148f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1490093840 0x7f149011bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f1486ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1490098c80 0x7f1490117ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f148ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f149012c150 0x7f1490118090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:26:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f1486ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1490098c80 0x7f1490117ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40784/0 (socket says 172.21.15.59:40784) 2023-09-30T22:26:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f148f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1490093840 0x7f149011bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55254/0 (socket says 172.21.15.59:55254) 2023-09-30T22:26:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f1486ffd700 1 -- 172.21.15.59:0/537306862 learned_addr learned my addr 172.21.15.59:0/537306862 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:26:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f148ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f149012c150 0x7f1490118090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37462/0 (socket says 172.21.15.59:37462) 2023-09-30T22:26:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f148ffff700 1 -- 172.21.15.59:0/537306862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1490093840 msgr2=0x7f149011bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f148ffff700 1 --2- 172.21.15.59:0/537306862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1490093840 0x7f149011bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f148ffff700 1 -- 172.21.15.59:0/537306862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1490098c80 msgr2=0x7f1490117ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f148ffff700 1 --2- 172.21.15.59:0/537306862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1490098c80 0x7f1490117ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f148ffff700 1 -- 172.21.15.59:0/537306862 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14800092a0 con 0x7f149012c150 2023-09-30T22:26:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f1486ffd700 1 --2- 172.21.15.59:0/537306862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1490098c80 0x7f1490117ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f148f7fe700 1 --2- 172.21.15.59:0/537306862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1490093840 0x7f149011bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f148ffff700 1 --2- 172.21.15.59:0/537306862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f149012c150 0x7f1490118090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1488014000 tx=0x7f1488009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f1487fff700 1 -- 172.21.15.59:0/537306862 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148801ce40 con 0x7f149012c150 2023-09-30T22:26:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f1487fff700 1 -- 172.21.15.59:0/537306862 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1488012620 con 0x7f149012c150 2023-09-30T22:26:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f149615f700 1 -- 172.21.15.59:0/537306862 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1478009370 con 0x7f149012c150 2023-09-30T22:26:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f1487fff700 1 -- 172.21.15.59:0/537306862 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14880129e0 con 0x7f149012c150 2023-09-30T22:26:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.909+0000 7f149615f700 1 -- 172.21.15.59:0/537306862 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1488009a20 con 0x7f149012c150 2023-09-30T22:26:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.910+0000 7f1487fff700 1 -- 172.21.15.59:0/537306862 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1488003040 con 0x7f149012c150 2023-09-30T22:26:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.910+0000 7f1487fff700 1 -- 172.21.15.59:0/537306862 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f148803c070 con 0x7f149012c150 2023-09-30T22:26:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.910+0000 7f149615f700 1 -- 172.21.15.59:0/537306862 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149005a260 con 0x7f149012c150 2023-09-30T22:26:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:58.915+0000 7f1487fff700 1 -- 172.21.15.59:0/537306862 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1488022080 con 0x7f149012c150 2023-09-30T22:26:59.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:59.139+0000 7f149615f700 1 -- 172.21.15.59:0/537306862 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f14901189a0 con 0x7f149012c150 2023-09-30T22:26:59.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:59.924+0000 7f1487fff700 1 -- 172.21.15.59:0/537306862 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f14880263b0 con 0x7f149012c150 2023-09-30T22:26:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:59.927+0000 7f149615f700 1 -- 172.21.15.59:0/537306862 >> v1:172.21.15.59:6816/118188 conn(0x7f147002bb90 legacy=0x7f147002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:59.927+0000 7f149615f700 1 -- 172.21.15.59:0/537306862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f149012c150 msgr2=0x7f1490118090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:59.927+0000 7f149615f700 1 --2- 172.21.15.59:0/537306862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f149012c150 0x7f1490118090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1488014000 tx=0x7f1488009780).stop 2023-09-30T22:26:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:59.927+0000 7f149615f700 1 -- 172.21.15.59:0/537306862 shutdown_connections 2023-09-30T22:26:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:59.927+0000 7f149615f700 1 --2- 172.21.15.59:0/537306862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f149012c150 0x7f1490118090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:59.927+0000 7f149615f700 1 --2- 172.21.15.59:0/537306862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1490093840 0x7f149011bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:59.927+0000 7f149615f700 1 --2- 172.21.15.59:0/537306862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1490098c80 0x7f1490117ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:26:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:59.927+0000 7f149615f700 1 -- 172.21.15.59:0/537306862 >> 172.21.15.59:0/537306862 conn(0x7f1490097480 msgr2=0x7f1490068a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:59.927+0000 7f149615f700 1 -- 172.21.15.59:0/537306862 shutdown_connections 2023-09-30T22:26:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:26:59.927+0000 7f149615f700 1 -- 172.21.15.59:0/537306862 wait complete. 2023-09-30T22:26:59.943 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2023-09-30T22:27:00.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.081+0000 7ffb554c0700 1 Processor -- start 2023-09-30T22:27:00.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.081+0000 7ffb554c0700 1 -- start start 2023-09-30T22:27:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.082+0000 7ffb554c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb501280d0 0x7ffb50127410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.082+0000 7ffb554c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb5012fd50 0x7ffb50132140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.082+0000 7ffb554c0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb50092ab0 con 0x7ffb50059070 2023-09-30T22:27:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.082+0000 7ffb554c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb50091bd0 con 0x7ffb5012fd50 2023-09-30T22:27:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.082+0000 7ffb554c0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb50059ee0 con 0x7ffb501280d0 2023-09-30T22:27:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.082+0000 7ffb4effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffb50059070 0x7ffb501279c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49550/0 (socket says 172.21.15.59:49550) 2023-09-30T22:27:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.082+0000 7ffb4effd700 1 -- 172.21.15.59:0/794492571 learned_addr learned my addr 172.21.15.59:0/794492571 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:27:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.082+0000 7ffb4f7fe700 1 --2- 172.21.15.59:0/794492571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb5012fd50 0x7ffb50132140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.082+0000 7ffb4e7fc700 1 --2- 172.21.15.59:0/794492571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb501280d0 0x7ffb50127410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.082+0000 7ffb4dffb700 1 -- 172.21.15.59:0/794492571 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796784903 0 0) 0x7ffb50092ab0 con 0x7ffb50059070 2023-09-30T22:27:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.083+0000 7ffb4e7fc700 1 -- 172.21.15.59:0/794492571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb5012fd50 msgr2=0x7ffb50132140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:00.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.083+0000 7ffb4e7fc700 1 --2- 172.21.15.59:0/794492571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb5012fd50 0x7ffb50132140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:00.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.083+0000 7ffb4e7fc700 1 -- 172.21.15.59:0/794492571 >> v1:172.21.15.59:6789/0 conn(0x7ffb50059070 legacy=0x7ffb501279c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.083+0000 7ffb4e7fc700 1 -- 172.21.15.59:0/794492571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb50096d70 con 0x7ffb501280d0 2023-09-30T22:27:00.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.083+0000 7ffb4f7fe700 1 --2- 172.21.15.59:0/794492571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb5012fd50 0x7ffb50132140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:00.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.083+0000 7ffb4e7fc700 1 --2- 172.21.15.59:0/794492571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb501280d0 0x7ffb50127410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7ffb38009790 tx=0x7ffb38009060).ready entity=mon.2 client_cookie=7453a24c6c3bcf2e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.083+0000 7ffb4dffb700 1 -- 172.21.15.59:0/794492571 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38009120 con 0x7ffb501280d0 2023-09-30T22:27:00.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.083+0000 7ffb4dffb700 1 -- 172.21.15.59:0/794492571 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3800f510 con 0x7ffb501280d0 2023-09-30T22:27:00.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.083+0000 7ffb4dffb700 1 -- 172.21.15.59:0/794492571 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3800f890 con 0x7ffb501280d0 2023-09-30T22:27:00.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.083+0000 7ffb554c0700 1 -- 172.21.15.59:0/794492571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb501280d0 msgr2=0x7ffb50127410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.083+0000 7ffb554c0700 1 --2- 172.21.15.59:0/794492571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb501280d0 0x7ffb50127410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7ffb38009790 tx=0x7ffb38009060).stop 2023-09-30T22:27:00.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.083+0000 7ffb554c0700 1 -- 172.21.15.59:0/794492571 shutdown_connections 2023-09-30T22:27:00.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.083+0000 7ffb554c0700 1 --2- 172.21.15.59:0/794492571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb5012fd50 0x7ffb50132140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:00.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.083+0000 7ffb554c0700 1 --2- 172.21.15.59:0/794492571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb501280d0 0x7ffb50127410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:00.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.083+0000 7ffb554c0700 1 -- 172.21.15.59:0/794492571 >> 172.21.15.59:0/794492571 conn(0x7ffb500976b0 msgr2=0x7ffb50097ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.084+0000 7ffb554c0700 1 -- 172.21.15.59:0/794492571 shutdown_connections 2023-09-30T22:27:00.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.084+0000 7ffb554c0700 1 -- 172.21.15.59:0/794492571 wait complete. 2023-09-30T22:27:00.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.085+0000 7ffb554c0700 1 Processor -- start 2023-09-30T22:27:00.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.085+0000 7ffb554c0700 1 -- start start 2023-09-30T22:27:00.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.085+0000 7ffb554c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb50059070 0x7ffb50111ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:00.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.085+0000 7ffb554c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb501280d0 0x7ffb5012cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:00.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.085+0000 7ffb554c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb5012fd50 0x7ffb5012d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.085+0000 7ffb554c0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb50126040 con 0x7ffb501280d0 2023-09-30T22:27:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.085+0000 7ffb554c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb50132150 con 0x7ffb50059070 2023-09-30T22:27:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.085+0000 7ffb554c0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb501119a0 con 0x7ffb5012fd50 2023-09-30T22:27:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.085+0000 7ffb4effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb50059070 0x7ffb50111ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.085+0000 7ffb4f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb5012fd50 0x7ffb5012d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.085+0000 7ffb4effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb50059070 0x7ffb50111ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55272/0 (socket says 172.21.15.59:55272) 2023-09-30T22:27:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.085+0000 7ffb4e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb501280d0 0x7ffb5012cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.085+0000 7ffb4effd700 1 -- 172.21.15.59:0/1772102114 learned_addr learned my addr 172.21.15.59:0/1772102114 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:27:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.086+0000 7ffb4f7fe700 1 -- 172.21.15.59:0/1772102114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb50059070 msgr2=0x7ffb50111ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.086+0000 7ffb4f7fe700 1 --2- 172.21.15.59:0/1772102114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb50059070 0x7ffb50111ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.086+0000 7ffb4f7fe700 1 -- 172.21.15.59:0/1772102114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb501280d0 msgr2=0x7ffb5012cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.086+0000 7ffb4f7fe700 1 --2- 172.21.15.59:0/1772102114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb501280d0 0x7ffb5012cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.086+0000 7ffb4f7fe700 1 -- 172.21.15.59:0/1772102114 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb48009a20 con 0x7ffb5012fd50 2023-09-30T22:27:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.086+0000 7ffb4e7fc700 1 --2- 172.21.15.59:0/1772102114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb501280d0 0x7ffb5012cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.086+0000 7ffb4f7fe700 1 --2- 172.21.15.59:0/1772102114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb5012fd50 0x7ffb5012d0d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ffb50065e80 tx=0x7ffb4800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.086+0000 7ffb46ffd700 1 -- 172.21.15.59:0/1772102114 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4800caa0 con 0x7ffb5012fd50 2023-09-30T22:27:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.086+0000 7ffb46ffd700 1 -- 172.21.15.59:0/1772102114 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4800f040 con 0x7ffb5012fd50 2023-09-30T22:27:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.086+0000 7ffb554c0700 1 -- 172.21.15.59:0/1772102114 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb380092a0 con 0x7ffb5012fd50 2023-09-30T22:27:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.086+0000 7ffb46ffd700 1 -- 172.21.15.59:0/1772102114 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4800ce30 con 0x7ffb5012fd50 2023-09-30T22:27:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.086+0000 7ffb554c0700 1 -- 172.21.15.59:0/1772102114 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5012e970 con 0x7ffb5012fd50 2023-09-30T22:27:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.087+0000 7ffb46ffd700 1 -- 172.21.15.59:0/1772102114 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ffb48013610 con 0x7ffb5012fd50 2023-09-30T22:27:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.087+0000 7ffb46ffd700 1 -- 172.21.15.59:0/1772102114 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ffb4803b800 con 0x7ffb5012fd50 2023-09-30T22:27:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.087+0000 7ffb554c0700 1 -- 172.21.15.59:0/1772102114 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5005a260 con 0x7ffb5012fd50 2023-09-30T22:27:00.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.092+0000 7ffb46ffd700 1 -- 172.21.15.59:0/1772102114 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ffb4801c410 con 0x7ffb5012fd50 2023-09-30T22:27:00.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.311+0000 7ffb554c0700 1 -- 172.21.15.59:0/1772102114 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7ffb5012d9e0 con 0x7ffb5012fd50 2023-09-30T22:27:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.925+0000 7ffb46ffd700 1 -- 172.21.15.59:0/1772102114 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7ffb4801a310 con 0x7ffb5012fd50 2023-09-30T22:27:00.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.928+0000 7ffb554c0700 1 -- 172.21.15.59:0/1772102114 >> v1:172.21.15.59:6816/118188 conn(0x7ffb3002bb60 legacy=0x7ffb3002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.928+0000 7ffb554c0700 1 -- 172.21.15.59:0/1772102114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb5012fd50 msgr2=0x7ffb5012d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.928+0000 7ffb554c0700 1 --2- 172.21.15.59:0/1772102114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb5012fd50 0x7ffb5012d0d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ffb50065e80 tx=0x7ffb4800b040).stop 2023-09-30T22:27:00.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.928+0000 7ffb554c0700 1 -- 172.21.15.59:0/1772102114 shutdown_connections 2023-09-30T22:27:00.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.928+0000 7ffb554c0700 1 --2- 172.21.15.59:0/1772102114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb5012fd50 0x7ffb5012d0d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:00.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.928+0000 7ffb554c0700 1 --2- 172.21.15.59:0/1772102114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb50059070 0x7ffb50111ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:00.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.928+0000 7ffb554c0700 1 --2- 172.21.15.59:0/1772102114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb501280d0 0x7ffb5012cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:00.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.928+0000 7ffb554c0700 1 -- 172.21.15.59:0/1772102114 >> 172.21.15.59:0/1772102114 conn(0x7ffb500976b0 msgr2=0x7ffb50099540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.929+0000 7ffb554c0700 1 -- 172.21.15.59:0/1772102114 shutdown_connections 2023-09-30T22:27:00.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:00.929+0000 7ffb554c0700 1 -- 172.21.15.59:0/1772102114 wait complete. 2023-09-30T22:27:00.946 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:27:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.077+0000 7f760c052700 1 Processor -- start 2023-09-30T22:27:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.077+0000 7f760c052700 1 -- start start 2023-09-30T22:27:01.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.078+0000 7f760c052700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7604123a90 0x7f7604123e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.078+0000 7f760c052700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7604067ce0 0x7f7604092340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.078+0000 7f760c052700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7604126f70 0x7f76041273f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.078+0000 7f760c052700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76040680c0 con 0x7f7604067ce0 2023-09-30T22:27:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.078+0000 7f760c052700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7604068880 con 0x7f7604126f70 2023-09-30T22:27:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.078+0000 7f760c052700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7604068c90 con 0x7f7604123a90 2023-09-30T22:27:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.078+0000 7f76095ed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7604067ce0 0x7f7604092340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.078+0000 7f7609dee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7604123a90 0x7f7604123e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.078+0000 7f760a5ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7604126f70 0x7f76041273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.078+0000 7f76095ed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7604067ce0 0x7f7604092340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40802/0 (socket says 172.21.15.59:40802) 2023-09-30T22:27:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.078+0000 7f7609dee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7604123a90 0x7f7604123e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37488/0 (socket says 172.21.15.59:37488) 2023-09-30T22:27:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.078+0000 7f76095ed700 1 -- 172.21.15.59:0/2768914213 learned_addr learned my addr 172.21.15.59:0/2768914213 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:27:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.078+0000 7f760a5ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7604126f70 0x7f76041273f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55280/0 (socket says 172.21.15.59:55280) 2023-09-30T22:27:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.079+0000 7f76095ed700 1 -- 172.21.15.59:0/2768914213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7604123a90 msgr2=0x7f7604123e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.079+0000 7f76095ed700 1 --2- 172.21.15.59:0/2768914213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7604123a90 0x7f7604123e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.079+0000 7f76095ed700 1 -- 172.21.15.59:0/2768914213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7604126f70 msgr2=0x7f76041273f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.079+0000 7f76095ed700 1 --2- 172.21.15.59:0/2768914213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7604126f70 0x7f76041273f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.079+0000 7f76095ed700 1 -- 172.21.15.59:0/2768914213 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7604124430 con 0x7f7604067ce0 2023-09-30T22:27:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.079+0000 7f760a5ef700 1 --2- 172.21.15.59:0/2768914213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7604126f70 0x7f76041273f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.079+0000 7f7609dee700 1 --2- 172.21.15.59:0/2768914213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7604123a90 0x7f7604123e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.079+0000 7f76095ed700 1 --2- 172.21.15.59:0/2768914213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7604067ce0 0x7f7604092340 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f75f4006fd0 tx=0x7f75f40090f0).ready entity=mon.0 client_cookie=ce5f0dfb4ba52160 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.079+0000 7f7608dec700 1 -- 172.21.15.59:0/2768914213 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f400f510 con 0x7f7604067ce0 2023-09-30T22:27:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.079+0000 7f7608dec700 1 -- 172.21.15.59:0/2768914213 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f400f670 con 0x7f7604067ce0 2023-09-30T22:27:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.079+0000 7f7608dec700 1 -- 172.21.15.59:0/2768914213 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f400f9f0 con 0x7f7604067ce0 2023-09-30T22:27:01.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.080+0000 7f760c052700 1 -- 172.21.15.59:0/2768914213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7604067ce0 msgr2=0x7f7604092340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.080+0000 7f760c052700 1 --2- 172.21.15.59:0/2768914213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7604067ce0 0x7f7604092340 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f75f4006fd0 tx=0x7f75f40090f0).stop 2023-09-30T22:27:01.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.080+0000 7f760c052700 1 -- 172.21.15.59:0/2768914213 shutdown_connections 2023-09-30T22:27:01.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.080+0000 7f760c052700 1 --2- 172.21.15.59:0/2768914213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7604126f70 0x7f76041273f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.080+0000 7f760c052700 1 --2- 172.21.15.59:0/2768914213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7604123a90 0x7f7604123e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.080+0000 7f760c052700 1 --2- 172.21.15.59:0/2768914213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7604067ce0 0x7f7604092340 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.080+0000 7f760c052700 1 -- 172.21.15.59:0/2768914213 >> 172.21.15.59:0/2768914213 conn(0x7f760409a220 msgr2=0x7f760409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:01.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.080+0000 7f760c052700 1 -- 172.21.15.59:0/2768914213 shutdown_connections 2023-09-30T22:27:01.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.080+0000 7f760c052700 1 -- 172.21.15.59:0/2768914213 wait complete. 2023-09-30T22:27:01.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.081+0000 7f760c052700 1 Processor -- start 2023-09-30T22:27:01.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.081+0000 7f760c052700 1 -- start start 2023-09-30T22:27:01.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.081+0000 7f760c052700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7604067ce0 0x7f76041163b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.081+0000 7f760c052700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7604123a90 0x7f76041168a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.081+0000 7f760c052700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7604126f70 0x7f7604116d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.081+0000 7f760c052700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7604119320 con 0x7f7604067ce0 2023-09-30T22:27:01.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.081+0000 7f760c052700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7604099cf0 con 0x7f7604126f70 2023-09-30T22:27:01.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.081+0000 7f760c052700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76040697c0 con 0x7f7604123a90 2023-09-30T22:27:01.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.081+0000 7f760a5ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7604126f70 0x7f7604116d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.081+0000 7f7609dee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7604067ce0 0x7f76041163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.081+0000 7f7609dee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7604067ce0 0x7f76041163b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40810/0 (socket says 172.21.15.59:40810) 2023-09-30T22:27:01.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.081+0000 7f7609dee700 1 -- 172.21.15.59:0/3768908126 learned_addr learned my addr 172.21.15.59:0/3768908126 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:27:01.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.081+0000 7f760a5ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7604126f70 0x7f7604116d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55284/0 (socket says 172.21.15.59:55284) 2023-09-30T22:27:01.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.081+0000 7f76095ed700 1 --2- 172.21.15.59:0/3768908126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7604123a90 0x7f76041168a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.082+0000 7f7609dee700 1 -- 172.21.15.59:0/3768908126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7604123a90 msgr2=0x7f76041168a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.082+0000 7f7609dee700 1 --2- 172.21.15.59:0/3768908126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7604123a90 0x7f76041168a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.082+0000 7f7609dee700 1 -- 172.21.15.59:0/3768908126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7604126f70 msgr2=0x7f7604116d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.082+0000 7f7609dee700 1 --2- 172.21.15.59:0/3768908126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7604126f70 0x7f7604116d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.082+0000 7f7609dee700 1 -- 172.21.15.59:0/3768908126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76000092a0 con 0x7f7604067ce0 2023-09-30T22:27:01.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.082+0000 7f760a5ef700 1 --2- 172.21.15.59:0/3768908126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7604126f70 0x7f7604116d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.082+0000 7f7609dee700 1 --2- 172.21.15.59:0/3768908126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7604067ce0 0x7f76041163b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f760000ea20 tx=0x7f7600009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.082+0000 7f75f9ffb700 1 -- 172.21.15.59:0/3768908126 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760000c850 con 0x7f7604067ce0 2023-09-30T22:27:01.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.082+0000 7f75f9ffb700 1 -- 172.21.15.59:0/3768908126 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760000c9b0 con 0x7f7604067ce0 2023-09-30T22:27:01.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.082+0000 7f760c052700 1 -- 172.21.15.59:0/3768908126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75fc009a20 con 0x7f7604067ce0 2023-09-30T22:27:01.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.082+0000 7f75f9ffb700 1 -- 172.21.15.59:0/3768908126 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760000cd30 con 0x7f7604067ce0 2023-09-30T22:27:01.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.082+0000 7f760c052700 1 -- 172.21.15.59:0/3768908126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f4009370 con 0x7f7604067ce0 2023-09-30T22:27:01.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.083+0000 7f75f9ffb700 1 -- 172.21.15.59:0/3768908126 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7600012600 con 0x7f7604067ce0 2023-09-30T22:27:01.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.083+0000 7f75f9ffb700 1 -- 172.21.15.59:0/3768908126 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f760003b5d0 con 0x7f7604067ce0 2023-09-30T22:27:01.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.083+0000 7f760c052700 1 -- 172.21.15.59:0/3768908126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7604117280 con 0x7f7604067ce0 2023-09-30T22:27:01.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.088+0000 7f75f9ffb700 1 -- 172.21.15.59:0/3768908126 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f760001b400 con 0x7f7604067ce0 2023-09-30T22:27:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.304+0000 7f760c052700 1 -- 172.21.15.59:0/3768908126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7604119820 con 0x7f7604067ce0 2023-09-30T22:27:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.304+0000 7f75f9ffb700 1 -- 172.21.15.59:0/3768908126 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f760002a090 con 0x7f7604067ce0 2023-09-30T22:27:01.305 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:27:01.305 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:26:34.412591+0000","modified":"2023-09-30T22:27:00.923070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/2103029646","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":2103029646}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:27:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.306+0000 7f760c052700 1 -- 172.21.15.59:0/3768908126 >> v1:172.21.15.59:6816/118188 conn(0x7f75e802bb60 legacy=0x7f75e802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.306+0000 7f760c052700 1 -- 172.21.15.59:0/3768908126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7604067ce0 msgr2=0x7f76041163b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.306+0000 7f760c052700 1 --2- 172.21.15.59:0/3768908126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7604067ce0 0x7f76041163b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f760000ea20 tx=0x7f7600009060).stop 2023-09-30T22:27:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.306+0000 7f760c052700 1 -- 172.21.15.59:0/3768908126 shutdown_connections 2023-09-30T22:27:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.306+0000 7f760c052700 1 --2- 172.21.15.59:0/3768908126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7604126f70 0x7f7604116d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.306+0000 7f760c052700 1 --2- 172.21.15.59:0/3768908126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7604067ce0 0x7f76041163b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.306+0000 7f760c052700 1 --2- 172.21.15.59:0/3768908126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7604123a90 0x7f76041168a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.306+0000 7f760c052700 1 -- 172.21.15.59:0/3768908126 >> 172.21.15.59:0/3768908126 conn(0x7f760409a220 msgr2=0x7f7604126850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.306+0000 7f760c052700 1 -- 172.21.15.59:0/3768908126 shutdown_connections 2023-09-30T22:27:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.306+0000 7f760c052700 1 -- 172.21.15.59:0/3768908126 wait complete. 2023-09-30T22:27:01.309 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-09-30T22:27:01.422 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:26:34.412591+0000', 'modified': '2023-09-30T22:27:00.923070+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4181}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4181': {'gid': 4181, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6817/2103029646', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.59:6817', 'nonce': 2103029646}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:27:01.422 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:27:01.423 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:27:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.557+0000 7fba012c8700 1 Processor -- start 2023-09-30T22:27:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.557+0000 7fba012c8700 1 -- start start 2023-09-30T22:27:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.557+0000 7fba012c8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc0650f0 0x7fb9fc0986a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.557+0000 7fba012c8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9fc097c30 0x7fb9fc098b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.557+0000 7fba012c8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc096160 con 0x7fb9fc099080 2023-09-30T22:27:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.557+0000 7fba012c8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc0654d0 con 0x7fb9fc097c30 2023-09-30T22:27:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.557+0000 7fba012c8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc099530 con 0x7fb9fc0650f0 2023-09-30T22:27:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.557+0000 7fb9fa7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9fc097c30 0x7fb9fc098b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.557+0000 7fb9faffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc0650f0 0x7fb9fc0986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.557+0000 7fb9fa7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9fc097c30 0x7fb9fc098b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40820/0 (socket says 172.21.15.59:40820) 2023-09-30T22:27:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.557+0000 7fb9faffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc0650f0 0x7fb9fc0986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37506/0 (socket says 172.21.15.59:37506) 2023-09-30T22:27:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.557+0000 7fb9fb7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb9fc099080 0x7fb9fc131470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49560/0 (socket says 172.21.15.59:49560) 2023-09-30T22:27:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.557+0000 7fb9fa7fc700 1 -- 172.21.15.59:0/4052718691 learned_addr learned my addr 172.21.15.59:0/4052718691 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:27:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.558+0000 7fb9fa7fc700 1 -- 172.21.15.59:0/4052718691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc0650f0 msgr2=0x7fb9fc0986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.558+0000 7fb9fa7fc700 1 --2- 172.21.15.59:0/4052718691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc0650f0 0x7fb9fc0986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.558+0000 7fb9fa7fc700 1 -- 172.21.15.59:0/4052718691 >> v1:172.21.15.59:6789/0 conn(0x7fb9fc099080 legacy=0x7fb9fc131470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.558+0000 7fb9fa7fc700 1 -- 172.21.15.59:0/4052718691 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc099790 con 0x7fb9fc097c30 2023-09-30T22:27:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.558+0000 7fb9f9ffb700 1 -- 172.21.15.59:0/4052718691 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191481189 0 0) 0x7fb9fc096160 con 0x7fb9fc099080 2023-09-30T22:27:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.558+0000 7fb9faffd700 1 --2- 172.21.15.59:0/4052718691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc0650f0 0x7fb9fc0986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.558+0000 7fb9fa7fc700 1 --2- 172.21.15.59:0/4052718691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc097c30 0x7fb9fc098b90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fb9f0009860 tx=0x7fb9f00090f0).ready entity=mon.0 client_cookie=e24eb1d62fc3a421 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.558+0000 7fb9f9ffb700 1 -- 172.21.15.59:0/4052718691 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f000b580 con 0x7fb9fc097c30 2023-09-30T22:27:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.558+0000 7fb9f9ffb700 1 -- 172.21.15.59:0/4052718691 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f000b6e0 con 0x7fb9fc097c30 2023-09-30T22:27:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.558+0000 7fb9f9ffb700 1 -- 172.21.15.59:0/4052718691 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f000ba60 con 0x7fb9fc097c30 2023-09-30T22:27:01.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.559+0000 7fba012c8700 1 -- 172.21.15.59:0/4052718691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc097c30 msgr2=0x7fb9fc098b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.559+0000 7fba012c8700 1 --2- 172.21.15.59:0/4052718691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc097c30 0x7fb9fc098b90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fb9f0009860 tx=0x7fb9f00090f0).stop 2023-09-30T22:27:01.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.559+0000 7fba012c8700 1 -- 172.21.15.59:0/4052718691 shutdown_connections 2023-09-30T22:27:01.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.559+0000 7fba012c8700 1 --2- 172.21.15.59:0/4052718691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc0650f0 0x7fb9fc0986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.559+0000 7fba012c8700 1 --2- 172.21.15.59:0/4052718691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc097c30 0x7fb9fc098b90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.559+0000 7fba012c8700 1 -- 172.21.15.59:0/4052718691 >> 172.21.15.59:0/4052718691 conn(0x7fb9fc09dc70 msgr2=0x7fb9fc09e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:01.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.559+0000 7fba012c8700 1 -- 172.21.15.59:0/4052718691 shutdown_connections 2023-09-30T22:27:01.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.559+0000 7fba012c8700 1 -- 172.21.15.59:0/4052718691 wait complete. 2023-09-30T22:27:01.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.560+0000 7fba012c8700 1 Processor -- start 2023-09-30T22:27:01.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.560+0000 7fba012c8700 1 -- start start 2023-09-30T22:27:01.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.560+0000 7fba012c8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc0650f0 0x7fb9fc13a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.560+0000 7fba012c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9fc099080 0x7fb9fc13a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.560+0000 7fba012c8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc13ac80 0x7fb9fc11aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.560+0000 7fba012c8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc099a80 con 0x7fb9fc13ac80 2023-09-30T22:27:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.560+0000 7fba012c8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc09cb60 con 0x7fb9fc099080 2023-09-30T22:27:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.560+0000 7fba012c8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc13b0a0 con 0x7fb9fc0650f0 2023-09-30T22:27:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fb9faffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc0650f0 0x7fb9fc13a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fb9fb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc13ac80 0x7fb9fc11aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fb9faffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc0650f0 0x7fb9fc13a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37518/0 (socket says 172.21.15.59:37518) 2023-09-30T22:27:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fb9faffd700 1 -- 172.21.15.59:0/550758742 learned_addr learned my addr 172.21.15.59:0/550758742 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:27:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fb9fa7fc700 1 --2- 172.21.15.59:0/550758742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9fc099080 0x7fb9fc13a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fb9faffd700 1 -- 172.21.15.59:0/550758742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9fc099080 msgr2=0x7fb9fc13a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fb9faffd700 1 --2- 172.21.15.59:0/550758742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9fc099080 0x7fb9fc13a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fb9faffd700 1 -- 172.21.15.59:0/550758742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc13ac80 msgr2=0x7fb9fc11aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fb9faffd700 1 --2- 172.21.15.59:0/550758742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc13ac80 0x7fb9fc11aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fb9faffd700 1 -- 172.21.15.59:0/550758742 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec0092a0 con 0x7fb9fc0650f0 2023-09-30T22:27:01.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fb9fb7fe700 1 --2- 172.21.15.59:0/550758742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc13ac80 0x7fb9fc11aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fb9faffd700 1 --2- 172.21.15.59:0/550758742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc0650f0 0x7fb9fc13a2a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb9ec00ea50 tx=0x7fb9ec009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fb9e2ffd700 1 -- 172.21.15.59:0/550758742 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00ee90 con 0x7fb9fc0650f0 2023-09-30T22:27:01.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fb9e2ffd700 1 -- 172.21.15.59:0/550758742 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec00c850 con 0x7fb9fc0650f0 2023-09-30T22:27:01.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fb9e2ffd700 1 -- 172.21.15.59:0/550758742 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00cbd0 con 0x7fb9fc0650f0 2023-09-30T22:27:01.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fba012c8700 1 -- 172.21.15.59:0/550758742 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f0009370 con 0x7fb9fc0650f0 2023-09-30T22:27:01.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.561+0000 7fba012c8700 1 -- 172.21.15.59:0/550758742 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc11e820 con 0x7fb9fc0650f0 2023-09-30T22:27:01.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.562+0000 7fb9e2ffd700 1 -- 172.21.15.59:0/550758742 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb9ec01b400 con 0x7fb9fc0650f0 2023-09-30T22:27:01.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.562+0000 7fb9e2ffd700 1 -- 172.21.15.59:0/550758742 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb9ec03b340 con 0x7fb9fc0650f0 2023-09-30T22:27:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.565+0000 7fba12c7bb80 1 Processor -- start 2023-09-30T22:27:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.565+0000 7fba12c7bb80 1 -- start start 2023-09-30T22:27:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fba12c7bb80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e613834170 0x55e613834550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fba12c7bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834a40 0x55e61385e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fba12c7bb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e61385e5b0 0x55e6138609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fba12c7bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6137fe610 con 0x55e613834a40 2023-09-30T22:27:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fba12c7bb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e613774db0 con 0x55e61385e5b0 2023-09-30T22:27:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fba12c7bb80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e61378a030 con 0x55e613834170 2023-09-30T22:27:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fb9fa7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834a40 0x55e61385e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fb9fb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e61385e5b0 0x55e6138609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fb9fa7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834a40 0x55e61385e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40834/0 (socket says 172.21.15.59:40834) 2023-09-30T22:27:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fb9faffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e613834170 0x55e613834550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fb9fa7fc700 1 -- 172.21.15.59:0/2722370717 learned_addr learned my addr 172.21.15.59:0/2722370717 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:27:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fb9fa7fc700 1 -- 172.21.15.59:0/2722370717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e613834170 msgr2=0x55e613834550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fb9fa7fc700 1 --2- 172.21.15.59:0/2722370717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e613834170 0x55e613834550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fb9fa7fc700 1 -- 172.21.15.59:0/2722370717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e61385e5b0 msgr2=0x55e6138609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fb9fa7fc700 1 --2- 172.21.15.59:0/2722370717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e61385e5b0 0x55e6138609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fb9fa7fc700 1 -- 172.21.15.59:0/2722370717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e613625710 con 0x55e613834a40 2023-09-30T22:27:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fb9fb7fe700 1 --2- 172.21.15.59:0/2722370717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e61385e5b0 0x55e6138609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fb9faffd700 1 --2- 172.21.15.59:0/2722370717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e613834170 0x55e613834550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.566+0000 7fb9fa7fc700 1 --2- 172.21.15.59:0/2722370717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834a40 0x55e61385e0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fb9f0009f00 tx=0x7fb9f0017000).ready entity=mon.0 client_cookie=7b7b01b7a3716e18 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.567+0000 7fb9dbfff700 1 -- 172.21.15.59:0/2722370717 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0006d90 con 0x55e613834a40 2023-09-30T22:27:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.567+0000 7fb9dbfff700 1 -- 172.21.15.59:0/2722370717 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f0000d10 con 0x55e613834a40 2023-09-30T22:27:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.567+0000 7fb9dbfff700 1 -- 172.21.15.59:0/2722370717 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f001c450 con 0x55e613834a40 2023-09-30T22:27:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.567+0000 7fba12c7bb80 1 -- 172.21.15.59:0/2722370717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834a40 msgr2=0x55e61385e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.567+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/2722370717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834a40 0x55e61385e0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fb9f0009f00 tx=0x7fb9f0017000).stop 2023-09-30T22:27:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.567+0000 7fba12c7bb80 1 -- 172.21.15.59:0/2722370717 shutdown_connections 2023-09-30T22:27:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.567+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/2722370717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e613834170 0x55e613834550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.567+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/2722370717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e61385e5b0 0x55e6138609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.567+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/2722370717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834a40 0x55e61385e0c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.567+0000 7fba12c7bb80 1 -- 172.21.15.59:0/2722370717 >> 172.21.15.59:0/2722370717 conn(0x55e6136a2940 msgr2=0x55e613854cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:01.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.567+0000 7fba12c7bb80 1 -- 172.21.15.59:0/2722370717 shutdown_connections 2023-09-30T22:27:01.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.567+0000 7fba12c7bb80 1 -- 172.21.15.59:0/2722370717 wait complete. 2023-09-30T22:27:01.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.568+0000 7fba12c7bb80 1 -- start start 2023-09-30T22:27:01.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.568+0000 7fba12c7bb80 1 Processor -- start 2023-09-30T22:27:01.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fba12c7bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834170 0x55e6138599c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fba12c7bb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834a40 0x55e613859eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fba12c7bb80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e61385e5b0 0x55e61385a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fba12c7bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61378a170 con 0x55e613834170 2023-09-30T22:27:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fba12c7bb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e61378a3f0 con 0x55e613834a40 2023-09-30T22:27:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fba12c7bb80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e613755920 con 0x55e61385e5b0 2023-09-30T22:27:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fba12c7bb80 10 client.0 ll_register_callbacks cb 0x55e61372ace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:27:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fb9fa7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834a40 0x55e613859eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fb9faffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834170 0x55e6138599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fb9fa7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834a40 0x55e613859eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55304/0 (socket says 172.21.15.59:55304) 2023-09-30T22:27:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fb9faffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834170 0x55e6138599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40848/0 (socket says 172.21.15.59:40848) 2023-09-30T22:27:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fb9fa7fc700 1 -- 172.21.15.59:0/4104427358 learned_addr learned my addr 172.21.15.59:0/4104427358 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:27:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fb9fb7fe700 1 --2- 172.21.15.59:0/4104427358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e61385e5b0 0x55e61385a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fb9faffd700 1 -- 172.21.15.59:0/4104427358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e61385e5b0 msgr2=0x55e61385a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fb9faffd700 1 --2- 172.21.15.59:0/4104427358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e61385e5b0 0x55e61385a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fb9faffd700 1 -- 172.21.15.59:0/4104427358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834a40 msgr2=0x55e613859eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fb9faffd700 1 --2- 172.21.15.59:0/4104427358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834a40 0x55e613859eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fb9faffd700 1 -- 172.21.15.59:0/4104427358 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc099790 con 0x55e613834170 2023-09-30T22:27:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fb9faffd700 1 --2- 172.21.15.59:0/4104427358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834170 0x55e6138599c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fb9ec039af0 tx=0x7fb9ec01a000).ready entity=mon.0 client_cookie=452c3b8da143ecf4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fb9d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-09-30T22:27:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fb9d97fa700 1 -- 172.21.15.59:0/4104427358 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec019310 con 0x55e613834170 2023-09-30T22:27:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.569+0000 7fb9d97fa700 1 -- 172.21.15.59:0/4104427358 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb9ec03a120 con 0x55e613834170 2023-09-30T22:27:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.570+0000 7fba12c7bb80 1 -- 172.21.15.59:0/4104427358 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e61382cf20 con 0x55e613834170 2023-09-30T22:27:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.570+0000 7fb9d97fa700 1 -- 172.21.15.59:0/4104427358 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9ec023350 con 0x55e613834170 2023-09-30T22:27:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.570+0000 7fba12c7bb80 10 client.4731 fetch_fsmap learned FSMap version 8 2023-09-30T22:27:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.570+0000 7fba12c7bb80 1 -- 172.21.15.59:0/4104427358 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e61375cb00 con 0x55e613834170 2023-09-30T22:27:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.570+0000 7fb9d97fa700 1 -- 172.21.15.59:0/4104427358 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e61382cf20 con 0x55e613834170 2023-09-30T22:27:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.570+0000 7fb9d97fa700 1 -- 172.21.15.59:0/4104427358 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 8) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fb9ec011770 con 0x55e613834170 2023-09-30T22:27:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.570+0000 7fba12c7bb80 10 client.4731 fetch_fsmap finished waiting for FSMap version 8 2023-09-30T22:27:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.570+0000 7fba12c7bb80 10 client.4731 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:27:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.570+0000 7fba12c7bb80 20 client.4731 populate_metadata read hostname 'smithi059' 2023-09-30T22:27:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.570+0000 7fba12c7bb80 4 client.4731 mds_command: new command op to 4181 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:27:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.570+0000 7fba12c7bb80 1 -- 172.21.15.59:0/4104427358 --> v1:172.21.15.59:6817/2103029646 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e613802250 con 0x55e61384e8f0 2023-09-30T22:27:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.570+0000 7fb9d97fa700 10 client.4731 ms_handle_connect on v1:172.21.15.59:6817/2103029646 2023-09-30T22:27:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.571+0000 7fb9d97fa700 1 -- 172.21.15.59:0/4104427358 <== mds.0 v1:172.21.15.59:6817/2103029646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55e613802250 con 0x55e61384e8f0 2023-09-30T22:27:01.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.571+0000 7fb9d97fa700 10 client.4731 handle_command_reply: tid=0 2023-09-30T22:27:01.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.571+0000 7fba12c7bb80 1 client.4731 shutdown 2023-09-30T22:27:01.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.571+0000 7fba12c7bb80 1 -- 172.21.15.59:0/4104427358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834170 msgr2=0x55e6138599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.571+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/4104427358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834170 0x55e6138599c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fb9ec039af0 tx=0x7fb9ec01a000).stop 2023-09-30T22:27:01.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.571+0000 7fba12c7bb80 1 -- 172.21.15.59:0/4104427358 shutdown_connections 2023-09-30T22:27:01.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.571+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/4104427358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e61385e5b0 0x55e61385a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.571+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/4104427358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834170 0x55e6138599c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.571+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/4104427358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834a40 0x55e613859eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.571+0000 7fb9d97fa700 0 client.4731 ms_handle_reset on v1:172.21.15.59:6817/2103029646 2023-09-30T22:27:01.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.571+0000 7fba12c7bb80 1 -- 172.21.15.59:0/4104427358 >> 172.21.15.59:0/4104427358 conn(0x55e6136a2940 msgr2=0x55e613854c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:01.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.571+0000 7fba12c7bb80 1 -- 172.21.15.59:0/4104427358 shutdown_connections 2023-09-30T22:27:01.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.571+0000 7fba12c7bb80 1 -- 172.21.15.59:0/4104427358 wait complete. 2023-09-30T22:27:01.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.571+0000 7fba12c7bb80 20 client.4731 trim_cache size 0 max 16384 2023-09-30T22:27:01.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.589+0000 7fba12c7bb80 1 Processor -- start 2023-09-30T22:27:01.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.589+0000 7fba12c7bb80 1 -- start start 2023-09-30T22:27:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fba12c7bb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834170 0x55e613850030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fba12c7bb80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e613834a40 0x55e613859d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fba12c7bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e61385e5b0 0x55e61385a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fba12c7bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61385bfa0 con 0x55e61385e5b0 2023-09-30T22:27:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fba12c7bb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e613835a20 con 0x55e613834170 2023-09-30T22:27:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fba12c7bb80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e613835840 con 0x55e613834a40 2023-09-30T22:27:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fb9faffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834170 0x55e613850030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fb9fb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e61385e5b0 0x55e61385a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fb9fa7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e613834a40 0x55e613859d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fb9faffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834170 0x55e613850030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55320/0 (socket says 172.21.15.59:55320) 2023-09-30T22:27:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fb9fb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e61385e5b0 0x55e61385a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40858/0 (socket says 172.21.15.59:40858) 2023-09-30T22:27:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fb9faffd700 1 -- 172.21.15.59:0/2004931878 learned_addr learned my addr 172.21.15.59:0/2004931878 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:27:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fb9faffd700 1 -- 172.21.15.59:0/2004931878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e613834a40 msgr2=0x55e613859d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fb9faffd700 1 --2- 172.21.15.59:0/2004931878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e613834a40 0x55e613859d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fb9faffd700 1 -- 172.21.15.59:0/2004931878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e61385e5b0 msgr2=0x55e61385a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fb9faffd700 1 --2- 172.21.15.59:0/2004931878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e61385e5b0 0x55e61385a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fb9faffd700 1 -- 172.21.15.59:0/2004931878 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e613782f70 con 0x55e613834170 2023-09-30T22:27:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fb9fa7fc700 1 --2- 172.21.15.59:0/2004931878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e613834a40 0x55e613859d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.590+0000 7fb9fb7fe700 1 --2- 172.21.15.59:0/2004931878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e61385e5b0 0x55e61385a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.591+0000 7fb9faffd700 1 --2- 172.21.15.59:0/2004931878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834170 0x55e613850030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb9ec006b90 tx=0x7fb9ec027040).ready entity=mon.1 client_cookie=dbc91c6af1b069dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.591+0000 7fb9e0ff9700 1 -- 172.21.15.59:0/2004931878 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec019310 con 0x55e613834170 2023-09-30T22:27:01.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.591+0000 7fb9e0ff9700 1 -- 172.21.15.59:0/2004931878 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec03a120 con 0x55e613834170 2023-09-30T22:27:01.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.591+0000 7fb9e0ff9700 1 -- 172.21.15.59:0/2004931878 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec023350 con 0x55e613834170 2023-09-30T22:27:01.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.591+0000 7fba12c7bb80 1 -- 172.21.15.59:0/2004931878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834170 msgr2=0x55e613850030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.591+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/2004931878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834170 0x55e613850030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb9ec006b90 tx=0x7fb9ec027040).stop 2023-09-30T22:27:01.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.591+0000 7fba12c7bb80 1 -- 172.21.15.59:0/2004931878 shutdown_connections 2023-09-30T22:27:01.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.591+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/2004931878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e61385e5b0 0x55e61385a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.591+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/2004931878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834170 0x55e613850030 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.591+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/2004931878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e613834a40 0x55e613859d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.591+0000 7fba12c7bb80 1 -- 172.21.15.59:0/2004931878 >> 172.21.15.59:0/2004931878 conn(0x55e6136a2940 msgr2=0x55e6138371f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:01.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.591+0000 7fba12c7bb80 1 -- 172.21.15.59:0/2004931878 shutdown_connections 2023-09-30T22:27:01.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.591+0000 7fba12c7bb80 1 -- 172.21.15.59:0/2004931878 wait complete. 2023-09-30T22:27:01.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.592+0000 7fba12c7bb80 1 -- start start 2023-09-30T22:27:01.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.592+0000 7fba12c7bb80 1 Processor -- start 2023-09-30T22:27:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fba12c7bb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834170 0x55e6138537f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fba12c7bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834a40 0x55e613853ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fba12c7bb80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e61385e5b0 0x55e6138541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:27:01.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fba12c7bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61389d000 con 0x55e613834a40 2023-09-30T22:27:01.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fba12c7bb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e61389af80 con 0x55e613834170 2023-09-30T22:27:01.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fba12c7bb80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e6138535c0 con 0x55e61385e5b0 2023-09-30T22:27:01.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fba12c7bb80 10 client.0 ll_register_callbacks cb 0x55e61372ace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:27:01.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fb9faffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834170 0x55e6138537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fb9faffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834170 0x55e6138537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55336/0 (socket says 172.21.15.59:55336) 2023-09-30T22:27:01.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fb9faffd700 1 -- 172.21.15.59:0/241122986 learned_addr learned my addr 172.21.15.59:0/241122986 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:27:01.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fb9fb7fe700 1 --2- 172.21.15.59:0/241122986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e61385e5b0 0x55e6138541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fb9fa7fc700 1 --2- 172.21.15.59:0/241122986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834a40 0x55e613853ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:27:01.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fb9faffd700 1 -- 172.21.15.59:0/241122986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e61385e5b0 msgr2=0x55e6138541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fb9faffd700 1 --2- 172.21.15.59:0/241122986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e61385e5b0 0x55e6138541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fb9faffd700 1 -- 172.21.15.59:0/241122986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834a40 msgr2=0x55e613853ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fb9faffd700 1 --2- 172.21.15.59:0/241122986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834a40 0x55e613853ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fb9faffd700 1 -- 172.21.15.59:0/241122986 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e613625710 con 0x55e613834170 2023-09-30T22:27:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fb9fb7fe700 1 --2- 172.21.15.59:0/241122986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e61385e5b0 0x55e6138541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fb9faffd700 1 --2- 172.21.15.59:0/241122986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834170 0x55e6138537f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb9ec000c00 tx=0x7fb9ec03c000).ready entity=mon.1 client_cookie=12155acfa7a4c2ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fb9d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.59:3301/0 2023-09-30T22:27:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fb9d97fa700 1 -- 172.21.15.59:0/241122986 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec019310 con 0x55e613834170 2023-09-30T22:27:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fb9d97fa700 1 -- 172.21.15.59:0/241122986 <== mon.1 v2:172.21.15.59:3301/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb9ec023350 con 0x55e613834170 2023-09-30T22:27:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.593+0000 7fba12c7bb80 1 -- 172.21.15.59:0/241122986 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9f0000d10 con 0x55e613834170 2023-09-30T22:27:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.594+0000 7fb9d97fa700 1 -- 172.21.15.59:0/241122986 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9ec03b650 con 0x55e613834170 2023-09-30T22:27:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.594+0000 7fba12c7bb80 10 client.4561 fetch_fsmap learned FSMap version 8 2023-09-30T22:27:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.594+0000 7fba12c7bb80 1 -- 172.21.15.59:0/241122986 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7fb9f4001e00 con 0x55e613834170 2023-09-30T22:27:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.594+0000 7fb9d97fa700 1 -- 172.21.15.59:0/241122986 <== mon.1 v2:172.21.15.59:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f0000d10 con 0x55e613834170 2023-09-30T22:27:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.594+0000 7fb9d97fa700 1 -- 172.21.15.59:0/241122986 <== mon.1 v2:172.21.15.59:3301/0 5 ==== fsmap(e 8) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fb9ec04e070 con 0x55e613834170 2023-09-30T22:27:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.594+0000 7fba12c7bb80 10 client.4561 fetch_fsmap finished waiting for FSMap version 8 2023-09-30T22:27:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.594+0000 7fba12c7bb80 10 client.4561 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:27:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.594+0000 7fba12c7bb80 20 client.4561 populate_metadata read hostname 'smithi059' 2023-09-30T22:27:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.594+0000 7fba12c7bb80 4 client.4561 mds_command: new command op to 4181 tid=0[{"prefix": "status"}] 2023-09-30T22:27:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.594+0000 7fba12c7bb80 1 -- 172.21.15.59:0/241122986 --> v1:172.21.15.59:6817/2103029646 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e6135f2ef0 con 0x55e6138b8ec0 2023-09-30T22:27:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.594+0000 7fb9d97fa700 10 client.4561 ms_handle_connect on v1:172.21.15.59:6817/2103029646 2023-09-30T22:27:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.595+0000 7fb9d97fa700 1 -- 172.21.15.59:0/241122986 <== mds.0 v1:172.21.15.59:6817/2103029646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 1944875542) 0x55e6135f2ef0 con 0x55e6138b8ec0 2023-09-30T22:27:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.595+0000 7fb9d97fa700 10 client.4561 handle_command_reply: tid=0 2023-09-30T22:27:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.595+0000 7fba12c7bb80 1 client.4561 shutdown 2023-09-30T22:27:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.595+0000 7fba12c7bb80 1 -- 172.21.15.59:0/241122986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834170 msgr2=0x55e6138537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.595+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/241122986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834170 0x55e6138537f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb9ec000c00 tx=0x7fb9ec03c000).stop 2023-09-30T22:27:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.595+0000 7fba12c7bb80 1 -- 172.21.15.59:0/241122986 shutdown_connections 2023-09-30T22:27:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.595+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/241122986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e61385e5b0 0x55e6138541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.595+0000 7fb9d97fa700 0 client.4561 ms_handle_reset on v1:172.21.15.59:6817/2103029646 2023-09-30T22:27:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.595+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/241122986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e613834170 0x55e6138537f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.595+0000 7fba12c7bb80 1 --2- 172.21.15.59:0/241122986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e613834a40 0x55e613853ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.595+0000 7fba12c7bb80 1 -- 172.21.15.59:0/241122986 >> 172.21.15.59:0/241122986 conn(0x55e6136a2940 msgr2=0x55e61384ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.595+0000 7fba12c7bb80 1 -- 172.21.15.59:0/241122986 shutdown_connections 2023-09-30T22:27:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.595+0000 7fba12c7bb80 1 -- 172.21.15.59:0/241122986 wait complete. 2023-09-30T22:27:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.595+0000 7fba12c7bb80 20 client.4561 trim_cache size 0 max 16384 2023-09-30T22:27:01.604 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-09-30T22:27:01.604 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "4ab45aad-c596-4cc8-9318-aa2f9d41daac", 2023-09-30T22:27:01.604 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2023-09-30T22:27:01.604 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4181, 2023-09-30T22:27:01.604 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2023-09-30T22:27:01.604 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2023-09-30T22:27:01.605 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2023-09-30T22:27:01.605 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 27.179387557999998, 2023-09-30T22:27:01.605 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 8, 2023-09-30T22:27:01.605 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 19, 2023-09-30T22:27:01.605 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 19, 2023-09-30T22:27:01.605 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 31.630865629999999 2023-09-30T22:27:01.605 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-09-30T22:27:01.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.596+0000 7fba012c8700 1 -- 172.21.15.59:0/550758742 >> v1:172.21.15.59:6816/118188 conn(0x7fb9e802bb60 legacy=0x7fb9e802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.596+0000 7fba012c8700 1 -- 172.21.15.59:0/550758742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc0650f0 msgr2=0x7fb9fc13a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.596+0000 7fba012c8700 1 --2- 172.21.15.59:0/550758742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc0650f0 0x7fb9fc13a2a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb9ec00ea50 tx=0x7fb9ec009060).stop 2023-09-30T22:27:01.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.596+0000 7fba012c8700 1 -- 172.21.15.59:0/550758742 shutdown_connections 2023-09-30T22:27:01.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.596+0000 7fba012c8700 1 --2- 172.21.15.59:0/550758742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc0650f0 0x7fb9fc13a2a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.596+0000 7fba012c8700 1 --2- 172.21.15.59:0/550758742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc13ac80 0x7fb9fc11aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.596+0000 7fba012c8700 1 --2- 172.21.15.59:0/550758742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9fc099080 0x7fb9fc13a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:27:01.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.596+0000 7fba012c8700 1 -- 172.21.15.59:0/550758742 >> 172.21.15.59:0/550758742 conn(0x7fb9fc09dc70 msgr2=0x7fb9fc09bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:01.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.596+0000 7fba012c8700 1 -- 172.21.15.59:0/550758742 shutdown_connections 2023-09-30T22:27:01.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:27:01.596+0000 7fba012c8700 1 -- 172.21.15.59:0/550758742 wait complete. 2023-09-30T22:27:01.610 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:27:01.619 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2023-09-30T22:27:01.619 INFO:teuthology.run_tasks:Running task install.upgrade... 2023-09-30T22:27:01.635 INFO:teuthology.task.install:project ceph config {'mon.a': {'branch': 'reef'}} overrides {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-09-30T22:27:01.635 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2023-09-30T22:27:01.635 INFO:teuthology.task.install:remote ubuntu@smithi059.front.sepia.ceph.com config {'branch': 'reef', 'flavor': 'default'} 2023-09-30T22:27:01.636 INFO:teuthology.task.install:extra packages: [] 2023-09-30T22:27:01.641 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-30T22:27:01.641 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2023-09-30T22:27:01.642 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:27:01.667 INFO:teuthology.orchestra.run.smithi059.stdout:16.2.14-44.geeb13ac9.el8 2023-09-30T22:27:01.668 INFO:teuthology.packaging:The installed version of ceph-common is 16.2.14-44.geeb13ac9.el8 2023-09-30T22:27:01.668 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-09-30T22:27:02.037 INFO:teuthology.task.install:Ceph rpm upgrade from 16.2.14-44.geeb13ac9.el8 to 18.2.0-501.gfc1e90a3 2023-09-30T22:27:02.037 INFO:teuthology.task.install.rpm:Host smithi059 is: centos 8 x86_64 2023-09-30T22:27:02.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-09-30T22:27:02.347 INFO:teuthology.task.install.rpm:Repo base URL: https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/ 2023-09-30T22:27:02.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-09-30T22:27:02.639 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T22:27:02.639 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-30T22:27:02.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T22:27:02.675 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T22:27:02.751 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T22:27:02.827 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T22:27:02.890 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2023-09-30T22:27:02.905 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2023-09-30T22:27:03.216 INFO:teuthology.orchestra.run.smithi059.stdout:71 files removed 2023-09-30T22:27:03.249 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2023-09-30T22:27:04.677 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 85 kB/s | 80 kB 00:00 2023-09-30T22:27:05.285 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 17 kB/s | 9.4 kB 00:00 2023-09-30T22:27:05.987 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 2.2 kB/s | 1.5 kB 00:00 2023-09-30T22:27:08.303 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - AppStream 15 MB/s | 33 MB 00:02 2023-09-30T22:27:17.854 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 48 MB 00:02 2023-09-30T22:27:25.954 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - Extras 40 kB/s | 18 kB 00:00 2023-09-30T22:27:26.921 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - Extras common packages 9.1 kB/s | 6.9 kB 00:00 2023-09-30T22:27:27.389 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - PowerTools 22 MB/s | 6.5 MB 00:00 2023-09-30T22:27:29.050 INFO:teuthology.orchestra.run.smithi059.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-09-30T22:27:30.577 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-09-30T22:27:34.841 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 501 kB/s | 24 kB 00:00 2023-09-30T22:27:39.548 INFO:teuthology.orchestra.run.smithi059.stderr:Package cephadm available, but not installed. 2023-09-30T22:27:39.549 INFO:teuthology.orchestra.run.smithi059.stdout:No match for argument: cephadm 2023-09-30T22:27:39.549 INFO:teuthology.orchestra.run.smithi059.stderr:Package ceph-immutable-object-cache available, but not installed. 2023-09-30T22:27:39.549 INFO:teuthology.orchestra.run.smithi059.stdout:No match for argument: ceph-immutable-object-cache 2023-09-30T22:27:39.563 INFO:teuthology.orchestra.run.smithi059.stderr:Package ceph-mgr-cephadm available, but not installed. 2023-09-30T22:27:39.563 INFO:teuthology.orchestra.run.smithi059.stdout:No match for argument: ceph-mgr-cephadm 2023-09-30T22:27:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:Package ceph-volume available, but not installed. 2023-09-30T22:27:39.568 INFO:teuthology.orchestra.run.smithi059.stdout:No match for argument: ceph-volume 2023-09-30T22:27:39.874 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-09-30T22:27:39.879 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================== 2023-09-30T22:27:39.880 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2023-09-30T22:27:39.880 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================== 2023-09-30T22:27:39.880 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2023-09-30T22:27:39.880 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 6.4 k 2023-09-30T22:27:39.880 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 5.4 M 2023-09-30T22:27:39.881 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 22 M 2023-09-30T22:27:39.881 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 847 k 2023-09-30T22:27:39.881 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 23 k 2023-09-30T22:27:39.881 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 2.3 M 2023-09-30T22:27:39.881 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 1.5 M 2023-09-30T22:27:39.881 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 1.7 M 2023-09-30T22:27:39.881 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 7.4 M 2023-09-30T22:27:39.882 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 241 k 2023-09-30T22:27:39.882 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 47 k 2023-09-30T22:27:39.882 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 4.6 M 2023-09-30T22:27:39.882 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 18 M 2023-09-30T22:27:39.882 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 15 k 2023-09-30T22:27:39.882 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 13 M 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 24 k 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 47 M 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 30 k 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 769 k 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 137 k 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 139 k 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 3.7 M 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 474 k 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 3.6 M 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 6.5 M 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 45 k 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 123 k 2023-09-30T22:27:39.885 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 190 k 2023-09-30T22:27:39.885 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 371 k 2023-09-30T22:27:39.885 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 364 k 2023-09-30T22:27:39.885 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 107 k 2023-09-30T22:27:39.885 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 94 k 2023-09-30T22:27:39.885 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 3.4 M 2023-09-30T22:27:39.886 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 179 k 2023-09-30T22:27:39.886 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2023-09-30T22:27:39.886 INFO:teuthology.orchestra.run.smithi059.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-30T22:27:39.886 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:27:39.886 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2023-09-30T22:27:39.886 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================== 2023-09-30T22:27:39.886 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2023-09-30T22:27:39.886 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 34 Packages 2023-09-30T22:27:39.886 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:27:39.887 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 145 M 2023-09-30T22:27:39.887 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2023-09-30T22:27:40.435 INFO:teuthology.orchestra.run.smithi059.stdout:(1/35): ceph-18.2.0-501.gfc1e90a3.el8.x86_64.rp 17 kB/s | 6.4 kB 00:00 2023-09-30T22:27:40.682 INFO:teuthology.orchestra.run.smithi059.stdout:(2/35): thrift-0.13.0-2.el8.x86_64.rpm 2.8 MB/s | 1.7 MB 00:00 2023-09-30T22:27:41.827 INFO:teuthology.orchestra.run.smithi059.stdout:(3/35): ceph-fuse-18.2.0-501.gfc1e90a3.el8.x86_ 740 kB/s | 847 kB 00:01 2023-09-30T22:27:42.402 INFO:teuthology.orchestra.run.smithi059.stdout:(4/35): ceph-base-18.2.0-501.gfc1e90a3.el8.x86_ 2.3 MB/s | 5.4 MB 00:02 2023-09-30T22:27:43.019 INFO:teuthology.orchestra.run.smithi059.stdout:(5/35): ceph-mds-18.2.0-501.gfc1e90a3.el8.x86_6 1.9 MB/s | 2.3 MB 00:01 2023-09-30T22:27:43.153 INFO:teuthology.orchestra.run.smithi059.stdout:(6/35): ceph-mgr-18.2.0-501.gfc1e90a3.el8.x86_6 2.1 MB/s | 1.5 MB 00:00 2023-09-30T22:27:44.703 INFO:teuthology.orchestra.run.smithi059.stdout:(7/35): ceph-mon-18.2.0-501.gfc1e90a3.el8.x86_6 2.7 MB/s | 4.6 MB 00:01 2023-09-30T22:27:46.470 INFO:teuthology.orchestra.run.smithi059.stdout:(8/35): ceph-common-18.2.0-501.gfc1e90a3.el8.x8 3.6 MB/s | 22 MB 00:06 2023-09-30T22:27:46.570 INFO:teuthology.orchestra.run.smithi059.stdout:(9/35): ceph-selinux-18.2.0-501.gfc1e90a3.el8.x 246 kB/s | 24 kB 00:00 2023-09-30T22:27:48.904 INFO:teuthology.orchestra.run.smithi059.stdout:(10/35): ceph-osd-18.2.0-501.gfc1e90a3.el8.x86_ 3.1 MB/s | 18 MB 00:05 2023-09-30T22:27:49.037 INFO:teuthology.orchestra.run.smithi059.stdout:(11/35): ceph-radosgw-18.2.0-501.gfc1e90a3.el8. 3.0 MB/s | 13 MB 00:04 2023-09-30T22:27:49.054 INFO:teuthology.orchestra.run.smithi059.stdout:(12/35): libcephfs-devel-18.2.0-501.gfc1e90a3.e 203 kB/s | 30 kB 00:00 2023-09-30T22:27:49.146 INFO:teuthology.orchestra.run.smithi059.stdout:(13/35): libcephsqlite-18.2.0-501.gfc1e90a3.el8 1.5 MB/s | 137 kB 00:00 2023-09-30T22:27:49.213 INFO:teuthology.orchestra.run.smithi059.stdout:(14/35): librados-devel-18.2.0-501.gfc1e90a3.el 2.0 MB/s | 139 kB 00:00 2023-09-30T22:27:49.263 INFO:teuthology.orchestra.run.smithi059.stdout:(15/35): libcephfs2-18.2.0-501.gfc1e90a3.el8.x8 3.3 MB/s | 769 kB 00:00 2023-09-30T22:27:49.463 INFO:teuthology.orchestra.run.smithi059.stdout:(16/35): libradosstriper1-18.2.0-501.gfc1e90a3. 2.3 MB/s | 474 kB 00:00 2023-09-30T22:27:50.097 INFO:teuthology.orchestra.run.smithi059.stdout:(17/35): librados2-18.2.0-501.gfc1e90a3.el8.x86 4.1 MB/s | 3.7 MB 00:00 2023-09-30T22:27:50.406 INFO:teuthology.orchestra.run.smithi059.stdout:(18/35): librbd1-18.2.0-501.gfc1e90a3.el8.x86_6 3.8 MB/s | 3.6 MB 00:00 2023-09-30T22:27:50.481 INFO:teuthology.orchestra.run.smithi059.stdout:(19/35): python3-ceph-argparse-18.2.0-501.gfc1e 597 kB/s | 45 kB 00:00 2023-09-30T22:27:50.556 INFO:teuthology.orchestra.run.smithi059.stdout:(20/35): python3-ceph-common-18.2.0-501.gfc1e90 1.6 MB/s | 123 kB 00:00 2023-09-30T22:27:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:(21/35): python3-cephfs-18.2.0-501.gfc1e90a3.el 1.8 MB/s | 190 kB 00:00 2023-09-30T22:27:50.807 INFO:teuthology.orchestra.run.smithi059.stdout:(22/35): python3-rados-18.2.0-501.gfc1e90a3.el8 2.5 MB/s | 371 kB 00:00 2023-09-30T22:27:50.941 INFO:teuthology.orchestra.run.smithi059.stdout:(23/35): python3-rbd-18.2.0-501.gfc1e90a3.el8.x 2.7 MB/s | 364 kB 00:00 2023-09-30T22:27:51.025 INFO:teuthology.orchestra.run.smithi059.stdout:(24/35): python3-rgw-18.2.0-501.gfc1e90a3.el8.x 1.3 MB/s | 107 kB 00:00 2023-09-30T22:27:51.100 INFO:teuthology.orchestra.run.smithi059.stdout:(25/35): rbd-fuse-18.2.0-501.gfc1e90a3.el8.x86_ 1.2 MB/s | 94 kB 00:00 2023-09-30T22:27:51.583 INFO:teuthology.orchestra.run.smithi059.stdout:(26/35): librgw2-18.2.0-501.gfc1e90a3.el8.x86_6 4.4 MB/s | 6.5 MB 00:01 2023-09-30T22:27:51.675 INFO:teuthology.orchestra.run.smithi059.stdout:(27/35): rbd-nbd-18.2.0-501.gfc1e90a3.el8.x86_6 1.9 MB/s | 179 kB 00:00 2023-09-30T22:27:51.751 INFO:teuthology.orchestra.run.smithi059.stdout:(28/35): ceph-grafana-dashboards-18.2.0-501.gfc 307 kB/s | 23 kB 00:00 2023-09-30T22:27:52.009 INFO:teuthology.orchestra.run.smithi059.stdout:(29/35): rbd-mirror-18.2.0-501.gfc1e90a3.el8.x8 3.8 MB/s | 3.4 MB 00:00 2023-09-30T22:27:52.234 INFO:teuthology.orchestra.run.smithi059.stdout:(30/35): ceph-mgr-dashboard-18.2.0-501.gfc1e90a 3.6 MB/s | 1.7 MB 00:00 2023-09-30T22:27:52.310 INFO:teuthology.orchestra.run.smithi059.stdout:(31/35): ceph-mgr-modules-core-18.2.0-501.gfc1e 3.1 MB/s | 241 kB 00:00 2023-09-30T22:27:52.393 INFO:teuthology.orchestra.run.smithi059.stdout:(32/35): ceph-mgr-rook-18.2.0-501.gfc1e90a3.el8 570 kB/s | 47 kB 00:00 2023-09-30T22:27:52.452 INFO:teuthology.orchestra.run.smithi059.stdout:(33/35): ceph-prometheus-alerts-18.2.0-501.gfc1 249 kB/s | 15 kB 00:00 2023-09-30T22:27:53.619 INFO:teuthology.orchestra.run.smithi059.stdout:(34/35): ceph-mgr-diskprediction-local-18.2.0-5 4.6 MB/s | 7.4 MB 00:01 2023-09-30T22:27:55.069 INFO:teuthology.orchestra.run.smithi059.stdout:(35/35): ceph-test-18.2.0-501.gfc1e90a3.el8.x86 5.5 MB/s | 47 MB 00:08 2023-09-30T22:27:55.072 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:27:55.072 INFO:teuthology.orchestra.run.smithi059.stdout:Total 9.5 MB/s | 145 MB 00:15 2023-09-30T22:27:55.074 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2023-09-30T22:27:55.152 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2023-09-30T22:27:55.153 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2023-09-30T22:27:55.878 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2023-09-30T22:27:55.881 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2023-09-30T22:27:58.181 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2023-09-30T22:27:58.382 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-09-30T22:27:58.981 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/69 2023-09-30T22:27:59.420 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2/69 2023-09-30T22:27:59.846 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2/69 2023-09-30T22:28:00.028 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 3/69 2023-09-30T22:28:00.164 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 3/69 2023-09-30T22:28:00.328 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 4/69 2023-09-30T22:28:01.151 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 4/69 2023-09-30T22:28:01.353 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 5/69 2023-09-30T22:28:01.459 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 5/69 2023-09-30T22:28:01.666 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : python3-rados-2:18.2.0-501.gfc1e90a3.el8.x86_64 6/69 2023-09-30T22:28:01.811 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 7/69 2023-09-30T22:28:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 7/69 2023-09-30T22:28:02.144 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 8/69 2023-09-30T22:28:02.196 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 8/69 2023-09-30T22:28:02.392 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : python3-ceph-argparse-2:18.2.0-501.gfc1e90a3.el8.x 9/69 2023-09-30T22:28:02.610 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : python3-cephfs-2:18.2.0-501.gfc1e90a3.el8.x86_64 10/69 2023-09-30T22:28:02.791 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : python3-rbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 11/69 2023-09-30T22:28:02.994 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : python3-rgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 12/69 2023-09-30T22:28:03.297 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 13/69 2023-09-30T22:28:03.400 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-prometheus-alerts-2:18.2.0-501.gfc1e90a3.el8. 14/69 2023-09-30T22:28:03.575 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-grafana-dashboards-2:18.2.0-501.gfc1e90a3.el8 15/69 2023-09-30T22:28:03.795 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : python3-ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86 16/69 2023-09-30T22:28:06.307 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 17/69 2023-09-30T22:28:06.537 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 17/69 2023-09-30T22:28:07.237 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 17/69 2023-09-30T22:28:07.508 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 18/69 2023-09-30T22:28:07.578 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 18/69 2023-09-30T22:28:07.760 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 19/69 2023-09-30T22:28:27.732 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 19/69 2023-09-30T22:28:27.938 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noar 20/69 2023-09-30T22:28:29.200 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noar 20/69 2023-09-30T22:28:29.416 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90 21/69 2023-09-30T22:28:29.523 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90 21/69 2023-09-30T22:28:29.910 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-mgr-modules-core-2:18.2.0-501.gfc1e90a3.el8.n 22/69 2023-09-30T22:28:30.289 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 23/69 2023-09-30T22:28:30.317 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 23/69 2023-09-30T22:28:30.491 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 24/69 2023-09-30T22:28:30.717 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 24/69 2023-09-30T22:28:30.975 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 25/69 2023-09-30T22:28:31.577 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 25/69 2023-09-30T22:28:31.791 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 26/69 2023-09-30T22:28:33.776 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 26/69 2023-09-30T22:28:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 27/69 2023-09-30T22:28:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 27/69 2023-09-30T22:28:35.631 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-2:18.2.0-501.gfc1e90a3.el8.x86_64 28/69 2023-09-30T22:28:35.863 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 29/69 2023-09-30T22:28:36.300 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 29/69 2023-09-30T22:28:36.541 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 30/69 2023-09-30T22:28:42.001 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 30/69 2023-09-30T22:28:42.262 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-test-2:18.2.0-501.gfc1e90a3.el8.x86_64 31/69 2023-09-30T22:28:42.452 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libcephfs-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 32/69 2023-09-30T22:28:42.650 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : rbd-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 33/69 2023-09-30T22:28:42.930 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : rbd-nbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 34/69 2023-09-30T22:28:43.150 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 35/69 2023-09-30T22:28:43.294 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 36/69 2023-09-30T22:28:43.516 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-09-30T22:28:43.525 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-09-30T22:28:43.525 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-09-30T22:28:43.772 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-09-30T22:28:43.924 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-09-30T22:28:43.924 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-09-30T22:28:44.117 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-09-30T22:28:44.124 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-09-30T22:28:44.124 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-09-30T22:28:44.327 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-09-30T22:28:44.512 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 42/69 2023-09-30T22:28:44.690 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 43/69 2023-09-30T22:28:44.697 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-09-30T22:28:44.698 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-09-30T22:28:44.908 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-09-30T22:28:45.082 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-09-30T22:28:45.082 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-09-30T22:28:45.283 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-09-30T22:28:45.440 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-09-30T22:28:45.448 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-09-30T22:28:45.449 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-09-30T22:28:45.833 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-09-30T22:28:45.833 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-09-30T22:28:46.056 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-09-30T22:28:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-09-30T22:28:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-09-30T22:28:46.249 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-09-30T22:28:46.256 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:28:46.257 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:28:46.458 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:28:46.458 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-09-30T22:28:46.617 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-09-30T22:28:46.647 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:28:46.648 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:28:46.951 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:28:46.951 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-09-30T22:28:47.182 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-09-30T22:28:47.183 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-09-30T22:28:47.399 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-09-30T22:28:47.590 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 56/69 2023-09-30T22:28:47.774 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-09-30T22:28:47.774 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-09-30T22:28:48.016 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-09-30T22:28:48.209 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 59/69 2023-09-30T22:28:48.209 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-09-30T22:28:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-09-30T22:28:48.615 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 61/69 2023-09-30T22:28:48.615 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-09-30T22:28:48.833 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-09-30T22:28:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 63/69 2023-09-30T22:28:49.092 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 64/69 2023-09-30T22:28:49.265 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 65/69 2023-09-30T22:28:49.398 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 66/69 2023-09-30T22:28:49.492 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 67/69 2023-09-30T22:28:49.492 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-09-30T22:28:49.666 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-09-30T22:28:49.666 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-09-30T22:28:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-09-30T22:28:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 1/69 2023-09-30T22:28:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:18.2.0-501.gfc1e90a3.el8.x86_64 2/69 2023-09-30T22:28:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 3/69 2023-09-30T22:28:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 4/69 2023-09-30T22:28:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 5/69 2023-09-30T22:28:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 6/69 2023-09-30T22:28:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 7/69 2023-09-30T22:28:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 8/69 2023-09-30T22:28:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 9/69 2023-09-30T22:28:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 10/69 2023-09-30T22:28:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 11/69 2023-09-30T22:28:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 12/69 2023-09-30T22:28:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 13/69 2023-09-30T22:28:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 14/69 2023-09-30T22:28:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 15/69 2023-09-30T22:28:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 16/69 2023-09-30T22:28:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 17/69 2023-09-30T22:28:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 18/69 2023-09-30T22:28:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 19/69 2023-09-30T22:28:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 20/69 2023-09-30T22:28:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 21/69 2023-09-30T22:28:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:18.2.0-501.gfc1e90a3.el8.x86_64 22/69 2023-09-30T22:28:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 23/69 2023-09-30T22:28:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 24/69 2023-09-30T22:28:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 25/69 2023-09-30T22:28:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 26/69 2023-09-30T22:28:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 27/69 2023-09-30T22:28:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 28/69 2023-09-30T22:28:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 29/69 2023-09-30T22:28:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 30/69 2023-09-30T22:28:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 31/69 2023-09-30T22:28:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 32/69 2023-09-30T22:28:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 33/69 2023-09-30T22:28:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 34/69 2023-09-30T22:28:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 35/69 2023-09-30T22:28:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 36/69 2023-09-30T22:28:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-09-30T22:28:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 38/69 2023-09-30T22:28:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-09-30T22:28:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:18.2.0-501.gfc1e90a3.el8.x 40/69 2023-09-30T22:28:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 41/69 2023-09-30T22:28:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86 42/69 2023-09-30T22:28:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 43/69 2023-09-30T22:28:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:18.2.0-501.gfc1e90a3.el8.x86_64 44/69 2023-09-30T22:28:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-09-30T22:28:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:18.2.0-501.gfc1e90a3.el8.x86_64 46/69 2023-09-30T22:28:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-09-30T22:28:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 48/69 2023-09-30T22:28:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 49/69 2023-09-30T22:28:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 50/69 2023-09-30T22:28:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:28:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 52/69 2023-09-30T22:28:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:28:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 54/69 2023-09-30T22:28:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-09-30T22:28:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 56/69 2023-09-30T22:28:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-09-30T22:28:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-501.gfc1e90a3.el8 58/69 2023-09-30T22:28:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 59/69 2023-09-30T22:28:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noar 60/69 2023-09-30T22:28:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 61/69 2023-09-30T22:28:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90 62/69 2023-09-30T22:28:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 63/69 2023-09-30T22:28:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-501.gfc1e90a3.el8.n 64/69 2023-09-30T22:28:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 65/69 2023-09-30T22:28:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 66/69 2023-09-30T22:28:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 67/69 2023-09-30T22:28:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-501.gfc1e90a3.el8. 68/69 2023-09-30T22:28:52.546 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 69/69 2023-09-30T22:28:52.546 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:28:52.546 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2023-09-30T22:28:52.546 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.546 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.546 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.547 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.547 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:28:52.547 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.547 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.547 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:28:52.547 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:28:52.547 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:28:52.547 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:28:52.547 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.547 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.547 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:28:52.548 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.548 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.548 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.548 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.548 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.549 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.550 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.550 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.550 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.550 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.550 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.550 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.550 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.550 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.550 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.550 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.551 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.551 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.551 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.551 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:28:52.551 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2023-09-30T22:28:52.551 INFO:teuthology.orchestra.run.smithi059.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-30T22:28:52.551 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:28:52.551 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-09-30T22:28:52.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-09-30T22:28:52.998 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:28:53.029 INFO:teuthology.orchestra.run.smithi059.stdout:18.2.0-501.gfc1e90a3.el8 2023-09-30T22:28:53.029 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-501.gfc1e90a3.el8 2023-09-30T22:28:53.029 INFO:teuthology.task.install:The correct ceph version 18.2.0-501.gfc1e90a3 is installed. 2023-09-30T22:28:53.030 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:28:53.040 INFO:teuthology.task.print:**** done install.upgrade the host 2023-09-30T22:28:53.040 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-09-30T22:28:53.089 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-30T22:28:53.089 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:28:53.103 INFO:tasks.ceph.mon.a:Stopped 2023-09-30T22:28:53.103 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-30T22:28:53.103 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-30T22:28:53.145 INFO:tasks.ceph.mon.a:Started 2023-09-30T22:28:53.146 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-30T22:28:53.146 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:28:53.160 INFO:tasks.ceph.mon.b:Stopped 2023-09-30T22:28:53.160 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-30T22:28:53.160 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-30T22:28:53.203 INFO:tasks.ceph.mon.b:Started 2023-09-30T22:28:53.203 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-30T22:28:53.204 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:28:53.219 INFO:tasks.ceph.mon.c:Stopped 2023-09-30T22:28:53.219 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-30T22:28:53.219 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-30T22:28:53.261 INFO:tasks.ceph.mon.c:Started 2023-09-30T22:28:53.261 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-30T22:28:53.262 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:28:53.294 INFO:tasks.ceph.mgr.x:Stopped 2023-09-30T22:28:53.294 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-30T22:28:53.294 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-30T22:28:53.337 INFO:tasks.ceph.mgr.x:Started 2023-09-30T22:28:53.337 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-09-30T22:28:53.348 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T22:28:53.348 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T22:28:53.348 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T22:28:53.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.489+0000 7f56ad7aa700 1 Processor -- start 2023-09-30T22:28:53.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.489+0000 7f56ad7aa700 1 -- start start 2023-09-30T22:28:53.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.489+0000 7f56ad7aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80a0a30 0x7f56a80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.489+0000 7f56ad7aa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56a8138d80 0x7f56a813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.489+0000 7f56ad7aa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a80a2a70 con 0x7f56a809d630 2023-09-30T22:28:53.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.489+0000 7f56ad7aa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a80a01d0 con 0x7f56a8138d80 2023-09-30T22:28:53.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.489+0000 7f56ad7aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a809e2b0 con 0x7f56a80a0a30 2023-09-30T22:28:53.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.490+0000 7f56a77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56a8138d80 0x7f56a813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.490+0000 7f56a67fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f56a809d630 0x7f56a80a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45196/0 (socket says 172.21.15.59:45196) 2023-09-30T22:28:53.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.490+0000 7f56a67fc700 1 -- 172.21.15.59:0/3322874255 learned_addr learned my addr 172.21.15.59:0/3322874255 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:28:53.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.490+0000 7f56a6ffd700 1 --2- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80a0a30 0x7f56a80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.490+0000 7f56a77fe700 1 -- 172.21.15.59:0/3322874255 >> v2:172.21.15.59:3300/0 conn(0x7f56a8138d80 msgr2=0x7f56a813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-30T22:28:53.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.490+0000 7f56a77fe700 1 -- 172.21.15.59:0/3322874255 >> v2:172.21.15.59:3300/0 conn(0x7f56a8138d80 msgr2=0x7f56a813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:28:53.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.490+0000 7f56a77fe700 1 --2- 172.21.15.59:0/3322874255 >> v2:172.21.15.59:3300/0 conn(0x7f56a8138d80 0x7f56a813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-30T22:28:53.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.490+0000 7f56a77fe700 1 --2- 172.21.15.59:0/3322874255 >> v2:172.21.15.59:3300/0 conn(0x7f56a8138d80 0x7f56a813b160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:28:53.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.490+0000 7f56a6ffd700 1 -- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80a0a30 msgr2=0x7f56a80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:28:53.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.490+0000 7f56a6ffd700 1 -- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80a0a30 msgr2=0x7f56a80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:28:53.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.490+0000 7f56a6ffd700 1 --2- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80a0a30 0x7f56a80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-30T22:28:53.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.490+0000 7f56a6ffd700 1 --2- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80a0a30 0x7f56a80a0e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:28:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 -- 172.21.15.59:0/3322874255 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185728656 0 0) 0x7f56a80a2a70 con 0x7f56a809d630 2023-09-30T22:28:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 -- 172.21.15.59:0/3322874255 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56900035b0 con 0x7f56a809d630 2023-09-30T22:28:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 -- 172.21.15.59:0/3322874255 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3194257697 0 0) 0x7f56900035b0 con 0x7f56a809d630 2023-09-30T22:28:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 -- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80a0a30 msgr2=0x7f56a80a0e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:28:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 --2- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80a0a30 0x7f56a80a0e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 -- 172.21.15.59:0/3322874255 >> v2:172.21.15.59:3300/0 conn(0x7f56a8138d80 msgr2=0x7f56a813b160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:28:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 --2- 172.21.15.59:0/3322874255 >> v2:172.21.15.59:3300/0 conn(0x7f56a8138d80 0x7f56a813b160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 -- 172.21.15.59:0/3322874255 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a809dc50 con 0x7f56a809d630 2023-09-30T22:28:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 -- 172.21.15.59:0/3322874255 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1997034051 0 0) 0x7f569c001670 con 0x7f56a809d630 2023-09-30T22:28:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 -- 172.21.15.59:0/3322874255 >> v1:172.21.15.59:6789/0 conn(0x7f56a809d630 legacy=0x7f56a80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 --2- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5690003a00 0x7f5690003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 --2- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80a0a30 0x7f5690004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 --2- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5690004d90 0x7f5690005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 -- 172.21.15.59:0/3322874255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a80a01d0 con 0x7f5690004d90 2023-09-30T22:28:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 -- 172.21.15.59:0/3322874255 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a809e2b0 con 0x7f56a80a0a30 2023-09-30T22:28:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a5ffb700 1 -- 172.21.15.59:0/3322874255 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f569000bc50 con 0x7f5690003a00 2023-09-30T22:28:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.527+0000 7f56a6ffd700 1 --2- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5690003a00 0x7f5690003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.528+0000 7f56a67fc700 1 --2- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80a0a30 0x7f5690004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.528+0000 7f56a77fe700 1 --2- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5690004d90 0x7f5690005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.528+0000 7f56a67fc700 1 -- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5690003a00 msgr2=0x7f5690003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.528+0000 7f56a67fc700 1 --2- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5690003a00 0x7f5690003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.528+0000 7f56a67fc700 1 -- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5690004d90 msgr2=0x7f5690005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.528+0000 7f56a67fc700 1 --2- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5690004d90 0x7f5690005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.528+0000 7f56a67fc700 1 -- 172.21.15.59:0/3322874255 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56900035b0 con 0x7f56a80a0a30 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.528+0000 7f56a67fc700 1 --2- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80a0a30 0x7f5690004850 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f569c00c1e0 tx=0x7f5690005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5c639d71ae91881 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.530+0000 7f56a77fe700 1 --2- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5690004d90 0x7f5690005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.530+0000 7f56a5ffb700 1 -- 172.21.15.59:0/3322874255 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c00cd80 con 0x7f56a80a0a30 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.530+0000 7f56a5ffb700 1 -- 172.21.15.59:0/3322874255 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c005960 con 0x7f56a80a0a30 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.530+0000 7f56a5ffb700 1 -- 172.21.15.59:0/3322874255 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c005d10 con 0x7f56a80a0a30 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.531+0000 7f56ad7aa700 1 -- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80a0a30 msgr2=0x7f5690004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.531+0000 7f56ad7aa700 1 --2- 172.21.15.59:0/3322874255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80a0a30 0x7f5690004850 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f569c00c1e0 tx=0x7f5690005880 comp rx=0 tx=0).stop 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.531+0000 7f56a77fe700 1 -- 172.21.15.59:0/3322874255 reap_dead start 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.531+0000 7f56ad7aa700 1 -- 172.21.15.59:0/3322874255 shutdown_connections 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.531+0000 7f56ad7aa700 1 -- 172.21.15.59:0/3322874255 >> 172.21.15.59:0/3322874255 conn(0x7f56a80a3050 msgr2=0x7f56a80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.531+0000 7f56ad7aa700 1 -- 172.21.15.59:0/3322874255 shutdown_connections 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.531+0000 7f56ad7aa700 1 -- 172.21.15.59:0/3322874255 wait complete. 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.532+0000 7f56ad7aa700 1 Processor -- start 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.532+0000 7f56ad7aa700 1 -- start start 2023-09-30T22:28:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56ad7aa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a80a0a30 0x7f56a8121650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56ad7aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a8121b90 0x7f56a81c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56ad7aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a81c8620 0x7f56a81c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56ad7aa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a8122fc0 con 0x7f56a80a0a30 2023-09-30T22:28:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56ad7aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a80a0410 con 0x7f56a81c8620 2023-09-30T22:28:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56ad7aa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56a8121fa0 con 0x7f56a8121b90 2023-09-30T22:28:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56a67fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a8121b90 0x7f56a81c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56a77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a81c8620 0x7f56a81c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56a6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a80a0a30 0x7f56a8121650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56a77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a81c8620 0x7f56a81c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44482/0 (socket says 172.21.15.59:44482) 2023-09-30T22:28:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56a67fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a8121b90 0x7f56a81c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55090/0 (socket says 172.21.15.59:55090) 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56a6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a80a0a30 0x7f56a8121650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38768/0 (socket says 172.21.15.59:38768) 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56a77fe700 1 -- 172.21.15.59:0/4285501488 learned_addr learned my addr 172.21.15.59:0/4285501488 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56a67fc700 1 -- 172.21.15.59:0/4285501488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a81c8620 msgr2=0x7f56a81c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56a67fc700 1 --2- 172.21.15.59:0/4285501488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a81c8620 0x7f56a81c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56a67fc700 1 -- 172.21.15.59:0/4285501488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a80a0a30 msgr2=0x7f56a8121650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56a67fc700 1 --2- 172.21.15.59:0/4285501488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a80a0a30 0x7f56a8121650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56a67fc700 1 -- 172.21.15.59:0/4285501488 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a81234f0 con 0x7f56a8121b90 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56a77fe700 1 --2- 172.21.15.59:0/4285501488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a81c8620 0x7f56a81c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56a6ffd700 1 --2- 172.21.15.59:0/4285501488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a80a0a30 0x7f56a8121650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.533+0000 7f56a67fc700 1 --2- 172.21.15.59:0/4285501488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a8121b90 0x7f56a81c80e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f569c011000 tx=0x7f56a809e5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.534+0000 7f568f7fe700 1 -- 172.21.15.59:0/4285501488 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c001680 con 0x7f56a8121b90 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.534+0000 7f568f7fe700 1 -- 172.21.15.59:0/4285501488 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c001b30 con 0x7f56a8121b90 2023-09-30T22:28:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.534+0000 7f568f7fe700 1 -- 172.21.15.59:0/4285501488 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c004cc0 con 0x7f56a8121b90 2023-09-30T22:28:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.534+0000 7f56ad7aa700 1 -- 172.21.15.59:0/4285501488 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a8124060 con 0x7f56a8121b90 2023-09-30T22:28:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.534+0000 7f56ad7aa700 1 -- 172.21.15.59:0/4285501488 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a81212a0 con 0x7f56a8121b90 2023-09-30T22:28:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.535+0000 7f56ad7aa700 1 -- 172.21.15.59:0/4285501488 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a80747f0 con 0x7f56a8121b90 2023-09-30T22:28:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.535+0000 7f568f7fe700 1 -- 172.21.15.59:0/4285501488 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f569c019070 con 0x7f56a8121b90 2023-09-30T22:28:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.535+0000 7f568f7fe700 1 -- 172.21.15.59:0/4285501488 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f569c03c680 con 0x7f56a8121b90 2023-09-30T22:28:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.535+0000 7f56a6ffd700 1 -- 172.21.15.59:0/4285501488 >> v1:172.21.15.59:6816/118188 conn(0x7f569402c1b0 legacy=0x7f569402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.540+0000 7f568f7fe700 1 -- 172.21.15.59:0/4285501488 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f569c007cd0 con 0x7f56a8121b90 2023-09-30T22:28:53.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.736+0000 7f56a6ffd700 1 -- 172.21.15.59:0/4285501488 >> v1:172.21.15.59:6816/118188 conn(0x7f569402c1b0 legacy=0x7f569402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:53.762 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:53.761+0000 7fc05e06b240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T22:28:53.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.769+0000 7f56ad7aa700 1 -- 172.21.15.59:0/4285501488 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f56a8123c80 con 0x7f56a8121b90 2023-09-30T22:28:53.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.770+0000 7f568f7fe700 1 -- 172.21.15.59:0/4285501488 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+64282 (secure 0 0 0) 0x7f569c022070 con 0x7f56a8121b90 2023-09-30T22:28:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:28:53.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.773+0000 7f56ad7aa700 1 -- 172.21.15.59:0/4285501488 >> v1:172.21.15.59:6816/118188 conn(0x7f569402c1b0 legacy=0x7f569402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:53.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.773+0000 7f56ad7aa700 1 -- 172.21.15.59:0/4285501488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a8121b90 msgr2=0x7f56a81c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.773+0000 7f56ad7aa700 1 --2- 172.21.15.59:0/4285501488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a8121b90 0x7f56a81c80e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f569c011000 tx=0x7f56a809e5d0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.773+0000 7f56ad7aa700 1 -- 172.21.15.59:0/4285501488 shutdown_connections 2023-09-30T22:28:53.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.773+0000 7f56ad7aa700 1 --2- 172.21.15.59:0/4285501488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a81c8620 0x7f56a81c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.773+0000 7f56ad7aa700 1 --2- 172.21.15.59:0/4285501488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a80a0a30 0x7f56a8121650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.773+0000 7f56ad7aa700 1 --2- 172.21.15.59:0/4285501488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a8121b90 0x7f56a81c80e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.773+0000 7f56ad7aa700 1 -- 172.21.15.59:0/4285501488 >> 172.21.15.59:0/4285501488 conn(0x7f56a80a3050 msgr2=0x7f56a8137d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.773+0000 7f56ad7aa700 1 -- 172.21.15.59:0/4285501488 shutdown_connections 2023-09-30T22:28:53.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.773+0000 7f56ad7aa700 1 -- 172.21.15.59:0/4285501488 wait complete. 2023-09-30T22:28:53.788 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6816","nonce":118188}]},"active_addr":"172.21.15.59:6816/118188","active_change":"2023-09-30T22:26:23.716187+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":3882222550}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":1346763106}]}]} 2023-09-30T22:28:53.791 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T22:28:53.792 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:28:53.792 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:28:53.949 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:53.948+0000 7fc05e06b240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T22:28:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.967+0000 7fd140320700 1 Processor -- start 2023-09-30T22:28:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.967+0000 7fd140320700 1 -- start start 2023-09-30T22:28:53.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.968+0000 7fd140320700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1380a1510 0x7fd138138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.968+0000 7fd140320700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd138139250 0x7fd13813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.968+0000 7fd140320700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13809edd0 con 0x7fd1380a0a30 2023-09-30T22:28:53.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.968+0000 7fd140320700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380a18e0 con 0x7fd138139250 2023-09-30T22:28:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.968+0000 7fd140320700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd13809e1f0 con 0x7fd1380a1510 2023-09-30T22:28:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.968+0000 7fd13d8bb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1380a1510 0x7fd138138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.968+0000 7fd13e0bc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd1380a0a30 0x7fd1380a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45204/0 (socket says 172.21.15.59:45204) 2023-09-30T22:28:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.968+0000 7fd13e0bc700 1 -- 172.21.15.59:0/4252147704 learned_addr learned my addr 172.21.15.59:0/4252147704 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:28:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.968+0000 7fd13e8bd700 1 --2- 172.21.15.59:0/4252147704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd138139250 0x7fd13813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.968+0000 7fd13d0ba700 1 -- 172.21.15.59:0/4252147704 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961113845 0 0) 0x7fd13809edd0 con 0x7fd1380a0a30 2023-09-30T22:28:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.969+0000 7fd13d0ba700 1 -- 172.21.15.59:0/4252147704 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1240035b0 con 0x7fd1380a0a30 2023-09-30T22:28:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.969+0000 7fd13d8bb700 1 -- 172.21.15.59:0/4252147704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd138139250 msgr2=0x7fd13813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.969+0000 7fd13d8bb700 1 --2- 172.21.15.59:0/4252147704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd138139250 0x7fd13813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.969+0000 7fd13d8bb700 1 -- 172.21.15.59:0/4252147704 >> v1:172.21.15.59:6789/0 conn(0x7fd1380a0a30 legacy=0x7fd1380a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.969+0000 7fd13d8bb700 1 -- 172.21.15.59:0/4252147704 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13809dc50 con 0x7fd1380a1510 2023-09-30T22:28:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.969+0000 7fd13e8bd700 1 --2- 172.21.15.59:0/4252147704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd138139250 0x7fd13813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.969+0000 7fd13d8bb700 1 --2- 172.21.15.59:0/4252147704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1380a1510 0x7fd138138d10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd128009870 tx=0x7fd128009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a46e96f69f3a7c9c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.969+0000 7fd13d0ba700 1 -- 172.21.15.59:0/4252147704 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128004230 con 0x7fd1380a1510 2023-09-30T22:28:53.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.969+0000 7fd13d0ba700 1 -- 172.21.15.59:0/4252147704 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd128004390 con 0x7fd1380a1510 2023-09-30T22:28:53.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.969+0000 7fd13d0ba700 1 -- 172.21.15.59:0/4252147704 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1280036a0 con 0x7fd1380a1510 2023-09-30T22:28:53.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.970+0000 7fd140320700 1 -- 172.21.15.59:0/4252147704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1380a1510 msgr2=0x7fd138138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.970+0000 7fd140320700 1 --2- 172.21.15.59:0/4252147704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1380a1510 0x7fd138138d10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd128009870 tx=0x7fd128009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.970+0000 7fd140320700 1 -- 172.21.15.59:0/4252147704 shutdown_connections 2023-09-30T22:28:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.970+0000 7fd140320700 1 --2- 172.21.15.59:0/4252147704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd138139250 0x7fd13813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.970+0000 7fd140320700 1 --2- 172.21.15.59:0/4252147704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1380a1510 0x7fd138138d10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.970+0000 7fd140320700 1 -- 172.21.15.59:0/4252147704 >> 172.21.15.59:0/4252147704 conn(0x7fd1380a6550 msgr2=0x7fd1380a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.970+0000 7fd140320700 1 -- 172.21.15.59:0/4252147704 shutdown_connections 2023-09-30T22:28:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.970+0000 7fd140320700 1 -- 172.21.15.59:0/4252147704 wait complete. 2023-09-30T22:28:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.971+0000 7fd140320700 1 Processor -- start 2023-09-30T22:28:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.971+0000 7fd140320700 1 -- start start 2023-09-30T22:28:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.971+0000 7fd140320700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1380a0a30 0x7fd1381217d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.971+0000 7fd140320700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1380a1510 0x7fd138121d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd140320700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd138139250 0x7fd138122250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd140320700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380a02b0 con 0x7fd1380a0a30 2023-09-30T22:28:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd140320700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd138124f80 con 0x7fd1380a1510 2023-09-30T22:28:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd140320700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1381249d0 con 0x7fd138139250 2023-09-30T22:28:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd13d8bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1380a1510 0x7fd138121d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd13e0bc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1380a0a30 0x7fd1381217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd13d8bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1380a1510 0x7fd138121d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44512/0 (socket says 172.21.15.59:44512) 2023-09-30T22:28:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd13d8bb700 1 -- 172.21.15.59:0/1267299330 learned_addr learned my addr 172.21.15.59:0/1267299330 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd13e8bd700 1 --2- 172.21.15.59:0/1267299330 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd138139250 0x7fd138122250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd13e8bd700 1 -- 172.21.15.59:0/1267299330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1380a1510 msgr2=0x7fd138121d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd13e8bd700 1 --2- 172.21.15.59:0/1267299330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1380a1510 0x7fd138121d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd13e8bd700 1 -- 172.21.15.59:0/1267299330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1380a0a30 msgr2=0x7fd1381217d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd13e8bd700 1 --2- 172.21.15.59:0/1267299330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1380a0a30 0x7fd1381217d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd13e8bd700 1 -- 172.21.15.59:0/1267299330 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd130009a70 con 0x7fd138139250 2023-09-30T22:28:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd13e0bc700 1 --2- 172.21.15.59:0/1267299330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1380a0a30 0x7fd1381217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd13d8bb700 1 --2- 172.21.15.59:0/1267299330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1380a1510 0x7fd138121d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd13e8bd700 1 --2- 172.21.15.59:0/1267299330 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd138139250 0x7fd138122250 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd130009e50 tx=0x7fd13000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd12effd700 1 -- 172.21.15.59:0/1267299330 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13000ca90 con 0x7fd138139250 2023-09-30T22:28:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd12effd700 1 -- 172.21.15.59:0/1267299330 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13000f040 con 0x7fd138139250 2023-09-30T22:28:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd140320700 1 -- 172.21.15.59:0/1267299330 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1280094a0 con 0x7fd138139250 2023-09-30T22:28:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.972+0000 7fd12effd700 1 -- 172.21.15.59:0/1267299330 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13000ce50 con 0x7fd138139250 2023-09-30T22:28:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.973+0000 7fd140320700 1 -- 172.21.15.59:0/1267299330 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd138123460 con 0x7fd138139250 2023-09-30T22:28:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.973+0000 7fd12effd700 1 -- 172.21.15.59:0/1267299330 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fd130014480 con 0x7fd138139250 2023-09-30T22:28:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.974+0000 7fd12effd700 1 -- 172.21.15.59:0/1267299330 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fd13003bdc0 con 0x7fd138139250 2023-09-30T22:28:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.974+0000 7fd13e0bc700 1 -- 172.21.15.59:0/1267299330 >> v1:172.21.15.59:6816/118188 conn(0x7fd11c02c1b0 legacy=0x7fd11c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.974+0000 7fd140320700 1 -- 172.21.15.59:0/1267299330 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd138074ea0 con 0x7fd138139250 2023-09-30T22:28:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:53.982+0000 7fd12effd700 1 -- 172.21.15.59:0/1267299330 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fd130012930 con 0x7fd138139250 2023-09-30T22:28:54.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.166+0000 7fd140320700 1 -- 172.21.15.59:0/1267299330 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd138124c20 con 0x7fd138139250 2023-09-30T22:28:54.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.167+0000 7fd12effd700 1 -- 172.21.15.59:0/1267299330 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+12743 (secure 0 0 0) 0x7fd138124c20 con 0x7fd138139250 2023-09-30T22:28:54.168 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:28:54.168 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":21,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:27:24.975640+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:28:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.169+0000 7fd140320700 1 -- 172.21.15.59:0/1267299330 >> v1:172.21.15.59:6816/118188 conn(0x7fd11c02c1b0 legacy=0x7fd11c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.169+0000 7fd140320700 1 -- 172.21.15.59:0/1267299330 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd138139250 msgr2=0x7fd138122250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.169+0000 7fd140320700 1 --2- 172.21.15.59:0/1267299330 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd138139250 0x7fd138122250 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd130009e50 tx=0x7fd13000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.169+0000 7fd140320700 1 -- 172.21.15.59:0/1267299330 shutdown_connections 2023-09-30T22:28:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.169+0000 7fd140320700 1 --2- 172.21.15.59:0/1267299330 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd138139250 0x7fd138122250 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.169+0000 7fd140320700 1 --2- 172.21.15.59:0/1267299330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1380a0a30 0x7fd1381217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.169+0000 7fd140320700 1 --2- 172.21.15.59:0/1267299330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1380a1510 0x7fd138121d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.169+0000 7fd140320700 1 -- 172.21.15.59:0/1267299330 >> 172.21.15.59:0/1267299330 conn(0x7fd1380a6550 msgr2=0x7fd138137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.169+0000 7fd140320700 1 -- 172.21.15.59:0/1267299330 shutdown_connections 2023-09-30T22:28:54.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.169+0000 7fd140320700 1 -- 172.21.15.59:0/1267299330 wait complete. 2023-09-30T22:28:54.185 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:28:54.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:28:54.242 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:54.241+0000 7fc05e06b240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T22:28:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.322+0000 7f7d4a024700 1 Processor -- start 2023-09-30T22:28:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.322+0000 7f7d4a024700 1 -- start start 2023-09-30T22:28:54.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.323+0000 7f7d4a024700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d440a1510 0x7f7d44138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.323+0000 7f7d4a024700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d44139250 0x7f7d4413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.323+0000 7f7d4a024700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4409edd0 con 0x7f7d440a0a30 2023-09-30T22:28:54.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.323+0000 7f7d4a024700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d440a18e0 con 0x7f7d44139250 2023-09-30T22:28:54.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.323+0000 7f7d4a024700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4409e1f0 con 0x7f7d440a1510 2023-09-30T22:28:54.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.323+0000 7f7d437fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7d440a0a30 0x7f7d440a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45218/0 (socket says 172.21.15.59:45218) 2023-09-30T22:28:54.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.323+0000 7f7d437fe700 1 -- 172.21.15.59:0/4246175527 learned_addr learned my addr 172.21.15.59:0/4246175527 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:28:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.323+0000 7f7d42ffd700 1 --2- 172.21.15.59:0/4246175527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d440a1510 0x7f7d44138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.323+0000 7f7d43fff700 1 --2- 172.21.15.59:0/4246175527 >> v2:172.21.15.59:3300/0 conn(0x7f7d44139250 0x7f7d4413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.324+0000 7f7d427fc700 1 -- 172.21.15.59:0/4246175527 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246078533 0 0) 0x7f7d4409edd0 con 0x7f7d440a0a30 2023-09-30T22:28:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.324+0000 7f7d427fc700 1 -- 172.21.15.59:0/4246175527 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d2c0035b0 con 0x7f7d440a0a30 2023-09-30T22:28:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.324+0000 7f7d42ffd700 1 -- 172.21.15.59:0/4246175527 >> v2:172.21.15.59:3300/0 conn(0x7f7d44139250 msgr2=0x7f7d4413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.324+0000 7f7d42ffd700 1 --2- 172.21.15.59:0/4246175527 >> v2:172.21.15.59:3300/0 conn(0x7f7d44139250 0x7f7d4413b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.324+0000 7f7d42ffd700 1 -- 172.21.15.59:0/4246175527 >> v1:172.21.15.59:6789/0 conn(0x7f7d440a0a30 legacy=0x7f7d440a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.324+0000 7f7d42ffd700 1 -- 172.21.15.59:0/4246175527 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4409dc50 con 0x7f7d440a1510 2023-09-30T22:28:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.324+0000 7f7d42ffd700 1 --2- 172.21.15.59:0/4246175527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d440a1510 0x7f7d44138d10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009870 tx=0x7f7d38009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5e9aede8a0b1f31 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.324+0000 7f7d427fc700 1 -- 172.21.15.59:0/4246175527 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38011830 con 0x7f7d440a1510 2023-09-30T22:28:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.324+0000 7f7d427fc700 1 -- 172.21.15.59:0/4246175527 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d38011990 con 0x7f7d440a1510 2023-09-30T22:28:54.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.324+0000 7f7d427fc700 1 -- 172.21.15.59:0/4246175527 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38011d20 con 0x7f7d440a1510 2023-09-30T22:28:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.325+0000 7f7d4a024700 1 -- 172.21.15.59:0/4246175527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d440a1510 msgr2=0x7f7d44138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.325+0000 7f7d4a024700 1 --2- 172.21.15.59:0/4246175527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d440a1510 0x7f7d44138d10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009870 tx=0x7f7d38009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.325+0000 7f7d4a024700 1 -- 172.21.15.59:0/4246175527 shutdown_connections 2023-09-30T22:28:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.325+0000 7f7d4a024700 1 --2- 172.21.15.59:0/4246175527 >> v2:172.21.15.59:3300/0 conn(0x7f7d44139250 0x7f7d4413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.325+0000 7f7d4a024700 1 --2- 172.21.15.59:0/4246175527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d440a1510 0x7f7d44138d10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.325+0000 7f7d4a024700 1 -- 172.21.15.59:0/4246175527 >> 172.21.15.59:0/4246175527 conn(0x7f7d440a6550 msgr2=0x7f7d440a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.325+0000 7f7d4a024700 1 -- 172.21.15.59:0/4246175527 shutdown_connections 2023-09-30T22:28:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.325+0000 7f7d4a024700 1 -- 172.21.15.59:0/4246175527 wait complete. 2023-09-30T22:28:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.327+0000 7f7d4a024700 1 Processor -- start 2023-09-30T22:28:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.327+0000 7f7d4a024700 1 -- start start 2023-09-30T22:28:54.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d4a024700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d440a0a30 0x7f7d4411e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d4a024700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d440a1510 0x7f7d4411eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d4a024700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d44139250 0x7f7d4411f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d4a024700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d44120270 con 0x7f7d44139250 2023-09-30T22:28:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d4a024700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d44134550 con 0x7f7d440a1510 2023-09-30T22:28:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d4a024700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d44121ea0 con 0x7f7d440a0a30 2023-09-30T22:28:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d42ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d440a1510 0x7f7d4411eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d43fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d44139250 0x7f7d4411f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d42ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d440a1510 0x7f7d4411eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44540/0 (socket says 172.21.15.59:44540) 2023-09-30T22:28:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d42ffd700 1 -- 172.21.15.59:0/1855085432 learned_addr learned my addr 172.21.15.59:0/1855085432 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d437fe700 1 --2- 172.21.15.59:0/1855085432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d440a0a30 0x7f7d4411e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d42ffd700 1 -- 172.21.15.59:0/1855085432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d440a0a30 msgr2=0x7f7d4411e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d42ffd700 1 --2- 172.21.15.59:0/1855085432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d440a0a30 0x7f7d4411e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d42ffd700 1 -- 172.21.15.59:0/1855085432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d44139250 msgr2=0x7f7d4411f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d42ffd700 1 --2- 172.21.15.59:0/1855085432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d44139250 0x7f7d4411f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d42ffd700 1 -- 172.21.15.59:0/1855085432 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d380094a0 con 0x7f7d440a1510 2023-09-30T22:28:54.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d43fff700 1 --2- 172.21.15.59:0/1855085432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d44139250 0x7f7d4411f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:54.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.328+0000 7f7d42ffd700 1 --2- 172.21.15.59:0/1855085432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d440a1510 0x7f7d4411eba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7d38000c00 tx=0x7f7d38004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.329+0000 7f7d2bfff700 1 -- 172.21.15.59:0/1855085432 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d380036a0 con 0x7f7d440a1510 2023-09-30T22:28:54.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.329+0000 7f7d2bfff700 1 -- 172.21.15.59:0/1855085432 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3801f070 con 0x7f7d440a1510 2023-09-30T22:28:54.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.329+0000 7f7d4a024700 1 -- 172.21.15.59:0/1855085432 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d440a5040 con 0x7f7d440a1510 2023-09-30T22:28:54.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.329+0000 7f7d2bfff700 1 -- 172.21.15.59:0/1855085432 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38003a60 con 0x7f7d440a1510 2023-09-30T22:28:54.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.329+0000 7f7d4a024700 1 -- 172.21.15.59:0/1855085432 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d44121910 con 0x7f7d440a1510 2023-09-30T22:28:54.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.329+0000 7f7d2bfff700 1 -- 172.21.15.59:0/1855085432 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f7d38003bc0 con 0x7f7d440a1510 2023-09-30T22:28:54.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.330+0000 7f7d2bfff700 1 -- 172.21.15.59:0/1855085432 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f7d38021070 con 0x7f7d440a1510 2023-09-30T22:28:54.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.330+0000 7f7d437fe700 1 -- 172.21.15.59:0/1855085432 >> v1:172.21.15.59:6816/118188 conn(0x7f7d3002c1e0 legacy=0x7f7d3002e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:54.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.330+0000 7f7d4a024700 1 -- 172.21.15.59:0/1855085432 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d44120ad0 con 0x7f7d440a1510 2023-09-30T22:28:54.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.335+0000 7f7d2bfff700 1 -- 172.21.15.59:0/1855085432 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f7d3802b080 con 0x7f7d440a1510 2023-09-30T22:28:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.520+0000 7f7d4a024700 1 -- 172.21.15.59:0/1855085432 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d44074ea0 con 0x7f7d440a1510 2023-09-30T22:28:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.523+0000 7f7d2bfff700 1 -- 172.21.15.59:0/1855085432 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+12743 (secure 0 0 0) 0x7f7d38015020 con 0x7f7d440a1510 2023-09-30T22:28:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:28:54.524 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":21,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:27:24.975640+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:28:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.525+0000 7f7d4a024700 1 -- 172.21.15.59:0/1855085432 >> v1:172.21.15.59:6816/118188 conn(0x7f7d3002c1e0 legacy=0x7f7d3002e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.525+0000 7f7d4a024700 1 -- 172.21.15.59:0/1855085432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d440a1510 msgr2=0x7f7d4411eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.525+0000 7f7d4a024700 1 --2- 172.21.15.59:0/1855085432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d440a1510 0x7f7d4411eba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7d38000c00 tx=0x7f7d38004750 comp rx=0 tx=0).stop 2023-09-30T22:28:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.525+0000 7f7d4a024700 1 -- 172.21.15.59:0/1855085432 shutdown_connections 2023-09-30T22:28:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.525+0000 7f7d4a024700 1 --2- 172.21.15.59:0/1855085432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d440a0a30 0x7f7d4411e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.525+0000 7f7d4a024700 1 --2- 172.21.15.59:0/1855085432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d44139250 0x7f7d4411f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.525+0000 7f7d4a024700 1 --2- 172.21.15.59:0/1855085432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d440a1510 0x7f7d4411eba0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.525+0000 7f7d4a024700 1 -- 172.21.15.59:0/1855085432 >> 172.21.15.59:0/1855085432 conn(0x7f7d440a6550 msgr2=0x7f7d440a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.525+0000 7f7d4a024700 1 -- 172.21.15.59:0/1855085432 shutdown_connections 2023-09-30T22:28:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.525+0000 7f7d4a024700 1 -- 172.21.15.59:0/1855085432 wait complete. 2023-09-30T22:28:54.542 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T22:28:54.543 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T22:28:54.543 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T22:28:54.544 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T22:28:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.699+0000 7f89950c9700 1 Processor -- start 2023-09-30T22:28:54.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.699+0000 7f89950c9700 1 -- start start 2023-09-30T22:28:54.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.700+0000 7f89950c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f899009e1d0 0x7f8990135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.700+0000 7f89950c9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8990135e50 0x7f8990138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.700+0000 7f89950c9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899009f130 con 0x7f899009d6f0 2023-09-30T22:28:54.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.700+0000 7f89950c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899009f520 con 0x7f899009e1d0 2023-09-30T22:28:54.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.700+0000 7f89950c9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f899009e930 con 0x7f8990135e50 2023-09-30T22:28:54.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.700+0000 7f898e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f899009e1d0 0x7f8990135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.700+0000 7f898e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f899009e1d0 0x7f8990135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36448/0 (socket says 172.21.15.59:36448) 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.700+0000 7f898e59c700 1 -- 172.21.15.59:0/2699999952 learned_addr learned my addr 172.21.15.59:0/2699999952 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.700+0000 7f898e59c700 1 -- 172.21.15.59:0/2699999952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8990135e50 msgr2=0x7f8990138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.700+0000 7f898e59c700 1 --2- 172.21.15.59:0/2699999952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8990135e50 0x7f8990138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.700+0000 7f898e59c700 1 -- 172.21.15.59:0/2699999952 >> v1:172.21.15.59:6789/0 conn(0x7f899009d6f0 legacy=0x7f899009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.700+0000 7f898e59c700 1 -- 172.21.15.59:0/2699999952 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899009b2d0 con 0x7f899009e1d0 2023-09-30T22:28:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.700+0000 7f898e59c700 1 --2- 172.21.15.59:0/2699999952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f899009e1d0 0x7f8990135910 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f898400bbc0 tx=0x7f898400bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a49d66d42120eb53 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.701+0000 7f898dd9b700 1 -- 172.21.15.59:0/2699999952 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898400dd50 con 0x7f899009e1d0 2023-09-30T22:28:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.701+0000 7f898dd9b700 1 -- 172.21.15.59:0/2699999952 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8984004030 con 0x7f899009e1d0 2023-09-30T22:28:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.701+0000 7f898dd9b700 1 -- 172.21.15.59:0/2699999952 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89840043c0 con 0x7f899009e1d0 2023-09-30T22:28:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.702+0000 7f89950c9700 1 -- 172.21.15.59:0/2699999952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f899009e1d0 msgr2=0x7f8990135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.702+0000 7f89950c9700 1 --2- 172.21.15.59:0/2699999952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f899009e1d0 0x7f8990135910 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f898400bbc0 tx=0x7f898400bed0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.702+0000 7f89950c9700 1 -- 172.21.15.59:0/2699999952 shutdown_connections 2023-09-30T22:28:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.702+0000 7f89950c9700 1 --2- 172.21.15.59:0/2699999952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8990135e50 0x7f8990138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.702+0000 7f89950c9700 1 --2- 172.21.15.59:0/2699999952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f899009e1d0 0x7f8990135910 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.702+0000 7f89950c9700 1 -- 172.21.15.59:0/2699999952 >> 172.21.15.59:0/2699999952 conn(0x7f8990066f50 msgr2=0x7f899009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.702+0000 7f89950c9700 1 -- 172.21.15.59:0/2699999952 shutdown_connections 2023-09-30T22:28:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.702+0000 7f89950c9700 1 -- 172.21.15.59:0/2699999952 wait complete. 2023-09-30T22:28:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.703+0000 7f89950c9700 1 Processor -- start 2023-09-30T22:28:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.704+0000 7f89950c9700 1 -- start start 2023-09-30T22:28:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.704+0000 7f89950c9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899009d6f0 0x7f89901c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.704+0000 7f89950c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f899009e1d0 0x7f89901c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.704+0000 7f89950c9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8990135e50 0x7f8990119550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.704+0000 7f89950c9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899011cdf0 con 0x7f899009d6f0 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.704+0000 7f89950c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89901c4e50 con 0x7f899009e1d0 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.704+0000 7f89950c9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f899011b070 con 0x7f8990135e50 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.705+0000 7f898f59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8990135e50 0x7f8990119550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.705+0000 7f898ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899009d6f0 0x7f89901c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.705+0000 7f898f59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8990135e50 0x7f8990119550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39586/0 (socket says 172.21.15.59:39586) 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.705+0000 7f898f59e700 1 -- 172.21.15.59:0/2890246075 learned_addr learned my addr 172.21.15.59:0/2890246075 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.705+0000 7f898e59c700 1 --2- 172.21.15.59:0/2890246075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f899009e1d0 0x7f89901c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.705+0000 7f898f59e700 1 -- 172.21.15.59:0/2890246075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f899009e1d0 msgr2=0x7f89901c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.705+0000 7f898f59e700 1 --2- 172.21.15.59:0/2890246075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f899009e1d0 0x7f89901c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.705+0000 7f898f59e700 1 -- 172.21.15.59:0/2890246075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899009d6f0 msgr2=0x7f89901c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.705+0000 7f898f59e700 1 --2- 172.21.15.59:0/2890246075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899009d6f0 0x7f89901c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.705+0000 7f898f59e700 1 -- 172.21.15.59:0/2890246075 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898400b7f0 con 0x7f8990135e50 2023-09-30T22:28:54.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.705+0000 7f898ed9d700 1 --2- 172.21.15.59:0/2890246075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f899009d6f0 0x7f89901c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:54.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.705+0000 7f898f59e700 1 --2- 172.21.15.59:0/2890246075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8990135e50 0x7f8990119550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f89880139c0 tx=0x7f8988013cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.706+0000 7f89777fe700 1 -- 172.21.15.59:0/2890246075 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898800f1c0 con 0x7f8990135e50 2023-09-30T22:28:54.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.706+0000 7f89777fe700 1 -- 172.21.15.59:0/2890246075 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898800f340 con 0x7f8990135e50 2023-09-30T22:28:54.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.706+0000 7f89950c9700 1 -- 172.21.15.59:0/2890246075 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89900a1d00 con 0x7f8990135e50 2023-09-30T22:28:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.706+0000 7f89777fe700 1 -- 172.21.15.59:0/2890246075 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898800f6f0 con 0x7f8990135e50 2023-09-30T22:28:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.706+0000 7fcb46c87700 1 Processor -- start 2023-09-30T22:28:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.706+0000 7fcb46c87700 1 -- start start 2023-09-30T22:28:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.706+0000 7f89950c9700 1 -- 172.21.15.59:0/2890246075 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899011b860 con 0x7f8990135e50 2023-09-30T22:28:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.707+0000 7fcb46c87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb4009e1d0 0x7fcb40135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.707+0000 7fcb46c87700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb40135e50 0x7fcb40138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.707+0000 7fcb46c87700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4009f130 con 0x7fcb4009d6f0 2023-09-30T22:28:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.707+0000 7fcb46c87700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4009f520 con 0x7fcb40135e50 2023-09-30T22:28:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.707+0000 7fcb46c87700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4009e930 con 0x7fcb4009e1d0 2023-09-30T22:28:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.707+0000 7f89777fe700 1 -- 172.21.15.59:0/2890246075 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f89880110d0 con 0x7f8990135e50 2023-09-30T22:28:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.707+0000 7f89950c9700 1 -- 172.21.15.59:0/2890246075 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f899009c000 con 0x7f8990135e50 2023-09-30T22:28:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.707+0000 7fcb45224700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb40135e50 0x7fcb40138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.707+0000 7fcb45224700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb40135e50 0x7fcb40138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56056/0 (socket says 172.21.15.59:56056) 2023-09-30T22:28:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.708+0000 7fcb45224700 1 -- 172.21.15.59:0/1499045913 learned_addr learned my addr 172.21.15.59:0/1499045913 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.708+0000 7f898ed9d700 1 -- 172.21.15.59:0/2890246075 >> v1:172.21.15.59:6816/118188 conn(0x7f897c02c200 legacy=0x7f897c02e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.708+0000 7fcb37fff700 1 --2- 172.21.15.59:0/1499045913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb4009e1d0 0x7fcb40135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.708+0000 7f89777fe700 1 -- 172.21.15.59:0/2890246075 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f8988006e40 con 0x7f8990135e50 2023-09-30T22:28:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.708+0000 7f89777fe700 1 -- 172.21.15.59:0/2890246075 --> v1:172.21.15.59:6812/118803 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f897c038e60 con 0x7f897c035160 2023-09-30T22:28:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.708+0000 7f89777fe700 1 -- 172.21.15.59:0/2890246075 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8988011380 con 0x7f8990135e50 2023-09-30T22:28:54.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.708+0000 7fcb37fff700 1 -- 172.21.15.59:0/1499045913 >> v2:172.21.15.59:3300/0 conn(0x7fcb40135e50 msgr2=0x7fcb40138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.708+0000 7fcb37fff700 1 --2- 172.21.15.59:0/1499045913 >> v2:172.21.15.59:3300/0 conn(0x7fcb40135e50 0x7fcb40138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.708+0000 7fcb37fff700 1 -- 172.21.15.59:0/1499045913 >> v1:172.21.15.59:6789/0 conn(0x7fcb4009d6f0 legacy=0x7fcb4009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.708+0000 7fcb37fff700 1 -- 172.21.15.59:0/1499045913 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4009b2d0 con 0x7fcb4009e1d0 2023-09-30T22:28:54.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.708+0000 7fcb37fff700 1 --2- 172.21.15.59:0/1499045913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb4009e1d0 0x7fcb40135910 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcb30009870 tx=0x7fcb30009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b8dae117709b0a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.709+0000 7fcb377fe700 1 -- 172.21.15.59:0/1499045913 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30004230 con 0x7fcb4009e1d0 2023-09-30T22:28:54.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.709+0000 7fcb377fe700 1 -- 172.21.15.59:0/1499045913 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb30004390 con 0x7fcb4009e1d0 2023-09-30T22:28:54.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.709+0000 7fcb377fe700 1 -- 172.21.15.59:0/1499045913 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb300036a0 con 0x7fcb4009e1d0 2023-09-30T22:28:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.709+0000 7fcb46c87700 1 -- 172.21.15.59:0/1499045913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb4009e1d0 msgr2=0x7fcb40135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.709+0000 7fcb46c87700 1 --2- 172.21.15.59:0/1499045913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb4009e1d0 0x7fcb40135910 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcb30009870 tx=0x7fcb30009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.710+0000 7fcb46c87700 1 -- 172.21.15.59:0/1499045913 shutdown_connections 2023-09-30T22:28:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.710+0000 7fcb46c87700 1 --2- 172.21.15.59:0/1499045913 >> v2:172.21.15.59:3300/0 conn(0x7fcb40135e50 0x7fcb40138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.710+0000 7fcb46c87700 1 --2- 172.21.15.59:0/1499045913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb4009e1d0 0x7fcb40135910 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcb30009870 tx=0x7fcb30009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.710+0000 7fcb46c87700 1 -- 172.21.15.59:0/1499045913 >> 172.21.15.59:0/1499045913 conn(0x7fcb40066f50 msgr2=0x7fcb4009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.710+0000 7f9e61373700 1 Processor -- start 2023-09-30T22:28:54.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.710+0000 7f9e61373700 1 -- start start 2023-09-30T22:28:54.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.711+0000 7f9e61373700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e5c09e1d0 0x7f9e5c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.711+0000 7f9e61373700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e5c139170 0x7f9e5c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.711+0000 7f9e61373700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5c09b120 con 0x7f9e5c09d6f0 2023-09-30T22:28:54.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.711+0000 7f9e61373700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e5c06b460 con 0x7f9e5c139170 2023-09-30T22:28:54.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.711+0000 7f9e61373700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c09a7e0 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.711+0000 7f9e527fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e5c09e1d0 0x7f9e5c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.711+0000 7f9e5affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9e5c09d6f0 0x7f9e5c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56828/0 (socket says 172.21.15.59:56828) 2023-09-30T22:28:54.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.711+0000 7f9e5affd700 1 -- 172.21.15.59:0/3172497033 learned_addr learned my addr 172.21.15.59:0/3172497033 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:28:54.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.711+0000 7f9e5b7fe700 1 --2- 172.21.15.59:0/3172497033 >> v2:172.21.15.59:3300/0 conn(0x7f9e5c139170 0x7f9e5c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.711+0000 7fcb46c87700 1 -- 172.21.15.59:0/1499045913 shutdown_connections 2023-09-30T22:28:54.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.711+0000 7f9e527fc700 1 -- 172.21.15.59:0/3172497033 >> v2:172.21.15.59:3300/0 conn(0x7f9e5c139170 msgr2=0x7f9e5c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.711+0000 7f9e527fc700 1 --2- 172.21.15.59:0/3172497033 >> v2:172.21.15.59:3300/0 conn(0x7f9e5c139170 0x7f9e5c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.711+0000 7f9e527fc700 1 -- 172.21.15.59:0/3172497033 >> v1:172.21.15.59:6789/0 conn(0x7f9e5c09d6f0 legacy=0x7f9e5c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.711+0000 7f9e527fc700 1 -- 172.21.15.59:0/3172497033 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5c09a500 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.711+0000 7fcb46c87700 1 -- 172.21.15.59:0/1499045913 wait complete. 2023-09-30T22:28:54.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.712+0000 7f9e5b7fe700 1 --2- 172.21.15.59:0/3172497033 >> v2:172.21.15.59:3300/0 conn(0x7f9e5c139170 0x7f9e5c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:54.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.712+0000 7f9e527fc700 1 --2- 172.21.15.59:0/3172497033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e5c09e1d0 0x7f9e5c138c30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009870 tx=0x7f9e44009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28f69d5c89d07f8e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.712+0000 7f9e5a7fc700 1 -- 172.21.15.59:0/3172497033 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44011830 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.712+0000 7f9e5a7fc700 1 -- 172.21.15.59:0/3172497033 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e44011990 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.712+0000 7f9e5a7fc700 1 -- 172.21.15.59:0/3172497033 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44011d20 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.713+0000 7f9e61373700 1 -- 172.21.15.59:0/3172497033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e5c09e1d0 msgr2=0x7f9e5c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.713+0000 7f9e61373700 1 --2- 172.21.15.59:0/3172497033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e5c09e1d0 0x7f9e5c138c30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009870 tx=0x7f9e44009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:54.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.713+0000 7f9e61373700 1 -- 172.21.15.59:0/3172497033 shutdown_connections 2023-09-30T22:28:54.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.713+0000 7f9e61373700 1 --2- 172.21.15.59:0/3172497033 >> v2:172.21.15.59:3300/0 conn(0x7f9e5c139170 0x7f9e5c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.713+0000 7f9e61373700 1 --2- 172.21.15.59:0/3172497033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e5c09e1d0 0x7f9e5c138c30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.713+0000 7f9e61373700 1 -- 172.21.15.59:0/3172497033 >> 172.21.15.59:0/3172497033 conn(0x7f9e5c066f50 msgr2=0x7f9e5c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.713+0000 7f9e61373700 1 -- 172.21.15.59:0/3172497033 shutdown_connections 2023-09-30T22:28:54.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.713+0000 7f9e61373700 1 -- 172.21.15.59:0/3172497033 wait complete. 2023-09-30T22:28:54.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.713+0000 7fcb46c87700 1 Processor -- start 2023-09-30T22:28:54.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.713+0000 7fcb46c87700 1 -- start start 2023-09-30T22:28:54.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.714+0000 7f9e61373700 1 Processor -- start 2023-09-30T22:28:54.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.714+0000 7fcb46c87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb4009d6f0 0x7fcb4013da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.714+0000 7fcb46c87700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb40135e50 0x7fcb40138880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.714+0000 7fcb46c87700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb40138dc0 0x7fcb40139230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.714+0000 7fcb46c87700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb40137700 con 0x7fcb40138dc0 2023-09-30T22:28:54.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.714+0000 7fcb46c87700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb401374c0 con 0x7fcb4009d6f0 2023-09-30T22:28:54.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.714+0000 7fcb46c87700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb401365f0 con 0x7fcb40135e50 2023-09-30T22:28:54.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7f9e61373700 1 -- start start 2023-09-30T22:28:54.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7fcb44a23700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb4009d6f0 0x7fcb4013da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7fcb45224700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb40138dc0 0x7fcb40139230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7fcb44a23700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb4009d6f0 0x7fcb4013da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36482/0 (socket says 172.21.15.59:36482) 2023-09-30T22:28:54.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7fcb45224700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb40138dc0 0x7fcb40139230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56064/0 (socket says 172.21.15.59:56064) 2023-09-30T22:28:54.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7fcb44a23700 1 -- 172.21.15.59:0/2348578976 learned_addr learned my addr 172.21.15.59:0/2348578976 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:54.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7fcb37fff700 1 --2- 172.21.15.59:0/2348578976 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb40135e50 0x7fcb40138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7fcb44a23700 1 -- 172.21.15.59:0/2348578976 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb40135e50 msgr2=0x7fcb40138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7fcb44a23700 1 --2- 172.21.15.59:0/2348578976 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb40135e50 0x7fcb40138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7fcb44a23700 1 -- 172.21.15.59:0/2348578976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb40138dc0 msgr2=0x7fcb40139230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7fcb44a23700 1 --2- 172.21.15.59:0/2348578976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb40138dc0 0x7fcb40139230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7fcb44a23700 1 -- 172.21.15.59:0/2348578976 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb300094a0 con 0x7fcb4009d6f0 2023-09-30T22:28:54.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7f9e61373700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e5c09d6f0 0x7f9e5c1c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7f9e61373700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e5c09e1d0 0x7f9e5c1c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7f9e61373700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e5c139170 0x7f9e5c1218e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7f9e61373700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c125200 con 0x7f9e5c09d6f0 2023-09-30T22:28:54.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7f9e61373700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c124e60 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.715+0000 7f9e61373700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c1234f0 con 0x7f9e5c139170 2023-09-30T22:28:54.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7f9e5affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e5c09d6f0 0x7f9e5c1c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7f9e527fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e5c09e1d0 0x7f9e5c1c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7f9e5affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e5c09d6f0 0x7f9e5c1c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56072/0 (socket says 172.21.15.59:56072) 2023-09-30T22:28:54.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7f9e527fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e5c09e1d0 0x7f9e5c1c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36492/0 (socket says 172.21.15.59:36492) 2023-09-30T22:28:54.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7f9e5affd700 1 -- 172.21.15.59:0/1011665422 learned_addr learned my addr 172.21.15.59:0/1011665422 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:54.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7f9e5b7fe700 1 --2- 172.21.15.59:0/1011665422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e5c139170 0x7f9e5c1218e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7fcb44a23700 1 --2- 172.21.15.59:0/2348578976 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb4009d6f0 0x7fcb4013da50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00c780 tx=0x7fcb3c00ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7f9e527fc700 1 -- 172.21.15.59:0/1011665422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e5c139170 msgr2=0x7f9e5c1218e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7f9e527fc700 1 --2- 172.21.15.59:0/1011665422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e5c139170 0x7f9e5c1218e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7f9e527fc700 1 -- 172.21.15.59:0/1011665422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e5c09d6f0 msgr2=0x7f9e5c1c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7f9e527fc700 1 --2- 172.21.15.59:0/1011665422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e5c09d6f0 0x7f9e5c1c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7f9e527fc700 1 -- 172.21.15.59:0/1011665422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e440094a0 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7f9e527fc700 1 --2- 172.21.15.59:0/1011665422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e5c09e1d0 0x7f9e5c1c8aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9e44016000 tx=0x7f9e44004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7f9e53fff700 1 -- 172.21.15.59:0/1011665422 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44004510 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7f9e53fff700 1 -- 172.21.15.59:0/1011665422 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4401f070 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7f9e53fff700 1 -- 172.21.15.59:0/1011665422 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e440038e0 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.717+0000 7f9e61373700 1 -- 172.21.15.59:0/1011665422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5c09c710 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.717+0000 7f9e61373700 1 -- 172.21.15.59:0/1011665422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5c125b90 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.716+0000 7fcb357fa700 1 -- 172.21.15.59:0/2348578976 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0054e0 con 0x7fcb4009d6f0 2023-09-30T22:28:54.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.717+0000 7fcb357fa700 1 -- 172.21.15.59:0/2348578976 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c003680 con 0x7fcb4009d6f0 2023-09-30T22:28:54.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.717+0000 7fcb357fa700 1 -- 172.21.15.59:0/2348578976 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c003a30 con 0x7fcb4009d6f0 2023-09-30T22:28:54.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.717+0000 7fcb46c87700 1 -- 172.21.15.59:0/2348578976 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4013a610 con 0x7fcb4009d6f0 2023-09-30T22:28:54.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.717+0000 7fcb46c87700 1 -- 172.21.15.59:0/2348578976 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4009c760 con 0x7fcb4009d6f0 2023-09-30T22:28:54.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.718+0000 7f9e61373700 1 -- 172.21.15.59:0/1011665422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e5c06a9e0 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.718+0000 7fcb46c87700 1 -- 172.21.15.59:0/2348578976 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb4009c000 con 0x7fcb4009d6f0 2023-09-30T22:28:54.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.718+0000 7fcb357fa700 1 -- 172.21.15.59:0/2348578976 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fcb3c003b90 con 0x7fcb4009d6f0 2023-09-30T22:28:54.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.718+0000 7fcb357fa700 1 -- 172.21.15.59:0/2348578976 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fcb3c03b980 con 0x7fcb4009d6f0 2023-09-30T22:28:54.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.718+0000 7fcb37fff700 1 -- 172.21.15.59:0/2348578976 >> v1:172.21.15.59:6816/118188 conn(0x7fcb2c02c200 legacy=0x7fcb2c02e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:54.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.718+0000 7f9e53fff700 1 -- 172.21.15.59:0/1011665422 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f9e44003a40 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.718+0000 7fcb357fa700 1 -- 172.21.15.59:0/2348578976 --> v1:172.21.15.59:6808/118802 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb2c038f60 con 0x7fcb2c035260 2023-09-30T22:28:54.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.718+0000 7fcb357fa700 1 -- 172.21.15.59:0/2348578976 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb3c03bbf0 con 0x7fcb4009d6f0 2023-09-30T22:28:54.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.719+0000 7f9e53fff700 1 -- 172.21.15.59:0/1011665422 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f9e44021070 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.719+0000 7f9e53fff700 1 -- 172.21.15.59:0/1011665422 --> v1:172.21.15.59:6800/118786 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e3c038ee0 con 0x7f9e3c0351e0 2023-09-30T22:28:54.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.719+0000 7f9e53fff700 1 -- 172.21.15.59:0/1011665422 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e44003cf0 con 0x7f9e5c09e1d0 2023-09-30T22:28:54.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.719+0000 7f9e5affd700 1 -- 172.21.15.59:0/1011665422 >> v1:172.21.15.59:6816/118188 conn(0x7f9e3c02c200 legacy=0x7f9e3c02e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:54.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.720+0000 7fcb357fa700 1 -- 172.21.15.59:0/2348578976 <== osd.3 v1:172.21.15.59:6808/118802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fcb2c038f60 con 0x7fcb2c035260 2023-09-30T22:28:54.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.720+0000 7f89777fe700 1 -- 172.21.15.59:0/2890246075 <== osd.2 v1:172.21.15.59:6812/118803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f897c038e60 con 0x7f897c035160 2023-09-30T22:28:54.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.720+0000 7f9e53fff700 1 -- 172.21.15.59:0/1011665422 <== osd.1 v1:172.21.15.59:6800/118786 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f9e54014a30 con 0x7f9e3c0351e0 2023-09-30T22:28:54.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.736+0000 7f9e61373700 1 -- 172.21.15.59:0/1011665422 --> v1:172.21.15.59:6800/118786 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9e5c125080 con 0x7f9e3c0351e0 2023-09-30T22:28:54.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.736+0000 7f9e53fff700 1 -- 172.21.15.59:0/1011665422 <== osd.1 v1:172.21.15.59:6800/118786 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2434951863) 0x7f9e3c038ee0 con 0x7f9e3c0351e0 2023-09-30T22:28:54.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.736+0000 7f9e61373700 1 -- 172.21.15.59:0/1011665422 >> v1:172.21.15.59:6800/118786 conn(0x7f9e3c0351e0 legacy=0x7f9e3c037670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.737+0000 7f9e61373700 1 -- 172.21.15.59:0/1011665422 >> v1:172.21.15.59:6816/118188 conn(0x7f9e3c02c200 legacy=0x7f9e3c02e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:54.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.737+0000 7f9e61373700 1 -- 172.21.15.59:0/1011665422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e5c09e1d0 msgr2=0x7f9e5c1c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.737+0000 7f9e61373700 1 --2- 172.21.15.59:0/1011665422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e5c09e1d0 0x7f9e5c1c8aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9e44016000 tx=0x7f9e44004750 comp rx=0 tx=0).stop 2023-09-30T22:28:54.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.737+0000 7f9e5b7fe700 1 -- 172.21.15.59:0/1011665422 reap_dead start 2023-09-30T22:28:54.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.737+0000 7f9e61373700 1 -- 172.21.15.59:0/1011665422 shutdown_connections 2023-09-30T22:28:54.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.737+0000 7f9e61373700 1 -- 172.21.15.59:0/1011665422 >> 172.21.15.59:0/1011665422 conn(0x7f9e5c066f50 msgr2=0x7f9e5c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.737+0000 7f9e61373700 1 -- 172.21.15.59:0/1011665422 shutdown_connections 2023-09-30T22:28:54.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.737+0000 7f9e61373700 1 -- 172.21.15.59:0/1011665422 wait complete. 2023-09-30T22:28:54.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.749+0000 7fcb46c87700 1 -- 172.21.15.59:0/2348578976 --> v1:172.21.15.59:6808/118802 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb4009c450 con 0x7fcb2c035260 2023-09-30T22:28:54.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.750+0000 7fcb357fa700 1 -- 172.21.15.59:0/2348578976 <== osd.3 v1:172.21.15.59:6808/118802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2434951863) 0x7fcb38009e90 con 0x7fcb2c035260 2023-09-30T22:28:54.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.750+0000 7fcb46c87700 1 -- 172.21.15.59:0/2348578976 >> v1:172.21.15.59:6808/118802 conn(0x7fcb2c035260 legacy=0x7fcb2c0376f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.750+0000 7fcb46c87700 1 -- 172.21.15.59:0/2348578976 >> v1:172.21.15.59:6816/118188 conn(0x7fcb2c02c200 legacy=0x7fcb2c02e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:54.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.750+0000 7fcb46c87700 1 -- 172.21.15.59:0/2348578976 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb4009d6f0 msgr2=0x7fcb4013da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.750+0000 7fcb46c87700 1 --2- 172.21.15.59:0/2348578976 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb4009d6f0 0x7fcb4013da50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00c780 tx=0x7fcb3c00ca90 comp rx=0 tx=0).stop 2023-09-30T22:28:54.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.750+0000 7fcb45224700 1 -- 172.21.15.59:0/2348578976 reap_dead start 2023-09-30T22:28:54.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.750+0000 7fcb46c87700 1 -- 172.21.15.59:0/2348578976 shutdown_connections 2023-09-30T22:28:54.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.751+0000 7fcb46c87700 1 -- 172.21.15.59:0/2348578976 >> 172.21.15.59:0/2348578976 conn(0x7fcb40066f50 msgr2=0x7fcb400a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.753 INFO:teuthology.orchestra.run.smithi059.stdout:38654705696 2023-09-30T22:28:54.753 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:54.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.751+0000 7fcb46c87700 1 -- 172.21.15.59:0/2348578976 shutdown_connections 2023-09-30T22:28:54.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.751+0000 7fcb46c87700 1 -- 172.21.15.59:0/2348578976 wait complete. 2023-09-30T22:28:54.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.753+0000 7f89950c9700 1 -- 172.21.15.59:0/2890246075 --> v1:172.21.15.59:6812/118803 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f899011d730 con 0x7f897c035160 2023-09-30T22:28:54.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.753+0000 7f89777fe700 1 -- 172.21.15.59:0/2890246075 <== osd.2 v1:172.21.15.59:6812/118803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3709200998) 0x7f899011d730 con 0x7f897c035160 2023-09-30T22:28:54.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.754+0000 7f89950c9700 1 -- 172.21.15.59:0/2890246075 >> v1:172.21.15.59:6812/118803 conn(0x7f897c035160 legacy=0x7f897c0375f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.754+0000 7f89950c9700 1 -- 172.21.15.59:0/2890246075 >> v1:172.21.15.59:6816/118188 conn(0x7f897c02c200 legacy=0x7f897c02e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:54.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.754+0000 7f89950c9700 1 -- 172.21.15.59:0/2890246075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8990135e50 msgr2=0x7f8990119550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.754+0000 7f89950c9700 1 --2- 172.21.15.59:0/2890246075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8990135e50 0x7f8990119550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f89880139c0 tx=0x7f8988013cd0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.756+0000 7f898f59e700 1 -- 172.21.15.59:0/2890246075 reap_dead start 2023-09-30T22:28:54.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.756+0000 7f89950c9700 1 -- 172.21.15.59:0/2890246075 shutdown_connections 2023-09-30T22:28:54.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.756+0000 7f89950c9700 1 -- 172.21.15.59:0/2890246075 >> 172.21.15.59:0/2890246075 conn(0x7f8990066f50 msgr2=0x7f8990130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.756+0000 7f89950c9700 1 -- 172.21.15.59:0/2890246075 shutdown_connections 2023-09-30T22:28:54.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.756+0000 7f89950c9700 1 -- 172.21.15.59:0/2890246075 wait complete. 2023-09-30T22:28:54.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.761+0000 7f9a186eb700 1 Processor -- start 2023-09-30T22:28:54.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.761+0000 7f9a186eb700 1 -- start start 2023-09-30T22:28:54.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.762+0000 7f9a186eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a1009d6f0 0x7f9a1009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.762+0000 7f9a186eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9a1009e410 0x7f9a10130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.762+0000 7f9a186eb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1009f130 con 0x7f9a1009e000 2023-09-30T22:28:54.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.762+0000 7f9a186eb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1009f520 con 0x7f9a1009d6f0 2023-09-30T22:28:54.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.762+0000 7f9a186eb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1009e930 con 0x7f9a1009e410 2023-09-30T22:28:54.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.762+0000 7f9a16c88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9a1009e410 0x7f9a10130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.762+0000 7f9a16c88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9a1009e410 0x7f9a10130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39614/0 (socket says 172.21.15.59:39614) 2023-09-30T22:28:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.762+0000 7f9a16c88700 1 -- 172.21.15.59:0/2322844120 learned_addr learned my addr 172.21.15.59:0/2322844120 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.763+0000 7f9a16487700 1 --2- 172.21.15.59:0/2322844120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a1009d6f0 0x7f9a1009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.763+0000 7f9a16c88700 1 -- 172.21.15.59:0/2322844120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a1009d6f0 msgr2=0x7f9a1009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.763+0000 7f9a16c88700 1 --2- 172.21.15.59:0/2322844120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a1009d6f0 0x7f9a1009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.763+0000 7f9a16c88700 1 -- 172.21.15.59:0/2322844120 >> v1:172.21.15.59:6789/0 conn(0x7f9a1009e000 legacy=0x7f9a10130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.763+0000 7f9a16c88700 1 -- 172.21.15.59:0/2322844120 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1009b2d0 con 0x7f9a1009e410 2023-09-30T22:28:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.763+0000 7f9a16c88700 1 --2- 172.21.15.59:0/2322844120 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9a1009e410 0x7f9a10130d70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009e80 tx=0x7f9a0800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5faa2b29bb7cb13 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.763+0000 7f9a15485700 1 -- 172.21.15.59:0/2322844120 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0800e070 con 0x7f9a1009e410 2023-09-30T22:28:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.763+0000 7f9a15485700 1 -- 172.21.15.59:0/2322844120 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a08003a20 con 0x7f9a1009e410 2023-09-30T22:28:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.763+0000 7f9a15485700 1 -- 172.21.15.59:0/2322844120 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08003dd0 con 0x7f9a1009e410 2023-09-30T22:28:54.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.765+0000 7f9a186eb700 1 -- 172.21.15.59:0/2322844120 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9a1009e410 msgr2=0x7f9a10130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.765+0000 7f9a186eb700 1 --2- 172.21.15.59:0/2322844120 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9a1009e410 0x7f9a10130d70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009e80 tx=0x7f9a0800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:54.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.765+0000 7f9a186eb700 1 -- 172.21.15.59:0/2322844120 shutdown_connections 2023-09-30T22:28:54.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.765+0000 7f9a186eb700 1 --2- 172.21.15.59:0/2322844120 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9a1009e410 0x7f9a10130d70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.765+0000 7f9a186eb700 1 --2- 172.21.15.59:0/2322844120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a1009d6f0 0x7f9a1009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.765+0000 7f9a186eb700 1 -- 172.21.15.59:0/2322844120 >> 172.21.15.59:0/2322844120 conn(0x7f9a10066f50 msgr2=0x7f9a1009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.765+0000 7f9a186eb700 1 -- 172.21.15.59:0/2322844120 shutdown_connections 2023-09-30T22:28:54.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.765+0000 7f9a186eb700 1 -- 172.21.15.59:0/2322844120 wait complete. 2023-09-30T22:28:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.766+0000 7f9a186eb700 1 Processor -- start 2023-09-30T22:28:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.766+0000 7f9a186eb700 1 -- start start 2023-09-30T22:28:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.766+0000 7f9a186eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9a1009d6f0 0x7f9a10079fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.766+0000 7f9a186eb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a1009e000 0x7f9a1007a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.766+0000 7f9a186eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a1009e410 0x7f9a1007aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.766+0000 7f9a186eb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1012e140 con 0x7f9a1009e000 2023-09-30T22:28:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.766+0000 7f9a186eb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1007d110 con 0x7f9a1009e410 2023-09-30T22:28:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.766+0000 7f9a186eb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1007dac0 con 0x7f9a1009d6f0 2023-09-30T22:28:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.767+0000 7f9a15c86700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a1009e000 0x7f9a1007a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.767+0000 7f9a16c88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a1009e410 0x7f9a1007aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.767+0000 7f9a15c86700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a1009e000 0x7f9a1007a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56076/0 (socket says 172.21.15.59:56076) 2023-09-30T22:28:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.767+0000 7f9a16c88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a1009e410 0x7f9a1007aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36504/0 (socket says 172.21.15.59:36504) 2023-09-30T22:28:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.767+0000 7f9a15c86700 1 -- 172.21.15.59:0/2776180894 learned_addr learned my addr 172.21.15.59:0/2776180894 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.767+0000 7f9a15c86700 1 -- 172.21.15.59:0/2776180894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9a1009d6f0 msgr2=0x7f9a10079fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.767+0000 7f9a15c86700 1 --2- 172.21.15.59:0/2776180894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9a1009d6f0 0x7f9a10079fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.767+0000 7f9a15c86700 1 -- 172.21.15.59:0/2776180894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a1009e410 msgr2=0x7f9a1007aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.767+0000 7f9a15c86700 1 --2- 172.21.15.59:0/2776180894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a1009e410 0x7f9a1007aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.767+0000 7f9a15c86700 1 -- 172.21.15.59:0/2776180894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08009b30 con 0x7f9a1009e000 2023-09-30T22:28:54.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.768+0000 7f9a16c88700 1 --2- 172.21.15.59:0/2776180894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a1009e410 0x7f9a1007aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:54.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.768+0000 7f9a15c86700 1 --2- 172.21.15.59:0/2776180894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a1009e000 0x7f9a1007a500 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000c4a0 tx=0x7f9a0000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.768+0000 7f9a06ffd700 1 -- 172.21.15.59:0/2776180894 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a000054e0 con 0x7f9a1009e000 2023-09-30T22:28:54.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.769+0000 7f9a06ffd700 1 -- 172.21.15.59:0/2776180894 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a00003680 con 0x7f9a1009e000 2023-09-30T22:28:54.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.769+0000 7f9a06ffd700 1 -- 172.21.15.59:0/2776180894 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00003a10 con 0x7f9a1009e000 2023-09-30T22:28:54.772 INFO:teuthology.orchestra.run.smithi059.stdout:38654705696 2023-09-30T22:28:54.772 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:54.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.769+0000 7f9a186eb700 1 -- 172.21.15.59:0/2776180894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a100a3ad0 con 0x7f9a1009e000 2023-09-30T22:28:54.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.769+0000 7f9a186eb700 1 -- 172.21.15.59:0/2776180894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1007ba20 con 0x7f9a1009e000 2023-09-30T22:28:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.770+0000 7f9a186eb700 1 -- 172.21.15.59:0/2776180894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a1009c000 con 0x7f9a1009e000 2023-09-30T22:28:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.770+0000 7f9a06ffd700 1 -- 172.21.15.59:0/2776180894 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f9a00003b70 con 0x7f9a1009e000 2023-09-30T22:28:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.770+0000 7f9a16487700 1 -- 172.21.15.59:0/2776180894 >> v1:172.21.15.59:6816/118188 conn(0x7f99f402c1b0 legacy=0x7f99f402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.770+0000 7f9a06ffd700 1 -- 172.21.15.59:0/2776180894 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f9a00003e20 con 0x7f9a1009e000 2023-09-30T22:28:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.771+0000 7f9a06ffd700 1 -- 172.21.15.59:0/2776180894 --> v1:172.21.15.59:6804/118795 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99f4038e10 con 0x7f99f4035110 2023-09-30T22:28:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.771+0000 7f9a06ffd700 1 -- 172.21.15.59:0/2776180894 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a00010b30 con 0x7f9a1009e000 2023-09-30T22:28:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.772+0000 7f9a06ffd700 1 -- 172.21.15.59:0/2776180894 <== osd.0 v1:172.21.15.59:6804/118795 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f99f4038e10 con 0x7f99f4035110 2023-09-30T22:28:54.778 INFO:teuthology.orchestra.run.smithi059.stdout:42949672991 2023-09-30T22:28:54.778 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.791+0000 7f9a186eb700 1 -- 172.21.15.59:0/2776180894 --> v1:172.21.15.59:6804/118795 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a1009c7c0 con 0x7f99f4035110 2023-09-30T22:28:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.791+0000 7f9a06ffd700 1 -- 172.21.15.59:0/2776180894 <== osd.0 v1:172.21.15.59:6804/118795 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3709200998) 0x7f9a1009c7c0 con 0x7f99f4035110 2023-09-30T22:28:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.792+0000 7f9a186eb700 1 -- 172.21.15.59:0/2776180894 >> v1:172.21.15.59:6804/118795 conn(0x7f99f4035110 legacy=0x7f99f40375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.792+0000 7f9a186eb700 1 -- 172.21.15.59:0/2776180894 >> v1:172.21.15.59:6816/118188 conn(0x7f99f402c1b0 legacy=0x7f99f402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.792+0000 7f9a186eb700 1 -- 172.21.15.59:0/2776180894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a1009e000 msgr2=0x7f9a1007a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.792+0000 7f9a186eb700 1 --2- 172.21.15.59:0/2776180894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a1009e000 0x7f9a1007a500 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000c4a0 tx=0x7f9a0000c7b0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.792+0000 7f9a16c88700 1 -- 172.21.15.59:0/2776180894 reap_dead start 2023-09-30T22:28:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.793+0000 7f9a186eb700 1 -- 172.21.15.59:0/2776180894 shutdown_connections 2023-09-30T22:28:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.793+0000 7f9a186eb700 1 -- 172.21.15.59:0/2776180894 >> 172.21.15.59:0/2776180894 conn(0x7f9a10066f50 msgr2=0x7f9a10070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.793+0000 7f9a186eb700 1 -- 172.21.15.59:0/2776180894 shutdown_connections 2023-09-30T22:28:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.793+0000 7f9a186eb700 1 -- 172.21.15.59:0/2776180894 wait complete. 2023-09-30T22:28:54.819 INFO:teuthology.orchestra.run.smithi059.stdout:42949672991 2023-09-30T22:28:54.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:54.916 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:54.916+0000 7fc05e06b240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-30T22:28:54.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.917+0000 7f4052544700 1 Processor -- start 2023-09-30T22:28:54.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.917+0000 7f4052544700 1 -- start start 2023-09-30T22:28:54.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.918+0000 7f4052544700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f404c09e1d0 0x7f404c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.918+0000 7f4052544700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f404c135e50 0x7f404c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.918+0000 7f4052544700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404c09f130 con 0x7f404c09d6f0 2023-09-30T22:28:54.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.918+0000 7f4052544700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404c09f520 con 0x7f404c09e1d0 2023-09-30T22:28:54.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.918+0000 7f4052544700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f404c09e930 con 0x7f404c135e50 2023-09-30T22:28:54.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.918+0000 7f404b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f404c09e1d0 0x7f404c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.918+0000 7f404b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f404c09e1d0 0x7f404c135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56086/0 (socket says 172.21.15.59:56086) 2023-09-30T22:28:54.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.918+0000 7f404b7fe700 1 -- 172.21.15.59:0/3138580763 learned_addr learned my addr 172.21.15.59:0/3138580763 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:54.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.918+0000 7f4050ae1700 1 --2- 172.21.15.59:0/3138580763 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f404c135e50 0x7f404c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.919+0000 7f404b7fe700 1 -- 172.21.15.59:0/3138580763 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f404c135e50 msgr2=0x7f404c138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.919+0000 7f404b7fe700 1 --2- 172.21.15.59:0/3138580763 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f404c135e50 0x7f404c138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.919+0000 7f404b7fe700 1 -- 172.21.15.59:0/3138580763 >> v1:172.21.15.59:6789/0 conn(0x7f404c09d6f0 legacy=0x7f404c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.919+0000 7f404b7fe700 1 -- 172.21.15.59:0/3138580763 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c09b2d0 con 0x7f404c09e1d0 2023-09-30T22:28:54.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.919+0000 7f4050ae1700 1 --2- 172.21.15.59:0/3138580763 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f404c135e50 0x7f404c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:54.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.919+0000 7f404b7fe700 1 --2- 172.21.15.59:0/3138580763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404c09e1d0 0x7f404c135910 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f40400098f0 tx=0x7f4040009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca6a6d9af8e3878 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.919+0000 7f404affd700 1 -- 172.21.15.59:0/3138580763 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040011830 con 0x7f404c09e1d0 2023-09-30T22:28:54.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.919+0000 7f404affd700 1 -- 172.21.15.59:0/3138580763 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4040011990 con 0x7f404c09e1d0 2023-09-30T22:28:54.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.919+0000 7f404affd700 1 -- 172.21.15.59:0/3138580763 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040011d20 con 0x7f404c09e1d0 2023-09-30T22:28:54.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.920+0000 7f4052544700 1 -- 172.21.15.59:0/3138580763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404c09e1d0 msgr2=0x7f404c135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.920+0000 7f4052544700 1 --2- 172.21.15.59:0/3138580763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404c09e1d0 0x7f404c135910 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f40400098f0 tx=0x7f4040009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:54.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.920+0000 7f4052544700 1 -- 172.21.15.59:0/3138580763 shutdown_connections 2023-09-30T22:28:54.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.920+0000 7f4052544700 1 --2- 172.21.15.59:0/3138580763 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f404c135e50 0x7f404c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.920+0000 7f4052544700 1 --2- 172.21.15.59:0/3138580763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404c09e1d0 0x7f404c135910 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.920+0000 7f4052544700 1 -- 172.21.15.59:0/3138580763 >> 172.21.15.59:0/3138580763 conn(0x7f404c066f50 msgr2=0x7f404c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.920+0000 7f4052544700 1 -- 172.21.15.59:0/3138580763 shutdown_connections 2023-09-30T22:28:54.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.920+0000 7f4052544700 1 -- 172.21.15.59:0/3138580763 wait complete. 2023-09-30T22:28:54.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.922+0000 7f4052544700 1 Processor -- start 2023-09-30T22:28:54.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.922+0000 7f4052544700 1 -- start start 2023-09-30T22:28:54.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.923+0000 7f4052544700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404c09d6f0 0x7f404c1328d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.923+0000 7f4052544700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f404c09e1d0 0x7f404c132e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.923+0000 7f4052544700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f404c135e50 0x7f404c133350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.923+0000 7f4052544700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c119750 con 0x7f404c09d6f0 2023-09-30T22:28:54.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.923+0000 7f4052544700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c1302d0 con 0x7f404c135e50 2023-09-30T22:28:54.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.923+0000 7f4052544700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f404c134a70 con 0x7f404c09e1d0 2023-09-30T22:28:54.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.923+0000 7f404bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404c09d6f0 0x7f404c1328d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.923+0000 7f404bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404c09d6f0 0x7f404c1328d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56090/0 (socket says 172.21.15.59:56090) 2023-09-30T22:28:54.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.923+0000 7f404bfff700 1 -- 172.21.15.59:0/1324794788 learned_addr learned my addr 172.21.15.59:0/1324794788 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:54.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.923+0000 7f404b7fe700 1 --2- 172.21.15.59:0/1324794788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f404c09e1d0 0x7f404c132e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.923+0000 7f404bfff700 1 -- 172.21.15.59:0/1324794788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f404c09e1d0 msgr2=0x7f404c132e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.923+0000 7f404bfff700 1 --2- 172.21.15.59:0/1324794788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f404c09e1d0 0x7f404c132e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.923+0000 7f404bfff700 1 -- 172.21.15.59:0/1324794788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f404c135e50 msgr2=0x7f404c133350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.923+0000 7f404bfff700 1 --2- 172.21.15.59:0/1324794788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f404c135e50 0x7f404c133350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.924+0000 7f404bfff700 1 -- 172.21.15.59:0/1324794788 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4044009a70 con 0x7f404c09d6f0 2023-09-30T22:28:54.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.924+0000 7f404bfff700 1 --2- 172.21.15.59:0/1324794788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404c09d6f0 0x7f404c1328d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f403c00c480 tx=0x7f403c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.924+0000 7f4048ff9700 1 -- 172.21.15.59:0/1324794788 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0052d0 con 0x7f404c09d6f0 2023-09-30T22:28:54.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.924+0000 7f4048ff9700 1 -- 172.21.15.59:0/1324794788 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c005430 con 0x7f404c09d6f0 2023-09-30T22:28:54.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.924+0000 7f4048ff9700 1 -- 172.21.15.59:0/1324794788 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0038c0 con 0x7f404c09d6f0 2023-09-30T22:28:54.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.924+0000 7f4052544700 1 -- 172.21.15.59:0/1324794788 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4040009550 con 0x7f404c09d6f0 2023-09-30T22:28:54.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.924+0000 7f4052544700 1 -- 172.21.15.59:0/1324794788 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404c134c40 con 0x7f404c09d6f0 2023-09-30T22:28:54.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.925+0000 7f4052544700 1 -- 172.21.15.59:0/1324794788 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404c1356a0 con 0x7f404c09d6f0 2023-09-30T22:28:54.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.926+0000 7f4048ff9700 1 -- 172.21.15.59:0/1324794788 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f403c003a20 con 0x7f404c09d6f0 2023-09-30T22:28:54.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.926+0000 7f4048ff9700 1 -- 172.21.15.59:0/1324794788 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f403c03ac20 con 0x7f404c09d6f0 2023-09-30T22:28:54.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.926+0000 7f404b7fe700 1 -- 172.21.15.59:0/1324794788 >> v1:172.21.15.59:6816/118188 conn(0x7f403802c1b0 legacy=0x7f403802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:54.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.931+0000 7f4048ff9700 1 -- 172.21.15.59:0/1324794788 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f403c019ce0 con 0x7f404c09d6f0 2023-09-30T22:28:54.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.945+0000 7f0a0680e700 1 Processor -- start 2023-09-30T22:28:54.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.945+0000 7f0a0680e700 1 -- start start 2023-09-30T22:28:54.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.946+0000 7f0a0680e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a0009e930 0x7f0a0009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.946+0000 7f0a0680e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a0009f650 0x7f0a00131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.946+0000 7f0a0680e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a00070940 con 0x7f0a0009f240 2023-09-30T22:28:54.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.946+0000 7f0a0680e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0006fd60 con 0x7f0a0009f650 2023-09-30T22:28:54.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.946+0000 7f0a0680e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0006fa80 con 0x7f0a0009e930 2023-09-30T22:28:54.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.946+0000 7f09fffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a0009e930 0x7f0a0009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.946+0000 7f0a04dab700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a0009f650 0x7f0a00131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.946+0000 7f09fffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a0009e930 0x7f0a0009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36528/0 (socket says 172.21.15.59:36528) 2023-09-30T22:28:54.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.946+0000 7f09fffff700 1 -- 172.21.15.59:0/68507014 learned_addr learned my addr 172.21.15.59:0/68507014 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:54.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.946+0000 7f0a04dab700 1 -- 172.21.15.59:0/68507014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a0009e930 msgr2=0x7f0a0009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.946+0000 7f0a04dab700 1 --2- 172.21.15.59:0/68507014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a0009e930 0x7f0a0009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.946+0000 7f0a04dab700 1 -- 172.21.15.59:0/68507014 >> v1:172.21.15.59:6789/0 conn(0x7f0a0009f240 legacy=0x7f0a001317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.946+0000 7f0a04dab700 1 -- 172.21.15.59:0/68507014 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0009fb60 con 0x7f0a0009f650 2023-09-30T22:28:54.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.947+0000 7f0a04dab700 1 --2- 172.21.15.59:0/68507014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a0009f650 0x7f0a00131f00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f09f800f370 tx=0x7f09f800f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fedc33d45a961e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.950+0000 7f09feffd700 1 -- 172.21.15.59:0/68507014 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8012070 con 0x7f0a0009f650 2023-09-30T22:28:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.950+0000 7f09feffd700 1 -- 172.21.15.59:0/68507014 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f800fe70 con 0x7f0a0009f650 2023-09-30T22:28:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.950+0000 7f09feffd700 1 -- 172.21.15.59:0/68507014 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f800d2f0 con 0x7f0a0009f650 2023-09-30T22:28:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.951+0000 7f0a0680e700 1 -- 172.21.15.59:0/68507014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a0009f650 msgr2=0x7f0a00131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.951+0000 7f0a0680e700 1 --2- 172.21.15.59:0/68507014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a0009f650 0x7f0a00131f00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f09f800f370 tx=0x7f09f800f680 comp rx=0 tx=0).stop 2023-09-30T22:28:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.951+0000 7f0a0680e700 1 -- 172.21.15.59:0/68507014 shutdown_connections 2023-09-30T22:28:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.951+0000 7f0a0680e700 1 --2- 172.21.15.59:0/68507014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a0009f650 0x7f0a00131f00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.951+0000 7f0a0680e700 1 --2- 172.21.15.59:0/68507014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a0009e930 0x7f0a0009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.951+0000 7f0a0680e700 1 -- 172.21.15.59:0/68507014 >> 172.21.15.59:0/68507014 conn(0x7f0a000a4210 msgr2=0x7f0a000a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.951+0000 7f0a0680e700 1 -- 172.21.15.59:0/68507014 shutdown_connections 2023-09-30T22:28:54.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.951+0000 7f0a0680e700 1 -- 172.21.15.59:0/68507014 wait complete. 2023-09-30T22:28:54.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.952+0000 7f6fc9abe700 1 Processor -- start 2023-09-30T22:28:54.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.952+0000 7f6fc9abe700 1 -- start start 2023-09-30T22:28:54.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.953+0000 7f6fc9abe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fc406a770 0x7f6fc409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.953+0000 7f6fc9abe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fc409dc30 0x7f6fc409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.953+0000 7f6fc9abe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6fc413c1e0 0x7f6fc413e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.953+0000 7f6fc9abe700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc406ab40 con 0x7f6fc413c1e0 2023-09-30T22:28:54.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.953+0000 7f6fc9abe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc409ebc0 con 0x7f6fc406a770 2023-09-30T22:28:54.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.953+0000 7f6fc9abe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc409a810 con 0x7f6fc409dc30 2023-09-30T22:28:54.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.953+0000 7f6fbaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fc409dc30 0x7f6fc409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.953+0000 7f6fbaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fc409dc30 0x7f6fc409e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39650/0 (socket says 172.21.15.59:39650) 2023-09-30T22:28:54.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.953+0000 7f6fbaffd700 1 -- 172.21.15.59:0/165019642 learned_addr learned my addr 172.21.15.59:0/165019642 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:54.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f6fc3fff700 1 --2- 172.21.15.59:0/165019642 >> v2:172.21.15.59:3300/0 conn(0x7f6fc413c1e0 0x7f6fc413e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f6fbaffd700 1 -- 172.21.15.59:0/165019642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fc406a770 msgr2=0x7f6fc409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f6fbaffd700 1 --2- 172.21.15.59:0/165019642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fc406a770 0x7f6fc409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f6fbaffd700 1 -- 172.21.15.59:0/165019642 >> v2:172.21.15.59:3300/0 conn(0x7f6fc413c1e0 msgr2=0x7f6fc413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f6fbaffd700 1 --2- 172.21.15.59:0/165019642 >> v2:172.21.15.59:3300/0 conn(0x7f6fc413c1e0 0x7f6fc413e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f6fbaffd700 1 -- 172.21.15.59:0/165019642 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc409e920 con 0x7f6fc409dc30 2023-09-30T22:28:54.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.953+0000 7f0a0680e700 1 Processor -- start 2023-09-30T22:28:54.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.953+0000 7f0a0680e700 1 -- start start 2023-09-30T22:28:54.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f0a0680e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a0009e930 0x7f0a001c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f0a0680e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a0009f240 0x7f0a001c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f0a0680e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a0009f650 0x7f0a001c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f0a0680e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a001a2100 con 0x7f0a0009e930 2023-09-30T22:28:54.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f0a0680e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a001b50c0 con 0x7f0a0009f650 2023-09-30T22:28:54.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f0a0680e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a000a3460 con 0x7f0a0009f240 2023-09-30T22:28:54.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f09ff7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a0009f240 0x7f0a001c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f09ff7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a0009f240 0x7f0a001c42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39658/0 (socket says 172.21.15.59:39658) 2023-09-30T22:28:54.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f09ff7fe700 1 -- 172.21.15.59:0/3674740240 learned_addr learned my addr 172.21.15.59:0/3674740240 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:54.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f09fffff700 1 --2- 172.21.15.59:0/3674740240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a0009e930 0x7f0a001c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f09ff7fe700 1 -- 172.21.15.59:0/3674740240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a0009f650 msgr2=0x7f0a001c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f09ff7fe700 1 --2- 172.21.15.59:0/3674740240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a0009f650 0x7f0a001c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f09ff7fe700 1 -- 172.21.15.59:0/3674740240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a0009e930 msgr2=0x7f0a001c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f09ff7fe700 1 --2- 172.21.15.59:0/3674740240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a0009e930 0x7f0a001c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.954+0000 7f09ff7fe700 1 -- 172.21.15.59:0/3674740240 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f800f050 con 0x7f0a0009f240 2023-09-30T22:28:54.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.955+0000 7f09ff7fe700 1 --2- 172.21.15.59:0/3674740240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a0009f240 0x7f0a001c42d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f09f400c4b0 tx=0x7f09f400c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.955+0000 7f09fcff9700 1 -- 172.21.15.59:0/3674740240 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f40052d0 con 0x7f0a0009f240 2023-09-30T22:28:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.955+0000 7f6fbaffd700 1 --2- 172.21.15.59:0/165019642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fc409dc30 0x7f6fc409e080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009920 tx=0x7f6fb4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58906f4402b15719 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.955+0000 7f09fcff9700 1 -- 172.21.15.59:0/3674740240 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f4005450 con 0x7f0a0009f240 2023-09-30T22:28:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.955+0000 7f09fcff9700 1 -- 172.21.15.59:0/3674740240 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f40038c0 con 0x7f0a0009f240 2023-09-30T22:28:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.955+0000 7f6fc2ffd700 1 -- 172.21.15.59:0/165019642 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb400ba20 con 0x7f6fc409dc30 2023-09-30T22:28:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.955+0000 7f6fc2ffd700 1 -- 172.21.15.59:0/165019642 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb400bb80 con 0x7f6fc409dc30 2023-09-30T22:28:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.955+0000 7f6fc2ffd700 1 -- 172.21.15.59:0/165019642 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4009e70 con 0x7f6fc409dc30 2023-09-30T22:28:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.956+0000 7f6fc9abe700 1 -- 172.21.15.59:0/165019642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fc409dc30 msgr2=0x7f6fc409e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.956+0000 7f6fc9abe700 1 --2- 172.21.15.59:0/165019642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fc409dc30 0x7f6fc409e080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009920 tx=0x7f6fb4009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.955+0000 7f0a0680e700 1 -- 172.21.15.59:0/3674740240 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a000a0190 con 0x7f0a0009f240 2023-09-30T22:28:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.956+0000 7f09fcff9700 1 -- 172.21.15.59:0/3674740240 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f09f4003a20 con 0x7f0a0009f240 2023-09-30T22:28:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.956+0000 7f0a0680e700 1 -- 172.21.15.59:0/3674740240 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a001a26b0 con 0x7f0a0009f240 2023-09-30T22:28:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.956+0000 7f6fc9abe700 1 -- 172.21.15.59:0/165019642 shutdown_connections 2023-09-30T22:28:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.956+0000 7f6fc9abe700 1 --2- 172.21.15.59:0/165019642 >> v2:172.21.15.59:3300/0 conn(0x7f6fc413c1e0 0x7f6fc413e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.956+0000 7f6fc9abe700 1 --2- 172.21.15.59:0/165019642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fc406a770 0x7f6fc409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.956+0000 7f6fc9abe700 1 --2- 172.21.15.59:0/165019642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fc409dc30 0x7f6fc409e080 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.956+0000 7f6fc9abe700 1 -- 172.21.15.59:0/165019642 >> 172.21.15.59:0/165019642 conn(0x7f6fc4066f50 msgr2=0x7f6fc409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.957+0000 7f6fc9abe700 1 -- 172.21.15.59:0/165019642 shutdown_connections 2023-09-30T22:28:54.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.957+0000 7f6fc9abe700 1 -- 172.21.15.59:0/165019642 wait complete. 2023-09-30T22:28:54.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.957+0000 7f09fcff9700 1 -- 172.21.15.59:0/3674740240 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f09f403f170 con 0x7f0a0009f240 2023-09-30T22:28:54.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.957+0000 7f09fffff700 1 -- 172.21.15.59:0/3674740240 >> v1:172.21.15.59:6816/118188 conn(0x7f09ec02c1b0 legacy=0x7f09ec02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:54.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.958+0000 7f0a0680e700 1 -- 172.21.15.59:0/3674740240 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a00074ea0 con 0x7f0a0009f240 2023-09-30T22:28:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.958+0000 7f6fc9abe700 1 Processor -- start 2023-09-30T22:28:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.958+0000 7f6fc9abe700 1 -- start start 2023-09-30T22:28:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.959+0000 7f6fc9abe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fc406a770 0x7f6fc413bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.959+0000 7f6fc9abe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc409dc30 0x7f6fc413a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.959+0000 7f6fc9abe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fc413c1e0 0x7f6fc413abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.959+0000 7f6fc9abe700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc40a3960 con 0x7f6fc409dc30 2023-09-30T22:28:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.959+0000 7f6fc9abe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc411ee20 con 0x7f6fc413c1e0 2023-09-30T22:28:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.959+0000 7f6fc9abe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc4072430 con 0x7f6fc406a770 2023-09-30T22:28:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.959+0000 7f6fc3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fc413c1e0 0x7f6fc413abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.959+0000 7f6fc3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fc413c1e0 0x7f6fc413abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36560/0 (socket says 172.21.15.59:36560) 2023-09-30T22:28:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.959+0000 7f6fc3fff700 1 -- 172.21.15.59:0/2112892907 learned_addr learned my addr 172.21.15.59:0/2112892907 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.959+0000 7f6fbaffd700 1 --2- 172.21.15.59:0/2112892907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc409dc30 0x7f6fc413a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.960+0000 7f6fc3fff700 1 -- 172.21.15.59:0/2112892907 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fc406a770 msgr2=0x7f6fc413bae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.960+0000 7f6fc3fff700 1 --2- 172.21.15.59:0/2112892907 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fc406a770 0x7f6fc413bae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.960+0000 7f6fc3fff700 1 -- 172.21.15.59:0/2112892907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc409dc30 msgr2=0x7f6fc413a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.960+0000 7f6fc3fff700 1 --2- 172.21.15.59:0/2112892907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc409dc30 0x7f6fc413a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.960+0000 7f6fc3fff700 1 -- 172.21.15.59:0/2112892907 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb4009550 con 0x7f6fc413c1e0 2023-09-30T22:28:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.960+0000 7f6fc3fff700 1 --2- 172.21.15.59:0/2112892907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fc413c1e0 0x7f6fc413abe0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc007e70 tx=0x7f6fbc00e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.960+0000 7f6fc0ff9700 1 -- 172.21.15.59:0/2112892907 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc00ede0 con 0x7f6fc413c1e0 2023-09-30T22:28:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.960+0000 7f6fc0ff9700 1 -- 172.21.15.59:0/2112892907 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc014420 con 0x7f6fc413c1e0 2023-09-30T22:28:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.960+0000 7f6fc9abe700 1 -- 172.21.15.59:0/2112892907 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc41200c0 con 0x7f6fc413c1e0 2023-09-30T22:28:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.961+0000 7f6fc0ff9700 1 -- 172.21.15.59:0/2112892907 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc0147d0 con 0x7f6fc413c1e0 2023-09-30T22:28:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.961+0000 7f6fc9abe700 1 -- 172.21.15.59:0/2112892907 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc409f1f0 con 0x7f6fc413c1e0 2023-09-30T22:28:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.962+0000 7f6fc0ff9700 1 -- 172.21.15.59:0/2112892907 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f6fbc014930 con 0x7f6fc413c1e0 2023-09-30T22:28:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.962+0000 7f6fc9abe700 1 -- 172.21.15.59:0/2112892907 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc4074ea0 con 0x7f6fc413c1e0 2023-09-30T22:28:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.962+0000 7f6fc0ff9700 1 -- 172.21.15.59:0/2112892907 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f6fbc03beb0 con 0x7f6fc413c1e0 2023-09-30T22:28:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.962+0000 7f6fc37fe700 1 -- 172.21.15.59:0/2112892907 >> v1:172.21.15.59:6816/118188 conn(0x7f6fa402c230 legacy=0x7f6fa402e6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:54.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.966+0000 7f09fcff9700 1 -- 172.21.15.59:0/3674740240 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f09f4040060 con 0x7f0a0009f240 2023-09-30T22:28:54.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:54.969+0000 7f6fc0ff9700 1 -- 172.21.15.59:0/2112892907 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f6fbc01bd70 con 0x7f6fc413c1e0 2023-09-30T22:28:55.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.029+0000 7f6655dd2700 1 Processor -- start 2023-09-30T22:28:55.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.029+0000 7f6655dd2700 1 -- start start 2023-09-30T22:28:55.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.029+0000 7f6655dd2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f665006e570 0x7f665006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.029+0000 7f6655dd2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f665009eca0 0x7f665006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.029+0000 7f6655dd2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6650070ee0 con 0x7f6650134610 2023-09-30T22:28:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.029+0000 7f6655dd2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6650071480 con 0x7f665009eca0 2023-09-30T22:28:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.029+0000 7f6655dd2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f665006f3c0 con 0x7f665006e570 2023-09-30T22:28:55.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.030+0000 7f664effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f665009eca0 0x7f665006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.030+0000 7f664effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f665009eca0 0x7f665006ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36562/0 (socket says 172.21.15.59:36562) 2023-09-30T22:28:55.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.030+0000 7f664effd700 1 -- 172.21.15.59:0/32400879 learned_addr learned my addr 172.21.15.59:0/32400879 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:55.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.030+0000 7f664f7fe700 1 --2- 172.21.15.59:0/32400879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f665006e570 0x7f665006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.030+0000 7f664effd700 1 -- 172.21.15.59:0/32400879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f665006e570 msgr2=0x7f665006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:55.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.030+0000 7f664effd700 1 --2- 172.21.15.59:0/32400879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f665006e570 0x7f665006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.030+0000 7f664effd700 1 -- 172.21.15.59:0/32400879 >> v1:172.21.15.59:6789/0 conn(0x7f6650134610 legacy=0x7f6650134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:55.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.030+0000 7f664effd700 1 -- 172.21.15.59:0/32400879 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6650071b90 con 0x7f665009eca0 2023-09-30T22:28:55.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.030+0000 7f664effd700 1 --2- 172.21.15.59:0/32400879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f665009eca0 0x7f665006ee80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6644009920 tx=0x7f6644009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a476746827e40ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:55.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.031+0000 7f664e7fc700 1 -- 172.21.15.59:0/32400879 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644004230 con 0x7f665009eca0 2023-09-30T22:28:55.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.031+0000 7f664e7fc700 1 -- 172.21.15.59:0/32400879 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6644004390 con 0x7f665009eca0 2023-09-30T22:28:55.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.031+0000 7f664e7fc700 1 -- 172.21.15.59:0/32400879 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66440036a0 con 0x7f665009eca0 2023-09-30T22:28:55.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.031+0000 7f6655dd2700 1 -- 172.21.15.59:0/32400879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f665009eca0 msgr2=0x7f665006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.031+0000 7f6655dd2700 1 --2- 172.21.15.59:0/32400879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f665009eca0 0x7f665006ee80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6644009920 tx=0x7f6644009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:55.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.031+0000 7f6655dd2700 1 -- 172.21.15.59:0/32400879 shutdown_connections 2023-09-30T22:28:55.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.031+0000 7f6655dd2700 1 --2- 172.21.15.59:0/32400879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f665006e570 0x7f665006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.031+0000 7f6655dd2700 1 --2- 172.21.15.59:0/32400879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f665009eca0 0x7f665006ee80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.031+0000 7f6655dd2700 1 -- 172.21.15.59:0/32400879 >> 172.21.15.59:0/32400879 conn(0x7f66500a2aa0 msgr2=0x7f66500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:55.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.032+0000 7f6655dd2700 1 -- 172.21.15.59:0/32400879 shutdown_connections 2023-09-30T22:28:55.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.032+0000 7f6655dd2700 1 -- 172.21.15.59:0/32400879 wait complete. 2023-09-30T22:28:55.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.033+0000 7f6655dd2700 1 Processor -- start 2023-09-30T22:28:55.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.033+0000 7f6655dd2700 1 -- start start 2023-09-30T22:28:55.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.033+0000 7f6655dd2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f665006e570 0x7f66501340b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.033+0000 7f6655dd2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6650134610 0x7f6650132e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.033+0000 7f6655dd2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66501333b0 0x7f6650133830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.033+0000 7f6655dd2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665013e190 con 0x7f665006e570 2023-09-30T22:28:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.033+0000 7f6655dd2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665013cb10 con 0x7f6650134610 2023-09-30T22:28:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.033+0000 7f6655dd2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f665013bbb0 con 0x7f66501333b0 2023-09-30T22:28:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.034+0000 7f664f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f665006e570 0x7f66501340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.034+0000 7f664f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f665006e570 0x7f66501340b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56128/0 (socket says 172.21.15.59:56128) 2023-09-30T22:28:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.034+0000 7f664f7fe700 1 -- 172.21.15.59:0/1703659118 learned_addr learned my addr 172.21.15.59:0/1703659118 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.034+0000 7f664ffff700 1 --2- 172.21.15.59:0/1703659118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66501333b0 0x7f6650133830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.034+0000 7f664f7fe700 1 -- 172.21.15.59:0/1703659118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66501333b0 msgr2=0x7f6650133830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.035+0000 7f664f7fe700 1 --2- 172.21.15.59:0/1703659118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66501333b0 0x7f6650133830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.035+0000 7f664f7fe700 1 -- 172.21.15.59:0/1703659118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6650134610 msgr2=0x7f6650132e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.035+0000 7f664f7fe700 1 --2- 172.21.15.59:0/1703659118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6650134610 0x7f6650132e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.035+0000 7f664f7fe700 1 -- 172.21.15.59:0/1703659118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6644009550 con 0x7f665006e570 2023-09-30T22:28:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.035+0000 7f664f7fe700 1 --2- 172.21.15.59:0/1703659118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f665006e570 0x7f66501340b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f664000e9b0 tx=0x7f664000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.035+0000 7f6637fff700 1 -- 172.21.15.59:0/1703659118 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6640009710 con 0x7f665006e570 2023-09-30T22:28:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.035+0000 7f6655dd2700 1 -- 172.21.15.59:0/1703659118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665013d080 con 0x7f665006e570 2023-09-30T22:28:55.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.035+0000 7f6637fff700 1 -- 172.21.15.59:0/1703659118 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664000c7f0 con 0x7f665006e570 2023-09-30T22:28:55.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.035+0000 7f6637fff700 1 -- 172.21.15.59:0/1703659118 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664000cb60 con 0x7f665006e570 2023-09-30T22:28:55.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.035+0000 7f6655dd2700 1 -- 172.21.15.59:0/1703659118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6650070610 con 0x7f665006e570 2023-09-30T22:28:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.036+0000 7f6637fff700 1 -- 172.21.15.59:0/1703659118 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f664000ccc0 con 0x7f665006e570 2023-09-30T22:28:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.037+0000 7f6637fff700 1 -- 172.21.15.59:0/1703659118 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f664003be60 con 0x7f665006e570 2023-09-30T22:28:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.037+0000 7f6655dd2700 1 -- 172.21.15.59:0/1703659118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6650074ea0 con 0x7f665006e570 2023-09-30T22:28:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.037+0000 7f664effd700 1 -- 172.21.15.59:0/1703659118 >> v1:172.21.15.59:6816/118188 conn(0x7f663c02c1b0 legacy=0x7f663c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.045+0000 7f6637fff700 1 -- 172.21.15.59:0/1703659118 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f6640017080 con 0x7f665006e570 2023-09-30T22:28:55.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.125+0000 7f4052544700 1 -- 172.21.15.59:0/1324794788 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f404c071700 con 0x7f404c09d6f0 2023-09-30T22:28:55.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.126+0000 7f4048ff9700 1 -- 172.21.15.59:0/1324794788 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f403c017020 con 0x7f404c09d6f0 2023-09-30T22:28:55.127 INFO:teuthology.orchestra.run.smithi059.stdout:38654705694 2023-09-30T22:28:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.127+0000 7f404b7fe700 1 -- 172.21.15.59:0/1324794788 >> v1:172.21.15.59:6816/118188 conn(0x7f403802c1b0 legacy=0x7f403802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.128+0000 7f4052544700 1 -- 172.21.15.59:0/1324794788 >> v1:172.21.15.59:6816/118188 conn(0x7f403802c1b0 legacy=0x7f403802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.128+0000 7f4052544700 1 -- 172.21.15.59:0/1324794788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404c09d6f0 msgr2=0x7f404c1328d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.128+0000 7f4052544700 1 --2- 172.21.15.59:0/1324794788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404c09d6f0 0x7f404c1328d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f403c00c480 tx=0x7f403c00c790 comp rx=0 tx=0).stop 2023-09-30T22:28:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.129+0000 7f4052544700 1 -- 172.21.15.59:0/1324794788 shutdown_connections 2023-09-30T22:28:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.129+0000 7f4052544700 1 --2- 172.21.15.59:0/1324794788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f404c135e50 0x7f404c133350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.129+0000 7f4052544700 1 --2- 172.21.15.59:0/1324794788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404c09d6f0 0x7f404c1328d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.129+0000 7f4052544700 1 --2- 172.21.15.59:0/1324794788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f404c09e1d0 0x7f404c132e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.129+0000 7f4052544700 1 -- 172.21.15.59:0/1324794788 >> 172.21.15.59:0/1324794788 conn(0x7f404c066f50 msgr2=0x7f404c06e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.129+0000 7f4052544700 1 -- 172.21.15.59:0/1324794788 shutdown_connections 2023-09-30T22:28:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.129+0000 7f4052544700 1 -- 172.21.15.59:0/1324794788 wait complete. 2023-09-30T22:28:55.138 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:55.137+0000 7fc05e06b240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-30T22:28:55.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705694 for osd.1 2023-09-30T22:28:55.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.158+0000 7f09fffff700 1 -- 172.21.15.59:0/3674740240 >> v1:172.21.15.59:6816/118188 conn(0x7f09ec02c1b0 legacy=0x7f09ec02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:55.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.158+0000 7f6fc9abe700 1 -- 172.21.15.59:0/2112892907 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6fc411fea0 con 0x7f6fc413c1e0 2023-09-30T22:28:55.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.159+0000 7f6fc0ff9700 1 -- 172.21.15.59:0/2112892907 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6fbc01b310 con 0x7f6fc413c1e0 2023-09-30T22:28:55.160 INFO:teuthology.orchestra.run.smithi059.stdout:42949672990 2023-09-30T22:28:55.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.162+0000 7f6fc9abe700 1 -- 172.21.15.59:0/2112892907 >> v1:172.21.15.59:6816/118188 conn(0x7f6fa402c230 legacy=0x7f6fa402e6e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.162+0000 7f6fc9abe700 1 -- 172.21.15.59:0/2112892907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fc413c1e0 msgr2=0x7f6fc413abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.162+0000 7f6fc9abe700 1 --2- 172.21.15.59:0/2112892907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fc413c1e0 0x7f6fc413abe0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc007e70 tx=0x7f6fbc00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.162+0000 7f6fc9abe700 1 -- 172.21.15.59:0/2112892907 shutdown_connections 2023-09-30T22:28:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.162+0000 7f6fc9abe700 1 --2- 172.21.15.59:0/2112892907 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fc406a770 0x7f6fc413bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.162+0000 7f6fc9abe700 1 --2- 172.21.15.59:0/2112892907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fc413c1e0 0x7f6fc413abe0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.162+0000 7f6fc9abe700 1 --2- 172.21.15.59:0/2112892907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc409dc30 0x7f6fc413a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.162+0000 7f6fc9abe700 1 -- 172.21.15.59:0/2112892907 >> 172.21.15.59:0/2112892907 conn(0x7f6fc4066f50 msgr2=0x7f6fc413c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.163+0000 7f6fc9abe700 1 -- 172.21.15.59:0/2112892907 shutdown_connections 2023-09-30T22:28:55.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.163+0000 7f6fc9abe700 1 -- 172.21.15.59:0/2112892907 wait complete. 2023-09-30T22:28:55.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672991 got 42949672990 for osd.2 2023-09-30T22:28:55.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.229+0000 7f6655dd2700 1 -- 172.21.15.59:0/1703659118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6650071100 con 0x7f665006e570 2023-09-30T22:28:55.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.230+0000 7f6637fff700 1 -- 172.21.15.59:0/1703659118 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f664001b3b0 con 0x7f665006e570 2023-09-30T22:28:55.231 INFO:teuthology.orchestra.run.smithi059.stdout:42949672990 2023-09-30T22:28:55.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.232+0000 7f6655dd2700 1 -- 172.21.15.59:0/1703659118 >> v1:172.21.15.59:6816/118188 conn(0x7f663c02c1b0 legacy=0x7f663c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:55.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.232+0000 7f6655dd2700 1 -- 172.21.15.59:0/1703659118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f665006e570 msgr2=0x7f66501340b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.232+0000 7f6655dd2700 1 --2- 172.21.15.59:0/1703659118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f665006e570 0x7f66501340b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f664000e9b0 tx=0x7f664000ed70 comp rx=0 tx=0).stop 2023-09-30T22:28:55.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.232+0000 7f6655dd2700 1 -- 172.21.15.59:0/1703659118 shutdown_connections 2023-09-30T22:28:55.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.232+0000 7f6655dd2700 1 --2- 172.21.15.59:0/1703659118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66501333b0 0x7f6650133830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.232+0000 7f6655dd2700 1 --2- 172.21.15.59:0/1703659118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f665006e570 0x7f66501340b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.232+0000 7f6655dd2700 1 --2- 172.21.15.59:0/1703659118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6650134610 0x7f6650132e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.232+0000 7f6655dd2700 1 -- 172.21.15.59:0/1703659118 >> 172.21.15.59:0/1703659118 conn(0x7f66500a2aa0 msgr2=0x7f66500a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:55.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.232+0000 7f6655dd2700 1 -- 172.21.15.59:0/1703659118 shutdown_connections 2023-09-30T22:28:55.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.232+0000 7f6655dd2700 1 -- 172.21.15.59:0/1703659118 wait complete. 2023-09-30T22:28:55.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672991 got 42949672990 for osd.0 2023-09-30T22:28:55.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.248+0000 7f0a0680e700 1 -- 172.21.15.59:0/3674740240 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0a001a3b00 con 0x7f0a0009f240 2023-09-30T22:28:55.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.249+0000 7f09fcff9700 1 -- 172.21.15.59:0/3674740240 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09f4018260 con 0x7f0a0009f240 2023-09-30T22:28:55.250 INFO:teuthology.orchestra.run.smithi059.stdout:38654705694 2023-09-30T22:28:55.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.250+0000 7f0a0680e700 1 -- 172.21.15.59:0/3674740240 >> v1:172.21.15.59:6816/118188 conn(0x7f09ec02c1b0 legacy=0x7f09ec02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:55.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.251+0000 7f0a0680e700 1 -- 172.21.15.59:0/3674740240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a0009f240 msgr2=0x7f0a001c42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.251+0000 7f0a0680e700 1 --2- 172.21.15.59:0/3674740240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a0009f240 0x7f0a001c42d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f09f400c4b0 tx=0x7f09f400c7c0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.251+0000 7f0a0680e700 1 -- 172.21.15.59:0/3674740240 shutdown_connections 2023-09-30T22:28:55.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.251+0000 7f0a0680e700 1 --2- 172.21.15.59:0/3674740240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a0009f650 0x7f0a001c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.251+0000 7f0a0680e700 1 --2- 172.21.15.59:0/3674740240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a0009e930 0x7f0a001c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.251+0000 7f0a0680e700 1 --2- 172.21.15.59:0/3674740240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a0009f240 0x7f0a001c42d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.251+0000 7f0a0680e700 1 -- 172.21.15.59:0/3674740240 >> 172.21.15.59:0/3674740240 conn(0x7f0a000a4210 msgr2=0x7f0a001b7970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:55.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.251+0000 7f0a0680e700 1 -- 172.21.15.59:0/3674740240 shutdown_connections 2023-09-30T22:28:55.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:55.251+0000 7f0a0680e700 1 -- 172.21.15.59:0/3674740240 wait complete. 2023-09-30T22:28:55.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705694 for osd.3 2023-09-30T22:28:55.522 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:55.521+0000 7fc05e06b240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T22:28:55.684 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:55.683+0000 7fc05e06b240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T22:28:55.768 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:55.766+0000 7fc05e06b240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T22:28:55.921 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:55.920+0000 7fc05e06b240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T22:28:56.001 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:56.000+0000 7fc05e06b240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T22:28:56.145 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:56.185 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:56.187 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:56.186+0000 7fc05e06b240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T22:28:56.247 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:56.266 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:56.285 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:56.283+0000 7fc05e06b240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T22:28:56.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.295+0000 7fd68cb88700 1 Processor -- start 2023-09-30T22:28:56.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.295+0000 7fd68cb88700 1 -- start start 2023-09-30T22:28:56.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.296+0000 7fd68cb88700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd68812cf60 0x7fd68806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.296+0000 7fd68cb88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd68812f8b0 0x7fd68812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.296+0000 7fd68cb88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd688130260 0x7fd688136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.296+0000 7fd68cb88700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68812d330 con 0x7fd68812cf60 2023-09-30T22:28:56.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.296+0000 7fd68cb88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68812cd90 con 0x7fd688130260 2023-09-30T22:28:56.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.296+0000 7fd68cb88700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6881306d0 con 0x7fd68812f8b0 2023-09-30T22:28:56.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.296+0000 7fd685d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd68812f8b0 0x7fd68812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.296+0000 7fd685d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd68812f8b0 0x7fd68812fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39690/0 (socket says 172.21.15.59:39690) 2023-09-30T22:28:56.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.297+0000 7fd685d9b700 1 -- 172.21.15.59:0/1665786602 learned_addr learned my addr 172.21.15.59:0/1665786602 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:56.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.297+0000 7fd68659c700 1 --2- 172.21.15.59:0/1665786602 >> v2:172.21.15.59:3300/0 conn(0x7fd68812cf60 0x7fd68806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.297+0000 7fd686d9d700 1 --2- 172.21.15.59:0/1665786602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd688130260 0x7fd688136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.297+0000 7fd68659c700 1 -- 172.21.15.59:0/1665786602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd68812f8b0 msgr2=0x7fd68812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:56.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.297+0000 7fd68659c700 1 --2- 172.21.15.59:0/1665786602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd68812f8b0 0x7fd68812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.297+0000 7fd68659c700 1 -- 172.21.15.59:0/1665786602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd688130260 msgr2=0x7fd688136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:56.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.297+0000 7fd68659c700 1 --2- 172.21.15.59:0/1665786602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd688130260 0x7fd688136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.297+0000 7fd68659c700 1 -- 172.21.15.59:0/1665786602 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd688071780 con 0x7fd68812cf60 2023-09-30T22:28:56.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.297+0000 7fd686d9d700 1 --2- 172.21.15.59:0/1665786602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd688130260 0x7fd688136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:56.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.298+0000 7fd68659c700 1 --2- 172.21.15.59:0/1665786602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd68812cf60 0x7fd68806f5d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd678009870 tx=0x7fd678009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4651506aefa94ea8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.300+0000 7fd68559a700 1 -- 172.21.15.59:0/1665786602 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678011830 con 0x7fd68812cf60 2023-09-30T22:28:56.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.300+0000 7fd68559a700 1 -- 172.21.15.59:0/1665786602 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678011990 con 0x7fd68812cf60 2023-09-30T22:28:56.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.300+0000 7fd68559a700 1 -- 172.21.15.59:0/1665786602 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678011d20 con 0x7fd68812cf60 2023-09-30T22:28:56.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.301+0000 7fd68cb88700 1 -- 172.21.15.59:0/1665786602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd68812cf60 msgr2=0x7fd68806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.301+0000 7fd68cb88700 1 --2- 172.21.15.59:0/1665786602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd68812cf60 0x7fd68806f5d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd678009870 tx=0x7fd678009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:56.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.301+0000 7fd68cb88700 1 -- 172.21.15.59:0/1665786602 shutdown_connections 2023-09-30T22:28:56.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.301+0000 7fd68cb88700 1 --2- 172.21.15.59:0/1665786602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd688130260 0x7fd688136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.301+0000 7fd68cb88700 1 --2- 172.21.15.59:0/1665786602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd68812cf60 0x7fd68806f5d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.301+0000 7fd68cb88700 1 --2- 172.21.15.59:0/1665786602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd68812f8b0 0x7fd68812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.301+0000 7fd68cb88700 1 -- 172.21.15.59:0/1665786602 >> 172.21.15.59:0/1665786602 conn(0x7fd6880a2aa0 msgr2=0x7fd6880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.301+0000 7fd68cb88700 1 -- 172.21.15.59:0/1665786602 shutdown_connections 2023-09-30T22:28:56.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.301+0000 7fd68cb88700 1 -- 172.21.15.59:0/1665786602 wait complete. 2023-09-30T22:28:56.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.303+0000 7fd68cb88700 1 Processor -- start 2023-09-30T22:28:56.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.303+0000 7fd68cb88700 1 -- start start 2023-09-30T22:28:56.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.304+0000 7fd68cb88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd68812cf60 0x7fd688128b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.304+0000 7fd68cb88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd68812f8b0 0x7fd6881290d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.304+0000 7fd68cb88700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd688130260 0x7fd68809afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.304+0000 7fd68cb88700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68809ed20 con 0x7fd688130260 2023-09-30T22:28:56.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.304+0000 7fd68cb88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68809e800 con 0x7fd68812f8b0 2023-09-30T22:28:56.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.304+0000 7fd68cb88700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd68809cd50 con 0x7fd68812cf60 2023-09-30T22:28:56.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.304+0000 7fd68659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd68812cf60 0x7fd688128b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.304+0000 7fd685d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd68812f8b0 0x7fd6881290d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.304+0000 7fd68659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd68812cf60 0x7fd688128b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39700/0 (socket says 172.21.15.59:39700) 2023-09-30T22:28:56.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.304+0000 7fd68659c700 1 -- 172.21.15.59:0/3963317693 learned_addr learned my addr 172.21.15.59:0/3963317693 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:56.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.304+0000 7fd686d9d700 1 --2- 172.21.15.59:0/3963317693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd688130260 0x7fd68809afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.305+0000 7fd685d9b700 1 -- 172.21.15.59:0/3963317693 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd68812cf60 msgr2=0x7fd688128b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.305+0000 7fd685d9b700 1 --2- 172.21.15.59:0/3963317693 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd68812cf60 0x7fd688128b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.305+0000 7fd685d9b700 1 -- 172.21.15.59:0/3963317693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd688130260 msgr2=0x7fd68809afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.305+0000 7fd685d9b700 1 --2- 172.21.15.59:0/3963317693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd688130260 0x7fd68809afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.305+0000 7fd685d9b700 1 -- 172.21.15.59:0/3963317693 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6780094a0 con 0x7fd68812f8b0 2023-09-30T22:28:56.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.305+0000 7fd685d9b700 1 --2- 172.21.15.59:0/3963317693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd68812f8b0 0x7fd6881290d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00dd90 tx=0x7fd67c009400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.305+0000 7fd676ffd700 1 -- 172.21.15.59:0/3963317693 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c009960 con 0x7fd68812f8b0 2023-09-30T22:28:56.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.305+0000 7fd676ffd700 1 -- 172.21.15.59:0/3963317693 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c009ac0 con 0x7fd68812f8b0 2023-09-30T22:28:56.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.305+0000 7fd68cb88700 1 -- 172.21.15.59:0/3963317693 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68809d180 con 0x7fd68812f8b0 2023-09-30T22:28:56.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.306+0000 7fd676ffd700 1 -- 172.21.15.59:0/3963317693 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c009e30 con 0x7fd68812f8b0 2023-09-30T22:28:56.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.306+0000 7fd68cb88700 1 -- 172.21.15.59:0/3963317693 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68809d3c0 con 0x7fd68812f8b0 2023-09-30T22:28:56.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.306+0000 7fd676ffd700 1 -- 172.21.15.59:0/3963317693 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fd67c0203b0 con 0x7fd68812f8b0 2023-09-30T22:28:56.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.307+0000 7fd676ffd700 1 -- 172.21.15.59:0/3963317693 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fd67c00b050 con 0x7fd68812f8b0 2023-09-30T22:28:56.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.307+0000 7fd68659c700 1 -- 172.21.15.59:0/3963317693 >> v1:172.21.15.59:6816/118188 conn(0x7fd66802c200 legacy=0x7fd66802e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:56.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.308+0000 7fd68cb88700 1 -- 172.21.15.59:0/3963317693 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd688074ea0 con 0x7fd68812f8b0 2023-09-30T22:28:56.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.316+0000 7fd676ffd700 1 -- 172.21.15.59:0/3963317693 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fd67c01c020 con 0x7fd68812f8b0 2023-09-30T22:28:56.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.340+0000 7fb392725700 1 Processor -- start 2023-09-30T22:28:56.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.340+0000 7fb392725700 1 -- start start 2023-09-30T22:28:56.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.341+0000 7fb392725700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb38c12cf60 0x7fb38c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.341+0000 7fb392725700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb38c12f8b0 0x7fb38c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.341+0000 7fb392725700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb38c130260 0x7fb38c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.341+0000 7fb392725700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38c12d330 con 0x7fb38c130260 2023-09-30T22:28:56.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.341+0000 7fb392725700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c12cd90 con 0x7fb38c12f8b0 2023-09-30T22:28:56.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.341+0000 7fb392725700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c1306d0 con 0x7fb38c12cf60 2023-09-30T22:28:56.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.341+0000 7fb38bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb38c12cf60 0x7fb38c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.341+0000 7fb38bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb38c12cf60 0x7fb38c06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39706/0 (socket says 172.21.15.59:39706) 2023-09-30T22:28:56.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.341+0000 7fb38bfff700 1 -- 172.21.15.59:0/907200985 learned_addr learned my addr 172.21.15.59:0/907200985 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:56.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.341+0000 7fb38b7fe700 1 --2- 172.21.15.59:0/907200985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb38c12f8b0 0x7fb38c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.341+0000 7fb38bfff700 1 -- 172.21.15.59:0/907200985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb38c12f8b0 msgr2=0x7fb38c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:56.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.341+0000 7fb38bfff700 1 --2- 172.21.15.59:0/907200985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb38c12f8b0 0x7fb38c12fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.341+0000 7fb38bfff700 1 -- 172.21.15.59:0/907200985 >> v2:172.21.15.59:3300/0 conn(0x7fb38c130260 msgr2=0x7fb38c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:56.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.341+0000 7fb38bfff700 1 --2- 172.21.15.59:0/907200985 >> v2:172.21.15.59:3300/0 conn(0x7fb38c130260 0x7fb38c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.341+0000 7fb38bfff700 1 -- 172.21.15.59:0/907200985 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c071780 con 0x7fb38c12cf60 2023-09-30T22:28:56.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.342+0000 7fb38bfff700 1 --2- 172.21.15.59:0/907200985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb38c12cf60 0x7fb38c06f5d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb38000bb90 tx=0x7fb38000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b733b9596ccf297b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.342+0000 7fb38affd700 1 -- 172.21.15.59:0/907200985 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38000dc40 con 0x7fb38c12cf60 2023-09-30T22:28:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.342+0000 7fb38affd700 1 -- 172.21.15.59:0/907200985 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38000dda0 con 0x7fb38c12cf60 2023-09-30T22:28:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.342+0000 7fb38affd700 1 -- 172.21.15.59:0/907200985 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380017630 con 0x7fb38c12cf60 2023-09-30T22:28:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.343+0000 7fb392725700 1 -- 172.21.15.59:0/907200985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb38c12cf60 msgr2=0x7fb38c06f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.343+0000 7fb392725700 1 --2- 172.21.15.59:0/907200985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb38c12cf60 0x7fb38c06f5d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb38000bb90 tx=0x7fb38000bea0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.343+0000 7fb392725700 1 -- 172.21.15.59:0/907200985 shutdown_connections 2023-09-30T22:28:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.343+0000 7fb392725700 1 --2- 172.21.15.59:0/907200985 >> v2:172.21.15.59:3300/0 conn(0x7fb38c130260 0x7fb38c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.343+0000 7fb392725700 1 --2- 172.21.15.59:0/907200985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb38c12cf60 0x7fb38c06f5d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.343+0000 7fb392725700 1 --2- 172.21.15.59:0/907200985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb38c12f8b0 0x7fb38c12fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.343+0000 7fb392725700 1 -- 172.21.15.59:0/907200985 >> 172.21.15.59:0/907200985 conn(0x7fb38c0a2aa0 msgr2=0x7fb38c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.343+0000 7fb392725700 1 -- 172.21.15.59:0/907200985 shutdown_connections 2023-09-30T22:28:56.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.343+0000 7fb392725700 1 -- 172.21.15.59:0/907200985 wait complete. 2023-09-30T22:28:56.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.344+0000 7fb392725700 1 Processor -- start 2023-09-30T22:28:56.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.345+0000 7fb392725700 1 -- start start 2023-09-30T22:28:56.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.345+0000 7fb392725700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb38c12cf60 0x7fb38c1d1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.345+0000 7fb392725700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb38c12f8b0 0x7fb38c1d24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.346+0000 7fb392725700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb38c130260 0x7fb38c1b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.346+0000 7fb392725700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c1b6ca0 con 0x7fb38c130260 2023-09-30T22:28:56.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.346+0000 7fb392725700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c1d1930 con 0x7fb38c12cf60 2023-09-30T22:28:56.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.346+0000 7fb392725700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c1b6a70 con 0x7fb38c12f8b0 2023-09-30T22:28:56.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.346+0000 7fb390cc2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb38c130260 0x7fb38c1b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.346+0000 7fb38b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb38c12f8b0 0x7fb38c1d24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.346+0000 7fb390cc2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb38c130260 0x7fb38c1b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56164/0 (socket says 172.21.15.59:56164) 2023-09-30T22:28:56.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.346+0000 7fb390cc2700 1 -- 172.21.15.59:0/2170082238 learned_addr learned my addr 172.21.15.59:0/2170082238 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.346+0000 7fb38bfff700 1 --2- 172.21.15.59:0/2170082238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb38c12cf60 0x7fb38c1d1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.346+0000 7fb38b7fe700 1 -- 172.21.15.59:0/2170082238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb38c12cf60 msgr2=0x7fb38c1d1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.346+0000 7fb38b7fe700 1 --2- 172.21.15.59:0/2170082238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb38c12cf60 0x7fb38c1d1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.346+0000 7fb38b7fe700 1 -- 172.21.15.59:0/2170082238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb38c130260 msgr2=0x7fb38c1b5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.346+0000 7fb38b7fe700 1 --2- 172.21.15.59:0/2170082238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb38c130260 0x7fb38c1b5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.346+0000 7fb38b7fe700 1 -- 172.21.15.59:0/2170082238 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38000b7f0 con 0x7fb38c12f8b0 2023-09-30T22:28:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.347+0000 7fb38b7fe700 1 --2- 172.21.15.59:0/2170082238 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb38c12f8b0 0x7fb38c1d24d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00e7e0 tx=0x7fb37c00eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.347+0000 7fb388ff9700 1 -- 172.21.15.59:0/2170082238 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c00c070 con 0x7fb38c12f8b0 2023-09-30T22:28:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.347+0000 7fb388ff9700 1 -- 172.21.15.59:0/2170082238 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37c004020 con 0x7fb38c12f8b0 2023-09-30T22:28:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.347+0000 7fb388ff9700 1 -- 172.21.15.59:0/2170082238 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c0043d0 con 0x7fb38c12f8b0 2023-09-30T22:28:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.347+0000 7fb392725700 1 -- 172.21.15.59:0/2170082238 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38c09e160 con 0x7fb38c12f8b0 2023-09-30T22:28:56.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.347+0000 7fb392725700 1 -- 172.21.15.59:0/2170082238 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38c1b8680 con 0x7fb38c12f8b0 2023-09-30T22:28:56.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.349+0000 7fb392725700 1 -- 172.21.15.59:0/2170082238 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38c074ea0 con 0x7fb38c12f8b0 2023-09-30T22:28:56.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.349+0000 7fb388ff9700 1 -- 172.21.15.59:0/2170082238 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fb37c0036a0 con 0x7fb38c12f8b0 2023-09-30T22:28:56.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.350+0000 7fb388ff9700 1 -- 172.21.15.59:0/2170082238 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fb37c043350 con 0x7fb38c12f8b0 2023-09-30T22:28:56.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.350+0000 7fb38bfff700 1 -- 172.21.15.59:0/2170082238 >> v1:172.21.15.59:6816/118188 conn(0x7fb37802c1b0 legacy=0x7fb37802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:56.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.359+0000 7fb388ff9700 1 -- 172.21.15.59:0/2170082238 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fb37c040060 con 0x7fb38c12f8b0 2023-09-30T22:28:56.391 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:56.390+0000 7fc05e06b240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T22:28:56.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.435+0000 7ffa2531c700 1 Processor -- start 2023-09-30T22:28:56.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.435+0000 7ffa2531c700 1 -- start start 2023-09-30T22:28:56.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.435+0000 7ffa2531c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009eca0 0x7ffa2013cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.436+0000 7ffa2531c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa2006f050 0x7ffa2013f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.436+0000 7ffa2531c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa20070ee0 con 0x7ffa2006e570 2023-09-30T22:28:56.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.436+0000 7ffa2531c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa20071980 con 0x7ffa2006f050 2023-09-30T22:28:56.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.436+0000 7ffa2531c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa20071480 con 0x7ffa2009eca0 2023-09-30T22:28:56.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.436+0000 7ffa1f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa2006f050 0x7ffa2013f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.436+0000 7ffa1f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa2006f050 0x7ffa2013f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56166/0 (socket says 172.21.15.59:56166) 2023-09-30T22:28:56.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.436+0000 7ffa1f7fe700 1 -- 172.21.15.59:0/4034423529 learned_addr learned my addr 172.21.15.59:0/4034423529 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:56.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.436+0000 7ffa1f7fe700 1 -- 172.21.15.59:0/4034423529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009eca0 msgr2=0x7ffa2013cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:56.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.436+0000 7ffa1f7fe700 1 --2- 172.21.15.59:0/4034423529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009eca0 0x7ffa2013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.436+0000 7ffa1f7fe700 1 -- 172.21.15.59:0/4034423529 >> v1:172.21.15.59:6789/0 conn(0x7ffa2006e570 legacy=0x7ffa2006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:56.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.436+0000 7ffa1f7fe700 1 -- 172.21.15.59:0/4034423529 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa20071b90 con 0x7ffa2006f050 2023-09-30T22:28:56.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.436+0000 7ffa1f7fe700 1 --2- 172.21.15.59:0/4034423529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2006f050 0x7ffa2013f3f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009e50 tx=0x7ffa1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0d27db633593a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.437+0000 7ffa1dffb700 1 -- 172.21.15.59:0/4034423529 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1800e070 con 0x7ffa2006f050 2023-09-30T22:28:56.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.437+0000 7ffa1dffb700 1 -- 172.21.15.59:0/4034423529 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa18003a20 con 0x7ffa2006f050 2023-09-30T22:28:56.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.437+0000 7ffa1dffb700 1 -- 172.21.15.59:0/4034423529 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18003dd0 con 0x7ffa2006f050 2023-09-30T22:28:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.437+0000 7ffa2531c700 1 -- 172.21.15.59:0/4034423529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2006f050 msgr2=0x7ffa2013f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.438+0000 7ffa2531c700 1 --2- 172.21.15.59:0/4034423529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2006f050 0x7ffa2013f3f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009e50 tx=0x7ffa1800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.438+0000 7ffa2531c700 1 -- 172.21.15.59:0/4034423529 shutdown_connections 2023-09-30T22:28:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.438+0000 7ffa2531c700 1 --2- 172.21.15.59:0/4034423529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2006f050 0x7ffa2013f3f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.438+0000 7ffa2531c700 1 --2- 172.21.15.59:0/4034423529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009eca0 0x7ffa2013cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.438+0000 7ffa2531c700 1 -- 172.21.15.59:0/4034423529 >> 172.21.15.59:0/4034423529 conn(0x7ffa200a2aa0 msgr2=0x7ffa200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.438+0000 7ffa2531c700 1 -- 172.21.15.59:0/4034423529 shutdown_connections 2023-09-30T22:28:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.438+0000 7ffa2531c700 1 -- 172.21.15.59:0/4034423529 wait complete. 2023-09-30T22:28:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.439+0000 7ffa2531c700 1 Processor -- start 2023-09-30T22:28:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.439+0000 7ffa2531c700 1 -- start start 2023-09-30T22:28:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.439+0000 7ffa2531c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2006e570 0x7ffa201214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.439+0000 7ffa2531c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2006f050 0x7ffa20121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.439+0000 7ffa2531c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa20121f60 0x7ffa201cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.439+0000 7ffa2531c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2013e730 con 0x7ffa2006e570 2023-09-30T22:28:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.439+0000 7ffa2531c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa20123370 con 0x7ffa20121f60 2023-09-30T22:28:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.439+0000 7ffa2531c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa20070680 con 0x7ffa2006f050 2023-09-30T22:28:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.440+0000 7ffa1effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2006e570 0x7ffa201214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.440+0000 7ffa1effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2006e570 0x7ffa201214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56172/0 (socket says 172.21.15.59:56172) 2023-09-30T22:28:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.440+0000 7ffa1effd700 1 -- 172.21.15.59:0/3079500395 learned_addr learned my addr 172.21.15.59:0/3079500395 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.440+0000 7ffa1e7fc700 1 --2- 172.21.15.59:0/3079500395 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2006f050 0x7ffa20121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.440+0000 7ffa1effd700 1 -- 172.21.15.59:0/3079500395 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2006f050 msgr2=0x7ffa20121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.440+0000 7ffa1effd700 1 --2- 172.21.15.59:0/3079500395 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2006f050 0x7ffa20121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.440+0000 7ffa1effd700 1 -- 172.21.15.59:0/3079500395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa20121f60 msgr2=0x7ffa201cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.440+0000 7ffa1effd700 1 --2- 172.21.15.59:0/3079500395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa20121f60 0x7ffa201cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.440+0000 7ffa1effd700 1 -- 172.21.15.59:0/3079500395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa18009b30 con 0x7ffa2006e570 2023-09-30T22:28:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.440+0000 7ffa1effd700 1 --2- 172.21.15.59:0/3079500395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2006e570 0x7ffa201214e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000c4a0 tx=0x7ffa1000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.441+0000 7ffa077fe700 1 -- 172.21.15.59:0/3079500395 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa100054e0 con 0x7ffa2006e570 2023-09-30T22:28:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.441+0000 7ffa077fe700 1 -- 172.21.15.59:0/3079500395 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa10003680 con 0x7ffa2006e570 2023-09-30T22:28:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.441+0000 7ffa2531c700 1 -- 172.21.15.59:0/3079500395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2009a3e0 con 0x7ffa2006e570 2023-09-30T22:28:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.441+0000 7ffa077fe700 1 -- 172.21.15.59:0/3079500395 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10003a30 con 0x7ffa2006e570 2023-09-30T22:28:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.441+0000 7ffa2531c700 1 -- 172.21.15.59:0/3079500395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa20123d50 con 0x7ffa2006e570 2023-09-30T22:28:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.442+0000 7ffa2531c700 1 -- 172.21.15.59:0/3079500395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa20122900 con 0x7ffa2006e570 2023-09-30T22:28:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.443+0000 7ffa077fe700 1 -- 172.21.15.59:0/3079500395 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7ffa10003b90 con 0x7ffa2006e570 2023-09-30T22:28:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.443+0000 7ffa077fe700 1 -- 172.21.15.59:0/3079500395 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7ffa1003b0e0 con 0x7ffa2006e570 2023-09-30T22:28:56.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.445+0000 7ffa1e7fc700 1 -- 172.21.15.59:0/3079500395 >> v1:172.21.15.59:6816/118188 conn(0x7ffa0c02c1e0 legacy=0x7ffa0c02e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:56.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.447+0000 7f69ff7dd700 1 Processor -- start 2023-09-30T22:28:56.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.447+0000 7f69ff7dd700 1 -- start start 2023-09-30T22:28:56.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.448+0000 7f69ff7dd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69f809d6f0 0x7f69f809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.448+0000 7f69ff7dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69f809e410 0x7f69f8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.448+0000 7f69ff7dd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f809f130 con 0x7f69f809e000 2023-09-30T22:28:56.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.448+0000 7f69ff7dd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f809f520 con 0x7f69f809d6f0 2023-09-30T22:28:56.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.448+0000 7f69ff7dd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69f809e930 con 0x7f69f809e410 2023-09-30T22:28:56.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.448+0000 7f69fdd7a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69f809e410 0x7f69f8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.448+0000 7f69fdd7a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69f809e410 0x7f69f8130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39722/0 (socket says 172.21.15.59:39722) 2023-09-30T22:28:56.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.448+0000 7f69fdd7a700 1 -- 172.21.15.59:0/2939106939 learned_addr learned my addr 172.21.15.59:0/2939106939 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:56.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.448+0000 7f69fd579700 1 --2- 172.21.15.59:0/2939106939 >> v2:172.21.15.59:3300/0 conn(0x7f69f809d6f0 0x7f69f809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.448+0000 7f69fdd7a700 1 -- 172.21.15.59:0/2939106939 >> v2:172.21.15.59:3300/0 conn(0x7f69f809d6f0 msgr2=0x7f69f809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.448+0000 7f69fdd7a700 1 --2- 172.21.15.59:0/2939106939 >> v2:172.21.15.59:3300/0 conn(0x7f69f809d6f0 0x7f69f809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.448+0000 7f69fdd7a700 1 -- 172.21.15.59:0/2939106939 >> v1:172.21.15.59:6789/0 conn(0x7f69f809e000 legacy=0x7f69f8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.448+0000 7f69fdd7a700 1 -- 172.21.15.59:0/2939106939 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f809b2d0 con 0x7f69f809e410 2023-09-30T22:28:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.449+0000 7f69fdd7a700 1 --2- 172.21.15.59:0/2939106939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69f809e410 0x7f69f8130d70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f69f0009e50 tx=0x7f69f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d0994bb6be3af7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.449+0000 7f69effff700 1 -- 172.21.15.59:0/2939106939 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f000e070 con 0x7f69f809e410 2023-09-30T22:28:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.449+0000 7f69effff700 1 -- 172.21.15.59:0/2939106939 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f000b9c0 con 0x7f69f809e410 2023-09-30T22:28:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.449+0000 7f69effff700 1 -- 172.21.15.59:0/2939106939 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f000bd70 con 0x7f69f809e410 2023-09-30T22:28:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.450+0000 7f69ff7dd700 1 -- 172.21.15.59:0/2939106939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69f809e410 msgr2=0x7f69f8130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.450+0000 7f69ff7dd700 1 --2- 172.21.15.59:0/2939106939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69f809e410 0x7f69f8130d70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f69f0009e50 tx=0x7f69f000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.450+0000 7f69ff7dd700 1 -- 172.21.15.59:0/2939106939 shutdown_connections 2023-09-30T22:28:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.450+0000 7f69ff7dd700 1 --2- 172.21.15.59:0/2939106939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69f809e410 0x7f69f8130d70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.450+0000 7f69ff7dd700 1 --2- 172.21.15.59:0/2939106939 >> v2:172.21.15.59:3300/0 conn(0x7f69f809d6f0 0x7f69f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.450+0000 7f69ff7dd700 1 -- 172.21.15.59:0/2939106939 >> 172.21.15.59:0/2939106939 conn(0x7f69f8066f50 msgr2=0x7f69f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.450+0000 7f69ff7dd700 1 -- 172.21.15.59:0/2939106939 shutdown_connections 2023-09-30T22:28:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.450+0000 7f69ff7dd700 1 -- 172.21.15.59:0/2939106939 wait complete. 2023-09-30T22:28:56.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.452+0000 7ffa077fe700 1 -- 172.21.15.59:0/3079500395 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7ffa10003e40 con 0x7ffa2006e570 2023-09-30T22:28:56.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.452+0000 7f69ff7dd700 1 Processor -- start 2023-09-30T22:28:56.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.452+0000 7f69ff7dd700 1 -- start start 2023-09-30T22:28:56.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.453+0000 7f69ff7dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69f809d6f0 0x7f69f81224a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.453+0000 7f69ff7dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69f809e000 0x7f69f81229e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.453+0000 7f69ff7dd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69f809e410 0x7f69f8122f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.453+0000 7f69ff7dd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f81240f0 con 0x7f69f809e410 2023-09-30T22:28:56.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.453+0000 7f69ff7dd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8125c80 con 0x7f69f809d6f0 2023-09-30T22:28:56.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.453+0000 7f69ff7dd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69f809c700 con 0x7f69f809e000 2023-09-30T22:28:56.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.453+0000 7f69fcd78700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69f809e000 0x7f69f81229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.453+0000 7f69fcd78700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69f809e000 0x7f69f81229e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39728/0 (socket says 172.21.15.59:39728) 2023-09-30T22:28:56.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.453+0000 7f69fcd78700 1 -- 172.21.15.59:0/2356953991 learned_addr learned my addr 172.21.15.59:0/2356953991 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:56.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.453+0000 7f69fd579700 1 --2- 172.21.15.59:0/2356953991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69f809d6f0 0x7f69f81224a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.453+0000 7f69fdd7a700 1 --2- 172.21.15.59:0/2356953991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69f809e410 0x7f69f8122f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.454+0000 7f69fcd78700 1 -- 172.21.15.59:0/2356953991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69f809d6f0 msgr2=0x7f69f81224a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.454+0000 7f69fcd78700 1 --2- 172.21.15.59:0/2356953991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69f809d6f0 0x7f69f81224a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.454+0000 7f69fcd78700 1 -- 172.21.15.59:0/2356953991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69f809e410 msgr2=0x7f69f8122f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.454+0000 7f69fcd78700 1 --2- 172.21.15.59:0/2356953991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69f809e410 0x7f69f8122f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.454+0000 7f69fcd78700 1 -- 172.21.15.59:0/2356953991 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f0009b30 con 0x7f69f809e000 2023-09-30T22:28:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.454+0000 7f69fcd78700 1 --2- 172.21.15.59:0/2356953991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69f809e000 0x7f69f81229e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f69e800c4e0 tx=0x7f69e800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.454+0000 7f69edffb700 1 -- 172.21.15.59:0/2356953991 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e8011790 con 0x7f69f809e000 2023-09-30T22:28:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.454+0000 7f69edffb700 1 -- 172.21.15.59:0/2356953991 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e80118f0 con 0x7f69f809e000 2023-09-30T22:28:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.454+0000 7f69edffb700 1 -- 172.21.15.59:0/2356953991 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e8011c60 con 0x7f69f809e000 2023-09-30T22:28:56.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.454+0000 7f69ff7dd700 1 -- 172.21.15.59:0/2356953991 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f8124840 con 0x7f69f809e000 2023-09-30T22:28:56.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.455+0000 7f69ff7dd700 1 -- 172.21.15.59:0/2356953991 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f8125f60 con 0x7f69f809e000 2023-09-30T22:28:56.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.456+0000 7f69ff7dd700 1 -- 172.21.15.59:0/2356953991 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f8074ea0 con 0x7f69f809e000 2023-09-30T22:28:56.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.458+0000 7f69edffb700 1 -- 172.21.15.59:0/2356953991 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f69e80050d0 con 0x7f69f809e000 2023-09-30T22:28:56.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.459+0000 7f69edffb700 1 -- 172.21.15.59:0/2356953991 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f69e803bca0 con 0x7f69f809e000 2023-09-30T22:28:56.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.460+0000 7f69fd579700 1 -- 172.21.15.59:0/2356953991 >> v1:172.21.15.59:6816/118188 conn(0x7f69dc02c1b0 legacy=0x7f69dc02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:56.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.465+0000 7f69edffb700 1 -- 172.21.15.59:0/2356953991 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f69e8024d70 con 0x7f69f809e000 2023-09-30T22:28:56.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.508+0000 7fd68659c700 1 -- 172.21.15.59:0/3963317693 >> v1:172.21.15.59:6816/118188 conn(0x7fd66802c200 legacy=0x7fd66802e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:56.530 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:56.529+0000 7fc05e06b240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T22:28:56.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.551+0000 7fb38bfff700 1 -- 172.21.15.59:0/2170082238 >> v1:172.21.15.59:6816/118188 conn(0x7fb37802c1b0 legacy=0x7fb37802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:56.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.554+0000 7fb392725700 1 -- 172.21.15.59:0/2170082238 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb38c1b89c0 con 0x7fb38c12f8b0 2023-09-30T22:28:56.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.555+0000 7fb388ff9700 1 -- 172.21.15.59:0/2170082238 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb38c1b89c0 con 0x7fb38c12f8b0 2023-09-30T22:28:56.556 INFO:teuthology.orchestra.run.smithi059.stdout:42949672990 2023-09-30T22:28:56.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.557+0000 7fb392725700 1 -- 172.21.15.59:0/2170082238 >> v1:172.21.15.59:6816/118188 conn(0x7fb37802c1b0 legacy=0x7fb37802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:56.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.557+0000 7fb392725700 1 -- 172.21.15.59:0/2170082238 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb38c12f8b0 msgr2=0x7fb38c1d24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.557+0000 7fb392725700 1 --2- 172.21.15.59:0/2170082238 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb38c12f8b0 0x7fb38c1d24d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00e7e0 tx=0x7fb37c00eaf0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.558+0000 7fb392725700 1 -- 172.21.15.59:0/2170082238 shutdown_connections 2023-09-30T22:28:56.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.558+0000 7fb392725700 1 --2- 172.21.15.59:0/2170082238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb38c130260 0x7fb38c1b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.558+0000 7fb392725700 1 --2- 172.21.15.59:0/2170082238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb38c12cf60 0x7fb38c1d1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.558+0000 7fb392725700 1 --2- 172.21.15.59:0/2170082238 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb38c12f8b0 0x7fb38c1d24d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.558+0000 7fb392725700 1 -- 172.21.15.59:0/2170082238 >> 172.21.15.59:0/2170082238 conn(0x7fb38c0a2aa0 msgr2=0x7fb38c0a1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.558+0000 7fb392725700 1 -- 172.21.15.59:0/2170082238 shutdown_connections 2023-09-30T22:28:56.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.558+0000 7fb392725700 1 -- 172.21.15.59:0/2170082238 wait complete. 2023-09-30T22:28:56.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672991 got 42949672990 for osd.2 2023-09-30T22:28:56.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.643+0000 7ffa2531c700 1 -- 172.21.15.59:0/3079500395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa20074ea0 con 0x7ffa2006e570 2023-09-30T22:28:56.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.644+0000 7ffa077fe700 1 -- 172.21.15.59:0/3079500395 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa10019730 con 0x7ffa2006e570 2023-09-30T22:28:56.645 INFO:teuthology.orchestra.run.smithi059.stdout:38654705694 2023-09-30T22:28:56.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.646+0000 7ffa1e7fc700 1 -- 172.21.15.59:0/3079500395 >> v1:172.21.15.59:6816/118188 conn(0x7ffa0c02c1e0 legacy=0x7ffa0c02e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:56.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.646+0000 7ffa2531c700 1 -- 172.21.15.59:0/3079500395 >> v1:172.21.15.59:6816/118188 conn(0x7ffa0c02c1e0 legacy=0x7ffa0c02e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:56.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.646+0000 7ffa2531c700 1 -- 172.21.15.59:0/3079500395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2006e570 msgr2=0x7ffa201214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.646+0000 7ffa2531c700 1 --2- 172.21.15.59:0/3079500395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2006e570 0x7ffa201214e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000c4a0 tx=0x7ffa1000c7b0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.646+0000 7ffa2531c700 1 -- 172.21.15.59:0/3079500395 shutdown_connections 2023-09-30T22:28:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.646+0000 7ffa2531c700 1 --2- 172.21.15.59:0/3079500395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa20121f60 0x7ffa201cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.646+0000 7ffa2531c700 1 --2- 172.21.15.59:0/3079500395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2006e570 0x7ffa201214e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.646+0000 7ffa2531c700 1 --2- 172.21.15.59:0/3079500395 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2006f050 0x7ffa20121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.646+0000 7ffa2531c700 1 -- 172.21.15.59:0/3079500395 >> 172.21.15.59:0/3079500395 conn(0x7ffa200a2aa0 msgr2=0x7ffa200a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.646+0000 7ffa2531c700 1 -- 172.21.15.59:0/3079500395 shutdown_connections 2023-09-30T22:28:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.646+0000 7ffa2531c700 1 -- 172.21.15.59:0/3079500395 wait complete. 2023-09-30T22:28:56.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.652+0000 7f69ff7dd700 1 -- 172.21.15.59:0/2356953991 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f69f8125920 con 0x7f69f809e000 2023-09-30T22:28:56.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.652+0000 7f69edffb700 1 -- 172.21.15.59:0/2356953991 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69e8024330 con 0x7f69f809e000 2023-09-30T22:28:56.653 INFO:teuthology.orchestra.run.smithi059.stdout:42949672990 2023-09-30T22:28:56.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.655+0000 7f69ff7dd700 1 -- 172.21.15.59:0/2356953991 >> v1:172.21.15.59:6816/118188 conn(0x7f69dc02c1b0 legacy=0x7f69dc02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:56.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.655+0000 7f69ff7dd700 1 -- 172.21.15.59:0/2356953991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69f809e000 msgr2=0x7f69f81229e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.655+0000 7f69ff7dd700 1 --2- 172.21.15.59:0/2356953991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69f809e000 0x7f69f81229e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f69e800c4e0 tx=0x7f69e800c7f0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.655+0000 7f69ff7dd700 1 -- 172.21.15.59:0/2356953991 shutdown_connections 2023-09-30T22:28:56.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.655+0000 7f69ff7dd700 1 --2- 172.21.15.59:0/2356953991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69f809e410 0x7f69f8122f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.655+0000 7f69ff7dd700 1 --2- 172.21.15.59:0/2356953991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69f809d6f0 0x7f69f81224a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.655+0000 7f69ff7dd700 1 --2- 172.21.15.59:0/2356953991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69f809e000 0x7f69f81229e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.655+0000 7f69ff7dd700 1 -- 172.21.15.59:0/2356953991 >> 172.21.15.59:0/2356953991 conn(0x7f69f8066f50 msgr2=0x7f69f8130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.655+0000 7f69ff7dd700 1 -- 172.21.15.59:0/2356953991 shutdown_connections 2023-09-30T22:28:56.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.655+0000 7f69ff7dd700 1 -- 172.21.15.59:0/2356953991 wait complete. 2023-09-30T22:28:56.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.657+0000 7fd68cb88700 1 -- 172.21.15.59:0/3963317693 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd6880713a0 con 0x7fd68812f8b0 2023-09-30T22:28:56.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.657+0000 7fd676ffd700 1 -- 172.21.15.59:0/3963317693 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd67c026070 con 0x7fd68812f8b0 2023-09-30T22:28:56.659 INFO:teuthology.orchestra.run.smithi059.stdout:38654705694 2023-09-30T22:28:56.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.661+0000 7fd68cb88700 1 -- 172.21.15.59:0/3963317693 >> v1:172.21.15.59:6816/118188 conn(0x7fd66802c200 legacy=0x7fd66802e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:56.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.661+0000 7fd68cb88700 1 -- 172.21.15.59:0/3963317693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd68812f8b0 msgr2=0x7fd6881290d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.661+0000 7fd68cb88700 1 --2- 172.21.15.59:0/3963317693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd68812f8b0 0x7fd6881290d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00dd90 tx=0x7fd67c009400 comp rx=0 tx=0).stop 2023-09-30T22:28:56.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.661+0000 7fd68cb88700 1 -- 172.21.15.59:0/3963317693 shutdown_connections 2023-09-30T22:28:56.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.661+0000 7fd68cb88700 1 --2- 172.21.15.59:0/3963317693 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd68812cf60 0x7fd688128b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.661+0000 7fd68cb88700 1 --2- 172.21.15.59:0/3963317693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd688130260 0x7fd68809afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.661+0000 7fd68cb88700 1 --2- 172.21.15.59:0/3963317693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd68812f8b0 0x7fd6881290d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.661+0000 7fd68cb88700 1 -- 172.21.15.59:0/3963317693 >> 172.21.15.59:0/3963317693 conn(0x7fd6880a2aa0 msgr2=0x7fd68806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.662+0000 7fd68cb88700 1 -- 172.21.15.59:0/3963317693 shutdown_connections 2023-09-30T22:28:56.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:56.662+0000 7fd68cb88700 1 -- 172.21.15.59:0/3963317693 wait complete. 2023-09-30T22:28:56.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705694 for osd.3 2023-09-30T22:28:56.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672991 got 42949672990 for osd.0 2023-09-30T22:28:56.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705694 for osd.1 2023-09-30T22:28:56.886 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:56.886+0000 7fc05e06b240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T22:28:56.980 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:56.981+0000 7fc05e06b240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T22:28:57.157 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:57.157+0000 7fc05e06b240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T22:28:57.238 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:57.238+0000 7fc05e06b240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T22:28:57.574 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:57.664 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:57.673 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:57.678 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:57.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.722+0000 7fef7bf8b700 1 Processor -- start 2023-09-30T22:28:57.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.722+0000 7fef7bf8b700 1 -- start start 2023-09-30T22:28:57.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.723+0000 7fef7bf8b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef7409d6f0 0x7fef7409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.723+0000 7fef7bf8b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7409e000 0x7fef741339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.723+0000 7fef7bf8b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7409b120 con 0x7fef7409e410 2023-09-30T22:28:57.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.723+0000 7fef7bf8b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7406b460 con 0x7fef7409d6f0 2023-09-30T22:28:57.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.723+0000 7fef7bf8b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef7409a7e0 con 0x7fef7409e000 2023-09-30T22:28:57.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.724+0000 7fef79d27700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef7409d6f0 0x7fef7409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.724+0000 7fef79d27700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef7409d6f0 0x7fef7409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56194/0 (socket says 172.21.15.59:56194) 2023-09-30T22:28:57.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.724+0000 7fef79d27700 1 -- 172.21.15.59:0/1892875421 learned_addr learned my addr 172.21.15.59:0/1892875421 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:57.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.724+0000 7fef79526700 1 --2- 172.21.15.59:0/1892875421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7409e000 0x7fef741339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.724+0000 7fef79d27700 1 -- 172.21.15.59:0/1892875421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7409e000 msgr2=0x7fef741339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.724+0000 7fef79d27700 1 --2- 172.21.15.59:0/1892875421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7409e000 0x7fef741339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.724+0000 7fef79d27700 1 -- 172.21.15.59:0/1892875421 >> v1:172.21.15.59:6789/0 conn(0x7fef7409e410 legacy=0x7fef74133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.725+0000 7fef79d27700 1 -- 172.21.15.59:0/1892875421 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7409a500 con 0x7fef7409d6f0 2023-09-30T22:28:57.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.724+0000 7fef78d25700 1 -- 172.21.15.59:0/1892875421 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786078707 0 0) 0x7fef7409b120 con 0x7fef7409e410 2023-09-30T22:28:57.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.725+0000 7fef79526700 1 --2- 172.21.15.59:0/1892875421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7409e000 0x7fef741339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:57.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.725+0000 7fef79d27700 1 --2- 172.21.15.59:0/1892875421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7409d6f0 0x7fef7409dac0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fef700131e0 tx=0x7fef700134f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5acfb030875df69 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.725+0000 7fef78d25700 1 -- 172.21.15.59:0/1892875421 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70016070 con 0x7fef7409d6f0 2023-09-30T22:28:57.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.725+0000 7fef78d25700 1 -- 172.21.15.59:0/1892875421 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef70013e30 con 0x7fef7409d6f0 2023-09-30T22:28:57.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.725+0000 7fef78d25700 1 -- 172.21.15.59:0/1892875421 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700112f0 con 0x7fef7409d6f0 2023-09-30T22:28:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.726+0000 7fef7bf8b700 1 -- 172.21.15.59:0/1892875421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7409d6f0 msgr2=0x7fef7409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.726+0000 7fef7bf8b700 1 --2- 172.21.15.59:0/1892875421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7409d6f0 0x7fef7409dac0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fef700131e0 tx=0x7fef700134f0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.726+0000 7fef7bf8b700 1 -- 172.21.15.59:0/1892875421 shutdown_connections 2023-09-30T22:28:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.726+0000 7fef7bf8b700 1 --2- 172.21.15.59:0/1892875421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7409d6f0 0x7fef7409dac0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.726+0000 7fef7bf8b700 1 --2- 172.21.15.59:0/1892875421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7409e000 0x7fef741339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.726+0000 7fef7bf8b700 1 -- 172.21.15.59:0/1892875421 >> 172.21.15.59:0/1892875421 conn(0x7fef74066f50 msgr2=0x7fef7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.726+0000 7fef7bf8b700 1 -- 172.21.15.59:0/1892875421 shutdown_connections 2023-09-30T22:28:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.726+0000 7fef7bf8b700 1 -- 172.21.15.59:0/1892875421 wait complete. 2023-09-30T22:28:57.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.728+0000 7fef7bf8b700 1 Processor -- start 2023-09-30T22:28:57.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.728+0000 7fef7bf8b700 1 -- start start 2023-09-30T22:28:57.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.729+0000 7fef7bf8b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7409d6f0 0x7fef741c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.729+0000 7fef7bf8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7409e000 0x7fef741c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.729+0000 7fef7bf8b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7409e410 0x7fef741c05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.729+0000 7fef7bf8b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef741a4ee0 con 0x7fef7409e410 2023-09-30T22:28:57.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.729+0000 7fef7bf8b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef741a50c0 con 0x7fef7409e000 2023-09-30T22:28:57.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.729+0000 7fef7bf8b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef741c4ab0 con 0x7fef7409d6f0 2023-09-30T22:28:57.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.729+0000 7fef7a528700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7409e410 0x7fef741c05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.729+0000 7fef7a528700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7409e410 0x7fef741c05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56208/0 (socket says 172.21.15.59:56208) 2023-09-30T22:28:57.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.729+0000 7fef7a528700 1 -- 172.21.15.59:0/2347088384 learned_addr learned my addr 172.21.15.59:0/2347088384 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:57.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.730+0000 7fef79526700 1 --2- 172.21.15.59:0/2347088384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7409e000 0x7fef741c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.730+0000 7fef79d27700 1 --2- 172.21.15.59:0/2347088384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7409d6f0 0x7fef741c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.730+0000 7fef7a528700 1 -- 172.21.15.59:0/2347088384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7409d6f0 msgr2=0x7fef741c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.730+0000 7fef7a528700 1 --2- 172.21.15.59:0/2347088384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7409d6f0 0x7fef741c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.730+0000 7fef7a528700 1 -- 172.21.15.59:0/2347088384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7409e000 msgr2=0x7fef741c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.730+0000 7fef7a528700 1 --2- 172.21.15.59:0/2347088384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7409e000 0x7fef741c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.730+0000 7fef7a528700 1 -- 172.21.15.59:0/2347088384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef70011df0 con 0x7fef7409e410 2023-09-30T22:28:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.730+0000 7fef79526700 1 --2- 172.21.15.59:0/2347088384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7409e000 0x7fef741c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:28:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.730+0000 7fef79d27700 1 --2- 172.21.15.59:0/2347088384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7409d6f0 0x7fef741c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:28:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.730+0000 7fef7a528700 1 --2- 172.21.15.59:0/2347088384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7409e410 0x7fef741c05c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00c870 tx=0x7fef6c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.730+0000 7fef6a7fc700 1 -- 172.21.15.59:0/2347088384 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c003e30 con 0x7fef7409e410 2023-09-30T22:28:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.730+0000 7fef6a7fc700 1 -- 172.21.15.59:0/2347088384 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c00ce70 con 0x7fef7409e410 2023-09-30T22:28:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.730+0000 7fef6a7fc700 1 -- 172.21.15.59:0/2347088384 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c005290 con 0x7fef7409e410 2023-09-30T22:28:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.730+0000 7fef7bf8b700 1 -- 172.21.15.59:0/2347088384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef741a3a40 con 0x7fef7409e410 2023-09-30T22:28:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.730+0000 7fef7bf8b700 1 -- 172.21.15.59:0/2347088384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef741a3490 con 0x7fef7409e410 2023-09-30T22:28:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.732+0000 7fef7bf8b700 1 -- 172.21.15.59:0/2347088384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef74074ea0 con 0x7fef7409e410 2023-09-30T22:28:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.733+0000 7fef6a7fc700 1 -- 172.21.15.59:0/2347088384 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fef6c0053f0 con 0x7fef7409e410 2023-09-30T22:28:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.733+0000 7fef6a7fc700 1 -- 172.21.15.59:0/2347088384 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fef6c03c0d0 con 0x7fef7409e410 2023-09-30T22:28:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.733+0000 7fef79d27700 1 -- 172.21.15.59:0/2347088384 >> v1:172.21.15.59:6816/118188 conn(0x7fef5802c1b0 legacy=0x7fef5802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:57.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.741+0000 7fef6a7fc700 1 -- 172.21.15.59:0/2347088384 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fef6c0056a0 con 0x7fef7409e410 2023-09-30T22:28:57.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.845+0000 7fa03948a700 1 Processor -- start 2023-09-30T22:28:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.845+0000 7fa03948a700 1 -- start start 2023-09-30T22:28:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.846+0000 7fa03948a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03409eca0 0x7fa03413cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.846+0000 7fa03948a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03406f050 0x7fa03413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.846+0000 7fa03948a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa034070ee0 con 0x7fa03406e570 2023-09-30T22:28:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.846+0000 7fa03948a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa034071980 con 0x7fa03406f050 2023-09-30T22:28:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.846+0000 7fa03948a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa034071480 con 0x7fa03409eca0 2023-09-30T22:28:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.846+0000 7fa0327fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03409eca0 0x7fa03413cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.846+0000 7fa0327fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03409eca0 0x7fa03413cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39754/0 (socket says 172.21.15.59:39754) 2023-09-30T22:28:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.846+0000 7fa0327fc700 1 -- 172.21.15.59:0/3252325684 learned_addr learned my addr 172.21.15.59:0/3252325684 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.846+0000 7fa0337fe700 1 --2- 172.21.15.59:0/3252325684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03406f050 0x7fa03413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.847+0000 7fa0327fc700 1 -- 172.21.15.59:0/3252325684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03406f050 msgr2=0x7fa03413f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.847+0000 7fa0327fc700 1 --2- 172.21.15.59:0/3252325684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03406f050 0x7fa03413f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.847+0000 7fa0327fc700 1 -- 172.21.15.59:0/3252325684 >> v1:172.21.15.59:6789/0 conn(0x7fa03406e570 legacy=0x7fa03406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.847+0000 7fa0327fc700 1 -- 172.21.15.59:0/3252325684 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa034071b90 con 0x7fa03409eca0 2023-09-30T22:28:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.847+0000 7fa0327fc700 1 --2- 172.21.15.59:0/3252325684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03409eca0 0x7fa03413cea0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa028009920 tx=0x7fa028009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa95085112589694 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.847+0000 7fa031ffb700 1 -- 172.21.15.59:0/3252325684 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa028004230 con 0x7fa03409eca0 2023-09-30T22:28:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.847+0000 7fa031ffb700 1 -- 172.21.15.59:0/3252325684 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa028004390 con 0x7fa03409eca0 2023-09-30T22:28:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.847+0000 7fa031ffb700 1 -- 172.21.15.59:0/3252325684 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa028009e70 con 0x7fa03409eca0 2023-09-30T22:28:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.848+0000 7fa03948a700 1 -- 172.21.15.59:0/3252325684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03409eca0 msgr2=0x7fa03413cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.848+0000 7fa03948a700 1 --2- 172.21.15.59:0/3252325684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03409eca0 0x7fa03413cea0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa028009920 tx=0x7fa028009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.848+0000 7fa03948a700 1 -- 172.21.15.59:0/3252325684 shutdown_connections 2023-09-30T22:28:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.848+0000 7fa03948a700 1 --2- 172.21.15.59:0/3252325684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03406f050 0x7fa03413f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.848+0000 7fa03948a700 1 --2- 172.21.15.59:0/3252325684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03409eca0 0x7fa03413cea0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.848+0000 7fa03948a700 1 -- 172.21.15.59:0/3252325684 >> 172.21.15.59:0/3252325684 conn(0x7fa0340a2aa0 msgr2=0x7fa0340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.848+0000 7fa03948a700 1 -- 172.21.15.59:0/3252325684 shutdown_connections 2023-09-30T22:28:57.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.848+0000 7fa03948a700 1 -- 172.21.15.59:0/3252325684 wait complete. 2023-09-30T22:28:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.849+0000 7fa03948a700 1 Processor -- start 2023-09-30T22:28:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.850+0000 7fa03948a700 1 -- start start 2023-09-30T22:28:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.850+0000 7fa03948a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03406e570 0x7fa03413cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.850+0000 7fa03948a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03406f050 0x7fa03413d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.850+0000 7fa03948a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03412e180 0x7fa03413d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.850+0000 7fa03948a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03413ec60 con 0x7fa03406e570 2023-09-30T22:28:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.850+0000 7fa03948a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa034070610 con 0x7fa03412e180 2023-09-30T22:28:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.850+0000 7fa03948a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa03412d410 con 0x7fa03406f050 2023-09-30T22:28:57.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.850+0000 7fa0337fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03412e180 0x7fa03413d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.850+0000 7fa0337fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03412e180 0x7fa03413d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36632/0 (socket says 172.21.15.59:36632) 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.850+0000 7fa0337fe700 1 -- 172.21.15.59:0/1640224778 learned_addr learned my addr 172.21.15.59:0/1640224778 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.850+0000 7fa032ffd700 1 --2- 172.21.15.59:0/1640224778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03406e570 0x7fa03413cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.851+0000 7fa0327fc700 1 --2- 172.21.15.59:0/1640224778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03406f050 0x7fa03413d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.851+0000 7fa0337fe700 1 -- 172.21.15.59:0/1640224778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03406f050 msgr2=0x7fa03413d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.851+0000 7fa0337fe700 1 --2- 172.21.15.59:0/1640224778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03406f050 0x7fa03413d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.851+0000 7fa0337fe700 1 -- 172.21.15.59:0/1640224778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03406e570 msgr2=0x7fa03413cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.851+0000 7fa0337fe700 1 --2- 172.21.15.59:0/1640224778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03406e570 0x7fa03413cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.851+0000 7fa0337fe700 1 -- 172.21.15.59:0/1640224778 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa028009550 con 0x7fa03412e180 2023-09-30T22:28:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.851+0000 7fa0337fe700 1 --2- 172.21.15.59:0/1640224778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03412e180 0x7fa03413d820 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa02c007e40 tx=0x7fa02c00e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.851+0000 7fa01b7fe700 1 -- 172.21.15.59:0/1640224778 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c00ed30 con 0x7fa03412e180 2023-09-30T22:28:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.851+0000 7fa01b7fe700 1 -- 172.21.15.59:0/1640224778 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c014420 con 0x7fa03412e180 2023-09-30T22:28:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.851+0000 7fa01b7fe700 1 -- 172.21.15.59:0/1640224778 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c0147d0 con 0x7fa03412e180 2023-09-30T22:28:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.852+0000 7fa03948a700 1 -- 172.21.15.59:0/1640224778 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03412dd20 con 0x7fa03412e180 2023-09-30T22:28:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.852+0000 7fa03948a700 1 -- 172.21.15.59:0/1640224778 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03412c4f0 con 0x7fa03412e180 2023-09-30T22:28:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.853+0000 7fa03948a700 1 -- 172.21.15.59:0/1640224778 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa034074ea0 con 0x7fa03412e180 2023-09-30T22:28:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.853+0000 7fa01b7fe700 1 -- 172.21.15.59:0/1640224778 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fa02c014930 con 0x7fa03412e180 2023-09-30T22:28:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.853+0000 7fa032ffd700 1 -- 172.21.15.59:0/1640224778 >> v1:172.21.15.59:6816/118188 conn(0x7fa02002c1b0 legacy=0x7fa02002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:57.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.858+0000 7fb834f5c700 1 Processor -- start 2023-09-30T22:28:57.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.858+0000 7fb834f5c700 1 -- start start 2023-09-30T22:28:57.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.859+0000 7fb834f5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8301338c0 0x7fb830133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.859+0000 7fb834f5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8301341d0 0x7fb83009de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.859+0000 7fb834f5c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb83009e390 0x7fb83009e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.859+0000 7fb834f5c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb830070c80 con 0x7fb83009e390 2023-09-30T22:28:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.859+0000 7fb834f5c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83006f720 con 0x7fb8301338c0 2023-09-30T22:28:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.859+0000 7fb834f5c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb83006fce0 con 0x7fb8301341d0 2023-09-30T22:28:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.859+0000 7fb82dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8301341d0 0x7fb83009de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.859+0000 7fb82ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb83009e390 0x7fb83009e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.859+0000 7fb82dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8301341d0 0x7fb83009de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39764/0 (socket says 172.21.15.59:39764) 2023-09-30T22:28:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.859+0000 7fb82dd9b700 1 -- 172.21.15.59:0/1723020529 learned_addr learned my addr 172.21.15.59:0/1723020529 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.860+0000 7fb82dd9b700 1 -- 172.21.15.59:0/1723020529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8301338c0 msgr2=0x7fb830133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.860+0000 7fb82dd9b700 1 --2- 172.21.15.59:0/1723020529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8301338c0 0x7fb830133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.860+0000 7fb82dd9b700 1 -- 172.21.15.59:0/1723020529 >> v2:172.21.15.59:3300/0 conn(0x7fb83009e390 msgr2=0x7fb83009e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.860+0000 7fb82dd9b700 1 --2- 172.21.15.59:0/1723020529 >> v2:172.21.15.59:3300/0 conn(0x7fb83009e390 0x7fb83009e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.860+0000 7fb82dd9b700 1 -- 172.21.15.59:0/1723020529 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8301336a0 con 0x7fb8301341d0 2023-09-30T22:28:57.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.860+0000 7fb82ed9d700 1 --2- 172.21.15.59:0/1723020529 >> v2:172.21.15.59:3300/0 conn(0x7fb83009e390 0x7fb83009e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:57.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.860+0000 7fb82dd9b700 1 --2- 172.21.15.59:0/1723020529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8301341d0 0x7fb83009de50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb8240098f0 tx=0x7fb824009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c265ef5b5af61932 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.860+0000 7fb82d59a700 1 -- 172.21.15.59:0/1723020529 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824011830 con 0x7fb8301341d0 2023-09-30T22:28:57.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.860+0000 7fb82d59a700 1 -- 172.21.15.59:0/1723020529 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb824011990 con 0x7fb8301341d0 2023-09-30T22:28:57.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.860+0000 7fb82d59a700 1 -- 172.21.15.59:0/1723020529 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824011d20 con 0x7fb8301341d0 2023-09-30T22:28:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.861+0000 7fb834f5c700 1 -- 172.21.15.59:0/1723020529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8301341d0 msgr2=0x7fb83009de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.861+0000 7fb834f5c700 1 --2- 172.21.15.59:0/1723020529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8301341d0 0x7fb83009de50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb8240098f0 tx=0x7fb824009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.861+0000 7fb834f5c700 1 -- 172.21.15.59:0/1723020529 shutdown_connections 2023-09-30T22:28:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.861+0000 7fb834f5c700 1 --2- 172.21.15.59:0/1723020529 >> v2:172.21.15.59:3300/0 conn(0x7fb83009e390 0x7fb83009e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.861+0000 7fb834f5c700 1 --2- 172.21.15.59:0/1723020529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8301338c0 0x7fb830133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.861+0000 7fb834f5c700 1 --2- 172.21.15.59:0/1723020529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8301341d0 0x7fb83009de50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.861+0000 7fb834f5c700 1 -- 172.21.15.59:0/1723020529 >> 172.21.15.59:0/1723020529 conn(0x7fb8300a2aa0 msgr2=0x7fb8300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.861+0000 7fb834f5c700 1 -- 172.21.15.59:0/1723020529 shutdown_connections 2023-09-30T22:28:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.861+0000 7fb834f5c700 1 -- 172.21.15.59:0/1723020529 wait complete. 2023-09-30T22:28:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.861+0000 7fa01b7fe700 1 -- 172.21.15.59:0/1640224778 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fa02c01bb40 con 0x7fa03412e180 2023-09-30T22:28:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.862+0000 7fa01b7fe700 1 -- 172.21.15.59:0/1640224778 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fa02c014be0 con 0x7fa03412e180 2023-09-30T22:28:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.863+0000 7fb834f5c700 1 Processor -- start 2023-09-30T22:28:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.863+0000 7fb834f5c700 1 -- start start 2023-09-30T22:28:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.864+0000 7fb834f5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83009e390 0x7fb8301cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.864+0000 7fb834f5c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8301338c0 0x7fb8301cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.864+0000 7fb834f5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8301341d0 0x7fb830099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.864+0000 7fb834f5c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83009b9a0 con 0x7fb8301338c0 2023-09-30T22:28:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.864+0000 7fb834f5c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83009d590 con 0x7fb8301341d0 2023-09-30T22:28:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.864+0000 7fb834f5c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb830130e50 con 0x7fb83009e390 2023-09-30T22:28:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.864+0000 7fb82e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83009e390 0x7fb8301cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.864+0000 7fb82e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83009e390 0x7fb8301cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39772/0 (socket says 172.21.15.59:39772) 2023-09-30T22:28:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.864+0000 7fb82e59c700 1 -- 172.21.15.59:0/827268860 learned_addr learned my addr 172.21.15.59:0/827268860 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.864+0000 7fb82ed9d700 1 --2- 172.21.15.59:0/827268860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8301341d0 0x7fb830099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.864+0000 7fb82dd9b700 1 --2- 172.21.15.59:0/827268860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8301338c0 0x7fb8301cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.865+0000 7fb82e59c700 1 -- 172.21.15.59:0/827268860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8301341d0 msgr2=0x7fb830099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.865+0000 7fb82e59c700 1 --2- 172.21.15.59:0/827268860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8301341d0 0x7fb830099a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.865+0000 7fb82e59c700 1 -- 172.21.15.59:0/827268860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8301338c0 msgr2=0x7fb8301cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.865+0000 7fb82e59c700 1 --2- 172.21.15.59:0/827268860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8301338c0 0x7fb8301cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.865+0000 7fb82e59c700 1 -- 172.21.15.59:0/827268860 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb828009a70 con 0x7fb83009e390 2023-09-30T22:28:57.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.865+0000 7fb82dd9b700 1 --2- 172.21.15.59:0/827268860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8301338c0 0x7fb8301cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:57.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.865+0000 7fb82e59c700 1 --2- 172.21.15.59:0/827268860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83009e390 0x7fb8301cc8d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb82000b560 tx=0x7fb82000b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.865+0000 7fb81effd700 1 -- 172.21.15.59:0/827268860 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820011830 con 0x7fb83009e390 2023-09-30T22:28:57.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.865+0000 7fb81effd700 1 -- 172.21.15.59:0/827268860 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb820011990 con 0x7fb83009e390 2023-09-30T22:28:57.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.865+0000 7fb834f5c700 1 -- 172.21.15.59:0/827268860 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb824009550 con 0x7fb83009e390 2023-09-30T22:28:57.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.865+0000 7fb81effd700 1 -- 172.21.15.59:0/827268860 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820011d20 con 0x7fb83009e390 2023-09-30T22:28:57.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.865+0000 7fb834f5c700 1 -- 172.21.15.59:0/827268860 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83009cff0 con 0x7fb83009e390 2023-09-30T22:28:57.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.866+0000 7fb81effd700 1 -- 172.21.15.59:0/827268860 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fb82001a400 con 0x7fb83009e390 2023-09-30T22:28:57.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.866+0000 7fb81effd700 1 -- 172.21.15.59:0/827268860 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fb82003b8b0 con 0x7fb83009e390 2023-09-30T22:28:57.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.866+0000 7fb82dd9b700 1 -- 172.21.15.59:0/827268860 >> v1:172.21.15.59:6816/118188 conn(0x7fb81002c1b0 legacy=0x7fb81002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:57.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.868+0000 7fb834f5c700 1 -- 172.21.15.59:0/827268860 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8140052e0 con 0x7fb83009e390 2023-09-30T22:28:57.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.876+0000 7fb81effd700 1 -- 172.21.15.59:0/827268860 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fb820015070 con 0x7fb83009e390 2023-09-30T22:28:57.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.890+0000 7ff8b4dd1700 1 Processor -- start 2023-09-30T22:28:57.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.890+0000 7ff8b4dd1700 1 -- start start 2023-09-30T22:28:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.891+0000 7ff8b4dd1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8b009d6f0 0x7ff8b009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.891+0000 7ff8b4dd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b009e000 0x7ff8b0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.891+0000 7ff8b4dd1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b009f130 con 0x7ff8b009e410 2023-09-30T22:28:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.891+0000 7ff8b4dd1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b009f520 con 0x7ff8b009d6f0 2023-09-30T22:28:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.891+0000 7ff8b4dd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b009e930 con 0x7ff8b009e000 2023-09-30T22:28:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.891+0000 7ff8ae59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8b009d6f0 0x7ff8b009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.891+0000 7ff8aed9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff8b009e410 0x7ff8b0130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56902/0 (socket says 172.21.15.59:56902) 2023-09-30T22:28:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.891+0000 7ff8ae59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8b009d6f0 0x7ff8b009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56250/0 (socket says 172.21.15.59:56250) 2023-09-30T22:28:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.891+0000 7ff8aed9d700 1 -- 172.21.15.59:0/264455432 learned_addr learned my addr 172.21.15.59:0/264455432 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:28:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.892+0000 7ff8add9b700 1 --2- 172.21.15.59:0/264455432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b009e000 0x7ff8b0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.892+0000 7ff8ae59c700 1 -- 172.21.15.59:0/264455432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b009e000 msgr2=0x7ff8b0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.892+0000 7ff8ae59c700 1 --2- 172.21.15.59:0/264455432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b009e000 0x7ff8b0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.892+0000 7ff8ae59c700 1 -- 172.21.15.59:0/264455432 >> v1:172.21.15.59:6789/0 conn(0x7ff8b009e410 legacy=0x7ff8b0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.892+0000 7ff8ae59c700 1 -- 172.21.15.59:0/264455432 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b009b2d0 con 0x7ff8b009d6f0 2023-09-30T22:28:57.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.892+0000 7ff8ad59a700 1 -- 172.21.15.59:0/264455432 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202309938 0 0) 0x7ff8b009f130 con 0x7ff8b009e410 2023-09-30T22:28:57.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.892+0000 7ff8add9b700 1 --2- 172.21.15.59:0/264455432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b009e000 0x7ff8b0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:57.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.892+0000 7ff8ae59c700 1 --2- 172.21.15.59:0/264455432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b009d6f0 0x7ff8b009dac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009840 tx=0x7ff8a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7dc1f30c9a2990 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.892+0000 7ff8ad59a700 1 -- 172.21.15.59:0/264455432 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0011830 con 0x7ff8b009d6f0 2023-09-30T22:28:57.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.893+0000 7ff8ad59a700 1 -- 172.21.15.59:0/264455432 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a0011990 con 0x7ff8b009d6f0 2023-09-30T22:28:57.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.893+0000 7ff8ad59a700 1 -- 172.21.15.59:0/264455432 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0011d20 con 0x7ff8b009d6f0 2023-09-30T22:28:57.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.893+0000 7ff8b4dd1700 1 -- 172.21.15.59:0/264455432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b009d6f0 msgr2=0x7ff8b009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.893+0000 7ff8b4dd1700 1 --2- 172.21.15.59:0/264455432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b009d6f0 0x7ff8b009dac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009840 tx=0x7ff8a0009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:57.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.893+0000 7ff8b4dd1700 1 -- 172.21.15.59:0/264455432 shutdown_connections 2023-09-30T22:28:57.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.893+0000 7ff8b4dd1700 1 --2- 172.21.15.59:0/264455432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b009d6f0 0x7ff8b009dac0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.893+0000 7ff8b4dd1700 1 --2- 172.21.15.59:0/264455432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b009e000 0x7ff8b0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.893+0000 7ff8b4dd1700 1 -- 172.21.15.59:0/264455432 >> 172.21.15.59:0/264455432 conn(0x7ff8b0066f50 msgr2=0x7ff8b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.893+0000 7ff8b4dd1700 1 -- 172.21.15.59:0/264455432 shutdown_connections 2023-09-30T22:28:57.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.894+0000 7ff8b4dd1700 1 -- 172.21.15.59:0/264455432 wait complete. 2023-09-30T22:28:57.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.895+0000 7ff8b4dd1700 1 Processor -- start 2023-09-30T22:28:57.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.895+0000 7ff8b4dd1700 1 -- start start 2023-09-30T22:28:57.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.895+0000 7ff8b4dd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b009d6f0 0x7ff8b0127ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.895+0000 7ff8b4dd1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b009e000 0x7ff8b0128410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.895+0000 7ff8b4dd1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8b009e410 0x7ff8b01cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.895+0000 7ff8b4dd1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b012ace0 con 0x7ff8b009e000 2023-09-30T22:28:57.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.895+0000 7ff8b4dd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b012aec0 con 0x7ff8b009d6f0 2023-09-30T22:28:57.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.895+0000 7ff8b4dd1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b0127a30 con 0x7ff8b009e410 2023-09-30T22:28:57.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.896+0000 7ff8add9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b009e000 0x7ff8b0128410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.896+0000 7ff8add9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b009e000 0x7ff8b0128410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56254/0 (socket says 172.21.15.59:56254) 2023-09-30T22:28:57.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.896+0000 7ff8add9b700 1 -- 172.21.15.59:0/2843509278 learned_addr learned my addr 172.21.15.59:0/2843509278 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:57.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.896+0000 7ff8ae59c700 1 --2- 172.21.15.59:0/2843509278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b009d6f0 0x7ff8b0127ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.896+0000 7ff8aed9d700 1 --2- 172.21.15.59:0/2843509278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8b009e410 0x7ff8b01cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.896+0000 7ff8ae59c700 1 -- 172.21.15.59:0/2843509278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8b009e410 msgr2=0x7ff8b01cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.896+0000 7ff8ae59c700 1 --2- 172.21.15.59:0/2843509278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8b009e410 0x7ff8b01cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.896+0000 7ff8ae59c700 1 -- 172.21.15.59:0/2843509278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b009e000 msgr2=0x7ff8b0128410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.896+0000 7ff8ae59c700 1 --2- 172.21.15.59:0/2843509278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b009e000 0x7ff8b0128410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.896+0000 7ff8ae59c700 1 -- 172.21.15.59:0/2843509278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a400b740 con 0x7ff8b009d6f0 2023-09-30T22:28:57.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.896+0000 7ff8add9b700 1 --2- 172.21.15.59:0/2843509278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b009e000 0x7ff8b0128410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:57.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.896+0000 7ff8ae59c700 1 --2- 172.21.15.59:0/2843509278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b009d6f0 0x7ff8b0127ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00a3e80 tx=0x7ff8a0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.897+0000 7ff89effd700 1 -- 172.21.15.59:0/2843509278 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00036a0 con 0x7ff8b009d6f0 2023-09-30T22:28:57.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.897+0000 7ff89effd700 1 -- 172.21.15.59:0/2843509278 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a001f070 con 0x7ff8b009d6f0 2023-09-30T22:28:57.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.897+0000 7ff8b4dd1700 1 -- 172.21.15.59:0/2843509278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a00094a0 con 0x7ff8b009d6f0 2023-09-30T22:28:57.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.897+0000 7ff89effd700 1 -- 172.21.15.59:0/2843509278 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0003a00 con 0x7ff8b009d6f0 2023-09-30T22:28:57.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.897+0000 7ff8b4dd1700 1 -- 172.21.15.59:0/2843509278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b01297a0 con 0x7ff8b009d6f0 2023-09-30T22:28:57.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.898+0000 7ff89effd700 1 -- 172.21.15.59:0/2843509278 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7ff8a0003b60 con 0x7ff8b009d6f0 2023-09-30T22:28:57.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.898+0000 7ff89cff9700 1 -- 172.21.15.59:0/2843509278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8880052e0 con 0x7ff8b009d6f0 2023-09-30T22:28:57.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.899+0000 7ff89effd700 1 -- 172.21.15.59:0/2843509278 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7ff8a0021070 con 0x7ff8b009d6f0 2023-09-30T22:28:57.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.899+0000 7ff8add9b700 1 -- 172.21.15.59:0/2843509278 >> v1:172.21.15.59:6816/118188 conn(0x7ff89002c1b0 legacy=0x7ff89002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:57.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.907+0000 7ff89effd700 1 -- 172.21.15.59:0/2843509278 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7ff8a0003e10 con 0x7ff8b009d6f0 2023-09-30T22:28:57.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.934+0000 7fef79d27700 1 -- 172.21.15.59:0/2347088384 >> v1:172.21.15.59:6816/118188 conn(0x7fef5802c1b0 legacy=0x7fef5802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:57.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.982+0000 7fef7bf8b700 1 -- 172.21.15.59:0/2347088384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fef741a5200 con 0x7fef7409e410 2023-09-30T22:28:57.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.983+0000 7fef6a7fc700 1 -- 172.21.15.59:0/2347088384 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef741a5200 con 0x7fef7409e410 2023-09-30T22:28:57.983 INFO:teuthology.orchestra.run.smithi059.stdout:42949672990 2023-09-30T22:28:57.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.985+0000 7fef7bf8b700 1 -- 172.21.15.59:0/2347088384 >> v1:172.21.15.59:6816/118188 conn(0x7fef5802c1b0 legacy=0x7fef5802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:57.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.985+0000 7fef7bf8b700 1 -- 172.21.15.59:0/2347088384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7409e410 msgr2=0x7fef741c05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.985+0000 7fef7bf8b700 1 --2- 172.21.15.59:0/2347088384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7409e410 0x7fef741c05c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00c870 tx=0x7fef6c00cc30 comp rx=0 tx=0).stop 2023-09-30T22:28:57.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.985+0000 7fef7bf8b700 1 -- 172.21.15.59:0/2347088384 shutdown_connections 2023-09-30T22:28:57.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.985+0000 7fef7bf8b700 1 --2- 172.21.15.59:0/2347088384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7409d6f0 0x7fef741c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.985+0000 7fef7bf8b700 1 --2- 172.21.15.59:0/2347088384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7409e410 0x7fef741c05c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.985+0000 7fef7bf8b700 1 --2- 172.21.15.59:0/2347088384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7409e000 0x7fef741c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.985+0000 7fef7bf8b700 1 -- 172.21.15.59:0/2347088384 >> 172.21.15.59:0/2347088384 conn(0x7fef74066f50 msgr2=0x7fef741b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.985+0000 7fef7bf8b700 1 -- 172.21.15.59:0/2347088384 shutdown_connections 2023-09-30T22:28:57.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:57.985+0000 7fef7bf8b700 1 -- 172.21.15.59:0/2347088384 wait complete. 2023-09-30T22:28:57.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672991 got 42949672990 for osd.2 2023-09-30T22:28:58.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.054+0000 7fa032ffd700 1 -- 172.21.15.59:0/1640224778 >> v1:172.21.15.59:6816/118188 conn(0x7fa02002c1b0 legacy=0x7fa02002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:58.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.059+0000 7fa03948a700 1 -- 172.21.15.59:0/1640224778 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa03412cfc0 con 0x7fa03412e180 2023-09-30T22:28:58.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.059+0000 7fa01b7fe700 1 -- 172.21.15.59:0/1640224778 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa02c03ae60 con 0x7fa03412e180 2023-09-30T22:28:58.060 INFO:teuthology.orchestra.run.smithi059.stdout:38654705694 2023-09-30T22:28:58.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.061+0000 7fa03948a700 1 -- 172.21.15.59:0/1640224778 >> v1:172.21.15.59:6816/118188 conn(0x7fa02002c1b0 legacy=0x7fa02002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:58.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.061+0000 7fa03948a700 1 -- 172.21.15.59:0/1640224778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03412e180 msgr2=0x7fa03413d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.061+0000 7fa03948a700 1 --2- 172.21.15.59:0/1640224778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03412e180 0x7fa03413d820 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa02c007e40 tx=0x7fa02c00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.061+0000 7fa03948a700 1 -- 172.21.15.59:0/1640224778 shutdown_connections 2023-09-30T22:28:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.061+0000 7fa03948a700 1 --2- 172.21.15.59:0/1640224778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03412e180 0x7fa03413d820 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.061+0000 7fa03948a700 1 --2- 172.21.15.59:0/1640224778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03406e570 0x7fa03413cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.061+0000 7fa03948a700 1 --2- 172.21.15.59:0/1640224778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03406f050 0x7fa03413d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.061+0000 7fa03948a700 1 -- 172.21.15.59:0/1640224778 >> 172.21.15.59:0/1640224778 conn(0x7fa0340a2aa0 msgr2=0x7fa03409cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.062+0000 7fa03948a700 1 -- 172.21.15.59:0/1640224778 shutdown_connections 2023-09-30T22:28:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.062+0000 7fa03948a700 1 -- 172.21.15.59:0/1640224778 wait complete. 2023-09-30T22:28:58.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.067+0000 7fb82dd9b700 1 -- 172.21.15.59:0/827268860 >> v1:172.21.15.59:6816/118188 conn(0x7fb81002c1b0 legacy=0x7fb81002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:58.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705694 for osd.3 2023-09-30T22:28:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.096+0000 7ff89cff9700 1 -- 172.21.15.59:0/2843509278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff888005590 con 0x7ff8b009d6f0 2023-09-30T22:28:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.097+0000 7ff89effd700 1 -- 172.21.15.59:0/2843509278 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff8a0015030 con 0x7ff8b009d6f0 2023-09-30T22:28:58.097 INFO:teuthology.orchestra.run.smithi059.stdout:38654705694 2023-09-30T22:28:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.099+0000 7ff89cff9700 1 -- 172.21.15.59:0/2843509278 >> v1:172.21.15.59:6816/118188 conn(0x7ff89002c1b0 legacy=0x7ff89002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.099+0000 7ff89cff9700 1 -- 172.21.15.59:0/2843509278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b009d6f0 msgr2=0x7ff8b0127ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.099+0000 7ff89cff9700 1 --2- 172.21.15.59:0/2843509278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b009d6f0 0x7ff8b0127ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00a3e80 tx=0x7ff8a0004750 comp rx=0 tx=0).stop 2023-09-30T22:28:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.099+0000 7ff89cff9700 1 -- 172.21.15.59:0/2843509278 shutdown_connections 2023-09-30T22:28:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.099+0000 7ff89cff9700 1 --2- 172.21.15.59:0/2843509278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8b009e410 0x7ff8b01cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.099+0000 7ff89cff9700 1 --2- 172.21.15.59:0/2843509278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b009d6f0 0x7ff8b0127ed0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.099+0000 7ff89cff9700 1 --2- 172.21.15.59:0/2843509278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b009e000 0x7ff8b0128410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.099+0000 7ff89cff9700 1 -- 172.21.15.59:0/2843509278 >> 172.21.15.59:0/2843509278 conn(0x7ff8b0066f50 msgr2=0x7ff8b0070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.099+0000 7ff89cff9700 1 -- 172.21.15.59:0/2843509278 shutdown_connections 2023-09-30T22:28:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.099+0000 7ff89cff9700 1 -- 172.21.15.59:0/2843509278 wait complete. 2023-09-30T22:28:58.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705694 for osd.1 2023-09-30T22:28:58.123 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:58.123+0000 7fc05e06b240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T22:28:58.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.169+0000 7fb834f5c700 1 -- 172.21.15.59:0/827268860 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb814005590 con 0x7fb83009e390 2023-09-30T22:28:58.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.169+0000 7fb81effd700 1 -- 172.21.15.59:0/827268860 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb820015020 con 0x7fb83009e390 2023-09-30T22:28:58.170 INFO:teuthology.orchestra.run.smithi059.stdout:42949672990 2023-09-30T22:28:58.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.171+0000 7fb834f5c700 1 -- 172.21.15.59:0/827268860 >> v1:172.21.15.59:6816/118188 conn(0x7fb81002c1b0 legacy=0x7fb81002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:58.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.171+0000 7fb834f5c700 1 -- 172.21.15.59:0/827268860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83009e390 msgr2=0x7fb8301cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.171+0000 7fb834f5c700 1 --2- 172.21.15.59:0/827268860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83009e390 0x7fb8301cc8d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb82000b560 tx=0x7fb82000b920 comp rx=0 tx=0).stop 2023-09-30T22:28:58.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.171+0000 7fb834f5c700 1 -- 172.21.15.59:0/827268860 shutdown_connections 2023-09-30T22:28:58.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.171+0000 7fb834f5c700 1 --2- 172.21.15.59:0/827268860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83009e390 0x7fb8301cc8d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.171+0000 7fb834f5c700 1 --2- 172.21.15.59:0/827268860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8301341d0 0x7fb830099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.171+0000 7fb834f5c700 1 --2- 172.21.15.59:0/827268860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8301338c0 0x7fb8301cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.171+0000 7fb834f5c700 1 -- 172.21.15.59:0/827268860 >> 172.21.15.59:0/827268860 conn(0x7fb8300a2aa0 msgr2=0x7fb830130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:58.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.171+0000 7fb834f5c700 1 -- 172.21.15.59:0/827268860 shutdown_connections 2023-09-30T22:28:58.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:58.171+0000 7fb834f5c700 1 -- 172.21.15.59:0/827268860 wait complete. 2023-09-30T22:28:58.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672991 got 42949672990 for osd.0 2023-09-30T22:28:58.265 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:58.265+0000 7fc05e06b240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T22:28:58.397 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:58.398+0000 7fc05e06b240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:28:59.000 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:59.040 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:59.040+0000 7fc05e06b240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T22:28:59.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:59.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:59.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.143+0000 7f5c2356f700 1 Processor -- start 2023-09-30T22:28:59.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.144+0000 7f5c2356f700 1 -- start start 2023-09-30T22:28:59.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.144+0000 7f5c2356f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c1c1338a0 0x7f5c1c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.144+0000 7f5c2356f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5c1c09de50 0x7f5c1c09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.144+0000 7f5c2356f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c1c06ef30 con 0x7f5c1c09e760 2023-09-30T22:28:59.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.144+0000 7f5c2356f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c1c06fef0 con 0x7f5c1c09de50 2023-09-30T22:28:59.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.144+0000 7f5c2356f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c1334b0 con 0x7f5c1c1338a0 2023-09-30T22:28:59.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.145+0000 7f5c2130b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c1c1338a0 0x7f5c1c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.145+0000 7f5c2130b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c1c1338a0 0x7f5c1c133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39784/0 (socket says 172.21.15.59:39784) 2023-09-30T22:28:59.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.145+0000 7f5c2130b700 1 -- 172.21.15.59:0/1633715496 learned_addr learned my addr 172.21.15.59:0/1633715496 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:59.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.145+0000 7f5c20b0a700 1 --2- 172.21.15.59:0/1633715496 >> v2:172.21.15.59:3300/0 conn(0x7f5c1c09de50 0x7f5c1c09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.145+0000 7f5c2130b700 1 -- 172.21.15.59:0/1633715496 >> v2:172.21.15.59:3300/0 conn(0x7f5c1c09de50 msgr2=0x7f5c1c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:59.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.145+0000 7f5c2130b700 1 --2- 172.21.15.59:0/1633715496 >> v2:172.21.15.59:3300/0 conn(0x7f5c1c09de50 0x7f5c1c09e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.145+0000 7f5c2130b700 1 -- 172.21.15.59:0/1633715496 >> v1:172.21.15.59:6789/0 conn(0x7f5c1c09e760 legacy=0x7f5c1c13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.145+0000 7f5c2130b700 1 -- 172.21.15.59:0/1633715496 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c06fc30 con 0x7f5c1c1338a0 2023-09-30T22:28:59.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.145+0000 7f5c20b0a700 1 --2- 172.21.15.59:0/1633715496 >> v2:172.21.15.59:3300/0 conn(0x7f5c1c09de50 0x7f5c1c09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:59.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.145+0000 7f5c2130b700 1 --2- 172.21.15.59:0/1633715496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c1c1338a0 0x7f5c1c133c70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5c180098f0 tx=0x7f5c18009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d01f94635213353c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.146+0000 7f5c13fff700 1 -- 172.21.15.59:0/1633715496 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c18011830 con 0x7f5c1c1338a0 2023-09-30T22:28:59.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.146+0000 7f5c13fff700 1 -- 172.21.15.59:0/1633715496 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c18011990 con 0x7f5c1c1338a0 2023-09-30T22:28:59.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.146+0000 7f5c13fff700 1 -- 172.21.15.59:0/1633715496 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c18011d20 con 0x7f5c1c1338a0 2023-09-30T22:28:59.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.147+0000 7f5c2356f700 1 -- 172.21.15.59:0/1633715496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c1c1338a0 msgr2=0x7f5c1c133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.147+0000 7f5c2356f700 1 --2- 172.21.15.59:0/1633715496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c1c1338a0 0x7f5c1c133c70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5c180098f0 tx=0x7f5c18009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:59.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.147+0000 7f5c2356f700 1 -- 172.21.15.59:0/1633715496 shutdown_connections 2023-09-30T22:28:59.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.147+0000 7f5c2356f700 1 --2- 172.21.15.59:0/1633715496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c1c1338a0 0x7f5c1c133c70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.147+0000 7f5c2356f700 1 --2- 172.21.15.59:0/1633715496 >> v2:172.21.15.59:3300/0 conn(0x7f5c1c09de50 0x7f5c1c09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.147+0000 7f5c2356f700 1 -- 172.21.15.59:0/1633715496 >> 172.21.15.59:0/1633715496 conn(0x7f5c1c0a2aa0 msgr2=0x7f5c1c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.147+0000 7f5c2356f700 1 -- 172.21.15.59:0/1633715496 shutdown_connections 2023-09-30T22:28:59.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.147+0000 7f5c2356f700 1 -- 172.21.15.59:0/1633715496 wait complete. 2023-09-30T22:28:59.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.148+0000 7f5c2356f700 1 Processor -- start 2023-09-30T22:28:59.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.148+0000 7f5c2356f700 1 -- start start 2023-09-30T22:28:59.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.149+0000 7f5c2356f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c1c09de50 0x7f5c1c11d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.149+0000 7f5c2356f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c1c09e760 0x7f5c1c11db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.149+0000 7f5c2356f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c1c1338a0 0x7f5c1c11e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.149+0000 7f5c2356f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c120f30 con 0x7f5c1c09e760 2023-09-30T22:28:59.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.149+0000 7f5c2356f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c121130 con 0x7f5c1c09de50 2023-09-30T22:28:59.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.149+0000 7f5c2356f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c120020 con 0x7f5c1c1338a0 2023-09-30T22:28:59.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.149+0000 7f5c2130b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c1c09de50 0x7f5c1c11d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.149+0000 7f5c2130b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c1c09de50 0x7f5c1c11d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36676/0 (socket says 172.21.15.59:36676) 2023-09-30T22:28:59.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.149+0000 7f5c2130b700 1 -- 172.21.15.59:0/946742352 learned_addr learned my addr 172.21.15.59:0/946742352 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:59.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.149+0000 7f5c20b0a700 1 --2- 172.21.15.59:0/946742352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c1c09e760 0x7f5c1c11db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.149+0000 7f5c21b0c700 1 --2- 172.21.15.59:0/946742352 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c1c1338a0 0x7f5c1c11e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.149+0000 7f5c2130b700 1 -- 172.21.15.59:0/946742352 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c1c1338a0 msgr2=0x7f5c1c11e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.149+0000 7f5c2130b700 1 --2- 172.21.15.59:0/946742352 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c1c1338a0 0x7f5c1c11e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.149+0000 7f5c2130b700 1 -- 172.21.15.59:0/946742352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c1c09e760 msgr2=0x7f5c1c11db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.149+0000 7f5c2130b700 1 --2- 172.21.15.59:0/946742352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c1c09e760 0x7f5c1c11db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.150+0000 7f5c2130b700 1 -- 172.21.15.59:0/946742352 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c0094a0 con 0x7f5c1c09de50 2023-09-30T22:28:59.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.150+0000 7f5c2130b700 1 --2- 172.21.15.59:0/946742352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c1c09de50 0x7f5c1c11d650 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c18000c00 tx=0x7f5c18004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.150+0000 7f5c11ffb700 1 -- 172.21.15.59:0/946742352 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c18004400 con 0x7f5c1c09de50 2023-09-30T22:28:59.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.150+0000 7f5c11ffb700 1 -- 172.21.15.59:0/946742352 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1801f070 con 0x7f5c1c09de50 2023-09-30T22:28:59.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.150+0000 7f5c2356f700 1 -- 172.21.15.59:0/946742352 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c18009550 con 0x7f5c1c09de50 2023-09-30T22:28:59.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.150+0000 7f5c11ffb700 1 -- 172.21.15.59:0/946742352 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c180038e0 con 0x7f5c1c09de50 2023-09-30T22:28:59.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.150+0000 7f5c2356f700 1 -- 172.21.15.59:0/946742352 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1c0a0fd0 con 0x7f5c1c09de50 2023-09-30T22:28:59.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.151+0000 7f5c11ffb700 1 -- 172.21.15.59:0/946742352 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f5c18021030 con 0x7f5c1c09de50 2023-09-30T22:28:59.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.152+0000 7f5c11ffb700 1 -- 172.21.15.59:0/946742352 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f5c1803cb50 con 0x7f5c1c09de50 2023-09-30T22:28:59.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.152+0000 7f5c20b0a700 1 -- 172.21.15.59:0/946742352 >> v1:172.21.15.59:6816/118188 conn(0x7f5c0002c1e0 legacy=0x7f5c0002e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:59.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.152+0000 7f5c2356f700 1 -- 172.21.15.59:0/946742352 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1c06f6a0 con 0x7f5c1c09de50 2023-09-30T22:28:59.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.161+0000 7f5c11ffb700 1 -- 172.21.15.59:0/946742352 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f5c18015070 con 0x7f5c1c09de50 2023-09-30T22:28:59.185 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:59.185+0000 7fc05e06b240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:28:59.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.237+0000 7febd61ca700 1 Processor -- start 2023-09-30T22:28:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.237+0000 7febd61ca700 1 -- start start 2023-09-30T22:28:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.238+0000 7febd61ca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd009e1d0 0x7febd0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.238+0000 7febd61ca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7febd0135e50 0x7febd0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.238+0000 7febd61ca700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd009f130 con 0x7febd009d6f0 2023-09-30T22:28:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.238+0000 7febd61ca700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd009f520 con 0x7febd0135e50 2023-09-30T22:28:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.238+0000 7febd61ca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd009e930 con 0x7febd009e1d0 2023-09-30T22:28:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.238+0000 7febcffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7febd0135e50 0x7febd0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.238+0000 7febcf7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7febd009d6f0 0x7febd009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56924/0 (socket says 172.21.15.59:56924) 2023-09-30T22:28:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.238+0000 7febcffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7febd0135e50 0x7febd0138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56284/0 (socket says 172.21.15.59:56284) 2023-09-30T22:28:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.238+0000 7febcf7fe700 1 -- 172.21.15.59:0/3907013010 learned_addr learned my addr 172.21.15.59:0/3907013010 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:28:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.239+0000 7febceffd700 1 --2- 172.21.15.59:0/3907013010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd009e1d0 0x7febd0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.239+0000 7febcffff700 1 -- 172.21.15.59:0/3907013010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd009e1d0 msgr2=0x7febd0135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.239+0000 7febcffff700 1 --2- 172.21.15.59:0/3907013010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd009e1d0 0x7febd0135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.239+0000 7febcffff700 1 -- 172.21.15.59:0/3907013010 >> v1:172.21.15.59:6789/0 conn(0x7febd009d6f0 legacy=0x7febd009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.239+0000 7febcffff700 1 -- 172.21.15.59:0/3907013010 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd009b2d0 con 0x7febd0135e50 2023-09-30T22:28:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.239+0000 7febcffff700 1 --2- 172.21.15.59:0/3907013010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd0135e50 0x7febd0138230 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7febc8009df0 tx=0x7febc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0d5666ed15761e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.239+0000 7febce7fc700 1 -- 172.21.15.59:0/3907013010 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc800e070 con 0x7febd0135e50 2023-09-30T22:28:59.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.239+0000 7febce7fc700 1 -- 172.21.15.59:0/3907013010 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc800bb50 con 0x7febd0135e50 2023-09-30T22:28:59.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.239+0000 7febce7fc700 1 -- 172.21.15.59:0/3907013010 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8012430 con 0x7febd0135e50 2023-09-30T22:28:59.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.240+0000 7febd61ca700 1 -- 172.21.15.59:0/3907013010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd0135e50 msgr2=0x7febd0138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.240+0000 7febd61ca700 1 --2- 172.21.15.59:0/3907013010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd0135e50 0x7febd0138230 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7febc8009df0 tx=0x7febc800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:59.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.241+0000 7febd61ca700 1 -- 172.21.15.59:0/3907013010 shutdown_connections 2023-09-30T22:28:59.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.241+0000 7febd61ca700 1 --2- 172.21.15.59:0/3907013010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd0135e50 0x7febd0138230 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.241+0000 7febd61ca700 1 --2- 172.21.15.59:0/3907013010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd009e1d0 0x7febd0135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.241+0000 7febd61ca700 1 -- 172.21.15.59:0/3907013010 >> 172.21.15.59:0/3907013010 conn(0x7febd0066f50 msgr2=0x7febd009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.241+0000 7febd61ca700 1 -- 172.21.15.59:0/3907013010 shutdown_connections 2023-09-30T22:28:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.241+0000 7febd61ca700 1 -- 172.21.15.59:0/3907013010 wait complete. 2023-09-30T22:28:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.242+0000 7febd61ca700 1 Processor -- start 2023-09-30T22:28:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.242+0000 7febd61ca700 1 -- start start 2023-09-30T22:28:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.243+0000 7febd61ca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd009d6f0 0x7febd0135180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.243+0000 7febd61ca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7febd009e1d0 0x7febd01356c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.243+0000 7febd61ca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd0135e50 0x7febd01397b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.243+0000 7febd61ca700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd01330d0 con 0x7febd009d6f0 2023-09-30T22:28:59.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.243+0000 7febd61ca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd0133740 con 0x7febd0135e50 2023-09-30T22:28:59.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.243+0000 7febd61ca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febd0132ca0 con 0x7febd009e1d0 2023-09-30T22:28:59.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.243+0000 7febcf7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd009d6f0 0x7febd0135180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.244+0000 7febcf7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd009d6f0 0x7febd0135180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56298/0 (socket says 172.21.15.59:56298) 2023-09-30T22:28:59.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.244+0000 7febcf7fe700 1 -- 172.21.15.59:0/4191886636 learned_addr learned my addr 172.21.15.59:0/4191886636 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:59.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.244+0000 7febceffd700 1 --2- 172.21.15.59:0/4191886636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7febd009e1d0 0x7febd01356c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.244+0000 7febcf7fe700 1 -- 172.21.15.59:0/4191886636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7febd009e1d0 msgr2=0x7febd01356c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.244+0000 7febcf7fe700 1 --2- 172.21.15.59:0/4191886636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7febd009e1d0 0x7febd01356c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.244+0000 7febcf7fe700 1 -- 172.21.15.59:0/4191886636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd0135e50 msgr2=0x7febd01397b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.244+0000 7febcf7fe700 1 --2- 172.21.15.59:0/4191886636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd0135e50 0x7febd01397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.244+0000 7febcf7fe700 1 -- 172.21.15.59:0/4191886636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc8009a70 con 0x7febd009d6f0 2023-09-30T22:28:59.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.244+0000 7febcf7fe700 1 --2- 172.21.15.59:0/4191886636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd009d6f0 0x7febd0135180 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7febc000c480 tx=0x7febc000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.244+0000 7febb7fff700 1 -- 172.21.15.59:0/4191886636 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0005d70 con 0x7febd009d6f0 2023-09-30T22:28:59.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.245+0000 7febb7fff700 1 -- 172.21.15.59:0/4191886636 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc00070d0 con 0x7febd009d6f0 2023-09-30T22:28:59.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.245+0000 7febd61ca700 1 -- 172.21.15.59:0/4191886636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd009a0c0 con 0x7febd009d6f0 2023-09-30T22:28:59.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.245+0000 7febb7fff700 1 -- 172.21.15.59:0/4191886636 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0007440 con 0x7febd009d6f0 2023-09-30T22:28:59.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.245+0000 7febd61ca700 1 -- 172.21.15.59:0/4191886636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd009c750 con 0x7febd009d6f0 2023-09-30T22:28:59.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.246+0000 7febb7fff700 1 -- 172.21.15.59:0/4191886636 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7febc00075a0 con 0x7febd009d6f0 2023-09-30T22:28:59.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.246+0000 7febb7fff700 1 -- 172.21.15.59:0/4191886636 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7febc003ada0 con 0x7febd009d6f0 2023-09-30T22:28:59.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.246+0000 7febceffd700 1 -- 172.21.15.59:0/4191886636 >> v1:172.21.15.59:6816/118188 conn(0x7febbc02c1b0 legacy=0x7febbc02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:59.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.247+0000 7febd61ca700 1 -- 172.21.15.59:0/4191886636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd0074ea0 con 0x7febd009d6f0 2023-09-30T22:28:59.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.255+0000 7febb7fff700 1 -- 172.21.15.59:0/4191886636 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7febc0017070 con 0x7febd009d6f0 2023-09-30T22:28:59.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.302+0000 7f87f47c5700 1 Processor -- start 2023-09-30T22:28:59.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.302+0000 7f87f47c5700 1 -- start start 2023-09-30T22:28:59.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.303+0000 7f87f47c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87ec06a770 0x7f87ec09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.303+0000 7f87f47c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec13d1f0 0x7f87ec13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.303+0000 7f87f47c5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec09a810 con 0x7f87ec09dc30 2023-09-30T22:28:59.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.303+0000 7f87f47c5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec06ab40 con 0x7f87ec06a770 2023-09-30T22:28:59.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.303+0000 7f87f47c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec09ebc0 con 0x7f87ec13d1f0 2023-09-30T22:28:59.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.303+0000 7f87f1d60700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f87ec09dc30 0x7f87ec09e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56938/0 (socket says 172.21.15.59:56938) 2023-09-30T22:28:59.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.303+0000 7f87f1d60700 1 -- 172.21.15.59:0/23337266 learned_addr learned my addr 172.21.15.59:0/23337266 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:28:59.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.303+0000 7f87f2d62700 1 --2- 172.21.15.59:0/23337266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec13d1f0 0x7f87ec13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.303+0000 7f87f2561700 1 --2- 172.21.15.59:0/23337266 >> v2:172.21.15.59:3300/0 conn(0x7f87ec06a770 0x7f87ec09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.304+0000 7f87f155f700 1 -- 172.21.15.59:0/23337266 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927152920 0 0) 0x7f87ec09a810 con 0x7f87ec09dc30 2023-09-30T22:28:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.304+0000 7f87f2d62700 1 -- 172.21.15.59:0/23337266 >> v2:172.21.15.59:3300/0 conn(0x7f87ec06a770 msgr2=0x7f87ec09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.304+0000 7f87f2d62700 1 --2- 172.21.15.59:0/23337266 >> v2:172.21.15.59:3300/0 conn(0x7f87ec06a770 0x7f87ec09d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.304+0000 7f87f2d62700 1 -- 172.21.15.59:0/23337266 >> v1:172.21.15.59:6789/0 conn(0x7f87ec09dc30 legacy=0x7f87ec09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.304+0000 7f87f2d62700 1 -- 172.21.15.59:0/23337266 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec09e920 con 0x7f87ec13d1f0 2023-09-30T22:28:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.304+0000 7f87f2d62700 1 --2- 172.21.15.59:0/23337266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec13d1f0 0x7f87ec13f5d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f87e4009d90 tx=0x7f87e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f06a924007c0a89 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.304+0000 7f87f155f700 1 -- 172.21.15.59:0/23337266 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e400e070 con 0x7f87ec13d1f0 2023-09-30T22:28:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.304+0000 7f87f155f700 1 -- 172.21.15.59:0/23337266 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e400bb20 con 0x7f87ec13d1f0 2023-09-30T22:28:59.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.304+0000 7f87f155f700 1 -- 172.21.15.59:0/23337266 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4012430 con 0x7f87ec13d1f0 2023-09-30T22:28:59.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.305+0000 7f87f47c5700 1 -- 172.21.15.59:0/23337266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec13d1f0 msgr2=0x7f87ec13f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.305+0000 7f87f47c5700 1 --2- 172.21.15.59:0/23337266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec13d1f0 0x7f87ec13f5d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f87e4009d90 tx=0x7f87e400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:59.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.305+0000 7f87f47c5700 1 -- 172.21.15.59:0/23337266 shutdown_connections 2023-09-30T22:28:59.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.305+0000 7f87f47c5700 1 --2- 172.21.15.59:0/23337266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec13d1f0 0x7f87ec13f5d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.305+0000 7f87f47c5700 1 --2- 172.21.15.59:0/23337266 >> v2:172.21.15.59:3300/0 conn(0x7f87ec06a770 0x7f87ec09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.305+0000 7f87f47c5700 1 -- 172.21.15.59:0/23337266 >> 172.21.15.59:0/23337266 conn(0x7f87ec066f50 msgr2=0x7f87ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.305+0000 7f87f47c5700 1 -- 172.21.15.59:0/23337266 shutdown_connections 2023-09-30T22:28:59.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.305+0000 7f87f47c5700 1 -- 172.21.15.59:0/23337266 wait complete. 2023-09-30T22:28:59.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.307+0000 7f87f47c5700 1 Processor -- start 2023-09-30T22:28:59.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.307+0000 7f87f47c5700 1 -- start start 2023-09-30T22:28:59.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.307+0000 7f87f47c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ec06a770 0x7f87ec1260a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.307+0000 7f87f47c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09dc30 0x7f87ec1265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.307+0000 7f87f47c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec13d1f0 0x7f87ec126b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.307+0000 7f87f47c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec128f70 con 0x7f87ec06a770 2023-09-30T22:28:59.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.307+0000 7f87f47c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec072840 con 0x7f87ec09dc30 2023-09-30T22:28:59.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.307+0000 7f87f47c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec128570 con 0x7f87ec13d1f0 2023-09-30T22:28:59.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.308+0000 7f87f2561700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ec06a770 0x7f87ec1260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.308+0000 7f87f2561700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ec06a770 0x7f87ec1260a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56312/0 (socket says 172.21.15.59:56312) 2023-09-30T22:28:59.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.308+0000 7f87f2561700 1 -- 172.21.15.59:0/3424448938 learned_addr learned my addr 172.21.15.59:0/3424448938 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:59.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.308+0000 7f87f2d62700 1 --2- 172.21.15.59:0/3424448938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec13d1f0 0x7f87ec126b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.308+0000 7f87f2d62700 1 -- 172.21.15.59:0/3424448938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09dc30 msgr2=0x7f87ec1265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.308+0000 7f87f2d62700 1 --2- 172.21.15.59:0/3424448938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09dc30 0x7f87ec1265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.308+0000 7f87f2d62700 1 -- 172.21.15.59:0/3424448938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ec06a770 msgr2=0x7f87ec1260a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.308+0000 7f87f2d62700 1 --2- 172.21.15.59:0/3424448938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ec06a770 0x7f87ec1260a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.308+0000 7f87f2d62700 1 -- 172.21.15.59:0/3424448938 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e4009a70 con 0x7f87ec13d1f0 2023-09-30T22:28:59.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.308+0000 7f87f2561700 1 --2- 172.21.15.59:0/3424448938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ec06a770 0x7f87ec1260a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:59.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.309+0000 7f87f2d62700 1 --2- 172.21.15.59:0/3424448938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec13d1f0 0x7f87ec126b20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f87e4016000 tx=0x7f87e4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.309+0000 7f87e2ffd700 1 -- 172.21.15.59:0/3424448938 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4012430 con 0x7f87ec13d1f0 2023-09-30T22:28:59.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.309+0000 7f87e2ffd700 1 -- 172.21.15.59:0/3424448938 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e4020070 con 0x7f87ec13d1f0 2023-09-30T22:28:59.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.309+0000 7f87f47c5700 1 -- 172.21.15.59:0/3424448938 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ec127d60 con 0x7f87ec13d1f0 2023-09-30T22:28:59.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.309+0000 7f87e2ffd700 1 -- 172.21.15.59:0/3424448938 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4004280 con 0x7f87ec13d1f0 2023-09-30T22:28:59.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.309+0000 7f87f47c5700 1 -- 172.21.15.59:0/3424448938 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ec13ce90 con 0x7f87ec13d1f0 2023-09-30T22:28:59.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.310+0000 7f87e2ffd700 1 -- 172.21.15.59:0/3424448938 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f87e40043e0 con 0x7f87ec13d1f0 2023-09-30T22:28:59.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.310+0000 7f87e2ffd700 1 -- 172.21.15.59:0/3424448938 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f87e4022070 con 0x7f87ec13d1f0 2023-09-30T22:28:59.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.310+0000 7f87f2561700 1 -- 172.21.15.59:0/3424448938 >> v1:172.21.15.59:6816/118188 conn(0x7f87d002c1b0 legacy=0x7f87d002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:59.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.311+0000 7f87f47c5700 1 -- 172.21.15.59:0/3424448938 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ec127f30 con 0x7f87ec13d1f0 2023-09-30T22:28:59.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.316+0000 7f87e2ffd700 1 -- 172.21.15.59:0/3424448938 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f87ec127f30 con 0x7f87ec13d1f0 2023-09-30T22:28:59.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.353+0000 7f5c20b0a700 1 -- 172.21.15.59:0/946742352 >> v1:172.21.15.59:6816/118188 conn(0x7f5c0002c1e0 legacy=0x7f5c0002e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:59.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.372+0000 7fbe058ef700 1 Processor -- start 2023-09-30T22:28:59.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.372+0000 7fbe058ef700 1 -- start start 2023-09-30T22:28:59.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.373+0000 7fbe058ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe0006a770 0x7fbe0009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.373+0000 7fbe058ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0009dc30 0x7fbe0009e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.373+0000 7fbe058ef700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe0013c1e0 0x7fbe0013e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.373+0000 7fbe058ef700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0006ab40 con 0x7fbe0013c1e0 2023-09-30T22:28:59.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.373+0000 7fbe058ef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0009ebc0 con 0x7fbe0009dc30 2023-09-30T22:28:59.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.373+0000 7fbe058ef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0009a810 con 0x7fbe0006a770 2023-09-30T22:28:59.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.373+0000 7fbdff7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe0013c1e0 0x7fbe0013e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.373+0000 7fbdff7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe0013c1e0 0x7fbe0013e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56322/0 (socket says 172.21.15.59:56322) 2023-09-30T22:28:59.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.373+0000 7fbdff7fe700 1 -- 172.21.15.59:0/3987316779 learned_addr learned my addr 172.21.15.59:0/3987316779 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:59.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.373+0000 7fbdfe7fc700 1 --2- 172.21.15.59:0/3987316779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0009dc30 0x7fbe0009e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.373+0000 7fbdff7fe700 1 -- 172.21.15.59:0/3987316779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe0006a770 msgr2=0x7fbe0009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:59.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.373+0000 7fbdff7fe700 1 --2- 172.21.15.59:0/3987316779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe0006a770 0x7fbe0009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.373+0000 7fbdff7fe700 1 -- 172.21.15.59:0/3987316779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0009dc30 msgr2=0x7fbe0009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:59.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.373+0000 7fbdff7fe700 1 --2- 172.21.15.59:0/3987316779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0009dc30 0x7fbe0009e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.373+0000 7fbdff7fe700 1 -- 172.21.15.59:0/3987316779 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0009e920 con 0x7fbe0013c1e0 2023-09-30T22:28:59.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.374+0000 7fbdff7fe700 1 --2- 172.21.15.59:0/3987316779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0013c1e0 0x7fbe0013e5c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009e50 tx=0x7fbdf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d30e7eaf6e3a49 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.375+0000 7fbdfdffb700 1 -- 172.21.15.59:0/3987316779 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800e070 con 0x7fbe0013c1e0 2023-09-30T22:28:59.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.375+0000 7fbdfdffb700 1 -- 172.21.15.59:0/3987316779 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf800b9c0 con 0x7fbe0013c1e0 2023-09-30T22:28:59.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.375+0000 7fbdfdffb700 1 -- 172.21.15.59:0/3987316779 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800bd70 con 0x7fbe0013c1e0 2023-09-30T22:28:59.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.376+0000 7fbe058ef700 1 -- 172.21.15.59:0/3987316779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0013c1e0 msgr2=0x7fbe0013e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.376+0000 7fbe058ef700 1 --2- 172.21.15.59:0/3987316779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0013c1e0 0x7fbe0013e5c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009e50 tx=0x7fbdf800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:59.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.376+0000 7fbe058ef700 1 -- 172.21.15.59:0/3987316779 shutdown_connections 2023-09-30T22:28:59.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.376+0000 7fbe058ef700 1 --2- 172.21.15.59:0/3987316779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0013c1e0 0x7fbe0013e5c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.376+0000 7fbe058ef700 1 --2- 172.21.15.59:0/3987316779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe0006a770 0x7fbe0009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.376+0000 7fbe058ef700 1 --2- 172.21.15.59:0/3987316779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0009dc30 0x7fbe0009e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.376+0000 7fbe058ef700 1 -- 172.21.15.59:0/3987316779 >> 172.21.15.59:0/3987316779 conn(0x7fbe00066f50 msgr2=0x7fbe0009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.377+0000 7fbe058ef700 1 -- 172.21.15.59:0/3987316779 shutdown_connections 2023-09-30T22:28:59.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.377+0000 7fbe058ef700 1 -- 172.21.15.59:0/3987316779 wait complete. 2023-09-30T22:28:59.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.378+0000 7fbe058ef700 1 Processor -- start 2023-09-30T22:28:59.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.378+0000 7fbe058ef700 1 -- start start 2023-09-30T22:28:59.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.379+0000 7fbe058ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0006a770 0x7fbe00127d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.379+0000 7fbe058ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe0009dc30 0x7fbe00128290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.379+0000 7fbe058ef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0013c1e0 0x7fbe001cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.379+0000 7fbe058ef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe00129100 con 0x7fbe0013c1e0 2023-09-30T22:28:59.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.379+0000 7fbe058ef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe001299d0 con 0x7fbe0006a770 2023-09-30T22:28:59.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.379+0000 7fbe058ef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0013be80 con 0x7fbe0009dc30 2023-09-30T22:28:59.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.379+0000 7fbdff7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0013c1e0 0x7fbe001cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.379+0000 7fbdff7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0013c1e0 0x7fbe001cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56330/0 (socket says 172.21.15.59:56330) 2023-09-30T22:28:59.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.379+0000 7fbdff7fe700 1 -- 172.21.15.59:0/1004025512 learned_addr learned my addr 172.21.15.59:0/1004025512 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:28:59.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.380+0000 7fbdfe7fc700 1 --2- 172.21.15.59:0/1004025512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe0009dc30 0x7fbe00128290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.380+0000 7fbdff7fe700 1 -- 172.21.15.59:0/1004025512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe0009dc30 msgr2=0x7fbe00128290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.380+0000 7fbdff7fe700 1 --2- 172.21.15.59:0/1004025512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe0009dc30 0x7fbe00128290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.380+0000 7fbdff7fe700 1 -- 172.21.15.59:0/1004025512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0006a770 msgr2=0x7fbe00127d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.380+0000 7fbdff7fe700 1 --2- 172.21.15.59:0/1004025512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0006a770 0x7fbe00127d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.380+0000 7fbdff7fe700 1 -- 172.21.15.59:0/1004025512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf8009b30 con 0x7fbe0013c1e0 2023-09-30T22:28:59.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.380+0000 7fbdfe7fc700 1 --2- 172.21.15.59:0/1004025512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe0009dc30 0x7fbe00128290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:59.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.380+0000 7fbdff7fe700 1 --2- 172.21.15.59:0/1004025512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0013c1e0 0x7fbe001cc6f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8003f80 tx=0x7fbdf8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.381+0000 7fbde7fff700 1 -- 172.21.15.59:0/1004025512 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8004450 con 0x7fbe0013c1e0 2023-09-30T22:28:59.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.381+0000 7fbde7fff700 1 -- 172.21.15.59:0/1004025512 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf80045b0 con 0x7fbe0013c1e0 2023-09-30T22:28:59.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.381+0000 7fbde7fff700 1 -- 172.21.15.59:0/1004025512 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8004940 con 0x7fbe0013c1e0 2023-09-30T22:28:59.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.381+0000 7fbe058ef700 1 -- 172.21.15.59:0/1004025512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0012b010 con 0x7fbe0013c1e0 2023-09-30T22:28:59.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.381+0000 7fbe058ef700 1 -- 172.21.15.59:0/1004025512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0012ad30 con 0x7fbe0013c1e0 2023-09-30T22:28:59.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.382+0000 7fbde7fff700 1 -- 172.21.15.59:0/1004025512 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fbdf801c410 con 0x7fbe0013c1e0 2023-09-30T22:28:59.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.382+0000 7fbde7fff700 1 -- 172.21.15.59:0/1004025512 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fbdf8041170 con 0x7fbe0013c1e0 2023-09-30T22:28:59.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.382+0000 7fbe058ef700 1 -- 172.21.15.59:0/1004025512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe00074ea0 con 0x7fbe0013c1e0 2023-09-30T22:28:59.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.382+0000 7fbdfeffd700 1 -- 172.21.15.59:0/1004025512 >> v1:172.21.15.59:6816/118188 conn(0x7fbdec02c1b0 legacy=0x7fbdec02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:59.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.391+0000 7fbde7fff700 1 -- 172.21.15.59:0/1004025512 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fbdf8042060 con 0x7fbe0013c1e0 2023-09-30T22:28:59.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.421+0000 7f5c2356f700 1 -- 172.21.15.59:0/946742352 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5c1c11a470 con 0x7f5c1c09de50 2023-09-30T22:28:59.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.421+0000 7f5c11ffb700 1 -- 172.21.15.59:0/946742352 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5c18015020 con 0x7f5c1c09de50 2023-09-30T22:28:59.422 INFO:teuthology.orchestra.run.smithi059.stdout:42949672990 2023-09-30T22:28:59.422 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:59.423+0000 7fc05e06b240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T22:28:59.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.425+0000 7f5c2356f700 1 -- 172.21.15.59:0/946742352 >> v1:172.21.15.59:6816/118188 conn(0x7f5c0002c1e0 legacy=0x7f5c0002e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:59.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.425+0000 7f5c2356f700 1 -- 172.21.15.59:0/946742352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c1c09de50 msgr2=0x7f5c1c11d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.425+0000 7f5c2356f700 1 --2- 172.21.15.59:0/946742352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c1c09de50 0x7f5c1c11d650 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c18000c00 tx=0x7f5c18004750 comp rx=0 tx=0).stop 2023-09-30T22:28:59.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.425+0000 7f5c2356f700 1 -- 172.21.15.59:0/946742352 shutdown_connections 2023-09-30T22:28:59.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.425+0000 7f5c2356f700 1 --2- 172.21.15.59:0/946742352 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c1c1338a0 0x7f5c1c11e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.425+0000 7f5c2356f700 1 --2- 172.21.15.59:0/946742352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c1c09de50 0x7f5c1c11d650 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.425+0000 7f5c2356f700 1 --2- 172.21.15.59:0/946742352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c1c09e760 0x7f5c1c11db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.425+0000 7f5c2356f700 1 -- 172.21.15.59:0/946742352 >> 172.21.15.59:0/946742352 conn(0x7f5c1c0a2aa0 msgr2=0x7f5c1c1bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.425+0000 7f5c2356f700 1 -- 172.21.15.59:0/946742352 shutdown_connections 2023-09-30T22:28:59.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.425+0000 7f5c2356f700 1 -- 172.21.15.59:0/946742352 wait complete. 2023-09-30T22:28:59.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672991 got 42949672990 for osd.2 2023-09-30T22:28:59.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.447+0000 7febceffd700 1 -- 172.21.15.59:0/4191886636 >> v1:172.21.15.59:6816/118188 conn(0x7febbc02c1b0 legacy=0x7febbc02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:59.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.504+0000 7febd61ca700 1 -- 172.21.15.59:0/4191886636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7febd00a2260 con 0x7febd009d6f0 2023-09-30T22:28:59.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.504+0000 7febb7fff700 1 -- 172.21.15.59:0/4191886636 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7febc0017020 con 0x7febd009d6f0 2023-09-30T22:28:59.504 INFO:teuthology.orchestra.run.smithi059.stdout:38654705694 2023-09-30T22:28:59.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.506+0000 7febd61ca700 1 -- 172.21.15.59:0/4191886636 >> v1:172.21.15.59:6816/118188 conn(0x7febbc02c1b0 legacy=0x7febbc02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.506+0000 7febd61ca700 1 -- 172.21.15.59:0/4191886636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd009d6f0 msgr2=0x7febd0135180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.506+0000 7febd61ca700 1 --2- 172.21.15.59:0/4191886636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd009d6f0 0x7febd0135180 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7febc000c480 tx=0x7febc000c790 comp rx=0 tx=0).stop 2023-09-30T22:28:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.506+0000 7febd61ca700 1 -- 172.21.15.59:0/4191886636 shutdown_connections 2023-09-30T22:28:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.506+0000 7febd61ca700 1 --2- 172.21.15.59:0/4191886636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd0135e50 0x7febd01397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.506+0000 7febd61ca700 1 --2- 172.21.15.59:0/4191886636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd009d6f0 0x7febd0135180 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.506+0000 7febd61ca700 1 --2- 172.21.15.59:0/4191886636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7febd009e1d0 0x7febd01356c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.506+0000 7febd61ca700 1 -- 172.21.15.59:0/4191886636 >> 172.21.15.59:0/4191886636 conn(0x7febd0066f50 msgr2=0x7febd006e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.507+0000 7febd61ca700 1 -- 172.21.15.59:0/4191886636 shutdown_connections 2023-09-30T22:28:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.507+0000 7febd61ca700 1 -- 172.21.15.59:0/4191886636 wait complete. 2023-09-30T22:28:59.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.511+0000 7f87f2561700 1 -- 172.21.15.59:0/3424448938 >> v1:172.21.15.59:6816/118188 conn(0x7f87d002c1b0 legacy=0x7f87d002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118188 2023-09-30T22:28:59.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705694 for osd.3 2023-09-30T22:28:59.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.534+0000 7f87f47c5700 1 -- 172.21.15.59:0/3424448938 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f87ec127f30 con 0x7f87ec13d1f0 2023-09-30T22:28:59.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.534+0000 7f87e2ffd700 1 -- 172.21.15.59:0/3424448938 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f87ec127f30 con 0x7f87ec13d1f0 2023-09-30T22:28:59.534 INFO:teuthology.orchestra.run.smithi059.stdout:38654705694 2023-09-30T22:28:59.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.536+0000 7f87f47c5700 1 -- 172.21.15.59:0/3424448938 >> v1:172.21.15.59:6816/118188 conn(0x7f87d002c1b0 legacy=0x7f87d002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:59.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.536+0000 7f87f47c5700 1 -- 172.21.15.59:0/3424448938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec13d1f0 msgr2=0x7f87ec126b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.536+0000 7f87f47c5700 1 --2- 172.21.15.59:0/3424448938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec13d1f0 0x7f87ec126b20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f87e4016000 tx=0x7f87e4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.536+0000 7f87f47c5700 1 -- 172.21.15.59:0/3424448938 shutdown_connections 2023-09-30T22:28:59.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.536+0000 7f87f47c5700 1 --2- 172.21.15.59:0/3424448938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec13d1f0 0x7f87ec126b20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.536+0000 7f87f47c5700 1 --2- 172.21.15.59:0/3424448938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ec06a770 0x7f87ec1260a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.536+0000 7f87f47c5700 1 --2- 172.21.15.59:0/3424448938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09dc30 0x7f87ec1265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.536+0000 7f87f47c5700 1 -- 172.21.15.59:0/3424448938 >> 172.21.15.59:0/3424448938 conn(0x7f87ec066f50 msgr2=0x7f87ec13d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.536+0000 7f87f47c5700 1 -- 172.21.15.59:0/3424448938 shutdown_connections 2023-09-30T22:28:59.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.536+0000 7f87f47c5700 1 -- 172.21.15.59:0/3424448938 wait complete. 2023-09-30T22:28:59.547 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:59.547+0000 7fc05e06b240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T22:28:59.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705694 for osd.1 2023-09-30T22:28:59.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.566+0000 7fbde7fff700 1 -- 172.21.15.59:0/1004025512 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fbdf801c900 con 0x7fbe0013c1e0 2023-09-30T22:28:59.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.566+0000 7fbde7fff700 1 -- 172.21.15.59:0/1004025512 >> v1:172.21.15.59:6816/118188 conn(0x7fbdec02c1b0 legacy=0x7fbdec02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:59.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.584+0000 7fbe058ef700 1 -- 172.21.15.59:0/1004025512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbe0009d950 con 0x7fbe0013c1e0 2023-09-30T22:28:59.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.585+0000 7fbde7fff700 1 -- 172.21.15.59:0/1004025512 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbdf80117a0 con 0x7fbe0013c1e0 2023-09-30T22:28:59.585 INFO:teuthology.orchestra.run.smithi059.stdout:42949672990 2023-09-30T22:28:59.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.587+0000 7fbe058ef700 1 -- 172.21.15.59:0/1004025512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0013c1e0 msgr2=0x7fbe001cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.587+0000 7fbe058ef700 1 --2- 172.21.15.59:0/1004025512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0013c1e0 0x7fbe001cc6f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8003f80 tx=0x7fbdf8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.587+0000 7fbe058ef700 1 -- 172.21.15.59:0/1004025512 shutdown_connections 2023-09-30T22:28:59.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.587+0000 7fbe058ef700 1 --2- 172.21.15.59:0/1004025512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0013c1e0 0x7fbe001cc6f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.587+0000 7fbe058ef700 1 --2- 172.21.15.59:0/1004025512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0006a770 0x7fbe00127d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.587+0000 7fbe058ef700 1 --2- 172.21.15.59:0/1004025512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe0009dc30 0x7fbe00128290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.587+0000 7fbe058ef700 1 -- 172.21.15.59:0/1004025512 >> 172.21.15.59:0/1004025512 conn(0x7fbe00066f50 msgr2=0x7fbe000a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.587+0000 7fbe058ef700 1 -- 172.21.15.59:0/1004025512 shutdown_connections 2023-09-30T22:28:59.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:28:59.587+0000 7fbe058ef700 1 -- 172.21.15.59:0/1004025512 wait complete. 2023-09-30T22:28:59.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672991 got 42949672990 for osd.0 2023-09-30T22:28:59.632 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:59.632+0000 7fbfdbf02700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:28:59.632 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:59.632+0000 7fbfdbf02700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:28:59.632 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:59.632+0000 7fbfdbf02700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:28:59.632 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:59.632+0000 7fbfdbf02700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:28:59.632 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:59.632+0000 7fbfdbf02700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:28:59.633 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:59.634+0000 7fbfd96fd700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:28:59.634 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:59.634+0000 7fbfd96fd700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:28:59.634 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:59.634+0000 7fbfd96fd700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:28:59.634 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:59.634+0000 7fbfd96fd700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:28:59.634 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:28:59.634+0000 7fbfd96fd700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:29:00.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:00.522 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:00.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:00.573 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:29:00.573+0000 7fc01f486700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-09-30T22:29:00.574 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:29:00.574+0000 7fc01f486700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-30T22:29:00.576 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:29:00.576+0000 7fc01f486700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-30T22:29:00.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.602+0000 7f1e65d53700 1 Processor -- start 2023-09-30T22:29:00.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.602+0000 7f1e65d53700 1 -- start start 2023-09-30T22:29:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e65d53700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e6009d6f0 0x7f1e6009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e65d53700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6009e000 0x7f1e60130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e65d53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6009e410 0x7f1e60130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e65d53700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6009f520 con 0x7f1e6009d6f0 2023-09-30T22:29:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e65d53700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6009f130 con 0x7f1e6009e410 2023-09-30T22:29:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e65d53700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6009e930 con 0x7f1e6009e000 2023-09-30T22:29:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e5f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e6009d6f0 0x7f1e6009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e5ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6009e410 0x7f1e60130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e5f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e6009d6f0 0x7f1e6009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56440/0 (socket says 172.21.15.59:56440) 2023-09-30T22:29:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e5ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6009e410 0x7f1e60130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36840/0 (socket says 172.21.15.59:36840) 2023-09-30T22:29:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e5f7fe700 1 -- 172.21.15.59:0/2677259994 learned_addr learned my addr 172.21.15.59:0/2677259994 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e5effd700 1 --2- 172.21.15.59:0/2677259994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6009e000 0x7f1e60130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e5f7fe700 1 -- 172.21.15.59:0/2677259994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6009e000 msgr2=0x7f1e60130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e5f7fe700 1 --2- 172.21.15.59:0/2677259994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6009e000 0x7f1e60130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e5f7fe700 1 -- 172.21.15.59:0/2677259994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6009e410 msgr2=0x7f1e60130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.603+0000 7f1e5f7fe700 1 --2- 172.21.15.59:0/2677259994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6009e410 0x7f1e60130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.604+0000 7f1e5f7fe700 1 -- 172.21.15.59:0/2677259994 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6009b2d0 con 0x7f1e6009d6f0 2023-09-30T22:29:00.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.604+0000 7f1e5f7fe700 1 --2- 172.21.15.59:0/2677259994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6009d6f0 0x7f1e6009dac0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009920 tx=0x7f1e50009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4f9bfeebd90097 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.604+0000 7f1e5e7fc700 1 -- 172.21.15.59:0/2677259994 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50011830 con 0x7f1e6009d6f0 2023-09-30T22:29:00.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.604+0000 7f1e5e7fc700 1 -- 172.21.15.59:0/2677259994 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e50011990 con 0x7f1e6009d6f0 2023-09-30T22:29:00.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.604+0000 7f1e5e7fc700 1 -- 172.21.15.59:0/2677259994 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50011d20 con 0x7f1e6009d6f0 2023-09-30T22:29:00.606 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.605+0000 7f1e65d53700 1 -- 172.21.15.59:0/2677259994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6009d6f0 msgr2=0x7f1e6009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.605+0000 7f1e65d53700 1 --2- 172.21.15.59:0/2677259994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6009d6f0 0x7f1e6009dac0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009920 tx=0x7f1e50009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.605+0000 7f1e65d53700 1 -- 172.21.15.59:0/2677259994 shutdown_connections 2023-09-30T22:29:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.605+0000 7f1e65d53700 1 --2- 172.21.15.59:0/2677259994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6009e410 0x7f1e60130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.605+0000 7f1e65d53700 1 --2- 172.21.15.59:0/2677259994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6009d6f0 0x7f1e6009dac0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.605+0000 7f1e65d53700 1 --2- 172.21.15.59:0/2677259994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6009e000 0x7f1e60130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.605+0000 7f1e65d53700 1 -- 172.21.15.59:0/2677259994 >> 172.21.15.59:0/2677259994 conn(0x7f1e60066f50 msgr2=0x7f1e6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.605+0000 7f1e65d53700 1 -- 172.21.15.59:0/2677259994 shutdown_connections 2023-09-30T22:29:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.605+0000 7f1e65d53700 1 -- 172.21.15.59:0/2677259994 wait complete. 2023-09-30T22:29:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.607+0000 7f1e65d53700 1 Processor -- start 2023-09-30T22:29:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.607+0000 7f1e65d53700 1 -- start start 2023-09-30T22:29:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e65d53700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6009d6f0 0x7f1e6011e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e65d53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6009e000 0x7f1e6011e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e65d53700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6009e410 0x7f1e6011ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e65d53700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6011fd40 con 0x7f1e6009d6f0 2023-09-30T22:29:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e65d53700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e60121480 con 0x7f1e6009e000 2023-09-30T22:29:00.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e65d53700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6009c770 con 0x7f1e6009e410 2023-09-30T22:29:00.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e5effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6009e000 0x7f1e6011e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e5effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6009e000 0x7f1e6011e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36846/0 (socket says 172.21.15.59:36846) 2023-09-30T22:29:00.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e5effd700 1 -- 172.21.15.59:0/2216552942 learned_addr learned my addr 172.21.15.59:0/2216552942 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:00.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e5f7fe700 1 --2- 172.21.15.59:0/2216552942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6009d6f0 0x7f1e6011e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e5ffff700 1 --2- 172.21.15.59:0/2216552942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6009e410 0x7f1e6011ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e5effd700 1 -- 172.21.15.59:0/2216552942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6009e410 msgr2=0x7f1e6011ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e5effd700 1 --2- 172.21.15.59:0/2216552942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6009e410 0x7f1e6011ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e5effd700 1 -- 172.21.15.59:0/2216552942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6009d6f0 msgr2=0x7f1e6011e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e5effd700 1 --2- 172.21.15.59:0/2216552942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6009d6f0 0x7f1e6011e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.608+0000 7f1e5effd700 1 -- 172.21.15.59:0/2216552942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e50009550 con 0x7f1e6009e000 2023-09-30T22:29:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.609+0000 7f1e5effd700 1 --2- 172.21.15.59:0/2216552942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6009e000 0x7f1e6011e670 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400bf20 tx=0x7f1e54009530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.609+0000 7f1e47fff700 1 -- 172.21.15.59:0/2216552942 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e54015040 con 0x7f1e6009e000 2023-09-30T22:29:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.609+0000 7f1e47fff700 1 -- 172.21.15.59:0/2216552942 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e54019420 con 0x7f1e6009e000 2023-09-30T22:29:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.609+0000 7f1e65d53700 1 -- 172.21.15.59:0/2216552942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e60121970 con 0x7f1e6009e000 2023-09-30T22:29:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.609+0000 7f1e47fff700 1 -- 172.21.15.59:0/2216552942 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e54019790 con 0x7f1e6009e000 2023-09-30T22:29:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.609+0000 7f1e65d53700 1 -- 172.21.15.59:0/2216552942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e601216b0 con 0x7f1e6009e000 2023-09-30T22:29:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.610+0000 7f1e47fff700 1 -- 172.21.15.59:0/2216552942 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f1e540198f0 con 0x7f1e6009e000 2023-09-30T22:29:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.610+0000 7f1e47fff700 1 -- 172.21.15.59:0/2216552942 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4038+0+0 (secure 0 0 0) 0x7f1e54043c00 con 0x7f1e6009e000 2023-09-30T22:29:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.611+0000 7f1e65d53700 1 -- 172.21.15.59:0/2216552942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e60130090 con 0x7f1e6009e000 2023-09-30T22:29:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.616+0000 7f1e47fff700 1 -- 172.21.15.59:0/2216552942 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e54019ba0 con 0x7f1e6009e000 2023-09-30T22:29:00.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.687+0000 7f4302ba2700 1 Processor -- start 2023-09-30T22:29:00.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.687+0000 7f4302ba2700 1 -- start start 2023-09-30T22:29:00.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.688+0000 7f4302ba2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f42fc09eac0 0x7f42fc09ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.688+0000 7f4302ba2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42fc09f3d0 0x7f42fc133790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.688+0000 7f4302ba2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42fc0a2350 con 0x7f42fc09f7a0 2023-09-30T22:29:00.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.688+0000 7f4302ba2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42fc0a1d50 con 0x7f42fc09eac0 2023-09-30T22:29:00.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.688+0000 7f4302ba2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc09d470 con 0x7f42fc09f3d0 2023-09-30T22:29:00.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.688+0000 7f430139f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42fc09f3d0 0x7f42fc133790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.688+0000 7f4301ba0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f42fc09eac0 0x7f42fc09ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.688+0000 7f430139f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42fc09f3d0 0x7f42fc133790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36854/0 (socket says 172.21.15.59:36854) 2023-09-30T22:29:00.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.688+0000 7f430139f700 1 -- 172.21.15.59:0/926247704 learned_addr learned my addr 172.21.15.59:0/926247704 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.689+0000 7f430139f700 1 -- 172.21.15.59:0/926247704 >> v2:172.21.15.59:3300/0 conn(0x7f42fc09eac0 msgr2=0x7f42fc09ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.689+0000 7f430139f700 1 --2- 172.21.15.59:0/926247704 >> v2:172.21.15.59:3300/0 conn(0x7f42fc09eac0 0x7f42fc09ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.689+0000 7f430139f700 1 -- 172.21.15.59:0/926247704 >> v1:172.21.15.59:6789/0 conn(0x7f42fc09f7a0 legacy=0x7f42fc133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.689+0000 7f430139f700 1 -- 172.21.15.59:0/926247704 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42fc06ce40 con 0x7f42fc09f3d0 2023-09-30T22:29:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.689+0000 7f4301ba0700 1 --2- 172.21.15.59:0/926247704 >> v2:172.21.15.59:3300/0 conn(0x7f42fc09eac0 0x7f42fc09ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.689+0000 7f430139f700 1 --2- 172.21.15.59:0/926247704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42fc09f3d0 0x7f42fc133790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0098f0 tx=0x7f42ec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec2b7183ffa9208b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.689+0000 7f4300b9e700 1 -- 172.21.15.59:0/926247704 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec011830 con 0x7f42fc09f3d0 2023-09-30T22:29:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.689+0000 7f4300b9e700 1 -- 172.21.15.59:0/926247704 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec011990 con 0x7f42fc09f3d0 2023-09-30T22:29:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.689+0000 7f4300b9e700 1 -- 172.21.15.59:0/926247704 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec011d20 con 0x7f42fc09f3d0 2023-09-30T22:29:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.690+0000 7f4302ba2700 1 -- 172.21.15.59:0/926247704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42fc09f3d0 msgr2=0x7f42fc133790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.690+0000 7f4302ba2700 1 --2- 172.21.15.59:0/926247704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42fc09f3d0 0x7f42fc133790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0098f0 tx=0x7f42ec009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.690+0000 7f4302ba2700 1 -- 172.21.15.59:0/926247704 shutdown_connections 2023-09-30T22:29:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.690+0000 7f4302ba2700 1 --2- 172.21.15.59:0/926247704 >> v2:172.21.15.59:3300/0 conn(0x7f42fc09eac0 0x7f42fc09ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.690+0000 7f4302ba2700 1 --2- 172.21.15.59:0/926247704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42fc09f3d0 0x7f42fc133790 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.690+0000 7f4302ba2700 1 -- 172.21.15.59:0/926247704 >> 172.21.15.59:0/926247704 conn(0x7f42fc0a6390 msgr2=0x7f42fc0a6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.690+0000 7f4302ba2700 1 -- 172.21.15.59:0/926247704 shutdown_connections 2023-09-30T22:29:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.690+0000 7f4302ba2700 1 -- 172.21.15.59:0/926247704 wait complete. 2023-09-30T22:29:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.692+0000 7f4302ba2700 1 Processor -- start 2023-09-30T22:29:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.692+0000 7f4302ba2700 1 -- start start 2023-09-30T22:29:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.692+0000 7f4302ba2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42fc09eac0 0x7f42fc122640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.692+0000 7f4302ba2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42fc09f3d0 0x7f42fc122b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.692+0000 7f4302ba2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42fc09f7a0 0x7f42fc1230c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.692+0000 7f4302ba2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc125e80 con 0x7f42fc09eac0 2023-09-30T22:29:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.692+0000 7f4302ba2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc124360 con 0x7f42fc09f7a0 2023-09-30T22:29:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.692+0000 7f4302ba2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc09c2a0 con 0x7f42fc09f3d0 2023-09-30T22:29:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.692+0000 7f430139f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42fc09f3d0 0x7f42fc122b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.693+0000 7f430139f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42fc09f3d0 0x7f42fc122b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39948/0 (socket says 172.21.15.59:39948) 2023-09-30T22:29:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.693+0000 7f430139f700 1 -- 172.21.15.59:0/2223296608 learned_addr learned my addr 172.21.15.59:0/2223296608 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.693+0000 7f43023a1700 1 --2- 172.21.15.59:0/2223296608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42fc09f7a0 0x7f42fc1230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.693+0000 7f4301ba0700 1 --2- 172.21.15.59:0/2223296608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42fc09eac0 0x7f42fc122640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.693+0000 7f430139f700 1 -- 172.21.15.59:0/2223296608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42fc09f7a0 msgr2=0x7f42fc1230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.693+0000 7f430139f700 1 --2- 172.21.15.59:0/2223296608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42fc09f7a0 0x7f42fc1230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.693+0000 7f430139f700 1 -- 172.21.15.59:0/2223296608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42fc09eac0 msgr2=0x7f42fc122640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.693+0000 7f430139f700 1 --2- 172.21.15.59:0/2223296608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42fc09eac0 0x7f42fc122640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.693+0000 7f430139f700 1 -- 172.21.15.59:0/2223296608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f80094a0 con 0x7f42fc09f3d0 2023-09-30T22:29:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.693+0000 7f4301ba0700 1 --2- 172.21.15.59:0/2223296608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42fc09eac0 0x7f42fc122640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.693+0000 7f430139f700 1 --2- 172.21.15.59:0/2223296608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42fc09f3d0 0x7f42fc122b80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f42ec000c00 tx=0x7f42ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.693+0000 7f42f27fc700 1 -- 172.21.15.59:0/2223296608 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec0036a0 con 0x7f42fc09f3d0 2023-09-30T22:29:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.693+0000 7f42f27fc700 1 -- 172.21.15.59:0/2223296608 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec003800 con 0x7f42fc09f3d0 2023-09-30T22:29:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.693+0000 7f42f27fc700 1 -- 172.21.15.59:0/2223296608 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec003bd0 con 0x7f42fc09f3d0 2023-09-30T22:29:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.693+0000 7f4302ba2700 1 -- 172.21.15.59:0/2223296608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ec009550 con 0x7f42fc09f3d0 2023-09-30T22:29:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.694+0000 7f4302ba2700 1 -- 172.21.15.59:0/2223296608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42fc133160 con 0x7f42fc09f3d0 2023-09-30T22:29:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.695+0000 7f42f27fc700 1 -- 172.21.15.59:0/2223296608 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f42ec021070 con 0x7f42fc09f3d0 2023-09-30T22:29:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.695+0000 7f4302ba2700 1 -- 172.21.15.59:0/2223296608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42fc0a10c0 con 0x7f42fc09f3d0 2023-09-30T22:29:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.695+0000 7f42f27fc700 1 -- 172.21.15.59:0/2223296608 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4038+0+0 (secure 0 0 0) 0x7f42ec040c60 con 0x7f42fc09f3d0 2023-09-30T22:29:00.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.704+0000 7f42f27fc700 1 -- 172.21.15.59:0/2223296608 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42ec010380 con 0x7f42fc09f3d0 2023-09-30T22:29:00.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.740+0000 7f1b36dee700 1 Processor -- start 2023-09-30T22:29:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.740+0000 7f1b36dee700 1 -- start start 2023-09-30T22:29:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.741+0000 7f1b36dee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b3009d6f0 0x7f1b3009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.741+0000 7f1b36dee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b3009e410 0x7f1b30130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.741+0000 7f1b36dee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3009f130 con 0x7f1b3009e000 2023-09-30T22:29:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.741+0000 7f1b36dee700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3009f520 con 0x7f1b3009d6f0 2023-09-30T22:29:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.741+0000 7f1b36dee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3009e930 con 0x7f1b3009e410 2023-09-30T22:29:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.741+0000 7f1b34b8a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b3009d6f0 0x7f1b3009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.741+0000 7f1b34b8a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b3009d6f0 0x7f1b3009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56474/0 (socket says 172.21.15.59:56474) 2023-09-30T22:29:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.741+0000 7f1b34b8a700 1 -- 172.21.15.59:0/2399168357 learned_addr learned my addr 172.21.15.59:0/2399168357 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.741+0000 7f1b3538b700 1 --2- 172.21.15.59:0/2399168357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b3009e410 0x7f1b30130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.742+0000 7f1b34b8a700 1 -- 172.21.15.59:0/2399168357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b3009e410 msgr2=0x7f1b30130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.742+0000 7f1b34b8a700 1 --2- 172.21.15.59:0/2399168357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b3009e410 0x7f1b30130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.742+0000 7f1b34b8a700 1 -- 172.21.15.59:0/2399168357 >> v1:172.21.15.59:6789/0 conn(0x7f1b3009e000 legacy=0x7f1b30130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.742+0000 7f1b2f7fe700 1 -- 172.21.15.59:0/2399168357 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167123069 0 0) 0x7f1b3009f130 con 0x7f1b3009e000 2023-09-30T22:29:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.742+0000 7f1b34b8a700 1 -- 172.21.15.59:0/2399168357 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3009b2d0 con 0x7f1b3009d6f0 2023-09-30T22:29:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.742+0000 7f1b3538b700 1 --2- 172.21.15.59:0/2399168357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b3009e410 0x7f1b30130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.742+0000 7f1b34b8a700 1 --2- 172.21.15.59:0/2399168357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b3009d6f0 0x7f1b3009dac0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400bb90 tx=0x7f1b2400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaed0db7b68ea0a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.742+0000 7f1b2f7fe700 1 -- 172.21.15.59:0/2399168357 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400dd50 con 0x7f1b3009d6f0 2023-09-30T22:29:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.742+0000 7f1b2f7fe700 1 -- 172.21.15.59:0/2399168357 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b24010470 con 0x7f1b3009d6f0 2023-09-30T22:29:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.742+0000 7f1b2f7fe700 1 -- 172.21.15.59:0/2399168357 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24010800 con 0x7f1b3009d6f0 2023-09-30T22:29:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.743+0000 7f1b36dee700 1 -- 172.21.15.59:0/2399168357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b3009d6f0 msgr2=0x7f1b3009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.743+0000 7f1b36dee700 1 --2- 172.21.15.59:0/2399168357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b3009d6f0 0x7f1b3009dac0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400bb90 tx=0x7f1b2400bea0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.743+0000 7f1b36dee700 1 -- 172.21.15.59:0/2399168357 shutdown_connections 2023-09-30T22:29:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.743+0000 7f1b36dee700 1 --2- 172.21.15.59:0/2399168357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b3009e410 0x7f1b30130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.743+0000 7f1b36dee700 1 --2- 172.21.15.59:0/2399168357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b3009d6f0 0x7f1b3009dac0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.743+0000 7f1b36dee700 1 -- 172.21.15.59:0/2399168357 >> 172.21.15.59:0/2399168357 conn(0x7f1b30066f50 msgr2=0x7f1b3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.743+0000 7f1b36dee700 1 -- 172.21.15.59:0/2399168357 shutdown_connections 2023-09-30T22:29:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.743+0000 7f1b36dee700 1 -- 172.21.15.59:0/2399168357 wait complete. 2023-09-30T22:29:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.745+0000 7f1b36dee700 1 Processor -- start 2023-09-30T22:29:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.745+0000 7f1b36dee700 1 -- start start 2023-09-30T22:29:00.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b36dee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b3009d6f0 0x7f1b30122350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b36dee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b3009e000 0x7f1b30122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b36dee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b3009e410 0x7f1b30122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b36dee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b301247e0 con 0x7f1b3009e000 2023-09-30T22:29:00.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b36dee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30125490 con 0x7f1b3009e410 2023-09-30T22:29:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b36dee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30125e20 con 0x7f1b3009d6f0 2023-09-30T22:29:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b34b8a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b3009d6f0 0x7f1b30122350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b34b8a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b3009d6f0 0x7f1b30122350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39978/0 (socket says 172.21.15.59:39978) 2023-09-30T22:29:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b34b8a700 1 -- 172.21.15.59:0/2414410584 learned_addr learned my addr 172.21.15.59:0/2414410584 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b3538b700 1 --2- 172.21.15.59:0/2414410584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b3009e410 0x7f1b30122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b2ffff700 1 --2- 172.21.15.59:0/2414410584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b3009e000 0x7f1b30122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b34b8a700 1 -- 172.21.15.59:0/2414410584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b3009e410 msgr2=0x7f1b30122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b34b8a700 1 --2- 172.21.15.59:0/2414410584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b3009e410 0x7f1b30122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b34b8a700 1 -- 172.21.15.59:0/2414410584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b3009e000 msgr2=0x7f1b30122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b34b8a700 1 --2- 172.21.15.59:0/2414410584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b3009e000 0x7f1b30122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b34b8a700 1 -- 172.21.15.59:0/2414410584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2400b7f0 con 0x7f1b3009d6f0 2023-09-30T22:29:00.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b2ffff700 1 --2- 172.21.15.59:0/2414410584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b3009e000 0x7f1b30122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:00.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.746+0000 7f1b34b8a700 1 --2- 172.21.15.59:0/2414410584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b3009d6f0 0x7f1b30122350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400bee0 tx=0x7f1b24004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.747+0000 7f1b2d7fa700 1 -- 172.21.15.59:0/2414410584 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24003b70 con 0x7f1b3009d6f0 2023-09-30T22:29:00.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.747+0000 7f1b2d7fa700 1 -- 172.21.15.59:0/2414410584 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b24003cd0 con 0x7f1b3009d6f0 2023-09-30T22:29:00.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.747+0000 7f1b36dee700 1 -- 172.21.15.59:0/2414410584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b30125880 con 0x7f1b3009d6f0 2023-09-30T22:29:00.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.747+0000 7f1b2d7fa700 1 -- 172.21.15.59:0/2414410584 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b240107e0 con 0x7f1b3009d6f0 2023-09-30T22:29:00.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.747+0000 7f1b36dee700 1 -- 172.21.15.59:0/2414410584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b30125b40 con 0x7f1b3009d6f0 2023-09-30T22:29:00.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.748+0000 7f1b36dee700 1 -- 172.21.15.59:0/2414410584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b30074ea0 con 0x7f1b3009d6f0 2023-09-30T22:29:00.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.749+0000 7f1b2d7fa700 1 -- 172.21.15.59:0/2414410584 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f1b2402d420 con 0x7f1b3009d6f0 2023-09-30T22:29:00.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.749+0000 7f1b2d7fa700 1 -- 172.21.15.59:0/2414410584 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4038+0+0 (secure 0 0 0) 0x7f1b240412f0 con 0x7f1b3009d6f0 2023-09-30T22:29:00.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.754+0000 7f1b2d7fa700 1 -- 172.21.15.59:0/2414410584 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b2402d6d0 con 0x7f1b3009d6f0 2023-09-30T22:29:00.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.766+0000 7fdf2b6c7700 1 Processor -- start 2023-09-30T22:29:00.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.767+0000 7fdf2b6c7700 1 -- start start 2023-09-30T22:29:00.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.767+0000 7fdf2b6c7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2409d6f0 0x7fdf2409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.767+0000 7fdf2b6c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf2409e000 0x7fdf241339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.767+0000 7fdf2b6c7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf2409e410 0x7fdf24133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.767+0000 7fdf2b6c7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2406b460 con 0x7fdf2409e410 2023-09-30T22:29:00.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.767+0000 7fdf2b6c7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2409b120 con 0x7fdf2409e000 2023-09-30T22:29:00.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.767+0000 7fdf2b6c7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2409a7e0 con 0x7fdf2409d6f0 2023-09-30T22:29:00.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.767+0000 7fdf29463700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2409d6f0 0x7fdf2409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.767+0000 7fdf29463700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2409d6f0 0x7fdf2409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39992/0 (socket says 172.21.15.59:39992) 2023-09-30T22:29:00.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.768+0000 7fdf29463700 1 -- 172.21.15.59:0/2156199991 learned_addr learned my addr 172.21.15.59:0/2156199991 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:00.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.768+0000 7fdf29c64700 1 --2- 172.21.15.59:0/2156199991 >> v2:172.21.15.59:3300/0 conn(0x7fdf2409e410 0x7fdf24133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.768+0000 7fdf28c62700 1 --2- 172.21.15.59:0/2156199991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf2409e000 0x7fdf241339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.768+0000 7fdf29463700 1 -- 172.21.15.59:0/2156199991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf2409e000 msgr2=0x7fdf241339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:00.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.768+0000 7fdf29463700 1 --2- 172.21.15.59:0/2156199991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf2409e000 0x7fdf241339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.768+0000 7fdf29463700 1 -- 172.21.15.59:0/2156199991 >> v2:172.21.15.59:3300/0 conn(0x7fdf2409e410 msgr2=0x7fdf24133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:00.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.768+0000 7fdf29463700 1 --2- 172.21.15.59:0/2156199991 >> v2:172.21.15.59:3300/0 conn(0x7fdf2409e410 0x7fdf24133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.768+0000 7fdf29463700 1 -- 172.21.15.59:0/2156199991 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2409a500 con 0x7fdf2409d6f0 2023-09-30T22:29:00.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.768+0000 7fdf29c64700 1 --2- 172.21.15.59:0/2156199991 >> v2:172.21.15.59:3300/0 conn(0x7fdf2409e410 0x7fdf24133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:00.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.768+0000 7fdf29463700 1 --2- 172.21.15.59:0/2156199991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2409d6f0 0x7fdf2409dac0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009920 tx=0x7fdf20009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a2ee522f0d17e67 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.769+0000 7fdf1bfff700 1 -- 172.21.15.59:0/2156199991 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20011830 con 0x7fdf2409d6f0 2023-09-30T22:29:00.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.769+0000 7fdf1bfff700 1 -- 172.21.15.59:0/2156199991 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf20011990 con 0x7fdf2409d6f0 2023-09-30T22:29:00.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.769+0000 7fdf1bfff700 1 -- 172.21.15.59:0/2156199991 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20011d20 con 0x7fdf2409d6f0 2023-09-30T22:29:00.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.770+0000 7fdf2b6c7700 1 -- 172.21.15.59:0/2156199991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2409d6f0 msgr2=0x7fdf2409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.770+0000 7fdf2b6c7700 1 --2- 172.21.15.59:0/2156199991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2409d6f0 0x7fdf2409dac0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009920 tx=0x7fdf20009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:00.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.770+0000 7fdf2b6c7700 1 -- 172.21.15.59:0/2156199991 shutdown_connections 2023-09-30T22:29:00.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.770+0000 7fdf2b6c7700 1 --2- 172.21.15.59:0/2156199991 >> v2:172.21.15.59:3300/0 conn(0x7fdf2409e410 0x7fdf24133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.770+0000 7fdf2b6c7700 1 --2- 172.21.15.59:0/2156199991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2409d6f0 0x7fdf2409dac0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.770+0000 7fdf2b6c7700 1 --2- 172.21.15.59:0/2156199991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf2409e000 0x7fdf241339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.770+0000 7fdf2b6c7700 1 -- 172.21.15.59:0/2156199991 >> 172.21.15.59:0/2156199991 conn(0x7fdf24066f50 msgr2=0x7fdf2409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.770+0000 7fdf2b6c7700 1 -- 172.21.15.59:0/2156199991 shutdown_connections 2023-09-30T22:29:00.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.770+0000 7fdf2b6c7700 1 -- 172.21.15.59:0/2156199991 wait complete. 2023-09-30T22:29:00.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.771+0000 7fdf2b6c7700 1 Processor -- start 2023-09-30T22:29:00.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.772+0000 7fdf2b6c7700 1 -- start start 2023-09-30T22:29:00.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.772+0000 7fdf2b6c7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2409d6f0 0x7fdf241c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.772+0000 7fdf2b6c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf2409e000 0x7fdf241c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.772+0000 7fdf2b6c7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf2409e410 0x7fdf241c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.772+0000 7fdf2b6c7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf241a5590 con 0x7fdf2409e410 2023-09-30T22:29:00.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.772+0000 7fdf2b6c7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf241a53a0 con 0x7fdf2409e000 2023-09-30T22:29:00.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.772+0000 7fdf2b6c7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240a30c0 con 0x7fdf2409d6f0 2023-09-30T22:29:00.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.773+0000 7fdf29463700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2409d6f0 0x7fdf241c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.773+0000 7fdf29463700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2409d6f0 0x7fdf241c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39996/0 (socket says 172.21.15.59:39996) 2023-09-30T22:29:00.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.773+0000 7fdf29463700 1 -- 172.21.15.59:0/1395148789 learned_addr learned my addr 172.21.15.59:0/1395148789 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:00.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.773+0000 7fdf28c62700 1 --2- 172.21.15.59:0/1395148789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf2409e000 0x7fdf241c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.773+0000 7fdf29c64700 1 --2- 172.21.15.59:0/1395148789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf2409e410 0x7fdf241c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.773+0000 7fdf28c62700 1 -- 172.21.15.59:0/1395148789 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2409d6f0 msgr2=0x7fdf241c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.773+0000 7fdf28c62700 1 --2- 172.21.15.59:0/1395148789 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2409d6f0 0x7fdf241c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.773+0000 7fdf28c62700 1 -- 172.21.15.59:0/1395148789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf2409e410 msgr2=0x7fdf241c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.773+0000 7fdf28c62700 1 --2- 172.21.15.59:0/1395148789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf2409e410 0x7fdf241c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.773+0000 7fdf28c62700 1 -- 172.21.15.59:0/1395148789 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c009a70 con 0x7fdf2409e000 2023-09-30T22:29:00.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.773+0000 7fdf28c62700 1 --2- 172.21.15.59:0/1395148789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf2409e000 0x7fdf241c86d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400e8d0 tx=0x7fdf1400ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.774+0000 7fdf19ffb700 1 -- 172.21.15.59:0/1395148789 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14013680 con 0x7fdf2409e000 2023-09-30T22:29:00.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.774+0000 7fdf19ffb700 1 -- 172.21.15.59:0/1395148789 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf140137e0 con 0x7fdf2409e000 2023-09-30T22:29:00.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.774+0000 7fdf2b6c7700 1 -- 172.21.15.59:0/1395148789 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf20009550 con 0x7fdf2409e000 2023-09-30T22:29:00.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.774+0000 7fdf19ffb700 1 -- 172.21.15.59:0/1395148789 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14013b50 con 0x7fdf2409e000 2023-09-30T22:29:00.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.774+0000 7fdf2b6c7700 1 -- 172.21.15.59:0/1395148789 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf241a7320 con 0x7fdf2409e000 2023-09-30T22:29:00.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.775+0000 7fdf19ffb700 1 -- 172.21.15.59:0/1395148789 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7fdf14013cb0 con 0x7fdf2409e000 2023-09-30T22:29:00.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.775+0000 7fdf19ffb700 1 -- 172.21.15.59:0/1395148789 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4038+0+0 (secure 0 0 0) 0x7fdf1403f740 con 0x7fdf2409e000 2023-09-30T22:29:00.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.775+0000 7fdf2b6c7700 1 -- 172.21.15.59:0/1395148789 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf241a6ef0 con 0x7fdf2409e000 2023-09-30T22:29:00.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.780+0000 7fdf19ffb700 1 -- 172.21.15.59:0/1395148789 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf14017080 con 0x7fdf2409e000 2023-09-30T22:29:00.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.885+0000 7f1e65d53700 1 -- 172.21.15.59:0/2216552942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e60074ea0 con 0x7f1e6009e000 2023-09-30T22:29:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.886+0000 7f1e47fff700 1 -- 172.21.15.59:0/2216552942 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1e54020b00 con 0x7f1e6009e000 2023-09-30T22:29:00.886 INFO:teuthology.orchestra.run.smithi059.stdout:42949672990 2023-09-30T22:29:00.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.889+0000 7f1e65d53700 1 -- 172.21.15.59:0/2216552942 >> v1:172.21.15.59:6816/126772 conn(0x7f1e4c02f240 legacy=0x7f1e4c0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.889+0000 7f1e65d53700 1 -- 172.21.15.59:0/2216552942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6009e000 msgr2=0x7f1e6011e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.889+0000 7f1e65d53700 1 --2- 172.21.15.59:0/2216552942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6009e000 0x7f1e6011e670 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400bf20 tx=0x7f1e54009530 comp rx=0 tx=0).stop 2023-09-30T22:29:00.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.889+0000 7f1e65d53700 1 -- 172.21.15.59:0/2216552942 shutdown_connections 2023-09-30T22:29:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.889+0000 7f1e65d53700 1 --2- 172.21.15.59:0/2216552942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6009e410 0x7f1e6011ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.889+0000 7f1e65d53700 1 --2- 172.21.15.59:0/2216552942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6009d6f0 0x7f1e6011e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.889+0000 7f1e65d53700 1 --2- 172.21.15.59:0/2216552942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6009e000 0x7f1e6011e670 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.889+0000 7f1e65d53700 1 -- 172.21.15.59:0/2216552942 >> 172.21.15.59:0/2216552942 conn(0x7f1e60066f50 msgr2=0x7f1e6006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.889+0000 7f1e65d53700 1 -- 172.21.15.59:0/2216552942 shutdown_connections 2023-09-30T22:29:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.889+0000 7f1e65d53700 1 -- 172.21.15.59:0/2216552942 wait complete. 2023-09-30T22:29:00.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672991 got 42949672990 for osd.2 2023-09-30T22:29:00.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.917+0000 7f4302ba2700 1 -- 172.21.15.59:0/2223296608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f42fc04f2a0 con 0x7f42fc09f3d0 2023-09-30T22:29:00.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.917+0000 7f42f27fc700 1 -- 172.21.15.59:0/2223296608 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42ec029030 con 0x7f42fc09f3d0 2023-09-30T22:29:00.918 INFO:teuthology.orchestra.run.smithi059.stdout:38654705694 2023-09-30T22:29:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.920+0000 7f4302ba2700 1 -- 172.21.15.59:0/2223296608 >> v1:172.21.15.59:6816/126772 conn(0x7f42e002f240 legacy=0x7f42e00316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.920+0000 7f4302ba2700 1 -- 172.21.15.59:0/2223296608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42fc09f3d0 msgr2=0x7f42fc122b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.920+0000 7f4302ba2700 1 --2- 172.21.15.59:0/2223296608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42fc09f3d0 0x7f42fc122b80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f42ec000c00 tx=0x7f42ec004750 comp rx=0 tx=0).stop 2023-09-30T22:29:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.920+0000 7f4302ba2700 1 -- 172.21.15.59:0/2223296608 shutdown_connections 2023-09-30T22:29:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.920+0000 7f4302ba2700 1 --2- 172.21.15.59:0/2223296608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42fc09f7a0 0x7f42fc1230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.920+0000 7f4302ba2700 1 --2- 172.21.15.59:0/2223296608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42fc09eac0 0x7f42fc122640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.920+0000 7f4302ba2700 1 --2- 172.21.15.59:0/2223296608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42fc09f3d0 0x7f42fc122b80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.920+0000 7f4302ba2700 1 -- 172.21.15.59:0/2223296608 >> 172.21.15.59:0/2223296608 conn(0x7f42fc0a6390 msgr2=0x7f42fc11c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.920+0000 7f4302ba2700 1 -- 172.21.15.59:0/2223296608 shutdown_connections 2023-09-30T22:29:00.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.920+0000 7f4302ba2700 1 -- 172.21.15.59:0/2223296608 wait complete. 2023-09-30T22:29:00.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705694 for osd.3 2023-09-30T22:29:00.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.963+0000 7f1b36dee700 1 -- 172.21.15.59:0/2414410584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1b3006c360 con 0x7f1b3009d6f0 2023-09-30T22:29:00.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.963+0000 7f1b2d7fa700 1 -- 172.21.15.59:0/2414410584 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b240223a0 con 0x7f1b3009d6f0 2023-09-30T22:29:00.963 INFO:teuthology.orchestra.run.smithi059.stdout:38654705694 2023-09-30T22:29:00.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.965+0000 7f1b36dee700 1 -- 172.21.15.59:0/2414410584 >> v1:172.21.15.59:6816/126772 conn(0x7f1b1402f270 legacy=0x7f1b14031720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.965+0000 7f1b36dee700 1 -- 172.21.15.59:0/2414410584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b3009d6f0 msgr2=0x7f1b30122350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.965+0000 7f1b36dee700 1 --2- 172.21.15.59:0/2414410584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b3009d6f0 0x7f1b30122350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400bee0 tx=0x7f1b24004750 comp rx=0 tx=0).stop 2023-09-30T22:29:00.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.965+0000 7f1b36dee700 1 -- 172.21.15.59:0/2414410584 shutdown_connections 2023-09-30T22:29:00.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.965+0000 7f1b36dee700 1 --2- 172.21.15.59:0/2414410584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b3009d6f0 0x7f1b30122350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.965+0000 7f1b36dee700 1 --2- 172.21.15.59:0/2414410584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b3009e410 0x7f1b30122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.965+0000 7f1b36dee700 1 --2- 172.21.15.59:0/2414410584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b3009e000 0x7f1b30122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.965+0000 7f1b36dee700 1 -- 172.21.15.59:0/2414410584 >> 172.21.15.59:0/2414410584 conn(0x7f1b30066f50 msgr2=0x7f1b30070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.966+0000 7f1b36dee700 1 -- 172.21.15.59:0/2414410584 shutdown_connections 2023-09-30T22:29:00.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:00.966+0000 7f1b36dee700 1 -- 172.21.15.59:0/2414410584 wait complete. 2023-09-30T22:29:00.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705694 for osd.1 2023-09-30T22:29:01.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:01.007+0000 7fdf2b6c7700 1 -- 172.21.15.59:0/1395148789 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdf24074ea0 con 0x7fdf2409e000 2023-09-30T22:29:01.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:01.007+0000 7fdf19ffb700 1 -- 172.21.15.59:0/1395148789 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf14021020 con 0x7fdf2409e000 2023-09-30T22:29:01.008 INFO:teuthology.orchestra.run.smithi059.stdout:42949672990 2023-09-30T22:29:01.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:01.009+0000 7fdf2b6c7700 1 -- 172.21.15.59:0/1395148789 >> v1:172.21.15.59:6816/126772 conn(0x7fdf0802f240 legacy=0x7fdf080316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:01.009+0000 7fdf2b6c7700 1 -- 172.21.15.59:0/1395148789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf2409e000 msgr2=0x7fdf241c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:01.009+0000 7fdf2b6c7700 1 --2- 172.21.15.59:0/1395148789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf2409e000 0x7fdf241c86d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400e8d0 tx=0x7fdf1400ebe0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:01.010+0000 7fdf2b6c7700 1 -- 172.21.15.59:0/1395148789 shutdown_connections 2023-09-30T22:29:01.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:01.010+0000 7fdf2b6c7700 1 --2- 172.21.15.59:0/1395148789 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2409d6f0 0x7fdf241c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:01.010+0000 7fdf2b6c7700 1 --2- 172.21.15.59:0/1395148789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf2409e410 0x7fdf241c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:01.010+0000 7fdf2b6c7700 1 --2- 172.21.15.59:0/1395148789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf2409e000 0x7fdf241c86d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:01.010+0000 7fdf2b6c7700 1 -- 172.21.15.59:0/1395148789 >> 172.21.15.59:0/1395148789 conn(0x7fdf24066f50 msgr2=0x7fdf241bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:01.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:01.010+0000 7fdf2b6c7700 1 -- 172.21.15.59:0/1395148789 shutdown_connections 2023-09-30T22:29:01.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:01.010+0000 7fdf2b6c7700 1 -- 172.21.15.59:0/1395148789 wait complete. 2023-09-30T22:29:01.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672991 got 42949672990 for osd.0 2023-09-30T22:29:01.903 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:01.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:01.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:02.024 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:02.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.050+0000 7f566f008700 1 Processor -- start 2023-09-30T22:29:02.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.050+0000 7f566f008700 1 -- start start 2023-09-30T22:29:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.051+0000 7f566f008700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566809d6f0 0x7f566809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.051+0000 7f566f008700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f566809e410 0x7f5668130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.051+0000 7f566f008700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566809f130 con 0x7f566809e000 2023-09-30T22:29:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.051+0000 7f566f008700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566809f520 con 0x7f566809e410 2023-09-30T22:29:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.051+0000 7f566f008700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566809e930 con 0x7f566809d6f0 2023-09-30T22:29:02.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.051+0000 7f5667fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f566809e000 0x7f5668130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56964/0 (socket says 172.21.15.59:56964) 2023-09-30T22:29:02.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.051+0000 7f5667fff700 1 -- 172.21.15.59:0/220573948 learned_addr learned my addr 172.21.15.59:0/220573948 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:02.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.051+0000 7f566d5a5700 1 --2- 172.21.15.59:0/220573948 >> v2:172.21.15.59:3300/0 conn(0x7f566809e410 0x7f5668130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.051+0000 7f566cda4700 1 --2- 172.21.15.59:0/220573948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566809d6f0 0x7f566809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.051+0000 7f56677fe700 1 -- 172.21.15.59:0/220573948 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986757999 0 0) 0x7f566809f130 con 0x7f566809e000 2023-09-30T22:29:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.051+0000 7f56677fe700 1 -- 172.21.15.59:0/220573948 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56580057c0 con 0x7f566809e000 2023-09-30T22:29:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.052+0000 7f566cda4700 1 -- 172.21.15.59:0/220573948 >> v2:172.21.15.59:3300/0 conn(0x7f566809e410 msgr2=0x7f5668130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.052+0000 7f566cda4700 1 --2- 172.21.15.59:0/220573948 >> v2:172.21.15.59:3300/0 conn(0x7f566809e410 0x7f5668130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.052+0000 7f566cda4700 1 -- 172.21.15.59:0/220573948 >> v1:172.21.15.59:6789/0 conn(0x7f566809e000 legacy=0x7f5668130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.052+0000 7f566cda4700 1 -- 172.21.15.59:0/220573948 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566809b2d0 con 0x7f566809d6f0 2023-09-30T22:29:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.052+0000 7f566cda4700 1 --2- 172.21.15.59:0/220573948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566809d6f0 0x7f566809dac0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f565c009840 tx=0x7f565c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb3e118942edf009 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.052+0000 7f56677fe700 1 -- 172.21.15.59:0/220573948 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c011830 con 0x7f566809d6f0 2023-09-30T22:29:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.052+0000 7f56677fe700 1 -- 172.21.15.59:0/220573948 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c011990 con 0x7f566809d6f0 2023-09-30T22:29:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.052+0000 7f56677fe700 1 -- 172.21.15.59:0/220573948 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c011d20 con 0x7f566809d6f0 2023-09-30T22:29:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.053+0000 7f566f008700 1 -- 172.21.15.59:0/220573948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566809d6f0 msgr2=0x7f566809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.053+0000 7f566f008700 1 --2- 172.21.15.59:0/220573948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566809d6f0 0x7f566809dac0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f565c009840 tx=0x7f565c009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.054+0000 7f566f008700 1 -- 172.21.15.59:0/220573948 shutdown_connections 2023-09-30T22:29:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.054+0000 7f566f008700 1 --2- 172.21.15.59:0/220573948 >> v2:172.21.15.59:3300/0 conn(0x7f566809e410 0x7f5668130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.054+0000 7f566f008700 1 --2- 172.21.15.59:0/220573948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566809d6f0 0x7f566809dac0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.054+0000 7f566f008700 1 -- 172.21.15.59:0/220573948 >> 172.21.15.59:0/220573948 conn(0x7f5668066f50 msgr2=0x7f566809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.054+0000 7f566f008700 1 -- 172.21.15.59:0/220573948 shutdown_connections 2023-09-30T22:29:02.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.054+0000 7f566f008700 1 -- 172.21.15.59:0/220573948 wait complete. 2023-09-30T22:29:02.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.056+0000 7f566f008700 1 Processor -- start 2023-09-30T22:29:02.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.056+0000 7f566f008700 1 -- start start 2023-09-30T22:29:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.057+0000 7f566f008700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566809d6f0 0x7f56681221d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.057+0000 7f566f008700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566809e000 0x7f5668122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.057+0000 7f566f008700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f566809e410 0x7f5668122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.057+0000 7f566f008700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5668125cf0 con 0x7f566809e000 2023-09-30T22:29:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.057+0000 7f566f008700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56680a2120 con 0x7f566809d6f0 2023-09-30T22:29:02.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.057+0000 7f566f008700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5668123de0 con 0x7f566809e410 2023-09-30T22:29:02.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.058+0000 7f566cda4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566809d6f0 0x7f56681221d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.058+0000 7f566d5a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f566809e410 0x7f5668122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.058+0000 7f566cda4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566809d6f0 0x7f56681221d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36942/0 (socket says 172.21.15.59:36942) 2023-09-30T22:29:02.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.058+0000 7f566cda4700 1 -- 172.21.15.59:0/1625931282 learned_addr learned my addr 172.21.15.59:0/1625931282 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:02.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.058+0000 7f566d5a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f566809e410 0x7f5668122c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40020/0 (socket says 172.21.15.59:40020) 2023-09-30T22:29:02.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.058+0000 7f5667fff700 1 --2- 172.21.15.59:0/1625931282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566809e000 0x7f5668122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.058+0000 7f566cda4700 1 -- 172.21.15.59:0/1625931282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f566809e410 msgr2=0x7f5668122c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.058+0000 7f566cda4700 1 --2- 172.21.15.59:0/1625931282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f566809e410 0x7f5668122c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.058+0000 7f566cda4700 1 -- 172.21.15.59:0/1625931282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566809e000 msgr2=0x7f5668122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.058+0000 7f566cda4700 1 --2- 172.21.15.59:0/1625931282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566809e000 0x7f5668122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.058+0000 7f566cda4700 1 -- 172.21.15.59:0/1625931282 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c0094a0 con 0x7f566809d6f0 2023-09-30T22:29:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.058+0000 7f566cda4700 1 --2- 172.21.15.59:0/1625931282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566809d6f0 0x7f56681221d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f565c0090b0 tx=0x7f565c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.059+0000 7f56657fa700 1 -- 172.21.15.59:0/1625931282 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c004590 con 0x7f566809d6f0 2023-09-30T22:29:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.059+0000 7f56657fa700 1 -- 172.21.15.59:0/1625931282 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c01f070 con 0x7f566809d6f0 2023-09-30T22:29:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.059+0000 7f56657fa700 1 -- 172.21.15.59:0/1625931282 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c0038e0 con 0x7f566809d6f0 2023-09-30T22:29:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.059+0000 7f566f008700 1 -- 172.21.15.59:0/1625931282 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566809c700 con 0x7f566809d6f0 2023-09-30T22:29:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.059+0000 7f566f008700 1 -- 172.21.15.59:0/1625931282 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56681245d0 con 0x7f566809d6f0 2023-09-30T22:29:02.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.060+0000 7f56657fa700 1 -- 172.21.15.59:0/1625931282 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f565c003a40 con 0x7f566809d6f0 2023-09-30T22:29:02.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.060+0000 7f56657fa700 1 -- 172.21.15.59:0/1625931282 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f565c021070 con 0x7f566809d6f0 2023-09-30T22:29:02.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.060+0000 7f566f008700 1 -- 172.21.15.59:0/1625931282 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56681256b0 con 0x7f566809d6f0 2023-09-30T22:29:02.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.067+0000 7f56657fa700 1 -- 172.21.15.59:0/1625931282 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56681256b0 con 0x7f566809d6f0 2023-09-30T22:29:02.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.127+0000 7f273a617700 1 Processor -- start 2023-09-30T22:29:02.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.127+0000 7f273a617700 1 -- start start 2023-09-30T22:29:02.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.127+0000 7f273a617700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273412cf60 0x7f273406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.127+0000 7f273a617700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f273412f8b0 0x7f273412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.127+0000 7f273a617700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2734130260 0x7f2734136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.127+0000 7f273a617700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273412d330 con 0x7f2734130260 2023-09-30T22:29:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.127+0000 7f273a617700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273412cd90 con 0x7f273412cf60 2023-09-30T22:29:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.127+0000 7f273a617700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27341306d0 con 0x7f273412f8b0 2023-09-30T22:29:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.128+0000 7f2733fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273412cf60 0x7f273406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.128+0000 7f2733fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273412cf60 0x7f273406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36948/0 (socket says 172.21.15.59:36948) 2023-09-30T22:29:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.128+0000 7f2733fff700 1 -- 172.21.15.59:0/2382793802 learned_addr learned my addr 172.21.15.59:0/2382793802 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.128+0000 7f2738bb4700 1 --2- 172.21.15.59:0/2382793802 >> v2:172.21.15.59:3300/0 conn(0x7f2734130260 0x7f2734136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.128+0000 7f27337fe700 1 --2- 172.21.15.59:0/2382793802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f273412f8b0 0x7f273412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.128+0000 7f2738bb4700 1 -- 172.21.15.59:0/2382793802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f273412f8b0 msgr2=0x7f273412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.128+0000 7f2738bb4700 1 --2- 172.21.15.59:0/2382793802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f273412f8b0 0x7f273412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.128+0000 7f2738bb4700 1 -- 172.21.15.59:0/2382793802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273412cf60 msgr2=0x7f273406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.128+0000 7f2738bb4700 1 --2- 172.21.15.59:0/2382793802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273412cf60 0x7f273406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.128+0000 7f2738bb4700 1 -- 172.21.15.59:0/2382793802 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2734071780 con 0x7f2734130260 2023-09-30T22:29:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.129+0000 7f2738bb4700 1 --2- 172.21.15.59:0/2382793802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734130260 0x7f2734136c20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f272c009d90 tx=0x7f272c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a51bd3f0f79a683 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.129+0000 7f2732ffd700 1 -- 172.21.15.59:0/2382793802 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c00e070 con 0x7f2734130260 2023-09-30T22:29:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.129+0000 7f2732ffd700 1 -- 172.21.15.59:0/2382793802 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c00bbd0 con 0x7f2734130260 2023-09-30T22:29:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.129+0000 7f2732ffd700 1 -- 172.21.15.59:0/2382793802 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c012430 con 0x7f2734130260 2023-09-30T22:29:02.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.130+0000 7f273a617700 1 -- 172.21.15.59:0/2382793802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734130260 msgr2=0x7f2734136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.130+0000 7f273a617700 1 --2- 172.21.15.59:0/2382793802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734130260 0x7f2734136c20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f272c009d90 tx=0x7f272c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:02.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.130+0000 7f273a617700 1 -- 172.21.15.59:0/2382793802 shutdown_connections 2023-09-30T22:29:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.130+0000 7f273a617700 1 --2- 172.21.15.59:0/2382793802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734130260 0x7f2734136c20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.130+0000 7f273a617700 1 --2- 172.21.15.59:0/2382793802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273412cf60 0x7f273406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.130+0000 7f273a617700 1 --2- 172.21.15.59:0/2382793802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f273412f8b0 0x7f273412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.130+0000 7f273a617700 1 -- 172.21.15.59:0/2382793802 >> 172.21.15.59:0/2382793802 conn(0x7f27340a2aa0 msgr2=0x7f27340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.130+0000 7f273a617700 1 -- 172.21.15.59:0/2382793802 shutdown_connections 2023-09-30T22:29:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.130+0000 7f273a617700 1 -- 172.21.15.59:0/2382793802 wait complete. 2023-09-30T22:29:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.131+0000 7f273a617700 1 Processor -- start 2023-09-30T22:29:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.131+0000 7f273a617700 1 -- start start 2023-09-30T22:29:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.132+0000 7f273a617700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f273412cf60 0x7f273409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.132+0000 7f273a617700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273412f8b0 0x7f273409e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.132+0000 7f273a617700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734130260 0x7f27341c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.132+0000 7f273a617700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273411aa00 con 0x7f2734130260 2023-09-30T22:29:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.132+0000 7f273a617700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273409d880 con 0x7f273412f8b0 2023-09-30T22:29:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.132+0000 7f273a617700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f273412da40 con 0x7f273412cf60 2023-09-30T22:29:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.132+0000 7f27337fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273412f8b0 0x7f273409e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.132+0000 7f27337fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273412f8b0 0x7f273409e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36956/0 (socket says 172.21.15.59:36956) 2023-09-30T22:29:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.132+0000 7f27337fe700 1 -- 172.21.15.59:0/467554956 learned_addr learned my addr 172.21.15.59:0/467554956 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.132+0000 7f2738bb4700 1 --2- 172.21.15.59:0/467554956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734130260 0x7f27341c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.133+0000 7f2733fff700 1 --2- 172.21.15.59:0/467554956 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f273412cf60 0x7f273409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.133+0000 7f27337fe700 1 -- 172.21.15.59:0/467554956 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f273412cf60 msgr2=0x7f273409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.133+0000 7f27337fe700 1 --2- 172.21.15.59:0/467554956 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f273412cf60 0x7f273409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.133+0000 7f27337fe700 1 -- 172.21.15.59:0/467554956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734130260 msgr2=0x7f27341c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.133+0000 7f27337fe700 1 --2- 172.21.15.59:0/467554956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734130260 0x7f27341c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.133+0000 7f27337fe700 1 -- 172.21.15.59:0/467554956 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c009a70 con 0x7f273412f8b0 2023-09-30T22:29:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.133+0000 7f2738bb4700 1 --2- 172.21.15.59:0/467554956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734130260 0x7f27341c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.133+0000 7f27337fe700 1 --2- 172.21.15.59:0/467554956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273412f8b0 0x7f273409e2b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f272800e810 tx=0x7f272800eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.133+0000 7f2730ff9700 1 -- 172.21.15.59:0/467554956 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728013610 con 0x7f273412f8b0 2023-09-30T22:29:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.133+0000 7f273a617700 1 -- 172.21.15.59:0/467554956 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273411ac00 con 0x7f273412f8b0 2023-09-30T22:29:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.133+0000 7f2730ff9700 1 -- 172.21.15.59:0/467554956 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2728013770 con 0x7f273412f8b0 2023-09-30T22:29:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.133+0000 7f2730ff9700 1 -- 172.21.15.59:0/467554956 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728013ae0 con 0x7f273412f8b0 2023-09-30T22:29:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.134+0000 7f273a617700 1 -- 172.21.15.59:0/467554956 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2734119550 con 0x7f273412f8b0 2023-09-30T22:29:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.135+0000 7f2730ff9700 1 -- 172.21.15.59:0/467554956 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f2728013c40 con 0x7f273412f8b0 2023-09-30T22:29:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.135+0000 7f273a617700 1 -- 172.21.15.59:0/467554956 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273409e7f0 con 0x7f273412f8b0 2023-09-30T22:29:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.135+0000 7f2730ff9700 1 -- 172.21.15.59:0/467554956 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f272803f970 con 0x7f273412f8b0 2023-09-30T22:29:02.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.144+0000 7f2730ff9700 1 -- 172.21.15.59:0/467554956 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2728012370 con 0x7f273412f8b0 2023-09-30T22:29:02.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.151+0000 7fa305635700 1 Processor -- start 2023-09-30T22:29:02.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.151+0000 7fa305635700 1 -- start start 2023-09-30T22:29:02.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.151+0000 7fa305635700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa30009e930 0x7fa30009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.151+0000 7fa305635700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa30009f240 0x7fa3001317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.151+0000 7fa305635700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa300070940 con 0x7fa30009f650 2023-09-30T22:29:02.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.151+0000 7fa305635700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30006fd60 con 0x7fa30009e930 2023-09-30T22:29:02.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.151+0000 7fa305635700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa30006fa80 con 0x7fa30009f240 2023-09-30T22:29:02.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2ff7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa30009f650 0x7fa300131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56966/0 (socket says 172.21.15.59:56966) 2023-09-30T22:29:02.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2ff7fe700 1 -- 172.21.15.59:0/2617498329 learned_addr learned my addr 172.21.15.59:0/2617498329 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:02.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fe7fc700 1 --2- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa30009f240 0x7fa3001317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 -- 172.21.15.59:0/2617498329 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4086324297 0 0) 0x7fa300070940 con 0x7fa30009f650 2023-09-30T22:29:02.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 -- 172.21.15.59:0/2617498329 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e80035b0 con 0x7fa30009f650 2023-09-30T22:29:02.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 -- 172.21.15.59:0/2617498329 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3988563019 0 0) 0x7fa2e80035b0 con 0x7fa30009f650 2023-09-30T22:29:02.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 -- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa30009f240 msgr2=0x7fa3001317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:02.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 --2- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa30009f240 0x7fa3001317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 -- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa30009e930 msgr2=0x7fa30009ed00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:29:02.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 --2- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa30009e930 0x7fa30009ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 -- 172.21.15.59:0/2617498329 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30009fb60 con 0x7fa30009f650 2023-09-30T22:29:02.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 -- 172.21.15.59:0/2617498329 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1997034051 0 0) 0x7fa2f80019f0 con 0x7fa30009f650 2023-09-30T22:29:02.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 -- 172.21.15.59:0/2617498329 >> v1:172.21.15.59:6789/0 conn(0x7fa30009f650 legacy=0x7fa300131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 --2- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e8003a00 0x7fa2e8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 --2- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e8004390 0x7fa2e8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 --2- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2e8005120 0x7fa2e800fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 -- 172.21.15.59:0/2617498329 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30006fd60 con 0x7fa2e8004390 2023-09-30T22:29:02.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 -- 172.21.15.59:0/2617498329 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30006fa80 con 0x7fa2e8005120 2023-09-30T22:29:02.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.152+0000 7fa2fdffb700 1 -- 172.21.15.59:0/2617498329 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e8010460 con 0x7fa2e8003a00 2023-09-30T22:29:02.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.153+0000 7fa2fe7fc700 1 --2- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e8004390 0x7fa2e8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.153+0000 7fa2feffd700 1 --2- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e8003a00 0x7fa2e8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.153+0000 7fa2fe7fc700 1 -- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e8003a00 msgr2=0x7fa2e8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:02.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.153+0000 7fa2fe7fc700 1 --2- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e8003a00 0x7fa2e8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.153+0000 7fa2fe7fc700 1 -- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2e8005120 msgr2=0x7fa2e800fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:02.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.153+0000 7fa2fe7fc700 1 --2- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2e8005120 0x7fa2e800fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.153+0000 7fa2fe7fc700 1 -- 172.21.15.59:0/2617498329 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e80035b0 con 0x7fa2e8004390 2023-09-30T22:29:02.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.154+0000 7fa2fe7fc700 1 --2- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e8004390 0x7fa2e8004850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa3000a1bc0 tx=0x7fa2e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd4b19aca5f732c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.154+0000 7fa2fdffb700 1 -- 172.21.15.59:0/2617498329 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f400e4d0 con 0x7fa2e8004390 2023-09-30T22:29:02.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.154+0000 7fa2fdffb700 1 -- 172.21.15.59:0/2617498329 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f400e630 con 0x7fa2e8004390 2023-09-30T22:29:02.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.154+0000 7fa2fdffb700 1 -- 172.21.15.59:0/2617498329 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f400e9a0 con 0x7fa2e8004390 2023-09-30T22:29:02.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.155+0000 7fa305635700 1 -- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e8004390 msgr2=0x7fa2e8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.155+0000 7fa305635700 1 --2- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e8004390 0x7fa2e8004850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa3000a1bc0 tx=0x7fa2e8005880 comp rx=0 tx=0).stop 2023-09-30T22:29:02.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.155+0000 7fa305635700 1 -- 172.21.15.59:0/2617498329 shutdown_connections 2023-09-30T22:29:02.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.155+0000 7fa305635700 1 --2- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e8003a00 0x7fa2e8003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.155+0000 7fa305635700 1 --2- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2e8005120 0x7fa2e800fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.155+0000 7fa305635700 1 --2- 172.21.15.59:0/2617498329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e8004390 0x7fa2e8004850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.155+0000 7fa305635700 1 -- 172.21.15.59:0/2617498329 >> 172.21.15.59:0/2617498329 conn(0x7fa3000a4210 msgr2=0x7fa3000a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.155+0000 7fa305635700 1 -- 172.21.15.59:0/2617498329 shutdown_connections 2023-09-30T22:29:02.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.155+0000 7fa305635700 1 -- 172.21.15.59:0/2617498329 wait complete. 2023-09-30T22:29:02.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.156+0000 7fa305635700 1 Processor -- start 2023-09-30T22:29:02.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.156+0000 7fa305635700 1 -- start start 2023-09-30T22:29:02.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.157+0000 7fa305635700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e8003a00 0x7fa3001c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.157+0000 7fa305635700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2e8004390 0x7fa3001c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.157+0000 7fa305635700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e8005120 0x7fa3001c0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.157+0000 7fa305635700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3001a53c0 con 0x7fa2e8005120 2023-09-30T22:29:02.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.157+0000 7fa305635700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3001a68b0 con 0x7fa2e8004390 2023-09-30T22:29:02.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.157+0000 7fa305635700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000a3260 con 0x7fa2e8003a00 2023-09-30T22:29:02.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.157+0000 7fa2ff7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e8005120 0x7fa3001c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.157+0000 7fa2ff7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e8005120 0x7fa3001c0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56590/0 (socket says 172.21.15.59:56590) 2023-09-30T22:29:02.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.157+0000 7fa2ff7fe700 1 -- 172.21.15.59:0/1493304629 learned_addr learned my addr 172.21.15.59:0/1493304629 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:02.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.157+0000 7fa2feffd700 1 --2- 172.21.15.59:0/1493304629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e8003a00 0x7fa3001c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.158+0000 7fa2ff7fe700 1 -- 172.21.15.59:0/1493304629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e8003a00 msgr2=0x7fa3001c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.158+0000 7fa2ff7fe700 1 --2- 172.21.15.59:0/1493304629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e8003a00 0x7fa3001c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.158+0000 7fa2ff7fe700 1 -- 172.21.15.59:0/1493304629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2e8004390 msgr2=0x7fa3001c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.158+0000 7fa2ff7fe700 1 --2- 172.21.15.59:0/1493304629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2e8004390 0x7fa3001c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.158+0000 7fa2ff7fe700 1 -- 172.21.15.59:0/1493304629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3000a0190 con 0x7fa2e8005120 2023-09-30T22:29:02.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.158+0000 7fa2ff7fe700 1 --2- 172.21.15.59:0/1493304629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e8005120 0x7fa3001c0870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8001ff0 tx=0x7fa2f800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.158+0000 7fa2e77fe700 1 -- 172.21.15.59:0/1493304629 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f800ada0 con 0x7fa2e8005120 2023-09-30T22:29:02.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.158+0000 7fa2e77fe700 1 -- 172.21.15.59:0/1493304629 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f80070d0 con 0x7fa2e8005120 2023-09-30T22:29:02.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.158+0000 7fa2e77fe700 1 -- 172.21.15.59:0/1493304629 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8007480 con 0x7fa2e8005120 2023-09-30T22:29:02.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.158+0000 7fa305635700 1 -- 172.21.15.59:0/1493304629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa300071d20 con 0x7fa2e8005120 2023-09-30T22:29:02.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.158+0000 7fa305635700 1 -- 172.21.15.59:0/1493304629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3001a5c70 con 0x7fa2e8005120 2023-09-30T22:29:02.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.159+0000 7fa305635700 1 -- 172.21.15.59:0/1493304629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30009a370 con 0x7fa2e8005120 2023-09-30T22:29:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.160+0000 7fa2e77fe700 1 -- 172.21.15.59:0/1493304629 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fa2f80075e0 con 0x7fa2e8005120 2023-09-30T22:29:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.160+0000 7fa2e77fe700 1 -- 172.21.15.59:0/1493304629 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fa2f803f8f0 con 0x7fa2e8005120 2023-09-30T22:29:02.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.166+0000 7fa2e77fe700 1 -- 172.21.15.59:0/1493304629 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2f8019860 con 0x7fa2e8005120 2023-09-30T22:29:02.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.194+0000 7fe96111e700 1 Processor -- start 2023-09-30T22:29:02.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.194+0000 7fe96111e700 1 -- start start 2023-09-30T22:29:02.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.195+0000 7fe96111e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe95c09d6f0 0x7fe95c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.195+0000 7fe96111e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09e000 0x7fe95c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.195+0000 7fe96111e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c09e410 0x7fe95c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.195+0000 7fe96111e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95c06b460 con 0x7fe95c09d6f0 2023-09-30T22:29:02.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.195+0000 7fe96111e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c09b120 con 0x7fe95c09e410 2023-09-30T22:29:02.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.195+0000 7fe96111e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c09a7e0 con 0x7fe95c09e000 2023-09-30T22:29:02.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.195+0000 7fe95b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c09e410 0x7fe95c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.195+0000 7fe95b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c09e410 0x7fe95c133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36992/0 (socket says 172.21.15.59:36992) 2023-09-30T22:29:02.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.196+0000 7fe95b59e700 1 -- 172.21.15.59:0/1116724430 learned_addr learned my addr 172.21.15.59:0/1116724430 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:02.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.196+0000 7fe95a59c700 1 --2- 172.21.15.59:0/1116724430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09e000 0x7fe95c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.196+0000 7fe95ad9d700 1 --2- 172.21.15.59:0/1116724430 >> v2:172.21.15.59:3300/0 conn(0x7fe95c09d6f0 0x7fe95c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.196+0000 7fe95b59e700 1 -- 172.21.15.59:0/1116724430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09e000 msgr2=0x7fe95c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:02.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.196+0000 7fe95b59e700 1 --2- 172.21.15.59:0/1116724430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09e000 0x7fe95c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.196+0000 7fe95b59e700 1 -- 172.21.15.59:0/1116724430 >> v2:172.21.15.59:3300/0 conn(0x7fe95c09d6f0 msgr2=0x7fe95c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:02.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.196+0000 7fe95b59e700 1 --2- 172.21.15.59:0/1116724430 >> v2:172.21.15.59:3300/0 conn(0x7fe95c09d6f0 0x7fe95c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.196+0000 7fe95b59e700 1 -- 172.21.15.59:0/1116724430 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c09a500 con 0x7fe95c09e410 2023-09-30T22:29:02.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.196+0000 7fe95ad9d700 1 --2- 172.21.15.59:0/1116724430 >> v2:172.21.15.59:3300/0 conn(0x7fe95c09d6f0 0x7fe95c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:02.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.196+0000 7fe95b59e700 1 --2- 172.21.15.59:0/1116724430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c09e410 0x7fe95c133f30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe954009e80 tx=0x7fe95400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac78c34526d77f0c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.197+0000 7fe959d9b700 1 -- 172.21.15.59:0/1116724430 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95400e070 con 0x7fe95c09e410 2023-09-30T22:29:02.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.197+0000 7fe959d9b700 1 -- 172.21.15.59:0/1116724430 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95400b8d0 con 0x7fe95c09e410 2023-09-30T22:29:02.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.197+0000 7fe959d9b700 1 -- 172.21.15.59:0/1116724430 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95400bc80 con 0x7fe95c09e410 2023-09-30T22:29:02.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.198+0000 7fe96111e700 1 -- 172.21.15.59:0/1116724430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c09e410 msgr2=0x7fe95c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.198+0000 7fe96111e700 1 --2- 172.21.15.59:0/1116724430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c09e410 0x7fe95c133f30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe954009e80 tx=0x7fe95400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:02.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.199+0000 7fe96111e700 1 -- 172.21.15.59:0/1116724430 shutdown_connections 2023-09-30T22:29:02.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.199+0000 7fe96111e700 1 --2- 172.21.15.59:0/1116724430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c09e410 0x7fe95c133f30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.199+0000 7fe96111e700 1 --2- 172.21.15.59:0/1116724430 >> v2:172.21.15.59:3300/0 conn(0x7fe95c09d6f0 0x7fe95c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.199+0000 7fe96111e700 1 --2- 172.21.15.59:0/1116724430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09e000 0x7fe95c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.199+0000 7fe96111e700 1 -- 172.21.15.59:0/1116724430 >> 172.21.15.59:0/1116724430 conn(0x7fe95c066f50 msgr2=0x7fe95c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.200+0000 7fe96111e700 1 -- 172.21.15.59:0/1116724430 shutdown_connections 2023-09-30T22:29:02.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.200+0000 7fe96111e700 1 -- 172.21.15.59:0/1116724430 wait complete. 2023-09-30T22:29:02.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.202+0000 7fe96111e700 1 Processor -- start 2023-09-30T22:29:02.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.203+0000 7fe96111e700 1 -- start start 2023-09-30T22:29:02.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.203+0000 7fe96111e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d6f0 0x7fe95c1a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.203+0000 7fe96111e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c09e000 0x7fe95c1a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.203+0000 7fe96111e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe95c09e410 0x7fe95c1c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.203+0000 7fe96111e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c1a8260 con 0x7fe95c09e410 2023-09-30T22:29:02.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.203+0000 7fe96111e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c1a8440 con 0x7fe95c09e000 2023-09-30T22:29:02.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.203+0000 7fe96111e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c1b92b0 con 0x7fe95c09d6f0 2023-09-30T22:29:02.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.204+0000 7fe95a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c09e000 0x7fe95c1a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.204+0000 7fe95a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c09e000 0x7fe95c1a5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36994/0 (socket says 172.21.15.59:36994) 2023-09-30T22:29:02.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.204+0000 7fe95a59c700 1 -- 172.21.15.59:0/953434590 learned_addr learned my addr 172.21.15.59:0/953434590 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:02.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.204+0000 7fe95ad9d700 1 --2- 172.21.15.59:0/953434590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d6f0 0x7fe95c1a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.204+0000 7fe95ad9d700 1 -- 172.21.15.59:0/953434590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c09e000 msgr2=0x7fe95c1a5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.204+0000 7fe95ad9d700 1 --2- 172.21.15.59:0/953434590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c09e000 0x7fe95c1a5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.204+0000 7fe95ad9d700 1 -- 172.21.15.59:0/953434590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe95c09e410 msgr2=0x7fe95c1c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.204+0000 7fe95ad9d700 1 --2- 172.21.15.59:0/953434590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe95c09e410 0x7fe95c1c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.204+0000 7fe95ad9d700 1 -- 172.21.15.59:0/953434590 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe954009b30 con 0x7fe95c09d6f0 2023-09-30T22:29:02.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.205+0000 7fe95ad9d700 1 --2- 172.21.15.59:0/953434590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d6f0 0x7fe95c1a52f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00c820 tx=0x7fe94c00cb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.205+0000 7fe9437fe700 1 -- 172.21.15.59:0/953434590 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c011800 con 0x7fe95c09d6f0 2023-09-30T22:29:02.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.205+0000 7fe96111e700 1 -- 172.21.15.59:0/953434590 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95c1a4de0 con 0x7fe95c09d6f0 2023-09-30T22:29:02.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.205+0000 7fe9437fe700 1 -- 172.21.15.59:0/953434590 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c011960 con 0x7fe95c09d6f0 2023-09-30T22:29:02.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.205+0000 7fe9437fe700 1 -- 172.21.15.59:0/953434590 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c011cd0 con 0x7fe95c09d6f0 2023-09-30T22:29:02.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.205+0000 7fe96111e700 1 -- 172.21.15.59:0/953434590 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95c1a6d20 con 0x7fe95c09d6f0 2023-09-30T22:29:02.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.207+0000 7fe9437fe700 1 -- 172.21.15.59:0/953434590 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fe94c010350 con 0x7fe95c09d6f0 2023-09-30T22:29:02.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.207+0000 7fe96111e700 1 -- 172.21.15.59:0/953434590 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95c074ea0 con 0x7fe95c09d6f0 2023-09-30T22:29:02.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.207+0000 7fe9437fe700 1 -- 172.21.15.59:0/953434590 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fe94c042030 con 0x7fe95c09d6f0 2023-09-30T22:29:02.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.217+0000 7fe9437fe700 1 -- 172.21.15.59:0/953434590 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe94c076750 con 0x7fe95c09d6f0 2023-09-30T22:29:02.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.335+0000 7f566f008700 1 -- 172.21.15.59:0/1625931282 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f56681256b0 con 0x7f566809d6f0 2023-09-30T22:29:02.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.336+0000 7f56657fa700 1 -- 172.21.15.59:0/1625931282 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f56681256b0 con 0x7f566809d6f0 2023-09-30T22:29:02.337 INFO:teuthology.orchestra.run.smithi059.stdout:42949672992 2023-09-30T22:29:02.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.339+0000 7f566f008700 1 -- 172.21.15.59:0/1625931282 >> v1:172.21.15.59:6816/126772 conn(0x7f564c02f4d0 legacy=0x7f564c031980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.339+0000 7f566f008700 1 -- 172.21.15.59:0/1625931282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566809d6f0 msgr2=0x7f56681221d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.339+0000 7f566f008700 1 --2- 172.21.15.59:0/1625931282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566809d6f0 0x7f56681221d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f565c0090b0 tx=0x7f565c004750 comp rx=0 tx=0).stop 2023-09-30T22:29:02.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.339+0000 7f566f008700 1 -- 172.21.15.59:0/1625931282 shutdown_connections 2023-09-30T22:29:02.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.339+0000 7f566f008700 1 --2- 172.21.15.59:0/1625931282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f566809e410 0x7f5668122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.339+0000 7f566f008700 1 --2- 172.21.15.59:0/1625931282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566809d6f0 0x7f56681221d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.339+0000 7f566f008700 1 --2- 172.21.15.59:0/1625931282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566809e000 0x7f5668122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.339+0000 7f566f008700 1 -- 172.21.15.59:0/1625931282 >> 172.21.15.59:0/1625931282 conn(0x7f5668066f50 msgr2=0x7f5668130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.339+0000 7f566f008700 1 -- 172.21.15.59:0/1625931282 shutdown_connections 2023-09-30T22:29:02.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.339+0000 7f566f008700 1 -- 172.21.15.59:0/1625931282 wait complete. 2023-09-30T22:29:02.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672991 got 42949672992 for osd.2 2023-09-30T22:29:02.360 DEBUG:teuthology.parallel:result is None 2023-09-30T22:29:02.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.389+0000 7f273a617700 1 -- 172.21.15.59:0/467554956 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2734074ea0 con 0x7f273412f8b0 2023-09-30T22:29:02.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.425+0000 7fa305635700 1 -- 172.21.15.59:0/1493304629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa3001a5c70 con 0x7fa2e8005120 2023-09-30T22:29:02.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.425+0000 7fa2e77fe700 1 -- 172.21.15.59:0/1493304629 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa3001a5c70 con 0x7fa2e8005120 2023-09-30T22:29:02.426 INFO:teuthology.orchestra.run.smithi059.stdout:38654705697 2023-09-30T22:29:02.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.428+0000 7fa305635700 1 -- 172.21.15.59:0/1493304629 >> v1:172.21.15.59:6816/126772 conn(0x7fa2ec02f480 legacy=0x7fa2ec031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.428+0000 7fa305635700 1 -- 172.21.15.59:0/1493304629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e8005120 msgr2=0x7fa3001c0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.428+0000 7fa305635700 1 --2- 172.21.15.59:0/1493304629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e8005120 0x7fa3001c0870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8001ff0 tx=0x7fa2f800a340 comp rx=0 tx=0).stop 2023-09-30T22:29:02.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.428+0000 7fa305635700 1 -- 172.21.15.59:0/1493304629 shutdown_connections 2023-09-30T22:29:02.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.428+0000 7fa305635700 1 --2- 172.21.15.59:0/1493304629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e8003a00 0x7fa3001c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.428+0000 7fa305635700 1 --2- 172.21.15.59:0/1493304629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e8005120 0x7fa3001c0870 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.428+0000 7fa305635700 1 --2- 172.21.15.59:0/1493304629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2e8004390 0x7fa3001c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.428+0000 7fa305635700 1 -- 172.21.15.59:0/1493304629 >> 172.21.15.59:0/1493304629 conn(0x7fa3000a4210 msgr2=0x7fa30006c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.428+0000 7fa305635700 1 -- 172.21.15.59:0/1493304629 shutdown_connections 2023-09-30T22:29:02.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.428+0000 7fa305635700 1 -- 172.21.15.59:0/1493304629 wait complete. 2023-09-30T22:29:02.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705697 for osd.1 2023-09-30T22:29:02.443 DEBUG:teuthology.parallel:result is None 2023-09-30T22:29:02.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.444+0000 7f2730ff9700 1 -- 172.21.15.59:0/467554956 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2728010310 con 0x7f273412f8b0 2023-09-30T22:29:02.444 INFO:teuthology.orchestra.run.smithi059.stdout:38654705697 2023-09-30T22:29:02.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.447+0000 7f273a617700 1 -- 172.21.15.59:0/467554956 >> v1:172.21.15.59:6816/126772 conn(0x7f272002f480 legacy=0x7f2720031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.447+0000 7f273a617700 1 -- 172.21.15.59:0/467554956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273412f8b0 msgr2=0x7f273409e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.447+0000 7f273a617700 1 --2- 172.21.15.59:0/467554956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273412f8b0 0x7f273409e2b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f272800e810 tx=0x7f272800eb20 comp rx=0 tx=0).stop 2023-09-30T22:29:02.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.447+0000 7f273a617700 1 -- 172.21.15.59:0/467554956 shutdown_connections 2023-09-30T22:29:02.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.447+0000 7f273a617700 1 --2- 172.21.15.59:0/467554956 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f273412cf60 0x7f273409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.447+0000 7f273a617700 1 --2- 172.21.15.59:0/467554956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734130260 0x7f27341c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.447+0000 7f273a617700 1 --2- 172.21.15.59:0/467554956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273412f8b0 0x7f273409e2b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.447+0000 7f273a617700 1 -- 172.21.15.59:0/467554956 >> 172.21.15.59:0/467554956 conn(0x7f27340a2aa0 msgr2=0x7f27341b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.447+0000 7f273a617700 1 -- 172.21.15.59:0/467554956 shutdown_connections 2023-09-30T22:29:02.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.447+0000 7f273a617700 1 -- 172.21.15.59:0/467554956 wait complete. 2023-09-30T22:29:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.461+0000 7fe96111e700 1 -- 172.21.15.59:0/953434590 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe95c1a6530 con 0x7fe95c09d6f0 2023-09-30T22:29:02.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705697 for osd.3 2023-09-30T22:29:02.470 DEBUG:teuthology.parallel:result is None 2023-09-30T22:29:02.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.548+0000 7fe9437fe700 1 -- 172.21.15.59:0/953434590 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe94c016260 con 0x7fe95c09d6f0 2023-09-30T22:29:02.549 INFO:teuthology.orchestra.run.smithi059.stdout:42949672992 2023-09-30T22:29:02.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.551+0000 7fe96111e700 1 -- 172.21.15.59:0/953434590 >> v1:172.21.15.59:6816/126772 conn(0x7fe94802f480 legacy=0x7fe948031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.551+0000 7fe96111e700 1 -- 172.21.15.59:0/953434590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d6f0 msgr2=0x7fe95c1a52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.551+0000 7fe96111e700 1 --2- 172.21.15.59:0/953434590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d6f0 0x7fe95c1a52f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00c820 tx=0x7fe94c00cb30 comp rx=0 tx=0).stop 2023-09-30T22:29:02.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.551+0000 7fe96111e700 1 -- 172.21.15.59:0/953434590 shutdown_connections 2023-09-30T22:29:02.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.551+0000 7fe96111e700 1 --2- 172.21.15.59:0/953434590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d6f0 0x7fe95c1a52f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.551+0000 7fe96111e700 1 --2- 172.21.15.59:0/953434590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe95c09e410 0x7fe95c1c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.551+0000 7fe96111e700 1 --2- 172.21.15.59:0/953434590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c09e000 0x7fe95c1a5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.551+0000 7fe96111e700 1 -- 172.21.15.59:0/953434590 >> 172.21.15.59:0/953434590 conn(0x7fe95c066f50 msgr2=0x7fe95c06f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.551+0000 7fe96111e700 1 -- 172.21.15.59:0/953434590 shutdown_connections 2023-09-30T22:29:02.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.551+0000 7fe96111e700 1 -- 172.21.15.59:0/953434590 wait complete. 2023-09-30T22:29:02.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672991 got 42949672992 for osd.0 2023-09-30T22:29:02.568 DEBUG:teuthology.parallel:result is None 2023-09-30T22:29:02.568 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:29:02.568 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:29:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.705+0000 7f567815c700 1 Processor -- start 2023-09-30T22:29:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.706+0000 7f567815c700 1 -- start start 2023-09-30T22:29:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.706+0000 7f567815c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e1d0 0x7f5670138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.706+0000 7f567815c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5670139170 0x7f567013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.706+0000 7f567815c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567009b120 con 0x7f567009d6f0 2023-09-30T22:29:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.706+0000 7f567815c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567006b460 con 0x7f567009e1d0 2023-09-30T22:29:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.706+0000 7f567815c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f567009a7e0 con 0x7f5670139170 2023-09-30T22:29:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.706+0000 7f56766f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5670139170 0x7f567013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.706+0000 7f56756f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e1d0 0x7f5670138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.706+0000 7f5675ef8700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f567009d6f0 0x7f567009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56974/0 (socket says 172.21.15.59:56974) 2023-09-30T22:29:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.706+0000 7f5675ef8700 1 -- 172.21.15.59:0/3648219721 learned_addr learned my addr 172.21.15.59:0/3648219721 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.707+0000 7f5674ef6700 1 -- 172.21.15.59:0/3648219721 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139695933 0 0) 0x7f567009b120 con 0x7f567009d6f0 2023-09-30T22:29:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.707+0000 7f56766f9700 1 -- 172.21.15.59:0/3648219721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e1d0 msgr2=0x7f5670138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.707+0000 7f56766f9700 1 --2- 172.21.15.59:0/3648219721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e1d0 0x7f5670138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.707+0000 7f56766f9700 1 -- 172.21.15.59:0/3648219721 >> v1:172.21.15.59:6789/0 conn(0x7f567009d6f0 legacy=0x7f567009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.707+0000 7f56766f9700 1 -- 172.21.15.59:0/3648219721 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567009a500 con 0x7f5670139170 2023-09-30T22:29:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.707+0000 7f56756f7700 1 --2- 172.21.15.59:0/3648219721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e1d0 0x7f5670138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.707+0000 7f56766f9700 1 --2- 172.21.15.59:0/3648219721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5670139170 0x7f567013b550 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5668009df0 tx=0x7f566800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14d1bdcc58c0d99f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.707+0000 7f5674ef6700 1 -- 172.21.15.59:0/3648219721 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566800e070 con 0x7f5670139170 2023-09-30T22:29:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.707+0000 7f5674ef6700 1 -- 172.21.15.59:0/3648219721 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566800bae0 con 0x7f5670139170 2023-09-30T22:29:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.707+0000 7f5674ef6700 1 -- 172.21.15.59:0/3648219721 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566800be90 con 0x7f5670139170 2023-09-30T22:29:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.708+0000 7f567815c700 1 -- 172.21.15.59:0/3648219721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5670139170 msgr2=0x7f567013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.708+0000 7f567815c700 1 --2- 172.21.15.59:0/3648219721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5670139170 0x7f567013b550 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5668009df0 tx=0x7f566800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:02.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.708+0000 7f567815c700 1 -- 172.21.15.59:0/3648219721 shutdown_connections 2023-09-30T22:29:02.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.708+0000 7f567815c700 1 --2- 172.21.15.59:0/3648219721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5670139170 0x7f567013b550 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.708+0000 7f567815c700 1 --2- 172.21.15.59:0/3648219721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e1d0 0x7f5670138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.708+0000 7f567815c700 1 -- 172.21.15.59:0/3648219721 >> 172.21.15.59:0/3648219721 conn(0x7f5670066f50 msgr2=0x7f567009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.708+0000 7f567815c700 1 -- 172.21.15.59:0/3648219721 shutdown_connections 2023-09-30T22:29:02.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.708+0000 7f567815c700 1 -- 172.21.15.59:0/3648219721 wait complete. 2023-09-30T22:29:02.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.709+0000 7f567815c700 1 Processor -- start 2023-09-30T22:29:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.709+0000 7f567815c700 1 -- start start 2023-09-30T22:29:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.709+0000 7f567815c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009d6f0 0x7f56701215c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.709+0000 7f567815c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e1d0 0x7f5670121b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.709+0000 7f567815c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5670139170 0x7f5670122040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.709+0000 7f567815c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5670123f80 con 0x7f567009d6f0 2023-09-30T22:29:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.709+0000 7f567815c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5670123a50 con 0x7f567009e1d0 2023-09-30T22:29:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.709+0000 7f567815c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5670123180 con 0x7f5670139170 2023-09-30T22:29:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.709+0000 7f5675ef8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009d6f0 0x7f56701215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.709+0000 7f56756f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e1d0 0x7f5670121b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.709+0000 7f5675ef8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009d6f0 0x7f56701215c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56644/0 (socket says 172.21.15.59:56644) 2023-09-30T22:29:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.709+0000 7f5675ef8700 1 -- 172.21.15.59:0/1356056574 learned_addr learned my addr 172.21.15.59:0/1356056574 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.709+0000 7f56766f9700 1 --2- 172.21.15.59:0/1356056574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5670139170 0x7f5670122040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.710+0000 7f56756f7700 1 -- 172.21.15.59:0/1356056574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5670139170 msgr2=0x7f5670122040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.710+0000 7f56756f7700 1 --2- 172.21.15.59:0/1356056574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5670139170 0x7f5670122040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.710+0000 7f56756f7700 1 -- 172.21.15.59:0/1356056574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009d6f0 msgr2=0x7f56701215c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.710+0000 7f56756f7700 1 --2- 172.21.15.59:0/1356056574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009d6f0 0x7f56701215c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.710+0000 7f56756f7700 1 -- 172.21.15.59:0/1356056574 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56640094a0 con 0x7f567009e1d0 2023-09-30T22:29:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.710+0000 7f5675ef8700 1 --2- 172.21.15.59:0/1356056574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009d6f0 0x7f56701215c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.710+0000 7f56756f7700 1 --2- 172.21.15.59:0/1356056574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e1d0 0x7f5670121b00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f566400e9b0 tx=0x7f566400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.710+0000 7f56627fc700 1 -- 172.21.15.59:0/1356056574 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566400ee50 con 0x7f567009e1d0 2023-09-30T22:29:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.710+0000 7f56627fc700 1 -- 172.21.15.59:0/1356056574 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566400c850 con 0x7f567009e1d0 2023-09-30T22:29:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.710+0000 7f567815c700 1 -- 172.21.15.59:0/1356056574 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5668009a70 con 0x7f567009e1d0 2023-09-30T22:29:02.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.710+0000 7f56627fc700 1 -- 172.21.15.59:0/1356056574 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566400cc00 con 0x7f567009e1d0 2023-09-30T22:29:02.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.710+0000 7f567815c700 1 -- 172.21.15.59:0/1356056574 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567009c710 con 0x7f567009e1d0 2023-09-30T22:29:02.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.711+0000 7f56627fc700 1 -- 172.21.15.59:0/1356056574 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f5664013470 con 0x7f567009e1d0 2023-09-30T22:29:02.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.711+0000 7f56627fc700 1 -- 172.21.15.59:0/1356056574 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f566403fad0 con 0x7f567009e1d0 2023-09-30T22:29:02.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.711+0000 7f567815c700 1 -- 172.21.15.59:0/1356056574 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5670074ea0 con 0x7f567009e1d0 2023-09-30T22:29:02.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.716+0000 7f56627fc700 1 -- 172.21.15.59:0/1356056574 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5664017080 con 0x7f567009e1d0 2023-09-30T22:29:02.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.913+0000 7f567815c700 1 -- 172.21.15.59:0/1356056574 --> v1:172.21.15.59:6816/126772 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5670124a50 con 0x7f565402f480 2023-09-30T22:29:02.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.920+0000 7f56627fc700 1 -- 172.21.15.59:0/1356056574 <== mgr.14104 v1:172.21.15.59:6816/126772 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270472 (unknown 2965378022 0 1284552662) 0x7f566c001760 con 0x7f565402f480 2023-09-30T22:29:02.924 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:02.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.924+0000 7f567815c700 1 -- 172.21.15.59:0/1356056574 >> v1:172.21.15.59:6816/126772 conn(0x7f565402f480 legacy=0x7f5654031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.924+0000 7f567815c700 1 -- 172.21.15.59:0/1356056574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e1d0 msgr2=0x7f5670121b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.924+0000 7f567815c700 1 --2- 172.21.15.59:0/1356056574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e1d0 0x7f5670121b00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f566400e9b0 tx=0x7f566400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.924+0000 7f567815c700 1 -- 172.21.15.59:0/1356056574 shutdown_connections 2023-09-30T22:29:02.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.924+0000 7f567815c700 1 --2- 172.21.15.59:0/1356056574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5670139170 0x7f5670122040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.924+0000 7f567815c700 1 --2- 172.21.15.59:0/1356056574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009d6f0 0x7f56701215c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.924+0000 7f567815c700 1 --2- 172.21.15.59:0/1356056574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e1d0 0x7f5670121b00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.924+0000 7f567815c700 1 -- 172.21.15.59:0/1356056574 >> 172.21.15.59:0/1356056574 conn(0x7f5670066f50 msgr2=0x7f5670070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.924+0000 7f567815c700 1 -- 172.21.15.59:0/1356056574 shutdown_connections 2023-09-30T22:29:02.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:02.924+0000 7f567815c700 1 -- 172.21.15.59:0/1356056574 wait complete. 2023-09-30T22:29:02.928 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-09-30T22:29:02.938 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-09-30T22:29:01.582749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189160,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298200,"statfs":{"total":386547056640,"available":385329356800,"internally_reserved":0,"allocated":794624,"data_stored":273928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.004508"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983567+0000","last_change":"2023-09-30T22:26:34.447805+0000","last_active":"2023-09-30T22:27:24.983567+0000","last_peered":"2023-09-30T22:27:24.983567+0000","last_clean":"2023-09-30T22:27:24.983567+0000","last_became_active":"2023-09-30T22:26:34.447480+0000","last_became_peered":"2023-09-30T22:26:34.447480+0000","last_unstale":"2023-09-30T22:27:24.983567+0000","last_undegraded":"2023-09-30T22:27:24.983567+0000","last_fullsized":"2023-09-30T22:27:24.983567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.985719+0000","last_change":"2023-09-30T22:26:34.440046+0000","last_active":"2023-09-30T22:27:24.985719+0000","last_peered":"2023-09-30T22:27:24.985719+0000","last_clean":"2023-09-30T22:27:24.985719+0000","last_became_active":"2023-09-30T22:26:34.439718+0000","last_became_peered":"2023-09-30T22:26:34.439718+0000","last_unstale":"2023-09-30T22:27:24.985719+0000","last_undegraded":"2023-09-30T22:27:24.985719+0000","last_fullsized":"2023-09-30T22:27:24.985719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984676+0000","last_change":"2023-09-30T22:26:34.457031+0000","last_active":"2023-09-30T22:27:24.984676+0000","last_peered":"2023-09-30T22:27:24.984676+0000","last_clean":"2023-09-30T22:27:24.984676+0000","last_became_active":"2023-09-30T22:26:34.456552+0000","last_became_peered":"2023-09-30T22:26:34.456552+0000","last_unstale":"2023-09-30T22:27:24.984676+0000","last_undegraded":"2023-09-30T22:27:24.984676+0000","last_fullsized":"2023-09-30T22:27:24.984676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983104+0000","last_change":"2023-09-30T22:26:34.456744+0000","last_active":"2023-09-30T22:27:24.983104+0000","last_peered":"2023-09-30T22:27:24.983104+0000","last_clean":"2023-09-30T22:27:24.983104+0000","last_became_active":"2023-09-30T22:26:34.456441+0000","last_became_peered":"2023-09-30T22:26:34.456441+0000","last_unstale":"2023-09-30T22:27:24.983104+0000","last_undegraded":"2023-09-30T22:27:24.983104+0000","last_fullsized":"2023-09-30T22:27:24.983104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983415+0000","last_change":"2023-09-30T22:26:34.454395+0000","last_active":"2023-09-30T22:27:24.983415+0000","last_peered":"2023-09-30T22:27:24.983415+0000","last_clean":"2023-09-30T22:27:24.983415+0000","last_became_active":"2023-09-30T22:26:34.454106+0000","last_became_peered":"2023-09-30T22:26:34.454106+0000","last_unstale":"2023-09-30T22:27:24.983415+0000","last_undegraded":"2023-09-30T22:27:24.983415+0000","last_fullsized":"2023-09-30T22:27:24.983415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.994305+0000","last_change":"2023-09-30T22:27:24.989557+0000","last_active":"2023-09-30T22:27:24.994305+0000","last_peered":"2023-09-30T22:27:24.994305+0000","last_clean":"2023-09-30T22:27:24.994305+0000","last_became_active":"2023-09-30T22:27:24.989108+0000","last_became_peered":"2023-09-30T22:27:24.989108+0000","last_unstale":"2023-09-30T22:27:24.994305+0000","last_undegraded":"2023-09-30T22:27:24.994305+0000","last_fullsized":"2023-09-30T22:27:24.994305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979332+0000","last_change":"2023-09-30T22:26:34.450051+0000","last_active":"2023-09-30T22:27:24.979332+0000","last_peered":"2023-09-30T22:27:24.979332+0000","last_clean":"2023-09-30T22:27:24.979332+0000","last_became_active":"2023-09-30T22:26:34.449264+0000","last_became_peered":"2023-09-30T22:26:34.449264+0000","last_unstale":"2023-09-30T22:27:24.979332+0000","last_undegraded":"2023-09-30T22:27:24.979332+0000","last_fullsized":"2023-09-30T22:27:24.979332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.978932+0000","last_change":"2023-09-30T22:26:34.463260+0000","last_active":"2023-09-30T22:27:24.978932+0000","last_peered":"2023-09-30T22:27:24.978932+0000","last_clean":"2023-09-30T22:27:24.978932+0000","last_became_active":"2023-09-30T22:26:34.462981+0000","last_became_peered":"2023-09-30T22:26:34.462981+0000","last_unstale":"2023-09-30T22:27:24.978932+0000","last_undegraded":"2023-09-30T22:27:24.978932+0000","last_fullsized":"2023-09-30T22:27:24.978932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984364+0000","last_change":"2023-09-30T22:26:34.451111+0000","last_active":"2023-09-30T22:27:24.984364+0000","last_peered":"2023-09-30T22:27:24.984364+0000","last_clean":"2023-09-30T22:27:24.984364+0000","last_became_active":"2023-09-30T22:26:34.450521+0000","last_became_peered":"2023-09-30T22:26:34.450521+0000","last_unstale":"2023-09-30T22:27:24.984364+0000","last_undegraded":"2023-09-30T22:27:24.984364+0000","last_fullsized":"2023-09-30T22:27:24.984364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.982013+0000","last_change":"2023-09-30T22:26:34.454512+0000","last_active":"2023-09-30T22:27:24.982013+0000","last_peered":"2023-09-30T22:27:24.982013+0000","last_clean":"2023-09-30T22:27:24.982013+0000","last_became_active":"2023-09-30T22:26:34.454222+0000","last_became_peered":"2023-09-30T22:26:34.454222+0000","last_unstale":"2023-09-30T22:27:24.982013+0000","last_undegraded":"2023-09-30T22:27:24.982013+0000","last_fullsized":"2023-09-30T22:27:24.982013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981333+0000","last_change":"2023-09-30T22:26:34.454698+0000","last_active":"2023-09-30T22:27:24.981333+0000","last_peered":"2023-09-30T22:27:24.981333+0000","last_clean":"2023-09-30T22:27:24.981333+0000","last_became_active":"2023-09-30T22:26:34.454060+0000","last_became_peered":"2023-09-30T22:26:34.454060+0000","last_unstale":"2023-09-30T22:27:24.981333+0000","last_undegraded":"2023-09-30T22:27:24.981333+0000","last_fullsized":"2023-09-30T22:27:24.981333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984598+0000","last_change":"2023-09-30T22:26:34.447740+0000","last_active":"2023-09-30T22:27:24.984598+0000","last_peered":"2023-09-30T22:27:24.984598+0000","last_clean":"2023-09-30T22:27:24.984598+0000","last_became_active":"2023-09-30T22:26:34.447444+0000","last_became_peered":"2023-09-30T22:26:34.447444+0000","last_unstale":"2023-09-30T22:27:24.984598+0000","last_undegraded":"2023-09-30T22:27:24.984598+0000","last_fullsized":"2023-09-30T22:27:24.984598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984599+0000","last_change":"2023-09-30T22:26:34.454342+0000","last_active":"2023-09-30T22:27:24.984599+0000","last_peered":"2023-09-30T22:27:24.984599+0000","last_clean":"2023-09-30T22:27:24.984599+0000","last_became_active":"2023-09-30T22:26:34.454063+0000","last_became_peered":"2023-09-30T22:26:34.454063+0000","last_unstale":"2023-09-30T22:27:24.984599+0000","last_undegraded":"2023-09-30T22:27:24.984599+0000","last_fullsized":"2023-09-30T22:27:24.984599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980794+0000","last_change":"2023-09-30T22:26:34.450497+0000","last_active":"2023-09-30T22:27:24.980794+0000","last_peered":"2023-09-30T22:27:24.980794+0000","last_clean":"2023-09-30T22:27:24.980794+0000","last_became_active":"2023-09-30T22:26:34.444267+0000","last_became_peered":"2023-09-30T22:26:34.444267+0000","last_unstale":"2023-09-30T22:27:24.980794+0000","last_undegraded":"2023-09-30T22:27:24.980794+0000","last_fullsized":"2023-09-30T22:27:24.980794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983554+0000","last_change":"2023-09-30T22:26:34.455898+0000","last_active":"2023-09-30T22:27:24.983554+0000","last_peered":"2023-09-30T22:27:24.983554+0000","last_clean":"2023-09-30T22:27:24.983554+0000","last_became_active":"2023-09-30T22:26:34.455631+0000","last_became_peered":"2023-09-30T22:26:34.455631+0000","last_unstale":"2023-09-30T22:27:24.983554+0000","last_undegraded":"2023-09-30T22:27:24.983554+0000","last_fullsized":"2023-09-30T22:27:24.983554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.978710+0000","last_change":"2023-09-30T22:26:34.447910+0000","last_active":"2023-09-30T22:27:24.978710+0000","last_peered":"2023-09-30T22:27:24.978710+0000","last_clean":"2023-09-30T22:27:24.978710+0000","last_became_active":"2023-09-30T22:26:34.447627+0000","last_became_peered":"2023-09-30T22:26:34.447627+0000","last_unstale":"2023-09-30T22:27:24.978710+0000","last_undegraded":"2023-09-30T22:27:24.978710+0000","last_fullsized":"2023-09-30T22:27:24.978710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984273+0000","last_change":"2023-09-30T22:26:34.451250+0000","last_active":"2023-09-30T22:27:24.984273+0000","last_peered":"2023-09-30T22:27:24.984273+0000","last_clean":"2023-09-30T22:27:24.984273+0000","last_became_active":"2023-09-30T22:26:34.450879+0000","last_became_peered":"2023-09-30T22:26:34.450879+0000","last_unstale":"2023-09-30T22:27:24.984273+0000","last_undegraded":"2023-09-30T22:27:24.984273+0000","last_fullsized":"2023-09-30T22:27:24.984273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984227+0000","last_change":"2023-09-30T22:26:34.440788+0000","last_active":"2023-09-30T22:27:24.984227+0000","last_peered":"2023-09-30T22:27:24.984227+0000","last_clean":"2023-09-30T22:27:24.984227+0000","last_became_active":"2023-09-30T22:26:34.440404+0000","last_became_peered":"2023-09-30T22:26:34.440404+0000","last_unstale":"2023-09-30T22:27:24.984227+0000","last_undegraded":"2023-09-30T22:27:24.984227+0000","last_fullsized":"2023-09-30T22:27:24.984227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983358+0000","last_change":"2023-09-30T22:26:34.445791+0000","last_active":"2023-09-30T22:27:24.983358+0000","last_peered":"2023-09-30T22:27:24.983358+0000","last_clean":"2023-09-30T22:27:24.983358+0000","last_became_active":"2023-09-30T22:26:34.445478+0000","last_became_peered":"2023-09-30T22:26:34.445478+0000","last_unstale":"2023-09-30T22:27:24.983358+0000","last_undegraded":"2023-09-30T22:27:24.983358+0000","last_fullsized":"2023-09-30T22:27:24.983358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981165+0000","last_change":"2023-09-30T22:26:34.453484+0000","last_active":"2023-09-30T22:27:24.981165+0000","last_peered":"2023-09-30T22:27:24.981165+0000","last_clean":"2023-09-30T22:27:24.981165+0000","last_became_active":"2023-09-30T22:26:34.453179+0000","last_became_peered":"2023-09-30T22:26:34.453179+0000","last_unstale":"2023-09-30T22:27:24.981165+0000","last_undegraded":"2023-09-30T22:27:24.981165+0000","last_fullsized":"2023-09-30T22:27:24.981165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980446+0000","last_change":"2023-09-30T22:26:34.457382+0000","last_active":"2023-09-30T22:27:24.980446+0000","last_peered":"2023-09-30T22:27:24.980446+0000","last_clean":"2023-09-30T22:27:24.980446+0000","last_became_active":"2023-09-30T22:26:34.457077+0000","last_became_peered":"2023-09-30T22:26:34.457077+0000","last_unstale":"2023-09-30T22:27:24.980446+0000","last_undegraded":"2023-09-30T22:27:24.980446+0000","last_fullsized":"2023-09-30T22:27:24.980446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984680+0000","last_change":"2023-09-30T22:26:34.465060+0000","last_active":"2023-09-30T22:27:24.984680+0000","last_peered":"2023-09-30T22:27:24.984680+0000","last_clean":"2023-09-30T22:27:24.984680+0000","last_became_active":"2023-09-30T22:26:34.464780+0000","last_became_peered":"2023-09-30T22:26:34.464780+0000","last_unstale":"2023-09-30T22:27:24.984680+0000","last_undegraded":"2023-09-30T22:27:24.984680+0000","last_fullsized":"2023-09-30T22:27:24.984680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979246+0000","last_change":"2023-09-30T22:26:34.449871+0000","last_active":"2023-09-30T22:27:24.979246+0000","last_peered":"2023-09-30T22:27:24.979246+0000","last_clean":"2023-09-30T22:27:24.979246+0000","last_became_active":"2023-09-30T22:26:34.448901+0000","last_became_peered":"2023-09-30T22:26:34.448901+0000","last_unstale":"2023-09-30T22:27:24.979246+0000","last_undegraded":"2023-09-30T22:27:24.979246+0000","last_fullsized":"2023-09-30T22:27:24.979246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979014+0000","last_change":"2023-09-30T22:26:34.463255+0000","last_active":"2023-09-30T22:27:24.979014+0000","last_peered":"2023-09-30T22:27:24.979014+0000","last_clean":"2023-09-30T22:27:24.979014+0000","last_became_active":"2023-09-30T22:26:34.462962+0000","last_became_peered":"2023-09-30T22:26:34.462962+0000","last_unstale":"2023-09-30T22:27:24.979014+0000","last_undegraded":"2023-09-30T22:27:24.979014+0000","last_fullsized":"2023-09-30T22:27:24.979014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981347+0000","last_change":"2023-09-30T22:26:34.458476+0000","last_active":"2023-09-30T22:27:24.981347+0000","last_peered":"2023-09-30T22:27:24.981347+0000","last_clean":"2023-09-30T22:27:24.981347+0000","last_became_active":"2023-09-30T22:26:34.458195+0000","last_became_peered":"2023-09-30T22:26:34.458195+0000","last_unstale":"2023-09-30T22:27:24.981347+0000","last_undegraded":"2023-09-30T22:27:24.981347+0000","last_fullsized":"2023-09-30T22:27:24.981347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981930+0000","last_change":"2023-09-30T22:26:34.441003+0000","last_active":"2023-09-30T22:27:24.981930+0000","last_peered":"2023-09-30T22:27:24.981930+0000","last_clean":"2023-09-30T22:27:24.981930+0000","last_became_active":"2023-09-30T22:26:34.440470+0000","last_became_peered":"2023-09-30T22:26:34.440470+0000","last_unstale":"2023-09-30T22:27:24.981930+0000","last_undegraded":"2023-09-30T22:27:24.981930+0000","last_fullsized":"2023-09-30T22:27:24.981930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981358+0000","last_change":"2023-09-30T22:26:34.448801+0000","last_active":"2023-09-30T22:27:24.981358+0000","last_peered":"2023-09-30T22:27:24.981358+0000","last_clean":"2023-09-30T22:27:24.981358+0000","last_became_active":"2023-09-30T22:26:34.448176+0000","last_became_peered":"2023-09-30T22:26:34.448176+0000","last_unstale":"2023-09-30T22:27:24.981358+0000","last_undegraded":"2023-09-30T22:27:24.981358+0000","last_fullsized":"2023-09-30T22:27:24.981358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980416+0000","last_change":"2023-09-30T22:26:34.031319+0000","last_active":"2023-09-30T22:27:24.980416+0000","last_peered":"2023-09-30T22:27:24.980416+0000","last_clean":"2023-09-30T22:27:24.980416+0000","last_became_active":"2023-09-30T22:26:34.030475+0000","last_became_peered":"2023-09-30T22:26:34.030475+0000","last_unstale":"2023-09-30T22:27:24.980416+0000","last_undegraded":"2023-09-30T22:27:24.980416+0000","last_fullsized":"2023-09-30T22:27:24.980416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981451+0000","last_change":"2023-09-30T22:26:34.459834+0000","last_active":"2023-09-30T22:27:24.981451+0000","last_peered":"2023-09-30T22:27:24.981451+0000","last_clean":"2023-09-30T22:27:24.981451+0000","last_became_active":"2023-09-30T22:26:34.459291+0000","last_became_peered":"2023-09-30T22:26:34.459291+0000","last_unstale":"2023-09-30T22:27:24.981451+0000","last_undegraded":"2023-09-30T22:27:24.981451+0000","last_fullsized":"2023-09-30T22:27:24.981451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980690+0000","last_change":"2023-09-30T22:26:34.036944+0000","last_active":"2023-09-30T22:27:24.980690+0000","last_peered":"2023-09-30T22:27:24.980690+0000","last_clean":"2023-09-30T22:27:24.980690+0000","last_became_active":"2023-09-30T22:26:34.036564+0000","last_became_peered":"2023-09-30T22:26:34.036564+0000","last_unstale":"2023-09-30T22:27:24.980690+0000","last_undegraded":"2023-09-30T22:27:24.980690+0000","last_fullsized":"2023-09-30T22:27:24.980690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983972+0000","last_change":"2023-09-30T22:26:34.464712+0000","last_active":"2023-09-30T22:27:24.983972+0000","last_peered":"2023-09-30T22:27:24.983972+0000","last_clean":"2023-09-30T22:27:24.983972+0000","last_became_active":"2023-09-30T22:26:34.464032+0000","last_became_peered":"2023-09-30T22:26:34.464032+0000","last_unstale":"2023-09-30T22:27:24.983972+0000","last_undegraded":"2023-09-30T22:27:24.983972+0000","last_fullsized":"2023-09-30T22:27:24.983972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980092+0000","last_change":"2023-09-30T22:26:34.041116+0000","last_active":"2023-09-30T22:27:24.980092+0000","last_peered":"2023-09-30T22:27:24.980092+0000","last_clean":"2023-09-30T22:27:24.980092+0000","last_became_active":"2023-09-30T22:26:34.040484+0000","last_became_peered":"2023-09-30T22:26:34.040484+0000","last_unstale":"2023-09-30T22:27:24.980092+0000","last_undegraded":"2023-09-30T22:27:24.980092+0000","last_fullsized":"2023-09-30T22:27:24.980092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981767+0000","last_change":"2023-09-30T22:26:34.461558+0000","last_active":"2023-09-30T22:27:24.981767+0000","last_peered":"2023-09-30T22:27:24.981767+0000","last_clean":"2023-09-30T22:27:24.981767+0000","last_became_active":"2023-09-30T22:26:34.461274+0000","last_became_peered":"2023-09-30T22:26:34.461274+0000","last_unstale":"2023-09-30T22:27:24.981767+0000","last_undegraded":"2023-09-30T22:27:24.981767+0000","last_fullsized":"2023-09-30T22:27:24.981767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984090+0000","last_change":"2023-09-30T22:26:34.026179+0000","last_active":"2023-09-30T22:27:24.984090+0000","last_peered":"2023-09-30T22:27:24.984090+0000","last_clean":"2023-09-30T22:27:24.984090+0000","last_became_active":"2023-09-30T22:26:34.025896+0000","last_became_peered":"2023-09-30T22:26:34.025896+0000","last_unstale":"2023-09-30T22:27:24.984090+0000","last_undegraded":"2023-09-30T22:27:24.984090+0000","last_fullsized":"2023-09-30T22:27:24.984090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980116+0000","last_change":"2023-09-30T22:26:34.461868+0000","last_active":"2023-09-30T22:27:24.980116+0000","last_peered":"2023-09-30T22:27:24.980116+0000","last_clean":"2023-09-30T22:27:24.980116+0000","last_became_active":"2023-09-30T22:26:34.458462+0000","last_became_peered":"2023-09-30T22:26:34.458462+0000","last_unstale":"2023-09-30T22:27:24.980116+0000","last_undegraded":"2023-09-30T22:27:24.980116+0000","last_fullsized":"2023-09-30T22:27:24.980116+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.982757+0000","last_change":"2023-09-30T22:26:34.034800+0000","last_active":"2023-09-30T22:27:24.982757+0000","last_peered":"2023-09-30T22:27:24.982757+0000","last_clean":"2023-09-30T22:27:24.982757+0000","last_became_active":"2023-09-30T22:26:34.034161+0000","last_became_peered":"2023-09-30T22:26:34.034161+0000","last_unstale":"2023-09-30T22:27:24.982757+0000","last_undegraded":"2023-09-30T22:27:24.982757+0000","last_fullsized":"2023-09-30T22:27:24.982757+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.997594+0000","last_change":"2023-09-30T22:27:24.994351+0000","last_active":"2023-09-30T22:27:24.997594+0000","last_peered":"2023-09-30T22:27:24.997594+0000","last_clean":"2023-09-30T22:27:24.997594+0000","last_became_active":"2023-09-30T22:27:24.994020+0000","last_became_peered":"2023-09-30T22:27:24.994020+0000","last_unstale":"2023-09-30T22:27:24.997594+0000","last_undegraded":"2023-09-30T22:27:24.997594+0000","last_fullsized":"2023-09-30T22:27:24.997594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984568+0000","last_change":"2023-09-30T22:26:34.037459+0000","last_active":"2023-09-30T22:27:24.984568+0000","last_peered":"2023-09-30T22:27:24.984568+0000","last_clean":"2023-09-30T22:27:24.984568+0000","last_became_active":"2023-09-30T22:26:34.037268+0000","last_became_peered":"2023-09-30T22:26:34.037268+0000","last_unstale":"2023-09-30T22:27:24.984568+0000","last_undegraded":"2023-09-30T22:27:24.984568+0000","last_fullsized":"2023-09-30T22:27:24.984568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.988564+0000","last_change":"2023-09-30T22:27:24.985586+0000","last_active":"2023-09-30T22:27:24.988564+0000","last_peered":"2023-09-30T22:27:24.988564+0000","last_clean":"2023-09-30T22:27:24.988564+0000","last_became_active":"2023-09-30T22:27:24.985256+0000","last_became_peered":"2023-09-30T22:27:24.985256+0000","last_unstale":"2023-09-30T22:27:24.988564+0000","last_undegraded":"2023-09-30T22:27:24.988564+0000","last_fullsized":"2023-09-30T22:27:24.988564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"22'12","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:28:59.639382+0000","last_change":"2023-09-30T22:26:34.040307+0000","last_active":"2023-09-30T22:28:59.639382+0000","last_peered":"2023-09-30T22:28:59.639382+0000","last_clean":"2023-09-30T22:28:59.639382+0000","last_became_active":"2023-09-30T22:26:34.040017+0000","last_became_peered":"2023-09-30T22:26:34.040017+0000","last_unstale":"2023-09-30T22:28:59.639382+0000","last_undegraded":"2023-09-30T22:28:59.639382+0000","last_fullsized":"2023-09-30T22:28:59.639382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.997290+0000","last_change":"2023-09-30T22:27:24.991943+0000","last_active":"2023-09-30T22:27:24.997290+0000","last_peered":"2023-09-30T22:27:24.997290+0000","last_clean":"2023-09-30T22:27:24.997290+0000","last_became_active":"2023-09-30T22:27:24.991604+0000","last_became_peered":"2023-09-30T22:27:24.991604+0000","last_unstale":"2023-09-30T22:27:24.997290+0000","last_undegraded":"2023-09-30T22:27:24.997290+0000","last_fullsized":"2023-09-30T22:27:24.997290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984140+0000","last_change":"2023-09-30T22:26:34.042269+0000","last_active":"2023-09-30T22:27:24.984140+0000","last_peered":"2023-09-30T22:27:24.984140+0000","last_clean":"2023-09-30T22:27:24.984140+0000","last_became_active":"2023-09-30T22:26:34.040124+0000","last_became_peered":"2023-09-30T22:26:34.040124+0000","last_unstale":"2023-09-30T22:27:24.984140+0000","last_undegraded":"2023-09-30T22:27:24.984140+0000","last_fullsized":"2023-09-30T22:27:24.984140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979418+0000","last_change":"2023-09-30T22:26:34.459725+0000","last_active":"2023-09-30T22:27:24.979418+0000","last_peered":"2023-09-30T22:27:24.979418+0000","last_clean":"2023-09-30T22:27:24.979418+0000","last_became_active":"2023-09-30T22:26:34.459414+0000","last_became_peered":"2023-09-30T22:26:34.459414+0000","last_unstale":"2023-09-30T22:27:24.979418+0000","last_undegraded":"2023-09-30T22:27:24.979418+0000","last_fullsized":"2023-09-30T22:27:24.979418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984793+0000","last_change":"2023-09-30T22:26:34.024931+0000","last_active":"2023-09-30T22:27:24.984793+0000","last_peered":"2023-09-30T22:27:24.984793+0000","last_clean":"2023-09-30T22:27:24.984793+0000","last_became_active":"2023-09-30T22:26:34.024616+0000","last_became_peered":"2023-09-30T22:26:34.024616+0000","last_unstale":"2023-09-30T22:27:24.984793+0000","last_undegraded":"2023-09-30T22:27:24.984793+0000","last_fullsized":"2023-09-30T22:27:24.984793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.997197+0000","last_change":"2023-09-30T22:27:24.992034+0000","last_active":"2023-09-30T22:27:24.997197+0000","last_peered":"2023-09-30T22:27:24.997197+0000","last_clean":"2023-09-30T22:27:24.997197+0000","last_became_active":"2023-09-30T22:27:24.991718+0000","last_became_peered":"2023-09-30T22:27:24.991718+0000","last_unstale":"2023-09-30T22:27:24.997197+0000","last_undegraded":"2023-09-30T22:27:24.997197+0000","last_fullsized":"2023-09-30T22:27:24.997197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979750+0000","last_change":"2023-09-30T22:26:34.040402+0000","last_active":"2023-09-30T22:27:24.979750+0000","last_peered":"2023-09-30T22:27:24.979750+0000","last_clean":"2023-09-30T22:27:24.979750+0000","last_became_active":"2023-09-30T22:26:34.039702+0000","last_became_peered":"2023-09-30T22:26:34.039702+0000","last_unstale":"2023-09-30T22:27:24.979750+0000","last_undegraded":"2023-09-30T22:27:24.979750+0000","last_fullsized":"2023-09-30T22:27:24.979750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984059+0000","last_change":"2023-09-30T22:26:34.450058+0000","last_active":"2023-09-30T22:27:24.984059+0000","last_peered":"2023-09-30T22:27:24.984059+0000","last_clean":"2023-09-30T22:27:24.984059+0000","last_became_active":"2023-09-30T22:26:34.449698+0000","last_became_peered":"2023-09-30T22:26:34.449698+0000","last_unstale":"2023-09-30T22:27:24.984059+0000","last_undegraded":"2023-09-30T22:27:24.984059+0000","last_fullsized":"2023-09-30T22:27:24.984059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979452+0000","last_change":"2023-09-30T22:26:34.041826+0000","last_active":"2023-09-30T22:27:24.979452+0000","last_peered":"2023-09-30T22:27:24.979452+0000","last_clean":"2023-09-30T22:27:24.979452+0000","last_became_active":"2023-09-30T22:26:34.041527+0000","last_became_peered":"2023-09-30T22:26:34.041527+0000","last_unstale":"2023-09-30T22:27:24.979452+0000","last_undegraded":"2023-09-30T22:27:24.979452+0000","last_fullsized":"2023-09-30T22:27:24.979452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981723+0000","last_change":"2023-09-30T22:26:34.461435+0000","last_active":"2023-09-30T22:27:24.981723+0000","last_peered":"2023-09-30T22:27:24.981723+0000","last_clean":"2023-09-30T22:27:24.981723+0000","last_became_active":"2023-09-30T22:26:34.461089+0000","last_became_peered":"2023-09-30T22:26:34.461089+0000","last_unstale":"2023-09-30T22:27:24.981723+0000","last_undegraded":"2023-09-30T22:27:24.981723+0000","last_fullsized":"2023-09-30T22:27:24.981723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983908+0000","last_change":"2023-09-30T22:26:34.030071+0000","last_active":"2023-09-30T22:27:24.983908+0000","last_peered":"2023-09-30T22:27:24.983908+0000","last_clean":"2023-09-30T22:27:24.983908+0000","last_became_active":"2023-09-30T22:26:34.029419+0000","last_became_peered":"2023-09-30T22:26:34.029419+0000","last_unstale":"2023-09-30T22:27:24.983908+0000","last_undegraded":"2023-09-30T22:27:24.983908+0000","last_fullsized":"2023-09-30T22:27:24.983908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.997466+0000","last_change":"2023-09-30T22:27:24.994305+0000","last_active":"2023-09-30T22:27:24.997466+0000","last_peered":"2023-09-30T22:27:24.997466+0000","last_clean":"2023-09-30T22:27:24.997466+0000","last_became_active":"2023-09-30T22:27:24.994040+0000","last_became_peered":"2023-09-30T22:27:24.994040+0000","last_unstale":"2023-09-30T22:27:24.997466+0000","last_undegraded":"2023-09-30T22:27:24.997466+0000","last_fullsized":"2023-09-30T22:27:24.997466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.985431+0000","last_change":"2023-09-30T22:26:34.024286+0000","last_active":"2023-09-30T22:27:24.985431+0000","last_peered":"2023-09-30T22:27:24.985431+0000","last_clean":"2023-09-30T22:27:24.985431+0000","last_became_active":"2023-09-30T22:26:34.022989+0000","last_became_peered":"2023-09-30T22:26:34.022989+0000","last_unstale":"2023-09-30T22:27:24.985431+0000","last_undegraded":"2023-09-30T22:27:24.985431+0000","last_fullsized":"2023-09-30T22:27:24.985431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980772+0000","last_change":"2023-09-30T22:26:34.453594+0000","last_active":"2023-09-30T22:27:24.980772+0000","last_peered":"2023-09-30T22:27:24.980772+0000","last_clean":"2023-09-30T22:27:24.980772+0000","last_became_active":"2023-09-30T22:26:34.453288+0000","last_became_peered":"2023-09-30T22:26:34.453288+0000","last_unstale":"2023-09-30T22:27:24.980772+0000","last_undegraded":"2023-09-30T22:27:24.980772+0000","last_fullsized":"2023-09-30T22:27:24.980772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981734+0000","last_change":"2023-09-30T22:26:34.042026+0000","last_active":"2023-09-30T22:27:24.981734+0000","last_peered":"2023-09-30T22:27:24.981734+0000","last_clean":"2023-09-30T22:27:24.981734+0000","last_became_active":"2023-09-30T22:26:34.041309+0000","last_became_peered":"2023-09-30T22:26:34.041309+0000","last_unstale":"2023-09-30T22:27:24.981734+0000","last_undegraded":"2023-09-30T22:27:24.981734+0000","last_fullsized":"2023-09-30T22:27:24.981734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983524+0000","last_change":"2023-09-30T22:26:34.448356+0000","last_active":"2023-09-30T22:27:24.983524+0000","last_peered":"2023-09-30T22:27:24.983524+0000","last_clean":"2023-09-30T22:27:24.983524+0000","last_became_active":"2023-09-30T22:26:34.447744+0000","last_became_peered":"2023-09-30T22:26:34.447744+0000","last_unstale":"2023-09-30T22:27:24.983524+0000","last_undegraded":"2023-09-30T22:27:24.983524+0000","last_fullsized":"2023-09-30T22:27:24.983524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983249+0000","last_change":"2023-09-30T22:26:34.025526+0000","last_active":"2023-09-30T22:27:24.983249+0000","last_peered":"2023-09-30T22:27:24.983249+0000","last_clean":"2023-09-30T22:27:24.983249+0000","last_became_active":"2023-09-30T22:26:34.025214+0000","last_became_peered":"2023-09-30T22:26:34.025214+0000","last_unstale":"2023-09-30T22:27:24.983249+0000","last_undegraded":"2023-09-30T22:27:24.983249+0000","last_fullsized":"2023-09-30T22:27:24.983249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983508+0000","last_change":"2023-09-30T22:26:34.457634+0000","last_active":"2023-09-30T22:27:24.983508+0000","last_peered":"2023-09-30T22:27:24.983508+0000","last_clean":"2023-09-30T22:27:24.983508+0000","last_became_active":"2023-09-30T22:26:34.457314+0000","last_became_peered":"2023-09-30T22:26:34.457314+0000","last_unstale":"2023-09-30T22:27:24.983508+0000","last_undegraded":"2023-09-30T22:27:24.983508+0000","last_fullsized":"2023-09-30T22:27:24.983508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983916+0000","last_change":"2023-09-30T22:26:34.042476+0000","last_active":"2023-09-30T22:27:24.983916+0000","last_peered":"2023-09-30T22:27:24.983916+0000","last_clean":"2023-09-30T22:27:24.983916+0000","last_became_active":"2023-09-30T22:26:34.040552+0000","last_became_peered":"2023-09-30T22:26:34.040552+0000","last_unstale":"2023-09-30T22:27:24.983916+0000","last_undegraded":"2023-09-30T22:27:24.983916+0000","last_fullsized":"2023-09-30T22:27:24.983916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983220+0000","last_change":"2023-09-30T22:26:34.451427+0000","last_active":"2023-09-30T22:27:24.983220+0000","last_peered":"2023-09-30T22:27:24.983220+0000","last_clean":"2023-09-30T22:27:24.983220+0000","last_became_active":"2023-09-30T22:26:34.451149+0000","last_became_peered":"2023-09-30T22:26:34.451149+0000","last_unstale":"2023-09-30T22:27:24.983220+0000","last_undegraded":"2023-09-30T22:27:24.983220+0000","last_fullsized":"2023-09-30T22:27:24.983220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980162+0000","last_change":"2023-09-30T22:26:34.039863+0000","last_active":"2023-09-30T22:27:24.980162+0000","last_peered":"2023-09-30T22:27:24.980162+0000","last_clean":"2023-09-30T22:27:24.980162+0000","last_became_active":"2023-09-30T22:26:34.039536+0000","last_became_peered":"2023-09-30T22:26:34.039536+0000","last_unstale":"2023-09-30T22:27:24.980162+0000","last_undegraded":"2023-09-30T22:27:24.980162+0000","last_fullsized":"2023-09-30T22:27:24.980162+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981635+0000","last_change":"2023-09-30T22:26:34.459623+0000","last_active":"2023-09-30T22:27:24.981635+0000","last_peered":"2023-09-30T22:27:24.981635+0000","last_clean":"2023-09-30T22:27:24.981635+0000","last_became_active":"2023-09-30T22:26:34.457887+0000","last_became_peered":"2023-09-30T22:26:34.457887+0000","last_unstale":"2023-09-30T22:27:24.981635+0000","last_undegraded":"2023-09-30T22:27:24.981635+0000","last_fullsized":"2023-09-30T22:27:24.981635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979419+0000","last_change":"2023-09-30T22:26:34.040793+0000","last_active":"2023-09-30T22:27:24.979419+0000","last_peered":"2023-09-30T22:27:24.979419+0000","last_clean":"2023-09-30T22:27:24.979419+0000","last_became_active":"2023-09-30T22:26:34.040437+0000","last_became_peered":"2023-09-30T22:26:34.040437+0000","last_unstale":"2023-09-30T22:27:24.979419+0000","last_undegraded":"2023-09-30T22:27:24.979419+0000","last_fullsized":"2023-09-30T22:27:24.979419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.985624+0000","last_change":"2023-09-30T22:26:34.446474+0000","last_active":"2023-09-30T22:27:24.985624+0000","last_peered":"2023-09-30T22:27:24.985624+0000","last_clean":"2023-09-30T22:27:24.985624+0000","last_became_active":"2023-09-30T22:26:34.445499+0000","last_became_peered":"2023-09-30T22:26:34.445499+0000","last_unstale":"2023-09-30T22:27:24.985624+0000","last_undegraded":"2023-09-30T22:27:24.985624+0000","last_fullsized":"2023-09-30T22:27:24.985624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979676+0000","last_change":"2023-09-30T22:26:34.040910+0000","last_active":"2023-09-30T22:27:24.979676+0000","last_peered":"2023-09-30T22:27:24.979676+0000","last_clean":"2023-09-30T22:27:24.979676+0000","last_became_active":"2023-09-30T22:26:34.040077+0000","last_became_peered":"2023-09-30T22:26:34.040077+0000","last_unstale":"2023-09-30T22:27:24.979676+0000","last_undegraded":"2023-09-30T22:27:24.979676+0000","last_fullsized":"2023-09-30T22:27:24.979676+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981505+0000","last_change":"2023-09-30T22:26:34.466480+0000","last_active":"2023-09-30T22:27:24.981505+0000","last_peered":"2023-09-30T22:27:24.981505+0000","last_clean":"2023-09-30T22:27:24.981505+0000","last_became_active":"2023-09-30T22:26:34.466187+0000","last_became_peered":"2023-09-30T22:26:34.466187+0000","last_unstale":"2023-09-30T22:27:24.981505+0000","last_undegraded":"2023-09-30T22:27:24.981505+0000","last_fullsized":"2023-09-30T22:27:24.981505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981099+0000","last_change":"2023-09-30T22:26:30.873307+0000","last_active":"2023-09-30T22:27:24.981099+0000","last_peered":"2023-09-30T22:27:24.981099+0000","last_clean":"2023-09-30T22:27:24.981099+0000","last_became_active":"2023-09-30T22:26:30.872872+0000","last_became_peered":"2023-09-30T22:26:30.872872+0000","last_unstale":"2023-09-30T22:27:24.981099+0000","last_undegraded":"2023-09-30T22:27:24.981099+0000","last_fullsized":"2023-09-30T22:27:24.981099+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983226+0000","last_change":"2023-09-30T22:26:34.037332+0000","last_active":"2023-09-30T22:27:24.983226+0000","last_peered":"2023-09-30T22:27:24.983226+0000","last_clean":"2023-09-30T22:27:24.983226+0000","last_became_active":"2023-09-30T22:26:34.037114+0000","last_became_peered":"2023-09-30T22:26:34.037114+0000","last_unstale":"2023-09-30T22:27:24.983226+0000","last_undegraded":"2023-09-30T22:27:24.983226+0000","last_fullsized":"2023-09-30T22:27:24.983226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980572+0000","last_change":"2023-09-30T22:26:34.462485+0000","last_active":"2023-09-30T22:27:24.980572+0000","last_peered":"2023-09-30T22:27:24.980572+0000","last_clean":"2023-09-30T22:27:24.980572+0000","last_became_active":"2023-09-30T22:26:34.454284+0000","last_became_peered":"2023-09-30T22:26:34.454284+0000","last_unstale":"2023-09-30T22:27:24.980572+0000","last_undegraded":"2023-09-30T22:27:24.980572+0000","last_fullsized":"2023-09-30T22:27:24.980572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981501+0000","last_change":"2023-09-30T22:26:29.861644+0000","last_active":"2023-09-30T22:27:24.981501+0000","last_peered":"2023-09-30T22:27:24.981501+0000","last_clean":"2023-09-30T22:27:24.981501+0000","last_became_active":"2023-09-30T22:26:29.861261+0000","last_became_peered":"2023-09-30T22:26:29.861261+0000","last_unstale":"2023-09-30T22:27:24.981501+0000","last_undegraded":"2023-09-30T22:27:24.981501+0000","last_fullsized":"2023-09-30T22:27:24.981501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983126+0000","last_change":"2023-09-30T22:26:34.024242+0000","last_active":"2023-09-30T22:27:24.983126+0000","last_peered":"2023-09-30T22:27:24.983126+0000","last_clean":"2023-09-30T22:27:24.983126+0000","last_became_active":"2023-09-30T22:26:34.023935+0000","last_became_peered":"2023-09-30T22:26:34.023935+0000","last_unstale":"2023-09-30T22:27:24.983126+0000","last_undegraded":"2023-09-30T22:27:24.983126+0000","last_fullsized":"2023-09-30T22:27:24.983126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980983+0000","last_change":"2023-09-30T22:26:34.444993+0000","last_active":"2023-09-30T22:27:24.980983+0000","last_peered":"2023-09-30T22:27:24.980983+0000","last_clean":"2023-09-30T22:27:24.980983+0000","last_became_active":"2023-09-30T22:26:34.444739+0000","last_became_peered":"2023-09-30T22:26:34.444739+0000","last_unstale":"2023-09-30T22:27:24.980983+0000","last_undegraded":"2023-09-30T22:27:24.980983+0000","last_fullsized":"2023-09-30T22:27:24.980983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.985804+0000","last_change":"2023-09-30T22:26:29.858340+0000","last_active":"2023-09-30T22:27:24.985804+0000","last_peered":"2023-09-30T22:27:24.985804+0000","last_clean":"2023-09-30T22:27:24.985804+0000","last_became_active":"2023-09-30T22:26:29.857989+0000","last_became_peered":"2023-09-30T22:26:29.857989+0000","last_unstale":"2023-09-30T22:27:24.985804+0000","last_undegraded":"2023-09-30T22:27:24.985804+0000","last_fullsized":"2023-09-30T22:27:24.985804+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979227+0000","last_change":"2023-09-30T22:26:34.031173+0000","last_active":"2023-09-30T22:27:24.979227+0000","last_peered":"2023-09-30T22:27:24.979227+0000","last_clean":"2023-09-30T22:27:24.979227+0000","last_became_active":"2023-09-30T22:26:34.030863+0000","last_became_peered":"2023-09-30T22:26:34.030863+0000","last_unstale":"2023-09-30T22:27:24.979227+0000","last_undegraded":"2023-09-30T22:27:24.979227+0000","last_fullsized":"2023-09-30T22:27:24.979227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981598+0000","last_change":"2023-09-30T22:26:34.456017+0000","last_active":"2023-09-30T22:27:24.981598+0000","last_peered":"2023-09-30T22:27:24.981598+0000","last_clean":"2023-09-30T22:27:24.981598+0000","last_became_active":"2023-09-30T22:26:34.455744+0000","last_became_peered":"2023-09-30T22:26:34.455744+0000","last_unstale":"2023-09-30T22:27:24.981598+0000","last_undegraded":"2023-09-30T22:27:24.981598+0000","last_fullsized":"2023-09-30T22:27:24.981598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984034+0000","last_change":"2023-09-30T22:26:29.859074+0000","last_active":"2023-09-30T22:27:24.984034+0000","last_peered":"2023-09-30T22:27:24.984034+0000","last_clean":"2023-09-30T22:27:24.984034+0000","last_became_active":"2023-09-30T22:26:29.858669+0000","last_became_peered":"2023-09-30T22:26:29.858669+0000","last_unstale":"2023-09-30T22:27:24.984034+0000","last_undegraded":"2023-09-30T22:27:24.984034+0000","last_fullsized":"2023-09-30T22:27:24.984034+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979090+0000","last_change":"2023-09-30T22:26:28.864097+0000","last_active":"2023-09-30T22:27:24.979090+0000","last_peered":"2023-09-30T22:27:24.979090+0000","last_clean":"2023-09-30T22:27:24.979090+0000","last_became_active":"2023-09-30T22:26:28.863723+0000","last_became_peered":"2023-09-30T22:26:28.863723+0000","last_unstale":"2023-09-30T22:27:24.979090+0000","last_undegraded":"2023-09-30T22:27:24.979090+0000","last_fullsized":"2023-09-30T22:27:24.979090+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_clean_scrub_stamp":"2023-09-30T22:26:27.842299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980072+0000","last_change":"2023-09-30T22:26:34.040465+0000","last_active":"2023-09-30T22:27:24.980072+0000","last_peered":"2023-09-30T22:27:24.980072+0000","last_clean":"2023-09-30T22:27:24.980072+0000","last_became_active":"2023-09-30T22:26:34.039806+0000","last_became_peered":"2023-09-30T22:26:34.039806+0000","last_unstale":"2023-09-30T22:27:24.980072+0000","last_undegraded":"2023-09-30T22:27:24.980072+0000","last_fullsized":"2023-09-30T22:27:24.980072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981952+0000","last_change":"2023-09-30T22:26:34.459817+0000","last_active":"2023-09-30T22:27:24.981952+0000","last_peered":"2023-09-30T22:27:24.981952+0000","last_clean":"2023-09-30T22:27:24.981952+0000","last_became_active":"2023-09-30T22:26:34.458434+0000","last_became_peered":"2023-09-30T22:26:34.458434+0000","last_unstale":"2023-09-30T22:27:24.981952+0000","last_undegraded":"2023-09-30T22:27:24.981952+0000","last_fullsized":"2023-09-30T22:27:24.981952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979954+0000","last_change":"2023-09-30T22:26:29.861337+0000","last_active":"2023-09-30T22:27:24.979954+0000","last_peered":"2023-09-30T22:27:24.979954+0000","last_clean":"2023-09-30T22:27:24.979954+0000","last_became_active":"2023-09-30T22:26:29.861003+0000","last_became_peered":"2023-09-30T22:26:29.861003+0000","last_unstale":"2023-09-30T22:27:24.979954+0000","last_undegraded":"2023-09-30T22:27:24.979954+0000","last_fullsized":"2023-09-30T22:27:24.979954+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983666+0000","last_change":"2023-09-30T22:26:34.022924+0000","last_active":"2023-09-30T22:27:24.983666+0000","last_peered":"2023-09-30T22:27:24.983666+0000","last_clean":"2023-09-30T22:27:24.983666+0000","last_became_active":"2023-09-30T22:26:34.022592+0000","last_became_peered":"2023-09-30T22:26:34.022592+0000","last_unstale":"2023-09-30T22:27:24.983666+0000","last_undegraded":"2023-09-30T22:27:24.983666+0000","last_fullsized":"2023-09-30T22:27:24.983666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984143+0000","last_change":"2023-09-30T22:26:34.464915+0000","last_active":"2023-09-30T22:27:24.984143+0000","last_peered":"2023-09-30T22:27:24.984143+0000","last_clean":"2023-09-30T22:27:24.984143+0000","last_became_active":"2023-09-30T22:26:34.464406+0000","last_became_peered":"2023-09-30T22:26:34.464406+0000","last_unstale":"2023-09-30T22:27:24.984143+0000","last_undegraded":"2023-09-30T22:27:24.984143+0000","last_fullsized":"2023-09-30T22:27:24.984143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981868+0000","last_change":"2023-09-30T22:26:30.874397+0000","last_active":"2023-09-30T22:27:24.981868+0000","last_peered":"2023-09-30T22:27:24.981868+0000","last_clean":"2023-09-30T22:27:24.981868+0000","last_became_active":"2023-09-30T22:26:30.874057+0000","last_became_peered":"2023-09-30T22:26:30.874057+0000","last_unstale":"2023-09-30T22:27:24.981868+0000","last_undegraded":"2023-09-30T22:27:24.981868+0000","last_fullsized":"2023-09-30T22:27:24.981868+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980917+0000","last_change":"2023-09-30T22:26:34.037126+0000","last_active":"2023-09-30T22:27:24.980917+0000","last_peered":"2023-09-30T22:27:24.980917+0000","last_clean":"2023-09-30T22:27:24.980917+0000","last_became_active":"2023-09-30T22:26:34.036825+0000","last_became_peered":"2023-09-30T22:26:34.036825+0000","last_unstale":"2023-09-30T22:27:24.980917+0000","last_undegraded":"2023-09-30T22:27:24.980917+0000","last_fullsized":"2023-09-30T22:27:24.980917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983316+0000","last_change":"2023-09-30T22:26:34.443381+0000","last_active":"2023-09-30T22:27:24.983316+0000","last_peered":"2023-09-30T22:27:24.983316+0000","last_clean":"2023-09-30T22:27:24.983316+0000","last_became_active":"2023-09-30T22:26:34.443094+0000","last_became_peered":"2023-09-30T22:26:34.443094+0000","last_unstale":"2023-09-30T22:27:24.983316+0000","last_undegraded":"2023-09-30T22:27:24.983316+0000","last_fullsized":"2023-09-30T22:27:24.983316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981546+0000","last_change":"2023-09-30T22:26:34.041060+0000","last_active":"2023-09-30T22:27:24.981546+0000","last_peered":"2023-09-30T22:27:24.981546+0000","last_clean":"2023-09-30T22:27:24.981546+0000","last_became_active":"2023-09-30T22:26:34.040742+0000","last_became_peered":"2023-09-30T22:26:34.040742+0000","last_unstale":"2023-09-30T22:27:24.981546+0000","last_undegraded":"2023-09-30T22:27:24.981546+0000","last_fullsized":"2023-09-30T22:27:24.981546+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981842+0000","last_change":"2023-09-30T22:26:30.873252+0000","last_active":"2023-09-30T22:27:24.981842+0000","last_peered":"2023-09-30T22:27:24.981842+0000","last_clean":"2023-09-30T22:27:24.981842+0000","last_became_active":"2023-09-30T22:26:30.872894+0000","last_became_peered":"2023-09-30T22:26:30.872894+0000","last_unstale":"2023-09-30T22:27:24.981842+0000","last_undegraded":"2023-09-30T22:27:24.981842+0000","last_fullsized":"2023-09-30T22:27:24.981842+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979785+0000","last_change":"2023-09-30T22:26:34.462059+0000","last_active":"2023-09-30T22:27:24.979785+0000","last_peered":"2023-09-30T22:27:24.979785+0000","last_clean":"2023-09-30T22:27:24.979785+0000","last_became_active":"2023-09-30T22:26:34.461415+0000","last_became_peered":"2023-09-30T22:26:34.461415+0000","last_unstale":"2023-09-30T22:27:24.979785+0000","last_undegraded":"2023-09-30T22:27:24.979785+0000","last_fullsized":"2023-09-30T22:27:24.979785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981638+0000","last_change":"2023-09-30T22:26:30.874887+0000","last_active":"2023-09-30T22:27:24.981638+0000","last_peered":"2023-09-30T22:27:24.981638+0000","last_clean":"2023-09-30T22:27:24.981638+0000","last_became_active":"2023-09-30T22:26:30.874533+0000","last_became_peered":"2023-09-30T22:26:30.874533+0000","last_unstale":"2023-09-30T22:27:24.981638+0000","last_undegraded":"2023-09-30T22:27:24.981638+0000","last_fullsized":"2023-09-30T22:27:24.981638+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983659+0000","last_change":"2023-09-30T22:26:34.029291+0000","last_active":"2023-09-30T22:27:24.983659+0000","last_peered":"2023-09-30T22:27:24.983659+0000","last_clean":"2023-09-30T22:27:24.983659+0000","last_became_active":"2023-09-30T22:26:34.028983+0000","last_became_peered":"2023-09-30T22:26:34.028983+0000","last_unstale":"2023-09-30T22:27:24.983659+0000","last_undegraded":"2023-09-30T22:27:24.983659+0000","last_fullsized":"2023-09-30T22:27:24.983659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.985864+0000","last_change":"2023-09-30T22:26:34.453608+0000","last_active":"2023-09-30T22:27:24.985864+0000","last_peered":"2023-09-30T22:27:24.985864+0000","last_clean":"2023-09-30T22:27:24.985864+0000","last_became_active":"2023-09-30T22:26:34.453255+0000","last_became_peered":"2023-09-30T22:26:34.453255+0000","last_unstale":"2023-09-30T22:27:24.985864+0000","last_undegraded":"2023-09-30T22:27:24.985864+0000","last_fullsized":"2023-09-30T22:27:24.985864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983222+0000","last_change":"2023-09-30T22:26:34.026874+0000","last_active":"2023-09-30T22:27:24.983222+0000","last_peered":"2023-09-30T22:27:24.983222+0000","last_clean":"2023-09-30T22:27:24.983222+0000","last_became_active":"2023-09-30T22:26:34.024536+0000","last_became_peered":"2023-09-30T22:26:34.024536+0000","last_unstale":"2023-09-30T22:27:24.983222+0000","last_undegraded":"2023-09-30T22:27:24.983222+0000","last_fullsized":"2023-09-30T22:27:24.983222+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.985543+0000","last_change":"2023-09-30T22:26:34.452982+0000","last_active":"2023-09-30T22:27:24.985543+0000","last_peered":"2023-09-30T22:27:24.985543+0000","last_clean":"2023-09-30T22:27:24.985543+0000","last_became_active":"2023-09-30T22:26:34.452695+0000","last_became_peered":"2023-09-30T22:26:34.452695+0000","last_unstale":"2023-09-30T22:27:24.985543+0000","last_undegraded":"2023-09-30T22:27:24.985543+0000","last_fullsized":"2023-09-30T22:27:24.985543+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981012+0000","last_change":"2023-09-30T22:26:34.045553+0000","last_active":"2023-09-30T22:27:24.981012+0000","last_peered":"2023-09-30T22:27:24.981012+0000","last_clean":"2023-09-30T22:27:24.981012+0000","last_became_active":"2023-09-30T22:26:34.045206+0000","last_became_peered":"2023-09-30T22:26:34.045206+0000","last_unstale":"2023-09-30T22:27:24.981012+0000","last_undegraded":"2023-09-30T22:27:24.981012+0000","last_fullsized":"2023-09-30T22:27:24.981012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984542+0000","last_change":"2023-09-30T22:26:34.454158+0000","last_active":"2023-09-30T22:27:24.984542+0000","last_peered":"2023-09-30T22:27:24.984542+0000","last_clean":"2023-09-30T22:27:24.984542+0000","last_became_active":"2023-09-30T22:26:34.453928+0000","last_became_peered":"2023-09-30T22:26:34.453928+0000","last_unstale":"2023-09-30T22:27:24.984542+0000","last_undegraded":"2023-09-30T22:27:24.984542+0000","last_fullsized":"2023-09-30T22:27:24.984542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.982038+0000","last_change":"2023-09-30T22:26:34.045717+0000","last_active":"2023-09-30T22:27:24.982038+0000","last_peered":"2023-09-30T22:27:24.982038+0000","last_clean":"2023-09-30T22:27:24.982038+0000","last_became_active":"2023-09-30T22:26:34.045395+0000","last_became_peered":"2023-09-30T22:26:34.045395+0000","last_unstale":"2023-09-30T22:27:24.982038+0000","last_undegraded":"2023-09-30T22:27:24.982038+0000","last_fullsized":"2023-09-30T22:27:24.982038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983427+0000","last_change":"2023-09-30T22:26:34.448542+0000","last_active":"2023-09-30T22:27:24.983427+0000","last_peered":"2023-09-30T22:27:24.983427+0000","last_clean":"2023-09-30T22:27:24.983427+0000","last_became_active":"2023-09-30T22:26:34.448081+0000","last_became_peered":"2023-09-30T22:26:34.448081+0000","last_unstale":"2023-09-30T22:27:24.983427+0000","last_undegraded":"2023-09-30T22:27:24.983427+0000","last_fullsized":"2023-09-30T22:27:24.983427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980055+0000","last_change":"2023-09-30T22:26:34.039959+0000","last_active":"2023-09-30T22:27:24.980055+0000","last_peered":"2023-09-30T22:27:24.980055+0000","last_clean":"2023-09-30T22:27:24.980055+0000","last_became_active":"2023-09-30T22:26:34.039615+0000","last_became_peered":"2023-09-30T22:26:34.039615+0000","last_unstale":"2023-09-30T22:27:24.980055+0000","last_undegraded":"2023-09-30T22:27:24.980055+0000","last_fullsized":"2023-09-30T22:27:24.980055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979840+0000","last_change":"2023-09-30T22:26:34.442775+0000","last_active":"2023-09-30T22:27:24.979840+0000","last_peered":"2023-09-30T22:27:24.979840+0000","last_clean":"2023-09-30T22:27:24.979840+0000","last_became_active":"2023-09-30T22:26:34.442406+0000","last_became_peered":"2023-09-30T22:26:34.442406+0000","last_unstale":"2023-09-30T22:27:24.979840+0000","last_undegraded":"2023-09-30T22:27:24.979840+0000","last_fullsized":"2023-09-30T22:27:24.979840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984185+0000","last_change":"2023-09-30T22:26:34.030292+0000","last_active":"2023-09-30T22:27:24.984185+0000","last_peered":"2023-09-30T22:27:24.984185+0000","last_clean":"2023-09-30T22:27:24.984185+0000","last_became_active":"2023-09-30T22:26:34.029782+0000","last_became_peered":"2023-09-30T22:26:34.029782+0000","last_unstale":"2023-09-30T22:27:24.984185+0000","last_undegraded":"2023-09-30T22:27:24.984185+0000","last_fullsized":"2023-09-30T22:27:24.984185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.986112+0000","last_change":"2023-09-30T22:26:34.446235+0000","last_active":"2023-09-30T22:27:24.986112+0000","last_peered":"2023-09-30T22:27:24.986112+0000","last_clean":"2023-09-30T22:27:24.986112+0000","last_became_active":"2023-09-30T22:26:34.445921+0000","last_became_peered":"2023-09-30T22:26:34.445921+0000","last_unstale":"2023-09-30T22:27:24.986112+0000","last_undegraded":"2023-09-30T22:27:24.986112+0000","last_fullsized":"2023-09-30T22:27:24.986112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979361+0000","last_change":"2023-09-30T22:26:34.441075+0000","last_active":"2023-09-30T22:27:24.979361+0000","last_peered":"2023-09-30T22:27:24.979361+0000","last_clean":"2023-09-30T22:27:24.979361+0000","last_became_active":"2023-09-30T22:26:34.440633+0000","last_became_peered":"2023-09-30T22:26:34.440633+0000","last_unstale":"2023-09-30T22:27:24.979361+0000","last_undegraded":"2023-09-30T22:27:24.979361+0000","last_fullsized":"2023-09-30T22:27:24.979361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.997032+0000","last_change":"2023-09-30T22:27:24.989703+0000","last_active":"2023-09-30T22:27:24.997032+0000","last_peered":"2023-09-30T22:27:24.997032+0000","last_clean":"2023-09-30T22:27:24.997032+0000","last_became_active":"2023-09-30T22:27:24.989414+0000","last_became_peered":"2023-09-30T22:27:24.989414+0000","last_unstale":"2023-09-30T22:27:24.997032+0000","last_undegraded":"2023-09-30T22:27:24.997032+0000","last_fullsized":"2023-09-30T22:27:24.997032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984818+0000","last_change":"2023-09-30T22:26:34.450865+0000","last_active":"2023-09-30T22:27:24.984818+0000","last_peered":"2023-09-30T22:27:24.984818+0000","last_clean":"2023-09-30T22:27:24.984818+0000","last_became_active":"2023-09-30T22:26:34.450568+0000","last_became_peered":"2023-09-30T22:26:34.450568+0000","last_unstale":"2023-09-30T22:27:24.984818+0000","last_undegraded":"2023-09-30T22:27:24.984818+0000","last_fullsized":"2023-09-30T22:27:24.984818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.997012+0000","last_change":"2023-09-30T22:27:24.989348+0000","last_active":"2023-09-30T22:27:24.997012+0000","last_peered":"2023-09-30T22:27:24.997012+0000","last_clean":"2023-09-30T22:27:24.997012+0000","last_became_active":"2023-09-30T22:27:24.989025+0000","last_became_peered":"2023-09-30T22:27:24.989025+0000","last_unstale":"2023-09-30T22:27:24.997012+0000","last_undegraded":"2023-09-30T22:27:24.997012+0000","last_fullsized":"2023-09-30T22:27:24.997012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981076+0000","last_change":"2023-09-30T22:26:34.444740+0000","last_active":"2023-09-30T22:27:24.981076+0000","last_peered":"2023-09-30T22:27:24.981076+0000","last_clean":"2023-09-30T22:27:24.981076+0000","last_became_active":"2023-09-30T22:26:34.444385+0000","last_became_peered":"2023-09-30T22:26:34.444385+0000","last_unstale":"2023-09-30T22:27:24.981076+0000","last_undegraded":"2023-09-30T22:27:24.981076+0000","last_fullsized":"2023-09-30T22:27:24.981076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705697,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297300,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074540,"statfs":{"total":96636764160,"available":96332328960,"internally_reserved":0,"allocated":208896,"data_stored":70607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:28:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33400000000000002,"15min":0.33300000000000002},"min":{"1min":0.26400000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.442,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.40000000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.33400000000000002}]},{"osd":1,"last update":"Sat Sep 30 22:28:34 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.45400000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.48099999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.38200000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:28:34 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.49299999999999999,"15min":0.51100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.498,"5min":2.827,"15min":2.827},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.36099999999999999,"15min":0.36299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.435,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.32000000000000001}]}]},{"osd":2,"up_from":10,"seq":42949672992,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":69344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.314,"15min":0.311},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.33300000000000002,"15min":0.33100000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.317}]},{"osd":1,"last update":"Sat Sep 30 22:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35099999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34599999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.32800000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.379,"15min":0.376},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.443},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35499999999999998,"15min":0.35599999999999998},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.39600000000000002}]}]},{"osd":0,"up_from":10,"seq":42949672992,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297288,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074552,"statfs":{"total":96636764160,"available":96332341248,"internally_reserved":0,"allocated":196608,"data_stored":66481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.251,"5min":0.248,"15min":0.248},"max":{"1min":0.439,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.34000000000000002,"15min":0.34100000000000003},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.45700000000000002,"5min":0.497,"15min":0.497},"last":0.60999999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35899999999999999,"15min":0.35999999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.504},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36699999999999999,"15min":0.371},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.53500000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27900000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.48399999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.55900000000000005}]}]},{"osd":1,"up_from":9,"seq":38654705697,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297288,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074552,"statfs":{"total":96636764160,"available":96332341248,"internally_reserved":0,"allocated":196608,"data_stored":67496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:28:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32100000000000001,"15min":0.32000000000000001},"min":{"1min":0.22800000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.48799999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.33600000000000002,"15min":0.33300000000000002},"min":{"1min":0.251,"5min":0.215,"15min":0.215},"max":{"1min":0.505,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.82099999999999995}]},{"osd":2,"last update":"Sat Sep 30 22:28:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35299999999999998,"15min":0.35099999999999998},"min":{"1min":0.246,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36599999999999999},"min":{"1min":0.27000000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.54000000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:28:35 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36399999999999999},"min":{"1min":0.28799999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57799999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.313,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.53000000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.53300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:29:02.945 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:29:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.116+0000 7f3de8559700 1 Processor -- start 2023-09-30T22:29:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.116+0000 7f3de8559700 1 -- start start 2023-09-30T22:29:03.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.116+0000 7f3de8559700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3de0131810 0x7f3de0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.116+0000 7f3de8559700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de0099a40 0x7f3de0099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.116+0000 7f3de8559700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de009a3b0 0x7f3de0138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.116+0000 7f3de8559700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de01313c0 con 0x7f3de0131810 2023-09-30T22:29:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.116+0000 7f3de8559700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de006e8c0 con 0x7f3de009a3b0 2023-09-30T22:29:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.116+0000 7f3de8559700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3de0071d20 con 0x7f3de0099a40 2023-09-30T22:29:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de5af4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de0099a40 0x7f3de0099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de6af6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de009a3b0 0x7f3de0138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de6af6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de009a3b0 0x7f3de0138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37016/0 (socket says 172.21.15.59:37016) 2023-09-30T22:29:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de5af4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de0099a40 0x7f3de0099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40108/0 (socket says 172.21.15.59:40108) 2023-09-30T22:29:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de62f5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3de0131810 0x7f3de0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de6af6700 1 -- 172.21.15.59:0/3081093552 learned_addr learned my addr 172.21.15.59:0/3081093552 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de62f5700 1 -- 172.21.15.59:0/3081093552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de0099a40 msgr2=0x7f3de0099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de62f5700 1 --2- 172.21.15.59:0/3081093552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de0099a40 0x7f3de0099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de62f5700 1 -- 172.21.15.59:0/3081093552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de009a3b0 msgr2=0x7f3de0138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de62f5700 1 --2- 172.21.15.59:0/3081093552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de009a3b0 0x7f3de0138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de62f5700 1 -- 172.21.15.59:0/3081093552 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de00721a0 con 0x7f3de0131810 2023-09-30T22:29:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de6af6700 1 --2- 172.21.15.59:0/3081093552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de009a3b0 0x7f3de0138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de62f5700 1 --2- 172.21.15.59:0/3081093552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de0131810 0x7f3de0131be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009840 tx=0x7f3ddc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda4e64013825cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de52f3700 1 -- 172.21.15.59:0/3081093552 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc011830 con 0x7f3de0131810 2023-09-30T22:29:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de52f3700 1 -- 172.21.15.59:0/3081093552 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc011990 con 0x7f3de0131810 2023-09-30T22:29:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.117+0000 7f3de52f3700 1 -- 172.21.15.59:0/3081093552 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc011d20 con 0x7f3de0131810 2023-09-30T22:29:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.118+0000 7f3de8559700 1 -- 172.21.15.59:0/3081093552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de0131810 msgr2=0x7f3de0131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.118+0000 7f3de8559700 1 --2- 172.21.15.59:0/3081093552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de0131810 0x7f3de0131be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009840 tx=0x7f3ddc009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:03.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.118+0000 7f3de8559700 1 -- 172.21.15.59:0/3081093552 shutdown_connections 2023-09-30T22:29:03.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.118+0000 7f3de8559700 1 --2- 172.21.15.59:0/3081093552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de009a3b0 0x7f3de0138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.118+0000 7f3de8559700 1 --2- 172.21.15.59:0/3081093552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de0131810 0x7f3de0131be0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.118+0000 7f3de8559700 1 --2- 172.21.15.59:0/3081093552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de0099a40 0x7f3de0099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.118+0000 7f3de8559700 1 -- 172.21.15.59:0/3081093552 >> 172.21.15.59:0/3081093552 conn(0x7f3de00a2aa0 msgr2=0x7f3de00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.118+0000 7f3de8559700 1 -- 172.21.15.59:0/3081093552 shutdown_connections 2023-09-30T22:29:03.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.118+0000 7f3de8559700 1 -- 172.21.15.59:0/3081093552 wait complete. 2023-09-30T22:29:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.119+0000 7f3de8559700 1 Processor -- start 2023-09-30T22:29:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.119+0000 7f3de8559700 1 -- start start 2023-09-30T22:29:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de8559700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0099a40 0x7f3de006f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de8559700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de009a3b0 0x7f3de006fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de8559700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de0131810 0x7f3de0070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de8559700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de0070a50 con 0x7f3de009a3b0 2023-09-30T22:29:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de8559700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de011dc10 con 0x7f3de0099a40 2023-09-30T22:29:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de8559700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3de012cb20 con 0x7f3de0131810 2023-09-30T22:29:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de62f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0099a40 0x7f3de006f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de62f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0099a40 0x7f3de006f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37020/0 (socket says 172.21.15.59:37020) 2023-09-30T22:29:03.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de62f5700 1 -- 172.21.15.59:0/3780303132 learned_addr learned my addr 172.21.15.59:0/3780303132 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:03.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de6af6700 1 --2- 172.21.15.59:0/3780303132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de0131810 0x7f3de0070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de5af4700 1 --2- 172.21.15.59:0/3780303132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de009a3b0 0x7f3de006fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de62f5700 1 -- 172.21.15.59:0/3780303132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de0131810 msgr2=0x7f3de0070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de62f5700 1 --2- 172.21.15.59:0/3780303132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de0131810 0x7f3de0070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de62f5700 1 -- 172.21.15.59:0/3780303132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de009a3b0 msgr2=0x7f3de006fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de62f5700 1 --2- 172.21.15.59:0/3780303132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de009a3b0 0x7f3de006fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de62f5700 1 -- 172.21.15.59:0/3780303132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd8009b30 con 0x7f3de0099a40 2023-09-30T22:29:03.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3de62f5700 1 --2- 172.21.15.59:0/3780303132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0099a40 0x7f3de006f610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0090b0 tx=0x7f3ddc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3dd6ffd700 1 -- 172.21.15.59:0/3780303132 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc004450 con 0x7f3de0099a40 2023-09-30T22:29:03.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3dd6ffd700 1 -- 172.21.15.59:0/3780303132 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc01f070 con 0x7f3de0099a40 2023-09-30T22:29:03.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.120+0000 7f3dd6ffd700 1 -- 172.21.15.59:0/3780303132 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0038e0 con 0x7f3de0099a40 2023-09-30T22:29:03.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.121+0000 7f3de8559700 1 -- 172.21.15.59:0/3780303132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ddc0094a0 con 0x7f3de0099a40 2023-09-30T22:29:03.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.121+0000 7f3de8559700 1 -- 172.21.15.59:0/3780303132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de006eb00 con 0x7f3de0099a40 2023-09-30T22:29:03.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.121+0000 7f3dd6ffd700 1 -- 172.21.15.59:0/3780303132 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f3ddc003a40 con 0x7f3de0099a40 2023-09-30T22:29:03.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.122+0000 7f3dd6ffd700 1 -- 172.21.15.59:0/3780303132 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f3ddc021070 con 0x7f3de0099a40 2023-09-30T22:29:03.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.122+0000 7f3de8559700 1 -- 172.21.15.59:0/3780303132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de011ec10 con 0x7f3de0099a40 2023-09-30T22:29:03.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.126+0000 7f3dd6ffd700 1 -- 172.21.15.59:0/3780303132 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3de011ec10 con 0x7f3de0099a40 2023-09-30T22:29:03.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.324+0000 7f3de8559700 1 -- 172.21.15.59:0/3780303132 --> v1:172.21.15.59:6816/126772 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3de0066680 con 0x7f3dc402f480 2023-09-30T22:29:03.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.331+0000 7f3dd6ffd700 1 -- 172.21.15.59:0/3780303132 <== mgr.14104 v1:172.21.15.59:6816/126772 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270472 (unknown 2965378022 0 1284552662) 0x7f3dd0009860 con 0x7f3dc402f480 2023-09-30T22:29:03.334 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:03.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.334+0000 7f3de8559700 1 -- 172.21.15.59:0/3780303132 >> v1:172.21.15.59:6816/126772 conn(0x7f3dc402f480 legacy=0x7f3dc4031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.334+0000 7f3de8559700 1 -- 172.21.15.59:0/3780303132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0099a40 msgr2=0x7f3de006f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.334+0000 7f3de8559700 1 --2- 172.21.15.59:0/3780303132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0099a40 0x7f3de006f610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0090b0 tx=0x7f3ddc004750 comp rx=0 tx=0).stop 2023-09-30T22:29:03.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.334+0000 7f3de8559700 1 -- 172.21.15.59:0/3780303132 shutdown_connections 2023-09-30T22:29:03.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.334+0000 7f3de8559700 1 --2- 172.21.15.59:0/3780303132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de0131810 0x7f3de0070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.334+0000 7f3de8559700 1 --2- 172.21.15.59:0/3780303132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0099a40 0x7f3de006f610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.334+0000 7f3de8559700 1 --2- 172.21.15.59:0/3780303132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de009a3b0 0x7f3de006fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.334+0000 7f3de8559700 1 -- 172.21.15.59:0/3780303132 >> 172.21.15.59:0/3780303132 conn(0x7f3de00a2aa0 msgr2=0x7f3de012e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.334+0000 7f3de8559700 1 -- 172.21.15.59:0/3780303132 shutdown_connections 2023-09-30T22:29:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.334+0000 7f3de8559700 1 -- 172.21.15.59:0/3780303132 wait complete. 2023-09-30T22:29:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-09-30T22:29:03.348 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-09-30T22:29:01.582749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189160,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298200,"statfs":{"total":386547056640,"available":385329356800,"internally_reserved":0,"allocated":794624,"data_stored":273928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.004508"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983567+0000","last_change":"2023-09-30T22:26:34.447805+0000","last_active":"2023-09-30T22:27:24.983567+0000","last_peered":"2023-09-30T22:27:24.983567+0000","last_clean":"2023-09-30T22:27:24.983567+0000","last_became_active":"2023-09-30T22:26:34.447480+0000","last_became_peered":"2023-09-30T22:26:34.447480+0000","last_unstale":"2023-09-30T22:27:24.983567+0000","last_undegraded":"2023-09-30T22:27:24.983567+0000","last_fullsized":"2023-09-30T22:27:24.983567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.985719+0000","last_change":"2023-09-30T22:26:34.440046+0000","last_active":"2023-09-30T22:27:24.985719+0000","last_peered":"2023-09-30T22:27:24.985719+0000","last_clean":"2023-09-30T22:27:24.985719+0000","last_became_active":"2023-09-30T22:26:34.439718+0000","last_became_peered":"2023-09-30T22:26:34.439718+0000","last_unstale":"2023-09-30T22:27:24.985719+0000","last_undegraded":"2023-09-30T22:27:24.985719+0000","last_fullsized":"2023-09-30T22:27:24.985719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984676+0000","last_change":"2023-09-30T22:26:34.457031+0000","last_active":"2023-09-30T22:27:24.984676+0000","last_peered":"2023-09-30T22:27:24.984676+0000","last_clean":"2023-09-30T22:27:24.984676+0000","last_became_active":"2023-09-30T22:26:34.456552+0000","last_became_peered":"2023-09-30T22:26:34.456552+0000","last_unstale":"2023-09-30T22:27:24.984676+0000","last_undegraded":"2023-09-30T22:27:24.984676+0000","last_fullsized":"2023-09-30T22:27:24.984676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983104+0000","last_change":"2023-09-30T22:26:34.456744+0000","last_active":"2023-09-30T22:27:24.983104+0000","last_peered":"2023-09-30T22:27:24.983104+0000","last_clean":"2023-09-30T22:27:24.983104+0000","last_became_active":"2023-09-30T22:26:34.456441+0000","last_became_peered":"2023-09-30T22:26:34.456441+0000","last_unstale":"2023-09-30T22:27:24.983104+0000","last_undegraded":"2023-09-30T22:27:24.983104+0000","last_fullsized":"2023-09-30T22:27:24.983104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983415+0000","last_change":"2023-09-30T22:26:34.454395+0000","last_active":"2023-09-30T22:27:24.983415+0000","last_peered":"2023-09-30T22:27:24.983415+0000","last_clean":"2023-09-30T22:27:24.983415+0000","last_became_active":"2023-09-30T22:26:34.454106+0000","last_became_peered":"2023-09-30T22:26:34.454106+0000","last_unstale":"2023-09-30T22:27:24.983415+0000","last_undegraded":"2023-09-30T22:27:24.983415+0000","last_fullsized":"2023-09-30T22:27:24.983415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.994305+0000","last_change":"2023-09-30T22:27:24.989557+0000","last_active":"2023-09-30T22:27:24.994305+0000","last_peered":"2023-09-30T22:27:24.994305+0000","last_clean":"2023-09-30T22:27:24.994305+0000","last_became_active":"2023-09-30T22:27:24.989108+0000","last_became_peered":"2023-09-30T22:27:24.989108+0000","last_unstale":"2023-09-30T22:27:24.994305+0000","last_undegraded":"2023-09-30T22:27:24.994305+0000","last_fullsized":"2023-09-30T22:27:24.994305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979332+0000","last_change":"2023-09-30T22:26:34.450051+0000","last_active":"2023-09-30T22:27:24.979332+0000","last_peered":"2023-09-30T22:27:24.979332+0000","last_clean":"2023-09-30T22:27:24.979332+0000","last_became_active":"2023-09-30T22:26:34.449264+0000","last_became_peered":"2023-09-30T22:26:34.449264+0000","last_unstale":"2023-09-30T22:27:24.979332+0000","last_undegraded":"2023-09-30T22:27:24.979332+0000","last_fullsized":"2023-09-30T22:27:24.979332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.978932+0000","last_change":"2023-09-30T22:26:34.463260+0000","last_active":"2023-09-30T22:27:24.978932+0000","last_peered":"2023-09-30T22:27:24.978932+0000","last_clean":"2023-09-30T22:27:24.978932+0000","last_became_active":"2023-09-30T22:26:34.462981+0000","last_became_peered":"2023-09-30T22:26:34.462981+0000","last_unstale":"2023-09-30T22:27:24.978932+0000","last_undegraded":"2023-09-30T22:27:24.978932+0000","last_fullsized":"2023-09-30T22:27:24.978932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984364+0000","last_change":"2023-09-30T22:26:34.451111+0000","last_active":"2023-09-30T22:27:24.984364+0000","last_peered":"2023-09-30T22:27:24.984364+0000","last_clean":"2023-09-30T22:27:24.984364+0000","last_became_active":"2023-09-30T22:26:34.450521+0000","last_became_peered":"2023-09-30T22:26:34.450521+0000","last_unstale":"2023-09-30T22:27:24.984364+0000","last_undegraded":"2023-09-30T22:27:24.984364+0000","last_fullsized":"2023-09-30T22:27:24.984364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.982013+0000","last_change":"2023-09-30T22:26:34.454512+0000","last_active":"2023-09-30T22:27:24.982013+0000","last_peered":"2023-09-30T22:27:24.982013+0000","last_clean":"2023-09-30T22:27:24.982013+0000","last_became_active":"2023-09-30T22:26:34.454222+0000","last_became_peered":"2023-09-30T22:26:34.454222+0000","last_unstale":"2023-09-30T22:27:24.982013+0000","last_undegraded":"2023-09-30T22:27:24.982013+0000","last_fullsized":"2023-09-30T22:27:24.982013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981333+0000","last_change":"2023-09-30T22:26:34.454698+0000","last_active":"2023-09-30T22:27:24.981333+0000","last_peered":"2023-09-30T22:27:24.981333+0000","last_clean":"2023-09-30T22:27:24.981333+0000","last_became_active":"2023-09-30T22:26:34.454060+0000","last_became_peered":"2023-09-30T22:26:34.454060+0000","last_unstale":"2023-09-30T22:27:24.981333+0000","last_undegraded":"2023-09-30T22:27:24.981333+0000","last_fullsized":"2023-09-30T22:27:24.981333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984598+0000","last_change":"2023-09-30T22:26:34.447740+0000","last_active":"2023-09-30T22:27:24.984598+0000","last_peered":"2023-09-30T22:27:24.984598+0000","last_clean":"2023-09-30T22:27:24.984598+0000","last_became_active":"2023-09-30T22:26:34.447444+0000","last_became_peered":"2023-09-30T22:26:34.447444+0000","last_unstale":"2023-09-30T22:27:24.984598+0000","last_undegraded":"2023-09-30T22:27:24.984598+0000","last_fullsized":"2023-09-30T22:27:24.984598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984599+0000","last_change":"2023-09-30T22:26:34.454342+0000","last_active":"2023-09-30T22:27:24.984599+0000","last_peered":"2023-09-30T22:27:24.984599+0000","last_clean":"2023-09-30T22:27:24.984599+0000","last_became_active":"2023-09-30T22:26:34.454063+0000","last_became_peered":"2023-09-30T22:26:34.454063+0000","last_unstale":"2023-09-30T22:27:24.984599+0000","last_undegraded":"2023-09-30T22:27:24.984599+0000","last_fullsized":"2023-09-30T22:27:24.984599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980794+0000","last_change":"2023-09-30T22:26:34.450497+0000","last_active":"2023-09-30T22:27:24.980794+0000","last_peered":"2023-09-30T22:27:24.980794+0000","last_clean":"2023-09-30T22:27:24.980794+0000","last_became_active":"2023-09-30T22:26:34.444267+0000","last_became_peered":"2023-09-30T22:26:34.444267+0000","last_unstale":"2023-09-30T22:27:24.980794+0000","last_undegraded":"2023-09-30T22:27:24.980794+0000","last_fullsized":"2023-09-30T22:27:24.980794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983554+0000","last_change":"2023-09-30T22:26:34.455898+0000","last_active":"2023-09-30T22:27:24.983554+0000","last_peered":"2023-09-30T22:27:24.983554+0000","last_clean":"2023-09-30T22:27:24.983554+0000","last_became_active":"2023-09-30T22:26:34.455631+0000","last_became_peered":"2023-09-30T22:26:34.455631+0000","last_unstale":"2023-09-30T22:27:24.983554+0000","last_undegraded":"2023-09-30T22:27:24.983554+0000","last_fullsized":"2023-09-30T22:27:24.983554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.978710+0000","last_change":"2023-09-30T22:26:34.447910+0000","last_active":"2023-09-30T22:27:24.978710+0000","last_peered":"2023-09-30T22:27:24.978710+0000","last_clean":"2023-09-30T22:27:24.978710+0000","last_became_active":"2023-09-30T22:26:34.447627+0000","last_became_peered":"2023-09-30T22:26:34.447627+0000","last_unstale":"2023-09-30T22:27:24.978710+0000","last_undegraded":"2023-09-30T22:27:24.978710+0000","last_fullsized":"2023-09-30T22:27:24.978710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984273+0000","last_change":"2023-09-30T22:26:34.451250+0000","last_active":"2023-09-30T22:27:24.984273+0000","last_peered":"2023-09-30T22:27:24.984273+0000","last_clean":"2023-09-30T22:27:24.984273+0000","last_became_active":"2023-09-30T22:26:34.450879+0000","last_became_peered":"2023-09-30T22:26:34.450879+0000","last_unstale":"2023-09-30T22:27:24.984273+0000","last_undegraded":"2023-09-30T22:27:24.984273+0000","last_fullsized":"2023-09-30T22:27:24.984273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984227+0000","last_change":"2023-09-30T22:26:34.440788+0000","last_active":"2023-09-30T22:27:24.984227+0000","last_peered":"2023-09-30T22:27:24.984227+0000","last_clean":"2023-09-30T22:27:24.984227+0000","last_became_active":"2023-09-30T22:26:34.440404+0000","last_became_peered":"2023-09-30T22:26:34.440404+0000","last_unstale":"2023-09-30T22:27:24.984227+0000","last_undegraded":"2023-09-30T22:27:24.984227+0000","last_fullsized":"2023-09-30T22:27:24.984227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983358+0000","last_change":"2023-09-30T22:26:34.445791+0000","last_active":"2023-09-30T22:27:24.983358+0000","last_peered":"2023-09-30T22:27:24.983358+0000","last_clean":"2023-09-30T22:27:24.983358+0000","last_became_active":"2023-09-30T22:26:34.445478+0000","last_became_peered":"2023-09-30T22:26:34.445478+0000","last_unstale":"2023-09-30T22:27:24.983358+0000","last_undegraded":"2023-09-30T22:27:24.983358+0000","last_fullsized":"2023-09-30T22:27:24.983358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981165+0000","last_change":"2023-09-30T22:26:34.453484+0000","last_active":"2023-09-30T22:27:24.981165+0000","last_peered":"2023-09-30T22:27:24.981165+0000","last_clean":"2023-09-30T22:27:24.981165+0000","last_became_active":"2023-09-30T22:26:34.453179+0000","last_became_peered":"2023-09-30T22:26:34.453179+0000","last_unstale":"2023-09-30T22:27:24.981165+0000","last_undegraded":"2023-09-30T22:27:24.981165+0000","last_fullsized":"2023-09-30T22:27:24.981165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980446+0000","last_change":"2023-09-30T22:26:34.457382+0000","last_active":"2023-09-30T22:27:24.980446+0000","last_peered":"2023-09-30T22:27:24.980446+0000","last_clean":"2023-09-30T22:27:24.980446+0000","last_became_active":"2023-09-30T22:26:34.457077+0000","last_became_peered":"2023-09-30T22:26:34.457077+0000","last_unstale":"2023-09-30T22:27:24.980446+0000","last_undegraded":"2023-09-30T22:27:24.980446+0000","last_fullsized":"2023-09-30T22:27:24.980446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984680+0000","last_change":"2023-09-30T22:26:34.465060+0000","last_active":"2023-09-30T22:27:24.984680+0000","last_peered":"2023-09-30T22:27:24.984680+0000","last_clean":"2023-09-30T22:27:24.984680+0000","last_became_active":"2023-09-30T22:26:34.464780+0000","last_became_peered":"2023-09-30T22:26:34.464780+0000","last_unstale":"2023-09-30T22:27:24.984680+0000","last_undegraded":"2023-09-30T22:27:24.984680+0000","last_fullsized":"2023-09-30T22:27:24.984680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979246+0000","last_change":"2023-09-30T22:26:34.449871+0000","last_active":"2023-09-30T22:27:24.979246+0000","last_peered":"2023-09-30T22:27:24.979246+0000","last_clean":"2023-09-30T22:27:24.979246+0000","last_became_active":"2023-09-30T22:26:34.448901+0000","last_became_peered":"2023-09-30T22:26:34.448901+0000","last_unstale":"2023-09-30T22:27:24.979246+0000","last_undegraded":"2023-09-30T22:27:24.979246+0000","last_fullsized":"2023-09-30T22:27:24.979246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979014+0000","last_change":"2023-09-30T22:26:34.463255+0000","last_active":"2023-09-30T22:27:24.979014+0000","last_peered":"2023-09-30T22:27:24.979014+0000","last_clean":"2023-09-30T22:27:24.979014+0000","last_became_active":"2023-09-30T22:26:34.462962+0000","last_became_peered":"2023-09-30T22:26:34.462962+0000","last_unstale":"2023-09-30T22:27:24.979014+0000","last_undegraded":"2023-09-30T22:27:24.979014+0000","last_fullsized":"2023-09-30T22:27:24.979014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981347+0000","last_change":"2023-09-30T22:26:34.458476+0000","last_active":"2023-09-30T22:27:24.981347+0000","last_peered":"2023-09-30T22:27:24.981347+0000","last_clean":"2023-09-30T22:27:24.981347+0000","last_became_active":"2023-09-30T22:26:34.458195+0000","last_became_peered":"2023-09-30T22:26:34.458195+0000","last_unstale":"2023-09-30T22:27:24.981347+0000","last_undegraded":"2023-09-30T22:27:24.981347+0000","last_fullsized":"2023-09-30T22:27:24.981347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981930+0000","last_change":"2023-09-30T22:26:34.441003+0000","last_active":"2023-09-30T22:27:24.981930+0000","last_peered":"2023-09-30T22:27:24.981930+0000","last_clean":"2023-09-30T22:27:24.981930+0000","last_became_active":"2023-09-30T22:26:34.440470+0000","last_became_peered":"2023-09-30T22:26:34.440470+0000","last_unstale":"2023-09-30T22:27:24.981930+0000","last_undegraded":"2023-09-30T22:27:24.981930+0000","last_fullsized":"2023-09-30T22:27:24.981930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981358+0000","last_change":"2023-09-30T22:26:34.448801+0000","last_active":"2023-09-30T22:27:24.981358+0000","last_peered":"2023-09-30T22:27:24.981358+0000","last_clean":"2023-09-30T22:27:24.981358+0000","last_became_active":"2023-09-30T22:26:34.448176+0000","last_became_peered":"2023-09-30T22:26:34.448176+0000","last_unstale":"2023-09-30T22:27:24.981358+0000","last_undegraded":"2023-09-30T22:27:24.981358+0000","last_fullsized":"2023-09-30T22:27:24.981358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980416+0000","last_change":"2023-09-30T22:26:34.031319+0000","last_active":"2023-09-30T22:27:24.980416+0000","last_peered":"2023-09-30T22:27:24.980416+0000","last_clean":"2023-09-30T22:27:24.980416+0000","last_became_active":"2023-09-30T22:26:34.030475+0000","last_became_peered":"2023-09-30T22:26:34.030475+0000","last_unstale":"2023-09-30T22:27:24.980416+0000","last_undegraded":"2023-09-30T22:27:24.980416+0000","last_fullsized":"2023-09-30T22:27:24.980416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981451+0000","last_change":"2023-09-30T22:26:34.459834+0000","last_active":"2023-09-30T22:27:24.981451+0000","last_peered":"2023-09-30T22:27:24.981451+0000","last_clean":"2023-09-30T22:27:24.981451+0000","last_became_active":"2023-09-30T22:26:34.459291+0000","last_became_peered":"2023-09-30T22:26:34.459291+0000","last_unstale":"2023-09-30T22:27:24.981451+0000","last_undegraded":"2023-09-30T22:27:24.981451+0000","last_fullsized":"2023-09-30T22:27:24.981451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980690+0000","last_change":"2023-09-30T22:26:34.036944+0000","last_active":"2023-09-30T22:27:24.980690+0000","last_peered":"2023-09-30T22:27:24.980690+0000","last_clean":"2023-09-30T22:27:24.980690+0000","last_became_active":"2023-09-30T22:26:34.036564+0000","last_became_peered":"2023-09-30T22:26:34.036564+0000","last_unstale":"2023-09-30T22:27:24.980690+0000","last_undegraded":"2023-09-30T22:27:24.980690+0000","last_fullsized":"2023-09-30T22:27:24.980690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983972+0000","last_change":"2023-09-30T22:26:34.464712+0000","last_active":"2023-09-30T22:27:24.983972+0000","last_peered":"2023-09-30T22:27:24.983972+0000","last_clean":"2023-09-30T22:27:24.983972+0000","last_became_active":"2023-09-30T22:26:34.464032+0000","last_became_peered":"2023-09-30T22:26:34.464032+0000","last_unstale":"2023-09-30T22:27:24.983972+0000","last_undegraded":"2023-09-30T22:27:24.983972+0000","last_fullsized":"2023-09-30T22:27:24.983972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980092+0000","last_change":"2023-09-30T22:26:34.041116+0000","last_active":"2023-09-30T22:27:24.980092+0000","last_peered":"2023-09-30T22:27:24.980092+0000","last_clean":"2023-09-30T22:27:24.980092+0000","last_became_active":"2023-09-30T22:26:34.040484+0000","last_became_peered":"2023-09-30T22:26:34.040484+0000","last_unstale":"2023-09-30T22:27:24.980092+0000","last_undegraded":"2023-09-30T22:27:24.980092+0000","last_fullsized":"2023-09-30T22:27:24.980092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981767+0000","last_change":"2023-09-30T22:26:34.461558+0000","last_active":"2023-09-30T22:27:24.981767+0000","last_peered":"2023-09-30T22:27:24.981767+0000","last_clean":"2023-09-30T22:27:24.981767+0000","last_became_active":"2023-09-30T22:26:34.461274+0000","last_became_peered":"2023-09-30T22:26:34.461274+0000","last_unstale":"2023-09-30T22:27:24.981767+0000","last_undegraded":"2023-09-30T22:27:24.981767+0000","last_fullsized":"2023-09-30T22:27:24.981767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984090+0000","last_change":"2023-09-30T22:26:34.026179+0000","last_active":"2023-09-30T22:27:24.984090+0000","last_peered":"2023-09-30T22:27:24.984090+0000","last_clean":"2023-09-30T22:27:24.984090+0000","last_became_active":"2023-09-30T22:26:34.025896+0000","last_became_peered":"2023-09-30T22:26:34.025896+0000","last_unstale":"2023-09-30T22:27:24.984090+0000","last_undegraded":"2023-09-30T22:27:24.984090+0000","last_fullsized":"2023-09-30T22:27:24.984090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980116+0000","last_change":"2023-09-30T22:26:34.461868+0000","last_active":"2023-09-30T22:27:24.980116+0000","last_peered":"2023-09-30T22:27:24.980116+0000","last_clean":"2023-09-30T22:27:24.980116+0000","last_became_active":"2023-09-30T22:26:34.458462+0000","last_became_peered":"2023-09-30T22:26:34.458462+0000","last_unstale":"2023-09-30T22:27:24.980116+0000","last_undegraded":"2023-09-30T22:27:24.980116+0000","last_fullsized":"2023-09-30T22:27:24.980116+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.982757+0000","last_change":"2023-09-30T22:26:34.034800+0000","last_active":"2023-09-30T22:27:24.982757+0000","last_peered":"2023-09-30T22:27:24.982757+0000","last_clean":"2023-09-30T22:27:24.982757+0000","last_became_active":"2023-09-30T22:26:34.034161+0000","last_became_peered":"2023-09-30T22:26:34.034161+0000","last_unstale":"2023-09-30T22:27:24.982757+0000","last_undegraded":"2023-09-30T22:27:24.982757+0000","last_fullsized":"2023-09-30T22:27:24.982757+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.997594+0000","last_change":"2023-09-30T22:27:24.994351+0000","last_active":"2023-09-30T22:27:24.997594+0000","last_peered":"2023-09-30T22:27:24.997594+0000","last_clean":"2023-09-30T22:27:24.997594+0000","last_became_active":"2023-09-30T22:27:24.994020+0000","last_became_peered":"2023-09-30T22:27:24.994020+0000","last_unstale":"2023-09-30T22:27:24.997594+0000","last_undegraded":"2023-09-30T22:27:24.997594+0000","last_fullsized":"2023-09-30T22:27:24.997594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984568+0000","last_change":"2023-09-30T22:26:34.037459+0000","last_active":"2023-09-30T22:27:24.984568+0000","last_peered":"2023-09-30T22:27:24.984568+0000","last_clean":"2023-09-30T22:27:24.984568+0000","last_became_active":"2023-09-30T22:26:34.037268+0000","last_became_peered":"2023-09-30T22:26:34.037268+0000","last_unstale":"2023-09-30T22:27:24.984568+0000","last_undegraded":"2023-09-30T22:27:24.984568+0000","last_fullsized":"2023-09-30T22:27:24.984568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.988564+0000","last_change":"2023-09-30T22:27:24.985586+0000","last_active":"2023-09-30T22:27:24.988564+0000","last_peered":"2023-09-30T22:27:24.988564+0000","last_clean":"2023-09-30T22:27:24.988564+0000","last_became_active":"2023-09-30T22:27:24.985256+0000","last_became_peered":"2023-09-30T22:27:24.985256+0000","last_unstale":"2023-09-30T22:27:24.988564+0000","last_undegraded":"2023-09-30T22:27:24.988564+0000","last_fullsized":"2023-09-30T22:27:24.988564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"22'12","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:28:59.639382+0000","last_change":"2023-09-30T22:26:34.040307+0000","last_active":"2023-09-30T22:28:59.639382+0000","last_peered":"2023-09-30T22:28:59.639382+0000","last_clean":"2023-09-30T22:28:59.639382+0000","last_became_active":"2023-09-30T22:26:34.040017+0000","last_became_peered":"2023-09-30T22:26:34.040017+0000","last_unstale":"2023-09-30T22:28:59.639382+0000","last_undegraded":"2023-09-30T22:28:59.639382+0000","last_fullsized":"2023-09-30T22:28:59.639382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.997290+0000","last_change":"2023-09-30T22:27:24.991943+0000","last_active":"2023-09-30T22:27:24.997290+0000","last_peered":"2023-09-30T22:27:24.997290+0000","last_clean":"2023-09-30T22:27:24.997290+0000","last_became_active":"2023-09-30T22:27:24.991604+0000","last_became_peered":"2023-09-30T22:27:24.991604+0000","last_unstale":"2023-09-30T22:27:24.997290+0000","last_undegraded":"2023-09-30T22:27:24.997290+0000","last_fullsized":"2023-09-30T22:27:24.997290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984140+0000","last_change":"2023-09-30T22:26:34.042269+0000","last_active":"2023-09-30T22:27:24.984140+0000","last_peered":"2023-09-30T22:27:24.984140+0000","last_clean":"2023-09-30T22:27:24.984140+0000","last_became_active":"2023-09-30T22:26:34.040124+0000","last_became_peered":"2023-09-30T22:26:34.040124+0000","last_unstale":"2023-09-30T22:27:24.984140+0000","last_undegraded":"2023-09-30T22:27:24.984140+0000","last_fullsized":"2023-09-30T22:27:24.984140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979418+0000","last_change":"2023-09-30T22:26:34.459725+0000","last_active":"2023-09-30T22:27:24.979418+0000","last_peered":"2023-09-30T22:27:24.979418+0000","last_clean":"2023-09-30T22:27:24.979418+0000","last_became_active":"2023-09-30T22:26:34.459414+0000","last_became_peered":"2023-09-30T22:26:34.459414+0000","last_unstale":"2023-09-30T22:27:24.979418+0000","last_undegraded":"2023-09-30T22:27:24.979418+0000","last_fullsized":"2023-09-30T22:27:24.979418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984793+0000","last_change":"2023-09-30T22:26:34.024931+0000","last_active":"2023-09-30T22:27:24.984793+0000","last_peered":"2023-09-30T22:27:24.984793+0000","last_clean":"2023-09-30T22:27:24.984793+0000","last_became_active":"2023-09-30T22:26:34.024616+0000","last_became_peered":"2023-09-30T22:26:34.024616+0000","last_unstale":"2023-09-30T22:27:24.984793+0000","last_undegraded":"2023-09-30T22:27:24.984793+0000","last_fullsized":"2023-09-30T22:27:24.984793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.997197+0000","last_change":"2023-09-30T22:27:24.992034+0000","last_active":"2023-09-30T22:27:24.997197+0000","last_peered":"2023-09-30T22:27:24.997197+0000","last_clean":"2023-09-30T22:27:24.997197+0000","last_became_active":"2023-09-30T22:27:24.991718+0000","last_became_peered":"2023-09-30T22:27:24.991718+0000","last_unstale":"2023-09-30T22:27:24.997197+0000","last_undegraded":"2023-09-30T22:27:24.997197+0000","last_fullsized":"2023-09-30T22:27:24.997197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979750+0000","last_change":"2023-09-30T22:26:34.040402+0000","last_active":"2023-09-30T22:27:24.979750+0000","last_peered":"2023-09-30T22:27:24.979750+0000","last_clean":"2023-09-30T22:27:24.979750+0000","last_became_active":"2023-09-30T22:26:34.039702+0000","last_became_peered":"2023-09-30T22:26:34.039702+0000","last_unstale":"2023-09-30T22:27:24.979750+0000","last_undegraded":"2023-09-30T22:27:24.979750+0000","last_fullsized":"2023-09-30T22:27:24.979750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984059+0000","last_change":"2023-09-30T22:26:34.450058+0000","last_active":"2023-09-30T22:27:24.984059+0000","last_peered":"2023-09-30T22:27:24.984059+0000","last_clean":"2023-09-30T22:27:24.984059+0000","last_became_active":"2023-09-30T22:26:34.449698+0000","last_became_peered":"2023-09-30T22:26:34.449698+0000","last_unstale":"2023-09-30T22:27:24.984059+0000","last_undegraded":"2023-09-30T22:27:24.984059+0000","last_fullsized":"2023-09-30T22:27:24.984059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979452+0000","last_change":"2023-09-30T22:26:34.041826+0000","last_active":"2023-09-30T22:27:24.979452+0000","last_peered":"2023-09-30T22:27:24.979452+0000","last_clean":"2023-09-30T22:27:24.979452+0000","last_became_active":"2023-09-30T22:26:34.041527+0000","last_became_peered":"2023-09-30T22:26:34.041527+0000","last_unstale":"2023-09-30T22:27:24.979452+0000","last_undegraded":"2023-09-30T22:27:24.979452+0000","last_fullsized":"2023-09-30T22:27:24.979452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981723+0000","last_change":"2023-09-30T22:26:34.461435+0000","last_active":"2023-09-30T22:27:24.981723+0000","last_peered":"2023-09-30T22:27:24.981723+0000","last_clean":"2023-09-30T22:27:24.981723+0000","last_became_active":"2023-09-30T22:26:34.461089+0000","last_became_peered":"2023-09-30T22:26:34.461089+0000","last_unstale":"2023-09-30T22:27:24.981723+0000","last_undegraded":"2023-09-30T22:27:24.981723+0000","last_fullsized":"2023-09-30T22:27:24.981723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983908+0000","last_change":"2023-09-30T22:26:34.030071+0000","last_active":"2023-09-30T22:27:24.983908+0000","last_peered":"2023-09-30T22:27:24.983908+0000","last_clean":"2023-09-30T22:27:24.983908+0000","last_became_active":"2023-09-30T22:26:34.029419+0000","last_became_peered":"2023-09-30T22:26:34.029419+0000","last_unstale":"2023-09-30T22:27:24.983908+0000","last_undegraded":"2023-09-30T22:27:24.983908+0000","last_fullsized":"2023-09-30T22:27:24.983908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.997466+0000","last_change":"2023-09-30T22:27:24.994305+0000","last_active":"2023-09-30T22:27:24.997466+0000","last_peered":"2023-09-30T22:27:24.997466+0000","last_clean":"2023-09-30T22:27:24.997466+0000","last_became_active":"2023-09-30T22:27:24.994040+0000","last_became_peered":"2023-09-30T22:27:24.994040+0000","last_unstale":"2023-09-30T22:27:24.997466+0000","last_undegraded":"2023-09-30T22:27:24.997466+0000","last_fullsized":"2023-09-30T22:27:24.997466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.985431+0000","last_change":"2023-09-30T22:26:34.024286+0000","last_active":"2023-09-30T22:27:24.985431+0000","last_peered":"2023-09-30T22:27:24.985431+0000","last_clean":"2023-09-30T22:27:24.985431+0000","last_became_active":"2023-09-30T22:26:34.022989+0000","last_became_peered":"2023-09-30T22:26:34.022989+0000","last_unstale":"2023-09-30T22:27:24.985431+0000","last_undegraded":"2023-09-30T22:27:24.985431+0000","last_fullsized":"2023-09-30T22:27:24.985431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980772+0000","last_change":"2023-09-30T22:26:34.453594+0000","last_active":"2023-09-30T22:27:24.980772+0000","last_peered":"2023-09-30T22:27:24.980772+0000","last_clean":"2023-09-30T22:27:24.980772+0000","last_became_active":"2023-09-30T22:26:34.453288+0000","last_became_peered":"2023-09-30T22:26:34.453288+0000","last_unstale":"2023-09-30T22:27:24.980772+0000","last_undegraded":"2023-09-30T22:27:24.980772+0000","last_fullsized":"2023-09-30T22:27:24.980772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981734+0000","last_change":"2023-09-30T22:26:34.042026+0000","last_active":"2023-09-30T22:27:24.981734+0000","last_peered":"2023-09-30T22:27:24.981734+0000","last_clean":"2023-09-30T22:27:24.981734+0000","last_became_active":"2023-09-30T22:26:34.041309+0000","last_became_peered":"2023-09-30T22:26:34.041309+0000","last_unstale":"2023-09-30T22:27:24.981734+0000","last_undegraded":"2023-09-30T22:27:24.981734+0000","last_fullsized":"2023-09-30T22:27:24.981734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983524+0000","last_change":"2023-09-30T22:26:34.448356+0000","last_active":"2023-09-30T22:27:24.983524+0000","last_peered":"2023-09-30T22:27:24.983524+0000","last_clean":"2023-09-30T22:27:24.983524+0000","last_became_active":"2023-09-30T22:26:34.447744+0000","last_became_peered":"2023-09-30T22:26:34.447744+0000","last_unstale":"2023-09-30T22:27:24.983524+0000","last_undegraded":"2023-09-30T22:27:24.983524+0000","last_fullsized":"2023-09-30T22:27:24.983524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983249+0000","last_change":"2023-09-30T22:26:34.025526+0000","last_active":"2023-09-30T22:27:24.983249+0000","last_peered":"2023-09-30T22:27:24.983249+0000","last_clean":"2023-09-30T22:27:24.983249+0000","last_became_active":"2023-09-30T22:26:34.025214+0000","last_became_peered":"2023-09-30T22:26:34.025214+0000","last_unstale":"2023-09-30T22:27:24.983249+0000","last_undegraded":"2023-09-30T22:27:24.983249+0000","last_fullsized":"2023-09-30T22:27:24.983249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983508+0000","last_change":"2023-09-30T22:26:34.457634+0000","last_active":"2023-09-30T22:27:24.983508+0000","last_peered":"2023-09-30T22:27:24.983508+0000","last_clean":"2023-09-30T22:27:24.983508+0000","last_became_active":"2023-09-30T22:26:34.457314+0000","last_became_peered":"2023-09-30T22:26:34.457314+0000","last_unstale":"2023-09-30T22:27:24.983508+0000","last_undegraded":"2023-09-30T22:27:24.983508+0000","last_fullsized":"2023-09-30T22:27:24.983508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983916+0000","last_change":"2023-09-30T22:26:34.042476+0000","last_active":"2023-09-30T22:27:24.983916+0000","last_peered":"2023-09-30T22:27:24.983916+0000","last_clean":"2023-09-30T22:27:24.983916+0000","last_became_active":"2023-09-30T22:26:34.040552+0000","last_became_peered":"2023-09-30T22:26:34.040552+0000","last_unstale":"2023-09-30T22:27:24.983916+0000","last_undegraded":"2023-09-30T22:27:24.983916+0000","last_fullsized":"2023-09-30T22:27:24.983916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983220+0000","last_change":"2023-09-30T22:26:34.451427+0000","last_active":"2023-09-30T22:27:24.983220+0000","last_peered":"2023-09-30T22:27:24.983220+0000","last_clean":"2023-09-30T22:27:24.983220+0000","last_became_active":"2023-09-30T22:26:34.451149+0000","last_became_peered":"2023-09-30T22:26:34.451149+0000","last_unstale":"2023-09-30T22:27:24.983220+0000","last_undegraded":"2023-09-30T22:27:24.983220+0000","last_fullsized":"2023-09-30T22:27:24.983220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980162+0000","last_change":"2023-09-30T22:26:34.039863+0000","last_active":"2023-09-30T22:27:24.980162+0000","last_peered":"2023-09-30T22:27:24.980162+0000","last_clean":"2023-09-30T22:27:24.980162+0000","last_became_active":"2023-09-30T22:26:34.039536+0000","last_became_peered":"2023-09-30T22:26:34.039536+0000","last_unstale":"2023-09-30T22:27:24.980162+0000","last_undegraded":"2023-09-30T22:27:24.980162+0000","last_fullsized":"2023-09-30T22:27:24.980162+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981635+0000","last_change":"2023-09-30T22:26:34.459623+0000","last_active":"2023-09-30T22:27:24.981635+0000","last_peered":"2023-09-30T22:27:24.981635+0000","last_clean":"2023-09-30T22:27:24.981635+0000","last_became_active":"2023-09-30T22:26:34.457887+0000","last_became_peered":"2023-09-30T22:26:34.457887+0000","last_unstale":"2023-09-30T22:27:24.981635+0000","last_undegraded":"2023-09-30T22:27:24.981635+0000","last_fullsized":"2023-09-30T22:27:24.981635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979419+0000","last_change":"2023-09-30T22:26:34.040793+0000","last_active":"2023-09-30T22:27:24.979419+0000","last_peered":"2023-09-30T22:27:24.979419+0000","last_clean":"2023-09-30T22:27:24.979419+0000","last_became_active":"2023-09-30T22:26:34.040437+0000","last_became_peered":"2023-09-30T22:26:34.040437+0000","last_unstale":"2023-09-30T22:27:24.979419+0000","last_undegraded":"2023-09-30T22:27:24.979419+0000","last_fullsized":"2023-09-30T22:27:24.979419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.985624+0000","last_change":"2023-09-30T22:26:34.446474+0000","last_active":"2023-09-30T22:27:24.985624+0000","last_peered":"2023-09-30T22:27:24.985624+0000","last_clean":"2023-09-30T22:27:24.985624+0000","last_became_active":"2023-09-30T22:26:34.445499+0000","last_became_peered":"2023-09-30T22:26:34.445499+0000","last_unstale":"2023-09-30T22:27:24.985624+0000","last_undegraded":"2023-09-30T22:27:24.985624+0000","last_fullsized":"2023-09-30T22:27:24.985624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979676+0000","last_change":"2023-09-30T22:26:34.040910+0000","last_active":"2023-09-30T22:27:24.979676+0000","last_peered":"2023-09-30T22:27:24.979676+0000","last_clean":"2023-09-30T22:27:24.979676+0000","last_became_active":"2023-09-30T22:26:34.040077+0000","last_became_peered":"2023-09-30T22:26:34.040077+0000","last_unstale":"2023-09-30T22:27:24.979676+0000","last_undegraded":"2023-09-30T22:27:24.979676+0000","last_fullsized":"2023-09-30T22:27:24.979676+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981505+0000","last_change":"2023-09-30T22:26:34.466480+0000","last_active":"2023-09-30T22:27:24.981505+0000","last_peered":"2023-09-30T22:27:24.981505+0000","last_clean":"2023-09-30T22:27:24.981505+0000","last_became_active":"2023-09-30T22:26:34.466187+0000","last_became_peered":"2023-09-30T22:26:34.466187+0000","last_unstale":"2023-09-30T22:27:24.981505+0000","last_undegraded":"2023-09-30T22:27:24.981505+0000","last_fullsized":"2023-09-30T22:27:24.981505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981099+0000","last_change":"2023-09-30T22:26:30.873307+0000","last_active":"2023-09-30T22:27:24.981099+0000","last_peered":"2023-09-30T22:27:24.981099+0000","last_clean":"2023-09-30T22:27:24.981099+0000","last_became_active":"2023-09-30T22:26:30.872872+0000","last_became_peered":"2023-09-30T22:26:30.872872+0000","last_unstale":"2023-09-30T22:27:24.981099+0000","last_undegraded":"2023-09-30T22:27:24.981099+0000","last_fullsized":"2023-09-30T22:27:24.981099+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983226+0000","last_change":"2023-09-30T22:26:34.037332+0000","last_active":"2023-09-30T22:27:24.983226+0000","last_peered":"2023-09-30T22:27:24.983226+0000","last_clean":"2023-09-30T22:27:24.983226+0000","last_became_active":"2023-09-30T22:26:34.037114+0000","last_became_peered":"2023-09-30T22:26:34.037114+0000","last_unstale":"2023-09-30T22:27:24.983226+0000","last_undegraded":"2023-09-30T22:27:24.983226+0000","last_fullsized":"2023-09-30T22:27:24.983226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980572+0000","last_change":"2023-09-30T22:26:34.462485+0000","last_active":"2023-09-30T22:27:24.980572+0000","last_peered":"2023-09-30T22:27:24.980572+0000","last_clean":"2023-09-30T22:27:24.980572+0000","last_became_active":"2023-09-30T22:26:34.454284+0000","last_became_peered":"2023-09-30T22:26:34.454284+0000","last_unstale":"2023-09-30T22:27:24.980572+0000","last_undegraded":"2023-09-30T22:27:24.980572+0000","last_fullsized":"2023-09-30T22:27:24.980572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981501+0000","last_change":"2023-09-30T22:26:29.861644+0000","last_active":"2023-09-30T22:27:24.981501+0000","last_peered":"2023-09-30T22:27:24.981501+0000","last_clean":"2023-09-30T22:27:24.981501+0000","last_became_active":"2023-09-30T22:26:29.861261+0000","last_became_peered":"2023-09-30T22:26:29.861261+0000","last_unstale":"2023-09-30T22:27:24.981501+0000","last_undegraded":"2023-09-30T22:27:24.981501+0000","last_fullsized":"2023-09-30T22:27:24.981501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983126+0000","last_change":"2023-09-30T22:26:34.024242+0000","last_active":"2023-09-30T22:27:24.983126+0000","last_peered":"2023-09-30T22:27:24.983126+0000","last_clean":"2023-09-30T22:27:24.983126+0000","last_became_active":"2023-09-30T22:26:34.023935+0000","last_became_peered":"2023-09-30T22:26:34.023935+0000","last_unstale":"2023-09-30T22:27:24.983126+0000","last_undegraded":"2023-09-30T22:27:24.983126+0000","last_fullsized":"2023-09-30T22:27:24.983126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980983+0000","last_change":"2023-09-30T22:26:34.444993+0000","last_active":"2023-09-30T22:27:24.980983+0000","last_peered":"2023-09-30T22:27:24.980983+0000","last_clean":"2023-09-30T22:27:24.980983+0000","last_became_active":"2023-09-30T22:26:34.444739+0000","last_became_peered":"2023-09-30T22:26:34.444739+0000","last_unstale":"2023-09-30T22:27:24.980983+0000","last_undegraded":"2023-09-30T22:27:24.980983+0000","last_fullsized":"2023-09-30T22:27:24.980983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.985804+0000","last_change":"2023-09-30T22:26:29.858340+0000","last_active":"2023-09-30T22:27:24.985804+0000","last_peered":"2023-09-30T22:27:24.985804+0000","last_clean":"2023-09-30T22:27:24.985804+0000","last_became_active":"2023-09-30T22:26:29.857989+0000","last_became_peered":"2023-09-30T22:26:29.857989+0000","last_unstale":"2023-09-30T22:27:24.985804+0000","last_undegraded":"2023-09-30T22:27:24.985804+0000","last_fullsized":"2023-09-30T22:27:24.985804+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979227+0000","last_change":"2023-09-30T22:26:34.031173+0000","last_active":"2023-09-30T22:27:24.979227+0000","last_peered":"2023-09-30T22:27:24.979227+0000","last_clean":"2023-09-30T22:27:24.979227+0000","last_became_active":"2023-09-30T22:26:34.030863+0000","last_became_peered":"2023-09-30T22:26:34.030863+0000","last_unstale":"2023-09-30T22:27:24.979227+0000","last_undegraded":"2023-09-30T22:27:24.979227+0000","last_fullsized":"2023-09-30T22:27:24.979227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981598+0000","last_change":"2023-09-30T22:26:34.456017+0000","last_active":"2023-09-30T22:27:24.981598+0000","last_peered":"2023-09-30T22:27:24.981598+0000","last_clean":"2023-09-30T22:27:24.981598+0000","last_became_active":"2023-09-30T22:26:34.455744+0000","last_became_peered":"2023-09-30T22:26:34.455744+0000","last_unstale":"2023-09-30T22:27:24.981598+0000","last_undegraded":"2023-09-30T22:27:24.981598+0000","last_fullsized":"2023-09-30T22:27:24.981598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984034+0000","last_change":"2023-09-30T22:26:29.859074+0000","last_active":"2023-09-30T22:27:24.984034+0000","last_peered":"2023-09-30T22:27:24.984034+0000","last_clean":"2023-09-30T22:27:24.984034+0000","last_became_active":"2023-09-30T22:26:29.858669+0000","last_became_peered":"2023-09-30T22:26:29.858669+0000","last_unstale":"2023-09-30T22:27:24.984034+0000","last_undegraded":"2023-09-30T22:27:24.984034+0000","last_fullsized":"2023-09-30T22:27:24.984034+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979090+0000","last_change":"2023-09-30T22:26:28.864097+0000","last_active":"2023-09-30T22:27:24.979090+0000","last_peered":"2023-09-30T22:27:24.979090+0000","last_clean":"2023-09-30T22:27:24.979090+0000","last_became_active":"2023-09-30T22:26:28.863723+0000","last_became_peered":"2023-09-30T22:26:28.863723+0000","last_unstale":"2023-09-30T22:27:24.979090+0000","last_undegraded":"2023-09-30T22:27:24.979090+0000","last_fullsized":"2023-09-30T22:27:24.979090+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:27.842299+0000","last_clean_scrub_stamp":"2023-09-30T22:26:27.842299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980072+0000","last_change":"2023-09-30T22:26:34.040465+0000","last_active":"2023-09-30T22:27:24.980072+0000","last_peered":"2023-09-30T22:27:24.980072+0000","last_clean":"2023-09-30T22:27:24.980072+0000","last_became_active":"2023-09-30T22:26:34.039806+0000","last_became_peered":"2023-09-30T22:26:34.039806+0000","last_unstale":"2023-09-30T22:27:24.980072+0000","last_undegraded":"2023-09-30T22:27:24.980072+0000","last_fullsized":"2023-09-30T22:27:24.980072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981952+0000","last_change":"2023-09-30T22:26:34.459817+0000","last_active":"2023-09-30T22:27:24.981952+0000","last_peered":"2023-09-30T22:27:24.981952+0000","last_clean":"2023-09-30T22:27:24.981952+0000","last_became_active":"2023-09-30T22:26:34.458434+0000","last_became_peered":"2023-09-30T22:26:34.458434+0000","last_unstale":"2023-09-30T22:27:24.981952+0000","last_undegraded":"2023-09-30T22:27:24.981952+0000","last_fullsized":"2023-09-30T22:27:24.981952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979954+0000","last_change":"2023-09-30T22:26:29.861337+0000","last_active":"2023-09-30T22:27:24.979954+0000","last_peered":"2023-09-30T22:27:24.979954+0000","last_clean":"2023-09-30T22:27:24.979954+0000","last_became_active":"2023-09-30T22:26:29.861003+0000","last_became_peered":"2023-09-30T22:26:29.861003+0000","last_unstale":"2023-09-30T22:27:24.979954+0000","last_undegraded":"2023-09-30T22:27:24.979954+0000","last_fullsized":"2023-09-30T22:27:24.979954+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983666+0000","last_change":"2023-09-30T22:26:34.022924+0000","last_active":"2023-09-30T22:27:24.983666+0000","last_peered":"2023-09-30T22:27:24.983666+0000","last_clean":"2023-09-30T22:27:24.983666+0000","last_became_active":"2023-09-30T22:26:34.022592+0000","last_became_peered":"2023-09-30T22:26:34.022592+0000","last_unstale":"2023-09-30T22:27:24.983666+0000","last_undegraded":"2023-09-30T22:27:24.983666+0000","last_fullsized":"2023-09-30T22:27:24.983666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984143+0000","last_change":"2023-09-30T22:26:34.464915+0000","last_active":"2023-09-30T22:27:24.984143+0000","last_peered":"2023-09-30T22:27:24.984143+0000","last_clean":"2023-09-30T22:27:24.984143+0000","last_became_active":"2023-09-30T22:26:34.464406+0000","last_became_peered":"2023-09-30T22:26:34.464406+0000","last_unstale":"2023-09-30T22:27:24.984143+0000","last_undegraded":"2023-09-30T22:27:24.984143+0000","last_fullsized":"2023-09-30T22:27:24.984143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981868+0000","last_change":"2023-09-30T22:26:30.874397+0000","last_active":"2023-09-30T22:27:24.981868+0000","last_peered":"2023-09-30T22:27:24.981868+0000","last_clean":"2023-09-30T22:27:24.981868+0000","last_became_active":"2023-09-30T22:26:30.874057+0000","last_became_peered":"2023-09-30T22:26:30.874057+0000","last_unstale":"2023-09-30T22:27:24.981868+0000","last_undegraded":"2023-09-30T22:27:24.981868+0000","last_fullsized":"2023-09-30T22:27:24.981868+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980917+0000","last_change":"2023-09-30T22:26:34.037126+0000","last_active":"2023-09-30T22:27:24.980917+0000","last_peered":"2023-09-30T22:27:24.980917+0000","last_clean":"2023-09-30T22:27:24.980917+0000","last_became_active":"2023-09-30T22:26:34.036825+0000","last_became_peered":"2023-09-30T22:26:34.036825+0000","last_unstale":"2023-09-30T22:27:24.980917+0000","last_undegraded":"2023-09-30T22:27:24.980917+0000","last_fullsized":"2023-09-30T22:27:24.980917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983316+0000","last_change":"2023-09-30T22:26:34.443381+0000","last_active":"2023-09-30T22:27:24.983316+0000","last_peered":"2023-09-30T22:27:24.983316+0000","last_clean":"2023-09-30T22:27:24.983316+0000","last_became_active":"2023-09-30T22:26:34.443094+0000","last_became_peered":"2023-09-30T22:26:34.443094+0000","last_unstale":"2023-09-30T22:27:24.983316+0000","last_undegraded":"2023-09-30T22:27:24.983316+0000","last_fullsized":"2023-09-30T22:27:24.983316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981546+0000","last_change":"2023-09-30T22:26:34.041060+0000","last_active":"2023-09-30T22:27:24.981546+0000","last_peered":"2023-09-30T22:27:24.981546+0000","last_clean":"2023-09-30T22:27:24.981546+0000","last_became_active":"2023-09-30T22:26:34.040742+0000","last_became_peered":"2023-09-30T22:26:34.040742+0000","last_unstale":"2023-09-30T22:27:24.981546+0000","last_undegraded":"2023-09-30T22:27:24.981546+0000","last_fullsized":"2023-09-30T22:27:24.981546+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981842+0000","last_change":"2023-09-30T22:26:30.873252+0000","last_active":"2023-09-30T22:27:24.981842+0000","last_peered":"2023-09-30T22:27:24.981842+0000","last_clean":"2023-09-30T22:27:24.981842+0000","last_became_active":"2023-09-30T22:26:30.872894+0000","last_became_peered":"2023-09-30T22:26:30.872894+0000","last_unstale":"2023-09-30T22:27:24.981842+0000","last_undegraded":"2023-09-30T22:27:24.981842+0000","last_fullsized":"2023-09-30T22:27:24.981842+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979785+0000","last_change":"2023-09-30T22:26:34.462059+0000","last_active":"2023-09-30T22:27:24.979785+0000","last_peered":"2023-09-30T22:27:24.979785+0000","last_clean":"2023-09-30T22:27:24.979785+0000","last_became_active":"2023-09-30T22:26:34.461415+0000","last_became_peered":"2023-09-30T22:26:34.461415+0000","last_unstale":"2023-09-30T22:27:24.979785+0000","last_undegraded":"2023-09-30T22:27:24.979785+0000","last_fullsized":"2023-09-30T22:27:24.979785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981638+0000","last_change":"2023-09-30T22:26:30.874887+0000","last_active":"2023-09-30T22:27:24.981638+0000","last_peered":"2023-09-30T22:27:24.981638+0000","last_clean":"2023-09-30T22:27:24.981638+0000","last_became_active":"2023-09-30T22:26:30.874533+0000","last_became_peered":"2023-09-30T22:26:30.874533+0000","last_unstale":"2023-09-30T22:27:24.981638+0000","last_undegraded":"2023-09-30T22:27:24.981638+0000","last_fullsized":"2023-09-30T22:27:24.981638+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:28.846610+0000","last_clean_scrub_stamp":"2023-09-30T22:26:28.846610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983659+0000","last_change":"2023-09-30T22:26:34.029291+0000","last_active":"2023-09-30T22:27:24.983659+0000","last_peered":"2023-09-30T22:27:24.983659+0000","last_clean":"2023-09-30T22:27:24.983659+0000","last_became_active":"2023-09-30T22:26:34.028983+0000","last_became_peered":"2023-09-30T22:26:34.028983+0000","last_unstale":"2023-09-30T22:27:24.983659+0000","last_undegraded":"2023-09-30T22:27:24.983659+0000","last_fullsized":"2023-09-30T22:27:24.983659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.985864+0000","last_change":"2023-09-30T22:26:34.453608+0000","last_active":"2023-09-30T22:27:24.985864+0000","last_peered":"2023-09-30T22:27:24.985864+0000","last_clean":"2023-09-30T22:27:24.985864+0000","last_became_active":"2023-09-30T22:26:34.453255+0000","last_became_peered":"2023-09-30T22:26:34.453255+0000","last_unstale":"2023-09-30T22:27:24.985864+0000","last_undegraded":"2023-09-30T22:27:24.985864+0000","last_fullsized":"2023-09-30T22:27:24.985864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983222+0000","last_change":"2023-09-30T22:26:34.026874+0000","last_active":"2023-09-30T22:27:24.983222+0000","last_peered":"2023-09-30T22:27:24.983222+0000","last_clean":"2023-09-30T22:27:24.983222+0000","last_became_active":"2023-09-30T22:26:34.024536+0000","last_became_peered":"2023-09-30T22:26:34.024536+0000","last_unstale":"2023-09-30T22:27:24.983222+0000","last_undegraded":"2023-09-30T22:27:24.983222+0000","last_fullsized":"2023-09-30T22:27:24.983222+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.985543+0000","last_change":"2023-09-30T22:26:34.452982+0000","last_active":"2023-09-30T22:27:24.985543+0000","last_peered":"2023-09-30T22:27:24.985543+0000","last_clean":"2023-09-30T22:27:24.985543+0000","last_became_active":"2023-09-30T22:26:34.452695+0000","last_became_peered":"2023-09-30T22:26:34.452695+0000","last_unstale":"2023-09-30T22:27:24.985543+0000","last_undegraded":"2023-09-30T22:27:24.985543+0000","last_fullsized":"2023-09-30T22:27:24.985543+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981012+0000","last_change":"2023-09-30T22:26:34.045553+0000","last_active":"2023-09-30T22:27:24.981012+0000","last_peered":"2023-09-30T22:27:24.981012+0000","last_clean":"2023-09-30T22:27:24.981012+0000","last_became_active":"2023-09-30T22:26:34.045206+0000","last_became_peered":"2023-09-30T22:26:34.045206+0000","last_unstale":"2023-09-30T22:27:24.981012+0000","last_undegraded":"2023-09-30T22:27:24.981012+0000","last_fullsized":"2023-09-30T22:27:24.981012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984542+0000","last_change":"2023-09-30T22:26:34.454158+0000","last_active":"2023-09-30T22:27:24.984542+0000","last_peered":"2023-09-30T22:27:24.984542+0000","last_clean":"2023-09-30T22:27:24.984542+0000","last_became_active":"2023-09-30T22:26:34.453928+0000","last_became_peered":"2023-09-30T22:26:34.453928+0000","last_unstale":"2023-09-30T22:27:24.984542+0000","last_undegraded":"2023-09-30T22:27:24.984542+0000","last_fullsized":"2023-09-30T22:27:24.984542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.982038+0000","last_change":"2023-09-30T22:26:34.045717+0000","last_active":"2023-09-30T22:27:24.982038+0000","last_peered":"2023-09-30T22:27:24.982038+0000","last_clean":"2023-09-30T22:27:24.982038+0000","last_became_active":"2023-09-30T22:26:34.045395+0000","last_became_peered":"2023-09-30T22:26:34.045395+0000","last_unstale":"2023-09-30T22:27:24.982038+0000","last_undegraded":"2023-09-30T22:27:24.982038+0000","last_fullsized":"2023-09-30T22:27:24.982038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.983427+0000","last_change":"2023-09-30T22:26:34.448542+0000","last_active":"2023-09-30T22:27:24.983427+0000","last_peered":"2023-09-30T22:27:24.983427+0000","last_clean":"2023-09-30T22:27:24.983427+0000","last_became_active":"2023-09-30T22:26:34.448081+0000","last_became_peered":"2023-09-30T22:26:34.448081+0000","last_unstale":"2023-09-30T22:27:24.983427+0000","last_undegraded":"2023-09-30T22:27:24.983427+0000","last_fullsized":"2023-09-30T22:27:24.983427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.980055+0000","last_change":"2023-09-30T22:26:34.039959+0000","last_active":"2023-09-30T22:27:24.980055+0000","last_peered":"2023-09-30T22:27:24.980055+0000","last_clean":"2023-09-30T22:27:24.980055+0000","last_became_active":"2023-09-30T22:26:34.039615+0000","last_became_peered":"2023-09-30T22:26:34.039615+0000","last_unstale":"2023-09-30T22:27:24.980055+0000","last_undegraded":"2023-09-30T22:27:24.980055+0000","last_fullsized":"2023-09-30T22:27:24.980055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979840+0000","last_change":"2023-09-30T22:26:34.442775+0000","last_active":"2023-09-30T22:27:24.979840+0000","last_peered":"2023-09-30T22:27:24.979840+0000","last_clean":"2023-09-30T22:27:24.979840+0000","last_became_active":"2023-09-30T22:26:34.442406+0000","last_became_peered":"2023-09-30T22:26:34.442406+0000","last_unstale":"2023-09-30T22:27:24.979840+0000","last_undegraded":"2023-09-30T22:27:24.979840+0000","last_fullsized":"2023-09-30T22:27:24.979840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984185+0000","last_change":"2023-09-30T22:26:34.030292+0000","last_active":"2023-09-30T22:27:24.984185+0000","last_peered":"2023-09-30T22:27:24.984185+0000","last_clean":"2023-09-30T22:27:24.984185+0000","last_became_active":"2023-09-30T22:26:34.029782+0000","last_became_peered":"2023-09-30T22:26:34.029782+0000","last_unstale":"2023-09-30T22:27:24.984185+0000","last_undegraded":"2023-09-30T22:27:24.984185+0000","last_fullsized":"2023-09-30T22:27:24.984185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:32.990555+0000","last_clean_scrub_stamp":"2023-09-30T22:26:32.990555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.986112+0000","last_change":"2023-09-30T22:26:34.446235+0000","last_active":"2023-09-30T22:27:24.986112+0000","last_peered":"2023-09-30T22:27:24.986112+0000","last_clean":"2023-09-30T22:27:24.986112+0000","last_became_active":"2023-09-30T22:26:34.445921+0000","last_became_peered":"2023-09-30T22:26:34.445921+0000","last_unstale":"2023-09-30T22:27:24.986112+0000","last_undegraded":"2023-09-30T22:27:24.986112+0000","last_fullsized":"2023-09-30T22:27:24.986112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.979361+0000","last_change":"2023-09-30T22:26:34.441075+0000","last_active":"2023-09-30T22:27:24.979361+0000","last_peered":"2023-09-30T22:27:24.979361+0000","last_clean":"2023-09-30T22:27:24.979361+0000","last_became_active":"2023-09-30T22:26:34.440633+0000","last_became_peered":"2023-09-30T22:26:34.440633+0000","last_unstale":"2023-09-30T22:27:24.979361+0000","last_undegraded":"2023-09-30T22:27:24.979361+0000","last_fullsized":"2023-09-30T22:27:24.979361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.997032+0000","last_change":"2023-09-30T22:27:24.989703+0000","last_active":"2023-09-30T22:27:24.997032+0000","last_peered":"2023-09-30T22:27:24.997032+0000","last_clean":"2023-09-30T22:27:24.997032+0000","last_became_active":"2023-09-30T22:27:24.989414+0000","last_became_peered":"2023-09-30T22:27:24.989414+0000","last_unstale":"2023-09-30T22:27:24.997032+0000","last_undegraded":"2023-09-30T22:27:24.997032+0000","last_fullsized":"2023-09-30T22:27:24.997032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.984818+0000","last_change":"2023-09-30T22:26:34.450865+0000","last_active":"2023-09-30T22:27:24.984818+0000","last_peered":"2023-09-30T22:27:24.984818+0000","last_clean":"2023-09-30T22:27:24.984818+0000","last_became_active":"2023-09-30T22:26:34.450568+0000","last_became_peered":"2023-09-30T22:26:34.450568+0000","last_unstale":"2023-09-30T22:27:24.984818+0000","last_undegraded":"2023-09-30T22:27:24.984818+0000","last_fullsized":"2023-09-30T22:27:24.984818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.997012+0000","last_change":"2023-09-30T22:27:24.989348+0000","last_active":"2023-09-30T22:27:24.997012+0000","last_peered":"2023-09-30T22:27:24.997012+0000","last_clean":"2023-09-30T22:27:24.997012+0000","last_became_active":"2023-09-30T22:27:24.989025+0000","last_became_peered":"2023-09-30T22:27:24.989025+0000","last_unstale":"2023-09-30T22:27:24.997012+0000","last_undegraded":"2023-09-30T22:27:24.997012+0000","last_fullsized":"2023-09-30T22:27:24.997012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:27:24.981076+0000","last_change":"2023-09-30T22:26:34.444740+0000","last_active":"2023-09-30T22:27:24.981076+0000","last_peered":"2023-09-30T22:27:24.981076+0000","last_clean":"2023-09-30T22:27:24.981076+0000","last_became_active":"2023-09-30T22:26:34.444385+0000","last_became_peered":"2023-09-30T22:26:34.444385+0000","last_unstale":"2023-09-30T22:27:24.981076+0000","last_undegraded":"2023-09-30T22:27:24.981076+0000","last_fullsized":"2023-09-30T22:27:24.981076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:26:33.994923+0000","last_clean_scrub_stamp":"2023-09-30T22:26:33.994923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705697,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297300,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074540,"statfs":{"total":96636764160,"available":96332328960,"internally_reserved":0,"allocated":208896,"data_stored":70607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:28:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33400000000000002,"15min":0.33300000000000002},"min":{"1min":0.26400000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.442,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.40000000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.33400000000000002}]},{"osd":1,"last update":"Sat Sep 30 22:28:34 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.45400000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.48099999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.38200000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:28:34 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.49299999999999999,"15min":0.51100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.498,"5min":2.827,"15min":2.827},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.36099999999999999,"15min":0.36299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.435,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.32000000000000001}]}]},{"osd":2,"up_from":10,"seq":42949672992,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":69344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.314,"15min":0.311},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.33300000000000002,"15min":0.33100000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.317}]},{"osd":1,"last update":"Sat Sep 30 22:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35099999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34599999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.32800000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.379,"15min":0.376},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.443},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35499999999999998,"15min":0.35599999999999998},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.39600000000000002}]}]},{"osd":0,"up_from":10,"seq":42949672992,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297288,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074552,"statfs":{"total":96636764160,"available":96332341248,"internally_reserved":0,"allocated":196608,"data_stored":66481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.251,"5min":0.248,"15min":0.248},"max":{"1min":0.439,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.34000000000000002,"15min":0.34100000000000003},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.45700000000000002,"5min":0.497,"15min":0.497},"last":0.60999999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35899999999999999,"15min":0.35999999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.504},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36699999999999999,"15min":0.371},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.53500000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27900000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.48399999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.55900000000000005}]}]},{"osd":1,"up_from":9,"seq":38654705697,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297288,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074552,"statfs":{"total":96636764160,"available":96332341248,"internally_reserved":0,"allocated":196608,"data_stored":67496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:28:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32100000000000001,"15min":0.32000000000000001},"min":{"1min":0.22800000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.48799999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.33600000000000002,"15min":0.33300000000000002},"min":{"1min":0.251,"5min":0.215,"15min":0.215},"max":{"1min":0.505,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.82099999999999995}]},{"osd":2,"last update":"Sat Sep 30 22:28:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35299999999999998,"15min":0.35099999999999998},"min":{"1min":0.246,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36599999999999999},"min":{"1min":0.27000000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.54000000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:28:35 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36399999999999999},"min":{"1min":0.28799999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57799999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.313,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.53000000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.53300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:29:03.354 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T22:29:03.354 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-30T22:29:03.354 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-30T22:29:03.354 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T22:29:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.525+0000 7fcd3e7c9700 1 Processor -- start 2023-09-30T22:29:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.525+0000 7fcd3e7c9700 1 -- start start 2023-09-30T22:29:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd3e7c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd380a0a30 0x7fcd380a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd3e7c9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd3809d630 0x7fcd380a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd3e7c9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd380a2a70 con 0x7fcd38133930 2023-09-30T22:29:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd3e7c9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd380a01d0 con 0x7fcd3809d630 2023-09-30T22:29:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd3e7c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3809e2b0 con 0x7fcd380a0a30 2023-09-30T22:29:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd37fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd380a0a30 0x7fcd380a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd37fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd380a0a30 0x7fcd380a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37028/0 (socket says 172.21.15.59:37028) 2023-09-30T22:29:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd37fff700 1 -- 172.21.15.59:0/1057579664 learned_addr learned my addr 172.21.15.59:0/1057579664 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd377fe700 1 --2- 172.21.15.59:0/1057579664 >> v2:172.21.15.59:3300/0 conn(0x7fcd3809d630 0x7fcd380a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd36ffd700 1 -- 172.21.15.59:0/1057579664 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230032475 0 0) 0x7fcd380a2a70 con 0x7fcd38133930 2023-09-30T22:29:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd36ffd700 1 -- 172.21.15.59:0/1057579664 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd200035b0 con 0x7fcd38133930 2023-09-30T22:29:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd377fe700 1 -- 172.21.15.59:0/1057579664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd380a0a30 msgr2=0x7fcd380a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd377fe700 1 --2- 172.21.15.59:0/1057579664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd380a0a30 0x7fcd380a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd377fe700 1 -- 172.21.15.59:0/1057579664 >> v1:172.21.15.59:6789/0 conn(0x7fcd38133930 legacy=0x7fcd38133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd377fe700 1 -- 172.21.15.59:0/1057579664 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3809dc50 con 0x7fcd3809d630 2023-09-30T22:29:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.526+0000 7fcd37fff700 1 --2- 172.21.15.59:0/1057579664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd380a0a30 0x7fcd380a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.527+0000 7fcd377fe700 1 --2- 172.21.15.59:0/1057579664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd3809d630 0x7fcd380a1340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009840 tx=0x7fcd2c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf4dc75cb999278 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.527+0000 7fcd36ffd700 1 -- 172.21.15.59:0/1057579664 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c011830 con 0x7fcd3809d630 2023-09-30T22:29:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.527+0000 7fcd36ffd700 1 -- 172.21.15.59:0/1057579664 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c011990 con 0x7fcd3809d630 2023-09-30T22:29:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.527+0000 7fcd36ffd700 1 -- 172.21.15.59:0/1057579664 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c011d20 con 0x7fcd3809d630 2023-09-30T22:29:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.527+0000 7fcd3e7c9700 1 -- 172.21.15.59:0/1057579664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd3809d630 msgr2=0x7fcd380a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.527+0000 7fcd3e7c9700 1 --2- 172.21.15.59:0/1057579664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd3809d630 0x7fcd380a1340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009840 tx=0x7fcd2c009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.527+0000 7fcd3e7c9700 1 -- 172.21.15.59:0/1057579664 shutdown_connections 2023-09-30T22:29:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.527+0000 7fcd3e7c9700 1 --2- 172.21.15.59:0/1057579664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd380a0a30 0x7fcd380a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.527+0000 7fcd3e7c9700 1 --2- 172.21.15.59:0/1057579664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd3809d630 0x7fcd380a1340 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.527+0000 7fcd3e7c9700 1 -- 172.21.15.59:0/1057579664 >> 172.21.15.59:0/1057579664 conn(0x7fcd380a3050 msgr2=0x7fcd380a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.527+0000 7fcd3e7c9700 1 -- 172.21.15.59:0/1057579664 shutdown_connections 2023-09-30T22:29:03.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.527+0000 7fcd3e7c9700 1 -- 172.21.15.59:0/1057579664 wait complete. 2023-09-30T22:29:03.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.528+0000 7fcd3e7c9700 1 Processor -- start 2023-09-30T22:29:03.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.529+0000 7fcd3e7c9700 1 -- start start 2023-09-30T22:29:03.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.529+0000 7fcd3e7c9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809d630 0x7fcd38132850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.529+0000 7fcd3e7c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd380a0a30 0x7fcd38132d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.529+0000 7fcd3e7c9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd38133930 0x7fcd381c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.529+0000 7fcd3e7c9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3811ef20 con 0x7fcd38133930 2023-09-30T22:29:03.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.529+0000 7fcd3e7c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd38122620 con 0x7fcd380a0a30 2023-09-30T22:29:03.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.529+0000 7fcd3e7c9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd381208b0 con 0x7fcd3809d630 2023-09-30T22:29:03.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.529+0000 7fcd377fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd380a0a30 0x7fcd38132d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.529+0000 7fcd37fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809d630 0x7fcd38132850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.529+0000 7fcd377fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd380a0a30 0x7fcd38132d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37030/0 (socket says 172.21.15.59:37030) 2023-09-30T22:29:03.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.529+0000 7fcd377fe700 1 -- 172.21.15.59:0/2689560789 learned_addr learned my addr 172.21.15.59:0/2689560789 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:03.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.529+0000 7fcd3cd66700 1 --2- 172.21.15.59:0/2689560789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd38133930 0x7fcd381c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.530+0000 7fcd37fff700 1 -- 172.21.15.59:0/2689560789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd380a0a30 msgr2=0x7fcd38132d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.530+0000 7fcd37fff700 1 --2- 172.21.15.59:0/2689560789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd380a0a30 0x7fcd38132d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.530+0000 7fcd37fff700 1 -- 172.21.15.59:0/2689560789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd38133930 msgr2=0x7fcd381c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.530+0000 7fcd37fff700 1 --2- 172.21.15.59:0/2689560789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd38133930 0x7fcd381c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.530+0000 7fcd37fff700 1 -- 172.21.15.59:0/2689560789 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd28009550 con 0x7fcd3809d630 2023-09-30T22:29:03.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.530+0000 7fcd37fff700 1 --2- 172.21.15.59:0/2689560789 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809d630 0x7fcd38132850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800ea00 tx=0x7fcd2800ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.530+0000 7fcd34ff9700 1 -- 172.21.15.59:0/2689560789 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2800eea0 con 0x7fcd3809d630 2023-09-30T22:29:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.530+0000 7fcd34ff9700 1 -- 172.21.15.59:0/2689560789 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd28004030 con 0x7fcd3809d630 2023-09-30T22:29:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.530+0000 7fcd3e7c9700 1 -- 172.21.15.59:0/2689560789 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2c0094a0 con 0x7fcd3809d630 2023-09-30T22:29:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.530+0000 7fcd34ff9700 1 -- 172.21.15.59:0/2689560789 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd280043c0 con 0x7fcd3809d630 2023-09-30T22:29:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.530+0000 7fcd3e7c9700 1 -- 172.21.15.59:0/2689560789 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd38121ff0 con 0x7fcd3809d630 2023-09-30T22:29:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.531+0000 7fcd34ff9700 1 -- 172.21.15.59:0/2689560789 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fcd2800c850 con 0x7fcd3809d630 2023-09-30T22:29:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.531+0000 7fcd3e7c9700 1 -- 172.21.15.59:0/2689560789 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd380747f0 con 0x7fcd3809d630 2023-09-30T22:29:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.531+0000 7fcd34ff9700 1 -- 172.21.15.59:0/2689560789 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fcd2803f8f0 con 0x7fcd3809d630 2023-09-30T22:29:03.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.536+0000 7fcd34ff9700 1 -- 172.21.15.59:0/2689560789 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd28019b30 con 0x7fcd3809d630 2023-09-30T22:29:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.782+0000 7fcd3e7c9700 1 -- 172.21.15.59:0/2689560789 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcd381332d0 con 0x7fcd3809d630 2023-09-30T22:29:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.782+0000 7fcd34ff9700 1 -- 172.21.15.59:0/2689560789 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fcd280161b0 con 0x7fcd3809d630 2023-09-30T22:29:03.783 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:03.783 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-30T22:29:03.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.784+0000 7fcd3e7c9700 1 -- 172.21.15.59:0/2689560789 >> v1:172.21.15.59:6816/126772 conn(0x7fcd2402f480 legacy=0x7fcd24031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.784+0000 7fcd3e7c9700 1 -- 172.21.15.59:0/2689560789 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809d630 msgr2=0x7fcd38132850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.784+0000 7fcd3e7c9700 1 --2- 172.21.15.59:0/2689560789 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809d630 0x7fcd38132850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800ea00 tx=0x7fcd2800ed10 comp rx=0 tx=0).stop 2023-09-30T22:29:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.784+0000 7fcd3e7c9700 1 -- 172.21.15.59:0/2689560789 shutdown_connections 2023-09-30T22:29:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.784+0000 7fcd3e7c9700 1 --2- 172.21.15.59:0/2689560789 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809d630 0x7fcd38132850 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.784+0000 7fcd3e7c9700 1 --2- 172.21.15.59:0/2689560789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd38133930 0x7fcd381c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.784+0000 7fcd3e7c9700 1 --2- 172.21.15.59:0/2689560789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd380a0a30 0x7fcd38132d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.784+0000 7fcd3e7c9700 1 -- 172.21.15.59:0/2689560789 >> 172.21.15.59:0/2689560789 conn(0x7fcd380a3050 msgr2=0x7fcd381bb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.785+0000 7fcd3e7c9700 1 -- 172.21.15.59:0/2689560789 shutdown_connections 2023-09-30T22:29:03.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.785+0000 7fcd3e7c9700 1 -- 172.21.15.59:0/2689560789 wait complete. 2023-09-30T22:29:03.798 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-30T22:29:03.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:29:03.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.934+0000 7f2570454700 1 Processor -- start 2023-09-30T22:29:03.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.934+0000 7f2570454700 1 -- start start 2023-09-30T22:29:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.935+0000 7f2570454700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25680a1510 0x7f2568138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.935+0000 7f2570454700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2568139250 0x7f256813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.935+0000 7f2570454700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256809edd0 con 0x7f25680a0a30 2023-09-30T22:29:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.935+0000 7f2570454700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25680a18e0 con 0x7f2568139250 2023-09-30T22:29:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.935+0000 7f2570454700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f256809e1f0 con 0x7f25680a1510 2023-09-30T22:29:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.935+0000 7f256d9ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25680a1510 0x7f2568138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.935+0000 7f256e9f1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2568139250 0x7f256813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.935+0000 7f256e1f0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f25680a0a30 0x7f25680a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56988/0 (socket says 172.21.15.59:56988) 2023-09-30T22:29:03.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.935+0000 7f256e1f0700 1 -- 172.21.15.59:0/3137457154 learned_addr learned my addr 172.21.15.59:0/3137457154 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:03.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.935+0000 7f256d1ee700 1 -- 172.21.15.59:0/3137457154 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213755999 0 0) 0x7f256809edd0 con 0x7f25680a0a30 2023-09-30T22:29:03.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.935+0000 7f256d1ee700 1 -- 172.21.15.59:0/3137457154 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25540035b0 con 0x7f25680a0a30 2023-09-30T22:29:03.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.935+0000 7f256e9f1700 1 -- 172.21.15.59:0/3137457154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25680a1510 msgr2=0x7f2568138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:03.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.935+0000 7f256e9f1700 1 --2- 172.21.15.59:0/3137457154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25680a1510 0x7f2568138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.935+0000 7f256e9f1700 1 -- 172.21.15.59:0/3137457154 >> v1:172.21.15.59:6789/0 conn(0x7f25680a0a30 legacy=0x7f25680a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.935+0000 7f256e9f1700 1 -- 172.21.15.59:0/3137457154 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256809dc50 con 0x7f2568139250 2023-09-30T22:29:03.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.936+0000 7f256d9ef700 1 --2- 172.21.15.59:0/3137457154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25680a1510 0x7f2568138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:03.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.936+0000 7f256e9f1700 1 --2- 172.21.15.59:0/3137457154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2568139250 0x7f256813b630 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2560009dc0 tx=0x7f256000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657ef5c24e77006e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.936+0000 7f256d1ee700 1 -- 172.21.15.59:0/3137457154 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000e070 con 0x7f2568139250 2023-09-30T22:29:03.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.936+0000 7f256d1ee700 1 -- 172.21.15.59:0/3137457154 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256000bae0 con 0x7f2568139250 2023-09-30T22:29:03.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.936+0000 7f256d1ee700 1 -- 172.21.15.59:0/3137457154 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000be90 con 0x7f2568139250 2023-09-30T22:29:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.936+0000 7f2570454700 1 -- 172.21.15.59:0/3137457154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2568139250 msgr2=0x7f256813b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.936+0000 7f2570454700 1 --2- 172.21.15.59:0/3137457154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2568139250 0x7f256813b630 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2560009dc0 tx=0x7f256000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.937+0000 7f2570454700 1 -- 172.21.15.59:0/3137457154 shutdown_connections 2023-09-30T22:29:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.937+0000 7f2570454700 1 --2- 172.21.15.59:0/3137457154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2568139250 0x7f256813b630 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.937+0000 7f2570454700 1 --2- 172.21.15.59:0/3137457154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25680a1510 0x7f2568138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.937+0000 7f2570454700 1 -- 172.21.15.59:0/3137457154 >> 172.21.15.59:0/3137457154 conn(0x7f25680a6550 msgr2=0x7f25680a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.937+0000 7f2570454700 1 -- 172.21.15.59:0/3137457154 shutdown_connections 2023-09-30T22:29:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.937+0000 7f2570454700 1 -- 172.21.15.59:0/3137457154 wait complete. 2023-09-30T22:29:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.938+0000 7f2570454700 1 Processor -- start 2023-09-30T22:29:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.938+0000 7f2570454700 1 -- start start 2023-09-30T22:29:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.938+0000 7f2570454700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25680a0a30 0x7f25681226d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.938+0000 7f2570454700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25680a1510 0x7f2568122c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.938+0000 7f2570454700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2568139250 0x7f2568123150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.938+0000 7f2570454700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2568138000 con 0x7f25680a1510 2023-09-30T22:29:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.938+0000 7f2570454700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25681385c0 con 0x7f2568139250 2023-09-30T22:29:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.938+0000 7f2570454700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25681261f0 con 0x7f25680a0a30 2023-09-30T22:29:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.938+0000 7f256e1f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25680a0a30 0x7f25681226d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.938+0000 7f256e9f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2568139250 0x7f2568123150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.938+0000 7f256e1f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25680a0a30 0x7f25681226d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40154/0 (socket says 172.21.15.59:40154) 2023-09-30T22:29:03.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.938+0000 7f256e1f0700 1 -- 172.21.15.59:0/3648275572 learned_addr learned my addr 172.21.15.59:0/3648275572 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:03.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.938+0000 7f256d9ef700 1 --2- 172.21.15.59:0/3648275572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25680a1510 0x7f2568122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.939+0000 7f256e1f0700 1 -- 172.21.15.59:0/3648275572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2568139250 msgr2=0x7f2568123150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.939+0000 7f256e1f0700 1 --2- 172.21.15.59:0/3648275572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2568139250 0x7f2568123150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.939+0000 7f256e1f0700 1 -- 172.21.15.59:0/3648275572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25680a1510 msgr2=0x7f2568122c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.939+0000 7f256e1f0700 1 --2- 172.21.15.59:0/3648275572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25680a1510 0x7f2568122c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.939+0000 7f256e1f0700 1 -- 172.21.15.59:0/3648275572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c0094a0 con 0x7f25680a0a30 2023-09-30T22:29:03.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.939+0000 7f256e1f0700 1 --2- 172.21.15.59:0/3648275572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25680a0a30 0x7f25681226d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f256400c700 tx=0x7f256400ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.939+0000 7f255affd700 1 -- 172.21.15.59:0/3648275572 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564005d70 con 0x7f25680a0a30 2023-09-30T22:29:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.939+0000 7f255affd700 1 -- 172.21.15.59:0/3648275572 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25640070d0 con 0x7f25680a0a30 2023-09-30T22:29:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.939+0000 7f255affd700 1 -- 172.21.15.59:0/3648275572 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564007460 con 0x7f25680a0a30 2023-09-30T22:29:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.939+0000 7f2570454700 1 -- 172.21.15.59:0/3648275572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2560009a70 con 0x7f25680a0a30 2023-09-30T22:29:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.939+0000 7f2570454700 1 -- 172.21.15.59:0/3648275572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25680a0220 con 0x7f25680a0a30 2023-09-30T22:29:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.940+0000 7f255affd700 1 -- 172.21.15.59:0/3648275572 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f25640075c0 con 0x7f25680a0a30 2023-09-30T22:29:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.940+0000 7f255affd700 1 -- 172.21.15.59:0/3648275572 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f256403eef0 con 0x7f25680a0a30 2023-09-30T22:29:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.940+0000 7f2570454700 1 -- 172.21.15.59:0/3648275572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2568124b40 con 0x7f25680a0a30 2023-09-30T22:29:03.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:03.945+0000 7f255affd700 1 -- 172.21.15.59:0/3648275572 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2564017020 con 0x7f25680a0a30 2023-09-30T22:29:04.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.148+0000 7f2570454700 1 -- 172.21.15.59:0/3648275572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2568074ea0 con 0x7f25680a0a30 2023-09-30T22:29:04.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.149+0000 7f255affd700 1 -- 172.21.15.59:0/3648275572 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+12919 (secure 0 0 0) 0x7f256403de60 con 0x7f25680a0a30 2023-09-30T22:29:04.149 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:04.149 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:29:01.577848+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/3882222550":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/1346763106":"2023-10-01T22:28:59.561079+0000","172.21.15.59:6816/118188":"2023-10-01T22:28:59.561079+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:29:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.151+0000 7f2570454700 1 -- 172.21.15.59:0/3648275572 >> v1:172.21.15.59:6816/126772 conn(0x7f254c02f480 legacy=0x7f254c031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.151+0000 7f2570454700 1 -- 172.21.15.59:0/3648275572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25680a0a30 msgr2=0x7f25681226d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.151+0000 7f2570454700 1 --2- 172.21.15.59:0/3648275572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25680a0a30 0x7f25681226d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f256400c700 tx=0x7f256400ca10 comp rx=0 tx=0).stop 2023-09-30T22:29:04.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.151+0000 7f2570454700 1 -- 172.21.15.59:0/3648275572 shutdown_connections 2023-09-30T22:29:04.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.151+0000 7f2570454700 1 --2- 172.21.15.59:0/3648275572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25680a0a30 0x7f25681226d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.151+0000 7f2570454700 1 --2- 172.21.15.59:0/3648275572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2568139250 0x7f2568123150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.151+0000 7f2570454700 1 --2- 172.21.15.59:0/3648275572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25680a1510 0x7f2568122c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.151+0000 7f2570454700 1 -- 172.21.15.59:0/3648275572 >> 172.21.15.59:0/3648275572 conn(0x7f25680a6550 msgr2=0x7f256811c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.151+0000 7f2570454700 1 -- 172.21.15.59:0/3648275572 shutdown_connections 2023-09-30T22:29:04.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.151+0000 7f2570454700 1 -- 172.21.15.59:0/3648275572 wait complete. 2023-09-30T22:29:04.165 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:26:26.893716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:26:28.448775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:26:32.964075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:26:33.390842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T22:29:04.165 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:29:04.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.307+0000 7fb386f99700 1 Processor -- start 2023-09-30T22:29:04.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.307+0000 7fb386f99700 1 -- start start 2023-09-30T22:29:04.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.307+0000 7fb386f99700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3801345c0 0x7fb3801369a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.307+0000 7fb386f99700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb380136ee0 0x7fb3801392c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.307+0000 7fb386f99700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb380131350 con 0x7fb380131760 2023-09-30T22:29:04.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.307+0000 7fb386f99700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38009ea40 con 0x7fb3801345c0 2023-09-30T22:29:04.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.307+0000 7fb386f99700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb380132240 con 0x7fb380136ee0 2023-09-30T22:29:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.307+0000 7fb37ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3801345c0 0x7fb3801369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.307+0000 7fb385536700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb380136ee0 0x7fb3801392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.307+0000 7fb384d35700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb380131760 0x7fb380131b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56994/0 (socket says 172.21.15.59:56994) 2023-09-30T22:29:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.307+0000 7fb384d35700 1 -- 172.21.15.59:0/3763365834 learned_addr learned my addr 172.21.15.59:0/3763365834 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.307+0000 7fb37ffff700 1 --2- 172.21.15.59:0/3763365834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3801345c0 0x7fb3801369a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37038/0 (socket says 172.21.15.59:37038) 2023-09-30T22:29:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.308+0000 7fb37ffff700 1 -- 172.21.15.59:0/3763365834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb380136ee0 msgr2=0x7fb3801392c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.308+0000 7fb37ffff700 1 --2- 172.21.15.59:0/3763365834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb380136ee0 0x7fb3801392c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.308+0000 7fb37ffff700 1 -- 172.21.15.59:0/3763365834 >> v1:172.21.15.59:6789/0 conn(0x7fb380131760 legacy=0x7fb380131b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.308+0000 7fb37f7fe700 1 -- 172.21.15.59:0/3763365834 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692622161 0 0) 0x7fb380131350 con 0x7fb380131760 2023-09-30T22:29:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.308+0000 7fb37ffff700 1 -- 172.21.15.59:0/3763365834 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38009dfc0 con 0x7fb3801345c0 2023-09-30T22:29:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.308+0000 7fb385536700 1 --2- 172.21.15.59:0/3763365834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb380136ee0 0x7fb3801392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.308+0000 7fb37ffff700 1 --2- 172.21.15.59:0/3763365834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3801345c0 0x7fb3801369a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb3700098a0 tx=0x7fb370009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8e10efafbbb7ff9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.308+0000 7fb37f7fe700 1 -- 172.21.15.59:0/3763365834 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370011830 con 0x7fb3801345c0 2023-09-30T22:29:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.308+0000 7fb37f7fe700 1 -- 172.21.15.59:0/3763365834 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb370011990 con 0x7fb3801345c0 2023-09-30T22:29:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.308+0000 7fb37f7fe700 1 -- 172.21.15.59:0/3763365834 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370011d20 con 0x7fb3801345c0 2023-09-30T22:29:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.309+0000 7fb386f99700 1 -- 172.21.15.59:0/3763365834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3801345c0 msgr2=0x7fb3801369a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.309+0000 7fb386f99700 1 --2- 172.21.15.59:0/3763365834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3801345c0 0x7fb3801369a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb3700098a0 tx=0x7fb370009bb0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.309+0000 7fb386f99700 1 -- 172.21.15.59:0/3763365834 shutdown_connections 2023-09-30T22:29:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.309+0000 7fb386f99700 1 --2- 172.21.15.59:0/3763365834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb380136ee0 0x7fb3801392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.309+0000 7fb386f99700 1 --2- 172.21.15.59:0/3763365834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3801345c0 0x7fb3801369a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.309+0000 7fb386f99700 1 -- 172.21.15.59:0/3763365834 >> 172.21.15.59:0/3763365834 conn(0x7fb380066d70 msgr2=0x7fb3800a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.309+0000 7fb386f99700 1 -- 172.21.15.59:0/3763365834 shutdown_connections 2023-09-30T22:29:04.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.309+0000 7fb386f99700 1 -- 172.21.15.59:0/3763365834 wait complete. 2023-09-30T22:29:04.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.310+0000 7fb386f99700 1 Processor -- start 2023-09-30T22:29:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.310+0000 7fb386f99700 1 -- start start 2023-09-30T22:29:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.310+0000 7fb386f99700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb380131760 0x7fb3801c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.310+0000 7fb386f99700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3801345c0 0x7fb3801c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.310+0000 7fb386f99700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb380136ee0 0x7fb38006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.310+0000 7fb386f99700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3801bc060 con 0x7fb380131760 2023-09-30T22:29:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.310+0000 7fb386f99700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3800a2f10 con 0x7fb380136ee0 2023-09-30T22:29:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.310+0000 7fb386f99700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb38012b9a0 con 0x7fb3801345c0 2023-09-30T22:29:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.310+0000 7fb385536700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb380136ee0 0x7fb38006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.310+0000 7fb384d35700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb380131760 0x7fb3801c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.310+0000 7fb37ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3801345c0 0x7fb3801c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.310+0000 7fb385536700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb380136ee0 0x7fb38006ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37040/0 (socket says 172.21.15.59:37040) 2023-09-30T22:29:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.310+0000 7fb385536700 1 -- 172.21.15.59:0/3198432783 learned_addr learned my addr 172.21.15.59:0/3198432783 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.311+0000 7fb384d35700 1 -- 172.21.15.59:0/3198432783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3801345c0 msgr2=0x7fb3801c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.311+0000 7fb384d35700 1 --2- 172.21.15.59:0/3198432783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3801345c0 0x7fb3801c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.311+0000 7fb384d35700 1 -- 172.21.15.59:0/3198432783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb380136ee0 msgr2=0x7fb38006ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.311+0000 7fb384d35700 1 --2- 172.21.15.59:0/3198432783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb380136ee0 0x7fb38006ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.311+0000 7fb384d35700 1 -- 172.21.15.59:0/3198432783 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb378009a70 con 0x7fb380131760 2023-09-30T22:29:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.311+0000 7fb385536700 1 --2- 172.21.15.59:0/3198432783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb380136ee0 0x7fb38006ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.311+0000 7fb384d35700 1 --2- 172.21.15.59:0/3198432783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb380131760 0x7fb3801c6390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb36800c470 tx=0x7fb36800c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.311+0000 7fb37d7fa700 1 -- 172.21.15.59:0/3198432783 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368004c80 con 0x7fb380131760 2023-09-30T22:29:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.311+0000 7fb37d7fa700 1 -- 172.21.15.59:0/3198432783 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb368004de0 con 0x7fb380131760 2023-09-30T22:29:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.311+0000 7fb386f99700 1 -- 172.21.15.59:0/3198432783 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3700094a0 con 0x7fb380131760 2023-09-30T22:29:04.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.311+0000 7fb37d7fa700 1 -- 172.21.15.59:0/3198432783 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368007310 con 0x7fb380131760 2023-09-30T22:29:04.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.311+0000 7fb386f99700 1 -- 172.21.15.59:0/3198432783 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb380119a70 con 0x7fb380131760 2023-09-30T22:29:04.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.312+0000 7fb37d7fa700 1 -- 172.21.15.59:0/3198432783 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb368007470 con 0x7fb380131760 2023-09-30T22:29:04.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.312+0000 7fb37d7fa700 1 -- 172.21.15.59:0/3198432783 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fb36803f720 con 0x7fb380131760 2023-09-30T22:29:04.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.312+0000 7fb386f99700 1 -- 172.21.15.59:0/3198432783 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb380074ea0 con 0x7fb380131760 2023-09-30T22:29:04.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.317+0000 7fb37d7fa700 1 -- 172.21.15.59:0/3198432783 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb368007720 con 0x7fb380131760 2023-09-30T22:29:04.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.518+0000 7fb386f99700 1 -- 172.21.15.59:0/3198432783 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb38004f2a0 con 0x7fb380131760 2023-09-30T22:29:04.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.518+0000 7fb37d7fa700 1 -- 172.21.15.59:0/3198432783 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb368011e80 con 0x7fb380131760 2023-09-30T22:29:04.518 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-30T22:29:04.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.520+0000 7fb386f99700 1 -- 172.21.15.59:0/3198432783 >> v1:172.21.15.59:6816/126772 conn(0x7fb36002f510 legacy=0x7fb3600319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.520+0000 7fb386f99700 1 -- 172.21.15.59:0/3198432783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb380131760 msgr2=0x7fb3801c6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.520+0000 7fb386f99700 1 --2- 172.21.15.59:0/3198432783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb380131760 0x7fb3801c6390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb36800c470 tx=0x7fb36800c780 comp rx=0 tx=0).stop 2023-09-30T22:29:04.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.520+0000 7fb386f99700 1 -- 172.21.15.59:0/3198432783 shutdown_connections 2023-09-30T22:29:04.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.520+0000 7fb386f99700 1 --2- 172.21.15.59:0/3198432783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb380136ee0 0x7fb38006ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.520+0000 7fb386f99700 1 --2- 172.21.15.59:0/3198432783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb380131760 0x7fb3801c6390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.520+0000 7fb386f99700 1 --2- 172.21.15.59:0/3198432783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3801345c0 0x7fb3801c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.520+0000 7fb386f99700 1 -- 172.21.15.59:0/3198432783 >> 172.21.15.59:0/3198432783 conn(0x7fb380066d70 msgr2=0x7fb380132a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.521+0000 7fb386f99700 1 -- 172.21.15.59:0/3198432783 shutdown_connections 2023-09-30T22:29:04.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.521+0000 7fb386f99700 1 -- 172.21.15.59:0/3198432783 wait complete. 2023-09-30T22:29:04.534 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:29:04.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.673+0000 7fae97f73700 1 Processor -- start 2023-09-30T22:29:04.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.674+0000 7fae97f73700 1 -- start start 2023-09-30T22:29:04.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.674+0000 7fae97f73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae901303c0 0x7fae90130790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.674+0000 7fae97f73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae9006a770 0x7fae9006ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.674+0000 7fae97f73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9006b0c0 0x7fae9013a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.674+0000 7fae97f73700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae90130280 con 0x7fae901303c0 2023-09-30T22:29:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.674+0000 7fae97f73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9009f620 con 0x7fae9006b0c0 2023-09-30T22:29:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.674+0000 7fae97f73700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae9009e1b0 con 0x7fae9006a770 2023-09-30T22:29:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.674+0000 7fae96510700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9006b0c0 0x7fae9013a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.674+0000 7fae95d0f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae901303c0 0x7fae90130790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.674+0000 7fae9550e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae9006a770 0x7fae9006ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.674+0000 7fae95d0f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae901303c0 0x7fae90130790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58400/0 (socket says 172.21.15.59:58400) 2023-09-30T22:29:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.674+0000 7fae96510700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9006b0c0 0x7fae9013a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42400/0 (socket says 172.21.15.59:42400) 2023-09-30T22:29:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.675+0000 7fae95d0f700 1 -- 172.21.15.59:0/4168973243 learned_addr learned my addr 172.21.15.59:0/4168973243 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.675+0000 7fae9550e700 1 --2- 172.21.15.59:0/4168973243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae9006a770 0x7fae9006ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59604/0 (socket says 172.21.15.59:59604) 2023-09-30T22:29:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.675+0000 7fae95d0f700 1 -- 172.21.15.59:0/4168973243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae9006a770 msgr2=0x7fae9006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.675+0000 7fae95d0f700 1 --2- 172.21.15.59:0/4168973243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae9006a770 0x7fae9006ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.675+0000 7fae95d0f700 1 -- 172.21.15.59:0/4168973243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9006b0c0 msgr2=0x7fae9013a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.675+0000 7fae95d0f700 1 --2- 172.21.15.59:0/4168973243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9006b0c0 0x7fae9013a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.675+0000 7fae95d0f700 1 -- 172.21.15.59:0/4168973243 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9006b510 con 0x7fae901303c0 2023-09-30T22:29:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.675+0000 7fae96510700 1 --2- 172.21.15.59:0/4168973243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9006b0c0 0x7fae9013a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.675+0000 7fae9550e700 1 --2- 172.21.15.59:0/4168973243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae9006a770 0x7fae9006ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.675+0000 7fae95d0f700 1 --2- 172.21.15.59:0/4168973243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae901303c0 0x7fae90130790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0098f0 tx=0x7fae8c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d80a4ff5b9ed045 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.675+0000 7fae94d0d700 1 -- 172.21.15.59:0/4168973243 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c011830 con 0x7fae901303c0 2023-09-30T22:29:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.675+0000 7fae94d0d700 1 -- 172.21.15.59:0/4168973243 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c011990 con 0x7fae901303c0 2023-09-30T22:29:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.675+0000 7fae94d0d700 1 -- 172.21.15.59:0/4168973243 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c011d20 con 0x7fae901303c0 2023-09-30T22:29:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.676+0000 7fae97f73700 1 -- 172.21.15.59:0/4168973243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae901303c0 msgr2=0x7fae90130790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.676+0000 7fae97f73700 1 --2- 172.21.15.59:0/4168973243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae901303c0 0x7fae90130790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0098f0 tx=0x7fae8c009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.676+0000 7fae97f73700 1 -- 172.21.15.59:0/4168973243 shutdown_connections 2023-09-30T22:29:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.676+0000 7fae97f73700 1 --2- 172.21.15.59:0/4168973243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9006b0c0 0x7fae9013a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.676+0000 7fae97f73700 1 --2- 172.21.15.59:0/4168973243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae901303c0 0x7fae90130790 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.676+0000 7fae97f73700 1 --2- 172.21.15.59:0/4168973243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae9006a770 0x7fae9006ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.676+0000 7fae97f73700 1 -- 172.21.15.59:0/4168973243 >> 172.21.15.59:0/4168973243 conn(0x7fae90066d70 msgr2=0x7fae900a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.676+0000 7fae97f73700 1 -- 172.21.15.59:0/4168973243 shutdown_connections 2023-09-30T22:29:04.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.676+0000 7fae97f73700 1 -- 172.21.15.59:0/4168973243 wait complete. 2023-09-30T22:29:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.677+0000 7fae97f73700 1 Processor -- start 2023-09-30T22:29:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.677+0000 7fae97f73700 1 -- start start 2023-09-30T22:29:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.677+0000 7fae97f73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9006a770 0x7fae9011d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.677+0000 7fae97f73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae9006b0c0 0x7fae9011de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.677+0000 7fae97f73700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae901303c0 0x7fae9011e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.677+0000 7fae97f73700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9011fb40 con 0x7fae901303c0 2023-09-30T22:29:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.677+0000 7fae97f73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9011fd20 con 0x7fae9006a770 2023-09-30T22:29:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.677+0000 7fae97f73700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae9012d6f0 con 0x7fae9006b0c0 2023-09-30T22:29:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae95d0f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9006a770 0x7fae9011d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae96510700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae901303c0 0x7fae9011e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae9550e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae9006b0c0 0x7fae9011de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae95d0f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9006a770 0x7fae9011d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42414/0 (socket says 172.21.15.59:42414) 2023-09-30T22:29:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae95d0f700 1 -- 172.21.15.59:0/451509078 learned_addr learned my addr 172.21.15.59:0/451509078 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae96510700 1 -- 172.21.15.59:0/451509078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae9006b0c0 msgr2=0x7fae9011de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae96510700 1 --2- 172.21.15.59:0/451509078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae9006b0c0 0x7fae9011de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae96510700 1 -- 172.21.15.59:0/451509078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9006a770 msgr2=0x7fae9011d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae96510700 1 --2- 172.21.15.59:0/451509078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9006a770 0x7fae9011d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae96510700 1 -- 172.21.15.59:0/451509078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae840094a0 con 0x7fae901303c0 2023-09-30T22:29:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae9550e700 1 --2- 172.21.15.59:0/451509078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae9006b0c0 0x7fae9011de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae96510700 1 --2- 172.21.15.59:0/451509078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae901303c0 0x7fae9011e3b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fae8800efc0 tx=0x7fae8800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae827fc700 1 -- 172.21.15.59:0/451509078 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8800ca90 con 0x7fae901303c0 2023-09-30T22:29:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae827fc700 1 -- 172.21.15.59:0/451509078 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8800f040 con 0x7fae901303c0 2023-09-30T22:29:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae97f73700 1 -- 172.21.15.59:0/451509078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae88009a70 con 0x7fae901303c0 2023-09-30T22:29:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae827fc700 1 -- 172.21.15.59:0/451509078 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8800ce30 con 0x7fae901303c0 2023-09-30T22:29:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.678+0000 7fae97f73700 1 -- 172.21.15.59:0/451509078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c009550 con 0x7fae901303c0 2023-09-30T22:29:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.679+0000 7fae827fc700 1 -- 172.21.15.59:0/451509078 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fae88014480 con 0x7fae901303c0 2023-09-30T22:29:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.679+0000 7fae827fc700 1 -- 172.21.15.59:0/451509078 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fae880401e0 con 0x7fae901303c0 2023-09-30T22:29:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.679+0000 7fae97f73700 1 -- 172.21.15.59:0/451509078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae90130c50 con 0x7fae901303c0 2023-09-30T22:29:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.684+0000 7fae827fc700 1 -- 172.21.15.59:0/451509078 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae88018070 con 0x7fae901303c0 2023-09-30T22:29:04.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.888+0000 7fae97f73700 1 -- 172.21.15.59:0/451509078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fae9011fee0 con 0x7fae901303c0 2023-09-30T22:29:04.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.888+0000 7fae827fc700 1 -- 172.21.15.59:0/451509078 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fae88018070 con 0x7fae901303c0 2023-09-30T22:29:04.888 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-09-30T22:29:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.890+0000 7fae97f73700 1 -- 172.21.15.59:0/451509078 >> v1:172.21.15.59:6816/126772 conn(0x7fae7402f510 legacy=0x7fae740319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.890+0000 7fae97f73700 1 -- 172.21.15.59:0/451509078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae901303c0 msgr2=0x7fae9011e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.890+0000 7fae97f73700 1 --2- 172.21.15.59:0/451509078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae901303c0 0x7fae9011e3b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fae8800efc0 tx=0x7fae8800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.890+0000 7fae97f73700 1 -- 172.21.15.59:0/451509078 shutdown_connections 2023-09-30T22:29:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.890+0000 7fae97f73700 1 --2- 172.21.15.59:0/451509078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae901303c0 0x7fae9011e3b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.890+0000 7fae97f73700 1 --2- 172.21.15.59:0/451509078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9006a770 0x7fae9011d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.890+0000 7fae97f73700 1 --2- 172.21.15.59:0/451509078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae9006b0c0 0x7fae9011de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.890+0000 7fae97f73700 1 -- 172.21.15.59:0/451509078 >> 172.21.15.59:0/451509078 conn(0x7fae90066d70 msgr2=0x7fae900a1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.890+0000 7fae97f73700 1 -- 172.21.15.59:0/451509078 shutdown_connections 2023-09-30T22:29:04.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:04.890+0000 7fae97f73700 1 -- 172.21.15.59:0/451509078 wait complete. 2023-09-30T22:29:04.904 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:29:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.043+0000 7ff116908700 1 Processor -- start 2023-09-30T22:29:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.043+0000 7ff116908700 1 -- start start 2023-09-30T22:29:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.043+0000 7ff116908700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff110071dd0 0x7ff1100721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.043+0000 7ff116908700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff11009e850 0x7ff11009ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.043+0000 7ff116908700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff11009f1a0 0x7ff11013aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.043+0000 7ff116908700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11006cb80 con 0x7ff11009f1a0 2023-09-30T22:29:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.043+0000 7ff116908700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1100726e0 con 0x7ff11009e850 2023-09-30T22:29:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.043+0000 7ff116908700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff11006c0a0 con 0x7ff110071dd0 2023-09-30T22:29:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.043+0000 7ff10f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff11009e850 0x7ff11009ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff10ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff110071dd0 0x7ff1100721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff114ea5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff11009f1a0 0x7ff11013aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff10f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff11009e850 0x7ff11009ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42430/0 (socket says 172.21.15.59:42430) 2023-09-30T22:29:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff10ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff110071dd0 0x7ff1100721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59616/0 (socket says 172.21.15.59:59616) 2023-09-30T22:29:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff10f7fe700 1 -- 172.21.15.59:0/860895403 learned_addr learned my addr 172.21.15.59:0/860895403 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff10f7fe700 1 -- 172.21.15.59:0/860895403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff110071dd0 msgr2=0x7ff1100721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff10f7fe700 1 --2- 172.21.15.59:0/860895403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff110071dd0 0x7ff1100721a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff10f7fe700 1 -- 172.21.15.59:0/860895403 >> v2:172.21.15.59:3300/0 conn(0x7ff11009f1a0 msgr2=0x7ff11013aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff10f7fe700 1 --2- 172.21.15.59:0/860895403 >> v2:172.21.15.59:3300/0 conn(0x7ff11009f1a0 0x7ff11013aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff10f7fe700 1 -- 172.21.15.59:0/860895403 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11006ba00 con 0x7ff11009e850 2023-09-30T22:29:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff114ea5700 1 --2- 172.21.15.59:0/860895403 >> v2:172.21.15.59:3300/0 conn(0x7ff11009f1a0 0x7ff11013aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff10ffff700 1 --2- 172.21.15.59:0/860895403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff110071dd0 0x7ff1100721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff10f7fe700 1 --2- 172.21.15.59:0/860895403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff11009e850 0x7ff11009ec60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff1040098f0 tx=0x7ff104009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c89c229762d8e48f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff10effd700 1 -- 172.21.15.59:0/860895403 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104011830 con 0x7ff11009e850 2023-09-30T22:29:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff10effd700 1 -- 172.21.15.59:0/860895403 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff104011990 con 0x7ff11009e850 2023-09-30T22:29:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.044+0000 7ff10effd700 1 -- 172.21.15.59:0/860895403 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104011d20 con 0x7ff11009e850 2023-09-30T22:29:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.045+0000 7ff116908700 1 -- 172.21.15.59:0/860895403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff11009e850 msgr2=0x7ff11009ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.045+0000 7ff116908700 1 --2- 172.21.15.59:0/860895403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff11009e850 0x7ff11009ec60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff1040098f0 tx=0x7ff104009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.045+0000 7ff116908700 1 -- 172.21.15.59:0/860895403 shutdown_connections 2023-09-30T22:29:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.045+0000 7ff116908700 1 --2- 172.21.15.59:0/860895403 >> v2:172.21.15.59:3300/0 conn(0x7ff11009f1a0 0x7ff11013aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.045+0000 7ff116908700 1 --2- 172.21.15.59:0/860895403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff110071dd0 0x7ff1100721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.045+0000 7ff116908700 1 --2- 172.21.15.59:0/860895403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff11009e850 0x7ff11009ec60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.045+0000 7ff116908700 1 -- 172.21.15.59:0/860895403 >> 172.21.15.59:0/860895403 conn(0x7ff1100a4130 msgr2=0x7ff1100a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.045+0000 7ff116908700 1 -- 172.21.15.59:0/860895403 shutdown_connections 2023-09-30T22:29:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.045+0000 7ff116908700 1 -- 172.21.15.59:0/860895403 wait complete. 2023-09-30T22:29:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.046+0000 7ff116908700 1 Processor -- start 2023-09-30T22:29:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.046+0000 7ff116908700 1 -- start start 2023-09-30T22:29:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff116908700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff110071dd0 0x7ff1101a7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff116908700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff11009e850 0x7ff1101a7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff116908700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff11009f1a0 0x7ff1101a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff116908700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1101a8d40 con 0x7ff11009f1a0 2023-09-30T22:29:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff116908700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1101a9360 con 0x7ff11009e850 2023-09-30T22:29:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff116908700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1101a9f90 con 0x7ff110071dd0 2023-09-30T22:29:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff10ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff110071dd0 0x7ff1101a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff10f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff11009e850 0x7ff1101a7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff114ea5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff11009f1a0 0x7ff1101a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff10ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff110071dd0 0x7ff1101a7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59622/0 (socket says 172.21.15.59:59622) 2023-09-30T22:29:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff10ffff700 1 -- 172.21.15.59:0/3445492894 learned_addr learned my addr 172.21.15.59:0/3445492894 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff10f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff11009e850 0x7ff1101a7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42434/0 (socket says 172.21.15.59:42434) 2023-09-30T22:29:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff10f7fe700 1 -- 172.21.15.59:0/3445492894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff110071dd0 msgr2=0x7ff1101a7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff10f7fe700 1 --2- 172.21.15.59:0/3445492894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff110071dd0 0x7ff1101a7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff10f7fe700 1 -- 172.21.15.59:0/3445492894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff11009f1a0 msgr2=0x7ff1101a7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff10f7fe700 1 --2- 172.21.15.59:0/3445492894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff11009f1a0 0x7ff1101a7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff10f7fe700 1 -- 172.21.15.59:0/3445492894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1000094a0 con 0x7ff11009e850 2023-09-30T22:29:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff10ffff700 1 --2- 172.21.15.59:0/3445492894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff110071dd0 0x7ff1101a7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff114ea5700 1 --2- 172.21.15.59:0/3445492894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff11009f1a0 0x7ff1101a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff10f7fe700 1 --2- 172.21.15.59:0/3445492894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff11009e850 0x7ff1101a7670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff104016000 tx=0x7ff104004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.047+0000 7ff10cff9700 1 -- 172.21.15.59:0/3445492894 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104004240 con 0x7ff11009e850 2023-09-30T22:29:05.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.048+0000 7ff10cff9700 1 -- 172.21.15.59:0/3445492894 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10401f070 con 0x7ff11009e850 2023-09-30T22:29:05.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.048+0000 7ff116908700 1 -- 172.21.15.59:0/3445492894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff108009a70 con 0x7ff11009e850 2023-09-30T22:29:05.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.048+0000 7ff10cff9700 1 -- 172.21.15.59:0/3445492894 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1040036a0 con 0x7ff11009e850 2023-09-30T22:29:05.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.048+0000 7ff116908700 1 -- 172.21.15.59:0/3445492894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff104009550 con 0x7ff11009e850 2023-09-30T22:29:05.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.049+0000 7ff116908700 1 -- 172.21.15.59:0/3445492894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1100a1420 con 0x7ff11009e850 2023-09-30T22:29:05.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.049+0000 7ff10cff9700 1 -- 172.21.15.59:0/3445492894 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff104021030 con 0x7ff11009e850 2023-09-30T22:29:05.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.049+0000 7ff10cff9700 1 -- 172.21.15.59:0/3445492894 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7ff1040410c0 con 0x7ff11009e850 2023-09-30T22:29:05.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.054+0000 7ff10cff9700 1 -- 172.21.15.59:0/3445492894 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1040239c0 con 0x7ff11009e850 2023-09-30T22:29:05.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.254+0000 7ff116908700 1 -- 172.21.15.59:0/3445492894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff11006cda0 con 0x7ff11009e850 2023-09-30T22:29:05.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.254+0000 7ff10cff9700 1 -- 172.21.15.59:0/3445492894 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff1040150a0 con 0x7ff11009e850 2023-09-30T22:29:05.254 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-30T22:29:05.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.256+0000 7ff116908700 1 -- 172.21.15.59:0/3445492894 >> v1:172.21.15.59:6816/126772 conn(0x7ff0fc02f510 legacy=0x7ff0fc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.256+0000 7ff116908700 1 -- 172.21.15.59:0/3445492894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff11009e850 msgr2=0x7ff1101a7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.256+0000 7ff116908700 1 --2- 172.21.15.59:0/3445492894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff11009e850 0x7ff1101a7670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff104016000 tx=0x7ff104004750 comp rx=0 tx=0).stop 2023-09-30T22:29:05.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.256+0000 7ff116908700 1 -- 172.21.15.59:0/3445492894 shutdown_connections 2023-09-30T22:29:05.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.256+0000 7ff116908700 1 --2- 172.21.15.59:0/3445492894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff110071dd0 0x7ff1101a7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.256+0000 7ff116908700 1 --2- 172.21.15.59:0/3445492894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff11009f1a0 0x7ff1101a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.256+0000 7ff116908700 1 --2- 172.21.15.59:0/3445492894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff11009e850 0x7ff1101a7670 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.256+0000 7ff116908700 1 -- 172.21.15.59:0/3445492894 >> 172.21.15.59:0/3445492894 conn(0x7ff1100a4130 msgr2=0x7ff1101ba970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.257+0000 7ff116908700 1 -- 172.21.15.59:0/3445492894 shutdown_connections 2023-09-30T22:29:05.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.257+0000 7ff116908700 1 -- 172.21.15.59:0/3445492894 wait complete. 2023-09-30T22:29:05.270 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:29:05.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.410+0000 7f823e9f3700 1 Processor -- start 2023-09-30T22:29:05.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.410+0000 7f823e9f3700 1 -- start start 2023-09-30T22:29:05.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f823e9f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f823809d7d0 0x7f823809dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f823e9f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f823809e0e0 0x7f8238130770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f823e9f3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8238130cb0 0x7f8238131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f823e9f3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823809b620 con 0x7f8238130cb0 2023-09-30T22:29:05.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f823e9f3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823809f370 con 0x7f823809e0e0 2023-09-30T22:29:05.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f823e9f3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f823809b800 con 0x7f823809d7d0 2023-09-30T22:29:05.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f82377fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f823809e0e0 0x7f8238130770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f823cf90700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8238130cb0 0x7f8238131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f823cf90700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8238130cb0 0x7f8238131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58426/0 (socket says 172.21.15.59:58426) 2023-09-30T22:29:05.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f8237fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f823809d7d0 0x7f823809dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f823cf90700 1 -- 172.21.15.59:0/2827957728 learned_addr learned my addr 172.21.15.59:0/2827957728 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f82377fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f823809e0e0 0x7f8238130770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42448/0 (socket says 172.21.15.59:42448) 2023-09-30T22:29:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f82377fe700 1 -- 172.21.15.59:0/2827957728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f823809d7d0 msgr2=0x7f823809dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f82377fe700 1 --2- 172.21.15.59:0/2827957728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f823809d7d0 0x7f823809dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f82377fe700 1 -- 172.21.15.59:0/2827957728 >> v2:172.21.15.59:3300/0 conn(0x7f8238130cb0 msgr2=0x7f8238131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f82377fe700 1 --2- 172.21.15.59:0/2827957728 >> v2:172.21.15.59:3300/0 conn(0x7f8238130cb0 0x7f8238131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f82377fe700 1 -- 172.21.15.59:0/2827957728 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823809ef80 con 0x7f823809e0e0 2023-09-30T22:29:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.411+0000 7f82377fe700 1 --2- 172.21.15.59:0/2827957728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f823809e0e0 0x7f8238130770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f822c009870 tx=0x7f822c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db1f592ae1b438af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.412+0000 7f8236ffd700 1 -- 172.21.15.59:0/2827957728 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c011830 con 0x7f823809e0e0 2023-09-30T22:29:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.412+0000 7f8236ffd700 1 -- 172.21.15.59:0/2827957728 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c011990 con 0x7f823809e0e0 2023-09-30T22:29:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.412+0000 7f8236ffd700 1 -- 172.21.15.59:0/2827957728 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c011d20 con 0x7f823809e0e0 2023-09-30T22:29:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.412+0000 7f823e9f3700 1 -- 172.21.15.59:0/2827957728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f823809e0e0 msgr2=0x7f8238130770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.412+0000 7f823e9f3700 1 --2- 172.21.15.59:0/2827957728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f823809e0e0 0x7f8238130770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f822c009870 tx=0x7f822c009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:05.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.412+0000 7f823e9f3700 1 -- 172.21.15.59:0/2827957728 shutdown_connections 2023-09-30T22:29:05.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.412+0000 7f823e9f3700 1 --2- 172.21.15.59:0/2827957728 >> v2:172.21.15.59:3300/0 conn(0x7f8238130cb0 0x7f8238131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.412+0000 7f823e9f3700 1 --2- 172.21.15.59:0/2827957728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f823809d7d0 0x7f823809dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.412+0000 7f823e9f3700 1 --2- 172.21.15.59:0/2827957728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f823809e0e0 0x7f8238130770 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.412+0000 7f823e9f3700 1 -- 172.21.15.59:0/2827957728 >> 172.21.15.59:0/2827957728 conn(0x7f8238066d70 msgr2=0x7f82380a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.412+0000 7f823e9f3700 1 -- 172.21.15.59:0/2827957728 shutdown_connections 2023-09-30T22:29:05.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.412+0000 7f823e9f3700 1 -- 172.21.15.59:0/2827957728 wait complete. 2023-09-30T22:29:05.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.413+0000 7f823e9f3700 1 Processor -- start 2023-09-30T22:29:05.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.413+0000 7f823e9f3700 1 -- start start 2023-09-30T22:29:05.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f823e9f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f823809d7d0 0x7f823811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f823e9f3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f823809e0e0 0x7f823811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f823e9f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8238130cb0 0x7f823811d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f823e9f3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82381212a0 con 0x7f823809e0e0 2023-09-30T22:29:05.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f823e9f3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823811e240 con 0x7f823809d7d0 2023-09-30T22:29:05.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f823e9f3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f823811fc20 con 0x7f8238130cb0 2023-09-30T22:29:05.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f82377fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f823809e0e0 0x7f823811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f8237fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f823809d7d0 0x7f823811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f82377fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f823809e0e0 0x7f823811d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58442/0 (socket says 172.21.15.59:58442) 2023-09-30T22:29:05.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f82377fe700 1 -- 172.21.15.59:0/3016173129 learned_addr learned my addr 172.21.15.59:0/3016173129 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:05.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f823cf90700 1 --2- 172.21.15.59:0/3016173129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8238130cb0 0x7f823811d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f82377fe700 1 -- 172.21.15.59:0/3016173129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8238130cb0 msgr2=0x7f823811d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f82377fe700 1 --2- 172.21.15.59:0/3016173129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8238130cb0 0x7f823811d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f82377fe700 1 -- 172.21.15.59:0/3016173129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f823809d7d0 msgr2=0x7f823811ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f82377fe700 1 --2- 172.21.15.59:0/3016173129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f823809d7d0 0x7f823811ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f82377fe700 1 -- 172.21.15.59:0/3016173129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c0094a0 con 0x7f823809e0e0 2023-09-30T22:29:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.414+0000 7f8237fff700 1 --2- 172.21.15.59:0/3016173129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f823809d7d0 0x7f823811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.415+0000 7f82377fe700 1 --2- 172.21.15.59:0/3016173129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f823809e0e0 0x7f823811d340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f822c000c00 tx=0x7f822c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.415+0000 7f8234ff9700 1 -- 172.21.15.59:0/3016173129 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c004450 con 0x7f823809e0e0 2023-09-30T22:29:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.415+0000 7f8234ff9700 1 -- 172.21.15.59:0/3016173129 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c01f070 con 0x7f823809e0e0 2023-09-30T22:29:05.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.415+0000 7f823e9f3700 1 -- 172.21.15.59:0/3016173129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8238120600 con 0x7f823809e0e0 2023-09-30T22:29:05.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.415+0000 7f8234ff9700 1 -- 172.21.15.59:0/3016173129 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c0038a0 con 0x7f823809e0e0 2023-09-30T22:29:05.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.415+0000 7f823e9f3700 1 -- 172.21.15.59:0/3016173129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823809c720 con 0x7f823809e0e0 2023-09-30T22:29:05.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.416+0000 7f8234ff9700 1 -- 172.21.15.59:0/3016173129 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f822c003a00 con 0x7f823809e0e0 2023-09-30T22:29:05.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.416+0000 7f8234ff9700 1 -- 172.21.15.59:0/3016173129 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f822c021070 con 0x7f823809e0e0 2023-09-30T22:29:05.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.416+0000 7f823e9f3700 1 -- 172.21.15.59:0/3016173129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823804f2a0 con 0x7f823809e0e0 2023-09-30T22:29:05.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.421+0000 7f8234ff9700 1 -- 172.21.15.59:0/3016173129 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f822c02b080 con 0x7f823809e0e0 2023-09-30T22:29:05.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.627+0000 7f823e9f3700 1 -- 172.21.15.59:0/3016173129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82381209a0 con 0x7f823809e0e0 2023-09-30T22:29:05.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.627+0000 7f8234ff9700 1 -- 172.21.15.59:0/3016173129 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f822c015020 con 0x7f823809e0e0 2023-09-30T22:29:05.627 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-30T22:29:05.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.629+0000 7f823e9f3700 1 -- 172.21.15.59:0/3016173129 >> v1:172.21.15.59:6816/126772 conn(0x7f822402f510 legacy=0x7f82240319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.629+0000 7f823e9f3700 1 -- 172.21.15.59:0/3016173129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f823809e0e0 msgr2=0x7f823811d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.629+0000 7f823e9f3700 1 --2- 172.21.15.59:0/3016173129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f823809e0e0 0x7f823811d340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f822c000c00 tx=0x7f822c004750 comp rx=0 tx=0).stop 2023-09-30T22:29:05.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.629+0000 7f823e9f3700 1 -- 172.21.15.59:0/3016173129 shutdown_connections 2023-09-30T22:29:05.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.629+0000 7f823e9f3700 1 --2- 172.21.15.59:0/3016173129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8238130cb0 0x7f823811d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.629+0000 7f823e9f3700 1 --2- 172.21.15.59:0/3016173129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f823809d7d0 0x7f823811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.629+0000 7f823e9f3700 1 --2- 172.21.15.59:0/3016173129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f823809e0e0 0x7f823811d340 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.629+0000 7f823e9f3700 1 -- 172.21.15.59:0/3016173129 >> 172.21.15.59:0/3016173129 conn(0x7f8238066d70 msgr2=0x7f82380720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.630+0000 7f823e9f3700 1 -- 172.21.15.59:0/3016173129 shutdown_connections 2023-09-30T22:29:05.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.630+0000 7f823e9f3700 1 -- 172.21.15.59:0/3016173129 wait complete. 2023-09-30T22:29:05.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:29:05.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.779+0000 7ff80eaf0700 1 Processor -- start 2023-09-30T22:29:05.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.779+0000 7ff80eaf0700 1 -- start start 2023-09-30T22:29:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.779+0000 7ff80eaf0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff80809d6f0 0x7ff80809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.779+0000 7ff80eaf0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff80809e000 0x7ff808130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.779+0000 7ff80eaf0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff80809e410 0x7ff808130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.779+0000 7ff80eaf0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80809f520 con 0x7ff80809e000 2023-09-30T22:29:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.779+0000 7ff80eaf0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80809f130 con 0x7ff80809e410 2023-09-30T22:29:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.779+0000 7ff80eaf0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff80809e930 con 0x7ff80809d6f0 2023-09-30T22:29:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.779+0000 7ff80c88c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff80809d6f0 0x7ff80809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.779+0000 7ff807fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff80809e000 0x7ff808130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.780+0000 7ff80d08d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff80809e410 0x7ff808130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.780+0000 7ff80c88c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff80809d6f0 0x7ff80809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59662/0 (socket says 172.21.15.59:59662) 2023-09-30T22:29:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.780+0000 7ff80c88c700 1 -- 172.21.15.59:0/3639676432 learned_addr learned my addr 172.21.15.59:0/3639676432 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.780+0000 7ff807fff700 1 -- 172.21.15.59:0/3639676432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff80809d6f0 msgr2=0x7ff80809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.780+0000 7ff807fff700 1 --2- 172.21.15.59:0/3639676432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff80809d6f0 0x7ff80809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.780+0000 7ff807fff700 1 -- 172.21.15.59:0/3639676432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff80809e410 msgr2=0x7ff808130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.780+0000 7ff807fff700 1 --2- 172.21.15.59:0/3639676432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff80809e410 0x7ff808130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.780+0000 7ff807fff700 1 -- 172.21.15.59:0/3639676432 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80809b2d0 con 0x7ff80809e000 2023-09-30T22:29:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.780+0000 7ff80d08d700 1 --2- 172.21.15.59:0/3639676432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff80809e410 0x7ff808130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.780+0000 7ff807fff700 1 --2- 172.21.15.59:0/3639676432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff80809e000 0x7ff808130660 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009870 tx=0x7ff7fc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce42f06fe0b19a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.780+0000 7ff8077fe700 1 -- 172.21.15.59:0/3639676432 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc011830 con 0x7ff80809e000 2023-09-30T22:29:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.780+0000 7ff8077fe700 1 -- 172.21.15.59:0/3639676432 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7fc011990 con 0x7ff80809e000 2023-09-30T22:29:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.780+0000 7ff8077fe700 1 -- 172.21.15.59:0/3639676432 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc011d20 con 0x7ff80809e000 2023-09-30T22:29:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.781+0000 7ff80eaf0700 1 -- 172.21.15.59:0/3639676432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff80809e000 msgr2=0x7ff808130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.781+0000 7ff80eaf0700 1 --2- 172.21.15.59:0/3639676432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff80809e000 0x7ff808130660 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009870 tx=0x7ff7fc009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.781+0000 7ff80eaf0700 1 -- 172.21.15.59:0/3639676432 shutdown_connections 2023-09-30T22:29:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.781+0000 7ff80eaf0700 1 --2- 172.21.15.59:0/3639676432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff80809e410 0x7ff808130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.781+0000 7ff80eaf0700 1 --2- 172.21.15.59:0/3639676432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff80809d6f0 0x7ff80809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.781+0000 7ff80eaf0700 1 --2- 172.21.15.59:0/3639676432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff80809e000 0x7ff808130660 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.781+0000 7ff80eaf0700 1 -- 172.21.15.59:0/3639676432 >> 172.21.15.59:0/3639676432 conn(0x7ff808066f50 msgr2=0x7ff80809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.781+0000 7ff80eaf0700 1 -- 172.21.15.59:0/3639676432 shutdown_connections 2023-09-30T22:29:05.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.781+0000 7ff80eaf0700 1 -- 172.21.15.59:0/3639676432 wait complete. 2023-09-30T22:29:05.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.782+0000 7ff80eaf0700 1 Processor -- start 2023-09-30T22:29:05.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.782+0000 7ff80eaf0700 1 -- start start 2023-09-30T22:29:05.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.782+0000 7ff80eaf0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff80809d6f0 0x7ff8081c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff80eaf0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff80809e000 0x7ff8081c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff80eaf0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff80809e410 0x7ff8081c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff80eaf0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8081258c0 con 0x7ff80809e000 2023-09-30T22:29:05.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff80eaf0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff808120140 con 0x7ff80809d6f0 2023-09-30T22:29:05.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff80eaf0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff80809c700 con 0x7ff80809e410 2023-09-30T22:29:05.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff80c88c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff80809d6f0 0x7ff8081c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff807fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff80809e000 0x7ff8081c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff80d08d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff80809e410 0x7ff8081c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff80c88c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff80809d6f0 0x7ff8081c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42468/0 (socket says 172.21.15.59:42468) 2023-09-30T22:29:05.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff80c88c700 1 -- 172.21.15.59:0/4289263141 learned_addr learned my addr 172.21.15.59:0/4289263141 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:05.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff807fff700 1 -- 172.21.15.59:0/4289263141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff80809e410 msgr2=0x7ff8081c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff807fff700 1 --2- 172.21.15.59:0/4289263141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff80809e410 0x7ff8081c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff807fff700 1 -- 172.21.15.59:0/4289263141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff80809d6f0 msgr2=0x7ff8081c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff807fff700 1 --2- 172.21.15.59:0/4289263141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff80809d6f0 0x7ff8081c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff807fff700 1 -- 172.21.15.59:0/4289263141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800009a70 con 0x7ff80809e000 2023-09-30T22:29:05.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff80c88c700 1 --2- 172.21.15.59:0/4289263141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff80809d6f0 0x7ff8081c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff80d08d700 1 --2- 172.21.15.59:0/4289263141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff80809e410 0x7ff8081c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff807fff700 1 --2- 172.21.15.59:0/4289263141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff80809e000 0x7ff8081c89c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc016000 tx=0x7ff7fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff8057fa700 1 -- 172.21.15.59:0/4289263141 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc004450 con 0x7ff80809e000 2023-09-30T22:29:05.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff8057fa700 1 -- 172.21.15.59:0/4289263141 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7fc01f070 con 0x7ff80809e000 2023-09-30T22:29:05.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff80eaf0700 1 -- 172.21.15.59:0/4289263141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7fc0094a0 con 0x7ff80809e000 2023-09-30T22:29:05.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.783+0000 7ff8057fa700 1 -- 172.21.15.59:0/4289263141 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc0038e0 con 0x7ff80809e000 2023-09-30T22:29:05.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.784+0000 7ff80eaf0700 1 -- 172.21.15.59:0/4289263141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff808125ea0 con 0x7ff80809e000 2023-09-30T22:29:05.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.784+0000 7ff8057fa700 1 -- 172.21.15.59:0/4289263141 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff7fc003a40 con 0x7ff80809e000 2023-09-30T22:29:05.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.785+0000 7ff8057fa700 1 -- 172.21.15.59:0/4289263141 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7ff7fc021070 con 0x7ff80809e000 2023-09-30T22:29:05.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.785+0000 7ff80eaf0700 1 -- 172.21.15.59:0/4289263141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff808074ea0 con 0x7ff80809e000 2023-09-30T22:29:05.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:05.790+0000 7ff8057fa700 1 -- 172.21.15.59:0/4289263141 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7fc02b080 con 0x7ff80809e000 2023-09-30T22:29:06.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.033+0000 7ff80eaf0700 1 -- 172.21.15.59:0/4289263141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff808125c70 con 0x7ff80809e000 2023-09-30T22:29:06.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.034+0000 7ff8057fa700 1 -- 172.21.15.59:0/4289263141 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2315 (secure 0 0 0) 0x7ff7fc015020 con 0x7ff80809e000 2023-09-30T22:29:06.034 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:06.034 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:26:34.412591+0000","modified":"2023-09-30T22:27:00.923070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/2103029646","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":2103029646}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T22:29:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.036+0000 7ff80eaf0700 1 -- 172.21.15.59:0/4289263141 >> v1:172.21.15.59:6816/126772 conn(0x7ff7f402f510 legacy=0x7ff7f40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.036+0000 7ff80eaf0700 1 -- 172.21.15.59:0/4289263141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff80809e000 msgr2=0x7ff8081c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.036+0000 7ff80eaf0700 1 --2- 172.21.15.59:0/4289263141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff80809e000 0x7ff8081c89c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc016000 tx=0x7ff7fc004750 comp rx=0 tx=0).stop 2023-09-30T22:29:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.036+0000 7ff80eaf0700 1 -- 172.21.15.59:0/4289263141 shutdown_connections 2023-09-30T22:29:06.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.036+0000 7ff80eaf0700 1 --2- 172.21.15.59:0/4289263141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff80809e410 0x7ff8081c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.036+0000 7ff80eaf0700 1 --2- 172.21.15.59:0/4289263141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff80809d6f0 0x7ff8081c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.036+0000 7ff80eaf0700 1 --2- 172.21.15.59:0/4289263141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff80809e000 0x7ff8081c89c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.036+0000 7ff80eaf0700 1 -- 172.21.15.59:0/4289263141 >> 172.21.15.59:0/4289263141 conn(0x7ff808066f50 msgr2=0x7ff808119480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:06.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.036+0000 7ff80eaf0700 1 -- 172.21.15.59:0/4289263141 shutdown_connections 2023-09-30T22:29:06.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.036+0000 7ff80eaf0700 1 -- 172.21.15.59:0/4289263141 wait complete. 2023-09-30T22:29:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-09-30T22:29:06.051 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:29:06.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.186+0000 7fbb2c705700 1 Processor -- start 2023-09-30T22:29:06.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.186+0000 7fbb2c705700 1 -- start start 2023-09-30T22:29:06.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb2c705700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb2409d6f0 0x7fbb2409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb2c705700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb2409e000 0x7fbb24130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb2c705700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb2409e410 0x7fbb24130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb2c705700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2409f520 con 0x7fbb2409e000 2023-09-30T22:29:06.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb2c705700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2409f130 con 0x7fbb2409e410 2023-09-30T22:29:06.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb2c705700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2409e930 con 0x7fbb2409d6f0 2023-09-30T22:29:06.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb2a4a1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb2409d6f0 0x7fbb2409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb2aca2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb2409e410 0x7fbb24130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb29ca0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb2409e000 0x7fbb24130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb2aca2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb2409e410 0x7fbb24130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42474/0 (socket says 172.21.15.59:42474) 2023-09-30T22:29:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb29ca0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb2409e000 0x7fbb24130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58482/0 (socket says 172.21.15.59:58482) 2023-09-30T22:29:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb2a4a1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb2409d6f0 0x7fbb2409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59680/0 (socket says 172.21.15.59:59680) 2023-09-30T22:29:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb2aca2700 1 -- 172.21.15.59:0/37299806 learned_addr learned my addr 172.21.15.59:0/37299806 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb29ca0700 1 -- 172.21.15.59:0/37299806 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb2409d6f0 msgr2=0x7fbb2409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb29ca0700 1 --2- 172.21.15.59:0/37299806 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb2409d6f0 0x7fbb2409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb29ca0700 1 -- 172.21.15.59:0/37299806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb2409e410 msgr2=0x7fbb24130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb29ca0700 1 --2- 172.21.15.59:0/37299806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb2409e410 0x7fbb24130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb29ca0700 1 -- 172.21.15.59:0/37299806 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2409b2d0 con 0x7fbb2409e000 2023-09-30T22:29:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.187+0000 7fbb2aca2700 1 --2- 172.21.15.59:0/37299806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb2409e410 0x7fbb24130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.188+0000 7fbb29ca0700 1 --2- 172.21.15.59:0/37299806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb2409e000 0x7fbb24130660 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009870 tx=0x7fbb14009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da39484c64b6ab0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.188+0000 7fbb2949f700 1 -- 172.21.15.59:0/37299806 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14011830 con 0x7fbb2409e000 2023-09-30T22:29:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.188+0000 7fbb2949f700 1 -- 172.21.15.59:0/37299806 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb14011990 con 0x7fbb2409e000 2023-09-30T22:29:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.188+0000 7fbb2949f700 1 -- 172.21.15.59:0/37299806 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14011d20 con 0x7fbb2409e000 2023-09-30T22:29:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.188+0000 7fbb2c705700 1 -- 172.21.15.59:0/37299806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb2409e000 msgr2=0x7fbb24130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.188+0000 7fbb2c705700 1 --2- 172.21.15.59:0/37299806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb2409e000 0x7fbb24130660 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009870 tx=0x7fbb14009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.188+0000 7fbb2c705700 1 -- 172.21.15.59:0/37299806 shutdown_connections 2023-09-30T22:29:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.188+0000 7fbb2c705700 1 --2- 172.21.15.59:0/37299806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb2409e410 0x7fbb24130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.188+0000 7fbb2c705700 1 --2- 172.21.15.59:0/37299806 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb2409d6f0 0x7fbb2409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.188+0000 7fbb2c705700 1 --2- 172.21.15.59:0/37299806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb2409e000 0x7fbb24130660 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.188+0000 7fbb2c705700 1 -- 172.21.15.59:0/37299806 >> 172.21.15.59:0/37299806 conn(0x7fbb24066f50 msgr2=0x7fbb2409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:06.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.188+0000 7fbb2c705700 1 -- 172.21.15.59:0/37299806 shutdown_connections 2023-09-30T22:29:06.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.189+0000 7fbb2c705700 1 -- 172.21.15.59:0/37299806 wait complete. 2023-09-30T22:29:06.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.189+0000 7fbb2c705700 1 Processor -- start 2023-09-30T22:29:06.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.189+0000 7fbb2c705700 1 -- start start 2023-09-30T22:29:06.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb2c705700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb2409d6f0 0x7fbb24122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb2c705700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb2409e000 0x7fbb24122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb2c705700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb2409e410 0x7fbb24123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb2c705700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb24125c60 con 0x7fbb2409d6f0 2023-09-30T22:29:06.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb2c705700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb24126200 con 0x7fbb2409e410 2023-09-30T22:29:06.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb2c705700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb24124b10 con 0x7fbb2409e000 2023-09-30T22:29:06.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb2a4a1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb2409d6f0 0x7fbb24122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb2aca2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb2409e410 0x7fbb24123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb29ca0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb2409e000 0x7fbb24122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb29ca0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb2409e000 0x7fbb24122cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59696/0 (socket says 172.21.15.59:59696) 2023-09-30T22:29:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb2aca2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb2409e410 0x7fbb24123200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42478/0 (socket says 172.21.15.59:42478) 2023-09-30T22:29:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb29ca0700 1 -- 172.21.15.59:0/2378495005 learned_addr learned my addr 172.21.15.59:0/2378495005 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb2aca2700 1 -- 172.21.15.59:0/2378495005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb2409e000 msgr2=0x7fbb24122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb2aca2700 1 --2- 172.21.15.59:0/2378495005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb2409e000 0x7fbb24122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb2aca2700 1 -- 172.21.15.59:0/2378495005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb2409d6f0 msgr2=0x7fbb24122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb2aca2700 1 --2- 172.21.15.59:0/2378495005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb2409d6f0 0x7fbb24122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb2aca2700 1 -- 172.21.15.59:0/2378495005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c009b30 con 0x7fbb2409e410 2023-09-30T22:29:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb2a4a1700 1 --2- 172.21.15.59:0/2378495005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb2409d6f0 0x7fbb24122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.190+0000 7fbb29ca0700 1 --2- 172.21.15.59:0/2378495005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb2409e000 0x7fbb24122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.191+0000 7fbb2aca2700 1 --2- 172.21.15.59:0/2378495005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb2409e410 0x7fbb24123200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00efc0 tx=0x7fbb1c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:06.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.191+0000 7fbb1affd700 1 -- 172.21.15.59:0/2378495005 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c018070 con 0x7fbb2409e410 2023-09-30T22:29:06.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.191+0000 7fbb1affd700 1 -- 172.21.15.59:0/2378495005 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c00f040 con 0x7fbb2409e410 2023-09-30T22:29:06.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.191+0000 7fbb1affd700 1 -- 172.21.15.59:0/2378495005 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c003c60 con 0x7fbb2409e410 2023-09-30T22:29:06.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.191+0000 7fbb2c705700 1 -- 172.21.15.59:0/2378495005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb140094a0 con 0x7fbb2409e410 2023-09-30T22:29:06.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.191+0000 7fbb2c705700 1 -- 172.21.15.59:0/2378495005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2409c700 con 0x7fbb2409e410 2023-09-30T22:29:06.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.192+0000 7fbb1affd700 1 -- 172.21.15.59:0/2378495005 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbb1c00c880 con 0x7fbb2409e410 2023-09-30T22:29:06.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.192+0000 7fbb1affd700 1 -- 172.21.15.59:0/2378495005 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fbb1c03fcb0 con 0x7fbb2409e410 2023-09-30T22:29:06.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.192+0000 7fbb2c705700 1 -- 172.21.15.59:0/2378495005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb24130600 con 0x7fbb2409e410 2023-09-30T22:29:06.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.197+0000 7fbb1affd700 1 -- 172.21.15.59:0/2378495005 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb1c003dc0 con 0x7fbb2409e410 2023-09-30T22:29:06.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.402+0000 7fbb2c705700 1 -- 172.21.15.59:0/2378495005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb24074ea0 con 0x7fbb2409e410 2023-09-30T22:29:06.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.403+0000 7fbb1affd700 1 -- 172.21.15.59:0/2378495005 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+12919 (secure 0 0 0) 0x7fbb1c01cb60 con 0x7fbb2409e410 2023-09-30T22:29:06.403 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:06.404 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:29:01.577848+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/3882222550":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/1346763106":"2023-10-01T22:28:59.561079+0000","172.21.15.59:6816/118188":"2023-10-01T22:28:59.561079+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:29:06.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.406+0000 7fbb2c705700 1 -- 172.21.15.59:0/2378495005 >> v1:172.21.15.59:6816/126772 conn(0x7fbb0802f510 legacy=0x7fbb080319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.406+0000 7fbb2c705700 1 -- 172.21.15.59:0/2378495005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb2409e410 msgr2=0x7fbb24123200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.406+0000 7fbb2c705700 1 --2- 172.21.15.59:0/2378495005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb2409e410 0x7fbb24123200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00efc0 tx=0x7fbb1c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.406+0000 7fbb2c705700 1 -- 172.21.15.59:0/2378495005 shutdown_connections 2023-09-30T22:29:06.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.406+0000 7fbb2c705700 1 --2- 172.21.15.59:0/2378495005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb2409e410 0x7fbb24123200 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.406+0000 7fbb2c705700 1 --2- 172.21.15.59:0/2378495005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb2409d6f0 0x7fbb24122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.406+0000 7fbb2c705700 1 --2- 172.21.15.59:0/2378495005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb2409e000 0x7fbb24122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.406+0000 7fbb2c705700 1 -- 172.21.15.59:0/2378495005 >> 172.21.15.59:0/2378495005 conn(0x7fbb24066f50 msgr2=0x7fbb240a1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:06.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.406+0000 7fbb2c705700 1 -- 172.21.15.59:0/2378495005 shutdown_connections 2023-09-30T22:29:06.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.406+0000 7fbb2c705700 1 -- 172.21.15.59:0/2378495005 wait complete. 2023-09-30T22:29:06.419 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:26:26.893716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:26:28.448775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:26:32.964075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:26:33.390842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T22:29:06.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:29:06.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.564+0000 7f5231433700 1 Processor -- start 2023-09-30T22:29:06.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.564+0000 7f5231433700 1 -- start start 2023-09-30T22:29:06.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.564+0000 7f5231433700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c133cc0 0x7f522c134090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.564+0000 7f5231433700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f522c1345d0 0x7f522c0a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f5231433700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522c09e1f0 con 0x7f522c0a0f70 2023-09-30T22:29:06.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f5231433700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522c0a23b0 con 0x7f522c1345d0 2023-09-30T22:29:06.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f5231433700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f522c09df30 con 0x7f522c133cc0 2023-09-30T22:29:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f522a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f522c1345d0 0x7f522c0a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f522affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c133cc0 0x7f522c134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f522b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f522c0a0f70 0x7f522c13ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49448/0 (socket says 172.21.15.59:49448) 2023-09-30T22:29:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f522a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f522c1345d0 0x7f522c0a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58508/0 (socket says 172.21.15.59:58508) 2023-09-30T22:29:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f522b7fe700 1 -- 172.21.15.59:0/1475502291 learned_addr learned my addr 172.21.15.59:0/1475502291 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f522affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c133cc0 0x7f522c134090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59712/0 (socket says 172.21.15.59:59712) 2023-09-30T22:29:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f522affd700 1 -- 172.21.15.59:0/1475502291 >> v2:172.21.15.59:3300/0 conn(0x7f522c1345d0 msgr2=0x7f522c0a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f522affd700 1 --2- 172.21.15.59:0/1475502291 >> v2:172.21.15.59:3300/0 conn(0x7f522c1345d0 0x7f522c0a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f522affd700 1 -- 172.21.15.59:0/1475502291 >> v1:172.21.15.59:6789/0 conn(0x7f522c0a0f70 legacy=0x7f522c13ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f522affd700 1 -- 172.21.15.59:0/1475502291 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c09d960 con 0x7f522c133cc0 2023-09-30T22:29:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f522affd700 1 --2- 172.21.15.59:0/1475502291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c133cc0 0x7f522c134090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f521c009840 tx=0x7f521c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9e69e28bf9c8553 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f5229ffb700 1 -- 172.21.15.59:0/1475502291 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c011830 con 0x7f522c133cc0 2023-09-30T22:29:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f5229ffb700 1 -- 172.21.15.59:0/1475502291 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c011990 con 0x7f522c133cc0 2023-09-30T22:29:06.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.565+0000 7f5229ffb700 1 -- 172.21.15.59:0/1475502291 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c011d20 con 0x7f522c133cc0 2023-09-30T22:29:06.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.566+0000 7f5231433700 1 -- 172.21.15.59:0/1475502291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c133cc0 msgr2=0x7f522c134090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.566+0000 7f5231433700 1 --2- 172.21.15.59:0/1475502291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c133cc0 0x7f522c134090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f521c009840 tx=0x7f521c009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:06.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.566+0000 7f5231433700 1 -- 172.21.15.59:0/1475502291 shutdown_connections 2023-09-30T22:29:06.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.566+0000 7f5231433700 1 --2- 172.21.15.59:0/1475502291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c133cc0 0x7f522c134090 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.566+0000 7f5231433700 1 --2- 172.21.15.59:0/1475502291 >> v2:172.21.15.59:3300/0 conn(0x7f522c1345d0 0x7f522c0a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.566+0000 7f5231433700 1 -- 172.21.15.59:0/1475502291 >> 172.21.15.59:0/1475502291 conn(0x7f522c0a3050 msgr2=0x7f522c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:06.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.566+0000 7f5231433700 1 -- 172.21.15.59:0/1475502291 shutdown_connections 2023-09-30T22:29:06.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.566+0000 7f5231433700 1 -- 172.21.15.59:0/1475502291 wait complete. 2023-09-30T22:29:06.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.567+0000 7f5231433700 1 Processor -- start 2023-09-30T22:29:06.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.567+0000 7f5231433700 1 -- start start 2023-09-30T22:29:06.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f5231433700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522c0a0f70 0x7f522c122420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f5231433700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c133cc0 0x7f522c122960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f5231433700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c1345d0 0x7f522c122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f5231433700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c124ef0 con 0x7f522c133cc0 2023-09-30T22:29:06.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f5231433700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c125c10 con 0x7f522c0a0f70 2023-09-30T22:29:06.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f5231433700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f522c123880 con 0x7f522c1345d0 2023-09-30T22:29:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f522a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c133cc0 0x7f522c122960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f522affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522c0a0f70 0x7f522c122420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f522b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c1345d0 0x7f522c122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f522a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c133cc0 0x7f522c122960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58510/0 (socket says 172.21.15.59:58510) 2023-09-30T22:29:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f522a7fc700 1 -- 172.21.15.59:0/3701722167 learned_addr learned my addr 172.21.15.59:0/3701722167 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f522a7fc700 1 -- 172.21.15.59:0/3701722167 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c1345d0 msgr2=0x7f522c122ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f522a7fc700 1 --2- 172.21.15.59:0/3701722167 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c1345d0 0x7f522c122ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f522a7fc700 1 -- 172.21.15.59:0/3701722167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522c0a0f70 msgr2=0x7f522c122420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f522a7fc700 1 --2- 172.21.15.59:0/3701722167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522c0a0f70 0x7f522c122420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f522a7fc700 1 -- 172.21.15.59:0/3701722167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c0094a0 con 0x7f522c133cc0 2023-09-30T22:29:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f522affd700 1 --2- 172.21.15.59:0/3701722167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522c0a0f70 0x7f522c122420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f522a7fc700 1 --2- 172.21.15.59:0/3701722167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c133cc0 0x7f522c122960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f521400e980 tx=0x7f521400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f52237fe700 1 -- 172.21.15.59:0/3701722167 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5214013680 con 0x7f522c133cc0 2023-09-30T22:29:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f52237fe700 1 -- 172.21.15.59:0/3701722167 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52140137e0 con 0x7f522c133cc0 2023-09-30T22:29:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.568+0000 7f5231433700 1 -- 172.21.15.59:0/3701722167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522c1337c0 con 0x7f522c133cc0 2023-09-30T22:29:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.569+0000 7f52237fe700 1 -- 172.21.15.59:0/3701722167 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5214013b50 con 0x7f522c133cc0 2023-09-30T22:29:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.569+0000 7f5231433700 1 -- 172.21.15.59:0/3701722167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522c126680 con 0x7f522c133cc0 2023-09-30T22:29:06.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.569+0000 7f52237fe700 1 -- 172.21.15.59:0/3701722167 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5214013cb0 con 0x7f522c133cc0 2023-09-30T22:29:06.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.569+0000 7f5231433700 1 -- 172.21.15.59:0/3701722167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522c04f2a0 con 0x7f522c133cc0 2023-09-30T22:29:06.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.570+0000 7f52237fe700 1 -- 172.21.15.59:0/3701722167 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f521403ff00 con 0x7f522c133cc0 2023-09-30T22:29:06.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.574+0000 7f52237fe700 1 -- 172.21.15.59:0/3701722167 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f521401adc0 con 0x7f522c133cc0 2023-09-30T22:29:06.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.775+0000 7f5231433700 1 -- 172.21.15.59:0/3701722167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f522c06d570 con 0x7f522c133cc0 2023-09-30T22:29:06.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.776+0000 7f52237fe700 1 -- 172.21.15.59:0/3701722167 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52140210a0 con 0x7f522c133cc0 2023-09-30T22:29:06.776 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-30T22:29:06.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.778+0000 7f5231433700 1 -- 172.21.15.59:0/3701722167 >> v1:172.21.15.59:6816/126772 conn(0x7f520c02f510 legacy=0x7f520c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.778+0000 7f5231433700 1 -- 172.21.15.59:0/3701722167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c133cc0 msgr2=0x7f522c122960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.778+0000 7f5231433700 1 --2- 172.21.15.59:0/3701722167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c133cc0 0x7f522c122960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f521400e980 tx=0x7f521400ec90 comp rx=0 tx=0).stop 2023-09-30T22:29:06.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.778+0000 7f5231433700 1 -- 172.21.15.59:0/3701722167 shutdown_connections 2023-09-30T22:29:06.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.778+0000 7f5231433700 1 --2- 172.21.15.59:0/3701722167 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c1345d0 0x7f522c122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.778+0000 7f5231433700 1 --2- 172.21.15.59:0/3701722167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522c0a0f70 0x7f522c122420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.778+0000 7f5231433700 1 --2- 172.21.15.59:0/3701722167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c133cc0 0x7f522c122960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.778+0000 7f5231433700 1 -- 172.21.15.59:0/3701722167 >> 172.21.15.59:0/3701722167 conn(0x7f522c0a3050 msgr2=0x7f522c0a5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:06.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.778+0000 7f5231433700 1 -- 172.21.15.59:0/3701722167 shutdown_connections 2023-09-30T22:29:06.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.778+0000 7f5231433700 1 -- 172.21.15.59:0/3701722167 wait complete. 2023-09-30T22:29:06.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:29:06.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.931+0000 7f590a598700 1 Processor -- start 2023-09-30T22:29:06.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.931+0000 7f590a598700 1 -- start start 2023-09-30T22:29:06.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f590a598700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f590409d7d0 0x7f590409dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f590a598700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f590409e0e0 0x7f5904130770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f590a598700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5904130cb0 0x7f5904131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f590a598700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590409b620 con 0x7f590409e0e0 2023-09-30T22:29:06.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f590a598700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590409f370 con 0x7f590409d7d0 2023-09-30T22:29:06.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f590a598700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f590409b800 con 0x7f5904130cb0 2023-09-30T22:29:06.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f5903fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f590409d7d0 0x7f590409dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f5908b35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5904130cb0 0x7f5904131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f5903fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f590409d7d0 0x7f590409dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42502/0 (socket says 172.21.15.59:42502) 2023-09-30T22:29:06.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f5903fff700 1 -- 172.21.15.59:0/3172678042 learned_addr learned my addr 172.21.15.59:0/3172678042 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:06.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f5908b35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5904130cb0 0x7f5904131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59730/0 (socket says 172.21.15.59:59730) 2023-09-30T22:29:06.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f59037fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f590409e0e0 0x7f5904130770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f5903fff700 1 -- 172.21.15.59:0/3172678042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5904130cb0 msgr2=0x7f5904131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:06.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f5903fff700 1 --2- 172.21.15.59:0/3172678042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5904130cb0 0x7f5904131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f5903fff700 1 -- 172.21.15.59:0/3172678042 >> v2:172.21.15.59:3300/0 conn(0x7f590409e0e0 msgr2=0x7f5904130770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:06.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f5903fff700 1 --2- 172.21.15.59:0/3172678042 >> v2:172.21.15.59:3300/0 conn(0x7f590409e0e0 0x7f5904130770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f5903fff700 1 -- 172.21.15.59:0/3172678042 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590409ef80 con 0x7f590409d7d0 2023-09-30T22:29:06.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f5908b35700 1 --2- 172.21.15.59:0/3172678042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5904130cb0 0x7f5904131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f59037fe700 1 --2- 172.21.15.59:0/3172678042 >> v2:172.21.15.59:3300/0 conn(0x7f590409e0e0 0x7f5904130770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.932+0000 7f5903fff700 1 --2- 172.21.15.59:0/3172678042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f590409d7d0 0x7f590409dba0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f58f400bbc0 tx=0x7f58f400bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1fc3faf47849f1d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:06.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.933+0000 7f5902ffd700 1 -- 172.21.15.59:0/3172678042 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f400dcf0 con 0x7f590409d7d0 2023-09-30T22:29:06.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.933+0000 7f5902ffd700 1 -- 172.21.15.59:0/3172678042 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f400de50 con 0x7f590409d7d0 2023-09-30T22:29:06.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.933+0000 7f5902ffd700 1 -- 172.21.15.59:0/3172678042 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4010690 con 0x7f590409d7d0 2023-09-30T22:29:06.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.933+0000 7f590a598700 1 -- 172.21.15.59:0/3172678042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f590409d7d0 msgr2=0x7f590409dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.933+0000 7f590a598700 1 --2- 172.21.15.59:0/3172678042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f590409d7d0 0x7f590409dba0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f58f400bbc0 tx=0x7f58f400bed0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.933+0000 7f590a598700 1 -- 172.21.15.59:0/3172678042 shutdown_connections 2023-09-30T22:29:06.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.933+0000 7f590a598700 1 --2- 172.21.15.59:0/3172678042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5904130cb0 0x7f5904131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.933+0000 7f590a598700 1 --2- 172.21.15.59:0/3172678042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f590409d7d0 0x7f590409dba0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.933+0000 7f590a598700 1 --2- 172.21.15.59:0/3172678042 >> v2:172.21.15.59:3300/0 conn(0x7f590409e0e0 0x7f5904130770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.933+0000 7f590a598700 1 -- 172.21.15.59:0/3172678042 >> 172.21.15.59:0/3172678042 conn(0x7f5904066d70 msgr2=0x7f59040a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:06.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.933+0000 7f590a598700 1 -- 172.21.15.59:0/3172678042 shutdown_connections 2023-09-30T22:29:06.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.933+0000 7f590a598700 1 -- 172.21.15.59:0/3172678042 wait complete. 2023-09-30T22:29:06.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.934+0000 7f590a598700 1 Processor -- start 2023-09-30T22:29:06.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.934+0000 7f590a598700 1 -- start start 2023-09-30T22:29:06.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f590a598700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f590409d7d0 0x7f590411ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f590a598700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f590409e0e0 0x7f590411b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f590a598700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5904130cb0 0x7f590411b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f590a598700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590411cf90 con 0x7f590409e0e0 2023-09-30T22:29:06.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f590a598700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590411e050 con 0x7f5904130cb0 2023-09-30T22:29:06.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f590a598700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f590409c720 con 0x7f590409d7d0 2023-09-30T22:29:06.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f5908b35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5904130cb0 0x7f590411b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f5903fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f590409d7d0 0x7f590411ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f59037fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f590409e0e0 0x7f590411b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f5903fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f590409d7d0 0x7f590411ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59738/0 (socket says 172.21.15.59:59738) 2023-09-30T22:29:06.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f5903fff700 1 -- 172.21.15.59:0/1316161015 learned_addr learned my addr 172.21.15.59:0/1316161015 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:06.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f59037fe700 1 --2- 172.21.15.59:0/1316161015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f590409e0e0 0x7f590411b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58526/0 (socket says 172.21.15.59:58526) 2023-09-30T22:29:06.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f5903fff700 1 -- 172.21.15.59:0/1316161015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5904130cb0 msgr2=0x7f590411b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f5903fff700 1 --2- 172.21.15.59:0/1316161015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5904130cb0 0x7f590411b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f5903fff700 1 -- 172.21.15.59:0/1316161015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f590409e0e0 msgr2=0x7f590411b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f5903fff700 1 --2- 172.21.15.59:0/1316161015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f590409e0e0 0x7f590411b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f5903fff700 1 -- 172.21.15.59:0/1316161015 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f80094a0 con 0x7f590409d7d0 2023-09-30T22:29:06.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f59037fe700 1 --2- 172.21.15.59:0/1316161015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f590409e0e0 0x7f590411b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.935+0000 7f5908b35700 1 --2- 172.21.15.59:0/1316161015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5904130cb0 0x7f590411b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.936+0000 7f5903fff700 1 --2- 172.21.15.59:0/1316161015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f590409d7d0 0x7f590411ada0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f58f4000c00 tx=0x7f58f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:06.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.936+0000 7f5900ff9700 1 -- 172.21.15.59:0/1316161015 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f401f070 con 0x7f590409d7d0 2023-09-30T22:29:06.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.936+0000 7f5900ff9700 1 -- 172.21.15.59:0/1316161015 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f40038b0 con 0x7f590409d7d0 2023-09-30T22:29:06.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.936+0000 7f590a598700 1 -- 172.21.15.59:0/1316161015 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc009a70 con 0x7f590409d7d0 2023-09-30T22:29:06.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.936+0000 7f5900ff9700 1 -- 172.21.15.59:0/1316161015 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4003c60 con 0x7f590409d7d0 2023-09-30T22:29:06.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.936+0000 7f590a598700 1 -- 172.21.15.59:0/1316161015 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f400b7f0 con 0x7f590409d7d0 2023-09-30T22:29:06.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.937+0000 7f5900ff9700 1 -- 172.21.15.59:0/1316161015 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f58f4019400 con 0x7f590409d7d0 2023-09-30T22:29:06.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.937+0000 7f5900ff9700 1 -- 172.21.15.59:0/1316161015 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f58f4042d20 con 0x7f590409d7d0 2023-09-30T22:29:06.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.937+0000 7f590a598700 1 -- 172.21.15.59:0/1316161015 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590411ca10 con 0x7f590409d7d0 2023-09-30T22:29:06.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:06.942+0000 7f5900ff9700 1 -- 172.21.15.59:0/1316161015 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58f4021310 con 0x7f590409d7d0 2023-09-30T22:29:07.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.145+0000 7f590a598700 1 -- 172.21.15.59:0/1316161015 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f590404f2a0 con 0x7f590409d7d0 2023-09-30T22:29:07.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.146+0000 7f5900ff9700 1 -- 172.21.15.59:0/1316161015 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f58f402ab00 con 0x7f590409d7d0 2023-09-30T22:29:07.146 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-09-30T22:29:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.148+0000 7f590a598700 1 -- 172.21.15.59:0/1316161015 >> v1:172.21.15.59:6816/126772 conn(0x7f58f002f510 legacy=0x7f58f00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.148+0000 7f590a598700 1 -- 172.21.15.59:0/1316161015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f590409d7d0 msgr2=0x7f590411ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.148+0000 7f590a598700 1 --2- 172.21.15.59:0/1316161015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f590409d7d0 0x7f590411ada0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f58f4000c00 tx=0x7f58f4004750 comp rx=0 tx=0).stop 2023-09-30T22:29:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.148+0000 7f590a598700 1 -- 172.21.15.59:0/1316161015 shutdown_connections 2023-09-30T22:29:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.148+0000 7f590a598700 1 --2- 172.21.15.59:0/1316161015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f590409d7d0 0x7f590411ada0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.148+0000 7f590a598700 1 --2- 172.21.15.59:0/1316161015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5904130cb0 0x7f590411b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.148+0000 7f590a598700 1 --2- 172.21.15.59:0/1316161015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f590409e0e0 0x7f590411b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.148+0000 7f590a598700 1 -- 172.21.15.59:0/1316161015 >> 172.21.15.59:0/1316161015 conn(0x7f5904066d70 msgr2=0x7f590412fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.148+0000 7f590a598700 1 -- 172.21.15.59:0/1316161015 shutdown_connections 2023-09-30T22:29:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.149+0000 7f590a598700 1 -- 172.21.15.59:0/1316161015 wait complete. 2023-09-30T22:29:07.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:29:07.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.303+0000 7fa79e69d700 1 Processor -- start 2023-09-30T22:29:07.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.303+0000 7fa79e69d700 1 -- start start 2023-09-30T22:29:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.303+0000 7fa79e69d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7981303c0 0x7fa798130790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.303+0000 7fa79e69d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa79806b290 0x7fa79813b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.303+0000 7fa79e69d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79809f620 con 0x7fa79806a770 2023-09-30T22:29:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.303+0000 7fa79e69d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa798130280 con 0x7fa79806b290 2023-09-30T22:29:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.303+0000 7fa79e69d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa79809e1b0 con 0x7fa7981303c0 2023-09-30T22:29:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.303+0000 7fa797fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7981303c0 0x7fa798130790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.303+0000 7fa79cc3a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa79806b290 0x7fa79813b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.303+0000 7fa7977fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa79806a770 0x7fa79806ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49462/0 (socket says 172.21.15.59:49462) 2023-09-30T22:29:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.303+0000 7fa7977fe700 1 -- 172.21.15.59:0/1662448131 learned_addr learned my addr 172.21.15.59:0/1662448131 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.304+0000 7fa797fff700 1 -- 172.21.15.59:0/1662448131 >> v2:172.21.15.59:3300/0 conn(0x7fa79806b290 msgr2=0x7fa79813b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.304+0000 7fa797fff700 1 --2- 172.21.15.59:0/1662448131 >> v2:172.21.15.59:3300/0 conn(0x7fa79806b290 0x7fa79813b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.304+0000 7fa797fff700 1 -- 172.21.15.59:0/1662448131 >> v1:172.21.15.59:6789/0 conn(0x7fa79806a770 legacy=0x7fa79806ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.304+0000 7fa797fff700 1 -- 172.21.15.59:0/1662448131 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa798130cd0 con 0x7fa7981303c0 2023-09-30T22:29:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.304+0000 7fa797fff700 1 --2- 172.21.15.59:0/1662448131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7981303c0 0x7fa798130790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa788009840 tx=0x7fa788009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cd25b63f993fcb7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.304+0000 7fa796ffd700 1 -- 172.21.15.59:0/1662448131 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788011830 con 0x7fa7981303c0 2023-09-30T22:29:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.304+0000 7fa796ffd700 1 -- 172.21.15.59:0/1662448131 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa788011990 con 0x7fa7981303c0 2023-09-30T22:29:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.304+0000 7fa796ffd700 1 -- 172.21.15.59:0/1662448131 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788011d20 con 0x7fa7981303c0 2023-09-30T22:29:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.305+0000 7fa79e69d700 1 -- 172.21.15.59:0/1662448131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7981303c0 msgr2=0x7fa798130790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.305+0000 7fa79e69d700 1 --2- 172.21.15.59:0/1662448131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7981303c0 0x7fa798130790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa788009840 tx=0x7fa788009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.305+0000 7fa79e69d700 1 -- 172.21.15.59:0/1662448131 shutdown_connections 2023-09-30T22:29:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.305+0000 7fa79e69d700 1 --2- 172.21.15.59:0/1662448131 >> v2:172.21.15.59:3300/0 conn(0x7fa79806b290 0x7fa79813b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.305+0000 7fa79e69d700 1 --2- 172.21.15.59:0/1662448131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7981303c0 0x7fa798130790 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.305+0000 7fa79e69d700 1 -- 172.21.15.59:0/1662448131 >> 172.21.15.59:0/1662448131 conn(0x7fa798066d70 msgr2=0x7fa7980a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.305+0000 7fa79e69d700 1 -- 172.21.15.59:0/1662448131 shutdown_connections 2023-09-30T22:29:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.305+0000 7fa79e69d700 1 -- 172.21.15.59:0/1662448131 wait complete. 2023-09-30T22:29:07.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.306+0000 7fa79e69d700 1 Processor -- start 2023-09-30T22:29:07.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.306+0000 7fa79e69d700 1 -- start start 2023-09-30T22:29:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa79e69d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa79806a770 0x7fa7981c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa79e69d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79806b290 0x7fa7981c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa79e69d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7981303c0 0x7fa7981c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa79e69d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79809cdd0 con 0x7fa79806b290 2023-09-30T22:29:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa79e69d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79812da50 con 0x7fa79806a770 2023-09-30T22:29:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa79e69d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa79811fe50 con 0x7fa7981303c0 2023-09-30T22:29:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa797fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa79806a770 0x7fa7981c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa79cc3a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7981303c0 0x7fa7981c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa797fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa79806a770 0x7fa7981c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42528/0 (socket says 172.21.15.59:42528) 2023-09-30T22:29:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa797fff700 1 -- 172.21.15.59:0/2460103937 learned_addr learned my addr 172.21.15.59:0/2460103937 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa7977fe700 1 --2- 172.21.15.59:0/2460103937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79806b290 0x7fa7981c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa797fff700 1 -- 172.21.15.59:0/2460103937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7981303c0 msgr2=0x7fa7981c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa797fff700 1 --2- 172.21.15.59:0/2460103937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7981303c0 0x7fa7981c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa797fff700 1 -- 172.21.15.59:0/2460103937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79806b290 msgr2=0x7fa7981c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa797fff700 1 --2- 172.21.15.59:0/2460103937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79806b290 0x7fa7981c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa797fff700 1 -- 172.21.15.59:0/2460103937 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7880094a0 con 0x7fa79806a770 2023-09-30T22:29:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa79cc3a700 1 --2- 172.21.15.59:0/2460103937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7981303c0 0x7fa7981c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa7977fe700 1 --2- 172.21.15.59:0/2460103937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79806b290 0x7fa7981c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa797fff700 1 --2- 172.21.15.59:0/2460103937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa79806a770 0x7fa7981c8570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa788009fd0 tx=0x7fa788004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.307+0000 7fa794ff9700 1 -- 172.21.15.59:0/2460103937 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7880036a0 con 0x7fa79806a770 2023-09-30T22:29:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.308+0000 7fa794ff9700 1 -- 172.21.15.59:0/2460103937 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78801f070 con 0x7fa79806a770 2023-09-30T22:29:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.308+0000 7fa794ff9700 1 -- 172.21.15.59:0/2460103937 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788003a60 con 0x7fa79806a770 2023-09-30T22:29:07.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.308+0000 7fa79e69d700 1 -- 172.21.15.59:0/2460103937 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa798120110 con 0x7fa79806a770 2023-09-30T22:29:07.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.308+0000 7fa79e69d700 1 -- 172.21.15.59:0/2460103937 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7980724f0 con 0x7fa79806a770 2023-09-30T22:29:07.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.308+0000 7fa794ff9700 1 -- 172.21.15.59:0/2460103937 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa788003bc0 con 0x7fa79806a770 2023-09-30T22:29:07.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.308+0000 7fa794ff9700 1 -- 172.21.15.59:0/2460103937 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fa788021070 con 0x7fa79806a770 2023-09-30T22:29:07.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.309+0000 7fa79e69d700 1 -- 172.21.15.59:0/2460103937 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7980726e0 con 0x7fa79806a770 2023-09-30T22:29:07.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.314+0000 7fa794ff9700 1 -- 172.21.15.59:0/2460103937 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa78802b080 con 0x7fa79806a770 2023-09-30T22:29:07.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.514+0000 7fa79e69d700 1 -- 172.21.15.59:0/2460103937 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa79804f2a0 con 0x7fa79806a770 2023-09-30T22:29:07.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.514+0000 7fa794ff9700 1 -- 172.21.15.59:0/2460103937 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa788015020 con 0x7fa79806a770 2023-09-30T22:29:07.515 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-30T22:29:07.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.517+0000 7fa79e69d700 1 -- 172.21.15.59:0/2460103937 >> v1:172.21.15.59:6816/126772 conn(0x7fa78402f510 legacy=0x7fa7840319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.517+0000 7fa79e69d700 1 -- 172.21.15.59:0/2460103937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa79806a770 msgr2=0x7fa7981c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.517+0000 7fa79e69d700 1 --2- 172.21.15.59:0/2460103937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa79806a770 0x7fa7981c8570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa788009fd0 tx=0x7fa788004750 comp rx=0 tx=0).stop 2023-09-30T22:29:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.517+0000 7fa79e69d700 1 -- 172.21.15.59:0/2460103937 shutdown_connections 2023-09-30T22:29:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.517+0000 7fa79e69d700 1 --2- 172.21.15.59:0/2460103937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7981303c0 0x7fa7981c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.517+0000 7fa79e69d700 1 --2- 172.21.15.59:0/2460103937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa79806a770 0x7fa7981c8570 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.517+0000 7fa79e69d700 1 --2- 172.21.15.59:0/2460103937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79806b290 0x7fa7981c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.517+0000 7fa79e69d700 1 -- 172.21.15.59:0/2460103937 >> 172.21.15.59:0/2460103937 conn(0x7fa798066d70 msgr2=0x7fa79809b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.517+0000 7fa79e69d700 1 -- 172.21.15.59:0/2460103937 shutdown_connections 2023-09-30T22:29:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.517+0000 7fa79e69d700 1 -- 172.21.15.59:0/2460103937 wait complete. 2023-09-30T22:29:07.530 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:29:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.670+0000 7fb2f2f43700 1 Processor -- start 2023-09-30T22:29:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.670+0000 7fb2f2f43700 1 -- start start 2023-09-30T22:29:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2f2f43700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2ec071cd0 0x7fb2ec0720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2f2f43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2ec09e850 0x7fb2ec09ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2f2f43700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2ec09f1a0 0x7fb2ec13aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2f2f43700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec0a0680 con 0x7fb2ec071cd0 2023-09-30T22:29:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2f2f43700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec06cb80 con 0x7fb2ec09e850 2023-09-30T22:29:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2f2f43700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec06c0a0 con 0x7fb2ec09f1a0 2023-09-30T22:29:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2ebfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2ec09e850 0x7fb2ec09ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2f0cdf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2ec071cd0 0x7fb2ec0720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2ebfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2ec09e850 0x7fb2ec09ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42540/0 (socket says 172.21.15.59:42540) 2023-09-30T22:29:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2ebfff700 1 -- 172.21.15.59:0/2864712622 learned_addr learned my addr 172.21.15.59:0/2864712622 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2f0cdf700 1 --2- 172.21.15.59:0/2864712622 >> v2:172.21.15.59:3300/0 conn(0x7fb2ec071cd0 0x7fb2ec0720a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58544/0 (socket says 172.21.15.59:58544) 2023-09-30T22:29:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2f14e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2ec09f1a0 0x7fb2ec13aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2f0cdf700 1 -- 172.21.15.59:0/2864712622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2ec09f1a0 msgr2=0x7fb2ec13aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2f0cdf700 1 --2- 172.21.15.59:0/2864712622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2ec09f1a0 0x7fb2ec13aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2f0cdf700 1 -- 172.21.15.59:0/2864712622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2ec09e850 msgr2=0x7fb2ec09ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2f0cdf700 1 --2- 172.21.15.59:0/2864712622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2ec09e850 0x7fb2ec09ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2f0cdf700 1 -- 172.21.15.59:0/2864712622 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec06ba00 con 0x7fb2ec071cd0 2023-09-30T22:29:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2ebfff700 1 --2- 172.21.15.59:0/2864712622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2ec09e850 0x7fb2ec09ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.671+0000 7fb2f14e0700 1 --2- 172.21.15.59:0/2864712622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2ec09f1a0 0x7fb2ec13aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.672+0000 7fb2f0cdf700 1 --2- 172.21.15.59:0/2864712622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2ec071cd0 0x7fb2ec0720a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009840 tx=0x7fb2dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4001e6097d5817 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.672+0000 7fb2eb7fe700 1 -- 172.21.15.59:0/2864712622 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc011830 con 0x7fb2ec071cd0 2023-09-30T22:29:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.672+0000 7fb2eb7fe700 1 -- 172.21.15.59:0/2864712622 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc011990 con 0x7fb2ec071cd0 2023-09-30T22:29:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.672+0000 7fb2eb7fe700 1 -- 172.21.15.59:0/2864712622 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc011d20 con 0x7fb2ec071cd0 2023-09-30T22:29:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.672+0000 7fb2f2f43700 1 -- 172.21.15.59:0/2864712622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2ec071cd0 msgr2=0x7fb2ec0720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.672+0000 7fb2f2f43700 1 --2- 172.21.15.59:0/2864712622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2ec071cd0 0x7fb2ec0720a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009840 tx=0x7fb2dc009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.672+0000 7fb2f2f43700 1 -- 172.21.15.59:0/2864712622 shutdown_connections 2023-09-30T22:29:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.672+0000 7fb2f2f43700 1 --2- 172.21.15.59:0/2864712622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2ec09f1a0 0x7fb2ec13aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.672+0000 7fb2f2f43700 1 --2- 172.21.15.59:0/2864712622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2ec071cd0 0x7fb2ec0720a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.672+0000 7fb2f2f43700 1 --2- 172.21.15.59:0/2864712622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2ec09e850 0x7fb2ec09ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.672+0000 7fb2f2f43700 1 -- 172.21.15.59:0/2864712622 >> 172.21.15.59:0/2864712622 conn(0x7fb2ec0a4130 msgr2=0x7fb2ec0a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.673+0000 7fb2f2f43700 1 -- 172.21.15.59:0/2864712622 shutdown_connections 2023-09-30T22:29:07.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.673+0000 7fb2f2f43700 1 -- 172.21.15.59:0/2864712622 wait complete. 2023-09-30T22:29:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.673+0000 7fb2f2f43700 1 Processor -- start 2023-09-30T22:29:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.674+0000 7fb2f2f43700 1 -- start start 2023-09-30T22:29:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.674+0000 7fb2f2f43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2ec071cd0 0x7fb2ec1c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.674+0000 7fb2f2f43700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2ec09e850 0x7fb2ec1c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.674+0000 7fb2f2f43700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2ec09f1a0 0x7fb2ec1c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.674+0000 7fb2f2f43700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec1aadc0 con 0x7fb2ec09f1a0 2023-09-30T22:29:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.674+0000 7fb2f2f43700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0a1720 con 0x7fb2ec071cd0 2023-09-30T22:29:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.674+0000 7fb2f2f43700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec06cda0 con 0x7fb2ec09e850 2023-09-30T22:29:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.674+0000 7fb2f14e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2ec09f1a0 0x7fb2ec1c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.674+0000 7fb2ebfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2ec09e850 0x7fb2ec1c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.674+0000 7fb2f0cdf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2ec071cd0 0x7fb2ec1c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.674+0000 7fb2f14e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2ec09f1a0 0x7fb2ec1c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58546/0 (socket says 172.21.15.59:58546) 2023-09-30T22:29:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.674+0000 7fb2f14e0700 1 -- 172.21.15.59:0/2499700862 learned_addr learned my addr 172.21.15.59:0/2499700862 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.675+0000 7fb2f14e0700 1 -- 172.21.15.59:0/2499700862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2ec09e850 msgr2=0x7fb2ec1c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.675+0000 7fb2f14e0700 1 --2- 172.21.15.59:0/2499700862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2ec09e850 0x7fb2ec1c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.675+0000 7fb2f14e0700 1 -- 172.21.15.59:0/2499700862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2ec071cd0 msgr2=0x7fb2ec1c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.675+0000 7fb2f14e0700 1 --2- 172.21.15.59:0/2499700862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2ec071cd0 0x7fb2ec1c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.675+0000 7fb2f14e0700 1 -- 172.21.15.59:0/2499700862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d4009550 con 0x7fb2ec09f1a0 2023-09-30T22:29:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.675+0000 7fb2ebfff700 1 --2- 172.21.15.59:0/2499700862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2ec09e850 0x7fb2ec1c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.675+0000 7fb2f0cdf700 1 --2- 172.21.15.59:0/2499700862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2ec071cd0 0x7fb2ec1c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:07.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.675+0000 7fb2f14e0700 1 --2- 172.21.15.59:0/2499700862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2ec09f1a0 0x7fb2ec1c4d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400efc0 tx=0x7fb2e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:07.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.675+0000 7fb2e97fa700 1 -- 172.21.15.59:0/2499700862 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e400ca90 con 0x7fb2ec09f1a0 2023-09-30T22:29:07.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.675+0000 7fb2e97fa700 1 -- 172.21.15.59:0/2499700862 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e400f040 con 0x7fb2ec09f1a0 2023-09-30T22:29:07.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.675+0000 7fb2f2f43700 1 -- 172.21.15.59:0/2499700862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e4009a70 con 0x7fb2ec09f1a0 2023-09-30T22:29:07.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.675+0000 7fb2e97fa700 1 -- 172.21.15.59:0/2499700862 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e400ce10 con 0x7fb2ec09f1a0 2023-09-30T22:29:07.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.675+0000 7fb2f2f43700 1 -- 172.21.15.59:0/2499700862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2dc0094a0 con 0x7fb2ec09f1a0 2023-09-30T22:29:07.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.676+0000 7fb2e97fa700 1 -- 172.21.15.59:0/2499700862 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb2e4014480 con 0x7fb2ec09f1a0 2023-09-30T22:29:07.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.676+0000 7fb2e97fa700 1 -- 172.21.15.59:0/2499700862 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fb2e40402b0 con 0x7fb2ec09f1a0 2023-09-30T22:29:07.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.676+0000 7fb2f2f43700 1 -- 172.21.15.59:0/2499700862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec04f2a0 con 0x7fb2ec09f1a0 2023-09-30T22:29:07.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.681+0000 7fb2e97fa700 1 -- 172.21.15.59:0/2499700862 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2e4018030 con 0x7fb2ec09f1a0 2023-09-30T22:29:07.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.885+0000 7fb2f2f43700 1 -- 172.21.15.59:0/2499700862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2ec0728b0 con 0x7fb2ec09f1a0 2023-09-30T22:29:07.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.886+0000 7fb2e97fa700 1 -- 172.21.15.59:0/2499700862 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2e4018020 con 0x7fb2ec09f1a0 2023-09-30T22:29:07.886 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-30T22:29:07.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.888+0000 7fb2f2f43700 1 -- 172.21.15.59:0/2499700862 >> v1:172.21.15.59:6816/126772 conn(0x7fb2cc02f540 legacy=0x7fb2cc0319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.888+0000 7fb2f2f43700 1 -- 172.21.15.59:0/2499700862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2ec09f1a0 msgr2=0x7fb2ec1c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.888+0000 7fb2f2f43700 1 --2- 172.21.15.59:0/2499700862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2ec09f1a0 0x7fb2ec1c4d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400efc0 tx=0x7fb2e400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.888+0000 7fb2f2f43700 1 -- 172.21.15.59:0/2499700862 shutdown_connections 2023-09-30T22:29:07.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.888+0000 7fb2f2f43700 1 --2- 172.21.15.59:0/2499700862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2ec09f1a0 0x7fb2ec1c4d80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.888+0000 7fb2f2f43700 1 --2- 172.21.15.59:0/2499700862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2ec071cd0 0x7fb2ec1c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.888+0000 7fb2f2f43700 1 --2- 172.21.15.59:0/2499700862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2ec09e850 0x7fb2ec1c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.888+0000 7fb2f2f43700 1 -- 172.21.15.59:0/2499700862 >> 172.21.15.59:0/2499700862 conn(0x7fb2ec0a4130 msgr2=0x7fb2ec0a2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.888+0000 7fb2f2f43700 1 -- 172.21.15.59:0/2499700862 shutdown_connections 2023-09-30T22:29:07.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:07.888+0000 7fb2f2f43700 1 -- 172.21.15.59:0/2499700862 wait complete. 2023-09-30T22:29:07.902 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:29:08.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.037+0000 7f84a5649700 1 Processor -- start 2023-09-30T22:29:08.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.038+0000 7f84a5649700 1 -- start start 2023-09-30T22:29:08.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.038+0000 7f84a5649700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84a00a0a30 0x7f84a00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.038+0000 7f84a5649700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84a009d630 0x7f84a00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.038+0000 7f84a5649700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a00a2a70 con 0x7f84a0133930 2023-09-30T22:29:08.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.038+0000 7f84a5649700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a00a01d0 con 0x7f84a00a0a30 2023-09-30T22:29:08.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.038+0000 7f84a5649700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84a009e2b0 con 0x7f84a009d630 2023-09-30T22:29:08.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.038+0000 7f849e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84a009d630 0x7f84a00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.038+0000 7f849f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f84a0133930 0x7f84a0133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49470/0 (socket says 172.21.15.59:49470) 2023-09-30T22:29:08.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.038+0000 7f849effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84a00a0a30 0x7f84a00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.038+0000 7f849f7fe700 1 -- 172.21.15.59:0/2323982856 learned_addr learned my addr 172.21.15.59:0/2323982856 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.039+0000 7f849dffb700 1 -- 172.21.15.59:0/2323982856 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714621144 0 0) 0x7f84a00a2a70 con 0x7f84a0133930 2023-09-30T22:29:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.039+0000 7f849e7fc700 1 -- 172.21.15.59:0/2323982856 >> v2:172.21.15.59:3300/0 conn(0x7f84a00a0a30 msgr2=0x7f84a00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.039+0000 7f849e7fc700 1 --2- 172.21.15.59:0/2323982856 >> v2:172.21.15.59:3300/0 conn(0x7f84a00a0a30 0x7f84a00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.039+0000 7f849e7fc700 1 -- 172.21.15.59:0/2323982856 >> v1:172.21.15.59:6789/0 conn(0x7f84a0133930 legacy=0x7f84a0133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.039+0000 7f849e7fc700 1 -- 172.21.15.59:0/2323982856 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a009dc50 con 0x7f84a009d630 2023-09-30T22:29:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.039+0000 7f849effd700 1 --2- 172.21.15.59:0/2323982856 >> v2:172.21.15.59:3300/0 conn(0x7f84a00a0a30 0x7f84a00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.039+0000 7f849e7fc700 1 --2- 172.21.15.59:0/2323982856 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84a009d630 0x7f84a00a1340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8494009840 tx=0x7f8494009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1c3e1df1f372afe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.039+0000 7f849dffb700 1 -- 172.21.15.59:0/2323982856 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494011830 con 0x7f84a009d630 2023-09-30T22:29:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.039+0000 7f849dffb700 1 -- 172.21.15.59:0/2323982856 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8494011990 con 0x7f84a009d630 2023-09-30T22:29:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.039+0000 7f849dffb700 1 -- 172.21.15.59:0/2323982856 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494011d20 con 0x7f84a009d630 2023-09-30T22:29:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.040+0000 7f84a5649700 1 -- 172.21.15.59:0/2323982856 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84a009d630 msgr2=0x7f84a00a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.040+0000 7f84a5649700 1 --2- 172.21.15.59:0/2323982856 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84a009d630 0x7f84a00a1340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8494009840 tx=0x7f8494009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:08.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.040+0000 7f84a5649700 1 -- 172.21.15.59:0/2323982856 shutdown_connections 2023-09-30T22:29:08.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.040+0000 7f84a5649700 1 --2- 172.21.15.59:0/2323982856 >> v2:172.21.15.59:3300/0 conn(0x7f84a00a0a30 0x7f84a00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.040+0000 7f84a5649700 1 --2- 172.21.15.59:0/2323982856 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84a009d630 0x7f84a00a1340 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.040+0000 7f84a5649700 1 -- 172.21.15.59:0/2323982856 >> 172.21.15.59:0/2323982856 conn(0x7f84a00a3050 msgr2=0x7f84a00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.040+0000 7f84a5649700 1 -- 172.21.15.59:0/2323982856 shutdown_connections 2023-09-30T22:29:08.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.040+0000 7f84a5649700 1 -- 172.21.15.59:0/2323982856 wait complete. 2023-09-30T22:29:08.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.041+0000 7f84a5649700 1 Processor -- start 2023-09-30T22:29:08.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.041+0000 7f84a5649700 1 -- start start 2023-09-30T22:29:08.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.041+0000 7f84a5649700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84a009d630 0x7f84a011d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.041+0000 7f84a5649700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84a00a0a30 0x7f84a011d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.041+0000 7f84a5649700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84a0133930 0x7f84a01c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.041+0000 7f84a5649700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a011eed0 con 0x7f84a00a0a30 2023-09-30T22:29:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.041+0000 7f84a5649700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a011cf60 con 0x7f84a009d630 2023-09-30T22:29:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.041+0000 7f84a5649700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84a011d1f0 con 0x7f84a0133930 2023-09-30T22:29:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.041+0000 7f849e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84a00a0a30 0x7f84a011d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.041+0000 7f849effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84a009d630 0x7f84a011d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.041+0000 7f849e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84a00a0a30 0x7f84a011d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58552/0 (socket says 172.21.15.59:58552) 2023-09-30T22:29:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.041+0000 7f849effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84a009d630 0x7f84a011d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42554/0 (socket says 172.21.15.59:42554) 2023-09-30T22:29:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.041+0000 7f849e7fc700 1 -- 172.21.15.59:0/2946250852 learned_addr learned my addr 172.21.15.59:0/2946250852 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.041+0000 7f849f7fe700 1 --2- 172.21.15.59:0/2946250852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84a0133930 0x7f84a01c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.042+0000 7f849f7fe700 1 -- 172.21.15.59:0/2946250852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84a009d630 msgr2=0x7f84a011d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.042+0000 7f849f7fe700 1 --2- 172.21.15.59:0/2946250852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84a009d630 0x7f84a011d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.042+0000 7f849f7fe700 1 -- 172.21.15.59:0/2946250852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84a00a0a30 msgr2=0x7f84a011d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.042+0000 7f849f7fe700 1 --2- 172.21.15.59:0/2946250852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84a00a0a30 0x7f84a011d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.042+0000 7f849f7fe700 1 -- 172.21.15.59:0/2946250852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490011d40 con 0x7f84a0133930 2023-09-30T22:29:08.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.042+0000 7f849effd700 1 --2- 172.21.15.59:0/2946250852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84a009d630 0x7f84a011d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:08.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.042+0000 7f849e7fc700 1 --2- 172.21.15.59:0/2946250852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84a00a0a30 0x7f84a011d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:08.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.042+0000 7f849f7fe700 1 --2- 172.21.15.59:0/2946250852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84a0133930 0x7f84a01c3ae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f849800cbe0 tx=0x7f849800cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.042+0000 7f84877fe700 1 -- 172.21.15.59:0/2946250852 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849800aa40 con 0x7f84a0133930 2023-09-30T22:29:08.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.042+0000 7f84877fe700 1 -- 172.21.15.59:0/2946250852 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849800abc0 con 0x7f84a0133930 2023-09-30T22:29:08.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.042+0000 7f84877fe700 1 -- 172.21.15.59:0/2946250852 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84980070d0 con 0x7f84a0133930 2023-09-30T22:29:08.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.042+0000 7f84a5649700 1 -- 172.21.15.59:0/2946250852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84940094a0 con 0x7f84a0133930 2023-09-30T22:29:08.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.042+0000 7f84a5649700 1 -- 172.21.15.59:0/2946250852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a011f440 con 0x7f84a0133930 2023-09-30T22:29:08.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.043+0000 7f84a5649700 1 -- 172.21.15.59:0/2946250852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a0071e20 con 0x7f84a0133930 2023-09-30T22:29:08.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.044+0000 7f84877fe700 1 -- 172.21.15.59:0/2946250852 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8498007230 con 0x7f84a0133930 2023-09-30T22:29:08.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.044+0000 7f84877fe700 1 -- 172.21.15.59:0/2946250852 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f849803f8b0 con 0x7f84a0133930 2023-09-30T22:29:08.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.048+0000 7f84877fe700 1 -- 172.21.15.59:0/2946250852 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84980074e0 con 0x7f84a0133930 2023-09-30T22:29:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.293+0000 7f84a5649700 1 -- 172.21.15.59:0/2946250852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84a011ff10 con 0x7f84a0133930 2023-09-30T22:29:08.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.294+0000 7f84877fe700 1 -- 172.21.15.59:0/2946250852 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2315 (secure 0 0 0) 0x7f8498018070 con 0x7f84a0133930 2023-09-30T22:29:08.294 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:08.294 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:26:34.412591+0000","modified":"2023-09-30T22:27:00.923070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/2103029646","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":2103029646}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T22:29:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.296+0000 7f84a5649700 1 -- 172.21.15.59:0/2946250852 >> v1:172.21.15.59:6816/126772 conn(0x7f848c02f510 legacy=0x7f848c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.296+0000 7f84a5649700 1 -- 172.21.15.59:0/2946250852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84a0133930 msgr2=0x7f84a01c3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.296+0000 7f84a5649700 1 --2- 172.21.15.59:0/2946250852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84a0133930 0x7f84a01c3ae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f849800cbe0 tx=0x7f849800cef0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.296+0000 7f84a5649700 1 -- 172.21.15.59:0/2946250852 shutdown_connections 2023-09-30T22:29:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.296+0000 7f84a5649700 1 --2- 172.21.15.59:0/2946250852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84a0133930 0x7f84a01c3ae0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.296+0000 7f84a5649700 1 --2- 172.21.15.59:0/2946250852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84a009d630 0x7f84a011d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.296+0000 7f84a5649700 1 --2- 172.21.15.59:0/2946250852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84a00a0a30 0x7f84a011d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.296+0000 7f84a5649700 1 -- 172.21.15.59:0/2946250852 >> 172.21.15.59:0/2946250852 conn(0x7f84a00a3050 msgr2=0x7f84a0132b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.296+0000 7f84a5649700 1 -- 172.21.15.59:0/2946250852 shutdown_connections 2023-09-30T22:29:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.296+0000 7f84a5649700 1 -- 172.21.15.59:0/2946250852 wait complete. 2023-09-30T22:29:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-09-30T22:29:08.311 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:29:08.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.447+0000 7f8e5358b700 1 Processor -- start 2023-09-30T22:29:08.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.447+0000 7f8e5358b700 1 -- start start 2023-09-30T22:29:08.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.448+0000 7f8e5358b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e1d0 0x7f8e4c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.448+0000 7f8e5358b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c139170 0x7f8e4c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.448+0000 7f8e5358b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c09d2f0 con 0x7f8e4c09d6f0 2023-09-30T22:29:08.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.448+0000 7f8e5358b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c09b0f0 con 0x7f8e4c09e1d0 2023-09-30T22:29:08.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.448+0000 7f8e5358b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c09a810 con 0x7f8e4c139170 2023-09-30T22:29:08.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.448+0000 7f8e50b26700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e1d0 0x7f8e4c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.448+0000 7f8e51327700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8e4c09d6f0 0x7f8e4c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49486/0 (socket says 172.21.15.59:49486) 2023-09-30T22:29:08.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.448+0000 7f8e51327700 1 -- 172.21.15.59:0/3636086188 learned_addr learned my addr 172.21.15.59:0/3636086188 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:08.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.448+0000 7f8e51b28700 1 --2- 172.21.15.59:0/3636086188 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c139170 0x7f8e4c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.448+0000 7f8e50b26700 1 -- 172.21.15.59:0/3636086188 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c139170 msgr2=0x7f8e4c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:08.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.448+0000 7f8e50b26700 1 --2- 172.21.15.59:0/3636086188 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c139170 0x7f8e4c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.448+0000 7f8e50b26700 1 -- 172.21.15.59:0/3636086188 >> v1:172.21.15.59:6789/0 conn(0x7f8e4c09d6f0 legacy=0x7f8e4c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.448+0000 7f8e50b26700 1 -- 172.21.15.59:0/3636086188 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c09a470 con 0x7f8e4c09e1d0 2023-09-30T22:29:08.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.448+0000 7f8e4bfff700 1 -- 172.21.15.59:0/3636086188 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763772852 0 0) 0x7f8e4c09d2f0 con 0x7f8e4c09d6f0 2023-09-30T22:29:08.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.449+0000 7f8e50b26700 1 --2- 172.21.15.59:0/3636086188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e1d0 0x7f8e4c138c30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8e400098a0 tx=0x7f8e40009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38dc6a66ba2a3466 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.449+0000 7f8e4bfff700 1 -- 172.21.15.59:0/3636086188 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40011830 con 0x7f8e4c09e1d0 2023-09-30T22:29:08.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.449+0000 7f8e4bfff700 1 -- 172.21.15.59:0/3636086188 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e40011990 con 0x7f8e4c09e1d0 2023-09-30T22:29:08.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.449+0000 7f8e4bfff700 1 -- 172.21.15.59:0/3636086188 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40011d20 con 0x7f8e4c09e1d0 2023-09-30T22:29:08.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.449+0000 7f8e5358b700 1 -- 172.21.15.59:0/3636086188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e1d0 msgr2=0x7f8e4c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.449+0000 7f8e5358b700 1 --2- 172.21.15.59:0/3636086188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e1d0 0x7f8e4c138c30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8e400098a0 tx=0x7f8e40009bb0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.449+0000 7f8e5358b700 1 -- 172.21.15.59:0/3636086188 shutdown_connections 2023-09-30T22:29:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.449+0000 7f8e5358b700 1 --2- 172.21.15.59:0/3636086188 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c139170 0x7f8e4c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.449+0000 7f8e5358b700 1 --2- 172.21.15.59:0/3636086188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e1d0 0x7f8e4c138c30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.449+0000 7f8e5358b700 1 -- 172.21.15.59:0/3636086188 >> 172.21.15.59:0/3636086188 conn(0x7f8e4c066f50 msgr2=0x7f8e4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.450+0000 7f8e5358b700 1 -- 172.21.15.59:0/3636086188 shutdown_connections 2023-09-30T22:29:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.450+0000 7f8e5358b700 1 -- 172.21.15.59:0/3636086188 wait complete. 2023-09-30T22:29:08.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.450+0000 7f8e5358b700 1 Processor -- start 2023-09-30T22:29:08.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e5358b700 1 -- start start 2023-09-30T22:29:08.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e5358b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09d6f0 0x7f8e4c120840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e5358b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e1d0 0x7f8e4c120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e5358b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4c139170 0x7f8e4c1212c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e5358b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c1223b0 con 0x7f8e4c139170 2023-09-30T22:29:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e5358b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c136690 con 0x7f8e4c09e1d0 2023-09-30T22:29:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e5358b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c123fe0 con 0x7f8e4c09d6f0 2023-09-30T22:29:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e51327700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09d6f0 0x7f8e4c120840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e50b26700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e1d0 0x7f8e4c120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e51b28700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4c139170 0x7f8e4c1212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e51327700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09d6f0 0x7f8e4c120840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59798/0 (socket says 172.21.15.59:59798) 2023-09-30T22:29:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e51327700 1 -- 172.21.15.59:0/2745708874 learned_addr learned my addr 172.21.15.59:0/2745708874 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e51327700 1 -- 172.21.15.59:0/2745708874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e1d0 msgr2=0x7f8e4c120d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e51327700 1 --2- 172.21.15.59:0/2745708874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e1d0 0x7f8e4c120d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e51327700 1 -- 172.21.15.59:0/2745708874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4c139170 msgr2=0x7f8e4c1212c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e51327700 1 --2- 172.21.15.59:0/2745708874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4c139170 0x7f8e4c1212c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.451+0000 7f8e51327700 1 -- 172.21.15.59:0/2745708874 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e400094a0 con 0x7f8e4c09d6f0 2023-09-30T22:29:08.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.452+0000 7f8e51327700 1 --2- 172.21.15.59:0/2745708874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09d6f0 0x7f8e4c120840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00c550 tx=0x7f8e3c00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.452+0000 7f8e49ffb700 1 -- 172.21.15.59:0/2745708874 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c004c80 con 0x7f8e4c09d6f0 2023-09-30T22:29:08.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.452+0000 7f8e49ffb700 1 -- 172.21.15.59:0/2745708874 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c004de0 con 0x7f8e4c09d6f0 2023-09-30T22:29:08.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.452+0000 7f8e5358b700 1 -- 172.21.15.59:0/2745708874 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c123a50 con 0x7f8e4c09d6f0 2023-09-30T22:29:08.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.452+0000 7f8e49ffb700 1 -- 172.21.15.59:0/2745708874 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c007310 con 0x7f8e4c09d6f0 2023-09-30T22:29:08.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.452+0000 7f8e5358b700 1 -- 172.21.15.59:0/2745708874 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c09c060 con 0x7f8e4c09d6f0 2023-09-30T22:29:08.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.453+0000 7f8e49ffb700 1 -- 172.21.15.59:0/2745708874 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8e3c007470 con 0x7f8e4c09d6f0 2023-09-30T22:29:08.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.453+0000 7f8e49ffb700 1 -- 172.21.15.59:0/2745708874 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f8e3c03f690 con 0x7f8e4c09d6f0 2023-09-30T22:29:08.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.453+0000 7f8e5358b700 1 -- 172.21.15.59:0/2745708874 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c074ea0 con 0x7f8e4c09d6f0 2023-09-30T22:29:08.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.458+0000 7f8e49ffb700 1 -- 172.21.15.59:0/2745708874 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e3c0123b0 con 0x7f8e4c09d6f0 2023-09-30T22:29:08.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.661+0000 7f8e5358b700 1 -- 172.21.15.59:0/2745708874 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e4c06c360 con 0x7f8e4c09d6f0 2023-09-30T22:29:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.662+0000 7f8e49ffb700 1 -- 172.21.15.59:0/2745708874 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+12919 (secure 0 0 0) 0x7f8e3c01b340 con 0x7f8e4c09d6f0 2023-09-30T22:29:08.662 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:08.662 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:29:01.577848+0000","last_up_change":"2023-09-30T22:26:27.842299+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/3882222550":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/1346763106":"2023-10-01T22:28:59.561079+0000","172.21.15.59:6816/118188":"2023-10-01T22:28:59.561079+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:29:08.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.664+0000 7f8e5358b700 1 -- 172.21.15.59:0/2745708874 >> v1:172.21.15.59:6816/126772 conn(0x7f8e3802f510 legacy=0x7f8e380319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.664+0000 7f8e5358b700 1 -- 172.21.15.59:0/2745708874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09d6f0 msgr2=0x7f8e4c120840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.664+0000 7f8e5358b700 1 --2- 172.21.15.59:0/2745708874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09d6f0 0x7f8e4c120840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00c550 tx=0x7f8e3c00c860 comp rx=0 tx=0).stop 2023-09-30T22:29:08.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.664+0000 7f8e5358b700 1 -- 172.21.15.59:0/2745708874 shutdown_connections 2023-09-30T22:29:08.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.664+0000 7f8e5358b700 1 --2- 172.21.15.59:0/2745708874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09d6f0 0x7f8e4c120840 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.664+0000 7f8e5358b700 1 --2- 172.21.15.59:0/2745708874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4c139170 0x7f8e4c1212c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.664+0000 7f8e5358b700 1 --2- 172.21.15.59:0/2745708874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e1d0 0x7f8e4c120d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.664+0000 7f8e5358b700 1 -- 172.21.15.59:0/2745708874 >> 172.21.15.59:0/2745708874 conn(0x7f8e4c066f50 msgr2=0x7f8e4c136b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.664+0000 7f8e5358b700 1 -- 172.21.15.59:0/2745708874 shutdown_connections 2023-09-30T22:29:08.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.664+0000 7f8e5358b700 1 -- 172.21.15.59:0/2745708874 wait complete. 2023-09-30T22:29:08.679 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:29:08.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.815+0000 7fe566912700 1 Processor -- start 2023-09-30T22:29:08.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.815+0000 7fe566912700 1 -- start start 2023-09-30T22:29:08.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.815+0000 7fe566912700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe56009f410 0x7fe560136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.815+0000 7fe566912700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe560136fe0 0x7fe5601393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.815+0000 7fe566912700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe560070940 con 0x7fe56009e930 2023-09-30T22:29:08.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.815+0000 7fe566912700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56006fd60 con 0x7fe56009f410 2023-09-30T22:29:08.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.815+0000 7fe566912700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe56006fa80 con 0x7fe560136fe0 2023-09-30T22:29:08.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.815+0000 7fe55f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe56009f410 0x7fe560136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.815+0000 7fe564eaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe560136fe0 0x7fe5601393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.815+0000 7fe564eaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe560136fe0 0x7fe5601393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59804/0 (socket says 172.21.15.59:59804) 2023-09-30T22:29:08.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.815+0000 7fe55f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe56009f410 0x7fe560136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58570/0 (socket says 172.21.15.59:58570) 2023-09-30T22:29:08.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.815+0000 7fe564eaf700 1 -- 172.21.15.59:0/3441352325 learned_addr learned my addr 172.21.15.59:0/3441352325 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:08.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.815+0000 7fe55ffff700 1 --1- 172.21.15.59:0/3441352325 >> v1:172.21.15.59:6789/0 conn(0x7fe56009e930 0x7fe56009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49490/0 (socket says 172.21.15.59:49490) 2023-09-30T22:29:08.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.816+0000 7fe564eaf700 1 -- 172.21.15.59:0/3441352325 >> v2:172.21.15.59:3300/0 conn(0x7fe56009f410 msgr2=0x7fe560136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:08.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.816+0000 7fe564eaf700 1 --2- 172.21.15.59:0/3441352325 >> v2:172.21.15.59:3300/0 conn(0x7fe56009f410 0x7fe560136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.816+0000 7fe564eaf700 1 -- 172.21.15.59:0/3441352325 >> v1:172.21.15.59:6789/0 conn(0x7fe56009e930 legacy=0x7fe56009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.816+0000 7fe564eaf700 1 -- 172.21.15.59:0/3441352325 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56009fb60 con 0x7fe560136fe0 2023-09-30T22:29:08.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.816+0000 7fe55f7fe700 1 --2- 172.21.15.59:0/3441352325 >> v2:172.21.15.59:3300/0 conn(0x7fe56009f410 0x7fe560136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:08.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.816+0000 7fe55effd700 1 -- 172.21.15.59:0/3441352325 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62321972 0 0) 0x7fe560070940 con 0x7fe56009e930 2023-09-30T22:29:08.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.816+0000 7fe564eaf700 1 --2- 172.21.15.59:0/3441352325 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe560136fe0 0x7fe5601393c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe558009e50 tx=0x7fe55800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3612c43b3c0aee9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.816+0000 7fe55effd700 1 -- 172.21.15.59:0/3441352325 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55800e070 con 0x7fe560136fe0 2023-09-30T22:29:08.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.816+0000 7fe55effd700 1 -- 172.21.15.59:0/3441352325 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55800b910 con 0x7fe560136fe0 2023-09-30T22:29:08.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.816+0000 7fe55effd700 1 -- 172.21.15.59:0/3441352325 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55800bcc0 con 0x7fe560136fe0 2023-09-30T22:29:08.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.817+0000 7fe566912700 1 -- 172.21.15.59:0/3441352325 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe560136fe0 msgr2=0x7fe5601393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.817+0000 7fe566912700 1 --2- 172.21.15.59:0/3441352325 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe560136fe0 0x7fe5601393c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe558009e50 tx=0x7fe55800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:08.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.817+0000 7fe566912700 1 -- 172.21.15.59:0/3441352325 shutdown_connections 2023-09-30T22:29:08.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.817+0000 7fe566912700 1 --2- 172.21.15.59:0/3441352325 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe560136fe0 0x7fe5601393c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.817+0000 7fe566912700 1 --2- 172.21.15.59:0/3441352325 >> v2:172.21.15.59:3300/0 conn(0x7fe56009f410 0x7fe560136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.817+0000 7fe566912700 1 -- 172.21.15.59:0/3441352325 >> 172.21.15.59:0/3441352325 conn(0x7fe5600a4210 msgr2=0x7fe5600a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.817+0000 7fe566912700 1 -- 172.21.15.59:0/3441352325 shutdown_connections 2023-09-30T22:29:08.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.817+0000 7fe566912700 1 -- 172.21.15.59:0/3441352325 wait complete. 2023-09-30T22:29:08.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.818+0000 7fe566912700 1 Processor -- start 2023-09-30T22:29:08.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.818+0000 7fe566912700 1 -- start start 2023-09-30T22:29:08.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.818+0000 7fe566912700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe56009e930 0x7fe56011b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.818+0000 7fe566912700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56009f410 0x7fe56011b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.818+0000 7fe566912700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe560136fe0 0x7fe56011bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe566912700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56011c680 con 0x7fe560136fe0 2023-09-30T22:29:08.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe566912700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe560133660 con 0x7fe56009f410 2023-09-30T22:29:08.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe566912700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe56011ecd0 con 0x7fe56009e930 2023-09-30T22:29:08.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe55ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe56009e930 0x7fe56011b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe564eaf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe560136fe0 0x7fe56011bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe55f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56009f410 0x7fe56011b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe564eaf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe560136fe0 0x7fe56011bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58578/0 (socket says 172.21.15.59:58578) 2023-09-30T22:29:08.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe55ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe56009e930 0x7fe56011b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59820/0 (socket says 172.21.15.59:59820) 2023-09-30T22:29:08.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe564eaf700 1 -- 172.21.15.59:0/538992283 learned_addr learned my addr 172.21.15.59:0/538992283 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:08.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe55f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56009f410 0x7fe56011b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42576/0 (socket says 172.21.15.59:42576) 2023-09-30T22:29:08.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe55ffff700 1 -- 172.21.15.59:0/538992283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56009f410 msgr2=0x7fe56011b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe55ffff700 1 --2- 172.21.15.59:0/538992283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56009f410 0x7fe56011b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe55ffff700 1 -- 172.21.15.59:0/538992283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe560136fe0 msgr2=0x7fe56011bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe55ffff700 1 --2- 172.21.15.59:0/538992283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe560136fe0 0x7fe56011bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe55ffff700 1 -- 172.21.15.59:0/538992283 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55400d940 con 0x7fe56009e930 2023-09-30T22:29:08.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe564eaf700 1 --2- 172.21.15.59:0/538992283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe560136fe0 0x7fe56011bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:08.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe55ffff700 1 --2- 172.21.15.59:0/538992283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe56009e930 0x7fe56011b1b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe55000c4a0 tx=0x7fe55000c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe55cff9700 1 -- 172.21.15.59:0/538992283 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550004c80 con 0x7fe56009e930 2023-09-30T22:29:08.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe55cff9700 1 -- 172.21.15.59:0/538992283 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe550004de0 con 0x7fe56009e930 2023-09-30T22:29:08.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe566912700 1 -- 172.21.15.59:0/538992283 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe558009b30 con 0x7fe56009e930 2023-09-30T22:29:08.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe55cff9700 1 -- 172.21.15.59:0/538992283 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550007310 con 0x7fe56009e930 2023-09-30T22:29:08.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.819+0000 7fe566912700 1 -- 172.21.15.59:0/538992283 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56011e460 con 0x7fe56009e930 2023-09-30T22:29:08.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.820+0000 7fe55cff9700 1 -- 172.21.15.59:0/538992283 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe550007470 con 0x7fe56009e930 2023-09-30T22:29:08.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.820+0000 7fe566912700 1 -- 172.21.15.59:0/538992283 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe560074ea0 con 0x7fe56009e930 2023-09-30T22:29:08.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.820+0000 7fe55cff9700 1 -- 172.21.15.59:0/538992283 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fe55003f700 con 0x7fe56009e930 2023-09-30T22:29:08.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:08.825+0000 7fe55cff9700 1 -- 172.21.15.59:0/538992283 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe550007720 con 0x7fe56009e930 2023-09-30T22:29:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.073+0000 7fe566912700 1 -- 172.21.15.59:0/538992283 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe56011d5a0 con 0x7fe56009e930 2023-09-30T22:29:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.073+0000 7fe55cff9700 1 -- 172.21.15.59:0/538992283 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2315 (secure 0 0 0) 0x7fe550011360 con 0x7fe56009e930 2023-09-30T22:29:09.073 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:09.073 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:26:34.412591+0000","modified":"2023-09-30T22:27:00.923070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/2103029646","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":2103029646}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T22:29:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.075+0000 7fe566912700 1 -- 172.21.15.59:0/538992283 >> v1:172.21.15.59:6816/126772 conn(0x7fe54c02f510 legacy=0x7fe54c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.075+0000 7fe566912700 1 -- 172.21.15.59:0/538992283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe56009e930 msgr2=0x7fe56011b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.075+0000 7fe566912700 1 --2- 172.21.15.59:0/538992283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe56009e930 0x7fe56011b1b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe55000c4a0 tx=0x7fe55000c7b0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.075+0000 7fe566912700 1 -- 172.21.15.59:0/538992283 shutdown_connections 2023-09-30T22:29:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.075+0000 7fe566912700 1 --2- 172.21.15.59:0/538992283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe56009e930 0x7fe56011b1b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.075+0000 7fe566912700 1 --2- 172.21.15.59:0/538992283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe560136fe0 0x7fe56011bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.075+0000 7fe566912700 1 --2- 172.21.15.59:0/538992283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56009f410 0x7fe56011b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.075+0000 7fe566912700 1 -- 172.21.15.59:0/538992283 >> 172.21.15.59:0/538992283 conn(0x7fe5600a4210 msgr2=0x7fe56009d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.075+0000 7fe566912700 1 -- 172.21.15.59:0/538992283 shutdown_connections 2023-09-30T22:29:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.075+0000 7fe566912700 1 -- 172.21.15.59:0/538992283 wait complete. 2023-09-30T22:29:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-09-30T22:29:09.189 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:26:34.412591+0000', 'modified': '2023-09-30T22:27:00.923070+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4181}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4181': {'gid': 4181, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6817/2103029646', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.59:6817', 'nonce': 2103029646}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-30T22:29:09.189 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:29:09.190 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:29:09.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.333+0000 7fb9e3543700 1 Processor -- start 2023-09-30T22:29:09.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.333+0000 7fb9e3543700 1 -- start start 2023-09-30T22:29:09.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.333+0000 7fb9e3543700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9dc09d6f0 0x7fb9dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.333+0000 7fb9e3543700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09e000 0x7fb9dc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.333+0000 7fb9e3543700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09e410 0x7fb9dc130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e3543700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9dc09f520 con 0x7fb9dc09d6f0 2023-09-30T22:29:09.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e3543700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc09f130 con 0x7fb9dc09e410 2023-09-30T22:29:09.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e3543700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc09e930 con 0x7fb9dc09e000 2023-09-30T22:29:09.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e0ade700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09e000 0x7fb9dc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e12df700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9dc09d6f0 0x7fb9dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e1ae0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09e410 0x7fb9dc130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e0ade700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09e000 0x7fb9dc130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59828/0 (socket says 172.21.15.59:59828) 2023-09-30T22:29:09.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e12df700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9dc09d6f0 0x7fb9dc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58592/0 (socket says 172.21.15.59:58592) 2023-09-30T22:29:09.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e0ade700 1 -- 172.21.15.59:0/275577165 learned_addr learned my addr 172.21.15.59:0/275577165 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:09.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e1ae0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09e410 0x7fb9dc130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42592/0 (socket says 172.21.15.59:42592) 2023-09-30T22:29:09.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e0ade700 1 -- 172.21.15.59:0/275577165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09e410 msgr2=0x7fb9dc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e0ade700 1 --2- 172.21.15.59:0/275577165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09e410 0x7fb9dc130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e0ade700 1 -- 172.21.15.59:0/275577165 >> v2:172.21.15.59:3300/0 conn(0x7fb9dc09d6f0 msgr2=0x7fb9dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e0ade700 1 --2- 172.21.15.59:0/275577165 >> v2:172.21.15.59:3300/0 conn(0x7fb9dc09d6f0 0x7fb9dc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e0ade700 1 -- 172.21.15.59:0/275577165 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc09b2d0 con 0x7fb9dc09e000 2023-09-30T22:29:09.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e12df700 1 --2- 172.21.15.59:0/275577165 >> v2:172.21.15.59:3300/0 conn(0x7fb9dc09d6f0 0x7fb9dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:09.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9e0ade700 1 --2- 172.21.15.59:0/275577165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09e000 0x7fb9dc130660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009920 tx=0x7fb9cc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65cb80658f88be80 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9d3fff700 1 -- 172.21.15.59:0/275577165 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc011830 con 0x7fb9dc09e000 2023-09-30T22:29:09.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9d3fff700 1 -- 172.21.15.59:0/275577165 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc011990 con 0x7fb9dc09e000 2023-09-30T22:29:09.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.334+0000 7fb9d3fff700 1 -- 172.21.15.59:0/275577165 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc011d20 con 0x7fb9dc09e000 2023-09-30T22:29:09.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.335+0000 7fb9e3543700 1 -- 172.21.15.59:0/275577165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09e000 msgr2=0x7fb9dc130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.335+0000 7fb9e3543700 1 --2- 172.21.15.59:0/275577165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09e000 0x7fb9dc130660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009920 tx=0x7fb9cc009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:09.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.335+0000 7fb9e3543700 1 -- 172.21.15.59:0/275577165 shutdown_connections 2023-09-30T22:29:09.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.335+0000 7fb9e3543700 1 --2- 172.21.15.59:0/275577165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09e410 0x7fb9dc130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.335+0000 7fb9e3543700 1 --2- 172.21.15.59:0/275577165 >> v2:172.21.15.59:3300/0 conn(0x7fb9dc09d6f0 0x7fb9dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.335+0000 7fb9e3543700 1 --2- 172.21.15.59:0/275577165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09e000 0x7fb9dc130660 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.335+0000 7fb9e3543700 1 -- 172.21.15.59:0/275577165 >> 172.21.15.59:0/275577165 conn(0x7fb9dc066f50 msgr2=0x7fb9dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.335+0000 7fb9e3543700 1 -- 172.21.15.59:0/275577165 shutdown_connections 2023-09-30T22:29:09.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.335+0000 7fb9e3543700 1 -- 172.21.15.59:0/275577165 wait complete. 2023-09-30T22:29:09.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.336+0000 7fb9e3543700 1 Processor -- start 2023-09-30T22:29:09.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.336+0000 7fb9e3543700 1 -- start start 2023-09-30T22:29:09.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e3543700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09d6f0 0x7fb9dc120330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e3543700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09e000 0x7fb9dc120870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e3543700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9dc09e410 0x7fb9dc120db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e3543700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc123c30 con 0x7fb9dc09e410 2023-09-30T22:29:09.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e3543700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc123e10 con 0x7fb9dc09e000 2023-09-30T22:29:09.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e3543700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc071630 con 0x7fb9dc09d6f0 2023-09-30T22:29:09.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e12df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09d6f0 0x7fb9dc120330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e0ade700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09e000 0x7fb9dc120870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e12df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09d6f0 0x7fb9dc120330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59836/0 (socket says 172.21.15.59:59836) 2023-09-30T22:29:09.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e12df700 1 -- 172.21.15.59:0/4280720065 learned_addr learned my addr 172.21.15.59:0/4280720065 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:09.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e1ae0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9dc09e410 0x7fb9dc120db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e12df700 1 -- 172.21.15.59:0/4280720065 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09e000 msgr2=0x7fb9dc120870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e12df700 1 --2- 172.21.15.59:0/4280720065 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09e000 0x7fb9dc120870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e12df700 1 -- 172.21.15.59:0/4280720065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9dc09e410 msgr2=0x7fb9dc120db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e12df700 1 --2- 172.21.15.59:0/4280720065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9dc09e410 0x7fb9dc120db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e12df700 1 -- 172.21.15.59:0/4280720065 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d80094a0 con 0x7fb9dc09d6f0 2023-09-30T22:29:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e0ade700 1 --2- 172.21.15.59:0/4280720065 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09e000 0x7fb9dc120870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e1ae0700 1 --2- 172.21.15.59:0/4280720065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9dc09e410 0x7fb9dc120db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.337+0000 7fb9e12df700 1 --2- 172.21.15.59:0/4280720065 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09d6f0 0x7fb9dc120330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800ec10 tx=0x7fb9d800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.338+0000 7fb9d1ffb700 1 -- 172.21.15.59:0/4280720065 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8009780 con 0x7fb9dc09d6f0 2023-09-30T22:29:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.338+0000 7fb9d1ffb700 1 -- 172.21.15.59:0/4280720065 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d800c850 con 0x7fb9dc09d6f0 2023-09-30T22:29:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.338+0000 7fb9e3543700 1 -- 172.21.15.59:0/4280720065 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9cc009550 con 0x7fb9dc09d6f0 2023-09-30T22:29:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.338+0000 7fb9d1ffb700 1 -- 172.21.15.59:0/4280720065 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800cbe0 con 0x7fb9dc09d6f0 2023-09-30T22:29:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.338+0000 7fb9e3543700 1 -- 172.21.15.59:0/4280720065 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc122000 con 0x7fb9dc09d6f0 2023-09-30T22:29:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.339+0000 7fb9d1ffb700 1 -- 172.21.15.59:0/4280720065 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb9d800cd40 con 0x7fb9dc09d6f0 2023-09-30T22:29:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.339+0000 7fb9d1ffb700 1 -- 172.21.15.59:0/4280720065 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fb9d803fc00 con 0x7fb9dc09d6f0 2023-09-30T22:29:09.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.342+0000 7fb9ef6e6b80 1 Processor -- start 2023-09-30T22:29:09.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.342+0000 7fb9ef6e6b80 1 -- start start 2023-09-30T22:29:09.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.342+0000 7fb9ef6e6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc319c50 0x55e9fc31a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.342+0000 7fb9ef6e6b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc336100 0x55e9fc31a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.342+0000 7fb9ef6e6b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc3308f0 0x55e9fc330d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.342+0000 7fb9ef6e6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9fc27cc60 con 0x55e9fc319c50 2023-09-30T22:29:09.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.342+0000 7fb9ef6e6b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9fc277a10 con 0x55e9fc336100 2023-09-30T22:29:09.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.342+0000 7fb9ef6e6b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e9fc275210 con 0x55e9fc3308f0 2023-09-30T22:29:09.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.343+0000 7fb9e12df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc319c50 0x55e9fc31a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.343+0000 7fb9e12df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc319c50 0x55e9fc31a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58614/0 (socket says 172.21.15.59:58614) 2023-09-30T22:29:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.343+0000 7fb9e12df700 1 -- 172.21.15.59:0/3350708655 learned_addr learned my addr 172.21.15.59:0/3350708655 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.343+0000 7fb9e1ae0700 1 --2- 172.21.15.59:0/3350708655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc3308f0 0x55e9fc330d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.343+0000 7fb9e0ade700 1 --2- 172.21.15.59:0/3350708655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc336100 0x55e9fc31a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.343+0000 7fb9e12df700 1 -- 172.21.15.59:0/3350708655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc3308f0 msgr2=0x55e9fc330d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.343+0000 7fb9e12df700 1 --2- 172.21.15.59:0/3350708655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc3308f0 0x55e9fc330d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.343+0000 7fb9e12df700 1 -- 172.21.15.59:0/3350708655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc336100 msgr2=0x55e9fc31a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.343+0000 7fb9e12df700 1 --2- 172.21.15.59:0/3350708655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc336100 0x55e9fc31a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.343+0000 7fb9e12df700 1 -- 172.21.15.59:0/3350708655 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9fc064790 con 0x55e9fc319c50 2023-09-30T22:29:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.343+0000 7fb9e12df700 1 --2- 172.21.15.59:0/3350708655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc319c50 0x55e9fc31a020 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb9d803e700 tx=0x7fb9d8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0eb663af97584b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.343+0000 7fb9c6ffd700 1 -- 172.21.15.59:0/3350708655 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8039ea0 con 0x55e9fc319c50 2023-09-30T22:29:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.343+0000 7fb9c6ffd700 1 -- 172.21.15.59:0/3350708655 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d801aba0 con 0x55e9fc319c50 2023-09-30T22:29:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.343+0000 7fb9c6ffd700 1 -- 172.21.15.59:0/3350708655 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d801b3b0 con 0x55e9fc319c50 2023-09-30T22:29:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.344+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3350708655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc319c50 msgr2=0x55e9fc31a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.344+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/3350708655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc319c50 0x55e9fc31a020 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb9d803e700 tx=0x7fb9d8011000 comp rx=0 tx=0).stop 2023-09-30T22:29:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.344+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3350708655 shutdown_connections 2023-09-30T22:29:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.344+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/3350708655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc3308f0 0x55e9fc330d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.344+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/3350708655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc319c50 0x55e9fc31a020 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.344+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/3350708655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc336100 0x55e9fc31a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.344+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3350708655 >> 172.21.15.59:0/3350708655 conn(0x55e9fc31e0f0 msgr2=0x55e9fc31d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.344+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3350708655 shutdown_connections 2023-09-30T22:29:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.344+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3350708655 wait complete. 2023-09-30T22:29:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.344+0000 7fb9ef6e6b80 1 -- start start 2023-09-30T22:29:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.344+0000 7fb9ef6e6b80 1 Processor -- start 2023-09-30T22:29:09.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.345+0000 7fb9ef6e6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc319c50 0x55e9fc33f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.345+0000 7fb9ef6e6b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc3308f0 0x55e9fc33f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.345+0000 7fb9ef6e6b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc336100 0x55e9fc33fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.345+0000 7fb9ef6e6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9fc270b00 con 0x55e9fc319c50 2023-09-30T22:29:09.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.345+0000 7fb9ef6e6b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9fc20c770 con 0x55e9fc3308f0 2023-09-30T22:29:09.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.345+0000 7fb9ef6e6b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e9fc22f6f0 con 0x55e9fc336100 2023-09-30T22:29:09.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.345+0000 7fb9ef6e6b80 10 client.0 _ll_register_callbacks cb 0x55e9fc0785a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:29:09.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.345+0000 7fb9e0ade700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc3308f0 0x55e9fc33f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.345+0000 7fb9e12df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc319c50 0x55e9fc33f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.345+0000 7fb9e0ade700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc3308f0 0x55e9fc33f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42610/0 (socket says 172.21.15.59:42610) 2023-09-30T22:29:09.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.345+0000 7fb9e0ade700 1 -- 172.21.15.59:0/567981348 learned_addr learned my addr 172.21.15.59:0/567981348 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:09.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.345+0000 7fb9e1ae0700 1 --2- 172.21.15.59:0/567981348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc336100 0x55e9fc33fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9e12df700 1 -- 172.21.15.59:0/567981348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc336100 msgr2=0x55e9fc33fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9e12df700 1 --2- 172.21.15.59:0/567981348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc336100 0x55e9fc33fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9e12df700 1 -- 172.21.15.59:0/567981348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc3308f0 msgr2=0x55e9fc33f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9e12df700 1 --2- 172.21.15.59:0/567981348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc3308f0 0x55e9fc33f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9e12df700 1 -- 172.21.15.59:0/567981348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc122000 con 0x55e9fc319c50 2023-09-30T22:29:09.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9e12df700 1 --2- 172.21.15.59:0/567981348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc319c50 0x55e9fc33f230 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8011fb0 tx=0x7fb9d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86e41889b6a84ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-09-30T22:29:09.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9bbfff700 1 -- 172.21.15.59:0/567981348 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d801b940 con 0x55e9fc319c50 2023-09-30T22:29:09.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9bbfff700 1 -- 172.21.15.59:0/567981348 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fb9d8005a20 con 0x55e9fc319c50 2023-09-30T22:29:09.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/567981348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9fc3122b0 con 0x55e9fc319c50 2023-09-30T22:29:09.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9bbfff700 1 -- 172.21.15.59:0/567981348 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9d8005c00 con 0x55e9fc319c50 2023-09-30T22:29:09.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9ef6e6b80 10 client.14466 fetch_fsmap learned FSMap version 8 2023-09-30T22:29:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/567981348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=3+}) v3 -- 0x55e9fc1510a0 con 0x55e9fc319c50 2023-09-30T22:29:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9bbfff700 1 -- 172.21.15.59:0/567981348 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e9fc3122b0 con 0x55e9fc319c50 2023-09-30T22:29:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9bbfff700 1 -- 172.21.15.59:0/567981348 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 8) v1 ==== 1436+0+0 (secure 0 0 0) 0x7fb9d801a360 con 0x55e9fc319c50 2023-09-30T22:29:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9ef6e6b80 10 client.14466 fetch_fsmap finished waiting for FSMap version 8 2023-09-30T22:29:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9ef6e6b80 10 client.14466 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:29:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9ef6e6b80 20 client.14466 populate_metadata read hostname 'smithi059' 2023-09-30T22:29:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9ef6e6b80 4 client.14466 mds_command: new command op to 4181 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:29:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.346+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/567981348 --> v1:172.21.15.59:6817/2103029646 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9fc2eef40 con 0x55e9fc32fdd0 2023-09-30T22:29:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.347+0000 7fb9bbfff700 10 client.14466 ms_handle_connect on v1:172.21.15.59:6817/2103029646 2023-09-30T22:29:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.347+0000 7fb9bbfff700 1 -- 172.21.15.59:0/567981348 <== mds.0 v1:172.21.15.59:6817/2103029646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55e9fc2eef40 con 0x55e9fc32fdd0 2023-09-30T22:29:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.347+0000 7fb9bbfff700 10 client.14466 handle_command_reply: tid=0 2023-09-30T22:29:09.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.348+0000 7fb9ef6e6b80 1 client.14466 shutdown 2023-09-30T22:29:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.348+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/567981348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc319c50 msgr2=0x55e9fc33f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.348+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/567981348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc319c50 0x55e9fc33f230 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8011fb0 tx=0x7fb9d8004750 comp rx=0 tx=0).stop 2023-09-30T22:29:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.348+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/567981348 shutdown_connections 2023-09-30T22:29:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.348+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/567981348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc336100 0x55e9fc33fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.348+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/567981348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc319c50 0x55e9fc33f230 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.348+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/567981348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc3308f0 0x55e9fc33f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.348+0000 7fb9bbfff700 0 client.14466 ms_handle_reset on v1:172.21.15.59:6817/2103029646 2023-09-30T22:29:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.348+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/567981348 >> 172.21.15.59:0/567981348 conn(0x55e9fc31e0f0 msgr2=0x55e9fc31a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.348+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/567981348 shutdown_connections 2023-09-30T22:29:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.348+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/567981348 wait complete. 2023-09-30T22:29:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.348+0000 7fb9ef6e6b80 20 client.14466 trim_cache size 0 max 16384 2023-09-30T22:29:09.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.366+0000 7fb9ef6e6b80 1 Processor -- start 2023-09-30T22:29:09.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.366+0000 7fb9ef6e6b80 1 -- start start 2023-09-30T22:29:09.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.366+0000 7fb9ef6e6b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc319c50 0x55e9fc31d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.366+0000 7fb9ef6e6b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc3308f0 0x55e9fc334560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.366+0000 7fb9ef6e6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc336100 0x55e9fc3384a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.366+0000 7fb9ef6e6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9fc33b040 con 0x55e9fc336100 2023-09-30T22:29:09.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.366+0000 7fb9ef6e6b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9fc065390 con 0x55e9fc3308f0 2023-09-30T22:29:09.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.366+0000 7fb9ef6e6b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e9fc340ae0 con 0x55e9fc319c50 2023-09-30T22:29:09.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9e1ae0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc336100 0x55e9fc3384a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9e0ade700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc3308f0 0x55e9fc334560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9e12df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc319c50 0x55e9fc31d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9e0ade700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc3308f0 0x55e9fc334560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42620/0 (socket says 172.21.15.59:42620) 2023-09-30T22:29:09.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9e12df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc319c50 0x55e9fc31d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59868/0 (socket says 172.21.15.59:59868) 2023-09-30T22:29:09.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9e1ae0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc336100 0x55e9fc3384a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58626/0 (socket says 172.21.15.59:58626) 2023-09-30T22:29:09.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9e0ade700 1 -- 172.21.15.59:0/3555935272 learned_addr learned my addr 172.21.15.59:0/3555935272 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:09.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9e0ade700 1 -- 172.21.15.59:0/3555935272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc319c50 msgr2=0x55e9fc31d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9e0ade700 1 --2- 172.21.15.59:0/3555935272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc319c50 0x55e9fc31d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9e0ade700 1 -- 172.21.15.59:0/3555935272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc336100 msgr2=0x55e9fc3384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9e0ade700 1 --2- 172.21.15.59:0/3555935272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc336100 0x55e9fc3384a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9e0ade700 1 -- 172.21.15.59:0/3555935272 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9fc237010 con 0x55e9fc3308f0 2023-09-30T22:29:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9e12df700 1 --2- 172.21.15.59:0/3555935272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc319c50 0x55e9fc31d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9e0ade700 1 --2- 172.21.15.59:0/3555935272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc3308f0 0x55e9fc334560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc013000 tx=0x7fb9cc008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a6314a7b43701d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9c77fe700 1 -- 172.21.15.59:0/3555935272 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc024070 con 0x55e9fc3308f0 2023-09-30T22:29:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9c77fe700 1 -- 172.21.15.59:0/3555935272 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc012d70 con 0x55e9fc3308f0 2023-09-30T22:29:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.367+0000 7fb9c77fe700 1 -- 172.21.15.59:0/3555935272 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc028280 con 0x55e9fc3308f0 2023-09-30T22:29:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.368+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3555935272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc3308f0 msgr2=0x55e9fc334560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.368+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/3555935272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc3308f0 0x55e9fc334560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc013000 tx=0x7fb9cc008030 comp rx=0 tx=0).stop 2023-09-30T22:29:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.368+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3555935272 shutdown_connections 2023-09-30T22:29:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.368+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/3555935272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc319c50 0x55e9fc31d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.368+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/3555935272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc336100 0x55e9fc3384a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.368+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/3555935272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc3308f0 0x55e9fc334560 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.368+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3555935272 >> 172.21.15.59:0/3555935272 conn(0x55e9fc31e0f0 msgr2=0x55e9fc316210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.368+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3555935272 shutdown_connections 2023-09-30T22:29:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.368+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3555935272 wait complete. 2023-09-30T22:29:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.368+0000 7fb9ef6e6b80 1 -- start start 2023-09-30T22:29:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.368+0000 7fb9ef6e6b80 1 Processor -- start 2023-09-30T22:29:09.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.369+0000 7fb9ef6e6b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc319c50 0x55e9fc39b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.369+0000 7fb9ef6e6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc3308f0 0x55e9fc39be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.369+0000 7fb9ef6e6b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc336100 0x55e9fc32e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.369+0000 7fb9ef6e6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9fc39c390 con 0x55e9fc3308f0 2023-09-30T22:29:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.369+0000 7fb9ef6e6b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9fc34f870 con 0x55e9fc319c50 2023-09-30T22:29:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.369+0000 7fb9ef6e6b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e9fc3501b0 con 0x55e9fc336100 2023-09-30T22:29:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.369+0000 7fb9ef6e6b80 10 client.0 _ll_register_callbacks cb 0x7fb9d80090e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:29:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.369+0000 7fb9e12df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc319c50 0x55e9fc39b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.369+0000 7fb9e12df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc319c50 0x55e9fc39b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42634/0 (socket says 172.21.15.59:42634) 2023-09-30T22:29:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.369+0000 7fb9e12df700 1 -- 172.21.15.59:0/3944882905 learned_addr learned my addr 172.21.15.59:0/3944882905 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.369+0000 7fb9e1ae0700 1 --2- 172.21.15.59:0/3944882905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc336100 0x55e9fc32e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.369+0000 7fb9e0ade700 1 --2- 172.21.15.59:0/3944882905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc3308f0 0x55e9fc39be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9e12df700 1 -- 172.21.15.59:0/3944882905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc336100 msgr2=0x55e9fc32e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9e12df700 1 --2- 172.21.15.59:0/3944882905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc336100 0x55e9fc32e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9e12df700 1 -- 172.21.15.59:0/3944882905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc3308f0 msgr2=0x55e9fc39be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9e12df700 1 --2- 172.21.15.59:0/3944882905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc3308f0 0x55e9fc39be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9e12df700 1 -- 172.21.15.59:0/3944882905 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e9fc1510a0 con 0x55e9fc319c50 2023-09-30T22:29:09.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9e1ae0700 1 --2- 172.21.15.59:0/3944882905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc336100 0x55e9fc32e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:09.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9e12df700 1 --2- 172.21.15.59:0/3944882905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc319c50 0x55e9fc39b910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8000be0 tx=0x7fb9d800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f8d483eaad0ea4b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.59:3301/0 2023-09-30T22:29:09.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9bbfff700 1 -- 172.21.15.59:0/3944882905 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d801a7d0 con 0x55e9fc319c50 2023-09-30T22:29:09.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9bbfff700 1 -- 172.21.15.59:0/3944882905 <== mon.1 v2:172.21.15.59:3301/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fb9d801a930 con 0x55e9fc319c50 2023-09-30T22:29:09.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3944882905 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9d801aba0 con 0x55e9fc319c50 2023-09-30T22:29:09.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9bbfff700 1 -- 172.21.15.59:0/3944882905 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9d8005a20 con 0x55e9fc319c50 2023-09-30T22:29:09.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9ef6e6b80 10 client.14371 fetch_fsmap learned FSMap version 8 2023-09-30T22:29:09.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3944882905 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=3+}) v3 -- 0x7fb9dc09b2d0 con 0x55e9fc319c50 2023-09-30T22:29:09.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9bbfff700 1 -- 172.21.15.59:0/3944882905 <== mon.1 v2:172.21.15.59:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d801aba0 con 0x55e9fc319c50 2023-09-30T22:29:09.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9bbfff700 1 -- 172.21.15.59:0/3944882905 <== mon.1 v2:172.21.15.59:3301/0 5 ==== fsmap(e 8) v1 ==== 1436+0+0 (secure 0 0 0) 0x7fb9d8005bc0 con 0x55e9fc319c50 2023-09-30T22:29:09.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9ef6e6b80 10 client.14371 fetch_fsmap finished waiting for FSMap version 8 2023-09-30T22:29:09.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9ef6e6b80 10 client.14371 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:29:09.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.370+0000 7fb9ef6e6b80 20 client.14371 populate_metadata read hostname 'smithi059' 2023-09-30T22:29:09.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.371+0000 7fb9ef6e6b80 4 client.14371 mds_command: new command op to 4181 tid=0[{"prefix": "status"}] 2023-09-30T22:29:09.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.371+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3944882905 --> v1:172.21.15.59:6817/2103029646 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e9fc269ce0 con 0x55e9fc32f220 2023-09-30T22:29:09.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.371+0000 7fb9bbfff700 10 client.14371 ms_handle_connect on v1:172.21.15.59:6817/2103029646 2023-09-30T22:29:09.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.371+0000 7fb9bbfff700 1 -- 172.21.15.59:0/3944882905 <== mds.0 v1:172.21.15.59:6817/2103029646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (unknown 0 0 3716309982) 0x55e9fc269ce0 con 0x55e9fc32f220 2023-09-30T22:29:09.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.371+0000 7fb9bbfff700 10 client.14371 handle_command_reply: tid=0 2023-09-30T22:29:09.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.371+0000 7fb9ef6e6b80 1 client.14371 shutdown 2023-09-30T22:29:09.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.371+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3944882905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc319c50 msgr2=0x55e9fc39b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.371+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/3944882905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc319c50 0x55e9fc39b910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8000be0 tx=0x7fb9d800ef90 comp rx=0 tx=0).stop 2023-09-30T22:29:09.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.371+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3944882905 shutdown_connections 2023-09-30T22:29:09.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.371+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/3944882905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55e9fc336100 0x55e9fc32e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.371+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/3944882905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e9fc319c50 0x55e9fc39b910 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.371+0000 7fb9bbfff700 0 client.14371 ms_handle_reset on v1:172.21.15.59:6817/2103029646 2023-09-30T22:29:09.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.371+0000 7fb9ef6e6b80 1 --2- 172.21.15.59:0/3944882905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9fc3308f0 0x55e9fc39be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.371+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3944882905 >> 172.21.15.59:0/3944882905 conn(0x55e9fc31e0f0 msgr2=0x55e9fc31a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.372+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3944882905 shutdown_connections 2023-09-30T22:29:09.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.372+0000 7fb9ef6e6b80 1 -- 172.21.15.59:0/3944882905 wait complete. 2023-09-30T22:29:09.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.372+0000 7fb9ef6e6b80 20 client.14371 trim_cache size 0 max 16384 2023-09-30T22:29:09.379 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-09-30T22:29:09.379 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "4ab45aad-c596-4cc8-9318-aa2f9d41daac", 2023-09-30T22:29:09.379 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2023-09-30T22:29:09.379 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4181, 2023-09-30T22:29:09.379 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2023-09-30T22:29:09.379 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2023-09-30T22:29:09.379 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2023-09-30T22:29:09.379 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 154.95494255099999, 2023-09-30T22:29:09.379 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 8, 2023-09-30T22:29:09.380 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 24, 2023-09-30T22:29:09.380 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 19, 2023-09-30T22:29:09.380 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 159.406419314 2023-09-30T22:29:09.380 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-09-30T22:29:09.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.372+0000 7fb9e3543700 1 -- 172.21.15.59:0/4280720065 >> v1:172.21.15.59:6816/126772 conn(0x7fb9c002f510 legacy=0x7fb9c00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.372+0000 7fb9e3543700 1 -- 172.21.15.59:0/4280720065 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09d6f0 msgr2=0x7fb9dc120330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.372+0000 7fb9e3543700 1 --2- 172.21.15.59:0/4280720065 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09d6f0 0x7fb9dc120330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800ec10 tx=0x7fb9d800ef20 comp rx=0 tx=0).stop 2023-09-30T22:29:09.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.372+0000 7fb9e3543700 1 -- 172.21.15.59:0/4280720065 shutdown_connections 2023-09-30T22:29:09.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.372+0000 7fb9e3543700 1 --2- 172.21.15.59:0/4280720065 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09d6f0 0x7fb9dc120330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.372+0000 7fb9e3543700 1 --2- 172.21.15.59:0/4280720065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9dc09e410 0x7fb9dc120db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.372+0000 7fb9e3543700 1 --2- 172.21.15.59:0/4280720065 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09e000 0x7fb9dc120870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.372+0000 7fb9e3543700 1 -- 172.21.15.59:0/4280720065 >> 172.21.15.59:0/4280720065 conn(0x7fb9dc066f50 msgr2=0x7fb9dc06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.372+0000 7fb9e3543700 1 -- 172.21.15.59:0/4280720065 shutdown_connections 2023-09-30T22:29:09.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.372+0000 7fb9e3543700 1 -- 172.21.15.59:0/4280720065 wait complete. 2023-09-30T22:29:09.386 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-09-30T22:29:09.398 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-30T22:29:09.398 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:29:09.434 INFO:tasks.ceph.osd.0:Stopped 2023-09-30T22:29:09.434 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2023-09-30T22:29:09.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.617+0000 7fab63b68700 1 Processor -- start 2023-09-30T22:29:09.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.618+0000 7fab63b68700 1 -- start start 2023-09-30T22:29:09.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.618+0000 7fab63b68700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5c09d6f0 0x7fab5c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.618+0000 7fab63b68700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5c09e000 0x7fab5c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.618+0000 7fab63b68700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab5c09e410 0x7fab5c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.618+0000 7fab63b68700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5c06b460 con 0x7fab5c09e410 2023-09-30T22:29:09.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.618+0000 7fab63b68700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c09b120 con 0x7fab5c09d6f0 2023-09-30T22:29:09.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.618+0000 7fab63b68700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c09a7e0 con 0x7fab5c09e000 2023-09-30T22:29:09.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.618+0000 7fab61904700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5c09d6f0 0x7fab5c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.618+0000 7fab61103700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5c09e000 0x7fab5c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.618+0000 7fab62105700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab5c09e410 0x7fab5c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.618+0000 7fab61904700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5c09d6f0 0x7fab5c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42648/0 (socket says 172.21.15.59:42648) 2023-09-30T22:29:09.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.618+0000 7fab61103700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5c09e000 0x7fab5c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59890/0 (socket says 172.21.15.59:59890) 2023-09-30T22:29:09.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.618+0000 7fab62105700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab5c09e410 0x7fab5c133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58650/0 (socket says 172.21.15.59:58650) 2023-09-30T22:29:09.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.618+0000 7fab61904700 1 -- 172.21.15.59:0/1957735720 learned_addr learned my addr 172.21.15.59:0/1957735720 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:09.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.619+0000 7fab62105700 1 -- 172.21.15.59:0/1957735720 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5c09e000 msgr2=0x7fab5c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.619+0000 7fab62105700 1 --2- 172.21.15.59:0/1957735720 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5c09e000 0x7fab5c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.619+0000 7fab62105700 1 -- 172.21.15.59:0/1957735720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5c09d6f0 msgr2=0x7fab5c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.619+0000 7fab62105700 1 --2- 172.21.15.59:0/1957735720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5c09d6f0 0x7fab5c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.619+0000 7fab62105700 1 -- 172.21.15.59:0/1957735720 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c09a500 con 0x7fab5c09e410 2023-09-30T22:29:09.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.619+0000 7fab61904700 1 --2- 172.21.15.59:0/1957735720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5c09d6f0 0x7fab5c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:09.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.619+0000 7fab61103700 1 --2- 172.21.15.59:0/1957735720 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5c09e000 0x7fab5c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:09.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.619+0000 7fab62105700 1 --2- 172.21.15.59:0/1957735720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5c09e410 0x7fab5c133f30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab54009d90 tx=0x7fab5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5221b2e57c4a81af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.619+0000 7fab60902700 1 -- 172.21.15.59:0/1957735720 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5400e070 con 0x7fab5c09e410 2023-09-30T22:29:09.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.619+0000 7fab60902700 1 -- 172.21.15.59:0/1957735720 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5400bb20 con 0x7fab5c09e410 2023-09-30T22:29:09.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.619+0000 7fab60902700 1 -- 172.21.15.59:0/1957735720 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54012430 con 0x7fab5c09e410 2023-09-30T22:29:09.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.620+0000 7fab63b68700 1 -- 172.21.15.59:0/1957735720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5c09e410 msgr2=0x7fab5c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.620+0000 7fab63b68700 1 --2- 172.21.15.59:0/1957735720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5c09e410 0x7fab5c133f30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab54009d90 tx=0x7fab5400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:09.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.620+0000 7fab63b68700 1 -- 172.21.15.59:0/1957735720 shutdown_connections 2023-09-30T22:29:09.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.620+0000 7fab63b68700 1 --2- 172.21.15.59:0/1957735720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5c09e410 0x7fab5c133f30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.620+0000 7fab63b68700 1 --2- 172.21.15.59:0/1957735720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5c09d6f0 0x7fab5c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.620+0000 7fab63b68700 1 --2- 172.21.15.59:0/1957735720 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5c09e000 0x7fab5c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.620+0000 7fab63b68700 1 -- 172.21.15.59:0/1957735720 >> 172.21.15.59:0/1957735720 conn(0x7fab5c066f50 msgr2=0x7fab5c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.620+0000 7fab63b68700 1 -- 172.21.15.59:0/1957735720 shutdown_connections 2023-09-30T22:29:09.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.620+0000 7fab63b68700 1 -- 172.21.15.59:0/1957735720 wait complete. 2023-09-30T22:29:09.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.621+0000 7fab63b68700 1 Processor -- start 2023-09-30T22:29:09.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.621+0000 7fab63b68700 1 -- start start 2023-09-30T22:29:09.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.621+0000 7fab63b68700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5c09d6f0 0x7fab5c1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.621+0000 7fab63b68700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5c09e000 0x7fab5c1c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.621+0000 7fab63b68700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5c09e410 0x7fab5c1c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.621+0000 7fab63b68700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c1a5470 con 0x7fab5c09e410 2023-09-30T22:29:09.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.621+0000 7fab63b68700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c1a5280 con 0x7fab5c09e000 2023-09-30T22:29:09.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.621+0000 7fab63b68700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0a2ee0 con 0x7fab5c09d6f0 2023-09-30T22:29:09.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.621+0000 7fab62105700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5c09e410 0x7fab5c1c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.621+0000 7fab61904700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5c09d6f0 0x7fab5c1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab62105700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5c09e410 0x7fab5c1c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58654/0 (socket says 172.21.15.59:58654) 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab62105700 1 -- 172.21.15.59:0/4138785406 learned_addr learned my addr 172.21.15.59:0/4138785406 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab61103700 1 --2- 172.21.15.59:0/4138785406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5c09e000 0x7fab5c1c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab62105700 1 -- 172.21.15.59:0/4138785406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5c09d6f0 msgr2=0x7fab5c1c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab62105700 1 --2- 172.21.15.59:0/4138785406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5c09d6f0 0x7fab5c1c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab62105700 1 -- 172.21.15.59:0/4138785406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5c09e000 msgr2=0x7fab5c1c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab62105700 1 --2- 172.21.15.59:0/4138785406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5c09e000 0x7fab5c1c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab62105700 1 -- 172.21.15.59:0/4138785406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab58009550 con 0x7fab5c09e410 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab61904700 1 --2- 172.21.15.59:0/4138785406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5c09d6f0 0x7fab5c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab61103700 1 --2- 172.21.15.59:0/4138785406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5c09e000 0x7fab5c1c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab62105700 1 --2- 172.21.15.59:0/4138785406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5c09e410 0x7fab5c1c8b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fab54013000 tx=0x7fab54004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab527fc700 1 -- 172.21.15.59:0/4138785406 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54004880 con 0x7fab5c09e410 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab527fc700 1 -- 172.21.15.59:0/4138785406 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab54020070 con 0x7fab5c09e410 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab63b68700 1 -- 172.21.15.59:0/4138785406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c0094a0 con 0x7fab5c09e410 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab527fc700 1 -- 172.21.15.59:0/4138785406 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540276c0 con 0x7fab5c09e410 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.622+0000 7fab63b68700 1 -- 172.21.15.59:0/4138785406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab54009a70 con 0x7fab5c09e410 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.623+0000 7fab527fc700 1 -- 172.21.15.59:0/4138785406 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fab54012430 con 0x7fab5c09e410 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.623+0000 7fab527fc700 1 -- 172.21.15.59:0/4138785406 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fab54022070 con 0x7fab5c09e410 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.623+0000 7fab63b68700 1 -- 172.21.15.59:0/4138785406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5c1a5ad0 con 0x7fab5c09e410 2023-09-30T22:29:09.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.629+0000 7fab527fc700 1 -- 172.21.15.59:0/4138785406 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab54003e10 con 0x7fab5c09e410 2023-09-30T22:29:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:09.846+0000 7fab63b68700 1 -- 172.21.15.59:0/4138785406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7fab5c074ea0 con 0x7fab5c09e410 2023-09-30T22:29:09.847 INFO:tasks.ceph.mon.a.smithi059.stderr:2023-09-30T22:29:09.846+0000 7f2c539ca700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2023-09-30T22:29:10.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.311+0000 7fab527fc700 1 -- 172.21.15.59:0/4138785406 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7fab54025b70 con 0x7fab5c09e410 2023-09-30T22:29:10.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.314+0000 7fab63b68700 1 -- 172.21.15.59:0/4138785406 >> v1:172.21.15.59:6816/126772 conn(0x7fab4002f510 legacy=0x7fab400319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.314+0000 7fab63b68700 1 -- 172.21.15.59:0/4138785406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5c09e410 msgr2=0x7fab5c1c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.314+0000 7fab63b68700 1 --2- 172.21.15.59:0/4138785406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5c09e410 0x7fab5c1c8b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fab54013000 tx=0x7fab54004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.315+0000 7fab63b68700 1 -- 172.21.15.59:0/4138785406 shutdown_connections 2023-09-30T22:29:10.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.315+0000 7fab63b68700 1 --2- 172.21.15.59:0/4138785406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5c09d6f0 0x7fab5c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.315+0000 7fab63b68700 1 --2- 172.21.15.59:0/4138785406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5c09e410 0x7fab5c1c8b10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.315+0000 7fab63b68700 1 --2- 172.21.15.59:0/4138785406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5c09e000 0x7fab5c1c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.315+0000 7fab63b68700 1 -- 172.21.15.59:0/4138785406 >> 172.21.15.59:0/4138785406 conn(0x7fab5c066f50 msgr2=0x7fab5c06f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:10.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.315+0000 7fab63b68700 1 -- 172.21.15.59:0/4138785406 shutdown_connections 2023-09-30T22:29:10.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.315+0000 7fab63b68700 1 -- 172.21.15.59:0/4138785406 wait complete. 2023-09-30T22:29:10.317 INFO:teuthology.orchestra.run.smithi059.stderr:marked down osd.0. 2023-09-30T22:29:10.333 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-30T22:29:10.333 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-30T22:29:10.335 INFO:tasks.ceph.osd.0:Started 2023-09-30T22:29:10.335 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-30T22:29:10.336 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:29:10.370 INFO:tasks.ceph.osd.1:Stopped 2023-09-30T22:29:10.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2023-09-30T22:29:10.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.548+0000 7f7c3d1b4700 1 Processor -- start 2023-09-30T22:29:10.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.548+0000 7f7c3d1b4700 1 -- start start 2023-09-30T22:29:10.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.548+0000 7f7c3d1b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3809e7e0 0x7f7c3809ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.548+0000 7f7c3d1b4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c3809f0f0 0x7f7c38137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.548+0000 7f7c3d1b4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3806bd70 con 0x7f7c38137ff0 2023-09-30T22:29:10.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.548+0000 7f7c3d1b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3806cc30 con 0x7f7c3809e7e0 2023-09-30T22:29:10.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.548+0000 7f7c3d1b4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3806d870 con 0x7f7c3809f0f0 2023-09-30T22:29:10.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.549+0000 7f7c36d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3809e7e0 0x7f7c3809ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.549+0000 7f7c3659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c3809f0f0 0x7f7c38137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.549+0000 7f7c36d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3809e7e0 0x7f7c3809ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42684/0 (socket says 172.21.15.59:42684) 2023-09-30T22:29:10.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.549+0000 7f7c36d9d700 1 -- 172.21.15.59:0/3156341126 learned_addr learned my addr 172.21.15.59:0/3156341126 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:10.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.549+0000 7f7c3659c700 1 -- 172.21.15.59:0/3156341126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3809e7e0 msgr2=0x7f7c3809ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:10.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.549+0000 7f7c3659c700 1 --2- 172.21.15.59:0/3156341126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3809e7e0 0x7f7c3809ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.549+0000 7f7c3659c700 1 -- 172.21.15.59:0/3156341126 >> v1:172.21.15.59:6789/0 conn(0x7f7c38137ff0 legacy=0x7f7c3813a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.549+0000 7f7c3659c700 1 -- 172.21.15.59:0/3156341126 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3806bab0 con 0x7f7c3809f0f0 2023-09-30T22:29:10.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.549+0000 7f7c35d9b700 1 -- 172.21.15.59:0/3156341126 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109788217 0 0) 0x7f7c3806bd70 con 0x7f7c38137ff0 2023-09-30T22:29:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.549+0000 7f7c3659c700 1 --2- 172.21.15.59:0/3156341126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c3809f0f0 0x7f7c38137ab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009870 tx=0x7f7c28009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a64ae0f262ea8e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.549+0000 7f7c35d9b700 1 -- 172.21.15.59:0/3156341126 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28011830 con 0x7f7c3809f0f0 2023-09-30T22:29:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.549+0000 7f7c35d9b700 1 -- 172.21.15.59:0/3156341126 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c28011990 con 0x7f7c3809f0f0 2023-09-30T22:29:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.549+0000 7f7c35d9b700 1 -- 172.21.15.59:0/3156341126 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28011d20 con 0x7f7c3809f0f0 2023-09-30T22:29:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.550+0000 7f7c3d1b4700 1 -- 172.21.15.59:0/3156341126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c3809f0f0 msgr2=0x7f7c38137ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.550+0000 7f7c3d1b4700 1 --2- 172.21.15.59:0/3156341126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c3809f0f0 0x7f7c38137ab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009870 tx=0x7f7c28009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.550+0000 7f7c3d1b4700 1 -- 172.21.15.59:0/3156341126 shutdown_connections 2023-09-30T22:29:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.550+0000 7f7c3d1b4700 1 --2- 172.21.15.59:0/3156341126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3809e7e0 0x7f7c3809ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.550+0000 7f7c3d1b4700 1 --2- 172.21.15.59:0/3156341126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c3809f0f0 0x7f7c38137ab0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.550+0000 7f7c3d1b4700 1 -- 172.21.15.59:0/3156341126 >> 172.21.15.59:0/3156341126 conn(0x7f7c380a4300 msgr2=0x7f7c380a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.550+0000 7f7c3d1b4700 1 -- 172.21.15.59:0/3156341126 shutdown_connections 2023-09-30T22:29:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.550+0000 7f7c3d1b4700 1 -- 172.21.15.59:0/3156341126 wait complete. 2023-09-30T22:29:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.551+0000 7f7c3d1b4700 1 Processor -- start 2023-09-30T22:29:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.551+0000 7f7c3d1b4700 1 -- start start 2023-09-30T22:29:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c3d1b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c3809e7e0 0x7f7c381217b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c3d1b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3809f0f0 0x7f7c38121cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c3d1b4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c38137ff0 0x7f7c38122230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c3d1b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c380a05d0 con 0x7f7c3809e7e0 2023-09-30T22:29:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c3d1b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c38124ca0 con 0x7f7c3809f0f0 2023-09-30T22:29:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c3d1b4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c38136690 con 0x7f7c38137ff0 2023-09-30T22:29:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c36d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c3809e7e0 0x7f7c381217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c3659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3809f0f0 0x7f7c38121cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c3759e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c38137ff0 0x7f7c38122230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c36d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c3809e7e0 0x7f7c381217b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58680/0 (socket says 172.21.15.59:58680) 2023-09-30T22:29:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c36d9d700 1 -- 172.21.15.59:0/4107300316 learned_addr learned my addr 172.21.15.59:0/4107300316 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c3659c700 1 -- 172.21.15.59:0/4107300316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c38137ff0 msgr2=0x7f7c38122230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c3659c700 1 --2- 172.21.15.59:0/4107300316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c38137ff0 0x7f7c38122230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c3659c700 1 -- 172.21.15.59:0/4107300316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c3809e7e0 msgr2=0x7f7c381217b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c3659c700 1 --2- 172.21.15.59:0/4107300316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c3809e7e0 0x7f7c381217b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c3659c700 1 -- 172.21.15.59:0/4107300316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c280094a0 con 0x7f7c3809f0f0 2023-09-30T22:29:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c36d9d700 1 --2- 172.21.15.59:0/4107300316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c3809e7e0 0x7f7c381217b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.552+0000 7f7c3659c700 1 --2- 172.21.15.59:0/4107300316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3809f0f0 0x7f7c38121cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c380a4e80 tx=0x7f7c28004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.553+0000 7f7c1f7fe700 1 -- 172.21.15.59:0/4107300316 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28004300 con 0x7f7c3809f0f0 2023-09-30T22:29:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.553+0000 7f7c1f7fe700 1 -- 172.21.15.59:0/4107300316 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2801f070 con 0x7f7c3809f0f0 2023-09-30T22:29:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.553+0000 7f7c3d1b4700 1 -- 172.21.15.59:0/4107300316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c381361d0 con 0x7f7c3809f0f0 2023-09-30T22:29:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.553+0000 7f7c1f7fe700 1 -- 172.21.15.59:0/4107300316 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280036a0 con 0x7f7c3809f0f0 2023-09-30T22:29:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.553+0000 7f7c3d1b4700 1 -- 172.21.15.59:0/4107300316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c38125940 con 0x7f7c3809f0f0 2023-09-30T22:29:10.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.554+0000 7f7c1f7fe700 1 -- 172.21.15.59:0/4107300316 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7c28021030 con 0x7f7c3809f0f0 2023-09-30T22:29:10.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.554+0000 7f7c1f7fe700 1 -- 172.21.15.59:0/4107300316 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f7c28040bb0 con 0x7f7c3809f0f0 2023-09-30T22:29:10.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.554+0000 7f7c3d1b4700 1 -- 172.21.15.59:0/4107300316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3804f2a0 con 0x7f7c3809f0f0 2023-09-30T22:29:10.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.559+0000 7f7c1f7fe700 1 -- 172.21.15.59:0/4107300316 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c28015020 con 0x7f7c3809f0f0 2023-09-30T22:29:10.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:10.780+0000 7f7c3d1b4700 1 -- 172.21.15.59:0/4107300316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7f7c3806b120 con 0x7f7c3809f0f0 2023-09-30T22:29:10.780 INFO:tasks.ceph.mon.a.smithi059.stderr:2023-09-30T22:29:10.780+0000 7f2c539ca700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2023-09-30T22:29:10.944 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-30T22:29:10.944+0000 7f69372b2680 -1 Falling back to public interface 2023-09-30T22:29:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.318+0000 7f7c1f7fe700 1 -- 172.21.15.59:0/4107300316 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v26) v1 ==== 89+0+0 (secure 0 0 0) 0x7f7c280239c0 con 0x7f7c3809f0f0 2023-09-30T22:29:11.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.327+0000 7f7c3d1b4700 1 -- 172.21.15.59:0/4107300316 >> v1:172.21.15.59:6816/126772 conn(0x7f7c2402f510 legacy=0x7f7c240319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.327+0000 7f7c3d1b4700 1 -- 172.21.15.59:0/4107300316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3809f0f0 msgr2=0x7f7c38121cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.327+0000 7f7c3d1b4700 1 --2- 172.21.15.59:0/4107300316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3809f0f0 0x7f7c38121cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c380a4e80 tx=0x7f7c28004750 comp rx=0 tx=0).stop 2023-09-30T22:29:11.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.327+0000 7f7c3d1b4700 1 -- 172.21.15.59:0/4107300316 shutdown_connections 2023-09-30T22:29:11.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.327+0000 7f7c3d1b4700 1 --2- 172.21.15.59:0/4107300316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c38137ff0 0x7f7c38122230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.327+0000 7f7c3d1b4700 1 --2- 172.21.15.59:0/4107300316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c3809e7e0 0x7f7c381217b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.327+0000 7f7c3d1b4700 1 --2- 172.21.15.59:0/4107300316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3809f0f0 0x7f7c38121cf0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c380a4e80 tx=0x7f7c28004750 comp rx=0 tx=0).stop 2023-09-30T22:29:11.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.327+0000 7f7c3d1b4700 1 -- 172.21.15.59:0/4107300316 >> 172.21.15.59:0/4107300316 conn(0x7f7c380a4300 msgr2=0x7f7c38070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:11.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.329+0000 7f7c3d1b4700 1 -- 172.21.15.59:0/4107300316 shutdown_connections 2023-09-30T22:29:11.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.329+0000 7f7c3d1b4700 1 -- 172.21.15.59:0/4107300316 wait complete. 2023-09-30T22:29:11.333 INFO:teuthology.orchestra.run.smithi059.stderr:marked down osd.1. 2023-09-30T22:29:11.346 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-30T22:29:11.346 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-30T22:29:11.348 INFO:tasks.ceph.osd.1:Started 2023-09-30T22:29:11.349 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-30T22:29:11.349 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:29:11.391 INFO:tasks.ceph.osd.2:Stopped 2023-09-30T22:29:11.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2023-09-30T22:29:11.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.530+0000 7f8e5d023700 1 Processor -- start 2023-09-30T22:29:11.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.530+0000 7f8e5d023700 1 -- start start 2023-09-30T22:29:11.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e5d023700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a0a30 0x7f8e580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e5d023700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e580a1340 0x7f8e58133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e5d023700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5809edd0 con 0x7f8e58133fa0 2023-09-30T22:29:11.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e5d023700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5809e1f0 con 0x7f8e580a1340 2023-09-30T22:29:11.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e5d023700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5809dc50 con 0x7f8e580a0a30 2023-09-30T22:29:11.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e56d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a0a30 0x7f8e580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e5759e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8e58133fa0 0x7f8e5813ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49536/0 (socket says 172.21.15.59:49536) 2023-09-30T22:29:11.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e5759e700 1 -- 172.21.15.59:0/1802922319 learned_addr learned my addr 172.21.15.59:0/1802922319 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:11.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e5659c700 1 --2- 172.21.15.59:0/1802922319 >> v2:172.21.15.59:3300/0 conn(0x7f8e580a1340 0x7f8e58133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e55d9b700 1 -- 172.21.15.59:0/1802922319 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209340870 0 0) 0x7f8e5809edd0 con 0x7f8e58133fa0 2023-09-30T22:29:11.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e56d9d700 1 -- 172.21.15.59:0/1802922319 >> v2:172.21.15.59:3300/0 conn(0x7f8e580a1340 msgr2=0x7f8e58133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:11.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e56d9d700 1 --2- 172.21.15.59:0/1802922319 >> v2:172.21.15.59:3300/0 conn(0x7f8e580a1340 0x7f8e58133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e56d9d700 1 -- 172.21.15.59:0/1802922319 >> v1:172.21.15.59:6789/0 conn(0x7f8e58133fa0 legacy=0x7f8e5813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e56d9d700 1 -- 172.21.15.59:0/1802922319 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e580a1fe0 con 0x7f8e580a0a30 2023-09-30T22:29:11.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e5659c700 1 --2- 172.21.15.59:0/1802922319 >> v2:172.21.15.59:3300/0 conn(0x7f8e580a1340 0x7f8e58133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:11.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.531+0000 7f8e56d9d700 1 --2- 172.21.15.59:0/1802922319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a0a30 0x7f8e580a0e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009840 tx=0x7f8e50009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f7275db296814c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:11.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.532+0000 7f8e55d9b700 1 -- 172.21.15.59:0/1802922319 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e50011830 con 0x7f8e580a0a30 2023-09-30T22:29:11.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.532+0000 7f8e55d9b700 1 -- 172.21.15.59:0/1802922319 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e50011990 con 0x7f8e580a0a30 2023-09-30T22:29:11.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.532+0000 7f8e55d9b700 1 -- 172.21.15.59:0/1802922319 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e50011d20 con 0x7f8e580a0a30 2023-09-30T22:29:11.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.532+0000 7f8e5d023700 1 -- 172.21.15.59:0/1802922319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a0a30 msgr2=0x7f8e580a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.532+0000 7f8e5d023700 1 --2- 172.21.15.59:0/1802922319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a0a30 0x7f8e580a0e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009840 tx=0x7f8e50009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:11.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.532+0000 7f8e5d023700 1 -- 172.21.15.59:0/1802922319 shutdown_connections 2023-09-30T22:29:11.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.532+0000 7f8e5d023700 1 --2- 172.21.15.59:0/1802922319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a0a30 0x7f8e580a0e00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.532+0000 7f8e5d023700 1 --2- 172.21.15.59:0/1802922319 >> v2:172.21.15.59:3300/0 conn(0x7f8e580a1340 0x7f8e58133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.532+0000 7f8e5d023700 1 -- 172.21.15.59:0/1802922319 >> 172.21.15.59:0/1802922319 conn(0x7f8e580a6550 msgr2=0x7f8e580a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:11.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.532+0000 7f8e5d023700 1 -- 172.21.15.59:0/1802922319 shutdown_connections 2023-09-30T22:29:11.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.532+0000 7f8e5d023700 1 -- 172.21.15.59:0/1802922319 wait complete. 2023-09-30T22:29:11.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.534+0000 7f8e5d023700 1 Processor -- start 2023-09-30T22:29:11.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.534+0000 7f8e5d023700 1 -- start start 2023-09-30T22:29:11.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.534+0000 7f8e5d023700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e580a0a30 0x7f8e58122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.534+0000 7f8e5d023700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a1340 0x7f8e58122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.534+0000 7f8e5d023700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e58133fa0 0x7f8e58123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.534+0000 7f8e5d023700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58125c80 con 0x7f8e58133fa0 2023-09-30T22:29:11.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.534+0000 7f8e5d023700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58123b80 con 0x7f8e580a1340 2023-09-30T22:29:11.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.534+0000 7f8e5d023700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e581243b0 con 0x7f8e580a0a30 2023-09-30T22:29:11.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.534+0000 7f8e5659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a1340 0x7f8e58122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.534+0000 7f8e56d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e580a0a30 0x7f8e58122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.534+0000 7f8e5659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a1340 0x7f8e58122cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42718/0 (socket says 172.21.15.59:42718) 2023-09-30T22:29:11.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.534+0000 7f8e5659c700 1 -- 172.21.15.59:0/2355439998 learned_addr learned my addr 172.21.15.59:0/2355439998 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:11.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.534+0000 7f8e5759e700 1 --2- 172.21.15.59:0/2355439998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e58133fa0 0x7f8e58123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.535+0000 7f8e56d9d700 1 -- 172.21.15.59:0/2355439998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a1340 msgr2=0x7f8e58122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.535+0000 7f8e56d9d700 1 --2- 172.21.15.59:0/2355439998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a1340 0x7f8e58122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.535+0000 7f8e56d9d700 1 -- 172.21.15.59:0/2355439998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e58133fa0 msgr2=0x7f8e58123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.535+0000 7f8e56d9d700 1 --2- 172.21.15.59:0/2355439998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e58133fa0 0x7f8e58123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.535+0000 7f8e56d9d700 1 -- 172.21.15.59:0/2355439998 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c0094a0 con 0x7f8e580a0a30 2023-09-30T22:29:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.535+0000 7f8e5659c700 1 --2- 172.21.15.59:0/2355439998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a1340 0x7f8e58122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.535+0000 7f8e5759e700 1 --2- 172.21.15.59:0/2355439998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e58133fa0 0x7f8e58123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.535+0000 7f8e56d9d700 1 --2- 172.21.15.59:0/2355439998 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e580a0a30 0x7f8e58122790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e50016000 tx=0x7f8e50004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.535+0000 7f8e3f7fe700 1 -- 172.21.15.59:0/2355439998 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e500036a0 con 0x7f8e580a0a30 2023-09-30T22:29:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.535+0000 7f8e3f7fe700 1 -- 172.21.15.59:0/2355439998 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5001f070 con 0x7f8e580a0a30 2023-09-30T22:29:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.535+0000 7f8e3f7fe700 1 -- 172.21.15.59:0/2355439998 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e50003a20 con 0x7f8e580a0a30 2023-09-30T22:29:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.535+0000 7f8e5d023700 1 -- 172.21.15.59:0/2355439998 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e500094a0 con 0x7f8e580a0a30 2023-09-30T22:29:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.535+0000 7f8e5d023700 1 -- 172.21.15.59:0/2355439998 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e58133200 con 0x7f8e580a0a30 2023-09-30T22:29:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.536+0000 7f8e3f7fe700 1 -- 172.21.15.59:0/2355439998 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8e50003b80 con 0x7f8e580a0a30 2023-09-30T22:29:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.536+0000 7f8e3f7fe700 1 -- 172.21.15.59:0/2355439998 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f8e50021070 con 0x7f8e580a0a30 2023-09-30T22:29:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.536+0000 7f8e5d023700 1 -- 172.21.15.59:0/2355439998 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e580a1d40 con 0x7f8e580a0a30 2023-09-30T22:29:11.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.541+0000 7f8e3f7fe700 1 -- 172.21.15.59:0/2355439998 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e5002b080 con 0x7f8e580a0a30 2023-09-30T22:29:11.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:11.762+0000 7f8e5d023700 1 -- 172.21.15.59:0/2355439998 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7f8e58074ea0 con 0x7f8e580a0a30 2023-09-30T22:29:11.762 INFO:tasks.ceph.mon.a.smithi059.stderr:2023-09-30T22:29:11.762+0000 7f2c539ca700 -1 mon.a@0(leader).osd e26 definitely_dead 0 2023-09-30T22:29:11.951 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-30T22:29:11.952+0000 7f6b2d10a680 -1 Falling back to public interface 2023-09-30T22:29:12.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.323+0000 7f8e3f7fe700 1 -- 172.21.15.59:0/2355439998 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v27) v1 ==== 89+0+0 (secure 0 0 0) 0x7f8e50015020 con 0x7f8e580a0a30 2023-09-30T22:29:12.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.328+0000 7f8e5d023700 1 -- 172.21.15.59:0/2355439998 >> v1:172.21.15.59:6816/126772 conn(0x7f8e4402f510 legacy=0x7f8e440319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.328+0000 7f8e5d023700 1 -- 172.21.15.59:0/2355439998 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e580a0a30 msgr2=0x7f8e58122790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.328+0000 7f8e5d023700 1 --2- 172.21.15.59:0/2355439998 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e580a0a30 0x7f8e58122790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e50016000 tx=0x7f8e50004750 comp rx=0 tx=0).stop 2023-09-30T22:29:12.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.328+0000 7f8e5d023700 1 -- 172.21.15.59:0/2355439998 shutdown_connections 2023-09-30T22:29:12.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.328+0000 7f8e5d023700 1 --2- 172.21.15.59:0/2355439998 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e580a0a30 0x7f8e58122790 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.328+0000 7f8e5d023700 1 --2- 172.21.15.59:0/2355439998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e58133fa0 0x7f8e58123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.328+0000 7f8e5d023700 1 --2- 172.21.15.59:0/2355439998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a1340 0x7f8e58122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.328+0000 7f8e5d023700 1 -- 172.21.15.59:0/2355439998 >> 172.21.15.59:0/2355439998 conn(0x7f8e580a6550 msgr2=0x7f8e580a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:12.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.328+0000 7f8e5d023700 1 -- 172.21.15.59:0/2355439998 shutdown_connections 2023-09-30T22:29:12.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.328+0000 7f8e5d023700 1 -- 172.21.15.59:0/2355439998 wait complete. 2023-09-30T22:29:12.330 INFO:teuthology.orchestra.run.smithi059.stderr:marked down osd.2. 2023-09-30T22:29:12.346 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-30T22:29:12.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-30T22:29:12.349 INFO:tasks.ceph.osd.2:Started 2023-09-30T22:29:12.349 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-30T22:29:12.349 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:29:12.394 INFO:tasks.ceph.osd.3:Stopped 2023-09-30T22:29:12.394 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2023-09-30T22:29:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.534+0000 7f7496837700 1 Processor -- start 2023-09-30T22:29:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.534+0000 7f7496837700 1 -- start start 2023-09-30T22:29:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.534+0000 7f7496837700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74900a0a30 0x7f74900a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.534+0000 7f7496837700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f749009d630 0x7f74900a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.534+0000 7f7496837700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7490133930 0x7f7490133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.534+0000 7f7496837700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74900a2a70 con 0x7f749009d630 2023-09-30T22:29:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.534+0000 7f7496837700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74900a01d0 con 0x7f7490133930 2023-09-30T22:29:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.534+0000 7f7496837700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f749009e2b0 con 0x7f74900a0a30 2023-09-30T22:29:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.534+0000 7f748f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f749009d630 0x7f74900a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.534+0000 7f748ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74900a0a30 0x7f74900a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.534+0000 7f7494dd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7490133930 0x7f7490133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.534+0000 7f748ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74900a0a30 0x7f74900a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59938/0 (socket says 172.21.15.59:59938) 2023-09-30T22:29:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.534+0000 7f7494dd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7490133930 0x7f7490133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42736/0 (socket says 172.21.15.59:42736) 2023-09-30T22:29:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.534+0000 7f748ffff700 1 -- 172.21.15.59:0/817694439 learned_addr learned my addr 172.21.15.59:0/817694439 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.534+0000 7f748f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f749009d630 0x7f74900a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58718/0 (socket says 172.21.15.59:58718) 2023-09-30T22:29:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.535+0000 7f748f7fe700 1 -- 172.21.15.59:0/817694439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74900a0a30 msgr2=0x7f74900a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:12.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.535+0000 7f748f7fe700 1 --2- 172.21.15.59:0/817694439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74900a0a30 0x7f74900a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.535+0000 7f748f7fe700 1 -- 172.21.15.59:0/817694439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7490133930 msgr2=0x7f7490133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:12.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.535+0000 7f748f7fe700 1 --2- 172.21.15.59:0/817694439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7490133930 0x7f7490133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.535+0000 7f748f7fe700 1 -- 172.21.15.59:0/817694439 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749009dc50 con 0x7f749009d630 2023-09-30T22:29:12.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.535+0000 7f748ffff700 1 --2- 172.21.15.59:0/817694439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74900a0a30 0x7f74900a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:12.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.535+0000 7f7494dd4700 1 --2- 172.21.15.59:0/817694439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7490133930 0x7f7490133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:12.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.535+0000 7f748f7fe700 1 --2- 172.21.15.59:0/817694439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f749009d630 0x7f74900a1340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7484009840 tx=0x7f7484009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4311ad67eed961cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.535+0000 7f748effd700 1 -- 172.21.15.59:0/817694439 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484011830 con 0x7f749009d630 2023-09-30T22:29:12.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.535+0000 7f748effd700 1 -- 172.21.15.59:0/817694439 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7484011990 con 0x7f749009d630 2023-09-30T22:29:12.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.535+0000 7f748effd700 1 -- 172.21.15.59:0/817694439 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484011d20 con 0x7f749009d630 2023-09-30T22:29:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.536+0000 7f7496837700 1 -- 172.21.15.59:0/817694439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f749009d630 msgr2=0x7f74900a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.536+0000 7f7496837700 1 --2- 172.21.15.59:0/817694439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f749009d630 0x7f74900a1340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7484009840 tx=0x7f7484009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.536+0000 7f7496837700 1 -- 172.21.15.59:0/817694439 shutdown_connections 2023-09-30T22:29:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.536+0000 7f7496837700 1 --2- 172.21.15.59:0/817694439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7490133930 0x7f7490133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.536+0000 7f7496837700 1 --2- 172.21.15.59:0/817694439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74900a0a30 0x7f74900a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.536+0000 7f7496837700 1 --2- 172.21.15.59:0/817694439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f749009d630 0x7f74900a1340 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.536+0000 7f7496837700 1 -- 172.21.15.59:0/817694439 >> 172.21.15.59:0/817694439 conn(0x7f74900a3050 msgr2=0x7f74900a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.536+0000 7f7496837700 1 -- 172.21.15.59:0/817694439 shutdown_connections 2023-09-30T22:29:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.536+0000 7f7496837700 1 -- 172.21.15.59:0/817694439 wait complete. 2023-09-30T22:29:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.537+0000 7f7496837700 1 Processor -- start 2023-09-30T22:29:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.537+0000 7f7496837700 1 -- start start 2023-09-30T22:29:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.537+0000 7f7496837700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f749009d630 0x7f749011f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.537+0000 7f7496837700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74900a0a30 0x7f749011fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.537+0000 7f7496837700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7490133930 0x7f74901c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.537+0000 7f7496837700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74901222e0 con 0x7f7490133930 2023-09-30T22:29:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.537+0000 7f7496837700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7490122800 con 0x7f749009d630 2023-09-30T22:29:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.537+0000 7f7496837700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7490133430 con 0x7f74900a0a30 2023-09-30T22:29:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.537+0000 7f748ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f749009d630 0x7f749011f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f748ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f749009d630 0x7f749011f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42750/0 (socket says 172.21.15.59:42750) 2023-09-30T22:29:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f748f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74900a0a30 0x7f749011fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f748ffff700 1 -- 172.21.15.59:0/2838576017 learned_addr learned my addr 172.21.15.59:0/2838576017 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f7494dd4700 1 --2- 172.21.15.59:0/2838576017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7490133930 0x7f74901c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f748ffff700 1 -- 172.21.15.59:0/2838576017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74900a0a30 msgr2=0x7f749011fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f748ffff700 1 --2- 172.21.15.59:0/2838576017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74900a0a30 0x7f749011fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f748ffff700 1 -- 172.21.15.59:0/2838576017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7490133930 msgr2=0x7f74901c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f748ffff700 1 --2- 172.21.15.59:0/2838576017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7490133930 0x7f74901c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f748ffff700 1 -- 172.21.15.59:0/2838576017 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7480009550 con 0x7f749009d630 2023-09-30T22:29:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f748f7fe700 1 --2- 172.21.15.59:0/2838576017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74900a0a30 0x7f749011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f748ffff700 1 --2- 172.21.15.59:0/2838576017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f749009d630 0x7f749011f500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f748000ec10 tx=0x7f748000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f748cff9700 1 -- 172.21.15.59:0/2838576017 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748000c850 con 0x7f749009d630 2023-09-30T22:29:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f748cff9700 1 -- 172.21.15.59:0/2838576017 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748000c9b0 con 0x7f749009d630 2023-09-30T22:29:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f748cff9700 1 -- 172.21.15.59:0/2838576017 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748000cd20 con 0x7f749009d630 2023-09-30T22:29:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f7496837700 1 -- 172.21.15.59:0/2838576017 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7488009a70 con 0x7f749009d630 2023-09-30T22:29:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.538+0000 7f7496837700 1 -- 172.21.15.59:0/2838576017 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74840094a0 con 0x7f749009d630 2023-09-30T22:29:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.539+0000 7f748cff9700 1 -- 172.21.15.59:0/2838576017 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7480013470 con 0x7f749009d630 2023-09-30T22:29:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.539+0000 7f7496837700 1 -- 172.21.15.59:0/2838576017 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7490121f60 con 0x7f749009d630 2023-09-30T22:29:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.539+0000 7f748cff9700 1 -- 172.21.15.59:0/2838576017 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f7480040020 con 0x7f749009d630 2023-09-30T22:29:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.544+0000 7f748cff9700 1 -- 172.21.15.59:0/2838576017 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7490121f60 con 0x7f749009d630 2023-09-30T22:29:12.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:12.761+0000 7f7496837700 1 -- 172.21.15.59:0/2838576017 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7f7490121f60 con 0x7f749009d630 2023-09-30T22:29:12.761 INFO:tasks.ceph.mon.a.smithi059.stderr:2023-09-30T22:29:12.761+0000 7f2c539ca700 -1 mon.a@0(leader).osd e27 definitely_dead 0 2023-09-30T22:29:12.952 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-30T22:29:12.952+0000 7ff76ba25680 -1 Falling back to public interface 2023-09-30T22:29:13.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.323+0000 7f748cff9700 1 -- 172.21.15.59:0/2838576017 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v28) v1 ==== 89+0+0 (secure 0 0 0) 0x7f7490121f60 con 0x7f749009d630 2023-09-30T22:29:13.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.325+0000 7f7496837700 1 -- 172.21.15.59:0/2838576017 >> v1:172.21.15.59:6816/126772 conn(0x7f747c02f510 legacy=0x7f747c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.325+0000 7f7496837700 1 -- 172.21.15.59:0/2838576017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f749009d630 msgr2=0x7f749011f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.325+0000 7f7496837700 1 --2- 172.21.15.59:0/2838576017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f749009d630 0x7f749011f500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f748000ec10 tx=0x7f748000ef20 comp rx=0 tx=0).stop 2023-09-30T22:29:13.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.325+0000 7f7496837700 1 -- 172.21.15.59:0/2838576017 shutdown_connections 2023-09-30T22:29:13.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.325+0000 7f7496837700 1 --2- 172.21.15.59:0/2838576017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7490133930 0x7f74901c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.325+0000 7f7496837700 1 --2- 172.21.15.59:0/2838576017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f749009d630 0x7f749011f500 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.325+0000 7f7496837700 1 --2- 172.21.15.59:0/2838576017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74900a0a30 0x7f749011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.325+0000 7f7496837700 1 -- 172.21.15.59:0/2838576017 >> 172.21.15.59:0/2838576017 conn(0x7f74900a3050 msgr2=0x7f74901bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:13.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.326+0000 7f7496837700 1 -- 172.21.15.59:0/2838576017 shutdown_connections 2023-09-30T22:29:13.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.326+0000 7f7496837700 1 -- 172.21.15.59:0/2838576017 wait complete. 2023-09-30T22:29:13.327 INFO:teuthology.orchestra.run.smithi059.stderr:marked down osd.3. 2023-09-30T22:29:13.344 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-30T22:29:13.344 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-30T22:29:13.346 INFO:tasks.ceph.osd.3:Started 2023-09-30T22:29:13.346 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:29:13.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:29:13.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.488+0000 7f4456ef7700 1 Processor -- start 2023-09-30T22:29:13.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.488+0000 7f4456ef7700 1 -- start start 2023-09-30T22:29:13.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f4456ef7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009f410 0x7f4450136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f4456ef7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4450136fe0 0x7f44501393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f4456ef7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4450070940 con 0x7f445009e930 2023-09-30T22:29:13.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f4456ef7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445006fd60 con 0x7f4450136fe0 2023-09-30T22:29:13.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f4456ef7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f445006fa80 con 0x7f445009f410 2023-09-30T22:29:13.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f444ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009f410 0x7f4450136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f4454c93700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f445009e930 0x7f445009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49554/0 (socket says 172.21.15.59:49554) 2023-09-30T22:29:13.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f4454c93700 1 -- 172.21.15.59:0/83181570 learned_addr learned my addr 172.21.15.59:0/83181570 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:13.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f4455494700 1 --2- 172.21.15.59:0/83181570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4450136fe0 0x7f44501393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f444f7fe700 1 -- 172.21.15.59:0/83181570 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463921107 0 0) 0x7f4450070940 con 0x7f445009e930 2023-09-30T22:29:13.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f444ffff700 1 -- 172.21.15.59:0/83181570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4450136fe0 msgr2=0x7f44501393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:13.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f444ffff700 1 --2- 172.21.15.59:0/83181570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4450136fe0 0x7f44501393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f444ffff700 1 -- 172.21.15.59:0/83181570 >> v1:172.21.15.59:6789/0 conn(0x7f445009e930 legacy=0x7f445009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f444ffff700 1 -- 172.21.15.59:0/83181570 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445009fb60 con 0x7f445009f410 2023-09-30T22:29:13.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f4455494700 1 --2- 172.21.15.59:0/83181570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4450136fe0 0x7f44501393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:13.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f444ffff700 1 --2- 172.21.15.59:0/83181570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009f410 0x7f4450136aa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f443c009870 tx=0x7f443c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6baf0d1bb4509326 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:13.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f444f7fe700 1 -- 172.21.15.59:0/83181570 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c011830 con 0x7f445009f410 2023-09-30T22:29:13.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f444f7fe700 1 -- 172.21.15.59:0/83181570 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c011990 con 0x7f445009f410 2023-09-30T22:29:13.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.489+0000 7f444f7fe700 1 -- 172.21.15.59:0/83181570 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c011d20 con 0x7f445009f410 2023-09-30T22:29:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.490+0000 7f4456ef7700 1 -- 172.21.15.59:0/83181570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009f410 msgr2=0x7f4450136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.490+0000 7f4456ef7700 1 --2- 172.21.15.59:0/83181570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009f410 0x7f4450136aa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f443c009870 tx=0x7f443c009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.490+0000 7f4456ef7700 1 -- 172.21.15.59:0/83181570 shutdown_connections 2023-09-30T22:29:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.490+0000 7f4456ef7700 1 --2- 172.21.15.59:0/83181570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4450136fe0 0x7f44501393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.490+0000 7f4456ef7700 1 --2- 172.21.15.59:0/83181570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009f410 0x7f4450136aa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.490+0000 7f4456ef7700 1 -- 172.21.15.59:0/83181570 >> 172.21.15.59:0/83181570 conn(0x7f44500a4210 msgr2=0x7f44500a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.490+0000 7f4456ef7700 1 -- 172.21.15.59:0/83181570 shutdown_connections 2023-09-30T22:29:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.490+0000 7f4456ef7700 1 -- 172.21.15.59:0/83181570 wait complete. 2023-09-30T22:29:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.491+0000 7f4456ef7700 1 Processor -- start 2023-09-30T22:29:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.491+0000 7f4456ef7700 1 -- start start 2023-09-30T22:29:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4456ef7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445009e930 0x7f445011e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4456ef7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009f410 0x7f445011ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4456ef7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4450136fe0 0x7f445011ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4456ef7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4450133e10 con 0x7f4450136fe0 2023-09-30T22:29:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4456ef7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44501343d0 con 0x7f445009e930 2023-09-30T22:29:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4456ef7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4450122000 con 0x7f445009f410 2023-09-30T22:29:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4454c93700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445009e930 0x7f445011e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4455494700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4450136fe0 0x7f445011ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f444ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009f410 0x7f445011ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4454c93700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445009e930 0x7f445011e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42784/0 (socket says 172.21.15.59:42784) 2023-09-30T22:29:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4455494700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4450136fe0 0x7f445011ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58752/0 (socket says 172.21.15.59:58752) 2023-09-30T22:29:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4454c93700 1 -- 172.21.15.59:0/477841104 learned_addr learned my addr 172.21.15.59:0/477841104 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:13.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4454c93700 1 -- 172.21.15.59:0/477841104 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009f410 msgr2=0x7f445011ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4454c93700 1 --2- 172.21.15.59:0/477841104 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009f410 0x7f445011ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4454c93700 1 -- 172.21.15.59:0/477841104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4450136fe0 msgr2=0x7f445011ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4454c93700 1 --2- 172.21.15.59:0/477841104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4450136fe0 0x7f445011ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4454c93700 1 -- 172.21.15.59:0/477841104 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4448009a70 con 0x7f445009e930 2023-09-30T22:29:13.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4455494700 1 --2- 172.21.15.59:0/477841104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4450136fe0 0x7f445011ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:13.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.492+0000 7f4454c93700 1 --2- 172.21.15.59:0/477841104 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445009e930 0x7f445011e4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f444400c520 tx=0x7f444400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:13.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.493+0000 7f444d7fa700 1 -- 172.21.15.59:0/477841104 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444004c80 con 0x7f445009e930 2023-09-30T22:29:13.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.493+0000 7f444d7fa700 1 -- 172.21.15.59:0/477841104 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4444015070 con 0x7f445009e930 2023-09-30T22:29:13.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.493+0000 7f4456ef7700 1 -- 172.21.15.59:0/477841104 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443c0094a0 con 0x7f445009e930 2023-09-30T22:29:13.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.493+0000 7f444d7fa700 1 -- 172.21.15.59:0/477841104 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44440070d0 con 0x7f445009e930 2023-09-30T22:29:13.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.493+0000 7f4456ef7700 1 -- 172.21.15.59:0/477841104 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44500a34b0 con 0x7f445009e930 2023-09-30T22:29:13.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.494+0000 7f444d7fa700 1 -- 172.21.15.59:0/477841104 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4444007230 con 0x7f445009e930 2023-09-30T22:29:13.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.494+0000 7f444d7fa700 1 -- 172.21.15.59:0/477841104 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f4444043390 con 0x7f445009e930 2023-09-30T22:29:13.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.494+0000 7f4456ef7700 1 -- 172.21.15.59:0/477841104 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4450074ea0 con 0x7f445009e930 2023-09-30T22:29:13.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.499+0000 7f444d7fa700 1 -- 172.21.15.59:0/477841104 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4444020030 con 0x7f445009e930 2023-09-30T22:29:13.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.707+0000 7f4456ef7700 1 -- 172.21.15.59:0/477841104 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f445006b250 con 0x7f445009e930 2023-09-30T22:29:13.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.708+0000 7f444d7fa700 1 -- 172.21.15.59:0/477841104 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+11951 (secure 0 0 0) 0x7f444402a090 con 0x7f445009e930 2023-09-30T22:29:13.708 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:13.708 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:29:13.318877+0000","last_up_change":"2023-09-30T22:29:13.318877+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":20,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118795}]},"public_addr":"172.21.15.59:6804/118795","cluster_addr":"172.21.15.59:6805/118795","heartbeat_back_addr":"172.21.15.59:6807/118795","heartbeat_front_addr":"172.21.15.59:6806/118795","state":["exists"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":27,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-09-30T22:29:13.318877+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/3882222550":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/1346763106":"2023-10-01T22:28:59.561079+0000","172.21.15.59:6816/118188":"2023-10-01T22:28:59.561079+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.711+0000 7f4456ef7700 1 -- 172.21.15.59:0/477841104 >> v1:172.21.15.59:6816/126772 conn(0x7f443402f510 legacy=0x7f44340319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.711+0000 7f4456ef7700 1 -- 172.21.15.59:0/477841104 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445009e930 msgr2=0x7f445011e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.711+0000 7f4456ef7700 1 --2- 172.21.15.59:0/477841104 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445009e930 0x7f445011e4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f444400c520 tx=0x7f444400c830 comp rx=0 tx=0).stop 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.711+0000 7f4456ef7700 1 -- 172.21.15.59:0/477841104 shutdown_connections 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.711+0000 7f4456ef7700 1 --2- 172.21.15.59:0/477841104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4450136fe0 0x7f445011ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.711+0000 7f4456ef7700 1 --2- 172.21.15.59:0/477841104 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445009e930 0x7f445011e4e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.711+0000 7f4456ef7700 1 --2- 172.21.15.59:0/477841104 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009f410 0x7f445011ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.711+0000 7f4456ef7700 1 -- 172.21.15.59:0/477841104 >> 172.21.15.59:0/477841104 conn(0x7f44500a4210 msgr2=0x7f4450134890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.711+0000 7f4456ef7700 1 -- 172.21.15.59:0/477841104 shutdown_connections 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:13.711+0000 7f4456ef7700 1 -- 172.21.15.59:0/477841104 wait complete. 2023-09-30T22:29:13.951 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-30T22:29:13.952+0000 7f70eabec680 -1 Falling back to public interface 2023-09-30T22:29:14.717 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-30T22:29:14.716+0000 7f69372b2680 -1 osd.0 24 log_to_monitors true 2023-09-30T22:29:15.824 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-30T22:29:15.824+0000 7f6b2d10a680 -1 osd.1 24 log_to_monitors true 2023-09-30T22:29:16.317 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-30T22:29:16.317+0000 7f692322d700 -1 osd.0 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:29:16.730 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:29:16.776 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-30T22:29:16.776+0000 7ff76ba25680 -1 osd.2 26 log_to_monitors true 2023-09-30T22:29:16.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.907+0000 7f2526012700 1 Processor -- start 2023-09-30T22:29:16.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.907+0000 7f2526012700 1 -- start start 2023-09-30T22:29:16.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f2526012700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f252009d5c0 0x7f2520138d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f2526012700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25200a14a0 0x7f252013b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f2526012700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252009ea10 con 0x7f25200a09c0 2023-09-30T22:29:16.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f2526012700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252009e210 con 0x7f252009d5c0 2023-09-30T22:29:16.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f2526012700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25200a26f0 con 0x7f25200a14a0 2023-09-30T22:29:16.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f251ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25200a14a0 0x7f252013b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f251effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f252009d5c0 0x7f2520138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f251ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25200a14a0 0x7f252013b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55998/0 (socket says 172.21.15.59:55998) 2023-09-30T22:29:16.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f251f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f25200a09c0 0x7f25200a0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51388/0 (socket says 172.21.15.59:51388) 2023-09-30T22:29:16.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f251effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f252009d5c0 0x7f2520138d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41384/0 (socket says 172.21.15.59:41384) 2023-09-30T22:29:16.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f251ffff700 1 -- 172.21.15.59:0/106205522 learned_addr learned my addr 172.21.15.59:0/106205522 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:16.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f251ffff700 1 -- 172.21.15.59:0/106205522 >> v2:172.21.15.59:3300/0 conn(0x7f252009d5c0 msgr2=0x7f2520138d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:16.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f251ffff700 1 --2- 172.21.15.59:0/106205522 >> v2:172.21.15.59:3300/0 conn(0x7f252009d5c0 0x7f2520138d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f251ffff700 1 -- 172.21.15.59:0/106205522 >> v1:172.21.15.59:6789/0 conn(0x7f25200a09c0 legacy=0x7f25200a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:16.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f251ffff700 1 -- 172.21.15.59:0/106205522 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252009db70 con 0x7f25200a14a0 2023-09-30T22:29:16.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f251effd700 1 --2- 172.21.15.59:0/106205522 >> v2:172.21.15.59:3300/0 conn(0x7f252009d5c0 0x7f2520138d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:16.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.908+0000 7f251ffff700 1 --2- 172.21.15.59:0/106205522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25200a14a0 0x7f252013b2c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2518009e50 tx=0x7f251800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=118ddee1ac102557 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:16.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.909+0000 7f251e7fc700 1 -- 172.21.15.59:0/106205522 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251800e070 con 0x7f25200a14a0 2023-09-30T22:29:16.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.909+0000 7f251e7fc700 1 -- 172.21.15.59:0/106205522 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251800b910 con 0x7f25200a14a0 2023-09-30T22:29:16.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.909+0000 7f251e7fc700 1 -- 172.21.15.59:0/106205522 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251800bcc0 con 0x7f25200a14a0 2023-09-30T22:29:16.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.909+0000 7f2526012700 1 -- 172.21.15.59:0/106205522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25200a14a0 msgr2=0x7f252013b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:16.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.909+0000 7f2526012700 1 --2- 172.21.15.59:0/106205522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25200a14a0 0x7f252013b2c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2518009e50 tx=0x7f251800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:16.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.909+0000 7f2526012700 1 -- 172.21.15.59:0/106205522 shutdown_connections 2023-09-30T22:29:16.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.909+0000 7f2526012700 1 --2- 172.21.15.59:0/106205522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25200a14a0 0x7f252013b2c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.909+0000 7f2526012700 1 --2- 172.21.15.59:0/106205522 >> v2:172.21.15.59:3300/0 conn(0x7f252009d5c0 0x7f2520138d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.909+0000 7f2526012700 1 -- 172.21.15.59:0/106205522 >> 172.21.15.59:0/106205522 conn(0x7f25200a2fe0 msgr2=0x7f25200a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:16.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.910+0000 7f2526012700 1 -- 172.21.15.59:0/106205522 shutdown_connections 2023-09-30T22:29:16.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.910+0000 7f2526012700 1 -- 172.21.15.59:0/106205522 wait complete. 2023-09-30T22:29:16.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.911+0000 7f2526012700 1 Processor -- start 2023-09-30T22:29:16.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.911+0000 7f2526012700 1 -- start start 2023-09-30T22:29:16.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.911+0000 7f2526012700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252009d5c0 0x7f252011c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.911+0000 7f2526012700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25200a09c0 0x7f252011ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.911+0000 7f2526012700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25200a14a0 0x7f252011d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.911+0000 7f2526012700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252011eea0 con 0x7f25200a09c0 2023-09-30T22:29:16.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.911+0000 7f2526012700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252011e270 con 0x7f252009d5c0 2023-09-30T22:29:16.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.911+0000 7f2526012700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f252011e630 con 0x7f25200a14a0 2023-09-30T22:29:16.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.912+0000 7f251f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252009d5c0 0x7f252011c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.912+0000 7f251f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252009d5c0 0x7f252011c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56008/0 (socket says 172.21.15.59:56008) 2023-09-30T22:29:16.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.912+0000 7f251f7fe700 1 -- 172.21.15.59:0/3966042602 learned_addr learned my addr 172.21.15.59:0/3966042602 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:16.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.912+0000 7f251ffff700 1 --2- 172.21.15.59:0/3966042602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25200a14a0 0x7f252011d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.912+0000 7f251effd700 1 --2- 172.21.15.59:0/3966042602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25200a09c0 0x7f252011ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.912+0000 7f251ffff700 1 -- 172.21.15.59:0/3966042602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252009d5c0 msgr2=0x7f252011c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:16.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.912+0000 7f251ffff700 1 --2- 172.21.15.59:0/3966042602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252009d5c0 0x7f252011c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.912+0000 7f251ffff700 1 -- 172.21.15.59:0/3966042602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25200a09c0 msgr2=0x7f252011ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:16.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.912+0000 7f251ffff700 1 --2- 172.21.15.59:0/3966042602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25200a09c0 0x7f252011ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.912+0000 7f251ffff700 1 -- 172.21.15.59:0/3966042602 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25140094a0 con 0x7f25200a14a0 2023-09-30T22:29:16.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.912+0000 7f251f7fe700 1 --2- 172.21.15.59:0/3966042602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252009d5c0 0x7f252011c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:16.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.912+0000 7f251ffff700 1 --2- 172.21.15.59:0/3966042602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25200a14a0 0x7f252011d230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2518015000 tx=0x7f2518004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:16.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.913+0000 7f2507fff700 1 -- 172.21.15.59:0/3966042602 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518003ea0 con 0x7f25200a14a0 2023-09-30T22:29:16.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.913+0000 7f2507fff700 1 -- 172.21.15.59:0/3966042602 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25180048c0 con 0x7f25200a14a0 2023-09-30T22:29:16.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.913+0000 7f2507fff700 1 -- 172.21.15.59:0/3966042602 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251801c660 con 0x7f25200a14a0 2023-09-30T22:29:16.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.913+0000 7f2526012700 1 -- 172.21.15.59:0/3966042602 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2518009b30 con 0x7f25200a14a0 2023-09-30T22:29:16.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.913+0000 7f2526012700 1 -- 172.21.15.59:0/3966042602 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252009cec0 con 0x7f25200a14a0 2023-09-30T22:29:16.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.914+0000 7f2526012700 1 -- 172.21.15.59:0/3966042602 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252011e860 con 0x7f25200a14a0 2023-09-30T22:29:16.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.915+0000 7f2507fff700 1 -- 172.21.15.59:0/3966042602 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f251801c7c0 con 0x7f25200a14a0 2023-09-30T22:29:16.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.915+0000 7f2507fff700 1 -- 172.21.15.59:0/3966042602 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f2518041970 con 0x7f25200a14a0 2023-09-30T22:29:16.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:16.920+0000 7f2507fff700 1 -- 172.21.15.59:0/3966042602 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2518023720 con 0x7f25200a14a0 2023-09-30T22:29:17.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:17.191+0000 7f2526012700 1 -- 172.21.15.59:0/3966042602 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f252011e860 con 0x7f25200a14a0 2023-09-30T22:29:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:17.192+0000 7f2507fff700 1 -- 172.21.15.59:0/3966042602 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12739 (secure 0 0 0) 0x7f252011e860 con 0x7f25200a14a0 2023-09-30T22:29:17.193 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:17.193 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":30,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:29:16.340889+0000","last_up_change":"2023-09-30T22:29:16.340889+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.25,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 4 has some PGs where all OSDs are with primary_affinity 0 (at least pg 4.0), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":20,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":129489}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":129489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":129489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":129489}]},"public_addr":"172.21.15.59:6800/129489","cluster_addr":"172.21.15.59:6801/129489","heartbeat_back_addr":"172.21.15.59:6803/129489","heartbeat_front_addr":"172.21.15.59:6802/129489","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118786}]},"public_addr":"172.21.15.59:6800/118786","cluster_addr":"172.21.15.59:6801/118786","heartbeat_back_addr":"172.21.15.59:6803/118786","heartbeat_front_addr":"172.21.15.59:6802/118786","state":["exists"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118803}]},"public_addr":"172.21.15.59:6812/118803","cluster_addr":"172.21.15.59:6813/118803","heartbeat_back_addr":"172.21.15.59:6815/118803","heartbeat_front_addr":"172.21.15.59:6814/118803","state":["exists"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":27,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-09-30T22:29:13.318877+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/3882222550":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/1346763106":"2023-10-01T22:28:59.561079+0000","172.21.15.59:6816/118188":"2023-10-01T22:28:59.561079+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:29:17.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:17.195+0000 7f2526012700 1 -- 172.21.15.59:0/3966042602 >> v1:172.21.15.59:6816/126772 conn(0x7f250c02f510 legacy=0x7f250c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:17.195+0000 7f2526012700 1 -- 172.21.15.59:0/3966042602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25200a14a0 msgr2=0x7f252011d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:17.195+0000 7f2526012700 1 --2- 172.21.15.59:0/3966042602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25200a14a0 0x7f252011d230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2518015000 tx=0x7f2518004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:17.195+0000 7f2526012700 1 -- 172.21.15.59:0/3966042602 shutdown_connections 2023-09-30T22:29:17.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:17.195+0000 7f2526012700 1 --2- 172.21.15.59:0/3966042602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25200a14a0 0x7f252011d230 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:17.195+0000 7f2526012700 1 --2- 172.21.15.59:0/3966042602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252009d5c0 0x7f252011c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:17.195+0000 7f2526012700 1 --2- 172.21.15.59:0/3966042602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25200a09c0 0x7f252011ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:17.195+0000 7f2526012700 1 -- 172.21.15.59:0/3966042602 >> 172.21.15.59:0/3966042602 conn(0x7f25200a2fe0 msgr2=0x7f252009a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:17.195+0000 7f2526012700 1 -- 172.21.15.59:0/3966042602 shutdown_connections 2023-09-30T22:29:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:17.195+0000 7f2526012700 1 -- 172.21.15.59:0/3966042602 wait complete. 2023-09-30T22:29:17.375 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-30T22:29:17.376+0000 7f6b19085700 -1 osd.1 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:29:17.821 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-30T22:29:17.821+0000 7f70eabec680 -1 osd.3 27 log_to_monitors true 2023-09-30T22:29:18.314 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-30T22:29:18.314+0000 7ff7579a0700 -1 osd.2 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:29:19.755 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-30T22:29:19.755+0000 7f70d6b67700 -1 osd.3 27 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:29:20.213 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:29:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.358+0000 7fece0128700 1 Processor -- start 2023-09-30T22:29:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.358+0000 7fece0128700 1 -- start start 2023-09-30T22:29:20.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.358+0000 7fece0128700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecd806c0e0 0x7fecd809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:20.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.358+0000 7fece0128700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecd81380f0 0x7fecd813fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:20.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.358+0000 7fece0128700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd8134980 con 0x7fecd8134ec0 2023-09-30T22:29:20.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.358+0000 7fece0128700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd806c4b0 con 0x7fecd81380f0 2023-09-30T22:29:20.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.358+0000 7fece0128700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80a09c0 con 0x7fecd806c0e0 2023-09-30T22:29:20.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.359+0000 7fecde6c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecd81380f0 0x7fecd813fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:20.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.359+0000 7fecddec4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecd806c0e0 0x7fecd809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:20.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.359+0000 7fecdd6c3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fecd8134ec0 0x7fecd81379e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51406/0 (socket says 172.21.15.59:51406) 2023-09-30T22:29:20.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.359+0000 7fecdd6c3700 1 -- 172.21.15.59:0/533846704 learned_addr learned my addr 172.21.15.59:0/533846704 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:20.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.359+0000 7fecde6c5700 1 -- 172.21.15.59:0/533846704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecd806c0e0 msgr2=0x7fecd809ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:20.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.359+0000 7fecdcec2700 1 -- 172.21.15.59:0/533846704 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254552726 0 0) 0x7fecd8134980 con 0x7fecd8134ec0 2023-09-30T22:29:20.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.359+0000 7fecde6c5700 1 --2- 172.21.15.59:0/533846704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecd806c0e0 0x7fecd809ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.359+0000 7fecde6c5700 1 -- 172.21.15.59:0/533846704 >> v1:172.21.15.59:6789/0 conn(0x7fecd8134ec0 legacy=0x7fecd81379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.359+0000 7fecde6c5700 1 -- 172.21.15.59:0/533846704 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd80a0600 con 0x7fecd81380f0 2023-09-30T22:29:20.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.359+0000 7fecddec4700 1 --2- 172.21.15.59:0/533846704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecd806c0e0 0x7fecd809ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.359+0000 7fecde6c5700 1 --2- 172.21.15.59:0/533846704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecd81380f0 0x7fecd813fd20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009dc0 tx=0x7fecd000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fb9dc6e4787ac3b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.359+0000 7fecdcec2700 1 -- 172.21.15.59:0/533846704 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd000e070 con 0x7fecd81380f0 2023-09-30T22:29:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.359+0000 7fecdcec2700 1 -- 172.21.15.59:0/533846704 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd000bb20 con 0x7fecd81380f0 2023-09-30T22:29:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.359+0000 7fecdcec2700 1 -- 172.21.15.59:0/533846704 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0012430 con 0x7fecd81380f0 2023-09-30T22:29:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.360+0000 7fece0128700 1 -- 172.21.15.59:0/533846704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecd81380f0 msgr2=0x7fecd813fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.360+0000 7fece0128700 1 --2- 172.21.15.59:0/533846704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecd81380f0 0x7fecd813fd20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009dc0 tx=0x7fecd000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.360+0000 7fece0128700 1 -- 172.21.15.59:0/533846704 shutdown_connections 2023-09-30T22:29:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.360+0000 7fece0128700 1 --2- 172.21.15.59:0/533846704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecd806c0e0 0x7fecd809ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.360+0000 7fece0128700 1 --2- 172.21.15.59:0/533846704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecd81380f0 0x7fecd813fd20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.360+0000 7fece0128700 1 -- 172.21.15.59:0/533846704 >> 172.21.15.59:0/533846704 conn(0x7fecd80a4210 msgr2=0x7fecd80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.360+0000 7fece0128700 1 -- 172.21.15.59:0/533846704 shutdown_connections 2023-09-30T22:29:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.360+0000 7fece0128700 1 -- 172.21.15.59:0/533846704 wait complete. 2023-09-30T22:29:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.361+0000 7fece0128700 1 Processor -- start 2023-09-30T22:29:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.361+0000 7fece0128700 1 -- start start 2023-09-30T22:29:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.361+0000 7fece0128700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecd806c0e0 0x7fecd811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fece0128700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8134ec0 0x7fecd811abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fece0128700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecd81380f0 0x7fecd811b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fece0128700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80a0480 con 0x7fecd8134ec0 2023-09-30T22:29:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fece0128700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd811c750 con 0x7fecd81380f0 2023-09-30T22:29:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fece0128700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecd811df40 con 0x7fecd806c0e0 2023-09-30T22:29:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecdd6c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8134ec0 0x7fecd811abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecddec4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecd806c0e0 0x7fecd811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:20.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecde6c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecd81380f0 0x7fecd811b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:20.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecdd6c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8134ec0 0x7fecd811abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41394/0 (socket says 172.21.15.59:41394) 2023-09-30T22:29:20.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecdd6c3700 1 -- 172.21.15.59:0/49545063 learned_addr learned my addr 172.21.15.59:0/49545063 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:20.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecddec4700 1 -- 172.21.15.59:0/49545063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecd81380f0 msgr2=0x7fecd811b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecddec4700 1 --2- 172.21.15.59:0/49545063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecd81380f0 0x7fecd811b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecddec4700 1 -- 172.21.15.59:0/49545063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8134ec0 msgr2=0x7fecd811abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecddec4700 1 --2- 172.21.15.59:0/49545063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8134ec0 0x7fecd811abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecddec4700 1 -- 172.21.15.59:0/49545063 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40094a0 con 0x7fecd806c0e0 2023-09-30T22:29:20.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecde6c5700 1 --2- 172.21.15.59:0/49545063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecd81380f0 0x7fecd811b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:20.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecdd6c3700 1 --2- 172.21.15.59:0/49545063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8134ec0 0x7fecd811abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:20.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecddec4700 1 --2- 172.21.15.59:0/49545063 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecd806c0e0 0x7fecd811a680 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fecd400e930 tx=0x7fecd400ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:20.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecce7fc700 1 -- 172.21.15.59:0/49545063 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4013680 con 0x7fecd806c0e0 2023-09-30T22:29:20.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecce7fc700 1 -- 172.21.15.59:0/49545063 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd40137e0 con 0x7fecd806c0e0 2023-09-30T22:29:20.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fece0128700 1 -- 172.21.15.59:0/49545063 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd0009a70 con 0x7fecd806c0e0 2023-09-30T22:29:20.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.362+0000 7fecce7fc700 1 -- 172.21.15.59:0/49545063 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4013b90 con 0x7fecd806c0e0 2023-09-30T22:29:20.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.363+0000 7fece0128700 1 -- 172.21.15.59:0/49545063 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd811db80 con 0x7fecd806c0e0 2023-09-30T22:29:20.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.363+0000 7fecce7fc700 1 -- 172.21.15.59:0/49545063 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fecd4013cf0 con 0x7fecd806c0e0 2023-09-30T22:29:20.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.364+0000 7fecce7fc700 1 -- 172.21.15.59:0/49545063 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fecd403fac0 con 0x7fecd806c0e0 2023-09-30T22:29:20.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.364+0000 7fece0128700 1 -- 172.21.15.59:0/49545063 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd811dda0 con 0x7fecd806c0e0 2023-09-30T22:29:20.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.369+0000 7fecce7fc700 1 -- 172.21.15.59:0/49545063 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecd811dda0 con 0x7fecd806c0e0 2023-09-30T22:29:20.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.579+0000 7fece0128700 1 -- 172.21.15.59:0/49545063 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecd811dda0 con 0x7fecd806c0e0 2023-09-30T22:29:20.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.580+0000 7fecce7fc700 1 -- 172.21.15.59:0/49545063 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+12925 (secure 0 0 0) 0x7fecd811dda0 con 0x7fecd806c0e0 2023-09-30T22:29:20.580 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:20.580 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":33,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:29:19.384388+0000","last_up_change":"2023-09-30T22:29:18.383039+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":9,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":0.75,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":0.75,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5099999904632568,"score_stable":1.5099999904632568,"optimal_score":0.75,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":129489}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":129489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":129489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":129489}]},"public_addr":"172.21.15.59:6800/129489","cluster_addr":"172.21.15.59:6801/129489","heartbeat_back_addr":"172.21.15.59:6803/129489","heartbeat_front_addr":"172.21.15.59:6802/129489","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":129609}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":129609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":129609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":129609}]},"public_addr":"172.21.15.59:6804/129609","cluster_addr":"172.21.15.59:6805/129609","heartbeat_back_addr":"172.21.15.59:6807/129609","heartbeat_front_addr":"172.21.15.59:6806/129609","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":129719}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":129719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":129719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":129719}]},"public_addr":"172.21.15.59:6808/129719","cluster_addr":"172.21.15.59:6809/129719","heartbeat_back_addr":"172.21.15.59:6811/129719","heartbeat_front_addr":"172.21.15.59:6810/129719","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":27,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118802}]},"public_addr":"172.21.15.59:6808/118802","cluster_addr":"172.21.15.59:6809/118802","heartbeat_back_addr":"172.21.15.59:6811/118802","heartbeat_front_addr":"172.21.15.59:6810/118802","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-09-30T22:29:13.318877+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/3882222550":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/1346763106":"2023-10-01T22:28:59.561079+0000","172.21.15.59:6816/118188":"2023-10-01T22:28:59.561079+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:29:20.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.582+0000 7fece0128700 1 -- 172.21.15.59:0/49545063 >> v1:172.21.15.59:6816/126772 conn(0x7fecbc02f510 legacy=0x7fecbc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.582+0000 7fece0128700 1 -- 172.21.15.59:0/49545063 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecd806c0e0 msgr2=0x7fecd811a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.582+0000 7fece0128700 1 --2- 172.21.15.59:0/49545063 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecd806c0e0 0x7fecd811a680 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fecd400e930 tx=0x7fecd400ec40 comp rx=0 tx=0).stop 2023-09-30T22:29:20.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.582+0000 7fece0128700 1 -- 172.21.15.59:0/49545063 shutdown_connections 2023-09-30T22:29:20.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.582+0000 7fece0128700 1 --2- 172.21.15.59:0/49545063 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecd806c0e0 0x7fecd811a680 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.582+0000 7fece0128700 1 --2- 172.21.15.59:0/49545063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecd81380f0 0x7fecd811b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.582+0000 7fece0128700 1 --2- 172.21.15.59:0/49545063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8134ec0 0x7fecd811abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.582+0000 7fece0128700 1 -- 172.21.15.59:0/49545063 >> 172.21.15.59:0/49545063 conn(0x7fecd80a4210 msgr2=0x7fecd8099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:20.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.582+0000 7fece0128700 1 -- 172.21.15.59:0/49545063 shutdown_connections 2023-09-30T22:29:20.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:20.582+0000 7fece0128700 1 -- 172.21.15.59:0/49545063 wait complete. 2023-09-30T22:29:23.596 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:29:23.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.742+0000 7f57d0d29700 1 Processor -- start 2023-09-30T22:29:23.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.742+0000 7f57d0d29700 1 -- start start 2023-09-30T22:29:23.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57d0d29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57cc09f410 0x7f57cc136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:23.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57d0d29700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57cc136fe0 0x7f57cc1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:23.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57d0d29700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57cc070940 con 0x7f57cc09e930 2023-09-30T22:29:23.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57d0d29700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc06fd60 con 0x7f57cc09f410 2023-09-30T22:29:23.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57d0d29700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc06fa80 con 0x7f57cc136fe0 2023-09-30T22:29:23.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57c9d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57cc09f410 0x7f57cc136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:23.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57cad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57cc136fe0 0x7f57cc1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:23.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57ca59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f57cc09e930 0x7f57cc09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51420/0 (socket says 172.21.15.59:51420) 2023-09-30T22:29:23.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57c9d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57cc09f410 0x7f57cc136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56032/0 (socket says 172.21.15.59:56032) 2023-09-30T22:29:23.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57cad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57cc136fe0 0x7f57cc1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39610/0 (socket says 172.21.15.59:39610) 2023-09-30T22:29:23.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57ca59c700 1 -- 172.21.15.59:0/2484967282 learned_addr learned my addr 172.21.15.59:0/2484967282 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:23.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57c9d9b700 1 -- 172.21.15.59:0/2484967282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57cc136fe0 msgr2=0x7f57cc1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:23.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57c9d9b700 1 --2- 172.21.15.59:0/2484967282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57cc136fe0 0x7f57cc1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57c9d9b700 1 -- 172.21.15.59:0/2484967282 >> v1:172.21.15.59:6789/0 conn(0x7f57cc09e930 legacy=0x7f57cc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:23.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57c959a700 1 -- 172.21.15.59:0/2484967282 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163715327 0 0) 0x7f57cc070940 con 0x7f57cc09e930 2023-09-30T22:29:23.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57c9d9b700 1 -- 172.21.15.59:0/2484967282 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc09fb60 con 0x7f57cc09f410 2023-09-30T22:29:23.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57cad9d700 1 --2- 172.21.15.59:0/2484967282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57cc136fe0 0x7f57cc1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:23.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.743+0000 7f57c9d9b700 1 --2- 172.21.15.59:0/2484967282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57cc09f410 0x7f57cc136aa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009870 tx=0x7f57b4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b298330f8245974 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:23.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.744+0000 7f57c959a700 1 -- 172.21.15.59:0/2484967282 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b4011830 con 0x7f57cc09f410 2023-09-30T22:29:23.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.744+0000 7f57c959a700 1 -- 172.21.15.59:0/2484967282 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b4011990 con 0x7f57cc09f410 2023-09-30T22:29:23.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.744+0000 7f57c959a700 1 -- 172.21.15.59:0/2484967282 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b4011d20 con 0x7f57cc09f410 2023-09-30T22:29:23.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.744+0000 7f57d0d29700 1 -- 172.21.15.59:0/2484967282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57cc09f410 msgr2=0x7f57cc136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:23.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.744+0000 7f57d0d29700 1 --2- 172.21.15.59:0/2484967282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57cc09f410 0x7f57cc136aa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009870 tx=0x7f57b4009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:23.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.744+0000 7f57d0d29700 1 -- 172.21.15.59:0/2484967282 shutdown_connections 2023-09-30T22:29:23.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.744+0000 7f57d0d29700 1 --2- 172.21.15.59:0/2484967282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57cc136fe0 0x7f57cc1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.744+0000 7f57d0d29700 1 --2- 172.21.15.59:0/2484967282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57cc09f410 0x7f57cc136aa0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.744+0000 7f57d0d29700 1 -- 172.21.15.59:0/2484967282 >> 172.21.15.59:0/2484967282 conn(0x7f57cc0a4210 msgr2=0x7f57cc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:23.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.744+0000 7f57d0d29700 1 -- 172.21.15.59:0/2484967282 shutdown_connections 2023-09-30T22:29:23.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.744+0000 7f57d0d29700 1 -- 172.21.15.59:0/2484967282 wait complete. 2023-09-30T22:29:23.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.745+0000 7f57d0d29700 1 Processor -- start 2023-09-30T22:29:23.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.746+0000 7f57d0d29700 1 -- start start 2023-09-30T22:29:23.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.746+0000 7f57d0d29700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57cc09e930 0x7f57cc06c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:23.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.746+0000 7f57d0d29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57cc09f410 0x7f57cc06c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:23.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.746+0000 7f57d0d29700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57cc136fe0 0x7f57cc1c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:23.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.746+0000 7f57d0d29700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc121160 con 0x7f57cc09e930 2023-09-30T22:29:23.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.746+0000 7f57d0d29700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc06d5c0 con 0x7f57cc09f410 2023-09-30T22:29:23.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.746+0000 7f57d0d29700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc06cc40 con 0x7f57cc136fe0 2023-09-30T22:29:23.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.746+0000 7f57ca59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57cc09e930 0x7f57cc06c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:23.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.746+0000 7f57cad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57cc136fe0 0x7f57cc1c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:23.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.746+0000 7f57c9d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57cc09f410 0x7f57cc06c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:23.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.746+0000 7f57ca59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57cc09e930 0x7f57cc06c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41396/0 (socket says 172.21.15.59:41396) 2023-09-30T22:29:23.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.746+0000 7f57ca59c700 1 -- 172.21.15.59:0/1010366878 learned_addr learned my addr 172.21.15.59:0/1010366878 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:23.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.747+0000 7f57c9d9b700 1 -- 172.21.15.59:0/1010366878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57cc136fe0 msgr2=0x7f57cc1c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:23.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.747+0000 7f57c9d9b700 1 --2- 172.21.15.59:0/1010366878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57cc136fe0 0x7f57cc1c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.747+0000 7f57c9d9b700 1 -- 172.21.15.59:0/1010366878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57cc09e930 msgr2=0x7f57cc06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.747+0000 7f57c9d9b700 1 --2- 172.21.15.59:0/1010366878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57cc09e930 0x7f57cc06c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.747+0000 7f57c9d9b700 1 -- 172.21.15.59:0/1010366878 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4009a70 con 0x7f57cc09f410 2023-09-30T22:29:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.747+0000 7f57cad9d700 1 --2- 172.21.15.59:0/1010366878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57cc136fe0 0x7f57cc1c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.747+0000 7f57c9d9b700 1 --2- 172.21.15.59:0/1010366878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57cc09f410 0x7f57cc06c700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f57b4016000 tx=0x7f57b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.747+0000 7f57c2ffd700 1 -- 172.21.15.59:0/1010366878 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b4004510 con 0x7f57cc09f410 2023-09-30T22:29:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.747+0000 7f57c2ffd700 1 -- 172.21.15.59:0/1010366878 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b401f070 con 0x7f57cc09f410 2023-09-30T22:29:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.747+0000 7f57d0d29700 1 -- 172.21.15.59:0/1010366878 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b40094a0 con 0x7f57cc09f410 2023-09-30T22:29:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.747+0000 7f57c2ffd700 1 -- 172.21.15.59:0/1010366878 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b40038c0 con 0x7f57cc09f410 2023-09-30T22:29:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.747+0000 7f57d0d29700 1 -- 172.21.15.59:0/1010366878 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57cc121590 con 0x7f57cc09f410 2023-09-30T22:29:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.748+0000 7f57c2ffd700 1 -- 172.21.15.59:0/1010366878 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f57b4003a20 con 0x7f57cc09f410 2023-09-30T22:29:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.748+0000 7f57d0d29700 1 -- 172.21.15.59:0/1010366878 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57cc09dfd0 con 0x7f57cc09f410 2023-09-30T22:29:23.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.748+0000 7f57c2ffd700 1 -- 172.21.15.59:0/1010366878 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f57b4021070 con 0x7f57cc09f410 2023-09-30T22:29:23.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.753+0000 7f57c2ffd700 1 -- 172.21.15.59:0/1010366878 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57b4010380 con 0x7f57cc09f410 2023-09-30T22:29:23.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.957+0000 7f57d0d29700 1 -- 172.21.15.59:0/1010366878 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57cc0a3d20 con 0x7f57cc09f410 2023-09-30T22:29:23.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.959+0000 7f57c2ffd700 1 -- 172.21.15.59:0/1010366878 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+12957 (secure 0 0 0) 0x7f57b4015070 con 0x7f57cc09f410 2023-09-30T22:29:23.959 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:23.959 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":35,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:29:21.759299+0000","last_up_change":"2023-09-30T22:29:20.757654+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":9,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":34,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":129489}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":129489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":129489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":129489}]},"public_addr":"172.21.15.59:6800/129489","cluster_addr":"172.21.15.59:6801/129489","heartbeat_back_addr":"172.21.15.59:6803/129489","heartbeat_front_addr":"172.21.15.59:6802/129489","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":32,"up_thru":34,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":129609}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":129609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":129609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":129609}]},"public_addr":"172.21.15.59:6804/129609","cluster_addr":"172.21.15.59:6805/129609","heartbeat_back_addr":"172.21.15.59:6807/129609","heartbeat_front_addr":"172.21.15.59:6806/129609","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":34,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":129719}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":129719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":129719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":129719}]},"public_addr":"172.21.15.59:6808/129719","cluster_addr":"172.21.15.59:6809/129719","heartbeat_back_addr":"172.21.15.59:6811/129719","heartbeat_front_addr":"172.21.15.59:6810/129719","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":34,"up_thru":34,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":130037}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":130037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":130037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":130037}]},"public_addr":"172.21.15.59:6812/130037","cluster_addr":"172.21.15.59:6813/130037","heartbeat_back_addr":"172.21.15.59:6815/130037","heartbeat_front_addr":"172.21.15.59:6814/130037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-09-30T22:29:13.318877+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/3882222550":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/1346763106":"2023-10-01T22:28:59.561079+0000","172.21.15.59:6816/118188":"2023-10-01T22:28:59.561079+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:29:23.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.961+0000 7f57d0d29700 1 -- 172.21.15.59:0/1010366878 >> v1:172.21.15.59:6816/126772 conn(0x7f57ac02f510 legacy=0x7f57ac0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:23.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.961+0000 7f57d0d29700 1 -- 172.21.15.59:0/1010366878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57cc09f410 msgr2=0x7f57cc06c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:23.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.961+0000 7f57d0d29700 1 --2- 172.21.15.59:0/1010366878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57cc09f410 0x7f57cc06c700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f57b4016000 tx=0x7f57b4004750 comp rx=0 tx=0).stop 2023-09-30T22:29:23.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.961+0000 7f57d0d29700 1 -- 172.21.15.59:0/1010366878 shutdown_connections 2023-09-30T22:29:23.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.961+0000 7f57d0d29700 1 --2- 172.21.15.59:0/1010366878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57cc136fe0 0x7f57cc1c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.961+0000 7f57d0d29700 1 --2- 172.21.15.59:0/1010366878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57cc09e930 0x7f57cc06c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.961+0000 7f57d0d29700 1 --2- 172.21.15.59:0/1010366878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57cc09f410 0x7f57cc06c700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.961+0000 7f57d0d29700 1 -- 172.21.15.59:0/1010366878 >> 172.21.15.59:0/1010366878 conn(0x7f57cc0a4210 msgr2=0x7f57cc135c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:23.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.961+0000 7f57d0d29700 1 -- 172.21.15.59:0/1010366878 shutdown_connections 2023-09-30T22:29:23.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:23.961+0000 7f57d0d29700 1 -- 172.21.15.59:0/1010366878 wait complete. 2023-09-30T22:29:23.974 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:29:23.975 INFO:teuthology.run_tasks:Running task ceph.stop... 2023-09-30T22:29:23.985 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:29:23.985 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:29:23.997 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:29:28.713 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2023-09-30T22:29:28.714 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-09-30T22:29:28.724 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2023-09-30T22:29:28.724 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:29:28.724 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:29:28.727 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:29:28.728 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:29:28.728 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:29:28.822 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2023-09-30T22:29:28.838 INFO:tasks.ceph.mon.a.smithi059.stderr:2023-09-30T22:29:28.838+0000 7f2c539ca700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T22:29:28.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.883+0000 7fe85c262700 1 Processor -- start 2023-09-30T22:29:28.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.883+0000 7fe85c262700 1 -- start start 2023-09-30T22:29:28.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.884+0000 7fe85c262700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8540a09c0 0x7fe8540a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.884+0000 7fe85c262700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe85409d5c0 0x7fe8540a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.884+0000 7fe85c262700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8540a1810 con 0x7fe854133920 2023-09-30T22:29:28.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.884+0000 7fe85c262700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85409ea10 con 0x7fe8540a09c0 2023-09-30T22:29:28.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.884+0000 7fe85c262700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe85409e210 con 0x7fe85409d5c0 2023-09-30T22:29:28.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.884+0000 7fe859ffe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8540a09c0 0x7fe8540a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.884+0000 7fe8597fd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe85409d5c0 0x7fe8540a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.884+0000 7fe8597fd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe85409d5c0 0x7fe8540a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42478/0 (socket says 172.21.15.59:42478) 2023-09-30T22:29:28.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.884+0000 7fe859ffe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8540a09c0 0x7fe8540a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52364/0 (socket says 172.21.15.59:52364) 2023-09-30T22:29:28.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.884+0000 7fe8597fd700 1 -- 172.21.15.59:0/399765444 learned_addr learned my addr 172.21.15.59:0/399765444 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.884+0000 7fe85a7ff700 1 --1- 172.21.15.59:0/399765444 >> v1:172.21.15.59:6789/0 conn(0x7fe854133920 0x7fe854133d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34332/0 (socket says 172.21.15.59:34332) 2023-09-30T22:29:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.884+0000 7fe8597fd700 1 -- 172.21.15.59:0/399765444 >> v2:172.21.15.59:3300/0 conn(0x7fe8540a09c0 msgr2=0x7fe8540a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.884+0000 7fe8597fd700 1 --2- 172.21.15.59:0/399765444 >> v2:172.21.15.59:3300/0 conn(0x7fe8540a09c0 0x7fe8540a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.884+0000 7fe8597fd700 1 -- 172.21.15.59:0/399765444 >> v1:172.21.15.59:6789/0 conn(0x7fe854133920 legacy=0x7fe854133d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.885+0000 7fe8597fd700 1 -- 172.21.15.59:0/399765444 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8540a26f0 con 0x7fe85409d5c0 2023-09-30T22:29:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.885+0000 7fe859ffe700 1 --2- 172.21.15.59:0/399765444 >> v2:172.21.15.59:3300/0 conn(0x7fe8540a09c0 0x7fe8540a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.885+0000 7fe8597fd700 1 --2- 172.21.15.59:0/399765444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe85409d5c0 0x7fe8540a12d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8480098f0 tx=0x7fe848009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b71fdc4e3cfd9cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.885+0000 7fe858ffc700 1 -- 172.21.15.59:0/399765444 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848011830 con 0x7fe85409d5c0 2023-09-30T22:29:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.885+0000 7fe858ffc700 1 -- 172.21.15.59:0/399765444 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe848011990 con 0x7fe85409d5c0 2023-09-30T22:29:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.885+0000 7fe858ffc700 1 -- 172.21.15.59:0/399765444 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848011d20 con 0x7fe85409d5c0 2023-09-30T22:29:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.886+0000 7fe85c262700 1 -- 172.21.15.59:0/399765444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe85409d5c0 msgr2=0x7fe8540a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.886+0000 7fe85c262700 1 --2- 172.21.15.59:0/399765444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe85409d5c0 0x7fe8540a12d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8480098f0 tx=0x7fe848009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:28.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.886+0000 7fe85c262700 1 -- 172.21.15.59:0/399765444 shutdown_connections 2023-09-30T22:29:28.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.886+0000 7fe85c262700 1 --2- 172.21.15.59:0/399765444 >> v2:172.21.15.59:3300/0 conn(0x7fe8540a09c0 0x7fe8540a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.886+0000 7fe85c262700 1 --2- 172.21.15.59:0/399765444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe85409d5c0 0x7fe8540a12d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.886+0000 7fe85c262700 1 -- 172.21.15.59:0/399765444 >> 172.21.15.59:0/399765444 conn(0x7fe8540a2fe0 msgr2=0x7fe8540a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:28.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.886+0000 7fe85c262700 1 -- 172.21.15.59:0/399765444 shutdown_connections 2023-09-30T22:29:28.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.886+0000 7fe85c262700 1 -- 172.21.15.59:0/399765444 wait complete. 2023-09-30T22:29:28.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.887+0000 7fe85c262700 1 Processor -- start 2023-09-30T22:29:28.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.887+0000 7fe85c262700 1 -- start start 2023-09-30T22:29:28.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.887+0000 7fe85c262700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe85409d5c0 0x7fe854121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.887+0000 7fe85c262700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8540a09c0 0x7fe8541216c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.887+0000 7fe85c262700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe854133920 0x7fe854121c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.887+0000 7fe85c262700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe854124a50 con 0x7fe85409d5c0 2023-09-30T22:29:28.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.887+0000 7fe85c262700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8541246b0 con 0x7fe8540a09c0 2023-09-30T22:29:28.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.887+0000 7fe85c262700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8541225e0 con 0x7fe854133920 2023-09-30T22:29:28.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.887+0000 7fe859ffe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe85409d5c0 0x7fe854121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.887+0000 7fe859ffe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe85409d5c0 0x7fe854121180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52372/0 (socket says 172.21.15.59:52372) 2023-09-30T22:29:28.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.887+0000 7fe859ffe700 1 -- 172.21.15.59:0/2825256574 learned_addr learned my addr 172.21.15.59:0/2825256574 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:28.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.887+0000 7fe8597fd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8540a09c0 0x7fe8541216c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.887+0000 7fe85a7ff700 1 --2- 172.21.15.59:0/2825256574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe854133920 0x7fe854121c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.888+0000 7fe859ffe700 1 -- 172.21.15.59:0/2825256574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe854133920 msgr2=0x7fe854121c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.888+0000 7fe859ffe700 1 --2- 172.21.15.59:0/2825256574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe854133920 0x7fe854121c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.888+0000 7fe859ffe700 1 -- 172.21.15.59:0/2825256574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8540a09c0 msgr2=0x7fe8541216c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.888+0000 7fe859ffe700 1 --2- 172.21.15.59:0/2825256574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8540a09c0 0x7fe8541216c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.888+0000 7fe859ffe700 1 -- 172.21.15.59:0/2825256574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8500094a0 con 0x7fe85409d5c0 2023-09-30T22:29:28.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.888+0000 7fe8597fd700 1 --2- 172.21.15.59:0/2825256574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8540a09c0 0x7fe8541216c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:28.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.888+0000 7fe85a7ff700 1 --2- 172.21.15.59:0/2825256574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe854133920 0x7fe854121c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:28.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.888+0000 7fe859ffe700 1 --2- 172.21.15.59:0/2825256574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe85409d5c0 0x7fe854121180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe85000ec10 tx=0x7fe85000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:28.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.888+0000 7fe8467fc700 1 -- 172.21.15.59:0/2825256574 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85000c850 con 0x7fe85409d5c0 2023-09-30T22:29:28.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.888+0000 7fe8467fc700 1 -- 172.21.15.59:0/2825256574 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85000c9b0 con 0x7fe85409d5c0 2023-09-30T22:29:28.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.888+0000 7fe85c262700 1 -- 172.21.15.59:0/2825256574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe848009550 con 0x7fe85409d5c0 2023-09-30T22:29:28.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.888+0000 7fe8467fc700 1 -- 172.21.15.59:0/2825256574 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85000cd20 con 0x7fe85409d5c0 2023-09-30T22:29:28.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.888+0000 7fe85c262700 1 -- 172.21.15.59:0/2825256574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85409cec0 con 0x7fe85409d5c0 2023-09-30T22:29:28.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.889+0000 7fe85c262700 1 -- 172.21.15.59:0/2825256574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85411df50 con 0x7fe85409d5c0 2023-09-30T22:29:28.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.890+0000 7fe8467fc700 1 -- 172.21.15.59:0/2825256574 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe850013470 con 0x7fe85409d5c0 2023-09-30T22:29:28.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.890+0000 7fe8467fc700 1 -- 172.21.15.59:0/2825256574 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe850040480 con 0x7fe85409d5c0 2023-09-30T22:29:28.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:28.894+0000 7fe8467fc700 1 -- 172.21.15.59:0/2825256574 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe850013720 con 0x7fe85409d5c0 2023-09-30T22:29:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.098+0000 7fe85c262700 1 -- 172.21.15.59:0/2825256574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8540747f0 con 0x7fe85409d5c0 2023-09-30T22:29:29.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.099+0000 7fe8467fc700 1 -- 172.21.15.59:0/2825256574 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13022 (secure 0 0 0) 0x7fe850017030 con 0x7fe85409d5c0 2023-09-30T22:29:29.099 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:29.099 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":36,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:29:28.838298+0000","last_up_change":"2023-09-30T22:29:20.757654+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":9,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":34,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":129489}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":129489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":129489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":129489}]},"public_addr":"172.21.15.59:6800/129489","cluster_addr":"172.21.15.59:6801/129489","heartbeat_back_addr":"172.21.15.59:6803/129489","heartbeat_front_addr":"172.21.15.59:6802/129489","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":32,"up_thru":34,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":129609}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":129609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":129609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":129609}]},"public_addr":"172.21.15.59:6804/129609","cluster_addr":"172.21.15.59:6805/129609","heartbeat_back_addr":"172.21.15.59:6807/129609","heartbeat_front_addr":"172.21.15.59:6806/129609","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":34,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":129719}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":129719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":129719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":129719}]},"public_addr":"172.21.15.59:6808/129719","cluster_addr":"172.21.15.59:6809/129719","heartbeat_back_addr":"172.21.15.59:6811/129719","heartbeat_front_addr":"172.21.15.59:6810/129719","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":34,"up_thru":34,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":130037}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":130037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":130037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":130037}]},"public_addr":"172.21.15.59:6812/130037","cluster_addr":"172.21.15.59:6813/130037","heartbeat_back_addr":"172.21.15.59:6815/130037","heartbeat_front_addr":"172.21.15.59:6814/130037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-09-30T22:29:13.318877+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6817/2103029646":"2023-10-01T22:29:28.838274+0000","172.21.15.59:0/3882222550":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/1346763106":"2023-10-01T22:28:59.561079+0000","172.21.15.59:6816/118188":"2023-10-01T22:28:59.561079+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:29:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.101+0000 7fe85c262700 1 -- 172.21.15.59:0/2825256574 >> v1:172.21.15.59:6816/126772 conn(0x7fe83802f510 legacy=0x7fe8380319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.101+0000 7fe85c262700 1 -- 172.21.15.59:0/2825256574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe85409d5c0 msgr2=0x7fe854121180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.101+0000 7fe85c262700 1 --2- 172.21.15.59:0/2825256574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe85409d5c0 0x7fe854121180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe85000ec10 tx=0x7fe85000ef20 comp rx=0 tx=0).stop 2023-09-30T22:29:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.101+0000 7fe85c262700 1 -- 172.21.15.59:0/2825256574 shutdown_connections 2023-09-30T22:29:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.101+0000 7fe85c262700 1 --2- 172.21.15.59:0/2825256574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe854133920 0x7fe854121c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.101+0000 7fe85c262700 1 --2- 172.21.15.59:0/2825256574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe85409d5c0 0x7fe854121180 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.101+0000 7fe85c262700 1 --2- 172.21.15.59:0/2825256574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8540a09c0 0x7fe8541216c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.101+0000 7fe85c262700 1 -- 172.21.15.59:0/2825256574 >> 172.21.15.59:0/2825256574 conn(0x7fe8540a2fe0 msgr2=0x7fe8541331c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.101+0000 7fe85c262700 1 -- 172.21.15.59:0/2825256574 shutdown_connections 2023-09-30T22:29:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.101+0000 7fe85c262700 1 -- 172.21.15.59:0/2825256574 wait complete. 2023-09-30T22:29:29.115 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:29:29.115 INFO:teuthology.run_tasks:Running task exec... 2023-09-30T22:29:29.125 INFO:teuthology.task.exec:Executing custom commands... 2023-09-30T22:29:29.125 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2023-09-30T22:29:29.125 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2023-09-30T22:29:29.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.262+0000 7fa9a2ab1700 1 Processor -- start 2023-09-30T22:29:29.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.262+0000 7fa9a2ab1700 1 -- start start 2023-09-30T22:29:29.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.263+0000 7fa9a2ab1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa99c09c980 0x7fa99c09cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.263+0000 7fa9a2ab1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa99c133600 0x7fa99c133a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.263+0000 7fa9a2ab1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c0a1320 con 0x7fa99c133f90 2023-09-30T22:29:29.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.263+0000 7fa9a2ab1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c09f250 con 0x7fa99c09c980 2023-09-30T22:29:29.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.263+0000 7fa9a2ab1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c134410 con 0x7fa99c133600 2023-09-30T22:29:29.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.263+0000 7fa9a084d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa99c09c980 0x7fa99c09cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.263+0000 7fa99bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa99c133600 0x7fa99c133a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.263+0000 7fa9a084d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa99c09c980 0x7fa99c09cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52388/0 (socket says 172.21.15.59:52388) 2023-09-30T22:29:29.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.263+0000 7fa99bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa99c133600 0x7fa99c133a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36460/0 (socket says 172.21.15.59:36460) 2023-09-30T22:29:29.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.263+0000 7fa9a084d700 1 -- 172.21.15.59:0/2034472491 learned_addr learned my addr 172.21.15.59:0/2034472491 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:29.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.264+0000 7fa9a084d700 1 -- 172.21.15.59:0/2034472491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa99c133600 msgr2=0x7fa99c133a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:29.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.264+0000 7fa9a084d700 1 --2- 172.21.15.59:0/2034472491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa99c133600 0x7fa99c133a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.264+0000 7fa9a084d700 1 -- 172.21.15.59:0/2034472491 >> v1:172.21.15.59:6789/0 conn(0x7fa99c133f90 legacy=0x7fa99c13a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.264+0000 7fa9a084d700 1 -- 172.21.15.59:0/2034472491 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c09ebd0 con 0x7fa99c09c980 2023-09-30T22:29:29.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.264+0000 7fa99bfff700 1 --2- 172.21.15.59:0/2034472491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa99c133600 0x7fa99c133a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:29.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.264+0000 7fa9a084d700 1 --2- 172.21.15.59:0/2034472491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa99c09c980 0x7fa99c09cd50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0098f0 tx=0x7fa98c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2fe89333e08afb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:29.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.264+0000 7fa99b7fe700 1 -- 172.21.15.59:0/2034472491 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c011830 con 0x7fa99c09c980 2023-09-30T22:29:29.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.264+0000 7fa99b7fe700 1 -- 172.21.15.59:0/2034472491 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c011990 con 0x7fa99c09c980 2023-09-30T22:29:29.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.264+0000 7fa99b7fe700 1 -- 172.21.15.59:0/2034472491 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c011d20 con 0x7fa99c09c980 2023-09-30T22:29:29.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.265+0000 7fa9a2ab1700 1 -- 172.21.15.59:0/2034472491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa99c09c980 msgr2=0x7fa99c09cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.265+0000 7fa9a2ab1700 1 --2- 172.21.15.59:0/2034472491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa99c09c980 0x7fa99c09cd50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0098f0 tx=0x7fa98c009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:29.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.265+0000 7fa9a2ab1700 1 -- 172.21.15.59:0/2034472491 shutdown_connections 2023-09-30T22:29:29.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.265+0000 7fa9a2ab1700 1 --2- 172.21.15.59:0/2034472491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa99c09c980 0x7fa99c09cd50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.265+0000 7fa9a2ab1700 1 --2- 172.21.15.59:0/2034472491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa99c133600 0x7fa99c133a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.265+0000 7fa9a2ab1700 1 -- 172.21.15.59:0/2034472491 >> 172.21.15.59:0/2034472491 conn(0x7fa99c0a64c0 msgr2=0x7fa99c0a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:29.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.265+0000 7fa9a2ab1700 1 -- 172.21.15.59:0/2034472491 shutdown_connections 2023-09-30T22:29:29.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.265+0000 7fa9a2ab1700 1 -- 172.21.15.59:0/2034472491 wait complete. 2023-09-30T22:29:29.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.266+0000 7fa9a2ab1700 1 Processor -- start 2023-09-30T22:29:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.266+0000 7fa9a2ab1700 1 -- start start 2023-09-30T22:29:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.266+0000 7fa9a2ab1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa99c09c980 0x7fa99c12f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.266+0000 7fa9a2ab1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa99c133600 0x7fa99c12fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.266+0000 7fa9a2ab1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa99c133f90 0x7fa99c130170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.266+0000 7fa9a2ab1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c12df30 con 0x7fa99c09c980 2023-09-30T22:29:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.266+0000 7fa9a2ab1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c12e2a0 con 0x7fa99c133600 2023-09-30T22:29:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.266+0000 7fa9a2ab1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0a3890 con 0x7fa99c133f90 2023-09-30T22:29:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa9a084d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa99c09c980 0x7fa99c12f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa99bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa99c133600 0x7fa99c12fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa9a084d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa99c09c980 0x7fa99c12f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52390/0 (socket says 172.21.15.59:52390) 2023-09-30T22:29:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa9a084d700 1 -- 172.21.15.59:0/3227525365 learned_addr learned my addr 172.21.15.59:0/3227525365 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa9a104e700 1 --2- 172.21.15.59:0/3227525365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa99c133f90 0x7fa99c130170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa9a084d700 1 -- 172.21.15.59:0/3227525365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa99c133f90 msgr2=0x7fa99c130170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa9a084d700 1 --2- 172.21.15.59:0/3227525365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa99c133f90 0x7fa99c130170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa9a084d700 1 -- 172.21.15.59:0/3227525365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa99c133600 msgr2=0x7fa99c12fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa9a084d700 1 --2- 172.21.15.59:0/3227525365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa99c133600 0x7fa99c12fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa9a084d700 1 -- 172.21.15.59:0/3227525365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9840094a0 con 0x7fa99c09c980 2023-09-30T22:29:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa99bfff700 1 --2- 172.21.15.59:0/3227525365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa99c133600 0x7fa99c12fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa9a084d700 1 --2- 172.21.15.59:0/3227525365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa99c09c980 0x7fa99c12f6f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa98c000c00 tx=0x7fa98c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa9997fa700 1 -- 172.21.15.59:0/3227525365 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c0036a0 con 0x7fa99c09c980 2023-09-30T22:29:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa9997fa700 1 -- 172.21.15.59:0/3227525365 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c003800 con 0x7fa99c09c980 2023-09-30T22:29:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa9a2ab1700 1 -- 172.21.15.59:0/3227525365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c009550 con 0x7fa99c09c980 2023-09-30T22:29:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa9997fa700 1 -- 172.21.15.59:0/3227525365 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c003bb0 con 0x7fa99c09c980 2023-09-30T22:29:29.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.267+0000 7fa9a2ab1700 1 -- 172.21.15.59:0/3227525365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c12da20 con 0x7fa99c09c980 2023-09-30T22:29:29.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.268+0000 7fa9997fa700 1 -- 172.21.15.59:0/3227525365 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa98c021070 con 0x7fa99c09c980 2023-09-30T22:29:29.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.268+0000 7fa9997fa700 1 -- 172.21.15.59:0/3227525365 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa98c041160 con 0x7fa99c09c980 2023-09-30T22:29:29.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.268+0000 7fa9a2ab1700 1 -- 172.21.15.59:0/3227525365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99c130710 con 0x7fa99c09c980 2023-09-30T22:29:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.274+0000 7fa9997fa700 1 -- 172.21.15.59:0/3227525365 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa98c029070 con 0x7fa99c09c980 2023-09-30T22:29:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.479+0000 7fa9a2ab1700 1 -- 172.21.15.59:0/3227525365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa99c04f2a0 con 0x7fa99c09c980 2023-09-30T22:29:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.480+0000 7fa9997fa700 1 -- 172.21.15.59:0/3227525365 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v36) v1 ==== 81+0+24349 (secure 0 0 0) 0x7fa98c015030 con 0x7fa99c09c980 2023-09-30T22:29:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:29.481 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-09-30T22:29:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 36, 2023-09-30T22:29:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "4ab45aad-c596-4cc8-9318-aa2f9d41daac", 2023-09-30T22:29:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "created": "2023-09-30T22:26:18.889102+0000", 2023-09-30T22:29:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2023-09-30T22:29:28.838298+0000", 2023-09-30T22:29:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "last_up_change": "2023-09-30T22:29:20.757654+0000", 2023-09-30T22:29:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "last_in_change": "2023-09-30T22:26:20.441845+0000", 2023-09-30T22:29:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:29:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_num": 5799936, 2023-09-30T22:29:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_set": [ 2023-09-30T22:29:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "pglog_hardlimit", 2023-09-30T22:29:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "purged_snapdirs", 2023-09-30T22:29:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_deletes", 2023-09-30T22:29:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "sortbitwise" 2023-09-30T22:29:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-09-30T22:29:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_version": 9, 2023-09-30T22:29:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "full_ratio": 0.94999998807907104, 2023-09-30T22:29:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-09-30T22:29:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "nearfull_ratio": 0.85000002384185791, 2023-09-30T22:29:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_snapshot": "", 2023-09-30T22:29:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_max": 4, 2023-09-30T22:29:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd": 4, 2023-09-30T22:29:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "require_min_compat_client": "pacific", 2023-09-30T22:29:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "min_compat_client": "luminous", 2023-09-30T22:29:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "require_osd_release": "pacific", 2023-09-30T22:29:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_crimson": false, 2023-09-30T22:29:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "pools": [ 2023-09-30T22:29:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 1, 2023-09-30T22:29:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": ".mgr", 2023-09-30T22:29:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2023-09-30T22:26:26.893716+0000", 2023-09-30T22:29:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-09-30T22:29:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2023-09-30T22:29:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2023-09-30T22:29:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2023-09-30T22:29:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2023-09-30T22:29:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2023-09-30T22:29:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:29:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:29:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:29:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:29:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2023-09-30T22:29:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:29:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 1, 2023-09-30T22:29:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 1, 2023-09-30T22:29:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 1, 2023-09-30T22:29:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 1, 2023-09-30T22:29:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 1, 2023-09-30T22:29:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2023-09-30T22:29:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2023-09-30T22:29:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2023-09-30T22:29:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2023-09-30T22:29:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2023-09-30T22:29:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2023-09-30T22:29:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2023-09-30T22:29:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "24", 2023-09-30T22:29:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2023-09-30T22:29:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:29:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:29:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2023-09-30T22:29:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:29:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2023-09-30T22:29:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2023-09-30T22:29:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2023-09-30T22:29:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2023-09-30T22:29:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2023-09-30T22:29:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2023-09-30T22:29:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2023-09-30T22:29:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2023-09-30T22:29:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2023-09-30T22:29:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2023-09-30T22:29:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2023-09-30T22:29:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2023-09-30T22:29:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2023-09-30T22:29:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:29:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:29:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:29:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2023-09-30T22:29:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2023-09-30T22:29:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2023-09-30T22:29:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2023-09-30T22:29:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2023-09-30T22:29:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2023-09-30T22:29:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2023-09-30T22:29:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2023-09-30T22:29:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:29:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:29:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:29:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:29:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2023-09-30T22:29:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2023-09-30T22:29:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2023-09-30T22:29:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2023-09-30T22:29:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "options": { 2023-09-30T22:29:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_max": 32, 2023-09-30T22:29:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_min": 1 2023-09-30T22:29:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2023-09-30T22:29:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": {}, 2023-09-30T22:29:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_devicehealth": {} 2023-09-30T22:29:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2023-09-30T22:29:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 4, 2023-09-30T22:29:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 4, 2023-09-30T22:29:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.5, 2023-09-30T22:29:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 2, 2023-09-30T22:29:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 2, 2023-09-30T22:29:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:29:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2023-09-30T22:29:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:29:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 2, 2023-09-30T22:29:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "rbd", 2023-09-30T22:29:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2023-09-30T22:26:28.448775+0000", 2023-09-30T22:29:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-09-30T22:29:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2023-09-30T22:29:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2023-09-30T22:29:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2023-09-30T22:29:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2023-09-30T22:29:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2023-09-30T22:29:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:29:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:29:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:29:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:29:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2023-09-30T22:29:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:29:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 8, 2023-09-30T22:29:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 8, 2023-09-30T22:29:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 8, 2023-09-30T22:29:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 8, 2023-09-30T22:29:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 8, 2023-09-30T22:29:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2023-09-30T22:29:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2023-09-30T22:29:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2023-09-30T22:29:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2023-09-30T22:29:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2023-09-30T22:29:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2023-09-30T22:29:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2023-09-30T22:29:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "14", 2023-09-30T22:29:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2023-09-30T22:29:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:29:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:29:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2023-09-30T22:29:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:29:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2023-09-30T22:29:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2023-09-30T22:29:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2023-09-30T22:29:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2023-09-30T22:29:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2023-09-30T22:29:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2023-09-30T22:29:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2023-09-30T22:29:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2023-09-30T22:29:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2023-09-30T22:29:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2023-09-30T22:29:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2023-09-30T22:29:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2023-09-30T22:29:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2023-09-30T22:29:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:29:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:29:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:29:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2023-09-30T22:29:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2023-09-30T22:29:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2023-09-30T22:29:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2023-09-30T22:29:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2023-09-30T22:29:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2023-09-30T22:29:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2023-09-30T22:29:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2023-09-30T22:29:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:29:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:29:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:29:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:29:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2023-09-30T22:29:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2023-09-30T22:29:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2023-09-30T22:29:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2023-09-30T22:29:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2023-09-30T22:29:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2023-09-30T22:29:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2023-09-30T22:29:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2023-09-30T22:29:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 2.5, 2023-09-30T22:29:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 2.5, 2023-09-30T22:29:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 1, 2023-09-30T22:29:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 2.5, 2023-09-30T22:29:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 2.5, 2023-09-30T22:29:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:29:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2023-09-30T22:29:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:29:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2023-09-30T22:29:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:29:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2023-09-30T22:26:32.964075+0000", 2023-09-30T22:29:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-09-30T22:29:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2023-09-30T22:29:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2023-09-30T22:29:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2023-09-30T22:29:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2023-09-30T22:29:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2023-09-30T22:29:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:29:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:29:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:29:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:29:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2023-09-30T22:29:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:29:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 32, 2023-09-30T22:29:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 32, 2023-09-30T22:29:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 32, 2023-09-30T22:29:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 32, 2023-09-30T22:29:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 32, 2023-09-30T22:29:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2023-09-30T22:29:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2023-09-30T22:29:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2023-09-30T22:29:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2023-09-30T22:29:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2023-09-30T22:29:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2023-09-30T22:29:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2023-09-30T22:29:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "17", 2023-09-30T22:29:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2023-09-30T22:29:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:29:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:29:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2023-09-30T22:29:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:29:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2023-09-30T22:29:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2023-09-30T22:29:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2023-09-30T22:29:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2023-09-30T22:29:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2023-09-30T22:29:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2023-09-30T22:29:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2023-09-30T22:29:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2023-09-30T22:29:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2023-09-30T22:29:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2023-09-30T22:29:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2023-09-30T22:29:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2023-09-30T22:29:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2023-09-30T22:29:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:29:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:29:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:29:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2023-09-30T22:29:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2023-09-30T22:29:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2023-09-30T22:29:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2023-09-30T22:29:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2023-09-30T22:29:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2023-09-30T22:29:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2023-09-30T22:29:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2023-09-30T22:29:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:29:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:29:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:29:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:29:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2023-09-30T22:29:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2023-09-30T22:29:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2023-09-30T22:29:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2023-09-30T22:29:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "options": { 2023-09-30T22:29:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:29:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_min": 16, 2023-09-30T22:29:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_priority": 5 2023-09-30T22:29:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2023-09-30T22:29:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs": { 2023-09-30T22:29:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": "cephfs" 2023-09-30T22:29:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2023-09-30T22:29:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1.6299999952316284, 2023-09-30T22:29:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1.6299999952316284, 2023-09-30T22:29:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 1, 2023-09-30T22:29:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.6299999952316284, 2023-09-30T22:29:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.6299999952316284, 2023-09-30T22:29:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:29:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2023-09-30T22:29:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:29:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 4, 2023-09-30T22:29:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "cephfs_data", 2023-09-30T22:29:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2023-09-30T22:26:33.390842+0000", 2023-09-30T22:29:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-09-30T22:29:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2023-09-30T22:29:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2023-09-30T22:29:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2023-09-30T22:29:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2023-09-30T22:29:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2023-09-30T22:29:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:29:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:29:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:29:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:29:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2023-09-30T22:29:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:29:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 64, 2023-09-30T22:29:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 64, 2023-09-30T22:29:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 64, 2023-09-30T22:29:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 64, 2023-09-30T22:29:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 64, 2023-09-30T22:29:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2023-09-30T22:29:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2023-09-30T22:29:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2023-09-30T22:29:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2023-09-30T22:29:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2023-09-30T22:29:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2023-09-30T22:29:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2023-09-30T22:29:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "18", 2023-09-30T22:29:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2023-09-30T22:29:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:29:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:29:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2023-09-30T22:29:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:29:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2023-09-30T22:29:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2023-09-30T22:29:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2023-09-30T22:29:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2023-09-30T22:29:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2023-09-30T22:29:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2023-09-30T22:29:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2023-09-30T22:29:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2023-09-30T22:29:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2023-09-30T22:29:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2023-09-30T22:29:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2023-09-30T22:29:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2023-09-30T22:29:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2023-09-30T22:29:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:29:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:29:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:29:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2023-09-30T22:29:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2023-09-30T22:29:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2023-09-30T22:29:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2023-09-30T22:29:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2023-09-30T22:29:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2023-09-30T22:29:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2023-09-30T22:29:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2023-09-30T22:29:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:29:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:29:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:29:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:29:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2023-09-30T22:29:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2023-09-30T22:29:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2023-09-30T22:29:29.511 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2023-09-30T22:29:29.511 INFO:teuthology.orchestra.run.smithi059.stdout: "options": { 2023-09-30T22:29:29.511 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_min": 64, 2023-09-30T22:29:29.511 INFO:teuthology.orchestra.run.smithi059.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:29:29.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.511 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2023-09-30T22:29:29.511 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs": { 2023-09-30T22:29:29.511 INFO:teuthology.orchestra.run.smithi059.stdout: "data": "cephfs" 2023-09-30T22:29:29.511 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.511 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2023-09-30T22:29:29.511 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1.1299999952316284, 2023-09-30T22:29:29.511 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1.1299999952316284, 2023-09-30T22:29:29.512 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 1, 2023-09-30T22:29:29.512 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.1299999952316284, 2023-09-30T22:29:29.512 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.1299999952316284, 2023-09-30T22:29:29.512 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:29:29.512 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2023-09-30T22:29:29.512 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:29:29.512 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.512 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.512 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-09-30T22:29:29.512 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2023-09-30T22:29:29.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.513 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2023-09-30T22:29:29.513 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "d0b434cc-ff57-487c-b74e-732daf83db21", 2023-09-30T22:29:29.513 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2023-09-30T22:29:29.513 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2023-09-30T22:29:29.513 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2023-09-30T22:29:29.513 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2023-09-30T22:29:29.513 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 10, 2023-09-30T22:29:29.513 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 24, 2023-09-30T22:29:29.513 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 30, 2023-09-30T22:29:29.514 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 34, 2023-09-30T22:29:29.514 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 25, 2023-09-30T22:29:29.514 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2023-09-30T22:29:29.514 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2023-09-30T22:29:29.514 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.514 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.514 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6800", 2023-09-30T22:29:29.514 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129489 2023-09-30T22:29:29.515 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.515 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.515 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2023-09-30T22:29:29.515 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.515 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.515 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6801", 2023-09-30T22:29:29.515 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129489 2023-09-30T22:29:29.515 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.515 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.516 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2023-09-30T22:29:29.516 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.516 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.516 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6803", 2023-09-30T22:29:29.516 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129489 2023-09-30T22:29:29.516 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.516 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.516 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2023-09-30T22:29:29.516 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.517 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.517 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6802", 2023-09-30T22:29:29.517 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129489 2023-09-30T22:29:29.517 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.517 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.517 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6800/129489", 2023-09-30T22:29:29.517 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6801/129489", 2023-09-30T22:29:29.517 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6803/129489", 2023-09-30T22:29:29.517 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6802/129489", 2023-09-30T22:29:29.517 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2023-09-30T22:29:29.517 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2023-09-30T22:29:29.517 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2023-09-30T22:29:29.518 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.518 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2023-09-30T22:29:29.518 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "be6a19ee-8eef-4d1a-aa98-0a9665822d8b", 2023-09-30T22:29:29.518 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2023-09-30T22:29:29.518 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2023-09-30T22:29:29.518 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2023-09-30T22:29:29.518 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2023-09-30T22:29:29.518 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 9, 2023-09-30T22:29:29.518 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 24, 2023-09-30T22:29:29.519 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 32, 2023-09-30T22:29:29.519 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 34, 2023-09-30T22:29:29.519 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 26, 2023-09-30T22:29:29.519 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2023-09-30T22:29:29.519 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2023-09-30T22:29:29.519 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.519 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.519 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6804", 2023-09-30T22:29:29.519 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129609 2023-09-30T22:29:29.519 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.519 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.520 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2023-09-30T22:29:29.520 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.520 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.520 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6805", 2023-09-30T22:29:29.520 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129609 2023-09-30T22:29:29.520 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.520 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.520 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2023-09-30T22:29:29.520 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.521 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.521 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6807", 2023-09-30T22:29:29.521 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129609 2023-09-30T22:29:29.521 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.521 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.521 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2023-09-30T22:29:29.521 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.521 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.521 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6806", 2023-09-30T22:29:29.522 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129609 2023-09-30T22:29:29.522 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.522 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.522 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6804/129609", 2023-09-30T22:29:29.522 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6805/129609", 2023-09-30T22:29:29.522 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6807/129609", 2023-09-30T22:29:29.522 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6806/129609", 2023-09-30T22:29:29.522 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2023-09-30T22:29:29.522 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2023-09-30T22:29:29.522 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2023-09-30T22:29:29.522 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.523 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2023-09-30T22:29:29.523 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "e23ec521-1072-4f90-9c51-51470aa9b4bf", 2023-09-30T22:29:29.523 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2023-09-30T22:29:29.523 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2023-09-30T22:29:29.523 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2023-09-30T22:29:29.523 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2023-09-30T22:29:29.523 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 10, 2023-09-30T22:29:29.523 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 26, 2023-09-30T22:29:29.523 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 32, 2023-09-30T22:29:29.524 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 34, 2023-09-30T22:29:29.524 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 27, 2023-09-30T22:29:29.524 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2023-09-30T22:29:29.524 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2023-09-30T22:29:29.524 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.524 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.524 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6808", 2023-09-30T22:29:29.524 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129719 2023-09-30T22:29:29.524 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.524 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.525 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2023-09-30T22:29:29.525 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.525 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.525 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6809", 2023-09-30T22:29:29.525 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129719 2023-09-30T22:29:29.525 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.525 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.525 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2023-09-30T22:29:29.525 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.525 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.526 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6811", 2023-09-30T22:29:29.526 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129719 2023-09-30T22:29:29.526 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.526 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.526 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2023-09-30T22:29:29.526 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.526 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.526 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6810", 2023-09-30T22:29:29.527 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129719 2023-09-30T22:29:29.527 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.527 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.527 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6808/129719", 2023-09-30T22:29:29.527 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6809/129719", 2023-09-30T22:29:29.527 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6811/129719", 2023-09-30T22:29:29.527 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6810/129719", 2023-09-30T22:29:29.527 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2023-09-30T22:29:29.527 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2023-09-30T22:29:29.527 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2023-09-30T22:29:29.527 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.528 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2023-09-30T22:29:29.528 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "287c081f-a40d-4dd9-8484-0262965ca8bb", 2023-09-30T22:29:29.528 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2023-09-30T22:29:29.528 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2023-09-30T22:29:29.528 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2023-09-30T22:29:29.528 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2023-09-30T22:29:29.528 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 9, 2023-09-30T22:29:29.528 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 27, 2023-09-30T22:29:29.528 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 34, 2023-09-30T22:29:29.528 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 34, 2023-09-30T22:29:29.529 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 28, 2023-09-30T22:29:29.529 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2023-09-30T22:29:29.529 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2023-09-30T22:29:29.529 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.529 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.529 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6812", 2023-09-30T22:29:29.529 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 130037 2023-09-30T22:29:29.529 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.529 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.529 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2023-09-30T22:29:29.529 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.530 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.530 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6813", 2023-09-30T22:29:29.530 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 130037 2023-09-30T22:29:29.530 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.530 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.530 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2023-09-30T22:29:29.530 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.530 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.531 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6815", 2023-09-30T22:29:29.531 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 130037 2023-09-30T22:29:29.531 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.531 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.531 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2023-09-30T22:29:29.531 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-09-30T22:29:29.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.531 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-30T22:29:29.531 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6814", 2023-09-30T22:29:29.531 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 130037 2023-09-30T22:29:29.531 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.532 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.532 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6812/130037", 2023-09-30T22:29:29.532 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6813/130037", 2023-09-30T22:29:29.532 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6815/130037", 2023-09-30T22:29:29.532 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6814/130037", 2023-09-30T22:29:29.532 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2023-09-30T22:29:29.532 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2023-09-30T22:29:29.532 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2023-09-30T22:29:29.532 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.532 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.532 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-09-30T22:29:29.532 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_xinfo": [ 2023-09-30T22:29:29.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.533 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2023-09-30T22:29:29.533 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2023-09-30T22:29:29.533 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2023-09-30T22:29:29.533 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2023-09-30T22:29:29.533 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540138322906710015, 2023-09-30T22:29:29.533 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2023-09-30T22:29:29.533 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2023-09-30T22:26:25.880134+0000", 2023-09-30T22:29:29.533 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 25 2023-09-30T22:29:29.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.533 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2023-09-30T22:29:29.534 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2023-09-30T22:29:29.534 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2023-09-30T22:29:29.534 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2023-09-30T22:29:29.534 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540138322906710015, 2023-09-30T22:29:29.534 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2023-09-30T22:29:29.534 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2023-09-30T22:26:25.840132+0000", 2023-09-30T22:29:29.534 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 26 2023-09-30T22:29:29.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.538 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2023-09-30T22:29:29.538 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2023-09-30T22:29:29.538 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2023-09-30T22:29:29.538 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2023-09-30T22:29:29.538 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540138322906710015, 2023-09-30T22:29:29.538 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2023-09-30T22:29:29.538 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2023-09-30T22:26:25.908133+0000", 2023-09-30T22:29:29.538 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 27 2023-09-30T22:29:29.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.539 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2023-09-30T22:29:29.539 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "2023-09-30T22:29:13.318877+0000", 2023-09-30T22:29:29.539 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2023-09-30T22:29:29.539 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2023-09-30T22:29:29.539 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540138322906710015, 2023-09-30T22:29:29.539 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2023-09-30T22:29:29.539 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2023-09-30T22:26:25.619080+0000", 2023-09-30T22:29:29.539 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2023-09-30T22:29:29.539 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.539 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-09-30T22:29:29.540 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap": [], 2023-09-30T22:29:29.540 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_items": [ 2023-09-30T22:29:29.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.540 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.8", 2023-09-30T22:29:29.540 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-09-30T22:29:29.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.540 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2023-09-30T22:29:29.540 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 2 2023-09-30T22:29:29.540 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.540 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.540 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.11", 2023-09-30T22:29:29.540 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-09-30T22:29:29.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.541 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2023-09-30T22:29:29.541 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 2 2023-09-30T22:29:29.541 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.541 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.541 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.12", 2023-09-30T22:29:29.541 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-09-30T22:29:29.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.541 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 1, 2023-09-30T22:29:29.541 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 0 2023-09-30T22:29:29.542 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.542 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.542 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.13", 2023-09-30T22:29:29.542 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-09-30T22:29:29.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.542 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2023-09-30T22:29:29.542 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 0 2023-09-30T22:29:29.542 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.542 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.543 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.15", 2023-09-30T22:29:29.543 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-09-30T22:29:29.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.543 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2023-09-30T22:29:29.543 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 2 2023-09-30T22:29:29.543 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.543 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.543 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.21", 2023-09-30T22:29:29.543 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-09-30T22:29:29.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.544 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2023-09-30T22:29:29.544 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 2 2023-09-30T22:29:29.544 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.544 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.544 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.23", 2023-09-30T22:29:29.544 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-09-30T22:29:29.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.544 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2023-09-30T22:29:29.544 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 2 2023-09-30T22:29:29.545 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.545 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.545 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.3a", 2023-09-30T22:29:29.545 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-09-30T22:29:29.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-30T22:29:29.545 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2023-09-30T22:29:29.545 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 0 2023-09-30T22:29:29.545 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.545 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-30T22:29:29.545 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.545 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-09-30T22:29:29.546 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_primaries": [], 2023-09-30T22:29:29.546 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_temp": [], 2023-09-30T22:29:29.546 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_temp": [], 2023-09-30T22:29:29.546 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklist": { 2023-09-30T22:29:29.546 INFO:teuthology.orchestra.run.smithi059.stdout: "172.21.15.59:6817/2103029646": "2023-10-01T22:29:28.838274+0000", 2023-09-30T22:29:29.546 INFO:teuthology.orchestra.run.smithi059.stdout: "172.21.15.59:0/3882222550": "2023-10-01T22:28:59.561079+0000", 2023-09-30T22:29:29.546 INFO:teuthology.orchestra.run.smithi059.stdout: "172.21.15.59:0/1346763106": "2023-10-01T22:28:59.561079+0000", 2023-09-30T22:29:29.546 INFO:teuthology.orchestra.run.smithi059.stdout: "172.21.15.59:6816/118188": "2023-10-01T22:28:59.561079+0000" 2023-09-30T22:29:29.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.546 INFO:teuthology.orchestra.run.smithi059.stdout: "range_blocklist": {}, 2023-09-30T22:29:29.546 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profiles": { 2023-09-30T22:29:29.546 INFO:teuthology.orchestra.run.smithi059.stdout: "default": { 2023-09-30T22:29:29.547 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-failure-domain": "osd", 2023-09-30T22:29:29.547 INFO:teuthology.orchestra.run.smithi059.stdout: "k": "2", 2023-09-30T22:29:29.547 INFO:teuthology.orchestra.run.smithi059.stdout: "m": "1", 2023-09-30T22:29:29.547 INFO:teuthology.orchestra.run.smithi059.stdout: "plugin": "jerasure", 2023-09-30T22:29:29.547 INFO:teuthology.orchestra.run.smithi059.stdout: "technique": "reed_sol_van" 2023-09-30T22:29:29.547 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:29.547 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps_queue": [], 2023-09-30T22:29:29.547 INFO:teuthology.orchestra.run.smithi059.stdout: "new_removed_snaps": [], 2023-09-30T22:29:29.547 INFO:teuthology.orchestra.run.smithi059.stdout: "new_purged_snaps": [], 2023-09-30T22:29:29.547 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_node_flags": {}, 2023-09-30T22:29:29.547 INFO:teuthology.orchestra.run.smithi059.stdout: "device_class_flags": {}, 2023-09-30T22:29:29.547 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode": { 2023-09-30T22:29:29.548 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_enabled": false, 2023-09-30T22:29:29.548 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_bucket_count": 0, 2023-09-30T22:29:29.548 INFO:teuthology.orchestra.run.smithi059.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:29:29.548 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:29:29.548 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_bucket": 0 2023-09-30T22:29:29.548 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:29.548 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-09-30T22:29:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.483+0000 7fa9a2ab1700 1 -- 172.21.15.59:0/3227525365 >> v1:172.21.15.59:6816/126772 conn(0x7fa97c02f510 legacy=0x7fa97c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.483+0000 7fa9a2ab1700 1 -- 172.21.15.59:0/3227525365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa99c09c980 msgr2=0x7fa99c12f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.483+0000 7fa9a2ab1700 1 --2- 172.21.15.59:0/3227525365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa99c09c980 0x7fa99c12f6f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa98c000c00 tx=0x7fa98c004750 comp rx=0 tx=0).stop 2023-09-30T22:29:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.483+0000 7fa9a2ab1700 1 -- 172.21.15.59:0/3227525365 shutdown_connections 2023-09-30T22:29:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.483+0000 7fa9a2ab1700 1 --2- 172.21.15.59:0/3227525365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa99c133f90 0x7fa99c130170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.483+0000 7fa9a2ab1700 1 --2- 172.21.15.59:0/3227525365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa99c09c980 0x7fa99c12f6f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.483+0000 7fa9a2ab1700 1 --2- 172.21.15.59:0/3227525365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa99c133600 0x7fa99c12fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.483+0000 7fa9a2ab1700 1 -- 172.21.15.59:0/3227525365 >> 172.21.15.59:0/3227525365 conn(0x7fa99c0a64c0 msgr2=0x7fa99c0a41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.483+0000 7fa9a2ab1700 1 -- 172.21.15.59:0/3227525365 shutdown_connections 2023-09-30T22:29:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.483+0000 7fa9a2ab1700 1 -- 172.21.15.59:0/3227525365 wait complete. 2023-09-30T22:29:29.551 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2023-09-30T22:29:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.686+0000 7f1cb79d9700 1 Processor -- start 2023-09-30T22:29:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.686+0000 7f1cb79d9700 1 -- start start 2023-09-30T22:29:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.686+0000 7f1cb79d9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb009e9d0 0x7f1cb009eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.686+0000 7f1cb79d9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cb01342b0 0x7f1cb013be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1cb79d9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb006db50 con 0x7f1cb009f2e0 2023-09-30T22:29:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1cb79d9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb006d7d0 con 0x7f1cb01342b0 2023-09-30T22:29:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1cb79d9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb009ae00 con 0x7f1cb009e9d0 2023-09-30T22:29:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1cb5f76700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cb01342b0 0x7f1cb013be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1cb5775700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb009e9d0 0x7f1cb009eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1cb5f76700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cb01342b0 0x7f1cb013be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52406/0 (socket says 172.21.15.59:52406) 2023-09-30T22:29:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1cb5775700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb009e9d0 0x7f1cb009eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36484/0 (socket says 172.21.15.59:36484) 2023-09-30T22:29:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1cb5f76700 1 -- 172.21.15.59:0/1732131790 learned_addr learned my addr 172.21.15.59:0/1732131790 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1cb5f76700 1 -- 172.21.15.59:0/1732131790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb009e9d0 msgr2=0x7f1cb009eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1cb5f76700 1 --2- 172.21.15.59:0/1732131790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb009e9d0 0x7f1cb009eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1cb5f76700 1 -- 172.21.15.59:0/1732131790 >> v1:172.21.15.59:6789/0 conn(0x7f1cb009f2e0 legacy=0x7f1cb0133ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1cb5f76700 1 -- 172.21.15.59:0/1732131790 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb006cb10 con 0x7f1cb01342b0 2023-09-30T22:29:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1cb5775700 1 --2- 172.21.15.59:0/1732131790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb009e9d0 0x7f1cb009eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1cb5f76700 1 --2- 172.21.15.59:0/1732131790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb01342b0 0x7f1cb013be00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009e50 tx=0x7f1ca800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7138df2c54a604bf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1ca7fff700 1 -- 172.21.15.59:0/1732131790 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca800e070 con 0x7f1cb01342b0 2023-09-30T22:29:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1ca7fff700 1 -- 172.21.15.59:0/1732131790 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca800b910 con 0x7f1cb01342b0 2023-09-30T22:29:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.687+0000 7f1ca7fff700 1 -- 172.21.15.59:0/1732131790 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca800bcc0 con 0x7f1cb01342b0 2023-09-30T22:29:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.688+0000 7f1cb79d9700 1 -- 172.21.15.59:0/1732131790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb01342b0 msgr2=0x7f1cb013be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.688+0000 7f1cb79d9700 1 --2- 172.21.15.59:0/1732131790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb01342b0 0x7f1cb013be00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009e50 tx=0x7f1ca800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.688+0000 7f1cb79d9700 1 -- 172.21.15.59:0/1732131790 shutdown_connections 2023-09-30T22:29:29.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.688+0000 7f1cb79d9700 1 --2- 172.21.15.59:0/1732131790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb01342b0 0x7f1cb013be00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.688+0000 7f1cb79d9700 1 --2- 172.21.15.59:0/1732131790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb009e9d0 0x7f1cb009eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.688+0000 7f1cb79d9700 1 -- 172.21.15.59:0/1732131790 >> 172.21.15.59:0/1732131790 conn(0x7f1cb00a43c0 msgr2=0x7f1cb00a47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:29.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.688+0000 7f1cb79d9700 1 -- 172.21.15.59:0/1732131790 shutdown_connections 2023-09-30T22:29:29.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.688+0000 7f1cb79d9700 1 -- 172.21.15.59:0/1732131790 wait complete. 2023-09-30T22:29:29.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.689+0000 7f1cb79d9700 1 Processor -- start 2023-09-30T22:29:29.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.689+0000 7f1cb79d9700 1 -- start start 2023-09-30T22:29:29.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.690+0000 7f1cb79d9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb009e9d0 0x7f1cb01228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.690+0000 7f1cb79d9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cb009f2e0 0x7f1cb0122de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.690+0000 7f1cb79d9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb01342b0 0x7f1cb0123320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.690+0000 7f1cb79d9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0125ac0 con 0x7f1cb01342b0 2023-09-30T22:29:29.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.690+0000 7f1cb79d9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb01244b0 con 0x7f1cb009e9d0 2023-09-30T22:29:29.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.690+0000 7f1cb79d9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb009b780 con 0x7f1cb009f2e0 2023-09-30T22:29:29.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.690+0000 7f1cb5775700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb009e9d0 0x7f1cb01228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.690+0000 7f1cb5775700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb009e9d0 0x7f1cb01228a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36488/0 (socket says 172.21.15.59:36488) 2023-09-30T22:29:29.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.690+0000 7f1cb5775700 1 -- 172.21.15.59:0/2148329053 learned_addr learned my addr 172.21.15.59:0/2148329053 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:29.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.690+0000 7f1cb5f76700 1 --2- 172.21.15.59:0/2148329053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb01342b0 0x7f1cb0123320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.690+0000 7f1cb4f74700 1 --2- 172.21.15.59:0/2148329053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cb009f2e0 0x7f1cb0122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.691+0000 7f1cb5775700 1 -- 172.21.15.59:0/2148329053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cb009f2e0 msgr2=0x7f1cb0122de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.691+0000 7f1cb5775700 1 --2- 172.21.15.59:0/2148329053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cb009f2e0 0x7f1cb0122de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.691+0000 7f1cb5775700 1 -- 172.21.15.59:0/2148329053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb01342b0 msgr2=0x7f1cb0123320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.691+0000 7f1cb5775700 1 --2- 172.21.15.59:0/2148329053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb01342b0 0x7f1cb0123320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.691+0000 7f1cb5775700 1 -- 172.21.15.59:0/2148329053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac0094a0 con 0x7f1cb009e9d0 2023-09-30T22:29:29.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.691+0000 7f1cb5f76700 1 --2- 172.21.15.59:0/2148329053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb01342b0 0x7f1cb0123320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:29.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.691+0000 7f1cb5775700 1 --2- 172.21.15.59:0/2148329053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb009e9d0 0x7f1cb01228a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00ebe0 tx=0x7f1cac00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:29.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.691+0000 7f1ca5ffb700 1 -- 172.21.15.59:0/2148329053 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac00c850 con 0x7f1cb009e9d0 2023-09-30T22:29:29.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.691+0000 7f1ca5ffb700 1 -- 172.21.15.59:0/2148329053 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac00c9b0 con 0x7f1cb009e9d0 2023-09-30T22:29:29.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.691+0000 7f1cb79d9700 1 -- 172.21.15.59:0/2148329053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca8009b30 con 0x7f1cb009e9d0 2023-09-30T22:29:29.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.691+0000 7f1ca5ffb700 1 -- 172.21.15.59:0/2148329053 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac00cd40 con 0x7f1cb009e9d0 2023-09-30T22:29:29.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.691+0000 7f1cb79d9700 1 -- 172.21.15.59:0/2148329053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb0125e20 con 0x7f1cb009e9d0 2023-09-30T22:29:29.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.692+0000 7f1ca5ffb700 1 -- 172.21.15.59:0/2148329053 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1cac013470 con 0x7f1cb009e9d0 2023-09-30T22:29:29.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.693+0000 7f1ca5ffb700 1 -- 172.21.15.59:0/2148329053 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1cac03fca0 con 0x7f1cb009e9d0 2023-09-30T22:29:29.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.692+0000 7f1cb79d9700 1 -- 172.21.15.59:0/2148329053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb004f2a0 con 0x7f1cb009e9d0 2023-09-30T22:29:29.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.698+0000 7f1ca5ffb700 1 -- 172.21.15.59:0/2148329053 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1cac021020 con 0x7f1cb009e9d0 2023-09-30T22:29:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.998+0000 7f1cb79d9700 1 -- 172.21.15.59:0/2148329053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1cb01337f0 con 0x7f1cb009e9d0 2023-09-30T22:29:29.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:29.999+0000 7f1ca5ffb700 1 -- 172.21.15.59:0/2148329053 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+627 (secure 0 0 0) 0x7f1cac013720 con 0x7f1cb009e9d0 2023-09-30T22:29:29.999 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-09-30T22:29:29.999 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": { 2023-09-30T22:29:29.999 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 3 2023-09-30T22:29:29.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:30.000 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": { 2023-09-30T22:29:30.000 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 1 2023-09-30T22:29:30.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:30.000 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": { 2023-09-30T22:29:30.000 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 4 2023-09-30T22:29:30.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:30.000 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2023-09-30T22:29:30.001 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 1 2023-09-30T22:29:30.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-30T22:29:30.001 INFO:teuthology.orchestra.run.smithi059.stdout: "overall": { 2023-09-30T22:29:30.001 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 9 2023-09-30T22:29:30.001 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-30T22:29:30.002 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-09-30T22:29:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.001+0000 7f1cb79d9700 1 -- 172.21.15.59:0/2148329053 >> v1:172.21.15.59:6816/126772 conn(0x7f1c9402f540 legacy=0x7f1c940319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.001+0000 7f1cb79d9700 1 -- 172.21.15.59:0/2148329053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb009e9d0 msgr2=0x7f1cb01228a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.001+0000 7f1cb79d9700 1 --2- 172.21.15.59:0/2148329053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb009e9d0 0x7f1cb01228a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00ebe0 tx=0x7f1cac00eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.001+0000 7f1cb79d9700 1 -- 172.21.15.59:0/2148329053 shutdown_connections 2023-09-30T22:29:30.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.001+0000 7f1cb79d9700 1 --2- 172.21.15.59:0/2148329053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb01342b0 0x7f1cb0123320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.001+0000 7f1cb79d9700 1 --2- 172.21.15.59:0/2148329053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb009e9d0 0x7f1cb01228a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.001+0000 7f1cb79d9700 1 --2- 172.21.15.59:0/2148329053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cb009f2e0 0x7f1cb0122de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.001+0000 7f1cb79d9700 1 -- 172.21.15.59:0/2148329053 >> 172.21.15.59:0/2148329053 conn(0x7f1cb00a43c0 msgr2=0x7f1cb009caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.001+0000 7f1cb79d9700 1 -- 172.21.15.59:0/2148329053 shutdown_connections 2023-09-30T22:29:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.001+0000 7f1cb79d9700 1 -- 172.21.15.59:0/2148329053 wait complete. 2023-09-30T22:29:30.015 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2023-09-30T22:29:30.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.149+0000 7fc8bbc29700 1 Processor -- start 2023-09-30T22:29:30.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.149+0000 7fc8bbc29700 1 -- start start 2023-09-30T22:29:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.150+0000 7fc8bbc29700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d930 0x7fc8b409dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.150+0000 7fc8bbc29700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc8b4130f00 0x7fc8b4138a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.150+0000 7fc8bbc29700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b409b570 con 0x7fc8b409e240 2023-09-30T22:29:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.150+0000 7fc8bbc29700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b409ed90 con 0x7fc8b4130f00 2023-09-30T22:29:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.150+0000 7fc8bbc29700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b409a5a0 con 0x7fc8b409d930 2023-09-30T22:29:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.150+0000 7fc8b99c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d930 0x7fc8b409dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.150+0000 7fc8b99c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d930 0x7fc8b409dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42524/0 (socket says 172.21.15.59:42524) 2023-09-30T22:29:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.150+0000 7fc8ba1c6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc8b4130f00 0x7fc8b4138a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.150+0000 7fc8b99c5700 1 -- 172.21.15.59:0/2107288585 learned_addr learned my addr 172.21.15.59:0/2107288585 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.150+0000 7fc8ba1c6700 1 -- 172.21.15.59:0/2107288585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d930 msgr2=0x7fc8b409dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.150+0000 7fc8ba1c6700 1 --2- 172.21.15.59:0/2107288585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d930 0x7fc8b409dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.150+0000 7fc8ba1c6700 1 -- 172.21.15.59:0/2107288585 >> v1:172.21.15.59:6789/0 conn(0x7fc8b409e240 legacy=0x7fc8b41307f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.150+0000 7fc8ba1c6700 1 -- 172.21.15.59:0/2107288585 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b409ac20 con 0x7fc8b4130f00 2023-09-30T22:29:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.150+0000 7fc8b99c5700 1 --2- 172.21.15.59:0/2107288585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d930 0x7fc8b409dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.150+0000 7fc8ba1c6700 1 --2- 172.21.15.59:0/2107288585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4130f00 0x7fc8b4138a50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009d90 tx=0x7fc8ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49aa65e3fd667211 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.151+0000 7fc8b89c3700 1 -- 172.21.15.59:0/2107288585 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac00e070 con 0x7fc8b4130f00 2023-09-30T22:29:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.151+0000 7fc8b89c3700 1 -- 172.21.15.59:0/2107288585 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac00bb20 con 0x7fc8b4130f00 2023-09-30T22:29:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.151+0000 7fc8b89c3700 1 -- 172.21.15.59:0/2107288585 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac012430 con 0x7fc8b4130f00 2023-09-30T22:29:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.151+0000 7fc8bbc29700 1 -- 172.21.15.59:0/2107288585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4130f00 msgr2=0x7fc8b4138a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.151+0000 7fc8bbc29700 1 --2- 172.21.15.59:0/2107288585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4130f00 0x7fc8b4138a50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009d90 tx=0x7fc8ac00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.151+0000 7fc8bbc29700 1 -- 172.21.15.59:0/2107288585 shutdown_connections 2023-09-30T22:29:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.151+0000 7fc8bbc29700 1 --2- 172.21.15.59:0/2107288585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4130f00 0x7fc8b4138a50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.151+0000 7fc8bbc29700 1 --2- 172.21.15.59:0/2107288585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d930 0x7fc8b409dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.151+0000 7fc8bbc29700 1 -- 172.21.15.59:0/2107288585 >> 172.21.15.59:0/2107288585 conn(0x7fc8b4099c30 msgr2=0x7fc8b40a3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:30.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.151+0000 7fc8bbc29700 1 -- 172.21.15.59:0/2107288585 shutdown_connections 2023-09-30T22:29:30.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.151+0000 7fc8bbc29700 1 -- 172.21.15.59:0/2107288585 wait complete. 2023-09-30T22:29:30.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.152+0000 7fc8bbc29700 1 Processor -- start 2023-09-30T22:29:30.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.152+0000 7fc8bbc29700 1 -- start start 2023-09-30T22:29:30.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8bbc29700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d930 0x7fc8b41231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:30.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8bbc29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b409e240 0x7fc8b4123710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:30.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8bbc29700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4130f00 0x7fc8b41c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:30.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8bbc29700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b4122dc0 con 0x7fc8b4130f00 2023-09-30T22:29:30.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8bbc29700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b40a2090 con 0x7fc8b409e240 2023-09-30T22:29:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8bbc29700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b409c980 con 0x7fc8b409d930 2023-09-30T22:29:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8ba1c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4130f00 0x7fc8b41c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8b99c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d930 0x7fc8b41231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8ba1c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4130f00 0x7fc8b41c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52422/0 (socket says 172.21.15.59:52422) 2023-09-30T22:29:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8b99c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d930 0x7fc8b41231d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42526/0 (socket says 172.21.15.59:42526) 2023-09-30T22:29:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8ba1c6700 1 -- 172.21.15.59:0/1536803765 learned_addr learned my addr 172.21.15.59:0/1536803765 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8b91c4700 1 --2- 172.21.15.59:0/1536803765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b409e240 0x7fc8b4123710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8b99c5700 1 -- 172.21.15.59:0/1536803765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b409e240 msgr2=0x7fc8b4123710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8b99c5700 1 --2- 172.21.15.59:0/1536803765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b409e240 0x7fc8b4123710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8b99c5700 1 -- 172.21.15.59:0/1536803765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4130f00 msgr2=0x7fc8b41c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8b99c5700 1 --2- 172.21.15.59:0/1536803765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4130f00 0x7fc8b41c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8b99c5700 1 -- 172.21.15.59:0/1536803765 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b0009550 con 0x7fc8b409d930 2023-09-30T22:29:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8ba1c6700 1 --2- 172.21.15.59:0/1536803765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4130f00 0x7fc8b41c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.153+0000 7fc8b91c4700 1 --2- 172.21.15.59:0/1536803765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b409e240 0x7fc8b4123710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.154+0000 7fc8b99c5700 1 --2- 172.21.15.59:0/1536803765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d930 0x7fc8b41231d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000e9a0 tx=0x7fc8b000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.154+0000 7fc8aa7fc700 1 -- 172.21.15.59:0/1536803765 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0004030 con 0x7fc8b409d930 2023-09-30T22:29:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.154+0000 7fc8aa7fc700 1 -- 172.21.15.59:0/1536803765 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b0004190 con 0x7fc8b409d930 2023-09-30T22:29:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.154+0000 7fc8bbc29700 1 -- 172.21.15.59:0/1536803765 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ac009a70 con 0x7fc8b409d930 2023-09-30T22:29:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.154+0000 7fc8aa7fc700 1 -- 172.21.15.59:0/1536803765 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0004520 con 0x7fc8b409d930 2023-09-30T22:29:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.154+0000 7fc8bbc29700 1 -- 172.21.15.59:0/1536803765 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b4125180 con 0x7fc8b409d930 2023-09-30T22:29:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.155+0000 7fc8aa7fc700 1 -- 172.21.15.59:0/1536803765 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc8b00036a0 con 0x7fc8b409d930 2023-09-30T22:29:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.155+0000 7fc8aa7fc700 1 -- 172.21.15.59:0/1536803765 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc8b003fd80 con 0x7fc8b409d930 2023-09-30T22:29:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.155+0000 7fc8bbc29700 1 -- 172.21.15.59:0/1536803765 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b404f2a0 con 0x7fc8b409d930 2023-09-30T22:29:30.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.160+0000 7fc8aa7fc700 1 -- 172.21.15.59:0/1536803765 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8b0011db0 con 0x7fc8b409d930 2023-09-30T22:29:30.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.368+0000 7fc8bbc29700 1 -- 172.21.15.59:0/1536803765 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7fc8b4124510 con 0x7fc8b409d930 2023-09-30T22:29:30.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.368+0000 7fc8aa7fc700 1 -- 172.21.15.59:0/1536803765 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v36) v1 ==== 59+0+37 (secure 0 0 0) 0x7fc8b0011350 con 0x7fc8b409d930 2023-09-30T22:29:30.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.371+0000 7fc8bbc29700 1 -- 172.21.15.59:0/1536803765 >> v1:172.21.15.59:6816/126772 conn(0x7fc89802f510 legacy=0x7fc8980319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.371+0000 7fc8bbc29700 1 -- 172.21.15.59:0/1536803765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d930 msgr2=0x7fc8b41231d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.371+0000 7fc8bbc29700 1 --2- 172.21.15.59:0/1536803765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d930 0x7fc8b41231d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000e9a0 tx=0x7fc8b000ecb0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.371+0000 7fc8bbc29700 1 -- 172.21.15.59:0/1536803765 shutdown_connections 2023-09-30T22:29:30.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.371+0000 7fc8bbc29700 1 --2- 172.21.15.59:0/1536803765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d930 0x7fc8b41231d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.371+0000 7fc8bbc29700 1 --2- 172.21.15.59:0/1536803765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4130f00 0x7fc8b41c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.371+0000 7fc8bbc29700 1 --2- 172.21.15.59:0/1536803765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b409e240 0x7fc8b4123710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.371+0000 7fc8bbc29700 1 -- 172.21.15.59:0/1536803765 >> 172.21.15.59:0/1536803765 conn(0x7fc8b4099c30 msgr2=0x7fc8b40a0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:30.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.371+0000 7fc8bbc29700 1 -- 172.21.15.59:0/1536803765 shutdown_connections 2023-09-30T22:29:30.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.371+0000 7fc8bbc29700 1 -- 172.21.15.59:0/1536803765 wait complete. 2023-09-30T22:29:30.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.490+0000 7f151c5dc700 1 Processor -- start 2023-09-30T22:29:30.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.490+0000 7f151c5dc700 1 -- start start 2023-09-30T22:29:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.491+0000 7f151c5dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f151409f4b0 0x7f15141369f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.491+0000 7f151c5dc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f151409f880 0x7f1514138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.491+0000 7f151c5dc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151409ab50 con 0x7f151409e9d0 2023-09-30T22:29:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.491+0000 7f151c5dc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15140a0140 con 0x7f151409f880 2023-09-30T22:29:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.491+0000 7f151c5dc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15140a0330 con 0x7f151409f4b0 2023-09-30T22:29:30.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.491+0000 7f151a378700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f151409e9d0 0x7f151409eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34376/0 (socket says 172.21.15.59:34376) 2023-09-30T22:29:30.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.491+0000 7f151a378700 1 -- 172.21.15.59:0/2378733959 learned_addr learned my addr 172.21.15.59:0/2378733959 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:30.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.491+0000 7f151ab79700 1 --2- 172.21.15.59:0/2378733959 >> v2:172.21.15.59:3300/0 conn(0x7f151409f880 0x7f1514138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:30.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.492+0000 7f1519b77700 1 --2- 172.21.15.59:0/2378733959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f151409f4b0 0x7f15141369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:30.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.492+0000 7f151ab79700 1 -- 172.21.15.59:0/2378733959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f151409f4b0 msgr2=0x7f15141369f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:30.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.492+0000 7f151ab79700 1 --2- 172.21.15.59:0/2378733959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f151409f4b0 0x7f15141369f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.492+0000 7f151ab79700 1 -- 172.21.15.59:0/2378733959 >> v1:172.21.15.59:6789/0 conn(0x7f151409e9d0 legacy=0x7f151409eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.492+0000 7f151ab79700 1 -- 172.21.15.59:0/2378733959 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151406ef60 con 0x7f151409f880 2023-09-30T22:29:30.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.492+0000 7f1519376700 1 -- 172.21.15.59:0/2378733959 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858358380 0 0) 0x7f151409ab50 con 0x7f151409e9d0 2023-09-30T22:29:30.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.492+0000 7f151ab79700 1 --2- 172.21.15.59:0/2378733959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f151409f880 0x7f1514138f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f150c009d90 tx=0x7f150c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb69bef8294ddf4c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:30.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.492+0000 7f1519376700 1 -- 172.21.15.59:0/2378733959 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c00e070 con 0x7f151409f880 2023-09-30T22:29:30.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.492+0000 7f1519376700 1 -- 172.21.15.59:0/2378733959 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c00bb20 con 0x7f151409f880 2023-09-30T22:29:30.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.492+0000 7f1519376700 1 -- 172.21.15.59:0/2378733959 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c012430 con 0x7f151409f880 2023-09-30T22:29:30.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.493+0000 7f151c5dc700 1 -- 172.21.15.59:0/2378733959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f151409f880 msgr2=0x7f1514138f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.493+0000 7f151c5dc700 1 --2- 172.21.15.59:0/2378733959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f151409f880 0x7f1514138f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f150c009d90 tx=0x7f150c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.493+0000 7f151c5dc700 1 -- 172.21.15.59:0/2378733959 shutdown_connections 2023-09-30T22:29:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.493+0000 7f151c5dc700 1 --2- 172.21.15.59:0/2378733959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f151409f880 0x7f1514138f40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.493+0000 7f151c5dc700 1 --2- 172.21.15.59:0/2378733959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f151409f4b0 0x7f15141369f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.493+0000 7f151c5dc700 1 -- 172.21.15.59:0/2378733959 >> 172.21.15.59:0/2378733959 conn(0x7f15140a43f0 msgr2=0x7f15140a47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.493+0000 7f151c5dc700 1 -- 172.21.15.59:0/2378733959 shutdown_connections 2023-09-30T22:29:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.493+0000 7f151c5dc700 1 -- 172.21.15.59:0/2378733959 wait complete. 2023-09-30T22:29:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.494+0000 7f151c5dc700 1 Processor -- start 2023-09-30T22:29:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.494+0000 7f151c5dc700 1 -- start start 2023-09-30T22:29:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.494+0000 7f151c5dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f151409e9d0 0x7f151406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:30.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.494+0000 7f151c5dc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f151409f4b0 0x7f151406cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.494+0000 7f151c5dc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f151409f880 0x7f151406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f151c5dc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1514138940 con 0x7f151409f4b0 2023-09-30T22:29:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f151c5dc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1514124a00 con 0x7f151409e9d0 2023-09-30T22:29:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f151c5dc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1514126040 con 0x7f151409f880 2023-09-30T22:29:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f151a378700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f151409e9d0 0x7f151406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f1519b77700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f151409f4b0 0x7f151406cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f151ab79700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f151409f880 0x7f151406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f1519b77700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f151409f4b0 0x7f151406cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52440/0 (socket says 172.21.15.59:52440) 2023-09-30T22:29:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f1519b77700 1 -- 172.21.15.59:0/418337153 learned_addr learned my addr 172.21.15.59:0/418337153 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f1519b77700 1 -- 172.21.15.59:0/418337153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f151409f880 msgr2=0x7f151406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f1519b77700 1 --2- 172.21.15.59:0/418337153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f151409f880 0x7f151406d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f1519b77700 1 -- 172.21.15.59:0/418337153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f151409e9d0 msgr2=0x7f151406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f1519b77700 1 --2- 172.21.15.59:0/418337153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f151409e9d0 0x7f151406c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f1519b77700 1 -- 172.21.15.59:0/418337153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c009a70 con 0x7f151409f4b0 2023-09-30T22:29:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f151a378700 1 --2- 172.21.15.59:0/418337153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f151409e9d0 0x7f151406c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f1519b77700 1 --2- 172.21.15.59:0/418337153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f151409f4b0 0x7f151406cee0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f150800e9b0 tx=0x7f150800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f1506ffd700 1 -- 172.21.15.59:0/418337153 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508009710 con 0x7f151409f4b0 2023-09-30T22:29:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f1506ffd700 1 -- 172.21.15.59:0/418337153 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150800ee50 con 0x7f151409f4b0 2023-09-30T22:29:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f151c5dc700 1 -- 172.21.15.59:0/418337153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1514125380 con 0x7f151409f4b0 2023-09-30T22:29:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f1506ffd700 1 -- 172.21.15.59:0/418337153 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150800ca50 con 0x7f151409f4b0 2023-09-30T22:29:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.495+0000 7f151c5dc700 1 -- 172.21.15.59:0/418337153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1514125d60 con 0x7f151409f4b0 2023-09-30T22:29:30.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.496+0000 7f1506ffd700 1 -- 172.21.15.59:0/418337153 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f150800cbb0 con 0x7f151409f4b0 2023-09-30T22:29:30.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.496+0000 7f1506ffd700 1 -- 172.21.15.59:0/418337153 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f150803fbe0 con 0x7f151409f4b0 2023-09-30T22:29:30.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.496+0000 7f151c5dc700 1 -- 172.21.15.59:0/418337153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151404f2a0 con 0x7f151409f4b0 2023-09-30T22:29:30.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.501+0000 7f1506ffd700 1 -- 172.21.15.59:0/418337153 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1508021020 con 0x7f151409f4b0 2023-09-30T22:29:30.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:30.706+0000 7f151c5dc700 1 -- 172.21.15.59:0/418337153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f151409a3a0 con 0x7f151409f4b0 2023-09-30T22:29:30.857 INFO:tasks.ceph.mgr.x.smithi059.stderr:terminate called after throwing an instance of 'ceph::buffer::v15_2_0::end_of_buffer' 2023-09-30T22:29:30.858 INFO:tasks.ceph.mgr.x.smithi059.stderr: what(): End of buffer [buffer:2] 2023-09-30T22:29:30.858 INFO:tasks.ceph.mgr.x.smithi059.stderr:*** Caught signal (Aborted) ** 2023-09-30T22:29:30.858 INFO:tasks.ceph.mgr.x.smithi059.stderr: in thread 7fbfcdee6700 thread_name:ms_dispatch 2023-09-30T22:29:30.858 INFO:tasks.ceph.mgr.x.smithi059.stderr: ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable) 2023-09-30T22:29:30.859 INFO:tasks.ceph.mgr.x.smithi059.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fc05b6a5cf0] 2023-09-30T22:29:30.859 INFO:tasks.ceph.mgr.x.smithi059.stderr: 2: gsignal() 2023-09-30T22:29:30.859 INFO:tasks.ceph.mgr.x.smithi059.stderr: 3: abort() 2023-09-30T22:29:30.859 INFO:tasks.ceph.mgr.x.smithi059.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7fc05a55509b] 2023-09-30T22:29:30.859 INFO:tasks.ceph.mgr.x.smithi059.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7fc05a55b53c] 2023-09-30T22:29:30.859 INFO:tasks.ceph.mgr.x.smithi059.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7fc05a55b597] 2023-09-30T22:29:30.859 INFO:tasks.ceph.mgr.x.smithi059.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7fc05a55b7f8] 2023-09-30T22:29:30.859 INFO:tasks.ceph.mgr.x.smithi059.stderr: 8: (ceph::buffer::v15_2_0::list::iterator_impl::copy(unsigned int, char*)+0xa5) [0x7fc05ca7db05] 2023-09-30T22:29:30.859 INFO:tasks.ceph.mgr.x.smithi059.stderr: 9: (SnapRealmInfo::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0x40) [0x7fc05c86eb60] 2023-09-30T22:29:30.859 INFO:tasks.ceph.mgr.x.smithi059.stderr: 10: /lib64/libcephfs.so.2(+0x62f7e) [0x7fc04767cf7e] 2023-09-30T22:29:30.859 INFO:tasks.ceph.mgr.x.smithi059.stderr: 11: /lib64/libcephfs.so.2(+0xbc051) [0x7fc0476d6051] 2023-09-30T22:29:30.859 INFO:tasks.ceph.mgr.x.smithi059.stderr: 12: /lib64/libcephfs.so.2(+0xbced8) [0x7fc0476d6ed8] 2023-09-30T22:29:30.860 INFO:tasks.ceph.mgr.x.smithi059.stderr: 13: /lib64/libcephfs.so.2(+0xe8af5) [0x7fc047702af5] 2023-09-30T22:29:30.860 INFO:tasks.ceph.mgr.x.smithi059.stderr: 14: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fc05c932208] 2023-09-30T22:29:30.860 INFO:tasks.ceph.mgr.x.smithi059.stderr: 15: (DispatchQueue::entry()+0x50f) [0x7fc05c92f3af] 2023-09-30T22:29:30.860 INFO:tasks.ceph.mgr.x.smithi059.stderr: 16: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc05c9f58f1] 2023-09-30T22:29:30.860 INFO:tasks.ceph.mgr.x.smithi059.stderr: 17: /lib64/libpthread.so.0(+0x81ca) [0x7fc05b69b1ca] 2023-09-30T22:29:30.860 INFO:tasks.ceph.mgr.x.smithi059.stderr: 18: clone() 2023-09-30T22:29:30.860 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-09-30T22:29:30.859+0000 7fbfcdee6700 -1 *** Caught signal (Aborted) ** 2023-09-30T22:29:30.860 INFO:tasks.ceph.mgr.x.smithi059.stderr: in thread 7fbfcdee6700 thread_name:ms_dispatch 2023-09-30T22:29:30.860 INFO:tasks.ceph.mgr.x.smithi059.stderr: 2023-09-30T22:29:30.860 INFO:tasks.ceph.mgr.x.smithi059.stderr: ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable) 2023-09-30T22:29:30.860 INFO:tasks.ceph.mgr.x.smithi059.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fc05b6a5cf0] 2023-09-30T22:29:30.861 INFO:tasks.ceph.mgr.x.smithi059.stderr: 2: gsignal() 2023-09-30T22:29:30.861 INFO:tasks.ceph.mgr.x.smithi059.stderr: 3: abort() 2023-09-30T22:29:30.861 INFO:tasks.ceph.mgr.x.smithi059.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7fc05a55509b] 2023-09-30T22:29:30.861 INFO:tasks.ceph.mgr.x.smithi059.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7fc05a55b53c] 2023-09-30T22:29:30.861 INFO:tasks.ceph.mgr.x.smithi059.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7fc05a55b597] 2023-09-30T22:29:30.861 INFO:tasks.ceph.mgr.x.smithi059.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7fc05a55b7f8] 2023-09-30T22:29:30.861 INFO:tasks.ceph.mgr.x.smithi059.stderr: 8: (ceph::buffer::v15_2_0::list::iterator_impl::copy(unsigned int, char*)+0xa5) [0x7fc05ca7db05] 2023-09-30T22:29:30.861 INFO:tasks.ceph.mgr.x.smithi059.stderr: 9: (SnapRealmInfo::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0x40) [0x7fc05c86eb60] 2023-09-30T22:29:30.861 INFO:tasks.ceph.mgr.x.smithi059.stderr: 10: /lib64/libcephfs.so.2(+0x62f7e) [0x7fc04767cf7e] 2023-09-30T22:29:30.861 INFO:tasks.ceph.mgr.x.smithi059.stderr: 11: /lib64/libcephfs.so.2(+0xbc051) [0x7fc0476d6051] 2023-09-30T22:29:30.861 INFO:tasks.ceph.mgr.x.smithi059.stderr: 12: /lib64/libcephfs.so.2(+0xbced8) [0x7fc0476d6ed8] 2023-09-30T22:29:30.861 INFO:tasks.ceph.mgr.x.smithi059.stderr: 13: /lib64/libcephfs.so.2(+0xe8af5) [0x7fc047702af5] 2023-09-30T22:29:30.862 INFO:tasks.ceph.mgr.x.smithi059.stderr: 14: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fc05c932208] 2023-09-30T22:29:30.862 INFO:tasks.ceph.mgr.x.smithi059.stderr: 15: (DispatchQueue::entry()+0x50f) [0x7fc05c92f3af] 2023-09-30T22:29:30.862 INFO:tasks.ceph.mgr.x.smithi059.stderr: 16: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc05c9f58f1] 2023-09-30T22:29:30.862 INFO:tasks.ceph.mgr.x.smithi059.stderr: 17: /lib64/libpthread.so.0(+0x81ca) [0x7fc05b69b1ca] 2023-09-30T22:29:30.862 INFO:tasks.ceph.mgr.x.smithi059.stderr: 18: clone() 2023-09-30T22:29:30.862 INFO:tasks.ceph.mgr.x.smithi059.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-09-30T22:29:30.862 INFO:tasks.ceph.mgr.x.smithi059.stderr: 2023-09-30T22:29:30.862 INFO:tasks.ceph.mgr.x.smithi059.stderr:terminate called recursively 2023-09-30T22:29:31.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.141+0000 7f151a378700 1 -- 172.21.15.59:0/418337153 >> v1:172.21.15.59:6816/126772 conn(0x7f14f802f510 legacy=0x7f14f80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-09-30T22:29:31.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.141+0000 7f151a378700 1 -- 172.21.15.59:0/418337153 >> v1:172.21.15.59:6816/126772 conn(0x7f14f802f510 legacy=0x7f14f80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-09-30T22:29:31.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.141+0000 7f151a378700 1 --1- 172.21.15.59:0/418337153 >> v1:172.21.15.59:6816/126772 conn(0x7f14f802f510 0x7f14f80319c0 :-1 s=OPENED pgs=57 cs=1 l=1).handle_message read tag failed 2023-09-30T22:29:31.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.141+0000 7f151a378700 1 --1- 172.21.15.59:0/418337153 >> v1:172.21.15.59:6816/126772 conn(0x7f14f802f510 0x7f14f80319c0 :-1 s=OPENED pgs=57 cs=1 l=1).fault on lossy channel, failing 2023-09-30T22:29:31.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.141+0000 7f1506ffd700 1 -- 172.21.15.59:0/418337153 >> v1:172.21.15.59:6816/126772 conn(0x7f14f802f510 legacy=0x7f14f80319c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-09-30T22:29:31.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.302+0000 7f1506ffd700 1 -- 172.21.15.59:0/418337153 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v37) v1 ==== 153+0+0 (secure 0 0 0) 0x7f15080232f0 con 0x7f151409f4b0 2023-09-30T22:29:31.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.306+0000 7f151c5dc700 1 -- 172.21.15.59:0/418337153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f151409f4b0 msgr2=0x7f151406cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.306+0000 7f151c5dc700 1 --2- 172.21.15.59:0/418337153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f151409f4b0 0x7f151406cee0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f150800e9b0 tx=0x7f150800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.306+0000 7f151c5dc700 1 -- 172.21.15.59:0/418337153 shutdown_connections 2023-09-30T22:29:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.306+0000 7f151c5dc700 1 --2- 172.21.15.59:0/418337153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f151409f880 0x7f151406d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.306+0000 7f151c5dc700 1 --2- 172.21.15.59:0/418337153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f151409e9d0 0x7f151406c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.306+0000 7f151c5dc700 1 --2- 172.21.15.59:0/418337153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f151409f4b0 0x7f151406cee0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.306+0000 7f151c5dc700 1 -- 172.21.15.59:0/418337153 >> 172.21.15.59:0/418337153 conn(0x7f15140a43f0 msgr2=0x7f15140a2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.306+0000 7f151c5dc700 1 -- 172.21.15.59:0/418337153 shutdown_connections 2023-09-30T22:29:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.306+0000 7f151c5dc700 1 -- 172.21.15.59:0/418337153 wait complete. 2023-09-30T22:29:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:set pool 1 pg_autoscale_mode to off 2023-09-30T22:29:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.430+0000 7fdea7655700 1 Processor -- start 2023-09-30T22:29:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.430+0000 7fdea7655700 1 -- start start 2023-09-30T22:29:31.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.431+0000 7fdea7655700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdea01347a0 0x7fdea0136b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.431+0000 7fdea7655700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdea01370c0 0x7fdea01394a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.431+0000 7fdea7655700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea0072860 con 0x7fdea009b2e0 2023-09-30T22:29:31.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.431+0000 7fdea7655700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea0098bc0 con 0x7fdea01370c0 2023-09-30T22:29:31.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.431+0000 7fdea7655700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdea009aeb0 con 0x7fdea01347a0 2023-09-30T22:29:31.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.431+0000 7fdea5bf2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdea01370c0 0x7fdea01394a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.431+0000 7fdea53f1700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdea009b2e0 0x7fdea009b6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34392/0 (socket says 172.21.15.59:34392) 2023-09-30T22:29:31.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.431+0000 7fdea53f1700 1 -- 172.21.15.59:0/2946875435 learned_addr learned my addr 172.21.15.59:0/2946875435 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:31.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.431+0000 7fdea4bf0700 1 --2- 172.21.15.59:0/2946875435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdea01347a0 0x7fdea0136b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.431+0000 7fdea4bf0700 1 -- 172.21.15.59:0/2946875435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdea01370c0 msgr2=0x7fdea01394a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:31.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.431+0000 7fdea4bf0700 1 --2- 172.21.15.59:0/2946875435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdea01370c0 0x7fdea01394a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.431+0000 7fdea4bf0700 1 -- 172.21.15.59:0/2946875435 >> v1:172.21.15.59:6789/0 conn(0x7fdea009b2e0 legacy=0x7fdea009b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.431+0000 7fdea4bf0700 1 -- 172.21.15.59:0/2946875435 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea00998a0 con 0x7fdea01347a0 2023-09-30T22:29:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.431+0000 7fdea5bf2700 1 --2- 172.21.15.59:0/2946875435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdea01370c0 0x7fdea01394a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.432+0000 7fdea4bf0700 1 --2- 172.21.15.59:0/2946875435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdea01347a0 0x7fdea0136b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde94009870 tx=0x7fde94009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9dab7ff05636821 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.432+0000 7fde93fff700 1 -- 172.21.15.59:0/2946875435 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94011830 con 0x7fdea01347a0 2023-09-30T22:29:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.432+0000 7fde93fff700 1 -- 172.21.15.59:0/2946875435 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde94011990 con 0x7fdea01347a0 2023-09-30T22:29:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.432+0000 7fde93fff700 1 -- 172.21.15.59:0/2946875435 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94011d20 con 0x7fdea01347a0 2023-09-30T22:29:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.432+0000 7fdea7655700 1 -- 172.21.15.59:0/2946875435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdea01347a0 msgr2=0x7fdea0136b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.432+0000 7fdea7655700 1 --2- 172.21.15.59:0/2946875435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdea01347a0 0x7fdea0136b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde94009870 tx=0x7fde94009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.432+0000 7fdea7655700 1 -- 172.21.15.59:0/2946875435 shutdown_connections 2023-09-30T22:29:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.432+0000 7fdea7655700 1 --2- 172.21.15.59:0/2946875435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdea01370c0 0x7fdea01394a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.432+0000 7fdea7655700 1 --2- 172.21.15.59:0/2946875435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdea01347a0 0x7fdea0136b80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.432+0000 7fdea7655700 1 -- 172.21.15.59:0/2946875435 >> 172.21.15.59:0/2946875435 conn(0x7fdea00a2fb0 msgr2=0x7fdea009eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.433+0000 7fdea7655700 1 -- 172.21.15.59:0/2946875435 shutdown_connections 2023-09-30T22:29:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.433+0000 7fdea7655700 1 -- 172.21.15.59:0/2946875435 wait complete. 2023-09-30T22:29:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea7655700 1 Processor -- start 2023-09-30T22:29:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea7655700 1 -- start start 2023-09-30T22:29:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea7655700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdea009b2e0 0x7fdea0128710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea7655700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdea01347a0 0x7fdea0128c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea7655700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdea01370c0 0x7fdea0129190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea7655700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea012cd40 con 0x7fdea01347a0 2023-09-30T22:29:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea7655700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea012bb20 con 0x7fdea01370c0 2023-09-30T22:29:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea7655700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdea0136b90 con 0x7fdea009b2e0 2023-09-30T22:29:31.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea53f1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdea009b2e0 0x7fdea0128710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea5bf2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdea01370c0 0x7fdea0129190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea53f1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdea009b2e0 0x7fdea0128710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42550/0 (socket says 172.21.15.59:42550) 2023-09-30T22:29:31.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea5bf2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdea01370c0 0x7fdea0129190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36542/0 (socket says 172.21.15.59:36542) 2023-09-30T22:29:31.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea53f1700 1 -- 172.21.15.59:0/4194742498 learned_addr learned my addr 172.21.15.59:0/4194742498 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:31.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea4bf0700 1 --2- 172.21.15.59:0/4194742498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdea01347a0 0x7fdea0128c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea53f1700 1 -- 172.21.15.59:0/4194742498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdea01370c0 msgr2=0x7fdea0129190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.434+0000 7fdea53f1700 1 --2- 172.21.15.59:0/4194742498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdea01370c0 0x7fdea0129190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.435+0000 7fdea53f1700 1 -- 172.21.15.59:0/4194742498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdea01347a0 msgr2=0x7fdea0128c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.435+0000 7fdea53f1700 1 --2- 172.21.15.59:0/4194742498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdea01347a0 0x7fdea0128c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.435+0000 7fdea53f1700 1 -- 172.21.15.59:0/4194742498 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98009a70 con 0x7fdea009b2e0 2023-09-30T22:29:31.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.435+0000 7fdea53f1700 1 --2- 172.21.15.59:0/4194742498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdea009b2e0 0x7fdea0128710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00c520 tx=0x7fde9c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:31.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.435+0000 7fde91ffb700 1 -- 172.21.15.59:0/4194742498 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c005d70 con 0x7fdea009b2e0 2023-09-30T22:29:31.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.435+0000 7fde91ffb700 1 -- 172.21.15.59:0/4194742498 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c0070d0 con 0x7fdea009b2e0 2023-09-30T22:29:31.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.435+0000 7fdea7655700 1 -- 172.21.15.59:0/4194742498 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde940094a0 con 0x7fdea009b2e0 2023-09-30T22:29:31.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.435+0000 7fde91ffb700 1 -- 172.21.15.59:0/4194742498 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c007440 con 0x7fdea009b2e0 2023-09-30T22:29:31.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.435+0000 7fdea7655700 1 -- 172.21.15.59:0/4194742498 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea012bde0 con 0x7fdea009b2e0 2023-09-30T22:29:31.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.436+0000 7fde91ffb700 1 -- 172.21.15.59:0/4194742498 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fde9c0075a0 con 0x7fdea009b2e0 2023-09-30T22:29:31.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.436+0000 7fde91ffb700 1 -- 172.21.15.59:0/4194742498 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fde9c03f0b0 con 0x7fdea009b2e0 2023-09-30T22:29:31.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.436+0000 7fdea4bf0700 1 -- 172.21.15.59:0/4194742498 >> v1:172.21.15.59:6816/126772 conn(0x7fde8402f510 legacy=0x7fde840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:31.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.436+0000 7fdea7655700 1 -- 172.21.15.59:0/4194742498 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea009a6e0 con 0x7fdea009b2e0 2023-09-30T22:29:31.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.441+0000 7fde91ffb700 1 -- 172.21.15.59:0/4194742498 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde9c017080 con 0x7fdea009b2e0 2023-09-30T22:29:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.637+0000 7fdea4bf0700 1 -- 172.21.15.59:0/4194742498 >> v1:172.21.15.59:6816/126772 conn(0x7fde8402f510 legacy=0x7fde840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:31.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:31.645+0000 7fdea7655700 1 -- 172.21.15.59:0/4194742498 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fdea004f2a0 con 0x7fdea009b2e0 2023-09-30T22:29:32.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.038+0000 7fdea4bf0700 1 -- 172.21.15.59:0/4194742498 >> v1:172.21.15.59:6816/126772 conn(0x7fde8402f510 legacy=0x7fde840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:32.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.317+0000 7fde91ffb700 1 -- 172.21.15.59:0/4194742498 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v38) v1 ==== 152+0+0 (secure 0 0 0) 0x7fde9c019d20 con 0x7fdea009b2e0 2023-09-30T22:29:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.321+0000 7fdea7655700 1 -- 172.21.15.59:0/4194742498 >> v1:172.21.15.59:6816/126772 conn(0x7fde8402f510 legacy=0x7fde840319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.321+0000 7fdea7655700 1 -- 172.21.15.59:0/4194742498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdea009b2e0 msgr2=0x7fdea0128710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.321+0000 7fdea7655700 1 --2- 172.21.15.59:0/4194742498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdea009b2e0 0x7fdea0128710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00c520 tx=0x7fde9c00c830 comp rx=0 tx=0).stop 2023-09-30T22:29:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.321+0000 7fdea7655700 1 -- 172.21.15.59:0/4194742498 shutdown_connections 2023-09-30T22:29:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.321+0000 7fdea7655700 1 --2- 172.21.15.59:0/4194742498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdea009b2e0 0x7fdea0128710 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.321+0000 7fdea7655700 1 --2- 172.21.15.59:0/4194742498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdea01370c0 0x7fdea0129190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.321+0000 7fdea7655700 1 --2- 172.21.15.59:0/4194742498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdea01347a0 0x7fdea0128c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.321+0000 7fdea7655700 1 -- 172.21.15.59:0/4194742498 >> 172.21.15.59:0/4194742498 conn(0x7fdea00a2fb0 msgr2=0x7fdea01bc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:32.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.322+0000 7fdea7655700 1 -- 172.21.15.59:0/4194742498 shutdown_connections 2023-09-30T22:29:32.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.322+0000 7fdea7655700 1 -- 172.21.15.59:0/4194742498 wait complete. 2023-09-30T22:29:32.323 INFO:teuthology.orchestra.run.smithi059.stderr:set pool 2 pg_autoscale_mode to off 2023-09-30T22:29:32.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.446+0000 7f9b3bb5e700 1 Processor -- start 2023-09-30T22:29:32.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.446+0000 7f9b3bb5e700 1 -- start start 2023-09-30T22:29:32.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.446+0000 7f9b3bb5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b3409d930 0x7f9b3409dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.446+0000 7f9b3bb5e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b3409e240 0x7f9b34137c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.446+0000 7f9b3bb5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b34138150 0x7f9b3413a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.446+0000 7f9b3bb5e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3409ef00 con 0x7f9b3409e240 2023-09-30T22:29:32.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b3bb5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3409a6b0 con 0x7f9b34138150 2023-09-30T22:29:32.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b3bb5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3409f130 con 0x7f9b3409d930 2023-09-30T22:29:32.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b398fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b3409d930 0x7f9b3409dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b3a0fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b34138150 0x7f9b3413a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b390f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b3409e240 0x7f9b34137c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b3a0fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b34138150 0x7f9b3413a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36546/0 (socket says 172.21.15.59:36546) 2023-09-30T22:29:32.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b398fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b3409d930 0x7f9b3409dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42566/0 (socket says 172.21.15.59:42566) 2023-09-30T22:29:32.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b3a0fb700 1 -- 172.21.15.59:0/1200014360 learned_addr learned my addr 172.21.15.59:0/1200014360 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:32.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b3a0fb700 1 -- 172.21.15.59:0/1200014360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b3409d930 msgr2=0x7f9b3409dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:32.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b3a0fb700 1 --2- 172.21.15.59:0/1200014360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b3409d930 0x7f9b3409dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b3a0fb700 1 -- 172.21.15.59:0/1200014360 >> v2:172.21.15.59:3300/0 conn(0x7f9b3409e240 msgr2=0x7f9b34137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:32.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b3a0fb700 1 --2- 172.21.15.59:0/1200014360 >> v2:172.21.15.59:3300/0 conn(0x7f9b3409e240 0x7f9b34137c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b3a0fb700 1 -- 172.21.15.59:0/1200014360 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3406b0a0 con 0x7f9b34138150 2023-09-30T22:29:32.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b398fa700 1 --2- 172.21.15.59:0/1200014360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b3409d930 0x7f9b3409dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:32.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b390f9700 1 --2- 172.21.15.59:0/1200014360 >> v2:172.21.15.59:3300/0 conn(0x7f9b3409e240 0x7f9b34137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:32.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b3a0fb700 1 --2- 172.21.15.59:0/1200014360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b34138150 0x7f9b3413a530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009e50 tx=0x7f9b2c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aba4359aa4ffa17 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:32.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b388f8700 1 -- 172.21.15.59:0/1200014360 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c00e070 con 0x7f9b34138150 2023-09-30T22:29:32.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b388f8700 1 -- 172.21.15.59:0/1200014360 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c00b910 con 0x7f9b34138150 2023-09-30T22:29:32.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.447+0000 7f9b388f8700 1 -- 172.21.15.59:0/1200014360 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c00bcc0 con 0x7f9b34138150 2023-09-30T22:29:32.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.448+0000 7f9b3bb5e700 1 -- 172.21.15.59:0/1200014360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b34138150 msgr2=0x7f9b3413a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.448+0000 7f9b3bb5e700 1 --2- 172.21.15.59:0/1200014360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b34138150 0x7f9b3413a530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009e50 tx=0x7f9b2c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:32.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.448+0000 7f9b3bb5e700 1 -- 172.21.15.59:0/1200014360 shutdown_connections 2023-09-30T22:29:32.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.448+0000 7f9b3bb5e700 1 --2- 172.21.15.59:0/1200014360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b34138150 0x7f9b3413a530 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.448+0000 7f9b3bb5e700 1 --2- 172.21.15.59:0/1200014360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b3409d930 0x7f9b3409dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.448+0000 7f9b3bb5e700 1 --2- 172.21.15.59:0/1200014360 >> v2:172.21.15.59:3300/0 conn(0x7f9b3409e240 0x7f9b34137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.448+0000 7f9b3bb5e700 1 -- 172.21.15.59:0/1200014360 >> 172.21.15.59:0/1200014360 conn(0x7f9b34099c30 msgr2=0x7f9b340a3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:32.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.448+0000 7f9b3bb5e700 1 -- 172.21.15.59:0/1200014360 shutdown_connections 2023-09-30T22:29:32.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.448+0000 7f9b3bb5e700 1 -- 172.21.15.59:0/1200014360 wait complete. 2023-09-30T22:29:32.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.449+0000 7f9b3bb5e700 1 Processor -- start 2023-09-30T22:29:32.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.449+0000 7f9b3bb5e700 1 -- start start 2023-09-30T22:29:32.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b3bb5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b3409d930 0x7f9b3411f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b3bb5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b3409e240 0x7f9b3411fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b3bb5e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b34138150 0x7f9b341201c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b3bb5e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b34123260 con 0x7f9b34138150 2023-09-30T22:29:32.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b3bb5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b34121970 con 0x7f9b3409d930 2023-09-30T22:29:32.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b3bb5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3409c7a0 con 0x7f9b3409e240 2023-09-30T22:29:32.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b398fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b3409d930 0x7f9b3411f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b3a0fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b34138150 0x7f9b341201c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b398fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b3409d930 0x7f9b3411f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36564/0 (socket says 172.21.15.59:36564) 2023-09-30T22:29:32.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b390f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b3409e240 0x7f9b3411fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b398fa700 1 -- 172.21.15.59:0/748269178 learned_addr learned my addr 172.21.15.59:0/748269178 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:32.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b390f9700 1 -- 172.21.15.59:0/748269178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b3409d930 msgr2=0x7f9b3411f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b390f9700 1 --2- 172.21.15.59:0/748269178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b3409d930 0x7f9b3411f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b390f9700 1 -- 172.21.15.59:0/748269178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b34138150 msgr2=0x7f9b341201c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b390f9700 1 --2- 172.21.15.59:0/748269178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b34138150 0x7f9b341201c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b390f9700 1 -- 172.21.15.59:0/748269178 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b300094a0 con 0x7f9b3409e240 2023-09-30T22:29:32.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b398fa700 1 --2- 172.21.15.59:0/748269178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b3409d930 0x7f9b3411f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:32.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b390f9700 1 --2- 172.21.15.59:0/748269178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b3409e240 0x7f9b3411fc80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400e980 tx=0x7f9b2400ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:32.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.450+0000 7f9b2a7fc700 1 -- 172.21.15.59:0/748269178 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2400c690 con 0x7f9b3409e240 2023-09-30T22:29:32.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.451+0000 7f9b2a7fc700 1 -- 172.21.15.59:0/748269178 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2400c7f0 con 0x7f9b3409e240 2023-09-30T22:29:32.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.451+0000 7f9b3bb5e700 1 -- 172.21.15.59:0/748269178 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b240094a0 con 0x7f9b3409e240 2023-09-30T22:29:32.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.451+0000 7f9b2a7fc700 1 -- 172.21.15.59:0/748269178 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2400cb80 con 0x7f9b3409e240 2023-09-30T22:29:32.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.451+0000 7f9b3bb5e700 1 -- 172.21.15.59:0/748269178 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2c009b30 con 0x7f9b3409e240 2023-09-30T22:29:32.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.451+0000 7f9b2a7fc700 1 -- 172.21.15.59:0/748269178 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9b2400cce0 con 0x7f9b3409e240 2023-09-30T22:29:32.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.452+0000 7f9b398fa700 1 -- 172.21.15.59:0/748269178 >> v1:172.21.15.59:6816/126772 conn(0x7f9b1802f510 legacy=0x7f9b180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:32.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.452+0000 7f9b2a7fc700 1 -- 172.21.15.59:0/748269178 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f9b2403fcd0 con 0x7f9b3409e240 2023-09-30T22:29:32.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.452+0000 7f9b3bb5e700 1 -- 172.21.15.59:0/748269178 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b34134760 con 0x7f9b3409e240 2023-09-30T22:29:32.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.457+0000 7f9b2a7fc700 1 -- 172.21.15.59:0/748269178 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b24017020 con 0x7f9b3409e240 2023-09-30T22:29:32.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.653+0000 7f9b398fa700 1 -- 172.21.15.59:0/748269178 >> v1:172.21.15.59:6816/126772 conn(0x7f9b1802f510 legacy=0x7f9b180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:32.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:32.662+0000 7f9b3bb5e700 1 -- 172.21.15.59:0/748269178 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f9b3404f2a0 con 0x7f9b3409e240 2023-09-30T22:29:33.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.054+0000 7f9b398fa700 1 -- 172.21.15.59:0/748269178 >> v1:172.21.15.59:6816/126772 conn(0x7f9b1802f510 legacy=0x7f9b180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:33.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.333+0000 7f9b2a7fc700 1 -- 172.21.15.59:0/748269178 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v39) v1 ==== 164+0+0 (secure 0 0 0) 0x7f9b2401b3b0 con 0x7f9b3409e240 2023-09-30T22:29:33.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.336+0000 7f9b3bb5e700 1 -- 172.21.15.59:0/748269178 >> v1:172.21.15.59:6816/126772 conn(0x7f9b1802f510 legacy=0x7f9b180319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:33.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.336+0000 7f9b3bb5e700 1 -- 172.21.15.59:0/748269178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b3409e240 msgr2=0x7f9b3411fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:33.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.336+0000 7f9b3bb5e700 1 --2- 172.21.15.59:0/748269178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b3409e240 0x7f9b3411fc80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400e980 tx=0x7f9b2400ec90 comp rx=0 tx=0).stop 2023-09-30T22:29:33.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.336+0000 7f9b3bb5e700 1 -- 172.21.15.59:0/748269178 shutdown_connections 2023-09-30T22:29:33.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.336+0000 7f9b3bb5e700 1 --2- 172.21.15.59:0/748269178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b34138150 0x7f9b341201c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:33.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.336+0000 7f9b3bb5e700 1 --2- 172.21.15.59:0/748269178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b3409d930 0x7f9b3411f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:33.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.336+0000 7f9b3bb5e700 1 --2- 172.21.15.59:0/748269178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b3409e240 0x7f9b3411fc80 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400e980 tx=0x7f9b2400ec90 comp rx=0 tx=0).stop 2023-09-30T22:29:33.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.336+0000 7f9b3bb5e700 1 -- 172.21.15.59:0/748269178 >> 172.21.15.59:0/748269178 conn(0x7f9b34099c30 msgr2=0x7f9b340a0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:33.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.337+0000 7f9b3bb5e700 1 -- 172.21.15.59:0/748269178 shutdown_connections 2023-09-30T22:29:33.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.337+0000 7f9b3bb5e700 1 -- 172.21.15.59:0/748269178 wait complete. 2023-09-30T22:29:33.338 INFO:teuthology.orchestra.run.smithi059.stderr:set pool 3 pg_autoscale_mode to off 2023-09-30T22:29:33.458 INFO:tasks.ceph.mgr.x.smithi059.stderr:daemon-helper: command crashed with signal 6 2023-09-30T22:29:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.462+0000 7f3ff4baf700 1 Processor -- start 2023-09-30T22:29:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.462+0000 7f3ff4baf700 1 -- start start 2023-09-30T22:29:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3ff4baf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3ff009d950 0x7f3ff009dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3ff4baf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ff009e260 0x7f3ff0130780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3ff4baf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ff0130cc0 0x7f3ff0131120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3ff4baf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff009f510 con 0x7f3ff009d950 2023-09-30T22:29:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3ff4baf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff009bd00 con 0x7f3ff009e260 2023-09-30T22:29:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3ff4baf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff009a350 con 0x7f3ff0130cc0 2023-09-30T22:29:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3fedd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ff009e260 0x7f3ff0130780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3fee59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3ff009d950 0x7f3ff009dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3fedd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ff009e260 0x7f3ff0130780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36576/0 (socket says 172.21.15.59:36576) 2023-09-30T22:29:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3fedd9b700 1 -- 172.21.15.59:0/2632151836 learned_addr learned my addr 172.21.15.59:0/2632151836 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3feed9d700 1 --2- 172.21.15.59:0/2632151836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ff0130cc0 0x7f3ff0131120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3fee59c700 1 -- 172.21.15.59:0/2632151836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ff0130cc0 msgr2=0x7f3ff0131120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3fee59c700 1 --2- 172.21.15.59:0/2632151836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ff0130cc0 0x7f3ff0131120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3fee59c700 1 -- 172.21.15.59:0/2632151836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ff009e260 msgr2=0x7f3ff0130780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:33.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3fee59c700 1 --2- 172.21.15.59:0/2632151836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ff009e260 0x7f3ff0130780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:33.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3fee59c700 1 -- 172.21.15.59:0/2632151836 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff009ac70 con 0x7f3ff009d950 2023-09-30T22:29:33.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3feed9d700 1 --2- 172.21.15.59:0/2632151836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ff0130cc0 0x7f3ff0131120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:33.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3fedd9b700 1 --2- 172.21.15.59:0/2632151836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ff009e260 0x7f3ff0130780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:33.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.463+0000 7f3fee59c700 1 --2- 172.21.15.59:0/2632151836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff009d950 0x7f3ff009dd20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000bac0 tx=0x7f3fe000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eca570751075616 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:33.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.464+0000 7f3fed59a700 1 -- 172.21.15.59:0/2632151836 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0005e30 con 0x7f3ff009d950 2023-09-30T22:29:33.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.464+0000 7f3fed59a700 1 -- 172.21.15.59:0/2632151836 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe000d860 con 0x7f3ff009d950 2023-09-30T22:29:33.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.464+0000 7f3fed59a700 1 -- 172.21.15.59:0/2632151836 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe000dbf0 con 0x7f3ff009d950 2023-09-30T22:29:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.464+0000 7f3ff4baf700 1 -- 172.21.15.59:0/2632151836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff009d950 msgr2=0x7f3ff009dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.464+0000 7f3ff4baf700 1 --2- 172.21.15.59:0/2632151836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff009d950 0x7f3ff009dd20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000bac0 tx=0x7f3fe000bdd0 comp rx=0 tx=0).stop 2023-09-30T22:29:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.464+0000 7f3ff4baf700 1 -- 172.21.15.59:0/2632151836 shutdown_connections 2023-09-30T22:29:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.464+0000 7f3ff4baf700 1 --2- 172.21.15.59:0/2632151836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ff0130cc0 0x7f3ff0131120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.464+0000 7f3ff4baf700 1 --2- 172.21.15.59:0/2632151836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff009d950 0x7f3ff009dd20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.464+0000 7f3ff4baf700 1 --2- 172.21.15.59:0/2632151836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ff009e260 0x7f3ff0130780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.464+0000 7f3ff4baf700 1 -- 172.21.15.59:0/2632151836 >> 172.21.15.59:0/2632151836 conn(0x7f3ff00a2f50 msgr2=0x7f3ff00a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.465+0000 7f3ff4baf700 1 -- 172.21.15.59:0/2632151836 shutdown_connections 2023-09-30T22:29:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.465+0000 7f3ff4baf700 1 -- 172.21.15.59:0/2632151836 wait complete. 2023-09-30T22:29:33.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.466+0000 7f3ff4baf700 1 Processor -- start 2023-09-30T22:29:33.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.466+0000 7f3ff4baf700 1 -- start start 2023-09-30T22:29:33.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.467+0000 7f3ff4baf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ff009d950 0x7f3ff011e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:33.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.467+0000 7f3ff4baf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ff009e260 0x7f3ff011e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:33.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.467+0000 7f3ff4baf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0130cc0 0x7f3ff011eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:33.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.467+0000 7f3ff4baf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff011fbf0 con 0x7f3ff0130cc0 2023-09-30T22:29:33.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.467+0000 7f3ff4baf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff0120e40 con 0x7f3ff009e260 2023-09-30T22:29:33.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.467+0000 7f3ff4baf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff01201d0 con 0x7f3ff009d950 2023-09-30T22:29:33.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.467+0000 7f3feed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0130cc0 0x7f3ff011eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:33.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.467+0000 7f3fedd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ff009e260 0x7f3ff011e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:33.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.467+0000 7f3fee59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ff009d950 0x7f3ff011e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:33.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.467+0000 7f3fedd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ff009e260 0x7f3ff011e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36584/0 (socket says 172.21.15.59:36584) 2023-09-30T22:29:33.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.467+0000 7f3feed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0130cc0 0x7f3ff011eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52478/0 (socket says 172.21.15.59:52478) 2023-09-30T22:29:33.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.467+0000 7f3fedd9b700 1 -- 172.21.15.59:0/1804342168 learned_addr learned my addr 172.21.15.59:0/1804342168 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:33.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.468+0000 7f3fedd9b700 1 -- 172.21.15.59:0/1804342168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ff009d950 msgr2=0x7f3ff011e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:33.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.468+0000 7f3fedd9b700 1 --2- 172.21.15.59:0/1804342168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ff009d950 0x7f3ff011e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:33.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.468+0000 7f3fedd9b700 1 -- 172.21.15.59:0/1804342168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0130cc0 msgr2=0x7f3ff011eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:33.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.468+0000 7f3fedd9b700 1 --2- 172.21.15.59:0/1804342168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0130cc0 0x7f3ff011eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:33.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.468+0000 7f3fedd9b700 1 -- 172.21.15.59:0/1804342168 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe4009500 con 0x7f3ff009e260 2023-09-30T22:29:33.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.468+0000 7f3feed9d700 1 --2- 172.21.15.59:0/1804342168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0130cc0 0x7f3ff011eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:33.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.468+0000 7f3fee59c700 1 --2- 172.21.15.59:0/1804342168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ff009d950 0x7f3ff011e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:33.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.468+0000 7f3fedd9b700 1 --2- 172.21.15.59:0/1804342168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ff009e260 0x7f3ff011e5b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400ebe0 tx=0x7f3fe400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:33.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.468+0000 7f3fdeffd700 1 -- 172.21.15.59:0/1804342168 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4009830 con 0x7f3ff009e260 2023-09-30T22:29:33.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.468+0000 7f3fdeffd700 1 -- 172.21.15.59:0/1804342168 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe4005a20 con 0x7f3ff009e260 2023-09-30T22:29:33.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.468+0000 7f3ff4baf700 1 -- 172.21.15.59:0/1804342168 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe8009a70 con 0x7f3ff009e260 2023-09-30T22:29:33.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.468+0000 7f3fdeffd700 1 -- 172.21.15.59:0/1804342168 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4005db0 con 0x7f3ff009e260 2023-09-30T22:29:33.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.468+0000 7f3ff4baf700 1 -- 172.21.15.59:0/1804342168 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe000b6d0 con 0x7f3ff009e260 2023-09-30T22:29:33.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.469+0000 7f3fdeffd700 1 -- 172.21.15.59:0/1804342168 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3fe400c7f0 con 0x7f3ff009e260 2023-09-30T22:29:33.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.469+0000 7f3fee59c700 1 -- 172.21.15.59:0/1804342168 >> v1:172.21.15.59:6816/126772 conn(0x7f3fd002f540 legacy=0x7f3fd00319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:33.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.469+0000 7f3fdeffd700 1 -- 172.21.15.59:0/1804342168 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f3fe403ff50 con 0x7f3ff009e260 2023-09-30T22:29:33.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.469+0000 7f3ff4baf700 1 -- 172.21.15.59:0/1804342168 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff011ad40 con 0x7f3ff009e260 2023-09-30T22:29:33.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.474+0000 7f3fdeffd700 1 -- 172.21.15.59:0/1804342168 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fe4006030 con 0x7f3ff009e260 2023-09-30T22:29:33.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.670+0000 7f3fee59c700 1 -- 172.21.15.59:0/1804342168 >> v1:172.21.15.59:6816/126772 conn(0x7f3fd002f540 legacy=0x7f3fd00319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:33.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:33.678+0000 7f3ff4baf700 1 -- 172.21.15.59:0/1804342168 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f3ff009cb00 con 0x7f3ff009e260 2023-09-30T22:29:34.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.071+0000 7f3fee59c700 1 -- 172.21.15.59:0/1804342168 >> v1:172.21.15.59:6816/126772 conn(0x7f3fd002f540 legacy=0x7f3fd00319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:34.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.334+0000 7f3fdeffd700 1 -- 172.21.15.59:0/1804342168 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v40) v1 ==== 160+0+0 (secure 0 0 0) 0x7f3fe402a0c0 con 0x7f3ff009e260 2023-09-30T22:29:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.339+0000 7f3ff4baf700 1 -- 172.21.15.59:0/1804342168 >> v1:172.21.15.59:6816/126772 conn(0x7f3fd002f540 legacy=0x7f3fd00319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.339+0000 7f3ff4baf700 1 -- 172.21.15.59:0/1804342168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ff009e260 msgr2=0x7f3ff011e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.339+0000 7f3ff4baf700 1 --2- 172.21.15.59:0/1804342168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ff009e260 0x7f3ff011e5b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400ebe0 tx=0x7f3fe400eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.339+0000 7f3ff4baf700 1 -- 172.21.15.59:0/1804342168 shutdown_connections 2023-09-30T22:29:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.339+0000 7f3ff4baf700 1 --2- 172.21.15.59:0/1804342168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ff009d950 0x7f3ff011e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.339+0000 7f3ff4baf700 1 --2- 172.21.15.59:0/1804342168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0130cc0 0x7f3ff011eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.339+0000 7f3ff4baf700 1 --2- 172.21.15.59:0/1804342168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ff009e260 0x7f3ff011e5b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.339+0000 7f3ff4baf700 1 -- 172.21.15.59:0/1804342168 >> 172.21.15.59:0/1804342168 conn(0x7f3ff00a2f50 msgr2=0x7f3ff0070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.340+0000 7f3ff4baf700 1 -- 172.21.15.59:0/1804342168 shutdown_connections 2023-09-30T22:29:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.340+0000 7f3ff4baf700 1 -- 172.21.15.59:0/1804342168 wait complete. 2023-09-30T22:29:34.341 INFO:teuthology.orchestra.run.smithi059.stderr:set pool 4 pg_autoscale_mode to off 2023-09-30T22:29:34.355 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release reef' 2023-09-30T22:29:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.538+0000 7f45e67d7700 1 Processor -- start 2023-09-30T22:29:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.538+0000 7f45e67d7700 1 -- start start 2023-09-30T22:29:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45e67d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e0133ac0 0x7f45e0133e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45e67d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e01343d0 0x7f45e009d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45e67d7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45e009d980 0x7f45e009de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45e67d7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e01338c0 con 0x7f45e009d980 2023-09-30T22:29:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45e67d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0099dd0 con 0x7f45e0133ac0 2023-09-30T22:29:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45e67d7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45e009a200 con 0x7f45e01343d0 2023-09-30T22:29:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45df7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e01343d0 0x7f45e009d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45e4d74700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45e009d980 0x7f45e009de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45dffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e0133ac0 0x7f45e0133e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45e4d74700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45e009d980 0x7f45e009de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56884/0 (socket says 172.21.15.59:56884) 2023-09-30T22:29:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45dffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e0133ac0 0x7f45e0133e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38688/0 (socket says 172.21.15.59:38688) 2023-09-30T22:29:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45df7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e01343d0 0x7f45e009d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36366/0 (socket says 172.21.15.59:36366) 2023-09-30T22:29:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45e4d74700 1 -- 172.21.15.59:0/1001466060 learned_addr learned my addr 172.21.15.59:0/1001466060 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:34.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45dffff700 1 -- 172.21.15.59:0/1001466060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e01343d0 msgr2=0x7f45e009d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:34.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45dffff700 1 --2- 172.21.15.59:0/1001466060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e01343d0 0x7f45e009d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45dffff700 1 -- 172.21.15.59:0/1001466060 >> v2:172.21.15.59:3300/0 conn(0x7f45e009d980 msgr2=0x7f45e009de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:34.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.539+0000 7f45dffff700 1 --2- 172.21.15.59:0/1001466060 >> v2:172.21.15.59:3300/0 conn(0x7f45e009d980 0x7f45e009de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.540+0000 7f45dffff700 1 -- 172.21.15.59:0/1001466060 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e009ef20 con 0x7f45e0133ac0 2023-09-30T22:29:34.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.540+0000 7f45e4d74700 1 --2- 172.21.15.59:0/1001466060 >> v2:172.21.15.59:3300/0 conn(0x7f45e009d980 0x7f45e009de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:34.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.540+0000 7f45df7fe700 1 --2- 172.21.15.59:0/1001466060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e01343d0 0x7f45e009d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:34.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.540+0000 7f45dffff700 1 --2- 172.21.15.59:0/1001466060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e0133ac0 0x7f45e0133e90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009840 tx=0x7f45d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a7220790b9baac1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:34.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.540+0000 7f45deffd700 1 -- 172.21.15.59:0/1001466060 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0011830 con 0x7f45e0133ac0 2023-09-30T22:29:34.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.540+0000 7f45deffd700 1 -- 172.21.15.59:0/1001466060 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d0011990 con 0x7f45e0133ac0 2023-09-30T22:29:34.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.540+0000 7f45deffd700 1 -- 172.21.15.59:0/1001466060 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0011d20 con 0x7f45e0133ac0 2023-09-30T22:29:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.540+0000 7f45e67d7700 1 -- 172.21.15.59:0/1001466060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e0133ac0 msgr2=0x7f45e0133e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.540+0000 7f45e67d7700 1 --2- 172.21.15.59:0/1001466060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e0133ac0 0x7f45e0133e90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009840 tx=0x7f45d0009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.541+0000 7f45e67d7700 1 -- 172.21.15.59:0/1001466060 shutdown_connections 2023-09-30T22:29:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.541+0000 7f45e67d7700 1 --2- 172.21.15.59:0/1001466060 >> v2:172.21.15.59:3300/0 conn(0x7f45e009d980 0x7f45e009de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.541+0000 7f45e67d7700 1 --2- 172.21.15.59:0/1001466060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e0133ac0 0x7f45e0133e90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.541+0000 7f45e67d7700 1 --2- 172.21.15.59:0/1001466060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e01343d0 0x7f45e009d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.541+0000 7f45e67d7700 1 -- 172.21.15.59:0/1001466060 >> 172.21.15.59:0/1001466060 conn(0x7f45e00a29e0 msgr2=0x7f45e00a2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:34.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.541+0000 7f45e67d7700 1 -- 172.21.15.59:0/1001466060 shutdown_connections 2023-09-30T22:29:34.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.541+0000 7f45e67d7700 1 -- 172.21.15.59:0/1001466060 wait complete. 2023-09-30T22:29:34.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.542+0000 7f45e67d7700 1 Processor -- start 2023-09-30T22:29:34.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.542+0000 7f45e67d7700 1 -- start start 2023-09-30T22:29:34.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.542+0000 7f45e67d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e009d980 0x7f45e011cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.542+0000 7f45e67d7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e0133ac0 0x7f45e011d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.542+0000 7f45e67d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e01343d0 0x7f45e011d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.542+0000 7f45e67d7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e012e030 con 0x7f45e0133ac0 2023-09-30T22:29:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.542+0000 7f45e67d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e011f940 con 0x7f45e01343d0 2023-09-30T22:29:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.542+0000 7f45e67d7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45e011f580 con 0x7f45e009d980 2023-09-30T22:29:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.542+0000 7f45e4d74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e01343d0 0x7f45e011d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.542+0000 7f45df7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e0133ac0 0x7f45e011d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.542+0000 7f45e4d74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e01343d0 0x7f45e011d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38700/0 (socket says 172.21.15.59:38700) 2023-09-30T22:29:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.542+0000 7f45e4d74700 1 -- 172.21.15.59:0/3006602832 learned_addr learned my addr 172.21.15.59:0/3006602832 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.542+0000 7f45dffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e009d980 0x7f45e011cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.543+0000 7f45df7fe700 1 -- 172.21.15.59:0/3006602832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e009d980 msgr2=0x7f45e011cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.543+0000 7f45df7fe700 1 --2- 172.21.15.59:0/3006602832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e009d980 0x7f45e011cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.543+0000 7f45df7fe700 1 -- 172.21.15.59:0/3006602832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e01343d0 msgr2=0x7f45e011d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.543+0000 7f45df7fe700 1 --2- 172.21.15.59:0/3006602832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e01343d0 0x7f45e011d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.543+0000 7f45df7fe700 1 -- 172.21.15.59:0/3006602832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d8009b30 con 0x7f45e0133ac0 2023-09-30T22:29:34.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.543+0000 7f45dffff700 1 --2- 172.21.15.59:0/3006602832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e009d980 0x7f45e011cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:34.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.543+0000 7f45e4d74700 1 --2- 172.21.15.59:0/3006602832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e01343d0 0x7f45e011d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:34.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.543+0000 7f45df7fe700 1 --2- 172.21.15.59:0/3006602832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e0133ac0 0x7f45e011d0b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f45e009b010 tx=0x7f45d400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:34.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.543+0000 7f45dcff9700 1 -- 172.21.15.59:0/3006602832 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d400c640 con 0x7f45e0133ac0 2023-09-30T22:29:34.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.543+0000 7f45dcff9700 1 -- 172.21.15.59:0/3006602832 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d400c7a0 con 0x7f45e0133ac0 2023-09-30T22:29:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.543+0000 7f45e67d7700 1 -- 172.21.15.59:0/3006602832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d40094a0 con 0x7f45e0133ac0 2023-09-30T22:29:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.543+0000 7f45dcff9700 1 -- 172.21.15.59:0/3006602832 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d400cb30 con 0x7f45e0133ac0 2023-09-30T22:29:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.543+0000 7f45e67d7700 1 -- 172.21.15.59:0/3006602832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d00094a0 con 0x7f45e0133ac0 2023-09-30T22:29:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.544+0000 7f45dcff9700 1 -- 172.21.15.59:0/3006602832 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f45d400cc90 con 0x7f45e0133ac0 2023-09-30T22:29:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.544+0000 7f45dcff9700 1 -- 172.21.15.59:0/3006602832 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f45d403fac0 con 0x7f45e0133ac0 2023-09-30T22:29:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.544+0000 7f45dffff700 1 -- 172.21.15.59:0/3006602832 >> v1:172.21.15.59:6816/126772 conn(0x7f45cc02f510 legacy=0x7f45cc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.544+0000 7f45e67d7700 1 -- 172.21.15.59:0/3006602832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e004f2a0 con 0x7f45e0133ac0 2023-09-30T22:29:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.549+0000 7f45dcff9700 1 -- 172.21.15.59:0/3006602832 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45d4021080 con 0x7f45e0133ac0 2023-09-30T22:29:34.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.745+0000 7f45dffff700 1 -- 172.21.15.59:0/3006602832 >> v1:172.21.15.59:6816/126772 conn(0x7f45cc02f510 legacy=0x7f45cc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:34.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:34.763+0000 7f45e67d7700 1 -- 172.21.15.59:0/3006602832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd require-osd-release", "release": "reef"} v 0) v1 -- 0x7f45e00721f0 con 0x7f45e0133ac0 2023-09-30T22:29:35.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.146+0000 7f45dffff700 1 -- 172.21.15.59:0/3006602832 >> v1:172.21.15.59:6816/126772 conn(0x7f45cc02f510 legacy=0x7f45cc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:35.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.335+0000 7f45dcff9700 1 -- 172.21.15.59:0/3006602832 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "reef"}]=0 v41) v1 ==== 90+0+0 (secure 0 0 0) 0x7f45d4017020 con 0x7f45e0133ac0 2023-09-30T22:29:35.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.342+0000 7f45e67d7700 1 -- 172.21.15.59:0/3006602832 >> v1:172.21.15.59:6816/126772 conn(0x7f45cc02f510 legacy=0x7f45cc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:35.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.342+0000 7f45e67d7700 1 -- 172.21.15.59:0/3006602832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e0133ac0 msgr2=0x7f45e011d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.342+0000 7f45e67d7700 1 --2- 172.21.15.59:0/3006602832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e0133ac0 0x7f45e011d0b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f45e009b010 tx=0x7f45d400ec60 comp rx=0 tx=0).stop 2023-09-30T22:29:35.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.342+0000 7f45e67d7700 1 -- 172.21.15.59:0/3006602832 shutdown_connections 2023-09-30T22:29:35.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.342+0000 7f45e67d7700 1 --2- 172.21.15.59:0/3006602832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e009d980 0x7f45e011cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.342+0000 7f45e67d7700 1 --2- 172.21.15.59:0/3006602832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e01343d0 0x7f45e011d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.342+0000 7f45e67d7700 1 --2- 172.21.15.59:0/3006602832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e0133ac0 0x7f45e011d0b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.342+0000 7f45e67d7700 1 -- 172.21.15.59:0/3006602832 >> 172.21.15.59:0/3006602832 conn(0x7f45e00a29e0 msgr2=0x7f45e01301c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:35.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.343+0000 7f45e67d7700 1 -- 172.21.15.59:0/3006602832 shutdown_connections 2023-09-30T22:29:35.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.343+0000 7f45e67d7700 1 -- 172.21.15.59:0/3006602832 wait complete. 2023-09-30T22:29:35.359 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-09-30T22:29:35.376 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T22:29:35.376 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T22:29:35.376 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T22:29:35.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.519+0000 7f502893c700 1 Processor -- start 2023-09-30T22:29:35.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.519+0000 7f502893c700 1 -- start start 2023-09-30T22:29:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.519+0000 7f502893c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f502406a770 0x7f502406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.519+0000 7f502893c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5024131d10 0x7f5024139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.519+0000 7f502893c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502409ece0 con 0x7f502406b080 2023-09-30T22:29:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.519+0000 7f502893c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502409e760 con 0x7f502406a770 2023-09-30T22:29:35.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.519+0000 7f502893c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f502409e040 con 0x7f5024131d10 2023-09-30T22:29:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.519+0000 7f502259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f502406a770 0x7f502406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.519+0000 7f5022d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5024131d10 0x7f5024139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.519+0000 7f5021d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f502406b080 0x7f5024131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58388/0 (socket says 172.21.15.59:58388) 2023-09-30T22:29:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.520+0000 7f5021d9b700 1 -- 172.21.15.59:0/3304040825 learned_addr learned my addr 172.21.15.59:0/3304040825 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.520+0000 7f502259c700 1 -- 172.21.15.59:0/3304040825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5024131d10 msgr2=0x7f5024139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.520+0000 7f502259c700 1 --2- 172.21.15.59:0/3304040825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5024131d10 0x7f5024139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.520+0000 7f502259c700 1 -- 172.21.15.59:0/3304040825 >> v1:172.21.15.59:6789/0 conn(0x7f502406b080 legacy=0x7f5024131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.520+0000 7f502259c700 1 -- 172.21.15.59:0/3304040825 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502409f630 con 0x7f502406a770 2023-09-30T22:29:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.520+0000 7f502159a700 1 -- 172.21.15.59:0/3304040825 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007021078 0 0) 0x7f502409ece0 con 0x7f502406b080 2023-09-30T22:29:35.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.520+0000 7f5022d9d700 1 --2- 172.21.15.59:0/3304040825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5024131d10 0x7f5024139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:35.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.520+0000 7f502259c700 1 --2- 172.21.15.59:0/3304040825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f502406a770 0x7f502406ab40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5014009840 tx=0x7f5014009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2971df48c02d5244 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:35.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.520+0000 7f502159a700 1 -- 172.21.15.59:0/3304040825 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014011830 con 0x7f502406a770 2023-09-30T22:29:35.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.520+0000 7f502159a700 1 -- 172.21.15.59:0/3304040825 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5014011990 con 0x7f502406a770 2023-09-30T22:29:35.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.520+0000 7f502159a700 1 -- 172.21.15.59:0/3304040825 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014011d20 con 0x7f502406a770 2023-09-30T22:29:35.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.521+0000 7f502893c700 1 -- 172.21.15.59:0/3304040825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f502406a770 msgr2=0x7f502406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.521+0000 7f502893c700 1 --2- 172.21.15.59:0/3304040825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f502406a770 0x7f502406ab40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5014009840 tx=0x7f5014009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:35.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.521+0000 7f502893c700 1 -- 172.21.15.59:0/3304040825 shutdown_connections 2023-09-30T22:29:35.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.521+0000 7f502893c700 1 --2- 172.21.15.59:0/3304040825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5024131d10 0x7f5024139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.521+0000 7f502893c700 1 --2- 172.21.15.59:0/3304040825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f502406a770 0x7f502406ab40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.521+0000 7f502893c700 1 -- 172.21.15.59:0/3304040825 >> 172.21.15.59:0/3304040825 conn(0x7f5024066f50 msgr2=0x7f502409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:35.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.521+0000 7f502893c700 1 -- 172.21.15.59:0/3304040825 shutdown_connections 2023-09-30T22:29:35.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.521+0000 7f502893c700 1 -- 172.21.15.59:0/3304040825 wait complete. 2023-09-30T22:29:35.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.522+0000 7f502893c700 1 Processor -- start 2023-09-30T22:29:35.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.522+0000 7f502893c700 1 -- start start 2023-09-30T22:29:35.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f502893c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f502406a770 0x7f5024120370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f502893c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f502406b080 0x7f50241208b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f502893c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5024131d10 0x7f5024120df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f502893c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5024123e40 con 0x7f502406a770 2023-09-30T22:29:35.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f502893c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5024130e20 con 0x7f5024131d10 2023-09-30T22:29:35.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f502893c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5024121fd0 con 0x7f502406b080 2023-09-30T22:29:35.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f502259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f502406a770 0x7f5024120370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f5021d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f502406b080 0x7f50241208b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f5022d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5024131d10 0x7f5024120df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f5021d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f502406b080 0x7f50241208b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36396/0 (socket says 172.21.15.59:36396) 2023-09-30T22:29:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f502259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f502406a770 0x7f5024120370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56900/0 (socket says 172.21.15.59:56900) 2023-09-30T22:29:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f5021d9b700 1 -- 172.21.15.59:0/3882671602 learned_addr learned my addr 172.21.15.59:0/3882671602 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f502259c700 1 -- 172.21.15.59:0/3882671602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f502406b080 msgr2=0x7f50241208b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f502259c700 1 --2- 172.21.15.59:0/3882671602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f502406b080 0x7f50241208b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f502259c700 1 -- 172.21.15.59:0/3882671602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5024131d10 msgr2=0x7f5024120df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f502259c700 1 --2- 172.21.15.59:0/3882671602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5024131d10 0x7f5024120df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f502259c700 1 -- 172.21.15.59:0/3882671602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c009a70 con 0x7f502406a770 2023-09-30T22:29:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f5021d9b700 1 --2- 172.21.15.59:0/3882671602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f502406b080 0x7f50241208b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f502259c700 1 --2- 172.21.15.59:0/3882671602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f502406a770 0x7f5024120370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5014016000 tx=0x7f5014004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.523+0000 7f501affd700 1 -- 172.21.15.59:0/3882671602 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014004550 con 0x7f502406a770 2023-09-30T22:29:35.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.524+0000 7f501affd700 1 -- 172.21.15.59:0/3882671602 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501401f070 con 0x7f502406a770 2023-09-30T22:29:35.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.524+0000 7f502893c700 1 -- 172.21.15.59:0/3882671602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50140094a0 con 0x7f502406a770 2023-09-30T22:29:35.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.524+0000 7f501affd700 1 -- 172.21.15.59:0/3882671602 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50140038a0 con 0x7f502406a770 2023-09-30T22:29:35.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.524+0000 7f502893c700 1 -- 172.21.15.59:0/3882671602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5024071e60 con 0x7f502406a770 2023-09-30T22:29:35.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.524+0000 7f501affd700 1 -- 172.21.15.59:0/3882671602 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5014003a00 con 0x7f502406a770 2023-09-30T22:29:35.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.525+0000 7f501affd700 1 -- 172.21.15.59:0/3882671602 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f5014021070 con 0x7f502406a770 2023-09-30T22:29:35.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.525+0000 7f5021d9b700 1 -- 172.21.15.59:0/3882671602 >> v1:172.21.15.59:6816/126772 conn(0x7f500402f510 legacy=0x7f50040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:35.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.525+0000 7f502893c700 1 -- 172.21.15.59:0/3882671602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5024074ea0 con 0x7f502406a770 2023-09-30T22:29:35.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.530+0000 7f501affd700 1 -- 172.21.15.59:0/3882671602 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5014015030 con 0x7f502406a770 2023-09-30T22:29:35.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.726+0000 7f5021d9b700 1 -- 172.21.15.59:0/3882671602 >> v1:172.21.15.59:6816/126772 conn(0x7f500402f510 legacy=0x7f50040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:35.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.796+0000 7f502893c700 1 -- 172.21.15.59:0/3882671602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f502406c360 con 0x7f502406a770 2023-09-30T22:29:35.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.797+0000 7f501affd700 1 -- 172.21.15.59:0/3882671602 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v9) v1 ==== 74+0+70483 (secure 0 0 0) 0x7f5014015070 con 0x7f502406a770 2023-09-30T22:29:35.798 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:35.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.800+0000 7f502893c700 1 -- 172.21.15.59:0/3882671602 >> v1:172.21.15.59:6816/126772 conn(0x7f500402f510 legacy=0x7f50040319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:35.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.800+0000 7f502893c700 1 -- 172.21.15.59:0/3882671602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f502406a770 msgr2=0x7f5024120370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.800+0000 7f502893c700 1 --2- 172.21.15.59:0/3882671602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f502406a770 0x7f5024120370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5014016000 tx=0x7f5014004750 comp rx=0 tx=0).stop 2023-09-30T22:29:35.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.800+0000 7f502893c700 1 -- 172.21.15.59:0/3882671602 shutdown_connections 2023-09-30T22:29:35.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.800+0000 7f502893c700 1 --2- 172.21.15.59:0/3882671602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5024131d10 0x7f5024120df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.800+0000 7f502893c700 1 --2- 172.21.15.59:0/3882671602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f502406a770 0x7f5024120370 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.800+0000 7f502893c700 1 --2- 172.21.15.59:0/3882671602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f502406b080 0x7f50241208b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.800+0000 7f502893c700 1 -- 172.21.15.59:0/3882671602 >> 172.21.15.59:0/3882671602 conn(0x7f5024066f50 msgr2=0x7f50240a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:35.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.800+0000 7f502893c700 1 -- 172.21.15.59:0/3882671602 shutdown_connections 2023-09-30T22:29:35.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.800+0000 7f502893c700 1 -- 172.21.15.59:0/3882671602 wait complete. 2023-09-30T22:29:35.814 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"active_gid":14104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6816","nonce":126772}]},"active_addr":"172.21.15.59:6816/126772","active_change":"2023-09-30T22:28:59.561330+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":22,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":978898929}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":2365211568}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":1645378737}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":3534779696}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":2628012448}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":3454906108}]}]} 2023-09-30T22:29:35.816 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T22:29:35.816 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:29:35.816 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:29:35.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.952+0000 7feaa8b48700 1 Processor -- start 2023-09-30T22:29:35.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.952+0000 7feaa8b48700 1 -- start start 2023-09-30T22:29:35.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa8b48700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa409d6f0 0x7feaa409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa8b48700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa409e000 0x7feaa41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa8b48700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feaa409e410 0x7feaa4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa8b48700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa406b460 con 0x7feaa409e410 2023-09-30T22:29:35.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa8b48700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa409b120 con 0x7feaa409e000 2023-09-30T22:29:35.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa8b48700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaa409a7e0 con 0x7feaa409d6f0 2023-09-30T22:29:35.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa409d6f0 0x7feaa409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa2d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feaa409e410 0x7feaa4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa409e000 0x7feaa41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa2d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feaa409e410 0x7feaa4133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56916/0 (socket says 172.21.15.59:56916) 2023-09-30T22:29:35.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa409d6f0 0x7feaa409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36408/0 (socket says 172.21.15.59:36408) 2023-09-30T22:29:35.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa2d9d700 1 -- 172.21.15.59:0/1635931482 learned_addr learned my addr 172.21.15.59:0/1635931482 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:35.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa409e000 0x7feaa41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38714/0 (socket says 172.21.15.59:38714) 2023-09-30T22:29:35.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa2d9d700 1 -- 172.21.15.59:0/1635931482 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa409d6f0 msgr2=0x7feaa409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:35.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa2d9d700 1 --2- 172.21.15.59:0/1635931482 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa409d6f0 0x7feaa409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa2d9d700 1 -- 172.21.15.59:0/1635931482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa409e000 msgr2=0x7feaa41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:35.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa2d9d700 1 --2- 172.21.15.59:0/1635931482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa409e000 0x7feaa41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa2d9d700 1 -- 172.21.15.59:0/1635931482 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa409a500 con 0x7feaa409e410 2023-09-30T22:29:35.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa259c700 1 --2- 172.21.15.59:0/1635931482 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa409d6f0 0x7feaa409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:35.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.953+0000 7feaa2d9d700 1 --2- 172.21.15.59:0/1635931482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa409e410 0x7feaa4133f30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009e50 tx=0x7fea9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17796ab9eab6617f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:35.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.954+0000 7feaa159a700 1 -- 172.21.15.59:0/1635931482 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00e070 con 0x7feaa409e410 2023-09-30T22:29:35.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.954+0000 7feaa159a700 1 -- 172.21.15.59:0/1635931482 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c00b910 con 0x7feaa409e410 2023-09-30T22:29:35.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.954+0000 7feaa159a700 1 -- 172.21.15.59:0/1635931482 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00bcc0 con 0x7feaa409e410 2023-09-30T22:29:35.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.954+0000 7feaa8b48700 1 -- 172.21.15.59:0/1635931482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa409e410 msgr2=0x7feaa4133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.954+0000 7feaa8b48700 1 --2- 172.21.15.59:0/1635931482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa409e410 0x7feaa4133f30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009e50 tx=0x7fea9c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:35.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.954+0000 7feaa8b48700 1 -- 172.21.15.59:0/1635931482 shutdown_connections 2023-09-30T22:29:35.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.954+0000 7feaa8b48700 1 --2- 172.21.15.59:0/1635931482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa409e410 0x7feaa4133f30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.954+0000 7feaa8b48700 1 --2- 172.21.15.59:0/1635931482 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa409d6f0 0x7feaa409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.954+0000 7feaa8b48700 1 --2- 172.21.15.59:0/1635931482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa409e000 0x7feaa41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.954+0000 7feaa8b48700 1 -- 172.21.15.59:0/1635931482 >> 172.21.15.59:0/1635931482 conn(0x7feaa4066f50 msgr2=0x7feaa409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.954+0000 7feaa8b48700 1 -- 172.21.15.59:0/1635931482 shutdown_connections 2023-09-30T22:29:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.954+0000 7feaa8b48700 1 -- 172.21.15.59:0/1635931482 wait complete. 2023-09-30T22:29:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.956+0000 7feaa8b48700 1 Processor -- start 2023-09-30T22:29:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.956+0000 7feaa8b48700 1 -- start start 2023-09-30T22:29:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.956+0000 7feaa8b48700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa409d6f0 0x7feaa41c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.956+0000 7feaa8b48700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa409e000 0x7feaa41c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.956+0000 7feaa8b48700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa409e410 0x7feaa41c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.956+0000 7feaa8b48700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa41a9620 con 0x7feaa409d6f0 2023-09-30T22:29:35.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.956+0000 7feaa8b48700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa41a8b60 con 0x7feaa409e000 2023-09-30T22:29:35.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.956+0000 7feaa8b48700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaa41c5aa0 con 0x7feaa409e410 2023-09-30T22:29:35.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.956+0000 7feaa259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa409d6f0 0x7feaa41c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.956+0000 7feaa1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa409e000 0x7feaa41c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.956+0000 7feaa2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa409e410 0x7feaa41c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.956+0000 7feaa259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa409d6f0 0x7feaa41c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56928/0 (socket says 172.21.15.59:56928) 2023-09-30T22:29:35.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.956+0000 7feaa1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa409e000 0x7feaa41c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38722/0 (socket says 172.21.15.59:38722) 2023-09-30T22:29:35.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.956+0000 7feaa259c700 1 -- 172.21.15.59:0/1648368918 learned_addr learned my addr 172.21.15.59:0/1648368918 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:35.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.957+0000 7feaa259c700 1 -- 172.21.15.59:0/1648368918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa409e410 msgr2=0x7feaa41c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.957+0000 7feaa259c700 1 --2- 172.21.15.59:0/1648368918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa409e410 0x7feaa41c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.957+0000 7feaa259c700 1 -- 172.21.15.59:0/1648368918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa409e000 msgr2=0x7feaa41c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.957+0000 7feaa259c700 1 --2- 172.21.15.59:0/1648368918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa409e000 0x7feaa41c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.957+0000 7feaa259c700 1 -- 172.21.15.59:0/1648368918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c0094a0 con 0x7feaa409d6f0 2023-09-30T22:29:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.957+0000 7feaa1d9b700 1 --2- 172.21.15.59:0/1648368918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa409e000 0x7feaa41c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.957+0000 7feaa2d9d700 1 --2- 172.21.15.59:0/1648368918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa409e410 0x7feaa41c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.957+0000 7feaa259c700 1 --2- 172.21.15.59:0/1648368918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa409d6f0 0x7feaa41c5020 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00ebe0 tx=0x7fea8c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.957+0000 7fea9affd700 1 -- 172.21.15.59:0/1648368918 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c00c850 con 0x7feaa409d6f0 2023-09-30T22:29:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.957+0000 7fea9affd700 1 -- 172.21.15.59:0/1648368918 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8c00c9b0 con 0x7feaa409d6f0 2023-09-30T22:29:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.957+0000 7feaa8b48700 1 -- 172.21.15.59:0/1648368918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c009b30 con 0x7feaa409d6f0 2023-09-30T22:29:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.957+0000 7fea9affd700 1 -- 172.21.15.59:0/1648368918 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c00cd40 con 0x7feaa409d6f0 2023-09-30T22:29:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.957+0000 7feaa8b48700 1 -- 172.21.15.59:0/1648368918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa40a30f0 con 0x7feaa409d6f0 2023-09-30T22:29:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.958+0000 7fea9affd700 1 -- 172.21.15.59:0/1648368918 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fea8c013470 con 0x7feaa409d6f0 2023-09-30T22:29:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.958+0000 7fea9affd700 1 -- 172.21.15.59:0/1648368918 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fea8c03fc60 con 0x7feaa409d6f0 2023-09-30T22:29:35.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.958+0000 7feaa1d9b700 1 -- 172.21.15.59:0/1648368918 >> v1:172.21.15.59:6816/126772 conn(0x7fea8402f510 legacy=0x7fea840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:35.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.958+0000 7feaa8b48700 1 -- 172.21.15.59:0/1648368918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa4074ea0 con 0x7feaa409d6f0 2023-09-30T22:29:35.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:35.963+0000 7fea9affd700 1 -- 172.21.15.59:0/1648368918 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea8c021080 con 0x7feaa409d6f0 2023-09-30T22:29:36.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.159+0000 7feaa1d9b700 1 -- 172.21.15.59:0/1648368918 >> v1:172.21.15.59:6816/126772 conn(0x7fea8402f510 legacy=0x7fea840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:36.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.168+0000 7feaa8b48700 1 -- 172.21.15.59:0/1648368918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaa41a9880 con 0x7feaa409d6f0 2023-09-30T22:29:36.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.169+0000 7fea9affd700 1 -- 172.21.15.59:0/1648368918 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13019 (secure 0 0 0) 0x7fea8c013720 con 0x7feaa409d6f0 2023-09-30T22:29:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:36.170 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":41,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:29:35.332362+0000","last_up_change":"2023-09-30T22:29:20.757654+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":9,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":34,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":129489}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":129489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":129489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":129489}]},"public_addr":"172.21.15.59:6800/129489","cluster_addr":"172.21.15.59:6801/129489","heartbeat_back_addr":"172.21.15.59:6803/129489","heartbeat_front_addr":"172.21.15.59:6802/129489","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":32,"up_thru":34,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":129609}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":129609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":129609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":129609}]},"public_addr":"172.21.15.59:6804/129609","cluster_addr":"172.21.15.59:6805/129609","heartbeat_back_addr":"172.21.15.59:6807/129609","heartbeat_front_addr":"172.21.15.59:6806/129609","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":34,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":129719}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":129719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":129719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":129719}]},"public_addr":"172.21.15.59:6808/129719","cluster_addr":"172.21.15.59:6809/129719","heartbeat_back_addr":"172.21.15.59:6811/129719","heartbeat_front_addr":"172.21.15.59:6810/129719","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":34,"up_thru":34,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":130037}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":130037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":130037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":130037}]},"public_addr":"172.21.15.59:6812/130037","cluster_addr":"172.21.15.59:6813/130037","heartbeat_back_addr":"172.21.15.59:6815/130037","heartbeat_front_addr":"172.21.15.59:6814/130037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-09-30T22:29:13.318877+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6817/2103029646":"2023-10-01T22:29:28.838274+0000","172.21.15.59:0/3882222550":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/1346763106":"2023-10-01T22:28:59.561079+0000","172.21.15.59:6816/118188":"2023-10-01T22:28:59.561079+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:29:36.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.172+0000 7feaa8b48700 1 -- 172.21.15.59:0/1648368918 >> v1:172.21.15.59:6816/126772 conn(0x7fea8402f510 legacy=0x7fea840319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:36.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.172+0000 7feaa8b48700 1 -- 172.21.15.59:0/1648368918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa409d6f0 msgr2=0x7feaa41c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.172+0000 7feaa8b48700 1 --2- 172.21.15.59:0/1648368918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa409d6f0 0x7feaa41c5020 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00ebe0 tx=0x7fea8c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.172+0000 7feaa8b48700 1 -- 172.21.15.59:0/1648368918 shutdown_connections 2023-09-30T22:29:36.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.172+0000 7feaa8b48700 1 --2- 172.21.15.59:0/1648368918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa409e410 0x7feaa41c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.172+0000 7feaa8b48700 1 --2- 172.21.15.59:0/1648368918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa409d6f0 0x7feaa41c5020 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.172+0000 7feaa8b48700 1 --2- 172.21.15.59:0/1648368918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa409e000 0x7feaa41c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.172+0000 7feaa8b48700 1 -- 172.21.15.59:0/1648368918 >> 172.21.15.59:0/1648368918 conn(0x7feaa4066f50 msgr2=0x7feaa41bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.172+0000 7feaa8b48700 1 -- 172.21.15.59:0/1648368918 shutdown_connections 2023-09-30T22:29:36.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.172+0000 7feaa8b48700 1 -- 172.21.15.59:0/1648368918 wait complete. 2023-09-30T22:29:36.186 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:29:36.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:29:36.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.322+0000 7f9c5a0ba700 1 Processor -- start 2023-09-30T22:29:36.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.322+0000 7f9c5a0ba700 1 -- start start 2023-09-30T22:29:36.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c5a0ba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c5409e1d0 0x7f9c54138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c5a0ba700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c54139170 0x7f9c5413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c5a0ba700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5409b120 con 0x7f9c5409d6f0 2023-09-30T22:29:36.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c5a0ba700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5406b460 con 0x7f9c54139170 2023-09-30T22:29:36.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c5a0ba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5409a7e0 con 0x7f9c5409e1d0 2023-09-30T22:29:36.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c537fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9c5409d6f0 0x7f9c5409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58394/0 (socket says 172.21.15.59:58394) 2023-09-30T22:29:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c537fe700 1 -- 172.21.15.59:0/1563998667 learned_addr learned my addr 172.21.15.59:0/1563998667 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c53fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c54139170 0x7f9c5413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c52ffd700 1 --2- 172.21.15.59:0/1563998667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c5409e1d0 0x7f9c54138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c527fc700 1 -- 172.21.15.59:0/1563998667 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671949392 0 0) 0x7f9c5409b120 con 0x7f9c5409d6f0 2023-09-30T22:29:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c527fc700 1 -- 172.21.15.59:0/1563998667 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c3c0035b0 con 0x7f9c5409d6f0 2023-09-30T22:29:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c52ffd700 1 -- 172.21.15.59:0/1563998667 >> v2:172.21.15.59:3300/0 conn(0x7f9c54139170 msgr2=0x7f9c5413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c52ffd700 1 --2- 172.21.15.59:0/1563998667 >> v2:172.21.15.59:3300/0 conn(0x7f9c54139170 0x7f9c5413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c52ffd700 1 -- 172.21.15.59:0/1563998667 >> v1:172.21.15.59:6789/0 conn(0x7f9c5409d6f0 legacy=0x7f9c5409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c52ffd700 1 -- 172.21.15.59:0/1563998667 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5409a500 con 0x7f9c5409e1d0 2023-09-30T22:29:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.323+0000 7f9c53fff700 1 --2- 172.21.15.59:0/1563998667 >> v2:172.21.15.59:3300/0 conn(0x7f9c54139170 0x7f9c5413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.324+0000 7f9c52ffd700 1 --2- 172.21.15.59:0/1563998667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c5409e1d0 0x7f9c54138c30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009870 tx=0x7f9c48009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d12184329a5ed7c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.324+0000 7f9c527fc700 1 -- 172.21.15.59:0/1563998667 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48011830 con 0x7f9c5409e1d0 2023-09-30T22:29:36.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.324+0000 7f9c527fc700 1 -- 172.21.15.59:0/1563998667 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c48011990 con 0x7f9c5409e1d0 2023-09-30T22:29:36.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.324+0000 7f9c527fc700 1 -- 172.21.15.59:0/1563998667 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48011d20 con 0x7f9c5409e1d0 2023-09-30T22:29:36.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.324+0000 7f9c5a0ba700 1 -- 172.21.15.59:0/1563998667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c5409e1d0 msgr2=0x7f9c54138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.324+0000 7f9c5a0ba700 1 --2- 172.21.15.59:0/1563998667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c5409e1d0 0x7f9c54138c30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009870 tx=0x7f9c48009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:36.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.324+0000 7f9c5a0ba700 1 -- 172.21.15.59:0/1563998667 shutdown_connections 2023-09-30T22:29:36.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.324+0000 7f9c5a0ba700 1 --2- 172.21.15.59:0/1563998667 >> v2:172.21.15.59:3300/0 conn(0x7f9c54139170 0x7f9c5413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.324+0000 7f9c5a0ba700 1 --2- 172.21.15.59:0/1563998667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c5409e1d0 0x7f9c54138c30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.324+0000 7f9c5a0ba700 1 -- 172.21.15.59:0/1563998667 >> 172.21.15.59:0/1563998667 conn(0x7f9c54066f50 msgr2=0x7f9c5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.325+0000 7f9c5a0ba700 1 -- 172.21.15.59:0/1563998667 shutdown_connections 2023-09-30T22:29:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.325+0000 7f9c5a0ba700 1 -- 172.21.15.59:0/1563998667 wait complete. 2023-09-30T22:29:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.325+0000 7f9c5a0ba700 1 Processor -- start 2023-09-30T22:29:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.326+0000 7f9c5a0ba700 1 -- start start 2023-09-30T22:29:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.326+0000 7f9c5a0ba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c5409d6f0 0x7f9c5411e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.326+0000 7f9c5a0ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c5409e1d0 0x7f9c5411ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.326+0000 7f9c5a0ba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c54139170 0x7f9c5411f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.326+0000 7f9c5a0ba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5409c710 con 0x7f9c54139170 2023-09-30T22:29:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.326+0000 7f9c5a0ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c54134160 con 0x7f9c5409e1d0 2023-09-30T22:29:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.326+0000 7f9c5a0ba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c54120550 con 0x7f9c5409d6f0 2023-09-30T22:29:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.326+0000 7f9c537fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c5409d6f0 0x7f9c5411e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.326+0000 7f9c52ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c5409e1d0 0x7f9c5411ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.326+0000 7f9c53fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c54139170 0x7f9c5411f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.326+0000 7f9c52ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c5409e1d0 0x7f9c5411ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38734/0 (socket says 172.21.15.59:38734) 2023-09-30T22:29:36.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.326+0000 7f9c537fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c5409d6f0 0x7f9c5411e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36432/0 (socket says 172.21.15.59:36432) 2023-09-30T22:29:36.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.326+0000 7f9c52ffd700 1 -- 172.21.15.59:0/4012075613 learned_addr learned my addr 172.21.15.59:0/4012075613 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.326+0000 7f9c53fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c54139170 0x7f9c5411f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56940/0 (socket says 172.21.15.59:56940) 2023-09-30T22:29:36.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.327+0000 7f9c537fe700 1 -- 172.21.15.59:0/4012075613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c5409e1d0 msgr2=0x7f9c5411ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.327+0000 7f9c537fe700 1 --2- 172.21.15.59:0/4012075613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c5409e1d0 0x7f9c5411ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.327+0000 7f9c537fe700 1 -- 172.21.15.59:0/4012075613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c54139170 msgr2=0x7f9c5411f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.327+0000 7f9c537fe700 1 --2- 172.21.15.59:0/4012075613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c54139170 0x7f9c5411f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.327+0000 7f9c537fe700 1 -- 172.21.15.59:0/4012075613 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c009a70 con 0x7f9c5409d6f0 2023-09-30T22:29:36.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.327+0000 7f9c53fff700 1 --2- 172.21.15.59:0/4012075613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c54139170 0x7f9c5411f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:36.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.327+0000 7f9c52ffd700 1 --2- 172.21.15.59:0/4012075613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c5409e1d0 0x7f9c5411ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:36.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.327+0000 7f9c537fe700 1 --2- 172.21.15.59:0/4012075613 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c5409d6f0 0x7f9c5411e8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400c490 tx=0x7f9c4400c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.327+0000 7f9c3bfff700 1 -- 172.21.15.59:0/4012075613 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44005d70 con 0x7f9c5409d6f0 2023-09-30T22:29:36.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.327+0000 7f9c3bfff700 1 -- 172.21.15.59:0/4012075613 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c440070d0 con 0x7f9c5409d6f0 2023-09-30T22:29:36.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.327+0000 7f9c5a0ba700 1 -- 172.21.15.59:0/4012075613 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c480094a0 con 0x7f9c5409d6f0 2023-09-30T22:29:36.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.327+0000 7f9c3bfff700 1 -- 172.21.15.59:0/4012075613 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44007440 con 0x7f9c5409d6f0 2023-09-30T22:29:36.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.327+0000 7f9c5a0ba700 1 -- 172.21.15.59:0/4012075613 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c54122070 con 0x7f9c5409d6f0 2023-09-30T22:29:36.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.328+0000 7f9c5a0ba700 1 -- 172.21.15.59:0/4012075613 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c540729a0 con 0x7f9c5409d6f0 2023-09-30T22:29:36.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.329+0000 7f9c3bfff700 1 -- 172.21.15.59:0/4012075613 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9c440075a0 con 0x7f9c5409d6f0 2023-09-30T22:29:36.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.329+0000 7f9c52ffd700 1 -- 172.21.15.59:0/4012075613 >> v1:172.21.15.59:6816/126772 conn(0x7f9c4002f510 legacy=0x7f9c400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:36.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.329+0000 7f9c3bfff700 1 -- 172.21.15.59:0/4012075613 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f9c4403f400 con 0x7f9c5409d6f0 2023-09-30T22:29:36.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.333+0000 7f9c3bfff700 1 -- 172.21.15.59:0/4012075613 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c44019b40 con 0x7f9c5409d6f0 2023-09-30T22:29:36.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.530+0000 7f9c52ffd700 1 -- 172.21.15.59:0/4012075613 >> v1:172.21.15.59:6816/126772 conn(0x7f9c4002f510 legacy=0x7f9c400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:36.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.538+0000 7f9c5a0ba700 1 -- 172.21.15.59:0/4012075613 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c5409f420 con 0x7f9c5409d6f0 2023-09-30T22:29:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.539+0000 7f9c3bfff700 1 -- 172.21.15.59:0/4012075613 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13019 (secure 0 0 0) 0x7f9c44017030 con 0x7f9c5409d6f0 2023-09-30T22:29:36.539 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:29:36.539 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":41,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:29:35.332362+0000","last_up_change":"2023-09-30T22:29:20.757654+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":9,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":34,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":129489}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":129489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":129489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":129489}]},"public_addr":"172.21.15.59:6800/129489","cluster_addr":"172.21.15.59:6801/129489","heartbeat_back_addr":"172.21.15.59:6803/129489","heartbeat_front_addr":"172.21.15.59:6802/129489","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":32,"up_thru":34,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":129609}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":129609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":129609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":129609}]},"public_addr":"172.21.15.59:6804/129609","cluster_addr":"172.21.15.59:6805/129609","heartbeat_back_addr":"172.21.15.59:6807/129609","heartbeat_front_addr":"172.21.15.59:6806/129609","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":34,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":129719}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":129719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":129719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":129719}]},"public_addr":"172.21.15.59:6808/129719","cluster_addr":"172.21.15.59:6809/129719","heartbeat_back_addr":"172.21.15.59:6811/129719","heartbeat_front_addr":"172.21.15.59:6810/129719","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":34,"up_thru":34,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":130037}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":130037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":130037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":130037}]},"public_addr":"172.21.15.59:6812/130037","cluster_addr":"172.21.15.59:6813/130037","heartbeat_back_addr":"172.21.15.59:6815/130037","heartbeat_front_addr":"172.21.15.59:6814/130037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-09-30T22:29:13.318877+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6817/2103029646":"2023-10-01T22:29:28.838274+0000","172.21.15.59:0/3882222550":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/1346763106":"2023-10-01T22:28:59.561079+0000","172.21.15.59:6816/118188":"2023-10-01T22:28:59.561079+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:29:36.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.542+0000 7f9c5a0ba700 1 -- 172.21.15.59:0/4012075613 >> v1:172.21.15.59:6816/126772 conn(0x7f9c4002f510 legacy=0x7f9c400319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:36.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.542+0000 7f9c5a0ba700 1 -- 172.21.15.59:0/4012075613 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c5409d6f0 msgr2=0x7f9c5411e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.542+0000 7f9c5a0ba700 1 --2- 172.21.15.59:0/4012075613 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c5409d6f0 0x7f9c5411e8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400c490 tx=0x7f9c4400c7a0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.542+0000 7f9c5a0ba700 1 -- 172.21.15.59:0/4012075613 shutdown_connections 2023-09-30T22:29:36.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.542+0000 7f9c5a0ba700 1 --2- 172.21.15.59:0/4012075613 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c5409d6f0 0x7f9c5411e8e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.542+0000 7f9c5a0ba700 1 --2- 172.21.15.59:0/4012075613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c54139170 0x7f9c5411f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.542+0000 7f9c5a0ba700 1 --2- 172.21.15.59:0/4012075613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c5409e1d0 0x7f9c5411ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.542+0000 7f9c5a0ba700 1 -- 172.21.15.59:0/4012075613 >> 172.21.15.59:0/4012075613 conn(0x7f9c54066f50 msgr2=0x7f9c540a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.542+0000 7f9c5a0ba700 1 -- 172.21.15.59:0/4012075613 shutdown_connections 2023-09-30T22:29:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.542+0000 7f9c5a0ba700 1 -- 172.21.15.59:0/4012075613 wait complete. 2023-09-30T22:29:36.556 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T22:29:36.557 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T22:29:36.557 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T22:29:36.558 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T22:29:36.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.703+0000 7f77e7c71700 1 Processor -- start 2023-09-30T22:29:36.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.704+0000 7f71d1f10700 1 Processor -- start 2023-09-30T22:29:36.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.704+0000 7f77e7c71700 1 -- start start 2023-09-30T22:29:36.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.704+0000 7f71d1f10700 1 -- start start 2023-09-30T22:29:36.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71d1f10700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc0a0a30 0x7f71cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71d1f10700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09d630 0x7f71cc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71d1f10700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f71cc133930 0x7f71cc133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71d1f10700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71cc0a2a70 con 0x7f71cc133930 2023-09-30T22:29:36.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71d1f10700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc0a01d0 con 0x7f71cc09d630 2023-09-30T22:29:36.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71d1f10700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc09e2b0 con 0x7f71cc0a0a30 2023-09-30T22:29:36.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71caffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09d630 0x7f71cc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71cb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc0a0a30 0x7f71cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71cb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc0a0a30 0x7f71cc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36438/0 (socket says 172.21.15.59:36438) 2023-09-30T22:29:36.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71cb7fe700 1 -- 172.21.15.59:0/3146618930 learned_addr learned my addr 172.21.15.59:0/3146618930 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71caffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09d630 0x7f71cc0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38748/0 (socket says 172.21.15.59:38748) 2023-09-30T22:29:36.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f77e7c71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77e01337f0 0x7f77e0138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f77e7c71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77e0138dc0 0x7f77e013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f77e7c71700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e006b990 con 0x7f77e0133420 2023-09-30T22:29:36.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f77e7c71700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e009b0e0 con 0x7f77e0138dc0 2023-09-30T22:29:36.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f77e7c71700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77e0133c20 con 0x7f77e01337f0 2023-09-30T22:29:36.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f77e520c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77e01337f0 0x7f77e0138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f77e620e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77e0138dc0 0x7f77e013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f77e520c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77e01337f0 0x7f77e0138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36446/0 (socket says 172.21.15.59:36446) 2023-09-30T22:29:36.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f77e520c700 1 -- 172.21.15.59:0/1211862985 learned_addr learned my addr 172.21.15.59:0/1211862985 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71cb7fe700 1 -- 172.21.15.59:0/3146618930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09d630 msgr2=0x7f71cc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71cb7fe700 1 --2- 172.21.15.59:0/3146618930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09d630 0x7f71cc0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71cb7fe700 1 -- 172.21.15.59:0/3146618930 >> v2:172.21.15.59:3300/0 conn(0x7f71cc133930 msgr2=0x7f71cc133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71cb7fe700 1 --2- 172.21.15.59:0/3146618930 >> v2:172.21.15.59:3300/0 conn(0x7f71cc133930 0x7f71cc133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f71cb7fe700 1 -- 172.21.15.59:0/3146618930 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc09dc50 con 0x7f71cc0a0a30 2023-09-30T22:29:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f77e620e700 1 -- 172.21.15.59:0/1211862985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77e01337f0 msgr2=0x7f77e0138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f77e620e700 1 --2- 172.21.15.59:0/1211862985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77e01337f0 0x7f77e0138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f77e620e700 1 -- 172.21.15.59:0/1211862985 >> v1:172.21.15.59:6789/0 conn(0x7f77e0133420 legacy=0x7f77e0133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.705+0000 7f77e620e700 1 -- 172.21.15.59:0/1211862985 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00a0590 con 0x7f77e0138dc0 2023-09-30T22:29:36.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.706+0000 7f71cb7fe700 1 --2- 172.21.15.59:0/3146618930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc0a0a30 0x7f71cc0a0e00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0098f0 tx=0x7f71bc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25e13795328d00e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.706+0000 7f77e620e700 1 --2- 172.21.15.59:0/1211862985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77e0138dc0 0x7f77e013b1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009dc0 tx=0x7f77d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=536870ad0dda7529 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.706+0000 7f71ca7fc700 1 -- 172.21.15.59:0/3146618930 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc011830 con 0x7f71cc0a0a30 2023-09-30T22:29:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.706+0000 7f71ca7fc700 1 -- 172.21.15.59:0/3146618930 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc011990 con 0x7f71cc0a0a30 2023-09-30T22:29:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.706+0000 7f71ca7fc700 1 -- 172.21.15.59:0/3146618930 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc011d20 con 0x7f71cc0a0a30 2023-09-30T22:29:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.707+0000 7f71d1f10700 1 -- 172.21.15.59:0/3146618930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc0a0a30 msgr2=0x7f71cc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.707+0000 7f71d1f10700 1 --2- 172.21.15.59:0/3146618930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc0a0a30 0x7f71cc0a0e00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0098f0 tx=0x7f71bc009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.707+0000 7f71d1f10700 1 -- 172.21.15.59:0/3146618930 shutdown_connections 2023-09-30T22:29:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.707+0000 7f71d1f10700 1 --2- 172.21.15.59:0/3146618930 >> v2:172.21.15.59:3300/0 conn(0x7f71cc133930 0x7f71cc133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.707+0000 7f71d1f10700 1 --2- 172.21.15.59:0/3146618930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc0a0a30 0x7f71cc0a0e00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.707+0000 7f71d1f10700 1 --2- 172.21.15.59:0/3146618930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09d630 0x7f71cc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.707+0000 7f71d1f10700 1 -- 172.21.15.59:0/3146618930 >> 172.21.15.59:0/3146618930 conn(0x7f71cc0a3050 msgr2=0x7f71cc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.707+0000 7f71d1f10700 1 -- 172.21.15.59:0/3146618930 shutdown_connections 2023-09-30T22:29:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.707+0000 7f71d1f10700 1 -- 172.21.15.59:0/3146618930 wait complete. 2023-09-30T22:29:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.708+0000 7f71d1f10700 1 Processor -- start 2023-09-30T22:29:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.708+0000 7f71d1f10700 1 -- start start 2023-09-30T22:29:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71d1f10700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc09d630 0x7f71cc1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71d1f10700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc0a0a30 0x7f71cc1c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71d1f10700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc133930 0x7f71cc1c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71d1f10700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc133530 con 0x7f71cc09d630 2023-09-30T22:29:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71d1f10700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc120730 con 0x7f71cc133930 2023-09-30T22:29:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71d1f10700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc0a41c0 con 0x7f71cc0a0a30 2023-09-30T22:29:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71caffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc0a0a30 0x7f71cc1c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71caffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc0a0a30 0x7f71cc1c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36454/0 (socket says 172.21.15.59:36454) 2023-09-30T22:29:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71caffd700 1 -- 172.21.15.59:0/200920456 learned_addr learned my addr 172.21.15.59:0/200920456 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71cbfff700 1 --2- 172.21.15.59:0/200920456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc133930 0x7f71cc1c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f77e4a0b700 1 -- 172.21.15.59:0/1211862985 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d800e070 con 0x7f77e0138dc0 2023-09-30T22:29:36.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f77e4a0b700 1 -- 172.21.15.59:0/1211862985 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d800bae0 con 0x7f77e0138dc0 2023-09-30T22:29:36.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f77e4a0b700 1 -- 172.21.15.59:0/1211862985 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d800be90 con 0x7f77e0138dc0 2023-09-30T22:29:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71cb7fe700 1 --2- 172.21.15.59:0/200920456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc09d630 0x7f71cc1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71caffd700 1 -- 172.21.15.59:0/200920456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc133930 msgr2=0x7f71cc1c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71caffd700 1 --2- 172.21.15.59:0/200920456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc133930 0x7f71cc1c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71caffd700 1 -- 172.21.15.59:0/200920456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc09d630 msgr2=0x7f71cc1c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71caffd700 1 --2- 172.21.15.59:0/200920456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc09d630 0x7f71cc1c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.709+0000 7f71caffd700 1 -- 172.21.15.59:0/200920456 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc009550 con 0x7f71cc0a0a30 2023-09-30T22:29:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.710+0000 7f71caffd700 1 --2- 172.21.15.59:0/200920456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc0a0a30 0x7f71cc1c8660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f71c000e980 tx=0x7f71c000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.710+0000 7f71b3fff700 1 -- 172.21.15.59:0/200920456 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c0009710 con 0x7f71cc0a0a30 2023-09-30T22:29:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.710+0000 7f71b3fff700 1 -- 172.21.15.59:0/200920456 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c000c690 con 0x7f71cc0a0a30 2023-09-30T22:29:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.710+0000 7f71d1f10700 1 -- 172.21.15.59:0/200920456 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71cc0a0410 con 0x7f71cc0a0a30 2023-09-30T22:29:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.710+0000 7f77e7c71700 1 -- 172.21.15.59:0/1211862985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77e0138dc0 msgr2=0x7f77e013b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.710+0000 7f77e7c71700 1 --2- 172.21.15.59:0/1211862985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77e0138dc0 0x7f77e013b1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009dc0 tx=0x7f77d800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.711+0000 7f77e7c71700 1 -- 172.21.15.59:0/1211862985 shutdown_connections 2023-09-30T22:29:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.711+0000 7f77e7c71700 1 --2- 172.21.15.59:0/1211862985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77e0138dc0 0x7f77e013b1a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.711+0000 7f77e7c71700 1 --2- 172.21.15.59:0/1211862985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77e01337f0 0x7f77e0138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.711+0000 7f77e7c71700 1 -- 172.21.15.59:0/1211862985 >> 172.21.15.59:0/1211862985 conn(0x7f77e00a4210 msgr2=0x7f77e00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.710+0000 7f71b3fff700 1 -- 172.21.15.59:0/200920456 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c000ca20 con 0x7f71cc0a0a30 2023-09-30T22:29:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.710+0000 7f71d1f10700 1 -- 172.21.15.59:0/200920456 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71cc122c50 con 0x7f71cc0a0a30 2023-09-30T22:29:36.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.711+0000 7f71b3fff700 1 -- 172.21.15.59:0/200920456 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f71c000cb80 con 0x7f71cc0a0a30 2023-09-30T22:29:36.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.711+0000 7f77e7c71700 1 -- 172.21.15.59:0/1211862985 shutdown_connections 2023-09-30T22:29:36.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.711+0000 7f77e7c71700 1 -- 172.21.15.59:0/1211862985 wait complete. 2023-09-30T22:29:36.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.711+0000 7f71b3fff700 1 -- 172.21.15.59:0/200920456 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f71c003fbe0 con 0x7f71cc0a0a30 2023-09-30T22:29:36.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.711+0000 7f71cb7fe700 1 -- 172.21.15.59:0/200920456 >> v1:172.21.15.59:6816/126772 conn(0x7f71b802f510 legacy=0x7f71b80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:36.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.712+0000 7f77e7c71700 1 Processor -- start 2023-09-30T22:29:36.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.712+0000 7f77e7c71700 1 -- start start 2023-09-30T22:29:36.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f71d1f10700 1 -- 172.21.15.59:0/200920456 --> v1:172.21.15.59:6800/129489 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71cc0621a0 con 0x7f71cc1323b0 2023-09-30T22:29:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e7c71700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e0133420 0x7f77e012ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e7c71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77e01337f0 0x7f77e012f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e7c71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77e0138dc0 0x7f77e012f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e7c71700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e009e1c0 con 0x7f77e0133420 2023-09-30T22:29:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e7c71700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e009cdc0 con 0x7f77e01337f0 2023-09-30T22:29:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e7c71700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77e009ca70 con 0x7f77e0138dc0 2023-09-30T22:29:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e520c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77e01337f0 0x7f77e012f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e520c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77e01337f0 0x7f77e012f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38772/0 (socket says 172.21.15.59:38772) 2023-09-30T22:29:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e620e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77e0138dc0 0x7f77e012f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e520c700 1 -- 172.21.15.59:0/1510814426 learned_addr learned my addr 172.21.15.59:0/1510814426 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e5a0d700 1 --2- 172.21.15.59:0/1510814426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e0133420 0x7f77e012ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e520c700 1 -- 172.21.15.59:0/1510814426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77e0138dc0 msgr2=0x7f77e012f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e520c700 1 --2- 172.21.15.59:0/1510814426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77e0138dc0 0x7f77e012f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e520c700 1 -- 172.21.15.59:0/1510814426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e0133420 msgr2=0x7f77e012ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e520c700 1 --2- 172.21.15.59:0/1510814426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e0133420 0x7f77e012ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.713+0000 7f77e520c700 1 -- 172.21.15.59:0/1510814426 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8009a70 con 0x7f77e01337f0 2023-09-30T22:29:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.714+0000 7f77e520c700 1 --2- 172.21.15.59:0/1510814426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77e01337f0 0x7f77e012f390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77d000e940 tx=0x7f77d000ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.714+0000 7f77d67fc700 1 -- 172.21.15.59:0/1510814426 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d00096a0 con 0x7f77e01337f0 2023-09-30T22:29:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.714+0000 7f77d67fc700 1 -- 172.21.15.59:0/1510814426 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d000ee90 con 0x7f77e01337f0 2023-09-30T22:29:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.714+0000 7f77e7c71700 1 -- 172.21.15.59:0/1510814426 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e009d930 con 0x7f77e01337f0 2023-09-30T22:29:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.714+0000 7f77d67fc700 1 -- 172.21.15.59:0/1510814426 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d000ca90 con 0x7f77e01337f0 2023-09-30T22:29:36.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.714+0000 7f71b3fff700 1 -- 172.21.15.59:0/200920456 <== osd.0 v1:172.21.15.59:6800/129489 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f71cc0621a0 con 0x7f71cc1323b0 2023-09-30T22:29:36.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.715+0000 7fdb5d1f6700 1 Processor -- start 2023-09-30T22:29:36.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.715+0000 7fdb5d1f6700 1 -- start start 2023-09-30T22:29:36.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.714+0000 7f77e7c71700 1 -- 172.21.15.59:0/1510814426 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e0138970 con 0x7f77e01337f0 2023-09-30T22:29:36.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.715+0000 7f77e7c71700 1 -- 172.21.15.59:0/1510814426 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77e006c350 con 0x7f77e01337f0 2023-09-30T22:29:36.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.715+0000 7fdb5d1f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb5809d6f0 0x7fdb5809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.715+0000 7fdb5d1f6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb5809e000 0x7fdb58130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.715+0000 7fdb5d1f6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb5809e410 0x7fdb58130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.715+0000 7fdb5d1f6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5809f520 con 0x7fdb5809e000 2023-09-30T22:29:36.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.715+0000 7fdb5d1f6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5809f130 con 0x7fdb5809d6f0 2023-09-30T22:29:36.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.715+0000 7fdb5d1f6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5809e930 con 0x7fdb5809e410 2023-09-30T22:29:36.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7f77d67fc700 1 -- 172.21.15.59:0/1510814426 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f77d000cbf0 con 0x7f77e01337f0 2023-09-30T22:29:36.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7fdb5759e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb5809e410 0x7fdb58130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7fdb56d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb5809d6f0 0x7fdb5809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7fdb5759e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb5809e410 0x7fdb58130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36472/0 (socket says 172.21.15.59:36472) 2023-09-30T22:29:36.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7fdb5759e700 1 -- 172.21.15.59:0/2919311256 learned_addr learned my addr 172.21.15.59:0/2919311256 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7f77d67fc700 1 -- 172.21.15.59:0/1510814426 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f77d0040330 con 0x7f77e01337f0 2023-09-30T22:29:36.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7f77e5a0d700 1 -- 172.21.15.59:0/1510814426 >> v1:172.21.15.59:6816/126772 conn(0x7f77c402f510 legacy=0x7f77c40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:36.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7f77d67fc700 1 -- 172.21.15.59:0/1510814426 --> v1:172.21.15.59:6808/129719 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77c403c360 con 0x7f77c4038660 2023-09-30T22:29:36.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7f77d67fc700 1 -- 172.21.15.59:0/1510814426 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77d0040750 con 0x7f77e01337f0 2023-09-30T22:29:36.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7fdb5759e700 1 -- 172.21.15.59:0/2919311256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb5809d6f0 msgr2=0x7fdb5809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7fdb5759e700 1 --2- 172.21.15.59:0/2919311256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb5809d6f0 0x7fdb5809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7fdb5759e700 1 -- 172.21.15.59:0/2919311256 >> v2:172.21.15.59:3300/0 conn(0x7fdb5809e000 msgr2=0x7fdb58130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7fdb5759e700 1 --2- 172.21.15.59:0/2919311256 >> v2:172.21.15.59:3300/0 conn(0x7fdb5809e000 0x7fdb58130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7fdb5759e700 1 -- 172.21.15.59:0/2919311256 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5809b2d0 con 0x7fdb5809e410 2023-09-30T22:29:36.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7f72c6a3c700 1 Processor -- start 2023-09-30T22:29:36.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7fdb5759e700 1 --2- 172.21.15.59:0/2919311256 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb5809e410 0x7fdb58130ba0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009f00 tx=0x7fdb5000d540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f538e6d1009f869 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.716+0000 7f72c6a3c700 1 -- start start 2023-09-30T22:29:36.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.717+0000 7fdb55d9b700 1 -- 172.21.15.59:0/2919311256 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000dda0 con 0x7fdb5809e410 2023-09-30T22:29:36.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.717+0000 7fdb55d9b700 1 -- 172.21.15.59:0/2919311256 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50011460 con 0x7fdb5809e410 2023-09-30T22:29:36.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.717+0000 7fdb55d9b700 1 -- 172.21.15.59:0/2919311256 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50011810 con 0x7fdb5809e410 2023-09-30T22:29:36.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.717+0000 7f72c6a3c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72c009e930 0x7f72c009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.717+0000 7f72c6a3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72c009f240 0x7f72c01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.717+0000 7f72c6a3c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c0070940 con 0x7f72c009f650 2023-09-30T22:29:36.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.717+0000 7f72c6a3c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c006fd60 con 0x7f72c009f240 2023-09-30T22:29:36.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.717+0000 7f72c6a3c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72c006fa80 con 0x7f72c009e930 2023-09-30T22:29:36.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/2919311256 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb5809e410 msgr2=0x7fdb58130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7fdb5d1f6700 1 --2- 172.21.15.59:0/2919311256 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb5809e410 0x7fdb58130ba0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009f00 tx=0x7fdb5000d540 comp rx=0 tx=0).stop 2023-09-30T22:29:36.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7f72bf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72c009f240 0x7f72c01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/2919311256 shutdown_connections 2023-09-30T22:29:36.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7fdb5d1f6700 1 --2- 172.21.15.59:0/2919311256 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb5809e410 0x7fdb58130ba0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7fdb5d1f6700 1 --2- 172.21.15.59:0/2919311256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb5809d6f0 0x7fdb5809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7f72bf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72c009f240 0x7f72c01317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38800/0 (socket says 172.21.15.59:38800) 2023-09-30T22:29:36.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7fdb5d1f6700 1 --2- 172.21.15.59:0/2919311256 >> v2:172.21.15.59:3300/0 conn(0x7fdb5809e000 0x7fdb58130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/2919311256 >> 172.21.15.59:0/2919311256 conn(0x7fdb58066f50 msgr2=0x7fdb5809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7f72bf7fe700 1 -- 172.21.15.59:0/293030943 learned_addr learned my addr 172.21.15.59:0/293030943 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/2919311256 shutdown_connections 2023-09-30T22:29:36.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/2919311256 wait complete. 2023-09-30T22:29:36.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7f72bffff700 1 --2- 172.21.15.59:0/293030943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72c009e930 0x7f72c009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7f77d67fc700 1 -- 172.21.15.59:0/1510814426 <== osd.2 v1:172.21.15.59:6808/129719 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f77c403c360 con 0x7f77c4038660 2023-09-30T22:29:36.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7f72bf7fe700 1 -- 172.21.15.59:0/293030943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72c009e930 msgr2=0x7f72c009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7f72bf7fe700 1 --2- 172.21.15.59:0/293030943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72c009e930 0x7f72c009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7f72bf7fe700 1 -- 172.21.15.59:0/293030943 >> v1:172.21.15.59:6789/0 conn(0x7f72c009f650 legacy=0x7f72c0131d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:29:36.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7f72bf7fe700 1 -- 172.21.15.59:0/293030943 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c009fb60 con 0x7f72c009f240 2023-09-30T22:29:36.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7f72bf7fe700 1 --2- 172.21.15.59:0/293030943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72c009f240 0x7f72c01317f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009920 tx=0x7f72b4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af2d091daeb17be7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7f72beffd700 1 -- 172.21.15.59:0/293030943 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4004230 con 0x7f72c009f240 2023-09-30T22:29:36.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7f72beffd700 1 -- 172.21.15.59:0/293030943 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b4004390 con 0x7f72c009f240 2023-09-30T22:29:36.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.718+0000 7f72beffd700 1 -- 172.21.15.59:0/293030943 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4009e70 con 0x7f72c009f240 2023-09-30T22:29:36.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.719+0000 7f72c6a3c700 1 -- 172.21.15.59:0/293030943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72c009f240 msgr2=0x7f72c01317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.719+0000 7f72c6a3c700 1 --2- 172.21.15.59:0/293030943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72c009f240 0x7f72c01317f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009920 tx=0x7f72b4009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:36.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7fdb5d1f6700 1 Processor -- start 2023-09-30T22:29:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7fdb5d1f6700 1 -- start start 2023-09-30T22:29:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7fdb5d1f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb5809d6f0 0x7fdb5811dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7fdb5d1f6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb5809e000 0x7fdb5811e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7fdb5d1f6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb5809e410 0x7fdb5811ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7fdb5d1f6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5811f470 con 0x7fdb5809e410 2023-09-30T22:29:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7fdb5d1f6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58130380 con 0x7fdb5809d6f0 2023-09-30T22:29:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7fdb5d1f6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58120e00 con 0x7fdb5809e000 2023-09-30T22:29:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7fdb5659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb5809e000 0x7fdb5811e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7fdb5659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb5809e000 0x7fdb5811e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36488/0 (socket says 172.21.15.59:36488) 2023-09-30T22:29:36.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7fdb5659c700 1 -- 172.21.15.59:0/1859309781 learned_addr learned my addr 172.21.15.59:0/1859309781 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7fdb56d9d700 1 --2- 172.21.15.59:0/1859309781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb5809d6f0 0x7fdb5811dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7f72c6a3c700 1 -- 172.21.15.59:0/293030943 shutdown_connections 2023-09-30T22:29:36.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7f72c6a3c700 1 --2- 172.21.15.59:0/293030943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72c009e930 0x7f72c009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7f72c6a3c700 1 --2- 172.21.15.59:0/293030943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72c009f240 0x7f72c01317f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.720+0000 7f72c6a3c700 1 -- 172.21.15.59:0/293030943 >> 172.21.15.59:0/293030943 conn(0x7f72c00a4210 msgr2=0x7f72c00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.721+0000 7fdb5759e700 1 --2- 172.21.15.59:0/1859309781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb5809e410 0x7fdb5811ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.721+0000 7fdb56d9d700 1 -- 172.21.15.59:0/1859309781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb5809e000 msgr2=0x7fdb5811e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.721+0000 7fdb56d9d700 1 --2- 172.21.15.59:0/1859309781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb5809e000 0x7fdb5811e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.721+0000 7fdb56d9d700 1 -- 172.21.15.59:0/1859309781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb5809e410 msgr2=0x7fdb5811ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.721+0000 7fdb56d9d700 1 --2- 172.21.15.59:0/1859309781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb5809e410 0x7fdb5811ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.721+0000 7fdb56d9d700 1 -- 172.21.15.59:0/1859309781 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb50009b30 con 0x7fdb5809d6f0 2023-09-30T22:29:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.721+0000 7fdb5759e700 1 --2- 172.21.15.59:0/1859309781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb5809e410 0x7fdb5811ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.721+0000 7fdb56d9d700 1 --2- 172.21.15.59:0/1859309781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb5809d6f0 0x7fdb5811dfa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800e900 tx=0x7fdb4800ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.721+0000 7fdb3f7fe700 1 -- 172.21.15.59:0/1859309781 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4800ee50 con 0x7fdb5809d6f0 2023-09-30T22:29:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.721+0000 7fdb3f7fe700 1 -- 172.21.15.59:0/1859309781 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4800c850 con 0x7fdb5809d6f0 2023-09-30T22:29:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.721+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/1859309781 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb581217e0 con 0x7fdb5809d6f0 2023-09-30T22:29:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.721+0000 7fdb3f7fe700 1 -- 172.21.15.59:0/1859309781 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4800cbc0 con 0x7fdb5809d6f0 2023-09-30T22:29:36.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.721+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/1859309781 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb581309c0 con 0x7fdb5809d6f0 2023-09-30T22:29:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.722+0000 7fdb3f7fe700 1 -- 172.21.15.59:0/1859309781 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fdb4800cd20 con 0x7fdb5809d6f0 2023-09-30T22:29:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.722+0000 7fdb3f7fe700 1 -- 172.21.15.59:0/1859309781 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fdb4803fbe0 con 0x7fdb5809d6f0 2023-09-30T22:29:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.722+0000 7fdb5659c700 1 -- 172.21.15.59:0/1859309781 >> v1:172.21.15.59:6816/126772 conn(0x7fdb4402f510 legacy=0x7fdb440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.723+0000 7f72c6a3c700 1 -- 172.21.15.59:0/293030943 shutdown_connections 2023-09-30T22:29:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.723+0000 7f72c6a3c700 1 -- 172.21.15.59:0/293030943 wait complete. 2023-09-30T22:29:36.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.723+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/1859309781 --> v1:172.21.15.59:6812/130037 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb5811b4a0 con 0x7fdb58061190 2023-09-30T22:29:36.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.724+0000 7f72c6a3c700 1 Processor -- start 2023-09-30T22:29:36.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.724+0000 7f72c6a3c700 1 -- start start 2023-09-30T22:29:36.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.725+0000 7f72c6a3c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c009e930 0x7f72c01a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.725+0000 7f72c6a3c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72c009f240 0x7f72c01a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.725+0000 7f72c6a3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72c009f650 0x7f72c006b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.725+0000 7f72c6a3c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c01a73b0 con 0x7f72c009e930 2023-09-30T22:29:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.725+0000 7f72c6a3c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c01a5f20 con 0x7f72c009f650 2023-09-30T22:29:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.725+0000 7f72c6a3c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00a37e0 con 0x7f72c009f240 2023-09-30T22:29:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.725+0000 7f72bf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72c009f240 0x7f72c01a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.725+0000 7f72bf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72c009f240 0x7f72c01a99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36494/0 (socket says 172.21.15.59:36494) 2023-09-30T22:29:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.725+0000 7f72bf7fe700 1 -- 172.21.15.59:0/3408955861 learned_addr learned my addr 172.21.15.59:0/3408955861 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.725+0000 7f72c4fd9700 1 --2- 172.21.15.59:0/3408955861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72c009f650 0x7f72c006b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.726+0000 7f72bffff700 1 --2- 172.21.15.59:0/3408955861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c009e930 0x7f72c01a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.726+0000 7f72c4fd9700 1 -- 172.21.15.59:0/3408955861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72c009f240 msgr2=0x7f72c01a99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.726+0000 7f72c4fd9700 1 --2- 172.21.15.59:0/3408955861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72c009f240 0x7f72c01a99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.726+0000 7f72c4fd9700 1 -- 172.21.15.59:0/3408955861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c009e930 msgr2=0x7f72c01a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.726+0000 7f72c4fd9700 1 --2- 172.21.15.59:0/3408955861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c009e930 0x7f72c01a94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.726+0000 7f72c4fd9700 1 -- 172.21.15.59:0/3408955861 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4009550 con 0x7f72c009f650 2023-09-30T22:29:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.726+0000 7f72bffff700 1 --2- 172.21.15.59:0/3408955861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c009e930 0x7f72c01a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:36.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.726+0000 7fdb3f7fe700 1 -- 172.21.15.59:0/1859309781 <== osd.3 v1:172.21.15.59:6812/130037 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7fdb5811b4a0 con 0x7fdb58061190 2023-09-30T22:29:36.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.726+0000 7f72c4fd9700 1 --2- 172.21.15.59:0/3408955861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72c009f650 0x7f72c006b880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f72b000b390 tx=0x7f72b000b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.726+0000 7f72bcff9700 1 -- 172.21.15.59:0/3408955861 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0011830 con 0x7f72c009f650 2023-09-30T22:29:36.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.726+0000 7f72c6a3c700 1 -- 172.21.15.59:0/3408955861 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c00a0190 con 0x7f72c009f650 2023-09-30T22:29:36.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.726+0000 7f72c6a3c700 1 -- 172.21.15.59:0/3408955861 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c01a7e20 con 0x7f72c009f650 2023-09-30T22:29:36.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.727+0000 7f72bcff9700 1 -- 172.21.15.59:0/3408955861 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0011990 con 0x7f72c009f650 2023-09-30T22:29:36.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.727+0000 7f72bcff9700 1 -- 172.21.15.59:0/3408955861 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0011d40 con 0x7f72c009f650 2023-09-30T22:29:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.728+0000 7f72c6a3c700 1 -- 172.21.15.59:0/3408955861 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f72a0000fb0 con 0x7f72c009f650 2023-09-30T22:29:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.728+0000 7f72bcff9700 1 -- 172.21.15.59:0/3408955861 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f72b001a400 con 0x7f72c009f650 2023-09-30T22:29:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.728+0000 7f72bcff9700 1 -- 172.21.15.59:0/3408955861 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f72b003fa50 con 0x7f72c009f650 2023-09-30T22:29:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.728+0000 7f72bffff700 1 -- 172.21.15.59:0/3408955861 >> v1:172.21.15.59:6816/126772 conn(0x7f72ac02f510 legacy=0x7f72ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.728+0000 7f72bcff9700 1 -- 172.21.15.59:0/3408955861 --> v1:172.21.15.59:6804/129609 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72ac03c2e0 con 0x7f72ac0385e0 2023-09-30T22:29:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.728+0000 7f72bcff9700 1 -- 172.21.15.59:0/3408955861 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72b000f2e0 con 0x7f72c009f650 2023-09-30T22:29:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.730+0000 7f72bcff9700 1 -- 172.21.15.59:0/3408955861 <== osd.1 v1:172.21.15.59:6804/129609 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f72ac03c2e0 con 0x7f72ac0385e0 2023-09-30T22:29:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.734+0000 7f71d1f10700 1 -- 172.21.15.59:0/200920456 --> v1:172.21.15.59:6800/129489 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f71cc0a1880 con 0x7f71cc1323b0 2023-09-30T22:29:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.735+0000 7f71b3fff700 1 -- 172.21.15.59:0/200920456 <== osd.0 v1:172.21.15.59:6800/129489 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1525574182) 0x7f71c4009aa0 con 0x7f71cc1323b0 2023-09-30T22:29:36.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.735+0000 7f71d1f10700 1 -- 172.21.15.59:0/200920456 >> v1:172.21.15.59:6800/129489 conn(0x7f71cc1323b0 legacy=0x7f71cc132780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.736+0000 7f71d1f10700 1 -- 172.21.15.59:0/200920456 >> v1:172.21.15.59:6816/126772 conn(0x7f71b802f510 legacy=0x7f71b80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.736+0000 7f71d1f10700 1 -- 172.21.15.59:0/200920456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc0a0a30 msgr2=0x7f71cc1c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.736+0000 7f71d1f10700 1 --2- 172.21.15.59:0/200920456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc0a0a30 0x7f71cc1c8660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f71c000e980 tx=0x7f71c000ec90 comp rx=0 tx=0).stop 2023-09-30T22:29:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.736+0000 7f71cbfff700 1 -- 172.21.15.59:0/200920456 reap_dead start 2023-09-30T22:29:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.736+0000 7f71d1f10700 1 -- 172.21.15.59:0/200920456 shutdown_connections 2023-09-30T22:29:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.736+0000 7f71d1f10700 1 -- 172.21.15.59:0/200920456 >> 172.21.15.59:0/200920456 conn(0x7f71cc0a3050 msgr2=0x7f71cc1bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.739+0000 7f71d1f10700 1 -- 172.21.15.59:0/200920456 shutdown_connections 2023-09-30T22:29:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.739+0000 7f71d1f10700 1 -- 172.21.15.59:0/200920456 wait complete. 2023-09-30T22:29:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.739+0000 7f77e7c71700 1 -- 172.21.15.59:0/1510814426 --> v1:172.21.15.59:6808/129719 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f77e00a0030 con 0x7f77c4038660 2023-09-30T22:29:36.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.740+0000 7f77d67fc700 1 -- 172.21.15.59:0/1510814426 <== osd.2 v1:172.21.15.59:6808/129719 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2909512871) 0x7f77d8003b50 con 0x7f77c4038660 2023-09-30T22:29:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.740+0000 7f77e7c71700 1 -- 172.21.15.59:0/1510814426 >> v1:172.21.15.59:6808/129719 conn(0x7f77c4038660 legacy=0x7f77c403aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.740+0000 7f77e7c71700 1 -- 172.21.15.59:0/1510814426 >> v1:172.21.15.59:6816/126772 conn(0x7f77c402f510 legacy=0x7f77c40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.740+0000 7f77e7c71700 1 -- 172.21.15.59:0/1510814426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77e01337f0 msgr2=0x7f77e012f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.740+0000 7f77e7c71700 1 --2- 172.21.15.59:0/1510814426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77e01337f0 0x7f77e012f390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77d000e940 tx=0x7f77d000ec50 comp rx=0 tx=0).stop 2023-09-30T22:29:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.740+0000 7f77e620e700 1 -- 172.21.15.59:0/1510814426 reap_dead start 2023-09-30T22:29:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.740+0000 7f77e7c71700 1 -- 172.21.15.59:0/1510814426 shutdown_connections 2023-09-30T22:29:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.740+0000 7f77e7c71700 1 -- 172.21.15.59:0/1510814426 >> 172.21.15.59:0/1510814426 conn(0x7f77e00a4210 msgr2=0x7f77e01396f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.740+0000 7f77e7c71700 1 -- 172.21.15.59:0/1510814426 shutdown_connections 2023-09-30T22:29:36.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.740+0000 7f77e7c71700 1 -- 172.21.15.59:0/1510814426 wait complete. 2023-09-30T22:29:36.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.744+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/1859309781 --> v1:172.21.15.59:6812/130037 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdb5809c450 con 0x7fdb58061190 2023-09-30T22:29:36.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.745+0000 7fdb3f7fe700 1 -- 172.21.15.59:0/1859309781 <== osd.3 v1:172.21.15.59:6812/130037 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1557062723) 0x7fdb5000dba0 con 0x7fdb58061190 2023-09-30T22:29:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.745+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/1859309781 >> v1:172.21.15.59:6812/130037 conn(0x7fdb58061190 legacy=0x7fdb58061560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.745+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/1859309781 >> v1:172.21.15.59:6816/126772 conn(0x7fdb4402f510 legacy=0x7fdb440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.745+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/1859309781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb5809d6f0 msgr2=0x7fdb5811dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.745+0000 7fdb5d1f6700 1 --2- 172.21.15.59:0/1859309781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb5809d6f0 0x7fdb5811dfa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800e900 tx=0x7fdb4800ec10 comp rx=0 tx=0).stop 2023-09-30T22:29:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.745+0000 7fdb5759e700 1 -- 172.21.15.59:0/1859309781 reap_dead start 2023-09-30T22:29:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.745+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/1859309781 shutdown_connections 2023-09-30T22:29:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.745+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/1859309781 >> 172.21.15.59:0/1859309781 conn(0x7fdb58066f50 msgr2=0x7fdb580a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.746+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/1859309781 shutdown_connections 2023-09-30T22:29:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.746+0000 7fdb5d1f6700 1 -- 172.21.15.59:0/1859309781 wait complete. 2023-09-30T22:29:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.748+0000 7f72c6a3c700 1 -- 172.21.15.59:0/3408955861 --> v1:172.21.15.59:6804/129609 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f72a0002d00 con 0x7f72ac0385e0 2023-09-30T22:29:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.749+0000 7f72bcff9700 1 -- 172.21.15.59:0/3408955861 <== osd.1 v1:172.21.15.59:6804/129609 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2909512871) 0x7f72a0002d00 con 0x7f72ac0385e0 2023-09-30T22:29:36.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.749+0000 7f72c6a3c700 1 -- 172.21.15.59:0/3408955861 >> v1:172.21.15.59:6804/129609 conn(0x7f72ac0385e0 legacy=0x7f72ac03aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.749+0000 7f72c6a3c700 1 -- 172.21.15.59:0/3408955861 >> v1:172.21.15.59:6816/126772 conn(0x7f72ac02f510 legacy=0x7f72ac0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:36.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.749+0000 7f72c6a3c700 1 -- 172.21.15.59:0/3408955861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72c009f650 msgr2=0x7f72c006b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.749+0000 7f72c6a3c700 1 --2- 172.21.15.59:0/3408955861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72c009f650 0x7f72c006b880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f72b000b390 tx=0x7f72b000b6a0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.749+0000 7f72c4fd9700 1 -- 172.21.15.59:0/3408955861 reap_dead start 2023-09-30T22:29:36.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.750+0000 7f72c6a3c700 1 -- 172.21.15.59:0/3408955861 shutdown_connections 2023-09-30T22:29:36.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.750+0000 7f72c6a3c700 1 -- 172.21.15.59:0/3408955861 >> 172.21.15.59:0/3408955861 conn(0x7f72c00a4210 msgr2=0x7f72c009e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.750+0000 7f72c6a3c700 1 -- 172.21.15.59:0/3408955861 shutdown_connections 2023-09-30T22:29:36.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.750+0000 7f72c6a3c700 1 -- 172.21.15.59:0/3408955861 wait complete. 2023-09-30T22:29:36.761 INFO:teuthology.orchestra.run.smithi059.stdout:128849018885 2023-09-30T22:29:36.761 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:36.763 INFO:teuthology.orchestra.run.smithi059.stdout:146028888068 2023-09-30T22:29:36.763 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:36.764 INFO:teuthology.orchestra.run.smithi059.stdout:137438953476 2023-09-30T22:29:36.764 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:36.767 INFO:teuthology.orchestra.run.smithi059.stdout:137438953476 2023-09-30T22:29:36.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.921+0000 7f30403af700 1 Processor -- start 2023-09-30T22:29:36.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.921+0000 7f30403af700 1 -- start start 2023-09-30T22:29:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.922+0000 7f30403af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f303809e1d0 0x7f3038135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.922+0000 7f30403af700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3038135e50 0x7f3038138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.922+0000 7f30403af700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303809f130 con 0x7f303809d6f0 2023-09-30T22:29:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.922+0000 7f30403af700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303809f520 con 0x7f3038135e50 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.922+0000 7f30403af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303809e930 con 0x7f303809e1d0 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.922+0000 7f303d94a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f303809e1d0 0x7f3038135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.922+0000 7f303d94a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f303809e1d0 0x7f3038135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38820/0 (socket says 172.21.15.59:38820) 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.922+0000 7f303d94a700 1 -- 172.21.15.59:0/2363203629 learned_addr learned my addr 172.21.15.59:0/2363203629 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.922+0000 7f303e94c700 1 --2- 172.21.15.59:0/2363203629 >> v2:172.21.15.59:3300/0 conn(0x7f3038135e50 0x7f3038138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.923+0000 7f303e94c700 1 -- 172.21.15.59:0/2363203629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f303809e1d0 msgr2=0x7f3038135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.923+0000 7f303e94c700 1 --2- 172.21.15.59:0/2363203629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f303809e1d0 0x7f3038135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.923+0000 7f303e94c700 1 -- 172.21.15.59:0/2363203629 >> v1:172.21.15.59:6789/0 conn(0x7f303809d6f0 legacy=0x7f303809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.923+0000 7f303e94c700 1 -- 172.21.15.59:0/2363203629 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303809b2d0 con 0x7f3038135e50 2023-09-30T22:29:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.923+0000 7f303d94a700 1 --2- 172.21.15.59:0/2363203629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f303809e1d0 0x7f3038135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.923+0000 7f303e94c700 1 --2- 172.21.15.59:0/2363203629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3038135e50 0x7f3038138230 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3030009dc0 tx=0x7f303000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60236b10ea080f20 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.923+0000 7f303d149700 1 -- 172.21.15.59:0/2363203629 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303000e070 con 0x7f3038135e50 2023-09-30T22:29:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.923+0000 7f303d149700 1 -- 172.21.15.59:0/2363203629 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303000bae0 con 0x7f3038135e50 2023-09-30T22:29:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.923+0000 7f303d149700 1 -- 172.21.15.59:0/2363203629 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303000be90 con 0x7f3038135e50 2023-09-30T22:29:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.924+0000 7f30403af700 1 -- 172.21.15.59:0/2363203629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3038135e50 msgr2=0x7f3038138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.924+0000 7f30403af700 1 --2- 172.21.15.59:0/2363203629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3038135e50 0x7f3038138230 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3030009dc0 tx=0x7f303000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.924+0000 7f30403af700 1 -- 172.21.15.59:0/2363203629 shutdown_connections 2023-09-30T22:29:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.924+0000 7f30403af700 1 --2- 172.21.15.59:0/2363203629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3038135e50 0x7f3038138230 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.924+0000 7f30403af700 1 --2- 172.21.15.59:0/2363203629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f303809e1d0 0x7f3038135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.924+0000 7f30403af700 1 -- 172.21.15.59:0/2363203629 >> 172.21.15.59:0/2363203629 conn(0x7f3038066f50 msgr2=0x7f303809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.924+0000 7f30403af700 1 -- 172.21.15.59:0/2363203629 shutdown_connections 2023-09-30T22:29:36.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.924+0000 7f30403af700 1 -- 172.21.15.59:0/2363203629 wait complete. 2023-09-30T22:29:36.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.925+0000 7f30403af700 1 Processor -- start 2023-09-30T22:29:36.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.925+0000 7f30403af700 1 -- start start 2023-09-30T22:29:36.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.926+0000 7f30403af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f303809d6f0 0x7f3038133f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.926+0000 7f30403af700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f303809e1d0 0x7f3038134490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.926+0000 7f30403af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3038135e50 0x7f30381349d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.926+0000 7f30403af700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303811ca30 con 0x7f303809e1d0 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.926+0000 7f30403af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303813b1c0 con 0x7f3038135e50 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.926+0000 7f30403af700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f303811afe0 con 0x7f303809d6f0 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.926+0000 7f303e94c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3038135e50 0x7f30381349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.926+0000 7f303e94c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3038135e50 0x7f30381349d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38836/0 (socket says 172.21.15.59:38836) 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.926+0000 7f303e94c700 1 -- 172.21.15.59:0/459088022 learned_addr learned my addr 172.21.15.59:0/459088022 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.926+0000 7f303e94c700 1 -- 172.21.15.59:0/459088022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f303809d6f0 msgr2=0x7f3038133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.926+0000 7f303e94c700 1 --2- 172.21.15.59:0/459088022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f303809d6f0 0x7f3038133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.927+0000 7f303e94c700 1 -- 172.21.15.59:0/459088022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f303809e1d0 msgr2=0x7f3038134490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.927+0000 7f303e94c700 1 --2- 172.21.15.59:0/459088022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f303809e1d0 0x7f3038134490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.927+0000 7f303e94c700 1 -- 172.21.15.59:0/459088022 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3028009550 con 0x7f3038135e50 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.927+0000 7f303e94c700 1 --2- 172.21.15.59:0/459088022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3038135e50 0x7f30381349d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f303000b370 tx=0x7f3030004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.927+0000 7f302effd700 1 -- 172.21.15.59:0/459088022 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030004730 con 0x7f3038135e50 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.927+0000 7f302effd700 1 -- 172.21.15.59:0/459088022 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3030020070 con 0x7f3038135e50 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.927+0000 7f30403af700 1 -- 172.21.15.59:0/459088022 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3030009a70 con 0x7f3038135e50 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.927+0000 7f302effd700 1 -- 172.21.15.59:0/459088022 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030027480 con 0x7f3038135e50 2023-09-30T22:29:36.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.928+0000 7f302effd700 1 -- 172.21.15.59:0/459088022 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3030012430 con 0x7f3038135e50 2023-09-30T22:29:36.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.928+0000 7f303e14b700 1 -- 172.21.15.59:0/459088022 >> v1:172.21.15.59:6816/126772 conn(0x7f301c02f510 legacy=0x7f301c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:36.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.928+0000 7f30403af700 1 -- 172.21.15.59:0/459088022 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303811a850 con 0x7f3038135e50 2023-09-30T22:29:36.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.928+0000 7f302effd700 1 -- 172.21.15.59:0/459088022 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f3030022070 con 0x7f3038135e50 2023-09-30T22:29:36.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.930+0000 7f30403af700 1 -- 172.21.15.59:0/459088022 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30381379c0 con 0x7f3038135e50 2023-09-30T22:29:36.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.938+0000 7f302effd700 1 -- 172.21.15.59:0/459088022 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f303811a850 con 0x7f3038135e50 2023-09-30T22:29:36.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.955+0000 7f5c51387700 1 Processor -- start 2023-09-30T22:29:36.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.956+0000 7f5c51387700 1 -- start start 2023-09-30T22:29:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.956+0000 7f5c51387700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4c09e1d0 0x7f5c4c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.956+0000 7f5c51387700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4c135e50 0x7f5c4c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.956+0000 7f5c51387700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4c09f130 con 0x7f5c4c09d6f0 2023-09-30T22:29:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.956+0000 7f5c51387700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c09f520 con 0x7f5c4c135e50 2023-09-30T22:29:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.956+0000 7f5c51387700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c09e930 con 0x7f5c4c09e1d0 2023-09-30T22:29:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.956+0000 7f5c4affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5c4c09d6f0 0x7f5c4c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58422/0 (socket says 172.21.15.59:58422) 2023-09-30T22:29:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.956+0000 7f5c4b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4c135e50 0x7f5c4c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.956+0000 7f5c4affd700 1 -- 172.21.15.59:0/3269582645 learned_addr learned my addr 172.21.15.59:0/3269582645 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.956+0000 7f5c4a7fc700 1 --2- 172.21.15.59:0/3269582645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4c09e1d0 0x7f5c4c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.957+0000 7f5c49ffb700 1 -- 172.21.15.59:0/3269582645 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106053299 0 0) 0x7f5c4c09f130 con 0x7f5c4c09d6f0 2023-09-30T22:29:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.957+0000 7f5c4b7fe700 1 -- 172.21.15.59:0/3269582645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4c09e1d0 msgr2=0x7f5c4c135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.957+0000 7f5c4b7fe700 1 --2- 172.21.15.59:0/3269582645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4c09e1d0 0x7f5c4c135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.957+0000 7f5c4b7fe700 1 -- 172.21.15.59:0/3269582645 >> v1:172.21.15.59:6789/0 conn(0x7f5c4c09d6f0 legacy=0x7f5c4c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.957+0000 7f5c4b7fe700 1 -- 172.21.15.59:0/3269582645 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c09b2d0 con 0x7f5c4c135e50 2023-09-30T22:29:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.957+0000 7f5c4b7fe700 1 --2- 172.21.15.59:0/3269582645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4c135e50 0x7f5c4c138230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009dc0 tx=0x7f5c4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40ada1300bad70d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.957+0000 7f5c49ffb700 1 -- 172.21.15.59:0/3269582645 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400e070 con 0x7f5c4c135e50 2023-09-30T22:29:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.957+0000 7f5c49ffb700 1 -- 172.21.15.59:0/3269582645 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4400bb20 con 0x7f5c4c135e50 2023-09-30T22:29:36.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.957+0000 7f5c49ffb700 1 -- 172.21.15.59:0/3269582645 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44012430 con 0x7f5c4c135e50 2023-09-30T22:29:36.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.958+0000 7f5c51387700 1 -- 172.21.15.59:0/3269582645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4c135e50 msgr2=0x7f5c4c138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.958+0000 7f5c51387700 1 --2- 172.21.15.59:0/3269582645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4c135e50 0x7f5c4c138230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009dc0 tx=0x7f5c4400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:36.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.958+0000 7f5c51387700 1 -- 172.21.15.59:0/3269582645 shutdown_connections 2023-09-30T22:29:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.958+0000 7f5c51387700 1 --2- 172.21.15.59:0/3269582645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4c135e50 0x7f5c4c138230 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.958+0000 7f5c51387700 1 --2- 172.21.15.59:0/3269582645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4c09e1d0 0x7f5c4c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.958+0000 7f5c51387700 1 -- 172.21.15.59:0/3269582645 >> 172.21.15.59:0/3269582645 conn(0x7f5c4c066f50 msgr2=0x7f5c4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.958+0000 7f5c51387700 1 -- 172.21.15.59:0/3269582645 shutdown_connections 2023-09-30T22:29:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.958+0000 7f9e7a07d700 1 Processor -- start 2023-09-30T22:29:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.958+0000 7f9e7a07d700 1 -- start start 2023-09-30T22:29:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.959+0000 7f9e7a07d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7409e1d0 0x7f9e74138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.959+0000 7f9e7a07d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e74139170 0x7f9e7413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.959+0000 7f9e7a07d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7409b120 con 0x7f9e7409d6f0 2023-09-30T22:29:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.959+0000 7f9e7a07d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7406b460 con 0x7f9e7409e1d0 2023-09-30T22:29:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.959+0000 7f9e7a07d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7409a7e0 con 0x7f9e74139170 2023-09-30T22:29:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.959+0000 7f9e72ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7409e1d0 0x7f9e74138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.959+0000 7f9e72ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7409e1d0 0x7f9e74138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38858/0 (socket says 172.21.15.59:38858) 2023-09-30T22:29:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.959+0000 7f9e737fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9e7409d6f0 0x7f9e7409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58430/0 (socket says 172.21.15.59:58430) 2023-09-30T22:29:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.959+0000 7f9e72ffd700 1 -- 172.21.15.59:0/2370114935 learned_addr learned my addr 172.21.15.59:0/2370114935 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.959+0000 7f9e73fff700 1 --2- 172.21.15.59:0/2370114935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e74139170 0x7f9e7413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.959+0000 7f5c51387700 1 -- 172.21.15.59:0/3269582645 wait complete. 2023-09-30T22:29:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.960+0000 7f9e73fff700 1 -- 172.21.15.59:0/2370114935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7409e1d0 msgr2=0x7f9e74138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.960+0000 7f9e73fff700 1 --2- 172.21.15.59:0/2370114935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7409e1d0 0x7f9e74138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.960+0000 7f9e73fff700 1 -- 172.21.15.59:0/2370114935 >> v1:172.21.15.59:6789/0 conn(0x7f9e7409d6f0 legacy=0x7f9e7409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.960+0000 7f9e727fc700 1 -- 172.21.15.59:0/2370114935 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306972170 0 0) 0x7f9e7409b120 con 0x7f9e7409d6f0 2023-09-30T22:29:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.960+0000 7f9e73fff700 1 -- 172.21.15.59:0/2370114935 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7409a500 con 0x7f9e74139170 2023-09-30T22:29:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.960+0000 7f9e73fff700 1 --2- 172.21.15.59:0/2370114935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e74139170 0x7f9e7413b550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009df0 tx=0x7f9e6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4be5816f6194cd2e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.960+0000 7f9e727fc700 1 -- 172.21.15.59:0/2370114935 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c00e070 con 0x7f9e74139170 2023-09-30T22:29:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.960+0000 7f9e727fc700 1 -- 172.21.15.59:0/2370114935 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6c00bb90 con 0x7f9e74139170 2023-09-30T22:29:36.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.960+0000 7f9e727fc700 1 -- 172.21.15.59:0/2370114935 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c012430 con 0x7f9e74139170 2023-09-30T22:29:36.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.961+0000 7f9e7a07d700 1 -- 172.21.15.59:0/2370114935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e74139170 msgr2=0x7f9e7413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.961+0000 7f9e7a07d700 1 --2- 172.21.15.59:0/2370114935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e74139170 0x7f9e7413b550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009df0 tx=0x7f9e6c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:36.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.961+0000 7f5c51387700 1 Processor -- start 2023-09-30T22:29:36.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.961+0000 7f9e7a07d700 1 -- 172.21.15.59:0/2370114935 shutdown_connections 2023-09-30T22:29:36.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.961+0000 7f9e7a07d700 1 --2- 172.21.15.59:0/2370114935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e74139170 0x7f9e7413b550 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.961+0000 7f9e7a07d700 1 --2- 172.21.15.59:0/2370114935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7409e1d0 0x7f9e74138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.961+0000 7f9e7a07d700 1 -- 172.21.15.59:0/2370114935 >> 172.21.15.59:0/2370114935 conn(0x7f9e74066f50 msgr2=0x7f9e7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.961+0000 7f9e7a07d700 1 -- 172.21.15.59:0/2370114935 shutdown_connections 2023-09-30T22:29:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.961+0000 7f5c51387700 1 -- start start 2023-09-30T22:29:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c51387700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4c09d6f0 0x7f5c4c1c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c51387700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4c09e1d0 0x7f5c4c1c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c51387700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4c135e50 0x7f5c4c1c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c51387700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c11cbf0 con 0x7f5c4c135e50 2023-09-30T22:29:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c51387700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c1c5a40 con 0x7f5c4c09e1d0 2023-09-30T22:29:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c51387700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c135ce0 con 0x7f5c4c09d6f0 2023-09-30T22:29:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c4affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4c09d6f0 0x7f5c4c1c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c4affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4c09d6f0 0x7f5c4c1c4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36524/0 (socket says 172.21.15.59:36524) 2023-09-30T22:29:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c4affd700 1 -- 172.21.15.59:0/3546994401 learned_addr learned my addr 172.21.15.59:0/3546994401 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c4a7fc700 1 --2- 172.21.15.59:0/3546994401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4c09e1d0 0x7f5c4c1c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f9e7a07d700 1 -- 172.21.15.59:0/2370114935 wait complete. 2023-09-30T22:29:36.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c4b7fe700 1 --2- 172.21.15.59:0/3546994401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4c135e50 0x7f5c4c1c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c4a7fc700 1 -- 172.21.15.59:0/3546994401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4c09d6f0 msgr2=0x7f5c4c1c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c4a7fc700 1 --2- 172.21.15.59:0/3546994401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4c09d6f0 0x7f5c4c1c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c4a7fc700 1 -- 172.21.15.59:0/3546994401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4c135e50 msgr2=0x7f5c4c1c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c4a7fc700 1 --2- 172.21.15.59:0/3546994401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4c135e50 0x7f5c4c1c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.962+0000 7f5c4a7fc700 1 -- 172.21.15.59:0/3546994401 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c44009a70 con 0x7f5c4c09e1d0 2023-09-30T22:29:36.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.963+0000 7f5c4a7fc700 1 --2- 172.21.15.59:0/3546994401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4c09e1d0 0x7f5c4c1c5500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000e900 tx=0x7f5c4000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.963+0000 7f5c337fe700 1 -- 172.21.15.59:0/3546994401 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000ee50 con 0x7f5c4c09e1d0 2023-09-30T22:29:36.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.963+0000 7f5c337fe700 1 -- 172.21.15.59:0/3546994401 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4000c850 con 0x7f5c4c09e1d0 2023-09-30T22:29:36.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.963+0000 7f5c51387700 1 -- 172.21.15.59:0/3546994401 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c09c700 con 0x7f5c4c09e1d0 2023-09-30T22:29:36.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.963+0000 7f5c51387700 1 -- 172.21.15.59:0/3546994401 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c11c110 con 0x7f5c4c09e1d0 2023-09-30T22:29:36.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.963+0000 7f9e7a07d700 1 Processor -- start 2023-09-30T22:29:36.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.964+0000 7f5c337fe700 1 -- 172.21.15.59:0/3546994401 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000cbc0 con 0x7f5c4c09e1d0 2023-09-30T22:29:36.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.964+0000 7f5c337fe700 1 -- 172.21.15.59:0/3546994401 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5c40013470 con 0x7f5c4c09e1d0 2023-09-30T22:29:36.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.965+0000 7f5c337fe700 1 -- 172.21.15.59:0/3546994401 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f5c4003fd70 con 0x7f5c4c09e1d0 2023-09-30T22:29:36.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.965+0000 7f5c4affd700 1 -- 172.21.15.59:0/3546994401 >> v1:172.21.15.59:6816/126772 conn(0x7f5c3802f540 legacy=0x7f5c380319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:36.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.965+0000 7f9e7a07d700 1 -- start start 2023-09-30T22:29:36.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.965+0000 7f9e7a07d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7409d6f0 0x7f9e741194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.965+0000 7f9e7a07d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7409e1d0 0x7f9e741199f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.965+0000 7f9e7a07d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e74139170 0x7f9e74119f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.965+0000 7f9e7a07d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7411ccf0 con 0x7f9e7409d6f0 2023-09-30T22:29:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.965+0000 7f9e7a07d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740a3a20 con 0x7f9e7409e1d0 2023-09-30T22:29:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.965+0000 7f9e7a07d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7411b0c0 con 0x7f9e74139170 2023-09-30T22:29:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.965+0000 7f9e73fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e74139170 0x7f9e74119f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.965+0000 7f9e72ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7409e1d0 0x7f9e741199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.965+0000 7f9e73fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e74139170 0x7f9e74119f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36540/0 (socket says 172.21.15.59:36540) 2023-09-30T22:29:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.965+0000 7f9e73fff700 1 -- 172.21.15.59:0/3363610737 learned_addr learned my addr 172.21.15.59:0/3363610737 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.966+0000 7f5c51387700 1 -- 172.21.15.59:0/3546994401 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c11cd30 con 0x7f5c4c09e1d0 2023-09-30T22:29:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.966+0000 7f9e737fe700 1 --2- 172.21.15.59:0/3363610737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7409d6f0 0x7f9e741194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.966+0000 7f9e737fe700 1 -- 172.21.15.59:0/3363610737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e74139170 msgr2=0x7f9e74119f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.966+0000 7f9e737fe700 1 --2- 172.21.15.59:0/3363610737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e74139170 0x7f9e74119f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.966+0000 7f9e737fe700 1 -- 172.21.15.59:0/3363610737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7409e1d0 msgr2=0x7f9e741199f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.966+0000 7f9e737fe700 1 --2- 172.21.15.59:0/3363610737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7409e1d0 0x7f9e741199f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.966+0000 7f9e737fe700 1 -- 172.21.15.59:0/3363610737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c009a70 con 0x7f9e7409d6f0 2023-09-30T22:29:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.966+0000 7f9e737fe700 1 --2- 172.21.15.59:0/3363610737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7409d6f0 0x7f9e741194b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9e6400c4e0 tx=0x7f9e6400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.966+0000 7f9e5bfff700 1 -- 172.21.15.59:0/3363610737 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e64004c80 con 0x7f9e7409d6f0 2023-09-30T22:29:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.967+0000 7f9e5bfff700 1 -- 172.21.15.59:0/3363610737 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e64004de0 con 0x7f9e7409d6f0 2023-09-30T22:29:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.967+0000 7f9e5bfff700 1 -- 172.21.15.59:0/3363610737 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e64007310 con 0x7f9e7409d6f0 2023-09-30T22:29:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.967+0000 7f9e7a07d700 1 -- 172.21.15.59:0/3363610737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7411b8b0 con 0x7f9e7409d6f0 2023-09-30T22:29:36.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.967+0000 7f9e7a07d700 1 -- 172.21.15.59:0/3363610737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e741cc580 con 0x7f9e7409d6f0 2023-09-30T22:29:36.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.968+0000 7f9e5bfff700 1 -- 172.21.15.59:0/3363610737 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9e64007470 con 0x7f9e7409d6f0 2023-09-30T22:29:36.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.968+0000 7f9e7a07d700 1 -- 172.21.15.59:0/3363610737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7411cb30 con 0x7f9e7409d6f0 2023-09-30T22:29:36.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.968+0000 7f9e5bfff700 1 -- 172.21.15.59:0/3363610737 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f9e6403f750 con 0x7f9e7409d6f0 2023-09-30T22:29:36.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.969+0000 7f9e72ffd700 1 -- 172.21.15.59:0/3363610737 >> v1:172.21.15.59:6816/126772 conn(0x7f9e6002f540 legacy=0x7f9e600319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:36.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.972+0000 7f0365d5d700 1 Processor -- start 2023-09-30T22:29:36.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.972+0000 7f5c337fe700 1 -- 172.21.15.59:0/3546994401 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c4c11cd30 con 0x7f5c4c09e1d0 2023-09-30T22:29:36.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.972+0000 7f0365d5d700 1 -- start start 2023-09-30T22:29:36.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.972+0000 7f0365d5d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f036009de00 0x7f036009e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.972+0000 7f0365d5d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f036013d1f0 0x7f036013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.972+0000 7f0365d5d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036009a810 con 0x7f036006a770 2023-09-30T22:29:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.972+0000 7f0365d5d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036006ab40 con 0x7f036009de00 2023-09-30T22:29:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.972+0000 7f0365d5d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f036009ebc0 con 0x7f036013d1f0 2023-09-30T22:29:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.972+0000 7f035effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f036009de00 0x7f036009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.973+0000 7f035effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f036009de00 0x7f036009e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57048/0 (socket says 172.21.15.59:57048) 2023-09-30T22:29:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.973+0000 7f035effd700 1 -- 172.21.15.59:0/4288479507 learned_addr learned my addr 172.21.15.59:0/4288479507 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.973+0000 7f035ffff700 1 --2- 172.21.15.59:0/4288479507 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f036013d1f0 0x7f036013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.973+0000 7f035effd700 1 -- 172.21.15.59:0/4288479507 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f036013d1f0 msgr2=0x7f036013f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.973+0000 7f035effd700 1 --2- 172.21.15.59:0/4288479507 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f036013d1f0 0x7f036013f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.973+0000 7f035effd700 1 -- 172.21.15.59:0/4288479507 >> v1:172.21.15.59:6789/0 conn(0x7f036006a770 legacy=0x7f036009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.973+0000 7f035effd700 1 -- 172.21.15.59:0/4288479507 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036009e920 con 0x7f036009de00 2023-09-30T22:29:36.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.973+0000 7f035effd700 1 --2- 172.21.15.59:0/4288479507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036009de00 0x7f036009e250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f03540098f0 tx=0x7f0354009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc264139f6aac1a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.974+0000 7f035e7fc700 1 -- 172.21.15.59:0/4288479507 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0354004230 con 0x7f036009de00 2023-09-30T22:29:36.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.974+0000 7f035e7fc700 1 -- 172.21.15.59:0/4288479507 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0354004390 con 0x7f036009de00 2023-09-30T22:29:36.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.974+0000 7f035e7fc700 1 -- 172.21.15.59:0/4288479507 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03540036a0 con 0x7f036009de00 2023-09-30T22:29:36.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.974+0000 7f9e5bfff700 1 -- 172.21.15.59:0/3363610737 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e640133c0 con 0x7f9e7409d6f0 2023-09-30T22:29:36.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.975+0000 7f0365d5d700 1 -- 172.21.15.59:0/4288479507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036009de00 msgr2=0x7f036009e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.975+0000 7f0365d5d700 1 --2- 172.21.15.59:0/4288479507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036009de00 0x7f036009e250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f03540098f0 tx=0x7f0354009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.982+0000 7f0365d5d700 1 -- 172.21.15.59:0/4288479507 shutdown_connections 2023-09-30T22:29:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.982+0000 7f0365d5d700 1 --2- 172.21.15.59:0/4288479507 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f036013d1f0 0x7f036013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.982+0000 7f0365d5d700 1 --2- 172.21.15.59:0/4288479507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036009de00 0x7f036009e250 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.982+0000 7f0365d5d700 1 -- 172.21.15.59:0/4288479507 >> 172.21.15.59:0/4288479507 conn(0x7f0360066f50 msgr2=0x7f036009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.982+0000 7f0365d5d700 1 -- 172.21.15.59:0/4288479507 shutdown_connections 2023-09-30T22:29:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.982+0000 7f0365d5d700 1 -- 172.21.15.59:0/4288479507 wait complete. 2023-09-30T22:29:36.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.983+0000 7f0365d5d700 1 Processor -- start 2023-09-30T22:29:36.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.985+0000 7f0365d5d700 1 -- start start 2023-09-30T22:29:36.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.985+0000 7f0365d5d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036006a770 0x7f036013bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.985+0000 7f0365d5d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f036009de00 0x7f036013c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.985+0000 7f0365d5d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f036013d1f0 0x7f036013c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.985+0000 7f0365d5d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036011df70 con 0x7f036006a770 2023-09-30T22:29:36.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.985+0000 7f0365d5d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036013ce00 con 0x7f036013d1f0 2023-09-30T22:29:36.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.985+0000 7f0365d5d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f036011ef20 con 0x7f036009de00 2023-09-30T22:29:36.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.986+0000 7f035f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036006a770 0x7f036013bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.986+0000 7f035f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036006a770 0x7f036013bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57058/0 (socket says 172.21.15.59:57058) 2023-09-30T22:29:36.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.986+0000 7f035f7fe700 1 -- 172.21.15.59:0/1221251787 learned_addr learned my addr 172.21.15.59:0/1221251787 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:36.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.986+0000 7f035ffff700 1 --2- 172.21.15.59:0/1221251787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f036013d1f0 0x7f036013c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.986+0000 7f035f7fe700 1 -- 172.21.15.59:0/1221251787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f036009de00 msgr2=0x7f036013c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.986+0000 7f035f7fe700 1 --2- 172.21.15.59:0/1221251787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f036009de00 0x7f036013c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.986+0000 7f035f7fe700 1 -- 172.21.15.59:0/1221251787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f036013d1f0 msgr2=0x7f036013c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.986+0000 7f035f7fe700 1 --2- 172.21.15.59:0/1221251787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f036013d1f0 0x7f036013c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.986+0000 7f035f7fe700 1 -- 172.21.15.59:0/1221251787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0354009550 con 0x7f036006a770 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.987+0000 7f035f7fe700 1 --2- 172.21.15.59:0/1221251787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036006a770 0x7f036013bac0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f035000c4d0 tx=0x7f035000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.987+0000 7f0347fff700 1 -- 172.21.15.59:0/1221251787 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500054e0 con 0x7f036006a770 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.987+0000 7f0365d5d700 1 -- 172.21.15.59:0/1221251787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036013f850 con 0x7f036006a770 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.987+0000 7f0347fff700 1 -- 172.21.15.59:0/1221251787 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0350003680 con 0x7f036006a770 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.987+0000 7f0347fff700 1 -- 172.21.15.59:0/1221251787 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350003a30 con 0x7f036006a770 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.987+0000 7f0365d5d700 1 -- 172.21.15.59:0/1221251787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036011e7c0 con 0x7f036006a770 2023-09-30T22:29:36.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.988+0000 7f0365d5d700 1 -- 172.21.15.59:0/1221251787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f036011d970 con 0x7f036006a770 2023-09-30T22:29:36.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.989+0000 7f0347fff700 1 -- 172.21.15.59:0/1221251787 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0350003b90 con 0x7f036006a770 2023-09-30T22:29:36.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.989+0000 7f0347fff700 1 -- 172.21.15.59:0/1221251787 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f035003eb70 con 0x7f036006a770 2023-09-30T22:29:36.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.989+0000 7f035effd700 1 -- 172.21.15.59:0/1221251787 >> v1:172.21.15.59:6816/126772 conn(0x7f034c02f510 legacy=0x7f034c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:36.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:36.998+0000 7f0347fff700 1 -- 172.21.15.59:0/1221251787 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f035001a360 con 0x7f036006a770 2023-09-30T22:29:37.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.129+0000 7f303e14b700 1 -- 172.21.15.59:0/459088022 >> v1:172.21.15.59:6816/126772 conn(0x7f301c02f510 legacy=0x7f301c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:37.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.154+0000 7f30403af700 1 -- 172.21.15.59:0/459088022 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f303811a850 con 0x7f3038135e50 2023-09-30T22:29:37.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.154+0000 7f302effd700 1 -- 172.21.15.59:0/459088022 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f303811a850 con 0x7f3038135e50 2023-09-30T22:29:37.155 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.158+0000 7f30403af700 1 -- 172.21.15.59:0/459088022 >> v1:172.21.15.59:6816/126772 conn(0x7f301c02f510 legacy=0x7f301c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.158+0000 7f30403af700 1 -- 172.21.15.59:0/459088022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3038135e50 msgr2=0x7f30381349d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.158+0000 7f30403af700 1 --2- 172.21.15.59:0/459088022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3038135e50 0x7f30381349d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f303000b370 tx=0x7f3030004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.158+0000 7f30403af700 1 -- 172.21.15.59:0/459088022 shutdown_connections 2023-09-30T22:29:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.158+0000 7f30403af700 1 --2- 172.21.15.59:0/459088022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f303809d6f0 0x7f3038133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.158+0000 7f30403af700 1 --2- 172.21.15.59:0/459088022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3038135e50 0x7f30381349d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.158+0000 7f30403af700 1 --2- 172.21.15.59:0/459088022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f303809e1d0 0x7f3038134490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.158+0000 7f30403af700 1 -- 172.21.15.59:0/459088022 >> 172.21.15.59:0/459088022 conn(0x7f3038066f50 msgr2=0x7f303809a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.158+0000 7f30403af700 1 -- 172.21.15.59:0/459088022 shutdown_connections 2023-09-30T22:29:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.158+0000 7f30403af700 1 -- 172.21.15.59:0/459088022 wait complete. 2023-09-30T22:29:37.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.166+0000 7f5c4affd700 1 -- 172.21.15.59:0/3546994401 >> v1:172.21.15.59:6816/126772 conn(0x7f5c3802f540 legacy=0x7f5c380319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:37.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.170+0000 7f9e72ffd700 1 -- 172.21.15.59:0/3363610737 >> v1:172.21.15.59:6816/126772 conn(0x7f9e6002f540 legacy=0x7f9e600319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:37.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.188+0000 7f9e7a07d700 1 -- 172.21.15.59:0/3363610737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9e74074ea0 con 0x7f9e7409d6f0 2023-09-30T22:29:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.188+0000 7f9e5bfff700 1 -- 172.21.15.59:0/3363610737 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e6401b340 con 0x7f9e7409d6f0 2023-09-30T22:29:37.188 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.190+0000 7f035effd700 1 -- 172.21.15.59:0/1221251787 >> v1:172.21.15.59:6816/126772 conn(0x7f034c02f510 legacy=0x7f034c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:37.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.191+0000 7f9e7a07d700 1 -- 172.21.15.59:0/3363610737 >> v1:172.21.15.59:6816/126772 conn(0x7f9e6002f540 legacy=0x7f9e600319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:37.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.191+0000 7f9e7a07d700 1 -- 172.21.15.59:0/3363610737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7409d6f0 msgr2=0x7f9e741194b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:37.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.191+0000 7f9e7a07d700 1 --2- 172.21.15.59:0/3363610737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7409d6f0 0x7f9e741194b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9e6400c4e0 tx=0x7f9e6400c7f0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.191+0000 7f9e7a07d700 1 -- 172.21.15.59:0/3363610737 shutdown_connections 2023-09-30T22:29:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.191+0000 7f9e7a07d700 1 --2- 172.21.15.59:0/3363610737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e74139170 0x7f9e74119f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.191+0000 7f9e7a07d700 1 --2- 172.21.15.59:0/3363610737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7409d6f0 0x7f9e741194b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.191+0000 7f9e7a07d700 1 --2- 172.21.15.59:0/3363610737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7409e1d0 0x7f9e741199f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.191+0000 7f9e7a07d700 1 -- 172.21.15.59:0/3363610737 >> 172.21.15.59:0/3363610737 conn(0x7f9e74066f50 msgr2=0x7f9e74136a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.191+0000 7f9e7a07d700 1 -- 172.21.15.59:0/3363610737 shutdown_connections 2023-09-30T22:29:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.191+0000 7f9e7a07d700 1 -- 172.21.15.59:0/3363610737 wait complete. 2023-09-30T22:29:37.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:37.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.204+0000 7f5c51387700 1 -- 172.21.15.59:0/3546994401 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5c4c11cd30 con 0x7f5c4c09e1d0 2023-09-30T22:29:37.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.205+0000 7f5c337fe700 1 -- 172.21.15.59:0/3546994401 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c4c11cd30 con 0x7f5c4c09e1d0 2023-09-30T22:29:37.206 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:37.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.207+0000 7f5c51387700 1 -- 172.21.15.59:0/3546994401 >> v1:172.21.15.59:6816/126772 conn(0x7f5c3802f540 legacy=0x7f5c380319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.207+0000 7f5c51387700 1 -- 172.21.15.59:0/3546994401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4c09e1d0 msgr2=0x7f5c4c1c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.207+0000 7f5c51387700 1 --2- 172.21.15.59:0/3546994401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4c09e1d0 0x7f5c4c1c5500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000e900 tx=0x7f5c4000ec10 comp rx=0 tx=0).stop 2023-09-30T22:29:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.207+0000 7f5c51387700 1 -- 172.21.15.59:0/3546994401 shutdown_connections 2023-09-30T22:29:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.207+0000 7f5c51387700 1 --2- 172.21.15.59:0/3546994401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4c09d6f0 0x7f5c4c1c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.207+0000 7f5c51387700 1 --2- 172.21.15.59:0/3546994401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4c135e50 0x7f5c4c1c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.207+0000 7f5c51387700 1 --2- 172.21.15.59:0/3546994401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4c09e1d0 0x7f5c4c1c5500 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.207+0000 7f5c51387700 1 -- 172.21.15.59:0/3546994401 >> 172.21.15.59:0/3546994401 conn(0x7f5c4c066f50 msgr2=0x7f5c4c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:37.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.207+0000 7f5c51387700 1 -- 172.21.15.59:0/3546994401 shutdown_connections 2023-09-30T22:29:37.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.207+0000 7f5c51387700 1 -- 172.21.15.59:0/3546994401 wait complete. 2023-09-30T22:29:37.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:37.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.236+0000 7f0365d5d700 1 -- 172.21.15.59:0/1221251787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f036013f850 con 0x7f036006a770 2023-09-30T22:29:37.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.236+0000 7f0347fff700 1 -- 172.21.15.59:0/1221251787 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f036013f850 con 0x7f036006a770 2023-09-30T22:29:37.236 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.238+0000 7f0365d5d700 1 -- 172.21.15.59:0/1221251787 >> v1:172.21.15.59:6816/126772 conn(0x7f034c02f510 legacy=0x7f034c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.238+0000 7f0365d5d700 1 -- 172.21.15.59:0/1221251787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036006a770 msgr2=0x7f036013bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.238+0000 7f0365d5d700 1 --2- 172.21.15.59:0/1221251787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036006a770 0x7f036013bac0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f035000c4d0 tx=0x7f035000c890 comp rx=0 tx=0).stop 2023-09-30T22:29:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.238+0000 7f0365d5d700 1 -- 172.21.15.59:0/1221251787 shutdown_connections 2023-09-30T22:29:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.238+0000 7f0365d5d700 1 --2- 172.21.15.59:0/1221251787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f036013d1f0 0x7f036013c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.239+0000 7f0365d5d700 1 --2- 172.21.15.59:0/1221251787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f036006a770 0x7f036013bac0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.239+0000 7f0365d5d700 1 --2- 172.21.15.59:0/1221251787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f036009de00 0x7f036013c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.239+0000 7f0365d5d700 1 -- 172.21.15.59:0/1221251787 >> 172.21.15.59:0/1221251787 conn(0x7f0360066f50 msgr2=0x7f036009b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:37.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.239+0000 7f0365d5d700 1 -- 172.21.15.59:0/1221251787 shutdown_connections 2023-09-30T22:29:37.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:37.239+0000 7f0365d5d700 1 -- 172.21.15.59:0/1221251787 wait complete. 2023-09-30T22:29:37.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:38.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:38.206 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:38.222 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:38.253 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:38.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.355+0000 7f52e1a45700 1 Processor -- start 2023-09-30T22:29:38.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.355+0000 7f52e1a45700 1 -- start start 2023-09-30T22:29:38.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.356+0000 7f52e1a45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52dc09e1d0 0x7f52dc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.356+0000 7f52e1a45700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52dc139170 0x7f52dc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.356+0000 7f52e1a45700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc09b120 con 0x7f52dc09d6f0 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.356+0000 7f52e1a45700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc06b460 con 0x7f52dc09e1d0 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.356+0000 7f52e1a45700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc09a7e0 con 0x7f52dc139170 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.356+0000 7f52da7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52dc09e1d0 0x7f52dc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.356+0000 7f52da7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52dc09e1d0 0x7f52dc138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38896/0 (socket says 172.21.15.59:38896) 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.356+0000 7f52da7fc700 1 -- 172.21.15.59:0/662057061 learned_addr learned my addr 172.21.15.59:0/662057061 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:38.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.356+0000 7f52db7fe700 1 --2- 172.21.15.59:0/662057061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52dc139170 0x7f52dc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.357+0000 7f52d9ffb700 1 -- 172.21.15.59:0/662057061 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319350628 0 0) 0x7f52dc09b120 con 0x7f52dc09d6f0 2023-09-30T22:29:38.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.357+0000 7f52d9ffb700 1 -- 172.21.15.59:0/662057061 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c40035b0 con 0x7f52dc09d6f0 2023-09-30T22:29:38.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.357+0000 7f52da7fc700 1 -- 172.21.15.59:0/662057061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52dc139170 msgr2=0x7f52dc13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:38.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.357+0000 7f52da7fc700 1 --2- 172.21.15.59:0/662057061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52dc139170 0x7f52dc13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.357+0000 7f52da7fc700 1 -- 172.21.15.59:0/662057061 >> v1:172.21.15.59:6789/0 conn(0x7f52dc09d6f0 legacy=0x7f52dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.357+0000 7f52da7fc700 1 -- 172.21.15.59:0/662057061 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc09a500 con 0x7f52dc09e1d0 2023-09-30T22:29:38.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.357+0000 7f52da7fc700 1 --2- 172.21.15.59:0/662057061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52dc09e1d0 0x7f52dc138c30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009920 tx=0x7f52d0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1b2c7b7b9e45b30 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.357+0000 7f52d9ffb700 1 -- 172.21.15.59:0/662057061 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0014e90 con 0x7f52dc09e1d0 2023-09-30T22:29:38.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.357+0000 7f52d9ffb700 1 -- 172.21.15.59:0/662057061 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d001c440 con 0x7f52dc09e1d0 2023-09-30T22:29:38.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.357+0000 7f52d9ffb700 1 -- 172.21.15.59:0/662057061 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d001c7d0 con 0x7f52dc09e1d0 2023-09-30T22:29:38.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.358+0000 7f52e1a45700 1 -- 172.21.15.59:0/662057061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52dc09e1d0 msgr2=0x7f52dc138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.359+0000 7f52e1a45700 1 --2- 172.21.15.59:0/662057061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52dc09e1d0 0x7f52dc138c30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009920 tx=0x7f52d0009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:38.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.359+0000 7f52e1a45700 1 -- 172.21.15.59:0/662057061 shutdown_connections 2023-09-30T22:29:38.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.359+0000 7f52e1a45700 1 --2- 172.21.15.59:0/662057061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52dc139170 0x7f52dc13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.359+0000 7f52e1a45700 1 --2- 172.21.15.59:0/662057061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52dc09e1d0 0x7f52dc138c30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.359+0000 7f52e1a45700 1 -- 172.21.15.59:0/662057061 >> 172.21.15.59:0/662057061 conn(0x7f52dc066f50 msgr2=0x7f52dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.359+0000 7f52e1a45700 1 -- 172.21.15.59:0/662057061 shutdown_connections 2023-09-30T22:29:38.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.359+0000 7f52e1a45700 1 -- 172.21.15.59:0/662057061 wait complete. 2023-09-30T22:29:38.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.360+0000 7f52e1a45700 1 Processor -- start 2023-09-30T22:29:38.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.360+0000 7f52e1a45700 1 -- start start 2023-09-30T22:29:38.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.360+0000 7f52e1a45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52dc09d6f0 0x7f52dc135c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.360+0000 7f52e1a45700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52dc09e1d0 0x7f52dc136170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.360+0000 7f52e1a45700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52dc139170 0x7f52dc1366b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.361+0000 7f52e1a45700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc138ee0 con 0x7f52dc09e1d0 2023-09-30T22:29:38.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.361+0000 7f52e1a45700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc137e60 con 0x7f52dc09d6f0 2023-09-30T22:29:38.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.361+0000 7f52e1a45700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc09c780 con 0x7f52dc139170 2023-09-30T22:29:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.361+0000 7f52da7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52dc09e1d0 0x7f52dc136170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.361+0000 7f52da7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52dc09e1d0 0x7f52dc136170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57064/0 (socket says 172.21.15.59:57064) 2023-09-30T22:29:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.361+0000 7f52da7fc700 1 -- 172.21.15.59:0/2861196716 learned_addr learned my addr 172.21.15.59:0/2861196716 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.361+0000 7f52daffd700 1 --2- 172.21.15.59:0/2861196716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52dc09d6f0 0x7f52dc135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.361+0000 7f52db7fe700 1 --2- 172.21.15.59:0/2861196716 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52dc139170 0x7f52dc1366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.361+0000 7f52da7fc700 1 -- 172.21.15.59:0/2861196716 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52dc139170 msgr2=0x7f52dc1366b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.361+0000 7f52da7fc700 1 --2- 172.21.15.59:0/2861196716 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52dc139170 0x7f52dc1366b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.361+0000 7f52da7fc700 1 -- 172.21.15.59:0/2861196716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52dc09d6f0 msgr2=0x7f52dc135c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.361+0000 7f52da7fc700 1 --2- 172.21.15.59:0/2861196716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52dc09d6f0 0x7f52dc135c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.361+0000 7f52da7fc700 1 -- 172.21.15.59:0/2861196716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d0009550 con 0x7f52dc09e1d0 2023-09-30T22:29:38.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.361+0000 7f52db7fe700 1 --2- 172.21.15.59:0/2861196716 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52dc139170 0x7f52dc1366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.361+0000 7f52da7fc700 1 --2- 172.21.15.59:0/2861196716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52dc09e1d0 0x7f52dc136170 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f52d00098f0 tx=0x7f52d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.362+0000 7f52c3fff700 1 -- 172.21.15.59:0/2861196716 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0003b70 con 0x7f52dc09e1d0 2023-09-30T22:29:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.362+0000 7f52c3fff700 1 -- 172.21.15.59:0/2861196716 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d0003cd0 con 0x7f52dc09e1d0 2023-09-30T22:29:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.362+0000 7f52e1a45700 1 -- 172.21.15.59:0/2861196716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52dc1197e0 con 0x7f52dc09e1d0 2023-09-30T22:29:38.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.362+0000 7f52c3fff700 1 -- 172.21.15.59:0/2861196716 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d001c7f0 con 0x7f52dc09e1d0 2023-09-30T22:29:38.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.362+0000 7f52e1a45700 1 -- 172.21.15.59:0/2861196716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52dc138030 con 0x7f52dc09e1d0 2023-09-30T22:29:38.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.363+0000 7f52c3fff700 1 -- 172.21.15.59:0/2861196716 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f52d0023070 con 0x7f52dc09e1d0 2023-09-30T22:29:38.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.363+0000 7f52e1a45700 1 -- 172.21.15.59:0/2861196716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52dc074ea0 con 0x7f52dc09e1d0 2023-09-30T22:29:38.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.363+0000 7f52c3fff700 1 -- 172.21.15.59:0/2861196716 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f52d001cc80 con 0x7f52dc09e1d0 2023-09-30T22:29:38.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.363+0000 7f52daffd700 1 -- 172.21.15.59:0/2861196716 >> v1:172.21.15.59:6816/126772 conn(0x7f52c802f510 legacy=0x7f52c80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:38.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.368+0000 7f52c3fff700 1 -- 172.21.15.59:0/2861196716 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52d0021020 con 0x7f52dc09e1d0 2023-09-30T22:29:38.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.374+0000 7effde4ec700 1 Processor -- start 2023-09-30T22:29:38.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.374+0000 7effde4ec700 1 -- start start 2023-09-30T22:29:38.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.374+0000 7effde4ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effd812cf60 0x7effd806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.374+0000 7effde4ec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effd8130430 0x7effd8137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.375+0000 7effde4ec700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd812cd90 con 0x7effd812f8b0 2023-09-30T22:29:38.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.375+0000 7effde4ec700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd812d330 con 0x7effd8130430 2023-09-30T22:29:38.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.375+0000 7effde4ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd8071780 con 0x7effd812cf60 2023-09-30T22:29:38.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.375+0000 7effd77fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7effd812f8b0 0x7effd812fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58464/0 (socket says 172.21.15.59:58464) 2023-09-30T22:29:38.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.375+0000 7effd77fe700 1 -- 172.21.15.59:0/3952775459 learned_addr learned my addr 172.21.15.59:0/3952775459 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:38.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.375+0000 7effdca89700 1 --2- 172.21.15.59:0/3952775459 >> v2:172.21.15.59:3300/0 conn(0x7effd8130430 0x7effd8137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.375+0000 7effd7fff700 1 --2- 172.21.15.59:0/3952775459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effd812cf60 0x7effd806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.375+0000 7effdca89700 1 -- 172.21.15.59:0/3952775459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effd812cf60 msgr2=0x7effd806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:38.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.375+0000 7effdca89700 1 --2- 172.21.15.59:0/3952775459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effd812cf60 0x7effd806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.375+0000 7effdca89700 1 -- 172.21.15.59:0/3952775459 >> v1:172.21.15.59:6789/0 conn(0x7effd812f8b0 legacy=0x7effd812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.375+0000 7effdca89700 1 -- 172.21.15.59:0/3952775459 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd8071a40 con 0x7effd8130430 2023-09-30T22:29:38.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.376+0000 7effdca89700 1 --2- 172.21.15.59:0/3952775459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd8130430 0x7effd8137c30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7effd0009d90 tx=0x7effd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc234549aec16c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.376+0000 7effd6ffd700 1 -- 172.21.15.59:0/3952775459 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd000e070 con 0x7effd8130430 2023-09-30T22:29:38.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.376+0000 7effd6ffd700 1 -- 172.21.15.59:0/3952775459 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd000bbd0 con 0x7effd8130430 2023-09-30T22:29:38.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.376+0000 7effd6ffd700 1 -- 172.21.15.59:0/3952775459 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0012430 con 0x7effd8130430 2023-09-30T22:29:38.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.377+0000 7effde4ec700 1 -- 172.21.15.59:0/3952775459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd8130430 msgr2=0x7effd8137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.377+0000 7effde4ec700 1 --2- 172.21.15.59:0/3952775459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd8130430 0x7effd8137c30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7effd0009d90 tx=0x7effd000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:38.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.377+0000 7effde4ec700 1 -- 172.21.15.59:0/3952775459 shutdown_connections 2023-09-30T22:29:38.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.377+0000 7effde4ec700 1 --2- 172.21.15.59:0/3952775459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd8130430 0x7effd8137c30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.377+0000 7effde4ec700 1 --2- 172.21.15.59:0/3952775459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effd812cf60 0x7effd806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.377+0000 7effde4ec700 1 -- 172.21.15.59:0/3952775459 >> 172.21.15.59:0/3952775459 conn(0x7effd80a2aa0 msgr2=0x7effd80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.377+0000 7effde4ec700 1 -- 172.21.15.59:0/3952775459 shutdown_connections 2023-09-30T22:29:38.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.377+0000 7effde4ec700 1 -- 172.21.15.59:0/3952775459 wait complete. 2023-09-30T22:29:38.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.379+0000 7effde4ec700 1 Processor -- start 2023-09-30T22:29:38.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.379+0000 7effde4ec700 1 -- start start 2023-09-30T22:29:38.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effde4ec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd812cf60 0x7effd81309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effde4ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effd812f8b0 0x7effd8130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effde4ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effd8130430 0x7effd8131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effde4ec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd8133710 con 0x7effd812cf60 2023-09-30T22:29:38.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effde4ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd8129fa0 con 0x7effd812f8b0 2023-09-30T22:29:38.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effde4ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effd8133380 con 0x7effd8130430 2023-09-30T22:29:38.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effd77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effd812f8b0 0x7effd8130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effd77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effd812f8b0 0x7effd8130f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38908/0 (socket says 172.21.15.59:38908) 2023-09-30T22:29:38.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effd77fe700 1 -- 172.21.15.59:0/1993370609 learned_addr learned my addr 172.21.15.59:0/1993370609 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:38.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effdca89700 1 --2- 172.21.15.59:0/1993370609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effd8130430 0x7effd8131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effd77fe700 1 -- 172.21.15.59:0/1993370609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effd8130430 msgr2=0x7effd8131460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effd77fe700 1 --2- 172.21.15.59:0/1993370609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effd8130430 0x7effd8131460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effd77fe700 1 -- 172.21.15.59:0/1993370609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd812cf60 msgr2=0x7effd81309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effd77fe700 1 --2- 172.21.15.59:0/1993370609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd812cf60 0x7effd81309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effd77fe700 1 -- 172.21.15.59:0/1993370609 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd0009a70 con 0x7effd812f8b0 2023-09-30T22:29:38.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.380+0000 7effdca89700 1 --2- 172.21.15.59:0/1993370609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effd8130430 0x7effd8131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:38.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.381+0000 7effd77fe700 1 --2- 172.21.15.59:0/1993370609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effd812f8b0 0x7effd8130f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7effcc00c500 tx=0x7effcc00c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.381+0000 7effd4ff9700 1 -- 172.21.15.59:0/1993370609 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc005d70 con 0x7effd812f8b0 2023-09-30T22:29:38.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.381+0000 7effd4ff9700 1 -- 172.21.15.59:0/1993370609 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effcc0070d0 con 0x7effd812f8b0 2023-09-30T22:29:38.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.381+0000 7effde4ec700 1 -- 172.21.15.59:0/1993370609 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd809eaf0 con 0x7effd812f8b0 2023-09-30T22:29:38.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.381+0000 7effd4ff9700 1 -- 172.21.15.59:0/1993370609 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc007440 con 0x7effd812f8b0 2023-09-30T22:29:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.381+0000 7effde4ec700 1 -- 172.21.15.59:0/1993370609 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd81394f0 con 0x7effd812f8b0 2023-09-30T22:29:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.382+0000 7effde4ec700 1 -- 172.21.15.59:0/1993370609 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd8074ea0 con 0x7effd812f8b0 2023-09-30T22:29:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.382+0000 7effd4ff9700 1 -- 172.21.15.59:0/1993370609 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7effcc0075a0 con 0x7effd812f8b0 2023-09-30T22:29:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.383+0000 7effd7fff700 1 -- 172.21.15.59:0/1993370609 >> v1:172.21.15.59:6816/126772 conn(0x7effc402f510 legacy=0x7effc40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.383+0000 7effd4ff9700 1 -- 172.21.15.59:0/1993370609 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7effcc03efb0 con 0x7effd812f8b0 2023-09-30T22:29:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.392+0000 7effd4ff9700 1 -- 172.21.15.59:0/1993370609 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effcc070750 con 0x7effd812f8b0 2023-09-30T22:29:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.401+0000 7fa47d54a700 1 Processor -- start 2023-09-30T22:29:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.401+0000 7fa47d54a700 1 -- start start 2023-09-30T22:29:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.402+0000 7fa47d54a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa47809e1d0 0x7fa478135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.402+0000 7fa47d54a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa478135e50 0x7fa478138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.402+0000 7fa47d54a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47809f130 con 0x7fa47809d6f0 2023-09-30T22:29:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.402+0000 7fa47d54a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47809f520 con 0x7fa47809e1d0 2023-09-30T22:29:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.402+0000 7fa47d54a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa47809e930 con 0x7fa478135e50 2023-09-30T22:29:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.402+0000 7fa4767fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa47809e1d0 0x7fa478135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.402+0000 7fa476ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa47809d6f0 0x7fa47809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58472/0 (socket says 172.21.15.59:58472) 2023-09-30T22:29:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.402+0000 7fa476ffd700 1 -- 172.21.15.59:0/3151925146 learned_addr learned my addr 172.21.15.59:0/3151925146 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.402+0000 7fa4777fe700 1 --2- 172.21.15.59:0/3151925146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa478135e50 0x7fa478138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.402+0000 7fa4767fc700 1 -- 172.21.15.59:0/3151925146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa478135e50 msgr2=0x7fa478138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.402+0000 7fa4767fc700 1 --2- 172.21.15.59:0/3151925146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa478135e50 0x7fa478138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.402+0000 7fa4767fc700 1 -- 172.21.15.59:0/3151925146 >> v1:172.21.15.59:6789/0 conn(0x7fa47809d6f0 legacy=0x7fa47809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.402+0000 7fa4767fc700 1 -- 172.21.15.59:0/3151925146 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47809b2d0 con 0x7fa47809e1d0 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.403+0000 7fa4767fc700 1 --2- 172.21.15.59:0/3151925146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa47809e1d0 0x7fa478135910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009840 tx=0x7fa46c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b63d5a301639e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.403+0000 7fa475ffb700 1 -- 172.21.15.59:0/3151925146 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c011830 con 0x7fa47809e1d0 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.403+0000 7fa475ffb700 1 -- 172.21.15.59:0/3151925146 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c011990 con 0x7fa47809e1d0 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.403+0000 7fa475ffb700 1 -- 172.21.15.59:0/3151925146 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c011d20 con 0x7fa47809e1d0 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.404+0000 7fa47d54a700 1 -- 172.21.15.59:0/3151925146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa47809e1d0 msgr2=0x7fa478135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.404+0000 7fa47d54a700 1 --2- 172.21.15.59:0/3151925146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa47809e1d0 0x7fa478135910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009840 tx=0x7fa46c009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.404+0000 7fa47d54a700 1 -- 172.21.15.59:0/3151925146 shutdown_connections 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.404+0000 7fa47d54a700 1 --2- 172.21.15.59:0/3151925146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa478135e50 0x7fa478138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.404+0000 7fa47d54a700 1 --2- 172.21.15.59:0/3151925146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa47809e1d0 0x7fa478135910 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.404+0000 7fa47d54a700 1 -- 172.21.15.59:0/3151925146 >> 172.21.15.59:0/3151925146 conn(0x7fa478066f50 msgr2=0x7fa47809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.404+0000 7fa47d54a700 1 -- 172.21.15.59:0/3151925146 shutdown_connections 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.404+0000 7fa47d54a700 1 -- 172.21.15.59:0/3151925146 wait complete. 2023-09-30T22:29:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.405+0000 7fa47d54a700 1 Processor -- start 2023-09-30T22:29:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.405+0000 7fa47d54a700 1 -- start start 2023-09-30T22:29:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.406+0000 7fa47d54a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa47809d6f0 0x7fa4781c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.406+0000 7fa47d54a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa47809e1d0 0x7fa4781c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.406+0000 7fa47d54a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa478135e50 0x7fa4781194d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.406+0000 7fa47d54a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4781c4f00 con 0x7fa47809e1d0 2023-09-30T22:29:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.406+0000 7fa47d54a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4781baf30 con 0x7fa47809d6f0 2023-09-30T22:29:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.406+0000 7fa47d54a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa47811cda0 con 0x7fa478135e50 2023-09-30T22:29:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.406+0000 7fa4767fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa47809e1d0 0x7fa4781c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.406+0000 7fa4767fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa47809e1d0 0x7fa4781c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57112/0 (socket says 172.21.15.59:57112) 2023-09-30T22:29:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.406+0000 7fa4767fc700 1 -- 172.21.15.59:0/833807758 learned_addr learned my addr 172.21.15.59:0/833807758 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.406+0000 7fa4777fe700 1 --2- 172.21.15.59:0/833807758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa478135e50 0x7fa4781194d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.406+0000 7fa4777fe700 1 -- 172.21.15.59:0/833807758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa47809d6f0 msgr2=0x7fa4781c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.406+0000 7fa4777fe700 1 --2- 172.21.15.59:0/833807758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa47809d6f0 0x7fa4781c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.406+0000 7fa4777fe700 1 -- 172.21.15.59:0/833807758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa47809e1d0 msgr2=0x7fa4781c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.406+0000 7fa4777fe700 1 --2- 172.21.15.59:0/833807758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa47809e1d0 0x7fa4781c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.406+0000 7fa4777fe700 1 -- 172.21.15.59:0/833807758 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c0094a0 con 0x7fa478135e50 2023-09-30T22:29:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.407+0000 7fa4777fe700 1 --2- 172.21.15.59:0/833807758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa478135e50 0x7fa4781194d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa470010f30 tx=0x7fa47000e3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.407+0000 7fa45f7fe700 1 -- 172.21.15.59:0/833807758 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47000e9f0 con 0x7fa478135e50 2023-09-30T22:29:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.407+0000 7fa45f7fe700 1 -- 172.21.15.59:0/833807758 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa470011040 con 0x7fa478135e50 2023-09-30T22:29:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.407+0000 7fa45f7fe700 1 -- 172.21.15.59:0/833807758 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47000edb0 con 0x7fa478135e50 2023-09-30T22:29:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.407+0000 7fa47d54a700 1 -- 172.21.15.59:0/833807758 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4780a1e00 con 0x7fa478135e50 2023-09-30T22:29:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.407+0000 7fa47d54a700 1 -- 172.21.15.59:0/833807758 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47809c700 con 0x7fa478135e50 2023-09-30T22:29:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.408+0000 7fa47d54a700 1 -- 172.21.15.59:0/833807758 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47811c8c0 con 0x7fa478135e50 2023-09-30T22:29:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.409+0000 7fa45f7fe700 1 -- 172.21.15.59:0/833807758 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa470009540 con 0x7fa478135e50 2023-09-30T22:29:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.409+0000 7fa45f7fe700 1 -- 172.21.15.59:0/833807758 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa470042e00 con 0x7fa478135e50 2023-09-30T22:29:38.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.409+0000 7fa476ffd700 1 -- 172.21.15.59:0/833807758 >> v1:172.21.15.59:6816/126772 conn(0x7fa46402f540 legacy=0x7fa4640319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.418+0000 7fa45f7fe700 1 -- 172.21.15.59:0/833807758 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4700157a0 con 0x7fa478135e50 2023-09-30T22:29:38.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.419+0000 7f91f65fa700 1 Processor -- start 2023-09-30T22:29:38.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.419+0000 7f91f65fa700 1 -- start start 2023-09-30T22:29:38.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.419+0000 7f91f65fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f009f410 0x7f91f0136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.419+0000 7f91f65fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f0136fe0 0x7f91f01393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.419+0000 7f91f65fa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f0070940 con 0x7f91f009e930 2023-09-30T22:29:38.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.419+0000 7f91f65fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f006fd60 con 0x7f91f009f410 2023-09-30T22:29:38.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.419+0000 7f91f65fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91f006fa80 con 0x7f91f0136fe0 2023-09-30T22:29:38.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.419+0000 7f91ef7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f009f410 0x7f91f0136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.419+0000 7f91ef7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f009f410 0x7f91f0136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38920/0 (socket says 172.21.15.59:38920) 2023-09-30T22:29:38.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.420+0000 7f91ef7fe700 1 -- 172.21.15.59:0/3911344749 learned_addr learned my addr 172.21.15.59:0/3911344749 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:38.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.419+0000 7f91effff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f91f009e930 0x7f91f009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58486/0 (socket says 172.21.15.59:58486) 2023-09-30T22:29:38.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.420+0000 7f91f4b97700 1 --2- 172.21.15.59:0/3911344749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f0136fe0 0x7f91f01393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.420+0000 7f91f4b97700 1 -- 172.21.15.59:0/3911344749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f009f410 msgr2=0x7f91f0136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:38.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.420+0000 7f91f4b97700 1 --2- 172.21.15.59:0/3911344749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f009f410 0x7f91f0136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.420+0000 7f91f4b97700 1 -- 172.21.15.59:0/3911344749 >> v1:172.21.15.59:6789/0 conn(0x7f91f009e930 legacy=0x7f91f009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.420+0000 7f91eeffd700 1 -- 172.21.15.59:0/3911344749 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243975094 0 0) 0x7f91f0070940 con 0x7f91f009e930 2023-09-30T22:29:38.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.420+0000 7f91f4b97700 1 -- 172.21.15.59:0/3911344749 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f009fb60 con 0x7f91f0136fe0 2023-09-30T22:29:38.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.420+0000 7f91f4b97700 1 --2- 172.21.15.59:0/3911344749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f0136fe0 0x7f91f01393c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f91e8010380 tx=0x7f91e8010690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89d22626604a276 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.420+0000 7f91eeffd700 1 -- 172.21.15.59:0/3911344749 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e801b680 con 0x7f91f0136fe0 2023-09-30T22:29:38.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.420+0000 7f91eeffd700 1 -- 172.21.15.59:0/3911344749 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e801b7e0 con 0x7f91f0136fe0 2023-09-30T22:29:38.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.420+0000 7f91eeffd700 1 -- 172.21.15.59:0/3911344749 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e801bb70 con 0x7f91f0136fe0 2023-09-30T22:29:38.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.421+0000 7f91f65fa700 1 -- 172.21.15.59:0/3911344749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f0136fe0 msgr2=0x7f91f01393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.421+0000 7f91f65fa700 1 --2- 172.21.15.59:0/3911344749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f0136fe0 0x7f91f01393c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f91e8010380 tx=0x7f91e8010690 comp rx=0 tx=0).stop 2023-09-30T22:29:38.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.421+0000 7f91f65fa700 1 -- 172.21.15.59:0/3911344749 shutdown_connections 2023-09-30T22:29:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.421+0000 7f91f65fa700 1 --2- 172.21.15.59:0/3911344749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f0136fe0 0x7f91f01393c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.421+0000 7f91f65fa700 1 --2- 172.21.15.59:0/3911344749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f009f410 0x7f91f0136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.421+0000 7f91f65fa700 1 -- 172.21.15.59:0/3911344749 >> 172.21.15.59:0/3911344749 conn(0x7f91f00a4210 msgr2=0x7f91f00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.421+0000 7f91f65fa700 1 -- 172.21.15.59:0/3911344749 shutdown_connections 2023-09-30T22:29:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.421+0000 7f91f65fa700 1 -- 172.21.15.59:0/3911344749 wait complete. 2023-09-30T22:29:38.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.422+0000 7f91f65fa700 1 Processor -- start 2023-09-30T22:29:38.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.423+0000 7f91f65fa700 1 -- start start 2023-09-30T22:29:38.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.423+0000 7f91f65fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f009e930 0x7f91f011b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.423+0000 7f91f65fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91f009f410 0x7f91f011ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.423+0000 7f91f65fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f0136fe0 0x7f91f011bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.423+0000 7f91f65fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00a3310 con 0x7f91f009f410 2023-09-30T22:29:38.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.423+0000 7f91f65fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f011e800 con 0x7f91f009e930 2023-09-30T22:29:38.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.423+0000 7f91f65fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91f011f110 con 0x7f91f0136fe0 2023-09-30T22:29:38.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.423+0000 7f91effff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f009e930 0x7f91f011b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.423+0000 7f91effff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f009e930 0x7f91f011b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38924/0 (socket says 172.21.15.59:38924) 2023-09-30T22:29:38.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.423+0000 7f91effff700 1 -- 172.21.15.59:0/2709211866 learned_addr learned my addr 172.21.15.59:0/2709211866 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:38.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.423+0000 7f91f4b97700 1 --2- 172.21.15.59:0/2709211866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f0136fe0 0x7f91f011bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.423+0000 7f91ef7fe700 1 --2- 172.21.15.59:0/2709211866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91f009f410 0x7f91f011ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.424+0000 7f91f4b97700 1 -- 172.21.15.59:0/2709211866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f009e930 msgr2=0x7f91f011b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.424+0000 7f91f4b97700 1 --2- 172.21.15.59:0/2709211866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f009e930 0x7f91f011b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.424+0000 7f91f4b97700 1 -- 172.21.15.59:0/2709211866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91f009f410 msgr2=0x7f91f011ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.424+0000 7f91f4b97700 1 --2- 172.21.15.59:0/2709211866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91f009f410 0x7f91f011ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.424+0000 7f91f4b97700 1 -- 172.21.15.59:0/2709211866 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e800bc50 con 0x7f91f0136fe0 2023-09-30T22:29:38.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.424+0000 7f91ef7fe700 1 --2- 172.21.15.59:0/2709211866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91f009f410 0x7f91f011ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:38.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.424+0000 7f91f4b97700 1 --2- 172.21.15.59:0/2709211866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f0136fe0 0x7f91f011bfd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f91e801a000 tx=0x7f91e8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.424+0000 7f91ecff9700 1 -- 172.21.15.59:0/2709211866 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e8022070 con 0x7f91f0136fe0 2023-09-30T22:29:38.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.424+0000 7f91ecff9700 1 -- 172.21.15.59:0/2709211866 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e801b950 con 0x7f91f0136fe0 2023-09-30T22:29:38.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.424+0000 7f91f65fa700 1 -- 172.21.15.59:0/2709211866 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f011d950 con 0x7f91f0136fe0 2023-09-30T22:29:38.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.424+0000 7f91ecff9700 1 -- 172.21.15.59:0/2709211866 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e801bcc0 con 0x7f91f0136fe0 2023-09-30T22:29:38.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.424+0000 7f91f65fa700 1 -- 172.21.15.59:0/2709211866 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f011f800 con 0x7f91f0136fe0 2023-09-30T22:29:38.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.426+0000 7f91f65fa700 1 -- 172.21.15.59:0/2709211866 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f006ceb0 con 0x7f91f0136fe0 2023-09-30T22:29:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.426+0000 7f91ecff9700 1 -- 172.21.15.59:0/2709211866 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f91e8004040 con 0x7f91f0136fe0 2023-09-30T22:29:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.426+0000 7f91ecff9700 1 -- 172.21.15.59:0/2709211866 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f91e8016070 con 0x7f91f0136fe0 2023-09-30T22:29:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.426+0000 7f91effff700 1 -- 172.21.15.59:0/2709211866 >> v1:172.21.15.59:6816/126772 conn(0x7f91dc02f510 legacy=0x7f91dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:38.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.435+0000 7f91ecff9700 1 -- 172.21.15.59:0/2709211866 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91e8012430 con 0x7f91f0136fe0 2023-09-30T22:29:38.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.564+0000 7f52daffd700 1 -- 172.21.15.59:0/2861196716 >> v1:172.21.15.59:6816/126772 conn(0x7f52c802f510 legacy=0x7f52c80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:38.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.584+0000 7effd7fff700 1 -- 172.21.15.59:0/1993370609 >> v1:172.21.15.59:6816/126772 conn(0x7effc402f510 legacy=0x7effc40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:38.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.610+0000 7fa476ffd700 1 -- 172.21.15.59:0/833807758 >> v1:172.21.15.59:6816/126772 conn(0x7fa46402f540 legacy=0x7fa4640319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:38.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.616+0000 7effde4ec700 1 -- 172.21.15.59:0/1993370609 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7effd8139fa0 con 0x7effd812f8b0 2023-09-30T22:29:38.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.616+0000 7effd4ff9700 1 -- 172.21.15.59:0/1993370609 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effcc017030 con 0x7effd812f8b0 2023-09-30T22:29:38.617 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:38.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.619+0000 7effde4ec700 1 -- 172.21.15.59:0/1993370609 >> v1:172.21.15.59:6816/126772 conn(0x7effc402f510 legacy=0x7effc40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:38.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.619+0000 7effde4ec700 1 -- 172.21.15.59:0/1993370609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effd812f8b0 msgr2=0x7effd8130f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.619+0000 7effde4ec700 1 --2- 172.21.15.59:0/1993370609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effd812f8b0 0x7effd8130f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7effcc00c500 tx=0x7effcc00c810 comp rx=0 tx=0).stop 2023-09-30T22:29:38.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.619+0000 7effde4ec700 1 -- 172.21.15.59:0/1993370609 shutdown_connections 2023-09-30T22:29:38.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.619+0000 7effde4ec700 1 --2- 172.21.15.59:0/1993370609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effd8130430 0x7effd8131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.619+0000 7effde4ec700 1 --2- 172.21.15.59:0/1993370609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd812cf60 0x7effd81309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.619+0000 7effde4ec700 1 --2- 172.21.15.59:0/1993370609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effd812f8b0 0x7effd8130f20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.619+0000 7effde4ec700 1 -- 172.21.15.59:0/1993370609 >> 172.21.15.59:0/1993370609 conn(0x7effd80a2aa0 msgr2=0x7effd806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.619+0000 7effde4ec700 1 -- 172.21.15.59:0/1993370609 shutdown_connections 2023-09-30T22:29:38.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.619+0000 7effde4ec700 1 -- 172.21.15.59:0/1993370609 wait complete. 2023-09-30T22:29:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.627+0000 7f91effff700 1 -- 172.21.15.59:0/2709211866 >> v1:172.21.15.59:6816/126772 conn(0x7f91dc02f510 legacy=0x7f91dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.627+0000 7f52e1a45700 1 -- 172.21.15.59:0/2861196716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f52dc138b20 con 0x7f52dc09e1d0 2023-09-30T22:29:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.628+0000 7f52c3fff700 1 -- 172.21.15.59:0/2861196716 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52d001c950 con 0x7f52dc09e1d0 2023-09-30T22:29:38.627 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:38.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.631+0000 7f52e1a45700 1 -- 172.21.15.59:0/2861196716 >> v1:172.21.15.59:6816/126772 conn(0x7f52c802f510 legacy=0x7f52c80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:38.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.631+0000 7f52e1a45700 1 -- 172.21.15.59:0/2861196716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52dc09e1d0 msgr2=0x7f52dc136170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.631+0000 7f52e1a45700 1 --2- 172.21.15.59:0/2861196716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52dc09e1d0 0x7f52dc136170 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f52d00098f0 tx=0x7f52d0004750 comp rx=0 tx=0).stop 2023-09-30T22:29:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.631+0000 7f52e1a45700 1 -- 172.21.15.59:0/2861196716 shutdown_connections 2023-09-30T22:29:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.631+0000 7f52e1a45700 1 --2- 172.21.15.59:0/2861196716 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52dc139170 0x7f52dc1366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.631+0000 7f52e1a45700 1 --2- 172.21.15.59:0/2861196716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52dc09d6f0 0x7f52dc135c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.631+0000 7f52e1a45700 1 --2- 172.21.15.59:0/2861196716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52dc09e1d0 0x7f52dc136170 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.631+0000 7f52e1a45700 1 -- 172.21.15.59:0/2861196716 >> 172.21.15.59:0/2861196716 conn(0x7f52dc066f50 msgr2=0x7f52dc132780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.631+0000 7f52e1a45700 1 -- 172.21.15.59:0/2861196716 shutdown_connections 2023-09-30T22:29:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.631+0000 7f52e1a45700 1 -- 172.21.15.59:0/2861196716 wait complete. 2023-09-30T22:29:38.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:38.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.654+0000 7f91f65fa700 1 -- 172.21.15.59:0/2709211866 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f91f0074ea0 con 0x7f91f0136fe0 2023-09-30T22:29:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.654+0000 7f91ecff9700 1 -- 172.21.15.59:0/2709211866 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91e80113c0 con 0x7f91f0136fe0 2023-09-30T22:29:38.654 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.656+0000 7f91f65fa700 1 -- 172.21.15.59:0/2709211866 >> v1:172.21.15.59:6816/126772 conn(0x7f91dc02f510 legacy=0x7f91dc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.656+0000 7f91f65fa700 1 -- 172.21.15.59:0/2709211866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f0136fe0 msgr2=0x7f91f011bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.656+0000 7f91f65fa700 1 --2- 172.21.15.59:0/2709211866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f0136fe0 0x7f91f011bfd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f91e801a000 tx=0x7f91e8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.656+0000 7f91f65fa700 1 -- 172.21.15.59:0/2709211866 shutdown_connections 2023-09-30T22:29:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.656+0000 7f91f65fa700 1 --2- 172.21.15.59:0/2709211866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f0136fe0 0x7f91f011bfd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.656+0000 7f91f65fa700 1 --2- 172.21.15.59:0/2709211866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f009e930 0x7f91f011b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.656+0000 7f91f65fa700 1 --2- 172.21.15.59:0/2709211866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91f009f410 0x7f91f011ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.656+0000 7f91f65fa700 1 -- 172.21.15.59:0/2709211866 >> 172.21.15.59:0/2709211866 conn(0x7f91f00a4210 msgr2=0x7f91f006bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.657+0000 7f91f65fa700 1 -- 172.21.15.59:0/2709211866 shutdown_connections 2023-09-30T22:29:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.657+0000 7f91f65fa700 1 -- 172.21.15.59:0/2709211866 wait complete. 2023-09-30T22:29:38.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:38.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.679+0000 7fa47d54a700 1 -- 172.21.15.59:0/833807758 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa47811cf10 con 0x7fa478135e50 2023-09-30T22:29:38.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.680+0000 7fa45f7fe700 1 -- 172.21.15.59:0/833807758 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa47002d090 con 0x7fa478135e50 2023-09-30T22:29:38.680 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.682+0000 7fa47d54a700 1 -- 172.21.15.59:0/833807758 >> v1:172.21.15.59:6816/126772 conn(0x7fa46402f540 legacy=0x7fa4640319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.682+0000 7fa47d54a700 1 -- 172.21.15.59:0/833807758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa478135e50 msgr2=0x7fa4781194d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.682+0000 7fa47d54a700 1 --2- 172.21.15.59:0/833807758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa478135e50 0x7fa4781194d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa470010f30 tx=0x7fa47000e3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.682+0000 7fa47d54a700 1 -- 172.21.15.59:0/833807758 shutdown_connections 2023-09-30T22:29:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.682+0000 7fa47d54a700 1 --2- 172.21.15.59:0/833807758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa478135e50 0x7fa4781194d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.682+0000 7fa47d54a700 1 --2- 172.21.15.59:0/833807758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa47809d6f0 0x7fa4781c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.682+0000 7fa47d54a700 1 --2- 172.21.15.59:0/833807758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa47809e1d0 0x7fa4781c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.682+0000 7fa47d54a700 1 -- 172.21.15.59:0/833807758 >> 172.21.15.59:0/833807758 conn(0x7fa478066f50 msgr2=0x7fa47806f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.682+0000 7fa47d54a700 1 -- 172.21.15.59:0/833807758 shutdown_connections 2023-09-30T22:29:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:38.682+0000 7fa47d54a700 1 -- 172.21.15.59:0/833807758 wait complete. 2023-09-30T22:29:38.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:39.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:39.652 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:39.672 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:39.697 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:39.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.822+0000 7fe6801aa700 1 Processor -- start 2023-09-30T22:29:39.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.822+0000 7fe6801aa700 1 -- start start 2023-09-30T22:29:39.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.823+0000 7fe6801aa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe67809e1d0 0x7fe678138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.823+0000 7fe6801aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe678139170 0x7fe67813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.823+0000 7fe6801aa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe67809b120 con 0x7fe67809d6f0 2023-09-30T22:29:39.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.823+0000 7fe6801aa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67806b460 con 0x7fe67809e1d0 2023-09-30T22:29:39.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.823+0000 7fe6801aa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe67809a7e0 con 0x7fe678139170 2023-09-30T22:29:39.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.823+0000 7fe67d745700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe67809e1d0 0x7fe678138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.823+0000 7fe67d745700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe67809e1d0 0x7fe678138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57126/0 (socket says 172.21.15.59:57126) 2023-09-30T22:29:39.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.823+0000 7fe67d745700 1 -- 172.21.15.59:0/1894650645 learned_addr learned my addr 172.21.15.59:0/1894650645 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:39.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.823+0000 7fe67e747700 1 --2- 172.21.15.59:0/1894650645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe678139170 0x7fe67813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.823+0000 7fe67e747700 1 -- 172.21.15.59:0/1894650645 >> v2:172.21.15.59:3300/0 conn(0x7fe67809e1d0 msgr2=0x7fe678138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:39.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.823+0000 7fe67e747700 1 --2- 172.21.15.59:0/1894650645 >> v2:172.21.15.59:3300/0 conn(0x7fe67809e1d0 0x7fe678138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.824+0000 7fe67e747700 1 -- 172.21.15.59:0/1894650645 >> v1:172.21.15.59:6789/0 conn(0x7fe67809d6f0 legacy=0x7fe67809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.824+0000 7fe67e747700 1 -- 172.21.15.59:0/1894650645 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67809a500 con 0x7fe678139170 2023-09-30T22:29:39.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.824+0000 7fe67d745700 1 --2- 172.21.15.59:0/1894650645 >> v2:172.21.15.59:3300/0 conn(0x7fe67809e1d0 0x7fe678138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:39.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.824+0000 7fe67e747700 1 --2- 172.21.15.59:0/1894650645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe678139170 0x7fe67813b550 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe670009dc0 tx=0x7fe67000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9a3aea86bb381d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.824+0000 7fe67cf44700 1 -- 172.21.15.59:0/1894650645 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000e070 con 0x7fe678139170 2023-09-30T22:29:39.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.824+0000 7fe67cf44700 1 -- 172.21.15.59:0/1894650645 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67000bb90 con 0x7fe678139170 2023-09-30T22:29:39.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.824+0000 7fe67cf44700 1 -- 172.21.15.59:0/1894650645 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe670012430 con 0x7fe678139170 2023-09-30T22:29:39.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.825+0000 7fe6801aa700 1 -- 172.21.15.59:0/1894650645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe678139170 msgr2=0x7fe67813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.825+0000 7fe6801aa700 1 --2- 172.21.15.59:0/1894650645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe678139170 0x7fe67813b550 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe670009dc0 tx=0x7fe67000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:39.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.825+0000 7fe6801aa700 1 -- 172.21.15.59:0/1894650645 shutdown_connections 2023-09-30T22:29:39.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.825+0000 7fe6801aa700 1 --2- 172.21.15.59:0/1894650645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe678139170 0x7fe67813b550 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.825+0000 7fe6801aa700 1 --2- 172.21.15.59:0/1894650645 >> v2:172.21.15.59:3300/0 conn(0x7fe67809e1d0 0x7fe678138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.825+0000 7fe6801aa700 1 -- 172.21.15.59:0/1894650645 >> 172.21.15.59:0/1894650645 conn(0x7fe678066f50 msgr2=0x7fe67809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:39.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.825+0000 7fe6801aa700 1 -- 172.21.15.59:0/1894650645 shutdown_connections 2023-09-30T22:29:39.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.825+0000 7fe6801aa700 1 -- 172.21.15.59:0/1894650645 wait complete. 2023-09-30T22:29:39.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.826+0000 7fe6801aa700 1 Processor -- start 2023-09-30T22:29:39.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.826+0000 7fe6801aa700 1 -- start start 2023-09-30T22:29:39.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.827+0000 7fe6801aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe67809d6f0 0x7fe6781c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.827+0000 7fe6801aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe67809e1d0 0x7fe6781c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.827+0000 7fe6801aa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe678139170 0x7fe67811e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.827+0000 7fe6801aa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe678121fe0 con 0x7fe678139170 2023-09-30T22:29:39.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.827+0000 7fe6801aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6781be250 con 0x7fe67809d6f0 2023-09-30T22:29:39.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.827+0000 7fe6801aa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe678122230 con 0x7fe67809e1d0 2023-09-30T22:29:39.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.827+0000 7fe67e747700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe678139170 0x7fe67811e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.827+0000 7fe67e747700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe678139170 0x7fe67811e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57134/0 (socket says 172.21.15.59:57134) 2023-09-30T22:29:39.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.827+0000 7fe67e747700 1 -- 172.21.15.59:0/3186389018 learned_addr learned my addr 172.21.15.59:0/3186389018 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:39.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.827+0000 7fe67d745700 1 --2- 172.21.15.59:0/3186389018 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe67809e1d0 0x7fe6781c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.828+0000 7fe67d745700 1 -- 172.21.15.59:0/3186389018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe67809d6f0 msgr2=0x7fe6781c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.828+0000 7fe67d745700 1 --2- 172.21.15.59:0/3186389018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe67809d6f0 0x7fe6781c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.828+0000 7fe67d745700 1 -- 172.21.15.59:0/3186389018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe678139170 msgr2=0x7fe67811e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.828+0000 7fe67d745700 1 --2- 172.21.15.59:0/3186389018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe678139170 0x7fe67811e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.828+0000 7fe67d745700 1 -- 172.21.15.59:0/3186389018 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe670009a70 con 0x7fe67809e1d0 2023-09-30T22:29:39.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.828+0000 7fe67e747700 1 --2- 172.21.15.59:0/3186389018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe678139170 0x7fe67811e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:39.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.828+0000 7fe67d745700 1 --2- 172.21.15.59:0/3186389018 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe67809e1d0 0x7fe6781c89c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe66800e840 tx=0x7fe66800eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.828+0000 7fe66e7fc700 1 -- 172.21.15.59:0/3186389018 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668004230 con 0x7fe67809e1d0 2023-09-30T22:29:39.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.828+0000 7fe66e7fc700 1 -- 172.21.15.59:0/3186389018 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe668004390 con 0x7fe67809e1d0 2023-09-30T22:29:39.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.828+0000 7fe6801aa700 1 -- 172.21.15.59:0/3186389018 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe678120320 con 0x7fe67809e1d0 2023-09-30T22:29:39.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.828+0000 7fe66e7fc700 1 -- 172.21.15.59:0/3186389018 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6680036a0 con 0x7fe67809e1d0 2023-09-30T22:29:39.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.828+0000 7fe6801aa700 1 -- 172.21.15.59:0/3186389018 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6781345e0 con 0x7fe67809e1d0 2023-09-30T22:29:39.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.829+0000 7fe66e7fc700 1 -- 172.21.15.59:0/3186389018 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe668003800 con 0x7fe67809e1d0 2023-09-30T22:29:39.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.830+0000 7fe66e7fc700 1 -- 172.21.15.59:0/3186389018 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe66803f6f0 con 0x7fe67809e1d0 2023-09-30T22:29:39.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.830+0000 7fe67df46700 1 -- 172.21.15.59:0/3186389018 >> v1:172.21.15.59:6816/126772 conn(0x7fe65c02f510 legacy=0x7fe65c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:39.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.830+0000 7fe6801aa700 1 -- 172.21.15.59:0/3186389018 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe678074ea0 con 0x7fe67809e1d0 2023-09-30T22:29:39.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.835+0000 7fe66e7fc700 1 -- 172.21.15.59:0/3186389018 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe6680228f0 con 0x7fe67809e1d0 2023-09-30T22:29:39.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.838+0000 7ff2f3e7c700 1 Processor -- start 2023-09-30T22:29:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.838+0000 7ff2f3e7c700 1 -- start start 2023-09-30T22:29:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f3e7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2ec09d6f0 0x7ff2ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f3e7c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2ec09e410 0x7ff2ec134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f3e7c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ec09b120 con 0x7ff2ec09e000 2023-09-30T22:29:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f3e7c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ec06b460 con 0x7ff2ec09e410 2023-09-30T22:29:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f3e7c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec09a7e0 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f1c18700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2ec09d6f0 0x7ff2ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f1c18700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2ec09d6f0 0x7ff2ec09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38938/0 (socket says 172.21.15.59:38938) 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f1417700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff2ec09e000 0x7ff2ec1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58508/0 (socket says 172.21.15.59:58508) 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f1c18700 1 -- 172.21.15.59:0/1530683558 learned_addr learned my addr 172.21.15.59:0/1530683558 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f2419700 1 --2- 172.21.15.59:0/1530683558 >> v2:172.21.15.59:3300/0 conn(0x7ff2ec09e410 0x7ff2ec134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f1c18700 1 -- 172.21.15.59:0/1530683558 >> v2:172.21.15.59:3300/0 conn(0x7ff2ec09e410 msgr2=0x7ff2ec134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f1c18700 1 --2- 172.21.15.59:0/1530683558 >> v2:172.21.15.59:3300/0 conn(0x7ff2ec09e410 0x7ff2ec134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f1c18700 1 -- 172.21.15.59:0/1530683558 >> v1:172.21.15.59:6789/0 conn(0x7ff2ec09e000 legacy=0x7ff2ec1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f1c18700 1 -- 172.21.15.59:0/1530683558 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec09a500 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f0c16700 1 -- 172.21.15.59:0/1530683558 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835484484 0 0) 0x7ff2ec09b120 con 0x7ff2ec09e000 2023-09-30T22:29:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.839+0000 7ff2f2419700 1 --2- 172.21.15.59:0/1530683558 >> v2:172.21.15.59:3300/0 conn(0x7ff2ec09e410 0x7ff2ec134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:39.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.840+0000 7ff2f1c18700 1 --2- 172.21.15.59:0/1530683558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2ec09d6f0 0x7ff2ec09dac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009920 tx=0x7ff2e8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e8bdb9a05cf0227 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.840+0000 7ff2f0c16700 1 -- 172.21.15.59:0/1530683558 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8011830 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.840+0000 7ff2f0c16700 1 -- 172.21.15.59:0/1530683558 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e8011990 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.840+0000 7ff2f0c16700 1 -- 172.21.15.59:0/1530683558 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8011d20 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.841+0000 7ff2f3e7c700 1 -- 172.21.15.59:0/1530683558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2ec09d6f0 msgr2=0x7ff2ec09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.841+0000 7ff2f3e7c700 1 --2- 172.21.15.59:0/1530683558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2ec09d6f0 0x7ff2ec09dac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009920 tx=0x7ff2e8009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:39.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.841+0000 7ff2f3e7c700 1 -- 172.21.15.59:0/1530683558 shutdown_connections 2023-09-30T22:29:39.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.841+0000 7ff2f3e7c700 1 --2- 172.21.15.59:0/1530683558 >> v2:172.21.15.59:3300/0 conn(0x7ff2ec09e410 0x7ff2ec134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.841+0000 7ff2f3e7c700 1 --2- 172.21.15.59:0/1530683558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2ec09d6f0 0x7ff2ec09dac0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.841+0000 7ff2f3e7c700 1 -- 172.21.15.59:0/1530683558 >> 172.21.15.59:0/1530683558 conn(0x7ff2ec066f50 msgr2=0x7ff2ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:39.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.841+0000 7ff2f3e7c700 1 -- 172.21.15.59:0/1530683558 shutdown_connections 2023-09-30T22:29:39.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.841+0000 7ff2f3e7c700 1 -- 172.21.15.59:0/1530683558 wait complete. 2023-09-30T22:29:39.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.842+0000 7ff2f3e7c700 1 Processor -- start 2023-09-30T22:29:39.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.842+0000 7ff2f3e7c700 1 -- start start 2023-09-30T22:29:39.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.843+0000 7ff2f3e7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2ec09d6f0 0x7ff2ec1a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.843+0000 7ff2f3e7c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ec09e000 0x7ff2ec1a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.843+0000 7ff2f3e7c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2ec09e410 0x7ff2ec1a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.843+0000 7ff2f3e7c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec1aa220 con 0x7ff2ec09e000 2023-09-30T22:29:39.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.843+0000 7ff2f3e7c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec1a7950 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.843+0000 7ff2f3e7c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec1a7f70 con 0x7ff2ec09e410 2023-09-30T22:29:39.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.843+0000 7ff2f1c18700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2ec09d6f0 0x7ff2ec1a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.843+0000 7ff2f1c18700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2ec09d6f0 0x7ff2ec1a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38942/0 (socket says 172.21.15.59:38942) 2023-09-30T22:29:39.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.843+0000 7ff2f1c18700 1 -- 172.21.15.59:0/3194592161 learned_addr learned my addr 172.21.15.59:0/3194592161 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:39.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.843+0000 7ff2f1417700 1 --2- 172.21.15.59:0/3194592161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ec09e000 0x7ff2ec1a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.844+0000 7ff2f1c18700 1 -- 172.21.15.59:0/3194592161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2ec09e410 msgr2=0x7ff2ec1a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.844+0000 7ff2f1c18700 1 --2- 172.21.15.59:0/3194592161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2ec09e410 0x7ff2ec1a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.844+0000 7ff2f1c18700 1 -- 172.21.15.59:0/3194592161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ec09e000 msgr2=0x7ff2ec1a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.844+0000 7ff2f1c18700 1 --2- 172.21.15.59:0/3194592161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ec09e000 0x7ff2ec1a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.844+0000 7ff2f1c18700 1 -- 172.21.15.59:0/3194592161 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e4009a70 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.844+0000 7ff2f1c18700 1 --2- 172.21.15.59:0/3194592161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2ec09d6f0 0x7ff2ec1a5de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009c70 tx=0x7ff2e8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.844+0000 7ff2e27fc700 1 -- 172.21.15.59:0/3194592161 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8004300 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.844+0000 7ff2e27fc700 1 -- 172.21.15.59:0/3194592161 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e801f070 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.844+0000 7ff2f3e7c700 1 -- 172.21.15.59:0/3194592161 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e8009550 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.844+0000 7ff2e27fc700 1 -- 172.21.15.59:0/3194592161 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e80036a0 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.844+0000 7ff2f3e7c700 1 -- 172.21.15.59:0/3194592161 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec1a8ff0 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.845+0000 7ff2e27fc700 1 -- 172.21.15.59:0/3194592161 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff2e8021030 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.846+0000 7ff2e27fc700 1 -- 172.21.15.59:0/3194592161 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff2e8040e40 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.846+0000 7ff2f1417700 1 -- 172.21.15.59:0/3194592161 >> v1:172.21.15.59:6816/126772 conn(0x7ff2d002f510 legacy=0x7ff2d00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:39.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.846+0000 7ff2f3e7c700 1 -- 172.21.15.59:0/3194592161 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ec0a3090 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.851+0000 7ff2e27fc700 1 -- 172.21.15.59:0/3194592161 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2e8015020 con 0x7ff2ec09d6f0 2023-09-30T22:29:39.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.869+0000 7f61b0b1e700 1 Processor -- start 2023-09-30T22:29:39.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.869+0000 7f61b0b1e700 1 -- start start 2023-09-30T22:29:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.870+0000 7f61b0b1e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61ac133420 0x7f61ac1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.870+0000 7f61b0b1e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ac133e30 0x7f61ac12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.870+0000 7f61b0b1e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ac06b990 con 0x7f61ac134260 2023-09-30T22:29:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.870+0000 7f61b0b1e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0a0590 con 0x7f61ac133e30 2023-09-30T22:29:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.870+0000 7f61b0b1e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac09fb80 con 0x7f61ac133420 2023-09-30T22:29:39.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.870+0000 7f61aa59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61ac133420 0x7f61ac1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.870+0000 7f61aa59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61ac133420 0x7f61ac1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36652/0 (socket says 172.21.15.59:36652) 2023-09-30T22:29:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.870+0000 7f61aa59c700 1 -- 172.21.15.59:0/2264346429 learned_addr learned my addr 172.21.15.59:0/2264346429 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.870+0000 7f61aad9d700 1 --1- 172.21.15.59:0/2264346429 >> v1:172.21.15.59:6789/0 conn(0x7f61ac134260 0x7f61ac1304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58518/0 (socket says 172.21.15.59:58518) 2023-09-30T22:29:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.870+0000 7f61a9d9b700 1 --2- 172.21.15.59:0/2264346429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ac133e30 0x7f61ac12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.871+0000 7f61aa59c700 1 -- 172.21.15.59:0/2264346429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ac133e30 msgr2=0x7f61ac12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.871+0000 7f61aa59c700 1 --2- 172.21.15.59:0/2264346429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ac133e30 0x7f61ac12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.871+0000 7f61aa59c700 1 -- 172.21.15.59:0/2264346429 >> v1:172.21.15.59:6789/0 conn(0x7f61ac134260 legacy=0x7f61ac1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.871+0000 7f61aa59c700 1 -- 172.21.15.59:0/2264346429 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac0a0030 con 0x7f61ac133420 2023-09-30T22:29:39.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.871+0000 7f61a9d9b700 1 --2- 172.21.15.59:0/2264346429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ac133e30 0x7f61ac12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:39.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.871+0000 7f61aa59c700 1 --2- 172.21.15.59:0/2264346429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61ac133420 0x7f61ac1337f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f619c009920 tx=0x7f619c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f1096feb810e6b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.871+0000 7f61a959a700 1 -- 172.21.15.59:0/2264346429 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c011830 con 0x7f61ac133420 2023-09-30T22:29:39.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.871+0000 7f61a959a700 1 -- 172.21.15.59:0/2264346429 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c011990 con 0x7f61ac133420 2023-09-30T22:29:39.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.871+0000 7f61a959a700 1 -- 172.21.15.59:0/2264346429 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c011d20 con 0x7f61ac133420 2023-09-30T22:29:39.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.872+0000 7f61b0b1e700 1 -- 172.21.15.59:0/2264346429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61ac133420 msgr2=0x7f61ac1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.872+0000 7f61b0b1e700 1 --2- 172.21.15.59:0/2264346429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61ac133420 0x7f61ac1337f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f619c009920 tx=0x7f619c009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:39.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.873+0000 7f61b0b1e700 1 -- 172.21.15.59:0/2264346429 shutdown_connections 2023-09-30T22:29:39.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.873+0000 7f61b0b1e700 1 --2- 172.21.15.59:0/2264346429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61ac133420 0x7f61ac1337f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.873+0000 7f61b0b1e700 1 --2- 172.21.15.59:0/2264346429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ac133e30 0x7f61ac12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.873+0000 7f61b0b1e700 1 -- 172.21.15.59:0/2264346429 >> 172.21.15.59:0/2264346429 conn(0x7f61ac0a4210 msgr2=0x7f61ac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:39.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.873+0000 7f61b0b1e700 1 -- 172.21.15.59:0/2264346429 shutdown_connections 2023-09-30T22:29:39.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.873+0000 7f61b0b1e700 1 -- 172.21.15.59:0/2264346429 wait complete. 2023-09-30T22:29:39.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.874+0000 7f61b0b1e700 1 Processor -- start 2023-09-30T22:29:39.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.874+0000 7f61b0b1e700 1 -- start start 2023-09-30T22:29:39.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.875+0000 7f61b0b1e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ac133420 0x7f61ac09c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.875+0000 7f61b0b1e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61ac133e30 0x7f61ac09c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.875+0000 7f61b0b1e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61ac134260 0x7f61ac09cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.875+0000 7f61b0b1e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac09dfa0 con 0x7f61ac134260 2023-09-30T22:29:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.875+0000 7f61b0b1e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac11fcc0 con 0x7f61ac133420 2023-09-30T22:29:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.875+0000 7f61b0b1e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac131a00 con 0x7f61ac133e30 2023-09-30T22:29:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.875+0000 7f61aad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61ac134260 0x7f61ac09cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.875+0000 7f61aa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ac133420 0x7f61ac09c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.875+0000 7f61aad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61ac134260 0x7f61ac09cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57160/0 (socket says 172.21.15.59:57160) 2023-09-30T22:29:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.875+0000 7f61aad9d700 1 -- 172.21.15.59:0/1984573111 learned_addr learned my addr 172.21.15.59:0/1984573111 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:39.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.876+0000 7f61a9d9b700 1 --2- 172.21.15.59:0/1984573111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61ac133e30 0x7f61ac09c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.876+0000 7f61aad9d700 1 -- 172.21.15.59:0/1984573111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61ac133e30 msgr2=0x7f61ac09c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.876+0000 7f61aad9d700 1 --2- 172.21.15.59:0/1984573111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61ac133e30 0x7f61ac09c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.876+0000 7f61aad9d700 1 -- 172.21.15.59:0/1984573111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ac133420 msgr2=0x7f61ac09c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.876+0000 7f61aad9d700 1 --2- 172.21.15.59:0/1984573111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ac133420 0x7f61ac09c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.876+0000 7f61aad9d700 1 -- 172.21.15.59:0/1984573111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a00094a0 con 0x7f61ac134260 2023-09-30T22:29:39.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.876+0000 7f61aad9d700 1 --2- 172.21.15.59:0/1984573111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61ac134260 0x7f61ac09cd20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f61a400cbd0 tx=0x7f61a400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.876+0000 7f619affd700 1 -- 172.21.15.59:0/1984573111 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a400aaa0 con 0x7f61ac134260 2023-09-30T22:29:39.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.876+0000 7f619affd700 1 -- 172.21.15.59:0/1984573111 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a400ac00 con 0x7f61ac134260 2023-09-30T22:29:39.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.876+0000 7f619affd700 1 -- 172.21.15.59:0/1984573111 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4007070 con 0x7f61ac134260 2023-09-30T22:29:39.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.876+0000 7f61b0b1e700 1 -- 172.21.15.59:0/1984573111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619c009550 con 0x7f61ac134260 2023-09-30T22:29:39.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.877+0000 7f61b0b1e700 1 -- 172.21.15.59:0/1984573111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac12db80 con 0x7f61ac134260 2023-09-30T22:29:39.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.877+0000 7f61b0b1e700 1 -- 172.21.15.59:0/1984573111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ac11fee0 con 0x7f61ac134260 2023-09-30T22:29:39.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.879+0000 7f619affd700 1 -- 172.21.15.59:0/1984573111 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f61a40071d0 con 0x7f61ac134260 2023-09-30T22:29:39.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.879+0000 7f619affd700 1 -- 172.21.15.59:0/1984573111 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f61a403ffd0 con 0x7f61ac134260 2023-09-30T22:29:39.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.879+0000 7f61aa59c700 1 -- 172.21.15.59:0/1984573111 >> v1:172.21.15.59:6816/126772 conn(0x7f618c02f510 legacy=0x7f618c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:39.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.883+0000 7f0c759d9700 1 Processor -- start 2023-09-30T22:29:39.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.883+0000 7f0c759d9700 1 -- start start 2023-09-30T22:29:39.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.883+0000 7f0c759d9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7012cf60 0x7f0c7006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.883+0000 7f0c759d9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7012f8b0 0x7f0c7012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.883+0000 7f0c759d9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c70130260 0x7f0c70136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.883+0000 7f0c759d9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7012d330 con 0x7f0c70130260 2023-09-30T22:29:39.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.883+0000 7f0c759d9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7012cd90 con 0x7f0c7012f8b0 2023-09-30T22:29:39.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.883+0000 7f0c759d9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c701306d0 con 0x7f0c7012cf60 2023-09-30T22:29:39.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.883+0000 7f0c6effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7012cf60 0x7f0c7006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.883+0000 7f0c6e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7012f8b0 0x7f0c7012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.883+0000 7f0c6effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7012cf60 0x7f0c7006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36682/0 (socket says 172.21.15.59:36682) 2023-09-30T22:29:39.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.883+0000 7f0c6effd700 1 -- 172.21.15.59:0/1146869235 learned_addr learned my addr 172.21.15.59:0/1146869235 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:39.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.884+0000 7f619affd700 1 -- 172.21.15.59:0/1984573111 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61a4007480 con 0x7f61ac134260 2023-09-30T22:29:39.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.884+0000 7f0c6f7fe700 1 --2- 172.21.15.59:0/1146869235 >> v2:172.21.15.59:3300/0 conn(0x7f0c70130260 0x7f0c70136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.884+0000 7f0c6e7fc700 1 -- 172.21.15.59:0/1146869235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7012cf60 msgr2=0x7f0c7006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:39.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.884+0000 7f0c6e7fc700 1 --2- 172.21.15.59:0/1146869235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7012cf60 0x7f0c7006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.884+0000 7f0c6e7fc700 1 -- 172.21.15.59:0/1146869235 >> v2:172.21.15.59:3300/0 conn(0x7f0c70130260 msgr2=0x7f0c70136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:39.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.884+0000 7f0c6e7fc700 1 --2- 172.21.15.59:0/1146869235 >> v2:172.21.15.59:3300/0 conn(0x7f0c70130260 0x7f0c70136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.884+0000 7f0c6e7fc700 1 -- 172.21.15.59:0/1146869235 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c70071780 con 0x7f0c7012f8b0 2023-09-30T22:29:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.884+0000 7f0c6f7fe700 1 --2- 172.21.15.59:0/1146869235 >> v2:172.21.15.59:3300/0 conn(0x7f0c70130260 0x7f0c70136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.884+0000 7f0c6e7fc700 1 --2- 172.21.15.59:0/1146869235 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7012f8b0 0x7f0c7012fd20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000bae0 tx=0x7f0c6000bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4921afb360de9bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.884+0000 7f0c6dffb700 1 -- 172.21.15.59:0/1146869235 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6000dc70 con 0x7f0c7012f8b0 2023-09-30T22:29:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.884+0000 7f0c6dffb700 1 -- 172.21.15.59:0/1146869235 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6000ddd0 con 0x7f0c7012f8b0 2023-09-30T22:29:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.884+0000 7f0c6dffb700 1 -- 172.21.15.59:0/1146869235 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60010690 con 0x7f0c7012f8b0 2023-09-30T22:29:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.885+0000 7f0c759d9700 1 -- 172.21.15.59:0/1146869235 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7012f8b0 msgr2=0x7f0c7012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.885+0000 7f0c759d9700 1 --2- 172.21.15.59:0/1146869235 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7012f8b0 0x7f0c7012fd20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000bae0 tx=0x7f0c6000bdf0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.885+0000 7f0c759d9700 1 -- 172.21.15.59:0/1146869235 shutdown_connections 2023-09-30T22:29:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.885+0000 7f0c759d9700 1 --2- 172.21.15.59:0/1146869235 >> v2:172.21.15.59:3300/0 conn(0x7f0c70130260 0x7f0c70136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.885+0000 7f0c759d9700 1 --2- 172.21.15.59:0/1146869235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7012cf60 0x7f0c7006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.885+0000 7f0c759d9700 1 --2- 172.21.15.59:0/1146869235 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7012f8b0 0x7f0c7012fd20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.885+0000 7f0c759d9700 1 -- 172.21.15.59:0/1146869235 >> 172.21.15.59:0/1146869235 conn(0x7f0c700a2aa0 msgr2=0x7f0c700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.886+0000 7f0c759d9700 1 -- 172.21.15.59:0/1146869235 shutdown_connections 2023-09-30T22:29:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.886+0000 7f0c759d9700 1 -- 172.21.15.59:0/1146869235 wait complete. 2023-09-30T22:29:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.887+0000 7f0c759d9700 1 Processor -- start 2023-09-30T22:29:39.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.888+0000 7f0c759d9700 1 -- start start 2023-09-30T22:29:39.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.888+0000 7f0c759d9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c7012cf60 0x7f0c701c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.888+0000 7f0c759d9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7012f8b0 0x7f0c701c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.888+0000 7f0c6effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c7012cf60 0x7f0c701c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.888+0000 7f0c6effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c7012cf60 0x7f0c701c5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57182/0 (socket says 172.21.15.59:57182) 2023-09-30T22:29:39.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.889+0000 7f0c759d9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c70130260 0x7f0c701c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.889+0000 7f0c759d9700 1 -- 172.21.15.59:0/583456397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7009e650 con 0x7f0c7012cf60 2023-09-30T22:29:39.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.889+0000 7f0c6effd700 1 -- 172.21.15.59:0/583456397 learned_addr learned my addr 172.21.15.59:0/583456397 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:39.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.889+0000 7f0c759d9700 1 -- 172.21.15.59:0/583456397 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c70129c60 con 0x7f0c7012f8b0 2023-09-30T22:29:39.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.889+0000 7f0c759d9700 1 -- 172.21.15.59:0/583456397 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7012f540 con 0x7f0c70130260 2023-09-30T22:29:39.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.889+0000 7f0c6effd700 1 -- 172.21.15.59:0/583456397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c70130260 msgr2=0x7f0c701c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.889+0000 7f0c6effd700 1 --2- 172.21.15.59:0/583456397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c70130260 0x7f0c701c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.889+0000 7f0c6effd700 1 -- 172.21.15.59:0/583456397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7012f8b0 msgr2=0x7f0c701c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.889+0000 7f0c6effd700 1 --2- 172.21.15.59:0/583456397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7012f8b0 0x7f0c701c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.889+0000 7f0c6effd700 1 -- 172.21.15.59:0/583456397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6000b740 con 0x7f0c7012cf60 2023-09-30T22:29:39.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.889+0000 7f0c6effd700 1 --2- 172.21.15.59:0/583456397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c7012cf60 0x7f0c701c5220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400e940 tx=0x7f0c6400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.890+0000 7f0c57fff700 1 -- 172.21.15.59:0/583456397 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c640096a0 con 0x7f0c7012cf60 2023-09-30T22:29:39.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.890+0000 7f0c57fff700 1 -- 172.21.15.59:0/583456397 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6400c850 con 0x7f0c7012cf60 2023-09-30T22:29:39.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.890+0000 7f0c57fff700 1 -- 172.21.15.59:0/583456397 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6400cc00 con 0x7f0c7012cf60 2023-09-30T22:29:39.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.890+0000 7f0c759d9700 1 -- 172.21.15.59:0/583456397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c70129fa0 con 0x7f0c7012cf60 2023-09-30T22:29:39.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.890+0000 7f0c759d9700 1 -- 172.21.15.59:0/583456397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7009cce0 con 0x7f0c7012cf60 2023-09-30T22:29:39.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.891+0000 7f0c57fff700 1 -- 172.21.15.59:0/583456397 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0c6400cd60 con 0x7f0c7012cf60 2023-09-30T22:29:39.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.892+0000 7f0c57fff700 1 -- 172.21.15.59:0/583456397 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0c6403fce0 con 0x7f0c7012cf60 2023-09-30T22:29:39.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.892+0000 7f0c6e7fc700 1 -- 172.21.15.59:0/583456397 >> v1:172.21.15.59:6816/126772 conn(0x7f0c5c02f510 legacy=0x7f0c5c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:39.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.892+0000 7f0c759d9700 1 -- 172.21.15.59:0/583456397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7009e870 con 0x7f0c7012cf60 2023-09-30T22:29:39.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:39.897+0000 7f0c57fff700 1 -- 172.21.15.59:0/583456397 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c640232f0 con 0x7f0c7012cf60 2023-09-30T22:29:40.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.031+0000 7fe67df46700 1 -- 172.21.15.59:0/3186389018 >> v1:172.21.15.59:6816/126772 conn(0x7fe65c02f510 legacy=0x7fe65c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:40.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.047+0000 7ff2f1417700 1 -- 172.21.15.59:0/3194592161 >> v1:172.21.15.59:6816/126772 conn(0x7ff2d002f510 legacy=0x7ff2d00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:40.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.050+0000 7fe6801aa700 1 -- 172.21.15.59:0/3186389018 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe678121e40 con 0x7fe67809e1d0 2023-09-30T22:29:40.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.051+0000 7fe66e7fc700 1 -- 172.21.15.59:0/3186389018 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe678121e40 con 0x7fe67809e1d0 2023-09-30T22:29:40.051 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:40.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.053+0000 7fe6801aa700 1 -- 172.21.15.59:0/3186389018 >> v1:172.21.15.59:6816/126772 conn(0x7fe65c02f510 legacy=0x7fe65c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:40.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.053+0000 7fe6801aa700 1 -- 172.21.15.59:0/3186389018 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe67809e1d0 msgr2=0x7fe6781c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:40.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.053+0000 7fe6801aa700 1 --2- 172.21.15.59:0/3186389018 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe67809e1d0 0x7fe6781c89c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe66800e840 tx=0x7fe66800eb50 comp rx=0 tx=0).stop 2023-09-30T22:29:40.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.053+0000 7fe6801aa700 1 -- 172.21.15.59:0/3186389018 shutdown_connections 2023-09-30T22:29:40.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.053+0000 7fe6801aa700 1 --2- 172.21.15.59:0/3186389018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe678139170 0x7fe67811e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.053+0000 7fe6801aa700 1 --2- 172.21.15.59:0/3186389018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe67809d6f0 0x7fe6781c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.053+0000 7fe6801aa700 1 --2- 172.21.15.59:0/3186389018 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe67809e1d0 0x7fe6781c89c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.053+0000 7fe6801aa700 1 -- 172.21.15.59:0/3186389018 >> 172.21.15.59:0/3186389018 conn(0x7fe678066f50 msgr2=0x7fe6780a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:40.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.053+0000 7fe6801aa700 1 -- 172.21.15.59:0/3186389018 shutdown_connections 2023-09-30T22:29:40.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.053+0000 7fe6801aa700 1 -- 172.21.15.59:0/3186389018 wait complete. 2023-09-30T22:29:40.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.061+0000 7ff2f3e7c700 1 -- 172.21.15.59:0/3194592161 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff2ec074ea0 con 0x7ff2ec09d6f0 2023-09-30T22:29:40.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.061+0000 7ff2e27fc700 1 -- 172.21.15.59:0/3194592161 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2e80199a0 con 0x7ff2ec09d6f0 2023-09-30T22:29:40.062 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:40.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.064+0000 7ff2f3e7c700 1 -- 172.21.15.59:0/3194592161 >> v1:172.21.15.59:6816/126772 conn(0x7ff2d002f510 legacy=0x7ff2d00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:40.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.064+0000 7ff2f3e7c700 1 -- 172.21.15.59:0/3194592161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2ec09d6f0 msgr2=0x7ff2ec1a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:40.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.064+0000 7ff2f3e7c700 1 --2- 172.21.15.59:0/3194592161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2ec09d6f0 0x7ff2ec1a5de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009c70 tx=0x7ff2e8004750 comp rx=0 tx=0).stop 2023-09-30T22:29:40.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.064+0000 7ff2f3e7c700 1 -- 172.21.15.59:0/3194592161 shutdown_connections 2023-09-30T22:29:40.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.064+0000 7ff2f3e7c700 1 --2- 172.21.15.59:0/3194592161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2ec09e410 0x7ff2ec1a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.064+0000 7ff2f3e7c700 1 --2- 172.21.15.59:0/3194592161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2ec09d6f0 0x7ff2ec1a5de0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.064+0000 7ff2f3e7c700 1 --2- 172.21.15.59:0/3194592161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2ec09e000 0x7ff2ec1a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.064+0000 7ff2f3e7c700 1 -- 172.21.15.59:0/3194592161 >> 172.21.15.59:0/3194592161 conn(0x7ff2ec066f50 msgr2=0x7ff2ec1bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:40.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.064+0000 7ff2f3e7c700 1 -- 172.21.15.59:0/3194592161 shutdown_connections 2023-09-30T22:29:40.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.064+0000 7ff2f3e7c700 1 -- 172.21.15.59:0/3194592161 wait complete. 2023-09-30T22:29:40.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:40.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:40.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.080+0000 7f61aa59c700 1 -- 172.21.15.59:0/1984573111 >> v1:172.21.15.59:6816/126772 conn(0x7f618c02f510 legacy=0x7f618c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:40.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.093+0000 7f0c6e7fc700 1 -- 172.21.15.59:0/583456397 >> v1:172.21.15.59:6816/126772 conn(0x7f0c5c02f510 legacy=0x7f0c5c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.114+0000 7f61b0b1e700 1 -- 172.21.15.59:0/1984573111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f61ac1200c0 con 0x7f61ac134260 2023-09-30T22:29:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.114+0000 7f619affd700 1 -- 172.21.15.59:0/1984573111 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61ac1200c0 con 0x7f61ac134260 2023-09-30T22:29:40.114 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:40.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.116+0000 7f61b0b1e700 1 -- 172.21.15.59:0/1984573111 >> v1:172.21.15.59:6816/126772 conn(0x7f618c02f510 legacy=0x7f618c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.116+0000 7f61b0b1e700 1 -- 172.21.15.59:0/1984573111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61ac134260 msgr2=0x7f61ac09cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.116+0000 7f61b0b1e700 1 --2- 172.21.15.59:0/1984573111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61ac134260 0x7f61ac09cd20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f61a400cbd0 tx=0x7f61a400cee0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.116+0000 7f61b0b1e700 1 -- 172.21.15.59:0/1984573111 shutdown_connections 2023-09-30T22:29:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.116+0000 7f61b0b1e700 1 --2- 172.21.15.59:0/1984573111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61ac134260 0x7f61ac09cd20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.116+0000 7f61b0b1e700 1 --2- 172.21.15.59:0/1984573111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ac133420 0x7f61ac09c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.116+0000 7f61b0b1e700 1 --2- 172.21.15.59:0/1984573111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61ac133e30 0x7f61ac09c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.116+0000 7f61b0b1e700 1 -- 172.21.15.59:0/1984573111 >> 172.21.15.59:0/1984573111 conn(0x7f61ac0a4210 msgr2=0x7f61ac0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.116+0000 7f61b0b1e700 1 -- 172.21.15.59:0/1984573111 shutdown_connections 2023-09-30T22:29:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.116+0000 7f61b0b1e700 1 -- 172.21.15.59:0/1984573111 wait complete. 2023-09-30T22:29:40.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.123+0000 7f0c759d9700 1 -- 172.21.15.59:0/583456397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0c70074ea0 con 0x7f0c7012cf60 2023-09-30T22:29:40.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.124+0000 7f0c57fff700 1 -- 172.21.15.59:0/583456397 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c64011350 con 0x7f0c7012cf60 2023-09-30T22:29:40.124 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:40.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.126+0000 7f0c759d9700 1 -- 172.21.15.59:0/583456397 >> v1:172.21.15.59:6816/126772 conn(0x7f0c5c02f510 legacy=0x7f0c5c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:40.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.126+0000 7f0c759d9700 1 -- 172.21.15.59:0/583456397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c7012cf60 msgr2=0x7f0c701c5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:40.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.126+0000 7f0c759d9700 1 --2- 172.21.15.59:0/583456397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c7012cf60 0x7f0c701c5220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400e940 tx=0x7f0c6400ed00 comp rx=0 tx=0).stop 2023-09-30T22:29:40.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.126+0000 7f0c759d9700 1 -- 172.21.15.59:0/583456397 shutdown_connections 2023-09-30T22:29:40.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.126+0000 7f0c759d9700 1 --2- 172.21.15.59:0/583456397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c70130260 0x7f0c701c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.126+0000 7f0c759d9700 1 --2- 172.21.15.59:0/583456397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c7012cf60 0x7f0c701c5220 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.126+0000 7f0c759d9700 1 --2- 172.21.15.59:0/583456397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7012f8b0 0x7f0c701c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.126+0000 7f0c759d9700 1 -- 172.21.15.59:0/583456397 >> 172.21.15.59:0/583456397 conn(0x7f0c700a2aa0 msgr2=0x7f0c7006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:40.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.127+0000 7f0c759d9700 1 -- 172.21.15.59:0/583456397 shutdown_connections 2023-09-30T22:29:40.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:40.127+0000 7f0c759d9700 1 -- 172.21.15.59:0/583456397 wait complete. 2023-09-30T22:29:40.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:40.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:41.068 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:41.079 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:41.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:41.141 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:41.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.220+0000 7f933becf700 1 Processor -- start 2023-09-30T22:29:41.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.220+0000 7f933becf700 1 -- start start 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.221+0000 7f933becf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9334136710 0x7f9334138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.221+0000 7f933becf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9334139030 0x7f933413b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.221+0000 7f933becf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933406ef30 con 0x7f93341338a0 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.221+0000 7f933becf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933406fef0 con 0x7f9334136710 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.221+0000 7f933becf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93341334b0 con 0x7f9334139030 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.221+0000 7f933a46c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9334139030 0x7f933413b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.221+0000 7f933a46c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9334139030 0x7f933413b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36708/0 (socket says 172.21.15.59:36708) 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.221+0000 7f933a46c700 1 -- 172.21.15.59:0/105194844 learned_addr learned my addr 172.21.15.59:0/105194844 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.221+0000 7f933946a700 1 --2- 172.21.15.59:0/105194844 >> v2:172.21.15.59:3300/0 conn(0x7f9334136710 0x7f9334138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.222+0000 7f933a46c700 1 -- 172.21.15.59:0/105194844 >> v2:172.21.15.59:3300/0 conn(0x7f9334136710 msgr2=0x7f9334138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:41.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.222+0000 7f933a46c700 1 --2- 172.21.15.59:0/105194844 >> v2:172.21.15.59:3300/0 conn(0x7f9334136710 0x7f9334138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.222+0000 7f933a46c700 1 -- 172.21.15.59:0/105194844 >> v1:172.21.15.59:6789/0 conn(0x7f93341338a0 legacy=0x7f9334133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.222+0000 7f933a46c700 1 -- 172.21.15.59:0/105194844 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933406fc30 con 0x7f9334139030 2023-09-30T22:29:41.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.222+0000 7f933a46c700 1 --2- 172.21.15.59:0/105194844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9334139030 0x7f933413b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f932c009e50 tx=0x7f932c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd8997a5b2639e30 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.222+0000 7f9338c69700 1 -- 172.21.15.59:0/105194844 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c00e070 con 0x7f9334139030 2023-09-30T22:29:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.222+0000 7f9338c69700 1 -- 172.21.15.59:0/105194844 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c00b910 con 0x7f9334139030 2023-09-30T22:29:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.222+0000 7f9338c69700 1 -- 172.21.15.59:0/105194844 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c00bcc0 con 0x7f9334139030 2023-09-30T22:29:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.223+0000 7f933becf700 1 -- 172.21.15.59:0/105194844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9334139030 msgr2=0x7f933413b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.223+0000 7f933becf700 1 --2- 172.21.15.59:0/105194844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9334139030 0x7f933413b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f932c009e50 tx=0x7f932c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.223+0000 7f933becf700 1 -- 172.21.15.59:0/105194844 shutdown_connections 2023-09-30T22:29:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.223+0000 7f933becf700 1 --2- 172.21.15.59:0/105194844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9334139030 0x7f933413b410 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.223+0000 7f933becf700 1 --2- 172.21.15.59:0/105194844 >> v2:172.21.15.59:3300/0 conn(0x7f9334136710 0x7f9334138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.223+0000 7f933becf700 1 -- 172.21.15.59:0/105194844 >> 172.21.15.59:0/105194844 conn(0x7f93340a2aa0 msgr2=0x7f93340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.223+0000 7f933becf700 1 -- 172.21.15.59:0/105194844 shutdown_connections 2023-09-30T22:29:41.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.223+0000 7f933becf700 1 -- 172.21.15.59:0/105194844 wait complete. 2023-09-30T22:29:41.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.225+0000 7f933becf700 1 Processor -- start 2023-09-30T22:29:41.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.225+0000 7f933becf700 1 -- start start 2023-09-30T22:29:41.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.225+0000 7f933becf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93341338a0 0x7f933411ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.225+0000 7f933becf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9334136710 0x7f933411b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.225+0000 7f933becf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9334139030 0x7f933411b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.225+0000 7f933becf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9334138d90 con 0x7f9334139030 2023-09-30T22:29:41.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.225+0000 7f933becf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933411c9f0 con 0x7f9334136710 2023-09-30T22:29:41.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.225+0000 7f933becf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f933406f640 con 0x7f93341338a0 2023-09-30T22:29:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.226+0000 7f9339c6b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93341338a0 0x7f933411ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.226+0000 7f933a46c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9334139030 0x7f933411b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.226+0000 7f933a46c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9334139030 0x7f933411b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57198/0 (socket says 172.21.15.59:57198) 2023-09-30T22:29:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.226+0000 7f933a46c700 1 -- 172.21.15.59:0/940217816 learned_addr learned my addr 172.21.15.59:0/940217816 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.226+0000 7f9339c6b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93341338a0 0x7f933411ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36718/0 (socket says 172.21.15.59:36718) 2023-09-30T22:29:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.226+0000 7f9339c6b700 1 -- 172.21.15.59:0/940217816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9334136710 msgr2=0x7f933411b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.226+0000 7f9339c6b700 1 --2- 172.21.15.59:0/940217816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9334136710 0x7f933411b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.226+0000 7f9339c6b700 1 -- 172.21.15.59:0/940217816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9334139030 msgr2=0x7f933411b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.226+0000 7f9339c6b700 1 --2- 172.21.15.59:0/940217816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9334139030 0x7f933411b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.226+0000 7f9339c6b700 1 -- 172.21.15.59:0/940217816 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c009b30 con 0x7f93341338a0 2023-09-30T22:29:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.226+0000 7f933a46c700 1 --2- 172.21.15.59:0/940217816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9334139030 0x7f933411b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.226+0000 7f9339c6b700 1 --2- 172.21.15.59:0/940217816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93341338a0 0x7f933411ad40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9330000f60 tx=0x7f933000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.227+0000 7f932a7fc700 1 -- 172.21.15.59:0/940217816 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93300052d0 con 0x7f93341338a0 2023-09-30T22:29:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.227+0000 7f932a7fc700 1 -- 172.21.15.59:0/940217816 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9330005430 con 0x7f93341338a0 2023-09-30T22:29:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.227+0000 7f933becf700 1 -- 172.21.15.59:0/940217816 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933411e580 con 0x7f93341338a0 2023-09-30T22:29:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.227+0000 7f933becf700 1 -- 172.21.15.59:0/940217816 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933411eff0 con 0x7f93341338a0 2023-09-30T22:29:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.227+0000 7f932a7fc700 1 -- 172.21.15.59:0/940217816 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93300038c0 con 0x7f93341338a0 2023-09-30T22:29:41.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.228+0000 7f933becf700 1 -- 172.21.15.59:0/940217816 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931c0052e0 con 0x7f93341338a0 2023-09-30T22:29:41.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.229+0000 7f932a7fc700 1 -- 172.21.15.59:0/940217816 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9330003a20 con 0x7f93341338a0 2023-09-30T22:29:41.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.229+0000 7f932a7fc700 1 -- 172.21.15.59:0/940217816 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f933003f170 con 0x7f93341338a0 2023-09-30T22:29:41.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.229+0000 7f933946a700 1 -- 172.21.15.59:0/940217816 >> v1:172.21.15.59:6816/126772 conn(0x7f931802f510 legacy=0x7f93180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:41.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.233+0000 7f932a7fc700 1 -- 172.21.15.59:0/940217816 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9330003cd0 con 0x7f93341338a0 2023-09-30T22:29:41.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.279+0000 7f0f69273700 1 Processor -- start 2023-09-30T22:29:41.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.279+0000 7f0f69273700 1 -- start start 2023-09-30T22:29:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f69273700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f6409d6f0 0x7f0f6409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f69273700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f6409e000 0x7f0f641339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f69273700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f6409e410 0x7f0f64133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f69273700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6406b460 con 0x7f0f6409e410 2023-09-30T22:29:41.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f69273700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6409b120 con 0x7f0f6409d6f0 2023-09-30T22:29:41.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f69273700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6409a7e0 con 0x7f0f6409e000 2023-09-30T22:29:41.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f62ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f6409d6f0 0x7f0f6409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f62ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f6409d6f0 0x7f0f6409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38982/0 (socket says 172.21.15.59:38982) 2023-09-30T22:29:41.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f62ffd700 1 -- 172.21.15.59:0/1955434581 learned_addr learned my addr 172.21.15.59:0/1955434581 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:41.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f637fe700 1 --2- 172.21.15.59:0/1955434581 >> v2:172.21.15.59:3300/0 conn(0x7f0f6409e410 0x7f0f64133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f627fc700 1 --2- 172.21.15.59:0/1955434581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f6409e000 0x7f0f641339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f62ffd700 1 -- 172.21.15.59:0/1955434581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f6409e000 msgr2=0x7f0f641339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:41.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f62ffd700 1 --2- 172.21.15.59:0/1955434581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f6409e000 0x7f0f641339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f62ffd700 1 -- 172.21.15.59:0/1955434581 >> v2:172.21.15.59:3300/0 conn(0x7f0f6409e410 msgr2=0x7f0f64133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:41.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f62ffd700 1 --2- 172.21.15.59:0/1955434581 >> v2:172.21.15.59:3300/0 conn(0x7f0f6409e410 0x7f0f64133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.280+0000 7f0f62ffd700 1 -- 172.21.15.59:0/1955434581 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6409a500 con 0x7f0f6409d6f0 2023-09-30T22:29:41.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.281+0000 7f0f62ffd700 1 --2- 172.21.15.59:0/1955434581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f6409d6f0 0x7f0f6409dac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009920 tx=0x7f0f54009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5000cd83899fb78 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.281+0000 7f0f61ffb700 1 -- 172.21.15.59:0/1955434581 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f54011830 con 0x7f0f6409d6f0 2023-09-30T22:29:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.281+0000 7f0f61ffb700 1 -- 172.21.15.59:0/1955434581 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f54011990 con 0x7f0f6409d6f0 2023-09-30T22:29:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.281+0000 7f0f61ffb700 1 -- 172.21.15.59:0/1955434581 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f54011d20 con 0x7f0f6409d6f0 2023-09-30T22:29:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.282+0000 7f0f69273700 1 -- 172.21.15.59:0/1955434581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f6409d6f0 msgr2=0x7f0f6409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.282+0000 7f0f69273700 1 --2- 172.21.15.59:0/1955434581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f6409d6f0 0x7f0f6409dac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009920 tx=0x7f0f54009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.282+0000 7f0f69273700 1 -- 172.21.15.59:0/1955434581 shutdown_connections 2023-09-30T22:29:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.282+0000 7f0f69273700 1 --2- 172.21.15.59:0/1955434581 >> v2:172.21.15.59:3300/0 conn(0x7f0f6409e410 0x7f0f64133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.282+0000 7f0f69273700 1 --2- 172.21.15.59:0/1955434581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f6409d6f0 0x7f0f6409dac0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.282+0000 7f0f69273700 1 --2- 172.21.15.59:0/1955434581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f6409e000 0x7f0f641339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.282+0000 7f0f69273700 1 -- 172.21.15.59:0/1955434581 >> 172.21.15.59:0/1955434581 conn(0x7f0f64066f50 msgr2=0x7f0f6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.282+0000 7f0f69273700 1 -- 172.21.15.59:0/1955434581 shutdown_connections 2023-09-30T22:29:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.282+0000 7f0f69273700 1 -- 172.21.15.59:0/1955434581 wait complete. 2023-09-30T22:29:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.284+0000 7f0f69273700 1 Processor -- start 2023-09-30T22:29:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.284+0000 7f0f69273700 1 -- start start 2023-09-30T22:29:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f69273700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f6409d6f0 0x7f0f641c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f69273700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f6409e000 0x7f0f641c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f69273700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f6409e410 0x7f0f641c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f69273700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f641a5590 con 0x7f0f6409e410 2023-09-30T22:29:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f69273700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f641a53a0 con 0x7f0f6409d6f0 2023-09-30T22:29:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f69273700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640a30c0 con 0x7f0f6409e000 2023-09-30T22:29:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f62ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f6409d6f0 0x7f0f641c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f62ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f6409d6f0 0x7f0f641c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38990/0 (socket says 172.21.15.59:38990) 2023-09-30T22:29:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f62ffd700 1 -- 172.21.15.59:0/2258640794 learned_addr learned my addr 172.21.15.59:0/2258640794 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f627fc700 1 --2- 172.21.15.59:0/2258640794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f6409e000 0x7f0f641c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f637fe700 1 --2- 172.21.15.59:0/2258640794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f6409e410 0x7f0f641c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f62ffd700 1 -- 172.21.15.59:0/2258640794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f6409e000 msgr2=0x7f0f641c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f62ffd700 1 --2- 172.21.15.59:0/2258640794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f6409e000 0x7f0f641c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f62ffd700 1 -- 172.21.15.59:0/2258640794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f6409e410 msgr2=0x7f0f641c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f62ffd700 1 --2- 172.21.15.59:0/2258640794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f6409e410 0x7f0f641c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.285+0000 7f0f62ffd700 1 -- 172.21.15.59:0/2258640794 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f54009550 con 0x7f0f6409d6f0 2023-09-30T22:29:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.286+0000 7f0f62ffd700 1 --2- 172.21.15.59:0/2258640794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f6409d6f0 0x7f0f641c8190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0f54000c00 tx=0x7f0f54004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.286+0000 7f0f4b7fe700 1 -- 172.21.15.59:0/2258640794 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f54004300 con 0x7f0f6409d6f0 2023-09-30T22:29:41.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.286+0000 7f0f4b7fe700 1 -- 172.21.15.59:0/2258640794 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5401f070 con 0x7f0f6409d6f0 2023-09-30T22:29:41.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.286+0000 7f0f4b7fe700 1 -- 172.21.15.59:0/2258640794 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f540036a0 con 0x7f0f6409d6f0 2023-09-30T22:29:41.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.287+0000 7f0f69273700 1 -- 172.21.15.59:0/2258640794 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6409c710 con 0x7f0f6409d6f0 2023-09-30T22:29:41.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.287+0000 7f0f69273700 1 -- 172.21.15.59:0/2258640794 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f641b84f0 con 0x7f0f6409d6f0 2023-09-30T22:29:41.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.288+0000 7f0f4b7fe700 1 -- 172.21.15.59:0/2258640794 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0f54021030 con 0x7f0f6409d6f0 2023-09-30T22:29:41.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.288+0000 7f0f4b7fe700 1 -- 172.21.15.59:0/2258640794 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0f54040d40 con 0x7f0f6409d6f0 2023-09-30T22:29:41.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.288+0000 7f0f627fc700 1 -- 172.21.15.59:0/2258640794 >> v1:172.21.15.59:6816/126772 conn(0x7f0f5002f510 legacy=0x7f0f500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:41.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.288+0000 7f0f69273700 1 -- 172.21.15.59:0/2258640794 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f64074ea0 con 0x7f0f6409d6f0 2023-09-30T22:29:41.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.296+0000 7f0f4b7fe700 1 -- 172.21.15.59:0/2258640794 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f54015020 con 0x7f0f6409d6f0 2023-09-30T22:29:41.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.304+0000 7fd35add1700 1 Processor -- start 2023-09-30T22:29:41.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.304+0000 7fd35add1700 1 -- start start 2023-09-30T22:29:41.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.305+0000 7fd35add1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd35409d6f0 0x7fd35409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.305+0000 7fd35add1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd35409e410 0x7fd354130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.305+0000 7fd35add1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35409f130 con 0x7fd35409e000 2023-09-30T22:29:41.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.305+0000 7fd35add1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35409f520 con 0x7fd35409e410 2023-09-30T22:29:41.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.305+0000 7fd35add1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd35409e930 con 0x7fd35409d6f0 2023-09-30T22:29:41.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.305+0000 7fd353fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd35409e000 0x7fd354130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58530/0 (socket says 172.21.15.59:58530) 2023-09-30T22:29:41.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.305+0000 7fd353fff700 1 -- 172.21.15.59:0/1073643673 learned_addr learned my addr 172.21.15.59:0/1073643673 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:41.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.305+0000 7fd358b6d700 1 --2- 172.21.15.59:0/1073643673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd35409d6f0 0x7fd35409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.305+0000 7fd35936e700 1 --2- 172.21.15.59:0/1073643673 >> v2:172.21.15.59:3300/0 conn(0x7fd35409e410 0x7fd354130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.305+0000 7f890156f700 1 Processor -- start 2023-09-30T22:29:41.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.306+0000 7f890156f700 1 -- start start 2023-09-30T22:29:41.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.306+0000 7fd358b6d700 1 -- 172.21.15.59:0/1073643673 >> v2:172.21.15.59:3300/0 conn(0x7fd35409e410 msgr2=0x7fd354130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:41.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.306+0000 7fd358b6d700 1 --2- 172.21.15.59:0/1073643673 >> v2:172.21.15.59:3300/0 conn(0x7fd35409e410 0x7fd354130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.306+0000 7fd358b6d700 1 -- 172.21.15.59:0/1073643673 >> v1:172.21.15.59:6789/0 conn(0x7fd35409e000 legacy=0x7fd354130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.306+0000 7fd358b6d700 1 -- 172.21.15.59:0/1073643673 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35409b2d0 con 0x7fd35409d6f0 2023-09-30T22:29:41.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.306+0000 7fd3537fe700 1 -- 172.21.15.59:0/1073643673 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882382781 0 0) 0x7fd35409f130 con 0x7fd35409e000 2023-09-30T22:29:41.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.306+0000 7fd358b6d700 1 --2- 172.21.15.59:0/1073643673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd35409d6f0 0x7fd35409dac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd348009840 tx=0x7fd348009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6d74520229cb7b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.306+0000 7fd3537fe700 1 -- 172.21.15.59:0/1073643673 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348011830 con 0x7fd35409d6f0 2023-09-30T22:29:41.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.306+0000 7fd3537fe700 1 -- 172.21.15.59:0/1073643673 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd348011990 con 0x7fd35409d6f0 2023-09-30T22:29:41.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.306+0000 7fd3537fe700 1 -- 172.21.15.59:0/1073643673 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348011d20 con 0x7fd35409d6f0 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.306+0000 7f890156f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88fc1338a0 0x7f88fc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.306+0000 7f890156f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88fc09e930 0x7f88fc13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.306+0000 7f890156f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88fc06ef30 con 0x7f88fc09de50 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.306+0000 7f890156f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88fc06fef0 con 0x7f88fc09e930 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.306+0000 7f890156f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc1334b0 con 0x7f88fc1338a0 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7f88fa7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f88fc09de50 0x7f88fc09e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58538/0 (socket says 172.21.15.59:58538) 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7f88fa7fc700 1 -- 172.21.15.59:0/3444680154 learned_addr learned my addr 172.21.15.59:0/3444680154 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7f88fb7fe700 1 --2- 172.21.15.59:0/3444680154 >> v2:172.21.15.59:3300/0 conn(0x7f88fc09e930 0x7f88fc13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7f88faffd700 1 --2- 172.21.15.59:0/3444680154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88fc1338a0 0x7f88fc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7f88f9ffb700 1 -- 172.21.15.59:0/3444680154 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553355185 0 0) 0x7f88fc06ef30 con 0x7f88fc09de50 2023-09-30T22:29:41.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7f88f9ffb700 1 -- 172.21.15.59:0/3444680154 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e40035b0 con 0x7f88fc09de50 2023-09-30T22:29:41.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7f88fb7fe700 1 -- 172.21.15.59:0/3444680154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88fc1338a0 msgr2=0x7f88fc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:41.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7f88fb7fe700 1 --2- 172.21.15.59:0/3444680154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88fc1338a0 0x7f88fc133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7f88fb7fe700 1 -- 172.21.15.59:0/3444680154 >> v1:172.21.15.59:6789/0 conn(0x7f88fc09de50 legacy=0x7f88fc09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7f88fb7fe700 1 -- 172.21.15.59:0/3444680154 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc06fc30 con 0x7f88fc09e930 2023-09-30T22:29:41.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7f88faffd700 1 --2- 172.21.15.59:0/3444680154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88fc1338a0 0x7f88fc133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:41.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7f88fb7fe700 1 --2- 172.21.15.59:0/3444680154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88fc09e930 0x7f88fc13b740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f88f4009d90 tx=0x7f88f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fb02696ccb5941 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7fd35add1700 1 -- 172.21.15.59:0/1073643673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd35409d6f0 msgr2=0x7fd35409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7fd35add1700 1 --2- 172.21.15.59:0/1073643673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd35409d6f0 0x7fd35409dac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd348009840 tx=0x7fd348009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:41.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7f88f9ffb700 1 -- 172.21.15.59:0/3444680154 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f400e070 con 0x7f88fc09e930 2023-09-30T22:29:41.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7f88f9ffb700 1 -- 172.21.15.59:0/3444680154 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f400bb20 con 0x7f88fc09e930 2023-09-30T22:29:41.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.307+0000 7f88f9ffb700 1 -- 172.21.15.59:0/3444680154 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f400be90 con 0x7f88fc09e930 2023-09-30T22:29:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.308+0000 7fd35add1700 1 -- 172.21.15.59:0/1073643673 shutdown_connections 2023-09-30T22:29:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.308+0000 7fd35add1700 1 --2- 172.21.15.59:0/1073643673 >> v2:172.21.15.59:3300/0 conn(0x7fd35409e410 0x7fd354130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.308+0000 7fd35add1700 1 --2- 172.21.15.59:0/1073643673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd35409d6f0 0x7fd35409dac0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.308+0000 7fd35add1700 1 -- 172.21.15.59:0/1073643673 >> 172.21.15.59:0/1073643673 conn(0x7fd354066f50 msgr2=0x7fd35409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.308+0000 7fd35add1700 1 -- 172.21.15.59:0/1073643673 shutdown_connections 2023-09-30T22:29:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.308+0000 7fd35add1700 1 -- 172.21.15.59:0/1073643673 wait complete. 2023-09-30T22:29:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.308+0000 7f890156f700 1 -- 172.21.15.59:0/3444680154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88fc09e930 msgr2=0x7f88fc13b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.308+0000 7f890156f700 1 --2- 172.21.15.59:0/3444680154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88fc09e930 0x7f88fc13b740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f88f4009d90 tx=0x7f88f400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.309+0000 7f890156f700 1 -- 172.21.15.59:0/3444680154 shutdown_connections 2023-09-30T22:29:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.309+0000 7f890156f700 1 --2- 172.21.15.59:0/3444680154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88fc09e930 0x7f88fc13b740 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.309+0000 7f890156f700 1 --2- 172.21.15.59:0/3444680154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88fc1338a0 0x7f88fc133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.309+0000 7f890156f700 1 -- 172.21.15.59:0/3444680154 >> 172.21.15.59:0/3444680154 conn(0x7f88fc0a2aa0 msgr2=0x7f88fc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.309+0000 7f890156f700 1 -- 172.21.15.59:0/3444680154 shutdown_connections 2023-09-30T22:29:41.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.309+0000 7f890156f700 1 -- 172.21.15.59:0/3444680154 wait complete. 2023-09-30T22:29:41.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.309+0000 7fd35add1700 1 Processor -- start 2023-09-30T22:29:41.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.309+0000 7fd35add1700 1 -- start start 2023-09-30T22:29:41.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.310+0000 7f890156f700 1 Processor -- start 2023-09-30T22:29:41.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.310+0000 7f890156f700 1 -- start start 2023-09-30T22:29:41.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.310+0000 7fd35add1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd35409d6f0 0x7fd35411de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.310+0000 7fd35add1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35409e000 0x7fd35411e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.310+0000 7fd35add1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd35409e410 0x7fd35411e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.310+0000 7fd35add1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35411fa60 con 0x7fd35409e000 2023-09-30T22:29:41.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.310+0000 7fd35add1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd354120cb0 con 0x7fd35409d6f0 2023-09-30T22:29:41.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.310+0000 7fd35add1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd354120040 con 0x7fd35409e410 2023-09-30T22:29:41.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7fd358b6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd35409d6f0 0x7fd35411de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7fd358b6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd35409d6f0 0x7fd35411de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39018/0 (socket says 172.21.15.59:39018) 2023-09-30T22:29:41.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7fd358b6d700 1 -- 172.21.15.59:0/2465666329 learned_addr learned my addr 172.21.15.59:0/2465666329 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:41.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7fd353fff700 1 --2- 172.21.15.59:0/2465666329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35409e000 0x7fd35411e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7fd358b6d700 1 -- 172.21.15.59:0/2465666329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd35409e410 msgr2=0x7fd35411e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7fd35936e700 1 --2- 172.21.15.59:0/2465666329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd35409e410 0x7fd35411e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7fd358b6d700 1 --2- 172.21.15.59:0/2465666329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd35409e410 0x7fd35411e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7fd358b6d700 1 -- 172.21.15.59:0/2465666329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35409e000 msgr2=0x7fd35411e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7fd358b6d700 1 --2- 172.21.15.59:0/2465666329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35409e000 0x7fd35411e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7f890156f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88fc09de50 0x7f88fc11b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7f890156f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88fc09e930 0x7f88fc11bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7f890156f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88fc1338a0 0x7f88fc11c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7f890156f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc11ca10 con 0x7f88fc1338a0 2023-09-30T22:29:41.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7f890156f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc11d7c0 con 0x7f88fc09de50 2023-09-30T22:29:41.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7fd358b6d700 1 -- 172.21.15.59:0/2465666329 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3480094a0 con 0x7fd35409d6f0 2023-09-30T22:29:41.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7f890156f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc11e880 con 0x7f88fc09e930 2023-09-30T22:29:41.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7f88fb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88fc1338a0 0x7f88fc11c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7f88fb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88fc1338a0 0x7f88fc11c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57270/0 (socket says 172.21.15.59:57270) 2023-09-30T22:29:41.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7f88fb7fe700 1 -- 172.21.15.59:0/4060526159 learned_addr learned my addr 172.21.15.59:0/4060526159 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:41.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7f88faffd700 1 --2- 172.21.15.59:0/4060526159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88fc09de50 0x7f88fc11b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7fd35936e700 1 --2- 172.21.15.59:0/2465666329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd35409e410 0x7fd35411e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:41.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7fd353fff700 1 --2- 172.21.15.59:0/2465666329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35409e000 0x7fd35411e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:41.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.311+0000 7fd358b6d700 1 --2- 172.21.15.59:0/2465666329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd35409d6f0 0x7fd35411de50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd3480090b0 tx=0x7fd348004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.312+0000 7f88fa7fc700 1 --2- 172.21.15.59:0/4060526159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88fc09e930 0x7f88fc11bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.312+0000 7f88faffd700 1 -- 172.21.15.59:0/4060526159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88fc09e930 msgr2=0x7f88fc11bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.312+0000 7fd3517fa700 1 -- 172.21.15.59:0/2465666329 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3480038a0 con 0x7fd35409d6f0 2023-09-30T22:29:41.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.312+0000 7f88faffd700 1 --2- 172.21.15.59:0/4060526159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88fc09e930 0x7f88fc11bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.312+0000 7f88faffd700 1 -- 172.21.15.59:0/4060526159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88fc1338a0 msgr2=0x7f88fc11c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.312+0000 7f88faffd700 1 --2- 172.21.15.59:0/4060526159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88fc1338a0 0x7f88fc11c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.312+0000 7f88faffd700 1 -- 172.21.15.59:0/4060526159 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f4009a70 con 0x7f88fc09de50 2023-09-30T22:29:41.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.312+0000 7f88faffd700 1 --2- 172.21.15.59:0/4060526159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88fc09de50 0x7f88fc11b5d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f88f000e7e0 tx=0x7f88f000eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.312+0000 7f88e37fe700 1 -- 172.21.15.59:0/4060526159 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0013610 con 0x7f88fc09de50 2023-09-30T22:29:41.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.312+0000 7f88e37fe700 1 -- 172.21.15.59:0/4060526159 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f0013770 con 0x7f88fc09de50 2023-09-30T22:29:41.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.312+0000 7f88e37fe700 1 -- 172.21.15.59:0/4060526159 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0013ae0 con 0x7f88fc09de50 2023-09-30T22:29:41.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.312+0000 7fd3517fa700 1 -- 172.21.15.59:0/2465666329 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34801f070 con 0x7fd35409d6f0 2023-09-30T22:29:41.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.312+0000 7fd35add1700 1 -- 172.21.15.59:0/2465666329 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd354121690 con 0x7fd35409d6f0 2023-09-30T22:29:41.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.312+0000 7fd35add1700 1 -- 172.21.15.59:0/2465666329 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35409c700 con 0x7fd35409d6f0 2023-09-30T22:29:41.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.312+0000 7f890156f700 1 -- 172.21.15.59:0/4060526159 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88fc06f640 con 0x7f88fc09de50 2023-09-30T22:29:41.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.313+0000 7f88fa7fc700 1 --2- 172.21.15.59:0/4060526159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88fc09e930 0x7f88fc11bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:41.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.313+0000 7f88fb7fe700 1 --2- 172.21.15.59:0/4060526159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88fc1338a0 0x7f88fc11c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:41.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.313+0000 7f890156f700 1 -- 172.21.15.59:0/4060526159 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88fc11d1e0 con 0x7f88fc09de50 2023-09-30T22:29:41.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.314+0000 7f88e37fe700 1 -- 172.21.15.59:0/4060526159 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f88f0013c40 con 0x7f88fc09de50 2023-09-30T22:29:41.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.313+0000 7fd3517fa700 1 -- 172.21.15.59:0/2465666329 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348003c00 con 0x7fd35409d6f0 2023-09-30T22:29:41.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.314+0000 7fd3517fa700 1 -- 172.21.15.59:0/2465666329 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd34801a430 con 0x7fd35409d6f0 2023-09-30T22:29:41.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.314+0000 7fd3517fa700 1 -- 172.21.15.59:0/2465666329 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fd348021070 con 0x7fd35409d6f0 2023-09-30T22:29:41.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.314+0000 7fd353fff700 1 -- 172.21.15.59:0/2465666329 >> v1:172.21.15.59:6816/126772 conn(0x7fd33802f590 legacy=0x7fd338031a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:41.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.314+0000 7fd33effd700 1 -- 172.21.15.59:0/2465666329 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3340052e0 con 0x7fd35409d6f0 2023-09-30T22:29:41.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.314+0000 7f890156f700 1 -- 172.21.15.59:0/4060526159 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88fc11eab0 con 0x7f88fc09de50 2023-09-30T22:29:41.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.314+0000 7f88e37fe700 1 -- 172.21.15.59:0/4060526159 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f88f003f520 con 0x7f88fc09de50 2023-09-30T22:29:41.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.314+0000 7f88fa7fc700 1 -- 172.21.15.59:0/4060526159 >> v1:172.21.15.59:6816/126772 conn(0x7f88e802f510 legacy=0x7f88e80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:41.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.324+0000 7f88e37fe700 1 -- 172.21.15.59:0/4060526159 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88fc11eab0 con 0x7f88fc09de50 2023-09-30T22:29:41.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.332+0000 7fd3517fa700 1 -- 172.21.15.59:0/2465666329 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd34801a6e0 con 0x7fd35409d6f0 2023-09-30T22:29:41.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.430+0000 7f933946a700 1 -- 172.21.15.59:0/940217816 >> v1:172.21.15.59:6816/126772 conn(0x7f931802f510 legacy=0x7f93180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:41.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.464+0000 7f933becf700 1 -- 172.21.15.59:0/940217816 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f931c005150 con 0x7f93341338a0 2023-09-30T22:29:41.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.464+0000 7f932a7fc700 1 -- 172.21.15.59:0/940217816 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f933001ce60 con 0x7f93341338a0 2023-09-30T22:29:41.465 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.467+0000 7f933becf700 1 -- 172.21.15.59:0/940217816 >> v1:172.21.15.59:6816/126772 conn(0x7f931802f510 legacy=0x7f93180319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.467+0000 7f933becf700 1 -- 172.21.15.59:0/940217816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93341338a0 msgr2=0x7f933411ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.467+0000 7f933becf700 1 --2- 172.21.15.59:0/940217816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93341338a0 0x7f933411ad40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9330000f60 tx=0x7f933000c730 comp rx=0 tx=0).stop 2023-09-30T22:29:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.467+0000 7f933becf700 1 -- 172.21.15.59:0/940217816 shutdown_connections 2023-09-30T22:29:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.467+0000 7f933becf700 1 --2- 172.21.15.59:0/940217816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93341338a0 0x7f933411ad40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.467+0000 7f933becf700 1 --2- 172.21.15.59:0/940217816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9334139030 0x7f933411b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.467+0000 7f933becf700 1 --2- 172.21.15.59:0/940217816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9334136710 0x7f933411b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.467+0000 7f933becf700 1 -- 172.21.15.59:0/940217816 >> 172.21.15.59:0/940217816 conn(0x7f93340a2aa0 msgr2=0x7f93341344d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.467+0000 7f933becf700 1 -- 172.21.15.59:0/940217816 shutdown_connections 2023-09-30T22:29:41.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.467+0000 7f933becf700 1 -- 172.21.15.59:0/940217816 wait complete. 2023-09-30T22:29:41.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:41.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.489+0000 7f0f627fc700 1 -- 172.21.15.59:0/2258640794 >> v1:172.21.15.59:6816/126772 conn(0x7f0f5002f510 legacy=0x7f0f500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:41.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.515+0000 7fd353fff700 1 -- 172.21.15.59:0/2465666329 >> v1:172.21.15.59:6816/126772 conn(0x7fd33802f590 legacy=0x7fd338031a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:41.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.515+0000 7f88fa7fc700 1 -- 172.21.15.59:0/4060526159 >> v1:172.21.15.59:6816/126772 conn(0x7f88e802f510 legacy=0x7f88e80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:41.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.518+0000 7f0f69273700 1 -- 172.21.15.59:0/2258640794 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0f6406c360 con 0x7f0f6409d6f0 2023-09-30T22:29:41.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.519+0000 7f0f4b7fe700 1 -- 172.21.15.59:0/2258640794 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f540235b0 con 0x7f0f6409d6f0 2023-09-30T22:29:41.519 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:41.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.521+0000 7f0f69273700 1 -- 172.21.15.59:0/2258640794 >> v1:172.21.15.59:6816/126772 conn(0x7f0f5002f510 legacy=0x7f0f500319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:41.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.521+0000 7f0f69273700 1 -- 172.21.15.59:0/2258640794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f6409d6f0 msgr2=0x7f0f641c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.521+0000 7f0f69273700 1 --2- 172.21.15.59:0/2258640794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f6409d6f0 0x7f0f641c8190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0f54000c00 tx=0x7f0f54004750 comp rx=0 tx=0).stop 2023-09-30T22:29:41.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.521+0000 7f0f69273700 1 -- 172.21.15.59:0/2258640794 shutdown_connections 2023-09-30T22:29:41.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.521+0000 7f0f69273700 1 --2- 172.21.15.59:0/2258640794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f6409e410 0x7f0f641c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.521+0000 7f0f69273700 1 --2- 172.21.15.59:0/2258640794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f6409d6f0 0x7f0f641c8190 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0f54000c00 tx=0x7f0f54004750 comp rx=0 tx=0).stop 2023-09-30T22:29:41.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.521+0000 7f0f69273700 1 --2- 172.21.15.59:0/2258640794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f6409e000 0x7f0f641c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.521+0000 7f0f69273700 1 -- 172.21.15.59:0/2258640794 >> 172.21.15.59:0/2258640794 conn(0x7f0f64066f50 msgr2=0x7f0f641bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.521+0000 7f0f69273700 1 -- 172.21.15.59:0/2258640794 shutdown_connections 2023-09-30T22:29:41.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.521+0000 7f0f69273700 1 -- 172.21.15.59:0/2258640794 wait complete. 2023-09-30T22:29:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.535+0000 7f890156f700 1 -- 172.21.15.59:0/4060526159 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f88fc11eab0 con 0x7f88fc09de50 2023-09-30T22:29:41.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.535+0000 7f88e37fe700 1 -- 172.21.15.59:0/4060526159 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88fc11eab0 con 0x7f88fc09de50 2023-09-30T22:29:41.535 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:41.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.537+0000 7f890156f700 1 -- 172.21.15.59:0/4060526159 >> v1:172.21.15.59:6816/126772 conn(0x7f88e802f510 legacy=0x7f88e80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.537+0000 7f890156f700 1 -- 172.21.15.59:0/4060526159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88fc09de50 msgr2=0x7f88fc11b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.537+0000 7f890156f700 1 --2- 172.21.15.59:0/4060526159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88fc09de50 0x7f88fc11b5d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f88f000e7e0 tx=0x7f88f000eaf0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.537+0000 7f890156f700 1 -- 172.21.15.59:0/4060526159 shutdown_connections 2023-09-30T22:29:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.537+0000 7f890156f700 1 --2- 172.21.15.59:0/4060526159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88fc1338a0 0x7f88fc11c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.537+0000 7f890156f700 1 --2- 172.21.15.59:0/4060526159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88fc09de50 0x7f88fc11b5d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.537+0000 7f890156f700 1 --2- 172.21.15.59:0/4060526159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88fc09e930 0x7f88fc11bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.538+0000 7f890156f700 1 -- 172.21.15.59:0/4060526159 >> 172.21.15.59:0/4060526159 conn(0x7f88fc0a2aa0 msgr2=0x7f88fc130530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.538+0000 7f890156f700 1 -- 172.21.15.59:0/4060526159 shutdown_connections 2023-09-30T22:29:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.538+0000 7f890156f700 1 -- 172.21.15.59:0/4060526159 wait complete. 2023-09-30T22:29:41.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.544+0000 7fd33effd700 1 -- 172.21.15.59:0/2465666329 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd334005860 con 0x7fd35409d6f0 2023-09-30T22:29:41.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.545+0000 7fd3517fa700 1 -- 172.21.15.59:0/2465666329 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd348015030 con 0x7fd35409d6f0 2023-09-30T22:29:41.545 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.547+0000 7fd33effd700 1 -- 172.21.15.59:0/2465666329 >> v1:172.21.15.59:6816/126772 conn(0x7fd33802f590 legacy=0x7fd338031a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.547+0000 7fd33effd700 1 -- 172.21.15.59:0/2465666329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd35409d6f0 msgr2=0x7fd35411de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.547+0000 7fd33effd700 1 --2- 172.21.15.59:0/2465666329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd35409d6f0 0x7fd35411de50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd3480090b0 tx=0x7fd348004750 comp rx=0 tx=0).stop 2023-09-30T22:29:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.547+0000 7fd33effd700 1 -- 172.21.15.59:0/2465666329 shutdown_connections 2023-09-30T22:29:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.547+0000 7fd33effd700 1 --2- 172.21.15.59:0/2465666329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd35409e410 0x7fd35411e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.547+0000 7fd33effd700 1 --2- 172.21.15.59:0/2465666329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd35409d6f0 0x7fd35411de50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.547+0000 7fd33effd700 1 --2- 172.21.15.59:0/2465666329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35409e000 0x7fd35411e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.547+0000 7fd33effd700 1 -- 172.21.15.59:0/2465666329 >> 172.21.15.59:0/2465666329 conn(0x7fd354066f50 msgr2=0x7fd354130ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.547+0000 7fd33effd700 1 -- 172.21.15.59:0/2465666329 shutdown_connections 2023-09-30T22:29:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:41.547+0000 7fd33effd700 1 -- 172.21.15.59:0/2465666329 wait complete. 2023-09-30T22:29:41.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:41.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:42.482 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:42.537 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:42.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:42.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.645+0000 7efcf49f7700 1 Processor -- start 2023-09-30T22:29:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.645+0000 7efcf49f7700 1 -- start start 2023-09-30T22:29:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.646+0000 7efcf49f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf0134630 0x7efcf0136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.646+0000 7efcf49f7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efcf0136f50 0x7efcf0139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.646+0000 7efcf49f7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf009b4f0 con 0x7efcf0131810 2023-09-30T22:29:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.646+0000 7efcf49f7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf01313c0 con 0x7efcf0136f50 2023-09-30T22:29:42.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.646+0000 7efcf49f7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf006e8c0 con 0x7efcf0134630 2023-09-30T22:29:42.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.646+0000 7efcedd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf0134630 0x7efcf0136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.646+0000 7efcedd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf0134630 0x7efcf0136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39046/0 (socket says 172.21.15.59:39046) 2023-09-30T22:29:42.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.646+0000 7efcedd9b700 1 -- 172.21.15.59:0/3616170595 learned_addr learned my addr 172.21.15.59:0/3616170595 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:42.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.646+0000 7efceed9d700 1 --2- 172.21.15.59:0/3616170595 >> v2:172.21.15.59:3300/0 conn(0x7efcf0136f50 0x7efcf0139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.647+0000 7efcedd9b700 1 -- 172.21.15.59:0/3616170595 >> v2:172.21.15.59:3300/0 conn(0x7efcf0136f50 msgr2=0x7efcf0139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:42.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.647+0000 7efcedd9b700 1 --2- 172.21.15.59:0/3616170595 >> v2:172.21.15.59:3300/0 conn(0x7efcf0136f50 0x7efcf0139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.647+0000 7efced59a700 1 -- 172.21.15.59:0/3616170595 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530422661 0 0) 0x7efcf009b4f0 con 0x7efcf0131810 2023-09-30T22:29:42.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.647+0000 7efcedd9b700 1 -- 172.21.15.59:0/3616170595 >> v1:172.21.15.59:6789/0 conn(0x7efcf0131810 legacy=0x7efcf0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.647+0000 7efcedd9b700 1 -- 172.21.15.59:0/3616170595 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0071d20 con 0x7efcf0134630 2023-09-30T22:29:42.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.647+0000 7efcedd9b700 1 --2- 172.21.15.59:0/3616170595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf0134630 0x7efcf0136a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efce40098f0 tx=0x7efce4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc39456eb718ad59 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.647+0000 7efced59a700 1 -- 172.21.15.59:0/3616170595 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011830 con 0x7efcf0134630 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.647+0000 7efced59a700 1 -- 172.21.15.59:0/3616170595 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce4011990 con 0x7efcf0134630 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.647+0000 7efced59a700 1 -- 172.21.15.59:0/3616170595 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011d20 con 0x7efcf0134630 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.648+0000 7efcf49f7700 1 -- 172.21.15.59:0/3616170595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf0134630 msgr2=0x7efcf0136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.648+0000 7efcf49f7700 1 --2- 172.21.15.59:0/3616170595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf0134630 0x7efcf0136a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efce40098f0 tx=0x7efce4009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.648+0000 7efcf49f7700 1 -- 172.21.15.59:0/3616170595 shutdown_connections 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.648+0000 7efcf49f7700 1 --2- 172.21.15.59:0/3616170595 >> v2:172.21.15.59:3300/0 conn(0x7efcf0136f50 0x7efcf0139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.648+0000 7efcf49f7700 1 --2- 172.21.15.59:0/3616170595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf0134630 0x7efcf0136a10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.648+0000 7efcf49f7700 1 -- 172.21.15.59:0/3616170595 >> 172.21.15.59:0/3616170595 conn(0x7efcf00a2aa0 msgr2=0x7efcf00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.648+0000 7efcf49f7700 1 -- 172.21.15.59:0/3616170595 shutdown_connections 2023-09-30T22:29:42.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.648+0000 7efcf49f7700 1 -- 172.21.15.59:0/3616170595 wait complete. 2023-09-30T22:29:42.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.650+0000 7efcf49f7700 1 Processor -- start 2023-09-30T22:29:42.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.650+0000 7efcf49f7700 1 -- start start 2023-09-30T22:29:42.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.650+0000 7efcf49f7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf0131810 0x7efcf009c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.650+0000 7efcf49f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf0134630 0x7efcf009cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.650+0000 7efcf49f7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf0136f50 0x7efcf01cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.650+0000 7efcf49f7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf0119c40 con 0x7efcf0131810 2023-09-30T22:29:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.650+0000 7efcf49f7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf0119e20 con 0x7efcf0134630 2023-09-30T22:29:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.650+0000 7efcf49f7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcf009c360 con 0x7efcf0136f50 2023-09-30T22:29:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.650+0000 7efcee59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf0131810 0x7efcf009c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.650+0000 7efcee59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf0131810 0x7efcf009c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57288/0 (socket says 172.21.15.59:57288) 2023-09-30T22:29:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.650+0000 7efcee59c700 1 -- 172.21.15.59:0/3226245077 learned_addr learned my addr 172.21.15.59:0/3226245077 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.650+0000 7efcedd9b700 1 --2- 172.21.15.59:0/3226245077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf0134630 0x7efcf009cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.651+0000 7efceed9d700 1 --2- 172.21.15.59:0/3226245077 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf0136f50 0x7efcf01cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.651+0000 7efcee59c700 1 -- 172.21.15.59:0/3226245077 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf0136f50 msgr2=0x7efcf01cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.651+0000 7efcee59c700 1 --2- 172.21.15.59:0/3226245077 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf0136f50 0x7efcf01cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.651+0000 7efcee59c700 1 -- 172.21.15.59:0/3226245077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf0134630 msgr2=0x7efcf009cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.651+0000 7efcee59c700 1 --2- 172.21.15.59:0/3226245077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf0134630 0x7efcf009cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.651+0000 7efcee59c700 1 -- 172.21.15.59:0/3226245077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce4009550 con 0x7efcf0131810 2023-09-30T22:29:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.651+0000 7efcee59c700 1 --2- 172.21.15.59:0/3226245077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf0131810 0x7efcf009c700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efce000c450 tx=0x7efce000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.651+0000 7efcdeffd700 1 -- 172.21.15.59:0/3226245077 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce00054e0 con 0x7efcf0131810 2023-09-30T22:29:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.651+0000 7efcdeffd700 1 -- 172.21.15.59:0/3226245077 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce000ce60 con 0x7efcf0131810 2023-09-30T22:29:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.651+0000 7efcf49f7700 1 -- 172.21.15.59:0/3226245077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf006eb00 con 0x7efcf0131810 2023-09-30T22:29:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.651+0000 7efcdeffd700 1 -- 172.21.15.59:0/3226245077 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce00038c0 con 0x7efcf0131810 2023-09-30T22:29:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.652+0000 7efcf49f7700 1 -- 172.21.15.59:0/3226245077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf009d9e0 con 0x7efcf0131810 2023-09-30T22:29:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.653+0000 7efcdeffd700 1 -- 172.21.15.59:0/3226245077 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7efce0003a20 con 0x7efcf0131810 2023-09-30T22:29:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.653+0000 7efcf49f7700 1 -- 172.21.15.59:0/3226245077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf0074ea0 con 0x7efcf0131810 2023-09-30T22:29:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.653+0000 7efcdeffd700 1 -- 172.21.15.59:0/3226245077 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7efce003ef90 con 0x7efcf0131810 2023-09-30T22:29:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.653+0000 7efcedd9b700 1 -- 172.21.15.59:0/3226245077 >> v1:172.21.15.59:6816/126772 conn(0x7efcd002f510 legacy=0x7efcd00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:42.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.658+0000 7efcdeffd700 1 -- 172.21.15.59:0/3226245077 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efce0019b40 con 0x7efcf0131810 2023-09-30T22:29:42.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.695+0000 7f8f8f702700 1 Processor -- start 2023-09-30T22:29:42.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.695+0000 7f8f8f702700 1 -- start start 2023-09-30T22:29:42.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.696+0000 7f8f8f702700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8809d6f0 0x7f8f8809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.696+0000 7f8f8f702700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f8809e000 0x7f8f88130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.696+0000 7f8f8f702700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f8809f130 con 0x7f8f8809e410 2023-09-30T22:29:42.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.696+0000 7f8f8f702700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8809f520 con 0x7f8f8809e000 2023-09-30T22:29:42.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.696+0000 7f8f8f702700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8809e930 con 0x7f8f8809d6f0 2023-09-30T22:29:42.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.696+0000 7f8f8d49e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8809d6f0 0x7f8f8809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.696+0000 7f8f8cc9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f8809e000 0x7f8f88130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.696+0000 7f8f8d49e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8809d6f0 0x7f8f8809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39052/0 (socket says 172.21.15.59:39052) 2023-09-30T22:29:42.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.696+0000 7f8f8dc9f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8f8809e410 0x7f8f88130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58546/0 (socket says 172.21.15.59:58546) 2023-09-30T22:29:42.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.696+0000 7f8f8d49e700 1 -- 172.21.15.59:0/903855172 learned_addr learned my addr 172.21.15.59:0/903855172 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:42.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.697+0000 7f8f8d49e700 1 -- 172.21.15.59:0/903855172 >> v2:172.21.15.59:3300/0 conn(0x7f8f8809e000 msgr2=0x7f8f88130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:42.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.697+0000 7f8f8d49e700 1 --2- 172.21.15.59:0/903855172 >> v2:172.21.15.59:3300/0 conn(0x7f8f8809e000 0x7f8f88130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.697+0000 7f8f8d49e700 1 -- 172.21.15.59:0/903855172 >> v1:172.21.15.59:6789/0 conn(0x7f8f8809e410 legacy=0x7f8f88130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.697+0000 7f8f8d49e700 1 -- 172.21.15.59:0/903855172 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8809b2d0 con 0x7f8f8809d6f0 2023-09-30T22:29:42.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.697+0000 7f8f8d49e700 1 --2- 172.21.15.59:0/903855172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8809d6f0 0x7f8f8809dac0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400bb90 tx=0x7f8f8400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c18a974c5d7ef6fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.697+0000 7f8f7ffff700 1 -- 172.21.15.59:0/903855172 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8400dd30 con 0x7f8f8809d6f0 2023-09-30T22:29:42.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.697+0000 7f8f7ffff700 1 -- 172.21.15.59:0/903855172 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8400de90 con 0x7f8f8809d6f0 2023-09-30T22:29:42.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.697+0000 7f8f7ffff700 1 -- 172.21.15.59:0/903855172 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f84010690 con 0x7f8f8809d6f0 2023-09-30T22:29:42.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.698+0000 7f8f8f702700 1 -- 172.21.15.59:0/903855172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8809d6f0 msgr2=0x7f8f8809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.698+0000 7f8f8f702700 1 --2- 172.21.15.59:0/903855172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8809d6f0 0x7f8f8809dac0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400bb90 tx=0x7f8f8400bea0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.698+0000 7f8f8f702700 1 -- 172.21.15.59:0/903855172 shutdown_connections 2023-09-30T22:29:42.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.698+0000 7f8f8f702700 1 --2- 172.21.15.59:0/903855172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8809d6f0 0x7f8f8809dac0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.698+0000 7f8f8f702700 1 --2- 172.21.15.59:0/903855172 >> v2:172.21.15.59:3300/0 conn(0x7f8f8809e000 0x7f8f88130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.698+0000 7f8f8f702700 1 -- 172.21.15.59:0/903855172 >> 172.21.15.59:0/903855172 conn(0x7f8f88066f50 msgr2=0x7f8f8809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.698+0000 7f8f8f702700 1 -- 172.21.15.59:0/903855172 shutdown_connections 2023-09-30T22:29:42.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.698+0000 7f8f8f702700 1 -- 172.21.15.59:0/903855172 wait complete. 2023-09-30T22:29:42.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.699+0000 7f8f8f702700 1 Processor -- start 2023-09-30T22:29:42.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.699+0000 7f8f8f702700 1 -- start start 2023-09-30T22:29:42.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8f702700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f8809d6f0 0x7f8f88122960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8f702700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8809e000 0x7f8f88122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8f702700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8809e410 0x7f8f881233e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8f702700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88127080 con 0x7f8f8809e410 2023-09-30T22:29:42.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8f702700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88124cc0 con 0x7f8f8809e000 2023-09-30T22:29:42.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8f702700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88125b70 con 0x7f8f8809d6f0 2023-09-30T22:29:42.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8dc9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8809e410 0x7f8f881233e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8dc9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8809e410 0x7f8f881233e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57310/0 (socket says 172.21.15.59:57310) 2023-09-30T22:29:42.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8dc9f700 1 -- 172.21.15.59:0/4177922000 learned_addr learned my addr 172.21.15.59:0/4177922000 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:42.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8d49e700 1 --2- 172.21.15.59:0/4177922000 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f8809d6f0 0x7f8f88122960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8d49e700 1 -- 172.21.15.59:0/4177922000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8809e000 msgr2=0x7f8f88122ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8cc9d700 1 --2- 172.21.15.59:0/4177922000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8809e000 0x7f8f88122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8d49e700 1 --2- 172.21.15.59:0/4177922000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8809e000 0x7f8f88122ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8d49e700 1 -- 172.21.15.59:0/4177922000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8809e410 msgr2=0x7f8f881233e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8d49e700 1 --2- 172.21.15.59:0/4177922000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8809e410 0x7f8f881233e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8d49e700 1 -- 172.21.15.59:0/4177922000 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8400b7f0 con 0x7f8f8809d6f0 2023-09-30T22:29:42.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.700+0000 7f8f8cc9d700 1 --2- 172.21.15.59:0/4177922000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8809e000 0x7f8f88122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:42.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.701+0000 7f8f8d49e700 1 --2- 172.21.15.59:0/4177922000 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f8809d6f0 0x7f8f88122960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f84018000 tx=0x7f8f84004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.701+0000 7f8f7dffb700 1 -- 172.21.15.59:0/4177922000 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f84003bf0 con 0x7f8f8809d6f0 2023-09-30T22:29:42.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.701+0000 7f8f8f702700 1 -- 172.21.15.59:0/4177922000 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f880a1d00 con 0x7f8f8809d6f0 2023-09-30T22:29:42.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.701+0000 7f8f7dffb700 1 -- 172.21.15.59:0/4177922000 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f84003d70 con 0x7f8f8809d6f0 2023-09-30T22:29:42.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.701+0000 7f8f7dffb700 1 -- 172.21.15.59:0/4177922000 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840106b0 con 0x7f8f8809d6f0 2023-09-30T22:29:42.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.701+0000 7f8f8f702700 1 -- 172.21.15.59:0/4177922000 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f88126b90 con 0x7f8f8809d6f0 2023-09-30T22:29:42.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.702+0000 7f8f7dffb700 1 -- 172.21.15.59:0/4177922000 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8f84019400 con 0x7f8f8809d6f0 2023-09-30T22:29:42.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.703+0000 7f8f737fe700 1 -- 172.21.15.59:0/4177922000 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f600052e0 con 0x7f8f8809d6f0 2023-09-30T22:29:42.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.703+0000 7f8f8cc9d700 1 -- 172.21.15.59:0/4177922000 >> v1:172.21.15.59:6816/126772 conn(0x7f8f6c02f510 legacy=0x7f8f6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:42.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.703+0000 7f8f7dffb700 1 -- 172.21.15.59:0/4177922000 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8f840414d0 con 0x7f8f8809d6f0 2023-09-30T22:29:42.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.712+0000 7f8f7dffb700 1 -- 172.21.15.59:0/4177922000 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f8400e720 con 0x7f8f8809d6f0 2023-09-30T22:29:42.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.738+0000 7f1623fa2700 1 Processor -- start 2023-09-30T22:29:42.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.738+0000 7f1623fa2700 1 -- start start 2023-09-30T22:29:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.739+0000 7f1623fa2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f161c09d6f0 0x7f161c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.739+0000 7f1623fa2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f161c09e410 0x7f161c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.739+0000 7f1623fa2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161c09f130 con 0x7f161c09e000 2023-09-30T22:29:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.739+0000 7f1623fa2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c09f520 con 0x7f161c09e410 2023-09-30T22:29:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.739+0000 7f1623fa2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f161c09e930 con 0x7f161c09d6f0 2023-09-30T22:29:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.739+0000 7f1621d3e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f161c09d6f0 0x7f161c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.739+0000 7f1621d3e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f161c09d6f0 0x7f161c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36774/0 (socket says 172.21.15.59:36774) 2023-09-30T22:29:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.739+0000 7f1621d3e700 1 -- 172.21.15.59:0/1523786214 learned_addr learned my addr 172.21.15.59:0/1523786214 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.739+0000 7f162253f700 1 --2- 172.21.15.59:0/1523786214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f161c09e410 0x7f161c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.739+0000 7f1621d3e700 1 -- 172.21.15.59:0/1523786214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f161c09e410 msgr2=0x7f161c130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.739+0000 7f1621d3e700 1 --2- 172.21.15.59:0/1523786214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f161c09e410 0x7f161c130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.739+0000 7f1620d3c700 1 -- 172.21.15.59:0/1523786214 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409923762 0 0) 0x7f161c09f130 con 0x7f161c09e000 2023-09-30T22:29:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.739+0000 7f1621d3e700 1 -- 172.21.15.59:0/1523786214 >> v1:172.21.15.59:6789/0 conn(0x7f161c09e000 legacy=0x7f161c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.739+0000 7f1621d3e700 1 -- 172.21.15.59:0/1523786214 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c09b2d0 con 0x7f161c09d6f0 2023-09-30T22:29:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.739+0000 7f162253f700 1 --2- 172.21.15.59:0/1523786214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f161c09e410 0x7f161c130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.740+0000 7f1621d3e700 1 --2- 172.21.15.59:0/1523786214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f161c09d6f0 0x7f161c09dac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1618009920 tx=0x7f1618009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf7b9f2b9c32586 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.740+0000 7f1620d3c700 1 -- 172.21.15.59:0/1523786214 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618011830 con 0x7f161c09d6f0 2023-09-30T22:29:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.740+0000 7f1620d3c700 1 -- 172.21.15.59:0/1523786214 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1618011990 con 0x7f161c09d6f0 2023-09-30T22:29:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.740+0000 7f1620d3c700 1 -- 172.21.15.59:0/1523786214 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618011d20 con 0x7f161c09d6f0 2023-09-30T22:29:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.741+0000 7f1623fa2700 1 -- 172.21.15.59:0/1523786214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f161c09d6f0 msgr2=0x7f161c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.741+0000 7f1623fa2700 1 --2- 172.21.15.59:0/1523786214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f161c09d6f0 0x7f161c09dac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1618009920 tx=0x7f1618009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.741+0000 7f1623fa2700 1 -- 172.21.15.59:0/1523786214 shutdown_connections 2023-09-30T22:29:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.741+0000 7f1623fa2700 1 --2- 172.21.15.59:0/1523786214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f161c09d6f0 0x7f161c09dac0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.741+0000 7f1623fa2700 1 --2- 172.21.15.59:0/1523786214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f161c09e410 0x7f161c130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.741+0000 7f1623fa2700 1 -- 172.21.15.59:0/1523786214 >> 172.21.15.59:0/1523786214 conn(0x7f161c066f50 msgr2=0x7f161c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.741+0000 7f1623fa2700 1 -- 172.21.15.59:0/1523786214 shutdown_connections 2023-09-30T22:29:42.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.741+0000 7f1623fa2700 1 -- 172.21.15.59:0/1523786214 wait complete. 2023-09-30T22:29:42.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.742+0000 7f1e72de7700 1 Processor -- start 2023-09-30T22:29:42.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.742+0000 7f1e72de7700 1 -- start start 2023-09-30T22:29:42.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.742+0000 7f1623fa2700 1 Processor -- start 2023-09-30T22:29:42.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.742+0000 7f1623fa2700 1 -- start start 2023-09-30T22:29:42.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f1e72de7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6c09e1d0 0x7f1e6c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f1e72de7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c139170 0x7f1e6c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f1e72de7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c09b120 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f1e72de7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c06b460 con 0x7f1e6c09e1d0 2023-09-30T22:29:42.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f1e72de7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c09a7e0 con 0x7f1e6c139170 2023-09-30T22:29:42.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f1623fa2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f161c09d6f0 0x7f161c12ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f1623fa2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f161c09e000 0x7f161c12f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f1623fa2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f161c09e410 0x7f161c12f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f1623fa2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0721e0 con 0x7f161c09e410 2023-09-30T22:29:42.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f1623fa2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c132790 con 0x7f161c09d6f0 2023-09-30T22:29:42.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f1623fa2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f161c13b600 con 0x7f161c09e000 2023-09-30T22:29:42.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f162153d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f161c09e000 0x7f161c12f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f162253f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f161c09e410 0x7f161c12f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f1e70b83700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1e6c09d6f0 0x7f1e6c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58566/0 (socket says 172.21.15.59:58566) 2023-09-30T22:29:42.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f1e70b83700 1 -- 172.21.15.59:0/3784168300 learned_addr learned my addr 172.21.15.59:0/3784168300 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:42.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f162253f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f161c09e410 0x7f161c12f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57326/0 (socket says 172.21.15.59:57326) 2023-09-30T22:29:42.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f162153d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f161c09e000 0x7f161c12f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36788/0 (socket says 172.21.15.59:36788) 2023-09-30T22:29:42.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.743+0000 7f162253f700 1 -- 172.21.15.59:0/1400562898 learned_addr learned my addr 172.21.15.59:0/1400562898 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 -- 172.21.15.59:0/3784168300 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757411771 0 0) 0x7f1e6c09b120 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 -- 172.21.15.59:0/3784168300 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e5c0035b0 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f162253f700 1 -- 172.21.15.59:0/1400562898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f161c09e000 msgr2=0x7f161c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f162253f700 1 --2- 172.21.15.59:0/1400562898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f161c09e000 0x7f161c12f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f162253f700 1 -- 172.21.15.59:0/1400562898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f161c09d6f0 msgr2=0x7f161c12ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f162253f700 1 --2- 172.21.15.59:0/1400562898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f161c09d6f0 0x7f161c12ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f162253f700 1 -- 172.21.15.59:0/1400562898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1614009a70 con 0x7f161c09e410 2023-09-30T22:29:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 -- 172.21.15.59:0/3784168300 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4210886246 0 0) 0x7f1e5c0035b0 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 -- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c139170 msgr2=0x7f1e6c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 --2- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c139170 0x7f1e6c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 -- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6c09e1d0 msgr2=0x7f1e6c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 --2- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6c09e1d0 0x7f1e6c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f162253f700 1 --2- 172.21.15.59:0/1400562898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f161c09e410 0x7f161c12f730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1614009f00 tx=0x7f161400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 -- 172.21.15.59:0/3784168300 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c09a500 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 -- 172.21.15.59:0/3784168300 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1997034051 0 0) 0x7f1e60001670 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 -- 172.21.15.59:0/3784168300 >> v1:172.21.15.59:6789/0 conn(0x7f1e6c09d6f0 legacy=0x7f1e6c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 --2- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6c09e1d0 0x7f1e5c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 --2- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c139170 0x7f1e5c0041a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 --2- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5c004900 0x7f1e5c004d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 -- 172.21.15.59:0/3784168300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c06b460 con 0x7f1e5c004900 2023-09-30T22:29:42.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 -- 172.21.15.59:0/3784168300 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c09a7e0 con 0x7f1e6c09e1d0 2023-09-30T22:29:42.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6b7fe700 1 -- 172.21.15.59:0/3784168300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c005550 con 0x7f1e6c139170 2023-09-30T22:29:42.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e6bfff700 1 --2- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c139170 0x7f1e5c0041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.744+0000 7f1e71384700 1 --2- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5c004900 0x7f1e5c004d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.745+0000 7f1e6bfff700 1 -- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6c09e1d0 msgr2=0x7f1e5c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:42.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.745+0000 7f1e6bfff700 1 --2- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6c09e1d0 0x7f1e5c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.745+0000 7f1e6bfff700 1 -- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5c004900 msgr2=0x7f1e5c004d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:42.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.745+0000 7f1e6bfff700 1 --2- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5c004900 0x7f1e5c004d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.745+0000 7f1e6bfff700 1 -- 172.21.15.59:0/3784168300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c09a500 con 0x7f1e6c139170 2023-09-30T22:29:42.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.745+0000 7f1e71384700 1 --2- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5c004900 0x7f1e5c004d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:42.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.745+0000 7f16127fc700 1 -- 172.21.15.59:0/1400562898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614009d70 con 0x7f161c09e410 2023-09-30T22:29:42.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.745+0000 7f16127fc700 1 -- 172.21.15.59:0/1400562898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161400f040 con 0x7f161c09e410 2023-09-30T22:29:42.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.745+0000 7f1623fa2700 1 -- 172.21.15.59:0/1400562898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1618009550 con 0x7f161c09e410 2023-09-30T22:29:42.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.745+0000 7f16127fc700 1 -- 172.21.15.59:0/1400562898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161400ce20 con 0x7f161c09e410 2023-09-30T22:29:42.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.745+0000 7f1623fa2700 1 -- 172.21.15.59:0/1400562898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161c09c700 con 0x7f161c09e410 2023-09-30T22:29:42.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.745+0000 7f1e6bfff700 1 --2- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c139170 0x7f1e5c0041a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009910 tx=0x7f1e5c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=988890b9f98b6bc5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.745+0000 7f1e6b7fe700 1 -- 172.21.15.59:0/3784168300 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e58011620 con 0x7f1e6c139170 2023-09-30T22:29:42.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.745+0000 7f1e6b7fe700 1 -- 172.21.15.59:0/3784168300 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e58011780 con 0x7f1e6c139170 2023-09-30T22:29:42.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.745+0000 7f1e6b7fe700 1 -- 172.21.15.59:0/3784168300 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e58011b10 con 0x7f1e6c139170 2023-09-30T22:29:42.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.746+0000 7f1623fa2700 1 -- 172.21.15.59:0/1400562898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161c131d10 con 0x7f161c09e410 2023-09-30T22:29:42.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.746+0000 7f16127fc700 1 -- 172.21.15.59:0/1400562898 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1614014480 con 0x7f161c09e410 2023-09-30T22:29:42.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.746+0000 7f16127fc700 1 -- 172.21.15.59:0/1400562898 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f16140425a0 con 0x7f161c09e410 2023-09-30T22:29:42.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.746+0000 7f1621d3e700 1 -- 172.21.15.59:0/1400562898 >> v1:172.21.15.59:6816/126772 conn(0x7f160002f510 legacy=0x7f16000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.747+0000 7f1e72de7700 1 -- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c139170 msgr2=0x7f1e5c0041a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.747+0000 7f1e72de7700 1 --2- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c139170 0x7f1e5c0041a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009910 tx=0x7f1e5c005880 comp rx=0 tx=0).stop 2023-09-30T22:29:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.747+0000 7f1e72de7700 1 -- 172.21.15.59:0/3784168300 shutdown_connections 2023-09-30T22:29:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.747+0000 7f1e72de7700 1 --2- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c139170 0x7f1e5c0041a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.747+0000 7f1e72de7700 1 --2- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5c004900 0x7f1e5c004d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.747+0000 7f1e72de7700 1 --2- 172.21.15.59:0/3784168300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e6c09e1d0 0x7f1e5c003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.747+0000 7f1e72de7700 1 -- 172.21.15.59:0/3784168300 >> 172.21.15.59:0/3784168300 conn(0x7f1e6c066f50 msgr2=0x7f1e6c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.748+0000 7f1e72de7700 1 -- 172.21.15.59:0/3784168300 shutdown_connections 2023-09-30T22:29:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.748+0000 7f1e72de7700 1 -- 172.21.15.59:0/3784168300 wait complete. 2023-09-30T22:29:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.749+0000 7f1e72de7700 1 Processor -- start 2023-09-30T22:29:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.749+0000 7f1e72de7700 1 -- start start 2023-09-30T22:29:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.750+0000 7f1e72de7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5c004900 0x7f1e6c126f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.750+0000 7f1e72de7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c09d6f0 0x7f1e6c1274a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.750+0000 7f1e72de7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6c09e1d0 0x7f1e6c1279e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.750+0000 7f1e72de7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c12aa30 con 0x7f1e6c09e1d0 2023-09-30T22:29:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.750+0000 7f1e72de7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c128b20 con 0x7f1e5c004900 2023-09-30T22:29:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.750+0000 7f1e72de7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c1290d0 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.751+0000 7f1e6bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c09d6f0 0x7f1e6c1274a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.751+0000 7f1e6bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c09d6f0 0x7f1e6c1274a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36802/0 (socket says 172.21.15.59:36802) 2023-09-30T22:29:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.751+0000 7f1e6bfff700 1 -- 172.21.15.59:0/3370323117 learned_addr learned my addr 172.21.15.59:0/3370323117 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.751+0000 7f1e71384700 1 --2- 172.21.15.59:0/3370323117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6c09e1d0 0x7f1e6c1279e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.751+0000 7f1e70b83700 1 --2- 172.21.15.59:0/3370323117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5c004900 0x7f1e6c126f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.751+0000 7f1e6bfff700 1 -- 172.21.15.59:0/3370323117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5c004900 msgr2=0x7f1e6c126f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.751+0000 7f1e6bfff700 1 --2- 172.21.15.59:0/3370323117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5c004900 0x7f1e6c126f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.751+0000 7f1e6bfff700 1 -- 172.21.15.59:0/3370323117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6c09e1d0 msgr2=0x7f1e6c1279e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.751+0000 7f1e6bfff700 1 --2- 172.21.15.59:0/3370323117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6c09e1d0 0x7f1e6c1279e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.751+0000 7f1e6bfff700 1 -- 172.21.15.59:0/3370323117 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c0a2f50 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.751+0000 7f1e6bfff700 1 --2- 172.21.15.59:0/3370323117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c09d6f0 0x7f1e6c1274a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e580090b0 tx=0x7f1e58004860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.751+0000 7f1e697fa700 1 -- 172.21.15.59:0/3370323117 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e58004440 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.752+0000 7f16127fc700 1 -- 172.21.15.59:0/1400562898 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1614012930 con 0x7f161c09e410 2023-09-30T22:29:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.752+0000 7f1e697fa700 1 -- 172.21.15.59:0/3370323117 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e580045c0 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.752+0000 7f1e72de7700 1 -- 172.21.15.59:0/3370323117 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c09c710 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.752+0000 7f1e697fa700 1 -- 172.21.15.59:0/3370323117 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e580038c0 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.752+0000 7f1e72de7700 1 -- 172.21.15.59:0/3370323117 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6c12a4e0 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.753+0000 7f1e56ffd700 1 -- 172.21.15.59:0/3370323117 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e440052e0 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.753+0000 7f1e697fa700 1 -- 172.21.15.59:0/3370323117 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1e58003a20 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.754+0000 7f1e70b83700 1 -- 172.21.15.59:0/3370323117 >> v1:172.21.15.59:6816/126772 conn(0x7f1e5002f560 legacy=0x7f1e50031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.756+0000 7f1e697fa700 1 -- 172.21.15.59:0/3370323117 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1e58010de0 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.758+0000 7f1e697fa700 1 -- 172.21.15.59:0/3370323117 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e5801a420 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.854+0000 7efcedd9b700 1 -- 172.21.15.59:0/3226245077 >> v1:172.21.15.59:6816/126772 conn(0x7efcd002f510 legacy=0x7efcd00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:42.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.893+0000 7efcf49f7700 1 -- 172.21.15.59:0/3226245077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efcf006b9e0 con 0x7efcf0131810 2023-09-30T22:29:42.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.894+0000 7efcdeffd700 1 -- 172.21.15.59:0/3226245077 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efce0017070 con 0x7efcf0131810 2023-09-30T22:29:42.894 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.896+0000 7efcf49f7700 1 -- 172.21.15.59:0/3226245077 >> v1:172.21.15.59:6816/126772 conn(0x7efcd002f510 legacy=0x7efcd00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.896+0000 7efcf49f7700 1 -- 172.21.15.59:0/3226245077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf0131810 msgr2=0x7efcf009c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.896+0000 7efcf49f7700 1 --2- 172.21.15.59:0/3226245077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf0131810 0x7efcf009c700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efce000c450 tx=0x7efce000c760 comp rx=0 tx=0).stop 2023-09-30T22:29:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.896+0000 7efcf49f7700 1 -- 172.21.15.59:0/3226245077 shutdown_connections 2023-09-30T22:29:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.896+0000 7efcf49f7700 1 --2- 172.21.15.59:0/3226245077 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf0136f50 0x7efcf01cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.896+0000 7efcf49f7700 1 --2- 172.21.15.59:0/3226245077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf0131810 0x7efcf009c700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.896+0000 7efcf49f7700 1 --2- 172.21.15.59:0/3226245077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf0134630 0x7efcf009cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.896+0000 7efcf49f7700 1 -- 172.21.15.59:0/3226245077 >> 172.21.15.59:0/3226245077 conn(0x7efcf00a2aa0 msgr2=0x7efcf00a1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.896+0000 7efcf49f7700 1 -- 172.21.15.59:0/3226245077 shutdown_connections 2023-09-30T22:29:42.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.896+0000 7efcf49f7700 1 -- 172.21.15.59:0/3226245077 wait complete. 2023-09-30T22:29:42.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.907+0000 7f8f8cc9d700 1 -- 172.21.15.59:0/4177922000 >> v1:172.21.15.59:6816/126772 conn(0x7f8f6c02f510 legacy=0x7f8f6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:42.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.924+0000 7f8f737fe700 1 -- 172.21.15.59:0/4177922000 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f60005860 con 0x7f8f8809d6f0 2023-09-30T22:29:42.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.924+0000 7f8f7dffb700 1 -- 172.21.15.59:0/4177922000 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f8402a390 con 0x7f8f8809d6f0 2023-09-30T22:29:42.924 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.927+0000 7f8f737fe700 1 -- 172.21.15.59:0/4177922000 >> v1:172.21.15.59:6816/126772 conn(0x7f8f6c02f510 legacy=0x7f8f6c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.927+0000 7f8f737fe700 1 -- 172.21.15.59:0/4177922000 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f8809d6f0 msgr2=0x7f8f88122960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.927+0000 7f8f737fe700 1 --2- 172.21.15.59:0/4177922000 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f8809d6f0 0x7f8f88122960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f84018000 tx=0x7f8f84004750 comp rx=0 tx=0).stop 2023-09-30T22:29:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.927+0000 7f8f737fe700 1 -- 172.21.15.59:0/4177922000 shutdown_connections 2023-09-30T22:29:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.927+0000 7f8f737fe700 1 --2- 172.21.15.59:0/4177922000 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f8809d6f0 0x7f8f88122960 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.927+0000 7f8f737fe700 1 --2- 172.21.15.59:0/4177922000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f8809e410 0x7f8f881233e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.927+0000 7f8f737fe700 1 --2- 172.21.15.59:0/4177922000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8809e000 0x7f8f88122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.927+0000 7f8f737fe700 1 -- 172.21.15.59:0/4177922000 >> 172.21.15.59:0/4177922000 conn(0x7f8f88066f50 msgr2=0x7f8f8806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.927+0000 7f8f737fe700 1 -- 172.21.15.59:0/4177922000 shutdown_connections 2023-09-30T22:29:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.928+0000 7f8f737fe700 1 -- 172.21.15.59:0/4177922000 wait complete. 2023-09-30T22:29:42.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:42.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.947+0000 7f1621d3e700 1 -- 172.21.15.59:0/1400562898 >> v1:172.21.15.59:6816/126772 conn(0x7f160002f510 legacy=0x7f16000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:42.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.955+0000 7f1e70b83700 1 -- 172.21.15.59:0/3370323117 >> v1:172.21.15.59:6816/126772 conn(0x7f1e5002f560 legacy=0x7f1e50031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:42.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.961+0000 7f1623fa2700 1 -- 172.21.15.59:0/1400562898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f161c0a2a10 con 0x7f161c09e410 2023-09-30T22:29:42.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.961+0000 7f16127fc700 1 -- 172.21.15.59:0/1400562898 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1614018070 con 0x7f161c09e410 2023-09-30T22:29:42.961 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:42.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.964+0000 7f1623fa2700 1 -- 172.21.15.59:0/1400562898 >> v1:172.21.15.59:6816/126772 conn(0x7f160002f510 legacy=0x7f16000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:42.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.964+0000 7f1623fa2700 1 -- 172.21.15.59:0/1400562898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f161c09e410 msgr2=0x7f161c12f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.964+0000 7f1623fa2700 1 --2- 172.21.15.59:0/1400562898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f161c09e410 0x7f161c12f730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1614009f00 tx=0x7f161400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.964+0000 7f1623fa2700 1 -- 172.21.15.59:0/1400562898 shutdown_connections 2023-09-30T22:29:42.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.964+0000 7f1623fa2700 1 --2- 172.21.15.59:0/1400562898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f161c09e410 0x7f161c12f730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.964+0000 7f1623fa2700 1 --2- 172.21.15.59:0/1400562898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f161c09d6f0 0x7f161c12ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.964+0000 7f1623fa2700 1 --2- 172.21.15.59:0/1400562898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f161c09e000 0x7f161c12f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.964+0000 7f1623fa2700 1 -- 172.21.15.59:0/1400562898 >> 172.21.15.59:0/1400562898 conn(0x7f161c066f50 msgr2=0x7f161c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.964+0000 7f1623fa2700 1 -- 172.21.15.59:0/1400562898 shutdown_connections 2023-09-30T22:29:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.964+0000 7f1623fa2700 1 -- 172.21.15.59:0/1400562898 wait complete. 2023-09-30T22:29:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.976+0000 7f1e56ffd700 1 -- 172.21.15.59:0/3370323117 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e44005860 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.977+0000 7f1e697fa700 1 -- 172.21.15.59:0/3370323117 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e580107a0 con 0x7f1e6c09d6f0 2023-09-30T22:29:42.977 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:42.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.979+0000 7f1e56ffd700 1 -- 172.21.15.59:0/3370323117 >> v1:172.21.15.59:6816/126772 conn(0x7f1e5002f560 legacy=0x7f1e50031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.979+0000 7f1e56ffd700 1 -- 172.21.15.59:0/3370323117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c09d6f0 msgr2=0x7f1e6c1274a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.979+0000 7f1e56ffd700 1 --2- 172.21.15.59:0/3370323117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c09d6f0 0x7f1e6c1274a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e580090b0 tx=0x7f1e58004860 comp rx=0 tx=0).stop 2023-09-30T22:29:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.979+0000 7f1e56ffd700 1 -- 172.21.15.59:0/3370323117 shutdown_connections 2023-09-30T22:29:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.979+0000 7f1e56ffd700 1 --2- 172.21.15.59:0/3370323117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6c09e1d0 0x7f1e6c1279e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.979+0000 7f1e56ffd700 1 --2- 172.21.15.59:0/3370323117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5c004900 0x7f1e6c126f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.979+0000 7f1e56ffd700 1 --2- 172.21.15.59:0/3370323117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e6c09d6f0 0x7f1e6c1274a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.979+0000 7f1e56ffd700 1 -- 172.21.15.59:0/3370323117 >> 172.21.15.59:0/3370323117 conn(0x7f1e6c066f50 msgr2=0x7f1e6c070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.979+0000 7f1e56ffd700 1 -- 172.21.15.59:0/3370323117 shutdown_connections 2023-09-30T22:29:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:42.979+0000 7f1e56ffd700 1 -- 172.21.15.59:0/3370323117 wait complete. 2023-09-30T22:29:42.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:43.912 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:43.947 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:43.979 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:43.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:44.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.070+0000 7fb417285700 1 Processor -- start 2023-09-30T22:29:44.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.070+0000 7fb417285700 1 -- start start 2023-09-30T22:29:44.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.071+0000 7fb417285700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41012cf60 0x7fb41006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.071+0000 7fb417285700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb41012f8b0 0x7fb41012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.071+0000 7fb417285700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41012cd90 con 0x7fb410130260 2023-09-30T22:29:44.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.071+0000 7fb417285700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41012d330 con 0x7fb41012f8b0 2023-09-30T22:29:44.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.071+0000 7fb417285700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4101306e0 con 0x7fb41012cf60 2023-09-30T22:29:44.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.071+0000 7fb414820700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb41012f8b0 0x7fb41012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.071+0000 7fb414820700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb41012f8b0 0x7fb41012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57346/0 (socket says 172.21.15.59:57346) 2023-09-30T22:29:44.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.071+0000 7fb414820700 1 -- 172.21.15.59:0/807789033 learned_addr learned my addr 172.21.15.59:0/807789033 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:44.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.071+0000 7fb415021700 1 --2- 172.21.15.59:0/807789033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41012cf60 0x7fb41006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.071+0000 7fb414820700 1 -- 172.21.15.59:0/807789033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41012cf60 msgr2=0x7fb41006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.072+0000 7fb414820700 1 --2- 172.21.15.59:0/807789033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41012cf60 0x7fb41006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.072+0000 7fb414820700 1 -- 172.21.15.59:0/807789033 >> v1:172.21.15.59:6789/0 conn(0x7fb410130260 legacy=0x7fb410136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.072+0000 7fb414820700 1 -- 172.21.15.59:0/807789033 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb410071780 con 0x7fb41012f8b0 2023-09-30T22:29:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.072+0000 7fb414820700 1 --2- 172.21.15.59:0/807789033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41012f8b0 0x7fb41012fd20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb40000bb90 tx=0x7fb40000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d262c7385c82e820 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.072+0000 7fb407fff700 1 -- 172.21.15.59:0/807789033 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40000dc20 con 0x7fb41012f8b0 2023-09-30T22:29:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.072+0000 7fb407fff700 1 -- 172.21.15.59:0/807789033 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40000dd80 con 0x7fb41012f8b0 2023-09-30T22:29:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.072+0000 7fb407fff700 1 -- 172.21.15.59:0/807789033 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400017630 con 0x7fb41012f8b0 2023-09-30T22:29:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.073+0000 7fb417285700 1 -- 172.21.15.59:0/807789033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41012f8b0 msgr2=0x7fb41012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.073+0000 7fb417285700 1 --2- 172.21.15.59:0/807789033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41012f8b0 0x7fb41012fd20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb40000bb90 tx=0x7fb40000bea0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.073+0000 7fb417285700 1 -- 172.21.15.59:0/807789033 shutdown_connections 2023-09-30T22:29:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.073+0000 7fb417285700 1 --2- 172.21.15.59:0/807789033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41012cf60 0x7fb41006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.073+0000 7fb417285700 1 --2- 172.21.15.59:0/807789033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41012f8b0 0x7fb41012fd20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.073+0000 7fb417285700 1 -- 172.21.15.59:0/807789033 >> 172.21.15.59:0/807789033 conn(0x7fb4100a2aa0 msgr2=0x7fb4100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.073+0000 7fb417285700 1 -- 172.21.15.59:0/807789033 shutdown_connections 2023-09-30T22:29:44.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.073+0000 7fb417285700 1 -- 172.21.15.59:0/807789033 wait complete. 2023-09-30T22:29:44.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.074+0000 7fb417285700 1 Processor -- start 2023-09-30T22:29:44.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.074+0000 7fb417285700 1 -- start start 2023-09-30T22:29:44.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb417285700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41012cf60 0x7fb41009bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb417285700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41012f8b0 0x7fb41009c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb417285700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb410130260 0x7fb4101c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb417285700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb410118d40 con 0x7fb41012f8b0 2023-09-30T22:29:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb417285700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41009b690 con 0x7fb41012cf60 2023-09-30T22:29:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb417285700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb41009c600 con 0x7fb410130260 2023-09-30T22:29:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb415021700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41012cf60 0x7fb41009bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb415021700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41012cf60 0x7fb41009bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39146/0 (socket says 172.21.15.59:39146) 2023-09-30T22:29:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb415021700 1 -- 172.21.15.59:0/1600157560 learned_addr learned my addr 172.21.15.59:0/1600157560 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb415822700 1 --2- 172.21.15.59:0/1600157560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb410130260 0x7fb4101c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb414820700 1 --2- 172.21.15.59:0/1600157560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41012f8b0 0x7fb41009c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb415021700 1 -- 172.21.15.59:0/1600157560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb410130260 msgr2=0x7fb4101c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb415021700 1 --2- 172.21.15.59:0/1600157560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb410130260 0x7fb4101c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb415021700 1 -- 172.21.15.59:0/1600157560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41012f8b0 msgr2=0x7fb41009c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb415021700 1 --2- 172.21.15.59:0/1600157560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41012f8b0 0x7fb41009c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb415021700 1 -- 172.21.15.59:0/1600157560 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40000b7f0 con 0x7fb41012cf60 2023-09-30T22:29:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb414820700 1 --2- 172.21.15.59:0/1600157560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41012f8b0 0x7fb41009c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.075+0000 7fb415021700 1 --2- 172.21.15.59:0/1600157560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41012cf60 0x7fb41009bb80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00e870 tx=0x7fb40c00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.076+0000 7fb405ffb700 1 -- 172.21.15.59:0/1600157560 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c009590 con 0x7fb41012cf60 2023-09-30T22:29:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.076+0000 7fb405ffb700 1 -- 172.21.15.59:0/1600157560 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40c013680 con 0x7fb41012cf60 2023-09-30T22:29:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.076+0000 7fb417285700 1 -- 172.21.15.59:0/1600157560 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41009e160 con 0x7fb41012cf60 2023-09-30T22:29:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.076+0000 7fb405ffb700 1 -- 172.21.15.59:0/1600157560 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c0139f0 con 0x7fb41012cf60 2023-09-30T22:29:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.076+0000 7fb417285700 1 -- 172.21.15.59:0/1600157560 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41009cd70 con 0x7fb41012cf60 2023-09-30T22:29:44.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.077+0000 7fb405ffb700 1 -- 172.21.15.59:0/1600157560 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb40c013b50 con 0x7fb41012cf60 2023-09-30T22:29:44.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.077+0000 7fb405ffb700 1 -- 172.21.15.59:0/1600157560 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fb40c041660 con 0x7fb41012cf60 2023-09-30T22:29:44.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.077+0000 7fb414820700 1 -- 172.21.15.59:0/1600157560 >> v1:172.21.15.59:6816/126772 conn(0x7fb3f402f510 legacy=0x7fb3f40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:44.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.082+0000 7fb417285700 1 -- 172.21.15.59:0/1600157560 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb410074ea0 con 0x7fb41012cf60 2023-09-30T22:29:44.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.091+0000 7fb405ffb700 1 -- 172.21.15.59:0/1600157560 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb40c045060 con 0x7fb41012cf60 2023-09-30T22:29:44.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.113+0000 7f40cf4d4700 1 Processor -- start 2023-09-30T22:29:44.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.113+0000 7f40cf4d4700 1 -- start start 2023-09-30T22:29:44.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.114+0000 7f40cf4d4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f40c8133540 0x7f40c8135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.114+0000 7f40cf4d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c8135e60 0x7f40c8138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.114+0000 7f40cf4d4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c80716a0 con 0x7f40c8130540 2023-09-30T22:29:44.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.114+0000 7f40cf4d4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c8071290 con 0x7f40c8133540 2023-09-30T22:29:44.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.114+0000 7f40cf4d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c8130340 con 0x7f40c8135e60 2023-09-30T22:29:44.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.114+0000 7f40cd270700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f40c8130540 0x7f40c8130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58594/0 (socket says 172.21.15.59:58594) 2023-09-30T22:29:44.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.114+0000 7f40cd270700 1 -- 172.21.15.59:0/121848825 learned_addr learned my addr 172.21.15.59:0/121848825 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:44.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.114+0000 7f40cda71700 1 --2- 172.21.15.59:0/121848825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c8135e60 0x7f40c8138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.114+0000 7f40cca6f700 1 --2- 172.21.15.59:0/121848825 >> v2:172.21.15.59:3300/0 conn(0x7f40c8133540 0x7f40c8135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.114+0000 7f40cda71700 1 -- 172.21.15.59:0/121848825 >> v2:172.21.15.59:3300/0 conn(0x7f40c8133540 msgr2=0x7f40c8135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:44.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.114+0000 7f40cda71700 1 --2- 172.21.15.59:0/121848825 >> v2:172.21.15.59:3300/0 conn(0x7f40c8133540 0x7f40c8135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.114+0000 7f40cda71700 1 -- 172.21.15.59:0/121848825 >> v1:172.21.15.59:6789/0 conn(0x7f40c8130540 legacy=0x7f40c8130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.114+0000 7f40bffff700 1 -- 172.21.15.59:0/121848825 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941893079 0 0) 0x7f40c80716a0 con 0x7f40c8130540 2023-09-30T22:29:44.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.114+0000 7f40cda71700 1 -- 172.21.15.59:0/121848825 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8070b80 con 0x7f40c8135e60 2023-09-30T22:29:44.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.114+0000 7f40cca6f700 1 --2- 172.21.15.59:0/121848825 >> v2:172.21.15.59:3300/0 conn(0x7f40c8133540 0x7f40c8135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:44.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.115+0000 7f40cda71700 1 --2- 172.21.15.59:0/121848825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c8135e60 0x7f40c8138240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009d90 tx=0x7f40c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78613a8a0d114d9d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:44.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.115+0000 7f40bffff700 1 -- 172.21.15.59:0/121848825 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000bd20 con 0x7f40c8135e60 2023-09-30T22:29:44.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.115+0000 7f40bffff700 1 -- 172.21.15.59:0/121848825 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c000be80 con 0x7f40c8135e60 2023-09-30T22:29:44.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.115+0000 7f40bffff700 1 -- 172.21.15.59:0/121848825 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c00116a0 con 0x7f40c8135e60 2023-09-30T22:29:44.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.116+0000 7f40cf4d4700 1 -- 172.21.15.59:0/121848825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c8135e60 msgr2=0x7f40c8138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.116+0000 7f40cf4d4700 1 --2- 172.21.15.59:0/121848825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c8135e60 0x7f40c8138240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009d90 tx=0x7f40c000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:44.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.116+0000 7f40cf4d4700 1 -- 172.21.15.59:0/121848825 shutdown_connections 2023-09-30T22:29:44.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.116+0000 7f40cf4d4700 1 --2- 172.21.15.59:0/121848825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c8135e60 0x7f40c8138240 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.116+0000 7f40cf4d4700 1 --2- 172.21.15.59:0/121848825 >> v2:172.21.15.59:3300/0 conn(0x7f40c8133540 0x7f40c8135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.116+0000 7f40cf4d4700 1 -- 172.21.15.59:0/121848825 >> 172.21.15.59:0/121848825 conn(0x7f40c80a2aa0 msgr2=0x7f40c80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:44.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.116+0000 7f40cf4d4700 1 -- 172.21.15.59:0/121848825 shutdown_connections 2023-09-30T22:29:44.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.116+0000 7f40cf4d4700 1 -- 172.21.15.59:0/121848825 wait complete. 2023-09-30T22:29:44.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.117+0000 7f40cf4d4700 1 Processor -- start 2023-09-30T22:29:44.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.117+0000 7f40cf4d4700 1 -- start start 2023-09-30T22:29:44.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.118+0000 7f40cf4d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c8130540 0x7f40c81c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.118+0000 7f40cf4d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40c8133540 0x7f40c81c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.118+0000 7f40cf4d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c8135e60 0x7f40c809c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.118+0000 7f40cf4d4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c809e500 con 0x7f40c8133540 2023-09-30T22:29:44.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.118+0000 7f40cf4d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c811aa30 con 0x7f40c8130540 2023-09-30T22:29:44.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.118+0000 7f40cf4d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40c81359c0 con 0x7f40c8135e60 2023-09-30T22:29:44.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.118+0000 7f40cca6f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40c8133540 0x7f40c81c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.118+0000 7f40cd270700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c8130540 0x7f40c81c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.118+0000 7f40cca6f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40c8133540 0x7f40c81c4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57386/0 (socket says 172.21.15.59:57386) 2023-09-30T22:29:44.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.118+0000 7f40cca6f700 1 -- 172.21.15.59:0/2399078545 learned_addr learned my addr 172.21.15.59:0/2399078545 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:44.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.119+0000 7f40cd270700 1 -- 172.21.15.59:0/2399078545 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c8135e60 msgr2=0x7f40c809c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.119+0000 7f40cd270700 1 --2- 172.21.15.59:0/2399078545 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c8135e60 0x7f40c809c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.119+0000 7f40cd270700 1 -- 172.21.15.59:0/2399078545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40c8133540 msgr2=0x7f40c81c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.119+0000 7f40cd270700 1 --2- 172.21.15.59:0/2399078545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40c8133540 0x7f40c81c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.119+0000 7f40cd270700 1 -- 172.21.15.59:0/2399078545 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b80094a0 con 0x7f40c8130540 2023-09-30T22:29:44.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.119+0000 7f40cca6f700 1 --2- 172.21.15.59:0/2399078545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40c8133540 0x7f40c81c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:44.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.119+0000 7f40cd270700 1 --2- 172.21.15.59:0/2399078545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c8130540 0x7f40c81c4510 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f40c400c4a0 tx=0x7f40c400c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:44.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.119+0000 7f40bdffb700 1 -- 172.21.15.59:0/2399078545 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4004c80 con 0x7f40c8130540 2023-09-30T22:29:44.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.119+0000 7f40bdffb700 1 -- 172.21.15.59:0/2399078545 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c4004de0 con 0x7f40c8130540 2023-09-30T22:29:44.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.119+0000 7f40bdffb700 1 -- 172.21.15.59:0/2399078545 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4007310 con 0x7f40c8130540 2023-09-30T22:29:44.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.119+0000 7f40cf4d4700 1 -- 172.21.15.59:0/2399078545 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c0009a70 con 0x7f40c8130540 2023-09-30T22:29:44.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.120+0000 7f40cf4d4700 1 -- 172.21.15.59:0/2399078545 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c812dc50 con 0x7f40c8130540 2023-09-30T22:29:44.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.121+0000 7f40bdffb700 1 -- 172.21.15.59:0/2399078545 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f40c4007470 con 0x7f40c8130540 2023-09-30T22:29:44.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.121+0000 7f40cf4d4700 1 -- 172.21.15.59:0/2399078545 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c81192e0 con 0x7f40c8130540 2023-09-30T22:29:44.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.121+0000 7f40cca6f700 1 -- 172.21.15.59:0/2399078545 >> v1:172.21.15.59:6816/126772 conn(0x7f40ac02f590 legacy=0x7f40ac031a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:44.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.121+0000 7f40bdffb700 1 -- 172.21.15.59:0/2399078545 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f40c40102c0 con 0x7f40c8130540 2023-09-30T22:29:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.130+0000 7f40bdffb700 1 -- 172.21.15.59:0/2399078545 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40c4044060 con 0x7f40c8130540 2023-09-30T22:29:44.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.146+0000 7f049cde5700 1 Processor -- start 2023-09-30T22:29:44.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.146+0000 7f049cde5700 1 -- start start 2023-09-30T22:29:44.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.147+0000 7f049cde5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049809d6f0 0x7f049809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.147+0000 7f049cde5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f049809e000 0x7f04981339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.147+0000 7f049cde5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049809b120 con 0x7f049809e410 2023-09-30T22:29:44.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.147+0000 7f049cde5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049806b460 con 0x7f049809e000 2023-09-30T22:29:44.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.147+0000 7f049cde5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f049809a7e0 con 0x7f049809d6f0 2023-09-30T22:29:44.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.147+0000 7f0495d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f049809e000 0x7f04981339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.147+0000 7f0495d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f049809e000 0x7f04981339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57402/0 (socket says 172.21.15.59:57402) 2023-09-30T22:29:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.147+0000 7f0495d9b700 1 -- 172.21.15.59:0/2031808573 learned_addr learned my addr 172.21.15.59:0/2031808573 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.147+0000 7f049659c700 1 --2- 172.21.15.59:0/2031808573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049809d6f0 0x7f049809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.148+0000 7f049559a700 1 -- 172.21.15.59:0/2031808573 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028544632 0 0) 0x7f049809b120 con 0x7f049809e410 2023-09-30T22:29:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.148+0000 7f0495d9b700 1 -- 172.21.15.59:0/2031808573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049809d6f0 msgr2=0x7f049809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.148+0000 7f0495d9b700 1 --2- 172.21.15.59:0/2031808573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049809d6f0 0x7f049809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.148+0000 7f0495d9b700 1 -- 172.21.15.59:0/2031808573 >> v1:172.21.15.59:6789/0 conn(0x7f049809e410 legacy=0x7f0498133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.148+0000 7f0495d9b700 1 -- 172.21.15.59:0/2031808573 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049809a500 con 0x7f049809e000 2023-09-30T22:29:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.148+0000 7f0495d9b700 1 --2- 172.21.15.59:0/2031808573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049809e000 0x7f04981339f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f048c0098f0 tx=0x7f048c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38cc46a0f365db7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.148+0000 7f049559a700 1 -- 172.21.15.59:0/2031808573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c00b8a0 con 0x7f049809e000 2023-09-30T22:29:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.148+0000 7f049559a700 1 -- 172.21.15.59:0/2031808573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048c00ba00 con 0x7f049809e000 2023-09-30T22:29:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.148+0000 7f049559a700 1 -- 172.21.15.59:0/2031808573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c00bd90 con 0x7f049809e000 2023-09-30T22:29:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.149+0000 7f049cde5700 1 -- 172.21.15.59:0/2031808573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049809e000 msgr2=0x7f04981339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.149+0000 7f049cde5700 1 --2- 172.21.15.59:0/2031808573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049809e000 0x7f04981339f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f048c0098f0 tx=0x7f048c009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.149+0000 7f049cde5700 1 -- 172.21.15.59:0/2031808573 shutdown_connections 2023-09-30T22:29:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.149+0000 7f049cde5700 1 --2- 172.21.15.59:0/2031808573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049809d6f0 0x7f049809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.149+0000 7f049cde5700 1 --2- 172.21.15.59:0/2031808573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049809e000 0x7f04981339f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.149+0000 7f049cde5700 1 -- 172.21.15.59:0/2031808573 >> 172.21.15.59:0/2031808573 conn(0x7f0498066f50 msgr2=0x7f049809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.149+0000 7f049cde5700 1 -- 172.21.15.59:0/2031808573 shutdown_connections 2023-09-30T22:29:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.149+0000 7f049cde5700 1 -- 172.21.15.59:0/2031808573 wait complete. 2023-09-30T22:29:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.150+0000 7f6bac32f700 1 Processor -- start 2023-09-30T22:29:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.150+0000 7f6bac32f700 1 -- start start 2023-09-30T22:29:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6bac32f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ba41316c0 0x7f6ba4131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6bac32f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ba409d9f0 0x7f6ba406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6bac32f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ba406acb0 0x7f6ba406b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6bac32f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba409e130 con 0x7f6ba41316c0 2023-09-30T22:29:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6bac32f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba41312b0 con 0x7f6ba406acb0 2023-09-30T22:29:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6bac32f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba409f6e0 con 0x7f6ba409d9f0 2023-09-30T22:29:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f049cde5700 1 Processor -- start 2023-09-30T22:29:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6baa0cb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ba41316c0 0x7f6ba4131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6ba98ca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ba409d9f0 0x7f6ba406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6baa0cb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ba41316c0 0x7f6ba4131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57416/0 (socket says 172.21.15.59:57416) 2023-09-30T22:29:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6ba98ca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ba409d9f0 0x7f6ba406a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36830/0 (socket says 172.21.15.59:36830) 2023-09-30T22:29:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6baa0cb700 1 -- 172.21.15.59:0/1947906796 learned_addr learned my addr 172.21.15.59:0/1947906796 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6baa8cc700 1 --2- 172.21.15.59:0/1947906796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ba406acb0 0x7f6ba406b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6baa0cb700 1 -- 172.21.15.59:0/1947906796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ba409d9f0 msgr2=0x7f6ba406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:44.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6baa0cb700 1 --2- 172.21.15.59:0/1947906796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ba409d9f0 0x7f6ba406a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6baa0cb700 1 -- 172.21.15.59:0/1947906796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ba406acb0 msgr2=0x7f6ba406b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:44.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6baa0cb700 1 --2- 172.21.15.59:0/1947906796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ba406acb0 0x7f6ba406b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f6baa0cb700 1 -- 172.21.15.59:0/1947906796 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba409e760 con 0x7f6ba41316c0 2023-09-30T22:29:44.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.152+0000 7f6baa0cb700 1 --2- 172.21.15.59:0/1947906796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba41316c0 0x7f6ba4131a90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00098f0 tx=0x7f6ba0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d104c429dbc61c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:44.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.151+0000 7f049cde5700 1 -- start start 2023-09-30T22:29:44.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.152+0000 7f049cde5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049809d6f0 0x7f04981a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.152+0000 7f049cde5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049809e000 0x7f04981a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.152+0000 7f049cde5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049809e410 0x7f04981a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.152+0000 7f049cde5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04981a9150 con 0x7f049809e410 2023-09-30T22:29:44.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.152+0000 7f049cde5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049809c710 con 0x7f049809d6f0 2023-09-30T22:29:44.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.152+0000 7f049cde5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04980a2e40 con 0x7f049809e000 2023-09-30T22:29:44.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.152+0000 7f6ba90c9700 1 -- 172.21.15.59:0/1947906796 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0010a90 con 0x7f6ba41316c0 2023-09-30T22:29:44.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.152+0000 7f6ba90c9700 1 -- 172.21.15.59:0/1947906796 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba0010bf0 con 0x7f6ba41316c0 2023-09-30T22:29:44.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.152+0000 7f6ba90c9700 1 -- 172.21.15.59:0/1947906796 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0018440 con 0x7f6ba41316c0 2023-09-30T22:29:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.152+0000 7f0495d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049809e000 0x7f04981a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.152+0000 7f0495d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049809e000 0x7f04981a63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36844/0 (socket says 172.21.15.59:36844) 2023-09-30T22:29:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.152+0000 7f0495d9b700 1 -- 172.21.15.59:0/2471879174 learned_addr learned my addr 172.21.15.59:0/2471879174 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.152+0000 7f049659c700 1 --2- 172.21.15.59:0/2471879174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049809d6f0 0x7f04981a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.152+0000 7f0496d9d700 1 --2- 172.21.15.59:0/2471879174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049809e410 0x7f04981a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.153+0000 7f0495d9b700 1 -- 172.21.15.59:0/2471879174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049809d6f0 msgr2=0x7f04981a5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.153+0000 7f0495d9b700 1 --2- 172.21.15.59:0/2471879174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049809d6f0 0x7f04981a5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.153+0000 7f0495d9b700 1 -- 172.21.15.59:0/2471879174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049809e410 msgr2=0x7f04981a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.153+0000 7f0495d9b700 1 --2- 172.21.15.59:0/2471879174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049809e410 0x7f04981a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.153+0000 7f0495d9b700 1 -- 172.21.15.59:0/2471879174 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048c009550 con 0x7f049809e000 2023-09-30T22:29:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.153+0000 7f0495d9b700 1 --2- 172.21.15.59:0/2471879174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049809e000 0x7f04981a63e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f048c000c00 tx=0x7f048c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.153+0000 7f0486ffd700 1 -- 172.21.15.59:0/2471879174 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c01a900 con 0x7f049809e000 2023-09-30T22:29:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.153+0000 7f0486ffd700 1 -- 172.21.15.59:0/2471879174 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048c01f070 con 0x7f049809e000 2023-09-30T22:29:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.153+0000 7f0486ffd700 1 -- 172.21.15.59:0/2471879174 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c01ac60 con 0x7f049809e000 2023-09-30T22:29:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.153+0000 7f049cde5700 1 -- 172.21.15.59:0/2471879174 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04981a7ab0 con 0x7f049809e000 2023-09-30T22:29:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.153+0000 7f049cde5700 1 -- 172.21.15.59:0/2471879174 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04981a9ec0 con 0x7f049809e000 2023-09-30T22:29:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.153+0000 7f6bac32f700 1 -- 172.21.15.59:0/1947906796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba41316c0 msgr2=0x7f6ba4131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.153+0000 7f6bac32f700 1 --2- 172.21.15.59:0/1947906796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba41316c0 0x7f6ba4131a90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00098f0 tx=0x7f6ba0009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.154+0000 7f6bac32f700 1 -- 172.21.15.59:0/1947906796 shutdown_connections 2023-09-30T22:29:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.154+0000 7f6bac32f700 1 --2- 172.21.15.59:0/1947906796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ba406acb0 0x7f6ba406b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.154+0000 7f6bac32f700 1 --2- 172.21.15.59:0/1947906796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba41316c0 0x7f6ba4131a90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.154+0000 7f6bac32f700 1 --2- 172.21.15.59:0/1947906796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ba409d9f0 0x7f6ba406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.154+0000 7f6bac32f700 1 -- 172.21.15.59:0/1947906796 >> 172.21.15.59:0/1947906796 conn(0x7f6ba4066f50 msgr2=0x7f6ba409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.154+0000 7f0486ffd700 1 -- 172.21.15.59:0/2471879174 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f048c026480 con 0x7f049809e000 2023-09-30T22:29:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.154+0000 7f049cde5700 1 -- 172.21.15.59:0/2471879174 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04981a9380 con 0x7f049809e000 2023-09-30T22:29:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.154+0000 7f6bac32f700 1 -- 172.21.15.59:0/1947906796 shutdown_connections 2023-09-30T22:29:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.155+0000 7f6bac32f700 1 -- 172.21.15.59:0/1947906796 wait complete. 2023-09-30T22:29:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.156+0000 7f6bac32f700 1 Processor -- start 2023-09-30T22:29:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.156+0000 7f6bac32f700 1 -- start start 2023-09-30T22:29:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.157+0000 7f6bac32f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ba406acb0 0x7f6ba406e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.157+0000 7f6bac32f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ba409d9f0 0x7f6ba406ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.157+0000 7f6bac32f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba41316c0 0x7f6ba406f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.157+0000 7f6bac32f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba406fc90 con 0x7f6ba41316c0 2023-09-30T22:29:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.157+0000 7f6bac32f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba4071270 con 0x7f6ba406acb0 2023-09-30T22:29:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.157+0000 7f6bac32f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba4071530 con 0x7f6ba409d9f0 2023-09-30T22:29:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.157+0000 7f6baa8cc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba41316c0 0x7f6ba406f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.157+0000 7f6baa8cc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba41316c0 0x7f6ba406f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57434/0 (socket says 172.21.15.59:57434) 2023-09-30T22:29:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.157+0000 7f6baa8cc700 1 -- 172.21.15.59:0/4146058414 learned_addr learned my addr 172.21.15.59:0/4146058414 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.155+0000 7f0486ffd700 1 -- 172.21.15.59:0/2471879174 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f048c021070 con 0x7f049809e000 2023-09-30T22:29:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.155+0000 7f049659c700 1 -- 172.21.15.59:0/2471879174 >> v1:172.21.15.59:6816/126772 conn(0x7f047802f510 legacy=0x7f04780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.158+0000 7f6baa8cc700 1 -- 172.21.15.59:0/4146058414 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ba409d9f0 msgr2=0x7f6ba406ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.158+0000 7f6baa8cc700 1 --2- 172.21.15.59:0/4146058414 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ba409d9f0 0x7f6ba406ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.158+0000 7f6baa8cc700 1 -- 172.21.15.59:0/4146058414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ba406acb0 msgr2=0x7f6ba406e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.158+0000 7f6baa8cc700 1 --2- 172.21.15.59:0/4146058414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ba406acb0 0x7f6ba406e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.158+0000 7f6baa8cc700 1 -- 172.21.15.59:0/4146058414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba0009550 con 0x7f6ba41316c0 2023-09-30T22:29:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.158+0000 7f6baa8cc700 1 --2- 172.21.15.59:0/4146058414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba41316c0 0x7f6ba406f360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c007e40 tx=0x7f6b9c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.158+0000 7f6b9affd700 1 -- 172.21.15.59:0/4146058414 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c00eea0 con 0x7f6ba41316c0 2023-09-30T22:29:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.158+0000 7f6b9affd700 1 -- 172.21.15.59:0/4146058414 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c014420 con 0x7f6ba41316c0 2023-09-30T22:29:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.158+0000 7f6b9affd700 1 -- 172.21.15.59:0/4146058414 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0147b0 con 0x7f6ba41316c0 2023-09-30T22:29:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.158+0000 7f6bac32f700 1 -- 172.21.15.59:0/4146058414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba40723f0 con 0x7f6ba41316c0 2023-09-30T22:29:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.158+0000 7f6bac32f700 1 -- 172.21.15.59:0/4146058414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba412b110 con 0x7f6ba41316c0 2023-09-30T22:29:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.160+0000 7f6bac32f700 1 -- 172.21.15.59:0/4146058414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba409a2d0 con 0x7f6ba41316c0 2023-09-30T22:29:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.160+0000 7f6b9affd700 1 -- 172.21.15.59:0/4146058414 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6b9c014910 con 0x7f6ba41316c0 2023-09-30T22:29:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.160+0000 7f6baa0cb700 1 -- 172.21.15.59:0/4146058414 >> v1:172.21.15.59:6816/126772 conn(0x7f6b8802f510 legacy=0x7f6b880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.162+0000 7f6b9affd700 1 -- 172.21.15.59:0/4146058414 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f6b9c01c360 con 0x7f6ba41316c0 2023-09-30T22:29:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.163+0000 7f0486ffd700 1 -- 172.21.15.59:0/2471879174 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04981a9380 con 0x7f049809e000 2023-09-30T22:29:44.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.169+0000 7f6b9affd700 1 -- 172.21.15.59:0/4146058414 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b9c0122e0 con 0x7f6ba41316c0 2023-09-30T22:29:44.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.278+0000 7fb414820700 1 -- 172.21.15.59:0/1600157560 >> v1:172.21.15.59:6816/126772 conn(0x7fb3f402f510 legacy=0x7fb3f40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:44.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.316+0000 7fb417285700 1 -- 172.21.15.59:0/1600157560 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb41009e900 con 0x7fb41012cf60 2023-09-30T22:29:44.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.316+0000 7fb405ffb700 1 -- 172.21.15.59:0/1600157560 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb41009e900 con 0x7fb41012cf60 2023-09-30T22:29:44.317 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:44.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.319+0000 7fb417285700 1 -- 172.21.15.59:0/1600157560 >> v1:172.21.15.59:6816/126772 conn(0x7fb3f402f510 legacy=0x7fb3f40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:44.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.319+0000 7fb417285700 1 -- 172.21.15.59:0/1600157560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41012cf60 msgr2=0x7fb41009bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.319+0000 7fb417285700 1 --2- 172.21.15.59:0/1600157560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41012cf60 0x7fb41009bb80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00e870 tx=0x7fb40c00eb80 comp rx=0 tx=0).stop 2023-09-30T22:29:44.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.319+0000 7fb417285700 1 -- 172.21.15.59:0/1600157560 shutdown_connections 2023-09-30T22:29:44.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.319+0000 7fb417285700 1 --2- 172.21.15.59:0/1600157560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb410130260 0x7fb4101c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.319+0000 7fb417285700 1 --2- 172.21.15.59:0/1600157560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41012cf60 0x7fb41009bb80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.319+0000 7fb417285700 1 --2- 172.21.15.59:0/1600157560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41012f8b0 0x7fb41009c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.319+0000 7fb417285700 1 -- 172.21.15.59:0/1600157560 >> 172.21.15.59:0/1600157560 conn(0x7fb4100a2aa0 msgr2=0x7fb41006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:44.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.319+0000 7fb417285700 1 -- 172.21.15.59:0/1600157560 shutdown_connections 2023-09-30T22:29:44.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.319+0000 7fb417285700 1 -- 172.21.15.59:0/1600157560 wait complete. 2023-09-30T22:29:44.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.322+0000 7f40cca6f700 1 -- 172.21.15.59:0/2399078545 >> v1:172.21.15.59:6816/126772 conn(0x7f40ac02f590 legacy=0x7f40ac031a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:44.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:44.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.352+0000 7f40cf4d4700 1 -- 172.21.15.59:0/2399078545 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f40c8067d20 con 0x7f40c8130540 2023-09-30T22:29:44.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.352+0000 7f40bdffb700 1 -- 172.21.15.59:0/2399078545 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40c4007720 con 0x7f40c8130540 2023-09-30T22:29:44.354 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.355+0000 7f40cf4d4700 1 -- 172.21.15.59:0/2399078545 >> v1:172.21.15.59:6816/126772 conn(0x7f40ac02f590 legacy=0x7f40ac031a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.355+0000 7f40cf4d4700 1 -- 172.21.15.59:0/2399078545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c8130540 msgr2=0x7f40c81c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.355+0000 7f40cf4d4700 1 --2- 172.21.15.59:0/2399078545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c8130540 0x7f40c81c4510 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f40c400c4a0 tx=0x7f40c400c7b0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.355+0000 7f40cf4d4700 1 -- 172.21.15.59:0/2399078545 shutdown_connections 2023-09-30T22:29:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.355+0000 7f40cf4d4700 1 --2- 172.21.15.59:0/2399078545 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c8135e60 0x7f40c809c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.355+0000 7f40cf4d4700 1 --2- 172.21.15.59:0/2399078545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c8130540 0x7f40c81c4510 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.355+0000 7f40cf4d4700 1 --2- 172.21.15.59:0/2399078545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40c8133540 0x7f40c81c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.355+0000 7f40cf4d4700 1 -- 172.21.15.59:0/2399078545 >> 172.21.15.59:0/2399078545 conn(0x7f40c80a2aa0 msgr2=0x7f40c8131300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:44.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.355+0000 7f40cf4d4700 1 -- 172.21.15.59:0/2399078545 shutdown_connections 2023-09-30T22:29:44.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.355+0000 7f40cf4d4700 1 -- 172.21.15.59:0/2399078545 wait complete. 2023-09-30T22:29:44.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.356+0000 7f049659c700 1 -- 172.21.15.59:0/2471879174 >> v1:172.21.15.59:6816/126772 conn(0x7f047802f510 legacy=0x7f04780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:44.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.361+0000 7f6baa0cb700 1 -- 172.21.15.59:0/4146058414 >> v1:172.21.15.59:6816/126772 conn(0x7f6b8802f510 legacy=0x7f6b880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:44.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.368+0000 7f049cde5700 1 -- 172.21.15.59:0/2471879174 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f04981a9380 con 0x7f049809e000 2023-09-30T22:29:44.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.368+0000 7f0486ffd700 1 -- 172.21.15.59:0/2471879174 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04981a9380 con 0x7f049809e000 2023-09-30T22:29:44.369 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:44.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:44.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.370+0000 7f049cde5700 1 -- 172.21.15.59:0/2471879174 >> v1:172.21.15.59:6816/126772 conn(0x7f047802f510 legacy=0x7f04780319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:44.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.370+0000 7f049cde5700 1 -- 172.21.15.59:0/2471879174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049809e000 msgr2=0x7f04981a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.370+0000 7f049cde5700 1 --2- 172.21.15.59:0/2471879174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049809e000 0x7f04981a63e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f048c000c00 tx=0x7f048c004750 comp rx=0 tx=0).stop 2023-09-30T22:29:44.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.370+0000 7f049cde5700 1 -- 172.21.15.59:0/2471879174 shutdown_connections 2023-09-30T22:29:44.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.370+0000 7f049cde5700 1 --2- 172.21.15.59:0/2471879174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049809e410 0x7f04981a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.370+0000 7f049cde5700 1 --2- 172.21.15.59:0/2471879174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049809d6f0 0x7f04981a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.370+0000 7f049cde5700 1 --2- 172.21.15.59:0/2471879174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049809e000 0x7f04981a63e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.370+0000 7f049cde5700 1 -- 172.21.15.59:0/2471879174 >> 172.21.15.59:0/2471879174 conn(0x7f0498066f50 msgr2=0x7f04981bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:44.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.371+0000 7f049cde5700 1 -- 172.21.15.59:0/2471879174 shutdown_connections 2023-09-30T22:29:44.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.371+0000 7f049cde5700 1 -- 172.21.15.59:0/2471879174 wait complete. 2023-09-30T22:29:44.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.377+0000 7f6bac32f700 1 -- 172.21.15.59:0/4146058414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6ba4074ea0 con 0x7f6ba41316c0 2023-09-30T22:29:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.377+0000 7f6b9affd700 1 -- 172.21.15.59:0/4146058414 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b9c01bb00 con 0x7f6ba41316c0 2023-09-30T22:29:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:44.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.381+0000 7f6bac32f700 1 -- 172.21.15.59:0/4146058414 >> v1:172.21.15.59:6816/126772 conn(0x7f6b8802f510 legacy=0x7f6b880319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.381+0000 7f6bac32f700 1 -- 172.21.15.59:0/4146058414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba41316c0 msgr2=0x7f6ba406f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.381+0000 7f6bac32f700 1 --2- 172.21.15.59:0/4146058414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba41316c0 0x7f6ba406f360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c007e40 tx=0x7f6b9c00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.381+0000 7f6bac32f700 1 -- 172.21.15.59:0/4146058414 shutdown_connections 2023-09-30T22:29:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.381+0000 7f6bac32f700 1 --2- 172.21.15.59:0/4146058414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba41316c0 0x7f6ba406f360 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.381+0000 7f6bac32f700 1 --2- 172.21.15.59:0/4146058414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ba406acb0 0x7f6ba406e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.381+0000 7f6bac32f700 1 --2- 172.21.15.59:0/4146058414 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ba409d9f0 0x7f6ba406ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.381+0000 7f6bac32f700 1 -- 172.21.15.59:0/4146058414 >> 172.21.15.59:0/4146058414 conn(0x7f6ba4066f50 msgr2=0x7f6ba4130180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.381+0000 7f6bac32f700 1 -- 172.21.15.59:0/4146058414 shutdown_connections 2023-09-30T22:29:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:44.381+0000 7f6bac32f700 1 -- 172.21.15.59:0/4146058414 wait complete. 2023-09-30T22:29:44.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:44.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:45.336 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:45.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:45.388 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:45.398 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:45.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.486+0000 7ff940fd0700 1 Processor -- start 2023-09-30T22:29:45.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.486+0000 7ff940fd0700 1 -- start start 2023-09-30T22:29:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.487+0000 7ff940fd0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff93c136710 0x7ff93c138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.487+0000 7ff940fd0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff93c139030 0x7ff93c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.487+0000 7ff940fd0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c06ef30 con 0x7ff93c1338a0 2023-09-30T22:29:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.487+0000 7ff940fd0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c06fef0 con 0x7ff93c136710 2023-09-30T22:29:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.487+0000 7ff940fd0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c1334b0 con 0x7ff93c139030 2023-09-30T22:29:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.487+0000 7ff939d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff93c136710 0x7ff93c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.487+0000 7ff93a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff93c1338a0 0x7ff93c133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33850/0 (socket says 172.21.15.59:33850) 2023-09-30T22:29:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.487+0000 7ff93a59c700 1 -- 172.21.15.59:0/75393377 learned_addr learned my addr 172.21.15.59:0/75393377 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.487+0000 7ff93ad9d700 1 --2- 172.21.15.59:0/75393377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff93c139030 0x7ff93c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.488+0000 7ff939d9b700 1 -- 172.21.15.59:0/75393377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff93c139030 msgr2=0x7ff93c13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.488+0000 7ff939d9b700 1 --2- 172.21.15.59:0/75393377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff93c139030 0x7ff93c13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.488+0000 7ff939d9b700 1 -- 172.21.15.59:0/75393377 >> v1:172.21.15.59:6789/0 conn(0x7ff93c1338a0 legacy=0x7ff93c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.488+0000 7ff93959a700 1 -- 172.21.15.59:0/75393377 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864164810 0 0) 0x7ff93c06ef30 con 0x7ff93c1338a0 2023-09-30T22:29:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.488+0000 7ff939d9b700 1 -- 172.21.15.59:0/75393377 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c06fc30 con 0x7ff93c136710 2023-09-30T22:29:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.488+0000 7ff939d9b700 1 --2- 172.21.15.59:0/75393377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff93c136710 0x7ff93c138af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff930009870 tx=0x7ff930009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65db4294a474ed26 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.488+0000 7ff93959a700 1 -- 172.21.15.59:0/75393377 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff930011830 con 0x7ff93c136710 2023-09-30T22:29:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.488+0000 7ff93959a700 1 -- 172.21.15.59:0/75393377 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff930011990 con 0x7ff93c136710 2023-09-30T22:29:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.488+0000 7ff93959a700 1 -- 172.21.15.59:0/75393377 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff930011d20 con 0x7ff93c136710 2023-09-30T22:29:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.489+0000 7ff940fd0700 1 -- 172.21.15.59:0/75393377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff93c136710 msgr2=0x7ff93c138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.489+0000 7ff940fd0700 1 --2- 172.21.15.59:0/75393377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff93c136710 0x7ff93c138af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff930009870 tx=0x7ff930009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.489+0000 7ff940fd0700 1 -- 172.21.15.59:0/75393377 shutdown_connections 2023-09-30T22:29:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.489+0000 7ff940fd0700 1 --2- 172.21.15.59:0/75393377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff93c139030 0x7ff93c13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.489+0000 7ff940fd0700 1 --2- 172.21.15.59:0/75393377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff93c136710 0x7ff93c138af0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.489+0000 7ff940fd0700 1 -- 172.21.15.59:0/75393377 >> 172.21.15.59:0/75393377 conn(0x7ff93c0a2aa0 msgr2=0x7ff93c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.489+0000 7ff940fd0700 1 -- 172.21.15.59:0/75393377 shutdown_connections 2023-09-30T22:29:45.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.489+0000 7ff940fd0700 1 -- 172.21.15.59:0/75393377 wait complete. 2023-09-30T22:29:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.491+0000 7ff940fd0700 1 Processor -- start 2023-09-30T22:29:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.491+0000 7ff940fd0700 1 -- start start 2023-09-30T22:29:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.491+0000 7ff940fd0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff93c1338a0 0x7ff93c11ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.491+0000 7ff940fd0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff93c136710 0x7ff93c11b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.491+0000 7ff940fd0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff93c139030 0x7ff93c11b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.491+0000 7ff940fd0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c11ced0 con 0x7ff93c139030 2023-09-30T22:29:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.491+0000 7ff940fd0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c11c9b0 con 0x7ff93c1338a0 2023-09-30T22:29:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.491+0000 7ff940fd0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c11e4d0 con 0x7ff93c136710 2023-09-30T22:29:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.491+0000 7ff93ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff93c139030 0x7ff93c11b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.491+0000 7ff93ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff93c139030 0x7ff93c11b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37324/0 (socket says 172.21.15.59:37324) 2023-09-30T22:29:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.491+0000 7ff93ad9d700 1 -- 172.21.15.59:0/3263376273 learned_addr learned my addr 172.21.15.59:0/3263376273 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.491+0000 7ff93a59c700 1 --2- 172.21.15.59:0/3263376273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff93c1338a0 0x7ff93c11ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.492+0000 7ff939d9b700 1 --2- 172.21.15.59:0/3263376273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff93c136710 0x7ff93c11b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.492+0000 7ff93ad9d700 1 -- 172.21.15.59:0/3263376273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff93c136710 msgr2=0x7ff93c11b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.492+0000 7ff93ad9d700 1 --2- 172.21.15.59:0/3263376273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff93c136710 0x7ff93c11b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.492+0000 7ff93ad9d700 1 -- 172.21.15.59:0/3263376273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff93c1338a0 msgr2=0x7ff93c11ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.492+0000 7ff93ad9d700 1 --2- 172.21.15.59:0/3263376273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff93c1338a0 0x7ff93c11ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.492+0000 7ff93ad9d700 1 -- 172.21.15.59:0/3263376273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9300094a0 con 0x7ff93c139030 2023-09-30T22:29:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.492+0000 7ff93ad9d700 1 --2- 172.21.15.59:0/3263376273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff93c139030 0x7ff93c11b710 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff93400ef90 tx=0x7ff93400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.492+0000 7ff92affd700 1 -- 172.21.15.59:0/3263376273 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93400cc90 con 0x7ff93c139030 2023-09-30T22:29:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.492+0000 7ff92affd700 1 -- 172.21.15.59:0/3263376273 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93400f040 con 0x7ff93c139030 2023-09-30T22:29:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.492+0000 7ff940fd0700 1 -- 172.21.15.59:0/3263376273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c138d90 con 0x7ff93c139030 2023-09-30T22:29:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.492+0000 7ff92affd700 1 -- 172.21.15.59:0/3263376273 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934014480 con 0x7ff93c139030 2023-09-30T22:29:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.493+0000 7ff92affd700 1 -- 172.21.15.59:0/3263376273 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff9340145e0 con 0x7ff93c139030 2023-09-30T22:29:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.493+0000 7ff93a59c700 1 -- 172.21.15.59:0/3263376273 >> v1:172.21.15.59:6816/126772 conn(0x7ff91c02f510 legacy=0x7ff91c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.494+0000 7ff940fd0700 1 -- 172.21.15.59:0/3263376273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c11ef40 con 0x7ff93c139030 2023-09-30T22:29:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.494+0000 7ff92affd700 1 -- 172.21.15.59:0/3263376273 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff93401c570 con 0x7ff93c139030 2023-09-30T22:29:45.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.495+0000 7ff940fd0700 1 -- 172.21.15.59:0/3263376273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93c11e310 con 0x7ff93c139030 2023-09-30T22:29:45.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.500+0000 7ff92affd700 1 -- 172.21.15.59:0/3263376273 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff934018070 con 0x7ff93c139030 2023-09-30T22:29:45.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.530+0000 7f6a893fb700 1 Processor -- start 2023-09-30T22:29:45.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.530+0000 7f6a893fb700 1 -- start start 2023-09-30T22:29:45.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.531+0000 7f6a893fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8409d6f0 0x7f6a8409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.531+0000 7f6a893fb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8409e000 0x7f6a84130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.531+0000 7f6a893fb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a8409e410 0x7f6a84130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.531+0000 7f6a893fb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8409f520 con 0x7f6a8409e410 2023-09-30T22:29:45.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.531+0000 7f6a893fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8409f130 con 0x7f6a8409d6f0 2023-09-30T22:29:45.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.531+0000 7f6a893fb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8409e930 con 0x7f6a8409e000 2023-09-30T22:29:45.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.531+0000 7f6a82ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8409d6f0 0x7f6a8409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.531+0000 7f6a82ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8409d6f0 0x7f6a8409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53876/0 (socket says 172.21.15.59:53876) 2023-09-30T22:29:45.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.531+0000 7f6a82ffd700 1 -- 172.21.15.59:0/1342520561 learned_addr learned my addr 172.21.15.59:0/1342520561 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:45.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.531+0000 7f6a837fe700 1 --2- 172.21.15.59:0/1342520561 >> v2:172.21.15.59:3300/0 conn(0x7f6a8409e410 0x7f6a84130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.531+0000 7f6a827fc700 1 --2- 172.21.15.59:0/1342520561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8409e000 0x7f6a84130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.532+0000 7f6a82ffd700 1 -- 172.21.15.59:0/1342520561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8409e000 msgr2=0x7f6a84130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:45.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.532+0000 7f6a82ffd700 1 --2- 172.21.15.59:0/1342520561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8409e000 0x7f6a84130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.532+0000 7f6a82ffd700 1 -- 172.21.15.59:0/1342520561 >> v2:172.21.15.59:3300/0 conn(0x7f6a8409e410 msgr2=0x7f6a84130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.532+0000 7f6a82ffd700 1 --2- 172.21.15.59:0/1342520561 >> v2:172.21.15.59:3300/0 conn(0x7f6a8409e410 0x7f6a84130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.532+0000 7f6a82ffd700 1 -- 172.21.15.59:0/1342520561 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8409b2d0 con 0x7f6a8409d6f0 2023-09-30T22:29:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.532+0000 7f6a82ffd700 1 --2- 172.21.15.59:0/1342520561 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8409d6f0 0x7f6a8409dac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6a74009920 tx=0x7f6a74009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=872b1aaea11f5822 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.532+0000 7f6a81ffb700 1 -- 172.21.15.59:0/1342520561 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a74011830 con 0x7f6a8409d6f0 2023-09-30T22:29:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.532+0000 7f6a81ffb700 1 -- 172.21.15.59:0/1342520561 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a74011990 con 0x7f6a8409d6f0 2023-09-30T22:29:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.532+0000 7f6a81ffb700 1 -- 172.21.15.59:0/1342520561 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a74011d20 con 0x7f6a8409d6f0 2023-09-30T22:29:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.533+0000 7f6a893fb700 1 -- 172.21.15.59:0/1342520561 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8409d6f0 msgr2=0x7f6a8409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.533+0000 7f6a893fb700 1 --2- 172.21.15.59:0/1342520561 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8409d6f0 0x7f6a8409dac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6a74009920 tx=0x7f6a74009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.533+0000 7f6a893fb700 1 -- 172.21.15.59:0/1342520561 shutdown_connections 2023-09-30T22:29:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.533+0000 7f6a893fb700 1 --2- 172.21.15.59:0/1342520561 >> v2:172.21.15.59:3300/0 conn(0x7f6a8409e410 0x7f6a84130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.533+0000 7f6a893fb700 1 --2- 172.21.15.59:0/1342520561 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8409d6f0 0x7f6a8409dac0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.533+0000 7f6a893fb700 1 --2- 172.21.15.59:0/1342520561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8409e000 0x7f6a84130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.533+0000 7f6a893fb700 1 -- 172.21.15.59:0/1342520561 >> 172.21.15.59:0/1342520561 conn(0x7f6a84066f50 msgr2=0x7f6a8409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.533+0000 7f6a893fb700 1 -- 172.21.15.59:0/1342520561 shutdown_connections 2023-09-30T22:29:45.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.533+0000 7f6a893fb700 1 -- 172.21.15.59:0/1342520561 wait complete. 2023-09-30T22:29:45.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.535+0000 7f6a893fb700 1 Processor -- start 2023-09-30T22:29:45.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.535+0000 7f6a893fb700 1 -- start start 2023-09-30T22:29:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a893fb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8409d6f0 0x7f6a84122590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a893fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8409e000 0x7f6a84122ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a893fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a8409e410 0x7f6a84123010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a893fb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a840a3b10 con 0x7f6a8409e410 2023-09-30T22:29:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a893fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8409c700 con 0x7f6a8409e000 2023-09-30T22:29:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a893fb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a84125dd0 con 0x7f6a8409d6f0 2023-09-30T22:29:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a82ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8409d6f0 0x7f6a84122590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a82ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8409d6f0 0x7f6a84122590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42806/0 (socket says 172.21.15.59:42806) 2023-09-30T22:29:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a82ffd700 1 -- 172.21.15.59:0/483167881 learned_addr learned my addr 172.21.15.59:0/483167881 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a827fc700 1 --2- 172.21.15.59:0/483167881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8409e000 0x7f6a84122ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a837fe700 1 --2- 172.21.15.59:0/483167881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a8409e410 0x7f6a84123010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a82ffd700 1 -- 172.21.15.59:0/483167881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8409e000 msgr2=0x7f6a84122ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a82ffd700 1 --2- 172.21.15.59:0/483167881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8409e000 0x7f6a84122ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a82ffd700 1 -- 172.21.15.59:0/483167881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a8409e410 msgr2=0x7f6a84123010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a82ffd700 1 --2- 172.21.15.59:0/483167881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a8409e410 0x7f6a84123010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.536+0000 7f6a82ffd700 1 -- 172.21.15.59:0/483167881 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a74009550 con 0x7f6a8409d6f0 2023-09-30T22:29:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.537+0000 7f6a837fe700 1 --2- 172.21.15.59:0/483167881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a8409e410 0x7f6a84123010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.537+0000 7f6a82ffd700 1 --2- 172.21.15.59:0/483167881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8409d6f0 0x7f6a84122590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6a74000c00 tx=0x7f6a74004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.537+0000 7f6a6b7fe700 1 -- 172.21.15.59:0/483167881 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a74004300 con 0x7f6a8409d6f0 2023-09-30T22:29:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.537+0000 7f6a6b7fe700 1 -- 172.21.15.59:0/483167881 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7401f070 con 0x7f6a8409d6f0 2023-09-30T22:29:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.537+0000 7f6a6b7fe700 1 -- 172.21.15.59:0/483167881 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a740036a0 con 0x7f6a8409d6f0 2023-09-30T22:29:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.537+0000 7f6a893fb700 1 -- 172.21.15.59:0/483167881 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a84124990 con 0x7f6a8409d6f0 2023-09-30T22:29:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.537+0000 7f6a893fb700 1 -- 172.21.15.59:0/483167881 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a841260b0 con 0x7f6a8409d6f0 2023-09-30T22:29:45.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.538+0000 7f6a6b7fe700 1 -- 172.21.15.59:0/483167881 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6a74021030 con 0x7f6a8409d6f0 2023-09-30T22:29:45.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.538+0000 7f6a893fb700 1 -- 172.21.15.59:0/483167881 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a84125a50 con 0x7f6a8409d6f0 2023-09-30T22:29:45.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.539+0000 7f6a6b7fe700 1 -- 172.21.15.59:0/483167881 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f6a74040bd0 con 0x7f6a8409d6f0 2023-09-30T22:29:45.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.539+0000 7f6a827fc700 1 -- 172.21.15.59:0/483167881 >> v1:172.21.15.59:6816/126772 conn(0x7f6a7002f510 legacy=0x7f6a700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.544+0000 7f6a6b7fe700 1 -- 172.21.15.59:0/483167881 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a84125a50 con 0x7f6a8409d6f0 2023-09-30T22:29:45.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.570+0000 7fcc2bbfa700 1 Processor -- start 2023-09-30T22:29:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.571+0000 7f86ad1f7700 1 Processor -- start 2023-09-30T22:29:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.571+0000 7fcc2bbfa700 1 -- start start 2023-09-30T22:29:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.571+0000 7fcc2bbfa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc2409d6f0 0x7fcc2409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.571+0000 7fcc2bbfa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc2409e000 0x7fcc241339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.571+0000 7fcc2bbfa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc2409b120 con 0x7fcc2409e410 2023-09-30T22:29:45.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.571+0000 7fcc2bbfa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2406b460 con 0x7fcc2409d6f0 2023-09-30T22:29:45.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.571+0000 7fcc2bbfa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2409a7e0 con 0x7fcc2409e000 2023-09-30T22:29:45.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.571+0000 7f86ad1f7700 1 -- start start 2023-09-30T22:29:45.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.571+0000 7f86ad1f7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a809eca0 0x7f86a813cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.571+0000 7f86ad1f7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86a806f050 0x7f86a813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.571+0000 7f86ad1f7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a8070ee0 con 0x7f86a806e570 2023-09-30T22:29:45.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.571+0000 7f86ad1f7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a8071980 con 0x7f86a806f050 2023-09-30T22:29:45.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.571+0000 7f86ad1f7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86a8071480 con 0x7f86a809eca0 2023-09-30T22:29:45.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7fcc29195700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc2409e000 0x7fcc241339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7fcc2a197700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcc2409e410 0x7fcc24133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33870/0 (socket says 172.21.15.59:33870) 2023-09-30T22:29:45.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7fcc2a197700 1 -- 172.21.15.59:0/251758581 learned_addr learned my addr 172.21.15.59:0/251758581 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:45.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7fcc29996700 1 --2- 172.21.15.59:0/251758581 >> v2:172.21.15.59:3300/0 conn(0x7fcc2409d6f0 0x7fcc2409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7f86a6d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f86a806e570 0x7f86a806e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33856/0 (socket says 172.21.15.59:33856) 2023-09-30T22:29:45.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7f86a6d9d700 1 -- 172.21.15.59:0/457242708 learned_addr learned my addr 172.21.15.59:0/457242708 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:45.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7f86a659c700 1 --2- 172.21.15.59:0/457242708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a809eca0 0x7f86a813cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7fcc28994700 1 -- 172.21.15.59:0/251758581 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168590370 0 0) 0x7fcc2409b120 con 0x7fcc2409e410 2023-09-30T22:29:45.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7fcc28994700 1 -- 172.21.15.59:0/251758581 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc100035b0 con 0x7fcc2409e410 2023-09-30T22:29:45.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7f86a759e700 1 --2- 172.21.15.59:0/457242708 >> v2:172.21.15.59:3300/0 conn(0x7f86a806f050 0x7f86a813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7fcc29195700 1 -- 172.21.15.59:0/251758581 >> v2:172.21.15.59:3300/0 conn(0x7fcc2409d6f0 msgr2=0x7fcc2409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:45.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7fcc29195700 1 --2- 172.21.15.59:0/251758581 >> v2:172.21.15.59:3300/0 conn(0x7fcc2409d6f0 0x7fcc2409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7fcc29195700 1 -- 172.21.15.59:0/251758581 >> v1:172.21.15.59:6789/0 conn(0x7fcc2409e410 legacy=0x7fcc24133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7fcc29195700 1 -- 172.21.15.59:0/251758581 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2409a500 con 0x7fcc2409e000 2023-09-30T22:29:45.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7f86a659c700 1 -- 172.21.15.59:0/457242708 >> v2:172.21.15.59:3300/0 conn(0x7f86a806f050 msgr2=0x7f86a813f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:45.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7f86a659c700 1 --2- 172.21.15.59:0/457242708 >> v2:172.21.15.59:3300/0 conn(0x7f86a806f050 0x7f86a813f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7f86a659c700 1 -- 172.21.15.59:0/457242708 >> v1:172.21.15.59:6789/0 conn(0x7f86a806e570 legacy=0x7f86a806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7f86a659c700 1 -- 172.21.15.59:0/457242708 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a8071b90 con 0x7f86a809eca0 2023-09-30T22:29:45.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.572+0000 7f86a759e700 1 --2- 172.21.15.59:0/457242708 >> v2:172.21.15.59:3300/0 conn(0x7f86a806f050 0x7f86a813f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:45.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.573+0000 7fcc29195700 1 --2- 172.21.15.59:0/251758581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc2409e000 0x7fcc241339f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009870 tx=0x7fcc14009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18b016763e657cbb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.573+0000 7f86a659c700 1 --2- 172.21.15.59:0/457242708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a809eca0 0x7f86a813cea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f869c009840 tx=0x7f869c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6db8323ff8f6ff4a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.573+0000 7fcc28994700 1 -- 172.21.15.59:0/251758581 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14004230 con 0x7fcc2409e000 2023-09-30T22:29:45.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.573+0000 7f86a5d9b700 1 -- 172.21.15.59:0/457242708 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c011830 con 0x7f86a809eca0 2023-09-30T22:29:45.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.573+0000 7fcc28994700 1 -- 172.21.15.59:0/251758581 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc14004390 con 0x7fcc2409e000 2023-09-30T22:29:45.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.573+0000 7fcc28994700 1 -- 172.21.15.59:0/251758581 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc140036a0 con 0x7fcc2409e000 2023-09-30T22:29:45.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.573+0000 7f86a5d9b700 1 -- 172.21.15.59:0/457242708 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c011990 con 0x7f86a809eca0 2023-09-30T22:29:45.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.573+0000 7f86a5d9b700 1 -- 172.21.15.59:0/457242708 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c011d20 con 0x7f86a809eca0 2023-09-30T22:29:45.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7f86ad1f7700 1 -- 172.21.15.59:0/457242708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a809eca0 msgr2=0x7f86a813cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7fcc2bbfa700 1 -- 172.21.15.59:0/251758581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc2409e000 msgr2=0x7fcc241339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7f86ad1f7700 1 --2- 172.21.15.59:0/457242708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a809eca0 0x7f86a813cea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f869c009840 tx=0x7f869c009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:45.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7fcc2bbfa700 1 --2- 172.21.15.59:0/251758581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc2409e000 0x7fcc241339f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009870 tx=0x7fcc14009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:45.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7fcc2bbfa700 1 -- 172.21.15.59:0/251758581 shutdown_connections 2023-09-30T22:29:45.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7fcc2bbfa700 1 --2- 172.21.15.59:0/251758581 >> v2:172.21.15.59:3300/0 conn(0x7fcc2409d6f0 0x7fcc2409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7fcc2bbfa700 1 --2- 172.21.15.59:0/251758581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc2409e000 0x7fcc241339f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7fcc2bbfa700 1 -- 172.21.15.59:0/251758581 >> 172.21.15.59:0/251758581 conn(0x7fcc24066f50 msgr2=0x7fcc2409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7f86ad1f7700 1 -- 172.21.15.59:0/457242708 shutdown_connections 2023-09-30T22:29:45.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7f86ad1f7700 1 --2- 172.21.15.59:0/457242708 >> v2:172.21.15.59:3300/0 conn(0x7f86a806f050 0x7f86a813f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7f86ad1f7700 1 --2- 172.21.15.59:0/457242708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a809eca0 0x7f86a813cea0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7f86ad1f7700 1 -- 172.21.15.59:0/457242708 >> 172.21.15.59:0/457242708 conn(0x7f86a80a2aa0 msgr2=0x7f86a80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7f86ad1f7700 1 -- 172.21.15.59:0/457242708 shutdown_connections 2023-09-30T22:29:45.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7f86ad1f7700 1 -- 172.21.15.59:0/457242708 wait complete. 2023-09-30T22:29:45.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7fcc2bbfa700 1 -- 172.21.15.59:0/251758581 shutdown_connections 2023-09-30T22:29:45.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.574+0000 7fcc2bbfa700 1 -- 172.21.15.59:0/251758581 wait complete. 2023-09-30T22:29:45.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.575+0000 7fcc2bbfa700 1 Processor -- start 2023-09-30T22:29:45.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.575+0000 7fcc2bbfa700 1 -- start start 2023-09-30T22:29:45.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc2bbfa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc2409d6f0 0x7fcc241c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc2bbfa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc2409e000 0x7fcc241c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc2bbfa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc2409e410 0x7fcc241c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc2bbfa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc241a7190 con 0x7fcc2409e410 2023-09-30T22:29:45.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc2bbfa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc241a8760 con 0x7fcc2409e000 2023-09-30T22:29:45.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc2bbfa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc241a8b20 con 0x7fcc2409d6f0 2023-09-30T22:29:45.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7f86ad1f7700 1 Processor -- start 2023-09-30T22:29:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc29996700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc2409d6f0 0x7fcc241c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc29996700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc2409d6f0 0x7fcc241c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42820/0 (socket says 172.21.15.59:42820) 2023-09-30T22:29:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc29996700 1 -- 172.21.15.59:0/4056597016 learned_addr learned my addr 172.21.15.59:0/4056597016 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc29195700 1 --2- 172.21.15.59:0/4056597016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc2409e000 0x7fcc241c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc2a197700 1 --2- 172.21.15.59:0/4056597016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc2409e410 0x7fcc241c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc29996700 1 -- 172.21.15.59:0/4056597016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc2409e000 msgr2=0x7fcc241c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc29996700 1 --2- 172.21.15.59:0/4056597016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc2409e000 0x7fcc241c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc29996700 1 -- 172.21.15.59:0/4056597016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc2409e410 msgr2=0x7fcc241c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc29996700 1 --2- 172.21.15.59:0/4056597016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc2409e410 0x7fcc241c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc29996700 1 -- 172.21.15.59:0/4056597016 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc140094a0 con 0x7fcc2409d6f0 2023-09-30T22:29:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7fcc29195700 1 --2- 172.21.15.59:0/4056597016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc2409e000 0x7fcc241c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7fcc29996700 1 --2- 172.21.15.59:0/4056597016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc2409d6f0 0x7fcc241c50d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000d860 tx=0x7fcc2000db70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.576+0000 7f86ad1f7700 1 -- start start 2023-09-30T22:29:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7f86ad1f7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a806e570 0x7f86a813ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7f86ad1f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a806f050 0x7f86a813cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7f86ad1f7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a812e0a0 0x7f86a813d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7f86ad1f7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a813df40 con 0x7f86a806e570 2023-09-30T22:29:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7f86ad1f7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a813e6a0 con 0x7f86a806f050 2023-09-30T22:29:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7f86ad1f7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86a813ec60 con 0x7f86a812e0a0 2023-09-30T22:29:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7f86a659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a806f050 0x7f86a813cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7f86a659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a806f050 0x7f86a813cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53914/0 (socket says 172.21.15.59:53914) 2023-09-30T22:29:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7f86a659c700 1 -- 172.21.15.59:0/3518970870 learned_addr learned my addr 172.21.15.59:0/3518970870 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7f86a759e700 1 --2- 172.21.15.59:0/3518970870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a812e0a0 0x7f86a813d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7fcc1a7fc700 1 -- 172.21.15.59:0/4056597016 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc200125f0 con 0x7fcc2409d6f0 2023-09-30T22:29:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7fcc1a7fc700 1 -- 172.21.15.59:0/4056597016 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc20012750 con 0x7fcc2409d6f0 2023-09-30T22:29:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7fcc1a7fc700 1 -- 172.21.15.59:0/4056597016 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc20012b00 con 0x7fcc2409d6f0 2023-09-30T22:29:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7fcc2bbfa700 1 -- 172.21.15.59:0/4056597016 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc241a9260 con 0x7fcc2409d6f0 2023-09-30T22:29:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7f86a659c700 1 -- 172.21.15.59:0/3518970870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a812e0a0 msgr2=0x7f86a813d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7f86a659c700 1 --2- 172.21.15.59:0/3518970870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a812e0a0 0x7f86a813d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7f86a659c700 1 -- 172.21.15.59:0/3518970870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a806e570 msgr2=0x7f86a813ca90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:45.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7f86a659c700 1 --2- 172.21.15.59:0/3518970870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a806e570 0x7f86a813ca90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7f86a659c700 1 -- 172.21.15.59:0/3518970870 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c0094a0 con 0x7f86a806f050 2023-09-30T22:29:45.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.577+0000 7fcc2bbfa700 1 -- 172.21.15.59:0/4056597016 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc241a78f0 con 0x7fcc2409d6f0 2023-09-30T22:29:45.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.578+0000 7fcc1a7fc700 1 -- 172.21.15.59:0/4056597016 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fcc20012c60 con 0x7fcc2409d6f0 2023-09-30T22:29:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.578+0000 7fcc2bbfa700 1 -- 172.21.15.59:0/4056597016 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc24074ea0 con 0x7fcc2409d6f0 2023-09-30T22:29:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.578+0000 7f86a659c700 1 --2- 172.21.15.59:0/3518970870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a806f050 0x7f86a813cfd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f869c0090b0 tx=0x7f869c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.579+0000 7f868f7fe700 1 -- 172.21.15.59:0/3518970870 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c0036a0 con 0x7f86a806f050 2023-09-30T22:29:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.579+0000 7f868f7fe700 1 -- 172.21.15.59:0/3518970870 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c003800 con 0x7f86a806f050 2023-09-30T22:29:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.579+0000 7f868f7fe700 1 -- 172.21.15.59:0/3518970870 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c003bb0 con 0x7f86a806f050 2023-09-30T22:29:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.579+0000 7fcc1a7fc700 1 -- 172.21.15.59:0/4056597016 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fcc2003fea0 con 0x7fcc2409d6f0 2023-09-30T22:29:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.579+0000 7fcc29195700 1 -- 172.21.15.59:0/4056597016 >> v1:172.21.15.59:6816/126772 conn(0x7fcc0802f560 legacy=0x7fcc08031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.579+0000 7f86ad1f7700 1 -- 172.21.15.59:0/3518970870 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a812d8c0 con 0x7f86a806f050 2023-09-30T22:29:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.579+0000 7f86ad1f7700 1 -- 172.21.15.59:0/3518970870 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a812cf70 con 0x7f86a806f050 2023-09-30T22:29:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.580+0000 7f868f7fe700 1 -- 172.21.15.59:0/3518970870 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f869c003d10 con 0x7f86a806f050 2023-09-30T22:29:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.580+0000 7f868f7fe700 1 -- 172.21.15.59:0/3518970870 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f869c041010 con 0x7f86a806f050 2023-09-30T22:29:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.580+0000 7f86a6d9d700 1 -- 172.21.15.59:0/3518970870 >> v1:172.21.15.59:6816/126772 conn(0x7f869402f510 legacy=0x7f86940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.581+0000 7f86ad1f7700 1 -- 172.21.15.59:0/3518970870 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86880052e0 con 0x7f86a806f050 2023-09-30T22:29:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.586+0000 7fcc1a7fc700 1 -- 172.21.15.59:0/4056597016 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc2001e460 con 0x7fcc2409d6f0 2023-09-30T22:29:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.586+0000 7f868f7fe700 1 -- 172.21.15.59:0/3518970870 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f869c015080 con 0x7f86a806f050 2023-09-30T22:29:45.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.694+0000 7ff93a59c700 1 -- 172.21.15.59:0/3263376273 >> v1:172.21.15.59:6816/126772 conn(0x7ff91c02f510 legacy=0x7ff91c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:45.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.738+0000 7ff940fd0700 1 -- 172.21.15.59:0/3263376273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff93c11e0f0 con 0x7ff93c139030 2023-09-30T22:29:45.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.738+0000 7ff92affd700 1 -- 172.21.15.59:0/3263376273 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff934018020 con 0x7ff93c139030 2023-09-30T22:29:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:45.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.740+0000 7f6a827fc700 1 -- 172.21.15.59:0/483167881 >> v1:172.21.15.59:6816/126772 conn(0x7f6a7002f510 legacy=0x7f6a700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:45.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.740+0000 7ff940fd0700 1 -- 172.21.15.59:0/3263376273 >> v1:172.21.15.59:6816/126772 conn(0x7ff91c02f510 legacy=0x7ff91c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:45.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.740+0000 7ff940fd0700 1 -- 172.21.15.59:0/3263376273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff93c139030 msgr2=0x7ff93c11b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.740+0000 7ff940fd0700 1 --2- 172.21.15.59:0/3263376273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff93c139030 0x7ff93c11b710 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff93400ef90 tx=0x7ff93400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.741+0000 7ff940fd0700 1 -- 172.21.15.59:0/3263376273 shutdown_connections 2023-09-30T22:29:45.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.741+0000 7ff940fd0700 1 --2- 172.21.15.59:0/3263376273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff93c139030 0x7ff93c11b710 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.741+0000 7ff940fd0700 1 --2- 172.21.15.59:0/3263376273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff93c1338a0 0x7ff93c11ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.741+0000 7ff940fd0700 1 --2- 172.21.15.59:0/3263376273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff93c136710 0x7ff93c11b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.741+0000 7ff940fd0700 1 -- 172.21.15.59:0/3263376273 >> 172.21.15.59:0/3263376273 conn(0x7ff93c0a2aa0 msgr2=0x7ff93c137100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.741+0000 7ff940fd0700 1 -- 172.21.15.59:0/3263376273 shutdown_connections 2023-09-30T22:29:45.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.741+0000 7ff940fd0700 1 -- 172.21.15.59:0/3263376273 wait complete. 2023-09-30T22:29:45.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.780+0000 7fcc29195700 1 -- 172.21.15.59:0/4056597016 >> v1:172.21.15.59:6816/126772 conn(0x7fcc0802f560 legacy=0x7fcc08031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.781+0000 7f86a6d9d700 1 -- 172.21.15.59:0/3518970870 >> v1:172.21.15.59:6816/126772 conn(0x7f869402f510 legacy=0x7f86940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:45.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.782+0000 7f6a893fb700 1 -- 172.21.15.59:0/483167881 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6a84125c30 con 0x7f6a8409d6f0 2023-09-30T22:29:45.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.782+0000 7f6a6b7fe700 1 -- 172.21.15.59:0/483167881 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a84125c30 con 0x7f6a8409d6f0 2023-09-30T22:29:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.786+0000 7f6a893fb700 1 -- 172.21.15.59:0/483167881 >> v1:172.21.15.59:6816/126772 conn(0x7f6a7002f510 legacy=0x7f6a700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.786+0000 7f6a893fb700 1 -- 172.21.15.59:0/483167881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8409d6f0 msgr2=0x7f6a84122590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.786+0000 7f6a893fb700 1 --2- 172.21.15.59:0/483167881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8409d6f0 0x7f6a84122590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6a74000c00 tx=0x7f6a74004750 comp rx=0 tx=0).stop 2023-09-30T22:29:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.786+0000 7f6a893fb700 1 -- 172.21.15.59:0/483167881 shutdown_connections 2023-09-30T22:29:45.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.786+0000 7f6a893fb700 1 --2- 172.21.15.59:0/483167881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8409d6f0 0x7f6a84122590 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.786+0000 7f6a893fb700 1 --2- 172.21.15.59:0/483167881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a8409e410 0x7f6a84123010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.786+0000 7f6a893fb700 1 --2- 172.21.15.59:0/483167881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8409e000 0x7f6a84122ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.786+0000 7f6a893fb700 1 -- 172.21.15.59:0/483167881 >> 172.21.15.59:0/483167881 conn(0x7f6a84066f50 msgr2=0x7f6a84070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.786+0000 7f6a893fb700 1 -- 172.21.15.59:0/483167881 shutdown_connections 2023-09-30T22:29:45.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.786+0000 7f6a893fb700 1 -- 172.21.15.59:0/483167881 wait complete. 2023-09-30T22:29:45.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.798+0000 7f86ad1f7700 1 -- 172.21.15.59:0/3518970870 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8688005150 con 0x7f86a806f050 2023-09-30T22:29:45.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.799+0000 7f868f7fe700 1 -- 172.21.15.59:0/3518970870 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f869c010790 con 0x7f86a806f050 2023-09-30T22:29:45.801 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:45.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.801+0000 7f86ad1f7700 1 -- 172.21.15.59:0/3518970870 >> v1:172.21.15.59:6816/126772 conn(0x7f869402f510 legacy=0x7f86940319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.801+0000 7f86ad1f7700 1 -- 172.21.15.59:0/3518970870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a806f050 msgr2=0x7f86a813cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.801+0000 7f86ad1f7700 1 --2- 172.21.15.59:0/3518970870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a806f050 0x7f86a813cfd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f869c0090b0 tx=0x7f869c004750 comp rx=0 tx=0).stop 2023-09-30T22:29:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.801+0000 7f86ad1f7700 1 -- 172.21.15.59:0/3518970870 shutdown_connections 2023-09-30T22:29:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.801+0000 7f86ad1f7700 1 --2- 172.21.15.59:0/3518970870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a812e0a0 0x7f86a813d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.801+0000 7f86ad1f7700 1 --2- 172.21.15.59:0/3518970870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a806e570 0x7f86a813ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.801+0000 7f86ad1f7700 1 --2- 172.21.15.59:0/3518970870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a806f050 0x7f86a813cfd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.801+0000 7f86ad1f7700 1 -- 172.21.15.59:0/3518970870 >> 172.21.15.59:0/3518970870 conn(0x7f86a80a2aa0 msgr2=0x7f86a809cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.801+0000 7f86ad1f7700 1 -- 172.21.15.59:0/3518970870 shutdown_connections 2023-09-30T22:29:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.801+0000 7f86ad1f7700 1 -- 172.21.15.59:0/3518970870 wait complete. 2023-09-30T22:29:45.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:45.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.807+0000 7fcc2bbfa700 1 -- 172.21.15.59:0/4056597016 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcc2406c360 con 0x7fcc2409d6f0 2023-09-30T22:29:45.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.808+0000 7fcc1a7fc700 1 -- 172.21.15.59:0/4056597016 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc20011340 con 0x7fcc2409d6f0 2023-09-30T22:29:45.809 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:45.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.810+0000 7fcc2bbfa700 1 -- 172.21.15.59:0/4056597016 >> v1:172.21.15.59:6816/126772 conn(0x7fcc0802f560 legacy=0x7fcc08031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:45.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.810+0000 7fcc2bbfa700 1 -- 172.21.15.59:0/4056597016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc2409d6f0 msgr2=0x7fcc241c50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.810+0000 7fcc2bbfa700 1 --2- 172.21.15.59:0/4056597016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc2409d6f0 0x7fcc241c50d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000d860 tx=0x7fcc2000db70 comp rx=0 tx=0).stop 2023-09-30T22:29:45.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.810+0000 7fcc2bbfa700 1 -- 172.21.15.59:0/4056597016 shutdown_connections 2023-09-30T22:29:45.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.810+0000 7fcc2bbfa700 1 --2- 172.21.15.59:0/4056597016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc2409d6f0 0x7fcc241c50d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.810+0000 7fcc2bbfa700 1 --2- 172.21.15.59:0/4056597016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc2409e410 0x7fcc241c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.810+0000 7fcc2bbfa700 1 --2- 172.21.15.59:0/4056597016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc2409e000 0x7fcc241c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.810+0000 7fcc2bbfa700 1 -- 172.21.15.59:0/4056597016 >> 172.21.15.59:0/4056597016 conn(0x7fcc24066f50 msgr2=0x7fcc241badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.810+0000 7fcc2bbfa700 1 -- 172.21.15.59:0/4056597016 shutdown_connections 2023-09-30T22:29:45.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:45.810+0000 7fcc2bbfa700 1 -- 172.21.15.59:0/4056597016 wait complete. 2023-09-30T22:29:45.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:45.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:46.761 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:46.806 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:46.818 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:46.826 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:46.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.924+0000 7f0c41bec700 1 Processor -- start 2023-09-30T22:29:46.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.924+0000 7f0c41bec700 1 -- start start 2023-09-30T22:29:46.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.925+0000 7f0c41bec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c3c09d6f0 0x7f0c3c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.925+0000 7f0c41bec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c3c09e410 0x7f0c3c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.925+0000 7f0c41bec700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3c09f130 con 0x7f0c3c09e000 2023-09-30T22:29:46.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.925+0000 7f0c41bec700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c09f520 con 0x7f0c3c09e410 2023-09-30T22:29:46.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.925+0000 7f0c41bec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c09e930 con 0x7f0c3c09d6f0 2023-09-30T22:29:46.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.925+0000 7f0c3b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c3c09d6f0 0x7f0c3c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.925+0000 7f0c3b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c3c09d6f0 0x7f0c3c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53916/0 (socket says 172.21.15.59:53916) 2023-09-30T22:29:46.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.925+0000 7f0c3b7fe700 1 -- 172.21.15.59:0/2291861165 learned_addr learned my addr 172.21.15.59:0/2291861165 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:46.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.925+0000 7f0c3bfff700 1 --2- 172.21.15.59:0/2291861165 >> v2:172.21.15.59:3300/0 conn(0x7f0c3c09e410 0x7f0c3c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.926+0000 7f0c3bfff700 1 -- 172.21.15.59:0/2291861165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c3c09d6f0 msgr2=0x7f0c3c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:46.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.926+0000 7f0c3bfff700 1 --2- 172.21.15.59:0/2291861165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c3c09d6f0 0x7f0c3c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.926+0000 7f0c3bfff700 1 -- 172.21.15.59:0/2291861165 >> v1:172.21.15.59:6789/0 conn(0x7f0c3c09e000 legacy=0x7f0c3c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.926+0000 7f0c3bfff700 1 -- 172.21.15.59:0/2291861165 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c09b2d0 con 0x7f0c3c09e410 2023-09-30T22:29:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.926+0000 7f0c3bfff700 1 --2- 172.21.15.59:0/2291861165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c3c09e410 0x7f0c3c130d70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009d90 tx=0x7f0c3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561f5bc47107733d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.926+0000 7f0c3a7fc700 1 -- 172.21.15.59:0/2291861165 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3400bd20 con 0x7f0c3c09e410 2023-09-30T22:29:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.926+0000 7f0c3a7fc700 1 -- 172.21.15.59:0/2291861165 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3400be80 con 0x7f0c3c09e410 2023-09-30T22:29:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.926+0000 7f0c3a7fc700 1 -- 172.21.15.59:0/2291861165 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340116a0 con 0x7f0c3c09e410 2023-09-30T22:29:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.927+0000 7f0c41bec700 1 -- 172.21.15.59:0/2291861165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c3c09e410 msgr2=0x7f0c3c130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.927+0000 7f0c41bec700 1 --2- 172.21.15.59:0/2291861165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c3c09e410 0x7f0c3c130d70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009d90 tx=0x7f0c3400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.927+0000 7f0c41bec700 1 -- 172.21.15.59:0/2291861165 shutdown_connections 2023-09-30T22:29:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.927+0000 7f0c41bec700 1 --2- 172.21.15.59:0/2291861165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c3c09e410 0x7f0c3c130d70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.927+0000 7f0c41bec700 1 --2- 172.21.15.59:0/2291861165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c3c09d6f0 0x7f0c3c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.927+0000 7f0c41bec700 1 -- 172.21.15.59:0/2291861165 >> 172.21.15.59:0/2291861165 conn(0x7f0c3c066f50 msgr2=0x7f0c3c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:46.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.927+0000 7f0c41bec700 1 -- 172.21.15.59:0/2291861165 shutdown_connections 2023-09-30T22:29:46.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.928+0000 7f0c41bec700 1 -- 172.21.15.59:0/2291861165 wait complete. 2023-09-30T22:29:46.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.929+0000 7f0c41bec700 1 Processor -- start 2023-09-30T22:29:46.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.929+0000 7f0c41bec700 1 -- start start 2023-09-30T22:29:46.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.930+0000 7f0c41bec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c3c09d6f0 0x7f0c3c11e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.930+0000 7f0c41bec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c3c09e000 0x7f0c3c11e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.930+0000 7f0c41bec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c3c09e410 0x7f0c3c11ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.930+0000 7f0c41bec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c120320 con 0x7f0c3c09d6f0 2023-09-30T22:29:46.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.930+0000 7f0c41bec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c121960 con 0x7f0c3c09e410 2023-09-30T22:29:46.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.930+0000 7f0c41bec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c11feb0 con 0x7f0c3c09e000 2023-09-30T22:29:46.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.930+0000 7f0c3affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c3c09e000 0x7f0c3c11e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.930+0000 7f0c3bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c3c09e410 0x7f0c3c11ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.930+0000 7f0c3affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c3c09e000 0x7f0c3c11e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42838/0 (socket says 172.21.15.59:42838) 2023-09-30T22:29:46.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.930+0000 7f0c3affd700 1 -- 172.21.15.59:0/3686954461 learned_addr learned my addr 172.21.15.59:0/3686954461 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:46.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.930+0000 7f0c3b7fe700 1 --2- 172.21.15.59:0/3686954461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c3c09d6f0 0x7f0c3c11e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.931+0000 7f0c3bfff700 1 -- 172.21.15.59:0/3686954461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c3c09e000 msgr2=0x7f0c3c11e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.931+0000 7f0c3bfff700 1 --2- 172.21.15.59:0/3686954461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c3c09e000 0x7f0c3c11e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.931+0000 7f0c3bfff700 1 -- 172.21.15.59:0/3686954461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c3c09d6f0 msgr2=0x7f0c3c11e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.931+0000 7f0c3bfff700 1 --2- 172.21.15.59:0/3686954461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c3c09d6f0 0x7f0c3c11e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.931+0000 7f0c3bfff700 1 -- 172.21.15.59:0/3686954461 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c34009a70 con 0x7f0c3c09e410 2023-09-30T22:29:46.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.931+0000 7f0c3bfff700 1 --2- 172.21.15.59:0/3686954461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c3c09e410 0x7f0c3c11ec30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0c34018000 tx=0x7f0c34004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:46.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.931+0000 7f0c23fff700 1 -- 172.21.15.59:0/3686954461 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c34004780 con 0x7f0c3c09e410 2023-09-30T22:29:46.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.931+0000 7f0c23fff700 1 -- 172.21.15.59:0/3686954461 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3401e040 con 0x7f0c3c09e410 2023-09-30T22:29:46.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.931+0000 7f0c41bec700 1 -- 172.21.15.59:0/3686954461 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c0a1d90 con 0x7f0c3c09e410 2023-09-30T22:29:46.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.931+0000 7f0c23fff700 1 -- 172.21.15.59:0/3686954461 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340116a0 con 0x7f0c3c09e410 2023-09-30T22:29:46.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.931+0000 7f0c41bec700 1 -- 172.21.15.59:0/3686954461 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c120520 con 0x7f0c3c09e410 2023-09-30T22:29:46.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.933+0000 7f0c41bec700 1 -- 172.21.15.59:0/3686954461 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3c120cb0 con 0x7f0c3c09e410 2023-09-30T22:29:46.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.933+0000 7f0c23fff700 1 -- 172.21.15.59:0/3686954461 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0c34011800 con 0x7f0c3c09e410 2023-09-30T22:29:46.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.933+0000 7f0c23fff700 1 -- 172.21.15.59:0/3686954461 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0c34041190 con 0x7f0c3c09e410 2023-09-30T22:29:46.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.933+0000 7f0c3b7fe700 1 -- 172.21.15.59:0/3686954461 >> v1:172.21.15.59:6816/126772 conn(0x7f0c2802f510 legacy=0x7f0c280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:46.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.942+0000 7f0c23fff700 1 -- 172.21.15.59:0/3686954461 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c34021940 con 0x7f0c3c09e410 2023-09-30T22:29:46.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.969+0000 7f0db149d700 1 Processor -- start 2023-09-30T22:29:46.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.969+0000 7f0db149d700 1 -- start start 2023-09-30T22:29:46.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0db149d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dac09d6f0 0x7f0dac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0db149d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0dac09e000 0x7f0dac130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0db149d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dac09e410 0x7f0dac130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0db149d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dac09f520 con 0x7f0dac09e000 2023-09-30T22:29:46.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0db149d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac09f130 con 0x7f0dac09d6f0 2023-09-30T22:29:46.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0db149d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac09e930 con 0x7f0dac09e410 2023-09-30T22:29:46.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0daaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dac09d6f0 0x7f0dac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0da27fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0dac09e000 0x7f0dac130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0daaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dac09d6f0 0x7f0dac09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53934/0 (socket says 172.21.15.59:53934) 2023-09-30T22:29:46.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0da27fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0dac09e000 0x7f0dac130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37384/0 (socket says 172.21.15.59:37384) 2023-09-30T22:29:46.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0daaffd700 1 -- 172.21.15.59:0/3480152180 learned_addr learned my addr 172.21.15.59:0/3480152180 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:46.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0dab7fe700 1 --2- 172.21.15.59:0/3480152180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dac09e410 0x7f0dac130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0da27fc700 1 -- 172.21.15.59:0/3480152180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dac09e410 msgr2=0x7f0dac130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:46.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0da27fc700 1 --2- 172.21.15.59:0/3480152180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dac09e410 0x7f0dac130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0da27fc700 1 -- 172.21.15.59:0/3480152180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dac09d6f0 msgr2=0x7f0dac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:46.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0da27fc700 1 --2- 172.21.15.59:0/3480152180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dac09d6f0 0x7f0dac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0da27fc700 1 -- 172.21.15.59:0/3480152180 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac09b2d0 con 0x7f0dac09e000 2023-09-30T22:29:46.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.970+0000 7f0daaffd700 1 --2- 172.21.15.59:0/3480152180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dac09d6f0 0x7f0dac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:46.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.971+0000 7f0da27fc700 1 --2- 172.21.15.59:0/3480152180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dac09e000 0x7f0dac130660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400f9e0 tx=0x7f0d9400fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ff1659e62e9448 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:46.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.971+0000 7f0daa7fc700 1 -- 172.21.15.59:0/3480152180 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9400f460 con 0x7f0dac09e000 2023-09-30T22:29:46.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.971+0000 7f0daa7fc700 1 -- 172.21.15.59:0/3480152180 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9400fe80 con 0x7f0dac09e000 2023-09-30T22:29:46.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.971+0000 7f0daa7fc700 1 -- 172.21.15.59:0/3480152180 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94009ad0 con 0x7f0dac09e000 2023-09-30T22:29:46.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.972+0000 7f0db149d700 1 -- 172.21.15.59:0/3480152180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dac09e000 msgr2=0x7f0dac130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.972+0000 7f0db149d700 1 --2- 172.21.15.59:0/3480152180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dac09e000 0x7f0dac130660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400f9e0 tx=0x7f0d9400fcf0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.972+0000 7f0db149d700 1 -- 172.21.15.59:0/3480152180 shutdown_connections 2023-09-30T22:29:46.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.972+0000 7f0db149d700 1 --2- 172.21.15.59:0/3480152180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dac09e410 0x7f0dac130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.972+0000 7f0db149d700 1 --2- 172.21.15.59:0/3480152180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dac09d6f0 0x7f0dac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.972+0000 7f0db149d700 1 --2- 172.21.15.59:0/3480152180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dac09e000 0x7f0dac130660 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.972+0000 7f0db149d700 1 -- 172.21.15.59:0/3480152180 >> 172.21.15.59:0/3480152180 conn(0x7f0dac066f50 msgr2=0x7f0dac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:46.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.972+0000 7f0db149d700 1 -- 172.21.15.59:0/3480152180 shutdown_connections 2023-09-30T22:29:46.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.972+0000 7f0db149d700 1 -- 172.21.15.59:0/3480152180 wait complete. 2023-09-30T22:29:46.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.974+0000 7f0db149d700 1 Processor -- start 2023-09-30T22:29:46.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.974+0000 7f0db149d700 1 -- start start 2023-09-30T22:29:46.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0db149d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dac09d6f0 0x7f0dac11e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0db149d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dac09e000 0x7f0dac11e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0db149d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dac09e410 0x7f0dac11ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0db149d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac121d10 con 0x7f0dac09e410 2023-09-30T22:29:46.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0db149d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac11f630 con 0x7f0dac09d6f0 2023-09-30T22:29:46.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0db149d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac11fe00 con 0x7f0dac09e000 2023-09-30T22:29:46.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0daaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dac09d6f0 0x7f0dac11e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0daaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dac09d6f0 0x7f0dac11e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53950/0 (socket says 172.21.15.59:53950) 2023-09-30T22:29:46.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0daaffd700 1 -- 172.21.15.59:0/2111336367 learned_addr learned my addr 172.21.15.59:0/2111336367 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:46.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0dab7fe700 1 --2- 172.21.15.59:0/2111336367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dac09e410 0x7f0dac11ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0da27fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dac09e000 0x7f0dac11e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0daaffd700 1 -- 172.21.15.59:0/2111336367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dac09e000 msgr2=0x7f0dac11e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0daaffd700 1 --2- 172.21.15.59:0/2111336367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dac09e000 0x7f0dac11e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0daaffd700 1 -- 172.21.15.59:0/2111336367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dac09e410 msgr2=0x7f0dac11ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0daaffd700 1 --2- 172.21.15.59:0/2111336367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dac09e410 0x7f0dac11ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.975+0000 7f0daaffd700 1 -- 172.21.15.59:0/2111336367 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c009550 con 0x7f0dac09d6f0 2023-09-30T22:29:46.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.976+0000 7f0daaffd700 1 --2- 172.21.15.59:0/2111336367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dac09d6f0 0x7f0dac11e1f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00ebb0 tx=0x7f0d9c00eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:46.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.976+0000 7f0da3fff700 1 -- 172.21.15.59:0/2111336367 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c004030 con 0x7f0dac09d6f0 2023-09-30T22:29:46.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.976+0000 7f0da3fff700 1 -- 172.21.15.59:0/2111336367 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c004190 con 0x7f0dac09d6f0 2023-09-30T22:29:46.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.976+0000 7f0db149d700 1 -- 172.21.15.59:0/2111336367 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9400f610 con 0x7f0dac09d6f0 2023-09-30T22:29:46.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.976+0000 7f0da3fff700 1 -- 172.21.15.59:0/2111336367 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c004520 con 0x7f0dac09d6f0 2023-09-30T22:29:46.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.976+0000 7f0db149d700 1 -- 172.21.15.59:0/2111336367 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac09c700 con 0x7f0dac09d6f0 2023-09-30T22:29:46.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.977+0000 7f0da3fff700 1 -- 172.21.15.59:0/2111336367 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0d9c00c850 con 0x7f0dac09d6f0 2023-09-30T22:29:46.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.977+0000 7f0db149d700 1 -- 172.21.15.59:0/2111336367 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac130150 con 0x7f0dac09d6f0 2023-09-30T22:29:46.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.977+0000 7f0da3fff700 1 -- 172.21.15.59:0/2111336367 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0d9c03fde0 con 0x7f0dac09d6f0 2023-09-30T22:29:46.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.978+0000 7f0da27fc700 1 -- 172.21.15.59:0/2111336367 >> v1:172.21.15.59:6816/126772 conn(0x7f0d8c02f510 legacy=0x7f0d8c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:46.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:46.982+0000 7f0da3fff700 1 -- 172.21.15.59:0/2111336367 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d9c0036a0 con 0x7f0dac09d6f0 2023-09-30T22:29:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.012+0000 7fa8c2cb9700 1 Processor -- start 2023-09-30T22:29:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.012+0000 7fa8c2cb9700 1 -- start start 2023-09-30T22:29:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8c2cb9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa8bc06a770 0x7fa8bc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8c2cb9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8bc06b080 0x7fa8bc131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8c2cb9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8bc131b40 0x7fa8bc131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8c2cb9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8bc09ece0 con 0x7fa8bc06a770 2023-09-30T22:29:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8c2cb9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc09e760 con 0x7fa8bc06b080 2023-09-30T22:29:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8c2cb9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc09e040 con 0x7fa8bc131b40 2023-09-30T22:29:47.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8c0a55700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa8bc06a770 0x7fa8bc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:47.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8c0a55700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa8bc06a770 0x7fa8bc06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37394/0 (socket says 172.21.15.59:37394) 2023-09-30T22:29:47.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8c0a55700 1 -- 172.21.15.59:0/2866639026 learned_addr learned my addr 172.21.15.59:0/2866639026 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:47.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8c1256700 1 --2- 172.21.15.59:0/2866639026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8bc131b40 0x7fa8bc131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:47.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8bbfff700 1 --2- 172.21.15.59:0/2866639026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8bc06b080 0x7fa8bc131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:47.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8c0a55700 1 -- 172.21.15.59:0/2866639026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8bc131b40 msgr2=0x7fa8bc131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:47.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8c0a55700 1 --2- 172.21.15.59:0/2866639026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8bc131b40 0x7fa8bc131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8c0a55700 1 -- 172.21.15.59:0/2866639026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8bc06b080 msgr2=0x7fa8bc131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:47.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8c0a55700 1 --2- 172.21.15.59:0/2866639026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8bc06b080 0x7fa8bc131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8c0a55700 1 -- 172.21.15.59:0/2866639026 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc09f630 con 0x7fa8bc06a770 2023-09-30T22:29:47.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.013+0000 7fa8bbfff700 1 --2- 172.21.15.59:0/2866639026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8bc06b080 0x7fa8bc131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:47.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.014+0000 7fa8c0a55700 1 --2- 172.21.15.59:0/2866639026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8bc06a770 0x7fa8bc06ab40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00098f0 tx=0x7fa8b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5122ce0043a4f43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:47.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.014+0000 7fa8bb7fe700 1 -- 172.21.15.59:0/2866639026 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0011830 con 0x7fa8bc06a770 2023-09-30T22:29:47.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.014+0000 7fa8bb7fe700 1 -- 172.21.15.59:0/2866639026 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b0011990 con 0x7fa8bc06a770 2023-09-30T22:29:47.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.014+0000 7fa8bb7fe700 1 -- 172.21.15.59:0/2866639026 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0011d20 con 0x7fa8bc06a770 2023-09-30T22:29:47.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.015+0000 7f34a96d4700 1 Processor -- start 2023-09-30T22:29:47.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.015+0000 7f34a96d4700 1 -- start start 2023-09-30T22:29:47.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.015+0000 7fa8c2cb9700 1 -- 172.21.15.59:0/2866639026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8bc06a770 msgr2=0x7fa8bc06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:47.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.015+0000 7fa8c2cb9700 1 --2- 172.21.15.59:0/2866639026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8bc06a770 0x7fa8bc06ab40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00098f0 tx=0x7fa8b0009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:47.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.015+0000 7fa8c2cb9700 1 -- 172.21.15.59:0/2866639026 shutdown_connections 2023-09-30T22:29:47.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.015+0000 7fa8c2cb9700 1 --2- 172.21.15.59:0/2866639026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8bc131b40 0x7fa8bc131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.015+0000 7fa8c2cb9700 1 --2- 172.21.15.59:0/2866639026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8bc06a770 0x7fa8bc06ab40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.015+0000 7fa8c2cb9700 1 --2- 172.21.15.59:0/2866639026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8bc06b080 0x7fa8bc131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.015+0000 7fa8c2cb9700 1 -- 172.21.15.59:0/2866639026 >> 172.21.15.59:0/2866639026 conn(0x7fa8bc066f50 msgr2=0x7fa8bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:47.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.015+0000 7fa8c2cb9700 1 -- 172.21.15.59:0/2866639026 shutdown_connections 2023-09-30T22:29:47.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.015+0000 7fa8c2cb9700 1 -- 172.21.15.59:0/2866639026 wait complete. 2023-09-30T22:29:47.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.016+0000 7f34a96d4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f34a41316c0 0x7f34a4131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:47.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.016+0000 7f34a96d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34a406ae80 0x7f34a4139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:47.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.016+0000 7f34a96d4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a409e130 con 0x7f34a409d9f0 2023-09-30T22:29:47.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.016+0000 7f34a96d4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a41312b0 con 0x7f34a41316c0 2023-09-30T22:29:47.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.016+0000 7f34a96d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34a409f6e0 con 0x7f34a406ae80 2023-09-30T22:29:47.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.016+0000 7f34a37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34a406ae80 0x7f34a4139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:47.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.016+0000 7f34a37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34a406ae80 0x7f34a4139550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42882/0 (socket says 172.21.15.59:42882) 2023-09-30T22:29:47.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.016+0000 7f34a37fe700 1 -- 172.21.15.59:0/2291426371 learned_addr learned my addr 172.21.15.59:0/2291426371 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:47.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.016+0000 7f34a37fe700 1 -- 172.21.15.59:0/2291426371 >> v2:172.21.15.59:3300/0 conn(0x7f34a41316c0 msgr2=0x7f34a4131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:47.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.016+0000 7f34a37fe700 1 --2- 172.21.15.59:0/2291426371 >> v2:172.21.15.59:3300/0 conn(0x7f34a41316c0 0x7f34a4131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.016+0000 7f34a37fe700 1 -- 172.21.15.59:0/2291426371 >> v1:172.21.15.59:6789/0 conn(0x7f34a409d9f0 legacy=0x7f34a406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:47.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.016+0000 7f34a37fe700 1 -- 172.21.15.59:0/2291426371 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a409e760 con 0x7f34a406ae80 2023-09-30T22:29:47.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.017+0000 7f34a37fe700 1 --2- 172.21.15.59:0/2291426371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34a406ae80 0x7f34a4139550 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f349c009e50 tx=0x7f349c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d81a11cdceac94d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:47.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.017+0000 7fa8c2cb9700 1 Processor -- start 2023-09-30T22:29:47.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.017+0000 7fa8c2cb9700 1 -- start start 2023-09-30T22:29:47.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.017+0000 7f34a1ffb700 1 -- 172.21.15.59:0/2291426371 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c00e070 con 0x7f34a406ae80 2023-09-30T22:29:47.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.017+0000 7f34a1ffb700 1 -- 172.21.15.59:0/2291426371 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c003a20 con 0x7f34a406ae80 2023-09-30T22:29:47.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.017+0000 7f34a1ffb700 1 -- 172.21.15.59:0/2291426371 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c003dd0 con 0x7f34a406ae80 2023-09-30T22:29:47.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7fa8c2cb9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8bc06a770 0x7fa8bc1c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:47.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7fa8c2cb9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8bc06b080 0x7fa8bc1c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:47.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7fa8c2cb9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8bc131b40 0x7fa8bc1c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:47.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7fa8c2cb9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc11d9a0 con 0x7fa8bc06a770 2023-09-30T22:29:47.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7fa8c2cb9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc09a560 con 0x7fa8bc131b40 2023-09-30T22:29:47.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7fa8c2cb9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc120460 con 0x7fa8bc06b080 2023-09-30T22:29:47.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7f34a96d4700 1 -- 172.21.15.59:0/2291426371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34a406ae80 msgr2=0x7f34a4139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:47.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7f34a96d4700 1 --2- 172.21.15.59:0/2291426371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34a406ae80 0x7f34a4139550 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f349c009e50 tx=0x7f349c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:47.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7fa8c1256700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8bc131b40 0x7fa8bc1c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:47.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7fa8c1256700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8bc131b40 0x7fa8bc1c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53966/0 (socket says 172.21.15.59:53966) 2023-09-30T22:29:47.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7fa8c1256700 1 -- 172.21.15.59:0/743835916 learned_addr learned my addr 172.21.15.59:0/743835916 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:47.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7fa8bbfff700 1 --2- 172.21.15.59:0/743835916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8bc06b080 0x7fa8bc1c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:47.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7f34a96d4700 1 -- 172.21.15.59:0/2291426371 shutdown_connections 2023-09-30T22:29:47.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7f34a96d4700 1 --2- 172.21.15.59:0/2291426371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34a406ae80 0x7f34a4139550 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7f34a96d4700 1 --2- 172.21.15.59:0/2291426371 >> v2:172.21.15.59:3300/0 conn(0x7f34a41316c0 0x7f34a4131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7f34a96d4700 1 -- 172.21.15.59:0/2291426371 >> 172.21.15.59:0/2291426371 conn(0x7f34a4066f50 msgr2=0x7f34a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:47.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.019+0000 7f34a96d4700 1 -- 172.21.15.59:0/2291426371 shutdown_connections 2023-09-30T22:29:47.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.019+0000 7f34a96d4700 1 -- 172.21.15.59:0/2291426371 wait complete. 2023-09-30T22:29:47.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.018+0000 7fa8c1256700 1 -- 172.21.15.59:0/743835916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8bc06b080 msgr2=0x7fa8bc1c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:47.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.019+0000 7fa8c1256700 1 --2- 172.21.15.59:0/743835916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8bc06b080 0x7fa8bc1c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.019+0000 7fa8c1256700 1 -- 172.21.15.59:0/743835916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8bc06a770 msgr2=0x7fa8bc1c8250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:47.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.019+0000 7fa8c1256700 1 --2- 172.21.15.59:0/743835916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8bc06a770 0x7fa8bc1c8250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.019+0000 7fa8c1256700 1 -- 172.21.15.59:0/743835916 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b0009550 con 0x7fa8bc131b40 2023-09-30T22:29:47.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.019+0000 7fa8c1256700 1 --2- 172.21.15.59:0/743835916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8bc131b40 0x7fa8bc1c8cd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400efc0 tx=0x7fa8b400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:47.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.019+0000 7fa8b97fa700 1 -- 172.21.15.59:0/743835916 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4009ea0 con 0x7fa8bc131b40 2023-09-30T22:29:47.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.019+0000 7fa8b97fa700 1 -- 172.21.15.59:0/743835916 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b400f040 con 0x7fa8bc131b40 2023-09-30T22:29:47.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.019+0000 7fa8b97fa700 1 -- 172.21.15.59:0/743835916 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4014480 con 0x7fa8bc131b40 2023-09-30T22:29:47.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.020+0000 7f34a96d4700 1 Processor -- start 2023-09-30T22:29:47.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.020+0000 7f34a96d4700 1 -- start start 2023-09-30T22:29:47.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.019+0000 7fa8c2cb9700 1 -- 172.21.15.59:0/743835916 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8bc1bc2b0 con 0x7fa8bc131b40 2023-09-30T22:29:47.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.019+0000 7fa8c2cb9700 1 -- 172.21.15.59:0/743835916 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8bc11f020 con 0x7fa8bc131b40 2023-09-30T22:29:47.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.020+0000 7fa8c2cb9700 1 -- 172.21.15.59:0/743835916 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8bc1205a0 con 0x7fa8bc131b40 2023-09-30T22:29:47.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.020+0000 7f34a96d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a406ae80 0x7f34a413e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:47.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.020+0000 7f34a96d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34a409d9f0 0x7f34a413aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:47.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.020+0000 7f34a96d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a41316c0 0x7f34a413af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:47.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.020+0000 7f34a96d4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a413a600 con 0x7f34a41316c0 2023-09-30T22:29:47.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.020+0000 7f34a96d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a413dc00 con 0x7f34a406ae80 2023-09-30T22:29:47.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.020+0000 7f34a96d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34a413c090 con 0x7f34a409d9f0 2023-09-30T22:29:47.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.021+0000 7f34a27fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34a409d9f0 0x7f34a413aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:47.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.021+0000 7f34a27fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34a409d9f0 0x7f34a413aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42892/0 (socket says 172.21.15.59:42892) 2023-09-30T22:29:47.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.021+0000 7f34a27fc700 1 -- 172.21.15.59:0/3843131420 learned_addr learned my addr 172.21.15.59:0/3843131420 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:47.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.021+0000 7fa8b97fa700 1 -- 172.21.15.59:0/743835916 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa8b40145e0 con 0x7fa8bc131b40 2023-09-30T22:29:47.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.022+0000 7fa8b97fa700 1 -- 172.21.15.59:0/743835916 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa8b4040be0 con 0x7fa8bc131b40 2023-09-30T22:29:47.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.022+0000 7fa8c0a55700 1 -- 172.21.15.59:0/743835916 >> v1:172.21.15.59:6816/126772 conn(0x7fa8a002f510 legacy=0x7fa8a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:47.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.021+0000 7f34a2ffd700 1 --2- 172.21.15.59:0/3843131420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a406ae80 0x7f34a413e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:47.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.021+0000 7f34a27fc700 1 -- 172.21.15.59:0/3843131420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a406ae80 msgr2=0x7f34a413e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:47.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.021+0000 7f34a27fc700 1 --2- 172.21.15.59:0/3843131420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a406ae80 0x7f34a413e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.021+0000 7f34a27fc700 1 -- 172.21.15.59:0/3843131420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a41316c0 msgr2=0x7f34a413af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:47.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.021+0000 7f34a27fc700 1 --2- 172.21.15.59:0/3843131420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a41316c0 0x7f34a413af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.021+0000 7f34a27fc700 1 -- 172.21.15.59:0/3843131420 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c009b30 con 0x7f34a409d9f0 2023-09-30T22:29:47.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.022+0000 7f34a27fc700 1 --2- 172.21.15.59:0/3843131420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34a409d9f0 0x7f34a413aa50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f349800c4a0 tx=0x7f349800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:47.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.022+0000 7f348b7fe700 1 -- 172.21.15.59:0/3843131420 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34980054e0 con 0x7f34a409d9f0 2023-09-30T22:29:47.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.022+0000 7f348b7fe700 1 -- 172.21.15.59:0/3843131420 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3498003680 con 0x7f34a409d9f0 2023-09-30T22:29:47.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.022+0000 7f348b7fe700 1 -- 172.21.15.59:0/3843131420 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498003a30 con 0x7f34a409d9f0 2023-09-30T22:29:47.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.022+0000 7f34a96d4700 1 -- 172.21.15.59:0/3843131420 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a412b900 con 0x7f34a409d9f0 2023-09-30T22:29:47.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.022+0000 7f34a96d4700 1 -- 172.21.15.59:0/3843131420 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a413e690 con 0x7f34a409d9f0 2023-09-30T22:29:47.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.023+0000 7f34a96d4700 1 -- 172.21.15.59:0/3843131420 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a4074ea0 con 0x7f34a409d9f0 2023-09-30T22:29:47.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.024+0000 7f348b7fe700 1 -- 172.21.15.59:0/3843131420 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3498003b90 con 0x7f34a409d9f0 2023-09-30T22:29:47.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.024+0000 7f348b7fe700 1 -- 172.21.15.59:0/3843131420 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f349803f0f0 con 0x7f34a409d9f0 2023-09-30T22:29:47.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.024+0000 7f34a2ffd700 1 -- 172.21.15.59:0/3843131420 >> v1:172.21.15.59:6816/126772 conn(0x7f349002f590 legacy=0x7f3490031a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:47.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.027+0000 7fa8b97fa700 1 -- 172.21.15.59:0/743835916 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8b4012730 con 0x7fa8bc131b40 2023-09-30T22:29:47.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.034+0000 7f348b7fe700 1 -- 172.21.15.59:0/3843131420 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3498003e40 con 0x7f34a409d9f0 2023-09-30T22:29:47.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.134+0000 7f0c3b7fe700 1 -- 172.21.15.59:0/3686954461 >> v1:172.21.15.59:6816/126772 conn(0x7f0c2802f510 legacy=0x7f0c280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:47.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.172+0000 7f0c41bec700 1 -- 172.21.15.59:0/3686954461 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0c3c074ea0 con 0x7f0c3c09e410 2023-09-30T22:29:47.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.172+0000 7f0c23fff700 1 -- 172.21.15.59:0/3686954461 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c34027020 con 0x7f0c3c09e410 2023-09-30T22:29:47.173 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.175+0000 7f0c41bec700 1 -- 172.21.15.59:0/3686954461 >> v1:172.21.15.59:6816/126772 conn(0x7f0c2802f510 legacy=0x7f0c280319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.175+0000 7f0c41bec700 1 -- 172.21.15.59:0/3686954461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c3c09e410 msgr2=0x7f0c3c11ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.175+0000 7f0c41bec700 1 --2- 172.21.15.59:0/3686954461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c3c09e410 0x7f0c3c11ec30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0c34018000 tx=0x7f0c34004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.176+0000 7f0c41bec700 1 -- 172.21.15.59:0/3686954461 shutdown_connections 2023-09-30T22:29:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.176+0000 7f0c41bec700 1 --2- 172.21.15.59:0/3686954461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c3c09e410 0x7f0c3c11ec30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.176+0000 7f0c41bec700 1 --2- 172.21.15.59:0/3686954461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c3c09d6f0 0x7f0c3c11e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.176+0000 7f0c41bec700 1 --2- 172.21.15.59:0/3686954461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c3c09e000 0x7f0c3c11e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.176+0000 7f0c41bec700 1 -- 172.21.15.59:0/3686954461 >> 172.21.15.59:0/3686954461 conn(0x7f0c3c066f50 msgr2=0x7f0c3c06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.176+0000 7f0c41bec700 1 -- 172.21.15.59:0/3686954461 shutdown_connections 2023-09-30T22:29:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.176+0000 7f0c41bec700 1 -- 172.21.15.59:0/3686954461 wait complete. 2023-09-30T22:29:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.179+0000 7f0da27fc700 1 -- 172.21.15.59:0/2111336367 >> v1:172.21.15.59:6816/126772 conn(0x7f0d8c02f510 legacy=0x7f0d8c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.192+0000 7f0db149d700 1 -- 172.21.15.59:0/2111336367 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0dac074ea0 con 0x7f0dac09d6f0 2023-09-30T22:29:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.193+0000 7f0da3fff700 1 -- 172.21.15.59:0/2111336367 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d9c020030 con 0x7f0dac09d6f0 2023-09-30T22:29:47.194 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:47.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:47.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.195+0000 7f0db149d700 1 -- 172.21.15.59:0/2111336367 >> v1:172.21.15.59:6816/126772 conn(0x7f0d8c02f510 legacy=0x7f0d8c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:47.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.195+0000 7f0db149d700 1 -- 172.21.15.59:0/2111336367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dac09d6f0 msgr2=0x7f0dac11e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:47.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.195+0000 7f0db149d700 1 --2- 172.21.15.59:0/2111336367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dac09d6f0 0x7f0dac11e1f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00ebb0 tx=0x7f0d9c00eec0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.195+0000 7f0db149d700 1 -- 172.21.15.59:0/2111336367 shutdown_connections 2023-09-30T22:29:47.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.195+0000 7f0db149d700 1 --2- 172.21.15.59:0/2111336367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dac09e410 0x7f0dac11ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.195+0000 7f0db149d700 1 --2- 172.21.15.59:0/2111336367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dac09d6f0 0x7f0dac11e1f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.195+0000 7f0db149d700 1 --2- 172.21.15.59:0/2111336367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dac09e000 0x7f0dac11e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.195+0000 7f0db149d700 1 -- 172.21.15.59:0/2111336367 >> 172.21.15.59:0/2111336367 conn(0x7f0dac066f50 msgr2=0x7f0dac06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:47.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.195+0000 7f0db149d700 1 -- 172.21.15.59:0/2111336367 shutdown_connections 2023-09-30T22:29:47.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.195+0000 7f0db149d700 1 -- 172.21.15.59:0/2111336367 wait complete. 2023-09-30T22:29:47.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:47.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.223+0000 7fa8c0a55700 1 -- 172.21.15.59:0/743835916 >> v1:172.21.15.59:6816/126772 conn(0x7fa8a002f510 legacy=0x7fa8a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:47.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.225+0000 7f34a2ffd700 1 -- 172.21.15.59:0/3843131420 >> v1:172.21.15.59:6816/126772 conn(0x7f349002f590 legacy=0x7f3490031a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:47.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.287+0000 7f34a96d4700 1 -- 172.21.15.59:0/3843131420 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f34a406c360 con 0x7f34a409d9f0 2023-09-30T22:29:47.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.287+0000 7f348b7fe700 1 -- 172.21.15.59:0/3843131420 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3498019730 con 0x7f34a409d9f0 2023-09-30T22:29:47.289 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:47.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.288+0000 7fa8c2cb9700 1 -- 172.21.15.59:0/743835916 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa8bc1200e0 con 0x7fa8bc131b40 2023-09-30T22:29:47.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.288+0000 7fa8b97fa700 1 -- 172.21.15.59:0/743835916 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8bc1200e0 con 0x7fa8bc131b40 2023-09-30T22:29:47.289 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:47.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.289+0000 7f34a96d4700 1 -- 172.21.15.59:0/3843131420 >> v1:172.21.15.59:6816/126772 conn(0x7f349002f590 legacy=0x7f3490031a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:47.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.289+0000 7f34a96d4700 1 -- 172.21.15.59:0/3843131420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34a409d9f0 msgr2=0x7f34a413aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:47.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.289+0000 7f34a96d4700 1 --2- 172.21.15.59:0/3843131420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34a409d9f0 0x7f34a413aa50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f349800c4a0 tx=0x7f349800c7b0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.290+0000 7f34a96d4700 1 -- 172.21.15.59:0/3843131420 shutdown_connections 2023-09-30T22:29:47.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.290+0000 7f34a96d4700 1 --2- 172.21.15.59:0/3843131420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a41316c0 0x7f34a413af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.290+0000 7f34a96d4700 1 --2- 172.21.15.59:0/3843131420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a406ae80 0x7f34a413e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.290+0000 7f34a96d4700 1 --2- 172.21.15.59:0/3843131420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34a409d9f0 0x7f34a413aa50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.290+0000 7f34a96d4700 1 -- 172.21.15.59:0/3843131420 >> 172.21.15.59:0/3843131420 conn(0x7f34a4066f50 msgr2=0x7f34a40a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:47.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.290+0000 7f34a96d4700 1 -- 172.21.15.59:0/3843131420 shutdown_connections 2023-09-30T22:29:47.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.290+0000 7f34a96d4700 1 -- 172.21.15.59:0/3843131420 wait complete. 2023-09-30T22:29:47.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.291+0000 7fa8c2cb9700 1 -- 172.21.15.59:0/743835916 >> v1:172.21.15.59:6816/126772 conn(0x7fa8a002f510 legacy=0x7fa8a00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:47.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.291+0000 7fa8c2cb9700 1 -- 172.21.15.59:0/743835916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8bc131b40 msgr2=0x7fa8bc1c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.291+0000 7fa8c2cb9700 1 --2- 172.21.15.59:0/743835916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8bc131b40 0x7fa8bc1c8cd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400efc0 tx=0x7fa8b400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.291+0000 7fa8c2cb9700 1 -- 172.21.15.59:0/743835916 shutdown_connections 2023-09-30T22:29:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.291+0000 7fa8c2cb9700 1 --2- 172.21.15.59:0/743835916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8bc131b40 0x7fa8bc1c8cd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.291+0000 7fa8c2cb9700 1 --2- 172.21.15.59:0/743835916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8bc06a770 0x7fa8bc1c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.291+0000 7fa8c2cb9700 1 --2- 172.21.15.59:0/743835916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8bc06b080 0x7fa8bc1c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.291+0000 7fa8c2cb9700 1 -- 172.21.15.59:0/743835916 >> 172.21.15.59:0/743835916 conn(0x7fa8bc066f50 msgr2=0x7fa8bc0708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.291+0000 7fa8c2cb9700 1 -- 172.21.15.59:0/743835916 shutdown_connections 2023-09-30T22:29:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:47.291+0000 7fa8c2cb9700 1 -- 172.21.15.59:0/743835916 wait complete. 2023-09-30T22:29:47.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:47.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:48.198 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:48.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:48.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:48.308 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:48.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.362+0000 7f2da9046700 1 Processor -- start 2023-09-30T22:29:48.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.362+0000 7f2da9046700 1 -- start start 2023-09-30T22:29:48.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.363+0000 7f2da9046700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2da406a770 0x7f2da409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.363+0000 7f2da9046700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2da409dc30 0x7f2da409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.363+0000 7f2da9046700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da409a810 con 0x7f2da413c1e0 2023-09-30T22:29:48.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.363+0000 7f2da9046700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da406ab40 con 0x7f2da409dc30 2023-09-30T22:29:48.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.363+0000 7f2da9046700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2da409ebc0 con 0x7f2da406a770 2023-09-30T22:29:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.363+0000 7f2da2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2da406a770 0x7f2da409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.363+0000 7f2da359e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2da413c1e0 0x7f2da413e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33906/0 (socket says 172.21.15.59:33906) 2023-09-30T22:29:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.363+0000 7f2da359e700 1 -- 172.21.15.59:0/2330112219 learned_addr learned my addr 172.21.15.59:0/2330112219 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.363+0000 7f2da259c700 1 --2- 172.21.15.59:0/2330112219 >> v2:172.21.15.59:3300/0 conn(0x7f2da409dc30 0x7f2da409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.364+0000 7f2da2d9d700 1 -- 172.21.15.59:0/2330112219 >> v2:172.21.15.59:3300/0 conn(0x7f2da409dc30 msgr2=0x7f2da409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.364+0000 7f2da2d9d700 1 --2- 172.21.15.59:0/2330112219 >> v2:172.21.15.59:3300/0 conn(0x7f2da409dc30 0x7f2da409e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.364+0000 7f2da2d9d700 1 -- 172.21.15.59:0/2330112219 >> v1:172.21.15.59:6789/0 conn(0x7f2da413c1e0 legacy=0x7f2da413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.364+0000 7f2da2d9d700 1 -- 172.21.15.59:0/2330112219 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da409e920 con 0x7f2da406a770 2023-09-30T22:29:48.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.364+0000 7f2da1d9b700 1 -- 172.21.15.59:0/2330112219 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465740737 0 0) 0x7f2da409a810 con 0x7f2da413c1e0 2023-09-30T22:29:48.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.364+0000 7f2da2d9d700 1 --2- 172.21.15.59:0/2330112219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2da406a770 0x7f2da409d6f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009870 tx=0x7f2d94009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7341fbe014f82d38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.364+0000 7f2da1d9b700 1 -- 172.21.15.59:0/2330112219 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d94011830 con 0x7f2da406a770 2023-09-30T22:29:48.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.364+0000 7f2da1d9b700 1 -- 172.21.15.59:0/2330112219 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d94011990 con 0x7f2da406a770 2023-09-30T22:29:48.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.364+0000 7f2da1d9b700 1 -- 172.21.15.59:0/2330112219 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d94011d20 con 0x7f2da406a770 2023-09-30T22:29:48.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.365+0000 7f2da9046700 1 -- 172.21.15.59:0/2330112219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2da406a770 msgr2=0x7f2da409d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.365+0000 7f2da9046700 1 --2- 172.21.15.59:0/2330112219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2da406a770 0x7f2da409d6f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009870 tx=0x7f2d94009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:48.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.365+0000 7f2da9046700 1 -- 172.21.15.59:0/2330112219 shutdown_connections 2023-09-30T22:29:48.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.365+0000 7f2da9046700 1 --2- 172.21.15.59:0/2330112219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2da406a770 0x7f2da409d6f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.365+0000 7f2da9046700 1 --2- 172.21.15.59:0/2330112219 >> v2:172.21.15.59:3300/0 conn(0x7f2da409dc30 0x7f2da409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.365+0000 7f2da9046700 1 -- 172.21.15.59:0/2330112219 >> 172.21.15.59:0/2330112219 conn(0x7f2da4066f50 msgr2=0x7f2da409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.365+0000 7f2da9046700 1 -- 172.21.15.59:0/2330112219 shutdown_connections 2023-09-30T22:29:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.365+0000 7f2da9046700 1 -- 172.21.15.59:0/2330112219 wait complete. 2023-09-30T22:29:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.367+0000 7f2da9046700 1 Processor -- start 2023-09-30T22:29:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.367+0000 7f2da9046700 1 -- start start 2023-09-30T22:29:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.368+0000 7f2da9046700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2da406a770 0x7f2da413af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.368+0000 7f2da9046700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2da409dc30 0x7f2da413b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.368+0000 7f2da9046700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2da413c1e0 0x7f2da4127120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.368+0000 7f2da9046700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da4128d30 con 0x7f2da413c1e0 2023-09-30T22:29:48.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.368+0000 7f2da9046700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da40a1a90 con 0x7f2da406a770 2023-09-30T22:29:48.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.368+0000 7f2da9046700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2da412ae60 con 0x7f2da409dc30 2023-09-30T22:29:48.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.368+0000 7f2da2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2da406a770 0x7f2da413af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.368+0000 7f2da259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2da409dc30 0x7f2da413b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.368+0000 7f2da2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2da406a770 0x7f2da413af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53976/0 (socket says 172.21.15.59:53976) 2023-09-30T22:29:48.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.368+0000 7f2da2d9d700 1 -- 172.21.15.59:0/3551935788 learned_addr learned my addr 172.21.15.59:0/3551935788 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:48.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.368+0000 7f2da359e700 1 --2- 172.21.15.59:0/3551935788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2da413c1e0 0x7f2da4127120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.369+0000 7f2da259c700 1 -- 172.21.15.59:0/3551935788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2da406a770 msgr2=0x7f2da413af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.369+0000 7f2da259c700 1 --2- 172.21.15.59:0/3551935788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2da406a770 0x7f2da413af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.369+0000 7f2da259c700 1 -- 172.21.15.59:0/3551935788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2da413c1e0 msgr2=0x7f2da4127120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.369+0000 7f2da259c700 1 --2- 172.21.15.59:0/3551935788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2da413c1e0 0x7f2da4127120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.369+0000 7f2da259c700 1 -- 172.21.15.59:0/3551935788 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d940094a0 con 0x7f2da409dc30 2023-09-30T22:29:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.369+0000 7f2da2d9d700 1 --2- 172.21.15.59:0/3551935788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2da406a770 0x7f2da413af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.369+0000 7f2da259c700 1 --2- 172.21.15.59:0/3551935788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2da409dc30 0x7f2da413b460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800e8d0 tx=0x7f2d9800ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.369+0000 7f2d8b7fe700 1 -- 172.21.15.59:0/3551935788 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98013680 con 0x7f2da409dc30 2023-09-30T22:29:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.369+0000 7f2d8b7fe700 1 -- 172.21.15.59:0/3551935788 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d980137e0 con 0x7f2da409dc30 2023-09-30T22:29:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.369+0000 7f2da9046700 1 -- 172.21.15.59:0/3551935788 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da412a960 con 0x7f2da409dc30 2023-09-30T22:29:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.369+0000 7f2d8b7fe700 1 -- 172.21.15.59:0/3551935788 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98013b50 con 0x7f2da409dc30 2023-09-30T22:29:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.369+0000 7f2da9046700 1 -- 172.21.15.59:0/3551935788 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da4129330 con 0x7f2da409dc30 2023-09-30T22:29:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.371+0000 7f2d8b7fe700 1 -- 172.21.15.59:0/3551935788 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2d98013cb0 con 0x7f2da409dc30 2023-09-30T22:29:48.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.371+0000 7f2d8b7fe700 1 -- 172.21.15.59:0/3551935788 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f2d9803ff40 con 0x7f2da409dc30 2023-09-30T22:29:48.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.371+0000 7f2da2d9d700 1 -- 172.21.15.59:0/3551935788 >> v1:172.21.15.59:6816/126772 conn(0x7f2d9002f510 legacy=0x7f2d900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:48.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.371+0000 7f2da9046700 1 -- 172.21.15.59:0/3551935788 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da4074ea0 con 0x7f2da409dc30 2023-09-30T22:29:48.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.380+0000 7f2d8b7fe700 1 -- 172.21.15.59:0/3551935788 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d98017080 con 0x7f2da409dc30 2023-09-30T22:29:48.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.405+0000 7fd10c08f700 1 Processor -- start 2023-09-30T22:29:48.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.406+0000 7fd10c08f700 1 -- start start 2023-09-30T22:29:48.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.406+0000 7fd10c08f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd10409e930 0x7fd10409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.406+0000 7fd10c08f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd10409f650 0x7fd104131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.406+0000 7fd10c08f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd104070940 con 0x7fd10409f240 2023-09-30T22:29:48.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.406+0000 7fd10c08f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10406fd60 con 0x7fd10409f650 2023-09-30T22:29:48.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.406+0000 7fd10c08f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10406fa80 con 0x7fd10409e930 2023-09-30T22:29:48.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.407+0000 7fd10962a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd10409f240 0x7fd1041317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33914/0 (socket says 172.21.15.59:33914) 2023-09-30T22:29:48.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.407+0000 7fd10962a700 1 -- 172.21.15.59:0/1987556313 learned_addr learned my addr 172.21.15.59:0/1987556313 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:48.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.407+0000 7fd109e2b700 1 --2- 172.21.15.59:0/1987556313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd10409e930 0x7fd10409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.407+0000 7fd10a62c700 1 --2- 172.21.15.59:0/1987556313 >> v2:172.21.15.59:3300/0 conn(0x7fd10409f650 0x7fd104131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.407+0000 7fd109e2b700 1 -- 172.21.15.59:0/1987556313 >> v2:172.21.15.59:3300/0 conn(0x7fd10409f650 msgr2=0x7fd104131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:48.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.407+0000 7fd109e2b700 1 --2- 172.21.15.59:0/1987556313 >> v2:172.21.15.59:3300/0 conn(0x7fd10409f650 0x7fd104131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.407+0000 7fd109e2b700 1 -- 172.21.15.59:0/1987556313 >> v1:172.21.15.59:6789/0 conn(0x7fd10409f240 legacy=0x7fd1041317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.407+0000 7fd109e2b700 1 -- 172.21.15.59:0/1987556313 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10409fb60 con 0x7fd10409e930 2023-09-30T22:29:48.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.407+0000 7fd109e2b700 1 --2- 172.21.15.59:0/1987556313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd10409e930 0x7fd10409ed00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd100009840 tx=0x7fd100009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8b48905a6512cec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.408+0000 7fd108e29700 1 -- 172.21.15.59:0/1987556313 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100011830 con 0x7fd10409e930 2023-09-30T22:29:48.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.408+0000 7fd108e29700 1 -- 172.21.15.59:0/1987556313 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd100011990 con 0x7fd10409e930 2023-09-30T22:29:48.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.408+0000 7fd108e29700 1 -- 172.21.15.59:0/1987556313 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100011d20 con 0x7fd10409e930 2023-09-30T22:29:48.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.409+0000 7fd10c08f700 1 -- 172.21.15.59:0/1987556313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd10409e930 msgr2=0x7fd10409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.409+0000 7fd10c08f700 1 --2- 172.21.15.59:0/1987556313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd10409e930 0x7fd10409ed00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd100009840 tx=0x7fd100009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:48.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.409+0000 7fd10c08f700 1 -- 172.21.15.59:0/1987556313 shutdown_connections 2023-09-30T22:29:48.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.409+0000 7fd10c08f700 1 --2- 172.21.15.59:0/1987556313 >> v2:172.21.15.59:3300/0 conn(0x7fd10409f650 0x7fd104131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.409+0000 7fd10c08f700 1 --2- 172.21.15.59:0/1987556313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd10409e930 0x7fd10409ed00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.409+0000 7fd10c08f700 1 -- 172.21.15.59:0/1987556313 >> 172.21.15.59:0/1987556313 conn(0x7fd1040a4210 msgr2=0x7fd1040a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.409+0000 7fd10c08f700 1 -- 172.21.15.59:0/1987556313 shutdown_connections 2023-09-30T22:29:48.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.409+0000 7fd10c08f700 1 -- 172.21.15.59:0/1987556313 wait complete. 2023-09-30T22:29:48.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.410+0000 7fd10c08f700 1 Processor -- start 2023-09-30T22:29:48.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.411+0000 7fd10c08f700 1 -- start start 2023-09-30T22:29:48.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.411+0000 7fd10c08f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd10409e930 0x7fd1041a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.411+0000 7fd10c08f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd10409f240 0x7fd1041a41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.411+0000 7fd10c08f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd10409f650 0x7fd1041a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.411+0000 7fd10c08f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1041a7430 con 0x7fd10409f650 2023-09-30T22:29:48.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.411+0000 7fd10c08f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1041a5910 con 0x7fd10409e930 2023-09-30T22:29:48.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.411+0000 7fd10c08f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040a35a0 con 0x7fd10409f240 2023-09-30T22:29:48.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.411+0000 7fd109e2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd10409e930 0x7fd1041a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.411+0000 7fd109e2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd10409e930 0x7fd1041a3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54000/0 (socket says 172.21.15.59:54000) 2023-09-30T22:29:48.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.411+0000 7fd109e2b700 1 -- 172.21.15.59:0/3766528840 learned_addr learned my addr 172.21.15.59:0/3766528840 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:48.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.412+0000 7fd10a62c700 1 --2- 172.21.15.59:0/3766528840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd10409f650 0x7fd1041a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.412+0000 7fd10962a700 1 --2- 172.21.15.59:0/3766528840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd10409f240 0x7fd1041a41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.412+0000 7fd109e2b700 1 -- 172.21.15.59:0/3766528840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd10409f240 msgr2=0x7fd1041a41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.412+0000 7fd109e2b700 1 --2- 172.21.15.59:0/3766528840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd10409f240 0x7fd1041a41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.412+0000 7fd109e2b700 1 -- 172.21.15.59:0/3766528840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd10409f650 msgr2=0x7fd1041a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.412+0000 7fd109e2b700 1 --2- 172.21.15.59:0/3766528840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd10409f650 0x7fd1041a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.412+0000 7fd109e2b700 1 -- 172.21.15.59:0/3766528840 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1000094a0 con 0x7fd10409e930 2023-09-30T22:29:48.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.412+0000 7fd10962a700 1 --2- 172.21.15.59:0/3766528840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd10409f240 0x7fd1041a41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:48.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.412+0000 7fd109e2b700 1 --2- 172.21.15.59:0/3766528840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd10409e930 0x7fd1041a3c90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd100009fd0 tx=0x7fd100004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.412+0000 7fd0fa7fc700 1 -- 172.21.15.59:0/3766528840 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000036a0 con 0x7fd10409e930 2023-09-30T22:29:48.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.412+0000 7fd0fa7fc700 1 -- 172.21.15.59:0/3766528840 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10001f070 con 0x7fd10409e930 2023-09-30T22:29:48.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.412+0000 7fd0fa7fc700 1 -- 172.21.15.59:0/3766528840 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100003a60 con 0x7fd10409e930 2023-09-30T22:29:48.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.412+0000 7fd10c08f700 1 -- 172.21.15.59:0/3766528840 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1040a0190 con 0x7fd10409e930 2023-09-30T22:29:48.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.412+0000 7fd10c08f700 1 -- 172.21.15.59:0/3766528840 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1041a6a50 con 0x7fd10409e930 2023-09-30T22:29:48.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.414+0000 7fd10c08f700 1 -- 172.21.15.59:0/3766528840 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1041a0b30 con 0x7fd10409e930 2023-09-30T22:29:48.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.414+0000 7fd0fa7fc700 1 -- 172.21.15.59:0/3766528840 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd100003bc0 con 0x7fd10409e930 2023-09-30T22:29:48.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.414+0000 7fd0fa7fc700 1 -- 172.21.15.59:0/3766528840 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fd100021070 con 0x7fd10409e930 2023-09-30T22:29:48.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.417+0000 7fd10962a700 1 -- 172.21.15.59:0/3766528840 >> v1:172.21.15.59:6816/126772 conn(0x7fd0e802f510 legacy=0x7fd0e80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:48.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.423+0000 7fd0fa7fc700 1 -- 172.21.15.59:0/3766528840 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd100046060 con 0x7fd10409e930 2023-09-30T22:29:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.459+0000 7f6e029a8700 1 Processor -- start 2023-09-30T22:29:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.460+0000 7f6e029a8700 1 -- start start 2023-09-30T22:29:48.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.460+0000 7f6e029a8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6dfc06a770 0x7f6dfc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.460+0000 7f6e029a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dfc06b080 0x7f6dfc131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.460+0000 7f6e029a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dfc131b40 0x7f6dfc131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.460+0000 7f6e029a8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dfc09ece0 con 0x7f6dfc06a770 2023-09-30T22:29:48.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.460+0000 7f6e029a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc09e760 con 0x7f6dfc131b40 2023-09-30T22:29:48.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.460+0000 7f6e029a8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc09e040 con 0x7f6dfc06b080 2023-09-30T22:29:48.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.461+0000 7f6dfb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dfc06b080 0x7f6dfc131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.461+0000 7f6dfb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dfc06b080 0x7f6dfc131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42922/0 (socket says 172.21.15.59:42922) 2023-09-30T22:29:48.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.461+0000 7f6dfb7fe700 1 -- 172.21.15.59:0/3437451847 learned_addr learned my addr 172.21.15.59:0/3437451847 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:48.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.461+0000 7f6e00f45700 1 --2- 172.21.15.59:0/3437451847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dfc131b40 0x7f6dfc131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.461+0000 7f6dfb7fe700 1 -- 172.21.15.59:0/3437451847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dfc131b40 msgr2=0x7f6dfc131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.461+0000 7f6dfb7fe700 1 --2- 172.21.15.59:0/3437451847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dfc131b40 0x7f6dfc131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.461+0000 7f6dfb7fe700 1 -- 172.21.15.59:0/3437451847 >> v2:172.21.15.59:3300/0 conn(0x7f6dfc06a770 msgr2=0x7f6dfc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.461+0000 7f6dfb7fe700 1 --2- 172.21.15.59:0/3437451847 >> v2:172.21.15.59:3300/0 conn(0x7f6dfc06a770 0x7f6dfc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.461+0000 7f6dfb7fe700 1 -- 172.21.15.59:0/3437451847 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc09f630 con 0x7f6dfc06b080 2023-09-30T22:29:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.461+0000 7f6dfb7fe700 1 --2- 172.21.15.59:0/3437451847 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dfc06b080 0x7f6dfc131600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6df00098f0 tx=0x7f6df0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93b76d8f90187d0b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.462+0000 7f6dfaffd700 1 -- 172.21.15.59:0/3437451847 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df0011830 con 0x7f6dfc06b080 2023-09-30T22:29:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.462+0000 7f6dfaffd700 1 -- 172.21.15.59:0/3437451847 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df0011990 con 0x7f6dfc06b080 2023-09-30T22:29:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.462+0000 7f6dfaffd700 1 -- 172.21.15.59:0/3437451847 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df0011d20 con 0x7f6dfc06b080 2023-09-30T22:29:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.463+0000 7f6e029a8700 1 -- 172.21.15.59:0/3437451847 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dfc06b080 msgr2=0x7f6dfc131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.463+0000 7f6e029a8700 1 --2- 172.21.15.59:0/3437451847 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dfc06b080 0x7f6dfc131600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6df00098f0 tx=0x7f6df0009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.463+0000 7f6e029a8700 1 -- 172.21.15.59:0/3437451847 shutdown_connections 2023-09-30T22:29:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.463+0000 7f6e029a8700 1 --2- 172.21.15.59:0/3437451847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dfc131b40 0x7f6dfc131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.463+0000 7f6e029a8700 1 --2- 172.21.15.59:0/3437451847 >> v2:172.21.15.59:3300/0 conn(0x7f6dfc06a770 0x7f6dfc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.463+0000 7f6e029a8700 1 --2- 172.21.15.59:0/3437451847 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dfc06b080 0x7f6dfc131600 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.463+0000 7f6e029a8700 1 -- 172.21.15.59:0/3437451847 >> 172.21.15.59:0/3437451847 conn(0x7f6dfc066f50 msgr2=0x7f6dfc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.463+0000 7f6e029a8700 1 -- 172.21.15.59:0/3437451847 shutdown_connections 2023-09-30T22:29:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.463+0000 7f6e029a8700 1 -- 172.21.15.59:0/3437451847 wait complete. 2023-09-30T22:29:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.464+0000 7fadcc5bf700 1 Processor -- start 2023-09-30T22:29:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.464+0000 7fadcc5bf700 1 -- start start 2023-09-30T22:29:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.464+0000 7fadcc5bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadc409d6f0 0x7fadc409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.464+0000 7fadcc5bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc409e000 0x7fadc4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.464+0000 7fadcc5bf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc409f130 con 0x7fadc409e410 2023-09-30T22:29:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.464+0000 7fadcc5bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc409f520 con 0x7fadc409e000 2023-09-30T22:29:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.464+0000 7fadcc5bf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadc409e930 con 0x7fadc409d6f0 2023-09-30T22:29:48.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.465+0000 7fadcab5c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fadc409e410 0x7fadc4130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33930/0 (socket says 172.21.15.59:33930) 2023-09-30T22:29:48.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.465+0000 7fadcab5c700 1 -- 172.21.15.59:0/3637227012 learned_addr learned my addr 172.21.15.59:0/3637227012 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:48.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.465+0000 7f6e029a8700 1 Processor -- start 2023-09-30T22:29:48.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.465+0000 7fadca35b700 1 --2- 172.21.15.59:0/3637227012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadc409d6f0 0x7fadc409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.465+0000 7fadc9b5a700 1 --2- 172.21.15.59:0/3637227012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc409e000 0x7fadc4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.465+0000 7f6e029a8700 1 -- start start 2023-09-30T22:29:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.465+0000 7fadca35b700 1 -- 172.21.15.59:0/3637227012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc409e000 msgr2=0x7fadc4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.465+0000 7fadca35b700 1 --2- 172.21.15.59:0/3637227012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc409e000 0x7fadc4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.465+0000 7fadca35b700 1 -- 172.21.15.59:0/3637227012 >> v1:172.21.15.59:6789/0 conn(0x7fadc409e410 legacy=0x7fadc4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.465+0000 7fadca35b700 1 -- 172.21.15.59:0/3637227012 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc409b2d0 con 0x7fadc409d6f0 2023-09-30T22:29:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.465+0000 7fadc9b5a700 1 --2- 172.21.15.59:0/3637227012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc409e000 0x7fadc4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.466+0000 7fadca35b700 1 --2- 172.21.15.59:0/3637227012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadc409d6f0 0x7fadc409dac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fadc00098a0 tx=0x7fadc0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b21657c66962b6be server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.466+0000 7fadc9359700 1 -- 172.21.15.59:0/3637227012 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000f8a0 con 0x7fadc409d6f0 2023-09-30T22:29:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.466+0000 7fadc9359700 1 -- 172.21.15.59:0/3637227012 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc000fa00 con 0x7fadc409d6f0 2023-09-30T22:29:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.466+0000 7fadc9359700 1 -- 172.21.15.59:0/3637227012 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000fd90 con 0x7fadc409d6f0 2023-09-30T22:29:48.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.466+0000 7f6e029a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dfc06a770 0x7f6dfc1211f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.466+0000 7f6e029a8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dfc06b080 0x7f6dfc121730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.466+0000 7f6e029a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dfc131b40 0x7f6dfc1c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.466+0000 7f6e029a8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc120e30 con 0x7f6dfc06b080 2023-09-30T22:29:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.466+0000 7f6e029a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc071e60 con 0x7f6dfc131b40 2023-09-30T22:29:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.466+0000 7f6e029a8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc123b40 con 0x7f6dfc06a770 2023-09-30T22:29:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.466+0000 7f6dfbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dfc06a770 0x7f6dfc1211f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.466+0000 7f6dfbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dfc06a770 0x7f6dfc1211f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42942/0 (socket says 172.21.15.59:42942) 2023-09-30T22:29:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.466+0000 7f6dfbfff700 1 -- 172.21.15.59:0/2299286091 learned_addr learned my addr 172.21.15.59:0/2299286091 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.466+0000 7f6e00f45700 1 --2- 172.21.15.59:0/2299286091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dfc131b40 0x7f6dfc1c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.467+0000 7f6dfb7fe700 1 --2- 172.21.15.59:0/2299286091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dfc06b080 0x7f6dfc121730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.467+0000 7f6dfbfff700 1 -- 172.21.15.59:0/2299286091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dfc131b40 msgr2=0x7f6dfc1c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.467+0000 7f6dfbfff700 1 --2- 172.21.15.59:0/2299286091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dfc131b40 0x7f6dfc1c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.467+0000 7f6dfbfff700 1 -- 172.21.15.59:0/2299286091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dfc06b080 msgr2=0x7f6dfc121730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.467+0000 7f6dfbfff700 1 --2- 172.21.15.59:0/2299286091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dfc06b080 0x7f6dfc121730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.467+0000 7f6dfbfff700 1 -- 172.21.15.59:0/2299286091 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df0009550 con 0x7f6dfc06a770 2023-09-30T22:29:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.467+0000 7f6dfbfff700 1 --2- 172.21.15.59:0/2299286091 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dfc06a770 0x7f6dfc1211f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00b530 tx=0x7f6dec00b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.467+0000 7f6df8ff9700 1 -- 172.21.15.59:0/2299286091 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec011830 con 0x7f6dfc06a770 2023-09-30T22:29:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.467+0000 7f6df8ff9700 1 -- 172.21.15.59:0/2299286091 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec0119b0 con 0x7f6dfc06a770 2023-09-30T22:29:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.467+0000 7f6e029a8700 1 -- 172.21.15.59:0/2299286091 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dfc06ee10 con 0x7f6dfc06a770 2023-09-30T22:29:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.467+0000 7f6df8ff9700 1 -- 172.21.15.59:0/2299286091 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec011d60 con 0x7f6dfc06a770 2023-09-30T22:29:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.467+0000 7f6e029a8700 1 -- 172.21.15.59:0/2299286091 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dfc121c70 con 0x7f6dfc06a770 2023-09-30T22:29:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.467+0000 7fadcc5bf700 1 -- 172.21.15.59:0/3637227012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadc409d6f0 msgr2=0x7fadc409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.467+0000 7fadcc5bf700 1 --2- 172.21.15.59:0/3637227012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadc409d6f0 0x7fadc409dac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fadc00098a0 tx=0x7fadc0009bb0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.467+0000 7f6dfb7fe700 1 --2- 172.21.15.59:0/2299286091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dfc06b080 0x7f6dfc121730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:48.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.468+0000 7fadcc5bf700 1 -- 172.21.15.59:0/3637227012 shutdown_connections 2023-09-30T22:29:48.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.468+0000 7fadcc5bf700 1 --2- 172.21.15.59:0/3637227012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadc409d6f0 0x7fadc409dac0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.468+0000 7fadcc5bf700 1 --2- 172.21.15.59:0/3637227012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc409e000 0x7fadc4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.468+0000 7fadcc5bf700 1 -- 172.21.15.59:0/3637227012 >> 172.21.15.59:0/3637227012 conn(0x7fadc4066f50 msgr2=0x7fadc409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.468+0000 7fadcc5bf700 1 -- 172.21.15.59:0/3637227012 shutdown_connections 2023-09-30T22:29:48.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.468+0000 7fadcc5bf700 1 -- 172.21.15.59:0/3637227012 wait complete. 2023-09-30T22:29:48.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.468+0000 7f6e029a8700 1 -- 172.21.15.59:0/2299286091 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dfc0a0760 con 0x7f6dfc06a770 2023-09-30T22:29:48.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.469+0000 7f6df8ff9700 1 -- 172.21.15.59:0/2299286091 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6dec01a400 con 0x7f6dfc06a770 2023-09-30T22:29:48.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.469+0000 7fadcc5bf700 1 Processor -- start 2023-09-30T22:29:48.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.469+0000 7fadcc5bf700 1 -- start start 2023-09-30T22:29:48.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.469+0000 7f6df8ff9700 1 -- 172.21.15.59:0/2299286091 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f6dec03fce0 con 0x7f6dfc06a770 2023-09-30T22:29:48.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadcc5bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc409d6f0 0x7fadc411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadcc5bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadc409e000 0x7fadc411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadcc5bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadc409e410 0x7fadc411ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadcc5bf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc4121aa0 con 0x7fadc409e000 2023-09-30T22:29:48.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadcc5bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc41201b0 con 0x7fadc409d6f0 2023-09-30T22:29:48.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadcc5bf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadc409c700 con 0x7fadc409e410 2023-09-30T22:29:48.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7f6dfb7fe700 1 -- 172.21.15.59:0/2299286091 >> v1:172.21.15.59:6816/126772 conn(0x7f6de802f510 legacy=0x7f6de80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:48.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadcab5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadc409e410 0x7fadc411ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadcab5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadc409e410 0x7fadc411ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42954/0 (socket says 172.21.15.59:42954) 2023-09-30T22:29:48.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadcab5c700 1 -- 172.21.15.59:0/3838685737 learned_addr learned my addr 172.21.15.59:0/3838685737 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:48.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadc9b5a700 1 --2- 172.21.15.59:0/3838685737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadc409e000 0x7fadc411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadc9b5a700 1 -- 172.21.15.59:0/3838685737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadc409e410 msgr2=0x7fadc411ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadc9b5a700 1 --2- 172.21.15.59:0/3838685737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadc409e410 0x7fadc411ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadc9b5a700 1 -- 172.21.15.59:0/3838685737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc409d6f0 msgr2=0x7fadc411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadc9b5a700 1 --2- 172.21.15.59:0/3838685737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc409d6f0 0x7fadc411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadc9b5a700 1 -- 172.21.15.59:0/3838685737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb40094a0 con 0x7fadc409e000 2023-09-30T22:29:48.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.470+0000 7fadcab5c700 1 --2- 172.21.15.59:0/3838685737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadc409e410 0x7fadc411ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:48.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.471+0000 7fadc9b5a700 1 --2- 172.21.15.59:0/3838685737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadc409e000 0x7fadc411e4c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fadb400e980 tx=0x7fadb400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.474+0000 7fadbaffd700 1 -- 172.21.15.59:0/3838685737 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb400eed0 con 0x7fadc409e000 2023-09-30T22:29:48.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.474+0000 7fadbaffd700 1 -- 172.21.15.59:0/3838685737 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb400c850 con 0x7fadc409e000 2023-09-30T22:29:48.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.474+0000 7fadcc5bf700 1 -- 172.21.15.59:0/3838685737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc00094a0 con 0x7fadc409e000 2023-09-30T22:29:48.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.474+0000 7fadbaffd700 1 -- 172.21.15.59:0/3838685737 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb400cbe0 con 0x7fadc409e000 2023-09-30T22:29:48.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.474+0000 7fadcc5bf700 1 -- 172.21.15.59:0/3838685737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc4130360 con 0x7fadc409e000 2023-09-30T22:29:48.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.474+0000 7f6df8ff9700 1 -- 172.21.15.59:0/2299286091 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6dec00f8d0 con 0x7f6dfc06a770 2023-09-30T22:29:48.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.475+0000 7fadbaffd700 1 -- 172.21.15.59:0/3838685737 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fadb400cd40 con 0x7fadc409e000 2023-09-30T22:29:48.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.476+0000 7fadcc5bf700 1 -- 172.21.15.59:0/3838685737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc4121460 con 0x7fadc409e000 2023-09-30T22:29:48.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.476+0000 7fadbaffd700 1 -- 172.21.15.59:0/3838685737 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fadb4040170 con 0x7fadc409e000 2023-09-30T22:29:48.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.476+0000 7fadca35b700 1 -- 172.21.15.59:0/3838685737 >> v1:172.21.15.59:6816/126772 conn(0x7fada802f510 legacy=0x7fada80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:48.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.481+0000 7fadbaffd700 1 -- 172.21.15.59:0/3838685737 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadc4121460 con 0x7fadc409e000 2023-09-30T22:29:48.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.572+0000 7f2da2d9d700 1 -- 172.21.15.59:0/3551935788 >> v1:172.21.15.59:6816/126772 conn(0x7f2d9002f510 legacy=0x7f2d900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:48.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.598+0000 7f2da9046700 1 -- 172.21.15.59:0/3551935788 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2da409a3d0 con 0x7f2da409dc30 2023-09-30T22:29:48.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.599+0000 7f2d8b7fe700 1 -- 172.21.15.59:0/3551935788 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d9801adc0 con 0x7f2da409dc30 2023-09-30T22:29:48.600 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:48.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.602+0000 7f2da9046700 1 -- 172.21.15.59:0/3551935788 >> v1:172.21.15.59:6816/126772 conn(0x7f2d9002f510 legacy=0x7f2d900319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:48.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.602+0000 7f2da9046700 1 -- 172.21.15.59:0/3551935788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2da409dc30 msgr2=0x7f2da413b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.602+0000 7f2da9046700 1 --2- 172.21.15.59:0/3551935788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2da409dc30 0x7f2da413b460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800e8d0 tx=0x7f2d9800ebe0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.602+0000 7f2da9046700 1 -- 172.21.15.59:0/3551935788 shutdown_connections 2023-09-30T22:29:48.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.602+0000 7f2da9046700 1 --2- 172.21.15.59:0/3551935788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2da413c1e0 0x7f2da4127120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.602+0000 7f2da9046700 1 --2- 172.21.15.59:0/3551935788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2da406a770 0x7f2da413af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.602+0000 7f2da9046700 1 --2- 172.21.15.59:0/3551935788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2da409dc30 0x7f2da413b460 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.602+0000 7f2da9046700 1 -- 172.21.15.59:0/3551935788 >> 172.21.15.59:0/3551935788 conn(0x7f2da4066f50 msgr2=0x7f2da409b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.602+0000 7f2da9046700 1 -- 172.21.15.59:0/3551935788 shutdown_connections 2023-09-30T22:29:48.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.602+0000 7f2da9046700 1 -- 172.21.15.59:0/3551935788 wait complete. 2023-09-30T22:29:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.618+0000 7fd10962a700 1 -- 172.21.15.59:0/3766528840 >> v1:172.21.15.59:6816/126772 conn(0x7fd0e802f510 legacy=0x7fd0e80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:48.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:48.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.645+0000 7fd10c08f700 1 -- 172.21.15.59:0/3766528840 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd104074ea0 con 0x7fd10409e930 2023-09-30T22:29:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.645+0000 7fd0fa7fc700 1 -- 172.21.15.59:0/3766528840 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd100046020 con 0x7fd10409e930 2023-09-30T22:29:48.646 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.647+0000 7fd10c08f700 1 -- 172.21.15.59:0/3766528840 >> v1:172.21.15.59:6816/126772 conn(0x7fd0e802f510 legacy=0x7fd0e80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.647+0000 7fd10c08f700 1 -- 172.21.15.59:0/3766528840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd10409e930 msgr2=0x7fd1041a3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.647+0000 7fd10c08f700 1 --2- 172.21.15.59:0/3766528840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd10409e930 0x7fd1041a3c90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd100009fd0 tx=0x7fd100004750 comp rx=0 tx=0).stop 2023-09-30T22:29:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.647+0000 7fd10c08f700 1 -- 172.21.15.59:0/3766528840 shutdown_connections 2023-09-30T22:29:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.647+0000 7fd10c08f700 1 --2- 172.21.15.59:0/3766528840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd10409f650 0x7fd1041a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.647+0000 7fd10c08f700 1 --2- 172.21.15.59:0/3766528840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd10409e930 0x7fd1041a3c90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.647+0000 7fd10c08f700 1 --2- 172.21.15.59:0/3766528840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd10409f240 0x7fd1041a41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.647+0000 7fd10c08f700 1 -- 172.21.15.59:0/3766528840 >> 172.21.15.59:0/3766528840 conn(0x7fd1040a4210 msgr2=0x7fd1041b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.647+0000 7fd10c08f700 1 -- 172.21.15.59:0/3766528840 shutdown_connections 2023-09-30T22:29:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.648+0000 7fd10c08f700 1 -- 172.21.15.59:0/3766528840 wait complete. 2023-09-30T22:29:48.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.671+0000 7f6dfb7fe700 1 -- 172.21.15.59:0/2299286091 >> v1:172.21.15.59:6816/126772 conn(0x7f6de802f510 legacy=0x7f6de80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:48.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.677+0000 7fadca35b700 1 -- 172.21.15.59:0/3838685737 >> v1:172.21.15.59:6816/126772 conn(0x7fada802f510 legacy=0x7fada80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:48.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.684+0000 7f6e029a8700 1 -- 172.21.15.59:0/2299286091 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6dfc074ea0 con 0x7f6dfc06a770 2023-09-30T22:29:48.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.685+0000 7f6df8ff9700 1 -- 172.21.15.59:0/2299286091 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6dec015030 con 0x7f6dfc06a770 2023-09-30T22:29:48.686 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:48.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.687+0000 7f6e029a8700 1 -- 172.21.15.59:0/2299286091 >> v1:172.21.15.59:6816/126772 conn(0x7f6de802f510 legacy=0x7f6de80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:48.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.687+0000 7f6e029a8700 1 -- 172.21.15.59:0/2299286091 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dfc06a770 msgr2=0x7f6dfc1211f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.687+0000 7f6e029a8700 1 --2- 172.21.15.59:0/2299286091 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dfc06a770 0x7f6dfc1211f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00b530 tx=0x7f6dec00b8f0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.687+0000 7f6e029a8700 1 -- 172.21.15.59:0/2299286091 shutdown_connections 2023-09-30T22:29:48.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.687+0000 7f6e029a8700 1 --2- 172.21.15.59:0/2299286091 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dfc06a770 0x7f6dfc1211f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.687+0000 7f6e029a8700 1 --2- 172.21.15.59:0/2299286091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dfc131b40 0x7f6dfc1c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.687+0000 7f6e029a8700 1 --2- 172.21.15.59:0/2299286091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dfc06b080 0x7f6dfc121730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.687+0000 7f6e029a8700 1 -- 172.21.15.59:0/2299286091 >> 172.21.15.59:0/2299286091 conn(0x7f6dfc066f50 msgr2=0x7f6dfc070150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.687+0000 7f6e029a8700 1 -- 172.21.15.59:0/2299286091 shutdown_connections 2023-09-30T22:29:48.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.687+0000 7f6e029a8700 1 -- 172.21.15.59:0/2299286091 wait complete. 2023-09-30T22:29:48.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.689+0000 7fadcc5bf700 1 -- 172.21.15.59:0/3838685737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fadc4121460 con 0x7fadc409e000 2023-09-30T22:29:48.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.689+0000 7fadbaffd700 1 -- 172.21.15.59:0/3838685737 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadc4121460 con 0x7fadc409e000 2023-09-30T22:29:48.691 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:48.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.692+0000 7fadcc5bf700 1 -- 172.21.15.59:0/3838685737 >> v1:172.21.15.59:6816/126772 conn(0x7fada802f510 legacy=0x7fada80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:48.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.692+0000 7fadcc5bf700 1 -- 172.21.15.59:0/3838685737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadc409e000 msgr2=0x7fadc411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.692+0000 7fadcc5bf700 1 --2- 172.21.15.59:0/3838685737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadc409e000 0x7fadc411e4c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fadb400e980 tx=0x7fadb400ec90 comp rx=0 tx=0).stop 2023-09-30T22:29:48.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.692+0000 7fadcc5bf700 1 -- 172.21.15.59:0/3838685737 shutdown_connections 2023-09-30T22:29:48.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.692+0000 7fadcc5bf700 1 --2- 172.21.15.59:0/3838685737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadc409e410 0x7fadc411ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.692+0000 7fadcc5bf700 1 --2- 172.21.15.59:0/3838685737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc409d6f0 0x7fadc411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.692+0000 7fadcc5bf700 1 --2- 172.21.15.59:0/3838685737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadc409e000 0x7fadc411e4c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.692+0000 7fadcc5bf700 1 -- 172.21.15.59:0/3838685737 >> 172.21.15.59:0/3838685737 conn(0x7fadc4066f50 msgr2=0x7fadc40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.692+0000 7fadcc5bf700 1 -- 172.21.15.59:0/3838685737 shutdown_connections 2023-09-30T22:29:48.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:48.692+0000 7fadcc5bf700 1 -- 172.21.15.59:0/3838685737 wait complete. 2023-09-30T22:29:48.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:48.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:49.622 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:49.664 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:49.704 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:49.707 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.791+0000 7f0578028700 1 Processor -- start 2023-09-30T22:29:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.791+0000 7f0578028700 1 -- start start 2023-09-30T22:29:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.792+0000 7f0578028700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0570133a80 0x7f0570133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.792+0000 7f0578028700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f057012ff20 0x7f0570130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.792+0000 7f0578028700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0570130870 0x7f057013a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.792+0000 7f0578028700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057006c570 con 0x7f0570130870 2023-09-30T22:29:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.792+0000 7f0578028700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057006bc00 con 0x7f0570133a80 2023-09-30T22:29:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.792+0000 7f0578028700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05700a0040 con 0x7f057012ff20 2023-09-30T22:29:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.792+0000 7f05765c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0570130870 0x7f057013a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.792+0000 7f0575dc4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0570133a80 0x7f0570133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.792+0000 7f05755c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f057012ff20 0x7f0570130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.792+0000 7f05765c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0570130870 0x7f057013a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37486/0 (socket says 172.21.15.59:37486) 2023-09-30T22:29:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.792+0000 7f05765c5700 1 -- 172.21.15.59:0/1556450613 learned_addr learned my addr 172.21.15.59:0/1556450613 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.792+0000 7f0575dc4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0570133a80 0x7f0570133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54042/0 (socket says 172.21.15.59:54042) 2023-09-30T22:29:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.792+0000 7f05765c5700 1 -- 172.21.15.59:0/1556450613 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f057012ff20 msgr2=0x7f0570130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.793+0000 7f05765c5700 1 --2- 172.21.15.59:0/1556450613 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f057012ff20 0x7f0570130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.793+0000 7f05765c5700 1 -- 172.21.15.59:0/1556450613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0570133a80 msgr2=0x7f0570133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.793+0000 7f05765c5700 1 --2- 172.21.15.59:0/1556450613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0570133a80 0x7f0570133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.793+0000 7f05765c5700 1 -- 172.21.15.59:0/1556450613 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0570133860 con 0x7f0570130870 2023-09-30T22:29:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.793+0000 7f0575dc4700 1 --2- 172.21.15.59:0/1556450613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0570133a80 0x7f0570133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.793+0000 7f05755c3700 1 --2- 172.21.15.59:0/1556450613 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f057012ff20 0x7f0570130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.793+0000 7f05765c5700 1 --2- 172.21.15.59:0/1556450613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0570130870 0x7f057013a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0568009e50 tx=0x7f056800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e96e9f8b19537f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.793+0000 7f0574dc2700 1 -- 172.21.15.59:0/1556450613 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056800e070 con 0x7f0570130870 2023-09-30T22:29:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.793+0000 7f0574dc2700 1 -- 172.21.15.59:0/1556450613 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056800b910 con 0x7f0570130870 2023-09-30T22:29:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.793+0000 7f0574dc2700 1 -- 172.21.15.59:0/1556450613 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056800bcc0 con 0x7f0570130870 2023-09-30T22:29:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.794+0000 7f0578028700 1 -- 172.21.15.59:0/1556450613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0570130870 msgr2=0x7f057013a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.794+0000 7f0578028700 1 --2- 172.21.15.59:0/1556450613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0570130870 0x7f057013a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0568009e50 tx=0x7f056800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.794+0000 7f0578028700 1 -- 172.21.15.59:0/1556450613 shutdown_connections 2023-09-30T22:29:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.794+0000 7f0578028700 1 --2- 172.21.15.59:0/1556450613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0570130870 0x7f057013a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.794+0000 7f0578028700 1 --2- 172.21.15.59:0/1556450613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0570133a80 0x7f0570133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.794+0000 7f0578028700 1 --2- 172.21.15.59:0/1556450613 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f057012ff20 0x7f0570130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.794+0000 7f0578028700 1 -- 172.21.15.59:0/1556450613 >> 172.21.15.59:0/1556450613 conn(0x7f05700a4210 msgr2=0x7f05700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:49.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.794+0000 7f0578028700 1 -- 172.21.15.59:0/1556450613 shutdown_connections 2023-09-30T22:29:49.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.794+0000 7f0578028700 1 -- 172.21.15.59:0/1556450613 wait complete. 2023-09-30T22:29:49.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.796+0000 7f0578028700 1 Processor -- start 2023-09-30T22:29:49.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.796+0000 7f0578028700 1 -- start start 2023-09-30T22:29:49.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f0578028700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f057012ff20 0x7f057009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f0578028700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0570130870 0x7f057009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f0578028700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0570133a80 0x7f057009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f0578028700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057012d420 con 0x7f0570130870 2023-09-30T22:29:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f0578028700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057012d7e0 con 0x7f057012ff20 2023-09-30T22:29:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f0578028700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f057011fe10 con 0x7f0570133a80 2023-09-30T22:29:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f0575dc4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f057012ff20 0x7f057009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f0575dc4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f057012ff20 0x7f057009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54052/0 (socket says 172.21.15.59:54052) 2023-09-30T22:29:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f0575dc4700 1 -- 172.21.15.59:0/774100761 learned_addr learned my addr 172.21.15.59:0/774100761 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f05765c5700 1 --2- 172.21.15.59:0/774100761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0570133a80 0x7f057009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f05755c3700 1 --2- 172.21.15.59:0/774100761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0570130870 0x7f057009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f05765c5700 1 -- 172.21.15.59:0/774100761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f057012ff20 msgr2=0x7f057009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f05765c5700 1 --2- 172.21.15.59:0/774100761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f057012ff20 0x7f057009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f05765c5700 1 -- 172.21.15.59:0/774100761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0570130870 msgr2=0x7f057009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f05765c5700 1 --2- 172.21.15.59:0/774100761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0570130870 0x7f057009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f05765c5700 1 -- 172.21.15.59:0/774100761 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05600094a0 con 0x7f0570133a80 2023-09-30T22:29:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.797+0000 7f05755c3700 1 --2- 172.21.15.59:0/774100761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0570130870 0x7f057009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.798+0000 7f05765c5700 1 --2- 172.21.15.59:0/774100761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0570133a80 0x7f057009cf00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0568015000 tx=0x7f0568004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.798+0000 7f05667fc700 1 -- 172.21.15.59:0/774100761 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680099b0 con 0x7f0570133a80 2023-09-30T22:29:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.798+0000 7f05667fc700 1 -- 172.21.15.59:0/774100761 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056800ce80 con 0x7f0570133a80 2023-09-30T22:29:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.798+0000 7f0578028700 1 -- 172.21.15.59:0/774100761 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c0094a0 con 0x7f0570133a80 2023-09-30T22:29:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.798+0000 7f05667fc700 1 -- 172.21.15.59:0/774100761 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568004470 con 0x7f0570133a80 2023-09-30T22:29:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.798+0000 7f0578028700 1 -- 172.21.15.59:0/774100761 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0568009b30 con 0x7f0570133a80 2023-09-30T22:29:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.799+0000 7f05667fc700 1 -- 172.21.15.59:0/774100761 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f05680045d0 con 0x7f0570133a80 2023-09-30T22:29:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.799+0000 7f0575dc4700 1 -- 172.21.15.59:0/774100761 >> v1:172.21.15.59:6816/126772 conn(0x7f055402f510 legacy=0x7f05540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.799+0000 7f05667fc700 1 -- 172.21.15.59:0/774100761 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0568040ff0 con 0x7f0570133a80 2023-09-30T22:29:49.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.799+0000 7f0578028700 1 -- 172.21.15.59:0/774100761 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05700a21e0 con 0x7f0570133a80 2023-09-30T22:29:49.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.808+0000 7f05667fc700 1 -- 172.21.15.59:0/774100761 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0568004880 con 0x7f0570133a80 2023-09-30T22:29:49.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.826+0000 7f21b12c2700 1 Processor -- start 2023-09-30T22:29:49.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.826+0000 7f21b12c2700 1 -- start start 2023-09-30T22:29:49.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.827+0000 7f21b12c2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21ac09d6f0 0x7f21ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.827+0000 7f21b12c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ac09e000 0x7f21ac1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.827+0000 7f21b12c2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21ac09b120 con 0x7f21ac09e410 2023-09-30T22:29:49.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.827+0000 7f21b12c2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ac06b460 con 0x7f21ac09d6f0 2023-09-30T22:29:49.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.827+0000 7f21b12c2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac09a7e0 con 0x7f21ac09e000 2023-09-30T22:29:49.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.827+0000 7f21aa7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ac09e000 0x7f21ac1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.827+0000 7f21aa7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ac09e000 0x7f21ac1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42974/0 (socket says 172.21.15.59:42974) 2023-09-30T22:29:49.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.827+0000 7f21aa7fc700 1 -- 172.21.15.59:0/2495649629 learned_addr learned my addr 172.21.15.59:0/2495649629 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:49.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.828+0000 7f21aa7fc700 1 -- 172.21.15.59:0/2495649629 >> v2:172.21.15.59:3300/0 conn(0x7f21ac09d6f0 msgr2=0x7f21ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:49.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.828+0000 7f21aaffd700 1 --2- 172.21.15.59:0/2495649629 >> v2:172.21.15.59:3300/0 conn(0x7f21ac09d6f0 0x7f21ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.828+0000 7f21aa7fc700 1 --2- 172.21.15.59:0/2495649629 >> v2:172.21.15.59:3300/0 conn(0x7f21ac09d6f0 0x7f21ac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.828+0000 7f21aa7fc700 1 -- 172.21.15.59:0/2495649629 >> v1:172.21.15.59:6789/0 conn(0x7f21ac09e410 legacy=0x7f21ac133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.828+0000 7f21aa7fc700 1 -- 172.21.15.59:0/2495649629 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac09a500 con 0x7f21ac09e000 2023-09-30T22:29:49.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.828+0000 7f21aaffd700 1 --2- 172.21.15.59:0/2495649629 >> v2:172.21.15.59:3300/0 conn(0x7f21ac09d6f0 0x7f21ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:49.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.828+0000 7f21aa7fc700 1 --2- 172.21.15.59:0/2495649629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ac09e000 0x7f21ac1339f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009920 tx=0x7f21a0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94ad7620bd996c97 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.828+0000 7f21a9ffb700 1 -- 172.21.15.59:0/2495649629 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a000ba20 con 0x7f21ac09e000 2023-09-30T22:29:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.828+0000 7f21a9ffb700 1 -- 172.21.15.59:0/2495649629 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a000bb80 con 0x7f21ac09e000 2023-09-30T22:29:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.828+0000 7f21a9ffb700 1 -- 172.21.15.59:0/2495649629 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0009e70 con 0x7f21ac09e000 2023-09-30T22:29:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.829+0000 7f21b12c2700 1 -- 172.21.15.59:0/2495649629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ac09e000 msgr2=0x7f21ac1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.829+0000 7f21b12c2700 1 --2- 172.21.15.59:0/2495649629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ac09e000 0x7f21ac1339f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009920 tx=0x7f21a0009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.829+0000 7f21b12c2700 1 -- 172.21.15.59:0/2495649629 shutdown_connections 2023-09-30T22:29:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.829+0000 7f21b12c2700 1 --2- 172.21.15.59:0/2495649629 >> v2:172.21.15.59:3300/0 conn(0x7f21ac09d6f0 0x7f21ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.829+0000 7f21b12c2700 1 --2- 172.21.15.59:0/2495649629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ac09e000 0x7f21ac1339f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.829+0000 7f21b12c2700 1 -- 172.21.15.59:0/2495649629 >> 172.21.15.59:0/2495649629 conn(0x7f21ac066f50 msgr2=0x7f21ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.829+0000 7f21b12c2700 1 -- 172.21.15.59:0/2495649629 shutdown_connections 2023-09-30T22:29:49.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.829+0000 7f21b12c2700 1 -- 172.21.15.59:0/2495649629 wait complete. 2023-09-30T22:29:49.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.831+0000 7f21b12c2700 1 Processor -- start 2023-09-30T22:29:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.831+0000 7f21b12c2700 1 -- start start 2023-09-30T22:29:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.832+0000 7f21b12c2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ac09d6f0 0x7f21ac1b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.832+0000 7f21b12c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ac09e000 0x7f21ac1b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.832+0000 7f21b12c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ac09e410 0x7f21ac1d4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.832+0000 7f21b12c2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac1b7d50 con 0x7f21ac09d6f0 2023-09-30T22:29:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.832+0000 7f21b12c2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac1b6a00 con 0x7f21ac09e000 2023-09-30T22:29:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.832+0000 7f21b12c2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac1b82f0 con 0x7f21ac09e410 2023-09-30T22:29:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.832+0000 7f21aaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ac09d6f0 0x7f21ac1b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.832+0000 7f21ab7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ac09e410 0x7f21ac1d4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.832+0000 7f21aa7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ac09e000 0x7f21ac1b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.832+0000 7f21ab7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ac09e410 0x7f21ac1d4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42978/0 (socket says 172.21.15.59:42978) 2023-09-30T22:29:49.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.832+0000 7f21aaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ac09d6f0 0x7f21ac1b52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37520/0 (socket says 172.21.15.59:37520) 2023-09-30T22:29:49.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.832+0000 7f21ab7fe700 1 -- 172.21.15.59:0/1015390855 learned_addr learned my addr 172.21.15.59:0/1015390855 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.832+0000 7f21ab7fe700 1 -- 172.21.15.59:0/1015390855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ac09e000 msgr2=0x7f21ac1b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.833+0000 7f21ab7fe700 1 --2- 172.21.15.59:0/1015390855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ac09e000 0x7f21ac1b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.833+0000 7f21ab7fe700 1 -- 172.21.15.59:0/1015390855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ac09d6f0 msgr2=0x7f21ac1b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.833+0000 7f21ab7fe700 1 --2- 172.21.15.59:0/1015390855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ac09d6f0 0x7f21ac1b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.833+0000 7f21ab7fe700 1 -- 172.21.15.59:0/1015390855 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a0009550 con 0x7f21ac09e410 2023-09-30T22:29:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.833+0000 7f21aaffd700 1 --2- 172.21.15.59:0/1015390855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ac09d6f0 0x7f21ac1b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.833+0000 7f21aa7fc700 1 --2- 172.21.15.59:0/1015390855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ac09e000 0x7f21ac1b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.833+0000 7f21ab7fe700 1 --2- 172.21.15.59:0/1015390855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ac09e410 0x7f21ac1d4d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f21a400cc80 tx=0x7f21a400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.833+0000 7f21937fe700 1 -- 172.21.15.59:0/1015390855 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a4003c00 con 0x7f21ac09e410 2023-09-30T22:29:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.833+0000 7f21937fe700 1 -- 172.21.15.59:0/1015390855 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a4003d60 con 0x7f21ac09e410 2023-09-30T22:29:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.833+0000 7f21937fe700 1 -- 172.21.15.59:0/1015390855 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a400ab50 con 0x7f21ac09e410 2023-09-30T22:29:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.833+0000 7f21b12c2700 1 -- 172.21.15.59:0/1015390855 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ac0a31b0 con 0x7f21ac09e410 2023-09-30T22:29:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.833+0000 7f21b12c2700 1 -- 172.21.15.59:0/1015390855 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ac1b4df0 con 0x7f21ac09e410 2023-09-30T22:29:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.834+0000 7f21937fe700 1 -- 172.21.15.59:0/1015390855 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f21a400acb0 con 0x7f21ac09e410 2023-09-30T22:29:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.834+0000 7f21937fe700 1 -- 172.21.15.59:0/1015390855 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f21a403fd60 con 0x7f21ac09e410 2023-09-30T22:29:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.834+0000 7f21aaffd700 1 -- 172.21.15.59:0/1015390855 >> v1:172.21.15.59:6816/126772 conn(0x7f219802f510 legacy=0x7f21980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.835+0000 7f21b12c2700 1 -- 172.21.15.59:0/1015390855 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ac1b5e10 con 0x7f21ac09e410 2023-09-30T22:29:49.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.843+0000 7f21937fe700 1 -- 172.21.15.59:0/1015390855 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21a40050d0 con 0x7f21ac09e410 2023-09-30T22:29:49.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.862+0000 7f20d6ed2700 1 Processor -- start 2023-09-30T22:29:49.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.863+0000 7f20d6ed2700 1 -- start start 2023-09-30T22:29:49.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.863+0000 7f20d6ed2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d009e930 0x7f20d009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.863+0000 7f20d6ed2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f20d009f240 0x7f20d01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.863+0000 7f20d6ed2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d0070940 con 0x7f20d009f650 2023-09-30T22:29:49.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.863+0000 7f20d6ed2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d006fd60 con 0x7f20d009f240 2023-09-30T22:29:49.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.863+0000 7f20d6ed2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d006fa80 con 0x7f20d009e930 2023-09-30T22:29:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.863+0000 7f20d4c6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d009e930 0x7f20d009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.863+0000 7f20d4c6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d009e930 0x7f20d009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54066/0 (socket says 172.21.15.59:54066) 2023-09-30T22:29:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.863+0000 7f20d4c6e700 1 -- 172.21.15.59:0/1921085250 learned_addr learned my addr 172.21.15.59:0/1921085250 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.864+0000 7f20d4c6e700 1 -- 172.21.15.59:0/1921085250 >> v2:172.21.15.59:3300/0 conn(0x7f20d009f240 msgr2=0x7f20d01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.864+0000 7f20d4c6e700 1 --2- 172.21.15.59:0/1921085250 >> v2:172.21.15.59:3300/0 conn(0x7f20d009f240 0x7f20d01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.864+0000 7f20d4c6e700 1 -- 172.21.15.59:0/1921085250 >> v1:172.21.15.59:6789/0 conn(0x7f20d009f650 legacy=0x7f20d0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.864+0000 7f20d4c6e700 1 -- 172.21.15.59:0/1921085250 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d009fb60 con 0x7f20d009e930 2023-09-30T22:29:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.864+0000 7f20d4c6e700 1 --2- 172.21.15.59:0/1921085250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d009e930 0x7f20d009ed00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0098f0 tx=0x7f20cc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1619792c6c5f24af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.864+0000 7f20c77fe700 1 -- 172.21.15.59:0/1921085250 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc004230 con 0x7f20d009e930 2023-09-30T22:29:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.864+0000 7f20c77fe700 1 -- 172.21.15.59:0/1921085250 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc004390 con 0x7f20d009e930 2023-09-30T22:29:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.864+0000 7f20c77fe700 1 -- 172.21.15.59:0/1921085250 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc0036a0 con 0x7f20d009e930 2023-09-30T22:29:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.865+0000 7f20d6ed2700 1 -- 172.21.15.59:0/1921085250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d009e930 msgr2=0x7f20d009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.865+0000 7f20d6ed2700 1 --2- 172.21.15.59:0/1921085250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d009e930 0x7f20d009ed00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0098f0 tx=0x7f20cc009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.865+0000 7f20d6ed2700 1 -- 172.21.15.59:0/1921085250 shutdown_connections 2023-09-30T22:29:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.865+0000 7f20d6ed2700 1 --2- 172.21.15.59:0/1921085250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d009e930 0x7f20d009ed00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.865+0000 7f20d6ed2700 1 --2- 172.21.15.59:0/1921085250 >> v2:172.21.15.59:3300/0 conn(0x7f20d009f240 0x7f20d01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.865+0000 7f20d6ed2700 1 -- 172.21.15.59:0/1921085250 >> 172.21.15.59:0/1921085250 conn(0x7f20d00a4210 msgr2=0x7f20d00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.865+0000 7f20d6ed2700 1 -- 172.21.15.59:0/1921085250 shutdown_connections 2023-09-30T22:29:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.865+0000 7f20d6ed2700 1 -- 172.21.15.59:0/1921085250 wait complete. 2023-09-30T22:29:49.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.866+0000 7f20d6ed2700 1 Processor -- start 2023-09-30T22:29:49.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.866+0000 7f20d6ed2700 1 -- start start 2023-09-30T22:29:49.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d6ed2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d009e930 0x7f20d01b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d6ed2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d009f240 0x7f20d01a9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d6ed2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d009f650 0x7f20d01a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d6ed2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d01bbf80 con 0x7f20d009f240 2023-09-30T22:29:49.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d6ed2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d01bbd90 con 0x7f20d009f650 2023-09-30T22:29:49.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d6ed2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20d0071d20 con 0x7f20d009e930 2023-09-30T22:29:49.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d546f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d009f650 0x7f20d01a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d546f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d009f650 0x7f20d01a9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54076/0 (socket says 172.21.15.59:54076) 2023-09-30T22:29:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d546f700 1 -- 172.21.15.59:0/2149929002 learned_addr learned my addr 172.21.15.59:0/2149929002 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d4c6e700 1 --2- 172.21.15.59:0/2149929002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d009e930 0x7f20d01b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20c7fff700 1 --2- 172.21.15.59:0/2149929002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d009f240 0x7f20d01a9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d546f700 1 -- 172.21.15.59:0/2149929002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d009e930 msgr2=0x7f20d01b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d546f700 1 --2- 172.21.15.59:0/2149929002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d009e930 0x7f20d01b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d546f700 1 -- 172.21.15.59:0/2149929002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d009f240 msgr2=0x7f20d01a9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d546f700 1 --2- 172.21.15.59:0/2149929002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d009f240 0x7f20d01a9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d546f700 1 -- 172.21.15.59:0/2149929002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc009550 con 0x7f20d009f650 2023-09-30T22:29:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.867+0000 7f20d546f700 1 --2- 172.21.15.59:0/2149929002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d009f650 0x7f20d01a9f90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c7a0 tx=0x7f20c800cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.868+0000 7f20c57fa700 1 -- 172.21.15.59:0/2149929002 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8003e10 con 0x7f20d009f650 2023-09-30T22:29:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.868+0000 7f20d6ed2700 1 -- 172.21.15.59:0/2149929002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d00a0190 con 0x7f20d009f650 2023-09-30T22:29:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.868+0000 7f20d6ed2700 1 -- 172.21.15.59:0/2149929002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d01bdc80 con 0x7f20d009f650 2023-09-30T22:29:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.869+0000 7f20c57fa700 1 -- 172.21.15.59:0/2149929002 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c8005070 con 0x7f20d009f650 2023-09-30T22:29:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.869+0000 7f20c57fa700 1 -- 172.21.15.59:0/2149929002 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8005420 con 0x7f20d009f650 2023-09-30T22:29:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.869+0000 7f20c57fa700 1 -- 172.21.15.59:0/2149929002 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f20c8005580 con 0x7f20d009f650 2023-09-30T22:29:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.869+0000 7f20c57fa700 1 -- 172.21.15.59:0/2149929002 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f20c803f460 con 0x7f20d009f650 2023-09-30T22:29:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.869+0000 7f20d4c6e700 1 -- 172.21.15.59:0/2149929002 >> v1:172.21.15.59:6816/126772 conn(0x7f20bc02f540 legacy=0x7f20bc0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.869+0000 7f20d6ed2700 1 -- 172.21.15.59:0/2149929002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b00052e0 con 0x7f20d009f650 2023-09-30T22:29:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.874+0000 7f20c57fa700 1 -- 172.21.15.59:0/2149929002 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20c8017070 con 0x7f20d009f650 2023-09-30T22:29:49.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.886+0000 7f987675d700 1 Processor -- start 2023-09-30T22:29:49.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.886+0000 7f987675d700 1 -- start start 2023-09-30T22:29:49.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.886+0000 7f987675d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f987009d6f0 0x7f987009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.886+0000 7f987675d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f987009e410 0x7f9870134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.886+0000 7f987675d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987009b120 con 0x7f987009e000 2023-09-30T22:29:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.886+0000 7f987675d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987006b460 con 0x7f987009e410 2023-09-30T22:29:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.886+0000 7f987675d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f987009a7e0 con 0x7f987009d6f0 2023-09-30T22:29:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.887+0000 7f986f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f987009e000 0x7f98701339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33954/0 (socket says 172.21.15.59:33954) 2023-09-30T22:29:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.887+0000 7f986f7fe700 1 -- 172.21.15.59:0/2284745703 learned_addr learned my addr 172.21.15.59:0/2284745703 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.887+0000 7f986ffff700 1 --2- 172.21.15.59:0/2284745703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f987009d6f0 0x7f987009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.887+0000 7f9874cfa700 1 --2- 172.21.15.59:0/2284745703 >> v2:172.21.15.59:3300/0 conn(0x7f987009e410 0x7f9870134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.887+0000 7f986ffff700 1 -- 172.21.15.59:0/2284745703 >> v2:172.21.15.59:3300/0 conn(0x7f987009e410 msgr2=0x7f9870134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.887+0000 7f986ffff700 1 --2- 172.21.15.59:0/2284745703 >> v2:172.21.15.59:3300/0 conn(0x7f987009e410 0x7f9870134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.887+0000 7f986ffff700 1 -- 172.21.15.59:0/2284745703 >> v1:172.21.15.59:6789/0 conn(0x7f987009e000 legacy=0x7f98701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.887+0000 7f986ffff700 1 -- 172.21.15.59:0/2284745703 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987009a500 con 0x7f987009d6f0 2023-09-30T22:29:49.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.887+0000 7f9874cfa700 1 --2- 172.21.15.59:0/2284745703 >> v2:172.21.15.59:3300/0 conn(0x7f987009e410 0x7f9870134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:49.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.887+0000 7f986ffff700 1 --2- 172.21.15.59:0/2284745703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f987009d6f0 0x7f987009dac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9860009870 tx=0x7f9860009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f15212fd4174ff73 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.888+0000 7f986effd700 1 -- 172.21.15.59:0/2284745703 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860011830 con 0x7f987009d6f0 2023-09-30T22:29:49.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.888+0000 7f986effd700 1 -- 172.21.15.59:0/2284745703 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9860011990 con 0x7f987009d6f0 2023-09-30T22:29:49.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.888+0000 7f986effd700 1 -- 172.21.15.59:0/2284745703 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860011d20 con 0x7f987009d6f0 2023-09-30T22:29:49.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.888+0000 7f987675d700 1 -- 172.21.15.59:0/2284745703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f987009d6f0 msgr2=0x7f987009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.888+0000 7f987675d700 1 --2- 172.21.15.59:0/2284745703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f987009d6f0 0x7f987009dac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9860009870 tx=0x7f9860009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:49.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.888+0000 7f987675d700 1 -- 172.21.15.59:0/2284745703 shutdown_connections 2023-09-30T22:29:49.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.888+0000 7f987675d700 1 --2- 172.21.15.59:0/2284745703 >> v2:172.21.15.59:3300/0 conn(0x7f987009e410 0x7f9870134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.888+0000 7f987675d700 1 --2- 172.21.15.59:0/2284745703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f987009d6f0 0x7f987009dac0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.888+0000 7f987675d700 1 -- 172.21.15.59:0/2284745703 >> 172.21.15.59:0/2284745703 conn(0x7f9870066f50 msgr2=0x7f987009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:49.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.888+0000 7f987675d700 1 -- 172.21.15.59:0/2284745703 shutdown_connections 2023-09-30T22:29:49.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.889+0000 7f987675d700 1 -- 172.21.15.59:0/2284745703 wait complete. 2023-09-30T22:29:49.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.889+0000 7f987675d700 1 Processor -- start 2023-09-30T22:29:49.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.890+0000 7f987675d700 1 -- start start 2023-09-30T22:29:49.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.890+0000 7f987675d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f987009d6f0 0x7f98701a8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.890+0000 7f987675d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f987009e000 0x7f98701a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.890+0000 7f987675d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f987009e410 0x7f98701a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.890+0000 7f987675d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98701aa0a0 con 0x7f987009d6f0 2023-09-30T22:29:49.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.890+0000 7f987675d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987009c780 con 0x7f987009e000 2023-09-30T22:29:49.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.890+0000 7f987675d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98701aa900 con 0x7f987009e410 2023-09-30T22:29:49.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.890+0000 7f9874cfa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f987009e410 0x7f98701a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.891+0000 7f9874cfa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f987009e410 0x7f98701a8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43016/0 (socket says 172.21.15.59:43016) 2023-09-30T22:29:49.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.891+0000 7f9874cfa700 1 -- 172.21.15.59:0/3254298360 learned_addr learned my addr 172.21.15.59:0/3254298360 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:49.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.891+0000 7f986ffff700 1 --2- 172.21.15.59:0/3254298360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f987009d6f0 0x7f98701a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.891+0000 7f9874cfa700 1 -- 172.21.15.59:0/3254298360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f987009e000 msgr2=0x7f98701a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.891+0000 7f9874cfa700 1 --2- 172.21.15.59:0/3254298360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f987009e000 0x7f98701a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.891+0000 7f9874cfa700 1 -- 172.21.15.59:0/3254298360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f987009d6f0 msgr2=0x7f98701a8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.891+0000 7f9874cfa700 1 --2- 172.21.15.59:0/3254298360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f987009d6f0 0x7f98701a8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.891+0000 7f9874cfa700 1 -- 172.21.15.59:0/3254298360 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98600094a0 con 0x7f987009e410 2023-09-30T22:29:49.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.891+0000 7f9874cfa700 1 --2- 172.21.15.59:0/3254298360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f987009e410 0x7f98701a8ff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9868009fa0 tx=0x7f986800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.891+0000 7f986cff9700 1 -- 172.21.15.59:0/3254298360 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986800de00 con 0x7f987009e410 2023-09-30T22:29:49.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.891+0000 7f987675d700 1 -- 172.21.15.59:0/3254298360 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98701aba10 con 0x7f987009e410 2023-09-30T22:29:49.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.891+0000 7f986cff9700 1 -- 172.21.15.59:0/3254298360 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986800f040 con 0x7f987009e410 2023-09-30T22:29:49.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.891+0000 7f986cff9700 1 -- 172.21.15.59:0/3254298360 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9868003c60 con 0x7f987009e410 2023-09-30T22:29:49.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.892+0000 7f987675d700 1 -- 172.21.15.59:0/3254298360 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98700a33b0 con 0x7f987009e410 2023-09-30T22:29:49.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.893+0000 7f986cff9700 1 -- 172.21.15.59:0/3254298360 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9868004030 con 0x7f987009e410 2023-09-30T22:29:49.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.893+0000 7f987675d700 1 -- 172.21.15.59:0/3254298360 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987004ea50 con 0x7f987009e410 2023-09-30T22:29:49.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.893+0000 7f986ffff700 1 -- 172.21.15.59:0/3254298360 >> v1:172.21.15.59:6816/126772 conn(0x7f985c02f540 legacy=0x7f985c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:49.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.893+0000 7f986cff9700 1 -- 172.21.15.59:0/3254298360 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f986803fec0 con 0x7f987009e410 2023-09-30T22:29:49.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:49.902+0000 7f986cff9700 1 -- 172.21.15.59:0/3254298360 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f986801e3b0 con 0x7f987009e410 2023-09-30T22:29:50.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.000+0000 7f0575dc4700 1 -- 172.21.15.59:0/774100761 >> v1:172.21.15.59:6816/126772 conn(0x7f055402f510 legacy=0x7f05540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:50.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.031+0000 7f0578028700 1 -- 172.21.15.59:0/774100761 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0570074ea0 con 0x7f0570133a80 2023-09-30T22:29:50.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.031+0000 7f05667fc700 1 -- 172.21.15.59:0/774100761 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0568011b80 con 0x7f0570133a80 2023-09-30T22:29:50.033 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.034+0000 7f0578028700 1 -- 172.21.15.59:0/774100761 >> v1:172.21.15.59:6816/126772 conn(0x7f055402f510 legacy=0x7f05540319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.034+0000 7f0578028700 1 -- 172.21.15.59:0/774100761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0570133a80 msgr2=0x7f057009cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.034+0000 7f0578028700 1 --2- 172.21.15.59:0/774100761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0570133a80 0x7f057009cf00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0568015000 tx=0x7f0568004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.034+0000 7f0578028700 1 -- 172.21.15.59:0/774100761 shutdown_connections 2023-09-30T22:29:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.034+0000 7f0578028700 1 --2- 172.21.15.59:0/774100761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0570133a80 0x7f057009cf00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.034+0000 7f0578028700 1 --2- 172.21.15.59:0/774100761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f057012ff20 0x7f057009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.034+0000 7f0578028700 1 --2- 172.21.15.59:0/774100761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0570130870 0x7f057009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.034+0000 7f0578028700 1 -- 172.21.15.59:0/774100761 >> 172.21.15.59:0/774100761 conn(0x7f05700a4210 msgr2=0x7f05700a0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.034+0000 7f0578028700 1 -- 172.21.15.59:0/774100761 shutdown_connections 2023-09-30T22:29:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.034+0000 7f0578028700 1 -- 172.21.15.59:0/774100761 wait complete. 2023-09-30T22:29:50.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.035+0000 7f21aaffd700 1 -- 172.21.15.59:0/1015390855 >> v1:172.21.15.59:6816/126772 conn(0x7f219802f510 legacy=0x7f21980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:50.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:50.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.070+0000 7f20d4c6e700 1 -- 172.21.15.59:0/2149929002 >> v1:172.21.15.59:6816/126772 conn(0x7f20bc02f540 legacy=0x7f20bc0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:50.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.070+0000 7f21b12c2700 1 -- 172.21.15.59:0/1015390855 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f21ac074ea0 con 0x7f21ac09e410 2023-09-30T22:29:50.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.070+0000 7f21937fe700 1 -- 172.21.15.59:0/1015390855 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21a4019300 con 0x7f21ac09e410 2023-09-30T22:29:50.072 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:50.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.074+0000 7f21b12c2700 1 -- 172.21.15.59:0/1015390855 >> v1:172.21.15.59:6816/126772 conn(0x7f219802f510 legacy=0x7f21980319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:50.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.074+0000 7f21b12c2700 1 -- 172.21.15.59:0/1015390855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ac09e410 msgr2=0x7f21ac1d4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:50.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.074+0000 7f21b12c2700 1 --2- 172.21.15.59:0/1015390855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ac09e410 0x7f21ac1d4d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f21a400cc80 tx=0x7f21a400cf90 comp rx=0 tx=0).stop 2023-09-30T22:29:50.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.074+0000 7f21b12c2700 1 -- 172.21.15.59:0/1015390855 shutdown_connections 2023-09-30T22:29:50.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.074+0000 7f21b12c2700 1 --2- 172.21.15.59:0/1015390855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ac09e410 0x7f21ac1d4d50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:50.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.074+0000 7f21b12c2700 1 --2- 172.21.15.59:0/1015390855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ac09d6f0 0x7f21ac1b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:50.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.074+0000 7f21b12c2700 1 --2- 172.21.15.59:0/1015390855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ac09e000 0x7f21ac1b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:50.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.074+0000 7f21b12c2700 1 -- 172.21.15.59:0/1015390855 >> 172.21.15.59:0/1015390855 conn(0x7f21ac066f50 msgr2=0x7f21ac071240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:50.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.074+0000 7f21b12c2700 1 -- 172.21.15.59:0/1015390855 shutdown_connections 2023-09-30T22:29:50.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.074+0000 7f21b12c2700 1 -- 172.21.15.59:0/1015390855 wait complete. 2023-09-30T22:29:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.084+0000 7f20d6ed2700 1 -- 172.21.15.59:0/2149929002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f20b0005860 con 0x7f20d009f650 2023-09-30T22:29:50.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.085+0000 7f20c57fa700 1 -- 172.21.15.59:0/2149929002 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20c800a930 con 0x7f20d009f650 2023-09-30T22:29:50.086 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:50.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.087+0000 7f20d6ed2700 1 -- 172.21.15.59:0/2149929002 >> v1:172.21.15.59:6816/126772 conn(0x7f20bc02f540 legacy=0x7f20bc0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:50.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.087+0000 7f20d6ed2700 1 -- 172.21.15.59:0/2149929002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d009f650 msgr2=0x7f20d01a9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:50.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.087+0000 7f20d6ed2700 1 --2- 172.21.15.59:0/2149929002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d009f650 0x7f20d01a9f90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c7a0 tx=0x7f20c800cab0 comp rx=0 tx=0).stop 2023-09-30T22:29:50.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.087+0000 7f20d6ed2700 1 -- 172.21.15.59:0/2149929002 shutdown_connections 2023-09-30T22:29:50.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.087+0000 7f20d6ed2700 1 --2- 172.21.15.59:0/2149929002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d009e930 0x7f20d01b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:50.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.087+0000 7f20d6ed2700 1 --2- 172.21.15.59:0/2149929002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d009f650 0x7f20d01a9f90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:50.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.087+0000 7f20d6ed2700 1 --2- 172.21.15.59:0/2149929002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d009f240 0x7f20d01a9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:50.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.087+0000 7f20d6ed2700 1 -- 172.21.15.59:0/2149929002 >> 172.21.15.59:0/2149929002 conn(0x7f20d00a4210 msgr2=0x7f20d01b78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:50.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.087+0000 7f20d6ed2700 1 -- 172.21.15.59:0/2149929002 shutdown_connections 2023-09-30T22:29:50.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.088+0000 7f20d6ed2700 1 -- 172.21.15.59:0/2149929002 wait complete. 2023-09-30T22:29:50.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:50.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.094+0000 7f986ffff700 1 -- 172.21.15.59:0/3254298360 >> v1:172.21.15.59:6816/126772 conn(0x7f985c02f540 legacy=0x7f985c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:50.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:50.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.122+0000 7f987675d700 1 -- 172.21.15.59:0/3254298360 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f987006edd0 con 0x7f987009e410 2023-09-30T22:29:50.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.122+0000 7f986cff9700 1 -- 172.21.15.59:0/3254298360 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f986801a070 con 0x7f987009e410 2023-09-30T22:29:50.123 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:50.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.124+0000 7f987675d700 1 -- 172.21.15.59:0/3254298360 >> v1:172.21.15.59:6816/126772 conn(0x7f985c02f540 legacy=0x7f985c0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:50.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.125+0000 7f987675d700 1 -- 172.21.15.59:0/3254298360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f987009e410 msgr2=0x7f98701a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:50.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.125+0000 7f987675d700 1 --2- 172.21.15.59:0/3254298360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f987009e410 0x7f98701a8ff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9868009fa0 tx=0x7f986800d3b0 comp rx=0 tx=0).stop 2023-09-30T22:29:50.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.125+0000 7f987675d700 1 -- 172.21.15.59:0/3254298360 shutdown_connections 2023-09-30T22:29:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.125+0000 7f987675d700 1 --2- 172.21.15.59:0/3254298360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f987009e410 0x7f98701a8ff0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.125+0000 7f987675d700 1 --2- 172.21.15.59:0/3254298360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f987009d6f0 0x7f98701a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.125+0000 7f987675d700 1 --2- 172.21.15.59:0/3254298360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f987009e000 0x7f98701a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.125+0000 7f987675d700 1 -- 172.21.15.59:0/3254298360 >> 172.21.15.59:0/3254298360 conn(0x7f9870066f50 msgr2=0x7f9870072140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.125+0000 7f987675d700 1 -- 172.21.15.59:0/3254298360 shutdown_connections 2023-09-30T22:29:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:50.125+0000 7f987675d700 1 -- 172.21.15.59:0/3254298360 wait complete. 2023-09-30T22:29:50.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:51.050 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:51.095 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:51.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:51.140 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:51.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.204+0000 7f8bdfc28700 1 Processor -- start 2023-09-30T22:29:51.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.204+0000 7f8bdfc28700 1 -- start start 2023-09-30T22:29:51.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.205+0000 7f8bdfc28700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bd81338a0 0x7f8bd8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.205+0000 7f8bdfc28700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bd809de50 0x7f8bd809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.205+0000 7f8bdfc28700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd806ef30 con 0x7f8bd809e760 2023-09-30T22:29:51.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.205+0000 7f8bdfc28700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd806fef0 con 0x7f8bd809de50 2023-09-30T22:29:51.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.205+0000 7f8bdfc28700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd81334b0 con 0x7f8bd81338a0 2023-09-30T22:29:51.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.205+0000 7f8bdd1c3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bd809de50 0x7f8bd809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.205+0000 7f8bde1c5700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8bd809e760 0x7f8bd813a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33958/0 (socket says 172.21.15.59:33958) 2023-09-30T22:29:51.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.205+0000 7f8bdd9c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bd81338a0 0x7f8bd8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.205+0000 7f8bde1c5700 1 -- 172.21.15.59:0/3469114288 learned_addr learned my addr 172.21.15.59:0/3469114288 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:51.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.205+0000 7f8bdd1c3700 1 -- 172.21.15.59:0/3469114288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bd81338a0 msgr2=0x7f8bd8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:51.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.205+0000 7f8bdd1c3700 1 --2- 172.21.15.59:0/3469114288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bd81338a0 0x7f8bd8133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.205+0000 7f8bdd1c3700 1 -- 172.21.15.59:0/3469114288 >> v1:172.21.15.59:6789/0 conn(0x7f8bd809e760 legacy=0x7f8bd813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.205+0000 7f8bdd1c3700 1 -- 172.21.15.59:0/3469114288 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd806fc30 con 0x7f8bd809de50 2023-09-30T22:29:51.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.206+0000 7f8bdd1c3700 1 --2- 172.21.15.59:0/3469114288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bd809de50 0x7f8bd809e220 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009840 tx=0x7f8bc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d943e8558d885890 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.206+0000 7f8bdc9c2700 1 -- 172.21.15.59:0/3469114288 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8011830 con 0x7f8bd809de50 2023-09-30T22:29:51.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.206+0000 7f8bdc9c2700 1 -- 172.21.15.59:0/3469114288 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc8011990 con 0x7f8bd809de50 2023-09-30T22:29:51.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.206+0000 7f8bdc9c2700 1 -- 172.21.15.59:0/3469114288 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8011d20 con 0x7f8bd809de50 2023-09-30T22:29:51.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.207+0000 7f8bdfc28700 1 -- 172.21.15.59:0/3469114288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bd809de50 msgr2=0x7f8bd809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.207+0000 7f8bdfc28700 1 --2- 172.21.15.59:0/3469114288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bd809de50 0x7f8bd809e220 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009840 tx=0x7f8bc8009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:51.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.207+0000 7f8bdfc28700 1 -- 172.21.15.59:0/3469114288 shutdown_connections 2023-09-30T22:29:51.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.207+0000 7f8bdfc28700 1 --2- 172.21.15.59:0/3469114288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bd81338a0 0x7f8bd8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.207+0000 7f8bdfc28700 1 --2- 172.21.15.59:0/3469114288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bd809de50 0x7f8bd809e220 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.207+0000 7f8bdfc28700 1 -- 172.21.15.59:0/3469114288 >> 172.21.15.59:0/3469114288 conn(0x7f8bd80a2aa0 msgr2=0x7f8bd80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.207+0000 7f8bdfc28700 1 -- 172.21.15.59:0/3469114288 shutdown_connections 2023-09-30T22:29:51.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.207+0000 7f8bdfc28700 1 -- 172.21.15.59:0/3469114288 wait complete. 2023-09-30T22:29:51.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.208+0000 7f8bdfc28700 1 Processor -- start 2023-09-30T22:29:51.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.208+0000 7f8bdfc28700 1 -- start start 2023-09-30T22:29:51.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.208+0000 7f8bdfc28700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bd809de50 0x7f8bd811eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.208+0000 7f8bdfc28700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bd809e760 0x7f8bd811f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.208+0000 7f8bdfc28700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bd81338a0 0x7f8bd811f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.208+0000 7f8bdfc28700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd8121ea0 con 0x7f8bd81338a0 2023-09-30T22:29:51.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.208+0000 7f8bdfc28700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd8122080 con 0x7f8bd809de50 2023-09-30T22:29:51.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.208+0000 7f8bdfc28700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd812f690 con 0x7f8bd809e760 2023-09-30T22:29:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.209+0000 7f8bde1c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bd81338a0 0x7f8bd811f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.209+0000 7f8bde1c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bd81338a0 0x7f8bd811f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37582/0 (socket says 172.21.15.59:37582) 2023-09-30T22:29:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.209+0000 7f8bde1c5700 1 -- 172.21.15.59:0/2729002279 learned_addr learned my addr 172.21.15.59:0/2729002279 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.209+0000 7f8bdd9c4700 1 --2- 172.21.15.59:0/2729002279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bd809de50 0x7f8bd811eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.209+0000 7f8bde1c5700 1 -- 172.21.15.59:0/2729002279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bd809e760 msgr2=0x7f8bd811f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.209+0000 7f8bde1c5700 1 --2- 172.21.15.59:0/2729002279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bd809e760 0x7f8bd811f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.209+0000 7f8bde1c5700 1 -- 172.21.15.59:0/2729002279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bd809de50 msgr2=0x7f8bd811eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.209+0000 7f8bde1c5700 1 --2- 172.21.15.59:0/2729002279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bd809de50 0x7f8bd811eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.209+0000 7f8bde1c5700 1 -- 172.21.15.59:0/2729002279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc80094a0 con 0x7f8bd81338a0 2023-09-30T22:29:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.209+0000 7f8bdd9c4700 1 --2- 172.21.15.59:0/2729002279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bd809de50 0x7f8bd811eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:51.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.209+0000 7f8bde1c5700 1 --2- 172.21.15.59:0/2729002279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bd81338a0 0x7f8bd811f580 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000cbf0 tx=0x7f8bd000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.210+0000 7f8bce7fc700 1 -- 172.21.15.59:0/2729002279 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd000ab10 con 0x7f8bd81338a0 2023-09-30T22:29:51.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.210+0000 7f8bce7fc700 1 -- 172.21.15.59:0/2729002279 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd000ac70 con 0x7f8bd81338a0 2023-09-30T22:29:51.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.210+0000 7f8bce7fc700 1 -- 172.21.15.59:0/2729002279 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0012400 con 0x7f8bd81338a0 2023-09-30T22:29:51.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.210+0000 7f8bdfc28700 1 -- 172.21.15.59:0/2729002279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd80a1110 con 0x7f8bd81338a0 2023-09-30T22:29:51.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.210+0000 7f8bdfc28700 1 -- 172.21.15.59:0/2729002279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd8122340 con 0x7f8bd81338a0 2023-09-30T22:29:51.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.211+0000 7f8bce7fc700 1 -- 172.21.15.59:0/2729002279 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8bd001b3b0 con 0x7f8bd81338a0 2023-09-30T22:29:51.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.211+0000 7f8bdfc28700 1 -- 172.21.15.59:0/2729002279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd8074ea0 con 0x7f8bd81338a0 2023-09-30T22:29:51.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.211+0000 7f8bce7fc700 1 -- 172.21.15.59:0/2729002279 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8bd003f860 con 0x7f8bd81338a0 2023-09-30T22:29:51.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.211+0000 7f8bdd9c4700 1 -- 172.21.15.59:0/2729002279 >> v1:172.21.15.59:6816/126772 conn(0x7f8bbc02f510 legacy=0x7f8bbc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:51.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.220+0000 7f8bce7fc700 1 -- 172.21.15.59:0/2729002279 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bd0017070 con 0x7f8bd81338a0 2023-09-30T22:29:51.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.248+0000 7f04a7df0700 1 Processor -- start 2023-09-30T22:29:51.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.248+0000 7f04a7df0700 1 -- start start 2023-09-30T22:29:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.248+0000 7f04a7df0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a009d6f0 0x7f04a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.248+0000 7f04a7df0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04a009e000 0x7f04a0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.248+0000 7f04a7df0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a009f130 con 0x7f04a009e410 2023-09-30T22:29:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.248+0000 7f04a7df0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a009f520 con 0x7f04a009e000 2023-09-30T22:29:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.248+0000 7f04a7df0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a009e930 con 0x7f04a009d6f0 2023-09-30T22:29:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.249+0000 7f04a538b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04a009e000 0x7f04a0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.249+0000 7f04a638d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f04a009e410 0x7f04a0130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33968/0 (socket says 172.21.15.59:33968) 2023-09-30T22:29:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.249+0000 7f04a538b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04a009e000 0x7f04a0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37594/0 (socket says 172.21.15.59:37594) 2023-09-30T22:29:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.249+0000 7f04a638d700 1 -- 172.21.15.59:0/1781498678 learned_addr learned my addr 172.21.15.59:0/1781498678 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.249+0000 7f04a5b8c700 1 --2- 172.21.15.59:0/1781498678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a009d6f0 0x7f04a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.249+0000 7f04a538b700 1 -- 172.21.15.59:0/1781498678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a009d6f0 msgr2=0x7f04a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.249+0000 7f04a538b700 1 --2- 172.21.15.59:0/1781498678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a009d6f0 0x7f04a009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.249+0000 7f04a538b700 1 -- 172.21.15.59:0/1781498678 >> v1:172.21.15.59:6789/0 conn(0x7f04a009e410 legacy=0x7f04a0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.249+0000 7f04a538b700 1 -- 172.21.15.59:0/1781498678 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a009b2d0 con 0x7f04a009e000 2023-09-30T22:29:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.249+0000 7f04a538b700 1 --2- 172.21.15.59:0/1781498678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a009e000 0x7f04a0130660 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f049000bae0 tx=0x7f049000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8eaa48e263524b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.250+0000 7f04a4b8a700 1 -- 172.21.15.59:0/1781498678 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049000dd30 con 0x7f04a009e000 2023-09-30T22:29:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.250+0000 7f04a4b8a700 1 -- 172.21.15.59:0/1781498678 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049000de90 con 0x7f04a009e000 2023-09-30T22:29:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.250+0000 7f04a4b8a700 1 -- 172.21.15.59:0/1781498678 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0490010690 con 0x7f04a009e000 2023-09-30T22:29:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.250+0000 7f04a7df0700 1 -- 172.21.15.59:0/1781498678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a009e000 msgr2=0x7f04a0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.250+0000 7f04a7df0700 1 --2- 172.21.15.59:0/1781498678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a009e000 0x7f04a0130660 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f049000bae0 tx=0x7f049000bdf0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.250+0000 7f04a7df0700 1 -- 172.21.15.59:0/1781498678 shutdown_connections 2023-09-30T22:29:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.250+0000 7f04a7df0700 1 --2- 172.21.15.59:0/1781498678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a009d6f0 0x7f04a009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.250+0000 7f04a7df0700 1 --2- 172.21.15.59:0/1781498678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a009e000 0x7f04a0130660 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.250+0000 7f04a7df0700 1 -- 172.21.15.59:0/1781498678 >> 172.21.15.59:0/1781498678 conn(0x7f04a0066f50 msgr2=0x7f04a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.251+0000 7f04a7df0700 1 -- 172.21.15.59:0/1781498678 shutdown_connections 2023-09-30T22:29:51.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.251+0000 7f04a7df0700 1 -- 172.21.15.59:0/1781498678 wait complete. 2023-09-30T22:29:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.252+0000 7f04a7df0700 1 Processor -- start 2023-09-30T22:29:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.252+0000 7f04a7df0700 1 -- start start 2023-09-30T22:29:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.252+0000 7f04a7df0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a009d6f0 0x7f04a0122390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.252+0000 7f04a7df0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a009e000 0x7f04a01228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.252+0000 7f04a7df0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a009e410 0x7f04a0122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.252+0000 7f04a7df0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a0123fa0 con 0x7f04a009d6f0 2023-09-30T22:29:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.252+0000 7f04a7df0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a0125910 con 0x7f04a009e000 2023-09-30T22:29:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.252+0000 7f04a7df0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04a0125eb0 con 0x7f04a009e410 2023-09-30T22:29:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.252+0000 7f04a5b8c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a009d6f0 0x7f04a0122390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.252+0000 7f04a5b8c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a009d6f0 0x7f04a0122390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37596/0 (socket says 172.21.15.59:37596) 2023-09-30T22:29:51.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.252+0000 7f04a5b8c700 1 -- 172.21.15.59:0/1905795438 learned_addr learned my addr 172.21.15.59:0/1905795438 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:51.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.252+0000 7f04a538b700 1 --2- 172.21.15.59:0/1905795438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a009e000 0x7f04a01228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.252+0000 7f04a638d700 1 --2- 172.21.15.59:0/1905795438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a009e410 0x7f04a0122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.253+0000 7f04a538b700 1 -- 172.21.15.59:0/1905795438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a009e410 msgr2=0x7f04a0122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.253+0000 7f04a538b700 1 --2- 172.21.15.59:0/1905795438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a009e410 0x7f04a0122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.253+0000 7f04a538b700 1 -- 172.21.15.59:0/1905795438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a009d6f0 msgr2=0x7f04a0122390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.253+0000 7f04a538b700 1 --2- 172.21.15.59:0/1905795438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a009d6f0 0x7f04a0122390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.253+0000 7f04a538b700 1 -- 172.21.15.59:0/1905795438 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049000b740 con 0x7f04a009e000 2023-09-30T22:29:51.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.253+0000 7f04a538b700 1 --2- 172.21.15.59:0/1905795438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a009e000 0x7f04a01228d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0490018000 tx=0x7f0490004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.253+0000 7f04967fc700 1 -- 172.21.15.59:0/1905795438 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0490004560 con 0x7f04a009e000 2023-09-30T22:29:51.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.253+0000 7f04967fc700 1 -- 172.21.15.59:0/1905795438 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0490010470 con 0x7f04a009e000 2023-09-30T22:29:51.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.253+0000 7f04967fc700 1 -- 172.21.15.59:0/1905795438 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0490010820 con 0x7f04a009e000 2023-09-30T22:29:51.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.253+0000 7f04a7df0700 1 -- 172.21.15.59:0/1905795438 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a00a1d70 con 0x7f04a009e000 2023-09-30T22:29:51.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.253+0000 7f04a7df0700 1 -- 172.21.15.59:0/1905795438 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a0125bd0 con 0x7f04a009e000 2023-09-30T22:29:51.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.255+0000 7f04967fc700 1 -- 172.21.15.59:0/1905795438 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0490019400 con 0x7f04a009e000 2023-09-30T22:29:51.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.255+0000 7f04a7df0700 1 -- 172.21.15.59:0/1905795438 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a0124820 con 0x7f04a009e000 2023-09-30T22:29:51.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.255+0000 7f04967fc700 1 -- 172.21.15.59:0/1905795438 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0490040cc0 con 0x7f04a009e000 2023-09-30T22:29:51.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.255+0000 7f04a5b8c700 1 -- 172.21.15.59:0/1905795438 >> v1:172.21.15.59:6816/126772 conn(0x7f048402f510 legacy=0x7f04840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:51.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.260+0000 7f04967fc700 1 -- 172.21.15.59:0/1905795438 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f049000f3d0 con 0x7f04a009e000 2023-09-30T22:29:51.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.296+0000 7f8e3d4d4700 1 Processor -- start 2023-09-30T22:29:51.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.296+0000 7f641e352700 1 Processor -- start 2023-09-30T22:29:51.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.296+0000 7f8e3d4d4700 1 -- start start 2023-09-30T22:29:51.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.296+0000 7f641e352700 1 -- start start 2023-09-30T22:29:51.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.296+0000 7f8e3d4d4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e38133540 0x7f8e38135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.296+0000 7f8e3d4d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e38135e60 0x7f8e38138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.296+0000 7f8e3d4d4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e380716a0 con 0x7f8e38130540 2023-09-30T22:29:51.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.296+0000 7f8e3d4d4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e38071290 con 0x7f8e38133540 2023-09-30T22:29:51.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.296+0000 7f8e3d4d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e38130340 con 0x7f8e38135e60 2023-09-30T22:29:51.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.296+0000 7f8e367fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e38133540 0x7f8e38135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f8e36ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8e38130540 0x7f8e38130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33980/0 (socket says 172.21.15.59:33980) 2023-09-30T22:29:51.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f8e36ffd700 1 -- 172.21.15.59:0/2978546401 learned_addr learned my addr 172.21.15.59:0/2978546401 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:51.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f641e352700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f64181337f0 0x7f6418138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f641e352700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6418138dc0 0x7f641813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f641e352700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f641806b990 con 0x7f6418133420 2023-09-30T22:29:51.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f641e352700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f641809b0e0 con 0x7f64181337f0 2023-09-30T22:29:51.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f641e352700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6418133c20 con 0x7f6418138dc0 2023-09-30T22:29:51.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f64177fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f64181337f0 0x7f6418138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f641c8ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6418138dc0 0x7f641813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f64177fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f64181337f0 0x7f6418138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37626/0 (socket says 172.21.15.59:37626) 2023-09-30T22:29:51.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f64177fe700 1 -- 172.21.15.59:0/604808681 learned_addr learned my addr 172.21.15.59:0/604808681 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:51.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f8e367fc700 1 -- 172.21.15.59:0/2978546401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e38135e60 msgr2=0x7f8e38138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:51.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f8e367fc700 1 --2- 172.21.15.59:0/2978546401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e38135e60 0x7f8e38138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f8e367fc700 1 -- 172.21.15.59:0/2978546401 >> v1:172.21.15.59:6789/0 conn(0x7f8e38130540 legacy=0x7f8e38130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:51.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f8e367fc700 1 -- 172.21.15.59:0/2978546401 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e38070b80 con 0x7f8e38133540 2023-09-30T22:29:51.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f6416ffd700 1 -- 172.21.15.59:0/604808681 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450227881 0 0) 0x7f641806b990 con 0x7f6418133420 2023-09-30T22:29:51.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f6416ffd700 1 -- 172.21.15.59:0/604808681 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64000035b0 con 0x7f6418133420 2023-09-30T22:29:51.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f64177fe700 1 -- 172.21.15.59:0/604808681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6418138dc0 msgr2=0x7f641813b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:51.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f64177fe700 1 --2- 172.21.15.59:0/604808681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6418138dc0 0x7f641813b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.298+0000 7f64177fe700 1 -- 172.21.15.59:0/604808681 >> v1:172.21.15.59:6789/0 conn(0x7f6418133420 legacy=0x7f6418133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.298+0000 7f64177fe700 1 -- 172.21.15.59:0/604808681 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64180a0590 con 0x7f64181337f0 2023-09-30T22:29:51.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.297+0000 7f8e367fc700 1 --2- 172.21.15.59:0/2978546401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e38133540 0x7f8e38135920 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00bae0 tx=0x7f8e2c00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844a610bcd2b4310 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.298+0000 7f8e35ffb700 1 -- 172.21.15.59:0/2978546401 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c00dcf0 con 0x7f8e38133540 2023-09-30T22:29:51.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.298+0000 7f8e35ffb700 1 -- 172.21.15.59:0/2978546401 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c00de50 con 0x7f8e38133540 2023-09-30T22:29:51.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.298+0000 7f8e35ffb700 1 -- 172.21.15.59:0/2978546401 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c004250 con 0x7f8e38133540 2023-09-30T22:29:51.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.298+0000 7f64177fe700 1 --2- 172.21.15.59:0/604808681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64181337f0 0x7f6418138880 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f640c0098f0 tx=0x7f640c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84331aee5d8fe5f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.298+0000 7f6416ffd700 1 -- 172.21.15.59:0/604808681 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c011830 con 0x7f64181337f0 2023-09-30T22:29:51.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.298+0000 7f6416ffd700 1 -- 172.21.15.59:0/604808681 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640c011990 con 0x7f64181337f0 2023-09-30T22:29:51.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.298+0000 7f6416ffd700 1 -- 172.21.15.59:0/604808681 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c011d20 con 0x7f64181337f0 2023-09-30T22:29:51.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.299+0000 7f8e3d4d4700 1 -- 172.21.15.59:0/2978546401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e38133540 msgr2=0x7f8e38135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.299+0000 7f8e3d4d4700 1 --2- 172.21.15.59:0/2978546401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e38133540 0x7f8e38135920 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00bae0 tx=0x7f8e2c00bdf0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.299+0000 7f8e3d4d4700 1 -- 172.21.15.59:0/2978546401 shutdown_connections 2023-09-30T22:29:51.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.299+0000 7f8e3d4d4700 1 --2- 172.21.15.59:0/2978546401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e38135e60 0x7f8e38138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.299+0000 7f8e3d4d4700 1 --2- 172.21.15.59:0/2978546401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e38133540 0x7f8e38135920 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.299+0000 7f8e3d4d4700 1 -- 172.21.15.59:0/2978546401 >> 172.21.15.59:0/2978546401 conn(0x7f8e380a2aa0 msgr2=0x7f8e380a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.299+0000 7f8e3d4d4700 1 -- 172.21.15.59:0/2978546401 shutdown_connections 2023-09-30T22:29:51.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.299+0000 7f8e3d4d4700 1 -- 172.21.15.59:0/2978546401 wait complete. 2023-09-30T22:29:51.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.299+0000 7f641e352700 1 -- 172.21.15.59:0/604808681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64181337f0 msgr2=0x7f6418138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.299+0000 7f641e352700 1 --2- 172.21.15.59:0/604808681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64181337f0 0x7f6418138880 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f640c0098f0 tx=0x7f640c009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:51.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.299+0000 7f641e352700 1 -- 172.21.15.59:0/604808681 shutdown_connections 2023-09-30T22:29:51.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.299+0000 7f641e352700 1 --2- 172.21.15.59:0/604808681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6418138dc0 0x7f641813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.299+0000 7f641e352700 1 --2- 172.21.15.59:0/604808681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64181337f0 0x7f6418138880 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.299+0000 7f641e352700 1 -- 172.21.15.59:0/604808681 >> 172.21.15.59:0/604808681 conn(0x7f64180a4210 msgr2=0x7f64180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.299+0000 7f641e352700 1 -- 172.21.15.59:0/604808681 shutdown_connections 2023-09-30T22:29:51.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.300+0000 7f641e352700 1 -- 172.21.15.59:0/604808681 wait complete. 2023-09-30T22:29:51.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.300+0000 7f8e3d4d4700 1 Processor -- start 2023-09-30T22:29:51.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.300+0000 7f8e3d4d4700 1 -- start start 2023-09-30T22:29:51.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e3d4d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e38130540 0x7f8e3809b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e3d4d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e38133540 0x7f8e3809b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e3d4d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e38135e60 0x7f8e381c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e3d4d4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3812bc50 con 0x7f8e38135e60 2023-09-30T22:29:51.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e3d4d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3809d190 con 0x7f8e38133540 2023-09-30T22:29:51.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e3d4d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380718e0 con 0x7f8e38130540 2023-09-30T22:29:51.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f641e352700 1 Processor -- start 2023-09-30T22:29:51.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e36ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e38130540 0x7f8e3809b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e36ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e38130540 0x7f8e3809b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43052/0 (socket says 172.21.15.59:43052) 2023-09-30T22:29:51.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e36ffd700 1 -- 172.21.15.59:0/3578527684 learned_addr learned my addr 172.21.15.59:0/3578527684 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:51.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e377fe700 1 --2- 172.21.15.59:0/3578527684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e38135e60 0x7f8e381c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e377fe700 1 -- 172.21.15.59:0/3578527684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e38130540 msgr2=0x7f8e3809b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e377fe700 1 --2- 172.21.15.59:0/3578527684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e38130540 0x7f8e3809b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e377fe700 1 -- 172.21.15.59:0/3578527684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e38133540 msgr2=0x7f8e3809b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e377fe700 1 --2- 172.21.15.59:0/3578527684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e38133540 0x7f8e3809b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e377fe700 1 -- 172.21.15.59:0/3578527684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c00b740 con 0x7f8e38135e60 2023-09-30T22:29:51.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f8e36ffd700 1 --2- 172.21.15.59:0/3578527684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e38130540 0x7f8e3809b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:51.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f8e377fe700 1 --2- 172.21.15.59:0/3578527684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e38135e60 0x7f8e381c84e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000bdf0 tx=0x7f8e30009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f8e1f7fe700 1 -- 172.21.15.59:0/3578527684 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3000cc10 con 0x7f8e38135e60 2023-09-30T22:29:51.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f8e3d4d4700 1 -- 172.21.15.59:0/3578527684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3809af30 con 0x7f8e38135e60 2023-09-30T22:29:51.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f8e3d4d4700 1 -- 172.21.15.59:0/3578527684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3811d590 con 0x7f8e38135e60 2023-09-30T22:29:51.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f8e1f7fe700 1 -- 172.21.15.59:0/3578527684 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3000cd90 con 0x7f8e38135e60 2023-09-30T22:29:51.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f8e1f7fe700 1 -- 172.21.15.59:0/3578527684 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30014680 con 0x7f8e38135e60 2023-09-30T22:29:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.301+0000 7f641e352700 1 -- start start 2023-09-30T22:29:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f641e352700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6418133420 0x7f64181300f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f641e352700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64181337f0 0x7f6418137ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f641e352700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6418138dc0 0x7f6418138220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f641e352700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641812f650 con 0x7f64181337f0 2023-09-30T22:29:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f641e352700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641812f360 con 0x7f6418133420 2023-09-30T22:29:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f641e352700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6418134760 con 0x7f6418138dc0 2023-09-30T22:29:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f641c8ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6418138dc0 0x7f6418138220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f641c8ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6418138dc0 0x7f6418138220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43054/0 (socket says 172.21.15.59:43054) 2023-09-30T22:29:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f641c8ef700 1 -- 172.21.15.59:0/3736033438 learned_addr learned my addr 172.21.15.59:0/3736033438 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.302+0000 7f6417fff700 1 --2- 172.21.15.59:0/3736033438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6418133420 0x7f64181300f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.303+0000 7f641c8ef700 1 -- 172.21.15.59:0/3736033438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6418133420 msgr2=0x7f64181300f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.303+0000 7f641c8ef700 1 --2- 172.21.15.59:0/3736033438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6418133420 0x7f64181300f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.303+0000 7f641c8ef700 1 -- 172.21.15.59:0/3736033438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64181337f0 msgr2=0x7f6418137ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.303+0000 7f641c8ef700 1 --2- 172.21.15.59:0/3736033438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64181337f0 0x7f6418137ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.303+0000 7f641c8ef700 1 -- 172.21.15.59:0/3736033438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c009550 con 0x7f6418138dc0 2023-09-30T22:29:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.303+0000 7f641c8ef700 1 --2- 172.21.15.59:0/3736033438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6418138dc0 0x7f6418138220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f641000efc0 tx=0x7f641000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.303+0000 7f6414ff9700 1 -- 172.21.15.59:0/3736033438 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641000cd40 con 0x7f6418138dc0 2023-09-30T22:29:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.303+0000 7f6414ff9700 1 -- 172.21.15.59:0/3736033438 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641000f040 con 0x7f6418138dc0 2023-09-30T22:29:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.303+0000 7f6414ff9700 1 -- 172.21.15.59:0/3736033438 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64100146c0 con 0x7f6418138dc0 2023-09-30T22:29:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.304+0000 7f8e3d4d4700 1 -- 172.21.15.59:0/3578527684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e180052e0 con 0x7f8e38135e60 2023-09-30T22:29:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.304+0000 7f8e1f7fe700 1 -- 172.21.15.59:0/3578527684 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8e3001d3b0 con 0x7f8e38135e60 2023-09-30T22:29:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.303+0000 7f641e352700 1 -- 172.21.15.59:0/3736033438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641812f910 con 0x7f6418138dc0 2023-09-30T22:29:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.304+0000 7f641e352700 1 -- 172.21.15.59:0/3736033438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64181307d0 con 0x7f6418138dc0 2023-09-30T22:29:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.304+0000 7f8e1f7fe700 1 -- 172.21.15.59:0/3578527684 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8e30006e40 con 0x7f8e38135e60 2023-09-30T22:29:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.304+0000 7f8e36ffd700 1 -- 172.21.15.59:0/3578527684 >> v1:172.21.15.59:6816/126772 conn(0x7f8e2402f510 legacy=0x7f8e240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:51.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.305+0000 7f641e352700 1 -- 172.21.15.59:0/3736033438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f641812fb30 con 0x7f6418138dc0 2023-09-30T22:29:51.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.309+0000 7f8e1f7fe700 1 -- 172.21.15.59:0/3578527684 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e3001c360 con 0x7f8e38135e60 2023-09-30T22:29:51.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.310+0000 7f6414ff9700 1 -- 172.21.15.59:0/3736033438 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6410014820 con 0x7f6418138dc0 2023-09-30T22:29:51.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.311+0000 7f6414ff9700 1 -- 172.21.15.59:0/3736033438 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f6410040fc0 con 0x7f6418138dc0 2023-09-30T22:29:51.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.311+0000 7f6417fff700 1 -- 172.21.15.59:0/3736033438 >> v1:172.21.15.59:6816/126772 conn(0x7f640402f510 legacy=0x7f64040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:51.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.312+0000 7f6414ff9700 1 -- 172.21.15.59:0/3736033438 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6410007330 con 0x7f6418138dc0 2023-09-30T22:29:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.412+0000 7f8bdd9c4700 1 -- 172.21.15.59:0/2729002279 >> v1:172.21.15.59:6816/126772 conn(0x7f8bbc02f510 legacy=0x7f8bbc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:51.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.439+0000 7f8bdfc28700 1 -- 172.21.15.59:0/2729002279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8bd8122580 con 0x7f8bd81338a0 2023-09-30T22:29:51.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.440+0000 7f8bce7fc700 1 -- 172.21.15.59:0/2729002279 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bd00192c0 con 0x7f8bd81338a0 2023-09-30T22:29:51.441 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:51.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.442+0000 7f8bdfc28700 1 -- 172.21.15.59:0/2729002279 >> v1:172.21.15.59:6816/126772 conn(0x7f8bbc02f510 legacy=0x7f8bbc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:51.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.442+0000 7f8bdfc28700 1 -- 172.21.15.59:0/2729002279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bd81338a0 msgr2=0x7f8bd811f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.442+0000 7f8bdfc28700 1 --2- 172.21.15.59:0/2729002279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bd81338a0 0x7f8bd811f580 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000cbf0 tx=0x7f8bd000cf00 comp rx=0 tx=0).stop 2023-09-30T22:29:51.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.442+0000 7f8bdfc28700 1 -- 172.21.15.59:0/2729002279 shutdown_connections 2023-09-30T22:29:51.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.442+0000 7f8bdfc28700 1 --2- 172.21.15.59:0/2729002279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bd81338a0 0x7f8bd811f580 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.442+0000 7f8bdfc28700 1 --2- 172.21.15.59:0/2729002279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bd809de50 0x7f8bd811eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.442+0000 7f8bdfc28700 1 --2- 172.21.15.59:0/2729002279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bd809e760 0x7f8bd811f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.442+0000 7f8bdfc28700 1 -- 172.21.15.59:0/2729002279 >> 172.21.15.59:0/2729002279 conn(0x7f8bd80a2aa0 msgr2=0x7f8bd809edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.442+0000 7f8bdfc28700 1 -- 172.21.15.59:0/2729002279 shutdown_connections 2023-09-30T22:29:51.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.442+0000 7f8bdfc28700 1 -- 172.21.15.59:0/2729002279 wait complete. 2023-09-30T22:29:51.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.456+0000 7f04a5b8c700 1 -- 172.21.15.59:0/1905795438 >> v1:172.21.15.59:6816/126772 conn(0x7f048402f510 legacy=0x7f04840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:51.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:51.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.505+0000 7f8e36ffd700 1 -- 172.21.15.59:0/3578527684 >> v1:172.21.15.59:6816/126772 conn(0x7f8e2402f510 legacy=0x7f8e240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:51.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.506+0000 7f04a7df0700 1 -- 172.21.15.59:0/1905795438 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f04a0074ea0 con 0x7f04a009e000 2023-09-30T22:29:51.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.507+0000 7f04967fc700 1 -- 172.21.15.59:0/1905795438 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0490028020 con 0x7f04a009e000 2023-09-30T22:29:51.508 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:51.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.509+0000 7f04a7df0700 1 -- 172.21.15.59:0/1905795438 >> v1:172.21.15.59:6816/126772 conn(0x7f048402f510 legacy=0x7f04840319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:51.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.509+0000 7f04a7df0700 1 -- 172.21.15.59:0/1905795438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a009e000 msgr2=0x7f04a01228d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.509+0000 7f04a7df0700 1 --2- 172.21.15.59:0/1905795438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a009e000 0x7f04a01228d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0490018000 tx=0x7f0490004750 comp rx=0 tx=0).stop 2023-09-30T22:29:51.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.509+0000 7f04a7df0700 1 -- 172.21.15.59:0/1905795438 shutdown_connections 2023-09-30T22:29:51.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.509+0000 7f04a7df0700 1 --2- 172.21.15.59:0/1905795438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a009e410 0x7f04a0122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.509+0000 7f04a7df0700 1 --2- 172.21.15.59:0/1905795438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a009d6f0 0x7f04a0122390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.509+0000 7f04a7df0700 1 --2- 172.21.15.59:0/1905795438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a009e000 0x7f04a01228d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.509+0000 7f04a7df0700 1 -- 172.21.15.59:0/1905795438 >> 172.21.15.59:0/1905795438 conn(0x7f04a0066f50 msgr2=0x7f04a00710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.509+0000 7f04a7df0700 1 -- 172.21.15.59:0/1905795438 shutdown_connections 2023-09-30T22:29:51.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.509+0000 7f04a7df0700 1 -- 172.21.15.59:0/1905795438 wait complete. 2023-09-30T22:29:51.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.512+0000 7f6417fff700 1 -- 172.21.15.59:0/3736033438 >> v1:172.21.15.59:6816/126772 conn(0x7f640402f510 legacy=0x7f64040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:51.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.522+0000 7f8e3d4d4700 1 -- 172.21.15.59:0/3578527684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e18005860 con 0x7f8e38135e60 2023-09-30T22:29:51.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.522+0000 7f8e1f7fe700 1 -- 172.21.15.59:0/3578527684 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e30019030 con 0x7f8e38135e60 2023-09-30T22:29:51.523 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:51.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:51.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.524+0000 7f8e3d4d4700 1 -- 172.21.15.59:0/3578527684 >> v1:172.21.15.59:6816/126772 conn(0x7f8e2402f510 legacy=0x7f8e240319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.524+0000 7f8e3d4d4700 1 -- 172.21.15.59:0/3578527684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e38135e60 msgr2=0x7f8e381c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.524+0000 7f8e3d4d4700 1 --2- 172.21.15.59:0/3578527684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e38135e60 0x7f8e381c84e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000bdf0 tx=0x7f8e30009ed0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.524+0000 7f8e3d4d4700 1 -- 172.21.15.59:0/3578527684 shutdown_connections 2023-09-30T22:29:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.524+0000 7f8e3d4d4700 1 --2- 172.21.15.59:0/3578527684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e38130540 0x7f8e3809b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.524+0000 7f8e3d4d4700 1 --2- 172.21.15.59:0/3578527684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e38135e60 0x7f8e381c84e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.524+0000 7f8e3d4d4700 1 --2- 172.21.15.59:0/3578527684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e38133540 0x7f8e3809b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.524+0000 7f8e3d4d4700 1 -- 172.21.15.59:0/3578527684 >> 172.21.15.59:0/3578527684 conn(0x7f8e380a2aa0 msgr2=0x7f8e38067900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.525+0000 7f8e3d4d4700 1 -- 172.21.15.59:0/3578527684 shutdown_connections 2023-09-30T22:29:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.525+0000 7f8e3d4d4700 1 -- 172.21.15.59:0/3578527684 wait complete. 2023-09-30T22:29:51.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:51.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.556+0000 7f641e352700 1 -- 172.21.15.59:0/3736033438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6418131830 con 0x7f6418138dc0 2023-09-30T22:29:51.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.556+0000 7f6414ff9700 1 -- 172.21.15.59:0/3736033438 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f641002a020 con 0x7f6418138dc0 2023-09-30T22:29:51.557 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:51.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.559+0000 7f641e352700 1 -- 172.21.15.59:0/3736033438 >> v1:172.21.15.59:6816/126772 conn(0x7f640402f510 legacy=0x7f64040319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:51.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.559+0000 7f641e352700 1 -- 172.21.15.59:0/3736033438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6418138dc0 msgr2=0x7f6418138220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.559+0000 7f641e352700 1 --2- 172.21.15.59:0/3736033438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6418138dc0 0x7f6418138220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f641000efc0 tx=0x7f641000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.559+0000 7f641e352700 1 -- 172.21.15.59:0/3736033438 shutdown_connections 2023-09-30T22:29:51.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.559+0000 7f641e352700 1 --2- 172.21.15.59:0/3736033438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6418138dc0 0x7f6418138220 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.559+0000 7f641e352700 1 --2- 172.21.15.59:0/3736033438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6418133420 0x7f64181300f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.559+0000 7f641e352700 1 --2- 172.21.15.59:0/3736033438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64181337f0 0x7f6418137ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.559+0000 7f641e352700 1 -- 172.21.15.59:0/3736033438 >> 172.21.15.59:0/3736033438 conn(0x7f64180a4210 msgr2=0x7f64180a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.559+0000 7f641e352700 1 -- 172.21.15.59:0/3736033438 shutdown_connections 2023-09-30T22:29:51.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:51.559+0000 7f641e352700 1 -- 172.21.15.59:0/3736033438 wait complete. 2023-09-30T22:29:51.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:52.458 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:52.525 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:52.540 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:52.574 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:52.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.612+0000 7fc58f0ad700 1 Processor -- start 2023-09-30T22:29:52.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.612+0000 7fc58f0ad700 1 -- start start 2023-09-30T22:29:52.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.612+0000 7fc58f0ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc58809d6f0 0x7fc58809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.612+0000 7fc58f0ad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc58809e000 0x7fc5881339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.612+0000 7fc58f0ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc58809e410 0x7fc588133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.612+0000 7fc58f0ad700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58806b460 con 0x7fc58809e000 2023-09-30T22:29:52.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.612+0000 7fc58f0ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58809b120 con 0x7fc58809d6f0 2023-09-30T22:29:52.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.612+0000 7fc58f0ad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc58809a7e0 con 0x7fc58809e410 2023-09-30T22:29:52.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.613+0000 7fc587fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc58809e000 0x7fc5881339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.613+0000 7fc58ce49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc58809d6f0 0x7fc58809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.613+0000 7fc587fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc58809e000 0x7fc5881339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37646/0 (socket says 172.21.15.59:37646) 2023-09-30T22:29:52.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.613+0000 7fc587fff700 1 -- 172.21.15.59:0/2973953307 learned_addr learned my addr 172.21.15.59:0/2973953307 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:52.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.613+0000 7fc58d64a700 1 --2- 172.21.15.59:0/2973953307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc58809e410 0x7fc588133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.613+0000 7fc587fff700 1 -- 172.21.15.59:0/2973953307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc58809e410 msgr2=0x7fc588133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.613+0000 7fc587fff700 1 --2- 172.21.15.59:0/2973953307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc58809e410 0x7fc588133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.613+0000 7fc587fff700 1 -- 172.21.15.59:0/2973953307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc58809d6f0 msgr2=0x7fc58809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.613+0000 7fc587fff700 1 --2- 172.21.15.59:0/2973953307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc58809d6f0 0x7fc58809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.613+0000 7fc587fff700 1 -- 172.21.15.59:0/2973953307 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58809a500 con 0x7fc58809e000 2023-09-30T22:29:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.613+0000 7fc587fff700 1 --2- 172.21.15.59:0/2973953307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc58809e000 0x7fc5881339f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc5740098f0 tx=0x7fc574009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7a658a3d595387 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.614+0000 7fc5877fe700 1 -- 172.21.15.59:0/2973953307 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574011830 con 0x7fc58809e000 2023-09-30T22:29:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.614+0000 7fc5877fe700 1 -- 172.21.15.59:0/2973953307 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc574011990 con 0x7fc58809e000 2023-09-30T22:29:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.614+0000 7fc5877fe700 1 -- 172.21.15.59:0/2973953307 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574011d20 con 0x7fc58809e000 2023-09-30T22:29:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.614+0000 7fc58f0ad700 1 -- 172.21.15.59:0/2973953307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc58809e000 msgr2=0x7fc5881339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.614+0000 7fc58f0ad700 1 --2- 172.21.15.59:0/2973953307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc58809e000 0x7fc5881339f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc5740098f0 tx=0x7fc574009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:52.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.615+0000 7fc58f0ad700 1 -- 172.21.15.59:0/2973953307 shutdown_connections 2023-09-30T22:29:52.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.615+0000 7fc58f0ad700 1 --2- 172.21.15.59:0/2973953307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc58809e410 0x7fc588133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.615+0000 7fc58f0ad700 1 --2- 172.21.15.59:0/2973953307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc58809d6f0 0x7fc58809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.615+0000 7fc58f0ad700 1 --2- 172.21.15.59:0/2973953307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc58809e000 0x7fc5881339f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.615+0000 7fc58f0ad700 1 -- 172.21.15.59:0/2973953307 >> 172.21.15.59:0/2973953307 conn(0x7fc588066f50 msgr2=0x7fc58809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.615+0000 7fc58f0ad700 1 -- 172.21.15.59:0/2973953307 shutdown_connections 2023-09-30T22:29:52.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.615+0000 7fc58f0ad700 1 -- 172.21.15.59:0/2973953307 wait complete. 2023-09-30T22:29:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.616+0000 7fc58f0ad700 1 Processor -- start 2023-09-30T22:29:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.616+0000 7fc58f0ad700 1 -- start start 2023-09-30T22:29:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc58f0ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc58809d6f0 0x7fc588119720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc58f0ad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc58809e000 0x7fc588119c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc58f0ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc58809e410 0x7fc58811a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc58f0ad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5881b95c0 con 0x7fc58809e000 2023-09-30T22:29:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc58f0ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58811ccf0 con 0x7fc58809d6f0 2023-09-30T22:29:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc58f0ad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880a2160 con 0x7fc58809e410 2023-09-30T22:29:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc58ce49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc58809d6f0 0x7fc588119720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc58ce49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc58809d6f0 0x7fc588119720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54158/0 (socket says 172.21.15.59:54158) 2023-09-30T22:29:52.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc58ce49700 1 -- 172.21.15.59:0/991930437 learned_addr learned my addr 172.21.15.59:0/991930437 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:52.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc587fff700 1 --2- 172.21.15.59:0/991930437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc58809e000 0x7fc588119c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc58d64a700 1 --2- 172.21.15.59:0/991930437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc58809e410 0x7fc58811a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc587fff700 1 -- 172.21.15.59:0/991930437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc58809e410 msgr2=0x7fc58811a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc587fff700 1 --2- 172.21.15.59:0/991930437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc58809e410 0x7fc58811a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc587fff700 1 -- 172.21.15.59:0/991930437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc58809d6f0 msgr2=0x7fc588119720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc587fff700 1 --2- 172.21.15.59:0/991930437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc58809d6f0 0x7fc588119720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.617+0000 7fc587fff700 1 -- 172.21.15.59:0/991930437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574009550 con 0x7fc58809e000 2023-09-30T22:29:52.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.618+0000 7fc587fff700 1 --2- 172.21.15.59:0/991930437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc58809e000 0x7fc588119c60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc574016000 tx=0x7fc574004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.618+0000 7fc5857fa700 1 -- 172.21.15.59:0/991930437 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574004240 con 0x7fc58809e000 2023-09-30T22:29:52.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.618+0000 7fc5857fa700 1 -- 172.21.15.59:0/991930437 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57401f070 con 0x7fc58809e000 2023-09-30T22:29:52.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.618+0000 7fc58f0ad700 1 -- 172.21.15.59:0/991930437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58809c710 con 0x7fc58809e000 2023-09-30T22:29:52.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.618+0000 7fc5857fa700 1 -- 172.21.15.59:0/991930437 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740045a0 con 0x7fc58809e000 2023-09-30T22:29:52.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.618+0000 7fc58f0ad700 1 -- 172.21.15.59:0/991930437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58811cfd0 con 0x7fc58809e000 2023-09-30T22:29:52.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.619+0000 7fc5857fa700 1 -- 172.21.15.59:0/991930437 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc574021030 con 0x7fc58809e000 2023-09-30T22:29:52.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.619+0000 7fc58f0ad700 1 -- 172.21.15.59:0/991930437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc588074ea0 con 0x7fc58809e000 2023-09-30T22:29:52.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.619+0000 7fc5857fa700 1 -- 172.21.15.59:0/991930437 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc574040d40 con 0x7fc58809e000 2023-09-30T22:29:52.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.619+0000 7fc58ce49700 1 -- 172.21.15.59:0/991930437 >> v1:172.21.15.59:6816/126772 conn(0x7fc56c02f510 legacy=0x7fc56c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.625+0000 7fc5857fa700 1 -- 172.21.15.59:0/991930437 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc57401a450 con 0x7fc58809e000 2023-09-30T22:29:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.684+0000 7f258a269700 1 Processor -- start 2023-09-30T22:29:52.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.684+0000 7f258a269700 1 -- start start 2023-09-30T22:29:52.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.685+0000 7f258a269700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25840a0a30 0x7f25840a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.685+0000 7f258a269700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f258409d630 0x7f25840a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.685+0000 7f258a269700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25840a2a70 con 0x7f2584133930 2023-09-30T22:29:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.685+0000 7f258a269700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25840a01d0 con 0x7f25840a0a30 2023-09-30T22:29:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.685+0000 7f258a269700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f258409e2b0 con 0x7f258409d630 2023-09-30T22:29:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.685+0000 7f2583fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25840a0a30 0x7f25840a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.685+0000 7f2583fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25840a0a30 0x7f25840a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54170/0 (socket says 172.21.15.59:54170) 2023-09-30T22:29:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.685+0000 7f2583fff700 1 -- 172.21.15.59:0/1495515687 learned_addr learned my addr 172.21.15.59:0/1495515687 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.685+0000 7f25837fe700 1 --2- 172.21.15.59:0/1495515687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f258409d630 0x7f25840a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.686+0000 7f2583fff700 1 -- 172.21.15.59:0/1495515687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f258409d630 msgr2=0x7f25840a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.686+0000 7f2583fff700 1 --2- 172.21.15.59:0/1495515687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f258409d630 0x7f25840a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.686+0000 7f2583fff700 1 -- 172.21.15.59:0/1495515687 >> v1:172.21.15.59:6789/0 conn(0x7f2584133930 legacy=0x7f2584133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.686+0000 7f2583fff700 1 -- 172.21.15.59:0/1495515687 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258409dc50 con 0x7f25840a0a30 2023-09-30T22:29:52.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.686+0000 7f2583fff700 1 --2- 172.21.15.59:0/1495515687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25840a0a30 0x7f25840a0e00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2574009920 tx=0x7f2574009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42307bb9f154fa9c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.686+0000 7f2582ffd700 1 -- 172.21.15.59:0/1495515687 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574011830 con 0x7f25840a0a30 2023-09-30T22:29:52.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.686+0000 7f2582ffd700 1 -- 172.21.15.59:0/1495515687 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2574011990 con 0x7f25840a0a30 2023-09-30T22:29:52.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.686+0000 7f2582ffd700 1 -- 172.21.15.59:0/1495515687 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574011d20 con 0x7f25840a0a30 2023-09-30T22:29:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.687+0000 7f258a269700 1 -- 172.21.15.59:0/1495515687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25840a0a30 msgr2=0x7f25840a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.687+0000 7f258a269700 1 --2- 172.21.15.59:0/1495515687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25840a0a30 0x7f25840a0e00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2574009920 tx=0x7f2574009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.687+0000 7f258a269700 1 -- 172.21.15.59:0/1495515687 shutdown_connections 2023-09-30T22:29:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.687+0000 7f258a269700 1 --2- 172.21.15.59:0/1495515687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25840a0a30 0x7f25840a0e00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.687+0000 7f258a269700 1 --2- 172.21.15.59:0/1495515687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f258409d630 0x7f25840a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.687+0000 7f258a269700 1 -- 172.21.15.59:0/1495515687 >> 172.21.15.59:0/1495515687 conn(0x7f25840a3050 msgr2=0x7f25840a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.687+0000 7f258a269700 1 -- 172.21.15.59:0/1495515687 shutdown_connections 2023-09-30T22:29:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.688+0000 7f258a269700 1 -- 172.21.15.59:0/1495515687 wait complete. 2023-09-30T22:29:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.689+0000 7f258a269700 1 Processor -- start 2023-09-30T22:29:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.689+0000 7f258a269700 1 -- start start 2023-09-30T22:29:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.690+0000 7f258a269700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409d630 0x7f258411f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.690+0000 7f258a269700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25840a0a30 0x7f258411f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.690+0000 7f258a269700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2584133930 0x7f25841c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.690+0000 7f258a269700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2584121e70 con 0x7f25840a0a30 2023-09-30T22:29:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.690+0000 7f258a269700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258411eea0 con 0x7f258409d630 2023-09-30T22:29:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.690+0000 7f258a269700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25841211e0 con 0x7f2584133930 2023-09-30T22:29:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.690+0000 7f25837fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25840a0a30 0x7f258411f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.690+0000 7f25837fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25840a0a30 0x7f258411f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37668/0 (socket says 172.21.15.59:37668) 2023-09-30T22:29:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.690+0000 7f25837fe700 1 -- 172.21.15.59:0/2029129296 learned_addr learned my addr 172.21.15.59:0/2029129296 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.690+0000 7f2588806700 1 --2- 172.21.15.59:0/2029129296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2584133930 0x7f25841c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.690+0000 7f2583fff700 1 --2- 172.21.15.59:0/2029129296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409d630 0x7f258411f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.691+0000 7f2583fff700 1 -- 172.21.15.59:0/2029129296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2584133930 msgr2=0x7f25841c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.691+0000 7f2583fff700 1 --2- 172.21.15.59:0/2029129296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2584133930 0x7f25841c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.691+0000 7f2583fff700 1 -- 172.21.15.59:0/2029129296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25840a0a30 msgr2=0x7f258411f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.691+0000 7f2583fff700 1 --2- 172.21.15.59:0/2029129296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25840a0a30 0x7f258411f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.691+0000 7f2583fff700 1 -- 172.21.15.59:0/2029129296 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574009550 con 0x7f258409d630 2023-09-30T22:29:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.691+0000 7f25837fe700 1 --2- 172.21.15.59:0/2029129296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25840a0a30 0x7f258411f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.691+0000 7f2583fff700 1 --2- 172.21.15.59:0/2029129296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409d630 0x7f258411f2d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2574016000 tx=0x7f2574004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.691+0000 7f2580ff9700 1 -- 172.21.15.59:0/2029129296 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574004450 con 0x7f258409d630 2023-09-30T22:29:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.691+0000 7f2580ff9700 1 -- 172.21.15.59:0/2029129296 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25740045b0 con 0x7f258409d630 2023-09-30T22:29:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.691+0000 7f258a269700 1 -- 172.21.15.59:0/2029129296 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2584122130 con 0x7f258409d630 2023-09-30T22:29:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.691+0000 7f258a269700 1 -- 172.21.15.59:0/2029129296 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2584122410 con 0x7f258409d630 2023-09-30T22:29:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.692+0000 7f2580ff9700 1 -- 172.21.15.59:0/2029129296 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25740038e0 con 0x7f258409d630 2023-09-30T22:29:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.693+0000 7f2580ff9700 1 -- 172.21.15.59:0/2029129296 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2574021020 con 0x7f258409d630 2023-09-30T22:29:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.693+0000 7f258a269700 1 -- 172.21.15.59:0/2029129296 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25840008d0 con 0x7f258409d630 2023-09-30T22:29:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.693+0000 7f25837fe700 1 -- 172.21.15.59:0/2029129296 >> v1:172.21.15.59:6816/126772 conn(0x7f257002f560 legacy=0x7f2570031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.693+0000 7f2580ff9700 1 -- 172.21.15.59:0/2029129296 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f2574040fc0 con 0x7f258409d630 2023-09-30T22:29:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.698+0000 7f2580ff9700 1 -- 172.21.15.59:0/2029129296 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25740239c0 con 0x7f258409d630 2023-09-30T22:29:52.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.716+0000 7f8e7846c700 1 Processor -- start 2023-09-30T22:29:52.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.716+0000 7f8e7846c700 1 -- start start 2023-09-30T22:29:52.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.716+0000 7f8e7846c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e70130540 0x7f8e70130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.716+0000 7f8e7846c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e70130e50 0x7f8e7006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.716+0000 7f8e7846c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e7006fb20 0x7f8e7006ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.716+0000 7f8e7846c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e7009a390 con 0x7f8e70130540 2023-09-30T22:29:52.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.716+0000 7f8e7846c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700716a0 con 0x7f8e70130e50 2023-09-30T22:29:52.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.716+0000 7f8e7846c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70071290 con 0x7f8e7006fb20 2023-09-30T22:29:52.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.717+0000 7f8e76a09700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e7006fb20 0x7f8e7006ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.717+0000 7f8e76208700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e70130540 0x7f8e70130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.717+0000 7f8e76a09700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e7006fb20 0x7f8e7006ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43106/0 (socket says 172.21.15.59:43106) 2023-09-30T22:29:52.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.717+0000 7f8e76a09700 1 -- 172.21.15.59:0/2038617930 learned_addr learned my addr 172.21.15.59:0/2038617930 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:52.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.717+0000 7f8e75a07700 1 --2- 172.21.15.59:0/2038617930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e70130e50 0x7f8e7006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.717+0000 7f8e76a09700 1 -- 172.21.15.59:0/2038617930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e70130e50 msgr2=0x7f8e7006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:52.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.717+0000 7f8e76a09700 1 --2- 172.21.15.59:0/2038617930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e70130e50 0x7f8e7006f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.717+0000 7f8e76a09700 1 -- 172.21.15.59:0/2038617930 >> v2:172.21.15.59:3300/0 conn(0x7f8e70130540 msgr2=0x7f8e70130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:52.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.717+0000 7f8e76a09700 1 --2- 172.21.15.59:0/2038617930 >> v2:172.21.15.59:3300/0 conn(0x7f8e70130540 0x7f8e70130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.717+0000 7f8e76a09700 1 -- 172.21.15.59:0/2038617930 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e70130340 con 0x7f8e7006fb20 2023-09-30T22:29:52.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.718+0000 7f8e76a09700 1 --2- 172.21.15.59:0/2038617930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e7006fb20 0x7f8e7006ffa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800d150 tx=0x7f8e6800d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bd4cefc51705edf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.718+0000 7f8e75206700 1 -- 172.21.15.59:0/2038617930 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68010070 con 0x7f8e7006fb20 2023-09-30T22:29:52.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.718+0000 7f8e75206700 1 -- 172.21.15.59:0/2038617930 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6800dd10 con 0x7f8e7006fb20 2023-09-30T22:29:52.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.718+0000 7f8e75206700 1 -- 172.21.15.59:0/2038617930 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6800b310 con 0x7f8e7006fb20 2023-09-30T22:29:52.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.718+0000 7f8e7846c700 1 -- 172.21.15.59:0/2038617930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e7006fb20 msgr2=0x7f8e7006ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.718+0000 7f8e7846c700 1 --2- 172.21.15.59:0/2038617930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e7006fb20 0x7f8e7006ffa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800d150 tx=0x7f8e6800d460 comp rx=0 tx=0).stop 2023-09-30T22:29:52.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.719+0000 7f8e7846c700 1 -- 172.21.15.59:0/2038617930 shutdown_connections 2023-09-30T22:29:52.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.719+0000 7f8e7846c700 1 --2- 172.21.15.59:0/2038617930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e7006fb20 0x7f8e7006ffa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.719+0000 7f8e7846c700 1 --2- 172.21.15.59:0/2038617930 >> v2:172.21.15.59:3300/0 conn(0x7f8e70130540 0x7f8e70130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.719+0000 7f8e7846c700 1 --2- 172.21.15.59:0/2038617930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e70130e50 0x7f8e7006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.719+0000 7f8e7846c700 1 -- 172.21.15.59:0/2038617930 >> 172.21.15.59:0/2038617930 conn(0x7f8e700a2aa0 msgr2=0x7f8e700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.719+0000 7f8e7846c700 1 -- 172.21.15.59:0/2038617930 shutdown_connections 2023-09-30T22:29:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.719+0000 7f8e7846c700 1 -- 172.21.15.59:0/2038617930 wait complete. 2023-09-30T22:29:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.720+0000 7f8e7846c700 1 Processor -- start 2023-09-30T22:29:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.720+0000 7f8e7846c700 1 -- start start 2023-09-30T22:29:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.720+0000 7f8e7846c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e7006fb20 0x7f8e7011eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.720+0000 7f8e7846c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e70130540 0x7f8e7011f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.720+0000 7f8e7846c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e70130e50 0x7f8e7011f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.720+0000 7f8e7846c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70120840 con 0x7f8e70130540 2023-09-30T22:29:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.720+0000 7f8e7846c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7012ca60 con 0x7f8e7006fb20 2023-09-30T22:29:52.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.720+0000 7f8e7846c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700718e0 con 0x7f8e70130e50 2023-09-30T22:29:52.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.721+0000 7f8e76a09700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e70130e50 0x7f8e7011f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.721+0000 7f8e76a09700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e70130e50 0x7f8e7011f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43114/0 (socket says 172.21.15.59:43114) 2023-09-30T22:29:52.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.721+0000 7f8e76a09700 1 -- 172.21.15.59:0/3212940191 learned_addr learned my addr 172.21.15.59:0/3212940191 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:52.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.721+0000 7f8e76208700 1 --2- 172.21.15.59:0/3212940191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e7006fb20 0x7f8e7011eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.721+0000 7f8e75a07700 1 --2- 172.21.15.59:0/3212940191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e70130540 0x7f8e7011f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.721+0000 7f8e76a09700 1 -- 172.21.15.59:0/3212940191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e7006fb20 msgr2=0x7f8e7011eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.721+0000 7f8e76a09700 1 --2- 172.21.15.59:0/3212940191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e7006fb20 0x7f8e7011eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.721+0000 7f8e76a09700 1 -- 172.21.15.59:0/3212940191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e70130540 msgr2=0x7f8e7011f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.721+0000 7f8e76a09700 1 --2- 172.21.15.59:0/3212940191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e70130540 0x7f8e7011f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.721+0000 7f8e76a09700 1 -- 172.21.15.59:0/3212940191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6800bd40 con 0x7f8e70130e50 2023-09-30T22:29:52.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.721+0000 7f8e76a09700 1 --2- 172.21.15.59:0/3212940191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e70130e50 0x7f8e7011f5d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800d4a0 tx=0x7f8e68004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.721+0000 7f8e66ffd700 1 -- 172.21.15.59:0/3212940191 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68009a10 con 0x7f8e70130e50 2023-09-30T22:29:52.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.722+0000 7f8e66ffd700 1 -- 172.21.15.59:0/3212940191 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e68009b90 con 0x7f8e70130e50 2023-09-30T22:29:52.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.722+0000 7f8e66ffd700 1 -- 172.21.15.59:0/3212940191 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68003e50 con 0x7f8e70130e50 2023-09-30T22:29:52.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.722+0000 7f8e7846c700 1 -- 172.21.15.59:0/3212940191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e70122030 con 0x7f8e70130e50 2023-09-30T22:29:52.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.722+0000 7f8e7846c700 1 -- 172.21.15.59:0/3212940191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e70122d60 con 0x7f8e70130e50 2023-09-30T22:29:52.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.723+0000 7f8e66ffd700 1 -- 172.21.15.59:0/3212940191 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8e68004040 con 0x7f8e70130e50 2023-09-30T22:29:52.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.723+0000 7f8e7846c700 1 -- 172.21.15.59:0/3212940191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e700a1330 con 0x7f8e70130e50 2023-09-30T22:29:52.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.723+0000 7f8e66ffd700 1 -- 172.21.15.59:0/3212940191 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8e680415b0 con 0x7f8e70130e50 2023-09-30T22:29:52.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.727+0000 7f8e76208700 1 -- 172.21.15.59:0/3212940191 >> v1:172.21.15.59:6816/126772 conn(0x7f8e5402f510 legacy=0x7f8e540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:52.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.732+0000 7f8e66ffd700 1 -- 172.21.15.59:0/3212940191 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e68013980 con 0x7f8e70130e50 2023-09-30T22:29:52.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.761+0000 7ff667571700 1 Processor -- start 2023-09-30T22:29:52.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.761+0000 7ff667571700 1 -- start start 2023-09-30T22:29:52.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.762+0000 7ff667571700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff66009d6f0 0x7ff66009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.762+0000 7ff667571700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff66009e000 0x7ff660130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.762+0000 7ff667571700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66009f130 con 0x7ff66009e410 2023-09-30T22:29:52.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.762+0000 7ff667571700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66009f520 con 0x7ff66009d6f0 2023-09-30T22:29:52.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.762+0000 7ff667571700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff66009e930 con 0x7ff66009e000 2023-09-30T22:29:52.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.762+0000 7ff664b0c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff66009e000 0x7ff660130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.762+0000 7ff665b0e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff66009e410 0x7ff660130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33996/0 (socket says 172.21.15.59:33996) 2023-09-30T22:29:52.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.762+0000 7ff665b0e700 1 -- 172.21.15.59:0/4016760462 learned_addr learned my addr 172.21.15.59:0/4016760462 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:52.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.762+0000 7ff66530d700 1 --2- 172.21.15.59:0/4016760462 >> v2:172.21.15.59:3300/0 conn(0x7ff66009d6f0 0x7ff66009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.763+0000 7ff664b0c700 1 -- 172.21.15.59:0/4016760462 >> v2:172.21.15.59:3300/0 conn(0x7ff66009d6f0 msgr2=0x7ff66009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:52.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.763+0000 7ff664b0c700 1 --2- 172.21.15.59:0/4016760462 >> v2:172.21.15.59:3300/0 conn(0x7ff66009d6f0 0x7ff66009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.763+0000 7ff664b0c700 1 -- 172.21.15.59:0/4016760462 >> v1:172.21.15.59:6789/0 conn(0x7ff66009e410 legacy=0x7ff660130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.763+0000 7ff664b0c700 1 -- 172.21.15.59:0/4016760462 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66009b2d0 con 0x7ff66009e000 2023-09-30T22:29:52.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.763+0000 7ff657fff700 1 -- 172.21.15.59:0/4016760462 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208917219 0 0) 0x7ff66009f130 con 0x7ff66009e410 2023-09-30T22:29:52.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.763+0000 7ff664b0c700 1 --2- 172.21.15.59:0/4016760462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff66009e000 0x7ff660130660 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff650009840 tx=0x7ff650009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e2b75f4d5edce9a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.763+0000 7ff657fff700 1 -- 172.21.15.59:0/4016760462 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650011830 con 0x7ff66009e000 2023-09-30T22:29:52.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.763+0000 7ff657fff700 1 -- 172.21.15.59:0/4016760462 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff650011990 con 0x7ff66009e000 2023-09-30T22:29:52.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.763+0000 7ff657fff700 1 -- 172.21.15.59:0/4016760462 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650011d20 con 0x7ff66009e000 2023-09-30T22:29:52.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.764+0000 7ff667571700 1 -- 172.21.15.59:0/4016760462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff66009e000 msgr2=0x7ff660130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.764+0000 7ff667571700 1 --2- 172.21.15.59:0/4016760462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff66009e000 0x7ff660130660 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff650009840 tx=0x7ff650009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:52.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.764+0000 7ff667571700 1 -- 172.21.15.59:0/4016760462 shutdown_connections 2023-09-30T22:29:52.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.764+0000 7ff667571700 1 --2- 172.21.15.59:0/4016760462 >> v2:172.21.15.59:3300/0 conn(0x7ff66009d6f0 0x7ff66009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.764+0000 7ff667571700 1 --2- 172.21.15.59:0/4016760462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff66009e000 0x7ff660130660 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.765+0000 7ff667571700 1 -- 172.21.15.59:0/4016760462 >> 172.21.15.59:0/4016760462 conn(0x7ff660066f50 msgr2=0x7ff66009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.765+0000 7ff667571700 1 -- 172.21.15.59:0/4016760462 shutdown_connections 2023-09-30T22:29:52.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.765+0000 7ff667571700 1 -- 172.21.15.59:0/4016760462 wait complete. 2023-09-30T22:29:52.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.766+0000 7ff667571700 1 Processor -- start 2023-09-30T22:29:52.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.766+0000 7ff667571700 1 -- start start 2023-09-30T22:29:52.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.767+0000 7ff667571700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff66009d6f0 0x7ff66011e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.767+0000 7ff667571700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff66009e000 0x7ff66011e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.767+0000 7ff667571700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff66009e410 0x7ff66011ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.767+0000 7ff667571700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6601303f0 con 0x7ff66009e410 2023-09-30T22:29:52.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.767+0000 7ff667571700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff660120240 con 0x7ff66009d6f0 2023-09-30T22:29:52.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.767+0000 7ff667571700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff660120e70 con 0x7ff66009e000 2023-09-30T22:29:52.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.767+0000 7ff664b0c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff66009e000 0x7ff66011e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.767+0000 7ff66530d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff66009d6f0 0x7ff66011e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.767+0000 7ff664b0c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff66009e000 0x7ff66011e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43134/0 (socket says 172.21.15.59:43134) 2023-09-30T22:29:52.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.767+0000 7ff664b0c700 1 -- 172.21.15.59:0/3871836910 learned_addr learned my addr 172.21.15.59:0/3871836910 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:52.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.767+0000 7ff665b0e700 1 --2- 172.21.15.59:0/3871836910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff66009e410 0x7ff66011ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.768+0000 7ff664b0c700 1 -- 172.21.15.59:0/3871836910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff66009d6f0 msgr2=0x7ff66011e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.768+0000 7ff664b0c700 1 --2- 172.21.15.59:0/3871836910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff66009d6f0 0x7ff66011e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.768+0000 7ff664b0c700 1 -- 172.21.15.59:0/3871836910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff66009e410 msgr2=0x7ff66011ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.768+0000 7ff664b0c700 1 --2- 172.21.15.59:0/3871836910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff66009e410 0x7ff66011ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.768+0000 7ff664b0c700 1 -- 172.21.15.59:0/3871836910 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6500094a0 con 0x7ff66009e000 2023-09-30T22:29:52.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.768+0000 7ff66530d700 1 --2- 172.21.15.59:0/3871836910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff66009d6f0 0x7ff66011e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:52.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.768+0000 7ff665b0e700 1 --2- 172.21.15.59:0/3871836910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff66009e410 0x7ff66011ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:52.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.768+0000 7ff664b0c700 1 --2- 172.21.15.59:0/3871836910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff66009e000 0x7ff66011e550 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff650009fd0 tx=0x7ff650004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.768+0000 7ff655ffb700 1 -- 172.21.15.59:0/3871836910 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6500038a0 con 0x7ff66009e000 2023-09-30T22:29:52.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.768+0000 7ff655ffb700 1 -- 172.21.15.59:0/3871836910 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65001f070 con 0x7ff66009e000 2023-09-30T22:29:52.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.768+0000 7ff667571700 1 -- 172.21.15.59:0/3871836910 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66011f470 con 0x7ff66009e000 2023-09-30T22:29:52.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.768+0000 7ff655ffb700 1 -- 172.21.15.59:0/3871836910 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650003c40 con 0x7ff66009e000 2023-09-30T22:29:52.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.768+0000 7ff667571700 1 -- 172.21.15.59:0/3871836910 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6600a20b0 con 0x7ff66009e000 2023-09-30T22:29:52.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.770+0000 7ff667571700 1 -- 172.21.15.59:0/3871836910 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66009c760 con 0x7ff66009e000 2023-09-30T22:29:52.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.770+0000 7ff655ffb700 1 -- 172.21.15.59:0/3871836910 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff650026480 con 0x7ff66009e000 2023-09-30T22:29:52.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.770+0000 7ff66530d700 1 -- 172.21.15.59:0/3871836910 >> v1:172.21.15.59:6816/126772 conn(0x7ff64402f540 legacy=0x7ff6440319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:52.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.771+0000 7ff655ffb700 1 -- 172.21.15.59:0/3871836910 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff650021070 con 0x7ff66009e000 2023-09-30T22:29:52.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.775+0000 7ff655ffb700 1 -- 172.21.15.59:0/3871836910 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff650003da0 con 0x7ff66009e000 2023-09-30T22:29:52.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.820+0000 7fc58ce49700 1 -- 172.21.15.59:0/991930437 >> v1:172.21.15.59:6816/126772 conn(0x7fc56c02f510 legacy=0x7fc56c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:52.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.855+0000 7fc58f0ad700 1 -- 172.21.15.59:0/991930437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc58811ce30 con 0x7fc58809e000 2023-09-30T22:29:52.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.856+0000 7fc5857fa700 1 -- 172.21.15.59:0/991930437 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc58811ce30 con 0x7fc58809e000 2023-09-30T22:29:52.857 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:52.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.859+0000 7fc58f0ad700 1 -- 172.21.15.59:0/991930437 >> v1:172.21.15.59:6816/126772 conn(0x7fc56c02f510 legacy=0x7fc56c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:52.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.859+0000 7fc58f0ad700 1 -- 172.21.15.59:0/991930437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc58809e000 msgr2=0x7fc588119c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.859+0000 7fc58f0ad700 1 --2- 172.21.15.59:0/991930437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc58809e000 0x7fc588119c60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc574016000 tx=0x7fc574004750 comp rx=0 tx=0).stop 2023-09-30T22:29:52.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.859+0000 7fc58f0ad700 1 -- 172.21.15.59:0/991930437 shutdown_connections 2023-09-30T22:29:52.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.859+0000 7fc58f0ad700 1 --2- 172.21.15.59:0/991930437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc58809e410 0x7fc58811a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.859+0000 7fc58f0ad700 1 --2- 172.21.15.59:0/991930437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc58809d6f0 0x7fc588119720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.859+0000 7fc58f0ad700 1 --2- 172.21.15.59:0/991930437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc58809e000 0x7fc588119c60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.859+0000 7fc58f0ad700 1 -- 172.21.15.59:0/991930437 >> 172.21.15.59:0/991930437 conn(0x7fc588066f50 msgr2=0x7fc5881bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.859+0000 7fc58f0ad700 1 -- 172.21.15.59:0/991930437 shutdown_connections 2023-09-30T22:29:52.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.859+0000 7fc58f0ad700 1 -- 172.21.15.59:0/991930437 wait complete. 2023-09-30T22:29:52.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:52.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.894+0000 7f25837fe700 1 -- 172.21.15.59:0/2029129296 >> v1:172.21.15.59:6816/126772 conn(0x7f257002f560 legacy=0x7f2570031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:52.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.911+0000 7f258a269700 1 -- 172.21.15.59:0/2029129296 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2584072980 con 0x7f258409d630 2023-09-30T22:29:52.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.912+0000 7f2580ff9700 1 -- 172.21.15.59:0/2029129296 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2574029090 con 0x7f258409d630 2023-09-30T22:29:52.913 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:52.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.914+0000 7f258a269700 1 -- 172.21.15.59:0/2029129296 >> v1:172.21.15.59:6816/126772 conn(0x7f257002f560 legacy=0x7f2570031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:52.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.914+0000 7f258a269700 1 -- 172.21.15.59:0/2029129296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409d630 msgr2=0x7f258411f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.914+0000 7f258a269700 1 --2- 172.21.15.59:0/2029129296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409d630 0x7f258411f2d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2574016000 tx=0x7f2574004750 comp rx=0 tx=0).stop 2023-09-30T22:29:52.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.914+0000 7f258a269700 1 -- 172.21.15.59:0/2029129296 shutdown_connections 2023-09-30T22:29:52.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.914+0000 7f258a269700 1 --2- 172.21.15.59:0/2029129296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2584133930 0x7f25841c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.914+0000 7f258a269700 1 --2- 172.21.15.59:0/2029129296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409d630 0x7f258411f2d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.914+0000 7f258a269700 1 --2- 172.21.15.59:0/2029129296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25840a0a30 0x7f258411f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.914+0000 7f258a269700 1 -- 172.21.15.59:0/2029129296 >> 172.21.15.59:0/2029129296 conn(0x7f25840a3050 msgr2=0x7f25841bbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.914+0000 7f258a269700 1 -- 172.21.15.59:0/2029129296 shutdown_connections 2023-09-30T22:29:52.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.914+0000 7f258a269700 1 -- 172.21.15.59:0/2029129296 wait complete. 2023-09-30T22:29:52.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.928+0000 7f8e76208700 1 -- 172.21.15.59:0/3212940191 >> v1:172.21.15.59:6816/126772 conn(0x7f8e5402f510 legacy=0x7f8e540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:52.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.957+0000 7f8e7846c700 1 -- 172.21.15.59:0/3212940191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e70074ea0 con 0x7f8e70130e50 2023-09-30T22:29:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.958+0000 7f8e66ffd700 1 -- 172.21.15.59:0/3212940191 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e68013390 con 0x7f8e70130e50 2023-09-30T22:29:52.959 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.960+0000 7f8e7846c700 1 -- 172.21.15.59:0/3212940191 >> v1:172.21.15.59:6816/126772 conn(0x7f8e5402f510 legacy=0x7f8e540319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.960+0000 7f8e7846c700 1 -- 172.21.15.59:0/3212940191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e70130e50 msgr2=0x7f8e7011f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.960+0000 7f8e7846c700 1 --2- 172.21.15.59:0/3212940191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e70130e50 0x7f8e7011f5d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800d4a0 tx=0x7f8e68004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.960+0000 7f8e7846c700 1 -- 172.21.15.59:0/3212940191 shutdown_connections 2023-09-30T22:29:52.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.960+0000 7f8e7846c700 1 --2- 172.21.15.59:0/3212940191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e70130e50 0x7f8e7011f5d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.960+0000 7f8e7846c700 1 --2- 172.21.15.59:0/3212940191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e7006fb20 0x7f8e7011eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.960+0000 7f8e7846c700 1 --2- 172.21.15.59:0/3212940191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e70130540 0x7f8e7011f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.960+0000 7f8e7846c700 1 -- 172.21.15.59:0/3212940191 >> 172.21.15.59:0/3212940191 conn(0x7f8e700a2aa0 msgr2=0x7f8e7012d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.960+0000 7f8e7846c700 1 -- 172.21.15.59:0/3212940191 shutdown_connections 2023-09-30T22:29:52.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.960+0000 7f8e7846c700 1 -- 172.21.15.59:0/3212940191 wait complete. 2023-09-30T22:29:52.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.971+0000 7ff66530d700 1 -- 172.21.15.59:0/3871836910 >> v1:172.21.15.59:6816/126772 conn(0x7ff64402f540 legacy=0x7ff6440319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:52.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:52.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.981+0000 7ff667571700 1 -- 172.21.15.59:0/3871836910 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff66011ac20 con 0x7ff66009e000 2023-09-30T22:29:52.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.982+0000 7ff655ffb700 1 -- 172.21.15.59:0/3871836910 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff650033090 con 0x7ff66009e000 2023-09-30T22:29:52.983 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:52.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.984+0000 7ff667571700 1 -- 172.21.15.59:0/3871836910 >> v1:172.21.15.59:6816/126772 conn(0x7ff64402f540 legacy=0x7ff6440319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:52.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.984+0000 7ff667571700 1 -- 172.21.15.59:0/3871836910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff66009e000 msgr2=0x7ff66011e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.984+0000 7ff667571700 1 --2- 172.21.15.59:0/3871836910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff66009e000 0x7ff66011e550 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff650009fd0 tx=0x7ff650004750 comp rx=0 tx=0).stop 2023-09-30T22:29:52.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.984+0000 7ff667571700 1 -- 172.21.15.59:0/3871836910 shutdown_connections 2023-09-30T22:29:52.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.984+0000 7ff667571700 1 --2- 172.21.15.59:0/3871836910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff66009e410 0x7ff66011ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.984+0000 7ff667571700 1 --2- 172.21.15.59:0/3871836910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff66009d6f0 0x7ff66011e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.984+0000 7ff667571700 1 --2- 172.21.15.59:0/3871836910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff66009e000 0x7ff66011e550 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.984+0000 7ff667571700 1 -- 172.21.15.59:0/3871836910 >> 172.21.15.59:0/3871836910 conn(0x7ff660066f50 msgr2=0x7ff660130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.984+0000 7ff667571700 1 -- 172.21.15.59:0/3871836910 shutdown_connections 2023-09-30T22:29:52.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:52.984+0000 7ff667571700 1 -- 172.21.15.59:0/3871836910 wait complete. 2023-09-30T22:29:52.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:53.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:53.931 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:53.976 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:53.999 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:54.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.034+0000 7f708c7da700 1 Processor -- start 2023-09-30T22:29:54.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.034+0000 7f708c7da700 1 -- start start 2023-09-30T22:29:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.035+0000 7f708c7da700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70841338a0 0x7f7084133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.035+0000 7f708c7da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708409de50 0x7f708409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.035+0000 7f708c7da700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708406ef30 con 0x7f708409e760 2023-09-30T22:29:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.035+0000 7f708c7da700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708406fef0 con 0x7f708409de50 2023-09-30T22:29:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.035+0000 7f708c7da700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70841334b0 con 0x7f70841338a0 2023-09-30T22:29:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.035+0000 7f7089d75700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708409de50 0x7f708409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.035+0000 7f7089d75700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708409de50 0x7f708409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54214/0 (socket says 172.21.15.59:54214) 2023-09-30T22:29:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.035+0000 7f7089d75700 1 -- 172.21.15.59:0/2345300991 learned_addr learned my addr 172.21.15.59:0/2345300991 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:54.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.035+0000 7f7089574700 1 -- 172.21.15.59:0/2345300991 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106516697 0 0) 0x7f708406ef30 con 0x7f708409e760 2023-09-30T22:29:54.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.035+0000 7f7089d75700 1 -- 172.21.15.59:0/2345300991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70841338a0 msgr2=0x7f7084133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.035+0000 7f7089d75700 1 --2- 172.21.15.59:0/2345300991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70841338a0 0x7f7084133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.035+0000 7f7089d75700 1 -- 172.21.15.59:0/2345300991 >> v1:172.21.15.59:6789/0 conn(0x7f708409e760 legacy=0x7f708413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.035+0000 7f7089d75700 1 -- 172.21.15.59:0/2345300991 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708406fc30 con 0x7f708409de50 2023-09-30T22:29:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.036+0000 7f7089d75700 1 --2- 172.21.15.59:0/2345300991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708409de50 0x7f708409e220 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7074009920 tx=0x7f7074009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3f086ba987c2dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.036+0000 7f7089574700 1 -- 172.21.15.59:0/2345300991 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707400ba60 con 0x7f708409de50 2023-09-30T22:29:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.036+0000 7f7089574700 1 -- 172.21.15.59:0/2345300991 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707400bbc0 con 0x7f708409de50 2023-09-30T22:29:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.036+0000 7f7089574700 1 -- 172.21.15.59:0/2345300991 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7074009e70 con 0x7f708409de50 2023-09-30T22:29:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.037+0000 7f708c7da700 1 -- 172.21.15.59:0/2345300991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708409de50 msgr2=0x7f708409e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.037+0000 7f708c7da700 1 --2- 172.21.15.59:0/2345300991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708409de50 0x7f708409e220 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7074009920 tx=0x7f7074009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.037+0000 7f708c7da700 1 -- 172.21.15.59:0/2345300991 shutdown_connections 2023-09-30T22:29:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.037+0000 7f708c7da700 1 --2- 172.21.15.59:0/2345300991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70841338a0 0x7f7084133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.037+0000 7f708c7da700 1 --2- 172.21.15.59:0/2345300991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708409de50 0x7f708409e220 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.037+0000 7f708c7da700 1 -- 172.21.15.59:0/2345300991 >> 172.21.15.59:0/2345300991 conn(0x7f70840a2aa0 msgr2=0x7f70840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.038+0000 7f708c7da700 1 -- 172.21.15.59:0/2345300991 shutdown_connections 2023-09-30T22:29:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.038+0000 7f708c7da700 1 -- 172.21.15.59:0/2345300991 wait complete. 2023-09-30T22:29:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.039+0000 7f708c7da700 1 Processor -- start 2023-09-30T22:29:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.039+0000 7f708c7da700 1 -- start start 2023-09-30T22:29:54.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.039+0000 7f708c7da700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f708409de50 0x7f708411b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.039+0000 7f708c7da700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f708409e760 0x7f708411bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.039+0000 7f708c7da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70841338a0 0x7f708411c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.039+0000 7f708c7da700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708411cc10 con 0x7f708409de50 2023-09-30T22:29:54.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.039+0000 7f708c7da700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708411d320 con 0x7f70841338a0 2023-09-30T22:29:54.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.039+0000 7f708c7da700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f708411d940 con 0x7f708409e760 2023-09-30T22:29:54.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.040+0000 7f708a576700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f708409de50 0x7f708411b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.040+0000 7f708a576700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f708409de50 0x7f708411b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37730/0 (socket says 172.21.15.59:37730) 2023-09-30T22:29:54.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.040+0000 7f708a576700 1 -- 172.21.15.59:0/3467769246 learned_addr learned my addr 172.21.15.59:0/3467769246 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:54.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.040+0000 7f708ad77700 1 --2- 172.21.15.59:0/3467769246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70841338a0 0x7f708411c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.040+0000 7f7089d75700 1 --2- 172.21.15.59:0/3467769246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f708409e760 0x7f708411bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.040+0000 7f708ad77700 1 -- 172.21.15.59:0/3467769246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f708409e760 msgr2=0x7f708411bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.040+0000 7f708ad77700 1 --2- 172.21.15.59:0/3467769246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f708409e760 0x7f708411bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.040+0000 7f708ad77700 1 -- 172.21.15.59:0/3467769246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f708409de50 msgr2=0x7f708411b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.040+0000 7f708ad77700 1 --2- 172.21.15.59:0/3467769246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f708409de50 0x7f708411b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.040+0000 7f708ad77700 1 -- 172.21.15.59:0/3467769246 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7074009550 con 0x7f70841338a0 2023-09-30T22:29:54.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.040+0000 7f708a576700 1 --2- 172.21.15.59:0/3467769246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f708409de50 0x7f708411b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:54.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.040+0000 7f708ad77700 1 --2- 172.21.15.59:0/3467769246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70841338a0 0x7f708411c1e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f707c00c730 tx=0x7f707c00ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:54.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.041+0000 7f707affd700 1 -- 172.21.15.59:0/3467769246 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c015e90 con 0x7f70841338a0 2023-09-30T22:29:54.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.041+0000 7f707affd700 1 -- 172.21.15.59:0/3467769246 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c003a00 con 0x7f70841338a0 2023-09-30T22:29:54.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.041+0000 7f707affd700 1 -- 172.21.15.59:0/3467769246 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c003d90 con 0x7f70841338a0 2023-09-30T22:29:54.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.041+0000 7f708c7da700 1 -- 172.21.15.59:0/3467769246 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708411ef50 con 0x7f70841338a0 2023-09-30T22:29:54.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.041+0000 7f708c7da700 1 -- 172.21.15.59:0/3467769246 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70840a0f20 con 0x7f70841338a0 2023-09-30T22:29:54.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.042+0000 7f707affd700 1 -- 172.21.15.59:0/3467769246 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f707c01b070 con 0x7f70841338a0 2023-09-30T22:29:54.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.043+0000 7f707affd700 1 -- 172.21.15.59:0/3467769246 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f707c0479d0 con 0x7f70841338a0 2023-09-30T22:29:54.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.043+0000 7f708a576700 1 -- 172.21.15.59:0/3467769246 >> v1:172.21.15.59:6816/126772 conn(0x7f706802f510 legacy=0x7f70680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:54.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.043+0000 7f708c7da700 1 -- 172.21.15.59:0/3467769246 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708411e5a0 con 0x7f70841338a0 2023-09-30T22:29:54.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.048+0000 7f707affd700 1 -- 172.21.15.59:0/3467769246 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f707c023030 con 0x7f70841338a0 2023-09-30T22:29:54.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.083+0000 7f220e5be700 1 Processor -- start 2023-09-30T22:29:54.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.083+0000 7f220e5be700 1 -- start start 2023-09-30T22:29:54.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.084+0000 7f220e5be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f220809f410 0x7f2208136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.084+0000 7f220e5be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2208136fe0 0x7f22081393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.084+0000 7f220e5be700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2208070940 con 0x7f220809e930 2023-09-30T22:29:54.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.084+0000 7f220e5be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220806fd60 con 0x7f220809f410 2023-09-30T22:29:54.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.084+0000 7f220e5be700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f220806fa80 con 0x7f2208136fe0 2023-09-30T22:29:54.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.084+0000 7f22077fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f220809f410 0x7f2208136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.084+0000 7f22077fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f220809f410 0x7f2208136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54226/0 (socket says 172.21.15.59:54226) 2023-09-30T22:29:54.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.084+0000 7f22077fe700 1 -- 172.21.15.59:0/959376896 learned_addr learned my addr 172.21.15.59:0/959376896 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:54.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.084+0000 7f220cb5b700 1 --2- 172.21.15.59:0/959376896 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2208136fe0 0x7f22081393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.084+0000 7f220cb5b700 1 -- 172.21.15.59:0/959376896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f220809f410 msgr2=0x7f2208136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:54.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.084+0000 7f220cb5b700 1 --2- 172.21.15.59:0/959376896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f220809f410 0x7f2208136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.084+0000 7f220cb5b700 1 -- 172.21.15.59:0/959376896 >> v1:172.21.15.59:6789/0 conn(0x7f220809e930 legacy=0x7f220809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.084+0000 7f220cb5b700 1 -- 172.21.15.59:0/959376896 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220809fb60 con 0x7f2208136fe0 2023-09-30T22:29:54.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.084+0000 7f220cb5b700 1 --2- 172.21.15.59:0/959376896 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2208136fe0 0x7f22081393c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2200009dc0 tx=0x7f220000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d11b493be8604653 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:54.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.085+0000 7f2206ffd700 1 -- 172.21.15.59:0/959376896 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220000e070 con 0x7f2208136fe0 2023-09-30T22:29:54.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.085+0000 7f2206ffd700 1 -- 172.21.15.59:0/959376896 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220000bb20 con 0x7f2208136fe0 2023-09-30T22:29:54.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.085+0000 7f2206ffd700 1 -- 172.21.15.59:0/959376896 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2200012430 con 0x7f2208136fe0 2023-09-30T22:29:54.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.085+0000 7f220e5be700 1 -- 172.21.15.59:0/959376896 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2208136fe0 msgr2=0x7f22081393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.085+0000 7f220e5be700 1 --2- 172.21.15.59:0/959376896 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2208136fe0 0x7f22081393c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2200009dc0 tx=0x7f220000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:54.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.086+0000 7f220e5be700 1 -- 172.21.15.59:0/959376896 shutdown_connections 2023-09-30T22:29:54.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.086+0000 7f220e5be700 1 --2- 172.21.15.59:0/959376896 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2208136fe0 0x7f22081393c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.086+0000 7f220e5be700 1 --2- 172.21.15.59:0/959376896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f220809f410 0x7f2208136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.086+0000 7f220e5be700 1 -- 172.21.15.59:0/959376896 >> 172.21.15.59:0/959376896 conn(0x7f22080a4210 msgr2=0x7f22080a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:54.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.086+0000 7f220e5be700 1 -- 172.21.15.59:0/959376896 shutdown_connections 2023-09-30T22:29:54.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.086+0000 7f220e5be700 1 -- 172.21.15.59:0/959376896 wait complete. 2023-09-30T22:29:54.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.087+0000 7f220e5be700 1 Processor -- start 2023-09-30T22:29:54.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.087+0000 7f220e5be700 1 -- start start 2023-09-30T22:29:54.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.087+0000 7f220e5be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f220809e930 0x7f220811c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.087+0000 7f220e5be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f220809f410 0x7f220811cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.088+0000 7f220e5be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2208136fe0 0x7f220811d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.088+0000 7f220e5be700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220811ea80 con 0x7f220809e930 2023-09-30T22:29:54.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.088+0000 7f220e5be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220811fe30 con 0x7f2208136fe0 2023-09-30T22:29:54.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.088+0000 7f220e5be700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22081205a0 con 0x7f220809f410 2023-09-30T22:29:54.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.088+0000 7f22077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f220809f410 0x7f220811cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.088+0000 7f22077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f220809f410 0x7f220811cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43176/0 (socket says 172.21.15.59:43176) 2023-09-30T22:29:54.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.088+0000 7f22077fe700 1 -- 172.21.15.59:0/112737885 learned_addr learned my addr 172.21.15.59:0/112737885 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:54.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.088+0000 7f220cb5b700 1 --2- 172.21.15.59:0/112737885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2208136fe0 0x7f220811d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.088+0000 7f2207fff700 1 --2- 172.21.15.59:0/112737885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f220809e930 0x7f220811c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.088+0000 7f220cb5b700 1 -- 172.21.15.59:0/112737885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f220809f410 msgr2=0x7f220811cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.088+0000 7f220cb5b700 1 --2- 172.21.15.59:0/112737885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f220809f410 0x7f220811cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.088+0000 7f220cb5b700 1 -- 172.21.15.59:0/112737885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f220809e930 msgr2=0x7f220811c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.088+0000 7f220cb5b700 1 --2- 172.21.15.59:0/112737885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f220809e930 0x7f220811c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.088+0000 7f220cb5b700 1 -- 172.21.15.59:0/112737885 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2200009a70 con 0x7f2208136fe0 2023-09-30T22:29:54.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.088+0000 7f22077fe700 1 --2- 172.21.15.59:0/112737885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f220809f410 0x7f220811cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:54.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.089+0000 7f220cb5b700 1 --2- 172.21.15.59:0/112737885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2208136fe0 0x7f220811d140 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2200016000 tx=0x7f2200004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:54.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.089+0000 7f2204ff9700 1 -- 172.21.15.59:0/112737885 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2200004800 con 0x7f2208136fe0 2023-09-30T22:29:54.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.089+0000 7f2204ff9700 1 -- 172.21.15.59:0/112737885 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2200020070 con 0x7f2208136fe0 2023-09-30T22:29:54.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.089+0000 7f220e5be700 1 -- 172.21.15.59:0/112737885 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2208071d20 con 0x7f2208136fe0 2023-09-30T22:29:54.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.089+0000 7f2204ff9700 1 -- 172.21.15.59:0/112737885 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22000276c0 con 0x7f2208136fe0 2023-09-30T22:29:54.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.089+0000 7f220e5be700 1 -- 172.21.15.59:0/112737885 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2208132470 con 0x7f2208136fe0 2023-09-30T22:29:54.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.090+0000 7f2204ff9700 1 -- 172.21.15.59:0/112737885 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2200012430 con 0x7f2208136fe0 2023-09-30T22:29:54.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.090+0000 7f2204ff9700 1 -- 172.21.15.59:0/112737885 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f2200022070 con 0x7f2208136fe0 2023-09-30T22:29:54.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.090+0000 7f2207fff700 1 -- 172.21.15.59:0/112737885 >> v1:172.21.15.59:6816/126772 conn(0x7f21f402f510 legacy=0x7f21f40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:54.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.090+0000 7f220e5be700 1 -- 172.21.15.59:0/112737885 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2208074ea0 con 0x7f2208136fe0 2023-09-30T22:29:54.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.095+0000 7f2204ff9700 1 -- 172.21.15.59:0/112737885 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f220002c080 con 0x7f2208136fe0 2023-09-30T22:29:54.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.135+0000 7f5ac855a700 1 Processor -- start 2023-09-30T22:29:54.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.135+0000 7f5ac855a700 1 -- start start 2023-09-30T22:29:54.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac855a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ac00a0a30 0x7f5ac00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac855a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ac00a1340 0x7f5ac0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac855a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ac0133fa0 0x7f5ac0134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac855a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac009edd0 con 0x7f5ac00a0a30 2023-09-30T22:29:54.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac855a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac009e1f0 con 0x7f5ac00a1340 2023-09-30T22:29:54.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac855a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac009dc50 con 0x7f5ac0133fa0 2023-09-30T22:29:54.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac62f6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ac00a0a30 0x7f5ac00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac62f6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ac00a0a30 0x7f5ac00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37748/0 (socket says 172.21.15.59:37748) 2023-09-30T22:29:54.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac62f6700 1 -- 172.21.15.59:0/1634008058 learned_addr learned my addr 172.21.15.59:0/1634008058 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:54.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac6af7700 1 --2- 172.21.15.59:0/1634008058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ac0133fa0 0x7f5ac0134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac5af5700 1 --2- 172.21.15.59:0/1634008058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ac00a1340 0x7f5ac0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac62f6700 1 -- 172.21.15.59:0/1634008058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ac0133fa0 msgr2=0x7f5ac0134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:54.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac62f6700 1 --2- 172.21.15.59:0/1634008058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ac0133fa0 0x7f5ac0134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac62f6700 1 -- 172.21.15.59:0/1634008058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ac00a1340 msgr2=0x7f5ac0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:54.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac62f6700 1 --2- 172.21.15.59:0/1634008058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ac00a1340 0x7f5ac0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac62f6700 1 -- 172.21.15.59:0/1634008058 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac00a1fe0 con 0x7f5ac00a0a30 2023-09-30T22:29:54.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.136+0000 7f5ac5af5700 1 --2- 172.21.15.59:0/1634008058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ac00a1340 0x7f5ac0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:54.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.137+0000 7f5ac62f6700 1 --2- 172.21.15.59:0/1634008058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac00a0a30 0x7f5ac00a0e00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0098f0 tx=0x7f5abc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8508036790762b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:54.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.137+0000 7f5ac52f4700 1 -- 172.21.15.59:0/1634008058 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc011830 con 0x7f5ac00a0a30 2023-09-30T22:29:54.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.137+0000 7f5ac52f4700 1 -- 172.21.15.59:0/1634008058 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc011990 con 0x7f5ac00a0a30 2023-09-30T22:29:54.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.137+0000 7f5ac52f4700 1 -- 172.21.15.59:0/1634008058 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc011d20 con 0x7f5ac00a0a30 2023-09-30T22:29:54.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.138+0000 7f5ac855a700 1 -- 172.21.15.59:0/1634008058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac00a0a30 msgr2=0x7f5ac00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.138+0000 7f5ac855a700 1 --2- 172.21.15.59:0/1634008058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac00a0a30 0x7f5ac00a0e00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0098f0 tx=0x7f5abc009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:54.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.138+0000 7f5ac855a700 1 -- 172.21.15.59:0/1634008058 shutdown_connections 2023-09-30T22:29:54.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.138+0000 7f5ac855a700 1 --2- 172.21.15.59:0/1634008058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ac0133fa0 0x7f5ac0134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.138+0000 7f5ac855a700 1 --2- 172.21.15.59:0/1634008058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac00a0a30 0x7f5ac00a0e00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.138+0000 7f5ac855a700 1 --2- 172.21.15.59:0/1634008058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ac00a1340 0x7f5ac0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.138+0000 7f5ac855a700 1 -- 172.21.15.59:0/1634008058 >> 172.21.15.59:0/1634008058 conn(0x7f5ac00a6550 msgr2=0x7f5ac00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:54.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.138+0000 7f5ac855a700 1 -- 172.21.15.59:0/1634008058 shutdown_connections 2023-09-30T22:29:54.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.138+0000 7f5ac855a700 1 -- 172.21.15.59:0/1634008058 wait complete. 2023-09-30T22:29:54.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.139+0000 7f5ac855a700 1 Processor -- start 2023-09-30T22:29:54.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.139+0000 7f5ac855a700 1 -- start start 2023-09-30T22:29:54.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.140+0000 7f5ac855a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ac00a0a30 0x7f5ac01212d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.140+0000 7f5ac855a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ac00a1340 0x7f5ac0121810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.140+0000 7f5ac855a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac0133fa0 0x7f5ac0121d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.140+0000 7f5ac855a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac01326a0 con 0x7f5ac0133fa0 2023-09-30T22:29:54.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.140+0000 7f5ac855a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0123d70 con 0x7f5ac00a1340 2023-09-30T22:29:54.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.140+0000 7f5ac855a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0124850 con 0x7f5ac00a0a30 2023-09-30T22:29:54.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.140+0000 7f5ac62f6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ac00a0a30 0x7f5ac01212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.140+0000 7f5ac62f6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ac00a0a30 0x7f5ac01212d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43198/0 (socket says 172.21.15.59:43198) 2023-09-30T22:29:54.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.140+0000 7f5ac62f6700 1 -- 172.21.15.59:0/3341261296 learned_addr learned my addr 172.21.15.59:0/3341261296 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:54.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.140+0000 7f5ac6af7700 1 --2- 172.21.15.59:0/3341261296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac0133fa0 0x7f5ac0121d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.141+0000 7f5ac62f6700 1 -- 172.21.15.59:0/3341261296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ac00a1340 msgr2=0x7f5ac0121810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.141+0000 7f5ac62f6700 1 --2- 172.21.15.59:0/3341261296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ac00a1340 0x7f5ac0121810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.141+0000 7f5ac62f6700 1 -- 172.21.15.59:0/3341261296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac0133fa0 msgr2=0x7f5ac0121d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.141+0000 7f5ac62f6700 1 --2- 172.21.15.59:0/3341261296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac0133fa0 0x7f5ac0121d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.141+0000 7f5ac62f6700 1 -- 172.21.15.59:0/3341261296 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab00094a0 con 0x7f5ac00a0a30 2023-09-30T22:29:54.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.141+0000 7f5ac62f6700 1 --2- 172.21.15.59:0/3341261296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ac00a0a30 0x7f5ac01212d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009f50 tx=0x7f5abc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.141+0000 7f5ab6ffd700 1 -- 172.21.15.59:0/3341261296 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc004300 con 0x7f5ac00a0a30 2023-09-30T22:29:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.141+0000 7f5ab6ffd700 1 -- 172.21.15.59:0/3341261296 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc01f070 con 0x7f5ac00a0a30 2023-09-30T22:29:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.141+0000 7f5ab6ffd700 1 -- 172.21.15.59:0/3341261296 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0036a0 con 0x7f5ac00a0a30 2023-09-30T22:29:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.141+0000 7f5ac855a700 1 -- 172.21.15.59:0/3341261296 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5abc009550 con 0x7f5ac00a0a30 2023-09-30T22:29:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.141+0000 7f5ac855a700 1 -- 172.21.15.59:0/3341261296 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac0124b60 con 0x7f5ac00a0a30 2023-09-30T22:29:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.142+0000 7f5ab6ffd700 1 -- 172.21.15.59:0/3341261296 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5abc021030 con 0x7f5ac00a0a30 2023-09-30T22:29:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.142+0000 7f5ac855a700 1 -- 172.21.15.59:0/3341261296 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac0074ea0 con 0x7f5ac00a0a30 2023-09-30T22:29:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.143+0000 7f5ab6ffd700 1 -- 172.21.15.59:0/3341261296 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f5abc040d80 con 0x7f5ac00a0a30 2023-09-30T22:29:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.143+0000 7f5ac5af5700 1 -- 172.21.15.59:0/3341261296 >> v1:172.21.15.59:6816/126772 conn(0x7f5aa402f510 legacy=0x7f5aa40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:54.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.152+0000 7f5ab6ffd700 1 -- 172.21.15.59:0/3341261296 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5abc0197c0 con 0x7f5ac00a0a30 2023-09-30T22:29:54.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.168+0000 7f29278db700 1 Processor -- start 2023-09-30T22:29:54.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.168+0000 7f29278db700 1 -- start start 2023-09-30T22:29:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.169+0000 7f29278db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f292006a770 0x7f292006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.169+0000 7f29278db700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2920131d10 0x7f2920139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.169+0000 7f29278db700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f292009ece0 con 0x7f292006b080 2023-09-30T22:29:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.169+0000 7f29278db700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292009e760 con 0x7f2920131d10 2023-09-30T22:29:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.169+0000 7f29278db700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f292009e040 con 0x7f292006a770 2023-09-30T22:29:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.169+0000 7f2925e78700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2920131d10 0x7f2920139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.169+0000 7f2925e78700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2920131d10 0x7f2920139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37780/0 (socket says 172.21.15.59:37780) 2023-09-30T22:29:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.169+0000 7f2925e78700 1 -- 172.21.15.59:0/611498800 learned_addr learned my addr 172.21.15.59:0/611498800 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.169+0000 7f2925677700 1 --2- 172.21.15.59:0/611498800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f292006a770 0x7f292006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.169+0000 7f2925e78700 1 -- 172.21.15.59:0/611498800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f292006a770 msgr2=0x7f292006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.169+0000 7f2925e78700 1 --2- 172.21.15.59:0/611498800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f292006a770 0x7f292006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.169+0000 7f2925e78700 1 -- 172.21.15.59:0/611498800 >> v1:172.21.15.59:6789/0 conn(0x7f292006b080 legacy=0x7f2920131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.170+0000 7f2925e78700 1 -- 172.21.15.59:0/611498800 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292009f630 con 0x7f2920131d10 2023-09-30T22:29:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.170+0000 7f2925e78700 1 --2- 172.21.15.59:0/611498800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2920131d10 0x7f2920139860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2918009e50 tx=0x7f291800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1cf30646bab34b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.170+0000 7f2917fff700 1 -- 172.21.15.59:0/611498800 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291800e070 con 0x7f2920131d10 2023-09-30T22:29:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.170+0000 7f2917fff700 1 -- 172.21.15.59:0/611498800 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291800b910 con 0x7f2920131d10 2023-09-30T22:29:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.170+0000 7f2917fff700 1 -- 172.21.15.59:0/611498800 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291800bcc0 con 0x7f2920131d10 2023-09-30T22:29:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.171+0000 7f29278db700 1 -- 172.21.15.59:0/611498800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2920131d10 msgr2=0x7f2920139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.171+0000 7f29278db700 1 --2- 172.21.15.59:0/611498800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2920131d10 0x7f2920139860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2918009e50 tx=0x7f291800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.171+0000 7f29278db700 1 -- 172.21.15.59:0/611498800 shutdown_connections 2023-09-30T22:29:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.171+0000 7f29278db700 1 --2- 172.21.15.59:0/611498800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2920131d10 0x7f2920139860 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.171+0000 7f29278db700 1 --2- 172.21.15.59:0/611498800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f292006a770 0x7f292006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.171+0000 7f29278db700 1 -- 172.21.15.59:0/611498800 >> 172.21.15.59:0/611498800 conn(0x7f2920066f50 msgr2=0x7f292009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.171+0000 7f29278db700 1 -- 172.21.15.59:0/611498800 shutdown_connections 2023-09-30T22:29:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.171+0000 7f29278db700 1 -- 172.21.15.59:0/611498800 wait complete. 2023-09-30T22:29:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.172+0000 7f29278db700 1 Processor -- start 2023-09-30T22:29:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.172+0000 7f29278db700 1 -- start start 2023-09-30T22:29:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.172+0000 7f29278db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f292006a770 0x7f29201c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.172+0000 7f29278db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f292006b080 0x7f29201c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.172+0000 7f29278db700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2920131d10 0x7f29201c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.172+0000 7f29278db700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29201316c0 con 0x7f2920131d10 2023-09-30T22:29:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.172+0000 7f29278db700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2920131420 con 0x7f292006b080 2023-09-30T22:29:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.172+0000 7f29278db700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2920125ea0 con 0x7f292006a770 2023-09-30T22:29:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f2925e78700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2920131d10 0x7f29201c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f2925e78700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2920131d10 0x7f29201c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37792/0 (socket says 172.21.15.59:37792) 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f2924e76700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f292006b080 0x7f29201c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f2925e78700 1 -- 172.21.15.59:0/38331680 learned_addr learned my addr 172.21.15.59:0/38331680 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f2925677700 1 --2- 172.21.15.59:0/38331680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f292006a770 0x7f29201c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f2925e78700 1 -- 172.21.15.59:0/38331680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f292006a770 msgr2=0x7f29201c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f2925e78700 1 --2- 172.21.15.59:0/38331680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f292006a770 0x7f29201c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f2925e78700 1 -- 172.21.15.59:0/38331680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f292006b080 msgr2=0x7f29201c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f2925e78700 1 --2- 172.21.15.59:0/38331680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f292006b080 0x7f29201c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f2925e78700 1 -- 172.21.15.59:0/38331680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2918009b30 con 0x7f2920131d10 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f2925e78700 1 --2- 172.21.15.59:0/38331680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2920131d10 0x7f29201c8d00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f292009ee70 tx=0x7f2918004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f2925677700 1 --2- 172.21.15.59:0/38331680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f292006a770 0x7f29201c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f2915ffb700 1 -- 172.21.15.59:0/38331680 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29180048b0 con 0x7f2920131d10 2023-09-30T22:29:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f29278db700 1 -- 172.21.15.59:0/38331680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292009a7e0 con 0x7f2920131d10 2023-09-30T22:29:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f2915ffb700 1 -- 172.21.15.59:0/38331680 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29180099b0 con 0x7f2920131d10 2023-09-30T22:29:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.173+0000 7f2915ffb700 1 -- 172.21.15.59:0/38331680 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291801c660 con 0x7f2920131d10 2023-09-30T22:29:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.174+0000 7f29278db700 1 -- 172.21.15.59:0/38331680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2920125500 con 0x7f2920131d10 2023-09-30T22:29:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.175+0000 7f2915ffb700 1 -- 172.21.15.59:0/38331680 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f291801c7c0 con 0x7f2920131d10 2023-09-30T22:29:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.175+0000 7f2915ffb700 1 -- 172.21.15.59:0/38331680 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f2918041990 con 0x7f2920131d10 2023-09-30T22:29:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.175+0000 7f2925677700 1 -- 172.21.15.59:0/38331680 >> v1:172.21.15.59:6816/126772 conn(0x7f290402f510 legacy=0x7f29040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.175+0000 7f29278db700 1 -- 172.21.15.59:0/38331680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2920074ea0 con 0x7f2920131d10 2023-09-30T22:29:54.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.184+0000 7f2915ffb700 1 -- 172.21.15.59:0/38331680 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29180257d0 con 0x7f2920131d10 2023-09-30T22:29:54.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.244+0000 7f708a576700 1 -- 172.21.15.59:0/3467769246 >> v1:172.21.15.59:6816/126772 conn(0x7f706802f510 legacy=0x7f70680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:54.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.267+0000 7f708c7da700 1 -- 172.21.15.59:0/3467769246 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7084074ea0 con 0x7f70841338a0 2023-09-30T22:29:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.267+0000 7f707affd700 1 -- 172.21.15.59:0/3467769246 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f707c023020 con 0x7f70841338a0 2023-09-30T22:29:54.268 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:54.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.269+0000 7f708c7da700 1 -- 172.21.15.59:0/3467769246 >> v1:172.21.15.59:6816/126772 conn(0x7f706802f510 legacy=0x7f70680319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:54.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.269+0000 7f708c7da700 1 -- 172.21.15.59:0/3467769246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70841338a0 msgr2=0x7f708411c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.269+0000 7f708c7da700 1 --2- 172.21.15.59:0/3467769246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70841338a0 0x7f708411c1e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f707c00c730 tx=0x7f707c00ca40 comp rx=0 tx=0).stop 2023-09-30T22:29:54.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.269+0000 7f708c7da700 1 -- 172.21.15.59:0/3467769246 shutdown_connections 2023-09-30T22:29:54.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.269+0000 7f708c7da700 1 --2- 172.21.15.59:0/3467769246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70841338a0 0x7f708411c1e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.269+0000 7f708c7da700 1 --2- 172.21.15.59:0/3467769246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f708409de50 0x7f708411b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.269+0000 7f708c7da700 1 --2- 172.21.15.59:0/3467769246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f708409e760 0x7f708411bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.269+0000 7f708c7da700 1 -- 172.21.15.59:0/3467769246 >> 172.21.15.59:0/3467769246 conn(0x7f70840a2aa0 msgr2=0x7f70841306c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:54.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.269+0000 7f708c7da700 1 -- 172.21.15.59:0/3467769246 shutdown_connections 2023-09-30T22:29:54.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.270+0000 7f708c7da700 1 -- 172.21.15.59:0/3467769246 wait complete. 2023-09-30T22:29:54.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:54.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.291+0000 7f2207fff700 1 -- 172.21.15.59:0/112737885 >> v1:172.21.15.59:6816/126772 conn(0x7f21f402f510 legacy=0x7f21f40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.344+0000 7f5ac5af5700 1 -- 172.21.15.59:0/3341261296 >> v1:172.21.15.59:6816/126772 conn(0x7f5aa402f510 legacy=0x7f5aa40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:54.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.363+0000 7f220e5be700 1 -- 172.21.15.59:0/112737885 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f220806b250 con 0x7f2208136fe0 2023-09-30T22:29:54.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.364+0000 7f2204ff9700 1 -- 172.21.15.59:0/112737885 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f220001c400 con 0x7f2208136fe0 2023-09-30T22:29:54.365 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:54.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.366+0000 7f220e5be700 1 -- 172.21.15.59:0/112737885 >> v1:172.21.15.59:6816/126772 conn(0x7f21f402f510 legacy=0x7f21f40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:54.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.366+0000 7f220e5be700 1 -- 172.21.15.59:0/112737885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2208136fe0 msgr2=0x7f220811d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.366+0000 7f220e5be700 1 --2- 172.21.15.59:0/112737885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2208136fe0 0x7f220811d140 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2200016000 tx=0x7f2200004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.366+0000 7f220e5be700 1 -- 172.21.15.59:0/112737885 shutdown_connections 2023-09-30T22:29:54.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.366+0000 7f220e5be700 1 --2- 172.21.15.59:0/112737885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2208136fe0 0x7f220811d140 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.366+0000 7f220e5be700 1 --2- 172.21.15.59:0/112737885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f220809e930 0x7f220811c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.366+0000 7f220e5be700 1 --2- 172.21.15.59:0/112737885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f220809f410 0x7f220811cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.366+0000 7f220e5be700 1 -- 172.21.15.59:0/112737885 >> 172.21.15.59:0/112737885 conn(0x7f22080a4210 msgr2=0x7f22080a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:54.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.366+0000 7f220e5be700 1 -- 172.21.15.59:0/112737885 shutdown_connections 2023-09-30T22:29:54.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.366+0000 7f220e5be700 1 -- 172.21.15.59:0/112737885 wait complete. 2023-09-30T22:29:54.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.376+0000 7f2925677700 1 -- 172.21.15.59:0/38331680 >> v1:172.21.15.59:6816/126772 conn(0x7f290402f510 legacy=0x7f29040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:54.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:54.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.393+0000 7f29278db700 1 -- 172.21.15.59:0/38331680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f292006c360 con 0x7f2920131d10 2023-09-30T22:29:54.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.393+0000 7f2915ffb700 1 -- 172.21.15.59:0/38331680 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2918023780 con 0x7f2920131d10 2023-09-30T22:29:54.395 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:54.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.396+0000 7f29278db700 1 -- 172.21.15.59:0/38331680 >> v1:172.21.15.59:6816/126772 conn(0x7f290402f510 legacy=0x7f29040319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:54.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.396+0000 7f29278db700 1 -- 172.21.15.59:0/38331680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2920131d10 msgr2=0x7f29201c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.396+0000 7f29278db700 1 --2- 172.21.15.59:0/38331680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2920131d10 0x7f29201c8d00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f292009ee70 tx=0x7f2918004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.396+0000 7f29278db700 1 -- 172.21.15.59:0/38331680 shutdown_connections 2023-09-30T22:29:54.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.396+0000 7f29278db700 1 --2- 172.21.15.59:0/38331680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f292006a770 0x7f29201c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.396+0000 7f29278db700 1 --2- 172.21.15.59:0/38331680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2920131d10 0x7f29201c8d00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.396+0000 7f29278db700 1 --2- 172.21.15.59:0/38331680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f292006b080 0x7f29201c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.396+0000 7f29278db700 1 -- 172.21.15.59:0/38331680 >> 172.21.15.59:0/38331680 conn(0x7f2920066f50 msgr2=0x7f29200a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:54.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.396+0000 7f29278db700 1 -- 172.21.15.59:0/38331680 shutdown_connections 2023-09-30T22:29:54.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.396+0000 7f29278db700 1 -- 172.21.15.59:0/38331680 wait complete. 2023-09-30T22:29:54.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.404+0000 7f5ac855a700 1 -- 172.21.15.59:0/3341261296 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5ac0124b60 con 0x7f5ac00a0a30 2023-09-30T22:29:54.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.405+0000 7f5ab6ffd700 1 -- 172.21.15.59:0/3341261296 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ac0124b60 con 0x7f5ac00a0a30 2023-09-30T22:29:54.406 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.407+0000 7f5ac855a700 1 -- 172.21.15.59:0/3341261296 >> v1:172.21.15.59:6816/126772 conn(0x7f5aa402f510 legacy=0x7f5aa40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.407+0000 7f5ac855a700 1 -- 172.21.15.59:0/3341261296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ac00a0a30 msgr2=0x7f5ac01212d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.407+0000 7f5ac855a700 1 --2- 172.21.15.59:0/3341261296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ac00a0a30 0x7f5ac01212d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009f50 tx=0x7f5abc004750 comp rx=0 tx=0).stop 2023-09-30T22:29:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.407+0000 7f5ac855a700 1 -- 172.21.15.59:0/3341261296 shutdown_connections 2023-09-30T22:29:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.407+0000 7f5ac855a700 1 --2- 172.21.15.59:0/3341261296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ac00a0a30 0x7f5ac01212d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.407+0000 7f5ac855a700 1 --2- 172.21.15.59:0/3341261296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac0133fa0 0x7f5ac0121d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.407+0000 7f5ac855a700 1 --2- 172.21.15.59:0/3341261296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ac00a1340 0x7f5ac0121810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.407+0000 7f5ac855a700 1 -- 172.21.15.59:0/3341261296 >> 172.21.15.59:0/3341261296 conn(0x7f5ac00a6550 msgr2=0x7f5ac00a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.407+0000 7f5ac855a700 1 -- 172.21.15.59:0/3341261296 shutdown_connections 2023-09-30T22:29:54.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:54.407+0000 7f5ac855a700 1 -- 172.21.15.59:0/3341261296 wait complete. 2023-09-30T22:29:54.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:54.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:55.286 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:55.382 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:55.412 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:55.422 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:55.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.438+0000 7f139cfc0700 1 Processor -- start 2023-09-30T22:29:55.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.438+0000 7f139cfc0700 1 -- start start 2023-09-30T22:29:55.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.439+0000 7f139cfc0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f139812cf60 0x7f139806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.439+0000 7f139cfc0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1398130430 0x7f1398137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.439+0000 7f139cfc0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139812cd90 con 0x7f139812f8b0 2023-09-30T22:29:55.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.439+0000 7f139cfc0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139812d330 con 0x7f139812cf60 2023-09-30T22:29:55.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.439+0000 7f139cfc0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1398071780 con 0x7f1398130430 2023-09-30T22:29:55.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.439+0000 7f1395d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f139812f8b0 0x7f139812fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54492/0 (socket says 172.21.15.59:54492) 2023-09-30T22:29:55.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.439+0000 7f1396d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1398130430 0x7f1398137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.439+0000 7f1395d9b700 1 -- 172.21.15.59:0/1764564867 learned_addr learned my addr 172.21.15.59:0/1764564867 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:55.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.440+0000 7f1396d9d700 1 -- 172.21.15.59:0/1764564867 >> v2:172.21.15.59:3300/0 conn(0x7f139812cf60 msgr2=0x7f139806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.440+0000 7f1396d9d700 1 --2- 172.21.15.59:0/1764564867 >> v2:172.21.15.59:3300/0 conn(0x7f139812cf60 0x7f139806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.440+0000 7f1396d9d700 1 -- 172.21.15.59:0/1764564867 >> v1:172.21.15.59:6789/0 conn(0x7f139812f8b0 legacy=0x7f139812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.440+0000 7f1396d9d700 1 -- 172.21.15.59:0/1764564867 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1398071a40 con 0x7f1398130430 2023-09-30T22:29:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.440+0000 7f1396d9d700 1 --2- 172.21.15.59:0/1764564867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1398130430 0x7f1398137c30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1390009d90 tx=0x7f139000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a15a5223dc3d6e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.440+0000 7f139559a700 1 -- 172.21.15.59:0/1764564867 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000e070 con 0x7f1398130430 2023-09-30T22:29:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.440+0000 7f139559a700 1 -- 172.21.15.59:0/1764564867 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139000bad0 con 0x7f1398130430 2023-09-30T22:29:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.440+0000 7f139559a700 1 -- 172.21.15.59:0/1764564867 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000be80 con 0x7f1398130430 2023-09-30T22:29:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.441+0000 7f139cfc0700 1 -- 172.21.15.59:0/1764564867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1398130430 msgr2=0x7f1398137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.441+0000 7f139cfc0700 1 --2- 172.21.15.59:0/1764564867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1398130430 0x7f1398137c30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1390009d90 tx=0x7f139000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.441+0000 7f139cfc0700 1 -- 172.21.15.59:0/1764564867 shutdown_connections 2023-09-30T22:29:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.441+0000 7f139cfc0700 1 --2- 172.21.15.59:0/1764564867 >> v2:172.21.15.59:3300/0 conn(0x7f139812cf60 0x7f139806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.441+0000 7f139cfc0700 1 --2- 172.21.15.59:0/1764564867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1398130430 0x7f1398137c30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.441+0000 7f139cfc0700 1 -- 172.21.15.59:0/1764564867 >> 172.21.15.59:0/1764564867 conn(0x7f13980a2aa0 msgr2=0x7f13980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.441+0000 7f139cfc0700 1 -- 172.21.15.59:0/1764564867 shutdown_connections 2023-09-30T22:29:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.441+0000 7f139cfc0700 1 -- 172.21.15.59:0/1764564867 wait complete. 2023-09-30T22:29:55.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.442+0000 7f139cfc0700 1 Processor -- start 2023-09-30T22:29:55.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.443+0000 7f139cfc0700 1 -- start start 2023-09-30T22:29:55.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.443+0000 7f139cfc0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f139812cf60 0x7f139809b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.443+0000 7f139cfc0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139812f8b0 0x7f139809b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.443+0000 7f139cfc0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1398130430 0x7f139809beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.443+0000 7f139cfc0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139809d040 con 0x7f139812f8b0 2023-09-30T22:29:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.443+0000 7f139cfc0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139809d660 con 0x7f139812cf60 2023-09-30T22:29:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.443+0000 7f139cfc0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1398129fa0 con 0x7f1398130430 2023-09-30T22:29:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.443+0000 7f139659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f139812cf60 0x7f139809b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.443+0000 7f139659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f139812cf60 0x7f139809b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50120/0 (socket says 172.21.15.59:50120) 2023-09-30T22:29:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.443+0000 7f139659c700 1 -- 172.21.15.59:0/2807872952 learned_addr learned my addr 172.21.15.59:0/2807872952 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.443+0000 7f1395d9b700 1 --2- 172.21.15.59:0/2807872952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139812f8b0 0x7f139809b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.444+0000 7f1396d9d700 1 --2- 172.21.15.59:0/2807872952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1398130430 0x7f139809beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.444+0000 7f139659c700 1 -- 172.21.15.59:0/2807872952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1398130430 msgr2=0x7f139809beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.444+0000 7f139659c700 1 --2- 172.21.15.59:0/2807872952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1398130430 0x7f139809beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.444+0000 7f139659c700 1 -- 172.21.15.59:0/2807872952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139812f8b0 msgr2=0x7f139809b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.444+0000 7f139659c700 1 --2- 172.21.15.59:0/2807872952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139812f8b0 0x7f139809b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.444+0000 7f139659c700 1 -- 172.21.15.59:0/2807872952 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1390009a70 con 0x7f139812cf60 2023-09-30T22:29:55.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.444+0000 7f1396d9d700 1 --2- 172.21.15.59:0/2807872952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1398130430 0x7f139809beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:55.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.444+0000 7f139659c700 1 --2- 172.21.15.59:0/2807872952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f139812cf60 0x7f139809b430 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f138800b560 tx=0x7f138800b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.444+0000 7f1386ffd700 1 -- 172.21.15.59:0/2807872952 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388011830 con 0x7f139812cf60 2023-09-30T22:29:55.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.444+0000 7f1386ffd700 1 -- 172.21.15.59:0/2807872952 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13880119b0 con 0x7f139812cf60 2023-09-30T22:29:55.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.444+0000 7f1386ffd700 1 -- 172.21.15.59:0/2807872952 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388011d60 con 0x7f139812cf60 2023-09-30T22:29:55.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.444+0000 7f139cfc0700 1 -- 172.21.15.59:0/2807872952 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139809e9b0 con 0x7f139812cf60 2023-09-30T22:29:55.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.445+0000 7f139cfc0700 1 -- 172.21.15.59:0/2807872952 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139809e6e0 con 0x7f139812cf60 2023-09-30T22:29:55.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.446+0000 7f139cfc0700 1 -- 172.21.15.59:0/2807872952 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139809eb40 con 0x7f139812cf60 2023-09-30T22:29:55.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.446+0000 7f1386ffd700 1 -- 172.21.15.59:0/2807872952 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f138801a400 con 0x7f139812cf60 2023-09-30T22:29:55.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.446+0000 7f1386ffd700 1 -- 172.21.15.59:0/2807872952 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f138803fd00 con 0x7f139812cf60 2023-09-30T22:29:55.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.446+0000 7f1395d9b700 1 -- 172.21.15.59:0/2807872952 >> v1:172.21.15.59:6816/126772 conn(0x7f137802f510 legacy=0x7f13780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.451+0000 7f1386ffd700 1 -- 172.21.15.59:0/2807872952 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f139809eb40 con 0x7f139812cf60 2023-09-30T22:29:55.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.539+0000 7ffa27195700 1 Processor -- start 2023-09-30T22:29:55.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.539+0000 7ffa27195700 1 -- start start 2023-09-30T22:29:55.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.540+0000 7ffa27195700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 0x7ffa2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.540+0000 7ffa27195700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa2009e410 0x7ffa20134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.540+0000 7ffa27195700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2009b120 con 0x7ffa2009e000 2023-09-30T22:29:55.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.540+0000 7ffa27195700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2006b460 con 0x7ffa2009e410 2023-09-30T22:29:55.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.540+0000 7ffa27195700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2009a7e0 con 0x7ffa2009d6f0 2023-09-30T22:29:55.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.540+0000 7ffa1ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffa2009e000 0x7ffa201339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54494/0 (socket says 172.21.15.59:54494) 2023-09-30T22:29:55.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.540+0000 7ffa1ffff700 1 -- 172.21.15.59:0/1059739187 learned_addr learned my addr 172.21.15.59:0/1059739187 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:55.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.540+0000 7ffa25732700 1 --2- 172.21.15.59:0/1059739187 >> v2:172.21.15.59:3300/0 conn(0x7ffa2009e410 0x7ffa20134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.540+0000 7ffa1f7fe700 1 -- 172.21.15.59:0/1059739187 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871757830 0 0) 0x7ffa2009b120 con 0x7ffa2009e000 2023-09-30T22:29:55.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.540+0000 7ffa1f7fe700 1 -- 172.21.15.59:0/1059739187 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa100035b0 con 0x7ffa2009e000 2023-09-30T22:29:55.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.541+0000 7ffa25732700 1 -- 172.21.15.59:0/1059739187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 msgr2=0x7ffa2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:55.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.541+0000 7ffa25732700 1 --2- 172.21.15.59:0/1059739187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 0x7ffa2009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.541+0000 7ffa25732700 1 -- 172.21.15.59:0/1059739187 >> v1:172.21.15.59:6789/0 conn(0x7ffa2009e000 legacy=0x7ffa201339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.541+0000 7ffa25732700 1 -- 172.21.15.59:0/1059739187 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2009a500 con 0x7ffa2009e410 2023-09-30T22:29:55.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.541+0000 7ffa25732700 1 --2- 172.21.15.59:0/1059739187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009e410 0x7ffa20134100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009d90 tx=0x7ffa1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc651314ae0811d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.541+0000 7ffa1f7fe700 1 -- 172.21.15.59:0/1059739187 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1800e070 con 0x7ffa2009e410 2023-09-30T22:29:55.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.541+0000 7ffa1f7fe700 1 -- 172.21.15.59:0/1059739187 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1800bb20 con 0x7ffa2009e410 2023-09-30T22:29:55.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.541+0000 7ffa1f7fe700 1 -- 172.21.15.59:0/1059739187 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18012430 con 0x7ffa2009e410 2023-09-30T22:29:55.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.542+0000 7ffa27195700 1 -- 172.21.15.59:0/1059739187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009e410 msgr2=0x7ffa20134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.542+0000 7ffa27195700 1 --2- 172.21.15.59:0/1059739187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009e410 0x7ffa20134100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009d90 tx=0x7ffa1800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:55.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.542+0000 7ffa27195700 1 -- 172.21.15.59:0/1059739187 shutdown_connections 2023-09-30T22:29:55.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.542+0000 7ffa27195700 1 --2- 172.21.15.59:0/1059739187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009e410 0x7ffa20134100 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.542+0000 7ffa27195700 1 --2- 172.21.15.59:0/1059739187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 0x7ffa2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.542+0000 7ffa27195700 1 -- 172.21.15.59:0/1059739187 >> 172.21.15.59:0/1059739187 conn(0x7ffa20066f50 msgr2=0x7ffa2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.542+0000 7ffa27195700 1 -- 172.21.15.59:0/1059739187 shutdown_connections 2023-09-30T22:29:55.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.542+0000 7ffa27195700 1 -- 172.21.15.59:0/1059739187 wait complete. 2023-09-30T22:29:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.543+0000 7ffa27195700 1 Processor -- start 2023-09-30T22:29:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.544+0000 7ffa27195700 1 -- start start 2023-09-30T22:29:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.544+0000 7ffa27195700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 0x7ffa201a5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa27195700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2009e000 0x7ffa201a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa27195700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009e410 0x7ffa201c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa27195700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa201a7d90 con 0x7ffa2009e410 2023-09-30T22:29:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa27195700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa201a4cd0 con 0x7ffa2009d6f0 2023-09-30T22:29:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa27195700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa201a6420 con 0x7ffa2009e000 2023-09-30T22:29:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa1ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2009e000 0x7ffa201a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa1ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2009e000 0x7ffa201a57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59340/0 (socket says 172.21.15.59:59340) 2023-09-30T22:29:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa1ffff700 1 -- 172.21.15.59:0/2796465315 learned_addr learned my addr 172.21.15.59:0/2796465315 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa24f31700 1 --2- 172.21.15.59:0/2796465315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 0x7ffa201a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa25732700 1 --2- 172.21.15.59:0/2796465315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009e410 0x7ffa201c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa1ffff700 1 -- 172.21.15.59:0/2796465315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 msgr2=0x7ffa201a5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa1ffff700 1 --2- 172.21.15.59:0/2796465315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 0x7ffa201a5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa1ffff700 1 -- 172.21.15.59:0/2796465315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009e410 msgr2=0x7ffa201c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa1ffff700 1 --2- 172.21.15.59:0/2796465315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009e410 0x7ffa201c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa1ffff700 1 -- 172.21.15.59:0/2796465315 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa18009a70 con 0x7ffa2009e000 2023-09-30T22:29:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa25732700 1 --2- 172.21.15.59:0/2796465315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009e410 0x7ffa201c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.545+0000 7ffa1ffff700 1 --2- 172.21.15.59:0/2796465315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2009e000 0x7ffa201a57b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c005910 tx=0x7ffa0c00ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.546+0000 7ffa1d7fa700 1 -- 172.21.15.59:0/2796465315 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c005d70 con 0x7ffa2009e000 2023-09-30T22:29:55.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.546+0000 7ffa1d7fa700 1 -- 172.21.15.59:0/2796465315 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c0070d0 con 0x7ffa2009e000 2023-09-30T22:29:55.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.546+0000 7ffa1d7fa700 1 -- 172.21.15.59:0/2796465315 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c007460 con 0x7ffa2009e000 2023-09-30T22:29:55.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.546+0000 7ffa27195700 1 -- 172.21.15.59:0/2796465315 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa200a2e20 con 0x7ffa2009e000 2023-09-30T22:29:55.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.546+0000 7ffa27195700 1 -- 172.21.15.59:0/2796465315 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa201b92c0 con 0x7ffa2009e000 2023-09-30T22:29:55.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.547+0000 7ffa1d7fa700 1 -- 172.21.15.59:0/2796465315 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ffa0c0075c0 con 0x7ffa2009e000 2023-09-30T22:29:55.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.547+0000 7ffa27195700 1 -- 172.21.15.59:0/2796465315 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa201a5cf0 con 0x7ffa2009e000 2023-09-30T22:29:55.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.547+0000 7ffa1d7fa700 1 -- 172.21.15.59:0/2796465315 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ffa0c03f270 con 0x7ffa2009e000 2023-09-30T22:29:55.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.547+0000 7ffa24f31700 1 -- 172.21.15.59:0/2796465315 >> v1:172.21.15.59:6816/126772 conn(0x7ffa0402f510 legacy=0x7ffa040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:55.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.553+0000 7ffa1d7fa700 1 -- 172.21.15.59:0/2796465315 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa0c00e280 con 0x7ffa2009e000 2023-09-30T22:29:55.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.572+0000 7f8d24bdd700 1 Processor -- start 2023-09-30T22:29:55.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.572+0000 7f8d24bdd700 1 -- start start 2023-09-30T22:29:55.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.573+0000 7f8d24bdd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d2009d6f0 0x7f8d2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.573+0000 7f8d24bdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2009e410 0x7f8d20130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.573+0000 7f8d24bdd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2009f130 con 0x7f8d2009e000 2023-09-30T22:29:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.573+0000 7f8d24bdd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2009f520 con 0x7f8d2009d6f0 2023-09-30T22:29:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.573+0000 7f8d24bdd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2009e930 con 0x7f8d2009e410 2023-09-30T22:29:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.573+0000 7f8d15d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8d2009e000 0x7f8d20130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54500/0 (socket says 172.21.15.59:54500) 2023-09-30T22:29:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.573+0000 7f8d15d9b700 1 -- 172.21.15.59:0/2913074801 learned_addr learned my addr 172.21.15.59:0/2913074801 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.573+0000 7f8d1ed9d700 1 --2- 172.21.15.59:0/2913074801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2009e410 0x7f8d20130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.573+0000 7f8d1e59c700 1 --2- 172.21.15.59:0/2913074801 >> v2:172.21.15.59:3300/0 conn(0x7f8d2009d6f0 0x7f8d2009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.573+0000 7f8d1dd9b700 1 -- 172.21.15.59:0/2913074801 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941141777 0 0) 0x7f8d2009f130 con 0x7f8d2009e000 2023-09-30T22:29:55.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.573+0000 7f8d1dd9b700 1 -- 172.21.15.59:0/2913074801 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d0c0057c0 con 0x7f8d2009e000 2023-09-30T22:29:55.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.573+0000 7f8d1ed9d700 1 -- 172.21.15.59:0/2913074801 >> v2:172.21.15.59:3300/0 conn(0x7f8d2009d6f0 msgr2=0x7f8d2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:55.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.573+0000 7f8d1ed9d700 1 --2- 172.21.15.59:0/2913074801 >> v2:172.21.15.59:3300/0 conn(0x7f8d2009d6f0 0x7f8d2009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.574+0000 7f8d1ed9d700 1 -- 172.21.15.59:0/2913074801 >> v1:172.21.15.59:6789/0 conn(0x7f8d2009e000 legacy=0x7f8d20130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.574+0000 7f8d1ed9d700 1 -- 172.21.15.59:0/2913074801 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2009b2d0 con 0x7f8d2009e410 2023-09-30T22:29:55.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.574+0000 7f8d1ed9d700 1 --2- 172.21.15.59:0/2913074801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2009e410 0x7f8d20130d70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009d90 tx=0x7f8d1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4a6518533ce5c1e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.574+0000 7f8d1dd9b700 1 -- 172.21.15.59:0/2913074801 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1800e070 con 0x7f8d2009e410 2023-09-30T22:29:55.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.574+0000 7f8d1dd9b700 1 -- 172.21.15.59:0/2913074801 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1800bb20 con 0x7f8d2009e410 2023-09-30T22:29:55.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.574+0000 7f8d1dd9b700 1 -- 172.21.15.59:0/2913074801 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18012430 con 0x7f8d2009e410 2023-09-30T22:29:55.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.575+0000 7f8d24bdd700 1 -- 172.21.15.59:0/2913074801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2009e410 msgr2=0x7f8d20130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.575+0000 7f8d24bdd700 1 --2- 172.21.15.59:0/2913074801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2009e410 0x7f8d20130d70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009d90 tx=0x7f8d1800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:55.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.575+0000 7f8d24bdd700 1 -- 172.21.15.59:0/2913074801 shutdown_connections 2023-09-30T22:29:55.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.575+0000 7f8d24bdd700 1 --2- 172.21.15.59:0/2913074801 >> v2:172.21.15.59:3300/0 conn(0x7f8d2009d6f0 0x7f8d2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.575+0000 7f8d24bdd700 1 --2- 172.21.15.59:0/2913074801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2009e410 0x7f8d20130d70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.575+0000 7f8d24bdd700 1 -- 172.21.15.59:0/2913074801 >> 172.21.15.59:0/2913074801 conn(0x7f8d20066f50 msgr2=0x7f8d2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.575+0000 7f8d24bdd700 1 -- 172.21.15.59:0/2913074801 shutdown_connections 2023-09-30T22:29:55.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.575+0000 7f8d24bdd700 1 -- 172.21.15.59:0/2913074801 wait complete. 2023-09-30T22:29:55.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.576+0000 7f8d24bdd700 1 Processor -- start 2023-09-30T22:29:55.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.576+0000 7f8d24bdd700 1 -- start start 2023-09-30T22:29:55.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.577+0000 7f8d24bdd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2009d6f0 0x7f8d201220e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.577+0000 7f8d24bdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2009e000 0x7f8d20122620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.577+0000 7f8d24bdd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d2009e410 0x7f8d20122b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.577+0000 7f8d24bdd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d20130480 con 0x7f8d2009d6f0 2023-09-30T22:29:55.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.577+0000 7f8d24bdd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d20125660 con 0x7f8d2009e000 2023-09-30T22:29:55.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.577+0000 7f8d24bdd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d20124550 con 0x7f8d2009e410 2023-09-30T22:29:55.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.577+0000 7f8d15d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2009e000 0x7f8d20122620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.577+0000 7f8d15d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2009e000 0x7f8d20122620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50164/0 (socket says 172.21.15.59:50164) 2023-09-30T22:29:55.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.577+0000 7f8d15d9b700 1 -- 172.21.15.59:0/1982226867 learned_addr learned my addr 172.21.15.59:0/1982226867 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:55.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.577+0000 7f8d1e59c700 1 --2- 172.21.15.59:0/1982226867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2009d6f0 0x7f8d201220e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.577+0000 7f8d1ed9d700 1 --2- 172.21.15.59:0/1982226867 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d2009e410 0x7f8d20122b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.578+0000 7f8d1e59c700 1 -- 172.21.15.59:0/1982226867 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d2009e410 msgr2=0x7f8d20122b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.578+0000 7f8d1e59c700 1 --2- 172.21.15.59:0/1982226867 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d2009e410 0x7f8d20122b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.578+0000 7f8d1e59c700 1 -- 172.21.15.59:0/1982226867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2009e000 msgr2=0x7f8d20122620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.578+0000 7f8d1e59c700 1 --2- 172.21.15.59:0/1982226867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2009e000 0x7f8d20122620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.578+0000 7f8d1e59c700 1 -- 172.21.15.59:0/1982226867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d18009a70 con 0x7f8d2009d6f0 2023-09-30T22:29:55.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.578+0000 7f8d1e59c700 1 --2- 172.21.15.59:0/1982226867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2009d6f0 0x7f8d201220e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000e930 tx=0x7f8d1000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.578+0000 7f8785f96700 1 Processor -- start 2023-09-30T22:29:55.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.578+0000 7f8d177fe700 1 -- 172.21.15.59:0/1982226867 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d10013680 con 0x7f8d2009d6f0 2023-09-30T22:29:55.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.578+0000 7f8d177fe700 1 -- 172.21.15.59:0/1982226867 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d100137e0 con 0x7f8d2009d6f0 2023-09-30T22:29:55.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.578+0000 7f8d24bdd700 1 -- 172.21.15.59:0/1982226867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d20125390 con 0x7f8d2009d6f0 2023-09-30T22:29:55.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.578+0000 7f8d24bdd700 1 -- 172.21.15.59:0/1982226867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d20125920 con 0x7f8d2009d6f0 2023-09-30T22:29:55.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.578+0000 7f8d177fe700 1 -- 172.21.15.59:0/1982226867 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d10013b50 con 0x7f8d2009d6f0 2023-09-30T22:29:55.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.578+0000 7f8785f96700 1 -- start start 2023-09-30T22:29:55.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.579+0000 7f8785f96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878006a770 0x7f878009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.579+0000 7f8785f96700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f878009dc30 0x7f878009e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.579+0000 7f8785f96700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f878013c1e0 0x7f878013e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.579+0000 7f8785f96700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878006ab40 con 0x7f878009dc30 2023-09-30T22:29:55.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.579+0000 7f8785f96700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878009ebc0 con 0x7f878006a770 2023-09-30T22:29:55.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.579+0000 7f8785f96700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f878009a810 con 0x7f878013c1e0 2023-09-30T22:29:55.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.579+0000 7f877effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f878009dc30 0x7f878009e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.579+0000 7f877effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f878009dc30 0x7f878009e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51672/0 (socket says 172.21.15.59:51672) 2023-09-30T22:29:55.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.579+0000 7f877effd700 1 -- 172.21.15.59:0/191366345 learned_addr learned my addr 172.21.15.59:0/191366345 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:55.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.579+0000 7f877ffff700 1 --2- 172.21.15.59:0/191366345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f878013c1e0 0x7f878013e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.579+0000 7f8d177fe700 1 -- 172.21.15.59:0/1982226867 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8d10013cb0 con 0x7f8d2009d6f0 2023-09-30T22:29:55.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.579+0000 7f877f7fe700 1 --2- 172.21.15.59:0/191366345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878006a770 0x7f878009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.579+0000 7f8d177fe700 1 -- 172.21.15.59:0/1982226867 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8d1003fe20 con 0x7f8d2009d6f0 2023-09-30T22:29:55.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.579+0000 7f8d15d9b700 1 -- 172.21.15.59:0/1982226867 >> v1:172.21.15.59:6816/126772 conn(0x7f8d0002f510 legacy=0x7f8d000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:55.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.580+0000 7f877ffff700 1 -- 172.21.15.59:0/191366345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878006a770 msgr2=0x7f878009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:55.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.580+0000 7f877ffff700 1 --2- 172.21.15.59:0/191366345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878006a770 0x7f878009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.580+0000 7f877ffff700 1 -- 172.21.15.59:0/191366345 >> v2:172.21.15.59:3300/0 conn(0x7f878009dc30 msgr2=0x7f878009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.580+0000 7f877ffff700 1 --2- 172.21.15.59:0/191366345 >> v2:172.21.15.59:3300/0 conn(0x7f878009dc30 0x7f878009e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.580+0000 7f877ffff700 1 -- 172.21.15.59:0/191366345 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878009e920 con 0x7f878013c1e0 2023-09-30T22:29:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.580+0000 7f877ffff700 1 --2- 172.21.15.59:0/191366345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f878013c1e0 0x7f878013e5c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8778009870 tx=0x7f8778009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=120da7f8b4e70b80 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.580+0000 7f877e7fc700 1 -- 172.21.15.59:0/191366345 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778011830 con 0x7f878013c1e0 2023-09-30T22:29:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.580+0000 7f877e7fc700 1 -- 172.21.15.59:0/191366345 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8778011990 con 0x7f878013c1e0 2023-09-30T22:29:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.580+0000 7f877e7fc700 1 -- 172.21.15.59:0/191366345 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778011d20 con 0x7f878013c1e0 2023-09-30T22:29:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.580+0000 7f8d24bdd700 1 -- 172.21.15.59:0/1982226867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d040052e0 con 0x7f8d2009d6f0 2023-09-30T22:29:55.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.581+0000 7f8785f96700 1 -- 172.21.15.59:0/191366345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f878013c1e0 msgr2=0x7f878013e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.581+0000 7f8785f96700 1 --2- 172.21.15.59:0/191366345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f878013c1e0 0x7f878013e5c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8778009870 tx=0x7f8778009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:55.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.581+0000 7f8785f96700 1 -- 172.21.15.59:0/191366345 shutdown_connections 2023-09-30T22:29:55.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.581+0000 7f8785f96700 1 --2- 172.21.15.59:0/191366345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f878013c1e0 0x7f878013e5c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.581+0000 7f8785f96700 1 --2- 172.21.15.59:0/191366345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878006a770 0x7f878009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.581+0000 7f8785f96700 1 --2- 172.21.15.59:0/191366345 >> v2:172.21.15.59:3300/0 conn(0x7f878009dc30 0x7f878009e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.581+0000 7f8785f96700 1 -- 172.21.15.59:0/191366345 >> 172.21.15.59:0/191366345 conn(0x7f8780066f50 msgr2=0x7f878009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.582+0000 7f8785f96700 1 -- 172.21.15.59:0/191366345 shutdown_connections 2023-09-30T22:29:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.582+0000 7f8785f96700 1 -- 172.21.15.59:0/191366345 wait complete. 2023-09-30T22:29:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.583+0000 7f8785f96700 1 Processor -- start 2023-09-30T22:29:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.583+0000 7f8785f96700 1 -- start start 2023-09-30T22:29:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.583+0000 7f8785f96700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878006a770 0x7f878013bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.583+0000 7f8785f96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878013c1e0 0x7f878013a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.583+0000 7f8785f96700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f878013abc0 0x7f878013b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.583+0000 7f8785f96700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8780072560 con 0x7f878006a770 2023-09-30T22:29:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.583+0000 7f8785f96700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878011fc70 con 0x7f878013c1e0 2023-09-30T22:29:55.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.583+0000 7f8785f96700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8780072370 con 0x7f878013abc0 2023-09-30T22:29:55.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.584+0000 7f877f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878006a770 0x7f878013bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.584+0000 7f877f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878006a770 0x7f878013bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51676/0 (socket says 172.21.15.59:51676) 2023-09-30T22:29:55.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.584+0000 7f877f7fe700 1 -- 172.21.15.59:0/3133935304 learned_addr learned my addr 172.21.15.59:0/3133935304 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:55.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.584+0000 7f877effd700 1 --2- 172.21.15.59:0/3133935304 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878013c1e0 0x7f878013a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.584+0000 7f877f7fe700 1 -- 172.21.15.59:0/3133935304 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f878013abc0 msgr2=0x7f878013b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.584+0000 7f877f7fe700 1 --2- 172.21.15.59:0/3133935304 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f878013abc0 0x7f878013b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.584+0000 7f877f7fe700 1 -- 172.21.15.59:0/3133935304 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878013c1e0 msgr2=0x7f878013a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.584+0000 7f877f7fe700 1 --2- 172.21.15.59:0/3133935304 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878013c1e0 0x7f878013a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.584+0000 7f877f7fe700 1 -- 172.21.15.59:0/3133935304 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87780094a0 con 0x7f878006a770 2023-09-30T22:29:55.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.584+0000 7f877f7fe700 1 --2- 172.21.15.59:0/3133935304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878006a770 0x7f878013bac0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f876800e9e0 tx=0x7f876800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.586+0000 7f8777fff700 1 -- 172.21.15.59:0/3133935304 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768009710 con 0x7f878006a770 2023-09-30T22:29:55.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.586+0000 7f8777fff700 1 -- 172.21.15.59:0/3133935304 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876800c850 con 0x7f878006a770 2023-09-30T22:29:55.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.586+0000 7f8785f96700 1 -- 172.21.15.59:0/3133935304 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878013c000 con 0x7f878006a770 2023-09-30T22:29:55.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.586+0000 7f8777fff700 1 -- 172.21.15.59:0/3133935304 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876800cbc0 con 0x7f878006a770 2023-09-30T22:29:55.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.586+0000 7f8785f96700 1 -- 172.21.15.59:0/3133935304 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878009f1a0 con 0x7f878006a770 2023-09-30T22:29:55.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.586+0000 7f8d177fe700 1 -- 172.21.15.59:0/1982226867 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d10017080 con 0x7f8d2009d6f0 2023-09-30T22:29:55.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.587+0000 7f8785f96700 1 -- 172.21.15.59:0/3133935304 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87640052e0 con 0x7f878006a770 2023-09-30T22:29:55.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.588+0000 7f8777fff700 1 -- 172.21.15.59:0/3133935304 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f876800cd20 con 0x7f878006a770 2023-09-30T22:29:55.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.588+0000 7f8777fff700 1 -- 172.21.15.59:0/3133935304 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f876803fc30 con 0x7f878006a770 2023-09-30T22:29:55.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.588+0000 7f877effd700 1 -- 172.21.15.59:0/3133935304 >> v1:172.21.15.59:6816/126772 conn(0x7f876002f510 legacy=0x7f87600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:55.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.597+0000 7f8777fff700 1 -- 172.21.15.59:0/3133935304 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8768046080 con 0x7f878006a770 2023-09-30T22:29:55.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.647+0000 7f1395d9b700 1 -- 172.21.15.59:0/2807872952 >> v1:172.21.15.59:6816/126772 conn(0x7f137802f510 legacy=0x7f13780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:55.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.682+0000 7f139cfc0700 1 -- 172.21.15.59:0/2807872952 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f139809eb40 con 0x7f139812cf60 2023-09-30T22:29:55.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.683+0000 7f1386ffd700 1 -- 172.21.15.59:0/2807872952 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f139809eb40 con 0x7f139812cf60 2023-09-30T22:29:55.684 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:55.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.685+0000 7f139cfc0700 1 -- 172.21.15.59:0/2807872952 >> v1:172.21.15.59:6816/126772 conn(0x7f137802f510 legacy=0x7f13780319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:55.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.685+0000 7f139cfc0700 1 -- 172.21.15.59:0/2807872952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f139812cf60 msgr2=0x7f139809b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.685+0000 7f139cfc0700 1 --2- 172.21.15.59:0/2807872952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f139812cf60 0x7f139809b430 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f138800b560 tx=0x7f138800b870 comp rx=0 tx=0).stop 2023-09-30T22:29:55.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.685+0000 7f139cfc0700 1 -- 172.21.15.59:0/2807872952 shutdown_connections 2023-09-30T22:29:55.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.685+0000 7f139cfc0700 1 --2- 172.21.15.59:0/2807872952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1398130430 0x7f139809beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.685+0000 7f139cfc0700 1 --2- 172.21.15.59:0/2807872952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f139812cf60 0x7f139809b430 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.685+0000 7f139cfc0700 1 --2- 172.21.15.59:0/2807872952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139812f8b0 0x7f139809b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.685+0000 7f139cfc0700 1 -- 172.21.15.59:0/2807872952 >> 172.21.15.59:0/2807872952 conn(0x7f13980a2aa0 msgr2=0x7f139806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.686+0000 7f139cfc0700 1 -- 172.21.15.59:0/2807872952 shutdown_connections 2023-09-30T22:29:55.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.686+0000 7f139cfc0700 1 -- 172.21.15.59:0/2807872952 wait complete. 2023-09-30T22:29:55.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:55.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.748+0000 7ffa24f31700 1 -- 172.21.15.59:0/2796465315 >> v1:172.21.15.59:6816/126772 conn(0x7ffa0402f510 legacy=0x7ffa040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:55.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.771+0000 7ffa27195700 1 -- 172.21.15.59:0/2796465315 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffa20074ea0 con 0x7ffa2009e000 2023-09-30T22:29:55.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.771+0000 7ffa1d7fa700 1 -- 172.21.15.59:0/2796465315 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa0c017020 con 0x7ffa2009e000 2023-09-30T22:29:55.772 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:55.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.773+0000 7ffa27195700 1 -- 172.21.15.59:0/2796465315 >> v1:172.21.15.59:6816/126772 conn(0x7ffa0402f510 legacy=0x7ffa040319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:55.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.773+0000 7ffa27195700 1 -- 172.21.15.59:0/2796465315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2009e000 msgr2=0x7ffa201a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.773+0000 7ffa27195700 1 --2- 172.21.15.59:0/2796465315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2009e000 0x7ffa201a57b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c005910 tx=0x7ffa0c00ca90 comp rx=0 tx=0).stop 2023-09-30T22:29:55.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.773+0000 7ffa27195700 1 -- 172.21.15.59:0/2796465315 shutdown_connections 2023-09-30T22:29:55.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.773+0000 7ffa27195700 1 --2- 172.21.15.59:0/2796465315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009e410 0x7ffa201c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.773+0000 7ffa27195700 1 --2- 172.21.15.59:0/2796465315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 0x7ffa201a5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.773+0000 7ffa27195700 1 --2- 172.21.15.59:0/2796465315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2009e000 0x7ffa201a57b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.773+0000 7ffa27195700 1 -- 172.21.15.59:0/2796465315 >> 172.21.15.59:0/2796465315 conn(0x7ffa20066f50 msgr2=0x7ffa201bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.773+0000 7ffa27195700 1 -- 172.21.15.59:0/2796465315 shutdown_connections 2023-09-30T22:29:55.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.773+0000 7ffa27195700 1 -- 172.21.15.59:0/2796465315 wait complete. 2023-09-30T22:29:55.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.780+0000 7f8d15d9b700 1 -- 172.21.15.59:0/1982226867 >> v1:172.21.15.59:6816/126772 conn(0x7f8d0002f510 legacy=0x7f8d000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:55.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:55.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.789+0000 7f877effd700 1 -- 172.21.15.59:0/3133935304 >> v1:172.21.15.59:6816/126772 conn(0x7f876002f510 legacy=0x7f87600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.810+0000 7f8d24bdd700 1 -- 172.21.15.59:0/1982226867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8d04005150 con 0x7f8d2009d6f0 2023-09-30T22:29:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.810+0000 7f8d177fe700 1 -- 172.21.15.59:0/1982226867 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d10021030 con 0x7f8d2009d6f0 2023-09-30T22:29:55.811 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:55.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.812+0000 7f8d24bdd700 1 -- 172.21.15.59:0/1982226867 >> v1:172.21.15.59:6816/126772 conn(0x7f8d0002f510 legacy=0x7f8d000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:55.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.812+0000 7f8d24bdd700 1 -- 172.21.15.59:0/1982226867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2009d6f0 msgr2=0x7f8d201220e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.812+0000 7f8d24bdd700 1 --2- 172.21.15.59:0/1982226867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2009d6f0 0x7f8d201220e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000e930 tx=0x7f8d1000ec40 comp rx=0 tx=0).stop 2023-09-30T22:29:55.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.812+0000 7f8d24bdd700 1 -- 172.21.15.59:0/1982226867 shutdown_connections 2023-09-30T22:29:55.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.812+0000 7f8d24bdd700 1 --2- 172.21.15.59:0/1982226867 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d2009e410 0x7f8d20122b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.812+0000 7f8d24bdd700 1 --2- 172.21.15.59:0/1982226867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2009d6f0 0x7f8d201220e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.812+0000 7f8d24bdd700 1 --2- 172.21.15.59:0/1982226867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2009e000 0x7f8d20122620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.812+0000 7f8d24bdd700 1 -- 172.21.15.59:0/1982226867 >> 172.21.15.59:0/1982226867 conn(0x7f8d20066f50 msgr2=0x7f8d20130a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.812+0000 7f8d24bdd700 1 -- 172.21.15.59:0/1982226867 shutdown_connections 2023-09-30T22:29:55.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.812+0000 7f8d24bdd700 1 -- 172.21.15.59:0/1982226867 wait complete. 2023-09-30T22:29:55.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:55.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.829+0000 7f8785f96700 1 -- 172.21.15.59:0/3133935304 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8764005860 con 0x7f878006a770 2023-09-30T22:29:55.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.829+0000 7f8777fff700 1 -- 172.21.15.59:0/3133935304 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8768021020 con 0x7f878006a770 2023-09-30T22:29:55.831 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:55.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.832+0000 7f8785f96700 1 -- 172.21.15.59:0/3133935304 >> v1:172.21.15.59:6816/126772 conn(0x7f876002f510 legacy=0x7f87600319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:55.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.832+0000 7f8785f96700 1 -- 172.21.15.59:0/3133935304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878006a770 msgr2=0x7f878013bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.832+0000 7f8785f96700 1 --2- 172.21.15.59:0/3133935304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878006a770 0x7f878013bac0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f876800e9e0 tx=0x7f876800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.832+0000 7f8785f96700 1 -- 172.21.15.59:0/3133935304 shutdown_connections 2023-09-30T22:29:55.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.832+0000 7f8785f96700 1 --2- 172.21.15.59:0/3133935304 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f878013abc0 0x7f878013b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.832+0000 7f8785f96700 1 --2- 172.21.15.59:0/3133935304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878006a770 0x7f878013bac0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.832+0000 7f8785f96700 1 --2- 172.21.15.59:0/3133935304 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878013c1e0 0x7f878013a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.832+0000 7f8785f96700 1 -- 172.21.15.59:0/3133935304 >> 172.21.15.59:0/3133935304 conn(0x7f8780066f50 msgr2=0x7f878009b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.832+0000 7f8785f96700 1 -- 172.21.15.59:0/3133935304 shutdown_connections 2023-09-30T22:29:55.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:55.832+0000 7f8785f96700 1 -- 172.21.15.59:0/3133935304 wait complete. 2023-09-30T22:29:55.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:56.707 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:56.789 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:56.829 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:56.847 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:56.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.856+0000 7f0aec371700 1 Processor -- start 2023-09-30T22:29:56.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.856+0000 7f0aec371700 1 -- start start 2023-09-30T22:29:56.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aec371700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0ae409d6f0 0x7f0ae409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aec371700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ae409e000 0x7f0ae41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aec371700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ae409e410 0x7f0ae4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aec371700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae406b460 con 0x7f0ae409d6f0 2023-09-30T22:29:56.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aec371700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae409b120 con 0x7f0ae409e410 2023-09-30T22:29:56.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aec371700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae409a7e0 con 0x7f0ae409e000 2023-09-30T22:29:56.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aea10d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0ae409d6f0 0x7f0ae409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aea90e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ae409e410 0x7f0ae4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aea90e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ae409e410 0x7f0ae4133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50186/0 (socket says 172.21.15.59:50186) 2023-09-30T22:29:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aea10d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0ae409d6f0 0x7f0ae409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51682/0 (socket says 172.21.15.59:51682) 2023-09-30T22:29:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aea90e700 1 -- 172.21.15.59:0/3238617968 learned_addr learned my addr 172.21.15.59:0/3238617968 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aea10d700 1 -- 172.21.15.59:0/3238617968 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ae409e000 msgr2=0x7f0ae41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aea10d700 1 --2- 172.21.15.59:0/3238617968 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ae409e000 0x7f0ae41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aea10d700 1 -- 172.21.15.59:0/3238617968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ae409e410 msgr2=0x7f0ae4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aea10d700 1 --2- 172.21.15.59:0/3238617968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ae409e410 0x7f0ae4133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aea10d700 1 -- 172.21.15.59:0/3238617968 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae409a500 con 0x7f0ae409d6f0 2023-09-30T22:29:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aea90e700 1 --2- 172.21.15.59:0/3238617968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ae409e410 0x7f0ae4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.857+0000 7f0aea10d700 1 --2- 172.21.15.59:0/3238617968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae409d6f0 0x7f0ae409dac0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009840 tx=0x7f0ae0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea51354149fab44 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.858+0000 7f0ae910b700 1 -- 172.21.15.59:0/3238617968 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0011830 con 0x7f0ae409d6f0 2023-09-30T22:29:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.858+0000 7f0ae910b700 1 -- 172.21.15.59:0/3238617968 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0011990 con 0x7f0ae409d6f0 2023-09-30T22:29:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.858+0000 7f0ae910b700 1 -- 172.21.15.59:0/3238617968 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0011d20 con 0x7f0ae409d6f0 2023-09-30T22:29:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.859+0000 7f0aec371700 1 -- 172.21.15.59:0/3238617968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae409d6f0 msgr2=0x7f0ae409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.859+0000 7f0aec371700 1 --2- 172.21.15.59:0/3238617968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae409d6f0 0x7f0ae409dac0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009840 tx=0x7f0ae0009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.859+0000 7f0aec371700 1 -- 172.21.15.59:0/3238617968 shutdown_connections 2023-09-30T22:29:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.859+0000 7f0aec371700 1 --2- 172.21.15.59:0/3238617968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ae409e410 0x7f0ae4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.859+0000 7f0aec371700 1 --2- 172.21.15.59:0/3238617968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae409d6f0 0x7f0ae409dac0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.859+0000 7f0aec371700 1 --2- 172.21.15.59:0/3238617968 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ae409e000 0x7f0ae41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.859+0000 7f0aec371700 1 -- 172.21.15.59:0/3238617968 >> 172.21.15.59:0/3238617968 conn(0x7f0ae4066f50 msgr2=0x7f0ae409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.859+0000 7f0aec371700 1 -- 172.21.15.59:0/3238617968 shutdown_connections 2023-09-30T22:29:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.859+0000 7f0aec371700 1 -- 172.21.15.59:0/3238617968 wait complete. 2023-09-30T22:29:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.861+0000 7f0aec371700 1 Processor -- start 2023-09-30T22:29:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.861+0000 7f0aec371700 1 -- start start 2023-09-30T22:29:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.861+0000 7f0aec371700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ae409d6f0 0x7f0ae41c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.861+0000 7f0aec371700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae409e000 0x7f0ae41c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.861+0000 7f0aec371700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ae409e410 0x7f0ae41c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.861+0000 7f0aec371700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae41a9600 con 0x7f0ae409e000 2023-09-30T22:29:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.861+0000 7f0aec371700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae41ab920 con 0x7f0ae409d6f0 2023-09-30T22:29:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.861+0000 7f0aec371700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae409c710 con 0x7f0ae409e410 2023-09-30T22:29:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.862+0000 7f0ae990c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae409e000 0x7f0ae41c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.862+0000 7f0ae990c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae409e000 0x7f0ae41c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51690/0 (socket says 172.21.15.59:51690) 2023-09-30T22:29:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.862+0000 7f0ae990c700 1 -- 172.21.15.59:0/3958207465 learned_addr learned my addr 172.21.15.59:0/3958207465 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.862+0000 7f0aea10d700 1 --2- 172.21.15.59:0/3958207465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ae409d6f0 0x7f0ae41c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.862+0000 7f0ae990c700 1 -- 172.21.15.59:0/3958207465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ae409e410 msgr2=0x7f0ae41c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.862+0000 7f0ae990c700 1 --2- 172.21.15.59:0/3958207465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ae409e410 0x7f0ae41c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.862+0000 7f0ae990c700 1 -- 172.21.15.59:0/3958207465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ae409d6f0 msgr2=0x7f0ae41c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.862+0000 7f0ae990c700 1 --2- 172.21.15.59:0/3958207465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ae409d6f0 0x7f0ae41c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.862+0000 7f0ae990c700 1 -- 172.21.15.59:0/3958207465 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc009b30 con 0x7f0ae409e000 2023-09-30T22:29:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.862+0000 7f0ae990c700 1 --2- 172.21.15.59:0/3958207465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae409e000 0x7f0ae41c8d00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400b530 tx=0x7f0ad400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.863+0000 7f0adaffd700 1 -- 172.21.15.59:0/3958207465 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4011830 con 0x7f0ae409e000 2023-09-30T22:29:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.863+0000 7f0adaffd700 1 -- 172.21.15.59:0/3958207465 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad4011990 con 0x7f0ae409e000 2023-09-30T22:29:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.863+0000 7f0aec371700 1 -- 172.21.15.59:0/3958207465 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae00094a0 con 0x7f0ae409e000 2023-09-30T22:29:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.863+0000 7f0adaffd700 1 -- 172.21.15.59:0/3958207465 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4011d40 con 0x7f0ae409e000 2023-09-30T22:29:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.863+0000 7f0aec371700 1 -- 172.21.15.59:0/3958207465 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae41aab10 con 0x7f0ae409e000 2023-09-30T22:29:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.864+0000 7f0aec371700 1 -- 172.21.15.59:0/3958207465 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae4074ea0 con 0x7f0ae409e000 2023-09-30T22:29:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.865+0000 7f0adaffd700 1 -- 172.21.15.59:0/3958207465 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0ad401a400 con 0x7f0ae409e000 2023-09-30T22:29:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.865+0000 7f0adaffd700 1 -- 172.21.15.59:0/3958207465 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0ad403fa60 con 0x7f0ae409e000 2023-09-30T22:29:56.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.865+0000 7f0aea10d700 1 -- 172.21.15.59:0/3958207465 >> v1:172.21.15.59:6816/126772 conn(0x7f0ac802f510 legacy=0x7f0ac80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:56.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.870+0000 7f0adaffd700 1 -- 172.21.15.59:0/3958207465 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ad400f8d0 con 0x7f0ae409e000 2023-09-30T22:29:56.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.948+0000 7fe088c12700 1 Processor -- start 2023-09-30T22:29:56.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.948+0000 7fe088c12700 1 -- start start 2023-09-30T22:29:56.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.949+0000 7fe088c12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0841305f0 0x7fe0841309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.949+0000 7fe088c12700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe08406f660 0x7fe08406fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.949+0000 7fe088c12700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0841301c0 con 0x7fe08406ff90 2023-09-30T22:29:56.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.949+0000 7fe088c12700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe084071ff0 con 0x7fe08406f660 2023-09-30T22:29:56.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.949+0000 7fe088c12700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe084070e70 con 0x7fe0841305f0 2023-09-30T22:29:56.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.949+0000 7fe08259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0841305f0 0x7fe0841309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.949+0000 7fe08259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0841305f0 0x7fe0841309c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59408/0 (socket says 172.21.15.59:59408) 2023-09-30T22:29:56.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.949+0000 7fe08259c700 1 -- 172.21.15.59:0/2731989330 learned_addr learned my addr 172.21.15.59:0/2731989330 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:56.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.949+0000 7fe081d9b700 1 --2- 172.21.15.59:0/2731989330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe08406f660 0x7fe08406fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.950+0000 7fe081d9b700 1 -- 172.21.15.59:0/2731989330 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0841305f0 msgr2=0x7fe0841309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:56.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.950+0000 7fe081d9b700 1 --2- 172.21.15.59:0/2731989330 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0841305f0 0x7fe0841309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.950+0000 7fe081d9b700 1 -- 172.21.15.59:0/2731989330 >> v1:172.21.15.59:6789/0 conn(0x7fe08406ff90 legacy=0x7fe084137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.950+0000 7fe081d9b700 1 -- 172.21.15.59:0/2731989330 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0840722b0 con 0x7fe08406f660 2023-09-30T22:29:56.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.950+0000 7fe08259c700 1 --2- 172.21.15.59:0/2731989330 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0841305f0 0x7fe0841309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:56.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.950+0000 7fe081d9b700 1 --2- 172.21.15.59:0/2731989330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe08406f660 0x7fe08406fa50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe078009870 tx=0x7fe078009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ebc3ff01723a2bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:56.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.950+0000 7fe08159a700 1 -- 172.21.15.59:0/2731989330 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07800f8a0 con 0x7fe08406f660 2023-09-30T22:29:56.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.950+0000 7fe08159a700 1 -- 172.21.15.59:0/2731989330 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07800fa00 con 0x7fe08406f660 2023-09-30T22:29:56.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.950+0000 7fe08159a700 1 -- 172.21.15.59:0/2731989330 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07800fd90 con 0x7fe08406f660 2023-09-30T22:29:56.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.951+0000 7fe088c12700 1 -- 172.21.15.59:0/2731989330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe08406f660 msgr2=0x7fe08406fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.951+0000 7fe088c12700 1 --2- 172.21.15.59:0/2731989330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe08406f660 0x7fe08406fa50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe078009870 tx=0x7fe078009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:56.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.951+0000 7fe088c12700 1 -- 172.21.15.59:0/2731989330 shutdown_connections 2023-09-30T22:29:56.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.951+0000 7fe088c12700 1 --2- 172.21.15.59:0/2731989330 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0841305f0 0x7fe0841309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.951+0000 7fe088c12700 1 --2- 172.21.15.59:0/2731989330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe08406f660 0x7fe08406fa50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.951+0000 7fe088c12700 1 -- 172.21.15.59:0/2731989330 >> 172.21.15.59:0/2731989330 conn(0x7fe0840a2aa0 msgr2=0x7fe0840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:56.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.951+0000 7fe088c12700 1 -- 172.21.15.59:0/2731989330 shutdown_connections 2023-09-30T22:29:56.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.951+0000 7fe088c12700 1 -- 172.21.15.59:0/2731989330 wait complete. 2023-09-30T22:29:56.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.953+0000 7fe088c12700 1 Processor -- start 2023-09-30T22:29:56.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.953+0000 7fe088c12700 1 -- start start 2023-09-30T22:29:56.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe088c12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe08406f660 0x7fe08411fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe088c12700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe08406ff90 0x7fe0841203a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe088c12700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0841305f0 0x7fe0841208e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe088c12700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe084121ff0 con 0x7fe08406ff90 2023-09-30T22:29:56.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe088c12700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe084124520 con 0x7fe0841305f0 2023-09-30T22:29:56.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe088c12700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe084121ad0 con 0x7fe08406f660 2023-09-30T22:29:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe082d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0841305f0 0x7fe0841208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe081d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe08406ff90 0x7fe0841203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe08259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe08406f660 0x7fe08411fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe082d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0841305f0 0x7fe0841208e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50226/0 (socket says 172.21.15.59:50226) 2023-09-30T22:29:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe082d9d700 1 -- 172.21.15.59:0/1419974155 learned_addr learned my addr 172.21.15.59:0/1419974155 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe081d9b700 1 -- 172.21.15.59:0/1419974155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe08406f660 msgr2=0x7fe08411fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe081d9b700 1 --2- 172.21.15.59:0/1419974155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe08406f660 0x7fe08411fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe081d9b700 1 -- 172.21.15.59:0/1419974155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0841305f0 msgr2=0x7fe0841208e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe081d9b700 1 --2- 172.21.15.59:0/1419974155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0841305f0 0x7fe0841208e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.954+0000 7fe081d9b700 1 -- 172.21.15.59:0/1419974155 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe074009550 con 0x7fe08406ff90 2023-09-30T22:29:56.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.955+0000 7fe081d9b700 1 --2- 172.21.15.59:0/1419974155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe08406ff90 0x7fe0841203a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe078018000 tx=0x7fe078004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:56.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.955+0000 7fe072ffd700 1 -- 172.21.15.59:0/1419974155 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0780038a0 con 0x7fe08406ff90 2023-09-30T22:29:56.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.955+0000 7fe072ffd700 1 -- 172.21.15.59:0/1419974155 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe078003a00 con 0x7fe08406ff90 2023-09-30T22:29:56.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.955+0000 7fe088c12700 1 -- 172.21.15.59:0/1419974155 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0780094a0 con 0x7fe08406ff90 2023-09-30T22:29:56.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.955+0000 7fe072ffd700 1 -- 172.21.15.59:0/1419974155 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078003d90 con 0x7fe08406ff90 2023-09-30T22:29:56.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.955+0000 7fe088c12700 1 -- 172.21.15.59:0/1419974155 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe084122220 con 0x7fe08406ff90 2023-09-30T22:29:56.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.956+0000 7fe072ffd700 1 -- 172.21.15.59:0/1419974155 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe078019400 con 0x7fe08406ff90 2023-09-30T22:29:56.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.956+0000 7fe08259c700 1 -- 172.21.15.59:0/1419974155 >> v1:172.21.15.59:6816/126772 conn(0x7fe06402f510 legacy=0x7fe0640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:56.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.956+0000 7fe072ffd700 1 -- 172.21.15.59:0/1419974155 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe0780406c0 con 0x7fe08406ff90 2023-09-30T22:29:56.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.956+0000 7fe088c12700 1 -- 172.21.15.59:0/1419974155 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe084121c10 con 0x7fe08406ff90 2023-09-30T22:29:56.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.961+0000 7fe072ffd700 1 -- 172.21.15.59:0/1419974155 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe084121c10 con 0x7fe08406ff90 2023-09-30T22:29:56.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.991+0000 7f2a25e99700 1 Processor -- start 2023-09-30T22:29:56.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.991+0000 7f2a25e99700 1 -- start start 2023-09-30T22:29:56.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.992+0000 7f2a25e99700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2009d6f0 0x7f2a2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.992+0000 7f2a25e99700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2a2009e000 0x7f2a201339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.992+0000 7f2a25e99700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a20133f30 0x7f2a201343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.992+0000 7f2a25e99700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2009b0f0 con 0x7f2a2009e000 2023-09-30T22:29:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.992+0000 7f2a25e99700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2009d2f0 con 0x7f2a2009d6f0 2023-09-30T22:29:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.992+0000 7f2a25e99700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2009a810 con 0x7f2a20133f30 2023-09-30T22:29:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.992+0000 7f2a1f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2009d6f0 0x7f2a2009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.992+0000 7f2a1ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a20133f30 0x7f2a201343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.992+0000 7f2a1ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a20133f30 0x7f2a201343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59432/0 (socket says 172.21.15.59:59432) 2023-09-30T22:29:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.992+0000 7f2a1ffff700 1 -- 172.21.15.59:0/1833343969 learned_addr learned my addr 172.21.15.59:0/1833343969 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.992+0000 7f2a1f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2009d6f0 0x7f2a2009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50240/0 (socket says 172.21.15.59:50240) 2023-09-30T22:29:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.992+0000 7f2a1effd700 1 --2- 172.21.15.59:0/1833343969 >> v2:172.21.15.59:3300/0 conn(0x7f2a2009e000 0x7f2a201339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.992+0000 7f2a1f7fe700 1 -- 172.21.15.59:0/1833343969 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a20133f30 msgr2=0x7f2a201343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.992+0000 7f2a1f7fe700 1 --2- 172.21.15.59:0/1833343969 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a20133f30 0x7f2a201343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.993+0000 7f2a1f7fe700 1 -- 172.21.15.59:0/1833343969 >> v2:172.21.15.59:3300/0 conn(0x7f2a2009e000 msgr2=0x7f2a201339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.993+0000 7f2a1f7fe700 1 --2- 172.21.15.59:0/1833343969 >> v2:172.21.15.59:3300/0 conn(0x7f2a2009e000 0x7f2a201339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.993+0000 7f2a1f7fe700 1 -- 172.21.15.59:0/1833343969 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2009a470 con 0x7f2a2009d6f0 2023-09-30T22:29:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.993+0000 7f2a1f7fe700 1 --2- 172.21.15.59:0/1833343969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2009d6f0 0x7f2a2009dac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2a10009840 tx=0x7f2a10009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9124560e8c8cac1d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:56.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.993+0000 7f2a1e7fc700 1 -- 172.21.15.59:0/1833343969 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10011830 con 0x7f2a2009d6f0 2023-09-30T22:29:56.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.993+0000 7f2a1e7fc700 1 -- 172.21.15.59:0/1833343969 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a10011990 con 0x7f2a2009d6f0 2023-09-30T22:29:56.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.993+0000 7f2a1e7fc700 1 -- 172.21.15.59:0/1833343969 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10011d20 con 0x7f2a2009d6f0 2023-09-30T22:29:56.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.994+0000 7f2a25e99700 1 -- 172.21.15.59:0/1833343969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2009d6f0 msgr2=0x7f2a2009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.994+0000 7f2a25e99700 1 --2- 172.21.15.59:0/1833343969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2009d6f0 0x7f2a2009dac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2a10009840 tx=0x7f2a10009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:56.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.994+0000 7f2a25e99700 1 -- 172.21.15.59:0/1833343969 shutdown_connections 2023-09-30T22:29:56.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.994+0000 7f2a25e99700 1 --2- 172.21.15.59:0/1833343969 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a20133f30 0x7f2a201343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.994+0000 7f2a25e99700 1 --2- 172.21.15.59:0/1833343969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2009d6f0 0x7f2a2009dac0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.994+0000 7f2a25e99700 1 --2- 172.21.15.59:0/1833343969 >> v2:172.21.15.59:3300/0 conn(0x7f2a2009e000 0x7f2a201339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.994+0000 7f2a25e99700 1 -- 172.21.15.59:0/1833343969 >> 172.21.15.59:0/1833343969 conn(0x7f2a20066f50 msgr2=0x7f2a2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:56.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.994+0000 7f2a25e99700 1 -- 172.21.15.59:0/1833343969 shutdown_connections 2023-09-30T22:29:56.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.994+0000 7f2a25e99700 1 -- 172.21.15.59:0/1833343969 wait complete. 2023-09-30T22:29:56.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.995+0000 7f2a25e99700 1 Processor -- start 2023-09-30T22:29:56.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.996+0000 7f2a25e99700 1 -- start start 2023-09-30T22:29:56.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.996+0000 7f2a25e99700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2009d6f0 0x7f2a201c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.996+0000 7f2a25e99700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2009e000 0x7f2a201c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.996+0000 7f2a25e99700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a20133f30 0x7f2a201c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.996+0000 7f2a25e99700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2009c640 con 0x7f2a2009e000 2023-09-30T22:29:56.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.996+0000 7f2a25e99700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a20120820 con 0x7f2a2009d6f0 2023-09-30T22:29:56.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.996+0000 7f2a25e99700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a201335d0 con 0x7f2a20133f30 2023-09-30T22:29:56.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.996+0000 7f2a1effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2009e000 0x7f2a201c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.996+0000 7f2a1effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2009e000 0x7f2a201c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51708/0 (socket says 172.21.15.59:51708) 2023-09-30T22:29:56.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.996+0000 7f2a1effd700 1 -- 172.21.15.59:0/2268786801 learned_addr learned my addr 172.21.15.59:0/2268786801 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:57.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.997+0000 7f2a1f7fe700 1 --2- 172.21.15.59:0/2268786801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2009d6f0 0x7f2a201c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:57.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.997+0000 7f2a1ffff700 1 --2- 172.21.15.59:0/2268786801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a20133f30 0x7f2a201c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:57.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.997+0000 7f2a1effd700 1 -- 172.21.15.59:0/2268786801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a20133f30 msgr2=0x7f2a201c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:57.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.997+0000 7f2a1effd700 1 --2- 172.21.15.59:0/2268786801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a20133f30 0x7f2a201c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.997+0000 7f2a1effd700 1 -- 172.21.15.59:0/2268786801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2009d6f0 msgr2=0x7f2a201c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:57.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.997+0000 7f2a1effd700 1 --2- 172.21.15.59:0/2268786801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2009d6f0 0x7f2a201c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.997+0000 7f2a1effd700 1 -- 172.21.15.59:0/2268786801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a100094a0 con 0x7f2a2009e000 2023-09-30T22:29:57.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.997+0000 7f2a1effd700 1 --2- 172.21.15.59:0/2268786801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2009e000 0x7f2a201c8530 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400e980 tx=0x7f2a1400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:57.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.997+0000 7f2a07fff700 1 -- 172.21.15.59:0/2268786801 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14009710 con 0x7f2a2009e000 2023-09-30T22:29:57.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.997+0000 7f2a07fff700 1 -- 172.21.15.59:0/2268786801 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1400eed0 con 0x7f2a2009e000 2023-09-30T22:29:57.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.997+0000 7f2a07fff700 1 -- 172.21.15.59:0/2268786801 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1400ca70 con 0x7f2a2009e000 2023-09-30T22:29:57.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.997+0000 7f2a25e99700 1 -- 172.21.15.59:0/2268786801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a20122010 con 0x7f2a2009e000 2023-09-30T22:29:57.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.997+0000 7f2a25e99700 1 -- 172.21.15.59:0/2268786801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a20122380 con 0x7f2a2009e000 2023-09-30T22:29:57.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.998+0000 7f2a25e99700 1 -- 172.21.15.59:0/2268786801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a20074ea0 con 0x7f2a2009e000 2023-09-30T22:29:57.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.998+0000 7f2a07fff700 1 -- 172.21.15.59:0/2268786801 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2a1400cbd0 con 0x7f2a2009e000 2023-09-30T22:29:57.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.999+0000 7f2a07fff700 1 -- 172.21.15.59:0/2268786801 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f2a1403fcc0 con 0x7f2a2009e000 2023-09-30T22:29:57.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:56.999+0000 7f2a1f7fe700 1 -- 172.21.15.59:0/2268786801 >> v1:172.21.15.59:6816/126772 conn(0x7f2a0c02f510 legacy=0x7f2a0c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:57.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.004+0000 7f316c239700 1 Processor -- start 2023-09-30T22:29:57.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.005+0000 7f316c239700 1 -- start start 2023-09-30T22:29:57.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.005+0000 7f316c239700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316406f5d0 0x7f316412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:57.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.005+0000 7f316c239700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3164135c20 0x7f3164138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:57.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.005+0000 7f316c239700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316406fa40 con 0x7f316412cf60 2023-09-30T22:29:57.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.005+0000 7f316c239700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316412cd90 con 0x7f3164135c20 2023-09-30T22:29:57.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.005+0000 7f316c239700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3164071780 con 0x7f316406f5d0 2023-09-30T22:29:57.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.006+0000 7f31697d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316406f5d0 0x7f316412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:57.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.006+0000 7f31697d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316406f5d0 0x7f316412ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50262/0 (socket says 172.21.15.59:50262) 2023-09-30T22:29:57.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.006+0000 7f31697d4700 1 -- 172.21.15.59:0/470998782 learned_addr learned my addr 172.21.15.59:0/470998782 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:57.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.006+0000 7f316a7d6700 1 --2- 172.21.15.59:0/470998782 >> v2:172.21.15.59:3300/0 conn(0x7f3164135c20 0x7f3164138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:57.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.006+0000 7f316a7d6700 1 -- 172.21.15.59:0/470998782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316406f5d0 msgr2=0x7f316412ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:57.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.006+0000 7f316a7d6700 1 --2- 172.21.15.59:0/470998782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316406f5d0 0x7f316412ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.006+0000 7f316a7d6700 1 -- 172.21.15.59:0/470998782 >> v1:172.21.15.59:6789/0 conn(0x7f316412cf60 legacy=0x7f316412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:57.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.006+0000 7f316a7d6700 1 -- 172.21.15.59:0/470998782 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3164071a40 con 0x7f3164135c20 2023-09-30T22:29:57.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.006+0000 7f31697d4700 1 --2- 172.21.15.59:0/470998782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316406f5d0 0x7f316412ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:57.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.006+0000 7f316a7d6700 1 --2- 172.21.15.59:0/470998782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3164135c20 0x7f3164138000 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f315c009dc0 tx=0x7f315c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d455d90fcee758eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:57.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.008+0000 7f3168fd3700 1 -- 172.21.15.59:0/470998782 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c00e070 con 0x7f3164135c20 2023-09-30T22:29:57.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.008+0000 7f3168fd3700 1 -- 172.21.15.59:0/470998782 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c00bae0 con 0x7f3164135c20 2023-09-30T22:29:57.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.008+0000 7f3168fd3700 1 -- 172.21.15.59:0/470998782 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c00be90 con 0x7f3164135c20 2023-09-30T22:29:57.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.008+0000 7f2a07fff700 1 -- 172.21.15.59:0/2268786801 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a1401bdf0 con 0x7f2a2009e000 2023-09-30T22:29:57.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.009+0000 7f316c239700 1 -- 172.21.15.59:0/470998782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3164135c20 msgr2=0x7f3164138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:57.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.009+0000 7f316c239700 1 --2- 172.21.15.59:0/470998782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3164135c20 0x7f3164138000 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f315c009dc0 tx=0x7f315c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:57.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.009+0000 7f316c239700 1 -- 172.21.15.59:0/470998782 shutdown_connections 2023-09-30T22:29:57.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.009+0000 7f316c239700 1 --2- 172.21.15.59:0/470998782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3164135c20 0x7f3164138000 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.009+0000 7f316c239700 1 --2- 172.21.15.59:0/470998782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316406f5d0 0x7f316412ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.009+0000 7f316c239700 1 -- 172.21.15.59:0/470998782 >> 172.21.15.59:0/470998782 conn(0x7f31640a2aa0 msgr2=0x7f31640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:57.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.009+0000 7f316c239700 1 -- 172.21.15.59:0/470998782 shutdown_connections 2023-09-30T22:29:57.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.009+0000 7f316c239700 1 -- 172.21.15.59:0/470998782 wait complete. 2023-09-30T22:29:57.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.010+0000 7f316c239700 1 Processor -- start 2023-09-30T22:29:57.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.011+0000 7f316c239700 1 -- start start 2023-09-30T22:29:57.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.011+0000 7f316c239700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316406f5d0 0x7f3164130920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:57.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.011+0000 7f316c239700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f316412cf60 0x7f3164130e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:57.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.011+0000 7f316c239700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3164135c20 0x7f31641313a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:57.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.011+0000 7f316c239700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316412ba00 con 0x7f316412cf60 2023-09-30T22:29:57.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.011+0000 7f316c239700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3164135010 con 0x7f3164135c20 2023-09-30T22:29:57.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.011+0000 7f316c239700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31641340b0 con 0x7f316406f5d0 2023-09-30T22:29:57.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.011+0000 7f31697d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f316412cf60 0x7f3164130e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:57.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.011+0000 7f3169fd5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316406f5d0 0x7f3164130920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:57.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.011+0000 7f31697d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f316412cf60 0x7f3164130e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51730/0 (socket says 172.21.15.59:51730) 2023-09-30T22:29:57.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.012+0000 7f31697d4700 1 -- 172.21.15.59:0/1344604618 learned_addr learned my addr 172.21.15.59:0/1344604618 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:57.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.012+0000 7f316a7d6700 1 --2- 172.21.15.59:0/1344604618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3164135c20 0x7f31641313a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:57.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.012+0000 7f31697d4700 1 -- 172.21.15.59:0/1344604618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316406f5d0 msgr2=0x7f3164130920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:57.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.012+0000 7f31697d4700 1 --2- 172.21.15.59:0/1344604618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316406f5d0 0x7f3164130920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.012+0000 7f31697d4700 1 -- 172.21.15.59:0/1344604618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3164135c20 msgr2=0x7f31641313a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:57.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.012+0000 7f31697d4700 1 --2- 172.21.15.59:0/1344604618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3164135c20 0x7f31641313a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.012+0000 7f31697d4700 1 -- 172.21.15.59:0/1344604618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3154009550 con 0x7f316412cf60 2023-09-30T22:29:57.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.012+0000 7f31697d4700 1 --2- 172.21.15.59:0/1344604618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f316412cf60 0x7f3164130e60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f315400ebe0 tx=0x7f315400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:57.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.012+0000 7f315a7fc700 1 -- 172.21.15.59:0/1344604618 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315400c850 con 0x7f316412cf60 2023-09-30T22:29:57.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.012+0000 7f315a7fc700 1 -- 172.21.15.59:0/1344604618 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315400c9b0 con 0x7f316412cf60 2023-09-30T22:29:57.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.012+0000 7f316c239700 1 -- 172.21.15.59:0/1344604618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c009a70 con 0x7f316412cf60 2023-09-30T22:29:57.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.012+0000 7f315a7fc700 1 -- 172.21.15.59:0/1344604618 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315400cd20 con 0x7f316412cf60 2023-09-30T22:29:57.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.013+0000 7f316c239700 1 -- 172.21.15.59:0/1344604618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3164132d50 con 0x7f316412cf60 2023-09-30T22:29:57.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.013+0000 7f315a7fc700 1 -- 172.21.15.59:0/1344604618 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3154013470 con 0x7f316412cf60 2023-09-30T22:29:57.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.014+0000 7f315a7fc700 1 -- 172.21.15.59:0/1344604618 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f3154040100 con 0x7f316412cf60 2023-09-30T22:29:57.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.014+0000 7f3169fd5700 1 -- 172.21.15.59:0/1344604618 >> v1:172.21.15.59:6816/126772 conn(0x7f314802f510 legacy=0x7f31480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:57.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.014+0000 7f316c239700 1 -- 172.21.15.59:0/1344604618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3164133d30 con 0x7f316412cf60 2023-09-30T22:29:57.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.023+0000 7f315a7fc700 1 -- 172.21.15.59:0/1344604618 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f315401b3b0 con 0x7f316412cf60 2023-09-30T22:29:57.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.066+0000 7f0aea10d700 1 -- 172.21.15.59:0/3958207465 >> v1:172.21.15.59:6816/126772 conn(0x7f0ac802f510 legacy=0x7f0ac80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:57.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.114+0000 7f0aec371700 1 -- 172.21.15.59:0/3958207465 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0ae40a2570 con 0x7f0ae409e000 2023-09-30T22:29:57.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.115+0000 7f0adaffd700 1 -- 172.21.15.59:0/3958207465 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ad4015030 con 0x7f0ae409e000 2023-09-30T22:29:57.116 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:57.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.117+0000 7f0aec371700 1 -- 172.21.15.59:0/3958207465 >> v1:172.21.15.59:6816/126772 conn(0x7f0ac802f510 legacy=0x7f0ac80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:57.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.117+0000 7f0aec371700 1 -- 172.21.15.59:0/3958207465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae409e000 msgr2=0x7f0ae41c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:57.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.117+0000 7f0aec371700 1 --2- 172.21.15.59:0/3958207465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae409e000 0x7f0ae41c8d00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400b530 tx=0x7f0ad400b840 comp rx=0 tx=0).stop 2023-09-30T22:29:57.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.117+0000 7f0aec371700 1 -- 172.21.15.59:0/3958207465 shutdown_connections 2023-09-30T22:29:57.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.117+0000 7f0aec371700 1 --2- 172.21.15.59:0/3958207465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ae409e410 0x7f0ae41c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.117+0000 7f0aec371700 1 --2- 172.21.15.59:0/3958207465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ae409d6f0 0x7f0ae41c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.117+0000 7f0aec371700 1 --2- 172.21.15.59:0/3958207465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae409e000 0x7f0ae41c8d00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.117+0000 7f0aec371700 1 -- 172.21.15.59:0/3958207465 >> 172.21.15.59:0/3958207465 conn(0x7f0ae4066f50 msgr2=0x7f0ae406f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:57.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.117+0000 7f0aec371700 1 -- 172.21.15.59:0/3958207465 shutdown_connections 2023-09-30T22:29:57.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.117+0000 7f0aec371700 1 -- 172.21.15.59:0/3958207465 wait complete. 2023-09-30T22:29:57.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:57.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.157+0000 7fe08259c700 1 -- 172.21.15.59:0/1419974155 >> v1:172.21.15.59:6816/126772 conn(0x7fe06402f510 legacy=0x7fe0640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:57.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.184+0000 7fe088c12700 1 -- 172.21.15.59:0/1419974155 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe084121c10 con 0x7fe08406ff90 2023-09-30T22:29:57.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.184+0000 7fe072ffd700 1 -- 172.21.15.59:0/1419974155 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe084121c10 con 0x7fe08406ff90 2023-09-30T22:29:57.185 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:57.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.186+0000 7fe088c12700 1 -- 172.21.15.59:0/1419974155 >> v1:172.21.15.59:6816/126772 conn(0x7fe06402f510 legacy=0x7fe0640319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:57.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.186+0000 7fe088c12700 1 -- 172.21.15.59:0/1419974155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe08406ff90 msgr2=0x7fe0841203a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:57.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.186+0000 7fe088c12700 1 --2- 172.21.15.59:0/1419974155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe08406ff90 0x7fe0841203a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe078018000 tx=0x7fe078004750 comp rx=0 tx=0).stop 2023-09-30T22:29:57.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.186+0000 7fe088c12700 1 -- 172.21.15.59:0/1419974155 shutdown_connections 2023-09-30T22:29:57.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.186+0000 7fe088c12700 1 --2- 172.21.15.59:0/1419974155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe08406f660 0x7fe08411fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.186+0000 7fe088c12700 1 --2- 172.21.15.59:0/1419974155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0841305f0 0x7fe0841208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.186+0000 7fe088c12700 1 --2- 172.21.15.59:0/1419974155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe08406ff90 0x7fe0841203a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.186+0000 7fe088c12700 1 -- 172.21.15.59:0/1419974155 >> 172.21.15.59:0/1419974155 conn(0x7fe0840a2aa0 msgr2=0x7fe08406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:57.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.186+0000 7fe088c12700 1 -- 172.21.15.59:0/1419974155 shutdown_connections 2023-09-30T22:29:57.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.187+0000 7fe088c12700 1 -- 172.21.15.59:0/1419974155 wait complete. 2023-09-30T22:29:57.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.200+0000 7f2a1f7fe700 1 -- 172.21.15.59:0/2268786801 >> v1:172.21.15.59:6816/126772 conn(0x7f2a0c02f510 legacy=0x7f2a0c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:57.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:57.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.215+0000 7f3169fd5700 1 -- 172.21.15.59:0/1344604618 >> v1:172.21.15.59:6816/126772 conn(0x7f314802f510 legacy=0x7f31480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:57.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.221+0000 7f2a25e99700 1 -- 172.21.15.59:0/2268786801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2a201225e0 con 0x7f2a2009e000 2023-09-30T22:29:57.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.221+0000 7f2a07fff700 1 -- 172.21.15.59:0/2268786801 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a14017070 con 0x7f2a2009e000 2023-09-30T22:29:57.223 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:57.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.223+0000 7f2a25e99700 1 -- 172.21.15.59:0/2268786801 >> v1:172.21.15.59:6816/126772 conn(0x7f2a0c02f510 legacy=0x7f2a0c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:57.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.223+0000 7f2a25e99700 1 -- 172.21.15.59:0/2268786801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2009e000 msgr2=0x7f2a201c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:57.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.223+0000 7f2a25e99700 1 --2- 172.21.15.59:0/2268786801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2009e000 0x7f2a201c8530 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400e980 tx=0x7f2a1400ec90 comp rx=0 tx=0).stop 2023-09-30T22:29:57.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.224+0000 7f2a25e99700 1 -- 172.21.15.59:0/2268786801 shutdown_connections 2023-09-30T22:29:57.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.224+0000 7f2a25e99700 1 --2- 172.21.15.59:0/2268786801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a20133f30 0x7f2a201c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.224+0000 7f2a25e99700 1 --2- 172.21.15.59:0/2268786801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2009d6f0 0x7f2a201c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.224+0000 7f2a25e99700 1 --2- 172.21.15.59:0/2268786801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2009e000 0x7f2a201c8530 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.224+0000 7f2a25e99700 1 -- 172.21.15.59:0/2268786801 >> 172.21.15.59:0/2268786801 conn(0x7f2a20066f50 msgr2=0x7f2a201bbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:57.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.224+0000 7f2a25e99700 1 -- 172.21.15.59:0/2268786801 shutdown_connections 2023-09-30T22:29:57.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.224+0000 7f2a25e99700 1 -- 172.21.15.59:0/2268786801 wait complete. 2023-09-30T22:29:57.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:57.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.250+0000 7f316c239700 1 -- 172.21.15.59:0/1344604618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3164074ea0 con 0x7f316412cf60 2023-09-30T22:29:57.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.251+0000 7f315a7fc700 1 -- 172.21.15.59:0/1344604618 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f315401ab00 con 0x7f316412cf60 2023-09-30T22:29:57.252 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:57.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.253+0000 7f316c239700 1 -- 172.21.15.59:0/1344604618 >> v1:172.21.15.59:6816/126772 conn(0x7f314802f510 legacy=0x7f31480319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:57.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.253+0000 7f316c239700 1 -- 172.21.15.59:0/1344604618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f316412cf60 msgr2=0x7f3164130e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:57.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.253+0000 7f316c239700 1 --2- 172.21.15.59:0/1344604618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f316412cf60 0x7f3164130e60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f315400ebe0 tx=0x7f315400eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.253+0000 7f316c239700 1 -- 172.21.15.59:0/1344604618 shutdown_connections 2023-09-30T22:29:57.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.253+0000 7f316c239700 1 --2- 172.21.15.59:0/1344604618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316406f5d0 0x7f3164130920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.253+0000 7f316c239700 1 --2- 172.21.15.59:0/1344604618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3164135c20 0x7f31641313a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.253+0000 7f316c239700 1 --2- 172.21.15.59:0/1344604618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f316412cf60 0x7f3164130e60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.253+0000 7f316c239700 1 -- 172.21.15.59:0/1344604618 >> 172.21.15.59:0/1344604618 conn(0x7f31640a2aa0 msgr2=0x7f31640a19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:57.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.253+0000 7f316c239700 1 -- 172.21.15.59:0/1344604618 shutdown_connections 2023-09-30T22:29:57.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:57.253+0000 7f316c239700 1 -- 172.21.15.59:0/1344604618 wait complete. 2023-09-30T22:29:57.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:58.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:58.204 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:58.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:58.268 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:58.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.282+0000 7f1e559bd700 1 Processor -- start 2023-09-30T22:29:58.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.282+0000 7f1e559bd700 1 -- start start 2023-09-30T22:29:58.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.282+0000 7f1e559bd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e500a0a30 0x7f1e500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.282+0000 7f1e559bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009d630 0x7f1e500a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.282+0000 7f1e559bd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e50133930 0x7f1e50133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.282+0000 7f1e559bd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e500a2a70 con 0x7f1e50133930 2023-09-30T22:29:58.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.282+0000 7f1e559bd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500a01d0 con 0x7f1e5009d630 2023-09-30T22:29:58.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.282+0000 7f1e559bd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5009e2b0 con 0x7f1e500a0a30 2023-09-30T22:29:58.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.282+0000 7f1e4e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009d630 0x7f1e500a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.283+0000 7f1e4e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009d630 0x7f1e500a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50282/0 (socket says 172.21.15.59:50282) 2023-09-30T22:29:58.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.283+0000 7f1e4e7fc700 1 -- 172.21.15.59:0/3683331553 learned_addr learned my addr 172.21.15.59:0/3683331553 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:58.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.283+0000 7f1e4f7fe700 1 --2- 172.21.15.59:0/3683331553 >> v2:172.21.15.59:3300/0 conn(0x7f1e50133930 0x7f1e50133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.283+0000 7f1e4effd700 1 --2- 172.21.15.59:0/3683331553 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e500a0a30 0x7f1e500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.283+0000 7f1e4e7fc700 1 -- 172.21.15.59:0/3683331553 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e500a0a30 msgr2=0x7f1e500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.283+0000 7f1e4e7fc700 1 --2- 172.21.15.59:0/3683331553 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e500a0a30 0x7f1e500a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.283+0000 7f1e4e7fc700 1 -- 172.21.15.59:0/3683331553 >> v2:172.21.15.59:3300/0 conn(0x7f1e50133930 msgr2=0x7f1e50133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.283+0000 7f1e4e7fc700 1 --2- 172.21.15.59:0/3683331553 >> v2:172.21.15.59:3300/0 conn(0x7f1e50133930 0x7f1e50133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.283+0000 7f1e4e7fc700 1 -- 172.21.15.59:0/3683331553 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5009dc50 con 0x7f1e5009d630 2023-09-30T22:29:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.283+0000 7f1e4e7fc700 1 --2- 172.21.15.59:0/3683331553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009d630 0x7f1e500a1340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e440098f0 tx=0x7f1e44009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35f50d5f7eae76c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.283+0000 7f1e4dffb700 1 -- 172.21.15.59:0/3683331553 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e44011830 con 0x7f1e5009d630 2023-09-30T22:29:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.283+0000 7f1e4dffb700 1 -- 172.21.15.59:0/3683331553 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e44011990 con 0x7f1e5009d630 2023-09-30T22:29:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.283+0000 7f1e4dffb700 1 -- 172.21.15.59:0/3683331553 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e44011d20 con 0x7f1e5009d630 2023-09-30T22:29:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.284+0000 7f1e559bd700 1 -- 172.21.15.59:0/3683331553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009d630 msgr2=0x7f1e500a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.284+0000 7f1e559bd700 1 --2- 172.21.15.59:0/3683331553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009d630 0x7f1e500a1340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e440098f0 tx=0x7f1e44009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:58.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.284+0000 7f1e559bd700 1 -- 172.21.15.59:0/3683331553 shutdown_connections 2023-09-30T22:29:58.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.284+0000 7f1e559bd700 1 --2- 172.21.15.59:0/3683331553 >> v2:172.21.15.59:3300/0 conn(0x7f1e50133930 0x7f1e50133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.284+0000 7f1e559bd700 1 --2- 172.21.15.59:0/3683331553 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e500a0a30 0x7f1e500a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.284+0000 7f1e559bd700 1 --2- 172.21.15.59:0/3683331553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009d630 0x7f1e500a1340 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.284+0000 7f1e559bd700 1 -- 172.21.15.59:0/3683331553 >> 172.21.15.59:0/3683331553 conn(0x7f1e500a3050 msgr2=0x7f1e500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.284+0000 7f1e559bd700 1 -- 172.21.15.59:0/3683331553 shutdown_connections 2023-09-30T22:29:58.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.284+0000 7f1e559bd700 1 -- 172.21.15.59:0/3683331553 wait complete. 2023-09-30T22:29:58.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.285+0000 7f1e559bd700 1 Processor -- start 2023-09-30T22:29:58.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.286+0000 7f1e559bd700 1 -- start start 2023-09-30T22:29:58.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.286+0000 7f1e559bd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5009d630 0x7f1e501c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.286+0000 7f1e559bd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e500a0a30 0x7f1e501c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.286+0000 7f1e559bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e50133930 0x7f1e5011e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.286+0000 7f1e559bd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e50133200 con 0x7f1e5009d630 2023-09-30T22:29:58.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.286+0000 7f1e559bd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e50121e60 con 0x7f1e50133930 2023-09-30T22:29:58.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.286+0000 7f1e559bd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e501bcf70 con 0x7f1e500a0a30 2023-09-30T22:29:58.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.286+0000 7f1e4f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e50133930 0x7f1e5011e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.286+0000 7f1e4f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e50133930 0x7f1e5011e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50286/0 (socket says 172.21.15.59:50286) 2023-09-30T22:29:58.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.286+0000 7f1e4f7fe700 1 -- 172.21.15.59:0/1789446196 learned_addr learned my addr 172.21.15.59:0/1789446196 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.286+0000 7f1e4effd700 1 --2- 172.21.15.59:0/1789446196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5009d630 0x7f1e501c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.286+0000 7f1e4e7fc700 1 --2- 172.21.15.59:0/1789446196 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e500a0a30 0x7f1e501c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.287+0000 7f1e4f7fe700 1 -- 172.21.15.59:0/1789446196 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e500a0a30 msgr2=0x7f1e501c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.287+0000 7f1e4f7fe700 1 --2- 172.21.15.59:0/1789446196 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e500a0a30 0x7f1e501c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.287+0000 7f1e4f7fe700 1 -- 172.21.15.59:0/1789446196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5009d630 msgr2=0x7f1e501c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.287+0000 7f1e4f7fe700 1 --2- 172.21.15.59:0/1789446196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5009d630 0x7f1e501c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.287+0000 7f1e4f7fe700 1 -- 172.21.15.59:0/1789446196 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e44009550 con 0x7f1e50133930 2023-09-30T22:29:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.287+0000 7f1e4effd700 1 --2- 172.21.15.59:0/1789446196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5009d630 0x7f1e501c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.287+0000 7f1e4f7fe700 1 --2- 172.21.15.59:0/1789446196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e50133930 0x7f1e5011e8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009dd0 tx=0x7f1e4800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.287+0000 7f1e37fff700 1 -- 172.21.15.59:0/1789446196 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e48009c40 con 0x7f1e50133930 2023-09-30T22:29:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.287+0000 7f1e37fff700 1 -- 172.21.15.59:0/1789446196 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4800f040 con 0x7f1e50133930 2023-09-30T22:29:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.287+0000 7f1e559bd700 1 -- 172.21.15.59:0/1789446196 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e501c8f60 con 0x7f1e50133930 2023-09-30T22:29:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.287+0000 7f1e37fff700 1 -- 172.21.15.59:0/1789446196 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4800ceb0 con 0x7f1e50133930 2023-09-30T22:29:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.287+0000 7f1e559bd700 1 -- 172.21.15.59:0/1789446196 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e50120460 con 0x7f1e50133930 2023-09-30T22:29:58.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.288+0000 7f1e37fff700 1 -- 172.21.15.59:0/1789446196 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1e48014480 con 0x7f1e50133930 2023-09-30T22:29:58.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.289+0000 7f1e559bd700 1 -- 172.21.15.59:0/1789446196 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e500747f0 con 0x7f1e50133930 2023-09-30T22:29:58.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.289+0000 7f1e4effd700 1 -- 172.21.15.59:0/1789446196 >> v1:172.21.15.59:6816/126772 conn(0x7f1e3c02f510 legacy=0x7f1e3c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:58.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.289+0000 7f1e37fff700 1 -- 172.21.15.59:0/1789446196 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1e480404c0 con 0x7f1e50133930 2023-09-30T22:29:58.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.298+0000 7f1e37fff700 1 -- 172.21.15.59:0/1789446196 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e480133e0 con 0x7f1e50133930 2023-09-30T22:29:58.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.353+0000 7f08d0390700 1 Processor -- start 2023-09-30T22:29:58.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.353+0000 7f08d0390700 1 -- start start 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.354+0000 7f08d0390700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c80a0a30 0x7f08c80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.354+0000 7f08d0390700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08c809d630 0x7f08c80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.354+0000 7f08d0390700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c80a2a70 con 0x7f08c8133930 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.354+0000 7f08d0390700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c80a01d0 con 0x7f08c809d630 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.354+0000 7f08d0390700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08c809e2b0 con 0x7f08c80a0a30 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.354+0000 7f08ce92d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f08c8133930 0x7f08c8133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54522/0 (socket says 172.21.15.59:54522) 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.354+0000 7f08ce92d700 1 -- 172.21.15.59:0/3002769292 learned_addr learned my addr 172.21.15.59:0/3002769292 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.354+0000 7f08cd12a700 1 -- 172.21.15.59:0/3002769292 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022938562 0 0) 0x7f08c80a2a70 con 0x7f08c8133930 2023-09-30T22:29:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.354+0000 7f08cd12a700 1 -- 172.21.15.59:0/3002769292 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08b40035b0 con 0x7f08c8133930 2023-09-30T22:29:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.354+0000 7f08cd92b700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08c809d630 0x7f08c80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.354+0000 7f08ce12c700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c80a0a30 0x7f08c80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd12a700 1 -- 172.21.15.59:0/3002769292 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 871491767 0 0) 0x7f08b40035b0 con 0x7f08c8133930 2023-09-30T22:29:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd12a700 1 -- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c80a0a30 msgr2=0x7f08c80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd12a700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c80a0a30 0x7f08c80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd12a700 1 -- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08c809d630 msgr2=0x7f08c80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd12a700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08c809d630 0x7f08c80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd12a700 1 -- 172.21.15.59:0/3002769292 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c809dc50 con 0x7f08c8133930 2023-09-30T22:29:58.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd12a700 1 -- 172.21.15.59:0/3002769292 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1997034051 0 0) 0x7f08c00019f0 con 0x7f08c8133930 2023-09-30T22:29:58.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd92b700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08c809d630 0x7f08c80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:58.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd12a700 1 -- 172.21.15.59:0/3002769292 >> v1:172.21.15.59:6789/0 conn(0x7f08c8133930 legacy=0x7f08c8133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd12a700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c80a0a30 0x7f08b4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd12a700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08b4003f80 0x7f08b4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd12a700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08c809d630 0x7f08b4004d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd12a700 1 -- 172.21.15.59:0/3002769292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c80a01d0 con 0x7f08b4003f80 2023-09-30T22:29:58.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd12a700 1 -- 172.21.15.59:0/3002769292 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c809e2b0 con 0x7f08c809d630 2023-09-30T22:29:58.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd12a700 1 -- 172.21.15.59:0/3002769292 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08b40052d0 con 0x7f08c80a0a30 2023-09-30T22:29:58.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08ce12c700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c80a0a30 0x7f08b4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08cd92b700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08b4003f80 0x7f08b4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.355+0000 7f08ce92d700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08c809d630 0x7f08b4004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.356+0000 7f08cd92b700 1 -- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c80a0a30 msgr2=0x7f08b4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.356+0000 7f08cd92b700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c80a0a30 0x7f08b4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.356+0000 7f08cd92b700 1 -- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08c809d630 msgr2=0x7f08b4004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.356+0000 7f08cd92b700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08c809d630 0x7f08b4004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.356+0000 7f08cd92b700 1 -- 172.21.15.59:0/3002769292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80094a0 con 0x7f08b4003f80 2023-09-30T22:29:58.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.356+0000 7f08cd92b700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08b4003f80 0x7f08b4004850 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009d00 tx=0x7f08b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80b260547b04601 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.356+0000 7f08cd12a700 1 -- 172.21.15.59:0/3002769292 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8009e50 con 0x7f08b4003f80 2023-09-30T22:29:58.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.356+0000 7f08cd12a700 1 -- 172.21.15.59:0/3002769292 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b800e9a0 con 0x7f08b4003f80 2023-09-30T22:29:58.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.356+0000 7f08cd12a700 1 -- 172.21.15.59:0/3002769292 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b800ed50 con 0x7f08b4003f80 2023-09-30T22:29:58.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.357+0000 7f08d0390700 1 -- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08b4003f80 msgr2=0x7f08b4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.357+0000 7f08d0390700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08b4003f80 0x7f08b4004850 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009d00 tx=0x7f08b4005880 comp rx=0 tx=0).stop 2023-09-30T22:29:58.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.357+0000 7f08d0390700 1 -- 172.21.15.59:0/3002769292 shutdown_connections 2023-09-30T22:29:58.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.357+0000 7f08d0390700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c80a0a30 0x7f08b4003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.357+0000 7f08d0390700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08c809d630 0x7f08b4004d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.357+0000 7f08d0390700 1 --2- 172.21.15.59:0/3002769292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08b4003f80 0x7f08b4004850 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.357+0000 7f08d0390700 1 -- 172.21.15.59:0/3002769292 >> 172.21.15.59:0/3002769292 conn(0x7f08c80a3050 msgr2=0x7f08c80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.357+0000 7f08d0390700 1 -- 172.21.15.59:0/3002769292 shutdown_connections 2023-09-30T22:29:58.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.357+0000 7f08d0390700 1 -- 172.21.15.59:0/3002769292 wait complete. 2023-09-30T22:29:58.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.358+0000 7f08d0390700 1 Processor -- start 2023-09-30T22:29:58.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.358+0000 7f08d0390700 1 -- start start 2023-09-30T22:29:58.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.358+0000 7f08d0390700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08b4003f80 0x7f08c811f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.358+0000 7f08d0390700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c809d630 0x7f08c811f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.358+0000 7f08d0390700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08c80a0a30 0x7f08c81c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.358+0000 7f08d0390700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c811f000 con 0x7f08c80a0a30 2023-09-30T22:29:58.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.358+0000 7f08d0390700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c81334b0 con 0x7f08b4003f80 2023-09-30T22:29:58.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.358+0000 7f08d0390700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08c8122360 con 0x7f08c809d630 2023-09-30T22:29:58.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.359+0000 7f08cd92b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c809d630 0x7f08c811f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.359+0000 7f08cd92b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c809d630 0x7f08c811f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59498/0 (socket says 172.21.15.59:59498) 2023-09-30T22:29:58.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.359+0000 7f08cd92b700 1 -- 172.21.15.59:0/4062455883 learned_addr learned my addr 172.21.15.59:0/4062455883 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:58.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.359+0000 7f08ce92d700 1 --2- 172.21.15.59:0/4062455883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08c80a0a30 0x7f08c81c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.359+0000 7f08cd92b700 1 -- 172.21.15.59:0/4062455883 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08b4003f80 msgr2=0x7f08c811f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.359+0000 7f08cd92b700 1 --2- 172.21.15.59:0/4062455883 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08b4003f80 0x7f08c811f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.359+0000 7f08cd92b700 1 -- 172.21.15.59:0/4062455883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08c80a0a30 msgr2=0x7f08c81c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.359+0000 7f08cd92b700 1 --2- 172.21.15.59:0/4062455883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08c80a0a30 0x7f08c81c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.359+0000 7f08cd92b700 1 -- 172.21.15.59:0/4062455883 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c8120ce0 con 0x7f08c809d630 2023-09-30T22:29:58.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.359+0000 7f08cd92b700 1 --2- 172.21.15.59:0/4062455883 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c809d630 0x7f08c811f980 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f08c8068e80 tx=0x7f08b80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.359+0000 7f08beffd700 1 -- 172.21.15.59:0/4062455883 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8006e60 con 0x7f08c809d630 2023-09-30T22:29:58.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.359+0000 7f08beffd700 1 -- 172.21.15.59:0/4062455883 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b8003af0 con 0x7f08c809d630 2023-09-30T22:29:58.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.359+0000 7f08beffd700 1 -- 172.21.15.59:0/4062455883 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8003ea0 con 0x7f08c809d630 2023-09-30T22:29:58.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.359+0000 7f08d0390700 1 -- 172.21.15.59:0/4062455883 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c8120730 con 0x7f08c809d630 2023-09-30T22:29:58.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.360+0000 7f08d0390700 1 -- 172.21.15.59:0/4062455883 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c811fec0 con 0x7f08c809d630 2023-09-30T22:29:58.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.361+0000 7f08beffd700 1 -- 172.21.15.59:0/4062455883 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f08b8013470 con 0x7f08c809d630 2023-09-30T22:29:58.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.361+0000 7f08d0390700 1 -- 172.21.15.59:0/4062455883 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c80747f0 con 0x7f08c809d630 2023-09-30T22:29:58.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.361+0000 7f08beffd700 1 -- 172.21.15.59:0/4062455883 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f08b8041580 con 0x7f08c809d630 2023-09-30T22:29:58.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.361+0000 7f08ce12c700 1 -- 172.21.15.59:0/4062455883 >> v1:172.21.15.59:6816/126772 conn(0x7f08ac02f510 legacy=0x7f08ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:58.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.366+0000 7f08beffd700 1 -- 172.21.15.59:0/4062455883 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08b8009e50 con 0x7f08c809d630 2023-09-30T22:29:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.430+0000 7fce12cb0700 1 Processor -- start 2023-09-30T22:29:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.430+0000 7fce12cb0700 1 -- start start 2023-09-30T22:29:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce12cb0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce0c09e1d0 0x7fce0c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce12cb0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce0c139170 0x7fce0c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce12cb0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0c09b120 con 0x7fce0c09d6f0 2023-09-30T22:29:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce12cb0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce0c06b460 con 0x7fce0c139170 2023-09-30T22:29:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce12cb0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c09a7e0 con 0x7fce0c09e1d0 2023-09-30T22:29:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce10a4c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fce0c09d6f0 0x7fce0c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54528/0 (socket says 172.21.15.59:54528) 2023-09-30T22:29:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce10a4c700 1 -- 172.21.15.59:0/2540250221 learned_addr learned my addr 172.21.15.59:0/2540250221 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:29:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce0bfff700 1 --2- 172.21.15.59:0/2540250221 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce0c09e1d0 0x7fce0c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce1124d700 1 --2- 172.21.15.59:0/2540250221 >> v2:172.21.15.59:3300/0 conn(0x7fce0c139170 0x7fce0c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce0b7fe700 1 -- 172.21.15.59:0/2540250221 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777264185 0 0) 0x7fce0c09b120 con 0x7fce0c09d6f0 2023-09-30T22:29:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce0b7fe700 1 -- 172.21.15.59:0/2540250221 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdfc0035b0 con 0x7fce0c09d6f0 2023-09-30T22:29:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce0bfff700 1 -- 172.21.15.59:0/2540250221 >> v2:172.21.15.59:3300/0 conn(0x7fce0c139170 msgr2=0x7fce0c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce0bfff700 1 --2- 172.21.15.59:0/2540250221 >> v2:172.21.15.59:3300/0 conn(0x7fce0c139170 0x7fce0c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce0bfff700 1 -- 172.21.15.59:0/2540250221 >> v1:172.21.15.59:6789/0 conn(0x7fce0c09d6f0 legacy=0x7fce0c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce0b7fe700 1 -- 172.21.15.59:0/2540250221 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2363270299 0 0) 0x7fcdfc0035b0 con 0x7fce0c09d6f0 2023-09-30T22:29:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.431+0000 7fce0bfff700 1 -- 172.21.15.59:0/2540250221 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c09a500 con 0x7fce0c09e1d0 2023-09-30T22:29:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.432+0000 7fce1124d700 1 --2- 172.21.15.59:0/2540250221 >> v2:172.21.15.59:3300/0 conn(0x7fce0c139170 0x7fce0c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.432+0000 7fce0bfff700 1 --2- 172.21.15.59:0/2540250221 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce0c09e1d0 0x7fce0c138c30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009870 tx=0x7fcdf8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=936d8028263de654 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.432+0000 7fce0b7fe700 1 -- 172.21.15.59:0/2540250221 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00001670 con 0x7fce0c09e1d0 2023-09-30T22:29:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.432+0000 7fce0b7fe700 1 -- 172.21.15.59:0/2540250221 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf8004030 con 0x7fce0c09e1d0 2023-09-30T22:29:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.432+0000 7fce0b7fe700 1 -- 172.21.15.59:0/2540250221 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf80043c0 con 0x7fce0c09e1d0 2023-09-30T22:29:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.433+0000 7fce12cb0700 1 -- 172.21.15.59:0/2540250221 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce0c09e1d0 msgr2=0x7fce0c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.433+0000 7fce12cb0700 1 --2- 172.21.15.59:0/2540250221 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce0c09e1d0 0x7fce0c138c30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009870 tx=0x7fcdf8009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.433+0000 7fce12cb0700 1 -- 172.21.15.59:0/2540250221 shutdown_connections 2023-09-30T22:29:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.433+0000 7fce12cb0700 1 --2- 172.21.15.59:0/2540250221 >> v2:172.21.15.59:3300/0 conn(0x7fce0c139170 0x7fce0c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.433+0000 7fce12cb0700 1 --2- 172.21.15.59:0/2540250221 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce0c09e1d0 0x7fce0c138c30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.433+0000 7fce12cb0700 1 -- 172.21.15.59:0/2540250221 >> 172.21.15.59:0/2540250221 conn(0x7fce0c066f50 msgr2=0x7fce0c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.437+0000 7fce12cb0700 1 -- 172.21.15.59:0/2540250221 shutdown_connections 2023-09-30T22:29:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.437+0000 7fce12cb0700 1 -- 172.21.15.59:0/2540250221 wait complete. 2023-09-30T22:29:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.439+0000 7fce12cb0700 1 Processor -- start 2023-09-30T22:29:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.439+0000 7fce12cb0700 1 -- start start 2023-09-30T22:29:58.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce12cb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0c09d6f0 0x7fce0c120910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce12cb0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce0c09e1d0 0x7fce0c120e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce12cb0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce0c139170 0x7fce0c121390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce12cb0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c071fd0 con 0x7fce0c09e1d0 2023-09-30T22:29:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce12cb0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c1363f0 con 0x7fce0c09d6f0 2023-09-30T22:29:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce12cb0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c1225e0 con 0x7fce0c139170 2023-09-30T22:29:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce10a4c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0c09d6f0 0x7fce0c120910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce10a4c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0c09d6f0 0x7fce0c120910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50326/0 (socket says 172.21.15.59:50326) 2023-09-30T22:29:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce10a4c700 1 -- 172.21.15.59:0/2921929670 learned_addr learned my addr 172.21.15.59:0/2921929670 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce1124d700 1 --2- 172.21.15.59:0/2921929670 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce0c139170 0x7fce0c121390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce0bfff700 1 --2- 172.21.15.59:0/2921929670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce0c09e1d0 0x7fce0c120e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce10a4c700 1 -- 172.21.15.59:0/2921929670 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce0c139170 msgr2=0x7fce0c121390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce10a4c700 1 --2- 172.21.15.59:0/2921929670 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce0c139170 0x7fce0c121390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce10a4c700 1 -- 172.21.15.59:0/2921929670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce0c09e1d0 msgr2=0x7fce0c120e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce10a4c700 1 --2- 172.21.15.59:0/2921929670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce0c09e1d0 0x7fce0c120e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.440+0000 7fce10a4c700 1 -- 172.21.15.59:0/2921929670 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce04009a70 con 0x7fce0c09d6f0 2023-09-30T22:29:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.441+0000 7fce10a4c700 1 --2- 172.21.15.59:0/2921929670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0c09d6f0 0x7fce0c120910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fce0000c760 tx=0x7fce0000ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.441+0000 7fce097fa700 1 -- 172.21.15.59:0/2921929670 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00004c80 con 0x7fce0c09d6f0 2023-09-30T22:29:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.441+0000 7fce097fa700 1 -- 172.21.15.59:0/2921929670 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce00004e00 con 0x7fce0c09d6f0 2023-09-30T22:29:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.441+0000 7fce12cb0700 1 -- 172.21.15.59:0/2921929670 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf80094a0 con 0x7fce0c09d6f0 2023-09-30T22:29:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.441+0000 7fce097fa700 1 -- 172.21.15.59:0/2921929670 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00007310 con 0x7fce0c09d6f0 2023-09-30T22:29:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.441+0000 7fce12cb0700 1 -- 172.21.15.59:0/2921929670 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0c123ea0 con 0x7fce0c09d6f0 2023-09-30T22:29:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.442+0000 7fce12cb0700 1 -- 172.21.15.59:0/2921929670 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0c124220 con 0x7fce0c09d6f0 2023-09-30T22:29:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.443+0000 7fce097fa700 1 -- 172.21.15.59:0/2921929670 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fce00007470 con 0x7fce0c09d6f0 2023-09-30T22:29:58.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.443+0000 7fce097fa700 1 -- 172.21.15.59:0/2921929670 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fce0003ff30 con 0x7fce0c09d6f0 2023-09-30T22:29:58.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.443+0000 7fce0bfff700 1 -- 172.21.15.59:0/2921929670 >> v1:172.21.15.59:6816/126772 conn(0x7fcdf002f510 legacy=0x7fcdf00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:58.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.444+0000 7f249f99f700 1 Processor -- start 2023-09-30T22:29:58.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.444+0000 7f249f99f700 1 -- start start 2023-09-30T22:29:58.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.445+0000 7f249f99f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249809e1d0 0x7f2498138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.445+0000 7f249f99f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2498139170 0x7f249813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.445+0000 7f249f99f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249809b120 con 0x7f249809d6f0 2023-09-30T22:29:58.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.445+0000 7f249f99f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249806b460 con 0x7f2498139170 2023-09-30T22:29:58.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.445+0000 7f249f99f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f249809a7e0 con 0x7f249809e1d0 2023-09-30T22:29:58.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.445+0000 7f249cf3a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249809e1d0 0x7f2498138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.445+0000 7f249cf3a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249809e1d0 0x7f2498138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59512/0 (socket says 172.21.15.59:59512) 2023-09-30T22:29:58.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.445+0000 7f249cf3a700 1 -- 172.21.15.59:0/3352163497 learned_addr learned my addr 172.21.15.59:0/3352163497 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:58.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.445+0000 7f249cf3a700 1 -- 172.21.15.59:0/3352163497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2498139170 msgr2=0x7f249813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.445+0000 7f249cf3a700 1 --2- 172.21.15.59:0/3352163497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2498139170 0x7f249813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.445+0000 7f249cf3a700 1 -- 172.21.15.59:0/3352163497 >> v1:172.21.15.59:6789/0 conn(0x7f249809d6f0 legacy=0x7f249809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.445+0000 7f249cf3a700 1 -- 172.21.15.59:0/3352163497 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249809a500 con 0x7f249809e1d0 2023-09-30T22:29:58.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.446+0000 7f249cf3a700 1 --2- 172.21.15.59:0/3352163497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249809e1d0 0x7f2498138c30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2488009950 tx=0x7f2488009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=761091c11b61a623 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.446+0000 7f248ffff700 1 -- 172.21.15.59:0/3352163497 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2488009ea0 con 0x7f249809e1d0 2023-09-30T22:29:58.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.446+0000 7f248ffff700 1 -- 172.21.15.59:0/3352163497 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2488004230 con 0x7f249809e1d0 2023-09-30T22:29:58.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.446+0000 7f248ffff700 1 -- 172.21.15.59:0/3352163497 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248800b7e0 con 0x7f249809e1d0 2023-09-30T22:29:58.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.447+0000 7f249f99f700 1 -- 172.21.15.59:0/3352163497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249809e1d0 msgr2=0x7f2498138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.447+0000 7f249f99f700 1 --2- 172.21.15.59:0/3352163497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249809e1d0 0x7f2498138c30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2488009950 tx=0x7f2488009c60 comp rx=0 tx=0).stop 2023-09-30T22:29:58.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.447+0000 7f249f99f700 1 -- 172.21.15.59:0/3352163497 shutdown_connections 2023-09-30T22:29:58.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.447+0000 7f249f99f700 1 --2- 172.21.15.59:0/3352163497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2498139170 0x7f249813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.447+0000 7f249f99f700 1 --2- 172.21.15.59:0/3352163497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249809e1d0 0x7f2498138c30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.447+0000 7f249f99f700 1 -- 172.21.15.59:0/3352163497 >> 172.21.15.59:0/3352163497 conn(0x7f2498066f50 msgr2=0x7f249809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.447+0000 7f249f99f700 1 -- 172.21.15.59:0/3352163497 shutdown_connections 2023-09-30T22:29:58.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.447+0000 7f249f99f700 1 -- 172.21.15.59:0/3352163497 wait complete. 2023-09-30T22:29:58.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.449+0000 7f249f99f700 1 Processor -- start 2023-09-30T22:29:58.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.449+0000 7f249f99f700 1 -- start start 2023-09-30T22:29:58.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.449+0000 7fce097fa700 1 -- 172.21.15.59:0/2921929670 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce0001a6c0 con 0x7fce0c09d6f0 2023-09-30T22:29:58.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.449+0000 7f249f99f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249809d6f0 0x7f24981c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.449+0000 7f249f99f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f249809e1d0 0x7f24981c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.449+0000 7f249f99f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2498139170 0x7f249811e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.449+0000 7f249f99f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24981203b0 con 0x7f249809e1d0 2023-09-30T22:29:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.449+0000 7f249f99f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2498134670 con 0x7f2498139170 2023-09-30T22:29:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.449+0000 7f249f99f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24980a2140 con 0x7f249809d6f0 2023-09-30T22:29:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.450+0000 7f249cf3a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f249809e1d0 0x7f24981c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.450+0000 7f249cf3a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f249809e1d0 0x7f24981c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51784/0 (socket says 172.21.15.59:51784) 2023-09-30T22:29:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.450+0000 7f249cf3a700 1 -- 172.21.15.59:0/4009425996 learned_addr learned my addr 172.21.15.59:0/4009425996 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.450+0000 7f249df3c700 1 --2- 172.21.15.59:0/4009425996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2498139170 0x7f249811e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.450+0000 7f249d73b700 1 --2- 172.21.15.59:0/4009425996 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249809d6f0 0x7f24981c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.450+0000 7f249df3c700 1 -- 172.21.15.59:0/4009425996 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249809d6f0 msgr2=0x7f24981c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.450+0000 7f249df3c700 1 --2- 172.21.15.59:0/4009425996 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249809d6f0 0x7f24981c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.450+0000 7f249df3c700 1 -- 172.21.15.59:0/4009425996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f249809e1d0 msgr2=0x7f24981c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.450+0000 7f249df3c700 1 --2- 172.21.15.59:0/4009425996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f249809e1d0 0x7f24981c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.450+0000 7f249df3c700 1 -- 172.21.15.59:0/4009425996 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2488009550 con 0x7f2498139170 2023-09-30T22:29:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.451+0000 7f249df3c700 1 --2- 172.21.15.59:0/4009425996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2498139170 0x7f249811e7a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f249000be20 tx=0x7f2490009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.451+0000 7f248dffb700 1 -- 172.21.15.59:0/4009425996 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000cc10 con 0x7f2498139170 2023-09-30T22:29:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.451+0000 7f248dffb700 1 -- 172.21.15.59:0/4009425996 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249000cd90 con 0x7f2498139170 2023-09-30T22:29:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.451+0000 7f248dffb700 1 -- 172.21.15.59:0/4009425996 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490014680 con 0x7f2498139170 2023-09-30T22:29:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.451+0000 7f249f99f700 1 -- 172.21.15.59:0/4009425996 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249809c710 con 0x7f2498139170 2023-09-30T22:29:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.451+0000 7f249f99f700 1 -- 172.21.15.59:0/4009425996 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2498122a50 con 0x7f2498139170 2023-09-30T22:29:58.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.452+0000 7f248dffb700 1 -- 172.21.15.59:0/4009425996 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f249001d3b0 con 0x7f2498139170 2023-09-30T22:29:58.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.453+0000 7f248dffb700 1 -- 172.21.15.59:0/4009425996 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f2490006e40 con 0x7f2498139170 2023-09-30T22:29:58.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.453+0000 7f249d73b700 1 -- 172.21.15.59:0/4009425996 >> v1:172.21.15.59:6816/126772 conn(0x7f247c02f540 legacy=0x7f247c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:58.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.461+0000 7f249f99f700 1 -- 172.21.15.59:0/4009425996 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2498074ea0 con 0x7f2498139170 2023-09-30T22:29:58.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.466+0000 7f248dffb700 1 -- 172.21.15.59:0/4009425996 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2490019030 con 0x7f2498139170 2023-09-30T22:29:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.490+0000 7f1e4effd700 1 -- 172.21.15.59:0/1789446196 >> v1:172.21.15.59:6816/126772 conn(0x7f1e3c02f510 legacy=0x7f1e3c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:58.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.562+0000 7f08ce12c700 1 -- 172.21.15.59:0/4062455883 >> v1:172.21.15.59:6816/126772 conn(0x7f08ac02f510 legacy=0x7f08ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:58.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.609+0000 7f08d0390700 1 -- 172.21.15.59:0/4062455883 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f08c81222c0 con 0x7f08c809d630 2023-09-30T22:29:58.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.610+0000 7f08beffd700 1 -- 172.21.15.59:0/4062455883 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08b802c020 con 0x7f08c809d630 2023-09-30T22:29:58.611 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:29:58.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.612+0000 7f08d0390700 1 -- 172.21.15.59:0/4062455883 >> v1:172.21.15.59:6816/126772 conn(0x7f08ac02f510 legacy=0x7f08ac0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:58.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.612+0000 7f08d0390700 1 -- 172.21.15.59:0/4062455883 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c809d630 msgr2=0x7f08c811f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.612+0000 7f08d0390700 1 --2- 172.21.15.59:0/4062455883 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c809d630 0x7f08c811f980 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f08c8068e80 tx=0x7f08b80047c0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.612+0000 7f08d0390700 1 -- 172.21.15.59:0/4062455883 shutdown_connections 2023-09-30T22:29:58.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.612+0000 7f08d0390700 1 --2- 172.21.15.59:0/4062455883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08c80a0a30 0x7f08c81c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.612+0000 7f08d0390700 1 --2- 172.21.15.59:0/4062455883 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08b4003f80 0x7f08c811f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.612+0000 7f08d0390700 1 --2- 172.21.15.59:0/4062455883 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08c809d630 0x7f08c811f980 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.612+0000 7f08d0390700 1 -- 172.21.15.59:0/4062455883 >> 172.21.15.59:0/4062455883 conn(0x7f08c80a3050 msgr2=0x7f08c81bb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.612+0000 7f08d0390700 1 -- 172.21.15.59:0/4062455883 shutdown_connections 2023-09-30T22:29:58.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.612+0000 7f08d0390700 1 -- 172.21.15.59:0/4062455883 wait complete. 2023-09-30T22:29:58.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:29:58.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.644+0000 7fce0bfff700 1 -- 172.21.15.59:0/2921929670 >> v1:172.21.15.59:6816/126772 conn(0x7fcdf002f510 legacy=0x7fcdf00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:58.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.649+0000 7f1e559bd700 1 -- 172.21.15.59:0/1789446196 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1e501209d0 con 0x7f1e50133930 2023-09-30T22:29:58.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.649+0000 7f1e37fff700 1 -- 172.21.15.59:0/1789446196 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e48018020 con 0x7f1e50133930 2023-09-30T22:29:58.650 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.651+0000 7f1e559bd700 1 -- 172.21.15.59:0/1789446196 >> v1:172.21.15.59:6816/126772 conn(0x7f1e3c02f510 legacy=0x7f1e3c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.651+0000 7f1e559bd700 1 -- 172.21.15.59:0/1789446196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e50133930 msgr2=0x7f1e5011e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.651+0000 7f1e559bd700 1 --2- 172.21.15.59:0/1789446196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e50133930 0x7f1e5011e8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009dd0 tx=0x7f1e4800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.651+0000 7f1e559bd700 1 -- 172.21.15.59:0/1789446196 shutdown_connections 2023-09-30T22:29:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.651+0000 7f1e559bd700 1 --2- 172.21.15.59:0/1789446196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e50133930 0x7f1e5011e8f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.651+0000 7f1e559bd700 1 --2- 172.21.15.59:0/1789446196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5009d630 0x7f1e501c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.651+0000 7f1e559bd700 1 --2- 172.21.15.59:0/1789446196 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e500a0a30 0x7f1e501c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.651+0000 7f1e559bd700 1 -- 172.21.15.59:0/1789446196 >> 172.21.15.59:0/1789446196 conn(0x7f1e500a3050 msgr2=0x7f1e5009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.651+0000 7f1e559bd700 1 -- 172.21.15.59:0/1789446196 shutdown_connections 2023-09-30T22:29:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.652+0000 7f1e559bd700 1 -- 172.21.15.59:0/1789446196 wait complete. 2023-09-30T22:29:58.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.654+0000 7f249d73b700 1 -- 172.21.15.59:0/4009425996 >> v1:172.21.15.59:6816/126772 conn(0x7f247c02f540 legacy=0x7f247c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:58.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:29:58.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.691+0000 7fce12cb0700 1 -- 172.21.15.59:0/2921929670 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fce0c09f420 con 0x7fce0c09d6f0 2023-09-30T22:29:58.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.691+0000 7fce097fa700 1 -- 172.21.15.59:0/2921929670 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce00011360 con 0x7fce0c09d6f0 2023-09-30T22:29:58.692 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:29:58.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.693+0000 7fce12cb0700 1 -- 172.21.15.59:0/2921929670 >> v1:172.21.15.59:6816/126772 conn(0x7fcdf002f510 legacy=0x7fcdf00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:58.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.693+0000 7fce12cb0700 1 -- 172.21.15.59:0/2921929670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0c09d6f0 msgr2=0x7fce0c120910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.693+0000 7fce12cb0700 1 --2- 172.21.15.59:0/2921929670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0c09d6f0 0x7fce0c120910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fce0000c760 tx=0x7fce0000ca70 comp rx=0 tx=0).stop 2023-09-30T22:29:58.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.693+0000 7fce12cb0700 1 -- 172.21.15.59:0/2921929670 shutdown_connections 2023-09-30T22:29:58.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.693+0000 7fce12cb0700 1 --2- 172.21.15.59:0/2921929670 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce0c139170 0x7fce0c121390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.693+0000 7fce12cb0700 1 --2- 172.21.15.59:0/2921929670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0c09d6f0 0x7fce0c120910 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.693+0000 7fce12cb0700 1 --2- 172.21.15.59:0/2921929670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce0c09e1d0 0x7fce0c120e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.693+0000 7fce12cb0700 1 -- 172.21.15.59:0/2921929670 >> 172.21.15.59:0/2921929670 conn(0x7fce0c066f50 msgr2=0x7fce0c070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.693+0000 7fce12cb0700 1 -- 172.21.15.59:0/2921929670 shutdown_connections 2023-09-30T22:29:58.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.693+0000 7fce12cb0700 1 -- 172.21.15.59:0/2921929670 wait complete. 2023-09-30T22:29:58.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:29:58.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.738+0000 7f249f99f700 1 -- 172.21.15.59:0/4009425996 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2498121c80 con 0x7f2498139170 2023-09-30T22:29:58.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.739+0000 7f248dffb700 1 -- 172.21.15.59:0/4009425996 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2490019020 con 0x7f2498139170 2023-09-30T22:29:58.740 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:29:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.741+0000 7f249f99f700 1 -- 172.21.15.59:0/4009425996 >> v1:172.21.15.59:6816/126772 conn(0x7f247c02f540 legacy=0x7f247c0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.741+0000 7f249f99f700 1 -- 172.21.15.59:0/4009425996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2498139170 msgr2=0x7f249811e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.741+0000 7f249f99f700 1 --2- 172.21.15.59:0/4009425996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2498139170 0x7f249811e7a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f249000be20 tx=0x7f2490009ed0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.741+0000 7f249f99f700 1 -- 172.21.15.59:0/4009425996 shutdown_connections 2023-09-30T22:29:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.741+0000 7f249f99f700 1 --2- 172.21.15.59:0/4009425996 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249809d6f0 0x7f24981c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.741+0000 7f249f99f700 1 --2- 172.21.15.59:0/4009425996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2498139170 0x7f249811e7a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.741+0000 7f249f99f700 1 --2- 172.21.15.59:0/4009425996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f249809e1d0 0x7f24981c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.741+0000 7f249f99f700 1 -- 172.21.15.59:0/4009425996 >> 172.21.15.59:0/4009425996 conn(0x7f2498066f50 msgr2=0x7f2498136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.741+0000 7f249f99f700 1 -- 172.21.15.59:0/4009425996 shutdown_connections 2023-09-30T22:29:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:58.741+0000 7f249f99f700 1 -- 172.21.15.59:0/4009425996 wait complete. 2023-09-30T22:29:58.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:29:59.628 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:59.668 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:59.709 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:59.757 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.779+0000 7f3cd26bd700 1 Processor -- start 2023-09-30T22:29:59.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.779+0000 7f3cd26bd700 1 -- start start 2023-09-30T22:29:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.779+0000 7f3cd26bd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3ccc1338c0 0x7f3ccc133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.779+0000 7f3cd26bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ccc09e560 0x7f3ccc13b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.779+0000 7f3cd26bd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ccc06f720 con 0x7f3ccc1341d0 2023-09-30T22:29:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.779+0000 7f3cd26bd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ccc070c80 con 0x7f3ccc1338c0 2023-09-30T22:29:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.779+0000 7f3cd26bd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc06fce0 con 0x7f3ccc09e560 2023-09-30T22:29:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.780+0000 7f3cd0c5a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ccc09e560 0x7f3ccc13b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.780+0000 7f3cd0c5a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ccc09e560 0x7f3ccc13b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50366/0 (socket says 172.21.15.59:50366) 2023-09-30T22:29:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.780+0000 7f3cd0c5a700 1 -- 172.21.15.59:0/3033150050 learned_addr learned my addr 172.21.15.59:0/3033150050 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.780+0000 7f3ccbfff700 1 --2- 172.21.15.59:0/3033150050 >> v2:172.21.15.59:3300/0 conn(0x7f3ccc1338c0 0x7f3ccc133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.780+0000 7f3cd0c5a700 1 -- 172.21.15.59:0/3033150050 >> v2:172.21.15.59:3300/0 conn(0x7f3ccc1338c0 msgr2=0x7f3ccc133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:59.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.780+0000 7f3cd0c5a700 1 --2- 172.21.15.59:0/3033150050 >> v2:172.21.15.59:3300/0 conn(0x7f3ccc1338c0 0x7f3ccc133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.780+0000 7f3cd0c5a700 1 -- 172.21.15.59:0/3033150050 >> v1:172.21.15.59:6789/0 conn(0x7f3ccc1341d0 legacy=0x7f3ccc09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:59.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.780+0000 7f3cd0c5a700 1 -- 172.21.15.59:0/3033150050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc1336a0 con 0x7f3ccc09e560 2023-09-30T22:29:59.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.780+0000 7f3cd0c5a700 1 --2- 172.21.15.59:0/3033150050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ccc09e560 0x7f3ccc13b860 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009e50 tx=0x7f3cc400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f733082a92087c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.780+0000 7f3ccaffd700 1 -- 172.21.15.59:0/3033150050 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc400e070 con 0x7f3ccc09e560 2023-09-30T22:29:59.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.780+0000 7f3ccaffd700 1 -- 172.21.15.59:0/3033150050 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc4003a20 con 0x7f3ccc09e560 2023-09-30T22:29:59.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.780+0000 7f3ccaffd700 1 -- 172.21.15.59:0/3033150050 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4003dd0 con 0x7f3ccc09e560 2023-09-30T22:29:59.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.781+0000 7f3cd26bd700 1 -- 172.21.15.59:0/3033150050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ccc09e560 msgr2=0x7f3ccc13b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.781+0000 7f3cd26bd700 1 --2- 172.21.15.59:0/3033150050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ccc09e560 0x7f3ccc13b860 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009e50 tx=0x7f3cc400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:59.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.781+0000 7f3cd26bd700 1 -- 172.21.15.59:0/3033150050 shutdown_connections 2023-09-30T22:29:59.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.781+0000 7f3cd26bd700 1 --2- 172.21.15.59:0/3033150050 >> v2:172.21.15.59:3300/0 conn(0x7f3ccc1338c0 0x7f3ccc133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.781+0000 7f3cd26bd700 1 --2- 172.21.15.59:0/3033150050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ccc09e560 0x7f3ccc13b860 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.781+0000 7f3cd26bd700 1 -- 172.21.15.59:0/3033150050 >> 172.21.15.59:0/3033150050 conn(0x7f3ccc0a2aa0 msgr2=0x7f3ccc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.781+0000 7f3cd26bd700 1 -- 172.21.15.59:0/3033150050 shutdown_connections 2023-09-30T22:29:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.782+0000 7f3cd26bd700 1 -- 172.21.15.59:0/3033150050 wait complete. 2023-09-30T22:29:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.783+0000 7f3cd26bd700 1 Processor -- start 2023-09-30T22:29:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.783+0000 7f3cd26bd700 1 -- start start 2023-09-30T22:29:59.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.784+0000 7f3cd26bd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ccc09e560 0x7f3ccc11b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.784+0000 7f3cd26bd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ccc1338c0 0x7f3ccc11ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.784+0000 7f3cd26bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ccc1341d0 0x7f3ccc11bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.784+0000 7f3cd26bd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc11f9c0 con 0x7f3ccc1338c0 2023-09-30T22:29:59.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.784+0000 7f3cd26bd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc11f000 con 0x7f3ccc1341d0 2023-09-30T22:29:59.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.784+0000 7f3cd26bd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc11e3b0 con 0x7f3ccc09e560 2023-09-30T22:29:59.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.784+0000 7f3cd0c5a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ccc1341d0 0x7f3ccc11bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.784+0000 7f3cd0c5a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ccc1341d0 0x7f3ccc11bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50368/0 (socket says 172.21.15.59:50368) 2023-09-30T22:29:59.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.784+0000 7f3cd0c5a700 1 -- 172.21.15.59:0/3284179348 learned_addr learned my addr 172.21.15.59:0/3284179348 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:59.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.784+0000 7f3ccbfff700 1 --2- 172.21.15.59:0/3284179348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ccc09e560 0x7f3ccc11b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.784+0000 7f3ccb7fe700 1 --2- 172.21.15.59:0/3284179348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ccc1338c0 0x7f3ccc11ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.785+0000 7f3cd0c5a700 1 -- 172.21.15.59:0/3284179348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ccc09e560 msgr2=0x7f3ccc11b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.785+0000 7f3cd0c5a700 1 --2- 172.21.15.59:0/3284179348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ccc09e560 0x7f3ccc11b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.785+0000 7f3cd0c5a700 1 -- 172.21.15.59:0/3284179348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ccc1338c0 msgr2=0x7f3ccc11ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.785+0000 7f3cd0c5a700 1 --2- 172.21.15.59:0/3284179348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ccc1338c0 0x7f3ccc11ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.785+0000 7f3cd0c5a700 1 -- 172.21.15.59:0/3284179348 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc4009b30 con 0x7f3ccc1341d0 2023-09-30T22:29:59.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.785+0000 7f3cd0c5a700 1 --2- 172.21.15.59:0/3284179348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ccc1341d0 0x7f3ccc11bf60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc06fe20 tx=0x7f3cc4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.785+0000 7f3cc8ff9700 1 -- 172.21.15.59:0/3284179348 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4004440 con 0x7f3ccc1341d0 2023-09-30T22:29:59.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.785+0000 7f3cc8ff9700 1 -- 172.21.15.59:0/3284179348 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc40045c0 con 0x7f3ccc1341d0 2023-09-30T22:29:59.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.785+0000 7f3cd26bd700 1 -- 172.21.15.59:0/3284179348 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ccc11d190 con 0x7f3ccc1341d0 2023-09-30T22:29:59.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.785+0000 7f3cc8ff9700 1 -- 172.21.15.59:0/3284179348 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4004970 con 0x7f3ccc1341d0 2023-09-30T22:29:59.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.785+0000 7f3cd26bd700 1 -- 172.21.15.59:0/3284179348 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ccc11def0 con 0x7f3ccc1341d0 2023-09-30T22:29:59.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.787+0000 7f3cd26bd700 1 -- 172.21.15.59:0/3284179348 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ccc09d1f0 con 0x7f3ccc1341d0 2023-09-30T22:29:59.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.787+0000 7f3cc8ff9700 1 -- 172.21.15.59:0/3284179348 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3cc401c440 con 0x7f3ccc1341d0 2023-09-30T22:29:59.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.787+0000 7f3ccbfff700 1 -- 172.21.15.59:0/3284179348 >> v1:172.21.15.59:6816/126772 conn(0x7f3cb802f510 legacy=0x7f3cb80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:59.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.787+0000 7f3cc8ff9700 1 -- 172.21.15.59:0/3284179348 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f3cc40426d0 con 0x7f3ccc1341d0 2023-09-30T22:29:59.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.796+0000 7f3cc8ff9700 1 -- 172.21.15.59:0/3284179348 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3cc4046060 con 0x7f3ccc1341d0 2023-09-30T22:29:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.820+0000 7f747189a700 1 Processor -- start 2023-09-30T22:29:59.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.820+0000 7f747189a700 1 -- start start 2023-09-30T22:29:59.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.821+0000 7f747189a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746c06a770 0x7f746c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.821+0000 7f747189a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f746c09dc30 0x7f746c09e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.821+0000 7f747189a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746c09a810 con 0x7f746c13c1e0 2023-09-30T22:29:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.821+0000 7f747189a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746c06ab40 con 0x7f746c09dc30 2023-09-30T22:29:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.821+0000 7f747189a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f746c09ebc0 con 0x7f746c06a770 2023-09-30T22:29:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.821+0000 7f746a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f746c09dc30 0x7f746c09e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.821+0000 7f746a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f746c09dc30 0x7f746c09e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51826/0 (socket says 172.21.15.59:51826) 2023-09-30T22:29:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.821+0000 7f746a7fc700 1 -- 172.21.15.59:0/1116087851 learned_addr learned my addr 172.21.15.59:0/1116087851 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.821+0000 7f746affd700 1 --2- 172.21.15.59:0/1116087851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746c06a770 0x7f746c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.822+0000 7f746a7fc700 1 -- 172.21.15.59:0/1116087851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746c06a770 msgr2=0x7f746c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:59.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.822+0000 7f746a7fc700 1 --2- 172.21.15.59:0/1116087851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746c06a770 0x7f746c09d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.822+0000 7f746a7fc700 1 -- 172.21.15.59:0/1116087851 >> v1:172.21.15.59:6789/0 conn(0x7f746c13c1e0 legacy=0x7f746c13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.822+0000 7f746a7fc700 1 -- 172.21.15.59:0/1116087851 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c09e920 con 0x7f746c09dc30 2023-09-30T22:29:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.822+0000 7f746a7fc700 1 --2- 172.21.15.59:0/1116087851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c09dc30 0x7f746c09e080 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7460009920 tx=0x7f7460009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30ecc7e54efa385 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.822+0000 7f7469ffb700 1 -- 172.21.15.59:0/1116087851 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460011830 con 0x7f746c09dc30 2023-09-30T22:29:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.822+0000 7f7469ffb700 1 -- 172.21.15.59:0/1116087851 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7460011990 con 0x7f746c09dc30 2023-09-30T22:29:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.822+0000 7f7469ffb700 1 -- 172.21.15.59:0/1116087851 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460011d20 con 0x7f746c09dc30 2023-09-30T22:29:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.823+0000 7f747189a700 1 -- 172.21.15.59:0/1116087851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c09dc30 msgr2=0x7f746c09e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.823+0000 7f747189a700 1 --2- 172.21.15.59:0/1116087851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c09dc30 0x7f746c09e080 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7460009920 tx=0x7f7460009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.823+0000 7f747189a700 1 -- 172.21.15.59:0/1116087851 shutdown_connections 2023-09-30T22:29:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.823+0000 7f747189a700 1 --2- 172.21.15.59:0/1116087851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746c06a770 0x7f746c09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.823+0000 7f747189a700 1 --2- 172.21.15.59:0/1116087851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c09dc30 0x7f746c09e080 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.823+0000 7f747189a700 1 -- 172.21.15.59:0/1116087851 >> 172.21.15.59:0/1116087851 conn(0x7f746c066f50 msgr2=0x7f746c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:59.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.823+0000 7f747189a700 1 -- 172.21.15.59:0/1116087851 shutdown_connections 2023-09-30T22:29:59.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.823+0000 7f747189a700 1 -- 172.21.15.59:0/1116087851 wait complete. 2023-09-30T22:29:59.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.824+0000 7f747189a700 1 Processor -- start 2023-09-30T22:29:59.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.824+0000 7f747189a700 1 -- start start 2023-09-30T22:29:59.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f747189a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c06a770 0x7f746c126c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f747189a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f746c09dc30 0x7f746c127190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f747189a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746c13c1e0 0x7f746c1cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f747189a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c13ad60 con 0x7f746c06a770 2023-09-30T22:29:59.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f747189a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746c09f1a0 con 0x7f746c09dc30 2023-09-30T22:29:59.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f747189a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f746c129830 con 0x7f746c13c1e0 2023-09-30T22:29:59.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f746affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c06a770 0x7f746c126c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f746affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c06a770 0x7f746c126c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51834/0 (socket says 172.21.15.59:51834) 2023-09-30T22:29:59.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f746affd700 1 -- 172.21.15.59:0/3643772979 learned_addr learned my addr 172.21.15.59:0/3643772979 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:59.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f746b7fe700 1 --2- 172.21.15.59:0/3643772979 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746c13c1e0 0x7f746c1cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f746affd700 1 -- 172.21.15.59:0/3643772979 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746c13c1e0 msgr2=0x7f746c1cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f746affd700 1 --2- 172.21.15.59:0/3643772979 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746c13c1e0 0x7f746c1cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f746affd700 1 -- 172.21.15.59:0/3643772979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f746c09dc30 msgr2=0x7f746c127190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f746affd700 1 --2- 172.21.15.59:0/3643772979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f746c09dc30 0x7f746c127190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f746affd700 1 -- 172.21.15.59:0/3643772979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7460009550 con 0x7f746c06a770 2023-09-30T22:29:59.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.825+0000 7f746b7fe700 1 --2- 172.21.15.59:0/3643772979 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746c13c1e0 0x7f746c1cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:59.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.826+0000 7f746affd700 1 --2- 172.21.15.59:0/3643772979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c06a770 0x7f746c126c50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f745c00e9b0 tx=0x7f745c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.826+0000 7f7453fff700 1 -- 172.21.15.59:0/3643772979 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c009710 con 0x7f746c06a770 2023-09-30T22:29:59.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.826+0000 7f7453fff700 1 -- 172.21.15.59:0/3643772979 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c00c850 con 0x7f746c06a770 2023-09-30T22:29:59.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.826+0000 7f7453fff700 1 -- 172.21.15.59:0/3643772979 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c00cbc0 con 0x7f746c06a770 2023-09-30T22:29:59.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.826+0000 7f747189a700 1 -- 172.21.15.59:0/3643772979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746c126840 con 0x7f746c06a770 2023-09-30T22:29:59.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.826+0000 7f747189a700 1 -- 172.21.15.59:0/3643772979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746c127f60 con 0x7f746c06a770 2023-09-30T22:29:59.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.827+0000 7f7453fff700 1 -- 172.21.15.59:0/3643772979 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f745c00cd20 con 0x7f746c06a770 2023-09-30T22:29:59.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.827+0000 7f747189a700 1 -- 172.21.15.59:0/3643772979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746c1277f0 con 0x7f746c06a770 2023-09-30T22:29:59.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.828+0000 7f746a7fc700 1 -- 172.21.15.59:0/3643772979 >> v1:172.21.15.59:6816/126772 conn(0x7f745802f540 legacy=0x7f74580319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:59.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.828+0000 7f7453fff700 1 -- 172.21.15.59:0/3643772979 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f745c03fb40 con 0x7f746c06a770 2023-09-30T22:29:59.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.837+0000 7f7453fff700 1 -- 172.21.15.59:0/3643772979 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f746c1277f0 con 0x7f746c06a770 2023-09-30T22:29:59.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.905+0000 7faacf885700 1 Processor -- start 2023-09-30T22:29:59.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.905+0000 7fdf0807d700 1 Processor -- start 2023-09-30T22:29:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.905+0000 7faacf885700 1 -- start start 2023-09-30T22:29:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.905+0000 7faacf885700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faac809d6f0 0x7faac809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.905+0000 7faacf885700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac809e000 0x7faac8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.905+0000 7fdf0807d700 1 -- start start 2023-09-30T22:29:59.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.905+0000 7faacf885700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac809f130 con 0x7faac809e410 2023-09-30T22:29:59.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7faacf885700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac809f520 con 0x7faac809d6f0 2023-09-30T22:29:59.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7faacf885700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faac809e930 con 0x7faac809e000 2023-09-30T22:29:59.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7faacce20700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac809e000 0x7faac8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7faacce20700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac809e000 0x7faac8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59552/0 (socket says 172.21.15.59:59552) 2023-09-30T22:29:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7faacce20700 1 -- 172.21.15.59:0/776618237 learned_addr learned my addr 172.21.15.59:0/776618237 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7faacd621700 1 --2- 172.21.15.59:0/776618237 >> v2:172.21.15.59:3300/0 conn(0x7faac809d6f0 0x7faac809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7faacce20700 1 -- 172.21.15.59:0/776618237 >> v2:172.21.15.59:3300/0 conn(0x7faac809d6f0 msgr2=0x7faac809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7faacce20700 1 --2- 172.21.15.59:0/776618237 >> v2:172.21.15.59:3300/0 conn(0x7faac809d6f0 0x7faac809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7faacce20700 1 -- 172.21.15.59:0/776618237 >> v1:172.21.15.59:6789/0 conn(0x7faac809e410 legacy=0x7faac8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7faacce20700 1 -- 172.21.15.59:0/776618237 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac809b2d0 con 0x7faac809e000 2023-09-30T22:29:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7fdf0807d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf0009d6f0 0x7fdf0009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7fdf0807d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf0009e000 0x7fdf00130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7fdf0807d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf0009e410 0x7fdf00130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7fdf0807d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0009f520 con 0x7fdf0009d6f0 2023-09-30T22:29:59.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7fdf0807d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0009f130 con 0x7fdf0009e000 2023-09-30T22:29:59.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7fdf0807d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0009e930 con 0x7fdf0009e410 2023-09-30T22:29:59.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.906+0000 7fdf05e19700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf0009d6f0 0x7fdf0009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.907+0000 7fdf05e19700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf0009d6f0 0x7fdf0009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51854/0 (socket says 172.21.15.59:51854) 2023-09-30T22:29:59.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.907+0000 7fdf05e19700 1 -- 172.21.15.59:0/193066508 learned_addr learned my addr 172.21.15.59:0/193066508 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:59.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.907+0000 7fdf05618700 1 --2- 172.21.15.59:0/193066508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf0009e000 0x7fdf00130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.907+0000 7faacce20700 1 --2- 172.21.15.59:0/776618237 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac809e000 0x7faac8130660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faab8009950 tx=0x7faab8009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa4f5769f4ae5588 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.907+0000 7fdf0661a700 1 --2- 172.21.15.59:0/193066508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf0009e410 0x7fdf00130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.907+0000 7faabffff700 1 -- 172.21.15.59:0/776618237 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8004230 con 0x7faac809e000 2023-09-30T22:29:59.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.907+0000 7faabffff700 1 -- 172.21.15.59:0/776618237 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab8004390 con 0x7faac809e000 2023-09-30T22:29:59.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.907+0000 7faabffff700 1 -- 172.21.15.59:0/776618237 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab80108c0 con 0x7faac809e000 2023-09-30T22:29:59.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.907+0000 7fdf05e19700 1 -- 172.21.15.59:0/193066508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf0009e410 msgr2=0x7fdf00130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:59.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.907+0000 7fdf05e19700 1 --2- 172.21.15.59:0/193066508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf0009e410 0x7fdf00130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.907+0000 7fdf05e19700 1 -- 172.21.15.59:0/193066508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf0009e000 msgr2=0x7fdf00130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:59.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.907+0000 7fdf05e19700 1 --2- 172.21.15.59:0/193066508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf0009e000 0x7fdf00130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.907+0000 7fdf05e19700 1 -- 172.21.15.59:0/193066508 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0009b2d0 con 0x7fdf0009d6f0 2023-09-30T22:29:59.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.907+0000 7fdf05e19700 1 --2- 172.21.15.59:0/193066508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf0009d6f0 0x7fdf0009dac0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009920 tx=0x7fdefc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9052a48b82195268 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.907+0000 7fdf04e17700 1 -- 172.21.15.59:0/193066508 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc012b80 con 0x7fdf0009d6f0 2023-09-30T22:29:59.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.908+0000 7fdf04e17700 1 -- 172.21.15.59:0/193066508 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc012ce0 con 0x7fdf0009d6f0 2023-09-30T22:29:59.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.908+0000 7fdf04e17700 1 -- 172.21.15.59:0/193066508 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc01b620 con 0x7fdf0009d6f0 2023-09-30T22:29:59.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.908+0000 7faacf885700 1 -- 172.21.15.59:0/776618237 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac809e000 msgr2=0x7faac8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.908+0000 7faacf885700 1 --2- 172.21.15.59:0/776618237 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac809e000 0x7faac8130660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faab8009950 tx=0x7faab8009c60 comp rx=0 tx=0).stop 2023-09-30T22:29:59.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.909+0000 7faacf885700 1 -- 172.21.15.59:0/776618237 shutdown_connections 2023-09-30T22:29:59.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.909+0000 7faacf885700 1 --2- 172.21.15.59:0/776618237 >> v2:172.21.15.59:3300/0 conn(0x7faac809d6f0 0x7faac809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.909+0000 7fdf0807d700 1 -- 172.21.15.59:0/193066508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf0009d6f0 msgr2=0x7fdf0009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.909+0000 7fdf0807d700 1 --2- 172.21.15.59:0/193066508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf0009d6f0 0x7fdf0009dac0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009920 tx=0x7fdefc009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:59.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.909+0000 7faacf885700 1 --2- 172.21.15.59:0/776618237 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac809e000 0x7faac8130660 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.909+0000 7faacf885700 1 -- 172.21.15.59:0/776618237 >> 172.21.15.59:0/776618237 conn(0x7faac8066f50 msgr2=0x7faac809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:59.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.909+0000 7fdf0807d700 1 -- 172.21.15.59:0/193066508 shutdown_connections 2023-09-30T22:29:59.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.909+0000 7fdf0807d700 1 --2- 172.21.15.59:0/193066508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf0009e410 0x7fdf00130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.909+0000 7fdf0807d700 1 --2- 172.21.15.59:0/193066508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf0009d6f0 0x7fdf0009dac0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.909+0000 7fdf0807d700 1 --2- 172.21.15.59:0/193066508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf0009e000 0x7fdf00130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.909+0000 7fdf0807d700 1 -- 172.21.15.59:0/193066508 >> 172.21.15.59:0/193066508 conn(0x7fdf00066f50 msgr2=0x7fdf0009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.909+0000 7faacf885700 1 -- 172.21.15.59:0/776618237 shutdown_connections 2023-09-30T22:29:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.909+0000 7faacf885700 1 -- 172.21.15.59:0/776618237 wait complete. 2023-09-30T22:29:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.909+0000 7fdf0807d700 1 -- 172.21.15.59:0/193066508 shutdown_connections 2023-09-30T22:29:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.909+0000 7fdf0807d700 1 -- 172.21.15.59:0/193066508 wait complete. 2023-09-30T22:29:59.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.910+0000 7faacf885700 1 Processor -- start 2023-09-30T22:29:59.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.910+0000 7faacf885700 1 -- start start 2023-09-30T22:29:59.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.910+0000 7faacf885700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac809d6f0 0x7faac811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.910+0000 7faacf885700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faac809e000 0x7faac811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.910+0000 7faacf885700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac809e410 0x7faac811ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.910+0000 7faacf885700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac8121aa0 con 0x7faac809d6f0 2023-09-30T22:29:59.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.910+0000 7faacf885700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac81201b0 con 0x7faac809e000 2023-09-30T22:29:59.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.910+0000 7faacf885700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faac809c700 con 0x7faac809e410 2023-09-30T22:29:59.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.911+0000 7faacde22700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac809e410 0x7faac811ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.911+0000 7faacde22700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac809e410 0x7faac811ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59582/0 (socket says 172.21.15.59:59582) 2023-09-30T22:29:59.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.911+0000 7faacde22700 1 -- 172.21.15.59:0/1411523277 learned_addr learned my addr 172.21.15.59:0/1411523277 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:59.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.911+0000 7fdf0807d700 1 Processor -- start 2023-09-30T22:29:59.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.911+0000 7fdf0807d700 1 -- start start 2023-09-30T22:29:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.911+0000 7faacde22700 1 -- 172.21.15.59:0/1411523277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faac809e000 msgr2=0x7faac811e4c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.911+0000 7faacde22700 1 --2- 172.21.15.59:0/1411523277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faac809e000 0x7faac811e4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.911+0000 7faacde22700 1 -- 172.21.15.59:0/1411523277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac809d6f0 msgr2=0x7faac811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.911+0000 7faacde22700 1 --2- 172.21.15.59:0/1411523277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac809d6f0 0x7faac811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.911+0000 7faacde22700 1 -- 172.21.15.59:0/1411523277 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab8009550 con 0x7faac809e410 2023-09-30T22:29:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.911+0000 7faacde22700 1 --2- 172.21.15.59:0/1411523277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac809e410 0x7faac811ea00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faac000cc50 tx=0x7faac000a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.911+0000 7faabdffb700 1 -- 172.21.15.59:0/1411523277 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac000ad80 con 0x7faac809e410 2023-09-30T22:29:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.911+0000 7faabdffb700 1 -- 172.21.15.59:0/1411523277 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac000ce50 con 0x7faac809e410 2023-09-30T22:29:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.911+0000 7faacf885700 1 -- 172.21.15.59:0/1411523277 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac8121230 con 0x7faac809e410 2023-09-30T22:29:59.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.911+0000 7faabdffb700 1 -- 172.21.15.59:0/1411523277 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac0003c40 con 0x7faac809e410 2023-09-30T22:29:59.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7faacf885700 1 -- 172.21.15.59:0/1411523277 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac8120de0 con 0x7faac809e410 2023-09-30T22:29:59.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf0807d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf0009d6f0 0x7fdf0011e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf0807d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf0009e000 0x7fdf0011e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf0807d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf0009e410 0x7fdf0011ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf0807d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0011fd50 con 0x7fdf0009d6f0 2023-09-30T22:29:59.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf0807d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf00121490 con 0x7fdf0009e000 2023-09-30T22:29:59.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf0807d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0009c770 con 0x7fdf0009e410 2023-09-30T22:29:59.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf05e19700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf0009d6f0 0x7fdf0011e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf05e19700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf0009d6f0 0x7fdf0011e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51874/0 (socket says 172.21.15.59:51874) 2023-09-30T22:29:59.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf05e19700 1 -- 172.21.15.59:0/2538244206 learned_addr learned my addr 172.21.15.59:0/2538244206 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:29:59.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf05618700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf0009e000 0x7fdf0011e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf0661a700 1 --2- 172.21.15.59:0/2538244206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf0009e410 0x7fdf0011ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf05618700 1 -- 172.21.15.59:0/2538244206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf0009e410 msgr2=0x7fdf0011ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf05618700 1 --2- 172.21.15.59:0/2538244206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf0009e410 0x7fdf0011ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf05618700 1 -- 172.21.15.59:0/2538244206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf0009d6f0 msgr2=0x7fdf0011e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf05618700 1 --2- 172.21.15.59:0/2538244206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf0009d6f0 0x7fdf0011e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.912+0000 7fdf05618700 1 -- 172.21.15.59:0/2538244206 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc009550 con 0x7fdf0009e000 2023-09-30T22:29:59.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.913+0000 7fdf05618700 1 --2- 172.21.15.59:0/2538244206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf0009e000 0x7fdf0011e680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdef000e8a0 tx=0x7fdef000ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.913+0000 7fdef67fc700 1 -- 172.21.15.59:0/2538244206 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0013680 con 0x7fdf0009e000 2023-09-30T22:29:59.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.913+0000 7fdef67fc700 1 -- 172.21.15.59:0/2538244206 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef00137e0 con 0x7fdf0009e000 2023-09-30T22:29:59.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.913+0000 7fdef67fc700 1 -- 172.21.15.59:0/2538244206 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0013b70 con 0x7fdf0009e000 2023-09-30T22:29:59.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.913+0000 7fdf05e19700 1 --2- 172.21.15.59:0/2538244206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf0009d6f0 0x7fdf0011e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:59.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.913+0000 7faabdffb700 1 -- 172.21.15.59:0/1411523277 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7faac00050d0 con 0x7faac809e410 2023-09-30T22:29:59.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.913+0000 7fdf0807d700 1 -- 172.21.15.59:0/2538244206 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf001219e0 con 0x7fdf0009e000 2023-09-30T22:29:59.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.913+0000 7fdf0807d700 1 -- 172.21.15.59:0/2538244206 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf001216c0 con 0x7fdf0009e000 2023-09-30T22:29:59.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.913+0000 7faacf885700 1 -- 172.21.15.59:0/1411523277 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac8074ea0 con 0x7faac809e410 2023-09-30T22:29:59.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.914+0000 7faabdffb700 1 -- 172.21.15.59:0/1411523277 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7faac0005380 con 0x7faac809e410 2023-09-30T22:29:59.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.914+0000 7faacd621700 1 -- 172.21.15.59:0/1411523277 >> v1:172.21.15.59:6816/126772 conn(0x7faaac02f510 legacy=0x7faaac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:59.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.914+0000 7fdef67fc700 1 -- 172.21.15.59:0/2538244206 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fdef0013cd0 con 0x7fdf0009e000 2023-09-30T22:29:59.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.914+0000 7fdef67fc700 1 -- 172.21.15.59:0/2538244206 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fdef003fbf0 con 0x7fdf0009e000 2023-09-30T22:29:59.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.914+0000 7fdf05e19700 1 -- 172.21.15.59:0/2538244206 >> v1:172.21.15.59:6816/126772 conn(0x7fdee402f510 legacy=0x7fdee40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:29:59.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.915+0000 7fdf0807d700 1 -- 172.21.15.59:0/2538244206 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee80052e0 con 0x7fdf0009e000 2023-09-30T22:29:59.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.920+0000 7fdef67fc700 1 -- 172.21.15.59:0/2538244206 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdef0021080 con 0x7fdf0009e000 2023-09-30T22:29:59.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.923+0000 7faabdffb700 1 -- 172.21.15.59:0/1411523277 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faac0045060 con 0x7faac809e410 2023-09-30T22:29:59.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:29:59.988+0000 7f3ccbfff700 1 -- 172.21.15.59:0/3284179348 >> v1:172.21.15.59:6816/126772 conn(0x7f3cb802f510 legacy=0x7f3cb80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:00.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.029+0000 7f746a7fc700 1 -- 172.21.15.59:0/3643772979 >> v1:172.21.15.59:6816/126772 conn(0x7f745802f540 legacy=0x7f74580319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:00.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.053+0000 7f3cd26bd700 1 -- 172.21.15.59:0/3284179348 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3ccc11ec80 con 0x7f3ccc1341d0 2023-09-30T22:30:00.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.054+0000 7f747189a700 1 -- 172.21.15.59:0/3643772979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f746c1277f0 con 0x7f746c06a770 2023-09-30T22:30:00.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.054+0000 7f3cc8ff9700 1 -- 172.21.15.59:0/3284179348 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ccc11ec80 con 0x7f3ccc1341d0 2023-09-30T22:30:00.056 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:00.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.054+0000 7f7453fff700 1 -- 172.21.15.59:0/3643772979 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f746c1277f0 con 0x7f746c06a770 2023-09-30T22:30:00.056 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:00.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.057+0000 7f3cd26bd700 1 -- 172.21.15.59:0/3284179348 >> v1:172.21.15.59:6816/126772 conn(0x7f3cb802f510 legacy=0x7f3cb80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:00.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.057+0000 7f3cd26bd700 1 -- 172.21.15.59:0/3284179348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ccc1341d0 msgr2=0x7f3ccc11bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:00.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.057+0000 7f3cd26bd700 1 --2- 172.21.15.59:0/3284179348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ccc1341d0 0x7f3ccc11bf60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc06fe20 tx=0x7f3cc4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.057+0000 7f747189a700 1 -- 172.21.15.59:0/3643772979 >> v1:172.21.15.59:6816/126772 conn(0x7f745802f540 legacy=0x7f74580319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:00.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.057+0000 7f747189a700 1 -- 172.21.15.59:0/3643772979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c06a770 msgr2=0x7f746c126c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:00.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.057+0000 7f747189a700 1 --2- 172.21.15.59:0/3643772979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c06a770 0x7f746c126c50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f745c00e9b0 tx=0x7f745c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.057+0000 7f3cd26bd700 1 -- 172.21.15.59:0/3284179348 shutdown_connections 2023-09-30T22:30:00.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.057+0000 7f3cd26bd700 1 --2- 172.21.15.59:0/3284179348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ccc09e560 0x7f3ccc11b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.057+0000 7f3cd26bd700 1 --2- 172.21.15.59:0/3284179348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ccc1341d0 0x7f3ccc11bf60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.057+0000 7f3cd26bd700 1 --2- 172.21.15.59:0/3284179348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ccc1338c0 0x7f3ccc11ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.057+0000 7f3cd26bd700 1 -- 172.21.15.59:0/3284179348 >> 172.21.15.59:0/3284179348 conn(0x7f3ccc0a2aa0 msgr2=0x7f3ccc0a1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:00.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.057+0000 7f3cd26bd700 1 -- 172.21.15.59:0/3284179348 shutdown_connections 2023-09-30T22:30:00.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.057+0000 7f3cd26bd700 1 -- 172.21.15.59:0/3284179348 wait complete. 2023-09-30T22:30:00.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.058+0000 7f747189a700 1 -- 172.21.15.59:0/3643772979 shutdown_connections 2023-09-30T22:30:00.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.058+0000 7f747189a700 1 --2- 172.21.15.59:0/3643772979 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746c13c1e0 0x7f746c1cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.058+0000 7f747189a700 1 --2- 172.21.15.59:0/3643772979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c06a770 0x7f746c126c50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.058+0000 7f747189a700 1 --2- 172.21.15.59:0/3643772979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f746c09dc30 0x7f746c127190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.058+0000 7f747189a700 1 -- 172.21.15.59:0/3643772979 >> 172.21.15.59:0/3643772979 conn(0x7f746c066f50 msgr2=0x7f746c13b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:00.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.058+0000 7f747189a700 1 -- 172.21.15.59:0/3643772979 shutdown_connections 2023-09-30T22:30:00.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.058+0000 7f747189a700 1 -- 172.21.15.59:0/3643772979 wait complete. 2023-09-30T22:30:00.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:00.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:00.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.115+0000 7fdf05e19700 1 -- 172.21.15.59:0/2538244206 >> v1:172.21.15.59:6816/126772 conn(0x7fdee402f510 legacy=0x7fdee40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:00.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.115+0000 7faacd621700 1 -- 172.21.15.59:0/1411523277 >> v1:172.21.15.59:6816/126772 conn(0x7faaac02f510 legacy=0x7faaac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:00.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.186+0000 7fdf0807d700 1 -- 172.21.15.59:0/2538244206 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdee8005860 con 0x7fdf0009e000 2023-09-30T22:30:00.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.186+0000 7fdef67fc700 1 -- 172.21.15.59:0/2538244206 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdef0017020 con 0x7fdf0009e000 2023-09-30T22:30:00.187 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:00.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.188+0000 7fdf0807d700 1 -- 172.21.15.59:0/2538244206 >> v1:172.21.15.59:6816/126772 conn(0x7fdee402f510 legacy=0x7fdee40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:00.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.188+0000 7fdf0807d700 1 -- 172.21.15.59:0/2538244206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf0009e000 msgr2=0x7fdf0011e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:00.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.188+0000 7fdf0807d700 1 --2- 172.21.15.59:0/2538244206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf0009e000 0x7fdf0011e680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdef000e8a0 tx=0x7fdef000ebb0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.188+0000 7fdf0807d700 1 -- 172.21.15.59:0/2538244206 shutdown_connections 2023-09-30T22:30:00.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.188+0000 7fdf0807d700 1 --2- 172.21.15.59:0/2538244206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf0009e410 0x7fdf0011ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.188+0000 7fdf0807d700 1 --2- 172.21.15.59:0/2538244206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf0009d6f0 0x7fdf0011e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.188+0000 7fdf0807d700 1 --2- 172.21.15.59:0/2538244206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf0009e000 0x7fdf0011e680 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.188+0000 7fdf0807d700 1 -- 172.21.15.59:0/2538244206 >> 172.21.15.59:0/2538244206 conn(0x7fdf00066f50 msgr2=0x7fdf00071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.189+0000 7fdf0807d700 1 -- 172.21.15.59:0/2538244206 shutdown_connections 2023-09-30T22:30:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.189+0000 7fdf0807d700 1 -- 172.21.15.59:0/2538244206 wait complete. 2023-09-30T22:30:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.192+0000 7faacf885700 1 -- 172.21.15.59:0/1411523277 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faac806c360 con 0x7faac809e410 2023-09-30T22:30:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.192+0000 7faabdffb700 1 -- 172.21.15.59:0/1411523277 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faac00198f0 con 0x7faac809e410 2023-09-30T22:30:00.193 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.195+0000 7faacf885700 1 -- 172.21.15.59:0/1411523277 >> v1:172.21.15.59:6816/126772 conn(0x7faaac02f510 legacy=0x7faaac0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.195+0000 7faacf885700 1 -- 172.21.15.59:0/1411523277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac809e410 msgr2=0x7faac811ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.195+0000 7faacf885700 1 --2- 172.21.15.59:0/1411523277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac809e410 0x7faac811ea00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faac000cc50 tx=0x7faac000a340 comp rx=0 tx=0).stop 2023-09-30T22:30:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.195+0000 7faacf885700 1 -- 172.21.15.59:0/1411523277 shutdown_connections 2023-09-30T22:30:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.195+0000 7faacf885700 1 --2- 172.21.15.59:0/1411523277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac809e410 0x7faac811ea00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.195+0000 7faacf885700 1 --2- 172.21.15.59:0/1411523277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac809d6f0 0x7faac811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.195+0000 7faacf885700 1 --2- 172.21.15.59:0/1411523277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faac809e000 0x7faac811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.195+0000 7faacf885700 1 -- 172.21.15.59:0/1411523277 >> 172.21.15.59:0/1411523277 conn(0x7faac8066f50 msgr2=0x7faac80710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.195+0000 7faacf885700 1 -- 172.21.15.59:0/1411523277 shutdown_connections 2023-09-30T22:30:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:00.195+0000 7faacf885700 1 -- 172.21.15.59:0/1411523277 wait complete. 2023-09-30T22:30:00.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:00.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:01.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:01.076 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:01.205 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:01.211 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:01.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.224+0000 7f3be3ea5700 1 Processor -- start 2023-09-30T22:30:01.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.224+0000 7f3be3ea5700 1 -- start start 2023-09-30T22:30:01.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.225+0000 7f3be3ea5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3bdc131810 0x7f3bdc131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.225+0000 7f3be3ea5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bdc099a40 0x7f3bdc099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.225+0000 7f3be3ea5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bdc09a3b0 0x7f3bdc138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.225+0000 7f3be3ea5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bdc1313c0 con 0x7f3bdc131810 2023-09-30T22:30:01.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.225+0000 7f3be3ea5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc06e8c0 con 0x7f3bdc09a3b0 2023-09-30T22:30:01.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.225+0000 7f3be3ea5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc071d20 con 0x7f3bdc099a40 2023-09-30T22:30:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.225+0000 7f3be1440700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bdc099a40 0x7f3bdc099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.225+0000 7f3be1c41700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3bdc131810 0x7f3bdc131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.225+0000 7f3be2442700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bdc09a3b0 0x7f3bdc138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.225+0000 7f3be1c41700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3bdc131810 0x7f3bdc131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51882/0 (socket says 172.21.15.59:51882) 2023-09-30T22:30:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.225+0000 7f3be1440700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bdc099a40 0x7f3bdc099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59600/0 (socket says 172.21.15.59:59600) 2023-09-30T22:30:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.225+0000 7f3be1c41700 1 -- 172.21.15.59:0/2692813618 learned_addr learned my addr 172.21.15.59:0/2692813618 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.225+0000 7f3be2442700 1 -- 172.21.15.59:0/2692813618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bdc099a40 msgr2=0x7f3bdc099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.225+0000 7f3be2442700 1 --2- 172.21.15.59:0/2692813618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bdc099a40 0x7f3bdc099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.226+0000 7f3be2442700 1 -- 172.21.15.59:0/2692813618 >> v2:172.21.15.59:3300/0 conn(0x7f3bdc131810 msgr2=0x7f3bdc131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.226+0000 7f3be2442700 1 --2- 172.21.15.59:0/2692813618 >> v2:172.21.15.59:3300/0 conn(0x7f3bdc131810 0x7f3bdc131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.226+0000 7f3be2442700 1 -- 172.21.15.59:0/2692813618 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc0721a0 con 0x7f3bdc09a3b0 2023-09-30T22:30:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.226+0000 7f3be1c41700 1 --2- 172.21.15.59:0/2692813618 >> v2:172.21.15.59:3300/0 conn(0x7f3bdc131810 0x7f3bdc131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.226+0000 7f3be2442700 1 --2- 172.21.15.59:0/2692813618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bdc09a3b0 0x7f3bdc138650 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009d90 tx=0x7f3bd400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d8d8a6d18c07c88 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.226+0000 7f3be0c3f700 1 -- 172.21.15.59:0/2692813618 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd400e070 con 0x7f3bdc09a3b0 2023-09-30T22:30:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.226+0000 7f3be0c3f700 1 -- 172.21.15.59:0/2692813618 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd400bb20 con 0x7f3bdc09a3b0 2023-09-30T22:30:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.226+0000 7f3be0c3f700 1 -- 172.21.15.59:0/2692813618 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4012430 con 0x7f3bdc09a3b0 2023-09-30T22:30:01.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.226+0000 7fbc2d4a2700 1 Processor -- start 2023-09-30T22:30:01.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.226+0000 7fbc2d4a2700 1 -- start start 2023-09-30T22:30:01.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.226+0000 7fbc2d4a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc2806a770 0x7fbc2809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7fbc2d4a2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbc2813d1f0 0x7fbc2813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7fbc2d4a2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2809a810 con 0x7fbc2809dc30 2023-09-30T22:30:01.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7fbc2d4a2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2806ab40 con 0x7fbc2813d1f0 2023-09-30T22:30:01.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7fbc2d4a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2809ebc0 con 0x7fbc2806a770 2023-09-30T22:30:01.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7fbc277fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbc2813d1f0 0x7fbc2813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7fbc277fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbc2813d1f0 0x7fbc2813f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51886/0 (socket says 172.21.15.59:51886) 2023-09-30T22:30:01.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7fbc277fe700 1 -- 172.21.15.59:0/1524720264 learned_addr learned my addr 172.21.15.59:0/1524720264 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:01.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7fbc26ffd700 1 --2- 172.21.15.59:0/1524720264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc2806a770 0x7fbc2809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7fbc277fe700 1 -- 172.21.15.59:0/1524720264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc2806a770 msgr2=0x7fbc2809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:01.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7fbc277fe700 1 --2- 172.21.15.59:0/1524720264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc2806a770 0x7fbc2809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7fbc277fe700 1 -- 172.21.15.59:0/1524720264 >> v1:172.21.15.59:6789/0 conn(0x7fbc2809dc30 legacy=0x7fbc2809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:01.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7f3be3ea5700 1 -- 172.21.15.59:0/2692813618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bdc09a3b0 msgr2=0x7f3bdc138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7f3be3ea5700 1 --2- 172.21.15.59:0/2692813618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bdc09a3b0 0x7f3bdc138650 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009d90 tx=0x7f3bd400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:01.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7fbc277fe700 1 -- 172.21.15.59:0/1524720264 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2809e920 con 0x7fbc2813d1f0 2023-09-30T22:30:01.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7f3be3ea5700 1 -- 172.21.15.59:0/2692813618 shutdown_connections 2023-09-30T22:30:01.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7f3be3ea5700 1 --2- 172.21.15.59:0/2692813618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bdc09a3b0 0x7f3bdc138650 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7f3be3ea5700 1 --2- 172.21.15.59:0/2692813618 >> v2:172.21.15.59:3300/0 conn(0x7f3bdc131810 0x7f3bdc131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7f3be3ea5700 1 --2- 172.21.15.59:0/2692813618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bdc099a40 0x7f3bdc099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7f3be3ea5700 1 -- 172.21.15.59:0/2692813618 >> 172.21.15.59:0/2692813618 conn(0x7f3bdc0a2aa0 msgr2=0x7f3bdc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:01.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.227+0000 7fbc277fe700 1 --2- 172.21.15.59:0/1524720264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2813d1f0 0x7fbc2813f5d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc20009e80 tx=0x7fbc2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85056a30b8e9d782 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:01.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.228+0000 7f3be3ea5700 1 -- 172.21.15.59:0/2692813618 shutdown_connections 2023-09-30T22:30:01.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.228+0000 7f3be3ea5700 1 -- 172.21.15.59:0/2692813618 wait complete. 2023-09-30T22:30:01.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.228+0000 7fbc25ffb700 1 -- 172.21.15.59:0/1524720264 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000e070 con 0x7fbc2813d1f0 2023-09-30T22:30:01.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.228+0000 7fbc25ffb700 1 -- 172.21.15.59:0/1524720264 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2000b980 con 0x7fbc2813d1f0 2023-09-30T22:30:01.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.228+0000 7fbc25ffb700 1 -- 172.21.15.59:0/1524720264 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000bd30 con 0x7fbc2813d1f0 2023-09-30T22:30:01.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.228+0000 7fbc2d4a2700 1 -- 172.21.15.59:0/1524720264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2813d1f0 msgr2=0x7fbc2813f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.228+0000 7fbc2d4a2700 1 --2- 172.21.15.59:0/1524720264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2813d1f0 0x7fbc2813f5d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc20009e80 tx=0x7fbc2000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.229+0000 7fbc2d4a2700 1 -- 172.21.15.59:0/1524720264 shutdown_connections 2023-09-30T22:30:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.229+0000 7fbc2d4a2700 1 --2- 172.21.15.59:0/1524720264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2813d1f0 0x7fbc2813f5d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.229+0000 7fbc2d4a2700 1 --2- 172.21.15.59:0/1524720264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc2806a770 0x7fbc2809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.229+0000 7fbc2d4a2700 1 -- 172.21.15.59:0/1524720264 >> 172.21.15.59:0/1524720264 conn(0x7fbc28066f50 msgr2=0x7fbc2809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.229+0000 7f3be3ea5700 1 Processor -- start 2023-09-30T22:30:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.229+0000 7fbc2d4a2700 1 -- 172.21.15.59:0/1524720264 shutdown_connections 2023-09-30T22:30:01.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.229+0000 7f3be3ea5700 1 -- start start 2023-09-30T22:30:01.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.230+0000 7f3be3ea5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bdc099a40 0x7f3bdc11b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.230+0000 7f3be3ea5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bdc09a3b0 0x7f3bdc11bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.230+0000 7f3be3ea5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bdc131810 0x7f3bdc11c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.230+0000 7f3be3ea5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0a1ad0 con 0x7f3bdc131810 2023-09-30T22:30:01.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.230+0000 7f3be3ea5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc11ec80 con 0x7f3bdc099a40 2023-09-30T22:30:01.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.230+0000 7f3be3ea5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc11e1b0 con 0x7f3bdc09a3b0 2023-09-30T22:30:01.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.230+0000 7fbc2d4a2700 1 -- 172.21.15.59:0/1524720264 wait complete. 2023-09-30T22:30:01.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.230+0000 7f3be2442700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bdc131810 0x7f3bdc11c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.230+0000 7f3be2442700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bdc131810 0x7f3bdc11c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51894/0 (socket says 172.21.15.59:51894) 2023-09-30T22:30:01.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.230+0000 7f3be2442700 1 -- 172.21.15.59:0/1994695529 learned_addr learned my addr 172.21.15.59:0/1994695529 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:01.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.231+0000 7f3be2442700 1 -- 172.21.15.59:0/1994695529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bdc09a3b0 msgr2=0x7f3bdc11bd10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:01.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.231+0000 7f3be2442700 1 --2- 172.21.15.59:0/1994695529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bdc09a3b0 0x7f3bdc11bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.231+0000 7f3be2442700 1 -- 172.21.15.59:0/1994695529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bdc099a40 msgr2=0x7f3bdc11b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.231+0000 7f3be2442700 1 --2- 172.21.15.59:0/1994695529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bdc099a40 0x7f3bdc11b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.231+0000 7f3be2442700 1 -- 172.21.15.59:0/1994695529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd8009550 con 0x7f3bdc131810 2023-09-30T22:30:01.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.231+0000 7f3be2442700 1 --2- 172.21.15.59:0/1994695529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bdc131810 0x7f3bdc11c250 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4014040 tx=0x7f3bd4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:01.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.231+0000 7f3bd27fc700 1 -- 172.21.15.59:0/1994695529 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4012430 con 0x7f3bdc131810 2023-09-30T22:30:01.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.231+0000 7f3bd27fc700 1 -- 172.21.15.59:0/1994695529 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd4020070 con 0x7f3bdc131810 2023-09-30T22:30:01.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.231+0000 7f3bd27fc700 1 -- 172.21.15.59:0/1994695529 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4003ea0 con 0x7f3bdc131810 2023-09-30T22:30:01.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.231+0000 7f3be3ea5700 1 -- 172.21.15.59:0/1994695529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd4009a70 con 0x7f3bdc131810 2023-09-30T22:30:01.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.231+0000 7f3be3ea5700 1 -- 172.21.15.59:0/1994695529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bdc11d480 con 0x7f3bdc131810 2023-09-30T22:30:01.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.231+0000 7fbc2d4a2700 1 Processor -- start 2023-09-30T22:30:01.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.232+0000 7fbc2d4a2700 1 -- start start 2023-09-30T22:30:01.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.232+0000 7fbc2d4a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc2806a770 0x7fbc28070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.232+0000 7fbc2d4a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc2809dc30 0x7fbc28071130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.232+0000 7fbc2d4a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2813d1f0 0x7fbc28071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.232+0000 7fbc2d4a2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2806fe10 con 0x7fbc2813d1f0 2023-09-30T22:30:01.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.232+0000 7fbc2d4a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc28072710 con 0x7fbc2809dc30 2023-09-30T22:30:01.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.232+0000 7fbc2d4a2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2806ed70 con 0x7fbc2806a770 2023-09-30T22:30:01.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.232+0000 7fbc277fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2813d1f0 0x7fbc28071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.232+0000 7fbc277fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2813d1f0 0x7fbc28071670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51900/0 (socket says 172.21.15.59:51900) 2023-09-30T22:30:01.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.232+0000 7fbc277fe700 1 -- 172.21.15.59:0/1104122146 learned_addr learned my addr 172.21.15.59:0/1104122146 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:01.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.233+0000 7fbc26ffd700 1 --2- 172.21.15.59:0/1104122146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc2806a770 0x7fbc28070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.233+0000 7fbc277fe700 1 -- 172.21.15.59:0/1104122146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc2806a770 msgr2=0x7fbc28070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.233+0000 7fbc277fe700 1 --2- 172.21.15.59:0/1104122146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc2806a770 0x7fbc28070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.233+0000 7fbc277fe700 1 -- 172.21.15.59:0/1104122146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc2809dc30 msgr2=0x7fbc28071130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:01.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.233+0000 7fbc277fe700 1 --2- 172.21.15.59:0/1104122146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc2809dc30 0x7fbc28071130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.233+0000 7fbc277fe700 1 -- 172.21.15.59:0/1104122146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc20009b30 con 0x7fbc2813d1f0 2023-09-30T22:30:01.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.233+0000 7fbc26ffd700 1 --2- 172.21.15.59:0/1104122146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc2806a770 0x7fbc28070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:01.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.233+0000 7fbc277fe700 1 --2- 172.21.15.59:0/1104122146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2813d1f0 0x7fbc28071670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbc20012000 tx=0x7fbc20004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:01.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.233+0000 7fbc0f7fe700 1 -- 172.21.15.59:0/1104122146 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc200092e0 con 0x7fbc2813d1f0 2023-09-30T22:30:01.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.233+0000 7fbc0f7fe700 1 -- 172.21.15.59:0/1104122146 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc20004960 con 0x7fbc2813d1f0 2023-09-30T22:30:01.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.233+0000 7fbc2d4a2700 1 -- 172.21.15.59:0/1104122146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2806f280 con 0x7fbc2813d1f0 2023-09-30T22:30:01.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.233+0000 7fbc0f7fe700 1 -- 172.21.15.59:0/1104122146 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2001c680 con 0x7fbc2813d1f0 2023-09-30T22:30:01.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.233+0000 7fbc2d4a2700 1 -- 172.21.15.59:0/1104122146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2806fad0 con 0x7fbc2813d1f0 2023-09-30T22:30:01.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.234+0000 7f3bd27fc700 1 -- 172.21.15.59:0/1994695529 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3bd4004280 con 0x7f3bdc131810 2023-09-30T22:30:01.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.234+0000 7f3bd27fc700 1 -- 172.21.15.59:0/1994695529 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f3bd4022070 con 0x7f3bdc131810 2023-09-30T22:30:01.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.234+0000 7f3be1c41700 1 -- 172.21.15.59:0/1994695529 >> v1:172.21.15.59:6816/126772 conn(0x7f3bc002f510 legacy=0x7f3bc00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:01.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.235+0000 7f3be3ea5700 1 -- 172.21.15.59:0/1994695529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bdc06ed10 con 0x7f3bdc131810 2023-09-30T22:30:01.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.234+0000 7fbc0f7fe700 1 -- 172.21.15.59:0/1104122146 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbc2001c7e0 con 0x7fbc2813d1f0 2023-09-30T22:30:01.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.234+0000 7fbc0f7fe700 1 -- 172.21.15.59:0/1104122146 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fbc200414f0 con 0x7fbc2813d1f0 2023-09-30T22:30:01.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.235+0000 7fbc26ffd700 1 -- 172.21.15.59:0/1104122146 >> v1:172.21.15.59:6816/126772 conn(0x7fbc1402f540 legacy=0x7fbc140319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:01.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.235+0000 7fbc2d4a2700 1 -- 172.21.15.59:0/1104122146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc080052e0 con 0x7fbc2813d1f0 2023-09-30T22:30:01.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.242+0000 7f3bd27fc700 1 -- 172.21.15.59:0/1994695529 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bd402c080 con 0x7f3bdc131810 2023-09-30T22:30:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.247+0000 7fbc0f7fe700 1 -- 172.21.15.59:0/1104122146 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc20024980 con 0x7fbc2813d1f0 2023-09-30T22:30:01.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.367+0000 7fca47b69700 1 Processor -- start 2023-09-30T22:30:01.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.368+0000 7fca47b69700 1 -- start start 2023-09-30T22:30:01.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.368+0000 7fca47b69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca40130750 0x7fca40130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.368+0000 7fca47b69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca4009e250 0x7fca401384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.368+0000 7fca47b69700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4009c190 con 0x7fca4009d6f0 2023-09-30T22:30:01.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.368+0000 7fca47b69700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4009b090 con 0x7fca4009e250 2023-09-30T22:30:01.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.368+0000 7fca47b69700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca4009a6c0 con 0x7fca40130750 2023-09-30T22:30:01.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.368+0000 7fca46106700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca4009e250 0x7fca401384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.368+0000 7fca45905700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca40130750 0x7fca40130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.368+0000 7fca46106700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca4009e250 0x7fca401384c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50430/0 (socket says 172.21.15.59:50430) 2023-09-30T22:30:01.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.369+0000 7fca45905700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca40130750 0x7fca40130b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59630/0 (socket says 172.21.15.59:59630) 2023-09-30T22:30:01.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.369+0000 7fca46106700 1 -- 172.21.15.59:0/968851505 learned_addr learned my addr 172.21.15.59:0/968851505 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:01.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.369+0000 7fca46106700 1 -- 172.21.15.59:0/968851505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca40130750 msgr2=0x7fca40130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:01.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.369+0000 7fca46106700 1 --2- 172.21.15.59:0/968851505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca40130750 0x7fca40130b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.369+0000 7fca46106700 1 -- 172.21.15.59:0/968851505 >> v1:172.21.15.59:6789/0 conn(0x7fca4009d6f0 legacy=0x7fca4009db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.369+0000 7fca46106700 1 -- 172.21.15.59:0/968851505 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca40131060 con 0x7fca4009e250 2023-09-30T22:30:01.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.369+0000 7fca44903700 1 -- 172.21.15.59:0/968851505 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898041640 0 0) 0x7fca4009c190 con 0x7fca4009d6f0 2023-09-30T22:30:01.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.369+0000 7fca46106700 1 --2- 172.21.15.59:0/968851505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca4009e250 0x7fca401384c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fca38009e80 tx=0x7fca3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8791fcad64822942 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:01.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.369+0000 7fca44903700 1 -- 172.21.15.59:0/968851505 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3800e070 con 0x7fca4009e250 2023-09-30T22:30:01.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.369+0000 7fca44903700 1 -- 172.21.15.59:0/968851505 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3800b910 con 0x7fca4009e250 2023-09-30T22:30:01.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.369+0000 7fca44903700 1 -- 172.21.15.59:0/968851505 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3800bcc0 con 0x7fca4009e250 2023-09-30T22:30:01.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.370+0000 7fca47b69700 1 -- 172.21.15.59:0/968851505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca4009e250 msgr2=0x7fca401384c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.370+0000 7fca47b69700 1 --2- 172.21.15.59:0/968851505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca4009e250 0x7fca401384c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fca38009e80 tx=0x7fca3800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:01.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.370+0000 7fca47b69700 1 -- 172.21.15.59:0/968851505 shutdown_connections 2023-09-30T22:30:01.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.370+0000 7fca47b69700 1 --2- 172.21.15.59:0/968851505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca40130750 0x7fca40130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.370+0000 7fca47b69700 1 --2- 172.21.15.59:0/968851505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca4009e250 0x7fca401384c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.370+0000 7fca47b69700 1 -- 172.21.15.59:0/968851505 >> 172.21.15.59:0/968851505 conn(0x7fca4009f470 msgr2=0x7fca400a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:01.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.370+0000 7fca47b69700 1 -- 172.21.15.59:0/968851505 shutdown_connections 2023-09-30T22:30:01.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.370+0000 7fca47b69700 1 -- 172.21.15.59:0/968851505 wait complete. 2023-09-30T22:30:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.372+0000 7fca47b69700 1 Processor -- start 2023-09-30T22:30:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.372+0000 7fca47b69700 1 -- start start 2023-09-30T22:30:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca47b69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca4009d6f0 0x7fca40097a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca47b69700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4009e250 0x7fca40097f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca47b69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca40130750 0x7fca40098490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca47b69700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4008c490 con 0x7fca4009e250 2023-09-30T22:30:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca47b69700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4009b2b0 con 0x7fca4009d6f0 2023-09-30T22:30:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca47b69700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca4013a3a0 con 0x7fca40130750 2023-09-30T22:30:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca45905700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca4009d6f0 0x7fca40097a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca45905700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca4009d6f0 0x7fca40097a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50434/0 (socket says 172.21.15.59:50434) 2023-09-30T22:30:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca45905700 1 -- 172.21.15.59:0/3804908650 learned_addr learned my addr 172.21.15.59:0/3804908650 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca45104700 1 --2- 172.21.15.59:0/3804908650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4009e250 0x7fca40097f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca46106700 1 --2- 172.21.15.59:0/3804908650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca40130750 0x7fca40098490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca45905700 1 -- 172.21.15.59:0/3804908650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca40130750 msgr2=0x7fca40098490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca45905700 1 --2- 172.21.15.59:0/3804908650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca40130750 0x7fca40098490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca45905700 1 -- 172.21.15.59:0/3804908650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4009e250 msgr2=0x7fca40097f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca45905700 1 --2- 172.21.15.59:0/3804908650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4009e250 0x7fca40097f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca45905700 1 -- 172.21.15.59:0/3804908650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca38009b30 con 0x7fca4009d6f0 2023-09-30T22:30:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.373+0000 7fca45905700 1 --2- 172.21.15.59:0/3804908650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca4009d6f0 0x7fca40097a10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00e9e0 tx=0x7fca3c00ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.374+0000 7fca367fc700 1 -- 172.21.15.59:0/3804908650 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c009710 con 0x7fca4009d6f0 2023-09-30T22:30:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.374+0000 7fca367fc700 1 -- 172.21.15.59:0/3804908650 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c00ee80 con 0x7fca4009d6f0 2023-09-30T22:30:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.374+0000 7fca47b69700 1 -- 172.21.15.59:0/3804908650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4008fe40 con 0x7fca4009d6f0 2023-09-30T22:30:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.374+0000 7fca367fc700 1 -- 172.21.15.59:0/3804908650 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c00ca50 con 0x7fca4009d6f0 2023-09-30T22:30:01.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.374+0000 7fca47b69700 1 -- 172.21.15.59:0/3804908650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca40139f00 con 0x7fca4009d6f0 2023-09-30T22:30:01.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.375+0000 7fca367fc700 1 -- 172.21.15.59:0/3804908650 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fca3c00cbb0 con 0x7fca4009d6f0 2023-09-30T22:30:01.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.375+0000 7fca47b69700 1 -- 172.21.15.59:0/3804908650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca400747f0 con 0x7fca4009d6f0 2023-09-30T22:30:01.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.375+0000 7fca367fc700 1 -- 172.21.15.59:0/3804908650 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fca3c03fc50 con 0x7fca4009d6f0 2023-09-30T22:30:01.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.375+0000 7fca45104700 1 -- 172.21.15.59:0/3804908650 >> v1:172.21.15.59:6816/126772 conn(0x7fca2402f510 legacy=0x7fca240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:01.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.380+0000 7fca367fc700 1 -- 172.21.15.59:0/3804908650 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca3c01be10 con 0x7fca4009d6f0 2023-09-30T22:30:01.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.407+0000 7f065fe90700 1 Processor -- start 2023-09-30T22:30:01.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.407+0000 7f065fe90700 1 -- start start 2023-09-30T22:30:01.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.408+0000 7f065fe90700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06580a0a30 0x7f06580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.408+0000 7f065fe90700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f065809d630 0x7f06580a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.408+0000 7f065fe90700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06580a2a70 con 0x7f0658133930 2023-09-30T22:30:01.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.408+0000 7f065fe90700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06580a01d0 con 0x7f06580a0a30 2023-09-30T22:30:01.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.408+0000 7f065fe90700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065809e2b0 con 0x7f065809d630 2023-09-30T22:30:01.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.408+0000 7f065dc2c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06580a0a30 0x7f06580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.408+0000 7f065dc2c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06580a0a30 0x7f06580a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51930/0 (socket says 172.21.15.59:51930) 2023-09-30T22:30:01.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.408+0000 7f065dc2c700 1 -- 172.21.15.59:0/963154646 learned_addr learned my addr 172.21.15.59:0/963154646 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:01.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.408+0000 7f065d42b700 1 --2- 172.21.15.59:0/963154646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f065809d630 0x7f06580a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.408+0000 7f065dc2c700 1 -- 172.21.15.59:0/963154646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f065809d630 msgr2=0x7f06580a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:01.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.408+0000 7f065dc2c700 1 --2- 172.21.15.59:0/963154646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f065809d630 0x7f06580a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.408+0000 7f065cc2a700 1 -- 172.21.15.59:0/963154646 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580697695 0 0) 0x7f06580a2a70 con 0x7f0658133930 2023-09-30T22:30:01.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.408+0000 7f065dc2c700 1 -- 172.21.15.59:0/963154646 >> v1:172.21.15.59:6789/0 conn(0x7f0658133930 legacy=0x7f0658133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.408+0000 7f065dc2c700 1 -- 172.21.15.59:0/963154646 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065809dc50 con 0x7f06580a0a30 2023-09-30T22:30:01.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.408+0000 7f065d42b700 1 --2- 172.21.15.59:0/963154646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f065809d630 0x7f06580a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:01.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.409+0000 7f065dc2c700 1 --2- 172.21.15.59:0/963154646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06580a0a30 0x7f06580a0e00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f06540098f0 tx=0x7f0654009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf3d1418292e78 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:01.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.409+0000 7f065cc2a700 1 -- 172.21.15.59:0/963154646 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654011830 con 0x7f06580a0a30 2023-09-30T22:30:01.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.409+0000 7f065cc2a700 1 -- 172.21.15.59:0/963154646 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0654011990 con 0x7f06580a0a30 2023-09-30T22:30:01.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.409+0000 7f065cc2a700 1 -- 172.21.15.59:0/963154646 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654011d20 con 0x7f06580a0a30 2023-09-30T22:30:01.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.410+0000 7f065fe90700 1 -- 172.21.15.59:0/963154646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06580a0a30 msgr2=0x7f06580a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.410+0000 7f065fe90700 1 --2- 172.21.15.59:0/963154646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06580a0a30 0x7f06580a0e00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f06540098f0 tx=0x7f0654009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:01.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.410+0000 7f065fe90700 1 -- 172.21.15.59:0/963154646 shutdown_connections 2023-09-30T22:30:01.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.410+0000 7f065fe90700 1 --2- 172.21.15.59:0/963154646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06580a0a30 0x7f06580a0e00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.410+0000 7f065fe90700 1 --2- 172.21.15.59:0/963154646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f065809d630 0x7f06580a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.410+0000 7f065fe90700 1 -- 172.21.15.59:0/963154646 >> 172.21.15.59:0/963154646 conn(0x7f06580a3050 msgr2=0x7f06580a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:01.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.410+0000 7f065fe90700 1 -- 172.21.15.59:0/963154646 shutdown_connections 2023-09-30T22:30:01.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.410+0000 7f065fe90700 1 -- 172.21.15.59:0/963154646 wait complete. 2023-09-30T22:30:01.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.411+0000 7f065fe90700 1 Processor -- start 2023-09-30T22:30:01.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.411+0000 7f065fe90700 1 -- start start 2023-09-30T22:30:01.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.411+0000 7f065fe90700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f065809d630 0x7f06581c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.411+0000 7f065fe90700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06580a0a30 0x7f06581c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.411+0000 7f065fe90700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0658133930 0x7f06581c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.411+0000 7f065fe90700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0658133530 con 0x7f0658133930 2023-09-30T22:30:01.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.411+0000 7f065fe90700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0658121f20 con 0x7f065809d630 2023-09-30T22:30:01.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.411+0000 7f065fe90700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0658120730 con 0x7f06580a0a30 2023-09-30T22:30:01.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.412+0000 7f065e42d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0658133930 0x7f06581c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.412+0000 7f065e42d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0658133930 0x7f06581c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51946/0 (socket says 172.21.15.59:51946) 2023-09-30T22:30:01.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.412+0000 7f065e42d700 1 -- 172.21.15.59:0/173605241 learned_addr learned my addr 172.21.15.59:0/173605241 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:01.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.412+0000 7f065dc2c700 1 --2- 172.21.15.59:0/173605241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f065809d630 0x7f06581c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.412+0000 7f065e42d700 1 -- 172.21.15.59:0/173605241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06580a0a30 msgr2=0x7f06581c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.412+0000 7f065e42d700 1 --2- 172.21.15.59:0/173605241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06580a0a30 0x7f06581c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.412+0000 7f065e42d700 1 -- 172.21.15.59:0/173605241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f065809d630 msgr2=0x7f06581c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.412+0000 7f065e42d700 1 --2- 172.21.15.59:0/173605241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f065809d630 0x7f06581c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.412+0000 7f065e42d700 1 -- 172.21.15.59:0/173605241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06480094a0 con 0x7f0658133930 2023-09-30T22:30:01.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.412+0000 7f065e42d700 1 --2- 172.21.15.59:0/173605241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0658133930 0x7f06581c8a00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f065000c810 tx=0x7f065000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:01.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.412+0000 7f064e7fc700 1 -- 172.21.15.59:0/173605241 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650003e30 con 0x7f0658133930 2023-09-30T22:30:01.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.412+0000 7f064e7fc700 1 -- 172.21.15.59:0/173605241 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0650005070 con 0x7f0658133930 2023-09-30T22:30:01.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.412+0000 7f064e7fc700 1 -- 172.21.15.59:0/173605241 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650005420 con 0x7f0658133930 2023-09-30T22:30:01.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.412+0000 7f065fe90700 1 -- 172.21.15.59:0/173605241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0654009550 con 0x7f0658133930 2023-09-30T22:30:01.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.413+0000 7f065fe90700 1 -- 172.21.15.59:0/173605241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06580a0410 con 0x7f0658133930 2023-09-30T22:30:01.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.414+0000 7f064e7fc700 1 -- 172.21.15.59:0/173605241 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0650005580 con 0x7f0658133930 2023-09-30T22:30:01.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.414+0000 7f064e7fc700 1 -- 172.21.15.59:0/173605241 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f065003f890 con 0x7f0658133930 2023-09-30T22:30:01.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.414+0000 7f065dc2c700 1 -- 172.21.15.59:0/173605241 >> v1:172.21.15.59:6816/126772 conn(0x7f063c02f510 legacy=0x7f063c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:01.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.414+0000 7f065fe90700 1 -- 172.21.15.59:0/173605241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06580747f0 con 0x7f0658133930 2023-09-30T22:30:01.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.424+0000 7f064e7fc700 1 -- 172.21.15.59:0/173605241 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0650019710 con 0x7f0658133930 2023-09-30T22:30:01.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.435+0000 7f3be1c41700 1 -- 172.21.15.59:0/1994695529 >> v1:172.21.15.59:6816/126772 conn(0x7f3bc002f510 legacy=0x7f3bc00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:01.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.436+0000 7fbc26ffd700 1 -- 172.21.15.59:0/1104122146 >> v1:172.21.15.59:6816/126772 conn(0x7fbc1402f540 legacy=0x7fbc140319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.455+0000 7f3be3ea5700 1 -- 172.21.15.59:0/1994695529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3bdc11d420 con 0x7f3bdc131810 2023-09-30T22:30:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.455+0000 7f3bd27fc700 1 -- 172.21.15.59:0/1994695529 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3bd401a740 con 0x7f3bdc131810 2023-09-30T22:30:01.457 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.458+0000 7f3be3ea5700 1 -- 172.21.15.59:0/1994695529 >> v1:172.21.15.59:6816/126772 conn(0x7f3bc002f510 legacy=0x7f3bc00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.458+0000 7f3be3ea5700 1 -- 172.21.15.59:0/1994695529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bdc131810 msgr2=0x7f3bdc11c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.458+0000 7f3be3ea5700 1 --2- 172.21.15.59:0/1994695529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bdc131810 0x7f3bdc11c250 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4014040 tx=0x7f3bd4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.458+0000 7f3be3ea5700 1 -- 172.21.15.59:0/1994695529 shutdown_connections 2023-09-30T22:30:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.458+0000 7f3be3ea5700 1 --2- 172.21.15.59:0/1994695529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bdc131810 0x7f3bdc11c250 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.458+0000 7f3be3ea5700 1 --2- 172.21.15.59:0/1994695529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bdc099a40 0x7f3bdc11b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.458+0000 7f3be3ea5700 1 --2- 172.21.15.59:0/1994695529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bdc09a3b0 0x7f3bdc11bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.458+0000 7f3be3ea5700 1 -- 172.21.15.59:0/1994695529 >> 172.21.15.59:0/1994695529 conn(0x7f3bdc0a2aa0 msgr2=0x7f3bdc1b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.458+0000 7f3be3ea5700 1 -- 172.21.15.59:0/1994695529 shutdown_connections 2023-09-30T22:30:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.458+0000 7f3be3ea5700 1 -- 172.21.15.59:0/1994695529 wait complete. 2023-09-30T22:30:01.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:01.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.576+0000 7fca45104700 1 -- 172.21.15.59:0/3804908650 >> v1:172.21.15.59:6816/126772 conn(0x7fca2402f510 legacy=0x7fca240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.578+0000 7fbc2d4a2700 1 -- 172.21.15.59:0/1104122146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbc08005860 con 0x7fbc2813d1f0 2023-09-30T22:30:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.578+0000 7fbc0f7fe700 1 -- 172.21.15.59:0/1104122146 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc20033090 con 0x7fbc2813d1f0 2023-09-30T22:30:01.579 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:01.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.580+0000 7fbc2d4a2700 1 -- 172.21.15.59:0/1104122146 >> v1:172.21.15.59:6816/126772 conn(0x7fbc1402f540 legacy=0x7fbc140319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:01.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.580+0000 7fbc2d4a2700 1 -- 172.21.15.59:0/1104122146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2813d1f0 msgr2=0x7fbc28071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.580+0000 7fbc2d4a2700 1 --2- 172.21.15.59:0/1104122146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2813d1f0 0x7fbc28071670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbc20012000 tx=0x7fbc20004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.580+0000 7fbc2d4a2700 1 -- 172.21.15.59:0/1104122146 shutdown_connections 2023-09-30T22:30:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.580+0000 7fbc2d4a2700 1 --2- 172.21.15.59:0/1104122146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc2806a770 0x7fbc28070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.580+0000 7fbc2d4a2700 1 --2- 172.21.15.59:0/1104122146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2813d1f0 0x7fbc28071670 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.580+0000 7fbc2d4a2700 1 --2- 172.21.15.59:0/1104122146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc2809dc30 0x7fbc28071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.580+0000 7fbc2d4a2700 1 -- 172.21.15.59:0/1104122146 >> 172.21.15.59:0/1104122146 conn(0x7fbc28066f50 msgr2=0x7fbc2813d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:01.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.580+0000 7fbc2d4a2700 1 -- 172.21.15.59:0/1104122146 shutdown_connections 2023-09-30T22:30:01.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.580+0000 7fbc2d4a2700 1 -- 172.21.15.59:0/1104122146 wait complete. 2023-09-30T22:30:01.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.594+0000 7fca47b69700 1 -- 172.21.15.59:0/3804908650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fca4006b250 con 0x7fca4009d6f0 2023-09-30T22:30:01.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.595+0000 7fca367fc700 1 -- 172.21.15.59:0/3804908650 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca3c017070 con 0x7fca4009d6f0 2023-09-30T22:30:01.596 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:01.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.597+0000 7fca47b69700 1 -- 172.21.15.59:0/3804908650 >> v1:172.21.15.59:6816/126772 conn(0x7fca2402f510 legacy=0x7fca240319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.597+0000 7fca47b69700 1 -- 172.21.15.59:0/3804908650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca4009d6f0 msgr2=0x7fca40097a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.597+0000 7fca47b69700 1 --2- 172.21.15.59:0/3804908650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca4009d6f0 0x7fca40097a10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00e9e0 tx=0x7fca3c00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.597+0000 7fca47b69700 1 -- 172.21.15.59:0/3804908650 shutdown_connections 2023-09-30T22:30:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.597+0000 7fca47b69700 1 --2- 172.21.15.59:0/3804908650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca40130750 0x7fca40098490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.597+0000 7fca47b69700 1 --2- 172.21.15.59:0/3804908650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca4009d6f0 0x7fca40097a10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.597+0000 7fca47b69700 1 --2- 172.21.15.59:0/3804908650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4009e250 0x7fca40097f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.597+0000 7fca47b69700 1 -- 172.21.15.59:0/3804908650 >> 172.21.15.59:0/3804908650 conn(0x7fca4009f470 msgr2=0x7fca400992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.597+0000 7fca47b69700 1 -- 172.21.15.59:0/3804908650 shutdown_connections 2023-09-30T22:30:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.597+0000 7fca47b69700 1 -- 172.21.15.59:0/3804908650 wait complete. 2023-09-30T22:30:01.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:01.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.615+0000 7f065dc2c700 1 -- 172.21.15.59:0/173605241 >> v1:172.21.15.59:6816/126772 conn(0x7f063c02f510 legacy=0x7f063c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:01.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.674+0000 7f065fe90700 1 -- 172.21.15.59:0/173605241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0658122cb0 con 0x7f0658133930 2023-09-30T22:30:01.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.674+0000 7f064e7fc700 1 -- 172.21.15.59:0/173605241 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06500113a0 con 0x7f0658133930 2023-09-30T22:30:01.675 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.676+0000 7f065fe90700 1 -- 172.21.15.59:0/173605241 >> v1:172.21.15.59:6816/126772 conn(0x7f063c02f510 legacy=0x7f063c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.676+0000 7f065fe90700 1 -- 172.21.15.59:0/173605241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0658133930 msgr2=0x7f06581c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.676+0000 7f065fe90700 1 --2- 172.21.15.59:0/173605241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0658133930 0x7f06581c8a00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f065000c810 tx=0x7f065000cbd0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.676+0000 7f065fe90700 1 -- 172.21.15.59:0/173605241 shutdown_connections 2023-09-30T22:30:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.676+0000 7f065fe90700 1 --2- 172.21.15.59:0/173605241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0658133930 0x7f06581c8a00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.676+0000 7f065fe90700 1 --2- 172.21.15.59:0/173605241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f065809d630 0x7f06581c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.676+0000 7f065fe90700 1 --2- 172.21.15.59:0/173605241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06580a0a30 0x7f06581c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.676+0000 7f065fe90700 1 -- 172.21.15.59:0/173605241 >> 172.21.15.59:0/173605241 conn(0x7f06580a3050 msgr2=0x7f06581bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.676+0000 7f065fe90700 1 -- 172.21.15.59:0/173605241 shutdown_connections 2023-09-30T22:30:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:01.676+0000 7f065fe90700 1 -- 172.21.15.59:0/173605241 wait complete. 2023-09-30T22:30:01.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:02.474 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:02.597 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:02.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:02.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.624+0000 7f8cd7e32700 1 Processor -- start 2023-09-30T22:30:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.625+0000 7f8cd7e32700 1 -- start start 2023-09-30T22:30:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.625+0000 7f8cd7e32700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cd009e930 0x7f8cd009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.625+0000 7f8cd7e32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cd009f650 0x7f8cd0131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.625+0000 7f8cd7e32700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd0070940 con 0x7f8cd009f240 2023-09-30T22:30:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.625+0000 7f8cd7e32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd006fd60 con 0x7f8cd009f650 2023-09-30T22:30:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.625+0000 7f8cd7e32700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd006fa80 con 0x7f8cd009e930 2023-09-30T22:30:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.625+0000 7f8cd5bce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cd009e930 0x7f8cd009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.625+0000 7f8cd5bce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cd009e930 0x7f8cd009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59652/0 (socket says 172.21.15.59:59652) 2023-09-30T22:30:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.625+0000 7f8cd5bce700 1 -- 172.21.15.59:0/2431381837 learned_addr learned my addr 172.21.15.59:0/2431381837 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.625+0000 7f8cd63cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cd009f650 0x7f8cd0131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.626+0000 7f8cd5bce700 1 -- 172.21.15.59:0/2431381837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cd009f650 msgr2=0x7f8cd0131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.626+0000 7f8cd5bce700 1 --2- 172.21.15.59:0/2431381837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cd009f650 0x7f8cd0131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.626+0000 7f8cd5bce700 1 -- 172.21.15.59:0/2431381837 >> v1:172.21.15.59:6789/0 conn(0x7f8cd009f240 legacy=0x7f8cd01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.626+0000 7f8cd5bce700 1 -- 172.21.15.59:0/2431381837 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd009fb60 con 0x7f8cd009e930 2023-09-30T22:30:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.626+0000 7f8cd4bcc700 1 -- 172.21.15.59:0/2431381837 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472475316 0 0) 0x7f8cd0070940 con 0x7f8cd009f240 2023-09-30T22:30:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.626+0000 7f8cd5bce700 1 --2- 172.21.15.59:0/2431381837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cd009e930 0x7f8cd009ed00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009920 tx=0x7f8ccc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=426365478d9027dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.626+0000 7f8cd4bcc700 1 -- 172.21.15.59:0/2431381837 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc011830 con 0x7f8cd009e930 2023-09-30T22:30:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.626+0000 7f8cd4bcc700 1 -- 172.21.15.59:0/2431381837 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc011990 con 0x7f8cd009e930 2023-09-30T22:30:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.626+0000 7f8cd4bcc700 1 -- 172.21.15.59:0/2431381837 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc011d20 con 0x7f8cd009e930 2023-09-30T22:30:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.627+0000 7f8cd7e32700 1 -- 172.21.15.59:0/2431381837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cd009e930 msgr2=0x7f8cd009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.627+0000 7f8cd7e32700 1 --2- 172.21.15.59:0/2431381837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cd009e930 0x7f8cd009ed00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009920 tx=0x7f8ccc009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.627+0000 7f8cd7e32700 1 -- 172.21.15.59:0/2431381837 shutdown_connections 2023-09-30T22:30:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.627+0000 7f8cd7e32700 1 --2- 172.21.15.59:0/2431381837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cd009e930 0x7f8cd009ed00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.627+0000 7f8cd7e32700 1 --2- 172.21.15.59:0/2431381837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cd009f650 0x7f8cd0131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.627+0000 7f8cd7e32700 1 -- 172.21.15.59:0/2431381837 >> 172.21.15.59:0/2431381837 conn(0x7f8cd00a4210 msgr2=0x7f8cd00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.627+0000 7f8cd7e32700 1 -- 172.21.15.59:0/2431381837 shutdown_connections 2023-09-30T22:30:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.628+0000 7f8cd7e32700 1 -- 172.21.15.59:0/2431381837 wait complete. 2023-09-30T22:30:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.629+0000 7f8cd7e32700 1 Processor -- start 2023-09-30T22:30:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.629+0000 7f8cd7e32700 1 -- start start 2023-09-30T22:30:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.629+0000 7f8cd7e32700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cd009e930 0x7f8cd01a0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.629+0000 7f8cd7e32700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cd009f240 0x7f8cd01a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.629+0000 7f8cd7e32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cd009f650 0x7f8cd01a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.629+0000 7f8cd7e32700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd01b5090 con 0x7f8cd009f240 2023-09-30T22:30:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.629+0000 7f8cd7e32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00a3340 con 0x7f8cd009f650 2023-09-30T22:30:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.629+0000 7f8cd7e32700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd01a2210 con 0x7f8cd009e930 2023-09-30T22:30:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.629+0000 7f8cd5bce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cd009e930 0x7f8cd01a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.629+0000 7f8cd5bce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cd009e930 0x7f8cd01a0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59668/0 (socket says 172.21.15.59:59668) 2023-09-30T22:30:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.629+0000 7f8cd5bce700 1 -- 172.21.15.59:0/2177286892 learned_addr learned my addr 172.21.15.59:0/2177286892 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.629+0000 7f8cd63cf700 1 --2- 172.21.15.59:0/2177286892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cd009f650 0x7f8cd01a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.629+0000 7f8cd53cd700 1 --2- 172.21.15.59:0/2177286892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cd009f240 0x7f8cd01a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.630+0000 7f8cd5bce700 1 -- 172.21.15.59:0/2177286892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cd009f650 msgr2=0x7f8cd01a0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.630+0000 7f8cd5bce700 1 --2- 172.21.15.59:0/2177286892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cd009f650 0x7f8cd01a0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.630+0000 7f8cd5bce700 1 -- 172.21.15.59:0/2177286892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cd009f240 msgr2=0x7f8cd01a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.630+0000 7f8cd5bce700 1 --2- 172.21.15.59:0/2177286892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cd009f240 0x7f8cd01a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.630+0000 7f8cd5bce700 1 -- 172.21.15.59:0/2177286892 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc009550 con 0x7f8cd009e930 2023-09-30T22:30:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.630+0000 7f8cd63cf700 1 --2- 172.21.15.59:0/2177286892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cd009f650 0x7f8cd01a0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.630+0000 7f8cd5bce700 1 --2- 172.21.15.59:0/2177286892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cd009e930 0x7f8cd01a0510 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0098f0 tx=0x7f8ccc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.630+0000 7f8cc67fc700 1 -- 172.21.15.59:0/2177286892 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc004450 con 0x7f8cd009e930 2023-09-30T22:30:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.630+0000 7f8cc67fc700 1 -- 172.21.15.59:0/2177286892 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc0045b0 con 0x7f8cd009e930 2023-09-30T22:30:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.630+0000 7f8cd7e32700 1 -- 172.21.15.59:0/2177286892 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd00a0190 con 0x7f8cd009e930 2023-09-30T22:30:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.630+0000 7f8cc67fc700 1 -- 172.21.15.59:0/2177286892 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0038c0 con 0x7f8cd009e930 2023-09-30T22:30:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.630+0000 7f8cd7e32700 1 -- 172.21.15.59:0/2177286892 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd01a3cc0 con 0x7f8cd009e930 2023-09-30T22:30:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.631+0000 7f8cc67fc700 1 -- 172.21.15.59:0/2177286892 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8ccc003a20 con 0x7f8cd009e930 2023-09-30T22:30:02.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.631+0000 7f8cc67fc700 1 -- 172.21.15.59:0/2177286892 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8ccc021030 con 0x7f8cd009e930 2023-09-30T22:30:02.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.631+0000 7f8cd53cd700 1 -- 172.21.15.59:0/2177286892 >> v1:172.21.15.59:6816/126772 conn(0x7f8cb402f510 legacy=0x7f8cb40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:02.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.631+0000 7f8cd7e32700 1 -- 172.21.15.59:0/2177286892 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd0074ea0 con 0x7f8cd009e930 2023-09-30T22:30:02.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.637+0000 7f8cc67fc700 1 -- 172.21.15.59:0/2177286892 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ccc02b080 con 0x7f8cd009e930 2023-09-30T22:30:02.692 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:02.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.742+0000 7f4edc227700 1 Processor -- start 2023-09-30T22:30:02.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.743+0000 7f4edc227700 1 -- start start 2023-09-30T22:30:02.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.743+0000 7f4edc227700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ed409d6f0 0x7f4ed409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.743+0000 7f4edc227700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ed409e410 0x7f4ed4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.743+0000 7f4edc227700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed409b120 con 0x7f4ed409e000 2023-09-30T22:30:02.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.743+0000 7f4edc227700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed406b460 con 0x7f4ed409e410 2023-09-30T22:30:02.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.743+0000 7f4edc227700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed409a7e0 con 0x7f4ed409d6f0 2023-09-30T22:30:02.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.743+0000 7f4ed9fc3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ed409d6f0 0x7f4ed409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.744+0000 7f4ed9fc3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ed409d6f0 0x7f4ed409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59674/0 (socket says 172.21.15.59:59674) 2023-09-30T22:30:02.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.744+0000 7f4ed9fc3700 1 -- 172.21.15.59:0/4152271030 learned_addr learned my addr 172.21.15.59:0/4152271030 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:02.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.744+0000 7f4eda7c4700 1 --2- 172.21.15.59:0/4152271030 >> v2:172.21.15.59:3300/0 conn(0x7f4ed409e410 0x7f4ed4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.744+0000 7f4ed9fc3700 1 -- 172.21.15.59:0/4152271030 >> v2:172.21.15.59:3300/0 conn(0x7f4ed409e410 msgr2=0x7f4ed4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:02.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.744+0000 7f4ed9fc3700 1 --2- 172.21.15.59:0/4152271030 >> v2:172.21.15.59:3300/0 conn(0x7f4ed409e410 0x7f4ed4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.744+0000 7f4ed9fc3700 1 -- 172.21.15.59:0/4152271030 >> v1:172.21.15.59:6789/0 conn(0x7f4ed409e000 legacy=0x7f4ed41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.744+0000 7f4ed9fc3700 1 -- 172.21.15.59:0/4152271030 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed409a500 con 0x7f4ed409d6f0 2023-09-30T22:30:02.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.744+0000 7f4ed9fc3700 1 --2- 172.21.15.59:0/4152271030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ed409d6f0 0x7f4ed409dac0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0009920 tx=0x7f4ed0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7067a42006f38ccb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.744+0000 7f4ed8fc1700 1 -- 172.21.15.59:0/4152271030 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0011830 con 0x7f4ed409d6f0 2023-09-30T22:30:02.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.745+0000 7f4ed8fc1700 1 -- 172.21.15.59:0/4152271030 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed0011990 con 0x7f4ed409d6f0 2023-09-30T22:30:02.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.745+0000 7f4ed8fc1700 1 -- 172.21.15.59:0/4152271030 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0011d20 con 0x7f4ed409d6f0 2023-09-30T22:30:02.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.745+0000 7f4edc227700 1 -- 172.21.15.59:0/4152271030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ed409d6f0 msgr2=0x7f4ed409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.745+0000 7f4edc227700 1 --2- 172.21.15.59:0/4152271030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ed409d6f0 0x7f4ed409dac0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0009920 tx=0x7f4ed0009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:02.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.745+0000 7f4edc227700 1 -- 172.21.15.59:0/4152271030 shutdown_connections 2023-09-30T22:30:02.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.745+0000 7f4edc227700 1 --2- 172.21.15.59:0/4152271030 >> v2:172.21.15.59:3300/0 conn(0x7f4ed409e410 0x7f4ed4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.745+0000 7f4edc227700 1 --2- 172.21.15.59:0/4152271030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ed409d6f0 0x7f4ed409dac0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.745+0000 7f4edc227700 1 -- 172.21.15.59:0/4152271030 >> 172.21.15.59:0/4152271030 conn(0x7f4ed4066f50 msgr2=0x7f4ed409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.746+0000 7f4edc227700 1 -- 172.21.15.59:0/4152271030 shutdown_connections 2023-09-30T22:30:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.746+0000 7f4edc227700 1 -- 172.21.15.59:0/4152271030 wait complete. 2023-09-30T22:30:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.747+0000 7f4edc227700 1 Processor -- start 2023-09-30T22:30:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.747+0000 7f4edc227700 1 -- start start 2023-09-30T22:30:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.747+0000 7f4edc227700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ed409d6f0 0x7f4ed41a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.747+0000 7f4edc227700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ed409e000 0x7f4ed41a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.747+0000 7f4edc227700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed409e410 0x7f4ed41a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.747+0000 7f4edc227700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed41a8da0 con 0x7f4ed409e410 2023-09-30T22:30:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.747+0000 7f4edc227700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed41a7410 con 0x7f4ed409d6f0 2023-09-30T22:30:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.747+0000 7f4edc227700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed41a97f0 con 0x7f4ed409e000 2023-09-30T22:30:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.747+0000 7f4ed9fc3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ed409d6f0 0x7f4ed41a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.747+0000 7f4ed97c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ed409e000 0x7f4ed41a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.747+0000 7f4ed9fc3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ed409d6f0 0x7f4ed41a5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50480/0 (socket says 172.21.15.59:50480) 2023-09-30T22:30:02.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.747+0000 7f4ed9fc3700 1 -- 172.21.15.59:0/3048159567 learned_addr learned my addr 172.21.15.59:0/3048159567 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:02.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.748+0000 7f4eda7c4700 1 --2- 172.21.15.59:0/3048159567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed409e410 0x7f4ed41a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.748+0000 7f4ed97c2700 1 -- 172.21.15.59:0/3048159567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ed409d6f0 msgr2=0x7f4ed41a5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.748+0000 7f4ed97c2700 1 --2- 172.21.15.59:0/3048159567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ed409d6f0 0x7f4ed41a5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.748+0000 7f4ed97c2700 1 -- 172.21.15.59:0/3048159567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed409e410 msgr2=0x7f4ed41a69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.748+0000 7f4ed97c2700 1 --2- 172.21.15.59:0/3048159567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed409e410 0x7f4ed41a69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.748+0000 7f4ed97c2700 1 -- 172.21.15.59:0/3048159567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed0009550 con 0x7f4ed409e000 2023-09-30T22:30:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.748+0000 7f4ed97c2700 1 --2- 172.21.15.59:0/3048159567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ed409e000 0x7f4ed41a64a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4000f60 tx=0x7f4ec400c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.748+0000 7f4eca7fc700 1 -- 172.21.15.59:0/3048159567 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40052d0 con 0x7f4ed409e000 2023-09-30T22:30:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.748+0000 7f4eca7fc700 1 -- 172.21.15.59:0/3048159567 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec4005430 con 0x7f4ed409e000 2023-09-30T22:30:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.748+0000 7f4edc227700 1 -- 172.21.15.59:0/3048159567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed41a88e0 con 0x7f4ed409e000 2023-09-30T22:30:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.748+0000 7f4edc227700 1 -- 172.21.15.59:0/3048159567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed409c710 con 0x7f4ed409e000 2023-09-30T22:30:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.750+0000 7f4eca7fc700 1 -- 172.21.15.59:0/3048159567 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40038a0 con 0x7f4ed409e000 2023-09-30T22:30:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.750+0000 7f4eca7fc700 1 -- 172.21.15.59:0/3048159567 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4ec4003a40 con 0x7f4ed409e000 2023-09-30T22:30:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.750+0000 7f4eca7fc700 1 -- 172.21.15.59:0/3048159567 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f4ec403f0f0 con 0x7f4ed409e000 2023-09-30T22:30:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.750+0000 7f4ed9fc3700 1 -- 172.21.15.59:0/3048159567 >> v1:172.21.15.59:6816/126772 conn(0x7f4eb802f510 legacy=0x7f4eb80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.751+0000 7f4edc227700 1 -- 172.21.15.59:0/3048159567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed4074ea0 con 0x7f4ed409e000 2023-09-30T22:30:02.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.760+0000 7f4eca7fc700 1 -- 172.21.15.59:0/3048159567 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ec4017080 con 0x7f4ed409e000 2023-09-30T22:30:02.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.770+0000 7fdf63ebe700 1 Processor -- start 2023-09-30T22:30:02.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.770+0000 7fdf63ebe700 1 -- start start 2023-09-30T22:30:02.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.770+0000 7fdf63ebe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf5c1338a0 0x7fdf5c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.770+0000 7fdf63ebe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5c09de50 0x7fdf5c09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.770+0000 7fdf63ebe700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf5c06ef30 con 0x7fdf5c09e760 2023-09-30T22:30:02.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.770+0000 7fdf63ebe700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5c06fef0 con 0x7fdf5c1338a0 2023-09-30T22:30:02.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.770+0000 7fdf63ebe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c1334b0 con 0x7fdf5c09de50 2023-09-30T22:30:02.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.771+0000 7fdf6245b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdf5c09e760 0x7fdf5c13a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54632/0 (socket says 172.21.15.59:54632) 2023-09-30T22:30:02.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.771+0000 7fdf6245b700 1 -- 172.21.15.59:0/891510737 learned_addr learned my addr 172.21.15.59:0/891510737 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:02.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.771+0000 7fdf61c5a700 1 --2- 172.21.15.59:0/891510737 >> v2:172.21.15.59:3300/0 conn(0x7fdf5c1338a0 0x7fdf5c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.771+0000 7fdf61459700 1 --2- 172.21.15.59:0/891510737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5c09de50 0x7fdf5c09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.771+0000 7fdf60c58700 1 -- 172.21.15.59:0/891510737 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626225938 0 0) 0x7fdf5c06ef30 con 0x7fdf5c09e760 2023-09-30T22:30:02.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.771+0000 7fdf60c58700 1 -- 172.21.15.59:0/891510737 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf480035b0 con 0x7fdf5c09e760 2023-09-30T22:30:02.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.771+0000 7fdf61459700 1 -- 172.21.15.59:0/891510737 >> v2:172.21.15.59:3300/0 conn(0x7fdf5c1338a0 msgr2=0x7fdf5c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:02.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.771+0000 7fdf61459700 1 --2- 172.21.15.59:0/891510737 >> v2:172.21.15.59:3300/0 conn(0x7fdf5c1338a0 0x7fdf5c133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.771+0000 7fdf61459700 1 -- 172.21.15.59:0/891510737 >> v1:172.21.15.59:6789/0 conn(0x7fdf5c09e760 legacy=0x7fdf5c13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.771+0000 7fdf61459700 1 -- 172.21.15.59:0/891510737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c06fc30 con 0x7fdf5c09de50 2023-09-30T22:30:02.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.771+0000 7fdf61459700 1 --2- 172.21.15.59:0/891510737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5c09de50 0x7fdf5c09e220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009840 tx=0x7fdf4c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e42234a872d92e5a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.772+0000 7fdf60c58700 1 -- 172.21.15.59:0/891510737 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c011830 con 0x7fdf5c09de50 2023-09-30T22:30:02.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.772+0000 7fdf60c58700 1 -- 172.21.15.59:0/891510737 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c011990 con 0x7fdf5c09de50 2023-09-30T22:30:02.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.772+0000 7fdf60c58700 1 -- 172.21.15.59:0/891510737 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c011d00 con 0x7fdf5c09de50 2023-09-30T22:30:02.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.772+0000 7fdf63ebe700 1 -- 172.21.15.59:0/891510737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5c09de50 msgr2=0x7fdf5c09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.772+0000 7fdf63ebe700 1 --2- 172.21.15.59:0/891510737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5c09de50 0x7fdf5c09e220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009840 tx=0x7fdf4c009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:02.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.772+0000 7fdf63ebe700 1 -- 172.21.15.59:0/891510737 shutdown_connections 2023-09-30T22:30:02.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.772+0000 7fdf63ebe700 1 --2- 172.21.15.59:0/891510737 >> v2:172.21.15.59:3300/0 conn(0x7fdf5c1338a0 0x7fdf5c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.772+0000 7fdf63ebe700 1 --2- 172.21.15.59:0/891510737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5c09de50 0x7fdf5c09e220 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.772+0000 7fdf63ebe700 1 -- 172.21.15.59:0/891510737 >> 172.21.15.59:0/891510737 conn(0x7fdf5c0a2aa0 msgr2=0x7fdf5c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:02.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.773+0000 7fdf63ebe700 1 -- 172.21.15.59:0/891510737 shutdown_connections 2023-09-30T22:30:02.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.773+0000 7fdf63ebe700 1 -- 172.21.15.59:0/891510737 wait complete. 2023-09-30T22:30:02.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.774+0000 7fdf63ebe700 1 Processor -- start 2023-09-30T22:30:02.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.774+0000 7fdf63ebe700 1 -- start start 2023-09-30T22:30:02.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.775+0000 7fdf63ebe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5c09de50 0x7fdf5c118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.775+0000 7fdf63ebe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf5c09e760 0x7fdf5c119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.775+0000 7fdf63ebe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf5c1338a0 0x7fdf5c119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.775+0000 7fdf63ebe700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c11bf30 con 0x7fdf5c1338a0 2023-09-30T22:30:02.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.775+0000 7fdf63ebe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c11c110 con 0x7fdf5c09de50 2023-09-30T22:30:02.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.775+0000 7fdf63ebe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c12d940 con 0x7fdf5c09e760 2023-09-30T22:30:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.775+0000 7fdf6245b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf5c1338a0 0x7fdf5c119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.775+0000 7fdf6245b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf5c1338a0 0x7fdf5c119750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52006/0 (socket says 172.21.15.59:52006) 2023-09-30T22:30:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.775+0000 7fdf6245b700 1 -- 172.21.15.59:0/772144906 learned_addr learned my addr 172.21.15.59:0/772144906 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.775+0000 7fdf61459700 1 --2- 172.21.15.59:0/772144906 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf5c09e760 0x7fdf5c119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.775+0000 7fdf61c5a700 1 --2- 172.21.15.59:0/772144906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5c09de50 0x7fdf5c118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.776+0000 7fdf6245b700 1 -- 172.21.15.59:0/772144906 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf5c09e760 msgr2=0x7fdf5c119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.776+0000 7fdf6245b700 1 --2- 172.21.15.59:0/772144906 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf5c09e760 0x7fdf5c119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.776+0000 7fdf6245b700 1 -- 172.21.15.59:0/772144906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5c09de50 msgr2=0x7fdf5c118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.776+0000 7fdf6245b700 1 --2- 172.21.15.59:0/772144906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5c09de50 0x7fdf5c118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.776+0000 7fdf6245b700 1 -- 172.21.15.59:0/772144906 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c0094a0 con 0x7fdf5c1338a0 2023-09-30T22:30:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.776+0000 7fdf6245b700 1 --2- 172.21.15.59:0/772144906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf5c1338a0 0x7fdf5c119750 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400cb70 tx=0x7fdf5400ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.776+0000 7fdf527fc700 1 -- 172.21.15.59:0/772144906 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5400aa60 con 0x7fdf5c1338a0 2023-09-30T22:30:02.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.776+0000 7fdf527fc700 1 -- 172.21.15.59:0/772144906 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5400abc0 con 0x7fdf5c1338a0 2023-09-30T22:30:02.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.776+0000 7fdf63ebe700 1 -- 172.21.15.59:0/772144906 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5c11ca80 con 0x7fdf5c1338a0 2023-09-30T22:30:02.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.776+0000 7fdf527fc700 1 -- 172.21.15.59:0/772144906 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54012400 con 0x7fdf5c1338a0 2023-09-30T22:30:02.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.776+0000 7fdf63ebe700 1 -- 172.21.15.59:0/772144906 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5c11b450 con 0x7fdf5c1338a0 2023-09-30T22:30:02.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.777+0000 7fdf527fc700 1 -- 172.21.15.59:0/772144906 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fdf5401b3b0 con 0x7fdf5c1338a0 2023-09-30T22:30:02.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.777+0000 7fdf527fc700 1 -- 172.21.15.59:0/772144906 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fdf5403f870 con 0x7fdf5c1338a0 2023-09-30T22:30:02.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.777+0000 7fdf61c5a700 1 -- 172.21.15.59:0/772144906 >> v1:172.21.15.59:6816/126772 conn(0x7fdf4002f510 legacy=0x7fdf400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:02.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.778+0000 7fdf63ebe700 1 -- 172.21.15.59:0/772144906 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf5c074ea0 con 0x7fdf5c1338a0 2023-09-30T22:30:02.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.783+0000 7fdf527fc700 1 -- 172.21.15.59:0/772144906 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf54017020 con 0x7fdf5c1338a0 2023-09-30T22:30:02.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.832+0000 7f8cd53cd700 1 -- 172.21.15.59:0/2177286892 >> v1:172.21.15.59:6816/126772 conn(0x7f8cb402f510 legacy=0x7f8cb40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:02.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.839+0000 7f4b268c2700 1 Processor -- start 2023-09-30T22:30:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.839+0000 7f4b268c2700 1 -- start start 2023-09-30T22:30:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b268c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b2009d6f0 0x7f4b2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b268c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b2009e410 0x7f4b20130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b268c2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2009f130 con 0x7f4b2009e000 2023-09-30T22:30:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b268c2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2009f520 con 0x7f4b2009d6f0 2023-09-30T22:30:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b268c2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2009e930 con 0x7f4b2009e410 2023-09-30T22:30:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b1ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b2009d6f0 0x7f4b2009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b1ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b2009d6f0 0x7f4b2009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50500/0 (socket says 172.21.15.59:50500) 2023-09-30T22:30:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b1ffff700 1 -- 172.21.15.59:0/3283257845 learned_addr learned my addr 172.21.15.59:0/3283257845 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b1f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4b2009e000 0x7f4b20130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54642/0 (socket says 172.21.15.59:54642) 2023-09-30T22:30:02.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b24e5f700 1 --2- 172.21.15.59:0/3283257845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b2009e410 0x7f4b20130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b1effd700 1 -- 172.21.15.59:0/3283257845 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837959220 0 0) 0x7f4b2009f130 con 0x7f4b2009e000 2023-09-30T22:30:02.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b1effd700 1 -- 172.21.15.59:0/3283257845 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b080035b0 con 0x7f4b2009e000 2023-09-30T22:30:02.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b24e5f700 1 -- 172.21.15.59:0/3283257845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b2009d6f0 msgr2=0x7f4b2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:02.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b24e5f700 1 --2- 172.21.15.59:0/3283257845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b2009d6f0 0x7f4b2009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b24e5f700 1 -- 172.21.15.59:0/3283257845 >> v1:172.21.15.59:6789/0 conn(0x7f4b2009e000 legacy=0x7f4b20130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.840+0000 7f4b24e5f700 1 -- 172.21.15.59:0/3283257845 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2009b2d0 con 0x7f4b2009e410 2023-09-30T22:30:02.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.841+0000 7f4b24e5f700 1 --2- 172.21.15.59:0/3283257845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b2009e410 0x7f4b20130d70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009dc0 tx=0x7f4b1800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95a4b51c8a4c54c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.841+0000 7f4b1effd700 1 -- 172.21.15.59:0/3283257845 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800e070 con 0x7f4b2009e410 2023-09-30T22:30:02.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.841+0000 7f4b1effd700 1 -- 172.21.15.59:0/3283257845 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1800bb20 con 0x7f4b2009e410 2023-09-30T22:30:02.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.841+0000 7f4b1effd700 1 -- 172.21.15.59:0/3283257845 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18012430 con 0x7f4b2009e410 2023-09-30T22:30:02.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.841+0000 7f4b268c2700 1 -- 172.21.15.59:0/3283257845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b2009e410 msgr2=0x7f4b20130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.841+0000 7f4b268c2700 1 --2- 172.21.15.59:0/3283257845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b2009e410 0x7f4b20130d70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009dc0 tx=0x7f4b1800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:02.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.842+0000 7f4b268c2700 1 -- 172.21.15.59:0/3283257845 shutdown_connections 2023-09-30T22:30:02.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.842+0000 7f4b268c2700 1 --2- 172.21.15.59:0/3283257845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b2009e410 0x7f4b20130d70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.842+0000 7f4b268c2700 1 --2- 172.21.15.59:0/3283257845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b2009d6f0 0x7f4b2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.842+0000 7f4b268c2700 1 -- 172.21.15.59:0/3283257845 >> 172.21.15.59:0/3283257845 conn(0x7f4b20066f50 msgr2=0x7f4b2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:02.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.842+0000 7f4b268c2700 1 -- 172.21.15.59:0/3283257845 shutdown_connections 2023-09-30T22:30:02.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.842+0000 7f4b268c2700 1 -- 172.21.15.59:0/3283257845 wait complete. 2023-09-30T22:30:02.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.843+0000 7f4b268c2700 1 Processor -- start 2023-09-30T22:30:02.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.843+0000 7f4b268c2700 1 -- start start 2023-09-30T22:30:02.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.843+0000 7f4b268c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b2009d6f0 0x7f4b20130b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.843+0000 7f4b268c2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b2009e000 0x7f4b20136890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.843+0000 7f4b268c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b2009e410 0x7f4b20136dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.843+0000 7f4b268c2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2013af10 con 0x7f4b2009e000 2023-09-30T22:30:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.843+0000 7f4b268c2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2013b100 con 0x7f4b2009e410 2023-09-30T22:30:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.843+0000 7f4b268c2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b20138a50 con 0x7f4b2009d6f0 2023-09-30T22:30:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.844+0000 7f4b1f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b2009e000 0x7f4b20136890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.844+0000 7f4b24e5f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b2009e410 0x7f4b20136dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.844+0000 7f4b1f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b2009e000 0x7f4b20136890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52020/0 (socket says 172.21.15.59:52020) 2023-09-30T22:30:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.844+0000 7f4b1f7fe700 1 -- 172.21.15.59:0/1720077570 learned_addr learned my addr 172.21.15.59:0/1720077570 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.844+0000 7f4b24e5f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b2009e410 0x7f4b20136dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50506/0 (socket says 172.21.15.59:50506) 2023-09-30T22:30:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.844+0000 7f4b1ffff700 1 --2- 172.21.15.59:0/1720077570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b2009d6f0 0x7f4b20130b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.844+0000 7f4b1f7fe700 1 -- 172.21.15.59:0/1720077570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b2009d6f0 msgr2=0x7f4b20130b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.844+0000 7f4b1f7fe700 1 --2- 172.21.15.59:0/1720077570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b2009d6f0 0x7f4b20130b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.844+0000 7f4b1f7fe700 1 -- 172.21.15.59:0/1720077570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b2009e410 msgr2=0x7f4b20136dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.844+0000 7f4b1f7fe700 1 --2- 172.21.15.59:0/1720077570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b2009e410 0x7f4b20136dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.844+0000 7f4b1f7fe700 1 -- 172.21.15.59:0/1720077570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b18009a70 con 0x7f4b2009e000 2023-09-30T22:30:02.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.844+0000 7f4b1f7fe700 1 --2- 172.21.15.59:0/1720077570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b2009e000 0x7f4b20136890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400c520 tx=0x7f4b1400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.845+0000 7f4b1cff9700 1 -- 172.21.15.59:0/1720077570 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14005cb0 con 0x7f4b2009e000 2023-09-30T22:30:02.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.845+0000 7f4b1cff9700 1 -- 172.21.15.59:0/1720077570 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b14005e10 con 0x7f4b2009e000 2023-09-30T22:30:02.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.845+0000 7f4b1cff9700 1 -- 172.21.15.59:0/1720077570 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b140072f0 con 0x7f4b2009e000 2023-09-30T22:30:02.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.845+0000 7f4b268c2700 1 -- 172.21.15.59:0/1720077570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b200a3860 con 0x7f4b2009e000 2023-09-30T22:30:02.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.845+0000 7f4b268c2700 1 -- 172.21.15.59:0/1720077570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2009c760 con 0x7f4b2009e000 2023-09-30T22:30:02.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.846+0000 7f4b268c2700 1 -- 172.21.15.59:0/1720077570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b20139cf0 con 0x7f4b2009e000 2023-09-30T22:30:02.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.847+0000 7f4b1cff9700 1 -- 172.21.15.59:0/1720077570 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4b14007450 con 0x7f4b2009e000 2023-09-30T22:30:02.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.848+0000 7f4b1cff9700 1 -- 172.21.15.59:0/1720077570 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f4b1403f3c0 con 0x7f4b2009e000 2023-09-30T22:30:02.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.848+0000 7f4b1ffff700 1 -- 172.21.15.59:0/1720077570 >> v1:172.21.15.59:6816/126772 conn(0x7f4b0c02f540 legacy=0x7f4b0c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.852+0000 7f4b1cff9700 1 -- 172.21.15.59:0/1720077570 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b1401b3b0 con 0x7f4b2009e000 2023-09-30T22:30:02.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.863+0000 7f8cd7e32700 1 -- 172.21.15.59:0/2177286892 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8cd01a2880 con 0x7f8cd009e930 2023-09-30T22:30:02.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.863+0000 7f8cc67fc700 1 -- 172.21.15.59:0/2177286892 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ccc015020 con 0x7f8cd009e930 2023-09-30T22:30:02.864 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.867+0000 7f8cd7e32700 1 -- 172.21.15.59:0/2177286892 >> v1:172.21.15.59:6816/126772 conn(0x7f8cb402f510 legacy=0x7f8cb40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.867+0000 7f8cd7e32700 1 -- 172.21.15.59:0/2177286892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cd009e930 msgr2=0x7f8cd01a0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.867+0000 7f8cd7e32700 1 --2- 172.21.15.59:0/2177286892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cd009e930 0x7f8cd01a0510 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0098f0 tx=0x7f8ccc004750 comp rx=0 tx=0).stop 2023-09-30T22:30:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.867+0000 7f8cd7e32700 1 -- 172.21.15.59:0/2177286892 shutdown_connections 2023-09-30T22:30:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.867+0000 7f8cd7e32700 1 --2- 172.21.15.59:0/2177286892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cd009e930 0x7f8cd01a0510 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.867+0000 7f8cd7e32700 1 --2- 172.21.15.59:0/2177286892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cd009f650 0x7f8cd01a0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.867+0000 7f8cd7e32700 1 --2- 172.21.15.59:0/2177286892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cd009f240 0x7f8cd01a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.867+0000 7f8cd7e32700 1 -- 172.21.15.59:0/2177286892 >> 172.21.15.59:0/2177286892 conn(0x7f8cd00a4210 msgr2=0x7f8cd01b7970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.867+0000 7f8cd7e32700 1 -- 172.21.15.59:0/2177286892 shutdown_connections 2023-09-30T22:30:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.867+0000 7f8cd7e32700 1 -- 172.21.15.59:0/2177286892 wait complete. 2023-09-30T22:30:02.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.951+0000 7f4ed9fc3700 1 -- 172.21.15.59:0/3048159567 >> v1:172.21.15.59:6816/126772 conn(0x7f4eb802f510 legacy=0x7f4eb80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.974+0000 7f4edc227700 1 -- 172.21.15.59:0/3048159567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4ed406c360 con 0x7f4ed409e000 2023-09-30T22:30:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.975+0000 7f4eca7fc700 1 -- 172.21.15.59:0/3048159567 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ec4011590 con 0x7f4ed409e000 2023-09-30T22:30:02.976 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.977+0000 7f4edc227700 1 -- 172.21.15.59:0/3048159567 >> v1:172.21.15.59:6816/126772 conn(0x7f4eb802f510 legacy=0x7f4eb80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.977+0000 7f4edc227700 1 -- 172.21.15.59:0/3048159567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ed409e000 msgr2=0x7f4ed41a64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.977+0000 7f4edc227700 1 --2- 172.21.15.59:0/3048159567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ed409e000 0x7f4ed41a64a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4000f60 tx=0x7f4ec400c730 comp rx=0 tx=0).stop 2023-09-30T22:30:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.977+0000 7f4edc227700 1 -- 172.21.15.59:0/3048159567 shutdown_connections 2023-09-30T22:30:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.977+0000 7f4edc227700 1 --2- 172.21.15.59:0/3048159567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed409e410 0x7f4ed41a69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.977+0000 7f4edc227700 1 --2- 172.21.15.59:0/3048159567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ed409d6f0 0x7f4ed41a5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.977+0000 7f4edc227700 1 --2- 172.21.15.59:0/3048159567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ed409e000 0x7f4ed41a64a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.977+0000 7f4edc227700 1 -- 172.21.15.59:0/3048159567 >> 172.21.15.59:0/3048159567 conn(0x7f4ed4066f50 msgr2=0x7f4ed41baed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.977+0000 7f4edc227700 1 -- 172.21.15.59:0/3048159567 shutdown_connections 2023-09-30T22:30:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.977+0000 7f4edc227700 1 -- 172.21.15.59:0/3048159567 wait complete. 2023-09-30T22:30:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.978+0000 7fdf61c5a700 1 -- 172.21.15.59:0/772144906 >> v1:172.21.15.59:6816/126772 conn(0x7fdf4002f510 legacy=0x7fdf400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:02.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.998+0000 7fdf63ebe700 1 -- 172.21.15.59:0/772144906 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdf5c06b9e0 con 0x7fdf5c1338a0 2023-09-30T22:30:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:02.998+0000 7fdf527fc700 1 -- 172.21.15.59:0/772144906 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf540113a0 con 0x7fdf5c1338a0 2023-09-30T22:30:02.999 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:03.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.000+0000 7fdf63ebe700 1 -- 172.21.15.59:0/772144906 >> v1:172.21.15.59:6816/126772 conn(0x7fdf4002f510 legacy=0x7fdf400319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:03.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.000+0000 7fdf63ebe700 1 -- 172.21.15.59:0/772144906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf5c1338a0 msgr2=0x7fdf5c119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.000+0000 7fdf63ebe700 1 --2- 172.21.15.59:0/772144906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf5c1338a0 0x7fdf5c119750 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400cb70 tx=0x7fdf5400ce80 comp rx=0 tx=0).stop 2023-09-30T22:30:03.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.001+0000 7fdf63ebe700 1 -- 172.21.15.59:0/772144906 shutdown_connections 2023-09-30T22:30:03.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.001+0000 7fdf63ebe700 1 --2- 172.21.15.59:0/772144906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf5c1338a0 0x7fdf5c119750 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.001+0000 7fdf63ebe700 1 --2- 172.21.15.59:0/772144906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5c09de50 0x7fdf5c118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.001+0000 7fdf63ebe700 1 --2- 172.21.15.59:0/772144906 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf5c09e760 0x7fdf5c119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.001+0000 7fdf63ebe700 1 -- 172.21.15.59:0/772144906 >> 172.21.15.59:0/772144906 conn(0x7fdf5c0a2aa0 msgr2=0x7fdf5c12f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:03.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.001+0000 7fdf63ebe700 1 -- 172.21.15.59:0/772144906 shutdown_connections 2023-09-30T22:30:03.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.001+0000 7fdf63ebe700 1 -- 172.21.15.59:0/772144906 wait complete. 2023-09-30T22:30:03.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.049+0000 7f4b1ffff700 1 -- 172.21.15.59:0/1720077570 >> v1:172.21.15.59:6816/126772 conn(0x7f4b0c02f540 legacy=0x7f4b0c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126772 2023-09-30T22:30:03.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.063+0000 7f4b268c2700 1 -- 172.21.15.59:0/1720077570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b20139cf0 con 0x7f4b2009e000 2023-09-30T22:30:03.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.063+0000 7f4b1cff9700 1 -- 172.21.15.59:0/1720077570 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b20139cf0 con 0x7f4b2009e000 2023-09-30T22:30:03.064 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:03.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.065+0000 7f4b268c2700 1 -- 172.21.15.59:0/1720077570 >> v1:172.21.15.59:6816/126772 conn(0x7f4b0c02f540 legacy=0x7f4b0c0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.065+0000 7f4b268c2700 1 -- 172.21.15.59:0/1720077570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b2009e000 msgr2=0x7f4b20136890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.065+0000 7f4b268c2700 1 --2- 172.21.15.59:0/1720077570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b2009e000 0x7f4b20136890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400c520 tx=0x7f4b1400c830 comp rx=0 tx=0).stop 2023-09-30T22:30:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.065+0000 7f4b268c2700 1 -- 172.21.15.59:0/1720077570 shutdown_connections 2023-09-30T22:30:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.065+0000 7f4b268c2700 1 --2- 172.21.15.59:0/1720077570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b2009d6f0 0x7f4b20130b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.065+0000 7f4b268c2700 1 --2- 172.21.15.59:0/1720077570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b2009e410 0x7f4b20136dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.065+0000 7f4b268c2700 1 --2- 172.21.15.59:0/1720077570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b2009e000 0x7f4b20136890 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.065+0000 7f4b268c2700 1 -- 172.21.15.59:0/1720077570 >> 172.21.15.59:0/1720077570 conn(0x7f4b20066f50 msgr2=0x7f4b20070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.065+0000 7f4b268c2700 1 -- 172.21.15.59:0/1720077570 shutdown_connections 2023-09-30T22:30:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:03.065+0000 7f4b268c2700 1 -- 172.21.15.59:0/1720077570 wait complete. 2023-09-30T22:30:03.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:03.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:03.993 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:04.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:04.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.031+0000 7ff365c56700 1 Processor -- start 2023-09-30T22:30:04.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.031+0000 7ff365c56700 1 -- start start 2023-09-30T22:30:04.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.032+0000 7ff365c56700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3600a1510 0x7ff360138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.032+0000 7ff365c56700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff360139250 0x7ff36013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.032+0000 7ff365c56700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36009edd0 con 0x7ff3600a0a30 2023-09-30T22:30:04.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.032+0000 7ff365c56700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3600a18e0 con 0x7ff3600a1510 2023-09-30T22:30:04.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.032+0000 7ff365c56700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36009e1f0 con 0x7ff360139250 2023-09-30T22:30:04.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.032+0000 7ff35effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3600a1510 0x7ff360138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.033+0000 7ff35effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3600a1510 0x7ff360138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52024/0 (socket says 172.21.15.59:52024) 2023-09-30T22:30:04.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.033+0000 7ff35effd700 1 -- 172.21.15.59:0/1189820054 learned_addr learned my addr 172.21.15.59:0/1189820054 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:04.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.033+0000 7ff35ffff700 1 --2- 172.21.15.59:0/1189820054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff360139250 0x7ff36013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.033+0000 7ff35ffff700 1 -- 172.21.15.59:0/1189820054 >> v2:172.21.15.59:3300/0 conn(0x7ff3600a1510 msgr2=0x7ff360138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:04.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.033+0000 7ff35ffff700 1 --2- 172.21.15.59:0/1189820054 >> v2:172.21.15.59:3300/0 conn(0x7ff3600a1510 0x7ff360138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.033+0000 7ff35ffff700 1 -- 172.21.15.59:0/1189820054 >> v1:172.21.15.59:6789/0 conn(0x7ff3600a0a30 legacy=0x7ff3600a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.033+0000 7ff35ffff700 1 -- 172.21.15.59:0/1189820054 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36009dc50 con 0x7ff360139250 2023-09-30T22:30:04.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.034+0000 7ff35ffff700 1 --2- 172.21.15.59:0/1189820054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff360139250 0x7ff36013b630 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff358009d90 tx=0x7ff35800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf6da67991e5b0e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:04.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.034+0000 7ff35e7fc700 1 -- 172.21.15.59:0/1189820054 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35800e070 con 0x7ff360139250 2023-09-30T22:30:04.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.034+0000 7ff35e7fc700 1 -- 172.21.15.59:0/1189820054 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35800bb20 con 0x7ff360139250 2023-09-30T22:30:04.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.034+0000 7ff35e7fc700 1 -- 172.21.15.59:0/1189820054 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358012430 con 0x7ff360139250 2023-09-30T22:30:04.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.035+0000 7ff365c56700 1 -- 172.21.15.59:0/1189820054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff360139250 msgr2=0x7ff36013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.035+0000 7ff365c56700 1 --2- 172.21.15.59:0/1189820054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff360139250 0x7ff36013b630 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff358009d90 tx=0x7ff35800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:04.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.035+0000 7ff365c56700 1 -- 172.21.15.59:0/1189820054 shutdown_connections 2023-09-30T22:30:04.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.035+0000 7ff365c56700 1 --2- 172.21.15.59:0/1189820054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff360139250 0x7ff36013b630 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.035+0000 7ff365c56700 1 --2- 172.21.15.59:0/1189820054 >> v2:172.21.15.59:3300/0 conn(0x7ff3600a1510 0x7ff360138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.035+0000 7ff365c56700 1 -- 172.21.15.59:0/1189820054 >> 172.21.15.59:0/1189820054 conn(0x7ff3600a6550 msgr2=0x7ff3600a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:04.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.035+0000 7ff365c56700 1 -- 172.21.15.59:0/1189820054 shutdown_connections 2023-09-30T22:30:04.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.035+0000 7ff365c56700 1 -- 172.21.15.59:0/1189820054 wait complete. 2023-09-30T22:30:04.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.036+0000 7ff365c56700 1 Processor -- start 2023-09-30T22:30:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.037+0000 7ff365c56700 1 -- start start 2023-09-30T22:30:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.037+0000 7ff365c56700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3600a0a30 0x7ff360122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.037+0000 7ff365c56700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3600a1510 0x7ff360122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.037+0000 7ff365c56700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff360139250 0x7ff3601233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.037+0000 7ff365c56700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3601381d0 con 0x7ff360139250 2023-09-30T22:30:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.037+0000 7ff365c56700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff360138790 con 0x7ff3600a0a30 2023-09-30T22:30:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.037+0000 7ff365c56700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3601245c0 con 0x7ff3600a1510 2023-09-30T22:30:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.037+0000 7ff35effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3600a1510 0x7ff360122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.037+0000 7ff35effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3600a1510 0x7ff360122e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59714/0 (socket says 172.21.15.59:59714) 2023-09-30T22:30:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.037+0000 7ff35effd700 1 -- 172.21.15.59:0/1601101938 learned_addr learned my addr 172.21.15.59:0/1601101938 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.037+0000 7ff35f7fe700 1 --2- 172.21.15.59:0/1601101938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3600a0a30 0x7ff360122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.037+0000 7ff35ffff700 1 --2- 172.21.15.59:0/1601101938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff360139250 0x7ff3601233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.038+0000 7ff35f7fe700 1 -- 172.21.15.59:0/1601101938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3600a1510 msgr2=0x7ff360122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.038+0000 7ff35f7fe700 1 --2- 172.21.15.59:0/1601101938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3600a1510 0x7ff360122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.038+0000 7ff35f7fe700 1 -- 172.21.15.59:0/1601101938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff360139250 msgr2=0x7ff3601233b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.038+0000 7ff35f7fe700 1 --2- 172.21.15.59:0/1601101938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff360139250 0x7ff3601233b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.038+0000 7ff35f7fe700 1 -- 172.21.15.59:0/1601101938 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff358009a70 con 0x7ff3600a0a30 2023-09-30T22:30:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.038+0000 7ff35effd700 1 --2- 172.21.15.59:0/1601101938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3600a1510 0x7ff360122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.038+0000 7ff35f7fe700 1 --2- 172.21.15.59:0/1601101938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3600a0a30 0x7ff360122930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff350000f60 tx=0x7ff35000c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.038+0000 7ff347fff700 1 -- 172.21.15.59:0/1601101938 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3500052d0 con 0x7ff3600a0a30 2023-09-30T22:30:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.038+0000 7ff347fff700 1 -- 172.21.15.59:0/1601101938 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff350005430 con 0x7ff3600a0a30 2023-09-30T22:30:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.038+0000 7ff365c56700 1 -- 172.21.15.59:0/1601101938 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff360125e20 con 0x7ff3600a0a30 2023-09-30T22:30:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.038+0000 7ff347fff700 1 -- 172.21.15.59:0/1601101938 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3500038c0 con 0x7ff3600a0a30 2023-09-30T22:30:04.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.038+0000 7ff365c56700 1 -- 172.21.15.59:0/1601101938 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff360126b50 con 0x7ff3600a0a30 2023-09-30T22:30:04.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.039+0000 7ff347fff700 1 -- 172.21.15.59:0/1601101938 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff350003a20 con 0x7ff3600a0a30 2023-09-30T22:30:04.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.040+0000 7ff347fff700 1 -- 172.21.15.59:0/1601101938 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff3500118c0 con 0x7ff3600a0a30 2023-09-30T22:30:04.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.040+0000 7ff365c56700 1 -- 172.21.15.59:0/1601101938 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff360074ea0 con 0x7ff3600a0a30 2023-09-30T22:30:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.045+0000 7ff347fff700 1 -- 172.21.15.59:0/1601101938 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff350044060 con 0x7ff3600a0a30 2023-09-30T22:30:04.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:04.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.140+0000 7f4df267c700 1 Processor -- start 2023-09-30T22:30:04.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.141+0000 7f4df267c700 1 -- start start 2023-09-30T22:30:04.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.141+0000 7f4df267c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dec06e570 0x7f4dec06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.141+0000 7f4df267c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4dec09eca0 0x7f4dec06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.141+0000 7f4df267c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dec134610 0x7f4dec134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.141+0000 7f4df267c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec070ee0 con 0x7f4dec09eca0 2023-09-30T22:30:04.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.141+0000 7f4df267c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec071480 con 0x7f4dec06e570 2023-09-30T22:30:04.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.141+0000 7f4df267c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec06f3c0 con 0x7f4dec134610 2023-09-30T22:30:04.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.141+0000 7f4df0c19700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dec134610 0x7f4dec134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.141+0000 7f4debfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dec06e570 0x7f4dec06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.141+0000 7f4df0c19700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dec134610 0x7f4dec134a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59728/0 (socket says 172.21.15.59:59728) 2023-09-30T22:30:04.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.141+0000 7f4df0c19700 1 -- 172.21.15.59:0/1947425140 learned_addr learned my addr 172.21.15.59:0/1947425140 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:04.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.141+0000 7f4debfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dec06e570 0x7f4dec06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50526/0 (socket says 172.21.15.59:50526) 2023-09-30T22:30:04.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.142+0000 7f4deb7fe700 1 --2- 172.21.15.59:0/1947425140 >> v2:172.21.15.59:3300/0 conn(0x7f4dec09eca0 0x7f4dec06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.142+0000 7f4df0c19700 1 -- 172.21.15.59:0/1947425140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dec06e570 msgr2=0x7f4dec06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:04.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.142+0000 7f4df0c19700 1 --2- 172.21.15.59:0/1947425140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dec06e570 0x7f4dec06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.142+0000 7f4df0c19700 1 -- 172.21.15.59:0/1947425140 >> v2:172.21.15.59:3300/0 conn(0x7f4dec09eca0 msgr2=0x7f4dec06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:04.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.142+0000 7f4df0c19700 1 --2- 172.21.15.59:0/1947425140 >> v2:172.21.15.59:3300/0 conn(0x7f4dec09eca0 0x7f4dec06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.142+0000 7f4df0c19700 1 -- 172.21.15.59:0/1947425140 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec071b90 con 0x7f4dec134610 2023-09-30T22:30:04.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.142+0000 7f4df0c19700 1 --2- 172.21.15.59:0/1947425140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dec134610 0x7f4dec134a40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009e50 tx=0x7f4de400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fc1a69d663d7650 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:04.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.142+0000 7f4deaffd700 1 -- 172.21.15.59:0/1947425140 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400e070 con 0x7f4dec134610 2023-09-30T22:30:04.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.142+0000 7f4deaffd700 1 -- 172.21.15.59:0/1947425140 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de400b910 con 0x7f4dec134610 2023-09-30T22:30:04.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.142+0000 7f4deaffd700 1 -- 172.21.15.59:0/1947425140 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400bcc0 con 0x7f4dec134610 2023-09-30T22:30:04.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.143+0000 7f4df267c700 1 -- 172.21.15.59:0/1947425140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dec134610 msgr2=0x7f4dec134a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.143+0000 7f4df267c700 1 --2- 172.21.15.59:0/1947425140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dec134610 0x7f4dec134a40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009e50 tx=0x7f4de400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:04.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.143+0000 7f4df267c700 1 -- 172.21.15.59:0/1947425140 shutdown_connections 2023-09-30T22:30:04.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.143+0000 7f4df267c700 1 --2- 172.21.15.59:0/1947425140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dec134610 0x7f4dec134a40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.143+0000 7f4df267c700 1 --2- 172.21.15.59:0/1947425140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dec06e570 0x7f4dec06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.143+0000 7f4df267c700 1 --2- 172.21.15.59:0/1947425140 >> v2:172.21.15.59:3300/0 conn(0x7f4dec09eca0 0x7f4dec06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.143+0000 7f4df267c700 1 -- 172.21.15.59:0/1947425140 >> 172.21.15.59:0/1947425140 conn(0x7f4dec0a2aa0 msgr2=0x7f4dec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:04.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.143+0000 7f4df267c700 1 -- 172.21.15.59:0/1947425140 shutdown_connections 2023-09-30T22:30:04.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.143+0000 7f4df267c700 1 -- 172.21.15.59:0/1947425140 wait complete. 2023-09-30T22:30:04.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.145+0000 7f4df267c700 1 Processor -- start 2023-09-30T22:30:04.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.145+0000 7f4df267c700 1 -- start start 2023-09-30T22:30:04.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4df267c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dec06e570 0x7f4dec13e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4df267c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dec134610 0x7f4dec1d4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4df267c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dec1d5180 0x7f4dec1d5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4df267c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec13d7d0 con 0x7f4dec134610 2023-09-30T22:30:04.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4df267c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec139f20 con 0x7f4dec1d5180 2023-09-30T22:30:04.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4df267c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec13d150 con 0x7f4dec06e570 2023-09-30T22:30:04.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4debfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dec06e570 0x7f4dec13e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4debfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dec06e570 0x7f4dec13e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59734/0 (socket says 172.21.15.59:59734) 2023-09-30T22:30:04.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4debfff700 1 -- 172.21.15.59:0/104687994 learned_addr learned my addr 172.21.15.59:0/104687994 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:04.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4deb7fe700 1 --2- 172.21.15.59:0/104687994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dec134610 0x7f4dec1d4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4df0c19700 1 --2- 172.21.15.59:0/104687994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dec1d5180 0x7f4dec1d5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4debfff700 1 -- 172.21.15.59:0/104687994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dec1d5180 msgr2=0x7f4dec1d5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4debfff700 1 --2- 172.21.15.59:0/104687994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dec1d5180 0x7f4dec1d5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4debfff700 1 -- 172.21.15.59:0/104687994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dec134610 msgr2=0x7f4dec1d4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4debfff700 1 --2- 172.21.15.59:0/104687994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dec134610 0x7f4dec1d4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4debfff700 1 -- 172.21.15.59:0/104687994 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4009b30 con 0x7f4dec06e570 2023-09-30T22:30:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4deb7fe700 1 --2- 172.21.15.59:0/104687994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dec134610 0x7f4dec1d4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.146+0000 7f4df0c19700 1 --2- 172.21.15.59:0/104687994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dec1d5180 0x7f4dec1d5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.147+0000 7f4debfff700 1 --2- 172.21.15.59:0/104687994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dec06e570 0x7f4dec13e460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00e9b0 tx=0x7f4ddc00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.147+0000 7f4de8ff9700 1 -- 172.21.15.59:0/104687994 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc009710 con 0x7f4dec06e570 2023-09-30T22:30:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.147+0000 7f4de8ff9700 1 -- 172.21.15.59:0/104687994 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc00c850 con 0x7f4dec06e570 2023-09-30T22:30:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.147+0000 7f4df267c700 1 -- 172.21.15.59:0/104687994 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dec13d410 con 0x7f4dec06e570 2023-09-30T22:30:04.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.147+0000 7f4de8ff9700 1 -- 172.21.15.59:0/104687994 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc00cbc0 con 0x7f4dec06e570 2023-09-30T22:30:04.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.147+0000 7f4df267c700 1 -- 172.21.15.59:0/104687994 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dec126db0 con 0x7f4dec06e570 2023-09-30T22:30:04.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.148+0000 7f4de8ff9700 1 -- 172.21.15.59:0/104687994 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ddc00cd20 con 0x7f4dec06e570 2023-09-30T22:30:04.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.148+0000 7f4de8ff9700 1 -- 172.21.15.59:0/104687994 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4ddc03f780 con 0x7f4dec06e570 2023-09-30T22:30:04.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.148+0000 7f4df267c700 1 -- 172.21.15.59:0/104687994 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dec13d600 con 0x7f4dec06e570 2023-09-30T22:30:04.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.158+0000 7f4de8ff9700 1 -- 172.21.15.59:0/104687994 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ddc021080 con 0x7f4dec06e570 2023-09-30T22:30:04.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.181+0000 7f6a16ad1700 1 Processor -- start 2023-09-30T22:30:04.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.181+0000 7f6a16ad1700 1 -- start start 2023-09-30T22:30:04.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.181+0000 7f6a16ad1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a101338a0 0x7f6a10133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.181+0000 7f6a16ad1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a1009de50 0x7f6a1009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.181+0000 7f6a16ad1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009e760 0x7f6a1013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.181+0000 7f6a16ad1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1006fef0 con 0x7f6a1009de50 2023-09-30T22:30:04.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.181+0000 7f6a16ad1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1006ef30 con 0x7f6a1009e760 2023-09-30T22:30:04.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.181+0000 7f6a16ad1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a101334b0 con 0x7f6a101338a0 2023-09-30T22:30:04.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.181+0000 7f6a1506e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009e760 0x7f6a1013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.182+0000 7f6a1506e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009e760 0x7f6a1013a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50542/0 (socket says 172.21.15.59:50542) 2023-09-30T22:30:04.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.182+0000 7f6a1506e700 1 -- 172.21.15.59:0/1219828317 learned_addr learned my addr 172.21.15.59:0/1219828317 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:04.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.182+0000 7f6a1486d700 1 --2- 172.21.15.59:0/1219828317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a101338a0 0x7f6a10133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.182+0000 7f6a0ffff700 1 --2- 172.21.15.59:0/1219828317 >> v2:172.21.15.59:3300/0 conn(0x7f6a1009de50 0x7f6a1009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.182+0000 7f6a0ffff700 1 -- 172.21.15.59:0/1219828317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a101338a0 msgr2=0x7f6a10133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:04.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.182+0000 7f6a0ffff700 1 --2- 172.21.15.59:0/1219828317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a101338a0 0x7f6a10133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.182+0000 7f6a0ffff700 1 -- 172.21.15.59:0/1219828317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009e760 msgr2=0x7f6a1013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:04.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.182+0000 7f6a0ffff700 1 --2- 172.21.15.59:0/1219828317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009e760 0x7f6a1013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.182+0000 7f6a0ffff700 1 -- 172.21.15.59:0/1219828317 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1006fc30 con 0x7f6a1009de50 2023-09-30T22:30:04.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.182+0000 7f6a0ffff700 1 --2- 172.21.15.59:0/1219828317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009de50 0x7f6a1009e220 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009840 tx=0x7f69fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb780a6f3e166da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:04.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.182+0000 7f6a0f7fe700 1 -- 172.21.15.59:0/1219828317 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc011830 con 0x7f6a1009de50 2023-09-30T22:30:04.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.182+0000 7f6a0f7fe700 1 -- 172.21.15.59:0/1219828317 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc011990 con 0x7f6a1009de50 2023-09-30T22:30:04.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.182+0000 7f6a0f7fe700 1 -- 172.21.15.59:0/1219828317 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc011d20 con 0x7f6a1009de50 2023-09-30T22:30:04.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.183+0000 7f6a16ad1700 1 -- 172.21.15.59:0/1219828317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009de50 msgr2=0x7f6a1009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.183+0000 7f6a16ad1700 1 --2- 172.21.15.59:0/1219828317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009de50 0x7f6a1009e220 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009840 tx=0x7f69fc009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:04.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.183+0000 7f6a16ad1700 1 -- 172.21.15.59:0/1219828317 shutdown_connections 2023-09-30T22:30:04.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.183+0000 7f6a16ad1700 1 --2- 172.21.15.59:0/1219828317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009e760 0x7f6a1013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.183+0000 7f6a16ad1700 1 --2- 172.21.15.59:0/1219828317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a101338a0 0x7f6a10133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.183+0000 7f6a16ad1700 1 --2- 172.21.15.59:0/1219828317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009de50 0x7f6a1009e220 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.183+0000 7f6a16ad1700 1 -- 172.21.15.59:0/1219828317 >> 172.21.15.59:0/1219828317 conn(0x7f6a100a2aa0 msgr2=0x7f6a100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.183+0000 7f6a16ad1700 1 -- 172.21.15.59:0/1219828317 shutdown_connections 2023-09-30T22:30:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.183+0000 7f6a16ad1700 1 -- 172.21.15.59:0/1219828317 wait complete. 2023-09-30T22:30:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.185+0000 7f6a16ad1700 1 Processor -- start 2023-09-30T22:30:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.185+0000 7f6a16ad1700 1 -- start start 2023-09-30T22:30:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a16ad1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009de50 0x7f6a1011d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a16ad1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009e760 0x7f6a1011dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a16ad1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a101338a0 0x7f6a1011e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a16ad1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a10120fe0 con 0x7f6a1009de50 2023-09-30T22:30:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a16ad1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1011f330 con 0x7f6a101338a0 2023-09-30T22:30:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a16ad1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1011f930 con 0x7f6a1009e760 2023-09-30T22:30:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a1486d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009de50 0x7f6a1011d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a1486d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009de50 0x7f6a1011d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52070/0 (socket says 172.21.15.59:52070) 2023-09-30T22:30:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a1486d700 1 -- 172.21.15.59:0/777824796 learned_addr learned my addr 172.21.15.59:0/777824796 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a1506e700 1 --2- 172.21.15.59:0/777824796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a101338a0 0x7f6a1011e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a0ffff700 1 --2- 172.21.15.59:0/777824796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009e760 0x7f6a1011dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a1486d700 1 -- 172.21.15.59:0/777824796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009e760 msgr2=0x7f6a1011dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a1486d700 1 --2- 172.21.15.59:0/777824796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009e760 0x7f6a1011dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a1486d700 1 -- 172.21.15.59:0/777824796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a101338a0 msgr2=0x7f6a1011e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a1486d700 1 --2- 172.21.15.59:0/777824796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a101338a0 0x7f6a1011e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a1486d700 1 -- 172.21.15.59:0/777824796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc0094a0 con 0x7f6a1009de50 2023-09-30T22:30:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.186+0000 7f6a0ffff700 1 --2- 172.21.15.59:0/777824796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009e760 0x7f6a1011dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.187+0000 7f6a1486d700 1 --2- 172.21.15.59:0/777824796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009de50 0x7f6a1011d800 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400e9e0 tx=0x7f6a0400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.187+0000 7f6a0d7fa700 1 -- 172.21.15.59:0/777824796 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04009710 con 0x7f6a1009de50 2023-09-30T22:30:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.187+0000 7f6a16ad1700 1 -- 172.21.15.59:0/777824796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a10120560 con 0x7f6a1009de50 2023-09-30T22:30:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.187+0000 7f6a0d7fa700 1 -- 172.21.15.59:0/777824796 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0400c850 con 0x7f6a1009de50 2023-09-30T22:30:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.187+0000 7f6a0d7fa700 1 -- 172.21.15.59:0/777824796 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400cbc0 con 0x7f6a1009de50 2023-09-30T22:30:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.187+0000 7f6a16ad1700 1 -- 172.21.15.59:0/777824796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1006f640 con 0x7f6a1009de50 2023-09-30T22:30:04.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.188+0000 7f6a0d7fa700 1 -- 172.21.15.59:0/777824796 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a0400cd20 con 0x7f6a1009de50 2023-09-30T22:30:04.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.188+0000 7f6a0d7fa700 1 -- 172.21.15.59:0/777824796 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6a0403fae0 con 0x7f6a1009de50 2023-09-30T22:30:04.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.189+0000 7f6a16ad1700 1 -- 172.21.15.59:0/777824796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1011a470 con 0x7f6a1009de50 2023-09-30T22:30:04.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.194+0000 7f6a0d7fa700 1 -- 172.21.15.59:0/777824796 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a04017080 con 0x7f6a1009de50 2023-09-30T22:30:04.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.228+0000 7fe2e1034700 1 Processor -- start 2023-09-30T22:30:04.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.228+0000 7fe2e1034700 1 -- start start 2023-09-30T22:30:04.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.228+0000 7fe2e1034700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2dc09e1d0 0x7fe2dc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.228+0000 7fe2e1034700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2dc139170 0x7fe2dc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.228+0000 7fe2e1034700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc09b120 con 0x7fe2dc09d6f0 2023-09-30T22:30:04.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.228+0000 7fe2e1034700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc06b460 con 0x7fe2dc139170 2023-09-30T22:30:04.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.228+0000 7fe2e1034700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc09a7e0 con 0x7fe2dc09e1d0 2023-09-30T22:30:04.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.229+0000 7fe2da59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2dc09e1d0 0x7fe2dc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.229+0000 7fe2dad9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe2dc09d6f0 0x7fe2dc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54646/0 (socket says 172.21.15.59:54646) 2023-09-30T22:30:04.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.229+0000 7fe2dad9d700 1 -- 172.21.15.59:0/186435284 learned_addr learned my addr 172.21.15.59:0/186435284 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:04.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.229+0000 7fe2db59e700 1 --2- 172.21.15.59:0/186435284 >> v2:172.21.15.59:3300/0 conn(0x7fe2dc139170 0x7fe2dc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.229+0000 7fe2da59c700 1 -- 172.21.15.59:0/186435284 >> v2:172.21.15.59:3300/0 conn(0x7fe2dc139170 msgr2=0x7fe2dc13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:04.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.229+0000 7fe2da59c700 1 --2- 172.21.15.59:0/186435284 >> v2:172.21.15.59:3300/0 conn(0x7fe2dc139170 0x7fe2dc13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.229+0000 7fe2d9d9b700 1 -- 172.21.15.59:0/186435284 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077842119 0 0) 0x7fe2dc09b120 con 0x7fe2dc09d6f0 2023-09-30T22:30:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.229+0000 7fe2da59c700 1 -- 172.21.15.59:0/186435284 >> v1:172.21.15.59:6789/0 conn(0x7fe2dc09d6f0 legacy=0x7fe2dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.229+0000 7fe2da59c700 1 -- 172.21.15.59:0/186435284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc09a500 con 0x7fe2dc09e1d0 2023-09-30T22:30:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.229+0000 7fe2da59c700 1 --2- 172.21.15.59:0/186435284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2dc09e1d0 0x7fe2dc138c30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009870 tx=0x7fe2d0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63d09d851aea4613 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.229+0000 7fe2d9d9b700 1 -- 172.21.15.59:0/186435284 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0011830 con 0x7fe2dc09e1d0 2023-09-30T22:30:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.230+0000 7fe2d9d9b700 1 -- 172.21.15.59:0/186435284 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d0011990 con 0x7fe2dc09e1d0 2023-09-30T22:30:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.230+0000 7fe2d9d9b700 1 -- 172.21.15.59:0/186435284 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0011d20 con 0x7fe2dc09e1d0 2023-09-30T22:30:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.230+0000 7fe2e1034700 1 -- 172.21.15.59:0/186435284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2dc09e1d0 msgr2=0x7fe2dc138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.230+0000 7fe2e1034700 1 --2- 172.21.15.59:0/186435284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2dc09e1d0 0x7fe2dc138c30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009870 tx=0x7fe2d0009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.230+0000 7fe2e1034700 1 -- 172.21.15.59:0/186435284 shutdown_connections 2023-09-30T22:30:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.230+0000 7fe2e1034700 1 --2- 172.21.15.59:0/186435284 >> v2:172.21.15.59:3300/0 conn(0x7fe2dc139170 0x7fe2dc13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.230+0000 7fe2e1034700 1 --2- 172.21.15.59:0/186435284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2dc09e1d0 0x7fe2dc138c30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.230+0000 7fe2e1034700 1 -- 172.21.15.59:0/186435284 >> 172.21.15.59:0/186435284 conn(0x7fe2dc066f50 msgr2=0x7fe2dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:04.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.230+0000 7fe2e1034700 1 -- 172.21.15.59:0/186435284 shutdown_connections 2023-09-30T22:30:04.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.230+0000 7fe2e1034700 1 -- 172.21.15.59:0/186435284 wait complete. 2023-09-30T22:30:04.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.232+0000 7fe2e1034700 1 Processor -- start 2023-09-30T22:30:04.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.232+0000 7fe2e1034700 1 -- start start 2023-09-30T22:30:04.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.232+0000 7fe2e1034700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2dc09d6f0 0x7fe2dc1216c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.232+0000 7fe2e1034700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2dc09e1d0 0x7fe2dc121c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.232+0000 7fe2e1034700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2dc139170 0x7fe2dc122140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:04.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.232+0000 7fe2e1034700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc123b30 con 0x7fe2dc09d6f0 2023-09-30T22:30:04.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.232+0000 7fe2e1034700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc124590 con 0x7fe2dc139170 2023-09-30T22:30:04.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.232+0000 7fe2e1034700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc09c710 con 0x7fe2dc09e1d0 2023-09-30T22:30:04.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.232+0000 7fe2da59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2dc09e1d0 0x7fe2dc121c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.232+0000 7fe2da59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2dc09e1d0 0x7fe2dc121c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59750/0 (socket says 172.21.15.59:59750) 2023-09-30T22:30:04.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.232+0000 7fe2da59c700 1 -- 172.21.15.59:0/2699103513 learned_addr learned my addr 172.21.15.59:0/2699103513 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:04.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.232+0000 7fe2dad9d700 1 --2- 172.21.15.59:0/2699103513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2dc09d6f0 0x7fe2dc1216c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.232+0000 7fe2db59e700 1 --2- 172.21.15.59:0/2699103513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2dc139170 0x7fe2dc122140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:04.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.233+0000 7fe2db59e700 1 -- 172.21.15.59:0/2699103513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2dc09e1d0 msgr2=0x7fe2dc121c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.233+0000 7fe2db59e700 1 --2- 172.21.15.59:0/2699103513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2dc09e1d0 0x7fe2dc121c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.233+0000 7fe2db59e700 1 -- 172.21.15.59:0/2699103513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2dc09d6f0 msgr2=0x7fe2dc1216c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.233+0000 7fe2db59e700 1 --2- 172.21.15.59:0/2699103513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2dc09d6f0 0x7fe2dc1216c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.233+0000 7fe2db59e700 1 -- 172.21.15.59:0/2699103513 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d00094a0 con 0x7fe2dc139170 2023-09-30T22:30:04.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.233+0000 7fe2db59e700 1 --2- 172.21.15.59:0/2699103513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2dc139170 0x7fe2dc122140 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400efc0 tx=0x7fe2d400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:04.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.233+0000 7fe2c37fe700 1 -- 172.21.15.59:0/2699103513 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400cc90 con 0x7fe2dc139170 2023-09-30T22:30:04.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.233+0000 7fe2c37fe700 1 -- 172.21.15.59:0/2699103513 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d400f040 con 0x7fe2dc139170 2023-09-30T22:30:04.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.233+0000 7fe2e1034700 1 -- 172.21.15.59:0/2699103513 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc0a31a0 con 0x7fe2dc139170 2023-09-30T22:30:04.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.233+0000 7fe2c37fe700 1 -- 172.21.15.59:0/2699103513 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40146c0 con 0x7fe2dc139170 2023-09-30T22:30:04.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.233+0000 7fe2e1034700 1 -- 172.21.15.59:0/2699103513 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc1258e0 con 0x7fe2dc139170 2023-09-30T22:30:04.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.234+0000 7fe2e1034700 1 -- 172.21.15.59:0/2699103513 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc074ea0 con 0x7fe2dc139170 2023-09-30T22:30:04.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.235+0000 7fe2c37fe700 1 -- 172.21.15.59:0/2699103513 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2d4014820 con 0x7fe2dc139170 2023-09-30T22:30:04.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.236+0000 7fe2c37fe700 1 -- 172.21.15.59:0/2699103513 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe2d4040850 con 0x7fe2dc139170 2023-09-30T22:30:04.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.240+0000 7fe2c37fe700 1 -- 172.21.15.59:0/2699103513 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2d4014ad0 con 0x7fe2dc139170 2023-09-30T22:30:04.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.271+0000 7ff365c56700 1 -- 172.21.15.59:0/1601101938 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff3600a28e0 con 0x7ff3600a0a30 2023-09-30T22:30:04.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.272+0000 7ff347fff700 1 -- 172.21.15.59:0/1601101938 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff350017030 con 0x7ff3600a0a30 2023-09-30T22:30:04.273 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.274+0000 7ff365c56700 1 -- 172.21.15.59:0/1601101938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3600a0a30 msgr2=0x7ff360122930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.274+0000 7ff365c56700 1 --2- 172.21.15.59:0/1601101938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3600a0a30 0x7ff360122930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff350000f60 tx=0x7ff35000c730 comp rx=0 tx=0).stop 2023-09-30T22:30:04.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.274+0000 7ff365c56700 1 -- 172.21.15.59:0/1601101938 shutdown_connections 2023-09-30T22:30:04.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.274+0000 7ff365c56700 1 --2- 172.21.15.59:0/1601101938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff360139250 0x7ff3601233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.274+0000 7ff365c56700 1 --2- 172.21.15.59:0/1601101938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3600a0a30 0x7ff360122930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.274+0000 7ff365c56700 1 --2- 172.21.15.59:0/1601101938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3600a1510 0x7ff360122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.274+0000 7ff365c56700 1 -- 172.21.15.59:0/1601101938 >> 172.21.15.59:0/1601101938 conn(0x7ff3600a6550 msgr2=0x7ff3600a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:04.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.274+0000 7ff365c56700 1 -- 172.21.15.59:0/1601101938 shutdown_connections 2023-09-30T22:30:04.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.274+0000 7ff365c56700 1 -- 172.21.15.59:0/1601101938 wait complete. 2023-09-30T22:30:04.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:04.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.403+0000 7f6a16ad1700 1 -- 172.21.15.59:0/777824796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6a10074ea0 con 0x7f6a1009de50 2023-09-30T22:30:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.404+0000 7f6a0d7fa700 1 -- 172.21.15.59:0/777824796 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a04021020 con 0x7f6a1009de50 2023-09-30T22:30:04.405 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:04.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.406+0000 7f6a16ad1700 1 -- 172.21.15.59:0/777824796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009de50 msgr2=0x7f6a1011d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.406+0000 7f6a16ad1700 1 --2- 172.21.15.59:0/777824796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009de50 0x7f6a1011d800 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400e9e0 tx=0x7f6a0400ecf0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.406+0000 7f6a16ad1700 1 -- 172.21.15.59:0/777824796 shutdown_connections 2023-09-30T22:30:04.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.406+0000 7f6a16ad1700 1 --2- 172.21.15.59:0/777824796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a101338a0 0x7f6a1011e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.406+0000 7f6a16ad1700 1 --2- 172.21.15.59:0/777824796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009de50 0x7f6a1011d800 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.406+0000 7f6a16ad1700 1 --2- 172.21.15.59:0/777824796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009e760 0x7f6a1011dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.406+0000 7f6a16ad1700 1 -- 172.21.15.59:0/777824796 >> 172.21.15.59:0/777824796 conn(0x7f6a100a2aa0 msgr2=0x7f6a101bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:04.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.406+0000 7f6a16ad1700 1 -- 172.21.15.59:0/777824796 shutdown_connections 2023-09-30T22:30:04.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.406+0000 7f6a16ad1700 1 -- 172.21.15.59:0/777824796 wait complete. 2023-09-30T22:30:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.413+0000 7f4df267c700 1 -- 172.21.15.59:0/104687994 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4dec074ea0 con 0x7f4dec06e570 2023-09-30T22:30:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.413+0000 7f4de8ff9700 1 -- 172.21.15.59:0/104687994 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ddc017020 con 0x7f4dec06e570 2023-09-30T22:30:04.414 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.416+0000 7f4df267c700 1 -- 172.21.15.59:0/104687994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dec06e570 msgr2=0x7f4dec13e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.416+0000 7f4df267c700 1 --2- 172.21.15.59:0/104687994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dec06e570 0x7f4dec13e460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00e9b0 tx=0x7f4ddc00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.416+0000 7f4df267c700 1 -- 172.21.15.59:0/104687994 shutdown_connections 2023-09-30T22:30:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.416+0000 7f4df267c700 1 --2- 172.21.15.59:0/104687994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dec06e570 0x7f4dec13e460 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.416+0000 7f4df267c700 1 --2- 172.21.15.59:0/104687994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dec1d5180 0x7f4dec1d5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.416+0000 7f4df267c700 1 --2- 172.21.15.59:0/104687994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dec134610 0x7f4dec1d4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.416+0000 7f4df267c700 1 -- 172.21.15.59:0/104687994 >> 172.21.15.59:0/104687994 conn(0x7f4dec0a2aa0 msgr2=0x7f4dec1378a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.416+0000 7f4df267c700 1 -- 172.21.15.59:0/104687994 shutdown_connections 2023-09-30T22:30:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.416+0000 7f4df267c700 1 -- 172.21.15.59:0/104687994 wait complete. 2023-09-30T22:30:04.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:04.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:04.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.486+0000 7fe2e1034700 1 -- 172.21.15.59:0/2699103513 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe2dc09f420 con 0x7fe2dc139170 2023-09-30T22:30:04.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.486+0000 7fe2c37fe700 1 -- 172.21.15.59:0/2699103513 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2d402a070 con 0x7fe2dc139170 2023-09-30T22:30:04.488 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.489+0000 7fe2e1034700 1 -- 172.21.15.59:0/2699103513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2dc139170 msgr2=0x7fe2dc122140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.489+0000 7fe2e1034700 1 --2- 172.21.15.59:0/2699103513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2dc139170 0x7fe2dc122140 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400efc0 tx=0x7fe2d400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.489+0000 7fe2e1034700 1 -- 172.21.15.59:0/2699103513 shutdown_connections 2023-09-30T22:30:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.489+0000 7fe2e1034700 1 --2- 172.21.15.59:0/2699103513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2dc139170 0x7fe2dc122140 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.489+0000 7fe2e1034700 1 --2- 172.21.15.59:0/2699103513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2dc09d6f0 0x7fe2dc1216c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.489+0000 7fe2e1034700 1 --2- 172.21.15.59:0/2699103513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2dc09e1d0 0x7fe2dc121c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.489+0000 7fe2e1034700 1 -- 172.21.15.59:0/2699103513 >> 172.21.15.59:0/2699103513 conn(0x7fe2dc066f50 msgr2=0x7fe2dc070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.489+0000 7fe2e1034700 1 -- 172.21.15.59:0/2699103513 shutdown_connections 2023-09-30T22:30:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:04.489+0000 7fe2e1034700 1 -- 172.21.15.59:0/2699103513 wait complete. 2023-09-30T22:30:04.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:05.291 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:05.422 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:05.431 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:05.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.438+0000 7f26e26f7700 1 Processor -- start 2023-09-30T22:30:05.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.438+0000 7f26e26f7700 1 -- start start 2023-09-30T22:30:05.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.438+0000 7f26e26f7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f26dc06a770 0x7f26dc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.438+0000 7f26e26f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26dc06b080 0x7f26dc131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.438+0000 7f26e26f7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26dc131b40 0x7f26dc131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.438+0000 7f26e26f7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc09ece0 con 0x7f26dc06a770 2023-09-30T22:30:05.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.438+0000 7f26e26f7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc09e760 con 0x7f26dc06b080 2023-09-30T22:30:05.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.438+0000 7f26e26f7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc09e040 con 0x7f26dc131b40 2023-09-30T22:30:05.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.439+0000 7f26dbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f26dc06a770 0x7f26dc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.439+0000 7f26e0c94700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26dc131b40 0x7f26dc131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.439+0000 7f26db7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26dc06b080 0x7f26dc131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.439+0000 7f26dbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f26dc06a770 0x7f26dc06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51718/0 (socket says 172.21.15.59:51718) 2023-09-30T22:30:05.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.439+0000 7f26e0c94700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26dc131b40 0x7f26dc131fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53342/0 (socket says 172.21.15.59:53342) 2023-09-30T22:30:05.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.439+0000 7f26dbfff700 1 -- 172.21.15.59:0/3947473032 learned_addr learned my addr 172.21.15.59:0/3947473032 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.439+0000 7f26dbfff700 1 -- 172.21.15.59:0/3947473032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26dc131b40 msgr2=0x7f26dc131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.439+0000 7f26dbfff700 1 --2- 172.21.15.59:0/3947473032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26dc131b40 0x7f26dc131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.439+0000 7f26dbfff700 1 -- 172.21.15.59:0/3947473032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26dc06b080 msgr2=0x7f26dc131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.439+0000 7f26dbfff700 1 --2- 172.21.15.59:0/3947473032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26dc06b080 0x7f26dc131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.439+0000 7f26dbfff700 1 -- 172.21.15.59:0/3947473032 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc09f630 con 0x7f26dc06a770 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.439+0000 7f26db7fe700 1 --2- 172.21.15.59:0/3947473032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26dc06b080 0x7f26dc131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.439+0000 7f26e0c94700 1 --2- 172.21.15.59:0/3947473032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26dc131b40 0x7f26dc131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.439+0000 7f26dbfff700 1 --2- 172.21.15.59:0/3947473032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26dc06a770 0x7f26dc06ab40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0098f0 tx=0x7f26cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b8d22404f6798c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.439+0000 7f26daffd700 1 -- 172.21.15.59:0/3947473032 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc011830 con 0x7f26dc06a770 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.440+0000 7f26daffd700 1 -- 172.21.15.59:0/3947473032 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc011990 con 0x7f26dc06a770 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.440+0000 7f26daffd700 1 -- 172.21.15.59:0/3947473032 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc011d20 con 0x7f26dc06a770 2023-09-30T22:30:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.440+0000 7f26e26f7700 1 -- 172.21.15.59:0/3947473032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26dc06a770 msgr2=0x7f26dc06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.440+0000 7f26e26f7700 1 --2- 172.21.15.59:0/3947473032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26dc06a770 0x7f26dc06ab40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0098f0 tx=0x7f26cc009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.440+0000 7f26e26f7700 1 -- 172.21.15.59:0/3947473032 shutdown_connections 2023-09-30T22:30:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.440+0000 7f26e26f7700 1 --2- 172.21.15.59:0/3947473032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26dc131b40 0x7f26dc131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.440+0000 7f26e26f7700 1 --2- 172.21.15.59:0/3947473032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26dc06a770 0x7f26dc06ab40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.440+0000 7f26e26f7700 1 --2- 172.21.15.59:0/3947473032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26dc06b080 0x7f26dc131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.440+0000 7f26e26f7700 1 -- 172.21.15.59:0/3947473032 >> 172.21.15.59:0/3947473032 conn(0x7f26dc066f50 msgr2=0x7f26dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.440+0000 7f26e26f7700 1 -- 172.21.15.59:0/3947473032 shutdown_connections 2023-09-30T22:30:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.440+0000 7f26e26f7700 1 -- 172.21.15.59:0/3947473032 wait complete. 2023-09-30T22:30:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.441+0000 7f26e26f7700 1 Processor -- start 2023-09-30T22:30:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.442+0000 7f26e26f7700 1 -- start start 2023-09-30T22:30:05.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.442+0000 7f26e26f7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26dc06a770 0x7f26dc120f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.442+0000 7f26e26f7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26dc06b080 0x7f26dc1214d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.442+0000 7f26e26f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26dc131b40 0x7f26dc1c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.442+0000 7f26e26f7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc123f00 con 0x7f26dc06b080 2023-09-30T22:30:05.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.442+0000 7f26e26f7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc123c40 con 0x7f26dc131b40 2023-09-30T22:30:05.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.442+0000 7f26e26f7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc120b90 con 0x7f26dc06a770 2023-09-30T22:30:05.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.442+0000 7f26db7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26dc06b080 0x7f26dc1214d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.442+0000 7f26db7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26dc06b080 0x7f26dc1214d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51734/0 (socket says 172.21.15.59:51734) 2023-09-30T22:30:05.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.442+0000 7f26db7fe700 1 -- 172.21.15.59:0/2481894379 learned_addr learned my addr 172.21.15.59:0/2481894379 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:05.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.442+0000 7f26dbfff700 1 --2- 172.21.15.59:0/2481894379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26dc06a770 0x7f26dc120f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.443+0000 7f26e0c94700 1 --2- 172.21.15.59:0/2481894379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26dc131b40 0x7f26dc1c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.443+0000 7f26db7fe700 1 -- 172.21.15.59:0/2481894379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26dc06a770 msgr2=0x7f26dc120f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.443+0000 7f26db7fe700 1 --2- 172.21.15.59:0/2481894379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26dc06a770 0x7f26dc120f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.443+0000 7f26db7fe700 1 -- 172.21.15.59:0/2481894379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26dc131b40 msgr2=0x7f26dc1c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.443+0000 7f26db7fe700 1 --2- 172.21.15.59:0/2481894379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26dc131b40 0x7f26dc1c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.443+0000 7f26db7fe700 1 -- 172.21.15.59:0/2481894379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d00094a0 con 0x7f26dc06b080 2023-09-30T22:30:05.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.443+0000 7f26dbfff700 1 --2- 172.21.15.59:0/2481894379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26dc06a770 0x7f26dc120f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:05.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.443+0000 7f26db7fe700 1 --2- 172.21.15.59:0/2481894379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26dc06b080 0x7f26dc1214d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f26d000ebe0 tx=0x7f26d000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.443+0000 7f26d8ff9700 1 -- 172.21.15.59:0/2481894379 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0009800 con 0x7f26dc06b080 2023-09-30T22:30:05.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.443+0000 7f26d8ff9700 1 -- 172.21.15.59:0/2481894379 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d000c850 con 0x7f26dc06b080 2023-09-30T22:30:05.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.443+0000 7f26e26f7700 1 -- 172.21.15.59:0/2481894379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d4009a70 con 0x7f26dc06b080 2023-09-30T22:30:05.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.444+0000 7f26d8ff9700 1 -- 172.21.15.59:0/2481894379 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d000cbc0 con 0x7f26dc06b080 2023-09-30T22:30:05.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.444+0000 7f26e26f7700 1 -- 172.21.15.59:0/2481894379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc009550 con 0x7f26dc06b080 2023-09-30T22:30:05.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.445+0000 7f26e26f7700 1 -- 172.21.15.59:0/2481894379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26dc074ea0 con 0x7f26dc06b080 2023-09-30T22:30:05.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.445+0000 7f26d8ff9700 1 -- 172.21.15.59:0/2481894379 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26d000cd20 con 0x7f26dc06b080 2023-09-30T22:30:05.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.445+0000 7f26d8ff9700 1 -- 172.21.15.59:0/2481894379 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f26d003fc60 con 0x7f26dc06b080 2023-09-30T22:30:05.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.450+0000 7f26d8ff9700 1 -- 172.21.15.59:0/2481894379 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26d001ada0 con 0x7f26dc06b080 2023-09-30T22:30:05.505 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:05.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.570+0000 7ff0759d8700 1 Processor -- start 2023-09-30T22:30:05.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.570+0000 7ff0759d8700 1 -- start start 2023-09-30T22:30:05.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.571+0000 7ff0759d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009d6f0 0x7ff07009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.571+0000 7ff0759d8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff07009e410 0x7ff070134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.571+0000 7ff0759d8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07009b120 con 0x7ff07009e000 2023-09-30T22:30:05.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.571+0000 7ff0759d8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07006b460 con 0x7ff07009e410 2023-09-30T22:30:05.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.571+0000 7ff0759d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07009a7e0 con 0x7ff07009d6f0 2023-09-30T22:30:05.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.571+0000 7ff06f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff07009e410 0x7ff070134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.571+0000 7ff06effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009d6f0 0x7ff07009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.571+0000 7ff06f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff07009e410 0x7ff070134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51736/0 (socket says 172.21.15.59:51736) 2023-09-30T22:30:05.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.571+0000 7ff06f7fe700 1 -- 172.21.15.59:0/3826711785 learned_addr learned my addr 172.21.15.59:0/3826711785 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:05.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.571+0000 7ff06effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009d6f0 0x7ff07009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43072/0 (socket says 172.21.15.59:43072) 2023-09-30T22:30:05.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.572+0000 7ff06f7fe700 1 -- 172.21.15.59:0/3826711785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009d6f0 msgr2=0x7ff07009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:05.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.572+0000 7ff06f7fe700 1 --2- 172.21.15.59:0/3826711785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009d6f0 0x7ff07009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.572+0000 7ff06f7fe700 1 -- 172.21.15.59:0/3826711785 >> v1:172.21.15.59:6789/0 conn(0x7ff07009e000 legacy=0x7ff0701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.572+0000 7ff06f7fe700 1 -- 172.21.15.59:0/3826711785 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07009a500 con 0x7ff07009e410 2023-09-30T22:30:05.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.572+0000 7ff06effd700 1 --2- 172.21.15.59:0/3826711785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009d6f0 0x7ff07009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:05.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.572+0000 7ff06f7fe700 1 --2- 172.21.15.59:0/3826711785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07009e410 0x7ff070134100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff068009e50 tx=0x7ff06800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b669045477954639 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.572+0000 7ff06dffb700 1 -- 172.21.15.59:0/3826711785 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06800e070 con 0x7ff07009e410 2023-09-30T22:30:05.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.572+0000 7ff06dffb700 1 -- 172.21.15.59:0/3826711785 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06800b910 con 0x7ff07009e410 2023-09-30T22:30:05.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.573+0000 7ff06dffb700 1 -- 172.21.15.59:0/3826711785 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06800bcc0 con 0x7ff07009e410 2023-09-30T22:30:05.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.574+0000 7ff0759d8700 1 -- 172.21.15.59:0/3826711785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07009e410 msgr2=0x7ff070134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.574+0000 7ff0759d8700 1 --2- 172.21.15.59:0/3826711785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07009e410 0x7ff070134100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff068009e50 tx=0x7ff06800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:05.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.574+0000 7ff0759d8700 1 -- 172.21.15.59:0/3826711785 shutdown_connections 2023-09-30T22:30:05.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.574+0000 7ff0759d8700 1 --2- 172.21.15.59:0/3826711785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07009e410 0x7ff070134100 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.574+0000 7ff0759d8700 1 --2- 172.21.15.59:0/3826711785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009d6f0 0x7ff07009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.574+0000 7ff0759d8700 1 -- 172.21.15.59:0/3826711785 >> 172.21.15.59:0/3826711785 conn(0x7ff070066f50 msgr2=0x7ff07009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.574+0000 7ff0759d8700 1 -- 172.21.15.59:0/3826711785 shutdown_connections 2023-09-30T22:30:05.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.574+0000 7ff0759d8700 1 -- 172.21.15.59:0/3826711785 wait complete. 2023-09-30T22:30:05.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.575+0000 7ff0759d8700 1 Processor -- start 2023-09-30T22:30:05.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.575+0000 7ff0759d8700 1 -- start start 2023-09-30T22:30:05.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff0759d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009d6f0 0x7ff0701a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff0759d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07009e000 0x7ff0701a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff0759d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff07009e410 0x7ff0701a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff0759d8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0701a8770 con 0x7ff07009e000 2023-09-30T22:30:05.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff0759d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0701a7a10 con 0x7ff07009d6f0 2023-09-30T22:30:05.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff0759d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0700a3040 con 0x7ff07009e410 2023-09-30T22:30:05.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff06f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff07009e410 0x7ff0701a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff06effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009d6f0 0x7ff0701a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff06f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff07009e410 0x7ff0701a6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53356/0 (socket says 172.21.15.59:53356) 2023-09-30T22:30:05.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff06f7fe700 1 -- 172.21.15.59:0/2593329488 learned_addr learned my addr 172.21.15.59:0/2593329488 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:05.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff06e7fc700 1 --2- 172.21.15.59:0/2593329488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07009e000 0x7ff0701a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff06f7fe700 1 -- 172.21.15.59:0/2593329488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009d6f0 msgr2=0x7ff0701a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff06f7fe700 1 --2- 172.21.15.59:0/2593329488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009d6f0 0x7ff0701a5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff06f7fe700 1 -- 172.21.15.59:0/2593329488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07009e000 msgr2=0x7ff0701a6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff06f7fe700 1 --2- 172.21.15.59:0/2593329488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07009e000 0x7ff0701a6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.576+0000 7ff06f7fe700 1 -- 172.21.15.59:0/2593329488 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0600094a0 con 0x7ff07009e410 2023-09-30T22:30:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.577+0000 7ff06f7fe700 1 --2- 172.21.15.59:0/2593329488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff07009e410 0x7ff0701a6870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff068004270 tx=0x7ff068004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.577+0000 7ff057fff700 1 -- 172.21.15.59:0/2593329488 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0680048e0 con 0x7ff07009e410 2023-09-30T22:30:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.577+0000 7ff057fff700 1 -- 172.21.15.59:0/2593329488 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0680092e0 con 0x7ff07009e410 2023-09-30T22:30:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.577+0000 7ff0759d8700 1 -- 172.21.15.59:0/2593329488 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff068009b30 con 0x7ff07009e410 2023-09-30T22:30:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.577+0000 7ff057fff700 1 -- 172.21.15.59:0/2593329488 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06801c640 con 0x7ff07009e410 2023-09-30T22:30:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.577+0000 7ff0759d8700 1 -- 172.21.15.59:0/2593329488 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0701a8c30 con 0x7ff07009e410 2023-09-30T22:30:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.578+0000 7ff057fff700 1 -- 172.21.15.59:0/2593329488 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff06801c7a0 con 0x7ff07009e410 2023-09-30T22:30:05.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.578+0000 7ff0759d8700 1 -- 172.21.15.59:0/2593329488 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff070074ea0 con 0x7ff07009e410 2023-09-30T22:30:05.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.578+0000 7ff057fff700 1 -- 172.21.15.59:0/2593329488 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff068041270 con 0x7ff07009e410 2023-09-30T22:30:05.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.583+0000 7ff057fff700 1 -- 172.21.15.59:0/2593329488 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff068025450 con 0x7ff07009e410 2023-09-30T22:30:05.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.591+0000 7f1181875700 1 Processor -- start 2023-09-30T22:30:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.591+0000 7f1181875700 1 -- start start 2023-09-30T22:30:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.591+0000 7f1181875700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f117c06c0e0 0x7f117c09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.591+0000 7f1181875700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f117c1380f0 0x7f117c13fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.591+0000 7f1181875700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117c134980 con 0x7f117c134ec0 2023-09-30T22:30:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.591+0000 7f1181875700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117c06c4b0 con 0x7f117c1380f0 2023-09-30T22:30:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.591+0000 7f1181875700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c0a09c0 con 0x7f117c06c0e0 2023-09-30T22:30:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.592+0000 7f117affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f117c06c0e0 0x7f117c09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.592+0000 7f117affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f117c06c0e0 0x7f117c09ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43084/0 (socket says 172.21.15.59:43084) 2023-09-30T22:30:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.592+0000 7f117affd700 1 -- 172.21.15.59:0/2748200838 learned_addr learned my addr 172.21.15.59:0/2748200838 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.592+0000 7f117b7fe700 1 --2- 172.21.15.59:0/2748200838 >> v2:172.21.15.59:3300/0 conn(0x7f117c1380f0 0x7f117c13fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.592+0000 7f117affd700 1 -- 172.21.15.59:0/2748200838 >> v2:172.21.15.59:3300/0 conn(0x7f117c1380f0 msgr2=0x7f117c13fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:05.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.592+0000 7f117affd700 1 --2- 172.21.15.59:0/2748200838 >> v2:172.21.15.59:3300/0 conn(0x7f117c1380f0 0x7f117c13fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.592+0000 7f117affd700 1 -- 172.21.15.59:0/2748200838 >> v1:172.21.15.59:6789/0 conn(0x7f117c134ec0 legacy=0x7f117c1379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.592+0000 7f117affd700 1 -- 172.21.15.59:0/2748200838 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c0a0600 con 0x7f117c06c0e0 2023-09-30T22:30:05.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.592+0000 7f117affd700 1 --2- 172.21.15.59:0/2748200838 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f117c06c0e0 0x7f117c09ac90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f116c0098f0 tx=0x7f116c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14dd797d5d30add5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.593+0000 7f1179ffb700 1 -- 172.21.15.59:0/2748200838 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c004230 con 0x7f117c06c0e0 2023-09-30T22:30:05.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.593+0000 7f1179ffb700 1 -- 172.21.15.59:0/2748200838 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c004390 con 0x7f117c06c0e0 2023-09-30T22:30:05.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.593+0000 7f1179ffb700 1 -- 172.21.15.59:0/2748200838 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c0036a0 con 0x7f117c06c0e0 2023-09-30T22:30:05.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.594+0000 7f1181875700 1 -- 172.21.15.59:0/2748200838 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f117c06c0e0 msgr2=0x7f117c09ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.594+0000 7f1181875700 1 --2- 172.21.15.59:0/2748200838 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f117c06c0e0 0x7f117c09ac90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f116c0098f0 tx=0x7f116c009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:05.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.594+0000 7f1181875700 1 -- 172.21.15.59:0/2748200838 shutdown_connections 2023-09-30T22:30:05.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.594+0000 7f1181875700 1 --2- 172.21.15.59:0/2748200838 >> v2:172.21.15.59:3300/0 conn(0x7f117c1380f0 0x7f117c13fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.594+0000 7f1181875700 1 --2- 172.21.15.59:0/2748200838 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f117c06c0e0 0x7f117c09ac90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.594+0000 7f1181875700 1 -- 172.21.15.59:0/2748200838 >> 172.21.15.59:0/2748200838 conn(0x7f117c0a4210 msgr2=0x7f117c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.594+0000 7f1181875700 1 -- 172.21.15.59:0/2748200838 shutdown_connections 2023-09-30T22:30:05.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.594+0000 7f1181875700 1 -- 172.21.15.59:0/2748200838 wait complete. 2023-09-30T22:30:05.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.595+0000 7f1181875700 1 Processor -- start 2023-09-30T22:30:05.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.596+0000 7f1181875700 1 -- start start 2023-09-30T22:30:05.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.596+0000 7f1181875700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f117c06c0e0 0x7f117c11a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.596+0000 7f1181875700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f117c134ec0 0x7f117c11ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.596+0000 7f1181875700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f117c1380f0 0x7f117c11b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.596+0000 7f1181875700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c140df0 con 0x7f117c134ec0 2023-09-30T22:30:05.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.596+0000 7f1181875700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c11dd10 con 0x7f117c06c0e0 2023-09-30T22:30:05.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.596+0000 7f1181875700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f117c0a03f0 con 0x7f117c1380f0 2023-09-30T22:30:05.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.596+0000 7f117affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f117c06c0e0 0x7f117c11a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.596+0000 7f117affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f117c06c0e0 0x7f117c11a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43094/0 (socket says 172.21.15.59:43094) 2023-09-30T22:30:05.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.596+0000 7f117b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f117c1380f0 0x7f117c11b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.596+0000 7f117affd700 1 -- 172.21.15.59:0/1259255317 learned_addr learned my addr 172.21.15.59:0/1259255317 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:05.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.597+0000 7f117a7fc700 1 --2- 172.21.15.59:0/1259255317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f117c134ec0 0x7f117c11ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.597+0000 7f117b7fe700 1 -- 172.21.15.59:0/1259255317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f117c06c0e0 msgr2=0x7f117c11a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.597+0000 7f117b7fe700 1 --2- 172.21.15.59:0/1259255317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f117c06c0e0 0x7f117c11a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.597+0000 7f117b7fe700 1 -- 172.21.15.59:0/1259255317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f117c134ec0 msgr2=0x7f117c11ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.597+0000 7f117b7fe700 1 --2- 172.21.15.59:0/1259255317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f117c134ec0 0x7f117c11ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.597+0000 7f117b7fe700 1 -- 172.21.15.59:0/1259255317 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c009550 con 0x7f117c1380f0 2023-09-30T22:30:05.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.597+0000 7f117affd700 1 --2- 172.21.15.59:0/1259255317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f117c06c0e0 0x7f117c11a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:05.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.597+0000 7f117b7fe700 1 --2- 172.21.15.59:0/1259255317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f117c1380f0 0x7f117c11b370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1174007d90 tx=0x7f117400e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.597+0000 7f1163fff700 1 -- 172.21.15.59:0/1259255317 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174018070 con 0x7f117c1380f0 2023-09-30T22:30:05.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.597+0000 7f1181875700 1 -- 172.21.15.59:0/1259255317 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117c11d050 con 0x7f117c1380f0 2023-09-30T22:30:05.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.597+0000 7f1163fff700 1 -- 172.21.15.59:0/1259255317 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117400ebe0 con 0x7f117c1380f0 2023-09-30T22:30:05.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.597+0000 7f1163fff700 1 -- 172.21.15.59:0/1259255317 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174003a20 con 0x7f117c1380f0 2023-09-30T22:30:05.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.597+0000 7f1181875700 1 -- 172.21.15.59:0/1259255317 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117c11c350 con 0x7f117c1380f0 2023-09-30T22:30:05.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.598+0000 7f1181875700 1 -- 172.21.15.59:0/1259255317 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117c074ea0 con 0x7f117c1380f0 2023-09-30T22:30:05.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.599+0000 7f1163fff700 1 -- 172.21.15.59:0/1259255317 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1174014420 con 0x7f117c1380f0 2023-09-30T22:30:05.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.599+0000 7f1163fff700 1 -- 172.21.15.59:0/1259255317 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f11740406e0 con 0x7f117c1380f0 2023-09-30T22:30:05.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.608+0000 7f1163fff700 1 -- 172.21.15.59:0/1259255317 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11740146d0 con 0x7f117c1380f0 2023-09-30T22:30:05.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.651+0000 7f7f25dc2700 1 Processor -- start 2023-09-30T22:30:05.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.651+0000 7f7f25dc2700 1 -- start start 2023-09-30T22:30:05.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.652+0000 7f7f25dc2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f2009d6f0 0x7f7f2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.652+0000 7f7f25dc2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7f2009e000 0x7f7f201339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.652+0000 7f7f25dc2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2009b120 con 0x7f7f2009e410 2023-09-30T22:30:05.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.652+0000 7f7f25dc2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2006b460 con 0x7f7f2009e000 2023-09-30T22:30:05.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.652+0000 7f7f25dc2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2009a7e0 con 0x7f7f2009d6f0 2023-09-30T22:30:05.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.652+0000 7f7f1ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7f2009e410 0x7f7f20133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37240/0 (socket says 172.21.15.59:37240) 2023-09-30T22:30:05.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.652+0000 7f7f1ffff700 1 -- 172.21.15.59:0/2934963868 learned_addr learned my addr 172.21.15.59:0/2934963868 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:05.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.652+0000 7f7f1effd700 1 --2- 172.21.15.59:0/2934963868 >> v2:172.21.15.59:3300/0 conn(0x7f7f2009e000 0x7f7f201339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.653+0000 7f7f1f7fe700 1 --2- 172.21.15.59:0/2934963868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f2009d6f0 0x7f7f2009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.653+0000 7f7f1effd700 1 -- 172.21.15.59:0/2934963868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f2009d6f0 msgr2=0x7f7f2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:05.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.653+0000 7f7f1effd700 1 --2- 172.21.15.59:0/2934963868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f2009d6f0 0x7f7f2009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.653+0000 7f7f1effd700 1 -- 172.21.15.59:0/2934963868 >> v1:172.21.15.59:6789/0 conn(0x7f7f2009e410 legacy=0x7f7f20133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.653+0000 7f7f1effd700 1 -- 172.21.15.59:0/2934963868 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2009a500 con 0x7f7f2009e000 2023-09-30T22:30:05.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.653+0000 7f7f1e7fc700 1 -- 172.21.15.59:0/2934963868 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178559356 0 0) 0x7f7f2009b120 con 0x7f7f2009e410 2023-09-30T22:30:05.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.653+0000 7f7f1effd700 1 --2- 172.21.15.59:0/2934963868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2009e000 0x7f7f201339f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009840 tx=0x7f7f14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242bb428d1d3759b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.653+0000 7f7f1e7fc700 1 -- 172.21.15.59:0/2934963868 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f14011830 con 0x7f7f2009e000 2023-09-30T22:30:05.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.653+0000 7f7f1e7fc700 1 -- 172.21.15.59:0/2934963868 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f14011990 con 0x7f7f2009e000 2023-09-30T22:30:05.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.653+0000 7f7f1e7fc700 1 -- 172.21.15.59:0/2934963868 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f14011d20 con 0x7f7f2009e000 2023-09-30T22:30:05.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.654+0000 7f7f25dc2700 1 -- 172.21.15.59:0/2934963868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2009e000 msgr2=0x7f7f201339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.654+0000 7f7f25dc2700 1 --2- 172.21.15.59:0/2934963868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2009e000 0x7f7f201339f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009840 tx=0x7f7f14009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:05.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.654+0000 7f7f25dc2700 1 -- 172.21.15.59:0/2934963868 shutdown_connections 2023-09-30T22:30:05.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.654+0000 7f7f25dc2700 1 --2- 172.21.15.59:0/2934963868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f2009d6f0 0x7f7f2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.654+0000 7f7f25dc2700 1 --2- 172.21.15.59:0/2934963868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2009e000 0x7f7f201339f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.654+0000 7f7f25dc2700 1 -- 172.21.15.59:0/2934963868 >> 172.21.15.59:0/2934963868 conn(0x7f7f20066f50 msgr2=0x7f7f2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.654+0000 7f7f25dc2700 1 -- 172.21.15.59:0/2934963868 shutdown_connections 2023-09-30T22:30:05.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.654+0000 7f7f25dc2700 1 -- 172.21.15.59:0/2934963868 wait complete. 2023-09-30T22:30:05.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.655+0000 7f7f25dc2700 1 Processor -- start 2023-09-30T22:30:05.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.656+0000 7f7f25dc2700 1 -- start start 2023-09-30T22:30:05.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.656+0000 7f7f25dc2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f2009d6f0 0x7f7f201a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.656+0000 7f7f25dc2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f2009e000 0x7f7f201a5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.656+0000 7f7f25dc2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2009e410 0x7f7f201c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.656+0000 7f7f25dc2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f201b9180 con 0x7f7f2009e410 2023-09-30T22:30:05.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.656+0000 7f7f25dc2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f201a4cd0 con 0x7f7f2009e000 2023-09-30T22:30:05.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.656+0000 7f7f25dc2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f201a6400 con 0x7f7f2009d6f0 2023-09-30T22:30:05.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.656+0000 7f7f1ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2009e410 0x7f7f201c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.656+0000 7f7f1ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2009e410 0x7f7f201c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51778/0 (socket says 172.21.15.59:51778) 2023-09-30T22:30:05.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.656+0000 7f7f1ffff700 1 -- 172.21.15.59:0/3815737295 learned_addr learned my addr 172.21.15.59:0/3815737295 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:05.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.656+0000 7f7f1f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f2009d6f0 0x7f7f201a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.656+0000 7f7f1effd700 1 --2- 172.21.15.59:0/3815737295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f2009e000 0x7f7f201a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.657+0000 7f7f1ffff700 1 -- 172.21.15.59:0/3815737295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f2009d6f0 msgr2=0x7f7f201a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.657+0000 7f7f1ffff700 1 --2- 172.21.15.59:0/3815737295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f2009d6f0 0x7f7f201a50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.657+0000 7f7f1ffff700 1 -- 172.21.15.59:0/3815737295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f2009e000 msgr2=0x7f7f201a5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.657+0000 7f7f1ffff700 1 --2- 172.21.15.59:0/3815737295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f2009e000 0x7f7f201a5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.657+0000 7f7f1ffff700 1 -- 172.21.15.59:0/3815737295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f140094a0 con 0x7f7f2009e410 2023-09-30T22:30:05.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.657+0000 7f7f1ffff700 1 --2- 172.21.15.59:0/3815737295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2009e410 0x7f7f201c8020 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7f18002230 tx=0x7f7f1800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.657+0000 7f7f07fff700 1 -- 172.21.15.59:0/3815737295 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800aac0 con 0x7f7f2009e410 2023-09-30T22:30:05.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.657+0000 7f7f07fff700 1 -- 172.21.15.59:0/3815737295 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1800ac20 con 0x7f7f2009e410 2023-09-30T22:30:05.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.657+0000 7f7f25dc2700 1 -- 172.21.15.59:0/3815737295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f201a7d70 con 0x7f7f2009e410 2023-09-30T22:30:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.657+0000 7f7f07fff700 1 -- 172.21.15.59:0/3815737295 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f180070d0 con 0x7f7f2009e410 2023-09-30T22:30:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.657+0000 7f7f25dc2700 1 -- 172.21.15.59:0/3815737295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f201a7070 con 0x7f7f2009e410 2023-09-30T22:30:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.658+0000 7f7f07fff700 1 -- 172.21.15.59:0/3815737295 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f18007230 con 0x7f7f2009e410 2023-09-30T22:30:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.659+0000 7f7f07fff700 1 -- 172.21.15.59:0/3815737295 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7f1803f510 con 0x7f7f2009e410 2023-09-30T22:30:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.659+0000 7f7f25dc2700 1 -- 172.21.15.59:0/3815737295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f201a8270 con 0x7f7f2009e410 2023-09-30T22:30:05.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.668+0000 7f7f07fff700 1 -- 172.21.15.59:0/3815737295 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f201a8270 con 0x7f7f2009e410 2023-09-30T22:30:05.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.675+0000 7f26e26f7700 1 -- 172.21.15.59:0/2481894379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f26dc06c360 con 0x7f26dc06b080 2023-09-30T22:30:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.676+0000 7f26d8ff9700 1 -- 172.21.15.59:0/2481894379 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26d0021090 con 0x7f26dc06b080 2023-09-30T22:30:05.677 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:05.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.679+0000 7f26e26f7700 1 -- 172.21.15.59:0/2481894379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26dc06b080 msgr2=0x7f26dc1214d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.679+0000 7f26e26f7700 1 --2- 172.21.15.59:0/2481894379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26dc06b080 0x7f26dc1214d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f26d000ebe0 tx=0x7f26d000eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.679+0000 7f26e26f7700 1 -- 172.21.15.59:0/2481894379 shutdown_connections 2023-09-30T22:30:05.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.679+0000 7f26e26f7700 1 --2- 172.21.15.59:0/2481894379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26dc06a770 0x7f26dc120f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.679+0000 7f26e26f7700 1 --2- 172.21.15.59:0/2481894379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26dc131b40 0x7f26dc1c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.679+0000 7f26e26f7700 1 --2- 172.21.15.59:0/2481894379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26dc06b080 0x7f26dc1214d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.679+0000 7f26e26f7700 1 -- 172.21.15.59:0/2481894379 >> 172.21.15.59:0/2481894379 conn(0x7f26dc066f50 msgr2=0x7f26dc0700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.679+0000 7f26e26f7700 1 -- 172.21.15.59:0/2481894379 shutdown_connections 2023-09-30T22:30:05.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.679+0000 7f26e26f7700 1 -- 172.21.15.59:0/2481894379 wait complete. 2023-09-30T22:30:05.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:05.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.802+0000 7ff0759d8700 1 -- 172.21.15.59:0/2593329488 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff07006c360 con 0x7ff07009e410 2023-09-30T22:30:05.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.802+0000 7ff057fff700 1 -- 172.21.15.59:0/2593329488 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff06802db40 con 0x7ff07009e410 2023-09-30T22:30:05.803 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:05.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.804+0000 7ff0759d8700 1 -- 172.21.15.59:0/2593329488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff07009e410 msgr2=0x7ff0701a6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.804+0000 7ff0759d8700 1 --2- 172.21.15.59:0/2593329488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff07009e410 0x7ff0701a6870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff068004270 tx=0x7ff068004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.804+0000 7ff0759d8700 1 -- 172.21.15.59:0/2593329488 shutdown_connections 2023-09-30T22:30:05.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.804+0000 7ff0759d8700 1 --2- 172.21.15.59:0/2593329488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff07009e410 0x7ff0701a6870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.804+0000 7ff0759d8700 1 --2- 172.21.15.59:0/2593329488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009d6f0 0x7ff0701a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.804+0000 7ff0759d8700 1 --2- 172.21.15.59:0/2593329488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff07009e000 0x7ff0701a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.804+0000 7ff0759d8700 1 -- 172.21.15.59:0/2593329488 >> 172.21.15.59:0/2593329488 conn(0x7ff070066f50 msgr2=0x7ff0701bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.805+0000 7ff0759d8700 1 -- 172.21.15.59:0/2593329488 shutdown_connections 2023-09-30T22:30:05.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.805+0000 7ff0759d8700 1 -- 172.21.15.59:0/2593329488 wait complete. 2023-09-30T22:30:05.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:05.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.818+0000 7f1181875700 1 -- 172.21.15.59:0/1259255317 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f117c11d5b0 con 0x7f117c1380f0 2023-09-30T22:30:05.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.818+0000 7f1163fff700 1 -- 172.21.15.59:0/1259255317 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f117402c090 con 0x7f117c1380f0 2023-09-30T22:30:05.820 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:05.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.821+0000 7f1181875700 1 -- 172.21.15.59:0/1259255317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f117c1380f0 msgr2=0x7f117c11b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.821+0000 7f1181875700 1 --2- 172.21.15.59:0/1259255317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f117c1380f0 0x7f117c11b370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1174007d90 tx=0x7f117400e3c0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.821+0000 7f1181875700 1 -- 172.21.15.59:0/1259255317 shutdown_connections 2023-09-30T22:30:05.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.821+0000 7f1181875700 1 --2- 172.21.15.59:0/1259255317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f117c1380f0 0x7f117c11b370 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.821+0000 7f1181875700 1 --2- 172.21.15.59:0/1259255317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f117c06c0e0 0x7f117c11a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.821+0000 7f1181875700 1 --2- 172.21.15.59:0/1259255317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f117c134ec0 0x7f117c11ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.821+0000 7f1181875700 1 -- 172.21.15.59:0/1259255317 >> 172.21.15.59:0/1259255317 conn(0x7f117c0a4210 msgr2=0x7f117c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.821+0000 7f1181875700 1 -- 172.21.15.59:0/1259255317 shutdown_connections 2023-09-30T22:30:05.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.821+0000 7f1181875700 1 -- 172.21.15.59:0/1259255317 wait complete. 2023-09-30T22:30:05.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.879+0000 7f7f25dc2700 1 -- 172.21.15.59:0/3815737295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7f20074ea0 con 0x7f7f2009e410 2023-09-30T22:30:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.879+0000 7f7f07fff700 1 -- 172.21.15.59:0/3815737295 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f18018080 con 0x7f7f2009e410 2023-09-30T22:30:05.881 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:05.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.882+0000 7f7f25dc2700 1 -- 172.21.15.59:0/3815737295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2009e410 msgr2=0x7f7f201c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.882+0000 7f7f25dc2700 1 --2- 172.21.15.59:0/3815737295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2009e410 0x7f7f201c8020 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7f18002230 tx=0x7f7f1800cf50 comp rx=0 tx=0).stop 2023-09-30T22:30:05.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.882+0000 7f7f25dc2700 1 -- 172.21.15.59:0/3815737295 shutdown_connections 2023-09-30T22:30:05.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.882+0000 7f7f25dc2700 1 --2- 172.21.15.59:0/3815737295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f2009d6f0 0x7f7f201a50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.882+0000 7f7f25dc2700 1 --2- 172.21.15.59:0/3815737295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2009e410 0x7f7f201c8020 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.882+0000 7f7f25dc2700 1 --2- 172.21.15.59:0/3815737295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f2009e000 0x7f7f201a5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.882+0000 7f7f25dc2700 1 -- 172.21.15.59:0/3815737295 >> 172.21.15.59:0/3815737295 conn(0x7f7f20066f50 msgr2=0x7f7f201bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.882+0000 7f7f25dc2700 1 -- 172.21.15.59:0/3815737295 shutdown_connections 2023-09-30T22:30:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:05.882+0000 7f7f25dc2700 1 -- 172.21.15.59:0/3815737295 wait complete. 2023-09-30T22:30:05.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:06.696 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:06.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:06.836 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.841+0000 7f18fdd4a700 1 Processor -- start 2023-09-30T22:30:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.841+0000 7f18fdd4a700 1 -- start start 2023-09-30T22:30:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.842+0000 7f18fdd4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f18f806a770 0x7f18f806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.842+0000 7f18fdd4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f8131d10 0x7f18f8139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.842+0000 7f18fdd4a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f809ece0 con 0x7f18f806b080 2023-09-30T22:30:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.842+0000 7f18fdd4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f809e760 con 0x7f18f8131d10 2023-09-30T22:30:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.842+0000 7f18fdd4a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18f809e040 con 0x7f18f806a770 2023-09-30T22:30:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.842+0000 7f18f6ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f18f806b080 0x7f18f8131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37256/0 (socket says 172.21.15.59:37256) 2023-09-30T22:30:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.842+0000 7f18f6ffd700 1 -- 172.21.15.59:0/3853097073 learned_addr learned my addr 172.21.15.59:0/3853097073 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.842+0000 7f18f7fff700 1 --2- 172.21.15.59:0/3853097073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f8131d10 0x7f18f8139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.842+0000 7f18f77fe700 1 --2- 172.21.15.59:0/3853097073 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f18f806a770 0x7f18f806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.843+0000 7f18f7fff700 1 -- 172.21.15.59:0/3853097073 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f18f806a770 msgr2=0x7f18f806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:06.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.843+0000 7f18f67fc700 1 -- 172.21.15.59:0/3853097073 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726782461 0 0) 0x7f18f809ece0 con 0x7f18f806b080 2023-09-30T22:30:06.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.843+0000 7f18f7fff700 1 --2- 172.21.15.59:0/3853097073 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f18f806a770 0x7f18f806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.843+0000 7f18f7fff700 1 -- 172.21.15.59:0/3853097073 >> v1:172.21.15.59:6789/0 conn(0x7f18f806b080 legacy=0x7f18f8131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.843+0000 7f18f7fff700 1 -- 172.21.15.59:0/3853097073 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f809f630 con 0x7f18f8131d10 2023-09-30T22:30:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.843+0000 7f18f7fff700 1 --2- 172.21.15.59:0/3853097073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f8131d10 0x7f18f8139860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009dc0 tx=0x7f18f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c13b6940420b8332 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.843+0000 7f18f67fc700 1 -- 172.21.15.59:0/3853097073 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f000e070 con 0x7f18f8131d10 2023-09-30T22:30:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.843+0000 7f18f67fc700 1 -- 172.21.15.59:0/3853097073 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f000bb20 con 0x7f18f8131d10 2023-09-30T22:30:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.843+0000 7f18f67fc700 1 -- 172.21.15.59:0/3853097073 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0012430 con 0x7f18f8131d10 2023-09-30T22:30:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.844+0000 7f18fdd4a700 1 -- 172.21.15.59:0/3853097073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f8131d10 msgr2=0x7f18f8139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.844+0000 7f18fdd4a700 1 --2- 172.21.15.59:0/3853097073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f8131d10 0x7f18f8139860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009dc0 tx=0x7f18f000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.844+0000 7f18fdd4a700 1 -- 172.21.15.59:0/3853097073 shutdown_connections 2023-09-30T22:30:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.844+0000 7f18fdd4a700 1 --2- 172.21.15.59:0/3853097073 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f18f806a770 0x7f18f806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.844+0000 7f18fdd4a700 1 --2- 172.21.15.59:0/3853097073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f8131d10 0x7f18f8139860 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.844+0000 7f18fdd4a700 1 -- 172.21.15.59:0/3853097073 >> 172.21.15.59:0/3853097073 conn(0x7f18f8066f50 msgr2=0x7f18f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.844+0000 7f18fdd4a700 1 -- 172.21.15.59:0/3853097073 shutdown_connections 2023-09-30T22:30:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.844+0000 7f18fdd4a700 1 -- 172.21.15.59:0/3853097073 wait complete. 2023-09-30T22:30:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.845+0000 7f18fdd4a700 1 Processor -- start 2023-09-30T22:30:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.845+0000 7f18fdd4a700 1 -- start start 2023-09-30T22:30:06.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.846+0000 7f18fdd4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f806a770 0x7f18f8120380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.846+0000 7f18fdd4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f18f806b080 0x7f18f81208c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.846+0000 7f18fdd4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f8131d10 0x7f18f8120e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.846+0000 7f18fdd4a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8131340 con 0x7f18f8131d10 2023-09-30T22:30:06.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.846+0000 7f18fdd4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f81220a0 con 0x7f18f806a770 2023-09-30T22:30:06.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.846+0000 7f18fdd4a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8071e60 con 0x7f18f806b080 2023-09-30T22:30:06.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.846+0000 7f18f77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f806a770 0x7f18f8120380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.846+0000 7f18f77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f806a770 0x7f18f8120380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43138/0 (socket says 172.21.15.59:43138) 2023-09-30T22:30:06.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.846+0000 7f18f6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f18f806b080 0x7f18f81208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.846+0000 7f18f77fe700 1 -- 172.21.15.59:0/4206543864 learned_addr learned my addr 172.21.15.59:0/4206543864 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:06.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.846+0000 7f18f7fff700 1 --2- 172.21.15.59:0/4206543864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f8131d10 0x7f18f8120e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.847+0000 7f18f77fe700 1 -- 172.21.15.59:0/4206543864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f18f806b080 msgr2=0x7f18f81208c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.847+0000 7f18f77fe700 1 --2- 172.21.15.59:0/4206543864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f18f806b080 0x7f18f81208c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.847+0000 7f18f77fe700 1 -- 172.21.15.59:0/4206543864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f8131d10 msgr2=0x7f18f8120e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.847+0000 7f18f77fe700 1 --2- 172.21.15.59:0/4206543864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f8131d10 0x7f18f8120e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.847+0000 7f18f77fe700 1 -- 172.21.15.59:0/4206543864 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f0009a70 con 0x7f18f806a770 2023-09-30T22:30:06.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.847+0000 7f18f6ffd700 1 --2- 172.21.15.59:0/4206543864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f18f806b080 0x7f18f81208c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:06.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.847+0000 7f18f77fe700 1 --2- 172.21.15.59:0/4206543864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f806a770 0x7f18f8120380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f18e800e9b0 tx=0x7f18e800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:06.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.847+0000 7f18dffff700 1 -- 172.21.15.59:0/4206543864 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8009710 con 0x7f18f806a770 2023-09-30T22:30:06.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.847+0000 7f18dffff700 1 -- 172.21.15.59:0/4206543864 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e800ee50 con 0x7f18f806a770 2023-09-30T22:30:06.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.847+0000 7f18dffff700 1 -- 172.21.15.59:0/4206543864 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e800ca50 con 0x7f18f806a770 2023-09-30T22:30:06.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.847+0000 7f18fdd4a700 1 -- 172.21.15.59:0/4206543864 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f8123900 con 0x7f18f806a770 2023-09-30T22:30:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.847+0000 7f18fdd4a700 1 -- 172.21.15.59:0/4206543864 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f8124630 con 0x7f18f806a770 2023-09-30T22:30:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.848+0000 7f18dffff700 1 -- 172.21.15.59:0/4206543864 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18e800cbb0 con 0x7f18f806a770 2023-09-30T22:30:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.848+0000 7f18fdd4a700 1 -- 172.21.15.59:0/4206543864 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f8074ea0 con 0x7f18f806a770 2023-09-30T22:30:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.849+0000 7f18dffff700 1 -- 172.21.15.59:0/4206543864 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f18e803f740 con 0x7f18f806a770 2023-09-30T22:30:06.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.854+0000 7f18dffff700 1 -- 172.21.15.59:0/4206543864 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18e80232f0 con 0x7f18f806a770 2023-09-30T22:30:06.897 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:06.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.972+0000 7f0da5f99700 1 Processor -- start 2023-09-30T22:30:06.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.972+0000 7f0da5f99700 1 -- start start 2023-09-30T22:30:06.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.972+0000 7f0da5f99700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da0130540 0x7f0da0130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.972+0000 7f0da5f99700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0da006fcf0 0x7f0da0138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.973+0000 7f0da5f99700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da00716a0 con 0x7f0da0130e50 2023-09-30T22:30:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.973+0000 7f0da5f99700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da009a390 con 0x7f0da006fcf0 2023-09-30T22:30:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.973+0000 7f0da5f99700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0da0071290 con 0x7f0da0130540 2023-09-30T22:30:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.973+0000 7f0d9f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da0130540 0x7f0da0130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.973+0000 7f0d9f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da0130540 0x7f0da0130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53392/0 (socket says 172.21.15.59:53392) 2023-09-30T22:30:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.973+0000 7f0d9f7fe700 1 -- 172.21.15.59:0/303557270 learned_addr learned my addr 172.21.15.59:0/303557270 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.973+0000 7f0d9f7fe700 1 -- 172.21.15.59:0/303557270 >> v2:172.21.15.59:3300/0 conn(0x7f0da006fcf0 msgr2=0x7f0da0138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.973+0000 7f0d9f7fe700 1 --2- 172.21.15.59:0/303557270 >> v2:172.21.15.59:3300/0 conn(0x7f0da006fcf0 0x7f0da0138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.973+0000 7f0d9f7fe700 1 -- 172.21.15.59:0/303557270 >> v1:172.21.15.59:6789/0 conn(0x7f0da0130e50 legacy=0x7f0da006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.973+0000 7f0d9f7fe700 1 -- 172.21.15.59:0/303557270 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da0130340 con 0x7f0da0130540 2023-09-30T22:30:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.973+0000 7f0d9f7fe700 1 --2- 172.21.15.59:0/303557270 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da0130540 0x7f0da0130910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000bbc0 tx=0x7f0d9000bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f77d6be0b879220a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.974+0000 7f0d9e7fc700 1 -- 172.21.15.59:0/303557270 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9000dd10 con 0x7f0da0130540 2023-09-30T22:30:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.974+0000 7f0d9e7fc700 1 -- 172.21.15.59:0/303557270 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9000de70 con 0x7f0da0130540 2023-09-30T22:30:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.974+0000 7f0d9e7fc700 1 -- 172.21.15.59:0/303557270 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90004230 con 0x7f0da0130540 2023-09-30T22:30:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.975+0000 7f0da5f99700 1 -- 172.21.15.59:0/303557270 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da0130540 msgr2=0x7f0da0130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.975+0000 7f0da5f99700 1 --2- 172.21.15.59:0/303557270 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da0130540 0x7f0da0130910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000bbc0 tx=0x7f0d9000bed0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.975+0000 7f0da5f99700 1 -- 172.21.15.59:0/303557270 shutdown_connections 2023-09-30T22:30:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.975+0000 7f0da5f99700 1 --2- 172.21.15.59:0/303557270 >> v2:172.21.15.59:3300/0 conn(0x7f0da006fcf0 0x7f0da0138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.975+0000 7f0da5f99700 1 --2- 172.21.15.59:0/303557270 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da0130540 0x7f0da0130910 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.975+0000 7f0da5f99700 1 -- 172.21.15.59:0/303557270 >> 172.21.15.59:0/303557270 conn(0x7f0da00a2aa0 msgr2=0x7f0da00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.975+0000 7f0da5f99700 1 -- 172.21.15.59:0/303557270 shutdown_connections 2023-09-30T22:30:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.975+0000 7f0da5f99700 1 -- 172.21.15.59:0/303557270 wait complete. 2023-09-30T22:30:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.976+0000 7f0da5f99700 1 Processor -- start 2023-09-30T22:30:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.977+0000 7f0da5f99700 1 -- start start 2023-09-30T22:30:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.977+0000 7f0da5f99700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da006fcf0 0x7f0da011eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.977+0000 7f0da5f99700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0130540 0x7f0da011f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.977+0000 7f0da5f99700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da0130e50 0x7f0da011f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.977+0000 7f0da5f99700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da01206f0 con 0x7f0da0130540 2023-09-30T22:30:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.977+0000 7f0da5f99700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da0121ce0 con 0x7f0da006fcf0 2023-09-30T22:30:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.977+0000 7f0da5f99700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0da012ca70 con 0x7f0da0130e50 2023-09-30T22:30:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.978+0000 7f0d9ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da0130e50 0x7f0da011f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.978+0000 7f0d9ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da0130e50 0x7f0da011f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53402/0 (socket says 172.21.15.59:53402) 2023-09-30T22:30:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.978+0000 7f0d9ffff700 1 -- 172.21.15.59:0/626601488 learned_addr learned my addr 172.21.15.59:0/626601488 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.978+0000 7f0d9f7fe700 1 --2- 172.21.15.59:0/626601488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da006fcf0 0x7f0da011eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.978+0000 7f0d9effd700 1 --2- 172.21.15.59:0/626601488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0130540 0x7f0da011f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.978+0000 7f0d9ffff700 1 -- 172.21.15.59:0/626601488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da006fcf0 msgr2=0x7f0da011eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.978+0000 7f0d9ffff700 1 --2- 172.21.15.59:0/626601488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da006fcf0 0x7f0da011eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.978+0000 7f0d9ffff700 1 -- 172.21.15.59:0/626601488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0130540 msgr2=0x7f0da011f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.978+0000 7f0d9ffff700 1 --2- 172.21.15.59:0/626601488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0130540 0x7f0da011f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.978+0000 7f0d9ffff700 1 -- 172.21.15.59:0/626601488 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9000b7f0 con 0x7f0da0130e50 2023-09-30T22:30:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.978+0000 7f0d9ffff700 1 --2- 172.21.15.59:0/626601488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da0130e50 0x7f0da011f560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800b970 tx=0x7f0d9800bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:06.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.979+0000 7f0d87fff700 1 -- 172.21.15.59:0/626601488 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9800d860 con 0x7f0da0130e50 2023-09-30T22:30:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.979+0000 7f0d87fff700 1 -- 172.21.15.59:0/626601488 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9800d9e0 con 0x7f0da0130e50 2023-09-30T22:30:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.979+0000 7f0da5f99700 1 -- 172.21.15.59:0/626601488 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da00718e0 con 0x7f0da0130e50 2023-09-30T22:30:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.979+0000 7f0d87fff700 1 -- 172.21.15.59:0/626601488 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9800dd90 con 0x7f0da0130e50 2023-09-30T22:30:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.979+0000 7f0da5f99700 1 -- 172.21.15.59:0/626601488 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da012c5b0 con 0x7f0da0130e50 2023-09-30T22:30:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.980+0000 7f0d87fff700 1 -- 172.21.15.59:0/626601488 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d9800e430 con 0x7f0da0130e50 2023-09-30T22:30:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.980+0000 7f0d87fff700 1 -- 172.21.15.59:0/626601488 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0d98006e40 con 0x7f0da0130e50 2023-09-30T22:30:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.980+0000 7f0da5f99700 1 -- 172.21.15.59:0/626601488 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da0074ea0 con 0x7f0da0130e50 2023-09-30T22:30:06.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.985+0000 7f0d87fff700 1 -- 172.21.15.59:0/626601488 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d9800e8c0 con 0x7f0da0130e50 2023-09-30T22:30:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.988+0000 7f75a3a4f700 1 Processor -- start 2023-09-30T22:30:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.988+0000 7f75a3a4f700 1 -- start start 2023-09-30T22:30:06.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.989+0000 7f75a3a4f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f759c130540 0x7f759c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.989+0000 7f75a3a4f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f759c130e50 0x7f759c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.989+0000 7f75a3a4f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c0716a0 con 0x7f759c06fb20 2023-09-30T22:30:06.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.989+0000 7f75a3a4f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759c09a390 con 0x7f759c130e50 2023-09-30T22:30:06.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.989+0000 7f75a3a4f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f759c071290 con 0x7f759c130540 2023-09-30T22:30:06.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.989+0000 7f75a17eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f759c130540 0x7f759c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.989+0000 7f75a17eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f759c130540 0x7f759c130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53410/0 (socket says 172.21.15.59:53410) 2023-09-30T22:30:06.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.989+0000 7f75a17eb700 1 -- 172.21.15.59:0/1047695078 learned_addr learned my addr 172.21.15.59:0/1047695078 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:06.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.989+0000 7f75a0fea700 1 --2- 172.21.15.59:0/1047695078 >> v2:172.21.15.59:3300/0 conn(0x7f759c130e50 0x7f759c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.990+0000 7f75a0fea700 1 -- 172.21.15.59:0/1047695078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f759c130540 msgr2=0x7f759c130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:06.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.990+0000 7f75a0fea700 1 --2- 172.21.15.59:0/1047695078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f759c130540 0x7f759c130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.990+0000 7f75a0fea700 1 -- 172.21.15.59:0/1047695078 >> v1:172.21.15.59:6789/0 conn(0x7f759c06fb20 legacy=0x7f759c137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.990+0000 7f75a0fea700 1 -- 172.21.15.59:0/1047695078 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c130340 con 0x7f759c130e50 2023-09-30T22:30:06.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.990+0000 7f75a17eb700 1 --2- 172.21.15.59:0/1047695078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f759c130540 0x7f759c130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:06.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.990+0000 7f75a0fea700 1 --2- 172.21.15.59:0/1047695078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f759c130e50 0x7f759c06f5e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f758c009840 tx=0x7f758c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42d2bcfb27de6ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:06.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.990+0000 7f7593fff700 1 -- 172.21.15.59:0/1047695078 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c011830 con 0x7f759c130e50 2023-09-30T22:30:06.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.990+0000 7f7593fff700 1 -- 172.21.15.59:0/1047695078 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c011990 con 0x7f759c130e50 2023-09-30T22:30:06.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.990+0000 7f7593fff700 1 -- 172.21.15.59:0/1047695078 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c011d20 con 0x7f759c130e50 2023-09-30T22:30:06.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.991+0000 7f75a3a4f700 1 -- 172.21.15.59:0/1047695078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f759c130e50 msgr2=0x7f759c06f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.991+0000 7f75a3a4f700 1 --2- 172.21.15.59:0/1047695078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f759c130e50 0x7f759c06f5e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f758c009840 tx=0x7f758c009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:06.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.991+0000 7f75a3a4f700 1 -- 172.21.15.59:0/1047695078 shutdown_connections 2023-09-30T22:30:06.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.991+0000 7f75a3a4f700 1 --2- 172.21.15.59:0/1047695078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f759c130540 0x7f759c130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.991+0000 7f75a3a4f700 1 --2- 172.21.15.59:0/1047695078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f759c130e50 0x7f759c06f5e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.991+0000 7f75a3a4f700 1 -- 172.21.15.59:0/1047695078 >> 172.21.15.59:0/1047695078 conn(0x7f759c0a2aa0 msgr2=0x7f759c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:06.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.991+0000 7f75a3a4f700 1 -- 172.21.15.59:0/1047695078 shutdown_connections 2023-09-30T22:30:06.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.991+0000 7f75a3a4f700 1 -- 172.21.15.59:0/1047695078 wait complete. 2023-09-30T22:30:06.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.992+0000 7f75a3a4f700 1 Processor -- start 2023-09-30T22:30:06.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.992+0000 7f75a3a4f700 1 -- start start 2023-09-30T22:30:06.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a3a4f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f759c06fb20 0x7f759c13acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a3a4f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f759c130540 0x7f759c137c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a3a4f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f759c130e50 0x7f759c138170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a3a4f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c12dc40 con 0x7f759c06fb20 2023-09-30T22:30:06.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a3a4f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759c0718e0 con 0x7f759c130540 2023-09-30T22:30:06.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a3a4f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f759c136ab0 con 0x7f759c130e50 2023-09-30T22:30:06.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a17eb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f759c06fb20 0x7f759c13acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a0fea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f759c130540 0x7f759c137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a17eb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f759c06fb20 0x7f759c13acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51820/0 (socket says 172.21.15.59:51820) 2023-09-30T22:30:06.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a17eb700 1 -- 172.21.15.59:0/325282105 learned_addr learned my addr 172.21.15.59:0/325282105 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:06.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a1fec700 1 --2- 172.21.15.59:0/325282105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f759c130e50 0x7f759c138170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a1fec700 1 -- 172.21.15.59:0/325282105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f759c130540 msgr2=0x7f759c137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a1fec700 1 --2- 172.21.15.59:0/325282105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f759c130540 0x7f759c137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a1fec700 1 -- 172.21.15.59:0/325282105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f759c06fb20 msgr2=0x7f759c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a1fec700 1 --2- 172.21.15.59:0/325282105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f759c06fb20 0x7f759c13acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a1fec700 1 -- 172.21.15.59:0/325282105 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7598009550 con 0x7f759c130e50 2023-09-30T22:30:06.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a0fea700 1 --2- 172.21.15.59:0/325282105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f759c130540 0x7f759c137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:06.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.993+0000 7f75a17eb700 1 --2- 172.21.15.59:0/325282105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f759c06fb20 0x7f759c13acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:06.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.994+0000 7f75a1fec700 1 --2- 172.21.15.59:0/325282105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f759c130e50 0x7f759c138170 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f759400cbc0 tx=0x7f759400ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:06.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.994+0000 7f7591ffb700 1 -- 172.21.15.59:0/325282105 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594003c00 con 0x7f759c130e50 2023-09-30T22:30:06.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.994+0000 7f7591ffb700 1 -- 172.21.15.59:0/325282105 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7594003d60 con 0x7f759c130e50 2023-09-30T22:30:06.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.994+0000 7f75a3a4f700 1 -- 172.21.15.59:0/325282105 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758c0094a0 con 0x7f759c130e50 2023-09-30T22:30:06.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.994+0000 7f7591ffb700 1 -- 172.21.15.59:0/325282105 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759400aaa0 con 0x7f759c130e50 2023-09-30T22:30:06.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.994+0000 7f75a3a4f700 1 -- 172.21.15.59:0/325282105 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759c139090 con 0x7f759c130e50 2023-09-30T22:30:06.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.995+0000 7f7591ffb700 1 -- 172.21.15.59:0/325282105 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f759400ac00 con 0x7f759c130e50 2023-09-30T22:30:06.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.995+0000 7f75a3a4f700 1 -- 172.21.15.59:0/325282105 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759c0a0650 con 0x7f759c130e50 2023-09-30T22:30:06.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:06.995+0000 7f7591ffb700 1 -- 172.21.15.59:0/325282105 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7594011540 con 0x7f759c130e50 2023-09-30T22:30:07.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.000+0000 7f7591ffb700 1 -- 172.21.15.59:0/325282105 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7594012420 con 0x7f759c130e50 2023-09-30T22:30:07.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.059+0000 7f5375b7c700 1 Processor -- start 2023-09-30T22:30:07.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.059+0000 7f5375b7c700 1 -- start start 2023-09-30T22:30:07.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.060+0000 7f5375b7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537009e1d0 0x7f5370138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.060+0000 7f5375b7c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5370139170 0x7f537013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.060+0000 7f5375b7c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537009b120 con 0x7f537009d6f0 2023-09-30T22:30:07.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.060+0000 7f5375b7c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537006b460 con 0x7f537009e1d0 2023-09-30T22:30:07.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.060+0000 7f5375b7c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f537009a7e0 con 0x7f5370139170 2023-09-30T22:30:07.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.060+0000 7f536effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537009e1d0 0x7f5370138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.060+0000 7f536effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537009e1d0 0x7f5370138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43164/0 (socket says 172.21.15.59:43164) 2023-09-30T22:30:07.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.060+0000 7f536effd700 1 -- 172.21.15.59:0/1985674421 learned_addr learned my addr 172.21.15.59:0/1985674421 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:07.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.060+0000 7f536ffff700 1 --2- 172.21.15.59:0/1985674421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5370139170 0x7f537013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.060+0000 7f536effd700 1 -- 172.21.15.59:0/1985674421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5370139170 msgr2=0x7f537013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:07.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.060+0000 7f536effd700 1 --2- 172.21.15.59:0/1985674421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5370139170 0x7f537013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.060+0000 7f536effd700 1 -- 172.21.15.59:0/1985674421 >> v1:172.21.15.59:6789/0 conn(0x7f537009d6f0 legacy=0x7f537009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.060+0000 7f536effd700 1 -- 172.21.15.59:0/1985674421 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537009a500 con 0x7f537009e1d0 2023-09-30T22:30:07.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.061+0000 7f536effd700 1 --2- 172.21.15.59:0/1985674421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537009e1d0 0x7f5370138c30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5364009920 tx=0x7f5364009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f658f0bdb8ea9fc0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:07.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.061+0000 7f536e7fc700 1 -- 172.21.15.59:0/1985674421 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364011830 con 0x7f537009e1d0 2023-09-30T22:30:07.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.061+0000 7f536e7fc700 1 -- 172.21.15.59:0/1985674421 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5364011990 con 0x7f537009e1d0 2023-09-30T22:30:07.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.061+0000 7f536e7fc700 1 -- 172.21.15.59:0/1985674421 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364011d20 con 0x7f537009e1d0 2023-09-30T22:30:07.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.062+0000 7f5375b7c700 1 -- 172.21.15.59:0/1985674421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537009e1d0 msgr2=0x7f5370138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.062+0000 7f5375b7c700 1 --2- 172.21.15.59:0/1985674421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537009e1d0 0x7f5370138c30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5364009920 tx=0x7f5364009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:07.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.062+0000 7f5375b7c700 1 -- 172.21.15.59:0/1985674421 shutdown_connections 2023-09-30T22:30:07.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.062+0000 7f5375b7c700 1 --2- 172.21.15.59:0/1985674421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5370139170 0x7f537013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.062+0000 7f5375b7c700 1 --2- 172.21.15.59:0/1985674421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537009e1d0 0x7f5370138c30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.062+0000 7f5375b7c700 1 -- 172.21.15.59:0/1985674421 >> 172.21.15.59:0/1985674421 conn(0x7f5370066f50 msgr2=0x7f537009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.062+0000 7f5375b7c700 1 -- 172.21.15.59:0/1985674421 shutdown_connections 2023-09-30T22:30:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.062+0000 7f5375b7c700 1 -- 172.21.15.59:0/1985674421 wait complete. 2023-09-30T22:30:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.063+0000 7f5375b7c700 1 Processor -- start 2023-09-30T22:30:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.064+0000 7f5375b7c700 1 -- start start 2023-09-30T22:30:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.064+0000 7f5375b7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537009d6f0 0x7f53701c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.064+0000 7f5375b7c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f537009e1d0 0x7f53701c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.064+0000 7f5375b7c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5370139170 0x7f537011e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.064+0000 7f5375b7c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53701be2f0 con 0x7f537009e1d0 2023-09-30T22:30:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.064+0000 7f5375b7c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53701c9150 con 0x7f537009d6f0 2023-09-30T22:30:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.064+0000 7f5375b7c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5370121d60 con 0x7f5370139170 2023-09-30T22:30:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.064+0000 7f536f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537009d6f0 0x7f53701c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.064+0000 7f536f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537009d6f0 0x7f53701c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43168/0 (socket says 172.21.15.59:43168) 2023-09-30T22:30:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.064+0000 7f536f7fe700 1 -- 172.21.15.59:0/1575296588 learned_addr learned my addr 172.21.15.59:0/1575296588 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.064+0000 7f536ffff700 1 --2- 172.21.15.59:0/1575296588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5370139170 0x7f537011e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.064+0000 7f536effd700 1 --2- 172.21.15.59:0/1575296588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f537009e1d0 0x7f53701c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.065+0000 7f536f7fe700 1 -- 172.21.15.59:0/1575296588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5370139170 msgr2=0x7f537011e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.065+0000 7f536f7fe700 1 --2- 172.21.15.59:0/1575296588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5370139170 0x7f537011e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.065+0000 7f536f7fe700 1 -- 172.21.15.59:0/1575296588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f537009e1d0 msgr2=0x7f53701c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.065+0000 7f536f7fe700 1 --2- 172.21.15.59:0/1575296588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f537009e1d0 0x7f53701c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.065+0000 7f536f7fe700 1 -- 172.21.15.59:0/1575296588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5364009550 con 0x7f537009d6f0 2023-09-30T22:30:07.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.065+0000 7f536f7fe700 1 --2- 172.21.15.59:0/1575296588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537009d6f0 0x7f53701c86d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f536000c4e0 tx=0x7f536000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:07.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.065+0000 7f5357fff700 1 -- 172.21.15.59:0/1575296588 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53600052d0 con 0x7f537009d6f0 2023-09-30T22:30:07.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.065+0000 7f5357fff700 1 -- 172.21.15.59:0/1575296588 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5360005430 con 0x7f537009d6f0 2023-09-30T22:30:07.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.065+0000 7f5375b7c700 1 -- 172.21.15.59:0/1575296588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537009c770 con 0x7f537009d6f0 2023-09-30T22:30:07.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.065+0000 7f5357fff700 1 -- 172.21.15.59:0/1575296588 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53600038c0 con 0x7f537009d6f0 2023-09-30T22:30:07.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.065+0000 7f5375b7c700 1 -- 172.21.15.59:0/1575296588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5370122300 con 0x7f537009d6f0 2023-09-30T22:30:07.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.066+0000 7f5357fff700 1 -- 172.21.15.59:0/1575296588 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5360003a20 con 0x7f537009d6f0 2023-09-30T22:30:07.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.066+0000 7f5375b7c700 1 -- 172.21.15.59:0/1575296588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5370074ea0 con 0x7f537009d6f0 2023-09-30T22:30:07.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.067+0000 7f5357fff700 1 -- 172.21.15.59:0/1575296588 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f536003ec20 con 0x7f537009d6f0 2023-09-30T22:30:07.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.076+0000 7f5357fff700 1 -- 172.21.15.59:0/1575296588 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5360018260 con 0x7f537009d6f0 2023-09-30T22:30:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.078+0000 7f18fdd4a700 1 -- 172.21.15.59:0/4206543864 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f18f806c360 con 0x7f18f806a770 2023-09-30T22:30:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.078+0000 7f18dffff700 1 -- 172.21.15.59:0/4206543864 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18e8017070 con 0x7f18f806a770 2023-09-30T22:30:07.079 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.081+0000 7f18fdd4a700 1 -- 172.21.15.59:0/4206543864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f806a770 msgr2=0x7f18f8120380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.081+0000 7f18fdd4a700 1 --2- 172.21.15.59:0/4206543864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f806a770 0x7f18f8120380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f18e800e9b0 tx=0x7f18e800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.082+0000 7f18fdd4a700 1 -- 172.21.15.59:0/4206543864 shutdown_connections 2023-09-30T22:30:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.082+0000 7f18fdd4a700 1 --2- 172.21.15.59:0/4206543864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f8131d10 0x7f18f8120e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.082+0000 7f18fdd4a700 1 --2- 172.21.15.59:0/4206543864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f806a770 0x7f18f8120380 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.082+0000 7f18fdd4a700 1 --2- 172.21.15.59:0/4206543864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f18f806b080 0x7f18f81208c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.082+0000 7f18fdd4a700 1 -- 172.21.15.59:0/4206543864 >> 172.21.15.59:0/4206543864 conn(0x7f18f8066f50 msgr2=0x7f18f8070000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.082+0000 7f18fdd4a700 1 -- 172.21.15.59:0/4206543864 shutdown_connections 2023-09-30T22:30:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.082+0000 7f18fdd4a700 1 -- 172.21.15.59:0/4206543864 wait complete. 2023-09-30T22:30:07.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:07.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.210+0000 7f75a3a4f700 1 -- 172.21.15.59:0/325282105 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f759c139030 con 0x7f759c130e50 2023-09-30T22:30:07.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.211+0000 7f7591ffb700 1 -- 172.21.15.59:0/325282105 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7594011380 con 0x7f759c130e50 2023-09-30T22:30:07.212 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:07.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.213+0000 7f75a3a4f700 1 -- 172.21.15.59:0/325282105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f759c130e50 msgr2=0x7f759c138170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.213+0000 7f75a3a4f700 1 --2- 172.21.15.59:0/325282105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f759c130e50 0x7f759c138170 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f759400cbc0 tx=0x7f759400ced0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.213+0000 7f75a3a4f700 1 -- 172.21.15.59:0/325282105 shutdown_connections 2023-09-30T22:30:07.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.213+0000 7f75a3a4f700 1 --2- 172.21.15.59:0/325282105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f759c130e50 0x7f759c138170 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.213+0000 7f75a3a4f700 1 --2- 172.21.15.59:0/325282105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f759c06fb20 0x7f759c13acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.213+0000 7f75a3a4f700 1 --2- 172.21.15.59:0/325282105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f759c130540 0x7f759c137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.213+0000 7f75a3a4f700 1 -- 172.21.15.59:0/325282105 >> 172.21.15.59:0/325282105 conn(0x7f759c0a2aa0 msgr2=0x7f759c06e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:07.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.214+0000 7f75a3a4f700 1 -- 172.21.15.59:0/325282105 shutdown_connections 2023-09-30T22:30:07.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.214+0000 7f75a3a4f700 1 -- 172.21.15.59:0/325282105 wait complete. 2023-09-30T22:30:07.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.226+0000 7f0da5f99700 1 -- 172.21.15.59:0/626601488 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0da0122df0 con 0x7f0da0130e50 2023-09-30T22:30:07.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.227+0000 7f0d87fff700 1 -- 172.21.15.59:0/626601488 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d98015300 con 0x7f0da0130e50 2023-09-30T22:30:07.228 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:07.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:07.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.229+0000 7f0da5f99700 1 -- 172.21.15.59:0/626601488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da0130e50 msgr2=0x7f0da011f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.229+0000 7f0da5f99700 1 --2- 172.21.15.59:0/626601488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da0130e50 0x7f0da011f560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800b970 tx=0x7f0d9800bc80 comp rx=0 tx=0).stop 2023-09-30T22:30:07.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.229+0000 7f0da5f99700 1 -- 172.21.15.59:0/626601488 shutdown_connections 2023-09-30T22:30:07.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.229+0000 7f0da5f99700 1 --2- 172.21.15.59:0/626601488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da0130e50 0x7f0da011f560 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.229+0000 7f0da5f99700 1 --2- 172.21.15.59:0/626601488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da006fcf0 0x7f0da011eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.229+0000 7f0da5f99700 1 --2- 172.21.15.59:0/626601488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0130540 0x7f0da011f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.229+0000 7f0da5f99700 1 -- 172.21.15.59:0/626601488 >> 172.21.15.59:0/626601488 conn(0x7f0da00a2aa0 msgr2=0x7f0da012d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:07.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.229+0000 7f0da5f99700 1 -- 172.21.15.59:0/626601488 shutdown_connections 2023-09-30T22:30:07.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.229+0000 7f0da5f99700 1 -- 172.21.15.59:0/626601488 wait complete. 2023-09-30T22:30:07.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:07.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.283+0000 7f5375b7c700 1 -- 172.21.15.59:0/1575296588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5370121f60 con 0x7f537009d6f0 2023-09-30T22:30:07.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.284+0000 7f5357fff700 1 -- 172.21.15.59:0/1575296588 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5370121f60 con 0x7f537009d6f0 2023-09-30T22:30:07.288 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.286+0000 7f5375b7c700 1 -- 172.21.15.59:0/1575296588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537009d6f0 msgr2=0x7f53701c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.286+0000 7f5375b7c700 1 --2- 172.21.15.59:0/1575296588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537009d6f0 0x7f53701c86d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f536000c4e0 tx=0x7f536000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.286+0000 7f5375b7c700 1 -- 172.21.15.59:0/1575296588 shutdown_connections 2023-09-30T22:30:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.286+0000 7f5375b7c700 1 --2- 172.21.15.59:0/1575296588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5370139170 0x7f537011e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.286+0000 7f5375b7c700 1 --2- 172.21.15.59:0/1575296588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537009d6f0 0x7f53701c86d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.286+0000 7f5375b7c700 1 --2- 172.21.15.59:0/1575296588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f537009e1d0 0x7f53701c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.286+0000 7f5375b7c700 1 -- 172.21.15.59:0/1575296588 >> 172.21.15.59:0/1575296588 conn(0x7f5370066f50 msgr2=0x7f5370136c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.286+0000 7f5375b7c700 1 -- 172.21.15.59:0/1575296588 shutdown_connections 2023-09-30T22:30:07.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:07.286+0000 7f5375b7c700 1 -- 172.21.15.59:0/1575296588 wait complete. 2023-09-30T22:30:07.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:08.098 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:08.231 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:08.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:08.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:08.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.243+0000 7f757c242700 1 Processor -- start 2023-09-30T22:30:08.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.243+0000 7f757c242700 1 -- start start 2023-09-30T22:30:08.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f757c242700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e1d0 0x7f757413cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f757c242700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757413d480 0x7f757413f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f757c242700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75740992c0 con 0x7f757409d6f0 2023-09-30T22:30:08.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f757c242700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7574099520 con 0x7f757413d480 2023-09-30T22:30:08.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f757c242700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75740997e0 con 0x7f757409e1d0 2023-09-30T22:30:08.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f757a7df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757413d480 0x7f757413f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f75797dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e1d0 0x7f757413cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f75797dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e1d0 0x7f757413cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53450/0 (socket says 172.21.15.59:53450) 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f7579fde700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f757409d6f0 0x7f757409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37286/0 (socket says 172.21.15.59:37286) 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f757a7df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757413d480 0x7f757413f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43170/0 (socket says 172.21.15.59:43170) 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f75797dd700 1 -- 172.21.15.59:0/4204291257 learned_addr learned my addr 172.21.15.59:0/4204291257 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f7578fdc700 1 -- 172.21.15.59:0/4204291257 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343919228 0 0) 0x7f75740992c0 con 0x7f757409d6f0 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f75797dd700 1 -- 172.21.15.59:0/4204291257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757413d480 msgr2=0x7f757413f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f75797dd700 1 --2- 172.21.15.59:0/4204291257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757413d480 0x7f757413f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f75797dd700 1 -- 172.21.15.59:0/4204291257 >> v1:172.21.15.59:6789/0 conn(0x7f757409d6f0 legacy=0x7f757409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f75797dd700 1 -- 172.21.15.59:0/4204291257 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7574099b30 con 0x7f757409e1d0 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.244+0000 7f757a7df700 1 --2- 172.21.15.59:0/4204291257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757413d480 0x7f757413f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.245+0000 7f75797dd700 1 --2- 172.21.15.59:0/4204291257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e1d0 0x7f757413cf40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7568009920 tx=0x7f7568009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc8c0518a71812d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.245+0000 7f7578fdc700 1 -- 172.21.15.59:0/4204291257 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568011830 con 0x7f757409e1d0 2023-09-30T22:30:08.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.245+0000 7f7578fdc700 1 -- 172.21.15.59:0/4204291257 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7568011990 con 0x7f757409e1d0 2023-09-30T22:30:08.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.245+0000 7f7578fdc700 1 -- 172.21.15.59:0/4204291257 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568011d20 con 0x7f757409e1d0 2023-09-30T22:30:08.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.245+0000 7f757c242700 1 -- 172.21.15.59:0/4204291257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e1d0 msgr2=0x7f757413cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.245+0000 7f757c242700 1 --2- 172.21.15.59:0/4204291257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e1d0 0x7f757413cf40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7568009920 tx=0x7f7568009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:08.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.245+0000 7f757c242700 1 -- 172.21.15.59:0/4204291257 shutdown_connections 2023-09-30T22:30:08.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.245+0000 7f757c242700 1 --2- 172.21.15.59:0/4204291257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757413d480 0x7f757413f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.245+0000 7f757c242700 1 --2- 172.21.15.59:0/4204291257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e1d0 0x7f757413cf40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.245+0000 7f757c242700 1 -- 172.21.15.59:0/4204291257 >> 172.21.15.59:0/4204291257 conn(0x7f757409f470 msgr2=0x7f75740a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:08.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.245+0000 7f757c242700 1 -- 172.21.15.59:0/4204291257 shutdown_connections 2023-09-30T22:30:08.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.245+0000 7f757c242700 1 -- 172.21.15.59:0/4204291257 wait complete. 2023-09-30T22:30:08.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.246+0000 7f757c242700 1 Processor -- start 2023-09-30T22:30:08.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f757c242700 1 -- start start 2023-09-30T22:30:08.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f757c242700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409d6f0 0x7f7574070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f757c242700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757409e1d0 0x7f75740709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f757c242700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757413d480 0x7f7574070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f757c242700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757413efd0 con 0x7f757409e1d0 2023-09-30T22:30:08.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f757c242700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75740721b0 con 0x7f757409d6f0 2023-09-30T22:30:08.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f757c242700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7574098c70 con 0x7f757413d480 2023-09-30T22:30:08.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f7579fde700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409d6f0 0x7f7574070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f75797dd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757409e1d0 0x7f75740709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f75797dd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757409e1d0 0x7f75740709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51842/0 (socket says 172.21.15.59:51842) 2023-09-30T22:30:08.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f7579fde700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409d6f0 0x7f7574070490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43184/0 (socket says 172.21.15.59:43184) 2023-09-30T22:30:08.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f75797dd700 1 -- 172.21.15.59:0/1626850057 learned_addr learned my addr 172.21.15.59:0/1626850057 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:08.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f757a7df700 1 --2- 172.21.15.59:0/1626850057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757413d480 0x7f7574070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f7579fde700 1 -- 172.21.15.59:0/1626850057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757413d480 msgr2=0x7f7574070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f7579fde700 1 --2- 172.21.15.59:0/1626850057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757413d480 0x7f7574070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f7579fde700 1 -- 172.21.15.59:0/1626850057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757409e1d0 msgr2=0x7f75740709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f7579fde700 1 --2- 172.21.15.59:0/1626850057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757409e1d0 0x7f75740709d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f7579fde700 1 -- 172.21.15.59:0/1626850057 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c009a70 con 0x7f757409d6f0 2023-09-30T22:30:08.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f757a7df700 1 --2- 172.21.15.59:0/1626850057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757413d480 0x7f7574070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:08.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.247+0000 7f75797dd700 1 --2- 172.21.15.59:0/1626850057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757409e1d0 0x7f75740709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:08.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.248+0000 7f7579fde700 1 --2- 172.21.15.59:0/1626850057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409d6f0 0x7f7574070490 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f757000c470 tx=0x7f757000c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:08.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.248+0000 7f75667fc700 1 -- 172.21.15.59:0/1626850057 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570004c80 con 0x7f757409d6f0 2023-09-30T22:30:08.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.248+0000 7f75667fc700 1 -- 172.21.15.59:0/1626850057 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7570004de0 con 0x7f757409d6f0 2023-09-30T22:30:08.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.248+0000 7f75667fc700 1 -- 172.21.15.59:0/1626850057 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570007310 con 0x7f757409d6f0 2023-09-30T22:30:08.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.248+0000 7f757c242700 1 -- 172.21.15.59:0/1626850057 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7568009550 con 0x7f757409d6f0 2023-09-30T22:30:08.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.248+0000 7f757c242700 1 -- 172.21.15.59:0/1626850057 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75741275f0 con 0x7f757409d6f0 2023-09-30T22:30:08.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.249+0000 7f75667fc700 1 -- 172.21.15.59:0/1626850057 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7570007470 con 0x7f757409d6f0 2023-09-30T22:30:08.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.249+0000 7f75667fc700 1 -- 172.21.15.59:0/1626850057 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f757003f200 con 0x7f757409d6f0 2023-09-30T22:30:08.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.249+0000 7f757c242700 1 -- 172.21.15.59:0/1626850057 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75740747f0 con 0x7f757409d6f0 2023-09-30T22:30:08.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.254+0000 7f75667fc700 1 -- 172.21.15.59:0/1626850057 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7570007720 con 0x7f757409d6f0 2023-09-30T22:30:08.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.461+0000 7f757c242700 1 -- 172.21.15.59:0/1626850057 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7574097de0 con 0x7f757409d6f0 2023-09-30T22:30:08.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.461+0000 7f75667fc700 1 -- 172.21.15.59:0/1626850057 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7570011360 con 0x7f757409d6f0 2023-09-30T22:30:08.722 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:08.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.464+0000 7f757c242700 1 -- 172.21.15.59:0/1626850057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409d6f0 msgr2=0x7f7574070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.464+0000 7f757c242700 1 --2- 172.21.15.59:0/1626850057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409d6f0 0x7f7574070490 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f757000c470 tx=0x7f757000c780 comp rx=0 tx=0).stop 2023-09-30T22:30:08.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.464+0000 7f757c242700 1 -- 172.21.15.59:0/1626850057 shutdown_connections 2023-09-30T22:30:08.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.464+0000 7f757c242700 1 --2- 172.21.15.59:0/1626850057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757413d480 0x7f7574070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.464+0000 7f757c242700 1 --2- 172.21.15.59:0/1626850057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409d6f0 0x7f7574070490 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.464+0000 7f757c242700 1 --2- 172.21.15.59:0/1626850057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757409e1d0 0x7f75740709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.464+0000 7f757c242700 1 -- 172.21.15.59:0/1626850057 >> 172.21.15.59:0/1626850057 conn(0x7f757409f470 msgr2=0x7f75740a0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:08.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.464+0000 7f757c242700 1 -- 172.21.15.59:0/1626850057 shutdown_connections 2023-09-30T22:30:08.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.464+0000 7f757c242700 1 -- 172.21.15.59:0/1626850057 wait complete. 2023-09-30T22:30:08.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:08.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.871+0000 7f8a91033700 1 Processor -- start 2023-09-30T22:30:08.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.871+0000 7f8a91033700 1 -- start start 2023-09-30T22:30:08.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.872+0000 7f8a91033700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8c09e930 0x7f8a8c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.872+0000 7f8a91033700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a8c09f650 0x7f8a8c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.872+0000 7f8a91033700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a8c070940 con 0x7f8a8c09f240 2023-09-30T22:30:08.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.872+0000 7f8a91033700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c06fd60 con 0x7f8a8c09e930 2023-09-30T22:30:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.872+0000 7f8a91033700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c06fa80 con 0x7f8a8c09f650 2023-09-30T22:30:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.872+0000 7f8a8a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8a8c09f240 0x7f8a8c1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37298/0 (socket says 172.21.15.59:37298) 2023-09-30T22:30:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.872+0000 7f8a8a59c700 1 -- 172.21.15.59:0/2185030552 learned_addr learned my addr 172.21.15.59:0/2185030552 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.872+0000 7f8a8ad9d700 1 --2- 172.21.15.59:0/2185030552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8c09e930 0x7f8a8c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.872+0000 7f8a8b59e700 1 --2- 172.21.15.59:0/2185030552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a8c09f650 0x7f8a8c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.873+0000 7f8a8ad9d700 1 -- 172.21.15.59:0/2185030552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a8c09f650 msgr2=0x7f8a8c131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.873+0000 7f8a8ad9d700 1 --2- 172.21.15.59:0/2185030552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a8c09f650 0x7f8a8c131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.873+0000 7f8a8ad9d700 1 -- 172.21.15.59:0/2185030552 >> v1:172.21.15.59:6789/0 conn(0x7f8a8c09f240 legacy=0x7f8a8c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.873+0000 7f8a8ad9d700 1 -- 172.21.15.59:0/2185030552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c09fb60 con 0x7f8a8c09e930 2023-09-30T22:30:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.873+0000 7f8a8ad9d700 1 --2- 172.21.15.59:0/2185030552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8c09e930 0x7f8a8c09ed00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009dc0 tx=0x7f8a7c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6d8cfd28d083737 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.873+0000 7f8a89d9b700 1 -- 172.21.15.59:0/2185030552 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c00e070 con 0x7f8a8c09e930 2023-09-30T22:30:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.873+0000 7f8a89d9b700 1 -- 172.21.15.59:0/2185030552 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c00bb20 con 0x7f8a8c09e930 2023-09-30T22:30:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.873+0000 7f8a89d9b700 1 -- 172.21.15.59:0/2185030552 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c012430 con 0x7f8a8c09e930 2023-09-30T22:30:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.874+0000 7f8a91033700 1 -- 172.21.15.59:0/2185030552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8c09e930 msgr2=0x7f8a8c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.874+0000 7f8a91033700 1 --2- 172.21.15.59:0/2185030552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8c09e930 0x7f8a8c09ed00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009dc0 tx=0x7f8a7c00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.874+0000 7f8a91033700 1 -- 172.21.15.59:0/2185030552 shutdown_connections 2023-09-30T22:30:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.874+0000 7f8a91033700 1 --2- 172.21.15.59:0/2185030552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a8c09f650 0x7f8a8c131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.874+0000 7f8a91033700 1 --2- 172.21.15.59:0/2185030552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8c09e930 0x7f8a8c09ed00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.874+0000 7f8a91033700 1 -- 172.21.15.59:0/2185030552 >> 172.21.15.59:0/2185030552 conn(0x7f8a8c0a4210 msgr2=0x7f8a8c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.874+0000 7f8a91033700 1 -- 172.21.15.59:0/2185030552 shutdown_connections 2023-09-30T22:30:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.874+0000 7f8a91033700 1 -- 172.21.15.59:0/2185030552 wait complete. 2023-09-30T22:30:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.875+0000 7f8a91033700 1 Processor -- start 2023-09-30T22:30:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.875+0000 7f8a91033700 1 -- start start 2023-09-30T22:30:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a91033700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8c09e930 0x7f8a8c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a91033700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a8c09f240 0x7f8a8c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a91033700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a8c09f650 0x7f8a8c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a91033700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c0a38e0 con 0x7f8a8c09f240 2023-09-30T22:30:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a91033700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c06d420 con 0x7f8a8c09e930 2023-09-30T22:30:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a91033700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c06ccc0 con 0x7f8a8c09f650 2023-09-30T22:30:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a8a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a8c09f240 0x7f8a8c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a8ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8c09e930 0x7f8a8c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a8a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a8c09f240 0x7f8a8c06bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51850/0 (socket says 172.21.15.59:51850) 2023-09-30T22:30:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a8ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8c09e930 0x7f8a8c06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43208/0 (socket says 172.21.15.59:43208) 2023-09-30T22:30:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a8a59c700 1 -- 172.21.15.59:0/4114302657 learned_addr learned my addr 172.21.15.59:0/4114302657 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a8b59e700 1 --2- 172.21.15.59:0/4114302657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a8c09f650 0x7f8a8c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a8a59c700 1 -- 172.21.15.59:0/4114302657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a8c09f650 msgr2=0x7f8a8c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a8a59c700 1 --2- 172.21.15.59:0/4114302657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a8c09f650 0x7f8a8c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a8a59c700 1 -- 172.21.15.59:0/4114302657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8c09e930 msgr2=0x7f8a8c06b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a8a59c700 1 --2- 172.21.15.59:0/4114302657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8c09e930 0x7f8a8c06b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a8a59c700 1 -- 172.21.15.59:0/4114302657 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7c009a70 con 0x7f8a8c09f240 2023-09-30T22:30:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.876+0000 7f8a8ad9d700 1 --2- 172.21.15.59:0/4114302657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8c09e930 0x7f8a8c06b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.877+0000 7f8a8a59c700 1 --2- 172.21.15.59:0/4114302657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a8c09f240 0x7f8a8c06bdc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000c500 tx=0x7f8a8000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.878+0000 7f8a737fe700 1 -- 172.21.15.59:0/4114302657 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80005d70 con 0x7f8a8c09f240 2023-09-30T22:30:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.878+0000 7f8a737fe700 1 -- 172.21.15.59:0/4114302657 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a800070d0 con 0x7f8a8c09f240 2023-09-30T22:30:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.878+0000 7f8a737fe700 1 -- 172.21.15.59:0/4114302657 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80007440 con 0x7f8a8c09f240 2023-09-30T22:30:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.878+0000 7f8a91033700 1 -- 172.21.15.59:0/4114302657 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8c0a0190 con 0x7f8a8c09f240 2023-09-30T22:30:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.878+0000 7f8a91033700 1 -- 172.21.15.59:0/4114302657 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8c1a85b0 con 0x7f8a8c09f240 2023-09-30T22:30:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.879+0000 7f8a737fe700 1 -- 172.21.15.59:0/4114302657 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a800075a0 con 0x7f8a8c09f240 2023-09-30T22:30:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.879+0000 7f8a737fe700 1 -- 172.21.15.59:0/4114302657 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8a8003ea20 con 0x7f8a8c09f240 2023-09-30T22:30:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.879+0000 7f8a91033700 1 -- 172.21.15.59:0/4114302657 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a8c071d80 con 0x7f8a8c09f240 2023-09-30T22:30:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.884+0000 7f8a737fe700 1 -- 172.21.15.59:0/4114302657 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a80017080 con 0x7f8a8c09f240 2023-09-30T22:30:08.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.885+0000 7f1da3df4700 1 Processor -- start 2023-09-30T22:30:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.886+0000 7f1da3df4700 1 -- start start 2023-09-30T22:30:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.886+0000 7fe5003a5700 1 Processor -- start 2023-09-30T22:30:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.887+0000 7fe5003a5700 1 -- start start 2023-09-30T22:30:08.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.887+0000 7f1da3df4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d9c09e1d0 0x7f1d9c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.887+0000 7f1da3df4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d9c135e50 0x7f1d9c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.887+0000 7f1da3df4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9c09f130 con 0x7f1d9c09d6f0 2023-09-30T22:30:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.887+0000 7f1da3df4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c09f520 con 0x7f1d9c09e1d0 2023-09-30T22:30:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.887+0000 7f1da3df4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c09e930 con 0x7f1d9c135e50 2023-09-30T22:30:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.887+0000 7f1da1b90700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1d9c09d6f0 0x7f1d9c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37308/0 (socket says 172.21.15.59:37308) 2023-09-30T22:30:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.887+0000 7f1da138f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d9c09e1d0 0x7f1d9c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.887+0000 7f1da1b90700 1 -- 172.21.15.59:0/2017711148 learned_addr learned my addr 172.21.15.59:0/2017711148 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.887+0000 7f1da2391700 1 --2- 172.21.15.59:0/2017711148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d9c135e50 0x7f1d9c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.887+0000 7f1da2391700 1 -- 172.21.15.59:0/2017711148 >> v2:172.21.15.59:3300/0 conn(0x7f1d9c09e1d0 msgr2=0x7f1d9c135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:08.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.887+0000 7f1da2391700 1 --2- 172.21.15.59:0/2017711148 >> v2:172.21.15.59:3300/0 conn(0x7f1d9c09e1d0 0x7f1d9c135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.887+0000 7f1da2391700 1 -- 172.21.15.59:0/2017711148 >> v1:172.21.15.59:6789/0 conn(0x7f1d9c09d6f0 legacy=0x7f1d9c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.887+0000 7f1da2391700 1 -- 172.21.15.59:0/2017711148 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c09b2d0 con 0x7f1d9c135e50 2023-09-30T22:30:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.887+0000 7f1da0b8e700 1 -- 172.21.15.59:0/2017711148 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395169687 0 0) 0x7f1d9c09f130 con 0x7f1d9c09d6f0 2023-09-30T22:30:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7fe5003a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f812cf60 0x7fe4f806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7f1da2391700 1 --2- 172.21.15.59:0/2017711148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d9c135e50 0x7f1d9c138230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400f370 tx=0x7f1d9400f680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92e9939bfe0fe155 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7fe5003a5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4f8130430 0x7fe4f8137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7fe5003a5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f812cd90 con 0x7fe4f812f8b0 2023-09-30T22:30:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7fe5003a5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f812d330 con 0x7fe4f8130430 2023-09-30T22:30:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7fe5003a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f8071780 con 0x7fe4f812cf60 2023-09-30T22:30:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7fe4fd940700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe4f812f8b0 0x7fe4f812fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37320/0 (socket says 172.21.15.59:37320) 2023-09-30T22:30:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7fe4fd940700 1 -- 172.21.15.59:0/1007809822 learned_addr learned my addr 172.21.15.59:0/1007809822 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:08.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7fe4fe942700 1 --2- 172.21.15.59:0/1007809822 >> v2:172.21.15.59:3300/0 conn(0x7fe4f8130430 0x7fe4f8137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7fe4fe141700 1 --2- 172.21.15.59:0/1007809822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f812cf60 0x7fe4f806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7f1da0b8e700 1 -- 172.21.15.59:0/2017711148 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d94012070 con 0x7f1d9c135e50 2023-09-30T22:30:08.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7f1da0b8e700 1 -- 172.21.15.59:0/2017711148 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9400fe70 con 0x7f1d9c135e50 2023-09-30T22:30:08.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7f1da0b8e700 1 -- 172.21.15.59:0/2017711148 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400d2f0 con 0x7f1d9c135e50 2023-09-30T22:30:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7fe4fe942700 1 -- 172.21.15.59:0/1007809822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f812cf60 msgr2=0x7fe4f806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7fe4fe942700 1 --2- 172.21.15.59:0/1007809822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f812cf60 0x7fe4f806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7fe4fe942700 1 -- 172.21.15.59:0/1007809822 >> v1:172.21.15.59:6789/0 conn(0x7fe4f812f8b0 legacy=0x7fe4f812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7fe4fd13f700 1 -- 172.21.15.59:0/1007809822 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002072608 0 0) 0x7fe4f812cd90 con 0x7fe4f812f8b0 2023-09-30T22:30:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7fe4fe942700 1 -- 172.21.15.59:0/1007809822 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f8071a40 con 0x7fe4f8130430 2023-09-30T22:30:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.888+0000 7fe4fe942700 1 --2- 172.21.15.59:0/1007809822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f8130430 0x7fe4f8137c30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009d90 tx=0x7fe4f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614c573230b17680 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.889+0000 7fe4fd13f700 1 -- 172.21.15.59:0/1007809822 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f000e070 con 0x7fe4f8130430 2023-09-30T22:30:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.889+0000 7fe4fd13f700 1 -- 172.21.15.59:0/1007809822 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f000bb20 con 0x7fe4f8130430 2023-09-30T22:30:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.889+0000 7fe4fd13f700 1 -- 172.21.15.59:0/1007809822 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0012430 con 0x7fe4f8130430 2023-09-30T22:30:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.889+0000 7f1da3df4700 1 -- 172.21.15.59:0/2017711148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d9c135e50 msgr2=0x7f1d9c138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.889+0000 7fe5003a5700 1 -- 172.21.15.59:0/1007809822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f8130430 msgr2=0x7fe4f8137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.889+0000 7fe5003a5700 1 --2- 172.21.15.59:0/1007809822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f8130430 0x7fe4f8137c30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009d90 tx=0x7fe4f000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:08.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.889+0000 7f1da3df4700 1 --2- 172.21.15.59:0/2017711148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d9c135e50 0x7f1d9c138230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400f370 tx=0x7f1d9400f680 comp rx=0 tx=0).stop 2023-09-30T22:30:08.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.889+0000 7f1da3df4700 1 -- 172.21.15.59:0/2017711148 shutdown_connections 2023-09-30T22:30:08.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.889+0000 7f1da3df4700 1 --2- 172.21.15.59:0/2017711148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d9c135e50 0x7f1d9c138230 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.889+0000 7f1da3df4700 1 --2- 172.21.15.59:0/2017711148 >> v2:172.21.15.59:3300/0 conn(0x7f1d9c09e1d0 0x7f1d9c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.889+0000 7f1da3df4700 1 -- 172.21.15.59:0/2017711148 >> 172.21.15.59:0/2017711148 conn(0x7f1d9c066f50 msgr2=0x7f1d9c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.889+0000 7fe5003a5700 1 -- 172.21.15.59:0/1007809822 shutdown_connections 2023-09-30T22:30:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.889+0000 7fe5003a5700 1 --2- 172.21.15.59:0/1007809822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f8130430 0x7fe4f8137c30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.890+0000 7fe5003a5700 1 --2- 172.21.15.59:0/1007809822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f812cf60 0x7fe4f806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.890+0000 7fe5003a5700 1 -- 172.21.15.59:0/1007809822 >> 172.21.15.59:0/1007809822 conn(0x7fe4f80a2aa0 msgr2=0x7fe4f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.890+0000 7fe5003a5700 1 -- 172.21.15.59:0/1007809822 shutdown_connections 2023-09-30T22:30:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.890+0000 7fe5003a5700 1 -- 172.21.15.59:0/1007809822 wait complete. 2023-09-30T22:30:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.890+0000 7f1da3df4700 1 -- 172.21.15.59:0/2017711148 shutdown_connections 2023-09-30T22:30:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.891+0000 7fe5003a5700 1 Processor -- start 2023-09-30T22:30:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.891+0000 7f1da3df4700 1 -- 172.21.15.59:0/2017711148 wait complete. 2023-09-30T22:30:08.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.891+0000 7fe5003a5700 1 -- start start 2023-09-30T22:30:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe5003a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4f812cf60 0x7fe4f8138170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe5003a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f812f8b0 0x7fe4f81386b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe5003a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f8130430 0x7fe4f8138bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe5003a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f8137390 con 0x7fe4f812f8b0 2023-09-30T22:30:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe5003a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f81354b0 con 0x7fe4f8130430 2023-09-30T22:30:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe5003a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f8135900 con 0x7fe4f812cf60 2023-09-30T22:30:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe4fe141700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4f812cf60 0x7fe4f8138170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe4fe141700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4f812cf60 0x7fe4f8138170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53504/0 (socket says 172.21.15.59:53504) 2023-09-30T22:30:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe4fe141700 1 -- 172.21.15.59:0/3763289950 learned_addr learned my addr 172.21.15.59:0/3763289950 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe4fd940700 1 --2- 172.21.15.59:0/3763289950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f812f8b0 0x7fe4f81386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe4fe942700 1 --2- 172.21.15.59:0/3763289950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f8130430 0x7fe4f8138bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7f1da3df4700 1 Processor -- start 2023-09-30T22:30:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe4fd940700 1 -- 172.21.15.59:0/3763289950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4f812cf60 msgr2=0x7fe4f8138170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe4fd940700 1 --2- 172.21.15.59:0/3763289950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4f812cf60 0x7fe4f8138170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe4fd940700 1 -- 172.21.15.59:0/3763289950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f8130430 msgr2=0x7fe4f8138bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe4fd940700 1 --2- 172.21.15.59:0/3763289950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f8130430 0x7fe4f8138bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.892+0000 7fe4fd940700 1 -- 172.21.15.59:0/3763289950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f0009a70 con 0x7fe4f812f8b0 2023-09-30T22:30:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.893+0000 7fe4fd940700 1 --2- 172.21.15.59:0/3763289950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f812f8b0 0x7fe4f81386b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8129f70 tx=0x7fe4e800c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.893+0000 7f1da3df4700 1 -- start start 2023-09-30T22:30:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.893+0000 7fe4eeffd700 1 -- 172.21.15.59:0/3763289950 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8004c80 con 0x7fe4f812f8b0 2023-09-30T22:30:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.893+0000 7fe4eeffd700 1 -- 172.21.15.59:0/3763289950 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e8004de0 con 0x7fe4f812f8b0 2023-09-30T22:30:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.893+0000 7fe5003a5700 1 -- 172.21.15.59:0/3763289950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f8129fa0 con 0x7fe4f812f8b0 2023-09-30T22:30:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.893+0000 7fe5003a5700 1 -- 172.21.15.59:0/3763289950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f81366b0 con 0x7fe4f812f8b0 2023-09-30T22:30:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.893+0000 7f1da3df4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d9c09d6f0 0x7f1d9c1cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da3df4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d9c09e1d0 0x7f1d9c1ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da3df4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c135e50 0x7f1d9c1cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da3df4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0a2000 con 0x7f1d9c135e50 2023-09-30T22:30:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da3df4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c124740 con 0x7f1d9c09e1d0 2023-09-30T22:30:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da3df4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c121da0 con 0x7f1d9c09d6f0 2023-09-30T22:30:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da2391700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c135e50 0x7f1d9c1cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da1b90700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d9c09d6f0 0x7f1d9c1cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da2391700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c135e50 0x7f1d9c1cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51892/0 (socket says 172.21.15.59:51892) 2023-09-30T22:30:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da1b90700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d9c09d6f0 0x7f1d9c1cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53506/0 (socket says 172.21.15.59:53506) 2023-09-30T22:30:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da2391700 1 -- 172.21.15.59:0/3773032537 learned_addr learned my addr 172.21.15.59:0/3773032537 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da138f700 1 --2- 172.21.15.59:0/3773032537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d9c09e1d0 0x7f1d9c1ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da2391700 1 -- 172.21.15.59:0/3773032537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d9c09d6f0 msgr2=0x7f1d9c1cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da2391700 1 --2- 172.21.15.59:0/3773032537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d9c09d6f0 0x7f1d9c1cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da2391700 1 -- 172.21.15.59:0/3773032537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d9c09e1d0 msgr2=0x7f1d9c1ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da2391700 1 --2- 172.21.15.59:0/3773032537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d9c09e1d0 0x7f1d9c1ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7f1da2391700 1 -- 172.21.15.59:0/3773032537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9400f050 con 0x7f1d9c135e50 2023-09-30T22:30:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7fe4eeffd700 1 -- 172.21.15.59:0/3763289950 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8007310 con 0x7fe4f812f8b0 2023-09-30T22:30:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7fe4eeffd700 1 -- 172.21.15.59:0/3763289950 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4e80074b0 con 0x7fe4f812f8b0 2023-09-30T22:30:08.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.894+0000 7fe5003a5700 1 -- 172.21.15.59:0/3763289950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f8074ea0 con 0x7fe4f812f8b0 2023-09-30T22:30:08.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.895+0000 7f1da2391700 1 --2- 172.21.15.59:0/3773032537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c135e50 0x7f1d9c1cd000 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c09ea70 tx=0x7f1d94004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:08.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.895+0000 7fe4eeffd700 1 -- 172.21.15.59:0/3763289950 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe4e803f3e0 con 0x7fe4f812f8b0 2023-09-30T22:30:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.899+0000 7f1d927fc700 1 -- 172.21.15.59:0/3773032537 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400b940 con 0x7f1d9c135e50 2023-09-30T22:30:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.899+0000 7f1d927fc700 1 -- 172.21.15.59:0/3773032537 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9400baa0 con 0x7f1d9c135e50 2023-09-30T22:30:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.899+0000 7f1d927fc700 1 -- 172.21.15.59:0/3773032537 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400be50 con 0x7f1d9c135e50 2023-09-30T22:30:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.899+0000 7f1da3df4700 1 -- 172.21.15.59:0/3773032537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9c1230c0 con 0x7f1d9c135e50 2023-09-30T22:30:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.899+0000 7f1da3df4700 1 -- 172.21.15.59:0/3773032537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c1bf4d0 con 0x7f1d9c135e50 2023-09-30T22:30:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.899+0000 7fe4eeffd700 1 -- 172.21.15.59:0/3763289950 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4e80106d0 con 0x7fe4f812f8b0 2023-09-30T22:30:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.900+0000 7f1da3df4700 1 -- 172.21.15.59:0/3773032537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9c09dcd0 con 0x7f1d9c135e50 2023-09-30T22:30:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.900+0000 7f1d927fc700 1 -- 172.21.15.59:0/3773032537 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d94009070 con 0x7f1d9c135e50 2023-09-30T22:30:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.901+0000 7f1d927fc700 1 -- 172.21.15.59:0/3773032537 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1d940412d0 con 0x7f1d9c135e50 2023-09-30T22:30:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:08.906+0000 7f1d927fc700 1 -- 172.21.15.59:0/3773032537 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d94015390 con 0x7f1d9c135e50 2023-09-30T22:30:09.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.092+0000 7f8a91033700 1 -- 172.21.15.59:0/4114302657 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8a8c04ea50 con 0x7f8a8c09f240 2023-09-30T22:30:09.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.093+0000 7f8a737fe700 1 -- 172.21.15.59:0/4114302657 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a80019d20 con 0x7f8a8c09f240 2023-09-30T22:30:09.095 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:09.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.095+0000 7f8a91033700 1 -- 172.21.15.59:0/4114302657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a8c09f240 msgr2=0x7f8a8c06bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.095+0000 7f8a91033700 1 --2- 172.21.15.59:0/4114302657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a8c09f240 0x7f8a8c06bdc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000c500 tx=0x7f8a8000c810 comp rx=0 tx=0).stop 2023-09-30T22:30:09.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.095+0000 7f8a91033700 1 -- 172.21.15.59:0/4114302657 shutdown_connections 2023-09-30T22:30:09.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.095+0000 7f8a91033700 1 --2- 172.21.15.59:0/4114302657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a8c09f650 0x7f8a8c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.095+0000 7f8a91033700 1 --2- 172.21.15.59:0/4114302657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8c09e930 0x7f8a8c06b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.095+0000 7f8a91033700 1 --2- 172.21.15.59:0/4114302657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a8c09f240 0x7f8a8c06bdc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.095+0000 7f8a91033700 1 -- 172.21.15.59:0/4114302657 >> 172.21.15.59:0/4114302657 conn(0x7f8a8c0a4210 msgr2=0x7f8a8c1b7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:09.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.095+0000 7f8a91033700 1 -- 172.21.15.59:0/4114302657 shutdown_connections 2023-09-30T22:30:09.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.095+0000 7f8a91033700 1 -- 172.21.15.59:0/4114302657 wait complete. 2023-09-30T22:30:09.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.105+0000 7fe5003a5700 1 -- 172.21.15.59:0/3763289950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe4f80713a0 con 0x7fe4f812f8b0 2023-09-30T22:30:09.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.105+0000 7fe4eeffd700 1 -- 172.21.15.59:0/3763289950 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4e80102c0 con 0x7fe4f812f8b0 2023-09-30T22:30:09.106 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.108+0000 7fe5003a5700 1 -- 172.21.15.59:0/3763289950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f812f8b0 msgr2=0x7fe4f81386b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.108+0000 7fe5003a5700 1 --2- 172.21.15.59:0/3763289950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f812f8b0 0x7fe4f81386b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8129f70 tx=0x7fe4e800c750 comp rx=0 tx=0).stop 2023-09-30T22:30:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.108+0000 7fe5003a5700 1 -- 172.21.15.59:0/3763289950 shutdown_connections 2023-09-30T22:30:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.108+0000 7fe5003a5700 1 --2- 172.21.15.59:0/3763289950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4f812cf60 0x7fe4f8138170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.108+0000 7fe5003a5700 1 --2- 172.21.15.59:0/3763289950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f8130430 0x7fe4f8138bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.108+0000 7fe5003a5700 1 --2- 172.21.15.59:0/3763289950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f812f8b0 0x7fe4f81386b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.108+0000 7fe5003a5700 1 -- 172.21.15.59:0/3763289950 >> 172.21.15.59:0/3763289950 conn(0x7fe4f80a2aa0 msgr2=0x7fe4f806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:09.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.108+0000 7fe5003a5700 1 -- 172.21.15.59:0/3763289950 shutdown_connections 2023-09-30T22:30:09.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.108+0000 7fe5003a5700 1 -- 172.21.15.59:0/3763289950 wait complete. 2023-09-30T22:30:09.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:09.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.114+0000 7f1da3df4700 1 -- 172.21.15.59:0/3773032537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1d9c074ea0 con 0x7f1d9c135e50 2023-09-30T22:30:09.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.114+0000 7f1d927fc700 1 -- 172.21.15.59:0/3773032537 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d94023070 con 0x7f1d9c135e50 2023-09-30T22:30:09.115 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.116+0000 7f1da3df4700 1 -- 172.21.15.59:0/3773032537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c135e50 msgr2=0x7f1d9c1cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.116+0000 7f1da3df4700 1 --2- 172.21.15.59:0/3773032537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c135e50 0x7f1d9c1cd000 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c09ea70 tx=0x7f1d94004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.116+0000 7f1da3df4700 1 -- 172.21.15.59:0/3773032537 shutdown_connections 2023-09-30T22:30:09.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.116+0000 7f1da3df4700 1 --2- 172.21.15.59:0/3773032537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d9c09d6f0 0x7f1d9c1cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.116+0000 7f1da3df4700 1 --2- 172.21.15.59:0/3773032537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c135e50 0x7f1d9c1cd000 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.116+0000 7f1da3df4700 1 --2- 172.21.15.59:0/3773032537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d9c09e1d0 0x7f1d9c1ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.116+0000 7f1da3df4700 1 -- 172.21.15.59:0/3773032537 >> 172.21.15.59:0/3773032537 conn(0x7f1d9c066f50 msgr2=0x7f1d9c070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:09.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.116+0000 7f1da3df4700 1 -- 172.21.15.59:0/3773032537 shutdown_connections 2023-09-30T22:30:09.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.116+0000 7f1da3df4700 1 -- 172.21.15.59:0/3773032537 wait complete. 2023-09-30T22:30:09.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:09.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:09.757 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:09.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.906+0000 7f45f53de700 1 Processor -- start 2023-09-30T22:30:09.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.906+0000 7f45f53de700 1 -- start start 2023-09-30T22:30:09.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.906+0000 7f45f53de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00a0a30 0x7f45f00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45f53de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f009d630 0x7f45f00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45f53de700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45f0133930 0x7f45f0133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45f53de700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f00a2a70 con 0x7f45f0133930 2023-09-30T22:30:09.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45f53de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00a01d0 con 0x7f45f00a0a30 2023-09-30T22:30:09.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45f53de700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45f009e2b0 con 0x7f45f009d630 2023-09-30T22:30:09.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45eeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00a0a30 0x7f45f00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45ee7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f009d630 0x7f45f00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45ef7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45f0133930 0x7f45f0133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45ee7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f009d630 0x7f45f00a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53514/0 (socket says 172.21.15.59:53514) 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45eeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00a0a30 0x7f45f00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43232/0 (socket says 172.21.15.59:43232) 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45ee7fc700 1 -- 172.21.15.59:0/2682455332 learned_addr learned my addr 172.21.15.59:0/2682455332 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45eeffd700 1 -- 172.21.15.59:0/2682455332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f009d630 msgr2=0x7f45f00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45eeffd700 1 --2- 172.21.15.59:0/2682455332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f009d630 0x7f45f00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45eeffd700 1 -- 172.21.15.59:0/2682455332 >> v2:172.21.15.59:3300/0 conn(0x7f45f0133930 msgr2=0x7f45f0133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45eeffd700 1 --2- 172.21.15.59:0/2682455332 >> v2:172.21.15.59:3300/0 conn(0x7f45f0133930 0x7f45f0133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45eeffd700 1 -- 172.21.15.59:0/2682455332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f009dc50 con 0x7f45f00a0a30 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45ef7fe700 1 --2- 172.21.15.59:0/2682455332 >> v2:172.21.15.59:3300/0 conn(0x7f45f0133930 0x7f45f0133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45ee7fc700 1 --2- 172.21.15.59:0/2682455332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f009d630 0x7f45f00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45eeffd700 1 --2- 172.21.15.59:0/2682455332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00a0a30 0x7f45f00a0e00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009840 tx=0x7f45e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55bfe7fcfd30e4b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:09.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.907+0000 7f45edffb700 1 -- 172.21.15.59:0/2682455332 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0011830 con 0x7f45f00a0a30 2023-09-30T22:30:09.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.908+0000 7f45edffb700 1 -- 172.21.15.59:0/2682455332 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e0011990 con 0x7f45f00a0a30 2023-09-30T22:30:09.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.908+0000 7f45edffb700 1 -- 172.21.15.59:0/2682455332 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0011d20 con 0x7f45f00a0a30 2023-09-30T22:30:09.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.908+0000 7f45f53de700 1 -- 172.21.15.59:0/2682455332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00a0a30 msgr2=0x7f45f00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.908+0000 7f45f53de700 1 --2- 172.21.15.59:0/2682455332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00a0a30 0x7f45f00a0e00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009840 tx=0x7f45e0009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:09.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.908+0000 7f45f53de700 1 -- 172.21.15.59:0/2682455332 shutdown_connections 2023-09-30T22:30:09.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.908+0000 7f45f53de700 1 --2- 172.21.15.59:0/2682455332 >> v2:172.21.15.59:3300/0 conn(0x7f45f0133930 0x7f45f0133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.908+0000 7f45f53de700 1 --2- 172.21.15.59:0/2682455332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00a0a30 0x7f45f00a0e00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.908+0000 7f45f53de700 1 --2- 172.21.15.59:0/2682455332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f009d630 0x7f45f00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.908+0000 7f45f53de700 1 -- 172.21.15.59:0/2682455332 >> 172.21.15.59:0/2682455332 conn(0x7f45f00a3050 msgr2=0x7f45f00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:09.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.908+0000 7f45f53de700 1 -- 172.21.15.59:0/2682455332 shutdown_connections 2023-09-30T22:30:09.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.908+0000 7f45f53de700 1 -- 172.21.15.59:0/2682455332 wait complete. 2023-09-30T22:30:09.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.909+0000 7f45f53de700 1 Processor -- start 2023-09-30T22:30:09.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.909+0000 7f45f53de700 1 -- start start 2023-09-30T22:30:09.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45f53de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f009d630 0x7f45f01c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45f53de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00a0a30 0x7f45f01c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45f53de700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f0133930 0x7f45f01c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45f53de700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f0133260 con 0x7f45f0133930 2023-09-30T22:30:09.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45f53de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f01206d0 con 0x7f45f00a0a30 2023-09-30T22:30:09.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45f53de700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00a40c0 con 0x7f45f009d630 2023-09-30T22:30:09.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45ef7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f0133930 0x7f45f01c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45ee7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00a0a30 0x7f45f01c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45eeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f009d630 0x7f45f01c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45ef7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f0133930 0x7f45f01c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51908/0 (socket says 172.21.15.59:51908) 2023-09-30T22:30:09.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45ee7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00a0a30 0x7f45f01c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43246/0 (socket says 172.21.15.59:43246) 2023-09-30T22:30:09.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45ef7fe700 1 -- 172.21.15.59:0/3980557669 learned_addr learned my addr 172.21.15.59:0/3980557669 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:09.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45ef7fe700 1 -- 172.21.15.59:0/3980557669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f009d630 msgr2=0x7f45f01c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45ef7fe700 1 --2- 172.21.15.59:0/3980557669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f009d630 0x7f45f01c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45ef7fe700 1 -- 172.21.15.59:0/3980557669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00a0a30 msgr2=0x7f45f01c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45ef7fe700 1 --2- 172.21.15.59:0/3980557669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00a0a30 0x7f45f01c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45ef7fe700 1 -- 172.21.15.59:0/3980557669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d8009550 con 0x7f45f0133930 2023-09-30T22:30:09.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45ee7fc700 1 --2- 172.21.15.59:0/3980557669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00a0a30 0x7f45f01c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:09.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.910+0000 7f45eeffd700 1 --2- 172.21.15.59:0/3980557669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f009d630 0x7f45f01c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:09.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.911+0000 7f45ef7fe700 1 --2- 172.21.15.59:0/3980557669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f0133930 0x7f45f01c8ba0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f45e800efc0 tx=0x7f45e800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:09.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.911+0000 7f45e77fe700 1 -- 172.21.15.59:0/3980557669 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e800ca90 con 0x7f45f0133930 2023-09-30T22:30:09.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.911+0000 7f45e77fe700 1 -- 172.21.15.59:0/3980557669 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e800f040 con 0x7f45f0133930 2023-09-30T22:30:09.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.911+0000 7f45f53de700 1 -- 172.21.15.59:0/3980557669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e8009a70 con 0x7f45f0133930 2023-09-30T22:30:09.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.911+0000 7f45e77fe700 1 -- 172.21.15.59:0/3980557669 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e800ce10 con 0x7f45f0133930 2023-09-30T22:30:09.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.911+0000 7f45f53de700 1 -- 172.21.15.59:0/3980557669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e00094a0 con 0x7f45f0133930 2023-09-30T22:30:09.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.912+0000 7f45e77fe700 1 -- 172.21.15.59:0/3980557669 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45e8014480 con 0x7f45f0133930 2023-09-30T22:30:09.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.912+0000 7f45e77fe700 1 -- 172.21.15.59:0/3980557669 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f45e803fc90 con 0x7f45f0133930 2023-09-30T22:30:09.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.912+0000 7f45f53de700 1 -- 172.21.15.59:0/3980557669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f00747f0 con 0x7f45f0133930 2023-09-30T22:30:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:09.917+0000 7f45e77fe700 1 -- 172.21.15.59:0/3980557669 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45e8012930 con 0x7f45f0133930 2023-09-30T22:30:10.111 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:10.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.119+0000 7f45f53de700 1 -- 172.21.15.59:0/3980557669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f45f0072980 con 0x7f45f0133930 2023-09-30T22:30:10.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.120+0000 7f45e77fe700 1 -- 172.21.15.59:0/3980557669 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45e801c3b0 con 0x7f45f0133930 2023-09-30T22:30:10.121 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.122+0000 7f45f53de700 1 -- 172.21.15.59:0/3980557669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f0133930 msgr2=0x7f45f01c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.122+0000 7f45f53de700 1 --2- 172.21.15.59:0/3980557669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f0133930 0x7f45f01c8ba0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f45e800efc0 tx=0x7f45e800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.122+0000 7f45f53de700 1 -- 172.21.15.59:0/3980557669 shutdown_connections 2023-09-30T22:30:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.122+0000 7f45f53de700 1 --2- 172.21.15.59:0/3980557669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f009d630 0x7f45f01c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.122+0000 7f45f53de700 1 --2- 172.21.15.59:0/3980557669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f0133930 0x7f45f01c8ba0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.122+0000 7f45f53de700 1 --2- 172.21.15.59:0/3980557669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00a0a30 0x7f45f01c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.122+0000 7f45f53de700 1 -- 172.21.15.59:0/3980557669 >> 172.21.15.59:0/3980557669 conn(0x7f45f00a3050 msgr2=0x7f45f009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.122+0000 7f45f53de700 1 -- 172.21.15.59:0/3980557669 shutdown_connections 2023-09-30T22:30:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.122+0000 7f45f53de700 1 -- 172.21.15.59:0/3980557669 wait complete. 2023-09-30T22:30:10.124 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:10.133 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:10.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:10.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.255+0000 7f17b9b16700 1 Processor -- start 2023-09-30T22:30:10.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.255+0000 7f17b9b16700 1 -- start start 2023-09-30T22:30:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b9b16700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17b40a0a30 0x7f17b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b9b16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b40a1340 0x7f17b4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b9b16700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b409edd0 con 0x7f17b4133fa0 2023-09-30T22:30:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b9b16700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b409e1f0 con 0x7f17b40a0a30 2023-09-30T22:30:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b9b16700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b409dc50 con 0x7f17b40a1340 2023-09-30T22:30:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b40a1340 0x7f17b4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17b40a0a30 0x7f17b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b40a1340 0x7f17b4133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43248/0 (socket says 172.21.15.59:43248) 2023-09-30T22:30:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17b40a0a30 0x7f17b40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51914/0 (socket says 172.21.15.59:51914) 2023-09-30T22:30:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b2ffd700 1 -- 172.21.15.59:0/2058252359 learned_addr learned my addr 172.21.15.59:0/2058252359 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b37fe700 1 -- 172.21.15.59:0/2058252359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b40a1340 msgr2=0x7f17b4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b37fe700 1 --2- 172.21.15.59:0/2058252359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b40a1340 0x7f17b4133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b37fe700 1 -- 172.21.15.59:0/2058252359 >> v1:172.21.15.59:6789/0 conn(0x7f17b4133fa0 legacy=0x7f17b413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b37fe700 1 -- 172.21.15.59:0/2058252359 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b40a1fe0 con 0x7f17b40a0a30 2023-09-30T22:30:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b2ffd700 1 --2- 172.21.15.59:0/2058252359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b40a1340 0x7f17b4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.256+0000 7f17b37fe700 1 --2- 172.21.15.59:0/2058252359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b40a0a30 0x7f17b40a0e00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009d90 tx=0x7f17a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72722c4e81aeb7d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.257+0000 7f17b27fc700 1 -- 172.21.15.59:0/2058252359 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a400e070 con 0x7f17b40a0a30 2023-09-30T22:30:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.257+0000 7f17b27fc700 1 -- 172.21.15.59:0/2058252359 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a400bb20 con 0x7f17b40a0a30 2023-09-30T22:30:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.257+0000 7f17b27fc700 1 -- 172.21.15.59:0/2058252359 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a4012430 con 0x7f17b40a0a30 2023-09-30T22:30:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.258+0000 7f17b9b16700 1 -- 172.21.15.59:0/2058252359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b40a0a30 msgr2=0x7f17b40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.258+0000 7f17b9b16700 1 --2- 172.21.15.59:0/2058252359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b40a0a30 0x7f17b40a0e00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009d90 tx=0x7f17a400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.258+0000 7f17b9b16700 1 -- 172.21.15.59:0/2058252359 shutdown_connections 2023-09-30T22:30:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.258+0000 7f17b9b16700 1 --2- 172.21.15.59:0/2058252359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b40a0a30 0x7f17b40a0e00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.258+0000 7f17b9b16700 1 --2- 172.21.15.59:0/2058252359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b40a1340 0x7f17b4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.258+0000 7f17b9b16700 1 -- 172.21.15.59:0/2058252359 >> 172.21.15.59:0/2058252359 conn(0x7f17b40a6550 msgr2=0x7f17b40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.258+0000 7f17b9b16700 1 -- 172.21.15.59:0/2058252359 shutdown_connections 2023-09-30T22:30:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.258+0000 7f17b9b16700 1 -- 172.21.15.59:0/2058252359 wait complete. 2023-09-30T22:30:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.259+0000 7f17b9b16700 1 Processor -- start 2023-09-30T22:30:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.259+0000 7f17b9b16700 1 -- start start 2023-09-30T22:30:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.260+0000 7f17b9b16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b40a0a30 0x7f17b411e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.260+0000 7f17b9b16700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b40a1340 0x7f17b411ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.260+0000 7f17b9b16700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b4133fa0 0x7f17b411f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.260+0000 7f17b9b16700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b4121f50 con 0x7f17b4133fa0 2023-09-30T22:30:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.260+0000 7f17b9b16700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b4120430 con 0x7f17b40a0a30 2023-09-30T22:30:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.260+0000 7f17b9b16700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40a37e0 con 0x7f17b40a1340 2023-09-30T22:30:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.260+0000 7f17b37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b40a0a30 0x7f17b411e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.260+0000 7f17b37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b40a0a30 0x7f17b411e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43254/0 (socket says 172.21.15.59:43254) 2023-09-30T22:30:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.260+0000 7f17b37fe700 1 -- 172.21.15.59:0/2893197922 learned_addr learned my addr 172.21.15.59:0/2893197922 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.260+0000 7f17b2ffd700 1 --2- 172.21.15.59:0/2893197922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b40a1340 0x7f17b411ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.260+0000 7f17b3fff700 1 --2- 172.21.15.59:0/2893197922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b4133fa0 0x7f17b411f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.261+0000 7f17b37fe700 1 -- 172.21.15.59:0/2893197922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b40a1340 msgr2=0x7f17b411ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.261+0000 7f17b37fe700 1 --2- 172.21.15.59:0/2893197922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b40a1340 0x7f17b411ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.261+0000 7f17b37fe700 1 -- 172.21.15.59:0/2893197922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b4133fa0 msgr2=0x7f17b411f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.261+0000 7f17b37fe700 1 --2- 172.21.15.59:0/2893197922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b4133fa0 0x7f17b411f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.261+0000 7f17b37fe700 1 -- 172.21.15.59:0/2893197922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a8009550 con 0x7f17b40a0a30 2023-09-30T22:30:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.261+0000 7f17b37fe700 1 --2- 172.21.15.59:0/2893197922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b40a0a30 0x7f17b411e7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f17b409e330 tx=0x7f17a4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.261+0000 7f179bfff700 1 -- 172.21.15.59:0/2893197922 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a4012430 con 0x7f17b40a0a30 2023-09-30T22:30:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.261+0000 7f179bfff700 1 -- 172.21.15.59:0/2893197922 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a4020070 con 0x7f17b40a0a30 2023-09-30T22:30:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.261+0000 7f17b9b16700 1 -- 172.21.15.59:0/2893197922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a4009a70 con 0x7f17b40a0a30 2023-09-30T22:30:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.261+0000 7f179bfff700 1 -- 172.21.15.59:0/2893197922 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a4004280 con 0x7f17b40a0a30 2023-09-30T22:30:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.261+0000 7f17b9b16700 1 -- 172.21.15.59:0/2893197922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b40a0270 con 0x7f17b40a0a30 2023-09-30T22:30:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.262+0000 7f179bfff700 1 -- 172.21.15.59:0/2893197922 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17a40043e0 con 0x7f17b40a0a30 2023-09-30T22:30:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.262+0000 7f179bfff700 1 -- 172.21.15.59:0/2893197922 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f17a4022070 con 0x7f17b40a0a30 2023-09-30T22:30:10.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.263+0000 7f17b9b16700 1 -- 172.21.15.59:0/2893197922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b4122a80 con 0x7f17b40a0a30 2023-09-30T22:30:10.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.267+0000 7fa2b29d2700 1 Processor -- start 2023-09-30T22:30:10.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.267+0000 7fa2b29d2700 1 -- start start 2023-09-30T22:30:10.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.267+0000 7fa2b29d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac131730 0x7fa2ac131b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.267+0000 7fa2b29d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac099a40 0x7fa2ac099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.267+0000 7fa2b29d2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac06f5d0 con 0x7fa2ac09a3d0 2023-09-30T22:30:10.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.267+0000 7fa2b29d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac06f9a0 con 0x7fa2ac099a40 2023-09-30T22:30:10.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.267+0000 7fa2b29d2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac1312e0 con 0x7fa2ac131730 2023-09-30T22:30:10.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.267+0000 7fa2abfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac131730 0x7fa2ac131b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.267+0000 7fa2ab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac099a40 0x7fa2ac099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.267+0000 7fa2ab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac099a40 0x7fa2ac099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43268/0 (socket says 172.21.15.59:43268) 2023-09-30T22:30:10.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.267+0000 7fa2abfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac131730 0x7fa2ac131b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53534/0 (socket says 172.21.15.59:53534) 2023-09-30T22:30:10.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.267+0000 7fa2ab7fe700 1 -- 172.21.15.59:0/1005531698 learned_addr learned my addr 172.21.15.59:0/1005531698 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:10.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.268+0000 7fa2ab7fe700 1 -- 172.21.15.59:0/1005531698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac131730 msgr2=0x7fa2ac131b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:10.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.268+0000 7fa2ab7fe700 1 --2- 172.21.15.59:0/1005531698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac131730 0x7fa2ac131b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.268+0000 7fa2ab7fe700 1 -- 172.21.15.59:0/1005531698 >> v1:172.21.15.59:6789/0 conn(0x7fa2ac09a3d0 legacy=0x7fa2ac138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.268+0000 7fa2ab7fe700 1 -- 172.21.15.59:0/1005531698 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac09b630 con 0x7fa2ac099a40 2023-09-30T22:30:10.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.268+0000 7fa2aaffd700 1 -- 172.21.15.59:0/1005531698 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546195508 0 0) 0x7fa2ac06f5d0 con 0x7fa2ac09a3d0 2023-09-30T22:30:10.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.268+0000 7fa2abfff700 1 --2- 172.21.15.59:0/1005531698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac131730 0x7fa2ac131b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:10.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.268+0000 7f179bfff700 1 -- 172.21.15.59:0/2893197922 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17a401c400 con 0x7f17b40a0a30 2023-09-30T22:30:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.268+0000 7fa2ab7fe700 1 --2- 172.21.15.59:0/1005531698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac099a40 0x7fa2ac099e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009920 tx=0x7fa2a0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=611cd5a5d3ab1e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.268+0000 7fa2aaffd700 1 -- 172.21.15.59:0/1005531698 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0011830 con 0x7fa2ac099a40 2023-09-30T22:30:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.268+0000 7fa2aaffd700 1 -- 172.21.15.59:0/1005531698 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a0011990 con 0x7fa2ac099a40 2023-09-30T22:30:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.268+0000 7fa2aaffd700 1 -- 172.21.15.59:0/1005531698 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0011d20 con 0x7fa2ac099a40 2023-09-30T22:30:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.269+0000 7fa2b29d2700 1 -- 172.21.15.59:0/1005531698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac099a40 msgr2=0x7fa2ac099e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.269+0000 7fa2b29d2700 1 --2- 172.21.15.59:0/1005531698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac099a40 0x7fa2ac099e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009920 tx=0x7fa2a0009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.269+0000 7fa2b29d2700 1 -- 172.21.15.59:0/1005531698 shutdown_connections 2023-09-30T22:30:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.269+0000 7fa2b29d2700 1 --2- 172.21.15.59:0/1005531698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac131730 0x7fa2ac131b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.269+0000 7fa2b29d2700 1 --2- 172.21.15.59:0/1005531698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac099a40 0x7fa2ac099e90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.269+0000 7fa2b29d2700 1 -- 172.21.15.59:0/1005531698 >> 172.21.15.59:0/1005531698 conn(0x7fa2ac0a27f0 msgr2=0x7fa2ac0a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.269+0000 7fa2b29d2700 1 -- 172.21.15.59:0/1005531698 shutdown_connections 2023-09-30T22:30:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.269+0000 7fa2b29d2700 1 -- 172.21.15.59:0/1005531698 wait complete. 2023-09-30T22:30:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.270+0000 7fa2b29d2700 1 Processor -- start 2023-09-30T22:30:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.270+0000 7fa2b29d2700 1 -- start start 2023-09-30T22:30:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.271+0000 7fa2b29d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac099a40 0x7fa2ac11b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.271+0000 7fa2b29d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac09a3d0 0x7fa2ac11bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.271+0000 7fa2b29d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac131730 0x7fa2ac11bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.271+0000 7fa2b29d2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac11f090 con 0x7fa2ac131730 2023-09-30T22:30:10.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.271+0000 7fa2b29d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac11e820 con 0x7fa2ac09a3d0 2023-09-30T22:30:10.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.271+0000 7fa2b29d2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0a1ca0 con 0x7fa2ac099a40 2023-09-30T22:30:10.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.271+0000 7fa2abfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac099a40 0x7fa2ac11b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.271+0000 7fa2ab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac09a3d0 0x7fa2ac11bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.271+0000 7fa2abfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac099a40 0x7fa2ac11b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53538/0 (socket says 172.21.15.59:53538) 2023-09-30T22:30:10.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.271+0000 7fa2abfff700 1 -- 172.21.15.59:0/2337655408 learned_addr learned my addr 172.21.15.59:0/2337655408 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:10.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.271+0000 7fa2ab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac09a3d0 0x7fa2ac11bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43270/0 (socket says 172.21.15.59:43270) 2023-09-30T22:30:10.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.271+0000 7fa2b0f6f700 1 --2- 172.21.15.59:0/2337655408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac131730 0x7fa2ac11bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.272+0000 7fa2abfff700 1 -- 172.21.15.59:0/2337655408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac09a3d0 msgr2=0x7fa2ac11bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.272+0000 7fa2abfff700 1 --2- 172.21.15.59:0/2337655408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac09a3d0 0x7fa2ac11bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.272+0000 7fa2abfff700 1 -- 172.21.15.59:0/2337655408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac131730 msgr2=0x7fa2ac11bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.272+0000 7fa2abfff700 1 --2- 172.21.15.59:0/2337655408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac131730 0x7fa2ac11bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.272+0000 7fa2abfff700 1 -- 172.21.15.59:0/2337655408 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0094a0 con 0x7fa2ac099a40 2023-09-30T22:30:10.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.272+0000 7fa2abfff700 1 --2- 172.21.15.59:0/2337655408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac099a40 0x7fa2ac11b570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00ebe0 tx=0x7fa29c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:10.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.272+0000 7fa2a8ff9700 1 -- 172.21.15.59:0/2337655408 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00c850 con 0x7fa2ac099a40 2023-09-30T22:30:10.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.272+0000 7fa2a8ff9700 1 -- 172.21.15.59:0/2337655408 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c00c9b0 con 0x7fa2ac099a40 2023-09-30T22:30:10.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.272+0000 7fa2a8ff9700 1 -- 172.21.15.59:0/2337655408 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00cd40 con 0x7fa2ac099a40 2023-09-30T22:30:10.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.272+0000 7fa2b29d2700 1 -- 172.21.15.59:0/2337655408 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a0009550 con 0x7fa2ac099a40 2023-09-30T22:30:10.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.272+0000 7fa2b29d2700 1 -- 172.21.15.59:0/2337655408 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac11d180 con 0x7fa2ac099a40 2023-09-30T22:30:10.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.273+0000 7fa2a8ff9700 1 -- 172.21.15.59:0/2337655408 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa29c013470 con 0x7fa2ac099a40 2023-09-30T22:30:10.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.273+0000 7fa2a8ff9700 1 -- 172.21.15.59:0/2337655408 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa29c03fc60 con 0x7fa2ac099a40 2023-09-30T22:30:10.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.274+0000 7fa2b29d2700 1 -- 172.21.15.59:0/2337655408 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac04f2a0 con 0x7fa2ac099a40 2023-09-30T22:30:10.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.284+0000 7fa2a8ff9700 1 -- 172.21.15.59:0/2337655408 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa29c017080 con 0x7fa2ac099a40 2023-09-30T22:30:10.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.331+0000 7f19cca5e700 1 Processor -- start 2023-09-30T22:30:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.331+0000 7f19cca5e700 1 -- start start 2023-09-30T22:30:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.332+0000 7f19cca5e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19c80a0a30 0x7f19c80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.332+0000 7f19cca5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c8134170 0x7f19c813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.332+0000 7f19cca5e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c809edd0 con 0x7f19c80a1340 2023-09-30T22:30:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.332+0000 7f19cca5e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c809e1f0 con 0x7f19c80a0a30 2023-09-30T22:30:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.332+0000 7f19cca5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19c809dc50 con 0x7f19c8134170 2023-09-30T22:30:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.332+0000 7f19c6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c8134170 0x7f19c813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.332+0000 7f19c659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19c80a0a30 0x7f19c80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.332+0000 7f19c6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c8134170 0x7f19c813bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53548/0 (socket says 172.21.15.59:53548) 2023-09-30T22:30:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.332+0000 7f19c6d9d700 1 -- 172.21.15.59:0/3452788521 learned_addr learned my addr 172.21.15.59:0/3452788521 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:10.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.332+0000 7f19c659c700 1 -- 172.21.15.59:0/3452788521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c8134170 msgr2=0x7f19c813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:10.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.332+0000 7f19c659c700 1 --2- 172.21.15.59:0/3452788521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c8134170 0x7f19c813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.332+0000 7f19c659c700 1 -- 172.21.15.59:0/3452788521 >> v1:172.21.15.59:6789/0 conn(0x7f19c80a1340 legacy=0x7f19c8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.332+0000 7f19c659c700 1 -- 172.21.15.59:0/3452788521 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c80a1fe0 con 0x7f19c80a0a30 2023-09-30T22:30:10.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.333+0000 7f19c659c700 1 --2- 172.21.15.59:0/3452788521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c80a0a30 0x7f19c80a0e00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009840 tx=0x7f19b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ff093107709b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:10.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.333+0000 7f19c559a700 1 -- 172.21.15.59:0/3452788521 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b8011830 con 0x7f19c80a0a30 2023-09-30T22:30:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.333+0000 7f19c559a700 1 -- 172.21.15.59:0/3452788521 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b8011990 con 0x7f19c80a0a30 2023-09-30T22:30:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.333+0000 7f19c559a700 1 -- 172.21.15.59:0/3452788521 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b8011d20 con 0x7f19c80a0a30 2023-09-30T22:30:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.334+0000 7f19cca5e700 1 -- 172.21.15.59:0/3452788521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c80a0a30 msgr2=0x7f19c80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.334+0000 7f19cca5e700 1 --2- 172.21.15.59:0/3452788521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c80a0a30 0x7f19c80a0e00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009840 tx=0x7f19b8009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.334+0000 7f19cca5e700 1 -- 172.21.15.59:0/3452788521 shutdown_connections 2023-09-30T22:30:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.334+0000 7f19cca5e700 1 --2- 172.21.15.59:0/3452788521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c8134170 0x7f19c813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.334+0000 7f19cca5e700 1 --2- 172.21.15.59:0/3452788521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c80a0a30 0x7f19c80a0e00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.334+0000 7f19cca5e700 1 -- 172.21.15.59:0/3452788521 >> 172.21.15.59:0/3452788521 conn(0x7f19c80a6550 msgr2=0x7f19c80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.334+0000 7f19cca5e700 1 -- 172.21.15.59:0/3452788521 shutdown_connections 2023-09-30T22:30:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.334+0000 7f19cca5e700 1 -- 172.21.15.59:0/3452788521 wait complete. 2023-09-30T22:30:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.336+0000 7f19cca5e700 1 Processor -- start 2023-09-30T22:30:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.336+0000 7f19cca5e700 1 -- start start 2023-09-30T22:30:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19cca5e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c80a0a30 0x7f19c81228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19cca5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c80a1340 0x7f19c8122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19cca5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c8134170 0x7f19c8123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19cca5e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c8124720 con 0x7f19c80a0a30 2023-09-30T22:30:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19cca5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c8126200 con 0x7f19c8134170 2023-09-30T22:30:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19cca5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19c81244f0 con 0x7f19c80a1340 2023-09-30T22:30:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19c5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c80a1340 0x7f19c8122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19c6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c8134170 0x7f19c8123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19c5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c80a1340 0x7f19c8122e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53550/0 (socket says 172.21.15.59:53550) 2023-09-30T22:30:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19c5d9b700 1 -- 172.21.15.59:0/1700446481 learned_addr learned my addr 172.21.15.59:0/1700446481 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19c659c700 1 --2- 172.21.15.59:0/1700446481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c80a0a30 0x7f19c81228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19c5d9b700 1 -- 172.21.15.59:0/1700446481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c8134170 msgr2=0x7f19c8123360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19c5d9b700 1 --2- 172.21.15.59:0/1700446481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c8134170 0x7f19c8123360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19c5d9b700 1 -- 172.21.15.59:0/1700446481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c80a0a30 msgr2=0x7f19c81228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19c5d9b700 1 --2- 172.21.15.59:0/1700446481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c80a0a30 0x7f19c81228e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19c5d9b700 1 -- 172.21.15.59:0/1700446481 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b80094a0 con 0x7f19c80a1340 2023-09-30T22:30:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19c6d9d700 1 --2- 172.21.15.59:0/1700446481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c8134170 0x7f19c8123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.337+0000 7f19c5d9b700 1 --2- 172.21.15.59:0/1700446481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c80a1340 0x7f19c8122e20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f19b000c510 tx=0x7f19b000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.338+0000 7f19beffd700 1 -- 172.21.15.59:0/1700446481 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b00052d0 con 0x7f19c80a1340 2023-09-30T22:30:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.338+0000 7f19beffd700 1 -- 172.21.15.59:0/1700446481 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b0005430 con 0x7f19c80a1340 2023-09-30T22:30:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.338+0000 7f19cca5e700 1 -- 172.21.15.59:0/1700446481 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c80a25e0 con 0x7f19c80a1340 2023-09-30T22:30:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.338+0000 7f19beffd700 1 -- 172.21.15.59:0/1700446481 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b00038c0 con 0x7f19c80a1340 2023-09-30T22:30:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.338+0000 7f19cca5e700 1 -- 172.21.15.59:0/1700446481 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c80a0270 con 0x7f19c80a1340 2023-09-30T22:30:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.339+0000 7f19beffd700 1 -- 172.21.15.59:0/1700446481 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19b0003a20 con 0x7f19c80a1340 2023-09-30T22:30:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.339+0000 7f19beffd700 1 -- 172.21.15.59:0/1700446481 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f19b003ea80 con 0x7f19c80a1340 2023-09-30T22:30:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.339+0000 7f19cca5e700 1 -- 172.21.15.59:0/1700446481 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c8074ea0 con 0x7f19c80a1340 2023-09-30T22:30:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.344+0000 7f19beffd700 1 -- 172.21.15.59:0/1700446481 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19b0018260 con 0x7f19c80a1340 2023-09-30T22:30:10.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.485+0000 7f17b9b16700 1 -- 172.21.15.59:0/2893197922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f17b4074ea0 con 0x7f17b40a0a30 2023-09-30T22:30:10.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.486+0000 7f179bfff700 1 -- 172.21.15.59:0/2893197922 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17a402c030 con 0x7f17b40a0a30 2023-09-30T22:30:10.487 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:10.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.488+0000 7f17b9b16700 1 -- 172.21.15.59:0/2893197922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b40a0a30 msgr2=0x7f17b411e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.488+0000 7f17b9b16700 1 --2- 172.21.15.59:0/2893197922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b40a0a30 0x7f17b411e7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f17b409e330 tx=0x7f17a4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.488+0000 7f17b9b16700 1 -- 172.21.15.59:0/2893197922 shutdown_connections 2023-09-30T22:30:10.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.488+0000 7f17b9b16700 1 --2- 172.21.15.59:0/2893197922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b4133fa0 0x7f17b411f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.488+0000 7f17b9b16700 1 --2- 172.21.15.59:0/2893197922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b40a0a30 0x7f17b411e7a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.488+0000 7f17b9b16700 1 --2- 172.21.15.59:0/2893197922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b40a1340 0x7f17b411ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.488+0000 7f17b9b16700 1 -- 172.21.15.59:0/2893197922 >> 172.21.15.59:0/2893197922 conn(0x7f17b40a6550 msgr2=0x7f17b41b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:10.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.488+0000 7f17b9b16700 1 -- 172.21.15.59:0/2893197922 shutdown_connections 2023-09-30T22:30:10.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.488+0000 7f17b9b16700 1 -- 172.21.15.59:0/2893197922 wait complete. 2023-09-30T22:30:10.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:10.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.504+0000 7fa2b29d2700 1 -- 172.21.15.59:0/2337655408 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa2ac11ea50 con 0x7fa2ac099a40 2023-09-30T22:30:10.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.505+0000 7fa2a8ff9700 1 -- 172.21.15.59:0/2337655408 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa29c00cea0 con 0x7fa2ac099a40 2023-09-30T22:30:10.506 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:10.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.507+0000 7fa2b29d2700 1 -- 172.21.15.59:0/2337655408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac099a40 msgr2=0x7fa2ac11b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.507+0000 7fa2b29d2700 1 --2- 172.21.15.59:0/2337655408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac099a40 0x7fa2ac11b570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00ebe0 tx=0x7fa29c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.507+0000 7fa2b29d2700 1 -- 172.21.15.59:0/2337655408 shutdown_connections 2023-09-30T22:30:10.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.507+0000 7fa2b29d2700 1 --2- 172.21.15.59:0/2337655408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac099a40 0x7fa2ac11b570 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.507+0000 7fa2b29d2700 1 --2- 172.21.15.59:0/2337655408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac131730 0x7fa2ac11bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.507+0000 7fa2b29d2700 1 --2- 172.21.15.59:0/2337655408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac09a3d0 0x7fa2ac11bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.507+0000 7fa2b29d2700 1 -- 172.21.15.59:0/2337655408 >> 172.21.15.59:0/2337655408 conn(0x7fa2ac0a27f0 msgr2=0x7fa2ac071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:10.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.507+0000 7fa2b29d2700 1 -- 172.21.15.59:0/2337655408 shutdown_connections 2023-09-30T22:30:10.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.507+0000 7fa2b29d2700 1 -- 172.21.15.59:0/2337655408 wait complete. 2023-09-30T22:30:10.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.553+0000 7f19cca5e700 1 -- 172.21.15.59:0/1700446481 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f19c80a28c0 con 0x7f19c80a1340 2023-09-30T22:30:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.553+0000 7f19beffd700 1 -- 172.21.15.59:0/1700446481 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19b0017020 con 0x7f19c80a1340 2023-09-30T22:30:10.555 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:10.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.556+0000 7f19cca5e700 1 -- 172.21.15.59:0/1700446481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c80a1340 msgr2=0x7f19c8122e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.556+0000 7f19cca5e700 1 --2- 172.21.15.59:0/1700446481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c80a1340 0x7f19c8122e20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f19b000c510 tx=0x7f19b000c820 comp rx=0 tx=0).stop 2023-09-30T22:30:10.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.556+0000 7f19cca5e700 1 -- 172.21.15.59:0/1700446481 shutdown_connections 2023-09-30T22:30:10.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.556+0000 7f19cca5e700 1 --2- 172.21.15.59:0/1700446481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c8134170 0x7f19c8123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.556+0000 7f19cca5e700 1 --2- 172.21.15.59:0/1700446481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c80a0a30 0x7f19c81228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.556+0000 7f19cca5e700 1 --2- 172.21.15.59:0/1700446481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c80a1340 0x7f19c8122e20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.556+0000 7f19cca5e700 1 -- 172.21.15.59:0/1700446481 >> 172.21.15.59:0/1700446481 conn(0x7f19c80a6550 msgr2=0x7f19c809ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:10.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.556+0000 7f19cca5e700 1 -- 172.21.15.59:0/1700446481 shutdown_connections 2023-09-30T22:30:10.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:10.556+0000 7f19cca5e700 1 -- 172.21.15.59:0/1700446481 wait complete. 2023-09-30T22:30:10.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:11.139 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:11.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.284+0000 7f981712e700 1 Processor -- start 2023-09-30T22:30:11.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.284+0000 7f981712e700 1 -- start start 2023-09-30T22:30:11.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f981712e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f981009d6f0 0x7f981009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f981712e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981009e440 0x7f9810134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f981712e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981009b120 con 0x7f981009e000 2023-09-30T22:30:11.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f981712e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981006b460 con 0x7f981009d6f0 2023-09-30T22:30:11.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f981712e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f981009a7e0 con 0x7f981009e440 2023-09-30T22:30:11.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f9814eca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f981009d6f0 0x7f981009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f98156cb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981009e440 0x7f9810134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f98156cb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981009e440 0x7f9810134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53560/0 (socket says 172.21.15.59:53560) 2023-09-30T22:30:11.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f9814eca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f981009d6f0 0x7f981009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51954/0 (socket says 172.21.15.59:51954) 2023-09-30T22:30:11.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f98156cb700 1 -- 172.21.15.59:0/1159889172 learned_addr learned my addr 172.21.15.59:0/1159889172 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:11.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f98156cb700 1 -- 172.21.15.59:0/1159889172 >> v2:172.21.15.59:3300/0 conn(0x7f981009d6f0 msgr2=0x7f981009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:11.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f98156cb700 1 --2- 172.21.15.59:0/1159889172 >> v2:172.21.15.59:3300/0 conn(0x7f981009d6f0 0x7f981009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f98156cb700 1 -- 172.21.15.59:0/1159889172 >> v1:172.21.15.59:6789/0 conn(0x7f981009e000 legacy=0x7f98101339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f98156cb700 1 -- 172.21.15.59:0/1159889172 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981009a500 con 0x7f981009e440 2023-09-30T22:30:11.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f9814eca700 1 --2- 172.21.15.59:0/1159889172 >> v2:172.21.15.59:3300/0 conn(0x7f981009d6f0 0x7f981009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:11.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f98156cb700 1 --2- 172.21.15.59:0/1159889172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981009e440 0x7f9810134100 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9808009e80 tx=0x7f980800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=425234c83cc6e470 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f980f7fe700 1 -- 172.21.15.59:0/1159889172 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800e070 con 0x7f981009e440 2023-09-30T22:30:11.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f980f7fe700 1 -- 172.21.15.59:0/1159889172 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980800b8d0 con 0x7f981009e440 2023-09-30T22:30:11.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.285+0000 7f980f7fe700 1 -- 172.21.15.59:0/1159889172 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800bc80 con 0x7f981009e440 2023-09-30T22:30:11.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.286+0000 7f981712e700 1 -- 172.21.15.59:0/1159889172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981009e440 msgr2=0x7f9810134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.286+0000 7f981712e700 1 --2- 172.21.15.59:0/1159889172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981009e440 0x7f9810134100 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9808009e80 tx=0x7f980800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:11.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.286+0000 7f981712e700 1 -- 172.21.15.59:0/1159889172 shutdown_connections 2023-09-30T22:30:11.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.286+0000 7f981712e700 1 --2- 172.21.15.59:0/1159889172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981009e440 0x7f9810134100 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.286+0000 7f981712e700 1 --2- 172.21.15.59:0/1159889172 >> v2:172.21.15.59:3300/0 conn(0x7f981009d6f0 0x7f981009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.286+0000 7f981712e700 1 -- 172.21.15.59:0/1159889172 >> 172.21.15.59:0/1159889172 conn(0x7f9810066f50 msgr2=0x7f981009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:11.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.286+0000 7f981712e700 1 -- 172.21.15.59:0/1159889172 shutdown_connections 2023-09-30T22:30:11.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.286+0000 7f981712e700 1 -- 172.21.15.59:0/1159889172 wait complete. 2023-09-30T22:30:11.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.287+0000 7f981712e700 1 Processor -- start 2023-09-30T22:30:11.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.287+0000 7f981712e700 1 -- start start 2023-09-30T22:30:11.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f981712e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981009d6f0 0x7f98101a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f981712e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981009e000 0x7f98101a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f981712e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981009e440 0x7f98101a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f981712e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98101aa360 con 0x7f981009d6f0 2023-09-30T22:30:11.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f981712e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98101a99a0 con 0x7f981009e000 2023-09-30T22:30:11.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f981712e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98101a8ce0 con 0x7f981009e440 2023-09-30T22:30:11.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f9814eca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981009d6f0 0x7f98101a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f9814eca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981009d6f0 0x7f98101a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51956/0 (socket says 172.21.15.59:51956) 2023-09-30T22:30:11.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f9814eca700 1 -- 172.21.15.59:0/2021030809 learned_addr learned my addr 172.21.15.59:0/2021030809 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:11.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f980ffff700 1 --2- 172.21.15.59:0/2021030809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981009e000 0x7f98101a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f98156cb700 1 --2- 172.21.15.59:0/2021030809 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981009e440 0x7f98101a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f9814eca700 1 -- 172.21.15.59:0/2021030809 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981009e440 msgr2=0x7f98101a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f9814eca700 1 --2- 172.21.15.59:0/2021030809 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981009e440 0x7f98101a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f9814eca700 1 -- 172.21.15.59:0/2021030809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981009e000 msgr2=0x7f98101a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f9814eca700 1 --2- 172.21.15.59:0/2021030809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981009e000 0x7f98101a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.288+0000 7f9814eca700 1 -- 172.21.15.59:0/2021030809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040094a0 con 0x7f981009d6f0 2023-09-30T22:30:11.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.289+0000 7f9814eca700 1 --2- 172.21.15.59:0/2021030809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981009d6f0 0x7f98101a5ed0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f980400ebe0 tx=0x7f980400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.289+0000 7f980d7fa700 1 -- 172.21.15.59:0/2021030809 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980400c850 con 0x7f981009d6f0 2023-09-30T22:30:11.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.289+0000 7f980d7fa700 1 -- 172.21.15.59:0/2021030809 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980400c9b0 con 0x7f981009d6f0 2023-09-30T22:30:11.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.289+0000 7f981712e700 1 -- 172.21.15.59:0/2021030809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9808009b30 con 0x7f981009d6f0 2023-09-30T22:30:11.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.289+0000 7f980d7fa700 1 -- 172.21.15.59:0/2021030809 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980400cd40 con 0x7f981009d6f0 2023-09-30T22:30:11.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.289+0000 7f981712e700 1 -- 172.21.15.59:0/2021030809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98101a7a90 con 0x7f981009d6f0 2023-09-30T22:30:11.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.290+0000 7f980d7fa700 1 -- 172.21.15.59:0/2021030809 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9804013470 con 0x7f981009d6f0 2023-09-30T22:30:11.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.290+0000 7f980d7fa700 1 -- 172.21.15.59:0/2021030809 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f980403fb00 con 0x7f981009d6f0 2023-09-30T22:30:11.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.290+0000 7f981712e700 1 -- 172.21.15.59:0/2021030809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9810074ea0 con 0x7f981009d6f0 2023-09-30T22:30:11.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.295+0000 7f980d7fa700 1 -- 172.21.15.59:0/2021030809 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9804021080 con 0x7f981009d6f0 2023-09-30T22:30:11.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.499+0000 7f981712e700 1 -- 172.21.15.59:0/2021030809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f981009f420 con 0x7f981009d6f0 2023-09-30T22:30:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.499+0000 7f980d7fa700 1 -- 172.21.15.59:0/2021030809 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9804017020 con 0x7f981009d6f0 2023-09-30T22:30:11.500 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.501+0000 7f981712e700 1 -- 172.21.15.59:0/2021030809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981009d6f0 msgr2=0x7f98101a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.501+0000 7f981712e700 1 --2- 172.21.15.59:0/2021030809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981009d6f0 0x7f98101a5ed0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f980400ebe0 tx=0x7f980400eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.501+0000 7f981712e700 1 -- 172.21.15.59:0/2021030809 shutdown_connections 2023-09-30T22:30:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.501+0000 7f981712e700 1 --2- 172.21.15.59:0/2021030809 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981009e440 0x7f98101a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.501+0000 7f981712e700 1 --2- 172.21.15.59:0/2021030809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981009d6f0 0x7f98101a5ed0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.501+0000 7f981712e700 1 --2- 172.21.15.59:0/2021030809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981009e000 0x7f98101a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.501+0000 7f981712e700 1 -- 172.21.15.59:0/2021030809 >> 172.21.15.59:0/2021030809 conn(0x7f9810066f50 msgr2=0x7f98101baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.501+0000 7f981712e700 1 -- 172.21.15.59:0/2021030809 shutdown_connections 2023-09-30T22:30:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.501+0000 7f981712e700 1 -- 172.21.15.59:0/2021030809 wait complete. 2023-09-30T22:30:11.505 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:11.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:11.523 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:11.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.644+0000 7f43ece42700 1 Processor -- start 2023-09-30T22:30:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.645+0000 7f43ece42700 1 -- start start 2023-09-30T22:30:11.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.645+0000 7f43ece42700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43e809e1d0 0x7f43e8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.645+0000 7f43ece42700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43e8139170 0x7f43e813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.645+0000 7f43ece42700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e809b120 con 0x7f43e809d6f0 2023-09-30T22:30:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.645+0000 7f43ece42700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e806b460 con 0x7f43e809e1d0 2023-09-30T22:30:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.645+0000 7f43ece42700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43e809a7e0 con 0x7f43e8139170 2023-09-30T22:30:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.646+0000 7f43e5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43e809e1d0 0x7f43e8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.646+0000 7f43e6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43e8139170 0x7f43e813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.646+0000 7f43e659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f43e809d6f0 0x7f43e809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37356/0 (socket says 172.21.15.59:37356) 2023-09-30T22:30:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.646+0000 7f43e659c700 1 -- 172.21.15.59:0/179345655 learned_addr learned my addr 172.21.15.59:0/179345655 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.646+0000 7f43e559a700 1 -- 172.21.15.59:0/179345655 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871114569 0 0) 0x7f43e809b120 con 0x7f43e809d6f0 2023-09-30T22:30:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.646+0000 7f43e559a700 1 -- 172.21.15.59:0/179345655 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d00035b0 con 0x7f43e809d6f0 2023-09-30T22:30:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.646+0000 7f43e5d9b700 1 -- 172.21.15.59:0/179345655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43e8139170 msgr2=0x7f43e813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.646+0000 7f43e5d9b700 1 --2- 172.21.15.59:0/179345655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43e8139170 0x7f43e813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.646+0000 7f43e5d9b700 1 -- 172.21.15.59:0/179345655 >> v1:172.21.15.59:6789/0 conn(0x7f43e809d6f0 legacy=0x7f43e809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.646+0000 7f43e5d9b700 1 -- 172.21.15.59:0/179345655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e809a500 con 0x7f43e809e1d0 2023-09-30T22:30:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.646+0000 7f43e6d9d700 1 --2- 172.21.15.59:0/179345655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43e8139170 0x7f43e813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.646+0000 7f43e5d9b700 1 --2- 172.21.15.59:0/179345655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43e809e1d0 0x7f43e8138c30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009870 tx=0x7f43dc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e853e5a816cb69e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.646+0000 7f43e559a700 1 -- 172.21.15.59:0/179345655 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc011830 con 0x7f43e809e1d0 2023-09-30T22:30:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.646+0000 7f43e559a700 1 -- 172.21.15.59:0/179345655 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc011990 con 0x7f43e809e1d0 2023-09-30T22:30:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.647+0000 7f43e559a700 1 -- 172.21.15.59:0/179345655 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc011d20 con 0x7f43e809e1d0 2023-09-30T22:30:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.647+0000 7f43ece42700 1 -- 172.21.15.59:0/179345655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43e809e1d0 msgr2=0x7f43e8138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.647+0000 7f43ece42700 1 --2- 172.21.15.59:0/179345655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43e809e1d0 0x7f43e8138c30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009870 tx=0x7f43dc009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.647+0000 7f43ece42700 1 -- 172.21.15.59:0/179345655 shutdown_connections 2023-09-30T22:30:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.647+0000 7f43ece42700 1 --2- 172.21.15.59:0/179345655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43e8139170 0x7f43e813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.647+0000 7f43ece42700 1 --2- 172.21.15.59:0/179345655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43e809e1d0 0x7f43e8138c30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.647+0000 7f43ece42700 1 -- 172.21.15.59:0/179345655 >> 172.21.15.59:0/179345655 conn(0x7f43e8066f50 msgr2=0x7f43e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.647+0000 7f43ece42700 1 -- 172.21.15.59:0/179345655 shutdown_connections 2023-09-30T22:30:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.647+0000 7f43ece42700 1 -- 172.21.15.59:0/179345655 wait complete. 2023-09-30T22:30:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.649+0000 7f43ece42700 1 Processor -- start 2023-09-30T22:30:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.649+0000 7f43ece42700 1 -- start start 2023-09-30T22:30:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.649+0000 7f43ece42700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43e809d6f0 0x7f43e81206f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.649+0000 7f43ece42700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43e809e1d0 0x7f43e8120c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.649+0000 7f43ece42700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43e8139170 0x7f43e8121170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.649+0000 7f43ece42700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8123a10 con 0x7f43e809e1d0 2023-09-30T22:30:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.649+0000 7f43ece42700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8136590 con 0x7f43e8139170 2023-09-30T22:30:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.649+0000 7f43ece42700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43e80a3a60 con 0x7f43e809d6f0 2023-09-30T22:30:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.649+0000 7f43e659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43e809d6f0 0x7f43e81206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.649+0000 7f43e659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43e809d6f0 0x7f43e81206f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53590/0 (socket says 172.21.15.59:53590) 2023-09-30T22:30:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.649+0000 7f43e659c700 1 -- 172.21.15.59:0/3596925493 learned_addr learned my addr 172.21.15.59:0/3596925493 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.650+0000 7f43e6d9d700 1 --2- 172.21.15.59:0/3596925493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43e8139170 0x7f43e8121170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.650+0000 7f43e5d9b700 1 --2- 172.21.15.59:0/3596925493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43e809e1d0 0x7f43e8120c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.650+0000 7f43e659c700 1 -- 172.21.15.59:0/3596925493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43e8139170 msgr2=0x7f43e8121170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.650+0000 7f43e659c700 1 --2- 172.21.15.59:0/3596925493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43e8139170 0x7f43e8121170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.650+0000 7f43e659c700 1 -- 172.21.15.59:0/3596925493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43e809e1d0 msgr2=0x7f43e8120c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.650+0000 7f43e659c700 1 --2- 172.21.15.59:0/3596925493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43e809e1d0 0x7f43e8120c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.650+0000 7f43e659c700 1 -- 172.21.15.59:0/3596925493 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e0009a70 con 0x7f43e809d6f0 2023-09-30T22:30:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.650+0000 7f43e5d9b700 1 --2- 172.21.15.59:0/3596925493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43e809e1d0 0x7f43e8120c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.650+0000 7f43e659c700 1 --2- 172.21.15.59:0/3596925493 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43e809d6f0 0x7f43e81206f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f43d800c730 tx=0x7f43d800caf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.650+0000 7f43d6ffd700 1 -- 172.21.15.59:0/3596925493 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d8005d70 con 0x7f43e809d6f0 2023-09-30T22:30:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.650+0000 7f43d6ffd700 1 -- 172.21.15.59:0/3596925493 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d80070d0 con 0x7f43e809d6f0 2023-09-30T22:30:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.650+0000 7f43ece42700 1 -- 172.21.15.59:0/3596925493 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc0094a0 con 0x7f43e809d6f0 2023-09-30T22:30:11.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.650+0000 7f43d6ffd700 1 -- 172.21.15.59:0/3596925493 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d8007440 con 0x7f43e809d6f0 2023-09-30T22:30:11.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.650+0000 7f43ece42700 1 -- 172.21.15.59:0/3596925493 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e8122b10 con 0x7f43e809d6f0 2023-09-30T22:30:11.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.651+0000 7f43d6ffd700 1 -- 172.21.15.59:0/3596925493 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43d80075a0 con 0x7f43e809d6f0 2023-09-30T22:30:11.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.651+0000 7f43d6ffd700 1 -- 172.21.15.59:0/3596925493 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f43d803eb80 con 0x7f43e809d6f0 2023-09-30T22:30:11.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.652+0000 7f43ece42700 1 -- 172.21.15.59:0/3596925493 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e81242c0 con 0x7f43e809d6f0 2023-09-30T22:30:11.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.661+0000 7f43d6ffd700 1 -- 172.21.15.59:0/3596925493 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43d803ee60 con 0x7f43e809d6f0 2023-09-30T22:30:11.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.700+0000 7f106d5c6700 1 Processor -- start 2023-09-30T22:30:11.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.700+0000 7f106d5c6700 1 -- start start 2023-09-30T22:30:11.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.701+0000 7f106d5c6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f106809d6f0 0x7f106809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.701+0000 7f106d5c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f106809e410 0x7f1068134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.701+0000 7f106d5c6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106809b120 con 0x7f106809e000 2023-09-30T22:30:11.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.701+0000 7f106d5c6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106806b460 con 0x7f106809e410 2023-09-30T22:30:11.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.701+0000 7f106d5c6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f106809a7e0 con 0x7f106809d6f0 2023-09-30T22:30:11.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.701+0000 7f1066ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f106809d6f0 0x7f106809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.701+0000 7f1066ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f106809d6f0 0x7f106809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53606/0 (socket says 172.21.15.59:53606) 2023-09-30T22:30:11.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.701+0000 7f1066ffd700 1 -- 172.21.15.59:0/402239150 learned_addr learned my addr 172.21.15.59:0/402239150 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:11.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.701+0000 7f10677fe700 1 --2- 172.21.15.59:0/402239150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f106809e410 0x7f1068134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.701+0000 7f1066ffd700 1 -- 172.21.15.59:0/402239150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f106809e410 msgr2=0x7f1068134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:11.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.701+0000 7f1065ffb700 1 -- 172.21.15.59:0/402239150 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492305818 0 0) 0x7f106809b120 con 0x7f106809e000 2023-09-30T22:30:11.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.701+0000 7f1066ffd700 1 --2- 172.21.15.59:0/402239150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f106809e410 0x7f1068134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.701+0000 7f1066ffd700 1 -- 172.21.15.59:0/402239150 >> v1:172.21.15.59:6789/0 conn(0x7f106809e000 legacy=0x7f10681339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.701+0000 7f1066ffd700 1 -- 172.21.15.59:0/402239150 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106809a500 con 0x7f106809d6f0 2023-09-30T22:30:11.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.702+0000 7f1066ffd700 1 --2- 172.21.15.59:0/402239150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f106809d6f0 0x7f106809dac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1058009950 tx=0x7f1058009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95a53c70cfb3b0b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.702+0000 7f1065ffb700 1 -- 172.21.15.59:0/402239150 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058011830 con 0x7f106809d6f0 2023-09-30T22:30:11.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.702+0000 7f1065ffb700 1 -- 172.21.15.59:0/402239150 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1058011990 con 0x7f106809d6f0 2023-09-30T22:30:11.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.702+0000 7f1065ffb700 1 -- 172.21.15.59:0/402239150 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058011d40 con 0x7f106809d6f0 2023-09-30T22:30:11.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.702+0000 7f106d5c6700 1 -- 172.21.15.59:0/402239150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f106809d6f0 msgr2=0x7f106809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.703+0000 7f106d5c6700 1 --2- 172.21.15.59:0/402239150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f106809d6f0 0x7f106809dac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1058009950 tx=0x7f1058009c60 comp rx=0 tx=0).stop 2023-09-30T22:30:11.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.703+0000 7f106d5c6700 1 -- 172.21.15.59:0/402239150 shutdown_connections 2023-09-30T22:30:11.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.703+0000 7f106d5c6700 1 --2- 172.21.15.59:0/402239150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f106809d6f0 0x7f106809dac0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.703+0000 7f106d5c6700 1 --2- 172.21.15.59:0/402239150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f106809e410 0x7f1068134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.703+0000 7f106d5c6700 1 -- 172.21.15.59:0/402239150 >> 172.21.15.59:0/402239150 conn(0x7f1068066f50 msgr2=0x7f106809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:11.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.703+0000 7f106d5c6700 1 -- 172.21.15.59:0/402239150 shutdown_connections 2023-09-30T22:30:11.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.703+0000 7f106d5c6700 1 -- 172.21.15.59:0/402239150 wait complete. 2023-09-30T22:30:11.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.704+0000 7f106d5c6700 1 Processor -- start 2023-09-30T22:30:11.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.704+0000 7f106d5c6700 1 -- start start 2023-09-30T22:30:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f106d5c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f106809d6f0 0x7f1068122350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f106d5c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f106809e000 0x7f1068122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f106d5c6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f106809e410 0x7f1068122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f106d5c6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1068123820 con 0x7f106809d6f0 2023-09-30T22:30:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f106d5c6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1068125de0 con 0x7f106809e000 2023-09-30T22:30:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f106d5c6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1068133750 con 0x7f106809e410 2023-09-30T22:30:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f10677fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f106809e410 0x7f1068122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f10667fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f106809e000 0x7f1068122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f10677fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f106809e410 0x7f1068122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53622/0 (socket says 172.21.15.59:53622) 2023-09-30T22:30:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f10667fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f106809e000 0x7f1068122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43316/0 (socket says 172.21.15.59:43316) 2023-09-30T22:30:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f10677fe700 1 -- 172.21.15.59:0/3773514657 learned_addr learned my addr 172.21.15.59:0/3773514657 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f1066ffd700 1 --2- 172.21.15.59:0/3773514657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f106809d6f0 0x7f1068122350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f10677fe700 1 -- 172.21.15.59:0/3773514657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f106809e000 msgr2=0x7f1068122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f10677fe700 1 --2- 172.21.15.59:0/3773514657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f106809e000 0x7f1068122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f10677fe700 1 -- 172.21.15.59:0/3773514657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f106809d6f0 msgr2=0x7f1068122350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f10677fe700 1 --2- 172.21.15.59:0/3773514657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f106809d6f0 0x7f1068122350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.705+0000 7f10677fe700 1 -- 172.21.15.59:0/3773514657 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058009550 con 0x7f106809e410 2023-09-30T22:30:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.706+0000 7f10677fe700 1 --2- 172.21.15.59:0/3773514657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f106809e410 0x7f1068122dd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1060009dd0 tx=0x7f106000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.706+0000 7f104f7fe700 1 -- 172.21.15.59:0/3773514657 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060009c40 con 0x7f106809e410 2023-09-30T22:30:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.706+0000 7f104f7fe700 1 -- 172.21.15.59:0/3773514657 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106000f040 con 0x7f106809e410 2023-09-30T22:30:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.706+0000 7f104f7fe700 1 -- 172.21.15.59:0/3773514657 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000ceb0 con 0x7f106809e410 2023-09-30T22:30:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.706+0000 7f106d5c6700 1 -- 172.21.15.59:0/3773514657 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10680a1940 con 0x7f106809e410 2023-09-30T22:30:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.706+0000 7f106d5c6700 1 -- 172.21.15.59:0/3773514657 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1068126570 con 0x7f106809e410 2023-09-30T22:30:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.707+0000 7f104f7fe700 1 -- 172.21.15.59:0/3773514657 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1060014480 con 0x7f106809e410 2023-09-30T22:30:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.707+0000 7f106d5c6700 1 -- 172.21.15.59:0/3773514657 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1068125a40 con 0x7f106809e410 2023-09-30T22:30:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.707+0000 7f104f7fe700 1 -- 172.21.15.59:0/3773514657 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1060040180 con 0x7f106809e410 2023-09-30T22:30:11.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.716+0000 7f104f7fe700 1 -- 172.21.15.59:0/3773514657 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1068125a40 con 0x7f106809e410 2023-09-30T22:30:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.745+0000 7fec19b85700 1 Processor -- start 2023-09-30T22:30:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.745+0000 7fec19b85700 1 -- start start 2023-09-30T22:30:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.746+0000 7fec19b85700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fec140a0a30 0x7fec140a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.746+0000 7fec19b85700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec140a1340 0x7fec14133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.746+0000 7fec19b85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec14133fa0 0x7fec14134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.746+0000 7fec19b85700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1409edd0 con 0x7fec140a0a30 2023-09-30T22:30:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.746+0000 7fec19b85700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1409e1f0 con 0x7fec14133fa0 2023-09-30T22:30:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.746+0000 7fec19b85700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec1409dc50 con 0x7fec140a1340 2023-09-30T22:30:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.746+0000 7fec137fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fec140a0a30 0x7fec140a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.746+0000 7fec0affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec140a1340 0x7fec14133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.746+0000 7fec137fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fec140a0a30 0x7fec140a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51988/0 (socket says 172.21.15.59:51988) 2023-09-30T22:30:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.746+0000 7fec137fe700 1 -- 172.21.15.59:0/2233074504 learned_addr learned my addr 172.21.15.59:0/2233074504 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.746+0000 7fec13fff700 1 --2- 172.21.15.59:0/2233074504 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec14133fa0 0x7fec14134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.746+0000 7fec13fff700 1 -- 172.21.15.59:0/2233074504 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec140a1340 msgr2=0x7fec14133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.747+0000 7fec13fff700 1 --2- 172.21.15.59:0/2233074504 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec140a1340 0x7fec14133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.747+0000 7fec13fff700 1 -- 172.21.15.59:0/2233074504 >> v2:172.21.15.59:3300/0 conn(0x7fec140a0a30 msgr2=0x7fec140a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.747+0000 7fec13fff700 1 --2- 172.21.15.59:0/2233074504 >> v2:172.21.15.59:3300/0 conn(0x7fec140a0a30 0x7fec140a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.747+0000 7fec13fff700 1 -- 172.21.15.59:0/2233074504 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec140a1fe0 con 0x7fec14133fa0 2023-09-30T22:30:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.747+0000 7fec0affd700 1 --2- 172.21.15.59:0/2233074504 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec140a1340 0x7fec14133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.747+0000 7fec13fff700 1 --2- 172.21.15.59:0/2233074504 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec14133fa0 0x7fec14134410 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009dc0 tx=0x7fec0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e400195ff52a53a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.747+0000 7fec12ffd700 1 -- 172.21.15.59:0/2233074504 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c00e070 con 0x7fec14133fa0 2023-09-30T22:30:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.747+0000 7fec12ffd700 1 -- 172.21.15.59:0/2233074504 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c00bae0 con 0x7fec14133fa0 2023-09-30T22:30:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.747+0000 7fec12ffd700 1 -- 172.21.15.59:0/2233074504 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c00be90 con 0x7fec14133fa0 2023-09-30T22:30:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.748+0000 7fec19b85700 1 -- 172.21.15.59:0/2233074504 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec14133fa0 msgr2=0x7fec14134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.748+0000 7fec19b85700 1 --2- 172.21.15.59:0/2233074504 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec14133fa0 0x7fec14134410 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009dc0 tx=0x7fec0c00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.748+0000 7fec19b85700 1 -- 172.21.15.59:0/2233074504 shutdown_connections 2023-09-30T22:30:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.748+0000 7fec19b85700 1 --2- 172.21.15.59:0/2233074504 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec14133fa0 0x7fec14134410 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.748+0000 7fec19b85700 1 --2- 172.21.15.59:0/2233074504 >> v2:172.21.15.59:3300/0 conn(0x7fec140a0a30 0x7fec140a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.748+0000 7fec19b85700 1 --2- 172.21.15.59:0/2233074504 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec140a1340 0x7fec14133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.748+0000 7fec19b85700 1 -- 172.21.15.59:0/2233074504 >> 172.21.15.59:0/2233074504 conn(0x7fec140a6550 msgr2=0x7fec140a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.748+0000 7fec19b85700 1 -- 172.21.15.59:0/2233074504 shutdown_connections 2023-09-30T22:30:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.748+0000 7fec19b85700 1 -- 172.21.15.59:0/2233074504 wait complete. 2023-09-30T22:30:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.749+0000 7fec19b85700 1 Processor -- start 2023-09-30T22:30:11.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.749+0000 7fec19b85700 1 -- start start 2023-09-30T22:30:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.750+0000 7fec19b85700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec140a0a30 0x7fec141200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.750+0000 7fec19b85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec140a1340 0x7fec141205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.750+0000 7fec19b85700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec14133fa0 0x7fec14120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.750+0000 7fec19b85700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec14121d70 con 0x7fec14133fa0 2023-09-30T22:30:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.750+0000 7fec19b85700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec140a6b20 con 0x7fec140a1340 2023-09-30T22:30:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.750+0000 7fec19b85700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec140a0220 con 0x7fec140a0a30 2023-09-30T22:30:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.750+0000 7fec0affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec140a1340 0x7fec141205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.750+0000 7fec0affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec140a1340 0x7fec141205e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43338/0 (socket says 172.21.15.59:43338) 2023-09-30T22:30:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.750+0000 7fec0affd700 1 -- 172.21.15.59:0/3369881531 learned_addr learned my addr 172.21.15.59:0/3369881531 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.750+0000 7fec13fff700 1 --2- 172.21.15.59:0/3369881531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec14133fa0 0x7fec14120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.750+0000 7fec137fe700 1 --2- 172.21.15.59:0/3369881531 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec140a0a30 0x7fec141200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.751+0000 7fec0affd700 1 -- 172.21.15.59:0/3369881531 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec140a0a30 msgr2=0x7fec141200a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.751+0000 7fec0affd700 1 --2- 172.21.15.59:0/3369881531 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec140a0a30 0x7fec141200a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.751+0000 7fec0affd700 1 -- 172.21.15.59:0/3369881531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec14133fa0 msgr2=0x7fec14120b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.751+0000 7fec0affd700 1 --2- 172.21.15.59:0/3369881531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec14133fa0 0x7fec14120b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.751+0000 7fec0affd700 1 -- 172.21.15.59:0/3369881531 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc0094a0 con 0x7fec140a1340 2023-09-30T22:30:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.751+0000 7fec13fff700 1 --2- 172.21.15.59:0/3369881531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec14133fa0 0x7fec14120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.751+0000 7fec0affd700 1 --2- 172.21.15.59:0/3369881531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec140a1340 0x7fec141205e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7febfc00ebe0 tx=0x7febfc00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.751+0000 7fec10ff9700 1 -- 172.21.15.59:0/3369881531 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc00c850 con 0x7fec140a1340 2023-09-30T22:30:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.751+0000 7fec10ff9700 1 -- 172.21.15.59:0/3369881531 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc00c9b0 con 0x7fec140a1340 2023-09-30T22:30:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.751+0000 7fec19b85700 1 -- 172.21.15.59:0/3369881531 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c009a70 con 0x7fec140a1340 2023-09-30T22:30:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.751+0000 7fec10ff9700 1 -- 172.21.15.59:0/3369881531 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc00cd40 con 0x7fec140a1340 2023-09-30T22:30:11.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.751+0000 7fec19b85700 1 -- 172.21.15.59:0/3369881531 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec14123b70 con 0x7fec140a1340 2023-09-30T22:30:11.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.753+0000 7fec19b85700 1 -- 172.21.15.59:0/3369881531 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec14074ea0 con 0x7fec140a1340 2023-09-30T22:30:11.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.753+0000 7fec10ff9700 1 -- 172.21.15.59:0/3369881531 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7febfc013470 con 0x7fec140a1340 2023-09-30T22:30:11.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.753+0000 7fec10ff9700 1 -- 172.21.15.59:0/3369881531 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7febfc03f760 con 0x7fec140a1340 2023-09-30T22:30:11.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.757+0000 7fec10ff9700 1 -- 172.21.15.59:0/3369881531 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febfc013720 con 0x7fec140a1340 2023-09-30T22:30:11.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.881+0000 7f43ece42700 1 -- 172.21.15.59:0/3596925493 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f43e8074ea0 con 0x7f43e809d6f0 2023-09-30T22:30:11.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.882+0000 7f43d6ffd700 1 -- 172.21.15.59:0/3596925493 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43d8017030 con 0x7f43e809d6f0 2023-09-30T22:30:11.883 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:11.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.884+0000 7f43ece42700 1 -- 172.21.15.59:0/3596925493 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43e809d6f0 msgr2=0x7f43e81206f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.884+0000 7f43ece42700 1 --2- 172.21.15.59:0/3596925493 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43e809d6f0 0x7f43e81206f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f43d800c730 tx=0x7f43d800caf0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.884+0000 7f43ece42700 1 -- 172.21.15.59:0/3596925493 shutdown_connections 2023-09-30T22:30:11.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.884+0000 7f43ece42700 1 --2- 172.21.15.59:0/3596925493 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43e809d6f0 0x7f43e81206f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.884+0000 7f43ece42700 1 --2- 172.21.15.59:0/3596925493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43e8139170 0x7f43e8121170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.884+0000 7f43ece42700 1 --2- 172.21.15.59:0/3596925493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43e809e1d0 0x7f43e8120c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.884+0000 7f43ece42700 1 -- 172.21.15.59:0/3596925493 >> 172.21.15.59:0/3596925493 conn(0x7f43e8066f50 msgr2=0x7f43e8136a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:11.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.884+0000 7f43ece42700 1 -- 172.21.15.59:0/3596925493 shutdown_connections 2023-09-30T22:30:11.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.884+0000 7f43ece42700 1 -- 172.21.15.59:0/3596925493 wait complete. 2023-09-30T22:30:11.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:11.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.924+0000 7f106d5c6700 1 -- 172.21.15.59:0/3773514657 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1068125a40 con 0x7f106809e410 2023-09-30T22:30:11.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.925+0000 7f104f7fe700 1 -- 172.21.15.59:0/3773514657 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1068125a40 con 0x7f106809e410 2023-09-30T22:30:11.926 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:11.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.927+0000 7f106d5c6700 1 -- 172.21.15.59:0/3773514657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f106809e410 msgr2=0x7f1068122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.927+0000 7f106d5c6700 1 --2- 172.21.15.59:0/3773514657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f106809e410 0x7f1068122dd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1060009dd0 tx=0x7f106000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.927+0000 7f106d5c6700 1 -- 172.21.15.59:0/3773514657 shutdown_connections 2023-09-30T22:30:11.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.927+0000 7f106d5c6700 1 --2- 172.21.15.59:0/3773514657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f106809e410 0x7f1068122dd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.927+0000 7f106d5c6700 1 --2- 172.21.15.59:0/3773514657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f106809d6f0 0x7f1068122350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.927+0000 7f106d5c6700 1 --2- 172.21.15.59:0/3773514657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f106809e000 0x7f1068122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.927+0000 7f106d5c6700 1 -- 172.21.15.59:0/3773514657 >> 172.21.15.59:0/3773514657 conn(0x7f1068066f50 msgr2=0x7f106809b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:11.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.927+0000 7f106d5c6700 1 -- 172.21.15.59:0/3773514657 shutdown_connections 2023-09-30T22:30:11.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.927+0000 7f106d5c6700 1 -- 172.21.15.59:0/3773514657 wait complete. 2023-09-30T22:30:11.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:11.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.972+0000 7fec19b85700 1 -- 172.21.15.59:0/3369881531 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fec14123950 con 0x7fec140a1340 2023-09-30T22:30:11.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.972+0000 7fec10ff9700 1 -- 172.21.15.59:0/3369881531 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7febfc021070 con 0x7fec140a1340 2023-09-30T22:30:11.974 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:11.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.975+0000 7fec19b85700 1 -- 172.21.15.59:0/3369881531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec140a1340 msgr2=0x7fec141205e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.975+0000 7fec19b85700 1 --2- 172.21.15.59:0/3369881531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec140a1340 0x7fec141205e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7febfc00ebe0 tx=0x7febfc00eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.975+0000 7fec19b85700 1 -- 172.21.15.59:0/3369881531 shutdown_connections 2023-09-30T22:30:11.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.975+0000 7fec19b85700 1 --2- 172.21.15.59:0/3369881531 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec140a0a30 0x7fec141200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.975+0000 7fec19b85700 1 --2- 172.21.15.59:0/3369881531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec14133fa0 0x7fec14120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.975+0000 7fec19b85700 1 --2- 172.21.15.59:0/3369881531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec140a1340 0x7fec141205e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.975+0000 7fec19b85700 1 -- 172.21.15.59:0/3369881531 >> 172.21.15.59:0/3369881531 conn(0x7fec140a6550 msgr2=0x7fec1409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.975+0000 7fec19b85700 1 -- 172.21.15.59:0/3369881531 shutdown_connections 2023-09-30T22:30:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:11.975+0000 7fec19b85700 1 -- 172.21.15.59:0/3369881531 wait complete. 2023-09-30T22:30:11.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:12.518 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:12.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.662+0000 7f782b28c700 1 Processor -- start 2023-09-30T22:30:12.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.662+0000 7f782b28c700 1 -- start start 2023-09-30T22:30:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f782b28c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782409d6f0 0x7f782409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f782b28c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f782409e000 0x7f78241339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f782b28c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782409d2f0 con 0x7f7824133f30 2023-09-30T22:30:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f782b28c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782409a810 con 0x7f782409d6f0 2023-09-30T22:30:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f782b28c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f782409a470 con 0x7f782409e000 2023-09-30T22:30:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f7828827700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f782409e000 0x7f78241339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f7829028700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782409d6f0 0x7f782409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f7829028700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782409d6f0 0x7f782409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43352/0 (socket says 172.21.15.59:43352) 2023-09-30T22:30:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f7828827700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f782409e000 0x7f78241339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53652/0 (socket says 172.21.15.59:53652) 2023-09-30T22:30:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f7829028700 1 -- 172.21.15.59:0/3562949879 learned_addr learned my addr 172.21.15.59:0/3562949879 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f7829829700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7824133f30 0x7f782413ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37376/0 (socket says 172.21.15.59:37376) 2023-09-30T22:30:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f7829028700 1 -- 172.21.15.59:0/3562949879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f782409e000 msgr2=0x7f78241339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f7829028700 1 --2- 172.21.15.59:0/3562949879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f782409e000 0x7f78241339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f7817fff700 1 -- 172.21.15.59:0/3562949879 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975273155 0 0) 0x7f782409d2f0 con 0x7f7824133f30 2023-09-30T22:30:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f7829028700 1 -- 172.21.15.59:0/3562949879 >> v1:172.21.15.59:6789/0 conn(0x7f7824133f30 legacy=0x7f782413ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f7829028700 1 -- 172.21.15.59:0/3562949879 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782409ec40 con 0x7f782409d6f0 2023-09-30T22:30:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.663+0000 7f7829028700 1 --2- 172.21.15.59:0/3562949879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782409d6f0 0x7f782409dac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7820009920 tx=0x7f7820009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91c37075a50d0386 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.664+0000 7f7817fff700 1 -- 172.21.15.59:0/3562949879 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820011830 con 0x7f782409d6f0 2023-09-30T22:30:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.664+0000 7f7817fff700 1 -- 172.21.15.59:0/3562949879 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7820011990 con 0x7f782409d6f0 2023-09-30T22:30:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.664+0000 7f7817fff700 1 -- 172.21.15.59:0/3562949879 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820011d20 con 0x7f782409d6f0 2023-09-30T22:30:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.664+0000 7f782b28c700 1 -- 172.21.15.59:0/3562949879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782409d6f0 msgr2=0x7f782409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.664+0000 7f782b28c700 1 --2- 172.21.15.59:0/3562949879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782409d6f0 0x7f782409dac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7820009920 tx=0x7f7820009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.664+0000 7f782b28c700 1 -- 172.21.15.59:0/3562949879 shutdown_connections 2023-09-30T22:30:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.664+0000 7f782b28c700 1 --2- 172.21.15.59:0/3562949879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782409d6f0 0x7f782409dac0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.664+0000 7f782b28c700 1 --2- 172.21.15.59:0/3562949879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f782409e000 0x7f78241339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.664+0000 7f782b28c700 1 -- 172.21.15.59:0/3562949879 >> 172.21.15.59:0/3562949879 conn(0x7f7824066f50 msgr2=0x7f782409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.664+0000 7f782b28c700 1 -- 172.21.15.59:0/3562949879 shutdown_connections 2023-09-30T22:30:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.664+0000 7f782b28c700 1 -- 172.21.15.59:0/3562949879 wait complete. 2023-09-30T22:30:12.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.665+0000 7f782b28c700 1 Processor -- start 2023-09-30T22:30:12.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.665+0000 7f782b28c700 1 -- start start 2023-09-30T22:30:12.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f782b28c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782409d6f0 0x7f7824122830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f782b28c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f782409e000 0x7f7824122d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f782b28c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824133f30 0x7f78241232b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f782b28c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7824126070 con 0x7f7824133f30 2023-09-30T22:30:12.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f782b28c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7824126f30 con 0x7f782409d6f0 2023-09-30T22:30:12.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f782b28c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78241337f0 con 0x7f782409e000 2023-09-30T22:30:12.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f7828827700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f782409e000 0x7f7824122d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f7829028700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782409d6f0 0x7f7824122830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f7828827700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f782409e000 0x7f7824122d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53666/0 (socket says 172.21.15.59:53666) 2023-09-30T22:30:12.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f7828827700 1 -- 172.21.15.59:0/2093562717 learned_addr learned my addr 172.21.15.59:0/2093562717 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:12.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f7829028700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782409d6f0 0x7f7824122830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43368/0 (socket says 172.21.15.59:43368) 2023-09-30T22:30:12.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f7829829700 1 --2- 172.21.15.59:0/2093562717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824133f30 0x7f78241232b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f7828827700 1 -- 172.21.15.59:0/2093562717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782409d6f0 msgr2=0x7f7824122830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f7828827700 1 --2- 172.21.15.59:0/2093562717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782409d6f0 0x7f7824122830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f7828827700 1 -- 172.21.15.59:0/2093562717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824133f30 msgr2=0x7f78241232b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f7828827700 1 --2- 172.21.15.59:0/2093562717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824133f30 0x7f78241232b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f7828827700 1 -- 172.21.15.59:0/2093562717 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7820009550 con 0x7f782409e000 2023-09-30T22:30:12.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.666+0000 7f7829028700 1 --2- 172.21.15.59:0/2093562717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782409d6f0 0x7f7824122830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:12.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.667+0000 7f7828827700 1 --2- 172.21.15.59:0/2093562717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f782409e000 0x7f7824122d70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f781800e9b0 tx=0x7f781800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:12.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.667+0000 7f7815ffb700 1 -- 172.21.15.59:0/2093562717 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818009710 con 0x7f782409e000 2023-09-30T22:30:12.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.667+0000 7f7815ffb700 1 -- 172.21.15.59:0/2093562717 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781800ee50 con 0x7f782409e000 2023-09-30T22:30:12.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.667+0000 7f782b28c700 1 -- 172.21.15.59:0/2093562717 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78240a1dc0 con 0x7f782409e000 2023-09-30T22:30:12.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.667+0000 7f7815ffb700 1 -- 172.21.15.59:0/2093562717 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781800ca70 con 0x7f782409e000 2023-09-30T22:30:12.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.667+0000 7f782b28c700 1 -- 172.21.15.59:0/2093562717 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7824124440 con 0x7f782409e000 2023-09-30T22:30:12.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.668+0000 7f7815ffb700 1 -- 172.21.15.59:0/2093562717 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f781800cbd0 con 0x7f782409e000 2023-09-30T22:30:12.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.668+0000 7f782b28c700 1 -- 172.21.15.59:0/2093562717 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7824074ea0 con 0x7f782409e000 2023-09-30T22:30:12.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.668+0000 7f7815ffb700 1 -- 172.21.15.59:0/2093562717 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f781803fb50 con 0x7f782409e000 2023-09-30T22:30:12.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.673+0000 7f7815ffb700 1 -- 172.21.15.59:0/2093562717 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f781801b3b0 con 0x7f782409e000 2023-09-30T22:30:12.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.875+0000 7f782b28c700 1 -- 172.21.15.59:0/2093562717 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78241261b0 con 0x7f782409e000 2023-09-30T22:30:12.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.876+0000 7f7815ffb700 1 -- 172.21.15.59:0/2093562717 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78241261b0 con 0x7f782409e000 2023-09-30T22:30:12.877 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.878+0000 7f782b28c700 1 -- 172.21.15.59:0/2093562717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f782409e000 msgr2=0x7f7824122d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.878+0000 7f782b28c700 1 --2- 172.21.15.59:0/2093562717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f782409e000 0x7f7824122d70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f781800e9b0 tx=0x7f781800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.878+0000 7f782b28c700 1 -- 172.21.15.59:0/2093562717 shutdown_connections 2023-09-30T22:30:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.878+0000 7f782b28c700 1 --2- 172.21.15.59:0/2093562717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824133f30 0x7f78241232b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.878+0000 7f782b28c700 1 --2- 172.21.15.59:0/2093562717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782409d6f0 0x7f7824122830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.878+0000 7f782b28c700 1 --2- 172.21.15.59:0/2093562717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f782409e000 0x7f7824122d70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.878+0000 7f782b28c700 1 -- 172.21.15.59:0/2093562717 >> 172.21.15.59:0/2093562717 conn(0x7f7824066f50 msgr2=0x7f78240a2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.878+0000 7f782b28c700 1 -- 172.21.15.59:0/2093562717 shutdown_connections 2023-09-30T22:30:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:12.878+0000 7f782b28c700 1 -- 172.21.15.59:0/2093562717 wait complete. 2023-09-30T22:30:12.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:12.900 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:12.943 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:12.990 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:13.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.040+0000 7f8c482c8700 1 Processor -- start 2023-09-30T22:30:13.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.040+0000 7f8c482c8700 1 -- start start 2023-09-30T22:30:13.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.041+0000 7f8c482c8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c4009f410 0x7f8c40136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.041+0000 7f8c482c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c40136fe0 0x7f8c401393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.041+0000 7f8c482c8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c40070940 con 0x7f8c4009e930 2023-09-30T22:30:13.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.041+0000 7f8c482c8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4006fd60 con 0x7f8c4009f410 2023-09-30T22:30:13.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.041+0000 7f8c482c8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4006fa80 con 0x7f8c40136fe0 2023-09-30T22:30:13.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.041+0000 7f8c46865700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c40136fe0 0x7f8c401393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.041+0000 7f8c46865700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c40136fe0 0x7f8c401393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43376/0 (socket says 172.21.15.59:43376) 2023-09-30T22:30:13.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.041+0000 7f8c46865700 1 -- 172.21.15.59:0/1820023150 learned_addr learned my addr 172.21.15.59:0/1820023150 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:13.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.041+0000 7f8c45863700 1 --2- 172.21.15.59:0/1820023150 >> v2:172.21.15.59:3300/0 conn(0x7f8c4009f410 0x7f8c40136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.041+0000 7f8c46865700 1 -- 172.21.15.59:0/1820023150 >> v2:172.21.15.59:3300/0 conn(0x7f8c4009f410 msgr2=0x7f8c40136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:13.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.041+0000 7f8c46865700 1 --2- 172.21.15.59:0/1820023150 >> v2:172.21.15.59:3300/0 conn(0x7f8c4009f410 0x7f8c40136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.041+0000 7f8c46865700 1 -- 172.21.15.59:0/1820023150 >> v1:172.21.15.59:6789/0 conn(0x7f8c4009e930 legacy=0x7f8c4009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.041+0000 7f8c46865700 1 -- 172.21.15.59:0/1820023150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4009fb60 con 0x7f8c40136fe0 2023-09-30T22:30:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.041+0000 7f8c45863700 1 --2- 172.21.15.59:0/1820023150 >> v2:172.21.15.59:3300/0 conn(0x7f8c4009f410 0x7f8c40136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.042+0000 7f8c46865700 1 --2- 172.21.15.59:0/1820023150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c40136fe0 0x7f8c401393c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009e50 tx=0x7f8c3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96579a4ac9496070 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.042+0000 7f8c45062700 1 -- 172.21.15.59:0/1820023150 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800e070 con 0x7f8c40136fe0 2023-09-30T22:30:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.042+0000 7f8c45062700 1 -- 172.21.15.59:0/1820023150 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3800b910 con 0x7f8c40136fe0 2023-09-30T22:30:13.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.042+0000 7f8c45062700 1 -- 172.21.15.59:0/1820023150 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800bcc0 con 0x7f8c40136fe0 2023-09-30T22:30:13.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.042+0000 7f8c482c8700 1 -- 172.21.15.59:0/1820023150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c40136fe0 msgr2=0x7f8c401393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.042+0000 7f8c482c8700 1 --2- 172.21.15.59:0/1820023150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c40136fe0 0x7f8c401393c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009e50 tx=0x7f8c3800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:13.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.043+0000 7f8c482c8700 1 -- 172.21.15.59:0/1820023150 shutdown_connections 2023-09-30T22:30:13.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.043+0000 7f8c482c8700 1 --2- 172.21.15.59:0/1820023150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c40136fe0 0x7f8c401393c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.043+0000 7f8c482c8700 1 --2- 172.21.15.59:0/1820023150 >> v2:172.21.15.59:3300/0 conn(0x7f8c4009f410 0x7f8c40136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.043+0000 7f8c482c8700 1 -- 172.21.15.59:0/1820023150 >> 172.21.15.59:0/1820023150 conn(0x7f8c400a4210 msgr2=0x7f8c400a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:13.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.043+0000 7f8c482c8700 1 -- 172.21.15.59:0/1820023150 shutdown_connections 2023-09-30T22:30:13.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.043+0000 7f8c482c8700 1 -- 172.21.15.59:0/1820023150 wait complete. 2023-09-30T22:30:13.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.044+0000 7f8c482c8700 1 Processor -- start 2023-09-30T22:30:13.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.044+0000 7f8c482c8700 1 -- start start 2023-09-30T22:30:13.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.045+0000 7f8c482c8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4009e930 0x7f8c401c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.045+0000 7f8c482c8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4009f410 0x7f8c401c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.045+0000 7f8c482c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c40136fe0 0x7f8c4006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.045+0000 7f8c482c8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c401bc0c0 con 0x7f8c4009e930 2023-09-30T22:30:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.045+0000 7f8c482c8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c401224b0 con 0x7f8c40136fe0 2023-09-30T22:30:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.045+0000 7f8c482c8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c401320d0 con 0x7f8c4009f410 2023-09-30T22:30:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.045+0000 7f8c45863700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4009f410 0x7f8c401c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.045+0000 7f8c45863700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4009f410 0x7f8c401c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53680/0 (socket says 172.21.15.59:53680) 2023-09-30T22:30:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.045+0000 7f8c45863700 1 -- 172.21.15.59:0/2318626882 learned_addr learned my addr 172.21.15.59:0/2318626882 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.045+0000 7f8c46865700 1 --2- 172.21.15.59:0/2318626882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c40136fe0 0x7f8c4006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.045+0000 7f8c46064700 1 --2- 172.21.15.59:0/2318626882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4009e930 0x7f8c401c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.046+0000 7f8c45863700 1 -- 172.21.15.59:0/2318626882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c40136fe0 msgr2=0x7f8c4006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.046+0000 7f8c45863700 1 --2- 172.21.15.59:0/2318626882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c40136fe0 0x7f8c4006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.046+0000 7f8c45863700 1 -- 172.21.15.59:0/2318626882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4009e930 msgr2=0x7f8c401c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.046+0000 7f8c45863700 1 --2- 172.21.15.59:0/2318626882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4009e930 0x7f8c401c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.046+0000 7f8c45863700 1 -- 172.21.15.59:0/2318626882 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c300094a0 con 0x7f8c4009f410 2023-09-30T22:30:13.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.046+0000 7f8c45863700 1 --2- 172.21.15.59:0/2318626882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4009f410 0x7f8c401c8c10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000ebe0 tx=0x7f8c3000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:13.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.046+0000 7f8c36ffd700 1 -- 172.21.15.59:0/2318626882 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000c850 con 0x7f8c4009f410 2023-09-30T22:30:13.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.046+0000 7f8c36ffd700 1 -- 172.21.15.59:0/2318626882 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3000c9b0 con 0x7f8c4009f410 2023-09-30T22:30:13.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.046+0000 7f8c36ffd700 1 -- 172.21.15.59:0/2318626882 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000cd40 con 0x7f8c4009f410 2023-09-30T22:30:13.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.046+0000 7f8c482c8700 1 -- 172.21.15.59:0/2318626882 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c38009b30 con 0x7f8c4009f410 2023-09-30T22:30:13.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.046+0000 7f8c482c8700 1 -- 172.21.15.59:0/2318626882 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c40121d40 con 0x7f8c4009f410 2023-09-30T22:30:13.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.047+0000 7f8c36ffd700 1 -- 172.21.15.59:0/2318626882 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c30013470 con 0x7f8c4009f410 2023-09-30T22:30:13.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.047+0000 7f8c482c8700 1 -- 172.21.15.59:0/2318626882 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c400a3460 con 0x7f8c4009f410 2023-09-30T22:30:13.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.047+0000 7f8c36ffd700 1 -- 172.21.15.59:0/2318626882 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8c3003f8d0 con 0x7f8c4009f410 2023-09-30T22:30:13.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.052+0000 7f8c36ffd700 1 -- 172.21.15.59:0/2318626882 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c400a3460 con 0x7f8c4009f410 2023-09-30T22:30:13.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.084+0000 7f9b49a71700 1 Processor -- start 2023-09-30T22:30:13.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.084+0000 7f9b49a71700 1 -- start start 2023-09-30T22:30:13.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.085+0000 7f9b49a71700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b4409d6f0 0x7f9b4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.085+0000 7f9b49a71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b4409e440 0x7f9b44134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.085+0000 7f9b49a71700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4409b120 con 0x7f9b4409e000 2023-09-30T22:30:13.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.085+0000 7f9b49a71700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4406b460 con 0x7f9b4409d6f0 2023-09-30T22:30:13.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.085+0000 7f9b49a71700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4409a7e0 con 0x7f9b4409e440 2023-09-30T22:30:13.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.085+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b4409e440 0x7f9b44134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.085+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b4409e440 0x7f9b44134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43394/0 (socket says 172.21.15.59:43394) 2023-09-30T22:30:13.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.085+0000 7f9b437fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b4409d6f0 0x7f9b4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.085+0000 7f9b43fff700 1 -- 172.21.15.59:0/3384632543 learned_addr learned my addr 172.21.15.59:0/3384632543 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:13.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.085+0000 7f9b43fff700 1 -- 172.21.15.59:0/3384632543 >> v2:172.21.15.59:3300/0 conn(0x7f9b4409d6f0 msgr2=0x7f9b4409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:13.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.085+0000 7f9b43fff700 1 --2- 172.21.15.59:0/3384632543 >> v2:172.21.15.59:3300/0 conn(0x7f9b4409d6f0 0x7f9b4409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.085+0000 7f9b43fff700 1 -- 172.21.15.59:0/3384632543 >> v1:172.21.15.59:6789/0 conn(0x7f9b4409e000 legacy=0x7f9b441339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.085+0000 7f9b43fff700 1 -- 172.21.15.59:0/3384632543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4409a500 con 0x7f9b4409e440 2023-09-30T22:30:13.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.085+0000 7f9b43fff700 1 --2- 172.21.15.59:0/3384632543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b4409e440 0x7f9b44134100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009e80 tx=0x7f9b3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9388d3bfa9ea96bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:13.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.086+0000 7f9b427fc700 1 -- 172.21.15.59:0/3384632543 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c00e070 con 0x7f9b4409e440 2023-09-30T22:30:13.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.086+0000 7f9b427fc700 1 -- 172.21.15.59:0/3384632543 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c00b8d0 con 0x7f9b4409e440 2023-09-30T22:30:13.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.086+0000 7f9b427fc700 1 -- 172.21.15.59:0/3384632543 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c00bc80 con 0x7f9b4409e440 2023-09-30T22:30:13.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.086+0000 7f9b49a71700 1 -- 172.21.15.59:0/3384632543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b4409e440 msgr2=0x7f9b44134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.086+0000 7f9b49a71700 1 --2- 172.21.15.59:0/3384632543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b4409e440 0x7f9b44134100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009e80 tx=0x7f9b3c00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:13.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.086+0000 7f9b49a71700 1 -- 172.21.15.59:0/3384632543 shutdown_connections 2023-09-30T22:30:13.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.086+0000 7f9b49a71700 1 --2- 172.21.15.59:0/3384632543 >> v2:172.21.15.59:3300/0 conn(0x7f9b4409d6f0 0x7f9b4409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.086+0000 7f9b49a71700 1 --2- 172.21.15.59:0/3384632543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b4409e440 0x7f9b44134100 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.086+0000 7f9b49a71700 1 -- 172.21.15.59:0/3384632543 >> 172.21.15.59:0/3384632543 conn(0x7f9b44066f50 msgr2=0x7f9b4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:13.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.086+0000 7f9b49a71700 1 -- 172.21.15.59:0/3384632543 shutdown_connections 2023-09-30T22:30:13.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.086+0000 7f9b49a71700 1 -- 172.21.15.59:0/3384632543 wait complete. 2023-09-30T22:30:13.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.087+0000 7f9b49a71700 1 Processor -- start 2023-09-30T22:30:13.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.088+0000 7f9b49a71700 1 -- start start 2023-09-30T22:30:13.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.088+0000 7f9b49a71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b4409d6f0 0x7f9b441a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.088+0000 7f9b49a71700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b4409e000 0x7f9b441a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.088+0000 7f9b49a71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b4409e440 0x7f9b441a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.088+0000 7f9b49a71700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441aa360 con 0x7f9b4409e000 2023-09-30T22:30:13.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.088+0000 7f9b49a71700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441a99a0 con 0x7f9b4409e440 2023-09-30T22:30:13.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.088+0000 7f9b49a71700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441a8ce0 con 0x7f9b4409d6f0 2023-09-30T22:30:13.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.088+0000 7f9b437fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b4409d6f0 0x7f9b441a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.088+0000 7f9b42ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b4409e000 0x7f9b441a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.088+0000 7f9b437fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b4409d6f0 0x7f9b441a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53694/0 (socket says 172.21.15.59:53694) 2023-09-30T22:30:13.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.088+0000 7f9b437fe700 1 -- 172.21.15.59:0/2287412077 learned_addr learned my addr 172.21.15.59:0/2287412077 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:13.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.089+0000 7f9b43fff700 1 --2- 172.21.15.59:0/2287412077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b4409e440 0x7f9b441a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.089+0000 7f9b42ffd700 1 -- 172.21.15.59:0/2287412077 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b4409d6f0 msgr2=0x7f9b441a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.089+0000 7f9b42ffd700 1 --2- 172.21.15.59:0/2287412077 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b4409d6f0 0x7f9b441a5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.089+0000 7f9b42ffd700 1 -- 172.21.15.59:0/2287412077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b4409e440 msgr2=0x7f9b441a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.089+0000 7f9b42ffd700 1 --2- 172.21.15.59:0/2287412077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b4409e440 0x7f9b441a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.089+0000 7f9b42ffd700 1 -- 172.21.15.59:0/2287412077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c009b30 con 0x7f9b4409e000 2023-09-30T22:30:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.089+0000 7f9b437fe700 1 --2- 172.21.15.59:0/2287412077 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b4409d6f0 0x7f9b441a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.089+0000 7f9b43fff700 1 --2- 172.21.15.59:0/2287412077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b4409e440 0x7f9b441a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.089+0000 7f9b42ffd700 1 --2- 172.21.15.59:0/2287412077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b4409e000 0x7f9b441a6410 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9b38000f60 tx=0x7f9b3800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.089+0000 7f9b2bfff700 1 -- 172.21.15.59:0/2287412077 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b380052d0 con 0x7f9b4409e000 2023-09-30T22:30:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.089+0000 7f9b2bfff700 1 -- 172.21.15.59:0/2287412077 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b38005430 con 0x7f9b4409e000 2023-09-30T22:30:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.089+0000 7f9b49a71700 1 -- 172.21.15.59:0/2287412077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b440a2000 con 0x7f9b4409e000 2023-09-30T22:30:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.089+0000 7f9b2bfff700 1 -- 172.21.15.59:0/2287412077 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b380038c0 con 0x7f9b4409e000 2023-09-30T22:30:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.089+0000 7f9b49a71700 1 -- 172.21.15.59:0/2287412077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4409c760 con 0x7f9b4409e000 2023-09-30T22:30:13.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.090+0000 7f9b2bfff700 1 -- 172.21.15.59:0/2287412077 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b38003a20 con 0x7f9b4409e000 2023-09-30T22:30:13.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.091+0000 7f9b2bfff700 1 -- 172.21.15.59:0/2287412077 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9b3803ea80 con 0x7f9b4409e000 2023-09-30T22:30:13.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.091+0000 7f9b49a71700 1 -- 172.21.15.59:0/2287412077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b441a9540 con 0x7f9b4409e000 2023-09-30T22:30:13.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.096+0000 7f9b2bfff700 1 -- 172.21.15.59:0/2287412077 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b38011590 con 0x7f9b4409e000 2023-09-30T22:30:13.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.132+0000 7f017f1ae700 1 Processor -- start 2023-09-30T22:30:13.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.132+0000 7f017f1ae700 1 -- start start 2023-09-30T22:30:13.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.133+0000 7f017f1ae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f017809e1d0 0x7f0178138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.133+0000 7f017f1ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0178139170 0x7f017813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.133+0000 7f017f1ae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017809b120 con 0x7f017809d6f0 2023-09-30T22:30:13.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.133+0000 7f017f1ae700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017806b460 con 0x7f017809e1d0 2023-09-30T22:30:13.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.133+0000 7f017f1ae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f017809a7e0 con 0x7f0178139170 2023-09-30T22:30:13.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.134+0000 7f017d74b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0178139170 0x7f017813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.134+0000 7f017cf4a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f017809d6f0 0x7f017809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37404/0 (socket says 172.21.15.59:37404) 2023-09-30T22:30:13.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.134+0000 7f017cf4a700 1 -- 172.21.15.59:0/3842830011 learned_addr learned my addr 172.21.15.59:0/3842830011 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:13.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.134+0000 7f0177fff700 1 --2- 172.21.15.59:0/3842830011 >> v2:172.21.15.59:3300/0 conn(0x7f017809e1d0 0x7f0178138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.134+0000 7f0177fff700 1 -- 172.21.15.59:0/3842830011 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0178139170 msgr2=0x7f017813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.134+0000 7f0177fff700 1 --2- 172.21.15.59:0/3842830011 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0178139170 0x7f017813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.134+0000 7f0177fff700 1 -- 172.21.15.59:0/3842830011 >> v1:172.21.15.59:6789/0 conn(0x7f017809d6f0 legacy=0x7f017809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.134+0000 7f01777fe700 1 -- 172.21.15.59:0/3842830011 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934211452 0 0) 0x7f017809b120 con 0x7f017809d6f0 2023-09-30T22:30:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.134+0000 7f0177fff700 1 -- 172.21.15.59:0/3842830011 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017809a500 con 0x7f017809e1d0 2023-09-30T22:30:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.134+0000 7f0177fff700 1 --2- 172.21.15.59:0/3842830011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f017809e1d0 0x7f0178138c30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f016c009870 tx=0x7f016c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ffdeae28ed1905 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.134+0000 7f01777fe700 1 -- 172.21.15.59:0/3842830011 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c011830 con 0x7f017809e1d0 2023-09-30T22:30:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.134+0000 7f01777fe700 1 -- 172.21.15.59:0/3842830011 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c011990 con 0x7f017809e1d0 2023-09-30T22:30:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.134+0000 7f01777fe700 1 -- 172.21.15.59:0/3842830011 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c011d20 con 0x7f017809e1d0 2023-09-30T22:30:13.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.135+0000 7f017f1ae700 1 -- 172.21.15.59:0/3842830011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f017809e1d0 msgr2=0x7f0178138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.135+0000 7f017f1ae700 1 --2- 172.21.15.59:0/3842830011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f017809e1d0 0x7f0178138c30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f016c009870 tx=0x7f016c009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:13.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.136+0000 7f017f1ae700 1 -- 172.21.15.59:0/3842830011 shutdown_connections 2023-09-30T22:30:13.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.136+0000 7f017f1ae700 1 --2- 172.21.15.59:0/3842830011 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0178139170 0x7f017813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.136+0000 7f017f1ae700 1 --2- 172.21.15.59:0/3842830011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f017809e1d0 0x7f0178138c30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.136+0000 7f017f1ae700 1 -- 172.21.15.59:0/3842830011 >> 172.21.15.59:0/3842830011 conn(0x7f0178066f50 msgr2=0x7f017809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.136+0000 7f017f1ae700 1 -- 172.21.15.59:0/3842830011 shutdown_connections 2023-09-30T22:30:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.136+0000 7f017f1ae700 1 -- 172.21.15.59:0/3842830011 wait complete. 2023-09-30T22:30:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.137+0000 7f017f1ae700 1 Processor -- start 2023-09-30T22:30:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.137+0000 7f017f1ae700 1 -- start start 2023-09-30T22:30:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.137+0000 7f017f1ae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f017809d6f0 0x7f0178121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.137+0000 7f017f1ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f017809e1d0 0x7f0178121c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.137+0000 7f017f1ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0178139170 0x7f01781221d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.137+0000 7f017f1ae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017809c710 con 0x7f017809d6f0 2023-09-30T22:30:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.137+0000 7f017f1ae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0178123bc0 con 0x7f017809e1d0 2023-09-30T22:30:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.137+0000 7f017f1ae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0178137640 con 0x7f0178139170 2023-09-30T22:30:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.137+0000 7f017cf4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f017809d6f0 0x7f0178121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.138+0000 7f017cf4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f017809d6f0 0x7f0178121750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52082/0 (socket says 172.21.15.59:52082) 2023-09-30T22:30:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.138+0000 7f017cf4a700 1 -- 172.21.15.59:0/2723692698 learned_addr learned my addr 172.21.15.59:0/2723692698 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.138+0000 7f0177fff700 1 --2- 172.21.15.59:0/2723692698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f017809e1d0 0x7f0178121c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.138+0000 7f017d74b700 1 --2- 172.21.15.59:0/2723692698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0178139170 0x7f01781221d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.138+0000 7f017cf4a700 1 -- 172.21.15.59:0/2723692698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0178139170 msgr2=0x7f01781221d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.138+0000 7f017cf4a700 1 --2- 172.21.15.59:0/2723692698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0178139170 0x7f01781221d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.138+0000 7f017cf4a700 1 -- 172.21.15.59:0/2723692698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f017809e1d0 msgr2=0x7f0178121c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.138+0000 7f017cf4a700 1 --2- 172.21.15.59:0/2723692698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f017809e1d0 0x7f0178121c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.138+0000 7f017cf4a700 1 -- 172.21.15.59:0/2723692698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c0094a0 con 0x7f017809d6f0 2023-09-30T22:30:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.138+0000 7f017cf4a700 1 --2- 172.21.15.59:0/2723692698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f017809d6f0 0x7f0178121750 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f016800c520 tx=0x7f016800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:13.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.138+0000 7f01757fa700 1 -- 172.21.15.59:0/2723692698 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168004c80 con 0x7f017809d6f0 2023-09-30T22:30:13.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.138+0000 7f01757fa700 1 -- 172.21.15.59:0/2723692698 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0168004e00 con 0x7f017809d6f0 2023-09-30T22:30:13.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.138+0000 7f017f1ae700 1 -- 172.21.15.59:0/2723692698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0178123400 con 0x7f017809d6f0 2023-09-30T22:30:13.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.138+0000 7f01757fa700 1 -- 172.21.15.59:0/2723692698 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168007310 con 0x7f017809d6f0 2023-09-30T22:30:13.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.138+0000 7f017f1ae700 1 -- 172.21.15.59:0/2723692698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0178124960 con 0x7f017809d6f0 2023-09-30T22:30:13.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.139+0000 7f01757fa700 1 -- 172.21.15.59:0/2723692698 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0168007470 con 0x7f017809d6f0 2023-09-30T22:30:13.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.140+0000 7f01757fa700 1 -- 172.21.15.59:0/2723692698 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f016803f320 con 0x7f017809d6f0 2023-09-30T22:30:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.140+0000 7f017f1ae700 1 -- 172.21.15.59:0/2723692698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0178124e40 con 0x7f017809d6f0 2023-09-30T22:30:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.145+0000 7f01757fa700 1 -- 172.21.15.59:0/2723692698 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01680123b0 con 0x7f017809d6f0 2023-09-30T22:30:13.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.264+0000 7f8c482c8700 1 -- 172.21.15.59:0/2318626882 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8c400a3460 con 0x7f8c4009f410 2023-09-30T22:30:13.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.264+0000 7f8c36ffd700 1 -- 172.21.15.59:0/2318626882 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c400a3460 con 0x7f8c4009f410 2023-09-30T22:30:13.265 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:13.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.266+0000 7f8c482c8700 1 -- 172.21.15.59:0/2318626882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4009f410 msgr2=0x7f8c401c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.266+0000 7f8c482c8700 1 --2- 172.21.15.59:0/2318626882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4009f410 0x7f8c401c8c10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000ebe0 tx=0x7f8c3000eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.267+0000 7f8c482c8700 1 -- 172.21.15.59:0/2318626882 shutdown_connections 2023-09-30T22:30:13.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.267+0000 7f8c482c8700 1 --2- 172.21.15.59:0/2318626882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c40136fe0 0x7f8c4006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.267+0000 7f8c482c8700 1 --2- 172.21.15.59:0/2318626882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4009e930 0x7f8c401c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.267+0000 7f8c482c8700 1 --2- 172.21.15.59:0/2318626882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4009f410 0x7f8c401c8c10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.267+0000 7f8c482c8700 1 -- 172.21.15.59:0/2318626882 >> 172.21.15.59:0/2318626882 conn(0x7f8c400a4210 msgr2=0x7f8c40135c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:13.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.267+0000 7f8c482c8700 1 -- 172.21.15.59:0/2318626882 shutdown_connections 2023-09-30T22:30:13.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.267+0000 7f8c482c8700 1 -- 172.21.15.59:0/2318626882 wait complete. 2023-09-30T22:30:13.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.307+0000 7f9b49a71700 1 -- 172.21.15.59:0/2287412077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9b4409f420 con 0x7f9b4409e000 2023-09-30T22:30:13.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.308+0000 7f9b2bfff700 1 -- 172.21.15.59:0/2287412077 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b38017020 con 0x7f9b4409e000 2023-09-30T22:30:13.309 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.310+0000 7f9b49a71700 1 -- 172.21.15.59:0/2287412077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b4409e000 msgr2=0x7f9b441a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.310+0000 7f9b49a71700 1 --2- 172.21.15.59:0/2287412077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b4409e000 0x7f9b441a6410 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9b38000f60 tx=0x7f9b3800c730 comp rx=0 tx=0).stop 2023-09-30T22:30:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.310+0000 7f9b49a71700 1 -- 172.21.15.59:0/2287412077 shutdown_connections 2023-09-30T22:30:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.310+0000 7f9b49a71700 1 --2- 172.21.15.59:0/2287412077 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b4409d6f0 0x7f9b441a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.310+0000 7f9b49a71700 1 --2- 172.21.15.59:0/2287412077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b4409e440 0x7f9b441a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.310+0000 7f9b49a71700 1 --2- 172.21.15.59:0/2287412077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b4409e000 0x7f9b441a6410 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.310+0000 7f9b49a71700 1 -- 172.21.15.59:0/2287412077 >> 172.21.15.59:0/2287412077 conn(0x7f9b44066f50 msgr2=0x7f9b441baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.310+0000 7f9b49a71700 1 -- 172.21.15.59:0/2287412077 shutdown_connections 2023-09-30T22:30:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.310+0000 7f9b49a71700 1 -- 172.21.15.59:0/2287412077 wait complete. 2023-09-30T22:30:13.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:13.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.355+0000 7f017f1ae700 1 -- 172.21.15.59:0/2723692698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f017809f420 con 0x7f017809d6f0 2023-09-30T22:30:13.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.355+0000 7f01757fa700 1 -- 172.21.15.59:0/2723692698 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0168011360 con 0x7f017809d6f0 2023-09-30T22:30:13.357 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:13.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.358+0000 7f017f1ae700 1 -- 172.21.15.59:0/2723692698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f017809d6f0 msgr2=0x7f0178121750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.358+0000 7f017f1ae700 1 --2- 172.21.15.59:0/2723692698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f017809d6f0 0x7f0178121750 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f016800c520 tx=0x7f016800c830 comp rx=0 tx=0).stop 2023-09-30T22:30:13.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.358+0000 7f017f1ae700 1 -- 172.21.15.59:0/2723692698 shutdown_connections 2023-09-30T22:30:13.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.358+0000 7f017f1ae700 1 --2- 172.21.15.59:0/2723692698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0178139170 0x7f01781221d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.358+0000 7f017f1ae700 1 --2- 172.21.15.59:0/2723692698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f017809d6f0 0x7f0178121750 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.358+0000 7f017f1ae700 1 --2- 172.21.15.59:0/2723692698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f017809e1d0 0x7f0178121c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.358+0000 7f017f1ae700 1 -- 172.21.15.59:0/2723692698 >> 172.21.15.59:0/2723692698 conn(0x7f0178066f50 msgr2=0x7f0178070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:13.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.358+0000 7f017f1ae700 1 -- 172.21.15.59:0/2723692698 shutdown_connections 2023-09-30T22:30:13.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:13.358+0000 7f017f1ae700 1 -- 172.21.15.59:0/2723692698 wait complete. 2023-09-30T22:30:13.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:13.895 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:14.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.039+0000 7f1151ad8700 1 Processor -- start 2023-09-30T22:30:14.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.040+0000 7f1151ad8700 1 -- start start 2023-09-30T22:30:14.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.040+0000 7f1151ad8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c09f410 0x7f114c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.040+0000 7f1151ad8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f114c136fe0 0x7f114c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.040+0000 7f1151ad8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114c070940 con 0x7f114c09e930 2023-09-30T22:30:14.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.040+0000 7f1151ad8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f114c06fd60 con 0x7f114c136fe0 2023-09-30T22:30:14.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.040+0000 7f1151ad8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114c06fa80 con 0x7f114c09f410 2023-09-30T22:30:14.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.040+0000 7f114bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f114c136fe0 0x7f114c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.040+0000 7f114affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c09f410 0x7f114c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.040+0000 7f114affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c09f410 0x7f114c136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43410/0 (socket says 172.21.15.59:43410) 2023-09-30T22:30:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.040+0000 7f114bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f114c136fe0 0x7f114c1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52084/0 (socket says 172.21.15.59:52084) 2023-09-30T22:30:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.040+0000 7f114affd700 1 -- 172.21.15.59:0/2787751179 learned_addr learned my addr 172.21.15.59:0/2787751179 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.041+0000 7f114bfff700 1 -- 172.21.15.59:0/2787751179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c09f410 msgr2=0x7f114c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.041+0000 7f114bfff700 1 --2- 172.21.15.59:0/2787751179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c09f410 0x7f114c136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.041+0000 7f114bfff700 1 -- 172.21.15.59:0/2787751179 >> v1:172.21.15.59:6789/0 conn(0x7f114c09e930 legacy=0x7f114c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.041+0000 7f114bfff700 1 -- 172.21.15.59:0/2787751179 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c09fb60 con 0x7f114c136fe0 2023-09-30T22:30:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.041+0000 7f114affd700 1 --2- 172.21.15.59:0/2787751179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c09f410 0x7f114c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.041+0000 7f114bfff700 1 --2- 172.21.15.59:0/2787751179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c136fe0 0x7f114c1393c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1144009d90 tx=0x7f114400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e845bb40d3040a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.041+0000 7f114a7fc700 1 -- 172.21.15.59:0/2787751179 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114400e070 con 0x7f114c136fe0 2023-09-30T22:30:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.041+0000 7f114a7fc700 1 -- 172.21.15.59:0/2787751179 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114400bb20 con 0x7f114c136fe0 2023-09-30T22:30:14.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.041+0000 7f114a7fc700 1 -- 172.21.15.59:0/2787751179 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1144012430 con 0x7f114c136fe0 2023-09-30T22:30:14.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.041+0000 7f1151ad8700 1 -- 172.21.15.59:0/2787751179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c136fe0 msgr2=0x7f114c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.041+0000 7f1151ad8700 1 --2- 172.21.15.59:0/2787751179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c136fe0 0x7f114c1393c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1144009d90 tx=0x7f114400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:14.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.042+0000 7f1151ad8700 1 -- 172.21.15.59:0/2787751179 shutdown_connections 2023-09-30T22:30:14.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.042+0000 7f1151ad8700 1 --2- 172.21.15.59:0/2787751179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c136fe0 0x7f114c1393c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.042+0000 7f1151ad8700 1 --2- 172.21.15.59:0/2787751179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c09f410 0x7f114c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.042+0000 7f1151ad8700 1 -- 172.21.15.59:0/2787751179 >> 172.21.15.59:0/2787751179 conn(0x7f114c0a4210 msgr2=0x7f114c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:14.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.042+0000 7f1151ad8700 1 -- 172.21.15.59:0/2787751179 shutdown_connections 2023-09-30T22:30:14.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.042+0000 7f1151ad8700 1 -- 172.21.15.59:0/2787751179 wait complete. 2023-09-30T22:30:14.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.043+0000 7f1151ad8700 1 Processor -- start 2023-09-30T22:30:14.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.043+0000 7f1151ad8700 1 -- start start 2023-09-30T22:30:14.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.043+0000 7f1151ad8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c09e930 0x7f114c11e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.043+0000 7f1151ad8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c09f410 0x7f114c11eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.043+0000 7f1151ad8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c136fe0 0x7f114c11f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.043+0000 7f1151ad8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c133ef0 con 0x7f114c09e930 2023-09-30T22:30:14.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.043+0000 7f1151ad8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114c1201d0 con 0x7f114c136fe0 2023-09-30T22:30:14.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.043+0000 7f1151ad8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f114c1344b0 con 0x7f114c09f410 2023-09-30T22:30:14.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.043+0000 7f114affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c09f410 0x7f114c11eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.043+0000 7f114b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c09e930 0x7f114c11e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.043+0000 7f114bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c136fe0 0x7f114c11f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.043+0000 7f114affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c09f410 0x7f114c11eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53722/0 (socket says 172.21.15.59:53722) 2023-09-30T22:30:14.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.043+0000 7f114b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c09e930 0x7f114c11e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52086/0 (socket says 172.21.15.59:52086) 2023-09-30T22:30:14.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.043+0000 7f114affd700 1 -- 172.21.15.59:0/3309407123 learned_addr learned my addr 172.21.15.59:0/3309407123 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:14.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.044+0000 7f114b7fe700 1 -- 172.21.15.59:0/3309407123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c09f410 msgr2=0x7f114c11eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.044+0000 7f114b7fe700 1 --2- 172.21.15.59:0/3309407123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c09f410 0x7f114c11eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.044+0000 7f114b7fe700 1 -- 172.21.15.59:0/3309407123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c136fe0 msgr2=0x7f114c11f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.044+0000 7f114b7fe700 1 --2- 172.21.15.59:0/3309407123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c136fe0 0x7f114c11f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.044+0000 7f114b7fe700 1 -- 172.21.15.59:0/3309407123 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1134009550 con 0x7f114c09e930 2023-09-30T22:30:14.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.044+0000 7f114b7fe700 1 --2- 172.21.15.59:0/3309407123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c09e930 0x7f114c11e5c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f113c00c450 tx=0x7f113c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:14.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.044+0000 7f1143fff700 1 -- 172.21.15.59:0/3309407123 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c0052d0 con 0x7f114c09e930 2023-09-30T22:30:14.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.044+0000 7f1143fff700 1 -- 172.21.15.59:0/3309407123 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c005430 con 0x7f114c09e930 2023-09-30T22:30:14.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.044+0000 7f1151ad8700 1 -- 172.21.15.59:0/3309407123 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1144009a70 con 0x7f114c09e930 2023-09-30T22:30:14.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.044+0000 7f1143fff700 1 -- 172.21.15.59:0/3309407123 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c0038c0 con 0x7f114c09e930 2023-09-30T22:30:14.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.044+0000 7f1151ad8700 1 -- 172.21.15.59:0/3309407123 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114c120a30 con 0x7f114c09e930 2023-09-30T22:30:14.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.045+0000 7f1143fff700 1 -- 172.21.15.59:0/3309407123 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f113c003a20 con 0x7f114c09e930 2023-09-30T22:30:14.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.045+0000 7f1143fff700 1 -- 172.21.15.59:0/3309407123 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f113c03e970 con 0x7f114c09e930 2023-09-30T22:30:14.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.045+0000 7f1151ad8700 1 -- 172.21.15.59:0/3309407123 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114c1218d0 con 0x7f114c09e930 2023-09-30T22:30:14.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.050+0000 7f1143fff700 1 -- 172.21.15.59:0/3309407123 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f114c1218d0 con 0x7f114c09e930 2023-09-30T22:30:14.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.254+0000 7f1151ad8700 1 -- 172.21.15.59:0/3309407123 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f114c1218d0 con 0x7f114c09e930 2023-09-30T22:30:14.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.255+0000 7f1143fff700 1 -- 172.21.15.59:0/3309407123 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f114c1218d0 con 0x7f114c09e930 2023-09-30T22:30:14.256 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:14.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.257+0000 7f1151ad8700 1 -- 172.21.15.59:0/3309407123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c09e930 msgr2=0x7f114c11e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.257+0000 7f1151ad8700 1 --2- 172.21.15.59:0/3309407123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c09e930 0x7f114c11e5c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f113c00c450 tx=0x7f113c00c760 comp rx=0 tx=0).stop 2023-09-30T22:30:14.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.257+0000 7f1151ad8700 1 -- 172.21.15.59:0/3309407123 shutdown_connections 2023-09-30T22:30:14.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.257+0000 7f1151ad8700 1 --2- 172.21.15.59:0/3309407123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c136fe0 0x7f114c11f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.257+0000 7f1151ad8700 1 --2- 172.21.15.59:0/3309407123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c09e930 0x7f114c11e5c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.257+0000 7f1151ad8700 1 --2- 172.21.15.59:0/3309407123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c09f410 0x7f114c11eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.257+0000 7f1151ad8700 1 -- 172.21.15.59:0/3309407123 >> 172.21.15.59:0/3309407123 conn(0x7f114c0a4210 msgr2=0x7f114c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:14.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.257+0000 7f1151ad8700 1 -- 172.21.15.59:0/3309407123 shutdown_connections 2023-09-30T22:30:14.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.257+0000 7f1151ad8700 1 -- 172.21.15.59:0/3309407123 wait complete. 2023-09-30T22:30:14.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:14.282 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:14.325 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:14.373 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:14.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.425+0000 7f13914a5700 1 Processor -- start 2023-09-30T22:30:14.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.426+0000 7f13914a5700 1 -- start start 2023-09-30T22:30:14.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.426+0000 7f13914a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f138c09d6f0 0x7f138c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.426+0000 7f13914a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f138c09e410 0x7f138c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.426+0000 7f13914a5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138c09b120 con 0x7f138c09e000 2023-09-30T22:30:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.426+0000 7f13914a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c06b460 con 0x7f138c09e410 2023-09-30T22:30:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.426+0000 7f13914a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f138c09a7e0 con 0x7f138c09d6f0 2023-09-30T22:30:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.427+0000 7f138a7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f138c09e000 0x7f138c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39640/0 (socket says 172.21.15.59:39640) 2023-09-30T22:30:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.427+0000 7f138b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f138c09e410 0x7f138c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.427+0000 7f138a7fc700 1 -- 172.21.15.59:0/2136641888 learned_addr learned my addr 172.21.15.59:0/2136641888 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.427+0000 7f138affd700 1 --2- 172.21.15.59:0/2136641888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f138c09d6f0 0x7f138c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.427+0000 7f1389ffb700 1 -- 172.21.15.59:0/2136641888 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473592083 0 0) 0x7f138c09b120 con 0x7f138c09e000 2023-09-30T22:30:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.427+0000 7f1389ffb700 1 -- 172.21.15.59:0/2136641888 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13740035b0 con 0x7f138c09e000 2023-09-30T22:30:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.427+0000 7f138affd700 1 -- 172.21.15.59:0/2136641888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f138c09e410 msgr2=0x7f138c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.427+0000 7f138affd700 1 --2- 172.21.15.59:0/2136641888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f138c09e410 0x7f138c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.427+0000 7f138affd700 1 -- 172.21.15.59:0/2136641888 >> v1:172.21.15.59:6789/0 conn(0x7f138c09e000 legacy=0x7f138c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.427+0000 7f138affd700 1 -- 172.21.15.59:0/2136641888 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c09a500 con 0x7f138c09d6f0 2023-09-30T22:30:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.427+0000 7f138b7fe700 1 --2- 172.21.15.59:0/2136641888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f138c09e410 0x7f138c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.427+0000 7f138affd700 1 --2- 172.21.15.59:0/2136641888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f138c09d6f0 0x7f138c09dac0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f137c0098a0 tx=0x7f137c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b6b7acf6ceb12da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.427+0000 7f1389ffb700 1 -- 172.21.15.59:0/2136641888 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c011830 con 0x7f138c09d6f0 2023-09-30T22:30:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.428+0000 7f1389ffb700 1 -- 172.21.15.59:0/2136641888 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c011990 con 0x7f138c09d6f0 2023-09-30T22:30:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.428+0000 7f1389ffb700 1 -- 172.21.15.59:0/2136641888 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c011d00 con 0x7f138c09d6f0 2023-09-30T22:30:14.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.428+0000 7f13914a5700 1 -- 172.21.15.59:0/2136641888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f138c09d6f0 msgr2=0x7f138c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.428+0000 7f13914a5700 1 --2- 172.21.15.59:0/2136641888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f138c09d6f0 0x7f138c09dac0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f137c0098a0 tx=0x7f137c009bb0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.428+0000 7f13914a5700 1 -- 172.21.15.59:0/2136641888 shutdown_connections 2023-09-30T22:30:14.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.428+0000 7f13914a5700 1 --2- 172.21.15.59:0/2136641888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f138c09d6f0 0x7f138c09dac0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.428+0000 7f13914a5700 1 --2- 172.21.15.59:0/2136641888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f138c09e410 0x7f138c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.428+0000 7f13914a5700 1 -- 172.21.15.59:0/2136641888 >> 172.21.15.59:0/2136641888 conn(0x7f138c066f50 msgr2=0x7f138c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:14.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.428+0000 7f13914a5700 1 -- 172.21.15.59:0/2136641888 shutdown_connections 2023-09-30T22:30:14.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.428+0000 7f13914a5700 1 -- 172.21.15.59:0/2136641888 wait complete. 2023-09-30T22:30:14.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.430+0000 7f13914a5700 1 Processor -- start 2023-09-30T22:30:14.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.430+0000 7f13914a5700 1 -- start start 2023-09-30T22:30:14.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.430+0000 7f13914a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f138c09d6f0 0x7f138c1a4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.430+0000 7f13914a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f138c09e000 0x7f138c1a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.430+0000 7f13914a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f138c09e410 0x7f138c1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.430+0000 7f13914a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c1a6ca0 con 0x7f138c09e000 2023-09-30T22:30:14.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.430+0000 7f13914a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c1b8020 con 0x7f138c09d6f0 2023-09-30T22:30:14.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.430+0000 7f13914a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f138c1a3be0 con 0x7f138c09e410 2023-09-30T22:30:14.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.430+0000 7f138a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f138c09e000 0x7f138c1a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.430+0000 7f138a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f138c09e000 0x7f138c1a45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48894/0 (socket says 172.21.15.59:48894) 2023-09-30T22:30:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.430+0000 7f138a7fc700 1 -- 172.21.15.59:0/3621588280 learned_addr learned my addr 172.21.15.59:0/3621588280 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.430+0000 7f138b7fe700 1 --2- 172.21.15.59:0/3621588280 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f138c09e410 0x7f138c1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.430+0000 7f138affd700 1 --2- 172.21.15.59:0/3621588280 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f138c09d6f0 0x7f138c1a4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.431+0000 7f138a7fc700 1 -- 172.21.15.59:0/3621588280 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f138c09e410 msgr2=0x7f138c1c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.431+0000 7f138a7fc700 1 --2- 172.21.15.59:0/3621588280 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f138c09e410 0x7f138c1c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.431+0000 7f138a7fc700 1 -- 172.21.15.59:0/3621588280 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f138c09d6f0 msgr2=0x7f138c1a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.431+0000 7f138a7fc700 1 --2- 172.21.15.59:0/3621588280 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f138c09d6f0 0x7f138c1a4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.431+0000 7f138a7fc700 1 -- 172.21.15.59:0/3621588280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1384009a70 con 0x7f138c09e000 2023-09-30T22:30:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.431+0000 7f138b7fe700 1 --2- 172.21.15.59:0/3621588280 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f138c09e410 0x7f138c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.431+0000 7f138affd700 1 --2- 172.21.15.59:0/3621588280 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f138c09d6f0 0x7f138c1a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:14.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.431+0000 7f138a7fc700 1 --2- 172.21.15.59:0/3621588280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f138c09e000 0x7f138c1a45c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f138000c700 tx=0x7f138000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:14.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.431+0000 7f13737fe700 1 -- 172.21.15.59:0/3621588280 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380001d80 con 0x7f138c09e000 2023-09-30T22:30:14.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.431+0000 7f13737fe700 1 -- 172.21.15.59:0/3621588280 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1380005d70 con 0x7f138c09e000 2023-09-30T22:30:14.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.431+0000 7f13914a5700 1 -- 172.21.15.59:0/3621588280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137c0094a0 con 0x7f138c09e000 2023-09-30T22:30:14.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.431+0000 7f13737fe700 1 -- 172.21.15.59:0/3621588280 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13800072f0 con 0x7f138c09e000 2023-09-30T22:30:14.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.431+0000 7f13914a5700 1 -- 172.21.15.59:0/3621588280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c0a1e20 con 0x7f138c09e000 2023-09-30T22:30:14.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.432+0000 7f13737fe700 1 -- 172.21.15.59:0/3621588280 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1380007450 con 0x7f138c09e000 2023-09-30T22:30:14.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.433+0000 7f13737fe700 1 -- 172.21.15.59:0/3621588280 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f138003eb10 con 0x7f138c09e000 2023-09-30T22:30:14.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.433+0000 7f13914a5700 1 -- 172.21.15.59:0/3621588280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138c1a4bc0 con 0x7f138c09e000 2023-09-30T22:30:14.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.438+0000 7f13737fe700 1 -- 172.21.15.59:0/3621588280 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1380017080 con 0x7f138c09e000 2023-09-30T22:30:14.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.467+0000 7fb84082a700 1 Processor -- start 2023-09-30T22:30:14.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.467+0000 7fb84082a700 1 -- start start 2023-09-30T22:30:14.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb84082a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83c0a0a30 0x7fb83c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb84082a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb83c0a1340 0x7fb83c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb84082a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83c09edd0 con 0x7fb83c133fa0 2023-09-30T22:30:14.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb84082a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb83c09e1f0 con 0x7fb83c0a1340 2023-09-30T22:30:14.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb84082a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c09dc50 con 0x7fb83c0a0a30 2023-09-30T22:30:14.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb839d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb83c0a1340 0x7fb83c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb83ad9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb83c133fa0 0x7fb83c13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39650/0 (socket says 172.21.15.59:39650) 2023-09-30T22:30:14.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb83a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83c0a0a30 0x7fb83c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb83ad9d700 1 -- 172.21.15.59:0/2715182987 learned_addr learned my addr 172.21.15.59:0/2715182987 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:14.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb839d9b700 1 -- 172.21.15.59:0/2715182987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83c0a0a30 msgr2=0x7fb83c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:14.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb839d9b700 1 --2- 172.21.15.59:0/2715182987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83c0a0a30 0x7fb83c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb839d9b700 1 -- 172.21.15.59:0/2715182987 >> v1:172.21.15.59:6789/0 conn(0x7fb83c133fa0 legacy=0x7fb83c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb83959a700 1 -- 172.21.15.59:0/2715182987 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787278003 0 0) 0x7fb83c09edd0 con 0x7fb83c133fa0 2023-09-30T22:30:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb839d9b700 1 -- 172.21.15.59:0/2715182987 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c0a1fe0 con 0x7fb83c0a1340 2023-09-30T22:30:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb83a59c700 1 --2- 172.21.15.59:0/2715182987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83c0a0a30 0x7fb83c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.468+0000 7fb839d9b700 1 --2- 172.21.15.59:0/2715182987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb83c0a1340 0x7fb83c133a60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb830009840 tx=0x7fb830009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f317b1a8e4c6a157 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.469+0000 7fb83959a700 1 -- 172.21.15.59:0/2715182987 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830011830 con 0x7fb83c0a1340 2023-09-30T22:30:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.469+0000 7fb83959a700 1 -- 172.21.15.59:0/2715182987 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb830011990 con 0x7fb83c0a1340 2023-09-30T22:30:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.469+0000 7fb83959a700 1 -- 172.21.15.59:0/2715182987 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830011d20 con 0x7fb83c0a1340 2023-09-30T22:30:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.469+0000 7fb84082a700 1 -- 172.21.15.59:0/2715182987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb83c0a1340 msgr2=0x7fb83c133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.469+0000 7fb84082a700 1 --2- 172.21.15.59:0/2715182987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb83c0a1340 0x7fb83c133a60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb830009840 tx=0x7fb830009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.469+0000 7fb84082a700 1 -- 172.21.15.59:0/2715182987 shutdown_connections 2023-09-30T22:30:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.469+0000 7fb84082a700 1 --2- 172.21.15.59:0/2715182987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83c0a0a30 0x7fb83c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.469+0000 7fb84082a700 1 --2- 172.21.15.59:0/2715182987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb83c0a1340 0x7fb83c133a60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.469+0000 7fb84082a700 1 -- 172.21.15.59:0/2715182987 >> 172.21.15.59:0/2715182987 conn(0x7fb83c0a6550 msgr2=0x7fb83c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.469+0000 7fb84082a700 1 -- 172.21.15.59:0/2715182987 shutdown_connections 2023-09-30T22:30:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.469+0000 7fb84082a700 1 -- 172.21.15.59:0/2715182987 wait complete. 2023-09-30T22:30:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.471+0000 7fb84082a700 1 Processor -- start 2023-09-30T22:30:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.471+0000 7fb84082a700 1 -- start start 2023-09-30T22:30:14.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.471+0000 7fb84082a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb83c0a0a30 0x7fb83c122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.471+0000 7fb84082a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb83c0a1340 0x7fb83c122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.471+0000 7fb84082a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83c133fa0 0x7fb83c1232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.471+0000 7fb84082a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c126f80 con 0x7fb83c0a0a30 2023-09-30T22:30:14.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.471+0000 7fb84082a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c125d60 con 0x7fb83c0a1340 2023-09-30T22:30:14.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.471+0000 7fb84082a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c0a3580 con 0x7fb83c133fa0 2023-09-30T22:30:14.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.471+0000 7fb83a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb83c0a0a30 0x7fb83c122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.471+0000 7fb83a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb83c0a0a30 0x7fb83c122820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48902/0 (socket says 172.21.15.59:48902) 2023-09-30T22:30:14.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.471+0000 7fb83ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83c133fa0 0x7fb83c1232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.471+0000 7fb83a59c700 1 -- 172.21.15.59:0/2479386907 learned_addr learned my addr 172.21.15.59:0/2479386907 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:14.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.471+0000 7fb839d9b700 1 --2- 172.21.15.59:0/2479386907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb83c0a1340 0x7fb83c122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.472+0000 7fb83ad9d700 1 -- 172.21.15.59:0/2479386907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb83c0a1340 msgr2=0x7fb83c122d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.472+0000 7fb83ad9d700 1 --2- 172.21.15.59:0/2479386907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb83c0a1340 0x7fb83c122d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.472+0000 7fb83ad9d700 1 -- 172.21.15.59:0/2479386907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb83c0a0a30 msgr2=0x7fb83c122820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.472+0000 7fb83ad9d700 1 --2- 172.21.15.59:0/2479386907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb83c0a0a30 0x7fb83c122820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.472+0000 7fb83ad9d700 1 -- 172.21.15.59:0/2479386907 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c0094a0 con 0x7fb83c133fa0 2023-09-30T22:30:14.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.472+0000 7fb83ad9d700 1 --2- 172.21.15.59:0/2479386907 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83c133fa0 0x7fb83c1232a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb83400cc10 tx=0x7fb83400cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:14.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.472+0000 7fb82affd700 1 -- 172.21.15.59:0/2479386907 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83400aa00 con 0x7fb83c133fa0 2023-09-30T22:30:14.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.472+0000 7fb84082a700 1 -- 172.21.15.59:0/2479386907 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8300094a0 con 0x7fb83c133fa0 2023-09-30T22:30:14.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.472+0000 7fb82affd700 1 -- 172.21.15.59:0/2479386907 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83400ab80 con 0x7fb83c133fa0 2023-09-30T22:30:14.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.472+0000 7fb82affd700 1 -- 172.21.15.59:0/2479386907 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8340070d0 con 0x7fb83c133fa0 2023-09-30T22:30:14.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.472+0000 7fb84082a700 1 -- 172.21.15.59:0/2479386907 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83c124bf0 con 0x7fb83c133fa0 2023-09-30T22:30:14.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.473+0000 7fb82affd700 1 -- 172.21.15.59:0/2479386907 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb834007230 con 0x7fb83c133fa0 2023-09-30T22:30:14.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.473+0000 7fb82affd700 1 -- 172.21.15.59:0/2479386907 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb83403f1b0 con 0x7fb83c133fa0 2023-09-30T22:30:14.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.473+0000 7fb84082a700 1 -- 172.21.15.59:0/2479386907 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83c125ed0 con 0x7fb83c133fa0 2023-09-30T22:30:14.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.479+0000 7fb82affd700 1 -- 172.21.15.59:0/2479386907 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb834018020 con 0x7fb83c133fa0 2023-09-30T22:30:14.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.517+0000 7fd8c52d3700 1 Processor -- start 2023-09-30T22:30:14.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.517+0000 7fd8c52d3700 1 -- start start 2023-09-30T22:30:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.517+0000 7fd8c52d3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8c009e850 0x7fd8c009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.517+0000 7fd8c52d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c009f160 0x7fd8c0133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.517+0000 7fd8c52d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c01340c0 0x7fd8c0134500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.517+0000 7fd8c52d3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c009ae60 con 0x7fd8c009e850 2023-09-30T22:30:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.517+0000 7fd8c52d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0134a40 con 0x7fd8c01340c0 2023-09-30T22:30:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.517+0000 7fd8c52d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c006b990 con 0x7fd8c009f160 2023-09-30T22:30:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.517+0000 7fd8be7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c009f160 0x7fd8c0133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.517+0000 7fd8be7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c009f160 0x7fd8c0133b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36022/0 (socket says 172.21.15.59:36022) 2023-09-30T22:30:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.517+0000 7fd8be7fc700 1 -- 172.21.15.59:0/4031989744 learned_addr learned my addr 172.21.15.59:0/4031989744 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.517+0000 7fd8bf7fe700 1 --2- 172.21.15.59:0/4031989744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c01340c0 0x7fd8c0134500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.517+0000 7fd8beffd700 1 --2- 172.21.15.59:0/4031989744 >> v2:172.21.15.59:3300/0 conn(0x7fd8c009e850 0x7fd8c009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.518+0000 7fd8be7fc700 1 -- 172.21.15.59:0/4031989744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c01340c0 msgr2=0x7fd8c0134500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.518+0000 7fd8be7fc700 1 --2- 172.21.15.59:0/4031989744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c01340c0 0x7fd8c0134500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.518+0000 7fd8be7fc700 1 -- 172.21.15.59:0/4031989744 >> v2:172.21.15.59:3300/0 conn(0x7fd8c009e850 msgr2=0x7fd8c009ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.518+0000 7fd8be7fc700 1 --2- 172.21.15.59:0/4031989744 >> v2:172.21.15.59:3300/0 conn(0x7fd8c009e850 0x7fd8c009ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.518+0000 7fd8be7fc700 1 -- 172.21.15.59:0/4031989744 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c006bc50 con 0x7fd8c009f160 2023-09-30T22:30:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.518+0000 7fd8beffd700 1 --2- 172.21.15.59:0/4031989744 >> v2:172.21.15.59:3300/0 conn(0x7fd8c009e850 0x7fd8c009ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.518+0000 7fd8be7fc700 1 --2- 172.21.15.59:0/4031989744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c009f160 0x7fd8c0133b80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40098f0 tx=0x7fd8b4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8d1bd64e08eccad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.518+0000 7fd8bdffb700 1 -- 172.21.15.59:0/4031989744 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4011830 con 0x7fd8c009f160 2023-09-30T22:30:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.518+0000 7fd8bdffb700 1 -- 172.21.15.59:0/4031989744 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b4011990 con 0x7fd8c009f160 2023-09-30T22:30:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.518+0000 7fd8bdffb700 1 -- 172.21.15.59:0/4031989744 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4011d20 con 0x7fd8c009f160 2023-09-30T22:30:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.519+0000 7fd8c52d3700 1 -- 172.21.15.59:0/4031989744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c009f160 msgr2=0x7fd8c0133b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.519+0000 7fd8c52d3700 1 --2- 172.21.15.59:0/4031989744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c009f160 0x7fd8c0133b80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40098f0 tx=0x7fd8b4009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.519+0000 7fd8c52d3700 1 -- 172.21.15.59:0/4031989744 shutdown_connections 2023-09-30T22:30:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.519+0000 7fd8c52d3700 1 --2- 172.21.15.59:0/4031989744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c01340c0 0x7fd8c0134500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.519+0000 7fd8c52d3700 1 --2- 172.21.15.59:0/4031989744 >> v2:172.21.15.59:3300/0 conn(0x7fd8c009e850 0x7fd8c009ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.519+0000 7fd8c52d3700 1 --2- 172.21.15.59:0/4031989744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c009f160 0x7fd8c0133b80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.519+0000 7fd8c52d3700 1 -- 172.21.15.59:0/4031989744 >> 172.21.15.59:0/4031989744 conn(0x7fd8c00a3f70 msgr2=0x7fd8c00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:14.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.519+0000 7fd8c52d3700 1 -- 172.21.15.59:0/4031989744 shutdown_connections 2023-09-30T22:30:14.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.519+0000 7fd8c52d3700 1 -- 172.21.15.59:0/4031989744 wait complete. 2023-09-30T22:30:14.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.520+0000 7fd8c52d3700 1 Processor -- start 2023-09-30T22:30:14.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.520+0000 7fd8c52d3700 1 -- start start 2023-09-30T22:30:14.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8c52d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c009e850 0x7fd8c01226a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8c52d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009f160 0x7fd8c0122be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8c52d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c01340c0 0x7fd8c0123120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8c52d3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00a17b0 con 0x7fd8c009f160 2023-09-30T22:30:14.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8c52d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c006cd30 con 0x7fd8c01340c0 2023-09-30T22:30:14.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8c52d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c01250d0 con 0x7fd8c009e850 2023-09-30T22:30:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8beffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c009e850 0x7fd8c01226a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8beffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c009e850 0x7fd8c01226a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36036/0 (socket says 172.21.15.59:36036) 2023-09-30T22:30:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8beffd700 1 -- 172.21.15.59:0/3248078443 learned_addr learned my addr 172.21.15.59:0/3248078443 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8be7fc700 1 --2- 172.21.15.59:0/3248078443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009f160 0x7fd8c0122be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8bf7fe700 1 --2- 172.21.15.59:0/3248078443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c01340c0 0x7fd8c0123120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8be7fc700 1 -- 172.21.15.59:0/3248078443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c009e850 msgr2=0x7fd8c01226a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8be7fc700 1 --2- 172.21.15.59:0/3248078443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c009e850 0x7fd8c01226a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8be7fc700 1 -- 172.21.15.59:0/3248078443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c01340c0 msgr2=0x7fd8c0123120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8be7fc700 1 --2- 172.21.15.59:0/3248078443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c01340c0 0x7fd8c0123120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8be7fc700 1 -- 172.21.15.59:0/3248078443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b0009a70 con 0x7fd8c009f160 2023-09-30T22:30:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.521+0000 7fd8beffd700 1 --2- 172.21.15.59:0/3248078443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c009e850 0x7fd8c01226a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.522+0000 7fd8be7fc700 1 --2- 172.21.15.59:0/3248078443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009f160 0x7fd8c0122be0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4016000 tx=0x7fd8b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.522+0000 7fd8a77fe700 1 -- 172.21.15.59:0/3248078443 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4004450 con 0x7fd8c009f160 2023-09-30T22:30:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.522+0000 7fd8a77fe700 1 -- 172.21.15.59:0/3248078443 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b40045b0 con 0x7fd8c009f160 2023-09-30T22:30:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.522+0000 7fd8c52d3700 1 -- 172.21.15.59:0/3248078443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b4009550 con 0x7fd8c009f160 2023-09-30T22:30:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.522+0000 7fd8a77fe700 1 -- 172.21.15.59:0/3248078443 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b40038e0 con 0x7fd8c009f160 2023-09-30T22:30:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.522+0000 7fd8c52d3700 1 -- 172.21.15.59:0/3248078443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c0125ee0 con 0x7fd8c009f160 2023-09-30T22:30:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.523+0000 7fd8a77fe700 1 -- 172.21.15.59:0/3248078443 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8b4021070 con 0x7fd8c009f160 2023-09-30T22:30:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.523+0000 7fd8a77fe700 1 -- 172.21.15.59:0/3248078443 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd8b40408c0 con 0x7fd8c009f160 2023-09-30T22:30:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.523+0000 7fd8c52d3700 1 -- 172.21.15.59:0/3248078443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c00747f0 con 0x7fd8c009f160 2023-09-30T22:30:14.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.528+0000 7fd8a77fe700 1 -- 172.21.15.59:0/3248078443 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8b4015080 con 0x7fd8c009f160 2023-09-30T22:30:14.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.649+0000 7f13914a5700 1 -- 172.21.15.59:0/3621588280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f138c074ea0 con 0x7f138c09e000 2023-09-30T22:30:14.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.649+0000 7f13737fe700 1 -- 172.21.15.59:0/3621588280 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1380019b40 con 0x7f138c09e000 2023-09-30T22:30:14.651 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:14.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.651+0000 7f13914a5700 1 -- 172.21.15.59:0/3621588280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f138c09e000 msgr2=0x7f138c1a45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.651+0000 7f13914a5700 1 --2- 172.21.15.59:0/3621588280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f138c09e000 0x7f138c1a45c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f138000c700 tx=0x7f138000ca10 comp rx=0 tx=0).stop 2023-09-30T22:30:14.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.651+0000 7f13914a5700 1 -- 172.21.15.59:0/3621588280 shutdown_connections 2023-09-30T22:30:14.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.651+0000 7f13914a5700 1 --2- 172.21.15.59:0/3621588280 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f138c09e410 0x7f138c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.651+0000 7f13914a5700 1 --2- 172.21.15.59:0/3621588280 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f138c09d6f0 0x7f138c1a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.651+0000 7f13914a5700 1 --2- 172.21.15.59:0/3621588280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f138c09e000 0x7f138c1a45c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.652+0000 7f13914a5700 1 -- 172.21.15.59:0/3621588280 >> 172.21.15.59:0/3621588280 conn(0x7f138c066f50 msgr2=0x7f138c1bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:14.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.652+0000 7f13914a5700 1 -- 172.21.15.59:0/3621588280 shutdown_connections 2023-09-30T22:30:14.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.652+0000 7f13914a5700 1 -- 172.21.15.59:0/3621588280 wait complete. 2023-09-30T22:30:14.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:14.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.689+0000 7fb84082a700 1 -- 172.21.15.59:0/2479386907 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb83c126b50 con 0x7fb83c133fa0 2023-09-30T22:30:14.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.690+0000 7fb82affd700 1 -- 172.21.15.59:0/2479386907 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8340074e0 con 0x7fb83c133fa0 2023-09-30T22:30:14.691 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.693+0000 7fb84082a700 1 -- 172.21.15.59:0/2479386907 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83c133fa0 msgr2=0x7fb83c1232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.693+0000 7fb84082a700 1 --2- 172.21.15.59:0/2479386907 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83c133fa0 0x7fb83c1232a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb83400cc10 tx=0x7fb83400cf20 comp rx=0 tx=0).stop 2023-09-30T22:30:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.693+0000 7fb84082a700 1 -- 172.21.15.59:0/2479386907 shutdown_connections 2023-09-30T22:30:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.693+0000 7fb84082a700 1 --2- 172.21.15.59:0/2479386907 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83c133fa0 0x7fb83c1232a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.693+0000 7fb84082a700 1 --2- 172.21.15.59:0/2479386907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb83c0a0a30 0x7fb83c122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.693+0000 7fb84082a700 1 --2- 172.21.15.59:0/2479386907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb83c0a1340 0x7fb83c122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.693+0000 7fb84082a700 1 -- 172.21.15.59:0/2479386907 >> 172.21.15.59:0/2479386907 conn(0x7fb83c0a6550 msgr2=0x7fb83c11c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.693+0000 7fb84082a700 1 -- 172.21.15.59:0/2479386907 shutdown_connections 2023-09-30T22:30:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.693+0000 7fb84082a700 1 -- 172.21.15.59:0/2479386907 wait complete. 2023-09-30T22:30:14.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:14.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.744+0000 7fd8c52d3700 1 -- 172.21.15.59:0/3248078443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd8c0072840 con 0x7fd8c009f160 2023-09-30T22:30:14.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.744+0000 7fd8a77fe700 1 -- 172.21.15.59:0/3248078443 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8b4029020 con 0x7fd8c009f160 2023-09-30T22:30:14.745 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:14.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.746+0000 7fd8c52d3700 1 -- 172.21.15.59:0/3248078443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009f160 msgr2=0x7fd8c0122be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.746+0000 7fd8c52d3700 1 --2- 172.21.15.59:0/3248078443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009f160 0x7fd8c0122be0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4016000 tx=0x7fd8b4004750 comp rx=0 tx=0).stop 2023-09-30T22:30:14.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.746+0000 7fd8c52d3700 1 -- 172.21.15.59:0/3248078443 shutdown_connections 2023-09-30T22:30:14.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.746+0000 7fd8c52d3700 1 --2- 172.21.15.59:0/3248078443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c009e850 0x7fd8c01226a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.746+0000 7fd8c52d3700 1 --2- 172.21.15.59:0/3248078443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c01340c0 0x7fd8c0123120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.746+0000 7fd8c52d3700 1 --2- 172.21.15.59:0/3248078443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009f160 0x7fd8c0122be0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.746+0000 7fd8c52d3700 1 -- 172.21.15.59:0/3248078443 >> 172.21.15.59:0/3248078443 conn(0x7fd8c00a3f70 msgr2=0x7fd8c00709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:14.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.746+0000 7fd8c52d3700 1 -- 172.21.15.59:0/3248078443 shutdown_connections 2023-09-30T22:30:14.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:14.746+0000 7fd8c52d3700 1 -- 172.21.15.59:0/3248078443 wait complete. 2023-09-30T22:30:14.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:15.273 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:15.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.420+0000 7fb219ca1700 1 Processor -- start 2023-09-30T22:30:15.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.420+0000 7fb219ca1700 1 -- start start 2023-09-30T22:30:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb219ca1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb214130540 0x7fb214130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb219ca1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb214130e50 0x7fb21406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb219ca1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb21406fb20 0x7fb21406ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb219ca1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb21409a390 con 0x7fb214130540 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb219ca1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2140716a0 con 0x7fb214130e50 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb219ca1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb214071290 con 0x7fb21406fb20 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb213fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb21406fb20 0x7fb21406ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb213fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb21406fb20 0x7fb21406ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36050/0 (socket says 172.21.15.59:36050) 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb213fff700 1 -- 172.21.15.59:0/1295369064 learned_addr learned my addr 172.21.15.59:0/1295369064 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb2137fe700 1 --2- 172.21.15.59:0/1295369064 >> v2:172.21.15.59:3300/0 conn(0x7fb214130540 0x7fb214130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb212ffd700 1 --2- 172.21.15.59:0/1295369064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb214130e50 0x7fb21406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb213fff700 1 -- 172.21.15.59:0/1295369064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb214130e50 msgr2=0x7fb21406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb213fff700 1 --2- 172.21.15.59:0/1295369064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb214130e50 0x7fb21406f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb213fff700 1 -- 172.21.15.59:0/1295369064 >> v2:172.21.15.59:3300/0 conn(0x7fb214130540 msgr2=0x7fb214130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb213fff700 1 --2- 172.21.15.59:0/1295369064 >> v2:172.21.15.59:3300/0 conn(0x7fb214130540 0x7fb214130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb213fff700 1 -- 172.21.15.59:0/1295369064 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb214130340 con 0x7fb21406fb20 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb212ffd700 1 --2- 172.21.15.59:0/1295369064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb214130e50 0x7fb21406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb2137fe700 1 --2- 172.21.15.59:0/1295369064 >> v2:172.21.15.59:3300/0 conn(0x7fb214130540 0x7fb214130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb213fff700 1 --2- 172.21.15.59:0/1295369064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb21406fb20 0x7fb21406ffa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009e50 tx=0x7fb20c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22963604dd11d9e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.421+0000 7fb2127fc700 1 -- 172.21.15.59:0/1295369064 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c00e070 con 0x7fb21406fb20 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.422+0000 7fb2127fc700 1 -- 172.21.15.59:0/1295369064 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20c00b9c0 con 0x7fb21406fb20 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.422+0000 7fb2127fc700 1 -- 172.21.15.59:0/1295369064 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c00bd70 con 0x7fb21406fb20 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.422+0000 7fb219ca1700 1 -- 172.21.15.59:0/1295369064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb21406fb20 msgr2=0x7fb21406ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.422+0000 7fb219ca1700 1 --2- 172.21.15.59:0/1295369064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb21406fb20 0x7fb21406ffa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009e50 tx=0x7fb20c00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.422+0000 7fb219ca1700 1 -- 172.21.15.59:0/1295369064 shutdown_connections 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.422+0000 7fb219ca1700 1 --2- 172.21.15.59:0/1295369064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb21406fb20 0x7fb21406ffa0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.422+0000 7fb219ca1700 1 --2- 172.21.15.59:0/1295369064 >> v2:172.21.15.59:3300/0 conn(0x7fb214130540 0x7fb214130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.422+0000 7fb219ca1700 1 --2- 172.21.15.59:0/1295369064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb214130e50 0x7fb21406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.422+0000 7fb219ca1700 1 -- 172.21.15.59:0/1295369064 >> 172.21.15.59:0/1295369064 conn(0x7fb2140a2aa0 msgr2=0x7fb2140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.422+0000 7fb219ca1700 1 -- 172.21.15.59:0/1295369064 shutdown_connections 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.422+0000 7fb219ca1700 1 -- 172.21.15.59:0/1295369064 wait complete. 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.423+0000 7fb219ca1700 1 Processor -- start 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.423+0000 7fb219ca1700 1 -- start start 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb219ca1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb21406fb20 0x7fb21406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb219ca1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb214130540 0x7fb21406ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb219ca1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb214130e50 0x7fb21406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb219ca1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21411a560 con 0x7fb214130e50 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb219ca1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb214118e90 con 0x7fb214130540 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb219ca1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb214119440 con 0x7fb21406fb20 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb2137fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb21406fb20 0x7fb21406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb213fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb214130e50 0x7fb21406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb2137fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb21406fb20 0x7fb21406e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36064/0 (socket says 172.21.15.59:36064) 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb2137fe700 1 -- 172.21.15.59:0/2501283124 learned_addr learned my addr 172.21.15.59:0/2501283124 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb212ffd700 1 --2- 172.21.15.59:0/2501283124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb214130540 0x7fb21406ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb212ffd700 1 -- 172.21.15.59:0/2501283124 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb21406fb20 msgr2=0x7fb21406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb212ffd700 1 --2- 172.21.15.59:0/2501283124 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb21406fb20 0x7fb21406e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb212ffd700 1 -- 172.21.15.59:0/2501283124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb214130e50 msgr2=0x7fb21406ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb212ffd700 1 --2- 172.21.15.59:0/2501283124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb214130e50 0x7fb21406ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb212ffd700 1 -- 172.21.15.59:0/2501283124 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c009b30 con 0x7fb214130540 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb2137fe700 1 --2- 172.21.15.59:0/2501283124 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb21406fb20 0x7fb21406e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.424+0000 7fb213fff700 1 --2- 172.21.15.59:0/2501283124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb214130e50 0x7fb21406ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.425+0000 7fb212ffd700 1 --2- 172.21.15.59:0/2501283124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb214130540 0x7fb21406ea10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb20800c820 tx=0x7fb20800cb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.425+0000 7fb1fbfff700 1 -- 172.21.15.59:0/2501283124 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb208011800 con 0x7fb214130540 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.425+0000 7fb1fbfff700 1 -- 172.21.15.59:0/2501283124 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb208011960 con 0x7fb214130540 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.425+0000 7fb219ca1700 1 -- 172.21.15.59:0/2501283124 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb214071950 con 0x7fb214130540 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.425+0000 7fb1fbfff700 1 -- 172.21.15.59:0/2501283124 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb208011cf0 con 0x7fb214130540 2023-09-30T22:30:15.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.425+0000 7fb219ca1700 1 -- 172.21.15.59:0/2501283124 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb214119610 con 0x7fb214130540 2023-09-30T22:30:15.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.425+0000 7fb1fbfff700 1 -- 172.21.15.59:0/2501283124 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb208018360 con 0x7fb214130540 2023-09-30T22:30:15.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.426+0000 7fb1fbfff700 1 -- 172.21.15.59:0/2501283124 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb20803f3b0 con 0x7fb214130540 2023-09-30T22:30:15.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.426+0000 7fb219ca1700 1 -- 172.21.15.59:0/2501283124 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb214074ea0 con 0x7fb214130540 2023-09-30T22:30:15.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.431+0000 7fb1fbfff700 1 -- 172.21.15.59:0/2501283124 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2080218f0 con 0x7fb214130540 2023-09-30T22:30:15.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.632+0000 7fb219ca1700 1 -- 172.21.15.59:0/2501283124 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb2140718e0 con 0x7fb214130540 2023-09-30T22:30:15.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.632+0000 7fb1fbfff700 1 -- 172.21.15.59:0/2501283124 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb208021300 con 0x7fb214130540 2023-09-30T22:30:15.633 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.635+0000 7fb219ca1700 1 -- 172.21.15.59:0/2501283124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb214130540 msgr2=0x7fb21406ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.635+0000 7fb219ca1700 1 --2- 172.21.15.59:0/2501283124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb214130540 0x7fb21406ea10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb20800c820 tx=0x7fb20800cb30 comp rx=0 tx=0).stop 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.635+0000 7fb219ca1700 1 -- 172.21.15.59:0/2501283124 shutdown_connections 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.635+0000 7fb219ca1700 1 --2- 172.21.15.59:0/2501283124 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb21406fb20 0x7fb21406e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.635+0000 7fb219ca1700 1 --2- 172.21.15.59:0/2501283124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb214130e50 0x7fb21406ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.635+0000 7fb219ca1700 1 --2- 172.21.15.59:0/2501283124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb214130540 0x7fb21406ea10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.635+0000 7fb219ca1700 1 -- 172.21.15.59:0/2501283124 >> 172.21.15.59:0/2501283124 conn(0x7fb2140a2aa0 msgr2=0x7fb21412d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.635+0000 7fb219ca1700 1 -- 172.21.15.59:0/2501283124 shutdown_connections 2023-09-30T22:30:15.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.635+0000 7fb219ca1700 1 -- 172.21.15.59:0/2501283124 wait complete. 2023-09-30T22:30:15.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:15.668 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:15.713 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:15.762 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:15.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.809+0000 7fde535ef700 1 Processor -- start 2023-09-30T22:30:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.810+0000 7fde535ef700 1 -- start start 2023-09-30T22:30:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.810+0000 7fde535ef700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde4c09eca0 0x7fde4c135550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.810+0000 7fde535ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde4c135a90 0x7fde4c137e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.810+0000 7fde535ef700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4c070a50 con 0x7fde4c130560 2023-09-30T22:30:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.810+0000 7fde535ef700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4c0717d0 con 0x7fde4c09eca0 2023-09-30T22:30:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.810+0000 7fde535ef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c130340 con 0x7fde4c135a90 2023-09-30T22:30:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.811+0000 7fde50b8a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde4c09eca0 0x7fde4c135550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.811+0000 7fde51b8c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde4c135a90 0x7fde4c137e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.811+0000 7fde50b8a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde4c09eca0 0x7fde4c135550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48946/0 (socket says 172.21.15.59:48946) 2023-09-30T22:30:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.811+0000 7fde50b8a700 1 -- 172.21.15.59:0/103990339 learned_addr learned my addr 172.21.15.59:0/103990339 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.811+0000 7fde50b8a700 1 -- 172.21.15.59:0/103990339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde4c135a90 msgr2=0x7fde4c137e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.811+0000 7fde50b8a700 1 --2- 172.21.15.59:0/103990339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde4c135a90 0x7fde4c137e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.811+0000 7fde50b8a700 1 -- 172.21.15.59:0/103990339 >> v1:172.21.15.59:6789/0 conn(0x7fde4c130560 legacy=0x7fde4c130930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.811+0000 7fde50b8a700 1 -- 172.21.15.59:0/103990339 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c071060 con 0x7fde4c09eca0 2023-09-30T22:30:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.811+0000 7fde51b8c700 1 --2- 172.21.15.59:0/103990339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde4c135a90 0x7fde4c137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.811+0000 7fde50b8a700 1 --2- 172.21.15.59:0/103990339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde4c09eca0 0x7fde4c135550 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0098f0 tx=0x7fde3c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af748a1b5a7fd45 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.811+0000 7fde43fff700 1 -- 172.21.15.59:0/103990339 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c011830 con 0x7fde4c09eca0 2023-09-30T22:30:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.811+0000 7fde43fff700 1 -- 172.21.15.59:0/103990339 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c011990 con 0x7fde4c09eca0 2023-09-30T22:30:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.812+0000 7fde43fff700 1 -- 172.21.15.59:0/103990339 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c011d20 con 0x7fde4c09eca0 2023-09-30T22:30:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.812+0000 7fde535ef700 1 -- 172.21.15.59:0/103990339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde4c09eca0 msgr2=0x7fde4c135550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.812+0000 7fde535ef700 1 --2- 172.21.15.59:0/103990339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde4c09eca0 0x7fde4c135550 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0098f0 tx=0x7fde3c009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.812+0000 7fde535ef700 1 -- 172.21.15.59:0/103990339 shutdown_connections 2023-09-30T22:30:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.812+0000 7fde535ef700 1 --2- 172.21.15.59:0/103990339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde4c135a90 0x7fde4c137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.812+0000 7fde535ef700 1 --2- 172.21.15.59:0/103990339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde4c09eca0 0x7fde4c135550 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.812+0000 7fde535ef700 1 -- 172.21.15.59:0/103990339 >> 172.21.15.59:0/103990339 conn(0x7fde4c0a2aa0 msgr2=0x7fde4c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.812+0000 7fde535ef700 1 -- 172.21.15.59:0/103990339 shutdown_connections 2023-09-30T22:30:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.812+0000 7fde535ef700 1 -- 172.21.15.59:0/103990339 wait complete. 2023-09-30T22:30:15.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.813+0000 7fde535ef700 1 Processor -- start 2023-09-30T22:30:15.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.813+0000 7fde535ef700 1 -- start start 2023-09-30T22:30:15.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.814+0000 7fde535ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde4c09eca0 0x7fde4c118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.814+0000 7fde535ef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde4c130560 0x7fde4c119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.814+0000 7fde535ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde4c135a90 0x7fde4c119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.814+0000 7fde535ef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c11c1a0 con 0x7fde4c130560 2023-09-30T22:30:15.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.814+0000 7fde535ef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c12db90 con 0x7fde4c09eca0 2023-09-30T22:30:15.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.814+0000 7fde535ef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c11a940 con 0x7fde4c135a90 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.814+0000 7fde5138b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde4c09eca0 0x7fde4c118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.814+0000 7fde50b8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde4c130560 0x7fde4c119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.814+0000 7fde50b8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde4c130560 0x7fde4c119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48962/0 (socket says 172.21.15.59:48962) 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.814+0000 7fde5138b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde4c09eca0 0x7fde4c118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57562/0 (socket says 172.21.15.59:57562) 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.814+0000 7fde50b8a700 1 -- 172.21.15.59:0/3875816783 learned_addr learned my addr 172.21.15.59:0/3875816783 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.814+0000 7fde51b8c700 1 --2- 172.21.15.59:0/3875816783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde4c135a90 0x7fde4c119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.815+0000 7fde5138b700 1 -- 172.21.15.59:0/3875816783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde4c135a90 msgr2=0x7fde4c119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.815+0000 7fde5138b700 1 --2- 172.21.15.59:0/3875816783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde4c135a90 0x7fde4c119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.815+0000 7fde5138b700 1 -- 172.21.15.59:0/3875816783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde4c130560 msgr2=0x7fde4c119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.815+0000 7fde5138b700 1 --2- 172.21.15.59:0/3875816783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde4c130560 0x7fde4c119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.815+0000 7fde5138b700 1 -- 172.21.15.59:0/3875816783 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde44009a70 con 0x7fde4c09eca0 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.815+0000 7fde50b8a700 1 --2- 172.21.15.59:0/3875816783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde4c130560 0x7fde4c119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.815+0000 7fde51b8c700 1 --2- 172.21.15.59:0/3875816783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde4c135a90 0x7fde4c119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.815+0000 7fde5138b700 1 --2- 172.21.15.59:0/3875816783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde4c09eca0 0x7fde4c118cd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fde48000f60 tx=0x7fde4800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.815+0000 7fde41ffb700 1 -- 172.21.15.59:0/3875816783 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480052d0 con 0x7fde4c09eca0 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.815+0000 7fde41ffb700 1 -- 172.21.15.59:0/3875816783 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde48005430 con 0x7fde4c09eca0 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.815+0000 7fde535ef700 1 -- 172.21.15.59:0/3875816783 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3c009550 con 0x7fde4c09eca0 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.815+0000 7fde41ffb700 1 -- 172.21.15.59:0/3875816783 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480038c0 con 0x7fde4c09eca0 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.815+0000 7fde535ef700 1 -- 172.21.15.59:0/3875816783 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4c11ced0 con 0x7fde4c09eca0 2023-09-30T22:30:15.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.816+0000 7fde41ffb700 1 -- 172.21.15.59:0/3875816783 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde48003a20 con 0x7fde4c09eca0 2023-09-30T22:30:15.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.816+0000 7fde41ffb700 1 -- 172.21.15.59:0/3875816783 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fde4803e970 con 0x7fde4c09eca0 2023-09-30T22:30:15.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.817+0000 7fde535ef700 1 -- 172.21.15.59:0/3875816783 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde4c074ea0 con 0x7fde4c09eca0 2023-09-30T22:30:15.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.822+0000 7fde41ffb700 1 -- 172.21.15.59:0/3875816783 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde48017080 con 0x7fde4c09eca0 2023-09-30T22:30:15.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.855+0000 7f7f1553c700 1 Processor -- start 2023-09-30T22:30:15.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.855+0000 7f7f1553c700 1 -- start start 2023-09-30T22:30:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.856+0000 7f7f1553c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7f100a0a30 0x7f7f100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.856+0000 7f7f1553c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f10138d80 0x7f7f1013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.856+0000 7f7f1553c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f100a2a70 con 0x7f7f1009d630 2023-09-30T22:30:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.856+0000 7f7f1553c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f100a01d0 con 0x7f7f100a0a30 2023-09-30T22:30:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.856+0000 7f7f1553c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1009e2b0 con 0x7f7f10138d80 2023-09-30T22:30:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.856+0000 7f7f0f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f10138d80 0x7f7f1013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.856+0000 7f7f0effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7f100a0a30 0x7f7f100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.856+0000 7f7f0effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7f100a0a30 0x7f7f100a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48966/0 (socket says 172.21.15.59:48966) 2023-09-30T22:30:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.856+0000 7f7f0f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f10138d80 0x7f7f1013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36106/0 (socket says 172.21.15.59:36106) 2023-09-30T22:30:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.856+0000 7f7f0effd700 1 -- 172.21.15.59:0/1930790561 learned_addr learned my addr 172.21.15.59:0/1930790561 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.856+0000 7f7f0effd700 1 -- 172.21.15.59:0/1930790561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f10138d80 msgr2=0x7f7f1013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.856+0000 7f7f0effd700 1 --2- 172.21.15.59:0/1930790561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f10138d80 0x7f7f1013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.856+0000 7f7f0effd700 1 -- 172.21.15.59:0/1930790561 >> v1:172.21.15.59:6789/0 conn(0x7f7f1009d630 legacy=0x7f7f100a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.857+0000 7f7f0effd700 1 -- 172.21.15.59:0/1930790561 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1009dc50 con 0x7f7f100a0a30 2023-09-30T22:30:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.857+0000 7f7f0f7fe700 1 --2- 172.21.15.59:0/1930790561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f10138d80 0x7f7f1013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.857+0000 7f7f0effd700 1 --2- 172.21.15.59:0/1930790561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f100a0a30 0x7f7f100a0e00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7f000098f0 tx=0x7f7f00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3136a6d93168736 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.857+0000 7f7f0dffb700 1 -- 172.21.15.59:0/1930790561 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00011830 con 0x7f7f100a0a30 2023-09-30T22:30:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.857+0000 7f7f0dffb700 1 -- 172.21.15.59:0/1930790561 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f00011990 con 0x7f7f100a0a30 2023-09-30T22:30:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.857+0000 7f7f0dffb700 1 -- 172.21.15.59:0/1930790561 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00011d20 con 0x7f7f100a0a30 2023-09-30T22:30:15.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.858+0000 7f7f1553c700 1 -- 172.21.15.59:0/1930790561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f100a0a30 msgr2=0x7f7f100a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.858+0000 7f7f1553c700 1 --2- 172.21.15.59:0/1930790561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f100a0a30 0x7f7f100a0e00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7f000098f0 tx=0x7f7f00009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:15.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.858+0000 7f7f1553c700 1 -- 172.21.15.59:0/1930790561 shutdown_connections 2023-09-30T22:30:15.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.858+0000 7f7f1553c700 1 --2- 172.21.15.59:0/1930790561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f10138d80 0x7f7f1013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.858+0000 7f7f1553c700 1 --2- 172.21.15.59:0/1930790561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f100a0a30 0x7f7f100a0e00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.858+0000 7f7f1553c700 1 -- 172.21.15.59:0/1930790561 >> 172.21.15.59:0/1930790561 conn(0x7f7f100a3050 msgr2=0x7f7f100a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:15.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.858+0000 7f7f1553c700 1 -- 172.21.15.59:0/1930790561 shutdown_connections 2023-09-30T22:30:15.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.858+0000 7f7f1553c700 1 -- 172.21.15.59:0/1930790561 wait complete. 2023-09-30T22:30:15.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.860+0000 7f7f1553c700 1 Processor -- start 2023-09-30T22:30:15.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.860+0000 7f7f1553c700 1 -- start start 2023-09-30T22:30:15.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.860+0000 7f7f1553c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f1009d630 0x7f7f10120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.860+0000 7f7f1553c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f100a0a30 0x7f7f10120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.860+0000 7f7f1553c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f10138d80 0x7f7f10121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.860+0000 7f7f1553c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10123110 con 0x7f7f10138d80 2023-09-30T22:30:15.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.860+0000 7f7f1553c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10122be0 con 0x7f7f1009d630 2023-09-30T22:30:15.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.860+0000 7f7f1553c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10122310 con 0x7f7f100a0a30 2023-09-30T22:30:15.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.860+0000 7f7f0effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f1009d630 0x7f7f10120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.860+0000 7f7f0effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f1009d630 0x7f7f10120700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57576/0 (socket says 172.21.15.59:57576) 2023-09-30T22:30:15.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.860+0000 7f7f0effd700 1 -- 172.21.15.59:0/1339762247 learned_addr learned my addr 172.21.15.59:0/1339762247 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:15.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.860+0000 7f7f0e7fc700 1 --2- 172.21.15.59:0/1339762247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f100a0a30 0x7f7f10120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.860+0000 7f7f0f7fe700 1 --2- 172.21.15.59:0/1339762247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f10138d80 0x7f7f10121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.861+0000 7f7f0effd700 1 -- 172.21.15.59:0/1339762247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f100a0a30 msgr2=0x7f7f10120c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.861+0000 7f7f0effd700 1 --2- 172.21.15.59:0/1339762247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f100a0a30 0x7f7f10120c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.861+0000 7f7f0effd700 1 -- 172.21.15.59:0/1339762247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f10138d80 msgr2=0x7f7f10121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.861+0000 7f7f0effd700 1 --2- 172.21.15.59:0/1339762247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f10138d80 0x7f7f10121180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.861+0000 7f7f0effd700 1 -- 172.21.15.59:0/1339762247 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f08009a70 con 0x7f7f1009d630 2023-09-30T22:30:15.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.861+0000 7f7f0f7fe700 1 --2- 172.21.15.59:0/1339762247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f10138d80 0x7f7f10121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:15.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.861+0000 7f7f0effd700 1 --2- 172.21.15.59:0/1339762247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f1009d630 0x7f7f10120700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009c40 tx=0x7f7f00004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:15.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.861+0000 7f7ef77fe700 1 -- 172.21.15.59:0/1339762247 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00004480 con 0x7f7f1009d630 2023-09-30T22:30:15.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.861+0000 7f7ef77fe700 1 -- 172.21.15.59:0/1339762247 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0001f070 con 0x7f7f1009d630 2023-09-30T22:30:15.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.861+0000 7f7ef77fe700 1 -- 172.21.15.59:0/1339762247 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f000038c0 con 0x7f7f1009d630 2023-09-30T22:30:15.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.861+0000 7f7f1553c700 1 -- 172.21.15.59:0/1339762247 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f00009550 con 0x7f7f1009d630 2023-09-30T22:30:15.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.861+0000 7f7f1553c700 1 -- 172.21.15.59:0/1339762247 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f100a4ec0 con 0x7f7f1009d630 2023-09-30T22:30:15.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.862+0000 7f7f1553c700 1 -- 172.21.15.59:0/1339762247 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f100a0410 con 0x7f7f1009d630 2023-09-30T22:30:15.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.862+0000 7f7ef77fe700 1 -- 172.21.15.59:0/1339762247 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f00021030 con 0x7f7f1009d630 2023-09-30T22:30:15.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.863+0000 7f7ef77fe700 1 -- 172.21.15.59:0/1339762247 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7f000409d0 con 0x7f7f1009d630 2023-09-30T22:30:15.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.867+0000 7f7ef77fe700 1 -- 172.21.15.59:0/1339762247 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f00003a20 con 0x7f7f1009d630 2023-09-30T22:30:15.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.905+0000 7faf3471c700 1 Processor -- start 2023-09-30T22:30:15.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.905+0000 7faf3471c700 1 -- start start 2023-09-30T22:30:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.906+0000 7faf3471c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf2c09d630 0x7faf2c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.906+0000 7faf3471c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf2c138d80 0x7faf2c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.906+0000 7faf3471c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2c0a2a70 con 0x7faf2c0a0a30 2023-09-30T22:30:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.906+0000 7faf3471c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2c0a01d0 con 0x7faf2c09d630 2023-09-30T22:30:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.906+0000 7faf3471c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c09e2b0 con 0x7faf2c138d80 2023-09-30T22:30:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.906+0000 7faf31cb7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf2c09d630 0x7faf2c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.906+0000 7faf32cb9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf2c138d80 0x7faf2c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.906+0000 7faf31cb7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf2c09d630 0x7faf2c0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48982/0 (socket says 172.21.15.59:48982) 2023-09-30T22:30:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.906+0000 7faf31cb7700 1 -- 172.21.15.59:0/2784292859 learned_addr learned my addr 172.21.15.59:0/2784292859 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.906+0000 7faf31cb7700 1 -- 172.21.15.59:0/2784292859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf2c138d80 msgr2=0x7faf2c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.906+0000 7faf31cb7700 1 --2- 172.21.15.59:0/2784292859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf2c138d80 0x7faf2c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.906+0000 7faf31cb7700 1 -- 172.21.15.59:0/2784292859 >> v1:172.21.15.59:6789/0 conn(0x7faf2c0a0a30 legacy=0x7faf2c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.906+0000 7faf31cb7700 1 -- 172.21.15.59:0/2784292859 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c09dc50 con 0x7faf2c09d630 2023-09-30T22:30:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.907+0000 7faf31cb7700 1 --2- 172.21.15.59:0/2784292859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c09d630 0x7faf2c0a1510 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0098f0 tx=0x7faf1c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc84cb1c72708ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.907+0000 7faf314b6700 1 -- 172.21.15.59:0/2784292859 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c011830 con 0x7faf2c09d630 2023-09-30T22:30:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.907+0000 7faf314b6700 1 -- 172.21.15.59:0/2784292859 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c011990 con 0x7faf2c09d630 2023-09-30T22:30:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.907+0000 7faf314b6700 1 -- 172.21.15.59:0/2784292859 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c011d20 con 0x7faf2c09d630 2023-09-30T22:30:15.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.907+0000 7faf3471c700 1 -- 172.21.15.59:0/2784292859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c09d630 msgr2=0x7faf2c0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.907+0000 7faf3471c700 1 --2- 172.21.15.59:0/2784292859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c09d630 0x7faf2c0a1510 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0098f0 tx=0x7faf1c009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:15.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.908+0000 7faf3471c700 1 -- 172.21.15.59:0/2784292859 shutdown_connections 2023-09-30T22:30:15.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.908+0000 7faf3471c700 1 --2- 172.21.15.59:0/2784292859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf2c138d80 0x7faf2c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.908+0000 7faf3471c700 1 --2- 172.21.15.59:0/2784292859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c09d630 0x7faf2c0a1510 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.908+0000 7faf3471c700 1 -- 172.21.15.59:0/2784292859 >> 172.21.15.59:0/2784292859 conn(0x7faf2c0a3050 msgr2=0x7faf2c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:15.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.908+0000 7faf3471c700 1 -- 172.21.15.59:0/2784292859 shutdown_connections 2023-09-30T22:30:15.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.908+0000 7faf3471c700 1 -- 172.21.15.59:0/2784292859 wait complete. 2023-09-30T22:30:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.909+0000 7faf3471c700 1 Processor -- start 2023-09-30T22:30:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.909+0000 7faf3471c700 1 -- start start 2023-09-30T22:30:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.909+0000 7faf3471c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf2c09d630 0x7faf2c120800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.909+0000 7faf3471c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c0a0a30 0x7faf2c120d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.909+0000 7faf3471c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf2c138d80 0x7faf2c121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.909+0000 7faf3471c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c123fb0 con 0x7faf2c0a0a30 2023-09-30T22:30:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.909+0000 7faf3471c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0a4e00 con 0x7faf2c09d630 2023-09-30T22:30:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.909+0000 7faf3471c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0a0410 con 0x7faf2c138d80 2023-09-30T22:30:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.909+0000 7faf31cb7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c0a0a30 0x7faf2c120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.909+0000 7faf31cb7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c0a0a30 0x7faf2c120d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48992/0 (socket says 172.21.15.59:48992) 2023-09-30T22:30:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.909+0000 7faf31cb7700 1 -- 172.21.15.59:0/3169568584 learned_addr learned my addr 172.21.15.59:0/3169568584 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.909+0000 7faf32cb9700 1 --2- 172.21.15.59:0/3169568584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf2c138d80 0x7faf2c121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.910+0000 7faf324b8700 1 --2- 172.21.15.59:0/3169568584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf2c09d630 0x7faf2c120800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.910+0000 7faf31cb7700 1 -- 172.21.15.59:0/3169568584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf2c138d80 msgr2=0x7faf2c121280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.910+0000 7faf31cb7700 1 --2- 172.21.15.59:0/3169568584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf2c138d80 0x7faf2c121280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.910+0000 7faf31cb7700 1 -- 172.21.15.59:0/3169568584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf2c09d630 msgr2=0x7faf2c120800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.910+0000 7faf31cb7700 1 --2- 172.21.15.59:0/3169568584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf2c09d630 0x7faf2c120800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.910+0000 7faf31cb7700 1 -- 172.21.15.59:0/3169568584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c009550 con 0x7faf2c0a0a30 2023-09-30T22:30:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.910+0000 7faf324b8700 1 --2- 172.21.15.59:0/3169568584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf2c09d630 0x7faf2c120800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.910+0000 7faf31cb7700 1 --2- 172.21.15.59:0/3169568584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c0a0a30 0x7faf2c120d40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faf1c000c00 tx=0x7faf1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.910+0000 7faf22ffd700 1 -- 172.21.15.59:0/3169568584 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0036a0 con 0x7faf2c0a0a30 2023-09-30T22:30:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.910+0000 7faf22ffd700 1 -- 172.21.15.59:0/3169568584 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c003800 con 0x7faf2c0a0a30 2023-09-30T22:30:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.910+0000 7faf3471c700 1 -- 172.21.15.59:0/3169568584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2c122b70 con 0x7faf2c0a0a30 2023-09-30T22:30:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.910+0000 7faf22ffd700 1 -- 172.21.15.59:0/3169568584 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c003bd0 con 0x7faf2c0a0a30 2023-09-30T22:30:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.910+0000 7faf3471c700 1 -- 172.21.15.59:0/3169568584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c124290 con 0x7faf2c0a0a30 2023-09-30T22:30:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.911+0000 7faf22ffd700 1 -- 172.21.15.59:0/3169568584 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf1c021070 con 0x7faf2c0a0a30 2023-09-30T22:30:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.911+0000 7faf22ffd700 1 -- 172.21.15.59:0/3169568584 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faf1c040bd0 con 0x7faf2c0a0a30 2023-09-30T22:30:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.911+0000 7faf3471c700 1 -- 172.21.15.59:0/3169568584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c0747f0 con 0x7faf2c0a0a30 2023-09-30T22:30:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:15.916+0000 7faf22ffd700 1 -- 172.21.15.59:0/3169568584 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf1c015080 con 0x7faf2c0a0a30 2023-09-30T22:30:16.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.033+0000 7fde535ef700 1 -- 172.21.15.59:0/3875816783 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fde4c06b9e0 con 0x7fde4c09eca0 2023-09-30T22:30:16.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.033+0000 7fde41ffb700 1 -- 172.21.15.59:0/3875816783 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde48011590 con 0x7fde4c09eca0 2023-09-30T22:30:16.035 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.037+0000 7fde535ef700 1 -- 172.21.15.59:0/3875816783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde4c09eca0 msgr2=0x7fde4c118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.037+0000 7fde535ef700 1 --2- 172.21.15.59:0/3875816783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde4c09eca0 0x7fde4c118cd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fde48000f60 tx=0x7fde4800c730 comp rx=0 tx=0).stop 2023-09-30T22:30:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.037+0000 7fde535ef700 1 -- 172.21.15.59:0/3875816783 shutdown_connections 2023-09-30T22:30:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.037+0000 7fde535ef700 1 --2- 172.21.15.59:0/3875816783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde4c135a90 0x7fde4c119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.037+0000 7fde535ef700 1 --2- 172.21.15.59:0/3875816783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde4c09eca0 0x7fde4c118cd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.037+0000 7fde535ef700 1 --2- 172.21.15.59:0/3875816783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde4c130560 0x7fde4c119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.037+0000 7fde535ef700 1 -- 172.21.15.59:0/3875816783 >> 172.21.15.59:0/3875816783 conn(0x7fde4c0a2aa0 msgr2=0x7fde4c12e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.037+0000 7fde535ef700 1 -- 172.21.15.59:0/3875816783 shutdown_connections 2023-09-30T22:30:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.037+0000 7fde535ef700 1 -- 172.21.15.59:0/3875816783 wait complete. 2023-09-30T22:30:16.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:16.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.075+0000 7f7f1553c700 1 -- 172.21.15.59:0/1339762247 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7f100747f0 con 0x7f7f1009d630 2023-09-30T22:30:16.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.076+0000 7f7ef77fe700 1 -- 172.21.15.59:0/1339762247 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f00015030 con 0x7f7f1009d630 2023-09-30T22:30:16.077 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:16.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.078+0000 7f7f1553c700 1 -- 172.21.15.59:0/1339762247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f1009d630 msgr2=0x7f7f10120700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.078+0000 7f7f1553c700 1 --2- 172.21.15.59:0/1339762247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f1009d630 0x7f7f10120700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009c40 tx=0x7f7f00004750 comp rx=0 tx=0).stop 2023-09-30T22:30:16.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.078+0000 7f7f1553c700 1 -- 172.21.15.59:0/1339762247 shutdown_connections 2023-09-30T22:30:16.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.078+0000 7f7f1553c700 1 --2- 172.21.15.59:0/1339762247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f10138d80 0x7f7f10121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.078+0000 7f7f1553c700 1 --2- 172.21.15.59:0/1339762247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f1009d630 0x7f7f10120700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.078+0000 7f7f1553c700 1 --2- 172.21.15.59:0/1339762247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f100a0a30 0x7f7f10120c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.078+0000 7f7f1553c700 1 -- 172.21.15.59:0/1339762247 >> 172.21.15.59:0/1339762247 conn(0x7f7f100a3050 msgr2=0x7f7f1009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:16.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.078+0000 7f7f1553c700 1 -- 172.21.15.59:0/1339762247 shutdown_connections 2023-09-30T22:30:16.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.078+0000 7f7f1553c700 1 -- 172.21.15.59:0/1339762247 wait complete. 2023-09-30T22:30:16.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:16.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.130+0000 7faf3471c700 1 -- 172.21.15.59:0/3169568584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faf2c072980 con 0x7faf2c0a0a30 2023-09-30T22:30:16.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.131+0000 7faf22ffd700 1 -- 172.21.15.59:0/3169568584 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf1c029020 con 0x7faf2c0a0a30 2023-09-30T22:30:16.132 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:16.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.133+0000 7faf3471c700 1 -- 172.21.15.59:0/3169568584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c0a0a30 msgr2=0x7faf2c120d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.133+0000 7faf3471c700 1 --2- 172.21.15.59:0/3169568584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c0a0a30 0x7faf2c120d40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faf1c000c00 tx=0x7faf1c004750 comp rx=0 tx=0).stop 2023-09-30T22:30:16.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.133+0000 7faf3471c700 1 -- 172.21.15.59:0/3169568584 shutdown_connections 2023-09-30T22:30:16.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.133+0000 7faf3471c700 1 --2- 172.21.15.59:0/3169568584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf2c138d80 0x7faf2c121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.133+0000 7faf3471c700 1 --2- 172.21.15.59:0/3169568584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf2c09d630 0x7faf2c120800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.133+0000 7faf3471c700 1 --2- 172.21.15.59:0/3169568584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf2c0a0a30 0x7faf2c120d40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.133+0000 7faf3471c700 1 -- 172.21.15.59:0/3169568584 >> 172.21.15.59:0/3169568584 conn(0x7faf2c0a3050 msgr2=0x7faf2c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:16.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.133+0000 7faf3471c700 1 -- 172.21.15.59:0/3169568584 shutdown_connections 2023-09-30T22:30:16.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.133+0000 7faf3471c700 1 -- 172.21.15.59:0/3169568584 wait complete. 2023-09-30T22:30:16.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:16.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.795+0000 7fbdee92d700 1 Processor -- start 2023-09-30T22:30:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.795+0000 7fbdee92d700 1 -- start start 2023-09-30T22:30:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.795+0000 7fbdee92d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde809d6f0 0x7fbde809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.795+0000 7fbdee92d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbde809e410 0x7fbde8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.795+0000 7fbdee92d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde809f130 con 0x7fbde809e000 2023-09-30T22:30:16.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.795+0000 7fbdee92d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde809f520 con 0x7fbde809e410 2023-09-30T22:30:16.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.795+0000 7fbdee92d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde809e930 con 0x7fbde809d6f0 2023-09-30T22:30:16.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.795+0000 7fbde7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde809d6f0 0x7fbde809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.795+0000 7fbdececa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbde809e410 0x7fbde8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.796+0000 7fbde7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde809d6f0 0x7fbde809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57602/0 (socket says 172.21.15.59:57602) 2023-09-30T22:30:16.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.796+0000 7fbde7fff700 1 -- 172.21.15.59:0/968059835 learned_addr learned my addr 172.21.15.59:0/968059835 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:16.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.796+0000 7fbdececa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbde809e410 0x7fbde8130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49006/0 (socket says 172.21.15.59:49006) 2023-09-30T22:30:16.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.796+0000 7fbde7fff700 1 -- 172.21.15.59:0/968059835 >> v2:172.21.15.59:3300/0 conn(0x7fbde809e410 msgr2=0x7fbde8130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:16.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.796+0000 7fbde7fff700 1 --2- 172.21.15.59:0/968059835 >> v2:172.21.15.59:3300/0 conn(0x7fbde809e410 0x7fbde8130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.796+0000 7fbde7fff700 1 -- 172.21.15.59:0/968059835 >> v1:172.21.15.59:6789/0 conn(0x7fbde809e000 legacy=0x7fbde8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.796+0000 7fbde7fff700 1 -- 172.21.15.59:0/968059835 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde809b2d0 con 0x7fbde809d6f0 2023-09-30T22:30:16.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.796+0000 7fbdececa700 1 --2- 172.21.15.59:0/968059835 >> v2:172.21.15.59:3300/0 conn(0x7fbde809e410 0x7fbde8130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:16.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.796+0000 7fbde7fff700 1 --2- 172.21.15.59:0/968059835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde809d6f0 0x7fbde809dac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80098f0 tx=0x7fbdd8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d056afd8951fb7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:16.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.796+0000 7fbde6ffd700 1 -- 172.21.15.59:0/968059835 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8011830 con 0x7fbde809d6f0 2023-09-30T22:30:16.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.796+0000 7fbde6ffd700 1 -- 172.21.15.59:0/968059835 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd8011990 con 0x7fbde809d6f0 2023-09-30T22:30:16.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.796+0000 7fbde6ffd700 1 -- 172.21.15.59:0/968059835 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8011d20 con 0x7fbde809d6f0 2023-09-30T22:30:16.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.797+0000 7fbdee92d700 1 -- 172.21.15.59:0/968059835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde809d6f0 msgr2=0x7fbde809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.797+0000 7fbdee92d700 1 --2- 172.21.15.59:0/968059835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde809d6f0 0x7fbde809dac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80098f0 tx=0x7fbdd8009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:16.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.797+0000 7fbdee92d700 1 -- 172.21.15.59:0/968059835 shutdown_connections 2023-09-30T22:30:16.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.797+0000 7fbdee92d700 1 --2- 172.21.15.59:0/968059835 >> v2:172.21.15.59:3300/0 conn(0x7fbde809e410 0x7fbde8130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.797+0000 7fbdee92d700 1 --2- 172.21.15.59:0/968059835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde809d6f0 0x7fbde809dac0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.797+0000 7fbdee92d700 1 -- 172.21.15.59:0/968059835 >> 172.21.15.59:0/968059835 conn(0x7fbde8066f50 msgr2=0x7fbde809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:16.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.797+0000 7fbdee92d700 1 -- 172.21.15.59:0/968059835 shutdown_connections 2023-09-30T22:30:16.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.797+0000 7fbdee92d700 1 -- 172.21.15.59:0/968059835 wait complete. 2023-09-30T22:30:16.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.798+0000 7fbdee92d700 1 Processor -- start 2023-09-30T22:30:16.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.798+0000 7fbdee92d700 1 -- start start 2023-09-30T22:30:16.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbdee92d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde809d6f0 0x7fbde81c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbdee92d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde809e000 0x7fbde81c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbdee92d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbde809e410 0x7fbde81c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbdee92d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde81205b0 con 0x7fbde809d6f0 2023-09-30T22:30:16.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbdee92d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde8126b00 con 0x7fbde809e000 2023-09-30T22:30:16.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbdee92d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbde8126190 con 0x7fbde809e410 2023-09-30T22:30:16.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbde7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde809d6f0 0x7fbde81c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbde77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde809e000 0x7fbde81c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbde7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde809d6f0 0x7fbde81c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49018/0 (socket says 172.21.15.59:49018) 2023-09-30T22:30:16.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbde7fff700 1 -- 172.21.15.59:0/2089914947 learned_addr learned my addr 172.21.15.59:0/2089914947 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:16.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbdececa700 1 --2- 172.21.15.59:0/2089914947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbde809e410 0x7fbde81c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbde7fff700 1 -- 172.21.15.59:0/2089914947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbde809e410 msgr2=0x7fbde81c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbde7fff700 1 --2- 172.21.15.59:0/2089914947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbde809e410 0x7fbde81c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbde7fff700 1 -- 172.21.15.59:0/2089914947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde809e000 msgr2=0x7fbde81c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbde7fff700 1 --2- 172.21.15.59:0/2089914947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde809e000 0x7fbde81c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbde7fff700 1 -- 172.21.15.59:0/2089914947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde0009a70 con 0x7fbde809d6f0 2023-09-30T22:30:16.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbde77fe700 1 --2- 172.21.15.59:0/2089914947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde809e000 0x7fbde81c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:16.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbde7fff700 1 --2- 172.21.15.59:0/2089914947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde809d6f0 0x7fbde81c8610 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8009c40 tx=0x7fbdd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:16.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.799+0000 7fbde4ff9700 1 -- 172.21.15.59:0/2089914947 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8004510 con 0x7fbde809d6f0 2023-09-30T22:30:16.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.800+0000 7fbde4ff9700 1 -- 172.21.15.59:0/2089914947 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd801e070 con 0x7fbde809d6f0 2023-09-30T22:30:16.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.800+0000 7fbdee92d700 1 -- 172.21.15.59:0/2089914947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd8009550 con 0x7fbde809d6f0 2023-09-30T22:30:16.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.800+0000 7fbde4ff9700 1 -- 172.21.15.59:0/2089914947 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd80038e0 con 0x7fbde809d6f0 2023-09-30T22:30:16.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.800+0000 7fbdee92d700 1 -- 172.21.15.59:0/2089914947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde81212a0 con 0x7fbde809d6f0 2023-09-30T22:30:16.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.800+0000 7fbde4ff9700 1 -- 172.21.15.59:0/2089914947 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbdd8003a40 con 0x7fbde809d6f0 2023-09-30T22:30:16.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.801+0000 7fbde4ff9700 1 -- 172.21.15.59:0/2089914947 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbdd80405a0 con 0x7fbde809d6f0 2023-09-30T22:30:16.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.801+0000 7fbdee92d700 1 -- 172.21.15.59:0/2089914947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde8074ea0 con 0x7fbde809d6f0 2023-09-30T22:30:16.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:16.806+0000 7fbde4ff9700 1 -- 172.21.15.59:0/2089914947 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdd8015020 con 0x7fbde809d6f0 2023-09-30T22:30:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.007+0000 7fbdee92d700 1 -- 172.21.15.59:0/2089914947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbde80a36b0 con 0x7fbde809d6f0 2023-09-30T22:30:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.008+0000 7fbde4ff9700 1 -- 172.21.15.59:0/2089914947 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdd802d7d0 con 0x7fbde809d6f0 2023-09-30T22:30:17.009 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:17.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.011+0000 7fbdee92d700 1 -- 172.21.15.59:0/2089914947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde809d6f0 msgr2=0x7fbde81c8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.011+0000 7fbdee92d700 1 --2- 172.21.15.59:0/2089914947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde809d6f0 0x7fbde81c8610 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8009c40 tx=0x7fbdd8004750 comp rx=0 tx=0).stop 2023-09-30T22:30:17.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.011+0000 7fbdee92d700 1 -- 172.21.15.59:0/2089914947 shutdown_connections 2023-09-30T22:30:17.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.011+0000 7fbdee92d700 1 --2- 172.21.15.59:0/2089914947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbde809e410 0x7fbde81c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.011+0000 7fbdee92d700 1 --2- 172.21.15.59:0/2089914947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde809d6f0 0x7fbde81c8610 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.011+0000 7fbdee92d700 1 --2- 172.21.15.59:0/2089914947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde809e000 0x7fbde81c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.011+0000 7fbdee92d700 1 -- 172.21.15.59:0/2089914947 >> 172.21.15.59:0/2089914947 conn(0x7fbde8066f50 msgr2=0x7fbde80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:17.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.011+0000 7fbdee92d700 1 -- 172.21.15.59:0/2089914947 shutdown_connections 2023-09-30T22:30:17.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.011+0000 7fbdee92d700 1 -- 172.21.15.59:0/2089914947 wait complete. 2023-09-30T22:30:17.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:17.058 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:17.094 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:17.148 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:17.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.201+0000 7fe3bbe21700 1 Processor -- start 2023-09-30T22:30:17.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.201+0000 7fe3bbe21700 1 -- start start 2023-09-30T22:30:17.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.202+0000 7fe3bbe21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3b4133420 0x7fe3b41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.202+0000 7fe3bbe21700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3b4134260 0x7fe3b41306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.202+0000 7fe3bbe21700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b406b990 con 0x7fe3b4133e30 2023-09-30T22:30:17.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.202+0000 7fe3bbe21700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b40a0590 con 0x7fe3b4133420 2023-09-30T22:30:17.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.202+0000 7fe3bbe21700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b409fb80 con 0x7fe3b4134260 2023-09-30T22:30:17.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.202+0000 7fe3b93bc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe3b4133e30 0x7fe3b412ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39690/0 (socket says 172.21.15.59:39690) 2023-09-30T22:30:17.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.202+0000 7fe3b93bc700 1 -- 172.21.15.59:0/1874522076 learned_addr learned my addr 172.21.15.59:0/1874522076 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:17.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.202+0000 7fe3b9bbd700 1 --2- 172.21.15.59:0/1874522076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3b4133420 0x7fe3b41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.202+0000 7fe3ba3be700 1 --2- 172.21.15.59:0/1874522076 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3b4134260 0x7fe3b41306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.203+0000 7fe3b8bbb700 1 -- 172.21.15.59:0/1874522076 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270269460 0 0) 0x7fe3b406b990 con 0x7fe3b4133e30 2023-09-30T22:30:17.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.203+0000 7fe3b8bbb700 1 -- 172.21.15.59:0/1874522076 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3a00035b0 con 0x7fe3b4133e30 2023-09-30T22:30:17.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.203+0000 7fe3ba3be700 1 -- 172.21.15.59:0/1874522076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3b4133420 msgr2=0x7fe3b41337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:17.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.203+0000 7fe3ba3be700 1 --2- 172.21.15.59:0/1874522076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3b4133420 0x7fe3b41337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.203+0000 7fe3ba3be700 1 -- 172.21.15.59:0/1874522076 >> v1:172.21.15.59:6789/0 conn(0x7fe3b4133e30 legacy=0x7fe3b412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.203+0000 7fe3ba3be700 1 -- 172.21.15.59:0/1874522076 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b40a0030 con 0x7fe3b4134260 2023-09-30T22:30:17.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.203+0000 7fe3b9bbd700 1 --2- 172.21.15.59:0/1874522076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3b4133420 0x7fe3b41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:17.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.203+0000 7fe3ba3be700 1 --2- 172.21.15.59:0/1874522076 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3b4134260 0x7fe3b41306a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009dc0 tx=0x7fe3ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1ffd7d3df69a9a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:17.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.203+0000 7fe3b8bbb700 1 -- 172.21.15.59:0/1874522076 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac00e070 con 0x7fe3b4134260 2023-09-30T22:30:17.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.203+0000 7fe3b8bbb700 1 -- 172.21.15.59:0/1874522076 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac00bb20 con 0x7fe3b4134260 2023-09-30T22:30:17.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.203+0000 7fe3b8bbb700 1 -- 172.21.15.59:0/1874522076 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac012430 con 0x7fe3b4134260 2023-09-30T22:30:17.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.204+0000 7fe3bbe21700 1 -- 172.21.15.59:0/1874522076 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3b4134260 msgr2=0x7fe3b41306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.204+0000 7fe3bbe21700 1 --2- 172.21.15.59:0/1874522076 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3b4134260 0x7fe3b41306a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009dc0 tx=0x7fe3ac00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:17.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.204+0000 7fe3bbe21700 1 -- 172.21.15.59:0/1874522076 shutdown_connections 2023-09-30T22:30:17.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.204+0000 7fe3bbe21700 1 --2- 172.21.15.59:0/1874522076 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3b4134260 0x7fe3b41306a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.204+0000 7fe3bbe21700 1 --2- 172.21.15.59:0/1874522076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3b4133420 0x7fe3b41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.204+0000 7fe3bbe21700 1 -- 172.21.15.59:0/1874522076 >> 172.21.15.59:0/1874522076 conn(0x7fe3b40a4210 msgr2=0x7fe3b40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:17.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.204+0000 7fe3bbe21700 1 -- 172.21.15.59:0/1874522076 shutdown_connections 2023-09-30T22:30:17.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.204+0000 7fe3bbe21700 1 -- 172.21.15.59:0/1874522076 wait complete. 2023-09-30T22:30:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.205+0000 7fe3bbe21700 1 Processor -- start 2023-09-30T22:30:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.205+0000 7fe3bbe21700 1 -- start start 2023-09-30T22:30:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.206+0000 7fe3bbe21700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3b4133420 0x7fe3b409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.206+0000 7fe3bbe21700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3b4133e30 0x7fe3b409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.206+0000 7fe3bbe21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3b4134260 0x7fe3b409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.206+0000 7fe3bbe21700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b411eb90 con 0x7fe3b4133420 2023-09-30T22:30:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.206+0000 7fe3bbe21700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b4120680 con 0x7fe3b4134260 2023-09-30T22:30:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.206+0000 7fe3bbe21700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b411fab0 con 0x7fe3b4133e30 2023-09-30T22:30:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.206+0000 7fe3b93bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3b4133e30 0x7fe3b409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.206+0000 7fe3b93bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3b4133e30 0x7fe3b409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36152/0 (socket says 172.21.15.59:36152) 2023-09-30T22:30:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.206+0000 7fe3b93bc700 1 -- 172.21.15.59:0/949353658 learned_addr learned my addr 172.21.15.59:0/949353658 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.206+0000 7fe3ba3be700 1 --2- 172.21.15.59:0/949353658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3b4134260 0x7fe3b409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.206+0000 7fe3b9bbd700 1 --2- 172.21.15.59:0/949353658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3b4133420 0x7fe3b409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.206+0000 7fe3b93bc700 1 -- 172.21.15.59:0/949353658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3b4134260 msgr2=0x7fe3b409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.207+0000 7fe3b93bc700 1 --2- 172.21.15.59:0/949353658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3b4134260 0x7fe3b409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.207+0000 7fe3b93bc700 1 -- 172.21.15.59:0/949353658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3b4133420 msgr2=0x7fe3b409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.207+0000 7fe3b93bc700 1 --2- 172.21.15.59:0/949353658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3b4133420 0x7fe3b409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.207+0000 7fe3b93bc700 1 -- 172.21.15.59:0/949353658 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b00094a0 con 0x7fe3b4133e30 2023-09-30T22:30:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.207+0000 7fe3ba3be700 1 --2- 172.21.15.59:0/949353658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3b4134260 0x7fe3b409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.207+0000 7fe3b93bc700 1 --2- 172.21.15.59:0/949353658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3b4133e30 0x7fe3b409c9c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4005910 tx=0x7fe3a400c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:17.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.207+0000 7fe3aa7fc700 1 -- 172.21.15.59:0/949353658 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4005d70 con 0x7fe3b4133e30 2023-09-30T22:30:17.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.207+0000 7fe3aa7fc700 1 -- 172.21.15.59:0/949353658 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a40070d0 con 0x7fe3b4133e30 2023-09-30T22:30:17.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.207+0000 7fe3aa7fc700 1 -- 172.21.15.59:0/949353658 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4007440 con 0x7fe3b4133e30 2023-09-30T22:30:17.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.207+0000 7fe3bbe21700 1 -- 172.21.15.59:0/949353658 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ac009a70 con 0x7fe3b4133e30 2023-09-30T22:30:17.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.207+0000 7fe3bbe21700 1 -- 172.21.15.59:0/949353658 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b411fd70 con 0x7fe3b4133e30 2023-09-30T22:30:17.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.208+0000 7fe3aa7fc700 1 -- 172.21.15.59:0/949353658 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe3a40075a0 con 0x7fe3b4133e30 2023-09-30T22:30:17.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.208+0000 7fe3aa7fc700 1 -- 172.21.15.59:0/949353658 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe3a403eaf0 con 0x7fe3b4133e30 2023-09-30T22:30:17.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.208+0000 7fe3bbe21700 1 -- 172.21.15.59:0/949353658 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b4074ea0 con 0x7fe3b4133e30 2023-09-30T22:30:17.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.214+0000 7fe3aa7fc700 1 -- 172.21.15.59:0/949353658 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3a4017080 con 0x7fe3b4133e30 2023-09-30T22:30:17.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.244+0000 7f5329006700 1 Processor -- start 2023-09-30T22:30:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.244+0000 7f5329006700 1 -- start start 2023-09-30T22:30:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f5329006700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f532409d6f0 0x7f532409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f5329006700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532409e000 0x7f53241339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f5329006700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f532409e410 0x7f5324133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f5329006700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532406b460 con 0x7f532409d6f0 2023-09-30T22:30:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f5329006700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532409b120 con 0x7f532409e000 2023-09-30T22:30:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f5329006700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f532409a7e0 con 0x7f532409e410 2023-09-30T22:30:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f532259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532409e000 0x7f53241339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f532359e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f532409e410 0x7f5324133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f532259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532409e000 0x7f53241339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57642/0 (socket says 172.21.15.59:57642) 2023-09-30T22:30:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f532259c700 1 -- 172.21.15.59:0/3712946232 learned_addr learned my addr 172.21.15.59:0/3712946232 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f5322d9d700 1 --2- 172.21.15.59:0/3712946232 >> v2:172.21.15.59:3300/0 conn(0x7f532409d6f0 0x7f532409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f532259c700 1 -- 172.21.15.59:0/3712946232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f532409e410 msgr2=0x7f5324133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f532259c700 1 --2- 172.21.15.59:0/3712946232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f532409e410 0x7f5324133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f532259c700 1 -- 172.21.15.59:0/3712946232 >> v2:172.21.15.59:3300/0 conn(0x7f532409d6f0 msgr2=0x7f532409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f532259c700 1 --2- 172.21.15.59:0/3712946232 >> v2:172.21.15.59:3300/0 conn(0x7f532409d6f0 0x7f532409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f532259c700 1 -- 172.21.15.59:0/3712946232 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532409a500 con 0x7f532409e000 2023-09-30T22:30:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.245+0000 7f532359e700 1 --2- 172.21.15.59:0/3712946232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f532409e410 0x7f5324133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.246+0000 7f532259c700 1 --2- 172.21.15.59:0/3712946232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532409e000 0x7f53241339f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5318009920 tx=0x7f5318009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c95facec2b281f44 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.246+0000 7f5321d9b700 1 -- 172.21.15.59:0/3712946232 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318011830 con 0x7f532409e000 2023-09-30T22:30:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.246+0000 7f5321d9b700 1 -- 172.21.15.59:0/3712946232 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5318011990 con 0x7f532409e000 2023-09-30T22:30:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.246+0000 7f5321d9b700 1 -- 172.21.15.59:0/3712946232 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318011d20 con 0x7f532409e000 2023-09-30T22:30:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.246+0000 7f5329006700 1 -- 172.21.15.59:0/3712946232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532409e000 msgr2=0x7f53241339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.246+0000 7f5329006700 1 --2- 172.21.15.59:0/3712946232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532409e000 0x7f53241339f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5318009920 tx=0x7f5318009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.246+0000 7f5329006700 1 -- 172.21.15.59:0/3712946232 shutdown_connections 2023-09-30T22:30:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.246+0000 7f5329006700 1 --2- 172.21.15.59:0/3712946232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f532409e410 0x7f5324133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.246+0000 7f5329006700 1 --2- 172.21.15.59:0/3712946232 >> v2:172.21.15.59:3300/0 conn(0x7f532409d6f0 0x7f532409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.246+0000 7f5329006700 1 --2- 172.21.15.59:0/3712946232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532409e000 0x7f53241339f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.246+0000 7f5329006700 1 -- 172.21.15.59:0/3712946232 >> 172.21.15.59:0/3712946232 conn(0x7f5324066f50 msgr2=0x7f532409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.246+0000 7f5329006700 1 -- 172.21.15.59:0/3712946232 shutdown_connections 2023-09-30T22:30:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.247+0000 7f5329006700 1 -- 172.21.15.59:0/3712946232 wait complete. 2023-09-30T22:30:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.248+0000 7f5329006700 1 Processor -- start 2023-09-30T22:30:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.248+0000 7f5329006700 1 -- start start 2023-09-30T22:30:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.248+0000 7f5329006700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532409d6f0 0x7f53241c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.248+0000 7f5329006700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f532409e000 0x7f53241c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.248+0000 7f5329006700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f532409e410 0x7f53241c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.248+0000 7f5329006700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53241a9920 con 0x7f532409e000 2023-09-30T22:30:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.248+0000 7f5329006700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53241a7910 con 0x7f532409d6f0 2023-09-30T22:30:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.248+0000 7f5329006700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f532409c710 con 0x7f532409e410 2023-09-30T22:30:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.249+0000 7f5322d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532409d6f0 0x7f53241c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.249+0000 7f532359e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f532409e410 0x7f53241c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.249+0000 7f5322d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532409d6f0 0x7f53241c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57654/0 (socket says 172.21.15.59:57654) 2023-09-30T22:30:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.249+0000 7f532359e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f532409e410 0x7f53241c4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36174/0 (socket says 172.21.15.59:36174) 2023-09-30T22:30:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.249+0000 7f5322d9d700 1 -- 172.21.15.59:0/3937431532 learned_addr learned my addr 172.21.15.59:0/3937431532 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.249+0000 7f532259c700 1 --2- 172.21.15.59:0/3937431532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f532409e000 0x7f53241c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.249+0000 7f532359e700 1 -- 172.21.15.59:0/3937431532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532409d6f0 msgr2=0x7f53241c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.249+0000 7f532359e700 1 --2- 172.21.15.59:0/3937431532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532409d6f0 0x7f53241c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.249+0000 7f532359e700 1 -- 172.21.15.59:0/3937431532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f532409e000 msgr2=0x7f53241c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.249+0000 7f532359e700 1 --2- 172.21.15.59:0/3937431532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f532409e000 0x7f53241c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.249+0000 7f532359e700 1 -- 172.21.15.59:0/3937431532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c009a70 con 0x7f532409e410 2023-09-30T22:30:17.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.249+0000 7f532359e700 1 --2- 172.21.15.59:0/3937431532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f532409e410 0x7f53241c4ad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f531c00efc0 tx=0x7f531c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:17.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.249+0000 7f530b7fe700 1 -- 172.21.15.59:0/3937431532 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c00ca90 con 0x7f532409e410 2023-09-30T22:30:17.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.250+0000 7f530b7fe700 1 -- 172.21.15.59:0/3937431532 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c00f040 con 0x7f532409e410 2023-09-30T22:30:17.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.250+0000 7f5329006700 1 -- 172.21.15.59:0/3937431532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5318009550 con 0x7f532409e410 2023-09-30T22:30:17.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.250+0000 7f530b7fe700 1 -- 172.21.15.59:0/3937431532 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c00ce30 con 0x7f532409e410 2023-09-30T22:30:17.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.250+0000 7f5329006700 1 -- 172.21.15.59:0/3937431532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53241a9280 con 0x7f532409e410 2023-09-30T22:30:17.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.251+0000 7f530b7fe700 1 -- 172.21.15.59:0/3937431532 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f531c014480 con 0x7f532409e410 2023-09-30T22:30:17.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.251+0000 7f5329006700 1 -- 172.21.15.59:0/3937431532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53241a87d0 con 0x7f532409e410 2023-09-30T22:30:17.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.251+0000 7f530b7fe700 1 -- 172.21.15.59:0/3937431532 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f531c03fcb0 con 0x7f532409e410 2023-09-30T22:30:17.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.256+0000 7f530b7fe700 1 -- 172.21.15.59:0/3937431532 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53241a87d0 con 0x7f532409e410 2023-09-30T22:30:17.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.291+0000 7fca197e0700 1 Processor -- start 2023-09-30T22:30:17.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.291+0000 7fca197e0700 1 -- start start 2023-09-30T22:30:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca197e0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca1409d630 0x7fca140a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca197e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca14138d80 0x7fca1413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca197e0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca140a2a70 con 0x7fca140a0a30 2023-09-30T22:30:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca197e0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca140a01d0 con 0x7fca1409d630 2023-09-30T22:30:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca197e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1409e2b0 con 0x7fca14138d80 2023-09-30T22:30:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca0a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca1409d630 0x7fca140a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca137fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca14138d80 0x7fca1413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca0a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca1409d630 0x7fca140a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49056/0 (socket says 172.21.15.59:49056) 2023-09-30T22:30:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca137fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca14138d80 0x7fca1413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57662/0 (socket says 172.21.15.59:57662) 2023-09-30T22:30:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca0a7fc700 1 -- 172.21.15.59:0/2439893138 learned_addr learned my addr 172.21.15.59:0/2439893138 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca137fe700 1 -- 172.21.15.59:0/2439893138 >> v2:172.21.15.59:3300/0 conn(0x7fca1409d630 msgr2=0x7fca140a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca137fe700 1 --2- 172.21.15.59:0/2439893138 >> v2:172.21.15.59:3300/0 conn(0x7fca1409d630 0x7fca140a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca137fe700 1 -- 172.21.15.59:0/2439893138 >> v1:172.21.15.59:6789/0 conn(0x7fca140a0a30 legacy=0x7fca140a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca137fe700 1 -- 172.21.15.59:0/2439893138 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1409dc50 con 0x7fca14138d80 2023-09-30T22:30:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca0a7fc700 1 --2- 172.21.15.59:0/2439893138 >> v2:172.21.15.59:3300/0 conn(0x7fca1409d630 0x7fca140a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.292+0000 7fca137fe700 1 --2- 172.21.15.59:0/2439893138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca14138d80 0x7fca1413b160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009d90 tx=0x7fca0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adbeeb8febbd8709 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.293+0000 7fca127fc700 1 -- 172.21.15.59:0/2439893138 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c00e070 con 0x7fca14138d80 2023-09-30T22:30:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.293+0000 7fca127fc700 1 -- 172.21.15.59:0/2439893138 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0c00bb20 con 0x7fca14138d80 2023-09-30T22:30:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.293+0000 7fca127fc700 1 -- 172.21.15.59:0/2439893138 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c012430 con 0x7fca14138d80 2023-09-30T22:30:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.294+0000 7fca197e0700 1 -- 172.21.15.59:0/2439893138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca14138d80 msgr2=0x7fca1413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.294+0000 7fca197e0700 1 --2- 172.21.15.59:0/2439893138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca14138d80 0x7fca1413b160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009d90 tx=0x7fca0c00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.294+0000 7fca197e0700 1 -- 172.21.15.59:0/2439893138 shutdown_connections 2023-09-30T22:30:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.294+0000 7fca197e0700 1 --2- 172.21.15.59:0/2439893138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca14138d80 0x7fca1413b160 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.294+0000 7fca197e0700 1 --2- 172.21.15.59:0/2439893138 >> v2:172.21.15.59:3300/0 conn(0x7fca1409d630 0x7fca140a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.294+0000 7fca197e0700 1 -- 172.21.15.59:0/2439893138 >> 172.21.15.59:0/2439893138 conn(0x7fca140a3050 msgr2=0x7fca140a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.294+0000 7fca197e0700 1 -- 172.21.15.59:0/2439893138 shutdown_connections 2023-09-30T22:30:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.294+0000 7fca197e0700 1 -- 172.21.15.59:0/2439893138 wait complete. 2023-09-30T22:30:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.295+0000 7fca197e0700 1 Processor -- start 2023-09-30T22:30:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.295+0000 7fca197e0700 1 -- start start 2023-09-30T22:30:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.295+0000 7fca197e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca1409d630 0x7fca141337d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.295+0000 7fca197e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca140a0a30 0x7fca14133d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.295+0000 7fca197e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca14138d80 0x7fca14134250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.295+0000 7fca197e0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca140a04a0 con 0x7fca14138d80 2023-09-30T22:30:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.295+0000 7fca197e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca14136a80 con 0x7fca1409d630 2023-09-30T22:30:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.295+0000 7fca197e0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca1413ae00 con 0x7fca140a0a30 2023-09-30T22:30:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.296+0000 7fca12ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca1409d630 0x7fca141337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.296+0000 7fca12ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca1409d630 0x7fca141337d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57672/0 (socket says 172.21.15.59:57672) 2023-09-30T22:30:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.296+0000 7fca12ffd700 1 -- 172.21.15.59:0/2466878957 learned_addr learned my addr 172.21.15.59:0/2466878957 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.296+0000 7fca0a7fc700 1 --2- 172.21.15.59:0/2466878957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca140a0a30 0x7fca14133d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.296+0000 7fca137fe700 1 --2- 172.21.15.59:0/2466878957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca14138d80 0x7fca14134250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.296+0000 7fca0a7fc700 1 -- 172.21.15.59:0/2466878957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca1409d630 msgr2=0x7fca141337d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.296+0000 7fca0a7fc700 1 --2- 172.21.15.59:0/2466878957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca1409d630 0x7fca141337d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.296+0000 7fca0a7fc700 1 -- 172.21.15.59:0/2466878957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca14138d80 msgr2=0x7fca14134250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.296+0000 7fca0a7fc700 1 --2- 172.21.15.59:0/2466878957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca14138d80 0x7fca14134250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.296+0000 7fca0a7fc700 1 -- 172.21.15.59:0/2466878957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc009550 con 0x7fca140a0a30 2023-09-30T22:30:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.296+0000 7fca12ffd700 1 --2- 172.21.15.59:0/2466878957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca1409d630 0x7fca141337d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.296+0000 7fca0a7fc700 1 --2- 172.21.15.59:0/2466878957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca140a0a30 0x7fca14133d10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00e9d0 tx=0x7fc9fc00ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.296+0000 7fca0bfff700 1 -- 172.21.15.59:0/2466878957 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc00ee70 con 0x7fca140a0a30 2023-09-30T22:30:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.297+0000 7fca0bfff700 1 -- 172.21.15.59:0/2466878957 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc004030 con 0x7fca140a0a30 2023-09-30T22:30:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.297+0000 7fca197e0700 1 -- 172.21.15.59:0/2466878957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0c009a70 con 0x7fca140a0a30 2023-09-30T22:30:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.297+0000 7fca0bfff700 1 -- 172.21.15.59:0/2466878957 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc0043c0 con 0x7fca140a0a30 2023-09-30T22:30:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.297+0000 7fca197e0700 1 -- 172.21.15.59:0/2466878957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca14135bd0 con 0x7fca140a0a30 2023-09-30T22:30:17.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.297+0000 7fca0bfff700 1 -- 172.21.15.59:0/2466878957 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9fc00c850 con 0x7fca140a0a30 2023-09-30T22:30:17.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.298+0000 7fca197e0700 1 -- 172.21.15.59:0/2466878957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca140747f0 con 0x7fca140a0a30 2023-09-30T22:30:17.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.298+0000 7fca0bfff700 1 -- 172.21.15.59:0/2466878957 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc9fc03f850 con 0x7fca140a0a30 2023-09-30T22:30:17.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.307+0000 7fca0bfff700 1 -- 172.21.15.59:0/2466878957 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9fc011d90 con 0x7fca140a0a30 2023-09-30T22:30:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.431+0000 7fe3bbe21700 1 -- 172.21.15.59:0/949353658 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe3b412db60 con 0x7fe3b4133e30 2023-09-30T22:30:17.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.431+0000 7fe3aa7fc700 1 -- 172.21.15.59:0/949353658 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe3a403ce60 con 0x7fe3b4133e30 2023-09-30T22:30:17.432 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.433+0000 7fe3bbe21700 1 -- 172.21.15.59:0/949353658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3b4133e30 msgr2=0x7fe3b409c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.433+0000 7fe3bbe21700 1 --2- 172.21.15.59:0/949353658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3b4133e30 0x7fe3b409c9c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4005910 tx=0x7fe3a400c9e0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.434+0000 7fe3bbe21700 1 -- 172.21.15.59:0/949353658 shutdown_connections 2023-09-30T22:30:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.434+0000 7fe3bbe21700 1 --2- 172.21.15.59:0/949353658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3b4134260 0x7fe3b409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.434+0000 7fe3bbe21700 1 --2- 172.21.15.59:0/949353658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3b4133420 0x7fe3b409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.434+0000 7fe3bbe21700 1 --2- 172.21.15.59:0/949353658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3b4133e30 0x7fe3b409c9c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.434+0000 7fe3bbe21700 1 -- 172.21.15.59:0/949353658 >> 172.21.15.59:0/949353658 conn(0x7fe3b40a4210 msgr2=0x7fe3b40a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.434+0000 7fe3bbe21700 1 -- 172.21.15.59:0/949353658 shutdown_connections 2023-09-30T22:30:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.434+0000 7fe3bbe21700 1 -- 172.21.15.59:0/949353658 wait complete. 2023-09-30T22:30:17.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:17.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.471+0000 7f5329006700 1 -- 172.21.15.59:0/3937431532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f53241a87d0 con 0x7f532409e410 2023-09-30T22:30:17.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.471+0000 7f530b7fe700 1 -- 172.21.15.59:0/3937431532 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53241a87d0 con 0x7f532409e410 2023-09-30T22:30:17.472 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.473+0000 7f5329006700 1 -- 172.21.15.59:0/3937431532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f532409e410 msgr2=0x7f53241c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.473+0000 7f5329006700 1 --2- 172.21.15.59:0/3937431532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f532409e410 0x7f53241c4ad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f531c00efc0 tx=0x7f531c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.473+0000 7f5329006700 1 -- 172.21.15.59:0/3937431532 shutdown_connections 2023-09-30T22:30:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.473+0000 7f5329006700 1 --2- 172.21.15.59:0/3937431532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f532409e410 0x7f53241c4ad0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.473+0000 7f5329006700 1 --2- 172.21.15.59:0/3937431532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532409d6f0 0x7f53241c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.473+0000 7f5329006700 1 --2- 172.21.15.59:0/3937431532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f532409e000 0x7f53241c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.473+0000 7f5329006700 1 -- 172.21.15.59:0/3937431532 >> 172.21.15.59:0/3937431532 conn(0x7f5324066f50 msgr2=0x7f53241bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.473+0000 7f5329006700 1 -- 172.21.15.59:0/3937431532 shutdown_connections 2023-09-30T22:30:17.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.473+0000 7f5329006700 1 -- 172.21.15.59:0/3937431532 wait complete. 2023-09-30T22:30:17.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:17.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.517+0000 7fca197e0700 1 -- 172.21.15.59:0/2466878957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fca14072980 con 0x7fca140a0a30 2023-09-30T22:30:17.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.517+0000 7fca0bfff700 1 -- 172.21.15.59:0/2466878957 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc9fc011350 con 0x7fca140a0a30 2023-09-30T22:30:17.519 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:17.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.519+0000 7fca197e0700 1 -- 172.21.15.59:0/2466878957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca140a0a30 msgr2=0x7fca14133d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.519+0000 7fca197e0700 1 --2- 172.21.15.59:0/2466878957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca140a0a30 0x7fca14133d10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00e9d0 tx=0x7fc9fc00ece0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.520+0000 7fca197e0700 1 -- 172.21.15.59:0/2466878957 shutdown_connections 2023-09-30T22:30:17.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.520+0000 7fca197e0700 1 --2- 172.21.15.59:0/2466878957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca14138d80 0x7fca14134250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.520+0000 7fca197e0700 1 --2- 172.21.15.59:0/2466878957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca1409d630 0x7fca141337d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.520+0000 7fca197e0700 1 --2- 172.21.15.59:0/2466878957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca140a0a30 0x7fca14133d10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.520+0000 7fca197e0700 1 -- 172.21.15.59:0/2466878957 >> 172.21.15.59:0/2466878957 conn(0x7fca140a3050 msgr2=0x7fca140a6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:17.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.520+0000 7fca197e0700 1 -- 172.21.15.59:0/2466878957 shutdown_connections 2023-09-30T22:30:17.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:17.520+0000 7fca197e0700 1 -- 172.21.15.59:0/2466878957 wait complete. 2023-09-30T22:30:17.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:18.025 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:18.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.169+0000 7fa800a39700 1 Processor -- start 2023-09-30T22:30:18.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.169+0000 7fa800a39700 1 -- start start 2023-09-30T22:30:18.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.169+0000 7fa800a39700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7fc09e930 0x7fa7fc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.169+0000 7fa800a39700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7fc09f650 0x7fa7fc131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.169+0000 7fa800a39700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7fc070940 con 0x7fa7fc09f240 2023-09-30T22:30:18.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.169+0000 7fa800a39700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc06fd60 con 0x7fa7fc09e930 2023-09-30T22:30:18.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.169+0000 7fa800a39700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc06fa80 con 0x7fa7fc09f650 2023-09-30T22:30:18.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.170+0000 7fa7fad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7fc09f650 0x7fa7fc131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.170+0000 7fa7fa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7fc09e930 0x7fa7fc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.170+0000 7fa7f9d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa7fc09f240 0x7fa7fc1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39712/0 (socket says 172.21.15.59:39712) 2023-09-30T22:30:18.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.170+0000 7fa7fad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7fc09f650 0x7fa7fc131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36196/0 (socket says 172.21.15.59:36196) 2023-09-30T22:30:18.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.170+0000 7fa7f9d9b700 1 -- 172.21.15.59:0/520257443 learned_addr learned my addr 172.21.15.59:0/520257443 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:18.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.170+0000 7fa7f959a700 1 -- 172.21.15.59:0/520257443 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767626714 0 0) 0x7fa7fc070940 con 0x7fa7fc09f240 2023-09-30T22:30:18.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.170+0000 7fa7fa59c700 1 -- 172.21.15.59:0/520257443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7fc09f650 msgr2=0x7fa7fc131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:18.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.170+0000 7fa7fa59c700 1 --2- 172.21.15.59:0/520257443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7fc09f650 0x7fa7fc131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.170+0000 7fa7fa59c700 1 -- 172.21.15.59:0/520257443 >> v1:172.21.15.59:6789/0 conn(0x7fa7fc09f240 legacy=0x7fa7fc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.170+0000 7fa7fa59c700 1 -- 172.21.15.59:0/520257443 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7fc09fb60 con 0x7fa7fc09e930 2023-09-30T22:30:18.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.170+0000 7fa7fad9d700 1 --2- 172.21.15.59:0/520257443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7fc09f650 0x7fa7fc131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:18.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.170+0000 7fa7fa59c700 1 --2- 172.21.15.59:0/520257443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7fc09e930 0x7fa7fc09ed00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009870 tx=0x7fa7ec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef2383b6ccae7f55 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.170+0000 7fa7f959a700 1 -- 172.21.15.59:0/520257443 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec011830 con 0x7fa7fc09e930 2023-09-30T22:30:18.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.170+0000 7fa7f959a700 1 -- 172.21.15.59:0/520257443 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec011990 con 0x7fa7fc09e930 2023-09-30T22:30:18.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.170+0000 7fa7f959a700 1 -- 172.21.15.59:0/520257443 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec011d20 con 0x7fa7fc09e930 2023-09-30T22:30:18.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.171+0000 7fa800a39700 1 -- 172.21.15.59:0/520257443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7fc09e930 msgr2=0x7fa7fc09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.171+0000 7fa800a39700 1 --2- 172.21.15.59:0/520257443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7fc09e930 0x7fa7fc09ed00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009870 tx=0x7fa7ec009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:18.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.171+0000 7fa800a39700 1 -- 172.21.15.59:0/520257443 shutdown_connections 2023-09-30T22:30:18.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.171+0000 7fa800a39700 1 --2- 172.21.15.59:0/520257443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7fc09f650 0x7fa7fc131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.171+0000 7fa800a39700 1 --2- 172.21.15.59:0/520257443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7fc09e930 0x7fa7fc09ed00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.171+0000 7fa800a39700 1 -- 172.21.15.59:0/520257443 >> 172.21.15.59:0/520257443 conn(0x7fa7fc0a4210 msgr2=0x7fa7fc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.171+0000 7fa800a39700 1 -- 172.21.15.59:0/520257443 shutdown_connections 2023-09-30T22:30:18.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.171+0000 7fa800a39700 1 -- 172.21.15.59:0/520257443 wait complete. 2023-09-30T22:30:18.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.171+0000 7fa800a39700 1 Processor -- start 2023-09-30T22:30:18.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.171+0000 7fa800a39700 1 -- start start 2023-09-30T22:30:18.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa800a39700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7fc09e930 0x7fa7fc1a7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa800a39700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7fc09f240 0x7fa7fc1a76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa800a39700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7fc09f650 0x7fa7fc1a7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa800a39700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc1aaca0 con 0x7fa7fc09f240 2023-09-30T22:30:18.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa800a39700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc1a9c40 con 0x7fa7fc09f650 2023-09-30T22:30:18.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa800a39700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc1aa790 con 0x7fa7fc09e930 2023-09-30T22:30:18.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7fa59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7fc09e930 0x7fa7fc1a7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7f9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7fc09f240 0x7fa7fc1a76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7fa59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7fc09e930 0x7fa7fc1a7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36202/0 (socket says 172.21.15.59:36202) 2023-09-30T22:30:18.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7fa59c700 1 -- 172.21.15.59:0/3383496141 learned_addr learned my addr 172.21.15.59:0/3383496141 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:18.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7f9d9b700 1 --2- 172.21.15.59:0/3383496141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7fc09f240 0x7fa7fc1a76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49072/0 (socket says 172.21.15.59:49072) 2023-09-30T22:30:18.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7fad9d700 1 --2- 172.21.15.59:0/3383496141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7fc09f650 0x7fa7fc1a7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7fa59c700 1 -- 172.21.15.59:0/3383496141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7fc09f650 msgr2=0x7fa7fc1a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7fa59c700 1 --2- 172.21.15.59:0/3383496141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7fc09f650 0x7fa7fc1a7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7fa59c700 1 -- 172.21.15.59:0/3383496141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7fc09f240 msgr2=0x7fa7fc1a76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7fa59c700 1 --2- 172.21.15.59:0/3383496141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7fc09f240 0x7fa7fc1a76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7fa59c700 1 -- 172.21.15.59:0/3383496141 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f4009a70 con 0x7fa7fc09e930 2023-09-30T22:30:18.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7f9d9b700 1 --2- 172.21.15.59:0/3383496141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7fc09f240 0x7fa7fc1a76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7fa59c700 1 --2- 172.21.15.59:0/3383496141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7fc09e930 0x7fa7fc1a7180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009840 tx=0x7fa7ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7eaffd700 1 -- 172.21.15.59:0/3383496141 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec004510 con 0x7fa7fc09e930 2023-09-30T22:30:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7eaffd700 1 -- 172.21.15.59:0/3383496141 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec01f070 con 0x7fa7fc09e930 2023-09-30T22:30:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7eaffd700 1 -- 172.21.15.59:0/3383496141 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0038e0 con 0x7fa7fc09e930 2023-09-30T22:30:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa800a39700 1 -- 172.21.15.59:0/3383496141 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec0094a0 con 0x7fa7fc09e930 2023-09-30T22:30:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa800a39700 1 -- 172.21.15.59:0/3383496141 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7fc0a0190 con 0x7fa7fc09e930 2023-09-30T22:30:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.173+0000 7fa7eaffd700 1 -- 172.21.15.59:0/3383496141 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7ec003a40 con 0x7fa7fc09e930 2023-09-30T22:30:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.175+0000 7fa7eaffd700 1 -- 172.21.15.59:0/3383496141 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa7ec021070 con 0x7fa7fc09e930 2023-09-30T22:30:18.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.175+0000 7fa800a39700 1 -- 172.21.15.59:0/3383496141 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7fc071d20 con 0x7fa7fc09e930 2023-09-30T22:30:18.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.180+0000 7fa7eaffd700 1 -- 172.21.15.59:0/3383496141 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7ec040e60 con 0x7fa7fc09e930 2023-09-30T22:30:18.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.384+0000 7fa800a39700 1 -- 172.21.15.59:0/3383496141 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa7fc074ea0 con 0x7fa7fc09e930 2023-09-30T22:30:18.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.384+0000 7fa7eaffd700 1 -- 172.21.15.59:0/3383496141 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7ec015020 con 0x7fa7fc09e930 2023-09-30T22:30:18.384 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:18.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.387+0000 7fa800a39700 1 -- 172.21.15.59:0/3383496141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7fc09e930 msgr2=0x7fa7fc1a7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.387+0000 7fa800a39700 1 --2- 172.21.15.59:0/3383496141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7fc09e930 0x7fa7fc1a7180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009840 tx=0x7fa7ec004750 comp rx=0 tx=0).stop 2023-09-30T22:30:18.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.387+0000 7fa800a39700 1 -- 172.21.15.59:0/3383496141 shutdown_connections 2023-09-30T22:30:18.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.387+0000 7fa800a39700 1 --2- 172.21.15.59:0/3383496141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7fc09e930 0x7fa7fc1a7180 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.387+0000 7fa800a39700 1 --2- 172.21.15.59:0/3383496141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7fc09f650 0x7fa7fc1a7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.387+0000 7fa800a39700 1 --2- 172.21.15.59:0/3383496141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7fc09f240 0x7fa7fc1a76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.387+0000 7fa800a39700 1 -- 172.21.15.59:0/3383496141 >> 172.21.15.59:0/3383496141 conn(0x7fa7fc0a4210 msgr2=0x7fa7fc1b8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.387+0000 7fa800a39700 1 -- 172.21.15.59:0/3383496141 shutdown_connections 2023-09-30T22:30:18.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.387+0000 7fa800a39700 1 -- 172.21.15.59:0/3383496141 wait complete. 2023-09-30T22:30:18.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:18.450 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:18.489 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:18.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.594+0000 7fc850a96700 1 Processor -- start 2023-09-30T22:30:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.594+0000 7fc850a96700 1 -- start start 2023-09-30T22:30:18.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.594+0000 7fc850a96700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc84c09d6f0 0x7fc84c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.594+0000 7fc850a96700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc84c09e410 0x7fc84c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.595+0000 7fc850a96700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84c09f130 con 0x7fc84c09e000 2023-09-30T22:30:18.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.595+0000 7fc850a96700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84c09f520 con 0x7fc84c09e410 2023-09-30T22:30:18.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.595+0000 7fc850a96700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c09e930 con 0x7fc84c09d6f0 2023-09-30T22:30:18.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.595+0000 7fc84ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc84c09e410 0x7fc84c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.595+0000 7fc84ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc84c09e410 0x7fc84c130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49088/0 (socket says 172.21.15.59:49088) 2023-09-30T22:30:18.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.595+0000 7fc84ad9d700 1 -- 172.21.15.59:0/3092786473 learned_addr learned my addr 172.21.15.59:0/3092786473 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:18.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.595+0000 7fc84a59c700 1 --2- 172.21.15.59:0/3092786473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc84c09d6f0 0x7fc84c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.595+0000 7fc84ad9d700 1 -- 172.21.15.59:0/3092786473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc84c09d6f0 msgr2=0x7fc84c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:18.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.595+0000 7fc84ad9d700 1 --2- 172.21.15.59:0/3092786473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc84c09d6f0 0x7fc84c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.595+0000 7fc84ad9d700 1 -- 172.21.15.59:0/3092786473 >> v1:172.21.15.59:6789/0 conn(0x7fc84c09e000 legacy=0x7fc84c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.595+0000 7fc84ad9d700 1 -- 172.21.15.59:0/3092786473 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c09b2d0 con 0x7fc84c09e410 2023-09-30T22:30:18.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.595+0000 7fc84a59c700 1 --2- 172.21.15.59:0/3092786473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc84c09d6f0 0x7fc84c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:18.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.595+0000 7fc84ad9d700 1 --2- 172.21.15.59:0/3092786473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc84c09e410 0x7fc84c130d70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc844009e50 tx=0x7fc84400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5100177ef60e2165 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.596+0000 7fc84959a700 1 -- 172.21.15.59:0/3092786473 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84400e070 con 0x7fc84c09e410 2023-09-30T22:30:18.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.596+0000 7fc84959a700 1 -- 172.21.15.59:0/3092786473 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84400b910 con 0x7fc84c09e410 2023-09-30T22:30:18.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.596+0000 7fc84959a700 1 -- 172.21.15.59:0/3092786473 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84400bcc0 con 0x7fc84c09e410 2023-09-30T22:30:18.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.596+0000 7fc850a96700 1 -- 172.21.15.59:0/3092786473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc84c09e410 msgr2=0x7fc84c130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.596+0000 7fc850a96700 1 --2- 172.21.15.59:0/3092786473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc84c09e410 0x7fc84c130d70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc844009e50 tx=0x7fc84400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:18.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.597+0000 7fc850a96700 1 -- 172.21.15.59:0/3092786473 shutdown_connections 2023-09-30T22:30:18.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.597+0000 7fc850a96700 1 --2- 172.21.15.59:0/3092786473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc84c09e410 0x7fc84c130d70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.597+0000 7fc850a96700 1 --2- 172.21.15.59:0/3092786473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc84c09d6f0 0x7fc84c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.597+0000 7fc850a96700 1 -- 172.21.15.59:0/3092786473 >> 172.21.15.59:0/3092786473 conn(0x7fc84c066f50 msgr2=0x7fc84c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.597+0000 7fc850a96700 1 -- 172.21.15.59:0/3092786473 shutdown_connections 2023-09-30T22:30:18.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.597+0000 7fc850a96700 1 -- 172.21.15.59:0/3092786473 wait complete. 2023-09-30T22:30:18.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.598+0000 7fc850a96700 1 Processor -- start 2023-09-30T22:30:18.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.598+0000 7fc850a96700 1 -- start start 2023-09-30T22:30:18.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.598+0000 7fc850a96700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc84c09d6f0 0x7fc84c127660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.598+0000 7fc850a96700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc84c09e000 0x7fc84c127ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.598+0000 7fc850a96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc84c09e410 0x7fc84c1280e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.598+0000 7fc850a96700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c1328a0 con 0x7fc84c09e000 2023-09-30T22:30:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.598+0000 7fc850a96700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c131c70 con 0x7fc84c09e410 2023-09-30T22:30:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.598+0000 7fc850a96700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c09c700 con 0x7fc84c09d6f0 2023-09-30T22:30:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.599+0000 7fc849d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc84c09e000 0x7fc84c127ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.599+0000 7fc849d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc84c09e000 0x7fc84c127ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49104/0 (socket says 172.21.15.59:49104) 2023-09-30T22:30:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.599+0000 7fc849d9b700 1 -- 172.21.15.59:0/851618644 learned_addr learned my addr 172.21.15.59:0/851618644 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.599+0000 7fc84a59c700 1 --2- 172.21.15.59:0/851618644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc84c09d6f0 0x7fc84c127660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.599+0000 7fc849d9b700 1 -- 172.21.15.59:0/851618644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc84c09d6f0 msgr2=0x7fc84c127660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.599+0000 7fc849d9b700 1 --2- 172.21.15.59:0/851618644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc84c09d6f0 0x7fc84c127660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.599+0000 7fc849d9b700 1 -- 172.21.15.59:0/851618644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc84c09e410 msgr2=0x7fc84c1280e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.599+0000 7fc849d9b700 1 --2- 172.21.15.59:0/851618644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc84c09e410 0x7fc84c1280e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.599+0000 7fc849d9b700 1 -- 172.21.15.59:0/851618644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c0094a0 con 0x7fc84c09e000 2023-09-30T22:30:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.599+0000 7fc84a59c700 1 --2- 172.21.15.59:0/851618644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc84c09d6f0 0x7fc84c127660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.599+0000 7fc849d9b700 1 --2- 172.21.15.59:0/851618644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc84c09e000 0x7fc84c127ba0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc84000c4b0 tx=0x7fc84000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.599+0000 7fc83affd700 1 -- 172.21.15.59:0/851618644 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8400052d0 con 0x7fc84c09e000 2023-09-30T22:30:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.599+0000 7fc83affd700 1 -- 172.21.15.59:0/851618644 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc840005430 con 0x7fc84c09e000 2023-09-30T22:30:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.600+0000 7fc83affd700 1 -- 172.21.15.59:0/851618644 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8400038c0 con 0x7fc84c09e000 2023-09-30T22:30:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.600+0000 7fc850a96700 1 -- 172.21.15.59:0/851618644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc844009b30 con 0x7fc84c09e000 2023-09-30T22:30:18.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.600+0000 7fc850a96700 1 -- 172.21.15.59:0/851618644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84c132030 con 0x7fc84c09e000 2023-09-30T22:30:18.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.600+0000 7fc83affd700 1 -- 172.21.15.59:0/851618644 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc840003a20 con 0x7fc84c09e000 2023-09-30T22:30:18.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.601+0000 7fc83affd700 1 -- 172.21.15.59:0/851618644 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc84003eab0 con 0x7fc84c09e000 2023-09-30T22:30:18.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.601+0000 7fc850a96700 1 -- 172.21.15.59:0/851618644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84c072410 con 0x7fc84c09e000 2023-09-30T22:30:18.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.610+0000 7fc83affd700 1 -- 172.21.15.59:0/851618644 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc840018260 con 0x7fc84c09e000 2023-09-30T22:30:18.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.647+0000 7f5eb6de8700 1 Processor -- start 2023-09-30T22:30:18.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.647+0000 7f5eb6de8700 1 -- start start 2023-09-30T22:30:18.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eb6de8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5eb01316c0 0x7f5eb0131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eb6de8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb009d9f0 0x7f5eb006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eb6de8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5eb006acb0 0x7f5eb006b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eb6de8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb009e130 con 0x7f5eb01316c0 2023-09-30T22:30:18.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eb6de8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb01312b0 con 0x7f5eb009d9f0 2023-09-30T22:30:18.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eb6de8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb009f6e0 con 0x7f5eb006acb0 2023-09-30T22:30:18.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eb4b84700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5eb01316c0 0x7f5eb0131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eb4b84700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5eb01316c0 0x7f5eb0131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49112/0 (socket says 172.21.15.59:49112) 2023-09-30T22:30:18.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eb4b84700 1 -- 172.21.15.59:0/4014336172 learned_addr learned my addr 172.21.15.59:0/4014336172 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:18.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eaffff700 1 --2- 172.21.15.59:0/4014336172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb009d9f0 0x7f5eb006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eb5385700 1 --2- 172.21.15.59:0/4014336172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5eb006acb0 0x7f5eb006b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eb4b84700 1 -- 172.21.15.59:0/4014336172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5eb006acb0 msgr2=0x7f5eb006b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:18.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eb4b84700 1 --2- 172.21.15.59:0/4014336172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5eb006acb0 0x7f5eb006b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eb4b84700 1 -- 172.21.15.59:0/4014336172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb009d9f0 msgr2=0x7f5eb006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:18.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eb4b84700 1 --2- 172.21.15.59:0/4014336172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb009d9f0 0x7f5eb006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eb4b84700 1 -- 172.21.15.59:0/4014336172 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb009e760 con 0x7f5eb01316c0 2023-09-30T22:30:18.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.648+0000 7f5eaffff700 1 --2- 172.21.15.59:0/4014336172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb009d9f0 0x7f5eb006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:18.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.649+0000 7f5eb4b84700 1 --2- 172.21.15.59:0/4014336172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb01316c0 0x7f5eb0131a90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40098f0 tx=0x7f5ea4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b21eed4951dabb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.649+0000 7f5eaf7fe700 1 -- 172.21.15.59:0/4014336172 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4011830 con 0x7f5eb01316c0 2023-09-30T22:30:18.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.649+0000 7f5eaf7fe700 1 -- 172.21.15.59:0/4014336172 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea4011990 con 0x7f5eb01316c0 2023-09-30T22:30:18.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.649+0000 7f5eaf7fe700 1 -- 172.21.15.59:0/4014336172 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4011d20 con 0x7f5eb01316c0 2023-09-30T22:30:18.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.649+0000 7f5eb6de8700 1 -- 172.21.15.59:0/4014336172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb01316c0 msgr2=0x7f5eb0131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.649+0000 7f5eb6de8700 1 --2- 172.21.15.59:0/4014336172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb01316c0 0x7f5eb0131a90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40098f0 tx=0x7f5ea4009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:18.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.650+0000 7f5eb6de8700 1 -- 172.21.15.59:0/4014336172 shutdown_connections 2023-09-30T22:30:18.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.650+0000 7f5eb6de8700 1 --2- 172.21.15.59:0/4014336172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5eb006acb0 0x7f5eb006b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.650+0000 7f5eb6de8700 1 --2- 172.21.15.59:0/4014336172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb01316c0 0x7f5eb0131a90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.650+0000 7f5eb6de8700 1 --2- 172.21.15.59:0/4014336172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb009d9f0 0x7f5eb006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.650+0000 7f5eb6de8700 1 -- 172.21.15.59:0/4014336172 >> 172.21.15.59:0/4014336172 conn(0x7f5eb0066f50 msgr2=0x7f5eb009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.650+0000 7f5eb6de8700 1 -- 172.21.15.59:0/4014336172 shutdown_connections 2023-09-30T22:30:18.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.650+0000 7f5eb6de8700 1 -- 172.21.15.59:0/4014336172 wait complete. 2023-09-30T22:30:18.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.651+0000 7f5eb6de8700 1 Processor -- start 2023-09-30T22:30:18.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.651+0000 7f5eb6de8700 1 -- start start 2023-09-30T22:30:18.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.651+0000 7f5eb6de8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb006acb0 0x7f5eb01c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.651+0000 7f5eb6de8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5eb009d9f0 0x7f5eb01c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.651+0000 7f5eb6de8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb01316c0 0x7f5eb0070a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.651+0000 7f5eb6de8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb009b840 con 0x7f5eb01316c0 2023-09-30T22:30:18.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.651+0000 7f5eb6de8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb009bb00 con 0x7f5eb006acb0 2023-09-30T22:30:18.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.651+0000 7f5eb6de8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb0128580 con 0x7f5eb009d9f0 2023-09-30T22:30:18.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.651+0000 7f5eb4b84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb006acb0 0x7f5eb01c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.651+0000 7f5eb4b84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb006acb0 0x7f5eb01c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57728/0 (socket says 172.21.15.59:57728) 2023-09-30T22:30:18.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.652+0000 7f5eb4b84700 1 -- 172.21.15.59:0/663908512 learned_addr learned my addr 172.21.15.59:0/663908512 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:18.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.652+0000 7f5eaffff700 1 --2- 172.21.15.59:0/663908512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5eb009d9f0 0x7f5eb01c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.652+0000 7f5eb5385700 1 --2- 172.21.15.59:0/663908512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb01316c0 0x7f5eb0070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.652+0000 7f5eb4b84700 1 -- 172.21.15.59:0/663908512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5eb009d9f0 msgr2=0x7f5eb01c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.652+0000 7f5eb4b84700 1 --2- 172.21.15.59:0/663908512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5eb009d9f0 0x7f5eb01c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.652+0000 7f5eb4b84700 1 -- 172.21.15.59:0/663908512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb01316c0 msgr2=0x7f5eb0070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.652+0000 7f5eb4b84700 1 --2- 172.21.15.59:0/663908512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb01316c0 0x7f5eb0070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.652+0000 7f5eb4b84700 1 -- 172.21.15.59:0/663908512 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c0094a0 con 0x7f5eb006acb0 2023-09-30T22:30:18.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.652+0000 7f5eb5385700 1 --2- 172.21.15.59:0/663908512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb01316c0 0x7f5eb0070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:18.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.652+0000 7f5eb4b84700 1 --2- 172.21.15.59:0/663908512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb006acb0 0x7f5eb01c8510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009c40 tx=0x7f5ea4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.652+0000 7f5ead7fa700 1 -- 172.21.15.59:0/663908512 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4004450 con 0x7f5eb006acb0 2023-09-30T22:30:18.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.652+0000 7f5ead7fa700 1 -- 172.21.15.59:0/663908512 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea40045b0 con 0x7f5eb006acb0 2023-09-30T22:30:18.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.652+0000 7f5eb6de8700 1 -- 172.21.15.59:0/663908512 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea4009550 con 0x7f5eb006acb0 2023-09-30T22:30:18.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.652+0000 7f5ead7fa700 1 -- 172.21.15.59:0/663908512 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea40038c0 con 0x7f5eb006acb0 2023-09-30T22:30:18.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.652+0000 7f5eb6de8700 1 -- 172.21.15.59:0/663908512 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb009c2e0 con 0x7f5eb006acb0 2023-09-30T22:30:18.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.653+0000 7f5ead7fa700 1 -- 172.21.15.59:0/663908512 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ea4021070 con 0x7f5eb006acb0 2023-09-30T22:30:18.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.653+0000 7f5ead7fa700 1 -- 172.21.15.59:0/663908512 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5ea4040b40 con 0x7f5eb006acb0 2023-09-30T22:30:18.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.653+0000 7f5eb6de8700 1 -- 172.21.15.59:0/663908512 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb0074ea0 con 0x7f5eb006acb0 2023-09-30T22:30:18.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.659+0000 7f5ead7fa700 1 -- 172.21.15.59:0/663908512 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ea4029020 con 0x7f5eb006acb0 2023-09-30T22:30:18.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.684+0000 7f07b0581700 1 Processor -- start 2023-09-30T22:30:18.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.684+0000 7f07b0581700 1 -- start start 2023-09-30T22:30:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.685+0000 7f07b0581700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f07a80a0a30 0x7f07a80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.685+0000 7f07b0581700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07a80a1340 0x7f07a8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.685+0000 7f07b0581700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f07a8133fa0 0x7f07a8134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.685+0000 7f07b0581700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a809edd0 con 0x7f07a80a0a30 2023-09-30T22:30:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.685+0000 7f07b0581700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a809e1f0 con 0x7f07a80a1340 2023-09-30T22:30:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.685+0000 7f07b0581700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07a809dc50 con 0x7f07a8133fa0 2023-09-30T22:30:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.685+0000 7f07ae31d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f07a80a0a30 0x7f07a80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.685+0000 7f07adb1c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07a80a1340 0x7f07a8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.685+0000 7f07ae31d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f07a80a0a30 0x7f07a80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49118/0 (socket says 172.21.15.59:49118) 2023-09-30T22:30:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.685+0000 7f07adb1c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07a80a1340 0x7f07a8133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57740/0 (socket says 172.21.15.59:57740) 2023-09-30T22:30:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.685+0000 7f07ae31d700 1 -- 172.21.15.59:0/1600407836 learned_addr learned my addr 172.21.15.59:0/1600407836 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.685+0000 7f07aeb1e700 1 --2- 172.21.15.59:0/1600407836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f07a8133fa0 0x7f07a8134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.685+0000 7f07ae31d700 1 -- 172.21.15.59:0/1600407836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f07a8133fa0 msgr2=0x7f07a8134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.685+0000 7f07ae31d700 1 --2- 172.21.15.59:0/1600407836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f07a8133fa0 0x7f07a8134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.685+0000 7f07ae31d700 1 -- 172.21.15.59:0/1600407836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07a80a1340 msgr2=0x7f07a8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.686+0000 7f07ae31d700 1 --2- 172.21.15.59:0/1600407836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07a80a1340 0x7f07a8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.686+0000 7f07ae31d700 1 -- 172.21.15.59:0/1600407836 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a80a1fe0 con 0x7f07a80a0a30 2023-09-30T22:30:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.686+0000 7f07ae31d700 1 --2- 172.21.15.59:0/1600407836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07a80a0a30 0x7f07a80a0e00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f07a40098f0 tx=0x7f07a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f14906a820d737 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.686+0000 7f07ad31b700 1 -- 172.21.15.59:0/1600407836 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4011830 con 0x7f07a80a0a30 2023-09-30T22:30:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.686+0000 7f07ad31b700 1 -- 172.21.15.59:0/1600407836 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a4011990 con 0x7f07a80a0a30 2023-09-30T22:30:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.686+0000 7f07ad31b700 1 -- 172.21.15.59:0/1600407836 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4011d20 con 0x7f07a80a0a30 2023-09-30T22:30:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.687+0000 7f07b0581700 1 -- 172.21.15.59:0/1600407836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07a80a0a30 msgr2=0x7f07a80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.687+0000 7f07b0581700 1 --2- 172.21.15.59:0/1600407836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07a80a0a30 0x7f07a80a0e00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f07a40098f0 tx=0x7f07a4009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.687+0000 7f07b0581700 1 -- 172.21.15.59:0/1600407836 shutdown_connections 2023-09-30T22:30:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.687+0000 7f07b0581700 1 --2- 172.21.15.59:0/1600407836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f07a8133fa0 0x7f07a8134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.687+0000 7f07b0581700 1 --2- 172.21.15.59:0/1600407836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07a80a0a30 0x7f07a80a0e00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.687+0000 7f07b0581700 1 --2- 172.21.15.59:0/1600407836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07a80a1340 0x7f07a8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.687+0000 7f07b0581700 1 -- 172.21.15.59:0/1600407836 >> 172.21.15.59:0/1600407836 conn(0x7f07a80a6550 msgr2=0x7f07a80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.687+0000 7f07b0581700 1 -- 172.21.15.59:0/1600407836 shutdown_connections 2023-09-30T22:30:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.687+0000 7f07b0581700 1 -- 172.21.15.59:0/1600407836 wait complete. 2023-09-30T22:30:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.688+0000 7f07b0581700 1 Processor -- start 2023-09-30T22:30:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.688+0000 7f07b0581700 1 -- start start 2023-09-30T22:30:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.688+0000 7f07b0581700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07a80a0a30 0x7f07a81212f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.688+0000 7f07b0581700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f07a80a1340 0x7f07a8121830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.688+0000 7f07b0581700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07a8133fa0 0x7f07a8121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.688+0000 7f07b0581700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a8124e10 con 0x7f07a8133fa0 2023-09-30T22:30:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.688+0000 7f07b0581700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a8123d90 con 0x7f07a80a0a30 2023-09-30T22:30:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.688+0000 7f07b0581700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07a8124870 con 0x7f07a80a1340 2023-09-30T22:30:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f07adb1c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f07a80a1340 0x7f07a8121830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f07ae31d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07a80a0a30 0x7f07a81212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f07adb1c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f07a80a1340 0x7f07a8121830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36250/0 (socket says 172.21.15.59:36250) 2023-09-30T22:30:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f07ae31d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07a80a0a30 0x7f07a81212f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57746/0 (socket says 172.21.15.59:57746) 2023-09-30T22:30:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f07adb1c700 1 -- 172.21.15.59:0/638704450 learned_addr learned my addr 172.21.15.59:0/638704450 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f07aeb1e700 1 --2- 172.21.15.59:0/638704450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07a8133fa0 0x7f07a8121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f07adb1c700 1 -- 172.21.15.59:0/638704450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07a80a0a30 msgr2=0x7f07a81212f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f07adb1c700 1 --2- 172.21.15.59:0/638704450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07a80a0a30 0x7f07a81212f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f07adb1c700 1 -- 172.21.15.59:0/638704450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07a8133fa0 msgr2=0x7f07a8121d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f07adb1c700 1 --2- 172.21.15.59:0/638704450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07a8133fa0 0x7f07a8121d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f07adb1c700 1 -- 172.21.15.59:0/638704450 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a4009550 con 0x7f07a80a1340 2023-09-30T22:30:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f07ae31d700 1 --2- 172.21.15.59:0/638704450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07a80a0a30 0x7f07a81212f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f07adb1c700 1 --2- 172.21.15.59:0/638704450 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f07a80a1340 0x7f07a8121830 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f079800e9e0 tx=0x7f079800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f079effd700 1 -- 172.21.15.59:0/638704450 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798009710 con 0x7f07a80a1340 2023-09-30T22:30:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f079effd700 1 -- 172.21.15.59:0/638704450 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079800ee80 con 0x7f07a80a1340 2023-09-30T22:30:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.689+0000 7f07b0581700 1 -- 172.21.15.59:0/638704450 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a81326c0 con 0x7f07a80a1340 2023-09-30T22:30:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.690+0000 7f079effd700 1 -- 172.21.15.59:0/638704450 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800ca50 con 0x7f07a80a1340 2023-09-30T22:30:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.690+0000 7f07b0581700 1 -- 172.21.15.59:0/638704450 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a80a3730 con 0x7f07a80a1340 2023-09-30T22:30:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.690+0000 7f07b0581700 1 -- 172.21.15.59:0/638704450 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a81246c0 con 0x7f07a80a1340 2023-09-30T22:30:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.691+0000 7f079effd700 1 -- 172.21.15.59:0/638704450 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f079800cbb0 con 0x7f07a80a1340 2023-09-30T22:30:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.691+0000 7f079effd700 1 -- 172.21.15.59:0/638704450 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f079803fec0 con 0x7f07a80a1340 2023-09-30T22:30:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.700+0000 7f079effd700 1 -- 172.21.15.59:0/638704450 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0798011350 con 0x7f07a80a1340 2023-09-30T22:30:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.839+0000 7fc850a96700 1 -- 172.21.15.59:0/851618644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc84c074ea0 con 0x7fc84c09e000 2023-09-30T22:30:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.839+0000 7fc83affd700 1 -- 172.21.15.59:0/851618644 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc840017020 con 0x7fc84c09e000 2023-09-30T22:30:18.840 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:18.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.843+0000 7fc850a96700 1 -- 172.21.15.59:0/851618644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc84c09e000 msgr2=0x7fc84c127ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.843+0000 7fc850a96700 1 --2- 172.21.15.59:0/851618644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc84c09e000 0x7fc84c127ba0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc84000c4b0 tx=0x7fc84000c7c0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.843+0000 7fc850a96700 1 -- 172.21.15.59:0/851618644 shutdown_connections 2023-09-30T22:30:18.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.843+0000 7fc850a96700 1 --2- 172.21.15.59:0/851618644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc84c09d6f0 0x7fc84c127660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.843+0000 7fc850a96700 1 --2- 172.21.15.59:0/851618644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc84c09e410 0x7fc84c1280e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.843+0000 7fc850a96700 1 --2- 172.21.15.59:0/851618644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc84c09e000 0x7fc84c127ba0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.843+0000 7fc850a96700 1 -- 172.21.15.59:0/851618644 >> 172.21.15.59:0/851618644 conn(0x7fc84c066f50 msgr2=0x7fc84c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.843+0000 7fc850a96700 1 -- 172.21.15.59:0/851618644 shutdown_connections 2023-09-30T22:30:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.843+0000 7fc850a96700 1 -- 172.21.15.59:0/851618644 wait complete. 2023-09-30T22:30:18.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.882+0000 7f5eb6de8700 1 -- 172.21.15.59:0/663908512 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5eb009e980 con 0x7f5eb006acb0 2023-09-30T22:30:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.882+0000 7f5ead7fa700 1 -- 172.21.15.59:0/663908512 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ea4032070 con 0x7f5eb006acb0 2023-09-30T22:30:18.883 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.885+0000 7f5eb6de8700 1 -- 172.21.15.59:0/663908512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb006acb0 msgr2=0x7f5eb01c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.885+0000 7f5eb6de8700 1 --2- 172.21.15.59:0/663908512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb006acb0 0x7f5eb01c8510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009c40 tx=0x7f5ea4004750 comp rx=0 tx=0).stop 2023-09-30T22:30:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.885+0000 7f5eb6de8700 1 -- 172.21.15.59:0/663908512 shutdown_connections 2023-09-30T22:30:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.885+0000 7f5eb6de8700 1 --2- 172.21.15.59:0/663908512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb01316c0 0x7f5eb0070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.885+0000 7f5eb6de8700 1 --2- 172.21.15.59:0/663908512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb006acb0 0x7f5eb01c8510 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.885+0000 7f5eb6de8700 1 --2- 172.21.15.59:0/663908512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5eb009d9f0 0x7f5eb01c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.885+0000 7f5eb6de8700 1 -- 172.21.15.59:0/663908512 >> 172.21.15.59:0/663908512 conn(0x7f5eb0066f50 msgr2=0x7f5eb00a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.885+0000 7f5eb6de8700 1 -- 172.21.15.59:0/663908512 shutdown_connections 2023-09-30T22:30:18.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.885+0000 7f5eb6de8700 1 -- 172.21.15.59:0/663908512 wait complete. 2023-09-30T22:30:18.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:18.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.907+0000 7f07b0581700 1 -- 172.21.15.59:0/638704450 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f07a8074ea0 con 0x7f07a80a1340 2023-09-30T22:30:18.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.908+0000 7f079effd700 1 -- 172.21.15.59:0/638704450 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0798017070 con 0x7f07a80a1340 2023-09-30T22:30:18.908 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:18.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.910+0000 7f07b0581700 1 -- 172.21.15.59:0/638704450 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f07a80a1340 msgr2=0x7f07a8121830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.910+0000 7f07b0581700 1 --2- 172.21.15.59:0/638704450 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f07a80a1340 0x7f07a8121830 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f079800e9e0 tx=0x7f079800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.910+0000 7f07b0581700 1 -- 172.21.15.59:0/638704450 shutdown_connections 2023-09-30T22:30:18.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.910+0000 7f07b0581700 1 --2- 172.21.15.59:0/638704450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07a8133fa0 0x7f07a8121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.910+0000 7f07b0581700 1 --2- 172.21.15.59:0/638704450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07a80a0a30 0x7f07a81212f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.910+0000 7f07b0581700 1 --2- 172.21.15.59:0/638704450 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f07a80a1340 0x7f07a8121830 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.910+0000 7f07b0581700 1 -- 172.21.15.59:0/638704450 >> 172.21.15.59:0/638704450 conn(0x7f07a80a6550 msgr2=0x7f07a80a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.910+0000 7f07b0581700 1 -- 172.21.15.59:0/638704450 shutdown_connections 2023-09-30T22:30:18.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:18.910+0000 7f07b0581700 1 -- 172.21.15.59:0/638704450 wait complete. 2023-09-30T22:30:18.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:19.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:19.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.549+0000 7ff44f713700 1 Processor -- start 2023-09-30T22:30:19.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.549+0000 7ff44f713700 1 -- start start 2023-09-30T22:30:19.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44f713700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff44809e930 0x7ff44809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44f713700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff44809f240 0x7ff4481317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44f713700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff448070940 con 0x7ff44809f650 2023-09-30T22:30:19.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44f713700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44806fd60 con 0x7ff44809f240 2023-09-30T22:30:19.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44f713700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44806fa80 con 0x7ff44809e930 2023-09-30T22:30:19.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44ccae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff44809f240 0x7ff4481317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44d4af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff44809e930 0x7ff44809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44d4af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff44809e930 0x7ff44809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57762/0 (socket says 172.21.15.59:57762) 2023-09-30T22:30:19.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44ccae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff44809f240 0x7ff4481317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49138/0 (socket says 172.21.15.59:49138) 2023-09-30T22:30:19.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44d4af700 1 -- 172.21.15.59:0/4189213914 learned_addr learned my addr 172.21.15.59:0/4189213914 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:19.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44dcb0700 1 --1- 172.21.15.59:0/4189213914 >> v1:172.21.15.59:6789/0 conn(0x7ff44809f650 0x7ff448131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39722/0 (socket says 172.21.15.59:39722) 2023-09-30T22:30:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44d4af700 1 -- 172.21.15.59:0/4189213914 >> v2:172.21.15.59:3300/0 conn(0x7ff44809f240 msgr2=0x7ff4481317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44d4af700 1 --2- 172.21.15.59:0/4189213914 >> v2:172.21.15.59:3300/0 conn(0x7ff44809f240 0x7ff4481317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44d4af700 1 -- 172.21.15.59:0/4189213914 >> v1:172.21.15.59:6789/0 conn(0x7ff44809f650 legacy=0x7ff448131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44d4af700 1 -- 172.21.15.59:0/4189213914 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44809fb60 con 0x7ff44809e930 2023-09-30T22:30:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44ccae700 1 --2- 172.21.15.59:0/4189213914 >> v2:172.21.15.59:3300/0 conn(0x7ff44809f240 0x7ff4481317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.550+0000 7ff44d4af700 1 --2- 172.21.15.59:0/4189213914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff44809e930 0x7ff44809ed00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4440098f0 tx=0x7ff444009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4fec5fe10f8ebdb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.551+0000 7ff43ffff700 1 -- 172.21.15.59:0/4189213914 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444011830 con 0x7ff44809e930 2023-09-30T22:30:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.551+0000 7ff43ffff700 1 -- 172.21.15.59:0/4189213914 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444011990 con 0x7ff44809e930 2023-09-30T22:30:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.551+0000 7ff43ffff700 1 -- 172.21.15.59:0/4189213914 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444011d20 con 0x7ff44809e930 2023-09-30T22:30:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.551+0000 7ff44f713700 1 -- 172.21.15.59:0/4189213914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff44809e930 msgr2=0x7ff44809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.551+0000 7ff44f713700 1 --2- 172.21.15.59:0/4189213914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff44809e930 0x7ff44809ed00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4440098f0 tx=0x7ff444009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:19.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.551+0000 7ff44f713700 1 -- 172.21.15.59:0/4189213914 shutdown_connections 2023-09-30T22:30:19.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.551+0000 7ff44f713700 1 --2- 172.21.15.59:0/4189213914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff44809e930 0x7ff44809ed00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.551+0000 7ff44f713700 1 --2- 172.21.15.59:0/4189213914 >> v2:172.21.15.59:3300/0 conn(0x7ff44809f240 0x7ff4481317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.551+0000 7ff44f713700 1 -- 172.21.15.59:0/4189213914 >> 172.21.15.59:0/4189213914 conn(0x7ff4480a4210 msgr2=0x7ff4480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:19.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.551+0000 7ff44f713700 1 -- 172.21.15.59:0/4189213914 shutdown_connections 2023-09-30T22:30:19.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.551+0000 7ff44f713700 1 -- 172.21.15.59:0/4189213914 wait complete. 2023-09-30T22:30:19.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.552+0000 7ff44f713700 1 Processor -- start 2023-09-30T22:30:19.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.552+0000 7ff44f713700 1 -- start start 2023-09-30T22:30:19.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44f713700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff44809e930 0x7ff4481a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44f713700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff44809f240 0x7ff4481a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44f713700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff44809f650 0x7ff4481c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44f713700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4481b9790 con 0x7ff44809f240 2023-09-30T22:30:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44f713700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4481a9b70 con 0x7ff44809f650 2023-09-30T22:30:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44f713700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4481a6400 con 0x7ff44809e930 2023-09-30T22:30:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44ccae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff44809f240 0x7ff4481a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44d4af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff44809e930 0x7ff4481a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44ccae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff44809f240 0x7ff4481a6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49144/0 (socket says 172.21.15.59:49144) 2023-09-30T22:30:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44ccae700 1 -- 172.21.15.59:0/2549156814 learned_addr learned my addr 172.21.15.59:0/2549156814 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44d4af700 1 --2- 172.21.15.59:0/2549156814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff44809e930 0x7ff4481a6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36252/0 (socket says 172.21.15.59:36252) 2023-09-30T22:30:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44dcb0700 1 --2- 172.21.15.59:0/2549156814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff44809f650 0x7ff4481c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44ccae700 1 -- 172.21.15.59:0/2549156814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff44809e930 msgr2=0x7ff4481a6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44ccae700 1 --2- 172.21.15.59:0/2549156814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff44809e930 0x7ff4481a6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44ccae700 1 -- 172.21.15.59:0/2549156814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff44809f650 msgr2=0x7ff4481c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44ccae700 1 --2- 172.21.15.59:0/2549156814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff44809f650 0x7ff4481c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.553+0000 7ff44ccae700 1 -- 172.21.15.59:0/2549156814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4380094a0 con 0x7ff44809f240 2023-09-30T22:30:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.554+0000 7ff44ccae700 1 --2- 172.21.15.59:0/2549156814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff44809f240 0x7ff4481a6db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff43800ebb0 tx=0x7ff43800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.554+0000 7ff43dffb700 1 -- 172.21.15.59:0/2549156814 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800c850 con 0x7ff44809f240 2023-09-30T22:30:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.554+0000 7ff43dffb700 1 -- 172.21.15.59:0/2549156814 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43800c9b0 con 0x7ff44809f240 2023-09-30T22:30:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.554+0000 7ff44f713700 1 -- 172.21.15.59:0/2549156814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff444009550 con 0x7ff44809f240 2023-09-30T22:30:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.554+0000 7ff43dffb700 1 -- 172.21.15.59:0/2549156814 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800cd40 con 0x7ff44809f240 2023-09-30T22:30:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.554+0000 7ff44f713700 1 -- 172.21.15.59:0/2549156814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4480a0190 con 0x7ff44809f240 2023-09-30T22:30:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.555+0000 7ff43dffb700 1 -- 172.21.15.59:0/2549156814 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff438013470 con 0x7ff44809f240 2023-09-30T22:30:19.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.555+0000 7ff44f713700 1 -- 172.21.15.59:0/2549156814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff448074ea0 con 0x7ff44809f240 2023-09-30T22:30:19.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.555+0000 7ff43dffb700 1 -- 172.21.15.59:0/2549156814 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff43803f790 con 0x7ff44809f240 2023-09-30T22:30:19.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.560+0000 7ff43dffb700 1 -- 172.21.15.59:0/2549156814 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4380232f0 con 0x7ff44809f240 2023-09-30T22:30:19.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.764+0000 7ff44f713700 1 -- 172.21.15.59:0/2549156814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff4481a9710 con 0x7ff44809f240 2023-09-30T22:30:19.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.765+0000 7ff43dffb700 1 -- 172.21.15.59:0/2549156814 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff438021020 con 0x7ff44809f240 2023-09-30T22:30:19.765 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:19.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.767+0000 7ff44f713700 1 -- 172.21.15.59:0/2549156814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff44809f240 msgr2=0x7ff4481a6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.767+0000 7ff44f713700 1 --2- 172.21.15.59:0/2549156814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff44809f240 0x7ff4481a6db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff43800ebb0 tx=0x7ff43800eec0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.767+0000 7ff44f713700 1 -- 172.21.15.59:0/2549156814 shutdown_connections 2023-09-30T22:30:19.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.767+0000 7ff44f713700 1 --2- 172.21.15.59:0/2549156814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff44809e930 0x7ff4481a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.767+0000 7ff44f713700 1 --2- 172.21.15.59:0/2549156814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff44809f650 0x7ff4481c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.767+0000 7ff44f713700 1 --2- 172.21.15.59:0/2549156814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff44809f240 0x7ff4481a6db0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.767+0000 7ff44f713700 1 -- 172.21.15.59:0/2549156814 >> 172.21.15.59:0/2549156814 conn(0x7ff4480a4210 msgr2=0x7ff4481bae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:19.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.767+0000 7ff44f713700 1 -- 172.21.15.59:0/2549156814 shutdown_connections 2023-09-30T22:30:19.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:19.767+0000 7ff44f713700 1 -- 172.21.15.59:0/2549156814 wait complete. 2023-09-30T22:30:19.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:19.863 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:19.900 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:19.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:20.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.011+0000 7fcd3eb63700 1 Processor -- start 2023-09-30T22:30:20.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.011+0000 7fcd3eb63700 1 -- start start 2023-09-30T22:30:20.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.012+0000 7fcd3eb63700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809e930 0x7fcd3809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.012+0000 7fcd3eb63700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd3809f650 0x7fcd38131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.012+0000 7fcd3eb63700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd38070940 con 0x7fcd3809f240 2023-09-30T22:30:20.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.012+0000 7fcd3eb63700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3806fd60 con 0x7fcd3809f650 2023-09-30T22:30:20.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.012+0000 7fcd3eb63700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3806fa80 con 0x7fcd3809e930 2023-09-30T22:30:20.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.012+0000 7fcd3c8ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809e930 0x7fcd3809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.012+0000 7fcd3c8ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809e930 0x7fcd3809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36264/0 (socket says 172.21.15.59:36264) 2023-09-30T22:30:20.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.012+0000 7fcd3c8ff700 1 -- 172.21.15.59:0/513178472 learned_addr learned my addr 172.21.15.59:0/513178472 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:20.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.012+0000 7fcd3d100700 1 --2- 172.21.15.59:0/513178472 >> v2:172.21.15.59:3300/0 conn(0x7fcd3809f650 0x7fcd38131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.013+0000 7fcd3c8ff700 1 -- 172.21.15.59:0/513178472 >> v2:172.21.15.59:3300/0 conn(0x7fcd3809f650 msgr2=0x7fcd38131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:20.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.013+0000 7fcd3c8ff700 1 --2- 172.21.15.59:0/513178472 >> v2:172.21.15.59:3300/0 conn(0x7fcd3809f650 0x7fcd38131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.013+0000 7fcd3c8ff700 1 -- 172.21.15.59:0/513178472 >> v1:172.21.15.59:6789/0 conn(0x7fcd3809f240 legacy=0x7fcd381317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.013+0000 7fcd3c8ff700 1 -- 172.21.15.59:0/513178472 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3809fb60 con 0x7fcd3809e930 2023-09-30T22:30:20.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.013+0000 7fcd3c8ff700 1 --2- 172.21.15.59:0/513178472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809e930 0x7fcd3809ed00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcd280098f0 tx=0x7fcd28009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0428cd1614f5f95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.013+0000 7fcd377fe700 1 -- 172.21.15.59:0/513178472 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28011830 con 0x7fcd3809e930 2023-09-30T22:30:20.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.013+0000 7fcd377fe700 1 -- 172.21.15.59:0/513178472 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd28011990 con 0x7fcd3809e930 2023-09-30T22:30:20.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.013+0000 7fcd377fe700 1 -- 172.21.15.59:0/513178472 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28011d20 con 0x7fcd3809e930 2023-09-30T22:30:20.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.014+0000 7fcd3eb63700 1 -- 172.21.15.59:0/513178472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809e930 msgr2=0x7fcd3809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.014+0000 7fcd3eb63700 1 --2- 172.21.15.59:0/513178472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809e930 0x7fcd3809ed00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcd280098f0 tx=0x7fcd28009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:20.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.014+0000 7fcd3eb63700 1 -- 172.21.15.59:0/513178472 shutdown_connections 2023-09-30T22:30:20.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.014+0000 7fcd3eb63700 1 --2- 172.21.15.59:0/513178472 >> v2:172.21.15.59:3300/0 conn(0x7fcd3809f650 0x7fcd38131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.014+0000 7fcd3eb63700 1 --2- 172.21.15.59:0/513178472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809e930 0x7fcd3809ed00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.014+0000 7fcd3eb63700 1 -- 172.21.15.59:0/513178472 >> 172.21.15.59:0/513178472 conn(0x7fcd380a4210 msgr2=0x7fcd380a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:20.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.014+0000 7fcd3eb63700 1 -- 172.21.15.59:0/513178472 shutdown_connections 2023-09-30T22:30:20.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.014+0000 7fcd3eb63700 1 -- 172.21.15.59:0/513178472 wait complete. 2023-09-30T22:30:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.015+0000 7fcd3eb63700 1 Processor -- start 2023-09-30T22:30:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.015+0000 7fcd3eb63700 1 -- start start 2023-09-30T22:30:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd3eb63700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd3809e930 0x7fcd381a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd3eb63700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809f240 0x7fcd381a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd3eb63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd3809f650 0x7fcd381a6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd3eb63700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd381a7230 con 0x7fcd3809e930 2023-09-30T22:30:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd3eb63700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd381a7900 con 0x7fcd3809f650 2023-09-30T22:30:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd3eb63700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd381a8b50 con 0x7fcd3809f240 2023-09-30T22:30:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd37fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809f240 0x7fcd381a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd37fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809f240 0x7fcd381a62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36276/0 (socket says 172.21.15.59:36276) 2023-09-30T22:30:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd37fff700 1 -- 172.21.15.59:0/312422163 learned_addr learned my addr 172.21.15.59:0/312422163 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd3c8ff700 1 --2- 172.21.15.59:0/312422163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd3809e930 0x7fcd381a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd37fff700 1 -- 172.21.15.59:0/312422163 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd3809f650 msgr2=0x7fcd381a6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd37fff700 1 --2- 172.21.15.59:0/312422163 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd3809f650 0x7fcd381a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd37fff700 1 -- 172.21.15.59:0/312422163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd3809e930 msgr2=0x7fcd381a5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd37fff700 1 --2- 172.21.15.59:0/312422163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd3809e930 0x7fcd381a5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd37fff700 1 -- 172.21.15.59:0/312422163 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd28009550 con 0x7fcd3809f240 2023-09-30T22:30:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.016+0000 7fcd37fff700 1 --2- 172.21.15.59:0/312422163 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809f240 0x7fcd381a62c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00c460 tx=0x7fcd2c00c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.017+0000 7fcd357fa700 1 -- 172.21.15.59:0/312422163 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c0052d0 con 0x7fcd3809f240 2023-09-30T22:30:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.017+0000 7fcd3eb63700 1 -- 172.21.15.59:0/312422163 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd380a0190 con 0x7fcd3809f240 2023-09-30T22:30:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.017+0000 7fcd357fa700 1 -- 172.21.15.59:0/312422163 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c005430 con 0x7fcd3809f240 2023-09-30T22:30:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.017+0000 7fcd357fa700 1 -- 172.21.15.59:0/312422163 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c0038c0 con 0x7fcd3809f240 2023-09-30T22:30:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.017+0000 7fcd3eb63700 1 -- 172.21.15.59:0/312422163 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd380a3510 con 0x7fcd3809f240 2023-09-30T22:30:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.018+0000 7fcd357fa700 1 -- 172.21.15.59:0/312422163 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd2c003a20 con 0x7fcd3809f240 2023-09-30T22:30:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.018+0000 7fcd357fa700 1 -- 172.21.15.59:0/312422163 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcd2c03ead0 con 0x7fcd3809f240 2023-09-30T22:30:20.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.018+0000 7fcd3eb63700 1 -- 172.21.15.59:0/312422163 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd381a2b40 con 0x7fcd3809f240 2023-09-30T22:30:20.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.023+0000 7fcd357fa700 1 -- 172.21.15.59:0/312422163 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd2c018260 con 0x7fcd3809f240 2023-09-30T22:30:20.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.056+0000 7f0f58364700 1 Processor -- start 2023-09-30T22:30:20.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.056+0000 7f0f58364700 1 -- start start 2023-09-30T22:30:20.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.056+0000 7f0f58364700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f500a0a30 0x7f0f500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.056+0000 7f0f58364700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f50138d80 0x7f0f5013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.056+0000 7f0f58364700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f500a2a70 con 0x7f0f5009d630 2023-09-30T22:30:20.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.056+0000 7f0f58364700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f500a01d0 con 0x7f0f500a0a30 2023-09-30T22:30:20.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.056+0000 7f0f58364700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5009e2b0 con 0x7f0f50138d80 2023-09-30T22:30:20.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.057+0000 7f0f56901700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f50138d80 0x7f0f5013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.057+0000 7f0f56901700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f50138d80 0x7f0f5013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36288/0 (socket says 172.21.15.59:36288) 2023-09-30T22:30:20.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.057+0000 7f0f56901700 1 -- 172.21.15.59:0/3299041138 learned_addr learned my addr 172.21.15.59:0/3299041138 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:20.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.057+0000 7f0f56100700 1 --2- 172.21.15.59:0/3299041138 >> v2:172.21.15.59:3300/0 conn(0x7f0f500a0a30 0x7f0f500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.057+0000 7f0f56901700 1 -- 172.21.15.59:0/3299041138 >> v2:172.21.15.59:3300/0 conn(0x7f0f500a0a30 msgr2=0x7f0f500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:20.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.057+0000 7f0f56901700 1 --2- 172.21.15.59:0/3299041138 >> v2:172.21.15.59:3300/0 conn(0x7f0f500a0a30 0x7f0f500a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.057+0000 7f0f56901700 1 -- 172.21.15.59:0/3299041138 >> v1:172.21.15.59:6789/0 conn(0x7f0f5009d630 legacy=0x7f0f500a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.057+0000 7f0f56901700 1 -- 172.21.15.59:0/3299041138 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5009dc50 con 0x7f0f50138d80 2023-09-30T22:30:20.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.057+0000 7f0f56100700 1 --2- 172.21.15.59:0/3299041138 >> v2:172.21.15.59:3300/0 conn(0x7f0f500a0a30 0x7f0f500a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:20.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.057+0000 7f0f56901700 1 --2- 172.21.15.59:0/3299041138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f50138d80 0x7f0f5013b160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f480098f0 tx=0x7f0f48009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b64fa57574cea9c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.057+0000 7f0f550fe700 1 -- 172.21.15.59:0/3299041138 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48011830 con 0x7f0f50138d80 2023-09-30T22:30:20.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.057+0000 7f0f550fe700 1 -- 172.21.15.59:0/3299041138 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f48011990 con 0x7f0f50138d80 2023-09-30T22:30:20.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.057+0000 7f0f550fe700 1 -- 172.21.15.59:0/3299041138 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48011d20 con 0x7f0f50138d80 2023-09-30T22:30:20.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.058+0000 7f0f58364700 1 -- 172.21.15.59:0/3299041138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f50138d80 msgr2=0x7f0f5013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.058+0000 7f0f58364700 1 --2- 172.21.15.59:0/3299041138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f50138d80 0x7f0f5013b160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f480098f0 tx=0x7f0f48009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:20.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.058+0000 7f0f58364700 1 -- 172.21.15.59:0/3299041138 shutdown_connections 2023-09-30T22:30:20.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.058+0000 7f0f58364700 1 --2- 172.21.15.59:0/3299041138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f50138d80 0x7f0f5013b160 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.058+0000 7f0f58364700 1 --2- 172.21.15.59:0/3299041138 >> v2:172.21.15.59:3300/0 conn(0x7f0f500a0a30 0x7f0f500a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.058+0000 7f0f58364700 1 -- 172.21.15.59:0/3299041138 >> 172.21.15.59:0/3299041138 conn(0x7f0f500a3050 msgr2=0x7f0f500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.058+0000 7f0f58364700 1 -- 172.21.15.59:0/3299041138 shutdown_connections 2023-09-30T22:30:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.058+0000 7f0f58364700 1 -- 172.21.15.59:0/3299041138 wait complete. 2023-09-30T22:30:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.059+0000 7f0f58364700 1 Processor -- start 2023-09-30T22:30:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.059+0000 7f0f58364700 1 -- start start 2023-09-30T22:30:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.060+0000 7f0f58364700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5009d630 0x7f0f50133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.060+0000 7f0f58364700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f500a0a30 0x7f0f50133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.060+0000 7f0f58364700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f50138d80 0x7f0f501344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.060+0000 7f0f58364700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f50136b90 con 0x7f0f500a0a30 2023-09-30T22:30:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.060+0000 7f0f58364700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f50138090 con 0x7f0f5009d630 2023-09-30T22:30:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.060+0000 7f0f58364700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f501374b0 con 0x7f0f50138d80 2023-09-30T22:30:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.060+0000 7f0f56100700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5009d630 0x7f0f50133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.060+0000 7f0f56100700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5009d630 0x7f0f50133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57792/0 (socket says 172.21.15.59:57792) 2023-09-30T22:30:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.060+0000 7f0f56100700 1 -- 172.21.15.59:0/3442539142 learned_addr learned my addr 172.21.15.59:0/3442539142 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.060+0000 7f0f558ff700 1 --2- 172.21.15.59:0/3442539142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f500a0a30 0x7f0f50133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.060+0000 7f0f56901700 1 --2- 172.21.15.59:0/3442539142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f50138d80 0x7f0f501344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.061+0000 7f0f558ff700 1 -- 172.21.15.59:0/3442539142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f50138d80 msgr2=0x7f0f501344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.061+0000 7f0f558ff700 1 --2- 172.21.15.59:0/3442539142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f50138d80 0x7f0f501344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.061+0000 7f0f558ff700 1 -- 172.21.15.59:0/3442539142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5009d630 msgr2=0x7f0f50133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.061+0000 7f0f558ff700 1 --2- 172.21.15.59:0/3442539142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5009d630 0x7f0f50133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.061+0000 7f0f558ff700 1 -- 172.21.15.59:0/3442539142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c009a70 con 0x7f0f500a0a30 2023-09-30T22:30:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.061+0000 7f0f56100700 1 --2- 172.21.15.59:0/3442539142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5009d630 0x7f0f50133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:20.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.061+0000 7f0f56901700 1 --2- 172.21.15.59:0/3442539142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f50138d80 0x7f0f501344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:20.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.061+0000 7f0f558ff700 1 --2- 172.21.15.59:0/3442539142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f500a0a30 0x7f0f50133f70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c450 tx=0x7f0f4000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.061+0000 7f0f46ffd700 1 -- 172.21.15.59:0/3442539142 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f400052d0 con 0x7f0f500a0a30 2023-09-30T22:30:20.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.061+0000 7f0f46ffd700 1 -- 172.21.15.59:0/3442539142 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f40005430 con 0x7f0f500a0a30 2023-09-30T22:30:20.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.061+0000 7f0f58364700 1 -- 172.21.15.59:0/3442539142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f48009550 con 0x7f0f500a0a30 2023-09-30T22:30:20.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.061+0000 7f0f46ffd700 1 -- 172.21.15.59:0/3442539142 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f400038c0 con 0x7f0f500a0a30 2023-09-30T22:30:20.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.061+0000 7f0f58364700 1 -- 172.21.15.59:0/3442539142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f501371d0 con 0x7f0f500a0a30 2023-09-30T22:30:20.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.062+0000 7f0f46ffd700 1 -- 172.21.15.59:0/3442539142 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f40003a20 con 0x7f0f500a0a30 2023-09-30T22:30:20.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.062+0000 7f0f46ffd700 1 -- 172.21.15.59:0/3442539142 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f4003e9c0 con 0x7f0f500a0a30 2023-09-30T22:30:20.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.062+0000 7f0f58364700 1 -- 172.21.15.59:0/3442539142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f50136e70 con 0x7f0f500a0a30 2023-09-30T22:30:20.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.067+0000 7f0f46ffd700 1 -- 172.21.15.59:0/3442539142 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f50136e70 con 0x7f0f500a0a30 2023-09-30T22:30:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.097+0000 7f45444de700 1 Processor -- start 2023-09-30T22:30:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.097+0000 7f45444de700 1 -- start start 2023-09-30T22:30:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.098+0000 7f45444de700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f453c09c650 0x7f453c09ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.098+0000 7f45444de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c0a0090 0x7f453c09cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.098+0000 7f45444de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c131970 0x7f453c131df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.098+0000 7f45444de700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c09ba70 con 0x7f453c09c650 2023-09-30T22:30:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.098+0000 7f45444de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c09d4a0 con 0x7f453c131970 2023-09-30T22:30:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.098+0000 7f45444de700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f453c09e8f0 con 0x7f453c0a0090 2023-09-30T22:30:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.098+0000 7f4541a79700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c0a0090 0x7f453c09cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.098+0000 7f4541a79700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c0a0090 0x7f453c09cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36298/0 (socket says 172.21.15.59:36298) 2023-09-30T22:30:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.098+0000 7f4541a79700 1 -- 172.21.15.59:0/2753402205 learned_addr learned my addr 172.21.15.59:0/2753402205 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.098+0000 7f4542a7b700 1 --2- 172.21.15.59:0/2753402205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c131970 0x7f453c131df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.098+0000 7f454227a700 1 --2- 172.21.15.59:0/2753402205 >> v2:172.21.15.59:3300/0 conn(0x7f453c09c650 0x7f453c09ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.099+0000 7f4541a79700 1 -- 172.21.15.59:0/2753402205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c131970 msgr2=0x7f453c131df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.099+0000 7f4541a79700 1 --2- 172.21.15.59:0/2753402205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c131970 0x7f453c131df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.099+0000 7f4541a79700 1 -- 172.21.15.59:0/2753402205 >> v2:172.21.15.59:3300/0 conn(0x7f453c09c650 msgr2=0x7f453c09ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.099+0000 7f4541a79700 1 --2- 172.21.15.59:0/2753402205 >> v2:172.21.15.59:3300/0 conn(0x7f453c09c650 0x7f453c09ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.099+0000 7f4541a79700 1 -- 172.21.15.59:0/2753402205 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c0a0760 con 0x7f453c0a0090 2023-09-30T22:30:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.099+0000 7f4542a7b700 1 --2- 172.21.15.59:0/2753402205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c131970 0x7f453c131df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.099+0000 7f4541a79700 1 --2- 172.21.15.59:0/2753402205 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c0a0090 0x7f453c09cf60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f452c0098f0 tx=0x7f452c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19eda329192fc2bf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.099+0000 7f4541278700 1 -- 172.21.15.59:0/2753402205 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c011830 con 0x7f453c0a0090 2023-09-30T22:30:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.099+0000 7f4541278700 1 -- 172.21.15.59:0/2753402205 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c011990 con 0x7f453c0a0090 2023-09-30T22:30:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.099+0000 7f4541278700 1 -- 172.21.15.59:0/2753402205 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c011d20 con 0x7f453c0a0090 2023-09-30T22:30:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.100+0000 7f45444de700 1 -- 172.21.15.59:0/2753402205 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c0a0090 msgr2=0x7f453c09cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.100+0000 7f45444de700 1 --2- 172.21.15.59:0/2753402205 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c0a0090 0x7f453c09cf60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f452c0098f0 tx=0x7f452c009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.100+0000 7f45444de700 1 -- 172.21.15.59:0/2753402205 shutdown_connections 2023-09-30T22:30:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.100+0000 7f45444de700 1 --2- 172.21.15.59:0/2753402205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c131970 0x7f453c131df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.100+0000 7f45444de700 1 --2- 172.21.15.59:0/2753402205 >> v2:172.21.15.59:3300/0 conn(0x7f453c09c650 0x7f453c09ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.100+0000 7f45444de700 1 --2- 172.21.15.59:0/2753402205 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c0a0090 0x7f453c09cf60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.100+0000 7f45444de700 1 -- 172.21.15.59:0/2753402205 >> 172.21.15.59:0/2753402205 conn(0x7f453c0a3f70 msgr2=0x7f453c0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.100+0000 7f45444de700 1 -- 172.21.15.59:0/2753402205 shutdown_connections 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.100+0000 7f45444de700 1 -- 172.21.15.59:0/2753402205 wait complete. 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.101+0000 7f45444de700 1 Processor -- start 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.101+0000 7f45444de700 1 -- start start 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.101+0000 7f45444de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c09c650 0x7f453c11a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.101+0000 7f45444de700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f453c0a0090 0x7f453c11ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.101+0000 7f45444de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c131970 0x7f453c11b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.101+0000 7f45444de700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c11d740 con 0x7f453c0a0090 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.101+0000 7f45444de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c11d9b0 con 0x7f453c09c650 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.101+0000 7f45444de700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f453c12ff40 con 0x7f453c131970 2023-09-30T22:30:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f4541a79700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f453c0a0090 0x7f453c11ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f4541a79700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f453c0a0090 0x7f453c11ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49196/0 (socket says 172.21.15.59:49196) 2023-09-30T22:30:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f4541a79700 1 -- 172.21.15.59:0/1568370198 learned_addr learned my addr 172.21.15.59:0/1568370198 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f454227a700 1 --2- 172.21.15.59:0/1568370198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c09c650 0x7f453c11a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f4542a7b700 1 --2- 172.21.15.59:0/1568370198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c131970 0x7f453c11b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f4541a79700 1 -- 172.21.15.59:0/1568370198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c131970 msgr2=0x7f453c11b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f4541a79700 1 --2- 172.21.15.59:0/1568370198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c131970 0x7f453c11b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f4541a79700 1 -- 172.21.15.59:0/1568370198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c09c650 msgr2=0x7f453c11a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f4541a79700 1 --2- 172.21.15.59:0/1568370198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c09c650 0x7f453c11a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f4541a79700 1 -- 172.21.15.59:0/1568370198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4534009a70 con 0x7f453c0a0090 2023-09-30T22:30:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f454227a700 1 --2- 172.21.15.59:0/1568370198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c09c650 0x7f453c11a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f4541a79700 1 --2- 172.21.15.59:0/1568370198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f453c0a0090 0x7f453c11ab60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f452c009c40 tx=0x7f452c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f4532ffd700 1 -- 172.21.15.59:0/1568370198 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c0042c0 con 0x7f453c0a0090 2023-09-30T22:30:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f4532ffd700 1 -- 172.21.15.59:0/1568370198 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c01f070 con 0x7f453c0a0090 2023-09-30T22:30:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f4532ffd700 1 -- 172.21.15.59:0/1568370198 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c0036a0 con 0x7f453c0a0090 2023-09-30T22:30:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f45444de700 1 -- 172.21.15.59:0/1568370198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f452c009550 con 0x7f453c0a0090 2023-09-30T22:30:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.102+0000 7f45444de700 1 -- 172.21.15.59:0/1568370198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453c09d9d0 con 0x7f453c0a0090 2023-09-30T22:30:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.103+0000 7f4532ffd700 1 -- 172.21.15.59:0/1568370198 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f452c021030 con 0x7f453c0a0090 2023-09-30T22:30:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.104+0000 7f4530ff9700 1 -- 172.21.15.59:0/1568370198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45180052e0 con 0x7f453c0a0090 2023-09-30T22:30:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.104+0000 7f4532ffd700 1 -- 172.21.15.59:0/1568370198 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f452c040910 con 0x7f453c0a0090 2023-09-30T22:30:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.113+0000 7f4532ffd700 1 -- 172.21.15.59:0/1568370198 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f452c0199a0 con 0x7f453c0a0090 2023-09-30T22:30:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.234+0000 7fcd3eb63700 1 -- 172.21.15.59:0/312422163 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd38074ea0 con 0x7fcd3809f240 2023-09-30T22:30:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.234+0000 7fcd357fa700 1 -- 172.21.15.59:0/312422163 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd2c017020 con 0x7fcd3809f240 2023-09-30T22:30:20.235 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.236+0000 7fcd3eb63700 1 -- 172.21.15.59:0/312422163 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809f240 msgr2=0x7fcd381a62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.236+0000 7fcd3eb63700 1 --2- 172.21.15.59:0/312422163 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809f240 0x7fcd381a62c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00c460 tx=0x7fcd2c00c770 comp rx=0 tx=0).stop 2023-09-30T22:30:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.236+0000 7fcd3eb63700 1 -- 172.21.15.59:0/312422163 shutdown_connections 2023-09-30T22:30:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.236+0000 7fcd3eb63700 1 --2- 172.21.15.59:0/312422163 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd3809f650 0x7fcd381a6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.236+0000 7fcd3eb63700 1 --2- 172.21.15.59:0/312422163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd3809e930 0x7fcd381a5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.236+0000 7fcd3eb63700 1 --2- 172.21.15.59:0/312422163 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd3809f240 0x7fcd381a62c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.236+0000 7fcd3eb63700 1 -- 172.21.15.59:0/312422163 >> 172.21.15.59:0/312422163 conn(0x7fcd380a4210 msgr2=0x7fcd3809dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.237+0000 7fcd3eb63700 1 -- 172.21.15.59:0/312422163 shutdown_connections 2023-09-30T22:30:20.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.237+0000 7fcd3eb63700 1 -- 172.21.15.59:0/312422163 wait complete. 2023-09-30T22:30:20.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.281+0000 7f0f58364700 1 -- 172.21.15.59:0/3442539142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0f50136e70 con 0x7f0f500a0a30 2023-09-30T22:30:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.282+0000 7f0f46ffd700 1 -- 172.21.15.59:0/3442539142 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f50136e70 con 0x7f0f500a0a30 2023-09-30T22:30:20.282 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.284+0000 7f0f58364700 1 -- 172.21.15.59:0/3442539142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f500a0a30 msgr2=0x7f0f50133f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.284+0000 7f0f58364700 1 --2- 172.21.15.59:0/3442539142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f500a0a30 0x7f0f50133f70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c450 tx=0x7f0f4000c760 comp rx=0 tx=0).stop 2023-09-30T22:30:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.284+0000 7f0f58364700 1 -- 172.21.15.59:0/3442539142 shutdown_connections 2023-09-30T22:30:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.284+0000 7f0f58364700 1 --2- 172.21.15.59:0/3442539142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f50138d80 0x7f0f501344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.284+0000 7f0f58364700 1 --2- 172.21.15.59:0/3442539142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f5009d630 0x7f0f50133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.284+0000 7f0f58364700 1 --2- 172.21.15.59:0/3442539142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f500a0a30 0x7f0f50133f70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.284+0000 7f0f58364700 1 -- 172.21.15.59:0/3442539142 >> 172.21.15.59:0/3442539142 conn(0x7f0f500a3050 msgr2=0x7f0f5009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.284+0000 7f0f58364700 1 -- 172.21.15.59:0/3442539142 shutdown_connections 2023-09-30T22:30:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.284+0000 7f0f58364700 1 -- 172.21.15.59:0/3442539142 wait complete. 2023-09-30T22:30:20.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:20.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.321+0000 7f4530ff9700 1 -- 172.21.15.59:0/1568370198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4518005590 con 0x7f453c0a0090 2023-09-30T22:30:20.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.321+0000 7f4532ffd700 1 -- 172.21.15.59:0/1568370198 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f452c015030 con 0x7f453c0a0090 2023-09-30T22:30:20.322 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:20.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.324+0000 7f4530ff9700 1 -- 172.21.15.59:0/1568370198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f453c0a0090 msgr2=0x7f453c11ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.324+0000 7f4530ff9700 1 --2- 172.21.15.59:0/1568370198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f453c0a0090 0x7f453c11ab60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f452c009c40 tx=0x7f452c004750 comp rx=0 tx=0).stop 2023-09-30T22:30:20.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.324+0000 7f4530ff9700 1 -- 172.21.15.59:0/1568370198 shutdown_connections 2023-09-30T22:30:20.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.324+0000 7f4530ff9700 1 --2- 172.21.15.59:0/1568370198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c131970 0x7f453c11b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.324+0000 7f4530ff9700 1 --2- 172.21.15.59:0/1568370198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c09c650 0x7f453c11a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.324+0000 7f4530ff9700 1 --2- 172.21.15.59:0/1568370198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f453c0a0090 0x7f453c11ab60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.324+0000 7f4530ff9700 1 -- 172.21.15.59:0/1568370198 >> 172.21.15.59:0/1568370198 conn(0x7f453c0a3f70 msgr2=0x7f453c12ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:20.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.324+0000 7f4530ff9700 1 -- 172.21.15.59:0/1568370198 shutdown_connections 2023-09-30T22:30:20.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.324+0000 7f4530ff9700 1 -- 172.21.15.59:0/1568370198 wait complete. 2023-09-30T22:30:20.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:20.782 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:20.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.927+0000 7fb703add700 1 Processor -- start 2023-09-30T22:30:20.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.928+0000 7fb703add700 1 -- start start 2023-09-30T22:30:20.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.928+0000 7fb703add700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6fc133a80 0x7fb6fc133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.928+0000 7fb703add700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6fc12ff20 0x7fb6fc130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.928+0000 7fb703add700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6fc130870 0x7fb6fc13a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.928+0000 7fb703add700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6fc06c570 con 0x7fb6fc133a80 2023-09-30T22:30:20.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.928+0000 7fb703add700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc06bc00 con 0x7fb6fc12ff20 2023-09-30T22:30:20.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.928+0000 7fb703add700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0a0040 con 0x7fb6fc130870 2023-09-30T22:30:20.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.928+0000 7fb701879700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6fc133a80 0x7fb6fc133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.928+0000 7fb70207a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6fc130870 0x7fb6fc13a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.928+0000 7fb701078700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6fc12ff20 0x7fb6fc130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.928+0000 7fb701879700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6fc133a80 0x7fb6fc133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49198/0 (socket says 172.21.15.59:49198) 2023-09-30T22:30:20.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.928+0000 7fb701879700 1 -- 172.21.15.59:0/152582861 learned_addr learned my addr 172.21.15.59:0/152582861 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:20.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.929+0000 7fb701078700 1 -- 172.21.15.59:0/152582861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6fc130870 msgr2=0x7fb6fc13a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:20.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.929+0000 7fb701078700 1 --2- 172.21.15.59:0/152582861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6fc130870 0x7fb6fc13a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.929+0000 7fb701078700 1 -- 172.21.15.59:0/152582861 >> v2:172.21.15.59:3300/0 conn(0x7fb6fc133a80 msgr2=0x7fb6fc133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:20.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.929+0000 7fb701078700 1 --2- 172.21.15.59:0/152582861 >> v2:172.21.15.59:3300/0 conn(0x7fb6fc133a80 0x7fb6fc133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.929+0000 7fb701078700 1 -- 172.21.15.59:0/152582861 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc133860 con 0x7fb6fc12ff20 2023-09-30T22:30:20.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.929+0000 7fb70207a700 1 --2- 172.21.15.59:0/152582861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6fc130870 0x7fb6fc13a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.929+0000 7fb701879700 1 --2- 172.21.15.59:0/152582861 >> v2:172.21.15.59:3300/0 conn(0x7fb6fc133a80 0x7fb6fc133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.929+0000 7fb701078700 1 --2- 172.21.15.59:0/152582861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6fc12ff20 0x7fb6fc130330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009840 tx=0x7fb6ec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60bb0828ab3ec0ac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.929+0000 7fb700877700 1 -- 172.21.15.59:0/152582861 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec011830 con 0x7fb6fc12ff20 2023-09-30T22:30:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.929+0000 7fb700877700 1 -- 172.21.15.59:0/152582861 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec011990 con 0x7fb6fc12ff20 2023-09-30T22:30:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.929+0000 7fb700877700 1 -- 172.21.15.59:0/152582861 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec011d20 con 0x7fb6fc12ff20 2023-09-30T22:30:20.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.930+0000 7fb703add700 1 -- 172.21.15.59:0/152582861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6fc12ff20 msgr2=0x7fb6fc130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.930+0000 7fb703add700 1 --2- 172.21.15.59:0/152582861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6fc12ff20 0x7fb6fc130330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009840 tx=0x7fb6ec009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:20.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.930+0000 7fb703add700 1 -- 172.21.15.59:0/152582861 shutdown_connections 2023-09-30T22:30:20.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.930+0000 7fb703add700 1 --2- 172.21.15.59:0/152582861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6fc130870 0x7fb6fc13a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.930+0000 7fb703add700 1 --2- 172.21.15.59:0/152582861 >> v2:172.21.15.59:3300/0 conn(0x7fb6fc133a80 0x7fb6fc133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.930+0000 7fb703add700 1 --2- 172.21.15.59:0/152582861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6fc12ff20 0x7fb6fc130330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.930+0000 7fb703add700 1 -- 172.21.15.59:0/152582861 >> 172.21.15.59:0/152582861 conn(0x7fb6fc0a4210 msgr2=0x7fb6fc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:20.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.930+0000 7fb703add700 1 -- 172.21.15.59:0/152582861 shutdown_connections 2023-09-30T22:30:20.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.930+0000 7fb703add700 1 -- 172.21.15.59:0/152582861 wait complete. 2023-09-30T22:30:20.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.931+0000 7fb703add700 1 Processor -- start 2023-09-30T22:30:20.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.931+0000 7fb703add700 1 -- start start 2023-09-30T22:30:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.931+0000 7fb703add700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6fc12ff20 0x7fb6fc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.931+0000 7fb703add700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6fc130870 0x7fb6fc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.931+0000 7fb703add700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6fc133a80 0x7fb6fc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.931+0000 7fb703add700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc11f1a0 con 0x7fb6fc12ff20 2023-09-30T22:30:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.931+0000 7fb703add700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc12dc50 con 0x7fb6fc133a80 2023-09-30T22:30:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.931+0000 7fb703add700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc12da60 con 0x7fb6fc130870 2023-09-30T22:30:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.931+0000 7fb701879700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6fc12ff20 0x7fb6fc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.931+0000 7fb701879700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6fc12ff20 0x7fb6fc09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49202/0 (socket says 172.21.15.59:49202) 2023-09-30T22:30:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.931+0000 7fb701879700 1 -- 172.21.15.59:0/673693622 learned_addr learned my addr 172.21.15.59:0/673693622 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.931+0000 7fb70207a700 1 --2- 172.21.15.59:0/673693622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6fc133a80 0x7fb6fc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.931+0000 7fb701078700 1 --2- 172.21.15.59:0/673693622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6fc130870 0x7fb6fc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.932+0000 7fb701879700 1 -- 172.21.15.59:0/673693622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6fc130870 msgr2=0x7fb6fc09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.932+0000 7fb701879700 1 --2- 172.21.15.59:0/673693622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6fc130870 0x7fb6fc09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.932+0000 7fb701879700 1 -- 172.21.15.59:0/673693622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6fc133a80 msgr2=0x7fb6fc09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.932+0000 7fb701879700 1 --2- 172.21.15.59:0/673693622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6fc133a80 0x7fb6fc09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.932+0000 7fb701879700 1 -- 172.21.15.59:0/673693622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f4009a70 con 0x7fb6fc12ff20 2023-09-30T22:30:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.932+0000 7fb701879700 1 --2- 172.21.15.59:0/673693622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6fc12ff20 0x7fb6fc09c480 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800ebe0 tx=0x7fb6f800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.932+0000 7fb6f27fc700 1 -- 172.21.15.59:0/673693622 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f800c850 con 0x7fb6fc12ff20 2023-09-30T22:30:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.932+0000 7fb6f27fc700 1 -- 172.21.15.59:0/673693622 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f800c9b0 con 0x7fb6fc12ff20 2023-09-30T22:30:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.932+0000 7fb703add700 1 -- 172.21.15.59:0/673693622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f8009550 con 0x7fb6fc12ff20 2023-09-30T22:30:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.932+0000 7fb6f27fc700 1 -- 172.21.15.59:0/673693622 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f800cd20 con 0x7fb6fc12ff20 2023-09-30T22:30:20.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.932+0000 7fb703add700 1 -- 172.21.15.59:0/673693622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ec0094a0 con 0x7fb6fc12ff20 2023-09-30T22:30:20.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.933+0000 7fb6f27fc700 1 -- 172.21.15.59:0/673693622 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6f8013470 con 0x7fb6fc12ff20 2023-09-30T22:30:20.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.933+0000 7fb6f27fc700 1 -- 172.21.15.59:0/673693622 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb6f803f710 con 0x7fb6fc12ff20 2023-09-30T22:30:20.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.933+0000 7fb703add700 1 -- 172.21.15.59:0/673693622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6fc074ea0 con 0x7fb6fc12ff20 2023-09-30T22:30:20.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:20.938+0000 7fb6f27fc700 1 -- 172.21.15.59:0/673693622 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6f8021080 con 0x7fb6fc12ff20 2023-09-30T22:30:21.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.142+0000 7fb703add700 1 -- 172.21.15.59:0/673693622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb6fc11f4f0 con 0x7fb6fc12ff20 2023-09-30T22:30:21.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.142+0000 7fb6f27fc700 1 -- 172.21.15.59:0/673693622 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6f8017020 con 0x7fb6fc12ff20 2023-09-30T22:30:21.143 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:21.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.145+0000 7fb703add700 1 -- 172.21.15.59:0/673693622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6fc12ff20 msgr2=0x7fb6fc09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.145+0000 7fb703add700 1 --2- 172.21.15.59:0/673693622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6fc12ff20 0x7fb6fc09c480 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800ebe0 tx=0x7fb6f800eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.145+0000 7fb703add700 1 -- 172.21.15.59:0/673693622 shutdown_connections 2023-09-30T22:30:21.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.145+0000 7fb703add700 1 --2- 172.21.15.59:0/673693622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6fc133a80 0x7fb6fc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.145+0000 7fb703add700 1 --2- 172.21.15.59:0/673693622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6fc12ff20 0x7fb6fc09c480 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.145+0000 7fb703add700 1 --2- 172.21.15.59:0/673693622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6fc130870 0x7fb6fc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.145+0000 7fb703add700 1 -- 172.21.15.59:0/673693622 >> 172.21.15.59:0/673693622 conn(0x7fb6fc0a4210 msgr2=0x7fb6fc09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:21.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.145+0000 7fb703add700 1 -- 172.21.15.59:0/673693622 shutdown_connections 2023-09-30T22:30:21.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.145+0000 7fb703add700 1 -- 172.21.15.59:0/673693622 wait complete. 2023-09-30T22:30:21.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:21.252 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:21.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:21.339 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:21.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.398+0000 7f37c2ee8700 1 Processor -- start 2023-09-30T22:30:21.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.398+0000 7f37c2ee8700 1 -- start start 2023-09-30T22:30:21.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.399+0000 7f37c2ee8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37bc130670 0x7f37bc130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.399+0000 7f37c2ee8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37bc0701a0 0x7f37bc138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.399+0000 7f37c2ee8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37bc130260 con 0x7f37bc06f680 2023-09-30T22:30:21.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.399+0000 7f37c2ee8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37bc071ff0 con 0x7f37bc0701a0 2023-09-30T22:30:21.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.399+0000 7f37c2ee8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc09ecf0 con 0x7f37bc130670 2023-09-30T22:30:21.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.399+0000 7f37c0c84700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37bc130670 0x7f37bc130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.399+0000 7f37bbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f37bc06f680 0x7f37bc06fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39742/0 (socket says 172.21.15.59:39742) 2023-09-30T22:30:21.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.399+0000 7f37bbfff700 1 -- 172.21.15.59:0/3095056894 learned_addr learned my addr 172.21.15.59:0/3095056894 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:21.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.399+0000 7f37c1485700 1 --2- 172.21.15.59:0/3095056894 >> v2:172.21.15.59:3300/0 conn(0x7f37bc0701a0 0x7f37bc138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.399+0000 7f37c0c84700 1 -- 172.21.15.59:0/3095056894 >> v2:172.21.15.59:3300/0 conn(0x7f37bc0701a0 msgr2=0x7f37bc138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:21.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.399+0000 7f37c0c84700 1 --2- 172.21.15.59:0/3095056894 >> v2:172.21.15.59:3300/0 conn(0x7f37bc0701a0 0x7f37bc138540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.399+0000 7f37c0c84700 1 -- 172.21.15.59:0/3095056894 >> v1:172.21.15.59:6789/0 conn(0x7f37bc06f680 legacy=0x7f37bc06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.399+0000 7f37c0c84700 1 -- 172.21.15.59:0/3095056894 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc070e70 con 0x7f37bc130670 2023-09-30T22:30:21.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.400+0000 7f37c0c84700 1 --2- 172.21.15.59:0/3095056894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37bc130670 0x7f37bc130a40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009840 tx=0x7f37b0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3a2a7e408f0e8f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.400+0000 7f37bb7fe700 1 -- 172.21.15.59:0/3095056894 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0011830 con 0x7f37bc130670 2023-09-30T22:30:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.400+0000 7f37bb7fe700 1 -- 172.21.15.59:0/3095056894 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b0011990 con 0x7f37bc130670 2023-09-30T22:30:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.400+0000 7f37bb7fe700 1 -- 172.21.15.59:0/3095056894 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0011d20 con 0x7f37bc130670 2023-09-30T22:30:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.401+0000 7f37c2ee8700 1 -- 172.21.15.59:0/3095056894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37bc130670 msgr2=0x7f37bc130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.401+0000 7f37c2ee8700 1 --2- 172.21.15.59:0/3095056894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37bc130670 0x7f37bc130a40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009840 tx=0x7f37b0009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.401+0000 7f37c2ee8700 1 -- 172.21.15.59:0/3095056894 shutdown_connections 2023-09-30T22:30:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.401+0000 7f37c2ee8700 1 --2- 172.21.15.59:0/3095056894 >> v2:172.21.15.59:3300/0 conn(0x7f37bc0701a0 0x7f37bc138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.401+0000 7f37c2ee8700 1 --2- 172.21.15.59:0/3095056894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37bc130670 0x7f37bc130a40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.401+0000 7f37c2ee8700 1 -- 172.21.15.59:0/3095056894 >> 172.21.15.59:0/3095056894 conn(0x7f37bc0a2aa0 msgr2=0x7f37bc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.401+0000 7f37c2ee8700 1 -- 172.21.15.59:0/3095056894 shutdown_connections 2023-09-30T22:30:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.401+0000 7f37c2ee8700 1 -- 172.21.15.59:0/3095056894 wait complete. 2023-09-30T22:30:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.402+0000 7f37c2ee8700 1 Processor -- start 2023-09-30T22:30:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.402+0000 7f37c2ee8700 1 -- start start 2023-09-30T22:30:21.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37c2ee8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37bc06f680 0x7f37bc11b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37c2ee8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37bc0701a0 0x7f37bc11beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37c2ee8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37bc130670 0x7f37bc11c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37c2ee8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc11de00 con 0x7f37bc06f680 2023-09-30T22:30:21.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37c2ee8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc09fda0 con 0x7f37bc130670 2023-09-30T22:30:21.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37c2ee8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc11f440 con 0x7f37bc0701a0 2023-09-30T22:30:21.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37c0c84700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37bc06f680 0x7f37bc11b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37c0c84700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37bc06f680 0x7f37bc11b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49212/0 (socket says 172.21.15.59:49212) 2023-09-30T22:30:21.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37c0c84700 1 -- 172.21.15.59:0/2247933455 learned_addr learned my addr 172.21.15.59:0/2247933455 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:21.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37c1485700 1 --2- 172.21.15.59:0/2247933455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37bc130670 0x7f37bc11c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37bbfff700 1 --2- 172.21.15.59:0/2247933455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37bc0701a0 0x7f37bc11beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37c0c84700 1 -- 172.21.15.59:0/2247933455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37bc0701a0 msgr2=0x7f37bc11beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37c0c84700 1 --2- 172.21.15.59:0/2247933455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37bc0701a0 0x7f37bc11beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37c0c84700 1 -- 172.21.15.59:0/2247933455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37bc130670 msgr2=0x7f37bc11c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37c0c84700 1 --2- 172.21.15.59:0/2247933455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37bc130670 0x7f37bc11c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.403+0000 7f37c0c84700 1 -- 172.21.15.59:0/2247933455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b00094a0 con 0x7f37bc06f680 2023-09-30T22:30:21.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.404+0000 7f37c0c84700 1 --2- 172.21.15.59:0/2247933455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37bc06f680 0x7f37bc11b970 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009b90 tx=0x7f37b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:21.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.404+0000 7f37b97fa700 1 -- 172.21.15.59:0/2247933455 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0004590 con 0x7f37bc06f680 2023-09-30T22:30:21.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.404+0000 7f37b97fa700 1 -- 172.21.15.59:0/2247933455 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b00036a0 con 0x7f37bc06f680 2023-09-30T22:30:21.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.404+0000 7f37c2ee8700 1 -- 172.21.15.59:0/2247933455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc071820 con 0x7f37bc06f680 2023-09-30T22:30:21.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.404+0000 7f37b97fa700 1 -- 172.21.15.59:0/2247933455 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0003a30 con 0x7f37bc06f680 2023-09-30T22:30:21.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.404+0000 7f37c2ee8700 1 -- 172.21.15.59:0/2247933455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc11da80 con 0x7f37bc06f680 2023-09-30T22:30:21.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.405+0000 7f37b97fa700 1 -- 172.21.15.59:0/2247933455 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37b0003b90 con 0x7f37bc06f680 2023-09-30T22:30:21.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.405+0000 7f37c2ee8700 1 -- 172.21.15.59:0/2247933455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc11e810 con 0x7f37bc06f680 2023-09-30T22:30:21.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.405+0000 7f37b97fa700 1 -- 172.21.15.59:0/2247933455 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f37b0040a20 con 0x7f37bc06f680 2023-09-30T22:30:21.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.414+0000 7f37b97fa700 1 -- 172.21.15.59:0/2247933455 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37b0003e40 con 0x7f37bc06f680 2023-09-30T22:30:21.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.446+0000 7f298b3b6700 1 Processor -- start 2023-09-30T22:30:21.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.447+0000 7f298b3b6700 1 -- start start 2023-09-30T22:30:21.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.447+0000 7f298b3b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29840a0a30 0x7f29840a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.447+0000 7f298b3b6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f29840a1340 0x7f2984133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.447+0000 7f298b3b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2984133fa0 0x7f2984134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.447+0000 7f298b3b6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298409edd0 con 0x7f29840a1340 2023-09-30T22:30:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.447+0000 7f298b3b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298409e1f0 con 0x7f29840a0a30 2023-09-30T22:30:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.447+0000 7f298b3b6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f298409dc50 con 0x7f2984133fa0 2023-09-30T22:30:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.447+0000 7f2989152700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29840a0a30 0x7f29840a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.447+0000 7f2988951700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f29840a1340 0x7f2984133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.448+0000 7f2989152700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29840a0a30 0x7f29840a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57860/0 (socket says 172.21.15.59:57860) 2023-09-30T22:30:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.448+0000 7f2988951700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f29840a1340 0x7f2984133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49214/0 (socket says 172.21.15.59:49214) 2023-09-30T22:30:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.448+0000 7f2989152700 1 -- 172.21.15.59:0/733724497 learned_addr learned my addr 172.21.15.59:0/733724497 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.448+0000 7f2989953700 1 --2- 172.21.15.59:0/733724497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2984133fa0 0x7f2984134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.448+0000 7f2988951700 1 -- 172.21.15.59:0/733724497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2984133fa0 msgr2=0x7f2984134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.448+0000 7f2988951700 1 --2- 172.21.15.59:0/733724497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2984133fa0 0x7f2984134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.448+0000 7f2988951700 1 -- 172.21.15.59:0/733724497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29840a0a30 msgr2=0x7f29840a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.448+0000 7f2988951700 1 --2- 172.21.15.59:0/733724497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29840a0a30 0x7f29840a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.448+0000 7f2988951700 1 -- 172.21.15.59:0/733724497 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29840a1fe0 con 0x7f29840a1340 2023-09-30T22:30:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.448+0000 7f2989953700 1 --2- 172.21.15.59:0/733724497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2984133fa0 0x7f2984134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.448+0000 7f2989152700 1 --2- 172.21.15.59:0/733724497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29840a0a30 0x7f29840a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.448+0000 7f2988951700 1 --2- 172.21.15.59:0/733724497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29840a1340 0x7f2984133a60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2978009840 tx=0x7f2978009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42e20c8f01fbf3c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.448+0000 7f2983fff700 1 -- 172.21.15.59:0/733724497 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978011830 con 0x7f29840a1340 2023-09-30T22:30:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.448+0000 7f2983fff700 1 -- 172.21.15.59:0/733724497 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2978011990 con 0x7f29840a1340 2023-09-30T22:30:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.448+0000 7f2983fff700 1 -- 172.21.15.59:0/733724497 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978011d20 con 0x7f29840a1340 2023-09-30T22:30:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.449+0000 7f298b3b6700 1 -- 172.21.15.59:0/733724497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29840a1340 msgr2=0x7f2984133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.449+0000 7f298b3b6700 1 --2- 172.21.15.59:0/733724497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29840a1340 0x7f2984133a60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2978009840 tx=0x7f2978009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.449+0000 7f298b3b6700 1 -- 172.21.15.59:0/733724497 shutdown_connections 2023-09-30T22:30:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.449+0000 7f298b3b6700 1 --2- 172.21.15.59:0/733724497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2984133fa0 0x7f2984134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.449+0000 7f298b3b6700 1 --2- 172.21.15.59:0/733724497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29840a0a30 0x7f29840a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.449+0000 7f298b3b6700 1 --2- 172.21.15.59:0/733724497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29840a1340 0x7f2984133a60 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.449+0000 7f298b3b6700 1 -- 172.21.15.59:0/733724497 >> 172.21.15.59:0/733724497 conn(0x7f29840a6550 msgr2=0x7f29840a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.450+0000 7f298b3b6700 1 -- 172.21.15.59:0/733724497 shutdown_connections 2023-09-30T22:30:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.450+0000 7f298b3b6700 1 -- 172.21.15.59:0/733724497 wait complete. 2023-09-30T22:30:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.451+0000 7f298b3b6700 1 Processor -- start 2023-09-30T22:30:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.451+0000 7f298b3b6700 1 -- start start 2023-09-30T22:30:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.451+0000 7f298b3b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29840a0a30 0x7f2984120130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.451+0000 7f298b3b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29840a1340 0x7f2984120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.451+0000 7f298b3b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2984133fa0 0x7f2984120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.451+0000 7f298b3b6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2984123c50 con 0x7f29840a0a30 2023-09-30T22:30:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.451+0000 7f298b3b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2984123020 con 0x7f29840a1340 2023-09-30T22:30:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.451+0000 7f298b3b6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29840a3530 con 0x7f2984133fa0 2023-09-30T22:30:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.451+0000 7f2988951700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29840a1340 0x7f2984120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.451+0000 7f2988951700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29840a1340 0x7f2984120670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57870/0 (socket says 172.21.15.59:57870) 2023-09-30T22:30:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.451+0000 7f2988951700 1 -- 172.21.15.59:0/2582281164 learned_addr learned my addr 172.21.15.59:0/2582281164 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.451+0000 7f2989953700 1 --2- 172.21.15.59:0/2582281164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2984133fa0 0x7f2984120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.451+0000 7f2989152700 1 --2- 172.21.15.59:0/2582281164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29840a0a30 0x7f2984120130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.452+0000 7f2989152700 1 -- 172.21.15.59:0/2582281164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2984133fa0 msgr2=0x7f2984120bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.452+0000 7f2989152700 1 --2- 172.21.15.59:0/2582281164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2984133fa0 0x7f2984120bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.452+0000 7f2989152700 1 -- 172.21.15.59:0/2582281164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29840a1340 msgr2=0x7f2984120670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.452+0000 7f2989152700 1 --2- 172.21.15.59:0/2582281164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29840a1340 0x7f2984120670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.452+0000 7f2989152700 1 -- 172.21.15.59:0/2582281164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2974009550 con 0x7f29840a0a30 2023-09-30T22:30:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.452+0000 7f2988951700 1 --2- 172.21.15.59:0/2582281164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29840a1340 0x7f2984120670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.452+0000 7f2989152700 1 --2- 172.21.15.59:0/2582281164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29840a0a30 0x7f2984120130 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f297400e9a0 tx=0x7f297400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.452+0000 7f2981ffb700 1 -- 172.21.15.59:0/2582281164 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974004030 con 0x7f29840a0a30 2023-09-30T22:30:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.452+0000 7f2981ffb700 1 -- 172.21.15.59:0/2582281164 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2974004190 con 0x7f29840a0a30 2023-09-30T22:30:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.452+0000 7f298b3b6700 1 -- 172.21.15.59:0/2582281164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297c009a70 con 0x7f29840a0a30 2023-09-30T22:30:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.452+0000 7f2981ffb700 1 -- 172.21.15.59:0/2582281164 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974004520 con 0x7f29840a0a30 2023-09-30T22:30:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.453+0000 7f298b3b6700 1 -- 172.21.15.59:0/2582281164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29780094a0 con 0x7f29840a0a30 2023-09-30T22:30:21.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.454+0000 7f298b3b6700 1 -- 172.21.15.59:0/2582281164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29841237d0 con 0x7f29840a0a30 2023-09-30T22:30:21.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.454+0000 7f2981ffb700 1 -- 172.21.15.59:0/2582281164 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29740036a0 con 0x7f29840a0a30 2023-09-30T22:30:21.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.454+0000 7f2981ffb700 1 -- 172.21.15.59:0/2582281164 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2974047350 con 0x7f29840a0a30 2023-09-30T22:30:21.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.463+0000 7f2981ffb700 1 -- 172.21.15.59:0/2582281164 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29841237d0 con 0x7f29840a0a30 2023-09-30T22:30:21.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.498+0000 7f039f1b3700 1 Processor -- start 2023-09-30T22:30:21.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.498+0000 7f039f1b3700 1 -- start start 2023-09-30T22:30:21.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.498+0000 7f039f1b3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03980a0a30 0x7f03980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.498+0000 7f039f1b3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f039809d630 0x7f03980a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.498+0000 7f039f1b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0398133930 0x7f0398133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.498+0000 7f039f1b3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03980a2a70 con 0x7f039809d630 2023-09-30T22:30:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.498+0000 7f039f1b3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03980a01d0 con 0x7f0398133930 2023-09-30T22:30:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.498+0000 7f039f1b3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f039809e2b0 con 0x7f03980a0a30 2023-09-30T22:30:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.498+0000 7f0397fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f039809d630 0x7f03980a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.498+0000 7f039d750700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0398133930 0x7f0398133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.498+0000 7f0397fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f039809d630 0x7f03980a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49242/0 (socket says 172.21.15.59:49242) 2023-09-30T22:30:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.498+0000 7f039cf4f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03980a0a30 0x7f03980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.498+0000 7f0397fff700 1 -- 172.21.15.59:0/124366894 learned_addr learned my addr 172.21.15.59:0/124366894 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.499+0000 7f0397fff700 1 -- 172.21.15.59:0/124366894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03980a0a30 msgr2=0x7f03980a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.499+0000 7f0397fff700 1 --2- 172.21.15.59:0/124366894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03980a0a30 0x7f03980a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.499+0000 7f0397fff700 1 -- 172.21.15.59:0/124366894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0398133930 msgr2=0x7f0398133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:21.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.499+0000 7f0397fff700 1 --2- 172.21.15.59:0/124366894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0398133930 0x7f0398133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.499+0000 7f0397fff700 1 -- 172.21.15.59:0/124366894 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039809dc50 con 0x7f039809d630 2023-09-30T22:30:21.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.499+0000 7f039cf4f700 1 --2- 172.21.15.59:0/124366894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03980a0a30 0x7f03980a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:21.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.499+0000 7f039d750700 1 --2- 172.21.15.59:0/124366894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0398133930 0x7f0398133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:21.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.499+0000 7f0397fff700 1 --2- 172.21.15.59:0/124366894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f039809d630 0x7f03980a1340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f03840098f0 tx=0x7f0384009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93cc28fa324c61 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:21.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.499+0000 7f03977fe700 1 -- 172.21.15.59:0/124366894 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384011830 con 0x7f039809d630 2023-09-30T22:30:21.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.499+0000 7f03977fe700 1 -- 172.21.15.59:0/124366894 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0384011990 con 0x7f039809d630 2023-09-30T22:30:21.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.499+0000 7f03977fe700 1 -- 172.21.15.59:0/124366894 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384011d20 con 0x7f039809d630 2023-09-30T22:30:21.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.500+0000 7f039f1b3700 1 -- 172.21.15.59:0/124366894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f039809d630 msgr2=0x7f03980a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.500+0000 7f039f1b3700 1 --2- 172.21.15.59:0/124366894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f039809d630 0x7f03980a1340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f03840098f0 tx=0x7f0384009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:21.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.500+0000 7f039f1b3700 1 -- 172.21.15.59:0/124366894 shutdown_connections 2023-09-30T22:30:21.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.500+0000 7f039f1b3700 1 --2- 172.21.15.59:0/124366894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0398133930 0x7f0398133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.500+0000 7f039f1b3700 1 --2- 172.21.15.59:0/124366894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03980a0a30 0x7f03980a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.500+0000 7f039f1b3700 1 --2- 172.21.15.59:0/124366894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f039809d630 0x7f03980a1340 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.500+0000 7f039f1b3700 1 -- 172.21.15.59:0/124366894 >> 172.21.15.59:0/124366894 conn(0x7f03980a3050 msgr2=0x7f03980a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:21.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.500+0000 7f039f1b3700 1 -- 172.21.15.59:0/124366894 shutdown_connections 2023-09-30T22:30:21.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.500+0000 7f039f1b3700 1 -- 172.21.15.59:0/124366894 wait complete. 2023-09-30T22:30:21.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.501+0000 7f039f1b3700 1 Processor -- start 2023-09-30T22:30:21.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.501+0000 7f039f1b3700 1 -- start start 2023-09-30T22:30:21.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.502+0000 7f039f1b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f039809d630 0x7f03981c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.502+0000 7f039f1b3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03980a0a30 0x7f03981c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.502+0000 7f039f1b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0398133930 0x7f03981c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.502+0000 7f039f1b3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03981206a0 con 0x7f039809d630 2023-09-30T22:30:21.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.502+0000 7f039f1b3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03981204b0 con 0x7f0398133930 2023-09-30T22:30:21.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.502+0000 7f039f1b3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03981223c0 con 0x7f03980a0a30 2023-09-30T22:30:21.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.502+0000 7f039cf4f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f039809d630 0x7f03981c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.502+0000 7f039cf4f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f039809d630 0x7f03981c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49250/0 (socket says 172.21.15.59:49250) 2023-09-30T22:30:21.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.502+0000 7f039cf4f700 1 -- 172.21.15.59:0/1885653631 learned_addr learned my addr 172.21.15.59:0/1885653631 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:21.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.502+0000 7f0397fff700 1 --2- 172.21.15.59:0/1885653631 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03980a0a30 0x7f03981c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.502+0000 7f039d750700 1 --2- 172.21.15.59:0/1885653631 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0398133930 0x7f03981c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.503+0000 7f039cf4f700 1 -- 172.21.15.59:0/1885653631 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03980a0a30 msgr2=0x7f03981c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.503+0000 7f039cf4f700 1 --2- 172.21.15.59:0/1885653631 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03980a0a30 0x7f03981c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.503+0000 7f039cf4f700 1 -- 172.21.15.59:0/1885653631 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0398133930 msgr2=0x7f03981c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.503+0000 7f039cf4f700 1 --2- 172.21.15.59:0/1885653631 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0398133930 0x7f03981c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.503+0000 7f039cf4f700 1 -- 172.21.15.59:0/1885653631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c0094a0 con 0x7f039809d630 2023-09-30T22:30:21.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.503+0000 7f039cf4f700 1 --2- 172.21.15.59:0/1885653631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f039809d630 0x7f03981c8100 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f038c00ebe0 tx=0x7f038c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:21.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.503+0000 7f03957fa700 1 -- 172.21.15.59:0/1885653631 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c009800 con 0x7f039809d630 2023-09-30T22:30:21.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.503+0000 7f03957fa700 1 -- 172.21.15.59:0/1885653631 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c00c910 con 0x7f039809d630 2023-09-30T22:30:21.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.503+0000 7f03957fa700 1 -- 172.21.15.59:0/1885653631 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c00cc80 con 0x7f039809d630 2023-09-30T22:30:21.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.503+0000 7f039f1b3700 1 -- 172.21.15.59:0/1885653631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0390009a70 con 0x7f039809d630 2023-09-30T22:30:21.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.503+0000 7f039f1b3700 1 -- 172.21.15.59:0/1885653631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0384009550 con 0x7f039809d630 2023-09-30T22:30:21.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.504+0000 7f03957fa700 1 -- 172.21.15.59:0/1885653631 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f038c013470 con 0x7f039809d630 2023-09-30T22:30:21.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.504+0000 7f039f1b3700 1 -- 172.21.15.59:0/1885653631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03980747f0 con 0x7f039809d630 2023-09-30T22:30:21.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.504+0000 7f03957fa700 1 -- 172.21.15.59:0/1885653631 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f038c03f8d0 con 0x7f039809d630 2023-09-30T22:30:21.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.514+0000 7f03957fa700 1 -- 172.21.15.59:0/1885653631 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f038c00ce80 con 0x7f039809d630 2023-09-30T22:30:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.631+0000 7f37c2ee8700 1 -- 172.21.15.59:0/2247933455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37bc11efb0 con 0x7f37bc06f680 2023-09-30T22:30:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.631+0000 7f37b97fa700 1 -- 172.21.15.59:0/2247933455 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f37b0015070 con 0x7f37bc06f680 2023-09-30T22:30:21.631 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.634+0000 7f37c2ee8700 1 -- 172.21.15.59:0/2247933455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37bc06f680 msgr2=0x7f37bc11b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.634+0000 7f37c2ee8700 1 --2- 172.21.15.59:0/2247933455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37bc06f680 0x7f37bc11b970 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009b90 tx=0x7f37b0004750 comp rx=0 tx=0).stop 2023-09-30T22:30:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.634+0000 7f37c2ee8700 1 -- 172.21.15.59:0/2247933455 shutdown_connections 2023-09-30T22:30:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.634+0000 7f37c2ee8700 1 --2- 172.21.15.59:0/2247933455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37bc130670 0x7f37bc11c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.634+0000 7f37c2ee8700 1 --2- 172.21.15.59:0/2247933455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37bc06f680 0x7f37bc11b970 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.634+0000 7f37c2ee8700 1 --2- 172.21.15.59:0/2247933455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37bc0701a0 0x7f37bc11beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.634+0000 7f37c2ee8700 1 -- 172.21.15.59:0/2247933455 >> 172.21.15.59:0/2247933455 conn(0x7f37bc0a2aa0 msgr2=0x7f37bc0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.634+0000 7f37c2ee8700 1 -- 172.21.15.59:0/2247933455 shutdown_connections 2023-09-30T22:30:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.635+0000 7f37c2ee8700 1 -- 172.21.15.59:0/2247933455 wait complete. 2023-09-30T22:30:21.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:21.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.676+0000 7f298b3b6700 1 -- 172.21.15.59:0/2582281164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f29841237d0 con 0x7f29840a0a30 2023-09-30T22:30:21.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.676+0000 7f2981ffb700 1 -- 172.21.15.59:0/2582281164 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29841237d0 con 0x7f29840a0a30 2023-09-30T22:30:21.677 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:21.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.679+0000 7f298b3b6700 1 -- 172.21.15.59:0/2582281164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29840a0a30 msgr2=0x7f2984120130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.679+0000 7f298b3b6700 1 --2- 172.21.15.59:0/2582281164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29840a0a30 0x7f2984120130 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f297400e9a0 tx=0x7f297400ecb0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.679+0000 7f298b3b6700 1 -- 172.21.15.59:0/2582281164 shutdown_connections 2023-09-30T22:30:21.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.679+0000 7f298b3b6700 1 --2- 172.21.15.59:0/2582281164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2984133fa0 0x7f2984120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.679+0000 7f298b3b6700 1 --2- 172.21.15.59:0/2582281164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29840a0a30 0x7f2984120130 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.679+0000 7f298b3b6700 1 --2- 172.21.15.59:0/2582281164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29840a1340 0x7f2984120670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.679+0000 7f298b3b6700 1 -- 172.21.15.59:0/2582281164 >> 172.21.15.59:0/2582281164 conn(0x7f29840a6550 msgr2=0x7f29841bb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:21.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.679+0000 7f298b3b6700 1 -- 172.21.15.59:0/2582281164 shutdown_connections 2023-09-30T22:30:21.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.679+0000 7f298b3b6700 1 -- 172.21.15.59:0/2582281164 wait complete. 2023-09-30T22:30:21.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:21.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.729+0000 7f039f1b3700 1 -- 172.21.15.59:0/1885653631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0398120ca0 con 0x7f039809d630 2023-09-30T22:30:21.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.729+0000 7f03957fa700 1 -- 172.21.15.59:0/1885653631 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f038c011350 con 0x7f039809d630 2023-09-30T22:30:21.729 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:21.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.731+0000 7f039f1b3700 1 -- 172.21.15.59:0/1885653631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f039809d630 msgr2=0x7f03981c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.731+0000 7f039f1b3700 1 --2- 172.21.15.59:0/1885653631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f039809d630 0x7f03981c8100 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f038c00ebe0 tx=0x7f038c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.732+0000 7f039f1b3700 1 -- 172.21.15.59:0/1885653631 shutdown_connections 2023-09-30T22:30:21.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.732+0000 7f039f1b3700 1 --2- 172.21.15.59:0/1885653631 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0398133930 0x7f03981c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.732+0000 7f039f1b3700 1 --2- 172.21.15.59:0/1885653631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f039809d630 0x7f03981c8100 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.732+0000 7f039f1b3700 1 --2- 172.21.15.59:0/1885653631 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03980a0a30 0x7f03981c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.732+0000 7f039f1b3700 1 -- 172.21.15.59:0/1885653631 >> 172.21.15.59:0/1885653631 conn(0x7f03980a3050 msgr2=0x7f03980a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:21.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.732+0000 7f039f1b3700 1 -- 172.21.15.59:0/1885653631 shutdown_connections 2023-09-30T22:30:21.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:21.732+0000 7f039f1b3700 1 -- 172.21.15.59:0/1885653631 wait complete. 2023-09-30T22:30:21.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:22.160 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:22.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.306+0000 7fd4b0d0a700 1 Processor -- start 2023-09-30T22:30:22.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.307+0000 7fd4b0d0a700 1 -- start start 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.307+0000 7fd4b0d0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ac09e930 0x7fd4ac09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.307+0000 7fd4b0d0a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4ac09f650 0x7fd4ac131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.307+0000 7fd4b0d0a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ac070940 con 0x7fd4ac09f240 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.307+0000 7fd4b0d0a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ac06fd60 con 0x7fd4ac09f650 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.307+0000 7fd4b0d0a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac06fa80 con 0x7fd4ac09e930 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.307+0000 7fd4aa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ac09e930 0x7fd4ac09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.307+0000 7fd4aad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4ac09f650 0x7fd4ac131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.307+0000 7fd4aad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4ac09f650 0x7fd4ac131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49266/0 (socket says 172.21.15.59:49266) 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.307+0000 7fd4aa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ac09e930 0x7fd4ac09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57892/0 (socket says 172.21.15.59:57892) 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.307+0000 7fd4aad9d700 1 -- 172.21.15.59:0/1239028165 learned_addr learned my addr 172.21.15.59:0/1239028165 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.308+0000 7fd4aad9d700 1 -- 172.21.15.59:0/1239028165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ac09e930 msgr2=0x7fd4ac09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.308+0000 7fd4aad9d700 1 --2- 172.21.15.59:0/1239028165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ac09e930 0x7fd4ac09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.308+0000 7fd4aad9d700 1 -- 172.21.15.59:0/1239028165 >> v1:172.21.15.59:6789/0 conn(0x7fd4ac09f240 legacy=0x7fd4ac1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.308+0000 7fd4aad9d700 1 -- 172.21.15.59:0/1239028165 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac09fb60 con 0x7fd4ac09f650 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.308+0000 7fd4aa59c700 1 --2- 172.21.15.59:0/1239028165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ac09e930 0x7fd4ac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.308+0000 7fd4aad9d700 1 --2- 172.21.15.59:0/1239028165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ac09f650 0x7fd4ac131f00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009e50 tx=0x7fd4a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1d0fdad3877d19 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.308+0000 7fd4a959a700 1 -- 172.21.15.59:0/1239028165 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400e070 con 0x7fd4ac09f650 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.308+0000 7fd4a959a700 1 -- 172.21.15.59:0/1239028165 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a400b910 con 0x7fd4ac09f650 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.308+0000 7fd4a959a700 1 -- 172.21.15.59:0/1239028165 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400bcc0 con 0x7fd4ac09f650 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.309+0000 7fd4b0d0a700 1 -- 172.21.15.59:0/1239028165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ac09f650 msgr2=0x7fd4ac131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.309+0000 7fd4b0d0a700 1 --2- 172.21.15.59:0/1239028165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ac09f650 0x7fd4ac131f00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009e50 tx=0x7fd4a400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.309+0000 7fd4b0d0a700 1 -- 172.21.15.59:0/1239028165 shutdown_connections 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.309+0000 7fd4b0d0a700 1 --2- 172.21.15.59:0/1239028165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ac09f650 0x7fd4ac131f00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.309+0000 7fd4b0d0a700 1 --2- 172.21.15.59:0/1239028165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ac09e930 0x7fd4ac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.309+0000 7fd4b0d0a700 1 -- 172.21.15.59:0/1239028165 >> 172.21.15.59:0/1239028165 conn(0x7fd4ac0a4210 msgr2=0x7fd4ac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.309+0000 7fd4b0d0a700 1 -- 172.21.15.59:0/1239028165 shutdown_connections 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.309+0000 7fd4b0d0a700 1 -- 172.21.15.59:0/1239028165 wait complete. 2023-09-30T22:30:22.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.310+0000 7fd4b0d0a700 1 Processor -- start 2023-09-30T22:30:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.310+0000 7fd4b0d0a700 1 -- start start 2023-09-30T22:30:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.310+0000 7fd4b0d0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ac09e930 0x7fd4ac1a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.310+0000 7fd4b0d0a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ac09f240 0x7fd4ac1a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.310+0000 7fd4b0d0a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4ac09f650 0x7fd4ac1a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.310+0000 7fd4b0d0a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac1a80e0 con 0x7fd4ac09f240 2023-09-30T22:30:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4b0d0a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac1a7720 con 0x7fd4ac09e930 2023-09-30T22:30:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4b0d0a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac1a6a60 con 0x7fd4ac09f650 2023-09-30T22:30:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4a9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ac09f240 0x7fd4ac1a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4aa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ac09e930 0x7fd4ac1a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4aa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ac09e930 0x7fd4ac1a3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57908/0 (socket says 172.21.15.59:57908) 2023-09-30T22:30:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4a9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ac09f240 0x7fd4ac1a4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49274/0 (socket says 172.21.15.59:49274) 2023-09-30T22:30:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4aa59c700 1 -- 172.21.15.59:0/3613097800 learned_addr learned my addr 172.21.15.59:0/3613097800 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4aad9d700 1 --2- 172.21.15.59:0/3613097800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4ac09f650 0x7fd4ac1a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4aa59c700 1 -- 172.21.15.59:0/3613097800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4ac09f650 msgr2=0x7fd4ac1a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4aa59c700 1 --2- 172.21.15.59:0/3613097800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4ac09f650 0x7fd4ac1a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4aa59c700 1 -- 172.21.15.59:0/3613097800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ac09f240 msgr2=0x7fd4ac1a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4aa59c700 1 --2- 172.21.15.59:0/3613097800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ac09f240 0x7fd4ac1a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4aa59c700 1 -- 172.21.15.59:0/3613097800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c0094a0 con 0x7fd4ac09e930 2023-09-30T22:30:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4aa59c700 1 --2- 172.21.15.59:0/3613097800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ac09e930 0x7fd4ac1a3c00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00ec10 tx=0x7fd49c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd49affd700 1 -- 172.21.15.59:0/3613097800 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c00c850 con 0x7fd4ac09e930 2023-09-30T22:30:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd49affd700 1 -- 172.21.15.59:0/3613097800 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c00c9b0 con 0x7fd4ac09e930 2023-09-30T22:30:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4b0d0a700 1 -- 172.21.15.59:0/3613097800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a4009b30 con 0x7fd4ac09e930 2023-09-30T22:30:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd49affd700 1 -- 172.21.15.59:0/3613097800 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c00cd20 con 0x7fd4ac09e930 2023-09-30T22:30:22.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.311+0000 7fd4b0d0a700 1 -- 172.21.15.59:0/3613097800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac0a0190 con 0x7fd4ac09e930 2023-09-30T22:30:22.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.312+0000 7fd49affd700 1 -- 172.21.15.59:0/3613097800 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd49c013470 con 0x7fd4ac09e930 2023-09-30T22:30:22.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.312+0000 7fd4b0d0a700 1 -- 172.21.15.59:0/3613097800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ac1a0b30 con 0x7fd4ac09e930 2023-09-30T22:30:22.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.312+0000 7fd49affd700 1 -- 172.21.15.59:0/3613097800 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd49c03fc50 con 0x7fd4ac09e930 2023-09-30T22:30:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.317+0000 7fd49affd700 1 -- 172.21.15.59:0/3613097800 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd49c013720 con 0x7fd4ac09e930 2023-09-30T22:30:22.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.522+0000 7fd4b0d0a700 1 -- 172.21.15.59:0/3613097800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd4ac1a72c0 con 0x7fd4ac09e930 2023-09-30T22:30:22.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.523+0000 7fd49affd700 1 -- 172.21.15.59:0/3613097800 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd49c011af0 con 0x7fd4ac09e930 2023-09-30T22:30:22.523 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:22.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.525+0000 7fd4b0d0a700 1 -- 172.21.15.59:0/3613097800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ac09e930 msgr2=0x7fd4ac1a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.525+0000 7fd4b0d0a700 1 --2- 172.21.15.59:0/3613097800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ac09e930 0x7fd4ac1a3c00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00ec10 tx=0x7fd49c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:30:22.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.525+0000 7fd4b0d0a700 1 -- 172.21.15.59:0/3613097800 shutdown_connections 2023-09-30T22:30:22.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.525+0000 7fd4b0d0a700 1 --2- 172.21.15.59:0/3613097800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4ac09f650 0x7fd4ac1a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.525+0000 7fd4b0d0a700 1 --2- 172.21.15.59:0/3613097800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ac09e930 0x7fd4ac1a3c00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.525+0000 7fd4b0d0a700 1 --2- 172.21.15.59:0/3613097800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ac09f240 0x7fd4ac1a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.525+0000 7fd4b0d0a700 1 -- 172.21.15.59:0/3613097800 >> 172.21.15.59:0/3613097800 conn(0x7fd4ac0a4210 msgr2=0x7fd4ac1b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:22.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.525+0000 7fd4b0d0a700 1 -- 172.21.15.59:0/3613097800 shutdown_connections 2023-09-30T22:30:22.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.525+0000 7fd4b0d0a700 1 -- 172.21.15.59:0/3613097800 wait complete. 2023-09-30T22:30:22.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:22.654 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:22.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:22.746 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:22.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.800+0000 7fd0a7679700 1 Processor -- start 2023-09-30T22:30:22.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.800+0000 7fd0a7679700 1 -- start start 2023-09-30T22:30:22.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.801+0000 7fd0a7679700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd0a009d6f0 0x7fd0a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.801+0000 7fd0a7679700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0a009e000 0x7fd0a01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.801+0000 7fd0a7679700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a009b120 con 0x7fd0a009e410 2023-09-30T22:30:22.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.801+0000 7fd0a7679700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a006b460 con 0x7fd0a009e000 2023-09-30T22:30:22.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.801+0000 7fd0a7679700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a009a7e0 con 0x7fd0a009d6f0 2023-09-30T22:30:22.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.802+0000 7fd0a5c16700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd0a009e410 0x7fd0a0133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39766/0 (socket says 172.21.15.59:39766) 2023-09-30T22:30:22.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.802+0000 7fd0a5c16700 1 -- 172.21.15.59:0/1794958828 learned_addr learned my addr 172.21.15.59:0/1794958828 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:22.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.802+0000 7fd0a4c14700 1 --2- 172.21.15.59:0/1794958828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0a009e000 0x7fd0a01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.802+0000 7fd0a5415700 1 --2- 172.21.15.59:0/1794958828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd0a009d6f0 0x7fd0a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.802+0000 7fd097fff700 1 -- 172.21.15.59:0/1794958828 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238260457 0 0) 0x7fd0a009b120 con 0x7fd0a009e410 2023-09-30T22:30:22.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.802+0000 7fd097fff700 1 -- 172.21.15.59:0/1794958828 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd08c0035b0 con 0x7fd0a009e410 2023-09-30T22:30:22.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.802+0000 7fd0a4c14700 1 -- 172.21.15.59:0/1794958828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd0a009d6f0 msgr2=0x7fd0a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:22.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.802+0000 7fd0a4c14700 1 --2- 172.21.15.59:0/1794958828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd0a009d6f0 0x7fd0a009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.802+0000 7fd0a4c14700 1 -- 172.21.15.59:0/1794958828 >> v1:172.21.15.59:6789/0 conn(0x7fd0a009e410 legacy=0x7fd0a0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.802+0000 7fd0a4c14700 1 -- 172.21.15.59:0/1794958828 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a009a500 con 0x7fd0a009e000 2023-09-30T22:30:22.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.802+0000 7fd0a4c14700 1 --2- 172.21.15.59:0/1794958828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0a009e000 0x7fd0a01339f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd090009870 tx=0x7fd090009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7dee4e0158f8222 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.802+0000 7fd097fff700 1 -- 172.21.15.59:0/1794958828 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090011830 con 0x7fd0a009e000 2023-09-30T22:30:22.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.802+0000 7fd097fff700 1 -- 172.21.15.59:0/1794958828 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd090011990 con 0x7fd0a009e000 2023-09-30T22:30:22.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.802+0000 7fd097fff700 1 -- 172.21.15.59:0/1794958828 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090011d20 con 0x7fd0a009e000 2023-09-30T22:30:22.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.803+0000 7fd0a7679700 1 -- 172.21.15.59:0/1794958828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0a009e000 msgr2=0x7fd0a01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.803+0000 7fd0a7679700 1 --2- 172.21.15.59:0/1794958828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0a009e000 0x7fd0a01339f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd090009870 tx=0x7fd090009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:22.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.803+0000 7fd0a7679700 1 -- 172.21.15.59:0/1794958828 shutdown_connections 2023-09-30T22:30:22.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.803+0000 7fd0a7679700 1 --2- 172.21.15.59:0/1794958828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd0a009d6f0 0x7fd0a009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.803+0000 7fd0a7679700 1 --2- 172.21.15.59:0/1794958828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0a009e000 0x7fd0a01339f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.803+0000 7fd0a7679700 1 -- 172.21.15.59:0/1794958828 >> 172.21.15.59:0/1794958828 conn(0x7fd0a0066f50 msgr2=0x7fd0a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:22.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.803+0000 7fd0a7679700 1 -- 172.21.15.59:0/1794958828 shutdown_connections 2023-09-30T22:30:22.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.803+0000 7fd0a7679700 1 -- 172.21.15.59:0/1794958828 wait complete. 2023-09-30T22:30:22.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.804+0000 7fd0a7679700 1 Processor -- start 2023-09-30T22:30:22.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.805+0000 7fd0a7679700 1 -- start start 2023-09-30T22:30:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.805+0000 7fd0a7679700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0a009d6f0 0x7fd0a0122350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.805+0000 7fd0a7679700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a009e000 0x7fd0a0122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.805+0000 7fd0a7679700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd0a009e410 0x7fd0a0122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.805+0000 7fd0a7679700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0125e70 con 0x7fd0a009e000 2023-09-30T22:30:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.805+0000 7fd0a7679700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a01337e0 con 0x7fd0a009d6f0 2023-09-30T22:30:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.805+0000 7fd0a7679700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a00a1f90 con 0x7fd0a009e410 2023-09-30T22:30:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.805+0000 7fd0a5415700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0a009d6f0 0x7fd0a0122350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.805+0000 7fd0a5415700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0a009d6f0 0x7fd0a0122350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57922/0 (socket says 172.21.15.59:57922) 2023-09-30T22:30:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.805+0000 7fd0a5415700 1 -- 172.21.15.59:0/51812987 learned_addr learned my addr 172.21.15.59:0/51812987 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.805+0000 7fd0a4c14700 1 --2- 172.21.15.59:0/51812987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a009e000 0x7fd0a0122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.805+0000 7fd0a5c16700 1 --2- 172.21.15.59:0/51812987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd0a009e410 0x7fd0a0122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.806+0000 7fd0a5415700 1 -- 172.21.15.59:0/51812987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd0a009e410 msgr2=0x7fd0a0122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.806+0000 7fd0a5415700 1 --2- 172.21.15.59:0/51812987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd0a009e410 0x7fd0a0122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.806+0000 7fd0a5415700 1 -- 172.21.15.59:0/51812987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a009e000 msgr2=0x7fd0a0122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.806+0000 7fd0a5415700 1 --2- 172.21.15.59:0/51812987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a009e000 0x7fd0a0122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.806+0000 7fd0a5415700 1 -- 172.21.15.59:0/51812987 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0900094a0 con 0x7fd0a009d6f0 2023-09-30T22:30:22.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.806+0000 7fd0a4c14700 1 --2- 172.21.15.59:0/51812987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a009e000 0x7fd0a0122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:22.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.806+0000 7fd0a5415700 1 --2- 172.21.15.59:0/51812987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0a009d6f0 0x7fd0a0122350 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00e9e0 tx=0x7fd09c00ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.806+0000 7fd095ffb700 1 -- 172.21.15.59:0/51812987 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c009710 con 0x7fd0a009d6f0 2023-09-30T22:30:22.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.806+0000 7fd095ffb700 1 -- 172.21.15.59:0/51812987 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c00ee80 con 0x7fd0a009d6f0 2023-09-30T22:30:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.806+0000 7fd0a7679700 1 -- 172.21.15.59:0/51812987 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a009c710 con 0x7fd0a009d6f0 2023-09-30T22:30:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.806+0000 7fd095ffb700 1 -- 172.21.15.59:0/51812987 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c00ca50 con 0x7fd0a009d6f0 2023-09-30T22:30:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.806+0000 7fd0a7679700 1 -- 172.21.15.59:0/51812987 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a0124d60 con 0x7fd0a009d6f0 2023-09-30T22:30:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.807+0000 7fd095ffb700 1 -- 172.21.15.59:0/51812987 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd09c00cbb0 con 0x7fd0a009d6f0 2023-09-30T22:30:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.807+0000 7fd095ffb700 1 -- 172.21.15.59:0/51812987 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd09c03f740 con 0x7fd0a009d6f0 2023-09-30T22:30:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.808+0000 7fd0a7679700 1 -- 172.21.15.59:0/51812987 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a0074ea0 con 0x7fd0a009d6f0 2023-09-30T22:30:22.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.812+0000 7fd095ffb700 1 -- 172.21.15.59:0/51812987 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd09c0232f0 con 0x7fd0a009d6f0 2023-09-30T22:30:22.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.841+0000 7f50fff0e700 1 Processor -- start 2023-09-30T22:30:22.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.842+0000 7f50fff0e700 1 -- start start 2023-09-30T22:30:22.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.842+0000 7f50fff0e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50f809f410 0x7f50f8136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.843+0000 7f50fff0e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f50f8136fe0 0x7f50f81393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.843+0000 7f50fff0e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f8070940 con 0x7f50f809e930 2023-09-30T22:30:22.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.843+0000 7f50fff0e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f806fd60 con 0x7f50f8136fe0 2023-09-30T22:30:22.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.843+0000 7f50fff0e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f806fa80 con 0x7f50f809f410 2023-09-30T22:30:22.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.843+0000 7f50fd4a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50f809f410 0x7f50f8136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.843+0000 7f50fd4a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50f809f410 0x7f50f8136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57938/0 (socket says 172.21.15.59:57938) 2023-09-30T22:30:22.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.843+0000 7f50fd4a9700 1 -- 172.21.15.59:0/2390854691 learned_addr learned my addr 172.21.15.59:0/2390854691 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:22.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.843+0000 7f50fe4ab700 1 --2- 172.21.15.59:0/2390854691 >> v2:172.21.15.59:3300/0 conn(0x7f50f8136fe0 0x7f50f81393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.843+0000 7f50fd4a9700 1 -- 172.21.15.59:0/2390854691 >> v2:172.21.15.59:3300/0 conn(0x7f50f8136fe0 msgr2=0x7f50f81393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:22.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.843+0000 7f50fd4a9700 1 --2- 172.21.15.59:0/2390854691 >> v2:172.21.15.59:3300/0 conn(0x7f50f8136fe0 0x7f50f81393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.843+0000 7f50fd4a9700 1 -- 172.21.15.59:0/2390854691 >> v1:172.21.15.59:6789/0 conn(0x7f50f809e930 legacy=0x7f50f809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.843+0000 7f50fd4a9700 1 -- 172.21.15.59:0/2390854691 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f809fb60 con 0x7f50f809f410 2023-09-30T22:30:22.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.843+0000 7f50fe4ab700 1 --2- 172.21.15.59:0/2390854691 >> v2:172.21.15.59:3300/0 conn(0x7f50f8136fe0 0x7f50f81393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:22.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.843+0000 7f50fd4a9700 1 --2- 172.21.15.59:0/2390854691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50f809f410 0x7f50f8136aa0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f50e80098f0 tx=0x7f50e8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51efca9ee401499b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.844+0000 7f50fcca8700 1 -- 172.21.15.59:0/2390854691 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e8011830 con 0x7f50f809f410 2023-09-30T22:30:22.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.844+0000 7f50fcca8700 1 -- 172.21.15.59:0/2390854691 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e8011990 con 0x7f50f809f410 2023-09-30T22:30:22.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.844+0000 7f50fcca8700 1 -- 172.21.15.59:0/2390854691 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e8011d20 con 0x7f50f809f410 2023-09-30T22:30:22.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.844+0000 7f50fff0e700 1 -- 172.21.15.59:0/2390854691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50f809f410 msgr2=0x7f50f8136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.844+0000 7f50fff0e700 1 --2- 172.21.15.59:0/2390854691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50f809f410 0x7f50f8136aa0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f50e80098f0 tx=0x7f50e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:22.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.844+0000 7f50fff0e700 1 -- 172.21.15.59:0/2390854691 shutdown_connections 2023-09-30T22:30:22.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.844+0000 7f50fff0e700 1 --2- 172.21.15.59:0/2390854691 >> v2:172.21.15.59:3300/0 conn(0x7f50f8136fe0 0x7f50f81393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.844+0000 7f50fff0e700 1 --2- 172.21.15.59:0/2390854691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50f809f410 0x7f50f8136aa0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.844+0000 7f50fff0e700 1 -- 172.21.15.59:0/2390854691 >> 172.21.15.59:0/2390854691 conn(0x7f50f80a4210 msgr2=0x7f50f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:22.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.844+0000 7f50fff0e700 1 -- 172.21.15.59:0/2390854691 shutdown_connections 2023-09-30T22:30:22.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.844+0000 7f50fff0e700 1 -- 172.21.15.59:0/2390854691 wait complete. 2023-09-30T22:30:22.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.846+0000 7f50fff0e700 1 Processor -- start 2023-09-30T22:30:22.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.846+0000 7f50fff0e700 1 -- start start 2023-09-30T22:30:22.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fff0e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50f809e930 0x7f50f811c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fff0e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50f809f410 0x7f50f811cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fff0e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50f8136fe0 0x7f50f811d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fff0e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f811fe50 con 0x7f50f8136fe0 2023-09-30T22:30:22.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fff0e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80a2f40 con 0x7f50f809f410 2023-09-30T22:30:22.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fff0e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50f811f8a0 con 0x7f50f809e930 2023-09-30T22:30:22.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fd4a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50f809f410 0x7f50f811cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fd4a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50f809f410 0x7f50f811cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57942/0 (socket says 172.21.15.59:57942) 2023-09-30T22:30:22.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fd4a9700 1 -- 172.21.15.59:0/1151238289 learned_addr learned my addr 172.21.15.59:0/1151238289 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:22.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fdcaa700 1 --2- 172.21.15.59:0/1151238289 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50f809e930 0x7f50f811c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fe4ab700 1 --2- 172.21.15.59:0/1151238289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50f8136fe0 0x7f50f811d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fe4ab700 1 -- 172.21.15.59:0/1151238289 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50f809e930 msgr2=0x7f50f811c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fe4ab700 1 --2- 172.21.15.59:0/1151238289 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50f809e930 0x7f50f811c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fe4ab700 1 -- 172.21.15.59:0/1151238289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50f809f410 msgr2=0x7f50f811cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fe4ab700 1 --2- 172.21.15.59:0/1151238289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50f809f410 0x7f50f811cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fe4ab700 1 -- 172.21.15.59:0/1151238289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f0009a70 con 0x7f50f8136fe0 2023-09-30T22:30:22.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fd4a9700 1 --2- 172.21.15.59:0/1151238289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50f809f410 0x7f50f811cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:22.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.847+0000 7f50fdcaa700 1 --2- 172.21.15.59:0/1151238289 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50f809e930 0x7f50f811c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:22.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.848+0000 7f50fe4ab700 1 --2- 172.21.15.59:0/1151238289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50f8136fe0 0x7f50f811d0e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f50f000ef90 tx=0x7f50f000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.848+0000 7f50ee7fc700 1 -- 172.21.15.59:0/1151238289 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f000cd40 con 0x7f50f8136fe0 2023-09-30T22:30:22.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.848+0000 7f50ee7fc700 1 -- 172.21.15.59:0/1151238289 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f000f040 con 0x7f50f8136fe0 2023-09-30T22:30:22.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.848+0000 7f50fff0e700 1 -- 172.21.15.59:0/1151238289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e8009550 con 0x7f50f8136fe0 2023-09-30T22:30:22.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.848+0000 7f50ee7fc700 1 -- 172.21.15.59:0/1151238289 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00146c0 con 0x7f50f8136fe0 2023-09-30T22:30:22.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.848+0000 7f50fff0e700 1 -- 172.21.15.59:0/1151238289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f811e330 con 0x7f50f8136fe0 2023-09-30T22:30:22.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.849+0000 7f50ee7fc700 1 -- 172.21.15.59:0/1151238289 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50f0014820 con 0x7f50f8136fe0 2023-09-30T22:30:22.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.849+0000 7f50ee7fc700 1 -- 172.21.15.59:0/1151238289 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f50f00402b0 con 0x7f50f8136fe0 2023-09-30T22:30:22.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.849+0000 7f50fff0e700 1 -- 172.21.15.59:0/1151238289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f8074ea0 con 0x7f50f8136fe0 2023-09-30T22:30:22.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.854+0000 7f50ee7fc700 1 -- 172.21.15.59:0/1151238289 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50f0018080 con 0x7f50f8136fe0 2023-09-30T22:30:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.889+0000 7f0433155700 1 Processor -- start 2023-09-30T22:30:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.889+0000 7f0433155700 1 -- start start 2023-09-30T22:30:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.889+0000 7f0433155700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f042c130540 0x7f042c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.889+0000 7f0433155700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f042c130e50 0x7f042c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.889+0000 7f0433155700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f042c06fb20 0x7f042c06ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.889+0000 7f0433155700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042c09a390 con 0x7f042c130540 2023-09-30T22:30:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.889+0000 7f0433155700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c0716a0 con 0x7f042c130e50 2023-09-30T22:30:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.889+0000 7f0433155700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f042c071290 con 0x7f042c06fb20 2023-09-30T22:30:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.890+0000 7f0430ef1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f042c130540 0x7f042c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.890+0000 7f0430ef1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f042c130540 0x7f042c130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49310/0 (socket says 172.21.15.59:49310) 2023-09-30T22:30:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.890+0000 7f0430ef1700 1 -- 172.21.15.59:0/2684518152 learned_addr learned my addr 172.21.15.59:0/2684518152 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.890+0000 7f04316f2700 1 --2- 172.21.15.59:0/2684518152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f042c06fb20 0x7f042c06ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.890+0000 7f042bfff700 1 --2- 172.21.15.59:0/2684518152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f042c130e50 0x7f042c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.890+0000 7f0430ef1700 1 -- 172.21.15.59:0/2684518152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f042c06fb20 msgr2=0x7f042c06ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.890+0000 7f0430ef1700 1 --2- 172.21.15.59:0/2684518152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f042c06fb20 0x7f042c06ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.890+0000 7f0430ef1700 1 -- 172.21.15.59:0/2684518152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f042c130e50 msgr2=0x7f042c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.890+0000 7f0430ef1700 1 --2- 172.21.15.59:0/2684518152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f042c130e50 0x7f042c06f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.890+0000 7f0430ef1700 1 -- 172.21.15.59:0/2684518152 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c130340 con 0x7f042c130540 2023-09-30T22:30:22.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.890+0000 7f042bfff700 1 --2- 172.21.15.59:0/2684518152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f042c130e50 0x7f042c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:22.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.890+0000 7f0430ef1700 1 --2- 172.21.15.59:0/2684518152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f042c130540 0x7f042c130910 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f04200098f0 tx=0x7f0420009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ccc0cee9df314 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.891+0000 7f042b7fe700 1 -- 172.21.15.59:0/2684518152 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420010a90 con 0x7f042c130540 2023-09-30T22:30:22.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.891+0000 7f042b7fe700 1 -- 172.21.15.59:0/2684518152 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0420010bf0 con 0x7f042c130540 2023-09-30T22:30:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.891+0000 7f042b7fe700 1 -- 172.21.15.59:0/2684518152 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420018440 con 0x7f042c130540 2023-09-30T22:30:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.891+0000 7f0433155700 1 -- 172.21.15.59:0/2684518152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f042c130540 msgr2=0x7f042c130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.891+0000 7f0433155700 1 --2- 172.21.15.59:0/2684518152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f042c130540 0x7f042c130910 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f04200098f0 tx=0x7f0420009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.891+0000 7f0433155700 1 -- 172.21.15.59:0/2684518152 shutdown_connections 2023-09-30T22:30:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.891+0000 7f0433155700 1 --2- 172.21.15.59:0/2684518152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f042c06fb20 0x7f042c06ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.891+0000 7f0433155700 1 --2- 172.21.15.59:0/2684518152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f042c130540 0x7f042c130910 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.891+0000 7f0433155700 1 --2- 172.21.15.59:0/2684518152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f042c130e50 0x7f042c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.891+0000 7f0433155700 1 -- 172.21.15.59:0/2684518152 >> 172.21.15.59:0/2684518152 conn(0x7f042c0a2aa0 msgr2=0x7f042c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:22.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.891+0000 7f0433155700 1 -- 172.21.15.59:0/2684518152 shutdown_connections 2023-09-30T22:30:22.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.891+0000 7f0433155700 1 -- 172.21.15.59:0/2684518152 wait complete. 2023-09-30T22:30:22.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.892+0000 7f0433155700 1 Processor -- start 2023-09-30T22:30:22.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.892+0000 7f0433155700 1 -- start start 2023-09-30T22:30:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.893+0000 7f0433155700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f042c06fb20 0x7f042c1c0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.893+0000 7f0433155700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f042c130540 0x7f042c1c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.893+0000 7f0433155700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f042c130e50 0x7f042c118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.893+0000 7f0433155700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c11bc90 con 0x7f042c130e50 2023-09-30T22:30:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.893+0000 7f0433155700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c11b240 con 0x7f042c06fb20 2023-09-30T22:30:22.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.893+0000 7f0433155700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f042c0718e0 con 0x7f042c130540 2023-09-30T22:30:22.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.893+0000 7f0430ef1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f042c06fb20 0x7f042c1c0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.893+0000 7f042bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f042c130540 0x7f042c1c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.893+0000 7f0430ef1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f042c06fb20 0x7f042c1c0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57964/0 (socket says 172.21.15.59:57964) 2023-09-30T22:30:22.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.893+0000 7f0430ef1700 1 -- 172.21.15.59:0/3536354215 learned_addr learned my addr 172.21.15.59:0/3536354215 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:22.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.893+0000 7f04316f2700 1 --2- 172.21.15.59:0/3536354215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f042c130e50 0x7f042c118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.894+0000 7f0430ef1700 1 -- 172.21.15.59:0/3536354215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f042c130540 msgr2=0x7f042c1c0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.894+0000 7f0430ef1700 1 --2- 172.21.15.59:0/3536354215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f042c130540 0x7f042c1c0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.894+0000 7f0430ef1700 1 -- 172.21.15.59:0/3536354215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f042c130e50 msgr2=0x7f042c118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.894+0000 7f0430ef1700 1 --2- 172.21.15.59:0/3536354215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f042c130e50 0x7f042c118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.894+0000 7f0430ef1700 1 -- 172.21.15.59:0/3536354215 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04180094a0 con 0x7f042c06fb20 2023-09-30T22:30:22.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.894+0000 7f04316f2700 1 --2- 172.21.15.59:0/3536354215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f042c130e50 0x7f042c118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:22.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.894+0000 7f0430ef1700 1 --2- 172.21.15.59:0/3536354215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f042c06fb20 0x7f042c1c0a20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0420009c40 tx=0x7f0420004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.894+0000 7f04297fa700 1 -- 172.21.15.59:0/3536354215 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04200038a0 con 0x7f042c06fb20 2023-09-30T22:30:22.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.894+0000 7f04297fa700 1 -- 172.21.15.59:0/3536354215 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0420003a20 con 0x7f042c06fb20 2023-09-30T22:30:22.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.894+0000 7f0433155700 1 -- 172.21.15.59:0/3536354215 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0420009550 con 0x7f042c06fb20 2023-09-30T22:30:22.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.894+0000 7f04297fa700 1 -- 172.21.15.59:0/3536354215 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420003dd0 con 0x7f042c06fb20 2023-09-30T22:30:22.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.894+0000 7f0433155700 1 -- 172.21.15.59:0/3536354215 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042c0a0ae0 con 0x7f042c06fb20 2023-09-30T22:30:22.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.895+0000 7f04297fa700 1 -- 172.21.15.59:0/3536354215 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f042001f070 con 0x7f042c06fb20 2023-09-30T22:30:22.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.895+0000 7f0433155700 1 -- 172.21.15.59:0/3536354215 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042c074ea0 con 0x7f042c06fb20 2023-09-30T22:30:22.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.895+0000 7f04297fa700 1 -- 172.21.15.59:0/3536354215 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0420044d80 con 0x7f042c06fb20 2023-09-30T22:30:22.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:22.900+0000 7f04297fa700 1 -- 172.21.15.59:0/3536354215 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0420048030 con 0x7f042c06fb20 2023-09-30T22:30:23.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.044+0000 7fd0a7679700 1 -- 172.21.15.59:0/51812987 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd0a006c360 con 0x7fd0a009d6f0 2023-09-30T22:30:23.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.044+0000 7fd095ffb700 1 -- 172.21.15.59:0/51812987 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd09c01ae80 con 0x7fd0a009d6f0 2023-09-30T22:30:23.045 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.047+0000 7fd0a7679700 1 -- 172.21.15.59:0/51812987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0a009d6f0 msgr2=0x7fd0a0122350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.047+0000 7fd0a7679700 1 --2- 172.21.15.59:0/51812987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0a009d6f0 0x7fd0a0122350 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00e9e0 tx=0x7fd09c00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.047+0000 7fd0a7679700 1 -- 172.21.15.59:0/51812987 shutdown_connections 2023-09-30T22:30:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.047+0000 7fd0a7679700 1 --2- 172.21.15.59:0/51812987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd0a009e410 0x7fd0a0122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.047+0000 7fd0a7679700 1 --2- 172.21.15.59:0/51812987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0a009d6f0 0x7fd0a0122350 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.047+0000 7fd0a7679700 1 --2- 172.21.15.59:0/51812987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0a009e000 0x7fd0a0122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.047+0000 7fd0a7679700 1 -- 172.21.15.59:0/51812987 >> 172.21.15.59:0/51812987 conn(0x7fd0a0066f50 msgr2=0x7fd0a0070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.048+0000 7fd0a7679700 1 -- 172.21.15.59:0/51812987 shutdown_connections 2023-09-30T22:30:23.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.048+0000 7fd0a7679700 1 -- 172.21.15.59:0/51812987 wait complete. 2023-09-30T22:30:23.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.062+0000 7f50fff0e700 1 -- 172.21.15.59:0/1151238289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f50f811ea30 con 0x7f50f8136fe0 2023-09-30T22:30:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.062+0000 7f50ee7fc700 1 -- 172.21.15.59:0/1151238289 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50f001d400 con 0x7f50f8136fe0 2023-09-30T22:30:23.063 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.064+0000 7f50fff0e700 1 -- 172.21.15.59:0/1151238289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50f8136fe0 msgr2=0x7f50f811d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.064+0000 7f50fff0e700 1 --2- 172.21.15.59:0/1151238289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50f8136fe0 0x7f50f811d0e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f50f000ef90 tx=0x7f50f000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.064+0000 7f50fff0e700 1 -- 172.21.15.59:0/1151238289 shutdown_connections 2023-09-30T22:30:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.064+0000 7f50fff0e700 1 --2- 172.21.15.59:0/1151238289 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50f809e930 0x7f50f811c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.064+0000 7f50fff0e700 1 --2- 172.21.15.59:0/1151238289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50f8136fe0 0x7f50f811d0e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.064+0000 7f50fff0e700 1 --2- 172.21.15.59:0/1151238289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50f809f410 0x7f50f811cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.064+0000 7f50fff0e700 1 -- 172.21.15.59:0/1151238289 >> 172.21.15.59:0/1151238289 conn(0x7f50f80a4210 msgr2=0x7f50f80a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.065+0000 7f50fff0e700 1 -- 172.21.15.59:0/1151238289 shutdown_connections 2023-09-30T22:30:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.065+0000 7f50fff0e700 1 -- 172.21.15.59:0/1151238289 wait complete. 2023-09-30T22:30:23.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:23.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.126+0000 7f0433155700 1 -- 172.21.15.59:0/3536354215 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f042c09e040 con 0x7f042c06fb20 2023-09-30T22:30:23.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.126+0000 7f04297fa700 1 -- 172.21.15.59:0/3536354215 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f042001d070 con 0x7f042c06fb20 2023-09-30T22:30:23.126 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:23.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.129+0000 7f0433155700 1 -- 172.21.15.59:0/3536354215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f042c06fb20 msgr2=0x7f042c1c0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.129+0000 7f0433155700 1 --2- 172.21.15.59:0/3536354215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f042c06fb20 0x7f042c1c0a20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0420009c40 tx=0x7f0420004750 comp rx=0 tx=0).stop 2023-09-30T22:30:23.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.129+0000 7f0433155700 1 -- 172.21.15.59:0/3536354215 shutdown_connections 2023-09-30T22:30:23.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.129+0000 7f0433155700 1 --2- 172.21.15.59:0/3536354215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f042c130e50 0x7f042c118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.129+0000 7f0433155700 1 --2- 172.21.15.59:0/3536354215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f042c06fb20 0x7f042c1c0a20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.129+0000 7f0433155700 1 --2- 172.21.15.59:0/3536354215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f042c130540 0x7f042c1c0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.129+0000 7f0433155700 1 -- 172.21.15.59:0/3536354215 >> 172.21.15.59:0/3536354215 conn(0x7f042c0a2aa0 msgr2=0x7f042c12d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:23.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.129+0000 7f0433155700 1 -- 172.21.15.59:0/3536354215 shutdown_connections 2023-09-30T22:30:23.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.129+0000 7f0433155700 1 -- 172.21.15.59:0/3536354215 wait complete. 2023-09-30T22:30:23.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:23.540 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:23.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.688+0000 7f9b1f3b6700 1 Processor -- start 2023-09-30T22:30:23.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.688+0000 7f9b1f3b6700 1 -- start start 2023-09-30T22:30:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.688+0000 7f9b1f3b6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b1809e930 0x7f9b1809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.688+0000 7f9b1f3b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1809f240 0x7f9b181317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.688+0000 7f9b1f3b6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b18070940 con 0x7f9b1809f650 2023-09-30T22:30:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.688+0000 7f9b1f3b6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1806fd60 con 0x7f9b1809e930 2023-09-30T22:30:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.688+0000 7f9b1f3b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1806fa80 con 0x7f9b1809f240 2023-09-30T22:30:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.688+0000 7f9b1d152700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b1809e930 0x7f9b1809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.688+0000 7f9b1c951700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1809f240 0x7f9b181317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.689+0000 7f9b1c951700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1809f240 0x7f9b181317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57972/0 (socket says 172.21.15.59:57972) 2023-09-30T22:30:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.689+0000 7f9b1d152700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b1809e930 0x7f9b1809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49330/0 (socket says 172.21.15.59:49330) 2023-09-30T22:30:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.689+0000 7f9b1c951700 1 -- 172.21.15.59:0/3902196766 learned_addr learned my addr 172.21.15.59:0/3902196766 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.689+0000 7f9b1d152700 1 -- 172.21.15.59:0/3902196766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1809f240 msgr2=0x7f9b181317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.689+0000 7f9b1d152700 1 --2- 172.21.15.59:0/3902196766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1809f240 0x7f9b181317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.689+0000 7f9b1d152700 1 -- 172.21.15.59:0/3902196766 >> v1:172.21.15.59:6789/0 conn(0x7f9b1809f650 legacy=0x7f9b18131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.689+0000 7f9b0ffff700 1 -- 172.21.15.59:0/3902196766 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357645255 0 0) 0x7f9b18070940 con 0x7f9b1809f650 2023-09-30T22:30:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.689+0000 7f9b1d152700 1 -- 172.21.15.59:0/3902196766 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1809fb60 con 0x7f9b1809e930 2023-09-30T22:30:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.689+0000 7f9b1c951700 1 --2- 172.21.15.59:0/3902196766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1809f240 0x7f9b181317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.689+0000 7f9b1d152700 1 --2- 172.21.15.59:0/3902196766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1809e930 0x7f9b1809ed00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9b14009840 tx=0x7f9b14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185771f648986f60 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.689+0000 7f9b0ffff700 1 -- 172.21.15.59:0/3902196766 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14011830 con 0x7f9b1809e930 2023-09-30T22:30:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.689+0000 7f9b0ffff700 1 -- 172.21.15.59:0/3902196766 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b14011990 con 0x7f9b1809e930 2023-09-30T22:30:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.689+0000 7f9b0ffff700 1 -- 172.21.15.59:0/3902196766 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14011d20 con 0x7f9b1809e930 2023-09-30T22:30:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.690+0000 7f9b1f3b6700 1 -- 172.21.15.59:0/3902196766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1809e930 msgr2=0x7f9b1809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.690+0000 7f9b1f3b6700 1 --2- 172.21.15.59:0/3902196766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1809e930 0x7f9b1809ed00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9b14009840 tx=0x7f9b14009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:23.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.690+0000 7f9b1f3b6700 1 -- 172.21.15.59:0/3902196766 shutdown_connections 2023-09-30T22:30:23.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.690+0000 7f9b1f3b6700 1 --2- 172.21.15.59:0/3902196766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1809e930 0x7f9b1809ed00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.690+0000 7f9b1f3b6700 1 --2- 172.21.15.59:0/3902196766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1809f240 0x7f9b181317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.690+0000 7f9b1f3b6700 1 -- 172.21.15.59:0/3902196766 >> 172.21.15.59:0/3902196766 conn(0x7f9b180a4210 msgr2=0x7f9b180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:23.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.690+0000 7f9b1f3b6700 1 -- 172.21.15.59:0/3902196766 shutdown_connections 2023-09-30T22:30:23.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.690+0000 7f9b1f3b6700 1 -- 172.21.15.59:0/3902196766 wait complete. 2023-09-30T22:30:23.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.691+0000 7f9b1f3b6700 1 Processor -- start 2023-09-30T22:30:23.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.691+0000 7f9b1f3b6700 1 -- start start 2023-09-30T22:30:23.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.691+0000 7f9b1f3b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b1809e930 0x7f9b181c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.691+0000 7f9b1f3b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1809f240 0x7f9b181c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.691+0000 7f9b1f3b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1809f650 0x7f9b181c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.691+0000 7f9b1f3b6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b181a4fe0 con 0x7f9b1809f650 2023-09-30T22:30:23.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.691+0000 7f9b1f3b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b181a75d0 con 0x7f9b1809f240 2023-09-30T22:30:23.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.691+0000 7f9b1f3b6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b181c6ca0 con 0x7f9b1809e930 2023-09-30T22:30:23.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b1d152700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b1809e930 0x7f9b181c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b1d953700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1809f650 0x7f9b181c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b1d152700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b1809e930 0x7f9b181c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36410/0 (socket says 172.21.15.59:36410) 2023-09-30T22:30:23.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b1d152700 1 -- 172.21.15.59:0/660924274 learned_addr learned my addr 172.21.15.59:0/660924274 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:23.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b1c951700 1 --2- 172.21.15.59:0/660924274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1809f240 0x7f9b181c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b1d953700 1 -- 172.21.15.59:0/660924274 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b1809e930 msgr2=0x7f9b181c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b1d953700 1 --2- 172.21.15.59:0/660924274 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b1809e930 0x7f9b181c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b1d953700 1 -- 172.21.15.59:0/660924274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1809f240 msgr2=0x7f9b181c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b1d953700 1 --2- 172.21.15.59:0/660924274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1809f240 0x7f9b181c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b1d953700 1 -- 172.21.15.59:0/660924274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b08009550 con 0x7f9b1809f650 2023-09-30T22:30:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b1d152700 1 --2- 172.21.15.59:0/660924274 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b1809e930 0x7f9b181c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b1c951700 1 --2- 172.21.15.59:0/660924274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1809f240 0x7f9b181c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b1d953700 1 --2- 172.21.15.59:0/660924274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1809f650 0x7f9b181c27d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000c7c0 tx=0x7f9b1000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b0dffb700 1 -- 172.21.15.59:0/660924274 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b10003e30 con 0x7f9b1809f650 2023-09-30T22:30:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b0dffb700 1 -- 172.21.15.59:0/660924274 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b10005070 con 0x7f9b1809f650 2023-09-30T22:30:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b1f3b6700 1 -- 172.21.15.59:0/660924274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b140094a0 con 0x7f9b1809f650 2023-09-30T22:30:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.692+0000 7f9b0dffb700 1 -- 172.21.15.59:0/660924274 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b10005420 con 0x7f9b1809f650 2023-09-30T22:30:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.693+0000 7f9b1f3b6700 1 -- 172.21.15.59:0/660924274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b180a0190 con 0x7f9b1809f650 2023-09-30T22:30:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.693+0000 7f9b0dffb700 1 -- 172.21.15.59:0/660924274 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b10005580 con 0x7f9b1809f650 2023-09-30T22:30:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.694+0000 7f9b0dffb700 1 -- 172.21.15.59:0/660924274 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9b1003ec00 con 0x7f9b1809f650 2023-09-30T22:30:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.694+0000 7f9b1f3b6700 1 -- 172.21.15.59:0/660924274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b181a6f90 con 0x7f9b1809f650 2023-09-30T22:30:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.699+0000 7f9b0dffb700 1 -- 172.21.15.59:0/660924274 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b10017030 con 0x7f9b1809f650 2023-09-30T22:30:23.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.902+0000 7f9b1f3b6700 1 -- 172.21.15.59:0/660924274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9b18074ea0 con 0x7f9b1809f650 2023-09-30T22:30:23.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.902+0000 7f9b0dffb700 1 -- 172.21.15.59:0/660924274 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b10010b80 con 0x7f9b1809f650 2023-09-30T22:30:23.902 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:23.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.904+0000 7f9b1f3b6700 1 -- 172.21.15.59:0/660924274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1809f650 msgr2=0x7f9b181c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.904+0000 7f9b1f3b6700 1 --2- 172.21.15.59:0/660924274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1809f650 0x7f9b181c27d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000c7c0 tx=0x7f9b1000cad0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.904+0000 7f9b1f3b6700 1 -- 172.21.15.59:0/660924274 shutdown_connections 2023-09-30T22:30:23.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.904+0000 7f9b1f3b6700 1 --2- 172.21.15.59:0/660924274 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b1809e930 0x7f9b181c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.904+0000 7f9b1f3b6700 1 --2- 172.21.15.59:0/660924274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1809f650 0x7f9b181c27d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.904+0000 7f9b1f3b6700 1 --2- 172.21.15.59:0/660924274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1809f240 0x7f9b181c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.904+0000 7f9b1f3b6700 1 -- 172.21.15.59:0/660924274 >> 172.21.15.59:0/660924274 conn(0x7f9b180a4210 msgr2=0x7f9b180a27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:23.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.905+0000 7f9b1f3b6700 1 -- 172.21.15.59:0/660924274 shutdown_connections 2023-09-30T22:30:23.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:23.905+0000 7f9b1f3b6700 1 -- 172.21.15.59:0/660924274 wait complete. 2023-09-30T22:30:23.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:24.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:24.078 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:24.144 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.211+0000 7fc16bbb4700 1 Processor -- start 2023-09-30T22:30:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.212+0000 7fc16bbb4700 1 -- start start 2023-09-30T22:30:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.212+0000 7fc16bbb4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc16409d6f0 0x7fc16409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.212+0000 7fc16bbb4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc16409e000 0x7fc1641339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.212+0000 7fc16bbb4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc16409e410 0x7fc164133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.212+0000 7fc16bbb4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc16406b460 con 0x7fc16409d6f0 2023-09-30T22:30:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.212+0000 7fc16bbb4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16409b120 con 0x7fc16409e000 2023-09-30T22:30:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.212+0000 7fc16bbb4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc16409a7e0 con 0x7fc16409e410 2023-09-30T22:30:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.212+0000 7fc16914f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc16409e000 0x7fc1641339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.212+0000 7fc16914f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc16409e000 0x7fc1641339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58000/0 (socket says 172.21.15.59:58000) 2023-09-30T22:30:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.212+0000 7fc16914f700 1 -- 172.21.15.59:0/2093681403 learned_addr learned my addr 172.21.15.59:0/2093681403 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.212+0000 7fc16a151700 1 --2- 172.21.15.59:0/2093681403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc16409e410 0x7fc164133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.212+0000 7fc169950700 1 --2- 172.21.15.59:0/2093681403 >> v2:172.21.15.59:3300/0 conn(0x7fc16409d6f0 0x7fc16409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.213+0000 7fc16914f700 1 -- 172.21.15.59:0/2093681403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc16409e410 msgr2=0x7fc164133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:24.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.213+0000 7fc16914f700 1 --2- 172.21.15.59:0/2093681403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc16409e410 0x7fc164133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.213+0000 7fc16914f700 1 -- 172.21.15.59:0/2093681403 >> v2:172.21.15.59:3300/0 conn(0x7fc16409d6f0 msgr2=0x7fc16409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:24.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.213+0000 7fc16914f700 1 --2- 172.21.15.59:0/2093681403 >> v2:172.21.15.59:3300/0 conn(0x7fc16409d6f0 0x7fc16409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.213+0000 7fc16914f700 1 -- 172.21.15.59:0/2093681403 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16409a500 con 0x7fc16409e000 2023-09-30T22:30:24.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.213+0000 7fc16a151700 1 --2- 172.21.15.59:0/2093681403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc16409e410 0x7fc164133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:24.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.213+0000 7fc16914f700 1 --2- 172.21.15.59:0/2093681403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc16409e000 0x7fc1641339f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc154009920 tx=0x7fc154009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6eb62a6b38976a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:24.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.213+0000 7fc16894e700 1 -- 172.21.15.59:0/2093681403 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154011830 con 0x7fc16409e000 2023-09-30T22:30:24.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.213+0000 7fc16894e700 1 -- 172.21.15.59:0/2093681403 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc154011990 con 0x7fc16409e000 2023-09-30T22:30:24.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.213+0000 7fc16894e700 1 -- 172.21.15.59:0/2093681403 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154011d20 con 0x7fc16409e000 2023-09-30T22:30:24.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.214+0000 7fc16bbb4700 1 -- 172.21.15.59:0/2093681403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc16409e000 msgr2=0x7fc1641339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.214+0000 7fc16bbb4700 1 --2- 172.21.15.59:0/2093681403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc16409e000 0x7fc1641339f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc154009920 tx=0x7fc154009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:24.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.214+0000 7fc16bbb4700 1 -- 172.21.15.59:0/2093681403 shutdown_connections 2023-09-30T22:30:24.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.214+0000 7fc16bbb4700 1 --2- 172.21.15.59:0/2093681403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc16409e410 0x7fc164133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.214+0000 7fc16bbb4700 1 --2- 172.21.15.59:0/2093681403 >> v2:172.21.15.59:3300/0 conn(0x7fc16409d6f0 0x7fc16409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.214+0000 7fc16bbb4700 1 --2- 172.21.15.59:0/2093681403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc16409e000 0x7fc1641339f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.214+0000 7fc16bbb4700 1 -- 172.21.15.59:0/2093681403 >> 172.21.15.59:0/2093681403 conn(0x7fc164066f50 msgr2=0x7fc16409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:24.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.214+0000 7fc16bbb4700 1 -- 172.21.15.59:0/2093681403 shutdown_connections 2023-09-30T22:30:24.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.214+0000 7fc16bbb4700 1 -- 172.21.15.59:0/2093681403 wait complete. 2023-09-30T22:30:24.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.216+0000 7fc16bbb4700 1 Processor -- start 2023-09-30T22:30:24.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.216+0000 7fc16bbb4700 1 -- start start 2023-09-30T22:30:24.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc16bbb4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc16409d6f0 0x7fc1641c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc16bbb4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc16409e000 0x7fc1641c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc16bbb4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc16409e410 0x7fc1641c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc16bbb4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1641a9920 con 0x7fc16409e000 2023-09-30T22:30:24.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc16bbb4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1641a7910 con 0x7fc16409d6f0 2023-09-30T22:30:24.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc16bbb4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc16409c710 con 0x7fc16409e410 2023-09-30T22:30:24.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc169950700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc16409d6f0 0x7fc1641c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc169950700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc16409d6f0 0x7fc1641c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58006/0 (socket says 172.21.15.59:58006) 2023-09-30T22:30:24.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc169950700 1 -- 172.21.15.59:0/1666244732 learned_addr learned my addr 172.21.15.59:0/1666244732 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:24.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc16914f700 1 --2- 172.21.15.59:0/1666244732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc16409e000 0x7fc1641c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc16a151700 1 --2- 172.21.15.59:0/1666244732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc16409e410 0x7fc1641c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc169950700 1 -- 172.21.15.59:0/1666244732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc16409e410 msgr2=0x7fc1641c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc169950700 1 --2- 172.21.15.59:0/1666244732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc16409e410 0x7fc1641c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc169950700 1 -- 172.21.15.59:0/1666244732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc16409e000 msgr2=0x7fc1641c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc169950700 1 --2- 172.21.15.59:0/1666244732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc16409e000 0x7fc1641c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc169950700 1 -- 172.21.15.59:0/1666244732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c0094a0 con 0x7fc16409d6f0 2023-09-30T22:30:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.217+0000 7fc169950700 1 --2- 172.21.15.59:0/1666244732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc16409d6f0 0x7fc1641c8520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc16000efc0 tx=0x7fc16000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.218+0000 7fc15a7fc700 1 -- 172.21.15.59:0/1666244732 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16000cbb0 con 0x7fc16409d6f0 2023-09-30T22:30:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.218+0000 7fc15a7fc700 1 -- 172.21.15.59:0/1666244732 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16000f040 con 0x7fc16409d6f0 2023-09-30T22:30:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.218+0000 7fc16bbb4700 1 -- 172.21.15.59:0/1666244732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc154009550 con 0x7fc16409d6f0 2023-09-30T22:30:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.218+0000 7fc15a7fc700 1 -- 172.21.15.59:0/1666244732 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc160014480 con 0x7fc16409d6f0 2023-09-30T22:30:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.218+0000 7fc16bbb4700 1 -- 172.21.15.59:0/1666244732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1641a9280 con 0x7fc16409d6f0 2023-09-30T22:30:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.219+0000 7fc15a7fc700 1 -- 172.21.15.59:0/1666244732 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1600145e0 con 0x7fc16409d6f0 2023-09-30T22:30:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.219+0000 7fc16bbb4700 1 -- 172.21.15.59:0/1666244732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1641a87d0 con 0x7fc16409d6f0 2023-09-30T22:30:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.219+0000 7fc15a7fc700 1 -- 172.21.15.59:0/1666244732 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc16003fff0 con 0x7fc16409d6f0 2023-09-30T22:30:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.224+0000 7fc15a7fc700 1 -- 172.21.15.59:0/1666244732 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1641a87d0 con 0x7fc16409d6f0 2023-09-30T22:30:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.253+0000 7f6b13c02700 1 Processor -- start 2023-09-30T22:30:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.253+0000 7f6b13c02700 1 -- start start 2023-09-30T22:30:24.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b13c02700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b0c133420 0x7f6b0c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b13c02700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b0c133e30 0x7f6b0c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b13c02700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b0c134260 0x7f6b0c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b13c02700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0c06b990 con 0x7f6b0c133420 2023-09-30T22:30:24.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b13c02700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c0a0590 con 0x7f6b0c134260 2023-09-30T22:30:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b13c02700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c09fb80 con 0x7f6b0c133e30 2023-09-30T22:30:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b1199e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b0c133420 0x7f6b0c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b1219f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b0c134260 0x7f6b0c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b1219f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b0c134260 0x7f6b0c1304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58016/0 (socket says 172.21.15.59:58016) 2023-09-30T22:30:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b1219f700 1 -- 172.21.15.59:0/3203117824 learned_addr learned my addr 172.21.15.59:0/3203117824 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b1199e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b0c133420 0x7f6b0c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49372/0 (socket says 172.21.15.59:49372) 2023-09-30T22:30:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b1119d700 1 --2- 172.21.15.59:0/3203117824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b0c133e30 0x7f6b0c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b1199e700 1 -- 172.21.15.59:0/3203117824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b0c133e30 msgr2=0x7f6b0c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b1199e700 1 --2- 172.21.15.59:0/3203117824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b0c133e30 0x7f6b0c12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b1199e700 1 -- 172.21.15.59:0/3203117824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b0c134260 msgr2=0x7f6b0c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b1199e700 1 --2- 172.21.15.59:0/3203117824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b0c134260 0x7f6b0c1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b1199e700 1 -- 172.21.15.59:0/3203117824 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c0a0030 con 0x7f6b0c133420 2023-09-30T22:30:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.254+0000 7f6b1219f700 1 --2- 172.21.15.59:0/3203117824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b0c134260 0x7f6b0c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.255+0000 7f6b1199e700 1 --2- 172.21.15.59:0/3203117824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0c133420 0x7f6b0c1337f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009840 tx=0x7f6b08009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef86d7433d3b99a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.255+0000 7f6b1099c700 1 -- 172.21.15.59:0/3203117824 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08011830 con 0x7f6b0c133420 2023-09-30T22:30:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.255+0000 7f6b1099c700 1 -- 172.21.15.59:0/3203117824 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b08011990 con 0x7f6b0c133420 2023-09-30T22:30:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.255+0000 7f6b1099c700 1 -- 172.21.15.59:0/3203117824 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08011d20 con 0x7f6b0c133420 2023-09-30T22:30:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.256+0000 7f6b13c02700 1 -- 172.21.15.59:0/3203117824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0c133420 msgr2=0x7f6b0c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.256+0000 7f6b13c02700 1 --2- 172.21.15.59:0/3203117824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0c133420 0x7f6b0c1337f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009840 tx=0x7f6b08009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:24.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.256+0000 7f6b13c02700 1 -- 172.21.15.59:0/3203117824 shutdown_connections 2023-09-30T22:30:24.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.256+0000 7f6b13c02700 1 --2- 172.21.15.59:0/3203117824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b0c134260 0x7f6b0c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.256+0000 7f6b13c02700 1 --2- 172.21.15.59:0/3203117824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0c133420 0x7f6b0c1337f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.256+0000 7f6b13c02700 1 --2- 172.21.15.59:0/3203117824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b0c133e30 0x7f6b0c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.256+0000 7f6b13c02700 1 -- 172.21.15.59:0/3203117824 >> 172.21.15.59:0/3203117824 conn(0x7f6b0c0a4210 msgr2=0x7f6b0c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:24.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.256+0000 7f6b13c02700 1 -- 172.21.15.59:0/3203117824 shutdown_connections 2023-09-30T22:30:24.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.256+0000 7f6b13c02700 1 -- 172.21.15.59:0/3203117824 wait complete. 2023-09-30T22:30:24.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.257+0000 7f6b13c02700 1 Processor -- start 2023-09-30T22:30:24.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.257+0000 7f6b13c02700 1 -- start start 2023-09-30T22:30:24.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b13c02700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0c133420 0x7f6b0c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b13c02700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b0c133e30 0x7f6b0c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b13c02700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b0c134260 0x7f6b0c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b13c02700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c11f180 con 0x7f6b0c133420 2023-09-30T22:30:24.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b13c02700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c09df60 con 0x7f6b0c133e30 2023-09-30T22:30:24.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b13c02700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c09dd70 con 0x7f6b0c134260 2023-09-30T22:30:24.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b1199e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0c133420 0x7f6b0c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b1199e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0c133420 0x7f6b0c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49374/0 (socket says 172.21.15.59:49374) 2023-09-30T22:30:24.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b1199e700 1 -- 172.21.15.59:0/1288183433 learned_addr learned my addr 172.21.15.59:0/1288183433 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:24.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b1119d700 1 --2- 172.21.15.59:0/1288183433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b0c133e30 0x7f6b0c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b1219f700 1 --2- 172.21.15.59:0/1288183433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b0c134260 0x7f6b0c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b1119d700 1 -- 172.21.15.59:0/1288183433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b0c134260 msgr2=0x7f6b0c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b1119d700 1 --2- 172.21.15.59:0/1288183433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b0c134260 0x7f6b0c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b1119d700 1 -- 172.21.15.59:0/1288183433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0c133420 msgr2=0x7f6b0c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b1119d700 1 --2- 172.21.15.59:0/1288183433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0c133420 0x7f6b0c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b1119d700 1 -- 172.21.15.59:0/1288183433 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b04009b30 con 0x7f6b0c133e30 2023-09-30T22:30:24.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.258+0000 7f6b1199e700 1 --2- 172.21.15.59:0/1288183433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0c133420 0x7f6b0c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:24.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.259+0000 7f6b1119d700 1 --2- 172.21.15.59:0/1288183433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b0c133e30 0x7f6b0c09c9c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00e900 tx=0x7f6afc00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:24.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.259+0000 7f6b027fc700 1 -- 172.21.15.59:0/1288183433 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc013680 con 0x7f6b0c133e30 2023-09-30T22:30:24.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.259+0000 7f6b027fc700 1 -- 172.21.15.59:0/1288183433 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc0137e0 con 0x7f6b0c133e30 2023-09-30T22:30:24.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.259+0000 7f6b027fc700 1 -- 172.21.15.59:0/1288183433 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc013b50 con 0x7f6b0c133e30 2023-09-30T22:30:24.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.259+0000 7f6b13c02700 1 -- 172.21.15.59:0/1288183433 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b080094a0 con 0x7f6b0c133e30 2023-09-30T22:30:24.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.259+0000 7f6b13c02700 1 -- 172.21.15.59:0/1288183433 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0c11f4d0 con 0x7f6b0c133e30 2023-09-30T22:30:24.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.260+0000 7f6b027fc700 1 -- 172.21.15.59:0/1288183433 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6afc013cb0 con 0x7f6b0c133e30 2023-09-30T22:30:24.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.260+0000 7f6b027fc700 1 -- 172.21.15.59:0/1288183433 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6afc03f8b0 con 0x7f6b0c133e30 2023-09-30T22:30:24.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.260+0000 7f6b13c02700 1 -- 172.21.15.59:0/1288183433 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b0c074ea0 con 0x7f6b0c133e30 2023-09-30T22:30:24.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.265+0000 7f6b027fc700 1 -- 172.21.15.59:0/1288183433 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6afc017080 con 0x7f6b0c133e30 2023-09-30T22:30:24.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.296+0000 7f1cc23ea700 1 Processor -- start 2023-09-30T22:30:24.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.296+0000 7f1cc23ea700 1 -- start start 2023-09-30T22:30:24.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.297+0000 7f1cc23ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cbc0a0a30 0x7f1cbc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.297+0000 7f1cc23ea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cbc09d630 0x7f1cbc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.297+0000 7f1cc23ea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc0a2a70 con 0x7f1cbc133930 2023-09-30T22:30:24.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.297+0000 7f1cc23ea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cbc0a01d0 con 0x7f1cbc09d630 2023-09-30T22:30:24.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.297+0000 7f1cc23ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc09e2b0 con 0x7f1cbc0a0a30 2023-09-30T22:30:24.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.297+0000 7f1cbbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cbc0a0a30 0x7f1cbc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.297+0000 7f1cbbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cbc0a0a30 0x7f1cbc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36460/0 (socket says 172.21.15.59:36460) 2023-09-30T22:30:24.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.297+0000 7f1cbbfff700 1 -- 172.21.15.59:0/214652311 learned_addr learned my addr 172.21.15.59:0/214652311 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:24.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.297+0000 7f1cbb7fe700 1 --2- 172.21.15.59:0/214652311 >> v2:172.21.15.59:3300/0 conn(0x7f1cbc09d630 0x7f1cbc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.297+0000 7f1cbb7fe700 1 -- 172.21.15.59:0/214652311 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cbc0a0a30 msgr2=0x7f1cbc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:24.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.297+0000 7f1cbb7fe700 1 --2- 172.21.15.59:0/214652311 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cbc0a0a30 0x7f1cbc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.297+0000 7f1cbb7fe700 1 -- 172.21.15.59:0/214652311 >> v1:172.21.15.59:6789/0 conn(0x7f1cbc133930 legacy=0x7f1cbc133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.297+0000 7f1cbb7fe700 1 -- 172.21.15.59:0/214652311 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc09dc50 con 0x7f1cbc09d630 2023-09-30T22:30:24.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.297+0000 7f1cbbfff700 1 --2- 172.21.15.59:0/214652311 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cbc0a0a30 0x7f1cbc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:24.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.297+0000 7f1cbb7fe700 1 --2- 172.21.15.59:0/214652311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc09d630 0x7f1cbc0a1340 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009840 tx=0x7f1cb0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a995def6366d1040 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:24.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.298+0000 7f1cbaffd700 1 -- 172.21.15.59:0/214652311 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0011830 con 0x7f1cbc09d630 2023-09-30T22:30:24.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.298+0000 7f1cbaffd700 1 -- 172.21.15.59:0/214652311 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb0011990 con 0x7f1cbc09d630 2023-09-30T22:30:24.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.298+0000 7f1cbaffd700 1 -- 172.21.15.59:0/214652311 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0011d20 con 0x7f1cbc09d630 2023-09-30T22:30:24.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.298+0000 7f1cc23ea700 1 -- 172.21.15.59:0/214652311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc09d630 msgr2=0x7f1cbc0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.298+0000 7f1cc23ea700 1 --2- 172.21.15.59:0/214652311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc09d630 0x7f1cbc0a1340 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009840 tx=0x7f1cb0009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:24.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.298+0000 7f1cc23ea700 1 -- 172.21.15.59:0/214652311 shutdown_connections 2023-09-30T22:30:24.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.298+0000 7f1cc23ea700 1 --2- 172.21.15.59:0/214652311 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cbc0a0a30 0x7f1cbc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.298+0000 7f1cc23ea700 1 --2- 172.21.15.59:0/214652311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc09d630 0x7f1cbc0a1340 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.298+0000 7f1cc23ea700 1 -- 172.21.15.59:0/214652311 >> 172.21.15.59:0/214652311 conn(0x7f1cbc0a3050 msgr2=0x7f1cbc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:24.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.298+0000 7f1cc23ea700 1 -- 172.21.15.59:0/214652311 shutdown_connections 2023-09-30T22:30:24.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.298+0000 7f1cc23ea700 1 -- 172.21.15.59:0/214652311 wait complete. 2023-09-30T22:30:24.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.300+0000 7f1cc23ea700 1 Processor -- start 2023-09-30T22:30:24.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.300+0000 7f1cc23ea700 1 -- start start 2023-09-30T22:30:24.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cc23ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cbc09d630 0x7f1cbc1c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cc23ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0a0a30 0x7f1cbc1c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cc23ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc133930 0x7f1cbc1c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cc23ea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc120a70 con 0x7f1cbc133930 2023-09-30T22:30:24.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cc23ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc120880 con 0x7f1cbc0a0a30 2023-09-30T22:30:24.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cc23ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc121920 con 0x7f1cbc09d630 2023-09-30T22:30:24.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cbb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0a0a30 0x7f1cbc1c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cbb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0a0a30 0x7f1cbc1c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58044/0 (socket says 172.21.15.59:58044) 2023-09-30T22:30:24.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cbb7fe700 1 -- 172.21.15.59:0/1738675134 learned_addr learned my addr 172.21.15.59:0/1738675134 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:24.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cbbfff700 1 --2- 172.21.15.59:0/1738675134 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cbc09d630 0x7f1cbc1c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cc0987700 1 --2- 172.21.15.59:0/1738675134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc133930 0x7f1cbc1c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cbb7fe700 1 -- 172.21.15.59:0/1738675134 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cbc09d630 msgr2=0x7f1cbc1c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cbb7fe700 1 --2- 172.21.15.59:0/1738675134 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cbc09d630 0x7f1cbc1c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cbb7fe700 1 -- 172.21.15.59:0/1738675134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc133930 msgr2=0x7f1cbc1c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cbb7fe700 1 --2- 172.21.15.59:0/1738675134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc133930 0x7f1cbc1c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cbb7fe700 1 -- 172.21.15.59:0/1738675134 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac009550 con 0x7f1cbc0a0a30 2023-09-30T22:30:24.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.301+0000 7f1cbb7fe700 1 --2- 172.21.15.59:0/1738675134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0a0a30 0x7f1cbc1c8850 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00090b0 tx=0x7f1cb0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:24.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.302+0000 7f1cb8ff9700 1 -- 172.21.15.59:0/1738675134 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0004400 con 0x7f1cbc0a0a30 2023-09-30T22:30:24.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.302+0000 7f1cb8ff9700 1 -- 172.21.15.59:0/1738675134 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb001f070 con 0x7f1cbc0a0a30 2023-09-30T22:30:24.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.302+0000 7f1cb8ff9700 1 -- 172.21.15.59:0/1738675134 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb00038e0 con 0x7f1cbc0a0a30 2023-09-30T22:30:24.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.302+0000 7f1cc23ea700 1 -- 172.21.15.59:0/1738675134 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb00094a0 con 0x7f1cbc0a0a30 2023-09-30T22:30:24.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.302+0000 7f1cc23ea700 1 -- 172.21.15.59:0/1738675134 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cbc1224b0 con 0x7f1cbc0a0a30 2023-09-30T22:30:24.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.303+0000 7f1cb8ff9700 1 -- 172.21.15.59:0/1738675134 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1cb0021030 con 0x7f1cbc0a0a30 2023-09-30T22:30:24.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.303+0000 7f1ca27fc700 1 -- 172.21.15.59:0/1738675134 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c940052e0 con 0x7f1cbc0a0a30 2023-09-30T22:30:24.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.303+0000 7f1cb8ff9700 1 -- 172.21.15.59:0/1738675134 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1cb00408d0 con 0x7f1cbc0a0a30 2023-09-30T22:30:24.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.308+0000 7f1cb8ff9700 1 -- 172.21.15.59:0/1738675134 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1cb00239c0 con 0x7f1cbc0a0a30 2023-09-30T22:30:24.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.438+0000 7fc16bbb4700 1 -- 172.21.15.59:0/1666244732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc1641a87d0 con 0x7fc16409d6f0 2023-09-30T22:30:24.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.438+0000 7fc15a7fc700 1 -- 172.21.15.59:0/1666244732 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc1641a87d0 con 0x7fc16409d6f0 2023-09-30T22:30:24.438 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.440+0000 7fc16bbb4700 1 -- 172.21.15.59:0/1666244732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc16409d6f0 msgr2=0x7fc1641c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.440+0000 7fc16bbb4700 1 --2- 172.21.15.59:0/1666244732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc16409d6f0 0x7fc1641c8520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc16000efc0 tx=0x7fc16000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.440+0000 7fc16bbb4700 1 -- 172.21.15.59:0/1666244732 shutdown_connections 2023-09-30T22:30:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.440+0000 7fc16bbb4700 1 --2- 172.21.15.59:0/1666244732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc16409e410 0x7fc1641c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.440+0000 7fc16bbb4700 1 --2- 172.21.15.59:0/1666244732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc16409d6f0 0x7fc1641c8520 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.440+0000 7fc16bbb4700 1 --2- 172.21.15.59:0/1666244732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc16409e000 0x7fc1641c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.440+0000 7fc16bbb4700 1 -- 172.21.15.59:0/1666244732 >> 172.21.15.59:0/1666244732 conn(0x7fc164066f50 msgr2=0x7fc1641bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.441+0000 7fc16bbb4700 1 -- 172.21.15.59:0/1666244732 shutdown_connections 2023-09-30T22:30:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.441+0000 7fc16bbb4700 1 -- 172.21.15.59:0/1666244732 wait complete. 2023-09-30T22:30:24.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:24.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.473+0000 7f6b13c02700 1 -- 172.21.15.59:0/1288183433 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b0c11f920 con 0x7f6b0c133e30 2023-09-30T22:30:24.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.473+0000 7f6b027fc700 1 -- 172.21.15.59:0/1288183433 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6afc01b590 con 0x7f6b0c133e30 2023-09-30T22:30:24.474 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:24.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.476+0000 7f6b13c02700 1 -- 172.21.15.59:0/1288183433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b0c133e30 msgr2=0x7f6b0c09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.476+0000 7f6b13c02700 1 --2- 172.21.15.59:0/1288183433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b0c133e30 0x7f6b0c09c9c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00e900 tx=0x7f6afc00ec10 comp rx=0 tx=0).stop 2023-09-30T22:30:24.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.476+0000 7f6b13c02700 1 -- 172.21.15.59:0/1288183433 shutdown_connections 2023-09-30T22:30:24.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.476+0000 7f6b13c02700 1 --2- 172.21.15.59:0/1288183433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b0c134260 0x7f6b0c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.476+0000 7f6b13c02700 1 --2- 172.21.15.59:0/1288183433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0c133420 0x7f6b0c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.476+0000 7f6b13c02700 1 --2- 172.21.15.59:0/1288183433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b0c133e30 0x7f6b0c09c9c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.476+0000 7f6b13c02700 1 -- 172.21.15.59:0/1288183433 >> 172.21.15.59:0/1288183433 conn(0x7f6b0c0a4210 msgr2=0x7f6b0c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:24.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.476+0000 7f6b13c02700 1 -- 172.21.15.59:0/1288183433 shutdown_connections 2023-09-30T22:30:24.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.476+0000 7f6b13c02700 1 -- 172.21.15.59:0/1288183433 wait complete. 2023-09-30T22:30:24.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:24.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.517+0000 7f1ca27fc700 1 -- 172.21.15.59:0/1738675134 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1c94005590 con 0x7f1cbc0a0a30 2023-09-30T22:30:24.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.517+0000 7f1cb8ff9700 1 -- 172.21.15.59:0/1738675134 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1cb0015070 con 0x7f1cbc0a0a30 2023-09-30T22:30:24.517 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.519+0000 7f1ca27fc700 1 -- 172.21.15.59:0/1738675134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0a0a30 msgr2=0x7f1cbc1c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.519+0000 7f1ca27fc700 1 --2- 172.21.15.59:0/1738675134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0a0a30 0x7f1cbc1c8850 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00090b0 tx=0x7f1cb0004750 comp rx=0 tx=0).stop 2023-09-30T22:30:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.519+0000 7f1ca27fc700 1 -- 172.21.15.59:0/1738675134 shutdown_connections 2023-09-30T22:30:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.519+0000 7f1ca27fc700 1 --2- 172.21.15.59:0/1738675134 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cbc09d630 0x7f1cbc1c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.519+0000 7f1ca27fc700 1 --2- 172.21.15.59:0/1738675134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc133930 0x7f1cbc1c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.519+0000 7f1ca27fc700 1 --2- 172.21.15.59:0/1738675134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0a0a30 0x7f1cbc1c8850 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.519+0000 7f1ca27fc700 1 -- 172.21.15.59:0/1738675134 >> 172.21.15.59:0/1738675134 conn(0x7f1cbc0a3050 msgr2=0x7f1cbc1bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.519+0000 7f1ca27fc700 1 -- 172.21.15.59:0/1738675134 shutdown_connections 2023-09-30T22:30:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:24.519+0000 7f1ca27fc700 1 -- 172.21.15.59:0/1738675134 wait complete. 2023-09-30T22:30:24.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:24.919 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:25.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.067+0000 7f7d11f57700 1 Processor -- start 2023-09-30T22:30:25.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.067+0000 7f7d11f57700 1 -- start start 2023-09-30T22:30:25.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.067+0000 7f7d11f57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d0c136710 0x7f7d0c138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.067+0000 7f7d11f57700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d0c139030 0x7f7d0c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.067+0000 7f7d11f57700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c06ef30 con 0x7f7d0c1338a0 2023-09-30T22:30:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.068+0000 7f7d11f57700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c06fef0 con 0x7f7d0c139030 2023-09-30T22:30:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.068+0000 7f7d11f57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1334b0 con 0x7f7d0c136710 2023-09-30T22:30:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.068+0000 7f7d0affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d0c136710 0x7f7d0c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.068+0000 7f7d0affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d0c136710 0x7f7d0c138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42578/0 (socket says 172.21.15.59:42578) 2023-09-30T22:30:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.068+0000 7f7d0bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d0c139030 0x7f7d0c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.068+0000 7f7d0affd700 1 -- 172.21.15.59:0/1952480494 learned_addr learned my addr 172.21.15.59:0/1952480494 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.068+0000 7f7d0affd700 1 -- 172.21.15.59:0/1952480494 >> v2:172.21.15.59:3300/0 conn(0x7f7d0c139030 msgr2=0x7f7d0c13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.068+0000 7f7d0affd700 1 --2- 172.21.15.59:0/1952480494 >> v2:172.21.15.59:3300/0 conn(0x7f7d0c139030 0x7f7d0c13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.068+0000 7f7d0affd700 1 -- 172.21.15.59:0/1952480494 >> v1:172.21.15.59:6789/0 conn(0x7f7d0c1338a0 legacy=0x7f7d0c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.068+0000 7f7d0affd700 1 -- 172.21.15.59:0/1952480494 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c06fc30 con 0x7f7d0c136710 2023-09-30T22:30:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.068+0000 7f7d0bfff700 1 --2- 172.21.15.59:0/1952480494 >> v2:172.21.15.59:3300/0 conn(0x7f7d0c139030 0x7f7d0c13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.068+0000 7f7d0affd700 1 --2- 172.21.15.59:0/1952480494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d0c136710 0x7f7d0c138af0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40098f0 tx=0x7f7cf4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bc8bc03a03d77d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.068+0000 7f7d0a7fc700 1 -- 172.21.15.59:0/1952480494 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4011830 con 0x7f7d0c136710 2023-09-30T22:30:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.068+0000 7f7d0a7fc700 1 -- 172.21.15.59:0/1952480494 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf4011990 con 0x7f7d0c136710 2023-09-30T22:30:25.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.068+0000 7f7d0a7fc700 1 -- 172.21.15.59:0/1952480494 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4011d20 con 0x7f7d0c136710 2023-09-30T22:30:25.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.069+0000 7f7d11f57700 1 -- 172.21.15.59:0/1952480494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d0c136710 msgr2=0x7f7d0c138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.069+0000 7f7d11f57700 1 --2- 172.21.15.59:0/1952480494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d0c136710 0x7f7d0c138af0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40098f0 tx=0x7f7cf4009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:25.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.069+0000 7f7d11f57700 1 -- 172.21.15.59:0/1952480494 shutdown_connections 2023-09-30T22:30:25.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.069+0000 7f7d11f57700 1 --2- 172.21.15.59:0/1952480494 >> v2:172.21.15.59:3300/0 conn(0x7f7d0c139030 0x7f7d0c13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.069+0000 7f7d11f57700 1 --2- 172.21.15.59:0/1952480494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d0c136710 0x7f7d0c138af0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.069+0000 7f7d11f57700 1 -- 172.21.15.59:0/1952480494 >> 172.21.15.59:0/1952480494 conn(0x7f7d0c0a2aa0 msgr2=0x7f7d0c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:25.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.069+0000 7f7d11f57700 1 -- 172.21.15.59:0/1952480494 shutdown_connections 2023-09-30T22:30:25.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.069+0000 7f7d11f57700 1 -- 172.21.15.59:0/1952480494 wait complete. 2023-09-30T22:30:25.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.070+0000 7f7d11f57700 1 Processor -- start 2023-09-30T22:30:25.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.070+0000 7f7d11f57700 1 -- start start 2023-09-30T22:30:25.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d11f57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d0c1338a0 0x7f7d0c1c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d11f57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d0c136710 0x7f7d0c1c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d11f57700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0c139030 0x7f7d0c11ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d11f57700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c06f640 con 0x7f7d0c139030 2023-09-30T22:30:25.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d11f57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c130c00 con 0x7f7d0c136710 2023-09-30T22:30:25.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d11f57700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c11e2b0 con 0x7f7d0c1338a0 2023-09-30T22:30:25.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d0affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d0c136710 0x7f7d0c1c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d0b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d0c1338a0 0x7f7d0c1c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d0bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0c139030 0x7f7d0c11ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d0b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d0c1338a0 0x7f7d0c1c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39948/0 (socket says 172.21.15.59:39948) 2023-09-30T22:30:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d0affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d0c136710 0x7f7d0c1c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42592/0 (socket says 172.21.15.59:42592) 2023-09-30T22:30:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d0b7fe700 1 -- 172.21.15.59:0/2772886152 learned_addr learned my addr 172.21.15.59:0/2772886152 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d0bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0c139030 0x7f7d0c11ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50716/0 (socket says 172.21.15.59:50716) 2023-09-30T22:30:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d0bfff700 1 -- 172.21.15.59:0/2772886152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d0c1338a0 msgr2=0x7f7d0c1c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d0bfff700 1 --2- 172.21.15.59:0/2772886152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d0c1338a0 0x7f7d0c1c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d0bfff700 1 -- 172.21.15.59:0/2772886152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d0c136710 msgr2=0x7f7d0c1c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d0bfff700 1 --2- 172.21.15.59:0/2772886152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d0c136710 0x7f7d0c1c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d0bfff700 1 -- 172.21.15.59:0/2772886152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d04009a70 con 0x7f7d0c139030 2023-09-30T22:30:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d0affd700 1 --2- 172.21.15.59:0/2772886152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d0c136710 0x7f7d0c1c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d0b7fe700 1 --2- 172.21.15.59:0/2772886152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d0c1338a0 0x7f7d0c1c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.071+0000 7f7d0bfff700 1 --2- 172.21.15.59:0/2772886152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0c139030 0x7f7d0c11ad70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400ef90 tx=0x7f7d0400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.072+0000 7f7d03fff700 1 -- 172.21.15.59:0/2772886152 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400ca90 con 0x7f7d0c139030 2023-09-30T22:30:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.072+0000 7f7d03fff700 1 -- 172.21.15.59:0/2772886152 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0400f040 con 0x7f7d0c139030 2023-09-30T22:30:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.072+0000 7f7d11f57700 1 -- 172.21.15.59:0/2772886152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf4009550 con 0x7f7d0c139030 2023-09-30T22:30:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.072+0000 7f7d03fff700 1 -- 172.21.15.59:0/2772886152 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400ce30 con 0x7f7d0c139030 2023-09-30T22:30:25.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.072+0000 7f7d11f57700 1 -- 172.21.15.59:0/2772886152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c11efe0 con 0x7f7d0c139030 2023-09-30T22:30:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.073+0000 7f7d03fff700 1 -- 172.21.15.59:0/2772886152 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d04014480 con 0x7f7d0c139030 2023-09-30T22:30:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.073+0000 7f7d03fff700 1 -- 172.21.15.59:0/2772886152 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7d0403fbf0 con 0x7f7d0c139030 2023-09-30T22:30:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.073+0000 7f7d11f57700 1 -- 172.21.15.59:0/2772886152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c074ea0 con 0x7f7d0c139030 2023-09-30T22:30:25.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.078+0000 7f7d03fff700 1 -- 172.21.15.59:0/2772886152 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d04012930 con 0x7f7d0c139030 2023-09-30T22:30:25.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.279+0000 7f7d11f57700 1 -- 172.21.15.59:0/2772886152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7d0c11e470 con 0x7f7d0c139030 2023-09-30T22:30:25.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.280+0000 7f7d03fff700 1 -- 172.21.15.59:0/2772886152 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d04012340 con 0x7f7d0c139030 2023-09-30T22:30:25.280 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:25.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.282+0000 7f7d11f57700 1 -- 172.21.15.59:0/2772886152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0c139030 msgr2=0x7f7d0c11ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.282+0000 7f7d11f57700 1 --2- 172.21.15.59:0/2772886152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0c139030 0x7f7d0c11ad70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400ef90 tx=0x7f7d0400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.282+0000 7f7d11f57700 1 -- 172.21.15.59:0/2772886152 shutdown_connections 2023-09-30T22:30:25.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.282+0000 7f7d11f57700 1 --2- 172.21.15.59:0/2772886152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d0c1338a0 0x7f7d0c1c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.282+0000 7f7d11f57700 1 --2- 172.21.15.59:0/2772886152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0c139030 0x7f7d0c11ad70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.282+0000 7f7d11f57700 1 --2- 172.21.15.59:0/2772886152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d0c136710 0x7f7d0c1c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.282+0000 7f7d11f57700 1 -- 172.21.15.59:0/2772886152 >> 172.21.15.59:0/2772886152 conn(0x7f7d0c0a2aa0 msgr2=0x7f7d0c137200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:25.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.282+0000 7f7d11f57700 1 -- 172.21.15.59:0/2772886152 shutdown_connections 2023-09-30T22:30:25.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.282+0000 7f7d11f57700 1 -- 172.21.15.59:0/2772886152 wait complete. 2023-09-30T22:30:25.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:25.455 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:25.491 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:25.533 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:25.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.602+0000 7ffbc334f700 1 Processor -- start 2023-09-30T22:30:25.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.602+0000 7ffbc334f700 1 -- start start 2023-09-30T22:30:25.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.603+0000 7ffbc334f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbbc06b250 0x7ffbbc136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.603+0000 7ffbc334f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffbbc136d80 0x7ffbbc139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.603+0000 7ffbc334f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbbc09ece0 con 0x7ffbbc06a770 2023-09-30T22:30:25.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.603+0000 7ffbc334f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbbc06b640 con 0x7ffbbc136d80 2023-09-30T22:30:25.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.603+0000 7ffbc334f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc09e760 con 0x7ffbbc06b250 2023-09-30T22:30:25.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.603+0000 7ffbc18ec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffbbc136d80 0x7ffbbc139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.603+0000 7ffbc18ec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffbbc136d80 0x7ffbbc139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50728/0 (socket says 172.21.15.59:50728) 2023-09-30T22:30:25.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.603+0000 7ffbc18ec700 1 -- 172.21.15.59:0/1010517426 learned_addr learned my addr 172.21.15.59:0/1010517426 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:25.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.603+0000 7ffbc08ea700 1 --2- 172.21.15.59:0/1010517426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbbc06b250 0x7ffbbc136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.603+0000 7ffbc18ec700 1 -- 172.21.15.59:0/1010517426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbbc06b250 msgr2=0x7ffbbc136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:25.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.603+0000 7ffbc18ec700 1 --2- 172.21.15.59:0/1010517426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbbc06b250 0x7ffbbc136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.603+0000 7ffbc18ec700 1 -- 172.21.15.59:0/1010517426 >> v1:172.21.15.59:6789/0 conn(0x7ffbbc06a770 legacy=0x7ffbbc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.603+0000 7ffbc18ec700 1 -- 172.21.15.59:0/1010517426 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc09e040 con 0x7ffbbc136d80 2023-09-30T22:30:25.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.603+0000 7ffbc18ec700 1 --2- 172.21.15.59:0/1010517426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbbc136d80 0x7ffbbc139160 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009e50 tx=0x7ffbb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ba6a4d6e4ad55d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:25.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.604+0000 7ffbb3fff700 1 -- 172.21.15.59:0/1010517426 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400e070 con 0x7ffbbc136d80 2023-09-30T22:30:25.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.604+0000 7ffbb3fff700 1 -- 172.21.15.59:0/1010517426 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb400b910 con 0x7ffbbc136d80 2023-09-30T22:30:25.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.604+0000 7ffbb3fff700 1 -- 172.21.15.59:0/1010517426 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400bc80 con 0x7ffbbc136d80 2023-09-30T22:30:25.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.604+0000 7ffbc334f700 1 -- 172.21.15.59:0/1010517426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbbc136d80 msgr2=0x7ffbbc139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.604+0000 7ffbc334f700 1 --2- 172.21.15.59:0/1010517426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbbc136d80 0x7ffbbc139160 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009e50 tx=0x7ffbb400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:25.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.605+0000 7ffbc334f700 1 -- 172.21.15.59:0/1010517426 shutdown_connections 2023-09-30T22:30:25.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.605+0000 7ffbc334f700 1 --2- 172.21.15.59:0/1010517426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbbc136d80 0x7ffbbc139160 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.605+0000 7ffbc334f700 1 --2- 172.21.15.59:0/1010517426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbbc06b250 0x7ffbbc136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.605+0000 7ffbc334f700 1 -- 172.21.15.59:0/1010517426 >> 172.21.15.59:0/1010517426 conn(0x7ffbbc066f50 msgr2=0x7ffbbc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:25.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.605+0000 7ffbc334f700 1 -- 172.21.15.59:0/1010517426 shutdown_connections 2023-09-30T22:30:25.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.605+0000 7ffbc334f700 1 -- 172.21.15.59:0/1010517426 wait complete. 2023-09-30T22:30:25.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.606+0000 7ffbc334f700 1 Processor -- start 2023-09-30T22:30:25.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.606+0000 7ffbc334f700 1 -- start start 2023-09-30T22:30:25.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.607+0000 7ffbc334f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbbc06a770 0x7ffbbc11cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.607+0000 7ffbc334f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbbc06b250 0x7ffbbc11d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.607+0000 7ffbc334f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbbc136d80 0x7ffbbc1c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.607+0000 7ffbc334f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc11d9b0 con 0x7ffbbc136d80 2023-09-30T22:30:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.607+0000 7ffbc334f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc06e8e0 con 0x7ffbbc06a770 2023-09-30T22:30:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.607+0000 7ffbc334f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc071e60 con 0x7ffbbc06b250 2023-09-30T22:30:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.607+0000 7ffbc18ec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbbc136d80 0x7ffbbc1c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.607+0000 7ffbc08ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbbc06b250 0x7ffbbc11d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.607+0000 7ffbc18ec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbbc136d80 0x7ffbbc1c5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50732/0 (socket says 172.21.15.59:50732) 2023-09-30T22:30:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.607+0000 7ffbc18ec700 1 -- 172.21.15.59:0/2028871914 learned_addr learned my addr 172.21.15.59:0/2028871914 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.608+0000 7ffbc18ec700 1 -- 172.21.15.59:0/2028871914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbbc06b250 msgr2=0x7ffbbc11d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.608+0000 7ffbc18ec700 1 --2- 172.21.15.59:0/2028871914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbbc06b250 0x7ffbbc11d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.608+0000 7ffbc18ec700 1 -- 172.21.15.59:0/2028871914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbbc06a770 msgr2=0x7ffbbc11cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.608+0000 7ffbc18ec700 1 --2- 172.21.15.59:0/2028871914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbbc06a770 0x7ffbbc11cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.608+0000 7ffbc18ec700 1 -- 172.21.15.59:0/2028871914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb4009b30 con 0x7ffbbc136d80 2023-09-30T22:30:25.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.608+0000 7ffbc08ea700 1 --2- 172.21.15.59:0/2028871914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbbc06b250 0x7ffbbc11d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:25.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.608+0000 7ffbc18ec700 1 --2- 172.21.15.59:0/2028871914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbbc136d80 0x7ffbbc1c5f70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc09ee70 tx=0x7ffbb4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:25.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.608+0000 7ffbb1ffb700 1 -- 172.21.15.59:0/2028871914 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40048f0 con 0x7ffbbc136d80 2023-09-30T22:30:25.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.608+0000 7ffbb1ffb700 1 -- 172.21.15.59:0/2028871914 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb40092e0 con 0x7ffbbc136d80 2023-09-30T22:30:25.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.608+0000 7ffbc334f700 1 -- 172.21.15.59:0/2028871914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbbc11fab0 con 0x7ffbbc136d80 2023-09-30T22:30:25.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.608+0000 7ffbb1ffb700 1 -- 172.21.15.59:0/2028871914 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb401c680 con 0x7ffbbc136d80 2023-09-30T22:30:25.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.608+0000 7ffbc334f700 1 -- 172.21.15.59:0/2028871914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbbc120050 con 0x7ffbbc136d80 2023-09-30T22:30:25.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.610+0000 7ffbc334f700 1 -- 172.21.15.59:0/2028871914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbbc074ea0 con 0x7ffbbc136d80 2023-09-30T22:30:25.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.610+0000 7ffbb1ffb700 1 -- 172.21.15.59:0/2028871914 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffbb401c7e0 con 0x7ffbbc136d80 2023-09-30T22:30:25.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.610+0000 7ffbb1ffb700 1 -- 172.21.15.59:0/2028871914 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffbb40412a0 con 0x7ffbbc136d80 2023-09-30T22:30:25.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.615+0000 7ffbb1ffb700 1 -- 172.21.15.59:0/2028871914 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffbb402d940 con 0x7ffbbc136d80 2023-09-30T22:30:25.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.643+0000 7f4093225700 1 Processor -- start 2023-09-30T22:30:25.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.643+0000 7f4093225700 1 -- start start 2023-09-30T22:30:25.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.643+0000 7f4093225700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f408c09d6f0 0x7f408c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.643+0000 7f4093225700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f408c09e000 0x7f408c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f4093225700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c09e410 0x7f408c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f4093225700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c06b460 con 0x7f408c09d6f0 2023-09-30T22:30:25.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f4093225700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c09b120 con 0x7f408c09e410 2023-09-30T22:30:25.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f4093225700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f408c09a7e0 con 0x7f408c09e000 2023-09-30T22:30:25.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f4090fc1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f408c09d6f0 0x7f408c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f4090fc1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f408c09d6f0 0x7f408c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50740/0 (socket says 172.21.15.59:50740) 2023-09-30T22:30:25.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f408bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f408c09e000 0x7f408c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f4090fc1700 1 -- 172.21.15.59:0/4242197451 learned_addr learned my addr 172.21.15.59:0/4242197451 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:25.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f40917c2700 1 --2- 172.21.15.59:0/4242197451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c09e410 0x7f408c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f408bfff700 1 -- 172.21.15.59:0/4242197451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c09e410 msgr2=0x7f408c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:25.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f408bfff700 1 --2- 172.21.15.59:0/4242197451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c09e410 0x7f408c133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f408bfff700 1 -- 172.21.15.59:0/4242197451 >> v2:172.21.15.59:3300/0 conn(0x7f408c09d6f0 msgr2=0x7f408c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:25.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f408bfff700 1 --2- 172.21.15.59:0/4242197451 >> v2:172.21.15.59:3300/0 conn(0x7f408c09d6f0 0x7f408c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f408bfff700 1 -- 172.21.15.59:0/4242197451 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c09a500 con 0x7f408c09e000 2023-09-30T22:30:25.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f4090fc1700 1 --2- 172.21.15.59:0/4242197451 >> v2:172.21.15.59:3300/0 conn(0x7f408c09d6f0 0x7f408c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:25.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.644+0000 7f408bfff700 1 --2- 172.21.15.59:0/4242197451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f408c09e000 0x7f408c1339f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4078009870 tx=0x7f4078009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba57ccc24b2b840e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:25.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.645+0000 7f408b7fe700 1 -- 172.21.15.59:0/4242197451 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4078011830 con 0x7f408c09e000 2023-09-30T22:30:25.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.645+0000 7f408b7fe700 1 -- 172.21.15.59:0/4242197451 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4078011990 con 0x7f408c09e000 2023-09-30T22:30:25.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.645+0000 7f408b7fe700 1 -- 172.21.15.59:0/4242197451 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4078011d20 con 0x7f408c09e000 2023-09-30T22:30:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.645+0000 7f4093225700 1 -- 172.21.15.59:0/4242197451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f408c09e000 msgr2=0x7f408c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.645+0000 7f4093225700 1 --2- 172.21.15.59:0/4242197451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f408c09e000 0x7f408c1339f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4078009870 tx=0x7f4078009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.645+0000 7f4093225700 1 -- 172.21.15.59:0/4242197451 shutdown_connections 2023-09-30T22:30:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.645+0000 7f4093225700 1 --2- 172.21.15.59:0/4242197451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c09e410 0x7f408c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.645+0000 7f4093225700 1 --2- 172.21.15.59:0/4242197451 >> v2:172.21.15.59:3300/0 conn(0x7f408c09d6f0 0x7f408c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.645+0000 7f4093225700 1 --2- 172.21.15.59:0/4242197451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f408c09e000 0x7f408c1339f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.645+0000 7f4093225700 1 -- 172.21.15.59:0/4242197451 >> 172.21.15.59:0/4242197451 conn(0x7f408c066f50 msgr2=0x7f408c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.645+0000 7f4093225700 1 -- 172.21.15.59:0/4242197451 shutdown_connections 2023-09-30T22:30:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.645+0000 7f4093225700 1 -- 172.21.15.59:0/4242197451 wait complete. 2023-09-30T22:30:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.646+0000 7f4093225700 1 Processor -- start 2023-09-30T22:30:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.647+0000 7f4093225700 1 -- start start 2023-09-30T22:30:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.647+0000 7f4093225700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f408c09d6f0 0x7f408c1a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.647+0000 7f4093225700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f408c09e000 0x7f408c1a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.647+0000 7f4093225700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c09e410 0x7f408c1a6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.647+0000 7f4093225700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c1a9a40 con 0x7f408c09d6f0 2023-09-30T22:30:25.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.647+0000 7f4093225700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c1aa280 con 0x7f408c09e410 2023-09-30T22:30:25.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.647+0000 7f4093225700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f408c1a79b0 con 0x7f408c09e000 2023-09-30T22:30:25.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.647+0000 7f4090fc1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f408c09d6f0 0x7f408c1a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.647+0000 7f408bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f408c09e000 0x7f408c1a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.647+0000 7f4090fc1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f408c09d6f0 0x7f408c1a5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50752/0 (socket says 172.21.15.59:50752) 2023-09-30T22:30:25.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.647+0000 7f4090fc1700 1 -- 172.21.15.59:0/952889721 learned_addr learned my addr 172.21.15.59:0/952889721 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:25.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.647+0000 7f40917c2700 1 --2- 172.21.15.59:0/952889721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c09e410 0x7f408c1a6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.648+0000 7f4090fc1700 1 -- 172.21.15.59:0/952889721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f408c09e000 msgr2=0x7f408c1a62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.648+0000 7f4090fc1700 1 --2- 172.21.15.59:0/952889721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f408c09e000 0x7f408c1a62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.648+0000 7f4090fc1700 1 -- 172.21.15.59:0/952889721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c09e410 msgr2=0x7f408c1a6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.648+0000 7f4090fc1700 1 --2- 172.21.15.59:0/952889721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c09e410 0x7f408c1a6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.648+0000 7f4090fc1700 1 -- 172.21.15.59:0/952889721 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4080009550 con 0x7f408c09d6f0 2023-09-30T22:30:25.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.648+0000 7f408bfff700 1 --2- 172.21.15.59:0/952889721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f408c09e000 0x7f408c1a62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:25.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.648+0000 7f4090fc1700 1 --2- 172.21.15.59:0/952889721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f408c09d6f0 0x7f408c1a5da0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f408000ec10 tx=0x7f408000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:25.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.648+0000 7f40897fa700 1 -- 172.21.15.59:0/952889721 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408000c7f0 con 0x7f408c09d6f0 2023-09-30T22:30:25.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.648+0000 7f40897fa700 1 -- 172.21.15.59:0/952889721 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408000c950 con 0x7f408c09d6f0 2023-09-30T22:30:25.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.648+0000 7f4093225700 1 -- 172.21.15.59:0/952889721 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40780094a0 con 0x7f408c09d6f0 2023-09-30T22:30:25.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.648+0000 7f40897fa700 1 -- 172.21.15.59:0/952889721 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408000cce0 con 0x7f408c09d6f0 2023-09-30T22:30:25.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.648+0000 7f4093225700 1 -- 172.21.15.59:0/952889721 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408c09c710 con 0x7f408c09d6f0 2023-09-30T22:30:25.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.649+0000 7f40897fa700 1 -- 172.21.15.59:0/952889721 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4080013470 con 0x7f408c09d6f0 2023-09-30T22:30:25.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.649+0000 7f40897fa700 1 -- 172.21.15.59:0/952889721 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f408003fc00 con 0x7f408c09d6f0 2023-09-30T22:30:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.650+0000 7f4093225700 1 -- 172.21.15.59:0/952889721 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408c074ea0 con 0x7f408c09d6f0 2023-09-30T22:30:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.655+0000 7f40897fa700 1 -- 172.21.15.59:0/952889721 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4080013720 con 0x7f408c09d6f0 2023-09-30T22:30:25.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.694+0000 7fe2f595c700 1 Processor -- start 2023-09-30T22:30:25.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.694+0000 7fe2f595c700 1 -- start start 2023-09-30T22:30:25.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.694+0000 7fe2f595c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2f009d6f0 0x7fe2f009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.694+0000 7fe2f595c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2f009e000 0x7fe2f01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.694+0000 7fe2f595c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2f009e410 0x7fe2f0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.694+0000 7fe2f595c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f006b460 con 0x7fe2f009e410 2023-09-30T22:30:25.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.695+0000 7fe2f595c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f009b120 con 0x7fe2f009e000 2023-09-30T22:30:25.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.695+0000 7fe2f595c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f009a7e0 con 0x7fe2f009d6f0 2023-09-30T22:30:25.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.695+0000 7fe2ef7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2f009e410 0x7fe2f0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.695+0000 7fe2eeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2f009d6f0 0x7fe2f009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.695+0000 7fe2ee7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2f009e000 0x7fe2f01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.695+0000 7fe2ef7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2f009e410 0x7fe2f0133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50754/0 (socket says 172.21.15.59:50754) 2023-09-30T22:30:25.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.695+0000 7fe2eeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2f009d6f0 0x7fe2f009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39996/0 (socket says 172.21.15.59:39996) 2023-09-30T22:30:25.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.695+0000 7fe2ef7fe700 1 -- 172.21.15.59:0/1732278502 learned_addr learned my addr 172.21.15.59:0/1732278502 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.695+0000 7fe2eeffd700 1 -- 172.21.15.59:0/1732278502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2f009e000 msgr2=0x7fe2f01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.695+0000 7fe2eeffd700 1 --2- 172.21.15.59:0/1732278502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2f009e000 0x7fe2f01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.695+0000 7fe2eeffd700 1 -- 172.21.15.59:0/1732278502 >> v2:172.21.15.59:3300/0 conn(0x7fe2f009e410 msgr2=0x7fe2f0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.695+0000 7fe2eeffd700 1 --2- 172.21.15.59:0/1732278502 >> v2:172.21.15.59:3300/0 conn(0x7fe2f009e410 0x7fe2f0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.695+0000 7fe2eeffd700 1 -- 172.21.15.59:0/1732278502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f009a500 con 0x7fe2f009d6f0 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.695+0000 7fe2ef7fe700 1 --2- 172.21.15.59:0/1732278502 >> v2:172.21.15.59:3300/0 conn(0x7fe2f009e410 0x7fe2f0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.695+0000 7fe2eeffd700 1 --2- 172.21.15.59:0/1732278502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2f009d6f0 0x7fe2f009dac0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0009870 tx=0x7fe2e0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a50e3c49fefa01e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.696+0000 7fe2edffb700 1 -- 172.21.15.59:0/1732278502 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0011830 con 0x7fe2f009d6f0 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.696+0000 7fe2edffb700 1 -- 172.21.15.59:0/1732278502 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e0011990 con 0x7fe2f009d6f0 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.696+0000 7fe2edffb700 1 -- 172.21.15.59:0/1732278502 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0011d20 con 0x7fe2f009d6f0 2023-09-30T22:30:25.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.696+0000 7fe2f595c700 1 -- 172.21.15.59:0/1732278502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2f009d6f0 msgr2=0x7fe2f009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.696+0000 7fe2f595c700 1 --2- 172.21.15.59:0/1732278502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2f009d6f0 0x7fe2f009dac0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0009870 tx=0x7fe2e0009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.696+0000 7fe2f595c700 1 -- 172.21.15.59:0/1732278502 shutdown_connections 2023-09-30T22:30:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.696+0000 7fe2f595c700 1 --2- 172.21.15.59:0/1732278502 >> v2:172.21.15.59:3300/0 conn(0x7fe2f009e410 0x7fe2f0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.696+0000 7fe2f595c700 1 --2- 172.21.15.59:0/1732278502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2f009d6f0 0x7fe2f009dac0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.696+0000 7fe2f595c700 1 --2- 172.21.15.59:0/1732278502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2f009e000 0x7fe2f01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.696+0000 7fe2f595c700 1 -- 172.21.15.59:0/1732278502 >> 172.21.15.59:0/1732278502 conn(0x7fe2f0066f50 msgr2=0x7fe2f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.696+0000 7fe2f595c700 1 -- 172.21.15.59:0/1732278502 shutdown_connections 2023-09-30T22:30:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.696+0000 7fe2f595c700 1 -- 172.21.15.59:0/1732278502 wait complete. 2023-09-30T22:30:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.698+0000 7fe2f595c700 1 Processor -- start 2023-09-30T22:30:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.698+0000 7fe2f595c700 1 -- start start 2023-09-30T22:30:25.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2f595c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f009d6f0 0x7fe2f01a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2f595c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2f009e000 0x7fe2f01a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2f595c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2f009e410 0x7fe2f01a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2f595c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f01a8600 con 0x7fe2f009d6f0 2023-09-30T22:30:25.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2f595c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00a31a0 con 0x7fe2f009e000 2023-09-30T22:30:25.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2f595c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f01a6ae0 con 0x7fe2f009e410 2023-09-30T22:30:25.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2eeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f009d6f0 0x7fe2f01a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2ee7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2f009e000 0x7fe2f01a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2eeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f009d6f0 0x7fe2f01a4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50762/0 (socket says 172.21.15.59:50762) 2023-09-30T22:30:25.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2eeffd700 1 -- 172.21.15.59:0/2413833624 learned_addr learned my addr 172.21.15.59:0/2413833624 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:25.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2ef7fe700 1 --2- 172.21.15.59:0/2413833624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2f009e410 0x7fe2f01a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2ee7fc700 1 -- 172.21.15.59:0/2413833624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2f009e410 msgr2=0x7fe2f01a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2ee7fc700 1 --2- 172.21.15.59:0/2413833624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2f009e410 0x7fe2f01a5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2ee7fc700 1 -- 172.21.15.59:0/2413833624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f009d6f0 msgr2=0x7fe2f01a4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2ee7fc700 1 --2- 172.21.15.59:0/2413833624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f009d6f0 0x7fe2f01a4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2ee7fc700 1 -- 172.21.15.59:0/2413833624 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e8009b30 con 0x7fe2f009e000 2023-09-30T22:30:25.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.699+0000 7fe2eeffd700 1 --2- 172.21.15.59:0/2413833624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f009d6f0 0x7fe2f01a4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:25.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.700+0000 7fe2ee7fc700 1 --2- 172.21.15.59:0/2413833624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2f009e000 0x7fe2f01a5410 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400e900 tx=0x7fe2e400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:25.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.700+0000 7fe2d7fff700 1 -- 172.21.15.59:0/2413833624 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4013680 con 0x7fe2f009e000 2023-09-30T22:30:25.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.700+0000 7fe2d7fff700 1 -- 172.21.15.59:0/2413833624 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e40137e0 con 0x7fe2f009e000 2023-09-30T22:30:25.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.700+0000 7fe2d7fff700 1 -- 172.21.15.59:0/2413833624 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4013b50 con 0x7fe2f009e000 2023-09-30T22:30:25.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.700+0000 7fe2f595c700 1 -- 172.21.15.59:0/2413833624 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e00094a0 con 0x7fe2f009e000 2023-09-30T22:30:25.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.700+0000 7fe2f595c700 1 -- 172.21.15.59:0/2413833624 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f01a7c20 con 0x7fe2f009e000 2023-09-30T22:30:25.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.701+0000 7fe2d7fff700 1 -- 172.21.15.59:0/2413833624 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2e4013cb0 con 0x7fe2f009e000 2023-09-30T22:30:25.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.701+0000 7fe2d7fff700 1 -- 172.21.15.59:0/2413833624 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe2e403f9d0 con 0x7fe2f009e000 2023-09-30T22:30:25.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.701+0000 7fe2f595c700 1 -- 172.21.15.59:0/2413833624 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f0074ea0 con 0x7fe2f009e000 2023-09-30T22:30:25.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.710+0000 7fe2d7fff700 1 -- 172.21.15.59:0/2413833624 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2e4017070 con 0x7fe2f009e000 2023-09-30T22:30:25.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.833+0000 7ffbc334f700 1 -- 172.21.15.59:0/2028871914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffbbc11fc40 con 0x7ffbbc136d80 2023-09-30T22:30:25.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.834+0000 7ffbb1ffb700 1 -- 172.21.15.59:0/2028871914 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffbb402d350 con 0x7ffbbc136d80 2023-09-30T22:30:25.834 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:25.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.837+0000 7ffbc334f700 1 -- 172.21.15.59:0/2028871914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbbc136d80 msgr2=0x7ffbbc1c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.837+0000 7ffbc334f700 1 --2- 172.21.15.59:0/2028871914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbbc136d80 0x7ffbbc1c5f70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc09ee70 tx=0x7ffbb4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.837+0000 7ffbc334f700 1 -- 172.21.15.59:0/2028871914 shutdown_connections 2023-09-30T22:30:25.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.837+0000 7ffbc334f700 1 --2- 172.21.15.59:0/2028871914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbbc136d80 0x7ffbbc1c5f70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.837+0000 7ffbc334f700 1 --2- 172.21.15.59:0/2028871914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbbc06a770 0x7ffbbc11cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.837+0000 7ffbc334f700 1 --2- 172.21.15.59:0/2028871914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbbc06b250 0x7ffbbc11d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.837+0000 7ffbc334f700 1 -- 172.21.15.59:0/2028871914 >> 172.21.15.59:0/2028871914 conn(0x7ffbbc066f50 msgr2=0x7ffbbc135d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:25.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.837+0000 7ffbc334f700 1 -- 172.21.15.59:0/2028871914 shutdown_connections 2023-09-30T22:30:25.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.837+0000 7ffbc334f700 1 -- 172.21.15.59:0/2028871914 wait complete. 2023-09-30T22:30:25.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:25.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.878+0000 7f4093225700 1 -- 172.21.15.59:0/952889721 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f408c1a9110 con 0x7f408c09d6f0 2023-09-30T22:30:25.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.879+0000 7f40897fa700 1 -- 172.21.15.59:0/952889721 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4080011b40 con 0x7f408c09d6f0 2023-09-30T22:30:25.879 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.881+0000 7f4093225700 1 -- 172.21.15.59:0/952889721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f408c09d6f0 msgr2=0x7f408c1a5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.881+0000 7f4093225700 1 --2- 172.21.15.59:0/952889721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f408c09d6f0 0x7f408c1a5da0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f408000ec10 tx=0x7f408000ef20 comp rx=0 tx=0).stop 2023-09-30T22:30:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.881+0000 7f4093225700 1 -- 172.21.15.59:0/952889721 shutdown_connections 2023-09-30T22:30:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.881+0000 7f4093225700 1 --2- 172.21.15.59:0/952889721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c09e410 0x7f408c1a6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.881+0000 7f4093225700 1 --2- 172.21.15.59:0/952889721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f408c09d6f0 0x7f408c1a5da0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.881+0000 7f4093225700 1 --2- 172.21.15.59:0/952889721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f408c09e000 0x7f408c1a62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.881+0000 7f4093225700 1 -- 172.21.15.59:0/952889721 >> 172.21.15.59:0/952889721 conn(0x7f408c066f50 msgr2=0x7f408c1bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:25.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.881+0000 7f4093225700 1 -- 172.21.15.59:0/952889721 shutdown_connections 2023-09-30T22:30:25.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.881+0000 7f4093225700 1 -- 172.21.15.59:0/952889721 wait complete. 2023-09-30T22:30:25.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:25.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.926+0000 7fe2f595c700 1 -- 172.21.15.59:0/2413833624 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe2f006c360 con 0x7fe2f009e000 2023-09-30T22:30:25.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.926+0000 7fe2d7fff700 1 -- 172.21.15.59:0/2413833624 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2e402a090 con 0x7fe2f009e000 2023-09-30T22:30:25.926 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:25.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.928+0000 7fe2f595c700 1 -- 172.21.15.59:0/2413833624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2f009e000 msgr2=0x7fe2f01a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.928+0000 7fe2f595c700 1 --2- 172.21.15.59:0/2413833624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2f009e000 0x7fe2f01a5410 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400e900 tx=0x7fe2e400ec10 comp rx=0 tx=0).stop 2023-09-30T22:30:25.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.928+0000 7fe2f595c700 1 -- 172.21.15.59:0/2413833624 shutdown_connections 2023-09-30T22:30:25.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.928+0000 7fe2f595c700 1 --2- 172.21.15.59:0/2413833624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2f009e410 0x7fe2f01a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.928+0000 7fe2f595c700 1 --2- 172.21.15.59:0/2413833624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f009d6f0 0x7fe2f01a4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.928+0000 7fe2f595c700 1 --2- 172.21.15.59:0/2413833624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2f009e000 0x7fe2f01a5410 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.928+0000 7fe2f595c700 1 -- 172.21.15.59:0/2413833624 >> 172.21.15.59:0/2413833624 conn(0x7fe2f0066f50 msgr2=0x7fe2f01b9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:25.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.929+0000 7fe2f595c700 1 -- 172.21.15.59:0/2413833624 shutdown_connections 2023-09-30T22:30:25.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:25.929+0000 7fe2f595c700 1 -- 172.21.15.59:0/2413833624 wait complete. 2023-09-30T22:30:25.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:26.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:26.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.444+0000 7f1151711700 1 Processor -- start 2023-09-30T22:30:26.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.444+0000 7f1151711700 1 -- start start 2023-09-30T22:30:26.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f1151711700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c0a09c0 0x7f114c0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f1151711700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f114c0a12d0 0x7f114c134030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f1151711700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114c09ea10 con 0x7f114c09d5c0 2023-09-30T22:30:26.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f1151711700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f114c09e210 con 0x7f114c0a12d0 2023-09-30T22:30:26.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f1151711700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f114c0a26f0 con 0x7f114c0a09c0 2023-09-30T22:30:26.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f114affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c0a09c0 0x7f114c0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f114b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f114c0a12d0 0x7f114c134030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f114affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c0a09c0 0x7f114c0a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40016/0 (socket says 172.21.15.59:40016) 2023-09-30T22:30:26.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f114b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f114c0a12d0 0x7f114c134030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50770/0 (socket says 172.21.15.59:50770) 2023-09-30T22:30:26.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f114affd700 1 -- 172.21.15.59:0/654226002 learned_addr learned my addr 172.21.15.59:0/654226002 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:26.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f114affd700 1 -- 172.21.15.59:0/654226002 >> v2:172.21.15.59:3300/0 conn(0x7f114c0a12d0 msgr2=0x7f114c134030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:26.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f114affd700 1 --2- 172.21.15.59:0/654226002 >> v2:172.21.15.59:3300/0 conn(0x7f114c0a12d0 0x7f114c134030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f114affd700 1 -- 172.21.15.59:0/654226002 >> v1:172.21.15.59:6789/0 conn(0x7f114c09d5c0 legacy=0x7f114c133920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f114affd700 1 -- 172.21.15.59:0/654226002 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c09db70 con 0x7f114c0a09c0 2023-09-30T22:30:26.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f114b7fe700 1 --2- 172.21.15.59:0/654226002 >> v2:172.21.15.59:3300/0 conn(0x7f114c0a12d0 0x7f114c134030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:26.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.445+0000 7f114affd700 1 --2- 172.21.15.59:0/654226002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c0a09c0 0x7f114c0a0d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f11340098f0 tx=0x7f1134009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bddd9604c5d4bc64 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:26.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.446+0000 7f1149ffb700 1 -- 172.21.15.59:0/654226002 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134011830 con 0x7f114c0a09c0 2023-09-30T22:30:26.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.446+0000 7f1149ffb700 1 -- 172.21.15.59:0/654226002 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1134011990 con 0x7f114c0a09c0 2023-09-30T22:30:26.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.446+0000 7f1149ffb700 1 -- 172.21.15.59:0/654226002 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134011d20 con 0x7f114c0a09c0 2023-09-30T22:30:26.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.446+0000 7f1151711700 1 -- 172.21.15.59:0/654226002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c0a09c0 msgr2=0x7f114c0a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.446+0000 7f1151711700 1 --2- 172.21.15.59:0/654226002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c0a09c0 0x7f114c0a0d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f11340098f0 tx=0x7f1134009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:26.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.446+0000 7f1151711700 1 -- 172.21.15.59:0/654226002 shutdown_connections 2023-09-30T22:30:26.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.446+0000 7f1151711700 1 --2- 172.21.15.59:0/654226002 >> v2:172.21.15.59:3300/0 conn(0x7f114c0a12d0 0x7f114c134030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.446+0000 7f1151711700 1 --2- 172.21.15.59:0/654226002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c0a09c0 0x7f114c0a0d90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.446+0000 7f1151711700 1 -- 172.21.15.59:0/654226002 >> 172.21.15.59:0/654226002 conn(0x7f114c0a2fe0 msgr2=0x7f114c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:26.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.446+0000 7f1151711700 1 -- 172.21.15.59:0/654226002 shutdown_connections 2023-09-30T22:30:26.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.446+0000 7f1151711700 1 -- 172.21.15.59:0/654226002 wait complete. 2023-09-30T22:30:26.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.447+0000 7f1151711700 1 Processor -- start 2023-09-30T22:30:26.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f1151711700 1 -- start start 2023-09-30T22:30:26.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f1151711700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c09d5c0 0x7f114c122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f1151711700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c0a09c0 0x7f114c122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f1151711700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c0a12d0 0x7f114c122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f1151711700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c125b60 con 0x7f114c0a12d0 2023-09-30T22:30:26.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f1151711700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114c125930 con 0x7f114c09d5c0 2023-09-30T22:30:26.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f1151711700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f114c124dc0 con 0x7f114c0a09c0 2023-09-30T22:30:26.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f114affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c09d5c0 0x7f114c122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f114b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c0a12d0 0x7f114c122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f114a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c0a09c0 0x7f114c122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f114affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c09d5c0 0x7f114c122320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42646/0 (socket says 172.21.15.59:42646) 2023-09-30T22:30:26.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f114affd700 1 -- 172.21.15.59:0/1016887695 learned_addr learned my addr 172.21.15.59:0/1016887695 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:26.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f114affd700 1 -- 172.21.15.59:0/1016887695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c0a09c0 msgr2=0x7f114c122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f114affd700 1 --2- 172.21.15.59:0/1016887695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c0a09c0 0x7f114c122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f114affd700 1 -- 172.21.15.59:0/1016887695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c0a12d0 msgr2=0x7f114c122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f114affd700 1 --2- 172.21.15.59:0/1016887695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c0a12d0 0x7f114c122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f114affd700 1 -- 172.21.15.59:0/1016887695 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1144009a70 con 0x7f114c09d5c0 2023-09-30T22:30:26.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f114b7fe700 1 --2- 172.21.15.59:0/1016887695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c0a12d0 0x7f114c122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:26.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.448+0000 7f114a7fc700 1 --2- 172.21.15.59:0/1016887695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c0a09c0 0x7f114c122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:26.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.449+0000 7f114affd700 1 --2- 172.21.15.59:0/1016887695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c09d5c0 0x7f114c122320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f114c0a2830 tx=0x7f1134004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:26.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.449+0000 7f11437fe700 1 -- 172.21.15.59:0/1016887695 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11340043c0 con 0x7f114c09d5c0 2023-09-30T22:30:26.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.449+0000 7f11437fe700 1 -- 172.21.15.59:0/1016887695 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113401f070 con 0x7f114c09d5c0 2023-09-30T22:30:26.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.449+0000 7f11437fe700 1 -- 172.21.15.59:0/1016887695 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11340036a0 con 0x7f114c09d5c0 2023-09-30T22:30:26.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.449+0000 7f1151711700 1 -- 172.21.15.59:0/1016887695 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1134009550 con 0x7f114c09d5c0 2023-09-30T22:30:26.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.449+0000 7f1151711700 1 -- 172.21.15.59:0/1016887695 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114c09cd10 con 0x7f114c09d5c0 2023-09-30T22:30:26.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.450+0000 7f11437fe700 1 -- 172.21.15.59:0/1016887695 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1134021030 con 0x7f114c09d5c0 2023-09-30T22:30:26.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.450+0000 7f11437fe700 1 -- 172.21.15.59:0/1016887695 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1134040920 con 0x7f114c09d5c0 2023-09-30T22:30:26.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.450+0000 7f1151711700 1 -- 172.21.15.59:0/1016887695 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114c125210 con 0x7f114c09d5c0 2023-09-30T22:30:26.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.455+0000 7f11437fe700 1 -- 172.21.15.59:0/1016887695 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1134015080 con 0x7f114c09d5c0 2023-09-30T22:30:26.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.661+0000 7f1151711700 1 -- 172.21.15.59:0/1016887695 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f114c11f670 con 0x7f114c09d5c0 2023-09-30T22:30:26.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.661+0000 7f11437fe700 1 -- 172.21.15.59:0/1016887695 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11340199a0 con 0x7f114c09d5c0 2023-09-30T22:30:26.662 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:26.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.663+0000 7f1151711700 1 -- 172.21.15.59:0/1016887695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c09d5c0 msgr2=0x7f114c122320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.663+0000 7f1151711700 1 --2- 172.21.15.59:0/1016887695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c09d5c0 0x7f114c122320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f114c0a2830 tx=0x7f1134004750 comp rx=0 tx=0).stop 2023-09-30T22:30:26.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.663+0000 7f1151711700 1 -- 172.21.15.59:0/1016887695 shutdown_connections 2023-09-30T22:30:26.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.663+0000 7f1151711700 1 --2- 172.21.15.59:0/1016887695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f114c0a12d0 0x7f114c122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.663+0000 7f1151711700 1 --2- 172.21.15.59:0/1016887695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f114c09d5c0 0x7f114c122320 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.663+0000 7f1151711700 1 --2- 172.21.15.59:0/1016887695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f114c0a09c0 0x7f114c122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.664+0000 7f1151711700 1 -- 172.21.15.59:0/1016887695 >> 172.21.15.59:0/1016887695 conn(0x7f114c0a2fe0 msgr2=0x7f114c11c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:26.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.664+0000 7f1151711700 1 -- 172.21.15.59:0/1016887695 shutdown_connections 2023-09-30T22:30:26.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:26.664+0000 7f1151711700 1 -- 172.21.15.59:0/1016887695 wait complete. 2023-09-30T22:30:26.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:26.853 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:26.895 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:26.943 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:27.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.003+0000 7fcd5ba1b700 1 Processor -- start 2023-09-30T22:30:27.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.003+0000 7fcd5ba1b700 1 -- start start 2023-09-30T22:30:27.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.003+0000 7fcd5ba1b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd5406a770 0x7fcd5406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.003+0000 7fcd5ba1b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd5406b080 0x7fcd54131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.003+0000 7fcd5ba1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd54131b40 0x7fcd54131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.003+0000 7fcd5ba1b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5409ece0 con 0x7fcd5406b080 2023-09-30T22:30:27.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.003+0000 7fcd5ba1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5409e760 con 0x7fcd54131b40 2023-09-30T22:30:27.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.003+0000 7fcd5ba1b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5409e040 con 0x7fcd5406a770 2023-09-30T22:30:27.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.004+0000 7fcd58fb6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd5406b080 0x7fcd54131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.004+0000 7fcd597b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd5406a770 0x7fcd5406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.004+0000 7fcd59fb8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd54131b40 0x7fcd54131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.004+0000 7fcd58fb6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd5406b080 0x7fcd54131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50792/0 (socket says 172.21.15.59:50792) 2023-09-30T22:30:27.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.004+0000 7fcd597b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd5406a770 0x7fcd5406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40020/0 (socket says 172.21.15.59:40020) 2023-09-30T22:30:27.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.004+0000 7fcd58fb6700 1 -- 172.21.15.59:0/1481889251 learned_addr learned my addr 172.21.15.59:0/1481889251 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:27.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.004+0000 7fcd58fb6700 1 -- 172.21.15.59:0/1481889251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd5406a770 msgr2=0x7fcd5406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:27.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.004+0000 7fcd58fb6700 1 --2- 172.21.15.59:0/1481889251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd5406a770 0x7fcd5406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.004+0000 7fcd58fb6700 1 -- 172.21.15.59:0/1481889251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd54131b40 msgr2=0x7fcd54131fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:27.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.004+0000 7fcd58fb6700 1 --2- 172.21.15.59:0/1481889251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd54131b40 0x7fcd54131fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.004+0000 7fcd58fb6700 1 -- 172.21.15.59:0/1481889251 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5409f630 con 0x7fcd5406b080 2023-09-30T22:30:27.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.004+0000 7fcd59fb8700 1 --2- 172.21.15.59:0/1481889251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd54131b40 0x7fcd54131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:27.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.004+0000 7fcd58fb6700 1 --2- 172.21.15.59:0/1481889251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd5406b080 0x7fcd54131600 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcd440098f0 tx=0x7fcd44009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94341e20827dba75 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:27.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.004+0000 7fcd4bfff700 1 -- 172.21.15.59:0/1481889251 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44011830 con 0x7fcd5406b080 2023-09-30T22:30:27.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.005+0000 7fcd4bfff700 1 -- 172.21.15.59:0/1481889251 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd44011990 con 0x7fcd5406b080 2023-09-30T22:30:27.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.005+0000 7fcd4bfff700 1 -- 172.21.15.59:0/1481889251 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44011d20 con 0x7fcd5406b080 2023-09-30T22:30:27.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.005+0000 7fcd5ba1b700 1 -- 172.21.15.59:0/1481889251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd5406b080 msgr2=0x7fcd54131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.005+0000 7fcd5ba1b700 1 --2- 172.21.15.59:0/1481889251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd5406b080 0x7fcd54131600 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcd440098f0 tx=0x7fcd44009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:27.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.005+0000 7fcd5ba1b700 1 -- 172.21.15.59:0/1481889251 shutdown_connections 2023-09-30T22:30:27.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.005+0000 7fcd5ba1b700 1 --2- 172.21.15.59:0/1481889251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd54131b40 0x7fcd54131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.005+0000 7fcd5ba1b700 1 --2- 172.21.15.59:0/1481889251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd5406a770 0x7fcd5406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.005+0000 7fcd5ba1b700 1 --2- 172.21.15.59:0/1481889251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd5406b080 0x7fcd54131600 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.005+0000 7fcd5ba1b700 1 -- 172.21.15.59:0/1481889251 >> 172.21.15.59:0/1481889251 conn(0x7fcd54066f50 msgr2=0x7fcd5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:27.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.005+0000 7fcd5ba1b700 1 -- 172.21.15.59:0/1481889251 shutdown_connections 2023-09-30T22:30:27.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.005+0000 7fcd5ba1b700 1 -- 172.21.15.59:0/1481889251 wait complete. 2023-09-30T22:30:27.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.006+0000 7fcd5ba1b700 1 Processor -- start 2023-09-30T22:30:27.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.006+0000 7fcd5ba1b700 1 -- start start 2023-09-30T22:30:27.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd5ba1b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd5406a770 0x7fcd5411b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd5ba1b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd5406b080 0x7fcd5411b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd5ba1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd54131b40 0x7fcd5411bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd5ba1b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5411e660 con 0x7fcd5406b080 2023-09-30T22:30:27.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd5ba1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5411c4c0 con 0x7fcd54131b40 2023-09-30T22:30:27.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd5ba1b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd54071e60 con 0x7fcd5406a770 2023-09-30T22:30:27.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd597b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd5406a770 0x7fcd5411b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd597b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd5406a770 0x7fcd5411b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40034/0 (socket says 172.21.15.59:40034) 2023-09-30T22:30:27.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd597b7700 1 -- 172.21.15.59:0/2315816841 learned_addr learned my addr 172.21.15.59:0/2315816841 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:27.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd58fb6700 1 --2- 172.21.15.59:0/2315816841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd5406b080 0x7fcd5411b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd59fb8700 1 --2- 172.21.15.59:0/2315816841 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd54131b40 0x7fcd5411bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd597b7700 1 -- 172.21.15.59:0/2315816841 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd54131b40 msgr2=0x7fcd5411bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd597b7700 1 --2- 172.21.15.59:0/2315816841 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd54131b40 0x7fcd5411bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd597b7700 1 -- 172.21.15.59:0/2315816841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd5406b080 msgr2=0x7fcd5411b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd597b7700 1 --2- 172.21.15.59:0/2315816841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd5406b080 0x7fcd5411b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd597b7700 1 -- 172.21.15.59:0/2315816841 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c008260 con 0x7fcd5406a770 2023-09-30T22:30:27.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd58fb6700 1 --2- 172.21.15.59:0/2315816841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd5406b080 0x7fcd5411b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:27.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.007+0000 7fcd59fb8700 1 --2- 172.21.15.59:0/2315816841 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd54131b40 0x7fcd5411bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:27.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.008+0000 7fcd597b7700 1 --2- 172.21.15.59:0/2315816841 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd5406a770 0x7fcd5411b0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcd50014390 tx=0x7fcd500146a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:27.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.008+0000 7fcd49ffb700 1 -- 172.21.15.59:0/2315816841 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd50016050 con 0x7fcd5406a770 2023-09-30T22:30:27.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.008+0000 7fcd49ffb700 1 -- 172.21.15.59:0/2315816841 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd50017040 con 0x7fcd5406a770 2023-09-30T22:30:27.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.008+0000 7fcd5ba1b700 1 -- 172.21.15.59:0/2315816841 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd44009550 con 0x7fcd5406a770 2023-09-30T22:30:27.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.008+0000 7fcd49ffb700 1 -- 172.21.15.59:0/2315816841 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500114d0 con 0x7fcd5406a770 2023-09-30T22:30:27.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.008+0000 7fcd5ba1b700 1 -- 172.21.15.59:0/2315816841 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5412e460 con 0x7fcd5406a770 2023-09-30T22:30:27.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.009+0000 7fcd49ffb700 1 -- 172.21.15.59:0/2315816841 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd5000f850 con 0x7fcd5406a770 2023-09-30T22:30:27.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.009+0000 7fcd5ba1b700 1 -- 172.21.15.59:0/2315816841 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd54074ea0 con 0x7fcd5406a770 2023-09-30T22:30:27.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.009+0000 7fcd49ffb700 1 -- 172.21.15.59:0/2315816841 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcd50047790 con 0x7fcd5406a770 2023-09-30T22:30:27.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.014+0000 7fcd49ffb700 1 -- 172.21.15.59:0/2315816841 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd50011630 con 0x7fcd5406a770 2023-09-30T22:30:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.041+0000 7f103a367700 1 Processor -- start 2023-09-30T22:30:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.041+0000 7f103a367700 1 -- start start 2023-09-30T22:30:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.042+0000 7f103a367700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f103409d6f0 0x7f103409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.042+0000 7f103a367700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103409e000 0x7f10341339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.042+0000 7f103a367700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103409b120 con 0x7f103409e410 2023-09-30T22:30:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.042+0000 7f103a367700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103406b460 con 0x7f103409d6f0 2023-09-30T22:30:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.042+0000 7f103a367700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103409a7e0 con 0x7f103409e000 2023-09-30T22:30:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.042+0000 7f10337fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103409e000 0x7f10341339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.042+0000 7f10337fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103409e000 0x7f10341339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42674/0 (socket says 172.21.15.59:42674) 2023-09-30T22:30:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.042+0000 7f10337fe700 1 -- 172.21.15.59:0/2076156965 learned_addr learned my addr 172.21.15.59:0/2076156965 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.042+0000 7f1033fff700 1 --2- 172.21.15.59:0/2076156965 >> v2:172.21.15.59:3300/0 conn(0x7f103409d6f0 0x7f103409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.042+0000 7f10337fe700 1 -- 172.21.15.59:0/2076156965 >> v2:172.21.15.59:3300/0 conn(0x7f103409d6f0 msgr2=0x7f103409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.042+0000 7f10337fe700 1 --2- 172.21.15.59:0/2076156965 >> v2:172.21.15.59:3300/0 conn(0x7f103409d6f0 0x7f103409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.042+0000 7f10337fe700 1 -- 172.21.15.59:0/2076156965 >> v1:172.21.15.59:6789/0 conn(0x7f103409e410 legacy=0x7f1034133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.042+0000 7f10337fe700 1 -- 172.21.15.59:0/2076156965 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103409a500 con 0x7f103409e000 2023-09-30T22:30:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.042+0000 7f10337fe700 1 --2- 172.21.15.59:0/2076156965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103409e000 0x7f10341339f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1028009920 tx=0x7f1028009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcf6860985dd0e63 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.043+0000 7f1032ffd700 1 -- 172.21.15.59:0/2076156965 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1028011830 con 0x7f103409e000 2023-09-30T22:30:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.043+0000 7f1032ffd700 1 -- 172.21.15.59:0/2076156965 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1028011990 con 0x7f103409e000 2023-09-30T22:30:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.043+0000 7f1032ffd700 1 -- 172.21.15.59:0/2076156965 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1028011d20 con 0x7f103409e000 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.043+0000 7f103a367700 1 -- 172.21.15.59:0/2076156965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103409e000 msgr2=0x7f10341339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.043+0000 7f103a367700 1 --2- 172.21.15.59:0/2076156965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103409e000 0x7f10341339f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1028009920 tx=0x7f1028009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.043+0000 7f103a367700 1 -- 172.21.15.59:0/2076156965 shutdown_connections 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.043+0000 7f103a367700 1 --2- 172.21.15.59:0/2076156965 >> v2:172.21.15.59:3300/0 conn(0x7f103409d6f0 0x7f103409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.043+0000 7f103a367700 1 --2- 172.21.15.59:0/2076156965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103409e000 0x7f10341339f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.043+0000 7f103a367700 1 -- 172.21.15.59:0/2076156965 >> 172.21.15.59:0/2076156965 conn(0x7f1034066f50 msgr2=0x7f103409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.044+0000 7f103a367700 1 -- 172.21.15.59:0/2076156965 shutdown_connections 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.044+0000 7f103a367700 1 -- 172.21.15.59:0/2076156965 wait complete. 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.045+0000 7f103a367700 1 Processor -- start 2023-09-30T22:30:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.045+0000 7f103a367700 1 -- start start 2023-09-30T22:30:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.045+0000 7f103a367700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f103409d6f0 0x7f10341a5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.045+0000 7f103a367700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103409e000 0x7f10341a6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.045+0000 7f103a367700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103409e410 0x7f10341a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.045+0000 7f103a367700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10341aa2c0 con 0x7f103409d6f0 2023-09-30T22:30:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.045+0000 7f103a367700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10341a7a90 con 0x7f103409e410 2023-09-30T22:30:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.045+0000 7f103a367700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10341a9620 con 0x7f103409e000 2023-09-30T22:30:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.045+0000 7f1033fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f103409d6f0 0x7f10341a5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.045+0000 7f1038904700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103409e410 0x7f10341a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.045+0000 7f1033fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f103409d6f0 0x7f10341a5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50818/0 (socket says 172.21.15.59:50818) 2023-09-30T22:30:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.045+0000 7f1033fff700 1 -- 172.21.15.59:0/2316666692 learned_addr learned my addr 172.21.15.59:0/2316666692 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.046+0000 7f10337fe700 1 --2- 172.21.15.59:0/2316666692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103409e000 0x7f10341a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.046+0000 7f1033fff700 1 -- 172.21.15.59:0/2316666692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103409e000 msgr2=0x7f10341a6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.046+0000 7f1033fff700 1 --2- 172.21.15.59:0/2316666692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103409e000 0x7f10341a6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.046+0000 7f1033fff700 1 -- 172.21.15.59:0/2316666692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103409e410 msgr2=0x7f10341a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.046+0000 7f1033fff700 1 --2- 172.21.15.59:0/2316666692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103409e410 0x7f10341a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.046+0000 7f1033fff700 1 -- 172.21.15.59:0/2316666692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1028009550 con 0x7f103409d6f0 2023-09-30T22:30:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.046+0000 7f1038904700 1 --2- 172.21.15.59:0/2316666692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103409e410 0x7f10341a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.046+0000 7f1033fff700 1 --2- 172.21.15.59:0/2316666692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f103409d6f0 0x7f10341a5ec0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f102400e9b0 tx=0x7f102400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.046+0000 7f1030ff9700 1 -- 172.21.15.59:0/2316666692 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102400ee50 con 0x7f103409d6f0 2023-09-30T22:30:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.046+0000 7f1030ff9700 1 -- 172.21.15.59:0/2316666692 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102400c850 con 0x7f103409d6f0 2023-09-30T22:30:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.046+0000 7f1030ff9700 1 -- 172.21.15.59:0/2316666692 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102400cbc0 con 0x7f103409d6f0 2023-09-30T22:30:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.046+0000 7f103a367700 1 -- 172.21.15.59:0/2316666692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10340a2020 con 0x7f103409d6f0 2023-09-30T22:30:27.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.047+0000 7f103a367700 1 -- 172.21.15.59:0/2316666692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103409c760 con 0x7f103409d6f0 2023-09-30T22:30:27.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.048+0000 7f1030ff9700 1 -- 172.21.15.59:0/2316666692 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f102400cd20 con 0x7f103409d6f0 2023-09-30T22:30:27.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.048+0000 7f103a367700 1 -- 172.21.15.59:0/2316666692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10341a9a20 con 0x7f103409d6f0 2023-09-30T22:30:27.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.048+0000 7f1030ff9700 1 -- 172.21.15.59:0/2316666692 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f102403fa80 con 0x7f103409d6f0 2023-09-30T22:30:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.053+0000 7f1030ff9700 1 -- 172.21.15.59:0/2316666692 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f102401ab50 con 0x7f103409d6f0 2023-09-30T22:30:27.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.087+0000 7f9eb3904700 1 Processor -- start 2023-09-30T22:30:27.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.087+0000 7f9eb3904700 1 -- start start 2023-09-30T22:30:27.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb3904700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eac0a0a30 0x7f9eac0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb3904700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9eac09d630 0x7f9eac0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb3904700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac0a2a70 con 0x7f9eac133930 2023-09-30T22:30:27.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb3904700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac0a01d0 con 0x7f9eac09d630 2023-09-30T22:30:27.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb3904700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac09e2b0 con 0x7f9eac0a0a30 2023-09-30T22:30:27.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb0e9f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9eac09d630 0x7f9eac0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb16a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eac0a0a30 0x7f9eac0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb0e9f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9eac09d630 0x7f9eac0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50828/0 (socket says 172.21.15.59:50828) 2023-09-30T22:30:27.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb1ea1700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9eac133930 0x7f9eac133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48420/0 (socket says 172.21.15.59:48420) 2023-09-30T22:30:27.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb16a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eac0a0a30 0x7f9eac0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42688/0 (socket says 172.21.15.59:42688) 2023-09-30T22:30:27.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb0e9f700 1 -- 172.21.15.59:0/3821068365 learned_addr learned my addr 172.21.15.59:0/3821068365 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:27.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb16a0700 1 -- 172.21.15.59:0/3821068365 >> v2:172.21.15.59:3300/0 conn(0x7f9eac09d630 msgr2=0x7f9eac0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:27.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb16a0700 1 --2- 172.21.15.59:0/3821068365 >> v2:172.21.15.59:3300/0 conn(0x7f9eac09d630 0x7f9eac0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb16a0700 1 -- 172.21.15.59:0/3821068365 >> v1:172.21.15.59:6789/0 conn(0x7f9eac133930 legacy=0x7f9eac133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb16a0700 1 -- 172.21.15.59:0/3821068365 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac09dc50 con 0x7f9eac0a0a30 2023-09-30T22:30:27.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb0e9f700 1 --2- 172.21.15.59:0/3821068365 >> v2:172.21.15.59:3300/0 conn(0x7f9eac09d630 0x7f9eac0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:27.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.088+0000 7f9eb16a0700 1 --2- 172.21.15.59:0/3821068365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eac0a0a30 0x7f9eac0a0e00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009840 tx=0x7f9ea8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=399dda81ee726dfa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:27.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.089+0000 7f9ea3fff700 1 -- 172.21.15.59:0/3821068365 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8011830 con 0x7f9eac0a0a30 2023-09-30T22:30:27.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.089+0000 7f9ea3fff700 1 -- 172.21.15.59:0/3821068365 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea8011990 con 0x7f9eac0a0a30 2023-09-30T22:30:27.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.089+0000 7f9ea3fff700 1 -- 172.21.15.59:0/3821068365 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8011d20 con 0x7f9eac0a0a30 2023-09-30T22:30:27.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.089+0000 7f9eb3904700 1 -- 172.21.15.59:0/3821068365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eac0a0a30 msgr2=0x7f9eac0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.089+0000 7f9eb3904700 1 --2- 172.21.15.59:0/3821068365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eac0a0a30 0x7f9eac0a0e00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009840 tx=0x7f9ea8009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:27.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.089+0000 7f9eb3904700 1 -- 172.21.15.59:0/3821068365 shutdown_connections 2023-09-30T22:30:27.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.089+0000 7f9eb3904700 1 --2- 172.21.15.59:0/3821068365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eac0a0a30 0x7f9eac0a0e00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.089+0000 7f9eb3904700 1 --2- 172.21.15.59:0/3821068365 >> v2:172.21.15.59:3300/0 conn(0x7f9eac09d630 0x7f9eac0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.089+0000 7f9eb3904700 1 -- 172.21.15.59:0/3821068365 >> 172.21.15.59:0/3821068365 conn(0x7f9eac0a3050 msgr2=0x7f9eac0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:27.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.090+0000 7f9eb3904700 1 -- 172.21.15.59:0/3821068365 shutdown_connections 2023-09-30T22:30:27.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.090+0000 7f9eb3904700 1 -- 172.21.15.59:0/3821068365 wait complete. 2023-09-30T22:30:27.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.091+0000 7f9eb3904700 1 Processor -- start 2023-09-30T22:30:27.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.091+0000 7f9eb3904700 1 -- start start 2023-09-30T22:30:27.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.091+0000 7f9eb3904700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eac09d630 0x7f9eac1c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.091+0000 7f9eb3904700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac0a0a30 0x7f9eac1c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.091+0000 7f9eb3904700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eac133930 0x7f9eac1c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.091+0000 7f9eb3904700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac120670 con 0x7f9eac0a0a30 2023-09-30T22:30:27.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.091+0000 7f9eb3904700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac121e60 con 0x7f9eac133930 2023-09-30T22:30:27.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.091+0000 7f9eb3904700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0a0410 con 0x7f9eac09d630 2023-09-30T22:30:27.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.091+0000 7f9eb0e9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac0a0a30 0x7f9eac1c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.091+0000 7f9eb0e9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac0a0a30 0x7f9eac1c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50838/0 (socket says 172.21.15.59:50838) 2023-09-30T22:30:27.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.091+0000 7f9eb16a0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eac09d630 0x7f9eac1c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.091+0000 7f9eb0e9f700 1 -- 172.21.15.59:0/2094631232 learned_addr learned my addr 172.21.15.59:0/2094631232 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:27.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.091+0000 7f9eb1ea1700 1 --2- 172.21.15.59:0/2094631232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eac133930 0x7f9eac1c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.092+0000 7f9eb16a0700 1 -- 172.21.15.59:0/2094631232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eac133930 msgr2=0x7f9eac1c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.092+0000 7f9eb16a0700 1 --2- 172.21.15.59:0/2094631232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eac133930 0x7f9eac1c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.092+0000 7f9eb16a0700 1 -- 172.21.15.59:0/2094631232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac0a0a30 msgr2=0x7f9eac1c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.092+0000 7f9eb16a0700 1 --2- 172.21.15.59:0/2094631232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac0a0a30 0x7f9eac1c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.092+0000 7f9eb16a0700 1 -- 172.21.15.59:0/2094631232 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c009550 con 0x7f9eac09d630 2023-09-30T22:30:27.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.092+0000 7f9eb0e9f700 1 --2- 172.21.15.59:0/2094631232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac0a0a30 0x7f9eac1c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:27.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.092+0000 7f9eb1ea1700 1 --2- 172.21.15.59:0/2094631232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eac133930 0x7f9eac1c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:27.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.092+0000 7f9eb16a0700 1 --2- 172.21.15.59:0/2094631232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eac09d630 0x7f9eac1c8170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8016000 tx=0x7f9ea8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:27.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.092+0000 7f9ea1ffb700 1 -- 172.21.15.59:0/2094631232 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8004400 con 0x7f9eac09d630 2023-09-30T22:30:27.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.092+0000 7f9ea1ffb700 1 -- 172.21.15.59:0/2094631232 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea801f070 con 0x7f9eac09d630 2023-09-30T22:30:27.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.092+0000 7f9eb3904700 1 -- 172.21.15.59:0/2094631232 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea80094a0 con 0x7f9eac09d630 2023-09-30T22:30:27.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.092+0000 7f9ea1ffb700 1 -- 172.21.15.59:0/2094631232 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80038e0 con 0x7f9eac09d630 2023-09-30T22:30:27.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.092+0000 7f9eb3904700 1 -- 172.21.15.59:0/2094631232 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac121160 con 0x7f9eac09d630 2023-09-30T22:30:27.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.093+0000 7f9eb3904700 1 -- 172.21.15.59:0/2094631232 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac0747f0 con 0x7f9eac09d630 2023-09-30T22:30:27.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.094+0000 7f9ea1ffb700 1 -- 172.21.15.59:0/2094631232 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ea8021030 con 0x7f9eac09d630 2023-09-30T22:30:27.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.094+0000 7f9ea1ffb700 1 -- 172.21.15.59:0/2094631232 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9ea8040f40 con 0x7f9eac09d630 2023-09-30T22:30:27.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.099+0000 7f9ea1ffb700 1 -- 172.21.15.59:0/2094631232 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ea8010970 con 0x7f9eac09d630 2023-09-30T22:30:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.241+0000 7fcd5ba1b700 1 -- 172.21.15.59:0/2315816841 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd5409a580 con 0x7fcd5406a770 2023-09-30T22:30:27.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.241+0000 7fcd49ffb700 1 -- 172.21.15.59:0/2315816841 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd50022b00 con 0x7fcd5406a770 2023-09-30T22:30:27.242 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:27.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.244+0000 7fcd5ba1b700 1 -- 172.21.15.59:0/2315816841 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd5406a770 msgr2=0x7fcd5411b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.244+0000 7fcd5ba1b700 1 --2- 172.21.15.59:0/2315816841 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd5406a770 0x7fcd5411b0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcd50014390 tx=0x7fcd500146a0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.244+0000 7fcd5ba1b700 1 -- 172.21.15.59:0/2315816841 shutdown_connections 2023-09-30T22:30:27.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.244+0000 7fcd5ba1b700 1 --2- 172.21.15.59:0/2315816841 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd5406a770 0x7fcd5411b0d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.244+0000 7fcd5ba1b700 1 --2- 172.21.15.59:0/2315816841 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd54131b40 0x7fcd5411bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.244+0000 7fcd5ba1b700 1 --2- 172.21.15.59:0/2315816841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd5406b080 0x7fcd5411b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.244+0000 7fcd5ba1b700 1 -- 172.21.15.59:0/2315816841 >> 172.21.15.59:0/2315816841 conn(0x7fcd54066f50 msgr2=0x7fcd540a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:27.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.244+0000 7fcd5ba1b700 1 -- 172.21.15.59:0/2315816841 shutdown_connections 2023-09-30T22:30:27.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.244+0000 7fcd5ba1b700 1 -- 172.21.15.59:0/2315816841 wait complete. 2023-09-30T22:30:27.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.261+0000 7f103a367700 1 -- 172.21.15.59:0/2316666692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1034074ea0 con 0x7f103409d6f0 2023-09-30T22:30:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.262+0000 7f1030ff9700 1 -- 172.21.15.59:0/2316666692 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1024017020 con 0x7f103409d6f0 2023-09-30T22:30:27.262 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.264+0000 7f103a367700 1 -- 172.21.15.59:0/2316666692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f103409d6f0 msgr2=0x7f10341a5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.264+0000 7f103a367700 1 --2- 172.21.15.59:0/2316666692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f103409d6f0 0x7f10341a5ec0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f102400e9b0 tx=0x7f102400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.264+0000 7f103a367700 1 -- 172.21.15.59:0/2316666692 shutdown_connections 2023-09-30T22:30:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.264+0000 7f103a367700 1 --2- 172.21.15.59:0/2316666692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103409e410 0x7f10341a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.264+0000 7f103a367700 1 --2- 172.21.15.59:0/2316666692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f103409d6f0 0x7f10341a5ec0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.264+0000 7f103a367700 1 --2- 172.21.15.59:0/2316666692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103409e000 0x7f10341a6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.264+0000 7f103a367700 1 -- 172.21.15.59:0/2316666692 >> 172.21.15.59:0/2316666692 conn(0x7f1034066f50 msgr2=0x7f10341bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.264+0000 7f103a367700 1 -- 172.21.15.59:0/2316666692 shutdown_connections 2023-09-30T22:30:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.264+0000 7f103a367700 1 -- 172.21.15.59:0/2316666692 wait complete. 2023-09-30T22:30:27.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:27.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.320+0000 7f9eb3904700 1 -- 172.21.15.59:0/2094631232 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9eac072980 con 0x7f9eac09d630 2023-09-30T22:30:27.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.320+0000 7f9ea1ffb700 1 -- 172.21.15.59:0/2094631232 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ea8015070 con 0x7f9eac09d630 2023-09-30T22:30:27.320 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.322+0000 7f9eb3904700 1 -- 172.21.15.59:0/2094631232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eac09d630 msgr2=0x7f9eac1c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.322+0000 7f9eb3904700 1 --2- 172.21.15.59:0/2094631232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eac09d630 0x7f9eac1c8170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8016000 tx=0x7f9ea8004750 comp rx=0 tx=0).stop 2023-09-30T22:30:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.322+0000 7f9eb3904700 1 -- 172.21.15.59:0/2094631232 shutdown_connections 2023-09-30T22:30:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.322+0000 7f9eb3904700 1 --2- 172.21.15.59:0/2094631232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eac09d630 0x7f9eac1c8170 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.322+0000 7f9eb3904700 1 --2- 172.21.15.59:0/2094631232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eac133930 0x7f9eac1c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.322+0000 7f9eb3904700 1 --2- 172.21.15.59:0/2094631232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac0a0a30 0x7f9eac1c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.322+0000 7f9eb3904700 1 -- 172.21.15.59:0/2094631232 >> 172.21.15.59:0/2094631232 conn(0x7f9eac0a3050 msgr2=0x7f9eac0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.322+0000 7f9eb3904700 1 -- 172.21.15.59:0/2094631232 shutdown_connections 2023-09-30T22:30:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.323+0000 7f9eb3904700 1 -- 172.21.15.59:0/2094631232 wait complete. 2023-09-30T22:30:27.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:27.679 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:27.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.824+0000 7f1d6fbd6700 1 Processor -- start 2023-09-30T22:30:27.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.824+0000 7f1d6fbd6700 1 -- start start 2023-09-30T22:30:27.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.824+0000 7f1d6fbd6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d681338c0 0x7f1d68133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.824+0000 7f1d6fbd6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d681341d0 0x7f1d6809de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6fbd6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d6809e390 0x7f1d6809e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6fbd6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d68070c80 con 0x7f1d6809e390 2023-09-30T22:30:27.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6fbd6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6806f720 con 0x7f1d681338c0 2023-09-30T22:30:27.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6fbd6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6806fce0 con 0x7f1d681341d0 2023-09-30T22:30:27.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6d171700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d681341d0 0x7f1d6809de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6e173700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d6809e390 0x7f1d6809e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6d972700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d681338c0 0x7f1d68133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6e173700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d6809e390 0x7f1d6809e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50844/0 (socket says 172.21.15.59:50844) 2023-09-30T22:30:27.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6e173700 1 -- 172.21.15.59:0/3390558752 learned_addr learned my addr 172.21.15.59:0/3390558752 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:27.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6d972700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d681338c0 0x7f1d68133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42698/0 (socket says 172.21.15.59:42698) 2023-09-30T22:30:27.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6d171700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d681341d0 0x7f1d6809de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40046/0 (socket says 172.21.15.59:40046) 2023-09-30T22:30:27.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6d972700 1 -- 172.21.15.59:0/3390558752 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d681341d0 msgr2=0x7f1d6809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:27.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6d972700 1 --2- 172.21.15.59:0/3390558752 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d681341d0 0x7f1d6809de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6d972700 1 -- 172.21.15.59:0/3390558752 >> v2:172.21.15.59:3300/0 conn(0x7f1d6809e390 msgr2=0x7f1d6809e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:27.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6d972700 1 --2- 172.21.15.59:0/3390558752 >> v2:172.21.15.59:3300/0 conn(0x7f1d6809e390 0x7f1d6809e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6d972700 1 -- 172.21.15.59:0/3390558752 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d681336a0 con 0x7f1d681338c0 2023-09-30T22:30:27.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6e173700 1 --2- 172.21.15.59:0/3390558752 >> v2:172.21.15.59:3300/0 conn(0x7f1d6809e390 0x7f1d6809e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:27.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6d171700 1 --2- 172.21.15.59:0/3390558752 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d681341d0 0x7f1d6809de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:27.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6d972700 1 --2- 172.21.15.59:0/3390558752 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d681338c0 0x7f1d68133c90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009840 tx=0x7f1d58009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fe5eb79bff6962c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:27.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6c970700 1 -- 172.21.15.59:0/3390558752 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58011830 con 0x7f1d681338c0 2023-09-30T22:30:27.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6c970700 1 -- 172.21.15.59:0/3390558752 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d58011990 con 0x7f1d681338c0 2023-09-30T22:30:27.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.825+0000 7f1d6c970700 1 -- 172.21.15.59:0/3390558752 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58011d20 con 0x7f1d681338c0 2023-09-30T22:30:27.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.826+0000 7f1d6fbd6700 1 -- 172.21.15.59:0/3390558752 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d681338c0 msgr2=0x7f1d68133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.826+0000 7f1d6fbd6700 1 --2- 172.21.15.59:0/3390558752 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d681338c0 0x7f1d68133c90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009840 tx=0x7f1d58009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:27.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.826+0000 7f1d6fbd6700 1 -- 172.21.15.59:0/3390558752 shutdown_connections 2023-09-30T22:30:27.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.826+0000 7f1d6fbd6700 1 --2- 172.21.15.59:0/3390558752 >> v2:172.21.15.59:3300/0 conn(0x7f1d6809e390 0x7f1d6809e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.826+0000 7f1d6fbd6700 1 --2- 172.21.15.59:0/3390558752 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d681338c0 0x7f1d68133c90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.826+0000 7f1d6fbd6700 1 --2- 172.21.15.59:0/3390558752 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d681341d0 0x7f1d6809de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.826+0000 7f1d6fbd6700 1 -- 172.21.15.59:0/3390558752 >> 172.21.15.59:0/3390558752 conn(0x7f1d680a2aa0 msgr2=0x7f1d680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:27.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.826+0000 7f1d6fbd6700 1 -- 172.21.15.59:0/3390558752 shutdown_connections 2023-09-30T22:30:27.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.826+0000 7f1d6fbd6700 1 -- 172.21.15.59:0/3390558752 wait complete. 2023-09-30T22:30:27.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.827+0000 7f1d6fbd6700 1 Processor -- start 2023-09-30T22:30:27.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.827+0000 7f1d6fbd6700 1 -- start start 2023-09-30T22:30:27.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6fbd6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d6809e390 0x7f1d6811f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6fbd6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d681338c0 0x7f1d6811fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6fbd6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d681341d0 0x7f1d68120300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6fbd6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68122310 con 0x7f1d681338c0 2023-09-30T22:30:27.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6fbd6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68123350 con 0x7f1d6809e390 2023-09-30T22:30:27.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6fbd6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68122e40 con 0x7f1d681341d0 2023-09-30T22:30:27.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6d972700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d6809e390 0x7f1d6811f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6d171700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d681338c0 0x7f1d6811fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6d972700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d6809e390 0x7f1d6811f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42712/0 (socket says 172.21.15.59:42712) 2023-09-30T22:30:27.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6d972700 1 -- 172.21.15.59:0/2281521813 learned_addr learned my addr 172.21.15.59:0/2281521813 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:27.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6e173700 1 --2- 172.21.15.59:0/2281521813 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d681341d0 0x7f1d68120300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6d171700 1 -- 172.21.15.59:0/2281521813 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d681341d0 msgr2=0x7f1d68120300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6d171700 1 --2- 172.21.15.59:0/2281521813 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d681341d0 0x7f1d68120300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6d171700 1 -- 172.21.15.59:0/2281521813 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d6809e390 msgr2=0x7f1d6811f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6d171700 1 --2- 172.21.15.59:0/2281521813 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d6809e390 0x7f1d6811f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6d171700 1 -- 172.21.15.59:0/2281521813 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d60009b30 con 0x7f1d681338c0 2023-09-30T22:30:27.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6d972700 1 --2- 172.21.15.59:0/2281521813 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d6809e390 0x7f1d6811f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:27.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d6d171700 1 --2- 172.21.15.59:0/2281521813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d681338c0 0x7f1d6811fdc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400e9b0 tx=0x7f1d6400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:27.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d5e7fc700 1 -- 172.21.15.59:0/2281521813 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6400ee50 con 0x7f1d681338c0 2023-09-30T22:30:27.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.828+0000 7f1d5e7fc700 1 -- 172.21.15.59:0/2281521813 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6400c850 con 0x7f1d681338c0 2023-09-30T22:30:27.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.829+0000 7f1d6fbd6700 1 -- 172.21.15.59:0/2281521813 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d640094a0 con 0x7f1d681338c0 2023-09-30T22:30:27.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.829+0000 7f1d5e7fc700 1 -- 172.21.15.59:0/2281521813 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6400cbe0 con 0x7f1d681338c0 2023-09-30T22:30:27.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.829+0000 7f1d6fbd6700 1 -- 172.21.15.59:0/2281521813 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d580094a0 con 0x7f1d681338c0 2023-09-30T22:30:27.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.829+0000 7f1d5e7fc700 1 -- 172.21.15.59:0/2281521813 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d6400cd40 con 0x7f1d681338c0 2023-09-30T22:30:27.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.830+0000 7f1d5e7fc700 1 -- 172.21.15.59:0/2281521813 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1d6403fa40 con 0x7f1d681338c0 2023-09-30T22:30:27.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.830+0000 7f1d6fbd6700 1 -- 172.21.15.59:0/2281521813 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d68074ea0 con 0x7f1d681338c0 2023-09-30T22:30:27.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:27.834+0000 7f1d5e7fc700 1 -- 172.21.15.59:0/2281521813 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d6401b3b0 con 0x7f1d681338c0 2023-09-30T22:30:28.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.037+0000 7f1d6fbd6700 1 -- 172.21.15.59:0/2281521813 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1d68130c00 con 0x7f1d681338c0 2023-09-30T22:30:28.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.038+0000 7f1d5e7fc700 1 -- 172.21.15.59:0/2281521813 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d64017020 con 0x7f1d681338c0 2023-09-30T22:30:28.038 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:28.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.040+0000 7f1d6fbd6700 1 -- 172.21.15.59:0/2281521813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d681338c0 msgr2=0x7f1d6811fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.040+0000 7f1d6fbd6700 1 --2- 172.21.15.59:0/2281521813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d681338c0 0x7f1d6811fdc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400e9b0 tx=0x7f1d6400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.040+0000 7f1d6fbd6700 1 -- 172.21.15.59:0/2281521813 shutdown_connections 2023-09-30T22:30:28.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.040+0000 7f1d6fbd6700 1 --2- 172.21.15.59:0/2281521813 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d681341d0 0x7f1d68120300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.040+0000 7f1d6fbd6700 1 --2- 172.21.15.59:0/2281521813 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d6809e390 0x7f1d6811f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.040+0000 7f1d6fbd6700 1 --2- 172.21.15.59:0/2281521813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d681338c0 0x7f1d6811fdc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.040+0000 7f1d6fbd6700 1 -- 172.21.15.59:0/2281521813 >> 172.21.15.59:0/2281521813 conn(0x7f1d680a2aa0 msgr2=0x7f1d680a0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:28.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.040+0000 7f1d6fbd6700 1 -- 172.21.15.59:0/2281521813 shutdown_connections 2023-09-30T22:30:28.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.040+0000 7f1d6fbd6700 1 -- 172.21.15.59:0/2281521813 wait complete. 2023-09-30T22:30:28.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:28.259 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:28.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:28.337 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:28.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.410+0000 7f1ff0b57700 1 Processor -- start 2023-09-30T22:30:28.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.410+0000 7f1ff0b57700 1 -- start start 2023-09-30T22:30:28.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.411+0000 7f1ff0b57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec09d6f0 0x7f1fec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.411+0000 7f1ff0b57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec09e410 0x7f1fec134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.411+0000 7f1ff0b57700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec09b120 con 0x7f1fec09e000 2023-09-30T22:30:28.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.411+0000 7f1ff0b57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec06b460 con 0x7f1fec09d6f0 2023-09-30T22:30:28.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.411+0000 7f1ff0b57700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec09a7e0 con 0x7f1fec09e410 2023-09-30T22:30:28.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.411+0000 7f1fe9d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1fec09e000 0x7f1fec1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48426/0 (socket says 172.21.15.59:48426) 2023-09-30T22:30:28.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.411+0000 7f1fea59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec09d6f0 0x7f1fec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.411+0000 7f1fe9d9b700 1 -- 172.21.15.59:0/1901425032 learned_addr learned my addr 172.21.15.59:0/1901425032 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:28.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.411+0000 7f1fead9d700 1 --2- 172.21.15.59:0/1901425032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec09e410 0x7f1fec134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.411+0000 7f1fead9d700 1 -- 172.21.15.59:0/1901425032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec09d6f0 msgr2=0x7f1fec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:28.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.411+0000 7f1fe959a700 1 -- 172.21.15.59:0/1901425032 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588190556 0 0) 0x7f1fec09b120 con 0x7f1fec09e000 2023-09-30T22:30:28.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.411+0000 7f1fead9d700 1 --2- 172.21.15.59:0/1901425032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec09d6f0 0x7f1fec09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.412+0000 7f1fead9d700 1 -- 172.21.15.59:0/1901425032 >> v1:172.21.15.59:6789/0 conn(0x7f1fec09e000 legacy=0x7f1fec1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.412+0000 7f1fead9d700 1 -- 172.21.15.59:0/1901425032 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec09a500 con 0x7f1fec09e410 2023-09-30T22:30:28.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.412+0000 7f1fea59c700 1 --2- 172.21.15.59:0/1901425032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec09d6f0 0x7f1fec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:28.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.412+0000 7f1fead9d700 1 --2- 172.21.15.59:0/1901425032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec09e410 0x7f1fec134100 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009df0 tx=0x7f1fe400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f135989da69a7f95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:28.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.412+0000 7f1fe959a700 1 -- 172.21.15.59:0/1901425032 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400e070 con 0x7f1fec09e410 2023-09-30T22:30:28.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.412+0000 7f1fe959a700 1 -- 172.21.15.59:0/1901425032 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe400bae0 con 0x7f1fec09e410 2023-09-30T22:30:28.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.412+0000 7f1fe959a700 1 -- 172.21.15.59:0/1901425032 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400be90 con 0x7f1fec09e410 2023-09-30T22:30:28.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.413+0000 7f1ff0b57700 1 -- 172.21.15.59:0/1901425032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec09e410 msgr2=0x7f1fec134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.413+0000 7f1ff0b57700 1 --2- 172.21.15.59:0/1901425032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec09e410 0x7f1fec134100 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009df0 tx=0x7f1fe400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:28.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.413+0000 7f1ff0b57700 1 -- 172.21.15.59:0/1901425032 shutdown_connections 2023-09-30T22:30:28.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.413+0000 7f1ff0b57700 1 --2- 172.21.15.59:0/1901425032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec09e410 0x7f1fec134100 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.413+0000 7f1ff0b57700 1 --2- 172.21.15.59:0/1901425032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec09d6f0 0x7f1fec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.413+0000 7f1ff0b57700 1 -- 172.21.15.59:0/1901425032 >> 172.21.15.59:0/1901425032 conn(0x7f1fec066f50 msgr2=0x7f1fec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:28.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.413+0000 7f1ff0b57700 1 -- 172.21.15.59:0/1901425032 shutdown_connections 2023-09-30T22:30:28.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.413+0000 7f1ff0b57700 1 -- 172.21.15.59:0/1901425032 wait complete. 2023-09-30T22:30:28.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.414+0000 7f1ff0b57700 1 Processor -- start 2023-09-30T22:30:28.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.414+0000 7f1ff0b57700 1 -- start start 2023-09-30T22:30:28.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1ff0b57700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec09d6f0 0x7f1fec122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1ff0b57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec09e000 0x7f1fec122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1ff0b57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec09e410 0x7f1fec122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1ff0b57700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec1237f0 con 0x7f1fec09d6f0 2023-09-30T22:30:28.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1ff0b57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec124e00 con 0x7f1fec09e410 2023-09-30T22:30:28.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1ff0b57700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec125e40 con 0x7f1fec09e000 2023-09-30T22:30:28.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1fe9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec09e000 0x7f1fec122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1fe9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec09e000 0x7f1fec122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40066/0 (socket says 172.21.15.59:40066) 2023-09-30T22:30:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1fe9d9b700 1 -- 172.21.15.59:0/3055548657 learned_addr learned my addr 172.21.15.59:0/3055548657 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1fea59c700 1 --2- 172.21.15.59:0/3055548657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec09d6f0 0x7f1fec122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1fead9d700 1 --2- 172.21.15.59:0/3055548657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec09e410 0x7f1fec122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1fe9d9b700 1 -- 172.21.15.59:0/3055548657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec09e410 msgr2=0x7f1fec122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1fe9d9b700 1 --2- 172.21.15.59:0/3055548657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec09e410 0x7f1fec122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1fe9d9b700 1 -- 172.21.15.59:0/3055548657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec09d6f0 msgr2=0x7f1fec122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1fe9d9b700 1 --2- 172.21.15.59:0/3055548657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec09d6f0 0x7f1fec122320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1fe9d9b700 1 -- 172.21.15.59:0/3055548657 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0094a0 con 0x7f1fec09e000 2023-09-30T22:30:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.415+0000 7f1fe9d9b700 1 --2- 172.21.15.59:0/3055548657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec09e000 0x7f1fec122860 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0001eb0 tx=0x7f1fe000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.416+0000 7f1fdaffd700 1 -- 172.21.15.59:0/3055548657 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0004c80 con 0x7f1fec09e000 2023-09-30T22:30:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.416+0000 7f1fdaffd700 1 -- 172.21.15.59:0/3055548657 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe0004de0 con 0x7f1fec09e000 2023-09-30T22:30:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.416+0000 7f1ff0b57700 1 -- 172.21.15.59:0/3055548657 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe4009a70 con 0x7f1fec09e000 2023-09-30T22:30:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.416+0000 7f1fdaffd700 1 -- 172.21.15.59:0/3055548657 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0007310 con 0x7f1fec09e000 2023-09-30T22:30:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.416+0000 7f1ff0b57700 1 -- 172.21.15.59:0/3055548657 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec0a2020 con 0x7f1fec09e000 2023-09-30T22:30:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.417+0000 7f1fdaffd700 1 -- 172.21.15.59:0/3055548657 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fe0007470 con 0x7f1fec09e000 2023-09-30T22:30:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.417+0000 7f1fdaffd700 1 -- 172.21.15.59:0/3055548657 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1fe003f380 con 0x7f1fec09e000 2023-09-30T22:30:28.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.417+0000 7f1ff0b57700 1 -- 172.21.15.59:0/3055548657 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fec11f030 con 0x7f1fec09e000 2023-09-30T22:30:28.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.422+0000 7f1fdaffd700 1 -- 172.21.15.59:0/3055548657 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fe00102c0 con 0x7f1fec09e000 2023-09-30T22:30:28.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.459+0000 7f84f9942700 1 Processor -- start 2023-09-30T22:30:28.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.459+0000 7f84f9942700 1 -- start start 2023-09-30T22:30:28.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.459+0000 7f84f9942700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84f40a0a30 0x7f84f40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.459+0000 7f84f9942700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f409d630 0x7f84f40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.459+0000 7f84f9942700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f40a2a70 con 0x7f84f4133930 2023-09-30T22:30:28.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.459+0000 7f84f9942700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f40a01d0 con 0x7f84f40a0a30 2023-09-30T22:30:28.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.459+0000 7f84f9942700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84f409e2b0 con 0x7f84f409d630 2023-09-30T22:30:28.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.460+0000 7f84f2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84f40a0a30 0x7f84f40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.460+0000 7f84f27fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f409d630 0x7f84f40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.460+0000 7f84f2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84f40a0a30 0x7f84f40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50876/0 (socket says 172.21.15.59:50876) 2023-09-30T22:30:28.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.460+0000 7f84f27fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f409d630 0x7f84f40a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40068/0 (socket says 172.21.15.59:40068) 2023-09-30T22:30:28.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.460+0000 7f84f2ffd700 1 -- 172.21.15.59:0/221063708 learned_addr learned my addr 172.21.15.59:0/221063708 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.460+0000 7f84f2ffd700 1 -- 172.21.15.59:0/221063708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f409d630 msgr2=0x7f84f40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.460+0000 7f84f2ffd700 1 --2- 172.21.15.59:0/221063708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f409d630 0x7f84f40a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.460+0000 7f84f2ffd700 1 -- 172.21.15.59:0/221063708 >> v1:172.21.15.59:6789/0 conn(0x7f84f4133930 legacy=0x7f84f4133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.460+0000 7f84f2ffd700 1 -- 172.21.15.59:0/221063708 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f409dc50 con 0x7f84f40a0a30 2023-09-30T22:30:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.460+0000 7f84f2ffd700 1 --2- 172.21.15.59:0/221063708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f40a0a30 0x7f84f40a0e00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f84e40098f0 tx=0x7f84e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964c7dd296817c0f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.460+0000 7f84f1ffb700 1 -- 172.21.15.59:0/221063708 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e400b8a0 con 0x7f84f40a0a30 2023-09-30T22:30:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.460+0000 7f84f1ffb700 1 -- 172.21.15.59:0/221063708 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e400ba00 con 0x7f84f40a0a30 2023-09-30T22:30:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.460+0000 7f84f1ffb700 1 -- 172.21.15.59:0/221063708 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e400bd90 con 0x7f84f40a0a30 2023-09-30T22:30:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.461+0000 7f84f9942700 1 -- 172.21.15.59:0/221063708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f40a0a30 msgr2=0x7f84f40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.461+0000 7f84f9942700 1 --2- 172.21.15.59:0/221063708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f40a0a30 0x7f84f40a0e00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f84e40098f0 tx=0x7f84e4009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.461+0000 7f84f9942700 1 -- 172.21.15.59:0/221063708 shutdown_connections 2023-09-30T22:30:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.461+0000 7f84f9942700 1 --2- 172.21.15.59:0/221063708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f40a0a30 0x7f84f40a0e00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.461+0000 7f84f9942700 1 --2- 172.21.15.59:0/221063708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f409d630 0x7f84f40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.461+0000 7f84f9942700 1 -- 172.21.15.59:0/221063708 >> 172.21.15.59:0/221063708 conn(0x7f84f40a3050 msgr2=0x7f84f40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.461+0000 7f84f9942700 1 -- 172.21.15.59:0/221063708 shutdown_connections 2023-09-30T22:30:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.461+0000 7f84f9942700 1 -- 172.21.15.59:0/221063708 wait complete. 2023-09-30T22:30:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.463+0000 7f84f9942700 1 Processor -- start 2023-09-30T22:30:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.463+0000 7f84f9942700 1 -- start start 2023-09-30T22:30:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f9942700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f409d630 0x7f84f4132840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f9942700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f40a0a30 0x7f84f4132d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f9942700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f4133930 0x7f84f41c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f9942700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f4120670 con 0x7f84f4133930 2023-09-30T22:30:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f9942700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f4121fe0 con 0x7f84f409d630 2023-09-30T22:30:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f9942700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84f4122660 con 0x7f84f40a0a30 2023-09-30T22:30:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f409d630 0x7f84f4132840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f409d630 0x7f84f4132840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42746/0 (socket says 172.21.15.59:42746) 2023-09-30T22:30:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f4133930 0x7f84f41c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f2ffd700 1 -- 172.21.15.59:0/2238006050 learned_addr learned my addr 172.21.15.59:0/2238006050 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f27fc700 1 --2- 172.21.15.59:0/2238006050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f40a0a30 0x7f84f4132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f2ffd700 1 -- 172.21.15.59:0/2238006050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f40a0a30 msgr2=0x7f84f4132d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f2ffd700 1 --2- 172.21.15.59:0/2238006050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f40a0a30 0x7f84f4132d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f2ffd700 1 -- 172.21.15.59:0/2238006050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f4133930 msgr2=0x7f84f41c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f2ffd700 1 --2- 172.21.15.59:0/2238006050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f4133930 0x7f84f41c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f2ffd700 1 -- 172.21.15.59:0/2238006050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e4009550 con 0x7f84f409d630 2023-09-30T22:30:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.464+0000 7f84f37fe700 1 --2- 172.21.15.59:0/2238006050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f4133930 0x7f84f41c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.465+0000 7f84f2ffd700 1 --2- 172.21.15.59:0/2238006050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f409d630 0x7f84f4132840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f84e4000c00 tx=0x7f84e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.465+0000 7f84dbfff700 1 -- 172.21.15.59:0/2238006050 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e4004510 con 0x7f84f409d630 2023-09-30T22:30:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.465+0000 7f84dbfff700 1 -- 172.21.15.59:0/2238006050 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e40036a0 con 0x7f84f409d630 2023-09-30T22:30:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.465+0000 7f84dbfff700 1 -- 172.21.15.59:0/2238006050 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e4003a30 con 0x7f84f409d630 2023-09-30T22:30:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.465+0000 7f84f9942700 1 -- 172.21.15.59:0/2238006050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f40a40c0 con 0x7f84f409d630 2023-09-30T22:30:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.465+0000 7f84f9942700 1 -- 172.21.15.59:0/2238006050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f41332c0 con 0x7f84f409d630 2023-09-30T22:30:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.466+0000 7f84dbfff700 1 -- 172.21.15.59:0/2238006050 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84e4021070 con 0x7f84f409d630 2023-09-30T22:30:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.466+0000 7f84da7fc700 1 -- 172.21.15.59:0/2238006050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f40747f0 con 0x7f84f409d630 2023-09-30T22:30:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.466+0000 7f84dbfff700 1 -- 172.21.15.59:0/2238006050 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f84e4040980 con 0x7f84f409d630 2023-09-30T22:30:28.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.471+0000 7f84dbfff700 1 -- 172.21.15.59:0/2238006050 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84e4003b90 con 0x7f84f409d630 2023-09-30T22:30:28.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.498+0000 7fb0e0656700 1 Processor -- start 2023-09-30T22:30:28.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.498+0000 7fb0e0656700 1 -- start start 2023-09-30T22:30:28.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.499+0000 7fb0e0656700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0d80a0a30 0x7fb0d80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.499+0000 7fb0e0656700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb0d80a1340 0x7fb0d8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.499+0000 7fb0e0656700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d809edd0 con 0x7fb0d8133fa0 2023-09-30T22:30:28.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.499+0000 7fb0e0656700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d809e1f0 con 0x7fb0d80a1340 2023-09-30T22:30:28.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.499+0000 7fb0e0656700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d809dc50 con 0x7fb0d80a0a30 2023-09-30T22:30:28.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.499+0000 7fb0de3f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0d80a0a30 0x7fb0d80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.499+0000 7fb0ddbf1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb0d80a1340 0x7fb0d8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.499+0000 7fb0de3f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0d80a0a30 0x7fb0d80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40074/0 (socket says 172.21.15.59:40074) 2023-09-30T22:30:28.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.499+0000 7fb0debf3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb0d8133fa0 0x7fb0d813ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48438/0 (socket says 172.21.15.59:48438) 2023-09-30T22:30:28.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.499+0000 7fb0de3f2700 1 -- 172.21.15.59:0/1330824573 learned_addr learned my addr 172.21.15.59:0/1330824573 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:28.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.499+0000 7fb0ddbf1700 1 -- 172.21.15.59:0/1330824573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0d80a0a30 msgr2=0x7fb0d80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:28.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.499+0000 7fb0ddbf1700 1 --2- 172.21.15.59:0/1330824573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0d80a0a30 0x7fb0d80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.499+0000 7fb0ddbf1700 1 -- 172.21.15.59:0/1330824573 >> v1:172.21.15.59:6789/0 conn(0x7fb0d8133fa0 legacy=0x7fb0d813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.499+0000 7fb0ddbf1700 1 -- 172.21.15.59:0/1330824573 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d80a1fe0 con 0x7fb0d80a1340 2023-09-30T22:30:28.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.500+0000 7fb0ddbf1700 1 --2- 172.21.15.59:0/1330824573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d80a1340 0x7fb0d8133a60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009840 tx=0x7fb0c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbf929ded699690 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:28.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.500+0000 7fb0dd3f0700 1 -- 172.21.15.59:0/1330824573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8011830 con 0x7fb0d80a1340 2023-09-30T22:30:28.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.500+0000 7fb0dd3f0700 1 -- 172.21.15.59:0/1330824573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c8011990 con 0x7fb0d80a1340 2023-09-30T22:30:28.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.500+0000 7fb0dd3f0700 1 -- 172.21.15.59:0/1330824573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8011d20 con 0x7fb0d80a1340 2023-09-30T22:30:28.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.500+0000 7fb0e0656700 1 -- 172.21.15.59:0/1330824573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d80a1340 msgr2=0x7fb0d8133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.500+0000 7fb0e0656700 1 --2- 172.21.15.59:0/1330824573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d80a1340 0x7fb0d8133a60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009840 tx=0x7fb0c8009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:28.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.501+0000 7fb0e0656700 1 -- 172.21.15.59:0/1330824573 shutdown_connections 2023-09-30T22:30:28.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.501+0000 7fb0e0656700 1 --2- 172.21.15.59:0/1330824573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0d80a0a30 0x7fb0d80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.501+0000 7fb0e0656700 1 --2- 172.21.15.59:0/1330824573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d80a1340 0x7fb0d8133a60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.501+0000 7fb0e0656700 1 -- 172.21.15.59:0/1330824573 >> 172.21.15.59:0/1330824573 conn(0x7fb0d80a6550 msgr2=0x7fb0d80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:28.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.501+0000 7fb0e0656700 1 -- 172.21.15.59:0/1330824573 shutdown_connections 2023-09-30T22:30:28.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.501+0000 7fb0e0656700 1 -- 172.21.15.59:0/1330824573 wait complete. 2023-09-30T22:30:28.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.502+0000 7fb0e0656700 1 Processor -- start 2023-09-30T22:30:28.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.502+0000 7fb0e0656700 1 -- start start 2023-09-30T22:30:28.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.502+0000 7fb0e0656700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d80a0a30 0x7fb0d811e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.502+0000 7fb0e0656700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0d80a1340 0x7fb0d811ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.502+0000 7fb0e0656700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0d8133fa0 0x7fb0d811f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.502+0000 7fb0e0656700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d8120b70 con 0x7fb0d80a0a30 2023-09-30T22:30:28.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.502+0000 7fb0e0656700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d8120420 con 0x7fb0d8133fa0 2023-09-30T22:30:28.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.502+0000 7fb0e0656700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d80a3850 con 0x7fb0d80a1340 2023-09-30T22:30:28.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.502+0000 7fb0de3f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d80a0a30 0x7fb0d811e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.502+0000 7fb0de3f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d80a0a30 0x7fb0d811e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50896/0 (socket says 172.21.15.59:50896) 2023-09-30T22:30:28.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.502+0000 7fb0de3f2700 1 -- 172.21.15.59:0/1245375457 learned_addr learned my addr 172.21.15.59:0/1245375457 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:28.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.502+0000 7fb0ddbf1700 1 --2- 172.21.15.59:0/1245375457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0d80a1340 0x7fb0d811ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.502+0000 7fb0debf3700 1 --2- 172.21.15.59:0/1245375457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0d8133fa0 0x7fb0d811f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.503+0000 7fb0de3f2700 1 -- 172.21.15.59:0/1245375457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0d80a1340 msgr2=0x7fb0d811ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.503+0000 7fb0de3f2700 1 --2- 172.21.15.59:0/1245375457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0d80a1340 0x7fb0d811ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.503+0000 7fb0de3f2700 1 -- 172.21.15.59:0/1245375457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0d8133fa0 msgr2=0x7fb0d811f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.503+0000 7fb0de3f2700 1 --2- 172.21.15.59:0/1245375457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0d8133fa0 0x7fb0d811f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.503+0000 7fb0de3f2700 1 -- 172.21.15.59:0/1245375457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c80094a0 con 0x7fb0d80a0a30 2023-09-30T22:30:28.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.503+0000 7fb0debf3700 1 --2- 172.21.15.59:0/1245375457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0d8133fa0 0x7fb0d811f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:28.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.503+0000 7fb0de3f2700 1 --2- 172.21.15.59:0/1245375457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d80a0a30 0x7fb0d811e7e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400e910 tx=0x7fb0d400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:28.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.503+0000 7fb0ceffd700 1 -- 172.21.15.59:0/1245375457 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d40096a0 con 0x7fb0d80a0a30 2023-09-30T22:30:28.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.503+0000 7fb0ceffd700 1 -- 172.21.15.59:0/1245375457 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d400ee60 con 0x7fb0d80a0a30 2023-09-30T22:30:28.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.503+0000 7fb0e0656700 1 -- 172.21.15.59:0/1245375457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d80a0220 con 0x7fb0d80a0a30 2023-09-30T22:30:28.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.503+0000 7fb0ceffd700 1 -- 172.21.15.59:0/1245375457 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d400ca90 con 0x7fb0d80a0a30 2023-09-30T22:30:28.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.503+0000 7fb0e0656700 1 -- 172.21.15.59:0/1245375457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d81331b0 con 0x7fb0d80a0a30 2023-09-30T22:30:28.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.504+0000 7fb0ceffd700 1 -- 172.21.15.59:0/1245375457 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0d400cbf0 con 0x7fb0d80a0a30 2023-09-30T22:30:28.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.504+0000 7fb0e0656700 1 -- 172.21.15.59:0/1245375457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d8074ea0 con 0x7fb0d80a0a30 2023-09-30T22:30:28.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.505+0000 7fb0ceffd700 1 -- 172.21.15.59:0/1245375457 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb0d403fa40 con 0x7fb0d80a0a30 2023-09-30T22:30:28.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.509+0000 7fb0ceffd700 1 -- 172.21.15.59:0/1245375457 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0d401b3b0 con 0x7fb0d80a0a30 2023-09-30T22:30:28.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.633+0000 7f1ff0b57700 1 -- 172.21.15.59:0/3055548657 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1fec074ea0 con 0x7f1fec09e000 2023-09-30T22:30:28.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.634+0000 7f1fdaffd700 1 -- 172.21.15.59:0/3055548657 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1fe0011360 con 0x7f1fec09e000 2023-09-30T22:30:28.634 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.636+0000 7f1ff0b57700 1 -- 172.21.15.59:0/3055548657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec09e000 msgr2=0x7f1fec122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.636+0000 7f1ff0b57700 1 --2- 172.21.15.59:0/3055548657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec09e000 0x7f1fec122860 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0001eb0 tx=0x7f1fe000c800 comp rx=0 tx=0).stop 2023-09-30T22:30:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.636+0000 7f1ff0b57700 1 -- 172.21.15.59:0/3055548657 shutdown_connections 2023-09-30T22:30:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.636+0000 7f1ff0b57700 1 --2- 172.21.15.59:0/3055548657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec09e410 0x7f1fec122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.636+0000 7f1ff0b57700 1 --2- 172.21.15.59:0/3055548657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec09d6f0 0x7f1fec122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.636+0000 7f1ff0b57700 1 --2- 172.21.15.59:0/3055548657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec09e000 0x7f1fec122860 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.636+0000 7f1ff0b57700 1 -- 172.21.15.59:0/3055548657 >> 172.21.15.59:0/3055548657 conn(0x7f1fec066f50 msgr2=0x7f1fec133de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.636+0000 7f1ff0b57700 1 -- 172.21.15.59:0/3055548657 shutdown_connections 2023-09-30T22:30:28.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.636+0000 7f1ff0b57700 1 -- 172.21.15.59:0/3055548657 wait complete. 2023-09-30T22:30:28.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:28.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.678+0000 7f84da7fc700 1 -- 172.21.15.59:0/2238006050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f84f4133510 con 0x7f84f409d630 2023-09-30T22:30:28.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.678+0000 7f84dbfff700 1 -- 172.21.15.59:0/2238006050 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84e4029020 con 0x7f84f409d630 2023-09-30T22:30:28.678 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:28.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.680+0000 7f84da7fc700 1 -- 172.21.15.59:0/2238006050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f409d630 msgr2=0x7f84f4132840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.680+0000 7f84da7fc700 1 --2- 172.21.15.59:0/2238006050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f409d630 0x7f84f4132840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f84e4000c00 tx=0x7f84e4004750 comp rx=0 tx=0).stop 2023-09-30T22:30:28.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.680+0000 7f84da7fc700 1 -- 172.21.15.59:0/2238006050 shutdown_connections 2023-09-30T22:30:28.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.680+0000 7f84da7fc700 1 --2- 172.21.15.59:0/2238006050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f4133930 0x7f84f41c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.681+0000 7f84da7fc700 1 --2- 172.21.15.59:0/2238006050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f409d630 0x7f84f4132840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.681+0000 7f84da7fc700 1 --2- 172.21.15.59:0/2238006050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f40a0a30 0x7f84f4132d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.681+0000 7f84da7fc700 1 -- 172.21.15.59:0/2238006050 >> 172.21.15.59:0/2238006050 conn(0x7f84f40a3050 msgr2=0x7f84f41bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:28.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.681+0000 7f84da7fc700 1 -- 172.21.15.59:0/2238006050 shutdown_connections 2023-09-30T22:30:28.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.681+0000 7f84da7fc700 1 -- 172.21.15.59:0/2238006050 wait complete. 2023-09-30T22:30:28.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:28.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.718+0000 7fb0e0656700 1 -- 172.21.15.59:0/1245375457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb0d80a28e0 con 0x7fb0d80a0a30 2023-09-30T22:30:28.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.718+0000 7fb0ceffd700 1 -- 172.21.15.59:0/1245375457 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0d4011b00 con 0x7fb0d80a0a30 2023-09-30T22:30:28.719 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:28.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.721+0000 7fb0e0656700 1 -- 172.21.15.59:0/1245375457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d80a0a30 msgr2=0x7fb0d811e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.721+0000 7fb0e0656700 1 --2- 172.21.15.59:0/1245375457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d80a0a30 0x7fb0d811e7e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400e910 tx=0x7fb0d400ec20 comp rx=0 tx=0).stop 2023-09-30T22:30:28.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.721+0000 7fb0e0656700 1 -- 172.21.15.59:0/1245375457 shutdown_connections 2023-09-30T22:30:28.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.721+0000 7fb0e0656700 1 --2- 172.21.15.59:0/1245375457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0d8133fa0 0x7fb0d811f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.721+0000 7fb0e0656700 1 --2- 172.21.15.59:0/1245375457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d80a0a30 0x7fb0d811e7e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.721+0000 7fb0e0656700 1 --2- 172.21.15.59:0/1245375457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0d80a1340 0x7fb0d811ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.721+0000 7fb0e0656700 1 -- 172.21.15.59:0/1245375457 >> 172.21.15.59:0/1245375457 conn(0x7fb0d80a6550 msgr2=0x7fb0d80a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:28.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.721+0000 7fb0e0656700 1 -- 172.21.15.59:0/1245375457 shutdown_connections 2023-09-30T22:30:28.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:28.721+0000 7fb0e0656700 1 -- 172.21.15.59:0/1245375457 wait complete. 2023-09-30T22:30:28.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:29.054 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:29.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.201+0000 7f2077df7700 1 Processor -- start 2023-09-30T22:30:29.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.201+0000 7f2077df7700 1 -- start start 2023-09-30T22:30:29.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2077df7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207009d6f0 0x7f207009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2077df7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2070134100 0x7f207013bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2077df7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207009d2f0 con 0x7f207009e000 2023-09-30T22:30:29.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2077df7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f207009a810 con 0x7f2070134100 2023-09-30T22:30:29.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2077df7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f207009a470 con 0x7f207009d6f0 2023-09-30T22:30:29.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2075b93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207009d6f0 0x7f207009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2076394700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2070134100 0x7f207013bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2076394700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2070134100 0x7f207013bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50908/0 (socket says 172.21.15.59:50908) 2023-09-30T22:30:29.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2075b93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207009d6f0 0x7f207009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40096/0 (socket says 172.21.15.59:40096) 2023-09-30T22:30:29.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2076394700 1 -- 172.21.15.59:0/545931220 learned_addr learned my addr 172.21.15.59:0/545931220 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:29.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2076394700 1 -- 172.21.15.59:0/545931220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207009d6f0 msgr2=0x7f207009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:29.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2076394700 1 --2- 172.21.15.59:0/545931220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207009d6f0 0x7f207009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2076394700 1 -- 172.21.15.59:0/545931220 >> v1:172.21.15.59:6789/0 conn(0x7f207009e000 legacy=0x7f20701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2076394700 1 -- 172.21.15.59:0/545931220 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207009ec40 con 0x7f2070134100 2023-09-30T22:30:29.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2075b93700 1 --2- 172.21.15.59:0/545931220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207009d6f0 0x7f207009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:29.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.202+0000 7f2076394700 1 --2- 172.21.15.59:0/545931220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2070134100 0x7f207013bc50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2068009e50 tx=0x7f206800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0089a7ba98d9223 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.203+0000 7f2074b91700 1 -- 172.21.15.59:0/545931220 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206800e070 con 0x7f2070134100 2023-09-30T22:30:29.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.203+0000 7f2074b91700 1 -- 172.21.15.59:0/545931220 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206800b910 con 0x7f2070134100 2023-09-30T22:30:29.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.203+0000 7f2074b91700 1 -- 172.21.15.59:0/545931220 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206800bcc0 con 0x7f2070134100 2023-09-30T22:30:29.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.203+0000 7f2077df7700 1 -- 172.21.15.59:0/545931220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2070134100 msgr2=0x7f207013bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.203+0000 7f2077df7700 1 --2- 172.21.15.59:0/545931220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2070134100 0x7f207013bc50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2068009e50 tx=0x7f206800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:29.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.203+0000 7f2077df7700 1 -- 172.21.15.59:0/545931220 shutdown_connections 2023-09-30T22:30:29.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.203+0000 7f2077df7700 1 --2- 172.21.15.59:0/545931220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2070134100 0x7f207013bc50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.203+0000 7f2077df7700 1 --2- 172.21.15.59:0/545931220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207009d6f0 0x7f207009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.203+0000 7f2077df7700 1 -- 172.21.15.59:0/545931220 >> 172.21.15.59:0/545931220 conn(0x7f2070066f50 msgr2=0x7f207009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:29.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.203+0000 7f2077df7700 1 -- 172.21.15.59:0/545931220 shutdown_connections 2023-09-30T22:30:29.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.203+0000 7f2077df7700 1 -- 172.21.15.59:0/545931220 wait complete. 2023-09-30T22:30:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.204+0000 7f2077df7700 1 Processor -- start 2023-09-30T22:30:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.204+0000 7f2077df7700 1 -- start start 2023-09-30T22:30:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2077df7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207009d6f0 0x7f2070122880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2077df7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f207009e000 0x7f2070122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2077df7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2070134100 0x7f2070123300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2077df7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20701245a0 con 0x7f207009e000 2023-09-30T22:30:29.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2077df7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20701260c0 con 0x7f2070134100 2023-09-30T22:30:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2077df7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20700a30f0 con 0x7f207009d6f0 2023-09-30T22:30:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2075b93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207009d6f0 0x7f2070122880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2075392700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f207009e000 0x7f2070122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2075b93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207009d6f0 0x7f2070122880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40100/0 (socket says 172.21.15.59:40100) 2023-09-30T22:30:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2075392700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f207009e000 0x7f2070122dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50914/0 (socket says 172.21.15.59:50914) 2023-09-30T22:30:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2075b93700 1 -- 172.21.15.59:0/218077075 learned_addr learned my addr 172.21.15.59:0/218077075 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2076394700 1 --2- 172.21.15.59:0/218077075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2070134100 0x7f2070123300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2075392700 1 -- 172.21.15.59:0/218077075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207009d6f0 msgr2=0x7f2070122880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2075392700 1 --2- 172.21.15.59:0/218077075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207009d6f0 0x7f2070122880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2075392700 1 -- 172.21.15.59:0/218077075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2070134100 msgr2=0x7f2070123300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2075392700 1 --2- 172.21.15.59:0/218077075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2070134100 0x7f2070123300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2075392700 1 -- 172.21.15.59:0/218077075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c0094a0 con 0x7f207009e000 2023-09-30T22:30:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.205+0000 7f2075392700 1 --2- 172.21.15.59:0/218077075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f207009e000 0x7f2070122dc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2060000f60 tx=0x7f206000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.206+0000 7f20667fc700 1 -- 172.21.15.59:0/218077075 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20600050d0 con 0x7f207009e000 2023-09-30T22:30:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.206+0000 7f20667fc700 1 -- 172.21.15.59:0/218077075 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2060005230 con 0x7f207009e000 2023-09-30T22:30:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.206+0000 7f20667fc700 1 -- 172.21.15.59:0/218077075 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060003680 con 0x7f207009e000 2023-09-30T22:30:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.206+0000 7f2077df7700 1 -- 172.21.15.59:0/218077075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2068009b30 con 0x7f207009e000 2023-09-30T22:30:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.206+0000 7f2077df7700 1 -- 172.21.15.59:0/218077075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207009c690 con 0x7f207009e000 2023-09-30T22:30:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.206+0000 7f20667fc700 1 -- 172.21.15.59:0/218077075 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20600037e0 con 0x7f207009e000 2023-09-30T22:30:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.207+0000 7f20667fc700 1 -- 172.21.15.59:0/218077075 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f206003e9c0 con 0x7f207009e000 2023-09-30T22:30:29.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.207+0000 7f2077df7700 1 -- 172.21.15.59:0/218077075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20701264c0 con 0x7f207009e000 2023-09-30T22:30:29.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.212+0000 7f20667fc700 1 -- 172.21.15.59:0/218077075 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2060011590 con 0x7f207009e000 2023-09-30T22:30:29.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.419+0000 7f2077df7700 1 -- 172.21.15.59:0/218077075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2070074ea0 con 0x7f207009e000 2023-09-30T22:30:29.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.420+0000 7f20667fc700 1 -- 172.21.15.59:0/218077075 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20600192c0 con 0x7f207009e000 2023-09-30T22:30:29.420 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:29.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.422+0000 7f2077df7700 1 -- 172.21.15.59:0/218077075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f207009e000 msgr2=0x7f2070122dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.422+0000 7f2077df7700 1 --2- 172.21.15.59:0/218077075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f207009e000 0x7f2070122dc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2060000f60 tx=0x7f206000c730 comp rx=0 tx=0).stop 2023-09-30T22:30:29.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.422+0000 7f2077df7700 1 -- 172.21.15.59:0/218077075 shutdown_connections 2023-09-30T22:30:29.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.422+0000 7f2077df7700 1 --2- 172.21.15.59:0/218077075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207009d6f0 0x7f2070122880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.422+0000 7f2077df7700 1 --2- 172.21.15.59:0/218077075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2070134100 0x7f2070123300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.422+0000 7f2077df7700 1 --2- 172.21.15.59:0/218077075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f207009e000 0x7f2070122dc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.422+0000 7f2077df7700 1 -- 172.21.15.59:0/218077075 >> 172.21.15.59:0/218077075 conn(0x7f2070066f50 msgr2=0x7f2070070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.422+0000 7f2077df7700 1 -- 172.21.15.59:0/218077075 shutdown_connections 2023-09-30T22:30:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.422+0000 7f2077df7700 1 -- 172.21.15.59:0/218077075 wait complete. 2023-09-30T22:30:29.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:29.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:29.695 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:29.735 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:29.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.808+0000 7f4a13446700 1 Processor -- start 2023-09-30T22:30:29.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.809+0000 7f4a13446700 1 -- start start 2023-09-30T22:30:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a13446700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a0c1338c0 0x7f4a0c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a13446700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a0c1341d0 0x7f4a0c09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a13446700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0c09e390 0x7f4a0c09e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a13446700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a0c070c80 con 0x7f4a0c1338c0 2023-09-30T22:30:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a13446700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c09ed20 con 0x7f4a0c1341d0 2023-09-30T22:30:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a13446700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c06f720 con 0x7f4a0c09e390 2023-09-30T22:30:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a111e2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a0c1338c0 0x7f4a0c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a109e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a0c1341d0 0x7f4a0c09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a111e2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a0c1338c0 0x7f4a0c133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50928/0 (socket says 172.21.15.59:50928) 2023-09-30T22:30:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a109e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a0c1341d0 0x7f4a0c09de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42770/0 (socket says 172.21.15.59:42770) 2023-09-30T22:30:29.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a111e2700 1 -- 172.21.15.59:0/3019064852 learned_addr learned my addr 172.21.15.59:0/3019064852 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:29.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a119e3700 1 --2- 172.21.15.59:0/3019064852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0c09e390 0x7f4a0c09e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a111e2700 1 -- 172.21.15.59:0/3019064852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0c09e390 msgr2=0x7f4a0c09e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:29.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a111e2700 1 --2- 172.21.15.59:0/3019064852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0c09e390 0x7f4a0c09e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a111e2700 1 -- 172.21.15.59:0/3019064852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a0c1341d0 msgr2=0x7f4a0c09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a111e2700 1 --2- 172.21.15.59:0/3019064852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a0c1341d0 0x7f4a0c09de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a111e2700 1 -- 172.21.15.59:0/3019064852 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0c06fce0 con 0x7f4a0c1338c0 2023-09-30T22:30:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a119e3700 1 --2- 172.21.15.59:0/3019064852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0c09e390 0x7f4a0c09e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.810+0000 7f4a109e1700 1 --2- 172.21.15.59:0/3019064852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a0c1341d0 0x7f4a0c09de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.811+0000 7f4a111e2700 1 --2- 172.21.15.59:0/3019064852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a0c1338c0 0x7f4a0c133c90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4a080098f0 tx=0x7f4a08009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd1217a98986d6d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.811+0000 7f4a03fff700 1 -- 172.21.15.59:0/3019064852 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a08011830 con 0x7f4a0c1338c0 2023-09-30T22:30:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.811+0000 7f4a03fff700 1 -- 172.21.15.59:0/3019064852 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a08011990 con 0x7f4a0c1338c0 2023-09-30T22:30:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.811+0000 7f4a03fff700 1 -- 172.21.15.59:0/3019064852 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a08011d20 con 0x7f4a0c1338c0 2023-09-30T22:30:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.811+0000 7f4a13446700 1 -- 172.21.15.59:0/3019064852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a0c1338c0 msgr2=0x7f4a0c133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.811+0000 7f4a13446700 1 --2- 172.21.15.59:0/3019064852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a0c1338c0 0x7f4a0c133c90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4a080098f0 tx=0x7f4a08009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.812+0000 7f4a13446700 1 -- 172.21.15.59:0/3019064852 shutdown_connections 2023-09-30T22:30:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.812+0000 7f4a13446700 1 --2- 172.21.15.59:0/3019064852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0c09e390 0x7f4a0c09e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.812+0000 7f4a13446700 1 --2- 172.21.15.59:0/3019064852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a0c1338c0 0x7f4a0c133c90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.812+0000 7f4a13446700 1 --2- 172.21.15.59:0/3019064852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a0c1341d0 0x7f4a0c09de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.812+0000 7f4a13446700 1 -- 172.21.15.59:0/3019064852 >> 172.21.15.59:0/3019064852 conn(0x7f4a0c0a2aa0 msgr2=0x7f4a0c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.812+0000 7f4a13446700 1 -- 172.21.15.59:0/3019064852 shutdown_connections 2023-09-30T22:30:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.812+0000 7f4a13446700 1 -- 172.21.15.59:0/3019064852 wait complete. 2023-09-30T22:30:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.813+0000 7f4a13446700 1 Processor -- start 2023-09-30T22:30:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.813+0000 7f4a13446700 1 -- start start 2023-09-30T22:30:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.813+0000 7f4a13446700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0c09e390 0x7f4a0c11eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.813+0000 7f4a13446700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a0c1341d0 0x7f4a0c11f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.813+0000 7f4a13446700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a0c11f5e0 0x7f4a0c1c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.813+0000 7f4a13446700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c122050 con 0x7f4a0c11f5e0 2023-09-30T22:30:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.813+0000 7f4a13446700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c12f660 con 0x7f4a0c1341d0 2023-09-30T22:30:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.813+0000 7f4a13446700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c130ce0 con 0x7f4a0c09e390 2023-09-30T22:30:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a109e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a0c1341d0 0x7f4a0c11f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a109e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a0c1341d0 0x7f4a0c11f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42784/0 (socket says 172.21.15.59:42784) 2023-09-30T22:30:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a119e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a0c11f5e0 0x7f4a0c1c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a109e1700 1 -- 172.21.15.59:0/4056769437 learned_addr learned my addr 172.21.15.59:0/4056769437 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a111e2700 1 --2- 172.21.15.59:0/4056769437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0c09e390 0x7f4a0c11eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a119e3700 1 -- 172.21.15.59:0/4056769437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0c09e390 msgr2=0x7f4a0c11eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a119e3700 1 --2- 172.21.15.59:0/4056769437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0c09e390 0x7f4a0c11eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a119e3700 1 -- 172.21.15.59:0/4056769437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a0c1341d0 msgr2=0x7f4a0c11f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a119e3700 1 --2- 172.21.15.59:0/4056769437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a0c1341d0 0x7f4a0c11f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a119e3700 1 -- 172.21.15.59:0/4056769437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a04009a70 con 0x7f4a0c11f5e0 2023-09-30T22:30:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a109e1700 1 --2- 172.21.15.59:0/4056769437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a0c1341d0 0x7f4a0c11f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a119e3700 1 --2- 172.21.15.59:0/4056769437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a0c11f5e0 0x7f4a0c1c8620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400efc0 tx=0x7f4a0400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a01ffb700 1 -- 172.21.15.59:0/4056769437 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0400ca90 con 0x7f4a0c11f5e0 2023-09-30T22:30:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a01ffb700 1 -- 172.21.15.59:0/4056769437 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0400f040 con 0x7f4a0c11f5e0 2023-09-30T22:30:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a13446700 1 -- 172.21.15.59:0/4056769437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49fc0094a0 con 0x7f4a0c11f5e0 2023-09-30T22:30:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.814+0000 7f4a01ffb700 1 -- 172.21.15.59:0/4056769437 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0400ce30 con 0x7f4a0c11f5e0 2023-09-30T22:30:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.815+0000 7f4a13446700 1 -- 172.21.15.59:0/4056769437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a08009550 con 0x7f4a0c11f5e0 2023-09-30T22:30:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.815+0000 7f4a01ffb700 1 -- 172.21.15.59:0/4056769437 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a04014480 con 0x7f4a0c11f5e0 2023-09-30T22:30:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.816+0000 7f4a01ffb700 1 -- 172.21.15.59:0/4056769437 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4a0403fc80 con 0x7f4a0c11f5e0 2023-09-30T22:30:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.816+0000 7f4a13446700 1 -- 172.21.15.59:0/4056769437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0c06f960 con 0x7f4a0c11f5e0 2023-09-30T22:30:29.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.821+0000 7f4a01ffb700 1 -- 172.21.15.59:0/4056769437 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a04012930 con 0x7f4a0c11f5e0 2023-09-30T22:30:29.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.851+0000 7fbb5d61e700 1 Processor -- start 2023-09-30T22:30:29.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.851+0000 7fbb5d61e700 1 -- start start 2023-09-30T22:30:29.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.852+0000 7fbb5d61e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb5809e1d0 0x7fbb58138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.852+0000 7fbb5d61e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb58139170 0x7fbb5813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.852+0000 7fbb5d61e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5809b120 con 0x7fbb5809d6f0 2023-09-30T22:30:29.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.852+0000 7fbb5d61e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5806b460 con 0x7fbb5809e1d0 2023-09-30T22:30:29.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.852+0000 7fbb5d61e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5809a7e0 con 0x7fbb58139170 2023-09-30T22:30:29.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.852+0000 7fbb567fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb5809e1d0 0x7fbb58138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.852+0000 7fbb56ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbb5809d6f0 0x7fbb5809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48462/0 (socket says 172.21.15.59:48462) 2023-09-30T22:30:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.852+0000 7fbb577fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb58139170 0x7fbb5813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.852+0000 7fbb56ffd700 1 -- 172.21.15.59:0/1139201776 learned_addr learned my addr 172.21.15.59:0/1139201776 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.853+0000 7fbb567fc700 1 -- 172.21.15.59:0/1139201776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb58139170 msgr2=0x7fbb5813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.853+0000 7fbb567fc700 1 --2- 172.21.15.59:0/1139201776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb58139170 0x7fbb5813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.853+0000 7fbb567fc700 1 -- 172.21.15.59:0/1139201776 >> v1:172.21.15.59:6789/0 conn(0x7fbb5809d6f0 legacy=0x7fbb5809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.853+0000 7fbb567fc700 1 -- 172.21.15.59:0/1139201776 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5809a500 con 0x7fbb5809e1d0 2023-09-30T22:30:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.853+0000 7fbb55ffb700 1 -- 172.21.15.59:0/1139201776 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130291353 0 0) 0x7fbb5809b120 con 0x7fbb5809d6f0 2023-09-30T22:30:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.853+0000 7fbb567fc700 1 --2- 172.21.15.59:0/1139201776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809e1d0 0x7fbb58138c30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009870 tx=0x7fbb4c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72dd9610980d5d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.853+0000 7fbb55ffb700 1 -- 172.21.15.59:0/1139201776 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c011830 con 0x7fbb5809e1d0 2023-09-30T22:30:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.853+0000 7fbb55ffb700 1 -- 172.21.15.59:0/1139201776 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c011990 con 0x7fbb5809e1d0 2023-09-30T22:30:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.853+0000 7fbb55ffb700 1 -- 172.21.15.59:0/1139201776 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c011d20 con 0x7fbb5809e1d0 2023-09-30T22:30:29.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.854+0000 7fbb5d61e700 1 -- 172.21.15.59:0/1139201776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809e1d0 msgr2=0x7fbb58138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.854+0000 7fbb5d61e700 1 --2- 172.21.15.59:0/1139201776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809e1d0 0x7fbb58138c30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009870 tx=0x7fbb4c009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:29.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.854+0000 7fbb5d61e700 1 -- 172.21.15.59:0/1139201776 shutdown_connections 2023-09-30T22:30:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.854+0000 7fbb5d61e700 1 --2- 172.21.15.59:0/1139201776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb58139170 0x7fbb5813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.854+0000 7fbb5d61e700 1 --2- 172.21.15.59:0/1139201776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809e1d0 0x7fbb58138c30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.854+0000 7fbb5d61e700 1 -- 172.21.15.59:0/1139201776 >> 172.21.15.59:0/1139201776 conn(0x7fbb58066f50 msgr2=0x7fbb5809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.854+0000 7fbb5d61e700 1 -- 172.21.15.59:0/1139201776 shutdown_connections 2023-09-30T22:30:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.854+0000 7fbb5d61e700 1 -- 172.21.15.59:0/1139201776 wait complete. 2023-09-30T22:30:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.855+0000 7fbb5d61e700 1 Processor -- start 2023-09-30T22:30:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.855+0000 7fbb5d61e700 1 -- start start 2023-09-30T22:30:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb5d61e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809d6f0 0x7fbb58120820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb5d61e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809e1d0 0x7fbb58120d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb5d61e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb58139170 0x7fbb581212a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb5d61e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5809c710 con 0x7fbb5809d6f0 2023-09-30T22:30:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb5d61e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58123d10 con 0x7fbb58139170 2023-09-30T22:30:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb5d61e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb581224b0 con 0x7fbb5809e1d0 2023-09-30T22:30:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb56ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809d6f0 0x7fbb58120820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb56ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809d6f0 0x7fbb58120820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50942/0 (socket says 172.21.15.59:50942) 2023-09-30T22:30:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb56ffd700 1 -- 172.21.15.59:0/3673049193 learned_addr learned my addr 172.21.15.59:0/3673049193 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb577fe700 1 --2- 172.21.15.59:0/3673049193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb58139170 0x7fbb581212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb56ffd700 1 -- 172.21.15.59:0/3673049193 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809e1d0 msgr2=0x7fbb58120d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb56ffd700 1 --2- 172.21.15.59:0/3673049193 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809e1d0 0x7fbb58120d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb56ffd700 1 -- 172.21.15.59:0/3673049193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb58139170 msgr2=0x7fbb581212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb56ffd700 1 --2- 172.21.15.59:0/3673049193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb58139170 0x7fbb581212a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb56ffd700 1 -- 172.21.15.59:0/3673049193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c0094a0 con 0x7fbb5809d6f0 2023-09-30T22:30:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb56ffd700 1 --2- 172.21.15.59:0/3673049193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809d6f0 0x7fbb58120820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800c550 tx=0x7fbb4800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.856+0000 7fbb3f7fe700 1 -- 172.21.15.59:0/3673049193 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48004c80 con 0x7fbb5809d6f0 2023-09-30T22:30:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.857+0000 7fbb3f7fe700 1 -- 172.21.15.59:0/3673049193 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb48004e00 con 0x7fbb5809d6f0 2023-09-30T22:30:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.857+0000 7fbb5d61e700 1 -- 172.21.15.59:0/3673049193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb58136660 con 0x7fbb5809d6f0 2023-09-30T22:30:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.857+0000 7fbb3f7fe700 1 -- 172.21.15.59:0/3673049193 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48007310 con 0x7fbb5809d6f0 2023-09-30T22:30:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.857+0000 7fbb5d61e700 1 -- 172.21.15.59:0/3673049193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb58124a40 con 0x7fbb5809d6f0 2023-09-30T22:30:29.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.858+0000 7fbb5d61e700 1 -- 172.21.15.59:0/3673049193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5809c530 con 0x7fbb5809d6f0 2023-09-30T22:30:29.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.858+0000 7fbb3f7fe700 1 -- 172.21.15.59:0/3673049193 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb48007470 con 0x7fbb5809d6f0 2023-09-30T22:30:29.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.858+0000 7fbb3f7fe700 1 -- 172.21.15.59:0/3673049193 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbb4803f320 con 0x7fbb5809d6f0 2023-09-30T22:30:29.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.867+0000 7fbb3f7fe700 1 -- 172.21.15.59:0/3673049193 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb480133c0 con 0x7fbb5809d6f0 2023-09-30T22:30:29.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.881+0000 7f4bb2954700 1 Processor -- start 2023-09-30T22:30:29.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.881+0000 7f4bb2954700 1 -- start start 2023-09-30T22:30:29.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.882+0000 7f4bb2954700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac09c650 0x7f4bac09ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.882+0000 7f4bb2954700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac0a0090 0x7f4bac09cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.882+0000 7f4bb2954700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bac09ba70 con 0x7f4bac131970 2023-09-30T22:30:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.882+0000 7f4bb2954700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac09d4a0 con 0x7f4bac0a0090 2023-09-30T22:30:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.882+0000 7f4bb2954700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac09e8f0 con 0x7f4bac09c650 2023-09-30T22:30:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.882+0000 7f4bab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac0a0090 0x7f4bac09cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.882+0000 7f4bb0ef1700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4bac131970 0x7f4bac131e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48472/0 (socket says 172.21.15.59:48472) 2023-09-30T22:30:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.882+0000 7f4babfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac09c650 0x7f4bac09ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.882+0000 7f4bb0ef1700 1 -- 172.21.15.59:0/4210914655 learned_addr learned my addr 172.21.15.59:0/4210914655 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.882+0000 7f4bab7fe700 1 --2- 172.21.15.59:0/4210914655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac0a0090 0x7f4bac09cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42814/0 (socket says 172.21.15.59:42814) 2023-09-30T22:30:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.882+0000 7f4bab7fe700 1 -- 172.21.15.59:0/4210914655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac09c650 msgr2=0x7f4bac09ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.882+0000 7f4bab7fe700 1 --2- 172.21.15.59:0/4210914655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac09c650 0x7f4bac09ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.882+0000 7f4bab7fe700 1 -- 172.21.15.59:0/4210914655 >> v1:172.21.15.59:6789/0 conn(0x7f4bac131970 legacy=0x7f4bac131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.882+0000 7f4bab7fe700 1 -- 172.21.15.59:0/4210914655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0a0760 con 0x7f4bac0a0090 2023-09-30T22:30:29.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.883+0000 7f4bab7fe700 1 --2- 172.21.15.59:0/4210914655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac0a0090 0x7f4bac09cf60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00098a0 tx=0x7f4ba0009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=465190ae909e6cab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.883+0000 7f4baaffd700 1 -- 172.21.15.59:0/4210914655 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0011830 con 0x7f4bac0a0090 2023-09-30T22:30:29.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.883+0000 7f4baaffd700 1 -- 172.21.15.59:0/4210914655 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba0011990 con 0x7f4bac0a0090 2023-09-30T22:30:29.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.883+0000 7f4baaffd700 1 -- 172.21.15.59:0/4210914655 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0011d40 con 0x7f4bac0a0090 2023-09-30T22:30:29.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.884+0000 7f4bb2954700 1 -- 172.21.15.59:0/4210914655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac0a0090 msgr2=0x7f4bac09cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.884+0000 7f4bb2954700 1 --2- 172.21.15.59:0/4210914655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac0a0090 0x7f4bac09cf60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00098a0 tx=0x7f4ba0009bb0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.884+0000 7f4bb2954700 1 -- 172.21.15.59:0/4210914655 shutdown_connections 2023-09-30T22:30:29.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.884+0000 7f4bb2954700 1 --2- 172.21.15.59:0/4210914655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac09c650 0x7f4bac09ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.884+0000 7f4bb2954700 1 --2- 172.21.15.59:0/4210914655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac0a0090 0x7f4bac09cf60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.884+0000 7f4bb2954700 1 -- 172.21.15.59:0/4210914655 >> 172.21.15.59:0/4210914655 conn(0x7f4bac0a3f70 msgr2=0x7f4bac0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:29.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.884+0000 7f4bb2954700 1 -- 172.21.15.59:0/4210914655 shutdown_connections 2023-09-30T22:30:29.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.884+0000 7f4bb2954700 1 -- 172.21.15.59:0/4210914655 wait complete. 2023-09-30T22:30:29.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.885+0000 7f4bb2954700 1 Processor -- start 2023-09-30T22:30:29.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.885+0000 7f4bb2954700 1 -- start start 2023-09-30T22:30:29.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4bb2954700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac09c650 0x7f4bac071160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4bb2954700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac0a0090 0x7f4bac0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4bb2954700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac131970 0x7f4bac071be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4bb2954700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac06d0f0 con 0x7f4bac09c650 2023-09-30T22:30:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4bb2954700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac06d730 con 0x7f4bac131970 2023-09-30T22:30:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4bb2954700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac09d980 con 0x7f4bac0a0090 2023-09-30T22:30:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4bab7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac0a0090 0x7f4bac0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4bab7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac0a0090 0x7f4bac0716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40134/0 (socket says 172.21.15.59:40134) 2023-09-30T22:30:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4bab7fe700 1 -- 172.21.15.59:0/677324169 learned_addr learned my addr 172.21.15.59:0/677324169 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4babfff700 1 --2- 172.21.15.59:0/677324169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac09c650 0x7f4bac071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4bb0ef1700 1 --2- 172.21.15.59:0/677324169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac131970 0x7f4bac071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4babfff700 1 -- 172.21.15.59:0/677324169 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac0a0090 msgr2=0x7f4bac0716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4babfff700 1 --2- 172.21.15.59:0/677324169 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac0a0090 0x7f4bac0716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4babfff700 1 -- 172.21.15.59:0/677324169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac131970 msgr2=0x7f4bac071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4babfff700 1 --2- 172.21.15.59:0/677324169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac131970 0x7f4bac071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4babfff700 1 -- 172.21.15.59:0/677324169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba00094a0 con 0x7f4bac09c650 2023-09-30T22:30:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4bab7fe700 1 --2- 172.21.15.59:0/677324169 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac0a0090 0x7f4bac0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.886+0000 7f4bb0ef1700 1 --2- 172.21.15.59:0/677324169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac131970 0x7f4bac071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.887+0000 7f4babfff700 1 --2- 172.21.15.59:0/677324169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac09c650 0x7f4bac071160 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00e7e0 tx=0x7f4b9c00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.887+0000 7f4ba8ff9700 1 -- 172.21.15.59:0/677324169 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00c070 con 0x7f4bac09c650 2023-09-30T22:30:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.887+0000 7f4ba8ff9700 1 -- 172.21.15.59:0/677324169 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c013610 con 0x7f4bac09c650 2023-09-30T22:30:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.887+0000 7f4bb2954700 1 -- 172.21.15.59:0/677324169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac130110 con 0x7f4bac09c650 2023-09-30T22:30:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.887+0000 7f4ba8ff9700 1 -- 172.21.15.59:0/677324169 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0139a0 con 0x7f4bac09c650 2023-09-30T22:30:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.887+0000 7f4bb2954700 1 -- 172.21.15.59:0/677324169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac12c4a0 con 0x7f4bac09c650 2023-09-30T22:30:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.888+0000 7f4ba8ff9700 1 -- 172.21.15.59:0/677324169 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b9c013b00 con 0x7f4bac09c650 2023-09-30T22:30:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.888+0000 7f4ba8ff9700 1 -- 172.21.15.59:0/677324169 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4b9c03f310 con 0x7f4bac09c650 2023-09-30T22:30:29.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.888+0000 7f4bb2954700 1 -- 172.21.15.59:0/677324169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac0747f0 con 0x7f4bac09c650 2023-09-30T22:30:29.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:29.893+0000 7f4ba8ff9700 1 -- 172.21.15.59:0/677324169 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b9c0108e0 con 0x7f4bac09c650 2023-09-30T22:30:30.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.035+0000 7f4a13446700 1 -- 172.21.15.59:0/4056769437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4a0c074ea0 con 0x7f4a0c11f5e0 2023-09-30T22:30:30.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.035+0000 7f4a01ffb700 1 -- 172.21.15.59:0/4056769437 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4a04012340 con 0x7f4a0c11f5e0 2023-09-30T22:30:30.036 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:30.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.038+0000 7f4a13446700 1 -- 172.21.15.59:0/4056769437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a0c11f5e0 msgr2=0x7f4a0c1c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.038+0000 7f4a13446700 1 --2- 172.21.15.59:0/4056769437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a0c11f5e0 0x7f4a0c1c8620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400efc0 tx=0x7f4a0400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.038+0000 7f4a13446700 1 -- 172.21.15.59:0/4056769437 shutdown_connections 2023-09-30T22:30:30.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.038+0000 7f4a13446700 1 --2- 172.21.15.59:0/4056769437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0c09e390 0x7f4a0c11eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.038+0000 7f4a13446700 1 --2- 172.21.15.59:0/4056769437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a0c11f5e0 0x7f4a0c1c8620 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.038+0000 7f4a13446700 1 --2- 172.21.15.59:0/4056769437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a0c1341d0 0x7f4a0c11f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.038+0000 7f4a13446700 1 -- 172.21.15.59:0/4056769437 >> 172.21.15.59:0/4056769437 conn(0x7f4a0c0a2aa0 msgr2=0x7f4a0c09f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:30.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.038+0000 7f4a13446700 1 -- 172.21.15.59:0/4056769437 shutdown_connections 2023-09-30T22:30:30.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.038+0000 7f4a13446700 1 -- 172.21.15.59:0/4056769437 wait complete. 2023-09-30T22:30:30.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:30.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.076+0000 7fbb5d61e700 1 -- 172.21.15.59:0/3673049193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbb5809f420 con 0x7fbb5809d6f0 2023-09-30T22:30:30.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.077+0000 7fbb3f7fe700 1 -- 172.21.15.59:0/3673049193 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb48011360 con 0x7fbb5809d6f0 2023-09-30T22:30:30.077 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:30.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.080+0000 7fbb5d61e700 1 -- 172.21.15.59:0/3673049193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809d6f0 msgr2=0x7fbb58120820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.080+0000 7fbb5d61e700 1 --2- 172.21.15.59:0/3673049193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809d6f0 0x7fbb58120820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800c550 tx=0x7fbb4800c860 comp rx=0 tx=0).stop 2023-09-30T22:30:30.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.080+0000 7fbb5d61e700 1 -- 172.21.15.59:0/3673049193 shutdown_connections 2023-09-30T22:30:30.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.080+0000 7fbb5d61e700 1 --2- 172.21.15.59:0/3673049193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb58139170 0x7fbb581212a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.080+0000 7fbb5d61e700 1 --2- 172.21.15.59:0/3673049193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809d6f0 0x7fbb58120820 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.080+0000 7fbb5d61e700 1 --2- 172.21.15.59:0/3673049193 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809e1d0 0x7fbb58120d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.080+0000 7fbb5d61e700 1 -- 172.21.15.59:0/3673049193 >> 172.21.15.59:0/3673049193 conn(0x7fbb58066f50 msgr2=0x7fbb58136b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:30.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.080+0000 7fbb5d61e700 1 -- 172.21.15.59:0/3673049193 shutdown_connections 2023-09-30T22:30:30.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.080+0000 7fbb5d61e700 1 -- 172.21.15.59:0/3673049193 wait complete. 2023-09-30T22:30:30.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:30.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.109+0000 7f4bb2954700 1 -- 172.21.15.59:0/677324169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4bac072840 con 0x7f4bac09c650 2023-09-30T22:30:30.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.110+0000 7f4ba8ff9700 1 -- 172.21.15.59:0/677324169 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b9c02b090 con 0x7f4bac09c650 2023-09-30T22:30:30.110 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:30.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.112+0000 7f4bb2954700 1 -- 172.21.15.59:0/677324169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac09c650 msgr2=0x7f4bac071160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.112+0000 7f4bb2954700 1 --2- 172.21.15.59:0/677324169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac09c650 0x7f4bac071160 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00e7e0 tx=0x7f4b9c00eaf0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.112+0000 7f4bb2954700 1 -- 172.21.15.59:0/677324169 shutdown_connections 2023-09-30T22:30:30.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.112+0000 7f4bb2954700 1 --2- 172.21.15.59:0/677324169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac131970 0x7f4bac071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.112+0000 7f4bb2954700 1 --2- 172.21.15.59:0/677324169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac09c650 0x7f4bac071160 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.112+0000 7f4bb2954700 1 --2- 172.21.15.59:0/677324169 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac0a0090 0x7f4bac0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.112+0000 7f4bb2954700 1 -- 172.21.15.59:0/677324169 >> 172.21.15.59:0/677324169 conn(0x7f4bac0a3f70 msgr2=0x7f4bac12f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.112+0000 7f4bb2954700 1 -- 172.21.15.59:0/677324169 shutdown_connections 2023-09-30T22:30:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.112+0000 7f4bb2954700 1 -- 172.21.15.59:0/677324169 wait complete. 2023-09-30T22:30:30.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:30.436 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:30.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.583+0000 7f5f0e4a0700 1 Processor -- start 2023-09-30T22:30:30.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.583+0000 7f5f0e4a0700 1 -- start start 2023-09-30T22:30:30.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.584+0000 7f5f0e4a0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5f08130540 0x7f5f08130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.584+0000 7f5f0e4a0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f08130e50 0x7f5f0806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.584+0000 7f5f0e4a0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f080716a0 con 0x7f5f0806fb20 2023-09-30T22:30:30.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.584+0000 7f5f0e4a0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0809a390 con 0x7f5f08130540 2023-09-30T22:30:30.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.584+0000 7f5f0e4a0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f08071290 con 0x7f5f08130e50 2023-09-30T22:30:30.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.584+0000 7f5f07fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5f08130540 0x7f5f08130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.584+0000 7f5f07fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5f08130540 0x7f5f08130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50956/0 (socket says 172.21.15.59:50956) 2023-09-30T22:30:30.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.584+0000 7f5f077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f08130e50 0x7f5f0806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.584+0000 7f5f07fff700 1 -- 172.21.15.59:0/2277272923 learned_addr learned my addr 172.21.15.59:0/2277272923 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:30.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.584+0000 7f5f077fe700 1 -- 172.21.15.59:0/2277272923 >> v2:172.21.15.59:3300/0 conn(0x7f5f08130540 msgr2=0x7f5f08130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:30.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.584+0000 7f5f077fe700 1 --2- 172.21.15.59:0/2277272923 >> v2:172.21.15.59:3300/0 conn(0x7f5f08130540 0x7f5f08130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.584+0000 7f5f077fe700 1 -- 172.21.15.59:0/2277272923 >> v1:172.21.15.59:6789/0 conn(0x7f5f0806fb20 legacy=0x7f5f08137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.584+0000 7f5f077fe700 1 -- 172.21.15.59:0/2277272923 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f08130340 con 0x7f5f08130e50 2023-09-30T22:30:30.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.584+0000 7f5f07fff700 1 --2- 172.21.15.59:0/2277272923 >> v2:172.21.15.59:3300/0 conn(0x7f5f08130540 0x7f5f08130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:30.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.585+0000 7f5f077fe700 1 --2- 172.21.15.59:0/2277272923 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f08130e50 0x7f5f0806f5e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009870 tx=0x7f5ef0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35a8bc18db07e491 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:30.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.585+0000 7f5f06ffd700 1 -- 172.21.15.59:0/2277272923 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0011830 con 0x7f5f08130e50 2023-09-30T22:30:30.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.585+0000 7f5f06ffd700 1 -- 172.21.15.59:0/2277272923 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef0011990 con 0x7f5f08130e50 2023-09-30T22:30:30.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.585+0000 7f5f06ffd700 1 -- 172.21.15.59:0/2277272923 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0011d20 con 0x7f5f08130e50 2023-09-30T22:30:30.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.585+0000 7f5f0e4a0700 1 -- 172.21.15.59:0/2277272923 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f08130e50 msgr2=0x7f5f0806f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.585+0000 7f5f0e4a0700 1 --2- 172.21.15.59:0/2277272923 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f08130e50 0x7f5f0806f5e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009870 tx=0x7f5ef0009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:30.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.585+0000 7f5f0e4a0700 1 -- 172.21.15.59:0/2277272923 shutdown_connections 2023-09-30T22:30:30.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.585+0000 7f5f0e4a0700 1 --2- 172.21.15.59:0/2277272923 >> v2:172.21.15.59:3300/0 conn(0x7f5f08130540 0x7f5f08130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.585+0000 7f5f0e4a0700 1 --2- 172.21.15.59:0/2277272923 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f08130e50 0x7f5f0806f5e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.585+0000 7f5f0e4a0700 1 -- 172.21.15.59:0/2277272923 >> 172.21.15.59:0/2277272923 conn(0x7f5f080a2aa0 msgr2=0x7f5f080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:30.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.586+0000 7f5f0e4a0700 1 -- 172.21.15.59:0/2277272923 shutdown_connections 2023-09-30T22:30:30.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.586+0000 7f5f0e4a0700 1 -- 172.21.15.59:0/2277272923 wait complete. 2023-09-30T22:30:30.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.586+0000 7f5f0e4a0700 1 Processor -- start 2023-09-30T22:30:30.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.587+0000 7f5f0e4a0700 1 -- start start 2023-09-30T22:30:30.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.587+0000 7f5f0e4a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f0806fb20 0x7f5f0811b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.587+0000 7f5f0e4a0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f08130540 0x7f5f0811bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.587+0000 7f5f0e4a0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f08130e50 0x7f5f0811c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.587+0000 7f5f0e4a0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0811e5b0 con 0x7f5f08130540 2023-09-30T22:30:30.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.587+0000 7f5f0e4a0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0811f000 con 0x7f5f0806fb20 2023-09-30T22:30:30.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.587+0000 7f5f0e4a0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0811e0f0 con 0x7f5f08130e50 2023-09-30T22:30:30.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.587+0000 7f5f07fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f0806fb20 0x7f5f0811b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.587+0000 7f5f0ca3d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f08130e50 0x7f5f0811c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.587+0000 7f5f077fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f08130540 0x7f5f0811bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.587+0000 7f5f07fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f0806fb20 0x7f5f0811b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42844/0 (socket says 172.21.15.59:42844) 2023-09-30T22:30:30.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.587+0000 7f5f0ca3d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f08130e50 0x7f5f0811c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40156/0 (socket says 172.21.15.59:40156) 2023-09-30T22:30:30.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.587+0000 7f5f077fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f08130540 0x7f5f0811bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50964/0 (socket says 172.21.15.59:50964) 2023-09-30T22:30:30.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.587+0000 7f5f07fff700 1 -- 172.21.15.59:0/3098011728 learned_addr learned my addr 172.21.15.59:0/3098011728 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:30.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.588+0000 7f5f07fff700 1 -- 172.21.15.59:0/3098011728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f08130e50 msgr2=0x7f5f0811c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.588+0000 7f5f07fff700 1 --2- 172.21.15.59:0/3098011728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f08130e50 0x7f5f0811c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.588+0000 7f5f07fff700 1 -- 172.21.15.59:0/3098011728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f08130540 msgr2=0x7f5f0811bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.588+0000 7f5f07fff700 1 --2- 172.21.15.59:0/3098011728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f08130540 0x7f5f0811bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.588+0000 7f5f07fff700 1 -- 172.21.15.59:0/3098011728 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef8009550 con 0x7f5f0806fb20 2023-09-30T22:30:30.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.588+0000 7f5f0ca3d700 1 --2- 172.21.15.59:0/3098011728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f08130e50 0x7f5f0811c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:30.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.588+0000 7f5f07fff700 1 --2- 172.21.15.59:0/3098011728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f0806fb20 0x7f5f0811b6e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800ec10 tx=0x7f5ef800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:30.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.588+0000 7f5f04ff9700 1 -- 172.21.15.59:0/3098011728 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800c850 con 0x7f5f0806fb20 2023-09-30T22:30:30.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.588+0000 7f5f04ff9700 1 -- 172.21.15.59:0/3098011728 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef800c9b0 con 0x7f5f0806fb20 2023-09-30T22:30:30.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.588+0000 7f5f0e4a0700 1 -- 172.21.15.59:0/3098011728 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef00094a0 con 0x7f5f0806fb20 2023-09-30T22:30:30.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.588+0000 7f5f04ff9700 1 -- 172.21.15.59:0/3098011728 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800cd40 con 0x7f5f0806fb20 2023-09-30T22:30:30.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.588+0000 7f5f0e4a0700 1 -- 172.21.15.59:0/3098011728 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f080718e0 con 0x7f5f0806fb20 2023-09-30T22:30:30.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.589+0000 7f5f04ff9700 1 -- 172.21.15.59:0/3098011728 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ef8013470 con 0x7f5f0806fb20 2023-09-30T22:30:30.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.589+0000 7f5f0e4a0700 1 -- 172.21.15.59:0/3098011728 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f08074ea0 con 0x7f5f0806fb20 2023-09-30T22:30:30.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.589+0000 7f5f04ff9700 1 -- 172.21.15.59:0/3098011728 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5ef803f9c0 con 0x7f5f0806fb20 2023-09-30T22:30:30.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.594+0000 7f5f04ff9700 1 -- 172.21.15.59:0/3098011728 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ef8013aa0 con 0x7f5f0806fb20 2023-09-30T22:30:30.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.797+0000 7f5f0e4a0700 1 -- 172.21.15.59:0/3098011728 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5f0811f140 con 0x7f5f0806fb20 2023-09-30T22:30:30.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.797+0000 7f5f04ff9700 1 -- 172.21.15.59:0/3098011728 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f0811f140 con 0x7f5f0806fb20 2023-09-30T22:30:30.798 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:30.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.799+0000 7f5f0e4a0700 1 -- 172.21.15.59:0/3098011728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f0806fb20 msgr2=0x7f5f0811b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.799+0000 7f5f0e4a0700 1 --2- 172.21.15.59:0/3098011728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f0806fb20 0x7f5f0811b6e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800ec10 tx=0x7f5ef800ef20 comp rx=0 tx=0).stop 2023-09-30T22:30:30.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.800+0000 7f5f0e4a0700 1 -- 172.21.15.59:0/3098011728 shutdown_connections 2023-09-30T22:30:30.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.800+0000 7f5f0e4a0700 1 --2- 172.21.15.59:0/3098011728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f08130e50 0x7f5f0811c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.800+0000 7f5f0e4a0700 1 --2- 172.21.15.59:0/3098011728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f0806fb20 0x7f5f0811b6e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.800+0000 7f5f0e4a0700 1 --2- 172.21.15.59:0/3098011728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f08130540 0x7f5f0811bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.800+0000 7f5f0e4a0700 1 -- 172.21.15.59:0/3098011728 >> 172.21.15.59:0/3098011728 conn(0x7f5f080a2aa0 msgr2=0x7f5f0809dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:30.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.800+0000 7f5f0e4a0700 1 -- 172.21.15.59:0/3098011728 shutdown_connections 2023-09-30T22:30:30.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:30.800+0000 7f5f0e4a0700 1 -- 172.21.15.59:0/3098011728 wait complete. 2023-09-30T22:30:30.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:31.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:31.099 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:31.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:31.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.202+0000 7efc25943700 1 Processor -- start 2023-09-30T22:30:31.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.202+0000 7efc25943700 1 -- start start 2023-09-30T22:30:31.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.202+0000 7efc25943700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc2006b250 0x7efc20136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.202+0000 7efc25943700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc20136d80 0x7efc20139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.202+0000 7efc25943700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2009ece0 con 0x7efc2006a770 2023-09-30T22:30:31.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.202+0000 7efc25943700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2006b640 con 0x7efc20136d80 2023-09-30T22:30:31.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.202+0000 7efc25943700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc2009e760 con 0x7efc2006b250 2023-09-30T22:30:31.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.202+0000 7efc1effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efc2006a770 0x7efc2006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48494/0 (socket says 172.21.15.59:48494) 2023-09-30T22:30:31.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.202+0000 7efc1effd700 1 -- 172.21.15.59:0/3505979427 learned_addr learned my addr 172.21.15.59:0/3505979427 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:31.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.202+0000 7efc1f7fe700 1 --2- 172.21.15.59:0/3505979427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc20136d80 0x7efc20139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.202+0000 7efc1e7fc700 1 --2- 172.21.15.59:0/3505979427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc2006b250 0x7efc20136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.203+0000 7efc1dffb700 1 -- 172.21.15.59:0/3505979427 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372124812 0 0) 0x7efc2009ece0 con 0x7efc2006a770 2023-09-30T22:30:31.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.203+0000 7efc1dffb700 1 -- 172.21.15.59:0/3505979427 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc080035b0 con 0x7efc2006a770 2023-09-30T22:30:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.203+0000 7efc1f7fe700 1 -- 172.21.15.59:0/3505979427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc2006b250 msgr2=0x7efc20136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.203+0000 7efc1f7fe700 1 --2- 172.21.15.59:0/3505979427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc2006b250 0x7efc20136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.203+0000 7efc1f7fe700 1 -- 172.21.15.59:0/3505979427 >> v1:172.21.15.59:6789/0 conn(0x7efc2006a770 legacy=0x7efc2006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.203+0000 7efc1f7fe700 1 -- 172.21.15.59:0/3505979427 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2009e040 con 0x7efc20136d80 2023-09-30T22:30:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.203+0000 7efc1e7fc700 1 --2- 172.21.15.59:0/3505979427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc2006b250 0x7efc20136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.203+0000 7efc1f7fe700 1 --2- 172.21.15.59:0/3505979427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc20136d80 0x7efc20139160 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efc18009dc0 tx=0x7efc1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61442ea10193898e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.203+0000 7efc1dffb700 1 -- 172.21.15.59:0/3505979427 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1800e070 con 0x7efc20136d80 2023-09-30T22:30:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.203+0000 7efc1dffb700 1 -- 172.21.15.59:0/3505979427 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1800bb20 con 0x7efc20136d80 2023-09-30T22:30:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.203+0000 7efc1dffb700 1 -- 172.21.15.59:0/3505979427 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18012430 con 0x7efc20136d80 2023-09-30T22:30:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.204+0000 7efc25943700 1 -- 172.21.15.59:0/3505979427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc20136d80 msgr2=0x7efc20139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.204+0000 7efc25943700 1 --2- 172.21.15.59:0/3505979427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc20136d80 0x7efc20139160 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efc18009dc0 tx=0x7efc1800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.204+0000 7efc25943700 1 -- 172.21.15.59:0/3505979427 shutdown_connections 2023-09-30T22:30:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.204+0000 7efc25943700 1 --2- 172.21.15.59:0/3505979427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc20136d80 0x7efc20139160 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.204+0000 7efc25943700 1 --2- 172.21.15.59:0/3505979427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc2006b250 0x7efc20136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.204+0000 7efc25943700 1 -- 172.21.15.59:0/3505979427 >> 172.21.15.59:0/3505979427 conn(0x7efc20066f50 msgr2=0x7efc2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.204+0000 7efc25943700 1 -- 172.21.15.59:0/3505979427 shutdown_connections 2023-09-30T22:30:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.204+0000 7efc25943700 1 -- 172.21.15.59:0/3505979427 wait complete. 2023-09-30T22:30:31.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.205+0000 7efc25943700 1 Processor -- start 2023-09-30T22:30:31.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.206+0000 7efc25943700 1 -- start start 2023-09-30T22:30:31.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.206+0000 7efc25943700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc2006a770 0x7efc201c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.206+0000 7efc25943700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2006b250 0x7efc201c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.206+0000 7efc25943700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc20136d80 0x7efc2011f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.206+0000 7efc25943700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc20122ac0 con 0x7efc2006b250 2023-09-30T22:30:31.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.206+0000 7efc25943700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2006edb0 con 0x7efc20136d80 2023-09-30T22:30:31.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.206+0000 7efc25943700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc201bbf00 con 0x7efc2006a770 2023-09-30T22:30:31.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.206+0000 7efc1e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2006b250 0x7efc201c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.206+0000 7efc1effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc2006a770 0x7efc201c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.206+0000 7efc1e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2006b250 0x7efc201c6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50974/0 (socket says 172.21.15.59:50974) 2023-09-30T22:30:31.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.206+0000 7efc1effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc2006a770 0x7efc201c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40170/0 (socket says 172.21.15.59:40170) 2023-09-30T22:30:31.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.206+0000 7efc1e7fc700 1 -- 172.21.15.59:0/3469519804 learned_addr learned my addr 172.21.15.59:0/3469519804 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:31.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.206+0000 7efc1f7fe700 1 --2- 172.21.15.59:0/3469519804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc20136d80 0x7efc2011f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.207+0000 7efc1e7fc700 1 -- 172.21.15.59:0/3469519804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc2006a770 msgr2=0x7efc201c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.207+0000 7efc1e7fc700 1 --2- 172.21.15.59:0/3469519804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc2006a770 0x7efc201c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.207+0000 7efc1e7fc700 1 -- 172.21.15.59:0/3469519804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc20136d80 msgr2=0x7efc2011f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.207+0000 7efc1e7fc700 1 --2- 172.21.15.59:0/3469519804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc20136d80 0x7efc2011f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.207+0000 7efc1e7fc700 1 -- 172.21.15.59:0/3469519804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc140094a0 con 0x7efc2006b250 2023-09-30T22:30:31.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.207+0000 7efc1effd700 1 --2- 172.21.15.59:0/3469519804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc2006a770 0x7efc201c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:31.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.207+0000 7efc1f7fe700 1 --2- 172.21.15.59:0/3469519804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc20136d80 0x7efc2011f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:31.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.207+0000 7efc1e7fc700 1 --2- 172.21.15.59:0/3469519804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2006b250 0x7efc201c6720 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efc14010ef0 tx=0x7efc1400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:31.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.207+0000 7efc07fff700 1 -- 172.21.15.59:0/3469519804 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc14015070 con 0x7efc2006b250 2023-09-30T22:30:31.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.207+0000 7efc07fff700 1 -- 172.21.15.59:0/3469519804 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1400bb90 con 0x7efc2006b250 2023-09-30T22:30:31.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.207+0000 7efc25943700 1 -- 172.21.15.59:0/3469519804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc18009a70 con 0x7efc2006b250 2023-09-30T22:30:31.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.207+0000 7efc07fff700 1 -- 172.21.15.59:0/3469519804 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc14019410 con 0x7efc2006b250 2023-09-30T22:30:31.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.207+0000 7efc25943700 1 -- 172.21.15.59:0/3469519804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc201237f0 con 0x7efc2006b250 2023-09-30T22:30:31.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.208+0000 7efc07fff700 1 -- 172.21.15.59:0/3469519804 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc14019570 con 0x7efc2006b250 2023-09-30T22:30:31.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.208+0000 7efc25943700 1 -- 172.21.15.59:0/3469519804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc20074ea0 con 0x7efc2006b250 2023-09-30T22:30:31.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.208+0000 7efc07fff700 1 -- 172.21.15.59:0/3469519804 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efc14043040 con 0x7efc2006b250 2023-09-30T22:30:31.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.213+0000 7efc07fff700 1 -- 172.21.15.59:0/3469519804 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc140208b0 con 0x7efc2006b250 2023-09-30T22:30:31.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.244+0000 7f3f382e0700 1 Processor -- start 2023-09-30T22:30:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.244+0000 7f3f382e0700 1 -- start start 2023-09-30T22:30:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.245+0000 7f3f382e0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f3009d6f0 0x7f3f3009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.245+0000 7f3f382e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009e410 0x7f3f30130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.245+0000 7f3f382e0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f3009f130 con 0x7f3f3009e000 2023-09-30T22:30:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.245+0000 7f3f382e0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3009f520 con 0x7f3f3009d6f0 2023-09-30T22:30:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.245+0000 7f3f382e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3009e930 con 0x7f3f3009e410 2023-09-30T22:30:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.245+0000 7f3f3687d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009e410 0x7f3f30130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.245+0000 7f3f3607c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f3009d6f0 0x7f3f3009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.245+0000 7f3f3607c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f3009d6f0 0x7f3f3009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50984/0 (socket says 172.21.15.59:50984) 2023-09-30T22:30:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.245+0000 7f3f3687d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009e410 0x7f3f30130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42866/0 (socket says 172.21.15.59:42866) 2023-09-30T22:30:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.245+0000 7f3f3607c700 1 -- 172.21.15.59:0/2403351895 learned_addr learned my addr 172.21.15.59:0/2403351895 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.246+0000 7f3f3607c700 1 -- 172.21.15.59:0/2403351895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009e410 msgr2=0x7f3f30130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.246+0000 7f3f3607c700 1 --2- 172.21.15.59:0/2403351895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009e410 0x7f3f30130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.246+0000 7f3f3607c700 1 -- 172.21.15.59:0/2403351895 >> v1:172.21.15.59:6789/0 conn(0x7f3f3009e000 legacy=0x7f3f30130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.246+0000 7f3f3607c700 1 -- 172.21.15.59:0/2403351895 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3009b2d0 con 0x7f3f3009d6f0 2023-09-30T22:30:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.246+0000 7f3f3507a700 1 -- 172.21.15.59:0/2403351895 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534512405 0 0) 0x7f3f3009f130 con 0x7f3f3009e000 2023-09-30T22:30:31.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.246+0000 7f3f3687d700 1 --2- 172.21.15.59:0/2403351895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009e410 0x7f3f30130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:31.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.246+0000 7f3f3607c700 1 --2- 172.21.15.59:0/2403351895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f3009d6f0 0x7f3f3009dac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0098f0 tx=0x7f3f2c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da916d3e98f441e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:31.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.246+0000 7f3f3507a700 1 -- 172.21.15.59:0/2403351895 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c011830 con 0x7f3f3009d6f0 2023-09-30T22:30:31.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.246+0000 7f3f3507a700 1 -- 172.21.15.59:0/2403351895 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c011990 con 0x7f3f3009d6f0 2023-09-30T22:30:31.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.246+0000 7f3f3507a700 1 -- 172.21.15.59:0/2403351895 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c011d20 con 0x7f3f3009d6f0 2023-09-30T22:30:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.247+0000 7f3f382e0700 1 -- 172.21.15.59:0/2403351895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f3009d6f0 msgr2=0x7f3f3009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.247+0000 7f3f382e0700 1 --2- 172.21.15.59:0/2403351895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f3009d6f0 0x7f3f3009dac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0098f0 tx=0x7f3f2c009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.247+0000 7f3f382e0700 1 -- 172.21.15.59:0/2403351895 shutdown_connections 2023-09-30T22:30:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.247+0000 7f3f382e0700 1 --2- 172.21.15.59:0/2403351895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f3009d6f0 0x7f3f3009dac0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.247+0000 7f3f382e0700 1 --2- 172.21.15.59:0/2403351895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009e410 0x7f3f30130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.247+0000 7f3f382e0700 1 -- 172.21.15.59:0/2403351895 >> 172.21.15.59:0/2403351895 conn(0x7f3f30066f50 msgr2=0x7f3f3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:31.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.247+0000 7f3f382e0700 1 -- 172.21.15.59:0/2403351895 shutdown_connections 2023-09-30T22:30:31.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.247+0000 7f3f382e0700 1 -- 172.21.15.59:0/2403351895 wait complete. 2023-09-30T22:30:31.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.249+0000 7f3f382e0700 1 Processor -- start 2023-09-30T22:30:31.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.249+0000 7f3f382e0700 1 -- start start 2023-09-30T22:30:31.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.249+0000 7f3f382e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009d6f0 0x7f3f30131610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.249+0000 7f3f382e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f3009e000 0x7f3f30131b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.249+0000 7f3f382e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f3009e410 0x7f3f30132090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.249+0000 7f3f382e0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f30133970 con 0x7f3f3009e410 2023-09-30T22:30:31.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.249+0000 7f3f382e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3009c770 con 0x7f3f3009d6f0 2023-09-30T22:30:31.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.249+0000 7f3f382e0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f30132c60 con 0x7f3f3009e000 2023-09-30T22:30:31.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.249+0000 7f3f3607c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009d6f0 0x7f3f30131610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f3607c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009d6f0 0x7f3f30131610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42872/0 (socket says 172.21.15.59:42872) 2023-09-30T22:30:31.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f3607c700 1 -- 172.21.15.59:0/3608376858 learned_addr learned my addr 172.21.15.59:0/3608376858 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:31.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f3687d700 1 --2- 172.21.15.59:0/3608376858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f3009e410 0x7f3f30132090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f3587b700 1 --2- 172.21.15.59:0/3608376858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f3009e000 0x7f3f30131b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f3607c700 1 -- 172.21.15.59:0/3608376858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f3009e000 msgr2=0x7f3f30131b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f3607c700 1 --2- 172.21.15.59:0/3608376858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f3009e000 0x7f3f30131b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f3607c700 1 -- 172.21.15.59:0/3608376858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f3009e410 msgr2=0x7f3f30132090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f3607c700 1 --2- 172.21.15.59:0/3608376858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f3009e410 0x7f3f30132090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f3607c700 1 -- 172.21.15.59:0/3608376858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f28009a70 con 0x7f3f3009d6f0 2023-09-30T22:30:31.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f3587b700 1 --2- 172.21.15.59:0/3608376858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f3009e000 0x7f3f30131b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:31.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f3607c700 1 --2- 172.21.15.59:0/3608376858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009d6f0 0x7f3f30131610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3f300a3e80 tx=0x7f3f2c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:31.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f26ffd700 1 -- 172.21.15.59:0/3608376858 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0043c0 con 0x7f3f3009d6f0 2023-09-30T22:30:31.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f26ffd700 1 -- 172.21.15.59:0/3608376858 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c01f070 con 0x7f3f3009d6f0 2023-09-30T22:30:31.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f382e0700 1 -- 172.21.15.59:0/3608376858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2c009550 con 0x7f3f3009d6f0 2023-09-30T22:30:31.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f26ffd700 1 -- 172.21.15.59:0/3608376858 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0036a0 con 0x7f3f3009d6f0 2023-09-30T22:30:31.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.250+0000 7f3f382e0700 1 -- 172.21.15.59:0/3608376858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f30133090 con 0x7f3f3009d6f0 2023-09-30T22:30:31.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.251+0000 7f3f382e0700 1 -- 172.21.15.59:0/3608376858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f300a1df0 con 0x7f3f3009d6f0 2023-09-30T22:30:31.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.252+0000 7f3f26ffd700 1 -- 172.21.15.59:0/3608376858 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f2c021030 con 0x7f3f3009d6f0 2023-09-30T22:30:31.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.252+0000 7f3f26ffd700 1 -- 172.21.15.59:0/3608376858 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f2c040b30 con 0x7f3f3009d6f0 2023-09-30T22:30:31.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.256+0000 7f3f26ffd700 1 -- 172.21.15.59:0/3608376858 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f2c0199a0 con 0x7f3f3009d6f0 2023-09-30T22:30:31.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.287+0000 7fde5cb3e700 1 Processor -- start 2023-09-30T22:30:31.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.287+0000 7fde5cb3e700 1 -- start start 2023-09-30T22:30:31.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.288+0000 7fde5cb3e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde5809d630 0x7fde580a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.288+0000 7fde5cb3e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde58138d80 0x7fde5813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.288+0000 7fde5cb3e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde580a2a70 con 0x7fde580a0a30 2023-09-30T22:30:31.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.288+0000 7fde5cb3e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde580a01d0 con 0x7fde58138d80 2023-09-30T22:30:31.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.288+0000 7fde5cb3e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde5809e2b0 con 0x7fde5809d630 2023-09-30T22:30:31.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.288+0000 7fde5659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fde580a0a30 0x7fde580a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48504/0 (socket says 172.21.15.59:48504) 2023-09-30T22:30:31.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.288+0000 7fde4dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde5809d630 0x7fde580a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.288+0000 7fde5659c700 1 -- 172.21.15.59:0/1433211279 learned_addr learned my addr 172.21.15.59:0/1433211279 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:31.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.288+0000 7fde56d9d700 1 --2- 172.21.15.59:0/1433211279 >> v2:172.21.15.59:3300/0 conn(0x7fde58138d80 0x7fde5813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.288+0000 7fde4dd9b700 1 -- 172.21.15.59:0/1433211279 >> v2:172.21.15.59:3300/0 conn(0x7fde58138d80 msgr2=0x7fde5813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:31.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.288+0000 7fde4dd9b700 1 --2- 172.21.15.59:0/1433211279 >> v2:172.21.15.59:3300/0 conn(0x7fde58138d80 0x7fde5813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.288+0000 7fde4dd9b700 1 -- 172.21.15.59:0/1433211279 >> v1:172.21.15.59:6789/0 conn(0x7fde580a0a30 legacy=0x7fde580a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.289+0000 7fde4dd9b700 1 -- 172.21.15.59:0/1433211279 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5809dc50 con 0x7fde5809d630 2023-09-30T22:30:31.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.289+0000 7fde55d9b700 1 -- 172.21.15.59:0/1433211279 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111079160 0 0) 0x7fde580a2a70 con 0x7fde580a0a30 2023-09-30T22:30:31.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.289+0000 7fde56d9d700 1 --2- 172.21.15.59:0/1433211279 >> v2:172.21.15.59:3300/0 conn(0x7fde58138d80 0x7fde5813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:31.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.289+0000 7fde4dd9b700 1 --2- 172.21.15.59:0/1433211279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde5809d630 0x7fde580a1510 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde40009840 tx=0x7fde40009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d31ba743ac994d0b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:31.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.289+0000 7fde55d9b700 1 -- 172.21.15.59:0/1433211279 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40011830 con 0x7fde5809d630 2023-09-30T22:30:31.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.289+0000 7fde55d9b700 1 -- 172.21.15.59:0/1433211279 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde40011990 con 0x7fde5809d630 2023-09-30T22:30:31.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.289+0000 7fde55d9b700 1 -- 172.21.15.59:0/1433211279 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40011d20 con 0x7fde5809d630 2023-09-30T22:30:31.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.290+0000 7fde5cb3e700 1 -- 172.21.15.59:0/1433211279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde5809d630 msgr2=0x7fde580a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.290+0000 7fde5cb3e700 1 --2- 172.21.15.59:0/1433211279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde5809d630 0x7fde580a1510 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde40009840 tx=0x7fde40009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:31.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.290+0000 7fde5cb3e700 1 -- 172.21.15.59:0/1433211279 shutdown_connections 2023-09-30T22:30:31.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.290+0000 7fde5cb3e700 1 --2- 172.21.15.59:0/1433211279 >> v2:172.21.15.59:3300/0 conn(0x7fde58138d80 0x7fde5813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.290+0000 7fde5cb3e700 1 --2- 172.21.15.59:0/1433211279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde5809d630 0x7fde580a1510 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.290+0000 7fde5cb3e700 1 -- 172.21.15.59:0/1433211279 >> 172.21.15.59:0/1433211279 conn(0x7fde580a3050 msgr2=0x7fde580a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:31.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.290+0000 7fde5cb3e700 1 -- 172.21.15.59:0/1433211279 shutdown_connections 2023-09-30T22:30:31.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.290+0000 7fde5cb3e700 1 -- 172.21.15.59:0/1433211279 wait complete. 2023-09-30T22:30:31.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.292+0000 7fde5cb3e700 1 Processor -- start 2023-09-30T22:30:31.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.292+0000 7fde5cb3e700 1 -- start start 2023-09-30T22:30:31.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde5cb3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5809d630 0x7fde581337b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde5cb3e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde580a0a30 0x7fde58133cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde5cb3e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde58138d80 0x7fde58134230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde5cb3e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde581365f0 con 0x7fde58138d80 2023-09-30T22:30:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde5cb3e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde58136f60 con 0x7fde5809d630 2023-09-30T22:30:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde5cb3e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde58136240 con 0x7fde580a0a30 2023-09-30T22:30:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde5659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5809d630 0x7fde581337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde4dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde580a0a30 0x7fde58133cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde5659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5809d630 0x7fde581337b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42880/0 (socket says 172.21.15.59:42880) 2023-09-30T22:30:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde4dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde580a0a30 0x7fde58133cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40192/0 (socket says 172.21.15.59:40192) 2023-09-30T22:30:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde5659c700 1 -- 172.21.15.59:0/1473812533 learned_addr learned my addr 172.21.15.59:0/1473812533 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde56d9d700 1 --2- 172.21.15.59:0/1473812533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde58138d80 0x7fde58134230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde4dd9b700 1 -- 172.21.15.59:0/1473812533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5809d630 msgr2=0x7fde581337b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde4dd9b700 1 --2- 172.21.15.59:0/1473812533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5809d630 0x7fde581337b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde4dd9b700 1 -- 172.21.15.59:0/1473812533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde58138d80 msgr2=0x7fde58134230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde4dd9b700 1 --2- 172.21.15.59:0/1473812533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde58138d80 0x7fde58134230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.293+0000 7fde4dd9b700 1 -- 172.21.15.59:0/1473812533 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50009a70 con 0x7fde580a0a30 2023-09-30T22:30:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.294+0000 7fde5659c700 1 --2- 172.21.15.59:0/1473812533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5809d630 0x7fde581337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.294+0000 7fde4dd9b700 1 --2- 172.21.15.59:0/1473812533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde580a0a30 0x7fde58133cf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fde40016000 tx=0x7fde40004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.294+0000 7fde4f7fe700 1 -- 172.21.15.59:0/1473812533 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400043c0 con 0x7fde580a0a30 2023-09-30T22:30:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.294+0000 7fde4f7fe700 1 -- 172.21.15.59:0/1473812533 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4001f070 con 0x7fde580a0a30 2023-09-30T22:30:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.294+0000 7fde5cb3e700 1 -- 172.21.15.59:0/1473812533 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde400094a0 con 0x7fde580a0a30 2023-09-30T22:30:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.294+0000 7fde4f7fe700 1 -- 172.21.15.59:0/1473812533 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400036a0 con 0x7fde580a0a30 2023-09-30T22:30:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.294+0000 7fde5cb3e700 1 -- 172.21.15.59:0/1473812533 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde580a0410 con 0x7fde580a0a30 2023-09-30T22:30:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.295+0000 7fde4f7fe700 1 -- 172.21.15.59:0/1473812533 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde40021030 con 0x7fde580a0a30 2023-09-30T22:30:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.295+0000 7fde5cb3e700 1 -- 172.21.15.59:0/1473812533 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde580747f0 con 0x7fde580a0a30 2023-09-30T22:30:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.295+0000 7fde4f7fe700 1 -- 172.21.15.59:0/1473812533 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fde400409c0 con 0x7fde580a0a30 2023-09-30T22:30:31.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.300+0000 7fde4f7fe700 1 -- 172.21.15.59:0/1473812533 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde40015070 con 0x7fde580a0a30 2023-09-30T22:30:31.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.431+0000 7efc25943700 1 -- 172.21.15.59:0/3469519804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efc2009f6b0 con 0x7efc2006b250 2023-09-30T22:30:31.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.431+0000 7efc07fff700 1 -- 172.21.15.59:0/3469519804 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc1401e030 con 0x7efc2006b250 2023-09-30T22:30:31.432 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.434+0000 7efc25943700 1 -- 172.21.15.59:0/3469519804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2006b250 msgr2=0x7efc201c6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.434+0000 7efc25943700 1 --2- 172.21.15.59:0/3469519804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2006b250 0x7efc201c6720 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efc14010ef0 tx=0x7efc1400b420 comp rx=0 tx=0).stop 2023-09-30T22:30:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.434+0000 7efc25943700 1 -- 172.21.15.59:0/3469519804 shutdown_connections 2023-09-30T22:30:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.434+0000 7efc25943700 1 --2- 172.21.15.59:0/3469519804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc2006a770 0x7efc201c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.434+0000 7efc25943700 1 --2- 172.21.15.59:0/3469519804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc20136d80 0x7efc2011f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.434+0000 7efc25943700 1 --2- 172.21.15.59:0/3469519804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2006b250 0x7efc201c6720 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.434+0000 7efc25943700 1 -- 172.21.15.59:0/3469519804 >> 172.21.15.59:0/3469519804 conn(0x7efc20066f50 msgr2=0x7efc2006ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.434+0000 7efc25943700 1 -- 172.21.15.59:0/3469519804 shutdown_connections 2023-09-30T22:30:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.434+0000 7efc25943700 1 -- 172.21.15.59:0/3469519804 wait complete. 2023-09-30T22:30:31.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:31.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.474+0000 7f3f382e0700 1 -- 172.21.15.59:0/3608376858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3f30074ea0 con 0x7f3f3009d6f0 2023-09-30T22:30:31.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.474+0000 7f3f26ffd700 1 -- 172.21.15.59:0/3608376858 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f2c015030 con 0x7f3f3009d6f0 2023-09-30T22:30:31.475 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.476+0000 7f3f382e0700 1 -- 172.21.15.59:0/3608376858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009d6f0 msgr2=0x7f3f30131610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.476+0000 7f3f382e0700 1 --2- 172.21.15.59:0/3608376858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009d6f0 0x7f3f30131610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3f300a3e80 tx=0x7f3f2c004750 comp rx=0 tx=0).stop 2023-09-30T22:30:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.476+0000 7f3f382e0700 1 -- 172.21.15.59:0/3608376858 shutdown_connections 2023-09-30T22:30:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.477+0000 7f3f382e0700 1 --2- 172.21.15.59:0/3608376858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f3009e410 0x7f3f30132090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.477+0000 7f3f382e0700 1 --2- 172.21.15.59:0/3608376858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009d6f0 0x7f3f30131610 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.477+0000 7f3f382e0700 1 --2- 172.21.15.59:0/3608376858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f3009e000 0x7f3f30131b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.477+0000 7f3f382e0700 1 -- 172.21.15.59:0/3608376858 >> 172.21.15.59:0/3608376858 conn(0x7f3f30066f50 msgr2=0x7f3f30070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.477+0000 7f3f382e0700 1 -- 172.21.15.59:0/3608376858 shutdown_connections 2023-09-30T22:30:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.477+0000 7f3f382e0700 1 -- 172.21.15.59:0/3608376858 wait complete. 2023-09-30T22:30:31.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:31.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.509+0000 7fde5cb3e700 1 -- 172.21.15.59:0/1473812533 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fde58072980 con 0x7fde580a0a30 2023-09-30T22:30:31.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.509+0000 7fde4f7fe700 1 -- 172.21.15.59:0/1473812533 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde400239c0 con 0x7fde580a0a30 2023-09-30T22:30:31.509 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:31.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.511+0000 7fde5cb3e700 1 -- 172.21.15.59:0/1473812533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde580a0a30 msgr2=0x7fde58133cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.511+0000 7fde5cb3e700 1 --2- 172.21.15.59:0/1473812533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde580a0a30 0x7fde58133cf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fde40016000 tx=0x7fde40004750 comp rx=0 tx=0).stop 2023-09-30T22:30:31.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.511+0000 7fde5cb3e700 1 -- 172.21.15.59:0/1473812533 shutdown_connections 2023-09-30T22:30:31.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.511+0000 7fde5cb3e700 1 --2- 172.21.15.59:0/1473812533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde58138d80 0x7fde58134230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.511+0000 7fde5cb3e700 1 --2- 172.21.15.59:0/1473812533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5809d630 0x7fde581337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.511+0000 7fde5cb3e700 1 --2- 172.21.15.59:0/1473812533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde580a0a30 0x7fde58133cf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.511+0000 7fde5cb3e700 1 -- 172.21.15.59:0/1473812533 >> 172.21.15.59:0/1473812533 conn(0x7fde580a3050 msgr2=0x7fde580a6940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:31.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.511+0000 7fde5cb3e700 1 -- 172.21.15.59:0/1473812533 shutdown_connections 2023-09-30T22:30:31.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.511+0000 7fde5cb3e700 1 -- 172.21.15.59:0/1473812533 wait complete. 2023-09-30T22:30:31.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:31.815 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:31.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.960+0000 7f7b25181700 1 Processor -- start 2023-09-30T22:30:31.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.960+0000 7f7b25181700 1 -- start start 2023-09-30T22:30:31.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.960+0000 7f7b25181700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b20133420 0x7f7b201337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.960+0000 7f7b25181700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b20133e30 0x7f7b2012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.960+0000 7f7b25181700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2006b990 con 0x7f7b20134260 2023-09-30T22:30:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.960+0000 7f7b25181700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b200a0590 con 0x7f7b20133e30 2023-09-30T22:30:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.960+0000 7f7b25181700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2009fb80 con 0x7f7b20133420 2023-09-30T22:30:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.960+0000 7f7b1ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b20133420 0x7f7b201337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.960+0000 7f7b1e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b20133e30 0x7f7b2012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.960+0000 7f7b1ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b20133420 0x7f7b201337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40198/0 (socket says 172.21.15.59:40198) 2023-09-30T22:30:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.960+0000 7f7b1ed9d700 1 -- 172.21.15.59:0/1251931981 learned_addr learned my addr 172.21.15.59:0/1251931981 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.961+0000 7f7b1ed9d700 1 -- 172.21.15.59:0/1251931981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b20133e30 msgr2=0x7f7b2012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.961+0000 7f7b1ed9d700 1 --2- 172.21.15.59:0/1251931981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b20133e30 0x7f7b2012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.961+0000 7f7b1ed9d700 1 -- 172.21.15.59:0/1251931981 >> v1:172.21.15.59:6789/0 conn(0x7f7b20134260 legacy=0x7f7b201304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.961+0000 7f7b1ed9d700 1 -- 172.21.15.59:0/1251931981 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b200a0030 con 0x7f7b20133420 2023-09-30T22:30:31.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.961+0000 7f7b1e59c700 1 --2- 172.21.15.59:0/1251931981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b20133e30 0x7f7b2012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:31.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.961+0000 7f7b1dd9b700 1 -- 172.21.15.59:0/1251931981 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268412217 0 0) 0x7f7b2006b990 con 0x7f7b20134260 2023-09-30T22:30:31.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.961+0000 7f7b1ed9d700 1 --2- 172.21.15.59:0/1251931981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b20133420 0x7f7b201337f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009920 tx=0x7f7b10009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55dab86ebd9b7bc0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:31.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.961+0000 7f7b1dd9b700 1 -- 172.21.15.59:0/1251931981 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b10011830 con 0x7f7b20133420 2023-09-30T22:30:31.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.961+0000 7f7b1dd9b700 1 -- 172.21.15.59:0/1251931981 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b10011990 con 0x7f7b20133420 2023-09-30T22:30:31.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.961+0000 7f7b1dd9b700 1 -- 172.21.15.59:0/1251931981 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b10011d20 con 0x7f7b20133420 2023-09-30T22:30:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.962+0000 7f7b25181700 1 -- 172.21.15.59:0/1251931981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b20133420 msgr2=0x7f7b201337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.962+0000 7f7b25181700 1 --2- 172.21.15.59:0/1251931981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b20133420 0x7f7b201337f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009920 tx=0x7f7b10009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.962+0000 7f7b25181700 1 -- 172.21.15.59:0/1251931981 shutdown_connections 2023-09-30T22:30:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.962+0000 7f7b25181700 1 --2- 172.21.15.59:0/1251931981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b20133420 0x7f7b201337f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.962+0000 7f7b25181700 1 --2- 172.21.15.59:0/1251931981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b20133e30 0x7f7b2012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.962+0000 7f7b25181700 1 -- 172.21.15.59:0/1251931981 >> 172.21.15.59:0/1251931981 conn(0x7f7b200a4210 msgr2=0x7f7b200a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.962+0000 7f7b25181700 1 -- 172.21.15.59:0/1251931981 shutdown_connections 2023-09-30T22:30:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.962+0000 7f7b25181700 1 -- 172.21.15.59:0/1251931981 wait complete. 2023-09-30T22:30:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.963+0000 7f7b25181700 1 Processor -- start 2023-09-30T22:30:31.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.963+0000 7f7b25181700 1 -- start start 2023-09-30T22:30:31.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b25181700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b20133420 0x7f7b2009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b25181700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b20133e30 0x7f7b2009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b25181700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b20134260 0x7f7b2009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b25181700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b201202e0 con 0x7f7b20134260 2023-09-30T22:30:31.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b25181700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2011fe90 con 0x7f7b20133420 2023-09-30T22:30:31.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b25181700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2012d940 con 0x7f7b20133e30 2023-09-30T22:30:31.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b1ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b20133420 0x7f7b2009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b1e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b20133e30 0x7f7b2009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b1ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b20133420 0x7f7b2009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42890/0 (socket says 172.21.15.59:42890) 2023-09-30T22:30:31.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b1ed9d700 1 -- 172.21.15.59:0/100721344 learned_addr learned my addr 172.21.15.59:0/100721344 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:31.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b1f59e700 1 --2- 172.21.15.59:0/100721344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b20134260 0x7f7b2009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b1ed9d700 1 -- 172.21.15.59:0/100721344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b20133e30 msgr2=0x7f7b2009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b1ed9d700 1 --2- 172.21.15.59:0/100721344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b20133e30 0x7f7b2009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b1ed9d700 1 -- 172.21.15.59:0/100721344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b20134260 msgr2=0x7f7b2009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b1ed9d700 1 --2- 172.21.15.59:0/100721344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b20134260 0x7f7b2009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b1ed9d700 1 -- 172.21.15.59:0/100721344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b140094a0 con 0x7f7b20133420 2023-09-30T22:30:31.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b1e59c700 1 --2- 172.21.15.59:0/100721344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b20133e30 0x7f7b2009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:31.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b1ed9d700 1 --2- 172.21.15.59:0/100721344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b20133420 0x7f7b2009c480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7b10000c00 tx=0x7f7b10004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:31.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b077fe700 1 -- 172.21.15.59:0/100721344 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b10004450 con 0x7f7b20133420 2023-09-30T22:30:31.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b077fe700 1 -- 172.21.15.59:0/100721344 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b100045b0 con 0x7f7b20133420 2023-09-30T22:30:31.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b25181700 1 -- 172.21.15.59:0/100721344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b10009550 con 0x7f7b20133420 2023-09-30T22:30:31.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.964+0000 7f7b077fe700 1 -- 172.21.15.59:0/100721344 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b100038a0 con 0x7f7b20133420 2023-09-30T22:30:31.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.965+0000 7f7b25181700 1 -- 172.21.15.59:0/100721344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2009dea0 con 0x7f7b20133420 2023-09-30T22:30:31.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.965+0000 7f7b077fe700 1 -- 172.21.15.59:0/100721344 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b10021070 con 0x7f7b20133420 2023-09-30T22:30:31.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.965+0000 7f7b077fe700 1 -- 172.21.15.59:0/100721344 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7b10040960 con 0x7f7b20133420 2023-09-30T22:30:31.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.966+0000 7f7b25181700 1 -- 172.21.15.59:0/100721344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2011fce0 con 0x7f7b20133420 2023-09-30T22:30:31.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:31.970+0000 7f7b077fe700 1 -- 172.21.15.59:0/100721344 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b100199a0 con 0x7f7b20133420 2023-09-30T22:30:32.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.173+0000 7f7b25181700 1 -- 172.21.15.59:0/100721344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7b201200d0 con 0x7f7b20133420 2023-09-30T22:30:32.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.173+0000 7f7b077fe700 1 -- 172.21.15.59:0/100721344 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b10029030 con 0x7f7b20133420 2023-09-30T22:30:32.174 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.176+0000 7f7b25181700 1 -- 172.21.15.59:0/100721344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b20133420 msgr2=0x7f7b2009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.176+0000 7f7b25181700 1 --2- 172.21.15.59:0/100721344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b20133420 0x7f7b2009c480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7b10000c00 tx=0x7f7b10004750 comp rx=0 tx=0).stop 2023-09-30T22:30:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.176+0000 7f7b25181700 1 -- 172.21.15.59:0/100721344 shutdown_connections 2023-09-30T22:30:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.176+0000 7f7b25181700 1 --2- 172.21.15.59:0/100721344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b20134260 0x7f7b2009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.176+0000 7f7b25181700 1 --2- 172.21.15.59:0/100721344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b20133420 0x7f7b2009c480 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.176+0000 7f7b25181700 1 --2- 172.21.15.59:0/100721344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b20133e30 0x7f7b2009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.176+0000 7f7b25181700 1 -- 172.21.15.59:0/100721344 >> 172.21.15.59:0/100721344 conn(0x7f7b200a4210 msgr2=0x7f7b200a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.176+0000 7f7b25181700 1 -- 172.21.15.59:0/100721344 shutdown_connections 2023-09-30T22:30:32.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.176+0000 7f7b25181700 1 -- 172.21.15.59:0/100721344 wait complete. 2023-09-30T22:30:32.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:32.449 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:32.491 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:32.526 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:32.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.601+0000 7f0819745700 1 Processor -- start 2023-09-30T22:30:32.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.601+0000 7f0819745700 1 -- start start 2023-09-30T22:30:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.602+0000 7f0819745700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f081409d6f0 0x7f081409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.602+0000 7f0819745700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f081409e440 0x7f0814134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.602+0000 7f0819745700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081409b120 con 0x7f081409e000 2023-09-30T22:30:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.602+0000 7f0819745700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081406b460 con 0x7f081409d6f0 2023-09-30T22:30:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.602+0000 7f0819745700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081409a7e0 con 0x7f081409e440 2023-09-30T22:30:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.602+0000 7f08137fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f081409e440 0x7f0814134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.602+0000 7f08137fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f081409e440 0x7f0814134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42898/0 (socket says 172.21.15.59:42898) 2023-09-30T22:30:32.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.602+0000 7f08137fe700 1 -- 172.21.15.59:0/1833883989 learned_addr learned my addr 172.21.15.59:0/1833883989 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:32.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.602+0000 7f0812ffd700 1 --2- 172.21.15.59:0/1833883989 >> v2:172.21.15.59:3300/0 conn(0x7f081409d6f0 0x7f081409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.602+0000 7f08137fe700 1 -- 172.21.15.59:0/1833883989 >> v2:172.21.15.59:3300/0 conn(0x7f081409d6f0 msgr2=0x7f081409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:32.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.602+0000 7f08137fe700 1 --2- 172.21.15.59:0/1833883989 >> v2:172.21.15.59:3300/0 conn(0x7f081409d6f0 0x7f081409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.602+0000 7f08137fe700 1 -- 172.21.15.59:0/1833883989 >> v1:172.21.15.59:6789/0 conn(0x7f081409e000 legacy=0x7f08141339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.602+0000 7f0811ffb700 1 -- 172.21.15.59:0/1833883989 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785530759 0 0) 0x7f081409b120 con 0x7f081409e000 2023-09-30T22:30:32.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.602+0000 7f08137fe700 1 -- 172.21.15.59:0/1833883989 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081409a500 con 0x7f081409e440 2023-09-30T22:30:32.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.603+0000 7f08137fe700 1 --2- 172.21.15.59:0/1833883989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f081409e440 0x7f0814134100 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f080c009e80 tx=0x7f080c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86a1c06bb03af737 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:32.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.603+0000 7f0811ffb700 1 -- 172.21.15.59:0/1833883989 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c00e070 con 0x7f081409e440 2023-09-30T22:30:32.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.603+0000 7f0811ffb700 1 -- 172.21.15.59:0/1833883989 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c00b8d0 con 0x7f081409e440 2023-09-30T22:30:32.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.603+0000 7f0811ffb700 1 -- 172.21.15.59:0/1833883989 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c00bc80 con 0x7f081409e440 2023-09-30T22:30:32.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.603+0000 7f0819745700 1 -- 172.21.15.59:0/1833883989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f081409e440 msgr2=0x7f0814134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.604+0000 7f0819745700 1 --2- 172.21.15.59:0/1833883989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f081409e440 0x7f0814134100 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f080c009e80 tx=0x7f080c00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:32.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.604+0000 7f0819745700 1 -- 172.21.15.59:0/1833883989 shutdown_connections 2023-09-30T22:30:32.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.604+0000 7f0819745700 1 --2- 172.21.15.59:0/1833883989 >> v2:172.21.15.59:3300/0 conn(0x7f081409d6f0 0x7f081409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.604+0000 7f0819745700 1 --2- 172.21.15.59:0/1833883989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f081409e440 0x7f0814134100 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.604+0000 7f0819745700 1 -- 172.21.15.59:0/1833883989 >> 172.21.15.59:0/1833883989 conn(0x7f0814066f50 msgr2=0x7f081409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:32.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.604+0000 7f0819745700 1 -- 172.21.15.59:0/1833883989 shutdown_connections 2023-09-30T22:30:32.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.604+0000 7f0819745700 1 -- 172.21.15.59:0/1833883989 wait complete. 2023-09-30T22:30:32.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.605+0000 7f0819745700 1 Processor -- start 2023-09-30T22:30:32.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.605+0000 7f0819745700 1 -- start start 2023-09-30T22:30:32.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.606+0000 7f0819745700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f081409d6f0 0x7f08141a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.606+0000 7f0819745700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f081409e000 0x7f08141a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.606+0000 7f0819745700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f081409e440 0x7f08141c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.606+0000 7f0819745700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08141b91b0 con 0x7f081409e440 2023-09-30T22:30:32.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.606+0000 7f0819745700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08141a80f0 con 0x7f081409e000 2023-09-30T22:30:32.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.606+0000 7f0819745700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08141a4d10 con 0x7f081409d6f0 2023-09-30T22:30:32.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.606+0000 7f0812ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f081409d6f0 0x7f08141a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.606+0000 7f0812ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f081409d6f0 0x7f08141a5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40226/0 (socket says 172.21.15.59:40226) 2023-09-30T22:30:32.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.606+0000 7f0812ffd700 1 -- 172.21.15.59:0/1285550637 learned_addr learned my addr 172.21.15.59:0/1285550637 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:32.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.606+0000 7f08127fc700 1 --2- 172.21.15.59:0/1285550637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f081409e000 0x7f08141a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.606+0000 7f08137fe700 1 --2- 172.21.15.59:0/1285550637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f081409e440 0x7f08141c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.607+0000 7f0812ffd700 1 -- 172.21.15.59:0/1285550637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f081409e000 msgr2=0x7f08141a58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.607+0000 7f0812ffd700 1 --2- 172.21.15.59:0/1285550637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f081409e000 0x7f08141a58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.607+0000 7f0812ffd700 1 -- 172.21.15.59:0/1285550637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f081409e440 msgr2=0x7f08141c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.607+0000 7f0812ffd700 1 --2- 172.21.15.59:0/1285550637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f081409e440 0x7f08141c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.607+0000 7f0812ffd700 1 -- 172.21.15.59:0/1285550637 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c009b30 con 0x7f081409d6f0 2023-09-30T22:30:32.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.607+0000 7f08137fe700 1 --2- 172.21.15.59:0/1285550637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f081409e440 0x7f08141c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:32.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.607+0000 7f0812ffd700 1 --2- 172.21.15.59:0/1285550637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f081409d6f0 0x7f08141a5360 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f080400e9b0 tx=0x7f080400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:32.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.607+0000 7f07fb7fe700 1 -- 172.21.15.59:0/1285550637 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804009710 con 0x7f081409d6f0 2023-09-30T22:30:32.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.607+0000 7f07fb7fe700 1 -- 172.21.15.59:0/1285550637 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080400ee50 con 0x7f081409d6f0 2023-09-30T22:30:32.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.607+0000 7f0819745700 1 -- 172.21.15.59:0/1285550637 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08141a6430 con 0x7f081409d6f0 2023-09-30T22:30:32.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.607+0000 7f07fb7fe700 1 -- 172.21.15.59:0/1285550637 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080400ca50 con 0x7f081409d6f0 2023-09-30T22:30:32.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.607+0000 7f0819745700 1 -- 172.21.15.59:0/1285550637 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08141a6c20 con 0x7f081409d6f0 2023-09-30T22:30:32.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.608+0000 7f07fb7fe700 1 -- 172.21.15.59:0/1285550637 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f080400cbb0 con 0x7f081409d6f0 2023-09-30T22:30:32.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.609+0000 7f0819745700 1 -- 172.21.15.59:0/1285550637 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0814074ea0 con 0x7f081409d6f0 2023-09-30T22:30:32.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.609+0000 7f07fb7fe700 1 -- 172.21.15.59:0/1285550637 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f080403fac0 con 0x7f081409d6f0 2023-09-30T22:30:32.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.614+0000 7f07fb7fe700 1 -- 172.21.15.59:0/1285550637 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f080401b3b0 con 0x7f081409d6f0 2023-09-30T22:30:32.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.639+0000 7fdaa51f3700 1 Processor -- start 2023-09-30T22:30:32.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.639+0000 7fdaa51f3700 1 -- start start 2023-09-30T22:30:32.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.639+0000 7fdaa51f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa00a0a30 0x7fdaa00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.639+0000 7fdaa51f3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdaa00a1340 0x7fdaa0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.639+0000 7fdaa51f3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa009edd0 con 0x7fdaa0133fa0 2023-09-30T22:30:32.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.639+0000 7fdaa51f3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa009e1f0 con 0x7fdaa00a1340 2023-09-30T22:30:32.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.639+0000 7fdaa51f3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa009dc50 con 0x7fdaa00a0a30 2023-09-30T22:30:32.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.639+0000 7fda9ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa00a0a30 0x7fdaa00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.639+0000 7fda9f59e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdaa0133fa0 0x7fdaa013ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48546/0 (socket says 172.21.15.59:48546) 2023-09-30T22:30:32.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.639+0000 7fda9f59e700 1 -- 172.21.15.59:0/4223823483 learned_addr learned my addr 172.21.15.59:0/4223823483 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:32.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.639+0000 7fda9ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa00a0a30 0x7fdaa00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42908/0 (socket says 172.21.15.59:42908) 2023-09-30T22:30:32.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.639+0000 7fda9e59c700 1 --2- 172.21.15.59:0/4223823483 >> v2:172.21.15.59:3300/0 conn(0x7fdaa00a1340 0x7fdaa0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.640+0000 7fda9ed9d700 1 -- 172.21.15.59:0/4223823483 >> v2:172.21.15.59:3300/0 conn(0x7fdaa00a1340 msgr2=0x7fdaa0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:32.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.640+0000 7fda9ed9d700 1 --2- 172.21.15.59:0/4223823483 >> v2:172.21.15.59:3300/0 conn(0x7fdaa00a1340 0x7fdaa0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.640+0000 7fda9ed9d700 1 -- 172.21.15.59:0/4223823483 >> v1:172.21.15.59:6789/0 conn(0x7fdaa0133fa0 legacy=0x7fdaa013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.640+0000 7fda9ed9d700 1 -- 172.21.15.59:0/4223823483 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa00a1fe0 con 0x7fdaa00a0a30 2023-09-30T22:30:32.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.640+0000 7fda9e59c700 1 --2- 172.21.15.59:0/4223823483 >> v2:172.21.15.59:3300/0 conn(0x7fdaa00a1340 0x7fdaa0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:32.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.640+0000 7fda9ed9d700 1 --2- 172.21.15.59:0/4223823483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa00a0a30 0x7fdaa00a0e00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fda90009840 tx=0x7fda90009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fdcfbc04ab5b013 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:32.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.640+0000 7fda9dd9b700 1 -- 172.21.15.59:0/4223823483 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90011830 con 0x7fdaa00a0a30 2023-09-30T22:30:32.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.640+0000 7fda9dd9b700 1 -- 172.21.15.59:0/4223823483 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda90011990 con 0x7fdaa00a0a30 2023-09-30T22:30:32.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.640+0000 7fda9dd9b700 1 -- 172.21.15.59:0/4223823483 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90011d20 con 0x7fdaa00a0a30 2023-09-30T22:30:32.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.641+0000 7fdaa51f3700 1 -- 172.21.15.59:0/4223823483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa00a0a30 msgr2=0x7fdaa00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.641+0000 7fdaa51f3700 1 --2- 172.21.15.59:0/4223823483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa00a0a30 0x7fdaa00a0e00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fda90009840 tx=0x7fda90009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:32.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.641+0000 7fdaa51f3700 1 -- 172.21.15.59:0/4223823483 shutdown_connections 2023-09-30T22:30:32.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.641+0000 7fdaa51f3700 1 --2- 172.21.15.59:0/4223823483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa00a0a30 0x7fdaa00a0e00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.641+0000 7fdaa51f3700 1 --2- 172.21.15.59:0/4223823483 >> v2:172.21.15.59:3300/0 conn(0x7fdaa00a1340 0x7fdaa0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.641+0000 7fdaa51f3700 1 -- 172.21.15.59:0/4223823483 >> 172.21.15.59:0/4223823483 conn(0x7fdaa00a6550 msgr2=0x7fdaa00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:32.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.641+0000 7fdaa51f3700 1 -- 172.21.15.59:0/4223823483 shutdown_connections 2023-09-30T22:30:32.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.641+0000 7fdaa51f3700 1 -- 172.21.15.59:0/4223823483 wait complete. 2023-09-30T22:30:32.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.642+0000 7fdaa51f3700 1 Processor -- start 2023-09-30T22:30:32.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.642+0000 7fdaa51f3700 1 -- start start 2023-09-30T22:30:32.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fdaa51f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa00a0a30 0x7fdaa011e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fdaa51f3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaa00a1340 0x7fdaa011ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fdaa51f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa0133fa0 0x7fdaa011f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fdaa51f3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0121f50 con 0x7fdaa00a1340 2023-09-30T22:30:32.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fdaa51f3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0120430 con 0x7fdaa0133fa0 2023-09-30T22:30:32.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fdaa51f3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa00a37e0 con 0x7fdaa00a0a30 2023-09-30T22:30:32.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fda9e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaa00a1340 0x7fdaa011ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fda9e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaa00a1340 0x7fdaa011ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51056/0 (socket says 172.21.15.59:51056) 2023-09-30T22:30:32.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fda9e59c700 1 -- 172.21.15.59:0/3125670852 learned_addr learned my addr 172.21.15.59:0/3125670852 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:32.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fda9ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa00a0a30 0x7fdaa011e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fda9f59e700 1 --2- 172.21.15.59:0/3125670852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa0133fa0 0x7fdaa011f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fda9ed9d700 1 -- 172.21.15.59:0/3125670852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa0133fa0 msgr2=0x7fdaa011f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fda9ed9d700 1 --2- 172.21.15.59:0/3125670852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa0133fa0 0x7fdaa011f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fda9ed9d700 1 -- 172.21.15.59:0/3125670852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaa00a1340 msgr2=0x7fdaa011ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fda9ed9d700 1 --2- 172.21.15.59:0/3125670852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaa00a1340 0x7fdaa011ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fda9ed9d700 1 -- 172.21.15.59:0/3125670852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda940094a0 con 0x7fdaa00a0a30 2023-09-30T22:30:32.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.643+0000 7fda9e59c700 1 --2- 172.21.15.59:0/3125670852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaa00a1340 0x7fdaa011ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:32.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.644+0000 7fda9ed9d700 1 --2- 172.21.15.59:0/3125670852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa00a0a30 0x7fdaa011e7a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00673c0 tx=0x7fda90004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:32.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.644+0000 7fda877fe700 1 -- 172.21.15.59:0/3125670852 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda900036a0 con 0x7fdaa00a0a30 2023-09-30T22:30:32.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.644+0000 7fda877fe700 1 -- 172.21.15.59:0/3125670852 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9001f070 con 0x7fdaa00a0a30 2023-09-30T22:30:32.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.644+0000 7fda877fe700 1 -- 172.21.15.59:0/3125670852 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90003a60 con 0x7fdaa00a0a30 2023-09-30T22:30:32.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.644+0000 7fdaa51f3700 1 -- 172.21.15.59:0/3125670852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda900094a0 con 0x7fdaa00a0a30 2023-09-30T22:30:32.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.644+0000 7fdaa51f3700 1 -- 172.21.15.59:0/3125670852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa00a0270 con 0x7fdaa00a0a30 2023-09-30T22:30:32.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.645+0000 7fda877fe700 1 -- 172.21.15.59:0/3125670852 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda90003bc0 con 0x7fdaa00a0a30 2023-09-30T22:30:32.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.645+0000 7fda877fe700 1 -- 172.21.15.59:0/3125670852 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fda90021070 con 0x7fdaa00a0a30 2023-09-30T22:30:32.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.645+0000 7fda857fa700 1 -- 172.21.15.59:0/3125670852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda780052e0 con 0x7fdaa00a0a30 2023-09-30T22:30:32.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.650+0000 7fda877fe700 1 -- 172.21.15.59:0/3125670852 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda90015070 con 0x7fdaa00a0a30 2023-09-30T22:30:32.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.701+0000 7f7beb324700 1 Processor -- start 2023-09-30T22:30:32.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.701+0000 7f7beb324700 1 -- start start 2023-09-30T22:30:32.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.702+0000 7f7beb324700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7be409d6f0 0x7f7be409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.702+0000 7f7beb324700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7be409e410 0x7f7be4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.702+0000 7f7beb324700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be409f130 con 0x7f7be409e000 2023-09-30T22:30:32.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.702+0000 7f7beb324700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be409f520 con 0x7f7be409e410 2023-09-30T22:30:32.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.702+0000 7f7beb324700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7be409e930 con 0x7f7be409d6f0 2023-09-30T22:30:32.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.702+0000 7f7be90c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7be409d6f0 0x7f7be409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.702+0000 7f7be88bf700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7be409e000 0x7f7be4130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48556/0 (socket says 172.21.15.59:48556) 2023-09-30T22:30:32.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.702+0000 7f7be98c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7be409e410 0x7f7be4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.702+0000 7f7be88bf700 1 -- 172.21.15.59:0/585077739 learned_addr learned my addr 172.21.15.59:0/585077739 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:32.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.702+0000 7f7bdbfff700 1 -- 172.21.15.59:0/585077739 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547418791 0 0) 0x7f7be409f130 con 0x7f7be409e000 2023-09-30T22:30:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.702+0000 7f7be98c1700 1 -- 172.21.15.59:0/585077739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7be409d6f0 msgr2=0x7f7be409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.702+0000 7f7be98c1700 1 --2- 172.21.15.59:0/585077739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7be409d6f0 0x7f7be409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.702+0000 7f7be98c1700 1 -- 172.21.15.59:0/585077739 >> v1:172.21.15.59:6789/0 conn(0x7f7be409e000 legacy=0x7f7be4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.702+0000 7f7be98c1700 1 -- 172.21.15.59:0/585077739 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be409b2d0 con 0x7f7be409e410 2023-09-30T22:30:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.702+0000 7f7be90c0700 1 --2- 172.21.15.59:0/585077739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7be409d6f0 0x7f7be409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.703+0000 7f7be98c1700 1 --2- 172.21.15.59:0/585077739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7be409e410 0x7f7be4130d70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009dc0 tx=0x7f7bdc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc710129ec463656 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.703+0000 7f7bdbfff700 1 -- 172.21.15.59:0/585077739 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc00e070 con 0x7f7be409e410 2023-09-30T22:30:32.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.703+0000 7f7bdbfff700 1 -- 172.21.15.59:0/585077739 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc00bb20 con 0x7f7be409e410 2023-09-30T22:30:32.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.703+0000 7f7bdbfff700 1 -- 172.21.15.59:0/585077739 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc012430 con 0x7f7be409e410 2023-09-30T22:30:32.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.704+0000 7f7beb324700 1 -- 172.21.15.59:0/585077739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7be409e410 msgr2=0x7f7be4130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.704+0000 7f7beb324700 1 --2- 172.21.15.59:0/585077739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7be409e410 0x7f7be4130d70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009dc0 tx=0x7f7bdc00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:32.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.704+0000 7f7beb324700 1 -- 172.21.15.59:0/585077739 shutdown_connections 2023-09-30T22:30:32.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.704+0000 7f7beb324700 1 --2- 172.21.15.59:0/585077739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7be409d6f0 0x7f7be409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.704+0000 7f7beb324700 1 --2- 172.21.15.59:0/585077739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7be409e410 0x7f7be4130d70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.704+0000 7f7beb324700 1 -- 172.21.15.59:0/585077739 >> 172.21.15.59:0/585077739 conn(0x7f7be4066f50 msgr2=0x7f7be409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:32.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.704+0000 7f7beb324700 1 -- 172.21.15.59:0/585077739 shutdown_connections 2023-09-30T22:30:32.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.704+0000 7f7beb324700 1 -- 172.21.15.59:0/585077739 wait complete. 2023-09-30T22:30:32.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.705+0000 7f7beb324700 1 Processor -- start 2023-09-30T22:30:32.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.706+0000 7f7beb324700 1 -- start start 2023-09-30T22:30:32.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.706+0000 7f7beb324700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7be409d6f0 0x7f7be406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.706+0000 7f7beb324700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be409e000 0x7f7be406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.706+0000 7f7beb324700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7be409e410 0x7f7be406f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.706+0000 7f7beb324700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40a1b80 con 0x7f7be409e000 2023-09-30T22:30:32.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.706+0000 7f7beb324700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be409c700 con 0x7f7be409d6f0 2023-09-30T22:30:32.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.706+0000 7f7beb324700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7be4125390 con 0x7f7be409e410 2023-09-30T22:30:32.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.706+0000 7f7be88bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be409e000 0x7f7be406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.707+0000 7f7be88bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be409e000 0x7f7be406edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51058/0 (socket says 172.21.15.59:51058) 2023-09-30T22:30:32.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.707+0000 7f7be88bf700 1 -- 172.21.15.59:0/374903435 learned_addr learned my addr 172.21.15.59:0/374903435 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.707+0000 7f7be90c0700 1 --2- 172.21.15.59:0/374903435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7be409d6f0 0x7f7be406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.707+0000 7f7be98c1700 1 --2- 172.21.15.59:0/374903435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7be409e410 0x7f7be406f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.707+0000 7f7be88bf700 1 -- 172.21.15.59:0/374903435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7be409e410 msgr2=0x7f7be406f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.707+0000 7f7be88bf700 1 --2- 172.21.15.59:0/374903435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7be409e410 0x7f7be406f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.707+0000 7f7be88bf700 1 -- 172.21.15.59:0/374903435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7be409d6f0 msgr2=0x7f7be406e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.707+0000 7f7be88bf700 1 --2- 172.21.15.59:0/374903435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7be409d6f0 0x7f7be406e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.707+0000 7f7be88bf700 1 -- 172.21.15.59:0/374903435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be00094a0 con 0x7f7be409e000 2023-09-30T22:30:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.707+0000 7f7be88bf700 1 --2- 172.21.15.59:0/374903435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be409e000 0x7f7be406edb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4001eb0 tx=0x7f7bd400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.707+0000 7f7bd9ffb700 1 -- 172.21.15.59:0/374903435 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4004c80 con 0x7f7be409e000 2023-09-30T22:30:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.707+0000 7f7bd9ffb700 1 -- 172.21.15.59:0/374903435 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd4004de0 con 0x7f7be409e000 2023-09-30T22:30:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.707+0000 7f7beb324700 1 -- 172.21.15.59:0/374903435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc009a70 con 0x7f7be409e000 2023-09-30T22:30:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.707+0000 7f7bd9ffb700 1 -- 172.21.15.59:0/374903435 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4007310 con 0x7f7be409e000 2023-09-30T22:30:32.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.708+0000 7f7beb324700 1 -- 172.21.15.59:0/374903435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be41244e0 con 0x7f7be409e000 2023-09-30T22:30:32.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.709+0000 7f7beb324700 1 -- 172.21.15.59:0/374903435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be411cc30 con 0x7f7be409e000 2023-09-30T22:30:32.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.710+0000 7f7bd9ffb700 1 -- 172.21.15.59:0/374903435 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7bd4007470 con 0x7f7be409e000 2023-09-30T22:30:32.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.710+0000 7f7bd9ffb700 1 -- 172.21.15.59:0/374903435 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7bd403f8b0 con 0x7f7be409e000 2023-09-30T22:30:32.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.718+0000 7f7bd9ffb700 1 -- 172.21.15.59:0/374903435 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7bd40133c0 con 0x7f7be409e000 2023-09-30T22:30:32.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.849+0000 7f0819745700 1 -- 172.21.15.59:0/1285550637 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f08141a7d00 con 0x7f081409d6f0 2023-09-30T22:30:32.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.850+0000 7f07fb7fe700 1 -- 172.21.15.59:0/1285550637 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0804021030 con 0x7f081409d6f0 2023-09-30T22:30:32.850 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:32.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.853+0000 7f0819745700 1 -- 172.21.15.59:0/1285550637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f081409d6f0 msgr2=0x7f08141a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.853+0000 7f0819745700 1 --2- 172.21.15.59:0/1285550637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f081409d6f0 0x7f08141a5360 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f080400e9b0 tx=0x7f080400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.853+0000 7f0819745700 1 -- 172.21.15.59:0/1285550637 shutdown_connections 2023-09-30T22:30:32.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.853+0000 7f0819745700 1 --2- 172.21.15.59:0/1285550637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f081409d6f0 0x7f08141a5360 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.853+0000 7f0819745700 1 --2- 172.21.15.59:0/1285550637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f081409e440 0x7f08141c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.853+0000 7f0819745700 1 --2- 172.21.15.59:0/1285550637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f081409e000 0x7f08141a58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.853+0000 7f0819745700 1 -- 172.21.15.59:0/1285550637 >> 172.21.15.59:0/1285550637 conn(0x7f0814066f50 msgr2=0x7f08140a1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:32.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.853+0000 7f0819745700 1 -- 172.21.15.59:0/1285550637 shutdown_connections 2023-09-30T22:30:32.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.853+0000 7f0819745700 1 -- 172.21.15.59:0/1285550637 wait complete. 2023-09-30T22:30:32.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.865+0000 7fda857fa700 1 -- 172.21.15.59:0/3125670852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fda78005590 con 0x7fdaa00a0a30 2023-09-30T22:30:32.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.865+0000 7fda877fe700 1 -- 172.21.15.59:0/3125670852 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda9002f3a0 con 0x7fdaa00a0a30 2023-09-30T22:30:32.865 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:32.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:32.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.868+0000 7fda857fa700 1 -- 172.21.15.59:0/3125670852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa00a0a30 msgr2=0x7fdaa011e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.868+0000 7fda857fa700 1 --2- 172.21.15.59:0/3125670852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa00a0a30 0x7fdaa011e7a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00673c0 tx=0x7fda90004750 comp rx=0 tx=0).stop 2023-09-30T22:30:32.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.868+0000 7fda857fa700 1 -- 172.21.15.59:0/3125670852 shutdown_connections 2023-09-30T22:30:32.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.868+0000 7fda857fa700 1 --2- 172.21.15.59:0/3125670852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa00a0a30 0x7fdaa011e7a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.868+0000 7fda857fa700 1 --2- 172.21.15.59:0/3125670852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa0133fa0 0x7fdaa011f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.868+0000 7fda857fa700 1 --2- 172.21.15.59:0/3125670852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaa00a1340 0x7fdaa011ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.868+0000 7fda857fa700 1 -- 172.21.15.59:0/3125670852 >> 172.21.15.59:0/3125670852 conn(0x7fdaa00a6550 msgr2=0x7fdaa01b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:32.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.868+0000 7fda857fa700 1 -- 172.21.15.59:0/3125670852 shutdown_connections 2023-09-30T22:30:32.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.868+0000 7fda857fa700 1 -- 172.21.15.59:0/3125670852 wait complete. 2023-09-30T22:30:32.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:32.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.927+0000 7f7beb324700 1 -- 172.21.15.59:0/374903435 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7be4074ea0 con 0x7f7be409e000 2023-09-30T22:30:32.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.928+0000 7f7bd9ffb700 1 -- 172.21.15.59:0/374903435 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7bd40102c0 con 0x7f7be409e000 2023-09-30T22:30:32.928 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:32.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.930+0000 7f7beb324700 1 -- 172.21.15.59:0/374903435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be409e000 msgr2=0x7f7be406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.930+0000 7f7beb324700 1 --2- 172.21.15.59:0/374903435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be409e000 0x7f7be406edb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4001eb0 tx=0x7f7bd400c800 comp rx=0 tx=0).stop 2023-09-30T22:30:32.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.930+0000 7f7beb324700 1 -- 172.21.15.59:0/374903435 shutdown_connections 2023-09-30T22:30:32.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.930+0000 7f7beb324700 1 --2- 172.21.15.59:0/374903435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7be409e410 0x7f7be406f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.930+0000 7f7beb324700 1 --2- 172.21.15.59:0/374903435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7be409d6f0 0x7f7be406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.930+0000 7f7beb324700 1 --2- 172.21.15.59:0/374903435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be409e000 0x7f7be406edb0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.930+0000 7f7beb324700 1 -- 172.21.15.59:0/374903435 >> 172.21.15.59:0/374903435 conn(0x7f7be4066f50 msgr2=0x7f7be409fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:32.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.930+0000 7f7beb324700 1 -- 172.21.15.59:0/374903435 shutdown_connections 2023-09-30T22:30:32.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:32.930+0000 7f7beb324700 1 -- 172.21.15.59:0/374903435 wait complete. 2023-09-30T22:30:32.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:33.191 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:33.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.339+0000 7fc933bf6700 1 Processor -- start 2023-09-30T22:30:33.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.340+0000 7fc933bf6700 1 -- start start 2023-09-30T22:30:33.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.340+0000 7fc933bf6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc92c09e1d0 0x7fc92c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.340+0000 7fc933bf6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c135e50 0x7fc92c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.340+0000 7fc933bf6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92c09f130 con 0x7fc92c09d6f0 2023-09-30T22:30:33.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.340+0000 7fc933bf6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92c09f520 con 0x7fc92c09e1d0 2023-09-30T22:30:33.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.340+0000 7fc933bf6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c09e930 con 0x7fc92c135e50 2023-09-30T22:30:33.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.340+0000 7fc932193700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c135e50 0x7fc92c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.340+0000 7fc931191700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc92c09e1d0 0x7fc92c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.340+0000 7fc931191700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc92c09e1d0 0x7fc92c135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51072/0 (socket says 172.21.15.59:51072) 2023-09-30T22:30:33.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.340+0000 7fc932193700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c135e50 0x7fc92c138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42966/0 (socket says 172.21.15.59:42966) 2023-09-30T22:30:33.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.340+0000 7fc931191700 1 -- 172.21.15.59:0/1407219550 learned_addr learned my addr 172.21.15.59:0/1407219550 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:33.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.341+0000 7fc932193700 1 -- 172.21.15.59:0/1407219550 >> v2:172.21.15.59:3300/0 conn(0x7fc92c09e1d0 msgr2=0x7fc92c135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:33.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.341+0000 7fc932193700 1 --2- 172.21.15.59:0/1407219550 >> v2:172.21.15.59:3300/0 conn(0x7fc92c09e1d0 0x7fc92c135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.341+0000 7fc932193700 1 -- 172.21.15.59:0/1407219550 >> v1:172.21.15.59:6789/0 conn(0x7fc92c09d6f0 legacy=0x7fc92c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.341+0000 7fc932193700 1 -- 172.21.15.59:0/1407219550 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c09b2d0 con 0x7fc92c135e50 2023-09-30T22:30:33.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.341+0000 7fc931191700 1 --2- 172.21.15.59:0/1407219550 >> v2:172.21.15.59:3300/0 conn(0x7fc92c09e1d0 0x7fc92c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:33.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.341+0000 7fc932193700 1 --2- 172.21.15.59:0/1407219550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c135e50 0x7fc92c138230 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc924009d90 tx=0x7fc92400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d02206d3135757f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:33.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.341+0000 7fc930990700 1 -- 172.21.15.59:0/1407219550 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92400e070 con 0x7fc92c135e50 2023-09-30T22:30:33.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.341+0000 7fc930990700 1 -- 172.21.15.59:0/1407219550 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92400bb20 con 0x7fc92c135e50 2023-09-30T22:30:33.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.341+0000 7fc930990700 1 -- 172.21.15.59:0/1407219550 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924012430 con 0x7fc92c135e50 2023-09-30T22:30:33.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.342+0000 7fc933bf6700 1 -- 172.21.15.59:0/1407219550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c135e50 msgr2=0x7fc92c138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.342+0000 7fc933bf6700 1 --2- 172.21.15.59:0/1407219550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c135e50 0x7fc92c138230 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc924009d90 tx=0x7fc92400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:33.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.342+0000 7fc933bf6700 1 -- 172.21.15.59:0/1407219550 shutdown_connections 2023-09-30T22:30:33.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.342+0000 7fc933bf6700 1 --2- 172.21.15.59:0/1407219550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c135e50 0x7fc92c138230 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.342+0000 7fc933bf6700 1 --2- 172.21.15.59:0/1407219550 >> v2:172.21.15.59:3300/0 conn(0x7fc92c09e1d0 0x7fc92c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.342+0000 7fc933bf6700 1 -- 172.21.15.59:0/1407219550 >> 172.21.15.59:0/1407219550 conn(0x7fc92c066f50 msgr2=0x7fc92c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:33.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.342+0000 7fc933bf6700 1 -- 172.21.15.59:0/1407219550 shutdown_connections 2023-09-30T22:30:33.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.342+0000 7fc933bf6700 1 -- 172.21.15.59:0/1407219550 wait complete. 2023-09-30T22:30:33.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.343+0000 7fc933bf6700 1 Processor -- start 2023-09-30T22:30:33.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.343+0000 7fc933bf6700 1 -- start start 2023-09-30T22:30:33.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.344+0000 7fc933bf6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92c09d6f0 0x7fc92c1202f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.344+0000 7fc933bf6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc92c09e1d0 0x7fc92c120830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.344+0000 7fc933bf6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c135e50 0x7fc92c1c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.344+0000 7fc933bf6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c123110 con 0x7fc92c09d6f0 2023-09-30T22:30:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.344+0000 7fc933bf6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c132160 con 0x7fc92c135e50 2023-09-30T22:30:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.344+0000 7fc933bf6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c11fd50 con 0x7fc92c09e1d0 2023-09-30T22:30:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.344+0000 7fc931992700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92c09d6f0 0x7fc92c1202f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.344+0000 7fc931992700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92c09d6f0 0x7fc92c1202f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51086/0 (socket says 172.21.15.59:51086) 2023-09-30T22:30:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.344+0000 7fc931191700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc92c09e1d0 0x7fc92c120830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.344+0000 7fc931992700 1 -- 172.21.15.59:0/4173135691 learned_addr learned my addr 172.21.15.59:0/4173135691 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:33.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.344+0000 7fc932193700 1 --2- 172.21.15.59:0/4173135691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c135e50 0x7fc92c1c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.345+0000 7fc931992700 1 -- 172.21.15.59:0/4173135691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc92c09e1d0 msgr2=0x7fc92c120830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.345+0000 7fc931992700 1 --2- 172.21.15.59:0/4173135691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc92c09e1d0 0x7fc92c120830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.345+0000 7fc931992700 1 -- 172.21.15.59:0/4173135691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c135e50 msgr2=0x7fc92c1c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.345+0000 7fc931992700 1 --2- 172.21.15.59:0/4173135691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c135e50 0x7fc92c1c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.345+0000 7fc931992700 1 -- 172.21.15.59:0/4173135691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc920009550 con 0x7fc92c09d6f0 2023-09-30T22:30:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.345+0000 7fc931992700 1 --2- 172.21.15.59:0/4173135691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92c09d6f0 0x7fc92c1202f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc92800c480 tx=0x7fc92800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.345+0000 7fc91e7fc700 1 -- 172.21.15.59:0/4173135691 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9280052d0 con 0x7fc92c09d6f0 2023-09-30T22:30:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.345+0000 7fc91e7fc700 1 -- 172.21.15.59:0/4173135691 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc928005430 con 0x7fc92c09d6f0 2023-09-30T22:30:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.345+0000 7fc933bf6700 1 -- 172.21.15.59:0/4173135691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc924009a70 con 0x7fc92c09d6f0 2023-09-30T22:30:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.345+0000 7fc91e7fc700 1 -- 172.21.15.59:0/4173135691 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9280038c0 con 0x7fc92c09d6f0 2023-09-30T22:30:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.345+0000 7fc933bf6700 1 -- 172.21.15.59:0/4173135691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92c121400 con 0x7fc92c09d6f0 2023-09-30T22:30:33.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.346+0000 7fc91e7fc700 1 -- 172.21.15.59:0/4173135691 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc928003a20 con 0x7fc92c09d6f0 2023-09-30T22:30:33.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.346+0000 7fc933bf6700 1 -- 172.21.15.59:0/4173135691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92c09c760 con 0x7fc92c09d6f0 2023-09-30T22:30:33.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.346+0000 7fc91e7fc700 1 -- 172.21.15.59:0/4173135691 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc92803e8b0 con 0x7fc92c09d6f0 2023-09-30T22:30:33.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.351+0000 7fc91e7fc700 1 -- 172.21.15.59:0/4173135691 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc928011590 con 0x7fc92c09d6f0 2023-09-30T22:30:33.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.558+0000 7fc933bf6700 1 -- 172.21.15.59:0/4173135691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc92c0a1e20 con 0x7fc92c09d6f0 2023-09-30T22:30:33.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.558+0000 7fc91e7fc700 1 -- 172.21.15.59:0/4173135691 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc928017090 con 0x7fc92c09d6f0 2023-09-30T22:30:33.558 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:33.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.560+0000 7fc933bf6700 1 -- 172.21.15.59:0/4173135691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92c09d6f0 msgr2=0x7fc92c1202f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.560+0000 7fc933bf6700 1 --2- 172.21.15.59:0/4173135691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92c09d6f0 0x7fc92c1202f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc92800c480 tx=0x7fc92800c790 comp rx=0 tx=0).stop 2023-09-30T22:30:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.560+0000 7fc933bf6700 1 -- 172.21.15.59:0/4173135691 shutdown_connections 2023-09-30T22:30:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.560+0000 7fc933bf6700 1 --2- 172.21.15.59:0/4173135691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c135e50 0x7fc92c1c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.560+0000 7fc933bf6700 1 --2- 172.21.15.59:0/4173135691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92c09d6f0 0x7fc92c1202f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.560+0000 7fc933bf6700 1 --2- 172.21.15.59:0/4173135691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc92c09e1d0 0x7fc92c120830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.560+0000 7fc933bf6700 1 -- 172.21.15.59:0/4173135691 >> 172.21.15.59:0/4173135691 conn(0x7fc92c066f50 msgr2=0x7fc92c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.560+0000 7fc933bf6700 1 -- 172.21.15.59:0/4173135691 shutdown_connections 2023-09-30T22:30:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:33.560+0000 7fc933bf6700 1 -- 172.21.15.59:0/4173135691 wait complete. 2023-09-30T22:30:33.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:33.869 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:33.882 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:33.945 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.019+0000 7fc93fb12700 1 Processor -- start 2023-09-30T22:30:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.019+0000 7fc93fb12700 1 -- start start 2023-09-30T22:30:34.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93fb12700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc93806a770 0x7fc93806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93fb12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc93806b080 0x7fc938131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93fb12700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc938131b40 0x7fc938131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93fb12700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93809ece0 con 0x7fc938131b40 2023-09-30T22:30:34.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93fb12700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93809e760 con 0x7fc93806a770 2023-09-30T22:30:34.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93fb12700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc93809e040 con 0x7fc93806b080 2023-09-30T22:30:34.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93d8ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc93806a770 0x7fc93806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93d0ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc93806b080 0x7fc938131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93d8ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc93806a770 0x7fc93806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42988/0 (socket says 172.21.15.59:42988) 2023-09-30T22:30:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93d8ae700 1 -- 172.21.15.59:0/2417625592 learned_addr learned my addr 172.21.15.59:0/2417625592 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93e0af700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc938131b40 0x7fc938131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93d0ad700 1 -- 172.21.15.59:0/2417625592 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc93806a770 msgr2=0x7fc93806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93d0ad700 1 --2- 172.21.15.59:0/2417625592 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc93806a770 0x7fc93806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93d0ad700 1 -- 172.21.15.59:0/2417625592 >> v2:172.21.15.59:3300/0 conn(0x7fc938131b40 msgr2=0x7fc938131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93d0ad700 1 --2- 172.21.15.59:0/2417625592 >> v2:172.21.15.59:3300/0 conn(0x7fc938131b40 0x7fc938131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93d0ad700 1 -- 172.21.15.59:0/2417625592 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93809f630 con 0x7fc93806b080 2023-09-30T22:30:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.020+0000 7fc93d8ae700 1 --2- 172.21.15.59:0/2417625592 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc93806a770 0x7fc93806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.021+0000 7fc93d0ad700 1 --2- 172.21.15.59:0/2417625592 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc93806b080 0x7fc938131600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc928009840 tx=0x7fc928009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85fc6618e336618f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.021+0000 7fc93c8ac700 1 -- 172.21.15.59:0/2417625592 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc928011830 con 0x7fc93806b080 2023-09-30T22:30:34.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.021+0000 7fc93c8ac700 1 -- 172.21.15.59:0/2417625592 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc928011990 con 0x7fc93806b080 2023-09-30T22:30:34.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.021+0000 7fc93c8ac700 1 -- 172.21.15.59:0/2417625592 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc928011d20 con 0x7fc93806b080 2023-09-30T22:30:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.022+0000 7fc93fb12700 1 -- 172.21.15.59:0/2417625592 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc93806b080 msgr2=0x7fc938131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.022+0000 7fc93fb12700 1 --2- 172.21.15.59:0/2417625592 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc93806b080 0x7fc938131600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc928009840 tx=0x7fc928009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.022+0000 7fc93fb12700 1 -- 172.21.15.59:0/2417625592 shutdown_connections 2023-09-30T22:30:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.022+0000 7fc93fb12700 1 --2- 172.21.15.59:0/2417625592 >> v2:172.21.15.59:3300/0 conn(0x7fc938131b40 0x7fc938131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.022+0000 7fc93fb12700 1 --2- 172.21.15.59:0/2417625592 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc93806a770 0x7fc93806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.022+0000 7fc93fb12700 1 --2- 172.21.15.59:0/2417625592 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc93806b080 0x7fc938131600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.022+0000 7fc93fb12700 1 -- 172.21.15.59:0/2417625592 >> 172.21.15.59:0/2417625592 conn(0x7fc938066f50 msgr2=0x7fc93809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.022+0000 7fc93fb12700 1 -- 172.21.15.59:0/2417625592 shutdown_connections 2023-09-30T22:30:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.022+0000 7fc93fb12700 1 -- 172.21.15.59:0/2417625592 wait complete. 2023-09-30T22:30:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.023+0000 7fc93fb12700 1 Processor -- start 2023-09-30T22:30:34.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.023+0000 7fc93fb12700 1 -- start start 2023-09-30T22:30:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.023+0000 7fc93fb12700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc93806a770 0x7fc93809a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.023+0000 7fc93fb12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc93806b080 0x7fc93809a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.023+0000 7fc93fb12700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc938131b40 0x7fc93809ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.023+0000 7fc93fb12700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9381248a0 con 0x7fc93806a770 2023-09-30T22:30:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.023+0000 7fc93fb12700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc938125ec0 con 0x7fc938131b40 2023-09-30T22:30:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.023+0000 7fc93fb12700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc93809b7d0 con 0x7fc93806b080 2023-09-30T22:30:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc93d8ae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc93806a770 0x7fc93809a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc93d0ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc93806b080 0x7fc93809a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc93d8ae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc93806a770 0x7fc93809a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51100/0 (socket says 172.21.15.59:51100) 2023-09-30T22:30:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc93d8ae700 1 -- 172.21.15.59:0/3047553728 learned_addr learned my addr 172.21.15.59:0/3047553728 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:34.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc93d0ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc93806b080 0x7fc93809a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40282/0 (socket says 172.21.15.59:40282) 2023-09-30T22:30:34.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc93e0af700 1 --2- 172.21.15.59:0/3047553728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc938131b40 0x7fc93809ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc93d0ad700 1 -- 172.21.15.59:0/3047553728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc938131b40 msgr2=0x7fc93809ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc93d0ad700 1 --2- 172.21.15.59:0/3047553728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc938131b40 0x7fc93809ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc93d0ad700 1 -- 172.21.15.59:0/3047553728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc93806a770 msgr2=0x7fc93809a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc93d0ad700 1 --2- 172.21.15.59:0/3047553728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc93806a770 0x7fc93809a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc93d0ad700 1 -- 172.21.15.59:0/3047553728 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc934009550 con 0x7fc93806b080 2023-09-30T22:30:34.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc93d8ae700 1 --2- 172.21.15.59:0/3047553728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc93806a770 0x7fc93809a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:34.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc93e0af700 1 --2- 172.21.15.59:0/3047553728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc938131b40 0x7fc93809ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:34.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc93d0ad700 1 --2- 172.21.15.59:0/3047553728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc93806b080 0x7fc93809a940 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc928016000 tx=0x7fc928004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:34.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc92e7fc700 1 -- 172.21.15.59:0/3047553728 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc928004450 con 0x7fc93806b080 2023-09-30T22:30:34.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.024+0000 7fc92e7fc700 1 -- 172.21.15.59:0/3047553728 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92801f070 con 0x7fc93806b080 2023-09-30T22:30:34.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.025+0000 7fc93fb12700 1 -- 172.21.15.59:0/3047553728 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9280094a0 con 0x7fc93806b080 2023-09-30T22:30:34.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.025+0000 7fc92e7fc700 1 -- 172.21.15.59:0/3047553728 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9280038e0 con 0x7fc93806b080 2023-09-30T22:30:34.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.025+0000 7fc93fb12700 1 -- 172.21.15.59:0/3047553728 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc938131320 con 0x7fc93806b080 2023-09-30T22:30:34.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.026+0000 7fc91bfff700 1 -- 172.21.15.59:0/3047553728 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9140052e0 con 0x7fc93806b080 2023-09-30T22:30:34.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.026+0000 7fc92e7fc700 1 -- 172.21.15.59:0/3047553728 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc928003a40 con 0x7fc93806b080 2023-09-30T22:30:34.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.027+0000 7fc92e7fc700 1 -- 172.21.15.59:0/3047553728 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc928021070 con 0x7fc93806b080 2023-09-30T22:30:34.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.031+0000 7fc92e7fc700 1 -- 172.21.15.59:0/3047553728 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc92801a430 con 0x7fc93806b080 2023-09-30T22:30:34.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.060+0000 7f9f20edf700 1 Processor -- start 2023-09-30T22:30:34.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.060+0000 7f9f20edf700 1 -- start start 2023-09-30T22:30:34.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.061+0000 7f9f20edf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f1c133420 0x7f9f1c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.061+0000 7f9f20edf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f1c134260 0x7f9f1c1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.061+0000 7f9f20edf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1c06b990 con 0x7f9f1c133e30 2023-09-30T22:30:34.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.061+0000 7f9f20edf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f1c0a0590 con 0x7f9f1c134260 2023-09-30T22:30:34.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.061+0000 7f9f20edf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c09fb80 con 0x7f9f1c133420 2023-09-30T22:30:34.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.061+0000 7f9f1ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f1c134260 0x7f9f1c1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.061+0000 7f9f1ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f1c134260 0x7f9f1c1306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51114/0 (socket says 172.21.15.59:51114) 2023-09-30T22:30:34.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.061+0000 7f9f1ad9d700 1 -- 172.21.15.59:0/1888889643 learned_addr learned my addr 172.21.15.59:0/1888889643 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:34.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.061+0000 7f9f1a59c700 1 --2- 172.21.15.59:0/1888889643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f1c133420 0x7f9f1c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.062+0000 7f9f1ad9d700 1 -- 172.21.15.59:0/1888889643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f1c133420 msgr2=0x7f9f1c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:34.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.062+0000 7f9f1ad9d700 1 --2- 172.21.15.59:0/1888889643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f1c133420 0x7f9f1c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.062+0000 7f9f1ad9d700 1 -- 172.21.15.59:0/1888889643 >> v1:172.21.15.59:6789/0 conn(0x7f9f1c133e30 legacy=0x7f9f1c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.062+0000 7f9f1959a700 1 -- 172.21.15.59:0/1888889643 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171861963 0 0) 0x7f9f1c06b990 con 0x7f9f1c133e30 2023-09-30T22:30:34.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.062+0000 7f9f1ad9d700 1 -- 172.21.15.59:0/1888889643 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c0a0030 con 0x7f9f1c134260 2023-09-30T22:30:34.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.062+0000 7f9f1ad9d700 1 --2- 172.21.15.59:0/1888889643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1c134260 0x7f9f1c1306a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9f140098f0 tx=0x7f9f14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1b3ab3b8ea2813 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:34.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.062+0000 7f9f1959a700 1 -- 172.21.15.59:0/1888889643 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14011830 con 0x7f9f1c134260 2023-09-30T22:30:34.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.062+0000 7f9f1959a700 1 -- 172.21.15.59:0/1888889643 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f14011990 con 0x7f9f1c134260 2023-09-30T22:30:34.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.062+0000 7f9f1959a700 1 -- 172.21.15.59:0/1888889643 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14011d20 con 0x7f9f1c134260 2023-09-30T22:30:34.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.063+0000 7f9f20edf700 1 -- 172.21.15.59:0/1888889643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1c134260 msgr2=0x7f9f1c1306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.063+0000 7f9f20edf700 1 --2- 172.21.15.59:0/1888889643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1c134260 0x7f9f1c1306a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9f140098f0 tx=0x7f9f14009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:34.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.063+0000 7f9f20edf700 1 -- 172.21.15.59:0/1888889643 shutdown_connections 2023-09-30T22:30:34.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.063+0000 7f9f20edf700 1 --2- 172.21.15.59:0/1888889643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1c134260 0x7f9f1c1306a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.063+0000 7f9f20edf700 1 --2- 172.21.15.59:0/1888889643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f1c133420 0x7f9f1c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.063+0000 7f9f20edf700 1 -- 172.21.15.59:0/1888889643 >> 172.21.15.59:0/1888889643 conn(0x7f9f1c0a4210 msgr2=0x7f9f1c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:34.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.063+0000 7f9f20edf700 1 -- 172.21.15.59:0/1888889643 shutdown_connections 2023-09-30T22:30:34.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.063+0000 7f9f20edf700 1 -- 172.21.15.59:0/1888889643 wait complete. 2023-09-30T22:30:34.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.064+0000 7f9f20edf700 1 Processor -- start 2023-09-30T22:30:34.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.064+0000 7f9f20edf700 1 -- start start 2023-09-30T22:30:34.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.065+0000 7f9f20edf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f1c133420 0x7f9f1c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.065+0000 7f9f20edf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f1c133e30 0x7f9f1c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.065+0000 7f9f20edf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1c134260 0x7f9f1c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.065+0000 7f9f20edf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c11fad0 con 0x7f9f1c134260 2023-09-30T22:30:34.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.065+0000 7f9f20edf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c11f080 con 0x7f9f1c133e30 2023-09-30T22:30:34.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.065+0000 7f9f20edf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c09deb0 con 0x7f9f1c133420 2023-09-30T22:30:34.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.065+0000 7f9f1a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f1c133420 0x7f9f1c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.065+0000 7f9f1a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f1c133420 0x7f9f1c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40298/0 (socket says 172.21.15.59:40298) 2023-09-30T22:30:34.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.065+0000 7f9f1a59c700 1 -- 172.21.15.59:0/3819655393 learned_addr learned my addr 172.21.15.59:0/3819655393 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:34.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.065+0000 7f9f19d9b700 1 --2- 172.21.15.59:0/3819655393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f1c133e30 0x7f9f1c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.065+0000 7f9f1ad9d700 1 --2- 172.21.15.59:0/3819655393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1c134260 0x7f9f1c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.065+0000 7f9f19d9b700 1 -- 172.21.15.59:0/3819655393 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f1c133420 msgr2=0x7f9f1c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.065+0000 7f9f19d9b700 1 --2- 172.21.15.59:0/3819655393 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f1c133420 0x7f9f1c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.065+0000 7f9f19d9b700 1 -- 172.21.15.59:0/3819655393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1c134260 msgr2=0x7f9f1c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.065+0000 7f9f19d9b700 1 --2- 172.21.15.59:0/3819655393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1c134260 0x7f9f1c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.066+0000 7f9f19d9b700 1 -- 172.21.15.59:0/3819655393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f14009550 con 0x7f9f1c133e30 2023-09-30T22:30:34.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.066+0000 7f9f1ad9d700 1 --2- 172.21.15.59:0/3819655393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1c134260 0x7f9f1c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:34.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.066+0000 7f9f19d9b700 1 --2- 172.21.15.59:0/3819655393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f1c133e30 0x7f9f1c09c9c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c09f2c0 tx=0x7f9f0400c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:34.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.066+0000 7f9f12ffd700 1 -- 172.21.15.59:0/3819655393 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f040054e0 con 0x7f9f1c133e30 2023-09-30T22:30:34.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.066+0000 7f9f12ffd700 1 -- 172.21.15.59:0/3819655393 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0400ce10 con 0x7f9f1c133e30 2023-09-30T22:30:34.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.066+0000 7f9f20edf700 1 -- 172.21.15.59:0/3819655393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1c11edd0 con 0x7f9f1c133e30 2023-09-30T22:30:34.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.066+0000 7f9f12ffd700 1 -- 172.21.15.59:0/3819655393 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f040038c0 con 0x7f9f1c133e30 2023-09-30T22:30:34.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.066+0000 7f9f20edf700 1 -- 172.21.15.59:0/3819655393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1c120570 con 0x7f9f1c133e30 2023-09-30T22:30:34.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.067+0000 7f9f20edf700 1 -- 172.21.15.59:0/3819655393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1c074ea0 con 0x7f9f1c133e30 2023-09-30T22:30:34.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.067+0000 7f9f12ffd700 1 -- 172.21.15.59:0/3819655393 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f04003a20 con 0x7f9f1c133e30 2023-09-30T22:30:34.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.068+0000 7f9f12ffd700 1 -- 172.21.15.59:0/3819655393 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9f0403ea00 con 0x7f9f1c133e30 2023-09-30T22:30:34.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.076+0000 7f9f12ffd700 1 -- 172.21.15.59:0/3819655393 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f04019b20 con 0x7f9f1c133e30 2023-09-30T22:30:34.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.107+0000 7efcaf6aa700 1 Processor -- start 2023-09-30T22:30:34.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.107+0000 7efcaf6aa700 1 -- start start 2023-09-30T22:30:34.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.107+0000 7efcaf6aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca80a0a30 0x7efca80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.107+0000 7efcaf6aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8134170 0x7efca813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.107+0000 7efcaf6aa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca809edd0 con 0x7efca80a1340 2023-09-30T22:30:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.107+0000 7efcaf6aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca809e1f0 con 0x7efca80a0a30 2023-09-30T22:30:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.107+0000 7efcaf6aa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efca809dc50 con 0x7efca8134170 2023-09-30T22:30:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.108+0000 7efcad446700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca80a0a30 0x7efca80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.108+0000 7efcacc45700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efca80a1340 0x7efca8133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48588/0 (socket says 172.21.15.59:48588) 2023-09-30T22:30:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.108+0000 7efcacc45700 1 -- 172.21.15.59:0/4036142481 learned_addr learned my addr 172.21.15.59:0/4036142481 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.108+0000 7efcadc47700 1 --2- 172.21.15.59:0/4036142481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8134170 0x7efca813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.108+0000 7efc9ffff700 1 -- 172.21.15.59:0/4036142481 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977741039 0 0) 0x7efca809edd0 con 0x7efca80a1340 2023-09-30T22:30:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.108+0000 7efc9ffff700 1 -- 172.21.15.59:0/4036142481 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc940035b0 con 0x7efca80a1340 2023-09-30T22:30:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.108+0000 7efcadc47700 1 -- 172.21.15.59:0/4036142481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca80a0a30 msgr2=0x7efca80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.108+0000 7efcadc47700 1 --2- 172.21.15.59:0/4036142481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca80a0a30 0x7efca80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.108+0000 7efcadc47700 1 -- 172.21.15.59:0/4036142481 >> v1:172.21.15.59:6789/0 conn(0x7efca80a1340 legacy=0x7efca8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.108+0000 7efcadc47700 1 -- 172.21.15.59:0/4036142481 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80a1fe0 con 0x7efca8134170 2023-09-30T22:30:34.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.108+0000 7efcad446700 1 --2- 172.21.15.59:0/4036142481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca80a0a30 0x7efca80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:34.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.108+0000 7efcadc47700 1 --2- 172.21.15.59:0/4036142481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8134170 0x7efca813bd30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efca0009870 tx=0x7efca0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cf26a5dca82f3a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:34.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.109+0000 7efc9ffff700 1 -- 172.21.15.59:0/4036142481 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0011830 con 0x7efca8134170 2023-09-30T22:30:34.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.109+0000 7efc9ffff700 1 -- 172.21.15.59:0/4036142481 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca0011990 con 0x7efca8134170 2023-09-30T22:30:34.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.109+0000 7efc9ffff700 1 -- 172.21.15.59:0/4036142481 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0011d00 con 0x7efca8134170 2023-09-30T22:30:34.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.109+0000 7efcaf6aa700 1 -- 172.21.15.59:0/4036142481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8134170 msgr2=0x7efca813bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.109+0000 7efcaf6aa700 1 --2- 172.21.15.59:0/4036142481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8134170 0x7efca813bd30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efca0009870 tx=0x7efca0009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:34.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.109+0000 7efcaf6aa700 1 -- 172.21.15.59:0/4036142481 shutdown_connections 2023-09-30T22:30:34.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.109+0000 7efcaf6aa700 1 --2- 172.21.15.59:0/4036142481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8134170 0x7efca813bd30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.109+0000 7efcaf6aa700 1 --2- 172.21.15.59:0/4036142481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca80a0a30 0x7efca80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.109+0000 7efcaf6aa700 1 -- 172.21.15.59:0/4036142481 >> 172.21.15.59:0/4036142481 conn(0x7efca80a6550 msgr2=0x7efca80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.109+0000 7efcaf6aa700 1 -- 172.21.15.59:0/4036142481 shutdown_connections 2023-09-30T22:30:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.109+0000 7efcaf6aa700 1 -- 172.21.15.59:0/4036142481 wait complete. 2023-09-30T22:30:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.110+0000 7efcaf6aa700 1 Processor -- start 2023-09-30T22:30:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.110+0000 7efcaf6aa700 1 -- start start 2023-09-30T22:30:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcaf6aa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efca80a0a30 0x7efca8122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcaf6aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca80a1340 0x7efca8122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcaf6aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca8134170 0x7efca8123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcaf6aa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca81261e0 con 0x7efca80a0a30 2023-09-30T22:30:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcaf6aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca81242d0 con 0x7efca8134170 2023-09-30T22:30:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcaf6aa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efca80a4d60 con 0x7efca80a1340 2023-09-30T22:30:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcad446700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efca80a0a30 0x7efca8122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcad446700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efca80a0a30 0x7efca8122710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51128/0 (socket says 172.21.15.59:51128) 2023-09-30T22:30:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcad446700 1 -- 172.21.15.59:0/4121073214 learned_addr learned my addr 172.21.15.59:0/4121073214 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcacc45700 1 --2- 172.21.15.59:0/4121073214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca80a1340 0x7efca8122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcadc47700 1 --2- 172.21.15.59:0/4121073214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca8134170 0x7efca8123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcacc45700 1 -- 172.21.15.59:0/4121073214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca8134170 msgr2=0x7efca8123190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcacc45700 1 --2- 172.21.15.59:0/4121073214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca8134170 0x7efca8123190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcacc45700 1 -- 172.21.15.59:0/4121073214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efca80a0a30 msgr2=0x7efca8122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcacc45700 1 --2- 172.21.15.59:0/4121073214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efca80a0a30 0x7efca8122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcacc45700 1 -- 172.21.15.59:0/4121073214 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca4009a70 con 0x7efca80a1340 2023-09-30T22:30:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcad446700 1 --2- 172.21.15.59:0/4121073214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efca80a0a30 0x7efca8122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.111+0000 7efcadc47700 1 --2- 172.21.15.59:0/4121073214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca8134170 0x7efca8123190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.112+0000 7efcacc45700 1 --2- 172.21.15.59:0/4121073214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca80a1340 0x7efca8122c50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc9800c490 tx=0x7efc9800c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.112+0000 7efc9dffb700 1 -- 172.21.15.59:0/4121073214 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98005e30 con 0x7efca80a1340 2023-09-30T22:30:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.112+0000 7efc9dffb700 1 -- 172.21.15.59:0/4121073214 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc980070d0 con 0x7efca80a1340 2023-09-30T22:30:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.112+0000 7efc9dffb700 1 -- 172.21.15.59:0/4121073214 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98007440 con 0x7efca80a1340 2023-09-30T22:30:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.112+0000 7efcaf6aa700 1 -- 172.21.15.59:0/4121073214 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca00094a0 con 0x7efca80a1340 2023-09-30T22:30:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.112+0000 7efcaf6aa700 1 -- 172.21.15.59:0/4121073214 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca80a25e0 con 0x7efca80a1340 2023-09-30T22:30:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.113+0000 7efc9dffb700 1 -- 172.21.15.59:0/4121073214 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc980075a0 con 0x7efca80a1340 2023-09-30T22:30:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.113+0000 7efcaf6aa700 1 -- 172.21.15.59:0/4121073214 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca8074ea0 con 0x7efca80a1340 2023-09-30T22:30:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.114+0000 7efc9dffb700 1 -- 172.21.15.59:0/4121073214 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efc9803e7f0 con 0x7efca80a1340 2023-09-30T22:30:34.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.118+0000 7efc9dffb700 1 -- 172.21.15.59:0/4121073214 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc98018af0 con 0x7efca80a1340 2023-09-30T22:30:34.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.239+0000 7fc91bfff700 1 -- 172.21.15.59:0/3047553728 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc914005860 con 0x7fc93806b080 2023-09-30T22:30:34.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.240+0000 7fc92e7fc700 1 -- 172.21.15.59:0/3047553728 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc928015030 con 0x7fc93806b080 2023-09-30T22:30:34.240 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:34.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.242+0000 7fc91bfff700 1 -- 172.21.15.59:0/3047553728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc93806b080 msgr2=0x7fc93809a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.242+0000 7fc91bfff700 1 --2- 172.21.15.59:0/3047553728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc93806b080 0x7fc93809a940 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc928016000 tx=0x7fc928004750 comp rx=0 tx=0).stop 2023-09-30T22:30:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.242+0000 7fc91bfff700 1 -- 172.21.15.59:0/3047553728 shutdown_connections 2023-09-30T22:30:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.242+0000 7fc91bfff700 1 --2- 172.21.15.59:0/3047553728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc938131b40 0x7fc93809ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.242+0000 7fc91bfff700 1 --2- 172.21.15.59:0/3047553728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc93806a770 0x7fc93809a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.242+0000 7fc91bfff700 1 --2- 172.21.15.59:0/3047553728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc93806b080 0x7fc93809a940 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.242+0000 7fc91bfff700 1 -- 172.21.15.59:0/3047553728 >> 172.21.15.59:0/3047553728 conn(0x7fc938066f50 msgr2=0x7fc9380714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.242+0000 7fc91bfff700 1 -- 172.21.15.59:0/3047553728 shutdown_connections 2023-09-30T22:30:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.242+0000 7fc91bfff700 1 -- 172.21.15.59:0/3047553728 wait complete. 2023-09-30T22:30:34.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:34.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.289+0000 7f9f20edf700 1 -- 172.21.15.59:0/3819655393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9f1c06b250 con 0x7f9f1c133e30 2023-09-30T22:30:34.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.290+0000 7f9f12ffd700 1 -- 172.21.15.59:0/3819655393 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f04017030 con 0x7f9f1c133e30 2023-09-30T22:30:34.290 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:34.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.292+0000 7f9f20edf700 1 -- 172.21.15.59:0/3819655393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f1c133e30 msgr2=0x7f9f1c09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.292+0000 7f9f20edf700 1 --2- 172.21.15.59:0/3819655393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f1c133e30 0x7f9f1c09c9c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c09f2c0 tx=0x7f9f0400c710 comp rx=0 tx=0).stop 2023-09-30T22:30:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.292+0000 7f9f20edf700 1 -- 172.21.15.59:0/3819655393 shutdown_connections 2023-09-30T22:30:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.292+0000 7f9f20edf700 1 --2- 172.21.15.59:0/3819655393 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f1c133420 0x7f9f1c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.292+0000 7f9f20edf700 1 --2- 172.21.15.59:0/3819655393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1c134260 0x7f9f1c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.292+0000 7f9f20edf700 1 --2- 172.21.15.59:0/3819655393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f1c133e30 0x7f9f1c09c9c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.292+0000 7f9f20edf700 1 -- 172.21.15.59:0/3819655393 >> 172.21.15.59:0/3819655393 conn(0x7f9f1c0a4210 msgr2=0x7f9f1c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.292+0000 7f9f20edf700 1 -- 172.21.15.59:0/3819655393 shutdown_connections 2023-09-30T22:30:34.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.292+0000 7f9f20edf700 1 -- 172.21.15.59:0/3819655393 wait complete. 2023-09-30T22:30:34.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:34.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.327+0000 7efcaf6aa700 1 -- 172.21.15.59:0/4121073214 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efca81331e0 con 0x7efca80a1340 2023-09-30T22:30:34.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.328+0000 7efc9dffb700 1 -- 172.21.15.59:0/4121073214 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc98017020 con 0x7efca80a1340 2023-09-30T22:30:34.328 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:34.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.330+0000 7efcaf6aa700 1 -- 172.21.15.59:0/4121073214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca80a1340 msgr2=0x7efca8122c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.330+0000 7efcaf6aa700 1 --2- 172.21.15.59:0/4121073214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca80a1340 0x7efca8122c50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc9800c490 tx=0x7efc9800c7a0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.330+0000 7efcaf6aa700 1 -- 172.21.15.59:0/4121073214 shutdown_connections 2023-09-30T22:30:34.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.330+0000 7efcaf6aa700 1 --2- 172.21.15.59:0/4121073214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca8134170 0x7efca8123190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.330+0000 7efcaf6aa700 1 --2- 172.21.15.59:0/4121073214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efca80a0a30 0x7efca8122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.330+0000 7efcaf6aa700 1 --2- 172.21.15.59:0/4121073214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca80a1340 0x7efca8122c50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.330+0000 7efcaf6aa700 1 -- 172.21.15.59:0/4121073214 >> 172.21.15.59:0/4121073214 conn(0x7efca80a6550 msgr2=0x7efca809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:34.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.330+0000 7efcaf6aa700 1 -- 172.21.15.59:0/4121073214 shutdown_connections 2023-09-30T22:30:34.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.330+0000 7efcaf6aa700 1 -- 172.21.15.59:0/4121073214 wait complete. 2023-09-30T22:30:34.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:34.575 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:34.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.719+0000 7f16aa2f7700 1 Processor -- start 2023-09-30T22:30:34.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.719+0000 7f16aa2f7700 1 -- start start 2023-09-30T22:30:34.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.720+0000 7f16aa2f7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16a409d6f0 0x7f16a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.720+0000 7f16aa2f7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16a409e410 0x7f16a4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.720+0000 7f16aa2f7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a409f130 con 0x7f16a409e000 2023-09-30T22:30:34.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.720+0000 7f16aa2f7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a409f520 con 0x7f16a409d6f0 2023-09-30T22:30:34.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.720+0000 7f16aa2f7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16a409e930 con 0x7f16a409e410 2023-09-30T22:30:34.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.720+0000 7f16a3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16a409d6f0 0x7f16a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.720+0000 7f16a8894700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16a409e410 0x7f16a4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.720+0000 7f16a8894700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16a409e410 0x7f16a4130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32784/0 (socket says 172.21.15.59:32784) 2023-09-30T22:30:34.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.720+0000 7f16a3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16a409d6f0 0x7f16a409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57444/0 (socket says 172.21.15.59:57444) 2023-09-30T22:30:34.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.720+0000 7f16a8894700 1 -- 172.21.15.59:0/1380972703 learned_addr learned my addr 172.21.15.59:0/1380972703 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:34.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.721+0000 7f16a3fff700 1 -- 172.21.15.59:0/1380972703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16a409e410 msgr2=0x7f16a4130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:34.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.721+0000 7f16a3fff700 1 --2- 172.21.15.59:0/1380972703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16a409e410 0x7f16a4130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.721+0000 7f16a3fff700 1 -- 172.21.15.59:0/1380972703 >> v1:172.21.15.59:6789/0 conn(0x7f16a409e000 legacy=0x7f16a4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.721+0000 7f16a3fff700 1 -- 172.21.15.59:0/1380972703 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a409b2d0 con 0x7f16a409d6f0 2023-09-30T22:30:34.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.721+0000 7f16a8894700 1 --2- 172.21.15.59:0/1380972703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16a409e410 0x7f16a4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:34.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.721+0000 7f16a3fff700 1 --2- 172.21.15.59:0/1380972703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a409d6f0 0x7f16a409dac0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1694009840 tx=0x7f1694009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0eb92178ff71bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:34.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.721+0000 7f16a2ffd700 1 -- 172.21.15.59:0/1380972703 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694011830 con 0x7f16a409d6f0 2023-09-30T22:30:34.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.721+0000 7f16a2ffd700 1 -- 172.21.15.59:0/1380972703 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694011990 con 0x7f16a409d6f0 2023-09-30T22:30:34.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.721+0000 7f16a2ffd700 1 -- 172.21.15.59:0/1380972703 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694011d20 con 0x7f16a409d6f0 2023-09-30T22:30:34.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.722+0000 7f16aa2f7700 1 -- 172.21.15.59:0/1380972703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a409d6f0 msgr2=0x7f16a409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.722+0000 7f16aa2f7700 1 --2- 172.21.15.59:0/1380972703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a409d6f0 0x7f16a409dac0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1694009840 tx=0x7f1694009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:34.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.722+0000 7f16aa2f7700 1 -- 172.21.15.59:0/1380972703 shutdown_connections 2023-09-30T22:30:34.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.722+0000 7f16aa2f7700 1 --2- 172.21.15.59:0/1380972703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16a409e410 0x7f16a4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.722+0000 7f16aa2f7700 1 --2- 172.21.15.59:0/1380972703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a409d6f0 0x7f16a409dac0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.722+0000 7f16aa2f7700 1 -- 172.21.15.59:0/1380972703 >> 172.21.15.59:0/1380972703 conn(0x7f16a4066f50 msgr2=0x7f16a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:34.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.722+0000 7f16aa2f7700 1 -- 172.21.15.59:0/1380972703 shutdown_connections 2023-09-30T22:30:34.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.722+0000 7f16aa2f7700 1 -- 172.21.15.59:0/1380972703 wait complete. 2023-09-30T22:30:34.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.723+0000 7f16aa2f7700 1 Processor -- start 2023-09-30T22:30:34.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.723+0000 7f16aa2f7700 1 -- start start 2023-09-30T22:30:34.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.723+0000 7f16aa2f7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16a409d6f0 0x7f16a4120160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.723+0000 7f16aa2f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16a409e000 0x7f16a41206a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.723+0000 7f16aa2f7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a409e410 0x7f16a4120be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.723+0000 7f16aa2f7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a4122390 con 0x7f16a409e410 2023-09-30T22:30:34.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.723+0000 7f16aa2f7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a409c700 con 0x7f16a409e000 2023-09-30T22:30:34.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.723+0000 7f16aa2f7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16a4121d70 con 0x7f16a409d6f0 2023-09-30T22:30:34.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16a3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16a409d6f0 0x7f16a4120160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16a8894700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a409e410 0x7f16a4120be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16a3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16a409d6f0 0x7f16a4120160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32798/0 (socket says 172.21.15.59:32798) 2023-09-30T22:30:34.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16a3fff700 1 -- 172.21.15.59:0/1415683502 learned_addr learned my addr 172.21.15.59:0/1415683502 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:34.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16a37fe700 1 --2- 172.21.15.59:0/1415683502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16a409e000 0x7f16a41206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16a3fff700 1 -- 172.21.15.59:0/1415683502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16a409e000 msgr2=0x7f16a41206a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16a3fff700 1 --2- 172.21.15.59:0/1415683502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16a409e000 0x7f16a41206a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16a3fff700 1 -- 172.21.15.59:0/1415683502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a409e410 msgr2=0x7f16a4120be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16a3fff700 1 --2- 172.21.15.59:0/1415683502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a409e410 0x7f16a4120be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16a3fff700 1 -- 172.21.15.59:0/1415683502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c009b30 con 0x7f16a409d6f0 2023-09-30T22:30:34.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16a8894700 1 --2- 172.21.15.59:0/1415683502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a409e410 0x7f16a4120be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:34.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16a3fff700 1 --2- 172.21.15.59:0/1415683502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16a409d6f0 0x7f16a4120160 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1694009fd0 tx=0x7f1694004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:34.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16a0ff9700 1 -- 172.21.15.59:0/1415683502 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16940036a0 con 0x7f16a409d6f0 2023-09-30T22:30:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16a0ff9700 1 -- 172.21.15.59:0/1415683502 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169401f070 con 0x7f16a409d6f0 2023-09-30T22:30:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16aa2f7700 1 -- 172.21.15.59:0/1415683502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16940094a0 con 0x7f16a409d6f0 2023-09-30T22:30:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16a0ff9700 1 -- 172.21.15.59:0/1415683502 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694003a60 con 0x7f16a409d6f0 2023-09-30T22:30:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.724+0000 7f16aa2f7700 1 -- 172.21.15.59:0/1415683502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a4122560 con 0x7f16a409d6f0 2023-09-30T22:30:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.725+0000 7f16aa2f7700 1 -- 172.21.15.59:0/1415683502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a4123820 con 0x7f16a409d6f0 2023-09-30T22:30:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.726+0000 7f16a0ff9700 1 -- 172.21.15.59:0/1415683502 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1694003bc0 con 0x7f16a409d6f0 2023-09-30T22:30:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.726+0000 7f16a0ff9700 1 -- 172.21.15.59:0/1415683502 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1694021070 con 0x7f16a409d6f0 2023-09-30T22:30:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.730+0000 7f16a0ff9700 1 -- 172.21.15.59:0/1415683502 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1694025db0 con 0x7f16a409d6f0 2023-09-30T22:30:34.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.935+0000 7f16aa2f7700 1 -- 172.21.15.59:0/1415683502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f16a4123820 con 0x7f16a409d6f0 2023-09-30T22:30:34.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.935+0000 7f16a0ff9700 1 -- 172.21.15.59:0/1415683502 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1694025bd0 con 0x7f16a409d6f0 2023-09-30T22:30:34.935 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:34.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.938+0000 7f16aa2f7700 1 -- 172.21.15.59:0/1415683502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16a409d6f0 msgr2=0x7f16a4120160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.938+0000 7f16aa2f7700 1 --2- 172.21.15.59:0/1415683502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16a409d6f0 0x7f16a4120160 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1694009fd0 tx=0x7f1694004750 comp rx=0 tx=0).stop 2023-09-30T22:30:34.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.938+0000 7f16aa2f7700 1 -- 172.21.15.59:0/1415683502 shutdown_connections 2023-09-30T22:30:34.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.938+0000 7f16aa2f7700 1 --2- 172.21.15.59:0/1415683502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16a409d6f0 0x7f16a4120160 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.938+0000 7f16aa2f7700 1 --2- 172.21.15.59:0/1415683502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16a409e410 0x7f16a4120be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.938+0000 7f16aa2f7700 1 --2- 172.21.15.59:0/1415683502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16a409e000 0x7f16a41206a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.938+0000 7f16aa2f7700 1 -- 172.21.15.59:0/1415683502 >> 172.21.15.59:0/1415683502 conn(0x7f16a4066f50 msgr2=0x7f16a406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:34.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.938+0000 7f16aa2f7700 1 -- 172.21.15.59:0/1415683502 shutdown_connections 2023-09-30T22:30:34.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:34.938+0000 7f16aa2f7700 1 -- 172.21.15.59:0/1415683502 wait complete. 2023-09-30T22:30:34.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:35.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:35.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:35.345 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:35.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.409+0000 7fa7768cc700 1 Processor -- start 2023-09-30T22:30:35.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.409+0000 7fa7768cc700 1 -- start start 2023-09-30T22:30:35.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa7768cc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009e930 0x7fa77009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa7768cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009f240 0x7fa7701317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa7768cc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa77009f650 0x7fa770131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa7768cc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa770070940 con 0x7fa77009f650 2023-09-30T22:30:35.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa7768cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77006fd60 con 0x7fa77009f240 2023-09-30T22:30:35.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa7768cc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa77006fa80 con 0x7fa77009e930 2023-09-30T22:30:35.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa76ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009e930 0x7fa77009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa774e69700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa77009f650 0x7fa770131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa76f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009f240 0x7fa7701317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa76ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009e930 0x7fa77009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32814/0 (socket says 172.21.15.59:32814) 2023-09-30T22:30:35.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa76ffff700 1 -- 172.21.15.59:0/1694444217 learned_addr learned my addr 172.21.15.59:0/1694444217 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:35.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa774e69700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa77009f650 0x7fa770131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57468/0 (socket says 172.21.15.59:57468) 2023-09-30T22:30:35.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa76f7fe700 1 -- 172.21.15.59:0/1694444217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009e930 msgr2=0x7fa77009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:35.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa76f7fe700 1 --2- 172.21.15.59:0/1694444217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009e930 0x7fa77009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa76f7fe700 1 -- 172.21.15.59:0/1694444217 >> v2:172.21.15.59:3300/0 conn(0x7fa77009f650 msgr2=0x7fa770131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa76f7fe700 1 --2- 172.21.15.59:0/1694444217 >> v2:172.21.15.59:3300/0 conn(0x7fa77009f650 0x7fa770131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa76f7fe700 1 -- 172.21.15.59:0/1694444217 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77009fb60 con 0x7fa77009f240 2023-09-30T22:30:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa76ffff700 1 --2- 172.21.15.59:0/1694444217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009e930 0x7fa77009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.410+0000 7fa774e69700 1 --2- 172.21.15.59:0/1694444217 >> v2:172.21.15.59:3300/0 conn(0x7fa77009f650 0x7fa770131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.411+0000 7fa76f7fe700 1 --2- 172.21.15.59:0/1694444217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009f240 0x7fa7701317f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa764009840 tx=0x7fa764009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bda6deabb6313172 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.411+0000 7fa76effd700 1 -- 172.21.15.59:0/1694444217 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764011830 con 0x7fa77009f240 2023-09-30T22:30:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.411+0000 7fa76effd700 1 -- 172.21.15.59:0/1694444217 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa764011990 con 0x7fa77009f240 2023-09-30T22:30:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.411+0000 7fa76effd700 1 -- 172.21.15.59:0/1694444217 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764011d20 con 0x7fa77009f240 2023-09-30T22:30:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.411+0000 7fa7768cc700 1 -- 172.21.15.59:0/1694444217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009f240 msgr2=0x7fa7701317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.411+0000 7fa7768cc700 1 --2- 172.21.15.59:0/1694444217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009f240 0x7fa7701317f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa764009840 tx=0x7fa764009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.412+0000 7fa7768cc700 1 -- 172.21.15.59:0/1694444217 shutdown_connections 2023-09-30T22:30:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.412+0000 7fa7768cc700 1 --2- 172.21.15.59:0/1694444217 >> v2:172.21.15.59:3300/0 conn(0x7fa77009f650 0x7fa770131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.412+0000 7fa7768cc700 1 --2- 172.21.15.59:0/1694444217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009e930 0x7fa77009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.412+0000 7fa7768cc700 1 --2- 172.21.15.59:0/1694444217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009f240 0x7fa7701317f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.412+0000 7fa7768cc700 1 -- 172.21.15.59:0/1694444217 >> 172.21.15.59:0/1694444217 conn(0x7fa7700a4210 msgr2=0x7fa7700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.412+0000 7fa7768cc700 1 -- 172.21.15.59:0/1694444217 shutdown_connections 2023-09-30T22:30:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.412+0000 7fa7768cc700 1 -- 172.21.15.59:0/1694444217 wait complete. 2023-09-30T22:30:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.413+0000 7fa7768cc700 1 Processor -- start 2023-09-30T22:30:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.413+0000 7fa7768cc700 1 -- start start 2023-09-30T22:30:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.414+0000 7fa7768cc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009e930 0x7fa7701c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.414+0000 7fa7768cc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa77009f240 0x7fa7701c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.414+0000 7fa7768cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009f650 0x7fa7701c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.414+0000 7fa7768cc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7701a94e0 con 0x7fa77009f240 2023-09-30T22:30:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.414+0000 7fa7768cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7701a96c0 con 0x7fa77009f650 2023-09-30T22:30:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.414+0000 7fa7768cc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7701c90b0 con 0x7fa77009e930 2023-09-30T22:30:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.414+0000 7fa76ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009e930 0x7fa7701c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.414+0000 7fa76ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009e930 0x7fa7701c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32822/0 (socket says 172.21.15.59:32822) 2023-09-30T22:30:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.414+0000 7fa76ffff700 1 -- 172.21.15.59:0/2659784219 learned_addr learned my addr 172.21.15.59:0/2659784219 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.414+0000 7fa76f7fe700 1 --2- 172.21.15.59:0/2659784219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa77009f240 0x7fa7701c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.414+0000 7fa774e69700 1 --2- 172.21.15.59:0/2659784219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009f650 0x7fa7701c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.415+0000 7fa76ffff700 1 -- 172.21.15.59:0/2659784219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009f650 msgr2=0x7fa7701c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.415+0000 7fa76ffff700 1 --2- 172.21.15.59:0/2659784219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009f650 0x7fa7701c4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.415+0000 7fa76ffff700 1 -- 172.21.15.59:0/2659784219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa77009f240 msgr2=0x7fa7701c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.415+0000 7fa76ffff700 1 --2- 172.21.15.59:0/2659784219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa77009f240 0x7fa7701c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.415+0000 7fa76ffff700 1 -- 172.21.15.59:0/2659784219 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa760009550 con 0x7fa77009e930 2023-09-30T22:30:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.415+0000 7fa76f7fe700 1 --2- 172.21.15.59:0/2659784219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa77009f240 0x7fa7701c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.415+0000 7fa774e69700 1 --2- 172.21.15.59:0/2659784219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009f650 0x7fa7701c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.415+0000 7fa76ffff700 1 --2- 172.21.15.59:0/2659784219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009e930 0x7fa7701c8630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa76000ec10 tx=0x7fa76000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.415+0000 7fa76cff9700 1 -- 172.21.15.59:0/2659784219 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760004030 con 0x7fa77009e930 2023-09-30T22:30:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.415+0000 7fa76cff9700 1 -- 172.21.15.59:0/2659784219 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa760004190 con 0x7fa77009e930 2023-09-30T22:30:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.415+0000 7fa76cff9700 1 -- 172.21.15.59:0/2659784219 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760004520 con 0x7fa77009e930 2023-09-30T22:30:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.415+0000 7fa7768cc700 1 -- 172.21.15.59:0/2659784219 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa768009a70 con 0x7fa77009e930 2023-09-30T22:30:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.415+0000 7fa7768cc700 1 -- 172.21.15.59:0/2659784219 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7640094a0 con 0x7fa77009e930 2023-09-30T22:30:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.416+0000 7fa76cff9700 1 -- 172.21.15.59:0/2659784219 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa76000c850 con 0x7fa77009e930 2023-09-30T22:30:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.416+0000 7fa7768cc700 1 -- 172.21.15.59:0/2659784219 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7700a3450 con 0x7fa77009e930 2023-09-30T22:30:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.417+0000 7fa76cff9700 1 -- 172.21.15.59:0/2659784219 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa76003f890 con 0x7fa77009e930 2023-09-30T22:30:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.421+0000 7fa76cff9700 1 -- 172.21.15.59:0/2659784219 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7600036a0 con 0x7fa77009e930 2023-09-30T22:30:35.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.454+0000 7f93b4a9b700 1 Processor -- start 2023-09-30T22:30:35.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.454+0000 7f93b4a9b700 1 -- start start 2023-09-30T22:30:35.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.454+0000 7f93b4a9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93b009d6f0 0x7f93b009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.454+0000 7f93b4a9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009e440 0x7f93b0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.454+0000 7f93b4a9b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b009b120 con 0x7f93b009e000 2023-09-30T22:30:35.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.454+0000 7f93b4a9b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b006b460 con 0x7f93b009d6f0 2023-09-30T22:30:35.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.454+0000 7f93b4a9b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b009a7e0 con 0x7f93b009e440 2023-09-30T22:30:35.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.455+0000 7f93aed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009e440 0x7f93b0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.455+0000 7f93ae59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93b009d6f0 0x7f93b009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.455+0000 7f93aed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009e440 0x7f93b0134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33380/0 (socket says 172.21.15.59:33380) 2023-09-30T22:30:35.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.455+0000 7f93aed9d700 1 -- 172.21.15.59:0/171986018 learned_addr learned my addr 172.21.15.59:0/171986018 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:35.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.455+0000 7f93ae59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93b009d6f0 0x7f93b009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57482/0 (socket says 172.21.15.59:57482) 2023-09-30T22:30:35.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.455+0000 7f93aed9d700 1 -- 172.21.15.59:0/171986018 >> v2:172.21.15.59:3300/0 conn(0x7f93b009d6f0 msgr2=0x7f93b009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:35.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.455+0000 7f93aed9d700 1 --2- 172.21.15.59:0/171986018 >> v2:172.21.15.59:3300/0 conn(0x7f93b009d6f0 0x7f93b009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.455+0000 7f93aed9d700 1 -- 172.21.15.59:0/171986018 >> v1:172.21.15.59:6789/0 conn(0x7f93b009e000 legacy=0x7f93b01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.455+0000 7f93aed9d700 1 -- 172.21.15.59:0/171986018 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b009a500 con 0x7f93b009e440 2023-09-30T22:30:35.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.455+0000 7f93aed9d700 1 --2- 172.21.15.59:0/171986018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009e440 0x7f93b0134100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009e80 tx=0x7f93a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2192d10bd5a3253 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:35.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.455+0000 7f93ad59a700 1 -- 172.21.15.59:0/171986018 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a800e070 con 0x7f93b009e440 2023-09-30T22:30:35.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.455+0000 7f93ad59a700 1 -- 172.21.15.59:0/171986018 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a800b8d0 con 0x7f93b009e440 2023-09-30T22:30:35.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.455+0000 7f93ad59a700 1 -- 172.21.15.59:0/171986018 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a800bc80 con 0x7f93b009e440 2023-09-30T22:30:35.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.456+0000 7f93b4a9b700 1 -- 172.21.15.59:0/171986018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009e440 msgr2=0x7f93b0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.456+0000 7f93b4a9b700 1 --2- 172.21.15.59:0/171986018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009e440 0x7f93b0134100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009e80 tx=0x7f93a800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:35.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.456+0000 7f93b4a9b700 1 -- 172.21.15.59:0/171986018 shutdown_connections 2023-09-30T22:30:35.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.456+0000 7f93b4a9b700 1 --2- 172.21.15.59:0/171986018 >> v2:172.21.15.59:3300/0 conn(0x7f93b009d6f0 0x7f93b009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.456+0000 7f93b4a9b700 1 --2- 172.21.15.59:0/171986018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009e440 0x7f93b0134100 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.456+0000 7f93b4a9b700 1 -- 172.21.15.59:0/171986018 >> 172.21.15.59:0/171986018 conn(0x7f93b0066f50 msgr2=0x7f93b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:35.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.456+0000 7f93b4a9b700 1 -- 172.21.15.59:0/171986018 shutdown_connections 2023-09-30T22:30:35.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.456+0000 7f93b4a9b700 1 -- 172.21.15.59:0/171986018 wait complete. 2023-09-30T22:30:35.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.458+0000 7f93b4a9b700 1 Processor -- start 2023-09-30T22:30:35.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.458+0000 7f93b4a9b700 1 -- start start 2023-09-30T22:30:35.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.458+0000 7f93b4a9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009d6f0 0x7f93b01a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.458+0000 7f93b4a9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009e000 0x7f93b01a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.458+0000 7f93b4a9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b009e440 0x7f93b01a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.458+0000 7f93b4a9b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b01a81f0 con 0x7f93b009e000 2023-09-30T22:30:35.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.458+0000 7f93b4a9b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b01a6b10 con 0x7f93b009d6f0 2023-09-30T22:30:35.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.458+0000 7f93b4a9b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93b01a86a0 con 0x7f93b009e440 2023-09-30T22:30:35.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.458+0000 7f93ae59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009d6f0 0x7f93b01a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.458+0000 7f93ae59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009d6f0 0x7f93b01a4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33396/0 (socket says 172.21.15.59:33396) 2023-09-30T22:30:35.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.458+0000 7f93ae59c700 1 -- 172.21.15.59:0/2121450917 learned_addr learned my addr 172.21.15.59:0/2121450917 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:35.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.458+0000 7f93aed9d700 1 --2- 172.21.15.59:0/2121450917 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b009e440 0x7f93b01a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.458+0000 7f93add9b700 1 --2- 172.21.15.59:0/2121450917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009e000 0x7f93b01a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.459+0000 7f93ae59c700 1 -- 172.21.15.59:0/2121450917 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b009e440 msgr2=0x7f93b01a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.459+0000 7f93ae59c700 1 --2- 172.21.15.59:0/2121450917 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b009e440 0x7f93b01a58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.459+0000 7f93ae59c700 1 -- 172.21.15.59:0/2121450917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009e000 msgr2=0x7f93b01a53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.459+0000 7f93ae59c700 1 --2- 172.21.15.59:0/2121450917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009e000 0x7f93b01a53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.459+0000 7f93ae59c700 1 -- 172.21.15.59:0/2121450917 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a8009b30 con 0x7f93b009d6f0 2023-09-30T22:30:35.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.459+0000 7f93add9b700 1 --2- 172.21.15.59:0/2121450917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009e000 0x7f93b01a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:35.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.459+0000 7f93ae59c700 1 --2- 172.21.15.59:0/2121450917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009d6f0 0x7f93b01a4e60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f93a000e9b0 tx=0x7f93a000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:35.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.459+0000 7f939effd700 1 -- 172.21.15.59:0/2121450917 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a0009710 con 0x7f93b009d6f0 2023-09-30T22:30:35.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.459+0000 7f939effd700 1 -- 172.21.15.59:0/2121450917 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a000c850 con 0x7f93b009d6f0 2023-09-30T22:30:35.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.459+0000 7f93b4a9b700 1 -- 172.21.15.59:0/2121450917 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b00a1fb0 con 0x7f93b009d6f0 2023-09-30T22:30:35.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.459+0000 7f939effd700 1 -- 172.21.15.59:0/2121450917 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a000cbc0 con 0x7f93b009d6f0 2023-09-30T22:30:35.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.459+0000 7f93b4a9b700 1 -- 172.21.15.59:0/2121450917 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b01a8980 con 0x7f93b009d6f0 2023-09-30T22:30:35.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.460+0000 7f939effd700 1 -- 172.21.15.59:0/2121450917 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93a000cd20 con 0x7f93b009d6f0 2023-09-30T22:30:35.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.460+0000 7f939effd700 1 -- 172.21.15.59:0/2121450917 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f93a003fb60 con 0x7f93b009d6f0 2023-09-30T22:30:35.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.460+0000 7f93b4a9b700 1 -- 172.21.15.59:0/2121450917 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b0074ea0 con 0x7f93b009d6f0 2023-09-30T22:30:35.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.465+0000 7f939effd700 1 -- 172.21.15.59:0/2121450917 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93a0017080 con 0x7f93b009d6f0 2023-09-30T22:30:35.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.493+0000 7fc7c2c49700 1 Processor -- start 2023-09-30T22:30:35.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.493+0000 7fc7c2c49700 1 -- start start 2023-09-30T22:30:35.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.494+0000 7fc7c2c49700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc7bc06a770 0x7fc7bc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.494+0000 7fc7c2c49700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7bc06b080 0x7fc7bc131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.494+0000 7fc7c2c49700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7bc09ece0 con 0x7fc7bc131b40 2023-09-30T22:30:35.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.494+0000 7fc7c2c49700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7bc09e760 con 0x7fc7bc06a770 2023-09-30T22:30:35.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.494+0000 7fc7c2c49700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc09e040 con 0x7fc7bc06b080 2023-09-30T22:30:35.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.494+0000 7fc7bbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7bc06b080 0x7fc7bc131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.494+0000 7fc7bbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7bc06b080 0x7fc7bc131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32834/0 (socket says 172.21.15.59:32834) 2023-09-30T22:30:35.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.494+0000 7fc7bbfff700 1 -- 172.21.15.59:0/1085742150 learned_addr learned my addr 172.21.15.59:0/1085742150 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:35.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.494+0000 7fc7c09e5700 1 --2- 172.21.15.59:0/1085742150 >> v2:172.21.15.59:3300/0 conn(0x7fc7bc06a770 0x7fc7bc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.494+0000 7fc7bbfff700 1 -- 172.21.15.59:0/1085742150 >> v2:172.21.15.59:3300/0 conn(0x7fc7bc06a770 msgr2=0x7fc7bc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.494+0000 7fc7bbfff700 1 --2- 172.21.15.59:0/1085742150 >> v2:172.21.15.59:3300/0 conn(0x7fc7bc06a770 0x7fc7bc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.494+0000 7fc7bbfff700 1 -- 172.21.15.59:0/1085742150 >> v1:172.21.15.59:6789/0 conn(0x7fc7bc131b40 legacy=0x7fc7bc138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.494+0000 7fc7bbfff700 1 -- 172.21.15.59:0/1085742150 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc09f630 con 0x7fc7bc06b080 2023-09-30T22:30:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.494+0000 7fc7c09e5700 1 --2- 172.21.15.59:0/1085742150 >> v2:172.21.15.59:3300/0 conn(0x7fc7bc06a770 0x7fc7bc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.495+0000 7fc7bbfff700 1 --2- 172.21.15.59:0/1085742150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7bc06b080 0x7fc7bc131600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80098f0 tx=0x7fc7a8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcaa89d8cdd9b909 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.495+0000 7fc7bb7fe700 1 -- 172.21.15.59:0/1085742150 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800b8a0 con 0x7fc7bc06b080 2023-09-30T22:30:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.495+0000 7fc7bb7fe700 1 -- 172.21.15.59:0/1085742150 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a800ba00 con 0x7fc7bc06b080 2023-09-30T22:30:35.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.495+0000 7fc7bb7fe700 1 -- 172.21.15.59:0/1085742150 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800bd90 con 0x7fc7bc06b080 2023-09-30T22:30:35.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.495+0000 7fc7c2c49700 1 -- 172.21.15.59:0/1085742150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7bc06b080 msgr2=0x7fc7bc131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.495+0000 7fc7c2c49700 1 --2- 172.21.15.59:0/1085742150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7bc06b080 0x7fc7bc131600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80098f0 tx=0x7fc7a8009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:35.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.496+0000 7fc7c2c49700 1 -- 172.21.15.59:0/1085742150 shutdown_connections 2023-09-30T22:30:35.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.496+0000 7fc7c2c49700 1 --2- 172.21.15.59:0/1085742150 >> v2:172.21.15.59:3300/0 conn(0x7fc7bc06a770 0x7fc7bc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.496+0000 7fc7c2c49700 1 --2- 172.21.15.59:0/1085742150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7bc06b080 0x7fc7bc131600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.496+0000 7fc7c2c49700 1 -- 172.21.15.59:0/1085742150 >> 172.21.15.59:0/1085742150 conn(0x7fc7bc066f50 msgr2=0x7fc7bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:35.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.496+0000 7fc7c2c49700 1 -- 172.21.15.59:0/1085742150 shutdown_connections 2023-09-30T22:30:35.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.496+0000 7fc7c2c49700 1 -- 172.21.15.59:0/1085742150 wait complete. 2023-09-30T22:30:35.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.497+0000 7fc7c2c49700 1 Processor -- start 2023-09-30T22:30:35.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.497+0000 7fc7c2c49700 1 -- start start 2023-09-30T22:30:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.498+0000 7fc7c2c49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7bc06a770 0x7fc7bc1c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.498+0000 7fc7c2c49700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7bc06b080 0x7fc7bc1c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.498+0000 7fc7c2c49700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7bc131b40 0x7fc7bc1c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.498+0000 7fc7c2c49700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc11fd50 con 0x7fc7bc06b080 2023-09-30T22:30:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.498+0000 7fc7c2c49700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc131520 con 0x7fc7bc06a770 2023-09-30T22:30:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.498+0000 7fc7c2c49700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc11fa90 con 0x7fc7bc131b40 2023-09-30T22:30:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.498+0000 7fc7c09e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7bc06a770 0x7fc7bc1c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.498+0000 7fc7c09e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7bc06a770 0x7fc7bc1c5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33410/0 (socket says 172.21.15.59:33410) 2023-09-30T22:30:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.498+0000 7fc7c09e5700 1 -- 172.21.15.59:0/1631700066 learned_addr learned my addr 172.21.15.59:0/1631700066 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.498+0000 7fc7bbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7bc06b080 0x7fc7bc1c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.498+0000 7fc7c11e6700 1 --2- 172.21.15.59:0/1631700066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7bc131b40 0x7fc7bc1c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.499+0000 7fc7bbfff700 1 -- 172.21.15.59:0/1631700066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7bc131b40 msgr2=0x7fc7bc1c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.499+0000 7fc7bbfff700 1 --2- 172.21.15.59:0/1631700066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7bc131b40 0x7fc7bc1c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.499+0000 7fc7bbfff700 1 -- 172.21.15.59:0/1631700066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7bc06a770 msgr2=0x7fc7bc1c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.499+0000 7fc7bbfff700 1 --2- 172.21.15.59:0/1631700066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7bc06a770 0x7fc7bc1c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.499+0000 7fc7bbfff700 1 -- 172.21.15.59:0/1631700066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a8009550 con 0x7fc7bc06b080 2023-09-30T22:30:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.499+0000 7fc7c09e5700 1 --2- 172.21.15.59:0/1631700066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7bc06a770 0x7fc7bc1c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:35.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.499+0000 7fc7bbfff700 1 --2- 172.21.15.59:0/1631700066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7bc06b080 0x7fc7bc1c6510 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8016000 tx=0x7fc7a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.499+0000 7fc7b97fa700 1 -- 172.21.15.59:0/1631700066 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8004510 con 0x7fc7bc06b080 2023-09-30T22:30:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.499+0000 7fc7b97fa700 1 -- 172.21.15.59:0/1631700066 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a80036a0 con 0x7fc7bc06b080 2023-09-30T22:30:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.499+0000 7fc7c2c49700 1 -- 172.21.15.59:0/1631700066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7bc071e60 con 0x7fc7bc06b080 2023-09-30T22:30:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.499+0000 7fc7b97fa700 1 -- 172.21.15.59:0/1631700066 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8003a10 con 0x7fc7bc06b080 2023-09-30T22:30:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.499+0000 7fc7c2c49700 1 -- 172.21.15.59:0/1631700066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7bc1207c0 con 0x7fc7bc06b080 2023-09-30T22:30:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.500+0000 7fc7c2c49700 1 -- 172.21.15.59:0/1631700066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7bc11fea0 con 0x7fc7bc06b080 2023-09-30T22:30:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.500+0000 7fc7b97fa700 1 -- 172.21.15.59:0/1631700066 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7a8021070 con 0x7fc7bc06b080 2023-09-30T22:30:35.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.501+0000 7fc7b97fa700 1 -- 172.21.15.59:0/1631700066 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc7a8040ca0 con 0x7fc7bc06b080 2023-09-30T22:30:35.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.505+0000 7fc7b97fa700 1 -- 172.21.15.59:0/1631700066 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7a802e9e0 con 0x7fc7bc06b080 2023-09-30T22:30:35.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.631+0000 7fa7768cc700 1 -- 172.21.15.59:0/2659784219 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa770074ea0 con 0x7fa77009e930 2023-09-30T22:30:35.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.632+0000 7fa76cff9700 1 -- 172.21.15.59:0/2659784219 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa760020030 con 0x7fa77009e930 2023-09-30T22:30:35.632 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:35.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.634+0000 7fa7768cc700 1 -- 172.21.15.59:0/2659784219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009e930 msgr2=0x7fa7701c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.634+0000 7fa7768cc700 1 --2- 172.21.15.59:0/2659784219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009e930 0x7fa7701c8630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa76000ec10 tx=0x7fa76000ef20 comp rx=0 tx=0).stop 2023-09-30T22:30:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.634+0000 7fa7768cc700 1 -- 172.21.15.59:0/2659784219 shutdown_connections 2023-09-30T22:30:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.634+0000 7fa7768cc700 1 --2- 172.21.15.59:0/2659784219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009e930 0x7fa7701c8630 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.634+0000 7fa7768cc700 1 --2- 172.21.15.59:0/2659784219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009f650 0x7fa7701c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.634+0000 7fa7768cc700 1 --2- 172.21.15.59:0/2659784219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa77009f240 0x7fa7701c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.634+0000 7fa7768cc700 1 -- 172.21.15.59:0/2659784219 >> 172.21.15.59:0/2659784219 conn(0x7fa7700a4210 msgr2=0x7fa7701baee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.634+0000 7fa7768cc700 1 -- 172.21.15.59:0/2659784219 shutdown_connections 2023-09-30T22:30:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.634+0000 7fa7768cc700 1 -- 172.21.15.59:0/2659784219 wait complete. 2023-09-30T22:30:35.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:35.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.689+0000 7f93b4a9b700 1 -- 172.21.15.59:0/2121450917 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f93b009f420 con 0x7f93b009d6f0 2023-09-30T22:30:35.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.689+0000 7f939effd700 1 -- 172.21.15.59:0/2121450917 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f93a001b3b0 con 0x7f93b009d6f0 2023-09-30T22:30:35.689 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:35.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.691+0000 7f93b4a9b700 1 -- 172.21.15.59:0/2121450917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009d6f0 msgr2=0x7f93b01a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.691+0000 7f93b4a9b700 1 --2- 172.21.15.59:0/2121450917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009d6f0 0x7f93b01a4e60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f93a000e9b0 tx=0x7f93a000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.691+0000 7f93b4a9b700 1 -- 172.21.15.59:0/2121450917 shutdown_connections 2023-09-30T22:30:35.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.691+0000 7f93b4a9b700 1 --2- 172.21.15.59:0/2121450917 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b009e440 0x7f93b01a58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.691+0000 7f93b4a9b700 1 --2- 172.21.15.59:0/2121450917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009d6f0 0x7f93b01a4e60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.691+0000 7f93b4a9b700 1 --2- 172.21.15.59:0/2121450917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009e000 0x7f93b01a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.692+0000 7f93b4a9b700 1 -- 172.21.15.59:0/2121450917 >> 172.21.15.59:0/2121450917 conn(0x7f93b0066f50 msgr2=0x7f93b01b9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:35.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.692+0000 7f93b4a9b700 1 -- 172.21.15.59:0/2121450917 shutdown_connections 2023-09-30T22:30:35.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.692+0000 7f93b4a9b700 1 -- 172.21.15.59:0/2121450917 wait complete. 2023-09-30T22:30:35.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:35.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.734+0000 7fc7c2c49700 1 -- 172.21.15.59:0/1631700066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc7bc074ea0 con 0x7fc7bc06b080 2023-09-30T22:30:35.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.735+0000 7fc7b97fa700 1 -- 172.21.15.59:0/1631700066 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7a8015020 con 0x7fc7bc06b080 2023-09-30T22:30:35.735 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:35.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.737+0000 7fc7c2c49700 1 -- 172.21.15.59:0/1631700066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7bc06b080 msgr2=0x7fc7bc1c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.737+0000 7fc7c2c49700 1 --2- 172.21.15.59:0/1631700066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7bc06b080 0x7fc7bc1c6510 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8016000 tx=0x7fc7a8004750 comp rx=0 tx=0).stop 2023-09-30T22:30:35.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.737+0000 7fc7c2c49700 1 -- 172.21.15.59:0/1631700066 shutdown_connections 2023-09-30T22:30:35.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.737+0000 7fc7c2c49700 1 --2- 172.21.15.59:0/1631700066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7bc131b40 0x7fc7bc1c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.737+0000 7fc7c2c49700 1 --2- 172.21.15.59:0/1631700066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7bc06a770 0x7fc7bc1c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.737+0000 7fc7c2c49700 1 --2- 172.21.15.59:0/1631700066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7bc06b080 0x7fc7bc1c6510 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.737+0000 7fc7c2c49700 1 -- 172.21.15.59:0/1631700066 >> 172.21.15.59:0/1631700066 conn(0x7fc7bc066f50 msgr2=0x7fc7bc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:35.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.737+0000 7fc7c2c49700 1 -- 172.21.15.59:0/1631700066 shutdown_connections 2023-09-30T22:30:35.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:35.737+0000 7fc7c2c49700 1 -- 172.21.15.59:0/1631700066 wait complete. 2023-09-30T22:30:35.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:35.952 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:36.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.097+0000 7f10638a7700 1 Processor -- start 2023-09-30T22:30:36.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.097+0000 7f10638a7700 1 -- start start 2023-09-30T22:30:36.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.098+0000 7f10638a7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f105c09e1d0 0x7f105c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.098+0000 7f10638a7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f105c135e50 0x7f105c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.098+0000 7f10638a7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105c09f130 con 0x7f105c09d6f0 2023-09-30T22:30:36.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.098+0000 7f10638a7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105c09f520 con 0x7f105c135e50 2023-09-30T22:30:36.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.098+0000 7f10638a7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f105c09e930 con 0x7f105c09e1d0 2023-09-30T22:30:36.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.098+0000 7f1061e44700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f105c135e50 0x7f105c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.098+0000 7f1060e42700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f105c09e1d0 0x7f105c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.098+0000 7f1061e44700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f105c135e50 0x7f105c138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57514/0 (socket says 172.21.15.59:57514) 2023-09-30T22:30:36.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.098+0000 7f1060e42700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f105c09e1d0 0x7f105c135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32846/0 (socket says 172.21.15.59:32846) 2023-09-30T22:30:36.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.098+0000 7f1061e44700 1 -- 172.21.15.59:0/1961007213 learned_addr learned my addr 172.21.15.59:0/1961007213 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:36.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.098+0000 7f1060e42700 1 -- 172.21.15.59:0/1961007213 >> v2:172.21.15.59:3300/0 conn(0x7f105c135e50 msgr2=0x7f105c138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:36.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.098+0000 7f1060e42700 1 --2- 172.21.15.59:0/1961007213 >> v2:172.21.15.59:3300/0 conn(0x7f105c135e50 0x7f105c138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.098+0000 7f1060e42700 1 -- 172.21.15.59:0/1961007213 >> v1:172.21.15.59:6789/0 conn(0x7f105c09d6f0 legacy=0x7f105c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.099+0000 7f1060e42700 1 -- 172.21.15.59:0/1961007213 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c09b2d0 con 0x7f105c09e1d0 2023-09-30T22:30:36.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.099+0000 7f1053fff700 1 -- 172.21.15.59:0/1961007213 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608763411 0 0) 0x7f105c09f130 con 0x7f105c09d6f0 2023-09-30T22:30:36.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.099+0000 7f1061e44700 1 --2- 172.21.15.59:0/1961007213 >> v2:172.21.15.59:3300/0 conn(0x7f105c135e50 0x7f105c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:36.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.099+0000 7f1060e42700 1 --2- 172.21.15.59:0/1961007213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f105c09e1d0 0x7f105c135910 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f104c009870 tx=0x7f104c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=150b59c9643a67fc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:36.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.099+0000 7f1053fff700 1 -- 172.21.15.59:0/1961007213 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c011830 con 0x7f105c09e1d0 2023-09-30T22:30:36.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.099+0000 7f1053fff700 1 -- 172.21.15.59:0/1961007213 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c011990 con 0x7f105c09e1d0 2023-09-30T22:30:36.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.099+0000 7f1053fff700 1 -- 172.21.15.59:0/1961007213 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c011d20 con 0x7f105c09e1d0 2023-09-30T22:30:36.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.099+0000 7f10638a7700 1 -- 172.21.15.59:0/1961007213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f105c09e1d0 msgr2=0x7f105c135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.099+0000 7f10638a7700 1 --2- 172.21.15.59:0/1961007213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f105c09e1d0 0x7f105c135910 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f104c009870 tx=0x7f104c009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:36.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.100+0000 7f10638a7700 1 -- 172.21.15.59:0/1961007213 shutdown_connections 2023-09-30T22:30:36.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.100+0000 7f10638a7700 1 --2- 172.21.15.59:0/1961007213 >> v2:172.21.15.59:3300/0 conn(0x7f105c135e50 0x7f105c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.100+0000 7f10638a7700 1 --2- 172.21.15.59:0/1961007213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f105c09e1d0 0x7f105c135910 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.100+0000 7f10638a7700 1 -- 172.21.15.59:0/1961007213 >> 172.21.15.59:0/1961007213 conn(0x7f105c066f50 msgr2=0x7f105c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:36.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.100+0000 7f10638a7700 1 -- 172.21.15.59:0/1961007213 shutdown_connections 2023-09-30T22:30:36.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.100+0000 7f10638a7700 1 -- 172.21.15.59:0/1961007213 wait complete. 2023-09-30T22:30:36.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.101+0000 7f10638a7700 1 Processor -- start 2023-09-30T22:30:36.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.101+0000 7f10638a7700 1 -- start start 2023-09-30T22:30:36.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.101+0000 7f10638a7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f105c09d6f0 0x7f105c11d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.101+0000 7f10638a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f105c09e1d0 0x7f105c11da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.101+0000 7f10638a7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f105c135e50 0x7f105c11df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.101+0000 7f10638a7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c11e9e0 con 0x7f105c09d6f0 2023-09-30T22:30:36.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.101+0000 7f10638a7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105c11f120 con 0x7f105c09e1d0 2023-09-30T22:30:36.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.101+0000 7f10638a7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f105c121030 con 0x7f105c135e50 2023-09-30T22:30:36.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.101+0000 7f1060e42700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f105c09e1d0 0x7f105c11da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.101+0000 7f1060e42700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f105c09e1d0 0x7f105c11da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33426/0 (socket says 172.21.15.59:33426) 2023-09-30T22:30:36.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.101+0000 7f1060e42700 1 -- 172.21.15.59:0/3685966486 learned_addr learned my addr 172.21.15.59:0/3685966486 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:36.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.101+0000 7f1061e44700 1 --2- 172.21.15.59:0/3685966486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f105c135e50 0x7f105c11df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.101+0000 7f1061643700 1 --2- 172.21.15.59:0/3685966486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f105c09d6f0 0x7f105c11d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.102+0000 7f1060e42700 1 -- 172.21.15.59:0/3685966486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f105c135e50 msgr2=0x7f105c11df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.102+0000 7f1060e42700 1 --2- 172.21.15.59:0/3685966486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f105c135e50 0x7f105c11df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.102+0000 7f1060e42700 1 -- 172.21.15.59:0/3685966486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f105c09d6f0 msgr2=0x7f105c11d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.102+0000 7f1060e42700 1 --2- 172.21.15.59:0/3685966486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f105c09d6f0 0x7f105c11d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.102+0000 7f1060e42700 1 -- 172.21.15.59:0/3685966486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1054009b30 con 0x7f105c09e1d0 2023-09-30T22:30:36.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.102+0000 7f1061e44700 1 --2- 172.21.15.59:0/3685966486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f105c135e50 0x7f105c11df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:36.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.102+0000 7f1060e42700 1 --2- 172.21.15.59:0/3685966486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f105c09e1d0 0x7f105c11da50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f104c000c00 tx=0x7f104c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:36.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.102+0000 7f1051ffb700 1 -- 172.21.15.59:0/3685966486 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c0036a0 con 0x7f105c09e1d0 2023-09-30T22:30:36.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.102+0000 7f1051ffb700 1 -- 172.21.15.59:0/3685966486 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c01f070 con 0x7f105c09e1d0 2023-09-30T22:30:36.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.102+0000 7f10638a7700 1 -- 172.21.15.59:0/3685966486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104c0094a0 con 0x7f105c09e1d0 2023-09-30T22:30:36.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.102+0000 7f1051ffb700 1 -- 172.21.15.59:0/3685966486 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c003a20 con 0x7f105c09e1d0 2023-09-30T22:30:36.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.102+0000 7f10638a7700 1 -- 172.21.15.59:0/3685966486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105c120d50 con 0x7f105c09e1d0 2023-09-30T22:30:36.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.103+0000 7f1051ffb700 1 -- 172.21.15.59:0/3685966486 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f104c003b80 con 0x7f105c09e1d0 2023-09-30T22:30:36.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.103+0000 7f10638a7700 1 -- 172.21.15.59:0/3685966486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105c1209f0 con 0x7f105c09e1d0 2023-09-30T22:30:36.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.103+0000 7f1051ffb700 1 -- 172.21.15.59:0/3685966486 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f104c021070 con 0x7f105c09e1d0 2023-09-30T22:30:36.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.108+0000 7f1051ffb700 1 -- 172.21.15.59:0/3685966486 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f105c1209f0 con 0x7f105c09e1d0 2023-09-30T22:30:36.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.312+0000 7f10638a7700 1 -- 172.21.15.59:0/3685966486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f105c1209f0 con 0x7f105c09e1d0 2023-09-30T22:30:36.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.313+0000 7f1051ffb700 1 -- 172.21.15.59:0/3685966486 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f105c1209f0 con 0x7f105c09e1d0 2023-09-30T22:30:36.313 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:36.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.315+0000 7f10638a7700 1 -- 172.21.15.59:0/3685966486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f105c09e1d0 msgr2=0x7f105c11da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.315+0000 7f10638a7700 1 --2- 172.21.15.59:0/3685966486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f105c09e1d0 0x7f105c11da50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f104c000c00 tx=0x7f104c004750 comp rx=0 tx=0).stop 2023-09-30T22:30:36.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.315+0000 7f10638a7700 1 -- 172.21.15.59:0/3685966486 shutdown_connections 2023-09-30T22:30:36.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.315+0000 7f10638a7700 1 --2- 172.21.15.59:0/3685966486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f105c135e50 0x7f105c11df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.315+0000 7f10638a7700 1 --2- 172.21.15.59:0/3685966486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f105c09d6f0 0x7f105c11d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.315+0000 7f10638a7700 1 --2- 172.21.15.59:0/3685966486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f105c09e1d0 0x7f105c11da50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.315+0000 7f10638a7700 1 -- 172.21.15.59:0/3685966486 >> 172.21.15.59:0/3685966486 conn(0x7f105c066f50 msgr2=0x7f105c071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:36.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.315+0000 7f10638a7700 1 -- 172.21.15.59:0/3685966486 shutdown_connections 2023-09-30T22:30:36.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.315+0000 7f10638a7700 1 -- 172.21.15.59:0/3685966486 wait complete. 2023-09-30T22:30:36.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:36.649 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:36.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:36.752 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:36.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.799+0000 7f11a90c4700 1 Processor -- start 2023-09-30T22:30:36.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.799+0000 7f11a90c4700 1 -- start start 2023-09-30T22:30:36.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.800+0000 7f11a90c4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11a409d6f0 0x7f11a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.800+0000 7f11a90c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11a409e000 0x7f11a4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.800+0000 7f11a90c4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f11a409e410 0x7f11a4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.800+0000 7f11a90c4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a409f520 con 0x7f11a409e410 2023-09-30T22:30:36.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.800+0000 7f11a90c4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a409f130 con 0x7f11a409e000 2023-09-30T22:30:36.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.800+0000 7f11a90c4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11a409e930 con 0x7f11a409d6f0 2023-09-30T22:30:36.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.800+0000 7f11a259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11a409e000 0x7f11a4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.800+0000 7f11a259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11a409e000 0x7f11a4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33438/0 (socket says 172.21.15.59:33438) 2023-09-30T22:30:36.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.800+0000 7f11a259c700 1 -- 172.21.15.59:0/2330153494 learned_addr learned my addr 172.21.15.59:0/2330153494 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:36.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.800+0000 7f11a359e700 1 --2- 172.21.15.59:0/2330153494 >> v2:172.21.15.59:3300/0 conn(0x7f11a409e410 0x7f11a4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.800+0000 7f11a2d9d700 1 --2- 172.21.15.59:0/2330153494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11a409d6f0 0x7f11a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.801+0000 7f11a259c700 1 -- 172.21.15.59:0/2330153494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11a409d6f0 msgr2=0x7f11a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:36.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.801+0000 7f11a259c700 1 --2- 172.21.15.59:0/2330153494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11a409d6f0 0x7f11a409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.801+0000 7f11a259c700 1 -- 172.21.15.59:0/2330153494 >> v2:172.21.15.59:3300/0 conn(0x7f11a409e410 msgr2=0x7f11a4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:36.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.801+0000 7f11a259c700 1 --2- 172.21.15.59:0/2330153494 >> v2:172.21.15.59:3300/0 conn(0x7f11a409e410 0x7f11a4130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.801+0000 7f11a259c700 1 -- 172.21.15.59:0/2330153494 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a409b2d0 con 0x7f11a409e000 2023-09-30T22:30:36.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.801+0000 7f11a359e700 1 --2- 172.21.15.59:0/2330153494 >> v2:172.21.15.59:3300/0 conn(0x7f11a409e410 0x7f11a4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:36.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.801+0000 7f11a259c700 1 --2- 172.21.15.59:0/2330153494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11a409e000 0x7f11a4130660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1198009920 tx=0x7f1198009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4bd19ba82d7ac96 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:36.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.801+0000 7f11a1d9b700 1 -- 172.21.15.59:0/2330153494 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198011830 con 0x7f11a409e000 2023-09-30T22:30:36.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.801+0000 7f11a1d9b700 1 -- 172.21.15.59:0/2330153494 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1198011990 con 0x7f11a409e000 2023-09-30T22:30:36.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.801+0000 7f11a1d9b700 1 -- 172.21.15.59:0/2330153494 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198011d20 con 0x7f11a409e000 2023-09-30T22:30:36.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.802+0000 7f11a90c4700 1 -- 172.21.15.59:0/2330153494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11a409e000 msgr2=0x7f11a4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.802+0000 7f11a90c4700 1 --2- 172.21.15.59:0/2330153494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11a409e000 0x7f11a4130660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1198009920 tx=0x7f1198009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:36.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.802+0000 7f11a90c4700 1 -- 172.21.15.59:0/2330153494 shutdown_connections 2023-09-30T22:30:36.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.802+0000 7f11a90c4700 1 --2- 172.21.15.59:0/2330153494 >> v2:172.21.15.59:3300/0 conn(0x7f11a409e410 0x7f11a4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.802+0000 7f11a90c4700 1 --2- 172.21.15.59:0/2330153494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11a409d6f0 0x7f11a409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.802+0000 7f11a90c4700 1 --2- 172.21.15.59:0/2330153494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11a409e000 0x7f11a4130660 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.802+0000 7f11a90c4700 1 -- 172.21.15.59:0/2330153494 >> 172.21.15.59:0/2330153494 conn(0x7f11a4066f50 msgr2=0x7f11a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:36.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.802+0000 7f11a90c4700 1 -- 172.21.15.59:0/2330153494 shutdown_connections 2023-09-30T22:30:36.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.802+0000 7f11a90c4700 1 -- 172.21.15.59:0/2330153494 wait complete. 2023-09-30T22:30:36.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.804+0000 7f11a90c4700 1 Processor -- start 2023-09-30T22:30:36.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.804+0000 7f11a90c4700 1 -- start start 2023-09-30T22:30:36.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a90c4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11a409d6f0 0x7f11a411dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a90c4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11a409e000 0x7f11a411e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a90c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11a409e410 0x7f11a411ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a90c4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a4121b00 con 0x7f11a409e000 2023-09-30T22:30:36.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a90c4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a4120e40 con 0x7f11a409e410 2023-09-30T22:30:36.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a90c4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11a40a1720 con 0x7f11a409d6f0 2023-09-30T22:30:36.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11a409d6f0 0x7f11a411dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11a409d6f0 0x7f11a411dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32888/0 (socket says 172.21.15.59:32888) 2023-09-30T22:30:36.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a2d9d700 1 -- 172.21.15.59:0/614381937 learned_addr learned my addr 172.21.15.59:0/614381937 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a359e700 1 --2- 172.21.15.59:0/614381937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11a409e410 0x7f11a411ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a259c700 1 --2- 172.21.15.59:0/614381937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11a409e000 0x7f11a411e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a2d9d700 1 -- 172.21.15.59:0/614381937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11a409e410 msgr2=0x7f11a411ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a2d9d700 1 --2- 172.21.15.59:0/614381937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11a409e410 0x7f11a411ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a2d9d700 1 -- 172.21.15.59:0/614381937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11a409e000 msgr2=0x7f11a411e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a2d9d700 1 --2- 172.21.15.59:0/614381937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11a409e000 0x7f11a411e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.805+0000 7f11a2d9d700 1 -- 172.21.15.59:0/614381937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c009a70 con 0x7f11a409d6f0 2023-09-30T22:30:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.806+0000 7f11a2d9d700 1 --2- 172.21.15.59:0/614381937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11a409d6f0 0x7f11a411dfe0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1194012ed0 tx=0x7f1194012f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.806+0000 7f118b7fe700 1 -- 172.21.15.59:0/614381937 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1194014040 con 0x7f11a409d6f0 2023-09-30T22:30:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.806+0000 7f118b7fe700 1 -- 172.21.15.59:0/614381937 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119400f850 con 0x7f11a409d6f0 2023-09-30T22:30:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.806+0000 7f11a90c4700 1 -- 172.21.15.59:0/614381937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1198009550 con 0x7f11a409d6f0 2023-09-30T22:30:36.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.806+0000 7f118b7fe700 1 -- 172.21.15.59:0/614381937 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119400dbb0 con 0x7f11a409d6f0 2023-09-30T22:30:36.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.806+0000 7f11a90c4700 1 -- 172.21.15.59:0/614381937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a409c700 con 0x7f11a409d6f0 2023-09-30T22:30:36.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.807+0000 7f118b7fe700 1 -- 172.21.15.59:0/614381937 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f119400fbc0 con 0x7f11a409d6f0 2023-09-30T22:30:36.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.807+0000 7f118b7fe700 1 -- 172.21.15.59:0/614381937 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1194043170 con 0x7f11a409d6f0 2023-09-30T22:30:36.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.807+0000 7f11a90c4700 1 -- 172.21.15.59:0/614381937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a4074ea0 con 0x7f11a409d6f0 2023-09-30T22:30:36.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.816+0000 7f118b7fe700 1 -- 172.21.15.59:0/614381937 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1194021410 con 0x7f11a409d6f0 2023-09-30T22:30:36.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.858+0000 7f5e50287700 1 Processor -- start 2023-09-30T22:30:36.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.858+0000 7f5e50287700 1 -- start start 2023-09-30T22:30:36.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.859+0000 7f5e50287700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5e481337f0 0x7f5e48138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.859+0000 7f5e50287700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e48138dc0 0x7f5e4813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.859+0000 7f5e50287700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e4806b990 con 0x7f5e48133420 2023-09-30T22:30:36.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.859+0000 7f5e50287700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4809b0e0 con 0x7f5e481337f0 2023-09-30T22:30:36.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.859+0000 7f5e50287700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48133c20 con 0x7f5e48138dc0 2023-09-30T22:30:36.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.859+0000 7f5e4e824700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e48138dc0 0x7f5e4813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.859+0000 7f5e4e824700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e48138dc0 0x7f5e4813b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33470/0 (socket says 172.21.15.59:33470) 2023-09-30T22:30:36.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.859+0000 7f5e4e824700 1 -- 172.21.15.59:0/2812966402 learned_addr learned my addr 172.21.15.59:0/2812966402 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:36.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.859+0000 7f5e4d822700 1 --2- 172.21.15.59:0/2812966402 >> v2:172.21.15.59:3300/0 conn(0x7f5e481337f0 0x7f5e48138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.859+0000 7f5e4e824700 1 -- 172.21.15.59:0/2812966402 >> v2:172.21.15.59:3300/0 conn(0x7f5e481337f0 msgr2=0x7f5e48138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:36.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.859+0000 7f5e4e824700 1 --2- 172.21.15.59:0/2812966402 >> v2:172.21.15.59:3300/0 conn(0x7f5e481337f0 0x7f5e48138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.859+0000 7f5e4e824700 1 -- 172.21.15.59:0/2812966402 >> v1:172.21.15.59:6789/0 conn(0x7f5e48133420 legacy=0x7f5e48133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.859+0000 7f5e4e824700 1 -- 172.21.15.59:0/2812966402 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e480a0590 con 0x7f5e48138dc0 2023-09-30T22:30:36.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.859+0000 7f5e4d822700 1 --2- 172.21.15.59:0/2812966402 >> v2:172.21.15.59:3300/0 conn(0x7f5e481337f0 0x7f5e48138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:36.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.860+0000 7f5e4e824700 1 --2- 172.21.15.59:0/2812966402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e48138dc0 0x7f5e4813b1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5e400098f0 tx=0x7f5e40009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61d59d3317323657 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:36.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.860+0000 7f5e4d021700 1 -- 172.21.15.59:0/2812966402 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40011830 con 0x7f5e48138dc0 2023-09-30T22:30:36.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.860+0000 7f5e4d021700 1 -- 172.21.15.59:0/2812966402 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e40011990 con 0x7f5e48138dc0 2023-09-30T22:30:36.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.860+0000 7f5e4d021700 1 -- 172.21.15.59:0/2812966402 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40011d20 con 0x7f5e48138dc0 2023-09-30T22:30:36.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.860+0000 7f5e50287700 1 -- 172.21.15.59:0/2812966402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e48138dc0 msgr2=0x7f5e4813b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.860+0000 7f5e50287700 1 --2- 172.21.15.59:0/2812966402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e48138dc0 0x7f5e4813b1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5e400098f0 tx=0x7f5e40009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:36.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.861+0000 7f5e50287700 1 -- 172.21.15.59:0/2812966402 shutdown_connections 2023-09-30T22:30:36.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.861+0000 7f5e50287700 1 --2- 172.21.15.59:0/2812966402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e48138dc0 0x7f5e4813b1a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.861+0000 7f5e50287700 1 --2- 172.21.15.59:0/2812966402 >> v2:172.21.15.59:3300/0 conn(0x7f5e481337f0 0x7f5e48138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.861+0000 7f5e50287700 1 -- 172.21.15.59:0/2812966402 >> 172.21.15.59:0/2812966402 conn(0x7f5e480a4210 msgr2=0x7f5e480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:36.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.861+0000 7f5e50287700 1 -- 172.21.15.59:0/2812966402 shutdown_connections 2023-09-30T22:30:36.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.861+0000 7f5e50287700 1 -- 172.21.15.59:0/2812966402 wait complete. 2023-09-30T22:30:36.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.862+0000 7f5e50287700 1 Processor -- start 2023-09-30T22:30:36.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.862+0000 7f5e50287700 1 -- start start 2023-09-30T22:30:36.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.862+0000 7f5e50287700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e48133420 0x7f5e4809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.862+0000 7f5e50287700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e481337f0 0x7f5e4809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.862+0000 7f5e50287700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e48138dc0 0x7f5e4809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.862+0000 7f5e50287700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e481388a0 con 0x7f5e481337f0 2023-09-30T22:30:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.862+0000 7f5e50287700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4812eff0 con 0x7f5e48133420 2023-09-30T22:30:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.862+0000 7f5e50287700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48130490 con 0x7f5e48138dc0 2023-09-30T22:30:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.862+0000 7f5e4d822700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e481337f0 0x7f5e4809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.862+0000 7f5e4d822700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e481337f0 0x7f5e4809c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57562/0 (socket says 172.21.15.59:57562) 2023-09-30T22:30:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.862+0000 7f5e4d822700 1 -- 172.21.15.59:0/2615154283 learned_addr learned my addr 172.21.15.59:0/2615154283 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.862+0000 7f5e4e824700 1 --2- 172.21.15.59:0/2615154283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e48138dc0 0x7f5e4809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.862+0000 7f5e4e023700 1 --2- 172.21.15.59:0/2615154283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e48133420 0x7f5e4809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.863+0000 7f5e4d822700 1 -- 172.21.15.59:0/2615154283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e48138dc0 msgr2=0x7f5e4809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.863+0000 7f5e4d822700 1 --2- 172.21.15.59:0/2615154283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e48138dc0 0x7f5e4809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.863+0000 7f5e4d822700 1 -- 172.21.15.59:0/2615154283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e48133420 msgr2=0x7f5e4809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.863+0000 7f5e4d822700 1 --2- 172.21.15.59:0/2615154283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e48133420 0x7f5e4809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.863+0000 7f5e4d822700 1 -- 172.21.15.59:0/2615154283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e380094a0 con 0x7f5e481337f0 2023-09-30T22:30:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.863+0000 7f5e4e824700 1 --2- 172.21.15.59:0/2615154283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e48138dc0 0x7f5e4809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.863+0000 7f5e4e023700 1 --2- 172.21.15.59:0/2615154283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e48133420 0x7f5e4809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.863+0000 7f5e4d822700 1 --2- 172.21.15.59:0/2615154283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e481337f0 0x7f5e4809c9c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800ebe0 tx=0x7f5e3800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.863+0000 7f5e3effd700 1 -- 172.21.15.59:0/2615154283 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800c850 con 0x7f5e481337f0 2023-09-30T22:30:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.863+0000 7f5e3effd700 1 -- 172.21.15.59:0/2615154283 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3800c9b0 con 0x7f5e481337f0 2023-09-30T22:30:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.863+0000 7f5e50287700 1 -- 172.21.15.59:0/2615154283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e40009550 con 0x7f5e481337f0 2023-09-30T22:30:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.863+0000 7f5e3effd700 1 -- 172.21.15.59:0/2615154283 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800cd40 con 0x7f5e481337f0 2023-09-30T22:30:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.863+0000 7f5e50287700 1 -- 172.21.15.59:0/2615154283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e481309b0 con 0x7f5e481337f0 2023-09-30T22:30:36.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.864+0000 7f5e3effd700 1 -- 172.21.15.59:0/2615154283 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e38013470 con 0x7f5e481337f0 2023-09-30T22:30:36.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.864+0000 7f5e50287700 1 -- 172.21.15.59:0/2615154283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e48074ea0 con 0x7f5e481337f0 2023-09-30T22:30:36.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.865+0000 7f5e3effd700 1 -- 172.21.15.59:0/2615154283 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5e3803fb30 con 0x7f5e481337f0 2023-09-30T22:30:36.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.873+0000 7f5e3effd700 1 -- 172.21.15.59:0/2615154283 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e38040e60 con 0x7f5e481337f0 2023-09-30T22:30:36.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.914+0000 7f2af4306700 1 Processor -- start 2023-09-30T22:30:36.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.914+0000 7f2af4306700 1 -- start start 2023-09-30T22:30:36.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.915+0000 7f2af4306700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2aec0a0a30 0x7f2aec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.915+0000 7f2af4306700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec0a1340 0x7f2aec133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.915+0000 7f2af4306700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2aec133fa0 0x7f2aec134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.915+0000 7f2af4306700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec09edd0 con 0x7f2aec133fa0 2023-09-30T22:30:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.915+0000 7f2af4306700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec09e1f0 con 0x7f2aec0a1340 2023-09-30T22:30:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.915+0000 7f2af4306700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec09dc50 con 0x7f2aec0a0a30 2023-09-30T22:30:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.915+0000 7f2af20a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2aec0a0a30 0x7f2aec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.915+0000 7f2af20a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2aec0a0a30 0x7f2aec0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32906/0 (socket says 172.21.15.59:32906) 2023-09-30T22:30:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.915+0000 7f2af20a2700 1 -- 172.21.15.59:0/174648666 learned_addr learned my addr 172.21.15.59:0/174648666 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.915+0000 7f2af28a3700 1 --2- 172.21.15.59:0/174648666 >> v2:172.21.15.59:3300/0 conn(0x7f2aec133fa0 0x7f2aec134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.915+0000 7f2af18a1700 1 --2- 172.21.15.59:0/174648666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec0a1340 0x7f2aec133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.916+0000 7f2af20a2700 1 -- 172.21.15.59:0/174648666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec0a1340 msgr2=0x7f2aec133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.916+0000 7f2af20a2700 1 --2- 172.21.15.59:0/174648666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec0a1340 0x7f2aec133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.916+0000 7f2af20a2700 1 -- 172.21.15.59:0/174648666 >> v2:172.21.15.59:3300/0 conn(0x7f2aec133fa0 msgr2=0x7f2aec134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.916+0000 7f2af20a2700 1 --2- 172.21.15.59:0/174648666 >> v2:172.21.15.59:3300/0 conn(0x7f2aec133fa0 0x7f2aec134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.916+0000 7f2af20a2700 1 -- 172.21.15.59:0/174648666 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec0a1fe0 con 0x7f2aec0a0a30 2023-09-30T22:30:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.916+0000 7f2af28a3700 1 --2- 172.21.15.59:0/174648666 >> v2:172.21.15.59:3300/0 conn(0x7f2aec133fa0 0x7f2aec134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.916+0000 7f2af20a2700 1 --2- 172.21.15.59:0/174648666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2aec0a0a30 0x7f2aec0a0e00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80098f0 tx=0x7f2ae8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b653c588924ebb2b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.916+0000 7f2af10a0700 1 -- 172.21.15.59:0/174648666 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8011830 con 0x7f2aec0a0a30 2023-09-30T22:30:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.916+0000 7f2af10a0700 1 -- 172.21.15.59:0/174648666 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae8011990 con 0x7f2aec0a0a30 2023-09-30T22:30:36.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.916+0000 7f2af10a0700 1 -- 172.21.15.59:0/174648666 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8011d20 con 0x7f2aec0a0a30 2023-09-30T22:30:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.917+0000 7f2af4306700 1 -- 172.21.15.59:0/174648666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2aec0a0a30 msgr2=0x7f2aec0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.917+0000 7f2af4306700 1 --2- 172.21.15.59:0/174648666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2aec0a0a30 0x7f2aec0a0e00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80098f0 tx=0x7f2ae8009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.917+0000 7f2af4306700 1 -- 172.21.15.59:0/174648666 shutdown_connections 2023-09-30T22:30:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.917+0000 7f2af4306700 1 --2- 172.21.15.59:0/174648666 >> v2:172.21.15.59:3300/0 conn(0x7f2aec133fa0 0x7f2aec134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.917+0000 7f2af4306700 1 --2- 172.21.15.59:0/174648666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2aec0a0a30 0x7f2aec0a0e00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.917+0000 7f2af4306700 1 --2- 172.21.15.59:0/174648666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec0a1340 0x7f2aec133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.917+0000 7f2af4306700 1 -- 172.21.15.59:0/174648666 >> 172.21.15.59:0/174648666 conn(0x7f2aec0a6550 msgr2=0x7f2aec0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.917+0000 7f2af4306700 1 -- 172.21.15.59:0/174648666 shutdown_connections 2023-09-30T22:30:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.917+0000 7f2af4306700 1 -- 172.21.15.59:0/174648666 wait complete. 2023-09-30T22:30:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.918+0000 7f2af4306700 1 Processor -- start 2023-09-30T22:30:36.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.918+0000 7f2af4306700 1 -- start start 2023-09-30T22:30:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.918+0000 7f2af4306700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec0a0a30 0x7f2aec11df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.918+0000 7f2af4306700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2aec0a1340 0x7f2aec11e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.918+0000 7f2af4306700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aec133fa0 0x7f2aec11e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.918+0000 7f2af4306700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec122430 con 0x7f2aec133fa0 2023-09-30T22:30:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.918+0000 7f2af4306700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec11fb60 con 0x7f2aec0a0a30 2023-09-30T22:30:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.918+0000 7f2af4306700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec120db0 con 0x7f2aec0a1340 2023-09-30T22:30:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2af20a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec0a0a30 0x7f2aec11df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2af20a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec0a0a30 0x7f2aec11df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33494/0 (socket says 172.21.15.59:33494) 2023-09-30T22:30:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2af20a2700 1 -- 172.21.15.59:0/508966879 learned_addr learned my addr 172.21.15.59:0/508966879 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:36.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2af18a1700 1 --2- 172.21.15.59:0/508966879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2aec0a1340 0x7f2aec11e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2af28a3700 1 --2- 172.21.15.59:0/508966879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aec133fa0 0x7f2aec11e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2af18a1700 1 -- 172.21.15.59:0/508966879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec0a0a30 msgr2=0x7f2aec11df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2af18a1700 1 --2- 172.21.15.59:0/508966879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec0a0a30 0x7f2aec11df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2af18a1700 1 -- 172.21.15.59:0/508966879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aec133fa0 msgr2=0x7f2aec11e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2af18a1700 1 --2- 172.21.15.59:0/508966879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aec133fa0 0x7f2aec11e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2af18a1700 1 -- 172.21.15.59:0/508966879 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae4009a70 con 0x7f2aec0a1340 2023-09-30T22:30:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2af20a2700 1 --2- 172.21.15.59:0/508966879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec0a0a30 0x7f2aec11df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2af18a1700 1 --2- 172.21.15.59:0/508966879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2aec0a1340 0x7f2aec11e490 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00e960 tx=0x7f2adc00ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2ae2ffd700 1 -- 172.21.15.59:0/508966879 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00c640 con 0x7f2aec0a1340 2023-09-30T22:30:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2ae2ffd700 1 -- 172.21.15.59:0/508966879 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc00c7a0 con 0x7f2aec0a1340 2023-09-30T22:30:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2ae2ffd700 1 -- 172.21.15.59:0/508966879 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00cb10 con 0x7f2aec0a1340 2023-09-30T22:30:36.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.919+0000 7f2af4306700 1 -- 172.21.15.59:0/508966879 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae8009550 con 0x7f2aec0a1340 2023-09-30T22:30:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.920+0000 7f2af4306700 1 -- 172.21.15.59:0/508966879 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec0a3630 con 0x7f2aec0a1340 2023-09-30T22:30:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.920+0000 7f2ae2ffd700 1 -- 172.21.15.59:0/508966879 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2adc00cc70 con 0x7f2aec0a1340 2023-09-30T22:30:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.921+0000 7f2ae2ffd700 1 -- 172.21.15.59:0/508966879 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2adc03f9c0 con 0x7f2aec0a1340 2023-09-30T22:30:36.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.921+0000 7f2af4306700 1 -- 172.21.15.59:0/508966879 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aec074ea0 con 0x7f2aec0a1340 2023-09-30T22:30:36.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:36.926+0000 7f2ae2ffd700 1 -- 172.21.15.59:0/508966879 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2adc017080 con 0x7f2aec0a1340 2023-09-30T22:30:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.045+0000 7f11a90c4700 1 -- 172.21.15.59:0/614381937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f11a406c360 con 0x7f11a409d6f0 2023-09-30T22:30:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.045+0000 7f118b7fe700 1 -- 172.21.15.59:0/614381937 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1194020370 con 0x7f11a409d6f0 2023-09-30T22:30:37.046 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:37.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.049+0000 7f11a90c4700 1 -- 172.21.15.59:0/614381937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11a409d6f0 msgr2=0x7f11a411dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.049+0000 7f11a90c4700 1 --2- 172.21.15.59:0/614381937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11a409d6f0 0x7f11a411dfe0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1194012ed0 tx=0x7f1194012f00 comp rx=0 tx=0).stop 2023-09-30T22:30:37.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.049+0000 7f11a90c4700 1 -- 172.21.15.59:0/614381937 shutdown_connections 2023-09-30T22:30:37.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.049+0000 7f11a90c4700 1 --2- 172.21.15.59:0/614381937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11a409d6f0 0x7f11a411dfe0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.049+0000 7f11a90c4700 1 --2- 172.21.15.59:0/614381937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11a409e410 0x7f11a411ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.049+0000 7f11a90c4700 1 --2- 172.21.15.59:0/614381937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11a409e000 0x7f11a411e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.049+0000 7f11a90c4700 1 -- 172.21.15.59:0/614381937 >> 172.21.15.59:0/614381937 conn(0x7f11a4066f50 msgr2=0x7f11a406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:37.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.049+0000 7f11a90c4700 1 -- 172.21.15.59:0/614381937 shutdown_connections 2023-09-30T22:30:37.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.049+0000 7f11a90c4700 1 -- 172.21.15.59:0/614381937 wait complete. 2023-09-30T22:30:37.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:37.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.110+0000 7f5e50287700 1 -- 172.21.15.59:0/2615154283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5e4806b250 con 0x7f5e481337f0 2023-09-30T22:30:37.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.111+0000 7f5e3effd700 1 -- 172.21.15.59:0/2615154283 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e38021020 con 0x7f5e481337f0 2023-09-30T22:30:37.111 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:37.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.113+0000 7f5e50287700 1 -- 172.21.15.59:0/2615154283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e481337f0 msgr2=0x7f5e4809c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.113+0000 7f5e50287700 1 --2- 172.21.15.59:0/2615154283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e481337f0 0x7f5e4809c9c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800ebe0 tx=0x7f5e3800eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.113+0000 7f5e50287700 1 -- 172.21.15.59:0/2615154283 shutdown_connections 2023-09-30T22:30:37.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.113+0000 7f5e50287700 1 --2- 172.21.15.59:0/2615154283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e48138dc0 0x7f5e4809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.113+0000 7f5e50287700 1 --2- 172.21.15.59:0/2615154283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e48133420 0x7f5e4809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.113+0000 7f5e50287700 1 --2- 172.21.15.59:0/2615154283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e481337f0 0x7f5e4809c9c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.113+0000 7f5e50287700 1 -- 172.21.15.59:0/2615154283 >> 172.21.15.59:0/2615154283 conn(0x7f5e480a4210 msgr2=0x7f5e480a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:37.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.113+0000 7f5e50287700 1 -- 172.21.15.59:0/2615154283 shutdown_connections 2023-09-30T22:30:37.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.113+0000 7f5e50287700 1 -- 172.21.15.59:0/2615154283 wait complete. 2023-09-30T22:30:37.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:37.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.155+0000 7f2af4306700 1 -- 172.21.15.59:0/508966879 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2aec0a28e0 con 0x7f2aec0a1340 2023-09-30T22:30:37.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.155+0000 7f2ae2ffd700 1 -- 172.21.15.59:0/508966879 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2adc021020 con 0x7f2aec0a1340 2023-09-30T22:30:37.155 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.158+0000 7f2af4306700 1 -- 172.21.15.59:0/508966879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2aec0a1340 msgr2=0x7f2aec11e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.158+0000 7f2af4306700 1 --2- 172.21.15.59:0/508966879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2aec0a1340 0x7f2aec11e490 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00e960 tx=0x7f2adc00ec70 comp rx=0 tx=0).stop 2023-09-30T22:30:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.158+0000 7f2af4306700 1 -- 172.21.15.59:0/508966879 shutdown_connections 2023-09-30T22:30:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.158+0000 7f2af4306700 1 --2- 172.21.15.59:0/508966879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aec133fa0 0x7f2aec11e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.158+0000 7f2af4306700 1 --2- 172.21.15.59:0/508966879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec0a0a30 0x7f2aec11df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.158+0000 7f2af4306700 1 --2- 172.21.15.59:0/508966879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2aec0a1340 0x7f2aec11e490 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.158+0000 7f2af4306700 1 -- 172.21.15.59:0/508966879 >> 172.21.15.59:0/508966879 conn(0x7f2aec0a6550 msgr2=0x7f2aec133060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.158+0000 7f2af4306700 1 -- 172.21.15.59:0/508966879 shutdown_connections 2023-09-30T22:30:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.158+0000 7f2af4306700 1 -- 172.21.15.59:0/508966879 wait complete. 2023-09-30T22:30:37.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:37.330 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:37.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.475+0000 7fa7519e3700 1 Processor -- start 2023-09-30T22:30:37.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.475+0000 7fa7519e3700 1 -- start start 2023-09-30T22:30:37.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.475+0000 7fa7519e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa74c0a09c0 0x7fa74c0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.475+0000 7fa7519e3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa74c0a12d0 0x7fa74c134030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.475+0000 7fa7519e3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa74c09ea10 con 0x7fa74c09d5c0 2023-09-30T22:30:37.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.475+0000 7fa7519e3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74c09e210 con 0x7fa74c0a12d0 2023-09-30T22:30:37.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.475+0000 7fa7519e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c0a26f0 con 0x7fa74c0a09c0 2023-09-30T22:30:37.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.475+0000 7fa74b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa74c0a12d0 0x7fa74c134030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.475+0000 7fa74affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa74c0a09c0 0x7fa74c0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.475+0000 7fa74b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa74c0a12d0 0x7fa74c134030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57604/0 (socket says 172.21.15.59:57604) 2023-09-30T22:30:37.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.475+0000 7fa74a7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa74c09d5c0 0x7fa74c133920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58116/0 (socket says 172.21.15.59:58116) 2023-09-30T22:30:37.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.475+0000 7fa74affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa74c0a09c0 0x7fa74c0a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33498/0 (socket says 172.21.15.59:33498) 2023-09-30T22:30:37.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.475+0000 7fa74b7fe700 1 -- 172.21.15.59:0/3588777059 learned_addr learned my addr 172.21.15.59:0/3588777059 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:37.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.476+0000 7fa74affd700 1 -- 172.21.15.59:0/3588777059 >> v2:172.21.15.59:3300/0 conn(0x7fa74c0a12d0 msgr2=0x7fa74c134030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:37.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.476+0000 7fa74affd700 1 --2- 172.21.15.59:0/3588777059 >> v2:172.21.15.59:3300/0 conn(0x7fa74c0a12d0 0x7fa74c134030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.476+0000 7fa74affd700 1 -- 172.21.15.59:0/3588777059 >> v1:172.21.15.59:6789/0 conn(0x7fa74c09d5c0 legacy=0x7fa74c133920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.476+0000 7fa74affd700 1 -- 172.21.15.59:0/3588777059 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c09db70 con 0x7fa74c0a09c0 2023-09-30T22:30:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.476+0000 7fa74b7fe700 1 --2- 172.21.15.59:0/3588777059 >> v2:172.21.15.59:3300/0 conn(0x7fa74c0a12d0 0x7fa74c134030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.476+0000 7fa74affd700 1 --2- 172.21.15.59:0/3588777059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa74c0a09c0 0x7fa74c0a0d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa73c009840 tx=0x7fa73c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bee2f7b75264a80 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.476+0000 7fa749ffb700 1 -- 172.21.15.59:0/3588777059 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c011830 con 0x7fa74c0a09c0 2023-09-30T22:30:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.476+0000 7fa749ffb700 1 -- 172.21.15.59:0/3588777059 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c011990 con 0x7fa74c0a09c0 2023-09-30T22:30:37.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.476+0000 7fa749ffb700 1 -- 172.21.15.59:0/3588777059 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c011d20 con 0x7fa74c0a09c0 2023-09-30T22:30:37.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.477+0000 7fa7519e3700 1 -- 172.21.15.59:0/3588777059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa74c0a09c0 msgr2=0x7fa74c0a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.477+0000 7fa7519e3700 1 --2- 172.21.15.59:0/3588777059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa74c0a09c0 0x7fa74c0a0d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa73c009840 tx=0x7fa73c009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:37.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.477+0000 7fa7519e3700 1 -- 172.21.15.59:0/3588777059 shutdown_connections 2023-09-30T22:30:37.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.477+0000 7fa7519e3700 1 --2- 172.21.15.59:0/3588777059 >> v2:172.21.15.59:3300/0 conn(0x7fa74c0a12d0 0x7fa74c134030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.477+0000 7fa7519e3700 1 --2- 172.21.15.59:0/3588777059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa74c0a09c0 0x7fa74c0a0d90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.477+0000 7fa7519e3700 1 -- 172.21.15.59:0/3588777059 >> 172.21.15.59:0/3588777059 conn(0x7fa74c0a2fe0 msgr2=0x7fa74c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:37.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.477+0000 7fa7519e3700 1 -- 172.21.15.59:0/3588777059 shutdown_connections 2023-09-30T22:30:37.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.477+0000 7fa7519e3700 1 -- 172.21.15.59:0/3588777059 wait complete. 2023-09-30T22:30:37.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.478+0000 7fa7519e3700 1 Processor -- start 2023-09-30T22:30:37.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.478+0000 7fa7519e3700 1 -- start start 2023-09-30T22:30:37.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.478+0000 7fa7519e3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa74c09d5c0 0x7fa74c122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.478+0000 7fa7519e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa74c0a09c0 0x7fa74c122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.478+0000 7fa7519e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa74c0a12d0 0x7fa74c122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.478+0000 7fa7519e3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c125b60 con 0x7fa74c0a09c0 2023-09-30T22:30:37.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.478+0000 7fa7519e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c125930 con 0x7fa74c0a12d0 2023-09-30T22:30:37.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.478+0000 7fa7519e3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c124dc0 con 0x7fa74c09d5c0 2023-09-30T22:30:37.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa74affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa74c09d5c0 0x7fa74c122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa74b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa74c0a12d0 0x7fa74c122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa74a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa74c0a09c0 0x7fa74c122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa74affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa74c09d5c0 0x7fa74c122320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32918/0 (socket says 172.21.15.59:32918) 2023-09-30T22:30:37.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa74affd700 1 -- 172.21.15.59:0/801793650 learned_addr learned my addr 172.21.15.59:0/801793650 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:37.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa74b7fe700 1 -- 172.21.15.59:0/801793650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa74c09d5c0 msgr2=0x7fa74c122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa74b7fe700 1 --2- 172.21.15.59:0/801793650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa74c09d5c0 0x7fa74c122320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa74b7fe700 1 -- 172.21.15.59:0/801793650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa74c0a09c0 msgr2=0x7fa74c122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa74b7fe700 1 --2- 172.21.15.59:0/801793650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa74c0a09c0 0x7fa74c122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa74b7fe700 1 -- 172.21.15.59:0/801793650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa744009b30 con 0x7fa74c0a12d0 2023-09-30T22:30:37.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa74a7fc700 1 --2- 172.21.15.59:0/801793650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa74c0a09c0 0x7fa74c122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:37.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa74b7fe700 1 --2- 172.21.15.59:0/801793650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa74c0a12d0 0x7fa74c122da0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa744009e50 tx=0x7fa74400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:37.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa743fff700 1 -- 172.21.15.59:0/801793650 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744018070 con 0x7fa74c0a12d0 2023-09-30T22:30:37.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa743fff700 1 -- 172.21.15.59:0/801793650 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74400f040 con 0x7fa74c0a12d0 2023-09-30T22:30:37.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa7519e3700 1 -- 172.21.15.59:0/801793650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c0094a0 con 0x7fa74c0a12d0 2023-09-30T22:30:37.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa743fff700 1 -- 172.21.15.59:0/801793650 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744003c40 con 0x7fa74c0a12d0 2023-09-30T22:30:37.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.479+0000 7fa7519e3700 1 -- 172.21.15.59:0/801793650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74c09cd10 con 0x7fa74c0a12d0 2023-09-30T22:30:37.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.480+0000 7fa743fff700 1 -- 172.21.15.59:0/801793650 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa74400c880 con 0x7fa74c0a12d0 2023-09-30T22:30:37.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.480+0000 7fa743fff700 1 -- 172.21.15.59:0/801793650 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa74403f730 con 0x7fa74c0a12d0 2023-09-30T22:30:37.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.480+0000 7fa7519e3700 1 -- 172.21.15.59:0/801793650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74c11f670 con 0x7fa74c0a12d0 2023-09-30T22:30:37.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.485+0000 7fa743fff700 1 -- 172.21.15.59:0/801793650 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa74400cb30 con 0x7fa74c0a12d0 2023-09-30T22:30:37.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.690+0000 7fa7519e3700 1 -- 172.21.15.59:0/801793650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa74c0747f0 con 0x7fa74c0a12d0 2023-09-30T22:30:37.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.690+0000 7fa743fff700 1 -- 172.21.15.59:0/801793650 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa74401cbb0 con 0x7fa74c0a12d0 2023-09-30T22:30:37.691 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:37.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.693+0000 7fa7519e3700 1 -- 172.21.15.59:0/801793650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa74c0a12d0 msgr2=0x7fa74c122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.693+0000 7fa7519e3700 1 --2- 172.21.15.59:0/801793650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa74c0a12d0 0x7fa74c122da0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa744009e50 tx=0x7fa74400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.693+0000 7fa7519e3700 1 -- 172.21.15.59:0/801793650 shutdown_connections 2023-09-30T22:30:37.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.693+0000 7fa7519e3700 1 --2- 172.21.15.59:0/801793650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa74c09d5c0 0x7fa74c122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.693+0000 7fa7519e3700 1 --2- 172.21.15.59:0/801793650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa74c0a12d0 0x7fa74c122da0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.693+0000 7fa7519e3700 1 --2- 172.21.15.59:0/801793650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa74c0a09c0 0x7fa74c122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.693+0000 7fa7519e3700 1 -- 172.21.15.59:0/801793650 >> 172.21.15.59:0/801793650 conn(0x7fa74c0a2fe0 msgr2=0x7fa74c11c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:37.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.693+0000 7fa7519e3700 1 -- 172.21.15.59:0/801793650 shutdown_connections 2023-09-30T22:30:37.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:37.693+0000 7fa7519e3700 1 -- 172.21.15.59:0/801793650 wait complete. 2023-09-30T22:30:37.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:38.069 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:38.128 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:38.172 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:38.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.217+0000 7fc2412f2700 1 Processor -- start 2023-09-30T22:30:38.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.217+0000 7fc2412f2700 1 -- start start 2023-09-30T22:30:38.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.217+0000 7fc2412f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23c09d5c0 0x7fc23c138d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.217+0000 7fc2412f2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc23c0a14a0 0x7fc23c13b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.217+0000 7fc2412f2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c09ea10 con 0x7fc23c0a09c0 2023-09-30T22:30:38.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.217+0000 7fc2412f2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23c09e210 con 0x7fc23c0a14a0 2023-09-30T22:30:38.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.217+0000 7fc2412f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0a26f0 con 0x7fc23c09d5c0 2023-09-30T22:30:38.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.218+0000 7fc23a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23c09d5c0 0x7fc23c138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.218+0000 7fc23a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23c09d5c0 0x7fc23c138d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33510/0 (socket says 172.21.15.59:33510) 2023-09-30T22:30:38.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.218+0000 7fc23a7fc700 1 -- 172.21.15.59:0/1775342634 learned_addr learned my addr 172.21.15.59:0/1775342634 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:38.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.218+0000 7fc23b7fe700 1 --2- 172.21.15.59:0/1775342634 >> v2:172.21.15.59:3300/0 conn(0x7fc23c0a14a0 0x7fc23c13b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.218+0000 7fc23a7fc700 1 -- 172.21.15.59:0/1775342634 >> v2:172.21.15.59:3300/0 conn(0x7fc23c0a14a0 msgr2=0x7fc23c13b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:38.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.218+0000 7fc23a7fc700 1 --2- 172.21.15.59:0/1775342634 >> v2:172.21.15.59:3300/0 conn(0x7fc23c0a14a0 0x7fc23c13b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.218+0000 7fc23a7fc700 1 -- 172.21.15.59:0/1775342634 >> v1:172.21.15.59:6789/0 conn(0x7fc23c0a09c0 legacy=0x7fc23c0a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.218+0000 7fc23a7fc700 1 -- 172.21.15.59:0/1775342634 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c09db70 con 0x7fc23c09d5c0 2023-09-30T22:30:38.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.218+0000 7fc23a7fc700 1 --2- 172.21.15.59:0/1775342634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23c09d5c0 0x7fc23c138d70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc2300098f0 tx=0x7fc230009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ea25835ae11e528 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:38.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.218+0000 7fc239ffb700 1 -- 172.21.15.59:0/1775342634 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230011830 con 0x7fc23c09d5c0 2023-09-30T22:30:38.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.218+0000 7fc239ffb700 1 -- 172.21.15.59:0/1775342634 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc230011990 con 0x7fc23c09d5c0 2023-09-30T22:30:38.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.219+0000 7fc239ffb700 1 -- 172.21.15.59:0/1775342634 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230011d20 con 0x7fc23c09d5c0 2023-09-30T22:30:38.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.219+0000 7fc2412f2700 1 -- 172.21.15.59:0/1775342634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23c09d5c0 msgr2=0x7fc23c138d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.219+0000 7fc2412f2700 1 --2- 172.21.15.59:0/1775342634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23c09d5c0 0x7fc23c138d70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc2300098f0 tx=0x7fc230009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:38.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.219+0000 7fc2412f2700 1 -- 172.21.15.59:0/1775342634 shutdown_connections 2023-09-30T22:30:38.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.219+0000 7fc2412f2700 1 --2- 172.21.15.59:0/1775342634 >> v2:172.21.15.59:3300/0 conn(0x7fc23c0a14a0 0x7fc23c13b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.219+0000 7fc2412f2700 1 --2- 172.21.15.59:0/1775342634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23c09d5c0 0x7fc23c138d70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.219+0000 7fc2412f2700 1 -- 172.21.15.59:0/1775342634 >> 172.21.15.59:0/1775342634 conn(0x7fc23c0a2fe0 msgr2=0x7fc23c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.219+0000 7fc2412f2700 1 -- 172.21.15.59:0/1775342634 shutdown_connections 2023-09-30T22:30:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.219+0000 7fc2412f2700 1 -- 172.21.15.59:0/1775342634 wait complete. 2023-09-30T22:30:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.220+0000 7fc2412f2700 1 Processor -- start 2023-09-30T22:30:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.221+0000 7fc2412f2700 1 -- start start 2023-09-30T22:30:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.221+0000 7fc2412f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23c09d5c0 0x7fc23c122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.221+0000 7fc2412f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23c0a09c0 0x7fc23c122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.221+0000 7fc2412f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc23c0a14a0 0x7fc23c1231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.221+0000 7fc2412f2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c125ce0 con 0x7fc23c0a14a0 2023-09-30T22:30:38.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.221+0000 7fc2412f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c09cec0 con 0x7fc23c09d5c0 2023-09-30T22:30:38.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.221+0000 7fc2412f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c124830 con 0x7fc23c0a09c0 2023-09-30T22:30:38.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.221+0000 7fc23a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23c0a09c0 0x7fc23c122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.221+0000 7fc23a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23c0a09c0 0x7fc23c122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32934/0 (socket says 172.21.15.59:32934) 2023-09-30T22:30:38.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.221+0000 7fc23a7fc700 1 -- 172.21.15.59:0/3133046166 learned_addr learned my addr 172.21.15.59:0/3133046166 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:38.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.221+0000 7fc23affd700 1 --2- 172.21.15.59:0/3133046166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23c09d5c0 0x7fc23c122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.221+0000 7fc23b7fe700 1 --2- 172.21.15.59:0/3133046166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc23c0a14a0 0x7fc23c1231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.222+0000 7fc23a7fc700 1 -- 172.21.15.59:0/3133046166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23c09d5c0 msgr2=0x7fc23c122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.222+0000 7fc23a7fc700 1 --2- 172.21.15.59:0/3133046166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23c09d5c0 0x7fc23c122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.222+0000 7fc23a7fc700 1 -- 172.21.15.59:0/3133046166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc23c0a14a0 msgr2=0x7fc23c1231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.222+0000 7fc23a7fc700 1 --2- 172.21.15.59:0/3133046166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc23c0a14a0 0x7fc23c1231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.222+0000 7fc23a7fc700 1 -- 172.21.15.59:0/3133046166 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc230009550 con 0x7fc23c0a09c0 2023-09-30T22:30:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.222+0000 7fc23affd700 1 --2- 172.21.15.59:0/3133046166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23c09d5c0 0x7fc23c122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.222+0000 7fc23a7fc700 1 --2- 172.21.15.59:0/3133046166 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23c0a09c0 0x7fc23c122c90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc230009c40 tx=0x7fc230004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.222+0000 7fc2237fe700 1 -- 172.21.15.59:0/3133046166 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230004400 con 0x7fc23c0a09c0 2023-09-30T22:30:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.222+0000 7fc2237fe700 1 -- 172.21.15.59:0/3133046166 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23001f070 con 0x7fc23c0a09c0 2023-09-30T22:30:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.222+0000 7fc2237fe700 1 -- 172.21.15.59:0/3133046166 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2300038e0 con 0x7fc23c0a09c0 2023-09-30T22:30:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.222+0000 7fc2412f2700 1 -- 172.21.15.59:0/3133046166 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23c0a5010 con 0x7fc23c0a09c0 2023-09-30T22:30:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.222+0000 7fc2412f2700 1 -- 172.21.15.59:0/3133046166 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23c125ec0 con 0x7fc23c0a09c0 2023-09-30T22:30:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.223+0000 7fc2237fe700 1 -- 172.21.15.59:0/3133046166 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc230021030 con 0x7fc23c0a09c0 2023-09-30T22:30:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.223+0000 7fc2237fe700 1 -- 172.21.15.59:0/3133046166 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc230040ac0 con 0x7fc23c0a09c0 2023-09-30T22:30:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.223+0000 7fc2412f2700 1 -- 172.21.15.59:0/3133046166 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23c125b10 con 0x7fc23c0a09c0 2023-09-30T22:30:38.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.229+0000 7fc2237fe700 1 -- 172.21.15.59:0/3133046166 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc23000b9d0 con 0x7fc23c0a09c0 2023-09-30T22:30:38.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.275+0000 7f78c5e81700 1 Processor -- start 2023-09-30T22:30:38.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.275+0000 7f78c5e81700 1 -- start start 2023-09-30T22:30:38.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.276+0000 7f78c5e81700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c0133a80 0x7f78c0133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.276+0000 7f78c5e81700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f78c0130a40 0x7f78c013b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.276+0000 7f78c5e81700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c006bc00 con 0x7f78c012ff20 2023-09-30T22:30:38.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.276+0000 7f78c5e81700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c006c570 con 0x7f78c0130a40 2023-09-30T22:30:38.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.276+0000 7f78c5e81700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00a0040 con 0x7f78c0133a80 2023-09-30T22:30:38.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.276+0000 7f78beffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f78c012ff20 0x7f78c0130330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58134/0 (socket says 172.21.15.59:58134) 2023-09-30T22:30:38.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.276+0000 7f78beffd700 1 -- 172.21.15.59:0/2363754274 learned_addr learned my addr 172.21.15.59:0/2363754274 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.276+0000 7f78bffff700 1 --2- 172.21.15.59:0/2363754274 >> v2:172.21.15.59:3300/0 conn(0x7f78c0130a40 0x7f78c013b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.276+0000 7f78bffff700 1 -- 172.21.15.59:0/2363754274 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c0133a80 msgr2=0x7f78c0133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.276+0000 7f78bffff700 1 --2- 172.21.15.59:0/2363754274 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c0133a80 0x7f78c0133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.277+0000 7f78bffff700 1 -- 172.21.15.59:0/2363754274 >> v1:172.21.15.59:6789/0 conn(0x7f78c012ff20 legacy=0x7f78c0130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.277+0000 7f78bffff700 1 -- 172.21.15.59:0/2363754274 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c0133860 con 0x7f78c0130a40 2023-09-30T22:30:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.277+0000 7f78be7fc700 1 -- 172.21.15.59:0/2363754274 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109355178 0 0) 0x7f78c006bc00 con 0x7f78c012ff20 2023-09-30T22:30:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.277+0000 7f78bffff700 1 --2- 172.21.15.59:0/2363754274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c0130a40 0x7f78c013b850 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009d90 tx=0x7f78b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9c19945a371589 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.277+0000 7f78be7fc700 1 -- 172.21.15.59:0/2363754274 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800e070 con 0x7f78c0130a40 2023-09-30T22:30:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.277+0000 7f78be7fc700 1 -- 172.21.15.59:0/2363754274 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b800bbd0 con 0x7f78c0130a40 2023-09-30T22:30:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.277+0000 7f78be7fc700 1 -- 172.21.15.59:0/2363754274 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8012430 con 0x7f78c0130a40 2023-09-30T22:30:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.278+0000 7f78c5e81700 1 -- 172.21.15.59:0/2363754274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c0130a40 msgr2=0x7f78c013b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.278+0000 7f78c5e81700 1 --2- 172.21.15.59:0/2363754274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c0130a40 0x7f78c013b850 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009d90 tx=0x7f78b800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.278+0000 7f78c5e81700 1 -- 172.21.15.59:0/2363754274 shutdown_connections 2023-09-30T22:30:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.278+0000 7f78c5e81700 1 --2- 172.21.15.59:0/2363754274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c0130a40 0x7f78c013b850 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.278+0000 7f78c5e81700 1 --2- 172.21.15.59:0/2363754274 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c0133a80 0x7f78c0133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.278+0000 7f78c5e81700 1 -- 172.21.15.59:0/2363754274 >> 172.21.15.59:0/2363754274 conn(0x7f78c00a4210 msgr2=0x7f78c00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.278+0000 7f78c5e81700 1 -- 172.21.15.59:0/2363754274 shutdown_connections 2023-09-30T22:30:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.278+0000 7f78c5e81700 1 -- 172.21.15.59:0/2363754274 wait complete. 2023-09-30T22:30:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.279+0000 7f78c5e81700 1 Processor -- start 2023-09-30T22:30:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.279+0000 7f78c5e81700 1 -- start start 2023-09-30T22:30:38.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.279+0000 7f78c5e81700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c012ff20 0x7f78c0070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.279+0000 7f78c5e81700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c0130a40 0x7f78c0070d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.279+0000 7f78c5e81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c0133a80 0x7f78c00712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.279+0000 7f78c5e81700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c011feb0 con 0x7f78c0130a40 2023-09-30T22:30:38.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.279+0000 7f78c5e81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c0072350 con 0x7f78c0133a80 2023-09-30T22:30:38.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.279+0000 7f78c5e81700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78c011f920 con 0x7f78c012ff20 2023-09-30T22:30:38.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.280+0000 7f78bf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c012ff20 0x7f78c0070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.280+0000 7f78bf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c012ff20 0x7f78c0070840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32948/0 (socket says 172.21.15.59:32948) 2023-09-30T22:30:38.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.280+0000 7f78bf7fe700 1 -- 172.21.15.59:0/1087527804 learned_addr learned my addr 172.21.15.59:0/1087527804 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:38.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.280+0000 7f78beffd700 1 --2- 172.21.15.59:0/1087527804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c0130a40 0x7f78c0070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.280+0000 7f78bffff700 1 --2- 172.21.15.59:0/1087527804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c0133a80 0x7f78c00712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.280+0000 7f78beffd700 1 -- 172.21.15.59:0/1087527804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c012ff20 msgr2=0x7f78c0070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.280+0000 7f78beffd700 1 --2- 172.21.15.59:0/1087527804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c012ff20 0x7f78c0070840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.280+0000 7f78beffd700 1 -- 172.21.15.59:0/1087527804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c0133a80 msgr2=0x7f78c00712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.280+0000 7f78beffd700 1 --2- 172.21.15.59:0/1087527804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c0133a80 0x7f78c00712c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.280+0000 7f78beffd700 1 -- 172.21.15.59:0/1087527804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b8009a70 con 0x7f78c0130a40 2023-09-30T22:30:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.280+0000 7f78beffd700 1 --2- 172.21.15.59:0/1087527804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c0130a40 0x7f78c0070d80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f78c009ac40 tx=0x7f78b400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.280+0000 7f78a7fff700 1 -- 172.21.15.59:0/1087527804 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4004c80 con 0x7f78c0130a40 2023-09-30T22:30:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.281+0000 7f78a7fff700 1 -- 172.21.15.59:0/1087527804 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b4004de0 con 0x7f78c0130a40 2023-09-30T22:30:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.281+0000 7f78c5e81700 1 -- 172.21.15.59:0/1087527804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c00725b0 con 0x7f78c0130a40 2023-09-30T22:30:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.281+0000 7f78a7fff700 1 -- 172.21.15.59:0/1087527804 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4007310 con 0x7f78c0130a40 2023-09-30T22:30:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.281+0000 7f78c5e81700 1 -- 172.21.15.59:0/1087527804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c012da40 con 0x7f78c0130a40 2023-09-30T22:30:38.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.282+0000 7f78c5e81700 1 -- 172.21.15.59:0/1087527804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c0074ea0 con 0x7f78c0130a40 2023-09-30T22:30:38.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.282+0000 7f78a7fff700 1 -- 172.21.15.59:0/1087527804 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78b4007470 con 0x7f78c0130a40 2023-09-30T22:30:38.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.282+0000 7f78a7fff700 1 -- 172.21.15.59:0/1087527804 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f78b403f1f0 con 0x7f78c0130a40 2023-09-30T22:30:38.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.287+0000 7f78a7fff700 1 -- 172.21.15.59:0/1087527804 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78b401bb70 con 0x7f78c0130a40 2023-09-30T22:30:38.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.331+0000 7f3ab3f81700 1 Processor -- start 2023-09-30T22:30:38.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.331+0000 7f3ab3f81700 1 -- start start 2023-09-30T22:30:38.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.332+0000 7f3ab3f81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aac09d630 0x7f3aac0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.332+0000 7f3ab3f81700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3aac138d80 0x7f3aac13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.332+0000 7f3ab3f81700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aac0a2a70 con 0x7f3aac0a0a30 2023-09-30T22:30:38.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.332+0000 7f3ab3f81700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aac0a01d0 con 0x7f3aac138d80 2023-09-30T22:30:38.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.332+0000 7f3ab3f81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac09e2b0 con 0x7f3aac09d630 2023-09-30T22:30:38.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.332+0000 7f3ab151c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aac09d630 0x7f3aac0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.332+0000 7f3ab151c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aac09d630 0x7f3aac0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33536/0 (socket says 172.21.15.59:33536) 2023-09-30T22:30:38.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.332+0000 7f3ab151c700 1 -- 172.21.15.59:0/1479160955 learned_addr learned my addr 172.21.15.59:0/1479160955 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:38.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.332+0000 7f3ab251e700 1 --2- 172.21.15.59:0/1479160955 >> v2:172.21.15.59:3300/0 conn(0x7f3aac138d80 0x7f3aac13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.333+0000 7f3ab151c700 1 -- 172.21.15.59:0/1479160955 >> v2:172.21.15.59:3300/0 conn(0x7f3aac138d80 msgr2=0x7f3aac13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:38.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.333+0000 7f3ab151c700 1 --2- 172.21.15.59:0/1479160955 >> v2:172.21.15.59:3300/0 conn(0x7f3aac138d80 0x7f3aac13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.333+0000 7f3ab151c700 1 -- 172.21.15.59:0/1479160955 >> v1:172.21.15.59:6789/0 conn(0x7f3aac0a0a30 legacy=0x7f3aac0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:38.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.333+0000 7f3ab151c700 1 -- 172.21.15.59:0/1479160955 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac09dc50 con 0x7f3aac09d630 2023-09-30T22:30:38.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.333+0000 7f3ab151c700 1 --2- 172.21.15.59:0/1479160955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aac09d630 0x7f3aac0a1510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00098f0 tx=0x7f3aa0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cced62a4b621766 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:38.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.333+0000 7f3ab0d1b700 1 -- 172.21.15.59:0/1479160955 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0011830 con 0x7f3aac09d630 2023-09-30T22:30:38.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.333+0000 7f3ab0d1b700 1 -- 172.21.15.59:0/1479160955 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa0011990 con 0x7f3aac09d630 2023-09-30T22:30:38.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.333+0000 7f3ab0d1b700 1 -- 172.21.15.59:0/1479160955 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0011d20 con 0x7f3aac09d630 2023-09-30T22:30:38.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.334+0000 7f3ab3f81700 1 -- 172.21.15.59:0/1479160955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aac09d630 msgr2=0x7f3aac0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.334+0000 7f3ab3f81700 1 --2- 172.21.15.59:0/1479160955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aac09d630 0x7f3aac0a1510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00098f0 tx=0x7f3aa0009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:38.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.334+0000 7f3ab3f81700 1 -- 172.21.15.59:0/1479160955 shutdown_connections 2023-09-30T22:30:38.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.334+0000 7f3ab3f81700 1 --2- 172.21.15.59:0/1479160955 >> v2:172.21.15.59:3300/0 conn(0x7f3aac138d80 0x7f3aac13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.334+0000 7f3ab3f81700 1 --2- 172.21.15.59:0/1479160955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aac09d630 0x7f3aac0a1510 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.334+0000 7f3ab3f81700 1 -- 172.21.15.59:0/1479160955 >> 172.21.15.59:0/1479160955 conn(0x7f3aac0a3050 msgr2=0x7f3aac0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:38.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.334+0000 7f3ab3f81700 1 -- 172.21.15.59:0/1479160955 shutdown_connections 2023-09-30T22:30:38.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.334+0000 7f3ab3f81700 1 -- 172.21.15.59:0/1479160955 wait complete. 2023-09-30T22:30:38.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.335+0000 7f3ab3f81700 1 Processor -- start 2023-09-30T22:30:38.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.335+0000 7f3ab3f81700 1 -- start start 2023-09-30T22:30:38.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.336+0000 7f3ab3f81700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aac09d630 0x7f3aac1207a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.336+0000 7f3ab3f81700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aac0a0a30 0x7f3aac120ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.336+0000 7f3ab3f81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aac138d80 0x7f3aac121220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.336+0000 7f3ab3f81700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac123670 con 0x7f3aac09d630 2023-09-30T22:30:38.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.336+0000 7f3ab3f81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac122c10 con 0x7f3aac138d80 2023-09-30T22:30:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.336+0000 7f3ab3f81700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac1242c0 con 0x7f3aac0a0a30 2023-09-30T22:30:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.336+0000 7f3ab251e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aac138d80 0x7f3aac121220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.336+0000 7f3ab1d1d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aac09d630 0x7f3aac1207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.336+0000 7f3ab251e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aac138d80 0x7f3aac121220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33546/0 (socket says 172.21.15.59:33546) 2023-09-30T22:30:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.336+0000 7f3ab251e700 1 -- 172.21.15.59:0/3633085766 learned_addr learned my addr 172.21.15.59:0/3633085766 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.337+0000 7f3ab151c700 1 --2- 172.21.15.59:0/3633085766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aac0a0a30 0x7f3aac120ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.337+0000 7f3ab251e700 1 -- 172.21.15.59:0/3633085766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aac0a0a30 msgr2=0x7f3aac120ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.337+0000 7f3ab251e700 1 --2- 172.21.15.59:0/3633085766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aac0a0a30 0x7f3aac120ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.337+0000 7f3ab251e700 1 -- 172.21.15.59:0/3633085766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aac09d630 msgr2=0x7f3aac1207a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.337+0000 7f3ab251e700 1 --2- 172.21.15.59:0/3633085766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aac09d630 0x7f3aac1207a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.337+0000 7f3ab251e700 1 -- 172.21.15.59:0/3633085766 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa0009550 con 0x7f3aac138d80 2023-09-30T22:30:38.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.337+0000 7f3ab151c700 1 --2- 172.21.15.59:0/3633085766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aac0a0a30 0x7f3aac120ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:38.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.337+0000 7f3ab251e700 1 --2- 172.21.15.59:0/3633085766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aac138d80 0x7f3aac121220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400e930 tx=0x7f3aa400ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:38.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.338+0000 7f3aaa7fc700 1 -- 172.21.15.59:0/3633085766 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa40096d0 con 0x7f3aac138d80 2023-09-30T22:30:38.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.338+0000 7f3aaa7fc700 1 -- 172.21.15.59:0/3633085766 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa400ee80 con 0x7f3aac138d80 2023-09-30T22:30:38.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.338+0000 7f3ab3f81700 1 -- 172.21.15.59:0/3633085766 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aac13aec0 con 0x7f3aac138d80 2023-09-30T22:30:38.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.338+0000 7f3aaa7fc700 1 -- 172.21.15.59:0/3633085766 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa400ca70 con 0x7f3aac138d80 2023-09-30T22:30:38.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.338+0000 7f3ab3f81700 1 -- 172.21.15.59:0/3633085766 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aac123fe0 con 0x7f3aac138d80 2023-09-30T22:30:38.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.339+0000 7f3ab3f81700 1 -- 172.21.15.59:0/3633085766 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aac0747f0 con 0x7f3aac138d80 2023-09-30T22:30:38.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.339+0000 7f3aaa7fc700 1 -- 172.21.15.59:0/3633085766 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3aa400cbd0 con 0x7f3aac138d80 2023-09-30T22:30:38.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.340+0000 7f3aaa7fc700 1 -- 172.21.15.59:0/3633085766 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3aa403f760 con 0x7f3aac138d80 2023-09-30T22:30:38.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.351+0000 7f3aaa7fc700 1 -- 172.21.15.59:0/3633085766 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3aa40232f0 con 0x7f3aac138d80 2023-09-30T22:30:38.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.459+0000 7fc2412f2700 1 -- 172.21.15.59:0/3133046166 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc23c124ae0 con 0x7fc23c0a09c0 2023-09-30T22:30:38.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.460+0000 7fc2237fe700 1 -- 172.21.15.59:0/3133046166 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc230015020 con 0x7fc23c0a09c0 2023-09-30T22:30:38.460 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:38.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.463+0000 7fc2412f2700 1 -- 172.21.15.59:0/3133046166 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23c0a09c0 msgr2=0x7fc23c122c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.463+0000 7fc2412f2700 1 --2- 172.21.15.59:0/3133046166 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23c0a09c0 0x7fc23c122c90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc230009c40 tx=0x7fc230004750 comp rx=0 tx=0).stop 2023-09-30T22:30:38.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.463+0000 7fc2412f2700 1 -- 172.21.15.59:0/3133046166 shutdown_connections 2023-09-30T22:30:38.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.463+0000 7fc2412f2700 1 --2- 172.21.15.59:0/3133046166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc23c0a14a0 0x7fc23c1231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.463+0000 7fc2412f2700 1 --2- 172.21.15.59:0/3133046166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23c09d5c0 0x7fc23c122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.463+0000 7fc2412f2700 1 --2- 172.21.15.59:0/3133046166 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23c0a09c0 0x7fc23c122c90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.463+0000 7fc2412f2700 1 -- 172.21.15.59:0/3133046166 >> 172.21.15.59:0/3133046166 conn(0x7fc23c0a2fe0 msgr2=0x7fc23c13adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:38.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.463+0000 7fc2412f2700 1 -- 172.21.15.59:0/3133046166 shutdown_connections 2023-09-30T22:30:38.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.463+0000 7fc2412f2700 1 -- 172.21.15.59:0/3133046166 wait complete. 2023-09-30T22:30:38.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:38.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.501+0000 7f78c5e81700 1 -- 172.21.15.59:0/1087527804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f78c006b250 con 0x7f78c0130a40 2023-09-30T22:30:38.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.502+0000 7f78a7fff700 1 -- 172.21.15.59:0/1087527804 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78b401b760 con 0x7f78c0130a40 2023-09-30T22:30:38.502 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:38.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.504+0000 7f78c5e81700 1 -- 172.21.15.59:0/1087527804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c0130a40 msgr2=0x7f78c0070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.504+0000 7f78c5e81700 1 --2- 172.21.15.59:0/1087527804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c0130a40 0x7f78c0070d80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f78c009ac40 tx=0x7f78b400c750 comp rx=0 tx=0).stop 2023-09-30T22:30:38.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.504+0000 7f78c5e81700 1 -- 172.21.15.59:0/1087527804 shutdown_connections 2023-09-30T22:30:38.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.504+0000 7f78c5e81700 1 --2- 172.21.15.59:0/1087527804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c012ff20 0x7f78c0070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.504+0000 7f78c5e81700 1 --2- 172.21.15.59:0/1087527804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c0133a80 0x7f78c00712c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.504+0000 7f78c5e81700 1 --2- 172.21.15.59:0/1087527804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c0130a40 0x7f78c0070d80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.504+0000 7f78c5e81700 1 -- 172.21.15.59:0/1087527804 >> 172.21.15.59:0/1087527804 conn(0x7f78c00a4210 msgr2=0x7f78c009e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:38.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.504+0000 7f78c5e81700 1 -- 172.21.15.59:0/1087527804 shutdown_connections 2023-09-30T22:30:38.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.504+0000 7f78c5e81700 1 -- 172.21.15.59:0/1087527804 wait complete. 2023-09-30T22:30:38.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.561+0000 7f3ab3f81700 1 -- 172.21.15.59:0/3633085766 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3aac072980 con 0x7f3aac138d80 2023-09-30T22:30:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.562+0000 7f3aaa7fc700 1 -- 172.21.15.59:0/3633085766 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3aa4021030 con 0x7f3aac138d80 2023-09-30T22:30:38.562 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:38.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.564+0000 7f3ab3f81700 1 -- 172.21.15.59:0/3633085766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aac138d80 msgr2=0x7f3aac121220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.564+0000 7f3ab3f81700 1 --2- 172.21.15.59:0/3633085766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aac138d80 0x7f3aac121220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400e930 tx=0x7f3aa400ec40 comp rx=0 tx=0).stop 2023-09-30T22:30:38.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.564+0000 7f3ab3f81700 1 -- 172.21.15.59:0/3633085766 shutdown_connections 2023-09-30T22:30:38.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.564+0000 7f3ab3f81700 1 --2- 172.21.15.59:0/3633085766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aac138d80 0x7f3aac121220 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.564+0000 7f3ab3f81700 1 --2- 172.21.15.59:0/3633085766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aac09d630 0x7f3aac1207a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.564+0000 7f3ab3f81700 1 --2- 172.21.15.59:0/3633085766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aac0a0a30 0x7f3aac120ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.564+0000 7f3ab3f81700 1 -- 172.21.15.59:0/3633085766 >> 172.21.15.59:0/3633085766 conn(0x7f3aac0a3050 msgr2=0x7f3aac139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:38.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.564+0000 7f3ab3f81700 1 -- 172.21.15.59:0/3633085766 shutdown_connections 2023-09-30T22:30:38.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.564+0000 7f3ab3f81700 1 -- 172.21.15.59:0/3633085766 wait complete. 2023-09-30T22:30:38.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:38.706 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:38.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.852+0000 7f28ea14f700 1 Processor -- start 2023-09-30T22:30:38.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.852+0000 7f28ea14f700 1 -- start start 2023-09-30T22:30:38.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.852+0000 7f28ea14f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28e409d6f0 0x7f28e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.852+0000 7f28ea14f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28e409e000 0x7f28e4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.852+0000 7f28ea14f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28e409e410 0x7f28e4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.852+0000 7f28ea14f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e409f520 con 0x7f28e409e410 2023-09-30T22:30:38.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28ea14f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e409f130 con 0x7f28e409d6f0 2023-09-30T22:30:38.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28ea14f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28e409e930 con 0x7f28e409e000 2023-09-30T22:30:38.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28e409e000 0x7f28e4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28e409d6f0 0x7f28e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28e409e410 0x7f28e4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28e409d6f0 0x7f28e409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33558/0 (socket says 172.21.15.59:33558) 2023-09-30T22:30:38.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28e409e000 0x7f28e4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32956/0 (socket says 172.21.15.59:32956) 2023-09-30T22:30:38.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e37fe700 1 -- 172.21.15.59:0/4046835284 learned_addr learned my addr 172.21.15.59:0/4046835284 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:38.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e37fe700 1 -- 172.21.15.59:0/4046835284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28e409e000 msgr2=0x7f28e4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:38.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e37fe700 1 --2- 172.21.15.59:0/4046835284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28e409e000 0x7f28e4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e37fe700 1 -- 172.21.15.59:0/4046835284 >> v2:172.21.15.59:3300/0 conn(0x7f28e409e410 msgr2=0x7f28e4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:38.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e37fe700 1 --2- 172.21.15.59:0/4046835284 >> v2:172.21.15.59:3300/0 conn(0x7f28e409e410 0x7f28e4130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e37fe700 1 -- 172.21.15.59:0/4046835284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e409b2d0 con 0x7f28e409d6f0 2023-09-30T22:30:38.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e3fff700 1 --2- 172.21.15.59:0/4046835284 >> v2:172.21.15.59:3300/0 conn(0x7f28e409e410 0x7f28e4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:38.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e2ffd700 1 --2- 172.21.15.59:0/4046835284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28e409e000 0x7f28e4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e37fe700 1 --2- 172.21.15.59:0/4046835284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28e409d6f0 0x7f28e409dac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f28d400b9d0 tx=0x7f28d400bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4591ca78b6c17e4a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e27fc700 1 -- 172.21.15.59:0/4046835284 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d400cc20 con 0x7f28e409d6f0 2023-09-30T22:30:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e27fc700 1 -- 172.21.15.59:0/4046835284 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d400cd80 con 0x7f28e409d6f0 2023-09-30T22:30:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.853+0000 7f28e27fc700 1 -- 172.21.15.59:0/4046835284 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d400f680 con 0x7f28e409d6f0 2023-09-30T22:30:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.854+0000 7f28ea14f700 1 -- 172.21.15.59:0/4046835284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28e409d6f0 msgr2=0x7f28e409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.854+0000 7f28ea14f700 1 --2- 172.21.15.59:0/4046835284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28e409d6f0 0x7f28e409dac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f28d400b9d0 tx=0x7f28d400bce0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.854+0000 7f28ea14f700 1 -- 172.21.15.59:0/4046835284 shutdown_connections 2023-09-30T22:30:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.854+0000 7f28ea14f700 1 --2- 172.21.15.59:0/4046835284 >> v2:172.21.15.59:3300/0 conn(0x7f28e409e410 0x7f28e4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.854+0000 7f28ea14f700 1 --2- 172.21.15.59:0/4046835284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28e409d6f0 0x7f28e409dac0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.854+0000 7f28ea14f700 1 --2- 172.21.15.59:0/4046835284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28e409e000 0x7f28e4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.854+0000 7f28ea14f700 1 -- 172.21.15.59:0/4046835284 >> 172.21.15.59:0/4046835284 conn(0x7f28e4066f50 msgr2=0x7f28e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.854+0000 7f28ea14f700 1 -- 172.21.15.59:0/4046835284 shutdown_connections 2023-09-30T22:30:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.854+0000 7f28ea14f700 1 -- 172.21.15.59:0/4046835284 wait complete. 2023-09-30T22:30:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.855+0000 7f28ea14f700 1 Processor -- start 2023-09-30T22:30:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.855+0000 7f28ea14f700 1 -- start start 2023-09-30T22:30:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28ea14f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28e409d6f0 0x7f28e411e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28ea14f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28e409e000 0x7f28e411e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28ea14f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28e409e410 0x7f28e411ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28ea14f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e409c700 con 0x7f28e409e000 2023-09-30T22:30:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28ea14f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e4120290 con 0x7f28e409d6f0 2023-09-30T22:30:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28ea14f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28e40a1a70 con 0x7f28e409e410 2023-09-30T22:30:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28e2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28e409e000 0x7f28e411e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28e3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28e409e410 0x7f28e411ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28e37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28e409d6f0 0x7f28e411e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28e37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28e409d6f0 0x7f28e411e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33568/0 (socket says 172.21.15.59:33568) 2023-09-30T22:30:38.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28e2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28e409e000 0x7f28e411e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57668/0 (socket says 172.21.15.59:57668) 2023-09-30T22:30:38.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28e37fe700 1 -- 172.21.15.59:0/1271753174 learned_addr learned my addr 172.21.15.59:0/1271753174 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:38.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28e3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28e409e410 0x7f28e411ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32966/0 (socket says 172.21.15.59:32966) 2023-09-30T22:30:38.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28e2ffd700 1 -- 172.21.15.59:0/1271753174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28e409e410 msgr2=0x7f28e411ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28e2ffd700 1 --2- 172.21.15.59:0/1271753174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28e409e410 0x7f28e411ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28e2ffd700 1 -- 172.21.15.59:0/1271753174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28e409d6f0 msgr2=0x7f28e411e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28e2ffd700 1 --2- 172.21.15.59:0/1271753174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28e409d6f0 0x7f28e411e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28e2ffd700 1 -- 172.21.15.59:0/1271753174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d80094a0 con 0x7f28e409e000 2023-09-30T22:30:38.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28e37fe700 1 --2- 172.21.15.59:0/1271753174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28e409d6f0 0x7f28e411e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:38.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.856+0000 7f28e2ffd700 1 --2- 172.21.15.59:0/1271753174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28e409e000 0x7f28e411e6b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f28e40a3e20 tx=0x7f28d800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:38.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.857+0000 7f28cbfff700 1 -- 172.21.15.59:0/1271753174 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8004240 con 0x7f28e409e000 2023-09-30T22:30:38.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.857+0000 7f28cbfff700 1 -- 172.21.15.59:0/1271753174 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d80043a0 con 0x7f28e409e000 2023-09-30T22:30:38.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.857+0000 7f28ea14f700 1 -- 172.21.15.59:0/1271753174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28dc00f050 con 0x7f28e409e000 2023-09-30T22:30:38.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.857+0000 7f28cbfff700 1 -- 172.21.15.59:0/1271753174 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d80036a0 con 0x7f28e409e000 2023-09-30T22:30:38.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.857+0000 7f28ea14f700 1 -- 172.21.15.59:0/1271753174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d400b600 con 0x7f28e409e000 2023-09-30T22:30:38.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.857+0000 7f28cbfff700 1 -- 172.21.15.59:0/1271753174 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28d8003800 con 0x7f28e409e000 2023-09-30T22:30:38.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.858+0000 7f28cbfff700 1 -- 172.21.15.59:0/1271753174 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f28d803fb10 con 0x7f28e409e000 2023-09-30T22:30:38.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.858+0000 7f28ea14f700 1 -- 172.21.15.59:0/1271753174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e4121590 con 0x7f28e409e000 2023-09-30T22:30:38.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:38.863+0000 7f28cbfff700 1 -- 172.21.15.59:0/1271753174 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28e4121590 con 0x7f28e409e000 2023-09-30T22:30:39.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.065+0000 7f28ea14f700 1 -- 172.21.15.59:0/1271753174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f28e4121590 con 0x7f28e409e000 2023-09-30T22:30:39.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.065+0000 7f28cbfff700 1 -- 172.21.15.59:0/1271753174 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28e4121590 con 0x7f28e409e000 2023-09-30T22:30:39.065 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.067+0000 7f28ea14f700 1 -- 172.21.15.59:0/1271753174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28e409e000 msgr2=0x7f28e411e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.067+0000 7f28ea14f700 1 --2- 172.21.15.59:0/1271753174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28e409e000 0x7f28e411e6b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f28e40a3e20 tx=0x7f28d800ec60 comp rx=0 tx=0).stop 2023-09-30T22:30:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.067+0000 7f28ea14f700 1 -- 172.21.15.59:0/1271753174 shutdown_connections 2023-09-30T22:30:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.067+0000 7f28ea14f700 1 --2- 172.21.15.59:0/1271753174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28e409e410 0x7f28e411ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.067+0000 7f28ea14f700 1 --2- 172.21.15.59:0/1271753174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28e409d6f0 0x7f28e411e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.067+0000 7f28ea14f700 1 --2- 172.21.15.59:0/1271753174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28e409e000 0x7f28e411e6b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.067+0000 7f28ea14f700 1 -- 172.21.15.59:0/1271753174 >> 172.21.15.59:0/1271753174 conn(0x7f28e4066f50 msgr2=0x7f28e406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.067+0000 7f28ea14f700 1 -- 172.21.15.59:0/1271753174 shutdown_connections 2023-09-30T22:30:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.067+0000 7f28ea14f700 1 -- 172.21.15.59:0/1271753174 wait complete. 2023-09-30T22:30:39.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:39.478 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:39.518 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:39.579 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:39.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.628+0000 7f9bbb33a700 1 Processor -- start 2023-09-30T22:30:39.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.628+0000 7f9bbb33a700 1 -- start start 2023-09-30T22:30:39.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.629+0000 7f9bbb33a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bb409e930 0x7f9bb409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.629+0000 7f9bbb33a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bb409f240 0x7f9bb41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.629+0000 7f9bbb33a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb4070940 con 0x7f9bb409f650 2023-09-30T22:30:39.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.629+0000 7f9bbb33a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb406fd60 con 0x7f9bb409f240 2023-09-30T22:30:39.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.629+0000 7f9bbb33a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb406fa80 con 0x7f9bb409e930 2023-09-30T22:30:39.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.629+0000 7f9bb98d7700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9bb409f650 0x7f9bb4131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58152/0 (socket says 172.21.15.59:58152) 2023-09-30T22:30:39.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.629+0000 7f9bb98d7700 1 -- 172.21.15.59:0/3793017032 learned_addr learned my addr 172.21.15.59:0/3793017032 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:39.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.629+0000 7f9bb90d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bb409e930 0x7f9bb409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.629+0000 7f9bb88d5700 1 --2- 172.21.15.59:0/3793017032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bb409f240 0x7f9bb41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.630+0000 7f9babfff700 1 -- 172.21.15.59:0/3793017032 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333720319 0 0) 0x7f9bb4070940 con 0x7f9bb409f650 2023-09-30T22:30:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.630+0000 7f9babfff700 1 -- 172.21.15.59:0/3793017032 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba00035b0 con 0x7f9bb409f650 2023-09-30T22:30:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.630+0000 7f9bb88d5700 1 -- 172.21.15.59:0/3793017032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bb409e930 msgr2=0x7f9bb409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.630+0000 7f9bb88d5700 1 --2- 172.21.15.59:0/3793017032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bb409e930 0x7f9bb409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.630+0000 7f9bb88d5700 1 -- 172.21.15.59:0/3793017032 >> v1:172.21.15.59:6789/0 conn(0x7f9bb409f650 legacy=0x7f9bb4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.630+0000 7f9bb88d5700 1 -- 172.21.15.59:0/3793017032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb409fb60 con 0x7f9bb409f240 2023-09-30T22:30:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.630+0000 7f9bb90d6700 1 --2- 172.21.15.59:0/3793017032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bb409e930 0x7f9bb409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.630+0000 7f9bb88d5700 1 --2- 172.21.15.59:0/3793017032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bb409f240 0x7f9bb41317f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400dc90 tx=0x7f9ba400f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dc270073988a942 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.630+0000 7f9babfff700 1 -- 172.21.15.59:0/3793017032 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4012070 con 0x7f9bb409f240 2023-09-30T22:30:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.630+0000 7f9babfff700 1 -- 172.21.15.59:0/3793017032 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba400d2e0 con 0x7f9bb409f240 2023-09-30T22:30:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.630+0000 7f9babfff700 1 -- 172.21.15.59:0/3793017032 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba400f8f0 con 0x7f9bb409f240 2023-09-30T22:30:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.631+0000 7f9bbb33a700 1 -- 172.21.15.59:0/3793017032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bb409f240 msgr2=0x7f9bb41317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.631+0000 7f9bbb33a700 1 --2- 172.21.15.59:0/3793017032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bb409f240 0x7f9bb41317f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400dc90 tx=0x7f9ba400f050 comp rx=0 tx=0).stop 2023-09-30T22:30:39.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.631+0000 7f9bbb33a700 1 -- 172.21.15.59:0/3793017032 shutdown_connections 2023-09-30T22:30:39.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.631+0000 7f9bbb33a700 1 --2- 172.21.15.59:0/3793017032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bb409e930 0x7f9bb409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.631+0000 7f9bbb33a700 1 --2- 172.21.15.59:0/3793017032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bb409f240 0x7f9bb41317f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.631+0000 7f9bbb33a700 1 -- 172.21.15.59:0/3793017032 >> 172.21.15.59:0/3793017032 conn(0x7f9bb40a4210 msgr2=0x7f9bb40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:39.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.631+0000 7f9bbb33a700 1 -- 172.21.15.59:0/3793017032 shutdown_connections 2023-09-30T22:30:39.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.631+0000 7f9bbb33a700 1 -- 172.21.15.59:0/3793017032 wait complete. 2023-09-30T22:30:39.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.632+0000 7f9bbb33a700 1 Processor -- start 2023-09-30T22:30:39.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.632+0000 7f9bbb33a700 1 -- start start 2023-09-30T22:30:39.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bbb33a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bb409e930 0x7f9bb41a0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bbb33a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bb409f240 0x7f9bb41a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bbb33a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bb409f650 0x7f9bb41c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bbb33a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb41a3ef0 con 0x7f9bb409f650 2023-09-30T22:30:39.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bbb33a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb41b4f60 con 0x7f9bb409f240 2023-09-30T22:30:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bbb33a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb41a0ab0 con 0x7f9bb409e930 2023-09-30T22:30:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bb98d7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bb409f650 0x7f9bb41c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bb88d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bb409f240 0x7f9bb41a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bb90d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bb409e930 0x7f9bb41a0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bb88d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bb409f240 0x7f9bb41a14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33574/0 (socket says 172.21.15.59:33574) 2023-09-30T22:30:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bb98d7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bb409f650 0x7f9bb41c3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57676/0 (socket says 172.21.15.59:57676) 2023-09-30T22:30:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bb88d5700 1 -- 172.21.15.59:0/3148046758 learned_addr learned my addr 172.21.15.59:0/3148046758 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bb88d5700 1 -- 172.21.15.59:0/3148046758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bb409e930 msgr2=0x7f9bb41a0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bb88d5700 1 --2- 172.21.15.59:0/3148046758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bb409e930 0x7f9bb41a0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bb88d5700 1 -- 172.21.15.59:0/3148046758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bb409f650 msgr2=0x7f9bb41c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bb88d5700 1 --2- 172.21.15.59:0/3148046758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bb409f650 0x7f9bb41c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bb88d5700 1 -- 172.21.15.59:0/3148046758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb00094a0 con 0x7f9bb409f240 2023-09-30T22:30:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.633+0000 7f9bb90d6700 1 --2- 172.21.15.59:0/3148046758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bb409e930 0x7f9bb41a0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.634+0000 7f9bb88d5700 1 --2- 172.21.15.59:0/3148046758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bb409f240 0x7f9bb41a14e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4016000 tx=0x7f9ba4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.634+0000 7f9ba9ffb700 1 -- 172.21.15.59:0/3148046758 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba400b070 con 0x7f9bb409f240 2023-09-30T22:30:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.634+0000 7f9ba9ffb700 1 -- 172.21.15.59:0/3148046758 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4010ca0 con 0x7f9bb409f240 2023-09-30T22:30:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.634+0000 7f9ba9ffb700 1 -- 172.21.15.59:0/3148046758 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40036a0 con 0x7f9bb409f240 2023-09-30T22:30:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.634+0000 7f9bbb33a700 1 -- 172.21.15.59:0/3148046758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba400d940 con 0x7f9bb409f240 2023-09-30T22:30:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.634+0000 7f9bbb33a700 1 -- 172.21.15.59:0/3148046758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb40a0190 con 0x7f9bb409f240 2023-09-30T22:30:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.635+0000 7f9ba9ffb700 1 -- 172.21.15.59:0/3148046758 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ba4003820 con 0x7f9bb409f240 2023-09-30T22:30:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.635+0000 7f9ba9ffb700 1 -- 172.21.15.59:0/3148046758 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9ba40400a0 con 0x7f9bb409f240 2023-09-30T22:30:39.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.636+0000 7f9bbb33a700 1 -- 172.21.15.59:0/3148046758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb41a21e0 con 0x7f9bb409f240 2023-09-30T22:30:39.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.645+0000 7f9ba9ffb700 1 -- 172.21.15.59:0/3148046758 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ba401f970 con 0x7f9bb409f240 2023-09-30T22:30:39.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.671+0000 7f47d11eb700 1 Processor -- start 2023-09-30T22:30:39.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.671+0000 7f47d11eb700 1 -- start start 2023-09-30T22:30:39.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47d11eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc09d6f0 0x7f47cc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47d11eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47cc09e000 0x7f47cc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47d11eb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc09f130 con 0x7f47cc09e410 2023-09-30T22:30:39.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47d11eb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc09f520 con 0x7f47cc09d6f0 2023-09-30T22:30:39.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47d11eb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc09e930 con 0x7f47cc09e000 2023-09-30T22:30:39.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47cad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc09d6f0 0x7f47cc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47cad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc09d6f0 0x7f47cc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33580/0 (socket says 172.21.15.59:33580) 2023-09-30T22:30:39.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47cad9d700 1 -- 172.21.15.59:0/2708595726 learned_addr learned my addr 172.21.15.59:0/2708595726 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:39.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47cb59e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f47cc09e410 0x7f47cc130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58158/0 (socket says 172.21.15.59:58158) 2023-09-30T22:30:39.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47ca59c700 1 --2- 172.21.15.59:0/2708595726 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47cc09e000 0x7f47cc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47cad9d700 1 -- 172.21.15.59:0/2708595726 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47cc09e000 msgr2=0x7f47cc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:39.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47cad9d700 1 --2- 172.21.15.59:0/2708595726 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47cc09e000 0x7f47cc130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47cad9d700 1 -- 172.21.15.59:0/2708595726 >> v1:172.21.15.59:6789/0 conn(0x7f47cc09e410 legacy=0x7f47cc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47c9d9b700 1 -- 172.21.15.59:0/2708595726 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627306729 0 0) 0x7f47cc09f130 con 0x7f47cc09e410 2023-09-30T22:30:39.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47cad9d700 1 -- 172.21.15.59:0/2708595726 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc09b2d0 con 0x7f47cc09d6f0 2023-09-30T22:30:39.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.672+0000 7f47cad9d700 1 --2- 172.21.15.59:0/2708595726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc09d6f0 0x7f47cc09dac0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009e80 tx=0x7f47bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fb56a77bfedf9ee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:39.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.673+0000 7f47c9d9b700 1 -- 172.21.15.59:0/2708595726 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc00e070 con 0x7f47cc09d6f0 2023-09-30T22:30:39.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.673+0000 7f47c9d9b700 1 -- 172.21.15.59:0/2708595726 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc00b910 con 0x7f47cc09d6f0 2023-09-30T22:30:39.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.673+0000 7f47c9d9b700 1 -- 172.21.15.59:0/2708595726 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc00bcc0 con 0x7f47cc09d6f0 2023-09-30T22:30:39.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.673+0000 7f47d11eb700 1 -- 172.21.15.59:0/2708595726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc09d6f0 msgr2=0x7f47cc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.673+0000 7f47d11eb700 1 --2- 172.21.15.59:0/2708595726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc09d6f0 0x7f47cc09dac0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009e80 tx=0x7f47bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:39.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.673+0000 7f47d11eb700 1 -- 172.21.15.59:0/2708595726 shutdown_connections 2023-09-30T22:30:39.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.673+0000 7f47d11eb700 1 --2- 172.21.15.59:0/2708595726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc09d6f0 0x7f47cc09dac0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.673+0000 7f47d11eb700 1 --2- 172.21.15.59:0/2708595726 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47cc09e000 0x7f47cc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.673+0000 7f47d11eb700 1 -- 172.21.15.59:0/2708595726 >> 172.21.15.59:0/2708595726 conn(0x7f47cc066f50 msgr2=0x7f47cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:39.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.673+0000 7f47d11eb700 1 -- 172.21.15.59:0/2708595726 shutdown_connections 2023-09-30T22:30:39.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.673+0000 7f47d11eb700 1 -- 172.21.15.59:0/2708595726 wait complete. 2023-09-30T22:30:39.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.675+0000 7f47d11eb700 1 Processor -- start 2023-09-30T22:30:39.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.675+0000 7f47d11eb700 1 -- start start 2023-09-30T22:30:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.676+0000 7f47d11eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc09d6f0 0x7f47cc122140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.676+0000 7f47d11eb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47cc09e000 0x7f47cc122680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.676+0000 7f47d11eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47cc09e410 0x7f47cc122bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.676+0000 7f47d11eb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc09c700 con 0x7f47cc09e000 2023-09-30T22:30:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.676+0000 7f47d11eb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0a3b60 con 0x7f47cc09d6f0 2023-09-30T22:30:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.676+0000 7f47d11eb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc1253f0 con 0x7f47cc09e410 2023-09-30T22:30:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.676+0000 7f47cad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc09d6f0 0x7f47cc122140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.676+0000 7f47cad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc09d6f0 0x7f47cc122140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33592/0 (socket says 172.21.15.59:33592) 2023-09-30T22:30:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.676+0000 7f47cad9d700 1 -- 172.21.15.59:0/3616935232 learned_addr learned my addr 172.21.15.59:0/3616935232 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:39.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.676+0000 7f47ca59c700 1 --2- 172.21.15.59:0/3616935232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47cc09e000 0x7f47cc122680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.676+0000 7f47cb59e700 1 --2- 172.21.15.59:0/3616935232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47cc09e410 0x7f47cc122bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.677+0000 7f47cb59e700 1 -- 172.21.15.59:0/3616935232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc09d6f0 msgr2=0x7f47cc122140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.677+0000 7f47cb59e700 1 --2- 172.21.15.59:0/3616935232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc09d6f0 0x7f47cc122140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.677+0000 7f47cb59e700 1 -- 172.21.15.59:0/3616935232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47cc09e000 msgr2=0x7f47cc122680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.677+0000 7f47cb59e700 1 --2- 172.21.15.59:0/3616935232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47cc09e000 0x7f47cc122680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.677+0000 7f47cb59e700 1 -- 172.21.15.59:0/3616935232 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc009b30 con 0x7f47cc09e410 2023-09-30T22:30:39.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.677+0000 7f47cad9d700 1 --2- 172.21.15.59:0/3616935232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc09d6f0 0x7f47cc122140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:39.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.677+0000 7f47ca59c700 1 --2- 172.21.15.59:0/3616935232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47cc09e000 0x7f47cc122680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:39.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.677+0000 7f47cb59e700 1 --2- 172.21.15.59:0/3616935232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47cc09e410 0x7f47cc122bc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f47c400c430 tx=0x7f47c400c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.677+0000 7f47c37fe700 1 -- 172.21.15.59:0/3616935232 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4004c80 con 0x7f47cc09e410 2023-09-30T22:30:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.677+0000 7f47c37fe700 1 -- 172.21.15.59:0/3616935232 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c4004e00 con 0x7f47cc09e410 2023-09-30T22:30:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.677+0000 7f47c37fe700 1 -- 172.21.15.59:0/3616935232 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4007310 con 0x7f47cc09e410 2023-09-30T22:30:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.677+0000 7f47d11eb700 1 -- 172.21.15.59:0/3616935232 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc125980 con 0x7f47cc09e410 2023-09-30T22:30:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.677+0000 7f47d11eb700 1 -- 172.21.15.59:0/3616935232 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc1263f0 con 0x7f47cc09e410 2023-09-30T22:30:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.678+0000 7f47d11eb700 1 -- 172.21.15.59:0/3616935232 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc11ac20 con 0x7f47cc09e410 2023-09-30T22:30:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.678+0000 7f47c37fe700 1 -- 172.21.15.59:0/3616935232 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47c4007470 con 0x7f47cc09e410 2023-09-30T22:30:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.678+0000 7f47c37fe700 1 -- 172.21.15.59:0/3616935232 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f47c403f280 con 0x7f47cc09e410 2023-09-30T22:30:39.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.683+0000 7f47c37fe700 1 -- 172.21.15.59:0/3616935232 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47c400ce40 con 0x7f47cc09e410 2023-09-30T22:30:39.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.755+0000 7fc247621700 1 Processor -- start 2023-09-30T22:30:39.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.756+0000 7fc247621700 1 -- start start 2023-09-30T22:30:39.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.756+0000 7fc247621700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2400954c0 0x7fc240095890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.756+0000 7fc247621700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc240099680 0x7fc240099ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.756+0000 7fc247621700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc240099ff0 0x7fc240137590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.756+0000 7fc247621700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24009aaf0 con 0x7fc2400954c0 2023-09-30T22:30:39.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.756+0000 7fc247621700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24009c280 con 0x7fc240099680 2023-09-30T22:30:39.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.756+0000 7fc247621700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc24009b960 con 0x7fc240099ff0 2023-09-30T22:30:39.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc244bbc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc240099680 0x7fc240099ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc2453bd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2400954c0 0x7fc240095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc244bbc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc240099680 0x7fc240099ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33598/0 (socket says 172.21.15.59:33598) 2023-09-30T22:30:39.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc244bbc700 1 -- 172.21.15.59:0/1123093342 learned_addr learned my addr 172.21.15.59:0/1123093342 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:39.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc245bbe700 1 --2- 172.21.15.59:0/1123093342 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc240099ff0 0x7fc240137590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc244bbc700 1 -- 172.21.15.59:0/1123093342 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc240099ff0 msgr2=0x7fc240137590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:39.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc244bbc700 1 --2- 172.21.15.59:0/1123093342 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc240099ff0 0x7fc240137590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc244bbc700 1 -- 172.21.15.59:0/1123093342 >> v2:172.21.15.59:3300/0 conn(0x7fc2400954c0 msgr2=0x7fc240095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:39.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc244bbc700 1 --2- 172.21.15.59:0/1123093342 >> v2:172.21.15.59:3300/0 conn(0x7fc2400954c0 0x7fc240095890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc244bbc700 1 -- 172.21.15.59:0/1123093342 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24009a7b0 con 0x7fc240099680 2023-09-30T22:30:39.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc2453bd700 1 --2- 172.21.15.59:0/1123093342 >> v2:172.21.15.59:3300/0 conn(0x7fc2400954c0 0x7fc240095890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:39.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc245bbe700 1 --2- 172.21.15.59:0/1123093342 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc240099ff0 0x7fc240137590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:39.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc244bbc700 1 --2- 172.21.15.59:0/1123093342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc240099680 0x7fc240099ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc2300098f0 tx=0x7fc230009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ad4283ff1ed11bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:39.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc237fff700 1 -- 172.21.15.59:0/1123093342 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230011830 con 0x7fc240099680 2023-09-30T22:30:39.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc237fff700 1 -- 172.21.15.59:0/1123093342 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc230011990 con 0x7fc240099680 2023-09-30T22:30:39.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.757+0000 7fc237fff700 1 -- 172.21.15.59:0/1123093342 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230011d20 con 0x7fc240099680 2023-09-30T22:30:39.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.758+0000 7fc247621700 1 -- 172.21.15.59:0/1123093342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc240099680 msgr2=0x7fc240099ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.758+0000 7fc247621700 1 --2- 172.21.15.59:0/1123093342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc240099680 0x7fc240099ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc2300098f0 tx=0x7fc230009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:39.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.758+0000 7fc247621700 1 -- 172.21.15.59:0/1123093342 shutdown_connections 2023-09-30T22:30:39.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.758+0000 7fc247621700 1 --2- 172.21.15.59:0/1123093342 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc240099ff0 0x7fc240137590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.758+0000 7fc247621700 1 --2- 172.21.15.59:0/1123093342 >> v2:172.21.15.59:3300/0 conn(0x7fc2400954c0 0x7fc240095890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.758+0000 7fc247621700 1 --2- 172.21.15.59:0/1123093342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc240099680 0x7fc240099ab0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.758+0000 7fc247621700 1 -- 172.21.15.59:0/1123093342 >> 172.21.15.59:0/1123093342 conn(0x7fc2400a2360 msgr2=0x7fc2400a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:39.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.758+0000 7fc247621700 1 -- 172.21.15.59:0/1123093342 shutdown_connections 2023-09-30T22:30:39.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.758+0000 7fc247621700 1 -- 172.21.15.59:0/1123093342 wait complete. 2023-09-30T22:30:39.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.760+0000 7fc247621700 1 Processor -- start 2023-09-30T22:30:39.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.760+0000 7fc247621700 1 -- start start 2023-09-30T22:30:39.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.760+0000 7fc247621700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2400954c0 0x7fc2400939d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.760+0000 7fc247621700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc240099680 0x7fc240093f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.760+0000 7fc247621700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc240099ff0 0x7fc240094450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.760+0000 7fc247621700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400917b0 con 0x7fc240099680 2023-09-30T22:30:39.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.760+0000 7fc247621700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400a0640 con 0x7fc2400954c0 2023-09-30T22:30:39.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.760+0000 7fc247621700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc240139840 con 0x7fc240099ff0 2023-09-30T22:30:39.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.761+0000 7fc244bbc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc240099680 0x7fc240093f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.761+0000 7fc244bbc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc240099680 0x7fc240093f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57704/0 (socket says 172.21.15.59:57704) 2023-09-30T22:30:39.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.761+0000 7fc244bbc700 1 -- 172.21.15.59:0/4254065081 learned_addr learned my addr 172.21.15.59:0/4254065081 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:39.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.761+0000 7fc245bbe700 1 --2- 172.21.15.59:0/4254065081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc240099ff0 0x7fc240094450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.761+0000 7fc2453bd700 1 --2- 172.21.15.59:0/4254065081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2400954c0 0x7fc2400939d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.761+0000 7fc244bbc700 1 -- 172.21.15.59:0/4254065081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc240099ff0 msgr2=0x7fc240094450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.761+0000 7fc244bbc700 1 --2- 172.21.15.59:0/4254065081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc240099ff0 0x7fc240094450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.761+0000 7fc244bbc700 1 -- 172.21.15.59:0/4254065081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2400954c0 msgr2=0x7fc2400939d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.761+0000 7fc244bbc700 1 --2- 172.21.15.59:0/4254065081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2400954c0 0x7fc2400939d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.761+0000 7fc244bbc700 1 -- 172.21.15.59:0/4254065081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c0094a0 con 0x7fc240099680 2023-09-30T22:30:39.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.761+0000 7fc244bbc700 1 --2- 172.21.15.59:0/4254065081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc240099680 0x7fc240093f10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc230000c00 tx=0x7fc230004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:39.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.761+0000 7fc235ffb700 1 -- 172.21.15.59:0/4254065081 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230004240 con 0x7fc240099680 2023-09-30T22:30:39.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.761+0000 7fc235ffb700 1 -- 172.21.15.59:0/4254065081 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23001f070 con 0x7fc240099680 2023-09-30T22:30:39.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.761+0000 7fc247621700 1 -- 172.21.15.59:0/4254065081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc238009a70 con 0x7fc240099680 2023-09-30T22:30:39.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.761+0000 7fc235ffb700 1 -- 172.21.15.59:0/4254065081 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2300045c0 con 0x7fc240099680 2023-09-30T22:30:39.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.762+0000 7fc247621700 1 -- 172.21.15.59:0/4254065081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc230009550 con 0x7fc240099680 2023-09-30T22:30:39.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.763+0000 7fc235ffb700 1 -- 172.21.15.59:0/4254065081 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc230021030 con 0x7fc240099680 2023-09-30T22:30:39.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.763+0000 7fc247621700 1 -- 172.21.15.59:0/4254065081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc240099a50 con 0x7fc240099680 2023-09-30T22:30:39.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.763+0000 7fc235ffb700 1 -- 172.21.15.59:0/4254065081 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc2300407a0 con 0x7fc240099680 2023-09-30T22:30:39.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.768+0000 7fc235ffb700 1 -- 172.21.15.59:0/4254065081 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2300197c0 con 0x7fc240099680 2023-09-30T22:30:39.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.886+0000 7f9bbb33a700 1 -- 172.21.15.59:0/3148046758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9bb409ffe0 con 0x7f9bb409f240 2023-09-30T22:30:39.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.886+0000 7f9ba9ffb700 1 -- 172.21.15.59:0/3148046758 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ba4015b80 con 0x7f9bb409f240 2023-09-30T22:30:39.886 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.888+0000 7f9bbb33a700 1 -- 172.21.15.59:0/3148046758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bb409f240 msgr2=0x7f9bb41a14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.888+0000 7f9bbb33a700 1 --2- 172.21.15.59:0/3148046758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bb409f240 0x7f9bb41a14e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4016000 tx=0x7f9ba4004750 comp rx=0 tx=0).stop 2023-09-30T22:30:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.889+0000 7f9bbb33a700 1 -- 172.21.15.59:0/3148046758 shutdown_connections 2023-09-30T22:30:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.889+0000 7f9bbb33a700 1 --2- 172.21.15.59:0/3148046758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bb409e930 0x7f9bb41a0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.889+0000 7f9bbb33a700 1 --2- 172.21.15.59:0/3148046758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bb409f650 0x7f9bb41c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.889+0000 7f9bbb33a700 1 --2- 172.21.15.59:0/3148046758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bb409f240 0x7f9bb41a14e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.889+0000 7f9bbb33a700 1 -- 172.21.15.59:0/3148046758 >> 172.21.15.59:0/3148046758 conn(0x7f9bb40a4210 msgr2=0x7f9bb406c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.889+0000 7f9bbb33a700 1 -- 172.21.15.59:0/3148046758 shutdown_connections 2023-09-30T22:30:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.889+0000 7f9bbb33a700 1 -- 172.21.15.59:0/3148046758 wait complete. 2023-09-30T22:30:39.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:39.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.927+0000 7f47d11eb700 1 -- 172.21.15.59:0/3616935232 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f47cc074ea0 con 0x7f47cc09e410 2023-09-30T22:30:39.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.927+0000 7f47c37fe700 1 -- 172.21.15.59:0/3616935232 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f47c4011360 con 0x7f47cc09e410 2023-09-30T22:30:39.928 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:39.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.930+0000 7f47d11eb700 1 -- 172.21.15.59:0/3616935232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47cc09e410 msgr2=0x7f47cc122bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.930+0000 7f47d11eb700 1 --2- 172.21.15.59:0/3616935232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47cc09e410 0x7f47cc122bc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f47c400c430 tx=0x7f47c400c740 comp rx=0 tx=0).stop 2023-09-30T22:30:39.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.930+0000 7f47d11eb700 1 -- 172.21.15.59:0/3616935232 shutdown_connections 2023-09-30T22:30:39.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.930+0000 7f47d11eb700 1 --2- 172.21.15.59:0/3616935232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47cc09e410 0x7f47cc122bc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.930+0000 7f47d11eb700 1 --2- 172.21.15.59:0/3616935232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc09d6f0 0x7f47cc122140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.930+0000 7f47d11eb700 1 --2- 172.21.15.59:0/3616935232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47cc09e000 0x7f47cc122680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.930+0000 7f47d11eb700 1 -- 172.21.15.59:0/3616935232 >> 172.21.15.59:0/3616935232 conn(0x7f47cc066f50 msgr2=0x7f47cc130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:39.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.930+0000 7f47d11eb700 1 -- 172.21.15.59:0/3616935232 shutdown_connections 2023-09-30T22:30:39.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.930+0000 7f47d11eb700 1 -- 172.21.15.59:0/3616935232 wait complete. 2023-09-30T22:30:39.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:39.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.995+0000 7fc247621700 1 -- 172.21.15.59:0/4254065081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc240096df0 con 0x7fc240099680 2023-09-30T22:30:39.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.996+0000 7fc235ffb700 1 -- 172.21.15.59:0/4254065081 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc230015030 con 0x7fc240099680 2023-09-30T22:30:39.996 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:39.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.998+0000 7fc247621700 1 -- 172.21.15.59:0/4254065081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc240099680 msgr2=0x7fc240093f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.998+0000 7fc247621700 1 --2- 172.21.15.59:0/4254065081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc240099680 0x7fc240093f10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc230000c00 tx=0x7fc230004750 comp rx=0 tx=0).stop 2023-09-30T22:30:39.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.998+0000 7fc247621700 1 -- 172.21.15.59:0/4254065081 shutdown_connections 2023-09-30T22:30:39.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.998+0000 7fc247621700 1 --2- 172.21.15.59:0/4254065081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc240099ff0 0x7fc240094450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.998+0000 7fc247621700 1 --2- 172.21.15.59:0/4254065081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2400954c0 0x7fc2400939d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.998+0000 7fc247621700 1 --2- 172.21.15.59:0/4254065081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc240099680 0x7fc240093f10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.998+0000 7fc247621700 1 -- 172.21.15.59:0/4254065081 >> 172.21.15.59:0/4254065081 conn(0x7fc2400a2360 msgr2=0x7fc24009d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:39.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.998+0000 7fc247621700 1 -- 172.21.15.59:0/4254065081 shutdown_connections 2023-09-30T22:30:39.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:39.998+0000 7fc247621700 1 -- 172.21.15.59:0/4254065081 wait complete. 2023-09-30T22:30:40.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:40.082 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:40.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.222+0000 7f4223948700 1 Processor -- start 2023-09-30T22:30:40.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.222+0000 7f4223948700 1 -- start start 2023-09-30T22:30:40.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f4223948700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f421c09e930 0x7f421c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f4223948700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421c09f650 0x7f421c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f4223948700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f421c070940 con 0x7f421c09f240 2023-09-30T22:30:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f4223948700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f421c06fd60 con 0x7f421c09e930 2023-09-30T22:30:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f4223948700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c06fa80 con 0x7f421c09f650 2023-09-30T22:30:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f42216e4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f421c09e930 0x7f421c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f4221ee5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421c09f650 0x7f421c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f4221ee5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421c09f650 0x7f421c131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33622/0 (socket says 172.21.15.59:33622) 2023-09-30T22:30:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f4221ee5700 1 -- 172.21.15.59:0/10738372 learned_addr learned my addr 172.21.15.59:0/10738372 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f42216e4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f421c09e930 0x7f421c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57708/0 (socket says 172.21.15.59:57708) 2023-09-30T22:30:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f4220ee3700 1 --1- 172.21.15.59:0/10738372 >> v1:172.21.15.59:6789/0 conn(0x7f421c09f240 0x7f421c1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58170/0 (socket says 172.21.15.59:58170) 2023-09-30T22:30:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f42216e4700 1 -- 172.21.15.59:0/10738372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421c09f650 msgr2=0x7f421c131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:40.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f42216e4700 1 --2- 172.21.15.59:0/10738372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421c09f650 0x7f421c131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f42216e4700 1 -- 172.21.15.59:0/10738372 >> v1:172.21.15.59:6789/0 conn(0x7f421c09f240 legacy=0x7f421c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f42216e4700 1 -- 172.21.15.59:0/10738372 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c09fb60 con 0x7f421c09e930 2023-09-30T22:30:40.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f4221ee5700 1 --2- 172.21.15.59:0/10738372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421c09f650 0x7f421c131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:40.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.223+0000 7f42216e4700 1 --2- 172.21.15.59:0/10738372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f421c09e930 0x7f421c09ed00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f421800dc60 tx=0x7f421800df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59aad3cdd5c5061f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:40.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.224+0000 7f4213fff700 1 -- 172.21.15.59:0/10738372 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218012070 con 0x7f421c09e930 2023-09-30T22:30:40.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.224+0000 7f4213fff700 1 -- 172.21.15.59:0/10738372 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421800d2e0 con 0x7f421c09e930 2023-09-30T22:30:40.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.224+0000 7f4213fff700 1 -- 172.21.15.59:0/10738372 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421800f900 con 0x7f421c09e930 2023-09-30T22:30:40.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.224+0000 7f4223948700 1 -- 172.21.15.59:0/10738372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f421c09e930 msgr2=0x7f421c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.224+0000 7f4223948700 1 --2- 172.21.15.59:0/10738372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f421c09e930 0x7f421c09ed00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f421800dc60 tx=0x7f421800df70 comp rx=0 tx=0).stop 2023-09-30T22:30:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.224+0000 7f4223948700 1 -- 172.21.15.59:0/10738372 shutdown_connections 2023-09-30T22:30:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.224+0000 7f4223948700 1 --2- 172.21.15.59:0/10738372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f421c09e930 0x7f421c09ed00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.224+0000 7f4223948700 1 --2- 172.21.15.59:0/10738372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421c09f650 0x7f421c131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.224+0000 7f4223948700 1 -- 172.21.15.59:0/10738372 >> 172.21.15.59:0/10738372 conn(0x7f421c0a4210 msgr2=0x7f421c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.224+0000 7f4223948700 1 -- 172.21.15.59:0/10738372 shutdown_connections 2023-09-30T22:30:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.224+0000 7f4223948700 1 -- 172.21.15.59:0/10738372 wait complete. 2023-09-30T22:30:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.225+0000 7f4223948700 1 Processor -- start 2023-09-30T22:30:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.225+0000 7f4223948700 1 -- start start 2023-09-30T22:30:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4223948700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421c09e930 0x7f421c1a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4223948700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f421c09f240 0x7f421c1a21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4223948700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f421c09f650 0x7f421c1a2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4223948700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c1a3160 con 0x7f421c09f650 2023-09-30T22:30:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4223948700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c1a38c0 con 0x7f421c09e930 2023-09-30T22:30:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4223948700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f421c1a4b10 con 0x7f421c09f240 2023-09-30T22:30:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f42216e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421c09e930 0x7f421c1a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4221ee5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f421c09f650 0x7f421c1a2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4221ee5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f421c09f650 0x7f421c1a2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57724/0 (socket says 172.21.15.59:57724) 2023-09-30T22:30:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f42216e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421c09e930 0x7f421c1a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33624/0 (socket says 172.21.15.59:33624) 2023-09-30T22:30:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4221ee5700 1 -- 172.21.15.59:0/3410506331 learned_addr learned my addr 172.21.15.59:0/3410506331 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4220ee3700 1 --2- 172.21.15.59:0/3410506331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f421c09f240 0x7f421c1a21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4221ee5700 1 -- 172.21.15.59:0/3410506331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f421c09f240 msgr2=0x7f421c1a21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4221ee5700 1 --2- 172.21.15.59:0/3410506331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f421c09f240 0x7f421c1a21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4221ee5700 1 -- 172.21.15.59:0/3410506331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421c09e930 msgr2=0x7f421c1a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4221ee5700 1 --2- 172.21.15.59:0/3410506331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421c09e930 0x7f421c1a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4221ee5700 1 -- 172.21.15.59:0/3410506331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4214009b30 con 0x7f421c09f650 2023-09-30T22:30:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f42216e4700 1 --2- 172.21.15.59:0/3410506331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421c09e930 0x7f421c1a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.226+0000 7f4221ee5700 1 --2- 172.21.15.59:0/3410506331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f421c09f650 0x7f421c1a2730 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4214009f10 tx=0x7f421400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.227+0000 7f4211ffb700 1 -- 172.21.15.59:0/3410506331 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214018070 con 0x7f421c09f650 2023-09-30T22:30:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.227+0000 7f4211ffb700 1 -- 172.21.15.59:0/3410506331 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421400f040 con 0x7f421c09f650 2023-09-30T22:30:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.227+0000 7f4223948700 1 -- 172.21.15.59:0/3410506331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421800d940 con 0x7f421c09f650 2023-09-30T22:30:40.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.227+0000 7f4211ffb700 1 -- 172.21.15.59:0/3410506331 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214003c40 con 0x7f421c09f650 2023-09-30T22:30:40.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.227+0000 7f4223948700 1 -- 172.21.15.59:0/3410506331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421c0a0190 con 0x7f421c09f650 2023-09-30T22:30:40.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.227+0000 7f4211ffb700 1 -- 172.21.15.59:0/3410506331 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f421400c940 con 0x7f421c09f650 2023-09-30T22:30:40.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.228+0000 7f4211ffb700 1 -- 172.21.15.59:0/3410506331 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f421403f7f0 con 0x7f421c09f650 2023-09-30T22:30:40.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.228+0000 7f4223948700 1 -- 172.21.15.59:0/3410506331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f421c0a35c0 con 0x7f421c09f650 2023-09-30T22:30:40.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.233+0000 7f4211ffb700 1 -- 172.21.15.59:0/3410506331 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4214014480 con 0x7f421c09f650 2023-09-30T22:30:40.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.438+0000 7f4223948700 1 -- 172.21.15.59:0/3410506331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f421c071d20 con 0x7f421c09f650 2023-09-30T22:30:40.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.438+0000 7f4211ffb700 1 -- 172.21.15.59:0/3410506331 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f421401cbb0 con 0x7f421c09f650 2023-09-30T22:30:40.438 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.440+0000 7f4223948700 1 -- 172.21.15.59:0/3410506331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f421c09f650 msgr2=0x7f421c1a2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.440+0000 7f4223948700 1 --2- 172.21.15.59:0/3410506331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f421c09f650 0x7f421c1a2730 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4214009f10 tx=0x7f421400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.440+0000 7f4223948700 1 -- 172.21.15.59:0/3410506331 shutdown_connections 2023-09-30T22:30:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.440+0000 7f4223948700 1 --2- 172.21.15.59:0/3410506331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f421c09f650 0x7f421c1a2730 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.440+0000 7f4223948700 1 --2- 172.21.15.59:0/3410506331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421c09e930 0x7f421c1a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.440+0000 7f4223948700 1 --2- 172.21.15.59:0/3410506331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f421c09f240 0x7f421c1a21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.440+0000 7f4223948700 1 -- 172.21.15.59:0/3410506331 >> 172.21.15.59:0/3410506331 conn(0x7f421c0a4210 msgr2=0x7f421c1b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.440+0000 7f4223948700 1 -- 172.21.15.59:0/3410506331 shutdown_connections 2023-09-30T22:30:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:40.441+0000 7f4223948700 1 -- 172.21.15.59:0/3410506331 wait complete. 2023-09-30T22:30:40.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:40.903 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:40.945 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:41.013 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.054+0000 7fa648fd0700 1 Processor -- start 2023-09-30T22:30:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.054+0000 7fa648fd0700 1 -- start start 2023-09-30T22:30:41.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa648fd0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa64409e930 0x7fa64409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa648fd0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa64409f240 0x7fa6441317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa648fd0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa64409f650 0x7fa644131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa648fd0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa644070940 con 0x7fa64409f650 2023-09-30T22:30:41.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa648fd0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64406fd60 con 0x7fa64409e930 2023-09-30T22:30:41.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa648fd0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa64406fa80 con 0x7fa64409f240 2023-09-30T22:30:41.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa64259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa64409e930 0x7fa64409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa642d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa64409f650 0x7fa644131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa642d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa64409f650 0x7fa644131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57728/0 (socket says 172.21.15.59:57728) 2023-09-30T22:30:41.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa64259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa64409e930 0x7fa64409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33634/0 (socket says 172.21.15.59:33634) 2023-09-30T22:30:41.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa642d9d700 1 -- 172.21.15.59:0/1717613700 learned_addr learned my addr 172.21.15.59:0/1717613700 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:41.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa639d9b700 1 --2- 172.21.15.59:0/1717613700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa64409f240 0x7fa6441317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa642d9d700 1 -- 172.21.15.59:0/1717613700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa64409f240 msgr2=0x7fa6441317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:41.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa642d9d700 1 --2- 172.21.15.59:0/1717613700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa64409f240 0x7fa6441317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa642d9d700 1 -- 172.21.15.59:0/1717613700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa64409e930 msgr2=0x7fa64409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:41.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa642d9d700 1 --2- 172.21.15.59:0/1717613700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa64409e930 0x7fa64409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.055+0000 7fa642d9d700 1 -- 172.21.15.59:0/1717613700 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64409fb60 con 0x7fa64409f650 2023-09-30T22:30:41.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.056+0000 7fa642d9d700 1 --2- 172.21.15.59:0/1717613700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa64409f650 0x7fa644131d30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00f370 tx=0x7fa63c00f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc117b27ef17fd5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.056+0000 7fa641d9b700 1 -- 172.21.15.59:0/1717613700 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c012070 con 0x7fa64409f650 2023-09-30T22:30:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.056+0000 7fa641d9b700 1 -- 172.21.15.59:0/1717613700 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c00d0d0 con 0x7fa64409f650 2023-09-30T22:30:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.056+0000 7fa641d9b700 1 -- 172.21.15.59:0/1717613700 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00d480 con 0x7fa64409f650 2023-09-30T22:30:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.056+0000 7fa648fd0700 1 -- 172.21.15.59:0/1717613700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa64409f650 msgr2=0x7fa644131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.056+0000 7fa648fd0700 1 --2- 172.21.15.59:0/1717613700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa64409f650 0x7fa644131d30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00f370 tx=0x7fa63c00f680 comp rx=0 tx=0).stop 2023-09-30T22:30:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.056+0000 7fa648fd0700 1 -- 172.21.15.59:0/1717613700 shutdown_connections 2023-09-30T22:30:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.056+0000 7fa648fd0700 1 --2- 172.21.15.59:0/1717613700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa64409f650 0x7fa644131d30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.056+0000 7fa648fd0700 1 --2- 172.21.15.59:0/1717613700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa64409e930 0x7fa64409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.056+0000 7fa648fd0700 1 --2- 172.21.15.59:0/1717613700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa64409f240 0x7fa6441317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.056+0000 7fa648fd0700 1 -- 172.21.15.59:0/1717613700 >> 172.21.15.59:0/1717613700 conn(0x7fa6440a4210 msgr2=0x7fa6440a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.057+0000 7fa648fd0700 1 -- 172.21.15.59:0/1717613700 shutdown_connections 2023-09-30T22:30:41.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.057+0000 7fa648fd0700 1 -- 172.21.15.59:0/1717613700 wait complete. 2023-09-30T22:30:41.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.058+0000 7fa648fd0700 1 Processor -- start 2023-09-30T22:30:41.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.058+0000 7fa648fd0700 1 -- start start 2023-09-30T22:30:41.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.058+0000 7fa648fd0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa64409e930 0x7fa6441b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.058+0000 7fa648fd0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa64409f240 0x7fa6441b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.058+0000 7fa648fd0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa64409f650 0x7fa6441a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.058+0000 7fa648fd0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6441a2100 con 0x7fa64409f650 2023-09-30T22:30:41.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.058+0000 7fa648fd0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6441b50c0 con 0x7fa64409f240 2023-09-30T22:30:41.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.058+0000 7fa648fd0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440a33b0 con 0x7fa64409e930 2023-09-30T22:30:41.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.059+0000 7fa642d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa64409f650 0x7fa6441a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.059+0000 7fa64259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa64409e930 0x7fa6441b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.059+0000 7fa642d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa64409f650 0x7fa6441a04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57744/0 (socket says 172.21.15.59:57744) 2023-09-30T22:30:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.059+0000 7fa642d9d700 1 -- 172.21.15.59:0/943814389 learned_addr learned my addr 172.21.15.59:0/943814389 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.059+0000 7fa639d9b700 1 --2- 172.21.15.59:0/943814389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa64409f240 0x7fa6441b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.059+0000 7fa642d9d700 1 -- 172.21.15.59:0/943814389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa64409e930 msgr2=0x7fa6441b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.059+0000 7fa642d9d700 1 --2- 172.21.15.59:0/943814389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa64409e930 0x7fa6441b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.059+0000 7fa642d9d700 1 -- 172.21.15.59:0/943814389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa64409f240 msgr2=0x7fa6441b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.059+0000 7fa642d9d700 1 --2- 172.21.15.59:0/943814389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa64409f240 0x7fa6441b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.059+0000 7fa642d9d700 1 -- 172.21.15.59:0/943814389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c00f050 con 0x7fa64409f650 2023-09-30T22:30:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.059+0000 7fa64259c700 1 --2- 172.21.15.59:0/943814389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa64409e930 0x7fa6441b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.059+0000 7fa642d9d700 1 --2- 172.21.15.59:0/943814389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa64409f650 0x7fa6441a04f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa63c016000 tx=0x7fa63c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.060+0000 7fa63b7fe700 1 -- 172.21.15.59:0/943814389 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00bc10 con 0x7fa64409f650 2023-09-30T22:30:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.060+0000 7fa63b7fe700 1 -- 172.21.15.59:0/943814389 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c00bd70 con 0x7fa64409f650 2023-09-30T22:30:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.060+0000 7fa648fd0700 1 -- 172.21.15.59:0/943814389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6440a0190 con 0x7fa64409f650 2023-09-30T22:30:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.060+0000 7fa63b7fe700 1 -- 172.21.15.59:0/943814389 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c004280 con 0x7fa64409f650 2023-09-30T22:30:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.060+0000 7fa648fd0700 1 -- 172.21.15.59:0/943814389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6441a3d80 con 0x7fa64409f650 2023-09-30T22:30:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.061+0000 7fa63b7fe700 1 -- 172.21.15.59:0/943814389 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa63c0043e0 con 0x7fa64409f650 2023-09-30T22:30:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.061+0000 7fa63b7fe700 1 -- 172.21.15.59:0/943814389 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa63c0444f0 con 0x7fa64409f650 2023-09-30T22:30:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.061+0000 7fa648fd0700 1 -- 172.21.15.59:0/943814389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6441a3d80 con 0x7fa64409f650 2023-09-30T22:30:41.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.066+0000 7fa63b7fe700 1 -- 172.21.15.59:0/943814389 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6441a3d80 con 0x7fa64409f650 2023-09-30T22:30:41.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.093+0000 7f2c95b3e700 1 Processor -- start 2023-09-30T22:30:41.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.094+0000 7f2c95b3e700 1 -- start start 2023-09-30T22:30:41.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.094+0000 7f2c95b3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c900a0a30 0x7f2c900a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.094+0000 7f2c95b3e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c90134170 0x7f2c9013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.094+0000 7f2c95b3e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c9009edd0 con 0x7f2c900a1340 2023-09-30T22:30:41.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.094+0000 7f2c95b3e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c9009e1f0 con 0x7f2c90134170 2023-09-30T22:30:41.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.094+0000 7f2c95b3e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9009dc50 con 0x7f2c900a0a30 2023-09-30T22:30:41.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.094+0000 7f2c8ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c90134170 0x7f2c9013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.094+0000 7f2c87fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2c900a1340 0x7f2c90133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58184/0 (socket says 172.21.15.59:58184) 2023-09-30T22:30:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.094+0000 7f2c8ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c90134170 0x7f2c9013bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57748/0 (socket says 172.21.15.59:57748) 2023-09-30T22:30:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.094+0000 7f2c87fff700 1 -- 172.21.15.59:0/3579781126 learned_addr learned my addr 172.21.15.59:0/3579781126 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.094+0000 7f2c8f7fe700 1 --2- 172.21.15.59:0/3579781126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c900a0a30 0x7f2c900a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.095+0000 7f2c8ffff700 1 -- 172.21.15.59:0/3579781126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c900a0a30 msgr2=0x7f2c900a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.095+0000 7f2c8ffff700 1 --2- 172.21.15.59:0/3579781126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c900a0a30 0x7f2c900a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.095+0000 7f2c8ffff700 1 -- 172.21.15.59:0/3579781126 >> v1:172.21.15.59:6789/0 conn(0x7f2c900a1340 legacy=0x7f2c90133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.095+0000 7f2c8ffff700 1 -- 172.21.15.59:0/3579781126 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c900a1fe0 con 0x7f2c90134170 2023-09-30T22:30:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.095+0000 7f2c8effd700 1 -- 172.21.15.59:0/3579781126 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508408190 0 0) 0x7f2c9009edd0 con 0x7f2c900a1340 2023-09-30T22:30:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.095+0000 7f2c8f7fe700 1 --2- 172.21.15.59:0/3579781126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c900a0a30 0x7f2c900a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.095+0000 7f2c8ffff700 1 --2- 172.21.15.59:0/3579781126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c90134170 0x7f2c9013bd30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009d90 tx=0x7f2c8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103135e7dccf9f53 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.095+0000 7f2c8effd700 1 -- 172.21.15.59:0/3579781126 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8800e070 con 0x7f2c90134170 2023-09-30T22:30:41.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.095+0000 7f2c8effd700 1 -- 172.21.15.59:0/3579781126 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8800bb20 con 0x7f2c90134170 2023-09-30T22:30:41.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.095+0000 7f2c8effd700 1 -- 172.21.15.59:0/3579781126 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88012430 con 0x7f2c90134170 2023-09-30T22:30:41.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.096+0000 7f2c95b3e700 1 -- 172.21.15.59:0/3579781126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c90134170 msgr2=0x7f2c9013bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.096+0000 7f2c95b3e700 1 --2- 172.21.15.59:0/3579781126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c90134170 0x7f2c9013bd30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009d90 tx=0x7f2c8800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:41.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.096+0000 7f2c95b3e700 1 -- 172.21.15.59:0/3579781126 shutdown_connections 2023-09-30T22:30:41.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.096+0000 7f2c95b3e700 1 --2- 172.21.15.59:0/3579781126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c90134170 0x7f2c9013bd30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.096+0000 7f2c95b3e700 1 --2- 172.21.15.59:0/3579781126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c900a0a30 0x7f2c900a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.096+0000 7f2c95b3e700 1 -- 172.21.15.59:0/3579781126 >> 172.21.15.59:0/3579781126 conn(0x7f2c900a6550 msgr2=0x7f2c900a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.096+0000 7f2c95b3e700 1 -- 172.21.15.59:0/3579781126 shutdown_connections 2023-09-30T22:30:41.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.096+0000 7f2c95b3e700 1 -- 172.21.15.59:0/3579781126 wait complete. 2023-09-30T22:30:41.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.097+0000 7f2c95b3e700 1 Processor -- start 2023-09-30T22:30:41.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.097+0000 7f2c95b3e700 1 -- start start 2023-09-30T22:30:41.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.097+0000 7f2c95b3e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c900a0a30 0x7f2c90122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.097+0000 7f2c95b3e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c900a1340 0x7f2c90122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.097+0000 7f2c95b3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c90134170 0x7f2c90123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.097+0000 7f2c95b3e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c90125f30 con 0x7f2c900a0a30 2023-09-30T22:30:41.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.097+0000 7f2c95b3e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c900a4dc0 con 0x7f2c90134170 2023-09-30T22:30:41.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.097+0000 7f2c95b3e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c900a0220 con 0x7f2c900a1340 2023-09-30T22:30:41.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.098+0000 7f2c87fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c900a1340 0x7f2c90122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.098+0000 7f2c87fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c900a1340 0x7f2c90122cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33064/0 (socket says 172.21.15.59:33064) 2023-09-30T22:30:41.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.098+0000 7f2c87fff700 1 -- 172.21.15.59:0/116149365 learned_addr learned my addr 172.21.15.59:0/116149365 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:41.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.098+0000 7f2c8ffff700 1 --2- 172.21.15.59:0/116149365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c90134170 0x7f2c90123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.098+0000 7f2c8f7fe700 1 --2- 172.21.15.59:0/116149365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c900a0a30 0x7f2c90122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.098+0000 7f2c87fff700 1 -- 172.21.15.59:0/116149365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c90134170 msgr2=0x7f2c90123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.098+0000 7f2c87fff700 1 --2- 172.21.15.59:0/116149365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c90134170 0x7f2c90123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.098+0000 7f2c87fff700 1 -- 172.21.15.59:0/116149365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c900a0a30 msgr2=0x7f2c90122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.098+0000 7f2c87fff700 1 --2- 172.21.15.59:0/116149365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c900a0a30 0x7f2c90122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.098+0000 7f2c87fff700 1 -- 172.21.15.59:0/116149365 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c800094a0 con 0x7f2c900a1340 2023-09-30T22:30:41.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.098+0000 7f2c8ffff700 1 --2- 172.21.15.59:0/116149365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c90134170 0x7f2c90123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:41.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.098+0000 7f2c8f7fe700 1 --2- 172.21.15.59:0/116149365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c900a0a30 0x7f2c90122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:41.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.098+0000 7f2c87fff700 1 --2- 172.21.15.59:0/116149365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c900a1340 0x7f2c90122cc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800c520 tx=0x7f2c7800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.098+0000 7f2c8cff9700 1 -- 172.21.15.59:0/116149365 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78004c80 con 0x7f2c900a1340 2023-09-30T22:30:41.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.098+0000 7f2c8cff9700 1 -- 172.21.15.59:0/116149365 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c78004de0 con 0x7f2c900a1340 2023-09-30T22:30:41.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.099+0000 7f2c8cff9700 1 -- 172.21.15.59:0/116149365 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78007310 con 0x7f2c900a1340 2023-09-30T22:30:41.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.099+0000 7f2c95b3e700 1 -- 172.21.15.59:0/116149365 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c88009a70 con 0x7f2c900a1340 2023-09-30T22:30:41.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.099+0000 7f2c95b3e700 1 -- 172.21.15.59:0/116149365 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c901269a0 con 0x7f2c900a1340 2023-09-30T22:30:41.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.100+0000 7f2c8cff9700 1 -- 172.21.15.59:0/116149365 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c78007470 con 0x7f2c900a1340 2023-09-30T22:30:41.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.100+0000 7f2c8cff9700 1 -- 172.21.15.59:0/116149365 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2c7803f360 con 0x7f2c900a1340 2023-09-30T22:30:41.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.101+0000 7f2c95b3e700 1 -- 172.21.15.59:0/116149365 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c90125bd0 con 0x7f2c900a1340 2023-09-30T22:30:41.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.110+0000 7f2c8cff9700 1 -- 172.21.15.59:0/116149365 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c780123b0 con 0x7f2c900a1340 2023-09-30T22:30:41.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.158+0000 7fc13caa1700 1 Processor -- start 2023-09-30T22:30:41.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.159+0000 7fc13caa1700 1 -- start start 2023-09-30T22:30:41.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.159+0000 7fc13caa1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc13809d6f0 0x7fc13809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.159+0000 7fc13caa1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc13809e000 0x7fc1381339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.159+0000 7fc13caa1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc13809e410 0x7fc138133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.159+0000 7fc13caa1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13806b460 con 0x7fc13809d6f0 2023-09-30T22:30:41.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.159+0000 7fc13caa1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13809b120 con 0x7fc13809e410 2023-09-30T22:30:41.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.159+0000 7fc13caa1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc13809a7e0 con 0x7fc13809e000 2023-09-30T22:30:41.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.159+0000 7fc135d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc13809e000 0x7fc1381339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.159+0000 7fc13659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc13809d6f0 0x7fc13809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.159+0000 7fc135d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc13809e000 0x7fc1381339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33080/0 (socket says 172.21.15.59:33080) 2023-09-30T22:30:41.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.159+0000 7fc135d9b700 1 -- 172.21.15.59:0/227115513 learned_addr learned my addr 172.21.15.59:0/227115513 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:41.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.160+0000 7fc136d9d700 1 --2- 172.21.15.59:0/227115513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc13809e410 0x7fc138133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.160+0000 7fc135d9b700 1 -- 172.21.15.59:0/227115513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc13809e410 msgr2=0x7fc138133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:41.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.160+0000 7fc135d9b700 1 --2- 172.21.15.59:0/227115513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc13809e410 0x7fc138133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.160+0000 7fc135d9b700 1 -- 172.21.15.59:0/227115513 >> v2:172.21.15.59:3300/0 conn(0x7fc13809d6f0 msgr2=0x7fc13809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:41.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.160+0000 7fc135d9b700 1 --2- 172.21.15.59:0/227115513 >> v2:172.21.15.59:3300/0 conn(0x7fc13809d6f0 0x7fc13809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.160+0000 7fc135d9b700 1 -- 172.21.15.59:0/227115513 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13809a500 con 0x7fc13809e000 2023-09-30T22:30:41.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.160+0000 7fc136d9d700 1 --2- 172.21.15.59:0/227115513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc13809e410 0x7fc138133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:41.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.160+0000 7fc13659c700 1 --2- 172.21.15.59:0/227115513 >> v2:172.21.15.59:3300/0 conn(0x7fc13809d6f0 0x7fc13809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:41.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.160+0000 7fc135d9b700 1 --2- 172.21.15.59:0/227115513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc13809e000 0x7fc1381339f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009920 tx=0x7fc12c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d2cf7ff91e81ffe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.160+0000 7fc13559a700 1 -- 172.21.15.59:0/227115513 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c011830 con 0x7fc13809e000 2023-09-30T22:30:41.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.160+0000 7fc13559a700 1 -- 172.21.15.59:0/227115513 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12c011990 con 0x7fc13809e000 2023-09-30T22:30:41.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.160+0000 7fc13559a700 1 -- 172.21.15.59:0/227115513 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c011d20 con 0x7fc13809e000 2023-09-30T22:30:41.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.161+0000 7fc13caa1700 1 -- 172.21.15.59:0/227115513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc13809e000 msgr2=0x7fc1381339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.161+0000 7fc13caa1700 1 --2- 172.21.15.59:0/227115513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc13809e000 0x7fc1381339f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009920 tx=0x7fc12c009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:41.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.161+0000 7fc13caa1700 1 -- 172.21.15.59:0/227115513 shutdown_connections 2023-09-30T22:30:41.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.161+0000 7fc13caa1700 1 --2- 172.21.15.59:0/227115513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc13809e410 0x7fc138133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.161+0000 7fc13caa1700 1 --2- 172.21.15.59:0/227115513 >> v2:172.21.15.59:3300/0 conn(0x7fc13809d6f0 0x7fc13809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.161+0000 7fc13caa1700 1 --2- 172.21.15.59:0/227115513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc13809e000 0x7fc1381339f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.161+0000 7fc13caa1700 1 -- 172.21.15.59:0/227115513 >> 172.21.15.59:0/227115513 conn(0x7fc138066f50 msgr2=0x7fc13809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.161+0000 7fc13caa1700 1 -- 172.21.15.59:0/227115513 shutdown_connections 2023-09-30T22:30:41.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.161+0000 7fc13caa1700 1 -- 172.21.15.59:0/227115513 wait complete. 2023-09-30T22:30:41.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.162+0000 7fc13caa1700 1 Processor -- start 2023-09-30T22:30:41.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.162+0000 7fc13caa1700 1 -- start start 2023-09-30T22:30:41.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc13caa1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc13809d6f0 0x7fc1381a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc13caa1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc13809e000 0x7fc1381a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc13caa1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc13809e410 0x7fc1381a6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc13caa1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1381aa260 con 0x7fc13809e410 2023-09-30T22:30:41.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc13caa1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1381a7990 con 0x7fc13809e000 2023-09-30T22:30:41.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc13caa1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1381a7fb0 con 0x7fc13809d6f0 2023-09-30T22:30:41.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc13659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc13809d6f0 0x7fc1381a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc13659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc13809d6f0 0x7fc1381a5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33090/0 (socket says 172.21.15.59:33090) 2023-09-30T22:30:41.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc13659c700 1 -- 172.21.15.59:0/1091960050 learned_addr learned my addr 172.21.15.59:0/1091960050 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:41.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc135d9b700 1 --2- 172.21.15.59:0/1091960050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc13809e000 0x7fc1381a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc136d9d700 1 --2- 172.21.15.59:0/1091960050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc13809e410 0x7fc1381a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc13659c700 1 -- 172.21.15.59:0/1091960050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc13809e000 msgr2=0x7fc1381a62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc13659c700 1 --2- 172.21.15.59:0/1091960050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc13809e000 0x7fc1381a62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc13659c700 1 -- 172.21.15.59:0/1091960050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc13809e410 msgr2=0x7fc1381a6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc13659c700 1 --2- 172.21.15.59:0/1091960050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc13809e410 0x7fc1381a6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc13659c700 1 -- 172.21.15.59:0/1091960050 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1280094a0 con 0x7fc13809d6f0 2023-09-30T22:30:41.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.163+0000 7fc136d9d700 1 --2- 172.21.15.59:0/1091960050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc13809e410 0x7fc1381a6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:41.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.164+0000 7fc13659c700 1 --2- 172.21.15.59:0/1091960050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc13809d6f0 0x7fc1381a5d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc12800ec10 tx=0x7fc12800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.164+0000 7fc126ffd700 1 -- 172.21.15.59:0/1091960050 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12800c910 con 0x7fc13809d6f0 2023-09-30T22:30:41.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.164+0000 7fc126ffd700 1 -- 172.21.15.59:0/1091960050 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12800ca70 con 0x7fc13809d6f0 2023-09-30T22:30:41.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.164+0000 7fc13caa1700 1 -- 172.21.15.59:0/1091960050 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc130009a70 con 0x7fc13809d6f0 2023-09-30T22:30:41.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.164+0000 7fc126ffd700 1 -- 172.21.15.59:0/1091960050 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12800cde0 con 0x7fc13809d6f0 2023-09-30T22:30:41.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.164+0000 7fc13caa1700 1 -- 172.21.15.59:0/1091960050 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12c009550 con 0x7fc13809d6f0 2023-09-30T22:30:41.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.165+0000 7fc13caa1700 1 -- 172.21.15.59:0/1091960050 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13809c710 con 0x7fc13809d6f0 2023-09-30T22:30:41.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.166+0000 7fc126ffd700 1 -- 172.21.15.59:0/1091960050 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc128013470 con 0x7fc13809d6f0 2023-09-30T22:30:41.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.166+0000 7fc126ffd700 1 -- 172.21.15.59:0/1091960050 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc128040040 con 0x7fc13809d6f0 2023-09-30T22:30:41.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.174+0000 7fc126ffd700 1 -- 172.21.15.59:0/1091960050 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc128024760 con 0x7fc13809d6f0 2023-09-30T22:30:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.284+0000 7fa648fd0700 1 -- 172.21.15.59:0/943814389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa6441a3d80 con 0x7fa64409f650 2023-09-30T22:30:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.285+0000 7fa63b7fe700 1 -- 172.21.15.59:0/943814389 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6441a3d80 con 0x7fa64409f650 2023-09-30T22:30:41.285 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.287+0000 7fa648fd0700 1 -- 172.21.15.59:0/943814389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa64409f650 msgr2=0x7fa6441a04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.287+0000 7fa648fd0700 1 --2- 172.21.15.59:0/943814389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa64409f650 0x7fa6441a04f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa63c016000 tx=0x7fa63c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.287+0000 7fa648fd0700 1 -- 172.21.15.59:0/943814389 shutdown_connections 2023-09-30T22:30:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.287+0000 7fa648fd0700 1 --2- 172.21.15.59:0/943814389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa64409e930 0x7fa6441b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.287+0000 7fa648fd0700 1 --2- 172.21.15.59:0/943814389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa64409f650 0x7fa6441a04f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.287+0000 7fa648fd0700 1 --2- 172.21.15.59:0/943814389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa64409f240 0x7fa6441b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.287+0000 7fa648fd0700 1 -- 172.21.15.59:0/943814389 >> 172.21.15.59:0/943814389 conn(0x7fa6440a4210 msgr2=0x7fa6441b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.287+0000 7fa648fd0700 1 -- 172.21.15.59:0/943814389 shutdown_connections 2023-09-30T22:30:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.287+0000 7fa648fd0700 1 -- 172.21.15.59:0/943814389 wait complete. 2023-09-30T22:30:41.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:41.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.317+0000 7f2c95b3e700 1 -- 172.21.15.59:0/116149365 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2c90074ea0 con 0x7f2c900a1340 2023-09-30T22:30:41.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.317+0000 7f2c8cff9700 1 -- 172.21.15.59:0/116149365 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c78011360 con 0x7f2c900a1340 2023-09-30T22:30:41.318 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:41.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.320+0000 7f2c95b3e700 1 -- 172.21.15.59:0/116149365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c900a1340 msgr2=0x7f2c90122cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.320+0000 7f2c95b3e700 1 --2- 172.21.15.59:0/116149365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c900a1340 0x7f2c90122cc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800c520 tx=0x7f2c7800c830 comp rx=0 tx=0).stop 2023-09-30T22:30:41.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.320+0000 7f2c95b3e700 1 -- 172.21.15.59:0/116149365 shutdown_connections 2023-09-30T22:30:41.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.320+0000 7f2c95b3e700 1 --2- 172.21.15.59:0/116149365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c90134170 0x7f2c90123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.320+0000 7f2c95b3e700 1 --2- 172.21.15.59:0/116149365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c900a0a30 0x7f2c90122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.320+0000 7f2c95b3e700 1 --2- 172.21.15.59:0/116149365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c900a1340 0x7f2c90122cc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.320+0000 7f2c95b3e700 1 -- 172.21.15.59:0/116149365 >> 172.21.15.59:0/116149365 conn(0x7f2c900a6550 msgr2=0x7f2c9009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.320+0000 7f2c95b3e700 1 -- 172.21.15.59:0/116149365 shutdown_connections 2023-09-30T22:30:41.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.320+0000 7f2c95b3e700 1 -- 172.21.15.59:0/116149365 wait complete. 2023-09-30T22:30:41.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:41.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.383+0000 7fc13caa1700 1 -- 172.21.15.59:0/1091960050 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc138074ea0 con 0x7fc13809d6f0 2023-09-30T22:30:41.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.383+0000 7fc126ffd700 1 -- 172.21.15.59:0/1091960050 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc128017030 con 0x7fc13809d6f0 2023-09-30T22:30:41.387 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.385+0000 7fc13caa1700 1 -- 172.21.15.59:0/1091960050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc13809d6f0 msgr2=0x7fc1381a5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.385+0000 7fc13caa1700 1 --2- 172.21.15.59:0/1091960050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc13809d6f0 0x7fc1381a5d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc12800ec10 tx=0x7fc12800ef20 comp rx=0 tx=0).stop 2023-09-30T22:30:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.385+0000 7fc13caa1700 1 -- 172.21.15.59:0/1091960050 shutdown_connections 2023-09-30T22:30:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.385+0000 7fc13caa1700 1 --2- 172.21.15.59:0/1091960050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc13809d6f0 0x7fc1381a5d80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.385+0000 7fc13caa1700 1 --2- 172.21.15.59:0/1091960050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc13809e410 0x7fc1381a6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.385+0000 7fc13caa1700 1 --2- 172.21.15.59:0/1091960050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc13809e000 0x7fc1381a62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.385+0000 7fc13caa1700 1 -- 172.21.15.59:0/1091960050 >> 172.21.15.59:0/1091960050 conn(0x7fc138066f50 msgr2=0x7fc1380a25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.385+0000 7fc13caa1700 1 -- 172.21.15.59:0/1091960050 shutdown_connections 2023-09-30T22:30:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.385+0000 7fc13caa1700 1 -- 172.21.15.59:0/1091960050 wait complete. 2023-09-30T22:30:41.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:41.454 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:41.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.596+0000 7f2329822700 1 Processor -- start 2023-09-30T22:30:41.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.596+0000 7f2329822700 1 -- start start 2023-09-30T22:30:41.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.597+0000 7f2329822700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f232409d6f0 0x7f232409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.597+0000 7f2329822700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f232409e410 0x7f2324134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.597+0000 7f2329822700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232409b120 con 0x7f232409e000 2023-09-30T22:30:41.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.597+0000 7f2329822700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232406b460 con 0x7f232409e410 2023-09-30T22:30:41.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.597+0000 7f2329822700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f232409a7e0 con 0x7f232409d6f0 2023-09-30T22:30:41.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.597+0000 7f23237fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f232409e410 0x7f2324134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.597+0000 7f2322ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f232409d6f0 0x7f232409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.597+0000 7f2322ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f232409d6f0 0x7f232409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33092/0 (socket says 172.21.15.59:33092) 2023-09-30T22:30:41.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.597+0000 7f23237fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f232409e410 0x7f2324134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57788/0 (socket says 172.21.15.59:57788) 2023-09-30T22:30:41.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.597+0000 7f2322ffd700 1 -- 172.21.15.59:0/196761561 learned_addr learned my addr 172.21.15.59:0/196761561 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:41.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.597+0000 7f23237fe700 1 -- 172.21.15.59:0/196761561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f232409d6f0 msgr2=0x7f232409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:41.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.597+0000 7f23237fe700 1 --2- 172.21.15.59:0/196761561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f232409d6f0 0x7f232409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.597+0000 7f23237fe700 1 -- 172.21.15.59:0/196761561 >> v1:172.21.15.59:6789/0 conn(0x7f232409e000 legacy=0x7f23241339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.597+0000 7f23237fe700 1 -- 172.21.15.59:0/196761561 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232409a500 con 0x7f232409e410 2023-09-30T22:30:41.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.597+0000 7f2322ffd700 1 --2- 172.21.15.59:0/196761561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f232409d6f0 0x7f232409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:41.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.598+0000 7f23237fe700 1 --2- 172.21.15.59:0/196761561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f232409e410 0x7f2324134100 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f231c009d90 tx=0x7f231c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23938d4aca5f8f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.598+0000 7f2321ffb700 1 -- 172.21.15.59:0/196761561 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00e070 con 0x7f232409e410 2023-09-30T22:30:41.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.598+0000 7f2321ffb700 1 -- 172.21.15.59:0/196761561 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c00bb20 con 0x7f232409e410 2023-09-30T22:30:41.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.598+0000 7f2321ffb700 1 -- 172.21.15.59:0/196761561 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c012430 con 0x7f232409e410 2023-09-30T22:30:41.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.598+0000 7f2329822700 1 -- 172.21.15.59:0/196761561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f232409e410 msgr2=0x7f2324134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.598+0000 7f2329822700 1 --2- 172.21.15.59:0/196761561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f232409e410 0x7f2324134100 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f231c009d90 tx=0x7f231c00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:41.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.598+0000 7f2329822700 1 -- 172.21.15.59:0/196761561 shutdown_connections 2023-09-30T22:30:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.598+0000 7f2329822700 1 --2- 172.21.15.59:0/196761561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f232409e410 0x7f2324134100 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.598+0000 7f2329822700 1 --2- 172.21.15.59:0/196761561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f232409d6f0 0x7f232409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.598+0000 7f2329822700 1 -- 172.21.15.59:0/196761561 >> 172.21.15.59:0/196761561 conn(0x7f2324066f50 msgr2=0x7f232409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.598+0000 7f2329822700 1 -- 172.21.15.59:0/196761561 shutdown_connections 2023-09-30T22:30:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.598+0000 7f2329822700 1 -- 172.21.15.59:0/196761561 wait complete. 2023-09-30T22:30:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.599+0000 7f2329822700 1 Processor -- start 2023-09-30T22:30:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.600+0000 7f2329822700 1 -- start start 2023-09-30T22:30:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.600+0000 7f2329822700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f232409d6f0 0x7f23241a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.600+0000 7f2329822700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f232409e000 0x7f23241a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.600+0000 7f2329822700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f232409e410 0x7f23241a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.600+0000 7f2329822700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23241a9870 con 0x7f232409e000 2023-09-30T22:30:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.600+0000 7f2329822700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23241a7b90 con 0x7f232409e410 2023-09-30T22:30:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.600+0000 7f2329822700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23241a9a70 con 0x7f232409d6f0 2023-09-30T22:30:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.600+0000 7f2322ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f232409d6f0 0x7f23241a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.600+0000 7f2322ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f232409d6f0 0x7f23241a60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33102/0 (socket says 172.21.15.59:33102) 2023-09-30T22:30:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.600+0000 7f2322ffd700 1 -- 172.21.15.59:0/2614221060 learned_addr learned my addr 172.21.15.59:0/2614221060 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.600+0000 7f23227fc700 1 --2- 172.21.15.59:0/2614221060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f232409e000 0x7f23241a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.600+0000 7f23237fe700 1 --2- 172.21.15.59:0/2614221060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f232409e410 0x7f23241a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.601+0000 7f2322ffd700 1 -- 172.21.15.59:0/2614221060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f232409e410 msgr2=0x7f23241a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.601+0000 7f2322ffd700 1 --2- 172.21.15.59:0/2614221060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f232409e410 0x7f23241a6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.601+0000 7f2322ffd700 1 -- 172.21.15.59:0/2614221060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f232409e000 msgr2=0x7f23241a65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.601+0000 7f2322ffd700 1 --2- 172.21.15.59:0/2614221060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f232409e000 0x7f23241a65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.601+0000 7f2322ffd700 1 -- 172.21.15.59:0/2614221060 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2314009550 con 0x7f232409d6f0 2023-09-30T22:30:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.601+0000 7f2322ffd700 1 --2- 172.21.15.59:0/2614221060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f232409d6f0 0x7f23241a60a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f231400ec10 tx=0x7f231400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.601+0000 7f231bfff700 1 -- 172.21.15.59:0/2614221060 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231400c850 con 0x7f232409d6f0 2023-09-30T22:30:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.601+0000 7f231bfff700 1 -- 172.21.15.59:0/2614221060 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231400c9b0 con 0x7f232409d6f0 2023-09-30T22:30:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.601+0000 7f231bfff700 1 -- 172.21.15.59:0/2614221060 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231400cd40 con 0x7f232409d6f0 2023-09-30T22:30:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.601+0000 7f2329822700 1 -- 172.21.15.59:0/2614221060 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231c009a70 con 0x7f232409d6f0 2023-09-30T22:30:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.601+0000 7f2329822700 1 -- 172.21.15.59:0/2614221060 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23240a2f90 con 0x7f232409d6f0 2023-09-30T22:30:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.602+0000 7f231bfff700 1 -- 172.21.15.59:0/2614221060 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2314013470 con 0x7f232409d6f0 2023-09-30T22:30:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.602+0000 7f231bfff700 1 -- 172.21.15.59:0/2614221060 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f231403f8b0 con 0x7f232409d6f0 2023-09-30T22:30:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.602+0000 7f2329822700 1 -- 172.21.15.59:0/2614221060 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2324074ea0 con 0x7f232409d6f0 2023-09-30T22:30:41.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.607+0000 7f231bfff700 1 -- 172.21.15.59:0/2614221060 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2314013720 con 0x7f232409d6f0 2023-09-30T22:30:41.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.814+0000 7f2329822700 1 -- 172.21.15.59:0/2614221060 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f23241aa3a0 con 0x7f232409d6f0 2023-09-30T22:30:41.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.814+0000 7f231bfff700 1 -- 172.21.15.59:0/2614221060 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f231401bb60 con 0x7f232409d6f0 2023-09-30T22:30:41.815 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:41.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.817+0000 7f2329822700 1 -- 172.21.15.59:0/2614221060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f232409d6f0 msgr2=0x7f23241a60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.817+0000 7f2329822700 1 --2- 172.21.15.59:0/2614221060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f232409d6f0 0x7f23241a60a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f231400ec10 tx=0x7f231400ef20 comp rx=0 tx=0).stop 2023-09-30T22:30:41.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.817+0000 7f2329822700 1 -- 172.21.15.59:0/2614221060 shutdown_connections 2023-09-30T22:30:41.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.817+0000 7f2329822700 1 --2- 172.21.15.59:0/2614221060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f232409d6f0 0x7f23241a60a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.817+0000 7f2329822700 1 --2- 172.21.15.59:0/2614221060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f232409e410 0x7f23241a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.817+0000 7f2329822700 1 --2- 172.21.15.59:0/2614221060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f232409e000 0x7f23241a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.817+0000 7f2329822700 1 -- 172.21.15.59:0/2614221060 >> 172.21.15.59:0/2614221060 conn(0x7f2324066f50 msgr2=0x7f23241baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.817+0000 7f2329822700 1 -- 172.21.15.59:0/2614221060 shutdown_connections 2023-09-30T22:30:41.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:41.817+0000 7f2329822700 1 -- 172.21.15.59:0/2614221060 wait complete. 2023-09-30T22:30:41.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:42.301 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:42.335 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:42.400 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.455+0000 7faa864c5700 1 Processor -- start 2023-09-30T22:30:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.455+0000 7faa864c5700 1 -- start start 2023-09-30T22:30:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa864c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa8009d6f0 0x7faa8009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa864c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8009e000 0x7faa801339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa864c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8009e410 0x7faa80133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa864c5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8006b460 con 0x7faa8009d6f0 2023-09-30T22:30:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa864c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8009b120 con 0x7faa8009e000 2023-09-30T22:30:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa864c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa8009a7e0 con 0x7faa8009e410 2023-09-30T22:30:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa7ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa8009d6f0 0x7faa8009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa7f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8009e000 0x7faa801339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa7ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa8009d6f0 0x7faa8009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57810/0 (socket says 172.21.15.59:57810) 2023-09-30T22:30:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa7ffff700 1 -- 172.21.15.59:0/978421484 learned_addr learned my addr 172.21.15.59:0/978421484 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa84a62700 1 --2- 172.21.15.59:0/978421484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8009e410 0x7faa80133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa84a62700 1 -- 172.21.15.59:0/978421484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8009e000 msgr2=0x7faa801339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa84a62700 1 --2- 172.21.15.59:0/978421484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8009e000 0x7faa801339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa84a62700 1 -- 172.21.15.59:0/978421484 >> v2:172.21.15.59:3300/0 conn(0x7faa8009d6f0 msgr2=0x7faa8009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa84a62700 1 --2- 172.21.15.59:0/978421484 >> v2:172.21.15.59:3300/0 conn(0x7faa8009d6f0 0x7faa8009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa84a62700 1 -- 172.21.15.59:0/978421484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8009a500 con 0x7faa8009e410 2023-09-30T22:30:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.456+0000 7faa7ffff700 1 --2- 172.21.15.59:0/978421484 >> v2:172.21.15.59:3300/0 conn(0x7faa8009d6f0 0x7faa8009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.457+0000 7faa84a62700 1 --2- 172.21.15.59:0/978421484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8009e410 0x7faa80133f30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faa78009dc0 tx=0x7faa7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ea1e232718d043c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.457+0000 7faa7effd700 1 -- 172.21.15.59:0/978421484 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7800e070 con 0x7faa8009e410 2023-09-30T22:30:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.457+0000 7faa7effd700 1 -- 172.21.15.59:0/978421484 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7800bae0 con 0x7faa8009e410 2023-09-30T22:30:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.457+0000 7faa7effd700 1 -- 172.21.15.59:0/978421484 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7800be90 con 0x7faa8009e410 2023-09-30T22:30:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.458+0000 7faa864c5700 1 -- 172.21.15.59:0/978421484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8009e410 msgr2=0x7faa80133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.458+0000 7faa864c5700 1 --2- 172.21.15.59:0/978421484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8009e410 0x7faa80133f30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faa78009dc0 tx=0x7faa7800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.458+0000 7faa864c5700 1 -- 172.21.15.59:0/978421484 shutdown_connections 2023-09-30T22:30:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.458+0000 7faa864c5700 1 --2- 172.21.15.59:0/978421484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8009e410 0x7faa80133f30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.458+0000 7faa864c5700 1 --2- 172.21.15.59:0/978421484 >> v2:172.21.15.59:3300/0 conn(0x7faa8009d6f0 0x7faa8009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.458+0000 7faa864c5700 1 --2- 172.21.15.59:0/978421484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8009e000 0x7faa801339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.458+0000 7faa864c5700 1 -- 172.21.15.59:0/978421484 >> 172.21.15.59:0/978421484 conn(0x7faa80066f50 msgr2=0x7faa8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.458+0000 7faa864c5700 1 -- 172.21.15.59:0/978421484 shutdown_connections 2023-09-30T22:30:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.458+0000 7faa864c5700 1 -- 172.21.15.59:0/978421484 wait complete. 2023-09-30T22:30:42.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.459+0000 7faa864c5700 1 Processor -- start 2023-09-30T22:30:42.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.459+0000 7faa864c5700 1 -- start start 2023-09-30T22:30:42.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.459+0000 7faa864c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8009d6f0 0x7faa801a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.459+0000 7faa864c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa8009e000 0x7faa801a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.460+0000 7faa864c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8009e410 0x7faa801c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.460+0000 7faa864c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa801a8170 con 0x7faa8009e000 2023-09-30T22:30:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.460+0000 7faa864c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa801a8350 con 0x7faa8009e410 2023-09-30T22:30:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.460+0000 7faa864c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa801b91c0 con 0x7faa8009d6f0 2023-09-30T22:30:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.460+0000 7faa84a62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8009e410 0x7faa801c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.460+0000 7faa84a62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8009e410 0x7faa801c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33718/0 (socket says 172.21.15.59:33718) 2023-09-30T22:30:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.460+0000 7faa84a62700 1 -- 172.21.15.59:0/559397570 learned_addr learned my addr 172.21.15.59:0/559397570 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.460+0000 7faa7ffff700 1 --2- 172.21.15.59:0/559397570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8009d6f0 0x7faa801a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.460+0000 7faa7f7fe700 1 --2- 172.21.15.59:0/559397570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa8009e000 0x7faa801a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.460+0000 7faa7ffff700 1 -- 172.21.15.59:0/559397570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8009e410 msgr2=0x7faa801c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.460+0000 7faa7ffff700 1 --2- 172.21.15.59:0/559397570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8009e410 0x7faa801c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.460+0000 7faa7ffff700 1 -- 172.21.15.59:0/559397570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa8009e000 msgr2=0x7faa801a5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.460+0000 7faa7ffff700 1 --2- 172.21.15.59:0/559397570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa8009e000 0x7faa801a5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.460+0000 7faa7ffff700 1 -- 172.21.15.59:0/559397570 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa70009550 con 0x7faa8009d6f0 2023-09-30T22:30:42.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.460+0000 7faa7ffff700 1 --2- 172.21.15.59:0/559397570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8009d6f0 0x7faa801a5200 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faa7000e9d0 tx=0x7faa7000ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:42.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.461+0000 7faa7cff9700 1 -- 172.21.15.59:0/559397570 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000ee70 con 0x7faa8009d6f0 2023-09-30T22:30:42.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.461+0000 7faa7cff9700 1 -- 172.21.15.59:0/559397570 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa70004030 con 0x7faa8009d6f0 2023-09-30T22:30:42.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.461+0000 7faa864c5700 1 -- 172.21.15.59:0/559397570 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa78009a70 con 0x7faa8009d6f0 2023-09-30T22:30:42.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.461+0000 7faa7cff9700 1 -- 172.21.15.59:0/559397570 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa700043c0 con 0x7faa8009d6f0 2023-09-30T22:30:42.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.461+0000 7faa864c5700 1 -- 172.21.15.59:0/559397570 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8009c710 con 0x7faa8009d6f0 2023-09-30T22:30:42.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.462+0000 7faa7cff9700 1 -- 172.21.15.59:0/559397570 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa7000c850 con 0x7faa8009d6f0 2023-09-30T22:30:42.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.462+0000 7faa7cff9700 1 -- 172.21.15.59:0/559397570 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faa7003f550 con 0x7faa8009d6f0 2023-09-30T22:30:42.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.462+0000 7faa864c5700 1 -- 172.21.15.59:0/559397570 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa80074ea0 con 0x7faa8009d6f0 2023-09-30T22:30:42.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.467+0000 7faa7cff9700 1 -- 172.21.15.59:0/559397570 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa70019d40 con 0x7faa8009d6f0 2023-09-30T22:30:42.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.490+0000 7f48147f0700 1 Processor -- start 2023-09-30T22:30:42.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.490+0000 7f48147f0700 1 -- start start 2023-09-30T22:30:42.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.491+0000 7f48147f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f480c130540 0x7f480c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.491+0000 7f48147f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f480c130e50 0x7f480c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.491+0000 7f48147f0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480c0716a0 con 0x7f480c06fb20 2023-09-30T22:30:42.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.491+0000 7f48147f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480c09a390 con 0x7f480c130540 2023-09-30T22:30:42.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.491+0000 7f48147f0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f480c071290 con 0x7f480c130e50 2023-09-30T22:30:42.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.491+0000 7f481258c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f480c130540 0x7f480c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.491+0000 7f4812d8d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f480c06fb20 0x7f480c137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58196/0 (socket says 172.21.15.59:58196) 2023-09-30T22:30:42.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.491+0000 7f4811d8b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f480c130e50 0x7f480c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.491+0000 7f481258c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f480c130540 0x7f480c130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33720/0 (socket says 172.21.15.59:33720) 2023-09-30T22:30:42.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.491+0000 7f4812d8d700 1 -- 172.21.15.59:0/784390477 learned_addr learned my addr 172.21.15.59:0/784390477 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:42.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.491+0000 7f481258c700 1 -- 172.21.15.59:0/784390477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f480c130e50 msgr2=0x7f480c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:42.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.491+0000 7f481258c700 1 --2- 172.21.15.59:0/784390477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f480c130e50 0x7f480c06f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.491+0000 7f481258c700 1 -- 172.21.15.59:0/784390477 >> v1:172.21.15.59:6789/0 conn(0x7f480c06fb20 legacy=0x7f480c137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.491+0000 7f481258c700 1 -- 172.21.15.59:0/784390477 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c130340 con 0x7f480c130540 2023-09-30T22:30:42.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.491+0000 7f481158a700 1 -- 172.21.15.59:0/784390477 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040095562 0 0) 0x7f480c0716a0 con 0x7f480c06fb20 2023-09-30T22:30:42.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.492+0000 7f481258c700 1 --2- 172.21.15.59:0/784390477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f480c130540 0x7f480c130910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f48080098a0 tx=0x7f4808009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b3cf9107317d7e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:42.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.492+0000 7f481158a700 1 -- 172.21.15.59:0/784390477 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808011830 con 0x7f480c130540 2023-09-30T22:30:42.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.492+0000 7f481158a700 1 -- 172.21.15.59:0/784390477 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4808011990 con 0x7f480c130540 2023-09-30T22:30:42.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.492+0000 7f481158a700 1 -- 172.21.15.59:0/784390477 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808011d20 con 0x7f480c130540 2023-09-30T22:30:42.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.493+0000 7f48147f0700 1 -- 172.21.15.59:0/784390477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f480c130540 msgr2=0x7f480c130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.493+0000 7f48147f0700 1 --2- 172.21.15.59:0/784390477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f480c130540 0x7f480c130910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f48080098a0 tx=0x7f4808009bb0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.493+0000 7f48147f0700 1 -- 172.21.15.59:0/784390477 shutdown_connections 2023-09-30T22:30:42.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.493+0000 7f48147f0700 1 --2- 172.21.15.59:0/784390477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f480c130540 0x7f480c130910 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.493+0000 7f48147f0700 1 --2- 172.21.15.59:0/784390477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f480c130e50 0x7f480c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.493+0000 7f48147f0700 1 -- 172.21.15.59:0/784390477 >> 172.21.15.59:0/784390477 conn(0x7f480c0a2aa0 msgr2=0x7f480c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:42.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.493+0000 7f48147f0700 1 -- 172.21.15.59:0/784390477 shutdown_connections 2023-09-30T22:30:42.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.493+0000 7f48147f0700 1 -- 172.21.15.59:0/784390477 wait complete. 2023-09-30T22:30:42.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.494+0000 7f48147f0700 1 Processor -- start 2023-09-30T22:30:42.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.494+0000 7f48147f0700 1 -- start start 2023-09-30T22:30:42.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.494+0000 7f48147f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f480c06fb20 0x7f480c11eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.494+0000 7f48147f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f480c130540 0x7f480c11f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.494+0000 7f48147f0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f480c130e50 0x7f480c11f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.494+0000 7f48147f0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c1221d0 con 0x7f480c130e50 2023-09-30T22:30:42.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.494+0000 7f48147f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480c0718e0 con 0x7f480c06fb20 2023-09-30T22:30:42.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.494+0000 7f48147f0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f480c121030 con 0x7f480c130540 2023-09-30T22:30:42.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.494+0000 7f481258c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f480c06fb20 0x7f480c11eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.494+0000 7f481258c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f480c06fb20 0x7f480c11eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33726/0 (socket says 172.21.15.59:33726) 2023-09-30T22:30:42.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.494+0000 7f481258c700 1 -- 172.21.15.59:0/1197715146 learned_addr learned my addr 172.21.15.59:0/1197715146 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:42.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.495+0000 7f4811d8b700 1 --2- 172.21.15.59:0/1197715146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f480c130540 0x7f480c11f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.495+0000 7f4812d8d700 1 --2- 172.21.15.59:0/1197715146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f480c130e50 0x7f480c11f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.495+0000 7f4812d8d700 1 -- 172.21.15.59:0/1197715146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f480c130540 msgr2=0x7f480c11f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.495+0000 7f4812d8d700 1 --2- 172.21.15.59:0/1197715146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f480c130540 0x7f480c11f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.495+0000 7f4812d8d700 1 -- 172.21.15.59:0/1197715146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f480c06fb20 msgr2=0x7f480c11eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.495+0000 7f4812d8d700 1 --2- 172.21.15.59:0/1197715146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f480c06fb20 0x7f480c11eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.495+0000 7f4812d8d700 1 -- 172.21.15.59:0/1197715146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48080094a0 con 0x7f480c130e50 2023-09-30T22:30:42.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.495+0000 7f4811d8b700 1 --2- 172.21.15.59:0/1197715146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f480c130540 0x7f480c11f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:42.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.495+0000 7f4812d8d700 1 --2- 172.21.15.59:0/1197715146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f480c130e50 0x7f480c11f720 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f480400cc10 tx=0x7f480400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:42.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.495+0000 7f4802ffd700 1 -- 172.21.15.59:0/1197715146 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480400aa00 con 0x7f480c130e50 2023-09-30T22:30:42.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.495+0000 7f4802ffd700 1 -- 172.21.15.59:0/1197715146 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480400ab80 con 0x7f480c130e50 2023-09-30T22:30:42.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.495+0000 7f48147f0700 1 -- 172.21.15.59:0/1197715146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480c1226e0 con 0x7f480c130e50 2023-09-30T22:30:42.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.495+0000 7f4802ffd700 1 -- 172.21.15.59:0/1197715146 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48040070d0 con 0x7f480c130e50 2023-09-30T22:30:42.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.495+0000 7f48147f0700 1 -- 172.21.15.59:0/1197715146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480c122400 con 0x7f480c130e50 2023-09-30T22:30:42.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.496+0000 7f48147f0700 1 -- 172.21.15.59:0/1197715146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480c074ea0 con 0x7f480c130e50 2023-09-30T22:30:42.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.496+0000 7f4802ffd700 1 -- 172.21.15.59:0/1197715146 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4804007230 con 0x7f480c130e50 2023-09-30T22:30:42.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.497+0000 7f4802ffd700 1 -- 172.21.15.59:0/1197715146 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f480403f020 con 0x7f480c130e50 2023-09-30T22:30:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.506+0000 7f4802ffd700 1 -- 172.21.15.59:0/1197715146 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48040074e0 con 0x7f480c130e50 2023-09-30T22:30:42.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.543+0000 7fa1cdf24700 1 Processor -- start 2023-09-30T22:30:42.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.543+0000 7fa1cdf24700 1 -- start start 2023-09-30T22:30:42.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.544+0000 7fa1cdf24700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1c80a0a30 0x7fa1c80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.544+0000 7fa1cdf24700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1c8138d80 0x7fa1c813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.544+0000 7fa1cdf24700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c80a2a70 con 0x7fa1c809d630 2023-09-30T22:30:42.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.544+0000 7fa1cdf24700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c80a01d0 con 0x7fa1c80a0a30 2023-09-30T22:30:42.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.544+0000 7fa1cdf24700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c809e2b0 con 0x7fa1c8138d80 2023-09-30T22:30:42.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.544+0000 7fa1c77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1c80a0a30 0x7fa1c80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.544+0000 7fa1c6ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa1c809d630 0x7fa1c80a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58210/0 (socket says 172.21.15.59:58210) 2023-09-30T22:30:42.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.544+0000 7fa1c6ffd700 1 -- 172.21.15.59:0/406873348 learned_addr learned my addr 172.21.15.59:0/406873348 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:42.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.544+0000 7fa1c77fe700 1 --2- 172.21.15.59:0/406873348 >> v2:172.21.15.59:3300/0 conn(0x7fa1c80a0a30 0x7fa1c80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57838/0 (socket says 172.21.15.59:57838) 2023-09-30T22:30:42.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.544+0000 7fa1c7fff700 1 --2- 172.21.15.59:0/406873348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1c8138d80 0x7fa1c813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.544+0000 7fa1c77fe700 1 -- 172.21.15.59:0/406873348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1c8138d80 msgr2=0x7fa1c813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:42.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.544+0000 7fa1c77fe700 1 --2- 172.21.15.59:0/406873348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1c8138d80 0x7fa1c813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.544+0000 7fa1c77fe700 1 -- 172.21.15.59:0/406873348 >> v1:172.21.15.59:6789/0 conn(0x7fa1c809d630 legacy=0x7fa1c80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.544+0000 7fa1c77fe700 1 -- 172.21.15.59:0/406873348 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c809dc50 con 0x7fa1c80a0a30 2023-09-30T22:30:42.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.544+0000 7fa1c7fff700 1 --2- 172.21.15.59:0/406873348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1c8138d80 0x7fa1c813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:42.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.545+0000 7fa1c77fe700 1 --2- 172.21.15.59:0/406873348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c80a0a30 0x7fa1c80a0e00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009d90 tx=0x7fa1b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7dbaadbedfbf98 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:42.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.545+0000 7fa1c67fc700 1 -- 172.21.15.59:0/406873348 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b800e070 con 0x7fa1c80a0a30 2023-09-30T22:30:42.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.545+0000 7fa1c67fc700 1 -- 172.21.15.59:0/406873348 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b800bb20 con 0x7fa1c80a0a30 2023-09-30T22:30:42.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.545+0000 7fa1c67fc700 1 -- 172.21.15.59:0/406873348 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8012430 con 0x7fa1c80a0a30 2023-09-30T22:30:42.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.546+0000 7fa1cdf24700 1 -- 172.21.15.59:0/406873348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c80a0a30 msgr2=0x7fa1c80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.546+0000 7fa1cdf24700 1 --2- 172.21.15.59:0/406873348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c80a0a30 0x7fa1c80a0e00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009d90 tx=0x7fa1b800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.546+0000 7fa1cdf24700 1 -- 172.21.15.59:0/406873348 shutdown_connections 2023-09-30T22:30:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.546+0000 7fa1cdf24700 1 --2- 172.21.15.59:0/406873348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1c8138d80 0x7fa1c813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.546+0000 7fa1cdf24700 1 --2- 172.21.15.59:0/406873348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c80a0a30 0x7fa1c80a0e00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.546+0000 7fa1cdf24700 1 -- 172.21.15.59:0/406873348 >> 172.21.15.59:0/406873348 conn(0x7fa1c80a3050 msgr2=0x7fa1c80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.546+0000 7fa1cdf24700 1 -- 172.21.15.59:0/406873348 shutdown_connections 2023-09-30T22:30:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.546+0000 7fa1cdf24700 1 -- 172.21.15.59:0/406873348 wait complete. 2023-09-30T22:30:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.547+0000 7fa1cdf24700 1 Processor -- start 2023-09-30T22:30:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.547+0000 7fa1cdf24700 1 -- start start 2023-09-30T22:30:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1cdf24700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1c809d630 0x7fa1c8120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1cdf24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1c80a0a30 0x7fa1c8120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1cdf24700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c8138d80 0x7fa1c8121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1cdf24700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c8123110 con 0x7fa1c8138d80 2023-09-30T22:30:42.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1cdf24700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c8122be0 con 0x7fa1c80a0a30 2023-09-30T22:30:42.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1cdf24700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c8122310 con 0x7fa1c809d630 2023-09-30T22:30:42.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1c77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1c809d630 0x7fa1c8120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1c6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1c80a0a30 0x7fa1c8120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1c77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1c809d630 0x7fa1c8120700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33152/0 (socket says 172.21.15.59:33152) 2023-09-30T22:30:42.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1c77fe700 1 -- 172.21.15.59:0/827302389 learned_addr learned my addr 172.21.15.59:0/827302389 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:42.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1c7fff700 1 --2- 172.21.15.59:0/827302389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c8138d80 0x7fa1c8121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1c6ffd700 1 -- 172.21.15.59:0/827302389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1c809d630 msgr2=0x7fa1c8120700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1c6ffd700 1 --2- 172.21.15.59:0/827302389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1c809d630 0x7fa1c8120700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1c6ffd700 1 -- 172.21.15.59:0/827302389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c8138d80 msgr2=0x7fa1c8121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1c6ffd700 1 --2- 172.21.15.59:0/827302389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c8138d80 0x7fa1c8121180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1c6ffd700 1 -- 172.21.15.59:0/827302389 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c00094a0 con 0x7fa1c80a0a30 2023-09-30T22:30:42.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1c77fe700 1 --2- 172.21.15.59:0/827302389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1c809d630 0x7fa1c8120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:42.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.548+0000 7fa1c6ffd700 1 --2- 172.21.15.59:0/827302389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1c80a0a30 0x7fa1c8120c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00c530 tx=0x7fa1bc00c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.549+0000 7fa1affff700 1 -- 172.21.15.59:0/827302389 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc00cea0 con 0x7fa1c80a0a30 2023-09-30T22:30:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.549+0000 7fa1affff700 1 -- 172.21.15.59:0/827302389 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1bc005d70 con 0x7fa1c80a0a30 2023-09-30T22:30:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.549+0000 7fa1cdf24700 1 -- 172.21.15.59:0/827302389 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b8009a70 con 0x7fa1c80a0a30 2023-09-30T22:30:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.549+0000 7fa1affff700 1 -- 172.21.15.59:0/827302389 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc0072d0 con 0x7fa1c80a0a30 2023-09-30T22:30:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.549+0000 7fa1cdf24700 1 -- 172.21.15.59:0/827302389 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c80a4ec0 con 0x7fa1c80a0a30 2023-09-30T22:30:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.550+0000 7fa1affff700 1 -- 172.21.15.59:0/827302389 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1bc007430 con 0x7fa1c80a0a30 2023-09-30T22:30:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.550+0000 7fa1affff700 1 -- 172.21.15.59:0/827302389 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa1bc03e980 con 0x7fa1c80a0a30 2023-09-30T22:30:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.550+0000 7fa1cdf24700 1 -- 172.21.15.59:0/827302389 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c8123be0 con 0x7fa1c80a0a30 2023-09-30T22:30:42.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.559+0000 7fa1affff700 1 -- 172.21.15.59:0/827302389 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1c8123be0 con 0x7fa1c80a0a30 2023-09-30T22:30:42.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.686+0000 7faa864c5700 1 -- 172.21.15.59:0/559397570 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faa801a6c30 con 0x7faa8009d6f0 2023-09-30T22:30:42.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.686+0000 7faa7cff9700 1 -- 172.21.15.59:0/559397570 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa700093b0 con 0x7faa8009d6f0 2023-09-30T22:30:42.687 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:42.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.689+0000 7faa864c5700 1 -- 172.21.15.59:0/559397570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8009d6f0 msgr2=0x7faa801a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.689+0000 7faa864c5700 1 --2- 172.21.15.59:0/559397570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8009d6f0 0x7faa801a5200 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faa7000e9d0 tx=0x7faa7000ece0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.689+0000 7faa864c5700 1 -- 172.21.15.59:0/559397570 shutdown_connections 2023-09-30T22:30:42.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.689+0000 7faa864c5700 1 --2- 172.21.15.59:0/559397570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8009d6f0 0x7faa801a5200 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.689+0000 7faa864c5700 1 --2- 172.21.15.59:0/559397570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8009e410 0x7faa801c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.689+0000 7faa864c5700 1 --2- 172.21.15.59:0/559397570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa8009e000 0x7faa801a5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.689+0000 7faa864c5700 1 -- 172.21.15.59:0/559397570 >> 172.21.15.59:0/559397570 conn(0x7faa80066f50 msgr2=0x7faa801bba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:42.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.689+0000 7faa864c5700 1 -- 172.21.15.59:0/559397570 shutdown_connections 2023-09-30T22:30:42.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.689+0000 7faa864c5700 1 -- 172.21.15.59:0/559397570 wait complete. 2023-09-30T22:30:42.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:42.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.721+0000 7f48147f0700 1 -- 172.21.15.59:0/1197715146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f480c06b9e0 con 0x7f480c130e50 2023-09-30T22:30:42.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.722+0000 7f4802ffd700 1 -- 172.21.15.59:0/1197715146 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4804018020 con 0x7f480c130e50 2023-09-30T22:30:42.722 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:42.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.724+0000 7f48147f0700 1 -- 172.21.15.59:0/1197715146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f480c130e50 msgr2=0x7f480c11f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.724+0000 7f48147f0700 1 --2- 172.21.15.59:0/1197715146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f480c130e50 0x7f480c11f720 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f480400cc10 tx=0x7f480400cf20 comp rx=0 tx=0).stop 2023-09-30T22:30:42.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.724+0000 7f48147f0700 1 -- 172.21.15.59:0/1197715146 shutdown_connections 2023-09-30T22:30:42.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.724+0000 7f48147f0700 1 --2- 172.21.15.59:0/1197715146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f480c130e50 0x7f480c11f720 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.724+0000 7f48147f0700 1 --2- 172.21.15.59:0/1197715146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f480c06fb20 0x7f480c11eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.724+0000 7f48147f0700 1 --2- 172.21.15.59:0/1197715146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f480c130540 0x7f480c11f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.724+0000 7f48147f0700 1 -- 172.21.15.59:0/1197715146 >> 172.21.15.59:0/1197715146 conn(0x7f480c0a2aa0 msgr2=0x7f480c12d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:42.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.724+0000 7f48147f0700 1 -- 172.21.15.59:0/1197715146 shutdown_connections 2023-09-30T22:30:42.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.724+0000 7f48147f0700 1 -- 172.21.15.59:0/1197715146 wait complete. 2023-09-30T22:30:42.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:42.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.763+0000 7fa1cdf24700 1 -- 172.21.15.59:0/827302389 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa1c8123be0 con 0x7fa1c80a0a30 2023-09-30T22:30:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.764+0000 7fa1affff700 1 -- 172.21.15.59:0/827302389 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1c8123be0 con 0x7fa1c80a0a30 2023-09-30T22:30:42.764 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:42.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.766+0000 7fa1cdf24700 1 -- 172.21.15.59:0/827302389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1c80a0a30 msgr2=0x7fa1c8120c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.766+0000 7fa1cdf24700 1 --2- 172.21.15.59:0/827302389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1c80a0a30 0x7fa1c8120c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00c530 tx=0x7fa1bc00c840 comp rx=0 tx=0).stop 2023-09-30T22:30:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.766+0000 7fa1cdf24700 1 -- 172.21.15.59:0/827302389 shutdown_connections 2023-09-30T22:30:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.766+0000 7fa1cdf24700 1 --2- 172.21.15.59:0/827302389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1c809d630 0x7fa1c8120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.766+0000 7fa1cdf24700 1 --2- 172.21.15.59:0/827302389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c8138d80 0x7fa1c8121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.766+0000 7fa1cdf24700 1 --2- 172.21.15.59:0/827302389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1c80a0a30 0x7fa1c8120c40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.766+0000 7fa1cdf24700 1 -- 172.21.15.59:0/827302389 >> 172.21.15.59:0/827302389 conn(0x7fa1c80a3050 msgr2=0x7fa1c809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.766+0000 7fa1cdf24700 1 -- 172.21.15.59:0/827302389 shutdown_connections 2023-09-30T22:30:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.766+0000 7fa1cdf24700 1 -- 172.21.15.59:0/827302389 wait complete. 2023-09-30T22:30:42.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:42.832 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.972+0000 7fe429d14700 1 Processor -- start 2023-09-30T22:30:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.972+0000 7fe429d14700 1 -- start start 2023-09-30T22:30:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe429d14700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe42409d6f0 0x7fe42409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe429d14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42409e000 0x7fe4241339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe429d14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42409e410 0x7fe424133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe429d14700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42406b460 con 0x7fe42409d6f0 2023-09-30T22:30:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe429d14700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42409b120 con 0x7fe42409e410 2023-09-30T22:30:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe429d14700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe42409a7e0 con 0x7fe42409e000 2023-09-30T22:30:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe4237fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe42409d6f0 0x7fe42409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe422ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42409e000 0x7fe4241339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe423fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42409e410 0x7fe424133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe422ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42409e000 0x7fe4241339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33156/0 (socket says 172.21.15.59:33156) 2023-09-30T22:30:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe4237fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe42409d6f0 0x7fe42409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57860/0 (socket says 172.21.15.59:57860) 2023-09-30T22:30:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe423fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42409e410 0x7fe424133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33744/0 (socket says 172.21.15.59:33744) 2023-09-30T22:30:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe422ffd700 1 -- 172.21.15.59:0/2381982498 learned_addr learned my addr 172.21.15.59:0/2381982498 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe422ffd700 1 -- 172.21.15.59:0/2381982498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42409e410 msgr2=0x7fe424133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe422ffd700 1 --2- 172.21.15.59:0/2381982498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42409e410 0x7fe424133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe422ffd700 1 -- 172.21.15.59:0/2381982498 >> v2:172.21.15.59:3300/0 conn(0x7fe42409d6f0 msgr2=0x7fe42409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe422ffd700 1 --2- 172.21.15.59:0/2381982498 >> v2:172.21.15.59:3300/0 conn(0x7fe42409d6f0 0x7fe42409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.973+0000 7fe422ffd700 1 -- 172.21.15.59:0/2381982498 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42409a500 con 0x7fe42409e000 2023-09-30T22:30:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.974+0000 7fe423fff700 1 --2- 172.21.15.59:0/2381982498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42409e410 0x7fe424133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.974+0000 7fe4237fe700 1 --2- 172.21.15.59:0/2381982498 >> v2:172.21.15.59:3300/0 conn(0x7fe42409d6f0 0x7fe42409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.974+0000 7fe422ffd700 1 --2- 172.21.15.59:0/2381982498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42409e000 0x7fe4241339f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe418009920 tx=0x7fe418009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf84acf760e00b65 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.974+0000 7fe4227fc700 1 -- 172.21.15.59:0/2381982498 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418011830 con 0x7fe42409e000 2023-09-30T22:30:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.974+0000 7fe4227fc700 1 -- 172.21.15.59:0/2381982498 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe418011990 con 0x7fe42409e000 2023-09-30T22:30:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.974+0000 7fe4227fc700 1 -- 172.21.15.59:0/2381982498 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418011d20 con 0x7fe42409e000 2023-09-30T22:30:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.974+0000 7fe429d14700 1 -- 172.21.15.59:0/2381982498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42409e000 msgr2=0x7fe4241339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.974+0000 7fe429d14700 1 --2- 172.21.15.59:0/2381982498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42409e000 0x7fe4241339f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe418009920 tx=0x7fe418009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.975+0000 7fe429d14700 1 -- 172.21.15.59:0/2381982498 shutdown_connections 2023-09-30T22:30:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.975+0000 7fe429d14700 1 --2- 172.21.15.59:0/2381982498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42409e410 0x7fe424133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.975+0000 7fe429d14700 1 --2- 172.21.15.59:0/2381982498 >> v2:172.21.15.59:3300/0 conn(0x7fe42409d6f0 0x7fe42409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.975+0000 7fe429d14700 1 --2- 172.21.15.59:0/2381982498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42409e000 0x7fe4241339f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.975+0000 7fe429d14700 1 -- 172.21.15.59:0/2381982498 >> 172.21.15.59:0/2381982498 conn(0x7fe424066f50 msgr2=0x7fe42409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.975+0000 7fe429d14700 1 -- 172.21.15.59:0/2381982498 shutdown_connections 2023-09-30T22:30:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.975+0000 7fe429d14700 1 -- 172.21.15.59:0/2381982498 wait complete. 2023-09-30T22:30:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.976+0000 7fe429d14700 1 Processor -- start 2023-09-30T22:30:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.976+0000 7fe429d14700 1 -- start start 2023-09-30T22:30:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.976+0000 7fe429d14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42409d6f0 0x7fe4241c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.976+0000 7fe429d14700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe42409e000 0x7fe4241c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.976+0000 7fe429d14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42409e410 0x7fe4241c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.976+0000 7fe429d14700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4241a9580 con 0x7fe42409e000 2023-09-30T22:30:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.976+0000 7fe429d14700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4241c5aa0 con 0x7fe42409d6f0 2023-09-30T22:30:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.976+0000 7fe429d14700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe42409c710 con 0x7fe42409e410 2023-09-30T22:30:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.976+0000 7fe422ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe42409e000 0x7fe4241c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.976+0000 7fe4237fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42409d6f0 0x7fe4241c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.976+0000 7fe4237fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42409d6f0 0x7fe4241c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33746/0 (socket says 172.21.15.59:33746) 2023-09-30T22:30:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.976+0000 7fe422ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe42409e000 0x7fe4241c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57874/0 (socket says 172.21.15.59:57874) 2023-09-30T22:30:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.976+0000 7fe4237fe700 1 -- 172.21.15.59:0/1282915595 learned_addr learned my addr 172.21.15.59:0/1282915595 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.976+0000 7fe423fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42409e410 0x7fe4241c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.977+0000 7fe4237fe700 1 -- 172.21.15.59:0/1282915595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42409e410 msgr2=0x7fe4241c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.977+0000 7fe4237fe700 1 --2- 172.21.15.59:0/1282915595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42409e410 0x7fe4241c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.977+0000 7fe4237fe700 1 -- 172.21.15.59:0/1282915595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe42409e000 msgr2=0x7fe4241c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.977+0000 7fe4237fe700 1 --2- 172.21.15.59:0/1282915595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe42409e000 0x7fe4241c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.977+0000 7fe4237fe700 1 -- 172.21.15.59:0/1282915595 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4140094a0 con 0x7fe42409d6f0 2023-09-30T22:30:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.977+0000 7fe422ffd700 1 --2- 172.21.15.59:0/1282915595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe42409e000 0x7fe4241c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.977+0000 7fe4237fe700 1 --2- 172.21.15.59:0/1282915595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42409d6f0 0x7fe4241c5020 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe41400ebe0 tx=0x7fe41400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.977+0000 7fe40bfff700 1 -- 172.21.15.59:0/1282915595 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414009800 con 0x7fe42409d6f0 2023-09-30T22:30:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.977+0000 7fe40bfff700 1 -- 172.21.15.59:0/1282915595 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41400c850 con 0x7fe42409d6f0 2023-09-30T22:30:42.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.977+0000 7fe429d14700 1 -- 172.21.15.59:0/1282915595 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c009a70 con 0x7fe42409d6f0 2023-09-30T22:30:42.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.977+0000 7fe40bfff700 1 -- 172.21.15.59:0/1282915595 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41400cbc0 con 0x7fe42409d6f0 2023-09-30T22:30:42.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.977+0000 7fe429d14700 1 -- 172.21.15.59:0/1282915595 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe418009550 con 0x7fe42409d6f0 2023-09-30T22:30:42.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.978+0000 7fe40bfff700 1 -- 172.21.15.59:0/1282915595 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe41400cd20 con 0x7fe42409d6f0 2023-09-30T22:30:42.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.978+0000 7fe40bfff700 1 -- 172.21.15.59:0/1282915595 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe41403f810 con 0x7fe42409d6f0 2023-09-30T22:30:42.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.978+0000 7fe429d14700 1 -- 172.21.15.59:0/1282915595 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4240a1ff0 con 0x7fe42409d6f0 2023-09-30T22:30:42.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:42.983+0000 7fe40bfff700 1 -- 172.21.15.59:0/1282915595 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4140232f0 con 0x7fe42409d6f0 2023-09-30T22:30:43.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.186+0000 7fe429d14700 1 -- 172.21.15.59:0/1282915595 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe4241a96c0 con 0x7fe42409d6f0 2023-09-30T22:30:43.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.186+0000 7fe40bfff700 1 -- 172.21.15.59:0/1282915595 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe414017020 con 0x7fe42409d6f0 2023-09-30T22:30:43.186 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:43.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.188+0000 7fe429d14700 1 -- 172.21.15.59:0/1282915595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42409d6f0 msgr2=0x7fe4241c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.188+0000 7fe429d14700 1 --2- 172.21.15.59:0/1282915595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42409d6f0 0x7fe4241c5020 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe41400ebe0 tx=0x7fe41400eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.188+0000 7fe429d14700 1 -- 172.21.15.59:0/1282915595 shutdown_connections 2023-09-30T22:30:43.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.188+0000 7fe429d14700 1 --2- 172.21.15.59:0/1282915595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42409e410 0x7fe4241c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.188+0000 7fe429d14700 1 --2- 172.21.15.59:0/1282915595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42409d6f0 0x7fe4241c5020 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.188+0000 7fe429d14700 1 --2- 172.21.15.59:0/1282915595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe42409e000 0x7fe4241c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.188+0000 7fe429d14700 1 -- 172.21.15.59:0/1282915595 >> 172.21.15.59:0/1282915595 conn(0x7fe424066f50 msgr2=0x7fe4241bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:43.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.188+0000 7fe429d14700 1 -- 172.21.15.59:0/1282915595 shutdown_connections 2023-09-30T22:30:43.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.188+0000 7fe429d14700 1 -- 172.21.15.59:0/1282915595 wait complete. 2023-09-30T22:30:43.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:43.704 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:43.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:43.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.853+0000 7f918b157700 1 Processor -- start 2023-09-30T22:30:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.853+0000 7f918b157700 1 -- start start 2023-09-30T22:30:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.853+0000 7f918b157700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a0a30 0x7f91840a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.853+0000 7f918b157700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9184138d80 0x7f918413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.853+0000 7f918b157700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91840a2a70 con 0x7f918409d630 2023-09-30T22:30:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.853+0000 7f918b157700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91840a01d0 con 0x7f9184138d80 2023-09-30T22:30:43.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.853+0000 7f918b157700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918409e2b0 con 0x7f91840a0a30 2023-09-30T22:30:43.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.854+0000 7f9188ef3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a0a30 0x7f91840a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.854+0000 7f91896f4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9184138d80 0x7f918413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.854+0000 7f9183fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f918409d630 0x7f91840a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58216/0 (socket says 172.21.15.59:58216) 2023-09-30T22:30:43.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.854+0000 7f9183fff700 1 -- 172.21.15.59:0/2253001941 learned_addr learned my addr 172.21.15.59:0/2253001941 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:43.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.854+0000 7f9188ef3700 1 --2- 172.21.15.59:0/2253001941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a0a30 0x7f91840a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33762/0 (socket says 172.21.15.59:33762) 2023-09-30T22:30:43.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.854+0000 7f9188ef3700 1 -- 172.21.15.59:0/2253001941 >> v2:172.21.15.59:3300/0 conn(0x7f9184138d80 msgr2=0x7f918413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:43.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.854+0000 7f9188ef3700 1 --2- 172.21.15.59:0/2253001941 >> v2:172.21.15.59:3300/0 conn(0x7f9184138d80 0x7f918413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.854+0000 7f9188ef3700 1 -- 172.21.15.59:0/2253001941 >> v1:172.21.15.59:6789/0 conn(0x7f918409d630 legacy=0x7f91840a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.854+0000 7f9188ef3700 1 -- 172.21.15.59:0/2253001941 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918409dc50 con 0x7f91840a0a30 2023-09-30T22:30:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.854+0000 7f9188ef3700 1 --2- 172.21.15.59:0/2253001941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a0a30 0x7f91840a0e00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9178009840 tx=0x7f9178009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5848b766bae3b11 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.854+0000 7f91837fe700 1 -- 172.21.15.59:0/2253001941 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178011830 con 0x7f91840a0a30 2023-09-30T22:30:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.855+0000 7f91837fe700 1 -- 172.21.15.59:0/2253001941 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9178011990 con 0x7f91840a0a30 2023-09-30T22:30:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.855+0000 7f91837fe700 1 -- 172.21.15.59:0/2253001941 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178011d20 con 0x7f91840a0a30 2023-09-30T22:30:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.855+0000 7f918b157700 1 -- 172.21.15.59:0/2253001941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a0a30 msgr2=0x7f91840a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.855+0000 7f918b157700 1 --2- 172.21.15.59:0/2253001941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a0a30 0x7f91840a0e00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9178009840 tx=0x7f9178009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.855+0000 7f918b157700 1 -- 172.21.15.59:0/2253001941 shutdown_connections 2023-09-30T22:30:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.855+0000 7f918b157700 1 --2- 172.21.15.59:0/2253001941 >> v2:172.21.15.59:3300/0 conn(0x7f9184138d80 0x7f918413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.855+0000 7f918b157700 1 --2- 172.21.15.59:0/2253001941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a0a30 0x7f91840a0e00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.855+0000 7f918b157700 1 -- 172.21.15.59:0/2253001941 >> 172.21.15.59:0/2253001941 conn(0x7f91840a3050 msgr2=0x7f91840a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.855+0000 7f918b157700 1 -- 172.21.15.59:0/2253001941 shutdown_connections 2023-09-30T22:30:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.855+0000 7f918b157700 1 -- 172.21.15.59:0/2253001941 wait complete. 2023-09-30T22:30:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.857+0000 7f918b157700 1 Processor -- start 2023-09-30T22:30:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.857+0000 7f918b157700 1 -- start start 2023-09-30T22:30:43.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f918b157700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918409d630 0x7f918411d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f918b157700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91840a0a30 0x7f918411d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f918b157700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9184138d80 0x7f918411def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f918b157700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9184120a90 con 0x7f918409d630 2023-09-30T22:30:43.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f918b157700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91840a0410 con 0x7f9184138d80 2023-09-30T22:30:43.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f918b157700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f918411f5e0 con 0x7f91840a0a30 2023-09-30T22:30:43.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f91896f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9184138d80 0x7f918411def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f91896f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9184138d80 0x7f918411def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33778/0 (socket says 172.21.15.59:33778) 2023-09-30T22:30:43.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f91896f4700 1 -- 172.21.15.59:0/4202337159 learned_addr learned my addr 172.21.15.59:0/4202337159 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:43.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f9188ef3700 1 --2- 172.21.15.59:0/4202337159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918409d630 0x7f918411d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f91896f4700 1 -- 172.21.15.59:0/4202337159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91840a0a30 msgr2=0x7f918411d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f91896f4700 1 --2- 172.21.15.59:0/4202337159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91840a0a30 0x7f918411d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f91896f4700 1 -- 172.21.15.59:0/4202337159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918409d630 msgr2=0x7f918411d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f91896f4700 1 --2- 172.21.15.59:0/4202337159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918409d630 0x7f918411d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f91896f4700 1 -- 172.21.15.59:0/4202337159 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91780094a0 con 0x7f9184138d80 2023-09-30T22:30:43.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.858+0000 7f9188ef3700 1 --2- 172.21.15.59:0/4202337159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918409d630 0x7f918411d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:43.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.859+0000 7f91896f4700 1 --2- 172.21.15.59:0/4202337159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9184138d80 0x7f918411def0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f917c00ef90 tx=0x7f917c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:43.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.859+0000 7f91817fa700 1 -- 172.21.15.59:0/4202337159 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c00cd40 con 0x7f9184138d80 2023-09-30T22:30:43.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.859+0000 7f91817fa700 1 -- 172.21.15.59:0/4202337159 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917c00f040 con 0x7f9184138d80 2023-09-30T22:30:43.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.859+0000 7f918b157700 1 -- 172.21.15.59:0/4202337159 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f918413b010 con 0x7f9184138d80 2023-09-30T22:30:43.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.859+0000 7f91817fa700 1 -- 172.21.15.59:0/4202337159 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c00cea0 con 0x7f9184138d80 2023-09-30T22:30:43.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.859+0000 7f918b157700 1 -- 172.21.15.59:0/4202337159 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9184120c70 con 0x7f9184138d80 2023-09-30T22:30:43.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.860+0000 7f91817fa700 1 -- 172.21.15.59:0/4202337159 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f917c0146c0 con 0x7f9184138d80 2023-09-30T22:30:43.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.860+0000 7f91817fa700 1 -- 172.21.15.59:0/4202337159 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f917c0402f0 con 0x7f9184138d80 2023-09-30T22:30:43.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.860+0000 7f918b157700 1 -- 172.21.15.59:0/4202337159 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91841208c0 con 0x7f9184138d80 2023-09-30T22:30:43.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.870+0000 7f91817fa700 1 -- 172.21.15.59:0/4202337159 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f917c018080 con 0x7f9184138d80 2023-09-30T22:30:43.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.891+0000 7face2130700 1 Processor -- start 2023-09-30T22:30:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.891+0000 7face2130700 1 -- start start 2023-09-30T22:30:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.891+0000 7face2130700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facdc0a0a30 0x7facdc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.891+0000 7face2130700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facdc0a1340 0x7facdc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7face2130700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7facdc133fa0 0x7facdc134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7face2130700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facdc09edd0 con 0x7facdc133fa0 2023-09-30T22:30:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7face2130700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc09e1f0 con 0x7facdc0a0a30 2023-09-30T22:30:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7face2130700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facdc09dc50 con 0x7facdc0a1340 2023-09-30T22:30:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7facdb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facdc0a0a30 0x7facdc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7facdb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facdc0a0a30 0x7facdc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33786/0 (socket says 172.21.15.59:33786) 2023-09-30T22:30:43.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7facdb7fe700 1 -- 172.21.15.59:0/657928860 learned_addr learned my addr 172.21.15.59:0/657928860 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:43.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7facdbfff700 1 --2- 172.21.15.59:0/657928860 >> v2:172.21.15.59:3300/0 conn(0x7facdc133fa0 0x7facdc134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7facdaffd700 1 --2- 172.21.15.59:0/657928860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facdc0a1340 0x7facdc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7facdbfff700 1 -- 172.21.15.59:0/657928860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facdc0a1340 msgr2=0x7facdc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:43.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7facdbfff700 1 --2- 172.21.15.59:0/657928860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facdc0a1340 0x7facdc133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7facdbfff700 1 -- 172.21.15.59:0/657928860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facdc0a0a30 msgr2=0x7facdc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:43.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7facdbfff700 1 --2- 172.21.15.59:0/657928860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facdc0a0a30 0x7facdc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7facdbfff700 1 -- 172.21.15.59:0/657928860 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc0a1fe0 con 0x7facdc133fa0 2023-09-30T22:30:43.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7facdb7fe700 1 --2- 172.21.15.59:0/657928860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facdc0a0a30 0x7facdc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:43.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.892+0000 7facdbfff700 1 --2- 172.21.15.59:0/657928860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facdc133fa0 0x7facdc134410 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7facd4009840 tx=0x7facd4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7f96a15af7f92f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:43.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.893+0000 7facda7fc700 1 -- 172.21.15.59:0/657928860 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4011830 con 0x7facdc133fa0 2023-09-30T22:30:43.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.893+0000 7facda7fc700 1 -- 172.21.15.59:0/657928860 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd4011990 con 0x7facdc133fa0 2023-09-30T22:30:43.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.893+0000 7facda7fc700 1 -- 172.21.15.59:0/657928860 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4011d20 con 0x7facdc133fa0 2023-09-30T22:30:43.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.893+0000 7face2130700 1 -- 172.21.15.59:0/657928860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facdc133fa0 msgr2=0x7facdc134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.893+0000 7face2130700 1 --2- 172.21.15.59:0/657928860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facdc133fa0 0x7facdc134410 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7facd4009840 tx=0x7facd4009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:43.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.893+0000 7face2130700 1 -- 172.21.15.59:0/657928860 shutdown_connections 2023-09-30T22:30:43.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.893+0000 7face2130700 1 --2- 172.21.15.59:0/657928860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facdc133fa0 0x7facdc134410 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.893+0000 7face2130700 1 --2- 172.21.15.59:0/657928860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facdc0a0a30 0x7facdc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.893+0000 7face2130700 1 --2- 172.21.15.59:0/657928860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facdc0a1340 0x7facdc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.893+0000 7face2130700 1 -- 172.21.15.59:0/657928860 >> 172.21.15.59:0/657928860 conn(0x7facdc0a6550 msgr2=0x7facdc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:43.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.893+0000 7face2130700 1 -- 172.21.15.59:0/657928860 shutdown_connections 2023-09-30T22:30:43.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.893+0000 7face2130700 1 -- 172.21.15.59:0/657928860 wait complete. 2023-09-30T22:30:43.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.894+0000 7face2130700 1 Processor -- start 2023-09-30T22:30:43.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.895+0000 7face2130700 1 -- start start 2023-09-30T22:30:43.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.895+0000 7face2130700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facdc0a0a30 0x7facdc1204f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.895+0000 7face2130700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facdc0a1340 0x7facdc120a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.895+0000 7face2130700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facdc133fa0 0x7facdc120f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.895+0000 7face2130700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc0a0220 con 0x7facdc0a0a30 2023-09-30T22:30:43.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.895+0000 7face2130700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc123d30 con 0x7facdc0a1340 2023-09-30T22:30:43.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.895+0000 7face2130700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facdc122210 con 0x7facdc133fa0 2023-09-30T22:30:43.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.895+0000 7facdaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facdc0a1340 0x7facdc120a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.895+0000 7facdaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facdc0a1340 0x7facdc120a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33792/0 (socket says 172.21.15.59:33792) 2023-09-30T22:30:43.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.895+0000 7facdaffd700 1 -- 172.21.15.59:0/947605107 learned_addr learned my addr 172.21.15.59:0/947605107 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:43.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.895+0000 7facdbfff700 1 --2- 172.21.15.59:0/947605107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facdc133fa0 0x7facdc120f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.895+0000 7facdb7fe700 1 --2- 172.21.15.59:0/947605107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facdc0a0a30 0x7facdc1204f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.896+0000 7facdbfff700 1 -- 172.21.15.59:0/947605107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facdc0a1340 msgr2=0x7facdc120a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.896+0000 7facdbfff700 1 --2- 172.21.15.59:0/947605107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facdc0a1340 0x7facdc120a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.896+0000 7facdbfff700 1 -- 172.21.15.59:0/947605107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facdc0a0a30 msgr2=0x7facdc1204f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.896+0000 7facdbfff700 1 --2- 172.21.15.59:0/947605107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facdc0a0a30 0x7facdc1204f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.896+0000 7facdbfff700 1 -- 172.21.15.59:0/947605107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc009b30 con 0x7facdc133fa0 2023-09-30T22:30:43.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.896+0000 7facdaffd700 1 --2- 172.21.15.59:0/947605107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facdc0a1340 0x7facdc120a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:43.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.896+0000 7facdb7fe700 1 --2- 172.21.15.59:0/947605107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facdc0a0a30 0x7facdc1204f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:43.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.896+0000 7facdbfff700 1 --2- 172.21.15.59:0/947605107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facdc133fa0 0x7facdc120f70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7facd4016000 tx=0x7facd4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:43.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.896+0000 7facc3fff700 1 -- 172.21.15.59:0/947605107 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4004450 con 0x7facdc133fa0 2023-09-30T22:30:43.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.896+0000 7facc3fff700 1 -- 172.21.15.59:0/947605107 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd40045b0 con 0x7facdc133fa0 2023-09-30T22:30:43.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.896+0000 7face2130700 1 -- 172.21.15.59:0/947605107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd40094a0 con 0x7facdc133fa0 2023-09-30T22:30:43.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.896+0000 7facc3fff700 1 -- 172.21.15.59:0/947605107 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40038e0 con 0x7facdc133fa0 2023-09-30T22:30:43.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.896+0000 7face2130700 1 -- 172.21.15.59:0/947605107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc0a6ab0 con 0x7facdc133fa0 2023-09-30T22:30:43.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.897+0000 7facc3fff700 1 -- 172.21.15.59:0/947605107 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7facd4003a40 con 0x7facdc133fa0 2023-09-30T22:30:43.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.897+0000 7facc3fff700 1 -- 172.21.15.59:0/947605107 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7facd40407a0 con 0x7facdc133fa0 2023-09-30T22:30:43.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.898+0000 7face2130700 1 -- 172.21.15.59:0/947605107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facdc123980 con 0x7facdc133fa0 2023-09-30T22:30:43.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.903+0000 7facc3fff700 1 -- 172.21.15.59:0/947605107 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7facd4015080 con 0x7facdc133fa0 2023-09-30T22:30:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.954+0000 7f28b3077700 1 Processor -- start 2023-09-30T22:30:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.954+0000 7f28b3077700 1 -- start start 2023-09-30T22:30:43.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.955+0000 7f28b3077700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ac1305f0 0x7f28ac1309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.955+0000 7f28b3077700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28ac070160 0x7f28ac138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.955+0000 7f28b3077700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac1301c0 con 0x7f28ac06f660 2023-09-30T22:30:43.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.955+0000 7f28b3077700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac09a2e0 con 0x7f28ac070160 2023-09-30T22:30:43.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.955+0000 7f28b3077700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac071ff0 con 0x7f28ac1305f0 2023-09-30T22:30:43.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.955+0000 7f28b0e13700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ac1305f0 0x7f28ac1309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.955+0000 7f28b0e13700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ac1305f0 0x7f28ac1309c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33804/0 (socket says 172.21.15.59:33804) 2023-09-30T22:30:43.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.955+0000 7f28b0e13700 1 -- 172.21.15.59:0/3172867046 learned_addr learned my addr 172.21.15.59:0/3172867046 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:43.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.955+0000 7f28b0e13700 1 -- 172.21.15.59:0/3172867046 >> v2:172.21.15.59:3300/0 conn(0x7f28ac070160 msgr2=0x7f28ac138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:43.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.955+0000 7f28b0e13700 1 --2- 172.21.15.59:0/3172867046 >> v2:172.21.15.59:3300/0 conn(0x7f28ac070160 0x7f28ac138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.955+0000 7f28b0e13700 1 -- 172.21.15.59:0/3172867046 >> v1:172.21.15.59:6789/0 conn(0x7f28ac06f660 legacy=0x7f28ac06fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:43.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.955+0000 7f28b0e13700 1 -- 172.21.15.59:0/3172867046 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac070e70 con 0x7f28ac1305f0 2023-09-30T22:30:43.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.955+0000 7f28b0e13700 1 --2- 172.21.15.59:0/3172867046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ac1305f0 0x7f28ac1309c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009920 tx=0x7f28a0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c11a3c763e8932ac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:43.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.956+0000 7f28ab7fe700 1 -- 172.21.15.59:0/3172867046 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0004230 con 0x7f28ac1305f0 2023-09-30T22:30:43.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.956+0000 7f28ab7fe700 1 -- 172.21.15.59:0/3172867046 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a0004390 con 0x7f28ac1305f0 2023-09-30T22:30:43.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.956+0000 7f28ab7fe700 1 -- 172.21.15.59:0/3172867046 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0009e70 con 0x7f28ac1305f0 2023-09-30T22:30:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.957+0000 7f28b3077700 1 -- 172.21.15.59:0/3172867046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ac1305f0 msgr2=0x7f28ac1309c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.957+0000 7f28b3077700 1 --2- 172.21.15.59:0/3172867046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ac1305f0 0x7f28ac1309c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009920 tx=0x7f28a0009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.957+0000 7f28b3077700 1 -- 172.21.15.59:0/3172867046 shutdown_connections 2023-09-30T22:30:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.957+0000 7f28b3077700 1 --2- 172.21.15.59:0/3172867046 >> v2:172.21.15.59:3300/0 conn(0x7f28ac070160 0x7f28ac138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.957+0000 7f28b3077700 1 --2- 172.21.15.59:0/3172867046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ac1305f0 0x7f28ac1309c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.957+0000 7f28b3077700 1 -- 172.21.15.59:0/3172867046 >> 172.21.15.59:0/3172867046 conn(0x7f28ac0a2aa0 msgr2=0x7f28ac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.957+0000 7f28b3077700 1 -- 172.21.15.59:0/3172867046 shutdown_connections 2023-09-30T22:30:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.957+0000 7f28b3077700 1 -- 172.21.15.59:0/3172867046 wait complete. 2023-09-30T22:30:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.958+0000 7f28b3077700 1 Processor -- start 2023-09-30T22:30:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.958+0000 7f28b3077700 1 -- start start 2023-09-30T22:30:43.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.959+0000 7f28b3077700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ac06f660 0x7f28ac11dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.959+0000 7f28b3077700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ac070160 0x7f28ac11e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.959+0000 7f28b3077700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28ac1305f0 0x7f28ac11e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.959+0000 7f28b3077700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac120df0 con 0x7f28ac1305f0 2023-09-30T22:30:43.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.959+0000 7f28b3077700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac121170 con 0x7f28ac070160 2023-09-30T22:30:43.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.959+0000 7f28b3077700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac120000 con 0x7f28ac06f660 2023-09-30T22:30:43.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.959+0000 7f28b0e13700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ac06f660 0x7f28ac11dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.959+0000 7f28b1614700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28ac1305f0 0x7f28ac11e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.959+0000 7f28abfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ac070160 0x7f28ac11e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.959+0000 7f28b0e13700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ac06f660 0x7f28ac11dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33214/0 (socket says 172.21.15.59:33214) 2023-09-30T22:30:43.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.959+0000 7f28b0e13700 1 -- 172.21.15.59:0/2664497816 learned_addr learned my addr 172.21.15.59:0/2664497816 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:43.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.960+0000 7f28b1614700 1 -- 172.21.15.59:0/2664497816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ac06f660 msgr2=0x7f28ac11dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.960+0000 7f28b1614700 1 --2- 172.21.15.59:0/2664497816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ac06f660 0x7f28ac11dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.960+0000 7f28b1614700 1 -- 172.21.15.59:0/2664497816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ac070160 msgr2=0x7f28ac11e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.960+0000 7f28b1614700 1 --2- 172.21.15.59:0/2664497816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ac070160 0x7f28ac11e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.960+0000 7f28b1614700 1 -- 172.21.15.59:0/2664497816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a0009550 con 0x7f28ac1305f0 2023-09-30T22:30:43.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.960+0000 7f28b0e13700 1 --2- 172.21.15.59:0/2664497816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ac06f660 0x7f28ac11dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:43.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.960+0000 7f28abfff700 1 --2- 172.21.15.59:0/2664497816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ac070160 0x7f28ac11e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:43.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.960+0000 7f28b1614700 1 --2- 172.21.15.59:0/2664497816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28ac1305f0 0x7f28ac11e680 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f28a400be20 tx=0x7f28a4009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:43.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.960+0000 7f28a97fa700 1 -- 172.21.15.59:0/2664497816 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a400cb30 con 0x7f28ac1305f0 2023-09-30T22:30:43.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.960+0000 7f28a97fa700 1 -- 172.21.15.59:0/2664497816 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a400ccb0 con 0x7f28ac1305f0 2023-09-30T22:30:43.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.960+0000 7f28b3077700 1 -- 172.21.15.59:0/2664497816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac09d2b0 con 0x7f28ac1305f0 2023-09-30T22:30:43.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.960+0000 7f28a97fa700 1 -- 172.21.15.59:0/2664497816 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4014680 con 0x7f28ac1305f0 2023-09-30T22:30:43.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.960+0000 7f28b3077700 1 -- 172.21.15.59:0/2664497816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac11f770 con 0x7f28ac1305f0 2023-09-30T22:30:43.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.961+0000 7f28a97fa700 1 -- 172.21.15.59:0/2664497816 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28a401d3b0 con 0x7f28ac1305f0 2023-09-30T22:30:43.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.961+0000 7f28a97fa700 1 -- 172.21.15.59:0/2664497816 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f28a4006e40 con 0x7f28ac1305f0 2023-09-30T22:30:43.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.962+0000 7f28b3077700 1 -- 172.21.15.59:0/2664497816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac074ea0 con 0x7f28ac1305f0 2023-09-30T22:30:43.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:43.967+0000 7f28a97fa700 1 -- 172.21.15.59:0/2664497816 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28a4019080 con 0x7f28ac1305f0 2023-09-30T22:30:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.078+0000 7f918b157700 1 -- 172.21.15.59:0/4202337159 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f918411f890 con 0x7f9184138d80 2023-09-30T22:30:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.078+0000 7f91817fa700 1 -- 172.21.15.59:0/4202337159 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f917c007330 con 0x7f9184138d80 2023-09-30T22:30:44.079 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:44.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.080+0000 7f918b157700 1 -- 172.21.15.59:0/4202337159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9184138d80 msgr2=0x7f918411def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.080+0000 7f918b157700 1 --2- 172.21.15.59:0/4202337159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9184138d80 0x7f918411def0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f917c00ef90 tx=0x7f917c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.081+0000 7f918b157700 1 -- 172.21.15.59:0/4202337159 shutdown_connections 2023-09-30T22:30:44.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.081+0000 7f918b157700 1 --2- 172.21.15.59:0/4202337159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9184138d80 0x7f918411def0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.081+0000 7f918b157700 1 --2- 172.21.15.59:0/4202337159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918409d630 0x7f918411d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.081+0000 7f918b157700 1 --2- 172.21.15.59:0/4202337159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91840a0a30 0x7f918411d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.081+0000 7f918b157700 1 -- 172.21.15.59:0/4202337159 >> 172.21.15.59:0/4202337159 conn(0x7f91840a3050 msgr2=0x7f918409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:44.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.081+0000 7f918b157700 1 -- 172.21.15.59:0/4202337159 shutdown_connections 2023-09-30T22:30:44.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.081+0000 7f918b157700 1 -- 172.21.15.59:0/4202337159 wait complete. 2023-09-30T22:30:44.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.149+0000 7face2130700 1 -- 172.21.15.59:0/947605107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7facdc124860 con 0x7facdc133fa0 2023-09-30T22:30:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.149+0000 7facc3fff700 1 -- 172.21.15.59:0/947605107 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7facd402e970 con 0x7facdc133fa0 2023-09-30T22:30:44.150 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.151+0000 7face2130700 1 -- 172.21.15.59:0/947605107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facdc133fa0 msgr2=0x7facdc120f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.151+0000 7face2130700 1 --2- 172.21.15.59:0/947605107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facdc133fa0 0x7facdc120f70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7facd4016000 tx=0x7facd4004750 comp rx=0 tx=0).stop 2023-09-30T22:30:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.152+0000 7face2130700 1 -- 172.21.15.59:0/947605107 shutdown_connections 2023-09-30T22:30:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.152+0000 7face2130700 1 --2- 172.21.15.59:0/947605107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facdc133fa0 0x7facdc120f70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.152+0000 7face2130700 1 --2- 172.21.15.59:0/947605107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facdc0a0a30 0x7facdc1204f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.152+0000 7face2130700 1 --2- 172.21.15.59:0/947605107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facdc0a1340 0x7facdc120a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.152+0000 7face2130700 1 -- 172.21.15.59:0/947605107 >> 172.21.15.59:0/947605107 conn(0x7facdc0a6550 msgr2=0x7facdc0a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.152+0000 7face2130700 1 -- 172.21.15.59:0/947605107 shutdown_connections 2023-09-30T22:30:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.152+0000 7face2130700 1 -- 172.21.15.59:0/947605107 wait complete. 2023-09-30T22:30:44.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.190+0000 7f28b3077700 1 -- 172.21.15.59:0/2664497816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f28ac06b9e0 con 0x7f28ac1305f0 2023-09-30T22:30:44.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.190+0000 7f28a97fa700 1 -- 172.21.15.59:0/2664497816 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28a40072b0 con 0x7f28ac1305f0 2023-09-30T22:30:44.190 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:44.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.192+0000 7f28b3077700 1 -- 172.21.15.59:0/2664497816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28ac1305f0 msgr2=0x7f28ac11e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.192+0000 7f28b3077700 1 --2- 172.21.15.59:0/2664497816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28ac1305f0 0x7f28ac11e680 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f28a400be20 tx=0x7f28a4009ed0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.192+0000 7f28b3077700 1 -- 172.21.15.59:0/2664497816 shutdown_connections 2023-09-30T22:30:44.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.192+0000 7f28b3077700 1 --2- 172.21.15.59:0/2664497816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ac06f660 0x7f28ac11dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.192+0000 7f28b3077700 1 --2- 172.21.15.59:0/2664497816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28ac1305f0 0x7f28ac11e680 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.192+0000 7f28b3077700 1 --2- 172.21.15.59:0/2664497816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ac070160 0x7f28ac11e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.192+0000 7f28b3077700 1 -- 172.21.15.59:0/2664497816 >> 172.21.15.59:0/2664497816 conn(0x7f28ac0a2aa0 msgr2=0x7f28ac06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.192+0000 7f28b3077700 1 -- 172.21.15.59:0/2664497816 shutdown_connections 2023-09-30T22:30:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.192+0000 7f28b3077700 1 -- 172.21.15.59:0/2664497816 wait complete. 2023-09-30T22:30:44.202 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:44.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.339+0000 7f1753235700 1 Processor -- start 2023-09-30T22:30:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.339+0000 7f1753235700 1 -- start start 2023-09-30T22:30:44.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.339+0000 7f1753235700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f174c09d6f0 0x7f174c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.339+0000 7f1753235700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f174c09e440 0x7f174c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.339+0000 7f1753235700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f174c09b120 con 0x7f174c09e000 2023-09-30T22:30:44.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.339+0000 7f1753235700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c06b460 con 0x7f174c09d6f0 2023-09-30T22:30:44.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.339+0000 7f1753235700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f174c09a7e0 con 0x7f174c09e440 2023-09-30T22:30:44.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.339+0000 7f1750fd1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f174c09d6f0 0x7f174c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.339+0000 7f17517d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f174c09e440 0x7f174c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.339+0000 7f17517d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f174c09e440 0x7f174c134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33230/0 (socket says 172.21.15.59:33230) 2023-09-30T22:30:44.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.339+0000 7f1750fd1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f174c09d6f0 0x7f174c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57932/0 (socket says 172.21.15.59:57932) 2023-09-30T22:30:44.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.339+0000 7f17517d2700 1 -- 172.21.15.59:0/2686430322 learned_addr learned my addr 172.21.15.59:0/2686430322 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:44.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.340+0000 7f1750fd1700 1 -- 172.21.15.59:0/2686430322 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f174c09e440 msgr2=0x7f174c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:44.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.340+0000 7f1750fd1700 1 --2- 172.21.15.59:0/2686430322 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f174c09e440 0x7f174c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.340+0000 7f1750fd1700 1 -- 172.21.15.59:0/2686430322 >> v1:172.21.15.59:6789/0 conn(0x7f174c09e000 legacy=0x7f174c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.340+0000 7f1750fd1700 1 -- 172.21.15.59:0/2686430322 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c09a500 con 0x7f174c09d6f0 2023-09-30T22:30:44.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.340+0000 7f17517d2700 1 --2- 172.21.15.59:0/2686430322 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f174c09e440 0x7f174c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.340+0000 7f1750fd1700 1 --2- 172.21.15.59:0/2686430322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c09d6f0 0x7f174c09dac0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f173c009870 tx=0x7f173c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6425b9964117323 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.340+0000 7f174b7fe700 1 -- 172.21.15.59:0/2686430322 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c011830 con 0x7f174c09d6f0 2023-09-30T22:30:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.340+0000 7f174b7fe700 1 -- 172.21.15.59:0/2686430322 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c011990 con 0x7f174c09d6f0 2023-09-30T22:30:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.340+0000 7f174b7fe700 1 -- 172.21.15.59:0/2686430322 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c011d20 con 0x7f174c09d6f0 2023-09-30T22:30:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.341+0000 7f1753235700 1 -- 172.21.15.59:0/2686430322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c09d6f0 msgr2=0x7f174c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.341+0000 7f1753235700 1 --2- 172.21.15.59:0/2686430322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c09d6f0 0x7f174c09dac0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f173c009870 tx=0x7f173c009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.341+0000 7f1753235700 1 -- 172.21.15.59:0/2686430322 shutdown_connections 2023-09-30T22:30:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.341+0000 7f1753235700 1 --2- 172.21.15.59:0/2686430322 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f174c09e440 0x7f174c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.341+0000 7f1753235700 1 --2- 172.21.15.59:0/2686430322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c09d6f0 0x7f174c09dac0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.341+0000 7f1753235700 1 -- 172.21.15.59:0/2686430322 >> 172.21.15.59:0/2686430322 conn(0x7f174c066f50 msgr2=0x7f174c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.341+0000 7f1753235700 1 -- 172.21.15.59:0/2686430322 shutdown_connections 2023-09-30T22:30:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.341+0000 7f1753235700 1 -- 172.21.15.59:0/2686430322 wait complete. 2023-09-30T22:30:44.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.342+0000 7f1753235700 1 Processor -- start 2023-09-30T22:30:44.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.342+0000 7f1753235700 1 -- start start 2023-09-30T22:30:44.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.342+0000 7f1753235700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f174c09d6f0 0x7f174c1a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.342+0000 7f1753235700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f174c09e000 0x7f174c1a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.342+0000 7f1753235700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c09e440 0x7f174c1a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.342+0000 7f1753235700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c1a7a60 con 0x7f174c09e440 2023-09-30T22:30:44.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.342+0000 7f1753235700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c09c710 con 0x7f174c09d6f0 2023-09-30T22:30:44.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.342+0000 7f1753235700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f174c1a9690 con 0x7f174c09e000 2023-09-30T22:30:44.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.342+0000 7f174bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f174c09e000 0x7f174c1a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.343+0000 7f17517d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c09e440 0x7f174c1a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.343+0000 7f17517d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c09e440 0x7f174c1a6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57934/0 (socket says 172.21.15.59:57934) 2023-09-30T22:30:44.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.343+0000 7f174bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f174c09e000 0x7f174c1a63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33242/0 (socket says 172.21.15.59:33242) 2023-09-30T22:30:44.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.343+0000 7f17517d2700 1 -- 172.21.15.59:0/4122377704 learned_addr learned my addr 172.21.15.59:0/4122377704 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:44.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.343+0000 7f1750fd1700 1 --2- 172.21.15.59:0/4122377704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f174c09d6f0 0x7f174c1a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.343+0000 7f17517d2700 1 -- 172.21.15.59:0/4122377704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f174c09e000 msgr2=0x7f174c1a63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.343+0000 7f17517d2700 1 --2- 172.21.15.59:0/4122377704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f174c09e000 0x7f174c1a63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.343+0000 7f17517d2700 1 -- 172.21.15.59:0/4122377704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f174c09d6f0 msgr2=0x7f174c1a5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.343+0000 7f17517d2700 1 --2- 172.21.15.59:0/4122377704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f174c09d6f0 0x7f174c1a5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.343+0000 7f17517d2700 1 -- 172.21.15.59:0/4122377704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1744009b30 con 0x7f174c09e440 2023-09-30T22:30:44.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.343+0000 7f174bfff700 1 --2- 172.21.15.59:0/4122377704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f174c09e000 0x7f174c1a63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:44.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.343+0000 7f17517d2700 1 --2- 172.21.15.59:0/4122377704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c09e440 0x7f174c1a6910 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f174400efc0 tx=0x7f174400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:44.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.343+0000 7f17497fa700 1 -- 172.21.15.59:0/4122377704 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744018070 con 0x7f174c09e440 2023-09-30T22:30:44.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.343+0000 7f17497fa700 1 -- 172.21.15.59:0/4122377704 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174400f040 con 0x7f174c09e440 2023-09-30T22:30:44.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.344+0000 7f1753235700 1 -- 172.21.15.59:0/4122377704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173c0094a0 con 0x7f174c09e440 2023-09-30T22:30:44.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.344+0000 7f17497fa700 1 -- 172.21.15.59:0/4122377704 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744003c20 con 0x7f174c09e440 2023-09-30T22:30:44.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.344+0000 7f1753235700 1 -- 172.21.15.59:0/4122377704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c1a8cb0 con 0x7f174c09e440 2023-09-30T22:30:44.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.344+0000 7f17497fa700 1 -- 172.21.15.59:0/4122377704 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f174400c880 con 0x7f174c09e440 2023-09-30T22:30:44.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.345+0000 7f1753235700 1 -- 172.21.15.59:0/4122377704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174c074ea0 con 0x7f174c09e440 2023-09-30T22:30:44.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.345+0000 7f17497fa700 1 -- 172.21.15.59:0/4122377704 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f174403f810 con 0x7f174c09e440 2023-09-30T22:30:44.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.352+0000 7f17497fa700 1 -- 172.21.15.59:0/4122377704 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f174400ce10 con 0x7f174c09e440 2023-09-30T22:30:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.553+0000 7f1753235700 1 -- 172.21.15.59:0/4122377704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f174c09f420 con 0x7f174c09e440 2023-09-30T22:30:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.554+0000 7f17497fa700 1 -- 172.21.15.59:0/4122377704 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f174401cbb0 con 0x7f174c09e440 2023-09-30T22:30:44.554 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.555+0000 7f1753235700 1 -- 172.21.15.59:0/4122377704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c09e440 msgr2=0x7f174c1a6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.555+0000 7f1753235700 1 --2- 172.21.15.59:0/4122377704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c09e440 0x7f174c1a6910 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f174400efc0 tx=0x7f174400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.556+0000 7f1753235700 1 -- 172.21.15.59:0/4122377704 shutdown_connections 2023-09-30T22:30:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.556+0000 7f1753235700 1 --2- 172.21.15.59:0/4122377704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c09e440 0x7f174c1a6910 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.556+0000 7f1753235700 1 --2- 172.21.15.59:0/4122377704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f174c09d6f0 0x7f174c1a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.556+0000 7f1753235700 1 --2- 172.21.15.59:0/4122377704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f174c09e000 0x7f174c1a63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.556+0000 7f1753235700 1 -- 172.21.15.59:0/4122377704 >> 172.21.15.59:0/4122377704 conn(0x7f174c066f50 msgr2=0x7f174c1bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.556+0000 7f1753235700 1 -- 172.21.15.59:0/4122377704 shutdown_connections 2023-09-30T22:30:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:44.556+0000 7f1753235700 1 -- 172.21.15.59:0/4122377704 wait complete. 2023-09-30T22:30:44.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:45.096 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:45.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:45.207 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:45.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.245+0000 7fe12ea6d700 1 Processor -- start 2023-09-30T22:30:45.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.245+0000 7fe12ea6d700 1 -- start start 2023-09-30T22:30:45.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.245+0000 7fe12ea6d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128130540 0x7fe128130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.245+0000 7fe12ea6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128130e50 0x7fe12806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.245+0000 7fe12ea6d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1280716a0 con 0x7fe12806fb20 2023-09-30T22:30:45.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.245+0000 7fe12ea6d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12809a390 con 0x7fe128130e50 2023-09-30T22:30:45.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.245+0000 7fe12ea6d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe128071290 con 0x7fe128130540 2023-09-30T22:30:45.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.245+0000 7fe12c809700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128130540 0x7fe128130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.245+0000 7fe12c809700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128130540 0x7fe128130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36238/0 (socket says 172.21.15.59:36238) 2023-09-30T22:30:45.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.245+0000 7fe12c809700 1 -- 172.21.15.59:0/619536403 learned_addr learned my addr 172.21.15.59:0/619536403 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:45.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.246+0000 7fe127fff700 1 --2- 172.21.15.59:0/619536403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128130e50 0x7fe12806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.246+0000 7fe1277fe700 1 -- 172.21.15.59:0/619536403 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8692320 0 0) 0x7fe1280716a0 con 0x7fe12806fb20 2023-09-30T22:30:45.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.246+0000 7fe1277fe700 1 -- 172.21.15.59:0/619536403 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1180035b0 con 0x7fe12806fb20 2023-09-30T22:30:45.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.246+0000 7fe12c809700 1 -- 172.21.15.59:0/619536403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128130e50 msgr2=0x7fe12806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.246+0000 7fe12c809700 1 --2- 172.21.15.59:0/619536403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128130e50 0x7fe12806f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.246+0000 7fe12c809700 1 -- 172.21.15.59:0/619536403 >> v1:172.21.15.59:6789/0 conn(0x7fe12806fb20 legacy=0x7fe128137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.246+0000 7fe12c809700 1 -- 172.21.15.59:0/619536403 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe128130340 con 0x7fe128130540 2023-09-30T22:30:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.246+0000 7fe127fff700 1 --2- 172.21.15.59:0/619536403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128130e50 0x7fe12806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.246+0000 7fe12c809700 1 --2- 172.21.15.59:0/619536403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128130540 0x7fe128130910 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe11c009950 tx=0x7fe11c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5071a7ff6a0f679 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.246+0000 7fe1277fe700 1 -- 172.21.15.59:0/619536403 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c004230 con 0x7fe128130540 2023-09-30T22:30:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.246+0000 7fe1277fe700 1 -- 172.21.15.59:0/619536403 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c004390 con 0x7fe128130540 2023-09-30T22:30:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.246+0000 7fe1277fe700 1 -- 172.21.15.59:0/619536403 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c0036a0 con 0x7fe128130540 2023-09-30T22:30:45.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.247+0000 7fe12ea6d700 1 -- 172.21.15.59:0/619536403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128130540 msgr2=0x7fe128130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.247+0000 7fe12ea6d700 1 --2- 172.21.15.59:0/619536403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128130540 0x7fe128130910 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe11c009950 tx=0x7fe11c009c60 comp rx=0 tx=0).stop 2023-09-30T22:30:45.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.247+0000 7fe12ea6d700 1 -- 172.21.15.59:0/619536403 shutdown_connections 2023-09-30T22:30:45.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.247+0000 7fe12ea6d700 1 --2- 172.21.15.59:0/619536403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128130540 0x7fe128130910 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.247+0000 7fe12ea6d700 1 --2- 172.21.15.59:0/619536403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128130e50 0x7fe12806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.247+0000 7fe12ea6d700 1 -- 172.21.15.59:0/619536403 >> 172.21.15.59:0/619536403 conn(0x7fe1280a2aa0 msgr2=0x7fe1280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:45.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.247+0000 7fe12ea6d700 1 -- 172.21.15.59:0/619536403 shutdown_connections 2023-09-30T22:30:45.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.247+0000 7fe12ea6d700 1 -- 172.21.15.59:0/619536403 wait complete. 2023-09-30T22:30:45.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.249+0000 7fe12ea6d700 1 Processor -- start 2023-09-30T22:30:45.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.249+0000 7fe12ea6d700 1 -- start start 2023-09-30T22:30:45.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.250+0000 7fe12ea6d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12806fb20 0x7fe12812abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.250+0000 7fe12ea6d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128130540 0x7fe12812b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.250+0000 7fe12ea6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128130e50 0x7fe1281c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.250+0000 7fe12ea6d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe128071950 con 0x7fe12806fb20 2023-09-30T22:30:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.250+0000 7fe12ea6d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12812dd80 con 0x7fe128130e50 2023-09-30T22:30:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.250+0000 7fe12ea6d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe12812a7e0 con 0x7fe128130540 2023-09-30T22:30:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.250+0000 7fe127fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128130540 0x7fe12812b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.250+0000 7fe127fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128130540 0x7fe12812b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36246/0 (socket says 172.21.15.59:36246) 2023-09-30T22:30:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.250+0000 7fe127fff700 1 -- 172.21.15.59:0/1336465708 learned_addr learned my addr 172.21.15.59:0/1336465708 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.250+0000 7fe12d00a700 1 --2- 172.21.15.59:0/1336465708 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128130e50 0x7fe1281c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.250+0000 7fe12c809700 1 --2- 172.21.15.59:0/1336465708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12806fb20 0x7fe12812abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.250+0000 7fe12d00a700 1 -- 172.21.15.59:0/1336465708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128130540 msgr2=0x7fe12812b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.250+0000 7fe12d00a700 1 --2- 172.21.15.59:0/1336465708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128130540 0x7fe12812b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.251+0000 7fe12d00a700 1 -- 172.21.15.59:0/1336465708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12806fb20 msgr2=0x7fe12812abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.251+0000 7fe12d00a700 1 --2- 172.21.15.59:0/1336465708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12806fb20 0x7fe12812abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.251+0000 7fe12d00a700 1 -- 172.21.15.59:0/1336465708 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c009550 con 0x7fe128130e50 2023-09-30T22:30:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.251+0000 7fe127fff700 1 --2- 172.21.15.59:0/1336465708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128130540 0x7fe12812b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.251+0000 7fe12c809700 1 --2- 172.21.15.59:0/1336465708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12806fb20 0x7fe12812abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.251+0000 7fe12d00a700 1 --2- 172.21.15.59:0/1336465708 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128130e50 0x7fe1281c5d70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe12000c730 tx=0x7fe12000ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.251+0000 7fe1257fa700 1 -- 172.21.15.59:0/1336465708 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe120003e30 con 0x7fe128130e50 2023-09-30T22:30:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.251+0000 7fe1257fa700 1 -- 172.21.15.59:0/1336465708 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe120005070 con 0x7fe128130e50 2023-09-30T22:30:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.251+0000 7fe12ea6d700 1 -- 172.21.15.59:0/1336465708 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12812da70 con 0x7fe128130e50 2023-09-30T22:30:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.251+0000 7fe1257fa700 1 -- 172.21.15.59:0/1336465708 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe120005420 con 0x7fe128130e50 2023-09-30T22:30:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.251+0000 7fe12ea6d700 1 -- 172.21.15.59:0/1336465708 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12812a3f0 con 0x7fe128130e50 2023-09-30T22:30:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.252+0000 7fe1257fa700 1 -- 172.21.15.59:0/1336465708 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe120005580 con 0x7fe128130e50 2023-09-30T22:30:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.252+0000 7fe1257fa700 1 -- 172.21.15.59:0/1336465708 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe12003f270 con 0x7fe128130e50 2023-09-30T22:30:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.252+0000 7fe12ea6d700 1 -- 172.21.15.59:0/1336465708 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12812d8d0 con 0x7fe128130e50 2023-09-30T22:30:45.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.261+0000 7fe1257fa700 1 -- 172.21.15.59:0/1336465708 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe12812d8d0 con 0x7fe128130e50 2023-09-30T22:30:45.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.311+0000 7f31c0f0c700 1 Processor -- start 2023-09-30T22:30:45.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.311+0000 7f31c0f0c700 1 -- start start 2023-09-30T22:30:45.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.312+0000 7f31c0f0c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f31bc06a770 0x7f31bc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.312+0000 7f31c0f0c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31bc131d10 0x7f31bc139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.312+0000 7f31c0f0c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31bc09ece0 con 0x7f31bc06b080 2023-09-30T22:30:45.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.312+0000 7f31c0f0c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31bc09e760 con 0x7f31bc06a770 2023-09-30T22:30:45.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.312+0000 7f31c0f0c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc09e040 con 0x7f31bc131d10 2023-09-30T22:30:45.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.312+0000 7f31ba59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f31bc06a770 0x7f31bc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.312+0000 7f31ba59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f31bc06a770 0x7f31bc06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56542/0 (socket says 172.21.15.59:56542) 2023-09-30T22:30:45.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.312+0000 7f31ba59c700 1 -- 172.21.15.59:0/3706188393 learned_addr learned my addr 172.21.15.59:0/3706188393 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:45.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.312+0000 7f31bad9d700 1 --2- 172.21.15.59:0/3706188393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31bc131d10 0x7f31bc139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.313+0000 7f31ba59c700 1 -- 172.21.15.59:0/3706188393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31bc131d10 msgr2=0x7f31bc139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.313+0000 7f31ba59c700 1 --2- 172.21.15.59:0/3706188393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31bc131d10 0x7f31bc139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.313+0000 7f31ba59c700 1 -- 172.21.15.59:0/3706188393 >> v1:172.21.15.59:6789/0 conn(0x7f31bc06b080 legacy=0x7f31bc131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.313+0000 7f31ba59c700 1 -- 172.21.15.59:0/3706188393 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc09f630 con 0x7f31bc06a770 2023-09-30T22:30:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.313+0000 7f31ba59c700 1 --2- 172.21.15.59:0/3706188393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31bc06a770 0x7f31bc06ab40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0098f0 tx=0x7f31ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ca5fa3439ffd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.313+0000 7f31b959a700 1 -- 172.21.15.59:0/3706188393 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00b8a0 con 0x7f31bc06a770 2023-09-30T22:30:45.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.313+0000 7f31b959a700 1 -- 172.21.15.59:0/3706188393 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac00ba00 con 0x7f31bc06a770 2023-09-30T22:30:45.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.313+0000 7f31b959a700 1 -- 172.21.15.59:0/3706188393 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00bd90 con 0x7f31bc06a770 2023-09-30T22:30:45.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.314+0000 7f31c0f0c700 1 -- 172.21.15.59:0/3706188393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31bc06a770 msgr2=0x7f31bc06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.314+0000 7f31c0f0c700 1 --2- 172.21.15.59:0/3706188393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31bc06a770 0x7f31bc06ab40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0098f0 tx=0x7f31ac009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:45.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.314+0000 7f31c0f0c700 1 -- 172.21.15.59:0/3706188393 shutdown_connections 2023-09-30T22:30:45.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.314+0000 7f31c0f0c700 1 --2- 172.21.15.59:0/3706188393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31bc06a770 0x7f31bc06ab40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.314+0000 7f31c0f0c700 1 --2- 172.21.15.59:0/3706188393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31bc131d10 0x7f31bc139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.314+0000 7f31c0f0c700 1 -- 172.21.15.59:0/3706188393 >> 172.21.15.59:0/3706188393 conn(0x7f31bc066f50 msgr2=0x7f31bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:45.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.314+0000 7f31c0f0c700 1 -- 172.21.15.59:0/3706188393 shutdown_connections 2023-09-30T22:30:45.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.314+0000 7f31c0f0c700 1 -- 172.21.15.59:0/3706188393 wait complete. 2023-09-30T22:30:45.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.315+0000 7f31c0f0c700 1 Processor -- start 2023-09-30T22:30:45.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.315+0000 7f31c0f0c700 1 -- start start 2023-09-30T22:30:45.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.316+0000 7f31c0f0c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31bc06a770 0x7f31bc11c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.316+0000 7f31c0f0c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31bc06b080 0x7f31bc11c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.316+0000 7f31c0f0c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31bc131d10 0x7f31bc11cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.316+0000 7f31c0f0c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc11fdd0 con 0x7f31bc131d10 2023-09-30T22:30:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.316+0000 7f31c0f0c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc11f5b0 con 0x7f31bc06a770 2023-09-30T22:30:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.316+0000 7f31c0f0c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc071e60 con 0x7f31bc06b080 2023-09-30T22:30:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.316+0000 7f31bad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31bc131d10 0x7f31bc11cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.316+0000 7f31b9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31bc06b080 0x7f31bc11c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.316+0000 7f31bad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31bc131d10 0x7f31bc11cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56550/0 (socket says 172.21.15.59:56550) 2023-09-30T22:30:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.316+0000 7f31bad9d700 1 -- 172.21.15.59:0/1585457680 learned_addr learned my addr 172.21.15.59:0/1585457680 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:45.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.316+0000 7f31ba59c700 1 --2- 172.21.15.59:0/1585457680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31bc06a770 0x7f31bc11c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.316+0000 7f31b9d9b700 1 -- 172.21.15.59:0/1585457680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31bc06a770 msgr2=0x7f31bc11c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.317+0000 7f31b9d9b700 1 --2- 172.21.15.59:0/1585457680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31bc06a770 0x7f31bc11c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.317+0000 7f31b9d9b700 1 -- 172.21.15.59:0/1585457680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31bc131d10 msgr2=0x7f31bc11cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.317+0000 7f31b9d9b700 1 --2- 172.21.15.59:0/1585457680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31bc131d10 0x7f31bc11cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.317+0000 7f31b9d9b700 1 -- 172.21.15.59:0/1585457680 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac009550 con 0x7f31bc06b080 2023-09-30T22:30:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.317+0000 7f31bad9d700 1 --2- 172.21.15.59:0/1585457680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31bc131d10 0x7f31bc11cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.317+0000 7f31b9d9b700 1 --2- 172.21.15.59:0/1585457680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31bc06b080 0x7f31bc11c840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f31b000c450 tx=0x7f31b000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.317+0000 7f31aaffd700 1 -- 172.21.15.59:0/1585457680 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b00052d0 con 0x7f31bc06b080 2023-09-30T22:30:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.317+0000 7f31aaffd700 1 -- 172.21.15.59:0/1585457680 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b0005430 con 0x7f31bc06b080 2023-09-30T22:30:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.317+0000 7f31aaffd700 1 -- 172.21.15.59:0/1585457680 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b00038c0 con 0x7f31bc06b080 2023-09-30T22:30:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.317+0000 7f31c0f0c700 1 -- 172.21.15.59:0/1585457680 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc1311b0 con 0x7f31bc06b080 2023-09-30T22:30:45.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.317+0000 7f31c0f0c700 1 -- 172.21.15.59:0/1585457680 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc130cf0 con 0x7f31bc06b080 2023-09-30T22:30:45.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.318+0000 7f31aaffd700 1 -- 172.21.15.59:0/1585457680 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31b0003a20 con 0x7f31bc06b080 2023-09-30T22:30:45.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.318+0000 7f31c0f0c700 1 -- 172.21.15.59:0/1585457680 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31bc074ea0 con 0x7f31bc06b080 2023-09-30T22:30:45.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.318+0000 7f31aaffd700 1 -- 172.21.15.59:0/1585457680 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f31b003e970 con 0x7f31bc06b080 2023-09-30T22:30:45.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.328+0000 7f31aaffd700 1 -- 172.21.15.59:0/1585457680 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31b0011590 con 0x7f31bc06b080 2023-09-30T22:30:45.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.357+0000 7f3b334ad700 1 Processor -- start 2023-09-30T22:30:45.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.357+0000 7f3b334ad700 1 -- start start 2023-09-30T22:30:45.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.357+0000 7f3b334ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b2c0a0a30 0x7f3b2c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.357+0000 7f3b334ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b2c134170 0x7f3b2c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.358+0000 7f3b334ad700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c09edd0 con 0x7f3b2c0a1340 2023-09-30T22:30:45.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.358+0000 7f3b334ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c09e1f0 con 0x7f3b2c134170 2023-09-30T22:30:45.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.358+0000 7f3b334ad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c09dc50 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.358+0000 7f3b31249700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b2c0a0a30 0x7f3b2c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.358+0000 7f3b31249700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b2c0a0a30 0x7f3b2c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36262/0 (socket says 172.21.15.59:36262) 2023-09-30T22:30:45.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.358+0000 7f3b31249700 1 -- 172.21.15.59:0/977707242 learned_addr learned my addr 172.21.15.59:0/977707242 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:45.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.358+0000 7f3b31a4a700 1 --2- 172.21.15.59:0/977707242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b2c134170 0x7f3b2c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.358+0000 7f3b31249700 1 -- 172.21.15.59:0/977707242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b2c134170 msgr2=0x7f3b2c13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:45.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.358+0000 7f3b31249700 1 --2- 172.21.15.59:0/977707242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b2c134170 0x7f3b2c13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.358+0000 7f3b31249700 1 -- 172.21.15.59:0/977707242 >> v1:172.21.15.59:6789/0 conn(0x7f3b2c0a1340 legacy=0x7f3b2c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.358+0000 7f3b31249700 1 -- 172.21.15.59:0/977707242 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c0a1fe0 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.358+0000 7f3b23fff700 1 -- 172.21.15.59:0/977707242 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072901446 0 0) 0x7f3b2c09edd0 con 0x7f3b2c0a1340 2023-09-30T22:30:45.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.358+0000 7f3b31249700 1 --2- 172.21.15.59:0/977707242 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b2c0a0a30 0x7f3b2c0a0e00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009920 tx=0x7f3b28009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8938cf47bc826a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.359+0000 7f3b23fff700 1 -- 172.21.15.59:0/977707242 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28011830 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.359+0000 7f3b23fff700 1 -- 172.21.15.59:0/977707242 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b28011990 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.359+0000 7f3b23fff700 1 -- 172.21.15.59:0/977707242 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28011d20 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.359+0000 7f3b334ad700 1 -- 172.21.15.59:0/977707242 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b2c0a0a30 msgr2=0x7f3b2c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.359+0000 7f3b334ad700 1 --2- 172.21.15.59:0/977707242 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b2c0a0a30 0x7f3b2c0a0e00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009920 tx=0x7f3b28009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:45.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.360+0000 7f3b334ad700 1 -- 172.21.15.59:0/977707242 shutdown_connections 2023-09-30T22:30:45.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.360+0000 7f3b334ad700 1 --2- 172.21.15.59:0/977707242 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b2c0a0a30 0x7f3b2c0a0e00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.360+0000 7f3b334ad700 1 --2- 172.21.15.59:0/977707242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b2c134170 0x7f3b2c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.360+0000 7f3b334ad700 1 -- 172.21.15.59:0/977707242 >> 172.21.15.59:0/977707242 conn(0x7f3b2c0a6550 msgr2=0x7f3b2c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:45.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.360+0000 7f3b334ad700 1 -- 172.21.15.59:0/977707242 shutdown_connections 2023-09-30T22:30:45.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.360+0000 7f3b334ad700 1 -- 172.21.15.59:0/977707242 wait complete. 2023-09-30T22:30:45.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.361+0000 7f3b334ad700 1 Processor -- start 2023-09-30T22:30:45.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.361+0000 7f3b334ad700 1 -- start start 2023-09-30T22:30:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b334ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b2c0a0a30 0x7f3b2c1c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b334ad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c0a1340 0x7f3b2c1c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b334ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b2c134170 0x7f3b2c1c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b334ad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c122d90 con 0x7f3b2c0a1340 2023-09-30T22:30:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b334ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0a4e90 con 0x7f3b2c134170 2023-09-30T22:30:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b334ad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0a0220 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b31249700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b2c0a0a30 0x7f3b2c1c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b31249700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b2c0a0a30 0x7f3b2c1c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36266/0 (socket says 172.21.15.59:36266) 2023-09-30T22:30:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b31249700 1 -- 172.21.15.59:0/2774911337 learned_addr learned my addr 172.21.15.59:0/2774911337 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b31a4a700 1 --2- 172.21.15.59:0/2774911337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b2c134170 0x7f3b2c1c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b30a48700 1 --2- 172.21.15.59:0/2774911337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c0a1340 0x7f3b2c1c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b31249700 1 -- 172.21.15.59:0/2774911337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b2c134170 msgr2=0x7f3b2c1c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b31249700 1 --2- 172.21.15.59:0/2774911337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b2c134170 0x7f3b2c1c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b31249700 1 -- 172.21.15.59:0/2774911337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c0a1340 msgr2=0x7f3b2c1c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b31249700 1 --2- 172.21.15.59:0/2774911337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c0a1340 0x7f3b2c1c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.362+0000 7f3b31249700 1 -- 172.21.15.59:0/2774911337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b28009550 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.363+0000 7f3b31249700 1 --2- 172.21.15.59:0/2774911337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b2c0a0a30 0x7f3b2c1c84c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3b28000c00 tx=0x7f3b28004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.363+0000 7f3b21ffb700 1 -- 172.21.15.59:0/2774911337 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28004510 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.363+0000 7f3b21ffb700 1 -- 172.21.15.59:0/2774911337 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b280036a0 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.363+0000 7f3b21ffb700 1 -- 172.21.15.59:0/2774911337 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28003a10 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.363+0000 7f3b334ad700 1 -- 172.21.15.59:0/2774911337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c0a25e0 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.363+0000 7f3b334ad700 1 -- 172.21.15.59:0/2774911337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c1251e0 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.364+0000 7f3b21ffb700 1 -- 172.21.15.59:0/2774911337 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b28003b70 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.364+0000 7f3b21ffb700 1 -- 172.21.15.59:0/2774911337 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3b28021030 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.364+0000 7f3b334ad700 1 -- 172.21.15.59:0/2774911337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c0a1b60 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.369+0000 7f3b21ffb700 1 -- 172.21.15.59:0/2774911337 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b28015080 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.480+0000 7fe12ea6d700 1 -- 172.21.15.59:0/1336465708 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe12812d8d0 con 0x7fe128130e50 2023-09-30T22:30:45.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.480+0000 7fe1257fa700 1 -- 172.21.15.59:0/1336465708 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe12812d8d0 con 0x7fe128130e50 2023-09-30T22:30:45.481 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:45.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.483+0000 7fe12ea6d700 1 -- 172.21.15.59:0/1336465708 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128130e50 msgr2=0x7fe1281c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.483+0000 7fe12ea6d700 1 --2- 172.21.15.59:0/1336465708 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128130e50 0x7fe1281c5d70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe12000c730 tx=0x7fe12000ca40 comp rx=0 tx=0).stop 2023-09-30T22:30:45.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.483+0000 7fe12ea6d700 1 -- 172.21.15.59:0/1336465708 shutdown_connections 2023-09-30T22:30:45.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.483+0000 7fe12ea6d700 1 --2- 172.21.15.59:0/1336465708 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128130e50 0x7fe1281c5d70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.483+0000 7fe12ea6d700 1 --2- 172.21.15.59:0/1336465708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12806fb20 0x7fe12812abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.483+0000 7fe12ea6d700 1 --2- 172.21.15.59:0/1336465708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128130540 0x7fe12812b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.483+0000 7fe12ea6d700 1 -- 172.21.15.59:0/1336465708 >> 172.21.15.59:0/1336465708 conn(0x7fe1280a2aa0 msgr2=0x7fe12806e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:45.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.483+0000 7fe12ea6d700 1 -- 172.21.15.59:0/1336465708 shutdown_connections 2023-09-30T22:30:45.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.483+0000 7fe12ea6d700 1 -- 172.21.15.59:0/1336465708 wait complete. 2023-09-30T22:30:45.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:45.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.536+0000 7f31c0f0c700 1 -- 172.21.15.59:0/1585457680 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f31bc11f9a0 con 0x7f31bc06b080 2023-09-30T22:30:45.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.537+0000 7f31aaffd700 1 -- 172.21.15.59:0/1585457680 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31b0017020 con 0x7f31bc06b080 2023-09-30T22:30:45.537 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.539+0000 7f31c0f0c700 1 -- 172.21.15.59:0/1585457680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31bc06b080 msgr2=0x7f31bc11c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.539+0000 7f31c0f0c700 1 --2- 172.21.15.59:0/1585457680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31bc06b080 0x7f31bc11c840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f31b000c450 tx=0x7f31b000c760 comp rx=0 tx=0).stop 2023-09-30T22:30:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.539+0000 7f31c0f0c700 1 -- 172.21.15.59:0/1585457680 shutdown_connections 2023-09-30T22:30:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.539+0000 7f31c0f0c700 1 --2- 172.21.15.59:0/1585457680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31bc131d10 0x7f31bc11cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.539+0000 7f31c0f0c700 1 --2- 172.21.15.59:0/1585457680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31bc06a770 0x7f31bc11c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.539+0000 7f31c0f0c700 1 --2- 172.21.15.59:0/1585457680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31bc06b080 0x7f31bc11c840 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.539+0000 7f31c0f0c700 1 -- 172.21.15.59:0/1585457680 >> 172.21.15.59:0/1585457680 conn(0x7f31bc066f50 msgr2=0x7f31bc070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.540+0000 7f31c0f0c700 1 -- 172.21.15.59:0/1585457680 shutdown_connections 2023-09-30T22:30:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.540+0000 7f31c0f0c700 1 -- 172.21.15.59:0/1585457680 wait complete. 2023-09-30T22:30:45.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:45.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:45.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.575+0000 7f3b334ad700 1 -- 172.21.15.59:0/2774911337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3b2c074ea0 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.576+0000 7f3b21ffb700 1 -- 172.21.15.59:0/2774911337 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b2802b020 con 0x7f3b2c0a0a30 2023-09-30T22:30:45.576 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:45.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.578+0000 7f3b334ad700 1 -- 172.21.15.59:0/2774911337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b2c0a0a30 msgr2=0x7f3b2c1c84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.578+0000 7f3b334ad700 1 --2- 172.21.15.59:0/2774911337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b2c0a0a30 0x7f3b2c1c84c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3b28000c00 tx=0x7f3b28004750 comp rx=0 tx=0).stop 2023-09-30T22:30:45.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.578+0000 7f3b334ad700 1 -- 172.21.15.59:0/2774911337 shutdown_connections 2023-09-30T22:30:45.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.578+0000 7f3b334ad700 1 --2- 172.21.15.59:0/2774911337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b2c0a0a30 0x7f3b2c1c84c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.578+0000 7f3b334ad700 1 --2- 172.21.15.59:0/2774911337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b2c134170 0x7f3b2c1c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.578+0000 7f3b334ad700 1 --2- 172.21.15.59:0/2774911337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c0a1340 0x7f3b2c1c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.578+0000 7f3b334ad700 1 -- 172.21.15.59:0/2774911337 >> 172.21.15.59:0/2774911337 conn(0x7f3b2c0a6550 msgr2=0x7f3b2c09edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:45.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.578+0000 7f3b334ad700 1 -- 172.21.15.59:0/2774911337 shutdown_connections 2023-09-30T22:30:45.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.578+0000 7f3b334ad700 1 -- 172.21.15.59:0/2774911337 wait complete. 2023-09-30T22:30:45.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:45.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.712+0000 7fe1837d3700 1 Processor -- start 2023-09-30T22:30:45.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.712+0000 7fe1837d3700 1 -- start start 2023-09-30T22:30:45.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.713+0000 7fe1837d3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe17c09e1d0 0x7fe17c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.713+0000 7fe1837d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe17c135e50 0x7fe17c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.713+0000 7fe1837d3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c09f130 con 0x7fe17c09d6f0 2023-09-30T22:30:45.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.713+0000 7fe1837d3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17c09f520 con 0x7fe17c09e1d0 2023-09-30T22:30:45.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.713+0000 7fe1837d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c09e930 con 0x7fe17c135e50 2023-09-30T22:30:45.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.713+0000 7fe181d70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe17c135e50 0x7fe17c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.713+0000 7fe180d6e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe17c09e1d0 0x7fe17c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.713+0000 7fe180d6e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe17c09e1d0 0x7fe17c135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56570/0 (socket says 172.21.15.59:56570) 2023-09-30T22:30:45.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.713+0000 7fe181d70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe17c135e50 0x7fe17c138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33750/0 (socket says 172.21.15.59:33750) 2023-09-30T22:30:45.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.713+0000 7fe180d6e700 1 -- 172.21.15.59:0/3785761753 learned_addr learned my addr 172.21.15.59:0/3785761753 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:45.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.713+0000 7fe181d70700 1 -- 172.21.15.59:0/3785761753 >> v2:172.21.15.59:3300/0 conn(0x7fe17c09e1d0 msgr2=0x7fe17c135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:45.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.713+0000 7fe181d70700 1 --2- 172.21.15.59:0/3785761753 >> v2:172.21.15.59:3300/0 conn(0x7fe17c09e1d0 0x7fe17c135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.713+0000 7fe181d70700 1 -- 172.21.15.59:0/3785761753 >> v1:172.21.15.59:6789/0 conn(0x7fe17c09d6f0 legacy=0x7fe17c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.713+0000 7fe181d70700 1 -- 172.21.15.59:0/3785761753 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c09b2d0 con 0x7fe17c135e50 2023-09-30T22:30:45.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.713+0000 7fe181d70700 1 --2- 172.21.15.59:0/3785761753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe17c135e50 0x7fe17c138230 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe174009d90 tx=0x7fe17400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aad91062762accf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.714+0000 7fe16ffff700 1 -- 172.21.15.59:0/3785761753 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17400e070 con 0x7fe17c135e50 2023-09-30T22:30:45.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.714+0000 7fe16ffff700 1 -- 172.21.15.59:0/3785761753 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17400bb20 con 0x7fe17c135e50 2023-09-30T22:30:45.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.714+0000 7fe16ffff700 1 -- 172.21.15.59:0/3785761753 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe174012430 con 0x7fe17c135e50 2023-09-30T22:30:45.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.714+0000 7fe1837d3700 1 -- 172.21.15.59:0/3785761753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe17c135e50 msgr2=0x7fe17c138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.714+0000 7fe1837d3700 1 --2- 172.21.15.59:0/3785761753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe17c135e50 0x7fe17c138230 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe174009d90 tx=0x7fe17400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:45.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.714+0000 7fe1837d3700 1 -- 172.21.15.59:0/3785761753 shutdown_connections 2023-09-30T22:30:45.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.714+0000 7fe1837d3700 1 --2- 172.21.15.59:0/3785761753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe17c135e50 0x7fe17c138230 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.714+0000 7fe1837d3700 1 --2- 172.21.15.59:0/3785761753 >> v2:172.21.15.59:3300/0 conn(0x7fe17c09e1d0 0x7fe17c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.714+0000 7fe1837d3700 1 -- 172.21.15.59:0/3785761753 >> 172.21.15.59:0/3785761753 conn(0x7fe17c066f50 msgr2=0x7fe17c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:45.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.714+0000 7fe1837d3700 1 -- 172.21.15.59:0/3785761753 shutdown_connections 2023-09-30T22:30:45.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.714+0000 7fe1837d3700 1 -- 172.21.15.59:0/3785761753 wait complete. 2023-09-30T22:30:45.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.715+0000 7fe1837d3700 1 Processor -- start 2023-09-30T22:30:45.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.715+0000 7fe1837d3700 1 -- start start 2023-09-30T22:30:45.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe1837d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe17c09d6f0 0x7fe17c136250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe1837d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe17c09e1d0 0x7fe17c136790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe1837d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe17c135e50 0x7fe17c136cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe1837d3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c1217e0 con 0x7fe17c09d6f0 2023-09-30T22:30:45.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe1837d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c09c700 con 0x7fe17c135e50 2023-09-30T22:30:45.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe1837d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c1219c0 con 0x7fe17c09e1d0 2023-09-30T22:30:45.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe18156f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe17c09d6f0 0x7fe17c136250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe18156f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe17c09d6f0 0x7fe17c136250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56578/0 (socket says 172.21.15.59:56578) 2023-09-30T22:30:45.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe180d6e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe17c09e1d0 0x7fe17c136790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe18156f700 1 -- 172.21.15.59:0/1803803692 learned_addr learned my addr 172.21.15.59:0/1803803692 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:45.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe181d70700 1 --2- 172.21.15.59:0/1803803692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe17c135e50 0x7fe17c136cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe18156f700 1 -- 172.21.15.59:0/1803803692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe17c09e1d0 msgr2=0x7fe17c136790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe18156f700 1 --2- 172.21.15.59:0/1803803692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe17c09e1d0 0x7fe17c136790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe18156f700 1 -- 172.21.15.59:0/1803803692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe17c135e50 msgr2=0x7fe17c136cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe18156f700 1 --2- 172.21.15.59:0/1803803692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe17c135e50 0x7fe17c136cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe18156f700 1 -- 172.21.15.59:0/1803803692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe174009a70 con 0x7fe17c09d6f0 2023-09-30T22:30:45.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe180d6e700 1 --2- 172.21.15.59:0/1803803692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe17c09e1d0 0x7fe17c136790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:45.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.716+0000 7fe181d70700 1 --2- 172.21.15.59:0/1803803692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe17c135e50 0x7fe17c136cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:45.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.717+0000 7fe18156f700 1 --2- 172.21.15.59:0/1803803692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe17c09d6f0 0x7fe17c136250 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c450 tx=0x7fe17800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.717+0000 7fe16dffb700 1 -- 172.21.15.59:0/1803803692 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780052d0 con 0x7fe17c09d6f0 2023-09-30T22:30:45.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.717+0000 7fe16dffb700 1 -- 172.21.15.59:0/1803803692 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe178005430 con 0x7fe17c09d6f0 2023-09-30T22:30:45.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.717+0000 7fe1837d3700 1 -- 172.21.15.59:0/1803803692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c0a1df0 con 0x7fe17c09d6f0 2023-09-30T22:30:45.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.717+0000 7fe16dffb700 1 -- 172.21.15.59:0/1803803692 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780038c0 con 0x7fe17c09d6f0 2023-09-30T22:30:45.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.717+0000 7fe1837d3700 1 -- 172.21.15.59:0/1803803692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c122430 con 0x7fe17c09d6f0 2023-09-30T22:30:45.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.718+0000 7fe16dffb700 1 -- 172.21.15.59:0/1803803692 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe178003a20 con 0x7fe17c09d6f0 2023-09-30T22:30:45.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.718+0000 7fe16dffb700 1 -- 172.21.15.59:0/1803803692 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe17803e9c0 con 0x7fe17c09d6f0 2023-09-30T22:30:45.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.718+0000 7fe1837d3700 1 -- 172.21.15.59:0/1803803692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c074ea0 con 0x7fe17c09d6f0 2023-09-30T22:30:45.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.723+0000 7fe16dffb700 1 -- 172.21.15.59:0/1803803692 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe178017080 con 0x7fe17c09d6f0 2023-09-30T22:30:45.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.929+0000 7fe1837d3700 1 -- 172.21.15.59:0/1803803692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe17c133170 con 0x7fe17c09d6f0 2023-09-30T22:30:45.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.930+0000 7fe16dffb700 1 -- 172.21.15.59:0/1803803692 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe17c133170 con 0x7fe17c09d6f0 2023-09-30T22:30:45.930 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.932+0000 7fe1837d3700 1 -- 172.21.15.59:0/1803803692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe17c09d6f0 msgr2=0x7fe17c136250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.932+0000 7fe1837d3700 1 --2- 172.21.15.59:0/1803803692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe17c09d6f0 0x7fe17c136250 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c450 tx=0x7fe17800c760 comp rx=0 tx=0).stop 2023-09-30T22:30:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.932+0000 7fe1837d3700 1 -- 172.21.15.59:0/1803803692 shutdown_connections 2023-09-30T22:30:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.932+0000 7fe1837d3700 1 --2- 172.21.15.59:0/1803803692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe17c135e50 0x7fe17c136cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.932+0000 7fe1837d3700 1 --2- 172.21.15.59:0/1803803692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe17c09d6f0 0x7fe17c136250 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.932+0000 7fe1837d3700 1 --2- 172.21.15.59:0/1803803692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe17c09e1d0 0x7fe17c136790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.932+0000 7fe1837d3700 1 -- 172.21.15.59:0/1803803692 >> 172.21.15.59:0/1803803692 conn(0x7fe17c066f50 msgr2=0x7fe17c06ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.933+0000 7fe1837d3700 1 -- 172.21.15.59:0/1803803692 shutdown_connections 2023-09-30T22:30:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:45.933+0000 7fe1837d3700 1 -- 172.21.15.59:0/1803803692 wait complete. 2023-09-30T22:30:45.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:46.498 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:46.555 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:46.594 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:46.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.648+0000 7fc5ab445700 1 Processor -- start 2023-09-30T22:30:46.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.649+0000 7fc5ab445700 1 -- start start 2023-09-30T22:30:46.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.649+0000 7fc5ab445700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5a4133420 0x7fc5a41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.649+0000 7fc5ab445700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5a4134260 0x7fc5a41306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.649+0000 7fc5ab445700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a406b990 con 0x7fc5a4133e30 2023-09-30T22:30:46.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.649+0000 7fc5ab445700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a40a0590 con 0x7fc5a4134260 2023-09-30T22:30:46.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.649+0000 7fc5ab445700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a409fb80 con 0x7fc5a4133420 2023-09-30T22:30:46.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.649+0000 7fc5a89e0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc5a4133e30 0x7fc5a412ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60760/0 (socket says 172.21.15.59:60760) 2023-09-30T22:30:46.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.649+0000 7fc5a89e0700 1 -- 172.21.15.59:0/1670012581 learned_addr learned my addr 172.21.15.59:0/1670012581 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:46.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.649+0000 7fc5a91e1700 1 --2- 172.21.15.59:0/1670012581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5a4133420 0x7fc5a41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.649+0000 7fc5a99e2700 1 --2- 172.21.15.59:0/1670012581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5a4134260 0x7fc5a41306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.650+0000 7fc59bfff700 1 -- 172.21.15.59:0/1670012581 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407576138 0 0) 0x7fc5a406b990 con 0x7fc5a4133e30 2023-09-30T22:30:46.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.650+0000 7fc59bfff700 1 -- 172.21.15.59:0/1670012581 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5900035b0 con 0x7fc5a4133e30 2023-09-30T22:30:46.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.650+0000 7fc5a91e1700 1 -- 172.21.15.59:0/1670012581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5a4134260 msgr2=0x7fc5a41306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:46.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.650+0000 7fc5a91e1700 1 --2- 172.21.15.59:0/1670012581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5a4134260 0x7fc5a41306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.650+0000 7fc5a91e1700 1 -- 172.21.15.59:0/1670012581 >> v1:172.21.15.59:6789/0 conn(0x7fc5a4133e30 legacy=0x7fc5a412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.650+0000 7fc5a91e1700 1 -- 172.21.15.59:0/1670012581 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a40a0030 con 0x7fc5a4133420 2023-09-30T22:30:46.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.650+0000 7fc5a91e1700 1 --2- 172.21.15.59:0/1670012581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5a4133420 0x7fc5a41337f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009870 tx=0x7fc5a0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8441d8c76cf8d1ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:46.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.650+0000 7fc59bfff700 1 -- 172.21.15.59:0/1670012581 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0011830 con 0x7fc5a4133420 2023-09-30T22:30:46.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.650+0000 7fc59bfff700 1 -- 172.21.15.59:0/1670012581 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a0011990 con 0x7fc5a4133420 2023-09-30T22:30:46.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.650+0000 7fc59bfff700 1 -- 172.21.15.59:0/1670012581 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0011d20 con 0x7fc5a4133420 2023-09-30T22:30:46.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.651+0000 7fc5ab445700 1 -- 172.21.15.59:0/1670012581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5a4133420 msgr2=0x7fc5a41337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.651+0000 7fc5ab445700 1 --2- 172.21.15.59:0/1670012581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5a4133420 0x7fc5a41337f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009870 tx=0x7fc5a0009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:46.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.651+0000 7fc5ab445700 1 -- 172.21.15.59:0/1670012581 shutdown_connections 2023-09-30T22:30:46.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.651+0000 7fc5ab445700 1 --2- 172.21.15.59:0/1670012581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5a4133420 0x7fc5a41337f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.651+0000 7fc5ab445700 1 --2- 172.21.15.59:0/1670012581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5a4134260 0x7fc5a41306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.651+0000 7fc5ab445700 1 -- 172.21.15.59:0/1670012581 >> 172.21.15.59:0/1670012581 conn(0x7fc5a40a4210 msgr2=0x7fc5a40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:46.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.651+0000 7fc5ab445700 1 -- 172.21.15.59:0/1670012581 shutdown_connections 2023-09-30T22:30:46.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.651+0000 7fc5ab445700 1 -- 172.21.15.59:0/1670012581 wait complete. 2023-09-30T22:30:46.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.653+0000 7fc5ab445700 1 Processor -- start 2023-09-30T22:30:46.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.653+0000 7fc5ab445700 1 -- start start 2023-09-30T22:30:46.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.653+0000 7fc5ab445700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5a4133420 0x7fc5a409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5ab445700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5a4133e30 0x7fc5a409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5ab445700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5a4134260 0x7fc5a409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5ab445700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a4120080 con 0x7fc5a4133e30 2023-09-30T22:30:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5ab445700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a411ee10 con 0x7fc5a4134260 2023-09-30T22:30:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5ab445700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a4120ee0 con 0x7fc5a4133420 2023-09-30T22:30:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5a91e1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5a4133420 0x7fc5a409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5a91e1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5a4133420 0x7fc5a409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36294/0 (socket says 172.21.15.59:36294) 2023-09-30T22:30:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5a91e1700 1 -- 172.21.15.59:0/1723639299 learned_addr learned my addr 172.21.15.59:0/1723639299 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5a99e2700 1 --2- 172.21.15.59:0/1723639299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5a4134260 0x7fc5a409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5a89e0700 1 --2- 172.21.15.59:0/1723639299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5a4133e30 0x7fc5a409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5a91e1700 1 -- 172.21.15.59:0/1723639299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5a4134260 msgr2=0x7fc5a409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5a91e1700 1 --2- 172.21.15.59:0/1723639299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5a4134260 0x7fc5a409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5a91e1700 1 -- 172.21.15.59:0/1723639299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5a4133e30 msgr2=0x7fc5a409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5a91e1700 1 --2- 172.21.15.59:0/1723639299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5a4133e30 0x7fc5a409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5a91e1700 1 -- 172.21.15.59:0/1723639299 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a00094a0 con 0x7fc5a4133420 2023-09-30T22:30:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.654+0000 7fc5a91e1700 1 --2- 172.21.15.59:0/1723639299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5a4133420 0x7fc5a409c480 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00090b0 tx=0x7fc5a0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.655+0000 7fc599ffb700 1 -- 172.21.15.59:0/1723639299 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0004240 con 0x7fc5a4133420 2023-09-30T22:30:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.655+0000 7fc599ffb700 1 -- 172.21.15.59:0/1723639299 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a001f070 con 0x7fc5a4133420 2023-09-30T22:30:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.655+0000 7fc5ab445700 1 -- 172.21.15.59:0/1723639299 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a4131700 con 0x7fc5a4133420 2023-09-30T22:30:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.655+0000 7fc599ffb700 1 -- 172.21.15.59:0/1723639299 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a00036a0 con 0x7fc5a4133420 2023-09-30T22:30:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.655+0000 7fc5ab445700 1 -- 172.21.15.59:0/1723639299 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a41209f0 con 0x7fc5a4133420 2023-09-30T22:30:46.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.656+0000 7fc5ab445700 1 -- 172.21.15.59:0/1723639299 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a4132b80 con 0x7fc5a4133420 2023-09-30T22:30:46.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.656+0000 7fc599ffb700 1 -- 172.21.15.59:0/1723639299 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5a0021030 con 0x7fc5a4133420 2023-09-30T22:30:46.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.656+0000 7fc599ffb700 1 -- 172.21.15.59:0/1723639299 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc5a00406f0 con 0x7fc5a4133420 2023-09-30T22:30:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.661+0000 7fc599ffb700 1 -- 172.21.15.59:0/1723639299 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5a00199a0 con 0x7fc5a4133420 2023-09-30T22:30:46.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.710+0000 7f89b1b81700 1 Processor -- start 2023-09-30T22:30:46.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.710+0000 7f89b1b81700 1 -- start start 2023-09-30T22:30:46.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.711+0000 7f89b1b81700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89ac0a1510 0x7f89ac138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.711+0000 7f89b1b81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89ac139250 0x7f89ac13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.711+0000 7f89b1b81700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ac09edd0 con 0x7f89ac0a0a30 2023-09-30T22:30:46.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.711+0000 7f89b1b81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0a18e0 con 0x7f89ac139250 2023-09-30T22:30:46.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.711+0000 7f89b1b81700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac09e1f0 con 0x7f89ac0a1510 2023-09-30T22:30:46.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.711+0000 7f89aaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89ac0a1510 0x7f89ac138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.711+0000 7f89ab7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f89ac0a0a30 0x7f89ac0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60772/0 (socket says 172.21.15.59:60772) 2023-09-30T22:30:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.711+0000 7f89ab7fe700 1 -- 172.21.15.59:0/2499093415 learned_addr learned my addr 172.21.15.59:0/2499093415 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.711+0000 7f89abfff700 1 --2- 172.21.15.59:0/2499093415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89ac139250 0x7f89ac13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.712+0000 7f89aa7fc700 1 -- 172.21.15.59:0/2499093415 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769399415 0 0) 0x7f89ac09edd0 con 0x7f89ac0a0a30 2023-09-30T22:30:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.712+0000 7f89aaffd700 1 -- 172.21.15.59:0/2499093415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89ac139250 msgr2=0x7f89ac13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.712+0000 7f89aaffd700 1 --2- 172.21.15.59:0/2499093415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89ac139250 0x7f89ac13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.712+0000 7f89aaffd700 1 -- 172.21.15.59:0/2499093415 >> v1:172.21.15.59:6789/0 conn(0x7f89ac0a0a30 legacy=0x7f89ac0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.712+0000 7f89aaffd700 1 -- 172.21.15.59:0/2499093415 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac09dc50 con 0x7f89ac0a1510 2023-09-30T22:30:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.712+0000 7f89abfff700 1 --2- 172.21.15.59:0/2499093415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89ac139250 0x7f89ac13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.712+0000 7f89aaffd700 1 --2- 172.21.15.59:0/2499093415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89ac0a1510 0x7f89ac138d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009870 tx=0x7f89a0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=900839cc57f6b9e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.712+0000 7f89aa7fc700 1 -- 172.21.15.59:0/2499093415 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a0011830 con 0x7f89ac0a1510 2023-09-30T22:30:46.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.712+0000 7f89aa7fc700 1 -- 172.21.15.59:0/2499093415 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a0011990 con 0x7f89ac0a1510 2023-09-30T22:30:46.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.712+0000 7f89aa7fc700 1 -- 172.21.15.59:0/2499093415 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a0011d20 con 0x7f89ac0a1510 2023-09-30T22:30:46.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.713+0000 7f89b1b81700 1 -- 172.21.15.59:0/2499093415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89ac0a1510 msgr2=0x7f89ac138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.713+0000 7f89b1b81700 1 --2- 172.21.15.59:0/2499093415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89ac0a1510 0x7f89ac138d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009870 tx=0x7f89a0009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:46.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.713+0000 7f89b1b81700 1 -- 172.21.15.59:0/2499093415 shutdown_connections 2023-09-30T22:30:46.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.713+0000 7f89b1b81700 1 --2- 172.21.15.59:0/2499093415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89ac139250 0x7f89ac13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.713+0000 7f89b1b81700 1 --2- 172.21.15.59:0/2499093415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89ac0a1510 0x7f89ac138d10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.713+0000 7f89b1b81700 1 -- 172.21.15.59:0/2499093415 >> 172.21.15.59:0/2499093415 conn(0x7f89ac0a6550 msgr2=0x7f89ac0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:46.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.713+0000 7f89b1b81700 1 -- 172.21.15.59:0/2499093415 shutdown_connections 2023-09-30T22:30:46.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.713+0000 7f89b1b81700 1 -- 172.21.15.59:0/2499093415 wait complete. 2023-09-30T22:30:46.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.714+0000 7f89b1b81700 1 Processor -- start 2023-09-30T22:30:46.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.715+0000 7f89b1b81700 1 -- start start 2023-09-30T22:30:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.715+0000 7f89b1b81700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89ac0a0a30 0x7f89ac122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.715+0000 7f89b1b81700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89ac0a1510 0x7f89ac122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.715+0000 7f89b1b81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89ac139250 0x7f89ac123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.715+0000 7f89b1b81700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac125c00 con 0x7f89ac0a0a30 2023-09-30T22:30:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.715+0000 7f89b1b81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac138180 con 0x7f89ac139250 2023-09-30T22:30:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.715+0000 7f89b1b81700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac1389a0 con 0x7f89ac0a1510 2023-09-30T22:30:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.715+0000 7f89abfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89ac139250 0x7f89ac123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.715+0000 7f89aaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89ac0a1510 0x7f89ac122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.715+0000 7f89abfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89ac139250 0x7f89ac123380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33790/0 (socket says 172.21.15.59:33790) 2023-09-30T22:30:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.715+0000 7f89aaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89ac0a1510 0x7f89ac122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36310/0 (socket says 172.21.15.59:36310) 2023-09-30T22:30:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.715+0000 7f89ab7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89ac0a0a30 0x7f89ac122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.715+0000 7f89aaffd700 1 -- 172.21.15.59:0/3275664705 learned_addr learned my addr 172.21.15.59:0/3275664705 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.716+0000 7f89abfff700 1 -- 172.21.15.59:0/3275664705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89ac0a1510 msgr2=0x7f89ac122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.716+0000 7f89abfff700 1 --2- 172.21.15.59:0/3275664705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89ac0a1510 0x7f89ac122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.716+0000 7f89abfff700 1 -- 172.21.15.59:0/3275664705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89ac0a0a30 msgr2=0x7f89ac122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.716+0000 7f89abfff700 1 --2- 172.21.15.59:0/3275664705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89ac0a0a30 0x7f89ac122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.716+0000 7f89abfff700 1 -- 172.21.15.59:0/3275664705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a4009a70 con 0x7f89ac139250 2023-09-30T22:30:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.716+0000 7f89ab7fe700 1 --2- 172.21.15.59:0/3275664705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89ac0a0a30 0x7f89ac122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.716+0000 7f89abfff700 1 --2- 172.21.15.59:0/3275664705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89ac139250 0x7f89ac123380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009e50 tx=0x7f89a400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.716+0000 7f8993fff700 1 -- 172.21.15.59:0/3275664705 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a400ca90 con 0x7f89ac139250 2023-09-30T22:30:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.716+0000 7f8993fff700 1 -- 172.21.15.59:0/3275664705 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a400f040 con 0x7f89ac139250 2023-09-30T22:30:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.716+0000 7f89b1b81700 1 -- 172.21.15.59:0/3275664705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a00094a0 con 0x7f89ac139250 2023-09-30T22:30:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.716+0000 7f8993fff700 1 -- 172.21.15.59:0/3275664705 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a400ce50 con 0x7f89ac139250 2023-09-30T22:30:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.717+0000 7f8993fff700 1 -- 172.21.15.59:0/3275664705 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89a4014480 con 0x7f89ac139250 2023-09-30T22:30:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.716+0000 7f89b1b81700 1 -- 172.21.15.59:0/3275664705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ac138760 con 0x7f89ac139250 2023-09-30T22:30:46.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.717+0000 7f8993fff700 1 -- 172.21.15.59:0/3275664705 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f89a4014730 con 0x7f89ac139250 2023-09-30T22:30:46.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.718+0000 7f89b1b81700 1 -- 172.21.15.59:0/3275664705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ac0a1d00 con 0x7f89ac139250 2023-09-30T22:30:46.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.723+0000 7f8993fff700 1 -- 172.21.15.59:0/3275664705 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89a4012930 con 0x7f89ac139250 2023-09-30T22:30:46.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.751+0000 7ff73c3bf700 1 Processor -- start 2023-09-30T22:30:46.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.751+0000 7ff73c3bf700 1 -- start start 2023-09-30T22:30:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.752+0000 7ff73c3bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7340a0a30 0x7ff7340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.752+0000 7ff73c3bf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff734138d80 0x7ff73413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.752+0000 7ff73c3bf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7340a2a70 con 0x7ff73409d630 2023-09-30T22:30:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.752+0000 7ff73c3bf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7340a01d0 con 0x7ff734138d80 2023-09-30T22:30:46.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.752+0000 7ff73c3bf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff73409e2b0 con 0x7ff7340a0a30 2023-09-30T22:30:46.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.752+0000 7ff73995a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff73409d630 0x7ff7340a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60786/0 (socket says 172.21.15.59:60786) 2023-09-30T22:30:46.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.752+0000 7ff73a15b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7340a0a30 0x7ff7340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.752+0000 7ff73995a700 1 -- 172.21.15.59:0/1935779883 learned_addr learned my addr 172.21.15.59:0/1935779883 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:46.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.752+0000 7ff73a95c700 1 --2- 172.21.15.59:0/1935779883 >> v2:172.21.15.59:3300/0 conn(0x7ff734138d80 0x7ff73413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.753+0000 7ff73a95c700 1 -- 172.21.15.59:0/1935779883 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7340a0a30 msgr2=0x7ff7340a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:46.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.753+0000 7ff73a95c700 1 --2- 172.21.15.59:0/1935779883 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7340a0a30 0x7ff7340a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.753+0000 7ff73a95c700 1 -- 172.21.15.59:0/1935779883 >> v1:172.21.15.59:6789/0 conn(0x7ff73409d630 legacy=0x7ff7340a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.753+0000 7ff73a95c700 1 -- 172.21.15.59:0/1935779883 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73409dc50 con 0x7ff734138d80 2023-09-30T22:30:46.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.753+0000 7ff739159700 1 -- 172.21.15.59:0/1935779883 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593169970 0 0) 0x7ff7340a2a70 con 0x7ff73409d630 2023-09-30T22:30:46.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.753+0000 7ff73a15b700 1 --2- 172.21.15.59:0/1935779883 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7340a0a30 0x7ff7340a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:46.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.753+0000 7ff73a95c700 1 --2- 172.21.15.59:0/1935779883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff734138d80 0x7ff73413b160 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009d90 tx=0x7ff72c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45985ded1654a2e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:46.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.753+0000 7ff739159700 1 -- 172.21.15.59:0/1935779883 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c00e070 con 0x7ff734138d80 2023-09-30T22:30:46.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.753+0000 7ff739159700 1 -- 172.21.15.59:0/1935779883 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c00bb20 con 0x7ff734138d80 2023-09-30T22:30:46.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.753+0000 7ff739159700 1 -- 172.21.15.59:0/1935779883 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c012430 con 0x7ff734138d80 2023-09-30T22:30:46.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.754+0000 7ff73c3bf700 1 -- 172.21.15.59:0/1935779883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff734138d80 msgr2=0x7ff73413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.754+0000 7ff73c3bf700 1 --2- 172.21.15.59:0/1935779883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff734138d80 0x7ff73413b160 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009d90 tx=0x7ff72c00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.754+0000 7ff73c3bf700 1 -- 172.21.15.59:0/1935779883 shutdown_connections 2023-09-30T22:30:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.754+0000 7ff73c3bf700 1 --2- 172.21.15.59:0/1935779883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff734138d80 0x7ff73413b160 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.754+0000 7ff73c3bf700 1 --2- 172.21.15.59:0/1935779883 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7340a0a30 0x7ff7340a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.754+0000 7ff73c3bf700 1 -- 172.21.15.59:0/1935779883 >> 172.21.15.59:0/1935779883 conn(0x7ff7340a3050 msgr2=0x7ff7340a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.754+0000 7ff73c3bf700 1 -- 172.21.15.59:0/1935779883 shutdown_connections 2023-09-30T22:30:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.754+0000 7ff73c3bf700 1 -- 172.21.15.59:0/1935779883 wait complete. 2023-09-30T22:30:46.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.755+0000 7ff73c3bf700 1 Processor -- start 2023-09-30T22:30:46.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.755+0000 7ff73c3bf700 1 -- start start 2023-09-30T22:30:46.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73c3bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff73409d630 0x7ff734133690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73c3bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7340a0a30 0x7ff734133bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73c3bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff734138d80 0x7ff734134110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73c3bf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7341361b0 con 0x7ff734138d80 2023-09-30T22:30:46.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73c3bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff734136ed0 con 0x7ff73409d630 2023-09-30T22:30:46.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73c3bf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7340a4b60 con 0x7ff7340a0a30 2023-09-30T22:30:46.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73995a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7340a0a30 0x7ff734133bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73a15b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff73409d630 0x7ff734133690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73995a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7340a0a30 0x7ff734133bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36326/0 (socket says 172.21.15.59:36326) 2023-09-30T22:30:46.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73995a700 1 -- 172.21.15.59:0/1319423010 learned_addr learned my addr 172.21.15.59:0/1319423010 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:46.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73a95c700 1 --2- 172.21.15.59:0/1319423010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff734138d80 0x7ff734134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73995a700 1 -- 172.21.15.59:0/1319423010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff73409d630 msgr2=0x7ff734133690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73995a700 1 --2- 172.21.15.59:0/1319423010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff73409d630 0x7ff734133690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73995a700 1 -- 172.21.15.59:0/1319423010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff734138d80 msgr2=0x7ff734134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73995a700 1 --2- 172.21.15.59:0/1319423010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff734138d80 0x7ff734134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73995a700 1 -- 172.21.15.59:0/1319423010 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7300094a0 con 0x7ff7340a0a30 2023-09-30T22:30:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73a15b700 1 --2- 172.21.15.59:0/1319423010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff73409d630 0x7ff734133690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.756+0000 7ff73a95c700 1 --2- 172.21.15.59:0/1319423010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff734138d80 0x7ff734134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.757+0000 7ff73995a700 1 --2- 172.21.15.59:0/1319423010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7340a0a30 0x7ff734133bd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff72400c520 tx=0x7ff72400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.757+0000 7ff72affd700 1 -- 172.21.15.59:0/1319423010 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff724004c80 con 0x7ff7340a0a30 2023-09-30T22:30:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.757+0000 7ff72affd700 1 -- 172.21.15.59:0/1319423010 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff724004de0 con 0x7ff7340a0a30 2023-09-30T22:30:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.757+0000 7ff73c3bf700 1 -- 172.21.15.59:0/1319423010 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72c009a70 con 0x7ff7340a0a30 2023-09-30T22:30:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.757+0000 7ff72affd700 1 -- 172.21.15.59:0/1319423010 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff724007310 con 0x7ff7340a0a30 2023-09-30T22:30:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.757+0000 7ff73c3bf700 1 -- 172.21.15.59:0/1319423010 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff734136560 con 0x7ff7340a0a30 2023-09-30T22:30:46.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.758+0000 7ff72affd700 1 -- 172.21.15.59:0/1319423010 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff724007470 con 0x7ff7340a0a30 2023-09-30T22:30:46.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.758+0000 7ff72affd700 1 -- 172.21.15.59:0/1319423010 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff72403f380 con 0x7ff7340a0a30 2023-09-30T22:30:46.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.758+0000 7ff73c3bf700 1 -- 172.21.15.59:0/1319423010 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff734137a00 con 0x7ff7340a0a30 2023-09-30T22:30:46.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.763+0000 7ff72affd700 1 -- 172.21.15.59:0/1319423010 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7240123b0 con 0x7ff7340a0a30 2023-09-30T22:30:46.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.875+0000 7fc5ab445700 1 -- 172.21.15.59:0/1723639299 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc5a4074ea0 con 0x7fc5a4133420 2023-09-30T22:30:46.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.875+0000 7fc599ffb700 1 -- 172.21.15.59:0/1723639299 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5a001b430 con 0x7fc5a4133420 2023-09-30T22:30:46.875 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:46.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.878+0000 7fc5ab445700 1 -- 172.21.15.59:0/1723639299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5a4133420 msgr2=0x7fc5a409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.878+0000 7fc5ab445700 1 --2- 172.21.15.59:0/1723639299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5a4133420 0x7fc5a409c480 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00090b0 tx=0x7fc5a0004750 comp rx=0 tx=0).stop 2023-09-30T22:30:46.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.879+0000 7fc5ab445700 1 -- 172.21.15.59:0/1723639299 shutdown_connections 2023-09-30T22:30:46.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.879+0000 7fc5ab445700 1 --2- 172.21.15.59:0/1723639299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5a4133420 0x7fc5a409c480 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.879+0000 7fc5ab445700 1 --2- 172.21.15.59:0/1723639299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5a4134260 0x7fc5a409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.879+0000 7fc5ab445700 1 --2- 172.21.15.59:0/1723639299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5a4133e30 0x7fc5a409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.879+0000 7fc5ab445700 1 -- 172.21.15.59:0/1723639299 >> 172.21.15.59:0/1723639299 conn(0x7fc5a40a4210 msgr2=0x7fc5a4130460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:46.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.879+0000 7fc5ab445700 1 -- 172.21.15.59:0/1723639299 shutdown_connections 2023-09-30T22:30:46.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.879+0000 7fc5ab445700 1 -- 172.21.15.59:0/1723639299 wait complete. 2023-09-30T22:30:46.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:46.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.940+0000 7f89b1b81700 1 -- 172.21.15.59:0/3275664705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f89ac074ea0 con 0x7f89ac139250 2023-09-30T22:30:46.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.941+0000 7f8993fff700 1 -- 172.21.15.59:0/3275664705 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89a402a090 con 0x7f89ac139250 2023-09-30T22:30:46.941 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:46.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.943+0000 7f89b1b81700 1 -- 172.21.15.59:0/3275664705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89ac139250 msgr2=0x7f89ac123380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.943+0000 7f89b1b81700 1 --2- 172.21.15.59:0/3275664705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89ac139250 0x7f89ac123380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009e50 tx=0x7f89a400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.943+0000 7f89b1b81700 1 -- 172.21.15.59:0/3275664705 shutdown_connections 2023-09-30T22:30:46.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.943+0000 7f89b1b81700 1 --2- 172.21.15.59:0/3275664705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89ac139250 0x7f89ac123380 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.943+0000 7f89b1b81700 1 --2- 172.21.15.59:0/3275664705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89ac0a0a30 0x7f89ac122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.943+0000 7f89b1b81700 1 --2- 172.21.15.59:0/3275664705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89ac0a1510 0x7f89ac122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.943+0000 7f89b1b81700 1 -- 172.21.15.59:0/3275664705 >> 172.21.15.59:0/3275664705 conn(0x7f89ac0a6550 msgr2=0x7f89ac09ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:46.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.943+0000 7f89b1b81700 1 -- 172.21.15.59:0/3275664705 shutdown_connections 2023-09-30T22:30:46.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.943+0000 7f89b1b81700 1 -- 172.21.15.59:0/3275664705 wait complete. 2023-09-30T22:30:46.947 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:46.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:46.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.971+0000 7ff73c3bf700 1 -- 172.21.15.59:0/1319423010 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7340747f0 con 0x7ff7340a0a30 2023-09-30T22:30:46.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.972+0000 7ff72affd700 1 -- 172.21.15.59:0/1319423010 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff724011360 con 0x7ff7340a0a30 2023-09-30T22:30:46.972 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:46.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.974+0000 7ff73c3bf700 1 -- 172.21.15.59:0/1319423010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7340a0a30 msgr2=0x7ff734133bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.974+0000 7ff73c3bf700 1 --2- 172.21.15.59:0/1319423010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7340a0a30 0x7ff734133bd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff72400c520 tx=0x7ff72400c830 comp rx=0 tx=0).stop 2023-09-30T22:30:46.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.974+0000 7ff73c3bf700 1 -- 172.21.15.59:0/1319423010 shutdown_connections 2023-09-30T22:30:46.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.974+0000 7ff73c3bf700 1 --2- 172.21.15.59:0/1319423010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff734138d80 0x7ff734134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.974+0000 7ff73c3bf700 1 --2- 172.21.15.59:0/1319423010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff73409d630 0x7ff734133690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.974+0000 7ff73c3bf700 1 --2- 172.21.15.59:0/1319423010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7340a0a30 0x7ff734133bd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.974+0000 7ff73c3bf700 1 -- 172.21.15.59:0/1319423010 >> 172.21.15.59:0/1319423010 conn(0x7ff7340a3050 msgr2=0x7ff73413af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:46.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.974+0000 7ff73c3bf700 1 -- 172.21.15.59:0/1319423010 shutdown_connections 2023-09-30T22:30:46.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:46.974+0000 7ff73c3bf700 1 -- 172.21.15.59:0/1319423010 wait complete. 2023-09-30T22:30:46.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:47.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.085+0000 7f1b0d30f700 1 Processor -- start 2023-09-30T22:30:47.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.085+0000 7f1b0d30f700 1 -- start start 2023-09-30T22:30:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.086+0000 7f1b0d30f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b0809d630 0x7f1b080a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.086+0000 7f1b0d30f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b08138d80 0x7f1b0813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.086+0000 7f1b0d30f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b080a2a70 con 0x7f1b080a0a30 2023-09-30T22:30:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.086+0000 7f1b0d30f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b080a01d0 con 0x7f1b08138d80 2023-09-30T22:30:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.086+0000 7f1b0d30f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0809e2b0 con 0x7f1b0809d630 2023-09-30T22:30:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.086+0000 7f1b067fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b0809d630 0x7f1b080a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.086+0000 7f1b077fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b08138d80 0x7f1b0813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.086+0000 7f1b067fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b0809d630 0x7f1b080a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33802/0 (socket says 172.21.15.59:33802) 2023-09-30T22:30:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.086+0000 7f1b067fc700 1 -- 172.21.15.59:0/3531537546 learned_addr learned my addr 172.21.15.59:0/3531537546 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.086+0000 7f1b067fc700 1 -- 172.21.15.59:0/3531537546 >> v2:172.21.15.59:3300/0 conn(0x7f1b08138d80 msgr2=0x7f1b0813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.086+0000 7f1b067fc700 1 --2- 172.21.15.59:0/3531537546 >> v2:172.21.15.59:3300/0 conn(0x7f1b08138d80 0x7f1b0813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.086+0000 7f1b067fc700 1 -- 172.21.15.59:0/3531537546 >> v1:172.21.15.59:6789/0 conn(0x7f1b080a0a30 legacy=0x7f1b080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.086+0000 7f1b067fc700 1 -- 172.21.15.59:0/3531537546 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0809dc50 con 0x7f1b0809d630 2023-09-30T22:30:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.086+0000 7f1b077fe700 1 --2- 172.21.15.59:0/3531537546 >> v2:172.21.15.59:3300/0 conn(0x7f1b08138d80 0x7f1b0813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.087+0000 7f1b067fc700 1 --2- 172.21.15.59:0/3531537546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b0809d630 0x7f1b080a1510 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0098f0 tx=0x7f1afc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aa75b5a7822f74 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.087+0000 7f1b05ffb700 1 -- 172.21.15.59:0/3531537546 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc011830 con 0x7f1b0809d630 2023-09-30T22:30:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.087+0000 7f1b05ffb700 1 -- 172.21.15.59:0/3531537546 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc011990 con 0x7f1b0809d630 2023-09-30T22:30:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.087+0000 7f1b05ffb700 1 -- 172.21.15.59:0/3531537546 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc011d20 con 0x7f1b0809d630 2023-09-30T22:30:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.087+0000 7f1b0d30f700 1 -- 172.21.15.59:0/3531537546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b0809d630 msgr2=0x7f1b080a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.087+0000 7f1b0d30f700 1 --2- 172.21.15.59:0/3531537546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b0809d630 0x7f1b080a1510 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0098f0 tx=0x7f1afc009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.087+0000 7f1b0d30f700 1 -- 172.21.15.59:0/3531537546 shutdown_connections 2023-09-30T22:30:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.087+0000 7f1b0d30f700 1 --2- 172.21.15.59:0/3531537546 >> v2:172.21.15.59:3300/0 conn(0x7f1b08138d80 0x7f1b0813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.087+0000 7f1b0d30f700 1 --2- 172.21.15.59:0/3531537546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b0809d630 0x7f1b080a1510 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.087+0000 7f1b0d30f700 1 -- 172.21.15.59:0/3531537546 >> 172.21.15.59:0/3531537546 conn(0x7f1b080a3050 msgr2=0x7f1b080a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.087+0000 7f1b0d30f700 1 -- 172.21.15.59:0/3531537546 shutdown_connections 2023-09-30T22:30:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.088+0000 7f1b0d30f700 1 -- 172.21.15.59:0/3531537546 wait complete. 2023-09-30T22:30:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.089+0000 7f1b0d30f700 1 Processor -- start 2023-09-30T22:30:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.089+0000 7f1b0d30f700 1 -- start start 2023-09-30T22:30:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.089+0000 7f1b0d30f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b0809d630 0x7f1b08133b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.089+0000 7f1b0d30f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b080a0a30 0x7f1b08134090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.089+0000 7f1b0d30f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b08138d80 0x7f1b081345d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.089+0000 7f1b0d30f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b08135010 con 0x7f1b08138d80 2023-09-30T22:30:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.089+0000 7f1b0d30f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0813afc0 con 0x7f1b080a0a30 2023-09-30T22:30:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.089+0000 7f1b0d30f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b08135c30 con 0x7f1b0809d630 2023-09-30T22:30:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.089+0000 7f1b067fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b080a0a30 0x7f1b08134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.089+0000 7f1b077fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b08138d80 0x7f1b081345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.089+0000 7f1b067fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b080a0a30 0x7f1b08134090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33810/0 (socket says 172.21.15.59:33810) 2023-09-30T22:30:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.089+0000 7f1b067fc700 1 -- 172.21.15.59:0/4020302219 learned_addr learned my addr 172.21.15.59:0/4020302219 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.089+0000 7f1b06ffd700 1 --2- 172.21.15.59:0/4020302219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b0809d630 0x7f1b08133b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.090+0000 7f1b067fc700 1 -- 172.21.15.59:0/4020302219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b0809d630 msgr2=0x7f1b08133b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.090+0000 7f1b067fc700 1 --2- 172.21.15.59:0/4020302219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b0809d630 0x7f1b08133b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.090+0000 7f1b067fc700 1 -- 172.21.15.59:0/4020302219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b08138d80 msgr2=0x7f1b081345d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.090+0000 7f1b067fc700 1 --2- 172.21.15.59:0/4020302219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b08138d80 0x7f1b081345d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.090+0000 7f1b067fc700 1 -- 172.21.15.59:0/4020302219 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b00009a70 con 0x7f1b080a0a30 2023-09-30T22:30:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.090+0000 7f1b077fe700 1 --2- 172.21.15.59:0/4020302219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b08138d80 0x7f1b081345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.090+0000 7f1b067fc700 1 --2- 172.21.15.59:0/4020302219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b080a0a30 0x7f1b08134090 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1afc000c00 tx=0x7f1afc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.090+0000 7f1aef7fe700 1 -- 172.21.15.59:0/4020302219 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc0045d0 con 0x7f1b080a0a30 2023-09-30T22:30:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.090+0000 7f1aef7fe700 1 -- 172.21.15.59:0/4020302219 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc0036a0 con 0x7f1b080a0a30 2023-09-30T22:30:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.090+0000 7f1aef7fe700 1 -- 172.21.15.59:0/4020302219 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc003a10 con 0x7f1b080a0a30 2023-09-30T22:30:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.090+0000 7f1b0d30f700 1 -- 172.21.15.59:0/4020302219 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1afc009550 con 0x7f1b080a0a30 2023-09-30T22:30:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.090+0000 7f1b0d30f700 1 -- 172.21.15.59:0/4020302219 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b08137590 con 0x7f1b080a0a30 2023-09-30T22:30:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.091+0000 7f1aef7fe700 1 -- 172.21.15.59:0/4020302219 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1afc021070 con 0x7f1b080a0a30 2023-09-30T22:30:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.091+0000 7f1aef7fe700 1 -- 172.21.15.59:0/4020302219 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1afc040c70 con 0x7f1b080a0a30 2023-09-30T22:30:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.091+0000 7f1b0d30f700 1 -- 172.21.15.59:0/4020302219 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b080747f0 con 0x7f1b080a0a30 2023-09-30T22:30:47.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.096+0000 7f1aef7fe700 1 -- 172.21.15.59:0/4020302219 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1afc015080 con 0x7f1b080a0a30 2023-09-30T22:30:47.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.299+0000 7f1b0d30f700 1 -- 172.21.15.59:0/4020302219 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1b08072980 con 0x7f1b080a0a30 2023-09-30T22:30:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.299+0000 7f1aef7fe700 1 -- 172.21.15.59:0/4020302219 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1afc029020 con 0x7f1b080a0a30 2023-09-30T22:30:47.300 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.302+0000 7f1b0d30f700 1 -- 172.21.15.59:0/4020302219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b080a0a30 msgr2=0x7f1b08134090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.302+0000 7f1b0d30f700 1 --2- 172.21.15.59:0/4020302219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b080a0a30 0x7f1b08134090 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1afc000c00 tx=0x7f1afc004750 comp rx=0 tx=0).stop 2023-09-30T22:30:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.302+0000 7f1b0d30f700 1 -- 172.21.15.59:0/4020302219 shutdown_connections 2023-09-30T22:30:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.302+0000 7f1b0d30f700 1 --2- 172.21.15.59:0/4020302219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b0809d630 0x7f1b08133b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.302+0000 7f1b0d30f700 1 --2- 172.21.15.59:0/4020302219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b08138d80 0x7f1b081345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.302+0000 7f1b0d30f700 1 --2- 172.21.15.59:0/4020302219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b080a0a30 0x7f1b08134090 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.302+0000 7f1b0d30f700 1 -- 172.21.15.59:0/4020302219 >> 172.21.15.59:0/4020302219 conn(0x7f1b080a3050 msgr2=0x7f1b0809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.302+0000 7f1b0d30f700 1 -- 172.21.15.59:0/4020302219 shutdown_connections 2023-09-30T22:30:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:47.302+0000 7f1b0d30f700 1 -- 172.21.15.59:0/4020302219 wait complete. 2023-09-30T22:30:47.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:47.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:47.958 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:47.989 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:48.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.049+0000 7f83d70ac700 1 Processor -- start 2023-09-30T22:30:48.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.049+0000 7f83d70ac700 1 -- start start 2023-09-30T22:30:48.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.050+0000 7f83d70ac700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83d009d6f0 0x7f83d009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.050+0000 7f83d70ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009e000 0x7f83d0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.050+0000 7f83d70ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009e410 0x7f83d0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.050+0000 7f83d70ac700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d009f520 con 0x7f83d009d6f0 2023-09-30T22:30:48.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.050+0000 7f83d70ac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d009f130 con 0x7f83d009e410 2023-09-30T22:30:48.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.050+0000 7f83d70ac700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83d009e930 con 0x7f83d009e000 2023-09-30T22:30:48.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.050+0000 7f83d4e48700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83d009d6f0 0x7f83d009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.050+0000 7f83d5649700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009e410 0x7f83d0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.050+0000 7f83d4e48700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83d009d6f0 0x7f83d009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56626/0 (socket says 172.21.15.59:56626) 2023-09-30T22:30:48.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.050+0000 7f83d4e48700 1 -- 172.21.15.59:0/128868852 learned_addr learned my addr 172.21.15.59:0/128868852 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:48.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.050+0000 7f83cffff700 1 --2- 172.21.15.59:0/128868852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009e000 0x7f83d0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.051+0000 7f83cffff700 1 -- 172.21.15.59:0/128868852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009e410 msgr2=0x7f83d0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:48.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.051+0000 7f83cffff700 1 --2- 172.21.15.59:0/128868852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009e410 0x7f83d0130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.051+0000 7f83cffff700 1 -- 172.21.15.59:0/128868852 >> v2:172.21.15.59:3300/0 conn(0x7f83d009d6f0 msgr2=0x7f83d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:48.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.051+0000 7f83cffff700 1 --2- 172.21.15.59:0/128868852 >> v2:172.21.15.59:3300/0 conn(0x7f83d009d6f0 0x7f83d009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.051+0000 7f83cffff700 1 -- 172.21.15.59:0/128868852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d009b2d0 con 0x7f83d009e000 2023-09-30T22:30:48.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.051+0000 7f83d4e48700 1 --2- 172.21.15.59:0/128868852 >> v2:172.21.15.59:3300/0 conn(0x7f83d009d6f0 0x7f83d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:48.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.051+0000 7f83cffff700 1 --2- 172.21.15.59:0/128868852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009e000 0x7f83d0130660 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f83bc009870 tx=0x7f83bc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edb96fa61bbffdf7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.051+0000 7f83cf7fe700 1 -- 172.21.15.59:0/128868852 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc011830 con 0x7f83d009e000 2023-09-30T22:30:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.051+0000 7f83cf7fe700 1 -- 172.21.15.59:0/128868852 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc011990 con 0x7f83d009e000 2023-09-30T22:30:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.051+0000 7f83cf7fe700 1 -- 172.21.15.59:0/128868852 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc011d20 con 0x7f83d009e000 2023-09-30T22:30:48.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.052+0000 7f83d70ac700 1 -- 172.21.15.59:0/128868852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009e000 msgr2=0x7f83d0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.052+0000 7f83d70ac700 1 --2- 172.21.15.59:0/128868852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009e000 0x7f83d0130660 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f83bc009870 tx=0x7f83bc009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:48.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.052+0000 7f83d70ac700 1 -- 172.21.15.59:0/128868852 shutdown_connections 2023-09-30T22:30:48.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.052+0000 7f83d70ac700 1 --2- 172.21.15.59:0/128868852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009e410 0x7f83d0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.052+0000 7f83d70ac700 1 --2- 172.21.15.59:0/128868852 >> v2:172.21.15.59:3300/0 conn(0x7f83d009d6f0 0x7f83d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.052+0000 7f83d70ac700 1 --2- 172.21.15.59:0/128868852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009e000 0x7f83d0130660 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.052+0000 7f83d70ac700 1 -- 172.21.15.59:0/128868852 >> 172.21.15.59:0/128868852 conn(0x7f83d0066f50 msgr2=0x7f83d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:48.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.052+0000 7f83d70ac700 1 -- 172.21.15.59:0/128868852 shutdown_connections 2023-09-30T22:30:48.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.052+0000 7f83d70ac700 1 -- 172.21.15.59:0/128868852 wait complete. 2023-09-30T22:30:48.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.053+0000 7f83d70ac700 1 Processor -- start 2023-09-30T22:30:48.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.053+0000 7f83d70ac700 1 -- start start 2023-09-30T22:30:48.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83d70ac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d009d6f0 0x7f83d0122350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83d70ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009e000 0x7f83d0122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83d70ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009e410 0x7f83d0122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83d70ac700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d0125b90 con 0x7f83d009d6f0 2023-09-30T22:30:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83d70ac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d0124070 con 0x7f83d009e410 2023-09-30T22:30:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83d70ac700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83d009c700 con 0x7f83d009e000 2023-09-30T22:30:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83d5649700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009e410 0x7f83d0122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83cffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009e000 0x7f83d0122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83d5649700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009e410 0x7f83d0122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33836/0 (socket says 172.21.15.59:33836) 2023-09-30T22:30:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83d5649700 1 -- 172.21.15.59:0/4037936770 learned_addr learned my addr 172.21.15.59:0/4037936770 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83cffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009e000 0x7f83d0122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36350/0 (socket says 172.21.15.59:36350) 2023-09-30T22:30:48.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83d4e48700 1 --2- 172.21.15.59:0/4037936770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d009d6f0 0x7f83d0122350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83cffff700 1 -- 172.21.15.59:0/4037936770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009e410 msgr2=0x7f83d0122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83cffff700 1 --2- 172.21.15.59:0/4037936770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009e410 0x7f83d0122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83cffff700 1 -- 172.21.15.59:0/4037936770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d009d6f0 msgr2=0x7f83d0122350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83cffff700 1 --2- 172.21.15.59:0/4037936770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d009d6f0 0x7f83d0122350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83cffff700 1 -- 172.21.15.59:0/4037936770 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c400b7f0 con 0x7f83d009e000 2023-09-30T22:30:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.054+0000 7f83d4e48700 1 --2- 172.21.15.59:0/4037936770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d009d6f0 0x7f83d0122350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.055+0000 7f83cffff700 1 --2- 172.21.15.59:0/4037936770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009e000 0x7f83d0122890 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f83d009f6f0 tx=0x7f83bc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.055+0000 7f83cd7fa700 1 -- 172.21.15.59:0/4037936770 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc004450 con 0x7f83d009e000 2023-09-30T22:30:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.055+0000 7f83cd7fa700 1 -- 172.21.15.59:0/4037936770 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc01f070 con 0x7f83d009e000 2023-09-30T22:30:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.055+0000 7f83cd7fa700 1 -- 172.21.15.59:0/4037936770 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc0038c0 con 0x7f83d009e000 2023-09-30T22:30:48.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.055+0000 7f83d70ac700 1 -- 172.21.15.59:0/4037936770 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc0094a0 con 0x7f83d009e000 2023-09-30T22:30:48.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.055+0000 7f83d70ac700 1 -- 172.21.15.59:0/4037936770 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d00a1700 con 0x7f83d009e000 2023-09-30T22:30:48.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.056+0000 7f83cd7fa700 1 -- 172.21.15.59:0/4037936770 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83bc003a20 con 0x7f83d009e000 2023-09-30T22:30:48.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.056+0000 7f83cd7fa700 1 -- 172.21.15.59:0/4037936770 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f83bc021070 con 0x7f83d009e000 2023-09-30T22:30:48.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.056+0000 7f83d70ac700 1 -- 172.21.15.59:0/4037936770 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d0074ea0 con 0x7f83d009e000 2023-09-30T22:30:48.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.062+0000 7f83cd7fa700 1 -- 172.21.15.59:0/4037936770 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83bc015080 con 0x7f83d009e000 2023-09-30T22:30:48.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.101+0000 7f626b7da700 1 Processor -- start 2023-09-30T22:30:48.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.102+0000 7f626b7da700 1 -- start start 2023-09-30T22:30:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f626b7da700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62641338c0 0x7f6264133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f626b7da700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62641341d0 0x7f626409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f626b7da700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626406f720 con 0x7f626409e390 2023-09-30T22:30:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f626b7da700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6264070c80 con 0x7f62641341d0 2023-09-30T22:30:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f626b7da700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f626406fce0 con 0x7f62641338c0 2023-09-30T22:30:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f6268d75700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62641341d0 0x7f626409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f6269576700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62641338c0 0x7f6264133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f6268d75700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62641341d0 0x7f626409de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56654/0 (socket says 172.21.15.59:56654) 2023-09-30T22:30:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f6268d75700 1 -- 172.21.15.59:0/2498631182 learned_addr learned my addr 172.21.15.59:0/2498631182 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f6269576700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62641338c0 0x7f6264133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36366/0 (socket says 172.21.15.59:36366) 2023-09-30T22:30:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f6268d75700 1 -- 172.21.15.59:0/2498631182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62641338c0 msgr2=0x7f6264133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f6268d75700 1 --2- 172.21.15.59:0/2498631182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62641338c0 0x7f6264133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f6268d75700 1 -- 172.21.15.59:0/2498631182 >> v1:172.21.15.59:6789/0 conn(0x7f626409e390 legacy=0x7f626413a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f6268d75700 1 -- 172.21.15.59:0/2498631182 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62641336a0 con 0x7f62641341d0 2023-09-30T22:30:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f6269576700 1 --2- 172.21.15.59:0/2498631182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62641338c0 0x7f6264133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.103+0000 7f6268d75700 1 --2- 172.21.15.59:0/2498631182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62641341d0 0x7f626409de50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f62540098f0 tx=0x7f6254009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92aef961f066232 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.104+0000 7f625bfff700 1 -- 172.21.15.59:0/2498631182 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254011830 con 0x7f62641341d0 2023-09-30T22:30:48.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.104+0000 7f625bfff700 1 -- 172.21.15.59:0/2498631182 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6254011990 con 0x7f62641341d0 2023-09-30T22:30:48.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.104+0000 7f625bfff700 1 -- 172.21.15.59:0/2498631182 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254011d20 con 0x7f62641341d0 2023-09-30T22:30:48.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.104+0000 7f626b7da700 1 -- 172.21.15.59:0/2498631182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62641341d0 msgr2=0x7f626409de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.104+0000 7f626b7da700 1 --2- 172.21.15.59:0/2498631182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62641341d0 0x7f626409de50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f62540098f0 tx=0x7f6254009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:48.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.104+0000 7f626b7da700 1 -- 172.21.15.59:0/2498631182 shutdown_connections 2023-09-30T22:30:48.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.104+0000 7f626b7da700 1 --2- 172.21.15.59:0/2498631182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62641338c0 0x7f6264133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.104+0000 7f626b7da700 1 --2- 172.21.15.59:0/2498631182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62641341d0 0x7f626409de50 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.104+0000 7f626b7da700 1 -- 172.21.15.59:0/2498631182 >> 172.21.15.59:0/2498631182 conn(0x7f62640a2aa0 msgr2=0x7f62640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:48.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.105+0000 7f626b7da700 1 -- 172.21.15.59:0/2498631182 shutdown_connections 2023-09-30T22:30:48.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.105+0000 7f626b7da700 1 -- 172.21.15.59:0/2498631182 wait complete. 2023-09-30T22:30:48.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.106+0000 7f626b7da700 1 Processor -- start 2023-09-30T22:30:48.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.106+0000 7f626b7da700 1 -- start start 2023-09-30T22:30:48.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f626b7da700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f626409e390 0x7f626411f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f626b7da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62641338c0 0x7f626411fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f626b7da700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62641341d0 0x7f6264120430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f626b7da700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6264120e80 con 0x7f626409e390 2023-09-30T22:30:48.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f626b7da700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62641234d0 con 0x7f62641338c0 2023-09-30T22:30:48.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f626b7da700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6264121660 con 0x7f62641341d0 2023-09-30T22:30:48.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f6269576700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f626409e390 0x7f626411f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f6269576700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f626409e390 0x7f626411f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56658/0 (socket says 172.21.15.59:56658) 2023-09-30T22:30:48.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f6269576700 1 -- 172.21.15.59:0/1692291805 learned_addr learned my addr 172.21.15.59:0/1692291805 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:48.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f6269d77700 1 --2- 172.21.15.59:0/1692291805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62641341d0 0x7f6264120430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f6268d75700 1 --2- 172.21.15.59:0/1692291805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62641338c0 0x7f626411fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f6269576700 1 -- 172.21.15.59:0/1692291805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62641341d0 msgr2=0x7f6264120430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f6269576700 1 --2- 172.21.15.59:0/1692291805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62641341d0 0x7f6264120430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f6269576700 1 -- 172.21.15.59:0/1692291805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62641338c0 msgr2=0x7f626411fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f6269576700 1 --2- 172.21.15.59:0/1692291805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62641338c0 0x7f626411fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.107+0000 7f6269576700 1 -- 172.21.15.59:0/1692291805 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600094a0 con 0x7f626409e390 2023-09-30T22:30:48.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.108+0000 7f6269576700 1 --2- 172.21.15.59:0/1692291805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f626409e390 0x7f626411f9b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f626000ebe0 tx=0x7f626000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.108+0000 7f6259ffb700 1 -- 172.21.15.59:0/1692291805 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626000c850 con 0x7f626409e390 2023-09-30T22:30:48.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.108+0000 7f6259ffb700 1 -- 172.21.15.59:0/1692291805 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626000c9b0 con 0x7f626409e390 2023-09-30T22:30:48.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.108+0000 7f626b7da700 1 -- 172.21.15.59:0/1692291805 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6254009550 con 0x7f626409e390 2023-09-30T22:30:48.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.108+0000 7f6259ffb700 1 -- 172.21.15.59:0/1692291805 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626000cd40 con 0x7f626409e390 2023-09-30T22:30:48.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.108+0000 7f626b7da700 1 -- 172.21.15.59:0/1692291805 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6264122f30 con 0x7f626409e390 2023-09-30T22:30:48.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.109+0000 7f6259ffb700 1 -- 172.21.15.59:0/1692291805 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6260013470 con 0x7f626409e390 2023-09-30T22:30:48.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.109+0000 7f6259ffb700 1 -- 172.21.15.59:0/1692291805 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f626003f7c0 con 0x7f626409e390 2023-09-30T22:30:48.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.110+0000 7f626b7da700 1 -- 172.21.15.59:0/1692291805 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6264123120 con 0x7f626409e390 2023-09-30T22:30:48.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.114+0000 7f6259ffb700 1 -- 172.21.15.59:0/1692291805 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6260021080 con 0x7f626409e390 2023-09-30T22:30:48.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.144+0000 7fb789cdc700 1 Processor -- start 2023-09-30T22:30:48.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.144+0000 7fb789cdc700 1 -- start start 2023-09-30T22:30:48.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.145+0000 7fb789cdc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb78409e1d0 0x7fb784138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.145+0000 7fb789cdc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb784139170 0x7fb78413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.145+0000 7fb789cdc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78409b120 con 0x7fb78409d6f0 2023-09-30T22:30:48.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.145+0000 7fb789cdc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78406b460 con 0x7fb78409e1d0 2023-09-30T22:30:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.145+0000 7fb789cdc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb78409a7e0 con 0x7fb784139170 2023-09-30T22:30:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.145+0000 7fb7837fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb78409d6f0 0x7fb78409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60802/0 (socket says 172.21.15.59:60802) 2023-09-30T22:30:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.145+0000 7fb7837fe700 1 -- 172.21.15.59:0/447608182 learned_addr learned my addr 172.21.15.59:0/447608182 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.145+0000 7fb782ffd700 1 --2- 172.21.15.59:0/447608182 >> v2:172.21.15.59:3300/0 conn(0x7fb78409e1d0 0x7fb784138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.145+0000 7fb783fff700 1 --2- 172.21.15.59:0/447608182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb784139170 0x7fb78413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.145+0000 7fb782ffd700 1 -- 172.21.15.59:0/447608182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb784139170 msgr2=0x7fb78413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.145+0000 7fb782ffd700 1 --2- 172.21.15.59:0/447608182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb784139170 0x7fb78413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.146+0000 7fb782ffd700 1 -- 172.21.15.59:0/447608182 >> v1:172.21.15.59:6789/0 conn(0x7fb78409d6f0 legacy=0x7fb78409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.146+0000 7fb782ffd700 1 -- 172.21.15.59:0/447608182 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78409a500 con 0x7fb78409e1d0 2023-09-30T22:30:48.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.146+0000 7fb782ffd700 1 --2- 172.21.15.59:0/447608182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb78409e1d0 0x7fb784138c30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb778009870 tx=0x7fb778009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a07ab4cd2e202bd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.146+0000 7fb7827fc700 1 -- 172.21.15.59:0/447608182 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778011830 con 0x7fb78409e1d0 2023-09-30T22:30:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.146+0000 7fb7827fc700 1 -- 172.21.15.59:0/447608182 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb778011990 con 0x7fb78409e1d0 2023-09-30T22:30:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.146+0000 7fb7827fc700 1 -- 172.21.15.59:0/447608182 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778011d20 con 0x7fb78409e1d0 2023-09-30T22:30:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.147+0000 7fb789cdc700 1 -- 172.21.15.59:0/447608182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb78409e1d0 msgr2=0x7fb784138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.147+0000 7fb789cdc700 1 --2- 172.21.15.59:0/447608182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb78409e1d0 0x7fb784138c30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb778009870 tx=0x7fb778009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.147+0000 7fb789cdc700 1 -- 172.21.15.59:0/447608182 shutdown_connections 2023-09-30T22:30:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.147+0000 7fb789cdc700 1 --2- 172.21.15.59:0/447608182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb784139170 0x7fb78413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.147+0000 7fb789cdc700 1 --2- 172.21.15.59:0/447608182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb78409e1d0 0x7fb784138c30 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.147+0000 7fb789cdc700 1 -- 172.21.15.59:0/447608182 >> 172.21.15.59:0/447608182 conn(0x7fb784066f50 msgr2=0x7fb78409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.147+0000 7fb789cdc700 1 -- 172.21.15.59:0/447608182 shutdown_connections 2023-09-30T22:30:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.147+0000 7fb789cdc700 1 -- 172.21.15.59:0/447608182 wait complete. 2023-09-30T22:30:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.148+0000 7fb789cdc700 1 Processor -- start 2023-09-30T22:30:48.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.148+0000 7fb789cdc700 1 -- start start 2023-09-30T22:30:48.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.148+0000 7fb789cdc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb78409d6f0 0x7fb78411e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.148+0000 7fb789cdc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb78409e1d0 0x7fb78411edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.148+0000 7fb789cdc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb784139170 0x7fb78411f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.148+0000 7fb789cdc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7840a2b90 con 0x7fb78409d6f0 2023-09-30T22:30:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.148+0000 7fb789cdc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb784120530 con 0x7fb784139170 2023-09-30T22:30:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.148+0000 7fb789cdc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb78409c710 con 0x7fb78409e1d0 2023-09-30T22:30:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.149+0000 7fb782ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb78409e1d0 0x7fb78411edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.149+0000 7fb782ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb78409e1d0 0x7fb78411edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36396/0 (socket says 172.21.15.59:36396) 2023-09-30T22:30:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.149+0000 7fb782ffd700 1 -- 172.21.15.59:0/3911937282 learned_addr learned my addr 172.21.15.59:0/3911937282 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.149+0000 7fb783fff700 1 --2- 172.21.15.59:0/3911937282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb784139170 0x7fb78411f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.149+0000 7fb7837fe700 1 --2- 172.21.15.59:0/3911937282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb78409d6f0 0x7fb78411e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.149+0000 7fb782ffd700 1 -- 172.21.15.59:0/3911937282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb784139170 msgr2=0x7fb78411f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.149+0000 7fb782ffd700 1 --2- 172.21.15.59:0/3911937282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb784139170 0x7fb78411f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.149+0000 7fb782ffd700 1 -- 172.21.15.59:0/3911937282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb78409d6f0 msgr2=0x7fb78411e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.149+0000 7fb782ffd700 1 --2- 172.21.15.59:0/3911937282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb78409d6f0 0x7fb78411e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.149+0000 7fb782ffd700 1 -- 172.21.15.59:0/3911937282 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7780094a0 con 0x7fb78409e1d0 2023-09-30T22:30:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.149+0000 7fb782ffd700 1 --2- 172.21.15.59:0/3911937282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb78409e1d0 0x7fb78411edc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb778000c00 tx=0x7fb778004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.149+0000 7fb76bfff700 1 -- 172.21.15.59:0/3911937282 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7780036a0 con 0x7fb78409e1d0 2023-09-30T22:30:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.149+0000 7fb76bfff700 1 -- 172.21.15.59:0/3911937282 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77801f070 con 0x7fb78409e1d0 2023-09-30T22:30:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.149+0000 7fb789cdc700 1 -- 172.21.15.59:0/3911937282 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7841220c0 con 0x7fb78409e1d0 2023-09-30T22:30:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.149+0000 7fb76bfff700 1 -- 172.21.15.59:0/3911937282 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778003a60 con 0x7fb78409e1d0 2023-09-30T22:30:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.150+0000 7fb789cdc700 1 -- 172.21.15.59:0/3911937282 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb784122b30 con 0x7fb78409e1d0 2023-09-30T22:30:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.150+0000 7fb76bfff700 1 -- 172.21.15.59:0/3911937282 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb778003bc0 con 0x7fb78409e1d0 2023-09-30T22:30:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.150+0000 7fb789cdc700 1 -- 172.21.15.59:0/3911937282 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb784074ea0 con 0x7fb78409e1d0 2023-09-30T22:30:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.151+0000 7fb76bfff700 1 -- 172.21.15.59:0/3911937282 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb778021070 con 0x7fb78409e1d0 2023-09-30T22:30:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.156+0000 7fb76bfff700 1 -- 172.21.15.59:0/3911937282 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7780253e0 con 0x7fb78409e1d0 2023-09-30T22:30:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.272+0000 7f83d70ac700 1 -- 172.21.15.59:0/4037936770 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f83d006c360 con 0x7f83d009e000 2023-09-30T22:30:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.272+0000 7f83cd7fa700 1 -- 172.21.15.59:0/4037936770 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83bc02b020 con 0x7f83d009e000 2023-09-30T22:30:48.272 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:48.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.274+0000 7f83d70ac700 1 -- 172.21.15.59:0/4037936770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009e000 msgr2=0x7f83d0122890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.274+0000 7f83d70ac700 1 --2- 172.21.15.59:0/4037936770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009e000 0x7f83d0122890 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f83d009f6f0 tx=0x7f83bc004750 comp rx=0 tx=0).stop 2023-09-30T22:30:48.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.275+0000 7f83d70ac700 1 -- 172.21.15.59:0/4037936770 shutdown_connections 2023-09-30T22:30:48.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.275+0000 7f83d70ac700 1 --2- 172.21.15.59:0/4037936770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009e410 0x7f83d0122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.275+0000 7f83d70ac700 1 --2- 172.21.15.59:0/4037936770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d009d6f0 0x7f83d0122350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.275+0000 7f83d70ac700 1 --2- 172.21.15.59:0/4037936770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009e000 0x7f83d0122890 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.275+0000 7f83d70ac700 1 -- 172.21.15.59:0/4037936770 >> 172.21.15.59:0/4037936770 conn(0x7f83d0066f50 msgr2=0x7f83d0130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:48.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.275+0000 7f83d70ac700 1 -- 172.21.15.59:0/4037936770 shutdown_connections 2023-09-30T22:30:48.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.275+0000 7f83d70ac700 1 -- 172.21.15.59:0/4037936770 wait complete. 2023-09-30T22:30:48.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:48.316 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:48.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.326+0000 7f626b7da700 1 -- 172.21.15.59:0/1692291805 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6264074ea0 con 0x7f626409e390 2023-09-30T22:30:48.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.326+0000 7f6259ffb700 1 -- 172.21.15.59:0/1692291805 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6260013720 con 0x7f626409e390 2023-09-30T22:30:48.326 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:48.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.328+0000 7f626b7da700 1 -- 172.21.15.59:0/1692291805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f626409e390 msgr2=0x7f626411f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.328+0000 7f626b7da700 1 --2- 172.21.15.59:0/1692291805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f626409e390 0x7f626411f9b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f626000ebe0 tx=0x7f626000eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.329+0000 7f626b7da700 1 -- 172.21.15.59:0/1692291805 shutdown_connections 2023-09-30T22:30:48.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.329+0000 7f626b7da700 1 --2- 172.21.15.59:0/1692291805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62641341d0 0x7f6264120430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.329+0000 7f626b7da700 1 --2- 172.21.15.59:0/1692291805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f626409e390 0x7f626411f9b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.329+0000 7f626b7da700 1 --2- 172.21.15.59:0/1692291805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62641338c0 0x7f626411fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.329+0000 7f626b7da700 1 -- 172.21.15.59:0/1692291805 >> 172.21.15.59:0/1692291805 conn(0x7f62640a2aa0 msgr2=0x7f626409f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:48.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.329+0000 7f626b7da700 1 -- 172.21.15.59:0/1692291805 shutdown_connections 2023-09-30T22:30:48.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.329+0000 7f626b7da700 1 -- 172.21.15.59:0/1692291805 wait complete. 2023-09-30T22:30:48.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:48.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.365+0000 7fb789cdc700 1 -- 172.21.15.59:0/3911937282 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb78409f420 con 0x7fb78409e1d0 2023-09-30T22:30:48.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.365+0000 7fb76bfff700 1 -- 172.21.15.59:0/3911937282 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb778010b70 con 0x7fb78409e1d0 2023-09-30T22:30:48.366 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.368+0000 7fb789cdc700 1 -- 172.21.15.59:0/3911937282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb78409e1d0 msgr2=0x7fb78411edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.368+0000 7fb789cdc700 1 --2- 172.21.15.59:0/3911937282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb78409e1d0 0x7fb78411edc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb778000c00 tx=0x7fb778004750 comp rx=0 tx=0).stop 2023-09-30T22:30:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.368+0000 7fb789cdc700 1 -- 172.21.15.59:0/3911937282 shutdown_connections 2023-09-30T22:30:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.368+0000 7fb789cdc700 1 --2- 172.21.15.59:0/3911937282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb784139170 0x7fb78411f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.368+0000 7fb789cdc700 1 --2- 172.21.15.59:0/3911937282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb78409d6f0 0x7fb78411e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.368+0000 7fb789cdc700 1 --2- 172.21.15.59:0/3911937282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb78409e1d0 0x7fb78411edc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.368+0000 7fb789cdc700 1 -- 172.21.15.59:0/3911937282 >> 172.21.15.59:0/3911937282 conn(0x7fb784066f50 msgr2=0x7fb7840a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.368+0000 7fb789cdc700 1 -- 172.21.15.59:0/3911937282 shutdown_connections 2023-09-30T22:30:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.368+0000 7fb789cdc700 1 -- 172.21.15.59:0/3911937282 wait complete. 2023-09-30T22:30:48.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:48.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.457+0000 7fa77f8da700 1 Processor -- start 2023-09-30T22:30:48.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.457+0000 7fa77f8da700 1 -- start start 2023-09-30T22:30:48.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.457+0000 7fa77f8da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77806b250 0x7fa778136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.457+0000 7fa77f8da700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa778136d80 0x7fa778139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.457+0000 7fa77f8da700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77809ece0 con 0x7fa77806a770 2023-09-30T22:30:48.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.457+0000 7fa77f8da700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77806b640 con 0x7fa77806b250 2023-09-30T22:30:48.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.457+0000 7fa77f8da700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa77809e760 con 0x7fa778136d80 2023-09-30T22:30:48.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.458+0000 7fa77ce75700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77806b250 0x7fa778136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.458+0000 7fa77d676700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa77806a770 0x7fa77806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60810/0 (socket says 172.21.15.59:60810) 2023-09-30T22:30:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.458+0000 7fa77d676700 1 -- 172.21.15.59:0/4039243118 learned_addr learned my addr 172.21.15.59:0/4039243118 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.458+0000 7fa77de77700 1 --2- 172.21.15.59:0/4039243118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa778136d80 0x7fa778139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.458+0000 7fa77ce75700 1 -- 172.21.15.59:0/4039243118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa778136d80 msgr2=0x7fa778139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.458+0000 7fa77ce75700 1 --2- 172.21.15.59:0/4039243118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa778136d80 0x7fa778139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.458+0000 7fa77ce75700 1 -- 172.21.15.59:0/4039243118 >> v1:172.21.15.59:6789/0 conn(0x7fa77806a770 legacy=0x7fa77806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.458+0000 7fa76ffff700 1 -- 172.21.15.59:0/4039243118 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052440143 0 0) 0x7fa77809ece0 con 0x7fa77806a770 2023-09-30T22:30:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.458+0000 7fa77ce75700 1 -- 172.21.15.59:0/4039243118 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77809e040 con 0x7fa77806b250 2023-09-30T22:30:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.458+0000 7fa77de77700 1 --2- 172.21.15.59:0/4039243118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa778136d80 0x7fa778139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.458+0000 7fa77ce75700 1 --2- 172.21.15.59:0/4039243118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77806b250 0x7fa778136840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa768009870 tx=0x7fa768009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=265e5590dd0e57ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.458+0000 7fa76ffff700 1 -- 172.21.15.59:0/4039243118 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768011830 con 0x7fa77806b250 2023-09-30T22:30:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.458+0000 7fa76ffff700 1 -- 172.21.15.59:0/4039243118 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa768011990 con 0x7fa77806b250 2023-09-30T22:30:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.458+0000 7fa76ffff700 1 -- 172.21.15.59:0/4039243118 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768011d20 con 0x7fa77806b250 2023-09-30T22:30:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.459+0000 7fa77f8da700 1 -- 172.21.15.59:0/4039243118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77806b250 msgr2=0x7fa778136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.459+0000 7fa77f8da700 1 --2- 172.21.15.59:0/4039243118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77806b250 0x7fa778136840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa768009870 tx=0x7fa768009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:48.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.459+0000 7fa77f8da700 1 -- 172.21.15.59:0/4039243118 shutdown_connections 2023-09-30T22:30:48.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.459+0000 7fa77f8da700 1 --2- 172.21.15.59:0/4039243118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa778136d80 0x7fa778139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.459+0000 7fa77f8da700 1 --2- 172.21.15.59:0/4039243118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77806b250 0x7fa778136840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.459+0000 7fa77f8da700 1 -- 172.21.15.59:0/4039243118 >> 172.21.15.59:0/4039243118 conn(0x7fa778066f50 msgr2=0x7fa77809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:48.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.459+0000 7fa77f8da700 1 -- 172.21.15.59:0/4039243118 shutdown_connections 2023-09-30T22:30:48.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.459+0000 7fa77f8da700 1 -- 172.21.15.59:0/4039243118 wait complete. 2023-09-30T22:30:48.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.460+0000 7fa77f8da700 1 Processor -- start 2023-09-30T22:30:48.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.460+0000 7fa77f8da700 1 -- start start 2023-09-30T22:30:48.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.460+0000 7fa77f8da700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77806a770 0x7fa7781c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.460+0000 7fa77f8da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77806b250 0x7fa7781c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.460+0000 7fa77f8da700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa778136d80 0x7fa7781c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.460+0000 7fa77f8da700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa778071e60 con 0x7fa778136d80 2023-09-30T22:30:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.460+0000 7fa77f8da700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7781236c0 con 0x7fa77806b250 2023-09-30T22:30:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.460+0000 7fa77f8da700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa77809c3a0 con 0x7fa77806a770 2023-09-30T22:30:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.461+0000 7fa77ce75700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77806b250 0x7fa7781c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.461+0000 7fa77d676700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77806a770 0x7fa7781c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.461+0000 7fa77ce75700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77806b250 0x7fa7781c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33880/0 (socket says 172.21.15.59:33880) 2023-09-30T22:30:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.461+0000 7fa77ce75700 1 -- 172.21.15.59:0/3244365601 learned_addr learned my addr 172.21.15.59:0/3244365601 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.461+0000 7fa77de77700 1 --2- 172.21.15.59:0/3244365601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa778136d80 0x7fa7781c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.461+0000 7fa77ce75700 1 -- 172.21.15.59:0/3244365601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77806a770 msgr2=0x7fa7781c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.461+0000 7fa77ce75700 1 --2- 172.21.15.59:0/3244365601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77806a770 0x7fa7781c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.461+0000 7fa77ce75700 1 -- 172.21.15.59:0/3244365601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa778136d80 msgr2=0x7fa7781c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.461+0000 7fa77ce75700 1 --2- 172.21.15.59:0/3244365601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa778136d80 0x7fa7781c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.461+0000 7fa77ce75700 1 -- 172.21.15.59:0/3244365601 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa770009a70 con 0x7fa77806b250 2023-09-30T22:30:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.461+0000 7fa77ce75700 1 --2- 172.21.15.59:0/3244365601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77806b250 0x7fa7781c86e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa768009840 tx=0x7fa768004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.461+0000 7fa76dffb700 1 -- 172.21.15.59:0/3244365601 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7680044d0 con 0x7fa77806b250 2023-09-30T22:30:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.461+0000 7fa76dffb700 1 -- 172.21.15.59:0/3244365601 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76801f070 con 0x7fa77806b250 2023-09-30T22:30:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.461+0000 7fa77f8da700 1 -- 172.21.15.59:0/3244365601 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7680094a0 con 0x7fa77806b250 2023-09-30T22:30:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.461+0000 7fa76dffb700 1 -- 172.21.15.59:0/3244365601 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7680038e0 con 0x7fa77806b250 2023-09-30T22:30:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.462+0000 7fa77f8da700 1 -- 172.21.15.59:0/3244365601 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa778123d30 con 0x7fa77806b250 2023-09-30T22:30:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.462+0000 7fa76dffb700 1 -- 172.21.15.59:0/3244365601 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa768003a40 con 0x7fa77806b250 2023-09-30T22:30:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.462+0000 7fa76dffb700 1 -- 172.21.15.59:0/3244365601 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa768021070 con 0x7fa77806b250 2023-09-30T22:30:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.463+0000 7fa77f8da700 1 -- 172.21.15.59:0/3244365601 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa778074ea0 con 0x7fa77806b250 2023-09-30T22:30:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.468+0000 7fa76dffb700 1 -- 172.21.15.59:0/3244365601 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa76802b080 con 0x7fa77806b250 2023-09-30T22:30:48.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.673+0000 7fa77f8da700 1 -- 172.21.15.59:0/3244365601 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa77809f6b0 con 0x7fa77806b250 2023-09-30T22:30:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.674+0000 7fa76dffb700 1 -- 172.21.15.59:0/3244365601 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa768015020 con 0x7fa77806b250 2023-09-30T22:30:48.674 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:48.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.676+0000 7fa77f8da700 1 -- 172.21.15.59:0/3244365601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77806b250 msgr2=0x7fa7781c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.676+0000 7fa77f8da700 1 --2- 172.21.15.59:0/3244365601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77806b250 0x7fa7781c86e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa768009840 tx=0x7fa768004750 comp rx=0 tx=0).stop 2023-09-30T22:30:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.676+0000 7fa77f8da700 1 -- 172.21.15.59:0/3244365601 shutdown_connections 2023-09-30T22:30:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.676+0000 7fa77f8da700 1 --2- 172.21.15.59:0/3244365601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77806a770 0x7fa7781c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.676+0000 7fa77f8da700 1 --2- 172.21.15.59:0/3244365601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa778136d80 0x7fa7781c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.676+0000 7fa77f8da700 1 --2- 172.21.15.59:0/3244365601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77806b250 0x7fa7781c86e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.676+0000 7fa77f8da700 1 -- 172.21.15.59:0/3244365601 >> 172.21.15.59:0/3244365601 conn(0x7fa778066f50 msgr2=0x7fa7780a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.676+0000 7fa77f8da700 1 -- 172.21.15.59:0/3244365601 shutdown_connections 2023-09-30T22:30:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:48.676+0000 7fa77f8da700 1 -- 172.21.15.59:0/3244365601 wait complete. 2023-09-30T22:30:49.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:49.290 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:49.345 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:49.383 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.440+0000 7f89bda7c700 1 Processor -- start 2023-09-30T22:30:49.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.440+0000 7f89bda7c700 1 -- start start 2023-09-30T22:30:49.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89bda7c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89b809d6f0 0x7f89b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89bda7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89b809e000 0x7f89b8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89bda7c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f89b809e410 0x7f89b8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89bda7c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b809f520 con 0x7f89b809e410 2023-09-30T22:30:49.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89bda7c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b809f130 con 0x7f89b809e000 2023-09-30T22:30:49.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89bda7c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89b809e930 con 0x7f89b809d6f0 2023-09-30T22:30:49.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89b77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89b809d6f0 0x7f89b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89b77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89b809d6f0 0x7f89b809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36422/0 (socket says 172.21.15.59:36422) 2023-09-30T22:30:49.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89b77fe700 1 -- 172.21.15.59:0/318824863 learned_addr learned my addr 172.21.15.59:0/318824863 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:49.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89b6ffd700 1 --2- 172.21.15.59:0/318824863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89b809e000 0x7f89b8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89b7fff700 1 --2- 172.21.15.59:0/318824863 >> v2:172.21.15.59:3300/0 conn(0x7f89b809e410 0x7f89b8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89b77fe700 1 -- 172.21.15.59:0/318824863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89b809e000 msgr2=0x7f89b8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:49.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89b77fe700 1 --2- 172.21.15.59:0/318824863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89b809e000 0x7f89b8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89b77fe700 1 -- 172.21.15.59:0/318824863 >> v2:172.21.15.59:3300/0 conn(0x7f89b809e410 msgr2=0x7f89b8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:49.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89b77fe700 1 --2- 172.21.15.59:0/318824863 >> v2:172.21.15.59:3300/0 conn(0x7f89b809e410 0x7f89b8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.441+0000 7f89b77fe700 1 -- 172.21.15.59:0/318824863 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b809b2d0 con 0x7f89b809d6f0 2023-09-30T22:30:49.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.442+0000 7f89b77fe700 1 --2- 172.21.15.59:0/318824863 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89b809d6f0 0x7f89b809dac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009920 tx=0x7f89a8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53d044fc4d82830f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:49.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.442+0000 7f89b67fc700 1 -- 172.21.15.59:0/318824863 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8011830 con 0x7f89b809d6f0 2023-09-30T22:30:49.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.442+0000 7f89b67fc700 1 -- 172.21.15.59:0/318824863 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a8011990 con 0x7f89b809d6f0 2023-09-30T22:30:49.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.442+0000 7f89b67fc700 1 -- 172.21.15.59:0/318824863 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8011d20 con 0x7f89b809d6f0 2023-09-30T22:30:49.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.443+0000 7f89bda7c700 1 -- 172.21.15.59:0/318824863 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89b809d6f0 msgr2=0x7f89b809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.443+0000 7f89bda7c700 1 --2- 172.21.15.59:0/318824863 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89b809d6f0 0x7f89b809dac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009920 tx=0x7f89a8009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:49.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.443+0000 7f89bda7c700 1 -- 172.21.15.59:0/318824863 shutdown_connections 2023-09-30T22:30:49.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.443+0000 7f89bda7c700 1 --2- 172.21.15.59:0/318824863 >> v2:172.21.15.59:3300/0 conn(0x7f89b809e410 0x7f89b8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.443+0000 7f89bda7c700 1 --2- 172.21.15.59:0/318824863 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89b809d6f0 0x7f89b809dac0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.443+0000 7f89bda7c700 1 --2- 172.21.15.59:0/318824863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89b809e000 0x7f89b8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.443+0000 7f89bda7c700 1 -- 172.21.15.59:0/318824863 >> 172.21.15.59:0/318824863 conn(0x7f89b8066f50 msgr2=0x7f89b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.443+0000 7f89bda7c700 1 -- 172.21.15.59:0/318824863 shutdown_connections 2023-09-30T22:30:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.443+0000 7f89bda7c700 1 -- 172.21.15.59:0/318824863 wait complete. 2023-09-30T22:30:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.444+0000 7f89bda7c700 1 Processor -- start 2023-09-30T22:30:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.444+0000 7f89bda7c700 1 -- start start 2023-09-30T22:30:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.444+0000 7f89bda7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89b809d6f0 0x7f89b8120170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.444+0000 7f89bda7c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89b809e000 0x7f89b81206b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.444+0000 7f89bda7c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89b809e410 0x7f89b8120bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.444+0000 7f89bda7c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8123c90 con 0x7f89b809e000 2023-09-30T22:30:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.444+0000 7f89bda7c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b81223a0 con 0x7f89b809d6f0 2023-09-30T22:30:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.444+0000 7f89bda7c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89b809c700 con 0x7f89b809e410 2023-09-30T22:30:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.445+0000 7f89b77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89b809d6f0 0x7f89b8120170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.445+0000 7f89b77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89b809d6f0 0x7f89b8120170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33898/0 (socket says 172.21.15.59:33898) 2023-09-30T22:30:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.445+0000 7f89b77fe700 1 -- 172.21.15.59:0/1712125141 learned_addr learned my addr 172.21.15.59:0/1712125141 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.445+0000 7f89b7fff700 1 --2- 172.21.15.59:0/1712125141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89b809e410 0x7f89b8120bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.445+0000 7f89b6ffd700 1 --2- 172.21.15.59:0/1712125141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89b809e000 0x7f89b81206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.445+0000 7f89b77fe700 1 -- 172.21.15.59:0/1712125141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89b809e410 msgr2=0x7f89b8120bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.445+0000 7f89b77fe700 1 --2- 172.21.15.59:0/1712125141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89b809e410 0x7f89b8120bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.445+0000 7f89b77fe700 1 -- 172.21.15.59:0/1712125141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89b809e000 msgr2=0x7f89b81206b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.445+0000 7f89b77fe700 1 --2- 172.21.15.59:0/1712125141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89b809e000 0x7f89b81206b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.445+0000 7f89b77fe700 1 -- 172.21.15.59:0/1712125141 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a8009550 con 0x7f89b809d6f0 2023-09-30T22:30:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.445+0000 7f89b77fe700 1 --2- 172.21.15.59:0/1712125141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89b809d6f0 0x7f89b8120170 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f89a8000c00 tx=0x7f89a8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.446+0000 7f899ffff700 1 -- 172.21.15.59:0/1712125141 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8004240 con 0x7f89b809d6f0 2023-09-30T22:30:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.446+0000 7f899ffff700 1 -- 172.21.15.59:0/1712125141 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a801f070 con 0x7f89b809d6f0 2023-09-30T22:30:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.446+0000 7f89bda7c700 1 -- 172.21.15.59:0/1712125141 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b8121d80 con 0x7f89b809d6f0 2023-09-30T22:30:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.446+0000 7f899ffff700 1 -- 172.21.15.59:0/1712125141 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80036a0 con 0x7f89b809d6f0 2023-09-30T22:30:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.446+0000 7f89bda7c700 1 -- 172.21.15.59:0/1712125141 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b8124420 con 0x7f89b809d6f0 2023-09-30T22:30:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.446+0000 7f899ffff700 1 -- 172.21.15.59:0/1712125141 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89a8021030 con 0x7f89b809d6f0 2023-09-30T22:30:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.447+0000 7f89bda7c700 1 -- 172.21.15.59:0/1712125141 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b8074ea0 con 0x7f89b809d6f0 2023-09-30T22:30:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.447+0000 7f899ffff700 1 -- 172.21.15.59:0/1712125141 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f89a80407a0 con 0x7f89b809d6f0 2023-09-30T22:30:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.456+0000 7f899ffff700 1 -- 172.21.15.59:0/1712125141 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89a80239c0 con 0x7f89b809d6f0 2023-09-30T22:30:49.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.519+0000 7fa49df82700 1 Processor -- start 2023-09-30T22:30:49.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.520+0000 7fa49df82700 1 -- start start 2023-09-30T22:30:49.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.520+0000 7fa49df82700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49809e930 0x7fa49809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.520+0000 7fa49df82700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49809f240 0x7fa4981317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.520+0000 7fa49df82700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa498070940 con 0x7fa49809f650 2023-09-30T22:30:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.520+0000 7fa49df82700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49806fd60 con 0x7fa49809f240 2023-09-30T22:30:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.520+0000 7fa49df82700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa49806fa80 con 0x7fa49809e930 2023-09-30T22:30:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.520+0000 7fa4977fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49809e930 0x7fa49809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.520+0000 7fa4977fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49809e930 0x7fa49809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36450/0 (socket says 172.21.15.59:36450) 2023-09-30T22:30:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.520+0000 7fa4977fe700 1 -- 172.21.15.59:0/2275068427 learned_addr learned my addr 172.21.15.59:0/2275068427 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.520+0000 7fa48effd700 1 --2- 172.21.15.59:0/2275068427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49809f240 0x7fa4981317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.521+0000 7fa48effd700 1 -- 172.21.15.59:0/2275068427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49809e930 msgr2=0x7fa49809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.521+0000 7fa48effd700 1 --2- 172.21.15.59:0/2275068427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49809e930 0x7fa49809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.521+0000 7fa48effd700 1 -- 172.21.15.59:0/2275068427 >> v1:172.21.15.59:6789/0 conn(0x7fa49809f650 legacy=0x7fa498131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.521+0000 7fa48effd700 1 -- 172.21.15.59:0/2275068427 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49809fb60 con 0x7fa49809f240 2023-09-30T22:30:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.521+0000 7fa4977fe700 1 --2- 172.21.15.59:0/2275068427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49809e930 0x7fa49809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.521+0000 7fa48effd700 1 --2- 172.21.15.59:0/2275068427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49809f240 0x7fa4981317f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa480009870 tx=0x7fa480009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=924ecb1a9cb7a6c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.521+0000 7fa496ffd700 1 -- 172.21.15.59:0/2275068427 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480011830 con 0x7fa49809f240 2023-09-30T22:30:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.521+0000 7fa496ffd700 1 -- 172.21.15.59:0/2275068427 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa480011990 con 0x7fa49809f240 2023-09-30T22:30:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.521+0000 7fa496ffd700 1 -- 172.21.15.59:0/2275068427 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480011d20 con 0x7fa49809f240 2023-09-30T22:30:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.522+0000 7fa49df82700 1 -- 172.21.15.59:0/2275068427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49809f240 msgr2=0x7fa4981317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.522+0000 7fa49df82700 1 --2- 172.21.15.59:0/2275068427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49809f240 0x7fa4981317f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa480009870 tx=0x7fa480009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.522+0000 7fa49df82700 1 -- 172.21.15.59:0/2275068427 shutdown_connections 2023-09-30T22:30:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.522+0000 7fa49df82700 1 --2- 172.21.15.59:0/2275068427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49809e930 0x7fa49809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.522+0000 7fa49df82700 1 --2- 172.21.15.59:0/2275068427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49809f240 0x7fa4981317f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.522+0000 7fa49df82700 1 -- 172.21.15.59:0/2275068427 >> 172.21.15.59:0/2275068427 conn(0x7fa4980a4210 msgr2=0x7fa4980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.522+0000 7fa49df82700 1 -- 172.21.15.59:0/2275068427 shutdown_connections 2023-09-30T22:30:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.522+0000 7fa49df82700 1 -- 172.21.15.59:0/2275068427 wait complete. 2023-09-30T22:30:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.523+0000 7fa49df82700 1 Processor -- start 2023-09-30T22:30:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.523+0000 7fa49df82700 1 -- start start 2023-09-30T22:30:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa49df82700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49809e930 0x7fa4981a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa49df82700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49809f240 0x7fa4981a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa49df82700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49809f650 0x7fa4981a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa49df82700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4981a94c0 con 0x7fa49809e930 2023-09-30T22:30:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa49df82700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4981a79a0 con 0x7fa49809f650 2023-09-30T22:30:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa49df82700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980a3850 con 0x7fa49809f240 2023-09-30T22:30:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa48effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49809f240 0x7fa4981a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa48effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49809f240 0x7fa4981a62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36462/0 (socket says 172.21.15.59:36462) 2023-09-30T22:30:49.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa48effd700 1 -- 172.21.15.59:0/998585487 learned_addr learned my addr 172.21.15.59:0/998585487 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:49.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa497fff700 1 --2- 172.21.15.59:0/998585487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49809f650 0x7fa4981a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa4977fe700 1 --2- 172.21.15.59:0/998585487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49809e930 0x7fa4981a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa48effd700 1 -- 172.21.15.59:0/998585487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49809f650 msgr2=0x7fa4981a67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa48effd700 1 --2- 172.21.15.59:0/998585487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49809f650 0x7fa4981a67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa48effd700 1 -- 172.21.15.59:0/998585487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49809e930 msgr2=0x7fa4981a5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa48effd700 1 --2- 172.21.15.59:0/998585487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49809e930 0x7fa4981a5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa48effd700 1 -- 172.21.15.59:0/998585487 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa488009550 con 0x7fa49809f240 2023-09-30T22:30:49.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.524+0000 7fa4977fe700 1 --2- 172.21.15.59:0/998585487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49809e930 0x7fa4981a5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:49.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.525+0000 7fa48effd700 1 --2- 172.21.15.59:0/998585487 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49809f240 0x7fa4981a62a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa480009bc0 tx=0x7fa480004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:49.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.525+0000 7fa494ff9700 1 -- 172.21.15.59:0/998585487 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480004510 con 0x7fa49809f240 2023-09-30T22:30:49.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.525+0000 7fa494ff9700 1 -- 172.21.15.59:0/998585487 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48001f070 con 0x7fa49809f240 2023-09-30T22:30:49.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.525+0000 7fa49df82700 1 -- 172.21.15.59:0/998585487 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4800094a0 con 0x7fa49809f240 2023-09-30T22:30:49.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.525+0000 7fa494ff9700 1 -- 172.21.15.59:0/998585487 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4800038e0 con 0x7fa49809f240 2023-09-30T22:30:49.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.525+0000 7fa49df82700 1 -- 172.21.15.59:0/998585487 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4980a0190 con 0x7fa49809f240 2023-09-30T22:30:49.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.526+0000 7fa49df82700 1 -- 172.21.15.59:0/998585487 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4981a2b40 con 0x7fa49809f240 2023-09-30T22:30:49.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.527+0000 7fa494ff9700 1 -- 172.21.15.59:0/998585487 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa480003a40 con 0x7fa49809f240 2023-09-30T22:30:49.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.527+0000 7fa494ff9700 1 -- 172.21.15.59:0/998585487 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa480021070 con 0x7fa49809f240 2023-09-30T22:30:49.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.531+0000 7fa494ff9700 1 -- 172.21.15.59:0/998585487 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa480010380 con 0x7fa49809f240 2023-09-30T22:30:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.560+0000 7f814447a700 1 Processor -- start 2023-09-30T22:30:49.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.560+0000 7f814447a700 1 -- start start 2023-09-30T22:30:49.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.561+0000 7f814447a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f813c06c0e0 0x7f813c09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.561+0000 7f814447a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f813c134ec0 0x7f813c1379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.561+0000 7f814447a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c134980 con 0x7f813c137f20 2023-09-30T22:30:49.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.561+0000 7f814447a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c06c4b0 con 0x7f813c06c0e0 2023-09-30T22:30:49.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.561+0000 7f814447a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0a09c0 con 0x7f813c134ec0 2023-09-30T22:30:49.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.561+0000 7f8142a17700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f813c137f20 0x7f813c13ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60832/0 (socket says 172.21.15.59:60832) 2023-09-30T22:30:49.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.561+0000 7f8142a17700 1 -- 172.21.15.59:0/262670155 learned_addr learned my addr 172.21.15.59:0/262670155 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:49.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.561+0000 7f8142216700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f813c06c0e0 0x7f813c09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.561+0000 7f8141a15700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f813c134ec0 0x7f813c1379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.561+0000 7f8141214700 1 -- 172.21.15.59:0/262670155 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564191045 0 0) 0x7f813c134980 con 0x7f813c137f20 2023-09-30T22:30:49.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.561+0000 7f8141214700 1 -- 172.21.15.59:0/262670155 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81280035b0 con 0x7f813c137f20 2023-09-30T22:30:49.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.562+0000 7f8141a15700 1 -- 172.21.15.59:0/262670155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f813c06c0e0 msgr2=0x7f813c09ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:49.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.562+0000 7f8141a15700 1 --2- 172.21.15.59:0/262670155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f813c06c0e0 0x7f813c09ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.562+0000 7f8141a15700 1 -- 172.21.15.59:0/262670155 >> v1:172.21.15.59:6789/0 conn(0x7f813c137f20 legacy=0x7f813c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.562+0000 7f8141a15700 1 -- 172.21.15.59:0/262670155 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c0a0600 con 0x7f813c134ec0 2023-09-30T22:30:49.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.562+0000 7f8142216700 1 --2- 172.21.15.59:0/262670155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f813c06c0e0 0x7f813c09ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:49.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.562+0000 7f8141a15700 1 --2- 172.21.15.59:0/262670155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f813c134ec0 0x7f813c1379e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f812c0098a0 tx=0x7f812c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39a4768bd234a6e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:49.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.562+0000 7f8141214700 1 -- 172.21.15.59:0/262670155 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c011830 con 0x7f813c134ec0 2023-09-30T22:30:49.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.562+0000 7f8141214700 1 -- 172.21.15.59:0/262670155 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c011990 con 0x7f813c134ec0 2023-09-30T22:30:49.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.562+0000 7f8141214700 1 -- 172.21.15.59:0/262670155 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c011d20 con 0x7f813c134ec0 2023-09-30T22:30:49.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.563+0000 7f814447a700 1 -- 172.21.15.59:0/262670155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f813c134ec0 msgr2=0x7f813c1379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.563+0000 7f814447a700 1 --2- 172.21.15.59:0/262670155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f813c134ec0 0x7f813c1379e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f812c0098a0 tx=0x7f812c009bb0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.563+0000 7f814447a700 1 -- 172.21.15.59:0/262670155 shutdown_connections 2023-09-30T22:30:49.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.563+0000 7f814447a700 1 --2- 172.21.15.59:0/262670155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f813c06c0e0 0x7f813c09ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.563+0000 7f814447a700 1 --2- 172.21.15.59:0/262670155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f813c134ec0 0x7f813c1379e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.563+0000 7f814447a700 1 -- 172.21.15.59:0/262670155 >> 172.21.15.59:0/262670155 conn(0x7f813c0a4210 msgr2=0x7f813c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:49.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.563+0000 7f814447a700 1 -- 172.21.15.59:0/262670155 shutdown_connections 2023-09-30T22:30:49.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.563+0000 7f814447a700 1 -- 172.21.15.59:0/262670155 wait complete. 2023-09-30T22:30:49.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.564+0000 7f814447a700 1 Processor -- start 2023-09-30T22:30:49.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.564+0000 7f814447a700 1 -- start start 2023-09-30T22:30:49.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.564+0000 7f814447a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c06c0e0 0x7f813c09b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.564+0000 7f814447a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f813c134ec0 0x7f813c09b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.564+0000 7f814447a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f813c137f20 0x7f813c09beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.564+0000 7f814447a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c09dc60 con 0x7f813c06c0e0 2023-09-30T22:30:49.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.564+0000 7f814447a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c11e630 con 0x7f813c137f20 2023-09-30T22:30:49.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.564+0000 7f814447a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f813c11aac0 con 0x7f813c134ec0 2023-09-30T22:30:49.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8141a15700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f813c134ec0 0x7f813c09b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8142216700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c06c0e0 0x7f813c09b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8141a15700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f813c134ec0 0x7f813c09b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36472/0 (socket says 172.21.15.59:36472) 2023-09-30T22:30:49.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8141a15700 1 -- 172.21.15.59:0/3267009423 learned_addr learned my addr 172.21.15.59:0/3267009423 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:49.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8142216700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c06c0e0 0x7f813c09b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56722/0 (socket says 172.21.15.59:56722) 2023-09-30T22:30:49.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8142a17700 1 --2- 172.21.15.59:0/3267009423 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f813c137f20 0x7f813c09beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8142216700 1 -- 172.21.15.59:0/3267009423 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f813c134ec0 msgr2=0x7f813c09b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8142216700 1 --2- 172.21.15.59:0/3267009423 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f813c134ec0 0x7f813c09b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8142216700 1 -- 172.21.15.59:0/3267009423 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f813c137f20 msgr2=0x7f813c09beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8142216700 1 --2- 172.21.15.59:0/3267009423 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f813c137f20 0x7f813c09beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8142216700 1 -- 172.21.15.59:0/3267009423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81380094a0 con 0x7f813c06c0e0 2023-09-30T22:30:49.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8141a15700 1 --2- 172.21.15.59:0/3267009423 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f813c134ec0 0x7f813c09b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:49.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8142216700 1 --2- 172.21.15.59:0/3267009423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c06c0e0 0x7f813c09b430 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f813800e930 tx=0x7f813800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:49.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8132ffd700 1 -- 172.21.15.59:0/3267009423 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138013680 con 0x7f813c06c0e0 2023-09-30T22:30:49.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8132ffd700 1 -- 172.21.15.59:0/3267009423 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81380137e0 con 0x7f813c06c0e0 2023-09-30T22:30:49.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f814447a700 1 -- 172.21.15.59:0/3267009423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812c0094a0 con 0x7f813c06c0e0 2023-09-30T22:30:49.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.565+0000 7f8132ffd700 1 -- 172.21.15.59:0/3267009423 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138013b90 con 0x7f813c06c0e0 2023-09-30T22:30:49.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.566+0000 7f814447a700 1 -- 172.21.15.59:0/3267009423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813c0a0440 con 0x7f813c06c0e0 2023-09-30T22:30:49.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.566+0000 7f8132ffd700 1 -- 172.21.15.59:0/3267009423 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8138013cf0 con 0x7f813c06c0e0 2023-09-30T22:30:49.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.567+0000 7f8132ffd700 1 -- 172.21.15.59:0/3267009423 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f813803f620 con 0x7f813c06c0e0 2023-09-30T22:30:49.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.567+0000 7f814447a700 1 -- 172.21.15.59:0/3267009423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813c137080 con 0x7f813c06c0e0 2023-09-30T22:30:49.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.576+0000 7f8132ffd700 1 -- 172.21.15.59:0/3267009423 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f813801bc00 con 0x7f813c06c0e0 2023-09-30T22:30:49.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.667+0000 7f89bda7c700 1 -- 172.21.15.59:0/1712125141 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f89b8123830 con 0x7f89b809d6f0 2023-09-30T22:30:49.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.667+0000 7f899ffff700 1 -- 172.21.15.59:0/1712125141 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89a8015070 con 0x7f89b809d6f0 2023-09-30T22:30:49.668 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:49.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.669+0000 7f89bda7c700 1 -- 172.21.15.59:0/1712125141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89b809d6f0 msgr2=0x7f89b8120170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.669+0000 7f89bda7c700 1 --2- 172.21.15.59:0/1712125141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89b809d6f0 0x7f89b8120170 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f89a8000c00 tx=0x7f89a8004750 comp rx=0 tx=0).stop 2023-09-30T22:30:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.669+0000 7f89bda7c700 1 -- 172.21.15.59:0/1712125141 shutdown_connections 2023-09-30T22:30:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.669+0000 7f89bda7c700 1 --2- 172.21.15.59:0/1712125141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89b809e410 0x7f89b8120bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.669+0000 7f89bda7c700 1 --2- 172.21.15.59:0/1712125141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89b809d6f0 0x7f89b8120170 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.669+0000 7f89bda7c700 1 --2- 172.21.15.59:0/1712125141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89b809e000 0x7f89b81206b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.669+0000 7f89bda7c700 1 -- 172.21.15.59:0/1712125141 >> 172.21.15.59:0/1712125141 conn(0x7f89b8066f50 msgr2=0x7f89b806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.670+0000 7f89bda7c700 1 -- 172.21.15.59:0/1712125141 shutdown_connections 2023-09-30T22:30:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.670+0000 7f89bda7c700 1 -- 172.21.15.59:0/1712125141 wait complete. 2023-09-30T22:30:49.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:49.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.742+0000 7fa49df82700 1 -- 172.21.15.59:0/998585487 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa498074ea0 con 0x7fa49809f240 2023-09-30T22:30:49.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.743+0000 7fa494ff9700 1 -- 172.21.15.59:0/998585487 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa480015020 con 0x7fa49809f240 2023-09-30T22:30:49.743 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:49.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.745+0000 7fa49df82700 1 -- 172.21.15.59:0/998585487 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49809f240 msgr2=0x7fa4981a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.745+0000 7fa49df82700 1 --2- 172.21.15.59:0/998585487 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49809f240 0x7fa4981a62a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa480009bc0 tx=0x7fa480004750 comp rx=0 tx=0).stop 2023-09-30T22:30:49.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.745+0000 7fa49df82700 1 -- 172.21.15.59:0/998585487 shutdown_connections 2023-09-30T22:30:49.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.745+0000 7fa49df82700 1 --2- 172.21.15.59:0/998585487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49809f650 0x7fa4981a67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.745+0000 7fa49df82700 1 --2- 172.21.15.59:0/998585487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49809e930 0x7fa4981a5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.745+0000 7fa49df82700 1 --2- 172.21.15.59:0/998585487 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49809f240 0x7fa4981a62a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.745+0000 7fa49df82700 1 -- 172.21.15.59:0/998585487 >> 172.21.15.59:0/998585487 conn(0x7fa4980a4210 msgr2=0x7fa49809ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:49.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.745+0000 7fa49df82700 1 -- 172.21.15.59:0/998585487 shutdown_connections 2023-09-30T22:30:49.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.745+0000 7fa49df82700 1 -- 172.21.15.59:0/998585487 wait complete. 2023-09-30T22:30:49.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:49.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.781+0000 7f814447a700 1 -- 172.21.15.59:0/3267009423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f813c074ea0 con 0x7f813c06c0e0 2023-09-30T22:30:49.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.782+0000 7f8132ffd700 1 -- 172.21.15.59:0/3267009423 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8138017020 con 0x7f813c06c0e0 2023-09-30T22:30:49.782 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:49.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.784+0000 7f814447a700 1 -- 172.21.15.59:0/3267009423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c06c0e0 msgr2=0x7f813c09b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.784+0000 7f814447a700 1 --2- 172.21.15.59:0/3267009423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c06c0e0 0x7f813c09b430 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f813800e930 tx=0x7f813800ec40 comp rx=0 tx=0).stop 2023-09-30T22:30:49.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.784+0000 7f814447a700 1 -- 172.21.15.59:0/3267009423 shutdown_connections 2023-09-30T22:30:49.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.784+0000 7f814447a700 1 --2- 172.21.15.59:0/3267009423 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f813c137f20 0x7f813c09beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.784+0000 7f814447a700 1 --2- 172.21.15.59:0/3267009423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c06c0e0 0x7f813c09b430 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.784+0000 7f814447a700 1 --2- 172.21.15.59:0/3267009423 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f813c134ec0 0x7f813c09b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.784+0000 7f814447a700 1 -- 172.21.15.59:0/3267009423 >> 172.21.15.59:0/3267009423 conn(0x7f813c0a4210 msgr2=0x7f813c133c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:49.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.785+0000 7f814447a700 1 -- 172.21.15.59:0/3267009423 shutdown_connections 2023-09-30T22:30:49.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:49.785+0000 7f814447a700 1 -- 172.21.15.59:0/3267009423 wait complete. 2023-09-30T22:30:49.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:50.055 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:50.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.371+0000 7fddd42e9700 1 Processor -- start 2023-09-30T22:30:50.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.371+0000 7fddd42e9700 1 -- start start 2023-09-30T22:30:50.999 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:50.999 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:50.999 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:51.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.372+0000 7fddd42e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddcc09f410 0x7fddcc136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.372+0000 7fddd42e9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fddcc136fe0 0x7fddcc1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.372+0000 7fddd42e9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddcc070940 con 0x7fddcc09e930 2023-09-30T22:30:51.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.372+0000 7fddd42e9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc06fd60 con 0x7fddcc136fe0 2023-09-30T22:30:51.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.372+0000 7fddd42e9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc06fa80 con 0x7fddcc09f410 2023-09-30T22:30:51.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.372+0000 7fddd2085700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fddcc09e930 0x7fddcc09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60842/0 (socket says 172.21.15.59:60842) 2023-09-30T22:30:51.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.372+0000 7fddd2085700 1 -- 172.21.15.59:0/3026096405 learned_addr learned my addr 172.21.15.59:0/3026096405 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.372+0000 7fddd2886700 1 --2- 172.21.15.59:0/3026096405 >> v2:172.21.15.59:3300/0 conn(0x7fddcc136fe0 0x7fddcc1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.372+0000 7fddd1884700 1 --2- 172.21.15.59:0/3026096405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddcc09f410 0x7fddcc136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.372+0000 7fddd2886700 1 -- 172.21.15.59:0/3026096405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddcc09f410 msgr2=0x7fddcc136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.372+0000 7fddd2886700 1 --2- 172.21.15.59:0/3026096405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddcc09f410 0x7fddcc136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.372+0000 7fddd2886700 1 -- 172.21.15.59:0/3026096405 >> v1:172.21.15.59:6789/0 conn(0x7fddcc09e930 legacy=0x7fddcc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.372+0000 7fddd2886700 1 -- 172.21.15.59:0/3026096405 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc09fb60 con 0x7fddcc136fe0 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.372+0000 7fddd1884700 1 --2- 172.21.15.59:0/3026096405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddcc09f410 0x7fddcc136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.372+0000 7fddd2886700 1 --2- 172.21.15.59:0/3026096405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddcc136fe0 0x7fddcc1393c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009d90 tx=0x7fddc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1771f3561675b28f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.373+0000 7fddd1083700 1 -- 172.21.15.59:0/3026096405 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400e070 con 0x7fddcc136fe0 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.373+0000 7fddd1083700 1 -- 172.21.15.59:0/3026096405 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc400bb20 con 0x7fddcc136fe0 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.373+0000 7fddd1083700 1 -- 172.21.15.59:0/3026096405 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4012430 con 0x7fddcc136fe0 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.373+0000 7fddd42e9700 1 -- 172.21.15.59:0/3026096405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddcc136fe0 msgr2=0x7fddcc1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.373+0000 7fddd42e9700 1 --2- 172.21.15.59:0/3026096405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddcc136fe0 0x7fddcc1393c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009d90 tx=0x7fddc400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.373+0000 7fddd42e9700 1 -- 172.21.15.59:0/3026096405 shutdown_connections 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.373+0000 7fddd42e9700 1 --2- 172.21.15.59:0/3026096405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddcc136fe0 0x7fddcc1393c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.373+0000 7fddd42e9700 1 --2- 172.21.15.59:0/3026096405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddcc09f410 0x7fddcc136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.373+0000 7fddd42e9700 1 -- 172.21.15.59:0/3026096405 >> 172.21.15.59:0/3026096405 conn(0x7fddcc0a4210 msgr2=0x7fddcc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.373+0000 7fddd42e9700 1 -- 172.21.15.59:0/3026096405 shutdown_connections 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.373+0000 7fddd42e9700 1 -- 172.21.15.59:0/3026096405 wait complete. 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.374+0000 7fddd42e9700 1 Processor -- start 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.374+0000 7fddd42e9700 1 -- start start 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd42e9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddcc09e930 0x7fddcc11c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd42e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddcc09f410 0x7fddcc11cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd42e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddcc136fe0 0x7fddcc11d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd42e9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc131e70 con 0x7fddcc09e930 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd42e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc11e150 con 0x7fddcc09f410 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd42e9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc11e9e0 con 0x7fddcc136fe0 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd2085700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddcc09e930 0x7fddcc11c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd2085700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddcc09e930 0x7fddcc11c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56732/0 (socket says 172.21.15.59:56732) 2023-09-30T22:30:51.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd2085700 1 -- 172.21.15.59:0/3252970111 learned_addr learned my addr 172.21.15.59:0/3252970111 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:51.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd1884700 1 --2- 172.21.15.59:0/3252970111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddcc09f410 0x7fddcc11cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd2886700 1 --2- 172.21.15.59:0/3252970111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddcc136fe0 0x7fddcc11d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd2085700 1 -- 172.21.15.59:0/3252970111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddcc136fe0 msgr2=0x7fddcc11d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd2085700 1 --2- 172.21.15.59:0/3252970111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddcc136fe0 0x7fddcc11d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd2085700 1 -- 172.21.15.59:0/3252970111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddcc09f410 msgr2=0x7fddcc11cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd2085700 1 --2- 172.21.15.59:0/3252970111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddcc09f410 0x7fddcc11cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd2085700 1 -- 172.21.15.59:0/3252970111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc00094a0 con 0x7fddcc09e930 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd1884700 1 --2- 172.21.15.59:0/3252970111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddcc09f410 0x7fddcc11cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.375+0000 7fddd2886700 1 --2- 172.21.15.59:0/3252970111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddcc136fe0 0x7fddcc11d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.376+0000 7fddd2085700 1 --2- 172.21.15.59:0/3252970111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddcc09e930 0x7fddcc11c580 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fddc800c550 tx=0x7fddc800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.376+0000 7fddbeffd700 1 -- 172.21.15.59:0/3252970111 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8005d70 con 0x7fddcc09e930 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.376+0000 7fddbeffd700 1 -- 172.21.15.59:0/3252970111 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc80070d0 con 0x7fddcc09e930 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.376+0000 7fddd42e9700 1 -- 172.21.15.59:0/3252970111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc4009a70 con 0x7fddcc09e930 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.376+0000 7fddbeffd700 1 -- 172.21.15.59:0/3252970111 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8007440 con 0x7fddcc09e930 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.376+0000 7fddd42e9700 1 -- 172.21.15.59:0/3252970111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc132430 con 0x7fddcc09e930 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.377+0000 7fddbeffd700 1 -- 172.21.15.59:0/3252970111 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddc80075a0 con 0x7fddcc09e930 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.377+0000 7fddbeffd700 1 -- 172.21.15.59:0/3252970111 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fddc803ea00 con 0x7fddcc09e930 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.377+0000 7fddd42e9700 1 -- 172.21.15.59:0/3252970111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddcc074ea0 con 0x7fddcc09e930 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.382+0000 7fddbeffd700 1 -- 172.21.15.59:0/3252970111 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddc8019b40 con 0x7fddcc09e930 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.583+0000 7fddd42e9700 1 -- 172.21.15.59:0/3252970111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fddcc06b250 con 0x7fddcc09e930 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.584+0000 7fddbeffd700 1 -- 172.21.15.59:0/3252970111 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddc8017020 con 0x7fddcc09e930 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.586+0000 7fddd42e9700 1 -- 172.21.15.59:0/3252970111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddcc09e930 msgr2=0x7fddcc11c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.586+0000 7fddd42e9700 1 --2- 172.21.15.59:0/3252970111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddcc09e930 0x7fddcc11c580 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fddc800c550 tx=0x7fddc800c860 comp rx=0 tx=0).stop 2023-09-30T22:30:51.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.586+0000 7fddd42e9700 1 -- 172.21.15.59:0/3252970111 shutdown_connections 2023-09-30T22:30:51.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.586+0000 7fddd42e9700 1 --2- 172.21.15.59:0/3252970111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddcc136fe0 0x7fddcc11d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.586+0000 7fddd42e9700 1 --2- 172.21.15.59:0/3252970111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddcc09e930 0x7fddcc11c580 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.586+0000 7fddd42e9700 1 --2- 172.21.15.59:0/3252970111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddcc09f410 0x7fddcc11cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.586+0000 7fddd42e9700 1 -- 172.21.15.59:0/3252970111 >> 172.21.15.59:0/3252970111 conn(0x7fddcc0a4210 msgr2=0x7fddcc0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.586+0000 7fddd42e9700 1 -- 172.21.15.59:0/3252970111 shutdown_connections 2023-09-30T22:30:51.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:50.586+0000 7fddd42e9700 1 -- 172.21.15.59:0/3252970111 wait complete. 2023-09-30T22:30:51.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:51.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.239+0000 7f2bac553700 1 Processor -- start 2023-09-30T22:30:51.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.239+0000 7f2bac553700 1 -- start start 2023-09-30T22:30:51.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2bac553700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba409e930 0x7f2ba409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2bac553700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba409f650 0x7f2ba4131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2bac553700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba4070940 con 0x7f2ba409f240 2023-09-30T22:30:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2bac553700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba406fd60 con 0x7f2ba409e930 2023-09-30T22:30:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2bac553700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba406fa80 con 0x7f2ba409f650 2023-09-30T22:30:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2baa2ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba409e930 0x7f2ba409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2baa2ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba409e930 0x7f2ba409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33958/0 (socket says 172.21.15.59:33958) 2023-09-30T22:30:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2baa2ef700 1 -- 172.21.15.59:0/2816729578 learned_addr learned my addr 172.21.15.59:0/2816729578 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2baaaf0700 1 --2- 172.21.15.59:0/2816729578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba409f650 0x7f2ba4131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2ba92ed700 1 -- 172.21.15.59:0/2816729578 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400276962 0 0) 0x7f2ba4070940 con 0x7f2ba409f240 2023-09-30T22:30:51.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2ba92ed700 1 -- 172.21.15.59:0/2816729578 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b900035b0 con 0x7f2ba409f240 2023-09-30T22:30:51.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2baa2ef700 1 -- 172.21.15.59:0/2816729578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba409f650 msgr2=0x7f2ba4131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:51.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2baa2ef700 1 --2- 172.21.15.59:0/2816729578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba409f650 0x7f2ba4131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2baa2ef700 1 -- 172.21.15.59:0/2816729578 >> v1:172.21.15.59:6789/0 conn(0x7f2ba409f240 legacy=0x7f2ba41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2baa2ef700 1 -- 172.21.15.59:0/2816729578 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba409fb60 con 0x7f2ba409e930 2023-09-30T22:30:51.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.240+0000 7f2baaaf0700 1 --2- 172.21.15.59:0/2816729578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba409f650 0x7f2ba4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:51.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.241+0000 7f2baa2ef700 1 --2- 172.21.15.59:0/2816729578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba409e930 0x7f2ba409ed00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009920 tx=0x7f2ba0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfb46bf47d68c821 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.241+0000 7f2ba92ed700 1 -- 172.21.15.59:0/2816729578 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0011830 con 0x7f2ba409e930 2023-09-30T22:30:51.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.241+0000 7f2ba92ed700 1 -- 172.21.15.59:0/2816729578 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba0011990 con 0x7f2ba409e930 2023-09-30T22:30:51.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.241+0000 7f2ba92ed700 1 -- 172.21.15.59:0/2816729578 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0011d20 con 0x7f2ba409e930 2023-09-30T22:30:51.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.241+0000 7f2bac553700 1 -- 172.21.15.59:0/2816729578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba409e930 msgr2=0x7f2ba409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.241+0000 7f2bac553700 1 --2- 172.21.15.59:0/2816729578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba409e930 0x7f2ba409ed00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009920 tx=0x7f2ba0009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:51.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.242+0000 7f2bac553700 1 -- 172.21.15.59:0/2816729578 shutdown_connections 2023-09-30T22:30:51.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.242+0000 7f2bac553700 1 --2- 172.21.15.59:0/2816729578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba409f650 0x7f2ba4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.242+0000 7f2bac553700 1 --2- 172.21.15.59:0/2816729578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba409e930 0x7f2ba409ed00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.242+0000 7f2bac553700 1 -- 172.21.15.59:0/2816729578 >> 172.21.15.59:0/2816729578 conn(0x7f2ba40a4210 msgr2=0x7f2ba40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.242+0000 7f2bac553700 1 -- 172.21.15.59:0/2816729578 shutdown_connections 2023-09-30T22:30:51.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.242+0000 7f2bac553700 1 -- 172.21.15.59:0/2816729578 wait complete. 2023-09-30T22:30:51.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.243+0000 7f2bac553700 1 Processor -- start 2023-09-30T22:30:51.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.243+0000 7f2bac553700 1 -- start start 2023-09-30T22:30:51.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.243+0000 7f2bac553700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba409e930 0x7f2ba4135410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.243+0000 7f2bac553700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba409f240 0x7f2ba4135950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.243+0000 7f2bac553700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba409f650 0x7f2ba4135e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.243+0000 7f2bac553700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4137d30 con 0x7f2ba409f240 2023-09-30T22:30:51.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.243+0000 7f2bac553700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba41377c0 con 0x7f2ba409f650 2023-09-30T22:30:51.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.243+0000 7f2bac553700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40a3240 con 0x7f2ba409e930 2023-09-30T22:30:51.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2baaaf0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba409f650 0x7f2ba4135e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2baa2ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba409e930 0x7f2ba4135410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2baaaf0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba409f650 0x7f2ba4135e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33968/0 (socket says 172.21.15.59:33968) 2023-09-30T22:30:51.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2baaaf0700 1 -- 172.21.15.59:0/19996153 learned_addr learned my addr 172.21.15.59:0/19996153 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:51.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2ba9aee700 1 --2- 172.21.15.59:0/19996153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba409f240 0x7f2ba4135950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2baa2ef700 1 -- 172.21.15.59:0/19996153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba409f650 msgr2=0x7f2ba4135e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2baa2ef700 1 --2- 172.21.15.59:0/19996153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba409f650 0x7f2ba4135e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2baa2ef700 1 -- 172.21.15.59:0/19996153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba409f240 msgr2=0x7f2ba4135950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2baa2ef700 1 --2- 172.21.15.59:0/19996153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba409f240 0x7f2ba4135950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2baa2ef700 1 -- 172.21.15.59:0/19996153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c009a70 con 0x7f2ba409e930 2023-09-30T22:30:51.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2baaaf0700 1 --2- 172.21.15.59:0/19996153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba409f650 0x7f2ba4135e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:51.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2baa2ef700 1 --2- 172.21.15.59:0/19996153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba409e930 0x7f2ba4135410 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0016000 tx=0x7f2ba0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2b9affd700 1 -- 172.21.15.59:0/19996153 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0004450 con 0x7f2ba409e930 2023-09-30T22:30:51.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2b9affd700 1 -- 172.21.15.59:0/19996153 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba001f070 con 0x7f2ba409e930 2023-09-30T22:30:51.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2bac553700 1 -- 172.21.15.59:0/19996153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba0009550 con 0x7f2ba409e930 2023-09-30T22:30:51.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.244+0000 7f2b9affd700 1 -- 172.21.15.59:0/19996153 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba00038e0 con 0x7f2ba409e930 2023-09-30T22:30:51.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.245+0000 7f2bac553700 1 -- 172.21.15.59:0/19996153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba40a0190 con 0x7f2ba409e930 2023-09-30T22:30:51.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.245+0000 7f2b9affd700 1 -- 172.21.15.59:0/19996153 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ba0003a40 con 0x7f2ba409e930 2023-09-30T22:30:51.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.245+0000 7f2bac553700 1 -- 172.21.15.59:0/19996153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba40a1750 con 0x7f2ba409e930 2023-09-30T22:30:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.246+0000 7f2b9affd700 1 -- 172.21.15.59:0/19996153 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2ba0021070 con 0x7f2ba409e930 2023-09-30T22:30:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.248+0000 7ff22cbd1700 1 Processor -- start 2023-09-30T22:30:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.248+0000 7ff22cbd1700 1 -- start start 2023-09-30T22:30:51.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.248+0000 7f7e6ad14700 1 Processor -- start 2023-09-30T22:30:51.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7f7e6ad14700 1 -- start start 2023-09-30T22:30:51.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7f7e6ad14700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e6409f330 0x7f7e64138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7f7e6ad14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e641393e0 0x7f7e6413b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7f7e6ad14700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e6406bf30 con 0x7f7e6409e850 2023-09-30T22:30:51.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7f7e6ad14700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6409ffb0 con 0x7f7e6409f330 2023-09-30T22:30:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7f7e6ad14700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6406cb10 con 0x7f7e641393e0 2023-09-30T22:30:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7ff22cbd1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2281338a0 0x7ff228133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7ff22cbd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff22809e930 0x7ff22813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7ff22cbd1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22806ef30 con 0x7ff22809de50 2023-09-30T22:30:51.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7ff22cbd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22806fef0 con 0x7ff22809e930 2023-09-30T22:30:51.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7ff22cbd1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2281334b0 con 0x7ff2281338a0 2023-09-30T22:30:51.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7f7e692b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e641393e0 0x7f7e6413b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7f7e692b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e641393e0 0x7f7e6413b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36524/0 (socket says 172.21.15.59:36524) 2023-09-30T22:30:51.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7f7e692b1700 1 -- 172.21.15.59:0/549667164 learned_addr learned my addr 172.21.15.59:0/549667164 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7ff226d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff22809e930 0x7ff22813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7ff226d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff22809e930 0x7ff22813b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33982/0 (socket says 172.21.15.59:33982) 2023-09-30T22:30:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.249+0000 7ff226d9d700 1 -- 172.21.15.59:0/312745026 learned_addr learned my addr 172.21.15.59:0/312745026 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.250+0000 7ff22659c700 1 --2- 172.21.15.59:0/312745026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2281338a0 0x7ff228133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.250+0000 7ff226d9d700 1 -- 172.21.15.59:0/312745026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2281338a0 msgr2=0x7ff228133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.250+0000 7ff226d9d700 1 --2- 172.21.15.59:0/312745026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2281338a0 0x7ff228133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.250+0000 7ff226d9d700 1 -- 172.21.15.59:0/312745026 >> v1:172.21.15.59:6789/0 conn(0x7ff22809de50 legacy=0x7ff22809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:51.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.250+0000 7ff226d9d700 1 -- 172.21.15.59:0/312745026 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22806fc30 con 0x7ff22809e930 2023-09-30T22:30:51.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.250+0000 7f7e692b1700 1 -- 172.21.15.59:0/549667164 >> v2:172.21.15.59:3300/0 conn(0x7f7e6409f330 msgr2=0x7f7e64138ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:51.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.250+0000 7f7e692b1700 1 --2- 172.21.15.59:0/549667164 >> v2:172.21.15.59:3300/0 conn(0x7f7e6409f330 0x7f7e64138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.250+0000 7f7e692b1700 1 -- 172.21.15.59:0/549667164 >> v1:172.21.15.59:6789/0 conn(0x7f7e6409e850 legacy=0x7f7e6409ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:51.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.250+0000 7f7e692b1700 1 -- 172.21.15.59:0/549667164 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e640a0270 con 0x7f7e641393e0 2023-09-30T22:30:51.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.250+0000 7ff226d9d700 1 --2- 172.21.15.59:0/312745026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff22809e930 0x7ff22813b740 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff220009e80 tx=0x7ff22000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=892ec475160f0114 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.250+0000 7f7e692b1700 1 --2- 172.21.15.59:0/549667164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e641393e0 0x7f7e6413b7c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009e50 tx=0x7f7e5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9198dc664efa8a05 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.250+0000 7ff22559a700 1 -- 172.21.15.59:0/312745026 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22000e070 con 0x7ff22809e930 2023-09-30T22:30:51.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.250+0000 7ff22559a700 1 -- 172.21.15.59:0/312745026 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff220003a20 con 0x7ff22809e930 2023-09-30T22:30:51.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.250+0000 7ff22559a700 1 -- 172.21.15.59:0/312745026 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220003dd0 con 0x7ff22809e930 2023-09-30T22:30:51.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.251+0000 7f7e637fe700 1 -- 172.21.15.59:0/549667164 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00e070 con 0x7f7e641393e0 2023-09-30T22:30:51.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.251+0000 7f7e637fe700 1 -- 172.21.15.59:0/549667164 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c003a20 con 0x7f7e641393e0 2023-09-30T22:30:51.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.251+0000 7f7e637fe700 1 -- 172.21.15.59:0/549667164 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c003dd0 con 0x7f7e641393e0 2023-09-30T22:30:51.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.251+0000 7ff22cbd1700 1 -- 172.21.15.59:0/312745026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff22809e930 msgr2=0x7ff22813b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.251+0000 7ff22cbd1700 1 --2- 172.21.15.59:0/312745026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff22809e930 0x7ff22813b740 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff220009e80 tx=0x7ff22000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:51.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.251+0000 7f2b9affd700 1 -- 172.21.15.59:0/19996153 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ba00045b0 con 0x7f2ba409e930 2023-09-30T22:30:51.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.251+0000 7ff22cbd1700 1 -- 172.21.15.59:0/312745026 shutdown_connections 2023-09-30T22:30:51.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.251+0000 7ff22cbd1700 1 --2- 172.21.15.59:0/312745026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2281338a0 0x7ff228133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.251+0000 7ff22cbd1700 1 --2- 172.21.15.59:0/312745026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff22809e930 0x7ff22813b740 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.251+0000 7ff22cbd1700 1 -- 172.21.15.59:0/312745026 >> 172.21.15.59:0/312745026 conn(0x7ff2280a2aa0 msgr2=0x7ff2280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.251+0000 7ff22cbd1700 1 -- 172.21.15.59:0/312745026 shutdown_connections 2023-09-30T22:30:51.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.251+0000 7ff22cbd1700 1 -- 172.21.15.59:0/312745026 wait complete. 2023-09-30T22:30:51.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.252+0000 7f7e6ad14700 1 -- 172.21.15.59:0/549667164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e641393e0 msgr2=0x7f7e6413b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.252+0000 7f7e6ad14700 1 --2- 172.21.15.59:0/549667164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e641393e0 0x7f7e6413b7c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009e50 tx=0x7f7e5c00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:51.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.252+0000 7f7e6ad14700 1 -- 172.21.15.59:0/549667164 shutdown_connections 2023-09-30T22:30:51.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.252+0000 7f7e6ad14700 1 --2- 172.21.15.59:0/549667164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e641393e0 0x7f7e6413b7c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.252+0000 7f7e6ad14700 1 --2- 172.21.15.59:0/549667164 >> v2:172.21.15.59:3300/0 conn(0x7f7e6409f330 0x7f7e64138ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.252+0000 7f7e6ad14700 1 -- 172.21.15.59:0/549667164 >> 172.21.15.59:0/549667164 conn(0x7f7e640a3f70 msgr2=0x7f7e640a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.253+0000 7ff22cbd1700 1 Processor -- start 2023-09-30T22:30:51.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.253+0000 7f7e6ad14700 1 -- 172.21.15.59:0/549667164 shutdown_connections 2023-09-30T22:30:51.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.253+0000 7f7e6ad14700 1 -- 172.21.15.59:0/549667164 wait complete. 2023-09-30T22:30:51.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.253+0000 7ff22cbd1700 1 -- start start 2023-09-30T22:30:51.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.253+0000 7ff22cbd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff22809de50 0x7ff22811ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.253+0000 7ff22cbd1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff22809e930 0x7ff22811efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.253+0000 7ff22cbd1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2281338a0 0x7ff22811f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.253+0000 7ff22cbd1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22806f640 con 0x7ff2281338a0 2023-09-30T22:30:51.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.253+0000 7ff22cbd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2281222b0 con 0x7ff22809de50 2023-09-30T22:30:51.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.254+0000 7ff22cbd1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff22811fed0 con 0x7ff22809e930 2023-09-30T22:30:51.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.254+0000 7f7e6ad14700 1 Processor -- start 2023-09-30T22:30:51.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.254+0000 7ff225d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff22809e930 0x7ff22811efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.254+0000 7ff225d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff22809e930 0x7ff22811efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36540/0 (socket says 172.21.15.59:36540) 2023-09-30T22:30:51.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.254+0000 7ff226d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2281338a0 0x7ff22811f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.254+0000 7ff225d9b700 1 -- 172.21.15.59:0/1244618865 learned_addr learned my addr 172.21.15.59:0/1244618865 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:51.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.254+0000 7f7e6ad14700 1 -- start start 2023-09-30T22:30:51.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.254+0000 7ff22659c700 1 --2- 172.21.15.59:0/1244618865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff22809de50 0x7ff22811ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.254+0000 7ff226d9d700 1 -- 172.21.15.59:0/1244618865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff22809e930 msgr2=0x7ff22811efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.254+0000 7ff226d9d700 1 --2- 172.21.15.59:0/1244618865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff22809e930 0x7ff22811efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.254+0000 7ff226d9d700 1 -- 172.21.15.59:0/1244618865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff22809de50 msgr2=0x7ff22811ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.254+0000 7ff226d9d700 1 --2- 172.21.15.59:0/1244618865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff22809de50 0x7ff22811ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.254+0000 7ff226d9d700 1 -- 172.21.15.59:0/1244618865 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff220009b30 con 0x7ff2281338a0 2023-09-30T22:30:51.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.254+0000 7ff225d9b700 1 --2- 172.21.15.59:0/1244618865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff22809e930 0x7ff22811efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:51.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.254+0000 7ff226d9d700 1 --2- 172.21.15.59:0/1244618865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2281338a0 0x7ff22811f4f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff220014000 tx=0x7ff220004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7ff216ffd700 1 -- 172.21.15.59:0/1244618865 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220004440 con 0x7ff2281338a0 2023-09-30T22:30:51.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7ff216ffd700 1 -- 172.21.15.59:0/1244618865 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2200092e0 con 0x7ff2281338a0 2023-09-30T22:30:51.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7ff216ffd700 1 -- 172.21.15.59:0/1244618865 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220004800 con 0x7ff2281338a0 2023-09-30T22:30:51.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7ff22cbd1700 1 -- 172.21.15.59:0/1244618865 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff228120790 con 0x7ff2281338a0 2023-09-30T22:30:51.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7ff22cbd1700 1 -- 172.21.15.59:0/1244618865 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff228122d20 con 0x7ff2281338a0 2023-09-30T22:30:51.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7f7e6ad14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e6409e850 0x7f7e641c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7f7e6ad14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e6409f330 0x7f7e641c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7f7e6ad14700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e641393e0 0x7f7e6411ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7f7e6ad14700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e64122200 con 0x7f7e641393e0 2023-09-30T22:30:51.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7f7e6ad14700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e641223e0 con 0x7f7e6409e850 2023-09-30T22:30:51.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7f7e6ad14700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e641be4c0 con 0x7f7e6409f330 2023-09-30T22:30:51.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7f7e68ab0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e6409e850 0x7f7e641c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7f7e68ab0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e6409e850 0x7f7e641c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34006/0 (socket says 172.21.15.59:34006) 2023-09-30T22:30:51.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7f7e68ab0700 1 -- 172.21.15.59:0/3718112353 learned_addr learned my addr 172.21.15.59:0/3718112353 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:51.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7f7e68ab0700 1 -- 172.21.15.59:0/3718112353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e6409f330 msgr2=0x7f7e641c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7f7e68ab0700 1 --2- 172.21.15.59:0/3718112353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e6409f330 0x7f7e641c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7f7e68ab0700 1 -- 172.21.15.59:0/3718112353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e641393e0 msgr2=0x7f7e6411ea30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:51.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7f7e68ab0700 1 --2- 172.21.15.59:0/3718112353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e641393e0 0x7f7e6411ea30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.255+0000 7f7e68ab0700 1 -- 172.21.15.59:0/3718112353 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c009b30 con 0x7f7e6409e850 2023-09-30T22:30:51.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.256+0000 7f7e68ab0700 1 --2- 172.21.15.59:0/3718112353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e6409e850 0x7f7e641c8920 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7e5800c4d0 tx=0x7f7e5800c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.256+0000 7ff216ffd700 1 -- 172.21.15.59:0/1244618865 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff22001c440 con 0x7ff2281338a0 2023-09-30T22:30:51.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.256+0000 7ff22cbd1700 1 -- 172.21.15.59:0/1244618865 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2280a10c0 con 0x7ff2281338a0 2023-09-30T22:30:51.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.256+0000 7ff216ffd700 1 -- 172.21.15.59:0/1244618865 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff220040830 con 0x7ff2281338a0 2023-09-30T22:30:51.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.258+0000 7f7e617fa700 1 -- 172.21.15.59:0/3718112353 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e580054e0 con 0x7f7e6409e850 2023-09-30T22:30:51.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.258+0000 7f7e617fa700 1 -- 172.21.15.59:0/3718112353 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e58003680 con 0x7f7e6409e850 2023-09-30T22:30:51.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.258+0000 7f7e6ad14700 1 -- 172.21.15.59:0/3718112353 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6406cd30 con 0x7f7e6409e850 2023-09-30T22:30:51.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.258+0000 7f7e617fa700 1 -- 172.21.15.59:0/3718112353 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e58003a30 con 0x7f7e6409e850 2023-09-30T22:30:51.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.258+0000 7f7e6ad14700 1 -- 172.21.15.59:0/3718112353 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e64134790 con 0x7f7e6409e850 2023-09-30T22:30:51.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.259+0000 7f7e617fa700 1 -- 172.21.15.59:0/3718112353 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e58003b90 con 0x7f7e6409e850 2023-09-30T22:30:51.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.259+0000 7f7e6ad14700 1 -- 172.21.15.59:0/3718112353 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6406acf0 con 0x7f7e6409e850 2023-09-30T22:30:51.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.259+0000 7f7e617fa700 1 -- 172.21.15.59:0/3718112353 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7e5803ed00 con 0x7f7e6409e850 2023-09-30T22:30:51.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.261+0000 7ff216ffd700 1 -- 172.21.15.59:0/1244618865 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff220011390 con 0x7ff2281338a0 2023-09-30T22:30:51.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.264+0000 7f7e617fa700 1 -- 172.21.15.59:0/3718112353 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e6406acf0 con 0x7f7e6409e850 2023-09-30T22:30:51.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.460+0000 7f2bac553700 1 -- 172.21.15.59:0/19996153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2ba406d2b0 con 0x7f2ba409e930 2023-09-30T22:30:51.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.460+0000 7f2b9affd700 1 -- 172.21.15.59:0/19996153 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ba0015020 con 0x7f2ba409e930 2023-09-30T22:30:51.460 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.462+0000 7f2bac553700 1 -- 172.21.15.59:0/19996153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba409e930 msgr2=0x7f2ba4135410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.462+0000 7f2bac553700 1 --2- 172.21.15.59:0/19996153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba409e930 0x7f2ba4135410 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0016000 tx=0x7f2ba0004750 comp rx=0 tx=0).stop 2023-09-30T22:30:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.462+0000 7f2bac553700 1 -- 172.21.15.59:0/19996153 shutdown_connections 2023-09-30T22:30:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.462+0000 7f2bac553700 1 --2- 172.21.15.59:0/19996153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba409e930 0x7f2ba4135410 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.462+0000 7f2bac553700 1 --2- 172.21.15.59:0/19996153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba409f650 0x7f2ba4135e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.462+0000 7f2bac553700 1 --2- 172.21.15.59:0/19996153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba409f240 0x7f2ba4135950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.462+0000 7f2bac553700 1 -- 172.21.15.59:0/19996153 >> 172.21.15.59:0/19996153 conn(0x7f2ba40a4210 msgr2=0x7f2ba406c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.462+0000 7f2bac553700 1 -- 172.21.15.59:0/19996153 shutdown_connections 2023-09-30T22:30:51.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.462+0000 7f2bac553700 1 -- 172.21.15.59:0/19996153 wait complete. 2023-09-30T22:30:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.472+0000 7ff22cbd1700 1 -- 172.21.15.59:0/1244618865 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff228074ea0 con 0x7ff2281338a0 2023-09-30T22:30:51.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.472+0000 7ff216ffd700 1 -- 172.21.15.59:0/1244618865 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff220017030 con 0x7ff2281338a0 2023-09-30T22:30:51.472 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:51.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.473+0000 7f7e6ad14700 1 -- 172.21.15.59:0/3718112353 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7e6406acf0 con 0x7f7e6409e850 2023-09-30T22:30:51.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.473+0000 7f7e617fa700 1 -- 172.21.15.59:0/3718112353 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e6406acf0 con 0x7f7e6409e850 2023-09-30T22:30:51.473 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:51.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.474+0000 7ff22cbd1700 1 -- 172.21.15.59:0/1244618865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2281338a0 msgr2=0x7ff22811f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.474+0000 7ff22cbd1700 1 --2- 172.21.15.59:0/1244618865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2281338a0 0x7ff22811f4f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff220014000 tx=0x7ff220004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.475+0000 7ff22cbd1700 1 -- 172.21.15.59:0/1244618865 shutdown_connections 2023-09-30T22:30:51.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.475+0000 7ff22cbd1700 1 --2- 172.21.15.59:0/1244618865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2281338a0 0x7ff22811f4f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.475+0000 7ff22cbd1700 1 --2- 172.21.15.59:0/1244618865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff22809de50 0x7ff22811ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.475+0000 7ff22cbd1700 1 --2- 172.21.15.59:0/1244618865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff22809e930 0x7ff22811efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.475+0000 7ff22cbd1700 1 -- 172.21.15.59:0/1244618865 >> 172.21.15.59:0/1244618865 conn(0x7ff2280a2aa0 msgr2=0x7ff22809ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.475+0000 7ff22cbd1700 1 -- 172.21.15.59:0/1244618865 shutdown_connections 2023-09-30T22:30:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.475+0000 7ff22cbd1700 1 -- 172.21.15.59:0/1244618865 wait complete. 2023-09-30T22:30:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.476+0000 7f7e6ad14700 1 -- 172.21.15.59:0/3718112353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e6409e850 msgr2=0x7f7e641c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.476+0000 7f7e6ad14700 1 --2- 172.21.15.59:0/3718112353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e6409e850 0x7f7e641c8920 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7e5800c4d0 tx=0x7f7e5800c890 comp rx=0 tx=0).stop 2023-09-30T22:30:51.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:51.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.477+0000 7f7e6ad14700 1 -- 172.21.15.59:0/3718112353 shutdown_connections 2023-09-30T22:30:51.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.477+0000 7f7e6ad14700 1 --2- 172.21.15.59:0/3718112353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e641393e0 0x7f7e6411ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.477+0000 7f7e6ad14700 1 --2- 172.21.15.59:0/3718112353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e6409e850 0x7f7e641c8920 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.477+0000 7f7e6ad14700 1 --2- 172.21.15.59:0/3718112353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e6409f330 0x7f7e641c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.477+0000 7f7e6ad14700 1 -- 172.21.15.59:0/3718112353 >> 172.21.15.59:0/3718112353 conn(0x7f7e640a3f70 msgr2=0x7f7e64071000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.477+0000 7f7e6ad14700 1 -- 172.21.15.59:0/3718112353 shutdown_connections 2023-09-30T22:30:51.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:51.477+0000 7f7e6ad14700 1 -- 172.21.15.59:0/3718112353 wait complete. 2023-09-30T22:30:51.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:51.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:52.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.198+0000 7fa2b4423700 1 Processor -- start 2023-09-30T22:30:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.198+0000 7fa2b4423700 1 -- start start 2023-09-30T22:30:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b4423700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac09f410 0x7fa2ac136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b4423700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa2ac136fe0 0x7fa2ac1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b4423700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac070940 con 0x7fa2ac09e930 2023-09-30T22:30:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b4423700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac06fd60 con 0x7fa2ac136fe0 2023-09-30T22:30:52.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b4423700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac06fa80 con 0x7fa2ac09f410 2023-09-30T22:30:52.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b29c0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa2ac136fe0 0x7fa2ac1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b19be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac09f410 0x7fa2ac136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b29c0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa2ac136fe0 0x7fa2ac1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56776/0 (socket says 172.21.15.59:56776) 2023-09-30T22:30:52.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b19be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac09f410 0x7fa2ac136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36560/0 (socket says 172.21.15.59:36560) 2023-09-30T22:30:52.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b29c0700 1 -- 172.21.15.59:0/937974835 learned_addr learned my addr 172.21.15.59:0/937974835 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:52.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b29c0700 1 -- 172.21.15.59:0/937974835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac09f410 msgr2=0x7fa2ac136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:52.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b29c0700 1 --2- 172.21.15.59:0/937974835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac09f410 0x7fa2ac136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b29c0700 1 -- 172.21.15.59:0/937974835 >> v1:172.21.15.59:6789/0 conn(0x7fa2ac09e930 legacy=0x7fa2ac09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b29c0700 1 -- 172.21.15.59:0/937974835 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac09fb60 con 0x7fa2ac136fe0 2023-09-30T22:30:52.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b29c0700 1 --2- 172.21.15.59:0/937974835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac136fe0 0x7fa2ac1393c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009e50 tx=0x7fa2a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71435e0bb69ace3f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.199+0000 7fa2b11bd700 1 -- 172.21.15.59:0/937974835 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a400e070 con 0x7fa2ac136fe0 2023-09-30T22:30:52.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.200+0000 7fa2b11bd700 1 -- 172.21.15.59:0/937974835 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a400b910 con 0x7fa2ac136fe0 2023-09-30T22:30:52.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.200+0000 7fa2b11bd700 1 -- 172.21.15.59:0/937974835 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a400bcc0 con 0x7fa2ac136fe0 2023-09-30T22:30:52.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.200+0000 7fa2b4423700 1 -- 172.21.15.59:0/937974835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac136fe0 msgr2=0x7fa2ac1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.200+0000 7fa2b4423700 1 --2- 172.21.15.59:0/937974835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac136fe0 0x7fa2ac1393c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009e50 tx=0x7fa2a400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:52.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.200+0000 7fa2b4423700 1 -- 172.21.15.59:0/937974835 shutdown_connections 2023-09-30T22:30:52.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.200+0000 7fa2b4423700 1 --2- 172.21.15.59:0/937974835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac136fe0 0x7fa2ac1393c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.200+0000 7fa2b4423700 1 --2- 172.21.15.59:0/937974835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac09f410 0x7fa2ac136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.200+0000 7fa2b4423700 1 -- 172.21.15.59:0/937974835 >> 172.21.15.59:0/937974835 conn(0x7fa2ac0a4210 msgr2=0x7fa2ac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.200+0000 7fa2b4423700 1 -- 172.21.15.59:0/937974835 shutdown_connections 2023-09-30T22:30:52.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.200+0000 7fa2b4423700 1 -- 172.21.15.59:0/937974835 wait complete. 2023-09-30T22:30:52.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.201+0000 7fa2b4423700 1 Processor -- start 2023-09-30T22:30:52.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.201+0000 7fa2b4423700 1 -- start start 2023-09-30T22:30:52.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b4423700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac09e930 0x7fa2ac1c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b4423700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac09f410 0x7fa2ac1c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b4423700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac136fe0 0x7fa2ac06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b4423700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac124000 con 0x7fa2ac09f410 2023-09-30T22:30:52.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b4423700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac1bc0c0 con 0x7fa2ac09e930 2023-09-30T22:30:52.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b4423700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac134370 con 0x7fa2ac136fe0 2023-09-30T22:30:52.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b19be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac09f410 0x7fa2ac1c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b19be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac09f410 0x7fa2ac1c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56784/0 (socket says 172.21.15.59:56784) 2023-09-30T22:30:52.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b19be700 1 -- 172.21.15.59:0/165202259 learned_addr learned my addr 172.21.15.59:0/165202259 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:52.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b21bf700 1 --2- 172.21.15.59:0/165202259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac09e930 0x7fa2ac1c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b29c0700 1 --2- 172.21.15.59:0/165202259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac136fe0 0x7fa2ac06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b19be700 1 -- 172.21.15.59:0/165202259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac136fe0 msgr2=0x7fa2ac06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b19be700 1 --2- 172.21.15.59:0/165202259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac136fe0 0x7fa2ac06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b19be700 1 -- 172.21.15.59:0/165202259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac09e930 msgr2=0x7fa2ac1c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b19be700 1 --2- 172.21.15.59:0/165202259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac09e930 0x7fa2ac1c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b19be700 1 -- 172.21.15.59:0/165202259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a4009b30 con 0x7fa2ac09f410 2023-09-30T22:30:52.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.202+0000 7fa2b19be700 1 --2- 172.21.15.59:0/165202259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac09f410 0x7fa2ac1c8a80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000e9b0 tx=0x7fa2a000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.203+0000 7fa29effd700 1 -- 172.21.15.59:0/165202259 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0009710 con 0x7fa2ac09f410 2023-09-30T22:30:52.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.203+0000 7fa29effd700 1 -- 172.21.15.59:0/165202259 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a000ee50 con 0x7fa2ac09f410 2023-09-30T22:30:52.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.203+0000 7fa2b4423700 1 -- 172.21.15.59:0/165202259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac1229a0 con 0x7fa2ac09f410 2023-09-30T22:30:52.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.203+0000 7fa29effd700 1 -- 172.21.15.59:0/165202259 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a000c9f0 con 0x7fa2ac09f410 2023-09-30T22:30:52.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.203+0000 7fa2b4423700 1 -- 172.21.15.59:0/165202259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac06d4c0 con 0x7fa2ac09f410 2023-09-30T22:30:52.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.203+0000 7fa29effd700 1 -- 172.21.15.59:0/165202259 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2a000cb50 con 0x7fa2ac09f410 2023-09-30T22:30:52.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.204+0000 7fa2b4423700 1 -- 172.21.15.59:0/165202259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac123ca0 con 0x7fa2ac09f410 2023-09-30T22:30:52.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.204+0000 7fa29effd700 1 -- 172.21.15.59:0/165202259 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa2a003f760 con 0x7fa2ac09f410 2023-09-30T22:30:52.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.208+0000 7fa29effd700 1 -- 172.21.15.59:0/165202259 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2a00232f0 con 0x7fa2ac09f410 2023-09-30T22:30:52.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.416+0000 7fa2b4423700 1 -- 172.21.15.59:0/165202259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa2ac124140 con 0x7fa2ac09f410 2023-09-30T22:30:52.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.416+0000 7fa29effd700 1 -- 172.21.15.59:0/165202259 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2ac124140 con 0x7fa2ac09f410 2023-09-30T22:30:52.416 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:52.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.418+0000 7fa2b4423700 1 -- 172.21.15.59:0/165202259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac09f410 msgr2=0x7fa2ac1c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.418+0000 7fa2b4423700 1 --2- 172.21.15.59:0/165202259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac09f410 0x7fa2ac1c8a80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000e9b0 tx=0x7fa2a000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.419+0000 7fa2b4423700 1 -- 172.21.15.59:0/165202259 shutdown_connections 2023-09-30T22:30:52.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.419+0000 7fa2b4423700 1 --2- 172.21.15.59:0/165202259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2ac136fe0 0x7fa2ac06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.419+0000 7fa2b4423700 1 --2- 172.21.15.59:0/165202259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2ac09e930 0x7fa2ac1c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.419+0000 7fa2b4423700 1 --2- 172.21.15.59:0/165202259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2ac09f410 0x7fa2ac1c8a80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.419+0000 7fa2b4423700 1 -- 172.21.15.59:0/165202259 >> 172.21.15.59:0/165202259 conn(0x7fa2ac0a4210 msgr2=0x7fa2ac0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.419+0000 7fa2b4423700 1 -- 172.21.15.59:0/165202259 shutdown_connections 2023-09-30T22:30:52.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.419+0000 7fa2b4423700 1 -- 172.21.15.59:0/165202259 wait complete. 2023-09-30T22:30:52.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:52.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:52.491 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:52.492 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:52.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.631+0000 7f595df5c700 1 Processor -- start 2023-09-30T22:30:52.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.632+0000 7f595df5c700 1 -- start start 2023-09-30T22:30:52.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.632+0000 7f595df5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f595809d6f0 0x7f595809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.632+0000 7f595df5c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f595809e000 0x7f5958130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.632+0000 7f595df5c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595809f130 con 0x7f595809e410 2023-09-30T22:30:52.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.632+0000 7f595df5c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595809f520 con 0x7f595809e000 2023-09-30T22:30:52.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.632+0000 7f595df5c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f595809e930 con 0x7f595809d6f0 2023-09-30T22:30:52.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.633+0000 7f5956ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f595809e000 0x7f5958130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.633+0000 7f59577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f595809d6f0 0x7f595809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.633+0000 7f5956ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f595809e000 0x7f5958130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56790/0 (socket says 172.21.15.59:56790) 2023-09-30T22:30:52.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.633+0000 7f59577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f595809d6f0 0x7f595809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36574/0 (socket says 172.21.15.59:36574) 2023-09-30T22:30:52.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.633+0000 7f5956ffd700 1 -- 172.21.15.59:0/90841876 learned_addr learned my addr 172.21.15.59:0/90841876 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.633+0000 7f5956ffd700 1 -- 172.21.15.59:0/90841876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f595809d6f0 msgr2=0x7f595809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.633+0000 7f5956ffd700 1 --2- 172.21.15.59:0/90841876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f595809d6f0 0x7f595809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.633+0000 7f5956ffd700 1 -- 172.21.15.59:0/90841876 >> v1:172.21.15.59:6789/0 conn(0x7f595809e410 legacy=0x7f5958130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.633+0000 7f5956ffd700 1 -- 172.21.15.59:0/90841876 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595809b2d0 con 0x7f595809e000 2023-09-30T22:30:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.633+0000 7f59567fc700 1 -- 172.21.15.59:0/90841876 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614811047 0 0) 0x7f595809f130 con 0x7f595809e410 2023-09-30T22:30:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.633+0000 7f59577fe700 1 --2- 172.21.15.59:0/90841876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f595809d6f0 0x7f595809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.633+0000 7f5956ffd700 1 --2- 172.21.15.59:0/90841876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f595809e000 0x7f5958130660 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f594c0098f0 tx=0x7f594c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75629cef650c244 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.634+0000 7f59567fc700 1 -- 172.21.15.59:0/90841876 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c011830 con 0x7f595809e000 2023-09-30T22:30:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.634+0000 7f59567fc700 1 -- 172.21.15.59:0/90841876 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c011990 con 0x7f595809e000 2023-09-30T22:30:52.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.634+0000 7f59567fc700 1 -- 172.21.15.59:0/90841876 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c011d20 con 0x7f595809e000 2023-09-30T22:30:52.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.634+0000 7f595df5c700 1 -- 172.21.15.59:0/90841876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f595809e000 msgr2=0x7f5958130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.634+0000 7f595df5c700 1 --2- 172.21.15.59:0/90841876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f595809e000 0x7f5958130660 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f594c0098f0 tx=0x7f594c009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:52.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.634+0000 7f595df5c700 1 -- 172.21.15.59:0/90841876 shutdown_connections 2023-09-30T22:30:52.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.634+0000 7f595df5c700 1 --2- 172.21.15.59:0/90841876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f595809d6f0 0x7f595809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.634+0000 7f595df5c700 1 --2- 172.21.15.59:0/90841876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f595809e000 0x7f5958130660 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.634+0000 7f595df5c700 1 -- 172.21.15.59:0/90841876 >> 172.21.15.59:0/90841876 conn(0x7f5958066f50 msgr2=0x7f595809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.634+0000 7f595df5c700 1 -- 172.21.15.59:0/90841876 shutdown_connections 2023-09-30T22:30:52.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.634+0000 7f595df5c700 1 -- 172.21.15.59:0/90841876 wait complete. 2023-09-30T22:30:52.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.635+0000 7f595df5c700 1 Processor -- start 2023-09-30T22:30:52.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.636+0000 7f595df5c700 1 -- start start 2023-09-30T22:30:52.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.636+0000 7f595df5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f595809d6f0 0x7f59581223d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f595df5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f595809e000 0x7f5958122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f595df5c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f595809e410 0x7f5958122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f595df5c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958125ef0 con 0x7f595809e410 2023-09-30T22:30:52.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f595df5c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5958123fe0 con 0x7f595809e000 2023-09-30T22:30:52.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f595df5c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5958072620 con 0x7f595809d6f0 2023-09-30T22:30:52.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f59577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f595809d6f0 0x7f59581223d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f5956ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f595809e000 0x7f5958122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f59577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f595809d6f0 0x7f59581223d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36590/0 (socket says 172.21.15.59:36590) 2023-09-30T22:30:52.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f59577fe700 1 -- 172.21.15.59:0/3833455027 learned_addr learned my addr 172.21.15.59:0/3833455027 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:52.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f5957fff700 1 --2- 172.21.15.59:0/3833455027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f595809e410 0x7f5958122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f59577fe700 1 -- 172.21.15.59:0/3833455027 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f595809e000 msgr2=0x7f5958122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f59577fe700 1 --2- 172.21.15.59:0/3833455027 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f595809e000 0x7f5958122910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f59577fe700 1 -- 172.21.15.59:0/3833455027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f595809e410 msgr2=0x7f5958122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f59577fe700 1 --2- 172.21.15.59:0/3833455027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f595809e410 0x7f5958122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f59577fe700 1 -- 172.21.15.59:0/3833455027 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59480094a0 con 0x7f595809d6f0 2023-09-30T22:30:52.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f5956ffd700 1 --2- 172.21.15.59:0/3833455027 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f595809e000 0x7f5958122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:52.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.637+0000 7f59577fe700 1 --2- 172.21.15.59:0/3833455027 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f595809d6f0 0x7f59581223d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f594800ebe0 tx=0x7f594800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.638+0000 7f593ffff700 1 -- 172.21.15.59:0/3833455027 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948009760 con 0x7f595809d6f0 2023-09-30T22:30:52.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.638+0000 7f593ffff700 1 -- 172.21.15.59:0/3833455027 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594800c850 con 0x7f595809d6f0 2023-09-30T22:30:52.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.638+0000 7f595df5c700 1 -- 172.21.15.59:0/3833455027 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594c009550 con 0x7f595809d6f0 2023-09-30T22:30:52.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.638+0000 7f593ffff700 1 -- 172.21.15.59:0/3833455027 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594800cbe0 con 0x7f595809d6f0 2023-09-30T22:30:52.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.638+0000 7f595df5c700 1 -- 172.21.15.59:0/3833455027 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59581237c0 con 0x7f595809d6f0 2023-09-30T22:30:52.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.639+0000 7f593ffff700 1 -- 172.21.15.59:0/3833455027 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f594800cd40 con 0x7f595809d6f0 2023-09-30T22:30:52.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.639+0000 7f595df5c700 1 -- 172.21.15.59:0/3833455027 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595804ea50 con 0x7f595809d6f0 2023-09-30T22:30:52.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.639+0000 7f593ffff700 1 -- 172.21.15.59:0/3833455027 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f594803fae0 con 0x7f595809d6f0 2023-09-30T22:30:52.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.644+0000 7f593ffff700 1 -- 172.21.15.59:0/3833455027 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f594801b3b0 con 0x7f595809d6f0 2023-09-30T22:30:52.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.666+0000 7f0358866700 1 Processor -- start 2023-09-30T22:30:52.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.666+0000 7f0358866700 1 -- start start 2023-09-30T22:30:52.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.667+0000 7f0358866700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f035412cf60 0x7f035406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.667+0000 7f0358866700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0354130430 0x7f0354137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.667+0000 7f0358866700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035412cd90 con 0x7f035412f8b0 2023-09-30T22:30:52.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.667+0000 7f0358866700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035412d330 con 0x7f0354130430 2023-09-30T22:30:52.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.667+0000 7f0358866700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0354071780 con 0x7f035412cf60 2023-09-30T22:30:52.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.667+0000 7f035259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f035412cf60 0x7f035406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.667+0000 7f035259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f035412cf60 0x7f035406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36606/0 (socket says 172.21.15.59:36606) 2023-09-30T22:30:52.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.667+0000 7f035259c700 1 -- 172.21.15.59:0/156708264 learned_addr learned my addr 172.21.15.59:0/156708264 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:52.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.667+0000 7f0352d9d700 1 --2- 172.21.15.59:0/156708264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0354130430 0x7f0354137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.667+0000 7f035259c700 1 -- 172.21.15.59:0/156708264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0354130430 msgr2=0x7f0354137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:52.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.667+0000 7f035259c700 1 --2- 172.21.15.59:0/156708264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0354130430 0x7f0354137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.667+0000 7f035259c700 1 -- 172.21.15.59:0/156708264 >> v1:172.21.15.59:6789/0 conn(0x7f035412f8b0 legacy=0x7f035412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.667+0000 7f035159a700 1 -- 172.21.15.59:0/156708264 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990342986 0 0) 0x7f035412cd90 con 0x7f035412f8b0 2023-09-30T22:30:52.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.667+0000 7f035259c700 1 -- 172.21.15.59:0/156708264 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0354071a40 con 0x7f035412cf60 2023-09-30T22:30:52.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.668+0000 7f035259c700 1 --2- 172.21.15.59:0/156708264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f035412cf60 0x7f035406f5d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0344009920 tx=0x7f0344009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19e5f09926967517 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.668+0000 7f035159a700 1 -- 172.21.15.59:0/156708264 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0344011830 con 0x7f035412cf60 2023-09-30T22:30:52.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.668+0000 7f035159a700 1 -- 172.21.15.59:0/156708264 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0344011990 con 0x7f035412cf60 2023-09-30T22:30:52.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.668+0000 7f035159a700 1 -- 172.21.15.59:0/156708264 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0344011d20 con 0x7f035412cf60 2023-09-30T22:30:52.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.668+0000 7f0358866700 1 -- 172.21.15.59:0/156708264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f035412cf60 msgr2=0x7f035406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.668+0000 7f0358866700 1 --2- 172.21.15.59:0/156708264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f035412cf60 0x7f035406f5d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0344009920 tx=0x7f0344009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:52.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.669+0000 7f0358866700 1 -- 172.21.15.59:0/156708264 shutdown_connections 2023-09-30T22:30:52.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.669+0000 7f0358866700 1 --2- 172.21.15.59:0/156708264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f035412cf60 0x7f035406f5d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.669+0000 7f0358866700 1 --2- 172.21.15.59:0/156708264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0354130430 0x7f0354137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.669+0000 7f0358866700 1 -- 172.21.15.59:0/156708264 >> 172.21.15.59:0/156708264 conn(0x7f03540a2aa0 msgr2=0x7f03540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.669+0000 7f0358866700 1 -- 172.21.15.59:0/156708264 shutdown_connections 2023-09-30T22:30:52.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.669+0000 7f0358866700 1 -- 172.21.15.59:0/156708264 wait complete. 2023-09-30T22:30:52.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.670+0000 7f0358866700 1 Processor -- start 2023-09-30T22:30:52.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.670+0000 7f0358866700 1 -- start start 2023-09-30T22:30:52.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f0358866700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f035412cf60 0x7f03541309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f0358866700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f035412f8b0 0x7f0354130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f0358866700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0354130430 0x7f0354131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f0358866700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035409eaa0 con 0x7f035412f8b0 2023-09-30T22:30:52.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f0358866700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0354133200 con 0x7f0354130430 2023-09-30T22:30:52.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f0358866700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0354131dc0 con 0x7f035412cf60 2023-09-30T22:30:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f035259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f035412cf60 0x7f03541309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f035259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f035412cf60 0x7f03541309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36614/0 (socket says 172.21.15.59:36614) 2023-09-30T22:30:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f035259c700 1 -- 172.21.15.59:0/1046844890 learned_addr learned my addr 172.21.15.59:0/1046844890 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f0351d9b700 1 --2- 172.21.15.59:0/1046844890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f035412f8b0 0x7f0354130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f0352d9d700 1 --2- 172.21.15.59:0/1046844890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0354130430 0x7f0354131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f035259c700 1 -- 172.21.15.59:0/1046844890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0354130430 msgr2=0x7f0354131460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f035259c700 1 --2- 172.21.15.59:0/1046844890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0354130430 0x7f0354131460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f035259c700 1 -- 172.21.15.59:0/1046844890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f035412f8b0 msgr2=0x7f0354130f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f035259c700 1 --2- 172.21.15.59:0/1046844890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f035412f8b0 0x7f0354130f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f035259c700 1 -- 172.21.15.59:0/1046844890 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344009550 con 0x7f035412cf60 2023-09-30T22:30:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.671+0000 7f035259c700 1 --2- 172.21.15.59:0/1046844890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f035412cf60 0x7f03541309e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0344009130 tx=0x7f0344004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.672+0000 7f0342ffd700 1 -- 172.21.15.59:0/1046844890 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0344004450 con 0x7f035412cf60 2023-09-30T22:30:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.672+0000 7f0342ffd700 1 -- 172.21.15.59:0/1046844890 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034401f070 con 0x7f035412cf60 2023-09-30T22:30:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.672+0000 7f0358866700 1 -- 172.21.15.59:0/1046844890 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0354131b30 con 0x7f035412cf60 2023-09-30T22:30:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.672+0000 7f0342ffd700 1 -- 172.21.15.59:0/1046844890 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03440038c0 con 0x7f035412cf60 2023-09-30T22:30:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.672+0000 7f0358866700 1 -- 172.21.15.59:0/1046844890 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03541334e0 con 0x7f035412cf60 2023-09-30T22:30:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.672+0000 7f0342ffd700 1 -- 172.21.15.59:0/1046844890 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0344003a20 con 0x7f035412cf60 2023-09-30T22:30:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.673+0000 7f0342ffd700 1 -- 172.21.15.59:0/1046844890 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0344021070 con 0x7f035412cf60 2023-09-30T22:30:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.673+0000 7f0358866700 1 -- 172.21.15.59:0/1046844890 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0354133040 con 0x7f035412cf60 2023-09-30T22:30:52.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.676+0000 7f873bfae700 1 Processor -- start 2023-09-30T22:30:52.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.676+0000 7f873bfae700 1 -- start start 2023-09-30T22:30:52.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.676+0000 7f873bfae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f873409e1d0 0x7f8734135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.676+0000 7f873bfae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8734135e50 0x7f8734138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.677+0000 7f873bfae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873409f130 con 0x7f873409d6f0 2023-09-30T22:30:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.677+0000 7f873bfae700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873409f520 con 0x7f8734135e50 2023-09-30T22:30:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.677+0000 7f873bfae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873409e930 con 0x7f873409e1d0 2023-09-30T22:30:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.677+0000 7f8739549700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f873409e1d0 0x7f8734135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.677+0000 7f8739549700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f873409e1d0 0x7f8734135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34050/0 (socket says 172.21.15.59:34050) 2023-09-30T22:30:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.677+0000 7f8739549700 1 -- 172.21.15.59:0/9434666 learned_addr learned my addr 172.21.15.59:0/9434666 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.677+0000 7f8739549700 1 -- 172.21.15.59:0/9434666 >> v2:172.21.15.59:3300/0 conn(0x7f8734135e50 msgr2=0x7f8734138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.677+0000 7f8739549700 1 --2- 172.21.15.59:0/9434666 >> v2:172.21.15.59:3300/0 conn(0x7f8734135e50 0x7f8734138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.677+0000 7f8739549700 1 -- 172.21.15.59:0/9434666 >> v1:172.21.15.59:6789/0 conn(0x7f873409d6f0 legacy=0x7f873409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.677+0000 7f8739549700 1 -- 172.21.15.59:0/9434666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873409b2d0 con 0x7f873409e1d0 2023-09-30T22:30:52.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.677+0000 7f8739549700 1 --2- 172.21.15.59:0/9434666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f873409e1d0 0x7f8734135910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f872400bbc0 tx=0x7f872400bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=379ccba44f88c765 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.677+0000 7f8738d48700 1 -- 172.21.15.59:0/9434666 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872400dd10 con 0x7f873409e1d0 2023-09-30T22:30:52.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.677+0000 7f8738d48700 1 -- 172.21.15.59:0/9434666 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872400de70 con 0x7f873409e1d0 2023-09-30T22:30:52.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.677+0000 7f8738d48700 1 -- 172.21.15.59:0/9434666 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724004230 con 0x7f873409e1d0 2023-09-30T22:30:52.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.678+0000 7f873bfae700 1 -- 172.21.15.59:0/9434666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f873409e1d0 msgr2=0x7f8734135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.678+0000 7f873bfae700 1 --2- 172.21.15.59:0/9434666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f873409e1d0 0x7f8734135910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f872400bbc0 tx=0x7f872400bed0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.678+0000 7f873bfae700 1 -- 172.21.15.59:0/9434666 shutdown_connections 2023-09-30T22:30:52.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.678+0000 7f873bfae700 1 --2- 172.21.15.59:0/9434666 >> v2:172.21.15.59:3300/0 conn(0x7f8734135e50 0x7f8734138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.678+0000 7f873bfae700 1 --2- 172.21.15.59:0/9434666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f873409e1d0 0x7f8734135910 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.678+0000 7f873bfae700 1 -- 172.21.15.59:0/9434666 >> 172.21.15.59:0/9434666 conn(0x7f8734066f50 msgr2=0x7f873409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.678+0000 7f873bfae700 1 -- 172.21.15.59:0/9434666 shutdown_connections 2023-09-30T22:30:52.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.678+0000 7f873bfae700 1 -- 172.21.15.59:0/9434666 wait complete. 2023-09-30T22:30:52.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.679+0000 7f0342ffd700 1 -- 172.21.15.59:0/1046844890 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0344015020 con 0x7f035412cf60 2023-09-30T22:30:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.679+0000 7f873bfae700 1 Processor -- start 2023-09-30T22:30:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.679+0000 7f873bfae700 1 -- start start 2023-09-30T22:30:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.680+0000 7f873bfae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f873409d6f0 0x7f8734119500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.680+0000 7f873bfae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f873409e1d0 0x7f8734119a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.680+0000 7f873bfae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8734135e50 0x7f8734119f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.680+0000 7f873bfae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873411bc40 con 0x7f8734135e50 2023-09-30T22:30:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.680+0000 7f873bfae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873411b150 con 0x7f873409e1d0 2023-09-30T22:30:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.680+0000 7f873bfae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87341301a0 con 0x7f873409d6f0 2023-09-30T22:30:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.680+0000 7f8739d4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f873409d6f0 0x7f8734119500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.680+0000 7f8739549700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f873409e1d0 0x7f8734119a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.680+0000 7f8739d4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f873409d6f0 0x7f8734119500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36622/0 (socket says 172.21.15.59:36622) 2023-09-30T22:30:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.680+0000 7f8739d4a700 1 -- 172.21.15.59:0/711937823 learned_addr learned my addr 172.21.15.59:0/711937823 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.680+0000 7f873a54b700 1 --2- 172.21.15.59:0/711937823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8734135e50 0x7f8734119f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.681+0000 7f8739d4a700 1 -- 172.21.15.59:0/711937823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f873409e1d0 msgr2=0x7f8734119a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.681+0000 7f8739d4a700 1 --2- 172.21.15.59:0/711937823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f873409e1d0 0x7f8734119a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.681+0000 7f8739d4a700 1 -- 172.21.15.59:0/711937823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8734135e50 msgr2=0x7f8734119f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.681+0000 7f8739d4a700 1 --2- 172.21.15.59:0/711937823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8734135e50 0x7f8734119f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.681+0000 7f8739d4a700 1 -- 172.21.15.59:0/711937823 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872400b7f0 con 0x7f873409d6f0 2023-09-30T22:30:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.681+0000 7f873a54b700 1 --2- 172.21.15.59:0/711937823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8734135e50 0x7f8734119f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.681+0000 7f8739d4a700 1 --2- 172.21.15.59:0/711937823 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f873409d6f0 0x7f8734119500 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f873000c4a0 tx=0x7f873000c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.681+0000 7f872a7fc700 1 -- 172.21.15.59:0/711937823 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87300054e0 con 0x7f873409d6f0 2023-09-30T22:30:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.681+0000 7f872a7fc700 1 -- 172.21.15.59:0/711937823 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8730003680 con 0x7f873409d6f0 2023-09-30T22:30:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.681+0000 7f873bfae700 1 -- 172.21.15.59:0/711937823 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873409c700 con 0x7f873409d6f0 2023-09-30T22:30:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.681+0000 7f872a7fc700 1 -- 172.21.15.59:0/711937823 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730003a30 con 0x7f873409d6f0 2023-09-30T22:30:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.681+0000 7f873bfae700 1 -- 172.21.15.59:0/711937823 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873411d670 con 0x7f873409d6f0 2023-09-30T22:30:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.682+0000 7f873bfae700 1 -- 172.21.15.59:0/711937823 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873411cb20 con 0x7f873409d6f0 2023-09-30T22:30:52.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.682+0000 7f872a7fc700 1 -- 172.21.15.59:0/711937823 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8730003b90 con 0x7f873409d6f0 2023-09-30T22:30:52.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.683+0000 7f872a7fc700 1 -- 172.21.15.59:0/711937823 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f873003e720 con 0x7f873409d6f0 2023-09-30T22:30:52.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.687+0000 7f872a7fc700 1 -- 172.21.15.59:0/711937823 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8730003e40 con 0x7f873409d6f0 2023-09-30T22:30:52.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.852+0000 7f595df5c700 1 -- 172.21.15.59:0/3833455027 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5958124810 con 0x7f595809d6f0 2023-09-30T22:30:52.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.852+0000 7f593ffff700 1 -- 172.21.15.59:0/3833455027 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5948017070 con 0x7f595809d6f0 2023-09-30T22:30:52.852 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:52.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.855+0000 7f595df5c700 1 -- 172.21.15.59:0/3833455027 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f595809d6f0 msgr2=0x7f59581223d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.855+0000 7f595df5c700 1 --2- 172.21.15.59:0/3833455027 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f595809d6f0 0x7f59581223d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f594800ebe0 tx=0x7f594800eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.855+0000 7f595df5c700 1 -- 172.21.15.59:0/3833455027 shutdown_connections 2023-09-30T22:30:52.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.855+0000 7f595df5c700 1 --2- 172.21.15.59:0/3833455027 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f595809d6f0 0x7f59581223d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.855+0000 7f595df5c700 1 --2- 172.21.15.59:0/3833455027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f595809e410 0x7f5958122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.855+0000 7f595df5c700 1 --2- 172.21.15.59:0/3833455027 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f595809e000 0x7f5958122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.855+0000 7f595df5c700 1 -- 172.21.15.59:0/3833455027 >> 172.21.15.59:0/3833455027 conn(0x7f5958066f50 msgr2=0x7f5958130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.855+0000 7f595df5c700 1 -- 172.21.15.59:0/3833455027 shutdown_connections 2023-09-30T22:30:52.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.855+0000 7f595df5c700 1 -- 172.21.15.59:0/3833455027 wait complete. 2023-09-30T22:30:52.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:52.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.886+0000 7f0358866700 1 -- 172.21.15.59:0/1046844890 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0354074ea0 con 0x7f035412cf60 2023-09-30T22:30:52.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.886+0000 7f0342ffd700 1 -- 172.21.15.59:0/1046844890 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f034401a7b0 con 0x7f035412cf60 2023-09-30T22:30:52.886 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:52.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.888+0000 7f0358866700 1 -- 172.21.15.59:0/1046844890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f035412cf60 msgr2=0x7f03541309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.888+0000 7f0358866700 1 --2- 172.21.15.59:0/1046844890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f035412cf60 0x7f03541309e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0344009130 tx=0x7f0344004750 comp rx=0 tx=0).stop 2023-09-30T22:30:52.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.888+0000 7f0358866700 1 -- 172.21.15.59:0/1046844890 shutdown_connections 2023-09-30T22:30:52.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.888+0000 7f0358866700 1 --2- 172.21.15.59:0/1046844890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f035412cf60 0x7f03541309e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.888+0000 7f0358866700 1 --2- 172.21.15.59:0/1046844890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0354130430 0x7f0354131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.888+0000 7f0358866700 1 --2- 172.21.15.59:0/1046844890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f035412f8b0 0x7f0354130f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.888+0000 7f0358866700 1 -- 172.21.15.59:0/1046844890 >> 172.21.15.59:0/1046844890 conn(0x7f03540a2aa0 msgr2=0x7f035412a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.888+0000 7f0358866700 1 -- 172.21.15.59:0/1046844890 shutdown_connections 2023-09-30T22:30:52.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.889+0000 7f0358866700 1 -- 172.21.15.59:0/1046844890 wait complete. 2023-09-30T22:30:52.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.894+0000 7f873bfae700 1 -- 172.21.15.59:0/711937823 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8734074ea0 con 0x7f873409d6f0 2023-09-30T22:30:52.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.895+0000 7f872a7fc700 1 -- 172.21.15.59:0/711937823 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8730017020 con 0x7f873409d6f0 2023-09-30T22:30:52.895 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:52.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.897+0000 7f873bfae700 1 -- 172.21.15.59:0/711937823 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f873409d6f0 msgr2=0x7f8734119500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.897+0000 7f873bfae700 1 --2- 172.21.15.59:0/711937823 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f873409d6f0 0x7f8734119500 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f873000c4a0 tx=0x7f873000c7b0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.897+0000 7f873bfae700 1 -- 172.21.15.59:0/711937823 shutdown_connections 2023-09-30T22:30:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.897+0000 7f873bfae700 1 --2- 172.21.15.59:0/711937823 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f873409d6f0 0x7f8734119500 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.897+0000 7f873bfae700 1 --2- 172.21.15.59:0/711937823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8734135e50 0x7f8734119f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.897+0000 7f873bfae700 1 --2- 172.21.15.59:0/711937823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f873409e1d0 0x7f8734119a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.897+0000 7f873bfae700 1 -- 172.21.15.59:0/711937823 >> 172.21.15.59:0/711937823 conn(0x7f8734066f50 msgr2=0x7f873406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.897+0000 7f873bfae700 1 -- 172.21.15.59:0/711937823 shutdown_connections 2023-09-30T22:30:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:52.897+0000 7f873bfae700 1 -- 172.21.15.59:0/711937823 wait complete. 2023-09-30T22:30:52.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:52.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:53.433 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:53.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.580+0000 7fa810598700 1 Processor -- start 2023-09-30T22:30:53.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.581+0000 7fa810598700 1 -- start start 2023-09-30T22:30:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.581+0000 7fa810598700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa80809d6f0 0x7fa80809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.581+0000 7fa810598700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa80809e410 0x7fa808130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.581+0000 7fa810598700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80809f130 con 0x7fa80809e000 2023-09-30T22:30:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.581+0000 7fa810598700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80809f520 con 0x7fa80809d6f0 2023-09-30T22:30:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.581+0000 7fa810598700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa80809e930 con 0x7fa80809e410 2023-09-30T22:30:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.581+0000 7fa80e334700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa80809d6f0 0x7fa80809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.581+0000 7fa80eb35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa80809e410 0x7fa808130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.581+0000 7fa80e334700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa80809d6f0 0x7fa80809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56824/0 (socket says 172.21.15.59:56824) 2023-09-30T22:30:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.581+0000 7fa80e334700 1 -- 172.21.15.59:0/3333814682 learned_addr learned my addr 172.21.15.59:0/3333814682 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.581+0000 7fa80db33700 1 --1- 172.21.15.59:0/3333814682 >> v1:172.21.15.59:6789/0 conn(0x7fa80809e000 0x7fa808130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60894/0 (socket says 172.21.15.59:60894) 2023-09-30T22:30:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.582+0000 7fa80eb35700 1 -- 172.21.15.59:0/3333814682 >> v2:172.21.15.59:3300/0 conn(0x7fa80809d6f0 msgr2=0x7fa80809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.582+0000 7fa80eb35700 1 --2- 172.21.15.59:0/3333814682 >> v2:172.21.15.59:3300/0 conn(0x7fa80809d6f0 0x7fa80809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.582+0000 7fa80eb35700 1 -- 172.21.15.59:0/3333814682 >> v1:172.21.15.59:6789/0 conn(0x7fa80809e000 legacy=0x7fa808130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.582+0000 7fa80eb35700 1 -- 172.21.15.59:0/3333814682 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80809b2d0 con 0x7fa80809e410 2023-09-30T22:30:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.582+0000 7fa80e334700 1 --2- 172.21.15.59:0/3333814682 >> v2:172.21.15.59:3300/0 conn(0x7fa80809d6f0 0x7fa80809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.582+0000 7fa80eb35700 1 --2- 172.21.15.59:0/3333814682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa80809e410 0x7fa808130d70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa800009d90 tx=0x7fa80000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e93a08a09d346143 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.582+0000 7fa80d332700 1 -- 172.21.15.59:0/3333814682 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80000e070 con 0x7fa80809e410 2023-09-30T22:30:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.582+0000 7fa80d332700 1 -- 172.21.15.59:0/3333814682 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80000bb20 con 0x7fa80809e410 2023-09-30T22:30:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.582+0000 7fa80d332700 1 -- 172.21.15.59:0/3333814682 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa800012430 con 0x7fa80809e410 2023-09-30T22:30:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.583+0000 7fa810598700 1 -- 172.21.15.59:0/3333814682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa80809e410 msgr2=0x7fa808130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.583+0000 7fa810598700 1 --2- 172.21.15.59:0/3333814682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa80809e410 0x7fa808130d70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa800009d90 tx=0x7fa80000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.583+0000 7fa810598700 1 -- 172.21.15.59:0/3333814682 shutdown_connections 2023-09-30T22:30:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.583+0000 7fa810598700 1 --2- 172.21.15.59:0/3333814682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa80809e410 0x7fa808130d70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.583+0000 7fa810598700 1 --2- 172.21.15.59:0/3333814682 >> v2:172.21.15.59:3300/0 conn(0x7fa80809d6f0 0x7fa80809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.583+0000 7fa810598700 1 -- 172.21.15.59:0/3333814682 >> 172.21.15.59:0/3333814682 conn(0x7fa808066f50 msgr2=0x7fa80809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.583+0000 7fa810598700 1 -- 172.21.15.59:0/3333814682 shutdown_connections 2023-09-30T22:30:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.583+0000 7fa810598700 1 -- 172.21.15.59:0/3333814682 wait complete. 2023-09-30T22:30:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.584+0000 7fa810598700 1 Processor -- start 2023-09-30T22:30:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.584+0000 7fa810598700 1 -- start start 2023-09-30T22:30:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.584+0000 7fa810598700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa80809d6f0 0x7fa808122230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.584+0000 7fa810598700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa80809e000 0x7fa808122770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.584+0000 7fa810598700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa80809e410 0x7fa808122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.584+0000 7fa810598700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa808125a70 con 0x7fa80809d6f0 2023-09-30T22:30:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.584+0000 7fa810598700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa808123f50 con 0x7fa80809e000 2023-09-30T22:30:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.584+0000 7fa810598700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa80809c700 con 0x7fa80809e410 2023-09-30T22:30:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa80e334700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa80809d6f0 0x7fa808122230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa80e334700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa80809d6f0 0x7fa808122230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56830/0 (socket says 172.21.15.59:56830) 2023-09-30T22:30:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa80e334700 1 -- 172.21.15.59:0/3525964111 learned_addr learned my addr 172.21.15.59:0/3525964111 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa80eb35700 1 --2- 172.21.15.59:0/3525964111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa80809e410 0x7fa808122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa80db33700 1 --2- 172.21.15.59:0/3525964111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa80809e000 0x7fa808122770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa80e334700 1 -- 172.21.15.59:0/3525964111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa80809e410 msgr2=0x7fa808122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa80e334700 1 --2- 172.21.15.59:0/3525964111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa80809e410 0x7fa808122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa80e334700 1 -- 172.21.15.59:0/3525964111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa80809e000 msgr2=0x7fa808122770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa80e334700 1 --2- 172.21.15.59:0/3525964111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa80809e000 0x7fa808122770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa80e334700 1 -- 172.21.15.59:0/3525964111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa804009550 con 0x7fa80809d6f0 2023-09-30T22:30:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa80eb35700 1 --2- 172.21.15.59:0/3525964111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa80809e410 0x7fa808122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa80e334700 1 --2- 172.21.15.59:0/3525964111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa80809d6f0 0x7fa808122230 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa80400ebe0 tx=0x7fa80400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa7faffd700 1 -- 172.21.15.59:0/3525964111 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80400c850 con 0x7fa80809d6f0 2023-09-30T22:30:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa7faffd700 1 -- 172.21.15.59:0/3525964111 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80400c9b0 con 0x7fa80809d6f0 2023-09-30T22:30:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa7faffd700 1 -- 172.21.15.59:0/3525964111 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80400cd40 con 0x7fa80809d6f0 2023-09-30T22:30:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa810598700 1 -- 172.21.15.59:0/3525964111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa800009a70 con 0x7fa80809d6f0 2023-09-30T22:30:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.585+0000 7fa810598700 1 -- 172.21.15.59:0/3525964111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8081264e0 con 0x7fa80809d6f0 2023-09-30T22:30:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.586+0000 7fa810598700 1 -- 172.21.15.59:0/3525964111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa808074ea0 con 0x7fa80809d6f0 2023-09-30T22:30:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.587+0000 7fa7faffd700 1 -- 172.21.15.59:0/3525964111 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa804013470 con 0x7fa80809d6f0 2023-09-30T22:30:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.587+0000 7fa7faffd700 1 -- 172.21.15.59:0/3525964111 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa8040400c0 con 0x7fa80809d6f0 2023-09-30T22:30:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.591+0000 7fa7faffd700 1 -- 172.21.15.59:0/3525964111 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa804011760 con 0x7fa80809d6f0 2023-09-30T22:30:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.793+0000 7fa810598700 1 -- 172.21.15.59:0/3525964111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa80806c360 con 0x7fa80809d6f0 2023-09-30T22:30:53.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.794+0000 7fa7faffd700 1 -- 172.21.15.59:0/3525964111 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa804017070 con 0x7fa80809d6f0 2023-09-30T22:30:53.794 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.796+0000 7fa810598700 1 -- 172.21.15.59:0/3525964111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa80809d6f0 msgr2=0x7fa808122230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.796+0000 7fa810598700 1 --2- 172.21.15.59:0/3525964111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa80809d6f0 0x7fa808122230 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa80400ebe0 tx=0x7fa80400eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.796+0000 7fa810598700 1 -- 172.21.15.59:0/3525964111 shutdown_connections 2023-09-30T22:30:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.796+0000 7fa810598700 1 --2- 172.21.15.59:0/3525964111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa80809e410 0x7fa808122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.796+0000 7fa810598700 1 --2- 172.21.15.59:0/3525964111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa80809d6f0 0x7fa808122230 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.796+0000 7fa810598700 1 --2- 172.21.15.59:0/3525964111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa80809e000 0x7fa808122770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.796+0000 7fa810598700 1 -- 172.21.15.59:0/3525964111 >> 172.21.15.59:0/3525964111 conn(0x7fa808066f50 msgr2=0x7fa808070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.796+0000 7fa810598700 1 -- 172.21.15.59:0/3525964111 shutdown_connections 2023-09-30T22:30:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:53.796+0000 7fa810598700 1 -- 172.21.15.59:0/3525964111 wait complete. 2023-09-30T22:30:53.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:53.870 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:53.904 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:53.912 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:54.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.017+0000 7f7d181d3700 1 Processor -- start 2023-09-30T22:30:54.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.017+0000 7f7d181d3700 1 -- start start 2023-09-30T22:30:54.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.018+0000 7f7d181d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d101338c0 0x7f7d10133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.018+0000 7f7d181d3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d101341d0 0x7f7d1009de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.018+0000 7f7d181d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d1009e390 0x7f7d1009e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.018+0000 7f7d181d3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d10070c80 con 0x7f7d101341d0 2023-09-30T22:30:54.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.018+0000 7f7d181d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1009ed20 con 0x7f7d101338c0 2023-09-30T22:30:54.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.018+0000 7f7d181d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1006f720 con 0x7f7d1009e390 2023-09-30T22:30:54.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.018+0000 7f7d1576e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d101341d0 0x7f7d1009de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.018+0000 7f7d15f6f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d101338c0 0x7f7d10133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.018+0000 7f7d15f6f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d101338c0 0x7f7d10133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34074/0 (socket says 172.21.15.59:34074) 2023-09-30T22:30:54.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.018+0000 7f7d1576e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d101341d0 0x7f7d1009de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56842/0 (socket says 172.21.15.59:56842) 2023-09-30T22:30:54.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.018+0000 7f7d15f6f700 1 -- 172.21.15.59:0/3292002576 learned_addr learned my addr 172.21.15.59:0/3292002576 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:54.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.018+0000 7f7d16770700 1 --2- 172.21.15.59:0/3292002576 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d1009e390 0x7f7d1009e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.019+0000 7f7d15f6f700 1 -- 172.21.15.59:0/3292002576 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d1009e390 msgr2=0x7f7d1009e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:54.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.019+0000 7f7d15f6f700 1 --2- 172.21.15.59:0/3292002576 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d1009e390 0x7f7d1009e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.019+0000 7f7d15f6f700 1 -- 172.21.15.59:0/3292002576 >> v2:172.21.15.59:3300/0 conn(0x7f7d101341d0 msgr2=0x7f7d1009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:54.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.019+0000 7f7d15f6f700 1 --2- 172.21.15.59:0/3292002576 >> v2:172.21.15.59:3300/0 conn(0x7f7d101341d0 0x7f7d1009de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.019+0000 7f7d15f6f700 1 -- 172.21.15.59:0/3292002576 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1006fce0 con 0x7f7d101338c0 2023-09-30T22:30:54.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.019+0000 7f7d15f6f700 1 --2- 172.21.15.59:0/3292002576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d101338c0 0x7f7d10133c90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009920 tx=0x7f7d0c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c8bebd49a21f292 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:54.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.019+0000 7f7d14f6d700 1 -- 172.21.15.59:0/3292002576 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c011830 con 0x7f7d101338c0 2023-09-30T22:30:54.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.019+0000 7f7d14f6d700 1 -- 172.21.15.59:0/3292002576 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c011990 con 0x7f7d101338c0 2023-09-30T22:30:54.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.019+0000 7f7d14f6d700 1 -- 172.21.15.59:0/3292002576 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c011d20 con 0x7f7d101338c0 2023-09-30T22:30:54.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.020+0000 7f7d181d3700 1 -- 172.21.15.59:0/3292002576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d101338c0 msgr2=0x7f7d10133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.020+0000 7f7d181d3700 1 --2- 172.21.15.59:0/3292002576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d101338c0 0x7f7d10133c90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009920 tx=0x7f7d0c009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:54.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.020+0000 7f7d181d3700 1 -- 172.21.15.59:0/3292002576 shutdown_connections 2023-09-30T22:30:54.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.020+0000 7f7d181d3700 1 --2- 172.21.15.59:0/3292002576 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d1009e390 0x7f7d1009e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.020+0000 7f7d181d3700 1 --2- 172.21.15.59:0/3292002576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d101338c0 0x7f7d10133c90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.020+0000 7f7d181d3700 1 --2- 172.21.15.59:0/3292002576 >> v2:172.21.15.59:3300/0 conn(0x7f7d101341d0 0x7f7d1009de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.020+0000 7f7d181d3700 1 -- 172.21.15.59:0/3292002576 >> 172.21.15.59:0/3292002576 conn(0x7f7d100a2aa0 msgr2=0x7f7d100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:54.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.020+0000 7f7d181d3700 1 -- 172.21.15.59:0/3292002576 shutdown_connections 2023-09-30T22:30:54.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.020+0000 7f7d181d3700 1 -- 172.21.15.59:0/3292002576 wait complete. 2023-09-30T22:30:54.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.022+0000 7f7d181d3700 1 Processor -- start 2023-09-30T22:30:54.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.022+0000 7f7d181d3700 1 -- start start 2023-09-30T22:30:54.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d181d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d1009e390 0x7f7d10118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d181d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d101338c0 0x7f7d10119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d181d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d101341d0 0x7f7d10119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d181d3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d10130d20 con 0x7f7d1009e390 2023-09-30T22:30:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d181d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1012bc00 con 0x7f7d101341d0 2023-09-30T22:30:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d181d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1011a7d0 con 0x7f7d101338c0 2023-09-30T22:30:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d15f6f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d1009e390 0x7f7d10118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d1576e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d101338c0 0x7f7d10119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d15f6f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d1009e390 0x7f7d10118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56850/0 (socket says 172.21.15.59:56850) 2023-09-30T22:30:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d15f6f700 1 -- 172.21.15.59:0/1800758227 learned_addr learned my addr 172.21.15.59:0/1800758227 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d16770700 1 --2- 172.21.15.59:0/1800758227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d101341d0 0x7f7d10119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d15f6f700 1 -- 172.21.15.59:0/1800758227 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d101338c0 msgr2=0x7f7d10119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d15f6f700 1 --2- 172.21.15.59:0/1800758227 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d101338c0 0x7f7d10119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d15f6f700 1 -- 172.21.15.59:0/1800758227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d101341d0 msgr2=0x7f7d10119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d15f6f700 1 --2- 172.21.15.59:0/1800758227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d101341d0 0x7f7d10119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d15f6f700 1 -- 172.21.15.59:0/1800758227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c009550 con 0x7f7d1009e390 2023-09-30T22:30:54.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d1576e700 1 --2- 172.21.15.59:0/1800758227 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d101338c0 0x7f7d10119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:54.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.023+0000 7f7d16770700 1 --2- 172.21.15.59:0/1800758227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d101341d0 0x7f7d10119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:54.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.024+0000 7f7d15f6f700 1 --2- 172.21.15.59:0/1800758227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d1009e390 0x7f7d10118cd0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0098f0 tx=0x7f7d0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:54.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.024+0000 7f7d067fc700 1 -- 172.21.15.59:0/1800758227 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c004240 con 0x7f7d1009e390 2023-09-30T22:30:54.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.024+0000 7f7d067fc700 1 -- 172.21.15.59:0/1800758227 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c01f070 con 0x7f7d1009e390 2023-09-30T22:30:54.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.024+0000 7f7d181d3700 1 -- 172.21.15.59:0/1800758227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1006f960 con 0x7f7d1009e390 2023-09-30T22:30:54.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.024+0000 7f7d067fc700 1 -- 172.21.15.59:0/1800758227 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c0045e0 con 0x7f7d1009e390 2023-09-30T22:30:54.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.024+0000 7f7d181d3700 1 -- 172.21.15.59:0/1800758227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1011beb0 con 0x7f7d1009e390 2023-09-30T22:30:54.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.025+0000 7f7d181d3700 1 -- 172.21.15.59:0/1800758227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d10074ea0 con 0x7f7d1009e390 2023-09-30T22:30:54.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.025+0000 7f7d067fc700 1 -- 172.21.15.59:0/1800758227 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d0c021030 con 0x7f7d1009e390 2023-09-30T22:30:54.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.026+0000 7f7d067fc700 1 -- 172.21.15.59:0/1800758227 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7d0c040d80 con 0x7f7d1009e390 2023-09-30T22:30:54.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.030+0000 7f7d067fc700 1 -- 172.21.15.59:0/1800758227 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d0c003e00 con 0x7f7d1009e390 2023-09-30T22:30:54.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.058+0000 7f1e5bb4e700 1 Processor -- start 2023-09-30T22:30:54.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.059+0000 7f4f86c5e700 1 Processor -- start 2023-09-30T22:30:54.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.059+0000 7f1e5bb4e700 1 -- start start 2023-09-30T22:30:54.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.059+0000 7f4f86c5e700 1 -- start start 2023-09-30T22:30:54.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f4f86c5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f800a09c0 0x7f4f800a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f1e5bb4e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5409f410 0x7f1e54136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f1e5bb4e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e54136fe0 0x7f1e541393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f1e5bb4e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e54070940 con 0x7f1e5409e930 2023-09-30T22:30:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f1e5bb4e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5406fd60 con 0x7f1e5409f410 2023-09-30T22:30:54.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f1e5bb4e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5406fa80 con 0x7f1e54136fe0 2023-09-30T22:30:54.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f4f86c5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009d5c0 0x7f4f800a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f4f86c5e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f800a1810 con 0x7f4f80133920 2023-09-30T22:30:54.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f4f86c5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8009ea10 con 0x7f4f800a09c0 2023-09-30T22:30:54.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f4f86c5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8009e210 con 0x7f4f8009d5c0 2023-09-30T22:30:54.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f1e5a0eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e54136fe0 0x7f1e541393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f4f851fb700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4f80133920 0x7f4f80133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60910/0 (socket says 172.21.15.59:60910) 2023-09-30T22:30:54.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f4f851fb700 1 -- 172.21.15.59:0/766127347 learned_addr learned my addr 172.21.15.59:0/766127347 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:54.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f4f7ffff700 1 --2- 172.21.15.59:0/766127347 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009d5c0 0x7f4f800a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f4f849fa700 1 --2- 172.21.15.59:0/766127347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f800a09c0 0x7f4f800a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f1e5a0eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e54136fe0 0x7f1e541393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36670/0 (socket says 172.21.15.59:36670) 2023-09-30T22:30:54.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f1e5a0eb700 1 -- 172.21.15.59:0/1540761677 learned_addr learned my addr 172.21.15.59:0/1540761677 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:54.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.060+0000 7f1e590e9700 1 --2- 172.21.15.59:0/1540761677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5409f410 0x7f1e54136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f4f7ffff700 1 -- 172.21.15.59:0/766127347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f800a09c0 msgr2=0x7f4f800a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f4f7ffff700 1 --2- 172.21.15.59:0/766127347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f800a09c0 0x7f4f800a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f4f7ffff700 1 -- 172.21.15.59:0/766127347 >> v1:172.21.15.59:6789/0 conn(0x7f4f80133920 legacy=0x7f4f80133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f4f7ffff700 1 -- 172.21.15.59:0/766127347 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f800a26f0 con 0x7f4f8009d5c0 2023-09-30T22:30:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f1e590e9700 1 -- 172.21.15.59:0/1540761677 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e54136fe0 msgr2=0x7f1e541393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f1e590e9700 1 --2- 172.21.15.59:0/1540761677 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e54136fe0 0x7f1e541393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f1e590e9700 1 -- 172.21.15.59:0/1540761677 >> v1:172.21.15.59:6789/0 conn(0x7f1e5409e930 legacy=0x7f1e5409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f1e590e9700 1 -- 172.21.15.59:0/1540761677 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5409fb60 con 0x7f1e5409f410 2023-09-30T22:30:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f1e590e9700 1 --2- 172.21.15.59:0/1540761677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5409f410 0x7f1e54136aa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009870 tx=0x7f1e44009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f4de7d1aa290f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f4f7ffff700 1 --2- 172.21.15.59:0/766127347 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009d5c0 0x7f4f800a12d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c009870 tx=0x7f4f6c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c05021609863787 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f1e588e8700 1 -- 172.21.15.59:0/1540761677 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e44011830 con 0x7f1e5409f410 2023-09-30T22:30:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f4f7f7fe700 1 -- 172.21.15.59:0/766127347 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c011830 con 0x7f4f8009d5c0 2023-09-30T22:30:54.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f1e588e8700 1 -- 172.21.15.59:0/1540761677 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e44011990 con 0x7f1e5409f410 2023-09-30T22:30:54.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f4f7f7fe700 1 -- 172.21.15.59:0/766127347 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6c011990 con 0x7f4f8009d5c0 2023-09-30T22:30:54.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f4f7f7fe700 1 -- 172.21.15.59:0/766127347 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c011d20 con 0x7f4f8009d5c0 2023-09-30T22:30:54.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.061+0000 7f1e588e8700 1 -- 172.21.15.59:0/1540761677 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e44011d20 con 0x7f1e5409f410 2023-09-30T22:30:54.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f4f86c5e700 1 -- 172.21.15.59:0/766127347 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009d5c0 msgr2=0x7f4f800a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f1e5bb4e700 1 -- 172.21.15.59:0/1540761677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5409f410 msgr2=0x7f1e54136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f4f86c5e700 1 --2- 172.21.15.59:0/766127347 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009d5c0 0x7f4f800a12d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c009870 tx=0x7f4f6c009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:54.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f1e5bb4e700 1 --2- 172.21.15.59:0/1540761677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5409f410 0x7f1e54136aa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009870 tx=0x7f1e44009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:54.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f1e5bb4e700 1 -- 172.21.15.59:0/1540761677 shutdown_connections 2023-09-30T22:30:54.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f1e5bb4e700 1 --2- 172.21.15.59:0/1540761677 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e54136fe0 0x7f1e541393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f1e5bb4e700 1 --2- 172.21.15.59:0/1540761677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5409f410 0x7f1e54136aa0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f1e5bb4e700 1 -- 172.21.15.59:0/1540761677 >> 172.21.15.59:0/1540761677 conn(0x7f1e540a4210 msgr2=0x7f1e540a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:54.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f4f86c5e700 1 -- 172.21.15.59:0/766127347 shutdown_connections 2023-09-30T22:30:54.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f4f86c5e700 1 --2- 172.21.15.59:0/766127347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f800a09c0 0x7f4f800a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f4f86c5e700 1 --2- 172.21.15.59:0/766127347 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009d5c0 0x7f4f800a12d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f4f86c5e700 1 -- 172.21.15.59:0/766127347 >> 172.21.15.59:0/766127347 conn(0x7f4f800a2fe0 msgr2=0x7f4f800a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:54.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f4f86c5e700 1 -- 172.21.15.59:0/766127347 shutdown_connections 2023-09-30T22:30:54.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f1e5bb4e700 1 -- 172.21.15.59:0/1540761677 shutdown_connections 2023-09-30T22:30:54.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f4f86c5e700 1 -- 172.21.15.59:0/766127347 wait complete. 2023-09-30T22:30:54.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.062+0000 7f1e5bb4e700 1 -- 172.21.15.59:0/1540761677 wait complete. 2023-09-30T22:30:54.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.063+0000 7f4f86c5e700 1 Processor -- start 2023-09-30T22:30:54.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.063+0000 7f1e5bb4e700 1 Processor -- start 2023-09-30T22:30:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.063+0000 7f4f86c5e700 1 -- start start 2023-09-30T22:30:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.063+0000 7f1e5bb4e700 1 -- start start 2023-09-30T22:30:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e5bb4e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5409e930 0x7f1e5406c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e5bb4e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5409f410 0x7f1e5406c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e5bb4e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e54136fe0 0x7f1e541c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e5bb4e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54132200 con 0x7f1e5409f410 2023-09-30T22:30:54.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e5bb4e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5406bd90 con 0x7f1e54136fe0 2023-09-30T22:30:54.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e5bb4e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54121e00 con 0x7f1e5409e930 2023-09-30T22:30:54.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f4f86c5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009d5c0 0x7f4f80121330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e590e9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5409f410 0x7f1e5406c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e590e9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5409f410 0x7f1e5406c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56852/0 (socket says 172.21.15.59:56852) 2023-09-30T22:30:54.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e590e9700 1 -- 172.21.15.59:0/2380547373 learned_addr learned my addr 172.21.15.59:0/2380547373 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:54.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e5a0eb700 1 --2- 172.21.15.59:0/2380547373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e54136fe0 0x7f1e541c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f4f86c5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f800a09c0 0x7f4f80121870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f4f849fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009d5c0 0x7f4f80121330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f4f849fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009d5c0 0x7f4f80121330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36698/0 (socket says 172.21.15.59:36698) 2023-09-30T22:30:54.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f4f86c5e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f80133920 0x7f4f80121db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f4f7ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f800a09c0 0x7f4f80121870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f4f86c5e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f80124c10 con 0x7f4f80133920 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f4f86c5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f80132700 con 0x7f4f800a09c0 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f4f86c5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f801248b0 con 0x7f4f8009d5c0 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f4f7ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f800a09c0 0x7f4f80121870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34114/0 (socket says 172.21.15.59:34114) 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f4f7ffff700 1 -- 172.21.15.59:0/2084134883 learned_addr learned my addr 172.21.15.59:0/2084134883 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f4f851fb700 1 --2- 172.21.15.59:0/2084134883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f80133920 0x7f4f80121db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e598ea700 1 --2- 172.21.15.59:0/2380547373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5409e930 0x7f1e5406c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e590e9700 1 -- 172.21.15.59:0/2380547373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5409e930 msgr2=0x7f1e5406c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e590e9700 1 --2- 172.21.15.59:0/2380547373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5409e930 0x7f1e5406c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e590e9700 1 -- 172.21.15.59:0/2380547373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e54136fe0 msgr2=0x7f1e541c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e590e9700 1 --2- 172.21.15.59:0/2380547373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e54136fe0 0x7f1e541c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.064+0000 7f1e590e9700 1 -- 172.21.15.59:0/2380547373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e440094a0 con 0x7f1e5409f410 2023-09-30T22:30:54.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f4f849fa700 1 -- 172.21.15.59:0/2084134883 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f800a09c0 msgr2=0x7f4f80121870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f4f849fa700 1 --2- 172.21.15.59:0/2084134883 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f800a09c0 0x7f4f80121870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f4f849fa700 1 -- 172.21.15.59:0/2084134883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f80133920 msgr2=0x7f4f80121db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f4f849fa700 1 --2- 172.21.15.59:0/2084134883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f80133920 0x7f4f80121db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f4f849fa700 1 -- 172.21.15.59:0/2084134883 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c0094a0 con 0x7f4f8009d5c0 2023-09-30T22:30:54.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f4f7ffff700 1 --2- 172.21.15.59:0/2084134883 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f800a09c0 0x7f4f80121870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:54.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f4f851fb700 1 --2- 172.21.15.59:0/2084134883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f80133920 0x7f4f80121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:54.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f1e590e9700 1 --2- 172.21.15.59:0/2380547373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5409f410 0x7f1e5406c750 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009840 tx=0x7f1e44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:54.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f4f849fa700 1 --2- 172.21.15.59:0/2084134883 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009d5c0 0x7f4f80121330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400e930 tx=0x7f4f7400ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:54.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f1e4a7fc700 1 -- 172.21.15.59:0/2380547373 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e44004510 con 0x7f1e5409f410 2023-09-30T22:30:54.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f1e4a7fc700 1 -- 172.21.15.59:0/2380547373 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4401f070 con 0x7f1e5409f410 2023-09-30T22:30:54.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f1e4a7fc700 1 -- 172.21.15.59:0/2380547373 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e440038a0 con 0x7f1e5409f410 2023-09-30T22:30:54.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f1e5bb4e700 1 -- 172.21.15.59:0/2380547373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5406cc90 con 0x7f1e5409f410 2023-09-30T22:30:54.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f1e5bb4e700 1 -- 172.21.15.59:0/2380547373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e540a3060 con 0x7f1e5409f410 2023-09-30T22:30:54.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f4f7d7fa700 1 -- 172.21.15.59:0/2084134883 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74013680 con 0x7f4f8009d5c0 2023-09-30T22:30:54.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f4f7d7fa700 1 -- 172.21.15.59:0/2084134883 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f740137e0 con 0x7f4f8009d5c0 2023-09-30T22:30:54.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.065+0000 7f4f7d7fa700 1 -- 172.21.15.59:0/2084134883 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74013b50 con 0x7f4f8009d5c0 2023-09-30T22:30:54.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.066+0000 7f4f86c5e700 1 -- 172.21.15.59:0/2084134883 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f80123dd0 con 0x7f4f8009d5c0 2023-09-30T22:30:54.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.066+0000 7f4f86c5e700 1 -- 172.21.15.59:0/2084134883 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f801245e0 con 0x7f4f8009d5c0 2023-09-30T22:30:54.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.066+0000 7f1e4a7fc700 1 -- 172.21.15.59:0/2380547373 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e44003a00 con 0x7f1e5409f410 2023-09-30T22:30:54.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.066+0000 7f1e4a7fc700 1 -- 172.21.15.59:0/2380547373 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e44021070 con 0x7f1e5409f410 2023-09-30T22:30:54.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.066+0000 7f1e5bb4e700 1 -- 172.21.15.59:0/2380547373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e54071d20 con 0x7f1e5409f410 2023-09-30T22:30:54.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.067+0000 7f4f7d7fa700 1 -- 172.21.15.59:0/2084134883 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f74013cb0 con 0x7f4f8009d5c0 2023-09-30T22:30:54.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.067+0000 7f4f7d7fa700 1 -- 172.21.15.59:0/2084134883 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4f7403f630 con 0x7f4f8009d5c0 2023-09-30T22:30:54.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.067+0000 7f4f86c5e700 1 -- 172.21.15.59:0/2084134883 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f80124190 con 0x7f4f8009d5c0 2023-09-30T22:30:54.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.071+0000 7f1e4a7fc700 1 -- 172.21.15.59:0/2380547373 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e4402b020 con 0x7f1e5409f410 2023-09-30T22:30:54.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.072+0000 7f4f7d7fa700 1 -- 172.21.15.59:0/2084134883 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f7401bde0 con 0x7f4f8009d5c0 2023-09-30T22:30:54.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.240+0000 7f7d181d3700 1 -- 172.21.15.59:0/1800758227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7d1006b9e0 con 0x7f7d1009e390 2023-09-30T22:30:54.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.240+0000 7f7d067fc700 1 -- 172.21.15.59:0/1800758227 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d0c015070 con 0x7f7d1009e390 2023-09-30T22:30:54.241 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:54.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.243+0000 7f7d181d3700 1 -- 172.21.15.59:0/1800758227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d1009e390 msgr2=0x7f7d10118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.243+0000 7f7d181d3700 1 --2- 172.21.15.59:0/1800758227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d1009e390 0x7f7d10118cd0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0098f0 tx=0x7f7d0c004750 comp rx=0 tx=0).stop 2023-09-30T22:30:54.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.243+0000 7f7d181d3700 1 -- 172.21.15.59:0/1800758227 shutdown_connections 2023-09-30T22:30:54.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.243+0000 7f7d181d3700 1 --2- 172.21.15.59:0/1800758227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d101341d0 0x7f7d10119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.243+0000 7f7d181d3700 1 --2- 172.21.15.59:0/1800758227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d1009e390 0x7f7d10118cd0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.243+0000 7f7d181d3700 1 --2- 172.21.15.59:0/1800758227 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d101338c0 0x7f7d10119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.243+0000 7f7d181d3700 1 -- 172.21.15.59:0/1800758227 >> 172.21.15.59:0/1800758227 conn(0x7f7d100a2aa0 msgr2=0x7f7d1012e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:54.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.243+0000 7f7d181d3700 1 -- 172.21.15.59:0/1800758227 shutdown_connections 2023-09-30T22:30:54.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.243+0000 7f7d181d3700 1 -- 172.21.15.59:0/1800758227 wait complete. 2023-09-30T22:30:54.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:54.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.278+0000 7f1e5bb4e700 1 -- 172.21.15.59:0/2380547373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1e54121100 con 0x7f1e5409f410 2023-09-30T22:30:54.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.278+0000 7f1e4a7fc700 1 -- 172.21.15.59:0/2380547373 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e44015070 con 0x7f1e5409f410 2023-09-30T22:30:54.278 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.280+0000 7f1e5bb4e700 1 -- 172.21.15.59:0/2380547373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5409f410 msgr2=0x7f1e5406c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.280+0000 7f1e5bb4e700 1 --2- 172.21.15.59:0/2380547373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5409f410 0x7f1e5406c750 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009840 tx=0x7f1e44004750 comp rx=0 tx=0).stop 2023-09-30T22:30:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.280+0000 7f1e5bb4e700 1 -- 172.21.15.59:0/2380547373 shutdown_connections 2023-09-30T22:30:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.280+0000 7f1e5bb4e700 1 --2- 172.21.15.59:0/2380547373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5409e930 0x7f1e5406c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.280+0000 7f1e5bb4e700 1 --2- 172.21.15.59:0/2380547373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e54136fe0 0x7f1e541c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.280+0000 7f1e5bb4e700 1 --2- 172.21.15.59:0/2380547373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e5409f410 0x7f1e5406c750 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.280+0000 7f1e5bb4e700 1 -- 172.21.15.59:0/2380547373 >> 172.21.15.59:0/2380547373 conn(0x7f1e540a4210 msgr2=0x7f1e54134b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.280+0000 7f1e5bb4e700 1 -- 172.21.15.59:0/2380547373 shutdown_connections 2023-09-30T22:30:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.281+0000 7f1e5bb4e700 1 -- 172.21.15.59:0/2380547373 wait complete. 2023-09-30T22:30:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.281+0000 7f4f86c5e700 1 -- 172.21.15.59:0/2084134883 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4f8011df50 con 0x7f4f8009d5c0 2023-09-30T22:30:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.281+0000 7f4f7d7fa700 1 -- 172.21.15.59:0/2084134883 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f74021020 con 0x7f4f8009d5c0 2023-09-30T22:30:54.282 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:54.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.284+0000 7f4f86c5e700 1 -- 172.21.15.59:0/2084134883 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009d5c0 msgr2=0x7f4f80121330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.284+0000 7f4f86c5e700 1 --2- 172.21.15.59:0/2084134883 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009d5c0 0x7f4f80121330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400e930 tx=0x7f4f7400ec40 comp rx=0 tx=0).stop 2023-09-30T22:30:54.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.284+0000 7f4f86c5e700 1 -- 172.21.15.59:0/2084134883 shutdown_connections 2023-09-30T22:30:54.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.284+0000 7f4f86c5e700 1 --2- 172.21.15.59:0/2084134883 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009d5c0 0x7f4f80121330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.284+0000 7f4f86c5e700 1 --2- 172.21.15.59:0/2084134883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f80133920 0x7f4f80121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.284+0000 7f4f86c5e700 1 --2- 172.21.15.59:0/2084134883 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f800a09c0 0x7f4f80121870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.284+0000 7f4f86c5e700 1 -- 172.21.15.59:0/2084134883 >> 172.21.15.59:0/2084134883 conn(0x7f4f800a2fe0 msgr2=0x7f4f801331c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:54.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.284+0000 7f4f86c5e700 1 -- 172.21.15.59:0/2084134883 shutdown_connections 2023-09-30T22:30:54.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.284+0000 7f4f86c5e700 1 -- 172.21.15.59:0/2084134883 wait complete. 2023-09-30T22:30:54.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:54.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:54.810 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:54.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.956+0000 7f402cb11700 1 Processor -- start 2023-09-30T22:30:54.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.956+0000 7f402cb11700 1 -- start start 2023-09-30T22:30:54.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f402cb11700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f402809e930 0x7f402809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f402cb11700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809f240 0x7f40281317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f402cb11700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f650 0x7f4028131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f402cb11700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4028070940 con 0x7f402809e930 2023-09-30T22:30:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f402cb11700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402806fd60 con 0x7f402809f240 2023-09-30T22:30:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f402cb11700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f402806fa80 con 0x7f402809f650 2023-09-30T22:30:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f402659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f402809e930 0x7f402809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f4025d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809f240 0x7f40281317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f4026d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f650 0x7f4028131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f4025d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809f240 0x7f40281317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40228/0 (socket says 172.21.15.59:40228) 2023-09-30T22:30:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f402659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f402809e930 0x7f402809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33996/0 (socket says 172.21.15.59:33996) 2023-09-30T22:30:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f4025d9b700 1 -- 172.21.15.59:0/2979728882 learned_addr learned my addr 172.21.15.59:0/2979728882 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f4025d9b700 1 -- 172.21.15.59:0/2979728882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f650 msgr2=0x7f4028131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f4025d9b700 1 --2- 172.21.15.59:0/2979728882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f650 0x7f4028131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f4025d9b700 1 -- 172.21.15.59:0/2979728882 >> v2:172.21.15.59:3300/0 conn(0x7f402809e930 msgr2=0x7f402809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f4025d9b700 1 --2- 172.21.15.59:0/2979728882 >> v2:172.21.15.59:3300/0 conn(0x7f402809e930 0x7f402809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f4025d9b700 1 -- 172.21.15.59:0/2979728882 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402809fb60 con 0x7f402809f240 2023-09-30T22:30:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f402659c700 1 --2- 172.21.15.59:0/2979728882 >> v2:172.21.15.59:3300/0 conn(0x7f402809e930 0x7f402809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f4026d9d700 1 --2- 172.21.15.59:0/2979728882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f650 0x7f4028131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.957+0000 7f4025d9b700 1 --2- 172.21.15.59:0/2979728882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809f240 0x7f40281317f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f40100098f0 tx=0x7f4010009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be791f4a8a093d40 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.958+0000 7f402559a700 1 -- 172.21.15.59:0/2979728882 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010011830 con 0x7f402809f240 2023-09-30T22:30:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.958+0000 7f402559a700 1 -- 172.21.15.59:0/2979728882 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4010011990 con 0x7f402809f240 2023-09-30T22:30:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.958+0000 7f402559a700 1 -- 172.21.15.59:0/2979728882 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010011d20 con 0x7f402809f240 2023-09-30T22:30:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.958+0000 7f402cb11700 1 -- 172.21.15.59:0/2979728882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809f240 msgr2=0x7f40281317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.958+0000 7f402cb11700 1 --2- 172.21.15.59:0/2979728882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809f240 0x7f40281317f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f40100098f0 tx=0x7f4010009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.958+0000 7f402cb11700 1 -- 172.21.15.59:0/2979728882 shutdown_connections 2023-09-30T22:30:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.958+0000 7f402cb11700 1 --2- 172.21.15.59:0/2979728882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f650 0x7f4028131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.958+0000 7f402cb11700 1 --2- 172.21.15.59:0/2979728882 >> v2:172.21.15.59:3300/0 conn(0x7f402809e930 0x7f402809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.958+0000 7f402cb11700 1 --2- 172.21.15.59:0/2979728882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809f240 0x7f40281317f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.958+0000 7f402cb11700 1 -- 172.21.15.59:0/2979728882 >> 172.21.15.59:0/2979728882 conn(0x7f40280a4210 msgr2=0x7f40280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.958+0000 7f402cb11700 1 -- 172.21.15.59:0/2979728882 shutdown_connections 2023-09-30T22:30:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.958+0000 7f402cb11700 1 -- 172.21.15.59:0/2979728882 wait complete. 2023-09-30T22:30:54.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.959+0000 7f402cb11700 1 Processor -- start 2023-09-30T22:30:54.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f402cb11700 1 -- start start 2023-09-30T22:30:54.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f402cb11700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809e930 0x7f402806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f402cb11700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809f240 0x7f402806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f402cb11700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402809f650 0x7f402806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f402cb11700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40281a9ca0 con 0x7f402809f650 2023-09-30T22:30:54.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f402cb11700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402806d430 con 0x7f402809f240 2023-09-30T22:30:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f402cb11700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40281a9900 con 0x7f402809e930 2023-09-30T22:30:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f4025d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809f240 0x7f402806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f4026d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402809f650 0x7f402806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f402659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809e930 0x7f402806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f4025d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809f240 0x7f402806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40242/0 (socket says 172.21.15.59:40242) 2023-09-30T22:30:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f4025d9b700 1 -- 172.21.15.59:0/3587672471 learned_addr learned my addr 172.21.15.59:0/3587672471 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f4025d9b700 1 -- 172.21.15.59:0/3587672471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809e930 msgr2=0x7f402806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f4025d9b700 1 --2- 172.21.15.59:0/3587672471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809e930 0x7f402806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f4025d9b700 1 -- 172.21.15.59:0/3587672471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402809f650 msgr2=0x7f402806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f4025d9b700 1 --2- 172.21.15.59:0/3587672471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402809f650 0x7f402806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.960+0000 7f4025d9b700 1 -- 172.21.15.59:0/3587672471 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40180094a0 con 0x7f402809f240 2023-09-30T22:30:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.961+0000 7f402659c700 1 --2- 172.21.15.59:0/3587672471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809e930 0x7f402806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.961+0000 7f4026d9d700 1 --2- 172.21.15.59:0/3587672471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402809f650 0x7f402806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.961+0000 7f4025d9b700 1 --2- 172.21.15.59:0/3587672471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809f240 0x7f402806bdf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4010000c00 tx=0x7f4010004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.961+0000 7f401effd700 1 -- 172.21.15.59:0/3587672471 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010004240 con 0x7f402809f240 2023-09-30T22:30:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.961+0000 7f401effd700 1 -- 172.21.15.59:0/3587672471 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401001f070 con 0x7f402809f240 2023-09-30T22:30:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.961+0000 7f402cb11700 1 -- 172.21.15.59:0/3587672471 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4020009a70 con 0x7f402809f240 2023-09-30T22:30:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.961+0000 7f401effd700 1 -- 172.21.15.59:0/3587672471 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40100045c0 con 0x7f402809f240 2023-09-30T22:30:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.961+0000 7f402cb11700 1 -- 172.21.15.59:0/3587672471 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4010009550 con 0x7f402809f240 2023-09-30T22:30:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.962+0000 7f401effd700 1 -- 172.21.15.59:0/3587672471 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4010021030 con 0x7f402809f240 2023-09-30T22:30:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.962+0000 7f401effd700 1 -- 172.21.15.59:0/3587672471 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f40100407c0 con 0x7f402809f240 2023-09-30T22:30:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.962+0000 7f402cb11700 1 -- 172.21.15.59:0/3587672471 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40281b72d0 con 0x7f402809f240 2023-09-30T22:30:54.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:54.967+0000 7f401effd700 1 -- 172.21.15.59:0/3587672471 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f401001a450 con 0x7f402809f240 2023-09-30T22:30:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.168+0000 7f402cb11700 1 -- 172.21.15.59:0/3587672471 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f402809a420 con 0x7f402809f240 2023-09-30T22:30:55.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.169+0000 7f401effd700 1 -- 172.21.15.59:0/3587672471 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40100233d0 con 0x7f402809f240 2023-09-30T22:30:55.169 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:55.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.171+0000 7f402cb11700 1 -- 172.21.15.59:0/3587672471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809f240 msgr2=0x7f402806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.171+0000 7f402cb11700 1 --2- 172.21.15.59:0/3587672471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809f240 0x7f402806bdf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4010000c00 tx=0x7f4010004750 comp rx=0 tx=0).stop 2023-09-30T22:30:55.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.171+0000 7f402cb11700 1 -- 172.21.15.59:0/3587672471 shutdown_connections 2023-09-30T22:30:55.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.171+0000 7f402cb11700 1 --2- 172.21.15.59:0/3587672471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809e930 0x7f402806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.171+0000 7f402cb11700 1 --2- 172.21.15.59:0/3587672471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402809f650 0x7f402806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.171+0000 7f402cb11700 1 --2- 172.21.15.59:0/3587672471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809f240 0x7f402806bdf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.171+0000 7f402cb11700 1 -- 172.21.15.59:0/3587672471 >> 172.21.15.59:0/3587672471 conn(0x7f40280a4210 msgr2=0x7f40281b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.171+0000 7f402cb11700 1 -- 172.21.15.59:0/3587672471 shutdown_connections 2023-09-30T22:30:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.171+0000 7f402cb11700 1 -- 172.21.15.59:0/3587672471 wait complete. 2023-09-30T22:30:55.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:55.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:55.298 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:55.299 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:55.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.411+0000 7fb1b04ec700 1 Processor -- start 2023-09-30T22:30:55.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.411+0000 7fb1b04ec700 1 -- start start 2023-09-30T22:30:55.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.412+0000 7fb1b04ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1a809d6f0 0x7fb1a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.412+0000 7fb1b04ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a809e000 0x7fb1a8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.412+0000 7fb1b04ec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb1a809e410 0x7fb1a8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.412+0000 7fb1b04ec700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a809f520 con 0x7fb1a809e410 2023-09-30T22:30:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.412+0000 7fb1b04ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a809f130 con 0x7fb1a809e000 2023-09-30T22:30:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.412+0000 7fb1b04ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a809e930 con 0x7fb1a809d6f0 2023-09-30T22:30:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.412+0000 7fb1aea89700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb1a809e410 0x7fb1a8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.412+0000 7fb1aea89700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb1a809e410 0x7fb1a8130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34026/0 (socket says 172.21.15.59:34026) 2023-09-30T22:30:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.412+0000 7fb1aea89700 1 -- 172.21.15.59:0/1414324495 learned_addr learned my addr 172.21.15.59:0/1414324495 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.412+0000 7fb1ae288700 1 --2- 172.21.15.59:0/1414324495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1a809d6f0 0x7fb1a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.412+0000 7fb1ada87700 1 --2- 172.21.15.59:0/1414324495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a809e000 0x7fb1a8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.412+0000 7fb1aea89700 1 -- 172.21.15.59:0/1414324495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1a809d6f0 msgr2=0x7fb1a809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.412+0000 7fb1aea89700 1 --2- 172.21.15.59:0/1414324495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1a809d6f0 0x7fb1a809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.412+0000 7fb1aea89700 1 -- 172.21.15.59:0/1414324495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a809e000 msgr2=0x7fb1a8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:55.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.412+0000 7fb1aea89700 1 --2- 172.21.15.59:0/1414324495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a809e000 0x7fb1a8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.413+0000 7fb1aea89700 1 -- 172.21.15.59:0/1414324495 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a809b2d0 con 0x7fb1a809e410 2023-09-30T22:30:55.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.413+0000 7fb1aea89700 1 --2- 172.21.15.59:0/1414324495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a809e410 0x7fb1a8130ba0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009e50 tx=0x7fb1a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eadf4e082985d93 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:55.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.413+0000 7fb1ad286700 1 -- 172.21.15.59:0/1414324495 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a000e070 con 0x7fb1a809e410 2023-09-30T22:30:55.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.413+0000 7fb1ad286700 1 -- 172.21.15.59:0/1414324495 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a000b910 con 0x7fb1a809e410 2023-09-30T22:30:55.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.413+0000 7fb1ad286700 1 -- 172.21.15.59:0/1414324495 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a000bcc0 con 0x7fb1a809e410 2023-09-30T22:30:55.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.414+0000 7fb1b04ec700 1 -- 172.21.15.59:0/1414324495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a809e410 msgr2=0x7fb1a8130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.414+0000 7fb1b04ec700 1 --2- 172.21.15.59:0/1414324495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a809e410 0x7fb1a8130ba0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009e50 tx=0x7fb1a000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:55.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.414+0000 7fb1b04ec700 1 -- 172.21.15.59:0/1414324495 shutdown_connections 2023-09-30T22:30:55.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.414+0000 7fb1b04ec700 1 --2- 172.21.15.59:0/1414324495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a809e410 0x7fb1a8130ba0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.414+0000 7fb1b04ec700 1 --2- 172.21.15.59:0/1414324495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1a809d6f0 0x7fb1a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.414+0000 7fb1b04ec700 1 --2- 172.21.15.59:0/1414324495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a809e000 0x7fb1a8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.414+0000 7fb1b04ec700 1 -- 172.21.15.59:0/1414324495 >> 172.21.15.59:0/1414324495 conn(0x7fb1a8066f50 msgr2=0x7fb1a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:55.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.414+0000 7fb1b04ec700 1 -- 172.21.15.59:0/1414324495 shutdown_connections 2023-09-30T22:30:55.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.414+0000 7fb1b04ec700 1 -- 172.21.15.59:0/1414324495 wait complete. 2023-09-30T22:30:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.416+0000 7fb1b04ec700 1 Processor -- start 2023-09-30T22:30:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.416+0000 7fb1b04ec700 1 -- start start 2023-09-30T22:30:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.416+0000 7fb1b04ec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a809d6f0 0x7fb1a81225d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.416+0000 7fb1b04ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1a809e000 0x7fb1a8122b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.416+0000 7fb1b04ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a809e410 0x7fb1a8123050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.416+0000 7fb1b04ec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a8125ef0 con 0x7fb1a809d6f0 2023-09-30T22:30:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.416+0000 7fb1b04ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a81260f0 con 0x7fb1a809e410 2023-09-30T22:30:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.416+0000 7fb1b04ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a8130940 con 0x7fb1a809e000 2023-09-30T22:30:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.417+0000 7fb1ada87700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1a809e000 0x7fb1a8122b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.417+0000 7fb1ae288700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a809d6f0 0x7fb1a81225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.417+0000 7fb1ada87700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1a809e000 0x7fb1a8122b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40906/0 (socket says 172.21.15.59:40906) 2023-09-30T22:30:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.417+0000 7fb1ada87700 1 -- 172.21.15.59:0/856250755 learned_addr learned my addr 172.21.15.59:0/856250755 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.417+0000 7fb1ae288700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a809d6f0 0x7fb1a81225d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34032/0 (socket says 172.21.15.59:34032) 2023-09-30T22:30:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.417+0000 7fb1aea89700 1 --2- 172.21.15.59:0/856250755 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a809e410 0x7fb1a8123050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.417+0000 7fb1ada87700 1 -- 172.21.15.59:0/856250755 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a809e410 msgr2=0x7fb1a8123050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.417+0000 7fb1ada87700 1 --2- 172.21.15.59:0/856250755 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a809e410 0x7fb1a8123050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.417+0000 7fb1ada87700 1 -- 172.21.15.59:0/856250755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a809d6f0 msgr2=0x7fb1a81225d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.417+0000 7fb1ada87700 1 --2- 172.21.15.59:0/856250755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a809d6f0 0x7fb1a81225d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.417+0000 7fb1ada87700 1 -- 172.21.15.59:0/856250755 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a0009b30 con 0x7fb1a809e000 2023-09-30T22:30:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.417+0000 7fb1ada87700 1 --2- 172.21.15.59:0/856250755 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1a809e000 0x7fb1a8122b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb19800e980 tx=0x7fb19800ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.418+0000 7fb19effd700 1 -- 172.21.15.59:0/856250755 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb198009710 con 0x7fb1a809e000 2023-09-30T22:30:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.418+0000 7fb19effd700 1 -- 172.21.15.59:0/856250755 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19800eed0 con 0x7fb1a809e000 2023-09-30T22:30:55.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.418+0000 7fb19effd700 1 -- 172.21.15.59:0/856250755 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19800ca70 con 0x7fb1a809e000 2023-09-30T22:30:55.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.418+0000 7fb1b04ec700 1 -- 172.21.15.59:0/856250755 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a8124280 con 0x7fb1a809e000 2023-09-30T22:30:55.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.418+0000 7fb1b04ec700 1 -- 172.21.15.59:0/856250755 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a8125b50 con 0x7fb1a809e000 2023-09-30T22:30:55.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.419+0000 7fb19effd700 1 -- 172.21.15.59:0/856250755 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb19800cbd0 con 0x7fb1a809e000 2023-09-30T22:30:55.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.420+0000 7fb1b04ec700 1 -- 172.21.15.59:0/856250755 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a8125d40 con 0x7fb1a809e000 2023-09-30T22:30:55.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.420+0000 7fb19effd700 1 -- 172.21.15.59:0/856250755 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb19803fb10 con 0x7fb1a809e000 2023-09-30T22:30:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.429+0000 7fb19effd700 1 -- 172.21.15.59:0/856250755 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb19801b3b0 con 0x7fb1a809e000 2023-09-30T22:30:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.451+0000 7fd639fac700 1 Processor -- start 2023-09-30T22:30:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.451+0000 7fd639fac700 1 -- start start 2023-09-30T22:30:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.452+0000 7fd639fac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63409d6f0 0x7fd63409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.452+0000 7fd639fac700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd63409e410 0x7fd634134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.452+0000 7fd639fac700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63409b120 con 0x7fd63409e000 2023-09-30T22:30:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.452+0000 7fd639fac700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63406b460 con 0x7fd63409e410 2023-09-30T22:30:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.452+0000 7fd639fac700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd63409a7e0 con 0x7fd63409d6f0 2023-09-30T22:30:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.452+0000 7fd633fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd63409e410 0x7fd634134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.452+0000 7fd633fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd63409e410 0x7fd634134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34042/0 (socket says 172.21.15.59:34042) 2023-09-30T22:30:55.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.452+0000 7fd633fff700 1 -- 172.21.15.59:0/3728341379 learned_addr learned my addr 172.21.15.59:0/3728341379 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:55.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.452+0000 7fd6337fe700 1 --2- 172.21.15.59:0/3728341379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63409d6f0 0x7fd63409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.452+0000 7fd6337fe700 1 -- 172.21.15.59:0/3728341379 >> v2:172.21.15.59:3300/0 conn(0x7fd63409e410 msgr2=0x7fd634134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:55.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.452+0000 7fd6337fe700 1 --2- 172.21.15.59:0/3728341379 >> v2:172.21.15.59:3300/0 conn(0x7fd63409e410 0x7fd634134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.452+0000 7fd6337fe700 1 -- 172.21.15.59:0/3728341379 >> v1:172.21.15.59:6789/0 conn(0x7fd63409e000 legacy=0x7fd6341339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.452+0000 7fd6337fe700 1 -- 172.21.15.59:0/3728341379 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63409a500 con 0x7fd63409d6f0 2023-09-30T22:30:55.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.453+0000 7fd6337fe700 1 --2- 172.21.15.59:0/3728341379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63409d6f0 0x7fd63409dac0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd624009870 tx=0x7fd624009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0104a9d3ae7b0c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:55.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.453+0000 7fd6327fc700 1 -- 172.21.15.59:0/3728341379 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624011830 con 0x7fd63409d6f0 2023-09-30T22:30:55.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.453+0000 7f4ef456f700 1 Processor -- start 2023-09-30T22:30:55.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.453+0000 7fd6327fc700 1 -- 172.21.15.59:0/3728341379 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd624011990 con 0x7fd63409d6f0 2023-09-30T22:30:55.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.453+0000 7fd6327fc700 1 -- 172.21.15.59:0/3728341379 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624011d20 con 0x7fd63409d6f0 2023-09-30T22:30:55.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.453+0000 7f4ef456f700 1 -- start start 2023-09-30T22:30:55.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7fd639fac700 1 -- 172.21.15.59:0/3728341379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63409d6f0 msgr2=0x7fd63409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7fd639fac700 1 --2- 172.21.15.59:0/3728341379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63409d6f0 0x7fd63409dac0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd624009870 tx=0x7fd624009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:55.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7fd639fac700 1 -- 172.21.15.59:0/3728341379 shutdown_connections 2023-09-30T22:30:55.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7fd639fac700 1 --2- 172.21.15.59:0/3728341379 >> v2:172.21.15.59:3300/0 conn(0x7fd63409e410 0x7fd634134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7fd639fac700 1 --2- 172.21.15.59:0/3728341379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63409d6f0 0x7fd63409dac0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7fd639fac700 1 -- 172.21.15.59:0/3728341379 >> 172.21.15.59:0/3728341379 conn(0x7fd634066f50 msgr2=0x7fd63409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:55.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7fd639fac700 1 -- 172.21.15.59:0/3728341379 shutdown_connections 2023-09-30T22:30:55.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7f4ef456f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4eec09d6f0 0x7f4eec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7f4ef456f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4eec09e000 0x7f4eec130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7f4ef456f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4eec09e410 0x7f4eec130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7f4ef456f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eec09f520 con 0x7f4eec09d6f0 2023-09-30T22:30:55.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7f4ef456f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec09f130 con 0x7f4eec09e410 2023-09-30T22:30:55.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7f4ef456f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec09e930 con 0x7f4eec09e000 2023-09-30T22:30:55.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7f4ef230b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4eec09d6f0 0x7f4eec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7f4ef230b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4eec09d6f0 0x7f4eec09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34046/0 (socket says 172.21.15.59:34046) 2023-09-30T22:30:55.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7f4ef230b700 1 -- 172.21.15.59:0/1591117939 learned_addr learned my addr 172.21.15.59:0/1591117939 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:55.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7f4ef2b0c700 1 --2- 172.21.15.59:0/1591117939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4eec09e410 0x7f4eec130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7fd639fac700 1 -- 172.21.15.59:0/3728341379 wait complete. 2023-09-30T22:30:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.454+0000 7f4ef1b0a700 1 --2- 172.21.15.59:0/1591117939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4eec09e000 0x7f4eec130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.455+0000 7f4ef2b0c700 1 -- 172.21.15.59:0/1591117939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4eec09e000 msgr2=0x7f4eec130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.455+0000 7f4ef2b0c700 1 --2- 172.21.15.59:0/1591117939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4eec09e000 0x7f4eec130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.455+0000 7f4ef2b0c700 1 -- 172.21.15.59:0/1591117939 >> v2:172.21.15.59:3300/0 conn(0x7f4eec09d6f0 msgr2=0x7f4eec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.455+0000 7f4ef2b0c700 1 --2- 172.21.15.59:0/1591117939 >> v2:172.21.15.59:3300/0 conn(0x7f4eec09d6f0 0x7f4eec09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.455+0000 7f4ef2b0c700 1 -- 172.21.15.59:0/1591117939 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec09b2d0 con 0x7f4eec09e410 2023-09-30T22:30:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.455+0000 7f4ef2b0c700 1 --2- 172.21.15.59:0/1591117939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4eec09e410 0x7f4eec130ba0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4009d90 tx=0x7f4ee400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1754b740984353ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.455+0000 7f4ef1309700 1 -- 172.21.15.59:0/1591117939 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee400e070 con 0x7f4eec09e410 2023-09-30T22:30:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.455+0000 7f4ef1309700 1 -- 172.21.15.59:0/1591117939 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee400bb20 con 0x7f4eec09e410 2023-09-30T22:30:55.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.455+0000 7f4ef1309700 1 -- 172.21.15.59:0/1591117939 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4012430 con 0x7f4eec09e410 2023-09-30T22:30:55.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.455+0000 7fd639fac700 1 Processor -- start 2023-09-30T22:30:55.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7fd639fac700 1 -- start start 2023-09-30T22:30:55.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7f4ef456f700 1 -- 172.21.15.59:0/1591117939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4eec09e410 msgr2=0x7f4eec130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7f4ef456f700 1 --2- 172.21.15.59:0/1591117939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4eec09e410 0x7f4eec130ba0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4009d90 tx=0x7f4ee400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7fd639fac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63409d6f0 0x7fd6341aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7fd639fac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd63409e000 0x7fd6341abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7fd639fac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63409e410 0x7fd6341ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7fd639fac700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6341af240 con 0x7fd63409d6f0 2023-09-30T22:30:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7fd639fac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6340a3320 con 0x7fd63409e000 2023-09-30T22:30:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7fd639fac700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd63409c710 con 0x7fd63409e410 2023-09-30T22:30:55.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7f4ef456f700 1 -- 172.21.15.59:0/1591117939 shutdown_connections 2023-09-30T22:30:55.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7f4ef456f700 1 --2- 172.21.15.59:0/1591117939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4eec09e410 0x7f4eec130ba0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7f4ef456f700 1 --2- 172.21.15.59:0/1591117939 >> v2:172.21.15.59:3300/0 conn(0x7f4eec09d6f0 0x7f4eec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7f4ef456f700 1 --2- 172.21.15.59:0/1591117939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4eec09e000 0x7f4eec130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7f4ef456f700 1 -- 172.21.15.59:0/1591117939 >> 172.21.15.59:0/1591117939 conn(0x7f4eec066f50 msgr2=0x7f4eec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:55.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7fd6337fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63409d6f0 0x7fd6341aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7fd632ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd63409e000 0x7fd6341abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7fd633fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63409e410 0x7fd6341ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7fd6337fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63409d6f0 0x7fd6341aba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34060/0 (socket says 172.21.15.59:34060) 2023-09-30T22:30:55.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.456+0000 7fd6337fe700 1 -- 172.21.15.59:0/1954098891 learned_addr learned my addr 172.21.15.59:0/1954098891 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:55.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.457+0000 7f4ef456f700 1 -- 172.21.15.59:0/1591117939 shutdown_connections 2023-09-30T22:30:55.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.457+0000 7f4ef456f700 1 -- 172.21.15.59:0/1591117939 wait complete. 2023-09-30T22:30:55.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.457+0000 7fd633fff700 1 -- 172.21.15.59:0/1954098891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd63409e000 msgr2=0x7fd6341abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.457+0000 7fd633fff700 1 --2- 172.21.15.59:0/1954098891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd63409e000 0x7fd6341abf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.457+0000 7fd633fff700 1 -- 172.21.15.59:0/1954098891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63409d6f0 msgr2=0x7fd6341aba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.457+0000 7fd633fff700 1 --2- 172.21.15.59:0/1954098891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63409d6f0 0x7fd6341aba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.457+0000 7fd633fff700 1 -- 172.21.15.59:0/1954098891 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6240094a0 con 0x7fd63409e410 2023-09-30T22:30:55.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.457+0000 7fd632ffd700 1 --2- 172.21.15.59:0/1954098891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd63409e000 0x7fd6341abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:55.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.457+0000 7fd633fff700 1 --2- 172.21.15.59:0/1954098891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63409e410 0x7fd6341ac480 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00efc0 tx=0x7fd62c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:55.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.457+0000 7fd61bfff700 1 -- 172.21.15.59:0/1954098891 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c003c20 con 0x7fd63409e410 2023-09-30T22:30:55.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.457+0000 7fd61bfff700 1 -- 172.21.15.59:0/1954098891 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c00f040 con 0x7fd63409e410 2023-09-30T22:30:55.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.457+0000 7fd639fac700 1 -- 172.21.15.59:0/1954098891 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6341ade00 con 0x7fd63409e410 2023-09-30T22:30:55.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.457+0000 7fd61bfff700 1 -- 172.21.15.59:0/1954098891 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c009e60 con 0x7fd63409e410 2023-09-30T22:30:55.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.458+0000 7fd639fac700 1 -- 172.21.15.59:0/1954098891 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6341af520 con 0x7fd63409e410 2023-09-30T22:30:55.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.458+0000 7f4ef456f700 1 Processor -- start 2023-09-30T22:30:55.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.458+0000 7f4ef456f700 1 -- start start 2023-09-30T22:30:55.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.458+0000 7f4ef456f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4eec09d6f0 0x7f4eec11df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.458+0000 7f4ef456f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4eec09e000 0x7f4eec11e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.458+0000 7f4ef456f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4eec09e410 0x7f4eec11e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.458+0000 7f4ef456f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec11fad0 con 0x7f4eec09d6f0 2023-09-30T22:30:55.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.458+0000 7f4ef456f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec120d20 con 0x7f4eec09e000 2023-09-30T22:30:55.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.458+0000 7f4ef456f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec1200b0 con 0x7f4eec09e410 2023-09-30T22:30:55.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.458+0000 7f4ef1b0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4eec09e000 0x7f4eec11e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.459+0000 7f4ef1b0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4eec09e000 0x7f4eec11e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40288/0 (socket says 172.21.15.59:40288) 2023-09-30T22:30:55.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.459+0000 7f4ef1b0a700 1 -- 172.21.15.59:0/3086323948 learned_addr learned my addr 172.21.15.59:0/3086323948 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:55.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.459+0000 7f4ef230b700 1 --2- 172.21.15.59:0/3086323948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4eec09d6f0 0x7f4eec11df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.459+0000 7f4ef1b0a700 1 -- 172.21.15.59:0/3086323948 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4eec09e410 msgr2=0x7f4eec11e990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:55.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.459+0000 7f4ef1b0a700 1 --2- 172.21.15.59:0/3086323948 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4eec09e410 0x7f4eec11e990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.459+0000 7f4ef1b0a700 1 -- 172.21.15.59:0/3086323948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4eec09d6f0 msgr2=0x7f4eec11df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.459+0000 7f4ef1b0a700 1 --2- 172.21.15.59:0/3086323948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4eec09d6f0 0x7f4eec11df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.459+0000 7f4ef1b0a700 1 -- 172.21.15.59:0/3086323948 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee4009a70 con 0x7f4eec09e000 2023-09-30T22:30:55.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.459+0000 7fd639fac700 1 -- 172.21.15.59:0/1954098891 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd634074ea0 con 0x7fd63409e410 2023-09-30T22:30:55.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.459+0000 7f4ef1b0a700 1 --2- 172.21.15.59:0/3086323948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4eec09e000 0x7f4eec11e450 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00e9e0 tx=0x7f4edc00ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:55.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.459+0000 7fd61bfff700 1 -- 172.21.15.59:0/1954098891 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd62c00c880 con 0x7fd63409e410 2023-09-30T22:30:55.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.460+0000 7f4ee2ffd700 1 -- 172.21.15.59:0/3086323948 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc009710 con 0x7f4eec09e000 2023-09-30T22:30:55.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.460+0000 7f4ee2ffd700 1 -- 172.21.15.59:0/3086323948 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4edc00c850 con 0x7f4eec09e000 2023-09-30T22:30:55.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.460+0000 7f4ee2ffd700 1 -- 172.21.15.59:0/3086323948 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc00cbc0 con 0x7f4eec09e000 2023-09-30T22:30:55.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.460+0000 7fd61bfff700 1 -- 172.21.15.59:0/1954098891 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd62c03fa90 con 0x7fd63409e410 2023-09-30T22:30:55.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.461+0000 7f4ef456f700 1 -- 172.21.15.59:0/3086323948 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec121700 con 0x7f4eec09e000 2023-09-30T22:30:55.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.461+0000 7f4ef456f700 1 -- 172.21.15.59:0/3086323948 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec09c700 con 0x7f4eec09e000 2023-09-30T22:30:55.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.461+0000 7f4ee2ffd700 1 -- 172.21.15.59:0/3086323948 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4edc00cd20 con 0x7f4eec09e000 2023-09-30T22:30:55.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.462+0000 7f4ef456f700 1 -- 172.21.15.59:0/3086323948 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eec074ea0 con 0x7f4eec09e000 2023-09-30T22:30:55.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.462+0000 7f4ee2ffd700 1 -- 172.21.15.59:0/3086323948 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4edc03f830 con 0x7f4eec09e000 2023-09-30T22:30:55.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.465+0000 7fd61bfff700 1 -- 172.21.15.59:0/1954098891 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd62c013bd0 con 0x7fd63409e410 2023-09-30T22:30:55.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.466+0000 7f4ee2ffd700 1 -- 172.21.15.59:0/3086323948 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4edc0232f0 con 0x7f4eec09e000 2023-09-30T22:30:55.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.649+0000 7fb1b04ec700 1 -- 172.21.15.59:0/856250755 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb1a81310c0 con 0x7fb1a809e000 2023-09-30T22:30:55.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.649+0000 7fb19effd700 1 -- 172.21.15.59:0/856250755 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1a81310c0 con 0x7fb1a809e000 2023-09-30T22:30:55.649 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:55.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.651+0000 7fb1b04ec700 1 -- 172.21.15.59:0/856250755 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1a809e000 msgr2=0x7fb1a8122b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.651+0000 7fb1b04ec700 1 --2- 172.21.15.59:0/856250755 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1a809e000 0x7fb1a8122b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb19800e980 tx=0x7fb19800ec90 comp rx=0 tx=0).stop 2023-09-30T22:30:55.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.651+0000 7fb1b04ec700 1 -- 172.21.15.59:0/856250755 shutdown_connections 2023-09-30T22:30:55.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.651+0000 7fb1b04ec700 1 --2- 172.21.15.59:0/856250755 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a809e410 0x7fb1a8123050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.651+0000 7fb1b04ec700 1 --2- 172.21.15.59:0/856250755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a809d6f0 0x7fb1a81225d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.651+0000 7fb1b04ec700 1 --2- 172.21.15.59:0/856250755 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1a809e000 0x7fb1a8122b10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.651+0000 7fb1b04ec700 1 -- 172.21.15.59:0/856250755 >> 172.21.15.59:0/856250755 conn(0x7fb1a8066f50 msgr2=0x7fb1a80a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:55.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.651+0000 7fb1b04ec700 1 -- 172.21.15.59:0/856250755 shutdown_connections 2023-09-30T22:30:55.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.651+0000 7fb1b04ec700 1 -- 172.21.15.59:0/856250755 wait complete. 2023-09-30T22:30:55.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:55.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.670+0000 7fd639fac700 1 -- 172.21.15.59:0/1954098891 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd63406c360 con 0x7fd63409e410 2023-09-30T22:30:55.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.671+0000 7fd61bfff700 1 -- 172.21.15.59:0/1954098891 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd62c014e00 con 0x7fd63409e410 2023-09-30T22:30:55.671 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:55.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.674+0000 7fd639fac700 1 -- 172.21.15.59:0/1954098891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63409e410 msgr2=0x7fd6341ac480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.674+0000 7fd639fac700 1 --2- 172.21.15.59:0/1954098891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63409e410 0x7fd6341ac480 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00efc0 tx=0x7fd62c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.674+0000 7fd639fac700 1 -- 172.21.15.59:0/1954098891 shutdown_connections 2023-09-30T22:30:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.674+0000 7fd639fac700 1 --2- 172.21.15.59:0/1954098891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63409e410 0x7fd6341ac480 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.674+0000 7fd639fac700 1 --2- 172.21.15.59:0/1954098891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63409d6f0 0x7fd6341aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.674+0000 7fd639fac700 1 --2- 172.21.15.59:0/1954098891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd63409e000 0x7fd6341abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.674+0000 7fd639fac700 1 -- 172.21.15.59:0/1954098891 >> 172.21.15.59:0/1954098891 conn(0x7fd634066f50 msgr2=0x7fd634071410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.674+0000 7fd639fac700 1 -- 172.21.15.59:0/1954098891 shutdown_connections 2023-09-30T22:30:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.674+0000 7fd639fac700 1 -- 172.21.15.59:0/1954098891 wait complete. 2023-09-30T22:30:55.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:55.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.697+0000 7f4ef456f700 1 -- 172.21.15.59:0/3086323948 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4eec06c360 con 0x7f4eec09e000 2023-09-30T22:30:55.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.697+0000 7f4ee2ffd700 1 -- 172.21.15.59:0/3086323948 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4edc01bba0 con 0x7f4eec09e000 2023-09-30T22:30:55.697 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:55.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.700+0000 7f4ef456f700 1 -- 172.21.15.59:0/3086323948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4eec09e000 msgr2=0x7f4eec11e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.700+0000 7f4ef456f700 1 --2- 172.21.15.59:0/3086323948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4eec09e000 0x7f4eec11e450 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00e9e0 tx=0x7f4edc00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.700+0000 7f4ef456f700 1 -- 172.21.15.59:0/3086323948 shutdown_connections 2023-09-30T22:30:55.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.700+0000 7f4ef456f700 1 --2- 172.21.15.59:0/3086323948 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4eec09e410 0x7f4eec11e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.700+0000 7f4ef456f700 1 --2- 172.21.15.59:0/3086323948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4eec09d6f0 0x7f4eec11df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.700+0000 7f4ef456f700 1 --2- 172.21.15.59:0/3086323948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4eec09e000 0x7f4eec11e450 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.700+0000 7f4ef456f700 1 -- 172.21.15.59:0/3086323948 >> 172.21.15.59:0/3086323948 conn(0x7f4eec066f50 msgr2=0x7f4eec0a1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:55.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.700+0000 7f4ef456f700 1 -- 172.21.15.59:0/3086323948 shutdown_connections 2023-09-30T22:30:55.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:55.700+0000 7f4ef456f700 1 -- 172.21.15.59:0/3086323948 wait complete. 2023-09-30T22:30:55.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:56.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:56.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.330+0000 7fe9d063a700 1 Processor -- start 2023-09-30T22:30:56.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.330+0000 7fe9d063a700 1 -- start start 2023-09-30T22:30:56.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.331+0000 7fe9d063a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9c809d6f0 0x7fe9c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.331+0000 7fe9d063a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c809e000 0x7fe9c8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.331+0000 7fe9d063a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c809e410 0x7fe9c8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.331+0000 7fe9d063a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c809f520 con 0x7fe9c809d6f0 2023-09-30T22:30:56.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.331+0000 7fe9d063a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c809f130 con 0x7fe9c809e410 2023-09-30T22:30:56.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.331+0000 7fe9d063a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c809e930 con 0x7fe9c809e000 2023-09-30T22:30:56.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9ce3d6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9c809d6f0 0x7fe9c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9cebd7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c809e410 0x7fe9c8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9ce3d6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9c809d6f0 0x7fe9c809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34082/0 (socket says 172.21.15.59:34082) 2023-09-30T22:30:56.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9ce3d6700 1 -- 172.21.15.59:0/2463630777 learned_addr learned my addr 172.21.15.59:0/2463630777 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:56.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9cdbd5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c809e000 0x7fe9c8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9ce3d6700 1 -- 172.21.15.59:0/2463630777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c809e000 msgr2=0x7fe9c8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9ce3d6700 1 --2- 172.21.15.59:0/2463630777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c809e000 0x7fe9c8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9ce3d6700 1 -- 172.21.15.59:0/2463630777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c809e410 msgr2=0x7fe9c8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9ce3d6700 1 --2- 172.21.15.59:0/2463630777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c809e410 0x7fe9c8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9ce3d6700 1 -- 172.21.15.59:0/2463630777 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c809b2d0 con 0x7fe9c809d6f0 2023-09-30T22:30:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9cdbd5700 1 --2- 172.21.15.59:0/2463630777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c809e000 0x7fe9c8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9cebd7700 1 --2- 172.21.15.59:0/2463630777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c809e410 0x7fe9c8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9ce3d6700 1 --2- 172.21.15.59:0/2463630777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c809d6f0 0x7fe9c809dac0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009920 tx=0x7fe9c4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83a6e10273a1307 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9cd3d4700 1 -- 172.21.15.59:0/2463630777 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4011830 con 0x7fe9c809d6f0 2023-09-30T22:30:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9cd3d4700 1 -- 172.21.15.59:0/2463630777 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c4011990 con 0x7fe9c809d6f0 2023-09-30T22:30:56.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.332+0000 7fe9cd3d4700 1 -- 172.21.15.59:0/2463630777 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4011d20 con 0x7fe9c809d6f0 2023-09-30T22:30:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.333+0000 7fe9d063a700 1 -- 172.21.15.59:0/2463630777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c809d6f0 msgr2=0x7fe9c809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.333+0000 7fe9d063a700 1 --2- 172.21.15.59:0/2463630777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c809d6f0 0x7fe9c809dac0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009920 tx=0x7fe9c4009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.333+0000 7fe9d063a700 1 -- 172.21.15.59:0/2463630777 shutdown_connections 2023-09-30T22:30:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.333+0000 7fe9d063a700 1 --2- 172.21.15.59:0/2463630777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c809e410 0x7fe9c8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.333+0000 7fe9d063a700 1 --2- 172.21.15.59:0/2463630777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c809d6f0 0x7fe9c809dac0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.333+0000 7fe9d063a700 1 --2- 172.21.15.59:0/2463630777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c809e000 0x7fe9c8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.333+0000 7fe9d063a700 1 -- 172.21.15.59:0/2463630777 >> 172.21.15.59:0/2463630777 conn(0x7fe9c8066f50 msgr2=0x7fe9c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.333+0000 7fe9d063a700 1 -- 172.21.15.59:0/2463630777 shutdown_connections 2023-09-30T22:30:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.333+0000 7fe9d063a700 1 -- 172.21.15.59:0/2463630777 wait complete. 2023-09-30T22:30:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.335+0000 7fe9d063a700 1 Processor -- start 2023-09-30T22:30:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.335+0000 7fe9d063a700 1 -- start start 2023-09-30T22:30:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.335+0000 7fe9d063a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c809d6f0 0x7fe9c81222d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.335+0000 7fe9d063a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c809e000 0x7fe9c8122810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.335+0000 7fe9d063a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c809e410 0x7fe9c8122d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.335+0000 7fe9d063a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c81254d0 con 0x7fe9c809e000 2023-09-30T22:30:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.335+0000 7fe9d063a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c8124780 con 0x7fe9c809d6f0 2023-09-30T22:30:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.335+0000 7fe9d063a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c8123ee0 con 0x7fe9c809e410 2023-09-30T22:30:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.335+0000 7fe9ce3d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c809d6f0 0x7fe9c81222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9cdbd5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c809e000 0x7fe9c8122810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9ce3d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c809d6f0 0x7fe9c81222d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40300/0 (socket says 172.21.15.59:40300) 2023-09-30T22:30:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9ce3d6700 1 -- 172.21.15.59:0/958229849 learned_addr learned my addr 172.21.15.59:0/958229849 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9cebd7700 1 --2- 172.21.15.59:0/958229849 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c809e410 0x7fe9c8122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9ce3d6700 1 -- 172.21.15.59:0/958229849 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c809e410 msgr2=0x7fe9c8122d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9ce3d6700 1 --2- 172.21.15.59:0/958229849 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c809e410 0x7fe9c8122d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9ce3d6700 1 -- 172.21.15.59:0/958229849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c809e000 msgr2=0x7fe9c8122810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9ce3d6700 1 --2- 172.21.15.59:0/958229849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c809e000 0x7fe9c8122810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9ce3d6700 1 -- 172.21.15.59:0/958229849 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9bc00ba70 con 0x7fe9c809d6f0 2023-09-30T22:30:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9cebd7700 1 --2- 172.21.15.59:0/958229849 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c809e410 0x7fe9c8122d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9cdbd5700 1 --2- 172.21.15.59:0/958229849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c809e000 0x7fe9c8122810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:56.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9ce3d6700 1 --2- 172.21.15.59:0/958229849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c809d6f0 0x7fe9c81222d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009c70 tx=0x7fe9c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9baffd700 1 -- 172.21.15.59:0/958229849 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4004240 con 0x7fe9c809d6f0 2023-09-30T22:30:56.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9baffd700 1 -- 172.21.15.59:0/958229849 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c401f070 con 0x7fe9c809d6f0 2023-09-30T22:30:56.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9d063a700 1 -- 172.21.15.59:0/958229849 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c0009a70 con 0x7fe9c809d6f0 2023-09-30T22:30:56.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9baffd700 1 -- 172.21.15.59:0/958229849 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c40045e0 con 0x7fe9c809d6f0 2023-09-30T22:30:56.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.336+0000 7fe9d063a700 1 -- 172.21.15.59:0/958229849 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c4009550 con 0x7fe9c809d6f0 2023-09-30T22:30:56.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.337+0000 7fe9baffd700 1 -- 172.21.15.59:0/958229849 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe9c4021030 con 0x7fe9c809d6f0 2023-09-30T22:30:56.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.337+0000 7fe9d063a700 1 -- 172.21.15.59:0/958229849 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c809c700 con 0x7fe9c809d6f0 2023-09-30T22:30:56.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.338+0000 7fe9baffd700 1 -- 172.21.15.59:0/958229849 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe9c4040790 con 0x7fe9c809d6f0 2023-09-30T22:30:56.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.342+0000 7fe9baffd700 1 -- 172.21.15.59:0/958229849 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9c4015070 con 0x7fe9c809d6f0 2023-09-30T22:30:56.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.547+0000 7fe9d063a700 1 -- 172.21.15.59:0/958229849 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe9c8074ea0 con 0x7fe9c809d6f0 2023-09-30T22:30:56.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.547+0000 7fe9baffd700 1 -- 172.21.15.59:0/958229849 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9c40197c0 con 0x7fe9c809d6f0 2023-09-30T22:30:56.547 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:56.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.549+0000 7fe9d063a700 1 -- 172.21.15.59:0/958229849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c809d6f0 msgr2=0x7fe9c81222d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.549+0000 7fe9d063a700 1 --2- 172.21.15.59:0/958229849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c809d6f0 0x7fe9c81222d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009c70 tx=0x7fe9c4004750 comp rx=0 tx=0).stop 2023-09-30T22:30:56.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.549+0000 7fe9d063a700 1 -- 172.21.15.59:0/958229849 shutdown_connections 2023-09-30T22:30:56.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.549+0000 7fe9d063a700 1 --2- 172.21.15.59:0/958229849 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c809e410 0x7fe9c8122d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.549+0000 7fe9d063a700 1 --2- 172.21.15.59:0/958229849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c809d6f0 0x7fe9c81222d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.549+0000 7fe9d063a700 1 --2- 172.21.15.59:0/958229849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c809e000 0x7fe9c8122810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.549+0000 7fe9d063a700 1 -- 172.21.15.59:0/958229849 >> 172.21.15.59:0/958229849 conn(0x7fe9c8066f50 msgr2=0x7fe9c8130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:56.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.549+0000 7fe9d063a700 1 -- 172.21.15.59:0/958229849 shutdown_connections 2023-09-30T22:30:56.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.549+0000 7fe9d063a700 1 -- 172.21.15.59:0/958229849 wait complete. 2023-09-30T22:30:56.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:56.666 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:56.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:56.714 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:56.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.818+0000 7f39416af700 1 Processor -- start 2023-09-30T22:30:56.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.818+0000 7f39416af700 1 -- start start 2023-09-30T22:30:56.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.818+0000 7f39416af700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f393c09e930 0x7f393c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.819+0000 7f39416af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f393c09f650 0x7f393c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.819+0000 7f39416af700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393c070940 con 0x7f393c09f240 2023-09-30T22:30:56.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.819+0000 7f39416af700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393c06fd60 con 0x7f393c09e930 2023-09-30T22:30:56.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.819+0000 7f39416af700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f393c06fa80 con 0x7f393c09f650 2023-09-30T22:30:56.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.819+0000 7f393b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f393c09f650 0x7f393c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.819+0000 7f393b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f393c09f650 0x7f393c131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40966/0 (socket says 172.21.15.59:40966) 2023-09-30T22:30:56.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.819+0000 7f393b7fe700 1 -- 172.21.15.59:0/259935494 learned_addr learned my addr 172.21.15.59:0/259935494 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:56.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.819+0000 7f393affd700 1 --2- 172.21.15.59:0/259935494 >> v2:172.21.15.59:3300/0 conn(0x7f393c09e930 0x7f393c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.819+0000 7f393affd700 1 -- 172.21.15.59:0/259935494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f393c09f650 msgr2=0x7f393c131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:56.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.819+0000 7f393affd700 1 --2- 172.21.15.59:0/259935494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f393c09f650 0x7f393c131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.819+0000 7f393affd700 1 -- 172.21.15.59:0/259935494 >> v1:172.21.15.59:6789/0 conn(0x7f393c09f240 legacy=0x7f393c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.819+0000 7f393affd700 1 -- 172.21.15.59:0/259935494 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c09fb60 con 0x7f393c09e930 2023-09-30T22:30:56.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.819+0000 7f393b7fe700 1 --2- 172.21.15.59:0/259935494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f393c09f650 0x7f393c131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:56.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.819+0000 7f393affd700 1 --2- 172.21.15.59:0/259935494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f393c09e930 0x7f393c09ed00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f392c009840 tx=0x7f392c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1cdf8214b86a85a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.820+0000 7f3939ffb700 1 -- 172.21.15.59:0/259935494 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c011830 con 0x7f393c09e930 2023-09-30T22:30:56.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.820+0000 7f3939ffb700 1 -- 172.21.15.59:0/259935494 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c011990 con 0x7f393c09e930 2023-09-30T22:30:56.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.820+0000 7f3939ffb700 1 -- 172.21.15.59:0/259935494 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c011d20 con 0x7f393c09e930 2023-09-30T22:30:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.820+0000 7f39416af700 1 -- 172.21.15.59:0/259935494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f393c09e930 msgr2=0x7f393c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.820+0000 7f39416af700 1 --2- 172.21.15.59:0/259935494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f393c09e930 0x7f393c09ed00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f392c009840 tx=0x7f392c009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.820+0000 7f39416af700 1 -- 172.21.15.59:0/259935494 shutdown_connections 2023-09-30T22:30:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.820+0000 7f39416af700 1 --2- 172.21.15.59:0/259935494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f393c09f650 0x7f393c131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.820+0000 7f39416af700 1 --2- 172.21.15.59:0/259935494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f393c09e930 0x7f393c09ed00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.820+0000 7f39416af700 1 -- 172.21.15.59:0/259935494 >> 172.21.15.59:0/259935494 conn(0x7f393c0a4210 msgr2=0x7f393c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.821+0000 7f39416af700 1 -- 172.21.15.59:0/259935494 shutdown_connections 2023-09-30T22:30:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.821+0000 7f39416af700 1 -- 172.21.15.59:0/259935494 wait complete. 2023-09-30T22:30:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.822+0000 7f39416af700 1 Processor -- start 2023-09-30T22:30:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.822+0000 7f39416af700 1 -- start start 2023-09-30T22:30:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.822+0000 7f39416af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f393c09e930 0x7f393c1a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.822+0000 7f39416af700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f393c09f240 0x7f393c1a40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.822+0000 7f39416af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f393c09f650 0x7f393c1a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.822+0000 7f39416af700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c1a76d0 con 0x7f393c09f240 2023-09-30T22:30:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.822+0000 7f39416af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393c1a6e60 con 0x7f393c09f650 2023-09-30T22:30:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.822+0000 7f39416af700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f393c0a3700 con 0x7f393c09e930 2023-09-30T22:30:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.822+0000 7f393affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f393c09e930 0x7f393c1a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.822+0000 7f393affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f393c09e930 0x7f393c1a3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40982/0 (socket says 172.21.15.59:40982) 2023-09-30T22:30:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.822+0000 7f393affd700 1 -- 172.21.15.59:0/343947852 learned_addr learned my addr 172.21.15.59:0/343947852 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.823+0000 7f393a7fc700 1 --2- 172.21.15.59:0/343947852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f393c09f240 0x7f393c1a40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.823+0000 7f393b7fe700 1 --2- 172.21.15.59:0/343947852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f393c09f650 0x7f393c1a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.823+0000 7f393affd700 1 -- 172.21.15.59:0/343947852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f393c09f650 msgr2=0x7f393c1a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.823+0000 7f393affd700 1 --2- 172.21.15.59:0/343947852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f393c09f650 0x7f393c1a4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.823+0000 7f393affd700 1 -- 172.21.15.59:0/343947852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f393c09f240 msgr2=0x7f393c1a40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.823+0000 7f393affd700 1 --2- 172.21.15.59:0/343947852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f393c09f240 0x7f393c1a40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.823+0000 7f393affd700 1 -- 172.21.15.59:0/343947852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3934009b30 con 0x7f393c09e930 2023-09-30T22:30:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.823+0000 7f393b7fe700 1 --2- 172.21.15.59:0/343947852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f393c09f650 0x7f393c1a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.823+0000 7f393affd700 1 --2- 172.21.15.59:0/343947852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f393c09e930 0x7f393c1a3bb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f392c009fd0 tx=0x7f392c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.823+0000 7f39237fe700 1 -- 172.21.15.59:0/343947852 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0036a0 con 0x7f393c09e930 2023-09-30T22:30:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.823+0000 7f39237fe700 1 -- 172.21.15.59:0/343947852 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c01f070 con 0x7f393c09e930 2023-09-30T22:30:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.823+0000 7f39416af700 1 -- 172.21.15.59:0/343947852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c0094a0 con 0x7f393c09e930 2023-09-30T22:30:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.823+0000 7f39237fe700 1 -- 172.21.15.59:0/343947852 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c003a60 con 0x7f393c09e930 2023-09-30T22:30:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.823+0000 7f39416af700 1 -- 172.21.15.59:0/343947852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393c0a0190 con 0x7f393c09e930 2023-09-30T22:30:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.824+0000 7f39416af700 1 -- 172.21.15.59:0/343947852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393c1a7090 con 0x7f393c09e930 2023-09-30T22:30:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.825+0000 7f39237fe700 1 -- 172.21.15.59:0/343947852 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f392c003bc0 con 0x7f393c09e930 2023-09-30T22:30:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.825+0000 7f39237fe700 1 -- 172.21.15.59:0/343947852 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f392c021070 con 0x7f393c09e930 2023-09-30T22:30:56.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.830+0000 7f39237fe700 1 -- 172.21.15.59:0/343947852 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f392c025db0 con 0x7f393c09e930 2023-09-30T22:30:56.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.853+0000 7f19604d5700 1 Processor -- start 2023-09-30T22:30:56.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.853+0000 7f19604d5700 1 -- start start 2023-09-30T22:30:56.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.854+0000 7f19604d5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1958133420 0x7f19581337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.854+0000 7f19604d5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1958134260 0x7f19581306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.854+0000 7f19604d5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195806b990 con 0x7f1958133e30 2023-09-30T22:30:56.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.854+0000 7f19604d5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19580a0590 con 0x7f1958133420 2023-09-30T22:30:56.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.854+0000 7f19604d5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f195809fb80 con 0x7f1958134260 2023-09-30T22:30:56.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.854+0000 7f195e271700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1958133420 0x7f19581337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.854+0000 7f195e271700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1958133420 0x7f19581337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34108/0 (socket says 172.21.15.59:34108) 2023-09-30T22:30:56.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.854+0000 7f195e271700 1 -- 172.21.15.59:0/4252919194 learned_addr learned my addr 172.21.15.59:0/4252919194 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:56.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.854+0000 7f195ea72700 1 --2- 172.21.15.59:0/4252919194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1958134260 0x7f19581306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.855+0000 7f195e271700 1 -- 172.21.15.59:0/4252919194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1958134260 msgr2=0x7f19581306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:56.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.855+0000 7f195e271700 1 --2- 172.21.15.59:0/4252919194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1958134260 0x7f19581306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.855+0000 7f195e271700 1 -- 172.21.15.59:0/4252919194 >> v1:172.21.15.59:6789/0 conn(0x7f1958133e30 legacy=0x7f195812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.855+0000 7f195e271700 1 -- 172.21.15.59:0/4252919194 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19580a0030 con 0x7f1958133420 2023-09-30T22:30:56.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.855+0000 7f195e271700 1 --2- 172.21.15.59:0/4252919194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1958133420 0x7f19581337f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1948009e50 tx=0x7f194800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468634e30fde4b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.855+0000 7f195d26f700 1 -- 172.21.15.59:0/4252919194 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194800e070 con 0x7f1958133420 2023-09-30T22:30:56.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.855+0000 7f195d26f700 1 -- 172.21.15.59:0/4252919194 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194800b910 con 0x7f1958133420 2023-09-30T22:30:56.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.855+0000 7f195d26f700 1 -- 172.21.15.59:0/4252919194 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194800bcc0 con 0x7f1958133420 2023-09-30T22:30:56.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.856+0000 7f19604d5700 1 -- 172.21.15.59:0/4252919194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1958133420 msgr2=0x7f19581337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.856+0000 7f19604d5700 1 --2- 172.21.15.59:0/4252919194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1958133420 0x7f19581337f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1948009e50 tx=0x7f194800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:56.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.856+0000 7f19604d5700 1 -- 172.21.15.59:0/4252919194 shutdown_connections 2023-09-30T22:30:56.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.856+0000 7f19604d5700 1 --2- 172.21.15.59:0/4252919194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1958134260 0x7f19581306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.856+0000 7f19604d5700 1 --2- 172.21.15.59:0/4252919194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1958133420 0x7f19581337f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.856+0000 7f19604d5700 1 -- 172.21.15.59:0/4252919194 >> 172.21.15.59:0/4252919194 conn(0x7f19580a4210 msgr2=0x7f19580a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:56.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.856+0000 7f19604d5700 1 -- 172.21.15.59:0/4252919194 shutdown_connections 2023-09-30T22:30:56.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.856+0000 7f19604d5700 1 -- 172.21.15.59:0/4252919194 wait complete. 2023-09-30T22:30:56.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.857+0000 7f19604d5700 1 Processor -- start 2023-09-30T22:30:56.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.858+0000 7f19604d5700 1 -- start start 2023-09-30T22:30:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.858+0000 7f19604d5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1958133420 0x7f195809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.858+0000 7f19604d5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1958133e30 0x7f195809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.858+0000 7f19604d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1958134260 0x7f195809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.858+0000 7f19604d5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195809d9e0 con 0x7f1958133e30 2023-09-30T22:30:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.858+0000 7f19604d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195811fce0 con 0x7f1958134260 2023-09-30T22:30:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.858+0000 7f19604d5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f195809dd80 con 0x7f1958133420 2023-09-30T22:30:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.858+0000 7f195e271700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1958133420 0x7f195809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.858+0000 7f195e271700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1958133420 0x7f195809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40996/0 (socket says 172.21.15.59:40996) 2023-09-30T22:30:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.858+0000 7f195e271700 1 -- 172.21.15.59:0/3784136501 learned_addr learned my addr 172.21.15.59:0/3784136501 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.858+0000 7f195da70700 1 --2- 172.21.15.59:0/3784136501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1958133e30 0x7f195809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.859+0000 7f195ea72700 1 --2- 172.21.15.59:0/3784136501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1958134260 0x7f195809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.859+0000 7f195e271700 1 -- 172.21.15.59:0/3784136501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1958134260 msgr2=0x7f195809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.859+0000 7f195e271700 1 --2- 172.21.15.59:0/3784136501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1958134260 0x7f195809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.859+0000 7f195e271700 1 -- 172.21.15.59:0/3784136501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1958133e30 msgr2=0x7f195809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.859+0000 7f195e271700 1 --2- 172.21.15.59:0/3784136501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1958133e30 0x7f195809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.859+0000 7f195e271700 1 -- 172.21.15.59:0/3784136501 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1948009b30 con 0x7f1958133420 2023-09-30T22:30:56.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.859+0000 7f195e271700 1 --2- 172.21.15.59:0/3784136501 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1958133420 0x7f195809c480 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f194800b370 tx=0x7f1948004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.859+0000 7f1956ffd700 1 -- 172.21.15.59:0/3784136501 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19480046a0 con 0x7f1958133420 2023-09-30T22:30:56.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.859+0000 7f1956ffd700 1 -- 172.21.15.59:0/3784136501 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19480092e0 con 0x7f1958133420 2023-09-30T22:30:56.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.859+0000 7f19604d5700 1 -- 172.21.15.59:0/3784136501 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1958120330 con 0x7f1958133420 2023-09-30T22:30:56.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.859+0000 7f1956ffd700 1 -- 172.21.15.59:0/3784136501 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194801c440 con 0x7f1958133420 2023-09-30T22:30:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.859+0000 7f19604d5700 1 -- 172.21.15.59:0/3784136501 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195811ff10 con 0x7f1958133420 2023-09-30T22:30:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.860+0000 7f1956ffd700 1 -- 172.21.15.59:0/3784136501 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f194801c5a0 con 0x7f1958133420 2023-09-30T22:30:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.860+0000 7f19604d5700 1 -- 172.21.15.59:0/3784136501 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1958120130 con 0x7f1958133420 2023-09-30T22:30:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.861+0000 7f1956ffd700 1 -- 172.21.15.59:0/3784136501 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1948041070 con 0x7f1958133420 2023-09-30T22:30:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.865+0000 7f1956ffd700 1 -- 172.21.15.59:0/3784136501 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f194802d760 con 0x7f1958133420 2023-09-30T22:30:56.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.897+0000 7fde012c2700 1 Processor -- start 2023-09-30T22:30:56.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.898+0000 7fde012c2700 1 -- start start 2023-09-30T22:30:56.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.898+0000 7fde012c2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fddfc09d6f0 0x7fddfc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.898+0000 7fde012c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddfc09e410 0x7fddfc130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.898+0000 7fde012c2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddfc09f130 con 0x7fddfc09e000 2023-09-30T22:30:56.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.898+0000 7fde012c2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddfc09f520 con 0x7fddfc09d6f0 2023-09-30T22:30:56.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.898+0000 7fde012c2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc09e930 con 0x7fddfc09e410 2023-09-30T22:30:56.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.899+0000 7fddfaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fddfc09d6f0 0x7fddfc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.899+0000 7fddfaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fddfc09d6f0 0x7fddfc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34130/0 (socket says 172.21.15.59:34130) 2023-09-30T22:30:56.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.899+0000 7fddfaffd700 1 -- 172.21.15.59:0/1890548852 learned_addr learned my addr 172.21.15.59:0/1890548852 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:56.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.899+0000 7fddfb7fe700 1 --2- 172.21.15.59:0/1890548852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddfc09e410 0x7fddfc130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.899+0000 7fddfaffd700 1 -- 172.21.15.59:0/1890548852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddfc09e410 msgr2=0x7fddfc130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:56.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.899+0000 7fddfaffd700 1 --2- 172.21.15.59:0/1890548852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddfc09e410 0x7fddfc130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.899+0000 7fddfaffd700 1 -- 172.21.15.59:0/1890548852 >> v1:172.21.15.59:6789/0 conn(0x7fddfc09e000 legacy=0x7fddfc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.899+0000 7fddfaffd700 1 -- 172.21.15.59:0/1890548852 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc09b2d0 con 0x7fddfc09d6f0 2023-09-30T22:30:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.899+0000 7fddfb7fe700 1 --2- 172.21.15.59:0/1890548852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddfc09e410 0x7fddfc130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.899+0000 7fddfaffd700 1 --2- 172.21.15.59:0/1890548852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddfc09d6f0 0x7fddfc09dac0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fddec0098f0 tx=0x7fddec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a005c441b51af0c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.899+0000 7fddf9ffb700 1 -- 172.21.15.59:0/1890548852 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec011830 con 0x7fddfc09d6f0 2023-09-30T22:30:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.900+0000 7fddf9ffb700 1 -- 172.21.15.59:0/1890548852 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec011990 con 0x7fddfc09d6f0 2023-09-30T22:30:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.900+0000 7fddf9ffb700 1 -- 172.21.15.59:0/1890548852 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec011d20 con 0x7fddfc09d6f0 2023-09-30T22:30:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.900+0000 7fde012c2700 1 -- 172.21.15.59:0/1890548852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddfc09d6f0 msgr2=0x7fddfc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.900+0000 7fde012c2700 1 --2- 172.21.15.59:0/1890548852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddfc09d6f0 0x7fddfc09dac0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fddec0098f0 tx=0x7fddec009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.900+0000 7fde012c2700 1 -- 172.21.15.59:0/1890548852 shutdown_connections 2023-09-30T22:30:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.900+0000 7fde012c2700 1 --2- 172.21.15.59:0/1890548852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddfc09d6f0 0x7fddfc09dac0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.900+0000 7fde012c2700 1 --2- 172.21.15.59:0/1890548852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddfc09e410 0x7fddfc130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.900+0000 7fde012c2700 1 -- 172.21.15.59:0/1890548852 >> 172.21.15.59:0/1890548852 conn(0x7fddfc066f50 msgr2=0x7fddfc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:56.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.900+0000 7fde012c2700 1 -- 172.21.15.59:0/1890548852 shutdown_connections 2023-09-30T22:30:56.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.900+0000 7fde012c2700 1 -- 172.21.15.59:0/1890548852 wait complete. 2023-09-30T22:30:56.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.901+0000 7fde012c2700 1 Processor -- start 2023-09-30T22:30:56.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.902+0000 7fde012c2700 1 -- start start 2023-09-30T22:30:56.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.902+0000 7fde012c2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddfc09d6f0 0x7fddfc1c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.902+0000 7fde012c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddfc09e000 0x7fddfc1c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.902+0000 7fde012c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddfc09e410 0x7fddfc06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.902+0000 7fde012c2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc06fd40 con 0x7fddfc09d6f0 2023-09-30T22:30:56.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.902+0000 7fde012c2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc09c770 con 0x7fddfc09e410 2023-09-30T22:30:56.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.902+0000 7fde012c2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc070570 con 0x7fddfc09e000 2023-09-30T22:30:56.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.902+0000 7fddfaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddfc09d6f0 0x7fddfc1c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.902+0000 7fddfa7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddfc09e000 0x7fddfc1c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.902+0000 7fddfaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddfc09d6f0 0x7fddfc1c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34136/0 (socket says 172.21.15.59:34136) 2023-09-30T22:30:56.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.902+0000 7fddfaffd700 1 -- 172.21.15.59:0/3999550167 learned_addr learned my addr 172.21.15.59:0/3999550167 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:56.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.902+0000 7fddfb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddfc09e410 0x7fddfc06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.903+0000 7fddfaffd700 1 -- 172.21.15.59:0/3999550167 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddfc09e000 msgr2=0x7fddfc1c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.903+0000 7fddfaffd700 1 --2- 172.21.15.59:0/3999550167 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddfc09e000 0x7fddfc1c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.903+0000 7fddfaffd700 1 -- 172.21.15.59:0/3999550167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddfc09e410 msgr2=0x7fddfc06e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.903+0000 7fddfaffd700 1 --2- 172.21.15.59:0/3999550167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddfc09e410 0x7fddfc06e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.903+0000 7fddfaffd700 1 -- 172.21.15.59:0/3999550167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf4009a70 con 0x7fddfc09d6f0 2023-09-30T22:30:56.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.903+0000 7fddfaffd700 1 --2- 172.21.15.59:0/3999550167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddfc09d6f0 0x7fddfc1c87c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fddec009c40 tx=0x7fddec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.903+0000 7fdde37fe700 1 -- 172.21.15.59:0/3999550167 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0043c0 con 0x7fddfc09d6f0 2023-09-30T22:30:56.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.903+0000 7fdde37fe700 1 -- 172.21.15.59:0/3999550167 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec01f070 con 0x7fddfc09d6f0 2023-09-30T22:30:56.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.903+0000 7fdde37fe700 1 -- 172.21.15.59:0/3999550167 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0036a0 con 0x7fddfc09d6f0 2023-09-30T22:30:56.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.903+0000 7fde012c2700 1 -- 172.21.15.59:0/3999550167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec009550 con 0x7fddfc09d6f0 2023-09-30T22:30:56.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.903+0000 7fde012c2700 1 -- 172.21.15.59:0/3999550167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc124aa0 con 0x7fddfc09d6f0 2023-09-30T22:30:56.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.904+0000 7fdde37fe700 1 -- 172.21.15.59:0/3999550167 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddec021030 con 0x7fddfc09d6f0 2023-09-30T22:30:56.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.904+0000 7fde012c2700 1 -- 172.21.15.59:0/3999550167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddfc074ea0 con 0x7fddfc09d6f0 2023-09-30T22:30:56.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.904+0000 7fdde37fe700 1 -- 172.21.15.59:0/3999550167 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fddec040a60 con 0x7fddfc09d6f0 2023-09-30T22:30:56.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:56.909+0000 7fdde37fe700 1 -- 172.21.15.59:0/3999550167 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddec019770 con 0x7fddfc09d6f0 2023-09-30T22:30:57.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.038+0000 7f39416af700 1 -- 172.21.15.59:0/343947852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f393c1a5820 con 0x7f393c09e930 2023-09-30T22:30:57.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.038+0000 7f39237fe700 1 -- 172.21.15.59:0/343947852 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f392c025bd0 con 0x7f393c09e930 2023-09-30T22:30:57.038 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:57.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.040+0000 7f39416af700 1 -- 172.21.15.59:0/343947852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f393c09e930 msgr2=0x7f393c1a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.040+0000 7f39416af700 1 --2- 172.21.15.59:0/343947852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f393c09e930 0x7f393c1a3bb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f392c009fd0 tx=0x7f392c004750 comp rx=0 tx=0).stop 2023-09-30T22:30:57.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.040+0000 7f39416af700 1 -- 172.21.15.59:0/343947852 shutdown_connections 2023-09-30T22:30:57.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.040+0000 7f39416af700 1 --2- 172.21.15.59:0/343947852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f393c09e930 0x7f393c1a3bb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.040+0000 7f39416af700 1 --2- 172.21.15.59:0/343947852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f393c09f650 0x7f393c1a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.040+0000 7f39416af700 1 --2- 172.21.15.59:0/343947852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f393c09f240 0x7f393c1a40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.040+0000 7f39416af700 1 -- 172.21.15.59:0/343947852 >> 172.21.15.59:0/343947852 conn(0x7f393c0a4210 msgr2=0x7f393c1b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:57.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.040+0000 7f39416af700 1 -- 172.21.15.59:0/343947852 shutdown_connections 2023-09-30T22:30:57.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.040+0000 7f39416af700 1 -- 172.21.15.59:0/343947852 wait complete. 2023-09-30T22:30:57.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:57.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.077+0000 7f19604d5700 1 -- 172.21.15.59:0/3784136501 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1958120330 con 0x7f1958133420 2023-09-30T22:30:57.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.077+0000 7f1956ffd700 1 -- 172.21.15.59:0/3784136501 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1958120330 con 0x7f1958133420 2023-09-30T22:30:57.078 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:57.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.080+0000 7f19604d5700 1 -- 172.21.15.59:0/3784136501 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1958133420 msgr2=0x7f195809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.080+0000 7f19604d5700 1 --2- 172.21.15.59:0/3784136501 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1958133420 0x7f195809c480 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f194800b370 tx=0x7f1948004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.080+0000 7f19604d5700 1 -- 172.21.15.59:0/3784136501 shutdown_connections 2023-09-30T22:30:57.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.080+0000 7f19604d5700 1 --2- 172.21.15.59:0/3784136501 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1958133420 0x7f195809c480 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.080+0000 7f19604d5700 1 --2- 172.21.15.59:0/3784136501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1958134260 0x7f195809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.080+0000 7f19604d5700 1 --2- 172.21.15.59:0/3784136501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1958133e30 0x7f195809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.080+0000 7f19604d5700 1 -- 172.21.15.59:0/3784136501 >> 172.21.15.59:0/3784136501 conn(0x7f19580a4210 msgr2=0x7f19580a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:57.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.080+0000 7f19604d5700 1 -- 172.21.15.59:0/3784136501 shutdown_connections 2023-09-30T22:30:57.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.080+0000 7f19604d5700 1 -- 172.21.15.59:0/3784136501 wait complete. 2023-09-30T22:30:57.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:57.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.120+0000 7fde012c2700 1 -- 172.21.15.59:0/3999550167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fddfc0a2180 con 0x7fddfc09d6f0 2023-09-30T22:30:57.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.120+0000 7fdde37fe700 1 -- 172.21.15.59:0/3999550167 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddec015020 con 0x7fddfc09d6f0 2023-09-30T22:30:57.120 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:57.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.122+0000 7fde012c2700 1 -- 172.21.15.59:0/3999550167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddfc09d6f0 msgr2=0x7fddfc1c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.122+0000 7fde012c2700 1 --2- 172.21.15.59:0/3999550167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddfc09d6f0 0x7fddfc1c87c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fddec009c40 tx=0x7fddec004750 comp rx=0 tx=0).stop 2023-09-30T22:30:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.122+0000 7fde012c2700 1 -- 172.21.15.59:0/3999550167 shutdown_connections 2023-09-30T22:30:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.122+0000 7fde012c2700 1 --2- 172.21.15.59:0/3999550167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddfc09e410 0x7fddfc06e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.122+0000 7fde012c2700 1 --2- 172.21.15.59:0/3999550167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddfc09d6f0 0x7fddfc1c87c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.122+0000 7fde012c2700 1 --2- 172.21.15.59:0/3999550167 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddfc09e000 0x7fddfc1c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.122+0000 7fde012c2700 1 -- 172.21.15.59:0/3999550167 >> 172.21.15.59:0/3999550167 conn(0x7fddfc066f50 msgr2=0x7fddfc0711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.122+0000 7fde012c2700 1 -- 172.21.15.59:0/3999550167 shutdown_connections 2023-09-30T22:30:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.122+0000 7fde012c2700 1 -- 172.21.15.59:0/3999550167 wait complete. 2023-09-30T22:30:57.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:57.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.714+0000 7f11d6455700 1 Processor -- start 2023-09-30T22:30:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.714+0000 7f11d6455700 1 -- start start 2023-09-30T22:30:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.714+0000 7f11d6455700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0096390 0x7f11d0136670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.714+0000 7f11d6455700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f11d0136bb0 0x7f11d0138f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.714+0000 7f11d6455700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d0131460 con 0x7f11d0131870 2023-09-30T22:30:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.714+0000 7f11d6455700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d0097550 con 0x7f11d0136bb0 2023-09-30T22:30:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.714+0000 7f11d6455700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d009e400 con 0x7f11d0096390 2023-09-30T22:30:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.714+0000 7f11d49f2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f11d0136bb0 0x7f11d0138f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.714+0000 7f11cf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0096390 0x7f11d0136670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.714+0000 7f11d49f2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f11d0136bb0 0x7f11d0138f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34152/0 (socket says 172.21.15.59:34152) 2023-09-30T22:30:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.714+0000 7f11d49f2700 1 -- 172.21.15.59:0/3841456283 learned_addr learned my addr 172.21.15.59:0/3841456283 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.715+0000 7f11cf7fe700 1 -- 172.21.15.59:0/3841456283 >> v2:172.21.15.59:3300/0 conn(0x7f11d0136bb0 msgr2=0x7f11d0138f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.715+0000 7f11cf7fe700 1 --2- 172.21.15.59:0/3841456283 >> v2:172.21.15.59:3300/0 conn(0x7f11d0136bb0 0x7f11d0138f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.715+0000 7f11cf7fe700 1 -- 172.21.15.59:0/3841456283 >> v1:172.21.15.59:6789/0 conn(0x7f11d0131870 legacy=0x7f11d0131c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.715+0000 7f11cf7fe700 1 -- 172.21.15.59:0/3841456283 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d00968a0 con 0x7f11d0096390 2023-09-30T22:30:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.715+0000 7f11d49f2700 1 --2- 172.21.15.59:0/3841456283 >> v2:172.21.15.59:3300/0 conn(0x7f11d0136bb0 0x7f11d0138f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.715+0000 7f11ceffd700 1 -- 172.21.15.59:0/3841456283 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561071342 0 0) 0x7f11d0131460 con 0x7f11d0131870 2023-09-30T22:30:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.715+0000 7f11cf7fe700 1 --2- 172.21.15.59:0/3841456283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0096390 0x7f11d0136670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009840 tx=0x7f11c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=949676a972396d74 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.715+0000 7f11ceffd700 1 -- 172.21.15.59:0/3841456283 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4011830 con 0x7f11d0096390 2023-09-30T22:30:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.715+0000 7f11ceffd700 1 -- 172.21.15.59:0/3841456283 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c4011990 con 0x7f11d0096390 2023-09-30T22:30:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.715+0000 7f11ceffd700 1 -- 172.21.15.59:0/3841456283 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4011d20 con 0x7f11d0096390 2023-09-30T22:30:57.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.716+0000 7f11d6455700 1 -- 172.21.15.59:0/3841456283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0096390 msgr2=0x7f11d0136670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.716+0000 7f11d6455700 1 --2- 172.21.15.59:0/3841456283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0096390 0x7f11d0136670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009840 tx=0x7f11c4009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:57.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.716+0000 7f11d6455700 1 -- 172.21.15.59:0/3841456283 shutdown_connections 2023-09-30T22:30:57.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.716+0000 7f11d6455700 1 --2- 172.21.15.59:0/3841456283 >> v2:172.21.15.59:3300/0 conn(0x7f11d0136bb0 0x7f11d0138f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.716+0000 7f11d6455700 1 --2- 172.21.15.59:0/3841456283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0096390 0x7f11d0136670 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.716+0000 7f11d6455700 1 -- 172.21.15.59:0/3841456283 >> 172.21.15.59:0/3841456283 conn(0x7f11d00a2360 msgr2=0x7f11d00a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:57.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.716+0000 7f11d6455700 1 -- 172.21.15.59:0/3841456283 shutdown_connections 2023-09-30T22:30:57.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.716+0000 7f11d6455700 1 -- 172.21.15.59:0/3841456283 wait complete. 2023-09-30T22:30:57.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.717+0000 7f11d6455700 1 Processor -- start 2023-09-30T22:30:57.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.717+0000 7f11d6455700 1 -- start start 2023-09-30T22:30:57.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.717+0000 7f11d6455700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d0096390 0x7f11d006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11d6455700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0131870 0x7f11d0070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11d6455700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d0136bb0 0x7f11d00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11d6455700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d0127340 con 0x7f11d0096390 2023-09-30T22:30:57.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11d6455700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d0098a90 con 0x7f11d0131870 2023-09-30T22:30:57.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11d6455700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11d0127550 con 0x7f11d0136bb0 2023-09-30T22:30:57.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11cf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0131870 0x7f11d0070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11cf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0131870 0x7f11d0070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40334/0 (socket says 172.21.15.59:40334) 2023-09-30T22:30:57.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11cf7fe700 1 -- 172.21.15.59:0/2319861978 learned_addr learned my addr 172.21.15.59:0/2319861978 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:57.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11cffff700 1 --2- 172.21.15.59:0/2319861978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d0096390 0x7f11d006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11d49f2700 1 --2- 172.21.15.59:0/2319861978 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d0136bb0 0x7f11d00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11cf7fe700 1 -- 172.21.15.59:0/2319861978 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d0136bb0 msgr2=0x7f11d00707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11cf7fe700 1 --2- 172.21.15.59:0/2319861978 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d0136bb0 0x7f11d00707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11cf7fe700 1 -- 172.21.15.59:0/2319861978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d0096390 msgr2=0x7f11d006fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11cf7fe700 1 --2- 172.21.15.59:0/2319861978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d0096390 0x7f11d006fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11cf7fe700 1 -- 172.21.15.59:0/2319861978 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c8009b30 con 0x7f11d0131870 2023-09-30T22:30:57.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11cf7fe700 1 --2- 172.21.15.59:0/2319861978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0131870 0x7f11d0070290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f11c40090b0 tx=0x7f11c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:57.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11ccff9700 1 -- 172.21.15.59:0/2319861978 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c40036a0 con 0x7f11d0131870 2023-09-30T22:30:57.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11ccff9700 1 -- 172.21.15.59:0/2319861978 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c401f070 con 0x7f11d0131870 2023-09-30T22:30:57.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11d6455700 1 -- 172.21.15.59:0/2319861978 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c40094a0 con 0x7f11d0131870 2023-09-30T22:30:57.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11ccff9700 1 -- 172.21.15.59:0/2319861978 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4003a60 con 0x7f11d0131870 2023-09-30T22:30:57.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.718+0000 7f11d6455700 1 -- 172.21.15.59:0/2319861978 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d0127810 con 0x7f11d0131870 2023-09-30T22:30:57.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.719+0000 7f11ccff9700 1 -- 172.21.15.59:0/2319861978 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11c4003bc0 con 0x7f11d0131870 2023-09-30T22:30:57.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.719+0000 7f11ccff9700 1 -- 172.21.15.59:0/2319861978 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f11c4021070 con 0x7f11d0131870 2023-09-30T22:30:57.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.719+0000 7f11d6455700 1 -- 172.21.15.59:0/2319861978 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d0074ea0 con 0x7f11d0131870 2023-09-30T22:30:57.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.724+0000 7f11ccff9700 1 -- 172.21.15.59:0/2319861978 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11c4015020 con 0x7f11d0131870 2023-09-30T22:30:57.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.931+0000 7f11d6455700 1 -- 172.21.15.59:0/2319861978 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f11d006b700 con 0x7f11d0131870 2023-09-30T22:30:57.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.931+0000 7f11ccff9700 1 -- 172.21.15.59:0/2319861978 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11c4026480 con 0x7f11d0131870 2023-09-30T22:30:57.931 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:57.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.933+0000 7f11d6455700 1 -- 172.21.15.59:0/2319861978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0131870 msgr2=0x7f11d0070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.933+0000 7f11d6455700 1 --2- 172.21.15.59:0/2319861978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0131870 0x7f11d0070290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f11c40090b0 tx=0x7f11c4004750 comp rx=0 tx=0).stop 2023-09-30T22:30:57.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.933+0000 7f11d6455700 1 -- 172.21.15.59:0/2319861978 shutdown_connections 2023-09-30T22:30:57.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.933+0000 7f11d6455700 1 --2- 172.21.15.59:0/2319861978 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d0136bb0 0x7f11d00707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.933+0000 7f11d6455700 1 --2- 172.21.15.59:0/2319861978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d0096390 0x7f11d006fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.933+0000 7f11d6455700 1 --2- 172.21.15.59:0/2319861978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0131870 0x7f11d0070290 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.934+0000 7f11d6455700 1 -- 172.21.15.59:0/2319861978 >> 172.21.15.59:0/2319861978 conn(0x7f11d00a2360 msgr2=0x7f11d0097760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:57.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.934+0000 7f11d6455700 1 -- 172.21.15.59:0/2319861978 shutdown_connections 2023-09-30T22:30:57.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:57.934+0000 7f11d6455700 1 -- 172.21.15.59:0/2319861978 wait complete. 2023-09-30T22:30:57.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:58.055 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:58.094 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:58.136 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:58.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.201+0000 7f8f8f1fa700 1 Processor -- start 2023-09-30T22:30:58.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.201+0000 7f8f8f1fa700 1 -- start start 2023-09-30T22:30:58.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f8f1fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8806a770 0x7f8f8806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f8f1fa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f8806b080 0x7f8f88131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f8f1fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f88131b40 0x7f8f88131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f8f1fa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8809ece0 con 0x7f8f8806b080 2023-09-30T22:30:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f8f1fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8809e760 con 0x7f8f8806a770 2023-09-30T22:30:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f8f1fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8809e040 con 0x7f8f88131b40 2023-09-30T22:30:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f8cf96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8806a770 0x7f8f8806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f8cf96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8806a770 0x7f8f8806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40350/0 (socket says 172.21.15.59:40350) 2023-09-30T22:30:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f87fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f8806b080 0x7f8f88131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f8cf96700 1 -- 172.21.15.59:0/1823190832 learned_addr learned my addr 172.21.15.59:0/1823190832 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f8d797700 1 --2- 172.21.15.59:0/1823190832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f88131b40 0x7f8f88131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f8cf96700 1 -- 172.21.15.59:0/1823190832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f88131b40 msgr2=0x7f8f88131fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f8cf96700 1 --2- 172.21.15.59:0/1823190832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f88131b40 0x7f8f88131fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f8cf96700 1 -- 172.21.15.59:0/1823190832 >> v2:172.21.15.59:3300/0 conn(0x7f8f8806b080 msgr2=0x7f8f88131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f8cf96700 1 --2- 172.21.15.59:0/1823190832 >> v2:172.21.15.59:3300/0 conn(0x7f8f8806b080 0x7f8f88131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.202+0000 7f8f8cf96700 1 -- 172.21.15.59:0/1823190832 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8809f630 con 0x7f8f8806a770 2023-09-30T22:30:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.203+0000 7f8f87fff700 1 --2- 172.21.15.59:0/1823190832 >> v2:172.21.15.59:3300/0 conn(0x7f8f8806b080 0x7f8f88131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.203+0000 7f8f8cf96700 1 --2- 172.21.15.59:0/1823190832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8806a770 0x7f8f8806ab40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0098f0 tx=0x7f8f7c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14308e09aeb8419b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.203+0000 7f8f877fe700 1 -- 172.21.15.59:0/1823190832 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c011830 con 0x7f8f8806a770 2023-09-30T22:30:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.203+0000 7f8f877fe700 1 -- 172.21.15.59:0/1823190832 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7c011990 con 0x7f8f8806a770 2023-09-30T22:30:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.203+0000 7f8f877fe700 1 -- 172.21.15.59:0/1823190832 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c011d20 con 0x7f8f8806a770 2023-09-30T22:30:58.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.204+0000 7f8f8f1fa700 1 -- 172.21.15.59:0/1823190832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8806a770 msgr2=0x7f8f8806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.204+0000 7f8f8f1fa700 1 --2- 172.21.15.59:0/1823190832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8806a770 0x7f8f8806ab40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0098f0 tx=0x7f8f7c009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:58.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.204+0000 7f8f8f1fa700 1 -- 172.21.15.59:0/1823190832 shutdown_connections 2023-09-30T22:30:58.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.204+0000 7f8f8f1fa700 1 --2- 172.21.15.59:0/1823190832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f88131b40 0x7f8f88131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.204+0000 7f8f8f1fa700 1 --2- 172.21.15.59:0/1823190832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8806a770 0x7f8f8806ab40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.204+0000 7f8f8f1fa700 1 --2- 172.21.15.59:0/1823190832 >> v2:172.21.15.59:3300/0 conn(0x7f8f8806b080 0x7f8f88131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.204+0000 7f8f8f1fa700 1 -- 172.21.15.59:0/1823190832 >> 172.21.15.59:0/1823190832 conn(0x7f8f88066f50 msgr2=0x7f8f8809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:58.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.204+0000 7f8f8f1fa700 1 -- 172.21.15.59:0/1823190832 shutdown_connections 2023-09-30T22:30:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.204+0000 7f8f8f1fa700 1 -- 172.21.15.59:0/1823190832 wait complete. 2023-09-30T22:30:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.205+0000 7f8f8f1fa700 1 Processor -- start 2023-09-30T22:30:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.205+0000 7f8f8f1fa700 1 -- start start 2023-09-30T22:30:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.206+0000 7f8f8f1fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f8806a770 0x7f8f8809a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.206+0000 7f8f8f1fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8806b080 0x7f8f8809a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.206+0000 7f8f8f1fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f88131b40 0x7f8f8809ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.206+0000 7f8f8f1fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8809c010 con 0x7f8f88131b40 2023-09-30T22:30:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.206+0000 7f8f8f1fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f881258d0 con 0x7f8f8806b080 2023-09-30T22:30:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.206+0000 7f8f8f1fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8809b860 con 0x7f8f8806a770 2023-09-30T22:30:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.207+0000 7f8f87fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8806b080 0x7f8f8809a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.207+0000 7f8f87fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8806b080 0x7f8f8809a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40356/0 (socket says 172.21.15.59:40356) 2023-09-30T22:30:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.207+0000 7f8f87fff700 1 -- 172.21.15.59:0/3538832599 learned_addr learned my addr 172.21.15.59:0/3538832599 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.207+0000 7f8f8cf96700 1 --2- 172.21.15.59:0/3538832599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f8806a770 0x7f8f8809a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.207+0000 7f8f8d797700 1 --2- 172.21.15.59:0/3538832599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f88131b40 0x7f8f8809ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.207+0000 7f8f87fff700 1 -- 172.21.15.59:0/3538832599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f8806a770 msgr2=0x7f8f8809a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.207+0000 7f8f87fff700 1 --2- 172.21.15.59:0/3538832599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f8806a770 0x7f8f8809a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.207+0000 7f8f87fff700 1 -- 172.21.15.59:0/3538832599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f88131b40 msgr2=0x7f8f8809ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.207+0000 7f8f87fff700 1 --2- 172.21.15.59:0/3538832599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f88131b40 0x7f8f8809ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.207+0000 7f8f87fff700 1 -- 172.21.15.59:0/3538832599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f740094a0 con 0x7f8f8806b080 2023-09-30T22:30:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.207+0000 7f8f87fff700 1 --2- 172.21.15.59:0/3538832599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8806b080 0x7f8f8809a940 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400ebe0 tx=0x7f8f7400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.207+0000 7f8f857fa700 1 -- 172.21.15.59:0/3538832599 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7400c850 con 0x7f8f8806b080 2023-09-30T22:30:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.207+0000 7f8f857fa700 1 -- 172.21.15.59:0/3538832599 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7400c9b0 con 0x7f8f8806b080 2023-09-30T22:30:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.207+0000 7f8f857fa700 1 -- 172.21.15.59:0/3538832599 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7400cd40 con 0x7f8f8806b080 2023-09-30T22:30:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.207+0000 7f8f8f1fa700 1 -- 172.21.15.59:0/3538832599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7c009550 con 0x7f8f8806b080 2023-09-30T22:30:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.208+0000 7f8f8f1fa700 1 -- 172.21.15.59:0/3538832599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f880a39a0 con 0x7f8f8806b080 2023-09-30T22:30:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.208+0000 7f8f857fa700 1 -- 172.21.15.59:0/3538832599 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f74013470 con 0x7f8f8806b080 2023-09-30T22:30:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.209+0000 7f8f857fa700 1 -- 172.21.15.59:0/3538832599 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f7403f7a0 con 0x7f8f8806b080 2023-09-30T22:30:58.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.209+0000 7f8f8f1fa700 1 -- 172.21.15.59:0/3538832599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f88074ea0 con 0x7f8f8806b080 2023-09-30T22:30:58.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.214+0000 7f8f857fa700 1 -- 172.21.15.59:0/3538832599 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f74017080 con 0x7f8f8806b080 2023-09-30T22:30:58.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.254+0000 7f2ede65f700 1 Processor -- start 2023-09-30T22:30:58.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.254+0000 7f2ede65f700 1 -- start start 2023-09-30T22:30:58.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.254+0000 7f2ede65f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ed80a0a30 0x7f2ed80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.254+0000 7f2ede65f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed80a1340 0x7f2ed8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.254+0000 7f2ede65f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed809edd0 con 0x7f2ed8133fa0 2023-09-30T22:30:58.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.254+0000 7f2ede65f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed809e1f0 con 0x7f2ed80a0a30 2023-09-30T22:30:58.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.254+0000 7f2ede65f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed809dc50 con 0x7f2ed80a1340 2023-09-30T22:30:58.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.254+0000 7f2ed7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ed80a0a30 0x7f2ed80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.254+0000 7f2ed77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed80a1340 0x7f2ed8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.254+0000 7f2ed7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ed80a0a30 0x7f2ed80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34194/0 (socket says 172.21.15.59:34194) 2023-09-30T22:30:58.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.254+0000 7f2ed7fff700 1 -- 172.21.15.59:0/4131016465 learned_addr learned my addr 172.21.15.59:0/4131016465 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:58.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.254+0000 7f2ed77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed80a1340 0x7f2ed8133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40368/0 (socket says 172.21.15.59:40368) 2023-09-30T22:30:58.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.254+0000 7f2edcbfc700 1 --1- 172.21.15.59:0/4131016465 >> v1:172.21.15.59:6789/0 conn(0x7f2ed8133fa0 0x7f2ed813ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55362/0 (socket says 172.21.15.59:55362) 2023-09-30T22:30:58.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.255+0000 7f2ed77fe700 1 -- 172.21.15.59:0/4131016465 >> v2:172.21.15.59:3300/0 conn(0x7f2ed80a0a30 msgr2=0x7f2ed80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:58.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.255+0000 7f2ed77fe700 1 --2- 172.21.15.59:0/4131016465 >> v2:172.21.15.59:3300/0 conn(0x7f2ed80a0a30 0x7f2ed80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.255+0000 7f2ed77fe700 1 -- 172.21.15.59:0/4131016465 >> v1:172.21.15.59:6789/0 conn(0x7f2ed8133fa0 legacy=0x7f2ed813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.255+0000 7f2ed77fe700 1 -- 172.21.15.59:0/4131016465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed80a1fe0 con 0x7f2ed80a1340 2023-09-30T22:30:58.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.255+0000 7f2ed7fff700 1 --2- 172.21.15.59:0/4131016465 >> v2:172.21.15.59:3300/0 conn(0x7f2ed80a0a30 0x7f2ed80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.255+0000 7f2ed77fe700 1 --2- 172.21.15.59:0/4131016465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed80a1340 0x7f2ed8133a60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009840 tx=0x7f2ecc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b4d79b309ac2466 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.255+0000 7f2ed6ffd700 1 -- 172.21.15.59:0/4131016465 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc011830 con 0x7f2ed80a1340 2023-09-30T22:30:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.255+0000 7f2ed6ffd700 1 -- 172.21.15.59:0/4131016465 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc011990 con 0x7f2ed80a1340 2023-09-30T22:30:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.255+0000 7f2ed6ffd700 1 -- 172.21.15.59:0/4131016465 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc011d20 con 0x7f2ed80a1340 2023-09-30T22:30:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.256+0000 7f2ede65f700 1 -- 172.21.15.59:0/4131016465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed80a1340 msgr2=0x7f2ed8133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.256+0000 7f2ede65f700 1 --2- 172.21.15.59:0/4131016465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed80a1340 0x7f2ed8133a60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009840 tx=0x7f2ecc009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.256+0000 7f2ede65f700 1 -- 172.21.15.59:0/4131016465 shutdown_connections 2023-09-30T22:30:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.256+0000 7f2ede65f700 1 --2- 172.21.15.59:0/4131016465 >> v2:172.21.15.59:3300/0 conn(0x7f2ed80a0a30 0x7f2ed80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.256+0000 7f2ede65f700 1 --2- 172.21.15.59:0/4131016465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed80a1340 0x7f2ed8133a60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.256+0000 7f2ede65f700 1 -- 172.21.15.59:0/4131016465 >> 172.21.15.59:0/4131016465 conn(0x7f2ed80a6550 msgr2=0x7f2ed80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.256+0000 7f2ede65f700 1 -- 172.21.15.59:0/4131016465 shutdown_connections 2023-09-30T22:30:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.256+0000 7f2ede65f700 1 -- 172.21.15.59:0/4131016465 wait complete. 2023-09-30T22:30:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.258+0000 7f2ede65f700 1 Processor -- start 2023-09-30T22:30:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.258+0000 7f2ede65f700 1 -- start start 2023-09-30T22:30:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.259+0000 7f2ede65f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed80a0a30 0x7f2ed811e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.259+0000 7f2ede65f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed80a1340 0x7f2ed811ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.259+0000 7f2ede65f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8133fa0 0x7f2ed811f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.259+0000 7f2ede65f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8120bc0 con 0x7f2ed8133fa0 2023-09-30T22:30:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.259+0000 7f2ede65f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80a3760 con 0x7f2ed80a1340 2023-09-30T22:30:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.259+0000 7f2ede65f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80a0220 con 0x7f2ed80a0a30 2023-09-30T22:30:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.259+0000 7f2edcbfc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8133fa0 0x7f2ed811f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.259+0000 7f2ed77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed80a1340 0x7f2ed811ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.259+0000 7f2ed7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed80a0a30 0x7f2ed811e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.259+0000 7f2ed77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed80a1340 0x7f2ed811ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40384/0 (socket says 172.21.15.59:40384) 2023-09-30T22:30:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.259+0000 7f2edcbfc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8133fa0 0x7f2ed811f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34208/0 (socket says 172.21.15.59:34208) 2023-09-30T22:30:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.259+0000 7f2ed7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed80a0a30 0x7f2ed811e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41028/0 (socket says 172.21.15.59:41028) 2023-09-30T22:30:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.259+0000 7f2ed77fe700 1 -- 172.21.15.59:0/1589298857 learned_addr learned my addr 172.21.15.59:0/1589298857 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.260+0000 7f2ed77fe700 1 -- 172.21.15.59:0/1589298857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed80a0a30 msgr2=0x7f2ed811e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.260+0000 7f2ed77fe700 1 --2- 172.21.15.59:0/1589298857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed80a0a30 0x7f2ed811e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.260+0000 7f2ed77fe700 1 -- 172.21.15.59:0/1589298857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8133fa0 msgr2=0x7f2ed811f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.260+0000 7f2ed77fe700 1 --2- 172.21.15.59:0/1589298857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8133fa0 0x7f2ed811f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.260+0000 7f2ed77fe700 1 -- 172.21.15.59:0/1589298857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec8009550 con 0x7f2ed80a1340 2023-09-30T22:30:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.260+0000 7f2edcbfc700 1 --2- 172.21.15.59:0/1589298857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8133fa0 0x7f2ed811f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.260+0000 7f2ed77fe700 1 --2- 172.21.15.59:0/1589298857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed80a1340 0x7f2ed811ec90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009fd0 tx=0x7f2ecc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.260+0000 7f2ed4ff9700 1 -- 172.21.15.59:0/1589298857 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc0036a0 con 0x7f2ed80a1340 2023-09-30T22:30:58.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.260+0000 7f2ed4ff9700 1 -- 172.21.15.59:0/1589298857 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc01f070 con 0x7f2ed80a1340 2023-09-30T22:30:58.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.260+0000 7f2ed4ff9700 1 -- 172.21.15.59:0/1589298857 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc003a60 con 0x7f2ed80a1340 2023-09-30T22:30:58.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.260+0000 7f2ede65f700 1 -- 172.21.15.59:0/1589298857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc0094a0 con 0x7f2ed80a1340 2023-09-30T22:30:58.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.260+0000 7f2ede65f700 1 -- 172.21.15.59:0/1589298857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed8122a00 con 0x7f2ed80a1340 2023-09-30T22:30:58.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.261+0000 7f2ed4ff9700 1 -- 172.21.15.59:0/1589298857 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ecc003bc0 con 0x7f2ed80a1340 2023-09-30T22:30:58.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.261+0000 7f2ed4ff9700 1 -- 172.21.15.59:0/1589298857 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2ecc021070 con 0x7f2ed80a1340 2023-09-30T22:30:58.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.262+0000 7f2ede65f700 1 -- 172.21.15.59:0/1589298857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed8074ea0 con 0x7f2ed80a1340 2023-09-30T22:30:58.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.267+0000 7f2ed4ff9700 1 -- 172.21.15.59:0/1589298857 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ecc02b080 con 0x7f2ed80a1340 2023-09-30T22:30:58.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.285+0000 7fa07f608700 1 Processor -- start 2023-09-30T22:30:58.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.286+0000 7fa07f608700 1 -- start start 2023-09-30T22:30:58.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.286+0000 7fa07f608700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0780a0a30 0x7fa0780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.286+0000 7fa07f608700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa07809d630 0x7fa0780a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.287+0000 7fa07f608700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0780a2a70 con 0x7fa078133930 2023-09-30T22:30:58.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.287+0000 7fa07f608700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780a01d0 con 0x7fa07809d630 2023-09-30T22:30:58.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.287+0000 7fa07f608700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa07809e2b0 con 0x7fa0780a0a30 2023-09-30T22:30:58.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.287+0000 7fa07d3a4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0780a0a30 0x7fa0780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.287+0000 7fa07d3a4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0780a0a30 0x7fa0780a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41034/0 (socket says 172.21.15.59:41034) 2023-09-30T22:30:58.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.287+0000 7fa07dba5700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa078133930 0x7fa078133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55368/0 (socket says 172.21.15.59:55368) 2023-09-30T22:30:58.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.287+0000 7fa07d3a4700 1 -- 172.21.15.59:0/3908534815 learned_addr learned my addr 172.21.15.59:0/3908534815 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:58.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.287+0000 7fa07cba3700 1 --2- 172.21.15.59:0/3908534815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa07809d630 0x7fa0780a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.287+0000 7fa07d3a4700 1 -- 172.21.15.59:0/3908534815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa07809d630 msgr2=0x7fa0780a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:58.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.287+0000 7fa07d3a4700 1 --2- 172.21.15.59:0/3908534815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa07809d630 0x7fa0780a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.287+0000 7fa07d3a4700 1 -- 172.21.15.59:0/3908534815 >> v1:172.21.15.59:6789/0 conn(0x7fa078133930 legacy=0x7fa078133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.287+0000 7fa07d3a4700 1 -- 172.21.15.59:0/3908534815 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07809dc50 con 0x7fa0780a0a30 2023-09-30T22:30:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.287+0000 7fa077fff700 1 -- 172.21.15.59:0/3908534815 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813002431 0 0) 0x7fa0780a2a70 con 0x7fa078133930 2023-09-30T22:30:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.287+0000 7fa07cba3700 1 --2- 172.21.15.59:0/3908534815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa07809d630 0x7fa0780a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.287+0000 7fa07d3a4700 1 --2- 172.21.15.59:0/3908534815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0780a0a30 0x7fa0780a0e00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa070009920 tx=0x7fa070009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61ef2fae348b7eff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.288+0000 7fa077fff700 1 -- 172.21.15.59:0/3908534815 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070011830 con 0x7fa0780a0a30 2023-09-30T22:30:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.288+0000 7fa077fff700 1 -- 172.21.15.59:0/3908534815 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa070011990 con 0x7fa0780a0a30 2023-09-30T22:30:58.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.288+0000 7fa077fff700 1 -- 172.21.15.59:0/3908534815 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070011d20 con 0x7fa0780a0a30 2023-09-30T22:30:58.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.288+0000 7fa07f608700 1 -- 172.21.15.59:0/3908534815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0780a0a30 msgr2=0x7fa0780a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.288+0000 7fa07f608700 1 --2- 172.21.15.59:0/3908534815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0780a0a30 0x7fa0780a0e00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa070009920 tx=0x7fa070009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:58.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.288+0000 7fa07f608700 1 -- 172.21.15.59:0/3908534815 shutdown_connections 2023-09-30T22:30:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.288+0000 7fa07f608700 1 --2- 172.21.15.59:0/3908534815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0780a0a30 0x7fa0780a0e00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.288+0000 7fa07f608700 1 --2- 172.21.15.59:0/3908534815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa07809d630 0x7fa0780a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.288+0000 7fa07f608700 1 -- 172.21.15.59:0/3908534815 >> 172.21.15.59:0/3908534815 conn(0x7fa0780a3050 msgr2=0x7fa0780a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.288+0000 7fa07f608700 1 -- 172.21.15.59:0/3908534815 shutdown_connections 2023-09-30T22:30:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.288+0000 7fa07f608700 1 -- 172.21.15.59:0/3908534815 wait complete. 2023-09-30T22:30:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.289+0000 7fa07f608700 1 Processor -- start 2023-09-30T22:30:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.289+0000 7fa07f608700 1 -- start start 2023-09-30T22:30:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07f608700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa07809d630 0x7fa07811f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07f608700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0780a0a30 0x7fa07811fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07f608700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa078133930 0x7fa0781c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07f608700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa078122680 con 0x7fa0780a0a30 2023-09-30T22:30:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07f608700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0781334f0 con 0x7fa078133930 2023-09-30T22:30:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07f608700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780a0410 con 0x7fa07809d630 2023-09-30T22:30:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07d3a4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa07809d630 0x7fa07811f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07d3a4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa07809d630 0x7fa07811f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41044/0 (socket says 172.21.15.59:41044) 2023-09-30T22:30:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07cba3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0780a0a30 0x7fa07811fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07d3a4700 1 -- 172.21.15.59:0/2477631375 learned_addr learned my addr 172.21.15.59:0/2477631375 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07dba5700 1 --2- 172.21.15.59:0/2477631375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa078133930 0x7fa0781c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07d3a4700 1 -- 172.21.15.59:0/2477631375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa078133930 msgr2=0x7fa0781c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07d3a4700 1 --2- 172.21.15.59:0/2477631375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa078133930 0x7fa0781c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07d3a4700 1 -- 172.21.15.59:0/2477631375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0780a0a30 msgr2=0x7fa07811fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07d3a4700 1 --2- 172.21.15.59:0/2477631375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0780a0a30 0x7fa07811fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.290+0000 7fa07d3a4700 1 -- 172.21.15.59:0/2477631375 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c0094a0 con 0x7fa07809d630 2023-09-30T22:30:58.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.291+0000 7fa07d3a4700 1 --2- 172.21.15.59:0/2477631375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa07809d630 0x7fa07811f580 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa070000c00 tx=0x7fa070004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:58.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.291+0000 7fa075ffb700 1 -- 172.21.15.59:0/2477631375 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070004450 con 0x7fa07809d630 2023-09-30T22:30:58.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.291+0000 7fa075ffb700 1 -- 172.21.15.59:0/2477631375 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0700045b0 con 0x7fa07809d630 2023-09-30T22:30:58.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.291+0000 7fa075ffb700 1 -- 172.21.15.59:0/2477631375 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0700038c0 con 0x7fa07809d630 2023-09-30T22:30:58.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.291+0000 7fa07f608700 1 -- 172.21.15.59:0/2477631375 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa070009550 con 0x7fa07809d630 2023-09-30T22:30:58.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.291+0000 7fa07f608700 1 -- 172.21.15.59:0/2477631375 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0780a42e0 con 0x7fa07809d630 2023-09-30T22:30:58.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.292+0000 7fa075ffb700 1 -- 172.21.15.59:0/2477631375 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa070003a20 con 0x7fa07809d630 2023-09-30T22:30:58.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.292+0000 7fa07f608700 1 -- 172.21.15.59:0/2477631375 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0780747f0 con 0x7fa07809d630 2023-09-30T22:30:58.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.292+0000 7fa075ffb700 1 -- 172.21.15.59:0/2477631375 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa070021030 con 0x7fa07809d630 2023-09-30T22:30:58.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.297+0000 7fa075ffb700 1 -- 172.21.15.59:0/2477631375 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa07001a430 con 0x7fa07809d630 2023-09-30T22:30:58.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.462+0000 7f8f8f1fa700 1 -- 172.21.15.59:0/3538832599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f8806c360 con 0x7f8f8806b080 2023-09-30T22:30:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.462+0000 7f8f857fa700 1 -- 172.21.15.59:0/3538832599 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f7400cea0 con 0x7f8f8806b080 2023-09-30T22:30:58.462 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:58.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.465+0000 7f8f8f1fa700 1 -- 172.21.15.59:0/3538832599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8806b080 msgr2=0x7f8f8809a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.465+0000 7f8f8f1fa700 1 --2- 172.21.15.59:0/3538832599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8806b080 0x7f8f8809a940 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400ebe0 tx=0x7f8f7400eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.465+0000 7f8f8f1fa700 1 -- 172.21.15.59:0/3538832599 shutdown_connections 2023-09-30T22:30:58.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.465+0000 7f8f8f1fa700 1 --2- 172.21.15.59:0/3538832599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f8806a770 0x7f8f8809a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.465+0000 7f8f8f1fa700 1 --2- 172.21.15.59:0/3538832599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f88131b40 0x7f8f8809ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.465+0000 7f8f8f1fa700 1 --2- 172.21.15.59:0/3538832599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f8806b080 0x7f8f8809a940 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.465+0000 7f8f8f1fa700 1 -- 172.21.15.59:0/3538832599 >> 172.21.15.59:0/3538832599 conn(0x7f8f88066f50 msgr2=0x7f8f8806fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:58.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.465+0000 7f8f8f1fa700 1 -- 172.21.15.59:0/3538832599 shutdown_connections 2023-09-30T22:30:58.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.466+0000 7f8f8f1fa700 1 -- 172.21.15.59:0/3538832599 wait complete. 2023-09-30T22:30:58.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:58.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.495+0000 7f2ede65f700 1 -- 172.21.15.59:0/1589298857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2ed80a28e0 con 0x7f2ed80a1340 2023-09-30T22:30:58.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.496+0000 7f2ed4ff9700 1 -- 172.21.15.59:0/1589298857 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ecc015020 con 0x7f2ed80a1340 2023-09-30T22:30:58.496 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:58.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.498+0000 7f2ede65f700 1 -- 172.21.15.59:0/1589298857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed80a1340 msgr2=0x7f2ed811ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.498+0000 7f2ede65f700 1 --2- 172.21.15.59:0/1589298857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed80a1340 0x7f2ed811ec90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009fd0 tx=0x7f2ecc004750 comp rx=0 tx=0).stop 2023-09-30T22:30:58.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.498+0000 7f2ede65f700 1 -- 172.21.15.59:0/1589298857 shutdown_connections 2023-09-30T22:30:58.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.498+0000 7f2ede65f700 1 --2- 172.21.15.59:0/1589298857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed80a0a30 0x7f2ed811e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.498+0000 7f2ede65f700 1 --2- 172.21.15.59:0/1589298857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed8133fa0 0x7f2ed811f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.498+0000 7f2ede65f700 1 --2- 172.21.15.59:0/1589298857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed80a1340 0x7f2ed811ec90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.498+0000 7f2ede65f700 1 -- 172.21.15.59:0/1589298857 >> 172.21.15.59:0/1589298857 conn(0x7f2ed80a6550 msgr2=0x7f2ed80a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:58.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.498+0000 7f2ede65f700 1 -- 172.21.15.59:0/1589298857 shutdown_connections 2023-09-30T22:30:58.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.498+0000 7f2ede65f700 1 -- 172.21.15.59:0/1589298857 wait complete. 2023-09-30T22:30:58.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:58.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.518+0000 7fa07f608700 1 -- 172.21.15.59:0/2477631375 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa078121660 con 0x7fa07809d630 2023-09-30T22:30:58.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.519+0000 7fa075ffb700 1 -- 172.21.15.59:0/2477631375 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa07002b070 con 0x7fa07809d630 2023-09-30T22:30:58.519 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:58.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.521+0000 7fa07f608700 1 -- 172.21.15.59:0/2477631375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa07809d630 msgr2=0x7fa07811f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.521+0000 7fa07f608700 1 --2- 172.21.15.59:0/2477631375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa07809d630 0x7fa07811f580 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa070000c00 tx=0x7fa070004750 comp rx=0 tx=0).stop 2023-09-30T22:30:58.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.521+0000 7fa07f608700 1 -- 172.21.15.59:0/2477631375 shutdown_connections 2023-09-30T22:30:58.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.521+0000 7fa07f608700 1 --2- 172.21.15.59:0/2477631375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa07809d630 0x7fa07811f580 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.521+0000 7fa07f608700 1 --2- 172.21.15.59:0/2477631375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa078133930 0x7fa0781c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.521+0000 7fa07f608700 1 --2- 172.21.15.59:0/2477631375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0780a0a30 0x7fa07811fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.521+0000 7fa07f608700 1 -- 172.21.15.59:0/2477631375 >> 172.21.15.59:0/2477631375 conn(0x7fa0780a3050 msgr2=0x7fa07809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:58.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.521+0000 7fa07f608700 1 -- 172.21.15.59:0/2477631375 shutdown_connections 2023-09-30T22:30:58.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:58.521+0000 7fa07f608700 1 -- 172.21.15.59:0/2477631375 wait complete. 2023-09-30T22:30:58.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:30:58.948 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:59.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.094+0000 7f5dbc7e1700 1 Processor -- start 2023-09-30T22:30:59.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.094+0000 7f5dbc7e1700 1 -- start start 2023-09-30T22:30:59.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.094+0000 7f5dbc7e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db4133420 0x7f5db41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.094+0000 7f5dbc7e1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db4133e30 0x7f5db412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5dbc7e1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db406b990 con 0x7f5db4134260 2023-09-30T22:30:59.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5dbc7e1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40a0590 con 0x7f5db4133420 2023-09-30T22:30:59.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5dbc7e1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5db409fb80 con 0x7f5db4133e30 2023-09-30T22:30:59.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5db9d7c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db4133e30 0x7f5db412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5db9d7c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db4133e30 0x7f5db412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41060/0 (socket says 172.21.15.59:41060) 2023-09-30T22:30:59.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5dba57d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db4133420 0x7f5db41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5db9d7c700 1 -- 172.21.15.59:0/3329574952 learned_addr learned my addr 172.21.15.59:0/3329574952 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:59.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5dba57d700 1 -- 172.21.15.59:0/3329574952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db4133e30 msgr2=0x7f5db412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:59.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5db957b700 1 -- 172.21.15.59:0/3329574952 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327758961 0 0) 0x7f5db406b990 con 0x7f5db4134260 2023-09-30T22:30:59.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5dba57d700 1 --2- 172.21.15.59:0/3329574952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db4133e30 0x7f5db412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5dba57d700 1 -- 172.21.15.59:0/3329574952 >> v1:172.21.15.59:6789/0 conn(0x7f5db4134260 legacy=0x7f5db41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5dba57d700 1 -- 172.21.15.59:0/3329574952 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db40a0030 con 0x7f5db4133420 2023-09-30T22:30:59.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5db9d7c700 1 --2- 172.21.15.59:0/3329574952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db4133e30 0x7f5db412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:59.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5dba57d700 1 --2- 172.21.15.59:0/3329574952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db4133420 0x7f5db41337f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5db0009870 tx=0x7f5db0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=831f6747f8f004db server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5db957b700 1 -- 172.21.15.59:0/3329574952 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db0011830 con 0x7f5db4133420 2023-09-30T22:30:59.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5db957b700 1 -- 172.21.15.59:0/3329574952 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db0011990 con 0x7f5db4133420 2023-09-30T22:30:59.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.095+0000 7f5db957b700 1 -- 172.21.15.59:0/3329574952 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db0011d20 con 0x7f5db4133420 2023-09-30T22:30:59.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.096+0000 7f5dbc7e1700 1 -- 172.21.15.59:0/3329574952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db4133420 msgr2=0x7f5db41337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.096+0000 7f5dbc7e1700 1 --2- 172.21.15.59:0/3329574952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db4133420 0x7f5db41337f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5db0009870 tx=0x7f5db0009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:59.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.096+0000 7f5dbc7e1700 1 -- 172.21.15.59:0/3329574952 shutdown_connections 2023-09-30T22:30:59.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.096+0000 7f5dbc7e1700 1 --2- 172.21.15.59:0/3329574952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db4133420 0x7f5db41337f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.096+0000 7f5dbc7e1700 1 --2- 172.21.15.59:0/3329574952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db4133e30 0x7f5db412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.096+0000 7f5dbc7e1700 1 -- 172.21.15.59:0/3329574952 >> 172.21.15.59:0/3329574952 conn(0x7f5db40a4210 msgr2=0x7f5db40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.096+0000 7f5dbc7e1700 1 -- 172.21.15.59:0/3329574952 shutdown_connections 2023-09-30T22:30:59.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.096+0000 7f5dbc7e1700 1 -- 172.21.15.59:0/3329574952 wait complete. 2023-09-30T22:30:59.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.097+0000 7f5dbc7e1700 1 Processor -- start 2023-09-30T22:30:59.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.097+0000 7f5dbc7e1700 1 -- start start 2023-09-30T22:30:59.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dbc7e1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db4133420 0x7f5db409c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dbc7e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db4133e30 0x7f5db409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dbc7e1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db4134260 0x7f5db409d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dbc7e1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db411fe10 con 0x7f5db4134260 2023-09-30T22:30:59.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dbc7e1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db411fae0 con 0x7f5db4133e30 2023-09-30T22:30:59.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dbc7e1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5db4131490 con 0x7f5db4133420 2023-09-30T22:30:59.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dba57d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db4133420 0x7f5db409c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dba57d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db4133420 0x7f5db409c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41068/0 (socket says 172.21.15.59:41068) 2023-09-30T22:30:59.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dba57d700 1 -- 172.21.15.59:0/143481440 learned_addr learned my addr 172.21.15.59:0/143481440 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:59.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5db9d7c700 1 --2- 172.21.15.59:0/143481440 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db4133e30 0x7f5db409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dbad7e700 1 --2- 172.21.15.59:0/143481440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db4134260 0x7f5db409d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dba57d700 1 -- 172.21.15.59:0/143481440 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db4133e30 msgr2=0x7f5db409cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dba57d700 1 --2- 172.21.15.59:0/143481440 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db4133e30 0x7f5db409cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dba57d700 1 -- 172.21.15.59:0/143481440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db4134260 msgr2=0x7f5db409d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dba57d700 1 --2- 172.21.15.59:0/143481440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db4134260 0x7f5db409d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dba57d700 1 -- 172.21.15.59:0/143481440 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da4009550 con 0x7f5db4133420 2023-09-30T22:30:59.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5dba57d700 1 --2- 172.21.15.59:0/143481440 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db4133420 0x7f5db409c6e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5db00090b0 tx=0x7f5db0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5daaffd700 1 -- 172.21.15.59:0/143481440 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db0004300 con 0x7f5db4133420 2023-09-30T22:30:59.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.098+0000 7f5daaffd700 1 -- 172.21.15.59:0/143481440 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db001f070 con 0x7f5db4133420 2023-09-30T22:30:59.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.099+0000 7f5dbc7e1700 1 -- 172.21.15.59:0/143481440 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db00094a0 con 0x7f5db4133420 2023-09-30T22:30:59.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.099+0000 7f5daaffd700 1 -- 172.21.15.59:0/143481440 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db00036a0 con 0x7f5db4133420 2023-09-30T22:30:59.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.099+0000 7f5dbc7e1700 1 -- 172.21.15.59:0/143481440 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db412d870 con 0x7f5db4133420 2023-09-30T22:30:59.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.099+0000 7f5daaffd700 1 -- 172.21.15.59:0/143481440 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5db0021030 con 0x7f5db4133420 2023-09-30T22:30:59.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.099+0000 7f5daaffd700 1 -- 172.21.15.59:0/143481440 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5db0040720 con 0x7f5db4133420 2023-09-30T22:30:59.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.100+0000 7f5dbc7e1700 1 -- 172.21.15.59:0/143481440 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db40a2360 con 0x7f5db4133420 2023-09-30T22:30:59.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.105+0000 7f5daaffd700 1 -- 172.21.15.59:0/143481440 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5db0003800 con 0x7f5db4133420 2023-09-30T22:30:59.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.306+0000 7f5dbc7e1700 1 -- 172.21.15.59:0/143481440 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5db4074ea0 con 0x7f5db4133420 2023-09-30T22:30:59.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.307+0000 7f5daaffd700 1 -- 172.21.15.59:0/143481440 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5db0015020 con 0x7f5db4133420 2023-09-30T22:30:59.307 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:59.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.309+0000 7f5dbc7e1700 1 -- 172.21.15.59:0/143481440 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db4133420 msgr2=0x7f5db409c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.309+0000 7f5dbc7e1700 1 --2- 172.21.15.59:0/143481440 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db4133420 0x7f5db409c6e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5db00090b0 tx=0x7f5db0004750 comp rx=0 tx=0).stop 2023-09-30T22:30:59.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.309+0000 7f5dbc7e1700 1 -- 172.21.15.59:0/143481440 shutdown_connections 2023-09-30T22:30:59.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.309+0000 7f5dbc7e1700 1 --2- 172.21.15.59:0/143481440 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db4133420 0x7f5db409c6e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.309+0000 7f5dbc7e1700 1 --2- 172.21.15.59:0/143481440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db4134260 0x7f5db409d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.309+0000 7f5dbc7e1700 1 --2- 172.21.15.59:0/143481440 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db4133e30 0x7f5db409cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.309+0000 7f5dbc7e1700 1 -- 172.21.15.59:0/143481440 >> 172.21.15.59:0/143481440 conn(0x7f5db40a4210 msgr2=0x7f5db40a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.309+0000 7f5dbc7e1700 1 -- 172.21.15.59:0/143481440 shutdown_connections 2023-09-30T22:30:59.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.309+0000 7f5dbc7e1700 1 -- 172.21.15.59:0/143481440 wait complete. 2023-09-30T22:30:59.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:30:59.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:59.513 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:59.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:59.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.634+0000 7fd0636fd700 1 Processor -- start 2023-09-30T22:30:59.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.634+0000 7fd0636fd700 1 -- start start 2023-09-30T22:30:59.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.635+0000 7fd0636fd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd05c09d6f0 0x7fd05c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.635+0000 7fd0636fd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05c09e440 0x7fd05c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.635+0000 7fd0636fd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd05c09b120 con 0x7fd05c09e000 2023-09-30T22:30:59.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.635+0000 7fd0636fd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd05c06b460 con 0x7fd05c09d6f0 2023-09-30T22:30:59.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.635+0000 7fd0636fd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c09a7e0 con 0x7fd05c09e440 2023-09-30T22:30:59.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.635+0000 7fd061c9a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05c09e440 0x7fd05c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.635+0000 7fd061499700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd05c09d6f0 0x7fd05c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.635+0000 7fd061c9a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05c09e440 0x7fd05c134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41072/0 (socket says 172.21.15.59:41072) 2023-09-30T22:30:59.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.635+0000 7fd061c9a700 1 -- 172.21.15.59:0/1776471844 learned_addr learned my addr 172.21.15.59:0/1776471844 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:59.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.635+0000 7fd061c9a700 1 -- 172.21.15.59:0/1776471844 >> v2:172.21.15.59:3300/0 conn(0x7fd05c09d6f0 msgr2=0x7fd05c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:59.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.635+0000 7fd061c9a700 1 --2- 172.21.15.59:0/1776471844 >> v2:172.21.15.59:3300/0 conn(0x7fd05c09d6f0 0x7fd05c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.635+0000 7fd061c9a700 1 -- 172.21.15.59:0/1776471844 >> v1:172.21.15.59:6789/0 conn(0x7fd05c09e000 legacy=0x7fd05c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.635+0000 7fd061c9a700 1 -- 172.21.15.59:0/1776471844 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c09a500 con 0x7fd05c09e440 2023-09-30T22:30:59.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.635+0000 7fd061c9a700 1 --2- 172.21.15.59:0/1776471844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05c09e440 0x7fd05c134100 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd054009e80 tx=0x7fd05400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e35e26d9671c0115 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.636+0000 7fd053fff700 1 -- 172.21.15.59:0/1776471844 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05400e070 con 0x7fd05c09e440 2023-09-30T22:30:59.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.636+0000 7fd053fff700 1 -- 172.21.15.59:0/1776471844 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05400b8d0 con 0x7fd05c09e440 2023-09-30T22:30:59.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.636+0000 7fd053fff700 1 -- 172.21.15.59:0/1776471844 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05400bc80 con 0x7fd05c09e440 2023-09-30T22:30:59.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.636+0000 7fd0636fd700 1 -- 172.21.15.59:0/1776471844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05c09e440 msgr2=0x7fd05c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.636+0000 7fd0636fd700 1 --2- 172.21.15.59:0/1776471844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05c09e440 0x7fd05c134100 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd054009e80 tx=0x7fd05400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:59.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.636+0000 7fd0636fd700 1 -- 172.21.15.59:0/1776471844 shutdown_connections 2023-09-30T22:30:59.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.636+0000 7fd0636fd700 1 --2- 172.21.15.59:0/1776471844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05c09e440 0x7fd05c134100 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.636+0000 7fd0636fd700 1 --2- 172.21.15.59:0/1776471844 >> v2:172.21.15.59:3300/0 conn(0x7fd05c09d6f0 0x7fd05c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.636+0000 7fd0636fd700 1 -- 172.21.15.59:0/1776471844 >> 172.21.15.59:0/1776471844 conn(0x7fd05c066f50 msgr2=0x7fd05c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.637+0000 7fd0636fd700 1 -- 172.21.15.59:0/1776471844 shutdown_connections 2023-09-30T22:30:59.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.637+0000 7fd0636fd700 1 -- 172.21.15.59:0/1776471844 wait complete. 2023-09-30T22:30:59.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.638+0000 7fd0636fd700 1 Processor -- start 2023-09-30T22:30:59.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.638+0000 7fd0636fd700 1 -- start start 2023-09-30T22:30:59.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.638+0000 7fd0636fd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05c09d6f0 0x7fd05c1a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.638+0000 7fd0636fd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd05c09e000 0x7fd05c1a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.638+0000 7fd0636fd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd05c09e440 0x7fd05c1a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.638+0000 7fd0636fd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c1aa360 con 0x7fd05c09e440 2023-09-30T22:30:59.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.638+0000 7fd0636fd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c1a99a0 con 0x7fd05c09e000 2023-09-30T22:30:59.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.638+0000 7fd0636fd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c1a8ce0 con 0x7fd05c09d6f0 2023-09-30T22:30:59.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.638+0000 7fd060c98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd05c09e000 0x7fd05c1a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.638+0000 7fd061499700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05c09d6f0 0x7fd05c1a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.638+0000 7fd061499700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05c09d6f0 0x7fd05c1a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41076/0 (socket says 172.21.15.59:41076) 2023-09-30T22:30:59.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.638+0000 7fd060c98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd05c09e000 0x7fd05c1a6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40442/0 (socket says 172.21.15.59:40442) 2023-09-30T22:30:59.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.638+0000 7fd061499700 1 -- 172.21.15.59:0/3842296736 learned_addr learned my addr 172.21.15.59:0/3842296736 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:59.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.639+0000 7fd061c9a700 1 --2- 172.21.15.59:0/3842296736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd05c09e440 0x7fd05c1a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.639+0000 7fd060c98700 1 -- 172.21.15.59:0/3842296736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05c09d6f0 msgr2=0x7fd05c1a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.639+0000 7fd060c98700 1 --2- 172.21.15.59:0/3842296736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05c09d6f0 0x7fd05c1a5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.639+0000 7fd060c98700 1 -- 172.21.15.59:0/3842296736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd05c09e440 msgr2=0x7fd05c1a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.639+0000 7fd060c98700 1 --2- 172.21.15.59:0/3842296736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd05c09e440 0x7fd05c1a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.639+0000 7fd060c98700 1 -- 172.21.15.59:0/3842296736 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd054009b30 con 0x7fd05c09e000 2023-09-30T22:30:59.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.639+0000 7fd061499700 1 --2- 172.21.15.59:0/3842296736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05c09d6f0 0x7fd05c1a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:59.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.639+0000 7fd060c98700 1 --2- 172.21.15.59:0/3842296736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd05c09e000 0x7fd05c1a6410 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00c450 tx=0x7fd04c00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.639+0000 7fd051ffb700 1 -- 172.21.15.59:0/3842296736 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0052d0 con 0x7fd05c09e000 2023-09-30T22:30:59.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.639+0000 7fd051ffb700 1 -- 172.21.15.59:0/3842296736 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c005430 con 0x7fd05c09e000 2023-09-30T22:30:59.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.639+0000 7fd0636fd700 1 -- 172.21.15.59:0/3842296736 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05c0a2000 con 0x7fd05c09e000 2023-09-30T22:30:59.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.639+0000 7fd051ffb700 1 -- 172.21.15.59:0/3842296736 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0038c0 con 0x7fd05c09e000 2023-09-30T22:30:59.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.640+0000 7fd0636fd700 1 -- 172.21.15.59:0/3842296736 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05c09c760 con 0x7fd05c09e000 2023-09-30T22:30:59.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.641+0000 7fd0636fd700 1 -- 172.21.15.59:0/3842296736 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05c074ea0 con 0x7fd05c09e000 2023-09-30T22:30:59.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.641+0000 7fd051ffb700 1 -- 172.21.15.59:0/3842296736 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd04c003a20 con 0x7fd05c09e000 2023-09-30T22:30:59.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.641+0000 7fd051ffb700 1 -- 172.21.15.59:0/3842296736 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd04c03eac0 con 0x7fd05c09e000 2023-09-30T22:30:59.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.646+0000 7fd051ffb700 1 -- 172.21.15.59:0/3842296736 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd04c011590 con 0x7fd05c09e000 2023-09-30T22:30:59.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.677+0000 7fceb14a4700 1 Processor -- start 2023-09-30T22:30:59.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.677+0000 7fceb14a4700 1 -- start start 2023-09-30T22:30:59.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceb14a4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceac0a0a30 0x7fceac0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceb14a4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fceac09d630 0x7fceac0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceb14a4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceac133930 0x7fceac133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceb14a4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac0a2a70 con 0x7fceac09d630 2023-09-30T22:30:59.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceb14a4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0a01d0 con 0x7fceac133930 2023-09-30T22:30:59.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceb14a4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fceac09e2b0 con 0x7fceac0a0a30 2023-09-30T22:30:59.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceaaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceac0a0a30 0x7fceac0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceaaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceac0a0a30 0x7fceac0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41086/0 (socket says 172.21.15.59:41086) 2023-09-30T22:30:59.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceaaffd700 1 -- 172.21.15.59:0/2211588034 learned_addr learned my addr 172.21.15.59:0/2211588034 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:59.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceab7fe700 1 --2- 172.21.15.59:0/2211588034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceac133930 0x7fceac133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceaa7fc700 1 --2- 172.21.15.59:0/2211588034 >> v2:172.21.15.59:3300/0 conn(0x7fceac09d630 0x7fceac0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceaaffd700 1 -- 172.21.15.59:0/2211588034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceac133930 msgr2=0x7fceac133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:59.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceaaffd700 1 --2- 172.21.15.59:0/2211588034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceac133930 0x7fceac133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceaaffd700 1 -- 172.21.15.59:0/2211588034 >> v2:172.21.15.59:3300/0 conn(0x7fceac09d630 msgr2=0x7fceac0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:59.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceaaffd700 1 --2- 172.21.15.59:0/2211588034 >> v2:172.21.15.59:3300/0 conn(0x7fceac09d630 0x7fceac0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceaaffd700 1 -- 172.21.15.59:0/2211588034 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac09dc50 con 0x7fceac0a0a30 2023-09-30T22:30:59.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.678+0000 7fceab7fe700 1 --2- 172.21.15.59:0/2211588034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceac133930 0x7fceac133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:59.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.679+0000 7fceaa7fc700 1 --2- 172.21.15.59:0/2211588034 >> v2:172.21.15.59:3300/0 conn(0x7fceac09d630 0x7fceac0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:59.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.679+0000 7fceaaffd700 1 --2- 172.21.15.59:0/2211588034 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceac0a0a30 0x7fceac0a0e00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0098f0 tx=0x7fce9c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b84ff94433aee58d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.679+0000 7fcea9ffb700 1 -- 172.21.15.59:0/2211588034 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c011830 con 0x7fceac0a0a30 2023-09-30T22:30:59.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.679+0000 7fcea9ffb700 1 -- 172.21.15.59:0/2211588034 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c011990 con 0x7fceac0a0a30 2023-09-30T22:30:59.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.679+0000 7fcea9ffb700 1 -- 172.21.15.59:0/2211588034 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c011d20 con 0x7fceac0a0a30 2023-09-30T22:30:59.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.680+0000 7fceb14a4700 1 -- 172.21.15.59:0/2211588034 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceac0a0a30 msgr2=0x7fceac0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.680+0000 7fceb14a4700 1 --2- 172.21.15.59:0/2211588034 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceac0a0a30 0x7fceac0a0e00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0098f0 tx=0x7fce9c009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:59.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.680+0000 7fceb14a4700 1 -- 172.21.15.59:0/2211588034 shutdown_connections 2023-09-30T22:30:59.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.680+0000 7fceb14a4700 1 --2- 172.21.15.59:0/2211588034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceac133930 0x7fceac133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.680+0000 7fceb14a4700 1 --2- 172.21.15.59:0/2211588034 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceac0a0a30 0x7fceac0a0e00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.680+0000 7fceb14a4700 1 --2- 172.21.15.59:0/2211588034 >> v2:172.21.15.59:3300/0 conn(0x7fceac09d630 0x7fceac0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.680+0000 7fceb14a4700 1 -- 172.21.15.59:0/2211588034 >> 172.21.15.59:0/2211588034 conn(0x7fceac0a3050 msgr2=0x7fceac0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.680+0000 7fceb14a4700 1 -- 172.21.15.59:0/2211588034 shutdown_connections 2023-09-30T22:30:59.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.680+0000 7fceb14a4700 1 -- 172.21.15.59:0/2211588034 wait complete. 2023-09-30T22:30:59.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.681+0000 7fceb14a4700 1 Processor -- start 2023-09-30T22:30:59.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.681+0000 7fceb14a4700 1 -- start start 2023-09-30T22:30:59.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceb14a4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceac09d630 0x7fceac11f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceb14a4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fceac0a0a30 0x7fceac11f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceb14a4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceac133930 0x7fceac1c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceb14a4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac11fe10 con 0x7fceac0a0a30 2023-09-30T22:30:59.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceb14a4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac11ee50 con 0x7fceac133930 2023-09-30T22:30:59.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceb14a4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fceac133300 con 0x7fceac09d630 2023-09-30T22:30:59.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceaa7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fceac0a0a30 0x7fceac11f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceaa7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fceac0a0a30 0x7fceac11f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34266/0 (socket says 172.21.15.59:34266) 2023-09-30T22:30:59.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceaa7fc700 1 -- 172.21.15.59:0/1560005422 learned_addr learned my addr 172.21.15.59:0/1560005422 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:59.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceab7fe700 1 --2- 172.21.15.59:0/1560005422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceac133930 0x7fceac1c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceaaffd700 1 --2- 172.21.15.59:0/1560005422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceac09d630 0x7fceac11f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceab7fe700 1 -- 172.21.15.59:0/1560005422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceac09d630 msgr2=0x7fceac11f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceab7fe700 1 --2- 172.21.15.59:0/1560005422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceac09d630 0x7fceac11f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceab7fe700 1 -- 172.21.15.59:0/1560005422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fceac0a0a30 msgr2=0x7fceac11f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceab7fe700 1 --2- 172.21.15.59:0/1560005422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fceac0a0a30 0x7fceac11f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceab7fe700 1 -- 172.21.15.59:0/1560005422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea00094a0 con 0x7fceac133930 2023-09-30T22:30:59.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.682+0000 7fceaa7fc700 1 --2- 172.21.15.59:0/1560005422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fceac0a0a30 0x7fceac11f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:59.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.683+0000 7fceab7fe700 1 --2- 172.21.15.59:0/1560005422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceac133930 0x7fceac1c8000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcea400efc0 tx=0x7fcea400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.683+0000 7fce937fe700 1 -- 172.21.15.59:0/1560005422 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea400cb40 con 0x7fceac133930 2023-09-30T22:30:59.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.683+0000 7fce937fe700 1 -- 172.21.15.59:0/1560005422 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea400f040 con 0x7fceac133930 2023-09-30T22:30:59.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.683+0000 7fce937fe700 1 -- 172.21.15.59:0/1560005422 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4003a20 con 0x7fceac133930 2023-09-30T22:30:59.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.683+0000 7fceb14a4700 1 -- 172.21.15.59:0/1560005422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea4009a70 con 0x7fceac133930 2023-09-30T22:30:59.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.683+0000 7fceb14a4700 1 -- 172.21.15.59:0/1560005422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c009550 con 0x7fceac133930 2023-09-30T22:30:59.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.684+0000 7fce937fe700 1 -- 172.21.15.59:0/1560005422 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcea4014480 con 0x7fceac133930 2023-09-30T22:30:59.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.684+0000 7fceb14a4700 1 -- 172.21.15.59:0/1560005422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac121e50 con 0x7fceac133930 2023-09-30T22:30:59.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.684+0000 7fce937fe700 1 -- 172.21.15.59:0/1560005422 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcea403fed0 con 0x7fceac133930 2023-09-30T22:30:59.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.689+0000 7fce937fe700 1 -- 172.21.15.59:0/1560005422 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcea4012930 con 0x7fceac133930 2023-09-30T22:30:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.717+0000 7fb9bb96d700 1 Processor -- start 2023-09-30T22:30:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.718+0000 7fb9bb96d700 1 -- start start 2023-09-30T22:30:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.718+0000 7fb9bb96d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9b409f410 0x7fb9b4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.718+0000 7fb9bb96d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9b4136fe0 0x7fb9b41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.718+0000 7fb9bb96d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b4070940 con 0x7fb9b409e930 2023-09-30T22:30:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.718+0000 7fb9bb96d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b406fd60 con 0x7fb9b4136fe0 2023-09-30T22:30:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.718+0000 7fb9bb96d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b406fa80 con 0x7fb9b409f410 2023-09-30T22:30:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.718+0000 7fb9b8f08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9b409f410 0x7fb9b4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.718+0000 7fb9b9709700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb9b409e930 0x7fb9b409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55402/0 (socket says 172.21.15.59:55402) 2023-09-30T22:30:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.718+0000 7fb9b8f08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9b409f410 0x7fb9b4136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40460/0 (socket says 172.21.15.59:40460) 2023-09-30T22:30:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.718+0000 7fb9b9709700 1 -- 172.21.15.59:0/1676254705 learned_addr learned my addr 172.21.15.59:0/1676254705 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:30:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.719+0000 7fb9b9f0a700 1 --2- 172.21.15.59:0/1676254705 >> v2:172.21.15.59:3300/0 conn(0x7fb9b4136fe0 0x7fb9b41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.719+0000 7fb9b8f08700 1 -- 172.21.15.59:0/1676254705 >> v2:172.21.15.59:3300/0 conn(0x7fb9b4136fe0 msgr2=0x7fb9b41393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.719+0000 7fb9b8f08700 1 --2- 172.21.15.59:0/1676254705 >> v2:172.21.15.59:3300/0 conn(0x7fb9b4136fe0 0x7fb9b41393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.719+0000 7fb9b8f08700 1 -- 172.21.15.59:0/1676254705 >> v1:172.21.15.59:6789/0 conn(0x7fb9b409e930 legacy=0x7fb9b409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.719+0000 7fb9b8f08700 1 -- 172.21.15.59:0/1676254705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b409fb60 con 0x7fb9b409f410 2023-09-30T22:30:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.719+0000 7fb9b8f08700 1 --2- 172.21.15.59:0/1676254705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9b409f410 0x7fb9b4136aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009840 tx=0x7fb9a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d25543f86e83eff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.719+0000 7fb9abfff700 1 -- 172.21.15.59:0/1676254705 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4011830 con 0x7fb9b409f410 2023-09-30T22:30:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.719+0000 7fb9abfff700 1 -- 172.21.15.59:0/1676254705 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a4011990 con 0x7fb9b409f410 2023-09-30T22:30:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.719+0000 7fb9abfff700 1 -- 172.21.15.59:0/1676254705 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4011d20 con 0x7fb9b409f410 2023-09-30T22:30:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.720+0000 7fb9bb96d700 1 -- 172.21.15.59:0/1676254705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9b409f410 msgr2=0x7fb9b4136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.720+0000 7fb9bb96d700 1 --2- 172.21.15.59:0/1676254705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9b409f410 0x7fb9b4136aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009840 tx=0x7fb9a4009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.720+0000 7fb9bb96d700 1 -- 172.21.15.59:0/1676254705 shutdown_connections 2023-09-30T22:30:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.720+0000 7fb9bb96d700 1 --2- 172.21.15.59:0/1676254705 >> v2:172.21.15.59:3300/0 conn(0x7fb9b4136fe0 0x7fb9b41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.720+0000 7fb9bb96d700 1 --2- 172.21.15.59:0/1676254705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9b409f410 0x7fb9b4136aa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.720+0000 7fb9bb96d700 1 -- 172.21.15.59:0/1676254705 >> 172.21.15.59:0/1676254705 conn(0x7fb9b40a4210 msgr2=0x7fb9b40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.720+0000 7fb9bb96d700 1 -- 172.21.15.59:0/1676254705 shutdown_connections 2023-09-30T22:30:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.720+0000 7fb9bb96d700 1 -- 172.21.15.59:0/1676254705 wait complete. 2023-09-30T22:30:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.721+0000 7fb9bb96d700 1 Processor -- start 2023-09-30T22:30:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.721+0000 7fb9bb96d700 1 -- start start 2023-09-30T22:30:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.721+0000 7fb9bb96d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9b409e930 0x7fb9b411c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.721+0000 7fb9bb96d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9b409f410 0x7fb9b411cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.721+0000 7fb9bb96d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9b4136fe0 0x7fb9b411d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.721+0000 7fb9bb96d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b411fe50 con 0x7fb9b409f410 2023-09-30T22:30:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.721+0000 7fb9bb96d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b411e220 con 0x7fb9b409e930 2023-09-30T22:30:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.721+0000 7fb9bb96d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b40a2f40 con 0x7fb9b4136fe0 2023-09-30T22:30:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.722+0000 7fb9b9709700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9b409e930 0x7fb9b411c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.722+0000 7fb9b9709700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9b409e930 0x7fb9b411c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40464/0 (socket says 172.21.15.59:40464) 2023-09-30T22:30:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.722+0000 7fb9b9709700 1 -- 172.21.15.59:0/1876881098 learned_addr learned my addr 172.21.15.59:0/1876881098 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:30:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.722+0000 7fb9b8f08700 1 --2- 172.21.15.59:0/1876881098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9b409f410 0x7fb9b411cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.722+0000 7fb9b9f0a700 1 --2- 172.21.15.59:0/1876881098 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9b4136fe0 0x7fb9b411d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.722+0000 7fb9b9709700 1 -- 172.21.15.59:0/1876881098 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9b4136fe0 msgr2=0x7fb9b411d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.722+0000 7fb9b9709700 1 --2- 172.21.15.59:0/1876881098 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9b4136fe0 0x7fb9b411d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.722+0000 7fb9b9709700 1 -- 172.21.15.59:0/1876881098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9b409f410 msgr2=0x7fb9b411cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.722+0000 7fb9b9709700 1 --2- 172.21.15.59:0/1876881098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9b409f410 0x7fb9b411cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.722+0000 7fb9b9709700 1 -- 172.21.15.59:0/1876881098 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a40094a0 con 0x7fb9b409e930 2023-09-30T22:30:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.722+0000 7fb9b9709700 1 --2- 172.21.15.59:0/1876881098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9b409e930 0x7fb9b411c610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000c520 tx=0x7fb9b000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.722+0000 7fb9a9ffb700 1 -- 172.21.15.59:0/1876881098 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0005d70 con 0x7fb9b409e930 2023-09-30T22:30:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.722+0000 7fb9a9ffb700 1 -- 172.21.15.59:0/1876881098 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b00070d0 con 0x7fb9b409e930 2023-09-30T22:30:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.722+0000 7fb9bb96d700 1 -- 172.21.15.59:0/1876881098 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b4071d20 con 0x7fb9b409e930 2023-09-30T22:30:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.722+0000 7fb9a9ffb700 1 -- 172.21.15.59:0/1876881098 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0007440 con 0x7fb9b409e930 2023-09-30T22:30:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.723+0000 7fb9bb96d700 1 -- 172.21.15.59:0/1876881098 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b411e9e0 con 0x7fb9b409e930 2023-09-30T22:30:59.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.724+0000 7fb9bb96d700 1 -- 172.21.15.59:0/1876881098 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b4074ea0 con 0x7fb9b409e930 2023-09-30T22:30:59.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.724+0000 7fb9a9ffb700 1 -- 172.21.15.59:0/1876881098 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9b00075a0 con 0x7fb9b409e930 2023-09-30T22:30:59.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.724+0000 7fb9a9ffb700 1 -- 172.21.15.59:0/1876881098 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb9b0040c10 con 0x7fb9b409e930 2023-09-30T22:30:59.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.729+0000 7fb9a9ffb700 1 -- 172.21.15.59:0/1876881098 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9b0044060 con 0x7fb9b409e930 2023-09-30T22:30:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.856+0000 7fd0636fd700 1 -- 172.21.15.59:0/3842296736 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd05c1a9250 con 0x7fd05c09e000 2023-09-30T22:30:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.856+0000 7fd051ffb700 1 -- 172.21.15.59:0/3842296736 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd04c017020 con 0x7fd05c09e000 2023-09-30T22:30:59.856 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:30:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.858+0000 7fd0636fd700 1 -- 172.21.15.59:0/3842296736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd05c09e000 msgr2=0x7fd05c1a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.858+0000 7fd0636fd700 1 --2- 172.21.15.59:0/3842296736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd05c09e000 0x7fd05c1a6410 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00c450 tx=0x7fd04c00c760 comp rx=0 tx=0).stop 2023-09-30T22:30:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.858+0000 7fd0636fd700 1 -- 172.21.15.59:0/3842296736 shutdown_connections 2023-09-30T22:30:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.858+0000 7fd0636fd700 1 --2- 172.21.15.59:0/3842296736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05c09d6f0 0x7fd05c1a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.858+0000 7fd0636fd700 1 --2- 172.21.15.59:0/3842296736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd05c09e440 0x7fd05c1a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.858+0000 7fd0636fd700 1 --2- 172.21.15.59:0/3842296736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd05c09e000 0x7fd05c1a6410 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.858+0000 7fd0636fd700 1 -- 172.21.15.59:0/3842296736 >> 172.21.15.59:0/3842296736 conn(0x7fd05c066f50 msgr2=0x7fd05c1baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.858+0000 7fd0636fd700 1 -- 172.21.15.59:0/3842296736 shutdown_connections 2023-09-30T22:30:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.858+0000 7fd0636fd700 1 -- 172.21.15.59:0/3842296736 wait complete. 2023-09-30T22:30:59.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:30:59.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.912+0000 7fceb14a4700 1 -- 172.21.15.59:0/1560005422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fceac120580 con 0x7fceac133930 2023-09-30T22:30:59.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.913+0000 7fce937fe700 1 -- 172.21.15.59:0/1560005422 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcea4012340 con 0x7fceac133930 2023-09-30T22:30:59.913 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:30:59.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.915+0000 7fceb14a4700 1 -- 172.21.15.59:0/1560005422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceac133930 msgr2=0x7fceac1c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.915+0000 7fceb14a4700 1 --2- 172.21.15.59:0/1560005422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceac133930 0x7fceac1c8000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcea400efc0 tx=0x7fcea400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.915+0000 7fceb14a4700 1 -- 172.21.15.59:0/1560005422 shutdown_connections 2023-09-30T22:30:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.915+0000 7fceb14a4700 1 --2- 172.21.15.59:0/1560005422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceac09d630 0x7fceac11f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.915+0000 7fceb14a4700 1 --2- 172.21.15.59:0/1560005422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceac133930 0x7fceac1c8000 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.915+0000 7fceb14a4700 1 --2- 172.21.15.59:0/1560005422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fceac0a0a30 0x7fceac11f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.915+0000 7fceb14a4700 1 -- 172.21.15.59:0/1560005422 >> 172.21.15.59:0/1560005422 conn(0x7fceac0a3050 msgr2=0x7fceac09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.915+0000 7fceb14a4700 1 -- 172.21.15.59:0/1560005422 shutdown_connections 2023-09-30T22:30:59.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.915+0000 7fceb14a4700 1 -- 172.21.15.59:0/1560005422 wait complete. 2023-09-30T22:30:59.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:30:59.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.950+0000 7fb9bb96d700 1 -- 172.21.15.59:0/1876881098 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb9b406b250 con 0x7fb9b409e930 2023-09-30T22:30:59.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.950+0000 7fb9a9ffb700 1 -- 172.21.15.59:0/1876881098 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9b0044070 con 0x7fb9b409e930 2023-09-30T22:30:59.950 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:30:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.952+0000 7fb9bb96d700 1 -- 172.21.15.59:0/1876881098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9b409e930 msgr2=0x7fb9b411c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.952+0000 7fb9bb96d700 1 --2- 172.21.15.59:0/1876881098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9b409e930 0x7fb9b411c610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000c520 tx=0x7fb9b000c830 comp rx=0 tx=0).stop 2023-09-30T22:30:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.952+0000 7fb9bb96d700 1 -- 172.21.15.59:0/1876881098 shutdown_connections 2023-09-30T22:30:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.952+0000 7fb9bb96d700 1 --2- 172.21.15.59:0/1876881098 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9b4136fe0 0x7fb9b411d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.952+0000 7fb9bb96d700 1 --2- 172.21.15.59:0/1876881098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9b409e930 0x7fb9b411c610 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.952+0000 7fb9bb96d700 1 --2- 172.21.15.59:0/1876881098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9b409f410 0x7fb9b411cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.952+0000 7fb9bb96d700 1 -- 172.21.15.59:0/1876881098 >> 172.21.15.59:0/1876881098 conn(0x7fb9b40a4210 msgr2=0x7fb9b4134b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.952+0000 7fb9bb96d700 1 -- 172.21.15.59:0/1876881098 shutdown_connections 2023-09-30T22:30:59.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:30:59.952+0000 7fb9bb96d700 1 -- 172.21.15.59:0/1876881098 wait complete. 2023-09-30T22:30:59.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:00.323 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:00.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.472+0000 7f3fa4987700 1 Processor -- start 2023-09-30T22:31:00.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.472+0000 7f3fa4987700 1 -- start start 2023-09-30T22:31:00.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3fa4987700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3fa009d6f0 0x7f3fa009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3fa4987700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fa009e410 0x7f3fa0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3fa4987700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa009f130 con 0x7f3fa009e000 2023-09-30T22:31:00.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3fa4987700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa009f520 con 0x7f3fa009d6f0 2023-09-30T22:31:00.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3fa4987700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa009e930 con 0x7f3fa009e410 2023-09-30T22:31:00.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3f9e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3fa009d6f0 0x7f3fa009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3f9ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fa009e410 0x7f3fa0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3f9e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3fa009d6f0 0x7f3fa009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34288/0 (socket says 172.21.15.59:34288) 2023-09-30T22:31:00.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3f9e59c700 1 -- 172.21.15.59:0/3887425187 learned_addr learned my addr 172.21.15.59:0/3887425187 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3f9ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fa009e410 0x7f3fa0130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40470/0 (socket says 172.21.15.59:40470) 2023-09-30T22:31:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3f9e59c700 1 -- 172.21.15.59:0/3887425187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fa009e410 msgr2=0x7f3fa0130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3f9e59c700 1 --2- 172.21.15.59:0/3887425187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fa009e410 0x7f3fa0130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3f9e59c700 1 -- 172.21.15.59:0/3887425187 >> v1:172.21.15.59:6789/0 conn(0x7f3fa009e000 legacy=0x7f3fa0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3f9e59c700 1 -- 172.21.15.59:0/3887425187 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa009b2d0 con 0x7f3fa009d6f0 2023-09-30T22:31:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3f9ed9d700 1 --2- 172.21.15.59:0/3887425187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fa009e410 0x7f3fa0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.473+0000 7f3f9e59c700 1 --2- 172.21.15.59:0/3887425187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fa009d6f0 0x7f3fa009dac0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000bb90 tx=0x7f3f9000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a0f7d275590338 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.474+0000 7f3f9d59a700 1 -- 172.21.15.59:0/3887425187 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000dd30 con 0x7f3fa009d6f0 2023-09-30T22:31:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.474+0000 7f3f9d59a700 1 -- 172.21.15.59:0/3887425187 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9000de90 con 0x7f3fa009d6f0 2023-09-30T22:31:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.474+0000 7f3f9d59a700 1 -- 172.21.15.59:0/3887425187 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90010690 con 0x7f3fa009d6f0 2023-09-30T22:31:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.474+0000 7f3fa4987700 1 -- 172.21.15.59:0/3887425187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fa009d6f0 msgr2=0x7f3fa009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.474+0000 7f3fa4987700 1 --2- 172.21.15.59:0/3887425187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fa009d6f0 0x7f3fa009dac0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000bb90 tx=0x7f3f9000bea0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.474+0000 7f3fa4987700 1 -- 172.21.15.59:0/3887425187 shutdown_connections 2023-09-30T22:31:00.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.474+0000 7f3fa4987700 1 --2- 172.21.15.59:0/3887425187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fa009d6f0 0x7f3fa009dac0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.474+0000 7f3fa4987700 1 --2- 172.21.15.59:0/3887425187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fa009e410 0x7f3fa0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.474+0000 7f3fa4987700 1 -- 172.21.15.59:0/3887425187 >> 172.21.15.59:0/3887425187 conn(0x7f3fa0066f50 msgr2=0x7f3fa009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:00.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.474+0000 7f3fa4987700 1 -- 172.21.15.59:0/3887425187 shutdown_connections 2023-09-30T22:31:00.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.474+0000 7f3fa4987700 1 -- 172.21.15.59:0/3887425187 wait complete. 2023-09-30T22:31:00.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.475+0000 7f3fa4987700 1 Processor -- start 2023-09-30T22:31:00.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3fa4987700 1 -- start start 2023-09-30T22:31:00.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3fa4987700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fa009d6f0 0x7f3fa0122460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3fa4987700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fa009e000 0x7f3fa01229a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3fa4987700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fa009e410 0x7f3fa0122ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3fa4987700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0125ca0 con 0x7f3fa009e000 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3fa4987700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0124180 con 0x7f3fa009d6f0 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3fa4987700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00a1d00 con 0x7f3fa009e410 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3f9e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fa009d6f0 0x7f3fa0122460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3f9e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fa009d6f0 0x7f3fa0122460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40484/0 (socket says 172.21.15.59:40484) 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3f9e59c700 1 -- 172.21.15.59:0/3431984807 learned_addr learned my addr 172.21.15.59:0/3431984807 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3f9ed9d700 1 --2- 172.21.15.59:0/3431984807 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fa009e410 0x7f3fa0122ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3f9dd9b700 1 --2- 172.21.15.59:0/3431984807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fa009e000 0x7f3fa01229a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3f9e59c700 1 -- 172.21.15.59:0/3431984807 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fa009e410 msgr2=0x7f3fa0122ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3f9e59c700 1 --2- 172.21.15.59:0/3431984807 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fa009e410 0x7f3fa0122ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3f9e59c700 1 -- 172.21.15.59:0/3431984807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fa009e000 msgr2=0x7f3fa01229a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3f9e59c700 1 --2- 172.21.15.59:0/3431984807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fa009e000 0x7f3fa01229a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.476+0000 7f3f9e59c700 1 -- 172.21.15.59:0/3431984807 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f98009a70 con 0x7f3fa009d6f0 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.477+0000 7f3f9e59c700 1 --2- 172.21.15.59:0/3431984807 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fa009d6f0 0x7f3fa0122460 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000bee0 tx=0x7f3f90004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.477+0000 7f3f96ffd700 1 -- 172.21.15.59:0/3431984807 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90003b30 con 0x7f3fa009d6f0 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.477+0000 7f3f96ffd700 1 -- 172.21.15.59:0/3431984807 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f90003c90 con 0x7f3fa009d6f0 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.477+0000 7f3fa4987700 1 -- 172.21.15.59:0/3431984807 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9000b7f0 con 0x7f3fa009d6f0 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.477+0000 7f3f96ffd700 1 -- 172.21.15.59:0/3431984807 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90010470 con 0x7f3fa009d6f0 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.477+0000 7f3fa4987700 1 -- 172.21.15.59:0/3431984807 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa009c750 con 0x7f3fa009d6f0 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.478+0000 7f3f96ffd700 1 -- 172.21.15.59:0/3431984807 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f90019400 con 0x7f3fa009d6f0 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.478+0000 7f3fa4987700 1 -- 172.21.15.59:0/3431984807 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa0074ea0 con 0x7f3fa009d6f0 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.478+0000 7f3f96ffd700 1 -- 172.21.15.59:0/3431984807 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f90040b90 con 0x7f3fa009d6f0 2023-09-30T22:31:00.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.483+0000 7f3f96ffd700 1 -- 172.21.15.59:0/3431984807 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f9002a6c0 con 0x7f3fa009d6f0 2023-09-30T22:31:00.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.690+0000 7f3fa4987700 1 -- 172.21.15.59:0/3431984807 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3fa0126770 con 0x7f3fa009d6f0 2023-09-30T22:31:00.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.690+0000 7f3f96ffd700 1 -- 172.21.15.59:0/3431984807 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f9002a300 con 0x7f3fa009d6f0 2023-09-30T22:31:00.690 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.692+0000 7f3fa4987700 1 -- 172.21.15.59:0/3431984807 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fa009d6f0 msgr2=0x7f3fa0122460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.692+0000 7f3fa4987700 1 --2- 172.21.15.59:0/3431984807 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fa009d6f0 0x7f3fa0122460 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000bee0 tx=0x7f3f90004750 comp rx=0 tx=0).stop 2023-09-30T22:31:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.693+0000 7f3fa4987700 1 -- 172.21.15.59:0/3431984807 shutdown_connections 2023-09-30T22:31:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.693+0000 7f3fa4987700 1 --2- 172.21.15.59:0/3431984807 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fa009e410 0x7f3fa0122ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.693+0000 7f3fa4987700 1 --2- 172.21.15.59:0/3431984807 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fa009d6f0 0x7f3fa0122460 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.693+0000 7f3fa4987700 1 --2- 172.21.15.59:0/3431984807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fa009e000 0x7f3fa01229a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.693+0000 7f3fa4987700 1 -- 172.21.15.59:0/3431984807 >> 172.21.15.59:0/3431984807 conn(0x7f3fa0066f50 msgr2=0x7f3fa00710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.693+0000 7f3fa4987700 1 -- 172.21.15.59:0/3431984807 shutdown_connections 2023-09-30T22:31:00.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:00.693+0000 7f3fa4987700 1 -- 172.21.15.59:0/3431984807 wait complete. 2023-09-30T22:31:00.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:00.873 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:00.931 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:00.966 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:01.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.029+0000 7ff91db85700 1 Processor -- start 2023-09-30T22:31:01.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.029+0000 7ff91db85700 1 -- start start 2023-09-30T22:31:01.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.030+0000 7ff91db85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91809e1b0 0x7ff918138a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.030+0000 7ff91db85700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff918138f50 0x7ff91813b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.030+0000 7ff91db85700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91809a570 con 0x7ff91809d6d0 2023-09-30T22:31:01.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.030+0000 7ff91db85700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91809e5a0 con 0x7ff918138f50 2023-09-30T22:31:01.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.030+0000 7ff91db85700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91809b1c0 con 0x7ff91809e1b0 2023-09-30T22:31:01.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.030+0000 7ff917fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff918138f50 0x7ff91813b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.030+0000 7ff916ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91809e1b0 0x7ff918138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.030+0000 7ff917fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff918138f50 0x7ff91813b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34314/0 (socket says 172.21.15.59:34314) 2023-09-30T22:31:01.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.030+0000 7ff917fff700 1 -- 172.21.15.59:0/3787078832 learned_addr learned my addr 172.21.15.59:0/3787078832 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:01.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.031+0000 7ff917fff700 1 -- 172.21.15.59:0/3787078832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91809e1b0 msgr2=0x7ff918138a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:01.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.031+0000 7ff917fff700 1 --2- 172.21.15.59:0/3787078832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91809e1b0 0x7ff918138a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.031+0000 7ff917fff700 1 -- 172.21.15.59:0/3787078832 >> v1:172.21.15.59:6789/0 conn(0x7ff91809d6d0 legacy=0x7ff91809daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.031+0000 7ff917fff700 1 -- 172.21.15.59:0/3787078832 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91809f240 con 0x7ff918138f50 2023-09-30T22:31:01.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.031+0000 7ff916ffd700 1 --2- 172.21.15.59:0/3787078832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91809e1b0 0x7ff918138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:01.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.031+0000 7ff917fff700 1 --2- 172.21.15.59:0/3787078832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff918138f50 0x7ff91813b330 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff910009e50 tx=0x7ff91000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5b73d75eb91e4f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:01.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.031+0000 7ff9167fc700 1 -- 172.21.15.59:0/3787078832 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91000e070 con 0x7ff918138f50 2023-09-30T22:31:01.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.031+0000 7ff9167fc700 1 -- 172.21.15.59:0/3787078832 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91000b910 con 0x7ff918138f50 2023-09-30T22:31:01.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.031+0000 7ff9167fc700 1 -- 172.21.15.59:0/3787078832 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91000bcc0 con 0x7ff918138f50 2023-09-30T22:31:01.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.032+0000 7ff91db85700 1 -- 172.21.15.59:0/3787078832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff918138f50 msgr2=0x7ff91813b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.032+0000 7ff91db85700 1 --2- 172.21.15.59:0/3787078832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff918138f50 0x7ff91813b330 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff910009e50 tx=0x7ff91000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:01.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.032+0000 7ff91db85700 1 -- 172.21.15.59:0/3787078832 shutdown_connections 2023-09-30T22:31:01.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.032+0000 7ff91db85700 1 --2- 172.21.15.59:0/3787078832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff918138f50 0x7ff91813b330 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.032+0000 7ff91db85700 1 --2- 172.21.15.59:0/3787078832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91809e1b0 0x7ff918138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.032+0000 7ff91db85700 1 -- 172.21.15.59:0/3787078832 >> 172.21.15.59:0/3787078832 conn(0x7ff918099c20 msgr2=0x7ff9180a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:01.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.032+0000 7ff91db85700 1 -- 172.21.15.59:0/3787078832 shutdown_connections 2023-09-30T22:31:01.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.032+0000 7ff91db85700 1 -- 172.21.15.59:0/3787078832 wait complete. 2023-09-30T22:31:01.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.033+0000 7ff91db85700 1 Processor -- start 2023-09-30T22:31:01.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.033+0000 7ff91db85700 1 -- start start 2023-09-30T22:31:01.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff91db85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91809d6d0 0x7ff91811b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff91db85700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff91809e1b0 0x7ff91811b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff91db85700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff918138f50 0x7ff9181c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff91db85700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91811dc30 con 0x7ff918138f50 2023-09-30T22:31:01.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff91db85700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91811adf0 con 0x7ff91809d6d0 2023-09-30T22:31:01.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff91db85700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff91811bc20 con 0x7ff91809e1b0 2023-09-30T22:31:01.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff917fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff918138f50 0x7ff9181c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff9177fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91809d6d0 0x7ff91811b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff917fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff918138f50 0x7ff9181c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34318/0 (socket says 172.21.15.59:34318) 2023-09-30T22:31:01.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff917fff700 1 -- 172.21.15.59:0/1593675230 learned_addr learned my addr 172.21.15.59:0/1593675230 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:01.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff9177fe700 1 -- 172.21.15.59:0/1593675230 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff91809e1b0 msgr2=0x7ff91811b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff9177fe700 1 --2- 172.21.15.59:0/1593675230 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff91809e1b0 0x7ff91811b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff9177fe700 1 -- 172.21.15.59:0/1593675230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff918138f50 msgr2=0x7ff9181c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff9177fe700 1 --2- 172.21.15.59:0/1593675230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff918138f50 0x7ff9181c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff9177fe700 1 -- 172.21.15.59:0/1593675230 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c0094a0 con 0x7ff91809d6d0 2023-09-30T22:31:01.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.034+0000 7ff917fff700 1 --2- 172.21.15.59:0/1593675230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff918138f50 0x7ff9181c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:01.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.035+0000 7ff9177fe700 1 --2- 172.21.15.59:0/1593675230 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91809d6d0 0x7ff91811b1a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff908000f60 tx=0x7ff90800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:01.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.035+0000 7ff8fffff700 1 -- 172.21.15.59:0/1593675230 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9080052d0 con 0x7ff91809d6d0 2023-09-30T22:31:01.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.035+0000 7ff91db85700 1 -- 172.21.15.59:0/1593675230 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff910009b30 con 0x7ff91809d6d0 2023-09-30T22:31:01.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.035+0000 7ff8fffff700 1 -- 172.21.15.59:0/1593675230 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff908005430 con 0x7ff91809d6d0 2023-09-30T22:31:01.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.035+0000 7ff8fffff700 1 -- 172.21.15.59:0/1593675230 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9080038c0 con 0x7ff91809d6d0 2023-09-30T22:31:01.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.035+0000 7ff91db85700 1 -- 172.21.15.59:0/1593675230 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91811c500 con 0x7ff91809d6d0 2023-09-30T22:31:01.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.036+0000 7ff8fffff700 1 -- 172.21.15.59:0/1593675230 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff908003a20 con 0x7ff91809d6d0 2023-09-30T22:31:01.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.036+0000 7ff8fffff700 1 -- 172.21.15.59:0/1593675230 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff90803eae0 con 0x7ff91809d6d0 2023-09-30T22:31:01.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.037+0000 7ff91db85700 1 -- 172.21.15.59:0/1593675230 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91804f2a0 con 0x7ff91809d6d0 2023-09-30T22:31:01.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.042+0000 7ff8fffff700 1 -- 172.21.15.59:0/1593675230 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff908018260 con 0x7ff91809d6d0 2023-09-30T22:31:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.075+0000 7feb96459700 1 Processor -- start 2023-09-30T22:31:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.075+0000 7feb96459700 1 -- start start 2023-09-30T22:31:01.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.076+0000 7feb96459700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feb900a0a30 0x7feb900a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.076+0000 7feb96459700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb900a1340 0x7feb90133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.076+0000 7feb96459700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9009edd0 con 0x7feb90133fa0 2023-09-30T22:31:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.076+0000 7feb96459700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9009e1f0 con 0x7feb900a0a30 2023-09-30T22:31:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.076+0000 7feb96459700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb9009dc50 con 0x7feb900a1340 2023-09-30T22:31:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.076+0000 7feb8ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feb900a0a30 0x7feb900a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.076+0000 7feb8ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feb900a0a30 0x7feb900a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34324/0 (socket says 172.21.15.59:34324) 2023-09-30T22:31:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.076+0000 7feb8ffff700 1 -- 172.21.15.59:0/1309573669 learned_addr learned my addr 172.21.15.59:0/1309573669 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.076+0000 7feb8f7fe700 1 --2- 172.21.15.59:0/1309573669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb900a1340 0x7feb90133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.077+0000 7feb8ffff700 1 -- 172.21.15.59:0/1309573669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb900a1340 msgr2=0x7feb90133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.077+0000 7feb8ffff700 1 --2- 172.21.15.59:0/1309573669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb900a1340 0x7feb90133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.077+0000 7feb8ffff700 1 -- 172.21.15.59:0/1309573669 >> v1:172.21.15.59:6789/0 conn(0x7feb90133fa0 legacy=0x7feb9013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.077+0000 7feb8ffff700 1 -- 172.21.15.59:0/1309573669 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb900a1fe0 con 0x7feb900a0a30 2023-09-30T22:31:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.077+0000 7feb8ffff700 1 --2- 172.21.15.59:0/1309573669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb900a0a30 0x7feb900a0e00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7feb800098f0 tx=0x7feb80009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8255ad00044d533c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.077+0000 7feb8effd700 1 -- 172.21.15.59:0/1309573669 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80011830 con 0x7feb900a0a30 2023-09-30T22:31:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.077+0000 7feb8effd700 1 -- 172.21.15.59:0/1309573669 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb80011990 con 0x7feb900a0a30 2023-09-30T22:31:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.077+0000 7feb8effd700 1 -- 172.21.15.59:0/1309573669 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80011d20 con 0x7feb900a0a30 2023-09-30T22:31:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.078+0000 7feb96459700 1 -- 172.21.15.59:0/1309573669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb900a0a30 msgr2=0x7feb900a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.078+0000 7feb96459700 1 --2- 172.21.15.59:0/1309573669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb900a0a30 0x7feb900a0e00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7feb800098f0 tx=0x7feb80009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.078+0000 7feb96459700 1 -- 172.21.15.59:0/1309573669 shutdown_connections 2023-09-30T22:31:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.078+0000 7feb96459700 1 --2- 172.21.15.59:0/1309573669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb900a0a30 0x7feb900a0e00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.078+0000 7feb96459700 1 --2- 172.21.15.59:0/1309573669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb900a1340 0x7feb90133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.078+0000 7feb96459700 1 -- 172.21.15.59:0/1309573669 >> 172.21.15.59:0/1309573669 conn(0x7feb900a6550 msgr2=0x7feb900a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.078+0000 7feb96459700 1 -- 172.21.15.59:0/1309573669 shutdown_connections 2023-09-30T22:31:01.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.078+0000 7feb96459700 1 -- 172.21.15.59:0/1309573669 wait complete. 2023-09-30T22:31:01.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.079+0000 7feb96459700 1 Processor -- start 2023-09-30T22:31:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.079+0000 7feb96459700 1 -- start start 2023-09-30T22:31:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb96459700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb900a0a30 0x7feb901c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb96459700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb900a1340 0x7feb901c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb96459700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb90133fa0 0x7feb901c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb96459700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb900a0220 con 0x7feb90133fa0 2023-09-30T22:31:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb96459700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb900a3710 con 0x7feb900a1340 2023-09-30T22:31:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb96459700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb90120580 con 0x7feb900a0a30 2023-09-30T22:31:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb8ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb900a0a30 0x7feb901c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb8f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb900a1340 0x7feb901c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb8ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb900a0a30 0x7feb901c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41134/0 (socket says 172.21.15.59:41134) 2023-09-30T22:31:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb8ffff700 1 -- 172.21.15.59:0/3846611910 learned_addr learned my addr 172.21.15.59:0/3846611910 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb949f6700 1 --2- 172.21.15.59:0/3846611910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb90133fa0 0x7feb901c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb8ffff700 1 -- 172.21.15.59:0/3846611910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb900a1340 msgr2=0x7feb901c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb8ffff700 1 --2- 172.21.15.59:0/3846611910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb900a1340 0x7feb901c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb8ffff700 1 -- 172.21.15.59:0/3846611910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb90133fa0 msgr2=0x7feb901c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb8ffff700 1 --2- 172.21.15.59:0/3846611910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb90133fa0 0x7feb901c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb8ffff700 1 -- 172.21.15.59:0/3846611910 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb80009550 con 0x7feb900a0a30 2023-09-30T22:31:01.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.080+0000 7feb8ffff700 1 --2- 172.21.15.59:0/3846611910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb900a0a30 0x7feb901c8530 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feb80000c00 tx=0x7feb80004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:01.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.081+0000 7feb8cff9700 1 -- 172.21.15.59:0/3846611910 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80004480 con 0x7feb900a0a30 2023-09-30T22:31:01.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.081+0000 7feb8cff9700 1 -- 172.21.15.59:0/3846611910 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8001f070 con 0x7feb900a0a30 2023-09-30T22:31:01.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.081+0000 7feb96459700 1 -- 172.21.15.59:0/3846611910 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb90120d00 con 0x7feb900a0a30 2023-09-30T22:31:01.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.081+0000 7feb8cff9700 1 -- 172.21.15.59:0/3846611910 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800038c0 con 0x7feb900a0a30 2023-09-30T22:31:01.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.081+0000 7feb96459700 1 -- 172.21.15.59:0/3846611910 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb90122bb0 con 0x7feb900a0a30 2023-09-30T22:31:01.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.082+0000 7feb8cff9700 1 -- 172.21.15.59:0/3846611910 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb80021030 con 0x7feb900a0a30 2023-09-30T22:31:01.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.082+0000 7feb8cff9700 1 -- 172.21.15.59:0/3846611910 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feb80040a00 con 0x7feb900a0a30 2023-09-30T22:31:01.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.082+0000 7feb96459700 1 -- 172.21.15.59:0/3846611910 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb90074ea0 con 0x7feb900a0a30 2023-09-30T22:31:01.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.087+0000 7feb8cff9700 1 -- 172.21.15.59:0/3846611910 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb80015080 con 0x7feb900a0a30 2023-09-30T22:31:01.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.117+0000 7f9ea5279700 1 Processor -- start 2023-09-30T22:31:01.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.117+0000 7f9ea5279700 1 -- start start 2023-09-30T22:31:01.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.118+0000 7f9ea5279700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ea00a0a30 0x7f9ea00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.118+0000 7f9ea5279700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ea009d630 0x7f9ea00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.118+0000 7f9ea5279700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea00a2a70 con 0x7f9ea0133930 2023-09-30T22:31:01.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.118+0000 7f9ea5279700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea00a01d0 con 0x7f9ea00a0a30 2023-09-30T22:31:01.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.118+0000 7f9ea5279700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea009e2b0 con 0x7f9ea009d630 2023-09-30T22:31:01.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.118+0000 7f9e9effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ea00a0a30 0x7f9ea00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.118+0000 7f9e9effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ea00a0a30 0x7f9ea00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34342/0 (socket says 172.21.15.59:34342) 2023-09-30T22:31:01.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.118+0000 7f9e9effd700 1 -- 172.21.15.59:0/4223916804 learned_addr learned my addr 172.21.15.59:0/4223916804 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:01.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.118+0000 7f9e967fc700 1 --2- 172.21.15.59:0/4223916804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ea009d630 0x7f9ea00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.119+0000 7f9e967fc700 1 -- 172.21.15.59:0/4223916804 >> v2:172.21.15.59:3300/0 conn(0x7f9ea00a0a30 msgr2=0x7f9ea00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:01.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.119+0000 7f9e967fc700 1 --2- 172.21.15.59:0/4223916804 >> v2:172.21.15.59:3300/0 conn(0x7f9ea00a0a30 0x7f9ea00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.119+0000 7f9e967fc700 1 -- 172.21.15.59:0/4223916804 >> v1:172.21.15.59:6789/0 conn(0x7f9ea0133930 legacy=0x7f9ea0133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.119+0000 7f9e967fc700 1 -- 172.21.15.59:0/4223916804 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea009dc50 con 0x7f9ea009d630 2023-09-30T22:31:01.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.119+0000 7f9e9effd700 1 --2- 172.21.15.59:0/4223916804 >> v2:172.21.15.59:3300/0 conn(0x7f9ea00a0a30 0x7f9ea00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:01.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.119+0000 7f9e967fc700 1 --2- 172.21.15.59:0/4223916804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ea009d630 0x7f9ea00a1340 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009840 tx=0x7f9e88009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf195eca58da6af5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:01.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.119+0000 7f9e9e7fc700 1 -- 172.21.15.59:0/4223916804 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88011830 con 0x7f9ea009d630 2023-09-30T22:31:01.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.119+0000 7f9e9e7fc700 1 -- 172.21.15.59:0/4223916804 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e88011990 con 0x7f9ea009d630 2023-09-30T22:31:01.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.119+0000 7f9e9e7fc700 1 -- 172.21.15.59:0/4223916804 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88011d20 con 0x7f9ea009d630 2023-09-30T22:31:01.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.120+0000 7f9ea5279700 1 -- 172.21.15.59:0/4223916804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ea009d630 msgr2=0x7f9ea00a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.120+0000 7f9ea5279700 1 --2- 172.21.15.59:0/4223916804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ea009d630 0x7f9ea00a1340 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009840 tx=0x7f9e88009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.120+0000 7f9ea5279700 1 -- 172.21.15.59:0/4223916804 shutdown_connections 2023-09-30T22:31:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.120+0000 7f9ea5279700 1 --2- 172.21.15.59:0/4223916804 >> v2:172.21.15.59:3300/0 conn(0x7f9ea00a0a30 0x7f9ea00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.120+0000 7f9ea5279700 1 --2- 172.21.15.59:0/4223916804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ea009d630 0x7f9ea00a1340 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.120+0000 7f9ea5279700 1 -- 172.21.15.59:0/4223916804 >> 172.21.15.59:0/4223916804 conn(0x7f9ea00a3050 msgr2=0x7f9ea00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.120+0000 7f9ea5279700 1 -- 172.21.15.59:0/4223916804 shutdown_connections 2023-09-30T22:31:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.120+0000 7f9ea5279700 1 -- 172.21.15.59:0/4223916804 wait complete. 2023-09-30T22:31:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.121+0000 7f9ea5279700 1 Processor -- start 2023-09-30T22:31:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.122+0000 7f9ea5279700 1 -- start start 2023-09-30T22:31:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.122+0000 7f9ea5279700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ea009d630 0x7f9ea0121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.122+0000 7f9ea5279700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ea00a0a30 0x7f9ea0121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9ea5279700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ea0133930 0x7f9ea0121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9ea5279700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea01225b0 con 0x7f9ea00a0a30 2023-09-30T22:31:01.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9ea5279700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea0124bd0 con 0x7f9ea0133930 2023-09-30T22:31:01.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9ea5279700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea0124630 con 0x7f9ea009d630 2023-09-30T22:31:01.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9e9effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ea009d630 0x7f9ea0121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9e9effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ea009d630 0x7f9ea0121100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41140/0 (socket says 172.21.15.59:41140) 2023-09-30T22:31:01.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9e9effd700 1 -- 172.21.15.59:0/3424914515 learned_addr learned my addr 172.21.15.59:0/3424914515 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:01.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9e967fc700 1 --2- 172.21.15.59:0/3424914515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ea00a0a30 0x7f9ea0121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9e9f7fe700 1 --2- 172.21.15.59:0/3424914515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ea0133930 0x7f9ea0121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9e9effd700 1 -- 172.21.15.59:0/3424914515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ea0133930 msgr2=0x7f9ea0121b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9e9effd700 1 --2- 172.21.15.59:0/3424914515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ea0133930 0x7f9ea0121b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9e9effd700 1 -- 172.21.15.59:0/3424914515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ea00a0a30 msgr2=0x7f9ea0121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9e9effd700 1 --2- 172.21.15.59:0/3424914515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ea00a0a30 0x7f9ea0121640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9e9effd700 1 -- 172.21.15.59:0/3424914515 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e90009550 con 0x7f9ea009d630 2023-09-30T22:31:01.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9e967fc700 1 --2- 172.21.15.59:0/3424914515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ea00a0a30 0x7f9ea0121640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:01.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9e9effd700 1 --2- 172.21.15.59:0/3424914515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ea009d630 0x7f9ea0121100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000ebe0 tx=0x7f9e9000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:01.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.123+0000 7f9e97fff700 1 -- 172.21.15.59:0/3424914515 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000c850 con 0x7f9ea009d630 2023-09-30T22:31:01.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.124+0000 7f9e97fff700 1 -- 172.21.15.59:0/3424914515 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9000c9b0 con 0x7f9ea009d630 2023-09-30T22:31:01.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.124+0000 7f9ea5279700 1 -- 172.21.15.59:0/3424914515 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e880094a0 con 0x7f9ea009d630 2023-09-30T22:31:01.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.124+0000 7f9e97fff700 1 -- 172.21.15.59:0/3424914515 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000cd40 con 0x7f9ea009d630 2023-09-30T22:31:01.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.124+0000 7f9ea5279700 1 -- 172.21.15.59:0/3424914515 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea00a0410 con 0x7f9ea009d630 2023-09-30T22:31:01.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.125+0000 7f9ea5279700 1 -- 172.21.15.59:0/3424914515 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea011df60 con 0x7f9ea009d630 2023-09-30T22:31:01.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.125+0000 7f9e97fff700 1 -- 172.21.15.59:0/3424914515 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e90013470 con 0x7f9ea009d630 2023-09-30T22:31:01.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.125+0000 7f9e97fff700 1 -- 172.21.15.59:0/3424914515 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9e90040030 con 0x7f9ea009d630 2023-09-30T22:31:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.130+0000 7f9e97fff700 1 -- 172.21.15.59:0/3424914515 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e90011760 con 0x7f9ea009d630 2023-09-30T22:31:01.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.253+0000 7ff91db85700 1 -- 172.21.15.59:0/1593675230 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff918137e70 con 0x7ff91809d6d0 2023-09-30T22:31:01.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.253+0000 7ff8fffff700 1 -- 172.21.15.59:0/1593675230 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff908017020 con 0x7ff91809d6d0 2023-09-30T22:31:01.254 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:01.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.255+0000 7ff91db85700 1 -- 172.21.15.59:0/1593675230 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91809d6d0 msgr2=0x7ff91811b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.255+0000 7ff91db85700 1 --2- 172.21.15.59:0/1593675230 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91809d6d0 0x7ff91811b1a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff908000f60 tx=0x7ff90800c730 comp rx=0 tx=0).stop 2023-09-30T22:31:01.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.256+0000 7ff91db85700 1 -- 172.21.15.59:0/1593675230 shutdown_connections 2023-09-30T22:31:01.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.256+0000 7ff91db85700 1 --2- 172.21.15.59:0/1593675230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff918138f50 0x7ff9181c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.256+0000 7ff91db85700 1 --2- 172.21.15.59:0/1593675230 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91809d6d0 0x7ff91811b1a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.256+0000 7ff91db85700 1 --2- 172.21.15.59:0/1593675230 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff91809e1b0 0x7ff91811b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.256+0000 7ff91db85700 1 -- 172.21.15.59:0/1593675230 >> 172.21.15.59:0/1593675230 conn(0x7ff918099c20 msgr2=0x7ff918133d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:01.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.256+0000 7ff91db85700 1 -- 172.21.15.59:0/1593675230 shutdown_connections 2023-09-30T22:31:01.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.256+0000 7ff91db85700 1 -- 172.21.15.59:0/1593675230 wait complete. 2023-09-30T22:31:01.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.297+0000 7feb96459700 1 -- 172.21.15.59:0/3846611910 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feb9009be80 con 0x7feb900a0a30 2023-09-30T22:31:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.297+0000 7feb8cff9700 1 -- 172.21.15.59:0/3846611910 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb80003a20 con 0x7feb900a0a30 2023-09-30T22:31:01.298 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.300+0000 7feb96459700 1 -- 172.21.15.59:0/3846611910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb900a0a30 msgr2=0x7feb901c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.300+0000 7feb96459700 1 --2- 172.21.15.59:0/3846611910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb900a0a30 0x7feb901c8530 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feb80000c00 tx=0x7feb80004750 comp rx=0 tx=0).stop 2023-09-30T22:31:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.300+0000 7feb96459700 1 -- 172.21.15.59:0/3846611910 shutdown_connections 2023-09-30T22:31:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.300+0000 7feb96459700 1 --2- 172.21.15.59:0/3846611910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb900a0a30 0x7feb901c8530 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.300+0000 7feb96459700 1 --2- 172.21.15.59:0/3846611910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb90133fa0 0x7feb901c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.300+0000 7feb96459700 1 --2- 172.21.15.59:0/3846611910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb900a1340 0x7feb901c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.300+0000 7feb96459700 1 -- 172.21.15.59:0/3846611910 >> 172.21.15.59:0/3846611910 conn(0x7feb900a6550 msgr2=0x7feb901b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.300+0000 7feb96459700 1 -- 172.21.15.59:0/3846611910 shutdown_connections 2023-09-30T22:31:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.300+0000 7feb96459700 1 -- 172.21.15.59:0/3846611910 wait complete. 2023-09-30T22:31:01.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:01.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.346+0000 7f9ea5279700 1 -- 172.21.15.59:0/3424914515 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9ea0124850 con 0x7f9ea009d630 2023-09-30T22:31:01.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.347+0000 7f9e97fff700 1 -- 172.21.15.59:0/3424914515 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ea0124850 con 0x7f9ea009d630 2023-09-30T22:31:01.347 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:01.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.349+0000 7f9ea5279700 1 -- 172.21.15.59:0/3424914515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ea009d630 msgr2=0x7f9ea0121100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.349+0000 7f9ea5279700 1 --2- 172.21.15.59:0/3424914515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ea009d630 0x7f9ea0121100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000ebe0 tx=0x7f9e9000eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.349+0000 7f9ea5279700 1 -- 172.21.15.59:0/3424914515 shutdown_connections 2023-09-30T22:31:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.349+0000 7f9ea5279700 1 --2- 172.21.15.59:0/3424914515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ea009d630 0x7f9ea0121100 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.349+0000 7f9ea5279700 1 --2- 172.21.15.59:0/3424914515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ea0133930 0x7f9ea0121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.349+0000 7f9ea5279700 1 --2- 172.21.15.59:0/3424914515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ea00a0a30 0x7f9ea0121640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.349+0000 7f9ea5279700 1 -- 172.21.15.59:0/3424914515 >> 172.21.15.59:0/3424914515 conn(0x7f9ea00a3050 msgr2=0x7f9ea0133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.349+0000 7f9ea5279700 1 -- 172.21.15.59:0/3424914515 shutdown_connections 2023-09-30T22:31:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.349+0000 7f9ea5279700 1 -- 172.21.15.59:0/3424914515 wait complete. 2023-09-30T22:31:01.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:01.707 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:01.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.852+0000 7f2d4ae93700 1 Processor -- start 2023-09-30T22:31:01.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.852+0000 7f2d4ae93700 1 -- start start 2023-09-30T22:31:01.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.853+0000 7f2d4ae93700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d440a0a30 0x7f2d440a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.853+0000 7f2d4ae93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d4409d630 0x7f2d440a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.853+0000 7f2d4ae93700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d440a2a70 con 0x7f2d44133930 2023-09-30T22:31:01.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.853+0000 7f2d4ae93700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d440a01d0 con 0x7f2d440a0a30 2023-09-30T22:31:01.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.853+0000 7f2d4ae93700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4409e2b0 con 0x7f2d4409d630 2023-09-30T22:31:01.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.853+0000 7f2d48c2f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d440a0a30 0x7f2d440a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.853+0000 7f2d43fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d4409d630 0x7f2d440a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.853+0000 7f2d48c2f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d440a0a30 0x7f2d440a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34358/0 (socket says 172.21.15.59:34358) 2023-09-30T22:31:01.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.853+0000 7f2d48c2f700 1 -- 172.21.15.59:0/2834055296 learned_addr learned my addr 172.21.15.59:0/2834055296 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:01.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.853+0000 7f2d43fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d4409d630 0x7f2d440a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41144/0 (socket says 172.21.15.59:41144) 2023-09-30T22:31:01.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.853+0000 7f2d48c2f700 1 -- 172.21.15.59:0/2834055296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d4409d630 msgr2=0x7f2d440a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:01.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.853+0000 7f2d48c2f700 1 --2- 172.21.15.59:0/2834055296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d4409d630 0x7f2d440a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.853+0000 7f2d48c2f700 1 -- 172.21.15.59:0/2834055296 >> v1:172.21.15.59:6789/0 conn(0x7f2d44133930 legacy=0x7f2d44133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.853+0000 7f2d48c2f700 1 -- 172.21.15.59:0/2834055296 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4409dc50 con 0x7f2d440a0a30 2023-09-30T22:31:01.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.853+0000 7f2d43fff700 1 --2- 172.21.15.59:0/2834055296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d4409d630 0x7f2d440a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:01.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.854+0000 7f2d48c2f700 1 --2- 172.21.15.59:0/2834055296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d440a0a30 0x7f2d440a0e00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2d380098f0 tx=0x7f2d38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85dbf257be9928a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:01.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.854+0000 7f2d437fe700 1 -- 172.21.15.59:0/2834055296 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38011830 con 0x7f2d440a0a30 2023-09-30T22:31:01.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.854+0000 7f2d437fe700 1 -- 172.21.15.59:0/2834055296 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d38011990 con 0x7f2d440a0a30 2023-09-30T22:31:01.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.854+0000 7f2d437fe700 1 -- 172.21.15.59:0/2834055296 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38011d20 con 0x7f2d440a0a30 2023-09-30T22:31:01.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.854+0000 7f2d4ae93700 1 -- 172.21.15.59:0/2834055296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d440a0a30 msgr2=0x7f2d440a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.854+0000 7f2d4ae93700 1 --2- 172.21.15.59:0/2834055296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d440a0a30 0x7f2d440a0e00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2d380098f0 tx=0x7f2d38009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:01.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.854+0000 7f2d4ae93700 1 -- 172.21.15.59:0/2834055296 shutdown_connections 2023-09-30T22:31:01.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.854+0000 7f2d4ae93700 1 --2- 172.21.15.59:0/2834055296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d440a0a30 0x7f2d440a0e00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.854+0000 7f2d4ae93700 1 --2- 172.21.15.59:0/2834055296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d4409d630 0x7f2d440a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.854+0000 7f2d4ae93700 1 -- 172.21.15.59:0/2834055296 >> 172.21.15.59:0/2834055296 conn(0x7f2d440a3050 msgr2=0x7f2d440a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:01.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.854+0000 7f2d4ae93700 1 -- 172.21.15.59:0/2834055296 shutdown_connections 2023-09-30T22:31:01.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.854+0000 7f2d4ae93700 1 -- 172.21.15.59:0/2834055296 wait complete. 2023-09-30T22:31:01.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.855+0000 7f2d4ae93700 1 Processor -- start 2023-09-30T22:31:01.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.855+0000 7f2d4ae93700 1 -- start start 2023-09-30T22:31:01.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.856+0000 7f2d4ae93700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d4409d630 0x7f2d441c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.856+0000 7f2d4ae93700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d440a0a30 0x7f2d441c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.856+0000 7f2d4ae93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d44133930 0x7f2d441c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.856+0000 7f2d4ae93700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4411eea0 con 0x7f2d4409d630 2023-09-30T22:31:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.856+0000 7f2d4ae93700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d441207f0 con 0x7f2d440a0a30 2023-09-30T22:31:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.856+0000 7f2d4ae93700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44120600 con 0x7f2d44133930 2023-09-30T22:31:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.856+0000 7f2d49430700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d44133930 0x7f2d441c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.856+0000 7f2d43fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d440a0a30 0x7f2d441c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.856+0000 7f2d48c2f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d4409d630 0x7f2d441c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.856+0000 7f2d49430700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d44133930 0x7f2d441c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41154/0 (socket says 172.21.15.59:41154) 2023-09-30T22:31:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.856+0000 7f2d49430700 1 -- 172.21.15.59:0/1066369605 learned_addr learned my addr 172.21.15.59:0/1066369605 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.856+0000 7f2d43fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d440a0a30 0x7f2d441c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40544/0 (socket says 172.21.15.59:40544) 2023-09-30T22:31:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.857+0000 7f2d48c2f700 1 -- 172.21.15.59:0/1066369605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d44133930 msgr2=0x7f2d441c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.857+0000 7f2d48c2f700 1 --2- 172.21.15.59:0/1066369605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d44133930 0x7f2d441c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.857+0000 7f2d48c2f700 1 -- 172.21.15.59:0/1066369605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d440a0a30 msgr2=0x7f2d441c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.857+0000 7f2d48c2f700 1 --2- 172.21.15.59:0/1066369605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d440a0a30 0x7f2d441c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.857+0000 7f2d48c2f700 1 -- 172.21.15.59:0/1066369605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d300094a0 con 0x7f2d4409d630 2023-09-30T22:31:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.857+0000 7f2d48c2f700 1 --2- 172.21.15.59:0/1066369605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d4409d630 0x7f2d441c8120 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2d38016000 tx=0x7f2d38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.857+0000 7f2d417fa700 1 -- 172.21.15.59:0/1066369605 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d380036a0 con 0x7f2d4409d630 2023-09-30T22:31:01.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.857+0000 7f2d417fa700 1 -- 172.21.15.59:0/1066369605 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d38003800 con 0x7f2d4409d630 2023-09-30T22:31:01.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.857+0000 7f2d4ae93700 1 -- 172.21.15.59:0/1066369605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d38009550 con 0x7f2d4409d630 2023-09-30T22:31:01.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.857+0000 7f2d417fa700 1 -- 172.21.15.59:0/1066369605 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38003b90 con 0x7f2d4409d630 2023-09-30T22:31:01.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.857+0000 7f2d4ae93700 1 -- 172.21.15.59:0/1066369605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d44122230 con 0x7f2d4409d630 2023-09-30T22:31:01.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.858+0000 7f2d417fa700 1 -- 172.21.15.59:0/1066369605 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d38021070 con 0x7f2d4409d630 2023-09-30T22:31:01.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.858+0000 7f2d417fa700 1 -- 172.21.15.59:0/1066369605 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d38040a90 con 0x7f2d4409d630 2023-09-30T22:31:01.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.858+0000 7f2d4ae93700 1 -- 172.21.15.59:0/1066369605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d440747f0 con 0x7f2d4409d630 2023-09-30T22:31:01.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:01.863+0000 7f2d417fa700 1 -- 172.21.15.59:0/1066369605 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d38015080 con 0x7f2d4409d630 2023-09-30T22:31:02.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.067+0000 7f2d4ae93700 1 -- 172.21.15.59:0/1066369605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2d44122000 con 0x7f2d4409d630 2023-09-30T22:31:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.068+0000 7f2d417fa700 1 -- 172.21.15.59:0/1066369605 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d3800b3e0 con 0x7f2d4409d630 2023-09-30T22:31:02.068 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.070+0000 7f2d4ae93700 1 -- 172.21.15.59:0/1066369605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d4409d630 msgr2=0x7f2d441c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.070+0000 7f2d4ae93700 1 --2- 172.21.15.59:0/1066369605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d4409d630 0x7f2d441c8120 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2d38016000 tx=0x7f2d38004750 comp rx=0 tx=0).stop 2023-09-30T22:31:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.070+0000 7f2d4ae93700 1 -- 172.21.15.59:0/1066369605 shutdown_connections 2023-09-30T22:31:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.070+0000 7f2d4ae93700 1 --2- 172.21.15.59:0/1066369605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d44133930 0x7f2d441c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.070+0000 7f2d4ae93700 1 --2- 172.21.15.59:0/1066369605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d4409d630 0x7f2d441c8120 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.070+0000 7f2d4ae93700 1 --2- 172.21.15.59:0/1066369605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d440a0a30 0x7f2d441c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.070+0000 7f2d4ae93700 1 -- 172.21.15.59:0/1066369605 >> 172.21.15.59:0/1066369605 conn(0x7f2d440a3050 msgr2=0x7f2d4409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.070+0000 7f2d4ae93700 1 -- 172.21.15.59:0/1066369605 shutdown_connections 2023-09-30T22:31:02.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.070+0000 7f2d4ae93700 1 -- 172.21.15.59:0/1066369605 wait complete. 2023-09-30T22:31:02.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:02.271 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:02.320 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:02.363 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:02.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.424+0000 7f8788687700 1 Processor -- start 2023-09-30T22:31:02.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.424+0000 7f8788687700 1 -- start start 2023-09-30T22:31:02.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.424+0000 7f8788687700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8780134550 0x7f8780136930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.424+0000 7f8788687700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8780136e70 0x7f8780139250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.424+0000 7f8788687700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878009acd0 con 0x7f8780131650 2023-09-30T22:31:02.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.424+0000 7f8788687700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8780131240 con 0x7f8780136e70 2023-09-30T22:31:02.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.424+0000 7f8788687700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8780132130 con 0x7f8780134550 2023-09-30T22:31:02.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.425+0000 7f8786423700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8780131650 0x7f8780131a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55454/0 (socket says 172.21.15.59:55454) 2023-09-30T22:31:02.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.425+0000 7f8786423700 1 -- 172.21.15.59:0/1655000863 learned_addr learned my addr 172.21.15.59:0/1655000863 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:02.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.425+0000 7f8785c22700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8780134550 0x7f8780136930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.425+0000 7f8786c24700 1 --2- 172.21.15.59:0/1655000863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8780136e70 0x7f8780139250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.425+0000 7f8785421700 1 -- 172.21.15.59:0/1655000863 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96679084 0 0) 0x7f878009acd0 con 0x7f8780131650 2023-09-30T22:31:02.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.425+0000 7f8785421700 1 -- 172.21.15.59:0/1655000863 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f876c0035b0 con 0x7f8780131650 2023-09-30T22:31:02.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.425+0000 7f8785c22700 1 -- 172.21.15.59:0/1655000863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8780136e70 msgr2=0x7f8780139250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:02.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.425+0000 7f8785c22700 1 --2- 172.21.15.59:0/1655000863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8780136e70 0x7f8780139250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.425+0000 7f8785c22700 1 -- 172.21.15.59:0/1655000863 >> v1:172.21.15.59:6789/0 conn(0x7f8780131650 legacy=0x7f8780131a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.425+0000 7f8785c22700 1 -- 172.21.15.59:0/1655000863 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8780131430 con 0x7f8780134550 2023-09-30T22:31:02.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.425+0000 7f8786c24700 1 --2- 172.21.15.59:0/1655000863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8780136e70 0x7f8780139250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:02.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.426+0000 7f8785c22700 1 --2- 172.21.15.59:0/1655000863 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8780134550 0x7f8780136930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8780131620 tx=0x7f8770009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a2e1ded4aa6a2aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:02.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.426+0000 7f8785421700 1 -- 172.21.15.59:0/1655000863 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8770004020 con 0x7f8780134550 2023-09-30T22:31:02.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.426+0000 7f8785421700 1 -- 172.21.15.59:0/1655000863 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8770004180 con 0x7f8780134550 2023-09-30T22:31:02.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.426+0000 7f8785421700 1 -- 172.21.15.59:0/1655000863 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8770004530 con 0x7f8780134550 2023-09-30T22:31:02.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.426+0000 7f8788687700 1 -- 172.21.15.59:0/1655000863 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8780134550 msgr2=0x7f8780136930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.426+0000 7f8788687700 1 --2- 172.21.15.59:0/1655000863 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8780134550 0x7f8780136930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8780131620 tx=0x7f8770009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:02.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.427+0000 7f8788687700 1 -- 172.21.15.59:0/1655000863 shutdown_connections 2023-09-30T22:31:02.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.427+0000 7f8788687700 1 --2- 172.21.15.59:0/1655000863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8780136e70 0x7f8780139250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.427+0000 7f8788687700 1 --2- 172.21.15.59:0/1655000863 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8780134550 0x7f8780136930 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.427+0000 7f8788687700 1 -- 172.21.15.59:0/1655000863 >> 172.21.15.59:0/1655000863 conn(0x7f87800a2610 msgr2=0x7f87800a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:02.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.427+0000 7f8788687700 1 -- 172.21.15.59:0/1655000863 shutdown_connections 2023-09-30T22:31:02.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.427+0000 7f8788687700 1 -- 172.21.15.59:0/1655000863 wait complete. 2023-09-30T22:31:02.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.428+0000 7f8788687700 1 Processor -- start 2023-09-30T22:31:02.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.428+0000 7f8788687700 1 -- start start 2023-09-30T22:31:02.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.428+0000 7f8788687700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8780131650 0x7f8780118c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.428+0000 7f8788687700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8780134550 0x7f87801191a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.428+0000 7f8788687700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8780136e70 0x7f87801196e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.428+0000 7f8788687700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878012e680 con 0x7f8780134550 2023-09-30T22:31:02.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.428+0000 7f8788687700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878009af10 con 0x7f8780136e70 2023-09-30T22:31:02.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.428+0000 7f8788687700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f878011c0d0 con 0x7f8780131650 2023-09-30T22:31:02.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.428+0000 7f8786423700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8780131650 0x7f8780118c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.428+0000 7f8786423700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8780131650 0x7f8780118c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41164/0 (socket says 172.21.15.59:41164) 2023-09-30T22:31:02.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.428+0000 7f8786423700 1 -- 172.21.15.59:0/4265102698 learned_addr learned my addr 172.21.15.59:0/4265102698 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:02.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.428+0000 7f8785c22700 1 --2- 172.21.15.59:0/4265102698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8780134550 0x7f87801191a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.429+0000 7f8786c24700 1 --2- 172.21.15.59:0/4265102698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8780136e70 0x7f87801196e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.429+0000 7f8786423700 1 -- 172.21.15.59:0/4265102698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8780136e70 msgr2=0x7f87801196e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.429+0000 7f8786423700 1 --2- 172.21.15.59:0/4265102698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8780136e70 0x7f87801196e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.429+0000 7f8786423700 1 -- 172.21.15.59:0/4265102698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8780134550 msgr2=0x7f87801191a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.429+0000 7f8786423700 1 --2- 172.21.15.59:0/4265102698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8780134550 0x7f87801191a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.429+0000 7f8786423700 1 -- 172.21.15.59:0/4265102698 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778009a70 con 0x7f8780131650 2023-09-30T22:31:02.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.429+0000 7f8786423700 1 --2- 172.21.15.59:0/4265102698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8780131650 0x7f8780118c60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f877c00c700 tx=0x7f877c00ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:02.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.429+0000 7f8776ffd700 1 -- 172.21.15.59:0/4265102698 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c005d70 con 0x7f8780131650 2023-09-30T22:31:02.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.429+0000 7f8776ffd700 1 -- 172.21.15.59:0/4265102698 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c0070d0 con 0x7f8780131650 2023-09-30T22:31:02.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.429+0000 7f8776ffd700 1 -- 172.21.15.59:0/4265102698 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c007440 con 0x7f8780131650 2023-09-30T22:31:02.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.429+0000 7f8788687700 1 -- 172.21.15.59:0/4265102698 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87700094a0 con 0x7f8780131650 2023-09-30T22:31:02.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.429+0000 7f8788687700 1 -- 172.21.15.59:0/4265102698 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878011c390 con 0x7f8780131650 2023-09-30T22:31:02.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.430+0000 7f8776ffd700 1 -- 172.21.15.59:0/4265102698 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f877c0075a0 con 0x7f8780131650 2023-09-30T22:31:02.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.430+0000 7f8776ffd700 1 -- 172.21.15.59:0/4265102698 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f877c03ea70 con 0x7f8780131650 2023-09-30T22:31:02.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.431+0000 7f8788687700 1 -- 172.21.15.59:0/4265102698 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878012ea80 con 0x7f8780131650 2023-09-30T22:31:02.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.435+0000 7f8776ffd700 1 -- 172.21.15.59:0/4265102698 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f877c017080 con 0x7f8780131650 2023-09-30T22:31:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.468+0000 7fa2ec434700 1 Processor -- start 2023-09-30T22:31:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.468+0000 7fa2ec434700 1 -- start start 2023-09-30T22:31:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.469+0000 7fa2ec434700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e409d6f0 0x7fa2e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.469+0000 7fa2ec434700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa2e409e000 0x7fa2e41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.469+0000 7fa2ec434700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e409b120 con 0x7fa2e409e410 2023-09-30T22:31:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.469+0000 7fa2ec434700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e406b460 con 0x7fa2e409e000 2023-09-30T22:31:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.469+0000 7fa2ec434700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e409a7e0 con 0x7fa2e409d6f0 2023-09-30T22:31:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.469+0000 7fa2e99cf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa2e409e000 0x7fa2e41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.469+0000 7fa2e99cf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa2e409e000 0x7fa2e41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34378/0 (socket says 172.21.15.59:34378) 2023-09-30T22:31:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.469+0000 7fa2e99cf700 1 -- 172.21.15.59:0/1598055881 learned_addr learned my addr 172.21.15.59:0/1598055881 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.469+0000 7fa2ea9d1700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa2e409e410 0x7fa2e4133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55464/0 (socket says 172.21.15.59:55464) 2023-09-30T22:31:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.469+0000 7fa2ea1d0700 1 --2- 172.21.15.59:0/1598055881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e409d6f0 0x7fa2e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.470+0000 7fa2e99cf700 1 -- 172.21.15.59:0/1598055881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e409d6f0 msgr2=0x7fa2e409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.470+0000 7fa2e99cf700 1 --2- 172.21.15.59:0/1598055881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e409d6f0 0x7fa2e409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.470+0000 7fa2e99cf700 1 -- 172.21.15.59:0/1598055881 >> v1:172.21.15.59:6789/0 conn(0x7fa2e409e410 legacy=0x7fa2e4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.470+0000 7fa2e99cf700 1 -- 172.21.15.59:0/1598055881 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e409a500 con 0x7fa2e409e000 2023-09-30T22:31:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.470+0000 7fa2ea1d0700 1 --2- 172.21.15.59:0/1598055881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e409d6f0 0x7fa2e409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.470+0000 7fa2e99cf700 1 --2- 172.21.15.59:0/1598055881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e409e000 0x7fa2e41339f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40098f0 tx=0x7fa2d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de0a63618005cbe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.470+0000 7fa2e91ce700 1 -- 172.21.15.59:0/1598055881 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4011830 con 0x7fa2e409e000 2023-09-30T22:31:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.470+0000 7fa2e91ce700 1 -- 172.21.15.59:0/1598055881 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4011990 con 0x7fa2e409e000 2023-09-30T22:31:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.470+0000 7fa2e91ce700 1 -- 172.21.15.59:0/1598055881 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4011d20 con 0x7fa2e409e000 2023-09-30T22:31:02.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.471+0000 7fa2ec434700 1 -- 172.21.15.59:0/1598055881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e409e000 msgr2=0x7fa2e41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.471+0000 7fa2ec434700 1 --2- 172.21.15.59:0/1598055881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e409e000 0x7fa2e41339f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40098f0 tx=0x7fa2d4009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:02.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.471+0000 7fa2ec434700 1 -- 172.21.15.59:0/1598055881 shutdown_connections 2023-09-30T22:31:02.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.471+0000 7fa2ec434700 1 --2- 172.21.15.59:0/1598055881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e409d6f0 0x7fa2e409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.471+0000 7fa2ec434700 1 --2- 172.21.15.59:0/1598055881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e409e000 0x7fa2e41339f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.471+0000 7fa2ec434700 1 -- 172.21.15.59:0/1598055881 >> 172.21.15.59:0/1598055881 conn(0x7fa2e4066f50 msgr2=0x7fa2e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:02.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.471+0000 7fa2ec434700 1 -- 172.21.15.59:0/1598055881 shutdown_connections 2023-09-30T22:31:02.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.471+0000 7fa2ec434700 1 -- 172.21.15.59:0/1598055881 wait complete. 2023-09-30T22:31:02.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.473+0000 7fa2ec434700 1 Processor -- start 2023-09-30T22:31:02.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.473+0000 7fa2ec434700 1 -- start start 2023-09-30T22:31:02.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2ec434700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2e409d6f0 0x7fa2e41a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2ec434700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e409e000 0x7fa2e41a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2ec434700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e409e410 0x7fa2e41a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2ec434700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e41a91f0 con 0x7fa2e409e410 2023-09-30T22:31:02.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2ec434700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e409c710 con 0x7fa2e409d6f0 2023-09-30T22:31:02.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2ec434700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40a3160 con 0x7fa2e409e000 2023-09-30T22:31:02.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2e99cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e409e000 0x7fa2e41a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2e99cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e409e000 0x7fa2e41a6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41180/0 (socket says 172.21.15.59:41180) 2023-09-30T22:31:02.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2ea1d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2e409d6f0 0x7fa2e41a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2e99cf700 1 -- 172.21.15.59:0/724694203 learned_addr learned my addr 172.21.15.59:0/724694203 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:02.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2ea9d1700 1 --2- 172.21.15.59:0/724694203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e409e410 0x7fa2e41a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2ea1d0700 1 -- 172.21.15.59:0/724694203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e409e000 msgr2=0x7fa2e41a6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2ea1d0700 1 --2- 172.21.15.59:0/724694203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e409e000 0x7fa2e41a6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2ea1d0700 1 -- 172.21.15.59:0/724694203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e409e410 msgr2=0x7fa2e41a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2ea1d0700 1 --2- 172.21.15.59:0/724694203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e409e410 0x7fa2e41a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2ea1d0700 1 -- 172.21.15.59:0/724694203 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e00094a0 con 0x7fa2e409d6f0 2023-09-30T22:31:02.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.474+0000 7fa2ea1d0700 1 --2- 172.21.15.59:0/724694203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2e409d6f0 0x7fa2e41a5fd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000e9b0 tx=0x7fa2e000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:02.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.475+0000 7fa2daffd700 1 -- 172.21.15.59:0/724694203 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e000c850 con 0x7fa2e409d6f0 2023-09-30T22:31:02.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.475+0000 7fa2daffd700 1 -- 172.21.15.59:0/724694203 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e000c9b0 con 0x7fa2e409d6f0 2023-09-30T22:31:02.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.475+0000 7fa2daffd700 1 -- 172.21.15.59:0/724694203 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e000cd40 con 0x7fa2e409d6f0 2023-09-30T22:31:02.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.475+0000 7fa2ec434700 1 -- 172.21.15.59:0/724694203 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d4009550 con 0x7fa2e409d6f0 2023-09-30T22:31:02.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.475+0000 7fa2ec434700 1 -- 172.21.15.59:0/724694203 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e41a8da0 con 0x7fa2e409d6f0 2023-09-30T22:31:02.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.476+0000 7fa2ec434700 1 -- 172.21.15.59:0/724694203 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e41a9600 con 0x7fa2e409d6f0 2023-09-30T22:31:02.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.476+0000 7fa2daffd700 1 -- 172.21.15.59:0/724694203 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2e0004020 con 0x7fa2e409d6f0 2023-09-30T22:31:02.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.477+0000 7fa2daffd700 1 -- 172.21.15.59:0/724694203 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa2e003f8a0 con 0x7fa2e409d6f0 2023-09-30T22:31:02.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.481+0000 7fa2daffd700 1 -- 172.21.15.59:0/724694203 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2e001b3b0 con 0x7fa2e409d6f0 2023-09-30T22:31:02.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.520+0000 7ff605462700 1 Processor -- start 2023-09-30T22:31:02.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.520+0000 7ff605462700 1 -- start start 2023-09-30T22:31:02.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.521+0000 7ff605462700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60009d6f0 0x7ff60009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.521+0000 7ff605462700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60009e000 0x7ff6001339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.521+0000 7ff605462700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60009b120 con 0x7ff60009e410 2023-09-30T22:31:02.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.521+0000 7ff605462700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60006b460 con 0x7ff60009d6f0 2023-09-30T22:31:02.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.521+0000 7ff605462700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff60009a7e0 con 0x7ff60009e000 2023-09-30T22:31:02.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.521+0000 7ff5fe7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60009e000 0x7ff6001339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.521+0000 7ff5feffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60009d6f0 0x7ff60009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.521+0000 7ff5fe7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60009e000 0x7ff6001339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41182/0 (socket says 172.21.15.59:41182) 2023-09-30T22:31:02.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.521+0000 7ff5fe7fc700 1 -- 172.21.15.59:0/2988271449 learned_addr learned my addr 172.21.15.59:0/2988271449 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:02.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.521+0000 7ff5ff7fe700 1 --1- 172.21.15.59:0/2988271449 >> v1:172.21.15.59:6789/0 conn(0x7ff60009e410 0x7ff600133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55466/0 (socket says 172.21.15.59:55466) 2023-09-30T22:31:02.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.522+0000 7ff5fdffb700 1 -- 172.21.15.59:0/2988271449 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274633840 0 0) 0x7ff60009b120 con 0x7ff60009e410 2023-09-30T22:31:02.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.522+0000 7ff5fe7fc700 1 -- 172.21.15.59:0/2988271449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60009d6f0 msgr2=0x7ff60009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:02.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.522+0000 7ff5fe7fc700 1 --2- 172.21.15.59:0/2988271449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60009d6f0 0x7ff60009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.522+0000 7ff5fe7fc700 1 -- 172.21.15.59:0/2988271449 >> v1:172.21.15.59:6789/0 conn(0x7ff60009e410 legacy=0x7ff600133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.522+0000 7ff5fe7fc700 1 -- 172.21.15.59:0/2988271449 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60009a500 con 0x7ff60009e000 2023-09-30T22:31:02.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.522+0000 7ff5feffd700 1 --2- 172.21.15.59:0/2988271449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60009d6f0 0x7ff60009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:02.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.522+0000 7ff5fe7fc700 1 --2- 172.21.15.59:0/2988271449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60009e000 0x7ff6001339f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009950 tx=0x7ff5f4009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76a8ff2cc76f8bf8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:02.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.522+0000 7ff5fdffb700 1 -- 172.21.15.59:0/2988271449 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4011830 con 0x7ff60009e000 2023-09-30T22:31:02.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.522+0000 7ff5fdffb700 1 -- 172.21.15.59:0/2988271449 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f4011990 con 0x7ff60009e000 2023-09-30T22:31:02.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.522+0000 7ff5fdffb700 1 -- 172.21.15.59:0/2988271449 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4011d40 con 0x7ff60009e000 2023-09-30T22:31:02.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.523+0000 7ff605462700 1 -- 172.21.15.59:0/2988271449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60009e000 msgr2=0x7ff6001339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.523+0000 7ff605462700 1 --2- 172.21.15.59:0/2988271449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60009e000 0x7ff6001339f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009950 tx=0x7ff5f4009c60 comp rx=0 tx=0).stop 2023-09-30T22:31:02.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.523+0000 7ff605462700 1 -- 172.21.15.59:0/2988271449 shutdown_connections 2023-09-30T22:31:02.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.523+0000 7ff605462700 1 --2- 172.21.15.59:0/2988271449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60009d6f0 0x7ff60009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.523+0000 7ff605462700 1 --2- 172.21.15.59:0/2988271449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60009e000 0x7ff6001339f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.523+0000 7ff605462700 1 -- 172.21.15.59:0/2988271449 >> 172.21.15.59:0/2988271449 conn(0x7ff600066f50 msgr2=0x7ff60009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:02.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.523+0000 7ff605462700 1 -- 172.21.15.59:0/2988271449 shutdown_connections 2023-09-30T22:31:02.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.523+0000 7ff605462700 1 -- 172.21.15.59:0/2988271449 wait complete. 2023-09-30T22:31:02.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.524+0000 7ff605462700 1 Processor -- start 2023-09-30T22:31:02.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.524+0000 7ff605462700 1 -- start start 2023-09-30T22:31:02.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.525+0000 7ff605462700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff60009d6f0 0x7ff6001a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.525+0000 7ff605462700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60009e000 0x7ff6001a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.525+0000 7ff605462700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60009e410 0x7ff6001c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.525+0000 7ff605462700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6001a4f70 con 0x7ff60009d6f0 2023-09-30T22:31:02.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.525+0000 7ff605462700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6001b93f0 con 0x7ff60009e000 2023-09-30T22:31:02.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.525+0000 7ff605462700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff60009c710 con 0x7ff60009e410 2023-09-30T22:31:02.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.525+0000 7ff5fe7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60009e000 0x7ff6001a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.525+0000 7ff5fe7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60009e000 0x7ff6001a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40602/0 (socket says 172.21.15.59:40602) 2023-09-30T22:31:02.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.525+0000 7ff5fe7fc700 1 -- 172.21.15.59:0/2535412944 learned_addr learned my addr 172.21.15.59:0/2535412944 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:02.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.525+0000 7ff5feffd700 1 --2- 172.21.15.59:0/2535412944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff60009d6f0 0x7ff6001a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.525+0000 7ff5ff7fe700 1 --2- 172.21.15.59:0/2535412944 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60009e410 0x7ff6001c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.526+0000 7ff5fe7fc700 1 -- 172.21.15.59:0/2535412944 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60009e410 msgr2=0x7ff6001c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.526+0000 7ff5fe7fc700 1 --2- 172.21.15.59:0/2535412944 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60009e410 0x7ff6001c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.526+0000 7ff5fe7fc700 1 -- 172.21.15.59:0/2535412944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff60009d6f0 msgr2=0x7ff6001a5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.526+0000 7ff5fe7fc700 1 --2- 172.21.15.59:0/2535412944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff60009d6f0 0x7ff6001a5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.526+0000 7ff5fe7fc700 1 -- 172.21.15.59:0/2535412944 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f00094a0 con 0x7ff60009e000 2023-09-30T22:31:02.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.526+0000 7ff5fe7fc700 1 --2- 172.21.15.59:0/2535412944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60009e000 0x7ff6001a5870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009130 tx=0x7ff5f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:02.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.526+0000 7ff5e77fe700 1 -- 172.21.15.59:0/2535412944 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f401a840 con 0x7ff60009e000 2023-09-30T22:31:02.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.526+0000 7ff5e77fe700 1 -- 172.21.15.59:0/2535412944 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f401f070 con 0x7ff60009e000 2023-09-30T22:31:02.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.526+0000 7ff605462700 1 -- 172.21.15.59:0/2535412944 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f4009550 con 0x7ff60009e000 2023-09-30T22:31:02.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.526+0000 7ff5e77fe700 1 -- 172.21.15.59:0/2535412944 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f401abc0 con 0x7ff60009e000 2023-09-30T22:31:02.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.526+0000 7ff605462700 1 -- 172.21.15.59:0/2535412944 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6001a6670 con 0x7ff60009e000 2023-09-30T22:31:02.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.528+0000 7ff5e77fe700 1 -- 172.21.15.59:0/2535412944 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5f401ad20 con 0x7ff60009e000 2023-09-30T22:31:02.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.528+0000 7ff605462700 1 -- 172.21.15.59:0/2535412944 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff600074ea0 con 0x7ff60009e000 2023-09-30T22:31:02.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.528+0000 7ff5e77fe700 1 -- 172.21.15.59:0/2535412944 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff5f4021070 con 0x7ff60009e000 2023-09-30T22:31:02.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.533+0000 7ff5e77fe700 1 -- 172.21.15.59:0/2535412944 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5f40253e0 con 0x7ff60009e000 2023-09-30T22:31:02.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.667+0000 7f8788687700 1 -- 172.21.15.59:0/4265102698 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f878009b240 con 0x7f8780131650 2023-09-30T22:31:02.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.667+0000 7f8776ffd700 1 -- 172.21.15.59:0/4265102698 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f877c019b40 con 0x7f8780131650 2023-09-30T22:31:02.668 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.671+0000 7f8788687700 1 -- 172.21.15.59:0/4265102698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8780131650 msgr2=0x7f8780118c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.671+0000 7f8788687700 1 --2- 172.21.15.59:0/4265102698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8780131650 0x7f8780118c60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f877c00c700 tx=0x7f877c00ca10 comp rx=0 tx=0).stop 2023-09-30T22:31:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.671+0000 7f8788687700 1 -- 172.21.15.59:0/4265102698 shutdown_connections 2023-09-30T22:31:02.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.671+0000 7f8788687700 1 --2- 172.21.15.59:0/4265102698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8780131650 0x7f8780118c60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.671+0000 7f8788687700 1 --2- 172.21.15.59:0/4265102698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8780136e70 0x7f87801196e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.671+0000 7f8788687700 1 --2- 172.21.15.59:0/4265102698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8780134550 0x7f87801191a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.671+0000 7f8788687700 1 -- 172.21.15.59:0/4265102698 >> 172.21.15.59:0/4265102698 conn(0x7f87800a2610 msgr2=0x7f878006e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:02.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.671+0000 7f8788687700 1 -- 172.21.15.59:0/4265102698 shutdown_connections 2023-09-30T22:31:02.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.671+0000 7f8788687700 1 -- 172.21.15.59:0/4265102698 wait complete. 2023-09-30T22:31:02.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.702+0000 7fa2ec434700 1 -- 172.21.15.59:0/724694203 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa2e41a9420 con 0x7fa2e409d6f0 2023-09-30T22:31:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.702+0000 7fa2daffd700 1 -- 172.21.15.59:0/724694203 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2e41a9420 con 0x7fa2e409d6f0 2023-09-30T22:31:02.703 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.705+0000 7fa2ec434700 1 -- 172.21.15.59:0/724694203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2e409d6f0 msgr2=0x7fa2e41a5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.705+0000 7fa2ec434700 1 --2- 172.21.15.59:0/724694203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2e409d6f0 0x7fa2e41a5fd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000e9b0 tx=0x7fa2e000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.705+0000 7fa2ec434700 1 -- 172.21.15.59:0/724694203 shutdown_connections 2023-09-30T22:31:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.705+0000 7fa2ec434700 1 --2- 172.21.15.59:0/724694203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e409e410 0x7fa2e41a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.705+0000 7fa2ec434700 1 --2- 172.21.15.59:0/724694203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2e409d6f0 0x7fa2e41a5fd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.705+0000 7fa2ec434700 1 --2- 172.21.15.59:0/724694203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2e409e000 0x7fa2e41a6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.705+0000 7fa2ec434700 1 -- 172.21.15.59:0/724694203 >> 172.21.15.59:0/724694203 conn(0x7fa2e4066f50 msgr2=0x7fa2e41baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.705+0000 7fa2ec434700 1 -- 172.21.15.59:0/724694203 shutdown_connections 2023-09-30T22:31:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.705+0000 7fa2ec434700 1 -- 172.21.15.59:0/724694203 wait complete. 2023-09-30T22:31:02.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:02.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.770+0000 7ff605462700 1 -- 172.21.15.59:0/2535412944 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff600072600 con 0x7ff60009e000 2023-09-30T22:31:02.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.770+0000 7ff5e77fe700 1 -- 172.21.15.59:0/2535412944 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5f4015020 con 0x7ff60009e000 2023-09-30T22:31:02.771 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:02.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.773+0000 7ff605462700 1 -- 172.21.15.59:0/2535412944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60009e000 msgr2=0x7ff6001a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.773+0000 7ff605462700 1 --2- 172.21.15.59:0/2535412944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60009e000 0x7ff6001a5870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009130 tx=0x7ff5f4004750 comp rx=0 tx=0).stop 2023-09-30T22:31:02.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.773+0000 7ff605462700 1 -- 172.21.15.59:0/2535412944 shutdown_connections 2023-09-30T22:31:02.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.773+0000 7ff605462700 1 --2- 172.21.15.59:0/2535412944 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60009e410 0x7ff6001c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.773+0000 7ff605462700 1 --2- 172.21.15.59:0/2535412944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff60009d6f0 0x7ff6001a5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.773+0000 7ff605462700 1 --2- 172.21.15.59:0/2535412944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60009e000 0x7ff6001a5870 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.773+0000 7ff605462700 1 -- 172.21.15.59:0/2535412944 >> 172.21.15.59:0/2535412944 conn(0x7ff600066f50 msgr2=0x7ff60006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:02.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.773+0000 7ff605462700 1 -- 172.21.15.59:0/2535412944 shutdown_connections 2023-09-30T22:31:02.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:02.773+0000 7ff605462700 1 -- 172.21.15.59:0/2535412944 wait complete. 2023-09-30T22:31:02.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:03.084 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.230+0000 7f77fa81d700 1 Processor -- start 2023-09-30T22:31:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.230+0000 7f77fa81d700 1 -- start start 2023-09-30T22:31:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.230+0000 7f77fa81d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77f4133a80 0x7f77f4133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.230+0000 7f77fa81d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f412ff20 0x7f77f4130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.230+0000 7f77fa81d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f4130870 0x7f77f413a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.230+0000 7f77fa81d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f406c570 con 0x7f77f4133a80 2023-09-30T22:31:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.230+0000 7f77fa81d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f406bc00 con 0x7f77f412ff20 2023-09-30T22:31:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.230+0000 7f77fa81d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40a0040 con 0x7f77f4130870 2023-09-30T22:31:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.230+0000 7f77f8dba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f4130870 0x7f77f413a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.230+0000 7f77f37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f412ff20 0x7f77f4130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.230+0000 7f77f3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77f4133a80 0x7f77f4133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.230+0000 7f77f37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f412ff20 0x7f77f4130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40612/0 (socket says 172.21.15.59:40612) 2023-09-30T22:31:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.230+0000 7f77f8dba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f4130870 0x7f77f413a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41196/0 (socket says 172.21.15.59:41196) 2023-09-30T22:31:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.230+0000 7f77f37fe700 1 -- 172.21.15.59:0/3447608031 learned_addr learned my addr 172.21.15.59:0/3447608031 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.230+0000 7f77f3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77f4133a80 0x7f77f4133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34406/0 (socket says 172.21.15.59:34406) 2023-09-30T22:31:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.231+0000 7f77f3fff700 1 -- 172.21.15.59:0/3447608031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f4130870 msgr2=0x7f77f413a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.231+0000 7f77f3fff700 1 --2- 172.21.15.59:0/3447608031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f4130870 0x7f77f413a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.231+0000 7f77f3fff700 1 -- 172.21.15.59:0/3447608031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f412ff20 msgr2=0x7f77f4130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.231+0000 7f77f3fff700 1 --2- 172.21.15.59:0/3447608031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f412ff20 0x7f77f4130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.231+0000 7f77f3fff700 1 -- 172.21.15.59:0/3447608031 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f4133860 con 0x7f77f4133a80 2023-09-30T22:31:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.231+0000 7f77f37fe700 1 --2- 172.21.15.59:0/3447608031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f412ff20 0x7f77f4130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.231+0000 7f77f3fff700 1 --2- 172.21.15.59:0/3447608031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f4133a80 0x7f77f4133e50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009840 tx=0x7f77e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e033c8cf4f3887 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.231+0000 7f77f2ffd700 1 -- 172.21.15.59:0/3447608031 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4011830 con 0x7f77f4133a80 2023-09-30T22:31:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.231+0000 7f77f2ffd700 1 -- 172.21.15.59:0/3447608031 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e4011990 con 0x7f77f4133a80 2023-09-30T22:31:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.231+0000 7f77f2ffd700 1 -- 172.21.15.59:0/3447608031 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4011d20 con 0x7f77f4133a80 2023-09-30T22:31:03.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.232+0000 7f77fa81d700 1 -- 172.21.15.59:0/3447608031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f4133a80 msgr2=0x7f77f4133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.232+0000 7f77fa81d700 1 --2- 172.21.15.59:0/3447608031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f4133a80 0x7f77f4133e50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009840 tx=0x7f77e4009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:03.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.232+0000 7f77fa81d700 1 -- 172.21.15.59:0/3447608031 shutdown_connections 2023-09-30T22:31:03.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.232+0000 7f77fa81d700 1 --2- 172.21.15.59:0/3447608031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f4130870 0x7f77f413a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.232+0000 7f77fa81d700 1 --2- 172.21.15.59:0/3447608031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f4133a80 0x7f77f4133e50 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.232+0000 7f77fa81d700 1 --2- 172.21.15.59:0/3447608031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f412ff20 0x7f77f4130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.232+0000 7f77fa81d700 1 -- 172.21.15.59:0/3447608031 >> 172.21.15.59:0/3447608031 conn(0x7f77f40a4210 msgr2=0x7f77f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:03.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.232+0000 7f77fa81d700 1 -- 172.21.15.59:0/3447608031 shutdown_connections 2023-09-30T22:31:03.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.232+0000 7f77fa81d700 1 -- 172.21.15.59:0/3447608031 wait complete. 2023-09-30T22:31:03.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.233+0000 7f77fa81d700 1 Processor -- start 2023-09-30T22:31:03.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.233+0000 7f77fa81d700 1 -- start start 2023-09-30T22:31:03.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.233+0000 7f77fa81d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f412ff20 0x7f77f409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.233+0000 7f77fa81d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f4130870 0x7f77f409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.233+0000 7f77fa81d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f4133a80 0x7f77f409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.233+0000 7f77fa81d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f411fcf0 con 0x7f77f4133a80 2023-09-30T22:31:03.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.233+0000 7f77fa81d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f411fed0 con 0x7f77f412ff20 2023-09-30T22:31:03.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.233+0000 7f77fa81d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77f4120320 con 0x7f77f4130870 2023-09-30T22:31:03.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.233+0000 7f77f8dba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f4133a80 0x7f77f409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.233+0000 7f77f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f412ff20 0x7f77f409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.233+0000 7f77f8dba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f4133a80 0x7f77f409cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34416/0 (socket says 172.21.15.59:34416) 2023-09-30T22:31:03.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.233+0000 7f77f37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f4130870 0x7f77f409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.233+0000 7f77f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f412ff20 0x7f77f409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40616/0 (socket says 172.21.15.59:40616) 2023-09-30T22:31:03.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.233+0000 7f77f8dba700 1 -- 172.21.15.59:0/1667954521 learned_addr learned my addr 172.21.15.59:0/1667954521 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:03.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.234+0000 7f77f8dba700 1 -- 172.21.15.59:0/1667954521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f4130870 msgr2=0x7f77f409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.234+0000 7f77f8dba700 1 --2- 172.21.15.59:0/1667954521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f4130870 0x7f77f409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.234+0000 7f77f8dba700 1 -- 172.21.15.59:0/1667954521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f412ff20 msgr2=0x7f77f409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.234+0000 7f77f8dba700 1 --2- 172.21.15.59:0/1667954521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f412ff20 0x7f77f409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.234+0000 7f77f8dba700 1 -- 172.21.15.59:0/1667954521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e8009550 con 0x7f77f4133a80 2023-09-30T22:31:03.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.234+0000 7f77f3fff700 1 --2- 172.21.15.59:0/1667954521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f412ff20 0x7f77f409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:03.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.234+0000 7f77f8dba700 1 --2- 172.21.15.59:0/1667954521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f4133a80 0x7f77f409cf00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00efc0 tx=0x7f77ec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.234+0000 7f77f0ff9700 1 -- 172.21.15.59:0/1667954521 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec009ea0 con 0x7f77f4133a80 2023-09-30T22:31:03.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.234+0000 7f77f0ff9700 1 -- 172.21.15.59:0/1667954521 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec00f040 con 0x7f77f4133a80 2023-09-30T22:31:03.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.234+0000 7f77fa81d700 1 -- 172.21.15.59:0/1667954521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e40094a0 con 0x7f77f4133a80 2023-09-30T22:31:03.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.234+0000 7f77f0ff9700 1 -- 172.21.15.59:0/1667954521 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00ced0 con 0x7f77f4133a80 2023-09-30T22:31:03.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.234+0000 7f77fa81d700 1 -- 172.21.15.59:0/1667954521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f411f4f0 con 0x7f77f4133a80 2023-09-30T22:31:03.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.235+0000 7f77f0ff9700 1 -- 172.21.15.59:0/1667954521 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77ec014480 con 0x7f77f4133a80 2023-09-30T22:31:03.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.235+0000 7f77f0ff9700 1 -- 172.21.15.59:0/1667954521 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f77ec040160 con 0x7f77f4133a80 2023-09-30T22:31:03.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.235+0000 7f77fa81d700 1 -- 172.21.15.59:0/1667954521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f4120110 con 0x7f77f4133a80 2023-09-30T22:31:03.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.240+0000 7f77f0ff9700 1 -- 172.21.15.59:0/1667954521 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77ec018030 con 0x7f77f4133a80 2023-09-30T22:31:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.446+0000 7f77fa81d700 1 -- 172.21.15.59:0/1667954521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f77f4074ea0 con 0x7f77f4133a80 2023-09-30T22:31:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.447+0000 7f77f0ff9700 1 -- 172.21.15.59:0/1667954521 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77ec007920 con 0x7f77f4133a80 2023-09-30T22:31:03.447 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.449+0000 7f77fa81d700 1 -- 172.21.15.59:0/1667954521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f4133a80 msgr2=0x7f77f409cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.449+0000 7f77fa81d700 1 --2- 172.21.15.59:0/1667954521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f4133a80 0x7f77f409cf00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00efc0 tx=0x7f77ec00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.449+0000 7f77fa81d700 1 -- 172.21.15.59:0/1667954521 shutdown_connections 2023-09-30T22:31:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.449+0000 7f77fa81d700 1 --2- 172.21.15.59:0/1667954521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f4133a80 0x7f77f409cf00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.449+0000 7f77fa81d700 1 --2- 172.21.15.59:0/1667954521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f412ff20 0x7f77f409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.449+0000 7f77fa81d700 1 --2- 172.21.15.59:0/1667954521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f4130870 0x7f77f409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.449+0000 7f77fa81d700 1 -- 172.21.15.59:0/1667954521 >> 172.21.15.59:0/1667954521 conn(0x7f77f40a4210 msgr2=0x7f77f409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.449+0000 7f77fa81d700 1 -- 172.21.15.59:0/1667954521 shutdown_connections 2023-09-30T22:31:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.449+0000 7f77fa81d700 1 -- 172.21.15.59:0/1667954521 wait complete. 2023-09-30T22:31:03.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:03.690 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:03.720 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:03.787 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:03.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.840+0000 7f4b37e3e700 1 Processor -- start 2023-09-30T22:31:03.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.840+0000 7f4b37e3e700 1 -- start start 2023-09-30T22:31:03.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.841+0000 7f4b37e3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b3006a770 0x7f4b3006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.841+0000 7f4b37e3e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4b30131d10 0x7f4b30139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.841+0000 7f4b37e3e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3009ece0 con 0x7f4b3006b080 2023-09-30T22:31:03.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.841+0000 7f4b37e3e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3009e760 con 0x7f4b30131d10 2023-09-30T22:31:03.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.841+0000 7f4b37e3e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3009e040 con 0x7f4b3006a770 2023-09-30T22:31:03.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.841+0000 7f4b35bda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b3006a770 0x7f4b3006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.841+0000 7f4b35bda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b3006a770 0x7f4b3006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40620/0 (socket says 172.21.15.59:40620) 2023-09-30T22:31:03.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.841+0000 7f4b35bda700 1 -- 172.21.15.59:0/3338224255 learned_addr learned my addr 172.21.15.59:0/3338224255 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:03.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.841+0000 7f4b363db700 1 --2- 172.21.15.59:0/3338224255 >> v2:172.21.15.59:3300/0 conn(0x7f4b30131d10 0x7f4b30139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.841+0000 7f4b35bda700 1 -- 172.21.15.59:0/3338224255 >> v2:172.21.15.59:3300/0 conn(0x7f4b30131d10 msgr2=0x7f4b30139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:03.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.841+0000 7f4b35bda700 1 --2- 172.21.15.59:0/3338224255 >> v2:172.21.15.59:3300/0 conn(0x7f4b30131d10 0x7f4b30139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.841+0000 7f4b35bda700 1 -- 172.21.15.59:0/3338224255 >> v1:172.21.15.59:6789/0 conn(0x7f4b3006b080 legacy=0x7f4b30131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.841+0000 7f4b34bd8700 1 -- 172.21.15.59:0/3338224255 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540776138 0 0) 0x7f4b3009ece0 con 0x7f4b3006b080 2023-09-30T22:31:03.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.841+0000 7f4b35bda700 1 -- 172.21.15.59:0/3338224255 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3009f630 con 0x7f4b3006a770 2023-09-30T22:31:03.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.841+0000 7f4b363db700 1 --2- 172.21.15.59:0/3338224255 >> v2:172.21.15.59:3300/0 conn(0x7f4b30131d10 0x7f4b30139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:03.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.842+0000 7f4b35bda700 1 --2- 172.21.15.59:0/3338224255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b3006a770 0x7f4b3006ab40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0098f0 tx=0x7f4b2c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65230d6d2c02587e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.842+0000 7f4b34bd8700 1 -- 172.21.15.59:0/3338224255 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c011830 con 0x7f4b3006a770 2023-09-30T22:31:03.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.842+0000 7f4b34bd8700 1 -- 172.21.15.59:0/3338224255 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c011990 con 0x7f4b3006a770 2023-09-30T22:31:03.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.842+0000 7f4b34bd8700 1 -- 172.21.15.59:0/3338224255 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c011d20 con 0x7f4b3006a770 2023-09-30T22:31:03.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.843+0000 7f4b37e3e700 1 -- 172.21.15.59:0/3338224255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b3006a770 msgr2=0x7f4b3006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.843+0000 7f4b37e3e700 1 --2- 172.21.15.59:0/3338224255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b3006a770 0x7f4b3006ab40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0098f0 tx=0x7f4b2c009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:03.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.843+0000 7f4b37e3e700 1 -- 172.21.15.59:0/3338224255 shutdown_connections 2023-09-30T22:31:03.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.843+0000 7f4b37e3e700 1 --2- 172.21.15.59:0/3338224255 >> v2:172.21.15.59:3300/0 conn(0x7f4b30131d10 0x7f4b30139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.843+0000 7f4b37e3e700 1 --2- 172.21.15.59:0/3338224255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b3006a770 0x7f4b3006ab40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.843+0000 7f4b37e3e700 1 -- 172.21.15.59:0/3338224255 >> 172.21.15.59:0/3338224255 conn(0x7f4b30066f50 msgr2=0x7f4b3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:03.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.843+0000 7f4b37e3e700 1 -- 172.21.15.59:0/3338224255 shutdown_connections 2023-09-30T22:31:03.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.843+0000 7f4b37e3e700 1 -- 172.21.15.59:0/3338224255 wait complete. 2023-09-30T22:31:03.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.844+0000 7f4b37e3e700 1 Processor -- start 2023-09-30T22:31:03.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.844+0000 7f4b37e3e700 1 -- start start 2023-09-30T22:31:03.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.844+0000 7f4b37e3e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b3006a770 0x7f4b3009abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.844+0000 7f4b37e3e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b3006b080 0x7f4b3009b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.844+0000 7f4b37e3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b30131d10 0x7f4b301c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.844+0000 7f4b37e3e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b301311d0 con 0x7f4b3006a770 2023-09-30T22:31:03.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.844+0000 7f4b37e3e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b30071e60 con 0x7f4b30131d10 2023-09-30T22:31:03.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.844+0000 7f4b37e3e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b30124ed0 con 0x7f4b3006b080 2023-09-30T22:31:03.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b35bda700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b3006a770 0x7f4b3009abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b353d9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b3006b080 0x7f4b3009b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b35bda700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b3006a770 0x7f4b3009abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34440/0 (socket says 172.21.15.59:34440) 2023-09-30T22:31:03.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b35bda700 1 -- 172.21.15.59:0/1580823860 learned_addr learned my addr 172.21.15.59:0/1580823860 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:03.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b363db700 1 --2- 172.21.15.59:0/1580823860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b30131d10 0x7f4b301c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b353d9700 1 -- 172.21.15.59:0/1580823860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b30131d10 msgr2=0x7f4b301c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b353d9700 1 --2- 172.21.15.59:0/1580823860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b30131d10 0x7f4b301c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b353d9700 1 -- 172.21.15.59:0/1580823860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b3006a770 msgr2=0x7f4b3009abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b353d9700 1 --2- 172.21.15.59:0/1580823860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b3006a770 0x7f4b3009abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b353d9700 1 -- 172.21.15.59:0/1580823860 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b28009a70 con 0x7f4b3006b080 2023-09-30T22:31:03.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b35bda700 1 --2- 172.21.15.59:0/1580823860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b3006a770 0x7f4b3009abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:03.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b353d9700 1 --2- 172.21.15.59:0/1580823860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b3006b080 0x7f4b3009b0f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000c430 tx=0x7f4b2000c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b267fc700 1 -- 172.21.15.59:0/1580823860 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b200054e0 con 0x7f4b3006b080 2023-09-30T22:31:03.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b267fc700 1 -- 172.21.15.59:0/1580823860 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b20003680 con 0x7f4b3006b080 2023-09-30T22:31:03.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b37e3e700 1 -- 172.21.15.59:0/1580823860 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c009550 con 0x7f4b3006b080 2023-09-30T22:31:03.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.845+0000 7f4b267fc700 1 -- 172.21.15.59:0/1580823860 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b20003a30 con 0x7f4b3006b080 2023-09-30T22:31:03.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.846+0000 7f4b37e3e700 1 -- 172.21.15.59:0/1580823860 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b30125c30 con 0x7f4b3006b080 2023-09-30T22:31:03.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.846+0000 7f4b267fc700 1 -- 172.21.15.59:0/1580823860 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b20003b90 con 0x7f4b3006b080 2023-09-30T22:31:03.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.847+0000 7f4b267fc700 1 -- 172.21.15.59:0/1580823860 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4b2003e8c0 con 0x7f4b3006b080 2023-09-30T22:31:03.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.847+0000 7f4b37e3e700 1 -- 172.21.15.59:0/1580823860 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b30131580 con 0x7f4b3006b080 2023-09-30T22:31:03.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.852+0000 7f4b267fc700 1 -- 172.21.15.59:0/1580823860 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b20017080 con 0x7f4b3006b080 2023-09-30T22:31:03.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.878+0000 7efe6e1e5700 1 Processor -- start 2023-09-30T22:31:03.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.879+0000 7efe6e1e5700 1 -- start start 2023-09-30T22:31:03.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.879+0000 7efe6e1e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6809d6f0 0x7efe6809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.879+0000 7efe6e1e5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe6809e410 0x7efe68134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.879+0000 7efe6e1e5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6809b120 con 0x7efe6809e000 2023-09-30T22:31:03.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.879+0000 7efe6e1e5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6806b460 con 0x7efe6809e410 2023-09-30T22:31:03.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.879+0000 7efe6e1e5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6809a7e0 con 0x7efe6809d6f0 2023-09-30T22:31:03.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.880+0000 7efe677fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6809d6f0 0x7efe6809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.880+0000 7efe677fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6809d6f0 0x7efe6809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40646/0 (socket says 172.21.15.59:40646) 2023-09-30T22:31:03.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.880+0000 7efe677fe700 1 -- 172.21.15.59:0/2835651374 learned_addr learned my addr 172.21.15.59:0/2835651374 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:03.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.880+0000 7efe67fff700 1 --2- 172.21.15.59:0/2835651374 >> v2:172.21.15.59:3300/0 conn(0x7efe6809e410 0x7efe68134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.880+0000 7efe677fe700 1 -- 172.21.15.59:0/2835651374 >> v2:172.21.15.59:3300/0 conn(0x7efe6809e410 msgr2=0x7efe68134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:03.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.880+0000 7efe677fe700 1 --2- 172.21.15.59:0/2835651374 >> v2:172.21.15.59:3300/0 conn(0x7efe6809e410 0x7efe68134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.880+0000 7efe677fe700 1 -- 172.21.15.59:0/2835651374 >> v1:172.21.15.59:6789/0 conn(0x7efe6809e000 legacy=0x7efe681339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.880+0000 7efe667fc700 1 -- 172.21.15.59:0/2835651374 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244311394 0 0) 0x7efe6809b120 con 0x7efe6809e000 2023-09-30T22:31:03.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.880+0000 7efe677fe700 1 -- 172.21.15.59:0/2835651374 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6809a500 con 0x7efe6809d6f0 2023-09-30T22:31:03.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.880+0000 7efe677fe700 1 --2- 172.21.15.59:0/2835651374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6809d6f0 0x7efe6809dac0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efe58009920 tx=0x7efe58009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aff30d003c0421f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.880+0000 7efe667fc700 1 -- 172.21.15.59:0/2835651374 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58011830 con 0x7efe6809d6f0 2023-09-30T22:31:03.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.880+0000 7efe667fc700 1 -- 172.21.15.59:0/2835651374 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58011990 con 0x7efe6809d6f0 2023-09-30T22:31:03.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.880+0000 7efe667fc700 1 -- 172.21.15.59:0/2835651374 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58011d20 con 0x7efe6809d6f0 2023-09-30T22:31:03.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.881+0000 7efe6e1e5700 1 -- 172.21.15.59:0/2835651374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6809d6f0 msgr2=0x7efe6809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.881+0000 7efe6e1e5700 1 --2- 172.21.15.59:0/2835651374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6809d6f0 0x7efe6809dac0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efe58009920 tx=0x7efe58009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:03.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.881+0000 7efe6e1e5700 1 -- 172.21.15.59:0/2835651374 shutdown_connections 2023-09-30T22:31:03.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.881+0000 7efe6e1e5700 1 --2- 172.21.15.59:0/2835651374 >> v2:172.21.15.59:3300/0 conn(0x7efe6809e410 0x7efe68134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.881+0000 7efe6e1e5700 1 --2- 172.21.15.59:0/2835651374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6809d6f0 0x7efe6809dac0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.881+0000 7efe6e1e5700 1 -- 172.21.15.59:0/2835651374 >> 172.21.15.59:0/2835651374 conn(0x7efe68066f50 msgr2=0x7efe6809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:03.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.881+0000 7efe6e1e5700 1 -- 172.21.15.59:0/2835651374 shutdown_connections 2023-09-30T22:31:03.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.881+0000 7efe6e1e5700 1 -- 172.21.15.59:0/2835651374 wait complete. 2023-09-30T22:31:03.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.883+0000 7efe6e1e5700 1 Processor -- start 2023-09-30T22:31:03.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.883+0000 7efe6e1e5700 1 -- start start 2023-09-30T22:31:03.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe6e1e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6809d6f0 0x7efe681a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe6e1e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe6809e000 0x7efe681a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe6e1e5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe6809e410 0x7efe681a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe6e1e5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe681aa220 con 0x7efe6809e000 2023-09-30T22:31:03.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe6e1e5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe681a7950 con 0x7efe6809d6f0 2023-09-30T22:31:03.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe6e1e5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe681a7f70 con 0x7efe6809e410 2023-09-30T22:31:03.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe66ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe6809e000 0x7efe681a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe66ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe6809e000 0x7efe681a6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34462/0 (socket says 172.21.15.59:34462) 2023-09-30T22:31:03.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe677fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6809d6f0 0x7efe681a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe66ffd700 1 -- 172.21.15.59:0/3806200295 learned_addr learned my addr 172.21.15.59:0/3806200295 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:03.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe67fff700 1 --2- 172.21.15.59:0/3806200295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe6809e410 0x7efe681a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe677fe700 1 -- 172.21.15.59:0/3806200295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe6809e410 msgr2=0x7efe681a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe677fe700 1 --2- 172.21.15.59:0/3806200295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe6809e410 0x7efe681a6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe677fe700 1 -- 172.21.15.59:0/3806200295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe6809e000 msgr2=0x7efe681a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe677fe700 1 --2- 172.21.15.59:0/3806200295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe6809e000 0x7efe681a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe677fe700 1 -- 172.21.15.59:0/3806200295 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe58009550 con 0x7efe6809d6f0 2023-09-30T22:31:03.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe66ffd700 1 --2- 172.21.15.59:0/3806200295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe6809e000 0x7efe681a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:03.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.884+0000 7efe677fe700 1 --2- 172.21.15.59:0/3806200295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6809d6f0 0x7efe681a5de0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efe6806e470 tx=0x7efe58004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.885+0000 7efe4ffff700 1 -- 172.21.15.59:0/3806200295 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58004450 con 0x7efe6809d6f0 2023-09-30T22:31:03.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.885+0000 7efe4ffff700 1 -- 172.21.15.59:0/3806200295 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe580036a0 con 0x7efe6809d6f0 2023-09-30T22:31:03.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.885+0000 7efe6e1e5700 1 -- 172.21.15.59:0/3806200295 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe681a8ba0 con 0x7efe6809d6f0 2023-09-30T22:31:03.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.885+0000 7efe4ffff700 1 -- 172.21.15.59:0/3806200295 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580045f0 con 0x7efe6809d6f0 2023-09-30T22:31:03.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.885+0000 7efe6e1e5700 1 -- 172.21.15.59:0/3806200295 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe680a3090 con 0x7efe6809d6f0 2023-09-30T22:31:03.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.886+0000 7efe4ffff700 1 -- 172.21.15.59:0/3806200295 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe58003a50 con 0x7efe6809d6f0 2023-09-30T22:31:03.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.886+0000 7efe4ffff700 1 -- 172.21.15.59:0/3806200295 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efe58021030 con 0x7efe6809d6f0 2023-09-30T22:31:03.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.886+0000 7efe6e1e5700 1 -- 172.21.15.59:0/3806200295 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6809c710 con 0x7efe6809d6f0 2023-09-30T22:31:03.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.895+0000 7efe4ffff700 1 -- 172.21.15.59:0/3806200295 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe58015020 con 0x7efe6809d6f0 2023-09-30T22:31:03.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.933+0000 7fe76090f700 1 Processor -- start 2023-09-30T22:31:03.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.933+0000 7fe76090f700 1 -- start start 2023-09-30T22:31:03.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.934+0000 7fe76090f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe75c0a0a30 0x7fe75c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.934+0000 7fe76090f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe75c09d630 0x7fe75c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.934+0000 7fe76090f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75c0a2a70 con 0x7fe75c133930 2023-09-30T22:31:03.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.934+0000 7fe76090f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75c0a01d0 con 0x7fe75c0a0a30 2023-09-30T22:31:03.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.934+0000 7fe76090f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c09e2b0 con 0x7fe75c09d630 2023-09-30T22:31:03.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.934+0000 7fe759d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe75c09d630 0x7fe75c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.934+0000 7fe759d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe75c09d630 0x7fe75c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41240/0 (socket says 172.21.15.59:41240) 2023-09-30T22:31:03.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.934+0000 7fe759d9b700 1 -- 172.21.15.59:0/3766672253 learned_addr learned my addr 172.21.15.59:0/3766672253 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:03.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.934+0000 7fe75a59c700 1 --2- 172.21.15.59:0/3766672253 >> v2:172.21.15.59:3300/0 conn(0x7fe75c0a0a30 0x7fe75c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.934+0000 7fe759d9b700 1 -- 172.21.15.59:0/3766672253 >> v2:172.21.15.59:3300/0 conn(0x7fe75c0a0a30 msgr2=0x7fe75c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.934+0000 7fe759d9b700 1 --2- 172.21.15.59:0/3766672253 >> v2:172.21.15.59:3300/0 conn(0x7fe75c0a0a30 0x7fe75c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.934+0000 7fe759d9b700 1 -- 172.21.15.59:0/3766672253 >> v1:172.21.15.59:6789/0 conn(0x7fe75c133930 legacy=0x7fe75c133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.934+0000 7fe759d9b700 1 -- 172.21.15.59:0/3766672253 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c09dc50 con 0x7fe75c09d630 2023-09-30T22:31:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.934+0000 7fe759d9b700 1 --2- 172.21.15.59:0/3766672253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe75c09d630 0x7fe75c0a1340 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe7500098f0 tx=0x7fe750009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a553446ee6190a36 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.935+0000 7fe75959a700 1 -- 172.21.15.59:0/3766672253 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe750011830 con 0x7fe75c09d630 2023-09-30T22:31:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.935+0000 7fe75959a700 1 -- 172.21.15.59:0/3766672253 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe750011990 con 0x7fe75c09d630 2023-09-30T22:31:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.935+0000 7fe75959a700 1 -- 172.21.15.59:0/3766672253 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe750011d20 con 0x7fe75c09d630 2023-09-30T22:31:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.935+0000 7fe76090f700 1 -- 172.21.15.59:0/3766672253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe75c09d630 msgr2=0x7fe75c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.935+0000 7fe76090f700 1 --2- 172.21.15.59:0/3766672253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe75c09d630 0x7fe75c0a1340 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe7500098f0 tx=0x7fe750009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.935+0000 7fe76090f700 1 -- 172.21.15.59:0/3766672253 shutdown_connections 2023-09-30T22:31:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.935+0000 7fe76090f700 1 --2- 172.21.15.59:0/3766672253 >> v2:172.21.15.59:3300/0 conn(0x7fe75c0a0a30 0x7fe75c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.935+0000 7fe76090f700 1 --2- 172.21.15.59:0/3766672253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe75c09d630 0x7fe75c0a1340 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.935+0000 7fe76090f700 1 -- 172.21.15.59:0/3766672253 >> 172.21.15.59:0/3766672253 conn(0x7fe75c0a3050 msgr2=0x7fe75c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.935+0000 7fe76090f700 1 -- 172.21.15.59:0/3766672253 shutdown_connections 2023-09-30T22:31:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.935+0000 7fe76090f700 1 -- 172.21.15.59:0/3766672253 wait complete. 2023-09-30T22:31:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.937+0000 7fe76090f700 1 Processor -- start 2023-09-30T22:31:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.937+0000 7fe76090f700 1 -- start start 2023-09-30T22:31:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.937+0000 7fe76090f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe75c09d630 0x7fe75c121200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.937+0000 7fe76090f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe75c0a0a30 0x7fe75c121740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.937+0000 7fe76090f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe75c133930 0x7fe75c121c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.937+0000 7fe76090f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c122dc0 con 0x7fe75c09d630 2023-09-30T22:31:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.937+0000 7fe76090f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c123c50 con 0x7fe75c133930 2023-09-30T22:31:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.937+0000 7fe76090f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c124730 con 0x7fe75c0a0a30 2023-09-30T22:31:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.937+0000 7fe75a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe75c09d630 0x7fe75c121200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.937+0000 7fe759d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe75c0a0a30 0x7fe75c121740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.937+0000 7fe75a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe75c09d630 0x7fe75c121200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34468/0 (socket says 172.21.15.59:34468) 2023-09-30T22:31:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.937+0000 7fe759d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe75c0a0a30 0x7fe75c121740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41248/0 (socket says 172.21.15.59:41248) 2023-09-30T22:31:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.937+0000 7fe75a59c700 1 -- 172.21.15.59:0/138170699 learned_addr learned my addr 172.21.15.59:0/138170699 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.937+0000 7fe75ad9d700 1 --2- 172.21.15.59:0/138170699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe75c133930 0x7fe75c121c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.938+0000 7fe759d9b700 1 -- 172.21.15.59:0/138170699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe75c133930 msgr2=0x7fe75c121c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.938+0000 7fe759d9b700 1 --2- 172.21.15.59:0/138170699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe75c133930 0x7fe75c121c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.938+0000 7fe759d9b700 1 -- 172.21.15.59:0/138170699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe75c09d630 msgr2=0x7fe75c121200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.938+0000 7fe759d9b700 1 --2- 172.21.15.59:0/138170699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe75c09d630 0x7fe75c121200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.938+0000 7fe759d9b700 1 -- 172.21.15.59:0/138170699 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe750009550 con 0x7fe75c0a0a30 2023-09-30T22:31:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.938+0000 7fe75a59c700 1 --2- 172.21.15.59:0/138170699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe75c09d630 0x7fe75c121200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.938+0000 7fe759d9b700 1 --2- 172.21.15.59:0/138170699 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe75c0a0a30 0x7fe75c121740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe750016000 tx=0x7fe750004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.938+0000 7fe74affd700 1 -- 172.21.15.59:0/138170699 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe750004480 con 0x7fe75c0a0a30 2023-09-30T22:31:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.938+0000 7fe74affd700 1 -- 172.21.15.59:0/138170699 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75001f070 con 0x7fe75c0a0a30 2023-09-30T22:31:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.938+0000 7fe76090f700 1 -- 172.21.15.59:0/138170699 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c1249f0 con 0x7fe75c0a0a30 2023-09-30T22:31:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.938+0000 7fe74affd700 1 -- 172.21.15.59:0/138170699 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500038e0 con 0x7fe75c0a0a30 2023-09-30T22:31:03.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.938+0000 7fe76090f700 1 -- 172.21.15.59:0/138170699 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c124460 con 0x7fe75c0a0a30 2023-09-30T22:31:03.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.939+0000 7fe76090f700 1 -- 172.21.15.59:0/138170699 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c124010 con 0x7fe75c0a0a30 2023-09-30T22:31:03.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.940+0000 7fe74affd700 1 -- 172.21.15.59:0/138170699 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe750021030 con 0x7fe75c0a0a30 2023-09-30T22:31:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.940+0000 7fe74affd700 1 -- 172.21.15.59:0/138170699 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe750040e60 con 0x7fe75c0a0a30 2023-09-30T22:31:03.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:03.949+0000 7fe74affd700 1 -- 172.21.15.59:0/138170699 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7500199a0 con 0x7fe75c0a0a30 2023-09-30T22:31:04.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.063+0000 7f4b37e3e700 1 -- 172.21.15.59:0/1580823860 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4b30074ea0 con 0x7f4b3006b080 2023-09-30T22:31:04.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.063+0000 7f4b267fc700 1 -- 172.21.15.59:0/1580823860 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b2001b3b0 con 0x7f4b3006b080 2023-09-30T22:31:04.064 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:04.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.066+0000 7f4b37e3e700 1 -- 172.21.15.59:0/1580823860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b3006b080 msgr2=0x7f4b3009b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.066+0000 7f4b37e3e700 1 --2- 172.21.15.59:0/1580823860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b3006b080 0x7f4b3009b0f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000c430 tx=0x7f4b2000c740 comp rx=0 tx=0).stop 2023-09-30T22:31:04.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.067+0000 7f4b37e3e700 1 -- 172.21.15.59:0/1580823860 shutdown_connections 2023-09-30T22:31:04.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.067+0000 7f4b37e3e700 1 --2- 172.21.15.59:0/1580823860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b30131d10 0x7f4b301c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.067+0000 7f4b37e3e700 1 --2- 172.21.15.59:0/1580823860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b3006a770 0x7f4b3009abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.067+0000 7f4b37e3e700 1 --2- 172.21.15.59:0/1580823860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b3006b080 0x7f4b3009b0f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.067+0000 7f4b37e3e700 1 -- 172.21.15.59:0/1580823860 >> 172.21.15.59:0/1580823860 conn(0x7f4b30066f50 msgr2=0x7f4b30070000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:04.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.067+0000 7f4b37e3e700 1 -- 172.21.15.59:0/1580823860 shutdown_connections 2023-09-30T22:31:04.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.067+0000 7f4b37e3e700 1 -- 172.21.15.59:0/1580823860 wait complete. 2023-09-30T22:31:04.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:04.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.110+0000 7efe6e1e5700 1 -- 172.21.15.59:0/3806200295 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efe68074ea0 con 0x7efe6809d6f0 2023-09-30T22:31:04.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.110+0000 7efe4ffff700 1 -- 172.21.15.59:0/3806200295 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe5801a430 con 0x7efe6809d6f0 2023-09-30T22:31:04.111 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.112+0000 7efe6e1e5700 1 -- 172.21.15.59:0/3806200295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6809d6f0 msgr2=0x7efe681a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.112+0000 7efe6e1e5700 1 --2- 172.21.15.59:0/3806200295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6809d6f0 0x7efe681a5de0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efe6806e470 tx=0x7efe58004750 comp rx=0 tx=0).stop 2023-09-30T22:31:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.112+0000 7efe6e1e5700 1 -- 172.21.15.59:0/3806200295 shutdown_connections 2023-09-30T22:31:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.112+0000 7efe6e1e5700 1 --2- 172.21.15.59:0/3806200295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe6809e410 0x7efe681a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.112+0000 7efe6e1e5700 1 --2- 172.21.15.59:0/3806200295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6809d6f0 0x7efe681a5de0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.112+0000 7efe6e1e5700 1 --2- 172.21.15.59:0/3806200295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe6809e000 0x7efe681a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.112+0000 7efe6e1e5700 1 -- 172.21.15.59:0/3806200295 >> 172.21.15.59:0/3806200295 conn(0x7efe68066f50 msgr2=0x7efe681badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.113+0000 7efe6e1e5700 1 -- 172.21.15.59:0/3806200295 shutdown_connections 2023-09-30T22:31:04.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.113+0000 7efe6e1e5700 1 -- 172.21.15.59:0/3806200295 wait complete. 2023-09-30T22:31:04.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:04.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.156+0000 7fe76090f700 1 -- 172.21.15.59:0/138170699 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe75c11df60 con 0x7fe75c0a0a30 2023-09-30T22:31:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.157+0000 7fe74affd700 1 -- 172.21.15.59:0/138170699 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe75001b430 con 0x7fe75c0a0a30 2023-09-30T22:31:04.157 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:04.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.159+0000 7fe76090f700 1 -- 172.21.15.59:0/138170699 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe75c0a0a30 msgr2=0x7fe75c121740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.159+0000 7fe76090f700 1 --2- 172.21.15.59:0/138170699 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe75c0a0a30 0x7fe75c121740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe750016000 tx=0x7fe750004750 comp rx=0 tx=0).stop 2023-09-30T22:31:04.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.159+0000 7fe76090f700 1 -- 172.21.15.59:0/138170699 shutdown_connections 2023-09-30T22:31:04.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.159+0000 7fe76090f700 1 --2- 172.21.15.59:0/138170699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe75c133930 0x7fe75c121c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.159+0000 7fe76090f700 1 --2- 172.21.15.59:0/138170699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe75c09d630 0x7fe75c121200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.159+0000 7fe76090f700 1 --2- 172.21.15.59:0/138170699 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe75c0a0a30 0x7fe75c121740 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.159+0000 7fe76090f700 1 -- 172.21.15.59:0/138170699 >> 172.21.15.59:0/138170699 conn(0x7fe75c0a3050 msgr2=0x7fe75c1331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:04.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.159+0000 7fe76090f700 1 -- 172.21.15.59:0/138170699 shutdown_connections 2023-09-30T22:31:04.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.159+0000 7fe76090f700 1 -- 172.21.15.59:0/138170699 wait complete. 2023-09-30T22:31:04.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:04.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.610+0000 7f326b09c700 1 Processor -- start 2023-09-30T22:31:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.610+0000 7f326b09c700 1 -- start start 2023-09-30T22:31:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.611+0000 7f326b09c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f326409d6f0 0x7f326409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.611+0000 7f326b09c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f326409e000 0x7f3264130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.611+0000 7f326b09c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326409f130 con 0x7f326409e410 2023-09-30T22:31:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.611+0000 7f326b09c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326409f520 con 0x7f326409e000 2023-09-30T22:31:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.611+0000 7f326b09c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f326409e930 con 0x7f326409d6f0 2023-09-30T22:31:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.611+0000 7f3268e38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f326409d6f0 0x7f326409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.611+0000 7f3263fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f326409e000 0x7f3264130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.611+0000 7f3268e38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f326409d6f0 0x7f326409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:34982/0 (socket says 172.21.15.59:34982) 2023-09-30T22:31:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.611+0000 7f3268e38700 1 -- 172.21.15.59:0/1150248493 learned_addr learned my addr 172.21.15.59:0/1150248493 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.612+0000 7f3263fff700 1 -- 172.21.15.59:0/1150248493 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f326409d6f0 msgr2=0x7f326409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.612+0000 7f3263fff700 1 --2- 172.21.15.59:0/1150248493 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f326409d6f0 0x7f326409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.612+0000 7f3263fff700 1 -- 172.21.15.59:0/1150248493 >> v1:172.21.15.59:6789/0 conn(0x7f326409e410 legacy=0x7f3264130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.612+0000 7f32637fe700 1 -- 172.21.15.59:0/1150248493 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340027367 0 0) 0x7f326409f130 con 0x7f326409e410 2023-09-30T22:31:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.612+0000 7f3263fff700 1 -- 172.21.15.59:0/1150248493 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326409b2d0 con 0x7f326409e000 2023-09-30T22:31:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.612+0000 7f3268e38700 1 --2- 172.21.15.59:0/1150248493 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f326409d6f0 0x7f326409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.612+0000 7f3263fff700 1 --2- 172.21.15.59:0/1150248493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326409e000 0x7f3264130660 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f324c009840 tx=0x7f324c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ff0cbc2d3e97e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.612+0000 7f32637fe700 1 -- 172.21.15.59:0/1150248493 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c011830 con 0x7f326409e000 2023-09-30T22:31:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.612+0000 7f32637fe700 1 -- 172.21.15.59:0/1150248493 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c011990 con 0x7f326409e000 2023-09-30T22:31:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.612+0000 7f32637fe700 1 -- 172.21.15.59:0/1150248493 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c011d20 con 0x7f326409e000 2023-09-30T22:31:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.613+0000 7f326b09c700 1 -- 172.21.15.59:0/1150248493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326409e000 msgr2=0x7f3264130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.613+0000 7f326b09c700 1 --2- 172.21.15.59:0/1150248493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326409e000 0x7f3264130660 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f324c009840 tx=0x7f324c009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.613+0000 7f326b09c700 1 -- 172.21.15.59:0/1150248493 shutdown_connections 2023-09-30T22:31:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.613+0000 7f326b09c700 1 --2- 172.21.15.59:0/1150248493 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f326409d6f0 0x7f326409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.613+0000 7f326b09c700 1 --2- 172.21.15.59:0/1150248493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326409e000 0x7f3264130660 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.613+0000 7f326b09c700 1 -- 172.21.15.59:0/1150248493 >> 172.21.15.59:0/1150248493 conn(0x7f3264066f50 msgr2=0x7f326409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.613+0000 7f326b09c700 1 -- 172.21.15.59:0/1150248493 shutdown_connections 2023-09-30T22:31:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.613+0000 7f326b09c700 1 -- 172.21.15.59:0/1150248493 wait complete. 2023-09-30T22:31:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.614+0000 7f326b09c700 1 Processor -- start 2023-09-30T22:31:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.614+0000 7f326b09c700 1 -- start start 2023-09-30T22:31:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.614+0000 7f326b09c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326409d6f0 0x7f326411de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.614+0000 7f326b09c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f326409e000 0x7f326411e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.614+0000 7f326b09c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f326409e410 0x7f326411e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.614+0000 7f326b09c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326411f280 con 0x7f326409d6f0 2023-09-30T22:31:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.614+0000 7f326b09c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3264120010 con 0x7f326409e000 2023-09-30T22:31:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.614+0000 7f326b09c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32641210d0 con 0x7f326409e410 2023-09-30T22:31:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.614+0000 7f3263fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f326409e000 0x7f326411e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.614+0000 7f3268e38700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326409d6f0 0x7f326411de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f3263fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f326409e000 0x7f326411e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47784/0 (socket says 172.21.15.59:47784) 2023-09-30T22:31:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f3263fff700 1 -- 172.21.15.59:0/3079555695 learned_addr learned my addr 172.21.15.59:0/3079555695 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f3268e38700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326409d6f0 0x7f326411de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36374/0 (socket says 172.21.15.59:36374) 2023-09-30T22:31:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f3269639700 1 --2- 172.21.15.59:0/3079555695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f326409e410 0x7f326411e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f3269639700 1 -- 172.21.15.59:0/3079555695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f326409e000 msgr2=0x7f326411e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f3269639700 1 --2- 172.21.15.59:0/3079555695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f326409e000 0x7f326411e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f3269639700 1 -- 172.21.15.59:0/3079555695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326409d6f0 msgr2=0x7f326411de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f3269639700 1 --2- 172.21.15.59:0/3079555695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326409d6f0 0x7f326411de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f3269639700 1 -- 172.21.15.59:0/3079555695 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325400b7f0 con 0x7f326409e410 2023-09-30T22:31:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f3263fff700 1 --2- 172.21.15.59:0/3079555695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f326409e000 0x7f326411e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f3268e38700 1 --2- 172.21.15.59:0/3079555695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326409d6f0 0x7f326411de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f3269639700 1 --2- 172.21.15.59:0/3079555695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f326409e410 0x7f326411e8a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f325c00c7c0 tx=0x7f325c00cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f32617fa700 1 -- 172.21.15.59:0/3079555695 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c003e30 con 0x7f326409e410 2023-09-30T22:31:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f32617fa700 1 -- 172.21.15.59:0/3079555695 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c005070 con 0x7f326409e410 2023-09-30T22:31:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f326b09c700 1 -- 172.21.15.59:0/3079555695 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324c0094a0 con 0x7f326409e410 2023-09-30T22:31:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f32617fa700 1 -- 172.21.15.59:0/3079555695 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c005420 con 0x7f326409e410 2023-09-30T22:31:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.615+0000 7f326b09c700 1 -- 172.21.15.59:0/3079555695 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32640720b0 con 0x7f326409e410 2023-09-30T22:31:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.616+0000 7f32617fa700 1 -- 172.21.15.59:0/3079555695 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f325c005580 con 0x7f326409e410 2023-09-30T22:31:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.616+0000 7f32617fa700 1 -- 172.21.15.59:0/3079555695 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f325c03ec30 con 0x7f326409e410 2023-09-30T22:31:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.616+0000 7f326b09c700 1 -- 172.21.15.59:0/3079555695 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326411ac20 con 0x7f326409e410 2023-09-30T22:31:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.621+0000 7f32617fa700 1 -- 172.21.15.59:0/3079555695 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f325c019b40 con 0x7f326409e410 2023-09-30T22:31:04.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.824+0000 7f326b09c700 1 -- 172.21.15.59:0/3079555695 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3264074ea0 con 0x7f326409e410 2023-09-30T22:31:04.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.824+0000 7f32617fa700 1 -- 172.21.15.59:0/3079555695 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f325c017030 con 0x7f326409e410 2023-09-30T22:31:04.825 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:04.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.826+0000 7f326b09c700 1 -- 172.21.15.59:0/3079555695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f326409e410 msgr2=0x7f326411e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.826+0000 7f326b09c700 1 --2- 172.21.15.59:0/3079555695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f326409e410 0x7f326411e8a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f325c00c7c0 tx=0x7f325c00cad0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.827+0000 7f326b09c700 1 -- 172.21.15.59:0/3079555695 shutdown_connections 2023-09-30T22:31:04.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.827+0000 7f326b09c700 1 --2- 172.21.15.59:0/3079555695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f326409e410 0x7f326411e8a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.827+0000 7f326b09c700 1 --2- 172.21.15.59:0/3079555695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326409d6f0 0x7f326411de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.827+0000 7f326b09c700 1 --2- 172.21.15.59:0/3079555695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f326409e000 0x7f326411e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.827+0000 7f326b09c700 1 -- 172.21.15.59:0/3079555695 >> 172.21.15.59:0/3079555695 conn(0x7f3264066f50 msgr2=0x7f3264130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:04.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.827+0000 7f326b09c700 1 -- 172.21.15.59:0/3079555695 shutdown_connections 2023-09-30T22:31:04.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:04.827+0000 7f326b09c700 1 -- 172.21.15.59:0/3079555695 wait complete. 2023-09-30T22:31:04.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:05.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:05.129 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:05.174 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.240+0000 7fcaf6062700 1 Processor -- start 2023-09-30T22:31:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.240+0000 7fcaf6062700 1 -- start start 2023-09-30T22:31:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.240+0000 7fcaf6062700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf0133960 0x7fcaf0133d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.240+0000 7fcaf6062700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaf009e990 0x7fcaf013b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.240+0000 7fcaf6062700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf0133550 con 0x7fcaf009de50 2023-09-30T22:31:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.240+0000 7fcaf6062700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf006fab0 con 0x7fcaf0133960 2023-09-30T22:31:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.240+0000 7fcaf6062700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf0071e20 con 0x7fcaf009e990 2023-09-30T22:31:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.241+0000 7fcaeeffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcaf009de50 0x7fcaf009e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57936/0 (socket says 172.21.15.59:57936) 2023-09-30T22:31:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.241+0000 7fcaeeffd700 1 -- 172.21.15.59:0/158635114 learned_addr learned my addr 172.21.15.59:0/158635114 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.241+0000 7fcaeffff700 1 --2- 172.21.15.59:0/158635114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaf009e990 0x7fcaf013b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.241+0000 7fcaef7fe700 1 --2- 172.21.15.59:0/158635114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf0133960 0x7fcaf0133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.241+0000 7fcaee7fc700 1 -- 172.21.15.59:0/158635114 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120358806 0 0) 0x7fcaf0133550 con 0x7fcaf009de50 2023-09-30T22:31:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.241+0000 7fcaef7fe700 1 -- 172.21.15.59:0/158635114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaf009e990 msgr2=0x7fcaf013b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.241+0000 7fcaef7fe700 1 --2- 172.21.15.59:0/158635114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaf009e990 0x7fcaf013b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.241+0000 7fcaef7fe700 1 -- 172.21.15.59:0/158635114 >> v1:172.21.15.59:6789/0 conn(0x7fcaf009de50 legacy=0x7fcaf009e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.241+0000 7fcaef7fe700 1 -- 172.21.15.59:0/158635114 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf006f1e0 con 0x7fcaf0133960 2023-09-30T22:31:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.241+0000 7fcaef7fe700 1 --2- 172.21.15.59:0/158635114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf0133960 0x7fcaf0133d30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcae0009870 tx=0x7fcae0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee21b7009667ee0b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.241+0000 7fcaee7fc700 1 -- 172.21.15.59:0/158635114 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0011830 con 0x7fcaf0133960 2023-09-30T22:31:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.241+0000 7fcaee7fc700 1 -- 172.21.15.59:0/158635114 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae0011990 con 0x7fcaf0133960 2023-09-30T22:31:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.241+0000 7fcaee7fc700 1 -- 172.21.15.59:0/158635114 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0011d20 con 0x7fcaf0133960 2023-09-30T22:31:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.242+0000 7fcaf6062700 1 -- 172.21.15.59:0/158635114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf0133960 msgr2=0x7fcaf0133d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.242+0000 7fcaf6062700 1 --2- 172.21.15.59:0/158635114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf0133960 0x7fcaf0133d30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcae0009870 tx=0x7fcae0009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.242+0000 7fcaf6062700 1 -- 172.21.15.59:0/158635114 shutdown_connections 2023-09-30T22:31:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.242+0000 7fcaf6062700 1 --2- 172.21.15.59:0/158635114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaf009e990 0x7fcaf013b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.242+0000 7fcaf6062700 1 --2- 172.21.15.59:0/158635114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf0133960 0x7fcaf0133d30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.242+0000 7fcaf6062700 1 -- 172.21.15.59:0/158635114 >> 172.21.15.59:0/158635114 conn(0x7fcaf00a2610 msgr2=0x7fcaf00a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.242+0000 7fcaf6062700 1 -- 172.21.15.59:0/158635114 shutdown_connections 2023-09-30T22:31:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.242+0000 7fcaf6062700 1 -- 172.21.15.59:0/158635114 wait complete. 2023-09-30T22:31:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.243+0000 7fcaf6062700 1 Processor -- start 2023-09-30T22:31:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.244+0000 7fcaf6062700 1 -- start start 2023-09-30T22:31:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.244+0000 7fcaf6062700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaf009de50 0x7fcaf011c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.244+0000 7fcaf6062700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf009e990 0x7fcaf011cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.244+0000 7fcaf6062700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf0133960 0x7fcaf011d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.244+0000 7fcaf6062700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf011e7d0 con 0x7fcaf0133960 2023-09-30T22:31:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.244+0000 7fcaf6062700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf011fb20 con 0x7fcaf009e990 2023-09-30T22:31:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.244+0000 7fcaf6062700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf011e330 con 0x7fcaf009de50 2023-09-30T22:31:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.244+0000 7fcaeeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf009e990 0x7fcaf011cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.244+0000 7fcaeeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf009e990 0x7fcaf011cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47796/0 (socket says 172.21.15.59:47796) 2023-09-30T22:31:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.244+0000 7fcaeeffd700 1 -- 172.21.15.59:0/2956677091 learned_addr learned my addr 172.21.15.59:0/2956677091 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.244+0000 7fcaef7fe700 1 --2- 172.21.15.59:0/2956677091 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaf009de50 0x7fcaf011c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.244+0000 7fcaeffff700 1 --2- 172.21.15.59:0/2956677091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf0133960 0x7fcaf011d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.245+0000 7fcaeeffd700 1 -- 172.21.15.59:0/2956677091 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaf009de50 msgr2=0x7fcaf011c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.245+0000 7fcaeeffd700 1 --2- 172.21.15.59:0/2956677091 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaf009de50 0x7fcaf011c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.245+0000 7fcaeeffd700 1 -- 172.21.15.59:0/2956677091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf0133960 msgr2=0x7fcaf011d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.245+0000 7fcaeeffd700 1 --2- 172.21.15.59:0/2956677091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf0133960 0x7fcaf011d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.245+0000 7fcaeeffd700 1 -- 172.21.15.59:0/2956677091 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae00094a0 con 0x7fcaf009e990 2023-09-30T22:31:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.245+0000 7fcaeeffd700 1 --2- 172.21.15.59:0/2956677091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf009e990 0x7fcaf011cae0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcae400c480 tx=0x7fcae400c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.245+0000 7fcad7fff700 1 -- 172.21.15.59:0/2956677091 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4004c80 con 0x7fcaf009e990 2023-09-30T22:31:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.245+0000 7fcad7fff700 1 -- 172.21.15.59:0/2956677091 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae4004e00 con 0x7fcaf009e990 2023-09-30T22:31:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.245+0000 7fcaf6062700 1 -- 172.21.15.59:0/2956677091 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf006f420 con 0x7fcaf009e990 2023-09-30T22:31:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.245+0000 7fcad7fff700 1 -- 172.21.15.59:0/2956677091 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4007310 con 0x7fcaf009e990 2023-09-30T22:31:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.245+0000 7fcaf6062700 1 -- 172.21.15.59:0/2956677091 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf011fde0 con 0x7fcaf009e990 2023-09-30T22:31:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.246+0000 7fcaf6062700 1 -- 172.21.15.59:0/2956677091 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf011ffd0 con 0x7fcaf009e990 2023-09-30T22:31:05.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.247+0000 7fcad7fff700 1 -- 172.21.15.59:0/2956677091 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcae4007470 con 0x7fcaf009e990 2023-09-30T22:31:05.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.247+0000 7fcad7fff700 1 -- 172.21.15.59:0/2956677091 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcae403f210 con 0x7fcaf009e990 2023-09-30T22:31:05.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.252+0000 7fcad7fff700 1 -- 172.21.15.59:0/2956677091 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcae40102c0 con 0x7fcaf009e990 2023-09-30T22:31:05.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.292+0000 7fb66f824700 1 Processor -- start 2023-09-30T22:31:05.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.292+0000 7fb66f824700 1 -- start start 2023-09-30T22:31:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.293+0000 7fb66f824700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb668133510 0x7fb6681358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.293+0000 7fb66f824700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb668135e30 0x7fb668138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.293+0000 7fb66f824700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb668130260 con 0x7fb668130670 2023-09-30T22:31:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.293+0000 7fb66f824700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66809a350 con 0x7fb668133510 2023-09-30T22:31:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.293+0000 7fb66f824700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb668071ff0 con 0x7fb668135e30 2023-09-30T22:31:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.293+0000 7fb66cdbf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb668133510 0x7fb6681358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.293+0000 7fb66cdbf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb668133510 0x7fb6681358f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36392/0 (socket says 172.21.15.59:36392) 2023-09-30T22:31:05.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.293+0000 7fb66cdbf700 1 -- 172.21.15.59:0/1081670944 learned_addr learned my addr 172.21.15.59:0/1081670944 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:05.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.293+0000 7fb66ddc1700 1 --2- 172.21.15.59:0/1081670944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb668135e30 0x7fb668138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.293+0000 7fb66cdbf700 1 -- 172.21.15.59:0/1081670944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb668135e30 msgr2=0x7fb668138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:05.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.293+0000 7fb66cdbf700 1 --2- 172.21.15.59:0/1081670944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb668135e30 0x7fb668138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.293+0000 7fb66cdbf700 1 -- 172.21.15.59:0/1081670944 >> v1:172.21.15.59:6789/0 conn(0x7fb668130670 legacy=0x7fb668130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.294+0000 7fb65ffff700 1 -- 172.21.15.59:0/1081670944 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600435848 0 0) 0x7fb668130260 con 0x7fb668130670 2023-09-30T22:31:05.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.294+0000 7fb66cdbf700 1 -- 172.21.15.59:0/1081670944 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66809ecf0 con 0x7fb668133510 2023-09-30T22:31:05.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.294+0000 7fb66ddc1700 1 --2- 172.21.15.59:0/1081670944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb668135e30 0x7fb668138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:05.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.294+0000 7fb66cdbf700 1 --2- 172.21.15.59:0/1081670944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb668133510 0x7fb6681358f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb6580098f0 tx=0x7fb658009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6f3a7d0116479f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:05.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.294+0000 7fb65ffff700 1 -- 172.21.15.59:0/1081670944 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658011830 con 0x7fb668133510 2023-09-30T22:31:05.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.294+0000 7fb65ffff700 1 -- 172.21.15.59:0/1081670944 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb658011990 con 0x7fb668133510 2023-09-30T22:31:05.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.294+0000 7fb65ffff700 1 -- 172.21.15.59:0/1081670944 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658011d20 con 0x7fb668133510 2023-09-30T22:31:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.295+0000 7fb66f824700 1 -- 172.21.15.59:0/1081670944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb668133510 msgr2=0x7fb6681358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.295+0000 7fb66f824700 1 --2- 172.21.15.59:0/1081670944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb668133510 0x7fb6681358f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb6580098f0 tx=0x7fb658009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.295+0000 7fb66f824700 1 -- 172.21.15.59:0/1081670944 shutdown_connections 2023-09-30T22:31:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.295+0000 7fb66f824700 1 --2- 172.21.15.59:0/1081670944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb668135e30 0x7fb668138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.295+0000 7fb66f824700 1 --2- 172.21.15.59:0/1081670944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb668133510 0x7fb6681358f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.295+0000 7fb66f824700 1 -- 172.21.15.59:0/1081670944 >> 172.21.15.59:0/1081670944 conn(0x7fb6680a2aa0 msgr2=0x7fb6680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.295+0000 7fb66f824700 1 -- 172.21.15.59:0/1081670944 shutdown_connections 2023-09-30T22:31:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.295+0000 7fb66f824700 1 -- 172.21.15.59:0/1081670944 wait complete. 2023-09-30T22:31:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.296+0000 7fb66f824700 1 Processor -- start 2023-09-30T22:31:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.297+0000 7fb66f824700 1 -- start start 2023-09-30T22:31:05.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.297+0000 7fb66f824700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb668130670 0x7fb668139760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.297+0000 7fb66f824700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb668133510 0x7fb668139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.297+0000 7fb66f824700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb668135e30 0x7fb66813a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.297+0000 7fb66f824700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66809a680 con 0x7fb668130670 2023-09-30T22:31:05.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.297+0000 7fb66f824700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66813acf0 con 0x7fb668135e30 2023-09-30T22:31:05.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.297+0000 7fb66f824700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb668138240 con 0x7fb668133510 2023-09-30T22:31:05.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.297+0000 7fb66ddc1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb668135e30 0x7fb66813a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.297+0000 7fb66d5c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb668130670 0x7fb668139760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.297+0000 7fb66cdbf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb668133510 0x7fb668139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.298+0000 7fb66ddc1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb668135e30 0x7fb66813a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47810/0 (socket says 172.21.15.59:47810) 2023-09-30T22:31:05.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.298+0000 7fb66ddc1700 1 -- 172.21.15.59:0/1227611686 learned_addr learned my addr 172.21.15.59:0/1227611686 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:05.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.298+0000 7fb66d5c0700 1 -- 172.21.15.59:0/1227611686 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb668133510 msgr2=0x7fb668139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.298+0000 7fb66d5c0700 1 --2- 172.21.15.59:0/1227611686 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb668133510 0x7fb668139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.298+0000 7fb66d5c0700 1 -- 172.21.15.59:0/1227611686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb668135e30 msgr2=0x7fb66813a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.298+0000 7fb66d5c0700 1 --2- 172.21.15.59:0/1227611686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb668135e30 0x7fb66813a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.298+0000 7fb66d5c0700 1 -- 172.21.15.59:0/1227611686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb660009a70 con 0x7fb668130670 2023-09-30T22:31:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.298+0000 7fb66ddc1700 1 --2- 172.21.15.59:0/1227611686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb668135e30 0x7fb66813a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.298+0000 7fb66d5c0700 1 --2- 172.21.15.59:0/1227611686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb668130670 0x7fb668139760 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb66400c430 tx=0x7fb66400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.298+0000 7fb65dffb700 1 -- 172.21.15.59:0/1227611686 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640054e0 con 0x7fb668130670 2023-09-30T22:31:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.298+0000 7fb65dffb700 1 -- 172.21.15.59:0/1227611686 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66400ce40 con 0x7fb668130670 2023-09-30T22:31:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.298+0000 7fb66f824700 1 -- 172.21.15.59:0/1227611686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb658009550 con 0x7fb668130670 2023-09-30T22:31:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.298+0000 7fb65dffb700 1 -- 172.21.15.59:0/1227611686 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640038c0 con 0x7fb668130670 2023-09-30T22:31:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.299+0000 7fb66f824700 1 -- 172.21.15.59:0/1227611686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb668071820 con 0x7fb668130670 2023-09-30T22:31:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.299+0000 7fb65dffb700 1 -- 172.21.15.59:0/1227611686 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb664003a20 con 0x7fb668130670 2023-09-30T22:31:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.300+0000 7fb65dffb700 1 -- 172.21.15.59:0/1227611686 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb66403ea10 con 0x7fb668130670 2023-09-30T22:31:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.300+0000 7fb66f824700 1 -- 172.21.15.59:0/1227611686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb668074ea0 con 0x7fb668130670 2023-09-30T22:31:05.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.305+0000 7fb65dffb700 1 -- 172.21.15.59:0/1227611686 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb664017080 con 0x7fb668130670 2023-09-30T22:31:05.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.316+0000 7f79af2c5700 1 Processor -- start 2023-09-30T22:31:05.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.316+0000 7f79af2c5700 1 -- start start 2023-09-30T22:31:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.317+0000 7f79af2c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79a80a0a30 0x7f79a80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.317+0000 7f79af2c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79a8134170 0x7f79a813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.317+0000 7f79af2c5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a809edd0 con 0x7f79a80a1340 2023-09-30T22:31:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.317+0000 7f79af2c5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a809e1f0 con 0x7f79a8134170 2023-09-30T22:31:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.317+0000 7f79af2c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a809dc50 con 0x7f79a80a0a30 2023-09-30T22:31:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.317+0000 7f79ad061700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79a80a0a30 0x7f79a80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.317+0000 7f79ad862700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79a8134170 0x7f79a813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.317+0000 7f79ad061700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79a80a0a30 0x7f79a80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47822/0 (socket says 172.21.15.59:47822) 2023-09-30T22:31:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.317+0000 7f79ac860700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f79a80a1340 0x7f79a8133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57960/0 (socket says 172.21.15.59:57960) 2023-09-30T22:31:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.317+0000 7f79ad061700 1 -- 172.21.15.59:0/1411437343 learned_addr learned my addr 172.21.15.59:0/1411437343 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.317+0000 7f79ad862700 1 --2- 172.21.15.59:0/1411437343 >> v2:172.21.15.59:3300/0 conn(0x7f79a8134170 0x7f79a813bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36406/0 (socket says 172.21.15.59:36406) 2023-09-30T22:31:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.318+0000 7f79ad862700 1 -- 172.21.15.59:0/1411437343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79a80a0a30 msgr2=0x7f79a80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.318+0000 7f79ad862700 1 --2- 172.21.15.59:0/1411437343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79a80a0a30 0x7f79a80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.318+0000 7f79ad862700 1 -- 172.21.15.59:0/1411437343 >> v1:172.21.15.59:6789/0 conn(0x7f79a80a1340 legacy=0x7f79a8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.318+0000 7f79ad862700 1 -- 172.21.15.59:0/1411437343 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80a1fe0 con 0x7f79a8134170 2023-09-30T22:31:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.318+0000 7f79ad061700 1 --2- 172.21.15.59:0/1411437343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79a80a0a30 0x7f79a80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.318+0000 7f79ad862700 1 --2- 172.21.15.59:0/1411437343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a8134170 0x7f79a813bd30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009d90 tx=0x7f79a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479e3ef8adf8ad64 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:05.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.318+0000 7f799ffff700 1 -- 172.21.15.59:0/1411437343 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a000e070 con 0x7f79a8134170 2023-09-30T22:31:05.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.318+0000 7f799ffff700 1 -- 172.21.15.59:0/1411437343 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a000bb20 con 0x7f79a8134170 2023-09-30T22:31:05.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.318+0000 7f799ffff700 1 -- 172.21.15.59:0/1411437343 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0012430 con 0x7f79a8134170 2023-09-30T22:31:05.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.319+0000 7f79af2c5700 1 -- 172.21.15.59:0/1411437343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a8134170 msgr2=0x7f79a813bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.319+0000 7f79af2c5700 1 --2- 172.21.15.59:0/1411437343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a8134170 0x7f79a813bd30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009d90 tx=0x7f79a000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:05.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.319+0000 7f79af2c5700 1 -- 172.21.15.59:0/1411437343 shutdown_connections 2023-09-30T22:31:05.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.319+0000 7f79af2c5700 1 --2- 172.21.15.59:0/1411437343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a8134170 0x7f79a813bd30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.319+0000 7f79af2c5700 1 --2- 172.21.15.59:0/1411437343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79a80a0a30 0x7f79a80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.319+0000 7f79af2c5700 1 -- 172.21.15.59:0/1411437343 >> 172.21.15.59:0/1411437343 conn(0x7f79a80a6550 msgr2=0x7f79a80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.319+0000 7f79af2c5700 1 -- 172.21.15.59:0/1411437343 shutdown_connections 2023-09-30T22:31:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.319+0000 7f79af2c5700 1 -- 172.21.15.59:0/1411437343 wait complete. 2023-09-30T22:31:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.320+0000 7f79af2c5700 1 Processor -- start 2023-09-30T22:31:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.320+0000 7f79af2c5700 1 -- start start 2023-09-30T22:31:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.320+0000 7f79af2c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79a80a0a30 0x7f79a8122a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.320+0000 7f79af2c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a80a1340 0x7f79a8122f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.320+0000 7f79af2c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79a8134170 0x7f79a8123480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.320+0000 7f79af2c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a8124e10 con 0x7f79a80a1340 2023-09-30T22:31:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.320+0000 7f79af2c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80a4e80 con 0x7f79a8134170 2023-09-30T22:31:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.320+0000 7f79af2c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80a0220 con 0x7f79a80a0a30 2023-09-30T22:31:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f79ad061700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79a80a0a30 0x7f79a8122a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f79ad862700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79a8134170 0x7f79a8123480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f79ad862700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79a8134170 0x7f79a8123480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47828/0 (socket says 172.21.15.59:47828) 2023-09-30T22:31:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f79ad061700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79a80a0a30 0x7f79a8122a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35038/0 (socket says 172.21.15.59:35038) 2023-09-30T22:31:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f79ad862700 1 -- 172.21.15.59:0/1631149995 learned_addr learned my addr 172.21.15.59:0/1631149995 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f79ac860700 1 --2- 172.21.15.59:0/1631149995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a80a1340 0x7f79a8122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f79ad862700 1 -- 172.21.15.59:0/1631149995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79a80a0a30 msgr2=0x7f79a8122a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f79ad862700 1 --2- 172.21.15.59:0/1631149995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79a80a0a30 0x7f79a8122a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f79ad862700 1 -- 172.21.15.59:0/1631149995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a80a1340 msgr2=0x7f79a8122f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f79ad862700 1 --2- 172.21.15.59:0/1631149995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a80a1340 0x7f79a8122f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f79ad862700 1 -- 172.21.15.59:0/1631149995 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a4009550 con 0x7f79a8134170 2023-09-30T22:31:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f79ac860700 1 --2- 172.21.15.59:0/1631149995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a80a1340 0x7f79a8122f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:05.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f79ad862700 1 --2- 172.21.15.59:0/1631149995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79a8134170 0x7f79a8123480 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f79a0014040 tx=0x7f79a0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:05.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f799dffb700 1 -- 172.21.15.59:0/1631149995 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0012430 con 0x7f79a8134170 2023-09-30T22:31:05.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f799dffb700 1 -- 172.21.15.59:0/1631149995 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a0020070 con 0x7f79a8134170 2023-09-30T22:31:05.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f79af2c5700 1 -- 172.21.15.59:0/1631149995 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a0009a70 con 0x7f79a8134170 2023-09-30T22:31:05.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.321+0000 7f799dffb700 1 -- 172.21.15.59:0/1631149995 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0003ea0 con 0x7f79a8134170 2023-09-30T22:31:05.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.322+0000 7f79af2c5700 1 -- 172.21.15.59:0/1631149995 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a8124ab0 con 0x7f79a8134170 2023-09-30T22:31:05.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.323+0000 7f79af2c5700 1 -- 172.21.15.59:0/1631149995 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a8125fd0 con 0x7f79a8134170 2023-09-30T22:31:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.323+0000 7f799dffb700 1 -- 172.21.15.59:0/1631149995 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79a0004040 con 0x7f79a8134170 2023-09-30T22:31:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.324+0000 7f799dffb700 1 -- 172.21.15.59:0/1631149995 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f79a0022070 con 0x7f79a8134170 2023-09-30T22:31:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.328+0000 7f799dffb700 1 -- 172.21.15.59:0/1631149995 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79a8125fd0 con 0x7f79a8134170 2023-09-30T22:31:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.496+0000 7fcaf6062700 1 -- 172.21.15.59:0/2956677091 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcaf00747f0 con 0x7fcaf009e990 2023-09-30T22:31:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.496+0000 7fcad7fff700 1 -- 172.21.15.59:0/2956677091 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcae4007720 con 0x7fcaf009e990 2023-09-30T22:31:05.498 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.498+0000 7fcaf6062700 1 -- 172.21.15.59:0/2956677091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf009e990 msgr2=0x7fcaf011cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.498+0000 7fcaf6062700 1 --2- 172.21.15.59:0/2956677091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf009e990 0x7fcaf011cae0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcae400c480 tx=0x7fcae400c790 comp rx=0 tx=0).stop 2023-09-30T22:31:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.498+0000 7fcaf6062700 1 -- 172.21.15.59:0/2956677091 shutdown_connections 2023-09-30T22:31:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.498+0000 7fcaf6062700 1 --2- 172.21.15.59:0/2956677091 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaf009de50 0x7fcaf011c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.498+0000 7fcaf6062700 1 --2- 172.21.15.59:0/2956677091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf0133960 0x7fcaf011d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.498+0000 7fcaf6062700 1 --2- 172.21.15.59:0/2956677091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf009e990 0x7fcaf011cae0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.499+0000 7fcaf6062700 1 -- 172.21.15.59:0/2956677091 >> 172.21.15.59:0/2956677091 conn(0x7fcaf00a2610 msgr2=0x7fcaf01bae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:05.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.499+0000 7fcaf6062700 1 -- 172.21.15.59:0/2956677091 shutdown_connections 2023-09-30T22:31:05.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.499+0000 7fcaf6062700 1 -- 172.21.15.59:0/2956677091 wait complete. 2023-09-30T22:31:05.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:05.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.532+0000 7fb66f824700 1 -- 172.21.15.59:0/1227611686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb668072210 con 0x7fb668130670 2023-09-30T22:31:05.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.533+0000 7fb65dffb700 1 -- 172.21.15.59:0/1227611686 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb664019b20 con 0x7fb668130670 2023-09-30T22:31:05.534 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:05.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.535+0000 7fb66f824700 1 -- 172.21.15.59:0/1227611686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb668130670 msgr2=0x7fb668139760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.535+0000 7fb66f824700 1 --2- 172.21.15.59:0/1227611686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb668130670 0x7fb668139760 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb66400c430 tx=0x7fb66400c740 comp rx=0 tx=0).stop 2023-09-30T22:31:05.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.535+0000 7fb66f824700 1 -- 172.21.15.59:0/1227611686 shutdown_connections 2023-09-30T22:31:05.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.535+0000 7fb66f824700 1 --2- 172.21.15.59:0/1227611686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb668135e30 0x7fb66813a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.535+0000 7fb66f824700 1 --2- 172.21.15.59:0/1227611686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb668130670 0x7fb668139760 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.535+0000 7fb66f824700 1 --2- 172.21.15.59:0/1227611686 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb668133510 0x7fb668139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.535+0000 7fb66f824700 1 -- 172.21.15.59:0/1227611686 >> 172.21.15.59:0/1227611686 conn(0x7fb6680a2aa0 msgr2=0x7fb66812e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.535+0000 7fb66f824700 1 -- 172.21.15.59:0/1227611686 shutdown_connections 2023-09-30T22:31:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.535+0000 7fb66f824700 1 -- 172.21.15.59:0/1227611686 wait complete. 2023-09-30T22:31:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.538+0000 7f79af2c5700 1 -- 172.21.15.59:0/1631149995 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f79a8125fd0 con 0x7f79a8134170 2023-09-30T22:31:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.538+0000 7f799dffb700 1 -- 172.21.15.59:0/1631149995 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79a8125fd0 con 0x7f79a8134170 2023-09-30T22:31:05.540 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.541+0000 7f79af2c5700 1 -- 172.21.15.59:0/1631149995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79a8134170 msgr2=0x7f79a8123480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.541+0000 7f79af2c5700 1 --2- 172.21.15.59:0/1631149995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79a8134170 0x7f79a8123480 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f79a0014040 tx=0x7f79a0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.541+0000 7f79af2c5700 1 -- 172.21.15.59:0/1631149995 shutdown_connections 2023-09-30T22:31:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.541+0000 7f79af2c5700 1 --2- 172.21.15.59:0/1631149995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79a80a0a30 0x7f79a8122a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.541+0000 7f79af2c5700 1 --2- 172.21.15.59:0/1631149995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79a8134170 0x7f79a8123480 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.541+0000 7f79af2c5700 1 --2- 172.21.15.59:0/1631149995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79a80a1340 0x7f79a8122f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.541+0000 7f79af2c5700 1 -- 172.21.15.59:0/1631149995 >> 172.21.15.59:0/1631149995 conn(0x7f79a80a6550 msgr2=0x7f79a809ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.541+0000 7f79af2c5700 1 -- 172.21.15.59:0/1631149995 shutdown_connections 2023-09-30T22:31:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.541+0000 7f79af2c5700 1 -- 172.21.15.59:0/1631149995 wait complete. 2023-09-30T22:31:05.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:05.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:05.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.985+0000 7fd611af5700 1 Processor -- start 2023-09-30T22:31:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.985+0000 7fd611af5700 1 -- start start 2023-09-30T22:31:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.986+0000 7fd611af5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd60c09e930 0x7fd60c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.986+0000 7fd611af5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd60c09f650 0x7fd60c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.986+0000 7fd611af5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c070940 con 0x7fd60c09f240 2023-09-30T22:31:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.986+0000 7fd611af5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c06fd60 con 0x7fd60c09e930 2023-09-30T22:31:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.986+0000 7fd611af5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c06fa80 con 0x7fd60c09f650 2023-09-30T22:31:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.986+0000 7fd60b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd60c09e930 0x7fd60c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.986+0000 7fd60bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd60c09f650 0x7fd60c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.986+0000 7fd60b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd60c09e930 0x7fd60c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36414/0 (socket says 172.21.15.59:36414) 2023-09-30T22:31:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.986+0000 7fd60bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd60c09f650 0x7fd60c131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35040/0 (socket says 172.21.15.59:35040) 2023-09-30T22:31:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.986+0000 7fd60b7fe700 1 -- 172.21.15.59:0/1847306379 learned_addr learned my addr 172.21.15.59:0/1847306379 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.986+0000 7fd60b7fe700 1 -- 172.21.15.59:0/1847306379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd60c09f650 msgr2=0x7fd60c131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.986+0000 7fd60b7fe700 1 --2- 172.21.15.59:0/1847306379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd60c09f650 0x7fd60c131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.986+0000 7fd60b7fe700 1 -- 172.21.15.59:0/1847306379 >> v1:172.21.15.59:6789/0 conn(0x7fd60c09f240 legacy=0x7fd60c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.986+0000 7fd60b7fe700 1 -- 172.21.15.59:0/1847306379 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c09fb60 con 0x7fd60c09e930 2023-09-30T22:31:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.986+0000 7fd60bfff700 1 --2- 172.21.15.59:0/1847306379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd60c09f650 0x7fd60c131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.987+0000 7fd60b7fe700 1 --2- 172.21.15.59:0/1847306379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c09e930 0x7fd60c09ed00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0098f0 tx=0x7fd5fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb9aca5cf0694d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.987+0000 7fd60a7fc700 1 -- 172.21.15.59:0/1847306379 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc011830 con 0x7fd60c09e930 2023-09-30T22:31:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.987+0000 7fd60a7fc700 1 -- 172.21.15.59:0/1847306379 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc011990 con 0x7fd60c09e930 2023-09-30T22:31:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.987+0000 7fd60a7fc700 1 -- 172.21.15.59:0/1847306379 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc011d20 con 0x7fd60c09e930 2023-09-30T22:31:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.987+0000 7fd611af5700 1 -- 172.21.15.59:0/1847306379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c09e930 msgr2=0x7fd60c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.987+0000 7fd611af5700 1 --2- 172.21.15.59:0/1847306379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c09e930 0x7fd60c09ed00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0098f0 tx=0x7fd5fc009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.987+0000 7fd611af5700 1 -- 172.21.15.59:0/1847306379 shutdown_connections 2023-09-30T22:31:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.987+0000 7fd611af5700 1 --2- 172.21.15.59:0/1847306379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd60c09f650 0x7fd60c131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.987+0000 7fd611af5700 1 --2- 172.21.15.59:0/1847306379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c09e930 0x7fd60c09ed00 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.987+0000 7fd611af5700 1 -- 172.21.15.59:0/1847306379 >> 172.21.15.59:0/1847306379 conn(0x7fd60c0a4210 msgr2=0x7fd60c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.988+0000 7fd611af5700 1 -- 172.21.15.59:0/1847306379 shutdown_connections 2023-09-30T22:31:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.988+0000 7fd611af5700 1 -- 172.21.15.59:0/1847306379 wait complete. 2023-09-30T22:31:05.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.988+0000 7fd611af5700 1 Processor -- start 2023-09-30T22:31:05.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.989+0000 7fd611af5700 1 -- start start 2023-09-30T22:31:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.989+0000 7fd611af5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd60c09e930 0x7fd60c1a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.989+0000 7fd611af5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c09f240 0x7fd60c1a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.989+0000 7fd611af5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd60c09f650 0x7fd60c1a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.989+0000 7fd611af5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c1b7190 con 0x7fd60c09f240 2023-09-30T22:31:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.989+0000 7fd611af5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c1a52a0 con 0x7fd60c09f650 2023-09-30T22:31:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.989+0000 7fd611af5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c1a6c00 con 0x7fd60c09e930 2023-09-30T22:31:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.989+0000 7fd60affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c09f240 0x7fd60c1a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.989+0000 7fd60bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd60c09f650 0x7fd60c1a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.989+0000 7fd60affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c09f240 0x7fd60c1a4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36420/0 (socket says 172.21.15.59:36420) 2023-09-30T22:31:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.989+0000 7fd60affd700 1 -- 172.21.15.59:0/924318190 learned_addr learned my addr 172.21.15.59:0/924318190 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.989+0000 7fd60b7fe700 1 --2- 172.21.15.59:0/924318190 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd60c09e930 0x7fd60c1a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.990+0000 7fd60bfff700 1 -- 172.21.15.59:0/924318190 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd60c09e930 msgr2=0x7fd60c1a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.990+0000 7fd60bfff700 1 --2- 172.21.15.59:0/924318190 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd60c09e930 0x7fd60c1a3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.990+0000 7fd60bfff700 1 -- 172.21.15.59:0/924318190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c09f240 msgr2=0x7fd60c1a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.990+0000 7fd60bfff700 1 --2- 172.21.15.59:0/924318190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c09f240 0x7fd60c1a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.990+0000 7fd60bfff700 1 -- 172.21.15.59:0/924318190 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd604009a70 con 0x7fd60c09f650 2023-09-30T22:31:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.990+0000 7fd60affd700 1 --2- 172.21.15.59:0/924318190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c09f240 0x7fd60c1a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.990+0000 7fd60bfff700 1 --2- 172.21.15.59:0/924318190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd60c09f650 0x7fd60c1a48c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd604009e50 tx=0x7fd60400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.990+0000 7fd603fff700 1 -- 172.21.15.59:0/924318190 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60400ca90 con 0x7fd60c09f650 2023-09-30T22:31:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.990+0000 7fd603fff700 1 -- 172.21.15.59:0/924318190 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60400f040 con 0x7fd60c09f650 2023-09-30T22:31:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.990+0000 7fd603fff700 1 -- 172.21.15.59:0/924318190 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60400ce50 con 0x7fd60c09f650 2023-09-30T22:31:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.990+0000 7fd611af5700 1 -- 172.21.15.59:0/924318190 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5fc009550 con 0x7fd60c09f650 2023-09-30T22:31:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.990+0000 7fd611af5700 1 -- 172.21.15.59:0/924318190 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c0a0190 con 0x7fd60c09f650 2023-09-30T22:31:05.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.991+0000 7fd603fff700 1 -- 172.21.15.59:0/924318190 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd604014480 con 0x7fd60c09f650 2023-09-30T22:31:05.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.991+0000 7fd603fff700 1 -- 172.21.15.59:0/924318190 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd60403fc80 con 0x7fd60c09f650 2023-09-30T22:31:05.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.991+0000 7fd611af5700 1 -- 172.21.15.59:0/924318190 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60c1a70b0 con 0x7fd60c09f650 2023-09-30T22:31:05.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:05.996+0000 7fd603fff700 1 -- 172.21.15.59:0/924318190 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd60c1a70b0 con 0x7fd60c09f650 2023-09-30T22:31:06.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.199+0000 7fd611af5700 1 -- 172.21.15.59:0/924318190 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd60c1a70b0 con 0x7fd60c09f650 2023-09-30T22:31:06.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.199+0000 7fd603fff700 1 -- 172.21.15.59:0/924318190 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd60c1a70b0 con 0x7fd60c09f650 2023-09-30T22:31:06.201 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:06.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.202+0000 7fd611af5700 1 -- 172.21.15.59:0/924318190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd60c09f650 msgr2=0x7fd60c1a48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.202+0000 7fd611af5700 1 --2- 172.21.15.59:0/924318190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd60c09f650 0x7fd60c1a48c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd604009e50 tx=0x7fd60400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.202+0000 7fd611af5700 1 -- 172.21.15.59:0/924318190 shutdown_connections 2023-09-30T22:31:06.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.202+0000 7fd611af5700 1 --2- 172.21.15.59:0/924318190 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd60c09e930 0x7fd60c1a3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.202+0000 7fd611af5700 1 --2- 172.21.15.59:0/924318190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd60c09f650 0x7fd60c1a48c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.202+0000 7fd611af5700 1 --2- 172.21.15.59:0/924318190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c09f240 0x7fd60c1a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.202+0000 7fd611af5700 1 -- 172.21.15.59:0/924318190 >> 172.21.15.59:0/924318190 conn(0x7fd60c0a4210 msgr2=0x7fd60c1b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:06.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.202+0000 7fd611af5700 1 -- 172.21.15.59:0/924318190 shutdown_connections 2023-09-30T22:31:06.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.202+0000 7fd611af5700 1 -- 172.21.15.59:0/924318190 wait complete. 2023-09-30T22:31:06.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:06.515 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:06.552 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:06.557 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:06.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.666+0000 7f2c73916700 1 Processor -- start 2023-09-30T22:31:06.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.666+0000 7f2c73916700 1 -- start start 2023-09-30T22:31:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.667+0000 7f2c73916700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c6c136710 0x7f2c6c138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.667+0000 7f2c73916700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c139030 0x7f2c6c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.667+0000 7f2c73916700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c06ef30 con 0x7f2c6c1338a0 2023-09-30T22:31:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.667+0000 7f2c73916700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6c06fef0 con 0x7f2c6c136710 2023-09-30T22:31:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.667+0000 7f2c73916700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c1334b0 con 0x7f2c6c139030 2023-09-30T22:31:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.667+0000 7f2c70eb1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c6c136710 0x7f2c6c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.667+0000 7f2c70eb1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c6c136710 0x7f2c6c138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36434/0 (socket says 172.21.15.59:36434) 2023-09-30T22:31:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.667+0000 7f2c70eb1700 1 -- 172.21.15.59:0/1000827007 learned_addr learned my addr 172.21.15.59:0/1000827007 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.667+0000 7f2c71eb3700 1 --2- 172.21.15.59:0/1000827007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c139030 0x7f2c6c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.667+0000 7f2c70eb1700 1 -- 172.21.15.59:0/1000827007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c139030 msgr2=0x7f2c6c13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.667+0000 7f2c70eb1700 1 --2- 172.21.15.59:0/1000827007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c139030 0x7f2c6c13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.667+0000 7f2c70eb1700 1 -- 172.21.15.59:0/1000827007 >> v1:172.21.15.59:6789/0 conn(0x7f2c6c1338a0 legacy=0x7f2c6c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.667+0000 7f2c70eb1700 1 -- 172.21.15.59:0/1000827007 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c06fc30 con 0x7f2c6c136710 2023-09-30T22:31:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.668+0000 7f2c70eb1700 1 --2- 172.21.15.59:0/1000827007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c136710 0x7f2c6c138af0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0098f0 tx=0x7f2c5c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4890396647111a83 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.668+0000 7f2c63fff700 1 -- 172.21.15.59:0/1000827007 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c011830 con 0x7f2c6c136710 2023-09-30T22:31:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.668+0000 7f2c63fff700 1 -- 172.21.15.59:0/1000827007 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c011990 con 0x7f2c6c136710 2023-09-30T22:31:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.668+0000 7f2c63fff700 1 -- 172.21.15.59:0/1000827007 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c011d20 con 0x7f2c6c136710 2023-09-30T22:31:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.669+0000 7f2c73916700 1 -- 172.21.15.59:0/1000827007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c136710 msgr2=0x7f2c6c138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.669+0000 7f2c73916700 1 --2- 172.21.15.59:0/1000827007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c136710 0x7f2c6c138af0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0098f0 tx=0x7f2c5c009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.669+0000 7f2c73916700 1 -- 172.21.15.59:0/1000827007 shutdown_connections 2023-09-30T22:31:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.669+0000 7f2c73916700 1 --2- 172.21.15.59:0/1000827007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c139030 0x7f2c6c13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.669+0000 7f2c73916700 1 --2- 172.21.15.59:0/1000827007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c136710 0x7f2c6c138af0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.669+0000 7f2c73916700 1 -- 172.21.15.59:0/1000827007 >> 172.21.15.59:0/1000827007 conn(0x7f2c6c0a2aa0 msgr2=0x7f2c6c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.669+0000 7f2c73916700 1 -- 172.21.15.59:0/1000827007 shutdown_connections 2023-09-30T22:31:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.669+0000 7f2c73916700 1 -- 172.21.15.59:0/1000827007 wait complete. 2023-09-30T22:31:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.670+0000 7f2c73916700 1 Processor -- start 2023-09-30T22:31:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.670+0000 7f2c73916700 1 -- start start 2023-09-30T22:31:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.670+0000 7f2c73916700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6c1338a0 0x7f2c6c11aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.670+0000 7f2c73916700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c136710 0x7f2c6c11b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.670+0000 7f2c73916700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c139030 0x7f2c6c11b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.670+0000 7f2c73916700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c11ca20 con 0x7f2c6c139030 2023-09-30T22:31:06.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.670+0000 7f2c73916700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c11eb70 con 0x7f2c6c136710 2023-09-30T22:31:06.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.670+0000 7f2c73916700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c11e650 con 0x7f2c6c1338a0 2023-09-30T22:31:06.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.670+0000 7f2c71eb3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c139030 0x7f2c6c11b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.670+0000 7f2c716b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6c1338a0 0x7f2c6c11aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.670+0000 7f2c71eb3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c139030 0x7f2c6c11b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36442/0 (socket says 172.21.15.59:36442) 2023-09-30T22:31:06.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.670+0000 7f2c71eb3700 1 -- 172.21.15.59:0/2808262582 learned_addr learned my addr 172.21.15.59:0/2808262582 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:06.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.670+0000 7f2c70eb1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c136710 0x7f2c6c11b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.671+0000 7f2c71eb3700 1 -- 172.21.15.59:0/2808262582 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6c1338a0 msgr2=0x7f2c6c11aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.671+0000 7f2c71eb3700 1 --2- 172.21.15.59:0/2808262582 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6c1338a0 0x7f2c6c11aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.671+0000 7f2c71eb3700 1 -- 172.21.15.59:0/2808262582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c136710 msgr2=0x7f2c6c11b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.671+0000 7f2c71eb3700 1 --2- 172.21.15.59:0/2808262582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c136710 0x7f2c6c11b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.671+0000 7f2c71eb3700 1 -- 172.21.15.59:0/2808262582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c009550 con 0x7f2c6c139030 2023-09-30T22:31:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.671+0000 7f2c71eb3700 1 --2- 172.21.15.59:0/2808262582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c139030 0x7f2c6c11b930 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400efc0 tx=0x7f2c6400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.671+0000 7f2c61ffb700 1 -- 172.21.15.59:0/2808262582 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c64009ea0 con 0x7f2c6c139030 2023-09-30T22:31:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.671+0000 7f2c61ffb700 1 -- 172.21.15.59:0/2808262582 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6400f040 con 0x7f2c6c139030 2023-09-30T22:31:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.671+0000 7f2c73916700 1 -- 172.21.15.59:0/2808262582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c11e0c0 con 0x7f2c6c139030 2023-09-30T22:31:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.671+0000 7f2c61ffb700 1 -- 172.21.15.59:0/2808262582 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400ced0 con 0x7f2c6c139030 2023-09-30T22:31:06.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.672+0000 7f2c73916700 1 -- 172.21.15.59:0/2808262582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c11d210 con 0x7f2c6c139030 2023-09-30T22:31:06.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.672+0000 7f2c61ffb700 1 -- 172.21.15.59:0/2808262582 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c64014480 con 0x7f2c6c139030 2023-09-30T22:31:06.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.673+0000 7f2c61ffb700 1 -- 172.21.15.59:0/2808262582 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2c6403ff60 con 0x7f2c6c139030 2023-09-30T22:31:06.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.673+0000 7f2c73916700 1 -- 172.21.15.59:0/2808262582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c11e2f0 con 0x7f2c6c139030 2023-09-30T22:31:06.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.678+0000 7f2c61ffb700 1 -- 172.21.15.59:0/2808262582 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c6406b750 con 0x7f2c6c139030 2023-09-30T22:31:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.703+0000 7f86303dd700 1 Processor -- start 2023-09-30T22:31:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.703+0000 7f86303dd700 1 -- start start 2023-09-30T22:31:06.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7fc74e5d7700 1 Processor -- start 2023-09-30T22:31:06.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7fc74e5d7700 1 -- start start 2023-09-30T22:31:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7f86303dd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f862809d6f0 0x7f862809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7f86303dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f862809e440 0x7f8628134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7f86303dd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f862809b120 con 0x7f862809e000 2023-09-30T22:31:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7f86303dd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862806b460 con 0x7f862809d6f0 2023-09-30T22:31:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7f86303dd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862809a7e0 con 0x7f862809e440 2023-09-30T22:31:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7f862e179700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f862809d6f0 0x7f862809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7f862e179700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f862809d6f0 0x7f862809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36444/0 (socket says 172.21.15.59:36444) 2023-09-30T22:31:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7f862e179700 1 -- 172.21.15.59:0/3971684137 learned_addr learned my addr 172.21.15.59:0/3971684137 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7fc74e5d7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc748131810 0x7fc748131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7fc74e5d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc74809a580 0x7fc748139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7fc74e5d7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7481313c0 con 0x7fc748099a40 2023-09-30T22:31:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7fc74e5d7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74806e8c0 con 0x7fc748131810 2023-09-30T22:31:06.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7fc74e5d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc748071d20 con 0x7fc74809a580 2023-09-30T22:31:06.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.704+0000 7fc74cb74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc74809a580 0x7fc748139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.705+0000 7fc74cb74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc74809a580 0x7fc748139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47884/0 (socket says 172.21.15.59:47884) 2023-09-30T22:31:06.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.705+0000 7fc74cb74700 1 -- 172.21.15.59:0/3670347637 learned_addr learned my addr 172.21.15.59:0/3670347637 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:06.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.705+0000 7fc74cb74700 1 -- 172.21.15.59:0/3670347637 >> v2:172.21.15.59:3300/0 conn(0x7fc748131810 msgr2=0x7fc748131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:06.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.705+0000 7fc74cb74700 1 --2- 172.21.15.59:0/3670347637 >> v2:172.21.15.59:3300/0 conn(0x7fc748131810 0x7fc748131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.705+0000 7fc74cb74700 1 -- 172.21.15.59:0/3670347637 >> v1:172.21.15.59:6789/0 conn(0x7fc748099a40 legacy=0x7fc748099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.705+0000 7fc74cb74700 1 -- 172.21.15.59:0/3670347637 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7480721a0 con 0x7fc74809a580 2023-09-30T22:31:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.705+0000 7f862e179700 1 -- 172.21.15.59:0/3971684137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f862809e440 msgr2=0x7f8628134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.705+0000 7f862e179700 1 --2- 172.21.15.59:0/3971684137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f862809e440 0x7f8628134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.705+0000 7f862e179700 1 -- 172.21.15.59:0/3971684137 >> v1:172.21.15.59:6789/0 conn(0x7f862809e000 legacy=0x7f86281339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.705+0000 7f862e179700 1 -- 172.21.15.59:0/3971684137 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862809a500 con 0x7f862809d6f0 2023-09-30T22:31:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.705+0000 7fc74cb74700 1 --2- 172.21.15.59:0/3670347637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc74809a580 0x7fc748139660 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc740009e50 tx=0x7fc74000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4732ebefa39f616 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.705+0000 7f862e179700 1 --2- 172.21.15.59:0/3971684137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862809d6f0 0x7f862809dac0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8624009920 tx=0x7f8624009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a051d68038703fe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.706+0000 7fc746ffd700 1 -- 172.21.15.59:0/3670347637 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74000e070 con 0x7fc74809a580 2023-09-30T22:31:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.706+0000 7fc746ffd700 1 -- 172.21.15.59:0/3670347637 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74000b9c0 con 0x7fc74809a580 2023-09-30T22:31:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.706+0000 7fc746ffd700 1 -- 172.21.15.59:0/3670347637 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74000bd70 con 0x7fc74809a580 2023-09-30T22:31:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.706+0000 7f862d177700 1 -- 172.21.15.59:0/3971684137 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862400ba20 con 0x7f862809d6f0 2023-09-30T22:31:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.706+0000 7f862d177700 1 -- 172.21.15.59:0/3971684137 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862400bb80 con 0x7f862809d6f0 2023-09-30T22:31:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.706+0000 7f862d177700 1 -- 172.21.15.59:0/3971684137 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624009e70 con 0x7f862809d6f0 2023-09-30T22:31:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.706+0000 7fc74e5d7700 1 -- 172.21.15.59:0/3670347637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc74809a580 msgr2=0x7fc748139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.706+0000 7fc74e5d7700 1 --2- 172.21.15.59:0/3670347637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc74809a580 0x7fc748139660 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc740009e50 tx=0x7fc74000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.706+0000 7f86303dd700 1 -- 172.21.15.59:0/3971684137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862809d6f0 msgr2=0x7f862809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.706+0000 7f86303dd700 1 --2- 172.21.15.59:0/3971684137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862809d6f0 0x7f862809dac0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8624009920 tx=0x7f8624009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.706+0000 7fc74e5d7700 1 -- 172.21.15.59:0/3670347637 shutdown_connections 2023-09-30T22:31:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.706+0000 7fc74e5d7700 1 --2- 172.21.15.59:0/3670347637 >> v2:172.21.15.59:3300/0 conn(0x7fc748131810 0x7fc748131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.707+0000 7fc74e5d7700 1 --2- 172.21.15.59:0/3670347637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc74809a580 0x7fc748139660 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.707+0000 7fc74e5d7700 1 -- 172.21.15.59:0/3670347637 >> 172.21.15.59:0/3670347637 conn(0x7fc7480a2aa0 msgr2=0x7fc7480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.707+0000 7f86303dd700 1 -- 172.21.15.59:0/3971684137 shutdown_connections 2023-09-30T22:31:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.707+0000 7f86303dd700 1 --2- 172.21.15.59:0/3971684137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862809d6f0 0x7f862809dac0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.707+0000 7f86303dd700 1 --2- 172.21.15.59:0/3971684137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f862809e440 0x7f8628134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.707+0000 7f86303dd700 1 -- 172.21.15.59:0/3971684137 >> 172.21.15.59:0/3971684137 conn(0x7f8628066f50 msgr2=0x7f862809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.707+0000 7f86303dd700 1 -- 172.21.15.59:0/3971684137 shutdown_connections 2023-09-30T22:31:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.707+0000 7fc74e5d7700 1 -- 172.21.15.59:0/3670347637 shutdown_connections 2023-09-30T22:31:06.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.707+0000 7f86303dd700 1 -- 172.21.15.59:0/3971684137 wait complete. 2023-09-30T22:31:06.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.707+0000 7fc74e5d7700 1 -- 172.21.15.59:0/3670347637 wait complete. 2023-09-30T22:31:06.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.708+0000 7fc74e5d7700 1 Processor -- start 2023-09-30T22:31:06.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.708+0000 7f86303dd700 1 Processor -- start 2023-09-30T22:31:06.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.708+0000 7f86303dd700 1 -- start start 2023-09-30T22:31:06.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.708+0000 7fc74e5d7700 1 -- start start 2023-09-30T22:31:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7f86303dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f862809d6f0 0x7f86281a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7f86303dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f862809e000 0x7f86281a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7f86303dd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862809e440 0x7f86281a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7f86303dd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86281a93b0 con 0x7f862809e440 2023-09-30T22:31:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7f86303dd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86281a8840 con 0x7f862809d6f0 2023-09-30T22:31:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7f86303dd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86281a8d00 con 0x7f862809e000 2023-09-30T22:31:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7fc74e5d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc748099a40 0x7fc7481c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7fc74e5d7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc74809a580 0x7fc7481c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7fc74e5d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc748131810 0x7fc748128390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7fc74e5d7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74812ad30 con 0x7fc74809a580 2023-09-30T22:31:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7fc74e5d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74812b980 con 0x7fc748099a40 2023-09-30T22:31:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7fc74e5d7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc74812a210 con 0x7fc748131810 2023-09-30T22:31:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7f862e179700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f862809d6f0 0x7f86281a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7f862e179700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f862809d6f0 0x7f86281a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47898/0 (socket says 172.21.15.59:47898) 2023-09-30T22:31:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7f862e179700 1 -- 172.21.15.59:0/3332286599 learned_addr learned my addr 172.21.15.59:0/3332286599 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7f862e97a700 1 --2- 172.21.15.59:0/3332286599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862809e440 0x7f86281a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7fc7477fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc74809a580 0x7fc7481c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7fc7477fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc74809a580 0x7fc7481c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36476/0 (socket says 172.21.15.59:36476) 2023-09-30T22:31:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.709+0000 7fc7477fe700 1 -- 172.21.15.59:0/1789810879 learned_addr learned my addr 172.21.15.59:0/1789810879 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7f862d978700 1 --2- 172.21.15.59:0/3332286599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f862809e000 0x7f86281a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7fc74cb74700 1 --2- 172.21.15.59:0/1789810879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc748131810 0x7fc748128390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7f862e179700 1 -- 172.21.15.59:0/3332286599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f862809e000 msgr2=0x7f86281a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7f862e179700 1 --2- 172.21.15.59:0/3332286599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f862809e000 0x7f86281a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7f862e179700 1 -- 172.21.15.59:0/3332286599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862809e440 msgr2=0x7f86281a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7f862e179700 1 --2- 172.21.15.59:0/3332286599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862809e440 0x7f86281a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7f862e179700 1 -- 172.21.15.59:0/3332286599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8624009550 con 0x7f862809d6f0 2023-09-30T22:31:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7f862e97a700 1 --2- 172.21.15.59:0/3332286599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862809e440 0x7f86281a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7f862e179700 1 --2- 172.21.15.59:0/3332286599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f862809d6f0 0x7f86281a5e30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f862809d470 tx=0x7f8624004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7fc7477fe700 1 -- 172.21.15.59:0/1789810879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc748131810 msgr2=0x7fc748128390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7fc7477fe700 1 --2- 172.21.15.59:0/1789810879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc748131810 0x7fc748128390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7fc7477fe700 1 -- 172.21.15.59:0/1789810879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc748099a40 msgr2=0x7fc7481c86d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:31:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7fc7477fe700 1 --2- 172.21.15.59:0/1789810879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc748099a40 0x7fc7481c86d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7fc7477fe700 1 -- 172.21.15.59:0/1789810879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc740009b30 con 0x7fc74809a580 2023-09-30T22:31:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7f861effd700 1 -- 172.21.15.59:0/3332286599 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86240036a0 con 0x7f862809d6f0 2023-09-30T22:31:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7f861effd700 1 -- 172.21.15.59:0/3332286599 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8624003820 con 0x7f862809d6f0 2023-09-30T22:31:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7f86303dd700 1 -- 172.21.15.59:0/3332286599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86281a9a30 con 0x7f862809d6f0 2023-09-30T22:31:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7f861effd700 1 -- 172.21.15.59:0/3332286599 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624003bd0 con 0x7f862809d6f0 2023-09-30T22:31:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7f86303dd700 1 -- 172.21.15.59:0/3332286599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86280a2250 con 0x7f862809d6f0 2023-09-30T22:31:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.710+0000 7fc74cb74700 1 --2- 172.21.15.59:0/1789810879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc748131810 0x7fc748128390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.711+0000 7fc7477fe700 1 --2- 172.21.15.59:0/1789810879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc74809a580 0x7fc7481c8c10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00c4b0 tx=0x7fc73c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.711+0000 7fc744ff9700 1 -- 172.21.15.59:0/1789810879 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0052d0 con 0x7fc74809a580 2023-09-30T22:31:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.711+0000 7fc744ff9700 1 -- 172.21.15.59:0/1789810879 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c005430 con 0x7fc74809a580 2023-09-30T22:31:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.711+0000 7fc74e5d7700 1 -- 172.21.15.59:0/1789810879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7481c8280 con 0x7fc74809a580 2023-09-30T22:31:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.711+0000 7fc744ff9700 1 -- 172.21.15.59:0/1789810879 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0038c0 con 0x7fc74809a580 2023-09-30T22:31:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.711+0000 7fc74e5d7700 1 -- 172.21.15.59:0/1789810879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc748129d70 con 0x7fc74809a580 2023-09-30T22:31:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.712+0000 7fc744ff9700 1 -- 172.21.15.59:0/1789810879 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc73c003a20 con 0x7fc74809a580 2023-09-30T22:31:06.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.712+0000 7f861effd700 1 -- 172.21.15.59:0/3332286599 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8624003d30 con 0x7f862809d6f0 2023-09-30T22:31:06.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.712+0000 7fc744ff9700 1 -- 172.21.15.59:0/1789810879 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc73c03eab0 con 0x7fc74809a580 2023-09-30T22:31:06.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.712+0000 7f86303dd700 1 -- 172.21.15.59:0/3332286599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86280729a0 con 0x7f862809d6f0 2023-09-30T22:31:06.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.712+0000 7f861effd700 1 -- 172.21.15.59:0/3332286599 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f86240409e0 con 0x7f862809d6f0 2023-09-30T22:31:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.713+0000 7fc74e5d7700 1 -- 172.21.15.59:0/1789810879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc748074ea0 con 0x7fc74809a580 2023-09-30T22:31:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.721+0000 7f861effd700 1 -- 172.21.15.59:0/3332286599 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f862402b360 con 0x7f862809d6f0 2023-09-30T22:31:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.721+0000 7fc744ff9700 1 -- 172.21.15.59:0/1789810879 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc73c018260 con 0x7fc74809a580 2023-09-30T22:31:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.888+0000 7f2c73916700 1 -- 172.21.15.59:0/2808262582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2c6c074ea0 con 0x7f2c6c139030 2023-09-30T22:31:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.889+0000 7f2c61ffb700 1 -- 172.21.15.59:0/2808262582 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c6c11e2f0 con 0x7f2c6c139030 2023-09-30T22:31:06.890 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:06.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.892+0000 7f2c73916700 1 -- 172.21.15.59:0/2808262582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c139030 msgr2=0x7f2c6c11b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.892+0000 7f2c73916700 1 --2- 172.21.15.59:0/2808262582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c139030 0x7f2c6c11b930 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400efc0 tx=0x7f2c6400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.892+0000 7f2c73916700 1 -- 172.21.15.59:0/2808262582 shutdown_connections 2023-09-30T22:31:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.892+0000 7f2c73916700 1 --2- 172.21.15.59:0/2808262582 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6c1338a0 0x7f2c6c11aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.892+0000 7f2c73916700 1 --2- 172.21.15.59:0/2808262582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c139030 0x7f2c6c11b930 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.892+0000 7f2c73916700 1 --2- 172.21.15.59:0/2808262582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c136710 0x7f2c6c11b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.892+0000 7f2c73916700 1 -- 172.21.15.59:0/2808262582 >> 172.21.15.59:0/2808262582 conn(0x7f2c6c0a2aa0 msgr2=0x7f2c6c1344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.892+0000 7f2c73916700 1 -- 172.21.15.59:0/2808262582 shutdown_connections 2023-09-30T22:31:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.892+0000 7f2c73916700 1 -- 172.21.15.59:0/2808262582 wait complete. 2023-09-30T22:31:06.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:06.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.927+0000 7f86303dd700 1 -- 172.21.15.59:0/3332286599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f862809f420 con 0x7f862809d6f0 2023-09-30T22:31:06.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.927+0000 7f861effd700 1 -- 172.21.15.59:0/3332286599 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8624028090 con 0x7f862809d6f0 2023-09-30T22:31:06.928 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:06.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.928+0000 7fc74e5d7700 1 -- 172.21.15.59:0/1789810879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc74806b9e0 con 0x7fc74809a580 2023-09-30T22:31:06.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.928+0000 7fc744ff9700 1 -- 172.21.15.59:0/1789810879 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc73c017020 con 0x7fc74809a580 2023-09-30T22:31:06.929 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:06.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.929+0000 7f86303dd700 1 -- 172.21.15.59:0/3332286599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f862809d6f0 msgr2=0x7f86281a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.929+0000 7f86303dd700 1 --2- 172.21.15.59:0/3332286599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f862809d6f0 0x7f86281a5e30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f862809d470 tx=0x7f8624004750 comp rx=0 tx=0).stop 2023-09-30T22:31:06.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.930+0000 7f86303dd700 1 -- 172.21.15.59:0/3332286599 shutdown_connections 2023-09-30T22:31:06.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.930+0000 7f86303dd700 1 --2- 172.21.15.59:0/3332286599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862809e440 0x7f86281a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.930+0000 7f86303dd700 1 --2- 172.21.15.59:0/3332286599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f862809d6f0 0x7f86281a5e30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.930+0000 7f86303dd700 1 --2- 172.21.15.59:0/3332286599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f862809e000 0x7f86281a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.930+0000 7f86303dd700 1 -- 172.21.15.59:0/3332286599 >> 172.21.15.59:0/3332286599 conn(0x7f8628066f50 msgr2=0x7f86281bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:06.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.930+0000 7f86303dd700 1 -- 172.21.15.59:0/3332286599 shutdown_connections 2023-09-30T22:31:06.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.930+0000 7f86303dd700 1 -- 172.21.15.59:0/3332286599 wait complete. 2023-09-30T22:31:06.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.930+0000 7fc74e5d7700 1 -- 172.21.15.59:0/1789810879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc74809a580 msgr2=0x7fc7481c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.930+0000 7fc74e5d7700 1 --2- 172.21.15.59:0/1789810879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc74809a580 0x7fc7481c8c10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00c4b0 tx=0x7fc73c00c7c0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.930+0000 7fc74e5d7700 1 -- 172.21.15.59:0/1789810879 shutdown_connections 2023-09-30T22:31:06.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.930+0000 7fc74e5d7700 1 --2- 172.21.15.59:0/1789810879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc748131810 0x7fc748128390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.930+0000 7fc74e5d7700 1 --2- 172.21.15.59:0/1789810879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc748099a40 0x7fc7481c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.930+0000 7fc74e5d7700 1 --2- 172.21.15.59:0/1789810879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc74809a580 0x7fc7481c8c10 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.930+0000 7fc74e5d7700 1 -- 172.21.15.59:0/1789810879 >> 172.21.15.59:0/1789810879 conn(0x7fc7480a2aa0 msgr2=0x7fc7480a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:06.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.931+0000 7fc74e5d7700 1 -- 172.21.15.59:0/1789810879 shutdown_connections 2023-09-30T22:31:06.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:06.931+0000 7fc74e5d7700 1 -- 172.21.15.59:0/1789810879 wait complete. 2023-09-30T22:31:06.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:06.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:07.218 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.363+0000 7f216e696700 1 Processor -- start 2023-09-30T22:31:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.363+0000 7f216e696700 1 -- start start 2023-09-30T22:31:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.363+0000 7f216e696700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f216806a770 0x7f216806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.363+0000 7f216e696700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2168131d10 0x7f2168139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.363+0000 7f216e696700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216809ece0 con 0x7f216806b080 2023-09-30T22:31:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.363+0000 7f216e696700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216809e760 con 0x7f216806a770 2023-09-30T22:31:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.363+0000 7f216e696700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216809e040 con 0x7f2168131d10 2023-09-30T22:31:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.364+0000 7f2167fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f216806a770 0x7f216806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.364+0000 7f216cc33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2168131d10 0x7f2168139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.364+0000 7f2167fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f216806a770 0x7f216806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36482/0 (socket says 172.21.15.59:36482) 2023-09-30T22:31:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.364+0000 7f2167fff700 1 -- 172.21.15.59:0/3149894716 learned_addr learned my addr 172.21.15.59:0/3149894716 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.364+0000 7f21677fe700 1 --1- 172.21.15.59:0/3149894716 >> v1:172.21.15.59:6789/0 conn(0x7f216806b080 0x7f2168131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58006/0 (socket says 172.21.15.59:58006) 2023-09-30T22:31:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.364+0000 7f216cc33700 1 -- 172.21.15.59:0/3149894716 >> v2:172.21.15.59:3300/0 conn(0x7f216806a770 msgr2=0x7f216806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.364+0000 7f216cc33700 1 --2- 172.21.15.59:0/3149894716 >> v2:172.21.15.59:3300/0 conn(0x7f216806a770 0x7f216806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.364+0000 7f216cc33700 1 -- 172.21.15.59:0/3149894716 >> v1:172.21.15.59:6789/0 conn(0x7f216806b080 legacy=0x7f2168131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.364+0000 7f216cc33700 1 -- 172.21.15.59:0/3149894716 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216809f630 con 0x7f2168131d10 2023-09-30T22:31:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.364+0000 7f2167fff700 1 --2- 172.21.15.59:0/3149894716 >> v2:172.21.15.59:3300/0 conn(0x7f216806a770 0x7f216806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.364+0000 7f216cc33700 1 --2- 172.21.15.59:0/3149894716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2168131d10 0x7f2168139860 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2160009d90 tx=0x7f216000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eccd88b32060e1c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.364+0000 7f2166ffd700 1 -- 172.21.15.59:0/3149894716 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216000e070 con 0x7f2168131d10 2023-09-30T22:31:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.364+0000 7f2166ffd700 1 -- 172.21.15.59:0/3149894716 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216000bb20 con 0x7f2168131d10 2023-09-30T22:31:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.364+0000 7f2166ffd700 1 -- 172.21.15.59:0/3149894716 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160012430 con 0x7f2168131d10 2023-09-30T22:31:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.365+0000 7f216e696700 1 -- 172.21.15.59:0/3149894716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2168131d10 msgr2=0x7f2168139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.365+0000 7f216e696700 1 --2- 172.21.15.59:0/3149894716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2168131d10 0x7f2168139860 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2160009d90 tx=0x7f216000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.365+0000 7f216e696700 1 -- 172.21.15.59:0/3149894716 shutdown_connections 2023-09-30T22:31:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.365+0000 7f216e696700 1 --2- 172.21.15.59:0/3149894716 >> v2:172.21.15.59:3300/0 conn(0x7f216806a770 0x7f216806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.365+0000 7f216e696700 1 --2- 172.21.15.59:0/3149894716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2168131d10 0x7f2168139860 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.365+0000 7f216e696700 1 -- 172.21.15.59:0/3149894716 >> 172.21.15.59:0/3149894716 conn(0x7f2168066f50 msgr2=0x7f216809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.365+0000 7f216e696700 1 -- 172.21.15.59:0/3149894716 shutdown_connections 2023-09-30T22:31:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.365+0000 7f216e696700 1 -- 172.21.15.59:0/3149894716 wait complete. 2023-09-30T22:31:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.366+0000 7f216e696700 1 Processor -- start 2023-09-30T22:31:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.366+0000 7f216e696700 1 -- start start 2023-09-30T22:31:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f216e696700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f216806a770 0x7f21681c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f216e696700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f216806b080 0x7f21681c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f216e696700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2168131d10 0x7f21681c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f216e696700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216811e1c0 con 0x7f2168131d10 2023-09-30T22:31:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f216e696700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216811e7e0 con 0x7f216806a770 2023-09-30T22:31:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f216e696700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2168071e60 con 0x7f216806b080 2023-09-30T22:31:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f2167fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f216806a770 0x7f21681c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f2167fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f216806a770 0x7f21681c6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47916/0 (socket says 172.21.15.59:47916) 2023-09-30T22:31:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f2167fff700 1 -- 172.21.15.59:0/3118047777 learned_addr learned my addr 172.21.15.59:0/3118047777 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f21677fe700 1 --2- 172.21.15.59:0/3118047777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f216806b080 0x7f21681c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f216cc33700 1 --2- 172.21.15.59:0/3118047777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2168131d10 0x7f21681c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f2167fff700 1 -- 172.21.15.59:0/3118047777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f216806b080 msgr2=0x7f21681c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f2167fff700 1 --2- 172.21.15.59:0/3118047777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f216806b080 0x7f21681c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f2167fff700 1 -- 172.21.15.59:0/3118047777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2168131d10 msgr2=0x7f21681c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f2167fff700 1 --2- 172.21.15.59:0/3118047777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2168131d10 0x7f21681c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f2167fff700 1 -- 172.21.15.59:0/3118047777 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c009550 con 0x7f216806a770 2023-09-30T22:31:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f216cc33700 1 --2- 172.21.15.59:0/3118047777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2168131d10 0x7f21681c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f2167fff700 1 --2- 172.21.15.59:0/3118047777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f216806a770 0x7f21681c6190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f215c00ebe0 tx=0x7f215c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.367+0000 7f2164ff9700 1 -- 172.21.15.59:0/3118047777 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c00c850 con 0x7f216806a770 2023-09-30T22:31:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.368+0000 7f2164ff9700 1 -- 172.21.15.59:0/3118047777 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c00c9b0 con 0x7f216806a770 2023-09-30T22:31:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.368+0000 7f2164ff9700 1 -- 172.21.15.59:0/3118047777 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c00cd40 con 0x7f216806a770 2023-09-30T22:31:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.368+0000 7f216e696700 1 -- 172.21.15.59:0/3118047777 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2160009a70 con 0x7f216806a770 2023-09-30T22:31:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.368+0000 7f216e696700 1 -- 172.21.15.59:0/3118047777 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216811fdf0 con 0x7f216806a770 2023-09-30T22:31:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.368+0000 7f2164ff9700 1 -- 172.21.15.59:0/3118047777 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f215c013470 con 0x7f216806a770 2023-09-30T22:31:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.369+0000 7f2164ff9700 1 -- 172.21.15.59:0/3118047777 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f215c03fc20 con 0x7f216806a770 2023-09-30T22:31:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.369+0000 7f216e696700 1 -- 172.21.15.59:0/3118047777 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2168074ea0 con 0x7f216806a770 2023-09-30T22:31:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.373+0000 7f2164ff9700 1 -- 172.21.15.59:0/3118047777 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f215c01b3b0 con 0x7f216806a770 2023-09-30T22:31:07.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.579+0000 7f216e696700 1 -- 172.21.15.59:0/3118047777 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f216806ed90 con 0x7f216806a770 2023-09-30T22:31:07.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.579+0000 7f2164ff9700 1 -- 172.21.15.59:0/3118047777 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f215c024350 con 0x7f216806a770 2023-09-30T22:31:07.581 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.582+0000 7f216e696700 1 -- 172.21.15.59:0/3118047777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f216806a770 msgr2=0x7f21681c6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.582+0000 7f216e696700 1 --2- 172.21.15.59:0/3118047777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f216806a770 0x7f21681c6190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f215c00ebe0 tx=0x7f215c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.582+0000 7f216e696700 1 -- 172.21.15.59:0/3118047777 shutdown_connections 2023-09-30T22:31:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.582+0000 7f216e696700 1 --2- 172.21.15.59:0/3118047777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2168131d10 0x7f21681c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.582+0000 7f216e696700 1 --2- 172.21.15.59:0/3118047777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f216806a770 0x7f21681c6190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.582+0000 7f216e696700 1 --2- 172.21.15.59:0/3118047777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f216806b080 0x7f21681c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.582+0000 7f216e696700 1 -- 172.21.15.59:0/3118047777 >> 172.21.15.59:0/3118047777 conn(0x7f2168066f50 msgr2=0x7f21680700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.582+0000 7f216e696700 1 -- 172.21.15.59:0/3118047777 shutdown_connections 2023-09-30T22:31:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:07.582+0000 7f216e696700 1 -- 172.21.15.59:0/3118047777 wait complete. 2023-09-30T22:31:07.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:07.908 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:07.947 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:07.948 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.057+0000 7ff26f348700 1 Processor -- start 2023-09-30T22:31:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.057+0000 7ff26f348700 1 -- start start 2023-09-30T22:31:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.058+0000 7ff26f348700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26809e930 0x7ff26809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.058+0000 7ff26f348700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff26809f240 0x7ff2681317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.058+0000 7ff26f348700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff268070940 con 0x7ff26809f650 2023-09-30T22:31:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.058+0000 7ff26f348700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26806fd60 con 0x7ff26809f240 2023-09-30T22:31:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.058+0000 7ff26f348700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26806fa80 con 0x7ff26809e930 2023-09-30T22:31:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.058+0000 7ff26d0e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26809e930 0x7ff26809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.058+0000 7ff26d0e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26809e930 0x7ff26809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47920/0 (socket says 172.21.15.59:47920) 2023-09-30T22:31:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.058+0000 7ff26d0e4700 1 -- 172.21.15.59:0/1566989168 learned_addr learned my addr 172.21.15.59:0/1566989168 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:08.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.058+0000 7ff26c8e3700 1 --2- 172.21.15.59:0/1566989168 >> v2:172.21.15.59:3300/0 conn(0x7ff26809f240 0x7ff2681317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.059+0000 7ff26c8e3700 1 -- 172.21.15.59:0/1566989168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26809e930 msgr2=0x7ff26809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:08.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.059+0000 7ff26c8e3700 1 --2- 172.21.15.59:0/1566989168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26809e930 0x7ff26809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.059+0000 7ff26c8e3700 1 -- 172.21.15.59:0/1566989168 >> v1:172.21.15.59:6789/0 conn(0x7ff26809f650 legacy=0x7ff268131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.059+0000 7ff26c8e3700 1 -- 172.21.15.59:0/1566989168 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26809fb60 con 0x7ff26809f240 2023-09-30T22:31:08.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.059+0000 7ff26d0e4700 1 --2- 172.21.15.59:0/1566989168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26809e930 0x7ff26809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:08.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.059+0000 7ff26c8e3700 1 --2- 172.21.15.59:0/1566989168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26809f240 0x7ff2681317f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff258009840 tx=0x7ff258009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf71d431167f7c60 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:08.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.059+0000 7ff25ffff700 1 -- 172.21.15.59:0/1566989168 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258011830 con 0x7ff26809f240 2023-09-30T22:31:08.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.059+0000 7ff25ffff700 1 -- 172.21.15.59:0/1566989168 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff258011990 con 0x7ff26809f240 2023-09-30T22:31:08.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.059+0000 7ff25ffff700 1 -- 172.21.15.59:0/1566989168 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258011d20 con 0x7ff26809f240 2023-09-30T22:31:08.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.060+0000 7ff26f348700 1 -- 172.21.15.59:0/1566989168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26809f240 msgr2=0x7ff2681317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.060+0000 7ff26f348700 1 --2- 172.21.15.59:0/1566989168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26809f240 0x7ff2681317f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff258009840 tx=0x7ff258009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:08.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.060+0000 7ff26f348700 1 -- 172.21.15.59:0/1566989168 shutdown_connections 2023-09-30T22:31:08.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.060+0000 7ff26f348700 1 --2- 172.21.15.59:0/1566989168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26809e930 0x7ff26809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.060+0000 7ff26f348700 1 --2- 172.21.15.59:0/1566989168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26809f240 0x7ff2681317f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.060+0000 7ff26f348700 1 -- 172.21.15.59:0/1566989168 >> 172.21.15.59:0/1566989168 conn(0x7ff2680a4210 msgr2=0x7ff2680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:08.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.060+0000 7ff26f348700 1 -- 172.21.15.59:0/1566989168 shutdown_connections 2023-09-30T22:31:08.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.060+0000 7ff26f348700 1 -- 172.21.15.59:0/1566989168 wait complete. 2023-09-30T22:31:08.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.061+0000 7ff26f348700 1 Processor -- start 2023-09-30T22:31:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.061+0000 7ff26f348700 1 -- start start 2023-09-30T22:31:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.061+0000 7ff26f348700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26809e930 0x7ff2681a3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.061+0000 7ff26f348700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26809f240 0x7ff2681a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.061+0000 7ff26f348700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26809f650 0x7ff2681a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.061+0000 7ff26f348700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2681a5310 con 0x7ff26809e930 2023-09-30T22:31:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.061+0000 7ff26f348700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2681a59d0 con 0x7ff26809f240 2023-09-30T22:31:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.061+0000 7ff26f348700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2681a6c20 con 0x7ff26809f650 2023-09-30T22:31:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.062+0000 7ff26d0e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26809e930 0x7ff2681a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.062+0000 7ff26d0e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26809e930 0x7ff2681a3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36506/0 (socket says 172.21.15.59:36506) 2023-09-30T22:31:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.062+0000 7ff26d0e4700 1 -- 172.21.15.59:0/1637415794 learned_addr learned my addr 172.21.15.59:0/1637415794 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.062+0000 7ff26c8e3700 1 --2- 172.21.15.59:0/1637415794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26809f240 0x7ff2681a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.062+0000 7ff26d8e5700 1 --2- 172.21.15.59:0/1637415794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26809f650 0x7ff2681a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.062+0000 7ff26d0e4700 1 -- 172.21.15.59:0/1637415794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26809f650 msgr2=0x7ff2681a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.062+0000 7ff26d0e4700 1 --2- 172.21.15.59:0/1637415794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26809f650 0x7ff2681a48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.062+0000 7ff26d0e4700 1 -- 172.21.15.59:0/1637415794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26809f240 msgr2=0x7ff2681a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.062+0000 7ff26d0e4700 1 --2- 172.21.15.59:0/1637415794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26809f240 0x7ff2681a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.062+0000 7ff26d0e4700 1 -- 172.21.15.59:0/1637415794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff264009550 con 0x7ff26809e930 2023-09-30T22:31:08.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.062+0000 7ff26d8e5700 1 --2- 172.21.15.59:0/1637415794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26809f650 0x7ff2681a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:08.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.062+0000 7ff26d0e4700 1 --2- 172.21.15.59:0/1637415794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26809e930 0x7ff2681a3e60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff26400ec10 tx=0x7ff26400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:08.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.062+0000 7ff25dffb700 1 -- 172.21.15.59:0/1637415794 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26400c850 con 0x7ff26809e930 2023-09-30T22:31:08.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.063+0000 7ff25dffb700 1 -- 172.21.15.59:0/1637415794 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26400c9b0 con 0x7ff26809e930 2023-09-30T22:31:08.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.063+0000 7ff26f348700 1 -- 172.21.15.59:0/1637415794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2580094a0 con 0x7ff26809e930 2023-09-30T22:31:08.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.063+0000 7ff25dffb700 1 -- 172.21.15.59:0/1637415794 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26400cd20 con 0x7ff26809e930 2023-09-30T22:31:08.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.063+0000 7ff26f348700 1 -- 172.21.15.59:0/1637415794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2680a0190 con 0x7ff26809e930 2023-09-30T22:31:08.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.064+0000 7ff26f348700 1 -- 172.21.15.59:0/1637415794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2680a3630 con 0x7ff26809e930 2023-09-30T22:31:08.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.064+0000 7ff25dffb700 1 -- 172.21.15.59:0/1637415794 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff264013470 con 0x7ff26809e930 2023-09-30T22:31:08.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.064+0000 7ff25dffb700 1 -- 172.21.15.59:0/1637415794 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff26403f820 con 0x7ff26809e930 2023-09-30T22:31:08.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.073+0000 7ff25dffb700 1 -- 172.21.15.59:0/1637415794 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff264013720 con 0x7ff26809e930 2023-09-30T22:31:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.097+0000 7fa50df23700 1 Processor -- start 2023-09-30T22:31:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.097+0000 7fa50df23700 1 -- start start 2023-09-30T22:31:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.097+0000 7fa50df23700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa50809d630 0x7fa5080a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.097+0000 7fa50df23700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa508138d80 0x7fa50813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.097+0000 7fa50df23700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5080a2a70 con 0x7fa5080a0a30 2023-09-30T22:31:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.097+0000 7fa50df23700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5080a01d0 con 0x7fa50809d630 2023-09-30T22:31:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.097+0000 7fa50df23700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50809e2b0 con 0x7fa508138d80 2023-09-30T22:31:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.097+0000 7fa507fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa508138d80 0x7fa50813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.097+0000 7fa5077fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa5080a0a30 0x7fa5080a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58038/0 (socket says 172.21.15.59:58038) 2023-09-30T22:31:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.097+0000 7fa5077fe700 1 -- 172.21.15.59:0/1452328663 learned_addr learned my addr 172.21.15.59:0/1452328663 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.097+0000 7fa506ffd700 1 --2- 172.21.15.59:0/1452328663 >> v2:172.21.15.59:3300/0 conn(0x7fa50809d630 0x7fa5080a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.098+0000 7fa507fff700 1 -- 172.21.15.59:0/1452328663 >> v2:172.21.15.59:3300/0 conn(0x7fa50809d630 msgr2=0x7fa5080a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.098+0000 7fa507fff700 1 --2- 172.21.15.59:0/1452328663 >> v2:172.21.15.59:3300/0 conn(0x7fa50809d630 0x7fa5080a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.098+0000 7fa5067fc700 1 -- 172.21.15.59:0/1452328663 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499519964 0 0) 0x7fa5080a2a70 con 0x7fa5080a0a30 2023-09-30T22:31:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.098+0000 7fa507fff700 1 -- 172.21.15.59:0/1452328663 >> v1:172.21.15.59:6789/0 conn(0x7fa5080a0a30 legacy=0x7fa5080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.098+0000 7fa507fff700 1 -- 172.21.15.59:0/1452328663 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50809dc50 con 0x7fa508138d80 2023-09-30T22:31:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.098+0000 7fa507fff700 1 --2- 172.21.15.59:0/1452328663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa508138d80 0x7fa50813b160 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa500009d90 tx=0x7fa50000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c142afa4fd2b8b6c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.098+0000 7fa5067fc700 1 -- 172.21.15.59:0/1452328663 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50000e070 con 0x7fa508138d80 2023-09-30T22:31:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.098+0000 7fa5067fc700 1 -- 172.21.15.59:0/1452328663 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50000bb20 con 0x7fa508138d80 2023-09-30T22:31:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.098+0000 7fa5067fc700 1 -- 172.21.15.59:0/1452328663 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500012430 con 0x7fa508138d80 2023-09-30T22:31:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.099+0000 7fa50df23700 1 -- 172.21.15.59:0/1452328663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa508138d80 msgr2=0x7fa50813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.099+0000 7fa50df23700 1 --2- 172.21.15.59:0/1452328663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa508138d80 0x7fa50813b160 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa500009d90 tx=0x7fa50000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.099+0000 7fa50df23700 1 -- 172.21.15.59:0/1452328663 shutdown_connections 2023-09-30T22:31:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.099+0000 7fa50df23700 1 --2- 172.21.15.59:0/1452328663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa508138d80 0x7fa50813b160 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.099+0000 7fa50df23700 1 --2- 172.21.15.59:0/1452328663 >> v2:172.21.15.59:3300/0 conn(0x7fa50809d630 0x7fa5080a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.099+0000 7fa50df23700 1 -- 172.21.15.59:0/1452328663 >> 172.21.15.59:0/1452328663 conn(0x7fa5080a3050 msgr2=0x7fa5080a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.099+0000 7fa50df23700 1 -- 172.21.15.59:0/1452328663 shutdown_connections 2023-09-30T22:31:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.099+0000 7fa50df23700 1 -- 172.21.15.59:0/1452328663 wait complete. 2023-09-30T22:31:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.100+0000 7fa50df23700 1 Processor -- start 2023-09-30T22:31:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.101+0000 7fa50df23700 1 -- start start 2023-09-30T22:31:08.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.101+0000 7fe8dbc9b700 1 Processor -- start 2023-09-30T22:31:08.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.101+0000 7fe8dbc9b700 1 -- start start 2023-09-30T22:31:08.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.101+0000 7fa50df23700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809d630 0x7fa508133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.101+0000 7fa50df23700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080a0a30 0x7fa508133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.101+0000 7fa50df23700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa508138d80 0x7fa508134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.101+0000 7fa50df23700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa508137180 con 0x7fa508138d80 2023-09-30T22:31:08.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.101+0000 7fa50df23700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa508136070 con 0x7fa5080a0a30 2023-09-30T22:31:08.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.101+0000 7fa50df23700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa508136530 con 0x7fa50809d630 2023-09-30T22:31:08.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fa507fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa508138d80 0x7fa508134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fa507fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa508138d80 0x7fa508134180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36526/0 (socket says 172.21.15.59:36526) 2023-09-30T22:31:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fa507fff700 1 -- 172.21.15.59:0/1108805173 learned_addr learned my addr 172.21.15.59:0/1108805173 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fa506ffd700 1 --2- 172.21.15.59:0/1108805173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080a0a30 0x7fa508133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fa5077fe700 1 --2- 172.21.15.59:0/1108805173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809d630 0x7fa508133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fe8dbc9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8d406b250 0x7fe8d4136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fe8dbc9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8d4136d80 0x7fe8d4139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fe8dbc9b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d409ece0 con 0x7fe8d406a770 2023-09-30T22:31:08.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fe8dbc9b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d409e760 con 0x7fe8d406b250 2023-09-30T22:31:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fe8dbc9b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d409e040 con 0x7fe8d4136d80 2023-09-30T22:31:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fa507fff700 1 -- 172.21.15.59:0/1108805173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809d630 msgr2=0x7fa508133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fa507fff700 1 --2- 172.21.15.59:0/1108805173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809d630 0x7fa508133700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fa507fff700 1 -- 172.21.15.59:0/1108805173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080a0a30 msgr2=0x7fa508133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fa507fff700 1 --2- 172.21.15.59:0/1108805173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080a0a30 0x7fa508133c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fa507fff700 1 -- 172.21.15.59:0/1108805173 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500009a70 con 0x7fa508138d80 2023-09-30T22:31:08.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fe8da238700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8d4136d80 0x7fe8d4139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fe8da238700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8d4136d80 0x7fe8d4139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47970/0 (socket says 172.21.15.59:47970) 2023-09-30T22:31:08.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fe8da238700 1 -- 172.21.15.59:0/2493415176 learned_addr learned my addr 172.21.15.59:0/2493415176 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:08.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.102+0000 7fe8d9236700 1 --2- 172.21.15.59:0/2493415176 >> v2:172.21.15.59:3300/0 conn(0x7fe8d406b250 0x7fe8d4136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.103+0000 7fe8da238700 1 -- 172.21.15.59:0/2493415176 >> v2:172.21.15.59:3300/0 conn(0x7fe8d406b250 msgr2=0x7fe8d4136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:08.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.103+0000 7fe8da238700 1 --2- 172.21.15.59:0/2493415176 >> v2:172.21.15.59:3300/0 conn(0x7fe8d406b250 0x7fe8d4136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.103+0000 7fe8da238700 1 -- 172.21.15.59:0/2493415176 >> v1:172.21.15.59:6789/0 conn(0x7fe8d406a770 legacy=0x7fe8d406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:08.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.103+0000 7fe8da238700 1 -- 172.21.15.59:0/2493415176 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d409f630 con 0x7fe8d4136d80 2023-09-30T22:31:08.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.103+0000 7fa507fff700 1 --2- 172.21.15.59:0/1108805173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa508138d80 0x7fa508134180 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa500013000 tx=0x7fa500004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:08.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.103+0000 7fa4effff700 1 -- 172.21.15.59:0/1108805173 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500012430 con 0x7fa508138d80 2023-09-30T22:31:08.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.103+0000 7fe8da238700 1 --2- 172.21.15.59:0/2493415176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8d4136d80 0x7fe8d4139160 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009e50 tx=0x7fe8cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=915bd68b8357c778 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:08.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.103+0000 7fa50df23700 1 -- 172.21.15.59:0/1108805173 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50813aba0 con 0x7fa508138d80 2023-09-30T22:31:08.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.103+0000 7fa4effff700 1 -- 172.21.15.59:0/1108805173 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa500020070 con 0x7fa508138d80 2023-09-30T22:31:08.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.103+0000 7fa4effff700 1 -- 172.21.15.59:0/1108805173 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500004280 con 0x7fa508138d80 2023-09-30T22:31:08.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.103+0000 7fa50df23700 1 -- 172.21.15.59:0/1108805173 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa508137910 con 0x7fa508138d80 2023-09-30T22:31:08.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.103+0000 7fe8d8a35700 1 -- 172.21.15.59:0/2493415176 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00e070 con 0x7fe8d4136d80 2023-09-30T22:31:08.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.103+0000 7fe8d8a35700 1 -- 172.21.15.59:0/2493415176 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc003a20 con 0x7fe8d4136d80 2023-09-30T22:31:08.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.103+0000 7fe8d8a35700 1 -- 172.21.15.59:0/2493415176 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc003dd0 con 0x7fe8d4136d80 2023-09-30T22:31:08.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.104+0000 7fa4effff700 1 -- 172.21.15.59:0/1108805173 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5000043e0 con 0x7fa508138d80 2023-09-30T22:31:08.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.104+0000 7fa4effff700 1 -- 172.21.15.59:0/1108805173 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa500022070 con 0x7fa508138d80 2023-09-30T22:31:08.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.104+0000 7fe8dbc9b700 1 -- 172.21.15.59:0/2493415176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8d4136d80 msgr2=0x7fe8d4139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.104+0000 7fe8dbc9b700 1 --2- 172.21.15.59:0/2493415176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8d4136d80 0x7fe8d4139160 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009e50 tx=0x7fe8cc00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:08.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.104+0000 7fe8dbc9b700 1 -- 172.21.15.59:0/2493415176 shutdown_connections 2023-09-30T22:31:08.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.104+0000 7fe8dbc9b700 1 --2- 172.21.15.59:0/2493415176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8d4136d80 0x7fe8d4139160 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.104+0000 7fe8dbc9b700 1 --2- 172.21.15.59:0/2493415176 >> v2:172.21.15.59:3300/0 conn(0x7fe8d406b250 0x7fe8d4136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.104+0000 7fe8dbc9b700 1 -- 172.21.15.59:0/2493415176 >> 172.21.15.59:0/2493415176 conn(0x7fe8d4066f50 msgr2=0x7fe8d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:08.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.104+0000 7fe8dbc9b700 1 -- 172.21.15.59:0/2493415176 shutdown_connections 2023-09-30T22:31:08.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.104+0000 7fe8dbc9b700 1 -- 172.21.15.59:0/2493415176 wait complete. 2023-09-30T22:31:08.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.105+0000 7fa50df23700 1 -- 172.21.15.59:0/1108805173 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5080747f0 con 0x7fa508138d80 2023-09-30T22:31:08.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.105+0000 7fe8dbc9b700 1 Processor -- start 2023-09-30T22:31:08.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.105+0000 7fe8dbc9b700 1 -- start start 2023-09-30T22:31:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8dbc9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8d406a770 0x7fe8d4132a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8dbc9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d406b250 0x7fe8d4132fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8dbc9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8d4136d80 0x7fe8d4133500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8dbc9b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d41353b0 con 0x7fe8d406b250 2023-09-30T22:31:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8dbc9b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d4136050 con 0x7fe8d4136d80 2023-09-30T22:31:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8dbc9b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d4136330 con 0x7fe8d406a770 2023-09-30T22:31:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8d9236700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d406b250 0x7fe8d4132fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8d9236700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d406b250 0x7fe8d4132fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36550/0 (socket says 172.21.15.59:36550) 2023-09-30T22:31:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8d9236700 1 -- 172.21.15.59:0/248693507 learned_addr learned my addr 172.21.15.59:0/248693507 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8da238700 1 --2- 172.21.15.59:0/248693507 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8d4136d80 0x7fe8d4133500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8da238700 1 -- 172.21.15.59:0/248693507 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8d406a770 msgr2=0x7fe8d4132a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8da238700 1 --2- 172.21.15.59:0/248693507 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8d406a770 0x7fe8d4132a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8da238700 1 -- 172.21.15.59:0/248693507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d406b250 msgr2=0x7fe8d4132fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8da238700 1 --2- 172.21.15.59:0/248693507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d406b250 0x7fe8d4132fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8da238700 1 -- 172.21.15.59:0/248693507 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc009b30 con 0x7fe8d4136d80 2023-09-30T22:31:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.106+0000 7fe8d9236700 1 --2- 172.21.15.59:0/248693507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d406b250 0x7fe8d4132fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.107+0000 7fe8da238700 1 --2- 172.21.15.59:0/248693507 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8d4136d80 0x7fe8d4133500 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc014000 tx=0x7fe8cc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.107+0000 7fe8ca7fc700 1 -- 172.21.15.59:0/248693507 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc004440 con 0x7fe8d4136d80 2023-09-30T22:31:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.107+0000 7fe8ca7fc700 1 -- 172.21.15.59:0/248693507 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc0045c0 con 0x7fe8d4136d80 2023-09-30T22:31:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.107+0000 7fe8dbc9b700 1 -- 172.21.15.59:0/248693507 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d409bf60 con 0x7fe8d4136d80 2023-09-30T22:31:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.107+0000 7fe8ca7fc700 1 -- 172.21.15.59:0/248693507 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc004970 con 0x7fe8d4136d80 2023-09-30T22:31:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.107+0000 7fe8dbc9b700 1 -- 172.21.15.59:0/248693507 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d4134c10 con 0x7fe8d4136d80 2023-09-30T22:31:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.108+0000 7fe8dbc9b700 1 -- 172.21.15.59:0/248693507 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d4136190 con 0x7fe8d4136d80 2023-09-30T22:31:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.108+0000 7fe8ca7fc700 1 -- 172.21.15.59:0/248693507 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8cc02e430 con 0x7fe8d4136d80 2023-09-30T22:31:08.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.109+0000 7fe8ca7fc700 1 -- 172.21.15.59:0/248693507 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe8cc040c30 con 0x7fe8d4136d80 2023-09-30T22:31:08.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.113+0000 7fe8ca7fc700 1 -- 172.21.15.59:0/248693507 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8cc024c10 con 0x7fe8d4136d80 2023-09-30T22:31:08.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.114+0000 7fa4effff700 1 -- 172.21.15.59:0/1108805173 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa50001b400 con 0x7fa508138d80 2023-09-30T22:31:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.285+0000 7ff26f348700 1 -- 172.21.15.59:0/1637415794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff2681a74f0 con 0x7ff26809e930 2023-09-30T22:31:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.285+0000 7ff25dffb700 1 -- 172.21.15.59:0/1637415794 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff264021020 con 0x7ff26809e930 2023-09-30T22:31:08.287 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:08.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.288+0000 7ff26f348700 1 -- 172.21.15.59:0/1637415794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26809e930 msgr2=0x7ff2681a3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.288+0000 7ff26f348700 1 --2- 172.21.15.59:0/1637415794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26809e930 0x7ff2681a3e60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff26400ec10 tx=0x7ff26400ef20 comp rx=0 tx=0).stop 2023-09-30T22:31:08.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.288+0000 7ff26f348700 1 -- 172.21.15.59:0/1637415794 shutdown_connections 2023-09-30T22:31:08.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.288+0000 7ff26f348700 1 --2- 172.21.15.59:0/1637415794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26809f650 0x7ff2681a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.288+0000 7ff26f348700 1 --2- 172.21.15.59:0/1637415794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26809e930 0x7ff2681a3e60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.288+0000 7ff26f348700 1 --2- 172.21.15.59:0/1637415794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26809f240 0x7ff2681a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.288+0000 7ff26f348700 1 -- 172.21.15.59:0/1637415794 >> 172.21.15.59:0/1637415794 conn(0x7ff2680a4210 msgr2=0x7ff2681b8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:08.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.288+0000 7ff26f348700 1 -- 172.21.15.59:0/1637415794 shutdown_connections 2023-09-30T22:31:08.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.288+0000 7ff26f348700 1 -- 172.21.15.59:0/1637415794 wait complete. 2023-09-30T22:31:08.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:08.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.318+0000 7fe8dbc9b700 1 -- 172.21.15.59:0/248693507 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe8d4136190 con 0x7fe8d4136d80 2023-09-30T22:31:08.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.319+0000 7fe8ca7fc700 1 -- 172.21.15.59:0/248693507 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8d4136190 con 0x7fe8d4136d80 2023-09-30T22:31:08.320 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:08.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.321+0000 7fe8dbc9b700 1 -- 172.21.15.59:0/248693507 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8d4136d80 msgr2=0x7fe8d4133500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.321+0000 7fe8dbc9b700 1 --2- 172.21.15.59:0/248693507 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8d4136d80 0x7fe8d4133500 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc014000 tx=0x7fe8cc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.321+0000 7fe8dbc9b700 1 -- 172.21.15.59:0/248693507 shutdown_connections 2023-09-30T22:31:08.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.321+0000 7fe8dbc9b700 1 --2- 172.21.15.59:0/248693507 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8d406a770 0x7fe8d4132a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.321+0000 7fe8dbc9b700 1 --2- 172.21.15.59:0/248693507 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8d4136d80 0x7fe8d4133500 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.321+0000 7fe8dbc9b700 1 --2- 172.21.15.59:0/248693507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d406b250 0x7fe8d4132fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.321+0000 7fe8dbc9b700 1 -- 172.21.15.59:0/248693507 >> 172.21.15.59:0/248693507 conn(0x7fe8d4066f50 msgr2=0x7fe8d40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:08.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.321+0000 7fe8dbc9b700 1 -- 172.21.15.59:0/248693507 shutdown_connections 2023-09-30T22:31:08.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.321+0000 7fe8dbc9b700 1 -- 172.21.15.59:0/248693507 wait complete. 2023-09-30T22:31:08.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.324+0000 7fa50df23700 1 -- 172.21.15.59:0/1108805173 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa508072980 con 0x7fa508138d80 2023-09-30T22:31:08.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.324+0000 7fa4effff700 1 -- 172.21.15.59:0/1108805173 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa50002c020 con 0x7fa508138d80 2023-09-30T22:31:08.325 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:08.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.326+0000 7fa50df23700 1 -- 172.21.15.59:0/1108805173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa508138d80 msgr2=0x7fa508134180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.326+0000 7fa50df23700 1 --2- 172.21.15.59:0/1108805173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa508138d80 0x7fa508134180 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa500013000 tx=0x7fa500004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.326+0000 7fa50df23700 1 -- 172.21.15.59:0/1108805173 shutdown_connections 2023-09-30T22:31:08.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.326+0000 7fa50df23700 1 --2- 172.21.15.59:0/1108805173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809d630 0x7fa508133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.326+0000 7fa50df23700 1 --2- 172.21.15.59:0/1108805173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa508138d80 0x7fa508134180 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.326+0000 7fa50df23700 1 --2- 172.21.15.59:0/1108805173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080a0a30 0x7fa508133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.326+0000 7fa50df23700 1 -- 172.21.15.59:0/1108805173 >> 172.21.15.59:0/1108805173 conn(0x7fa5080a3050 msgr2=0x7fa50809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:08.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.327+0000 7fa50df23700 1 -- 172.21.15.59:0/1108805173 shutdown_connections 2023-09-30T22:31:08.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.327+0000 7fa50df23700 1 -- 172.21.15.59:0/1108805173 wait complete. 2023-09-30T22:31:08.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:08.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:08.598 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.742+0000 7f62cafc3700 1 Processor -- start 2023-09-30T22:31:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.742+0000 7f62cafc3700 1 -- start start 2023-09-30T22:31:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62cafc3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c4133420 0x7f62c41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62cafc3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62c4133e30 0x7f62c412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62cafc3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c4134260 0x7f62c41304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62cafc3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c406b990 con 0x7f62c4133e30 2023-09-30T22:31:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62cafc3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40a0590 con 0x7f62c4134260 2023-09-30T22:31:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62cafc3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62c409fb80 con 0x7f62c4133420 2023-09-30T22:31:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62c3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62c4133e30 0x7f62c412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62c8d5f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c4133420 0x7f62c41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62c9560700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c4134260 0x7f62c41304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62c8d5f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c4133420 0x7f62c41337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35126/0 (socket says 172.21.15.59:35126) 2023-09-30T22:31:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62c3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62c4133e30 0x7f62c412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36552/0 (socket says 172.21.15.59:36552) 2023-09-30T22:31:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62c8d5f700 1 -- 172.21.15.59:0/4154901902 learned_addr learned my addr 172.21.15.59:0/4154901902 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62c9560700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c4134260 0x7f62c41304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47982/0 (socket says 172.21.15.59:47982) 2023-09-30T22:31:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62c8d5f700 1 -- 172.21.15.59:0/4154901902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c4134260 msgr2=0x7f62c41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62c8d5f700 1 --2- 172.21.15.59:0/4154901902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c4134260 0x7f62c41304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62c8d5f700 1 -- 172.21.15.59:0/4154901902 >> v2:172.21.15.59:3300/0 conn(0x7f62c4133e30 msgr2=0x7f62c412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62c8d5f700 1 --2- 172.21.15.59:0/4154901902 >> v2:172.21.15.59:3300/0 conn(0x7f62c4133e30 0x7f62c412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62c8d5f700 1 -- 172.21.15.59:0/4154901902 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40a0030 con 0x7f62c4133420 2023-09-30T22:31:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62c9560700 1 --2- 172.21.15.59:0/4154901902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c4134260 0x7f62c41304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.743+0000 7f62c3fff700 1 --2- 172.21.15.59:0/4154901902 >> v2:172.21.15.59:3300/0 conn(0x7f62c4133e30 0x7f62c412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.744+0000 7f62c8d5f700 1 --2- 172.21.15.59:0/4154901902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c4133420 0x7f62c41337f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f62b40098f0 tx=0x7f62b4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bc9da80d32a910a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.744+0000 7f62c37fe700 1 -- 172.21.15.59:0/4154901902 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4011830 con 0x7f62c4133420 2023-09-30T22:31:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.744+0000 7f62c37fe700 1 -- 172.21.15.59:0/4154901902 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b4011990 con 0x7f62c4133420 2023-09-30T22:31:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.744+0000 7f62c37fe700 1 -- 172.21.15.59:0/4154901902 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4011d20 con 0x7f62c4133420 2023-09-30T22:31:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.744+0000 7f62cafc3700 1 -- 172.21.15.59:0/4154901902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c4133420 msgr2=0x7f62c41337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.744+0000 7f62cafc3700 1 --2- 172.21.15.59:0/4154901902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c4133420 0x7f62c41337f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f62b40098f0 tx=0x7f62b4009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.744+0000 7f62cafc3700 1 -- 172.21.15.59:0/4154901902 shutdown_connections 2023-09-30T22:31:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.744+0000 7f62cafc3700 1 --2- 172.21.15.59:0/4154901902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c4134260 0x7f62c41304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.744+0000 7f62cafc3700 1 --2- 172.21.15.59:0/4154901902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c4133420 0x7f62c41337f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.744+0000 7f62cafc3700 1 --2- 172.21.15.59:0/4154901902 >> v2:172.21.15.59:3300/0 conn(0x7f62c4133e30 0x7f62c412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.744+0000 7f62cafc3700 1 -- 172.21.15.59:0/4154901902 >> 172.21.15.59:0/4154901902 conn(0x7f62c40a4210 msgr2=0x7f62c40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.745+0000 7f62cafc3700 1 -- 172.21.15.59:0/4154901902 shutdown_connections 2023-09-30T22:31:08.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.745+0000 7f62cafc3700 1 -- 172.21.15.59:0/4154901902 wait complete. 2023-09-30T22:31:08.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.746+0000 7f62cafc3700 1 Processor -- start 2023-09-30T22:31:08.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.746+0000 7f62cafc3700 1 -- start start 2023-09-30T22:31:08.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62cafc3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c4133420 0x7f62c409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62cafc3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c4133e30 0x7f62c409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62cafc3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62c4134260 0x7f62c409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62cafc3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c412dca0 con 0x7f62c4134260 2023-09-30T22:31:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62cafc3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c412d280 con 0x7f62c4133e30 2023-09-30T22:31:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62cafc3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62c409dfa0 con 0x7f62c4133420 2023-09-30T22:31:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62c8d5f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c4133420 0x7f62c409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62c9560700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62c4134260 0x7f62c409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62c8d5f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c4133420 0x7f62c409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35134/0 (socket says 172.21.15.59:35134) 2023-09-30T22:31:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62c8d5f700 1 -- 172.21.15.59:0/2180525995 learned_addr learned my addr 172.21.15.59:0/2180525995 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62c3fff700 1 --2- 172.21.15.59:0/2180525995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c4133e30 0x7f62c409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62c8d5f700 1 -- 172.21.15.59:0/2180525995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c4133e30 msgr2=0x7f62c409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62c8d5f700 1 --2- 172.21.15.59:0/2180525995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c4133e30 0x7f62c409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62c8d5f700 1 -- 172.21.15.59:0/2180525995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62c4134260 msgr2=0x7f62c409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62c8d5f700 1 --2- 172.21.15.59:0/2180525995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62c4134260 0x7f62c409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62c8d5f700 1 -- 172.21.15.59:0/2180525995 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac0094a0 con 0x7f62c4133420 2023-09-30T22:31:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.747+0000 7f62c9560700 1 --2- 172.21.15.59:0/2180525995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62c4134260 0x7f62c409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:08.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.748+0000 7f62c8d5f700 1 --2- 172.21.15.59:0/2180525995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c4133420 0x7f62c409c480 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009c40 tx=0x7f62b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:08.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.748+0000 7f62c17fa700 1 -- 172.21.15.59:0/2180525995 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4004450 con 0x7f62c4133420 2023-09-30T22:31:08.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.748+0000 7f62c17fa700 1 -- 172.21.15.59:0/2180525995 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b40045b0 con 0x7f62c4133420 2023-09-30T22:31:08.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.748+0000 7f62cafc3700 1 -- 172.21.15.59:0/2180525995 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62bc009a70 con 0x7f62c4133420 2023-09-30T22:31:08.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.748+0000 7f62c17fa700 1 -- 172.21.15.59:0/2180525995 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b40038c0 con 0x7f62c4133420 2023-09-30T22:31:08.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.748+0000 7f62cafc3700 1 -- 172.21.15.59:0/2180525995 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b4009550 con 0x7f62c4133420 2023-09-30T22:31:08.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.748+0000 7f62c17fa700 1 -- 172.21.15.59:0/2180525995 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62b4021070 con 0x7f62c4133420 2023-09-30T22:31:08.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.749+0000 7f62c17fa700 1 -- 172.21.15.59:0/2180525995 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f62b4040930 con 0x7f62c4133420 2023-09-30T22:31:08.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.749+0000 7f62cafc3700 1 -- 172.21.15.59:0/2180525995 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c4131520 con 0x7f62c4133420 2023-09-30T22:31:08.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.754+0000 7f62c17fa700 1 -- 172.21.15.59:0/2180525995 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62b4015080 con 0x7f62c4133420 2023-09-30T22:31:08.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.957+0000 7f62cafc3700 1 -- 172.21.15.59:0/2180525995 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f62c4074ea0 con 0x7f62c4133420 2023-09-30T22:31:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.957+0000 7f62c17fa700 1 -- 172.21.15.59:0/2180525995 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62b4029020 con 0x7f62c4133420 2023-09-30T22:31:08.959 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.959+0000 7f62cafc3700 1 -- 172.21.15.59:0/2180525995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c4133420 msgr2=0x7f62c409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.959+0000 7f62cafc3700 1 --2- 172.21.15.59:0/2180525995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c4133420 0x7f62c409c480 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009c40 tx=0x7f62b4004750 comp rx=0 tx=0).stop 2023-09-30T22:31:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.959+0000 7f62cafc3700 1 -- 172.21.15.59:0/2180525995 shutdown_connections 2023-09-30T22:31:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.959+0000 7f62cafc3700 1 --2- 172.21.15.59:0/2180525995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c4133420 0x7f62c409c480 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.959+0000 7f62cafc3700 1 --2- 172.21.15.59:0/2180525995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62c4134260 0x7f62c409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.959+0000 7f62cafc3700 1 --2- 172.21.15.59:0/2180525995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c4133e30 0x7f62c409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.959+0000 7f62cafc3700 1 -- 172.21.15.59:0/2180525995 >> 172.21.15.59:0/2180525995 conn(0x7f62c40a4210 msgr2=0x7f62c40a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.959+0000 7f62cafc3700 1 -- 172.21.15.59:0/2180525995 shutdown_connections 2023-09-30T22:31:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:08.959+0000 7f62cafc3700 1 -- 172.21.15.59:0/2180525995 wait complete. 2023-09-30T22:31:08.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:09.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:09.337 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:09.343 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:09.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.455+0000 7f3ec2058700 1 Processor -- start 2023-09-30T22:31:09.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.455+0000 7f3ec2058700 1 -- start start 2023-09-30T22:31:09.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3ec2058700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3ebc0a0a30 0x7f3ebc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3ec2058700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ebc0a1340 0x7f3ebc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3ec2058700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ebc133fa0 0x7f3ebc134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3ec2058700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ebc09edd0 con 0x7f3ebc0a0a30 2023-09-30T22:31:09.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3ec2058700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc09e1f0 con 0x7f3ebc0a1340 2023-09-30T22:31:09.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3ec2058700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc09dc50 con 0x7f3ebc133fa0 2023-09-30T22:31:09.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3eb2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ebc0a1340 0x7f3ebc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3eb2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ebc0a1340 0x7f3ebc133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48002/0 (socket says 172.21.15.59:48002) 2023-09-30T22:31:09.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3ebbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ebc133fa0 0x7f3ebc134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3eb2ffd700 1 -- 172.21.15.59:0/3282408606 learned_addr learned my addr 172.21.15.59:0/3282408606 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:09.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3ebb7fe700 1 --2- 172.21.15.59:0/3282408606 >> v2:172.21.15.59:3300/0 conn(0x7f3ebc0a0a30 0x7f3ebc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3eb2ffd700 1 -- 172.21.15.59:0/3282408606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ebc133fa0 msgr2=0x7f3ebc134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:09.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3eb2ffd700 1 --2- 172.21.15.59:0/3282408606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ebc133fa0 0x7f3ebc134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3eb2ffd700 1 -- 172.21.15.59:0/3282408606 >> v2:172.21.15.59:3300/0 conn(0x7f3ebc0a0a30 msgr2=0x7f3ebc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:09.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3eb2ffd700 1 --2- 172.21.15.59:0/3282408606 >> v2:172.21.15.59:3300/0 conn(0x7f3ebc0a0a30 0x7f3ebc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.456+0000 7f3eb2ffd700 1 -- 172.21.15.59:0/3282408606 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc0a1fe0 con 0x7f3ebc0a1340 2023-09-30T22:31:09.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.457+0000 7f3eb2ffd700 1 --2- 172.21.15.59:0/3282408606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ebc0a1340 0x7f3ebc133a60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009920 tx=0x7f3ea4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c107cb9dc975ca84 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:09.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.457+0000 7f3ebaffd700 1 -- 172.21.15.59:0/3282408606 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4011830 con 0x7f3ebc0a1340 2023-09-30T22:31:09.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.457+0000 7f3ebaffd700 1 -- 172.21.15.59:0/3282408606 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4011990 con 0x7f3ebc0a1340 2023-09-30T22:31:09.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.457+0000 7f3ebaffd700 1 -- 172.21.15.59:0/3282408606 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4011d20 con 0x7f3ebc0a1340 2023-09-30T22:31:09.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.458+0000 7f3ec2058700 1 -- 172.21.15.59:0/3282408606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ebc0a1340 msgr2=0x7f3ebc133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.458+0000 7f3ec2058700 1 --2- 172.21.15.59:0/3282408606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ebc0a1340 0x7f3ebc133a60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009920 tx=0x7f3ea4009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:09.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.458+0000 7f3ec2058700 1 -- 172.21.15.59:0/3282408606 shutdown_connections 2023-09-30T22:31:09.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.458+0000 7f3ec2058700 1 --2- 172.21.15.59:0/3282408606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ebc133fa0 0x7f3ebc134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.458+0000 7f3ec2058700 1 --2- 172.21.15.59:0/3282408606 >> v2:172.21.15.59:3300/0 conn(0x7f3ebc0a0a30 0x7f3ebc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.458+0000 7f3ec2058700 1 --2- 172.21.15.59:0/3282408606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ebc0a1340 0x7f3ebc133a60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.458+0000 7f3ec2058700 1 -- 172.21.15.59:0/3282408606 >> 172.21.15.59:0/3282408606 conn(0x7f3ebc0a6550 msgr2=0x7f3ebc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:09.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.458+0000 7f3ec2058700 1 -- 172.21.15.59:0/3282408606 shutdown_connections 2023-09-30T22:31:09.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.458+0000 7f3ec2058700 1 -- 172.21.15.59:0/3282408606 wait complete. 2023-09-30T22:31:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.459+0000 7f3ec2058700 1 Processor -- start 2023-09-30T22:31:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.459+0000 7f3ec2058700 1 -- start start 2023-09-30T22:31:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.459+0000 7f3ec2058700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ebc0a0a30 0x7f3ebc120160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.459+0000 7f3ec2058700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ebc0a1340 0x7f3ebc1206a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.459+0000 7f3ec2058700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ebc133fa0 0x7f3ebc120be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.459+0000 7f3ec2058700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc121d70 con 0x7f3ebc0a1340 2023-09-30T22:31:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.459+0000 7f3ec2058700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc122fc0 con 0x7f3ebc133fa0 2023-09-30T22:31:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.459+0000 7f3ec2058700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc122360 con 0x7f3ebc0a0a30 2023-09-30T22:31:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.460+0000 7f3ebb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ebc0a0a30 0x7f3ebc120160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.460+0000 7f3ebb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ebc0a0a30 0x7f3ebc120160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35160/0 (socket says 172.21.15.59:35160) 2023-09-30T22:31:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.460+0000 7f3ebb7fe700 1 -- 172.21.15.59:0/1720497828 learned_addr learned my addr 172.21.15.59:0/1720497828 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.460+0000 7f3eb2ffd700 1 --2- 172.21.15.59:0/1720497828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ebc0a1340 0x7f3ebc1206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.460+0000 7f3ebbfff700 1 --2- 172.21.15.59:0/1720497828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ebc133fa0 0x7f3ebc120be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.460+0000 7f3ebb7fe700 1 -- 172.21.15.59:0/1720497828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ebc133fa0 msgr2=0x7f3ebc120be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.460+0000 7f3ebb7fe700 1 --2- 172.21.15.59:0/1720497828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ebc133fa0 0x7f3ebc120be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.460+0000 7f3ebb7fe700 1 -- 172.21.15.59:0/1720497828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ebc0a1340 msgr2=0x7f3ebc1206a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.460+0000 7f3ebb7fe700 1 --2- 172.21.15.59:0/1720497828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ebc0a1340 0x7f3ebc1206a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.460+0000 7f3ebb7fe700 1 -- 172.21.15.59:0/1720497828 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea4009550 con 0x7f3ebc0a0a30 2023-09-30T22:31:09.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.460+0000 7f3eb2ffd700 1 --2- 172.21.15.59:0/1720497828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ebc0a1340 0x7f3ebc1206a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:09.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.460+0000 7f3ebb7fe700 1 --2- 172.21.15.59:0/1720497828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ebc0a0a30 0x7f3ebc120160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00e9e0 tx=0x7f3eac00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:09.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.460+0000 7f3eb8ff9700 1 -- 172.21.15.59:0/1720497828 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac009710 con 0x7f3ebc0a0a30 2023-09-30T22:31:09.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.461+0000 7f3eb8ff9700 1 -- 172.21.15.59:0/1720497828 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac00ee80 con 0x7f3ebc0a0a30 2023-09-30T22:31:09.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.461+0000 7f3ec2058700 1 -- 172.21.15.59:0/1720497828 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ebc123410 con 0x7f3ebc0a0a30 2023-09-30T22:31:09.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.461+0000 7f3eb8ff9700 1 -- 172.21.15.59:0/1720497828 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac00ca50 con 0x7f3ebc0a0a30 2023-09-30T22:31:09.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.461+0000 7f3ec2058700 1 -- 172.21.15.59:0/1720497828 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ebc0a3710 con 0x7f3ebc0a0a30 2023-09-30T22:31:09.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.462+0000 7f3eb8ff9700 1 -- 172.21.15.59:0/1720497828 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3eac00cbb0 con 0x7f3ebc0a0a30 2023-09-30T22:31:09.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.462+0000 7f3ec2058700 1 -- 172.21.15.59:0/1720497828 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ebc074ea0 con 0x7f3ebc0a0a30 2023-09-30T22:31:09.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.462+0000 7f3eb8ff9700 1 -- 172.21.15.59:0/1720497828 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3eac03fab0 con 0x7f3ebc0a0a30 2023-09-30T22:31:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.471+0000 7f3eb8ff9700 1 -- 172.21.15.59:0/1720497828 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3eac01b3b0 con 0x7f3ebc0a0a30 2023-09-30T22:31:09.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.494+0000 7ff04687d700 1 Processor -- start 2023-09-30T22:31:09.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.494+0000 7ff04687d700 1 -- start start 2023-09-30T22:31:09.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff04687d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff040133420 0x7ff0401337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff04687d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff040133e30 0x7ff04012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff04687d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff040134260 0x7ff0401304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff04687d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04006b990 con 0x7ff040133420 2023-09-30T22:31:09.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff04687d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0400a0590 con 0x7ff040134260 2023-09-30T22:31:09.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff04687d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff04009fb80 con 0x7ff040133e30 2023-09-30T22:31:09.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff03f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff040133e30 0x7ff04012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff03f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff040133e30 0x7ff04012ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35168/0 (socket says 172.21.15.59:35168) 2023-09-30T22:31:09.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff03f7fe700 1 -- 172.21.15.59:0/2786414805 learned_addr learned my addr 172.21.15.59:0/2786414805 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:09.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff044e1a700 1 --2- 172.21.15.59:0/2786414805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff040134260 0x7ff0401304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff03ffff700 1 --2- 172.21.15.59:0/2786414805 >> v2:172.21.15.59:3300/0 conn(0x7ff040133420 0x7ff0401337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff03f7fe700 1 -- 172.21.15.59:0/2786414805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff040134260 msgr2=0x7ff0401304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:09.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff03f7fe700 1 --2- 172.21.15.59:0/2786414805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff040134260 0x7ff0401304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff03f7fe700 1 -- 172.21.15.59:0/2786414805 >> v2:172.21.15.59:3300/0 conn(0x7ff040133420 msgr2=0x7ff0401337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:09.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff03f7fe700 1 --2- 172.21.15.59:0/2786414805 >> v2:172.21.15.59:3300/0 conn(0x7ff040133420 0x7ff0401337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff03f7fe700 1 -- 172.21.15.59:0/2786414805 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0400a0030 con 0x7ff040133e30 2023-09-30T22:31:09.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff044e1a700 1 --2- 172.21.15.59:0/2786414805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff040134260 0x7ff0401304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:09.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.495+0000 7ff03ffff700 1 --2- 172.21.15.59:0/2786414805 >> v2:172.21.15.59:3300/0 conn(0x7ff040133420 0x7ff0401337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:09.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.496+0000 7ff03f7fe700 1 --2- 172.21.15.59:0/2786414805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff040133e30 0x7ff04012ff90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff0340098f0 tx=0x7ff034009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bf9d80c0fc84e78 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:09.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.496+0000 7ff03effd700 1 -- 172.21.15.59:0/2786414805 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034011830 con 0x7ff040133e30 2023-09-30T22:31:09.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.496+0000 7ff03effd700 1 -- 172.21.15.59:0/2786414805 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff034011990 con 0x7ff040133e30 2023-09-30T22:31:09.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.496+0000 7ff03effd700 1 -- 172.21.15.59:0/2786414805 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034011d20 con 0x7ff040133e30 2023-09-30T22:31:09.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.496+0000 7ff04687d700 1 -- 172.21.15.59:0/2786414805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff040133e30 msgr2=0x7ff04012ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.496+0000 7ff04687d700 1 --2- 172.21.15.59:0/2786414805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff040133e30 0x7ff04012ff90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff0340098f0 tx=0x7ff034009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:09.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.497+0000 7ff04687d700 1 -- 172.21.15.59:0/2786414805 shutdown_connections 2023-09-30T22:31:09.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.497+0000 7ff04687d700 1 --2- 172.21.15.59:0/2786414805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff040134260 0x7ff0401304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.497+0000 7ff04687d700 1 --2- 172.21.15.59:0/2786414805 >> v2:172.21.15.59:3300/0 conn(0x7ff040133420 0x7ff0401337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.497+0000 7ff04687d700 1 --2- 172.21.15.59:0/2786414805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff040133e30 0x7ff04012ff90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.497+0000 7ff04687d700 1 -- 172.21.15.59:0/2786414805 >> 172.21.15.59:0/2786414805 conn(0x7ff0400a4210 msgr2=0x7ff0400a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:09.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.497+0000 7ff04687d700 1 -- 172.21.15.59:0/2786414805 shutdown_connections 2023-09-30T22:31:09.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.497+0000 7ff04687d700 1 -- 172.21.15.59:0/2786414805 wait complete. 2023-09-30T22:31:09.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.498+0000 7fb838878700 1 Processor -- start 2023-09-30T22:31:09.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.498+0000 7ff04687d700 1 Processor -- start 2023-09-30T22:31:09.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.498+0000 7fb838878700 1 -- start start 2023-09-30T22:31:09.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.498+0000 7ff04687d700 1 -- start start 2023-09-30T22:31:09.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7fb838878700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb834130540 0x7fb834130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7fb838878700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb834130e50 0x7fb83406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7fb838878700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8340716a0 con 0x7fb83406fb20 2023-09-30T22:31:09.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7fb838878700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb83409a390 con 0x7fb834130540 2023-09-30T22:31:09.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7fb838878700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb834071290 con 0x7fb834130e50 2023-09-30T22:31:09.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7fb831d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb834130e50 0x7fb83406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7fb83259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb834130540 0x7fb834130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7fb83259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb834130540 0x7fb834130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36596/0 (socket says 172.21.15.59:36596) 2023-09-30T22:31:09.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7fb831d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb834130e50 0x7fb83406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35180/0 (socket says 172.21.15.59:35180) 2023-09-30T22:31:09.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7fb83259c700 1 -- 172.21.15.59:0/1642568928 learned_addr learned my addr 172.21.15.59:0/1642568928 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:09.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7ff04687d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff040133420 0x7ff04009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7ff04687d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040133e30 0x7ff04009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7ff04687d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff040134260 0x7ff04009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7ff04687d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04011ff20 con 0x7ff040133e30 2023-09-30T22:31:09.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7ff04687d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04009dd20 con 0x7ff040134260 2023-09-30T22:31:09.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7ff04687d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff040120170 con 0x7ff040133420 2023-09-30T22:31:09.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7ff03f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040133e30 0x7ff04009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7ff03f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040133e30 0x7ff04009c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36606/0 (socket says 172.21.15.59:36606) 2023-09-30T22:31:09.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.499+0000 7ff03f7fe700 1 -- 172.21.15.59:0/4273116731 learned_addr learned my addr 172.21.15.59:0/4273116731 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:09.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7fb831d9b700 1 -- 172.21.15.59:0/1642568928 >> v2:172.21.15.59:3300/0 conn(0x7fb834130540 msgr2=0x7fb834130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:09.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7fb831d9b700 1 --2- 172.21.15.59:0/1642568928 >> v2:172.21.15.59:3300/0 conn(0x7fb834130540 0x7fb834130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7fb831d9b700 1 -- 172.21.15.59:0/1642568928 >> v1:172.21.15.59:6789/0 conn(0x7fb83406fb20 legacy=0x7fb834137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7fb831d9b700 1 -- 172.21.15.59:0/1642568928 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb834130340 con 0x7fb834130e50 2023-09-30T22:31:09.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7ff03f7fe700 1 -- 172.21.15.59:0/4273116731 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff040133420 msgr2=0x7ff04009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7ff03ffff700 1 --2- 172.21.15.59:0/4273116731 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff040133420 0x7ff04009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7fb831d9b700 1 --2- 172.21.15.59:0/1642568928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb834130e50 0x7fb83406f5e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb828009870 tx=0x7fb828009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0ddc8b11dd25f5e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:09.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7ff03f7fe700 1 --2- 172.21.15.59:0/4273116731 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff040133420 0x7ff04009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7ff03f7fe700 1 -- 172.21.15.59:0/4273116731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff040134260 msgr2=0x7ff04009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7ff03f7fe700 1 --2- 172.21.15.59:0/4273116731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff040134260 0x7ff04009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7ff03f7fe700 1 -- 172.21.15.59:0/4273116731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300094a0 con 0x7ff040133e30 2023-09-30T22:31:09.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7ff03ffff700 1 --2- 172.21.15.59:0/4273116731 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff040133420 0x7ff04009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:09.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7ff03f7fe700 1 --2- 172.21.15.59:0/4273116731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040133e30 0x7ff04009c9c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff034000c00 tx=0x7ff034004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:09.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7fb83159a700 1 -- 172.21.15.59:0/1642568928 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828011830 con 0x7fb834130e50 2023-09-30T22:31:09.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7fb83159a700 1 -- 172.21.15.59:0/1642568928 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb828011990 con 0x7fb834130e50 2023-09-30T22:31:09.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7fb83159a700 1 -- 172.21.15.59:0/1642568928 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828011d20 con 0x7fb834130e50 2023-09-30T22:31:09.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7ff03cff9700 1 -- 172.21.15.59:0/4273116731 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034004300 con 0x7ff040133e30 2023-09-30T22:31:09.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7ff03cff9700 1 -- 172.21.15.59:0/4273116731 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03401f070 con 0x7ff040133e30 2023-09-30T22:31:09.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7ff03cff9700 1 -- 172.21.15.59:0/4273116731 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0340036a0 con 0x7ff040133e30 2023-09-30T22:31:09.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.500+0000 7ff04687d700 1 -- 172.21.15.59:0/4273116731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff038009a70 con 0x7ff040133e30 2023-09-30T22:31:09.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.501+0000 7ff04687d700 1 -- 172.21.15.59:0/4273116731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff034009550 con 0x7ff040133e30 2023-09-30T22:31:09.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.501+0000 7fb838878700 1 -- 172.21.15.59:0/1642568928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb834130e50 msgr2=0x7fb83406f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.501+0000 7fb838878700 1 --2- 172.21.15.59:0/1642568928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb834130e50 0x7fb83406f5e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb828009870 tx=0x7fb828009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:09.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.501+0000 7fb838878700 1 -- 172.21.15.59:0/1642568928 shutdown_connections 2023-09-30T22:31:09.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.501+0000 7fb838878700 1 --2- 172.21.15.59:0/1642568928 >> v2:172.21.15.59:3300/0 conn(0x7fb834130540 0x7fb834130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.501+0000 7fb838878700 1 --2- 172.21.15.59:0/1642568928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb834130e50 0x7fb83406f5e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.501+0000 7fb838878700 1 -- 172.21.15.59:0/1642568928 >> 172.21.15.59:0/1642568928 conn(0x7fb8340a2aa0 msgr2=0x7fb8340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:09.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.502+0000 7ff03cff9700 1 -- 172.21.15.59:0/4273116731 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff034021030 con 0x7ff040133e30 2023-09-30T22:31:09.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.502+0000 7fb838878700 1 -- 172.21.15.59:0/1642568928 shutdown_connections 2023-09-30T22:31:09.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.502+0000 7ff04687d700 1 -- 172.21.15.59:0/4273116731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff040074ea0 con 0x7ff040133e30 2023-09-30T22:31:09.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.502+0000 7fb838878700 1 -- 172.21.15.59:0/1642568928 wait complete. 2023-09-30T22:31:09.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.502+0000 7ff03cff9700 1 -- 172.21.15.59:0/4273116731 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff0340407a0 con 0x7ff040133e30 2023-09-30T22:31:09.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.503+0000 7fb838878700 1 Processor -- start 2023-09-30T22:31:09.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.503+0000 7fb838878700 1 -- start start 2023-09-30T22:31:09.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.503+0000 7fb838878700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83406fb20 0x7fb83411b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.503+0000 7fb838878700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb834130540 0x7fb83411bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.503+0000 7fb838878700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb834130e50 0x7fb83411c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb838878700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340a0bf0 con 0x7fb834130e50 2023-09-30T22:31:09.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb838878700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83411eb20 con 0x7fb834130540 2023-09-30T22:31:09.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb838878700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb83411d2c0 con 0x7fb83406fb20 2023-09-30T22:31:09.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb831d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb834130540 0x7fb83411bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb832d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb834130e50 0x7fb83411c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb831d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb834130540 0x7fb83411bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48050/0 (socket says 172.21.15.59:48050) 2023-09-30T22:31:09.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb831d9b700 1 -- 172.21.15.59:0/2229345157 learned_addr learned my addr 172.21.15.59:0/2229345157 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:09.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb831d9b700 1 -- 172.21.15.59:0/2229345157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83406fb20 msgr2=0x7fb83411b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb831d9b700 1 --2- 172.21.15.59:0/2229345157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83406fb20 0x7fb83411b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb831d9b700 1 -- 172.21.15.59:0/2229345157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb834130e50 msgr2=0x7fb83411c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb831d9b700 1 --2- 172.21.15.59:0/2229345157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb834130e50 0x7fb83411c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb831d9b700 1 -- 172.21.15.59:0/2229345157 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8280094a0 con 0x7fb834130540 2023-09-30T22:31:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb832d9d700 1 --2- 172.21.15.59:0/2229345157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb834130e50 0x7fb83411c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb831d9b700 1 --2- 172.21.15.59:0/2229345157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb834130540 0x7fb83411bc90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb8280097c0 tx=0x7fb828004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb822ffd700 1 -- 172.21.15.59:0/2229345157 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828004590 con 0x7fb834130540 2023-09-30T22:31:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb822ffd700 1 -- 172.21.15.59:0/2229345157 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8280036a0 con 0x7fb834130540 2023-09-30T22:31:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb822ffd700 1 -- 172.21.15.59:0/2229345157 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828003a10 con 0x7fb834130540 2023-09-30T22:31:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.504+0000 7fb838878700 1 -- 172.21.15.59:0/2229345157 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8340718e0 con 0x7fb834130540 2023-09-30T22:31:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.505+0000 7fb838878700 1 -- 172.21.15.59:0/2229345157 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83411dfb0 con 0x7fb834130540 2023-09-30T22:31:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.505+0000 7fb822ffd700 1 -- 172.21.15.59:0/2229345157 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb828003b70 con 0x7fb834130540 2023-09-30T22:31:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.505+0000 7fb822ffd700 1 -- 172.21.15.59:0/2229345157 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb8280402d0 con 0x7fb834130540 2023-09-30T22:31:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.506+0000 7fb838878700 1 -- 172.21.15.59:0/2229345157 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83409dd40 con 0x7fb834130540 2023-09-30T22:31:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.507+0000 7ff03cff9700 1 -- 172.21.15.59:0/4273116731 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0340199a0 con 0x7ff040133e30 2023-09-30T22:31:09.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.515+0000 7fb822ffd700 1 -- 172.21.15.59:0/2229345157 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb82800b950 con 0x7fb834130540 2023-09-30T22:31:09.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.684+0000 7f3ec2058700 1 -- 172.21.15.59:0/1720497828 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3ebc0a28e0 con 0x7f3ebc0a0a30 2023-09-30T22:31:09.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.685+0000 7f3eb8ff9700 1 -- 172.21.15.59:0/1720497828 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3eac021030 con 0x7f3ebc0a0a30 2023-09-30T22:31:09.686 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:09.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.687+0000 7f3ec2058700 1 -- 172.21.15.59:0/1720497828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ebc0a0a30 msgr2=0x7f3ebc120160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.687+0000 7f3ec2058700 1 --2- 172.21.15.59:0/1720497828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ebc0a0a30 0x7f3ebc120160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00e9e0 tx=0x7f3eac00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.687+0000 7f3ec2058700 1 -- 172.21.15.59:0/1720497828 shutdown_connections 2023-09-30T22:31:09.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.687+0000 7f3ec2058700 1 --2- 172.21.15.59:0/1720497828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ebc0a0a30 0x7f3ebc120160 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.687+0000 7f3ec2058700 1 --2- 172.21.15.59:0/1720497828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ebc133fa0 0x7f3ebc120be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.687+0000 7f3ec2058700 1 --2- 172.21.15.59:0/1720497828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ebc0a1340 0x7f3ebc1206a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.687+0000 7f3ec2058700 1 -- 172.21.15.59:0/1720497828 >> 172.21.15.59:0/1720497828 conn(0x7f3ebc0a6550 msgr2=0x7f3ebc1ba800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:09.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.687+0000 7f3ec2058700 1 -- 172.21.15.59:0/1720497828 shutdown_connections 2023-09-30T22:31:09.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.687+0000 7f3ec2058700 1 -- 172.21.15.59:0/1720497828 wait complete. 2023-09-30T22:31:09.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:09.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.715+0000 7ff04687d700 1 -- 172.21.15.59:0/4273116731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff04006b250 con 0x7ff040133e30 2023-09-30T22:31:09.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.715+0000 7ff03cff9700 1 -- 172.21.15.59:0/4273116731 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff034015030 con 0x7ff040133e30 2023-09-30T22:31:09.717 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:09.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.718+0000 7ff04687d700 1 -- 172.21.15.59:0/4273116731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040133e30 msgr2=0x7ff04009c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.718+0000 7ff04687d700 1 --2- 172.21.15.59:0/4273116731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040133e30 0x7ff04009c9c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff034000c00 tx=0x7ff034004750 comp rx=0 tx=0).stop 2023-09-30T22:31:09.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.718+0000 7ff04687d700 1 -- 172.21.15.59:0/4273116731 shutdown_connections 2023-09-30T22:31:09.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.718+0000 7ff04687d700 1 --2- 172.21.15.59:0/4273116731 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff040133420 0x7ff04009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.718+0000 7ff04687d700 1 --2- 172.21.15.59:0/4273116731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff040134260 0x7ff04009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.718+0000 7ff04687d700 1 --2- 172.21.15.59:0/4273116731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040133e30 0x7ff04009c9c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.718+0000 7ff04687d700 1 -- 172.21.15.59:0/4273116731 >> 172.21.15.59:0/4273116731 conn(0x7ff0400a4210 msgr2=0x7ff0401302c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:09.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.718+0000 7ff04687d700 1 -- 172.21.15.59:0/4273116731 shutdown_connections 2023-09-30T22:31:09.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.718+0000 7ff04687d700 1 -- 172.21.15.59:0/4273116731 wait complete. 2023-09-30T22:31:09.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.725+0000 7fb838878700 1 -- 172.21.15.59:0/2229345157 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb834074ea0 con 0x7fb834130540 2023-09-30T22:31:09.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.725+0000 7fb822ffd700 1 -- 172.21.15.59:0/2229345157 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb828028090 con 0x7fb834130540 2023-09-30T22:31:09.726 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:09.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.728+0000 7fb838878700 1 -- 172.21.15.59:0/2229345157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb834130540 msgr2=0x7fb83411bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.728+0000 7fb838878700 1 --2- 172.21.15.59:0/2229345157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb834130540 0x7fb83411bc90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb8280097c0 tx=0x7fb828004750 comp rx=0 tx=0).stop 2023-09-30T22:31:09.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.728+0000 7fb838878700 1 -- 172.21.15.59:0/2229345157 shutdown_connections 2023-09-30T22:31:09.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.728+0000 7fb838878700 1 --2- 172.21.15.59:0/2229345157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb83406fb20 0x7fb83411b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.728+0000 7fb838878700 1 --2- 172.21.15.59:0/2229345157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb834130e50 0x7fb83411c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.728+0000 7fb838878700 1 --2- 172.21.15.59:0/2229345157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb834130540 0x7fb83411bc90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.728+0000 7fb838878700 1 -- 172.21.15.59:0/2229345157 >> 172.21.15.59:0/2229345157 conn(0x7fb8340a2aa0 msgr2=0x7fb83412faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:09.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.728+0000 7fb838878700 1 -- 172.21.15.59:0/2229345157 shutdown_connections 2023-09-30T22:31:09.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:09.728+0000 7fb838878700 1 -- 172.21.15.59:0/2229345157 wait complete. 2023-09-30T22:31:09.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:09.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:09.975 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:10.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.120+0000 7ffb1dab9700 1 Processor -- start 2023-09-30T22:31:10.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.120+0000 7ffb1dab9700 1 -- start start 2023-09-30T22:31:10.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.120+0000 7ffb1dab9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb181337f0 0x7ffb18138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.120+0000 7ffb1dab9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb18138dc0 0x7ffb1813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.120+0000 7ffb1dab9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1806b990 con 0x7ffb18133420 2023-09-30T22:31:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.120+0000 7ffb1dab9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1809b0e0 con 0x7ffb18138dc0 2023-09-30T22:31:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.120+0000 7ffb1dab9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18133c20 con 0x7ffb181337f0 2023-09-30T22:31:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.120+0000 7ffb17fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb18138dc0 0x7ffb1813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.120+0000 7ffb16ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb181337f0 0x7ffb18138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.120+0000 7ffb17fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb18138dc0 0x7ffb1813b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36622/0 (socket says 172.21.15.59:36622) 2023-09-30T22:31:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.120+0000 7ffb16ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb181337f0 0x7ffb18138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35216/0 (socket says 172.21.15.59:35216) 2023-09-30T22:31:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.120+0000 7ffb17fff700 1 -- 172.21.15.59:0/865964588 learned_addr learned my addr 172.21.15.59:0/865964588 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.121+0000 7ffb16ffd700 1 -- 172.21.15.59:0/865964588 >> v2:172.21.15.59:3300/0 conn(0x7ffb18138dc0 msgr2=0x7ffb1813b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.121+0000 7ffb16ffd700 1 --2- 172.21.15.59:0/865964588 >> v2:172.21.15.59:3300/0 conn(0x7ffb18138dc0 0x7ffb1813b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.121+0000 7ffb16ffd700 1 -- 172.21.15.59:0/865964588 >> v1:172.21.15.59:6789/0 conn(0x7ffb18133420 legacy=0x7ffb18133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.121+0000 7ffb16ffd700 1 -- 172.21.15.59:0/865964588 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb180a0590 con 0x7ffb181337f0 2023-09-30T22:31:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.121+0000 7ffb17fff700 1 --2- 172.21.15.59:0/865964588 >> v2:172.21.15.59:3300/0 conn(0x7ffb18138dc0 0x7ffb1813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.121+0000 7ffb16ffd700 1 --2- 172.21.15.59:0/865964588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb181337f0 0x7ffb18138880 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009840 tx=0x7ffb0c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b0ab1af0a05b00a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.121+0000 7ffb167fc700 1 -- 172.21.15.59:0/865964588 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c011830 con 0x7ffb181337f0 2023-09-30T22:31:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.121+0000 7ffb167fc700 1 -- 172.21.15.59:0/865964588 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0c011990 con 0x7ffb181337f0 2023-09-30T22:31:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.121+0000 7ffb167fc700 1 -- 172.21.15.59:0/865964588 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c011d20 con 0x7ffb181337f0 2023-09-30T22:31:10.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.122+0000 7ffb1dab9700 1 -- 172.21.15.59:0/865964588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb181337f0 msgr2=0x7ffb18138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.122+0000 7ffb1dab9700 1 --2- 172.21.15.59:0/865964588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb181337f0 0x7ffb18138880 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009840 tx=0x7ffb0c009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.122+0000 7ffb1dab9700 1 -- 172.21.15.59:0/865964588 shutdown_connections 2023-09-30T22:31:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.122+0000 7ffb1dab9700 1 --2- 172.21.15.59:0/865964588 >> v2:172.21.15.59:3300/0 conn(0x7ffb18138dc0 0x7ffb1813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.122+0000 7ffb1dab9700 1 --2- 172.21.15.59:0/865964588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb181337f0 0x7ffb18138880 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.122+0000 7ffb1dab9700 1 -- 172.21.15.59:0/865964588 >> 172.21.15.59:0/865964588 conn(0x7ffb180a4210 msgr2=0x7ffb180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.122+0000 7ffb1dab9700 1 -- 172.21.15.59:0/865964588 shutdown_connections 2023-09-30T22:31:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.122+0000 7ffb1dab9700 1 -- 172.21.15.59:0/865964588 wait complete. 2023-09-30T22:31:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.123+0000 7ffb1dab9700 1 Processor -- start 2023-09-30T22:31:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.123+0000 7ffb1dab9700 1 -- start start 2023-09-30T22:31:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.123+0000 7ffb1dab9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb18133420 0x7ffb180709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.123+0000 7ffb1dab9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb181337f0 0x7ffb18070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.123+0000 7ffb1dab9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb18138dc0 0x7ffb18071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.123+0000 7ffb1dab9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1809ca90 con 0x7ffb18138dc0 2023-09-30T22:31:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.123+0000 7ffb1dab9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1809d640 con 0x7ffb18133420 2023-09-30T22:31:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.123+0000 7ffb1dab9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1809c7d0 con 0x7ffb181337f0 2023-09-30T22:31:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb17fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb18138dc0 0x7ffb18071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb16ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb181337f0 0x7ffb18070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb177fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb18133420 0x7ffb180709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb16ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb181337f0 0x7ffb18070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35230/0 (socket says 172.21.15.59:35230) 2023-09-30T22:31:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb16ffd700 1 -- 172.21.15.59:0/2129438926 learned_addr learned my addr 172.21.15.59:0/2129438926 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb177fe700 1 --2- 172.21.15.59:0/2129438926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb18133420 0x7ffb180709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48052/0 (socket says 172.21.15.59:48052) 2023-09-30T22:31:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb17fff700 1 --2- 172.21.15.59:0/2129438926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb18138dc0 0x7ffb18071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36630/0 (socket says 172.21.15.59:36630) 2023-09-30T22:31:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb16ffd700 1 -- 172.21.15.59:0/2129438926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb18133420 msgr2=0x7ffb180709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb16ffd700 1 --2- 172.21.15.59:0/2129438926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb18133420 0x7ffb180709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb16ffd700 1 -- 172.21.15.59:0/2129438926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb18138dc0 msgr2=0x7ffb18071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb16ffd700 1 --2- 172.21.15.59:0/2129438926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb18138dc0 0x7ffb18071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb16ffd700 1 -- 172.21.15.59:0/2129438926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb10009b30 con 0x7ffb181337f0 2023-09-30T22:31:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb17fff700 1 --2- 172.21.15.59:0/2129438926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb18138dc0 0x7ffb18071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb177fe700 1 --2- 172.21.15.59:0/2129438926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb18133420 0x7ffb180709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb16ffd700 1 --2- 172.21.15.59:0/2129438926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb181337f0 0x7ffb18070ee0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009fd0 tx=0x7ffb0c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffafffff700 1 -- 172.21.15.59:0/2129438926 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c004400 con 0x7ffb181337f0 2023-09-30T22:31:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffafffff700 1 -- 172.21.15.59:0/2129438926 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0c01f070 con 0x7ffb181337f0 2023-09-30T22:31:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb1dab9700 1 -- 172.21.15.59:0/2129438926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c0094a0 con 0x7ffb181337f0 2023-09-30T22:31:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffafffff700 1 -- 172.21.15.59:0/2129438926 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0038e0 con 0x7ffb181337f0 2023-09-30T22:31:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.124+0000 7ffb1dab9700 1 -- 172.21.15.59:0/2129438926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb180724f0 con 0x7ffb181337f0 2023-09-30T22:31:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.125+0000 7ffafffff700 1 -- 172.21.15.59:0/2129438926 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb0c021030 con 0x7ffb181337f0 2023-09-30T22:31:10.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.125+0000 7ffafffff700 1 -- 172.21.15.59:0/2129438926 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffb0c040790 con 0x7ffb181337f0 2023-09-30T22:31:10.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.126+0000 7ffb1dab9700 1 -- 172.21.15.59:0/2129438926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1809cbe0 con 0x7ffb181337f0 2023-09-30T22:31:10.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.130+0000 7ffafffff700 1 -- 172.21.15.59:0/2129438926 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb0c0239a0 con 0x7ffb181337f0 2023-09-30T22:31:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.333+0000 7ffb1dab9700 1 -- 172.21.15.59:0/2129438926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb18074ea0 con 0x7ffb181337f0 2023-09-30T22:31:10.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.333+0000 7ffafffff700 1 -- 172.21.15.59:0/2129438926 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb0c015020 con 0x7ffb181337f0 2023-09-30T22:31:10.335 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.336+0000 7ffb1dab9700 1 -- 172.21.15.59:0/2129438926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb181337f0 msgr2=0x7ffb18070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.336+0000 7ffb1dab9700 1 --2- 172.21.15.59:0/2129438926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb181337f0 0x7ffb18070ee0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009fd0 tx=0x7ffb0c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.336+0000 7ffb1dab9700 1 -- 172.21.15.59:0/2129438926 shutdown_connections 2023-09-30T22:31:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.336+0000 7ffb1dab9700 1 --2- 172.21.15.59:0/2129438926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb18138dc0 0x7ffb18071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.336+0000 7ffb1dab9700 1 --2- 172.21.15.59:0/2129438926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb18133420 0x7ffb180709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.336+0000 7ffb1dab9700 1 --2- 172.21.15.59:0/2129438926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb181337f0 0x7ffb18070ee0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.336+0000 7ffb1dab9700 1 -- 172.21.15.59:0/2129438926 >> 172.21.15.59:0/2129438926 conn(0x7ffb180a4210 msgr2=0x7ffb18131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.336+0000 7ffb1dab9700 1 -- 172.21.15.59:0/2129438926 shutdown_connections 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.336+0000 7ffb1dab9700 1 -- 172.21.15.59:0/2129438926 wait complete. 2023-09-30T22:31:10.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:10.703 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:10.734 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:10.743 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:10.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.855+0000 7fdf716de700 1 Processor -- start 2023-09-30T22:31:10.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.855+0000 7fdf716de700 1 -- start start 2023-09-30T22:31:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.856+0000 7fdf716de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf6c09d6f0 0x7fdf6c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.856+0000 7fdf716de700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf6c09e410 0x7fdf6c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.856+0000 7fdf716de700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6c09b120 con 0x7fdf6c09e000 2023-09-30T22:31:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.856+0000 7fdf716de700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c06b460 con 0x7fdf6c09e410 2023-09-30T22:31:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.856+0000 7fdf716de700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c09a7e0 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.856+0000 7fdf6affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf6c09d6f0 0x7fdf6c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.856+0000 7fdf6a7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdf6c09e000 0x7fdf6c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58054/0 (socket says 172.21.15.59:58054) 2023-09-30T22:31:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.856+0000 7fdf6a7fc700 1 -- 172.21.15.59:0/2001946136 learned_addr learned my addr 172.21.15.59:0/2001946136 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.856+0000 7fdf6b7fe700 1 --2- 172.21.15.59:0/2001946136 >> v2:172.21.15.59:3300/0 conn(0x7fdf6c09e410 0x7fdf6c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.857+0000 7fdf6affd700 1 -- 172.21.15.59:0/2001946136 >> v2:172.21.15.59:3300/0 conn(0x7fdf6c09e410 msgr2=0x7fdf6c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:10.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.857+0000 7fdf6affd700 1 --2- 172.21.15.59:0/2001946136 >> v2:172.21.15.59:3300/0 conn(0x7fdf6c09e410 0x7fdf6c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.857+0000 7fdf6affd700 1 -- 172.21.15.59:0/2001946136 >> v1:172.21.15.59:6789/0 conn(0x7fdf6c09e000 legacy=0x7fdf6c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.857+0000 7fdf6affd700 1 -- 172.21.15.59:0/2001946136 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c09a500 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.857+0000 7fdf6affd700 1 --2- 172.21.15.59:0/2001946136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf6c09d6f0 0x7fdf6c09dac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009870 tx=0x7fdf5c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b1ddd123ec3d352 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.857+0000 7fdf69ffb700 1 -- 172.21.15.59:0/2001946136 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c011830 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.857+0000 7fdf69ffb700 1 -- 172.21.15.59:0/2001946136 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5c011990 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.857+0000 7fdf69ffb700 1 -- 172.21.15.59:0/2001946136 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c011d20 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.858+0000 7fdf716de700 1 -- 172.21.15.59:0/2001946136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf6c09d6f0 msgr2=0x7fdf6c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.858+0000 7fdf716de700 1 --2- 172.21.15.59:0/2001946136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf6c09d6f0 0x7fdf6c09dac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009870 tx=0x7fdf5c009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:10.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.858+0000 7fdf716de700 1 -- 172.21.15.59:0/2001946136 shutdown_connections 2023-09-30T22:31:10.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.858+0000 7fdf716de700 1 --2- 172.21.15.59:0/2001946136 >> v2:172.21.15.59:3300/0 conn(0x7fdf6c09e410 0x7fdf6c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.858+0000 7fdf716de700 1 --2- 172.21.15.59:0/2001946136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf6c09d6f0 0x7fdf6c09dac0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.858+0000 7fdf716de700 1 -- 172.21.15.59:0/2001946136 >> 172.21.15.59:0/2001946136 conn(0x7fdf6c066f50 msgr2=0x7fdf6c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:10.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.858+0000 7fdf716de700 1 -- 172.21.15.59:0/2001946136 shutdown_connections 2023-09-30T22:31:10.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.858+0000 7fdf716de700 1 -- 172.21.15.59:0/2001946136 wait complete. 2023-09-30T22:31:10.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.860+0000 7fdf716de700 1 Processor -- start 2023-09-30T22:31:10.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.860+0000 7fdf716de700 1 -- start start 2023-09-30T22:31:10.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf716de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf6c09d6f0 0x7fdf6c1a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf716de700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf6c09e000 0x7fdf6c1a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf716de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf6c09e410 0x7fdf6c1a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf716de700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c1a9720 con 0x7fdf6c09e000 2023-09-30T22:31:10.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf716de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c1a9920 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf716de700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c1a8810 con 0x7fdf6c09e410 2023-09-30T22:31:10.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf6affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf6c09d6f0 0x7fdf6c1a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf6b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf6c09e410 0x7fdf6c1a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf6affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf6c09d6f0 0x7fdf6c1a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48056/0 (socket says 172.21.15.59:48056) 2023-09-30T22:31:10.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf6affd700 1 -- 172.21.15.59:0/1761247025 learned_addr learned my addr 172.21.15.59:0/1761247025 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:10.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf6a7fc700 1 --2- 172.21.15.59:0/1761247025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf6c09e000 0x7fdf6c1a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf6affd700 1 -- 172.21.15.59:0/1761247025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf6c09e410 msgr2=0x7fdf6c1a6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf6affd700 1 --2- 172.21.15.59:0/1761247025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf6c09e410 0x7fdf6c1a6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf6affd700 1 -- 172.21.15.59:0/1761247025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf6c09e000 msgr2=0x7fdf6c1a63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf6affd700 1 --2- 172.21.15.59:0/1761247025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf6c09e000 0x7fdf6c1a63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf6affd700 1 -- 172.21.15.59:0/1761247025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c0094a0 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.861+0000 7fdf6b7fe700 1 --2- 172.21.15.59:0/1761247025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf6c09e410 0x7fdf6c1a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:10.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.862+0000 7fdf6affd700 1 --2- 172.21.15.59:0/1761247025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf6c09d6f0 0x7fdf6c1a5e90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c000c00 tx=0x7fdf5c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.862+0000 7fdf537fe700 1 -- 172.21.15.59:0/1761247025 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c0036a0 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.862+0000 7fdf537fe700 1 -- 172.21.15.59:0/1761247025 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5c01f070 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.862+0000 7fdf537fe700 1 -- 172.21.15.59:0/1761247025 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c003a60 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.862+0000 7fdf716de700 1 -- 172.21.15.59:0/1761247025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf6c1a7ab0 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.862+0000 7fdf716de700 1 -- 172.21.15.59:0/1761247025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6c09c710 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.863+0000 7fdf537fe700 1 -- 172.21.15.59:0/1761247025 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf5c003bc0 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.863+0000 7fdf716de700 1 -- 172.21.15.59:0/1761247025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6c074ea0 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.863+0000 7fdf537fe700 1 -- 172.21.15.59:0/1761247025 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdf5c021070 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.872+0000 7fdf537fe700 1 -- 172.21.15.59:0/1761247025 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf5c046020 con 0x7fdf6c09d6f0 2023-09-30T22:31:10.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.893+0000 7fab6a0de700 1 Processor -- start 2023-09-30T22:31:10.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.893+0000 7fab6a0de700 1 -- start start 2023-09-30T22:31:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.894+0000 7fab6a0de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab6409ffb0 0x7fab6409f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.894+0000 7fab6a0de700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab64138e30 0x7fab6413b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.894+0000 7fab6a0de700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab640a06b0 con 0x7fab6409e850 2023-09-30T22:31:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.894+0000 7fab6a0de700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6406b920 con 0x7fab64138e30 2023-09-30T22:31:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.894+0000 7fab6a0de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6409aa30 con 0x7fab6409ffb0 2023-09-30T22:31:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.894+0000 7fab62ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab6409ffb0 0x7fab6409f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.894+0000 7fab62ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab6409ffb0 0x7fab6409f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48064/0 (socket says 172.21.15.59:48064) 2023-09-30T22:31:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.894+0000 7fab63fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab64138e30 0x7fab6413b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.894+0000 7fab62ffd700 1 -- 172.21.15.59:0/1660496549 learned_addr learned my addr 172.21.15.59:0/1660496549 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.894+0000 7fab62ffd700 1 -- 172.21.15.59:0/1660496549 >> v2:172.21.15.59:3300/0 conn(0x7fab64138e30 msgr2=0x7fab6413b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.894+0000 7fab62ffd700 1 --2- 172.21.15.59:0/1660496549 >> v2:172.21.15.59:3300/0 conn(0x7fab64138e30 0x7fab6413b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.894+0000 7fab62ffd700 1 -- 172.21.15.59:0/1660496549 >> v1:172.21.15.59:6789/0 conn(0x7fab6409e850 legacy=0x7fab6409ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.894+0000 7fab62ffd700 1 -- 172.21.15.59:0/1660496549 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6406caa0 con 0x7fab6409ffb0 2023-09-30T22:31:10.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.894+0000 7fab62ffd700 1 --2- 172.21.15.59:0/1660496549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab6409ffb0 0x7fab6409f330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fab580098f0 tx=0x7fab58009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6221d4172d50c08d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.895+0000 7fab627fc700 1 -- 172.21.15.59:0/1660496549 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58011830 con 0x7fab6409ffb0 2023-09-30T22:31:10.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.895+0000 7fab627fc700 1 -- 172.21.15.59:0/1660496549 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab58011990 con 0x7fab6409ffb0 2023-09-30T22:31:10.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.895+0000 7fab627fc700 1 -- 172.21.15.59:0/1660496549 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58011d20 con 0x7fab6409ffb0 2023-09-30T22:31:10.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.895+0000 7fab6a0de700 1 -- 172.21.15.59:0/1660496549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab6409ffb0 msgr2=0x7fab6409f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.895+0000 7fab6a0de700 1 --2- 172.21.15.59:0/1660496549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab6409ffb0 0x7fab6409f330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fab580098f0 tx=0x7fab58009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:10.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.895+0000 7fab6a0de700 1 -- 172.21.15.59:0/1660496549 shutdown_connections 2023-09-30T22:31:10.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.895+0000 7fab6a0de700 1 --2- 172.21.15.59:0/1660496549 >> v2:172.21.15.59:3300/0 conn(0x7fab64138e30 0x7fab6413b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.895+0000 7fab6a0de700 1 --2- 172.21.15.59:0/1660496549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab6409ffb0 0x7fab6409f330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.895+0000 7fab6a0de700 1 -- 172.21.15.59:0/1660496549 >> 172.21.15.59:0/1660496549 conn(0x7fab640a3f70 msgr2=0x7fab640a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:10.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.895+0000 7fab6a0de700 1 -- 172.21.15.59:0/1660496549 shutdown_connections 2023-09-30T22:31:10.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.895+0000 7fab6a0de700 1 -- 172.21.15.59:0/1660496549 wait complete. 2023-09-30T22:31:10.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.896+0000 7f349f64f700 1 Processor -- start 2023-09-30T22:31:10.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.896+0000 7fab6a0de700 1 Processor -- start 2023-09-30T22:31:10.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.897+0000 7fab6a0de700 1 -- start start 2023-09-30T22:31:10.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.897+0000 7f349f64f700 1 -- start start 2023-09-30T22:31:10.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.897+0000 7fab6a0de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab6409e850 0x7fab64120990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.897+0000 7fab6a0de700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab6409ffb0 0x7fab64120ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.897+0000 7fab6a0de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab64138e30 0x7fab64121410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.897+0000 7fab6a0de700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab641237f0 con 0x7fab6409ffb0 2023-09-30T22:31:10.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.897+0000 7fab6a0de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6406ccc0 con 0x7fab6409e850 2023-09-30T22:31:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.897+0000 7fab6a0de700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab641225a0 con 0x7fab64138e30 2023-09-30T22:31:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.897+0000 7f349f64f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3498130540 0x7f3498130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.897+0000 7f349f64f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f349806fcf0 0x7f3498138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.897+0000 7f349f64f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34980716a0 con 0x7f3498130e50 2023-09-30T22:31:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.897+0000 7f349f64f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349809a390 con 0x7f3498130540 2023-09-30T22:31:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.897+0000 7f349f64f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3498071290 con 0x7f349806fcf0 2023-09-30T22:31:10.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7fab63fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab64138e30 0x7fab64121410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7fab63fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab64138e30 0x7fab64121410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35256/0 (socket says 172.21.15.59:35256) 2023-09-30T22:31:10.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7fab63fff700 1 -- 172.21.15.59:0/713847767 learned_addr learned my addr 172.21.15.59:0/713847767 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:10.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7fab62ffd700 1 --2- 172.21.15.59:0/713847767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab6409ffb0 0x7fab64120ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7fab63fff700 1 -- 172.21.15.59:0/713847767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab6409e850 msgr2=0x7fab64120990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:31:10.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7fab63fff700 1 --2- 172.21.15.59:0/713847767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab6409e850 0x7fab64120990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7fab63fff700 1 -- 172.21.15.59:0/713847767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab6409ffb0 msgr2=0x7fab64120ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7fab63fff700 1 --2- 172.21.15.59:0/713847767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab6409ffb0 0x7fab64120ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7fab63fff700 1 -- 172.21.15.59:0/713847767 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab58009550 con 0x7fab64138e30 2023-09-30T22:31:10.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7f349d3eb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3498130540 0x7f3498130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7f349d3eb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3498130540 0x7f3498130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36672/0 (socket says 172.21.15.59:36672) 2023-09-30T22:31:10.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7f349d3eb700 1 -- 172.21.15.59:0/2763720019 learned_addr learned my addr 172.21.15.59:0/2763720019 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7f349dbec700 1 --2- 172.21.15.59:0/2763720019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f349806fcf0 0x7f3498138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7fab63fff700 1 --2- 172.21.15.59:0/713847767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab64138e30 0x7fab64121410 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00e960 tx=0x7fab5c00ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7fab62ffd700 1 --2- 172.21.15.59:0/713847767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab6409ffb0 0x7fab64120ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7f349d3eb700 1 -- 172.21.15.59:0/2763720019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f349806fcf0 msgr2=0x7f3498138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7f349d3eb700 1 --2- 172.21.15.59:0/2763720019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f349806fcf0 0x7f3498138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7f349d3eb700 1 -- 172.21.15.59:0/2763720019 >> v1:172.21.15.59:6789/0 conn(0x7f3498130e50 legacy=0x7f349806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.898+0000 7f349d3eb700 1 -- 172.21.15.59:0/2763720019 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3498130340 con 0x7f3498130540 2023-09-30T22:31:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.899+0000 7f349d3eb700 1 --2- 172.21.15.59:0/2763720019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3498130540 0x7f3498130910 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f349400bb90 tx=0x7f349400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b994fa66e19bf3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.899+0000 7f348ffff700 1 -- 172.21.15.59:0/2763720019 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400dc70 con 0x7f3498130540 2023-09-30T22:31:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.899+0000 7f348ffff700 1 -- 172.21.15.59:0/2763720019 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349400ddd0 con 0x7f3498130540 2023-09-30T22:31:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.899+0000 7f348ffff700 1 -- 172.21.15.59:0/2763720019 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494012990 con 0x7f3498130540 2023-09-30T22:31:10.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.900+0000 7fab4bfff700 1 -- 172.21.15.59:0/713847767 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c00c850 con 0x7fab64138e30 2023-09-30T22:31:10.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.900+0000 7fab4bfff700 1 -- 172.21.15.59:0/713847767 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c00c9b0 con 0x7fab64138e30 2023-09-30T22:31:10.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.900+0000 7fab4bfff700 1 -- 172.21.15.59:0/713847767 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c00cd20 con 0x7fab64138e30 2023-09-30T22:31:10.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.900+0000 7fab6a0de700 1 -- 172.21.15.59:0/713847767 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab640a3a70 con 0x7fab64138e30 2023-09-30T22:31:10.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.900+0000 7f349f64f700 1 -- 172.21.15.59:0/2763720019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3498130540 msgr2=0x7f3498130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.900+0000 7f349f64f700 1 --2- 172.21.15.59:0/2763720019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3498130540 0x7f3498130910 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f349400bb90 tx=0x7f349400bea0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.900+0000 7fab6a0de700 1 -- 172.21.15.59:0/713847767 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab64123c40 con 0x7fab64138e30 2023-09-30T22:31:10.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.901+0000 7f349f64f700 1 -- 172.21.15.59:0/2763720019 shutdown_connections 2023-09-30T22:31:10.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.901+0000 7f349f64f700 1 --2- 172.21.15.59:0/2763720019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3498130540 0x7f3498130910 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.901+0000 7f349f64f700 1 --2- 172.21.15.59:0/2763720019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f349806fcf0 0x7f3498138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.901+0000 7f349f64f700 1 -- 172.21.15.59:0/2763720019 >> 172.21.15.59:0/2763720019 conn(0x7f34980a2aa0 msgr2=0x7f34980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:10.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.901+0000 7fab6a0de700 1 -- 172.21.15.59:0/713847767 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab640747f0 con 0x7fab64138e30 2023-09-30T22:31:10.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.901+0000 7fab4bfff700 1 -- 172.21.15.59:0/713847767 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab5c013470 con 0x7fab64138e30 2023-09-30T22:31:10.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.901+0000 7f349f64f700 1 -- 172.21.15.59:0/2763720019 shutdown_connections 2023-09-30T22:31:10.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.901+0000 7f349f64f700 1 -- 172.21.15.59:0/2763720019 wait complete. 2023-09-30T22:31:10.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.901+0000 7fab4bfff700 1 -- 172.21.15.59:0/713847767 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab5c03f860 con 0x7fab64138e30 2023-09-30T22:31:10.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.902+0000 7f349f64f700 1 Processor -- start 2023-09-30T22:31:10.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.902+0000 7f349f64f700 1 -- start start 2023-09-30T22:31:10.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.903+0000 7f349f64f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f349806fcf0 0x7f3498118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.903+0000 7f349f64f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3498130540 0x7f3498119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.903+0000 7f349f64f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3498130e50 0x7f3498119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.903+0000 7f349f64f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349811c980 con 0x7f3498130e50 2023-09-30T22:31:10.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.903+0000 7f349f64f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349811bfc0 con 0x7f349806fcf0 2023-09-30T22:31:10.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.903+0000 7f349f64f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f349809e1d0 con 0x7f3498130540 2023-09-30T22:31:10.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.903+0000 7f349cbea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3498130540 0x7f3498119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.903+0000 7f349dbec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3498130e50 0x7f3498119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.903+0000 7f349cbea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3498130540 0x7f3498119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35264/0 (socket says 172.21.15.59:35264) 2023-09-30T22:31:10.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.903+0000 7f349dbec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3498130e50 0x7f3498119750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36684/0 (socket says 172.21.15.59:36684) 2023-09-30T22:31:10.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.903+0000 7f349cbea700 1 -- 172.21.15.59:0/314697386 learned_addr learned my addr 172.21.15.59:0/314697386 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:10.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.903+0000 7f349d3eb700 1 --2- 172.21.15.59:0/314697386 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f349806fcf0 0x7f3498118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.904+0000 7f349d3eb700 1 -- 172.21.15.59:0/314697386 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3498130540 msgr2=0x7f3498119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.904+0000 7f349d3eb700 1 --2- 172.21.15.59:0/314697386 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3498130540 0x7f3498119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.904+0000 7f349d3eb700 1 -- 172.21.15.59:0/314697386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3498130e50 msgr2=0x7f3498119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.904+0000 7f349d3eb700 1 --2- 172.21.15.59:0/314697386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3498130e50 0x7f3498119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.904+0000 7f349d3eb700 1 -- 172.21.15.59:0/314697386 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349400b7f0 con 0x7f349806fcf0 2023-09-30T22:31:10.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.904+0000 7f349d3eb700 1 --2- 172.21.15.59:0/314697386 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f349806fcf0 0x7f3498118cd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f349401a000 tx=0x7f3494004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.904+0000 7f348dffb700 1 -- 172.21.15.59:0/314697386 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494020070 con 0x7f349806fcf0 2023-09-30T22:31:10.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.904+0000 7f348dffb700 1 -- 172.21.15.59:0/314697386 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3494012770 con 0x7f349806fcf0 2023-09-30T22:31:10.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.904+0000 7f348dffb700 1 -- 172.21.15.59:0/314697386 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494012b00 con 0x7f349806fcf0 2023-09-30T22:31:10.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.905+0000 7f349f64f700 1 -- 172.21.15.59:0/314697386 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349811ad20 con 0x7f349806fcf0 2023-09-30T22:31:10.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.905+0000 7f349f64f700 1 -- 172.21.15.59:0/314697386 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34980718e0 con 0x7f349806fcf0 2023-09-30T22:31:10.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.906+0000 7f349f64f700 1 -- 172.21.15.59:0/314697386 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349811bae0 con 0x7f349806fcf0 2023-09-30T22:31:10.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.906+0000 7f348dffb700 1 -- 172.21.15.59:0/314697386 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3494024070 con 0x7f349806fcf0 2023-09-30T22:31:10.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.906+0000 7f348dffb700 1 -- 172.21.15.59:0/314697386 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3494044870 con 0x7f349806fcf0 2023-09-30T22:31:10.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.910+0000 7fab4bfff700 1 -- 172.21.15.59:0/713847767 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab5c013720 con 0x7fab64138e30 2023-09-30T22:31:10.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:10.911+0000 7f348dffb700 1 -- 172.21.15.59:0/314697386 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f349401b400 con 0x7f349806fcf0 2023-09-30T22:31:11.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.086+0000 7fdf716de700 1 -- 172.21.15.59:0/1761247025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdf6c06c360 con 0x7fdf6c09d6f0 2023-09-30T22:31:11.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.086+0000 7fdf537fe700 1 -- 172.21.15.59:0/1761247025 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf5c02b070 con 0x7fdf6c09d6f0 2023-09-30T22:31:11.088 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.090+0000 7fdf716de700 1 -- 172.21.15.59:0/1761247025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf6c09d6f0 msgr2=0x7fdf6c1a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.090+0000 7fdf716de700 1 --2- 172.21.15.59:0/1761247025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf6c09d6f0 0x7fdf6c1a5e90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c000c00 tx=0x7fdf5c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.090+0000 7fdf716de700 1 -- 172.21.15.59:0/1761247025 shutdown_connections 2023-09-30T22:31:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.090+0000 7fdf716de700 1 --2- 172.21.15.59:0/1761247025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf6c09e410 0x7fdf6c1a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.090+0000 7fdf716de700 1 --2- 172.21.15.59:0/1761247025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf6c09d6f0 0x7fdf6c1a5e90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.090+0000 7fdf716de700 1 --2- 172.21.15.59:0/1761247025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf6c09e000 0x7fdf6c1a63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.090+0000 7fdf716de700 1 -- 172.21.15.59:0/1761247025 >> 172.21.15.59:0/1761247025 conn(0x7fdf6c066f50 msgr2=0x7fdf6c1bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:11.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.090+0000 7fdf716de700 1 -- 172.21.15.59:0/1761247025 shutdown_connections 2023-09-30T22:31:11.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.090+0000 7fdf716de700 1 -- 172.21.15.59:0/1761247025 wait complete. 2023-09-30T22:31:11.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:11.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.121+0000 7f349f64f700 1 -- 172.21.15.59:0/314697386 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3498074ea0 con 0x7f349806fcf0 2023-09-30T22:31:11.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.121+0000 7f348dffb700 1 -- 172.21.15.59:0/314697386 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3494024320 con 0x7f349806fcf0 2023-09-30T22:31:11.122 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:11.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.123+0000 7f349f64f700 1 -- 172.21.15.59:0/314697386 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f349806fcf0 msgr2=0x7f3498118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.123+0000 7f349f64f700 1 --2- 172.21.15.59:0/314697386 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f349806fcf0 0x7f3498118cd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f349401a000 tx=0x7f3494004750 comp rx=0 tx=0).stop 2023-09-30T22:31:11.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.123+0000 7f349f64f700 1 -- 172.21.15.59:0/314697386 shutdown_connections 2023-09-30T22:31:11.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.123+0000 7f349f64f700 1 --2- 172.21.15.59:0/314697386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3498130e50 0x7f3498119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.123+0000 7f349f64f700 1 --2- 172.21.15.59:0/314697386 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f349806fcf0 0x7f3498118cd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.123+0000 7f349f64f700 1 --2- 172.21.15.59:0/314697386 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3498130540 0x7f3498119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.123+0000 7f349f64f700 1 -- 172.21.15.59:0/314697386 >> 172.21.15.59:0/314697386 conn(0x7f34980a2aa0 msgr2=0x7f349812d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:11.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.123+0000 7f349f64f700 1 -- 172.21.15.59:0/314697386 shutdown_connections 2023-09-30T22:31:11.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.124+0000 7f349f64f700 1 -- 172.21.15.59:0/314697386 wait complete. 2023-09-30T22:31:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.129+0000 7fab6a0de700 1 -- 172.21.15.59:0/713847767 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fab64072820 con 0x7fab64138e30 2023-09-30T22:31:11.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.130+0000 7fab4bfff700 1 -- 172.21.15.59:0/713847767 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab5c021020 con 0x7fab64138e30 2023-09-30T22:31:11.131 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:11.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.134+0000 7fab6a0de700 1 -- 172.21.15.59:0/713847767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab64138e30 msgr2=0x7fab64121410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.134+0000 7fab6a0de700 1 --2- 172.21.15.59:0/713847767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab64138e30 0x7fab64121410 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00e960 tx=0x7fab5c00ed20 comp rx=0 tx=0).stop 2023-09-30T22:31:11.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.134+0000 7fab6a0de700 1 -- 172.21.15.59:0/713847767 shutdown_connections 2023-09-30T22:31:11.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.134+0000 7fab6a0de700 1 --2- 172.21.15.59:0/713847767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab64138e30 0x7fab64121410 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.134+0000 7fab6a0de700 1 --2- 172.21.15.59:0/713847767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab6409e850 0x7fab64120990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.134+0000 7fab6a0de700 1 --2- 172.21.15.59:0/713847767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab6409ffb0 0x7fab64120ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.134+0000 7fab6a0de700 1 -- 172.21.15.59:0/713847767 >> 172.21.15.59:0/713847767 conn(0x7fab640a3f70 msgr2=0x7fab640a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:11.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.134+0000 7fab6a0de700 1 -- 172.21.15.59:0/713847767 shutdown_connections 2023-09-30T22:31:11.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.134+0000 7fab6a0de700 1 -- 172.21.15.59:0/713847767 wait complete. 2023-09-30T22:31:11.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:11.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:11.351 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.499+0000 7f1d429f0700 1 Processor -- start 2023-09-30T22:31:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.500+0000 7f1d429f0700 1 -- start start 2023-09-30T22:31:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.500+0000 7f1d429f0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d3c06b250 0x7f1d3c136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.500+0000 7f1d429f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c136d80 0x7f1d3c139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.500+0000 7f1d429f0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c09ece0 con 0x7f1d3c06a770 2023-09-30T22:31:11.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.500+0000 7f1d429f0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3c09e760 con 0x7f1d3c06b250 2023-09-30T22:31:11.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.500+0000 7f1d429f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c09e040 con 0x7f1d3c136d80 2023-09-30T22:31:11.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.500+0000 7f1d3b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d3c06b250 0x7f1d3c136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.500+0000 7f1d3b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d3c06b250 0x7f1d3c136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36686/0 (socket says 172.21.15.59:36686) 2023-09-30T22:31:11.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.500+0000 7f1d40f8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c136d80 0x7f1d3c139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.500+0000 7f1d3b7fe700 1 -- 172.21.15.59:0/2131320884 learned_addr learned my addr 172.21.15.59:0/2131320884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:11.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.501+0000 7f1d40f8d700 1 -- 172.21.15.59:0/2131320884 >> v2:172.21.15.59:3300/0 conn(0x7f1d3c06b250 msgr2=0x7f1d3c136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:11.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.501+0000 7f1d40f8d700 1 --2- 172.21.15.59:0/2131320884 >> v2:172.21.15.59:3300/0 conn(0x7f1d3c06b250 0x7f1d3c136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.501+0000 7f1d40f8d700 1 -- 172.21.15.59:0/2131320884 >> v1:172.21.15.59:6789/0 conn(0x7f1d3c06a770 legacy=0x7f1d3c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.501+0000 7f1d40f8d700 1 -- 172.21.15.59:0/2131320884 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c09f630 con 0x7f1d3c136d80 2023-09-30T22:31:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.501+0000 7f1d3b7fe700 1 --2- 172.21.15.59:0/2131320884 >> v2:172.21.15.59:3300/0 conn(0x7f1d3c06b250 0x7f1d3c136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.501+0000 7f1d40f8d700 1 --2- 172.21.15.59:0/2131320884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c136d80 0x7f1d3c139160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1d34009d90 tx=0x7f1d3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=537f96f4ed225e11 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.501+0000 7f1d3affd700 1 -- 172.21.15.59:0/2131320884 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3400e070 con 0x7f1d3c136d80 2023-09-30T22:31:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.501+0000 7f1d3affd700 1 -- 172.21.15.59:0/2131320884 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3400bb20 con 0x7f1d3c136d80 2023-09-30T22:31:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.501+0000 7f1d3affd700 1 -- 172.21.15.59:0/2131320884 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34012430 con 0x7f1d3c136d80 2023-09-30T22:31:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.502+0000 7f1d429f0700 1 -- 172.21.15.59:0/2131320884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c136d80 msgr2=0x7f1d3c139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.502+0000 7f1d429f0700 1 --2- 172.21.15.59:0/2131320884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c136d80 0x7f1d3c139160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1d34009d90 tx=0x7f1d3400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.502+0000 7f1d429f0700 1 -- 172.21.15.59:0/2131320884 shutdown_connections 2023-09-30T22:31:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.502+0000 7f1d429f0700 1 --2- 172.21.15.59:0/2131320884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c136d80 0x7f1d3c139160 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.502+0000 7f1d429f0700 1 --2- 172.21.15.59:0/2131320884 >> v2:172.21.15.59:3300/0 conn(0x7f1d3c06b250 0x7f1d3c136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.502+0000 7f1d429f0700 1 -- 172.21.15.59:0/2131320884 >> 172.21.15.59:0/2131320884 conn(0x7f1d3c066f50 msgr2=0x7f1d3c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:11.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.502+0000 7f1d429f0700 1 -- 172.21.15.59:0/2131320884 shutdown_connections 2023-09-30T22:31:11.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.502+0000 7f1d429f0700 1 -- 172.21.15.59:0/2131320884 wait complete. 2023-09-30T22:31:11.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.503+0000 7f1d429f0700 1 Processor -- start 2023-09-30T22:31:11.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.503+0000 7f1d429f0700 1 -- start start 2023-09-30T22:31:11.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d429f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c06a770 0x7f1d3c1c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d429f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c06b250 0x7f1d3c1c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d429f0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d3c136d80 0x7f1d3c11c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d429f0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c11fdf0 con 0x7f1d3c136d80 2023-09-30T22:31:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d429f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c1c6eb0 con 0x7f1d3c06a770 2023-09-30T22:31:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d429f0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c071e60 con 0x7f1d3c06b250 2023-09-30T22:31:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d3bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c06a770 0x7f1d3c1c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d3b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c06b250 0x7f1d3c1c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d3bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c06a770 0x7f1d3c1c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48086/0 (socket says 172.21.15.59:48086) 2023-09-30T22:31:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d3bfff700 1 -- 172.21.15.59:0/1502744243 learned_addr learned my addr 172.21.15.59:0/1502744243 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d40f8d700 1 --2- 172.21.15.59:0/1502744243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d3c136d80 0x7f1d3c11c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d3bfff700 1 -- 172.21.15.59:0/1502744243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c06b250 msgr2=0x7f1d3c1c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d3bfff700 1 --2- 172.21.15.59:0/1502744243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c06b250 0x7f1d3c1c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d3bfff700 1 -- 172.21.15.59:0/1502744243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d3c136d80 msgr2=0x7f1d3c11c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d3bfff700 1 --2- 172.21.15.59:0/1502744243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d3c136d80 0x7f1d3c11c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.504+0000 7f1d3bfff700 1 -- 172.21.15.59:0/1502744243 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d30009550 con 0x7f1d3c06a770 2023-09-30T22:31:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.505+0000 7f1d40f8d700 1 --2- 172.21.15.59:0/1502744243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d3c136d80 0x7f1d3c11c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.505+0000 7f1d3b7fe700 1 --2- 172.21.15.59:0/1502744243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c06b250 0x7f1d3c1c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.505+0000 7f1d3bfff700 1 --2- 172.21.15.59:0/1502744243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c06a770 0x7f1d3c1c6430 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00c4e0 tx=0x7f1d2c00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.505+0000 7f1d38ff9700 1 -- 172.21.15.59:0/1502744243 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c0052d0 con 0x7f1d3c06a770 2023-09-30T22:31:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.505+0000 7f1d38ff9700 1 -- 172.21.15.59:0/1502744243 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c005430 con 0x7f1d3c06a770 2023-09-30T22:31:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.505+0000 7f1d429f0700 1 -- 172.21.15.59:0/1502744243 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d34009a70 con 0x7f1d3c06a770 2023-09-30T22:31:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.505+0000 7f1d38ff9700 1 -- 172.21.15.59:0/1502744243 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c0038c0 con 0x7f1d3c06a770 2023-09-30T22:31:11.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.505+0000 7f1d429f0700 1 -- 172.21.15.59:0/1502744243 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3c132380 con 0x7f1d3c06a770 2023-09-30T22:31:11.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.506+0000 7f1d38ff9700 1 -- 172.21.15.59:0/1502744243 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d2c003a20 con 0x7f1d3c06a770 2023-09-30T22:31:11.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.506+0000 7f1d38ff9700 1 -- 172.21.15.59:0/1502744243 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1d2c03ea90 con 0x7f1d3c06a770 2023-09-30T22:31:11.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.506+0000 7f1d429f0700 1 -- 172.21.15.59:0/1502744243 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3c074ea0 con 0x7f1d3c06a770 2023-09-30T22:31:11.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.511+0000 7f1d38ff9700 1 -- 172.21.15.59:0/1502744243 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d2c017020 con 0x7f1d3c06a770 2023-09-30T22:31:11.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.716+0000 7f1d429f0700 1 -- 172.21.15.59:0/1502744243 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1d3c120140 con 0x7f1d3c06a770 2023-09-30T22:31:11.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.717+0000 7f1d38ff9700 1 -- 172.21.15.59:0/1502744243 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d2c018260 con 0x7f1d3c06a770 2023-09-30T22:31:11.718 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.719+0000 7f1d429f0700 1 -- 172.21.15.59:0/1502744243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c06a770 msgr2=0x7f1d3c1c6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.719+0000 7f1d429f0700 1 --2- 172.21.15.59:0/1502744243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c06a770 0x7f1d3c1c6430 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00c4e0 tx=0x7f1d2c00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.719+0000 7f1d429f0700 1 -- 172.21.15.59:0/1502744243 shutdown_connections 2023-09-30T22:31:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.719+0000 7f1d429f0700 1 --2- 172.21.15.59:0/1502744243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d3c136d80 0x7f1d3c11c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.719+0000 7f1d429f0700 1 --2- 172.21.15.59:0/1502744243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c06a770 0x7f1d3c1c6430 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.719+0000 7f1d429f0700 1 --2- 172.21.15.59:0/1502744243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c06b250 0x7f1d3c1c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.719+0000 7f1d429f0700 1 -- 172.21.15.59:0/1502744243 >> 172.21.15.59:0/1502744243 conn(0x7f1d3c066f50 msgr2=0x7f1d3c0701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.719+0000 7f1d429f0700 1 -- 172.21.15.59:0/1502744243 shutdown_connections 2023-09-30T22:31:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:11.719+0000 7f1d429f0700 1 -- 172.21.15.59:0/1502744243 wait complete. 2023-09-30T22:31:11.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:12.111 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:12.142 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:12.151 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.272+0000 7f1651c00700 1 Processor -- start 2023-09-30T22:31:12.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.272+0000 7f1651c00700 1 -- start start 2023-09-30T22:31:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f1651c00700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f164c09d6f0 0x7f164c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f1651c00700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f164c09e410 0x7f164c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f1651c00700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c09b120 con 0x7f164c09e000 2023-09-30T22:31:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f1651c00700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c06b460 con 0x7f164c09e410 2023-09-30T22:31:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f1651c00700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f164c09a7e0 con 0x7f164c09d6f0 2023-09-30T22:31:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f164affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f164c09e000 0x7f164c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58096/0 (socket says 172.21.15.59:58096) 2023-09-30T22:31:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f164affd700 1 -- 172.21.15.59:0/2091760559 learned_addr learned my addr 172.21.15.59:0/2091760559 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f164bfff700 1 --2- 172.21.15.59:0/2091760559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f164c09e410 0x7f164c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f164b7fe700 1 --2- 172.21.15.59:0/2091760559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f164c09d6f0 0x7f164c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f164a7fc700 1 -- 172.21.15.59:0/2091760559 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000887527 0 0) 0x7f164c09b120 con 0x7f164c09e000 2023-09-30T22:31:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f164a7fc700 1 -- 172.21.15.59:0/2091760559 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16340035b0 con 0x7f164c09e000 2023-09-30T22:31:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f164bfff700 1 -- 172.21.15.59:0/2091760559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f164c09d6f0 msgr2=0x7f164c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f164bfff700 1 --2- 172.21.15.59:0/2091760559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f164c09d6f0 0x7f164c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f164bfff700 1 -- 172.21.15.59:0/2091760559 >> v1:172.21.15.59:6789/0 conn(0x7f164c09e000 legacy=0x7f164c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f164bfff700 1 -- 172.21.15.59:0/2091760559 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c09a500 con 0x7f164c09e410 2023-09-30T22:31:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.273+0000 7f164b7fe700 1 --2- 172.21.15.59:0/2091760559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f164c09d6f0 0x7f164c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.274+0000 7f164bfff700 1 --2- 172.21.15.59:0/2091760559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f164c09e410 0x7f164c134100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1644009dc0 tx=0x7f164400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f28c93580c13da3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.274+0000 7f164a7fc700 1 -- 172.21.15.59:0/2091760559 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400e070 con 0x7f164c09e410 2023-09-30T22:31:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.274+0000 7f164a7fc700 1 -- 172.21.15.59:0/2091760559 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164400bb20 con 0x7f164c09e410 2023-09-30T22:31:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.274+0000 7f164a7fc700 1 -- 172.21.15.59:0/2091760559 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644012430 con 0x7f164c09e410 2023-09-30T22:31:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.275+0000 7f1651c00700 1 -- 172.21.15.59:0/2091760559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f164c09e410 msgr2=0x7f164c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.275+0000 7f1651c00700 1 --2- 172.21.15.59:0/2091760559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f164c09e410 0x7f164c134100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1644009dc0 tx=0x7f164400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.275+0000 7f1651c00700 1 -- 172.21.15.59:0/2091760559 shutdown_connections 2023-09-30T22:31:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.275+0000 7f1651c00700 1 --2- 172.21.15.59:0/2091760559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f164c09d6f0 0x7f164c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.275+0000 7f1651c00700 1 --2- 172.21.15.59:0/2091760559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f164c09e410 0x7f164c134100 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.275+0000 7f1651c00700 1 -- 172.21.15.59:0/2091760559 >> 172.21.15.59:0/2091760559 conn(0x7f164c066f50 msgr2=0x7f164c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.275+0000 7f1651c00700 1 -- 172.21.15.59:0/2091760559 shutdown_connections 2023-09-30T22:31:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.275+0000 7f1651c00700 1 -- 172.21.15.59:0/2091760559 wait complete. 2023-09-30T22:31:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.276+0000 7f1651c00700 1 Processor -- start 2023-09-30T22:31:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.277+0000 7f1651c00700 1 -- start start 2023-09-30T22:31:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.277+0000 7f1651c00700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f164c09d6f0 0x7f164c122430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.277+0000 7f1651c00700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f164c09e000 0x7f164c122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.277+0000 7f1651c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f164c09e410 0x7f164c122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.277+0000 7f1651c00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c124600 con 0x7f164c09e410 2023-09-30T22:31:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.277+0000 7f1651c00700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c1259b0 con 0x7f164c09e000 2023-09-30T22:31:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.277+0000 7f1651c00700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0a3b90 con 0x7f164c09d6f0 2023-09-30T22:31:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.277+0000 7f164b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f164c09d6f0 0x7f164c122430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.278+0000 7f164b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f164c09d6f0 0x7f164c122430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35278/0 (socket says 172.21.15.59:35278) 2023-09-30T22:31:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.278+0000 7f164b7fe700 1 -- 172.21.15.59:0/3397328990 learned_addr learned my addr 172.21.15.59:0/3397328990 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.278+0000 7f164bfff700 1 --2- 172.21.15.59:0/3397328990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f164c09e410 0x7f164c122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.278+0000 7f164affd700 1 --2- 172.21.15.59:0/3397328990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f164c09e000 0x7f164c122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.278+0000 7f164b7fe700 1 -- 172.21.15.59:0/3397328990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f164c09e000 msgr2=0x7f164c122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.278+0000 7f164b7fe700 1 --2- 172.21.15.59:0/3397328990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f164c09e000 0x7f164c122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.278+0000 7f164b7fe700 1 -- 172.21.15.59:0/3397328990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f164c09e410 msgr2=0x7f164c122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.278+0000 7f164b7fe700 1 --2- 172.21.15.59:0/3397328990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f164c09e410 0x7f164c122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.278+0000 7f164b7fe700 1 -- 172.21.15.59:0/3397328990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c0094a0 con 0x7f164c09d6f0 2023-09-30T22:31:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.278+0000 7f164bfff700 1 --2- 172.21.15.59:0/3397328990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f164c09e410 0x7f164c122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.278+0000 7f164b7fe700 1 --2- 172.21.15.59:0/3397328990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f164c09d6f0 0x7f164c122430 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f163c00ebe0 tx=0x7f163c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.278+0000 7f1633fff700 1 -- 172.21.15.59:0/3397328990 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c00c850 con 0x7f164c09d6f0 2023-09-30T22:31:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.278+0000 7f1633fff700 1 -- 172.21.15.59:0/3397328990 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c00c9b0 con 0x7f164c09d6f0 2023-09-30T22:31:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.278+0000 7f1651c00700 1 -- 172.21.15.59:0/3397328990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1644009a70 con 0x7f164c09d6f0 2023-09-30T22:31:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.279+0000 7f1633fff700 1 -- 172.21.15.59:0/3397328990 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c00cd40 con 0x7f164c09d6f0 2023-09-30T22:31:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.279+0000 7f1651c00700 1 -- 172.21.15.59:0/3397328990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c124860 con 0x7f164c09d6f0 2023-09-30T22:31:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.280+0000 7f1651c00700 1 -- 172.21.15.59:0/3397328990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c074ea0 con 0x7f164c09d6f0 2023-09-30T22:31:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.280+0000 7f1633fff700 1 -- 172.21.15.59:0/3397328990 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f163c013470 con 0x7f164c09d6f0 2023-09-30T22:31:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.280+0000 7f1633fff700 1 -- 172.21.15.59:0/3397328990 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f163c03f910 con 0x7f164c09d6f0 2023-09-30T22:31:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.285+0000 7f1633fff700 1 -- 172.21.15.59:0/3397328990 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f163c013720 con 0x7f164c09d6f0 2023-09-30T22:31:12.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.302+0000 7f5a329fe700 1 Processor -- start 2023-09-30T22:31:12.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.302+0000 7f5a329fe700 1 -- start start 2023-09-30T22:31:12.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.303+0000 7f5a329fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a2c0a0a30 0x7f5a2c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.303+0000 7f5a329fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0a1340 0x7f5a2c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.303+0000 7f5a329fe700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a2c09edd0 con 0x7f5a2c133fa0 2023-09-30T22:31:12.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.303+0000 7f5a329fe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c09e1f0 con 0x7f5a2c0a1340 2023-09-30T22:31:12.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.303+0000 7f5a329fe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c09dc50 con 0x7f5a2c0a0a30 2023-09-30T22:31:12.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.303+0000 7f5a2b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0a1340 0x7f5a2c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.303+0000 7f5a2bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a2c0a0a30 0x7f5a2c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.303+0000 7f5a30f9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5a2c133fa0 0x7f5a2c13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58102/0 (socket says 172.21.15.59:58102) 2023-09-30T22:31:12.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.303+0000 7f5a30f9b700 1 -- 172.21.15.59:0/2254467132 learned_addr learned my addr 172.21.15.59:0/2254467132 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:12.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.303+0000 7f5a2bfff700 1 -- 172.21.15.59:0/2254467132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0a1340 msgr2=0x7f5a2c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:12.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.303+0000 7f5a2bfff700 1 --2- 172.21.15.59:0/2254467132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0a1340 0x7f5a2c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.303+0000 7f5a2bfff700 1 -- 172.21.15.59:0/2254467132 >> v1:172.21.15.59:6789/0 conn(0x7f5a2c133fa0 legacy=0x7f5a2c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.303+0000 7f5a2affd700 1 -- 172.21.15.59:0/2254467132 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353697403 0 0) 0x7f5a2c09edd0 con 0x7f5a2c133fa0 2023-09-30T22:31:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.303+0000 7f5a2bfff700 1 -- 172.21.15.59:0/2254467132 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c0a1fe0 con 0x7f5a2c0a0a30 2023-09-30T22:31:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.304+0000 7f5a2bfff700 1 --2- 172.21.15.59:0/2254467132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a2c0a0a30 0x7f5a2c0a0e00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009870 tx=0x7f5a1c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9127277bfe883e47 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.304+0000 7f5a2affd700 1 -- 172.21.15.59:0/2254467132 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c011830 con 0x7f5a2c0a0a30 2023-09-30T22:31:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.304+0000 7f5a2affd700 1 -- 172.21.15.59:0/2254467132 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c011990 con 0x7f5a2c0a0a30 2023-09-30T22:31:12.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.304+0000 7f5a2affd700 1 -- 172.21.15.59:0/2254467132 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c011d20 con 0x7f5a2c0a0a30 2023-09-30T22:31:12.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.305+0000 7f5a329fe700 1 -- 172.21.15.59:0/2254467132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a2c0a0a30 msgr2=0x7f5a2c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.305+0000 7f5a329fe700 1 --2- 172.21.15.59:0/2254467132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a2c0a0a30 0x7f5a2c0a0e00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009870 tx=0x7f5a1c009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:12.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.305+0000 7f5a329fe700 1 -- 172.21.15.59:0/2254467132 shutdown_connections 2023-09-30T22:31:12.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.305+0000 7f5a329fe700 1 --2- 172.21.15.59:0/2254467132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a2c0a0a30 0x7f5a2c0a0e00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.305+0000 7f5a329fe700 1 --2- 172.21.15.59:0/2254467132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0a1340 0x7f5a2c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.305+0000 7f5a329fe700 1 -- 172.21.15.59:0/2254467132 >> 172.21.15.59:0/2254467132 conn(0x7f5a2c0a6550 msgr2=0x7f5a2c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:12.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.305+0000 7f5a329fe700 1 -- 172.21.15.59:0/2254467132 shutdown_connections 2023-09-30T22:31:12.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.305+0000 7f5a329fe700 1 -- 172.21.15.59:0/2254467132 wait complete. 2023-09-30T22:31:12.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.306+0000 7f5a329fe700 1 Processor -- start 2023-09-30T22:31:12.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.307+0000 7f5a329fe700 1 -- start start 2023-09-30T22:31:12.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.307+0000 7f5a329fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a2c0a0a30 0x7f5a2c1c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.307+0000 7f5a329fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0a1340 0x7f5a2c1c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.307+0000 7f5a329fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2c133fa0 0x7f5a2c1c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.307+0000 7f5a329fe700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c124820 con 0x7f5a2c133fa0 2023-09-30T22:31:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.307+0000 7f5a329fe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c125fd0 con 0x7f5a2c0a1340 2023-09-30T22:31:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.307+0000 7f5a329fe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c0a0220 con 0x7f5a2c0a0a30 2023-09-30T22:31:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.307+0000 7f5a2b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0a1340 0x7f5a2c1c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.307+0000 7f5a30f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2c133fa0 0x7f5a2c1c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.307+0000 7f5a2b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0a1340 0x7f5a2c1c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48136/0 (socket says 172.21.15.59:48136) 2023-09-30T22:31:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.307+0000 7f5a2b7fe700 1 -- 172.21.15.59:0/304431279 learned_addr learned my addr 172.21.15.59:0/304431279 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.308+0000 7f5a2bfff700 1 --2- 172.21.15.59:0/304431279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a2c0a0a30 0x7f5a2c1c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.308+0000 7f5a2b7fe700 1 -- 172.21.15.59:0/304431279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a2c0a0a30 msgr2=0x7f5a2c1c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.308+0000 7f5a2b7fe700 1 --2- 172.21.15.59:0/304431279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a2c0a0a30 0x7f5a2c1c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.308+0000 7f5a2b7fe700 1 -- 172.21.15.59:0/304431279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2c133fa0 msgr2=0x7f5a2c1c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.308+0000 7f5a2b7fe700 1 --2- 172.21.15.59:0/304431279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2c133fa0 0x7f5a2c1c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.308+0000 7f5a2b7fe700 1 -- 172.21.15.59:0/304431279 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c0094a0 con 0x7f5a2c0a1340 2023-09-30T22:31:12.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.308+0000 7f5a2b7fe700 1 --2- 172.21.15.59:0/304431279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0a1340 0x7f5a2c1c88c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000e9b0 tx=0x7f5a2000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:12.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.308+0000 7f5a28ff9700 1 -- 172.21.15.59:0/304431279 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20009710 con 0x7f5a2c0a1340 2023-09-30T22:31:12.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.308+0000 7f5a28ff9700 1 -- 172.21.15.59:0/304431279 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2000ee50 con 0x7f5a2c0a1340 2023-09-30T22:31:12.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.308+0000 7f5a329fe700 1 -- 172.21.15.59:0/304431279 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2c0a25e0 con 0x7f5a2c0a1340 2023-09-30T22:31:12.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.308+0000 7f5a28ff9700 1 -- 172.21.15.59:0/304431279 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2000ca50 con 0x7f5a2c0a1340 2023-09-30T22:31:12.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.308+0000 7f5a329fe700 1 -- 172.21.15.59:0/304431279 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2c133550 con 0x7f5a2c0a1340 2023-09-30T22:31:12.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.309+0000 7f5a28ff9700 1 -- 172.21.15.59:0/304431279 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a2000cbb0 con 0x7f5a2c0a1340 2023-09-30T22:31:12.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.309+0000 7f5a28ff9700 1 -- 172.21.15.59:0/304431279 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5a2003fae0 con 0x7f5a2c0a1340 2023-09-30T22:31:12.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.310+0000 7f5a329fe700 1 -- 172.21.15.59:0/304431279 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2c0a6b60 con 0x7f5a2c0a1340 2023-09-30T22:31:12.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.314+0000 7f25adcba700 1 Processor -- start 2023-09-30T22:31:12.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.315+0000 7f25adcba700 1 -- start start 2023-09-30T22:31:12.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.315+0000 7f5a28ff9700 1 -- 172.21.15.59:0/304431279 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a20017080 con 0x7f5a2c0a1340 2023-09-30T22:31:12.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.315+0000 7f25adcba700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25a806f5d0 0x7f25a812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.315+0000 7f25adcba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a8135c20 0x7f25a8138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.315+0000 7f25adcba700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a806fa40 con 0x7f25a812cf60 2023-09-30T22:31:12.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.315+0000 7f25adcba700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a812cd90 con 0x7f25a806f5d0 2023-09-30T22:31:12.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.315+0000 7f25adcba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a8071780 con 0x7f25a8135c20 2023-09-30T22:31:12.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.316+0000 7f259effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25a806f5d0 0x7f25a812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.316+0000 7f25a7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a8135c20 0x7f25a8138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.316+0000 7f259effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25a806f5d0 0x7f25a812ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36730/0 (socket says 172.21.15.59:36730) 2023-09-30T22:31:12.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.316+0000 7f259effd700 1 -- 172.21.15.59:0/1424792920 learned_addr learned my addr 172.21.15.59:0/1424792920 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:12.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.316+0000 7f25a7fff700 1 -- 172.21.15.59:0/1424792920 >> v2:172.21.15.59:3300/0 conn(0x7f25a806f5d0 msgr2=0x7f25a812ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:12.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.316+0000 7f25a7fff700 1 --2- 172.21.15.59:0/1424792920 >> v2:172.21.15.59:3300/0 conn(0x7f25a806f5d0 0x7f25a812ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.316+0000 7f25a7fff700 1 -- 172.21.15.59:0/1424792920 >> v1:172.21.15.59:6789/0 conn(0x7f25a812cf60 legacy=0x7f25a812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.316+0000 7f25a7fff700 1 -- 172.21.15.59:0/1424792920 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a8071a40 con 0x7f25a8135c20 2023-09-30T22:31:12.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.316+0000 7f25a7fff700 1 --2- 172.21.15.59:0/1424792920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a8135c20 0x7f25a8138000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009d90 tx=0x7f25a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46fbbc0a55fec84c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:12.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.316+0000 7f25a6ffd700 1 -- 172.21.15.59:0/1424792920 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a000e070 con 0x7f25a8135c20 2023-09-30T22:31:12.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.316+0000 7f25a6ffd700 1 -- 172.21.15.59:0/1424792920 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a000bb20 con 0x7f25a8135c20 2023-09-30T22:31:12.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.317+0000 7f25a6ffd700 1 -- 172.21.15.59:0/1424792920 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0012430 con 0x7f25a8135c20 2023-09-30T22:31:12.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.317+0000 7f25adcba700 1 -- 172.21.15.59:0/1424792920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a8135c20 msgr2=0x7f25a8138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.317+0000 7f25adcba700 1 --2- 172.21.15.59:0/1424792920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a8135c20 0x7f25a8138000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009d90 tx=0x7f25a000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:12.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.317+0000 7f25adcba700 1 -- 172.21.15.59:0/1424792920 shutdown_connections 2023-09-30T22:31:12.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.317+0000 7f25adcba700 1 --2- 172.21.15.59:0/1424792920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a8135c20 0x7f25a8138000 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.317+0000 7f25adcba700 1 --2- 172.21.15.59:0/1424792920 >> v2:172.21.15.59:3300/0 conn(0x7f25a806f5d0 0x7f25a812ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.317+0000 7f25adcba700 1 -- 172.21.15.59:0/1424792920 >> 172.21.15.59:0/1424792920 conn(0x7f25a80a2aa0 msgr2=0x7f25a80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:12.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.317+0000 7f25adcba700 1 -- 172.21.15.59:0/1424792920 shutdown_connections 2023-09-30T22:31:12.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.317+0000 7f25adcba700 1 -- 172.21.15.59:0/1424792920 wait complete. 2023-09-30T22:31:12.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.318+0000 7f25adcba700 1 Processor -- start 2023-09-30T22:31:12.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.319+0000 7f25adcba700 1 -- start start 2023-09-30T22:31:12.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.319+0000 7f25adcba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a806f5d0 0x7f25a8127100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.319+0000 7f25adcba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25a812cf60 0x7f25a8127640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f25adcba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a8135c20 0x7f25a81c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f25adcba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a809dea0 con 0x7f25a8135c20 2023-09-30T22:31:12.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f25adcba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a8131170 con 0x7f25a806f5d0 2023-09-30T22:31:12.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f25adcba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25a8129fa0 con 0x7f25a812cf60 2023-09-30T22:31:12.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f25a77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a806f5d0 0x7f25a8127100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f25a77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a806f5d0 0x7f25a8127100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48154/0 (socket says 172.21.15.59:48154) 2023-09-30T22:31:12.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f25a77fe700 1 -- 172.21.15.59:0/3960325500 learned_addr learned my addr 172.21.15.59:0/3960325500 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:12.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f259effd700 1 --2- 172.21.15.59:0/3960325500 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25a812cf60 0x7f25a8127640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f25a7fff700 1 --2- 172.21.15.59:0/3960325500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a8135c20 0x7f25a81c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f25a77fe700 1 -- 172.21.15.59:0/3960325500 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25a812cf60 msgr2=0x7f25a8127640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f25a77fe700 1 --2- 172.21.15.59:0/3960325500 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25a812cf60 0x7f25a8127640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f25a77fe700 1 -- 172.21.15.59:0/3960325500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a8135c20 msgr2=0x7f25a81c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f25a77fe700 1 --2- 172.21.15.59:0/3960325500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a8135c20 0x7f25a81c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f25a77fe700 1 -- 172.21.15.59:0/3960325500 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a0009a70 con 0x7f25a806f5d0 2023-09-30T22:31:12.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f25a7fff700 1 --2- 172.21.15.59:0/3960325500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a8135c20 0x7f25a81c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:12.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.320+0000 7f25a77fe700 1 --2- 172.21.15.59:0/3960325500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a806f5d0 0x7f25a8127100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f259800c4e0 tx=0x7f259800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:12.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.321+0000 7f25a4ff9700 1 -- 172.21.15.59:0/3960325500 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980052d0 con 0x7f25a806f5d0 2023-09-30T22:31:12.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.321+0000 7f25a4ff9700 1 -- 172.21.15.59:0/3960325500 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2598005430 con 0x7f25a806f5d0 2023-09-30T22:31:12.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.321+0000 7f25adcba700 1 -- 172.21.15.59:0/3960325500 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a81357e0 con 0x7f25a806f5d0 2023-09-30T22:31:12.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.321+0000 7f25a4ff9700 1 -- 172.21.15.59:0/3960325500 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980038c0 con 0x7f25a806f5d0 2023-09-30T22:31:12.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.321+0000 7f25adcba700 1 -- 172.21.15.59:0/3960325500 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a81317a0 con 0x7f25a806f5d0 2023-09-30T22:31:12.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.322+0000 7f25a4ff9700 1 -- 172.21.15.59:0/3960325500 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2598003a20 con 0x7f25a806f5d0 2023-09-30T22:31:12.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.322+0000 7f25a4ff9700 1 -- 172.21.15.59:0/3960325500 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f259803ec60 con 0x7f25a806f5d0 2023-09-30T22:31:12.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.322+0000 7f25adcba700 1 -- 172.21.15.59:0/3960325500 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a809c9a0 con 0x7f25a806f5d0 2023-09-30T22:31:12.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.327+0000 7f25a4ff9700 1 -- 172.21.15.59:0/3960325500 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25a809c9a0 con 0x7f25a806f5d0 2023-09-30T22:31:12.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.495+0000 7f1651c00700 1 -- 172.21.15.59:0/3397328990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f164c09fde0 con 0x7f164c09d6f0 2023-09-30T22:31:12.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.496+0000 7f1633fff700 1 -- 172.21.15.59:0/3397328990 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f163c01b9c0 con 0x7f164c09d6f0 2023-09-30T22:31:12.497 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:12.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.498+0000 7f1651c00700 1 -- 172.21.15.59:0/3397328990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f164c09d6f0 msgr2=0x7f164c122430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.498+0000 7f1651c00700 1 --2- 172.21.15.59:0/3397328990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f164c09d6f0 0x7f164c122430 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f163c00ebe0 tx=0x7f163c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.498+0000 7f1651c00700 1 -- 172.21.15.59:0/3397328990 shutdown_connections 2023-09-30T22:31:12.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.498+0000 7f1651c00700 1 --2- 172.21.15.59:0/3397328990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f164c09d6f0 0x7f164c122430 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.498+0000 7f1651c00700 1 --2- 172.21.15.59:0/3397328990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f164c09e410 0x7f164c122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.498+0000 7f1651c00700 1 --2- 172.21.15.59:0/3397328990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f164c09e000 0x7f164c122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.498+0000 7f1651c00700 1 -- 172.21.15.59:0/3397328990 >> 172.21.15.59:0/3397328990 conn(0x7f164c066f50 msgr2=0x7f164c133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:12.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.498+0000 7f1651c00700 1 -- 172.21.15.59:0/3397328990 shutdown_connections 2023-09-30T22:31:12.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.498+0000 7f1651c00700 1 -- 172.21.15.59:0/3397328990 wait complete. 2023-09-30T22:31:12.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:12.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.527+0000 7f5a329fe700 1 -- 172.21.15.59:0/304431279 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5a2c126640 con 0x7f5a2c0a1340 2023-09-30T22:31:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.527+0000 7f5a28ff9700 1 -- 172.21.15.59:0/304431279 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a2001b3b0 con 0x7f5a2c0a1340 2023-09-30T22:31:12.528 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.530+0000 7f5a329fe700 1 -- 172.21.15.59:0/304431279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0a1340 msgr2=0x7f5a2c1c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.530+0000 7f5a329fe700 1 --2- 172.21.15.59:0/304431279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0a1340 0x7f5a2c1c88c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000e9b0 tx=0x7f5a2000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.530+0000 7f5a329fe700 1 -- 172.21.15.59:0/304431279 shutdown_connections 2023-09-30T22:31:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.530+0000 7f5a329fe700 1 --2- 172.21.15.59:0/304431279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a2c0a0a30 0x7f5a2c1c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.530+0000 7f5a329fe700 1 --2- 172.21.15.59:0/304431279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2c133fa0 0x7f5a2c1c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.530+0000 7f5a329fe700 1 --2- 172.21.15.59:0/304431279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0a1340 0x7f5a2c1c88c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.530+0000 7f5a329fe700 1 -- 172.21.15.59:0/304431279 >> 172.21.15.59:0/304431279 conn(0x7f5a2c0a6550 msgr2=0x7f5a2c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.531+0000 7f5a329fe700 1 -- 172.21.15.59:0/304431279 shutdown_connections 2023-09-30T22:31:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.531+0000 7f5a329fe700 1 -- 172.21.15.59:0/304431279 wait complete. 2023-09-30T22:31:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.543+0000 7f25adcba700 1 -- 172.21.15.59:0/3960325500 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f25a809c9a0 con 0x7f25a806f5d0 2023-09-30T22:31:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.543+0000 7f25a4ff9700 1 -- 172.21.15.59:0/3960325500 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25a809c9a0 con 0x7f25a806f5d0 2023-09-30T22:31:12.544 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:12.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.546+0000 7f25adcba700 1 -- 172.21.15.59:0/3960325500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a806f5d0 msgr2=0x7f25a8127100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.546+0000 7f25adcba700 1 --2- 172.21.15.59:0/3960325500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a806f5d0 0x7f25a8127100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f259800c4e0 tx=0x7f259800c7f0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.546+0000 7f25adcba700 1 -- 172.21.15.59:0/3960325500 shutdown_connections 2023-09-30T22:31:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.546+0000 7f25adcba700 1 --2- 172.21.15.59:0/3960325500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a8135c20 0x7f25a81c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.546+0000 7f25adcba700 1 --2- 172.21.15.59:0/3960325500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a806f5d0 0x7f25a8127100 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.546+0000 7f25adcba700 1 --2- 172.21.15.59:0/3960325500 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25a812cf60 0x7f25a8127640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.546+0000 7f25adcba700 1 -- 172.21.15.59:0/3960325500 >> 172.21.15.59:0/3960325500 conn(0x7f25a80a2aa0 msgr2=0x7f25a812a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.547+0000 7f25adcba700 1 -- 172.21.15.59:0/3960325500 shutdown_connections 2023-09-30T22:31:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.547+0000 7f25adcba700 1 -- 172.21.15.59:0/3960325500 wait complete. 2023-09-30T22:31:12.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:12.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:12.735 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.878+0000 7efe112bb700 1 Processor -- start 2023-09-30T22:31:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.878+0000 7efe112bb700 1 -- start start 2023-09-30T22:31:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe112bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe0c09d6f0 0x7efe0c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe112bb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe0c09e000 0x7efe0c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe112bb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe0c09e410 0x7efe0c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe112bb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0c09f520 con 0x7efe0c09e410 2023-09-30T22:31:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe112bb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c09f130 con 0x7efe0c09d6f0 2023-09-30T22:31:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe112bb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c09e930 con 0x7efe0c09e000 2023-09-30T22:31:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe0b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe0c09e410 0x7efe0c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe0affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe0c09d6f0 0x7efe0c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe0a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe0c09e000 0x7efe0c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe0affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe0c09d6f0 0x7efe0c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48166/0 (socket says 172.21.15.59:48166) 2023-09-30T22:31:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe0affd700 1 -- 172.21.15.59:0/3040120338 learned_addr learned my addr 172.21.15.59:0/3040120338 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe0b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe0c09e410 0x7efe0c130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36746/0 (socket says 172.21.15.59:36746) 2023-09-30T22:31:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe0a7fc700 1 -- 172.21.15.59:0/3040120338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe0c09d6f0 msgr2=0x7efe0c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe0a7fc700 1 --2- 172.21.15.59:0/3040120338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe0c09d6f0 0x7efe0c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe0a7fc700 1 -- 172.21.15.59:0/3040120338 >> v2:172.21.15.59:3300/0 conn(0x7efe0c09e410 msgr2=0x7efe0c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe0a7fc700 1 --2- 172.21.15.59:0/3040120338 >> v2:172.21.15.59:3300/0 conn(0x7efe0c09e410 0x7efe0c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe0a7fc700 1 -- 172.21.15.59:0/3040120338 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c09b2d0 con 0x7efe0c09e000 2023-09-30T22:31:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe0b7fe700 1 --2- 172.21.15.59:0/3040120338 >> v2:172.21.15.59:3300/0 conn(0x7efe0c09e410 0x7efe0c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:12.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.879+0000 7efe0affd700 1 --2- 172.21.15.59:0/3040120338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe0c09d6f0 0x7efe0c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:12.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.880+0000 7efe0a7fc700 1 --2- 172.21.15.59:0/3040120338 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe0c09e000 0x7efe0c130660 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efdf400bb10 tx=0x7efdf400be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74beae27523e4dea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:12.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.880+0000 7efe09ffb700 1 -- 172.21.15.59:0/3040120338 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf400dc30 con 0x7efe0c09e000 2023-09-30T22:31:12.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.880+0000 7efe09ffb700 1 -- 172.21.15.59:0/3040120338 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf400dd90 con 0x7efe0c09e000 2023-09-30T22:31:12.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.880+0000 7efe09ffb700 1 -- 172.21.15.59:0/3040120338 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4010690 con 0x7efe0c09e000 2023-09-30T22:31:12.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.880+0000 7efe112bb700 1 -- 172.21.15.59:0/3040120338 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe0c09e000 msgr2=0x7efe0c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.880+0000 7efe112bb700 1 --2- 172.21.15.59:0/3040120338 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe0c09e000 0x7efe0c130660 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efdf400bb10 tx=0x7efdf400be20 comp rx=0 tx=0).stop 2023-09-30T22:31:12.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.880+0000 7efe112bb700 1 -- 172.21.15.59:0/3040120338 shutdown_connections 2023-09-30T22:31:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.880+0000 7efe112bb700 1 --2- 172.21.15.59:0/3040120338 >> v2:172.21.15.59:3300/0 conn(0x7efe0c09e410 0x7efe0c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.880+0000 7efe112bb700 1 --2- 172.21.15.59:0/3040120338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe0c09d6f0 0x7efe0c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.880+0000 7efe112bb700 1 --2- 172.21.15.59:0/3040120338 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe0c09e000 0x7efe0c130660 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.880+0000 7efe112bb700 1 -- 172.21.15.59:0/3040120338 >> 172.21.15.59:0/3040120338 conn(0x7efe0c066f50 msgr2=0x7efe0c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.880+0000 7efe112bb700 1 -- 172.21.15.59:0/3040120338 shutdown_connections 2023-09-30T22:31:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.880+0000 7efe112bb700 1 -- 172.21.15.59:0/3040120338 wait complete. 2023-09-30T22:31:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.882+0000 7efe112bb700 1 Processor -- start 2023-09-30T22:31:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.882+0000 7efe112bb700 1 -- start start 2023-09-30T22:31:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.882+0000 7efe112bb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c09d6f0 0x7efe0c11e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.882+0000 7efe112bb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe0c09e000 0x7efe0c11e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.882+0000 7efe112bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe0c09e410 0x7efe0c11eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.882+0000 7efe112bb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c120590 con 0x7efe0c09d6f0 2023-09-30T22:31:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.882+0000 7efe112bb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c09c700 con 0x7efe0c09e410 2023-09-30T22:31:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.882+0000 7efe112bb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c120270 con 0x7efe0c09e000 2023-09-30T22:31:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.882+0000 7efe0affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c09d6f0 0x7efe0c11e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.882+0000 7efe0a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe0c09e000 0x7efe0c11e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.882+0000 7efe0a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe0c09e000 0x7efe0c11e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35318/0 (socket says 172.21.15.59:35318) 2023-09-30T22:31:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.882+0000 7efe0b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe0c09e410 0x7efe0c11eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.882+0000 7efe0a7fc700 1 -- 172.21.15.59:0/63507684 learned_addr learned my addr 172.21.15.59:0/63507684 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.882+0000 7efe0affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c09d6f0 0x7efe0c11e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36756/0 (socket says 172.21.15.59:36756) 2023-09-30T22:31:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.883+0000 7efe0a7fc700 1 -- 172.21.15.59:0/63507684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe0c09e410 msgr2=0x7efe0c11eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.883+0000 7efe0a7fc700 1 --2- 172.21.15.59:0/63507684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe0c09e410 0x7efe0c11eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.883+0000 7efe0a7fc700 1 -- 172.21.15.59:0/63507684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c09d6f0 msgr2=0x7efe0c11e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.883+0000 7efe0a7fc700 1 --2- 172.21.15.59:0/63507684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c09d6f0 0x7efe0c11e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.883+0000 7efe0a7fc700 1 -- 172.21.15.59:0/63507684 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc009550 con 0x7efe0c09e000 2023-09-30T22:31:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.883+0000 7efe0b7fe700 1 --2- 172.21.15.59:0/63507684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe0c09e410 0x7efe0c11eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.883+0000 7efe0a7fc700 1 --2- 172.21.15.59:0/63507684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe0c09e000 0x7efe0c11e5f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efdf4000c00 tx=0x7efdf4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.883+0000 7efe037fe700 1 -- 172.21.15.59:0/63507684 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf401f070 con 0x7efe0c09e000 2023-09-30T22:31:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.883+0000 7efe037fe700 1 -- 172.21.15.59:0/63507684 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf40038b0 con 0x7efe0c09e000 2023-09-30T22:31:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.883+0000 7efe112bb700 1 -- 172.21.15.59:0/63507684 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe04009a70 con 0x7efe0c09e000 2023-09-30T22:31:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.883+0000 7efe037fe700 1 -- 172.21.15.59:0/63507684 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4003c60 con 0x7efe0c09e000 2023-09-30T22:31:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.883+0000 7efe112bb700 1 -- 172.21.15.59:0/63507684 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf400b740 con 0x7efe0c09e000 2023-09-30T22:31:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.884+0000 7efe037fe700 1 -- 172.21.15.59:0/63507684 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efdf402c430 con 0x7efe0c09e000 2023-09-30T22:31:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.884+0000 7efe037fe700 1 -- 172.21.15.59:0/63507684 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efdf4042560 con 0x7efe0c09e000 2023-09-30T22:31:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.884+0000 7efe112bb700 1 -- 172.21.15.59:0/63507684 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0c121540 con 0x7efe0c09e000 2023-09-30T22:31:12.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:12.889+0000 7efe037fe700 1 -- 172.21.15.59:0/63507684 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efdf402c6e0 con 0x7efe0c09e000 2023-09-30T22:31:13.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.094+0000 7efe112bb700 1 -- 172.21.15.59:0/63507684 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe0c074ea0 con 0x7efe0c09e000 2023-09-30T22:31:13.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.094+0000 7efe037fe700 1 -- 172.21.15.59:0/63507684 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efdf400eb50 con 0x7efe0c09e000 2023-09-30T22:31:13.097 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:13.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.097+0000 7efe112bb700 1 -- 172.21.15.59:0/63507684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe0c09e000 msgr2=0x7efe0c11e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.097+0000 7efe112bb700 1 --2- 172.21.15.59:0/63507684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe0c09e000 0x7efe0c11e5f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efdf4000c00 tx=0x7efdf4004750 comp rx=0 tx=0).stop 2023-09-30T22:31:13.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.097+0000 7efe112bb700 1 -- 172.21.15.59:0/63507684 shutdown_connections 2023-09-30T22:31:13.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.097+0000 7efe112bb700 1 --2- 172.21.15.59:0/63507684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe0c09e410 0x7efe0c11eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.097+0000 7efe112bb700 1 --2- 172.21.15.59:0/63507684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe0c09d6f0 0x7efe0c11e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.097+0000 7efe112bb700 1 --2- 172.21.15.59:0/63507684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe0c09e000 0x7efe0c11e5f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.097+0000 7efe112bb700 1 -- 172.21.15.59:0/63507684 >> 172.21.15.59:0/63507684 conn(0x7efe0c066f50 msgr2=0x7efe0c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:13.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.097+0000 7efe112bb700 1 -- 172.21.15.59:0/63507684 shutdown_connections 2023-09-30T22:31:13.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.097+0000 7efe112bb700 1 -- 172.21.15.59:0/63507684 wait complete. 2023-09-30T22:31:13.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:13.514 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:13.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:13.561 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:13.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.663+0000 7fefe20bf700 1 Processor -- start 2023-09-30T22:31:13.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.663+0000 7fefe20bf700 1 -- start start 2023-09-30T22:31:13.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.663+0000 7fefe20bf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fefdc09e930 0x7fefdc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.663+0000 7fefe20bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefdc09f240 0x7fefdc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.663+0000 7fefe20bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefdc09f650 0x7fefdc131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.663+0000 7fefe20bf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefdc070940 con 0x7fefdc09e930 2023-09-30T22:31:13.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.663+0000 7fefe20bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc06fd60 con 0x7fefdc09f650 2023-09-30T22:31:13.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.663+0000 7fefe20bf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc06fa80 con 0x7fefdc09f240 2023-09-30T22:31:13.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.664+0000 7fefdb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fefdc09e930 0x7fefdc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.664+0000 7fefdaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefdc09f240 0x7fefdc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.664+0000 7fefdb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fefdc09e930 0x7fefdc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36760/0 (socket says 172.21.15.59:36760) 2023-09-30T22:31:13.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.664+0000 7fefdbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefdc09f650 0x7fefdc131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.664+0000 7fefdb7fe700 1 -- 172.21.15.59:0/3242276060 learned_addr learned my addr 172.21.15.59:0/3242276060 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:13.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.664+0000 7fefdaffd700 1 -- 172.21.15.59:0/3242276060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefdc09f650 msgr2=0x7fefdc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:13.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.664+0000 7fefdaffd700 1 --2- 172.21.15.59:0/3242276060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefdc09f650 0x7fefdc131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.664+0000 7fefdaffd700 1 -- 172.21.15.59:0/3242276060 >> v2:172.21.15.59:3300/0 conn(0x7fefdc09e930 msgr2=0x7fefdc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:13.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.664+0000 7fefdaffd700 1 --2- 172.21.15.59:0/3242276060 >> v2:172.21.15.59:3300/0 conn(0x7fefdc09e930 0x7fefdc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.664+0000 7fefdaffd700 1 -- 172.21.15.59:0/3242276060 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc09fb60 con 0x7fefdc09f240 2023-09-30T22:31:13.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.664+0000 7fefdb7fe700 1 --2- 172.21.15.59:0/3242276060 >> v2:172.21.15.59:3300/0 conn(0x7fefdc09e930 0x7fefdc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:13.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.664+0000 7fefdaffd700 1 --2- 172.21.15.59:0/3242276060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefdc09f240 0x7fefdc1317f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009840 tx=0x7fefd0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d04d16b2a8e94d40 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:13.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.664+0000 7fefda7fc700 1 -- 172.21.15.59:0/3242276060 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0011830 con 0x7fefdc09f240 2023-09-30T22:31:13.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.664+0000 7fefda7fc700 1 -- 172.21.15.59:0/3242276060 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd0011990 con 0x7fefdc09f240 2023-09-30T22:31:13.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.664+0000 7fefda7fc700 1 -- 172.21.15.59:0/3242276060 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0011d20 con 0x7fefdc09f240 2023-09-30T22:31:13.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.665+0000 7fefe20bf700 1 -- 172.21.15.59:0/3242276060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefdc09f240 msgr2=0x7fefdc1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.665+0000 7fefe20bf700 1 --2- 172.21.15.59:0/3242276060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefdc09f240 0x7fefdc1317f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009840 tx=0x7fefd0009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:13.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.665+0000 7fefe20bf700 1 -- 172.21.15.59:0/3242276060 shutdown_connections 2023-09-30T22:31:13.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.665+0000 7fefe20bf700 1 --2- 172.21.15.59:0/3242276060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefdc09f650 0x7fefdc131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.665+0000 7fefe20bf700 1 --2- 172.21.15.59:0/3242276060 >> v2:172.21.15.59:3300/0 conn(0x7fefdc09e930 0x7fefdc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.665+0000 7fefe20bf700 1 --2- 172.21.15.59:0/3242276060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefdc09f240 0x7fefdc1317f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.665+0000 7fefe20bf700 1 -- 172.21.15.59:0/3242276060 >> 172.21.15.59:0/3242276060 conn(0x7fefdc0a4210 msgr2=0x7fefdc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:13.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.665+0000 7fefe20bf700 1 -- 172.21.15.59:0/3242276060 shutdown_connections 2023-09-30T22:31:13.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.665+0000 7fefe20bf700 1 -- 172.21.15.59:0/3242276060 wait complete. 2023-09-30T22:31:13.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.666+0000 7fefe20bf700 1 Processor -- start 2023-09-30T22:31:13.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.667+0000 7fefe20bf700 1 -- start start 2023-09-30T22:31:13.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.667+0000 7fefe20bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefdc09e930 0x7fefdc1a3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.667+0000 7fefe20bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefdc09f240 0x7fefdc1a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.667+0000 7fefe20bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefdc09f650 0x7fefdc1a4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.667+0000 7fefe20bf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc1a58a0 con 0x7fefdc09e930 2023-09-30T22:31:13.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.667+0000 7fefe20bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc1a52c0 con 0x7fefdc09f650 2023-09-30T22:31:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.667+0000 7fefe20bf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc1a7310 con 0x7fefdc09f240 2023-09-30T22:31:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.667+0000 7fefdb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefdc09e930 0x7fefdc1a3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.667+0000 7fefdaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefdc09f240 0x7fefdc1a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.667+0000 7fefdb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefdc09e930 0x7fefdc1a3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36774/0 (socket says 172.21.15.59:36774) 2023-09-30T22:31:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.667+0000 7fefdb7fe700 1 -- 172.21.15.59:0/2970116719 learned_addr learned my addr 172.21.15.59:0/2970116719 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:13.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.667+0000 7fefdbfff700 1 --2- 172.21.15.59:0/2970116719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefdc09f650 0x7fefdc1a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.668+0000 7fefdaffd700 1 -- 172.21.15.59:0/2970116719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefdc09f650 msgr2=0x7fefdc1a4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.668+0000 7fefdaffd700 1 --2- 172.21.15.59:0/2970116719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefdc09f650 0x7fefdc1a4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.668+0000 7fefdaffd700 1 -- 172.21.15.59:0/2970116719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefdc09e930 msgr2=0x7fefdc1a3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.668+0000 7fefdaffd700 1 --2- 172.21.15.59:0/2970116719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefdc09e930 0x7fefdc1a3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.668+0000 7fefdaffd700 1 -- 172.21.15.59:0/2970116719 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc009550 con 0x7fefdc09f240 2023-09-30T22:31:13.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.668+0000 7fefdb7fe700 1 --2- 172.21.15.59:0/2970116719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefdc09e930 0x7fefdc1a3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:13.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.668+0000 7fefdbfff700 1 --2- 172.21.15.59:0/2970116719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefdc09f650 0x7fefdc1a4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:13.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.668+0000 7fefdaffd700 1 --2- 172.21.15.59:0/2970116719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefdc09f240 0x7fefdc1a4350 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fefd0016000 tx=0x7fefd0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:13.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.668+0000 7fefc3fff700 1 -- 172.21.15.59:0/2970116719 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0004450 con 0x7fefdc09f240 2023-09-30T22:31:13.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.668+0000 7fefc3fff700 1 -- 172.21.15.59:0/2970116719 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd001f070 con 0x7fefdc09f240 2023-09-30T22:31:13.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.668+0000 7fefe20bf700 1 -- 172.21.15.59:0/2970116719 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd00094a0 con 0x7fefdc09f240 2023-09-30T22:31:13.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.668+0000 7fefc3fff700 1 -- 172.21.15.59:0/2970116719 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd00038e0 con 0x7fefdc09f240 2023-09-30T22:31:13.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.668+0000 7fefe20bf700 1 -- 172.21.15.59:0/2970116719 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc0a0190 con 0x7fefdc09f240 2023-09-30T22:31:13.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.669+0000 7fefc3fff700 1 -- 172.21.15.59:0/2970116719 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fefd0003a40 con 0x7fefdc09f240 2023-09-30T22:31:13.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.669+0000 7fefc3fff700 1 -- 172.21.15.59:0/2970116719 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fefd0021070 con 0x7fefdc09f240 2023-09-30T22:31:13.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.670+0000 7fefe20bf700 1 -- 172.21.15.59:0/2970116719 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefdc1a0b30 con 0x7fefdc09f240 2023-09-30T22:31:13.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.675+0000 7fefc3fff700 1 -- 172.21.15.59:0/2970116719 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fefd002b080 con 0x7fefdc09f240 2023-09-30T22:31:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.702+0000 7f5231be2700 1 Processor -- start 2023-09-30T22:31:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.702+0000 7f5231be2700 1 -- start start 2023-09-30T22:31:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.702+0000 7f5231be2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f522c0a0a30 0x7f522c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.702+0000 7f5231be2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c134170 0x7f522c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.702+0000 7f5231be2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522c09edd0 con 0x7f522c0a1340 2023-09-30T22:31:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.702+0000 7f5231be2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522c09e1f0 con 0x7f522c0a0a30 2023-09-30T22:31:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.702+0000 7f5231be2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f522c09dc50 con 0x7f522c134170 2023-09-30T22:31:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.702+0000 7f522bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c134170 0x7f522c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.702+0000 7f522b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f522c0a0a30 0x7f522c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.702+0000 7f522bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c134170 0x7f522c13bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35338/0 (socket says 172.21.15.59:35338) 2023-09-30T22:31:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.702+0000 7f522b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f522c0a0a30 0x7f522c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36790/0 (socket says 172.21.15.59:36790) 2023-09-30T22:31:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.702+0000 7f522bfff700 1 -- 172.21.15.59:0/148940656 learned_addr learned my addr 172.21.15.59:0/148940656 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.703+0000 7f522b7fe700 1 -- 172.21.15.59:0/148940656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c134170 msgr2=0x7f522c13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.703+0000 7f522b7fe700 1 --2- 172.21.15.59:0/148940656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c134170 0x7f522c13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.703+0000 7f522b7fe700 1 -- 172.21.15.59:0/148940656 >> v1:172.21.15.59:6789/0 conn(0x7f522c0a1340 legacy=0x7f522c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.703+0000 7f522b7fe700 1 -- 172.21.15.59:0/148940656 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c0a1fe0 con 0x7f522c0a0a30 2023-09-30T22:31:13.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.703+0000 7f522bfff700 1 --2- 172.21.15.59:0/148940656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c134170 0x7f522c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:13.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.703+0000 7f522b7fe700 1 --2- 172.21.15.59:0/148940656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c0a0a30 0x7f522c0a0e00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f521c009840 tx=0x7f521c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd77e4111e7cab6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:13.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.703+0000 7f522affd700 1 -- 172.21.15.59:0/148940656 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c011830 con 0x7f522c0a0a30 2023-09-30T22:31:13.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.703+0000 7f522affd700 1 -- 172.21.15.59:0/148940656 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c011990 con 0x7f522c0a0a30 2023-09-30T22:31:13.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.703+0000 7f522affd700 1 -- 172.21.15.59:0/148940656 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c011d20 con 0x7f522c0a0a30 2023-09-30T22:31:13.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.704+0000 7f5231be2700 1 -- 172.21.15.59:0/148940656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c0a0a30 msgr2=0x7f522c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.704+0000 7f5231be2700 1 --2- 172.21.15.59:0/148940656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c0a0a30 0x7f522c0a0e00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f521c009840 tx=0x7f521c009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:13.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.704+0000 7f5231be2700 1 -- 172.21.15.59:0/148940656 shutdown_connections 2023-09-30T22:31:13.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.704+0000 7f5231be2700 1 --2- 172.21.15.59:0/148940656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c134170 0x7f522c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.704+0000 7f5231be2700 1 --2- 172.21.15.59:0/148940656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c0a0a30 0x7f522c0a0e00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.704+0000 7f5231be2700 1 -- 172.21.15.59:0/148940656 >> 172.21.15.59:0/148940656 conn(0x7f522c0a6550 msgr2=0x7f522c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:13.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.704+0000 7f5231be2700 1 -- 172.21.15.59:0/148940656 shutdown_connections 2023-09-30T22:31:13.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.704+0000 7f5231be2700 1 -- 172.21.15.59:0/148940656 wait complete. 2023-09-30T22:31:13.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.705+0000 7f5231be2700 1 Processor -- start 2023-09-30T22:31:13.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.706+0000 7f5231be2700 1 -- start start 2023-09-30T22:31:13.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.706+0000 7f5231be2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c0a0a30 0x7f522c11e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.706+0000 7f5231be2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522c0a1340 0x7f522c11ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.706+0000 7f5231be2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c134170 0x7f522c11f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.706+0000 7f5231be2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c1330a0 con 0x7f522c134170 2023-09-30T22:31:13.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.706+0000 7f5231be2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c132f10 con 0x7f522c0a1340 2023-09-30T22:31:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.706+0000 7f5231be2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f522c120200 con 0x7f522c0a0a30 2023-09-30T22:31:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.707+0000 7f522b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c0a0a30 0x7f522c11e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.707+0000 7f5222ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522c0a1340 0x7f522c11ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.707+0000 7f522b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c0a0a30 0x7f522c11e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35354/0 (socket says 172.21.15.59:35354) 2023-09-30T22:31:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.707+0000 7f522b7fe700 1 -- 172.21.15.59:0/3980594947 learned_addr learned my addr 172.21.15.59:0/3980594947 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.707+0000 7f522bfff700 1 --2- 172.21.15.59:0/3980594947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c134170 0x7f522c11f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.707+0000 7f522b7fe700 1 -- 172.21.15.59:0/3980594947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522c0a1340 msgr2=0x7f522c11ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.707+0000 7f522b7fe700 1 --2- 172.21.15.59:0/3980594947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522c0a1340 0x7f522c11ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.707+0000 7f522b7fe700 1 -- 172.21.15.59:0/3980594947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c134170 msgr2=0x7f522c11f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.707+0000 7f522b7fe700 1 --2- 172.21.15.59:0/3980594947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c134170 0x7f522c11f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.707+0000 7f522b7fe700 1 -- 172.21.15.59:0/3980594947 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5224009b30 con 0x7f522c0a0a30 2023-09-30T22:31:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.707+0000 7f522bfff700 1 --2- 172.21.15.59:0/3980594947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c134170 0x7f522c11f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.707+0000 7f5222ffd700 1 --2- 172.21.15.59:0/3980594947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522c0a1340 0x7f522c11ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.707+0000 7f522b7fe700 1 --2- 172.21.15.59:0/3980594947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c0a0a30 0x7f522c11e680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f521c009fd0 tx=0x7f521c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.707+0000 7f5228ff9700 1 -- 172.21.15.59:0/3980594947 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c0036a0 con 0x7f522c0a0a30 2023-09-30T22:31:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.708+0000 7f5228ff9700 1 -- 172.21.15.59:0/3980594947 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c01f070 con 0x7f522c0a0a30 2023-09-30T22:31:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.708+0000 7f5231be2700 1 -- 172.21.15.59:0/3980594947 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521c0094a0 con 0x7f522c0a0a30 2023-09-30T22:31:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.708+0000 7f5228ff9700 1 -- 172.21.15.59:0/3980594947 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c003a60 con 0x7f522c0a0a30 2023-09-30T22:31:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.708+0000 7f5231be2700 1 -- 172.21.15.59:0/3980594947 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522c0a25e0 con 0x7f522c0a0a30 2023-09-30T22:31:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.708+0000 7f5228ff9700 1 -- 172.21.15.59:0/3980594947 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f521c003bc0 con 0x7f522c0a0a30 2023-09-30T22:31:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.709+0000 7f5228ff9700 1 -- 172.21.15.59:0/3980594947 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f521c021070 con 0x7f522c0a0a30 2023-09-30T22:31:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.709+0000 7f5231be2700 1 -- 172.21.15.59:0/3980594947 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522c0a0220 con 0x7f522c0a0a30 2023-09-30T22:31:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.714+0000 7f5228ff9700 1 -- 172.21.15.59:0/3980594947 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f521c015080 con 0x7f522c0a0a30 2023-09-30T22:31:13.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.745+0000 7fc2e8543700 1 Processor -- start 2023-09-30T22:31:13.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.745+0000 7fc2e8543700 1 -- start start 2023-09-30T22:31:13.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.745+0000 7fc2e8543700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2e009d630 0x7fc2e00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.745+0000 7fc2e8543700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2e0138d80 0x7fc2e013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.745+0000 7fc2e8543700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e00a2a70 con 0x7fc2e00a0a30 2023-09-30T22:31:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.745+0000 7fc2e8543700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e00a01d0 con 0x7fc2e0138d80 2023-09-30T22:31:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.745+0000 7fc2e8543700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e009e2b0 con 0x7fc2e009d630 2023-09-30T22:31:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.746+0000 7fc2e5ade700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2e009d630 0x7fc2e00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.746+0000 7fc2e6ae0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2e0138d80 0x7fc2e013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.746+0000 7fc2e6ae0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2e0138d80 0x7fc2e013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36798/0 (socket says 172.21.15.59:36798) 2023-09-30T22:31:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.746+0000 7fc2e6ae0700 1 -- 172.21.15.59:0/660929794 learned_addr learned my addr 172.21.15.59:0/660929794 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.746+0000 7fc2e5ade700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2e009d630 0x7fc2e00a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35370/0 (socket says 172.21.15.59:35370) 2023-09-30T22:31:13.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.746+0000 7fc2e6ae0700 1 -- 172.21.15.59:0/660929794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2e009d630 msgr2=0x7fc2e00a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:13.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.746+0000 7fc2e6ae0700 1 --2- 172.21.15.59:0/660929794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2e009d630 0x7fc2e00a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.746+0000 7fc2e6ae0700 1 -- 172.21.15.59:0/660929794 >> v1:172.21.15.59:6789/0 conn(0x7fc2e00a0a30 legacy=0x7fc2e00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.746+0000 7fc2e6ae0700 1 -- 172.21.15.59:0/660929794 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e009dc50 con 0x7fc2e0138d80 2023-09-30T22:31:13.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.746+0000 7fc2e5ade700 1 --2- 172.21.15.59:0/660929794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2e009d630 0x7fc2e00a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.746+0000 7fc2e6ae0700 1 --2- 172.21.15.59:0/660929794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2e0138d80 0x7fc2e013b160 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80098f0 tx=0x7fc2d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e79dc384aeedbf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.746+0000 7fc2e52dd700 1 -- 172.21.15.59:0/660929794 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8011830 con 0x7fc2e0138d80 2023-09-30T22:31:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.746+0000 7fc2e52dd700 1 -- 172.21.15.59:0/660929794 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d8011990 con 0x7fc2e0138d80 2023-09-30T22:31:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.746+0000 7fc2e52dd700 1 -- 172.21.15.59:0/660929794 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8011d20 con 0x7fc2e0138d80 2023-09-30T22:31:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.747+0000 7fc2e8543700 1 -- 172.21.15.59:0/660929794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2e0138d80 msgr2=0x7fc2e013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.747+0000 7fc2e8543700 1 --2- 172.21.15.59:0/660929794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2e0138d80 0x7fc2e013b160 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80098f0 tx=0x7fc2d8009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.747+0000 7fc2e8543700 1 -- 172.21.15.59:0/660929794 shutdown_connections 2023-09-30T22:31:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.747+0000 7fc2e8543700 1 --2- 172.21.15.59:0/660929794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2e0138d80 0x7fc2e013b160 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.747+0000 7fc2e8543700 1 --2- 172.21.15.59:0/660929794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2e009d630 0x7fc2e00a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.747+0000 7fc2e8543700 1 -- 172.21.15.59:0/660929794 >> 172.21.15.59:0/660929794 conn(0x7fc2e00a3050 msgr2=0x7fc2e00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.747+0000 7fc2e8543700 1 -- 172.21.15.59:0/660929794 shutdown_connections 2023-09-30T22:31:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.747+0000 7fc2e8543700 1 -- 172.21.15.59:0/660929794 wait complete. 2023-09-30T22:31:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.748+0000 7fc2e8543700 1 Processor -- start 2023-09-30T22:31:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.748+0000 7fc2e8543700 1 -- start start 2023-09-30T22:31:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e8543700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2e009d630 0x7fc2e0133750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e8543700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2e00a0a30 0x7fc2e0133c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e8543700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2e0138d80 0x7fc2e01341d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e8543700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e0134bb0 con 0x7fc2e0138d80 2023-09-30T22:31:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e8543700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e0136c40 con 0x7fc2e00a0a30 2023-09-30T22:31:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e8543700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e01389f0 con 0x7fc2e009d630 2023-09-30T22:31:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e62df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2e009d630 0x7fc2e0133750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e6ae0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2e0138d80 0x7fc2e01341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e62df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2e009d630 0x7fc2e0133750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35384/0 (socket says 172.21.15.59:35384) 2023-09-30T22:31:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e62df700 1 -- 172.21.15.59:0/3028027127 learned_addr learned my addr 172.21.15.59:0/3028027127 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e5ade700 1 --2- 172.21.15.59:0/3028027127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2e00a0a30 0x7fc2e0133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e62df700 1 -- 172.21.15.59:0/3028027127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2e00a0a30 msgr2=0x7fc2e0133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e62df700 1 --2- 172.21.15.59:0/3028027127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2e00a0a30 0x7fc2e0133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e62df700 1 -- 172.21.15.59:0/3028027127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2e0138d80 msgr2=0x7fc2e01341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e62df700 1 --2- 172.21.15.59:0/3028027127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2e0138d80 0x7fc2e01341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e62df700 1 -- 172.21.15.59:0/3028027127 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d00094a0 con 0x7fc2e009d630 2023-09-30T22:31:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.749+0000 7fc2e6ae0700 1 --2- 172.21.15.59:0/3028027127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2e0138d80 0x7fc2e01341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.750+0000 7fc2e62df700 1 --2- 172.21.15.59:0/3028027127 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2e009d630 0x7fc2e0133750 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc001ed0 tx=0x7fc2dc0021e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.750+0000 7fc2d6ffd700 1 -- 172.21.15.59:0/3028027127 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc003c00 con 0x7fc2e009d630 2023-09-30T22:31:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.750+0000 7fc2d6ffd700 1 -- 172.21.15.59:0/3028027127 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc003d60 con 0x7fc2e009d630 2023-09-30T22:31:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.750+0000 7fc2d6ffd700 1 -- 172.21.15.59:0/3028027127 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc00ab40 con 0x7fc2e009d630 2023-09-30T22:31:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.750+0000 7fc2e8543700 1 -- 172.21.15.59:0/3028027127 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d8009550 con 0x7fc2e009d630 2023-09-30T22:31:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.750+0000 7fc2e8543700 1 -- 172.21.15.59:0/3028027127 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e00a0410 con 0x7fc2e009d630 2023-09-30T22:31:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.751+0000 7fc2d6ffd700 1 -- 172.21.15.59:0/3028027127 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2dc00aca0 con 0x7fc2e009d630 2023-09-30T22:31:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.751+0000 7fc2e8543700 1 -- 172.21.15.59:0/3028027127 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e00747f0 con 0x7fc2e009d630 2023-09-30T22:31:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.751+0000 7fc2d6ffd700 1 -- 172.21.15.59:0/3028027127 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc2dc03f750 con 0x7fc2e009d630 2023-09-30T22:31:13.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.756+0000 7fc2d6ffd700 1 -- 172.21.15.59:0/3028027127 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2dc0198f0 con 0x7fc2e009d630 2023-09-30T22:31:13.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.891+0000 7fefe20bf700 1 -- 172.21.15.59:0/2970116719 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fefdc074ea0 con 0x7fefdc09f240 2023-09-30T22:31:13.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.891+0000 7fefc3fff700 1 -- 172.21.15.59:0/2970116719 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fefd0015020 con 0x7fefdc09f240 2023-09-30T22:31:13.892 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:13.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.893+0000 7fefe20bf700 1 -- 172.21.15.59:0/2970116719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefdc09f240 msgr2=0x7fefdc1a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.893+0000 7fefe20bf700 1 --2- 172.21.15.59:0/2970116719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefdc09f240 0x7fefdc1a4350 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fefd0016000 tx=0x7fefd0004750 comp rx=0 tx=0).stop 2023-09-30T22:31:13.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.894+0000 7fefe20bf700 1 -- 172.21.15.59:0/2970116719 shutdown_connections 2023-09-30T22:31:13.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.894+0000 7fefe20bf700 1 --2- 172.21.15.59:0/2970116719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefdc09f650 0x7fefdc1a4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.894+0000 7fefe20bf700 1 --2- 172.21.15.59:0/2970116719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefdc09e930 0x7fefdc1a3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.894+0000 7fefe20bf700 1 --2- 172.21.15.59:0/2970116719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefdc09f240 0x7fefdc1a4350 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.894+0000 7fefe20bf700 1 -- 172.21.15.59:0/2970116719 >> 172.21.15.59:0/2970116719 conn(0x7fefdc0a4210 msgr2=0x7fefdc1b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:13.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.894+0000 7fefe20bf700 1 -- 172.21.15.59:0/2970116719 shutdown_connections 2023-09-30T22:31:13.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.894+0000 7fefe20bf700 1 -- 172.21.15.59:0/2970116719 wait complete. 2023-09-30T22:31:13.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.926+0000 7f5231be2700 1 -- 172.21.15.59:0/3980594947 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f522c074ea0 con 0x7f522c0a0a30 2023-09-30T22:31:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.927+0000 7f5228ff9700 1 -- 172.21.15.59:0/3980594947 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f521c035090 con 0x7f522c0a0a30 2023-09-30T22:31:13.928 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.929+0000 7f5231be2700 1 -- 172.21.15.59:0/3980594947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c0a0a30 msgr2=0x7f522c11e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.929+0000 7f5231be2700 1 --2- 172.21.15.59:0/3980594947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c0a0a30 0x7f522c11e680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f521c009fd0 tx=0x7f521c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.929+0000 7f5231be2700 1 -- 172.21.15.59:0/3980594947 shutdown_connections 2023-09-30T22:31:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.929+0000 7f5231be2700 1 --2- 172.21.15.59:0/3980594947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f522c0a0a30 0x7f522c11e680 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.929+0000 7f5231be2700 1 --2- 172.21.15.59:0/3980594947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f522c134170 0x7f522c11f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.929+0000 7f5231be2700 1 --2- 172.21.15.59:0/3980594947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522c0a1340 0x7f522c11ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.929+0000 7f5231be2700 1 -- 172.21.15.59:0/3980594947 >> 172.21.15.59:0/3980594947 conn(0x7f522c0a6550 msgr2=0x7f522c1b9300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.929+0000 7f5231be2700 1 -- 172.21.15.59:0/3980594947 shutdown_connections 2023-09-30T22:31:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.929+0000 7f5231be2700 1 -- 172.21.15.59:0/3980594947 wait complete. 2023-09-30T22:31:13.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:13.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.983+0000 7fc2e8543700 1 -- 172.21.15.59:0/3028027127 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc2e0072980 con 0x7fc2e009d630 2023-09-30T22:31:13.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.984+0000 7fc2d6ffd700 1 -- 172.21.15.59:0/3028027127 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2dc019300 con 0x7fc2e009d630 2023-09-30T22:31:13.985 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:13.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.986+0000 7fc2e8543700 1 -- 172.21.15.59:0/3028027127 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2e009d630 msgr2=0x7fc2e0133750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.986+0000 7fc2e8543700 1 --2- 172.21.15.59:0/3028027127 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2e009d630 0x7fc2e0133750 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc001ed0 tx=0x7fc2dc0021e0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.986+0000 7fc2e8543700 1 -- 172.21.15.59:0/3028027127 shutdown_connections 2023-09-30T22:31:13.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.986+0000 7fc2e8543700 1 --2- 172.21.15.59:0/3028027127 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2e009d630 0x7fc2e0133750 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.986+0000 7fc2e8543700 1 --2- 172.21.15.59:0/3028027127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2e0138d80 0x7fc2e01341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.986+0000 7fc2e8543700 1 --2- 172.21.15.59:0/3028027127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2e00a0a30 0x7fc2e0133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.986+0000 7fc2e8543700 1 -- 172.21.15.59:0/3028027127 >> 172.21.15.59:0/3028027127 conn(0x7fc2e00a3050 msgr2=0x7fc2e009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:13.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.986+0000 7fc2e8543700 1 -- 172.21.15.59:0/3028027127 shutdown_connections 2023-09-30T22:31:13.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:13.986+0000 7fc2e8543700 1 -- 172.21.15.59:0/3028027127 wait complete. 2023-09-30T22:31:14.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:14.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:14.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.255+0000 7fd2e5556700 1 Processor -- start 2023-09-30T22:31:14.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.255+0000 7fd2e5556700 1 -- start start 2023-09-30T22:31:14.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.255+0000 7fd2e5556700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2e00a09c0 0x7fd2e006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.255+0000 7fd2e5556700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2e00a0d90 0x7fd2e00a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.255+0000 7fd2e5556700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e00a2a20 con 0x7fd2e01338a0 2023-09-30T22:31:14.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.255+0000 7fd2e5556700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e009e690 con 0x7fd2e00a09c0 2023-09-30T22:31:14.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.255+0000 7fd2e5556700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e00a1cc0 con 0x7fd2e00a0d90 2023-09-30T22:31:14.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.256+0000 7fd2de7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2e00a0d90 0x7fd2e00a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.256+0000 7fd2deffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2e00a09c0 0x7fd2e006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.256+0000 7fd2deffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2e00a09c0 0x7fd2e006c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36820/0 (socket says 172.21.15.59:36820) 2023-09-30T22:31:14.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.256+0000 7fd2de7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2e00a0d90 0x7fd2e00a11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35386/0 (socket says 172.21.15.59:35386) 2023-09-30T22:31:14.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.256+0000 7fd2deffd700 1 -- 172.21.15.59:0/3535901288 learned_addr learned my addr 172.21.15.59:0/3535901288 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:14.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.256+0000 7fd2de7fc700 1 -- 172.21.15.59:0/3535901288 >> v2:172.21.15.59:3300/0 conn(0x7fd2e00a09c0 msgr2=0x7fd2e006c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:14.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.256+0000 7fd2de7fc700 1 --2- 172.21.15.59:0/3535901288 >> v2:172.21.15.59:3300/0 conn(0x7fd2e00a09c0 0x7fd2e006c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.256+0000 7fd2de7fc700 1 -- 172.21.15.59:0/3535901288 >> v1:172.21.15.59:6789/0 conn(0x7fd2e01338a0 legacy=0x7fd2e0133d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.256+0000 7fd2de7fc700 1 -- 172.21.15.59:0/3535901288 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e00a1f40 con 0x7fd2e00a0d90 2023-09-30T22:31:14.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.256+0000 7fd2deffd700 1 --2- 172.21.15.59:0/3535901288 >> v2:172.21.15.59:3300/0 conn(0x7fd2e00a09c0 0x7fd2e006c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:14.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.256+0000 7fd2de7fc700 1 --2- 172.21.15.59:0/3535901288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2e00a0d90 0x7fd2e00a11c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009840 tx=0x7fd2c8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdc9544e62595a0e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:14.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.256+0000 7fd2ddffb700 1 -- 172.21.15.59:0/3535901288 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8011830 con 0x7fd2e00a0d90 2023-09-30T22:31:14.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.256+0000 7fd2ddffb700 1 -- 172.21.15.59:0/3535901288 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c8011990 con 0x7fd2e00a0d90 2023-09-30T22:31:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.256+0000 7fd2ddffb700 1 -- 172.21.15.59:0/3535901288 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8011d20 con 0x7fd2e00a0d90 2023-09-30T22:31:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.257+0000 7fd2e5556700 1 -- 172.21.15.59:0/3535901288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2e00a0d90 msgr2=0x7fd2e00a11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.257+0000 7fd2e5556700 1 --2- 172.21.15.59:0/3535901288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2e00a0d90 0x7fd2e00a11c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009840 tx=0x7fd2c8009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.257+0000 7fd2e5556700 1 -- 172.21.15.59:0/3535901288 shutdown_connections 2023-09-30T22:31:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.257+0000 7fd2e5556700 1 --2- 172.21.15.59:0/3535901288 >> v2:172.21.15.59:3300/0 conn(0x7fd2e00a09c0 0x7fd2e006c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.257+0000 7fd2e5556700 1 --2- 172.21.15.59:0/3535901288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2e00a0d90 0x7fd2e00a11c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.257+0000 7fd2e5556700 1 -- 172.21.15.59:0/3535901288 >> 172.21.15.59:0/3535901288 conn(0x7fd2e00a60c0 msgr2=0x7fd2e00a64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.257+0000 7fd2e5556700 1 -- 172.21.15.59:0/3535901288 shutdown_connections 2023-09-30T22:31:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.257+0000 7fd2e5556700 1 -- 172.21.15.59:0/3535901288 wait complete. 2023-09-30T22:31:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.258+0000 7fd2e5556700 1 Processor -- start 2023-09-30T22:31:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.258+0000 7fd2e5556700 1 -- start start 2023-09-30T22:31:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2e5556700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2e00a09c0 0x7fd2e0121240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2e5556700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2e00a0d90 0x7fd2e0121780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2e5556700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e01338a0 0x7fd2e0121cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2e5556700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e0124b10 con 0x7fd2e01338a0 2023-09-30T22:31:14.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2e5556700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e0123c00 con 0x7fd2e00a0d90 2023-09-30T22:31:14.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2e5556700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e0122ea0 con 0x7fd2e00a09c0 2023-09-30T22:31:14.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2deffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2e00a09c0 0x7fd2e0121240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2deffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2e00a09c0 0x7fd2e0121240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35400/0 (socket says 172.21.15.59:35400) 2023-09-30T22:31:14.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2deffd700 1 -- 172.21.15.59:0/3911207743 learned_addr learned my addr 172.21.15.59:0/3911207743 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:14.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2de7fc700 1 --2- 172.21.15.59:0/3911207743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2e00a0d90 0x7fd2e0121780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2df7fe700 1 --2- 172.21.15.59:0/3911207743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e01338a0 0x7fd2e0121cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2deffd700 1 -- 172.21.15.59:0/3911207743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2e00a0d90 msgr2=0x7fd2e0121780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2deffd700 1 --2- 172.21.15.59:0/3911207743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2e00a0d90 0x7fd2e0121780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2deffd700 1 -- 172.21.15.59:0/3911207743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e01338a0 msgr2=0x7fd2e0121cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2deffd700 1 --2- 172.21.15.59:0/3911207743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e01338a0 0x7fd2e0121cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2deffd700 1 -- 172.21.15.59:0/3911207743 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0009550 con 0x7fd2e00a09c0 2023-09-30T22:31:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2de7fc700 1 --2- 172.21.15.59:0/3911207743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2e00a0d90 0x7fd2e0121780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.259+0000 7fd2deffd700 1 --2- 172.21.15.59:0/3911207743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2e00a09c0 0x7fd2e0121240 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000ebe0 tx=0x7fd2d000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.260+0000 7fd2d77fe700 1 -- 172.21.15.59:0/3911207743 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000c850 con 0x7fd2e00a09c0 2023-09-30T22:31:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.260+0000 7fd2d77fe700 1 -- 172.21.15.59:0/3911207743 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d000c9b0 con 0x7fd2e00a09c0 2023-09-30T22:31:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.260+0000 7fd2e5556700 1 -- 172.21.15.59:0/3911207743 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c80094a0 con 0x7fd2e00a09c0 2023-09-30T22:31:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.260+0000 7fd2d77fe700 1 -- 172.21.15.59:0/3911207743 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000cd40 con 0x7fd2e00a09c0 2023-09-30T22:31:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.260+0000 7fd2e5556700 1 -- 172.21.15.59:0/3911207743 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e009dea0 con 0x7fd2e00a09c0 2023-09-30T22:31:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.261+0000 7fd2d77fe700 1 -- 172.21.15.59:0/3911207743 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2d0013470 con 0x7fd2e00a09c0 2023-09-30T22:31:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.261+0000 7fd2d77fe700 1 -- 172.21.15.59:0/3911207743 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd2d003f880 con 0x7fd2e00a09c0 2023-09-30T22:31:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.261+0000 7fd2e5556700 1 -- 172.21.15.59:0/3911207743 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e011ded0 con 0x7fd2e00a09c0 2023-09-30T22:31:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.266+0000 7fd2d77fe700 1 -- 172.21.15.59:0/3911207743 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2d0017080 con 0x7fd2e00a09c0 2023-09-30T22:31:14.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.469+0000 7fd2e5556700 1 -- 172.21.15.59:0/3911207743 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd2e00a1680 con 0x7fd2e00a09c0 2023-09-30T22:31:14.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.469+0000 7fd2d77fe700 1 -- 172.21.15.59:0/3911207743 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd2d0021020 con 0x7fd2e00a09c0 2023-09-30T22:31:14.470 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.471+0000 7fd2e5556700 1 -- 172.21.15.59:0/3911207743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2e00a09c0 msgr2=0x7fd2e0121240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.471+0000 7fd2e5556700 1 --2- 172.21.15.59:0/3911207743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2e00a09c0 0x7fd2e0121240 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000ebe0 tx=0x7fd2d000eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.471+0000 7fd2e5556700 1 -- 172.21.15.59:0/3911207743 shutdown_connections 2023-09-30T22:31:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.471+0000 7fd2e5556700 1 --2- 172.21.15.59:0/3911207743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2e00a09c0 0x7fd2e0121240 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.471+0000 7fd2e5556700 1 --2- 172.21.15.59:0/3911207743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e01338a0 0x7fd2e0121cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.471+0000 7fd2e5556700 1 --2- 172.21.15.59:0/3911207743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2e00a0d90 0x7fd2e0121780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.471+0000 7fd2e5556700 1 -- 172.21.15.59:0/3911207743 >> 172.21.15.59:0/3911207743 conn(0x7fd2e00a60c0 msgr2=0x7fd2e01330f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.471+0000 7fd2e5556700 1 -- 172.21.15.59:0/3911207743 shutdown_connections 2023-09-30T22:31:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:14.471+0000 7fd2e5556700 1 -- 172.21.15.59:0/3911207743 wait complete. 2023-09-30T22:31:14.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:14.914 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:14.949 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:15.002 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.065+0000 7fc439b17700 1 Processor -- start 2023-09-30T22:31:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.065+0000 7fc439b17700 1 -- start start 2023-09-30T22:31:15.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.065+0000 7fc439b17700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4340a0a30 0x7fc4340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.065+0000 7fc439b17700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4340a1340 0x7fc434133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.065+0000 7fc439b17700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43409edd0 con 0x7fc434133fa0 2023-09-30T22:31:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.065+0000 7fc439b17700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43409e1f0 con 0x7fc4340a0a30 2023-09-30T22:31:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.065+0000 7fc439b17700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc43409dc50 con 0x7fc4340a1340 2023-09-30T22:31:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.065+0000 7fc432ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4340a1340 0x7fc434133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.065+0000 7fc432ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4340a1340 0x7fc434133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41550/0 (socket says 172.21.15.59:41550) 2023-09-30T22:31:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.065+0000 7fc432ffd700 1 -- 172.21.15.59:0/547538022 learned_addr learned my addr 172.21.15.59:0/547538022 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.066+0000 7fc4337fe700 1 --2- 172.21.15.59:0/547538022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4340a0a30 0x7fc4340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.066+0000 7fc432ffd700 1 -- 172.21.15.59:0/547538022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4340a0a30 msgr2=0x7fc4340a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.066+0000 7fc432ffd700 1 --2- 172.21.15.59:0/547538022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4340a0a30 0x7fc4340a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.066+0000 7fc432ffd700 1 -- 172.21.15.59:0/547538022 >> v1:172.21.15.59:6789/0 conn(0x7fc434133fa0 legacy=0x7fc43413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.066+0000 7fc432ffd700 1 -- 172.21.15.59:0/547538022 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4340a1fe0 con 0x7fc4340a1340 2023-09-30T22:31:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.066+0000 7fc4337fe700 1 --2- 172.21.15.59:0/547538022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4340a0a30 0x7fc4340a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.066+0000 7fc432ffd700 1 --2- 172.21.15.59:0/547538022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4340a1340 0x7fc434133a60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc428009920 tx=0x7fc428009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4af21e888f9e006e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.066+0000 7fc4327fc700 1 -- 172.21.15.59:0/547538022 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc428011830 con 0x7fc4340a1340 2023-09-30T22:31:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.066+0000 7fc4327fc700 1 -- 172.21.15.59:0/547538022 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc428011990 con 0x7fc4340a1340 2023-09-30T22:31:15.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.066+0000 7fc4327fc700 1 -- 172.21.15.59:0/547538022 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc428011d20 con 0x7fc4340a1340 2023-09-30T22:31:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.067+0000 7fc439b17700 1 -- 172.21.15.59:0/547538022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4340a1340 msgr2=0x7fc434133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.067+0000 7fc439b17700 1 --2- 172.21.15.59:0/547538022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4340a1340 0x7fc434133a60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc428009920 tx=0x7fc428009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.067+0000 7fc439b17700 1 -- 172.21.15.59:0/547538022 shutdown_connections 2023-09-30T22:31:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.067+0000 7fc439b17700 1 --2- 172.21.15.59:0/547538022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4340a0a30 0x7fc4340a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.067+0000 7fc439b17700 1 --2- 172.21.15.59:0/547538022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4340a1340 0x7fc434133a60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.067+0000 7fc439b17700 1 -- 172.21.15.59:0/547538022 >> 172.21.15.59:0/547538022 conn(0x7fc4340a6550 msgr2=0x7fc4340a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.067+0000 7fc439b17700 1 -- 172.21.15.59:0/547538022 shutdown_connections 2023-09-30T22:31:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.067+0000 7fc439b17700 1 -- 172.21.15.59:0/547538022 wait complete. 2023-09-30T22:31:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.069+0000 7fc439b17700 1 Processor -- start 2023-09-30T22:31:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.069+0000 7fc439b17700 1 -- start start 2023-09-30T22:31:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc439b17700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4340a0a30 0x7fc43411e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc439b17700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4340a1340 0x7fc43411ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc439b17700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434133fa0 0x7fc43411f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc439b17700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc434120740 con 0x7fc4340a0a30 2023-09-30T22:31:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc439b17700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43411fe10 con 0x7fc434133fa0 2023-09-30T22:31:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc439b17700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc434120550 con 0x7fc4340a1340 2023-09-30T22:31:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc4337fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4340a0a30 0x7fc43411e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc4337fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4340a0a30 0x7fc43411e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53764/0 (socket says 172.21.15.59:53764) 2023-09-30T22:31:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc4337fe700 1 -- 172.21.15.59:0/2037675695 learned_addr learned my addr 172.21.15.59:0/2037675695 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc432ffd700 1 --2- 172.21.15.59:0/2037675695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4340a1340 0x7fc43411ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc433fff700 1 --2- 172.21.15.59:0/2037675695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434133fa0 0x7fc43411f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc4337fe700 1 -- 172.21.15.59:0/2037675695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4340a1340 msgr2=0x7fc43411ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc4337fe700 1 --2- 172.21.15.59:0/2037675695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4340a1340 0x7fc43411ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc4337fe700 1 -- 172.21.15.59:0/2037675695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434133fa0 msgr2=0x7fc43411f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc4337fe700 1 --2- 172.21.15.59:0/2037675695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434133fa0 0x7fc43411f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc4337fe700 1 -- 172.21.15.59:0/2037675695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc424009a70 con 0x7fc4340a0a30 2023-09-30T22:31:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc432ffd700 1 --2- 172.21.15.59:0/2037675695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4340a1340 0x7fc43411ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.070+0000 7fc433fff700 1 --2- 172.21.15.59:0/2037675695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434133fa0 0x7fc43411f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.071+0000 7fc4337fe700 1 --2- 172.21.15.59:0/2037675695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4340a0a30 0x7fc43411e940 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc42400efc0 tx=0x7fc42400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.071+0000 7fc41bfff700 1 -- 172.21.15.59:0/2037675695 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42400cdd0 con 0x7fc4340a0a30 2023-09-30T22:31:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.071+0000 7fc41bfff700 1 -- 172.21.15.59:0/2037675695 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42400f040 con 0x7fc4340a0a30 2023-09-30T22:31:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.071+0000 7fc439b17700 1 -- 172.21.15.59:0/2037675695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc428009550 con 0x7fc4340a0a30 2023-09-30T22:31:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.071+0000 7fc41bfff700 1 -- 172.21.15.59:0/2037675695 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4240146a0 con 0x7fc4340a0a30 2023-09-30T22:31:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.071+0000 7fc439b17700 1 -- 172.21.15.59:0/2037675695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4340a25e0 con 0x7fc4340a0a30 2023-09-30T22:31:15.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.072+0000 7fc41bfff700 1 -- 172.21.15.59:0/2037675695 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc424014800 con 0x7fc4340a0a30 2023-09-30T22:31:15.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.072+0000 7fc41bfff700 1 -- 172.21.15.59:0/2037675695 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc424040380 con 0x7fc4340a0a30 2023-09-30T22:31:15.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.072+0000 7fc439b17700 1 -- 172.21.15.59:0/2037675695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc434074ea0 con 0x7fc4340a0a30 2023-09-30T22:31:15.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.077+0000 7fc41bfff700 1 -- 172.21.15.59:0/2037675695 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc42401d400 con 0x7fc4340a0a30 2023-09-30T22:31:15.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.104+0000 7f2be9088700 1 Processor -- start 2023-09-30T22:31:15.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.104+0000 7f2be9088700 1 -- start start 2023-09-30T22:31:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.104+0000 7f2be9088700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2be40a0a30 0x7f2be40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2be9088700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2be40a1340 0x7f2be4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2be9088700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2be4133fa0 0x7f2be4134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2be9088700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be409edd0 con 0x7f2be4133fa0 2023-09-30T22:31:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2be9088700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be409e1f0 con 0x7f2be40a0a30 2023-09-30T22:31:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2be9088700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2be409dc50 con 0x7f2be40a1340 2023-09-30T22:31:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2be2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2be40a0a30 0x7f2be40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2be2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2be40a0a30 0x7f2be40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58970/0 (socket says 172.21.15.59:58970) 2023-09-30T22:31:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2be2d9d700 1 -- 172.21.15.59:0/3483670139 learned_addr learned my addr 172.21.15.59:0/3483670139 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2be359e700 1 --2- 172.21.15.59:0/3483670139 >> v2:172.21.15.59:3300/0 conn(0x7f2be4133fa0 0x7f2be4134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2bda59c700 1 --2- 172.21.15.59:0/3483670139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2be40a1340 0x7f2be4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2be2d9d700 1 -- 172.21.15.59:0/3483670139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2be40a1340 msgr2=0x7f2be4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2be2d9d700 1 --2- 172.21.15.59:0/3483670139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2be40a1340 0x7f2be4133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2be2d9d700 1 -- 172.21.15.59:0/3483670139 >> v2:172.21.15.59:3300/0 conn(0x7f2be4133fa0 msgr2=0x7f2be4134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2be2d9d700 1 --2- 172.21.15.59:0/3483670139 >> v2:172.21.15.59:3300/0 conn(0x7f2be4133fa0 0x7f2be4134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2be2d9d700 1 -- 172.21.15.59:0/3483670139 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be40a1fe0 con 0x7f2be40a0a30 2023-09-30T22:31:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.105+0000 7f2be2d9d700 1 --2- 172.21.15.59:0/3483670139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2be40a0a30 0x7f2be40a0e00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40098f0 tx=0x7f2bd4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ab84efca9b3c033 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.106+0000 7f2be259c700 1 -- 172.21.15.59:0/3483670139 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4011830 con 0x7f2be40a0a30 2023-09-30T22:31:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.106+0000 7f2be259c700 1 -- 172.21.15.59:0/3483670139 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd4011990 con 0x7f2be40a0a30 2023-09-30T22:31:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.106+0000 7f2be259c700 1 -- 172.21.15.59:0/3483670139 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4011d20 con 0x7f2be40a0a30 2023-09-30T22:31:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.107+0000 7f2be9088700 1 -- 172.21.15.59:0/3483670139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2be40a0a30 msgr2=0x7f2be40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.107+0000 7f2be9088700 1 --2- 172.21.15.59:0/3483670139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2be40a0a30 0x7f2be40a0e00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40098f0 tx=0x7f2bd4009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.107+0000 7f2be9088700 1 -- 172.21.15.59:0/3483670139 shutdown_connections 2023-09-30T22:31:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.107+0000 7f2be9088700 1 --2- 172.21.15.59:0/3483670139 >> v2:172.21.15.59:3300/0 conn(0x7f2be4133fa0 0x7f2be4134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.107+0000 7f2be9088700 1 --2- 172.21.15.59:0/3483670139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2be40a0a30 0x7f2be40a0e00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.107+0000 7f2be9088700 1 --2- 172.21.15.59:0/3483670139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2be40a1340 0x7f2be4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.107+0000 7f2be9088700 1 -- 172.21.15.59:0/3483670139 >> 172.21.15.59:0/3483670139 conn(0x7f2be40a6550 msgr2=0x7f2be40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.107+0000 7f2be9088700 1 -- 172.21.15.59:0/3483670139 shutdown_connections 2023-09-30T22:31:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.107+0000 7f2be9088700 1 -- 172.21.15.59:0/3483670139 wait complete. 2023-09-30T22:31:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.108+0000 7f2be9088700 1 Processor -- start 2023-09-30T22:31:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.108+0000 7f2be9088700 1 -- start start 2023-09-30T22:31:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be9088700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be40a0a30 0x7f2be41200e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be9088700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2be40a1340 0x7f2be4120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be9088700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2be4133fa0 0x7f2be4120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be9088700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be40a3480 con 0x7f2be40a0a30 2023-09-30T22:31:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be9088700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be4121e00 con 0x7f2be4133fa0 2023-09-30T22:31:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be9088700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2be40a0220 con 0x7f2be40a1340 2023-09-30T22:31:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be40a0a30 0x7f2be41200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be40a0a30 0x7f2be41200e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53776/0 (socket says 172.21.15.59:53776) 2023-09-30T22:31:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be2d9d700 1 -- 172.21.15.59:0/524539989 learned_addr learned my addr 172.21.15.59:0/524539989 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be359e700 1 --2- 172.21.15.59:0/524539989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2be4133fa0 0x7f2be4120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2bda59c700 1 --2- 172.21.15.59:0/524539989 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2be40a1340 0x7f2be4120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be2d9d700 1 -- 172.21.15.59:0/524539989 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2be40a1340 msgr2=0x7f2be4120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be2d9d700 1 --2- 172.21.15.59:0/524539989 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2be40a1340 0x7f2be4120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be2d9d700 1 -- 172.21.15.59:0/524539989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2be4133fa0 msgr2=0x7f2be4120b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be2d9d700 1 --2- 172.21.15.59:0/524539989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2be4133fa0 0x7f2be4120b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be2d9d700 1 -- 172.21.15.59:0/524539989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd4009550 con 0x7f2be40a0a30 2023-09-30T22:31:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.109+0000 7f2be359e700 1 --2- 172.21.15.59:0/524539989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2be4133fa0 0x7f2be4120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.110+0000 7f2be2d9d700 1 --2- 172.21.15.59:0/524539989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be40a0a30 0x7f2be41200e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4000c00 tx=0x7f2bd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.110+0000 7f2bdbfff700 1 -- 172.21.15.59:0/524539989 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4004240 con 0x7f2be40a0a30 2023-09-30T22:31:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.110+0000 7f2bdbfff700 1 -- 172.21.15.59:0/524539989 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd401f070 con 0x7f2be40a0a30 2023-09-30T22:31:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.110+0000 7f2be9088700 1 -- 172.21.15.59:0/524539989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be4122fb0 con 0x7f2be40a0a30 2023-09-30T22:31:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.110+0000 7f2bdbfff700 1 -- 172.21.15.59:0/524539989 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40045e0 con 0x7f2be40a0a30 2023-09-30T22:31:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.110+0000 7f2be9088700 1 -- 172.21.15.59:0/524539989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be4123c00 con 0x7f2be40a0a30 2023-09-30T22:31:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.111+0000 7f2bdbfff700 1 -- 172.21.15.59:0/524539989 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2bd4021030 con 0x7f2be40a0a30 2023-09-30T22:31:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.111+0000 7f2bdbfff700 1 -- 172.21.15.59:0/524539989 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2bd40409e0 con 0x7f2be40a0a30 2023-09-30T22:31:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.111+0000 7f2be9088700 1 -- 172.21.15.59:0/524539989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be4074ea0 con 0x7f2be40a0a30 2023-09-30T22:31:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.116+0000 7f2bdbfff700 1 -- 172.21.15.59:0/524539989 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2bd4015030 con 0x7f2be40a0a30 2023-09-30T22:31:15.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.147+0000 7fa17f1e8700 1 Processor -- start 2023-09-30T22:31:15.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.147+0000 7fa17f1e8700 1 -- start start 2023-09-30T22:31:15.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.147+0000 7fa17f1e8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa17809e930 0x7fa17809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.147+0000 7fa17f1e8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa17809f650 0x7fa178131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.147+0000 7fa17f1e8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa178070940 con 0x7fa17809f240 2023-09-30T22:31:15.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.147+0000 7fa17f1e8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17806fd60 con 0x7fa17809f650 2023-09-30T22:31:15.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.147+0000 7fa17f1e8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17806fa80 con 0x7fa17809e930 2023-09-30T22:31:15.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.148+0000 7fa177fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa17809f240 0x7fa1781317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56110/0 (socket says 172.21.15.59:56110) 2023-09-30T22:31:15.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.148+0000 7fa177fff700 1 -- 172.21.15.59:0/1216646653 learned_addr learned my addr 172.21.15.59:0/1216646653 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:15.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.148+0000 7fa17cf84700 1 --2- 172.21.15.59:0/1216646653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa17809e930 0x7fa17809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.148+0000 7fa17d785700 1 --2- 172.21.15.59:0/1216646653 >> v2:172.21.15.59:3300/0 conn(0x7fa17809f650 0x7fa178131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.148+0000 7fa17cf84700 1 -- 172.21.15.59:0/1216646653 >> v2:172.21.15.59:3300/0 conn(0x7fa17809f650 msgr2=0x7fa178131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:15.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.148+0000 7fa17cf84700 1 --2- 172.21.15.59:0/1216646653 >> v2:172.21.15.59:3300/0 conn(0x7fa17809f650 0x7fa178131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.148+0000 7fa17cf84700 1 -- 172.21.15.59:0/1216646653 >> v1:172.21.15.59:6789/0 conn(0x7fa17809f240 legacy=0x7fa1781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.148+0000 7fa1777fe700 1 -- 172.21.15.59:0/1216646653 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645101599 0 0) 0x7fa178070940 con 0x7fa17809f240 2023-09-30T22:31:15.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.148+0000 7fa17cf84700 1 -- 172.21.15.59:0/1216646653 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17809fb60 con 0x7fa17809e930 2023-09-30T22:31:15.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.148+0000 7fa17cf84700 1 --2- 172.21.15.59:0/1216646653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa17809e930 0x7fa17809ed00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa168009840 tx=0x7fa168009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60d74640272eba14 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.148+0000 7fa1777fe700 1 -- 172.21.15.59:0/1216646653 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168011830 con 0x7fa17809e930 2023-09-30T22:31:15.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.149+0000 7fa1777fe700 1 -- 172.21.15.59:0/1216646653 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa168011990 con 0x7fa17809e930 2023-09-30T22:31:15.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.149+0000 7fa1777fe700 1 -- 172.21.15.59:0/1216646653 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168011d20 con 0x7fa17809e930 2023-09-30T22:31:15.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.149+0000 7fa17f1e8700 1 -- 172.21.15.59:0/1216646653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa17809e930 msgr2=0x7fa17809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.149+0000 7fa17f1e8700 1 --2- 172.21.15.59:0/1216646653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa17809e930 0x7fa17809ed00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa168009840 tx=0x7fa168009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:15.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.149+0000 7fa17f1e8700 1 -- 172.21.15.59:0/1216646653 shutdown_connections 2023-09-30T22:31:15.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.149+0000 7fa17f1e8700 1 --2- 172.21.15.59:0/1216646653 >> v2:172.21.15.59:3300/0 conn(0x7fa17809f650 0x7fa178131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.150+0000 7fa17f1e8700 1 --2- 172.21.15.59:0/1216646653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa17809e930 0x7fa17809ed00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.150+0000 7fa17f1e8700 1 -- 172.21.15.59:0/1216646653 >> 172.21.15.59:0/1216646653 conn(0x7fa1780a4210 msgr2=0x7fa1780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:15.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.150+0000 7fa17f1e8700 1 -- 172.21.15.59:0/1216646653 shutdown_connections 2023-09-30T22:31:15.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.150+0000 7fa17f1e8700 1 -- 172.21.15.59:0/1216646653 wait complete. 2023-09-30T22:31:15.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.151+0000 7fa17f1e8700 1 Processor -- start 2023-09-30T22:31:15.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.151+0000 7fa17f1e8700 1 -- start start 2023-09-30T22:31:15.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.152+0000 7fa17f1e8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa17809e930 0x7fa1781c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.152+0000 7fa17f1e8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa17809f240 0x7fa1781c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.152+0000 7fa17f1e8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa17809f650 0x7fa1781c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.152+0000 7fa17f1e8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1781a7410 con 0x7fa17809f650 2023-09-30T22:31:15.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.152+0000 7fa17f1e8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1781c38a0 con 0x7fa17809e930 2023-09-30T22:31:15.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.152+0000 7fa17f1e8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1781a5700 con 0x7fa17809f240 2023-09-30T22:31:15.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.152+0000 7fa17cf84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa17809e930 0x7fa1781c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.152+0000 7fa17d785700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa17809f650 0x7fa1781c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.152+0000 7fa17cf84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa17809e930 0x7fa1781c2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58998/0 (socket says 172.21.15.59:58998) 2023-09-30T22:31:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.152+0000 7fa17cf84700 1 -- 172.21.15.59:0/3182503054 learned_addr learned my addr 172.21.15.59:0/3182503054 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.152+0000 7fa17d785700 1 -- 172.21.15.59:0/3182503054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa17809f240 msgr2=0x7fa1781c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.152+0000 7fa17d785700 1 --2- 172.21.15.59:0/3182503054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa17809f240 0x7fa1781c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.152+0000 7fa17d785700 1 -- 172.21.15.59:0/3182503054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa17809e930 msgr2=0x7fa1781c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.153+0000 7fa17d785700 1 --2- 172.21.15.59:0/3182503054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa17809e930 0x7fa1781c2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.153+0000 7fa17d785700 1 -- 172.21.15.59:0/3182503054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1680094a0 con 0x7fa17809f650 2023-09-30T22:31:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.153+0000 7fa17cf84700 1 --2- 172.21.15.59:0/3182503054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa17809e930 0x7fa1781c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.153+0000 7fa17d785700 1 --2- 172.21.15.59:0/3182503054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa17809f650 0x7fa1781c5e40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa170009d90 tx=0x7fa17000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.153+0000 7fa1757fa700 1 -- 172.21.15.59:0/3182503054 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170009c00 con 0x7fa17809f650 2023-09-30T22:31:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.153+0000 7fa1757fa700 1 -- 172.21.15.59:0/3182503054 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17000f040 con 0x7fa17809f650 2023-09-30T22:31:15.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.153+0000 7fa17f1e8700 1 -- 172.21.15.59:0/3182503054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1780a0190 con 0x7fa17809f650 2023-09-30T22:31:15.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.153+0000 7fa1757fa700 1 -- 172.21.15.59:0/3182503054 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170014480 con 0x7fa17809f650 2023-09-30T22:31:15.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.153+0000 7fa17f1e8700 1 -- 172.21.15.59:0/3182503054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1781a6950 con 0x7fa17809f650 2023-09-30T22:31:15.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.154+0000 7fa1757fa700 1 -- 172.21.15.59:0/3182503054 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1700145e0 con 0x7fa17809f650 2023-09-30T22:31:15.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.154+0000 7fa1757fa700 1 -- 172.21.15.59:0/3182503054 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa170040260 con 0x7fa17809f650 2023-09-30T22:31:15.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.154+0000 7fa17f1e8700 1 -- 172.21.15.59:0/3182503054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa178074ea0 con 0x7fa17809f650 2023-09-30T22:31:15.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.164+0000 7fa1757fa700 1 -- 172.21.15.59:0/3182503054 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa170007900 con 0x7fa17809f650 2023-09-30T22:31:15.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.295+0000 7fc439b17700 1 -- 172.21.15.59:0/2037675695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc4340a28e0 con 0x7fc4340a0a30 2023-09-30T22:31:15.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.296+0000 7fc41bfff700 1 -- 172.21.15.59:0/2037675695 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc42402a020 con 0x7fc4340a0a30 2023-09-30T22:31:15.297 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:15.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.298+0000 7fc439b17700 1 -- 172.21.15.59:0/2037675695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4340a0a30 msgr2=0x7fc43411e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.298+0000 7fc439b17700 1 --2- 172.21.15.59:0/2037675695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4340a0a30 0x7fc43411e940 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc42400efc0 tx=0x7fc42400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.298+0000 7fc439b17700 1 -- 172.21.15.59:0/2037675695 shutdown_connections 2023-09-30T22:31:15.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.298+0000 7fc439b17700 1 --2- 172.21.15.59:0/2037675695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434133fa0 0x7fc43411f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.298+0000 7fc439b17700 1 --2- 172.21.15.59:0/2037675695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4340a0a30 0x7fc43411e940 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.298+0000 7fc439b17700 1 --2- 172.21.15.59:0/2037675695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4340a1340 0x7fc43411ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.298+0000 7fc439b17700 1 -- 172.21.15.59:0/2037675695 >> 172.21.15.59:0/2037675695 conn(0x7fc4340a6550 msgr2=0x7fc4341b9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:15.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.298+0000 7fc439b17700 1 -- 172.21.15.59:0/2037675695 shutdown_connections 2023-09-30T22:31:15.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.298+0000 7fc439b17700 1 -- 172.21.15.59:0/2037675695 wait complete. 2023-09-30T22:31:15.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:15.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.329+0000 7f2be9088700 1 -- 172.21.15.59:0/524539989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2be40a28e0 con 0x7f2be40a0a30 2023-09-30T22:31:15.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.329+0000 7f2bdbfff700 1 -- 172.21.15.59:0/524539989 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2bd401a450 con 0x7f2be40a0a30 2023-09-30T22:31:15.330 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:15.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.331+0000 7f2be9088700 1 -- 172.21.15.59:0/524539989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be40a0a30 msgr2=0x7f2be41200e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.331+0000 7f2be9088700 1 --2- 172.21.15.59:0/524539989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be40a0a30 0x7f2be41200e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4000c00 tx=0x7f2bd4004750 comp rx=0 tx=0).stop 2023-09-30T22:31:15.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.331+0000 7f2be9088700 1 -- 172.21.15.59:0/524539989 shutdown_connections 2023-09-30T22:31:15.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.331+0000 7f2be9088700 1 --2- 172.21.15.59:0/524539989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2be4133fa0 0x7f2be4120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.331+0000 7f2be9088700 1 --2- 172.21.15.59:0/524539989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be40a0a30 0x7f2be41200e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.331+0000 7f2be9088700 1 --2- 172.21.15.59:0/524539989 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2be40a1340 0x7f2be4120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.331+0000 7f2be9088700 1 -- 172.21.15.59:0/524539989 >> 172.21.15.59:0/524539989 conn(0x7f2be40a6550 msgr2=0x7f2be41bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:15.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.331+0000 7f2be9088700 1 -- 172.21.15.59:0/524539989 shutdown_connections 2023-09-30T22:31:15.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.331+0000 7f2be9088700 1 -- 172.21.15.59:0/524539989 wait complete. 2023-09-30T22:31:15.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.372+0000 7fa17f1e8700 1 -- 172.21.15.59:0/3182503054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa17806b250 con 0x7fa17809f650 2023-09-30T22:31:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.373+0000 7fa1757fa700 1 -- 172.21.15.59:0/3182503054 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa17002c090 con 0x7fa17809f650 2023-09-30T22:31:15.375 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.375+0000 7fa17f1e8700 1 -- 172.21.15.59:0/3182503054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa17809f650 msgr2=0x7fa1781c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.375+0000 7fa17f1e8700 1 --2- 172.21.15.59:0/3182503054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa17809f650 0x7fa1781c5e40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa170009d90 tx=0x7fa17000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.375+0000 7fa17f1e8700 1 -- 172.21.15.59:0/3182503054 shutdown_connections 2023-09-30T22:31:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.375+0000 7fa17f1e8700 1 --2- 172.21.15.59:0/3182503054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa17809f650 0x7fa1781c5e40 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.375+0000 7fa17f1e8700 1 --2- 172.21.15.59:0/3182503054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa17809e930 0x7fa1781c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.375+0000 7fa17f1e8700 1 --2- 172.21.15.59:0/3182503054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa17809f240 0x7fa1781c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.375+0000 7fa17f1e8700 1 -- 172.21.15.59:0/3182503054 >> 172.21.15.59:0/3182503054 conn(0x7fa1780a4210 msgr2=0x7fa1781b8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.375+0000 7fa17f1e8700 1 -- 172.21.15.59:0/3182503054 shutdown_connections 2023-09-30T22:31:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.375+0000 7fa17f1e8700 1 -- 172.21.15.59:0/3182503054 wait complete. 2023-09-30T22:31:15.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:15.488 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:15.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.629+0000 7fbee6a53700 1 Processor -- start 2023-09-30T22:31:15.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.629+0000 7fbee6a53700 1 -- start start 2023-09-30T22:31:15.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.629+0000 7fbee6a53700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbee009e930 0x7fbee009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.629+0000 7fbee6a53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbee009f240 0x7fbee01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.629+0000 7fbee6a53700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee0070940 con 0x7fbee009f650 2023-09-30T22:31:15.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.629+0000 7fbee6a53700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee006fd60 con 0x7fbee009f240 2023-09-30T22:31:15.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.629+0000 7fbee6a53700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbee006fa80 con 0x7fbee009e930 2023-09-30T22:31:15.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.630+0000 7fbedf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbee009f240 0x7fbee01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.630+0000 7fbee4ff0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbee009f650 0x7fbee0131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56114/0 (socket says 172.21.15.59:56114) 2023-09-30T22:31:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.630+0000 7fbedffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbee009e930 0x7fbee009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.630+0000 7fbee4ff0700 1 -- 172.21.15.59:0/2499653936 learned_addr learned my addr 172.21.15.59:0/2499653936 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.630+0000 7fbedf7fe700 1 -- 172.21.15.59:0/2499653936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbee009e930 msgr2=0x7fbee009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.630+0000 7fbedeffd700 1 -- 172.21.15.59:0/2499653936 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786624365 0 0) 0x7fbee0070940 con 0x7fbee009f650 2023-09-30T22:31:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.630+0000 7fbedf7fe700 1 --2- 172.21.15.59:0/2499653936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbee009e930 0x7fbee009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.630+0000 7fbedf7fe700 1 -- 172.21.15.59:0/2499653936 >> v1:172.21.15.59:6789/0 conn(0x7fbee009f650 legacy=0x7fbee0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.630+0000 7fbedf7fe700 1 -- 172.21.15.59:0/2499653936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee009fb60 con 0x7fbee009f240 2023-09-30T22:31:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.630+0000 7fbedffff700 1 --2- 172.21.15.59:0/2499653936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbee009e930 0x7fbee009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.630+0000 7fbedf7fe700 1 --2- 172.21.15.59:0/2499653936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbee009f240 0x7fbee01317f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009870 tx=0x7fbed4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cccb0ff11c054bd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.630+0000 7fbedeffd700 1 -- 172.21.15.59:0/2499653936 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4011830 con 0x7fbee009f240 2023-09-30T22:31:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.630+0000 7fbedeffd700 1 -- 172.21.15.59:0/2499653936 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed4011990 con 0x7fbee009f240 2023-09-30T22:31:15.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.630+0000 7fbedeffd700 1 -- 172.21.15.59:0/2499653936 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4011d20 con 0x7fbee009f240 2023-09-30T22:31:15.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.631+0000 7fbee6a53700 1 -- 172.21.15.59:0/2499653936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbee009f240 msgr2=0x7fbee01317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.631+0000 7fbee6a53700 1 --2- 172.21.15.59:0/2499653936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbee009f240 0x7fbee01317f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009870 tx=0x7fbed4009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:15.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.631+0000 7fbee6a53700 1 -- 172.21.15.59:0/2499653936 shutdown_connections 2023-09-30T22:31:15.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.631+0000 7fbee6a53700 1 --2- 172.21.15.59:0/2499653936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbee009e930 0x7fbee009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.631+0000 7fbee6a53700 1 --2- 172.21.15.59:0/2499653936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbee009f240 0x7fbee01317f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.631+0000 7fbee6a53700 1 -- 172.21.15.59:0/2499653936 >> 172.21.15.59:0/2499653936 conn(0x7fbee00a4210 msgr2=0x7fbee00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:15.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.631+0000 7fbee6a53700 1 -- 172.21.15.59:0/2499653936 shutdown_connections 2023-09-30T22:31:15.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.631+0000 7fbee6a53700 1 -- 172.21.15.59:0/2499653936 wait complete. 2023-09-30T22:31:15.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.632+0000 7fbee6a53700 1 Processor -- start 2023-09-30T22:31:15.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.632+0000 7fbee6a53700 1 -- start start 2023-09-30T22:31:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbee6a53700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbee009e930 0x7fbee01a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbee6a53700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbee009f240 0x7fbee01a4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbee6a53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbee009f650 0x7fbee01a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbee6a53700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee01a5de0 con 0x7fbee009f240 2023-09-30T22:31:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbee6a53700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee01a76a0 con 0x7fbee009f650 2023-09-30T22:31:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbee6a53700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbee01a6a70 con 0x7fbee009e930 2023-09-30T22:31:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbedffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbee009e930 0x7fbee01a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbee4ff0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbee009f650 0x7fbee01a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbedffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbee009e930 0x7fbee01a3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41592/0 (socket says 172.21.15.59:41592) 2023-09-30T22:31:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbedffff700 1 -- 172.21.15.59:0/2477618533 learned_addr learned my addr 172.21.15.59:0/2477618533 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:15.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbedf7fe700 1 --2- 172.21.15.59:0/2477618533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbee009f240 0x7fbee01a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbedffff700 1 -- 172.21.15.59:0/2477618533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbee009f650 msgr2=0x7fbee01a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbedffff700 1 --2- 172.21.15.59:0/2477618533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbee009f650 0x7fbee01a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbedffff700 1 -- 172.21.15.59:0/2477618533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbee009f240 msgr2=0x7fbee01a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbedffff700 1 --2- 172.21.15.59:0/2477618533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbee009f240 0x7fbee01a4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbedffff700 1 -- 172.21.15.59:0/2477618533 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed00094a0 con 0x7fbee009e930 2023-09-30T22:31:15.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbee4ff0700 1 --2- 172.21.15.59:0/2477618533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbee009f650 0x7fbee01a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:15.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbedffff700 1 --2- 172.21.15.59:0/2477618533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbee009e930 0x7fbee01a3c20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbed000ebe0 tx=0x7fbed000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbedcff9700 1 -- 172.21.15.59:0/2477618533 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed000c850 con 0x7fbee009e930 2023-09-30T22:31:15.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbedcff9700 1 -- 172.21.15.59:0/2477618533 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed000c9b0 con 0x7fbee009e930 2023-09-30T22:31:15.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.633+0000 7fbee6a53700 1 -- 172.21.15.59:0/2477618533 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed40094a0 con 0x7fbee009e930 2023-09-30T22:31:15.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.634+0000 7fbedcff9700 1 -- 172.21.15.59:0/2477618533 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed000cd40 con 0x7fbee009e930 2023-09-30T22:31:15.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.634+0000 7fbee6a53700 1 -- 172.21.15.59:0/2477618533 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee00a0190 con 0x7fbee009e930 2023-09-30T22:31:15.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.635+0000 7fbee6a53700 1 -- 172.21.15.59:0/2477618533 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee01a0b30 con 0x7fbee009e930 2023-09-30T22:31:15.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.635+0000 7fbedcff9700 1 -- 172.21.15.59:0/2477618533 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbed0013470 con 0x7fbee009e930 2023-09-30T22:31:15.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.635+0000 7fbedcff9700 1 -- 172.21.15.59:0/2477618533 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbed00400b0 con 0x7fbee009e930 2023-09-30T22:31:15.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.640+0000 7fbedcff9700 1 -- 172.21.15.59:0/2477618533 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbed0013720 con 0x7fbee009e930 2023-09-30T22:31:15.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.841+0000 7fbee6a53700 1 -- 172.21.15.59:0/2477618533 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbee01a7060 con 0x7fbee009e930 2023-09-30T22:31:15.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.841+0000 7fbedcff9700 1 -- 172.21.15.59:0/2477618533 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbee01a7060 con 0x7fbee009e930 2023-09-30T22:31:15.842 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:15.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.843+0000 7fbee6a53700 1 -- 172.21.15.59:0/2477618533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbee009e930 msgr2=0x7fbee01a3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.843+0000 7fbee6a53700 1 --2- 172.21.15.59:0/2477618533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbee009e930 0x7fbee01a3c20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbed000ebe0 tx=0x7fbed000eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.843+0000 7fbee6a53700 1 -- 172.21.15.59:0/2477618533 shutdown_connections 2023-09-30T22:31:15.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.843+0000 7fbee6a53700 1 --2- 172.21.15.59:0/2477618533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbee009e930 0x7fbee01a3c20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.843+0000 7fbee6a53700 1 --2- 172.21.15.59:0/2477618533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbee009f650 0x7fbee01a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.843+0000 7fbee6a53700 1 --2- 172.21.15.59:0/2477618533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbee009f240 0x7fbee01a4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.843+0000 7fbee6a53700 1 -- 172.21.15.59:0/2477618533 >> 172.21.15.59:0/2477618533 conn(0x7fbee00a4210 msgr2=0x7fbee01b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:15.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.843+0000 7fbee6a53700 1 -- 172.21.15.59:0/2477618533 shutdown_connections 2023-09-30T22:31:15.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:15.843+0000 7fbee6a53700 1 -- 172.21.15.59:0/2477618533 wait complete. 2023-09-30T22:31:15.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:16.314 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:16.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:16.392 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:16.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.465+0000 7f29460d1700 1 Processor -- start 2023-09-30T22:31:16.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.466+0000 7f29460d1700 1 -- start start 2023-09-30T22:31:16.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.466+0000 7f29460d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f294009d6f0 0x7f294009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.466+0000 7f29460d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f294009ace0 0x7f294009e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.466+0000 7f29460d1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294009b150 con 0x7f29401339f0 2023-09-30T22:31:16.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.466+0000 7f29460d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294009a500 con 0x7f294009ace0 2023-09-30T22:31:16.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.466+0000 7f29460d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f294009e540 con 0x7f294009d6f0 2023-09-30T22:31:16.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.466+0000 7f293ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f29401339f0 0x7f2940133e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56130/0 (socket says 172.21.15.59:56130) 2023-09-30T22:31:16.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.466+0000 7f293ffff700 1 -- 172.21.15.59:0/4022641417 learned_addr learned my addr 172.21.15.59:0/4022641417 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:16.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.466+0000 7f293effd700 1 --2- 172.21.15.59:0/4022641417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f294009ace0 0x7f294009e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.466+0000 7f293f7fe700 1 --2- 172.21.15.59:0/4022641417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f294009d6f0 0x7f294009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.467+0000 7f293effd700 1 -- 172.21.15.59:0/4022641417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f294009d6f0 msgr2=0x7f294009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:16.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.467+0000 7f293effd700 1 --2- 172.21.15.59:0/4022641417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f294009d6f0 0x7f294009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.467+0000 7f293effd700 1 -- 172.21.15.59:0/4022641417 >> v1:172.21.15.59:6789/0 conn(0x7f29401339f0 legacy=0x7f2940133e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.467+0000 7f293effd700 1 -- 172.21.15.59:0/4022641417 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294009f720 con 0x7f294009ace0 2023-09-30T22:31:16.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.467+0000 7f293effd700 1 --2- 172.21.15.59:0/4022641417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f294009ace0 0x7f294009e000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2934009870 tx=0x7f2934009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1455fb03e04df1ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.467+0000 7f293e7fc700 1 -- 172.21.15.59:0/4022641417 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934011830 con 0x7f294009ace0 2023-09-30T22:31:16.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.467+0000 7f293e7fc700 1 -- 172.21.15.59:0/4022641417 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2934011990 con 0x7f294009ace0 2023-09-30T22:31:16.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.467+0000 7f293e7fc700 1 -- 172.21.15.59:0/4022641417 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934011d20 con 0x7f294009ace0 2023-09-30T22:31:16.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.468+0000 7f29460d1700 1 -- 172.21.15.59:0/4022641417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f294009ace0 msgr2=0x7f294009e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.468+0000 7f29460d1700 1 --2- 172.21.15.59:0/4022641417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f294009ace0 0x7f294009e000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2934009870 tx=0x7f2934009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:16.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.468+0000 7f29460d1700 1 -- 172.21.15.59:0/4022641417 shutdown_connections 2023-09-30T22:31:16.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.468+0000 7f29460d1700 1 --2- 172.21.15.59:0/4022641417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f294009d6f0 0x7f294009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.468+0000 7f29460d1700 1 --2- 172.21.15.59:0/4022641417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f294009ace0 0x7f294009e000 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.468+0000 7f29460d1700 1 -- 172.21.15.59:0/4022641417 >> 172.21.15.59:0/4022641417 conn(0x7f2940066f50 msgr2=0x7f294009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.468+0000 7f29460d1700 1 -- 172.21.15.59:0/4022641417 shutdown_connections 2023-09-30T22:31:16.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.468+0000 7f29460d1700 1 -- 172.21.15.59:0/4022641417 wait complete. 2023-09-30T22:31:16.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.469+0000 7f29460d1700 1 Processor -- start 2023-09-30T22:31:16.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.469+0000 7f29460d1700 1 -- start start 2023-09-30T22:31:16.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f29460d1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f294009ace0 0x7f29401c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f29460d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f294009d6f0 0x7f29401c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f29460d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29401339f0 0x7f29401c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f29460d1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2940120ba0 con 0x7f294009ace0 2023-09-30T22:31:16.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f29460d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294009c760 con 0x7f294009d6f0 2023-09-30T22:31:16.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f29460d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2940120700 con 0x7f29401339f0 2023-09-30T22:31:16.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f293effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f294009d6f0 0x7f29401c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f293effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f294009d6f0 0x7f29401c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59044/0 (socket says 172.21.15.59:59044) 2023-09-30T22:31:16.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f293effd700 1 -- 172.21.15.59:0/508013239 learned_addr learned my addr 172.21.15.59:0/508013239 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:16.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f293f7fe700 1 --2- 172.21.15.59:0/508013239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f294009ace0 0x7f29401c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f293ffff700 1 --2- 172.21.15.59:0/508013239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29401339f0 0x7f29401c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f293effd700 1 -- 172.21.15.59:0/508013239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29401339f0 msgr2=0x7f29401c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f293effd700 1 --2- 172.21.15.59:0/508013239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29401339f0 0x7f29401c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f293effd700 1 -- 172.21.15.59:0/508013239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f294009ace0 msgr2=0x7f29401c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f293effd700 1 --2- 172.21.15.59:0/508013239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f294009ace0 0x7f29401c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.470+0000 7f293effd700 1 -- 172.21.15.59:0/508013239 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29340094a0 con 0x7f294009d6f0 2023-09-30T22:31:16.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.471+0000 7f293effd700 1 --2- 172.21.15.59:0/508013239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f294009d6f0 0x7f29401c8800 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f29340090b0 tx=0x7f2934004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.471+0000 7f2927fff700 1 -- 172.21.15.59:0/508013239 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934004450 con 0x7f294009d6f0 2023-09-30T22:31:16.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.471+0000 7f2927fff700 1 -- 172.21.15.59:0/508013239 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293401f070 con 0x7f294009d6f0 2023-09-30T22:31:16.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.471+0000 7f29460d1700 1 -- 172.21.15.59:0/508013239 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2940122490 con 0x7f294009d6f0 2023-09-30T22:31:16.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.471+0000 7f2927fff700 1 -- 172.21.15.59:0/508013239 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29340038e0 con 0x7f294009d6f0 2023-09-30T22:31:16.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.471+0000 7f29460d1700 1 -- 172.21.15.59:0/508013239 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2940120d70 con 0x7f294009d6f0 2023-09-30T22:31:16.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.472+0000 7f2927fff700 1 -- 172.21.15.59:0/508013239 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2934003a40 con 0x7f294009d6f0 2023-09-30T22:31:16.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.472+0000 7f2927fff700 1 -- 172.21.15.59:0/508013239 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2934021070 con 0x7f294009d6f0 2023-09-30T22:31:16.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.472+0000 7f29460d1700 1 -- 172.21.15.59:0/508013239 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29400747f0 con 0x7f294009d6f0 2023-09-30T22:31:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.481+0000 7f2927fff700 1 -- 172.21.15.59:0/508013239 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2934015020 con 0x7f294009d6f0 2023-09-30T22:31:16.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.508+0000 7fafd6319700 1 Processor -- start 2023-09-30T22:31:16.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.508+0000 7fafd6319700 1 -- start start 2023-09-30T22:31:16.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.509+0000 7fafd6319700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd00a0a30 0x7fafd00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.509+0000 7fafd6319700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fafd00a1340 0x7fafd0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.509+0000 7fafd6319700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd009edd0 con 0x7fafd0133fa0 2023-09-30T22:31:16.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.509+0000 7fafd6319700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd009e1f0 con 0x7fafd00a1340 2023-09-30T22:31:16.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.509+0000 7fafd6319700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd009dc50 con 0x7fafd00a0a30 2023-09-30T22:31:16.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.509+0000 7fafcffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd00a0a30 0x7fafd00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.509+0000 7fafcffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd00a0a30 0x7fafd00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59048/0 (socket says 172.21.15.59:59048) 2023-09-30T22:31:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.509+0000 7fafcffff700 1 -- 172.21.15.59:0/2543899703 learned_addr learned my addr 172.21.15.59:0/2543899703 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.509+0000 7fafcf7fe700 1 --2- 172.21.15.59:0/2543899703 >> v2:172.21.15.59:3300/0 conn(0x7fafd00a1340 0x7fafd0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.509+0000 7fafcf7fe700 1 -- 172.21.15.59:0/2543899703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd00a0a30 msgr2=0x7fafd00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.509+0000 7fafcf7fe700 1 --2- 172.21.15.59:0/2543899703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd00a0a30 0x7fafd00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.510+0000 7fafcf7fe700 1 -- 172.21.15.59:0/2543899703 >> v1:172.21.15.59:6789/0 conn(0x7fafd0133fa0 legacy=0x7fafd013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.510+0000 7fafcf7fe700 1 -- 172.21.15.59:0/2543899703 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd00a1fe0 con 0x7fafd00a1340 2023-09-30T22:31:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.510+0000 7fafcf7fe700 1 --2- 172.21.15.59:0/2543899703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd00a1340 0x7fafd0133a60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009840 tx=0x7fafc4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ed07a2ed6ff7a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.510+0000 7fafceffd700 1 -- 172.21.15.59:0/2543899703 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4011830 con 0x7fafd00a1340 2023-09-30T22:31:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.510+0000 7fafceffd700 1 -- 172.21.15.59:0/2543899703 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc4011990 con 0x7fafd00a1340 2023-09-30T22:31:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.510+0000 7fafceffd700 1 -- 172.21.15.59:0/2543899703 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4011d20 con 0x7fafd00a1340 2023-09-30T22:31:16.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.511+0000 7fafd6319700 1 -- 172.21.15.59:0/2543899703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd00a1340 msgr2=0x7fafd0133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.511+0000 7fafd6319700 1 --2- 172.21.15.59:0/2543899703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd00a1340 0x7fafd0133a60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009840 tx=0x7fafc4009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:16.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.511+0000 7fafd6319700 1 -- 172.21.15.59:0/2543899703 shutdown_connections 2023-09-30T22:31:16.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.511+0000 7fafd6319700 1 --2- 172.21.15.59:0/2543899703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd00a0a30 0x7fafd00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.511+0000 7fafd6319700 1 --2- 172.21.15.59:0/2543899703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd00a1340 0x7fafd0133a60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.511+0000 7fafd6319700 1 -- 172.21.15.59:0/2543899703 >> 172.21.15.59:0/2543899703 conn(0x7fafd00a6550 msgr2=0x7fafd00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.511+0000 7fafd6319700 1 -- 172.21.15.59:0/2543899703 shutdown_connections 2023-09-30T22:31:16.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.511+0000 7fafd6319700 1 -- 172.21.15.59:0/2543899703 wait complete. 2023-09-30T22:31:16.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.512+0000 7fafd6319700 1 Processor -- start 2023-09-30T22:31:16.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.512+0000 7fafd6319700 1 -- start start 2023-09-30T22:31:16.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.512+0000 7fafd6319700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd00a0a30 0x7fafd011e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.512+0000 7fafd6319700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd00a1340 0x7fafd011ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.512+0000 7fafd6319700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd0133fa0 0x7fafd011f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.512+0000 7fafd6319700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd01208f0 con 0x7fafd0133fa0 2023-09-30T22:31:16.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafd6319700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00a0220 con 0x7fafd00a1340 2023-09-30T22:31:16.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafd6319700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafd01203b0 con 0x7fafd00a0a30 2023-09-30T22:31:16.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafcf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd00a1340 0x7fafd011ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafd48b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd0133fa0 0x7fafd011f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafcf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd00a1340 0x7fafd011ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59062/0 (socket says 172.21.15.59:59062) 2023-09-30T22:31:16.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafcf7fe700 1 -- 172.21.15.59:0/822667705 learned_addr learned my addr 172.21.15.59:0/822667705 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:16.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafd48b6700 1 -- 172.21.15.59:0/822667705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd00a0a30 msgr2=0x7fafd011e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafd48b6700 1 --2- 172.21.15.59:0/822667705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd00a0a30 0x7fafd011e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafd48b6700 1 -- 172.21.15.59:0/822667705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd00a1340 msgr2=0x7fafd011ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafd48b6700 1 --2- 172.21.15.59:0/822667705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd00a1340 0x7fafd011ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafd48b6700 1 -- 172.21.15.59:0/822667705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc40094a0 con 0x7fafd0133fa0 2023-09-30T22:31:16.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafcf7fe700 1 --2- 172.21.15.59:0/822667705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd00a1340 0x7fafd011ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:16.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafd48b6700 1 --2- 172.21.15.59:0/822667705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd0133fa0 0x7fafd011f1a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fafc800cbc0 tx=0x7fafc800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafccff9700 1 -- 172.21.15.59:0/822667705 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8003c00 con 0x7fafd0133fa0 2023-09-30T22:31:16.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafccff9700 1 -- 172.21.15.59:0/822667705 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc8003d60 con 0x7fafd0133fa0 2023-09-30T22:31:16.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafd6319700 1 -- 172.21.15.59:0/822667705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd0121ed0 con 0x7fafd0133fa0 2023-09-30T22:31:16.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.513+0000 7fafccff9700 1 -- 172.21.15.59:0/822667705 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc800aaa0 con 0x7fafd0133fa0 2023-09-30T22:31:16.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.514+0000 7fafd6319700 1 -- 172.21.15.59:0/822667705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd01221b0 con 0x7fafd0133fa0 2023-09-30T22:31:16.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.514+0000 7fafd6319700 1 -- 172.21.15.59:0/822667705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd00a1d40 con 0x7fafd0133fa0 2023-09-30T22:31:16.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.515+0000 7fafccff9700 1 -- 172.21.15.59:0/822667705 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fafc800ac00 con 0x7fafd0133fa0 2023-09-30T22:31:16.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.515+0000 7fafccff9700 1 -- 172.21.15.59:0/822667705 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fafc8040110 con 0x7fafd0133fa0 2023-09-30T22:31:16.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.524+0000 7fafccff9700 1 -- 172.21.15.59:0/822667705 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafc8011740 con 0x7fafd0133fa0 2023-09-30T22:31:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.568+0000 7fdf5099c700 1 Processor -- start 2023-09-30T22:31:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.568+0000 7fdf5099c700 1 -- start start 2023-09-30T22:31:16.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.569+0000 7fdf5099c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf4c09d6f0 0x7fdf4c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.569+0000 7fdf5099c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf4c09e000 0x7fdf4c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.569+0000 7fdf5099c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4c09b120 con 0x7fdf4c09e410 2023-09-30T22:31:16.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.569+0000 7fdf5099c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf4c06b460 con 0x7fdf4c09d6f0 2023-09-30T22:31:16.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.569+0000 7fdf5099c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c09a7e0 con 0x7fdf4c09e000 2023-09-30T22:31:16.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.569+0000 7fdf49d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf4c09e000 0x7fdf4c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.569+0000 7fdf4a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf4c09d6f0 0x7fdf4c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.569+0000 7fdf4ad9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdf4c09e410 0x7fdf4c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56158/0 (socket says 172.21.15.59:56158) 2023-09-30T22:31:16.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.569+0000 7fdf4ad9d700 1 -- 172.21.15.59:0/575118722 learned_addr learned my addr 172.21.15.59:0/575118722 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:16.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.569+0000 7fdf4a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf4c09d6f0 0x7fdf4c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53838/0 (socket says 172.21.15.59:53838) 2023-09-30T22:31:16.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.569+0000 7fdf49d9b700 1 --2- 172.21.15.59:0/575118722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf4c09e000 0x7fdf4c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59064/0 (socket says 172.21.15.59:59064) 2023-09-30T22:31:16.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.569+0000 7fdf49d9b700 1 -- 172.21.15.59:0/575118722 >> v2:172.21.15.59:3300/0 conn(0x7fdf4c09d6f0 msgr2=0x7fdf4c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:16.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.569+0000 7fdf49d9b700 1 --2- 172.21.15.59:0/575118722 >> v2:172.21.15.59:3300/0 conn(0x7fdf4c09d6f0 0x7fdf4c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.570+0000 7fdf49d9b700 1 -- 172.21.15.59:0/575118722 >> v1:172.21.15.59:6789/0 conn(0x7fdf4c09e410 legacy=0x7fdf4c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.570+0000 7fdf49d9b700 1 -- 172.21.15.59:0/575118722 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c09a500 con 0x7fdf4c09e000 2023-09-30T22:31:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.570+0000 7fdf4a59c700 1 --2- 172.21.15.59:0/575118722 >> v2:172.21.15.59:3300/0 conn(0x7fdf4c09d6f0 0x7fdf4c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.570+0000 7fdf49d9b700 1 --2- 172.21.15.59:0/575118722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf4c09e000 0x7fdf4c1339f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009870 tx=0x7fdf40009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fffafcbf6e09438 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.570+0000 7fdf4959a700 1 -- 172.21.15.59:0/575118722 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40011830 con 0x7fdf4c09e000 2023-09-30T22:31:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.570+0000 7fdf4959a700 1 -- 172.21.15.59:0/575118722 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf40011990 con 0x7fdf4c09e000 2023-09-30T22:31:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.570+0000 7fdf4959a700 1 -- 172.21.15.59:0/575118722 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40011d20 con 0x7fdf4c09e000 2023-09-30T22:31:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.571+0000 7fdf5099c700 1 -- 172.21.15.59:0/575118722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf4c09e000 msgr2=0x7fdf4c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.571+0000 7fdf5099c700 1 --2- 172.21.15.59:0/575118722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf4c09e000 0x7fdf4c1339f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009870 tx=0x7fdf40009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.571+0000 7fdf5099c700 1 -- 172.21.15.59:0/575118722 shutdown_connections 2023-09-30T22:31:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.571+0000 7fdf5099c700 1 --2- 172.21.15.59:0/575118722 >> v2:172.21.15.59:3300/0 conn(0x7fdf4c09d6f0 0x7fdf4c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.571+0000 7fdf5099c700 1 --2- 172.21.15.59:0/575118722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf4c09e000 0x7fdf4c1339f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.571+0000 7fdf5099c700 1 -- 172.21.15.59:0/575118722 >> 172.21.15.59:0/575118722 conn(0x7fdf4c066f50 msgr2=0x7fdf4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.571+0000 7fdf5099c700 1 -- 172.21.15.59:0/575118722 shutdown_connections 2023-09-30T22:31:16.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.571+0000 7fdf5099c700 1 -- 172.21.15.59:0/575118722 wait complete. 2023-09-30T22:31:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.572+0000 7fdf5099c700 1 Processor -- start 2023-09-30T22:31:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.572+0000 7fdf5099c700 1 -- start start 2023-09-30T22:31:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.572+0000 7fdf5099c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf4c09d6f0 0x7fdf4c1a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.572+0000 7fdf5099c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf4c09e000 0x7fdf4c1a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.572+0000 7fdf5099c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf4c09e410 0x7fdf4c1a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.572+0000 7fdf5099c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c1a7a50 con 0x7fdf4c09d6f0 2023-09-30T22:31:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.572+0000 7fdf5099c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c1a8070 con 0x7fdf4c09e000 2023-09-30T22:31:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.572+0000 7fdf5099c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c1a8ca0 con 0x7fdf4c09e410 2023-09-30T22:31:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf4a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf4c09d6f0 0x7fdf4c1a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf49d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf4c09e000 0x7fdf4c1a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf4a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf4c09d6f0 0x7fdf4c1a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53850/0 (socket says 172.21.15.59:53850) 2023-09-30T22:31:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf49d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf4c09e000 0x7fdf4c1a63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59078/0 (socket says 172.21.15.59:59078) 2023-09-30T22:31:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf4a59c700 1 -- 172.21.15.59:0/937930344 learned_addr learned my addr 172.21.15.59:0/937930344 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf4ad9d700 1 --2- 172.21.15.59:0/937930344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf4c09e410 0x7fdf4c1a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf49d9b700 1 -- 172.21.15.59:0/937930344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf4c09e410 msgr2=0x7fdf4c1a6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf49d9b700 1 --2- 172.21.15.59:0/937930344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf4c09e410 0x7fdf4c1a6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf49d9b700 1 -- 172.21.15.59:0/937930344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf4c09d6f0 msgr2=0x7fdf4c1a5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf49d9b700 1 --2- 172.21.15.59:0/937930344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf4c09d6f0 0x7fdf4c1a5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf49d9b700 1 -- 172.21.15.59:0/937930344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c0094a0 con 0x7fdf4c09e000 2023-09-30T22:31:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf4ad9d700 1 --2- 172.21.15.59:0/937930344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf4c09e410 0x7fdf4c1a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf4a59c700 1 --2- 172.21.15.59:0/937930344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf4c09d6f0 0x7fdf4c1a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf49d9b700 1 --2- 172.21.15.59:0/937930344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf4c09e000 0x7fdf4c1a63d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdf40016000 tx=0x7fdf40004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf3affd700 1 -- 172.21.15.59:0/937930344 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf400036a0 con 0x7fdf4c09e000 2023-09-30T22:31:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf3affd700 1 -- 172.21.15.59:0/937930344 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4001f070 con 0x7fdf4c09e000 2023-09-30T22:31:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.573+0000 7fdf3affd700 1 -- 172.21.15.59:0/937930344 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40003a00 con 0x7fdf4c09e000 2023-09-30T22:31:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.574+0000 7fdf5099c700 1 -- 172.21.15.59:0/937930344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf400094a0 con 0x7fdf4c09e000 2023-09-30T22:31:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.574+0000 7fdf5099c700 1 -- 172.21.15.59:0/937930344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4c1a90f0 con 0x7fdf4c09e000 2023-09-30T22:31:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.575+0000 7fdf3affd700 1 -- 172.21.15.59:0/937930344 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf40003b60 con 0x7fdf4c09e000 2023-09-30T22:31:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.575+0000 7fdf5099c700 1 -- 172.21.15.59:0/937930344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf4c074ea0 con 0x7fdf4c09e000 2023-09-30T22:31:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.575+0000 7fdf3affd700 1 -- 172.21.15.59:0/937930344 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdf40021070 con 0x7fdf4c09e000 2023-09-30T22:31:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.584+0000 7fdf3affd700 1 -- 172.21.15.59:0/937930344 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf40046020 con 0x7fdf4c09e000 2023-09-30T22:31:16.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.702+0000 7f29460d1700 1 -- 172.21.15.59:0/508013239 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2940121e50 con 0x7f294009d6f0 2023-09-30T22:31:16.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.703+0000 7f2927fff700 1 -- 172.21.15.59:0/508013239 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f293401a430 con 0x7f294009d6f0 2023-09-30T22:31:16.704 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:16.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.705+0000 7f29460d1700 1 -- 172.21.15.59:0/508013239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f294009d6f0 msgr2=0x7f29401c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.705+0000 7f29460d1700 1 --2- 172.21.15.59:0/508013239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f294009d6f0 0x7f29401c8800 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f29340090b0 tx=0x7f2934004750 comp rx=0 tx=0).stop 2023-09-30T22:31:16.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.705+0000 7f29460d1700 1 -- 172.21.15.59:0/508013239 shutdown_connections 2023-09-30T22:31:16.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.705+0000 7f29460d1700 1 --2- 172.21.15.59:0/508013239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29401339f0 0x7f29401c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.705+0000 7f29460d1700 1 --2- 172.21.15.59:0/508013239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f294009ace0 0x7f29401c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.705+0000 7f29460d1700 1 --2- 172.21.15.59:0/508013239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f294009d6f0 0x7f29401c8800 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.705+0000 7f29460d1700 1 -- 172.21.15.59:0/508013239 >> 172.21.15.59:0/508013239 conn(0x7f2940066f50 msgr2=0x7f29401b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.705+0000 7f29460d1700 1 -- 172.21.15.59:0/508013239 shutdown_connections 2023-09-30T22:31:16.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.705+0000 7f29460d1700 1 -- 172.21.15.59:0/508013239 wait complete. 2023-09-30T22:31:16.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:16.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.743+0000 7fafd6319700 1 -- 172.21.15.59:0/822667705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fafd0074ea0 con 0x7fafd0133fa0 2023-09-30T22:31:16.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.743+0000 7fafccff9700 1 -- 172.21.15.59:0/822667705 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafc8011380 con 0x7fafd0133fa0 2023-09-30T22:31:16.745 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:16.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.746+0000 7fafd6319700 1 -- 172.21.15.59:0/822667705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd0133fa0 msgr2=0x7fafd011f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.746+0000 7fafd6319700 1 --2- 172.21.15.59:0/822667705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd0133fa0 0x7fafd011f1a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fafc800cbc0 tx=0x7fafc800ced0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.746+0000 7fafd6319700 1 -- 172.21.15.59:0/822667705 shutdown_connections 2023-09-30T22:31:16.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.746+0000 7fafd6319700 1 --2- 172.21.15.59:0/822667705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd00a0a30 0x7fafd011e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.746+0000 7fafd6319700 1 --2- 172.21.15.59:0/822667705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd0133fa0 0x7fafd011f1a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.746+0000 7fafd6319700 1 --2- 172.21.15.59:0/822667705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd00a1340 0x7fafd011ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.746+0000 7fafd6319700 1 -- 172.21.15.59:0/822667705 >> 172.21.15.59:0/822667705 conn(0x7fafd00a6550 msgr2=0x7fafd01bc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.746+0000 7fafd6319700 1 -- 172.21.15.59:0/822667705 shutdown_connections 2023-09-30T22:31:16.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.746+0000 7fafd6319700 1 -- 172.21.15.59:0/822667705 wait complete. 2023-09-30T22:31:16.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.792+0000 7fdf5099c700 1 -- 172.21.15.59:0/937930344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdf4c09c6d0 con 0x7fdf4c09e000 2023-09-30T22:31:16.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.793+0000 7fdf3affd700 1 -- 172.21.15.59:0/937930344 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf4002b030 con 0x7fdf4c09e000 2023-09-30T22:31:16.794 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.795+0000 7fdf5099c700 1 -- 172.21.15.59:0/937930344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf4c09e000 msgr2=0x7fdf4c1a63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.795+0000 7fdf5099c700 1 --2- 172.21.15.59:0/937930344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf4c09e000 0x7fdf4c1a63d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdf40016000 tx=0x7fdf40004750 comp rx=0 tx=0).stop 2023-09-30T22:31:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.795+0000 7fdf5099c700 1 -- 172.21.15.59:0/937930344 shutdown_connections 2023-09-30T22:31:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.795+0000 7fdf5099c700 1 --2- 172.21.15.59:0/937930344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf4c09e410 0x7fdf4c1a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.795+0000 7fdf5099c700 1 --2- 172.21.15.59:0/937930344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf4c09d6f0 0x7fdf4c1a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.795+0000 7fdf5099c700 1 --2- 172.21.15.59:0/937930344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf4c09e000 0x7fdf4c1a63d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.795+0000 7fdf5099c700 1 -- 172.21.15.59:0/937930344 >> 172.21.15.59:0/937930344 conn(0x7fdf4c066f50 msgr2=0x7fdf4c1bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.795+0000 7fdf5099c700 1 -- 172.21.15.59:0/937930344 shutdown_connections 2023-09-30T22:31:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.795+0000 7fdf5099c700 1 -- 172.21.15.59:0/937930344 wait complete. 2023-09-30T22:31:16.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:16.858 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:16.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.997+0000 7f9f455c0700 1 Processor -- start 2023-09-30T22:31:16.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.997+0000 7f9f455c0700 1 -- start start 2023-09-30T22:31:17.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f455c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f4009d6f0 0x7f9f4009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f455c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f4009e000 0x7f9f40130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f455c0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f4009e410 0x7f9f40130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f455c0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4009f520 con 0x7f9f4009e410 2023-09-30T22:31:17.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f455c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4009f130 con 0x7f9f4009d6f0 2023-09-30T22:31:17.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f455c0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4009e930 con 0x7f9f4009e000 2023-09-30T22:31:17.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f3f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f4009e410 0x7f9f40130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f3e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f4009e000 0x7f9f40130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f3f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f4009e410 0x7f9f40130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53856/0 (socket says 172.21.15.59:53856) 2023-09-30T22:31:17.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f3effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f4009d6f0 0x7f9f4009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f3f7fe700 1 -- 172.21.15.59:0/2214225356 learned_addr learned my addr 172.21.15.59:0/2214225356 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:17.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f3effd700 1 -- 172.21.15.59:0/2214225356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f4009e000 msgr2=0x7f9f40130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:17.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f3effd700 1 --2- 172.21.15.59:0/2214225356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f4009e000 0x7f9f40130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f3effd700 1 -- 172.21.15.59:0/2214225356 >> v2:172.21.15.59:3300/0 conn(0x7f9f4009e410 msgr2=0x7f9f40130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:17.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f3effd700 1 --2- 172.21.15.59:0/2214225356 >> v2:172.21.15.59:3300/0 conn(0x7f9f4009e410 0x7f9f40130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f3effd700 1 -- 172.21.15.59:0/2214225356 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4009b2d0 con 0x7f9f4009d6f0 2023-09-30T22:31:17.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f3f7fe700 1 --2- 172.21.15.59:0/2214225356 >> v2:172.21.15.59:3300/0 conn(0x7f9f4009e410 0x7f9f40130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:17.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.998+0000 7f9f3e7fc700 1 --2- 172.21.15.59:0/2214225356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f4009e000 0x7f9f40130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:17.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.999+0000 7f9f3effd700 1 --2- 172.21.15.59:0/2214225356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f4009d6f0 0x7f9f4009dac0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009870 tx=0x7f9f30009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef1ebac8587a5edf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.999+0000 7f9f3dffb700 1 -- 172.21.15.59:0/2214225356 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3000f8a0 con 0x7f9f4009d6f0 2023-09-30T22:31:17.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.999+0000 7f9f3dffb700 1 -- 172.21.15.59:0/2214225356 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3000fa00 con 0x7f9f4009d6f0 2023-09-30T22:31:17.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.999+0000 7f9f3dffb700 1 -- 172.21.15.59:0/2214225356 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3000fd90 con 0x7f9f4009d6f0 2023-09-30T22:31:17.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.999+0000 7f9f455c0700 1 -- 172.21.15.59:0/2214225356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f4009d6f0 msgr2=0x7f9f4009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.999+0000 7f9f455c0700 1 --2- 172.21.15.59:0/2214225356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f4009d6f0 0x7f9f4009dac0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009870 tx=0x7f9f30009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:17.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.999+0000 7f9f455c0700 1 -- 172.21.15.59:0/2214225356 shutdown_connections 2023-09-30T22:31:17.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.999+0000 7f9f455c0700 1 --2- 172.21.15.59:0/2214225356 >> v2:172.21.15.59:3300/0 conn(0x7f9f4009e410 0x7f9f40130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.999+0000 7f9f455c0700 1 --2- 172.21.15.59:0/2214225356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f4009d6f0 0x7f9f4009dac0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:16.999+0000 7f9f455c0700 1 --2- 172.21.15.59:0/2214225356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f4009e000 0x7f9f40130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.000+0000 7f9f455c0700 1 -- 172.21.15.59:0/2214225356 >> 172.21.15.59:0/2214225356 conn(0x7f9f40066f50 msgr2=0x7f9f4009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.000+0000 7f9f455c0700 1 -- 172.21.15.59:0/2214225356 shutdown_connections 2023-09-30T22:31:17.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.000+0000 7f9f455c0700 1 -- 172.21.15.59:0/2214225356 wait complete. 2023-09-30T22:31:17.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.001+0000 7f9f455c0700 1 Processor -- start 2023-09-30T22:31:17.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.001+0000 7f9f455c0700 1 -- start start 2023-09-30T22:31:17.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f455c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4009d6f0 0x7f9f4011e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f455c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f4009e000 0x7f9f4011e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f455c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f4009e410 0x7f9f4011ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f455c0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4009c700 con 0x7f9f4009d6f0 2023-09-30T22:31:17.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f455c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f40120290 con 0x7f9f4009e410 2023-09-30T22:31:17.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f455c0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400a1a70 con 0x7f9f4009e000 2023-09-30T22:31:17.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f3e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f4009e000 0x7f9f4011e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f3e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f4009e000 0x7f9f4011e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41658/0 (socket says 172.21.15.59:41658) 2023-09-30T22:31:17.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f3f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f4009e410 0x7f9f4011ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f3e7fc700 1 -- 172.21.15.59:0/951565029 learned_addr learned my addr 172.21.15.59:0/951565029 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:17.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f3effd700 1 --2- 172.21.15.59:0/951565029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4009d6f0 0x7f9f4011e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f3f7fe700 1 -- 172.21.15.59:0/951565029 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f4009e000 msgr2=0x7f9f4011e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f3f7fe700 1 --2- 172.21.15.59:0/951565029 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f4009e000 0x7f9f4011e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f3f7fe700 1 -- 172.21.15.59:0/951565029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4009d6f0 msgr2=0x7f9f4011e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f3f7fe700 1 --2- 172.21.15.59:0/951565029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4009d6f0 0x7f9f4011e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f3f7fe700 1 -- 172.21.15.59:0/951565029 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f280094a0 con 0x7f9f4009e410 2023-09-30T22:31:17.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.002+0000 7f9f3e7fc700 1 --2- 172.21.15.59:0/951565029 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f4009e000 0x7f9f4011e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:17.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.003+0000 7f9f3f7fe700 1 --2- 172.21.15.59:0/951565029 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f4009e410 0x7f9f4011ebf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800efc0 tx=0x7f9f3800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.003+0000 7f9f377fe700 1 -- 172.21.15.59:0/951565029 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38018070 con 0x7f9f4009e410 2023-09-30T22:31:17.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.003+0000 7f9f377fe700 1 -- 172.21.15.59:0/951565029 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3800f040 con 0x7f9f4009e410 2023-09-30T22:31:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.003+0000 7f9f377fe700 1 -- 172.21.15.59:0/951565029 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38003c60 con 0x7f9f4009e410 2023-09-30T22:31:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.003+0000 7f9f455c0700 1 -- 172.21.15.59:0/951565029 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f38009b30 con 0x7f9f4009e410 2023-09-30T22:31:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.003+0000 7f9f455c0700 1 -- 172.21.15.59:0/951565029 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f300094a0 con 0x7f9f4009e410 2023-09-30T22:31:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.004+0000 7f9f455c0700 1 -- 172.21.15.59:0/951565029 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f40121560 con 0x7f9f4009e410 2023-09-30T22:31:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.004+0000 7f9f377fe700 1 -- 172.21.15.59:0/951565029 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f3800c880 con 0x7f9f4009e410 2023-09-30T22:31:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.004+0000 7f9f377fe700 1 -- 172.21.15.59:0/951565029 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9f3803f670 con 0x7f9f4009e410 2023-09-30T22:31:17.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.009+0000 7f9f377fe700 1 -- 172.21.15.59:0/951565029 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f3801cd40 con 0x7f9f4009e410 2023-09-30T22:31:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.211+0000 7f9f455c0700 1 -- 172.21.15.59:0/951565029 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9f40120f30 con 0x7f9f4009e410 2023-09-30T22:31:17.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.211+0000 7f9f377fe700 1 -- 172.21.15.59:0/951565029 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f3801de00 con 0x7f9f4009e410 2023-09-30T22:31:17.212 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:17.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.213+0000 7f9f455c0700 1 -- 172.21.15.59:0/951565029 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f4009e410 msgr2=0x7f9f4011ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.213+0000 7f9f455c0700 1 --2- 172.21.15.59:0/951565029 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f4009e410 0x7f9f4011ebf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800efc0 tx=0x7f9f3800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.213+0000 7f9f455c0700 1 -- 172.21.15.59:0/951565029 shutdown_connections 2023-09-30T22:31:17.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.213+0000 7f9f455c0700 1 --2- 172.21.15.59:0/951565029 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f4009e410 0x7f9f4011ebf0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.213+0000 7f9f455c0700 1 --2- 172.21.15.59:0/951565029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4009d6f0 0x7f9f4011e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.213+0000 7f9f455c0700 1 --2- 172.21.15.59:0/951565029 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f4009e000 0x7f9f4011e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.213+0000 7f9f455c0700 1 -- 172.21.15.59:0/951565029 >> 172.21.15.59:0/951565029 conn(0x7f9f40066f50 msgr2=0x7f9f4006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.213+0000 7f9f455c0700 1 -- 172.21.15.59:0/951565029 shutdown_connections 2023-09-30T22:31:17.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.214+0000 7f9f455c0700 1 -- 172.21.15.59:0/951565029 wait complete. 2023-09-30T22:31:17.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:17.721 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:17.762 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:17.811 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.870+0000 7fa54139e700 1 Processor -- start 2023-09-30T22:31:17.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.870+0000 7fa54139e700 1 -- start start 2023-09-30T22:31:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.871+0000 7fa54139e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa53c133510 0x7fa53c1358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.871+0000 7fa54139e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c135e30 0x7fa53c138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.871+0000 7fa54139e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53c130260 con 0x7fa53c130670 2023-09-30T22:31:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.871+0000 7fa54139e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53c09a350 con 0x7fa53c133510 2023-09-30T22:31:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.871+0000 7fa54139e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c071ff0 con 0x7fa53c135e30 2023-09-30T22:31:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.872+0000 7fa53a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa53c133510 0x7fa53c1358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.872+0000 7fa53b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c135e30 0x7fa53c138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.872+0000 7fa53a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa53c133510 0x7fa53c1358f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53870/0 (socket says 172.21.15.59:53870) 2023-09-30T22:31:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.872+0000 7fa53a7fc700 1 -- 172.21.15.59:0/2675076674 learned_addr learned my addr 172.21.15.59:0/2675076674 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.872+0000 7fa53b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c135e30 0x7fa53c138210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59126/0 (socket says 172.21.15.59:59126) 2023-09-30T22:31:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.872+0000 7fa53a7fc700 1 -- 172.21.15.59:0/2675076674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c135e30 msgr2=0x7fa53c138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.872+0000 7fa53a7fc700 1 --2- 172.21.15.59:0/2675076674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c135e30 0x7fa53c138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.872+0000 7fa53a7fc700 1 -- 172.21.15.59:0/2675076674 >> v1:172.21.15.59:6789/0 conn(0x7fa53c130670 legacy=0x7fa53c130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.872+0000 7fa53a7fc700 1 -- 172.21.15.59:0/2675076674 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c09ecf0 con 0x7fa53c133510 2023-09-30T22:31:17.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.872+0000 7fa53b7fe700 1 --2- 172.21.15.59:0/2675076674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c135e30 0x7fa53c138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:17.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.872+0000 7fa53a7fc700 1 --2- 172.21.15.59:0/2675076674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c133510 0x7fa53c1358f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa53000bb90 tx=0x7fa53000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63de5ea3a8b6b472 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.872+0000 7fa539ffb700 1 -- 172.21.15.59:0/2675076674 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53000dd30 con 0x7fa53c133510 2023-09-30T22:31:17.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.872+0000 7fa539ffb700 1 -- 172.21.15.59:0/2675076674 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53000de90 con 0x7fa53c133510 2023-09-30T22:31:17.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.872+0000 7fa539ffb700 1 -- 172.21.15.59:0/2675076674 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530010690 con 0x7fa53c133510 2023-09-30T22:31:17.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.873+0000 7fa54139e700 1 -- 172.21.15.59:0/2675076674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c133510 msgr2=0x7fa53c1358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.873+0000 7fa54139e700 1 --2- 172.21.15.59:0/2675076674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c133510 0x7fa53c1358f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa53000bb90 tx=0x7fa53000bea0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.873+0000 7fa54139e700 1 -- 172.21.15.59:0/2675076674 shutdown_connections 2023-09-30T22:31:17.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.873+0000 7fa54139e700 1 --2- 172.21.15.59:0/2675076674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c135e30 0x7fa53c138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.874+0000 7fa54139e700 1 --2- 172.21.15.59:0/2675076674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c133510 0x7fa53c1358f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.874+0000 7fa54139e700 1 -- 172.21.15.59:0/2675076674 >> 172.21.15.59:0/2675076674 conn(0x7fa53c0a2aa0 msgr2=0x7fa53c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.874+0000 7fa54139e700 1 -- 172.21.15.59:0/2675076674 shutdown_connections 2023-09-30T22:31:17.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.874+0000 7fa54139e700 1 -- 172.21.15.59:0/2675076674 wait complete. 2023-09-30T22:31:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.875+0000 7fa54139e700 1 Processor -- start 2023-09-30T22:31:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.875+0000 7fa54139e700 1 -- start start 2023-09-30T22:31:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.875+0000 7fa54139e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa53c130670 0x7fa53c09b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.875+0000 7fa54139e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c133510 0x7fa53c09b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.875+0000 7fa54139e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c135e30 0x7fa53c1c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.875+0000 7fa54139e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c09bd40 con 0x7fa53c133510 2023-09-30T22:31:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.875+0000 7fa54139e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c135b90 con 0x7fa53c135e30 2023-09-30T22:31:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.875+0000 7fa54139e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c071820 con 0x7fa53c130670 2023-09-30T22:31:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.875+0000 7fa53affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa53c130670 0x7fa53c09b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.875+0000 7fa53affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa53c130670 0x7fa53c09b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41664/0 (socket says 172.21.15.59:41664) 2023-09-30T22:31:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.875+0000 7fa53affd700 1 -- 172.21.15.59:0/30006107 learned_addr learned my addr 172.21.15.59:0/30006107 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.876+0000 7fa53a7fc700 1 --2- 172.21.15.59:0/30006107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c133510 0x7fa53c09b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.876+0000 7fa53b7fe700 1 --2- 172.21.15.59:0/30006107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c135e30 0x7fa53c1c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.876+0000 7fa53affd700 1 -- 172.21.15.59:0/30006107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c135e30 msgr2=0x7fa53c1c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.876+0000 7fa53affd700 1 --2- 172.21.15.59:0/30006107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c135e30 0x7fa53c1c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.876+0000 7fa53affd700 1 -- 172.21.15.59:0/30006107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c133510 msgr2=0x7fa53c09b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.876+0000 7fa53affd700 1 --2- 172.21.15.59:0/30006107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c133510 0x7fa53c09b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.876+0000 7fa53affd700 1 -- 172.21.15.59:0/30006107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa534009a70 con 0x7fa53c130670 2023-09-30T22:31:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.876+0000 7fa53affd700 1 --2- 172.21.15.59:0/30006107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa53c130670 0x7fa53c09b2c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00c4e0 tx=0x7fa52c00c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.876+0000 7fa5237fe700 1 -- 172.21.15.59:0/30006107 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c0052d0 con 0x7fa53c130670 2023-09-30T22:31:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.876+0000 7fa5237fe700 1 -- 172.21.15.59:0/30006107 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c005430 con 0x7fa53c130670 2023-09-30T22:31:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.876+0000 7fa54139e700 1 -- 172.21.15.59:0/30006107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53000b7f0 con 0x7fa53c130670 2023-09-30T22:31:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.876+0000 7fa5237fe700 1 -- 172.21.15.59:0/30006107 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c0038c0 con 0x7fa53c130670 2023-09-30T22:31:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.876+0000 7fa54139e700 1 -- 172.21.15.59:0/30006107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c09e150 con 0x7fa53c130670 2023-09-30T22:31:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.877+0000 7fa5237fe700 1 -- 172.21.15.59:0/30006107 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa52c003a20 con 0x7fa53c130670 2023-09-30T22:31:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.877+0000 7fa5237fe700 1 -- 172.21.15.59:0/30006107 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa52c03ed70 con 0x7fa53c130670 2023-09-30T22:31:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.878+0000 7fa54139e700 1 -- 172.21.15.59:0/30006107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53c09da90 con 0x7fa53c130670 2023-09-30T22:31:17.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.883+0000 7fa5237fe700 1 -- 172.21.15.59:0/30006107 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa52c017080 con 0x7fa53c130670 2023-09-30T22:31:17.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.908+0000 7f5ca45af700 1 Processor -- start 2023-09-30T22:31:17.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.908+0000 7f5ca45af700 1 -- start start 2023-09-30T22:31:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.909+0000 7f5ca45af700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5c9c0a0a30 0x7f5c9c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.909+0000 7f5ca45af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c9c09d630 0x7f5c9c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.909+0000 7f5ca45af700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9c0a2a70 con 0x7f5c9c133930 2023-09-30T22:31:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.909+0000 7f5ca45af700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9c0a01d0 con 0x7f5c9c0a0a30 2023-09-30T22:31:17.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.909+0000 7f5ca45af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c09e2b0 con 0x7f5c9c09d630 2023-09-30T22:31:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.909+0000 7f5ca1b4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c9c09d630 0x7f5c9c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.909+0000 7f5ca234b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5c9c0a0a30 0x7f5c9c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.909+0000 7f5ca1b4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c9c09d630 0x7f5c9c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59146/0 (socket says 172.21.15.59:59146) 2023-09-30T22:31:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.909+0000 7f5ca1b4a700 1 -- 172.21.15.59:0/630351080 learned_addr learned my addr 172.21.15.59:0/630351080 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.909+0000 7f5ca1b4a700 1 -- 172.21.15.59:0/630351080 >> v2:172.21.15.59:3300/0 conn(0x7f5c9c0a0a30 msgr2=0x7f5c9c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.909+0000 7f5ca1b4a700 1 --2- 172.21.15.59:0/630351080 >> v2:172.21.15.59:3300/0 conn(0x7f5c9c0a0a30 0x7f5c9c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.909+0000 7f5ca1b4a700 1 -- 172.21.15.59:0/630351080 >> v1:172.21.15.59:6789/0 conn(0x7f5c9c133930 legacy=0x7f5c9c133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.909+0000 7f5ca1b4a700 1 -- 172.21.15.59:0/630351080 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c09dc50 con 0x7f5c9c09d630 2023-09-30T22:31:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.909+0000 7f5ca234b700 1 --2- 172.21.15.59:0/630351080 >> v2:172.21.15.59:3300/0 conn(0x7f5c9c0a0a30 0x7f5c9c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.910+0000 7f5ca1b4a700 1 --2- 172.21.15.59:0/630351080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c9c09d630 0x7f5c9c0a1340 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0098f0 tx=0x7f5c8c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7e2cd8396bd7281 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.910+0000 7f5ca1349700 1 -- 172.21.15.59:0/630351080 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c011830 con 0x7f5c9c09d630 2023-09-30T22:31:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.910+0000 7f5ca1349700 1 -- 172.21.15.59:0/630351080 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c011990 con 0x7f5c9c09d630 2023-09-30T22:31:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.910+0000 7f5ca1349700 1 -- 172.21.15.59:0/630351080 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c011d20 con 0x7f5c9c09d630 2023-09-30T22:31:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.911+0000 7f5ca45af700 1 -- 172.21.15.59:0/630351080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c9c09d630 msgr2=0x7f5c9c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.911+0000 7f5ca45af700 1 --2- 172.21.15.59:0/630351080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c9c09d630 0x7f5c9c0a1340 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0098f0 tx=0x7f5c8c009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.911+0000 7f5ca45af700 1 -- 172.21.15.59:0/630351080 shutdown_connections 2023-09-30T22:31:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.911+0000 7f5ca45af700 1 --2- 172.21.15.59:0/630351080 >> v2:172.21.15.59:3300/0 conn(0x7f5c9c0a0a30 0x7f5c9c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.911+0000 7f5ca45af700 1 --2- 172.21.15.59:0/630351080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c9c09d630 0x7f5c9c0a1340 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.911+0000 7f5ca45af700 1 -- 172.21.15.59:0/630351080 >> 172.21.15.59:0/630351080 conn(0x7f5c9c0a3050 msgr2=0x7f5c9c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.911+0000 7f5ca45af700 1 -- 172.21.15.59:0/630351080 shutdown_connections 2023-09-30T22:31:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.911+0000 7f5ca45af700 1 -- 172.21.15.59:0/630351080 wait complete. 2023-09-30T22:31:17.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.912+0000 7f5ca45af700 1 Processor -- start 2023-09-30T22:31:17.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.912+0000 7f5ca45af700 1 -- start start 2023-09-30T22:31:17.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.912+0000 7f5ca45af700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c09d630 0x7f5c9c121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.912+0000 7f5ca45af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c9c0a0a30 0x7f5c9c121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.912+0000 7f5ca45af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c9c133930 0x7f5c9c121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.912+0000 7f5ca45af700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c1225b0 con 0x7f5c9c09d630 2023-09-30T22:31:17.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.912+0000 7f5ca45af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c124bd0 con 0x7f5c9c133930 2023-09-30T22:31:17.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.912+0000 7f5ca45af700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c124630 con 0x7f5c9c0a0a30 2023-09-30T22:31:17.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.912+0000 7f5ca234b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c09d630 0x7f5c9c121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.912+0000 7f5ca234b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c09d630 0x7f5c9c121100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53902/0 (socket says 172.21.15.59:53902) 2023-09-30T22:31:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.912+0000 7f5ca234b700 1 -- 172.21.15.59:0/689154689 learned_addr learned my addr 172.21.15.59:0/689154689 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.913+0000 7f5ca1b4a700 1 --2- 172.21.15.59:0/689154689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c9c0a0a30 0x7f5c9c121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.913+0000 7f5ca2b4c700 1 --2- 172.21.15.59:0/689154689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c9c133930 0x7f5c9c121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.913+0000 7f5ca234b700 1 -- 172.21.15.59:0/689154689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c9c0a0a30 msgr2=0x7f5c9c121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.913+0000 7f5ca234b700 1 --2- 172.21.15.59:0/689154689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c9c0a0a30 0x7f5c9c121640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.913+0000 7f5ca234b700 1 -- 172.21.15.59:0/689154689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c9c133930 msgr2=0x7f5c9c121b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.913+0000 7f5ca234b700 1 --2- 172.21.15.59:0/689154689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c9c133930 0x7f5c9c121b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.913+0000 7f5ca234b700 1 -- 172.21.15.59:0/689154689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c980094a0 con 0x7f5c9c09d630 2023-09-30T22:31:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.913+0000 7f5ca234b700 1 --2- 172.21.15.59:0/689154689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c09d630 0x7f5c9c121100 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800ebe0 tx=0x7f5c9800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.913+0000 7f5c92ffd700 1 -- 172.21.15.59:0/689154689 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9800c850 con 0x7f5c9c09d630 2023-09-30T22:31:17.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.913+0000 7f5c92ffd700 1 -- 172.21.15.59:0/689154689 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9800c9b0 con 0x7f5c9c09d630 2023-09-30T22:31:17.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.913+0000 7f5c92ffd700 1 -- 172.21.15.59:0/689154689 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9800cd40 con 0x7f5c9c09d630 2023-09-30T22:31:17.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.913+0000 7f5ca45af700 1 -- 172.21.15.59:0/689154689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8c009550 con 0x7f5c9c09d630 2023-09-30T22:31:17.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.913+0000 7f5ca45af700 1 -- 172.21.15.59:0/689154689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9c0a0410 con 0x7f5c9c09d630 2023-09-30T22:31:17.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.914+0000 7f5c92ffd700 1 -- 172.21.15.59:0/689154689 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c98013470 con 0x7f5c9c09d630 2023-09-30T22:31:17.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.914+0000 7f5c92ffd700 1 -- 172.21.15.59:0/689154689 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5c9803f790 con 0x7f5c9c09d630 2023-09-30T22:31:17.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.915+0000 7f5ca45af700 1 -- 172.21.15.59:0/689154689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9c11df60 con 0x7f5c9c09d630 2023-09-30T22:31:17.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.920+0000 7f5c92ffd700 1 -- 172.21.15.59:0/689154689 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c98013720 con 0x7f5c9c09d630 2023-09-30T22:31:17.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.961+0000 7f32ce0d1700 1 Processor -- start 2023-09-30T22:31:17.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.961+0000 7f32ce0d1700 1 -- start start 2023-09-30T22:31:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.962+0000 7f32ce0d1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f32c80a0a30 0x7f32c80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.962+0000 7f32ce0d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c8138d80 0x7f32c813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.962+0000 7f32ce0d1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c80a2a70 con 0x7f32c809d630 2023-09-30T22:31:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.962+0000 7f32ce0d1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c80a01d0 con 0x7f32c80a0a30 2023-09-30T22:31:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.962+0000 7f32ce0d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c809e2b0 con 0x7f32c8138d80 2023-09-30T22:31:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.962+0000 7f32c77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f32c80a0a30 0x7f32c80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.962+0000 7f32c77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f32c80a0a30 0x7f32c80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53908/0 (socket says 172.21.15.59:53908) 2023-09-30T22:31:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.962+0000 7f32c7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c8138d80 0x7f32c813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.962+0000 7f32c77fe700 1 -- 172.21.15.59:0/3340927902 learned_addr learned my addr 172.21.15.59:0/3340927902 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.962+0000 7f32c6ffd700 1 --1- 172.21.15.59:0/3340927902 >> v1:172.21.15.59:6789/0 conn(0x7f32c809d630 0x7f32c80a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56184/0 (socket says 172.21.15.59:56184) 2023-09-30T22:31:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.962+0000 7f32c77fe700 1 -- 172.21.15.59:0/3340927902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c8138d80 msgr2=0x7f32c813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.962+0000 7f32c77fe700 1 --2- 172.21.15.59:0/3340927902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c8138d80 0x7f32c813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.962+0000 7f32c77fe700 1 -- 172.21.15.59:0/3340927902 >> v1:172.21.15.59:6789/0 conn(0x7f32c809d630 legacy=0x7f32c80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.962+0000 7f32c77fe700 1 -- 172.21.15.59:0/3340927902 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c809dc50 con 0x7f32c80a0a30 2023-09-30T22:31:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.962+0000 7f32c7fff700 1 --2- 172.21.15.59:0/3340927902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c8138d80 0x7f32c813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.963+0000 7f32c77fe700 1 --2- 172.21.15.59:0/3340927902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c80a0a30 0x7f32c80a0e00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f32b80098f0 tx=0x7f32b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7623cd5df8723899 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.963+0000 7f32c67fc700 1 -- 172.21.15.59:0/3340927902 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b8011830 con 0x7f32c80a0a30 2023-09-30T22:31:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.963+0000 7f32c67fc700 1 -- 172.21.15.59:0/3340927902 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b8011990 con 0x7f32c80a0a30 2023-09-30T22:31:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.963+0000 7f32c67fc700 1 -- 172.21.15.59:0/3340927902 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b8011d20 con 0x7f32c80a0a30 2023-09-30T22:31:17.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.963+0000 7f32ce0d1700 1 -- 172.21.15.59:0/3340927902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c80a0a30 msgr2=0x7f32c80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.963+0000 7f32ce0d1700 1 --2- 172.21.15.59:0/3340927902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c80a0a30 0x7f32c80a0e00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f32b80098f0 tx=0x7f32b8009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.963+0000 7f32ce0d1700 1 -- 172.21.15.59:0/3340927902 shutdown_connections 2023-09-30T22:31:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.963+0000 7f32ce0d1700 1 --2- 172.21.15.59:0/3340927902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c80a0a30 0x7f32c80a0e00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.963+0000 7f32ce0d1700 1 --2- 172.21.15.59:0/3340927902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c8138d80 0x7f32c813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.963+0000 7f32ce0d1700 1 -- 172.21.15.59:0/3340927902 >> 172.21.15.59:0/3340927902 conn(0x7f32c80a3050 msgr2=0x7f32c80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.963+0000 7f32ce0d1700 1 -- 172.21.15.59:0/3340927902 shutdown_connections 2023-09-30T22:31:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.964+0000 7f32ce0d1700 1 -- 172.21.15.59:0/3340927902 wait complete. 2023-09-30T22:31:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.964+0000 7f32ce0d1700 1 Processor -- start 2023-09-30T22:31:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.965+0000 7f32ce0d1700 1 -- start start 2023-09-30T22:31:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.965+0000 7f32ce0d1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c809d630 0x7f32c8120830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.965+0000 7f32ce0d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32c80a0a30 0x7f32c8120d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.965+0000 7f32ce0d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c8138d80 0x7f32c81212b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.965+0000 7f32ce0d1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80a4ea0 con 0x7f32c809d630 2023-09-30T22:31:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.965+0000 7f32ce0d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80a0410 con 0x7f32c8138d80 2023-09-30T22:31:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.965+0000 7f32ce0d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32c8123ae0 con 0x7f32c80a0a30 2023-09-30T22:31:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.965+0000 7f32c77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c809d630 0x7f32c8120830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.965+0000 7f32c7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c8138d80 0x7f32c81212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.965+0000 7f32c77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c809d630 0x7f32c8120830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53920/0 (socket says 172.21.15.59:53920) 2023-09-30T22:31:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.965+0000 7f32c77fe700 1 -- 172.21.15.59:0/1045838633 learned_addr learned my addr 172.21.15.59:0/1045838633 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.965+0000 7f32c6ffd700 1 --2- 172.21.15.59:0/1045838633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32c80a0a30 0x7f32c8120d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.966+0000 7f32c7fff700 1 -- 172.21.15.59:0/1045838633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32c80a0a30 msgr2=0x7f32c8120d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.966+0000 7f32c7fff700 1 --2- 172.21.15.59:0/1045838633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32c80a0a30 0x7f32c8120d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.966+0000 7f32c7fff700 1 -- 172.21.15.59:0/1045838633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c809d630 msgr2=0x7f32c8120830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.966+0000 7f32c7fff700 1 --2- 172.21.15.59:0/1045838633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c809d630 0x7f32c8120830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.966+0000 7f32c7fff700 1 -- 172.21.15.59:0/1045838633 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c0009a70 con 0x7f32c8138d80 2023-09-30T22:31:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.966+0000 7f32c7fff700 1 --2- 172.21.15.59:0/1045838633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c8138d80 0x7f32c81212b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f32c000ef90 tx=0x7f32c000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.966+0000 7f32affff700 1 -- 172.21.15.59:0/1045838633 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c000cc90 con 0x7f32c8138d80 2023-09-30T22:31:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.966+0000 7f32affff700 1 -- 172.21.15.59:0/1045838633 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c000f040 con 0x7f32c8138d80 2023-09-30T22:31:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.966+0000 7f32affff700 1 -- 172.21.15.59:0/1045838633 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c00146c0 con 0x7f32c8138d80 2023-09-30T22:31:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.966+0000 7f32ce0d1700 1 -- 172.21.15.59:0/1045838633 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b8009550 con 0x7f32c8138d80 2023-09-30T22:31:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.966+0000 7f32ce0d1700 1 -- 172.21.15.59:0/1045838633 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c8122c30 con 0x7f32c8138d80 2023-09-30T22:31:17.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.967+0000 7f32affff700 1 -- 172.21.15.59:0/1045838633 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32c0014820 con 0x7f32c8138d80 2023-09-30T22:31:17.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.967+0000 7f32ce0d1700 1 -- 172.21.15.59:0/1045838633 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c80747f0 con 0x7f32c8138d80 2023-09-30T22:31:17.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.968+0000 7f32affff700 1 -- 172.21.15.59:0/1045838633 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f32c0040240 con 0x7f32c8138d80 2023-09-30T22:31:17.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:17.972+0000 7f32affff700 1 -- 172.21.15.59:0/1045838633 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32c0007920 con 0x7f32c8138d80 2023-09-30T22:31:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.097+0000 7fa54139e700 1 -- 172.21.15.59:0/30006107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa53c12f2f0 con 0x7fa53c130670 2023-09-30T22:31:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.098+0000 7fa5237fe700 1 -- 172.21.15.59:0/30006107 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa52c018260 con 0x7fa53c130670 2023-09-30T22:31:18.099 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.100+0000 7fa54139e700 1 -- 172.21.15.59:0/30006107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa53c130670 msgr2=0x7fa53c09b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.100+0000 7fa54139e700 1 --2- 172.21.15.59:0/30006107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa53c130670 0x7fa53c09b2c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00c4e0 tx=0x7fa52c00c8a0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.100+0000 7fa54139e700 1 -- 172.21.15.59:0/30006107 shutdown_connections 2023-09-30T22:31:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.100+0000 7fa54139e700 1 --2- 172.21.15.59:0/30006107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa53c130670 0x7fa53c09b2c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.100+0000 7fa54139e700 1 --2- 172.21.15.59:0/30006107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c135e30 0x7fa53c1c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.100+0000 7fa54139e700 1 --2- 172.21.15.59:0/30006107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c133510 0x7fa53c09b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.100+0000 7fa54139e700 1 -- 172.21.15.59:0/30006107 >> 172.21.15.59:0/30006107 conn(0x7fa53c0a2aa0 msgr2=0x7fa53c132390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.100+0000 7fa54139e700 1 -- 172.21.15.59:0/30006107 shutdown_connections 2023-09-30T22:31:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.100+0000 7fa54139e700 1 -- 172.21.15.59:0/30006107 wait complete. 2023-09-30T22:31:18.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:18.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.139+0000 7f5ca45af700 1 -- 172.21.15.59:0/689154689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5c9c124850 con 0x7f5c9c09d630 2023-09-30T22:31:18.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.139+0000 7f5c92ffd700 1 -- 172.21.15.59:0/689154689 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c9c124850 con 0x7f5c9c09d630 2023-09-30T22:31:18.141 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:18.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.142+0000 7f5ca45af700 1 -- 172.21.15.59:0/689154689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c09d630 msgr2=0x7f5c9c121100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.142+0000 7f5ca45af700 1 --2- 172.21.15.59:0/689154689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c09d630 0x7f5c9c121100 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800ebe0 tx=0x7f5c9800eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.142+0000 7f5ca45af700 1 -- 172.21.15.59:0/689154689 shutdown_connections 2023-09-30T22:31:18.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.142+0000 7f5ca45af700 1 --2- 172.21.15.59:0/689154689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c9c133930 0x7f5c9c121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.142+0000 7f5ca45af700 1 --2- 172.21.15.59:0/689154689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c9c09d630 0x7f5c9c121100 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.142+0000 7f5ca45af700 1 --2- 172.21.15.59:0/689154689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c9c0a0a30 0x7f5c9c121640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.142+0000 7f5ca45af700 1 -- 172.21.15.59:0/689154689 >> 172.21.15.59:0/689154689 conn(0x7f5c9c0a3050 msgr2=0x7f5c9c133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.142+0000 7f5ca45af700 1 -- 172.21.15.59:0/689154689 shutdown_connections 2023-09-30T22:31:18.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.142+0000 7f5ca45af700 1 -- 172.21.15.59:0/689154689 wait complete. 2023-09-30T22:31:18.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:18.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.180+0000 7f32ce0d1700 1 -- 172.21.15.59:0/1045838633 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f32c8123690 con 0x7f32c8138d80 2023-09-30T22:31:18.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.180+0000 7f32affff700 1 -- 172.21.15.59:0/1045838633 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32c0018030 con 0x7f32c8138d80 2023-09-30T22:31:18.181 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:18.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.182+0000 7f32ce0d1700 1 -- 172.21.15.59:0/1045838633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c8138d80 msgr2=0x7f32c81212b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.182+0000 7f32ce0d1700 1 --2- 172.21.15.59:0/1045838633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c8138d80 0x7f32c81212b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f32c000ef90 tx=0x7f32c000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.182+0000 7f32ce0d1700 1 -- 172.21.15.59:0/1045838633 shutdown_connections 2023-09-30T22:31:18.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.182+0000 7f32ce0d1700 1 --2- 172.21.15.59:0/1045838633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c8138d80 0x7f32c81212b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.182+0000 7f32ce0d1700 1 --2- 172.21.15.59:0/1045838633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c809d630 0x7f32c8120830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.182+0000 7f32ce0d1700 1 --2- 172.21.15.59:0/1045838633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32c80a0a30 0x7f32c8120d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.182+0000 7f32ce0d1700 1 -- 172.21.15.59:0/1045838633 >> 172.21.15.59:0/1045838633 conn(0x7f32c80a3050 msgr2=0x7f32c809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.182+0000 7f32ce0d1700 1 -- 172.21.15.59:0/1045838633 shutdown_connections 2023-09-30T22:31:18.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.182+0000 7f32ce0d1700 1 -- 172.21.15.59:0/1045838633 wait complete. 2023-09-30T22:31:18.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:18.229 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:18.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.376+0000 7ffaf75b1700 1 Processor -- start 2023-09-30T22:31:18.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.377+0000 7ffaf75b1700 1 -- start start 2023-09-30T22:31:18.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.377+0000 7ffaf75b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf009d6f0 0x7ffaf009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.377+0000 7ffaf75b1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffaf009e000 0x7ffaf01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.377+0000 7ffaf75b1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf009b120 con 0x7ffaf009e410 2023-09-30T22:31:18.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.377+0000 7ffaf75b1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf006b460 con 0x7ffaf009e000 2023-09-30T22:31:18.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.377+0000 7ffaf75b1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf009a7e0 con 0x7ffaf009d6f0 2023-09-30T22:31:18.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.377+0000 7ffaf4b4c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffaf009e000 0x7ffaf01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.377+0000 7ffaf534d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf009d6f0 0x7ffaf009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.377+0000 7ffaf534d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf009d6f0 0x7ffaf009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59190/0 (socket says 172.21.15.59:59190) 2023-09-30T22:31:18.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.377+0000 7ffaf4b4c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffaf009e000 0x7ffaf01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53926/0 (socket says 172.21.15.59:53926) 2023-09-30T22:31:18.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.377+0000 7ffaf534d700 1 -- 172.21.15.59:0/4089265878 learned_addr learned my addr 172.21.15.59:0/4089265878 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:18.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.378+0000 7ffaf534d700 1 -- 172.21.15.59:0/4089265878 >> v2:172.21.15.59:3300/0 conn(0x7ffaf009e000 msgr2=0x7ffaf01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:18.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.378+0000 7ffaf534d700 1 --2- 172.21.15.59:0/4089265878 >> v2:172.21.15.59:3300/0 conn(0x7ffaf009e000 0x7ffaf01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.378+0000 7ffaf534d700 1 -- 172.21.15.59:0/4089265878 >> v1:172.21.15.59:6789/0 conn(0x7ffaf009e410 legacy=0x7ffaf0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.378+0000 7ffaf534d700 1 -- 172.21.15.59:0/4089265878 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf009a500 con 0x7ffaf009d6f0 2023-09-30T22:31:18.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.378+0000 7ffaf4b4c700 1 --2- 172.21.15.59:0/4089265878 >> v2:172.21.15.59:3300/0 conn(0x7ffaf009e000 0x7ffaf01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:18.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.378+0000 7ffaf534d700 1 --2- 172.21.15.59:0/4089265878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf009d6f0 0x7ffaf009dac0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009920 tx=0x7ffae4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc47870606c7e80d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.378+0000 7ffae3fff700 1 -- 172.21.15.59:0/4089265878 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4011830 con 0x7ffaf009d6f0 2023-09-30T22:31:18.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.378+0000 7ffae3fff700 1 -- 172.21.15.59:0/4089265878 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4011990 con 0x7ffaf009d6f0 2023-09-30T22:31:18.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.378+0000 7ffae3fff700 1 -- 172.21.15.59:0/4089265878 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4011d20 con 0x7ffaf009d6f0 2023-09-30T22:31:18.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.379+0000 7ffaf75b1700 1 -- 172.21.15.59:0/4089265878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf009d6f0 msgr2=0x7ffaf009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.379+0000 7ffaf75b1700 1 --2- 172.21.15.59:0/4089265878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf009d6f0 0x7ffaf009dac0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009920 tx=0x7ffae4009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:18.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.379+0000 7ffaf75b1700 1 -- 172.21.15.59:0/4089265878 shutdown_connections 2023-09-30T22:31:18.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.379+0000 7ffaf75b1700 1 --2- 172.21.15.59:0/4089265878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf009d6f0 0x7ffaf009dac0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.379+0000 7ffaf75b1700 1 --2- 172.21.15.59:0/4089265878 >> v2:172.21.15.59:3300/0 conn(0x7ffaf009e000 0x7ffaf01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.379+0000 7ffaf75b1700 1 -- 172.21.15.59:0/4089265878 >> 172.21.15.59:0/4089265878 conn(0x7ffaf0066f50 msgr2=0x7ffaf009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.379+0000 7ffaf75b1700 1 -- 172.21.15.59:0/4089265878 shutdown_connections 2023-09-30T22:31:18.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.379+0000 7ffaf75b1700 1 -- 172.21.15.59:0/4089265878 wait complete. 2023-09-30T22:31:18.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.380+0000 7ffaf75b1700 1 Processor -- start 2023-09-30T22:31:18.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.380+0000 7ffaf75b1700 1 -- start start 2023-09-30T22:31:18.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.380+0000 7ffaf75b1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaf009d6f0 0x7ffaf01a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.380+0000 7ffaf75b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf009e000 0x7ffaf01a6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.380+0000 7ffaf75b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaf009e410 0x7ffaf01a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.380+0000 7ffaf75b1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf01a7cb0 con 0x7ffaf009d6f0 2023-09-30T22:31:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.380+0000 7ffaf75b1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf01a9820 con 0x7ffaf009e000 2023-09-30T22:31:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.380+0000 7ffaf75b1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00a3380 con 0x7ffaf009e410 2023-09-30T22:31:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.380+0000 7ffaf534d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaf009d6f0 0x7ffaf01a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.380+0000 7ffaf534d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaf009d6f0 0x7ffaf01a60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53936/0 (socket says 172.21.15.59:53936) 2023-09-30T22:31:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.381+0000 7ffaf534d700 1 -- 172.21.15.59:0/2143421012 learned_addr learned my addr 172.21.15.59:0/2143421012 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.381+0000 7ffaf5b4e700 1 --2- 172.21.15.59:0/2143421012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaf009e410 0x7ffaf01a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.381+0000 7ffaf4b4c700 1 --2- 172.21.15.59:0/2143421012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf009e000 0x7ffaf01a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.381+0000 7ffaf534d700 1 -- 172.21.15.59:0/2143421012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaf009e410 msgr2=0x7ffaf01a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.381+0000 7ffaf534d700 1 --2- 172.21.15.59:0/2143421012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaf009e410 0x7ffaf01a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.381+0000 7ffaf534d700 1 -- 172.21.15.59:0/2143421012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf009e000 msgr2=0x7ffaf01a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.381+0000 7ffaf534d700 1 --2- 172.21.15.59:0/2143421012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf009e000 0x7ffaf01a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.381+0000 7ffaf534d700 1 -- 172.21.15.59:0/2143421012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec0094a0 con 0x7ffaf009d6f0 2023-09-30T22:31:18.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.381+0000 7ffaf4b4c700 1 --2- 172.21.15.59:0/2143421012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf009e000 0x7ffaf01a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:18.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.381+0000 7ffaf534d700 1 --2- 172.21.15.59:0/2143421012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaf009d6f0 0x7ffaf01a60f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009870 tx=0x7ffae4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.381+0000 7ffae1ffb700 1 -- 172.21.15.59:0/2143421012 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4004300 con 0x7ffaf009d6f0 2023-09-30T22:31:18.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.381+0000 7ffae1ffb700 1 -- 172.21.15.59:0/2143421012 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae401f070 con 0x7ffaf009d6f0 2023-09-30T22:31:18.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.381+0000 7ffaf75b1700 1 -- 172.21.15.59:0/2143421012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae4009550 con 0x7ffaf009d6f0 2023-09-30T22:31:18.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.381+0000 7ffae1ffb700 1 -- 172.21.15.59:0/2143421012 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae40036a0 con 0x7ffaf009d6f0 2023-09-30T22:31:18.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.382+0000 7ffaf75b1700 1 -- 172.21.15.59:0/2143421012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf01a8330 con 0x7ffaf009d6f0 2023-09-30T22:31:18.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.382+0000 7ffaf75b1700 1 -- 172.21.15.59:0/2143421012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf0074ea0 con 0x7ffaf009d6f0 2023-09-30T22:31:18.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.383+0000 7ffae1ffb700 1 -- 172.21.15.59:0/2143421012 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffae4021030 con 0x7ffaf009d6f0 2023-09-30T22:31:18.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.383+0000 7ffae1ffb700 1 -- 172.21.15.59:0/2143421012 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffae4040ce0 con 0x7ffaf009d6f0 2023-09-30T22:31:18.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.388+0000 7ffae1ffb700 1 -- 172.21.15.59:0/2143421012 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffae40199a0 con 0x7ffaf009d6f0 2023-09-30T22:31:18.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.589+0000 7ffaf75b1700 1 -- 172.21.15.59:0/2143421012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffaf01a9b60 con 0x7ffaf009d6f0 2023-09-30T22:31:18.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.589+0000 7ffae1ffb700 1 -- 172.21.15.59:0/2143421012 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffae4015070 con 0x7ffaf009d6f0 2023-09-30T22:31:18.590 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:18.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.591+0000 7ffaf75b1700 1 -- 172.21.15.59:0/2143421012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaf009d6f0 msgr2=0x7ffaf01a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.591+0000 7ffaf75b1700 1 --2- 172.21.15.59:0/2143421012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaf009d6f0 0x7ffaf01a60f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009870 tx=0x7ffae4004750 comp rx=0 tx=0).stop 2023-09-30T22:31:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.591+0000 7ffaf75b1700 1 -- 172.21.15.59:0/2143421012 shutdown_connections 2023-09-30T22:31:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.591+0000 7ffaf75b1700 1 --2- 172.21.15.59:0/2143421012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaf009e410 0x7ffaf01a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.591+0000 7ffaf75b1700 1 --2- 172.21.15.59:0/2143421012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaf009d6f0 0x7ffaf01a60f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.591+0000 7ffaf75b1700 1 --2- 172.21.15.59:0/2143421012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf009e000 0x7ffaf01a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.591+0000 7ffaf75b1700 1 -- 172.21.15.59:0/2143421012 >> 172.21.15.59:0/2143421012 conn(0x7ffaf0066f50 msgr2=0x7ffaf01baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.591+0000 7ffaf75b1700 1 -- 172.21.15.59:0/2143421012 shutdown_connections 2023-09-30T22:31:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:18.591+0000 7ffaf75b1700 1 -- 172.21.15.59:0/2143421012 wait complete. 2023-09-30T22:31:18.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:19.116 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:19.158 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:19.197 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:19.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.265+0000 7f35164ed700 1 Processor -- start 2023-09-30T22:31:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.265+0000 7f35164ed700 1 -- start start 2023-09-30T22:31:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.266+0000 7f35164ed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f351009e930 0x7f351009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.266+0000 7f35164ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f351009f240 0x7f35101317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.266+0000 7f35164ed700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3510070940 con 0x7f351009f650 2023-09-30T22:31:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.266+0000 7f35164ed700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351006fd60 con 0x7f351009e930 2023-09-30T22:31:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.266+0000 7f35164ed700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f351006fa80 con 0x7f351009f240 2023-09-30T22:31:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.266+0000 7f350f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f351009f240 0x7f35101317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.266+0000 7f350f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f351009f240 0x7f35101317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41696/0 (socket says 172.21.15.59:41696) 2023-09-30T22:31:19.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.266+0000 7f350ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f351009e930 0x7f351009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.266+0000 7f350f7fe700 1 -- 172.21.15.59:0/372408804 learned_addr learned my addr 172.21.15.59:0/372408804 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.266+0000 7f350ffff700 1 -- 172.21.15.59:0/372408804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f351009f240 msgr2=0x7f35101317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.266+0000 7f350ffff700 1 --2- 172.21.15.59:0/372408804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f351009f240 0x7f35101317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.266+0000 7f350ffff700 1 -- 172.21.15.59:0/372408804 >> v1:172.21.15.59:6789/0 conn(0x7f351009f650 legacy=0x7f3510131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.266+0000 7f350ffff700 1 -- 172.21.15.59:0/372408804 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351009fb60 con 0x7f351009e930 2023-09-30T22:31:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.266+0000 7f350f7fe700 1 --2- 172.21.15.59:0/372408804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f351009f240 0x7f35101317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.266+0000 7f350ffff700 1 --2- 172.21.15.59:0/372408804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351009e930 0x7f351009ed00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3500009840 tx=0x7f3500009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9fa5a6b5eb6de6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.267+0000 7f350effd700 1 -- 172.21.15.59:0/372408804 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500011830 con 0x7f351009e930 2023-09-30T22:31:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.267+0000 7f350effd700 1 -- 172.21.15.59:0/372408804 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3500011990 con 0x7f351009e930 2023-09-30T22:31:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.267+0000 7f350effd700 1 -- 172.21.15.59:0/372408804 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500011d20 con 0x7f351009e930 2023-09-30T22:31:19.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.267+0000 7f35164ed700 1 -- 172.21.15.59:0/372408804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351009e930 msgr2=0x7f351009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.267+0000 7f35164ed700 1 --2- 172.21.15.59:0/372408804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351009e930 0x7f351009ed00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3500009840 tx=0x7f3500009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:19.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.268+0000 7f35164ed700 1 -- 172.21.15.59:0/372408804 shutdown_connections 2023-09-30T22:31:19.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.268+0000 7f35164ed700 1 --2- 172.21.15.59:0/372408804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351009e930 0x7f351009ed00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.268+0000 7f35164ed700 1 --2- 172.21.15.59:0/372408804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f351009f240 0x7f35101317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.268+0000 7f35164ed700 1 -- 172.21.15.59:0/372408804 >> 172.21.15.59:0/372408804 conn(0x7f35100a4210 msgr2=0x7f35100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:19.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.268+0000 7f35164ed700 1 -- 172.21.15.59:0/372408804 shutdown_connections 2023-09-30T22:31:19.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.268+0000 7f35164ed700 1 -- 172.21.15.59:0/372408804 wait complete. 2023-09-30T22:31:19.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.269+0000 7f35164ed700 1 Processor -- start 2023-09-30T22:31:19.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.269+0000 7f35164ed700 1 -- start start 2023-09-30T22:31:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.270+0000 7f35164ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351009e930 0x7f351006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.270+0000 7f35164ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f351009f240 0x7f351006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.270+0000 7f35164ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351009f650 0x7f351006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.270+0000 7f35164ed700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35101b7240 con 0x7f351009e930 2023-09-30T22:31:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.270+0000 7f35164ed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35101a93f0 con 0x7f351009f650 2023-09-30T22:31:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.270+0000 7f35164ed700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35101a8910 con 0x7f351009f240 2023-09-30T22:31:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.270+0000 7f350ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351009e930 0x7f351006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.270+0000 7f350ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351009e930 0x7f351006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53964/0 (socket says 172.21.15.59:53964) 2023-09-30T22:31:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.270+0000 7f350ffff700 1 -- 172.21.15.59:0/2245086199 learned_addr learned my addr 172.21.15.59:0/2245086199 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.270+0000 7f350f7fe700 1 --2- 172.21.15.59:0/2245086199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f351009f240 0x7f351006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.270+0000 7f350ffff700 1 -- 172.21.15.59:0/2245086199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f351009f240 msgr2=0x7f351006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.270+0000 7f350ffff700 1 --2- 172.21.15.59:0/2245086199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f351009f240 0x7f351006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.270+0000 7f350ffff700 1 -- 172.21.15.59:0/2245086199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351009f650 msgr2=0x7f351006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.270+0000 7f350ffff700 1 --2- 172.21.15.59:0/2245086199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351009f650 0x7f351006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.270+0000 7f350ffff700 1 -- 172.21.15.59:0/2245086199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3504009550 con 0x7f351009e930 2023-09-30T22:31:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.271+0000 7f350ffff700 1 --2- 172.21.15.59:0/2245086199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351009e930 0x7f351006b8b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f35000090b0 tx=0x7f3500004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.271+0000 7f350cff9700 1 -- 172.21.15.59:0/2245086199 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35000036a0 con 0x7f351009e930 2023-09-30T22:31:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.271+0000 7f35164ed700 1 -- 172.21.15.59:0/2245086199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35000094a0 con 0x7f351009e930 2023-09-30T22:31:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.271+0000 7f350cff9700 1 -- 172.21.15.59:0/2245086199 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350001f070 con 0x7f351009e930 2023-09-30T22:31:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.271+0000 7f350cff9700 1 -- 172.21.15.59:0/2245086199 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500003a20 con 0x7f351009e930 2023-09-30T22:31:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.271+0000 7f35164ed700 1 -- 172.21.15.59:0/2245086199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35100a0190 con 0x7f351009e930 2023-09-30T22:31:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.272+0000 7f350cff9700 1 -- 172.21.15.59:0/2245086199 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3500003b80 con 0x7f351009e930 2023-09-30T22:31:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.272+0000 7f35164ed700 1 -- 172.21.15.59:0/2245086199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35100a3510 con 0x7f351009e930 2023-09-30T22:31:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.272+0000 7f350cff9700 1 -- 172.21.15.59:0/2245086199 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3500021070 con 0x7f351009e930 2023-09-30T22:31:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.277+0000 7f350cff9700 1 -- 172.21.15.59:0/2245086199 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3500010c00 con 0x7f351009e930 2023-09-30T22:31:19.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.305+0000 7f78804a1700 1 Processor -- start 2023-09-30T22:31:19.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.306+0000 7f78804a1700 1 -- start start 2023-09-30T22:31:19.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.306+0000 7f78804a1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787809d6f0 0x7f787809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.306+0000 7f78804a1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787809e000 0x7f78781339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.306+0000 7f78804a1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787809b120 con 0x7f787809e410 2023-09-30T22:31:19.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.306+0000 7f78804a1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787806b460 con 0x7f787809d6f0 2023-09-30T22:31:19.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.306+0000 7f78804a1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f787809a7e0 con 0x7f787809e000 2023-09-30T22:31:19.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.306+0000 7f787da3c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787809e000 0x7f78781339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.307+0000 7f787e23d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787809d6f0 0x7f787809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.307+0000 7f787ea3e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f787809e410 0x7f7878133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56204/0 (socket says 172.21.15.59:56204) 2023-09-30T22:31:19.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.307+0000 7f787ea3e700 1 -- 172.21.15.59:0/4080722952 learned_addr learned my addr 172.21.15.59:0/4080722952 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:19.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.307+0000 7f787da3c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787809e000 0x7f78781339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41716/0 (socket says 172.21.15.59:41716) 2023-09-30T22:31:19.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.307+0000 7f787e23d700 1 -- 172.21.15.59:0/4080722952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787809e000 msgr2=0x7f78781339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:19.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.307+0000 7f787e23d700 1 --2- 172.21.15.59:0/4080722952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787809e000 0x7f78781339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.307+0000 7f787e23d700 1 -- 172.21.15.59:0/4080722952 >> v1:172.21.15.59:6789/0 conn(0x7f787809e410 legacy=0x7f7878133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.307+0000 7f787e23d700 1 -- 172.21.15.59:0/4080722952 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787809a500 con 0x7f787809d6f0 2023-09-30T22:31:19.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.307+0000 7f787e23d700 1 --2- 172.21.15.59:0/4080722952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787809d6f0 0x7f787809dac0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7874009870 tx=0x7f7874009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=681265237f1419c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:19.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.307+0000 7f787d23b700 1 -- 172.21.15.59:0/4080722952 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874011830 con 0x7f787809d6f0 2023-09-30T22:31:19.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.307+0000 7f787d23b700 1 -- 172.21.15.59:0/4080722952 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7874011990 con 0x7f787809d6f0 2023-09-30T22:31:19.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.307+0000 7f787d23b700 1 -- 172.21.15.59:0/4080722952 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874011d20 con 0x7f787809d6f0 2023-09-30T22:31:19.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.308+0000 7f78804a1700 1 -- 172.21.15.59:0/4080722952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787809d6f0 msgr2=0x7f787809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.308+0000 7f78804a1700 1 --2- 172.21.15.59:0/4080722952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787809d6f0 0x7f787809dac0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7874009870 tx=0x7f7874009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:19.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.308+0000 7f78804a1700 1 -- 172.21.15.59:0/4080722952 shutdown_connections 2023-09-30T22:31:19.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.308+0000 7f78804a1700 1 --2- 172.21.15.59:0/4080722952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787809d6f0 0x7f787809dac0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.308+0000 7f78804a1700 1 --2- 172.21.15.59:0/4080722952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787809e000 0x7f78781339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.308+0000 7f78804a1700 1 -- 172.21.15.59:0/4080722952 >> 172.21.15.59:0/4080722952 conn(0x7f7878066f50 msgr2=0x7f787809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:19.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.308+0000 7f78804a1700 1 -- 172.21.15.59:0/4080722952 shutdown_connections 2023-09-30T22:31:19.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.308+0000 7f78804a1700 1 -- 172.21.15.59:0/4080722952 wait complete. 2023-09-30T22:31:19.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.310+0000 7f78804a1700 1 Processor -- start 2023-09-30T22:31:19.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.310+0000 7f78804a1700 1 -- start start 2023-09-30T22:31:19.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f78804a1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787809d6f0 0x7f7878122490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f78804a1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787809e000 0x7f78781229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f78804a1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787809e410 0x7f7878122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f78804a1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7878125a10 con 0x7f787809e410 2023-09-30T22:31:19.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f78804a1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78781238f0 con 0x7f787809e000 2023-09-30T22:31:19.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f78804a1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7878124900 con 0x7f787809d6f0 2023-09-30T22:31:19.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f787da3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787809e000 0x7f78781229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f787da3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787809e000 0x7f78781229d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59232/0 (socket says 172.21.15.59:59232) 2023-09-30T22:31:19.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f787da3c700 1 -- 172.21.15.59:0/3544213621 learned_addr learned my addr 172.21.15.59:0/3544213621 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:19.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f787e23d700 1 --2- 172.21.15.59:0/3544213621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787809d6f0 0x7f7878122490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f787ea3e700 1 --2- 172.21.15.59:0/3544213621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787809e410 0x7f7878122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f787da3c700 1 -- 172.21.15.59:0/3544213621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787809d6f0 msgr2=0x7f7878122490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f787da3c700 1 --2- 172.21.15.59:0/3544213621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787809d6f0 0x7f7878122490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f787da3c700 1 -- 172.21.15.59:0/3544213621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787809e410 msgr2=0x7f7878122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f787da3c700 1 --2- 172.21.15.59:0/3544213621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787809e410 0x7f7878122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f787da3c700 1 -- 172.21.15.59:0/3544213621 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78740094a0 con 0x7f787809e000 2023-09-30T22:31:19.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.311+0000 7f787da3c700 1 --2- 172.21.15.59:0/3544213621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787809e000 0x7f78781229d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f786800e9b0 tx=0x7f786800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:19.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.312+0000 7f786effd700 1 -- 172.21.15.59:0/3544213621 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868009710 con 0x7f787809e000 2023-09-30T22:31:19.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.312+0000 7f786effd700 1 -- 172.21.15.59:0/3544213621 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786800ee50 con 0x7f787809e000 2023-09-30T22:31:19.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.312+0000 7f786effd700 1 -- 172.21.15.59:0/3544213621 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786800ca50 con 0x7f787809e000 2023-09-30T22:31:19.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.312+0000 7f78804a1700 1 -- 172.21.15.59:0/3544213621 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78780a2be0 con 0x7f787809e000 2023-09-30T22:31:19.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.312+0000 7f78804a1700 1 -- 172.21.15.59:0/3544213621 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7878126740 con 0x7f787809e000 2023-09-30T22:31:19.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.313+0000 7f786effd700 1 -- 172.21.15.59:0/3544213621 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f786800cbb0 con 0x7f787809e000 2023-09-30T22:31:19.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.313+0000 7f78804a1700 1 -- 172.21.15.59:0/3544213621 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7878074ea0 con 0x7f787809e000 2023-09-30T22:31:19.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.313+0000 7f786effd700 1 -- 172.21.15.59:0/3544213621 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f786803fb60 con 0x7f787809e000 2023-09-30T22:31:19.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.318+0000 7f786effd700 1 -- 172.21.15.59:0/3544213621 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f786801b3b0 con 0x7f787809e000 2023-09-30T22:31:19.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.347+0000 7f8d6d944700 1 Processor -- start 2023-09-30T22:31:19.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.347+0000 7f8d6d944700 1 -- start start 2023-09-30T22:31:19.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.348+0000 7f8d6d944700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d6809f410 0x7f8d68136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.348+0000 7f8d6d944700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d68136fe0 0x7f8d681393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.348+0000 7f8d6d944700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d68070940 con 0x7f8d6809e930 2023-09-30T22:31:19.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.348+0000 7f8d6d944700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6806fd60 con 0x7f8d68136fe0 2023-09-30T22:31:19.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.348+0000 7f8d6d944700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6806fa80 con 0x7f8d6809f410 2023-09-30T22:31:19.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.348+0000 7f8d66ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8d6809e930 0x7f8d6809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56216/0 (socket says 172.21.15.59:56216) 2023-09-30T22:31:19.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.348+0000 7f8d66ffd700 1 -- 172.21.15.59:0/3861583728 learned_addr learned my addr 172.21.15.59:0/3861583728 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:19.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.348+0000 7f8d677fe700 1 --2- 172.21.15.59:0/3861583728 >> v2:172.21.15.59:3300/0 conn(0x7f8d68136fe0 0x7f8d681393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.348+0000 7f8d667fc700 1 --2- 172.21.15.59:0/3861583728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d6809f410 0x7f8d68136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.349+0000 7f8d667fc700 1 -- 172.21.15.59:0/3861583728 >> v2:172.21.15.59:3300/0 conn(0x7f8d68136fe0 msgr2=0x7f8d681393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.349+0000 7f8d667fc700 1 --2- 172.21.15.59:0/3861583728 >> v2:172.21.15.59:3300/0 conn(0x7f8d68136fe0 0x7f8d681393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.349+0000 7f8d667fc700 1 -- 172.21.15.59:0/3861583728 >> v1:172.21.15.59:6789/0 conn(0x7f8d6809e930 legacy=0x7f8d6809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.349+0000 7f8d667fc700 1 -- 172.21.15.59:0/3861583728 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6809fb60 con 0x7f8d6809f410 2023-09-30T22:31:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.349+0000 7f8d65ffb700 1 -- 172.21.15.59:0/3861583728 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534358075 0 0) 0x7f8d68070940 con 0x7f8d6809e930 2023-09-30T22:31:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.349+0000 7f8d677fe700 1 --2- 172.21.15.59:0/3861583728 >> v2:172.21.15.59:3300/0 conn(0x7f8d68136fe0 0x7f8d681393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.349+0000 7f8d667fc700 1 --2- 172.21.15.59:0/3861583728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d6809f410 0x7f8d68136aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009840 tx=0x7f8d5c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6278f9f9dee49bdf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.349+0000 7f8d65ffb700 1 -- 172.21.15.59:0/3861583728 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c011830 con 0x7f8d6809f410 2023-09-30T22:31:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.349+0000 7f8d65ffb700 1 -- 172.21.15.59:0/3861583728 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c011990 con 0x7f8d6809f410 2023-09-30T22:31:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.349+0000 7f8d65ffb700 1 -- 172.21.15.59:0/3861583728 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c011d20 con 0x7f8d6809f410 2023-09-30T22:31:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.350+0000 7f8d6d944700 1 -- 172.21.15.59:0/3861583728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d6809f410 msgr2=0x7f8d68136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.350+0000 7f8d6d944700 1 --2- 172.21.15.59:0/3861583728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d6809f410 0x7f8d68136aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009840 tx=0x7f8d5c009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:19.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.350+0000 7f8d6d944700 1 -- 172.21.15.59:0/3861583728 shutdown_connections 2023-09-30T22:31:19.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.350+0000 7f8d6d944700 1 --2- 172.21.15.59:0/3861583728 >> v2:172.21.15.59:3300/0 conn(0x7f8d68136fe0 0x7f8d681393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.350+0000 7f8d6d944700 1 --2- 172.21.15.59:0/3861583728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d6809f410 0x7f8d68136aa0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.350+0000 7f8d6d944700 1 -- 172.21.15.59:0/3861583728 >> 172.21.15.59:0/3861583728 conn(0x7f8d680a4210 msgr2=0x7f8d680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:19.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.350+0000 7f8d6d944700 1 -- 172.21.15.59:0/3861583728 shutdown_connections 2023-09-30T22:31:19.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.350+0000 7f8d6d944700 1 -- 172.21.15.59:0/3861583728 wait complete. 2023-09-30T22:31:19.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.351+0000 7f8d6d944700 1 Processor -- start 2023-09-30T22:31:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.351+0000 7f8d6d944700 1 -- start start 2023-09-30T22:31:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.352+0000 7f8d6d944700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d6809e930 0x7f8d681c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.352+0000 7f8d6d944700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d6809f410 0x7f8d681c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.352+0000 7f8d6d944700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d68136fe0 0x7f8d6806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.352+0000 7f8d6d944700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68121eb0 con 0x7f8d68136fe0 2023-09-30T22:31:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.352+0000 7f8d6d944700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d681bc0c0 con 0x7f8d6809f410 2023-09-30T22:31:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.352+0000 7f8d6d944700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68132220 con 0x7f8d6809e930 2023-09-30T22:31:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.352+0000 7f8d66ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d6809e930 0x7f8d681c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.352+0000 7f8d66ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d6809e930 0x7f8d681c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41732/0 (socket says 172.21.15.59:41732) 2023-09-30T22:31:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.352+0000 7f8d66ffd700 1 -- 172.21.15.59:0/1383962421 learned_addr learned my addr 172.21.15.59:0/1383962421 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.352+0000 7f8d667fc700 1 --2- 172.21.15.59:0/1383962421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d6809f410 0x7f8d681c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.352+0000 7f8d677fe700 1 --2- 172.21.15.59:0/1383962421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d68136fe0 0x7f8d6806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.353+0000 7f8d667fc700 1 -- 172.21.15.59:0/1383962421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d6809e930 msgr2=0x7f8d681c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.353+0000 7f8d667fc700 1 --2- 172.21.15.59:0/1383962421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d6809e930 0x7f8d681c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.353+0000 7f8d667fc700 1 -- 172.21.15.59:0/1383962421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d68136fe0 msgr2=0x7f8d6806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.353+0000 7f8d667fc700 1 --2- 172.21.15.59:0/1383962421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d68136fe0 0x7f8d6806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.353+0000 7f8d667fc700 1 -- 172.21.15.59:0/1383962421 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d60009a70 con 0x7f8d6809f410 2023-09-30T22:31:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.353+0000 7f8d66ffd700 1 --2- 172.21.15.59:0/1383962421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d6809e930 0x7f8d681c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.353+0000 7f8d667fc700 1 --2- 172.21.15.59:0/1383962421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d6809f410 0x7f8d681c8950 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c016000 tx=0x7f8d5c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.353+0000 7f8d4ffff700 1 -- 172.21.15.59:0/1383962421 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c004550 con 0x7f8d6809f410 2023-09-30T22:31:19.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.353+0000 7f8d4ffff700 1 -- 172.21.15.59:0/1383962421 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c01f070 con 0x7f8d6809f410 2023-09-30T22:31:19.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.353+0000 7f8d6d944700 1 -- 172.21.15.59:0/1383962421 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5c0094a0 con 0x7f8d6809f410 2023-09-30T22:31:19.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.353+0000 7f8d4ffff700 1 -- 172.21.15.59:0/1383962421 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c0038e0 con 0x7f8d6809f410 2023-09-30T22:31:19.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.353+0000 7f8d6d944700 1 -- 172.21.15.59:0/1383962421 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d68120a70 con 0x7f8d6809f410 2023-09-30T22:31:19.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.354+0000 7f8d6d944700 1 -- 172.21.15.59:0/1383962421 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d68074ea0 con 0x7f8d6809f410 2023-09-30T22:31:19.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.355+0000 7f8d4ffff700 1 -- 172.21.15.59:0/1383962421 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d5c003a40 con 0x7f8d6809f410 2023-09-30T22:31:19.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.355+0000 7f8d4ffff700 1 -- 172.21.15.59:0/1383962421 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d5c021070 con 0x7f8d6809f410 2023-09-30T22:31:19.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.359+0000 7f8d4ffff700 1 -- 172.21.15.59:0/1383962421 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d5c010380 con 0x7f8d6809f410 2023-09-30T22:31:19.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.502+0000 7f35164ed700 1 -- 172.21.15.59:0/2245086199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3510071d20 con 0x7f351009e930 2023-09-30T22:31:19.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.502+0000 7f350cff9700 1 -- 172.21.15.59:0/2245086199 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3500015070 con 0x7f351009e930 2023-09-30T22:31:19.503 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:19.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.504+0000 7f35164ed700 1 -- 172.21.15.59:0/2245086199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351009e930 msgr2=0x7f351006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.504+0000 7f35164ed700 1 --2- 172.21.15.59:0/2245086199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351009e930 0x7f351006b8b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f35000090b0 tx=0x7f3500004750 comp rx=0 tx=0).stop 2023-09-30T22:31:19.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.505+0000 7f35164ed700 1 -- 172.21.15.59:0/2245086199 shutdown_connections 2023-09-30T22:31:19.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.505+0000 7f35164ed700 1 --2- 172.21.15.59:0/2245086199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351009f650 0x7f351006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.505+0000 7f35164ed700 1 --2- 172.21.15.59:0/2245086199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351009e930 0x7f351006b8b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.505+0000 7f35164ed700 1 --2- 172.21.15.59:0/2245086199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f351009f240 0x7f351006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.505+0000 7f35164ed700 1 -- 172.21.15.59:0/2245086199 >> 172.21.15.59:0/2245086199 conn(0x7f35100a4210 msgr2=0x7f35101b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:19.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.505+0000 7f35164ed700 1 -- 172.21.15.59:0/2245086199 shutdown_connections 2023-09-30T22:31:19.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.505+0000 7f35164ed700 1 -- 172.21.15.59:0/2245086199 wait complete. 2023-09-30T22:31:19.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:19.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.531+0000 7f78804a1700 1 -- 172.21.15.59:0/3544213621 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f787806c360 con 0x7f787809e000 2023-09-30T22:31:19.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.531+0000 7f786effd700 1 -- 172.21.15.59:0/3544213621 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7868011b40 con 0x7f787809e000 2023-09-30T22:31:19.532 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:19.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.533+0000 7f78804a1700 1 -- 172.21.15.59:0/3544213621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787809e000 msgr2=0x7f78781229d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.533+0000 7f78804a1700 1 --2- 172.21.15.59:0/3544213621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787809e000 0x7f78781229d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f786800e9b0 tx=0x7f786800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.533+0000 7f78804a1700 1 -- 172.21.15.59:0/3544213621 shutdown_connections 2023-09-30T22:31:19.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.533+0000 7f78804a1700 1 --2- 172.21.15.59:0/3544213621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787809d6f0 0x7f7878122490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.533+0000 7f78804a1700 1 --2- 172.21.15.59:0/3544213621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787809e410 0x7f7878122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.533+0000 7f78804a1700 1 --2- 172.21.15.59:0/3544213621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787809e000 0x7f78781229d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.533+0000 7f78804a1700 1 -- 172.21.15.59:0/3544213621 >> 172.21.15.59:0/3544213621 conn(0x7f7878066f50 msgr2=0x7f78780a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:19.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.533+0000 7f78804a1700 1 -- 172.21.15.59:0/3544213621 shutdown_connections 2023-09-30T22:31:19.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.534+0000 7f78804a1700 1 -- 172.21.15.59:0/3544213621 wait complete. 2023-09-30T22:31:19.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.583+0000 7f8d6d944700 1 -- 172.21.15.59:0/1383962421 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8d6806d4c0 con 0x7f8d6809f410 2023-09-30T22:31:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.583+0000 7f8d4ffff700 1 -- 172.21.15.59:0/1383962421 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d5c015020 con 0x7f8d6809f410 2023-09-30T22:31:19.584 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.585+0000 7f8d6d944700 1 -- 172.21.15.59:0/1383962421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d6809f410 msgr2=0x7f8d681c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.585+0000 7f8d6d944700 1 --2- 172.21.15.59:0/1383962421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d6809f410 0x7f8d681c8950 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c016000 tx=0x7f8d5c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.585+0000 7f8d6d944700 1 -- 172.21.15.59:0/1383962421 shutdown_connections 2023-09-30T22:31:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.585+0000 7f8d6d944700 1 --2- 172.21.15.59:0/1383962421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d6809e930 0x7f8d681c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.585+0000 7f8d6d944700 1 --2- 172.21.15.59:0/1383962421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d68136fe0 0x7f8d6806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.585+0000 7f8d6d944700 1 --2- 172.21.15.59:0/1383962421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d6809f410 0x7f8d681c8950 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.585+0000 7f8d6d944700 1 -- 172.21.15.59:0/1383962421 >> 172.21.15.59:0/1383962421 conn(0x7f8d680a4210 msgr2=0x7f8d68134ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.585+0000 7f8d6d944700 1 -- 172.21.15.59:0/1383962421 shutdown_connections 2023-09-30T22:31:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.585+0000 7f8d6d944700 1 -- 172.21.15.59:0/1383962421 wait complete. 2023-09-30T22:31:19.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:19.607 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:19.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.778+0000 7f30c7476700 1 Processor -- start 2023-09-30T22:31:19.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.778+0000 7f30c7476700 1 -- start start 2023-09-30T22:31:19.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30c7476700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c009d6f0 0x7f30c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30c7476700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c009e000 0x7f30c0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30c7476700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c009f130 con 0x7f30c009e410 2023-09-30T22:31:19.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30c7476700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c009f520 con 0x7f30c009e000 2023-09-30T22:31:19.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30c7476700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30c009e930 con 0x7f30c009d6f0 2023-09-30T22:31:19.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30c5212700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c009d6f0 0x7f30c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30c5a13700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f30c009e410 0x7f30c0130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56224/0 (socket says 172.21.15.59:56224) 2023-09-30T22:31:19.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30c5212700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c009d6f0 0x7f30c009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41744/0 (socket says 172.21.15.59:41744) 2023-09-30T22:31:19.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30c5a13700 1 -- 172.21.15.59:0/4068377439 learned_addr learned my addr 172.21.15.59:0/4068377439 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:19.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30c4a11700 1 --2- 172.21.15.59:0/4068377439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c009e000 0x7f30c0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30b3fff700 1 -- 172.21.15.59:0/4068377439 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593558301 0 0) 0x7f30c009f130 con 0x7f30c009e410 2023-09-30T22:31:19.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30c5212700 1 -- 172.21.15.59:0/4068377439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c009e000 msgr2=0x7f30c0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:19.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30c5212700 1 --2- 172.21.15.59:0/4068377439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c009e000 0x7f30c0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30c5212700 1 -- 172.21.15.59:0/4068377439 >> v1:172.21.15.59:6789/0 conn(0x7f30c009e410 legacy=0x7f30c0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30c5212700 1 -- 172.21.15.59:0/4068377439 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c009b2d0 con 0x7f30c009d6f0 2023-09-30T22:31:19.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.779+0000 7f30c4a11700 1 --2- 172.21.15.59:0/4068377439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c009e000 0x7f30c0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:19.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.780+0000 7f30c5212700 1 --2- 172.21.15.59:0/4068377439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c009d6f0 0x7f30c009dac0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f30b40098a0 tx=0x7f30b4009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ed4b6c80306f827 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:19.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.780+0000 7f30b3fff700 1 -- 172.21.15.59:0/4068377439 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4011830 con 0x7f30c009d6f0 2023-09-30T22:31:19.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.780+0000 7f30b3fff700 1 -- 172.21.15.59:0/4068377439 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4011990 con 0x7f30c009d6f0 2023-09-30T22:31:19.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.780+0000 7f30b3fff700 1 -- 172.21.15.59:0/4068377439 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4011d20 con 0x7f30c009d6f0 2023-09-30T22:31:19.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.780+0000 7f30c7476700 1 -- 172.21.15.59:0/4068377439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c009d6f0 msgr2=0x7f30c009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.780+0000 7f30c7476700 1 --2- 172.21.15.59:0/4068377439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c009d6f0 0x7f30c009dac0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f30b40098a0 tx=0x7f30b4009bb0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.780+0000 7f30c7476700 1 -- 172.21.15.59:0/4068377439 shutdown_connections 2023-09-30T22:31:19.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.780+0000 7f30c7476700 1 --2- 172.21.15.59:0/4068377439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c009d6f0 0x7f30c009dac0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.780+0000 7f30c7476700 1 --2- 172.21.15.59:0/4068377439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c009e000 0x7f30c0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.780+0000 7f30c7476700 1 -- 172.21.15.59:0/4068377439 >> 172.21.15.59:0/4068377439 conn(0x7f30c0066f50 msgr2=0x7f30c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:19.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.780+0000 7f30c7476700 1 -- 172.21.15.59:0/4068377439 shutdown_connections 2023-09-30T22:31:19.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.781+0000 7f30c7476700 1 -- 172.21.15.59:0/4068377439 wait complete. 2023-09-30T22:31:19.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.781+0000 7f30c7476700 1 Processor -- start 2023-09-30T22:31:19.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.781+0000 7f30c7476700 1 -- start start 2023-09-30T22:31:19.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c7476700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c009d6f0 0x7f30c0122220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c7476700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c009e000 0x7f30c0122760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c7476700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c009e410 0x7f30c0122ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c7476700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0124450 con 0x7f30c009e000 2023-09-30T22:31:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c7476700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c009c770 con 0x7f30c009d6f0 2023-09-30T22:31:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c7476700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0123660 con 0x7f30c009e410 2023-09-30T22:31:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c5a13700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c009e410 0x7f30c0122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c5212700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c009d6f0 0x7f30c0122220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c5a13700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c009e410 0x7f30c0122ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41750/0 (socket says 172.21.15.59:41750) 2023-09-30T22:31:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c5a13700 1 -- 172.21.15.59:0/1707157271 learned_addr learned my addr 172.21.15.59:0/1707157271 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c4a11700 1 --2- 172.21.15.59:0/1707157271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c009e000 0x7f30c0122760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c5212700 1 -- 172.21.15.59:0/1707157271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c009e410 msgr2=0x7f30c0122ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c5212700 1 --2- 172.21.15.59:0/1707157271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c009e410 0x7f30c0122ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c5212700 1 -- 172.21.15.59:0/1707157271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c009e000 msgr2=0x7f30c0122760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c5212700 1 --2- 172.21.15.59:0/1707157271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c009e000 0x7f30c0122760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c5212700 1 -- 172.21.15.59:0/1707157271 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc00ba70 con 0x7f30c009d6f0 2023-09-30T22:31:19.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.782+0000 7f30c5a13700 1 --2- 172.21.15.59:0/1707157271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c009e410 0x7f30c0122ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:19.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.783+0000 7f30c5212700 1 --2- 172.21.15.59:0/1707157271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c009d6f0 0x7f30c0122220 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f30b4016000 tx=0x7f30b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:19.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.783+0000 7f30b1ffb700 1 -- 172.21.15.59:0/1707157271 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4004450 con 0x7f30c009d6f0 2023-09-30T22:31:19.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.783+0000 7f30b1ffb700 1 -- 172.21.15.59:0/1707157271 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b401f070 con 0x7f30c009d6f0 2023-09-30T22:31:19.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.783+0000 7f30c7476700 1 -- 172.21.15.59:0/1707157271 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b40094a0 con 0x7f30c009d6f0 2023-09-30T22:31:19.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.783+0000 7f30b1ffb700 1 -- 172.21.15.59:0/1707157271 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b40038e0 con 0x7f30c009d6f0 2023-09-30T22:31:19.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.783+0000 7f30c7476700 1 -- 172.21.15.59:0/1707157271 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c0125a60 con 0x7f30c009d6f0 2023-09-30T22:31:19.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.784+0000 7f30b1ffb700 1 -- 172.21.15.59:0/1707157271 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30b4003a40 con 0x7f30c009d6f0 2023-09-30T22:31:19.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.784+0000 7f30b1ffb700 1 -- 172.21.15.59:0/1707157271 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f30b4021070 con 0x7f30c009d6f0 2023-09-30T22:31:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.784+0000 7f30c7476700 1 -- 172.21.15.59:0/1707157271 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c0074ea0 con 0x7f30c009d6f0 2023-09-30T22:31:19.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.789+0000 7f30b1ffb700 1 -- 172.21.15.59:0/1707157271 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30b402b080 con 0x7f30c009d6f0 2023-09-30T22:31:19.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.993+0000 7f30c7476700 1 -- 172.21.15.59:0/1707157271 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f30c0124620 con 0x7f30c009d6f0 2023-09-30T22:31:19.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.994+0000 7f30b1ffb700 1 -- 172.21.15.59:0/1707157271 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30b4015020 con 0x7f30c009d6f0 2023-09-30T22:31:19.995 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:19.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.996+0000 7f30c7476700 1 -- 172.21.15.59:0/1707157271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c009d6f0 msgr2=0x7f30c0122220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.996+0000 7f30c7476700 1 --2- 172.21.15.59:0/1707157271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c009d6f0 0x7f30c0122220 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f30b4016000 tx=0x7f30b4004750 comp rx=0 tx=0).stop 2023-09-30T22:31:19.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.996+0000 7f30c7476700 1 -- 172.21.15.59:0/1707157271 shutdown_connections 2023-09-30T22:31:19.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.996+0000 7f30c7476700 1 --2- 172.21.15.59:0/1707157271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c009e410 0x7f30c0122ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.996+0000 7f30c7476700 1 --2- 172.21.15.59:0/1707157271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c009d6f0 0x7f30c0122220 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.996+0000 7f30c7476700 1 --2- 172.21.15.59:0/1707157271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c009e000 0x7f30c0122760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.996+0000 7f30c7476700 1 -- 172.21.15.59:0/1707157271 >> 172.21.15.59:0/1707157271 conn(0x7f30c0066f50 msgr2=0x7f30c0130a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:19.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.996+0000 7f30c7476700 1 -- 172.21.15.59:0/1707157271 shutdown_connections 2023-09-30T22:31:19.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:19.996+0000 7f30c7476700 1 -- 172.21.15.59:0/1707157271 wait complete. 2023-09-30T22:31:20.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:20.520 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:20.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:20.600 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:20.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.669+0000 7f014b133700 1 Processor -- start 2023-09-30T22:31:20.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.669+0000 7f014b133700 1 -- start start 2023-09-30T22:31:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.670+0000 7f014b133700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f014409d6f0 0x7f014409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.670+0000 7f014b133700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f014409e000 0x7f01441339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.670+0000 7f014b133700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014409b120 con 0x7f014409e410 2023-09-30T22:31:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.670+0000 7f014b133700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014406b460 con 0x7f014409d6f0 2023-09-30T22:31:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.670+0000 7f014b133700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f014409a7e0 con 0x7f014409e000 2023-09-30T22:31:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.670+0000 7f0148ecf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f014409d6f0 0x7f014409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.670+0000 7f0143fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f014409e000 0x7f01441339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.670+0000 7f0148ecf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f014409d6f0 0x7f014409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54016/0 (socket says 172.21.15.59:54016) 2023-09-30T22:31:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.670+0000 7f0148ecf700 1 -- 172.21.15.59:0/1093930929 learned_addr learned my addr 172.21.15.59:0/1093930929 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.671+0000 7f0148ecf700 1 -- 172.21.15.59:0/1093930929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f014409e000 msgr2=0x7f01441339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.671+0000 7f0148ecf700 1 --2- 172.21.15.59:0/1093930929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f014409e000 0x7f01441339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.671+0000 7f0148ecf700 1 -- 172.21.15.59:0/1093930929 >> v1:172.21.15.59:6789/0 conn(0x7f014409e410 legacy=0x7f0144133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.671+0000 7f0148ecf700 1 -- 172.21.15.59:0/1093930929 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014409a500 con 0x7f014409d6f0 2023-09-30T22:31:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.671+0000 7f0148ecf700 1 --2- 172.21.15.59:0/1093930929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f014409d6f0 0x7f014409dac0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f01380098f0 tx=0x7f0138009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1b81d2896601a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.671+0000 7f01437fe700 1 -- 172.21.15.59:0/1093930929 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138011830 con 0x7f014409d6f0 2023-09-30T22:31:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.671+0000 7f01437fe700 1 -- 172.21.15.59:0/1093930929 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0138011990 con 0x7f014409d6f0 2023-09-30T22:31:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.671+0000 7f01437fe700 1 -- 172.21.15.59:0/1093930929 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138011d20 con 0x7f014409d6f0 2023-09-30T22:31:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.672+0000 7f014b133700 1 -- 172.21.15.59:0/1093930929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f014409d6f0 msgr2=0x7f014409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.672+0000 7f014b133700 1 --2- 172.21.15.59:0/1093930929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f014409d6f0 0x7f014409dac0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f01380098f0 tx=0x7f0138009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.672+0000 7f014b133700 1 -- 172.21.15.59:0/1093930929 shutdown_connections 2023-09-30T22:31:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.672+0000 7f014b133700 1 --2- 172.21.15.59:0/1093930929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f014409d6f0 0x7f014409dac0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.672+0000 7f014b133700 1 --2- 172.21.15.59:0/1093930929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f014409e000 0x7f01441339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.672+0000 7f014b133700 1 -- 172.21.15.59:0/1093930929 >> 172.21.15.59:0/1093930929 conn(0x7f0144066f50 msgr2=0x7f014409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:20.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.672+0000 7f014b133700 1 -- 172.21.15.59:0/1093930929 shutdown_connections 2023-09-30T22:31:20.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.672+0000 7f014b133700 1 -- 172.21.15.59:0/1093930929 wait complete. 2023-09-30T22:31:20.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.673+0000 7f014b133700 1 Processor -- start 2023-09-30T22:31:20.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.673+0000 7f014b133700 1 -- start start 2023-09-30T22:31:20.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.674+0000 7f014b133700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f014409d6f0 0x7f01441a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.674+0000 7f014b133700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f014409e000 0x7f01441a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.674+0000 7f014b133700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f014409e410 0x7f01441a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.674+0000 7f014b133700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01441a7340 con 0x7f014409e410 2023-09-30T22:31:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.674+0000 7f014b133700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01441a7ac0 con 0x7f014409d6f0 2023-09-30T22:31:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.674+0000 7f014b133700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01441a80e0 con 0x7f014409e000 2023-09-30T22:31:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.675+0000 7f0148ecf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f014409d6f0 0x7f01441a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.675+0000 7f0143fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f014409e000 0x7f01441a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.675+0000 7f0148ecf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f014409d6f0 0x7f01441a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59266/0 (socket says 172.21.15.59:59266) 2023-09-30T22:31:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.675+0000 7f0143fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f014409e000 0x7f01441a63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41776/0 (socket says 172.21.15.59:41776) 2023-09-30T22:31:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.675+0000 7f0148ecf700 1 -- 172.21.15.59:0/3242923217 learned_addr learned my addr 172.21.15.59:0/3242923217 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.675+0000 7f01496d0700 1 --2- 172.21.15.59:0/3242923217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f014409e410 0x7f01441a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.675+0000 7f0148ecf700 1 -- 172.21.15.59:0/3242923217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f014409e000 msgr2=0x7f01441a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.675+0000 7f0148ecf700 1 --2- 172.21.15.59:0/3242923217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f014409e000 0x7f01441a63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.675+0000 7f0148ecf700 1 -- 172.21.15.59:0/3242923217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f014409e410 msgr2=0x7f01441a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.675+0000 7f0148ecf700 1 --2- 172.21.15.59:0/3242923217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f014409e410 0x7f01441a6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.675+0000 7f0148ecf700 1 -- 172.21.15.59:0/3242923217 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0138009550 con 0x7f014409d6f0 2023-09-30T22:31:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.675+0000 7f0143fff700 1 --2- 172.21.15.59:0/3242923217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f014409e000 0x7f01441a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.675+0000 7f0148ecf700 1 --2- 172.21.15.59:0/3242923217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f014409d6f0 0x7f01441a5eb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0138014040 tx=0x7f0138004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.675+0000 7f01417fa700 1 -- 172.21.15.59:0/3242923217 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138004510 con 0x7f014409d6f0 2023-09-30T22:31:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.675+0000 7f01417fa700 1 -- 172.21.15.59:0/3242923217 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013801e070 con 0x7f014409d6f0 2023-09-30T22:31:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.676+0000 7f014b133700 1 -- 172.21.15.59:0/3242923217 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01441a96f0 con 0x7f014409d6f0 2023-09-30T22:31:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.676+0000 7f01417fa700 1 -- 172.21.15.59:0/3242923217 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01380038c0 con 0x7f014409d6f0 2023-09-30T22:31:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.676+0000 7f014b133700 1 -- 172.21.15.59:0/3242923217 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014409c710 con 0x7f014409d6f0 2023-09-30T22:31:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.676+0000 7f01417fa700 1 -- 172.21.15.59:0/3242923217 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0138003a20 con 0x7f014409d6f0 2023-09-30T22:31:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.676+0000 7f01417fa700 1 -- 172.21.15.59:0/3242923217 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f01380405f0 con 0x7f014409d6f0 2023-09-30T22:31:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.677+0000 7f014b133700 1 -- 172.21.15.59:0/3242923217 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0144074ea0 con 0x7f014409d6f0 2023-09-30T22:31:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.682+0000 7f01417fa700 1 -- 172.21.15.59:0/3242923217 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0138003cd0 con 0x7f014409d6f0 2023-09-30T22:31:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.707+0000 7f124ebdd700 1 Processor -- start 2023-09-30T22:31:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.707+0000 7f124ebdd700 1 -- start start 2023-09-30T22:31:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.707+0000 7f124ebdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12480a09c0 0x7f12480a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.707+0000 7f124ebdd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12480a12d0 0x7f1248134030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.707+0000 7f124ebdd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124809ea10 con 0x7f124809d5c0 2023-09-30T22:31:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.708+0000 7f124ebdd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124809e210 con 0x7f12480a09c0 2023-09-30T22:31:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.708+0000 7f124ebdd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12480a26f0 con 0x7f12480a12d0 2023-09-30T22:31:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.708+0000 7f1247fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f124809d5c0 0x7f1248133920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56248/0 (socket says 172.21.15.59:56248) 2023-09-30T22:31:20.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.708+0000 7f1247fff700 1 -- 172.21.15.59:0/1973337537 learned_addr learned my addr 172.21.15.59:0/1973337537 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:20.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.708+0000 7f124c979700 1 --2- 172.21.15.59:0/1973337537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12480a09c0 0x7f12480a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.708+0000 7f124d17a700 1 --2- 172.21.15.59:0/1973337537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12480a12d0 0x7f1248134030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.708+0000 7f124c979700 1 -- 172.21.15.59:0/1973337537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12480a12d0 msgr2=0x7f1248134030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:20.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.708+0000 7f124c979700 1 --2- 172.21.15.59:0/1973337537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12480a12d0 0x7f1248134030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.708+0000 7f124c979700 1 -- 172.21.15.59:0/1973337537 >> v1:172.21.15.59:6789/0 conn(0x7f124809d5c0 legacy=0x7f1248133920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.708+0000 7f124c979700 1 -- 172.21.15.59:0/1973337537 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124809db70 con 0x7f12480a09c0 2023-09-30T22:31:20.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.708+0000 7f124c979700 1 --2- 172.21.15.59:0/1973337537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12480a09c0 0x7f12480a0d90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f123c009870 tx=0x7f123c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c2805f6fea0731d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:20.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.708+0000 7f12477fe700 1 -- 172.21.15.59:0/1973337537 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c004230 con 0x7f12480a09c0 2023-09-30T22:31:20.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.709+0000 7f12477fe700 1 -- 172.21.15.59:0/1973337537 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c004390 con 0x7f12480a09c0 2023-09-30T22:31:20.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.709+0000 7f12477fe700 1 -- 172.21.15.59:0/1973337537 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c0036a0 con 0x7f12480a09c0 2023-09-30T22:31:20.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.709+0000 7f124ebdd700 1 -- 172.21.15.59:0/1973337537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12480a09c0 msgr2=0x7f12480a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.709+0000 7f124ebdd700 1 --2- 172.21.15.59:0/1973337537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12480a09c0 0x7f12480a0d90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f123c009870 tx=0x7f123c009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:20.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.709+0000 7f124ebdd700 1 -- 172.21.15.59:0/1973337537 shutdown_connections 2023-09-30T22:31:20.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.709+0000 7f124ebdd700 1 --2- 172.21.15.59:0/1973337537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12480a12d0 0x7f1248134030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.709+0000 7f124ebdd700 1 --2- 172.21.15.59:0/1973337537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12480a09c0 0x7f12480a0d90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.709+0000 7f124ebdd700 1 -- 172.21.15.59:0/1973337537 >> 172.21.15.59:0/1973337537 conn(0x7f12480a2fe0 msgr2=0x7f12480a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:20.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.709+0000 7f124ebdd700 1 -- 172.21.15.59:0/1973337537 shutdown_connections 2023-09-30T22:31:20.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.709+0000 7f124ebdd700 1 -- 172.21.15.59:0/1973337537 wait complete. 2023-09-30T22:31:20.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.711+0000 7f124ebdd700 1 Processor -- start 2023-09-30T22:31:20.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.711+0000 7f124ebdd700 1 -- start start 2023-09-30T22:31:20.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124ebdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124809d5c0 0x7f1248121360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124ebdd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12480a09c0 0x7f12481218a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124ebdd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12480a12d0 0x7f1248121de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124ebdd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1248124ac0 con 0x7f12480a09c0 2023-09-30T22:31:20.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124ebdd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1248124ca0 con 0x7f124809d5c0 2023-09-30T22:31:20.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124ebdd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1248134880 con 0x7f12480a12d0 2023-09-30T22:31:20.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124c979700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124809d5c0 0x7f1248121360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124c979700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124809d5c0 0x7f1248121360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59290/0 (socket says 172.21.15.59:59290) 2023-09-30T22:31:20.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124c979700 1 -- 172.21.15.59:0/4055276090 learned_addr learned my addr 172.21.15.59:0/4055276090 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:20.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f1247fff700 1 --2- 172.21.15.59:0/4055276090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12480a09c0 0x7f12481218a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124d17a700 1 --2- 172.21.15.59:0/4055276090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12480a12d0 0x7f1248121de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124c979700 1 -- 172.21.15.59:0/4055276090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12480a12d0 msgr2=0x7f1248121de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124c979700 1 --2- 172.21.15.59:0/4055276090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12480a12d0 0x7f1248121de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124c979700 1 -- 172.21.15.59:0/4055276090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12480a09c0 msgr2=0x7f12481218a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124c979700 1 --2- 172.21.15.59:0/4055276090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12480a09c0 0x7f12481218a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124c979700 1 -- 172.21.15.59:0/4055276090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c0094a0 con 0x7f124809d5c0 2023-09-30T22:31:20.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.712+0000 7f124c979700 1 --2- 172.21.15.59:0/4055276090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124809d5c0 0x7f1248121360 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f124809e350 tx=0x7f123c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:20.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.713+0000 7f12457fa700 1 -- 172.21.15.59:0/4055276090 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c003c50 con 0x7f124809d5c0 2023-09-30T22:31:20.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.713+0000 7f12457fa700 1 -- 172.21.15.59:0/4055276090 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c01f070 con 0x7f124809d5c0 2023-09-30T22:31:20.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.713+0000 7f124ebdd700 1 -- 172.21.15.59:0/4055276090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124809cec0 con 0x7f124809d5c0 2023-09-30T22:31:20.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.713+0000 7f12457fa700 1 -- 172.21.15.59:0/4055276090 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c011630 con 0x7f124809d5c0 2023-09-30T22:31:20.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.713+0000 7f124ebdd700 1 -- 172.21.15.59:0/4055276090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1248124700 con 0x7f124809d5c0 2023-09-30T22:31:20.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.714+0000 7f12457fa700 1 -- 172.21.15.59:0/4055276090 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f123c021030 con 0x7f124809d5c0 2023-09-30T22:31:20.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.714+0000 7f12457fa700 1 -- 172.21.15.59:0/4055276090 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f123c0407d0 con 0x7f124809d5c0 2023-09-30T22:31:20.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.714+0000 7f124ebdd700 1 -- 172.21.15.59:0/4055276090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1248134630 con 0x7f124809d5c0 2023-09-30T22:31:20.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.719+0000 7f12457fa700 1 -- 172.21.15.59:0/4055276090 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f123c0199b0 con 0x7f124809d5c0 2023-09-30T22:31:20.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.776+0000 7f4f79747700 1 Processor -- start 2023-09-30T22:31:20.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.776+0000 7f4f79747700 1 -- start start 2023-09-30T22:31:20.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.776+0000 7f4f79747700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f7409e1d0 0x7f4f74135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.776+0000 7f4f79747700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f74135e50 0x7f4f74138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.777+0000 7f4f79747700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f7409f130 con 0x7f4f7409d6f0 2023-09-30T22:31:20.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.777+0000 7f4f79747700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7409f520 con 0x7f4f74135e50 2023-09-30T22:31:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.777+0000 7f4f79747700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7409e930 con 0x7f4f7409e1d0 2023-09-30T22:31:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.777+0000 7f4f727fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f7409e1d0 0x7f4f74135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.777+0000 7f4f727fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f7409e1d0 0x7f4f74135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41790/0 (socket says 172.21.15.59:41790) 2023-09-30T22:31:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.777+0000 7f4f727fc700 1 -- 172.21.15.59:0/1304830836 learned_addr learned my addr 172.21.15.59:0/1304830836 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.777+0000 7f4f737fe700 1 --2- 172.21.15.59:0/1304830836 >> v2:172.21.15.59:3300/0 conn(0x7f4f74135e50 0x7f4f74138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.777+0000 7f4f727fc700 1 -- 172.21.15.59:0/1304830836 >> v2:172.21.15.59:3300/0 conn(0x7f4f74135e50 msgr2=0x7f4f74138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.777+0000 7f4f727fc700 1 --2- 172.21.15.59:0/1304830836 >> v2:172.21.15.59:3300/0 conn(0x7f4f74135e50 0x7f4f74138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.777+0000 7f4f727fc700 1 -- 172.21.15.59:0/1304830836 >> v1:172.21.15.59:6789/0 conn(0x7f4f7409d6f0 legacy=0x7f4f7409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.777+0000 7f4f727fc700 1 -- 172.21.15.59:0/1304830836 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7409b2d0 con 0x7f4f7409e1d0 2023-09-30T22:31:20.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.777+0000 7f4f727fc700 1 --2- 172.21.15.59:0/1304830836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f7409e1d0 0x7f4f74135910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009920 tx=0x7f4f68009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea45918cd19aba8d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:20.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.777+0000 7f4f71ffb700 1 -- 172.21.15.59:0/1304830836 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68011830 con 0x7f4f7409e1d0 2023-09-30T22:31:20.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.778+0000 7f4f71ffb700 1 -- 172.21.15.59:0/1304830836 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f68011990 con 0x7f4f7409e1d0 2023-09-30T22:31:20.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.778+0000 7f4f71ffb700 1 -- 172.21.15.59:0/1304830836 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68011d20 con 0x7f4f7409e1d0 2023-09-30T22:31:20.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.779+0000 7f4f79747700 1 -- 172.21.15.59:0/1304830836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f7409e1d0 msgr2=0x7f4f74135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.779+0000 7f4f79747700 1 --2- 172.21.15.59:0/1304830836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f7409e1d0 0x7f4f74135910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009920 tx=0x7f4f68009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:20.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.779+0000 7f4f79747700 1 -- 172.21.15.59:0/1304830836 shutdown_connections 2023-09-30T22:31:20.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.779+0000 7f4f79747700 1 --2- 172.21.15.59:0/1304830836 >> v2:172.21.15.59:3300/0 conn(0x7f4f74135e50 0x7f4f74138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.779+0000 7f4f79747700 1 --2- 172.21.15.59:0/1304830836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f7409e1d0 0x7f4f74135910 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.779+0000 7f4f79747700 1 -- 172.21.15.59:0/1304830836 >> 172.21.15.59:0/1304830836 conn(0x7f4f74066f50 msgr2=0x7f4f7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:20.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.779+0000 7f4f79747700 1 -- 172.21.15.59:0/1304830836 shutdown_connections 2023-09-30T22:31:20.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.779+0000 7f4f79747700 1 -- 172.21.15.59:0/1304830836 wait complete. 2023-09-30T22:31:20.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.781+0000 7f4f79747700 1 Processor -- start 2023-09-30T22:31:20.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.781+0000 7f4f79747700 1 -- start start 2023-09-30T22:31:20.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.781+0000 7f4f79747700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f7409d6f0 0x7f4f741c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.781+0000 7f4f79747700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f7409e1d0 0x7f4f741c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.781+0000 7f4f79747700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f74135e50 0x7f4f741c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.781+0000 7f4f79747700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7406e9b0 con 0x7f4f7409d6f0 2023-09-30T22:31:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.781+0000 7f4f79747700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7409c700 con 0x7f4f74135e50 2023-09-30T22:31:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.781+0000 7f4f79747700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7411d3b0 con 0x7f4f7409e1d0 2023-09-30T22:31:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.782+0000 7f4f727fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f7409e1d0 0x7f4f741c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.782+0000 7f4f727fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f7409e1d0 0x7f4f741c5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41796/0 (socket says 172.21.15.59:41796) 2023-09-30T22:31:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.782+0000 7f4f727fc700 1 -- 172.21.15.59:0/2102340536 learned_addr learned my addr 172.21.15.59:0/2102340536 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.782+0000 7f4f72ffd700 1 --2- 172.21.15.59:0/2102340536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f7409d6f0 0x7f4f741c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.782+0000 7f4f737fe700 1 --2- 172.21.15.59:0/2102340536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f74135e50 0x7f4f741c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.782+0000 7f4f727fc700 1 -- 172.21.15.59:0/2102340536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f74135e50 msgr2=0x7f4f741c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.782+0000 7f4f727fc700 1 --2- 172.21.15.59:0/2102340536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f74135e50 0x7f4f741c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.782+0000 7f4f727fc700 1 -- 172.21.15.59:0/2102340536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f7409d6f0 msgr2=0x7f4f741c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.782+0000 7f4f727fc700 1 --2- 172.21.15.59:0/2102340536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f7409d6f0 0x7f4f741c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.782+0000 7f4f727fc700 1 -- 172.21.15.59:0/2102340536 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f68009550 con 0x7f4f7409e1d0 2023-09-30T22:31:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.782+0000 7f4f727fc700 1 --2- 172.21.15.59:0/2102340536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f7409e1d0 0x7f4f741c5680 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4f680098f0 tx=0x7f4f68004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.783+0000 7f4f5b7fe700 1 -- 172.21.15.59:0/2102340536 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68004510 con 0x7f4f7409e1d0 2023-09-30T22:31:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.783+0000 7f4f5b7fe700 1 -- 172.21.15.59:0/2102340536 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f680036a0 con 0x7f4f7409e1d0 2023-09-30T22:31:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.783+0000 7f4f79747700 1 -- 172.21.15.59:0/2102340536 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7411ec10 con 0x7f4f7409e1d0 2023-09-30T22:31:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.783+0000 7f4f5b7fe700 1 -- 172.21.15.59:0/2102340536 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68003a50 con 0x7f4f7409e1d0 2023-09-30T22:31:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.783+0000 7f4f79747700 1 -- 172.21.15.59:0/2102340536 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7411df10 con 0x7f4f7409e1d0 2023-09-30T22:31:20.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.784+0000 7f4f79747700 1 -- 172.21.15.59:0/2102340536 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7411ee00 con 0x7f4f7409e1d0 2023-09-30T22:31:20.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.784+0000 7f4f5b7fe700 1 -- 172.21.15.59:0/2102340536 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f68003bb0 con 0x7f4f7409e1d0 2023-09-30T22:31:20.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.784+0000 7f4f5b7fe700 1 -- 172.21.15.59:0/2102340536 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4f68042470 con 0x7f4f7409e1d0 2023-09-30T22:31:20.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.789+0000 7f4f5b7fe700 1 -- 172.21.15.59:0/2102340536 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f6801b5c0 con 0x7f4f7409e1d0 2023-09-30T22:31:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.930+0000 7f014b133700 1 -- 172.21.15.59:0/3242923217 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f014406c360 con 0x7f014409d6f0 2023-09-30T22:31:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.931+0000 7f01417fa700 1 -- 172.21.15.59:0/3242923217 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0138015020 con 0x7f014409d6f0 2023-09-30T22:31:20.932 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.934+0000 7f014b133700 1 -- 172.21.15.59:0/3242923217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f014409d6f0 msgr2=0x7f01441a5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.934+0000 7f014b133700 1 --2- 172.21.15.59:0/3242923217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f014409d6f0 0x7f01441a5eb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0138014040 tx=0x7f0138004750 comp rx=0 tx=0).stop 2023-09-30T22:31:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.934+0000 7f014b133700 1 -- 172.21.15.59:0/3242923217 shutdown_connections 2023-09-30T22:31:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.934+0000 7f014b133700 1 --2- 172.21.15.59:0/3242923217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f014409e410 0x7f01441a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.934+0000 7f014b133700 1 --2- 172.21.15.59:0/3242923217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f014409d6f0 0x7f01441a5eb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.934+0000 7f014b133700 1 --2- 172.21.15.59:0/3242923217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f014409e000 0x7f01441a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.934+0000 7f014b133700 1 -- 172.21.15.59:0/3242923217 >> 172.21.15.59:0/3242923217 conn(0x7f0144066f50 msgr2=0x7f01441badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.934+0000 7f014b133700 1 -- 172.21.15.59:0/3242923217 shutdown_connections 2023-09-30T22:31:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.934+0000 7f014b133700 1 -- 172.21.15.59:0/3242923217 wait complete. 2023-09-30T22:31:20.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.947+0000 7f124ebdd700 1 -- 172.21.15.59:0/4055276090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f12481248f0 con 0x7f124809d5c0 2023-09-30T22:31:20.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.947+0000 7f12457fa700 1 -- 172.21.15.59:0/4055276090 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f123c035090 con 0x7f124809d5c0 2023-09-30T22:31:20.948 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:20.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:20.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.950+0000 7f124ebdd700 1 -- 172.21.15.59:0/4055276090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124809d5c0 msgr2=0x7f1248121360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.950+0000 7f124ebdd700 1 --2- 172.21.15.59:0/4055276090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124809d5c0 0x7f1248121360 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f124809e350 tx=0x7f123c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:20.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.950+0000 7f124ebdd700 1 -- 172.21.15.59:0/4055276090 shutdown_connections 2023-09-30T22:31:20.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.950+0000 7f124ebdd700 1 --2- 172.21.15.59:0/4055276090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12480a12d0 0x7f1248121de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.950+0000 7f124ebdd700 1 --2- 172.21.15.59:0/4055276090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124809d5c0 0x7f1248121360 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.950+0000 7f124ebdd700 1 --2- 172.21.15.59:0/4055276090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12480a09c0 0x7f12481218a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.950+0000 7f124ebdd700 1 -- 172.21.15.59:0/4055276090 >> 172.21.15.59:0/4055276090 conn(0x7f12480a2fe0 msgr2=0x7f12481bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:20.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.950+0000 7f124ebdd700 1 -- 172.21.15.59:0/4055276090 shutdown_connections 2023-09-30T22:31:20.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:20.950+0000 7f124ebdd700 1 -- 172.21.15.59:0/4055276090 wait complete. 2023-09-30T22:31:20.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:21.011 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:21.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.015+0000 7f4f79747700 1 -- 172.21.15.59:0/2102340536 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4f74074ea0 con 0x7f4f7409e1d0 2023-09-30T22:31:21.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.015+0000 7f4f5b7fe700 1 -- 172.21.15.59:0/2102340536 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f68029070 con 0x7f4f7409e1d0 2023-09-30T22:31:21.017 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:21.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.018+0000 7f4f79747700 1 -- 172.21.15.59:0/2102340536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f7409e1d0 msgr2=0x7f4f741c5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.018+0000 7f4f79747700 1 --2- 172.21.15.59:0/2102340536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f7409e1d0 0x7f4f741c5680 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4f680098f0 tx=0x7f4f68004750 comp rx=0 tx=0).stop 2023-09-30T22:31:21.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.018+0000 7f4f79747700 1 -- 172.21.15.59:0/2102340536 shutdown_connections 2023-09-30T22:31:21.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.018+0000 7f4f79747700 1 --2- 172.21.15.59:0/2102340536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f74135e50 0x7f4f741c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.018+0000 7f4f79747700 1 --2- 172.21.15.59:0/2102340536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f7409d6f0 0x7f4f741c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.018+0000 7f4f79747700 1 --2- 172.21.15.59:0/2102340536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f7409e1d0 0x7f4f741c5680 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.018+0000 7f4f79747700 1 -- 172.21.15.59:0/2102340536 >> 172.21.15.59:0/2102340536 conn(0x7f4f74066f50 msgr2=0x7f4f740701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:21.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.018+0000 7f4f79747700 1 -- 172.21.15.59:0/2102340536 shutdown_connections 2023-09-30T22:31:21.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.018+0000 7f4f79747700 1 -- 172.21.15.59:0/2102340536 wait complete. 2023-09-30T22:31:21.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:21.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.149+0000 7f0cdb5c3700 1 Processor -- start 2023-09-30T22:31:21.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.149+0000 7f0cdb5c3700 1 -- start start 2023-09-30T22:31:21.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.149+0000 7f0cdb5c3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cd4133a80 0x7f0cd4133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.149+0000 7f0cdb5c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd4130a70 0x7f0cd413b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.149+0000 7f0cdb5c3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd406bc00 con 0x7f0cd412ff20 2023-09-30T22:31:21.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.149+0000 7f0cdb5c3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd406c570 con 0x7f0cd4133a80 2023-09-30T22:31:21.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.149+0000 7f0cdb5c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd40a0040 con 0x7f0cd4130a70 2023-09-30T22:31:21.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.150+0000 7f0cd935f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cd4133a80 0x7f0cd4133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.150+0000 7f0cd9b60700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd4130a70 0x7f0cd413b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.150+0000 7f0cd935f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cd4133a80 0x7f0cd4133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54072/0 (socket says 172.21.15.59:54072) 2023-09-30T22:31:21.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.150+0000 7f0cd9b60700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd4130a70 0x7f0cd413b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41810/0 (socket says 172.21.15.59:41810) 2023-09-30T22:31:21.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.150+0000 7f0cd935f700 1 -- 172.21.15.59:0/2727048604 learned_addr learned my addr 172.21.15.59:0/2727048604 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:21.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.150+0000 7f0cd8b5e700 1 --1- 172.21.15.59:0/2727048604 >> v1:172.21.15.59:6789/0 conn(0x7f0cd412ff20 0x7f0cd4130360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56266/0 (socket says 172.21.15.59:56266) 2023-09-30T22:31:21.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.150+0000 7f0cd9b60700 1 -- 172.21.15.59:0/2727048604 >> v2:172.21.15.59:3300/0 conn(0x7f0cd4133a80 msgr2=0x7f0cd4133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:21.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.150+0000 7f0cd9b60700 1 --2- 172.21.15.59:0/2727048604 >> v2:172.21.15.59:3300/0 conn(0x7f0cd4133a80 0x7f0cd4133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.150+0000 7f0cd9b60700 1 -- 172.21.15.59:0/2727048604 >> v1:172.21.15.59:6789/0 conn(0x7f0cd412ff20 legacy=0x7f0cd4130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.150+0000 7f0cd9b60700 1 -- 172.21.15.59:0/2727048604 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd4133860 con 0x7f0cd4130a70 2023-09-30T22:31:21.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.150+0000 7f0cd935f700 1 --2- 172.21.15.59:0/2727048604 >> v2:172.21.15.59:3300/0 conn(0x7f0cd4133a80 0x7f0cd4133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:21.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.150+0000 7f0cd9b60700 1 --2- 172.21.15.59:0/2727048604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd4130a70 0x7f0cd413b850 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009d90 tx=0x7f0ccc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6c412e8aa5d7b04 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:21.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.150+0000 7f0ccbfff700 1 -- 172.21.15.59:0/2727048604 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc00e070 con 0x7f0cd4130a70 2023-09-30T22:31:21.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.150+0000 7f0ccbfff700 1 -- 172.21.15.59:0/2727048604 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc00bb20 con 0x7f0cd4130a70 2023-09-30T22:31:21.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.150+0000 7f0ccbfff700 1 -- 172.21.15.59:0/2727048604 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc012430 con 0x7f0cd4130a70 2023-09-30T22:31:21.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.151+0000 7f0cdb5c3700 1 -- 172.21.15.59:0/2727048604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd4130a70 msgr2=0x7f0cd413b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.151+0000 7f0cdb5c3700 1 --2- 172.21.15.59:0/2727048604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd4130a70 0x7f0cd413b850 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009d90 tx=0x7f0ccc00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:21.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.151+0000 7f0cdb5c3700 1 -- 172.21.15.59:0/2727048604 shutdown_connections 2023-09-30T22:31:21.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.151+0000 7f0cdb5c3700 1 --2- 172.21.15.59:0/2727048604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd4130a70 0x7f0cd413b850 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.151+0000 7f0cdb5c3700 1 --2- 172.21.15.59:0/2727048604 >> v2:172.21.15.59:3300/0 conn(0x7f0cd4133a80 0x7f0cd4133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.151+0000 7f0cdb5c3700 1 -- 172.21.15.59:0/2727048604 >> 172.21.15.59:0/2727048604 conn(0x7f0cd40a4210 msgr2=0x7f0cd40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:21.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.151+0000 7f0cdb5c3700 1 -- 172.21.15.59:0/2727048604 shutdown_connections 2023-09-30T22:31:21.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.151+0000 7f0cdb5c3700 1 -- 172.21.15.59:0/2727048604 wait complete. 2023-09-30T22:31:21.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.152+0000 7f0cdb5c3700 1 Processor -- start 2023-09-30T22:31:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.152+0000 7f0cdb5c3700 1 -- start start 2023-09-30T22:31:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.152+0000 7f0cdb5c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd412ff20 0x7f0cd409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.152+0000 7f0cdb5c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd4130a70 0x7f0cd409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.152+0000 7f0cdb5c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd4133a80 0x7f0cd409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.152+0000 7f0cdb5c3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd412d690 con 0x7f0cd4130a70 2023-09-30T22:31:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.152+0000 7f0cdb5c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd412d2d0 con 0x7f0cd412ff20 2023-09-30T22:31:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.152+0000 7f0cdb5c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd40a2030 con 0x7f0cd4133a80 2023-09-30T22:31:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cd935f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd412ff20 0x7f0cd409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cd8b5e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd4130a70 0x7f0cd409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cd8b5e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd4130a70 0x7f0cd409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54080/0 (socket says 172.21.15.59:54080) 2023-09-30T22:31:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cd935f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd412ff20 0x7f0cd409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59296/0 (socket says 172.21.15.59:59296) 2023-09-30T22:31:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cd9b60700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd4133a80 0x7f0cd409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cd8b5e700 1 -- 172.21.15.59:0/3258842624 learned_addr learned my addr 172.21.15.59:0/3258842624 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cd8b5e700 1 -- 172.21.15.59:0/3258842624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd4133a80 msgr2=0x7f0cd409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cd8b5e700 1 --2- 172.21.15.59:0/3258842624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd4133a80 0x7f0cd409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cd8b5e700 1 -- 172.21.15.59:0/3258842624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd412ff20 msgr2=0x7f0cd409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cd8b5e700 1 --2- 172.21.15.59:0/3258842624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd412ff20 0x7f0cd409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cd8b5e700 1 -- 172.21.15.59:0/3258842624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd0009550 con 0x7f0cd4130a70 2023-09-30T22:31:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cd9b60700 1 --2- 172.21.15.59:0/3258842624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd4133a80 0x7f0cd409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cd935f700 1 --2- 172.21.15.59:0/3258842624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd412ff20 0x7f0cd409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cd8b5e700 1 --2- 172.21.15.59:0/3258842624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd4130a70 0x7f0cd409c9c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400c550 tx=0x7f0cc400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cc9ffb700 1 -- 172.21.15.59:0/3258842624 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4005cb0 con 0x7f0cd4130a70 2023-09-30T22:31:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cc9ffb700 1 -- 172.21.15.59:0/3258842624 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc4005e10 con 0x7f0cd4130a70 2023-09-30T22:31:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cdb5c3700 1 -- 172.21.15.59:0/3258842624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ccc009a70 con 0x7f0cd4130a70 2023-09-30T22:31:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.153+0000 7f0cc9ffb700 1 -- 172.21.15.59:0/3258842624 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc40072d0 con 0x7f0cd4130a70 2023-09-30T22:31:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.154+0000 7f0cdb5c3700 1 -- 172.21.15.59:0/3258842624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd412dae0 con 0x7f0cd4130a70 2023-09-30T22:31:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.154+0000 7f0cc9ffb700 1 -- 172.21.15.59:0/3258842624 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cc4007430 con 0x7f0cd4130a70 2023-09-30T22:31:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.155+0000 7f0cc9ffb700 1 -- 172.21.15.59:0/3258842624 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0cc403ea70 con 0x7f0cd4130a70 2023-09-30T22:31:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.155+0000 7f0cdb5c3700 1 -- 172.21.15.59:0/3258842624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd4134310 con 0x7f0cd4130a70 2023-09-30T22:31:21.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.159+0000 7f0cc9ffb700 1 -- 172.21.15.59:0/3258842624 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cc4017080 con 0x7f0cd4130a70 2023-09-30T22:31:21.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.365+0000 7f0cdb5c3700 1 -- 172.21.15.59:0/3258842624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0cd4074ea0 con 0x7f0cd4130a70 2023-09-30T22:31:21.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.366+0000 7f0cc9ffb700 1 -- 172.21.15.59:0/3258842624 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cc401b3b0 con 0x7f0cd4130a70 2023-09-30T22:31:21.367 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.368+0000 7f0cdb5c3700 1 -- 172.21.15.59:0/3258842624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd4130a70 msgr2=0x7f0cd409c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.368+0000 7f0cdb5c3700 1 --2- 172.21.15.59:0/3258842624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd4130a70 0x7f0cd409c9c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400c550 tx=0x7f0cc400c860 comp rx=0 tx=0).stop 2023-09-30T22:31:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.368+0000 7f0cdb5c3700 1 -- 172.21.15.59:0/3258842624 shutdown_connections 2023-09-30T22:31:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.368+0000 7f0cdb5c3700 1 --2- 172.21.15.59:0/3258842624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd4133a80 0x7f0cd409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.368+0000 7f0cdb5c3700 1 --2- 172.21.15.59:0/3258842624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd412ff20 0x7f0cd409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.368+0000 7f0cdb5c3700 1 --2- 172.21.15.59:0/3258842624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd4130a70 0x7f0cd409c9c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.368+0000 7f0cdb5c3700 1 -- 172.21.15.59:0/3258842624 >> 172.21.15.59:0/3258842624 conn(0x7f0cd40a4210 msgr2=0x7f0cd409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.368+0000 7f0cdb5c3700 1 -- 172.21.15.59:0/3258842624 shutdown_connections 2023-09-30T22:31:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:21.368+0000 7f0cdb5c3700 1 -- 172.21.15.59:0/3258842624 wait complete. 2023-09-30T22:31:21.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:21.951 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:21.965 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:22.036 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.101+0000 7fae85896700 1 Processor -- start 2023-09-30T22:31:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.101+0000 7fae85896700 1 -- start start 2023-09-30T22:31:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.102+0000 7fae85896700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae8009d6f0 0x7fae8009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.102+0000 7fae85896700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae8009e000 0x7fae80130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.102+0000 7fae85896700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae8009e410 0x7fae80130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.102+0000 7fae85896700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8009f520 con 0x7fae8009d6f0 2023-09-30T22:31:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.102+0000 7fae85896700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8009f130 con 0x7fae8009e000 2023-09-30T22:31:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.102+0000 7fae85896700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae8009e930 con 0x7fae8009e410 2023-09-30T22:31:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.102+0000 7fae7effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae8009d6f0 0x7fae8009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.102+0000 7fae7effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae8009d6f0 0x7fae8009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54082/0 (socket says 172.21.15.59:54082) 2023-09-30T22:31:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.102+0000 7fae7effd700 1 -- 172.21.15.59:0/509081293 learned_addr learned my addr 172.21.15.59:0/509081293 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.102+0000 7fae7e7fc700 1 --2- 172.21.15.59:0/509081293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae8009e000 0x7fae80130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.102+0000 7fae7f7fe700 1 --2- 172.21.15.59:0/509081293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae8009e410 0x7fae80130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.102+0000 7fae7e7fc700 1 -- 172.21.15.59:0/509081293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae8009e410 msgr2=0x7fae80130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.102+0000 7fae7e7fc700 1 --2- 172.21.15.59:0/509081293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae8009e410 0x7fae80130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.102+0000 7fae7e7fc700 1 -- 172.21.15.59:0/509081293 >> v2:172.21.15.59:3300/0 conn(0x7fae8009d6f0 msgr2=0x7fae8009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.102+0000 7fae7e7fc700 1 --2- 172.21.15.59:0/509081293 >> v2:172.21.15.59:3300/0 conn(0x7fae8009d6f0 0x7fae8009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.103+0000 7fae7e7fc700 1 -- 172.21.15.59:0/509081293 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8009b2d0 con 0x7fae8009e000 2023-09-30T22:31:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.103+0000 7fae7effd700 1 --2- 172.21.15.59:0/509081293 >> v2:172.21.15.59:3300/0 conn(0x7fae8009d6f0 0x7fae8009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.103+0000 7fae7e7fc700 1 --2- 172.21.15.59:0/509081293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae8009e000 0x7fae80130660 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fae7400bae0 tx=0x7fae7400bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dad1a0a285f53d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.103+0000 7fae7dffb700 1 -- 172.21.15.59:0/509081293 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7400dc70 con 0x7fae8009e000 2023-09-30T22:31:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.103+0000 7fae7dffb700 1 -- 172.21.15.59:0/509081293 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7400ddd0 con 0x7fae8009e000 2023-09-30T22:31:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.103+0000 7fae7dffb700 1 -- 172.21.15.59:0/509081293 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae74010690 con 0x7fae8009e000 2023-09-30T22:31:22.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.104+0000 7fae85896700 1 -- 172.21.15.59:0/509081293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae8009e000 msgr2=0x7fae80130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.104+0000 7fae85896700 1 --2- 172.21.15.59:0/509081293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae8009e000 0x7fae80130660 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fae7400bae0 tx=0x7fae7400bdf0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.104+0000 7fae85896700 1 -- 172.21.15.59:0/509081293 shutdown_connections 2023-09-30T22:31:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.104+0000 7fae85896700 1 --2- 172.21.15.59:0/509081293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae8009e410 0x7fae80130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.104+0000 7fae85896700 1 --2- 172.21.15.59:0/509081293 >> v2:172.21.15.59:3300/0 conn(0x7fae8009d6f0 0x7fae8009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.104+0000 7fae85896700 1 --2- 172.21.15.59:0/509081293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae8009e000 0x7fae80130660 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.104+0000 7fae85896700 1 -- 172.21.15.59:0/509081293 >> 172.21.15.59:0/509081293 conn(0x7fae80066f50 msgr2=0x7fae8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.104+0000 7fae85896700 1 -- 172.21.15.59:0/509081293 shutdown_connections 2023-09-30T22:31:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.104+0000 7fae85896700 1 -- 172.21.15.59:0/509081293 wait complete. 2023-09-30T22:31:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.105+0000 7fae85896700 1 Processor -- start 2023-09-30T22:31:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.106+0000 7fae85896700 1 -- start start 2023-09-30T22:31:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.106+0000 7fae85896700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae8009d6f0 0x7fae8011e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.106+0000 7fae85896700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae8009e000 0x7fae8011e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.106+0000 7fae85896700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae8009e410 0x7fae8011ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.106+0000 7fae85896700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae80121480 con 0x7fae8009e410 2023-09-30T22:31:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.106+0000 7fae85896700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae801204c0 con 0x7fae8009d6f0 2023-09-30T22:31:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.106+0000 7fae85896700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae80121da0 con 0x7fae8009e000 2023-09-30T22:31:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.106+0000 7fae7e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae8009e000 0x7fae8011e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.106+0000 7fae7e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae8009e000 0x7fae8011e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41824/0 (socket says 172.21.15.59:41824) 2023-09-30T22:31:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.106+0000 7fae7e7fc700 1 -- 172.21.15.59:0/282376620 learned_addr learned my addr 172.21.15.59:0/282376620 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.106+0000 7fae7effd700 1 --2- 172.21.15.59:0/282376620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae8009d6f0 0x7fae8011e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.107+0000 7fae7f7fe700 1 --2- 172.21.15.59:0/282376620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae8009e410 0x7fae8011ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.107+0000 7fae7e7fc700 1 -- 172.21.15.59:0/282376620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae8009d6f0 msgr2=0x7fae8011e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.107+0000 7fae7e7fc700 1 --2- 172.21.15.59:0/282376620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae8009d6f0 0x7fae8011e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.107+0000 7fae7e7fc700 1 -- 172.21.15.59:0/282376620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae8009e410 msgr2=0x7fae8011ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.107+0000 7fae7e7fc700 1 --2- 172.21.15.59:0/282376620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae8009e410 0x7fae8011ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.107+0000 7fae7e7fc700 1 -- 172.21.15.59:0/282376620 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae70009b30 con 0x7fae8009e000 2023-09-30T22:31:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.107+0000 7fae7e7fc700 1 --2- 172.21.15.59:0/282376620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae8009e000 0x7fae8011e7c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fae7400d5d0 tx=0x7fae74004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.107+0000 7fae67fff700 1 -- 172.21.15.59:0/282376620 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7401f070 con 0x7fae8009e000 2023-09-30T22:31:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.107+0000 7fae67fff700 1 -- 172.21.15.59:0/282376620 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae740038b0 con 0x7fae8009e000 2023-09-30T22:31:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.107+0000 7fae67fff700 1 -- 172.21.15.59:0/282376620 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae74003c40 con 0x7fae8009e000 2023-09-30T22:31:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.107+0000 7fae85896700 1 -- 172.21.15.59:0/282376620 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7400b740 con 0x7fae8009e000 2023-09-30T22:31:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.107+0000 7fae85896700 1 -- 172.21.15.59:0/282376620 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8009c700 con 0x7fae8009e000 2023-09-30T22:31:22.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.108+0000 7fae67fff700 1 -- 172.21.15.59:0/282376620 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae74019400 con 0x7fae8009e000 2023-09-30T22:31:22.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.109+0000 7fae67fff700 1 -- 172.21.15.59:0/282376620 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fae740427b0 con 0x7fae8009e000 2023-09-30T22:31:22.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.109+0000 7fae85896700 1 -- 172.21.15.59:0/282376620 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae80074ea0 con 0x7fae8009e000 2023-09-30T22:31:22.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.118+0000 7fae67fff700 1 -- 172.21.15.59:0/282376620 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae74003da0 con 0x7fae8009e000 2023-09-30T22:31:22.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.144+0000 7fc930352700 1 Processor -- start 2023-09-30T22:31:22.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.144+0000 7fc930352700 1 -- start start 2023-09-30T22:31:22.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc930352700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9280a0a30 0x7fc9280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc930352700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc92809d630 0x7fc9280a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc930352700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc928133930 0x7fc928133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc930352700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9280a2a70 con 0x7fc9280a0a30 2023-09-30T22:31:22.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc930352700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9280a01d0 con 0x7fc928133930 2023-09-30T22:31:22.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc930352700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc92809e2b0 con 0x7fc92809d630 2023-09-30T22:31:22.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc92d8ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc92809d630 0x7fc9280a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc92e8ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc928133930 0x7fc928133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc92d8ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc92809d630 0x7fc9280a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41840/0 (socket says 172.21.15.59:41840) 2023-09-30T22:31:22.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc92e8ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc928133930 0x7fc928133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59324/0 (socket says 172.21.15.59:59324) 2023-09-30T22:31:22.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc92e8ef700 1 -- 172.21.15.59:0/2478286044 learned_addr learned my addr 172.21.15.59:0/2478286044 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:22.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc92e0ee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9280a0a30 0x7fc9280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc92e8ef700 1 -- 172.21.15.59:0/2478286044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc92809d630 msgr2=0x7fc9280a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:22.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc92e8ef700 1 --2- 172.21.15.59:0/2478286044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc92809d630 0x7fc9280a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc92e8ef700 1 -- 172.21.15.59:0/2478286044 >> v2:172.21.15.59:3300/0 conn(0x7fc9280a0a30 msgr2=0x7fc9280a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:22.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc92e8ef700 1 --2- 172.21.15.59:0/2478286044 >> v2:172.21.15.59:3300/0 conn(0x7fc9280a0a30 0x7fc9280a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc92e8ef700 1 -- 172.21.15.59:0/2478286044 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92809dc50 con 0x7fc928133930 2023-09-30T22:31:22.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc92d8ed700 1 --2- 172.21.15.59:0/2478286044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc92809d630 0x7fc9280a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:22.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.145+0000 7fc92e0ee700 1 --2- 172.21.15.59:0/2478286044 >> v2:172.21.15.59:3300/0 conn(0x7fc9280a0a30 0x7fc9280a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:22.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.146+0000 7fc92e8ef700 1 --2- 172.21.15.59:0/2478286044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc928133930 0x7fc928133db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc920009e50 tx=0x7fc92000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a61a1e17e0f570dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:22.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.146+0000 7fc92d0ec700 1 -- 172.21.15.59:0/2478286044 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92000e070 con 0x7fc928133930 2023-09-30T22:31:22.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.146+0000 7fc92d0ec700 1 -- 172.21.15.59:0/2478286044 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92000b910 con 0x7fc928133930 2023-09-30T22:31:22.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.146+0000 7fc92d0ec700 1 -- 172.21.15.59:0/2478286044 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92000bcc0 con 0x7fc928133930 2023-09-30T22:31:22.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.146+0000 7fc930352700 1 -- 172.21.15.59:0/2478286044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc928133930 msgr2=0x7fc928133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.146+0000 7fc930352700 1 --2- 172.21.15.59:0/2478286044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc928133930 0x7fc928133db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc920009e50 tx=0x7fc92000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:22.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.147+0000 7fc930352700 1 -- 172.21.15.59:0/2478286044 shutdown_connections 2023-09-30T22:31:22.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.147+0000 7fc930352700 1 --2- 172.21.15.59:0/2478286044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc928133930 0x7fc928133db0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.147+0000 7fc930352700 1 --2- 172.21.15.59:0/2478286044 >> v2:172.21.15.59:3300/0 conn(0x7fc9280a0a30 0x7fc9280a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.147+0000 7fc930352700 1 --2- 172.21.15.59:0/2478286044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc92809d630 0x7fc9280a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.147+0000 7fc930352700 1 -- 172.21.15.59:0/2478286044 >> 172.21.15.59:0/2478286044 conn(0x7fc9280a3050 msgr2=0x7fc9280a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:22.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.147+0000 7fc930352700 1 -- 172.21.15.59:0/2478286044 shutdown_connections 2023-09-30T22:31:22.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.147+0000 7fc930352700 1 -- 172.21.15.59:0/2478286044 wait complete. 2023-09-30T22:31:22.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.148+0000 7fc930352700 1 Processor -- start 2023-09-30T22:31:22.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.148+0000 7fc930352700 1 -- start start 2023-09-30T22:31:22.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.148+0000 7fc930352700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92809d630 0x7fc92811e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.148+0000 7fc930352700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9280a0a30 0x7fc92811ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.148+0000 7fc930352700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc928133930 0x7fc92811f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.148+0000 7fc930352700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9281204e0 con 0x7fc92809d630 2023-09-30T22:31:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.148+0000 7fc930352700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc928133320 con 0x7fc928133930 2023-09-30T22:31:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.148+0000 7fc930352700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc928120980 con 0x7fc9280a0a30 2023-09-30T22:31:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.148+0000 7fc92d8ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9280a0a30 0x7fc92811ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.148+0000 7fc92e0ee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92809d630 0x7fc92811e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.148+0000 7fc92d8ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9280a0a30 0x7fc92811ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41854/0 (socket says 172.21.15.59:41854) 2023-09-30T22:31:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.148+0000 7fc92d8ed700 1 -- 172.21.15.59:0/2699094143 learned_addr learned my addr 172.21.15.59:0/2699094143 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.148+0000 7fc92e8ef700 1 --2- 172.21.15.59:0/2699094143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc928133930 0x7fc92811f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.149+0000 7fc92e0ee700 1 -- 172.21.15.59:0/2699094143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9280a0a30 msgr2=0x7fc92811ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.149+0000 7fc92e0ee700 1 --2- 172.21.15.59:0/2699094143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9280a0a30 0x7fc92811ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.149+0000 7fc92e0ee700 1 -- 172.21.15.59:0/2699094143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc928133930 msgr2=0x7fc92811f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.149+0000 7fc92e0ee700 1 --2- 172.21.15.59:0/2699094143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc928133930 0x7fc92811f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.149+0000 7fc92e0ee700 1 -- 172.21.15.59:0/2699094143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9180094a0 con 0x7fc92809d630 2023-09-30T22:31:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.149+0000 7fc92d8ed700 1 --2- 172.21.15.59:0/2699094143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9280a0a30 0x7fc92811ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.149+0000 7fc92e0ee700 1 --2- 172.21.15.59:0/2699094143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92809d630 0x7fc92811e850 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc92400e9b0 tx=0x7fc92400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.149+0000 7fc91effd700 1 -- 172.21.15.59:0/2699094143 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92400c850 con 0x7fc92809d630 2023-09-30T22:31:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.149+0000 7fc91effd700 1 -- 172.21.15.59:0/2699094143 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92400c9b0 con 0x7fc92809d630 2023-09-30T22:31:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.149+0000 7fc930352700 1 -- 172.21.15.59:0/2699094143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9240094a0 con 0x7fc92809d630 2023-09-30T22:31:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.149+0000 7fc91effd700 1 -- 172.21.15.59:0/2699094143 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92400cd60 con 0x7fc92809d630 2023-09-30T22:31:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.149+0000 7fc930352700 1 -- 172.21.15.59:0/2699094143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc920009b30 con 0x7fc92809d630 2023-09-30T22:31:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.150+0000 7fc91effd700 1 -- 172.21.15.59:0/2699094143 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc924013470 con 0x7fc92809d630 2023-09-30T22:31:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.150+0000 7fc91effd700 1 -- 172.21.15.59:0/2699094143 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc92403fab0 con 0x7fc92809d630 2023-09-30T22:31:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.150+0000 7fc930352700 1 -- 172.21.15.59:0/2699094143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc928122120 con 0x7fc92809d630 2023-09-30T22:31:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.155+0000 7fc91effd700 1 -- 172.21.15.59:0/2699094143 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc92401b3b0 con 0x7fc92809d630 2023-09-30T22:31:22.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.180+0000 7fc66a842700 1 Processor -- start 2023-09-30T22:31:22.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.180+0000 7fc66a842700 1 -- start start 2023-09-30T22:31:22.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.181+0000 7fc66a842700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc66409e930 0x7fc66409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.181+0000 7fc66a842700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc66409f240 0x7fc6641317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.181+0000 7fc66a842700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc664070940 con 0x7fc66409f650 2023-09-30T22:31:22.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.181+0000 7fc66a842700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66406fd60 con 0x7fc66409e930 2023-09-30T22:31:22.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.181+0000 7fc66a842700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc66406fa80 con 0x7fc66409f240 2023-09-30T22:31:22.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.181+0000 7fc663fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc66409e930 0x7fc66409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.181+0000 7fc6637fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc66409f240 0x7fc6641317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.181+0000 7fc663fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc66409e930 0x7fc66409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54124/0 (socket says 172.21.15.59:54124) 2023-09-30T22:31:22.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.181+0000 7fc663fff700 1 -- 172.21.15.59:0/2407446750 learned_addr learned my addr 172.21.15.59:0/2407446750 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:22.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.181+0000 7fc668ddf700 1 --1- 172.21.15.59:0/2407446750 >> v1:172.21.15.59:6789/0 conn(0x7fc66409f650 0x7fc664131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56268/0 (socket says 172.21.15.59:56268) 2023-09-30T22:31:22.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.182+0000 7fc663fff700 1 -- 172.21.15.59:0/2407446750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc66409f240 msgr2=0x7fc6641317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:22.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.182+0000 7fc663fff700 1 --2- 172.21.15.59:0/2407446750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc66409f240 0x7fc6641317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.182+0000 7fc663fff700 1 -- 172.21.15.59:0/2407446750 >> v1:172.21.15.59:6789/0 conn(0x7fc66409f650 legacy=0x7fc664131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.182+0000 7fc662ffd700 1 -- 172.21.15.59:0/2407446750 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029300047 0 0) 0x7fc664070940 con 0x7fc66409f650 2023-09-30T22:31:22.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.182+0000 7fc663fff700 1 -- 172.21.15.59:0/2407446750 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66409fb60 con 0x7fc66409e930 2023-09-30T22:31:22.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.182+0000 7fc663fff700 1 --2- 172.21.15.59:0/2407446750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66409e930 0x7fc66409ed00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc6540098f0 tx=0x7fc654009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dfef1ae817a2a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:22.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.182+0000 7fc662ffd700 1 -- 172.21.15.59:0/2407446750 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654011830 con 0x7fc66409e930 2023-09-30T22:31:22.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.182+0000 7fc662ffd700 1 -- 172.21.15.59:0/2407446750 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc654011990 con 0x7fc66409e930 2023-09-30T22:31:22.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.182+0000 7fc662ffd700 1 -- 172.21.15.59:0/2407446750 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654011d20 con 0x7fc66409e930 2023-09-30T22:31:22.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.183+0000 7fc66a842700 1 -- 172.21.15.59:0/2407446750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66409e930 msgr2=0x7fc66409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.183+0000 7fc66a842700 1 --2- 172.21.15.59:0/2407446750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66409e930 0x7fc66409ed00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc6540098f0 tx=0x7fc654009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:22.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.183+0000 7fc66a842700 1 -- 172.21.15.59:0/2407446750 shutdown_connections 2023-09-30T22:31:22.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.183+0000 7fc66a842700 1 --2- 172.21.15.59:0/2407446750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66409e930 0x7fc66409ed00 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.183+0000 7fc66a842700 1 --2- 172.21.15.59:0/2407446750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc66409f240 0x7fc6641317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.183+0000 7fc66a842700 1 -- 172.21.15.59:0/2407446750 >> 172.21.15.59:0/2407446750 conn(0x7fc6640a4210 msgr2=0x7fc6640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:22.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.183+0000 7fc66a842700 1 -- 172.21.15.59:0/2407446750 shutdown_connections 2023-09-30T22:31:22.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.183+0000 7fc66a842700 1 -- 172.21.15.59:0/2407446750 wait complete. 2023-09-30T22:31:22.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.185+0000 7fc66a842700 1 Processor -- start 2023-09-30T22:31:22.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.185+0000 7fc66a842700 1 -- start start 2023-09-30T22:31:22.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.185+0000 7fc66a842700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66409f240 0x7fc66406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc66a842700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc66409f650 0x7fc66406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc66a842700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66406c330 0x7fc6641ce860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc66a842700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6641b7220 con 0x7fc66409f240 2023-09-30T22:31:22.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc66a842700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6641a93d0 con 0x7fc66406c330 2023-09-30T22:31:22.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc66a842700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6641a88f0 con 0x7fc66409f650 2023-09-30T22:31:22.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc663fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66409f240 0x7fc66406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc663fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66409f240 0x7fc66406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54132/0 (socket says 172.21.15.59:54132) 2023-09-30T22:31:22.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc663fff700 1 -- 172.21.15.59:0/3580936887 learned_addr learned my addr 172.21.15.59:0/3580936887 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:22.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc6637fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc66409f650 0x7fc66406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc668ddf700 1 --2- 172.21.15.59:0/3580936887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66406c330 0x7fc6641ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc6637fe700 1 -- 172.21.15.59:0/3580936887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66406c330 msgr2=0x7fc6641ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc6637fe700 1 --2- 172.21.15.59:0/3580936887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66406c330 0x7fc6641ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc6637fe700 1 -- 172.21.15.59:0/3580936887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66409f240 msgr2=0x7fc66406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc6637fe700 1 --2- 172.21.15.59:0/3580936887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66409f240 0x7fc66406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc6637fe700 1 -- 172.21.15.59:0/3580936887 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc654009550 con 0x7fc66409f650 2023-09-30T22:31:22.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc663fff700 1 --2- 172.21.15.59:0/3580936887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66409f240 0x7fc66406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:22.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.186+0000 7fc6637fe700 1 --2- 172.21.15.59:0/3580936887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc66409f650 0x7fc66406bdf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc65800e900 tx=0x7fc65800ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:22.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.187+0000 7fc660ff9700 1 -- 172.21.15.59:0/3580936887 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc658013680 con 0x7fc66409f650 2023-09-30T22:31:22.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.187+0000 7fc660ff9700 1 -- 172.21.15.59:0/3580936887 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6580137e0 con 0x7fc66409f650 2023-09-30T22:31:22.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.187+0000 7fc66a842700 1 -- 172.21.15.59:0/3580936887 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6640a0190 con 0x7fc66409f650 2023-09-30T22:31:22.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.187+0000 7fc660ff9700 1 -- 172.21.15.59:0/3580936887 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc658013b50 con 0x7fc66409f650 2023-09-30T22:31:22.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.187+0000 7fc66a842700 1 -- 172.21.15.59:0/3580936887 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6641a9100 con 0x7fc66409f650 2023-09-30T22:31:22.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.188+0000 7fc660ff9700 1 -- 172.21.15.59:0/3580936887 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc658013cb0 con 0x7fc66409f650 2023-09-30T22:31:22.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.188+0000 7fc66a842700 1 -- 172.21.15.59:0/3580936887 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6641a0b30 con 0x7fc66409f650 2023-09-30T22:31:22.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.188+0000 7fc660ff9700 1 -- 172.21.15.59:0/3580936887 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc65803fa50 con 0x7fc66409f650 2023-09-30T22:31:22.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.193+0000 7fc660ff9700 1 -- 172.21.15.59:0/3580936887 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc65801abc0 con 0x7fc66409f650 2023-09-30T22:31:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.327+0000 7fae85896700 1 -- 172.21.15.59:0/282376620 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fae80072010 con 0x7fae8009e000 2023-09-30T22:31:22.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.328+0000 7fae67fff700 1 -- 172.21.15.59:0/282376620 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae7402ab00 con 0x7fae8009e000 2023-09-30T22:31:22.329 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:22.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.330+0000 7fae85896700 1 -- 172.21.15.59:0/282376620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae8009e000 msgr2=0x7fae8011e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.330+0000 7fae85896700 1 --2- 172.21.15.59:0/282376620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae8009e000 0x7fae8011e7c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fae7400d5d0 tx=0x7fae74004750 comp rx=0 tx=0).stop 2023-09-30T22:31:22.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.330+0000 7fae85896700 1 -- 172.21.15.59:0/282376620 shutdown_connections 2023-09-30T22:31:22.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.330+0000 7fae85896700 1 --2- 172.21.15.59:0/282376620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae8009e410 0x7fae8011ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.330+0000 7fae85896700 1 --2- 172.21.15.59:0/282376620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae8009d6f0 0x7fae8011e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.330+0000 7fae85896700 1 --2- 172.21.15.59:0/282376620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae8009e000 0x7fae8011e7c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.330+0000 7fae85896700 1 -- 172.21.15.59:0/282376620 >> 172.21.15.59:0/282376620 conn(0x7fae80066f50 msgr2=0x7fae8006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:22.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.330+0000 7fae85896700 1 -- 172.21.15.59:0/282376620 shutdown_connections 2023-09-30T22:31:22.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.330+0000 7fae85896700 1 -- 172.21.15.59:0/282376620 wait complete. 2023-09-30T22:31:22.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:22.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.362+0000 7fc930352700 1 -- 172.21.15.59:0/2699094143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc9280747f0 con 0x7fc92809d630 2023-09-30T22:31:22.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.363+0000 7fc91effd700 1 -- 172.21.15.59:0/2699094143 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc924017020 con 0x7fc92809d630 2023-09-30T22:31:22.364 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.365+0000 7fc930352700 1 -- 172.21.15.59:0/2699094143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92809d630 msgr2=0x7fc92811e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.365+0000 7fc930352700 1 --2- 172.21.15.59:0/2699094143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92809d630 0x7fc92811e850 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc92400e9b0 tx=0x7fc92400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.365+0000 7fc930352700 1 -- 172.21.15.59:0/2699094143 shutdown_connections 2023-09-30T22:31:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.365+0000 7fc930352700 1 --2- 172.21.15.59:0/2699094143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc928133930 0x7fc92811f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.365+0000 7fc930352700 1 --2- 172.21.15.59:0/2699094143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92809d630 0x7fc92811e850 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.365+0000 7fc930352700 1 --2- 172.21.15.59:0/2699094143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9280a0a30 0x7fc92811ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.365+0000 7fc930352700 1 -- 172.21.15.59:0/2699094143 >> 172.21.15.59:0/2699094143 conn(0x7fc9280a3050 msgr2=0x7fc92809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:22.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.365+0000 7fc930352700 1 -- 172.21.15.59:0/2699094143 shutdown_connections 2023-09-30T22:31:22.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.365+0000 7fc930352700 1 -- 172.21.15.59:0/2699094143 wait complete. 2023-09-30T22:31:22.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:22.384 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:22.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.399+0000 7fc66a842700 1 -- 172.21.15.59:0/3580936887 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc6640a3440 con 0x7fc66409f650 2023-09-30T22:31:22.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.400+0000 7fc660ff9700 1 -- 172.21.15.59:0/3580936887 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc658017070 con 0x7fc66409f650 2023-09-30T22:31:22.401 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:22.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.402+0000 7fc66a842700 1 -- 172.21.15.59:0/3580936887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc66409f650 msgr2=0x7fc66406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.402+0000 7fc66a842700 1 --2- 172.21.15.59:0/3580936887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc66409f650 0x7fc66406bdf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc65800e900 tx=0x7fc65800ec10 comp rx=0 tx=0).stop 2023-09-30T22:31:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.402+0000 7fc66a842700 1 -- 172.21.15.59:0/3580936887 shutdown_connections 2023-09-30T22:31:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.402+0000 7fc66a842700 1 --2- 172.21.15.59:0/3580936887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66406c330 0x7fc6641ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.402+0000 7fc66a842700 1 --2- 172.21.15.59:0/3580936887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66409f240 0x7fc66406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.402+0000 7fc66a842700 1 --2- 172.21.15.59:0/3580936887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc66409f650 0x7fc66406bdf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.402+0000 7fc66a842700 1 -- 172.21.15.59:0/3580936887 >> 172.21.15.59:0/3580936887 conn(0x7fc6640a4210 msgr2=0x7fc6641b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.403+0000 7fc66a842700 1 -- 172.21.15.59:0/3580936887 shutdown_connections 2023-09-30T22:31:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.403+0000 7fc66a842700 1 -- 172.21.15.59:0/3580936887 wait complete. 2023-09-30T22:31:22.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:22.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.536+0000 7f2d5be86700 1 Processor -- start 2023-09-30T22:31:22.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.536+0000 7f2d5be86700 1 -- start start 2023-09-30T22:31:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d5be86700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d5409d6f0 0x7f2d5409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d5be86700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d5409e000 0x7f2d541339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d5be86700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d54133f30 0x7f2d54134390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d5be86700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5409b0f0 con 0x7f2d5409d6f0 2023-09-30T22:31:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d5be86700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5409d2f0 con 0x7f2d54133f30 2023-09-30T22:31:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d5be86700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5409a810 con 0x7f2d5409e000 2023-09-30T22:31:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d5a423700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d54133f30 0x7f2d54134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d59c22700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d5409d6f0 0x7f2d5409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d5a423700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d54133f30 0x7f2d54134390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59362/0 (socket says 172.21.15.59:59362) 2023-09-30T22:31:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d59421700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d5409e000 0x7f2d541339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d5a423700 1 -- 172.21.15.59:0/969764062 learned_addr learned my addr 172.21.15.59:0/969764062 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:22.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d59c22700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d5409d6f0 0x7f2d5409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54136/0 (socket says 172.21.15.59:54136) 2023-09-30T22:31:22.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d5a423700 1 -- 172.21.15.59:0/969764062 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d5409e000 msgr2=0x7f2d541339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:22.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d5a423700 1 --2- 172.21.15.59:0/969764062 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d5409e000 0x7f2d541339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d5a423700 1 -- 172.21.15.59:0/969764062 >> v2:172.21.15.59:3300/0 conn(0x7f2d5409d6f0 msgr2=0x7f2d5409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:22.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d5a423700 1 --2- 172.21.15.59:0/969764062 >> v2:172.21.15.59:3300/0 conn(0x7f2d5409d6f0 0x7f2d5409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d5a423700 1 -- 172.21.15.59:0/969764062 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5409a470 con 0x7f2d54133f30 2023-09-30T22:31:22.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d59c22700 1 --2- 172.21.15.59:0/969764062 >> v2:172.21.15.59:3300/0 conn(0x7f2d5409d6f0 0x7f2d5409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:22.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d59421700 1 --2- 172.21.15.59:0/969764062 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d5409e000 0x7f2d541339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:22.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.537+0000 7f2d5a423700 1 --2- 172.21.15.59:0/969764062 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d54133f30 0x7f2d54134390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c009e50 tx=0x7f2d4c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bb885538f90f4c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:22.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.538+0000 7f2d58c20700 1 -- 172.21.15.59:0/969764062 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c00e070 con 0x7f2d54133f30 2023-09-30T22:31:22.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.538+0000 7f2d58c20700 1 -- 172.21.15.59:0/969764062 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c00b910 con 0x7f2d54133f30 2023-09-30T22:31:22.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.538+0000 7f2d58c20700 1 -- 172.21.15.59:0/969764062 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c00bcc0 con 0x7f2d54133f30 2023-09-30T22:31:22.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.538+0000 7f2d5be86700 1 -- 172.21.15.59:0/969764062 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d54133f30 msgr2=0x7f2d54134390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.538+0000 7f2d5be86700 1 --2- 172.21.15.59:0/969764062 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d54133f30 0x7f2d54134390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c009e50 tx=0x7f2d4c00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:22.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.538+0000 7f2d5be86700 1 -- 172.21.15.59:0/969764062 shutdown_connections 2023-09-30T22:31:22.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.538+0000 7f2d5be86700 1 --2- 172.21.15.59:0/969764062 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d54133f30 0x7f2d54134390 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.538+0000 7f2d5be86700 1 --2- 172.21.15.59:0/969764062 >> v2:172.21.15.59:3300/0 conn(0x7f2d5409d6f0 0x7f2d5409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.538+0000 7f2d5be86700 1 --2- 172.21.15.59:0/969764062 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d5409e000 0x7f2d541339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.538+0000 7f2d5be86700 1 -- 172.21.15.59:0/969764062 >> 172.21.15.59:0/969764062 conn(0x7f2d54066f50 msgr2=0x7f2d5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:22.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.538+0000 7f2d5be86700 1 -- 172.21.15.59:0/969764062 shutdown_connections 2023-09-30T22:31:22.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.538+0000 7f2d5be86700 1 -- 172.21.15.59:0/969764062 wait complete. 2023-09-30T22:31:22.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.539+0000 7f2d5be86700 1 Processor -- start 2023-09-30T22:31:22.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.539+0000 7f2d5be86700 1 -- start start 2023-09-30T22:31:22.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d5be86700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d5409d6f0 0x7f2d541202d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d5be86700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d5409e000 0x7f2d54120810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d5be86700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d54133f30 0x7f2d54120d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d5be86700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54123df0 con 0x7f2d5409e000 2023-09-30T22:31:22.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d5be86700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54121f80 con 0x7f2d5409d6f0 2023-09-30T22:31:22.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d5be86700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5409be40 con 0x7f2d54133f30 2023-09-30T22:31:22.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d59c22700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d5409d6f0 0x7f2d541202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d59c22700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d5409d6f0 0x7f2d541202d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59378/0 (socket says 172.21.15.59:59378) 2023-09-30T22:31:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d59c22700 1 -- 172.21.15.59:0/2596341314 learned_addr learned my addr 172.21.15.59:0/2596341314 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d59421700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d5409e000 0x7f2d54120810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d5a423700 1 --2- 172.21.15.59:0/2596341314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d54133f30 0x7f2d54120d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d59c22700 1 -- 172.21.15.59:0/2596341314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d54133f30 msgr2=0x7f2d54120d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d59c22700 1 --2- 172.21.15.59:0/2596341314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d54133f30 0x7f2d54120d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d59c22700 1 -- 172.21.15.59:0/2596341314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d5409e000 msgr2=0x7f2d54120810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d59c22700 1 --2- 172.21.15.59:0/2596341314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d5409e000 0x7f2d54120810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d59c22700 1 -- 172.21.15.59:0/2596341314 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d500094a0 con 0x7f2d5409d6f0 2023-09-30T22:31:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.540+0000 7f2d59421700 1 --2- 172.21.15.59:0/2596341314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d5409e000 0x7f2d54120810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.541+0000 7f2d59c22700 1 --2- 172.21.15.59:0/2596341314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d5409d6f0 0x7f2d541202d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000ebe0 tx=0x7f2d5000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:22.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.541+0000 7f2d467fc700 1 -- 172.21.15.59:0/2596341314 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50009760 con 0x7f2d5409d6f0 2023-09-30T22:31:22.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.541+0000 7f2d467fc700 1 -- 172.21.15.59:0/2596341314 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5000c850 con 0x7f2d5409d6f0 2023-09-30T22:31:22.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.541+0000 7f2d5be86700 1 -- 172.21.15.59:0/2596341314 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d480094a0 con 0x7f2d5409d6f0 2023-09-30T22:31:22.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.541+0000 7f2d467fc700 1 -- 172.21.15.59:0/2596341314 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5000cbe0 con 0x7f2d5409d6f0 2023-09-30T22:31:22.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.541+0000 7f2d5be86700 1 -- 172.21.15.59:0/2596341314 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4c009b30 con 0x7f2d5409d6f0 2023-09-30T22:31:22.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.541+0000 7f2d467fc700 1 -- 172.21.15.59:0/2596341314 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d5000cd40 con 0x7f2d5409d6f0 2023-09-30T22:31:22.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.542+0000 7f2d467fc700 1 -- 172.21.15.59:0/2596341314 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d5003f7a0 con 0x7f2d5409d6f0 2023-09-30T22:31:22.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.542+0000 7f2d5be86700 1 -- 172.21.15.59:0/2596341314 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d54071ff0 con 0x7f2d5409d6f0 2023-09-30T22:31:22.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.547+0000 7f2d467fc700 1 -- 172.21.15.59:0/2596341314 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d500232f0 con 0x7f2d5409d6f0 2023-09-30T22:31:22.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.752+0000 7f2d5be86700 1 -- 172.21.15.59:0/2596341314 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2d54123a30 con 0x7f2d5409d6f0 2023-09-30T22:31:22.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.752+0000 7f2d467fc700 1 -- 172.21.15.59:0/2596341314 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d50011350 con 0x7f2d5409d6f0 2023-09-30T22:31:22.795 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:22.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.754+0000 7f2d5be86700 1 -- 172.21.15.59:0/2596341314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d5409d6f0 msgr2=0x7f2d541202d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.754+0000 7f2d5be86700 1 --2- 172.21.15.59:0/2596341314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d5409d6f0 0x7f2d541202d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000ebe0 tx=0x7f2d5000eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.755+0000 7f2d5be86700 1 -- 172.21.15.59:0/2596341314 shutdown_connections 2023-09-30T22:31:22.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.755+0000 7f2d5be86700 1 --2- 172.21.15.59:0/2596341314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d54133f30 0x7f2d54120d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.755+0000 7f2d5be86700 1 --2- 172.21.15.59:0/2596341314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d5409d6f0 0x7f2d541202d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.755+0000 7f2d5be86700 1 --2- 172.21.15.59:0/2596341314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d5409e000 0x7f2d54120810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.755+0000 7f2d5be86700 1 -- 172.21.15.59:0/2596341314 >> 172.21.15.59:0/2596341314 conn(0x7f2d54066f50 msgr2=0x7f2d54132250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:22.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.755+0000 7f2d5be86700 1 -- 172.21.15.59:0/2596341314 shutdown_connections 2023-09-30T22:31:22.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:22.755+0000 7f2d5be86700 1 -- 172.21.15.59:0/2596341314 wait complete. 2023-09-30T22:31:22.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:23.346 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:23.380 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:23.419 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:23.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.503+0000 7fd128b95700 1 Processor -- start 2023-09-30T22:31:23.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.503+0000 7fd128b95700 1 -- start start 2023-09-30T22:31:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.503+0000 7fd128b95700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd12406a770 0x7fd12406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.503+0000 7fd128b95700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd124131d10 0x7fd124139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.503+0000 7fd128b95700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12409ece0 con 0x7fd12406b080 2023-09-30T22:31:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.503+0000 7fd128b95700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12409e760 con 0x7fd124131d10 2023-09-30T22:31:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.503+0000 7fd128b95700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd12409e040 con 0x7fd12406a770 2023-09-30T22:31:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.504+0000 7fd12259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd12406a770 0x7fd12406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.504+0000 7fd12259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd12406a770 0x7fd12406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41882/0 (socket says 172.21.15.59:41882) 2023-09-30T22:31:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.504+0000 7fd12259c700 1 -- 172.21.15.59:0/2437658789 learned_addr learned my addr 172.21.15.59:0/2437658789 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.504+0000 7fd122d9d700 1 --2- 172.21.15.59:0/2437658789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd124131d10 0x7fd124139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.504+0000 7fd12159a700 1 -- 172.21.15.59:0/2437658789 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704481062 0 0) 0x7fd12409ece0 con 0x7fd12406b080 2023-09-30T22:31:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.504+0000 7fd12259c700 1 -- 172.21.15.59:0/2437658789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd124131d10 msgr2=0x7fd124139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.504+0000 7fd12259c700 1 --2- 172.21.15.59:0/2437658789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd124131d10 0x7fd124139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.504+0000 7fd12259c700 1 -- 172.21.15.59:0/2437658789 >> v1:172.21.15.59:6789/0 conn(0x7fd12406b080 legacy=0x7fd124131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.504+0000 7fd12259c700 1 -- 172.21.15.59:0/2437658789 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12409f630 con 0x7fd12406a770 2023-09-30T22:31:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.504+0000 7fd122d9d700 1 --2- 172.21.15.59:0/2437658789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd124131d10 0x7fd124139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.504+0000 7fd12259c700 1 --2- 172.21.15.59:0/2437658789 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd12406a770 0x7fd12406ab40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd114009920 tx=0x7fd114009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce2d1cfa2ee1b23d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.504+0000 7fd12159a700 1 -- 172.21.15.59:0/2437658789 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114011830 con 0x7fd12406a770 2023-09-30T22:31:23.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.504+0000 7fd12159a700 1 -- 172.21.15.59:0/2437658789 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd114011990 con 0x7fd12406a770 2023-09-30T22:31:23.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.504+0000 7fd12159a700 1 -- 172.21.15.59:0/2437658789 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114011d20 con 0x7fd12406a770 2023-09-30T22:31:23.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.505+0000 7fd128b95700 1 -- 172.21.15.59:0/2437658789 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd12406a770 msgr2=0x7fd12406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.505+0000 7fd128b95700 1 --2- 172.21.15.59:0/2437658789 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd12406a770 0x7fd12406ab40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd114009920 tx=0x7fd114009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:23.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.506+0000 7fd128b95700 1 -- 172.21.15.59:0/2437658789 shutdown_connections 2023-09-30T22:31:23.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.506+0000 7fd128b95700 1 --2- 172.21.15.59:0/2437658789 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd12406a770 0x7fd12406ab40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.506+0000 7fd128b95700 1 --2- 172.21.15.59:0/2437658789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd124131d10 0x7fd124139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.506+0000 7fd128b95700 1 -- 172.21.15.59:0/2437658789 >> 172.21.15.59:0/2437658789 conn(0x7fd124066f50 msgr2=0x7fd12409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:23.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.506+0000 7fd128b95700 1 -- 172.21.15.59:0/2437658789 shutdown_connections 2023-09-30T22:31:23.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.506+0000 7fd128b95700 1 -- 172.21.15.59:0/2437658789 wait complete. 2023-09-30T22:31:23.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.507+0000 7fd128b95700 1 Processor -- start 2023-09-30T22:31:23.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.507+0000 7fd128b95700 1 -- start start 2023-09-30T22:31:23.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.508+0000 7fd128b95700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd12406a770 0x7fd1241c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.508+0000 7fd128b95700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd12406b080 0x7fd1241c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.508+0000 7fd128b95700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd124131d10 0x7fd124120500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.508+0000 7fd128b95700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd124122110 con 0x7fd12406a770 2023-09-30T22:31:23.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.508+0000 7fd128b95700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1241c6ed0 con 0x7fd12406b080 2023-09-30T22:31:23.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.508+0000 7fd128b95700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd12406ed70 con 0x7fd124131d10 2023-09-30T22:31:23.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.508+0000 7fd121d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd12406b080 0x7fd1241c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.508+0000 7fd122d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd124131d10 0x7fd124120500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.508+0000 7fd12259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd12406a770 0x7fd1241c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd122d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd124131d10 0x7fd124120500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41894/0 (socket says 172.21.15.59:41894) 2023-09-30T22:31:23.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd122d9d700 1 -- 172.21.15.59:0/3095278880 learned_addr learned my addr 172.21.15.59:0/3095278880 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:23.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd121d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd12406b080 0x7fd1241c6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59396/0 (socket says 172.21.15.59:59396) 2023-09-30T22:31:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd122d9d700 1 -- 172.21.15.59:0/3095278880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd12406b080 msgr2=0x7fd1241c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd122d9d700 1 --2- 172.21.15.59:0/3095278880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd12406b080 0x7fd1241c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd122d9d700 1 -- 172.21.15.59:0/3095278880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd12406a770 msgr2=0x7fd1241c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd122d9d700 1 --2- 172.21.15.59:0/3095278880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd12406a770 0x7fd1241c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd122d9d700 1 -- 172.21.15.59:0/3095278880 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c009a70 con 0x7fd124131d10 2023-09-30T22:31:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd12259c700 1 --2- 172.21.15.59:0/3095278880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd12406a770 0x7fd1241c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd121d9b700 1 --2- 172.21.15.59:0/3095278880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd12406b080 0x7fd1241c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd122d9d700 1 --2- 172.21.15.59:0/3095278880 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd124131d10 0x7fd124120500 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd11c00efc0 tx=0x7fd11c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd112ffd700 1 -- 172.21.15.59:0/3095278880 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c00ca90 con 0x7fd124131d10 2023-09-30T22:31:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd112ffd700 1 -- 172.21.15.59:0/3095278880 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c00f040 con 0x7fd124131d10 2023-09-30T22:31:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd112ffd700 1 -- 172.21.15.59:0/3095278880 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c00ce10 con 0x7fd124131d10 2023-09-30T22:31:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd128b95700 1 -- 172.21.15.59:0/3095278880 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd114009550 con 0x7fd124131d10 2023-09-30T22:31:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.509+0000 7fd128b95700 1 -- 172.21.15.59:0/3095278880 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd124123a80 con 0x7fd124131d10 2023-09-30T22:31:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.510+0000 7fd112ffd700 1 -- 172.21.15.59:0/3095278880 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd11c014480 con 0x7fd124131d10 2023-09-30T22:31:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.510+0000 7fd112ffd700 1 -- 172.21.15.59:0/3095278880 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd11c03fd20 con 0x7fd124131d10 2023-09-30T22:31:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.511+0000 7fd128b95700 1 -- 172.21.15.59:0/3095278880 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd124131b30 con 0x7fd124131d10 2023-09-30T22:31:23.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.516+0000 7fd112ffd700 1 -- 172.21.15.59:0/3095278880 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd11c012930 con 0x7fd124131d10 2023-09-30T22:31:23.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.542+0000 7f33366dd700 1 Processor -- start 2023-09-30T22:31:23.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.542+0000 7f33366dd700 1 -- start start 2023-09-30T22:31:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.543+0000 7f33366dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f333006f5d0 0x7f333012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.543+0000 7f33366dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3330135c20 0x7f3330138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.543+0000 7f33366dd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333006fa40 con 0x7f333012cf60 2023-09-30T22:31:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.543+0000 7f33366dd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333012cd90 con 0x7f333006f5d0 2023-09-30T22:31:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.543+0000 7f33366dd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3330071780 con 0x7f3330135c20 2023-09-30T22:31:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.543+0000 7f332f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f333006f5d0 0x7f333012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.543+0000 7f332f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f333006f5d0 0x7f333012ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59402/0 (socket says 172.21.15.59:59402) 2023-09-30T22:31:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.543+0000 7f332f7fe700 1 -- 172.21.15.59:0/2423516915 learned_addr learned my addr 172.21.15.59:0/2423516915 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.543+0000 7f332ffff700 1 --1- 172.21.15.59:0/2423516915 >> v1:172.21.15.59:6789/0 conn(0x7f333012cf60 0x7f333012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56288/0 (socket says 172.21.15.59:56288) 2023-09-30T22:31:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.543+0000 7f3334c7a700 1 --2- 172.21.15.59:0/2423516915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3330135c20 0x7f3330138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.543+0000 7f332f7fe700 1 -- 172.21.15.59:0/2423516915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3330135c20 msgr2=0x7f3330138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.543+0000 7f332f7fe700 1 --2- 172.21.15.59:0/2423516915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3330135c20 0x7f3330138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.543+0000 7f332f7fe700 1 -- 172.21.15.59:0/2423516915 >> v1:172.21.15.59:6789/0 conn(0x7f333012cf60 legacy=0x7f333012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.543+0000 7f332f7fe700 1 -- 172.21.15.59:0/2423516915 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3330071a40 con 0x7f333006f5d0 2023-09-30T22:31:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.543+0000 7f3334c7a700 1 --2- 172.21.15.59:0/2423516915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3330135c20 0x7f3330138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.544+0000 7f332f7fe700 1 --2- 172.21.15.59:0/2423516915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f333006f5d0 0x7f333012ffc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f332400b9d0 tx=0x7f332400bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c2499a65d370956 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.544+0000 7f332effd700 1 -- 172.21.15.59:0/2423516915 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400cc60 con 0x7f333006f5d0 2023-09-30T22:31:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.544+0000 7f332effd700 1 -- 172.21.15.59:0/2423516915 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332400cdc0 con 0x7f333006f5d0 2023-09-30T22:31:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.544+0000 7f332effd700 1 -- 172.21.15.59:0/2423516915 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400f680 con 0x7f333006f5d0 2023-09-30T22:31:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.544+0000 7f33366dd700 1 -- 172.21.15.59:0/2423516915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f333006f5d0 msgr2=0x7f333012ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.544+0000 7f33366dd700 1 --2- 172.21.15.59:0/2423516915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f333006f5d0 0x7f333012ffc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f332400b9d0 tx=0x7f332400bce0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.544+0000 7f33366dd700 1 -- 172.21.15.59:0/2423516915 shutdown_connections 2023-09-30T22:31:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.544+0000 7f33366dd700 1 --2- 172.21.15.59:0/2423516915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3330135c20 0x7f3330138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.545+0000 7f33366dd700 1 --2- 172.21.15.59:0/2423516915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f333006f5d0 0x7f333012ffc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.545+0000 7f33366dd700 1 -- 172.21.15.59:0/2423516915 >> 172.21.15.59:0/2423516915 conn(0x7f33300a2aa0 msgr2=0x7f33300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.545+0000 7f33366dd700 1 -- 172.21.15.59:0/2423516915 shutdown_connections 2023-09-30T22:31:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.545+0000 7f33366dd700 1 -- 172.21.15.59:0/2423516915 wait complete. 2023-09-30T22:31:23.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.546+0000 7f33366dd700 1 Processor -- start 2023-09-30T22:31:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.546+0000 7f33366dd700 1 -- start start 2023-09-30T22:31:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f33366dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f333006f5d0 0x7f3330133c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f33366dd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f333012cf60 0x7f33301341b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f33366dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3330135c20 0x7f33301c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f33366dd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333009abc0 con 0x7f333012cf60 2023-09-30T22:31:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f33366dd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33301353f0 con 0x7f333006f5d0 2023-09-30T22:31:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f33366dd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3330133690 con 0x7f3330135c20 2023-09-30T22:31:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f332ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f333006f5d0 0x7f3330133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f332ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f333006f5d0 0x7f3330133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59414/0 (socket says 172.21.15.59:59414) 2023-09-30T22:31:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f332ffff700 1 -- 172.21.15.59:0/2345115309 learned_addr learned my addr 172.21.15.59:0/2345115309 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f332f7fe700 1 --2- 172.21.15.59:0/2345115309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f333012cf60 0x7f33301341b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f3334c7a700 1 --2- 172.21.15.59:0/2345115309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3330135c20 0x7f33301c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f332ffff700 1 -- 172.21.15.59:0/2345115309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3330135c20 msgr2=0x7f33301c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f332ffff700 1 --2- 172.21.15.59:0/2345115309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3330135c20 0x7f33301c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f332ffff700 1 -- 172.21.15.59:0/2345115309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f333012cf60 msgr2=0x7f33301341b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f332ffff700 1 --2- 172.21.15.59:0/2345115309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f333012cf60 0x7f33301341b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.547+0000 7f332ffff700 1 -- 172.21.15.59:0/2345115309 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332800bc50 con 0x7f333006f5d0 2023-09-30T22:31:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.548+0000 7f332ffff700 1 --2- 172.21.15.59:0/2345115309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f333006f5d0 0x7f3330133c70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f332000c550 tx=0x7f332000c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.548+0000 7f332cff9700 1 -- 172.21.15.59:0/2345115309 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320005cb0 con 0x7f333006f5d0 2023-09-30T22:31:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.548+0000 7f332cff9700 1 -- 172.21.15.59:0/2345115309 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3320005e10 con 0x7f333006f5d0 2023-09-30T22:31:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.548+0000 7f33366dd700 1 -- 172.21.15.59:0/2345115309 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332400b600 con 0x7f333006f5d0 2023-09-30T22:31:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.548+0000 7f332cff9700 1 -- 172.21.15.59:0/2345115309 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33200072d0 con 0x7f333006f5d0 2023-09-30T22:31:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.548+0000 7f33366dd700 1 -- 172.21.15.59:0/2345115309 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333009a900 con 0x7f333006f5d0 2023-09-30T22:31:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.549+0000 7f332cff9700 1 -- 172.21.15.59:0/2345115309 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3320007430 con 0x7f333006f5d0 2023-09-30T22:31:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.549+0000 7f332cff9700 1 -- 172.21.15.59:0/2345115309 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f332003ea30 con 0x7f333006f5d0 2023-09-30T22:31:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.549+0000 7f33366dd700 1 -- 172.21.15.59:0/2345115309 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3330074ea0 con 0x7f333006f5d0 2023-09-30T22:31:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.555+0000 7f332cff9700 1 -- 172.21.15.59:0/2345115309 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3320017020 con 0x7f333006f5d0 2023-09-30T22:31:23.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.576+0000 7fd8ba58f700 1 Processor -- start 2023-09-30T22:31:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.576+0000 7fd8ba58f700 1 -- start start 2023-09-30T22:31:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.576+0000 7fd8ba58f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b406b250 0x7fd8b4136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.576+0000 7fd8ba58f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4136d80 0x7fd8b4139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.576+0000 7fd8ba58f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b409ece0 con 0x7fd8b406a770 2023-09-30T22:31:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.576+0000 7fd8ba58f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b406b640 con 0x7fd8b4136d80 2023-09-30T22:31:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.576+0000 7fd8ba58f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b409e760 con 0x7fd8b406b250 2023-09-30T22:31:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.576+0000 7fd8b3fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd8b406a770 0x7fd8b406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56292/0 (socket says 172.21.15.59:56292) 2023-09-30T22:31:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.576+0000 7fd8b3fff700 1 -- 172.21.15.59:0/1910826652 learned_addr learned my addr 172.21.15.59:0/1910826652 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.576+0000 7fd8b8b2c700 1 --2- 172.21.15.59:0/1910826652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4136d80 0x7fd8b4139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.577+0000 7fd8b37fe700 1 --2- 172.21.15.59:0/1910826652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b406b250 0x7fd8b4136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.577+0000 7fd8b2ffd700 1 -- 172.21.15.59:0/1910826652 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175788000 0 0) 0x7fd8b409ece0 con 0x7fd8b406a770 2023-09-30T22:31:23.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.577+0000 7fd8b2ffd700 1 -- 172.21.15.59:0/1910826652 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd89c0035b0 con 0x7fd8b406a770 2023-09-30T22:31:23.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.577+0000 7fd8b37fe700 1 -- 172.21.15.59:0/1910826652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4136d80 msgr2=0x7fd8b4139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:23.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.577+0000 7fd8b37fe700 1 --2- 172.21.15.59:0/1910826652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4136d80 0x7fd8b4139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.577+0000 7fd8b37fe700 1 -- 172.21.15.59:0/1910826652 >> v1:172.21.15.59:6789/0 conn(0x7fd8b406a770 legacy=0x7fd8b406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.577+0000 7fd8b37fe700 1 -- 172.21.15.59:0/1910826652 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b409e040 con 0x7fd8b406b250 2023-09-30T22:31:23.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.577+0000 7fd8b8b2c700 1 --2- 172.21.15.59:0/1910826652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4136d80 0x7fd8b4139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:23.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.577+0000 7fd8b37fe700 1 --2- 172.21.15.59:0/1910826652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b406b250 0x7fd8b4136840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009870 tx=0x7fd8a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=738f5638408f949d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:23.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.577+0000 7fd8b2ffd700 1 -- 172.21.15.59:0/1910826652 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8011830 con 0x7fd8b406b250 2023-09-30T22:31:23.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.577+0000 7fd8b2ffd700 1 -- 172.21.15.59:0/1910826652 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a8011990 con 0x7fd8b406b250 2023-09-30T22:31:23.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.577+0000 7fd8b2ffd700 1 -- 172.21.15.59:0/1910826652 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8011d00 con 0x7fd8b406b250 2023-09-30T22:31:23.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.578+0000 7fd8ba58f700 1 -- 172.21.15.59:0/1910826652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b406b250 msgr2=0x7fd8b4136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.578+0000 7fd8ba58f700 1 --2- 172.21.15.59:0/1910826652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b406b250 0x7fd8b4136840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009870 tx=0x7fd8a8009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:23.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.578+0000 7fd8ba58f700 1 -- 172.21.15.59:0/1910826652 shutdown_connections 2023-09-30T22:31:23.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.578+0000 7fd8ba58f700 1 --2- 172.21.15.59:0/1910826652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4136d80 0x7fd8b4139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.578+0000 7fd8ba58f700 1 --2- 172.21.15.59:0/1910826652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b406b250 0x7fd8b4136840 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.578+0000 7fd8ba58f700 1 -- 172.21.15.59:0/1910826652 >> 172.21.15.59:0/1910826652 conn(0x7fd8b4066f50 msgr2=0x7fd8b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:23.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.578+0000 7fd8ba58f700 1 -- 172.21.15.59:0/1910826652 shutdown_connections 2023-09-30T22:31:23.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.578+0000 7fd8ba58f700 1 -- 172.21.15.59:0/1910826652 wait complete. 2023-09-30T22:31:23.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.579+0000 7fd8ba58f700 1 Processor -- start 2023-09-30T22:31:23.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.580+0000 7fd8ba58f700 1 -- start start 2023-09-30T22:31:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.580+0000 7fd8ba58f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b406a770 0x7fd8b41c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.580+0000 7fd8ba58f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b406b250 0x7fd8b41c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.580+0000 7fd8ba58f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b4136d80 0x7fd8b411c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.580+0000 7fd8ba58f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b41bbe60 con 0x7fd8b4136d80 2023-09-30T22:31:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.580+0000 7fd8ba58f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b411fc10 con 0x7fd8b406a770 2023-09-30T22:31:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.580+0000 7fd8ba58f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b406ecb0 con 0x7fd8b406b250 2023-09-30T22:31:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.580+0000 7fd8b37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b406b250 0x7fd8b41c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.580+0000 7fd8b37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b406b250 0x7fd8b41c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41936/0 (socket says 172.21.15.59:41936) 2023-09-30T22:31:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.580+0000 7fd8b37fe700 1 -- 172.21.15.59:0/3930354197 learned_addr learned my addr 172.21.15.59:0/3930354197 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.580+0000 7fd8b3fff700 1 --2- 172.21.15.59:0/3930354197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b406a770 0x7fd8b41c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.580+0000 7fd8b8b2c700 1 --2- 172.21.15.59:0/3930354197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b4136d80 0x7fd8b411c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.581+0000 7fd8b37fe700 1 -- 172.21.15.59:0/3930354197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b406a770 msgr2=0x7fd8b41c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.581+0000 7fd8b37fe700 1 --2- 172.21.15.59:0/3930354197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b406a770 0x7fd8b41c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.581+0000 7fd8b37fe700 1 -- 172.21.15.59:0/3930354197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b4136d80 msgr2=0x7fd8b411c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.581+0000 7fd8b37fe700 1 --2- 172.21.15.59:0/3930354197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b4136d80 0x7fd8b411c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.581+0000 7fd8b37fe700 1 -- 172.21.15.59:0/3930354197 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac009a70 con 0x7fd8b406b250 2023-09-30T22:31:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.581+0000 7fd8b37fe700 1 --2- 172.21.15.59:0/3930354197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b406b250 0x7fd8b41c6760 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80090b0 tx=0x7fd8a8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.581+0000 7fd8b0ff9700 1 -- 172.21.15.59:0/3930354197 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8004550 con 0x7fd8b406b250 2023-09-30T22:31:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.581+0000 7fd8b0ff9700 1 -- 172.21.15.59:0/3930354197 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a801f070 con 0x7fd8b406b250 2023-09-30T22:31:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.581+0000 7fd8ba58f700 1 -- 172.21.15.59:0/3930354197 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a80094a0 con 0x7fd8b406b250 2023-09-30T22:31:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.581+0000 7fd8b0ff9700 1 -- 172.21.15.59:0/3930354197 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a80038a0 con 0x7fd8b406b250 2023-09-30T22:31:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.581+0000 7fd8ba58f700 1 -- 172.21.15.59:0/3930354197 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b411e7d0 con 0x7fd8b406b250 2023-09-30T22:31:23.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.582+0000 7fd8b0ff9700 1 -- 172.21.15.59:0/3930354197 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8a8003a00 con 0x7fd8b406b250 2023-09-30T22:31:23.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.583+0000 7fd8b0ff9700 1 -- 172.21.15.59:0/3930354197 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd8a8021070 con 0x7fd8b406b250 2023-09-30T22:31:23.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.583+0000 7fd8ba58f700 1 -- 172.21.15.59:0/3930354197 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b4074ea0 con 0x7fd8b406b250 2023-09-30T22:31:23.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.588+0000 7fd8b0ff9700 1 -- 172.21.15.59:0/3930354197 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8a8015080 con 0x7fd8b406b250 2023-09-30T22:31:23.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.725+0000 7fd128b95700 1 -- 172.21.15.59:0/3095278880 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd124074ea0 con 0x7fd124131d10 2023-09-30T22:31:23.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.726+0000 7fd112ffd700 1 -- 172.21.15.59:0/3095278880 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd11c012340 con 0x7fd124131d10 2023-09-30T22:31:23.730 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:23.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.728+0000 7fd128b95700 1 -- 172.21.15.59:0/3095278880 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd124131d10 msgr2=0x7fd124120500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.728+0000 7fd128b95700 1 --2- 172.21.15.59:0/3095278880 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd124131d10 0x7fd124120500 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd11c00efc0 tx=0x7fd11c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.728+0000 7fd128b95700 1 -- 172.21.15.59:0/3095278880 shutdown_connections 2023-09-30T22:31:23.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.728+0000 7fd128b95700 1 --2- 172.21.15.59:0/3095278880 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd124131d10 0x7fd124120500 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.728+0000 7fd128b95700 1 --2- 172.21.15.59:0/3095278880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd12406a770 0x7fd1241c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.728+0000 7fd128b95700 1 --2- 172.21.15.59:0/3095278880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd12406b080 0x7fd1241c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.728+0000 7fd128b95700 1 -- 172.21.15.59:0/3095278880 >> 172.21.15.59:0/3095278880 conn(0x7fd124066f50 msgr2=0x7fd1240700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:23.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.728+0000 7fd128b95700 1 -- 172.21.15.59:0/3095278880 shutdown_connections 2023-09-30T22:31:23.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.728+0000 7fd128b95700 1 -- 172.21.15.59:0/3095278880 wait complete. 2023-09-30T22:31:23.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:23.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.762+0000 7f33366dd700 1 -- 172.21.15.59:0/2345115309 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f33300713a0 con 0x7f333006f5d0 2023-09-30T22:31:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.762+0000 7f332cff9700 1 -- 172.21.15.59:0/2345115309 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f332001b3b0 con 0x7f333006f5d0 2023-09-30T22:31:23.763 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:23.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.764+0000 7f33366dd700 1 -- 172.21.15.59:0/2345115309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f333006f5d0 msgr2=0x7f3330133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.764+0000 7f33366dd700 1 --2- 172.21.15.59:0/2345115309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f333006f5d0 0x7f3330133c70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f332000c550 tx=0x7f332000c860 comp rx=0 tx=0).stop 2023-09-30T22:31:23.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.764+0000 7f33366dd700 1 -- 172.21.15.59:0/2345115309 shutdown_connections 2023-09-30T22:31:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.764+0000 7f33366dd700 1 --2- 172.21.15.59:0/2345115309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3330135c20 0x7f33301c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.764+0000 7f33366dd700 1 --2- 172.21.15.59:0/2345115309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f333006f5d0 0x7f3330133c70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.764+0000 7f33366dd700 1 --2- 172.21.15.59:0/2345115309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f333012cf60 0x7f33301341b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.764+0000 7f33366dd700 1 -- 172.21.15.59:0/2345115309 >> 172.21.15.59:0/2345115309 conn(0x7f33300a2aa0 msgr2=0x7f333006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.764+0000 7f33366dd700 1 -- 172.21.15.59:0/2345115309 shutdown_connections 2023-09-30T22:31:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.764+0000 7f33366dd700 1 -- 172.21.15.59:0/2345115309 wait complete. 2023-09-30T22:31:23.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:23.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:23.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.804+0000 7fd8ba58f700 1 -- 172.21.15.59:0/3930354197 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd8b411f8b0 con 0x7fd8b406b250 2023-09-30T22:31:23.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.804+0000 7fd8b0ff9700 1 -- 172.21.15.59:0/3930354197 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8b411f8b0 con 0x7fd8b406b250 2023-09-30T22:31:23.805 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.807+0000 7fd8ba58f700 1 -- 172.21.15.59:0/3930354197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b406b250 msgr2=0x7fd8b41c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.807+0000 7fd8ba58f700 1 --2- 172.21.15.59:0/3930354197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b406b250 0x7fd8b41c6760 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80090b0 tx=0x7fd8a8004750 comp rx=0 tx=0).stop 2023-09-30T22:31:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.807+0000 7fd8ba58f700 1 -- 172.21.15.59:0/3930354197 shutdown_connections 2023-09-30T22:31:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.807+0000 7fd8ba58f700 1 --2- 172.21.15.59:0/3930354197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b4136d80 0x7fd8b411c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.807+0000 7fd8ba58f700 1 --2- 172.21.15.59:0/3930354197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b406a770 0x7fd8b41c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.807+0000 7fd8ba58f700 1 --2- 172.21.15.59:0/3930354197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b406b250 0x7fd8b41c6760 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.807+0000 7fd8ba58f700 1 -- 172.21.15.59:0/3930354197 >> 172.21.15.59:0/3930354197 conn(0x7fd8b4066f50 msgr2=0x7fd8b4070030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.807+0000 7fd8ba58f700 1 -- 172.21.15.59:0/3930354197 shutdown_connections 2023-09-30T22:31:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.807+0000 7fd8ba58f700 1 -- 172.21.15.59:0/3930354197 wait complete. 2023-09-30T22:31:23.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.939+0000 7f94e35f2700 1 Processor -- start 2023-09-30T22:31:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.940+0000 7f94e35f2700 1 -- start start 2023-09-30T22:31:23.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.940+0000 7f94e35f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94dc09e1d0 0x7f94dc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.940+0000 7f94e35f2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94dc139170 0x7f94dc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.940+0000 7f94e35f2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94dc09b120 con 0x7f94dc09d6f0 2023-09-30T22:31:23.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.940+0000 7f94e35f2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94dc06b460 con 0x7f94dc139170 2023-09-30T22:31:23.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.940+0000 7f94e35f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc09a7e0 con 0x7f94dc09e1d0 2023-09-30T22:31:23.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.940+0000 7f94e1b8f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94dc139170 0x7f94dc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.940+0000 7f94e0b8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94dc09e1d0 0x7f94dc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.940+0000 7f94e0b8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94dc09e1d0 0x7f94dc138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59436/0 (socket says 172.21.15.59:59436) 2023-09-30T22:31:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.940+0000 7f94e1b8f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94dc139170 0x7f94dc13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54172/0 (socket says 172.21.15.59:54172) 2023-09-30T22:31:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.940+0000 7f94e0b8d700 1 -- 172.21.15.59:0/3424534026 learned_addr learned my addr 172.21.15.59:0/3424534026 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.941+0000 7f94e0b8d700 1 -- 172.21.15.59:0/3424534026 >> v2:172.21.15.59:3300/0 conn(0x7f94dc139170 msgr2=0x7f94dc13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.941+0000 7f94e0b8d700 1 --2- 172.21.15.59:0/3424534026 >> v2:172.21.15.59:3300/0 conn(0x7f94dc139170 0x7f94dc13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.941+0000 7f94e0b8d700 1 -- 172.21.15.59:0/3424534026 >> v1:172.21.15.59:6789/0 conn(0x7f94dc09d6f0 legacy=0x7f94dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.941+0000 7f94e0b8d700 1 -- 172.21.15.59:0/3424534026 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc09a500 con 0x7f94dc09e1d0 2023-09-30T22:31:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.941+0000 7f94e1b8f700 1 --2- 172.21.15.59:0/3424534026 >> v2:172.21.15.59:3300/0 conn(0x7f94dc139170 0x7f94dc13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.941+0000 7f94e0b8d700 1 --2- 172.21.15.59:0/3424534026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94dc09e1d0 0x7f94dc138c30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009920 tx=0x7f94cc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f699ca9efb27be0c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.941+0000 7f94d3fff700 1 -- 172.21.15.59:0/3424534026 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc011830 con 0x7f94dc09e1d0 2023-09-30T22:31:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.941+0000 7f94d3fff700 1 -- 172.21.15.59:0/3424534026 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc011990 con 0x7f94dc09e1d0 2023-09-30T22:31:23.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.941+0000 7f94d3fff700 1 -- 172.21.15.59:0/3424534026 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc011d20 con 0x7f94dc09e1d0 2023-09-30T22:31:23.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.942+0000 7f94e35f2700 1 -- 172.21.15.59:0/3424534026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94dc09e1d0 msgr2=0x7f94dc138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.942+0000 7f94e35f2700 1 --2- 172.21.15.59:0/3424534026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94dc09e1d0 0x7f94dc138c30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009920 tx=0x7f94cc009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:23.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.942+0000 7f94e35f2700 1 -- 172.21.15.59:0/3424534026 shutdown_connections 2023-09-30T22:31:23.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.942+0000 7f94e35f2700 1 --2- 172.21.15.59:0/3424534026 >> v2:172.21.15.59:3300/0 conn(0x7f94dc139170 0x7f94dc13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.942+0000 7f94e35f2700 1 --2- 172.21.15.59:0/3424534026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94dc09e1d0 0x7f94dc138c30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.942+0000 7f94e35f2700 1 -- 172.21.15.59:0/3424534026 >> 172.21.15.59:0/3424534026 conn(0x7f94dc066f50 msgr2=0x7f94dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:23.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.942+0000 7f94e35f2700 1 -- 172.21.15.59:0/3424534026 shutdown_connections 2023-09-30T22:31:23.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.942+0000 7f94e35f2700 1 -- 172.21.15.59:0/3424534026 wait complete. 2023-09-30T22:31:23.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.943+0000 7f94e35f2700 1 Processor -- start 2023-09-30T22:31:23.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.943+0000 7f94e35f2700 1 -- start start 2023-09-30T22:31:23.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.943+0000 7f94e35f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94dc09d6f0 0x7f94dc122470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.943+0000 7f94e35f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94dc09e1d0 0x7f94dc1229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.943+0000 7f94e35f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94dc139170 0x7f94dc1c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.943+0000 7f94e35f2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc122000 con 0x7f94dc139170 2023-09-30T22:31:23.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.943+0000 7f94e35f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc124fd0 con 0x7f94dc09e1d0 2023-09-30T22:31:23.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.943+0000 7f94e35f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc0a2a90 con 0x7f94dc09d6f0 2023-09-30T22:31:23.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.943+0000 7f94e0b8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94dc09e1d0 0x7f94dc1229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.943+0000 7f94e1b8f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94dc139170 0x7f94dc1c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.943+0000 7f94e138e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94dc09d6f0 0x7f94dc122470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.943+0000 7f94e0b8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94dc09e1d0 0x7f94dc1229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59450/0 (socket says 172.21.15.59:59450) 2023-09-30T22:31:23.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.943+0000 7f94e1b8f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94dc139170 0x7f94dc1c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54180/0 (socket says 172.21.15.59:54180) 2023-09-30T22:31:23.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.943+0000 7f94e138e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94dc09d6f0 0x7f94dc122470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41952/0 (socket says 172.21.15.59:41952) 2023-09-30T22:31:23.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.943+0000 7f94e0b8d700 1 -- 172.21.15.59:0/2230680853 learned_addr learned my addr 172.21.15.59:0/2230680853 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:23.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.944+0000 7f94e1b8f700 1 -- 172.21.15.59:0/2230680853 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94dc09d6f0 msgr2=0x7f94dc122470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.944+0000 7f94e1b8f700 1 --2- 172.21.15.59:0/2230680853 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94dc09d6f0 0x7f94dc122470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.944+0000 7f94e1b8f700 1 -- 172.21.15.59:0/2230680853 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94dc09e1d0 msgr2=0x7f94dc1229b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.944+0000 7f94e1b8f700 1 --2- 172.21.15.59:0/2230680853 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94dc09e1d0 0x7f94dc1229b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.944+0000 7f94e1b8f700 1 -- 172.21.15.59:0/2230680853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d40094a0 con 0x7f94dc139170 2023-09-30T22:31:23.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.944+0000 7f94e0b8d700 1 --2- 172.21.15.59:0/2230680853 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94dc09e1d0 0x7f94dc1229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:23.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.944+0000 7f94e1b8f700 1 --2- 172.21.15.59:0/2230680853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94dc139170 0x7f94dc1c8360 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f94d400e910 tx=0x7f94d400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:23.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.944+0000 7f94d1ffb700 1 -- 172.21.15.59:0/2230680853 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4004020 con 0x7f94dc139170 2023-09-30T22:31:23.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.944+0000 7f94d1ffb700 1 -- 172.21.15.59:0/2230680853 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d40041a0 con 0x7f94dc139170 2023-09-30T22:31:23.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.944+0000 7f94e35f2700 1 -- 172.21.15.59:0/2230680853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94cc009550 con 0x7f94dc139170 2023-09-30T22:31:23.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.944+0000 7f94d1ffb700 1 -- 172.21.15.59:0/2230680853 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4004550 con 0x7f94dc139170 2023-09-30T22:31:23.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.944+0000 7f94e35f2700 1 -- 172.21.15.59:0/2230680853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94dc125d00 con 0x7f94dc139170 2023-09-30T22:31:23.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.945+0000 7f94d1ffb700 1 -- 172.21.15.59:0/2230680853 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f94d40036a0 con 0x7f94dc139170 2023-09-30T22:31:23.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.945+0000 7f94e35f2700 1 -- 172.21.15.59:0/2230680853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94dc074ea0 con 0x7f94dc139170 2023-09-30T22:31:23.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.945+0000 7f94d1ffb700 1 -- 172.21.15.59:0/2230680853 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f94d403f870 con 0x7f94dc139170 2023-09-30T22:31:23.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:23.950+0000 7f94d1ffb700 1 -- 172.21.15.59:0/2230680853 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94d4017020 con 0x7f94dc139170 2023-09-30T22:31:24.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.154+0000 7f94e35f2700 1 -- 172.21.15.59:0/2230680853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f94dc1251d0 con 0x7f94dc139170 2023-09-30T22:31:24.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.154+0000 7f94d1ffb700 1 -- 172.21.15.59:0/2230680853 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94dc1251d0 con 0x7f94dc139170 2023-09-30T22:31:24.155 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:24.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.156+0000 7f94e35f2700 1 -- 172.21.15.59:0/2230680853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94dc139170 msgr2=0x7f94dc1c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.156+0000 7f94e35f2700 1 --2- 172.21.15.59:0/2230680853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94dc139170 0x7f94dc1c8360 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f94d400e910 tx=0x7f94d400ec20 comp rx=0 tx=0).stop 2023-09-30T22:31:24.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.156+0000 7f94e35f2700 1 -- 172.21.15.59:0/2230680853 shutdown_connections 2023-09-30T22:31:24.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.156+0000 7f94e35f2700 1 --2- 172.21.15.59:0/2230680853 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94dc09d6f0 0x7f94dc122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.156+0000 7f94e35f2700 1 --2- 172.21.15.59:0/2230680853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94dc139170 0x7f94dc1c8360 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.156+0000 7f94e35f2700 1 --2- 172.21.15.59:0/2230680853 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94dc09e1d0 0x7f94dc1229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.156+0000 7f94e35f2700 1 -- 172.21.15.59:0/2230680853 >> 172.21.15.59:0/2230680853 conn(0x7f94dc066f50 msgr2=0x7f94dc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:24.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.156+0000 7f94e35f2700 1 -- 172.21.15.59:0/2230680853 shutdown_connections 2023-09-30T22:31:24.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.157+0000 7f94e35f2700 1 -- 172.21.15.59:0/2230680853 wait complete. 2023-09-30T22:31:24.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:24.745 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:24.784 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:24.823 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:24.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.902+0000 7f276b9e9700 1 Processor -- start 2023-09-30T22:31:24.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.903+0000 7f276b9e9700 1 -- start start 2023-09-30T22:31:24.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.903+0000 7f276b9e9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f276406a770 0x7f276406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.903+0000 7f276b9e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2764131d10 0x7f2764139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.903+0000 7f276b9e9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276409ece0 con 0x7f276406b080 2023-09-30T22:31:24.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.903+0000 7f276b9e9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276409e760 con 0x7f276406a770 2023-09-30T22:31:24.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.903+0000 7f276b9e9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f276409e040 con 0x7f2764131d10 2023-09-30T22:31:24.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.903+0000 7f2769785700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f276406a770 0x7f276406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.903+0000 7f2769f86700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2764131d10 0x7f2764139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.904+0000 7f2769f86700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2764131d10 0x7f2764139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45568/0 (socket says 172.21.15.59:45568) 2023-09-30T22:31:24.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.904+0000 7f2769f86700 1 -- 172.21.15.59:0/4179751745 learned_addr learned my addr 172.21.15.59:0/4179751745 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:24.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.904+0000 7f2769785700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f276406a770 0x7f276406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36418/0 (socket says 172.21.15.59:36418) 2023-09-30T22:31:24.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.904+0000 7f2769f86700 1 -- 172.21.15.59:0/4179751745 >> v2:172.21.15.59:3300/0 conn(0x7f276406a770 msgr2=0x7f276406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:24.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.904+0000 7f2769f86700 1 --2- 172.21.15.59:0/4179751745 >> v2:172.21.15.59:3300/0 conn(0x7f276406a770 0x7f276406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.904+0000 7f2769f86700 1 -- 172.21.15.59:0/4179751745 >> v1:172.21.15.59:6789/0 conn(0x7f276406b080 legacy=0x7f2764131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.904+0000 7f2769f86700 1 -- 172.21.15.59:0/4179751745 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276409f630 con 0x7f2764131d10 2023-09-30T22:31:24.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.904+0000 7f2769f86700 1 --2- 172.21.15.59:0/4179751745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2764131d10 0x7f2764139860 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f275c009e50 tx=0x7f275c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecd02bb17a8c3adb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:24.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.904+0000 7f275bfff700 1 -- 172.21.15.59:0/4179751745 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c00e070 con 0x7f2764131d10 2023-09-30T22:31:24.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.904+0000 7f275bfff700 1 -- 172.21.15.59:0/4179751745 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c00b910 con 0x7f2764131d10 2023-09-30T22:31:24.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.904+0000 7f275bfff700 1 -- 172.21.15.59:0/4179751745 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c00bcc0 con 0x7f2764131d10 2023-09-30T22:31:24.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.905+0000 7f276b9e9700 1 -- 172.21.15.59:0/4179751745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2764131d10 msgr2=0x7f2764139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.905+0000 7f276b9e9700 1 --2- 172.21.15.59:0/4179751745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2764131d10 0x7f2764139860 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f275c009e50 tx=0x7f275c00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:24.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.905+0000 7f276b9e9700 1 -- 172.21.15.59:0/4179751745 shutdown_connections 2023-09-30T22:31:24.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.905+0000 7f276b9e9700 1 --2- 172.21.15.59:0/4179751745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2764131d10 0x7f2764139860 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.905+0000 7f276b9e9700 1 --2- 172.21.15.59:0/4179751745 >> v2:172.21.15.59:3300/0 conn(0x7f276406a770 0x7f276406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.905+0000 7f276b9e9700 1 -- 172.21.15.59:0/4179751745 >> 172.21.15.59:0/4179751745 conn(0x7f2764066f50 msgr2=0x7f276409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:24.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.905+0000 7f276b9e9700 1 -- 172.21.15.59:0/4179751745 shutdown_connections 2023-09-30T22:31:24.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.905+0000 7f276b9e9700 1 -- 172.21.15.59:0/4179751745 wait complete. 2023-09-30T22:31:24.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.907+0000 7f276b9e9700 1 Processor -- start 2023-09-30T22:31:24.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.907+0000 7f276b9e9700 1 -- start start 2023-09-30T22:31:24.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.907+0000 7f276b9e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f276406a770 0x7f2764121010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.907+0000 7f276b9e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f276406b080 0x7f2764121550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.907+0000 7f276b9e9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2764131d10 0x7f27641c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.907+0000 7f276b9e9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2764123c70 con 0x7f2764131d10 2023-09-30T22:31:24.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.907+0000 7f276b9e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2764123f30 con 0x7f276406a770 2023-09-30T22:31:24.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.907+0000 7f276b9e9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2764122300 con 0x7f276406b080 2023-09-30T22:31:24.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.908+0000 7f2769f86700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2764131d10 0x7f27641c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.908+0000 7f2769f86700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2764131d10 0x7f27641c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36430/0 (socket says 172.21.15.59:36430) 2023-09-30T22:31:24.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.908+0000 7f2769f86700 1 -- 172.21.15.59:0/3670396149 learned_addr learned my addr 172.21.15.59:0/3670396149 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:24.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.908+0000 7f2768f84700 1 --2- 172.21.15.59:0/3670396149 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f276406b080 0x7f2764121550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.908+0000 7f2769785700 1 --2- 172.21.15.59:0/3670396149 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f276406a770 0x7f2764121010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.908+0000 7f2769f86700 1 -- 172.21.15.59:0/3670396149 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f276406b080 msgr2=0x7f2764121550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.908+0000 7f2769f86700 1 --2- 172.21.15.59:0/3670396149 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f276406b080 0x7f2764121550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.908+0000 7f2769f86700 1 -- 172.21.15.59:0/3670396149 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f276406a770 msgr2=0x7f2764121010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.908+0000 7f2769f86700 1 --2- 172.21.15.59:0/3670396149 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f276406a770 0x7f2764121010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.908+0000 7f2769f86700 1 -- 172.21.15.59:0/3670396149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c009b30 con 0x7f2764131d10 2023-09-30T22:31:24.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.908+0000 7f2769f86700 1 --2- 172.21.15.59:0/3670396149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2764131d10 0x7f27641c60f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f276409e180 tx=0x7f275c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:24.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.908+0000 7f2759ffb700 1 -- 172.21.15.59:0/3670396149 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c004800 con 0x7f2764131d10 2023-09-30T22:31:24.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.909+0000 7f2759ffb700 1 -- 172.21.15.59:0/3670396149 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c004960 con 0x7f2764131d10 2023-09-30T22:31:24.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.909+0000 7f2759ffb700 1 -- 172.21.15.59:0/3670396149 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c01c680 con 0x7f2764131d10 2023-09-30T22:31:24.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.909+0000 7f276b9e9700 1 -- 172.21.15.59:0/3670396149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27641249a0 con 0x7f2764131d10 2023-09-30T22:31:24.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.909+0000 7f276b9e9700 1 -- 172.21.15.59:0/3670396149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2764124210 con 0x7f2764131d10 2023-09-30T22:31:24.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.910+0000 7f2759ffb700 1 -- 172.21.15.59:0/3670396149 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f275c01c7e0 con 0x7f2764131d10 2023-09-30T22:31:24.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.910+0000 7f2759ffb700 1 -- 172.21.15.59:0/3670396149 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f275c0427b0 con 0x7f2764131d10 2023-09-30T22:31:24.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.910+0000 7f276b9e9700 1 -- 172.21.15.59:0/3670396149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276406e970 con 0x7f2764131d10 2023-09-30T22:31:24.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.915+0000 7f2759ffb700 1 -- 172.21.15.59:0/3670396149 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f275c046060 con 0x7f2764131d10 2023-09-30T22:31:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.933+0000 7f485592a700 1 Processor -- start 2023-09-30T22:31:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.933+0000 7f485592a700 1 -- start start 2023-09-30T22:31:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.933+0000 7f485592a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f485009d630 0x7f48500a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.933+0000 7f485592a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4850138d80 0x7f485013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.933+0000 7f485592a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48500a2a70 con 0x7f48500a0a30 2023-09-30T22:31:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.933+0000 7f485592a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48500a01d0 con 0x7f485009d630 2023-09-30T22:31:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.933+0000 7f485592a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f485009e2b0 con 0x7f4850138d80 2023-09-30T22:31:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.933+0000 7f484effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f48500a0a30 0x7f48500a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45244/0 (socket says 172.21.15.59:45244) 2023-09-30T22:31:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.933+0000 7f484effd700 1 -- 172.21.15.59:0/2234733206 learned_addr learned my addr 172.21.15.59:0/2234733206 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.933+0000 7f484e7fc700 1 --2- 172.21.15.59:0/2234733206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f485009d630 0x7f48500a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.933+0000 7f484f7fe700 1 --2- 172.21.15.59:0/2234733206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4850138d80 0x7f485013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.934+0000 7f484dffb700 1 -- 172.21.15.59:0/2234733206 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239630369 0 0) 0x7f48500a2a70 con 0x7f48500a0a30 2023-09-30T22:31:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.934+0000 7f484e7fc700 1 -- 172.21.15.59:0/2234733206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4850138d80 msgr2=0x7f485013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:24.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.934+0000 7f484e7fc700 1 --2- 172.21.15.59:0/2234733206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4850138d80 0x7f485013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.934+0000 7f484e7fc700 1 -- 172.21.15.59:0/2234733206 >> v1:172.21.15.59:6789/0 conn(0x7f48500a0a30 legacy=0x7f48500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.934+0000 7f484e7fc700 1 -- 172.21.15.59:0/2234733206 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485009dc50 con 0x7f485009d630 2023-09-30T22:31:24.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.934+0000 7f484e7fc700 1 --2- 172.21.15.59:0/2234733206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f485009d630 0x7f48500a1510 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4844009870 tx=0x7f4844009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60a455260714ba5c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:24.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.934+0000 7f484dffb700 1 -- 172.21.15.59:0/2234733206 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844011830 con 0x7f485009d630 2023-09-30T22:31:24.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.934+0000 7f484dffb700 1 -- 172.21.15.59:0/2234733206 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4844011990 con 0x7f485009d630 2023-09-30T22:31:24.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.934+0000 7f484dffb700 1 -- 172.21.15.59:0/2234733206 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844011d20 con 0x7f485009d630 2023-09-30T22:31:24.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.935+0000 7f485592a700 1 -- 172.21.15.59:0/2234733206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f485009d630 msgr2=0x7f48500a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.935+0000 7f485592a700 1 --2- 172.21.15.59:0/2234733206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f485009d630 0x7f48500a1510 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4844009870 tx=0x7f4844009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:24.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.935+0000 7f485592a700 1 -- 172.21.15.59:0/2234733206 shutdown_connections 2023-09-30T22:31:24.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.935+0000 7f485592a700 1 --2- 172.21.15.59:0/2234733206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4850138d80 0x7f485013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.935+0000 7f485592a700 1 --2- 172.21.15.59:0/2234733206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f485009d630 0x7f48500a1510 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.935+0000 7f485592a700 1 -- 172.21.15.59:0/2234733206 >> 172.21.15.59:0/2234733206 conn(0x7f48500a3050 msgr2=0x7f48500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:24.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.935+0000 7f485592a700 1 -- 172.21.15.59:0/2234733206 shutdown_connections 2023-09-30T22:31:24.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.935+0000 7f485592a700 1 -- 172.21.15.59:0/2234733206 wait complete. 2023-09-30T22:31:24.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.936+0000 7f485592a700 1 Processor -- start 2023-09-30T22:31:24.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.937+0000 7f485592a700 1 -- start start 2023-09-30T22:31:24.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.937+0000 7f485592a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f485009d630 0x7f48501335c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.937+0000 7f485592a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48500a0a30 0x7f4850133b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.937+0000 7f485592a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4850138d80 0x7f4850134040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.937+0000 7f485592a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4850136400 con 0x7f4850138d80 2023-09-30T22:31:24.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.937+0000 7f485592a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4850136d70 con 0x7f485009d630 2023-09-30T22:31:24.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.937+0000 7f485592a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48500a4c00 con 0x7f48500a0a30 2023-09-30T22:31:24.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.938+0000 7f484e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48500a0a30 0x7f4850133b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.938+0000 7f484e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48500a0a30 0x7f4850133b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45582/0 (socket says 172.21.15.59:45582) 2023-09-30T22:31:24.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.938+0000 7f484e7fc700 1 -- 172.21.15.59:0/1349390509 learned_addr learned my addr 172.21.15.59:0/1349390509 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.938+0000 7f484effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f485009d630 0x7f48501335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.938+0000 7f484f7fe700 1 --2- 172.21.15.59:0/1349390509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4850138d80 0x7f4850134040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.938+0000 7f484e7fc700 1 -- 172.21.15.59:0/1349390509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f485009d630 msgr2=0x7f48501335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.938+0000 7f484e7fc700 1 --2- 172.21.15.59:0/1349390509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f485009d630 0x7f48501335c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.938+0000 7f484e7fc700 1 -- 172.21.15.59:0/1349390509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4850138d80 msgr2=0x7f4850134040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.938+0000 7f484e7fc700 1 --2- 172.21.15.59:0/1349390509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4850138d80 0x7f4850134040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.938+0000 7f484e7fc700 1 -- 172.21.15.59:0/1349390509 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48440094a0 con 0x7f48500a0a30 2023-09-30T22:31:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.938+0000 7f484f7fe700 1 --2- 172.21.15.59:0/1349390509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4850138d80 0x7f4850134040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.938+0000 7f484e7fc700 1 --2- 172.21.15.59:0/1349390509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48500a0a30 0x7f4850133b00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f48440090b0 tx=0x7f4844004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.938+0000 7f4837fff700 1 -- 172.21.15.59:0/1349390509 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844004300 con 0x7f48500a0a30 2023-09-30T22:31:24.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.939+0000 7f4837fff700 1 -- 172.21.15.59:0/1349390509 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484401f070 con 0x7f48500a0a30 2023-09-30T22:31:24.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.939+0000 7f485592a700 1 -- 172.21.15.59:0/1349390509 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48500a0410 con 0x7f48500a0a30 2023-09-30T22:31:24.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.939+0000 7f4837fff700 1 -- 172.21.15.59:0/1349390509 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48440036a0 con 0x7f48500a0a30 2023-09-30T22:31:24.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.939+0000 7f485592a700 1 -- 172.21.15.59:0/1349390509 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48501377e0 con 0x7f48500a0a30 2023-09-30T22:31:24.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.940+0000 7f485592a700 1 -- 172.21.15.59:0/1349390509 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48500747f0 con 0x7f48500a0a30 2023-09-30T22:31:24.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.940+0000 7f4837fff700 1 -- 172.21.15.59:0/1349390509 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4844021030 con 0x7f48500a0a30 2023-09-30T22:31:24.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.941+0000 7f4837fff700 1 -- 172.21.15.59:0/1349390509 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4844040cd0 con 0x7f48500a0a30 2023-09-30T22:31:24.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.945+0000 7f4837fff700 1 -- 172.21.15.59:0/1349390509 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48440239c0 con 0x7f48500a0a30 2023-09-30T22:31:24.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.984+0000 7f270d261700 1 Processor -- start 2023-09-30T22:31:24.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.984+0000 7f270d261700 1 -- start start 2023-09-30T22:31:24.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.984+0000 7f270d261700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f270809e850 0x7f270809ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.984+0000 7f270d261700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2708131ea0 0x7f2708139c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.984+0000 7f270d261700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270809b560 con 0x7f270809f160 2023-09-30T22:31:24.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.984+0000 7f270d261700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27080a0040 con 0x7f270809e850 2023-09-30T22:31:24.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.984+0000 7f270d261700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27080a02e0 con 0x7f2708131ea0 2023-09-30T22:31:24.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.984+0000 7f27077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2708131ea0 0x7f2708139c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.984+0000 7f27077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2708131ea0 0x7f2708139c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45588/0 (socket says 172.21.15.59:45588) 2023-09-30T22:31:24.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.984+0000 7f27077fe700 1 -- 172.21.15.59:0/257709501 learned_addr learned my addr 172.21.15.59:0/257709501 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:24.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.984+0000 7f2706ffd700 1 --2- 172.21.15.59:0/257709501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f270809e850 0x7f270809ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.985+0000 7f2706ffd700 1 -- 172.21.15.59:0/257709501 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2708131ea0 msgr2=0x7f2708139c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:24.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.985+0000 7f2706ffd700 1 --2- 172.21.15.59:0/257709501 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2708131ea0 0x7f2708139c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.985+0000 7f2706ffd700 1 -- 172.21.15.59:0/257709501 >> v1:172.21.15.59:6789/0 conn(0x7f270809f160 legacy=0x7f2708131790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.985+0000 7f2706ffd700 1 -- 172.21.15.59:0/257709501 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270809fab0 con 0x7f270809e850 2023-09-30T22:31:24.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.985+0000 7f27077fe700 1 --2- 172.21.15.59:0/257709501 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2708131ea0 0x7f2708139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:24.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.985+0000 7f2706ffd700 1 --2- 172.21.15.59:0/257709501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f270809e850 0x7f270809ec20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009870 tx=0x7f26f8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c96aa119c945fcf6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:24.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.985+0000 7f27067fc700 1 -- 172.21.15.59:0/257709501 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8011830 con 0x7f270809e850 2023-09-30T22:31:24.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.985+0000 7f27067fc700 1 -- 172.21.15.59:0/257709501 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f8011990 con 0x7f270809e850 2023-09-30T22:31:24.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.985+0000 7f27067fc700 1 -- 172.21.15.59:0/257709501 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8011d20 con 0x7f270809e850 2023-09-30T22:31:24.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.986+0000 7f270d261700 1 -- 172.21.15.59:0/257709501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f270809e850 msgr2=0x7f270809ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.986+0000 7f270d261700 1 --2- 172.21.15.59:0/257709501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f270809e850 0x7f270809ec20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009870 tx=0x7f26f8009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:24.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.986+0000 7f270d261700 1 -- 172.21.15.59:0/257709501 shutdown_connections 2023-09-30T22:31:24.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.986+0000 7f270d261700 1 --2- 172.21.15.59:0/257709501 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2708131ea0 0x7f2708139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.986+0000 7f270d261700 1 --2- 172.21.15.59:0/257709501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f270809e850 0x7f270809ec20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.986+0000 7f270d261700 1 -- 172.21.15.59:0/257709501 >> 172.21.15.59:0/257709501 conn(0x7f27080a3f70 msgr2=0x7f27080a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:24.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.986+0000 7f270d261700 1 -- 172.21.15.59:0/257709501 shutdown_connections 2023-09-30T22:31:24.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.986+0000 7f270d261700 1 -- 172.21.15.59:0/257709501 wait complete. 2023-09-30T22:31:24.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.987+0000 7f270d261700 1 Processor -- start 2023-09-30T22:31:24.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.987+0000 7f270d261700 1 -- start start 2023-09-30T22:31:24.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f270d261700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f270809e850 0x7f27081202d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f270d261700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f270809f160 0x7f2708120810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f270d261700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2708131ea0 0x7f2708120d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f270d261700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2708121ee0 con 0x7f2708131ea0 2023-09-30T22:31:24.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f270d261700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27081238e0 con 0x7f270809e850 2023-09-30T22:31:24.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f270d261700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2708121730 con 0x7f270809f160 2023-09-30T22:31:24.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f26fe7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f270809f160 0x7f2708120810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f26fe7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f270809f160 0x7f2708120810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45596/0 (socket says 172.21.15.59:45596) 2023-09-30T22:31:24.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f26fe7fc700 1 -- 172.21.15.59:0/3774845969 learned_addr learned my addr 172.21.15.59:0/3774845969 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:24.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f2706ffd700 1 --2- 172.21.15.59:0/3774845969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f270809e850 0x7f27081202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f27077fe700 1 --2- 172.21.15.59:0/3774845969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2708131ea0 0x7f2708120d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f26fe7fc700 1 -- 172.21.15.59:0/3774845969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f270809e850 msgr2=0x7f27081202d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f26fe7fc700 1 --2- 172.21.15.59:0/3774845969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f270809e850 0x7f27081202d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f26fe7fc700 1 -- 172.21.15.59:0/3774845969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2708131ea0 msgr2=0x7f2708120d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f26fe7fc700 1 --2- 172.21.15.59:0/3774845969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2708131ea0 0x7f2708120d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.988+0000 7f26fe7fc700 1 -- 172.21.15.59:0/3774845969 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700009b30 con 0x7f270809f160 2023-09-30T22:31:24.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.989+0000 7f26fe7fc700 1 --2- 172.21.15.59:0/3774845969 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f270809f160 0x7f2708120810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f26f000c4b0 tx=0x7f26f000c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:24.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.989+0000 7f26fffff700 1 -- 172.21.15.59:0/3774845969 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f00052d0 con 0x7f270809f160 2023-09-30T22:31:24.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.989+0000 7f26fffff700 1 -- 172.21.15.59:0/3774845969 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f0005430 con 0x7f270809f160 2023-09-30T22:31:24.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.989+0000 7f270d261700 1 -- 172.21.15.59:0/3774845969 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f80094a0 con 0x7f270809f160 2023-09-30T22:31:24.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.989+0000 7f26fffff700 1 -- 172.21.15.59:0/3774845969 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f00038c0 con 0x7f270809f160 2023-09-30T22:31:24.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.989+0000 7f270d261700 1 -- 172.21.15.59:0/3774845969 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2708123e50 con 0x7f270809f160 2023-09-30T22:31:24.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.990+0000 7f26fffff700 1 -- 172.21.15.59:0/3774845969 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26f0003a20 con 0x7f270809f160 2023-09-30T22:31:24.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.990+0000 7f270d261700 1 -- 172.21.15.59:0/3774845969 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27080747f0 con 0x7f270809f160 2023-09-30T22:31:24.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.990+0000 7f26fffff700 1 -- 172.21.15.59:0/3774845969 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f26f003ea50 con 0x7f270809f160 2023-09-30T22:31:24.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:24.995+0000 7f26fffff700 1 -- 172.21.15.59:0/3774845969 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26f0019e60 con 0x7f270809f160 2023-09-30T22:31:25.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.128+0000 7f276b9e9700 1 -- 172.21.15.59:0/3670396149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2764074ea0 con 0x7f2764131d10 2023-09-30T22:31:25.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.128+0000 7f2759ffb700 1 -- 172.21.15.59:0/3670396149 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f275c023950 con 0x7f2764131d10 2023-09-30T22:31:25.129 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:25.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.130+0000 7f276b9e9700 1 -- 172.21.15.59:0/3670396149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2764131d10 msgr2=0x7f27641c60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.130+0000 7f276b9e9700 1 --2- 172.21.15.59:0/3670396149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2764131d10 0x7f27641c60f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f276409e180 tx=0x7f275c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.130+0000 7f276b9e9700 1 -- 172.21.15.59:0/3670396149 shutdown_connections 2023-09-30T22:31:25.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.130+0000 7f276b9e9700 1 --2- 172.21.15.59:0/3670396149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2764131d10 0x7f27641c60f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.130+0000 7f276b9e9700 1 --2- 172.21.15.59:0/3670396149 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f276406a770 0x7f2764121010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.130+0000 7f276b9e9700 1 --2- 172.21.15.59:0/3670396149 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f276406b080 0x7f2764121550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.130+0000 7f276b9e9700 1 -- 172.21.15.59:0/3670396149 >> 172.21.15.59:0/3670396149 conn(0x7f2764066f50 msgr2=0x7f27640700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:25.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.130+0000 7f276b9e9700 1 -- 172.21.15.59:0/3670396149 shutdown_connections 2023-09-30T22:31:25.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.130+0000 7f276b9e9700 1 -- 172.21.15.59:0/3670396149 wait complete. 2023-09-30T22:31:25.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:25.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.155+0000 7f485592a700 1 -- 172.21.15.59:0/1349390509 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4850072980 con 0x7f48500a0a30 2023-09-30T22:31:25.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.155+0000 7f4837fff700 1 -- 172.21.15.59:0/1349390509 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4844015070 con 0x7f48500a0a30 2023-09-30T22:31:25.156 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:25.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.158+0000 7f485592a700 1 -- 172.21.15.59:0/1349390509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48500a0a30 msgr2=0x7f4850133b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.158+0000 7f485592a700 1 --2- 172.21.15.59:0/1349390509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48500a0a30 0x7f4850133b00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f48440090b0 tx=0x7f4844004750 comp rx=0 tx=0).stop 2023-09-30T22:31:25.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.158+0000 7f485592a700 1 -- 172.21.15.59:0/1349390509 shutdown_connections 2023-09-30T22:31:25.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.158+0000 7f485592a700 1 --2- 172.21.15.59:0/1349390509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4850138d80 0x7f4850134040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.158+0000 7f485592a700 1 --2- 172.21.15.59:0/1349390509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f485009d630 0x7f48501335c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.158+0000 7f485592a700 1 --2- 172.21.15.59:0/1349390509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48500a0a30 0x7f4850133b00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.158+0000 7f485592a700 1 -- 172.21.15.59:0/1349390509 >> 172.21.15.59:0/1349390509 conn(0x7f48500a3050 msgr2=0x7f485009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:25.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.158+0000 7f485592a700 1 -- 172.21.15.59:0/1349390509 shutdown_connections 2023-09-30T22:31:25.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.158+0000 7f485592a700 1 -- 172.21.15.59:0/1349390509 wait complete. 2023-09-30T22:31:25.171 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:25.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:25.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.208+0000 7f270d261700 1 -- 172.21.15.59:0/3774845969 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2708072820 con 0x7f270809f160 2023-09-30T22:31:25.210 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:25.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.208+0000 7f26fffff700 1 -- 172.21.15.59:0/3774845969 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26f0017030 con 0x7f270809f160 2023-09-30T22:31:25.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.210+0000 7f270d261700 1 -- 172.21.15.59:0/3774845969 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f270809f160 msgr2=0x7f2708120810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.210+0000 7f270d261700 1 --2- 172.21.15.59:0/3774845969 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f270809f160 0x7f2708120810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f26f000c4b0 tx=0x7f26f000c7c0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.210+0000 7f270d261700 1 -- 172.21.15.59:0/3774845969 shutdown_connections 2023-09-30T22:31:25.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.210+0000 7f270d261700 1 --2- 172.21.15.59:0/3774845969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2708131ea0 0x7f2708120d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.210+0000 7f270d261700 1 --2- 172.21.15.59:0/3774845969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f270809e850 0x7f27081202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.210+0000 7f270d261700 1 --2- 172.21.15.59:0/3774845969 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f270809f160 0x7f2708120810 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.211+0000 7f270d261700 1 -- 172.21.15.59:0/3774845969 >> 172.21.15.59:0/3774845969 conn(0x7f27080a3f70 msgr2=0x7f27080a1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:25.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.211+0000 7f270d261700 1 -- 172.21.15.59:0/3774845969 shutdown_connections 2023-09-30T22:31:25.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.211+0000 7f270d261700 1 -- 172.21.15.59:0/3774845969 wait complete. 2023-09-30T22:31:25.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:25.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.343+0000 7f5df55f8700 1 Processor -- start 2023-09-30T22:31:25.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.343+0000 7f5df55f8700 1 -- start start 2023-09-30T22:31:25.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.344+0000 7f5df55f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df009d6f0 0x7f5df009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.344+0000 7f5df55f8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5df009e000 0x7f5df01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.344+0000 7f5df55f8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df009b120 con 0x7f5df009e410 2023-09-30T22:31:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.344+0000 7f5df55f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df006b460 con 0x7f5df009d6f0 2023-09-30T22:31:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.344+0000 7f5df55f8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5df009a7e0 con 0x7f5df009e000 2023-09-30T22:31:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.344+0000 7f5deeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df009d6f0 0x7f5df009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.344+0000 7f5dee7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5df009e000 0x7f5df01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.344+0000 7f5def7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5df009e410 0x7f5df0133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45260/0 (socket says 172.21.15.59:45260) 2023-09-30T22:31:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.344+0000 7f5def7fe700 1 -- 172.21.15.59:0/540106201 learned_addr learned my addr 172.21.15.59:0/540106201 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.344+0000 7f5dee7fc700 1 -- 172.21.15.59:0/540106201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df009d6f0 msgr2=0x7f5df009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.344+0000 7f5dedffb700 1 -- 172.21.15.59:0/540106201 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240459940 0 0) 0x7f5df009b120 con 0x7f5df009e410 2023-09-30T22:31:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.344+0000 7f5dee7fc700 1 --2- 172.21.15.59:0/540106201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df009d6f0 0x7f5df009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.344+0000 7f5dee7fc700 1 -- 172.21.15.59:0/540106201 >> v1:172.21.15.59:6789/0 conn(0x7f5df009e410 legacy=0x7f5df0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.344+0000 7f5dee7fc700 1 -- 172.21.15.59:0/540106201 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df009a500 con 0x7f5df009e000 2023-09-30T22:31:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.344+0000 7f5deeffd700 1 --2- 172.21.15.59:0/540106201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df009d6f0 0x7f5df009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.345+0000 7f5dee7fc700 1 --2- 172.21.15.59:0/540106201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5df009e000 0x7f5df01339f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80098a0 tx=0x7f5dd8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0a57aedddc0673f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.345+0000 7f5dedffb700 1 -- 172.21.15.59:0/540106201 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8011830 con 0x7f5df009e000 2023-09-30T22:31:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.345+0000 7f5dedffb700 1 -- 172.21.15.59:0/540106201 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd8011990 con 0x7f5df009e000 2023-09-30T22:31:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.345+0000 7f5dedffb700 1 -- 172.21.15.59:0/540106201 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8011d20 con 0x7f5df009e000 2023-09-30T22:31:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.345+0000 7f5df55f8700 1 -- 172.21.15.59:0/540106201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5df009e000 msgr2=0x7f5df01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.345+0000 7f5df55f8700 1 --2- 172.21.15.59:0/540106201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5df009e000 0x7f5df01339f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80098a0 tx=0x7f5dd8009bb0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.345+0000 7f5df55f8700 1 -- 172.21.15.59:0/540106201 shutdown_connections 2023-09-30T22:31:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.345+0000 7f5df55f8700 1 --2- 172.21.15.59:0/540106201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df009d6f0 0x7f5df009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.345+0000 7f5df55f8700 1 --2- 172.21.15.59:0/540106201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5df009e000 0x7f5df01339f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.345+0000 7f5df55f8700 1 -- 172.21.15.59:0/540106201 >> 172.21.15.59:0/540106201 conn(0x7f5df0066f50 msgr2=0x7f5df009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:25.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.346+0000 7f5df55f8700 1 -- 172.21.15.59:0/540106201 shutdown_connections 2023-09-30T22:31:25.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.346+0000 7f5df55f8700 1 -- 172.21.15.59:0/540106201 wait complete. 2023-09-30T22:31:25.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.347+0000 7f5df55f8700 1 Processor -- start 2023-09-30T22:31:25.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.347+0000 7f5df55f8700 1 -- start start 2023-09-30T22:31:25.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.347+0000 7f5df55f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df009d6f0 0x7f5df01c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.347+0000 7f5df55f8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5df009e000 0x7f5df01c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.347+0000 7f5df55f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df009e410 0x7f5df01c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.347+0000 7f5df55f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df01a82d0 con 0x7f5df009e410 2023-09-30T22:31:25.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.347+0000 7f5df55f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df01a7d30 con 0x7f5df009d6f0 2023-09-30T22:31:25.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.347+0000 7f5df55f8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5df01b92f0 con 0x7f5df009e000 2023-09-30T22:31:25.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.347+0000 7f5deeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df009d6f0 0x7f5df01c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.347+0000 7f5def7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df009e410 0x7f5df01c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.347+0000 7f5deeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df009d6f0 0x7f5df01c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42124/0 (socket says 172.21.15.59:42124) 2023-09-30T22:31:25.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.347+0000 7f5deeffd700 1 -- 172.21.15.59:0/3156988133 learned_addr learned my addr 172.21.15.59:0/3156988133 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:25.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.347+0000 7f5dee7fc700 1 --2- 172.21.15.59:0/3156988133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5df009e000 0x7f5df01c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.348+0000 7f5deeffd700 1 -- 172.21.15.59:0/3156988133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5df009e000 msgr2=0x7f5df01c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.348+0000 7f5deeffd700 1 --2- 172.21.15.59:0/3156988133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5df009e000 0x7f5df01c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.348+0000 7f5deeffd700 1 -- 172.21.15.59:0/3156988133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df009e410 msgr2=0x7f5df01c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.348+0000 7f5deeffd700 1 --2- 172.21.15.59:0/3156988133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df009e410 0x7f5df01c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.348+0000 7f5deeffd700 1 -- 172.21.15.59:0/3156988133 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de00094a0 con 0x7f5df009d6f0 2023-09-30T22:31:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.348+0000 7f5def7fe700 1 --2- 172.21.15.59:0/3156988133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df009e410 0x7f5df01c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.348+0000 7f5deeffd700 1 --2- 172.21.15.59:0/3156988133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df009d6f0 0x7f5df01c80b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5de000ebe0 tx=0x7f5de000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.348+0000 7f5de77fe700 1 -- 172.21.15.59:0/3156988133 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de000c850 con 0x7f5df009d6f0 2023-09-30T22:31:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.348+0000 7f5de77fe700 1 -- 172.21.15.59:0/3156988133 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de000c9b0 con 0x7f5df009d6f0 2023-09-30T22:31:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.348+0000 7f5df55f8700 1 -- 172.21.15.59:0/3156988133 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd80094a0 con 0x7f5df009d6f0 2023-09-30T22:31:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.348+0000 7f5de77fe700 1 -- 172.21.15.59:0/3156988133 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de000cd40 con 0x7f5df009d6f0 2023-09-30T22:31:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.348+0000 7f5df55f8700 1 -- 172.21.15.59:0/3156988133 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df01a6520 con 0x7f5df009d6f0 2023-09-30T22:31:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.349+0000 7f5de77fe700 1 -- 172.21.15.59:0/3156988133 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5de0013470 con 0x7f5df009d6f0 2023-09-30T22:31:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.349+0000 7f5de77fe700 1 -- 172.21.15.59:0/3156988133 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5de003f910 con 0x7f5df009d6f0 2023-09-30T22:31:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.349+0000 7f5df55f8700 1 -- 172.21.15.59:0/3156988133 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df01a8420 con 0x7f5df009d6f0 2023-09-30T22:31:25.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.354+0000 7f5de77fe700 1 -- 172.21.15.59:0/3156988133 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5de0013720 con 0x7f5df009d6f0 2023-09-30T22:31:25.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.557+0000 7f5df55f8700 1 -- 172.21.15.59:0/3156988133 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5df0074ea0 con 0x7f5df009d6f0 2023-09-30T22:31:25.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.557+0000 7f5de77fe700 1 -- 172.21.15.59:0/3156988133 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5de002a090 con 0x7f5df009d6f0 2023-09-30T22:31:25.558 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:25.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.559+0000 7f5df55f8700 1 -- 172.21.15.59:0/3156988133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df009d6f0 msgr2=0x7f5df01c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.559+0000 7f5df55f8700 1 --2- 172.21.15.59:0/3156988133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df009d6f0 0x7f5df01c80b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5de000ebe0 tx=0x7f5de000eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.559+0000 7f5df55f8700 1 -- 172.21.15.59:0/3156988133 shutdown_connections 2023-09-30T22:31:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.559+0000 7f5df55f8700 1 --2- 172.21.15.59:0/3156988133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df009e410 0x7f5df01c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.559+0000 7f5df55f8700 1 --2- 172.21.15.59:0/3156988133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df009d6f0 0x7f5df01c80b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.559+0000 7f5df55f8700 1 --2- 172.21.15.59:0/3156988133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5df009e000 0x7f5df01c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.559+0000 7f5df55f8700 1 -- 172.21.15.59:0/3156988133 >> 172.21.15.59:0/3156988133 conn(0x7f5df0066f50 msgr2=0x7f5df01bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.560+0000 7f5df55f8700 1 -- 172.21.15.59:0/3156988133 shutdown_connections 2023-09-30T22:31:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:25.560+0000 7f5df55f8700 1 -- 172.21.15.59:0/3156988133 wait complete. 2023-09-30T22:31:25.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:26.151 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:26.174 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:26.226 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:26.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.300+0000 7f2f0ea63700 1 Processor -- start 2023-09-30T22:31:26.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.301+0000 7f2f0ea63700 1 -- start start 2023-09-30T22:31:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.301+0000 7f2f0ea63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f081338a0 0x7f2f08133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.301+0000 7f2f0ea63700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f0809e930 0x7f2f0813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.301+0000 7f2f0ea63700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0806ef30 con 0x7f2f0809de50 2023-09-30T22:31:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.301+0000 7f2f0ea63700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0806fef0 con 0x7f2f0809e930 2023-09-30T22:31:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.301+0000 7f2f0ea63700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f081334b0 con 0x7f2f081338a0 2023-09-30T22:31:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.301+0000 7f2f0d000700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f0809e930 0x7f2f0813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.301+0000 7f2f07fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f081338a0 0x7f2f08133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.302+0000 7f2f077fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2f0809de50 0x7f2f0809e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45264/0 (socket says 172.21.15.59:45264) 2023-09-30T22:31:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.302+0000 7f2f07fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f081338a0 0x7f2f08133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42136/0 (socket says 172.21.15.59:42136) 2023-09-30T22:31:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.302+0000 7f2f0d000700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f0809e930 0x7f2f0813b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36478/0 (socket says 172.21.15.59:36478) 2023-09-30T22:31:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.302+0000 7f2f077fe700 1 -- 172.21.15.59:0/987793526 learned_addr learned my addr 172.21.15.59:0/987793526 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.302+0000 7f2f07fff700 1 -- 172.21.15.59:0/987793526 >> v2:172.21.15.59:3300/0 conn(0x7f2f0809e930 msgr2=0x7f2f0813b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.302+0000 7f2f07fff700 1 --2- 172.21.15.59:0/987793526 >> v2:172.21.15.59:3300/0 conn(0x7f2f0809e930 0x7f2f0813b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.302+0000 7f2f07fff700 1 -- 172.21.15.59:0/987793526 >> v1:172.21.15.59:6789/0 conn(0x7f2f0809de50 legacy=0x7f2f0809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.302+0000 7f2f07fff700 1 -- 172.21.15.59:0/987793526 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0806fc30 con 0x7f2f081338a0 2023-09-30T22:31:26.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.302+0000 7f2f0d000700 1 --2- 172.21.15.59:0/987793526 >> v2:172.21.15.59:3300/0 conn(0x7f2f0809e930 0x7f2f0813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:26.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.302+0000 7f2f07fff700 1 --2- 172.21.15.59:0/987793526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f081338a0 0x7f2f08133c70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009840 tx=0x7f2ef8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cb3733a5fd80691 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:26.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.302+0000 7f2f06ffd700 1 -- 172.21.15.59:0/987793526 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8011830 con 0x7f2f081338a0 2023-09-30T22:31:26.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.302+0000 7f2f06ffd700 1 -- 172.21.15.59:0/987793526 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef8011990 con 0x7f2f081338a0 2023-09-30T22:31:26.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.302+0000 7f2f06ffd700 1 -- 172.21.15.59:0/987793526 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8011d20 con 0x7f2f081338a0 2023-09-30T22:31:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.303+0000 7f2f0ea63700 1 -- 172.21.15.59:0/987793526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f081338a0 msgr2=0x7f2f08133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.303+0000 7f2f0ea63700 1 --2- 172.21.15.59:0/987793526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f081338a0 0x7f2f08133c70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009840 tx=0x7f2ef8009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.303+0000 7f2f0ea63700 1 -- 172.21.15.59:0/987793526 shutdown_connections 2023-09-30T22:31:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.303+0000 7f2f0ea63700 1 --2- 172.21.15.59:0/987793526 >> v2:172.21.15.59:3300/0 conn(0x7f2f0809e930 0x7f2f0813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.303+0000 7f2f0ea63700 1 --2- 172.21.15.59:0/987793526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f081338a0 0x7f2f08133c70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.303+0000 7f2f0ea63700 1 -- 172.21.15.59:0/987793526 >> 172.21.15.59:0/987793526 conn(0x7f2f080a2aa0 msgr2=0x7f2f080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.303+0000 7f2f0ea63700 1 -- 172.21.15.59:0/987793526 shutdown_connections 2023-09-30T22:31:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.303+0000 7f2f0ea63700 1 -- 172.21.15.59:0/987793526 wait complete. 2023-09-30T22:31:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.304+0000 7f2f0ea63700 1 Processor -- start 2023-09-30T22:31:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.305+0000 7f2f0ea63700 1 -- start start 2023-09-30T22:31:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.305+0000 7f2f0ea63700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f0809de50 0x7f2f0811d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.305+0000 7f2f0ea63700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f0809e930 0x7f2f0811dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.305+0000 7f2f0ea63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f081338a0 0x7f2f0811e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.305+0000 7f2f0ea63700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0811f350 con 0x7f2f0809de50 2023-09-30T22:31:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.305+0000 7f2f0ea63700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0806f640 con 0x7f2f081338a0 2023-09-30T22:31:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.305+0000 7f2f0ea63700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f08120f80 con 0x7f2f0809e930 2023-09-30T22:31:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.305+0000 7f2f07fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f0809de50 0x7f2f0811d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.305+0000 7f2f07fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f0809de50 0x7f2f0811d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36490/0 (socket says 172.21.15.59:36490) 2023-09-30T22:31:26.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.305+0000 7f2f07fff700 1 -- 172.21.15.59:0/2450961963 learned_addr learned my addr 172.21.15.59:0/2450961963 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:26.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.305+0000 7f2f077fe700 1 --2- 172.21.15.59:0/2450961963 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f0809e930 0x7f2f0811dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.305+0000 7f2f0d000700 1 --2- 172.21.15.59:0/2450961963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f081338a0 0x7f2f0811e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.306+0000 7f2f077fe700 1 -- 172.21.15.59:0/2450961963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f081338a0 msgr2=0x7f2f0811e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.306+0000 7f2f077fe700 1 --2- 172.21.15.59:0/2450961963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f081338a0 0x7f2f0811e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.306+0000 7f2f077fe700 1 -- 172.21.15.59:0/2450961963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f0809de50 msgr2=0x7f2f0811d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.306+0000 7f2f077fe700 1 --2- 172.21.15.59:0/2450961963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f0809de50 0x7f2f0811d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.306+0000 7f2f077fe700 1 -- 172.21.15.59:0/2450961963 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f00009a70 con 0x7f2f0809e930 2023-09-30T22:31:26.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.306+0000 7f2f07fff700 1 --2- 172.21.15.59:0/2450961963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f0809de50 0x7f2f0811d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:26.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.306+0000 7f2f077fe700 1 --2- 172.21.15.59:0/2450961963 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f0809e930 0x7f2f0811dd60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c390 tx=0x7f2efc00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:26.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.306+0000 7f2f04ff9700 1 -- 172.21.15.59:0/2450961963 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc005b40 con 0x7f2f0809e930 2023-09-30T22:31:26.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.306+0000 7f2f04ff9700 1 -- 172.21.15.59:0/2450961963 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc005ca0 con 0x7f2f0809e930 2023-09-30T22:31:26.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.306+0000 7f2f04ff9700 1 -- 172.21.15.59:0/2450961963 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0072f0 con 0x7f2f0809e930 2023-09-30T22:31:26.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.306+0000 7f2f0ea63700 1 -- 172.21.15.59:0/2450961963 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef80094a0 con 0x7f2f0809e930 2023-09-30T22:31:26.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.306+0000 7f2f0ea63700 1 -- 172.21.15.59:0/2450961963 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f080a1050 con 0x7f2f0809e930 2023-09-30T22:31:26.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.307+0000 7f2f04ff9700 1 -- 172.21.15.59:0/2450961963 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2efc007450 con 0x7f2f0809e930 2023-09-30T22:31:26.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.307+0000 7f2f04ff9700 1 -- 172.21.15.59:0/2450961963 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2efc03e950 con 0x7f2f0809e930 2023-09-30T22:31:26.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.308+0000 7f2f0ea63700 1 -- 172.21.15.59:0/2450961963 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0811a470 con 0x7f2f0809e930 2023-09-30T22:31:26.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.313+0000 7f2f04ff9700 1 -- 172.21.15.59:0/2450961963 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2efc017080 con 0x7f2f0809e930 2023-09-30T22:31:26.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.340+0000 7f4292d41700 1 Processor -- start 2023-09-30T22:31:26.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.340+0000 7f4292d41700 1 -- start start 2023-09-30T22:31:26.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.341+0000 7f4292d41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c130750 0x7f428c130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.341+0000 7f4292d41700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c09e250 0x7f428c1384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.341+0000 7f4292d41700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428c09c190 con 0x7f428c09d6f0 2023-09-30T22:31:26.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.341+0000 7f4292d41700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c09b090 con 0x7f428c130750 2023-09-30T22:31:26.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.341+0000 7f4292d41700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f428c09a6c0 con 0x7f428c09e250 2023-09-30T22:31:26.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.341+0000 7f42912de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c09e250 0x7f428c1384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.341+0000 7f42912de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c09e250 0x7f428c1384c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45622/0 (socket says 172.21.15.59:45622) 2023-09-30T22:31:26.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.341+0000 7f4290add700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c130750 0x7f428c130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.341+0000 7f42912de700 1 -- 172.21.15.59:0/1910349524 learned_addr learned my addr 172.21.15.59:0/1910349524 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:26.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.341+0000 7f42912de700 1 -- 172.21.15.59:0/1910349524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c130750 msgr2=0x7f428c130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:26.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.341+0000 7f42912de700 1 --2- 172.21.15.59:0/1910349524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c130750 0x7f428c130b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.341+0000 7f42912de700 1 -- 172.21.15.59:0/1910349524 >> v1:172.21.15.59:6789/0 conn(0x7f428c09d6f0 legacy=0x7f428c09db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.341+0000 7f428b7fe700 1 -- 172.21.15.59:0/1910349524 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928048590 0 0) 0x7f428c09c190 con 0x7f428c09d6f0 2023-09-30T22:31:26.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.341+0000 7f42912de700 1 -- 172.21.15.59:0/1910349524 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c131060 con 0x7f428c09e250 2023-09-30T22:31:26.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.341+0000 7f4290add700 1 --2- 172.21.15.59:0/1910349524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c130750 0x7f428c130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:26.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.342+0000 7f42912de700 1 --2- 172.21.15.59:0/1910349524 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c09e250 0x7f428c1384c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4284009e80 tx=0x7f428400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=295988e7c4f0b721 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:26.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.342+0000 7f428b7fe700 1 -- 172.21.15.59:0/1910349524 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428400e070 con 0x7f428c09e250 2023-09-30T22:31:26.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.342+0000 7f428b7fe700 1 -- 172.21.15.59:0/1910349524 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428400b910 con 0x7f428c09e250 2023-09-30T22:31:26.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.342+0000 7f428b7fe700 1 -- 172.21.15.59:0/1910349524 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428400bcc0 con 0x7f428c09e250 2023-09-30T22:31:26.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.343+0000 7f4292d41700 1 -- 172.21.15.59:0/1910349524 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c09e250 msgr2=0x7f428c1384c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.343+0000 7f4292d41700 1 --2- 172.21.15.59:0/1910349524 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c09e250 0x7f428c1384c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4284009e80 tx=0x7f428400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:26.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.343+0000 7f4292d41700 1 -- 172.21.15.59:0/1910349524 shutdown_connections 2023-09-30T22:31:26.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.343+0000 7f4292d41700 1 --2- 172.21.15.59:0/1910349524 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c09e250 0x7f428c1384c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.343+0000 7f4292d41700 1 --2- 172.21.15.59:0/1910349524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c130750 0x7f428c130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.343+0000 7f4292d41700 1 -- 172.21.15.59:0/1910349524 >> 172.21.15.59:0/1910349524 conn(0x7f428c09f470 msgr2=0x7f428c0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:26.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.343+0000 7f4292d41700 1 -- 172.21.15.59:0/1910349524 shutdown_connections 2023-09-30T22:31:26.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.343+0000 7f4292d41700 1 -- 172.21.15.59:0/1910349524 wait complete. 2023-09-30T22:31:26.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.344+0000 7f4292d41700 1 Processor -- start 2023-09-30T22:31:26.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.344+0000 7f4292d41700 1 -- start start 2023-09-30T22:31:26.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.344+0000 7f4292d41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c09d6f0 0x7f428c097950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.344+0000 7f4292d41700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c09e250 0x7f428c097e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.344+0000 7f4292d41700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c130750 0x7f428c0983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.344+0000 7f4292d41700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c13af10 con 0x7f428c130750 2023-09-30T22:31:26.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.344+0000 7f4292d41700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c09b2b0 con 0x7f428c09d6f0 2023-09-30T22:31:26.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.344+0000 7f4292d41700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f428c092b20 con 0x7f428c09e250 2023-09-30T22:31:26.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.345+0000 7f42912de700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c130750 0x7f428c0983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.345+0000 7f428bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c09e250 0x7f428c097e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.345+0000 7f42912de700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c130750 0x7f428c0983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36498/0 (socket says 172.21.15.59:36498) 2023-09-30T22:31:26.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.345+0000 7f42912de700 1 -- 172.21.15.59:0/74589012 learned_addr learned my addr 172.21.15.59:0/74589012 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:26.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.345+0000 7f4290add700 1 --2- 172.21.15.59:0/74589012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c09d6f0 0x7f428c097950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.345+0000 7f42912de700 1 -- 172.21.15.59:0/74589012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c09e250 msgr2=0x7f428c097e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.345+0000 7f42912de700 1 --2- 172.21.15.59:0/74589012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c09e250 0x7f428c097e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.345+0000 7f42912de700 1 -- 172.21.15.59:0/74589012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c09d6f0 msgr2=0x7f428c097950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.345+0000 7f42912de700 1 --2- 172.21.15.59:0/74589012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c09d6f0 0x7f428c097950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.345+0000 7f42912de700 1 -- 172.21.15.59:0/74589012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800094a0 con 0x7f428c130750 2023-09-30T22:31:26.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.345+0000 7f4290add700 1 --2- 172.21.15.59:0/74589012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c09d6f0 0x7f428c097950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:26.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.345+0000 7f42912de700 1 --2- 172.21.15.59:0/74589012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c130750 0x7f428c0983d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4284012000 tx=0x7f4284004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:26.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.345+0000 7f42897fa700 1 -- 172.21.15.59:0/74589012 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840048c0 con 0x7f428c130750 2023-09-30T22:31:26.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.346+0000 7f42897fa700 1 -- 172.21.15.59:0/74589012 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42840092e0 con 0x7f428c130750 2023-09-30T22:31:26.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.346+0000 7f4292d41700 1 -- 172.21.15.59:0/74589012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4284009b30 con 0x7f428c130750 2023-09-30T22:31:26.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.346+0000 7f42897fa700 1 -- 172.21.15.59:0/74589012 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428401b670 con 0x7f428c130750 2023-09-30T22:31:26.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.346+0000 7f4292d41700 1 -- 172.21.15.59:0/74589012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c13ba10 con 0x7f428c130750 2023-09-30T22:31:26.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.346+0000 7f42897fa700 1 -- 172.21.15.59:0/74589012 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f428401b7d0 con 0x7f428c130750 2023-09-30T22:31:26.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.347+0000 7f4292d41700 1 -- 172.21.15.59:0/74589012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c0747f0 con 0x7f428c130750 2023-09-30T22:31:26.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.347+0000 7f42897fa700 1 -- 172.21.15.59:0/74589012 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4284040ae0 con 0x7f428c130750 2023-09-30T22:31:26.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.352+0000 7f42897fa700 1 -- 172.21.15.59:0/74589012 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42840239a0 con 0x7f428c130750 2023-09-30T22:31:26.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.381+0000 7fd4dbccb700 1 Processor -- start 2023-09-30T22:31:26.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.381+0000 7fd4dbccb700 1 -- start start 2023-09-30T22:31:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.382+0000 7fd4dbccb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4d409d630 0x7fd4d40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.382+0000 7fd4dbccb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d4138d80 0x7fd4d413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.382+0000 7fd4dbccb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d40a2a70 con 0x7fd4d40a0a30 2023-09-30T22:31:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.382+0000 7fd4dbccb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d40a01d0 con 0x7fd4d409d630 2023-09-30T22:31:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.382+0000 7fd4dbccb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d409e2b0 con 0x7fd4d4138d80 2023-09-30T22:31:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.382+0000 7fd4d9266700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4d409d630 0x7fd4d40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.382+0000 7fd4d9a67700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd4d40a0a30 0x7fd4d40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45284/0 (socket says 172.21.15.59:45284) 2023-09-30T22:31:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.382+0000 7fd4d9a67700 1 -- 172.21.15.59:0/2636992665 learned_addr learned my addr 172.21.15.59:0/2636992665 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.382+0000 7fd4da268700 1 --2- 172.21.15.59:0/2636992665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d4138d80 0x7fd4d413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.382+0000 7fd4d9266700 1 -- 172.21.15.59:0/2636992665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d4138d80 msgr2=0x7fd4d413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.382+0000 7fd4d9266700 1 --2- 172.21.15.59:0/2636992665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d4138d80 0x7fd4d413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.382+0000 7fd4d9266700 1 -- 172.21.15.59:0/2636992665 >> v1:172.21.15.59:6789/0 conn(0x7fd4d40a0a30 legacy=0x7fd4d40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.382+0000 7fd4d9266700 1 -- 172.21.15.59:0/2636992665 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d409dc50 con 0x7fd4d409d630 2023-09-30T22:31:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.382+0000 7fd4d8a65700 1 -- 172.21.15.59:0/2636992665 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481487509 0 0) 0x7fd4d40a2a70 con 0x7fd4d40a0a30 2023-09-30T22:31:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.382+0000 7fd4d9266700 1 --2- 172.21.15.59:0/2636992665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d409d630 0x7fd4d40a1510 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009840 tx=0x7fd4c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8901d221090ff89e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.383+0000 7fd4d8a65700 1 -- 172.21.15.59:0/2636992665 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4011830 con 0x7fd4d409d630 2023-09-30T22:31:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.383+0000 7fd4d8a65700 1 -- 172.21.15.59:0/2636992665 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c4011990 con 0x7fd4d409d630 2023-09-30T22:31:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.383+0000 7fd4d8a65700 1 -- 172.21.15.59:0/2636992665 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4011d20 con 0x7fd4d409d630 2023-09-30T22:31:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.383+0000 7fd4dbccb700 1 -- 172.21.15.59:0/2636992665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d409d630 msgr2=0x7fd4d40a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.383+0000 7fd4dbccb700 1 --2- 172.21.15.59:0/2636992665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d409d630 0x7fd4d40a1510 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009840 tx=0x7fd4c4009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.383+0000 7fd4dbccb700 1 -- 172.21.15.59:0/2636992665 shutdown_connections 2023-09-30T22:31:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.383+0000 7fd4dbccb700 1 --2- 172.21.15.59:0/2636992665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d4138d80 0x7fd4d413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.383+0000 7fd4dbccb700 1 --2- 172.21.15.59:0/2636992665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d409d630 0x7fd4d40a1510 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.383+0000 7fd4dbccb700 1 -- 172.21.15.59:0/2636992665 >> 172.21.15.59:0/2636992665 conn(0x7fd4d40a3050 msgr2=0x7fd4d40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.383+0000 7fd4dbccb700 1 -- 172.21.15.59:0/2636992665 shutdown_connections 2023-09-30T22:31:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.384+0000 7fd4dbccb700 1 -- 172.21.15.59:0/2636992665 wait complete. 2023-09-30T22:31:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.384+0000 7fd4dbccb700 1 Processor -- start 2023-09-30T22:31:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.385+0000 7fd4dbccb700 1 -- start start 2023-09-30T22:31:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.385+0000 7fd4dbccb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d409d630 0x7fd4d41337a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.385+0000 7fd4dbccb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d40a0a30 0x7fd4d4133ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.385+0000 7fd4dbccb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d4138d80 0x7fd4d4134220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.385+0000 7fd4dbccb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d4136270 con 0x7fd4d409d630 2023-09-30T22:31:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.385+0000 7fd4dbccb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d4136f90 con 0x7fd4d40a0a30 2023-09-30T22:31:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.385+0000 7fd4dbccb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40a4b10 con 0x7fd4d4138d80 2023-09-30T22:31:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.385+0000 7fd4da268700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d4138d80 0x7fd4d4134220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.385+0000 7fd4da268700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d4138d80 0x7fd4d4134220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45638/0 (socket says 172.21.15.59:45638) 2023-09-30T22:31:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.385+0000 7fd4da268700 1 -- 172.21.15.59:0/1609458457 learned_addr learned my addr 172.21.15.59:0/1609458457 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.385+0000 7fd4d9266700 1 --2- 172.21.15.59:0/1609458457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d40a0a30 0x7fd4d4133ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.385+0000 7fd4d9a67700 1 --2- 172.21.15.59:0/1609458457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d409d630 0x7fd4d41337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.386+0000 7fd4da268700 1 -- 172.21.15.59:0/1609458457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d40a0a30 msgr2=0x7fd4d4133ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.386+0000 7fd4da268700 1 --2- 172.21.15.59:0/1609458457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d40a0a30 0x7fd4d4133ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.386+0000 7fd4da268700 1 -- 172.21.15.59:0/1609458457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d409d630 msgr2=0x7fd4d41337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.386+0000 7fd4da268700 1 --2- 172.21.15.59:0/1609458457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d409d630 0x7fd4d41337a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.386+0000 7fd4da268700 1 -- 172.21.15.59:0/1609458457 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c40094a0 con 0x7fd4d4138d80 2023-09-30T22:31:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.386+0000 7fd4d9a67700 1 --2- 172.21.15.59:0/1609458457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d409d630 0x7fd4d41337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.386+0000 7fd4da268700 1 --2- 172.21.15.59:0/1609458457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d4138d80 0x7fd4d4134220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00e930 tx=0x7fd4cc00ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.386+0000 7fd4ca7fc700 1 -- 172.21.15.59:0/1609458457 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc0096d0 con 0x7fd4d4138d80 2023-09-30T22:31:26.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.386+0000 7fd4ca7fc700 1 -- 172.21.15.59:0/1609458457 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc00ee80 con 0x7fd4d4138d80 2023-09-30T22:31:26.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.386+0000 7fd4dbccb700 1 -- 172.21.15.59:0/1609458457 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d40a0410 con 0x7fd4d4138d80 2023-09-30T22:31:26.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.386+0000 7fd4ca7fc700 1 -- 172.21.15.59:0/1609458457 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc00ca70 con 0x7fd4d4138d80 2023-09-30T22:31:26.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.386+0000 7fd4dbccb700 1 -- 172.21.15.59:0/1609458457 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d4137270 con 0x7fd4d4138d80 2023-09-30T22:31:26.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.387+0000 7fd4ca7fc700 1 -- 172.21.15.59:0/1609458457 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd4cc00cbd0 con 0x7fd4d4138d80 2023-09-30T22:31:26.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.387+0000 7fd4dbccb700 1 -- 172.21.15.59:0/1609458457 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d4136dd0 con 0x7fd4d4138d80 2023-09-30T22:31:26.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.388+0000 7fd4ca7fc700 1 -- 172.21.15.59:0/1609458457 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd4cc03f770 con 0x7fd4d4138d80 2023-09-30T22:31:26.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.392+0000 7fd4ca7fc700 1 -- 172.21.15.59:0/1609458457 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4cc0232f0 con 0x7fd4d4138d80 2023-09-30T22:31:26.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.523+0000 7f2f0ea63700 1 -- 172.21.15.59:0/2450961963 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2f08074ea0 con 0x7f2f0809e930 2023-09-30T22:31:26.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.524+0000 7f2f04ff9700 1 -- 172.21.15.59:0/2450961963 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2efc0196d0 con 0x7f2f0809e930 2023-09-30T22:31:26.525 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:26.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.526+0000 7f2f0ea63700 1 -- 172.21.15.59:0/2450961963 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f0809e930 msgr2=0x7f2f0811dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.526+0000 7f2f0ea63700 1 --2- 172.21.15.59:0/2450961963 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f0809e930 0x7f2f0811dd60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c390 tx=0x7f2efc00c6a0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.526+0000 7f2f0ea63700 1 -- 172.21.15.59:0/2450961963 shutdown_connections 2023-09-30T22:31:26.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.526+0000 7f2f0ea63700 1 --2- 172.21.15.59:0/2450961963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f081338a0 0x7f2f0811e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.526+0000 7f2f0ea63700 1 --2- 172.21.15.59:0/2450961963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f0809de50 0x7f2f0811d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.526+0000 7f2f0ea63700 1 --2- 172.21.15.59:0/2450961963 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f0809e930 0x7f2f0811dd60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.526+0000 7f2f0ea63700 1 -- 172.21.15.59:0/2450961963 >> 172.21.15.59:0/2450961963 conn(0x7f2f080a2aa0 msgr2=0x7f2f081badd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:26.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.526+0000 7f2f0ea63700 1 -- 172.21.15.59:0/2450961963 shutdown_connections 2023-09-30T22:31:26.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.526+0000 7f2f0ea63700 1 -- 172.21.15.59:0/2450961963 wait complete. 2023-09-30T22:31:26.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:26.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.563+0000 7f4292d41700 1 -- 172.21.15.59:0/74589012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f428c13b6b0 con 0x7f428c130750 2023-09-30T22:31:26.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.564+0000 7f42897fa700 1 -- 172.21.15.59:0/74589012 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f428401f030 con 0x7f428c130750 2023-09-30T22:31:26.565 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:26.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.566+0000 7f4292d41700 1 -- 172.21.15.59:0/74589012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c130750 msgr2=0x7f428c0983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.566+0000 7f4292d41700 1 --2- 172.21.15.59:0/74589012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c130750 0x7f428c0983d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4284012000 tx=0x7f4284004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.566+0000 7f4292d41700 1 -- 172.21.15.59:0/74589012 shutdown_connections 2023-09-30T22:31:26.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.566+0000 7f4292d41700 1 --2- 172.21.15.59:0/74589012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c130750 0x7f428c0983d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.566+0000 7f4292d41700 1 --2- 172.21.15.59:0/74589012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c09d6f0 0x7f428c097950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.566+0000 7f4292d41700 1 --2- 172.21.15.59:0/74589012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c09e250 0x7f428c097e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.566+0000 7f4292d41700 1 -- 172.21.15.59:0/74589012 >> 172.21.15.59:0/74589012 conn(0x7f428c09f470 msgr2=0x7f428c0992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:26.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.566+0000 7f4292d41700 1 -- 172.21.15.59:0/74589012 shutdown_connections 2023-09-30T22:31:26.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.566+0000 7f4292d41700 1 -- 172.21.15.59:0/74589012 wait complete. 2023-09-30T22:31:26.576 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:26.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:26.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.605+0000 7fd4dbccb700 1 -- 172.21.15.59:0/1609458457 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd4d4136c30 con 0x7fd4d4138d80 2023-09-30T22:31:26.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.605+0000 7fd4ca7fc700 1 -- 172.21.15.59:0/1609458457 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd4d4136c30 con 0x7fd4d4138d80 2023-09-30T22:31:26.606 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:26.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.607+0000 7fd4dbccb700 1 -- 172.21.15.59:0/1609458457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d4138d80 msgr2=0x7fd4d4134220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.607+0000 7fd4dbccb700 1 --2- 172.21.15.59:0/1609458457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d4138d80 0x7fd4d4134220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00e930 tx=0x7fd4cc00ec40 comp rx=0 tx=0).stop 2023-09-30T22:31:26.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.607+0000 7fd4dbccb700 1 -- 172.21.15.59:0/1609458457 shutdown_connections 2023-09-30T22:31:26.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.607+0000 7fd4dbccb700 1 --2- 172.21.15.59:0/1609458457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d4138d80 0x7fd4d4134220 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.607+0000 7fd4dbccb700 1 --2- 172.21.15.59:0/1609458457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d409d630 0x7fd4d41337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.607+0000 7fd4dbccb700 1 --2- 172.21.15.59:0/1609458457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d40a0a30 0x7fd4d4133ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.607+0000 7fd4dbccb700 1 -- 172.21.15.59:0/1609458457 >> 172.21.15.59:0/1609458457 conn(0x7fd4d40a3050 msgr2=0x7fd4d409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:26.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.607+0000 7fd4dbccb700 1 -- 172.21.15.59:0/1609458457 shutdown_connections 2023-09-30T22:31:26.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.607+0000 7fd4dbccb700 1 -- 172.21.15.59:0/1609458457 wait complete. 2023-09-30T22:31:26.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:26.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.711+0000 7fa4bde91700 1 Processor -- start 2023-09-30T22:31:26.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.712+0000 7fa4bde91700 1 -- start start 2023-09-30T22:31:26.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.712+0000 7fa4bde91700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4b809d6f0 0x7fa4b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.712+0000 7fa4bde91700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4b809e000 0x7fa4b81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.712+0000 7fa4bde91700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b809b120 con 0x7fa4b809e410 2023-09-30T22:31:26.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.712+0000 7fa4bde91700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b806b460 con 0x7fa4b809e000 2023-09-30T22:31:26.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.712+0000 7fa4bde91700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b809a7e0 con 0x7fa4b809d6f0 2023-09-30T22:31:26.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.712+0000 7fa4b77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4b809d6f0 0x7fa4b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.712+0000 7fa4b6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4b809e000 0x7fa4b81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.712+0000 7fa4b77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4b809d6f0 0x7fa4b809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45642/0 (socket says 172.21.15.59:45642) 2023-09-30T22:31:26.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.712+0000 7fa4b6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4b809e000 0x7fa4b81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36528/0 (socket says 172.21.15.59:36528) 2023-09-30T22:31:26.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.712+0000 7fa4b77fe700 1 -- 172.21.15.59:0/2058621042 learned_addr learned my addr 172.21.15.59:0/2058621042 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:26.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.713+0000 7fa4b77fe700 1 -- 172.21.15.59:0/2058621042 >> v2:172.21.15.59:3300/0 conn(0x7fa4b809e000 msgr2=0x7fa4b81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:26.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.713+0000 7fa4b77fe700 1 --2- 172.21.15.59:0/2058621042 >> v2:172.21.15.59:3300/0 conn(0x7fa4b809e000 0x7fa4b81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.713+0000 7fa4b77fe700 1 -- 172.21.15.59:0/2058621042 >> v1:172.21.15.59:6789/0 conn(0x7fa4b809e410 legacy=0x7fa4b8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.713+0000 7fa4b77fe700 1 -- 172.21.15.59:0/2058621042 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b809a500 con 0x7fa4b809d6f0 2023-09-30T22:31:26.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.713+0000 7fa4b6ffd700 1 --2- 172.21.15.59:0/2058621042 >> v2:172.21.15.59:3300/0 conn(0x7fa4b809e000 0x7fa4b81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:26.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.713+0000 7fa4b77fe700 1 --2- 172.21.15.59:0/2058621042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4b809d6f0 0x7fa4b809dac0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8009920 tx=0x7fa4a8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59b255432f2f929e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:26.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.713+0000 7fa4b67fc700 1 -- 172.21.15.59:0/2058621042 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8011830 con 0x7fa4b809d6f0 2023-09-30T22:31:26.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.713+0000 7fa4b67fc700 1 -- 172.21.15.59:0/2058621042 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a8011990 con 0x7fa4b809d6f0 2023-09-30T22:31:26.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.713+0000 7fa4b67fc700 1 -- 172.21.15.59:0/2058621042 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8011d20 con 0x7fa4b809d6f0 2023-09-30T22:31:26.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.714+0000 7fa4bde91700 1 -- 172.21.15.59:0/2058621042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4b809d6f0 msgr2=0x7fa4b809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.714+0000 7fa4bde91700 1 --2- 172.21.15.59:0/2058621042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4b809d6f0 0x7fa4b809dac0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8009920 tx=0x7fa4a8009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:26.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.714+0000 7fa4bde91700 1 -- 172.21.15.59:0/2058621042 shutdown_connections 2023-09-30T22:31:26.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.714+0000 7fa4bde91700 1 --2- 172.21.15.59:0/2058621042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4b809d6f0 0x7fa4b809dac0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.714+0000 7fa4bde91700 1 --2- 172.21.15.59:0/2058621042 >> v2:172.21.15.59:3300/0 conn(0x7fa4b809e000 0x7fa4b81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.714+0000 7fa4bde91700 1 -- 172.21.15.59:0/2058621042 >> 172.21.15.59:0/2058621042 conn(0x7fa4b8066f50 msgr2=0x7fa4b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:26.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.714+0000 7fa4bde91700 1 -- 172.21.15.59:0/2058621042 shutdown_connections 2023-09-30T22:31:26.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.714+0000 7fa4bde91700 1 -- 172.21.15.59:0/2058621042 wait complete. 2023-09-30T22:31:26.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.715+0000 7fa4bde91700 1 Processor -- start 2023-09-30T22:31:26.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.715+0000 7fa4bde91700 1 -- start start 2023-09-30T22:31:26.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.716+0000 7fa4bde91700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4b809d6f0 0x7fa4b81a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.716+0000 7fa4bde91700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4b809e000 0x7fa4b81a6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.716+0000 7fa4bde91700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4b809e410 0x7fa4b81a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:26.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.716+0000 7fa4bde91700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81a7cb0 con 0x7fa4b809e410 2023-09-30T22:31:26.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.716+0000 7fa4bde91700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81a9820 con 0x7fa4b809d6f0 2023-09-30T22:31:26.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.716+0000 7fa4bde91700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80a3380 con 0x7fa4b809e000 2023-09-30T22:31:26.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.716+0000 7fa4b6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4b809e000 0x7fa4b81a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.716+0000 7fa4b77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4b809d6f0 0x7fa4b81a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.716+0000 7fa4b6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4b809e000 0x7fa4b81a6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45646/0 (socket says 172.21.15.59:45646) 2023-09-30T22:31:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.716+0000 7fa4b6ffd700 1 -- 172.21.15.59:0/2543164161 learned_addr learned my addr 172.21.15.59:0/2543164161 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.716+0000 7fa4b7fff700 1 --2- 172.21.15.59:0/2543164161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4b809e410 0x7fa4b81a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.717+0000 7fa4b6ffd700 1 -- 172.21.15.59:0/2543164161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4b809d6f0 msgr2=0x7fa4b81a60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.717+0000 7fa4b6ffd700 1 --2- 172.21.15.59:0/2543164161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4b809d6f0 0x7fa4b81a60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.717+0000 7fa4b6ffd700 1 -- 172.21.15.59:0/2543164161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4b809e410 msgr2=0x7fa4b81a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.717+0000 7fa4b6ffd700 1 --2- 172.21.15.59:0/2543164161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4b809e410 0x7fa4b81a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.717+0000 7fa4b6ffd700 1 -- 172.21.15.59:0/2543164161 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac0094a0 con 0x7fa4b809e000 2023-09-30T22:31:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.717+0000 7fa4b7fff700 1 --2- 172.21.15.59:0/2543164161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4b809e410 0x7fa4b81a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.717+0000 7fa4b77fe700 1 --2- 172.21.15.59:0/2543164161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4b809d6f0 0x7fa4b81a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.717+0000 7fa4b6ffd700 1 --2- 172.21.15.59:0/2543164161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4b809e000 0x7fa4b81a6630 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00ebe0 tx=0x7fa4ac00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.717+0000 7fa49ffff700 1 -- 172.21.15.59:0/2543164161 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac00c850 con 0x7fa4b809e000 2023-09-30T22:31:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.717+0000 7fa49ffff700 1 -- 172.21.15.59:0/2543164161 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac00c9b0 con 0x7fa4b809e000 2023-09-30T22:31:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.717+0000 7fa4bde91700 1 -- 172.21.15.59:0/2543164161 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a8009550 con 0x7fa4b809e000 2023-09-30T22:31:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.717+0000 7fa49ffff700 1 -- 172.21.15.59:0/2543164161 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac00cd40 con 0x7fa4b809e000 2023-09-30T22:31:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.717+0000 7fa4bde91700 1 -- 172.21.15.59:0/2543164161 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b809c760 con 0x7fa4b809e000 2023-09-30T22:31:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.718+0000 7fa49ffff700 1 -- 172.21.15.59:0/2543164161 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4ac013470 con 0x7fa4b809e000 2023-09-30T22:31:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.718+0000 7fa49ffff700 1 -- 172.21.15.59:0/2543164161 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa4ac03fb30 con 0x7fa4b809e000 2023-09-30T22:31:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.718+0000 7fa4bde91700 1 -- 172.21.15.59:0/2543164161 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b8074ea0 con 0x7fa4b809e000 2023-09-30T22:31:26.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.723+0000 7fa49ffff700 1 -- 172.21.15.59:0/2543164161 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4ac013720 con 0x7fa4b809e000 2023-09-30T22:31:26.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.926+0000 7fa4bde91700 1 -- 172.21.15.59:0/2543164161 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa4b81a9bc0 con 0x7fa4b809e000 2023-09-30T22:31:26.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.927+0000 7fa49ffff700 1 -- 172.21.15.59:0/2543164161 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4ac02a090 con 0x7fa4b809e000 2023-09-30T22:31:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:26.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.929+0000 7fa4bde91700 1 -- 172.21.15.59:0/2543164161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4b809e000 msgr2=0x7fa4b81a6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.929+0000 7fa4bde91700 1 --2- 172.21.15.59:0/2543164161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4b809e000 0x7fa4b81a6630 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00ebe0 tx=0x7fa4ac00eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.929+0000 7fa4bde91700 1 -- 172.21.15.59:0/2543164161 shutdown_connections 2023-09-30T22:31:26.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.929+0000 7fa4bde91700 1 --2- 172.21.15.59:0/2543164161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4b809e410 0x7fa4b81a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.929+0000 7fa4bde91700 1 --2- 172.21.15.59:0/2543164161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4b809d6f0 0x7fa4b81a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.929+0000 7fa4bde91700 1 --2- 172.21.15.59:0/2543164161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4b809e000 0x7fa4b81a6630 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.929+0000 7fa4bde91700 1 -- 172.21.15.59:0/2543164161 >> 172.21.15.59:0/2543164161 conn(0x7fa4b8066f50 msgr2=0x7fa4b81baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:26.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.929+0000 7fa4bde91700 1 -- 172.21.15.59:0/2543164161 shutdown_connections 2023-09-30T22:31:26.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:26.929+0000 7fa4bde91700 1 -- 172.21.15.59:0/2543164161 wait complete. 2023-09-30T22:31:26.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:27.542 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:27.581 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:27.623 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:27.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.699+0000 7f78ae31b700 1 Processor -- start 2023-09-30T22:31:27.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.699+0000 7f78ae31b700 1 -- start start 2023-09-30T22:31:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.699+0000 7f78ae31b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78a809e930 0x7f78a809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.699+0000 7f78ae31b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a809f240 0x7f78a81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.699+0000 7f78ae31b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a8070940 con 0x7f78a809f650 2023-09-30T22:31:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.699+0000 7f78ae31b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a806fd60 con 0x7f78a809f240 2023-09-30T22:31:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.699+0000 7f78ae31b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78a806fa80 con 0x7f78a809e930 2023-09-30T22:31:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.700+0000 7f78a7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78a809e930 0x7f78a809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.700+0000 7f78a77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a809f240 0x7f78a81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.700+0000 7f78ac8b8700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f78a809f650 0x7f78a8131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45302/0 (socket says 172.21.15.59:45302) 2023-09-30T22:31:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.700+0000 7f78ac8b8700 1 -- 172.21.15.59:0/3925331890 learned_addr learned my addr 172.21.15.59:0/3925331890 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.700+0000 7f78a77fe700 1 -- 172.21.15.59:0/3925331890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78a809e930 msgr2=0x7f78a809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.700+0000 7f78a77fe700 1 --2- 172.21.15.59:0/3925331890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78a809e930 0x7f78a809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.700+0000 7f78a77fe700 1 -- 172.21.15.59:0/3925331890 >> v1:172.21.15.59:6789/0 conn(0x7f78a809f650 legacy=0x7f78a8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.700+0000 7f78a6ffd700 1 -- 172.21.15.59:0/3925331890 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768463352 0 0) 0x7f78a8070940 con 0x7f78a809f650 2023-09-30T22:31:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.700+0000 7f78a77fe700 1 -- 172.21.15.59:0/3925331890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a809fb60 con 0x7f78a809f240 2023-09-30T22:31:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.700+0000 7f78a7fff700 1 --2- 172.21.15.59:0/3925331890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78a809e930 0x7f78a809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.700+0000 7f78a77fe700 1 --2- 172.21.15.59:0/3925331890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a809f240 0x7f78a81317f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f789c009870 tx=0x7f789c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65c85572efa43ce4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.701+0000 7f78a6ffd700 1 -- 172.21.15.59:0/3925331890 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c011830 con 0x7f78a809f240 2023-09-30T22:31:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.701+0000 7f78a6ffd700 1 -- 172.21.15.59:0/3925331890 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c011990 con 0x7f78a809f240 2023-09-30T22:31:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.701+0000 7f78a6ffd700 1 -- 172.21.15.59:0/3925331890 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c011d20 con 0x7f78a809f240 2023-09-30T22:31:27.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.701+0000 7f78ae31b700 1 -- 172.21.15.59:0/3925331890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a809f240 msgr2=0x7f78a81317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.701+0000 7f78ae31b700 1 --2- 172.21.15.59:0/3925331890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a809f240 0x7f78a81317f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f789c009870 tx=0x7f789c009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:27.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.701+0000 7f78ae31b700 1 -- 172.21.15.59:0/3925331890 shutdown_connections 2023-09-30T22:31:27.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.701+0000 7f78ae31b700 1 --2- 172.21.15.59:0/3925331890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78a809e930 0x7f78a809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.701+0000 7f78ae31b700 1 --2- 172.21.15.59:0/3925331890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a809f240 0x7f78a81317f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.701+0000 7f78ae31b700 1 -- 172.21.15.59:0/3925331890 >> 172.21.15.59:0/3925331890 conn(0x7f78a80a4210 msgr2=0x7f78a80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:27.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.701+0000 7f78ae31b700 1 -- 172.21.15.59:0/3925331890 shutdown_connections 2023-09-30T22:31:27.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.701+0000 7f78ae31b700 1 -- 172.21.15.59:0/3925331890 wait complete. 2023-09-30T22:31:27.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.702+0000 7f78ae31b700 1 Processor -- start 2023-09-30T22:31:27.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.703+0000 7f78ae31b700 1 -- start start 2023-09-30T22:31:27.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.703+0000 7f78ae31b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78a809e930 0x7f78a81a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.703+0000 7f78ae31b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a809f240 0x7f78a81a4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.703+0000 7f78ae31b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a809f650 0x7f78a81a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.703+0000 7f78ae31b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a81a5de0 con 0x7f78a809f650 2023-09-30T22:31:27.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.703+0000 7f78ae31b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a81a76a0 con 0x7f78a809f240 2023-09-30T22:31:27.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.703+0000 7f78ae31b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78a81a6a70 con 0x7f78a809e930 2023-09-30T22:31:27.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.703+0000 7f78a77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a809f240 0x7f78a81a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.703+0000 7f78a77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a809f240 0x7f78a81a4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42214/0 (socket says 172.21.15.59:42214) 2023-09-30T22:31:27.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.703+0000 7f78a77fe700 1 -- 172.21.15.59:0/856040379 learned_addr learned my addr 172.21.15.59:0/856040379 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:27.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.703+0000 7f78a7fff700 1 --2- 172.21.15.59:0/856040379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78a809e930 0x7f78a81a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.703+0000 7f78ac8b8700 1 --2- 172.21.15.59:0/856040379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a809f650 0x7f78a81a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.704+0000 7f78a77fe700 1 -- 172.21.15.59:0/856040379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78a809e930 msgr2=0x7f78a81a3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.704+0000 7f78a77fe700 1 --2- 172.21.15.59:0/856040379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78a809e930 0x7f78a81a3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.704+0000 7f78a77fe700 1 -- 172.21.15.59:0/856040379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a809f650 msgr2=0x7f78a81a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.704+0000 7f78a77fe700 1 --2- 172.21.15.59:0/856040379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a809f650 0x7f78a81a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.704+0000 7f78a77fe700 1 -- 172.21.15.59:0/856040379 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78980094a0 con 0x7f78a809f240 2023-09-30T22:31:27.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.704+0000 7f78a77fe700 1 --2- 172.21.15.59:0/856040379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a809f240 0x7f78a81a4160 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f789c013000 tx=0x7f789c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:27.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.704+0000 7f78a4ff9700 1 -- 172.21.15.59:0/856040379 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c004510 con 0x7f78a809f240 2023-09-30T22:31:27.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.704+0000 7f78a4ff9700 1 -- 172.21.15.59:0/856040379 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c01f070 con 0x7f78a809f240 2023-09-30T22:31:27.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.704+0000 7f78a4ff9700 1 -- 172.21.15.59:0/856040379 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c0038c0 con 0x7f78a809f240 2023-09-30T22:31:27.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.704+0000 7f78ae31b700 1 -- 172.21.15.59:0/856040379 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f789c0094a0 con 0x7f78a809f240 2023-09-30T22:31:27.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.704+0000 7f78ae31b700 1 -- 172.21.15.59:0/856040379 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a80a0190 con 0x7f78a809f240 2023-09-30T22:31:27.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.705+0000 7f78a4ff9700 1 -- 172.21.15.59:0/856040379 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f789c003a20 con 0x7f78a809f240 2023-09-30T22:31:27.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.705+0000 7f78a4ff9700 1 -- 172.21.15.59:0/856040379 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f789c021070 con 0x7f78a809f240 2023-09-30T22:31:27.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.706+0000 7f78ae31b700 1 -- 172.21.15.59:0/856040379 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a81a7060 con 0x7f78a809f240 2023-09-30T22:31:27.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.715+0000 7f78a4ff9700 1 -- 172.21.15.59:0/856040379 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78a81a7060 con 0x7f78a809f240 2023-09-30T22:31:27.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.729+0000 7f6ae3747700 1 Processor -- start 2023-09-30T22:31:27.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.730+0000 7f6ae3747700 1 -- start start 2023-09-30T22:31:27.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.731+0000 7f6ae3747700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6adc09e930 0x7f6adc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.731+0000 7f6ae3747700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc09f650 0x7f6adc131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.731+0000 7f6ae3747700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc070940 con 0x7f6adc09f240 2023-09-30T22:31:27.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.731+0000 7f6ae3747700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc06fd60 con 0x7f6adc09f650 2023-09-30T22:31:27.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.731+0000 7f6ae3747700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc06fa80 con 0x7f6adc09e930 2023-09-30T22:31:27.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.731+0000 7f6ae0ce2700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6adc09f240 0x7f6adc1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45306/0 (socket says 172.21.15.59:45306) 2023-09-30T22:31:27.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.731+0000 7f6ae1ce4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc09f650 0x7f6adc131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.731+0000 7f6ae0ce2700 1 -- 172.21.15.59:0/3056961904 learned_addr learned my addr 172.21.15.59:0/3056961904 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:27.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.731+0000 7f6ae14e3700 1 --2- 172.21.15.59:0/3056961904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6adc09e930 0x7f6adc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.731+0000 7f6ad3fff700 1 -- 172.21.15.59:0/3056961904 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059417655 0 0) 0x7f6adc070940 con 0x7f6adc09f240 2023-09-30T22:31:27.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.731+0000 7f6ae1ce4700 1 -- 172.21.15.59:0/3056961904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6adc09e930 msgr2=0x7f6adc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:27.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.731+0000 7f6ae1ce4700 1 --2- 172.21.15.59:0/3056961904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6adc09e930 0x7f6adc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.731+0000 7f6ae1ce4700 1 -- 172.21.15.59:0/3056961904 >> v1:172.21.15.59:6789/0 conn(0x7f6adc09f240 legacy=0x7f6adc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.731+0000 7f6ae1ce4700 1 -- 172.21.15.59:0/3056961904 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc09fb60 con 0x7f6adc09f650 2023-09-30T22:31:27.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.731+0000 7f6ae14e3700 1 --2- 172.21.15.59:0/3056961904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6adc09e930 0x7f6adc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:27.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.732+0000 7f6ae1ce4700 1 --2- 172.21.15.59:0/3056961904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc09f650 0x7f6adc131f00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009dc0 tx=0x7f6ad400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af5e63747e301e40 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:27.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.732+0000 7f6ad3fff700 1 -- 172.21.15.59:0/3056961904 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400e070 con 0x7f6adc09f650 2023-09-30T22:31:27.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.732+0000 7f6ad3fff700 1 -- 172.21.15.59:0/3056961904 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad400bb20 con 0x7f6adc09f650 2023-09-30T22:31:27.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.732+0000 7f6ad3fff700 1 -- 172.21.15.59:0/3056961904 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4012430 con 0x7f6adc09f650 2023-09-30T22:31:27.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.733+0000 7f6ae3747700 1 -- 172.21.15.59:0/3056961904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc09f650 msgr2=0x7f6adc131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.733+0000 7f6ae3747700 1 --2- 172.21.15.59:0/3056961904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc09f650 0x7f6adc131f00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009dc0 tx=0x7f6ad400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:27.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.733+0000 7f6ae3747700 1 -- 172.21.15.59:0/3056961904 shutdown_connections 2023-09-30T22:31:27.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.733+0000 7f6ae3747700 1 --2- 172.21.15.59:0/3056961904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6adc09e930 0x7f6adc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.733+0000 7f6ae3747700 1 --2- 172.21.15.59:0/3056961904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc09f650 0x7f6adc131f00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.733+0000 7f6ae3747700 1 -- 172.21.15.59:0/3056961904 >> 172.21.15.59:0/3056961904 conn(0x7f6adc0a4210 msgr2=0x7f6adc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:27.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.733+0000 7f6ae3747700 1 -- 172.21.15.59:0/3056961904 shutdown_connections 2023-09-30T22:31:27.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.733+0000 7f6ae3747700 1 -- 172.21.15.59:0/3056961904 wait complete. 2023-09-30T22:31:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.735+0000 7f6ae3747700 1 Processor -- start 2023-09-30T22:31:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.735+0000 7f6ae3747700 1 -- start start 2023-09-30T22:31:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.735+0000 7f6ae3747700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6adc09e930 0x7f6adc1c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.735+0000 7f6ae3747700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc09f240 0x7f6adc1c3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.735+0000 7f6ae3747700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6adc09f650 0x7f6adc1c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.735+0000 7f6ae3747700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc1a6e40 con 0x7f6adc09f650 2023-09-30T22:31:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.735+0000 7f6ae3747700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc1c3880 con 0x7f6adc09f240 2023-09-30T22:31:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.735+0000 7f6ae3747700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc1a56c0 con 0x7f6adc09e930 2023-09-30T22:31:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.735+0000 7f6ae14e3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6adc09e930 0x7f6adc1c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ae0ce2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc09f240 0x7f6adc1c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ae14e3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6adc09e930 0x7f6adc1c2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45666/0 (socket says 172.21.15.59:45666) 2023-09-30T22:31:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ae0ce2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc09f240 0x7f6adc1c3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42244/0 (socket says 172.21.15.59:42244) 2023-09-30T22:31:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ae14e3700 1 -- 172.21.15.59:0/2358374474 learned_addr learned my addr 172.21.15.59:0/2358374474 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ae1ce4700 1 --2- 172.21.15.59:0/2358374474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6adc09f650 0x7f6adc1c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ae14e3700 1 -- 172.21.15.59:0/2358374474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc09f240 msgr2=0x7f6adc1c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ae14e3700 1 --2- 172.21.15.59:0/2358374474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc09f240 0x7f6adc1c3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ae14e3700 1 -- 172.21.15.59:0/2358374474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6adc09f650 msgr2=0x7f6adc1c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ae14e3700 1 --2- 172.21.15.59:0/2358374474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6adc09f650 0x7f6adc1c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ae14e3700 1 -- 172.21.15.59:0/2358374474 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad80094a0 con 0x7f6adc09e930 2023-09-30T22:31:27.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ae1ce4700 1 --2- 172.21.15.59:0/2358374474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6adc09f650 0x7f6adc1c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:27.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ae0ce2700 1 --2- 172.21.15.59:0/2358374474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc09f240 0x7f6adc1c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:27.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ae14e3700 1 --2- 172.21.15.59:0/2358374474 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6adc09e930 0x7f6adc1c2e00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800ec10 tx=0x7f6ad800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:27.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ad1ffb700 1 -- 172.21.15.59:0/2358374474 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad800c850 con 0x7f6adc09e930 2023-09-30T22:31:27.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ad1ffb700 1 -- 172.21.15.59:0/2358374474 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad800c9b0 con 0x7f6adc09e930 2023-09-30T22:31:27.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ae3747700 1 -- 172.21.15.59:0/2358374474 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad4009a70 con 0x7f6adc09e930 2023-09-30T22:31:27.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.736+0000 7f6ad1ffb700 1 -- 172.21.15.59:0/2358374474 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad800cd20 con 0x7f6adc09e930 2023-09-30T22:31:27.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.737+0000 7f6ae3747700 1 -- 172.21.15.59:0/2358374474 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc0a0190 con 0x7f6adc09e930 2023-09-30T22:31:27.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.738+0000 7f6ad1ffb700 1 -- 172.21.15.59:0/2358374474 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ad8013470 con 0x7f6adc09e930 2023-09-30T22:31:27.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.738+0000 7f6ae3747700 1 -- 172.21.15.59:0/2358374474 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6adc071d80 con 0x7f6adc09e930 2023-09-30T22:31:27.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.738+0000 7f6ad1ffb700 1 -- 172.21.15.59:0/2358374474 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6ad803f7a0 con 0x7f6adc09e930 2023-09-30T22:31:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.743+0000 7f6ad1ffb700 1 -- 172.21.15.59:0/2358374474 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ad8013720 con 0x7f6adc09e930 2023-09-30T22:31:27.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.786+0000 7f2f8fe69700 1 Processor -- start 2023-09-30T22:31:27.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.786+0000 7f2f8fe69700 1 -- start start 2023-09-30T22:31:27.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.786+0000 7f2f8fe69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f880a0090 0x7f2f88136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.786+0000 7f2f8fe69700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f8809d130 0x7f2f88139170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.786+0000 7f2f8fe69700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8809ba70 con 0x7f2f8809c650 2023-09-30T22:31:27.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.786+0000 7f2f8fe69700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8809e8f0 con 0x7f2f8809d130 2023-09-30T22:31:27.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.786+0000 7f2f8fe69700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880a0760 con 0x7f2f880a0090 2023-09-30T22:31:27.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.787+0000 7f2f8e406700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f8809d130 0x7f2f88139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.787+0000 7f2f8e406700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f8809d130 0x7f2f88139170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36568/0 (socket says 172.21.15.59:36568) 2023-09-30T22:31:27.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.787+0000 7f2f8e406700 1 -- 172.21.15.59:0/1515572303 learned_addr learned my addr 172.21.15.59:0/1515572303 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:27.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.787+0000 7f2f8d404700 1 --2- 172.21.15.59:0/1515572303 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f880a0090 0x7f2f88136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.787+0000 7f2f8e406700 1 -- 172.21.15.59:0/1515572303 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f880a0090 msgr2=0x7f2f88136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:27.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.787+0000 7f2f8e406700 1 --2- 172.21.15.59:0/1515572303 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f880a0090 0x7f2f88136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.787+0000 7f2f8e406700 1 -- 172.21.15.59:0/1515572303 >> v1:172.21.15.59:6789/0 conn(0x7f2f8809c650 legacy=0x7f2f8809ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.787+0000 7f2f8cc03700 1 -- 172.21.15.59:0/1515572303 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227210823 0 0) 0x7f2f8809ba70 con 0x7f2f8809c650 2023-09-30T22:31:27.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.787+0000 7f2f8e406700 1 -- 172.21.15.59:0/1515572303 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8809a080 con 0x7f2f8809d130 2023-09-30T22:31:27.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.787+0000 7f2f8e406700 1 --2- 172.21.15.59:0/1515572303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f8809d130 0x7f2f88139170 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009e50 tx=0x7f2f8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63118bca9dd5a3e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:27.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.787+0000 7f2f8cc03700 1 -- 172.21.15.59:0/1515572303 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000e070 con 0x7f2f8809d130 2023-09-30T22:31:27.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.787+0000 7f2f8cc03700 1 -- 172.21.15.59:0/1515572303 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8000b910 con 0x7f2f8809d130 2023-09-30T22:31:27.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.788+0000 7f2f8cc03700 1 -- 172.21.15.59:0/1515572303 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000bcc0 con 0x7f2f8809d130 2023-09-30T22:31:27.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.788+0000 7f2f8fe69700 1 -- 172.21.15.59:0/1515572303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f8809d130 msgr2=0x7f2f88139170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.788+0000 7f2f8fe69700 1 --2- 172.21.15.59:0/1515572303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f8809d130 0x7f2f88139170 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009e50 tx=0x7f2f8000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:27.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.788+0000 7f2f8fe69700 1 -- 172.21.15.59:0/1515572303 shutdown_connections 2023-09-30T22:31:27.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.788+0000 7f2f8fe69700 1 --2- 172.21.15.59:0/1515572303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f8809d130 0x7f2f88139170 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.788+0000 7f2f8fe69700 1 --2- 172.21.15.59:0/1515572303 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f880a0090 0x7f2f88136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.788+0000 7f2f8fe69700 1 -- 172.21.15.59:0/1515572303 >> 172.21.15.59:0/1515572303 conn(0x7f2f880a3f70 msgr2=0x7f2f880a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:27.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.788+0000 7f2f8fe69700 1 -- 172.21.15.59:0/1515572303 shutdown_connections 2023-09-30T22:31:27.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.788+0000 7f2f8fe69700 1 -- 172.21.15.59:0/1515572303 wait complete. 2023-09-30T22:31:27.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.790+0000 7f2f8fe69700 1 Processor -- start 2023-09-30T22:31:27.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.790+0000 7f2f8fe69700 1 -- start start 2023-09-30T22:31:27.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8fe69700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f8809c650 0x7f2f88135140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8fe69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8809d130 0x7f2f88135680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8fe69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f880a0090 0x7f2f88135bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8fe69700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f88136d50 con 0x7f2f8809c650 2023-09-30T22:31:27.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8fe69700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8811a7f0 con 0x7f2f8809d130 2023-09-30T22:31:27.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8fe69700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8809d9f0 con 0x7f2f880a0090 2023-09-30T22:31:27.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8d404700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8809d130 0x7f2f88135680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8d404700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8809d130 0x7f2f88135680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42256/0 (socket says 172.21.15.59:42256) 2023-09-30T22:31:27.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8d404700 1 -- 172.21.15.59:0/628987802 learned_addr learned my addr 172.21.15.59:0/628987802 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:27.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8e406700 1 --2- 172.21.15.59:0/628987802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f880a0090 0x7f2f88135bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8dc05700 1 --2- 172.21.15.59:0/628987802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f8809c650 0x7f2f88135140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8d404700 1 -- 172.21.15.59:0/628987802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f880a0090 msgr2=0x7f2f88135bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8d404700 1 --2- 172.21.15.59:0/628987802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f880a0090 0x7f2f88135bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8d404700 1 -- 172.21.15.59:0/628987802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f8809c650 msgr2=0x7f2f88135140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8d404700 1 --2- 172.21.15.59:0/628987802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f8809c650 0x7f2f88135140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8d404700 1 -- 172.21.15.59:0/628987802 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f80009b30 con 0x7f2f8809d130 2023-09-30T22:31:27.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.791+0000 7f2f8d404700 1 --2- 172.21.15.59:0/628987802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8809d130 0x7f2f88135680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800e9e0 tx=0x7f2f7800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:27.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.792+0000 7f2f7e7fc700 1 -- 172.21.15.59:0/628987802 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78009710 con 0x7f2f8809d130 2023-09-30T22:31:27.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.792+0000 7f2f7e7fc700 1 -- 172.21.15.59:0/628987802 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7800ee80 con 0x7f2f8809d130 2023-09-30T22:31:27.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.792+0000 7f2f8fe69700 1 -- 172.21.15.59:0/628987802 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f88137330 con 0x7f2f8809d130 2023-09-30T22:31:27.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.792+0000 7f2f7e7fc700 1 -- 172.21.15.59:0/628987802 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800c9f0 con 0x7f2f8809d130 2023-09-30T22:31:27.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.792+0000 7f2f8fe69700 1 -- 172.21.15.59:0/628987802 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f88137540 con 0x7f2f8809d130 2023-09-30T22:31:27.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.793+0000 7f2f7e7fc700 1 -- 172.21.15.59:0/628987802 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f7800cb50 con 0x7f2f8809d130 2023-09-30T22:31:27.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.793+0000 7f2f7e7fc700 1 -- 172.21.15.59:0/628987802 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2f7803f850 con 0x7f2f8809d130 2023-09-30T22:31:27.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.793+0000 7f2f8fe69700 1 -- 172.21.15.59:0/628987802 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f880747f0 con 0x7f2f8809d130 2023-09-30T22:31:27.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.798+0000 7f2f7e7fc700 1 -- 172.21.15.59:0/628987802 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f780232f0 con 0x7f2f8809d130 2023-09-30T22:31:27.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.926+0000 7f78ae31b700 1 -- 172.21.15.59:0/856040379 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f78a81a7060 con 0x7f78a809f240 2023-09-30T22:31:27.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.927+0000 7f78a4ff9700 1 -- 172.21.15.59:0/856040379 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78a81a7060 con 0x7f78a809f240 2023-09-30T22:31:27.928 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:27.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.929+0000 7f78ae31b700 1 -- 172.21.15.59:0/856040379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a809f240 msgr2=0x7f78a81a4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.929+0000 7f78ae31b700 1 --2- 172.21.15.59:0/856040379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a809f240 0x7f78a81a4160 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f789c013000 tx=0x7f789c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:27.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.929+0000 7f78ae31b700 1 -- 172.21.15.59:0/856040379 shutdown_connections 2023-09-30T22:31:27.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.929+0000 7f78ae31b700 1 --2- 172.21.15.59:0/856040379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78a809e930 0x7f78a81a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.929+0000 7f78ae31b700 1 --2- 172.21.15.59:0/856040379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a809f650 0x7f78a81a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.929+0000 7f78ae31b700 1 --2- 172.21.15.59:0/856040379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a809f240 0x7f78a81a4160 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.929+0000 7f78ae31b700 1 -- 172.21.15.59:0/856040379 >> 172.21.15.59:0/856040379 conn(0x7f78a80a4210 msgr2=0x7f78a81b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:27.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.929+0000 7f78ae31b700 1 -- 172.21.15.59:0/856040379 shutdown_connections 2023-09-30T22:31:27.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.929+0000 7f78ae31b700 1 -- 172.21.15.59:0/856040379 wait complete. 2023-09-30T22:31:27.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:27.945 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:27.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.951+0000 7f6ae3747700 1 -- 172.21.15.59:0/2358374474 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6adc09ffe0 con 0x7f6adc09e930 2023-09-30T22:31:27.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.952+0000 7f6ad1ffb700 1 -- 172.21.15.59:0/2358374474 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ad8021070 con 0x7f6adc09e930 2023-09-30T22:31:27.953 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:27.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.954+0000 7f6ae3747700 1 -- 172.21.15.59:0/2358374474 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6adc09e930 msgr2=0x7f6adc1c2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.954+0000 7f6ae3747700 1 --2- 172.21.15.59:0/2358374474 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6adc09e930 0x7f6adc1c2e00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800ec10 tx=0x7f6ad800ef20 comp rx=0 tx=0).stop 2023-09-30T22:31:27.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.954+0000 7f6ae3747700 1 -- 172.21.15.59:0/2358374474 shutdown_connections 2023-09-30T22:31:27.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.954+0000 7f6ae3747700 1 --2- 172.21.15.59:0/2358374474 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6adc09e930 0x7f6adc1c2e00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.954+0000 7f6ae3747700 1 --2- 172.21.15.59:0/2358374474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6adc09f650 0x7f6adc1c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.954+0000 7f6ae3747700 1 --2- 172.21.15.59:0/2358374474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc09f240 0x7f6adc1c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.954+0000 7f6ae3747700 1 -- 172.21.15.59:0/2358374474 >> 172.21.15.59:0/2358374474 conn(0x7f6adc0a4210 msgr2=0x7f6adc1b89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:27.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.954+0000 7f6ae3747700 1 -- 172.21.15.59:0/2358374474 shutdown_connections 2023-09-30T22:31:27.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:27.954+0000 7f6ae3747700 1 -- 172.21.15.59:0/2358374474 wait complete. 2023-09-30T22:31:27.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:28.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.004+0000 7f2f8fe69700 1 -- 172.21.15.59:0/628987802 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2f88072840 con 0x7f2f8809d130 2023-09-30T22:31:28.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.005+0000 7f2f7e7fc700 1 -- 172.21.15.59:0/628987802 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f7801ae80 con 0x7f2f8809d130 2023-09-30T22:31:28.006 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.007+0000 7f2f8fe69700 1 -- 172.21.15.59:0/628987802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8809d130 msgr2=0x7f2f88135680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.007+0000 7f2f8fe69700 1 --2- 172.21.15.59:0/628987802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8809d130 0x7f2f88135680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800e9e0 tx=0x7f2f7800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.007+0000 7f2f8fe69700 1 -- 172.21.15.59:0/628987802 shutdown_connections 2023-09-30T22:31:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.007+0000 7f2f8fe69700 1 --2- 172.21.15.59:0/628987802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f880a0090 0x7f2f88135bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.007+0000 7f2f8fe69700 1 --2- 172.21.15.59:0/628987802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f8809c650 0x7f2f88135140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.007+0000 7f2f8fe69700 1 --2- 172.21.15.59:0/628987802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8809d130 0x7f2f88135680 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.007+0000 7f2f8fe69700 1 -- 172.21.15.59:0/628987802 >> 172.21.15.59:0/628987802 conn(0x7f2f880a3f70 msgr2=0x7f2f88138ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.007+0000 7f2f8fe69700 1 -- 172.21.15.59:0/628987802 shutdown_connections 2023-09-30T22:31:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.007+0000 7f2f8fe69700 1 -- 172.21.15.59:0/628987802 wait complete. 2023-09-30T22:31:28.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:28.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.082+0000 7fc36a078700 1 Processor -- start 2023-09-30T22:31:28.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.082+0000 7fc36a078700 1 -- start start 2023-09-30T22:31:28.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.083+0000 7fc36a078700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc36409e1d0 0x7fc364138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.083+0000 7fc36a078700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc364139170 0x7fc36413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.083+0000 7fc36a078700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36409b120 con 0x7fc36409d6f0 2023-09-30T22:31:28.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.083+0000 7fc36a078700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36406b460 con 0x7fc364139170 2023-09-30T22:31:28.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.083+0000 7fc36a078700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc36409a7e0 con 0x7fc36409e1d0 2023-09-30T22:31:28.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.083+0000 7fc363fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc364139170 0x7fc36413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.083+0000 7fc362ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc36409e1d0 0x7fc364138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.083+0000 7fc363fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc364139170 0x7fc36413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42272/0 (socket says 172.21.15.59:42272) 2023-09-30T22:31:28.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.083+0000 7fc363fff700 1 -- 172.21.15.59:0/2533212571 learned_addr learned my addr 172.21.15.59:0/2533212571 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:28.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.083+0000 7fc3637fe700 1 --1- 172.21.15.59:0/2533212571 >> v1:172.21.15.59:6789/0 conn(0x7fc36409d6f0 0x7fc36409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45324/0 (socket says 172.21.15.59:45324) 2023-09-30T22:31:28.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.084+0000 7fc363fff700 1 -- 172.21.15.59:0/2533212571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc36409e1d0 msgr2=0x7fc364138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:28.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.084+0000 7fc363fff700 1 --2- 172.21.15.59:0/2533212571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc36409e1d0 0x7fc364138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.084+0000 7fc363fff700 1 -- 172.21.15.59:0/2533212571 >> v1:172.21.15.59:6789/0 conn(0x7fc36409d6f0 legacy=0x7fc36409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.084+0000 7fc363fff700 1 -- 172.21.15.59:0/2533212571 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36409a500 con 0x7fc364139170 2023-09-30T22:31:28.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.084+0000 7fc3627fc700 1 -- 172.21.15.59:0/2533212571 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175165009 0 0) 0x7fc36409b120 con 0x7fc36409d6f0 2023-09-30T22:31:28.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.084+0000 7fc362ffd700 1 --2- 172.21.15.59:0/2533212571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc36409e1d0 0x7fc364138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:28.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.084+0000 7fc363fff700 1 --2- 172.21.15.59:0/2533212571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc364139170 0x7fc36413b550 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc35c009e80 tx=0x7fc35c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2ff64d44e6f5c42 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:28.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.084+0000 7fc3627fc700 1 -- 172.21.15.59:0/2533212571 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c00e070 con 0x7fc364139170 2023-09-30T22:31:28.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.084+0000 7fc3627fc700 1 -- 172.21.15.59:0/2533212571 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c00b910 con 0x7fc364139170 2023-09-30T22:31:28.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.084+0000 7fc3627fc700 1 -- 172.21.15.59:0/2533212571 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c00bcc0 con 0x7fc364139170 2023-09-30T22:31:28.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.084+0000 7fc36a078700 1 -- 172.21.15.59:0/2533212571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc364139170 msgr2=0x7fc36413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.084+0000 7fc36a078700 1 --2- 172.21.15.59:0/2533212571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc364139170 0x7fc36413b550 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc35c009e80 tx=0x7fc35c00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:28.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.085+0000 7fc36a078700 1 -- 172.21.15.59:0/2533212571 shutdown_connections 2023-09-30T22:31:28.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.085+0000 7fc36a078700 1 --2- 172.21.15.59:0/2533212571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc364139170 0x7fc36413b550 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.085+0000 7fc36a078700 1 --2- 172.21.15.59:0/2533212571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc36409e1d0 0x7fc364138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.085+0000 7fc36a078700 1 -- 172.21.15.59:0/2533212571 >> 172.21.15.59:0/2533212571 conn(0x7fc364066f50 msgr2=0x7fc36409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:28.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.085+0000 7fc36a078700 1 -- 172.21.15.59:0/2533212571 shutdown_connections 2023-09-30T22:31:28.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.085+0000 7fc36a078700 1 -- 172.21.15.59:0/2533212571 wait complete. 2023-09-30T22:31:28.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.085+0000 7fc36a078700 1 Processor -- start 2023-09-30T22:31:28.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.086+0000 7fc36a078700 1 -- start start 2023-09-30T22:31:28.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.086+0000 7fc36a078700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc36409d6f0 0x7fc3641205f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.086+0000 7fc36a078700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc36409e1d0 0x7fc364120b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.086+0000 7fc36a078700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc364139170 0x7fc364121070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.086+0000 7fc36a078700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc364123f30 con 0x7fc364139170 2023-09-30T22:31:28.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.086+0000 7fc36a078700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc364124110 con 0x7fc36409d6f0 2023-09-30T22:31:28.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.086+0000 7fc36a078700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3641230a0 con 0x7fc36409e1d0 2023-09-30T22:31:28.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.086+0000 7fc363fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc364139170 0x7fc364121070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.086+0000 7fc3637fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc36409d6f0 0x7fc3641205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.086+0000 7fc3637fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc36409d6f0 0x7fc3641205f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42274/0 (socket says 172.21.15.59:42274) 2023-09-30T22:31:28.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.086+0000 7fc363fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc364139170 0x7fc364121070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36578/0 (socket says 172.21.15.59:36578) 2023-09-30T22:31:28.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.086+0000 7fc3637fe700 1 -- 172.21.15.59:0/3943299096 learned_addr learned my addr 172.21.15.59:0/3943299096 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:28.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.086+0000 7fc362ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc36409e1d0 0x7fc364120b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.087+0000 7fc3637fe700 1 -- 172.21.15.59:0/3943299096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc36409e1d0 msgr2=0x7fc364120b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.087+0000 7fc3637fe700 1 --2- 172.21.15.59:0/3943299096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc36409e1d0 0x7fc364120b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.087+0000 7fc3637fe700 1 -- 172.21.15.59:0/3943299096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc364139170 msgr2=0x7fc364121070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.087+0000 7fc3637fe700 1 --2- 172.21.15.59:0/3943299096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc364139170 0x7fc364121070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.087+0000 7fc3637fe700 1 -- 172.21.15.59:0/3943299096 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c0094a0 con 0x7fc36409d6f0 2023-09-30T22:31:28.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.087+0000 7fc3637fe700 1 --2- 172.21.15.59:0/3943299096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc36409d6f0 0x7fc3641205f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc35400c520 tx=0x7fc35400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:28.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.087+0000 7fc35bfff700 1 -- 172.21.15.59:0/3943299096 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354004c80 con 0x7fc36409d6f0 2023-09-30T22:31:28.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.087+0000 7fc35bfff700 1 -- 172.21.15.59:0/3943299096 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc354004e00 con 0x7fc36409d6f0 2023-09-30T22:31:28.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.087+0000 7fc36a078700 1 -- 172.21.15.59:0/3943299096 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c009b30 con 0x7fc36409d6f0 2023-09-30T22:31:28.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.087+0000 7fc35bfff700 1 -- 172.21.15.59:0/3943299096 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354007310 con 0x7fc36409d6f0 2023-09-30T22:31:28.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.087+0000 7fc36a078700 1 -- 172.21.15.59:0/3943299096 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc364136820 con 0x7fc36409d6f0 2023-09-30T22:31:28.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.088+0000 7fc35bfff700 1 -- 172.21.15.59:0/3943299096 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc354007470 con 0x7fc36409d6f0 2023-09-30T22:31:28.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.088+0000 7fc35bfff700 1 -- 172.21.15.59:0/3943299096 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc35403f2e0 con 0x7fc36409d6f0 2023-09-30T22:31:28.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.088+0000 7fc36a078700 1 -- 172.21.15.59:0/3943299096 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc364074ea0 con 0x7fc36409d6f0 2023-09-30T22:31:28.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.093+0000 7fc35bfff700 1 -- 172.21.15.59:0/3943299096 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3540123b0 con 0x7fc36409d6f0 2023-09-30T22:31:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.298+0000 7fc36a078700 1 -- 172.21.15.59:0/3943299096 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc36406c360 con 0x7fc36409d6f0 2023-09-30T22:31:28.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.298+0000 7fc35bfff700 1 -- 172.21.15.59:0/3943299096 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc354011360 con 0x7fc36409d6f0 2023-09-30T22:31:28.299 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:28.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.300+0000 7fc36a078700 1 -- 172.21.15.59:0/3943299096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc36409d6f0 msgr2=0x7fc3641205f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.300+0000 7fc36a078700 1 --2- 172.21.15.59:0/3943299096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc36409d6f0 0x7fc3641205f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc35400c520 tx=0x7fc35400c830 comp rx=0 tx=0).stop 2023-09-30T22:31:28.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.300+0000 7fc36a078700 1 -- 172.21.15.59:0/3943299096 shutdown_connections 2023-09-30T22:31:28.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.300+0000 7fc36a078700 1 --2- 172.21.15.59:0/3943299096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc364139170 0x7fc364121070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.300+0000 7fc36a078700 1 --2- 172.21.15.59:0/3943299096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc36409d6f0 0x7fc3641205f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.300+0000 7fc36a078700 1 --2- 172.21.15.59:0/3943299096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc36409e1d0 0x7fc364120b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.300+0000 7fc36a078700 1 -- 172.21.15.59:0/3943299096 >> 172.21.15.59:0/3943299096 conn(0x7fc364066f50 msgr2=0x7fc364070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:28.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.300+0000 7fc36a078700 1 -- 172.21.15.59:0/3943299096 shutdown_connections 2023-09-30T22:31:28.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:28.300+0000 7fc36a078700 1 -- 172.21.15.59:0/3943299096 wait complete. 2023-09-30T22:31:28.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:28.945 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:28.970 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:29.023 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:29.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.094+0000 7fdcbcae2700 1 Processor -- start 2023-09-30T22:31:29.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.094+0000 7fdcbcae2700 1 -- start start 2023-09-30T22:31:29.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.095+0000 7fdcbcae2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdcb8133420 0x7fdcb81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.095+0000 7fdcbcae2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcb8133e30 0x7fdcb812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.095+0000 7fdcbcae2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb806b990 con 0x7fdcb8134260 2023-09-30T22:31:29.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.095+0000 7fdcbcae2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb80a0590 con 0x7fdcb8133420 2023-09-30T22:31:29.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.095+0000 7fdcbcae2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb809fb80 con 0x7fdcb8133e30 2023-09-30T22:31:29.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.095+0000 7fdcb659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdcb8133420 0x7fdcb81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.095+0000 7fdcb659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdcb8133420 0x7fdcb81337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36592/0 (socket says 172.21.15.59:36592) 2023-09-30T22:31:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.095+0000 7fdcb659c700 1 -- 172.21.15.59:0/1695116909 learned_addr learned my addr 172.21.15.59:0/1695116909 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.095+0000 7fdcb5d9b700 1 --2- 172.21.15.59:0/1695116909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcb8133e30 0x7fdcb812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.096+0000 7fdcb659c700 1 -- 172.21.15.59:0/1695116909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcb8133e30 msgr2=0x7fdcb812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.096+0000 7fdcb659c700 1 --2- 172.21.15.59:0/1695116909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcb8133e30 0x7fdcb812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.096+0000 7fdcb659c700 1 -- 172.21.15.59:0/1695116909 >> v1:172.21.15.59:6789/0 conn(0x7fdcb8134260 legacy=0x7fdcb81304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.096+0000 7fdcb659c700 1 -- 172.21.15.59:0/1695116909 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb80a0030 con 0x7fdcb8133420 2023-09-30T22:31:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.096+0000 7fdcb659c700 1 --2- 172.21.15.59:0/1695116909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb8133420 0x7fdcb81337f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fdca8009e50 tx=0x7fdca800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3736bcd2fa41e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.096+0000 7fdcb559a700 1 -- 172.21.15.59:0/1695116909 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca800e070 con 0x7fdcb8133420 2023-09-30T22:31:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.096+0000 7fdcb559a700 1 -- 172.21.15.59:0/1695116909 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca800b910 con 0x7fdcb8133420 2023-09-30T22:31:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.096+0000 7fdcb559a700 1 -- 172.21.15.59:0/1695116909 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca800bcc0 con 0x7fdcb8133420 2023-09-30T22:31:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.097+0000 7fdcbcae2700 1 -- 172.21.15.59:0/1695116909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb8133420 msgr2=0x7fdcb81337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.097+0000 7fdcbcae2700 1 --2- 172.21.15.59:0/1695116909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb8133420 0x7fdcb81337f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fdca8009e50 tx=0x7fdca800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.097+0000 7fdcbcae2700 1 -- 172.21.15.59:0/1695116909 shutdown_connections 2023-09-30T22:31:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.097+0000 7fdcbcae2700 1 --2- 172.21.15.59:0/1695116909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb8133420 0x7fdcb81337f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.097+0000 7fdcbcae2700 1 --2- 172.21.15.59:0/1695116909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcb8133e30 0x7fdcb812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.097+0000 7fdcbcae2700 1 -- 172.21.15.59:0/1695116909 >> 172.21.15.59:0/1695116909 conn(0x7fdcb80a4210 msgr2=0x7fdcb80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.097+0000 7fdcbcae2700 1 -- 172.21.15.59:0/1695116909 shutdown_connections 2023-09-30T22:31:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.097+0000 7fdcbcae2700 1 -- 172.21.15.59:0/1695116909 wait complete. 2023-09-30T22:31:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.098+0000 7fdcbcae2700 1 Processor -- start 2023-09-30T22:31:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.098+0000 7fdcbcae2700 1 -- start start 2023-09-30T22:31:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcbcae2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb8133420 0x7fdcb809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcbcae2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcb8133e30 0x7fdcb809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcbcae2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcb8134260 0x7fdcb809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcbcae2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8131720 con 0x7fdcb8133420 2023-09-30T22:31:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcbcae2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb811fd60 con 0x7fdcb8133e30 2023-09-30T22:31:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcbcae2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb812d730 con 0x7fdcb8134260 2023-09-30T22:31:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcb5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcb8133e30 0x7fdcb809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcb5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcb8133e30 0x7fdcb809c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42302/0 (socket says 172.21.15.59:42302) 2023-09-30T22:31:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcb5d9b700 1 -- 172.21.15.59:0/1394923542 learned_addr learned my addr 172.21.15.59:0/1394923542 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcb6d9d700 1 --2- 172.21.15.59:0/1394923542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcb8134260 0x7fdcb809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcb659c700 1 --2- 172.21.15.59:0/1394923542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb8133420 0x7fdcb809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcb5d9b700 1 -- 172.21.15.59:0/1394923542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcb8134260 msgr2=0x7fdcb809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcb5d9b700 1 --2- 172.21.15.59:0/1394923542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcb8134260 0x7fdcb809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcb5d9b700 1 -- 172.21.15.59:0/1394923542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb8133420 msgr2=0x7fdcb809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcb5d9b700 1 --2- 172.21.15.59:0/1394923542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb8133420 0x7fdcb809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.099+0000 7fdcb5d9b700 1 -- 172.21.15.59:0/1394923542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca8009b30 con 0x7fdcb8133e30 2023-09-30T22:31:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.100+0000 7fdcb5d9b700 1 --2- 172.21.15.59:0/1394923542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcb8133e30 0x7fdcb809c9c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00e9b0 tx=0x7fdcac00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.100+0000 7fdca6ffd700 1 -- 172.21.15.59:0/1394923542 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac009710 con 0x7fdcb8133e30 2023-09-30T22:31:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.100+0000 7fdcbcae2700 1 -- 172.21.15.59:0/1394923542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb812db80 con 0x7fdcb8133e30 2023-09-30T22:31:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.100+0000 7fdcbcae2700 1 -- 172.21.15.59:0/1394923542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb8120a00 con 0x7fdcb8133e30 2023-09-30T22:31:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.100+0000 7fdca6ffd700 1 -- 172.21.15.59:0/1394923542 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac00c850 con 0x7fdcb8133e30 2023-09-30T22:31:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.100+0000 7fdca6ffd700 1 -- 172.21.15.59:0/1394923542 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac00cbc0 con 0x7fdcb8133e30 2023-09-30T22:31:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.101+0000 7fdcbcae2700 1 -- 172.21.15.59:0/1394923542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9c0052e0 con 0x7fdcb8133e30 2023-09-30T22:31:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.102+0000 7fdca6ffd700 1 -- 172.21.15.59:0/1394923542 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdcac00cd20 con 0x7fdcb8133e30 2023-09-30T22:31:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.102+0000 7fdca6ffd700 1 -- 172.21.15.59:0/1394923542 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdcac03fea0 con 0x7fdcb8133e30 2023-09-30T22:31:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.106+0000 7fdca6ffd700 1 -- 172.21.15.59:0/1394923542 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdcac012c00 con 0x7fdcb8133e30 2023-09-30T22:31:29.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.135+0000 7fbdf9146700 1 Processor -- start 2023-09-30T22:31:29.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.136+0000 7fbdf9146700 1 -- start start 2023-09-30T22:31:29.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.136+0000 7fbdf9146700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf40a0a30 0x7fbdf40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.136+0000 7fbdf9146700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbdf40a1340 0x7fbdf4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.136+0000 7fbdf9146700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf409edd0 con 0x7fbdf4133fa0 2023-09-30T22:31:29.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.136+0000 7fbdf9146700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf409e1f0 con 0x7fbdf40a1340 2023-09-30T22:31:29.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.136+0000 7fbdf9146700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf409dc50 con 0x7fbdf40a0a30 2023-09-30T22:31:29.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.136+0000 7fbdf2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf40a0a30 0x7fbdf40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.136+0000 7fbdf2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf40a0a30 0x7fbdf40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42316/0 (socket says 172.21.15.59:42316) 2023-09-30T22:31:29.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.136+0000 7fbdf2d9d700 1 -- 172.21.15.59:0/3252564467 learned_addr learned my addr 172.21.15.59:0/3252564467 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:29.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.136+0000 7fbdf259c700 1 --2- 172.21.15.59:0/3252564467 >> v2:172.21.15.59:3300/0 conn(0x7fbdf40a1340 0x7fbdf4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.137+0000 7fbdf2d9d700 1 -- 172.21.15.59:0/3252564467 >> v2:172.21.15.59:3300/0 conn(0x7fbdf40a1340 msgr2=0x7fbdf4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:29.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.137+0000 7fbdf2d9d700 1 --2- 172.21.15.59:0/3252564467 >> v2:172.21.15.59:3300/0 conn(0x7fbdf40a1340 0x7fbdf4133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.137+0000 7fbdf2d9d700 1 -- 172.21.15.59:0/3252564467 >> v1:172.21.15.59:6789/0 conn(0x7fbdf4133fa0 legacy=0x7fbdf413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:29.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.137+0000 7fbdf2d9d700 1 -- 172.21.15.59:0/3252564467 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf40a1fe0 con 0x7fbdf40a0a30 2023-09-30T22:31:29.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.137+0000 7fbdf2d9d700 1 --2- 172.21.15.59:0/3252564467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf40a0a30 0x7fbdf40a0e00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbde40098f0 tx=0x7fbde4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=657859d1eac21d08 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:29.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.137+0000 7fbdf1d9b700 1 -- 172.21.15.59:0/3252564467 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4004230 con 0x7fbdf40a0a30 2023-09-30T22:31:29.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.137+0000 7fbdf1d9b700 1 -- 172.21.15.59:0/3252564467 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde4004390 con 0x7fbdf40a0a30 2023-09-30T22:31:29.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.137+0000 7fbdf1d9b700 1 -- 172.21.15.59:0/3252564467 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde40036a0 con 0x7fbdf40a0a30 2023-09-30T22:31:29.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.138+0000 7fbdf9146700 1 -- 172.21.15.59:0/3252564467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf40a0a30 msgr2=0x7fbdf40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.138+0000 7fbdf9146700 1 --2- 172.21.15.59:0/3252564467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf40a0a30 0x7fbdf40a0e00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbde40098f0 tx=0x7fbde4009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:29.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.138+0000 7fbdf9146700 1 -- 172.21.15.59:0/3252564467 shutdown_connections 2023-09-30T22:31:29.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.138+0000 7fbdf9146700 1 --2- 172.21.15.59:0/3252564467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf40a0a30 0x7fbdf40a0e00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.138+0000 7fbdf9146700 1 --2- 172.21.15.59:0/3252564467 >> v2:172.21.15.59:3300/0 conn(0x7fbdf40a1340 0x7fbdf4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.138+0000 7fbdf9146700 1 -- 172.21.15.59:0/3252564467 >> 172.21.15.59:0/3252564467 conn(0x7fbdf40a6550 msgr2=0x7fbdf40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:29.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.138+0000 7fbdf9146700 1 -- 172.21.15.59:0/3252564467 shutdown_connections 2023-09-30T22:31:29.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.138+0000 7fbdf9146700 1 -- 172.21.15.59:0/3252564467 wait complete. 2023-09-30T22:31:29.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.139+0000 7fbdf9146700 1 Processor -- start 2023-09-30T22:31:29.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.139+0000 7fbdf9146700 1 -- start start 2023-09-30T22:31:29.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf9146700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf40a0a30 0x7fbdf41c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf9146700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf40a1340 0x7fbdf41c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf9146700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf4133fa0 0x7fbdf41c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf9146700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf4120910 con 0x7fbdf40a0a30 2023-09-30T22:31:29.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf9146700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf4120720 con 0x7fbdf4133fa0 2023-09-30T22:31:29.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf9146700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40a0220 con 0x7fbdf40a1340 2023-09-30T22:31:29.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf40a1340 0x7fbdf41c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf40a0a30 0x7fbdf41c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf40a1340 0x7fbdf41c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45704/0 (socket says 172.21.15.59:45704) 2023-09-30T22:31:29.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf259c700 1 -- 172.21.15.59:0/3728016532 learned_addr learned my addr 172.21.15.59:0/3728016532 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:29.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf359e700 1 --2- 172.21.15.59:0/3728016532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf4133fa0 0x7fbdf41c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf259c700 1 -- 172.21.15.59:0/3728016532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf4133fa0 msgr2=0x7fbdf41c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf259c700 1 --2- 172.21.15.59:0/3728016532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf4133fa0 0x7fbdf41c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf259c700 1 -- 172.21.15.59:0/3728016532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf40a0a30 msgr2=0x7fbdf41c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf259c700 1 --2- 172.21.15.59:0/3728016532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf40a0a30 0x7fbdf41c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.140+0000 7fbdf259c700 1 -- 172.21.15.59:0/3728016532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde4009550 con 0x7fbdf40a1340 2023-09-30T22:31:29.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.141+0000 7fbdf259c700 1 --2- 172.21.15.59:0/3728016532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf40a1340 0x7fbdf41c8ac0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbde800e9b0 tx=0x7fbde800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:29.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.141+0000 7fbddb7fe700 1 -- 172.21.15.59:0/3728016532 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8009710 con 0x7fbdf40a1340 2023-09-30T22:31:29.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.141+0000 7fbddb7fe700 1 -- 172.21.15.59:0/3728016532 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde800ee50 con 0x7fbdf40a1340 2023-09-30T22:31:29.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.141+0000 7fbdf9146700 1 -- 172.21.15.59:0/3728016532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf4122630 con 0x7fbdf40a1340 2023-09-30T22:31:29.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.141+0000 7fbddb7fe700 1 -- 172.21.15.59:0/3728016532 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde800ca50 con 0x7fbdf40a1340 2023-09-30T22:31:29.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.141+0000 7fbdf9146700 1 -- 172.21.15.59:0/3728016532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf40a3810 con 0x7fbdf40a1340 2023-09-30T22:31:29.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.142+0000 7fbddb7fe700 1 -- 172.21.15.59:0/3728016532 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbde800cbb0 con 0x7fbdf40a1340 2023-09-30T22:31:29.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.142+0000 7fbdf9146700 1 -- 172.21.15.59:0/3728016532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf4120f70 con 0x7fbdf40a1340 2023-09-30T22:31:29.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.142+0000 7fbddb7fe700 1 -- 172.21.15.59:0/3728016532 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbde803f770 con 0x7fbdf40a1340 2023-09-30T22:31:29.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.147+0000 7fbddb7fe700 1 -- 172.21.15.59:0/3728016532 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbde801be10 con 0x7fbdf40a1340 2023-09-30T22:31:29.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.179+0000 7fe392225700 1 Processor -- start 2023-09-30T22:31:29.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.179+0000 7fe392225700 1 -- start start 2023-09-30T22:31:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.179+0000 7fe392225700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe38c09e930 0x7fe38c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.179+0000 7fe392225700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe38c09f240 0x7fe38c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.179+0000 7fe392225700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38c070940 con 0x7fe38c09f650 2023-09-30T22:31:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.179+0000 7fe392225700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c06fd60 con 0x7fe38c09f240 2023-09-30T22:31:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.179+0000 7fe392225700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c06fa80 con 0x7fe38c09e930 2023-09-30T22:31:29.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.179+0000 7fe38bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe38c09f650 0x7fe38c131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45352/0 (socket says 172.21.15.59:45352) 2023-09-30T22:31:29.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.179+0000 7fe38bfff700 1 -- 172.21.15.59:0/1038635294 learned_addr learned my addr 172.21.15.59:0/1038635294 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:29.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.179+0000 7fe38affd700 1 --2- 172.21.15.59:0/1038635294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe38c09f240 0x7fe38c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.179+0000 7fe38b7fe700 1 --2- 172.21.15.59:0/1038635294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe38c09e930 0x7fe38c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.180+0000 7fe38a7fc700 1 -- 172.21.15.59:0/1038635294 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42609056 0 0) 0x7fe38c070940 con 0x7fe38c09f650 2023-09-30T22:31:29.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.180+0000 7fe38a7fc700 1 -- 172.21.15.59:0/1038635294 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3740035b0 con 0x7fe38c09f650 2023-09-30T22:31:29.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.180+0000 7fe38affd700 1 -- 172.21.15.59:0/1038635294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe38c09e930 msgr2=0x7fe38c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:29.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.180+0000 7fe38affd700 1 --2- 172.21.15.59:0/1038635294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe38c09e930 0x7fe38c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.180+0000 7fe38affd700 1 -- 172.21.15.59:0/1038635294 >> v1:172.21.15.59:6789/0 conn(0x7fe38c09f650 legacy=0x7fe38c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.180+0000 7fe38affd700 1 -- 172.21.15.59:0/1038635294 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c09fb60 con 0x7fe38c09f240 2023-09-30T22:31:29.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.180+0000 7fe38b7fe700 1 --2- 172.21.15.59:0/1038635294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe38c09e930 0x7fe38c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:29.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.180+0000 7fe38affd700 1 --2- 172.21.15.59:0/1038635294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe38c09f240 0x7fe38c1317f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe380009870 tx=0x7fe380009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf726f54060f8f8f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.180+0000 7fe38a7fc700 1 -- 172.21.15.59:0/1038635294 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380011830 con 0x7fe38c09f240 2023-09-30T22:31:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.180+0000 7fe38a7fc700 1 -- 172.21.15.59:0/1038635294 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe380011990 con 0x7fe38c09f240 2023-09-30T22:31:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.180+0000 7fe38a7fc700 1 -- 172.21.15.59:0/1038635294 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380011d20 con 0x7fe38c09f240 2023-09-30T22:31:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.181+0000 7fe392225700 1 -- 172.21.15.59:0/1038635294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe38c09f240 msgr2=0x7fe38c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.181+0000 7fe392225700 1 --2- 172.21.15.59:0/1038635294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe38c09f240 0x7fe38c1317f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe380009870 tx=0x7fe380009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.181+0000 7fe392225700 1 -- 172.21.15.59:0/1038635294 shutdown_connections 2023-09-30T22:31:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.181+0000 7fe392225700 1 --2- 172.21.15.59:0/1038635294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe38c09e930 0x7fe38c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.181+0000 7fe392225700 1 --2- 172.21.15.59:0/1038635294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe38c09f240 0x7fe38c1317f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.181+0000 7fe392225700 1 -- 172.21.15.59:0/1038635294 >> 172.21.15.59:0/1038635294 conn(0x7fe38c0a4210 msgr2=0x7fe38c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.181+0000 7fe392225700 1 -- 172.21.15.59:0/1038635294 shutdown_connections 2023-09-30T22:31:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.181+0000 7fe392225700 1 -- 172.21.15.59:0/1038635294 wait complete. 2023-09-30T22:31:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.183+0000 7fe392225700 1 Processor -- start 2023-09-30T22:31:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.183+0000 7fe392225700 1 -- start start 2023-09-30T22:31:29.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe392225700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe38c09e930 0x7fe38c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe392225700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe38c09f240 0x7fe38c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe392225700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe38c09f650 0x7fe38c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe392225700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c1b7230 con 0x7fe38c09f650 2023-09-30T22:31:29.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe392225700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c1a93e0 con 0x7fe38c09f240 2023-09-30T22:31:29.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe392225700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c1a8900 con 0x7fe38c09e930 2023-09-30T22:31:29.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe38affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe38c09f240 0x7fe38c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe38affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe38c09f240 0x7fe38c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42346/0 (socket says 172.21.15.59:42346) 2023-09-30T22:31:29.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe38affd700 1 -- 172.21.15.59:0/3124142935 learned_addr learned my addr 172.21.15.59:0/3124142935 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:29.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe38b7fe700 1 --2- 172.21.15.59:0/3124142935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe38c09e930 0x7fe38c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe38bfff700 1 --2- 172.21.15.59:0/3124142935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe38c09f650 0x7fe38c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe38affd700 1 -- 172.21.15.59:0/3124142935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe38c09e930 msgr2=0x7fe38c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe38affd700 1 --2- 172.21.15.59:0/3124142935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe38c09e930 0x7fe38c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe38affd700 1 -- 172.21.15.59:0/3124142935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe38c09f650 msgr2=0x7fe38c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe38affd700 1 --2- 172.21.15.59:0/3124142935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe38c09f650 0x7fe38c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe38affd700 1 -- 172.21.15.59:0/3124142935 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c0094a0 con 0x7fe38c09f240 2023-09-30T22:31:29.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.184+0000 7fe38b7fe700 1 --2- 172.21.15.59:0/3124142935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe38c09e930 0x7fe38c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:29.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.185+0000 7fe38affd700 1 --2- 172.21.15.59:0/3124142935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe38c09f240 0x7fe38c06bdf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe3800090b0 tx=0x7fe380004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:29.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.185+0000 7fe373fff700 1 -- 172.21.15.59:0/3124142935 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380004450 con 0x7fe38c09f240 2023-09-30T22:31:29.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.185+0000 7fe373fff700 1 -- 172.21.15.59:0/3124142935 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38001f070 con 0x7fe38c09f240 2023-09-30T22:31:29.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.185+0000 7fe392225700 1 -- 172.21.15.59:0/3124142935 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3800094a0 con 0x7fe38c09f240 2023-09-30T22:31:29.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.185+0000 7fe373fff700 1 -- 172.21.15.59:0/3124142935 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3800038e0 con 0x7fe38c09f240 2023-09-30T22:31:29.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.185+0000 7fe392225700 1 -- 172.21.15.59:0/3124142935 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38c0a0190 con 0x7fe38c09f240 2023-09-30T22:31:29.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.186+0000 7fe373fff700 1 -- 172.21.15.59:0/3124142935 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe380003a40 con 0x7fe38c09f240 2023-09-30T22:31:29.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.186+0000 7fe373fff700 1 -- 172.21.15.59:0/3124142935 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe380021070 con 0x7fe38c09f240 2023-09-30T22:31:29.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.186+0000 7fe392225700 1 -- 172.21.15.59:0/3124142935 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38c1a0b30 con 0x7fe38c09f240 2023-09-30T22:31:29.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.191+0000 7fe373fff700 1 -- 172.21.15.59:0/3124142935 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe380015070 con 0x7fe38c09f240 2023-09-30T22:31:29.317 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:29.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.316+0000 7fdcbcae2700 1 -- 172.21.15.59:0/1394923542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdc9c005150 con 0x7fdcb8133e30 2023-09-30T22:31:29.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.317+0000 7fdca6ffd700 1 -- 172.21.15.59:0/1394923542 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdcac02a090 con 0x7fdcb8133e30 2023-09-30T22:31:29.319 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:29.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.319+0000 7fdcbcae2700 1 -- 172.21.15.59:0/1394923542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcb8133e30 msgr2=0x7fdcb809c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.319+0000 7fdcbcae2700 1 --2- 172.21.15.59:0/1394923542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcb8133e30 0x7fdcb809c9c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00e9b0 tx=0x7fdcac00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.319+0000 7fdcbcae2700 1 -- 172.21.15.59:0/1394923542 shutdown_connections 2023-09-30T22:31:29.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.319+0000 7fdcbcae2700 1 --2- 172.21.15.59:0/1394923542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcb8134260 0x7fdcb809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.319+0000 7fdcbcae2700 1 --2- 172.21.15.59:0/1394923542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb8133420 0x7fdcb809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.319+0000 7fdcbcae2700 1 --2- 172.21.15.59:0/1394923542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcb8133e30 0x7fdcb809c9c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.319+0000 7fdcbcae2700 1 -- 172.21.15.59:0/1394923542 >> 172.21.15.59:0/1394923542 conn(0x7fdcb80a4210 msgr2=0x7fdcb80a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:29.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.319+0000 7fdcbcae2700 1 -- 172.21.15.59:0/1394923542 shutdown_connections 2023-09-30T22:31:29.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.319+0000 7fdcbcae2700 1 -- 172.21.15.59:0/1394923542 wait complete. 2023-09-30T22:31:29.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:29.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.388+0000 7fbdf9146700 1 -- 172.21.15.59:0/3728016532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbdf40a1d40 con 0x7fbdf40a1340 2023-09-30T22:31:29.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.389+0000 7fbddb7fe700 1 -- 172.21.15.59:0/3728016532 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbde8021020 con 0x7fbdf40a1340 2023-09-30T22:31:29.390 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.391+0000 7fbdf9146700 1 -- 172.21.15.59:0/3728016532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf40a1340 msgr2=0x7fbdf41c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.391+0000 7fbdf9146700 1 --2- 172.21.15.59:0/3728016532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf40a1340 0x7fbdf41c8ac0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbde800e9b0 tx=0x7fbde800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.391+0000 7fbdf9146700 1 -- 172.21.15.59:0/3728016532 shutdown_connections 2023-09-30T22:31:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.391+0000 7fbdf9146700 1 --2- 172.21.15.59:0/3728016532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf4133fa0 0x7fbdf41c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.391+0000 7fbdf9146700 1 --2- 172.21.15.59:0/3728016532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf40a0a30 0x7fbdf41c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.391+0000 7fbdf9146700 1 --2- 172.21.15.59:0/3728016532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf40a1340 0x7fbdf41c8ac0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.391+0000 7fbdf9146700 1 -- 172.21.15.59:0/3728016532 >> 172.21.15.59:0/3728016532 conn(0x7fbdf40a6550 msgr2=0x7fbdf41b9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.391+0000 7fbdf9146700 1 -- 172.21.15.59:0/3728016532 shutdown_connections 2023-09-30T22:31:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.392+0000 7fbdf9146700 1 -- 172.21.15.59:0/3728016532 wait complete. 2023-09-30T22:31:29.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.422+0000 7fe392225700 1 -- 172.21.15.59:0/3124142935 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe38c1a9110 con 0x7fe38c09f240 2023-09-30T22:31:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.422+0000 7fe373fff700 1 -- 172.21.15.59:0/3124142935 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe38002b020 con 0x7fe38c09f240 2023-09-30T22:31:29.423 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:29.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.424+0000 7fe392225700 1 -- 172.21.15.59:0/3124142935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe38c09f240 msgr2=0x7fe38c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.424+0000 7fe392225700 1 --2- 172.21.15.59:0/3124142935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe38c09f240 0x7fe38c06bdf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe3800090b0 tx=0x7fe380004750 comp rx=0 tx=0).stop 2023-09-30T22:31:29.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.424+0000 7fe392225700 1 -- 172.21.15.59:0/3124142935 shutdown_connections 2023-09-30T22:31:29.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.424+0000 7fe392225700 1 --2- 172.21.15.59:0/3124142935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe38c09e930 0x7fe38c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.424+0000 7fe392225700 1 --2- 172.21.15.59:0/3124142935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe38c09f650 0x7fe38c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.424+0000 7fe392225700 1 --2- 172.21.15.59:0/3124142935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe38c09f240 0x7fe38c06bdf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.424+0000 7fe392225700 1 -- 172.21.15.59:0/3124142935 >> 172.21.15.59:0/3124142935 conn(0x7fe38c0a4210 msgr2=0x7fe38c1b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:29.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.424+0000 7fe392225700 1 -- 172.21.15.59:0/3124142935 shutdown_connections 2023-09-30T22:31:29.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.425+0000 7fe392225700 1 -- 172.21.15.59:0/3124142935 wait complete. 2023-09-30T22:31:29.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:29.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.459+0000 7faccef47700 1 Processor -- start 2023-09-30T22:31:29.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.459+0000 7faccef47700 1 -- start start 2023-09-30T22:31:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.459+0000 7faccef47700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc809d630 0x7facc80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.459+0000 7faccef47700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7facc8138d80 0x7facc813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.459+0000 7faccef47700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc80a2a70 con 0x7facc80a0a30 2023-09-30T22:31:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.459+0000 7faccef47700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc80a01d0 con 0x7facc8138d80 2023-09-30T22:31:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.459+0000 7faccef47700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc809e2b0 con 0x7facc809d630 2023-09-30T22:31:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.460+0000 7faccd4e4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7facc8138d80 0x7facc813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.460+0000 7facc7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc809d630 0x7facc80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.460+0000 7faccd4e4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7facc8138d80 0x7facc813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36632/0 (socket says 172.21.15.59:36632) 2023-09-30T22:31:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.460+0000 7facc7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc809d630 0x7facc80a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42348/0 (socket says 172.21.15.59:42348) 2023-09-30T22:31:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.460+0000 7faccd4e4700 1 -- 172.21.15.59:0/3782907495 learned_addr learned my addr 172.21.15.59:0/3782907495 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.460+0000 7faccd4e4700 1 -- 172.21.15.59:0/3782907495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc809d630 msgr2=0x7facc80a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.460+0000 7faccd4e4700 1 --2- 172.21.15.59:0/3782907495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc809d630 0x7facc80a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.460+0000 7faccd4e4700 1 -- 172.21.15.59:0/3782907495 >> v1:172.21.15.59:6789/0 conn(0x7facc80a0a30 legacy=0x7facc80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.460+0000 7faccd4e4700 1 -- 172.21.15.59:0/3782907495 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc809dc50 con 0x7facc8138d80 2023-09-30T22:31:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.460+0000 7facc7fff700 1 --2- 172.21.15.59:0/3782907495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc809d630 0x7facc80a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.460+0000 7faccd4e4700 1 --2- 172.21.15.59:0/3782907495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8138d80 0x7facc813b160 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7facc0009e50 tx=0x7facc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86525f447a91eca0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.460+0000 7facc77fe700 1 -- 172.21.15.59:0/3782907495 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc000e070 con 0x7facc8138d80 2023-09-30T22:31:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.460+0000 7facc77fe700 1 -- 172.21.15.59:0/3782907495 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc000b910 con 0x7facc8138d80 2023-09-30T22:31:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.460+0000 7facc77fe700 1 -- 172.21.15.59:0/3782907495 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc000bcc0 con 0x7facc8138d80 2023-09-30T22:31:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.461+0000 7faccef47700 1 -- 172.21.15.59:0/3782907495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8138d80 msgr2=0x7facc813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.461+0000 7faccef47700 1 --2- 172.21.15.59:0/3782907495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8138d80 0x7facc813b160 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7facc0009e50 tx=0x7facc000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.461+0000 7faccef47700 1 -- 172.21.15.59:0/3782907495 shutdown_connections 2023-09-30T22:31:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.461+0000 7faccef47700 1 --2- 172.21.15.59:0/3782907495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8138d80 0x7facc813b160 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.461+0000 7faccef47700 1 --2- 172.21.15.59:0/3782907495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc809d630 0x7facc80a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.461+0000 7faccef47700 1 -- 172.21.15.59:0/3782907495 >> 172.21.15.59:0/3782907495 conn(0x7facc80a3050 msgr2=0x7facc80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:29.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.461+0000 7faccef47700 1 -- 172.21.15.59:0/3782907495 shutdown_connections 2023-09-30T22:31:29.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.461+0000 7faccef47700 1 -- 172.21.15.59:0/3782907495 wait complete. 2023-09-30T22:31:29.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.462+0000 7faccef47700 1 Processor -- start 2023-09-30T22:31:29.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.462+0000 7faccef47700 1 -- start start 2023-09-30T22:31:29.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.462+0000 7faccef47700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc809d630 0x7facc8133850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7faccef47700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facc80a0a30 0x7facc8133d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7faccef47700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc8138d80 0x7facc81342d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7faccef47700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc8137000 con 0x7facc809d630 2023-09-30T22:31:29.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7faccef47700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc81359f0 con 0x7facc8138d80 2023-09-30T22:31:29.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7faccef47700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facc80a0480 con 0x7facc80a0a30 2023-09-30T22:31:29.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7facccce3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc809d630 0x7facc8133850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7facc7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facc80a0a30 0x7facc8133d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7facccce3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc809d630 0x7facc8133850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36636/0 (socket says 172.21.15.59:36636) 2023-09-30T22:31:29.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7facccce3700 1 -- 172.21.15.59:0/605209223 learned_addr learned my addr 172.21.15.59:0/605209223 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:29.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7faccd4e4700 1 --2- 172.21.15.59:0/605209223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc8138d80 0x7facc81342d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7facccce3700 1 -- 172.21.15.59:0/605209223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facc80a0a30 msgr2=0x7facc8133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7facccce3700 1 --2- 172.21.15.59:0/605209223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facc80a0a30 0x7facc8133d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7facccce3700 1 -- 172.21.15.59:0/605209223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc8138d80 msgr2=0x7facc81342d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7facccce3700 1 --2- 172.21.15.59:0/605209223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc8138d80 0x7facc81342d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7facccce3700 1 -- 172.21.15.59:0/605209223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb40094a0 con 0x7facc809d630 2023-09-30T22:31:29.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7faccd4e4700 1 --2- 172.21.15.59:0/605209223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc8138d80 0x7facc81342d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:29.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7facccce3700 1 --2- 172.21.15.59:0/605209223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc809d630 0x7facc8133850 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7facbc00c510 tx=0x7facbc00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:29.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7facc57fa700 1 -- 172.21.15.59:0/605209223 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc0052d0 con 0x7facc809d630 2023-09-30T22:31:29.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7facc57fa700 1 -- 172.21.15.59:0/605209223 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc005430 con 0x7facc809d630 2023-09-30T22:31:29.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7faccef47700 1 -- 172.21.15.59:0/605209223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc0009b30 con 0x7facc809d630 2023-09-30T22:31:29.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7facc57fa700 1 -- 172.21.15.59:0/605209223 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc0038c0 con 0x7facc809d630 2023-09-30T22:31:29.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.463+0000 7faccef47700 1 -- 172.21.15.59:0/605209223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc8137ec0 con 0x7facc809d630 2023-09-30T22:31:29.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.464+0000 7facc57fa700 1 -- 172.21.15.59:0/605209223 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7facbc003a20 con 0x7facc809d630 2023-09-30T22:31:29.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.465+0000 7facc57fa700 1 -- 172.21.15.59:0/605209223 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7facbc03e900 con 0x7facc809d630 2023-09-30T22:31:29.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.465+0000 7faccef47700 1 -- 172.21.15.59:0/605209223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc80747f0 con 0x7facc809d630 2023-09-30T22:31:29.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.470+0000 7facc57fa700 1 -- 172.21.15.59:0/605209223 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7facbc017080 con 0x7facc809d630 2023-09-30T22:31:29.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.675+0000 7faccef47700 1 -- 172.21.15.59:0/605209223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7facc8136c80 con 0x7facc809d630 2023-09-30T22:31:29.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.675+0000 7facc57fa700 1 -- 172.21.15.59:0/605209223 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7facbc018260 con 0x7facc809d630 2023-09-30T22:31:29.676 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.677+0000 7faccef47700 1 -- 172.21.15.59:0/605209223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc809d630 msgr2=0x7facc8133850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.677+0000 7faccef47700 1 --2- 172.21.15.59:0/605209223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc809d630 0x7facc8133850 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7facbc00c510 tx=0x7facbc00c820 comp rx=0 tx=0).stop 2023-09-30T22:31:29.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.677+0000 7faccef47700 1 -- 172.21.15.59:0/605209223 shutdown_connections 2023-09-30T22:31:29.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.677+0000 7faccef47700 1 --2- 172.21.15.59:0/605209223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc8138d80 0x7facc81342d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.677+0000 7faccef47700 1 --2- 172.21.15.59:0/605209223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc809d630 0x7facc8133850 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.677+0000 7faccef47700 1 --2- 172.21.15.59:0/605209223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facc80a0a30 0x7facc8133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.677+0000 7faccef47700 1 -- 172.21.15.59:0/605209223 >> 172.21.15.59:0/605209223 conn(0x7facc80a3050 msgr2=0x7facc809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:29.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.677+0000 7faccef47700 1 -- 172.21.15.59:0/605209223 shutdown_connections 2023-09-30T22:31:29.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:29.677+0000 7faccef47700 1 -- 172.21.15.59:0/605209223 wait complete. 2023-09-30T22:31:29.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:30.341 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:30.407 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:30.440 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:30.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.495+0000 7f6a3e70c700 1 Processor -- start 2023-09-30T22:31:30.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.495+0000 7f6a3e70c700 1 -- start start 2023-09-30T22:31:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.496+0000 7f6a3e70c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a3809d6f0 0x7f6a3809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.496+0000 7f6a3e70c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a3809e000 0x7f6a38130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.496+0000 7f6a3e70c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3809f130 con 0x7f6a3809e410 2023-09-30T22:31:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.496+0000 7f6a3e70c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3809f520 con 0x7f6a3809e000 2023-09-30T22:31:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.496+0000 7f6a3e70c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3809e930 con 0x7f6a3809d6f0 2023-09-30T22:31:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.496+0000 7f6a377fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a3809e000 0x7f6a38130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.496+0000 7f6a37fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a3809d6f0 0x7f6a3809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.496+0000 7f6a37fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a3809d6f0 0x7f6a3809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45742/0 (socket says 172.21.15.59:45742) 2023-09-30T22:31:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.496+0000 7f6a377fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a3809e000 0x7f6a38130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36648/0 (socket says 172.21.15.59:36648) 2023-09-30T22:31:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.496+0000 7f6a37fff700 1 -- 172.21.15.59:0/1184282095 learned_addr learned my addr 172.21.15.59:0/1184282095 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.497+0000 7f6a37fff700 1 -- 172.21.15.59:0/1184282095 >> v2:172.21.15.59:3300/0 conn(0x7f6a3809e000 msgr2=0x7f6a38130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.497+0000 7f6a37fff700 1 --2- 172.21.15.59:0/1184282095 >> v2:172.21.15.59:3300/0 conn(0x7f6a3809e000 0x7f6a38130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.497+0000 7f6a37fff700 1 -- 172.21.15.59:0/1184282095 >> v1:172.21.15.59:6789/0 conn(0x7f6a3809e410 legacy=0x7f6a38130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.497+0000 7f6a37fff700 1 -- 172.21.15.59:0/1184282095 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3809b2d0 con 0x7f6a3809d6f0 2023-09-30T22:31:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.497+0000 7f6a377fe700 1 --2- 172.21.15.59:0/1184282095 >> v2:172.21.15.59:3300/0 conn(0x7f6a3809e000 0x7f6a38130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.497+0000 7f6a37fff700 1 --2- 172.21.15.59:0/1184282095 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a3809d6f0 0x7f6a3809dac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6a280098f0 tx=0x7f6a28009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72c8b03fe035707c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:30.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.497+0000 7f6a36ffd700 1 -- 172.21.15.59:0/1184282095 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28011830 con 0x7f6a3809d6f0 2023-09-30T22:31:30.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.497+0000 7f6a36ffd700 1 -- 172.21.15.59:0/1184282095 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a28011990 con 0x7f6a3809d6f0 2023-09-30T22:31:30.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.497+0000 7f6a36ffd700 1 -- 172.21.15.59:0/1184282095 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28011d20 con 0x7f6a3809d6f0 2023-09-30T22:31:30.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.498+0000 7f6a3e70c700 1 -- 172.21.15.59:0/1184282095 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a3809d6f0 msgr2=0x7f6a3809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.498+0000 7f6a3e70c700 1 --2- 172.21.15.59:0/1184282095 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a3809d6f0 0x7f6a3809dac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6a280098f0 tx=0x7f6a28009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:30.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.498+0000 7f6a3e70c700 1 -- 172.21.15.59:0/1184282095 shutdown_connections 2023-09-30T22:31:30.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.498+0000 7f6a3e70c700 1 --2- 172.21.15.59:0/1184282095 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a3809d6f0 0x7f6a3809dac0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.498+0000 7f6a3e70c700 1 --2- 172.21.15.59:0/1184282095 >> v2:172.21.15.59:3300/0 conn(0x7f6a3809e000 0x7f6a38130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.498+0000 7f6a3e70c700 1 -- 172.21.15.59:0/1184282095 >> 172.21.15.59:0/1184282095 conn(0x7f6a38066f50 msgr2=0x7f6a3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:30.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.498+0000 7f6a3e70c700 1 -- 172.21.15.59:0/1184282095 shutdown_connections 2023-09-30T22:31:30.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.498+0000 7f6a3e70c700 1 -- 172.21.15.59:0/1184282095 wait complete. 2023-09-30T22:31:30.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.499+0000 7f6a3e70c700 1 Processor -- start 2023-09-30T22:31:30.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.499+0000 7f6a3e70c700 1 -- start start 2023-09-30T22:31:30.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.500+0000 7f6a3e70c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a3809d6f0 0x7f6a3812e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.500+0000 7f6a3e70c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a3809e000 0x7f6a3812e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.500+0000 7f6a3e70c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3809e410 0x7f6a3812eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.500+0000 7f6a3e70c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a38130810 con 0x7f6a3809e410 2023-09-30T22:31:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.500+0000 7f6a3e70c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3812f990 con 0x7f6a3809d6f0 2023-09-30T22:31:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.500+0000 7f6a3e70c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a381321b0 con 0x7f6a3809e000 2023-09-30T22:31:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.500+0000 7f6a377fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a3809e000 0x7f6a3812e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.500+0000 7f6a377fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a3809e000 0x7f6a3812e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45748/0 (socket says 172.21.15.59:45748) 2023-09-30T22:31:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.500+0000 7f6a377fe700 1 -- 172.21.15.59:0/443838982 learned_addr learned my addr 172.21.15.59:0/443838982 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.500+0000 7f6a3cca9700 1 --2- 172.21.15.59:0/443838982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3809e410 0x7f6a3812eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.501+0000 7f6a377fe700 1 -- 172.21.15.59:0/443838982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a3809d6f0 msgr2=0x7f6a3812e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.501+0000 7f6a377fe700 1 --2- 172.21.15.59:0/443838982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a3809d6f0 0x7f6a3812e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.501+0000 7f6a377fe700 1 -- 172.21.15.59:0/443838982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3809e410 msgr2=0x7f6a3812eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.501+0000 7f6a377fe700 1 --2- 172.21.15.59:0/443838982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3809e410 0x7f6a3812eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.501+0000 7f6a377fe700 1 -- 172.21.15.59:0/443838982 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c0094a0 con 0x7f6a3809e000 2023-09-30T22:31:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.501+0000 7f6a3cca9700 1 --2- 172.21.15.59:0/443838982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3809e410 0x7f6a3812eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:30.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.501+0000 7f6a377fe700 1 --2- 172.21.15.59:0/443838982 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a3809e000 0x7f6a3812e630 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00ebe0 tx=0x7f6a2c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:30.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.501+0000 7f6a34ff9700 1 -- 172.21.15.59:0/443838982 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00c910 con 0x7f6a3809e000 2023-09-30T22:31:30.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.501+0000 7f6a34ff9700 1 -- 172.21.15.59:0/443838982 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c00ca70 con 0x7f6a3809e000 2023-09-30T22:31:30.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.501+0000 7f6a3e70c700 1 -- 172.21.15.59:0/443838982 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a28009550 con 0x7f6a3809e000 2023-09-30T22:31:30.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.501+0000 7f6a34ff9700 1 -- 172.21.15.59:0/443838982 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00ce00 con 0x7f6a3809e000 2023-09-30T22:31:30.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.501+0000 7f6a3e70c700 1 -- 172.21.15.59:0/443838982 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a381319d0 con 0x7f6a3809e000 2023-09-30T22:31:30.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.503+0000 7f6a3e70c700 1 -- 172.21.15.59:0/443838982 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a38074ea0 con 0x7f6a3809e000 2023-09-30T22:31:30.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.503+0000 7f6a34ff9700 1 -- 172.21.15.59:0/443838982 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a2c013470 con 0x7f6a3809e000 2023-09-30T22:31:30.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.503+0000 7f6a34ff9700 1 -- 172.21.15.59:0/443838982 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6a2c040050 con 0x7f6a3809e000 2023-09-30T22:31:30.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.512+0000 7f6a34ff9700 1 -- 172.21.15.59:0/443838982 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a2c011760 con 0x7f6a3809e000 2023-09-30T22:31:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.551+0000 7ff271680700 1 Processor -- start 2023-09-30T22:31:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.551+0000 7ff271680700 1 -- start start 2023-09-30T22:31:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.551+0000 7ff271680700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff26c0a0a30 0x7ff26c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.551+0000 7ff271680700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09d630 0x7ff26c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.551+0000 7ff271680700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c0a2a70 con 0x7ff26c133930 2023-09-30T22:31:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.551+0000 7ff271680700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26c0a01d0 con 0x7ff26c0a0a30 2023-09-30T22:31:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.551+0000 7ff271680700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c09e2b0 con 0x7ff26c09d630 2023-09-30T22:31:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.552+0000 7ff26affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff26c0a0a30 0x7ff26c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.552+0000 7ff26a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09d630 0x7ff26c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.552+0000 7ff26affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff26c0a0a30 0x7ff26c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36664/0 (socket says 172.21.15.59:36664) 2023-09-30T22:31:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.552+0000 7ff26a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09d630 0x7ff26c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42364/0 (socket says 172.21.15.59:42364) 2023-09-30T22:31:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.552+0000 7ff26affd700 1 -- 172.21.15.59:0/1497866817 learned_addr learned my addr 172.21.15.59:0/1497866817 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.552+0000 7ff26affd700 1 -- 172.21.15.59:0/1497866817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09d630 msgr2=0x7ff26c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.552+0000 7ff26affd700 1 --2- 172.21.15.59:0/1497866817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09d630 0x7ff26c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.552+0000 7ff26affd700 1 -- 172.21.15.59:0/1497866817 >> v1:172.21.15.59:6789/0 conn(0x7ff26c133930 legacy=0x7ff26c133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.552+0000 7ff26affd700 1 -- 172.21.15.59:0/1497866817 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c09dc50 con 0x7ff26c0a0a30 2023-09-30T22:31:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.552+0000 7ff26a7fc700 1 --2- 172.21.15.59:0/1497866817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09d630 0x7ff26c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.552+0000 7ff26affd700 1 --2- 172.21.15.59:0/1497866817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c0a0a30 0x7ff26c0a0e00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009e50 tx=0x7ff25c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9cc5d8528f1d966 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.553+0000 7ff269ffb700 1 -- 172.21.15.59:0/1497866817 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c00e070 con 0x7ff26c0a0a30 2023-09-30T22:31:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.553+0000 7ff269ffb700 1 -- 172.21.15.59:0/1497866817 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c00b910 con 0x7ff26c0a0a30 2023-09-30T22:31:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.553+0000 7ff269ffb700 1 -- 172.21.15.59:0/1497866817 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c00bcc0 con 0x7ff26c0a0a30 2023-09-30T22:31:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.553+0000 7ff271680700 1 -- 172.21.15.59:0/1497866817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c0a0a30 msgr2=0x7ff26c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.553+0000 7ff271680700 1 --2- 172.21.15.59:0/1497866817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c0a0a30 0x7ff26c0a0e00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009e50 tx=0x7ff25c00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.553+0000 7ff271680700 1 -- 172.21.15.59:0/1497866817 shutdown_connections 2023-09-30T22:31:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.553+0000 7ff271680700 1 --2- 172.21.15.59:0/1497866817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c0a0a30 0x7ff26c0a0e00 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.553+0000 7ff271680700 1 --2- 172.21.15.59:0/1497866817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09d630 0x7ff26c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.553+0000 7ff271680700 1 -- 172.21.15.59:0/1497866817 >> 172.21.15.59:0/1497866817 conn(0x7ff26c0a3050 msgr2=0x7ff26c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.553+0000 7ff271680700 1 -- 172.21.15.59:0/1497866817 shutdown_connections 2023-09-30T22:31:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.553+0000 7ff271680700 1 -- 172.21.15.59:0/1497866817 wait complete. 2023-09-30T22:31:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.555+0000 7ff271680700 1 Processor -- start 2023-09-30T22:31:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.555+0000 7ff271680700 1 -- start start 2023-09-30T22:31:30.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff271680700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26c09d630 0x7ff26c1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff271680700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c0a0a30 0x7ff26c1c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff271680700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c133930 0x7ff26c1c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff271680700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c11eea0 con 0x7ff26c133930 2023-09-30T22:31:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff271680700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c1207f0 con 0x7ff26c0a0a30 2023-09-30T22:31:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff271680700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c120600 con 0x7ff26c09d630 2023-09-30T22:31:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff26affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26c09d630 0x7ff26c1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff26affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26c09d630 0x7ff26c1c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45760/0 (socket says 172.21.15.59:45760) 2023-09-30T22:31:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff26affd700 1 -- 172.21.15.59:0/758755857 learned_addr learned my addr 172.21.15.59:0/758755857 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff26a7fc700 1 --2- 172.21.15.59:0/758755857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c0a0a30 0x7ff26c1c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff26b7fe700 1 --2- 172.21.15.59:0/758755857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c133930 0x7ff26c1c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff26affd700 1 -- 172.21.15.59:0/758755857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c0a0a30 msgr2=0x7ff26c1c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff26affd700 1 --2- 172.21.15.59:0/758755857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c0a0a30 0x7ff26c1c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff26affd700 1 -- 172.21.15.59:0/758755857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c133930 msgr2=0x7ff26c1c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff26affd700 1 --2- 172.21.15.59:0/758755857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c133930 0x7ff26c1c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff26affd700 1 -- 172.21.15.59:0/758755857 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2600094a0 con 0x7ff26c09d630 2023-09-30T22:31:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.556+0000 7ff26a7fc700 1 --2- 172.21.15.59:0/758755857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c0a0a30 0x7ff26c1c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.557+0000 7ff26affd700 1 --2- 172.21.15.59:0/758755857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26c09d630 0x7ff26c1c8120 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00b370 tx=0x7ff25c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.557+0000 7ff2537fe700 1 -- 172.21.15.59:0/758755857 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c004800 con 0x7ff26c09d630 2023-09-30T22:31:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.557+0000 7ff2537fe700 1 -- 172.21.15.59:0/758755857 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c0092e0 con 0x7ff26c09d630 2023-09-30T22:31:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.557+0000 7ff271680700 1 -- 172.21.15.59:0/758755857 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25c009b30 con 0x7ff26c09d630 2023-09-30T22:31:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.557+0000 7ff2537fe700 1 -- 172.21.15.59:0/758755857 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c01c680 con 0x7ff26c09d630 2023-09-30T22:31:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.557+0000 7ff271680700 1 -- 172.21.15.59:0/758755857 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26c122230 con 0x7ff26c09d630 2023-09-30T22:31:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.558+0000 7ff2537fe700 1 -- 172.21.15.59:0/758755857 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff25c01c7e0 con 0x7ff26c09d630 2023-09-30T22:31:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.558+0000 7ff2537fe700 1 -- 172.21.15.59:0/758755857 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff25c040f00 con 0x7ff26c09d630 2023-09-30T22:31:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.558+0000 7ff271680700 1 -- 172.21.15.59:0/758755857 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26c0747f0 con 0x7ff26c09d630 2023-09-30T22:31:30.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.563+0000 7ff2537fe700 1 -- 172.21.15.59:0/758755857 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff25c0123f0 con 0x7ff26c09d630 2023-09-30T22:31:30.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.599+0000 7f01d79ce700 1 Processor -- start 2023-09-30T22:31:30.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.600+0000 7f01d79ce700 1 -- start start 2023-09-30T22:31:30.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.600+0000 7f01d79ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d009d630 0x7f01d00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.600+0000 7f01d79ce700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01d0138d80 0x7f01d013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.600+0000 7f01d79ce700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d00a2a70 con 0x7f01d00a0a30 2023-09-30T22:31:30.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.600+0000 7f01d79ce700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d00a01d0 con 0x7f01d0138d80 2023-09-30T22:31:30.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.600+0000 7f01d79ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d009e2b0 con 0x7f01d009d630 2023-09-30T22:31:30.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.600+0000 7f01d4f69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d009d630 0x7f01d00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.600+0000 7f01d5f6b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01d0138d80 0x7f01d013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.600+0000 7f01d4f69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d009d630 0x7f01d00a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42380/0 (socket says 172.21.15.59:42380) 2023-09-30T22:31:30.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.600+0000 7f01d4f69700 1 -- 172.21.15.59:0/661568085 learned_addr learned my addr 172.21.15.59:0/661568085 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:30.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.601+0000 7f01d5f6b700 1 -- 172.21.15.59:0/661568085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d009d630 msgr2=0x7f01d00a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:30.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.601+0000 7f01d5f6b700 1 --2- 172.21.15.59:0/661568085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d009d630 0x7f01d00a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.601+0000 7f01d5f6b700 1 -- 172.21.15.59:0/661568085 >> v1:172.21.15.59:6789/0 conn(0x7f01d00a0a30 legacy=0x7f01d00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.601+0000 7f01d5f6b700 1 -- 172.21.15.59:0/661568085 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d009dc50 con 0x7f01d0138d80 2023-09-30T22:31:30.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.601+0000 7f01d4f69700 1 --2- 172.21.15.59:0/661568085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d009d630 0x7f01d00a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:30.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.601+0000 7f01d5f6b700 1 --2- 172.21.15.59:0/661568085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01d0138d80 0x7f01d013b160 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009d90 tx=0x7f01c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee48ab4810ab215e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:30.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.601+0000 7f01cffff700 1 -- 172.21.15.59:0/661568085 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c800e070 con 0x7f01d0138d80 2023-09-30T22:31:30.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.601+0000 7f01cffff700 1 -- 172.21.15.59:0/661568085 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c800bb20 con 0x7f01d0138d80 2023-09-30T22:31:30.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.601+0000 7f01cffff700 1 -- 172.21.15.59:0/661568085 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8012430 con 0x7f01d0138d80 2023-09-30T22:31:30.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.602+0000 7f01d79ce700 1 -- 172.21.15.59:0/661568085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01d0138d80 msgr2=0x7f01d013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.602+0000 7f01d79ce700 1 --2- 172.21.15.59:0/661568085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01d0138d80 0x7f01d013b160 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009d90 tx=0x7f01c800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:30.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.602+0000 7f01d79ce700 1 -- 172.21.15.59:0/661568085 shutdown_connections 2023-09-30T22:31:30.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.602+0000 7f01d79ce700 1 --2- 172.21.15.59:0/661568085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01d0138d80 0x7f01d013b160 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.602+0000 7f01d79ce700 1 --2- 172.21.15.59:0/661568085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d009d630 0x7f01d00a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.602+0000 7f01d79ce700 1 -- 172.21.15.59:0/661568085 >> 172.21.15.59:0/661568085 conn(0x7f01d00a3050 msgr2=0x7f01d00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:30.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.602+0000 7f01d79ce700 1 -- 172.21.15.59:0/661568085 shutdown_connections 2023-09-30T22:31:30.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.602+0000 7f01d79ce700 1 -- 172.21.15.59:0/661568085 wait complete. 2023-09-30T22:31:30.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.603+0000 7f01d79ce700 1 Processor -- start 2023-09-30T22:31:30.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.603+0000 7f01d79ce700 1 -- start start 2023-09-30T22:31:30.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.603+0000 7f01d79ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d009d630 0x7f01d0133850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d79ce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01d00a0a30 0x7f01d0133d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d79ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d0138d80 0x7f01d01342d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d79ce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0137000 con 0x7f01d00a0a30 2023-09-30T22:31:30.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d79ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d01359f0 con 0x7f01d0138d80 2023-09-30T22:31:30.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d79ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01d00a0480 con 0x7f01d009d630 2023-09-30T22:31:30.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d5f6b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d0138d80 0x7f01d01342d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d5f6b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d0138d80 0x7f01d01342d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42396/0 (socket says 172.21.15.59:42396) 2023-09-30T22:31:30.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d5f6b700 1 -- 172.21.15.59:0/3144609511 learned_addr learned my addr 172.21.15.59:0/3144609511 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:30.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d576a700 1 --2- 172.21.15.59:0/3144609511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d009d630 0x7f01d0133850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d4f69700 1 --2- 172.21.15.59:0/3144609511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01d00a0a30 0x7f01d0133d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d5f6b700 1 -- 172.21.15.59:0/3144609511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d009d630 msgr2=0x7f01d0133850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d5f6b700 1 --2- 172.21.15.59:0/3144609511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d009d630 0x7f01d0133850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d5f6b700 1 -- 172.21.15.59:0/3144609511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01d00a0a30 msgr2=0x7f01d0133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d5f6b700 1 --2- 172.21.15.59:0/3144609511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01d00a0a30 0x7f01d0133d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d5f6b700 1 -- 172.21.15.59:0/3144609511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c4009550 con 0x7f01d0138d80 2023-09-30T22:31:30.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.604+0000 7f01d5f6b700 1 --2- 172.21.15.59:0/3144609511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d0138d80 0x7f01d01342d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f01d00a2c00 tx=0x7f01c8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:30.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.605+0000 7f01cdffb700 1 -- 172.21.15.59:0/3144609511 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8012430 con 0x7f01d0138d80 2023-09-30T22:31:30.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.605+0000 7f01d79ce700 1 -- 172.21.15.59:0/3144609511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c8009a70 con 0x7f01d0138d80 2023-09-30T22:31:30.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.605+0000 7f01cdffb700 1 -- 172.21.15.59:0/3144609511 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c8020070 con 0x7f01d0138d80 2023-09-30T22:31:30.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.605+0000 7f01cdffb700 1 -- 172.21.15.59:0/3144609511 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80276c0 con 0x7f01d0138d80 2023-09-30T22:31:30.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.605+0000 7f01d79ce700 1 -- 172.21.15.59:0/3144609511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d0137ec0 con 0x7f01d0138d80 2023-09-30T22:31:30.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.606+0000 7f01d79ce700 1 -- 172.21.15.59:0/3144609511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d00747f0 con 0x7f01d0138d80 2023-09-30T22:31:30.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.606+0000 7f01cdffb700 1 -- 172.21.15.59:0/3144609511 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01c8031480 con 0x7f01d0138d80 2023-09-30T22:31:30.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.607+0000 7f01cdffb700 1 -- 172.21.15.59:0/3144609511 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f01c8022070 con 0x7f01d0138d80 2023-09-30T22:31:30.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.611+0000 7f01cdffb700 1 -- 172.21.15.59:0/3144609511 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01c8012e60 con 0x7f01d0138d80 2023-09-30T22:31:30.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:30.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.730+0000 7f6a3e70c700 1 -- 172.21.15.59:0/443838982 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6a38131290 con 0x7f6a3809e000 2023-09-30T22:31:30.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.730+0000 7f6a34ff9700 1 -- 172.21.15.59:0/443838982 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a38131290 con 0x7f6a3809e000 2023-09-30T22:31:30.731 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:30.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.733+0000 7f6a3e70c700 1 -- 172.21.15.59:0/443838982 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a3809e000 msgr2=0x7f6a3812e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.733+0000 7f6a3e70c700 1 --2- 172.21.15.59:0/443838982 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a3809e000 0x7f6a3812e630 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00ebe0 tx=0x7f6a2c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.733+0000 7f6a3e70c700 1 -- 172.21.15.59:0/443838982 shutdown_connections 2023-09-30T22:31:30.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.733+0000 7f6a3e70c700 1 --2- 172.21.15.59:0/443838982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3809e410 0x7f6a3812eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.733+0000 7f6a3e70c700 1 --2- 172.21.15.59:0/443838982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a3809d6f0 0x7f6a3812e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.733+0000 7f6a3e70c700 1 --2- 172.21.15.59:0/443838982 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a3809e000 0x7f6a3812e630 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.733+0000 7f6a3e70c700 1 -- 172.21.15.59:0/443838982 >> 172.21.15.59:0/443838982 conn(0x7f6a38066f50 msgr2=0x7f6a380a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:30.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.733+0000 7f6a3e70c700 1 -- 172.21.15.59:0/443838982 shutdown_connections 2023-09-30T22:31:30.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.733+0000 7f6a3e70c700 1 -- 172.21.15.59:0/443838982 wait complete. 2023-09-30T22:31:30.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:30.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.822+0000 7ff271680700 1 -- 172.21.15.59:0/758755857 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff26c120df0 con 0x7ff26c09d630 2023-09-30T22:31:30.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.822+0000 7ff2537fe700 1 -- 172.21.15.59:0/758755857 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff25c0243b0 con 0x7ff26c09d630 2023-09-30T22:31:30.824 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:30.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.825+0000 7ff271680700 1 -- 172.21.15.59:0/758755857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26c09d630 msgr2=0x7ff26c1c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.825+0000 7ff271680700 1 --2- 172.21.15.59:0/758755857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26c09d630 0x7ff26c1c8120 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00b370 tx=0x7ff25c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.825+0000 7ff271680700 1 -- 172.21.15.59:0/758755857 shutdown_connections 2023-09-30T22:31:30.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.825+0000 7ff271680700 1 --2- 172.21.15.59:0/758755857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26c09d630 0x7ff26c1c8120 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.825+0000 7ff271680700 1 --2- 172.21.15.59:0/758755857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c133930 0x7ff26c1c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.825+0000 7ff271680700 1 --2- 172.21.15.59:0/758755857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c0a0a30 0x7ff26c1c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.825+0000 7ff271680700 1 -- 172.21.15.59:0/758755857 >> 172.21.15.59:0/758755857 conn(0x7ff26c0a3050 msgr2=0x7ff26c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:30.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.825+0000 7ff271680700 1 -- 172.21.15.59:0/758755857 shutdown_connections 2023-09-30T22:31:30.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.825+0000 7ff271680700 1 -- 172.21.15.59:0/758755857 wait complete. 2023-09-30T22:31:30.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.833+0000 7f19e2315700 1 Processor -- start 2023-09-30T22:31:30.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.833+0000 7f19e2315700 1 -- start start 2023-09-30T22:31:30.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.834+0000 7f19e2315700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc09d6f0 0x7f19dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.834+0000 7f19e2315700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19dc09e410 0x7f19dc134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.834+0000 7f19e2315700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19dc09b120 con 0x7f19dc09e000 2023-09-30T22:31:30.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.834+0000 7f19e2315700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc06b460 con 0x7f19dc09e410 2023-09-30T22:31:30.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.834+0000 7f19e2315700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc09a7e0 con 0x7f19dc09d6f0 2023-09-30T22:31:30.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.834+0000 7f19dbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc09d6f0 0x7f19dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.834+0000 7f19db7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f19dc09e000 0x7f19dc1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45406/0 (socket says 172.21.15.59:45406) 2023-09-30T22:31:30.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.834+0000 7f19db7fe700 1 -- 172.21.15.59:0/423483284 learned_addr learned my addr 172.21.15.59:0/423483284 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:30.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.834+0000 7f19dbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc09d6f0 0x7f19dc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42402/0 (socket says 172.21.15.59:42402) 2023-09-30T22:31:30.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.834+0000 7f19e08b2700 1 --2- 172.21.15.59:0/423483284 >> v2:172.21.15.59:3300/0 conn(0x7f19dc09e410 0x7f19dc134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.834+0000 7f19daffd700 1 -- 172.21.15.59:0/423483284 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018130990 0 0) 0x7f19dc09b120 con 0x7f19dc09e000 2023-09-30T22:31:30.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.835+0000 7f19dbfff700 1 -- 172.21.15.59:0/423483284 >> v2:172.21.15.59:3300/0 conn(0x7f19dc09e410 msgr2=0x7f19dc134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:30.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.835+0000 7f19dbfff700 1 --2- 172.21.15.59:0/423483284 >> v2:172.21.15.59:3300/0 conn(0x7f19dc09e410 0x7f19dc134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.835+0000 7f19dbfff700 1 -- 172.21.15.59:0/423483284 >> v1:172.21.15.59:6789/0 conn(0x7f19dc09e000 legacy=0x7f19dc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.835+0000 7f19dbfff700 1 -- 172.21.15.59:0/423483284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc09a500 con 0x7f19dc09d6f0 2023-09-30T22:31:30.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.835+0000 7f19dbfff700 1 --2- 172.21.15.59:0/423483284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc09d6f0 0x7f19dc09dac0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009870 tx=0x7f19cc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14041991e280ad3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:30.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.835+0000 7f19daffd700 1 -- 172.21.15.59:0/423483284 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc011830 con 0x7f19dc09d6f0 2023-09-30T22:31:30.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.835+0000 7f19daffd700 1 -- 172.21.15.59:0/423483284 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc011990 con 0x7f19dc09d6f0 2023-09-30T22:31:30.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.835+0000 7f19daffd700 1 -- 172.21.15.59:0/423483284 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc011d20 con 0x7f19dc09d6f0 2023-09-30T22:31:30.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.836+0000 7f19e2315700 1 -- 172.21.15.59:0/423483284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc09d6f0 msgr2=0x7f19dc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.836+0000 7f19e2315700 1 --2- 172.21.15.59:0/423483284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc09d6f0 0x7f19dc09dac0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009870 tx=0x7f19cc009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:30.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.836+0000 7f19e2315700 1 -- 172.21.15.59:0/423483284 shutdown_connections 2023-09-30T22:31:30.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.836+0000 7f19e2315700 1 --2- 172.21.15.59:0/423483284 >> v2:172.21.15.59:3300/0 conn(0x7f19dc09e410 0x7f19dc134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.836+0000 7f19e2315700 1 --2- 172.21.15.59:0/423483284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc09d6f0 0x7f19dc09dac0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.836+0000 7f19e2315700 1 -- 172.21.15.59:0/423483284 >> 172.21.15.59:0/423483284 conn(0x7f19dc066f50 msgr2=0x7f19dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:30.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.836+0000 7f19e2315700 1 -- 172.21.15.59:0/423483284 shutdown_connections 2023-09-30T22:31:30.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.836+0000 7f19e2315700 1 -- 172.21.15.59:0/423483284 wait complete. 2023-09-30T22:31:30.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.837+0000 7f19e2315700 1 Processor -- start 2023-09-30T22:31:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.837+0000 7f19e2315700 1 -- start start 2023-09-30T22:31:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19e2315700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19dc09d6f0 0x7f19dc1a5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19e2315700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc09e000 0x7f19dc1a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19e2315700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc09e410 0x7f19dc1a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19e2315700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc1a7b10 con 0x7f19dc09d6f0 2023-09-30T22:31:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19e2315700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc1a8d60 con 0x7f19dc09e000 2023-09-30T22:31:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19e2315700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc1a80f0 con 0x7f19dc09e410 2023-09-30T22:31:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19db7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc09e000 0x7f19dc1a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19dbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19dc09d6f0 0x7f19dc1a5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19e08b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc09e410 0x7f19dc1a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19dbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19dc09d6f0 0x7f19dc1a5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36726/0 (socket says 172.21.15.59:36726) 2023-09-30T22:31:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19dbfff700 1 -- 172.21.15.59:0/1444303548 learned_addr learned my addr 172.21.15.59:0/1444303548 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:30.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19db7fe700 1 -- 172.21.15.59:0/1444303548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc09e410 msgr2=0x7f19dc1a6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19db7fe700 1 --2- 172.21.15.59:0/1444303548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc09e410 0x7f19dc1a6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19db7fe700 1 -- 172.21.15.59:0/1444303548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19dc09d6f0 msgr2=0x7f19dc1a5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19db7fe700 1 --2- 172.21.15.59:0/1444303548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19dc09d6f0 0x7f19dc1a5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19db7fe700 1 -- 172.21.15.59:0/1444303548 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc0094a0 con 0x7f19dc09e000 2023-09-30T22:31:30.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19dbfff700 1 --2- 172.21.15.59:0/1444303548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19dc09d6f0 0x7f19dc1a5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.838+0000 7f19e08b2700 1 --2- 172.21.15.59:0/1444303548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc09e410 0x7f19dc1a6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.839+0000 7f19db7fe700 1 --2- 172.21.15.59:0/1444303548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc09e000 0x7f19dc1a64d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f19d000c470 tx=0x7f19d000c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.839+0000 7f19d8ff9700 1 -- 172.21.15.59:0/1444303548 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0004c80 con 0x7f19dc09e000 2023-09-30T22:31:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.839+0000 7f19d8ff9700 1 -- 172.21.15.59:0/1444303548 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d0004de0 con 0x7f19dc09e000 2023-09-30T22:31:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.839+0000 7f19e2315700 1 -- 172.21.15.59:0/1444303548 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc1a9740 con 0x7f19dc09e000 2023-09-30T22:31:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.839+0000 7f19d8ff9700 1 -- 172.21.15.59:0/1444303548 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0007310 con 0x7f19dc09e000 2023-09-30T22:31:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.839+0000 7f19e2315700 1 -- 172.21.15.59:0/1444303548 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc09c710 con 0x7f19dc09e000 2023-09-30T22:31:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.840+0000 7f19d8ff9700 1 -- 172.21.15.59:0/1444303548 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19d0007470 con 0x7f19dc09e000 2023-09-30T22:31:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.840+0000 7f19d8ff9700 1 -- 172.21.15.59:0/1444303548 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f19d0040be0 con 0x7f19dc09e000 2023-09-30T22:31:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.840+0000 7f19e2315700 1 -- 172.21.15.59:0/1444303548 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc04ea50 con 0x7f19dc09e000 2023-09-30T22:31:30.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:30.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.845+0000 7f19d8ff9700 1 -- 172.21.15.59:0/1444303548 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19d0044060 con 0x7f19dc09e000 2023-09-30T22:31:30.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.867+0000 7f01d79ce700 1 -- 172.21.15.59:0/3144609511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f01d0135bc0 con 0x7f01d0138d80 2023-09-30T22:31:30.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.868+0000 7f01cdffb700 1 -- 172.21.15.59:0/3144609511 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f01c8036090 con 0x7f01d0138d80 2023-09-30T22:31:30.869 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:30.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.870+0000 7f01d79ce700 1 -- 172.21.15.59:0/3144609511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d0138d80 msgr2=0x7f01d01342d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.870+0000 7f01d79ce700 1 --2- 172.21.15.59:0/3144609511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d0138d80 0x7f01d01342d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f01d00a2c00 tx=0x7f01c8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.870+0000 7f01d79ce700 1 -- 172.21.15.59:0/3144609511 shutdown_connections 2023-09-30T22:31:30.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.870+0000 7f01d79ce700 1 --2- 172.21.15.59:0/3144609511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01d009d630 0x7f01d0133850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.870+0000 7f01d79ce700 1 --2- 172.21.15.59:0/3144609511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01d0138d80 0x7f01d01342d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.870+0000 7f01d79ce700 1 --2- 172.21.15.59:0/3144609511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01d00a0a30 0x7f01d0133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.870+0000 7f01d79ce700 1 -- 172.21.15.59:0/3144609511 >> 172.21.15.59:0/3144609511 conn(0x7f01d00a3050 msgr2=0x7f01d009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:30.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.870+0000 7f01d79ce700 1 -- 172.21.15.59:0/3144609511 shutdown_connections 2023-09-30T22:31:30.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:30.870+0000 7f01d79ce700 1 -- 172.21.15.59:0/3144609511 wait complete. 2023-09-30T22:31:30.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:31.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.050+0000 7f19e2315700 1 -- 172.21.15.59:0/1444303548 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f19dc074ea0 con 0x7f19dc09e000 2023-09-30T22:31:31.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.050+0000 7f19d8ff9700 1 -- 172.21.15.59:0/1444303548 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19d000ce40 con 0x7f19dc09e000 2023-09-30T22:31:31.052 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.052+0000 7f19e2315700 1 -- 172.21.15.59:0/1444303548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc09e000 msgr2=0x7f19dc1a64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.052+0000 7f19e2315700 1 --2- 172.21.15.59:0/1444303548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc09e000 0x7f19dc1a64d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f19d000c470 tx=0x7f19d000c780 comp rx=0 tx=0).stop 2023-09-30T22:31:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.052+0000 7f19e2315700 1 -- 172.21.15.59:0/1444303548 shutdown_connections 2023-09-30T22:31:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.052+0000 7f19e2315700 1 --2- 172.21.15.59:0/1444303548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc09e410 0x7f19dc1a6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.052+0000 7f19e2315700 1 --2- 172.21.15.59:0/1444303548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19dc09d6f0 0x7f19dc1a5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.052+0000 7f19e2315700 1 --2- 172.21.15.59:0/1444303548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc09e000 0x7f19dc1a64d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.052+0000 7f19e2315700 1 -- 172.21.15.59:0/1444303548 >> 172.21.15.59:0/1444303548 conn(0x7f19dc066f50 msgr2=0x7f19dc1bac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.053+0000 7f19e2315700 1 -- 172.21.15.59:0/1444303548 shutdown_connections 2023-09-30T22:31:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.053+0000 7f19e2315700 1 -- 172.21.15.59:0/1444303548 wait complete. 2023-09-30T22:31:31.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:31.750 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:31.845 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:31.886 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:31.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.897+0000 7f244829d700 1 Processor -- start 2023-09-30T22:31:31.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.897+0000 7f244829d700 1 -- start start 2023-09-30T22:31:31.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.898+0000 7f244829d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24401302b0 0x7f24400700d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.898+0000 7f244829d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f244012c260 0x7f244012c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.898+0000 7f244829d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2440130090 con 0x7f244012cbb0 2023-09-30T22:31:31.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.898+0000 7f244829d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2440070610 con 0x7f244012c260 2023-09-30T22:31:31.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.898+0000 7f244829d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f244009a210 con 0x7f24401302b0 2023-09-30T22:31:31.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.898+0000 7f2446039700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24401302b0 0x7f24400700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.898+0000 7f2446039700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24401302b0 0x7f24400700d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45788/0 (socket says 172.21.15.59:45788) 2023-09-30T22:31:31.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.898+0000 7f2446039700 1 -- 172.21.15.59:0/3339375110 learned_addr learned my addr 172.21.15.59:0/3339375110 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:31.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.898+0000 7f2445838700 1 --2- 172.21.15.59:0/3339375110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f244012c260 0x7f244012c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.898+0000 7f244683a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f244012cbb0 0x7f2440136b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45416/0 (socket says 172.21.15.59:45416) 2023-09-30T22:31:31.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.898+0000 7f2446039700 1 -- 172.21.15.59:0/3339375110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f244012c260 msgr2=0x7f244012c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:31.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.898+0000 7f2446039700 1 --2- 172.21.15.59:0/3339375110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f244012c260 0x7f244012c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.899+0000 7f2446039700 1 -- 172.21.15.59:0/3339375110 >> v1:172.21.15.59:6789/0 conn(0x7f244012cbb0 legacy=0x7f2440136b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.899+0000 7f2446039700 1 -- 172.21.15.59:0/3339375110 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2440099c70 con 0x7f24401302b0 2023-09-30T22:31:31.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.899+0000 7f2445037700 1 -- 172.21.15.59:0/3339375110 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691392152 0 0) 0x7f2440130090 con 0x7f244012cbb0 2023-09-30T22:31:31.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.899+0000 7f2446039700 1 --2- 172.21.15.59:0/3339375110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24401302b0 0x7f24400700d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f243c009920 tx=0x7f243c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9edf9c9259c5af0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:31.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.899+0000 7f2445037700 1 -- 172.21.15.59:0/3339375110 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c00b830 con 0x7f24401302b0 2023-09-30T22:31:31.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.899+0000 7f2445037700 1 -- 172.21.15.59:0/3339375110 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c00b990 con 0x7f24401302b0 2023-09-30T22:31:31.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.899+0000 7f2445037700 1 -- 172.21.15.59:0/3339375110 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c00bd20 con 0x7f24401302b0 2023-09-30T22:31:31.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.900+0000 7f244829d700 1 -- 172.21.15.59:0/3339375110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24401302b0 msgr2=0x7f24400700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.900+0000 7f244829d700 1 --2- 172.21.15.59:0/3339375110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24401302b0 0x7f24400700d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f243c009920 tx=0x7f243c009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:31.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.900+0000 7f244829d700 1 -- 172.21.15.59:0/3339375110 shutdown_connections 2023-09-30T22:31:31.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.900+0000 7f244829d700 1 --2- 172.21.15.59:0/3339375110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24401302b0 0x7f24400700d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.900+0000 7f244829d700 1 --2- 172.21.15.59:0/3339375110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f244012c260 0x7f244012c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.900+0000 7f244829d700 1 -- 172.21.15.59:0/3339375110 >> 172.21.15.59:0/3339375110 conn(0x7f24400a27f0 msgr2=0x7f24400a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:31.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.900+0000 7f244829d700 1 -- 172.21.15.59:0/3339375110 shutdown_connections 2023-09-30T22:31:31.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.900+0000 7f244829d700 1 -- 172.21.15.59:0/3339375110 wait complete. 2023-09-30T22:31:31.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.901+0000 7f244829d700 1 Processor -- start 2023-09-30T22:31:31.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.901+0000 7f244829d700 1 -- start start 2023-09-30T22:31:31.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.902+0000 7f244829d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f244012c260 0x7f2440118c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.902+0000 7f244829d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f244012cbb0 0x7f24401191a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.902+0000 7f244829d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24401302b0 0x7f24401196e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.902+0000 7f244829d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2440119ef0 con 0x7f24401302b0 2023-09-30T22:31:31.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.902+0000 7f244829d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2440119d00 con 0x7f244012cbb0 2023-09-30T22:31:31.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.902+0000 7f244829d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2440129ec0 con 0x7f244012c260 2023-09-30T22:31:31.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.902+0000 7f2445838700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f244012cbb0 0x7f24401191a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.902+0000 7f2445838700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f244012cbb0 0x7f24401191a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42424/0 (socket says 172.21.15.59:42424) 2023-09-30T22:31:31.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.902+0000 7f2445838700 1 -- 172.21.15.59:0/1931024251 learned_addr learned my addr 172.21.15.59:0/1931024251 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:31.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.902+0000 7f2446039700 1 --2- 172.21.15.59:0/1931024251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f244012c260 0x7f2440118c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.902+0000 7f244683a700 1 --2- 172.21.15.59:0/1931024251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24401302b0 0x7f24401196e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.903+0000 7f244683a700 1 -- 172.21.15.59:0/1931024251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f244012c260 msgr2=0x7f2440118c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.903+0000 7f244683a700 1 --2- 172.21.15.59:0/1931024251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f244012c260 0x7f2440118c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.903+0000 7f244683a700 1 -- 172.21.15.59:0/1931024251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f244012cbb0 msgr2=0x7f24401191a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.903+0000 7f244683a700 1 --2- 172.21.15.59:0/1931024251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f244012cbb0 0x7f24401191a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.903+0000 7f244683a700 1 -- 172.21.15.59:0/1931024251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c009550 con 0x7f24401302b0 2023-09-30T22:31:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.903+0000 7f2445838700 1 --2- 172.21.15.59:0/1931024251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f244012cbb0 0x7f24401191a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.903+0000 7f244683a700 1 --2- 172.21.15.59:0/1931024251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24401302b0 0x7f24401196e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f243800cc40 tx=0x7f243800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.903+0000 7f2436ffd700 1 -- 172.21.15.59:0/1931024251 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243800aa20 con 0x7f24401302b0 2023-09-30T22:31:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.903+0000 7f2436ffd700 1 -- 172.21.15.59:0/1931024251 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243800aba0 con 0x7f24401302b0 2023-09-30T22:31:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.903+0000 7f244829d700 1 -- 172.21.15.59:0/1931024251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2440129b90 con 0x7f24401302b0 2023-09-30T22:31:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.903+0000 7f2436ffd700 1 -- 172.21.15.59:0/1931024251 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24380070d0 con 0x7f24401302b0 2023-09-30T22:31:31.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.903+0000 7f244829d700 1 -- 172.21.15.59:0/1931024251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244011b8c0 con 0x7f24401302b0 2023-09-30T22:31:31.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.904+0000 7f2436ffd700 1 -- 172.21.15.59:0/1931024251 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2438007230 con 0x7f24401302b0 2023-09-30T22:31:31.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.904+0000 7f2436ffd700 1 -- 172.21.15.59:0/1931024251 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f243803f070 con 0x7f24401302b0 2023-09-30T22:31:31.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.904+0000 7f244829d700 1 -- 172.21.15.59:0/1931024251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2440071d90 con 0x7f24401302b0 2023-09-30T22:31:31.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.909+0000 7f2436ffd700 1 -- 172.21.15.59:0/1931024251 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2440071d90 con 0x7f24401302b0 2023-09-30T22:31:31.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.987+0000 7f643129b700 1 Processor -- start 2023-09-30T22:31:31.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.987+0000 7f643129b700 1 -- start start 2023-09-30T22:31:31.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f643129b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642c09e930 0x7f642c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f643129b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f642c09f240 0x7f642c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f643129b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f642c09f650 0x7f642c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f643129b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642c070940 con 0x7f642c09f650 2023-09-30T22:31:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f643129b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c06fd60 con 0x7f642c09e930 2023-09-30T22:31:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f643129b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f642c06fa80 con 0x7f642c09f240 2023-09-30T22:31:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f642affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642c09e930 0x7f642c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f642b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f642c09f650 0x7f642c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f642affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642c09e930 0x7f642c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42436/0 (socket says 172.21.15.59:42436) 2023-09-30T22:31:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f642affd700 1 -- 172.21.15.59:0/141748905 learned_addr learned my addr 172.21.15.59:0/141748905 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f642b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f642c09f650 0x7f642c131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36738/0 (socket says 172.21.15.59:36738) 2023-09-30T22:31:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f642a7fc700 1 --2- 172.21.15.59:0/141748905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f642c09f240 0x7f642c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f642affd700 1 -- 172.21.15.59:0/141748905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f642c09f240 msgr2=0x7f642c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:31.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f642affd700 1 --2- 172.21.15.59:0/141748905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f642c09f240 0x7f642c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f642affd700 1 -- 172.21.15.59:0/141748905 >> v2:172.21.15.59:3300/0 conn(0x7f642c09f650 msgr2=0x7f642c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:31.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f642affd700 1 --2- 172.21.15.59:0/141748905 >> v2:172.21.15.59:3300/0 conn(0x7f642c09f650 0x7f642c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f642affd700 1 -- 172.21.15.59:0/141748905 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c09fb60 con 0x7f642c09e930 2023-09-30T22:31:31.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.988+0000 7f642b7fe700 1 --2- 172.21.15.59:0/141748905 >> v2:172.21.15.59:3300/0 conn(0x7f642c09f650 0x7f642c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:31.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.989+0000 7f642affd700 1 --2- 172.21.15.59:0/141748905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642c09e930 0x7f642c09ed00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f641c0098f0 tx=0x7f641c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=113fac9311b76ed6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:31.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.989+0000 7f6429ffb700 1 -- 172.21.15.59:0/141748905 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c010a90 con 0x7f642c09e930 2023-09-30T22:31:31.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.989+0000 7f6429ffb700 1 -- 172.21.15.59:0/141748905 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c010bf0 con 0x7f642c09e930 2023-09-30T22:31:31.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.989+0000 7f6429ffb700 1 -- 172.21.15.59:0/141748905 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c018440 con 0x7f642c09e930 2023-09-30T22:31:31.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.990+0000 7f643129b700 1 -- 172.21.15.59:0/141748905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642c09e930 msgr2=0x7f642c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.990+0000 7f643129b700 1 --2- 172.21.15.59:0/141748905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642c09e930 0x7f642c09ed00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f641c0098f0 tx=0x7f641c009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:31.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.990+0000 7f643129b700 1 -- 172.21.15.59:0/141748905 shutdown_connections 2023-09-30T22:31:31.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.990+0000 7f643129b700 1 --2- 172.21.15.59:0/141748905 >> v2:172.21.15.59:3300/0 conn(0x7f642c09f650 0x7f642c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.990+0000 7f643129b700 1 --2- 172.21.15.59:0/141748905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642c09e930 0x7f642c09ed00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.990+0000 7f643129b700 1 --2- 172.21.15.59:0/141748905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f642c09f240 0x7f642c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.990+0000 7f643129b700 1 -- 172.21.15.59:0/141748905 >> 172.21.15.59:0/141748905 conn(0x7f642c0a4210 msgr2=0x7f642c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:31.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.990+0000 7f643129b700 1 -- 172.21.15.59:0/141748905 shutdown_connections 2023-09-30T22:31:31.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.990+0000 7f643129b700 1 -- 172.21.15.59:0/141748905 wait complete. 2023-09-30T22:31:31.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.991+0000 7f643129b700 1 Processor -- start 2023-09-30T22:31:31.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.991+0000 7f643129b700 1 -- start start 2023-09-30T22:31:31.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.991+0000 7f643129b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642c09e930 0x7f642c11d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f643129b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f642c09f240 0x7f642c11da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f643129b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f642c09f650 0x7f642c11dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f643129b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c1206e0 con 0x7f642c09f240 2023-09-30T22:31:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f643129b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c11f0d0 con 0x7f642c09e930 2023-09-30T22:31:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f643129b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f642c0a2fb0 con 0x7f642c09f650 2023-09-30T22:31:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f642affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642c09e930 0x7f642c11d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f642a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f642c09f240 0x7f642c11da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f642affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642c09e930 0x7f642c11d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42440/0 (socket says 172.21.15.59:42440) 2023-09-30T22:31:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f642affd700 1 -- 172.21.15.59:0/451935730 learned_addr learned my addr 172.21.15.59:0/451935730 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f642b7fe700 1 --2- 172.21.15.59:0/451935730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f642c09f650 0x7f642c11dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f642affd700 1 -- 172.21.15.59:0/451935730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f642c09f650 msgr2=0x7f642c11dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f642affd700 1 --2- 172.21.15.59:0/451935730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f642c09f650 0x7f642c11dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f642affd700 1 -- 172.21.15.59:0/451935730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f642c09f240 msgr2=0x7f642c11da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f642affd700 1 --2- 172.21.15.59:0/451935730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f642c09f240 0x7f642c11da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f642affd700 1 -- 172.21.15.59:0/451935730 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6424009a70 con 0x7f642c09e930 2023-09-30T22:31:31.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.992+0000 7f642affd700 1 --2- 172.21.15.59:0/451935730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642c09e930 0x7f642c11d550 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f641c009c40 tx=0x7f641c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:31.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.993+0000 7f64137fe700 1 -- 172.21.15.59:0/451935730 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c0038a0 con 0x7f642c09e930 2023-09-30T22:31:31.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.993+0000 7f64137fe700 1 -- 172.21.15.59:0/451935730 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c003a20 con 0x7f642c09e930 2023-09-30T22:31:31.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.993+0000 7f643129b700 1 -- 172.21.15.59:0/451935730 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641c009550 con 0x7f642c09e930 2023-09-30T22:31:31.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.993+0000 7f64137fe700 1 -- 172.21.15.59:0/451935730 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c003dd0 con 0x7f642c09e930 2023-09-30T22:31:31.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.993+0000 7f643129b700 1 -- 172.21.15.59:0/451935730 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642c0a0190 con 0x7f642c09e930 2023-09-30T22:31:31.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.993+0000 7f64137fe700 1 -- 172.21.15.59:0/451935730 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f641c01f070 con 0x7f642c09e930 2023-09-30T22:31:31.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.994+0000 7f64137fe700 1 -- 172.21.15.59:0/451935730 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f641c045130 con 0x7f642c09e930 2023-09-30T22:31:31.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.994+0000 7f643129b700 1 -- 172.21.15.59:0/451935730 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642c074ea0 con 0x7f642c09e930 2023-09-30T22:31:31.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:31.999+0000 7f64137fe700 1 -- 172.21.15.59:0/451935730 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f641c020790 con 0x7f642c09e930 2023-09-30T22:31:32.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.031+0000 7fabce165700 1 Processor -- start 2023-09-30T22:31:32.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.031+0000 7fabce165700 1 -- start start 2023-09-30T22:31:32.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabce165700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc809d6f0 0x7fabc809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabce165700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabc809e000 0x7fabc81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabce165700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc809b120 con 0x7fabc809e410 2023-09-30T22:31:32.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabce165700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc806b460 con 0x7fabc809d6f0 2023-09-30T22:31:32.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabce165700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabc809a7e0 con 0x7fabc809e000 2023-09-30T22:31:32.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabc7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fabc809e410 0x7fabc8133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45420/0 (socket says 172.21.15.59:45420) 2023-09-30T22:31:32.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabc77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc809d6f0 0x7fabc809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabc7fff700 1 -- 172.21.15.59:0/2037346002 learned_addr learned my addr 172.21.15.59:0/2037346002 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabc6ffd700 1 --2- 172.21.15.59:0/2037346002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabc809e000 0x7fabc81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabc67fc700 1 -- 172.21.15.59:0/2037346002 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311804294 0 0) 0x7fabc809b120 con 0x7fabc809e410 2023-09-30T22:31:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabc67fc700 1 -- 172.21.15.59:0/2037346002 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabb00035b0 con 0x7fabc809e410 2023-09-30T22:31:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabc77fe700 1 -- 172.21.15.59:0/2037346002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabc809e000 msgr2=0x7fabc81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabc77fe700 1 --2- 172.21.15.59:0/2037346002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabc809e000 0x7fabc81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabc77fe700 1 -- 172.21.15.59:0/2037346002 >> v1:172.21.15.59:6789/0 conn(0x7fabc809e410 legacy=0x7fabc8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabc77fe700 1 -- 172.21.15.59:0/2037346002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc809a500 con 0x7fabc809d6f0 2023-09-30T22:31:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.032+0000 7fabc6ffd700 1 --2- 172.21.15.59:0/2037346002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabc809e000 0x7fabc81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.033+0000 7fabc77fe700 1 --2- 172.21.15.59:0/2037346002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc809d6f0 0x7fabc809dac0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009870 tx=0x7fabb8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b880256ce83462f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.033+0000 7fabc67fc700 1 -- 172.21.15.59:0/2037346002 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8011830 con 0x7fabc809d6f0 2023-09-30T22:31:32.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.033+0000 7fabc67fc700 1 -- 172.21.15.59:0/2037346002 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb8011990 con 0x7fabc809d6f0 2023-09-30T22:31:32.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.033+0000 7fabc67fc700 1 -- 172.21.15.59:0/2037346002 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8011d20 con 0x7fabc809d6f0 2023-09-30T22:31:32.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.033+0000 7fabce165700 1 -- 172.21.15.59:0/2037346002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc809d6f0 msgr2=0x7fabc809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.033+0000 7fabce165700 1 --2- 172.21.15.59:0/2037346002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc809d6f0 0x7fabc809dac0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009870 tx=0x7fabb8009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:32.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.034+0000 7fabce165700 1 -- 172.21.15.59:0/2037346002 shutdown_connections 2023-09-30T22:31:32.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.034+0000 7fabce165700 1 --2- 172.21.15.59:0/2037346002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc809d6f0 0x7fabc809dac0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.034+0000 7fabce165700 1 --2- 172.21.15.59:0/2037346002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabc809e000 0x7fabc81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.034+0000 7fabce165700 1 -- 172.21.15.59:0/2037346002 >> 172.21.15.59:0/2037346002 conn(0x7fabc8066f50 msgr2=0x7fabc809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:32.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.034+0000 7fabce165700 1 -- 172.21.15.59:0/2037346002 shutdown_connections 2023-09-30T22:31:32.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.034+0000 7fabce165700 1 -- 172.21.15.59:0/2037346002 wait complete. 2023-09-30T22:31:32.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.035+0000 7fabce165700 1 Processor -- start 2023-09-30T22:31:32.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.035+0000 7fabce165700 1 -- start start 2023-09-30T22:31:32.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.035+0000 7fabce165700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabc809d6f0 0x7fabc81222c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.035+0000 7fabce165700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabc809e000 0x7fabc8122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.035+0000 7fabce165700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc809e410 0x7fabc8122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.035+0000 7fabce165700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc809c710 con 0x7fabc809d6f0 2023-09-30T22:31:32.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.035+0000 7fabce165700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc8124da0 con 0x7fabc809e410 2023-09-30T22:31:32.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.035+0000 7fabce165700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabc8133690 con 0x7fabc809e000 2023-09-30T22:31:32.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabc77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabc809d6f0 0x7fabc81222c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabc6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabc809e000 0x7fabc8122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabc77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabc809d6f0 0x7fabc81222c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36762/0 (socket says 172.21.15.59:36762) 2023-09-30T22:31:32.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabc77fe700 1 -- 172.21.15.59:0/1996929967 learned_addr learned my addr 172.21.15.59:0/1996929967 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:32.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabc6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabc809e000 0x7fabc8122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45832/0 (socket says 172.21.15.59:45832) 2023-09-30T22:31:32.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabc7fff700 1 --2- 172.21.15.59:0/1996929967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc809e410 0x7fabc8122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabc6ffd700 1 -- 172.21.15.59:0/1996929967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc809e410 msgr2=0x7fabc8122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabc6ffd700 1 --2- 172.21.15.59:0/1996929967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc809e410 0x7fabc8122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabc6ffd700 1 -- 172.21.15.59:0/1996929967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabc809d6f0 msgr2=0x7fabc81222c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabc6ffd700 1 --2- 172.21.15.59:0/1996929967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabc809d6f0 0x7fabc81222c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabc6ffd700 1 -- 172.21.15.59:0/1996929967 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc0094a0 con 0x7fabc809e000 2023-09-30T22:31:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabc77fe700 1 --2- 172.21.15.59:0/1996929967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabc809d6f0 0x7fabc81222c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabc6ffd700 1 --2- 172.21.15.59:0/1996929967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabc809e000 0x7fabc8122800 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00e980 tx=0x7fabbc00ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabaffff700 1 -- 172.21.15.59:0/1996929967 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00c690 con 0x7fabc809e000 2023-09-30T22:31:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabaffff700 1 -- 172.21.15.59:0/1996929967 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc00c7f0 con 0x7fabc809e000 2023-09-30T22:31:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabce165700 1 -- 172.21.15.59:0/1996929967 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb80094a0 con 0x7fabc809e000 2023-09-30T22:31:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabaffff700 1 -- 172.21.15.59:0/1996929967 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00cb80 con 0x7fabc809e000 2023-09-30T22:31:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.036+0000 7fabce165700 1 -- 172.21.15.59:0/1996929967 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc80a2910 con 0x7fabc809e000 2023-09-30T22:31:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.037+0000 7fabce165700 1 -- 172.21.15.59:0/1996929967 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc811f030 con 0x7fabc809e000 2023-09-30T22:31:32.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.038+0000 7fabaffff700 1 -- 172.21.15.59:0/1996929967 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabbc00cce0 con 0x7fabc809e000 2023-09-30T22:31:32.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.038+0000 7fabaffff700 1 -- 172.21.15.59:0/1996929967 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fabbc03ff50 con 0x7fabc809e000 2023-09-30T22:31:32.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.043+0000 7fabaffff700 1 -- 172.21.15.59:0/1996929967 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabbc011350 con 0x7fabc809e000 2023-09-30T22:31:32.068 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:32.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.123+0000 7f244829d700 1 -- 172.21.15.59:0/1931024251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2440071d90 con 0x7f24401302b0 2023-09-30T22:31:32.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.123+0000 7f2436ffd700 1 -- 172.21.15.59:0/1931024251 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2440071d90 con 0x7f24401302b0 2023-09-30T22:31:32.125 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:32.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.126+0000 7f244829d700 1 -- 172.21.15.59:0/1931024251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24401302b0 msgr2=0x7f24401196e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.126+0000 7f244829d700 1 --2- 172.21.15.59:0/1931024251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24401302b0 0x7f24401196e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f243800cc40 tx=0x7f243800cf50 comp rx=0 tx=0).stop 2023-09-30T22:31:32.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.126+0000 7f244829d700 1 -- 172.21.15.59:0/1931024251 shutdown_connections 2023-09-30T22:31:32.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.126+0000 7f244829d700 1 --2- 172.21.15.59:0/1931024251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f244012c260 0x7f2440118c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.126+0000 7f244829d700 1 --2- 172.21.15.59:0/1931024251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24401302b0 0x7f24401196e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.126+0000 7f244829d700 1 --2- 172.21.15.59:0/1931024251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f244012cbb0 0x7f24401191a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.126+0000 7f244829d700 1 -- 172.21.15.59:0/1931024251 >> 172.21.15.59:0/1931024251 conn(0x7f24400a27f0 msgr2=0x7f244006f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:32.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.126+0000 7f244829d700 1 -- 172.21.15.59:0/1931024251 shutdown_connections 2023-09-30T22:31:32.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.126+0000 7f244829d700 1 -- 172.21.15.59:0/1931024251 wait complete. 2023-09-30T22:31:32.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:32.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.208+0000 7ff0e491d700 1 Processor -- start 2023-09-30T22:31:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.208+0000 7ff0e491d700 1 -- start start 2023-09-30T22:31:32.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.209+0000 7ff0e491d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0e009f410 0x7ff0e0136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.209+0000 7ff0e491d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0e0136fe0 0x7ff0e01393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.209+0000 7ff0e491d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e0070940 con 0x7ff0e009e930 2023-09-30T22:31:32.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.209+0000 7ff0e491d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e006fd60 con 0x7ff0e009f410 2023-09-30T22:31:32.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.209+0000 7ff0e491d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e006fa80 con 0x7ff0e0136fe0 2023-09-30T22:31:32.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.209+0000 7ff0ded9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0e0136fe0 0x7ff0e01393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.209+0000 7ff0ddd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0e009f410 0x7ff0e0136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.209+0000 7ff0ded9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0e0136fe0 0x7ff0e01393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45836/0 (socket says 172.21.15.59:45836) 2023-09-30T22:31:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.209+0000 7ff0ddd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0e009f410 0x7ff0e0136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42456/0 (socket says 172.21.15.59:42456) 2023-09-30T22:31:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.209+0000 7ff0de59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff0e009e930 0x7ff0e009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45430/0 (socket says 172.21.15.59:45430) 2023-09-30T22:31:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.209+0000 7ff0ded9d700 1 -- 172.21.15.59:0/1931809489 learned_addr learned my addr 172.21.15.59:0/1931809489 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.210+0000 7ff0dd59a700 1 -- 172.21.15.59:0/1931809489 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921989314 0 0) 0x7ff0e0070940 con 0x7ff0e009e930 2023-09-30T22:31:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.210+0000 7ff0ded9d700 1 -- 172.21.15.59:0/1931809489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0e009f410 msgr2=0x7ff0e0136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.210+0000 7ff0ded9d700 1 --2- 172.21.15.59:0/1931809489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0e009f410 0x7ff0e0136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.210+0000 7ff0ded9d700 1 -- 172.21.15.59:0/1931809489 >> v1:172.21.15.59:6789/0 conn(0x7ff0e009e930 legacy=0x7ff0e009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.210+0000 7ff0ded9d700 1 -- 172.21.15.59:0/1931809489 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e009fb60 con 0x7ff0e0136fe0 2023-09-30T22:31:32.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.210+0000 7ff0ded9d700 1 --2- 172.21.15.59:0/1931809489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0e0136fe0 0x7ff0e01393c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009e80 tx=0x7ff0d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ef6ffabd83c53ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:32.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.210+0000 7ff0dd59a700 1 -- 172.21.15.59:0/1931809489 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800e070 con 0x7ff0e0136fe0 2023-09-30T22:31:32.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.210+0000 7ff0dd59a700 1 -- 172.21.15.59:0/1931809489 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d800b910 con 0x7ff0e0136fe0 2023-09-30T22:31:32.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.210+0000 7ff0dd59a700 1 -- 172.21.15.59:0/1931809489 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800bcc0 con 0x7ff0e0136fe0 2023-09-30T22:31:32.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.211+0000 7ff0e491d700 1 -- 172.21.15.59:0/1931809489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0e0136fe0 msgr2=0x7ff0e01393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.211+0000 7ff0e491d700 1 --2- 172.21.15.59:0/1931809489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0e0136fe0 0x7ff0e01393c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009e80 tx=0x7ff0d800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:32.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.211+0000 7ff0e491d700 1 -- 172.21.15.59:0/1931809489 shutdown_connections 2023-09-30T22:31:32.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.211+0000 7ff0e491d700 1 --2- 172.21.15.59:0/1931809489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0e0136fe0 0x7ff0e01393c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.211+0000 7ff0e491d700 1 --2- 172.21.15.59:0/1931809489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0e009f410 0x7ff0e0136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.211+0000 7ff0e491d700 1 -- 172.21.15.59:0/1931809489 >> 172.21.15.59:0/1931809489 conn(0x7ff0e00a4210 msgr2=0x7ff0e00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:32.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.211+0000 7ff0e491d700 1 -- 172.21.15.59:0/1931809489 shutdown_connections 2023-09-30T22:31:32.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.211+0000 7ff0e491d700 1 -- 172.21.15.59:0/1931809489 wait complete. 2023-09-30T22:31:32.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.212+0000 7ff0e491d700 1 Processor -- start 2023-09-30T22:31:32.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.212+0000 7ff0e491d700 1 -- start start 2023-09-30T22:31:32.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.213+0000 7ff0e491d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e009e930 0x7ff0e01c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.213+0000 7ff0e491d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0e009f410 0x7ff0e01c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.213+0000 7ff0e491d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0e0136fe0 0x7ff0e006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.213+0000 7ff0e491d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e01345f0 con 0x7ff0e009e930 2023-09-30T22:31:32.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.213+0000 7ff0e491d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e006d640 con 0x7ff0e009f410 2023-09-30T22:31:32.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.213+0000 7ff0e491d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0122ae0 con 0x7ff0e0136fe0 2023-09-30T22:31:32.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.213+0000 7ff0ddd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0e009f410 0x7ff0e01c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.213+0000 7ff0ddd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0e009f410 0x7ff0e01c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42470/0 (socket says 172.21.15.59:42470) 2023-09-30T22:31:32.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.213+0000 7ff0ddd9b700 1 -- 172.21.15.59:0/2863609179 learned_addr learned my addr 172.21.15.59:0/2863609179 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:32.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.213+0000 7ff0de59c700 1 --2- 172.21.15.59:0/2863609179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e009e930 0x7ff0e01c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.213+0000 7ff0ded9d700 1 --2- 172.21.15.59:0/2863609179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0e0136fe0 0x7ff0e006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.214+0000 7ff0ded9d700 1 -- 172.21.15.59:0/2863609179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0e009f410 msgr2=0x7ff0e01c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.214+0000 7ff0ded9d700 1 --2- 172.21.15.59:0/2863609179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0e009f410 0x7ff0e01c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.214+0000 7ff0ded9d700 1 -- 172.21.15.59:0/2863609179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e009e930 msgr2=0x7ff0e01c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.214+0000 7ff0ded9d700 1 --2- 172.21.15.59:0/2863609179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e009e930 0x7ff0e01c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.214+0000 7ff0ded9d700 1 -- 172.21.15.59:0/2863609179 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d8009b30 con 0x7ff0e0136fe0 2023-09-30T22:31:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.214+0000 7ff0ddd9b700 1 --2- 172.21.15.59:0/2863609179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0e009f410 0x7ff0e01c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.214+0000 7ff0de59c700 1 --2- 172.21.15.59:0/2863609179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e009e930 0x7ff0e01c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.214+0000 7ff0ded9d700 1 --2- 172.21.15.59:0/2863609179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0e0136fe0 0x7ff0e006b8b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8015000 tx=0x7ff0d8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.214+0000 7ff0ceffd700 1 -- 172.21.15.59:0/2863609179 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8004450 con 0x7ff0e0136fe0 2023-09-30T22:31:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.214+0000 7ff0ceffd700 1 -- 172.21.15.59:0/2863609179 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d80045b0 con 0x7ff0e0136fe0 2023-09-30T22:31:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.214+0000 7ff0e491d700 1 -- 172.21.15.59:0/2863609179 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e0124190 con 0x7ff0e0136fe0 2023-09-30T22:31:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.214+0000 7ff0ceffd700 1 -- 172.21.15.59:0/2863609179 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8004940 con 0x7ff0e0136fe0 2023-09-30T22:31:32.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.214+0000 7ff0e491d700 1 -- 172.21.15.59:0/2863609179 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e00a32f0 con 0x7ff0e0136fe0 2023-09-30T22:31:32.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.215+0000 7ff0ceffd700 1 -- 172.21.15.59:0/2863609179 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0d8025460 con 0x7ff0e0136fe0 2023-09-30T22:31:32.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.215+0000 7ff0ceffd700 1 -- 172.21.15.59:0/2863609179 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff0d8041770 con 0x7ff0e0136fe0 2023-09-30T22:31:32.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.216+0000 7ff0e491d700 1 -- 172.21.15.59:0/2863609179 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e0071d20 con 0x7ff0e0136fe0 2023-09-30T22:31:32.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.219+0000 7f643129b700 1 -- 172.21.15.59:0/451935730 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f642c130430 con 0x7f642c09e930 2023-09-30T22:31:32.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.219+0000 7f64137fe700 1 -- 172.21.15.59:0/451935730 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f641c027030 con 0x7f642c09e930 2023-09-30T22:31:32.221 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:32.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.222+0000 7f643129b700 1 -- 172.21.15.59:0/451935730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642c09e930 msgr2=0x7f642c11d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.222+0000 7f643129b700 1 --2- 172.21.15.59:0/451935730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642c09e930 0x7f642c11d550 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f641c009c40 tx=0x7f641c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:32.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.222+0000 7f643129b700 1 -- 172.21.15.59:0/451935730 shutdown_connections 2023-09-30T22:31:32.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.222+0000 7f643129b700 1 --2- 172.21.15.59:0/451935730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f642c09f650 0x7f642c11dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.222+0000 7f643129b700 1 --2- 172.21.15.59:0/451935730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642c09e930 0x7f642c11d550 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.222+0000 7f643129b700 1 --2- 172.21.15.59:0/451935730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f642c09f240 0x7f642c11da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.222+0000 7f643129b700 1 -- 172.21.15.59:0/451935730 >> 172.21.15.59:0/451935730 conn(0x7f642c0a4210 msgr2=0x7f642c1308e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:32.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.222+0000 7f643129b700 1 -- 172.21.15.59:0/451935730 shutdown_connections 2023-09-30T22:31:32.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.222+0000 7f643129b700 1 -- 172.21.15.59:0/451935730 wait complete. 2023-09-30T22:31:32.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.225+0000 7ff0ceffd700 1 -- 172.21.15.59:0/2863609179 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0d801b990 con 0x7ff0e0136fe0 2023-09-30T22:31:32.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:32.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.269+0000 7fabce165700 1 -- 172.21.15.59:0/1996929967 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fabc806c360 con 0x7fabc809e000 2023-09-30T22:31:32.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.270+0000 7fabaffff700 1 -- 172.21.15.59:0/1996929967 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabbc021020 con 0x7fabc809e000 2023-09-30T22:31:32.271 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:32.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.272+0000 7fabce165700 1 -- 172.21.15.59:0/1996929967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabc809e000 msgr2=0x7fabc8122800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.272+0000 7fabce165700 1 --2- 172.21.15.59:0/1996929967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabc809e000 0x7fabc8122800 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00e980 tx=0x7fabbc00ec90 comp rx=0 tx=0).stop 2023-09-30T22:31:32.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.272+0000 7fabce165700 1 -- 172.21.15.59:0/1996929967 shutdown_connections 2023-09-30T22:31:32.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.272+0000 7fabce165700 1 --2- 172.21.15.59:0/1996929967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc809e410 0x7fabc8122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.272+0000 7fabce165700 1 --2- 172.21.15.59:0/1996929967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabc809d6f0 0x7fabc81222c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.272+0000 7fabce165700 1 --2- 172.21.15.59:0/1996929967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabc809e000 0x7fabc8122800 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.272+0000 7fabce165700 1 -- 172.21.15.59:0/1996929967 >> 172.21.15.59:0/1996929967 conn(0x7fabc8066f50 msgr2=0x7fabc8133e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:32.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.272+0000 7fabce165700 1 -- 172.21.15.59:0/1996929967 shutdown_connections 2023-09-30T22:31:32.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.272+0000 7fabce165700 1 -- 172.21.15.59:0/1996929967 wait complete. 2023-09-30T22:31:32.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:32.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.436+0000 7ff0e491d700 1 -- 172.21.15.59:0/2863609179 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff0e0074ea0 con 0x7ff0e0136fe0 2023-09-30T22:31:32.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.437+0000 7ff0ceffd700 1 -- 172.21.15.59:0/2863609179 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0d802e3e0 con 0x7ff0e0136fe0 2023-09-30T22:31:32.438 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:32.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.439+0000 7ff0e491d700 1 -- 172.21.15.59:0/2863609179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0e0136fe0 msgr2=0x7ff0e006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.439+0000 7ff0e491d700 1 --2- 172.21.15.59:0/2863609179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0e0136fe0 0x7ff0e006b8b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8015000 tx=0x7ff0d8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.439+0000 7ff0e491d700 1 -- 172.21.15.59:0/2863609179 shutdown_connections 2023-09-30T22:31:32.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.439+0000 7ff0e491d700 1 --2- 172.21.15.59:0/2863609179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0e0136fe0 0x7ff0e006b8b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.439+0000 7ff0e491d700 1 --2- 172.21.15.59:0/2863609179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0e009e930 0x7ff0e01c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.439+0000 7ff0e491d700 1 --2- 172.21.15.59:0/2863609179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0e009f410 0x7ff0e01c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.439+0000 7ff0e491d700 1 -- 172.21.15.59:0/2863609179 >> 172.21.15.59:0/2863609179 conn(0x7ff0e00a4210 msgr2=0x7ff0e00a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:32.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.439+0000 7ff0e491d700 1 -- 172.21.15.59:0/2863609179 shutdown_connections 2023-09-30T22:31:32.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:32.439+0000 7ff0e491d700 1 -- 172.21.15.59:0/2863609179 wait complete. 2023-09-30T22:31:32.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:33.142 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:33.242 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:33.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.288+0000 7ff5440ae700 1 Processor -- start 2023-09-30T22:31:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.288+0000 7ff5440ae700 1 -- start start 2023-09-30T22:31:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff5440ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff53c0a0a30 0x7ff53c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff5440ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c134170 0x7ff53c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff5440ae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53c09edd0 con 0x7ff53c0a1340 2023-09-30T22:31:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff5440ae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c09e1f0 con 0x7ff53c134170 2023-09-30T22:31:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff5440ae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c09dc50 con 0x7ff53c0a0a30 2023-09-30T22:31:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff54264b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c134170 0x7ff53c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff541e4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff53c0a0a30 0x7ff53c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff54264b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c134170 0x7ff53c13bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42478/0 (socket says 172.21.15.59:42478) 2023-09-30T22:31:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff541e4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff53c0a0a30 0x7ff53c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45840/0 (socket says 172.21.15.59:45840) 2023-09-30T22:31:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff54264b700 1 -- 172.21.15.59:0/2602134049 learned_addr learned my addr 172.21.15.59:0/2602134049 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:33.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff54264b700 1 -- 172.21.15.59:0/2602134049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff53c0a0a30 msgr2=0x7ff53c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:33.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff54264b700 1 --2- 172.21.15.59:0/2602134049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff53c0a0a30 0x7ff53c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff54264b700 1 -- 172.21.15.59:0/2602134049 >> v1:172.21.15.59:6789/0 conn(0x7ff53c0a1340 legacy=0x7ff53c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff54264b700 1 -- 172.21.15.59:0/2602134049 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0a1fe0 con 0x7ff53c134170 2023-09-30T22:31:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff541e4a700 1 --2- 172.21.15.59:0/2602134049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff53c0a0a30 0x7ff53c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.289+0000 7ff54264b700 1 --2- 172.21.15.59:0/2602134049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c134170 0x7ff53c13bd30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff534009e80 tx=0x7ff53400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40ef8b3f5980c66a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.290+0000 7ff540e48700 1 -- 172.21.15.59:0/2602134049 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53400e070 con 0x7ff53c134170 2023-09-30T22:31:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.290+0000 7ff540e48700 1 -- 172.21.15.59:0/2602134049 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53400b910 con 0x7ff53c134170 2023-09-30T22:31:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.290+0000 7ff540e48700 1 -- 172.21.15.59:0/2602134049 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53400bcc0 con 0x7ff53c134170 2023-09-30T22:31:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.290+0000 7ff5440ae700 1 -- 172.21.15.59:0/2602134049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c134170 msgr2=0x7ff53c13bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.290+0000 7ff5440ae700 1 --2- 172.21.15.59:0/2602134049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c134170 0x7ff53c13bd30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff534009e80 tx=0x7ff53400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.290+0000 7ff5440ae700 1 -- 172.21.15.59:0/2602134049 shutdown_connections 2023-09-30T22:31:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.290+0000 7ff5440ae700 1 --2- 172.21.15.59:0/2602134049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff53c0a0a30 0x7ff53c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.290+0000 7ff5440ae700 1 --2- 172.21.15.59:0/2602134049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c134170 0x7ff53c13bd30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.290+0000 7ff5440ae700 1 -- 172.21.15.59:0/2602134049 >> 172.21.15.59:0/2602134049 conn(0x7ff53c0a6550 msgr2=0x7ff53c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.291+0000 7ff5440ae700 1 -- 172.21.15.59:0/2602134049 shutdown_connections 2023-09-30T22:31:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.291+0000 7ff5440ae700 1 -- 172.21.15.59:0/2602134049 wait complete. 2023-09-30T22:31:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.292+0000 7ff5440ae700 1 Processor -- start 2023-09-30T22:31:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.292+0000 7ff5440ae700 1 -- start start 2023-09-30T22:31:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.292+0000 7ff5440ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0a0a30 0x7ff53c1c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.292+0000 7ff5440ae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0a1340 0x7ff53c1c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.292+0000 7ff5440ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff53c134170 0x7ff53c1c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.292+0000 7ff5440ae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c124670 con 0x7ff53c0a1340 2023-09-30T22:31:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.292+0000 7ff5440ae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c124480 con 0x7ff53c0a0a30 2023-09-30T22:31:33.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.292+0000 7ff5440ae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c126120 con 0x7ff53c134170 2023-09-30T22:31:33.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.292+0000 7ff541e4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0a0a30 0x7ff53c1c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.292+0000 7ff541e4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0a0a30 0x7ff53c1c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42494/0 (socket says 172.21.15.59:42494) 2023-09-30T22:31:33.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.292+0000 7ff541e4a700 1 -- 172.21.15.59:0/477805265 learned_addr learned my addr 172.21.15.59:0/477805265 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:33.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.292+0000 7ff541649700 1 --2- 172.21.15.59:0/477805265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0a1340 0x7ff53c1c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.293+0000 7ff541e4a700 1 -- 172.21.15.59:0/477805265 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff53c134170 msgr2=0x7ff53c1c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.293+0000 7ff541e4a700 1 --2- 172.21.15.59:0/477805265 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff53c134170 0x7ff53c1c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.293+0000 7ff541e4a700 1 -- 172.21.15.59:0/477805265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0a1340 msgr2=0x7ff53c1c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.293+0000 7ff541e4a700 1 --2- 172.21.15.59:0/477805265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0a1340 0x7ff53c1c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.293+0000 7ff541e4a700 1 -- 172.21.15.59:0/477805265 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5380094a0 con 0x7ff53c0a0a30 2023-09-30T22:31:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.293+0000 7ff541e4a700 1 --2- 172.21.15.59:0/477805265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0a0a30 0x7ff53c1c83b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff53800ec40 tx=0x7ff53800ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.293+0000 7ff5327fc700 1 -- 172.21.15.59:0/477805265 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53800c910 con 0x7ff53c0a0a30 2023-09-30T22:31:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.293+0000 7ff5327fc700 1 -- 172.21.15.59:0/477805265 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53800ca70 con 0x7ff53c0a0a30 2023-09-30T22:31:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.293+0000 7ff5440ae700 1 -- 172.21.15.59:0/477805265 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff534009b30 con 0x7ff53c0a0a30 2023-09-30T22:31:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.293+0000 7ff5327fc700 1 -- 172.21.15.59:0/477805265 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53800cde0 con 0x7ff53c0a0a30 2023-09-30T22:31:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.293+0000 7ff5440ae700 1 -- 172.21.15.59:0/477805265 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c0a25e0 con 0x7ff53c0a0a30 2023-09-30T22:31:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.294+0000 7ff5327fc700 1 -- 172.21.15.59:0/477805265 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff538013470 con 0x7ff53c0a0a30 2023-09-30T22:31:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.295+0000 7ff5440ae700 1 -- 172.21.15.59:0/477805265 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c125d50 con 0x7ff53c0a0a30 2023-09-30T22:31:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.295+0000 7ff5327fc700 1 -- 172.21.15.59:0/477805265 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff53803fd10 con 0x7ff53c0a0a30 2023-09-30T22:31:33.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.300+0000 7ff5327fc700 1 -- 172.21.15.59:0/477805265 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff53801b3b0 con 0x7ff53c0a0a30 2023-09-30T22:31:33.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.385+0000 7f2284dd1700 1 Processor -- start 2023-09-30T22:31:33.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.385+0000 7f2284dd1700 1 -- start start 2023-09-30T22:31:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.385+0000 7f2284dd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22800a0a30 0x7f22800a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.385+0000 7f2284dd1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2280134000 0x7f228013bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.385+0000 7f2284dd1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228009eaf0 con 0x7f22800a1340 2023-09-30T22:31:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.385+0000 7f2284dd1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22800a27c0 con 0x7f2280134000 2023-09-30T22:31:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.385+0000 7f2284dd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228009dbe0 con 0x7f22800a0a30 2023-09-30T22:31:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.386+0000 7f227e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22800a0a30 0x7f22800a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.386+0000 7f227ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2280134000 0x7f228013bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.386+0000 7f227e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22800a0a30 0x7f22800a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42510/0 (socket says 172.21.15.59:42510) 2023-09-30T22:31:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.386+0000 7f227ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2280134000 0x7f228013bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36794/0 (socket says 172.21.15.59:36794) 2023-09-30T22:31:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.386+0000 7f227e59c700 1 -- 172.21.15.59:0/2437865522 learned_addr learned my addr 172.21.15.59:0/2437865522 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.386+0000 7f227ed9d700 1 -- 172.21.15.59:0/2437865522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22800a0a30 msgr2=0x7f22800a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.386+0000 7f227ed9d700 1 --2- 172.21.15.59:0/2437865522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22800a0a30 0x7f22800a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.386+0000 7f227ed9d700 1 -- 172.21.15.59:0/2437865522 >> v1:172.21.15.59:6789/0 conn(0x7f22800a1340 legacy=0x7f22801338f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.386+0000 7f227ed9d700 1 -- 172.21.15.59:0/2437865522 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22800a1f90 con 0x7f2280134000 2023-09-30T22:31:33.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.386+0000 7f227ed9d700 1 --2- 172.21.15.59:0/2437865522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2280134000 0x7f228013bb50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2278009d90 tx=0x7f227800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec070ecfd6a9ec3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:33.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.386+0000 7f227d59a700 1 -- 172.21.15.59:0/2437865522 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227800e070 con 0x7f2280134000 2023-09-30T22:31:33.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.387+0000 7f227d59a700 1 -- 172.21.15.59:0/2437865522 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227800bb20 con 0x7f2280134000 2023-09-30T22:31:33.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.387+0000 7f227d59a700 1 -- 172.21.15.59:0/2437865522 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278012430 con 0x7f2280134000 2023-09-30T22:31:33.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.387+0000 7f2284dd1700 1 -- 172.21.15.59:0/2437865522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2280134000 msgr2=0x7f228013bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.387+0000 7f2284dd1700 1 --2- 172.21.15.59:0/2437865522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2280134000 0x7f228013bb50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2278009d90 tx=0x7f227800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:33.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.387+0000 7f2284dd1700 1 -- 172.21.15.59:0/2437865522 shutdown_connections 2023-09-30T22:31:33.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.387+0000 7f2284dd1700 1 --2- 172.21.15.59:0/2437865522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2280134000 0x7f228013bb50 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.387+0000 7f2284dd1700 1 --2- 172.21.15.59:0/2437865522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22800a0a30 0x7f22800a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.387+0000 7f2284dd1700 1 -- 172.21.15.59:0/2437865522 >> 172.21.15.59:0/2437865522 conn(0x7f22800a6550 msgr2=0x7f22800a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:33.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.387+0000 7f2284dd1700 1 -- 172.21.15.59:0/2437865522 shutdown_connections 2023-09-30T22:31:33.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.387+0000 7f2284dd1700 1 -- 172.21.15.59:0/2437865522 wait complete. 2023-09-30T22:31:33.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.389+0000 7f2284dd1700 1 Processor -- start 2023-09-30T22:31:33.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.389+0000 7f2284dd1700 1 -- start start 2023-09-30T22:31:33.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.389+0000 7f2284dd1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22800a0a30 0x7f22801228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.389+0000 7f2284dd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22800a1340 0x7f2280122e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.389+0000 7f2284dd1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2280134000 0x7f2280123340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.389+0000 7f2284dd1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22800a0350 con 0x7f22800a0a30 2023-09-30T22:31:33.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.389+0000 7f2284dd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22800a54a0 con 0x7f22800a1340 2023-09-30T22:31:33.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.389+0000 7f2284dd1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2280126ef0 con 0x7f2280134000 2023-09-30T22:31:33.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.389+0000 7f227e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22800a0a30 0x7f22801228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.389+0000 7f227e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22800a0a30 0x7f22801228c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36810/0 (socket says 172.21.15.59:36810) 2023-09-30T22:31:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.389+0000 7f227e59c700 1 -- 172.21.15.59:0/1423609101 learned_addr learned my addr 172.21.15.59:0/1423609101 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.389+0000 7f227dd9b700 1 --2- 172.21.15.59:0/1423609101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22800a1340 0x7f2280122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.390+0000 7f227ed9d700 1 --2- 172.21.15.59:0/1423609101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2280134000 0x7f2280123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.390+0000 7f227e59c700 1 -- 172.21.15.59:0/1423609101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2280134000 msgr2=0x7f2280123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.390+0000 7f227e59c700 1 --2- 172.21.15.59:0/1423609101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2280134000 0x7f2280123340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.390+0000 7f227e59c700 1 -- 172.21.15.59:0/1423609101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22800a1340 msgr2=0x7f2280122e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.390+0000 7f227e59c700 1 --2- 172.21.15.59:0/1423609101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22800a1340 0x7f2280122e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.390+0000 7f227e59c700 1 -- 172.21.15.59:0/1423609101 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2278009a70 con 0x7f22800a0a30 2023-09-30T22:31:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.390+0000 7f227dd9b700 1 --2- 172.21.15.59:0/1423609101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22800a1340 0x7f2280122e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.390+0000 7f227e59c700 1 --2- 172.21.15.59:0/1423609101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22800a0a30 0x7f22801228c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f227000e910 tx=0x7f227000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.390+0000 7f226effd700 1 -- 172.21.15.59:0/1423609101 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22700096a0 con 0x7f22800a0a30 2023-09-30T22:31:33.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.390+0000 7f226effd700 1 -- 172.21.15.59:0/1423609101 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227000ee60 con 0x7f22800a0a30 2023-09-30T22:31:33.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.390+0000 7f2284dd1700 1 -- 172.21.15.59:0/1423609101 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228009d710 con 0x7f22800a0a30 2023-09-30T22:31:33.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.390+0000 7f226effd700 1 -- 172.21.15.59:0/1423609101 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227000ca90 con 0x7f22800a0a30 2023-09-30T22:31:33.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.390+0000 7f2284dd1700 1 -- 172.21.15.59:0/1423609101 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2280126030 con 0x7f22800a0a30 2023-09-30T22:31:33.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.391+0000 7f226effd700 1 -- 172.21.15.59:0/1423609101 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f227000cbf0 con 0x7f22800a0a30 2023-09-30T22:31:33.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.391+0000 7f226effd700 1 -- 172.21.15.59:0/1423609101 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f227003fab0 con 0x7f22800a0a30 2023-09-30T22:31:33.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.391+0000 7f2284dd1700 1 -- 172.21.15.59:0/1423609101 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228006d440 con 0x7f22800a0a30 2023-09-30T22:31:33.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.396+0000 7f226effd700 1 -- 172.21.15.59:0/1423609101 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2270017080 con 0x7f22800a0a30 2023-09-30T22:31:33.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.441+0000 7fd037b37700 1 Processor -- start 2023-09-30T22:31:33.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.441+0000 7fd037b37700 1 -- start start 2023-09-30T22:31:33.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.442+0000 7fd037b37700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd030133540 0x7fd030135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.442+0000 7fd037b37700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd030135e60 0x7fd030138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.442+0000 7fd037b37700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0300716a0 con 0x7fd030130540 2023-09-30T22:31:33.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.442+0000 7fd037b37700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd030071290 con 0x7fd030135e60 2023-09-30T22:31:33.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.442+0000 7fd037b37700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd030130340 con 0x7fd030133540 2023-09-30T22:31:33.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.442+0000 7fd0350d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd030133540 0x7fd030135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.442+0000 7fd0350d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd030133540 0x7fd030135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45880/0 (socket says 172.21.15.59:45880) 2023-09-30T22:31:33.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.442+0000 7fd0350d2700 1 -- 172.21.15.59:0/3233732624 learned_addr learned my addr 172.21.15.59:0/3233732624 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:33.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.442+0000 7fd0360d4700 1 --2- 172.21.15.59:0/3233732624 >> v2:172.21.15.59:3300/0 conn(0x7fd030135e60 0x7fd030138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.443+0000 7fd0350d2700 1 -- 172.21.15.59:0/3233732624 >> v2:172.21.15.59:3300/0 conn(0x7fd030135e60 msgr2=0x7fd030138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:33.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.443+0000 7fd0350d2700 1 --2- 172.21.15.59:0/3233732624 >> v2:172.21.15.59:3300/0 conn(0x7fd030135e60 0x7fd030138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.443+0000 7fd0350d2700 1 -- 172.21.15.59:0/3233732624 >> v1:172.21.15.59:6789/0 conn(0x7fd030130540 legacy=0x7fd030130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.443+0000 7fd0350d2700 1 -- 172.21.15.59:0/3233732624 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd030070b80 con 0x7fd030133540 2023-09-30T22:31:33.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.443+0000 7fd0360d4700 1 --2- 172.21.15.59:0/3233732624 >> v2:172.21.15.59:3300/0 conn(0x7fd030135e60 0x7fd030138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:33.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.443+0000 7fd0350d2700 1 --2- 172.21.15.59:0/3233732624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd030133540 0x7fd030135920 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd02000bb90 tx=0x7fd02000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8745d6f657325b68 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:33.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.443+0000 7fd0348d1700 1 -- 172.21.15.59:0/3233732624 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02000dd30 con 0x7fd030133540 2023-09-30T22:31:33.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.443+0000 7fd0348d1700 1 -- 172.21.15.59:0/3233732624 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02000de90 con 0x7fd030133540 2023-09-30T22:31:33.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.443+0000 7fd0348d1700 1 -- 172.21.15.59:0/3233732624 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020010690 con 0x7fd030133540 2023-09-30T22:31:33.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.444+0000 7fd037b37700 1 -- 172.21.15.59:0/3233732624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd030133540 msgr2=0x7fd030135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.444+0000 7fd037b37700 1 --2- 172.21.15.59:0/3233732624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd030133540 0x7fd030135920 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd02000bb90 tx=0x7fd02000bea0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.444+0000 7fd037b37700 1 -- 172.21.15.59:0/3233732624 shutdown_connections 2023-09-30T22:31:33.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.444+0000 7fd037b37700 1 --2- 172.21.15.59:0/3233732624 >> v2:172.21.15.59:3300/0 conn(0x7fd030135e60 0x7fd030138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.444+0000 7fd037b37700 1 --2- 172.21.15.59:0/3233732624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd030133540 0x7fd030135920 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.444+0000 7fd037b37700 1 -- 172.21.15.59:0/3233732624 >> 172.21.15.59:0/3233732624 conn(0x7fd0300a2aa0 msgr2=0x7fd0300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:33.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.444+0000 7fd037b37700 1 -- 172.21.15.59:0/3233732624 shutdown_connections 2023-09-30T22:31:33.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.444+0000 7fd037b37700 1 -- 172.21.15.59:0/3233732624 wait complete. 2023-09-30T22:31:33.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.445+0000 7fd037b37700 1 Processor -- start 2023-09-30T22:31:33.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.445+0000 7fd037b37700 1 -- start start 2023-09-30T22:31:33.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.445+0000 7fd037b37700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd030130540 0x7fd03009d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.445+0000 7fd037b37700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd030133540 0x7fd03009d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.445+0000 7fd037b37700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd030135e60 0x7fd0301c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.445+0000 7fd037b37700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03012db10 con 0x7fd030135e60 2023-09-30T22:31:33.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.445+0000 7fd037b37700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03011e9e0 con 0x7fd030130540 2023-09-30T22:31:33.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.445+0000 7fd037b37700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd03009e3a0 con 0x7fd030133540 2023-09-30T22:31:33.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.445+0000 7fd0358d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd030130540 0x7fd03009d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.445+0000 7fd0350d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd030133540 0x7fd03009d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.445+0000 7fd0350d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd030133540 0x7fd03009d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45894/0 (socket says 172.21.15.59:45894) 2023-09-30T22:31:33.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.446+0000 7fd0350d2700 1 -- 172.21.15.59:0/4114643963 learned_addr learned my addr 172.21.15.59:0/4114643963 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:33.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.445+0000 7fd0358d3700 1 --2- 172.21.15.59:0/4114643963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd030130540 0x7fd03009d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42536/0 (socket says 172.21.15.59:42536) 2023-09-30T22:31:33.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.446+0000 7fd0360d4700 1 --2- 172.21.15.59:0/4114643963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd030135e60 0x7fd0301c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.446+0000 7fd0350d2700 1 -- 172.21.15.59:0/4114643963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd030130540 msgr2=0x7fd03009d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.446+0000 7fd0350d2700 1 --2- 172.21.15.59:0/4114643963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd030130540 0x7fd03009d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.446+0000 7fd0350d2700 1 -- 172.21.15.59:0/4114643963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd030135e60 msgr2=0x7fd0301c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.446+0000 7fd0350d2700 1 --2- 172.21.15.59:0/4114643963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd030135e60 0x7fd0301c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.446+0000 7fd0350d2700 1 -- 172.21.15.59:0/4114643963 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd028009a70 con 0x7fd030133540 2023-09-30T22:31:33.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.446+0000 7fd0350d2700 1 --2- 172.21.15.59:0/4114643963 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd030133540 0x7fd03009d630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd020000c00 tx=0x7fd020004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:33.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.446+0000 7fd0267fc700 1 -- 172.21.15.59:0/4114643963 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020003b30 con 0x7fd030133540 2023-09-30T22:31:33.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.446+0000 7fd0267fc700 1 -- 172.21.15.59:0/4114643963 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd020003cb0 con 0x7fd030133540 2023-09-30T22:31:33.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.446+0000 7fd0267fc700 1 -- 172.21.15.59:0/4114643963 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0200106b0 con 0x7fd030133540 2023-09-30T22:31:33.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.446+0000 7fd037b37700 1 -- 172.21.15.59:0/4114643963 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02000b7f0 con 0x7fd030133540 2023-09-30T22:31:33.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.446+0000 7fd037b37700 1 -- 172.21.15.59:0/4114643963 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03011d5a0 con 0x7fd030133540 2023-09-30T22:31:33.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.447+0000 7fd0267fc700 1 -- 172.21.15.59:0/4114643963 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd020019400 con 0x7fd030133540 2023-09-30T22:31:33.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.448+0000 7fd037b37700 1 -- 172.21.15.59:0/4114643963 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd030074ea0 con 0x7fd030133540 2023-09-30T22:31:33.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.448+0000 7fd0267fc700 1 -- 172.21.15.59:0/4114643963 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd020040860 con 0x7fd030133540 2023-09-30T22:31:33.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.453+0000 7fd0267fc700 1 -- 172.21.15.59:0/4114643963 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd020018950 con 0x7fd030133540 2023-09-30T22:31:33.455 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:33.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.521+0000 7ff5440ae700 1 -- 172.21.15.59:0/477805265 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff53c074ea0 con 0x7ff53c0a0a30 2023-09-30T22:31:33.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.522+0000 7ff5327fc700 1 -- 172.21.15.59:0/477805265 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff538017070 con 0x7ff53c0a0a30 2023-09-30T22:31:33.523 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:33.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.524+0000 7ff5440ae700 1 -- 172.21.15.59:0/477805265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0a0a30 msgr2=0x7ff53c1c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.524+0000 7ff5440ae700 1 --2- 172.21.15.59:0/477805265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0a0a30 0x7ff53c1c83b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff53800ec40 tx=0x7ff53800ef50 comp rx=0 tx=0).stop 2023-09-30T22:31:33.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.525+0000 7ff5440ae700 1 -- 172.21.15.59:0/477805265 shutdown_connections 2023-09-30T22:31:33.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.525+0000 7ff5440ae700 1 --2- 172.21.15.59:0/477805265 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff53c134170 0x7ff53c1c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.525+0000 7ff5440ae700 1 --2- 172.21.15.59:0/477805265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0a0a30 0x7ff53c1c83b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.525+0000 7ff5440ae700 1 --2- 172.21.15.59:0/477805265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0a1340 0x7ff53c1c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.525+0000 7ff5440ae700 1 -- 172.21.15.59:0/477805265 >> 172.21.15.59:0/477805265 conn(0x7ff53c0a6550 msgr2=0x7ff53c09ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:33.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.525+0000 7ff5440ae700 1 -- 172.21.15.59:0/477805265 shutdown_connections 2023-09-30T22:31:33.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.525+0000 7ff5440ae700 1 -- 172.21.15.59:0/477805265 wait complete. 2023-09-30T22:31:33.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:33.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.598+0000 7fd06b8ee700 1 Processor -- start 2023-09-30T22:31:33.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.598+0000 7fd06b8ee700 1 -- start start 2023-09-30T22:31:33.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.599+0000 7fd06b8ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd06409d6f0 0x7fd06409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.599+0000 7fd06b8ee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd06409e410 0x7fd064134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.599+0000 7fd06b8ee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06409b120 con 0x7fd06409e000 2023-09-30T22:31:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.599+0000 7fd06b8ee700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06406b460 con 0x7fd06409e410 2023-09-30T22:31:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.599+0000 7fd06b8ee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd06409a7e0 con 0x7fd06409d6f0 2023-09-30T22:31:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.599+0000 7fd069e8b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd06409e410 0x7fd064134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.599+0000 7fd069e8b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd06409e410 0x7fd064134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36836/0 (socket says 172.21.15.59:36836) 2023-09-30T22:31:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.599+0000 7fd069e8b700 1 -- 172.21.15.59:0/3894462223 learned_addr learned my addr 172.21.15.59:0/3894462223 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.599+0000 7fd068e89700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd06409e000 0x7fd0641339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45472/0 (socket says 172.21.15.59:45472) 2023-09-30T22:31:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.599+0000 7fd06968a700 1 --2- 172.21.15.59:0/3894462223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd06409d6f0 0x7fd06409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.600+0000 7fd069e8b700 1 -- 172.21.15.59:0/3894462223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd06409d6f0 msgr2=0x7fd06409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:33.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.600+0000 7fd069e8b700 1 --2- 172.21.15.59:0/3894462223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd06409d6f0 0x7fd06409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.600+0000 7fd069e8b700 1 -- 172.21.15.59:0/3894462223 >> v1:172.21.15.59:6789/0 conn(0x7fd06409e000 legacy=0x7fd0641339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.600+0000 7fd069e8b700 1 -- 172.21.15.59:0/3894462223 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06409a500 con 0x7fd06409e410 2023-09-30T22:31:33.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.600+0000 7fd06968a700 1 --2- 172.21.15.59:0/3894462223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd06409d6f0 0x7fd06409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:33.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.600+0000 7fd069e8b700 1 --2- 172.21.15.59:0/3894462223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd06409e410 0x7fd064134100 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0098f0 tx=0x7fd05c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e0fd6f48bd2121 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:33.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.600+0000 7fd05bfff700 1 -- 172.21.15.59:0/3894462223 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c011830 con 0x7fd06409e410 2023-09-30T22:31:33.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.600+0000 7fd05bfff700 1 -- 172.21.15.59:0/3894462223 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c011990 con 0x7fd06409e410 2023-09-30T22:31:33.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.600+0000 7fd05bfff700 1 -- 172.21.15.59:0/3894462223 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c011d20 con 0x7fd06409e410 2023-09-30T22:31:33.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.600+0000 7fd06b8ee700 1 -- 172.21.15.59:0/3894462223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd06409e410 msgr2=0x7fd064134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.601+0000 7fd06b8ee700 1 --2- 172.21.15.59:0/3894462223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd06409e410 0x7fd064134100 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0098f0 tx=0x7fd05c009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.601+0000 7fd06b8ee700 1 -- 172.21.15.59:0/3894462223 shutdown_connections 2023-09-30T22:31:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.601+0000 7fd06b8ee700 1 --2- 172.21.15.59:0/3894462223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd06409e410 0x7fd064134100 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.601+0000 7fd06b8ee700 1 --2- 172.21.15.59:0/3894462223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd06409d6f0 0x7fd06409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.601+0000 7fd06b8ee700 1 -- 172.21.15.59:0/3894462223 >> 172.21.15.59:0/3894462223 conn(0x7fd064066f50 msgr2=0x7fd06409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.601+0000 7fd06b8ee700 1 -- 172.21.15.59:0/3894462223 shutdown_connections 2023-09-30T22:31:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.601+0000 7fd06b8ee700 1 -- 172.21.15.59:0/3894462223 wait complete. 2023-09-30T22:31:33.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.602+0000 7fd06b8ee700 1 Processor -- start 2023-09-30T22:31:33.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.602+0000 7fd06b8ee700 1 -- start start 2023-09-30T22:31:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.602+0000 7fd06b8ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd06409d6f0 0x7fd0641a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.602+0000 7fd06b8ee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd06409e000 0x7fd0641a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.602+0000 7fd06b8ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd06409e410 0x7fd0641a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.602+0000 7fd06b8ee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0641a9870 con 0x7fd06409e000 2023-09-30T22:31:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.602+0000 7fd06b8ee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0641a7b90 con 0x7fd06409e410 2023-09-30T22:31:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.602+0000 7fd06b8ee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0641a9a70 con 0x7fd06409d6f0 2023-09-30T22:31:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.602+0000 7fd069e8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd06409e410 0x7fd0641a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.602+0000 7fd069e8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd06409e410 0x7fd0641a6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42552/0 (socket says 172.21.15.59:42552) 2023-09-30T22:31:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.603+0000 7fd069e8b700 1 -- 172.21.15.59:0/3643453380 learned_addr learned my addr 172.21.15.59:0/3643453380 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.603+0000 7fd068e89700 1 --2- 172.21.15.59:0/3643453380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd06409e000 0x7fd0641a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.603+0000 7fd06968a700 1 --2- 172.21.15.59:0/3643453380 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd06409d6f0 0x7fd0641a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.603+0000 7fd069e8b700 1 -- 172.21.15.59:0/3643453380 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd06409d6f0 msgr2=0x7fd0641a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.603+0000 7fd069e8b700 1 --2- 172.21.15.59:0/3643453380 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd06409d6f0 0x7fd0641a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.603+0000 7fd069e8b700 1 -- 172.21.15.59:0/3643453380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd06409e000 msgr2=0x7fd0641a65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.603+0000 7fd069e8b700 1 --2- 172.21.15.59:0/3643453380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd06409e000 0x7fd0641a65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.603+0000 7fd069e8b700 1 -- 172.21.15.59:0/3643453380 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd060009a70 con 0x7fd06409e410 2023-09-30T22:31:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.603+0000 7fd069e8b700 1 --2- 172.21.15.59:0/3643453380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd06409e410 0x7fd0641a6b20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd05c011d30 tx=0x7fd05c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.603+0000 7fd059ffb700 1 -- 172.21.15.59:0/3643453380 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c004400 con 0x7fd06409e410 2023-09-30T22:31:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.603+0000 7fd059ffb700 1 -- 172.21.15.59:0/3643453380 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c01f070 con 0x7fd06409e410 2023-09-30T22:31:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.603+0000 7fd06b8ee700 1 -- 172.21.15.59:0/3643453380 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05c009550 con 0x7fd06409e410 2023-09-30T22:31:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.603+0000 7fd059ffb700 1 -- 172.21.15.59:0/3643453380 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c0038e0 con 0x7fd06409e410 2023-09-30T22:31:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.604+0000 7fd06b8ee700 1 -- 172.21.15.59:0/3643453380 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0641a88f0 con 0x7fd06409e410 2023-09-30T22:31:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.605+0000 7fd06b8ee700 1 -- 172.21.15.59:0/3643453380 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd064074ea0 con 0x7fd06409e410 2023-09-30T22:31:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.605+0000 7fd059ffb700 1 -- 172.21.15.59:0/3643453380 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd05c021030 con 0x7fd06409e410 2023-09-30T22:31:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.605+0000 7fd059ffb700 1 -- 172.21.15.59:0/3643453380 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd05c040b30 con 0x7fd06409e410 2023-09-30T22:31:33.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.614+0000 7fd059ffb700 1 -- 172.21.15.59:0/3643453380 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd05c0199a0 con 0x7fd06409e410 2023-09-30T22:31:33.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.624+0000 7f2284dd1700 1 -- 172.21.15.59:0/1423609101 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f228004f2a0 con 0x7f22800a0a30 2023-09-30T22:31:33.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.624+0000 7f226effd700 1 -- 172.21.15.59:0/1423609101 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f227001b3b0 con 0x7f22800a0a30 2023-09-30T22:31:33.626 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:33.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.627+0000 7f2284dd1700 1 -- 172.21.15.59:0/1423609101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22800a0a30 msgr2=0x7f22801228c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.627+0000 7f2284dd1700 1 --2- 172.21.15.59:0/1423609101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22800a0a30 0x7f22801228c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f227000e910 tx=0x7f227000ec20 comp rx=0 tx=0).stop 2023-09-30T22:31:33.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.627+0000 7f2284dd1700 1 -- 172.21.15.59:0/1423609101 shutdown_connections 2023-09-30T22:31:33.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.627+0000 7f2284dd1700 1 --2- 172.21.15.59:0/1423609101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2280134000 0x7f2280123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.627+0000 7f2284dd1700 1 --2- 172.21.15.59:0/1423609101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22800a0a30 0x7f22801228c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.627+0000 7f2284dd1700 1 --2- 172.21.15.59:0/1423609101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22800a1340 0x7f2280122e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.627+0000 7f2284dd1700 1 -- 172.21.15.59:0/1423609101 >> 172.21.15.59:0/1423609101 conn(0x7f22800a6550 msgr2=0x7f22800a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:33.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.627+0000 7f2284dd1700 1 -- 172.21.15.59:0/1423609101 shutdown_connections 2023-09-30T22:31:33.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.627+0000 7f2284dd1700 1 -- 172.21.15.59:0/1423609101 wait complete. 2023-09-30T22:31:33.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:33.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.669+0000 7fd037b37700 1 -- 172.21.15.59:0/4114643963 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd03009ed90 con 0x7fd030133540 2023-09-30T22:31:33.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.670+0000 7fd0267fc700 1 -- 172.21.15.59:0/4114643963 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd020018360 con 0x7fd030133540 2023-09-30T22:31:33.671 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:33.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.672+0000 7fd037b37700 1 -- 172.21.15.59:0/4114643963 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd030133540 msgr2=0x7fd03009d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.672+0000 7fd037b37700 1 --2- 172.21.15.59:0/4114643963 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd030133540 0x7fd03009d630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd020000c00 tx=0x7fd020004750 comp rx=0 tx=0).stop 2023-09-30T22:31:33.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.672+0000 7fd037b37700 1 -- 172.21.15.59:0/4114643963 shutdown_connections 2023-09-30T22:31:33.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.672+0000 7fd037b37700 1 --2- 172.21.15.59:0/4114643963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd030135e60 0x7fd0301c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.672+0000 7fd037b37700 1 --2- 172.21.15.59:0/4114643963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd030130540 0x7fd03009d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.672+0000 7fd037b37700 1 --2- 172.21.15.59:0/4114643963 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd030133540 0x7fd03009d630 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.672+0000 7fd037b37700 1 -- 172.21.15.59:0/4114643963 >> 172.21.15.59:0/4114643963 conn(0x7fd0300a2aa0 msgr2=0x7fd030131300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:33.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.672+0000 7fd037b37700 1 -- 172.21.15.59:0/4114643963 shutdown_connections 2023-09-30T22:31:33.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.672+0000 7fd037b37700 1 -- 172.21.15.59:0/4114643963 wait complete. 2023-09-30T22:31:33.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:33.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.822+0000 7fd06b8ee700 1 -- 172.21.15.59:0/3643453380 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd0641a82b0 con 0x7fd06409e410 2023-09-30T22:31:33.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.823+0000 7fd059ffb700 1 -- 172.21.15.59:0/3643453380 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd05c015030 con 0x7fd06409e410 2023-09-30T22:31:33.824 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:33.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.825+0000 7fd06b8ee700 1 -- 172.21.15.59:0/3643453380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd06409e410 msgr2=0x7fd0641a6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.825+0000 7fd06b8ee700 1 --2- 172.21.15.59:0/3643453380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd06409e410 0x7fd0641a6b20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd05c011d30 tx=0x7fd05c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.825+0000 7fd06b8ee700 1 -- 172.21.15.59:0/3643453380 shutdown_connections 2023-09-30T22:31:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.825+0000 7fd06b8ee700 1 --2- 172.21.15.59:0/3643453380 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd06409d6f0 0x7fd0641a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.825+0000 7fd06b8ee700 1 --2- 172.21.15.59:0/3643453380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd06409e410 0x7fd0641a6b20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.825+0000 7fd06b8ee700 1 --2- 172.21.15.59:0/3643453380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd06409e000 0x7fd0641a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.825+0000 7fd06b8ee700 1 -- 172.21.15.59:0/3643453380 >> 172.21.15.59:0/3643453380 conn(0x7fd064066f50 msgr2=0x7fd0641baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.825+0000 7fd06b8ee700 1 -- 172.21.15.59:0/3643453380 shutdown_connections 2023-09-30T22:31:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:33.825+0000 7fd06b8ee700 1 -- 172.21.15.59:0/3643453380 wait complete. 2023-09-30T22:31:33.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:34.542 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:34.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:34.688 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.688+0000 7f089aade700 1 Processor -- start 2023-09-30T22:31:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.688+0000 7f089aade700 1 -- start start 2023-09-30T22:31:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.688+0000 7f089aade700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f08940a0a30 0x7f08940a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.688+0000 7f089aade700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089409d630 0x7f08940a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.688+0000 7f089aade700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08940a2a70 con 0x7f0894133930 2023-09-30T22:31:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.688+0000 7f089aade700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08940a01d0 con 0x7f08940a0a30 2023-09-30T22:31:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.688+0000 7f089aade700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089409e2b0 con 0x7f089409d630 2023-09-30T22:31:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.689+0000 7f0893fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089409d630 0x7f08940a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.689+0000 7f0893fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089409d630 0x7f08940a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41786/0 (socket says 172.21.15.59:41786) 2023-09-30T22:31:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.689+0000 7f089887a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f08940a0a30 0x7f08940a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.689+0000 7f0893fff700 1 -- 172.21.15.59:0/1058691844 learned_addr learned my addr 172.21.15.59:0/1058691844 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:34.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.689+0000 7f0893fff700 1 -- 172.21.15.59:0/1058691844 >> v2:172.21.15.59:3300/0 conn(0x7f08940a0a30 msgr2=0x7f08940a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:34.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.689+0000 7f0893fff700 1 --2- 172.21.15.59:0/1058691844 >> v2:172.21.15.59:3300/0 conn(0x7f08940a0a30 0x7f08940a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.689+0000 7f0893fff700 1 -- 172.21.15.59:0/1058691844 >> v1:172.21.15.59:6789/0 conn(0x7f0894133930 legacy=0x7f0894133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.689+0000 7f0893fff700 1 -- 172.21.15.59:0/1058691844 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089409dc50 con 0x7f089409d630 2023-09-30T22:31:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.689+0000 7f089887a700 1 --2- 172.21.15.59:0/1058691844 >> v2:172.21.15.59:3300/0 conn(0x7f08940a0a30 0x7f08940a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.689+0000 7f0893fff700 1 --2- 172.21.15.59:0/1058691844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089409d630 0x7f08940a1340 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f08800098f0 tx=0x7f0880009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f0ba1c86d27c58c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.689+0000 7f08937fe700 1 -- 172.21.15.59:0/1058691844 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880011830 con 0x7f089409d630 2023-09-30T22:31:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.689+0000 7f08937fe700 1 -- 172.21.15.59:0/1058691844 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0880011990 con 0x7f089409d630 2023-09-30T22:31:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.689+0000 7f08937fe700 1 -- 172.21.15.59:0/1058691844 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880011d20 con 0x7f089409d630 2023-09-30T22:31:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.690+0000 7f089aade700 1 -- 172.21.15.59:0/1058691844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089409d630 msgr2=0x7f08940a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.690+0000 7f089aade700 1 --2- 172.21.15.59:0/1058691844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089409d630 0x7f08940a1340 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f08800098f0 tx=0x7f0880009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.690+0000 7f089aade700 1 -- 172.21.15.59:0/1058691844 shutdown_connections 2023-09-30T22:31:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.690+0000 7f089aade700 1 --2- 172.21.15.59:0/1058691844 >> v2:172.21.15.59:3300/0 conn(0x7f08940a0a30 0x7f08940a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.690+0000 7f089aade700 1 --2- 172.21.15.59:0/1058691844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089409d630 0x7f08940a1340 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.690+0000 7f089aade700 1 -- 172.21.15.59:0/1058691844 >> 172.21.15.59:0/1058691844 conn(0x7f08940a3050 msgr2=0x7f08940a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.690+0000 7f089aade700 1 -- 172.21.15.59:0/1058691844 shutdown_connections 2023-09-30T22:31:34.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.690+0000 7f089aade700 1 -- 172.21.15.59:0/1058691844 wait complete. 2023-09-30T22:31:34.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.691+0000 7f089aade700 1 Processor -- start 2023-09-30T22:31:34.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.691+0000 7f089aade700 1 -- start start 2023-09-30T22:31:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.692+0000 7f089aade700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f089409d630 0x7f0894121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.692+0000 7f089aade700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08940a0a30 0x7f0894121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.692+0000 7f089aade700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0894133930 0x7f0894121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.692+0000 7f089aade700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08941225b0 con 0x7f08940a0a30 2023-09-30T22:31:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.692+0000 7f089aade700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0894124bd0 con 0x7f0894133930 2023-09-30T22:31:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.692+0000 7f089aade700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0894124630 con 0x7f089409d630 2023-09-30T22:31:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.692+0000 7f089887a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f089409d630 0x7f0894121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.692+0000 7f0893fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08940a0a30 0x7f0894121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.692+0000 7f089887a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f089409d630 0x7f0894121100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52592/0 (socket says 172.21.15.59:52592) 2023-09-30T22:31:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.692+0000 7f089887a700 1 -- 172.21.15.59:0/719021843 learned_addr learned my addr 172.21.15.59:0/719021843 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.692+0000 7f089907b700 1 --2- 172.21.15.59:0/719021843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0894133930 0x7f0894121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.693+0000 7f0893fff700 1 -- 172.21.15.59:0/719021843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f089409d630 msgr2=0x7f0894121100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.693+0000 7f0893fff700 1 --2- 172.21.15.59:0/719021843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f089409d630 0x7f0894121100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.693+0000 7f0893fff700 1 -- 172.21.15.59:0/719021843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0894133930 msgr2=0x7f0894121b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.693+0000 7f0893fff700 1 --2- 172.21.15.59:0/719021843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0894133930 0x7f0894121b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.693+0000 7f0893fff700 1 -- 172.21.15.59:0/719021843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08880094a0 con 0x7f08940a0a30 2023-09-30T22:31:34.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.693+0000 7f0893fff700 1 --2- 172.21.15.59:0/719021843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08940a0a30 0x7f0894121640 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0880016000 tx=0x7f0880004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.693+0000 7f08917fa700 1 -- 172.21.15.59:0/719021843 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880004480 con 0x7f08940a0a30 2023-09-30T22:31:34.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.693+0000 7f08917fa700 1 -- 172.21.15.59:0/719021843 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088001f070 con 0x7f08940a0a30 2023-09-30T22:31:34.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.693+0000 7f08917fa700 1 -- 172.21.15.59:0/719021843 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08800038e0 con 0x7f08940a0a30 2023-09-30T22:31:34.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.693+0000 7f089aade700 1 -- 172.21.15.59:0/719021843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0880009550 con 0x7f08940a0a30 2023-09-30T22:31:34.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.693+0000 7f089aade700 1 -- 172.21.15.59:0/719021843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08940a0410 con 0x7f08940a0a30 2023-09-30T22:31:34.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.695+0000 7f089aade700 1 -- 172.21.15.59:0/719021843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0894124850 con 0x7f08940a0a30 2023-09-30T22:31:34.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.695+0000 7f08917fa700 1 -- 172.21.15.59:0/719021843 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0880021030 con 0x7f08940a0a30 2023-09-30T22:31:34.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.696+0000 7f08917fa700 1 -- 172.21.15.59:0/719021843 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f08800408f0 con 0x7f08940a0a30 2023-09-30T22:31:34.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.701+0000 7f08917fa700 1 -- 172.21.15.59:0/719021843 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0894124850 con 0x7f08940a0a30 2023-09-30T22:31:34.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.786+0000 7f9196651700 1 Processor -- start 2023-09-30T22:31:34.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.786+0000 7f9196651700 1 -- start start 2023-09-30T22:31:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.787+0000 7f9196651700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91901316c0 0x7f9190131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.787+0000 7f9196651700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f919009d9f0 0x7f919006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.787+0000 7f9196651700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919009e130 con 0x7f919006acb0 2023-09-30T22:31:34.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.787+0000 7f9196651700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91901312b0 con 0x7f91901316c0 2023-09-30T22:31:34.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.787+0000 7f9196651700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f919009f6e0 con 0x7f919009d9f0 2023-09-30T22:31:34.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.787+0000 7f918ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91901316c0 0x7f9190131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.787+0000 7f9194bee700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f919006acb0 0x7f9190138540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47688/0 (socket says 172.21.15.59:47688) 2023-09-30T22:31:34.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.787+0000 7f9194bee700 1 -- 172.21.15.59:0/357512216 learned_addr learned my addr 172.21.15.59:0/357512216 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:34.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.787+0000 7f918f7fe700 1 --2- 172.21.15.59:0/357512216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f919009d9f0 0x7f919006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.788+0000 7f918ffff700 1 -- 172.21.15.59:0/357512216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f919009d9f0 msgr2=0x7f919006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:34.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.788+0000 7f918ffff700 1 --2- 172.21.15.59:0/357512216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f919009d9f0 0x7f919006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.788+0000 7f918ffff700 1 -- 172.21.15.59:0/357512216 >> v1:172.21.15.59:6789/0 conn(0x7f919006acb0 legacy=0x7f9190138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.788+0000 7f918effd700 1 -- 172.21.15.59:0/357512216 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899778349 0 0) 0x7f9188001490 con 0x7f919006acb0 2023-09-30T22:31:34.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.788+0000 7f918ffff700 1 -- 172.21.15.59:0/357512216 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919009e760 con 0x7f91901316c0 2023-09-30T22:31:34.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.788+0000 7f918ffff700 1 --2- 172.21.15.59:0/357512216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91901316c0 0x7f9190131a90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9180009840 tx=0x7f9180009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6774894089ed6082 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.788+0000 7f918effd700 1 -- 172.21.15.59:0/357512216 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9180011830 con 0x7f91901316c0 2023-09-30T22:31:34.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.788+0000 7f918effd700 1 -- 172.21.15.59:0/357512216 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9180011990 con 0x7f91901316c0 2023-09-30T22:31:34.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.788+0000 7f918effd700 1 -- 172.21.15.59:0/357512216 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9180011d20 con 0x7f91901316c0 2023-09-30T22:31:34.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.789+0000 7f9196651700 1 -- 172.21.15.59:0/357512216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91901316c0 msgr2=0x7f9190131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.789+0000 7f9196651700 1 --2- 172.21.15.59:0/357512216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91901316c0 0x7f9190131a90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9180009840 tx=0x7f9180009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:34.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.789+0000 7f9196651700 1 -- 172.21.15.59:0/357512216 shutdown_connections 2023-09-30T22:31:34.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.789+0000 7f9196651700 1 --2- 172.21.15.59:0/357512216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91901316c0 0x7f9190131a90 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.789+0000 7f9196651700 1 --2- 172.21.15.59:0/357512216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f919009d9f0 0x7f919006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.789+0000 7f9196651700 1 -- 172.21.15.59:0/357512216 >> 172.21.15.59:0/357512216 conn(0x7f9190066f50 msgr2=0x7f919009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:34.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.790+0000 7f9196651700 1 -- 172.21.15.59:0/357512216 shutdown_connections 2023-09-30T22:31:34.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.790+0000 7f9196651700 1 -- 172.21.15.59:0/357512216 wait complete. 2023-09-30T22:31:34.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.791+0000 7f9196651700 1 Processor -- start 2023-09-30T22:31:34.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.791+0000 7f9196651700 1 -- start start 2023-09-30T22:31:34.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.792+0000 7f9196651700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f919006acb0 0x7f91901c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.792+0000 7f9196651700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f919009d9f0 0x7f91901c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.792+0000 7f9196651700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91901316c0 0x7f9190070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.792+0000 7f9196651700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919009bdf0 con 0x7f919006acb0 2023-09-30T22:31:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.792+0000 7f9196651700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91900a3760 con 0x7f919009d9f0 2023-09-30T22:31:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.792+0000 7f9196651700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f919012b900 con 0x7f91901316c0 2023-09-30T22:31:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.792+0000 7f918f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f919009d9f0 0x7f91901c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.792+0000 7f9194bee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91901316c0 0x7f9190070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.792+0000 7f918f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f919009d9f0 0x7f91901c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41806/0 (socket says 172.21.15.59:41806) 2023-09-30T22:31:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.792+0000 7f918f7fe700 1 -- 172.21.15.59:0/2870049895 learned_addr learned my addr 172.21.15.59:0/2870049895 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:34.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.792+0000 7f918ffff700 1 --2- 172.21.15.59:0/2870049895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f919006acb0 0x7f91901c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.793+0000 7f9194bee700 1 -- 172.21.15.59:0/2870049895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f919009d9f0 msgr2=0x7f91901c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.793+0000 7f9194bee700 1 --2- 172.21.15.59:0/2870049895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f919009d9f0 0x7f91901c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.793+0000 7f9194bee700 1 -- 172.21.15.59:0/2870049895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f919006acb0 msgr2=0x7f91901c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.793+0000 7f9194bee700 1 --2- 172.21.15.59:0/2870049895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f919006acb0 0x7f91901c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.793+0000 7f9194bee700 1 -- 172.21.15.59:0/2870049895 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91800094a0 con 0x7f91901316c0 2023-09-30T22:31:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.793+0000 7f9194bee700 1 --2- 172.21.15.59:0/2870049895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91901316c0 0x7f9190070b40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f918800cc10 tx=0x7f918800cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.793+0000 7f918cff9700 1 -- 172.21.15.59:0/2870049895 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918800aaa0 con 0x7f91901316c0 2023-09-30T22:31:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.793+0000 7f918cff9700 1 -- 172.21.15.59:0/2870049895 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918800ac00 con 0x7f91901316c0 2023-09-30T22:31:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.793+0000 7f9196651700 1 -- 172.21.15.59:0/2870049895 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919009ead0 con 0x7f91901316c0 2023-09-30T22:31:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.793+0000 7f918cff9700 1 -- 172.21.15.59:0/2870049895 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880070d0 con 0x7f91901316c0 2023-09-30T22:31:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.793+0000 7f9196651700 1 -- 172.21.15.59:0/2870049895 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919009a8b0 con 0x7f91901316c0 2023-09-30T22:31:34.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.794+0000 7f9196651700 1 -- 172.21.15.59:0/2870049895 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9190074ea0 con 0x7f91901316c0 2023-09-30T22:31:34.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.795+0000 7f918cff9700 1 -- 172.21.15.59:0/2870049895 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9188007230 con 0x7f91901316c0 2023-09-30T22:31:34.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.795+0000 7f918cff9700 1 -- 172.21.15.59:0/2870049895 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f918803f740 con 0x7f91901316c0 2023-09-30T22:31:34.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.800+0000 7f918cff9700 1 -- 172.21.15.59:0/2870049895 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f918801c3b0 con 0x7f91901316c0 2023-09-30T22:31:34.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.831+0000 7f4955cb0700 1 Processor -- start 2023-09-30T22:31:34.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.831+0000 7f4955cb0700 1 -- start start 2023-09-30T22:31:34.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.832+0000 7f4955cb0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49500a1510 0x7f4950138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.832+0000 7f4955cb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4950139250 0x7f495013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.832+0000 7f4955cb0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f495009edd0 con 0x7f49500a0a30 2023-09-30T22:31:34.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.832+0000 7f4955cb0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49500a18e0 con 0x7f4950139250 2023-09-30T22:31:34.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.832+0000 7f4955cb0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f495009e1f0 con 0x7f49500a1510 2023-09-30T22:31:34.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.832+0000 7f494effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49500a1510 0x7f4950138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.832+0000 7f494ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4950139250 0x7f495013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.832+0000 7f494effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49500a1510 0x7f4950138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52626/0 (socket says 172.21.15.59:52626) 2023-09-30T22:31:34.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.832+0000 7f494effd700 1 -- 172.21.15.59:0/1262408421 learned_addr learned my addr 172.21.15.59:0/1262408421 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:34.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.833+0000 7f494ffff700 1 -- 172.21.15.59:0/1262408421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49500a1510 msgr2=0x7f4950138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:34.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.833+0000 7f494ffff700 1 --2- 172.21.15.59:0/1262408421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49500a1510 0x7f4950138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.833+0000 7f494ffff700 1 -- 172.21.15.59:0/1262408421 >> v1:172.21.15.59:6789/0 conn(0x7f49500a0a30 legacy=0x7f49500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.833+0000 7f494ffff700 1 -- 172.21.15.59:0/1262408421 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495009dc50 con 0x7f4950139250 2023-09-30T22:31:34.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.833+0000 7f494ffff700 1 --2- 172.21.15.59:0/1262408421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4950139250 0x7f495013b630 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4948009870 tx=0x7f4948009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=310120eb3e2cbc24 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.833+0000 7f494e7fc700 1 -- 172.21.15.59:0/1262408421 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948011830 con 0x7f4950139250 2023-09-30T22:31:34.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.833+0000 7f494e7fc700 1 -- 172.21.15.59:0/1262408421 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4948011990 con 0x7f4950139250 2023-09-30T22:31:34.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.833+0000 7f494e7fc700 1 -- 172.21.15.59:0/1262408421 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948011d20 con 0x7f4950139250 2023-09-30T22:31:34.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.834+0000 7f4955cb0700 1 -- 172.21.15.59:0/1262408421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4950139250 msgr2=0x7f495013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.834+0000 7f4955cb0700 1 --2- 172.21.15.59:0/1262408421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4950139250 0x7f495013b630 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4948009870 tx=0x7f4948009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:34.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.834+0000 7f4955cb0700 1 -- 172.21.15.59:0/1262408421 shutdown_connections 2023-09-30T22:31:34.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.834+0000 7f4955cb0700 1 --2- 172.21.15.59:0/1262408421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4950139250 0x7f495013b630 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.834+0000 7f4955cb0700 1 --2- 172.21.15.59:0/1262408421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49500a1510 0x7f4950138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.834+0000 7f4955cb0700 1 -- 172.21.15.59:0/1262408421 >> 172.21.15.59:0/1262408421 conn(0x7f49500a6550 msgr2=0x7f49500a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:34.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.834+0000 7f4955cb0700 1 -- 172.21.15.59:0/1262408421 shutdown_connections 2023-09-30T22:31:34.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.834+0000 7f4955cb0700 1 -- 172.21.15.59:0/1262408421 wait complete. 2023-09-30T22:31:34.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.835+0000 7f4955cb0700 1 Processor -- start 2023-09-30T22:31:34.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.835+0000 7f4955cb0700 1 -- start start 2023-09-30T22:31:34.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.836+0000 7f4955cb0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49500a0a30 0x7f4950121790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.836+0000 7f4955cb0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49500a1510 0x7f4950121cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.836+0000 7f4955cb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4950139250 0x7f4950122210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.836+0000 7f4955cb0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4950124fd0 con 0x7f49500a1510 2023-09-30T22:31:34.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.836+0000 7f4955cb0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49501253f0 con 0x7f4950139250 2023-09-30T22:31:34.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.836+0000 7f4955cb0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4950124a20 con 0x7f49500a0a30 2023-09-30T22:31:34.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.836+0000 7f494effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49500a1510 0x7f4950121cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.836+0000 7f494effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49500a1510 0x7f4950121cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53676/0 (socket says 172.21.15.59:53676) 2023-09-30T22:31:34.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.836+0000 7f494ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4950139250 0x7f4950122210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.836+0000 7f494effd700 1 -- 172.21.15.59:0/2744897463 learned_addr learned my addr 172.21.15.59:0/2744897463 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:34.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.837+0000 7f494f7fe700 1 --2- 172.21.15.59:0/2744897463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49500a0a30 0x7f4950121790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.837+0000 7f494ffff700 1 -- 172.21.15.59:0/2744897463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49500a0a30 msgr2=0x7f4950121790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.837+0000 7f494ffff700 1 --2- 172.21.15.59:0/2744897463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49500a0a30 0x7f4950121790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.837+0000 7f494ffff700 1 -- 172.21.15.59:0/2744897463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49500a1510 msgr2=0x7f4950121cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.837+0000 7f494ffff700 1 --2- 172.21.15.59:0/2744897463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49500a1510 0x7f4950121cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.837+0000 7f494ffff700 1 -- 172.21.15.59:0/2744897463 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49480094a0 con 0x7f4950139250 2023-09-30T22:31:34.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.837+0000 7f494effd700 1 --2- 172.21.15.59:0/2744897463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49500a1510 0x7f4950121cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:34.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.837+0000 7f494ffff700 1 --2- 172.21.15.59:0/2744897463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4950139250 0x7f4950122210 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4948016000 tx=0x7f4948004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.837+0000 7f4937fff700 1 -- 172.21.15.59:0/2744897463 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948004510 con 0x7f4950139250 2023-09-30T22:31:34.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.837+0000 7f4937fff700 1 -- 172.21.15.59:0/2744897463 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49480036a0 con 0x7f4950139250 2023-09-30T22:31:34.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.837+0000 7f4955cb0700 1 -- 172.21.15.59:0/2744897463 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4950138ad0 con 0x7f4950139250 2023-09-30T22:31:34.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.837+0000 7f4937fff700 1 -- 172.21.15.59:0/2744897463 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948003a50 con 0x7f4950139250 2023-09-30T22:31:34.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.837+0000 7f4955cb0700 1 -- 172.21.15.59:0/2744897463 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4950123b50 con 0x7f4950139250 2023-09-30T22:31:34.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:34.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.839+0000 7f4955cb0700 1 -- 172.21.15.59:0/2744897463 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4950074ea0 con 0x7f4950139250 2023-09-30T22:31:34.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.839+0000 7f4937fff700 1 -- 172.21.15.59:0/2744897463 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4948003bb0 con 0x7f4950139250 2023-09-30T22:31:34.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.839+0000 7f4937fff700 1 -- 172.21.15.59:0/2744897463 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4948049410 con 0x7f4950139250 2023-09-30T22:31:34.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.844+0000 7f4937fff700 1 -- 172.21.15.59:0/2744897463 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f494800f2e0 con 0x7f4950139250 2023-09-30T22:31:34.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.916+0000 7f089aade700 1 -- 172.21.15.59:0/719021843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0894124850 con 0x7f08940a0a30 2023-09-30T22:31:34.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.917+0000 7f08917fa700 1 -- 172.21.15.59:0/719021843 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0894124850 con 0x7f08940a0a30 2023-09-30T22:31:34.918 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:34.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.919+0000 7f089aade700 1 -- 172.21.15.59:0/719021843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08940a0a30 msgr2=0x7f0894121640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.919+0000 7f089aade700 1 --2- 172.21.15.59:0/719021843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08940a0a30 0x7f0894121640 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0880016000 tx=0x7f0880004750 comp rx=0 tx=0).stop 2023-09-30T22:31:34.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.919+0000 7f089aade700 1 -- 172.21.15.59:0/719021843 shutdown_connections 2023-09-30T22:31:34.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.919+0000 7f089aade700 1 --2- 172.21.15.59:0/719021843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f089409d630 0x7f0894121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.919+0000 7f089aade700 1 --2- 172.21.15.59:0/719021843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0894133930 0x7f0894121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.919+0000 7f089aade700 1 --2- 172.21.15.59:0/719021843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08940a0a30 0x7f0894121640 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.919+0000 7f089aade700 1 -- 172.21.15.59:0/719021843 >> 172.21.15.59:0/719021843 conn(0x7f08940a3050 msgr2=0x7f0894133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:34.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.919+0000 7f089aade700 1 -- 172.21.15.59:0/719021843 shutdown_connections 2023-09-30T22:31:34.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.919+0000 7f089aade700 1 -- 172.21.15.59:0/719021843 wait complete. 2023-09-30T22:31:34.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:34.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.985+0000 7faa09fef700 1 Processor -- start 2023-09-30T22:31:34.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.985+0000 7faa09fef700 1 -- start start 2023-09-30T22:31:34.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.985+0000 7faa09fef700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa040a0a30 0x7faa040a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.986+0000 7faa09fef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa04134170 0x7faa0413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.986+0000 7faa09fef700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0409edd0 con 0x7faa040a1340 2023-09-30T22:31:34.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.986+0000 7faa09fef700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0409e1f0 con 0x7faa040a0a30 2023-09-30T22:31:34.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.986+0000 7faa09fef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0409dc50 con 0x7faa04134170 2023-09-30T22:31:34.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.986+0000 7faa037fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa040a0a30 0x7faa040a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.986+0000 7faa037fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa040a0a30 0x7faa040a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53680/0 (socket says 172.21.15.59:53680) 2023-09-30T22:31:34.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.986+0000 7faa037fe700 1 -- 172.21.15.59:0/3421196507 learned_addr learned my addr 172.21.15.59:0/3421196507 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:34.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.986+0000 7faa03fff700 1 --2- 172.21.15.59:0/3421196507 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa04134170 0x7faa0413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.986+0000 7faa037fe700 1 -- 172.21.15.59:0/3421196507 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa04134170 msgr2=0x7faa0413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:34.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.986+0000 7faa037fe700 1 --2- 172.21.15.59:0/3421196507 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa04134170 0x7faa0413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.986+0000 7faa037fe700 1 -- 172.21.15.59:0/3421196507 >> v1:172.21.15.59:6789/0 conn(0x7faa040a1340 legacy=0x7faa04133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.986+0000 7faa037fe700 1 -- 172.21.15.59:0/3421196507 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa040a1fe0 con 0x7faa040a0a30 2023-09-30T22:31:34.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.986+0000 7faa037fe700 1 --2- 172.21.15.59:0/3421196507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa040a0a30 0x7faa040a0e00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40098f0 tx=0x7fa9f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9d42246a4e8b79 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.987+0000 7faa027fc700 1 -- 172.21.15.59:0/3421196507 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4011830 con 0x7faa040a0a30 2023-09-30T22:31:34.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.987+0000 7faa027fc700 1 -- 172.21.15.59:0/3421196507 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f4011990 con 0x7faa040a0a30 2023-09-30T22:31:34.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.987+0000 7faa027fc700 1 -- 172.21.15.59:0/3421196507 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4011d20 con 0x7faa040a0a30 2023-09-30T22:31:34.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.987+0000 7faa09fef700 1 -- 172.21.15.59:0/3421196507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa040a0a30 msgr2=0x7faa040a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.987+0000 7faa09fef700 1 --2- 172.21.15.59:0/3421196507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa040a0a30 0x7faa040a0e00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40098f0 tx=0x7fa9f4009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:34.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.987+0000 7faa09fef700 1 -- 172.21.15.59:0/3421196507 shutdown_connections 2023-09-30T22:31:34.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.987+0000 7faa09fef700 1 --2- 172.21.15.59:0/3421196507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa040a0a30 0x7faa040a0e00 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.987+0000 7faa09fef700 1 --2- 172.21.15.59:0/3421196507 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa04134170 0x7faa0413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.987+0000 7faa09fef700 1 -- 172.21.15.59:0/3421196507 >> 172.21.15.59:0/3421196507 conn(0x7faa040a6550 msgr2=0x7faa040a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:34.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.987+0000 7faa09fef700 1 -- 172.21.15.59:0/3421196507 shutdown_connections 2023-09-30T22:31:34.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.987+0000 7faa09fef700 1 -- 172.21.15.59:0/3421196507 wait complete. 2023-09-30T22:31:34.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.989+0000 7faa09fef700 1 Processor -- start 2023-09-30T22:31:34.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.989+0000 7faa09fef700 1 -- start start 2023-09-30T22:31:34.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa09fef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa040a0a30 0x7faa0411e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa09fef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa040a1340 0x7faa0411edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa09fef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa04134170 0x7faa0411f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa09fef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa04120a50 con 0x7faa040a1340 2023-09-30T22:31:34.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa09fef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa040a0290 con 0x7faa04134170 2023-09-30T22:31:34.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa09fef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa041205b0 con 0x7faa040a0a30 2023-09-30T22:31:34.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa037fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa040a0a30 0x7faa0411e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa037fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa040a0a30 0x7faa0411e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52634/0 (socket says 172.21.15.59:52634) 2023-09-30T22:31:34.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa037fe700 1 -- 172.21.15.59:0/3120393831 learned_addr learned my addr 172.21.15.59:0/3120393831 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:34.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa03fff700 1 --2- 172.21.15.59:0/3120393831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa04134170 0x7faa0411f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa02ffd700 1 --2- 172.21.15.59:0/3120393831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa040a1340 0x7faa0411edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa037fe700 1 -- 172.21.15.59:0/3120393831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa04134170 msgr2=0x7faa0411f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa037fe700 1 --2- 172.21.15.59:0/3120393831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa04134170 0x7faa0411f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa037fe700 1 -- 172.21.15.59:0/3120393831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa040a1340 msgr2=0x7faa0411edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa037fe700 1 --2- 172.21.15.59:0/3120393831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa040a1340 0x7faa0411edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.990+0000 7faa037fe700 1 -- 172.21.15.59:0/3120393831 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f4009550 con 0x7faa040a0a30 2023-09-30T22:31:34.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.991+0000 7faa037fe700 1 --2- 172.21.15.59:0/3120393831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa040a0a30 0x7faa0411e8b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4000c00 tx=0x7fa9f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.991+0000 7fa9ebfff700 1 -- 172.21.15.59:0/3120393831 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40036a0 con 0x7faa040a0a30 2023-09-30T22:31:34.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.991+0000 7fa9ebfff700 1 -- 172.21.15.59:0/3120393831 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f4003800 con 0x7faa040a0a30 2023-09-30T22:31:34.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.991+0000 7fa9ebfff700 1 -- 172.21.15.59:0/3120393831 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4003bb0 con 0x7faa040a0a30 2023-09-30T22:31:34.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.991+0000 7faa09fef700 1 -- 172.21.15.59:0/3120393831 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa040a25e0 con 0x7faa040a0a30 2023-09-30T22:31:34.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.991+0000 7faa09fef700 1 -- 172.21.15.59:0/3120393831 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa04120c20 con 0x7faa040a0a30 2023-09-30T22:31:34.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.992+0000 7fa9ebfff700 1 -- 172.21.15.59:0/3120393831 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9f4021070 con 0x7faa040a0a30 2023-09-30T22:31:34.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.992+0000 7faa09fef700 1 -- 172.21.15.59:0/3120393831 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa04074ea0 con 0x7faa040a0a30 2023-09-30T22:31:34.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:34.992+0000 7fa9ebfff700 1 -- 172.21.15.59:0/3120393831 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa9f4040d00 con 0x7faa040a0a30 2023-09-30T22:31:35.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.001+0000 7fa9ebfff700 1 -- 172.21.15.59:0/3120393831 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9f4029070 con 0x7faa040a0a30 2023-09-30T22:31:35.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.018+0000 7f9196651700 1 -- 172.21.15.59:0/2870049895 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f919009e130 con 0x7f91901316c0 2023-09-30T22:31:35.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.019+0000 7f918cff9700 1 -- 172.21.15.59:0/2870049895 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f919009e130 con 0x7f91901316c0 2023-09-30T22:31:35.020 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:35.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.022+0000 7f9196651700 1 -- 172.21.15.59:0/2870049895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91901316c0 msgr2=0x7f9190070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.022+0000 7f9196651700 1 --2- 172.21.15.59:0/2870049895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91901316c0 0x7f9190070b40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f918800cc10 tx=0x7f918800cf20 comp rx=0 tx=0).stop 2023-09-30T22:31:35.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.022+0000 7f9196651700 1 -- 172.21.15.59:0/2870049895 shutdown_connections 2023-09-30T22:31:35.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.022+0000 7f9196651700 1 --2- 172.21.15.59:0/2870049895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91901316c0 0x7f9190070b40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.022+0000 7f9196651700 1 --2- 172.21.15.59:0/2870049895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f919006acb0 0x7f91901c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.022+0000 7f9196651700 1 --2- 172.21.15.59:0/2870049895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f919009d9f0 0x7f91901c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.022+0000 7f9196651700 1 -- 172.21.15.59:0/2870049895 >> 172.21.15.59:0/2870049895 conn(0x7f9190066f50 msgr2=0x7f91900a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:35.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.022+0000 7f9196651700 1 -- 172.21.15.59:0/2870049895 shutdown_connections 2023-09-30T22:31:35.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.022+0000 7f9196651700 1 -- 172.21.15.59:0/2870049895 wait complete. 2023-09-30T22:31:35.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:35.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.058+0000 7f4955cb0700 1 -- 172.21.15.59:0/2744897463 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f49500a28c0 con 0x7f4950139250 2023-09-30T22:31:35.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.059+0000 7f4937fff700 1 -- 172.21.15.59:0/2744897463 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4948015070 con 0x7f4950139250 2023-09-30T22:31:35.060 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.061+0000 7f4955cb0700 1 -- 172.21.15.59:0/2744897463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4950139250 msgr2=0x7f4950122210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.061+0000 7f4955cb0700 1 --2- 172.21.15.59:0/2744897463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4950139250 0x7f4950122210 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4948016000 tx=0x7f4948004750 comp rx=0 tx=0).stop 2023-09-30T22:31:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.061+0000 7f4955cb0700 1 -- 172.21.15.59:0/2744897463 shutdown_connections 2023-09-30T22:31:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.061+0000 7f4955cb0700 1 --2- 172.21.15.59:0/2744897463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49500a0a30 0x7f4950121790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.061+0000 7f4955cb0700 1 --2- 172.21.15.59:0/2744897463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4950139250 0x7f4950122210 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.061+0000 7f4955cb0700 1 --2- 172.21.15.59:0/2744897463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49500a1510 0x7f4950121cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.061+0000 7f4955cb0700 1 -- 172.21.15.59:0/2744897463 >> 172.21.15.59:0/2744897463 conn(0x7f49500a6550 msgr2=0x7f4950137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.061+0000 7f4955cb0700 1 -- 172.21.15.59:0/2744897463 shutdown_connections 2023-09-30T22:31:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.061+0000 7f4955cb0700 1 -- 172.21.15.59:0/2744897463 wait complete. 2023-09-30T22:31:35.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:35.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.210+0000 7faa09fef700 1 -- 172.21.15.59:0/3120393831 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faa04121e50 con 0x7faa040a0a30 2023-09-30T22:31:35.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.210+0000 7fa9ebfff700 1 -- 172.21.15.59:0/3120393831 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9f4015030 con 0x7faa040a0a30 2023-09-30T22:31:35.212 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:35.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.213+0000 7faa09fef700 1 -- 172.21.15.59:0/3120393831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa040a0a30 msgr2=0x7faa0411e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.213+0000 7faa09fef700 1 --2- 172.21.15.59:0/3120393831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa040a0a30 0x7faa0411e8b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4000c00 tx=0x7fa9f4004750 comp rx=0 tx=0).stop 2023-09-30T22:31:35.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.213+0000 7faa09fef700 1 -- 172.21.15.59:0/3120393831 shutdown_connections 2023-09-30T22:31:35.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.213+0000 7faa09fef700 1 --2- 172.21.15.59:0/3120393831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa040a0a30 0x7faa0411e8b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.213+0000 7faa09fef700 1 --2- 172.21.15.59:0/3120393831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa04134170 0x7faa0411f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.213+0000 7faa09fef700 1 --2- 172.21.15.59:0/3120393831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa040a1340 0x7faa0411edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.213+0000 7faa09fef700 1 -- 172.21.15.59:0/3120393831 >> 172.21.15.59:0/3120393831 conn(0x7faa040a6550 msgr2=0x7faa041b9300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:35.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.213+0000 7faa09fef700 1 -- 172.21.15.59:0/3120393831 shutdown_connections 2023-09-30T22:31:35.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:35.213+0000 7faa09fef700 1 -- 172.21.15.59:0/3120393831 wait complete. 2023-09-30T22:31:35.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:35.936 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:36.038 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:36.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:36.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.081+0000 7efe4b4f0700 1 Processor -- start 2023-09-30T22:31:36.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.082+0000 7efe4b4f0700 1 -- start start 2023-09-30T22:31:36.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.082+0000 7efe4b4f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe44130750 0x7efe44130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.082+0000 7efe4b4f0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe4409d6f0 0x7efe4409db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.082+0000 7efe4b4f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe4409e080 0x7efe441374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.082+0000 7efe4b4f0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4409c190 con 0x7efe4409d6f0 2023-09-30T22:31:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.082+0000 7efe4b4f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4409e520 con 0x7efe4409e080 2023-09-30T22:31:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.082+0000 7efe4b4f0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe4409b090 con 0x7efe44130750 2023-09-30T22:31:36.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.082+0000 7efe48a8b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe4409d6f0 0x7efe4409db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.082+0000 7efe49a8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe4409e080 0x7efe441374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.082+0000 7efe4928c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe44130750 0x7efe44130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.082+0000 7efe48a8b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe4409d6f0 0x7efe4409db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53694/0 (socket says 172.21.15.59:53694) 2023-09-30T22:31:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.082+0000 7efe49a8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe4409e080 0x7efe441374b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41852/0 (socket says 172.21.15.59:41852) 2023-09-30T22:31:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.082+0000 7efe48a8b700 1 -- 172.21.15.59:0/364981273 learned_addr learned my addr 172.21.15.59:0/364981273 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.082+0000 7efe4928c700 1 --2- 172.21.15.59:0/364981273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe44130750 0x7efe44130b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52642/0 (socket says 172.21.15.59:52642) 2023-09-30T22:31:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.083+0000 7efe48a8b700 1 -- 172.21.15.59:0/364981273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe44130750 msgr2=0x7efe44130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.083+0000 7efe48a8b700 1 --2- 172.21.15.59:0/364981273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe44130750 0x7efe44130b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.083+0000 7efe48a8b700 1 -- 172.21.15.59:0/364981273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe4409e080 msgr2=0x7efe441374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.083+0000 7efe48a8b700 1 --2- 172.21.15.59:0/364981273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe4409e080 0x7efe441374b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.083+0000 7efe48a8b700 1 -- 172.21.15.59:0/364981273 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4409a6c0 con 0x7efe4409d6f0 2023-09-30T22:31:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.083+0000 7efe4928c700 1 --2- 172.21.15.59:0/364981273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe44130750 0x7efe44130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.083+0000 7efe48a8b700 1 --2- 172.21.15.59:0/364981273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe4409d6f0 0x7efe4409db40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7efe380098f0 tx=0x7efe38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7129431553432109 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.083+0000 7efe43fff700 1 -- 172.21.15.59:0/364981273 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38011830 con 0x7efe4409d6f0 2023-09-30T22:31:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.083+0000 7efe43fff700 1 -- 172.21.15.59:0/364981273 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe38011990 con 0x7efe4409d6f0 2023-09-30T22:31:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.083+0000 7efe43fff700 1 -- 172.21.15.59:0/364981273 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38011d20 con 0x7efe4409d6f0 2023-09-30T22:31:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.084+0000 7efe4b4f0700 1 -- 172.21.15.59:0/364981273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe4409d6f0 msgr2=0x7efe4409db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.084+0000 7efe4b4f0700 1 --2- 172.21.15.59:0/364981273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe4409d6f0 0x7efe4409db40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7efe380098f0 tx=0x7efe38009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.084+0000 7efe4b4f0700 1 -- 172.21.15.59:0/364981273 shutdown_connections 2023-09-30T22:31:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.084+0000 7efe4b4f0700 1 --2- 172.21.15.59:0/364981273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe4409e080 0x7efe441374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.084+0000 7efe4b4f0700 1 --2- 172.21.15.59:0/364981273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe44130750 0x7efe44130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.084+0000 7efe4b4f0700 1 --2- 172.21.15.59:0/364981273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe4409d6f0 0x7efe4409db40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.084+0000 7efe4b4f0700 1 -- 172.21.15.59:0/364981273 >> 172.21.15.59:0/364981273 conn(0x7efe4409f470 msgr2=0x7efe440a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:36.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.084+0000 7efe4b4f0700 1 -- 172.21.15.59:0/364981273 shutdown_connections 2023-09-30T22:31:36.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.084+0000 7efe4b4f0700 1 -- 172.21.15.59:0/364981273 wait complete. 2023-09-30T22:31:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.085+0000 7efe4b4f0700 1 Processor -- start 2023-09-30T22:31:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.086+0000 7efe4b4f0700 1 -- start start 2023-09-30T22:31:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.086+0000 7efe4b4f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe4409d6f0 0x7efe4412e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.086+0000 7efe4b4f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe4409e080 0x7efe4412e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.086+0000 7efe4b4f0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe44130750 0x7efe4412eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.086+0000 7efe4b4f0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4406f700 con 0x7efe44130750 2023-09-30T22:31:36.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.086+0000 7efe4b4f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4409b2b0 con 0x7efe4409e080 2023-09-30T22:31:36.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.086+0000 7efe4b4f0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe4406f440 con 0x7efe4409d6f0 2023-09-30T22:31:36.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.086+0000 7efe48a8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe4409e080 0x7efe4412e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.086+0000 7efe49a8d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe44130750 0x7efe4412eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.086+0000 7efe4928c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe4409d6f0 0x7efe4412e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.086+0000 7efe48a8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe4409e080 0x7efe4412e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41866/0 (socket says 172.21.15.59:41866) 2023-09-30T22:31:36.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.086+0000 7efe48a8b700 1 -- 172.21.15.59:0/2286308652 learned_addr learned my addr 172.21.15.59:0/2286308652 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:36.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.087+0000 7efe48a8b700 1 -- 172.21.15.59:0/2286308652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe4409d6f0 msgr2=0x7efe4412e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.087+0000 7efe48a8b700 1 --2- 172.21.15.59:0/2286308652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe4409d6f0 0x7efe4412e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.087+0000 7efe48a8b700 1 -- 172.21.15.59:0/2286308652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe44130750 msgr2=0x7efe4412eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.087+0000 7efe48a8b700 1 --2- 172.21.15.59:0/2286308652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe44130750 0x7efe4412eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.087+0000 7efe48a8b700 1 -- 172.21.15.59:0/2286308652 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c009a70 con 0x7efe4409e080 2023-09-30T22:31:36.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.087+0000 7efe48a8b700 1 --2- 172.21.15.59:0/2286308652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe4409e080 0x7efe4412e5c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efe38014040 tx=0x7efe38004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:36.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.087+0000 7efe41ffb700 1 -- 172.21.15.59:0/2286308652 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38004450 con 0x7efe4409e080 2023-09-30T22:31:36.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.087+0000 7efe41ffb700 1 -- 172.21.15.59:0/2286308652 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe380045b0 con 0x7efe4409e080 2023-09-30T22:31:36.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.087+0000 7efe4b4f0700 1 -- 172.21.15.59:0/2286308652 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe38009550 con 0x7efe4409e080 2023-09-30T22:31:36.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.087+0000 7efe41ffb700 1 -- 172.21.15.59:0/2286308652 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe380038e0 con 0x7efe4409e080 2023-09-30T22:31:36.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.087+0000 7efe4b4f0700 1 -- 172.21.15.59:0/2286308652 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe441310e0 con 0x7efe4409e080 2023-09-30T22:31:36.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.088+0000 7efe41ffb700 1 -- 172.21.15.59:0/2286308652 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe38003a40 con 0x7efe4409e080 2023-09-30T22:31:36.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.089+0000 7efe4b4f0700 1 -- 172.21.15.59:0/2286308652 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4406f850 con 0x7efe4409e080 2023-09-30T22:31:36.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.089+0000 7efe41ffb700 1 -- 172.21.15.59:0/2286308652 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efe38020030 con 0x7efe4409e080 2023-09-30T22:31:36.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.094+0000 7efe41ffb700 1 -- 172.21.15.59:0/2286308652 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe3802a070 con 0x7efe4409e080 2023-09-30T22:31:36.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.181+0000 7f7d80234700 1 Processor -- start 2023-09-30T22:31:36.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.181+0000 7f7d80234700 1 -- start start 2023-09-30T22:31:36.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.182+0000 7f7d80234700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d781338a0 0x7f7d78133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.182+0000 7f7d80234700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7809de50 0x7f7d7809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.182+0000 7f7d80234700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7806ef30 con 0x7f7d7809e760 2023-09-30T22:31:36.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.182+0000 7f7d80234700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7806fef0 con 0x7f7d7809de50 2023-09-30T22:31:36.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.182+0000 7f7d80234700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d781334b0 con 0x7f7d781338a0 2023-09-30T22:31:36.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.182+0000 7f7d7dfd0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d781338a0 0x7f7d78133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.182+0000 7f7d7dfd0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d781338a0 0x7f7d78133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52658/0 (socket says 172.21.15.59:52658) 2023-09-30T22:31:36.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.182+0000 7f7d7dfd0700 1 -- 172.21.15.59:0/4172523824 learned_addr learned my addr 172.21.15.59:0/4172523824 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:36.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.182+0000 7f7d7d7cf700 1 --2- 172.21.15.59:0/4172523824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7809de50 0x7f7d7809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.183+0000 7f7d7dfd0700 1 -- 172.21.15.59:0/4172523824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7809de50 msgr2=0x7f7d7809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:36.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.183+0000 7f7d7dfd0700 1 --2- 172.21.15.59:0/4172523824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7809de50 0x7f7d7809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.183+0000 7f7d7dfd0700 1 -- 172.21.15.59:0/4172523824 >> v1:172.21.15.59:6789/0 conn(0x7f7d7809e760 legacy=0x7f7d7813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.183+0000 7f7d7dfd0700 1 -- 172.21.15.59:0/4172523824 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7806fc30 con 0x7f7d781338a0 2023-09-30T22:31:36.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.183+0000 7f7d7d7cf700 1 --2- 172.21.15.59:0/4172523824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7809de50 0x7f7d7809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:36.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.183+0000 7f7d7dfd0700 1 --2- 172.21.15.59:0/4172523824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d781338a0 0x7f7d78133c70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009950 tx=0x7f7d74009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=701e72a57d798f97 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:36.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.183+0000 7f7d7cfce700 1 -- 172.21.15.59:0/4172523824 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d74011830 con 0x7f7d781338a0 2023-09-30T22:31:36.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.183+0000 7f7d7cfce700 1 -- 172.21.15.59:0/4172523824 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d74011990 con 0x7f7d781338a0 2023-09-30T22:31:36.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.183+0000 7f7d7cfce700 1 -- 172.21.15.59:0/4172523824 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d74011d40 con 0x7f7d781338a0 2023-09-30T22:31:36.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.184+0000 7f7d80234700 1 -- 172.21.15.59:0/4172523824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d781338a0 msgr2=0x7f7d78133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.184+0000 7f7d80234700 1 --2- 172.21.15.59:0/4172523824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d781338a0 0x7f7d78133c70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009950 tx=0x7f7d74009c60 comp rx=0 tx=0).stop 2023-09-30T22:31:36.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.184+0000 7f7d80234700 1 -- 172.21.15.59:0/4172523824 shutdown_connections 2023-09-30T22:31:36.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.184+0000 7f7d80234700 1 --2- 172.21.15.59:0/4172523824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d781338a0 0x7f7d78133c70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.184+0000 7f7d80234700 1 --2- 172.21.15.59:0/4172523824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7809de50 0x7f7d7809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.184+0000 7f7d80234700 1 -- 172.21.15.59:0/4172523824 >> 172.21.15.59:0/4172523824 conn(0x7f7d780a2aa0 msgr2=0x7f7d780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.184+0000 7f7d80234700 1 -- 172.21.15.59:0/4172523824 shutdown_connections 2023-09-30T22:31:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.184+0000 7f7d80234700 1 -- 172.21.15.59:0/4172523824 wait complete. 2023-09-30T22:31:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.185+0000 7f7d80234700 1 Processor -- start 2023-09-30T22:31:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.185+0000 7f7d80234700 1 -- start start 2023-09-30T22:31:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.185+0000 7f7d80234700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7809de50 0x7f7d7811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.185+0000 7f7d80234700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7809e760 0x7f7d7811f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.185+0000 7f7d80234700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d781338a0 0x7f7d7811f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.186+0000 7f7d80234700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78120730 con 0x7f7d7809de50 2023-09-30T22:31:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.186+0000 7f7d80234700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d781222c0 con 0x7f7d781338a0 2023-09-30T22:31:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.186+0000 7f7d80234700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780a10d0 con 0x7f7d7809e760 2023-09-30T22:31:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.186+0000 7f7d7dfd0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7809de50 0x7f7d7811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.186+0000 7f7d7dfd0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7809de50 0x7f7d7811ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53716/0 (socket says 172.21.15.59:53716) 2023-09-30T22:31:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.186+0000 7f7d7dfd0700 1 -- 172.21.15.59:0/762634884 learned_addr learned my addr 172.21.15.59:0/762634884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.186+0000 7f7d7d7cf700 1 --2- 172.21.15.59:0/762634884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7809e760 0x7f7d7811f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.186+0000 7f7d7e7d1700 1 --2- 172.21.15.59:0/762634884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d781338a0 0x7f7d7811f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.186+0000 7f7d7dfd0700 1 -- 172.21.15.59:0/762634884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7809e760 msgr2=0x7f7d7811f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.186+0000 7f7d7dfd0700 1 --2- 172.21.15.59:0/762634884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7809e760 0x7f7d7811f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.186+0000 7f7d7dfd0700 1 -- 172.21.15.59:0/762634884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d781338a0 msgr2=0x7f7d7811f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.186+0000 7f7d7dfd0700 1 --2- 172.21.15.59:0/762634884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d781338a0 0x7f7d7811f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.186+0000 7f7d7dfd0700 1 -- 172.21.15.59:0/762634884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d680094a0 con 0x7f7d7809de50 2023-09-30T22:31:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.186+0000 7f7d7dfd0700 1 --2- 172.21.15.59:0/762634884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7809de50 0x7f7d7811ead0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009ca0 tx=0x7f7d74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.186+0000 7f7d6e7fc700 1 -- 172.21.15.59:0/762634884 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d74004510 con 0x7f7d7809de50 2023-09-30T22:31:36.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.187+0000 7f7d6e7fc700 1 -- 172.21.15.59:0/762634884 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d740036a0 con 0x7f7d7809de50 2023-09-30T22:31:36.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.187+0000 7f7d80234700 1 -- 172.21.15.59:0/762634884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d74009550 con 0x7f7d7809de50 2023-09-30T22:31:36.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.187+0000 7f7d6e7fc700 1 -- 172.21.15.59:0/762634884 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d74003a50 con 0x7f7d7809de50 2023-09-30T22:31:36.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.187+0000 7f7d80234700 1 -- 172.21.15.59:0/762634884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7812f5a0 con 0x7f7d7809de50 2023-09-30T22:31:36.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.187+0000 7f7d6e7fc700 1 -- 172.21.15.59:0/762634884 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d74003bb0 con 0x7f7d7809de50 2023-09-30T22:31:36.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.188+0000 7f7d80234700 1 -- 172.21.15.59:0/762634884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d78122100 con 0x7f7d7809de50 2023-09-30T22:31:36.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.188+0000 7f7d6e7fc700 1 -- 172.21.15.59:0/762634884 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7d74040840 con 0x7f7d7809de50 2023-09-30T22:31:36.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.193+0000 7f7d6e7fc700 1 -- 172.21.15.59:0/762634884 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d7401a420 con 0x7f7d7809de50 2023-09-30T22:31:36.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.223+0000 7fb45ad37700 1 Processor -- start 2023-09-30T22:31:36.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.224+0000 7fb45ad37700 1 -- start start 2023-09-30T22:31:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.224+0000 7fb45ad37700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4541316c0 0x7fb454131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.224+0000 7fb45ad37700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb45409d9f0 0x7fb45406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.224+0000 7fb45ad37700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb45406acb0 0x7fb45406b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.224+0000 7fb45ad37700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45409e130 con 0x7fb4541316c0 2023-09-30T22:31:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.224+0000 7fb45ad37700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4541312b0 con 0x7fb45406acb0 2023-09-30T22:31:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.224+0000 7fb45ad37700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb45409f6e0 con 0x7fb45409d9f0 2023-09-30T22:31:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.225+0000 7fb458ad3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4541316c0 0x7fb454131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.225+0000 7fb458ad3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4541316c0 0x7fb454131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53718/0 (socket says 172.21.15.59:53718) 2023-09-30T22:31:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.225+0000 7fb4592d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb45406acb0 0x7fb45406b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.225+0000 7fb458ad3700 1 -- 172.21.15.59:0/1103878728 learned_addr learned my addr 172.21.15.59:0/1103878728 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.225+0000 7fb453fff700 1 --2- 172.21.15.59:0/1103878728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb45409d9f0 0x7fb45406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.225+0000 7fb458ad3700 1 -- 172.21.15.59:0/1103878728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb45409d9f0 msgr2=0x7fb45406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.225+0000 7fb458ad3700 1 --2- 172.21.15.59:0/1103878728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb45409d9f0 0x7fb45406a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.225+0000 7fb458ad3700 1 -- 172.21.15.59:0/1103878728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb45406acb0 msgr2=0x7fb45406b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.225+0000 7fb458ad3700 1 --2- 172.21.15.59:0/1103878728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb45406acb0 0x7fb45406b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.225+0000 7fb458ad3700 1 -- 172.21.15.59:0/1103878728 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45409e760 con 0x7fb4541316c0 2023-09-30T22:31:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.225+0000 7fb4592d4700 1 --2- 172.21.15.59:0/1103878728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb45406acb0 0x7fb45406b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:36.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.225+0000 7fb458ad3700 1 --2- 172.21.15.59:0/1103878728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4541316c0 0x7fb454131a90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb4480098f0 tx=0x7fb448009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e4ab557fc7aa05 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:36.228 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.226+0000 7fb4537fe700 1 -- 172.21.15.59:0/1103878728 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448011830 con 0x7fb4541316c0 2023-09-30T22:31:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.226+0000 7fb4537fe700 1 -- 172.21.15.59:0/1103878728 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb448011990 con 0x7fb4541316c0 2023-09-30T22:31:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.226+0000 7fb4537fe700 1 -- 172.21.15.59:0/1103878728 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448011d20 con 0x7fb4541316c0 2023-09-30T22:31:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.226+0000 7fb45ad37700 1 -- 172.21.15.59:0/1103878728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4541316c0 msgr2=0x7fb454131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.226+0000 7fb45ad37700 1 --2- 172.21.15.59:0/1103878728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4541316c0 0x7fb454131a90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb4480098f0 tx=0x7fb448009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.226+0000 7fb45ad37700 1 -- 172.21.15.59:0/1103878728 shutdown_connections 2023-09-30T22:31:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.226+0000 7fb45ad37700 1 --2- 172.21.15.59:0/1103878728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb45406acb0 0x7fb45406b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.226+0000 7fb45ad37700 1 --2- 172.21.15.59:0/1103878728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4541316c0 0x7fb454131a90 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.226+0000 7fb45ad37700 1 --2- 172.21.15.59:0/1103878728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb45409d9f0 0x7fb45406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.226+0000 7fb45ad37700 1 -- 172.21.15.59:0/1103878728 >> 172.21.15.59:0/1103878728 conn(0x7fb454066f50 msgr2=0x7fb45409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.226+0000 7fb45ad37700 1 -- 172.21.15.59:0/1103878728 shutdown_connections 2023-09-30T22:31:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.226+0000 7fb45ad37700 1 -- 172.21.15.59:0/1103878728 wait complete. 2023-09-30T22:31:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.228+0000 7fb45ad37700 1 Processor -- start 2023-09-30T22:31:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.228+0000 7fb45ad37700 1 -- start start 2023-09-30T22:31:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb45ad37700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb45406acb0 0x7fb45411a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb45ad37700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb45409d9f0 0x7fb45411a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb45ad37700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4541316c0 0x7fb45411aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb45ad37700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45411db40 con 0x7fb4541316c0 2023-09-30T22:31:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb45ad37700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45411dd40 con 0x7fb45406acb0 2023-09-30T22:31:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb45ad37700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb45411cc30 con 0x7fb45409d9f0 2023-09-30T22:31:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb453fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb45409d9f0 0x7fb45411a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb458ad3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb45406acb0 0x7fb45411a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb453fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb45409d9f0 0x7fb45411a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52682/0 (socket says 172.21.15.59:52682) 2023-09-30T22:31:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb453fff700 1 -- 172.21.15.59:0/1434234503 learned_addr learned my addr 172.21.15.59:0/1434234503 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb4592d4700 1 --2- 172.21.15.59:0/1434234503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4541316c0 0x7fb45411aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb453fff700 1 -- 172.21.15.59:0/1434234503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb45406acb0 msgr2=0x7fb45411a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb453fff700 1 --2- 172.21.15.59:0/1434234503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb45406acb0 0x7fb45411a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb453fff700 1 -- 172.21.15.59:0/1434234503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4541316c0 msgr2=0x7fb45411aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb453fff700 1 --2- 172.21.15.59:0/1434234503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4541316c0 0x7fb45411aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb453fff700 1 -- 172.21.15.59:0/1434234503 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c009a70 con 0x7fb45409d9f0 2023-09-30T22:31:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb458ad3700 1 --2- 172.21.15.59:0/1434234503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb45406acb0 0x7fb45411a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:36.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.229+0000 7fb453fff700 1 --2- 172.21.15.59:0/1434234503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb45409d9f0 0x7fb45411a760 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb44000e9e0 tx=0x7fb44000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:36.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.230+0000 7fb4517fa700 1 -- 172.21.15.59:0/1434234503 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440009710 con 0x7fb45409d9f0 2023-09-30T22:31:36.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.230+0000 7fb4517fa700 1 -- 172.21.15.59:0/1434234503 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44000ee70 con 0x7fb45409d9f0 2023-09-30T22:31:36.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.230+0000 7fb45ad37700 1 -- 172.21.15.59:0/1434234503 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb448009550 con 0x7fb45409d9f0 2023-09-30T22:31:36.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.230+0000 7fb4517fa700 1 -- 172.21.15.59:0/1434234503 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44000ca50 con 0x7fb45409d9f0 2023-09-30T22:31:36.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.230+0000 7fb45ad37700 1 -- 172.21.15.59:0/1434234503 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45412b900 con 0x7fb45409d9f0 2023-09-30T22:31:36.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.231+0000 7fb45ad37700 1 -- 172.21.15.59:0/1434234503 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb454070080 con 0x7fb45409d9f0 2023-09-30T22:31:36.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.232+0000 7fb4517fa700 1 -- 172.21.15.59:0/1434234503 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb44000cbb0 con 0x7fb45409d9f0 2023-09-30T22:31:36.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.232+0000 7fb4517fa700 1 -- 172.21.15.59:0/1434234503 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb44003fe90 con 0x7fb45409d9f0 2023-09-30T22:31:36.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.240+0000 7fb4517fa700 1 -- 172.21.15.59:0/1434234503 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb44001a360 con 0x7fb45409d9f0 2023-09-30T22:31:36.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.309+0000 7efe4b4f0700 1 -- 172.21.15.59:0/2286308652 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efe4406fac0 con 0x7efe4409e080 2023-09-30T22:31:36.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.309+0000 7efe41ffb700 1 -- 172.21.15.59:0/2286308652 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe38034090 con 0x7efe4409e080 2023-09-30T22:31:36.310 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:36.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.313+0000 7efe4b4f0700 1 -- 172.21.15.59:0/2286308652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe4409e080 msgr2=0x7efe4412e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.313+0000 7efe4b4f0700 1 --2- 172.21.15.59:0/2286308652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe4409e080 0x7efe4412e5c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efe38014040 tx=0x7efe38004750 comp rx=0 tx=0).stop 2023-09-30T22:31:36.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.313+0000 7efe4b4f0700 1 -- 172.21.15.59:0/2286308652 shutdown_connections 2023-09-30T22:31:36.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.313+0000 7efe4b4f0700 1 --2- 172.21.15.59:0/2286308652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe4409d6f0 0x7efe4412e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.313+0000 7efe4b4f0700 1 --2- 172.21.15.59:0/2286308652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe44130750 0x7efe4412eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.313+0000 7efe4b4f0700 1 --2- 172.21.15.59:0/2286308652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe4409e080 0x7efe4412e5c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.313+0000 7efe4b4f0700 1 -- 172.21.15.59:0/2286308652 >> 172.21.15.59:0/2286308652 conn(0x7efe4409f470 msgr2=0x7efe440992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:36.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.313+0000 7efe4b4f0700 1 -- 172.21.15.59:0/2286308652 shutdown_connections 2023-09-30T22:31:36.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.313+0000 7efe4b4f0700 1 -- 172.21.15.59:0/2286308652 wait complete. 2023-09-30T22:31:36.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:36.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.369+0000 7f942f365700 1 Processor -- start 2023-09-30T22:31:36.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.369+0000 7f942f365700 1 -- start start 2023-09-30T22:31:36.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.369+0000 7f942f365700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94281337f0 0x7f9428138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.369+0000 7f942f365700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9428138dc0 0x7f942813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.369+0000 7f942f365700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f942806b990 con 0x7f9428133420 2023-09-30T22:31:36.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.369+0000 7f942f365700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942809b0e0 con 0x7f9428138dc0 2023-09-30T22:31:36.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.369+0000 7f942f365700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9428133c20 con 0x7f94281337f0 2023-09-30T22:31:36.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.370+0000 7f942c900700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94281337f0 0x7f9428138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.370+0000 7f942d101700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9428133420 0x7f9428133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47734/0 (socket says 172.21.15.59:47734) 2023-09-30T22:31:36.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.370+0000 7f942c900700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94281337f0 0x7f9428138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52688/0 (socket says 172.21.15.59:52688) 2023-09-30T22:31:36.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.370+0000 7f942d101700 1 -- 172.21.15.59:0/1145570603 learned_addr learned my addr 172.21.15.59:0/1145570603 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:36.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.370+0000 7f942d902700 1 --2- 172.21.15.59:0/1145570603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9428138dc0 0x7f942813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.370+0000 7f941ffff700 1 -- 172.21.15.59:0/1145570603 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209412782 0 0) 0x7f942806b990 con 0x7f9428133420 2023-09-30T22:31:36.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.370+0000 7f942c900700 1 -- 172.21.15.59:0/1145570603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9428138dc0 msgr2=0x7f942813b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:36.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.370+0000 7f942c900700 1 --2- 172.21.15.59:0/1145570603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9428138dc0 0x7f942813b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.370+0000 7f942c900700 1 -- 172.21.15.59:0/1145570603 >> v1:172.21.15.59:6789/0 conn(0x7f9428133420 legacy=0x7f9428133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.370+0000 7f942c900700 1 -- 172.21.15.59:0/1145570603 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94280a0590 con 0x7f94281337f0 2023-09-30T22:31:36.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.370+0000 7f942c900700 1 --2- 172.21.15.59:0/1145570603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94281337f0 0x7f9428138880 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9418009870 tx=0x7f9418009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c30e517d35d9ddb3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:36.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.371+0000 7f941ffff700 1 -- 172.21.15.59:0/1145570603 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9418011830 con 0x7f94281337f0 2023-09-30T22:31:36.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.371+0000 7f941ffff700 1 -- 172.21.15.59:0/1145570603 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9418011990 con 0x7f94281337f0 2023-09-30T22:31:36.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.371+0000 7f941ffff700 1 -- 172.21.15.59:0/1145570603 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9418011d20 con 0x7f94281337f0 2023-09-30T22:31:36.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.371+0000 7f942f365700 1 -- 172.21.15.59:0/1145570603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94281337f0 msgr2=0x7f9428138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.371+0000 7f942f365700 1 --2- 172.21.15.59:0/1145570603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94281337f0 0x7f9428138880 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9418009870 tx=0x7f9418009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:36.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.371+0000 7f942f365700 1 -- 172.21.15.59:0/1145570603 shutdown_connections 2023-09-30T22:31:36.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.371+0000 7f942f365700 1 --2- 172.21.15.59:0/1145570603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9428138dc0 0x7f942813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.371+0000 7f942f365700 1 --2- 172.21.15.59:0/1145570603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94281337f0 0x7f9428138880 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.371+0000 7f942f365700 1 -- 172.21.15.59:0/1145570603 >> 172.21.15.59:0/1145570603 conn(0x7f94280a4210 msgr2=0x7f94280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:36.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.371+0000 7f942f365700 1 -- 172.21.15.59:0/1145570603 shutdown_connections 2023-09-30T22:31:36.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.371+0000 7f942f365700 1 -- 172.21.15.59:0/1145570603 wait complete. 2023-09-30T22:31:36.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.372+0000 7f942f365700 1 Processor -- start 2023-09-30T22:31:36.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.372+0000 7f942f365700 1 -- start start 2023-09-30T22:31:36.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942f365700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9428133420 0x7f94281304c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942f365700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94281337f0 0x7f9428130a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942f365700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9428138dc0 0x7f942809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:36.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942f365700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94281331c0 con 0x7f9428133420 2023-09-30T22:31:36.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942f365700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942812efa0 con 0x7f94281337f0 2023-09-30T22:31:36.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942f365700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f942812f3f0 con 0x7f9428138dc0 2023-09-30T22:31:36.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942d902700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9428138dc0 0x7f942809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942d902700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9428138dc0 0x7f942809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52704/0 (socket says 172.21.15.59:52704) 2023-09-30T22:31:36.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942d902700 1 -- 172.21.15.59:0/2066226153 learned_addr learned my addr 172.21.15.59:0/2066226153 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:36.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942d101700 1 --2- 172.21.15.59:0/2066226153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9428133420 0x7f94281304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:36.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942d902700 1 -- 172.21.15.59:0/2066226153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94281337f0 msgr2=0x7f9428130a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942d902700 1 --2- 172.21.15.59:0/2066226153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94281337f0 0x7f9428130a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942d902700 1 -- 172.21.15.59:0/2066226153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9428133420 msgr2=0x7f94281304c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942d902700 1 --2- 172.21.15.59:0/2066226153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9428133420 0x7f94281304c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942d902700 1 -- 172.21.15.59:0/2066226153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94180094a0 con 0x7f9428138dc0 2023-09-30T22:31:36.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.373+0000 7f942d101700 1 --2- 172.21.15.59:0/2066226153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9428133420 0x7f94281304c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:36.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.374+0000 7f942d902700 1 --2- 172.21.15.59:0/2066226153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9428138dc0 0x7f942809c480 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f942000efc0 tx=0x7f942000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:36.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.374+0000 7f941dffb700 1 -- 172.21.15.59:0/2066226153 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9420009ca0 con 0x7f9428138dc0 2023-09-30T22:31:36.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.374+0000 7f941dffb700 1 -- 172.21.15.59:0/2066226153 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942000f040 con 0x7f9428138dc0 2023-09-30T22:31:36.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.374+0000 7f942f365700 1 -- 172.21.15.59:0/2066226153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942812db40 con 0x7f9428138dc0 2023-09-30T22:31:36.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.374+0000 7f941dffb700 1 -- 172.21.15.59:0/2066226153 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9420014480 con 0x7f9428138dc0 2023-09-30T22:31:36.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.374+0000 7f942f365700 1 -- 172.21.15.59:0/2066226153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942812fa10 con 0x7f9428138dc0 2023-09-30T22:31:36.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.375+0000 7f941dffb700 1 -- 172.21.15.59:0/2066226153 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f94200145e0 con 0x7f9428138dc0 2023-09-30T22:31:36.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.375+0000 7f941dffb700 1 -- 172.21.15.59:0/2066226153 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9420040480 con 0x7f9428138dc0 2023-09-30T22:31:36.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.375+0000 7f942f365700 1 -- 172.21.15.59:0/2066226153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f942812f1e0 con 0x7f9428138dc0 2023-09-30T22:31:36.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.380+0000 7f941dffb700 1 -- 172.21.15.59:0/2066226153 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9420018030 con 0x7f9428138dc0 2023-09-30T22:31:36.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.422+0000 7f7d80234700 1 -- 172.21.15.59:0/762634884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7d78074ea0 con 0x7f7d7809de50 2023-09-30T22:31:36.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.422+0000 7f7d6e7fc700 1 -- 172.21.15.59:0/762634884 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d74028090 con 0x7f7d7809de50 2023-09-30T22:31:36.423 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:36.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.424+0000 7f7d80234700 1 -- 172.21.15.59:0/762634884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7809de50 msgr2=0x7f7d7811ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.424+0000 7f7d80234700 1 --2- 172.21.15.59:0/762634884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7809de50 0x7f7d7811ead0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009ca0 tx=0x7f7d74004750 comp rx=0 tx=0).stop 2023-09-30T22:31:36.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.424+0000 7f7d80234700 1 -- 172.21.15.59:0/762634884 shutdown_connections 2023-09-30T22:31:36.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.424+0000 7f7d80234700 1 --2- 172.21.15.59:0/762634884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d781338a0 0x7f7d7811f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.424+0000 7f7d80234700 1 --2- 172.21.15.59:0/762634884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7809de50 0x7f7d7811ead0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.424+0000 7f7d80234700 1 --2- 172.21.15.59:0/762634884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7809e760 0x7f7d7811f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.424+0000 7f7d80234700 1 -- 172.21.15.59:0/762634884 >> 172.21.15.59:0/762634884 conn(0x7f7d780a2aa0 msgr2=0x7f7d7809ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:36.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.424+0000 7f7d80234700 1 -- 172.21.15.59:0/762634884 shutdown_connections 2023-09-30T22:31:36.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.424+0000 7f7d80234700 1 -- 172.21.15.59:0/762634884 wait complete. 2023-09-30T22:31:36.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:36.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.454+0000 7fb45ad37700 1 -- 172.21.15.59:0/1434234503 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb454074ea0 con 0x7fb45409d9f0 2023-09-30T22:31:36.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.454+0000 7fb4517fa700 1 -- 172.21.15.59:0/1434234503 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb440017070 con 0x7fb45409d9f0 2023-09-30T22:31:36.455 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.456+0000 7fb45ad37700 1 -- 172.21.15.59:0/1434234503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb45409d9f0 msgr2=0x7fb45411a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.457+0000 7fb45ad37700 1 --2- 172.21.15.59:0/1434234503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb45409d9f0 0x7fb45411a760 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb44000e9e0 tx=0x7fb44000ecf0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.457+0000 7fb45ad37700 1 -- 172.21.15.59:0/1434234503 shutdown_connections 2023-09-30T22:31:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.457+0000 7fb45ad37700 1 --2- 172.21.15.59:0/1434234503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4541316c0 0x7fb45411aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.457+0000 7fb45ad37700 1 --2- 172.21.15.59:0/1434234503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb45406acb0 0x7fb45411a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.457+0000 7fb45ad37700 1 --2- 172.21.15.59:0/1434234503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb45409d9f0 0x7fb45411a760 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.457+0000 7fb45ad37700 1 -- 172.21.15.59:0/1434234503 >> 172.21.15.59:0/1434234503 conn(0x7fb454066f50 msgr2=0x7fb45412e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.457+0000 7fb45ad37700 1 -- 172.21.15.59:0/1434234503 shutdown_connections 2023-09-30T22:31:36.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.457+0000 7fb45ad37700 1 -- 172.21.15.59:0/1434234503 wait complete. 2023-09-30T22:31:36.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:36.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.587+0000 7f942f365700 1 -- 172.21.15.59:0/2066226153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9428074ea0 con 0x7f9428138dc0 2023-09-30T22:31:36.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.587+0000 7f941dffb700 1 -- 172.21.15.59:0/2066226153 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f942002b090 con 0x7f9428138dc0 2023-09-30T22:31:36.589 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:36.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.590+0000 7f942f365700 1 -- 172.21.15.59:0/2066226153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9428138dc0 msgr2=0x7f942809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:36.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.590+0000 7f942f365700 1 --2- 172.21.15.59:0/2066226153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9428138dc0 0x7f942809c480 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f942000efc0 tx=0x7f942000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.590+0000 7f942f365700 1 -- 172.21.15.59:0/2066226153 shutdown_connections 2023-09-30T22:31:36.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.590+0000 7f942f365700 1 --2- 172.21.15.59:0/2066226153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9428138dc0 0x7f942809c480 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.590+0000 7f942f365700 1 --2- 172.21.15.59:0/2066226153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9428133420 0x7f94281304c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.590+0000 7f942f365700 1 --2- 172.21.15.59:0/2066226153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94281337f0 0x7f9428130a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:36.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.590+0000 7f942f365700 1 -- 172.21.15.59:0/2066226153 >> 172.21.15.59:0/2066226153 conn(0x7f94280a4210 msgr2=0x7f94280a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:36.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.590+0000 7f942f365700 1 -- 172.21.15.59:0/2066226153 shutdown_connections 2023-09-30T22:31:36.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:36.590+0000 7f942f365700 1 -- 172.21.15.59:0/2066226153 wait complete. 2023-09-30T22:31:36.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:37.335 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:37.440 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:37.473 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:37.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.482+0000 7f9c0bfa1700 1 Processor -- start 2023-09-30T22:31:37.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.482+0000 7f9c0bfa1700 1 -- start start 2023-09-30T22:31:37.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.483+0000 7f9c0bfa1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c040a1510 0x7f9c04138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.483+0000 7f9c0bfa1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c04139250 0x7f9c0413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.483+0000 7f9c0bfa1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0409edd0 con 0x7f9c040a0a30 2023-09-30T22:31:37.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.483+0000 7f9c0bfa1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c040a18e0 con 0x7f9c040a1510 2023-09-30T22:31:37.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.483+0000 7f9c0bfa1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0409e1f0 con 0x7f9c04139250 2023-09-30T22:31:37.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.483+0000 7f9c0a53e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c04139250 0x7f9c0413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.483+0000 7f9c0a53e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c04139250 0x7f9c0413b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41942/0 (socket says 172.21.15.59:41942) 2023-09-30T22:31:37.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.483+0000 7f9c0a53e700 1 -- 172.21.15.59:0/1840078982 learned_addr learned my addr 172.21.15.59:0/1840078982 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:37.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.483+0000 7f9c0953c700 1 --2- 172.21.15.59:0/1840078982 >> v2:172.21.15.59:3300/0 conn(0x7f9c040a1510 0x7f9c04138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.483+0000 7f9c0a53e700 1 -- 172.21.15.59:0/1840078982 >> v2:172.21.15.59:3300/0 conn(0x7f9c040a1510 msgr2=0x7f9c04138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:37.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.483+0000 7f9c0a53e700 1 --2- 172.21.15.59:0/1840078982 >> v2:172.21.15.59:3300/0 conn(0x7f9c040a1510 0x7f9c04138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.483+0000 7f9c0a53e700 1 -- 172.21.15.59:0/1840078982 >> v1:172.21.15.59:6789/0 conn(0x7f9c040a0a30 legacy=0x7f9c040a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:37.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.483+0000 7f9c0a53e700 1 -- 172.21.15.59:0/1840078982 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0409dc50 con 0x7f9c04139250 2023-09-30T22:31:37.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.484+0000 7f9c0a53e700 1 --2- 172.21.15.59:0/1840078982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c04139250 0x7f9c0413b630 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009e50 tx=0x7f9bfc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f5b4838065994b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.484+0000 7f9c08d3b700 1 -- 172.21.15.59:0/1840078982 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc00e070 con 0x7f9c04139250 2023-09-30T22:31:37.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.484+0000 7f9c08d3b700 1 -- 172.21.15.59:0/1840078982 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc003a20 con 0x7f9c04139250 2023-09-30T22:31:37.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.484+0000 7f9c08d3b700 1 -- 172.21.15.59:0/1840078982 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc003dd0 con 0x7f9c04139250 2023-09-30T22:31:37.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.485+0000 7f9c0bfa1700 1 -- 172.21.15.59:0/1840078982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c04139250 msgr2=0x7f9c0413b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.485+0000 7f9c0bfa1700 1 --2- 172.21.15.59:0/1840078982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c04139250 0x7f9c0413b630 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009e50 tx=0x7f9bfc00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:37.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.485+0000 7f9c0bfa1700 1 -- 172.21.15.59:0/1840078982 shutdown_connections 2023-09-30T22:31:37.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.485+0000 7f9c0bfa1700 1 --2- 172.21.15.59:0/1840078982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c04139250 0x7f9c0413b630 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.485+0000 7f9c0bfa1700 1 --2- 172.21.15.59:0/1840078982 >> v2:172.21.15.59:3300/0 conn(0x7f9c040a1510 0x7f9c04138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.485+0000 7f9c0bfa1700 1 -- 172.21.15.59:0/1840078982 >> 172.21.15.59:0/1840078982 conn(0x7f9c040a6550 msgr2=0x7f9c040a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.485+0000 7f9c0bfa1700 1 -- 172.21.15.59:0/1840078982 shutdown_connections 2023-09-30T22:31:37.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.485+0000 7f9c0bfa1700 1 -- 172.21.15.59:0/1840078982 wait complete. 2023-09-30T22:31:37.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.486+0000 7f9c0bfa1700 1 Processor -- start 2023-09-30T22:31:37.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.486+0000 7f9c0bfa1700 1 -- start start 2023-09-30T22:31:37.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c0bfa1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c040a0a30 0x7f9c04122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c0bfa1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c040a1510 0x7f9c04122ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c0bfa1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c04139250 0x7f9c04123400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c0bfa1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c041261c0 con 0x7f9c04139250 2023-09-30T22:31:37.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c0bfa1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c041246a0 con 0x7f9c040a0a30 2023-09-30T22:31:37.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c0bfa1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c04138c40 con 0x7f9c040a1510 2023-09-30T22:31:37.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c09d3d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c040a0a30 0x7f9c04122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c09d3d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c040a0a30 0x7f9c04122980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41948/0 (socket says 172.21.15.59:41948) 2023-09-30T22:31:37.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c09d3d700 1 -- 172.21.15.59:0/1603655336 learned_addr learned my addr 172.21.15.59:0/1603655336 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:37.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c0a53e700 1 --2- 172.21.15.59:0/1603655336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c04139250 0x7f9c04123400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c0953c700 1 --2- 172.21.15.59:0/1603655336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c040a1510 0x7f9c04122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c09d3d700 1 -- 172.21.15.59:0/1603655336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c040a1510 msgr2=0x7f9c04122ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c09d3d700 1 --2- 172.21.15.59:0/1603655336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c040a1510 0x7f9c04122ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c09d3d700 1 -- 172.21.15.59:0/1603655336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c04139250 msgr2=0x7f9c04123400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c09d3d700 1 --2- 172.21.15.59:0/1603655336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c04139250 0x7f9c04123400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c09d3d700 1 -- 172.21.15.59:0/1603655336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc009b30 con 0x7f9c040a0a30 2023-09-30T22:31:37.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c0953c700 1 --2- 172.21.15.59:0/1603655336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c040a1510 0x7f9c04122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:37.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.487+0000 7f9c09d3d700 1 --2- 172.21.15.59:0/1603655336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c040a0a30 0x7f9c04122980 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000c4d0 tx=0x7f9c0000c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.488+0000 7f9bfa7fc700 1 -- 172.21.15.59:0/1603655336 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00011790 con 0x7f9c040a0a30 2023-09-30T22:31:37.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.488+0000 7f9bfa7fc700 1 -- 172.21.15.59:0/1603655336 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c000118f0 con 0x7f9c040a0a30 2023-09-30T22:31:37.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.488+0000 7f9bfa7fc700 1 -- 172.21.15.59:0/1603655336 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00011ca0 con 0x7f9c040a0a30 2023-09-30T22:31:37.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.488+0000 7f9c0bfa1700 1 -- 172.21.15.59:0/1603655336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c040a0220 con 0x7f9c040a0a30 2023-09-30T22:31:37.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.488+0000 7f9c0bfa1700 1 -- 172.21.15.59:0/1603655336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c04126c30 con 0x7f9c040a0a30 2023-09-30T22:31:37.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.489+0000 7f9c0bfa1700 1 -- 172.21.15.59:0/1603655336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c04074ea0 con 0x7f9c040a0a30 2023-09-30T22:31:37.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.490+0000 7f9bfa7fc700 1 -- 172.21.15.59:0/1603655336 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c00026430 con 0x7f9c040a0a30 2023-09-30T22:31:37.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.490+0000 7f9bfa7fc700 1 -- 172.21.15.59:0/1603655336 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9c00040080 con 0x7f9c040a0a30 2023-09-30T22:31:37.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.494+0000 7f9bfa7fc700 1 -- 172.21.15.59:0/1603655336 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c00026e40 con 0x7f9c040a0a30 2023-09-30T22:31:37.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.596+0000 7fb8b1c08700 1 Processor -- start 2023-09-30T22:31:37.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.596+0000 7fb8b1c08700 1 -- start start 2023-09-30T22:31:37.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.596+0000 7fb8b1c08700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8ac09e1d0 0x7fb8ac138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.596+0000 7fb8b1c08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8ac139170 0x7fb8ac13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.596+0000 7fb8b1c08700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ac09b120 con 0x7fb8ac09d6f0 2023-09-30T22:31:37.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.596+0000 7fb8b1c08700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac06b460 con 0x7fb8ac09e1d0 2023-09-30T22:31:37.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.596+0000 7fb8b1c08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac09a7e0 con 0x7fb8ac139170 2023-09-30T22:31:37.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.597+0000 7fb8aaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8ac09e1d0 0x7fb8ac138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.597+0000 7fb8abfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8ac139170 0x7fb8ac13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.597+0000 7fb8aaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8ac09e1d0 0x7fb8ac138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53774/0 (socket says 172.21.15.59:53774) 2023-09-30T22:31:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.597+0000 7fb8aaffd700 1 -- 172.21.15.59:0/2271056775 learned_addr learned my addr 172.21.15.59:0/2271056775 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.597+0000 7fb8aaffd700 1 -- 172.21.15.59:0/2271056775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8ac139170 msgr2=0x7fb8ac13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.597+0000 7fb8aaffd700 1 --2- 172.21.15.59:0/2271056775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8ac139170 0x7fb8ac13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.597+0000 7fb8aaffd700 1 -- 172.21.15.59:0/2271056775 >> v1:172.21.15.59:6789/0 conn(0x7fb8ac09d6f0 legacy=0x7fb8ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.597+0000 7fb8aaffd700 1 -- 172.21.15.59:0/2271056775 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac09a500 con 0x7fb8ac09e1d0 2023-09-30T22:31:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.597+0000 7fb8abfff700 1 --2- 172.21.15.59:0/2271056775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8ac139170 0x7fb8ac13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.597+0000 7fb8aaffd700 1 --2- 172.21.15.59:0/2271056775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac09e1d0 0x7fb8ac138c30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009920 tx=0x7fb8a0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe9859138db798a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.597+0000 7fb8aa7fc700 1 -- 172.21.15.59:0/2271056775 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0011830 con 0x7fb8ac09e1d0 2023-09-30T22:31:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.598+0000 7fb8aa7fc700 1 -- 172.21.15.59:0/2271056775 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a0011990 con 0x7fb8ac09e1d0 2023-09-30T22:31:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.598+0000 7fb8aa7fc700 1 -- 172.21.15.59:0/2271056775 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0011d20 con 0x7fb8ac09e1d0 2023-09-30T22:31:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.598+0000 7fb8b1c08700 1 -- 172.21.15.59:0/2271056775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac09e1d0 msgr2=0x7fb8ac138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.598+0000 7fb8b1c08700 1 --2- 172.21.15.59:0/2271056775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac09e1d0 0x7fb8ac138c30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009920 tx=0x7fb8a0009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.599+0000 7fb8b1c08700 1 -- 172.21.15.59:0/2271056775 shutdown_connections 2023-09-30T22:31:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.599+0000 7fb8b1c08700 1 --2- 172.21.15.59:0/2271056775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8ac139170 0x7fb8ac13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.599+0000 7fb8b1c08700 1 --2- 172.21.15.59:0/2271056775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac09e1d0 0x7fb8ac138c30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.599+0000 7fb8b1c08700 1 -- 172.21.15.59:0/2271056775 >> 172.21.15.59:0/2271056775 conn(0x7fb8ac066f50 msgr2=0x7fb8ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.599+0000 7fb8b1c08700 1 -- 172.21.15.59:0/2271056775 shutdown_connections 2023-09-30T22:31:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.599+0000 7fb8b1c08700 1 -- 172.21.15.59:0/2271056775 wait complete. 2023-09-30T22:31:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.600+0000 7fb8b1c08700 1 Processor -- start 2023-09-30T22:31:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.600+0000 7fb8b1c08700 1 -- start start 2023-09-30T22:31:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.601+0000 7fb8b1c08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8ac09d6f0 0x7fb8ac1c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.601+0000 7fb8b1c08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8ac09e1d0 0x7fb8ac1c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.601+0000 7fb8b1c08700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac139170 0x7fb8ac11e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.601+0000 7fb8b1c08700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0a1a50 con 0x7fb8ac139170 2023-09-30T22:31:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.601+0000 7fb8b1c08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac121d20 con 0x7fb8ac09d6f0 2023-09-30T22:31:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.601+0000 7fb8b1c08700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac09c710 con 0x7fb8ac09e1d0 2023-09-30T22:31:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.601+0000 7fb8aaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8ac09e1d0 0x7fb8ac1c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.601+0000 7fb8aaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8ac09e1d0 0x7fb8ac1c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52726/0 (socket says 172.21.15.59:52726) 2023-09-30T22:31:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.601+0000 7fb8aaffd700 1 -- 172.21.15.59:0/4048929116 learned_addr learned my addr 172.21.15.59:0/4048929116 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.601+0000 7fb8ab7fe700 1 --2- 172.21.15.59:0/4048929116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8ac09d6f0 0x7fb8ac1c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.601+0000 7fb8abfff700 1 --2- 172.21.15.59:0/4048929116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac139170 0x7fb8ac11e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.602+0000 7fb8ab7fe700 1 -- 172.21.15.59:0/4048929116 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8ac09e1d0 msgr2=0x7fb8ac1c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.602+0000 7fb8ab7fe700 1 --2- 172.21.15.59:0/4048929116 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8ac09e1d0 0x7fb8ac1c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.602+0000 7fb8ab7fe700 1 -- 172.21.15.59:0/4048929116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac139170 msgr2=0x7fb8ac11e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.602+0000 7fb8ab7fe700 1 --2- 172.21.15.59:0/4048929116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac139170 0x7fb8ac11e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.602+0000 7fb8ab7fe700 1 -- 172.21.15.59:0/4048929116 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a4009a70 con 0x7fb8ac09d6f0 2023-09-30T22:31:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.602+0000 7fb8aaffd700 1 --2- 172.21.15.59:0/4048929116 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8ac09e1d0 0x7fb8ac1c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.602+0000 7fb8ab7fe700 1 --2- 172.21.15.59:0/4048929116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8ac09d6f0 0x7fb8ac1c84f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00c450 tx=0x7fb89c00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.602+0000 7fb893fff700 1 -- 172.21.15.59:0/4048929116 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0052d0 con 0x7fb8ac09d6f0 2023-09-30T22:31:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.602+0000 7fb893fff700 1 -- 172.21.15.59:0/4048929116 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c005430 con 0x7fb8ac09d6f0 2023-09-30T22:31:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.602+0000 7fb8b1c08700 1 -- 172.21.15.59:0/4048929116 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a0009550 con 0x7fb8ac09d6f0 2023-09-30T22:31:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.602+0000 7fb893fff700 1 -- 172.21.15.59:0/4048929116 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0038c0 con 0x7fb8ac09d6f0 2023-09-30T22:31:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.602+0000 7fb8b1c08700 1 -- 172.21.15.59:0/4048929116 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac122a50 con 0x7fb8ac09d6f0 2023-09-30T22:31:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.603+0000 7fb8b1c08700 1 -- 172.21.15.59:0/4048929116 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac074ea0 con 0x7fb8ac09d6f0 2023-09-30T22:31:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.604+0000 7fb893fff700 1 -- 172.21.15.59:0/4048929116 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb89c003a20 con 0x7fb8ac09d6f0 2023-09-30T22:31:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.604+0000 7fb893fff700 1 -- 172.21.15.59:0/4048929116 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb89c03e970 con 0x7fb8ac09d6f0 2023-09-30T22:31:37.607 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:37.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.609+0000 7fb893fff700 1 -- 172.21.15.59:0/4048929116 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb89c011590 con 0x7fb8ac09d6f0 2023-09-30T22:31:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.625+0000 7f519fb4a700 1 Processor -- start 2023-09-30T22:31:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.625+0000 7f519fb4a700 1 -- start start 2023-09-30T22:31:37.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.626+0000 7f519fb4a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f519809d6f0 0x7f519809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.626+0000 7f519fb4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519809e000 0x7f51981339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.626+0000 7f519fb4a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519809b120 con 0x7f519809e410 2023-09-30T22:31:37.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.626+0000 7f519fb4a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519806b460 con 0x7f519809d6f0 2023-09-30T22:31:37.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.626+0000 7f519fb4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519809a7e0 con 0x7f519809e000 2023-09-30T22:31:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.626+0000 7f519d0e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519809e000 0x7f51981339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.626+0000 7f519d0e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519809e000 0x7f51981339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41982/0 (socket says 172.21.15.59:41982) 2023-09-30T22:31:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.626+0000 7f519d0e5700 1 -- 172.21.15.59:0/2380114184 learned_addr learned my addr 172.21.15.59:0/2380114184 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.626+0000 7f519d8e6700 1 --2- 172.21.15.59:0/2380114184 >> v2:172.21.15.59:3300/0 conn(0x7f519809d6f0 0x7f519809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.626+0000 7f519d0e5700 1 -- 172.21.15.59:0/2380114184 >> v2:172.21.15.59:3300/0 conn(0x7f519809d6f0 msgr2=0x7f519809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.626+0000 7f519d0e5700 1 --2- 172.21.15.59:0/2380114184 >> v2:172.21.15.59:3300/0 conn(0x7f519809d6f0 0x7f519809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.626+0000 7f519d0e5700 1 -- 172.21.15.59:0/2380114184 >> v1:172.21.15.59:6789/0 conn(0x7f519809e410 legacy=0x7f5198133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.626+0000 7f519d0e5700 1 -- 172.21.15.59:0/2380114184 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519809a500 con 0x7f519809e000 2023-09-30T22:31:37.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.626+0000 7f519d0e5700 1 --2- 172.21.15.59:0/2380114184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519809e000 0x7f51981339f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5188009920 tx=0x7f5188009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40c069c7adc0f32f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.627+0000 7f519c8e4700 1 -- 172.21.15.59:0/2380114184 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518800ba20 con 0x7f519809e000 2023-09-30T22:31:37.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.627+0000 7f519c8e4700 1 -- 172.21.15.59:0/2380114184 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518800bb80 con 0x7f519809e000 2023-09-30T22:31:37.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.627+0000 7f519c8e4700 1 -- 172.21.15.59:0/2380114184 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188009e70 con 0x7f519809e000 2023-09-30T22:31:37.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.628+0000 7f519fb4a700 1 -- 172.21.15.59:0/2380114184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519809e000 msgr2=0x7f51981339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.628+0000 7f519fb4a700 1 --2- 172.21.15.59:0/2380114184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519809e000 0x7f51981339f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5188009920 tx=0x7f5188009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:37.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.628+0000 7f519fb4a700 1 -- 172.21.15.59:0/2380114184 shutdown_connections 2023-09-30T22:31:37.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.628+0000 7f519fb4a700 1 --2- 172.21.15.59:0/2380114184 >> v2:172.21.15.59:3300/0 conn(0x7f519809d6f0 0x7f519809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.628+0000 7f519fb4a700 1 --2- 172.21.15.59:0/2380114184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519809e000 0x7f51981339f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.628+0000 7f519fb4a700 1 -- 172.21.15.59:0/2380114184 >> 172.21.15.59:0/2380114184 conn(0x7f5198066f50 msgr2=0x7f519809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.628+0000 7f519fb4a700 1 -- 172.21.15.59:0/2380114184 shutdown_connections 2023-09-30T22:31:37.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.628+0000 7f519fb4a700 1 -- 172.21.15.59:0/2380114184 wait complete. 2023-09-30T22:31:37.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.629+0000 7f519fb4a700 1 Processor -- start 2023-09-30T22:31:37.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.629+0000 7f519fb4a700 1 -- start start 2023-09-30T22:31:37.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.629+0000 7f519fb4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519809d6f0 0x7f51981a5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.629+0000 7f519fb4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f519809e000 0x7f51981a6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.629+0000 7f519fb4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519809e410 0x7f51981a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.629+0000 7f519fb4a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51981a7370 con 0x7f519809d6f0 2023-09-30T22:31:37.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.629+0000 7f519fb4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51981a7a40 con 0x7f519809e410 2023-09-30T22:31:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.629+0000 7f519fb4a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51981a8c90 con 0x7f519809e000 2023-09-30T22:31:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.630+0000 7f519e0e7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519809e410 0x7f51981a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.630+0000 7f519e0e7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519809e410 0x7f51981a6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41988/0 (socket says 172.21.15.59:41988) 2023-09-30T22:31:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.630+0000 7f519e0e7700 1 -- 172.21.15.59:0/3281803341 learned_addr learned my addr 172.21.15.59:0/3281803341 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.630+0000 7f519d8e6700 1 --2- 172.21.15.59:0/3281803341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519809d6f0 0x7f51981a5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.630+0000 7f519d8e6700 1 -- 172.21.15.59:0/3281803341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f519809e000 msgr2=0x7f51981a6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.630+0000 7f519d8e6700 1 --2- 172.21.15.59:0/3281803341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f519809e000 0x7f51981a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.630+0000 7f519d8e6700 1 -- 172.21.15.59:0/3281803341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519809e410 msgr2=0x7f51981a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.630+0000 7f519d8e6700 1 --2- 172.21.15.59:0/3281803341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519809e410 0x7f51981a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.630+0000 7f519d8e6700 1 -- 172.21.15.59:0/3281803341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5188009550 con 0x7f519809d6f0 2023-09-30T22:31:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.630+0000 7f519e0e7700 1 --2- 172.21.15.59:0/3281803341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519809e410 0x7f51981a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:37.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.630+0000 7f519d8e6700 1 --2- 172.21.15.59:0/3281803341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519809d6f0 0x7f51981a5ec0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f519400e810 tx=0x7f519400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.630+0000 7f518e7fc700 1 -- 172.21.15.59:0/3281803341 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519400c070 con 0x7f519809d6f0 2023-09-30T22:31:37.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.630+0000 7f518e7fc700 1 -- 172.21.15.59:0/3281803341 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5194013610 con 0x7f519809d6f0 2023-09-30T22:31:37.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.631+0000 7f519fb4a700 1 -- 172.21.15.59:0/3281803341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51981a9670 con 0x7f519809d6f0 2023-09-30T22:31:37.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.631+0000 7f518e7fc700 1 -- 172.21.15.59:0/3281803341 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51940139a0 con 0x7f519809d6f0 2023-09-30T22:31:37.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.631+0000 7f519fb4a700 1 -- 172.21.15.59:0/3281803341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51980a2040 con 0x7f519809d6f0 2023-09-30T22:31:37.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.631+0000 7f518e7fc700 1 -- 172.21.15.59:0/3281803341 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5194013b00 con 0x7f519809d6f0 2023-09-30T22:31:37.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.632+0000 7f518e7fc700 1 -- 172.21.15.59:0/3281803341 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f519403f360 con 0x7f519809d6f0 2023-09-30T22:31:37.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.632+0000 7f519fb4a700 1 -- 172.21.15.59:0/3281803341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519809c770 con 0x7f519809d6f0 2023-09-30T22:31:37.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.637+0000 7f518e7fc700 1 -- 172.21.15.59:0/3281803341 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51940108e0 con 0x7f519809d6f0 2023-09-30T22:31:37.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.740+0000 7f9c0bfa1700 1 -- 172.21.15.59:0/1603655336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9c040a28e0 con 0x7f9c040a0a30 2023-09-30T22:31:37.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.740+0000 7f9bfa7fc700 1 -- 172.21.15.59:0/1603655336 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c0001a360 con 0x7f9c040a0a30 2023-09-30T22:31:37.741 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:37.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.742+0000 7f9c0bfa1700 1 -- 172.21.15.59:0/1603655336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c040a0a30 msgr2=0x7f9c04122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.742+0000 7f9c0bfa1700 1 --2- 172.21.15.59:0/1603655336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c040a0a30 0x7f9c04122980 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000c4d0 tx=0x7f9c0000c7e0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.743+0000 7f9c0bfa1700 1 -- 172.21.15.59:0/1603655336 shutdown_connections 2023-09-30T22:31:37.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.743+0000 7f9c0bfa1700 1 --2- 172.21.15.59:0/1603655336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c04139250 0x7f9c04123400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.743+0000 7f9c0bfa1700 1 --2- 172.21.15.59:0/1603655336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c040a0a30 0x7f9c04122980 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.743+0000 7f9c0bfa1700 1 --2- 172.21.15.59:0/1603655336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c040a1510 0x7f9c04122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.743+0000 7f9c0bfa1700 1 -- 172.21.15.59:0/1603655336 >> 172.21.15.59:0/1603655336 conn(0x7f9c040a6550 msgr2=0x7f9c040a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.744+0000 7f9c0bfa1700 1 -- 172.21.15.59:0/1603655336 shutdown_connections 2023-09-30T22:31:37.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.744+0000 7f9c0bfa1700 1 -- 172.21.15.59:0/1603655336 wait complete. 2023-09-30T22:31:37.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.753+0000 7f7faedf8700 1 Processor -- start 2023-09-30T22:31:37.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.753+0000 7f7faedf8700 1 -- start start 2023-09-30T22:31:37.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.754+0000 7f7faedf8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fa809e1d0 0x7f7fa8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.754+0000 7f7faedf8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7fa8139170 0x7f7fa813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.754+0000 7f7faedf8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa809b120 con 0x7f7fa809d6f0 2023-09-30T22:31:37.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.754+0000 7f7faedf8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa806b460 con 0x7f7fa8139170 2023-09-30T22:31:37.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.754+0000 7f7faedf8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa809a7e0 con 0x7f7fa809e1d0 2023-09-30T22:31:37.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.754+0000 7f7fa7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fa809e1d0 0x7f7fa8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.754+0000 7f7fad395700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7fa8139170 0x7f7fa813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.754+0000 7f7fa7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fa809e1d0 0x7f7fa8138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52744/0 (socket says 172.21.15.59:52744) 2023-09-30T22:31:37.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.754+0000 7f7fa7fff700 1 -- 172.21.15.59:0/2581142453 learned_addr learned my addr 172.21.15.59:0/2581142453 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:37.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.754+0000 7f7fad395700 1 --2- 172.21.15.59:0/2581142453 >> v2:172.21.15.59:3300/0 conn(0x7f7fa8139170 0x7f7fa813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53818/0 (socket says 172.21.15.59:53818) 2023-09-30T22:31:37.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.754+0000 7f7facb94700 1 --1- 172.21.15.59:0/2581142453 >> v1:172.21.15.59:6789/0 conn(0x7f7fa809d6f0 0x7f7fa809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47770/0 (socket says 172.21.15.59:47770) 2023-09-30T22:31:37.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.755+0000 7f7fa7fff700 1 -- 172.21.15.59:0/2581142453 >> v2:172.21.15.59:3300/0 conn(0x7f7fa8139170 msgr2=0x7f7fa813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:37.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.755+0000 7f7fa7fff700 1 --2- 172.21.15.59:0/2581142453 >> v2:172.21.15.59:3300/0 conn(0x7f7fa8139170 0x7f7fa813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.755+0000 7f7fa77fe700 1 -- 172.21.15.59:0/2581142453 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508655524 0 0) 0x7f7fa809b120 con 0x7f7fa809d6f0 2023-09-30T22:31:37.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.755+0000 7f7fa7fff700 1 -- 172.21.15.59:0/2581142453 >> v1:172.21.15.59:6789/0 conn(0x7f7fa809d6f0 legacy=0x7f7fa809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.755+0000 7f7fa7fff700 1 -- 172.21.15.59:0/2581142453 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa809a500 con 0x7f7fa809e1d0 2023-09-30T22:31:37.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.755+0000 7f7fad395700 1 --2- 172.21.15.59:0/2581142453 >> v2:172.21.15.59:3300/0 conn(0x7f7fa8139170 0x7f7fa813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:37.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.755+0000 7f7fa7fff700 1 --2- 172.21.15.59:0/2581142453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fa809e1d0 0x7f7fa8138c30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7f94009920 tx=0x7f7f94009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4de0632055cbae1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.755+0000 7f7fa77fe700 1 -- 172.21.15.59:0/2581142453 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f94011830 con 0x7f7fa809e1d0 2023-09-30T22:31:37.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.755+0000 7f7fa77fe700 1 -- 172.21.15.59:0/2581142453 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f94011990 con 0x7f7fa809e1d0 2023-09-30T22:31:37.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.755+0000 7f7fa77fe700 1 -- 172.21.15.59:0/2581142453 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f94011d20 con 0x7f7fa809e1d0 2023-09-30T22:31:37.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.756+0000 7f7faedf8700 1 -- 172.21.15.59:0/2581142453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fa809e1d0 msgr2=0x7f7fa8138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.756+0000 7f7faedf8700 1 --2- 172.21.15.59:0/2581142453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fa809e1d0 0x7f7fa8138c30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7f94009920 tx=0x7f7f94009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:37.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.756+0000 7f7faedf8700 1 -- 172.21.15.59:0/2581142453 shutdown_connections 2023-09-30T22:31:37.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.756+0000 7f7faedf8700 1 --2- 172.21.15.59:0/2581142453 >> v2:172.21.15.59:3300/0 conn(0x7f7fa8139170 0x7f7fa813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.756+0000 7f7faedf8700 1 --2- 172.21.15.59:0/2581142453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fa809e1d0 0x7f7fa8138c30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.756+0000 7f7faedf8700 1 -- 172.21.15.59:0/2581142453 >> 172.21.15.59:0/2581142453 conn(0x7f7fa8066f50 msgr2=0x7f7fa809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.756+0000 7f7faedf8700 1 -- 172.21.15.59:0/2581142453 shutdown_connections 2023-09-30T22:31:37.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.756+0000 7f7faedf8700 1 -- 172.21.15.59:0/2581142453 wait complete. 2023-09-30T22:31:37.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.757+0000 7f7faedf8700 1 Processor -- start 2023-09-30T22:31:37.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.757+0000 7f7faedf8700 1 -- start start 2023-09-30T22:31:37.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.758+0000 7f7faedf8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fa809d6f0 0x7f7fa81c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.758+0000 7f7faedf8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fa809e1d0 0x7f7fa81c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.758+0000 7f7faedf8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fa8139170 0x7f7fa81209d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.758+0000 7f7faedf8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa81227d0 con 0x7f7fa809d6f0 2023-09-30T22:31:37.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.758+0000 7f7faedf8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa81225e0 con 0x7f7fa8139170 2023-09-30T22:31:37.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.758+0000 7f7faedf8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa81c9210 con 0x7f7fa809e1d0 2023-09-30T22:31:37.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.758+0000 7f7facb94700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fa809d6f0 0x7f7fa81c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.758+0000 7f7facb94700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fa809d6f0 0x7f7fa81c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53834/0 (socket says 172.21.15.59:53834) 2023-09-30T22:31:37.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.758+0000 7f7facb94700 1 -- 172.21.15.59:0/3213201570 learned_addr learned my addr 172.21.15.59:0/3213201570 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:37.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.758+0000 7f7fa7fff700 1 --2- 172.21.15.59:0/3213201570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fa809e1d0 0x7f7fa81c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.759+0000 7f7fa7fff700 1 -- 172.21.15.59:0/3213201570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fa8139170 msgr2=0x7f7fa81209d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.759+0000 7f7fa7fff700 1 --2- 172.21.15.59:0/3213201570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fa8139170 0x7f7fa81209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.759+0000 7f7fa7fff700 1 -- 172.21.15.59:0/3213201570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fa809d6f0 msgr2=0x7f7fa81c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.759+0000 7f7fa7fff700 1 --2- 172.21.15.59:0/3213201570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fa809d6f0 0x7f7fa81c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.759+0000 7f7fa7fff700 1 -- 172.21.15.59:0/3213201570 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa0009a70 con 0x7f7fa809e1d0 2023-09-30T22:31:37.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:37.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.759+0000 7f7facb94700 1 --2- 172.21.15.59:0/3213201570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fa809d6f0 0x7f7fa81c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:37.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.759+0000 7f7fa7fff700 1 --2- 172.21.15.59:0/3213201570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fa809e1d0 0x7f7fa81c8cd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7fa806b640 tx=0x7f7f94004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.759+0000 7f7fa57fa700 1 -- 172.21.15.59:0/3213201570 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f940045d0 con 0x7f7fa809e1d0 2023-09-30T22:31:37.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.759+0000 7f7fa57fa700 1 -- 172.21.15.59:0/3213201570 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9401f070 con 0x7f7fa809e1d0 2023-09-30T22:31:37.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.759+0000 7f7fa57fa700 1 -- 172.21.15.59:0/3213201570 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f940038e0 con 0x7f7fa809e1d0 2023-09-30T22:31:37.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.759+0000 7f7faedf8700 1 -- 172.21.15.59:0/3213201570 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f94009550 con 0x7f7fa809e1d0 2023-09-30T22:31:37.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.759+0000 7f7faedf8700 1 -- 172.21.15.59:0/3213201570 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa8124210 con 0x7f7fa809e1d0 2023-09-30T22:31:37.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.760+0000 7f7fa57fa700 1 -- 172.21.15.59:0/3213201570 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f94003a40 con 0x7f7fa809e1d0 2023-09-30T22:31:37.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.760+0000 7f7faedf8700 1 -- 172.21.15.59:0/3213201570 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa8123eb0 con 0x7f7fa809e1d0 2023-09-30T22:31:37.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.761+0000 7f7fa57fa700 1 -- 172.21.15.59:0/3213201570 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7f94021070 con 0x7f7fa809e1d0 2023-09-30T22:31:37.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.765+0000 7f7fa57fa700 1 -- 172.21.15.59:0/3213201570 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7fa8123eb0 con 0x7f7fa809e1d0 2023-09-30T22:31:37.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.859+0000 7fb8b1c08700 1 -- 172.21.15.59:0/4048929116 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb8ac09f420 con 0x7fb8ac09d6f0 2023-09-30T22:31:37.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.860+0000 7fb893fff700 1 -- 172.21.15.59:0/4048929116 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb89c017030 con 0x7fb8ac09d6f0 2023-09-30T22:31:37.861 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.862+0000 7fb8b1c08700 1 -- 172.21.15.59:0/4048929116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8ac09d6f0 msgr2=0x7fb8ac1c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.862+0000 7fb8b1c08700 1 --2- 172.21.15.59:0/4048929116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8ac09d6f0 0x7fb8ac1c84f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00c450 tx=0x7fb89c00c760 comp rx=0 tx=0).stop 2023-09-30T22:31:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.862+0000 7fb8b1c08700 1 -- 172.21.15.59:0/4048929116 shutdown_connections 2023-09-30T22:31:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.863+0000 7fb8b1c08700 1 --2- 172.21.15.59:0/4048929116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac139170 0x7fb8ac11e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.863+0000 7fb8b1c08700 1 --2- 172.21.15.59:0/4048929116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8ac09d6f0 0x7fb8ac1c84f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.863+0000 7fb8b1c08700 1 --2- 172.21.15.59:0/4048929116 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8ac09e1d0 0x7fb8ac1c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.863+0000 7fb8b1c08700 1 -- 172.21.15.59:0/4048929116 >> 172.21.15.59:0/4048929116 conn(0x7fb8ac066f50 msgr2=0x7fb8ac09b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.863+0000 7fb8b1c08700 1 -- 172.21.15.59:0/4048929116 shutdown_connections 2023-09-30T22:31:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.863+0000 7fb8b1c08700 1 -- 172.21.15.59:0/4048929116 wait complete. 2023-09-30T22:31:37.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.868+0000 7f519fb4a700 1 -- 172.21.15.59:0/3281803341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5198074ea0 con 0x7f519809d6f0 2023-09-30T22:31:37.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.868+0000 7f518e7fc700 1 -- 172.21.15.59:0/3281803341 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f519402b090 con 0x7f519809d6f0 2023-09-30T22:31:37.869 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:37.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.872+0000 7f519fb4a700 1 -- 172.21.15.59:0/3281803341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519809d6f0 msgr2=0x7f51981a5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.872+0000 7f519fb4a700 1 --2- 172.21.15.59:0/3281803341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519809d6f0 0x7f51981a5ec0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f519400e810 tx=0x7f519400eb20 comp rx=0 tx=0).stop 2023-09-30T22:31:37.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.872+0000 7f519fb4a700 1 -- 172.21.15.59:0/3281803341 shutdown_connections 2023-09-30T22:31:37.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.872+0000 7f519fb4a700 1 --2- 172.21.15.59:0/3281803341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519809e410 0x7f51981a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.872+0000 7f519fb4a700 1 --2- 172.21.15.59:0/3281803341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519809d6f0 0x7f51981a5ec0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.872+0000 7f519fb4a700 1 --2- 172.21.15.59:0/3281803341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f519809e000 0x7f51981a6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.872+0000 7f519fb4a700 1 -- 172.21.15.59:0/3281803341 >> 172.21.15.59:0/3281803341 conn(0x7f5198066f50 msgr2=0x7f51981badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.872+0000 7f519fb4a700 1 -- 172.21.15.59:0/3281803341 shutdown_connections 2023-09-30T22:31:37.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.872+0000 7f519fb4a700 1 -- 172.21.15.59:0/3281803341 wait complete. 2023-09-30T22:31:37.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:37.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:37.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.975+0000 7f7faedf8700 1 -- 172.21.15.59:0/3213201570 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7fa8123eb0 con 0x7f7fa809e1d0 2023-09-30T22:31:37.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.976+0000 7f7fa57fa700 1 -- 172.21.15.59:0/3213201570 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7fa8123eb0 con 0x7f7fa809e1d0 2023-09-30T22:31:37.977 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:37.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.978+0000 7f7faedf8700 1 -- 172.21.15.59:0/3213201570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fa809e1d0 msgr2=0x7f7fa81c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.978+0000 7f7faedf8700 1 --2- 172.21.15.59:0/3213201570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fa809e1d0 0x7f7fa81c8cd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7fa806b640 tx=0x7f7f94004750 comp rx=0 tx=0).stop 2023-09-30T22:31:37.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.978+0000 7f7faedf8700 1 -- 172.21.15.59:0/3213201570 shutdown_connections 2023-09-30T22:31:37.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.978+0000 7f7faedf8700 1 --2- 172.21.15.59:0/3213201570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fa8139170 0x7f7fa81209d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.978+0000 7f7faedf8700 1 --2- 172.21.15.59:0/3213201570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fa809d6f0 0x7f7fa81c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.978+0000 7f7faedf8700 1 --2- 172.21.15.59:0/3213201570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fa809e1d0 0x7f7fa81c8cd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.978+0000 7f7faedf8700 1 -- 172.21.15.59:0/3213201570 >> 172.21.15.59:0/3213201570 conn(0x7f7fa8066f50 msgr2=0x7f7fa8136b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.978+0000 7f7faedf8700 1 -- 172.21.15.59:0/3213201570 shutdown_connections 2023-09-30T22:31:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:37.978+0000 7f7faedf8700 1 -- 172.21.15.59:0/3213201570 wait complete. 2023-09-30T22:31:37.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:38.763 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:38.882 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:38.889 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.910+0000 7f3a4d69e700 1 Processor -- start 2023-09-30T22:31:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.910+0000 7f3a4d69e700 1 -- start start 2023-09-30T22:31:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.911+0000 7f3a4d69e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a48130540 0x7f3a48130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.911+0000 7f3a4d69e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4806fcf0 0x7f3a48138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.911+0000 7f3a4d69e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a480716a0 con 0x7f3a48130e50 2023-09-30T22:31:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.911+0000 7f3a4d69e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4809a390 con 0x7f3a48130540 2023-09-30T22:31:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.911+0000 7f3a4d69e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a48071290 con 0x7f3a4806fcf0 2023-09-30T22:31:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.911+0000 7f3a46ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a48130540 0x7f3a48130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.911+0000 7f3a477fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4806fcf0 0x7f3a48138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.911+0000 7f3a46ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a48130540 0x7f3a48130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53846/0 (socket says 172.21.15.59:53846) 2023-09-30T22:31:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.911+0000 7f3a46ffd700 1 -- 172.21.15.59:0/1116219418 learned_addr learned my addr 172.21.15.59:0/1116219418 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.911+0000 7f3a477fe700 1 -- 172.21.15.59:0/1116219418 >> v2:172.21.15.59:3300/0 conn(0x7f3a48130540 msgr2=0x7f3a48130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.911+0000 7f3a477fe700 1 --2- 172.21.15.59:0/1116219418 >> v2:172.21.15.59:3300/0 conn(0x7f3a48130540 0x7f3a48130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.911+0000 7f3a477fe700 1 -- 172.21.15.59:0/1116219418 >> v1:172.21.15.59:6789/0 conn(0x7f3a48130e50 legacy=0x7f3a4806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.911+0000 7f3a477fe700 1 -- 172.21.15.59:0/1116219418 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a48130340 con 0x7f3a4806fcf0 2023-09-30T22:31:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.912+0000 7f3a477fe700 1 --2- 172.21.15.59:0/1116219418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4806fcf0 0x7f3a48138570 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009dc0 tx=0x7f3a4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96b56bfa66b5d2b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.912+0000 7f3a45ffb700 1 -- 172.21.15.59:0/1116219418 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4000e070 con 0x7f3a4806fcf0 2023-09-30T22:31:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.912+0000 7f3a45ffb700 1 -- 172.21.15.59:0/1116219418 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4000bae0 con 0x7f3a4806fcf0 2023-09-30T22:31:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.912+0000 7f3a45ffb700 1 -- 172.21.15.59:0/1116219418 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4000be90 con 0x7f3a4806fcf0 2023-09-30T22:31:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.913+0000 7f3a4d69e700 1 -- 172.21.15.59:0/1116219418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4806fcf0 msgr2=0x7f3a48138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.913+0000 7f3a4d69e700 1 --2- 172.21.15.59:0/1116219418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4806fcf0 0x7f3a48138570 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009dc0 tx=0x7f3a4000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.913+0000 7f3a4d69e700 1 -- 172.21.15.59:0/1116219418 shutdown_connections 2023-09-30T22:31:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.913+0000 7f3a4d69e700 1 --2- 172.21.15.59:0/1116219418 >> v2:172.21.15.59:3300/0 conn(0x7f3a48130540 0x7f3a48130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.913+0000 7f3a4d69e700 1 --2- 172.21.15.59:0/1116219418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4806fcf0 0x7f3a48138570 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.913+0000 7f3a4d69e700 1 -- 172.21.15.59:0/1116219418 >> 172.21.15.59:0/1116219418 conn(0x7f3a480a2aa0 msgr2=0x7f3a480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.913+0000 7f3a4d69e700 1 -- 172.21.15.59:0/1116219418 shutdown_connections 2023-09-30T22:31:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.913+0000 7f3a4d69e700 1 -- 172.21.15.59:0/1116219418 wait complete. 2023-09-30T22:31:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.914+0000 7f3a4d69e700 1 Processor -- start 2023-09-30T22:31:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.914+0000 7f3a4d69e700 1 -- start start 2023-09-30T22:31:38.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a4d69e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4806fcf0 0x7f3a4811a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a4d69e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a48130540 0x7f3a4811aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a4d69e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a48130e50 0x7f3a4811afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a4d69e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4811e050 con 0x7f3a48130e50 2023-09-30T22:31:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a4d69e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4811d400 con 0x7f3a4806fcf0 2023-09-30T22:31:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a4d69e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4811b950 con 0x7f3a48130540 2023-09-30T22:31:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a477fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a48130e50 0x7f3a4811afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a477fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a48130e50 0x7f3a4811afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53860/0 (socket says 172.21.15.59:53860) 2023-09-30T22:31:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a477fe700 1 -- 172.21.15.59:0/858495172 learned_addr learned my addr 172.21.15.59:0/858495172 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a467fc700 1 --2- 172.21.15.59:0/858495172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a48130540 0x7f3a4811aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a46ffd700 1 --2- 172.21.15.59:0/858495172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4806fcf0 0x7f3a4811a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a477fe700 1 -- 172.21.15.59:0/858495172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a48130540 msgr2=0x7f3a4811aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a477fe700 1 --2- 172.21.15.59:0/858495172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a48130540 0x7f3a4811aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a477fe700 1 -- 172.21.15.59:0/858495172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4806fcf0 msgr2=0x7f3a4811a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a477fe700 1 --2- 172.21.15.59:0/858495172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4806fcf0 0x7f3a4811a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a477fe700 1 -- 172.21.15.59:0/858495172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a40009a70 con 0x7f3a48130e50 2023-09-30T22:31:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a467fc700 1 --2- 172.21.15.59:0/858495172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a48130540 0x7f3a4811aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.915+0000 7f3a46ffd700 1 --2- 172.21.15.59:0/858495172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4806fcf0 0x7f3a4811a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.916+0000 7f3a477fe700 1 --2- 172.21.15.59:0/858495172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a48130e50 0x7f3a4811afb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000b370 tx=0x7f3a40004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.916+0000 7f3a2f7fe700 1 -- 172.21.15.59:0/858495172 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a400048b0 con 0x7f3a48130e50 2023-09-30T22:31:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.916+0000 7f3a2f7fe700 1 -- 172.21.15.59:0/858495172 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a40020070 con 0x7f3a48130e50 2023-09-30T22:31:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.916+0000 7f3a4d69e700 1 -- 172.21.15.59:0/858495172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a480a09c0 con 0x7f3a48130e50 2023-09-30T22:31:38.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.916+0000 7f3a2f7fe700 1 -- 172.21.15.59:0/858495172 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a40026670 con 0x7f3a48130e50 2023-09-30T22:31:38.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.916+0000 7f3a4d69e700 1 -- 172.21.15.59:0/858495172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a48071930 con 0x7f3a48130e50 2023-09-30T22:31:38.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.917+0000 7f3a2f7fe700 1 -- 172.21.15.59:0/858495172 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a40012430 con 0x7f3a48130e50 2023-09-30T22:31:38.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.917+0000 7f3a2f7fe700 1 -- 172.21.15.59:0/858495172 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3a40022070 con 0x7f3a48130e50 2023-09-30T22:31:38.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.917+0000 7f3a4d69e700 1 -- 172.21.15.59:0/858495172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4809cd40 con 0x7f3a48130e50 2023-09-30T22:31:38.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:38.923+0000 7f3a2f7fe700 1 -- 172.21.15.59:0/858495172 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a400126e0 con 0x7f3a48130e50 2023-09-30T22:31:38.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:39.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.036+0000 7f267f3a2700 1 Processor -- start 2023-09-30T22:31:39.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.036+0000 7f267f3a2700 1 -- start start 2023-09-30T22:31:39.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.037+0000 7f267f3a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f267809d8d0 0x7f267809dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.037+0000 7f267f3a2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f267809e610 0x7f2678130b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.037+0000 7f267f3a2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267809b6e0 con 0x7f267809e1e0 2023-09-30T22:31:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.037+0000 7f267f3a2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267809b470 con 0x7f267809e610 2023-09-30T22:31:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.037+0000 7f267f3a2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f267809eb80 con 0x7f267809d8d0 2023-09-30T22:31:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.037+0000 7f267db9f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f267809e1e0 0x7f2678130460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47780/0 (socket says 172.21.15.59:47780) 2023-09-30T22:31:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.037+0000 7f267db9f700 1 -- 172.21.15.59:0/2628829124 learned_addr learned my addr 172.21.15.59:0/2628829124 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.037+0000 7f267eba1700 1 --2- 172.21.15.59:0/2628829124 >> v2:172.21.15.59:3300/0 conn(0x7f267809e610 0x7f2678130b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.037+0000 7f267e3a0700 1 --2- 172.21.15.59:0/2628829124 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f267809d8d0 0x7f267809dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.038+0000 7f267d39e700 1 -- 172.21.15.59:0/2628829124 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550046475 0 0) 0x7f267809b6e0 con 0x7f267809e1e0 2023-09-30T22:31:39.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.038+0000 7f267d39e700 1 -- 172.21.15.59:0/2628829124 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26640035b0 con 0x7f267809e1e0 2023-09-30T22:31:39.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.038+0000 7f267e3a0700 1 -- 172.21.15.59:0/2628829124 >> v2:172.21.15.59:3300/0 conn(0x7f267809e610 msgr2=0x7f2678130b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:39.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.038+0000 7f267e3a0700 1 --2- 172.21.15.59:0/2628829124 >> v2:172.21.15.59:3300/0 conn(0x7f267809e610 0x7f2678130b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.038+0000 7f267e3a0700 1 -- 172.21.15.59:0/2628829124 >> v1:172.21.15.59:6789/0 conn(0x7f267809e1e0 legacy=0x7f2678130460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.038+0000 7f267e3a0700 1 -- 172.21.15.59:0/2628829124 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267809ae00 con 0x7f267809d8d0 2023-09-30T22:31:39.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.038+0000 7f267e3a0700 1 --2- 172.21.15.59:0/2628829124 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f267809d8d0 0x7f267809dca0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2674009840 tx=0x7f2674009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a376e02b15214e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:39.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.038+0000 7f267d39e700 1 -- 172.21.15.59:0/2628829124 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674011830 con 0x7f267809d8d0 2023-09-30T22:31:39.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.038+0000 7f267d39e700 1 -- 172.21.15.59:0/2628829124 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2674011990 con 0x7f267809d8d0 2023-09-30T22:31:39.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.038+0000 7f267d39e700 1 -- 172.21.15.59:0/2628829124 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674011d20 con 0x7f267809d8d0 2023-09-30T22:31:39.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.039+0000 7f267f3a2700 1 -- 172.21.15.59:0/2628829124 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f267809d8d0 msgr2=0x7f267809dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.039+0000 7f267f3a2700 1 --2- 172.21.15.59:0/2628829124 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f267809d8d0 0x7f267809dca0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2674009840 tx=0x7f2674009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:39.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.039+0000 7f267f3a2700 1 -- 172.21.15.59:0/2628829124 shutdown_connections 2023-09-30T22:31:39.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.039+0000 7f267f3a2700 1 --2- 172.21.15.59:0/2628829124 >> v2:172.21.15.59:3300/0 conn(0x7f267809e610 0x7f2678130b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.039+0000 7f267f3a2700 1 --2- 172.21.15.59:0/2628829124 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f267809d8d0 0x7f267809dca0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.039+0000 7f267f3a2700 1 -- 172.21.15.59:0/2628829124 >> 172.21.15.59:0/2628829124 conn(0x7f26780a2e20 msgr2=0x7f26780a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:39.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.039+0000 7f267f3a2700 1 -- 172.21.15.59:0/2628829124 shutdown_connections 2023-09-30T22:31:39.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.039+0000 7f267f3a2700 1 -- 172.21.15.59:0/2628829124 wait complete. 2023-09-30T22:31:39.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.041+0000 7f267f3a2700 1 Processor -- start 2023-09-30T22:31:39.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.041+0000 7f267f3a2700 1 -- start start 2023-09-30T22:31:39.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.041+0000 7f267f3a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267809d8d0 0x7f267812ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.042+0000 7f267f3a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f267809e1e0 0x7f267812efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.042+0000 7f267f3a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f267809e610 0x7f267812f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.042+0000 7f267f3a2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2678132630 con 0x7f267809d8d0 2023-09-30T22:31:39.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.042+0000 7f267f3a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267809c600 con 0x7f267809e610 2023-09-30T22:31:39.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.042+0000 7f267f3a2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26781306f0 con 0x7f267809e1e0 2023-09-30T22:31:39.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.042+0000 7f267e3a0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267809d8d0 0x7f267812ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.042+0000 7f267e3a0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267809d8d0 0x7f267812ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53874/0 (socket says 172.21.15.59:53874) 2023-09-30T22:31:39.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.042+0000 7f267e3a0700 1 -- 172.21.15.59:0/1507694640 learned_addr learned my addr 172.21.15.59:0/1507694640 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:39.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.042+0000 7f267db9f700 1 --2- 172.21.15.59:0/1507694640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f267809e1e0 0x7f267812efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.042+0000 7f267e3a0700 1 -- 172.21.15.59:0/1507694640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f267809e1e0 msgr2=0x7f267812efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.042+0000 7f267e3a0700 1 --2- 172.21.15.59:0/1507694640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f267809e1e0 0x7f267812efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.042+0000 7f267e3a0700 1 -- 172.21.15.59:0/1507694640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f267809e610 msgr2=0x7f267812f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.042+0000 7f267e3a0700 1 --2- 172.21.15.59:0/1507694640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f267809e610 0x7f267812f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.042+0000 7f267e3a0700 1 -- 172.21.15.59:0/1507694640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26740094a0 con 0x7f267809d8d0 2023-09-30T22:31:39.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.042+0000 7f267e3a0700 1 --2- 172.21.15.59:0/1507694640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267809d8d0 0x7f267812ea60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f2674009fd0 tx=0x7f2674004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:39.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.043+0000 7f266effd700 1 -- 172.21.15.59:0/1507694640 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26740036a0 con 0x7f267809d8d0 2023-09-30T22:31:39.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.043+0000 7f266effd700 1 -- 172.21.15.59:0/1507694640 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267401e070 con 0x7f267809d8d0 2023-09-30T22:31:39.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.043+0000 7f266effd700 1 -- 172.21.15.59:0/1507694640 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674003a60 con 0x7f267809d8d0 2023-09-30T22:31:39.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.043+0000 7f267f3a2700 1 -- 172.21.15.59:0/1507694640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2678130b90 con 0x7f267809d8d0 2023-09-30T22:31:39.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.043+0000 7f267f3a2700 1 -- 172.21.15.59:0/1507694640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267806b370 con 0x7f267809d8d0 2023-09-30T22:31:39.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.044+0000 7f266effd700 1 -- 172.21.15.59:0/1507694640 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2674003bc0 con 0x7f267809d8d0 2023-09-30T22:31:39.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.044+0000 7f266effd700 1 -- 172.21.15.59:0/1507694640 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2674040440 con 0x7f267809d8d0 2023-09-30T22:31:39.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.044+0000 7f267f3a2700 1 -- 172.21.15.59:0/1507694640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2678074ea0 con 0x7f267809d8d0 2023-09-30T22:31:39.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.049+0000 7f266effd700 1 -- 172.21.15.59:0/1507694640 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2674015080 con 0x7f267809d8d0 2023-09-30T22:31:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.065+0000 7f3f81405700 1 Processor -- start 2023-09-30T22:31:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.065+0000 7f3f81405700 1 -- start start 2023-09-30T22:31:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.066+0000 7f3f81405700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f7c09d6f0 0x7f3f7c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.066+0000 7f3f81405700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f7c09e410 0x7f3f7c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.066+0000 7f3f81405700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7c09f130 con 0x7f3f7c09e000 2023-09-30T22:31:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.066+0000 7f3f81405700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c09f520 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.066+0000 7f3f81405700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c09e930 con 0x7f3f7c09e410 2023-09-30T22:31:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.066+0000 7f3f7b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f7c09e410 0x7f3f7c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.066+0000 7f3f7b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f7c09e410 0x7f3f7c130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52784/0 (socket says 172.21.15.59:52784) 2023-09-30T22:31:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.066+0000 7f3f7b7fe700 1 -- 172.21.15.59:0/3745261985 learned_addr learned my addr 172.21.15.59:0/3745261985 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.066+0000 7f3f7affd700 1 --2- 172.21.15.59:0/3745261985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f7c09d6f0 0x7f3f7c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.066+0000 7f3f7affd700 1 -- 172.21.15.59:0/3745261985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f7c09e410 msgr2=0x7f3f7c130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.066+0000 7f3f7affd700 1 --2- 172.21.15.59:0/3745261985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f7c09e410 0x7f3f7c130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.066+0000 7f3f7affd700 1 -- 172.21.15.59:0/3745261985 >> v1:172.21.15.59:6789/0 conn(0x7f3f7c09e000 legacy=0x7f3f7c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.066+0000 7f3f7affd700 1 -- 172.21.15.59:0/3745261985 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c09b2d0 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.066+0000 7f3f7b7fe700 1 --2- 172.21.15.59:0/3745261985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f7c09e410 0x7f3f7c130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:39.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.067+0000 7f3f7affd700 1 --2- 172.21.15.59:0/3745261985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f7c09d6f0 0x7f3f7c09dac0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00dfc0 tx=0x7f3f6c00f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85073dc728b70485 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:39.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.067+0000 7f3f7a7fc700 1 -- 172.21.15.59:0/3745261985 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c012070 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.067+0000 7f3f7a7fc700 1 -- 172.21.15.59:0/3745261985 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c005d10 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.067+0000 7f3f7a7fc700 1 -- 172.21.15.59:0/3745261985 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00fc50 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.068+0000 7f3f81405700 1 -- 172.21.15.59:0/3745261985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f7c09d6f0 msgr2=0x7f3f7c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.068+0000 7f3f81405700 1 --2- 172.21.15.59:0/3745261985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f7c09d6f0 0x7f3f7c09dac0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00dfc0 tx=0x7f3f6c00f330 comp rx=0 tx=0).stop 2023-09-30T22:31:39.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.068+0000 7f3f81405700 1 -- 172.21.15.59:0/3745261985 shutdown_connections 2023-09-30T22:31:39.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.068+0000 7f3f81405700 1 --2- 172.21.15.59:0/3745261985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f7c09e410 0x7f3f7c130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.068+0000 7f3f81405700 1 --2- 172.21.15.59:0/3745261985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f7c09d6f0 0x7f3f7c09dac0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.068+0000 7f3f81405700 1 -- 172.21.15.59:0/3745261985 >> 172.21.15.59:0/3745261985 conn(0x7f3f7c066f50 msgr2=0x7f3f7c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.068+0000 7f3f81405700 1 -- 172.21.15.59:0/3745261985 shutdown_connections 2023-09-30T22:31:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.068+0000 7f3f81405700 1 -- 172.21.15.59:0/3745261985 wait complete. 2023-09-30T22:31:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.070+0000 7f3f81405700 1 Processor -- start 2023-09-30T22:31:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.070+0000 7f3f81405700 1 -- start start 2023-09-30T22:31:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f81405700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f7c09d6f0 0x7f3f7c11e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f81405700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f7c09e000 0x7f3f7c11e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f81405700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f7c09e410 0x7f3f7c11eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f81405700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c1304a0 con 0x7f3f7c09e410 2023-09-30T22:31:39.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f81405700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c120f20 con 0x7f3f7c09e000 2023-09-30T22:31:39.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f81405700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c121900 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f73fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f7c09e000 0x7f3f7c11e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f7affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f7c09d6f0 0x7f3f7c11e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f7affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f7c09d6f0 0x7f3f7c11e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52792/0 (socket says 172.21.15.59:52792) 2023-09-30T22:31:39.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f7affd700 1 -- 172.21.15.59:0/1173932401 learned_addr learned my addr 172.21.15.59:0/1173932401 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:39.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f73fff700 1 --2- 172.21.15.59:0/1173932401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f7c09e000 0x7f3f7c11e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42042/0 (socket says 172.21.15.59:42042) 2023-09-30T22:31:39.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f7b7fe700 1 --2- 172.21.15.59:0/1173932401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f7c09e410 0x7f3f7c11eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f7affd700 1 -- 172.21.15.59:0/1173932401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f7c09e000 msgr2=0x7f3f7c11e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f7affd700 1 --2- 172.21.15.59:0/1173932401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f7c09e000 0x7f3f7c11e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f7affd700 1 -- 172.21.15.59:0/1173932401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f7c09e410 msgr2=0x7f3f7c11eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f7affd700 1 --2- 172.21.15.59:0/1173932401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f7c09e410 0x7f3f7c11eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.071+0000 7f3f7affd700 1 -- 172.21.15.59:0/1173932401 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f74009b30 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.072+0000 7f3f7affd700 1 --2- 172.21.15.59:0/1173932401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f7c09d6f0 0x7f3f7c11e0c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00f680 tx=0x7f3f6c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.072+0000 7f3f737fe700 1 -- 172.21.15.59:0/1173932401 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c010ee0 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.072+0000 7f3f737fe700 1 -- 172.21.15.59:0/1173932401 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c020640 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.072+0000 7f3f81405700 1 -- 172.21.15.59:0/1173932401 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6c00dca0 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.072+0000 7f3f737fe700 1 -- 172.21.15.59:0/1173932401 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0209d0 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.072+0000 7f3f81405700 1 -- 172.21.15.59:0/1173932401 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7c0a1d00 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.073+0000 7f3f737fe700 1 -- 172.21.15.59:0/1173932401 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f6c020b30 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.073+0000 7f3f81405700 1 -- 172.21.15.59:0/1173932401 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7c09c700 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.074+0000 7f3f737fe700 1 -- 172.21.15.59:0/1173932401 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f6c046da0 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.079+0000 7f3f737fe700 1 -- 172.21.15.59:0/1173932401 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f6c04a060 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.145+0000 7fe036c26700 1 Processor -- start 2023-09-30T22:31:39.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.145+0000 7fe036c26700 1 -- start start 2023-09-30T22:31:39.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.146+0000 7fe036c26700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe03006c0e0 0x7fe03009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.146+0000 7fe036c26700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe0301380f0 0x7fe03013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.146+0000 7fe036c26700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe030134980 con 0x7fe030134ec0 2023-09-30T22:31:39.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.146+0000 7fe036c26700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03006c4b0 con 0x7fe0301380f0 2023-09-30T22:31:39.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.146+0000 7fe036c26700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0300a09c0 con 0x7fe03006c0e0 2023-09-30T22:31:39.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.146+0000 7fe02ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe030134ec0 0x7fe0301379e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47800/0 (socket says 172.21.15.59:47800) 2023-09-30T22:31:39.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.146+0000 7fe02ffff700 1 -- 172.21.15.59:0/3260936754 learned_addr learned my addr 172.21.15.59:0/3260936754 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:39.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.146+0000 7fe0349c2700 1 --2- 172.21.15.59:0/3260936754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe03006c0e0 0x7fe03009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.146+0000 7fe0351c3700 1 --2- 172.21.15.59:0/3260936754 >> v2:172.21.15.59:3300/0 conn(0x7fe0301380f0 0x7fe03013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.146+0000 7fe0349c2700 1 -- 172.21.15.59:0/3260936754 >> v2:172.21.15.59:3300/0 conn(0x7fe0301380f0 msgr2=0x7fe03013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:39.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.147+0000 7fe0349c2700 1 --2- 172.21.15.59:0/3260936754 >> v2:172.21.15.59:3300/0 conn(0x7fe0301380f0 0x7fe03013fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.147+0000 7fe0349c2700 1 -- 172.21.15.59:0/3260936754 >> v1:172.21.15.59:6789/0 conn(0x7fe030134ec0 legacy=0x7fe0301379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.147+0000 7fe0349c2700 1 -- 172.21.15.59:0/3260936754 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0300a0600 con 0x7fe03006c0e0 2023-09-30T22:31:39.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.147+0000 7fe02f7fe700 1 -- 172.21.15.59:0/3260936754 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505662391 0 0) 0x7fe030134980 con 0x7fe030134ec0 2023-09-30T22:31:39.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.147+0000 7fe0349c2700 1 --2- 172.21.15.59:0/3260936754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe03006c0e0 0x7fe03009ac90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe024009840 tx=0x7fe024009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8560ba9b0d9d55b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:39.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.147+0000 7fe02f7fe700 1 -- 172.21.15.59:0/3260936754 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024011830 con 0x7fe03006c0e0 2023-09-30T22:31:39.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.147+0000 7fe02f7fe700 1 -- 172.21.15.59:0/3260936754 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe024011990 con 0x7fe03006c0e0 2023-09-30T22:31:39.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.147+0000 7fe02f7fe700 1 -- 172.21.15.59:0/3260936754 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024011d20 con 0x7fe03006c0e0 2023-09-30T22:31:39.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.148+0000 7fe036c26700 1 -- 172.21.15.59:0/3260936754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe03006c0e0 msgr2=0x7fe03009ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.148+0000 7fe036c26700 1 --2- 172.21.15.59:0/3260936754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe03006c0e0 0x7fe03009ac90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe024009840 tx=0x7fe024009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:39.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.148+0000 7fe036c26700 1 -- 172.21.15.59:0/3260936754 shutdown_connections 2023-09-30T22:31:39.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.148+0000 7fe036c26700 1 --2- 172.21.15.59:0/3260936754 >> v2:172.21.15.59:3300/0 conn(0x7fe0301380f0 0x7fe03013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.148+0000 7fe036c26700 1 --2- 172.21.15.59:0/3260936754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe03006c0e0 0x7fe03009ac90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.148+0000 7fe036c26700 1 -- 172.21.15.59:0/3260936754 >> 172.21.15.59:0/3260936754 conn(0x7fe0300a4210 msgr2=0x7fe0300a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:39.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.148+0000 7fe036c26700 1 -- 172.21.15.59:0/3260936754 shutdown_connections 2023-09-30T22:31:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.148+0000 7fe036c26700 1 -- 172.21.15.59:0/3260936754 wait complete. 2023-09-30T22:31:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.149+0000 7fe036c26700 1 Processor -- start 2023-09-30T22:31:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.149+0000 7fe036c26700 1 -- start start 2023-09-30T22:31:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.150+0000 7fe036c26700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe03006c0e0 0x7fe0301ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.150+0000 7fe036c26700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe030134ec0 0x7fe0301cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.150+0000 7fe036c26700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0301380f0 0x7fe03011a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.150+0000 7fe036c26700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe030133f10 con 0x7fe030134ec0 2023-09-30T22:31:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.150+0000 7fe036c26700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0301273b0 con 0x7fe03006c0e0 2023-09-30T22:31:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.150+0000 7fe036c26700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe03011e0a0 con 0x7fe0301380f0 2023-09-30T22:31:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.150+0000 7fe02ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe030134ec0 0x7fe0301cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.150+0000 7fe02ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe030134ec0 0x7fe0301cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53918/0 (socket says 172.21.15.59:53918) 2023-09-30T22:31:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.150+0000 7fe02ffff700 1 -- 172.21.15.59:0/2999991366 learned_addr learned my addr 172.21.15.59:0/2999991366 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:39.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.150+0000 7fe0351c3700 1 --2- 172.21.15.59:0/2999991366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0301380f0 0x7fe03011a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.150+0000 7fe02ffff700 1 -- 172.21.15.59:0/2999991366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0301380f0 msgr2=0x7fe03011a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.150+0000 7fe02ffff700 1 --2- 172.21.15.59:0/2999991366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0301380f0 0x7fe03011a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.150+0000 7fe02ffff700 1 -- 172.21.15.59:0/2999991366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe03006c0e0 msgr2=0x7fe0301ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.150+0000 7fe02ffff700 1 --2- 172.21.15.59:0/2999991366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe03006c0e0 0x7fe0301ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.150+0000 7fe02ffff700 1 -- 172.21.15.59:0/2999991366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0240094a0 con 0x7fe030134ec0 2023-09-30T22:31:39.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.151+0000 7fe02ffff700 1 --2- 172.21.15.59:0/2999991366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe030134ec0 0x7fe0301cd290 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe01c001eb0 tx=0x7fe01c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:39.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.151+0000 7fe02d7fa700 1 -- 172.21.15.59:0/2999991366 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c004c80 con 0x7fe030134ec0 2023-09-30T22:31:39.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.151+0000 7fe02d7fa700 1 -- 172.21.15.59:0/2999991366 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c004de0 con 0x7fe030134ec0 2023-09-30T22:31:39.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.151+0000 7fe036c26700 1 -- 172.21.15.59:0/2999991366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03011e5a0 con 0x7fe030134ec0 2023-09-30T22:31:39.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.151+0000 7fe02d7fa700 1 -- 172.21.15.59:0/2999991366 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c007310 con 0x7fe030134ec0 2023-09-30T22:31:39.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.151+0000 7fe036c26700 1 -- 172.21.15.59:0/2999991366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03011abc0 con 0x7fe030134ec0 2023-09-30T22:31:39.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.152+0000 7fe02d7fa700 1 -- 172.21.15.59:0/2999991366 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe01c007470 con 0x7fe030134ec0 2023-09-30T22:31:39.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.152+0000 7fe02d7fa700 1 -- 172.21.15.59:0/2999991366 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe01c03f360 con 0x7fe030134ec0 2023-09-30T22:31:39.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.153+0000 7fe036c26700 1 -- 172.21.15.59:0/2999991366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe030074ea0 con 0x7fe030134ec0 2023-09-30T22:31:39.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.156+0000 7f3a4d69e700 1 -- 172.21.15.59:0/858495172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3a48074ea0 con 0x7f3a48130e50 2023-09-30T22:31:39.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.162+0000 7f3a2f7fe700 1 -- 172.21.15.59:0/858495172 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a40011390 con 0x7f3a48130e50 2023-09-30T22:31:39.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.162+0000 7fe02d7fa700 1 -- 172.21.15.59:0/2999991366 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe01c0123b0 con 0x7fe030134ec0 2023-09-30T22:31:39.163 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.164+0000 7f3a4d69e700 1 -- 172.21.15.59:0/858495172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a48130e50 msgr2=0x7f3a4811afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.164+0000 7f3a4d69e700 1 --2- 172.21.15.59:0/858495172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a48130e50 0x7f3a4811afb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000b370 tx=0x7f3a40004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.165+0000 7f3a4d69e700 1 -- 172.21.15.59:0/858495172 shutdown_connections 2023-09-30T22:31:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.165+0000 7f3a4d69e700 1 --2- 172.21.15.59:0/858495172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a48130e50 0x7f3a4811afb0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.165+0000 7f3a4d69e700 1 --2- 172.21.15.59:0/858495172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4806fcf0 0x7f3a4811a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.165+0000 7f3a4d69e700 1 --2- 172.21.15.59:0/858495172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a48130540 0x7f3a4811aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.165+0000 7f3a4d69e700 1 -- 172.21.15.59:0/858495172 >> 172.21.15.59:0/858495172 conn(0x7f3a480a2aa0 msgr2=0x7f3a4812d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:39.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.166+0000 7f3a4d69e700 1 -- 172.21.15.59:0/858495172 shutdown_connections 2023-09-30T22:31:39.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.167+0000 7f3a4d69e700 1 -- 172.21.15.59:0/858495172 wait complete. 2023-09-30T22:31:39.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:39.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.262+0000 7f267f3a2700 1 -- 172.21.15.59:0/1507694640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f267804f2a0 con 0x7f267809d8d0 2023-09-30T22:31:39.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.262+0000 7f266effd700 1 -- 172.21.15.59:0/1507694640 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f267402d970 con 0x7f267809d8d0 2023-09-30T22:31:39.264 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:39.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.265+0000 7f267f3a2700 1 -- 172.21.15.59:0/1507694640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267809d8d0 msgr2=0x7f267812ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.265+0000 7f267f3a2700 1 --2- 172.21.15.59:0/1507694640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267809d8d0 0x7f267812ea60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f2674009fd0 tx=0x7f2674004750 comp rx=0 tx=0).stop 2023-09-30T22:31:39.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.265+0000 7f267f3a2700 1 -- 172.21.15.59:0/1507694640 shutdown_connections 2023-09-30T22:31:39.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.265+0000 7f267f3a2700 1 --2- 172.21.15.59:0/1507694640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f267809e610 0x7f267812f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.265+0000 7f267f3a2700 1 --2- 172.21.15.59:0/1507694640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267809d8d0 0x7f267812ea60 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.265+0000 7f267f3a2700 1 --2- 172.21.15.59:0/1507694640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f267809e1e0 0x7f267812efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.265+0000 7f267f3a2700 1 -- 172.21.15.59:0/1507694640 >> 172.21.15.59:0/1507694640 conn(0x7f26780a2e20 msgr2=0x7f2678070990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:39.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.265+0000 7f267f3a2700 1 -- 172.21.15.59:0/1507694640 shutdown_connections 2023-09-30T22:31:39.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.265+0000 7f267f3a2700 1 -- 172.21.15.59:0/1507694640 wait complete. 2023-09-30T22:31:39.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:39.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.294+0000 7f3f81405700 1 -- 172.21.15.59:0/1173932401 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3f7c074ea0 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.294+0000 7f3f737fe700 1 -- 172.21.15.59:0/1173932401 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f6c04a070 con 0x7f3f7c09d6f0 2023-09-30T22:31:39.296 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.297+0000 7f3f81405700 1 -- 172.21.15.59:0/1173932401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f7c09d6f0 msgr2=0x7f3f7c11e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.297+0000 7f3f81405700 1 --2- 172.21.15.59:0/1173932401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f7c09d6f0 0x7f3f7c11e0c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00f680 tx=0x7f3f6c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.297+0000 7f3f81405700 1 -- 172.21.15.59:0/1173932401 shutdown_connections 2023-09-30T22:31:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.297+0000 7f3f81405700 1 --2- 172.21.15.59:0/1173932401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f7c09d6f0 0x7f3f7c11e0c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.297+0000 7f3f81405700 1 --2- 172.21.15.59:0/1173932401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f7c09e410 0x7f3f7c11eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.297+0000 7f3f81405700 1 --2- 172.21.15.59:0/1173932401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f7c09e000 0x7f3f7c11e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.297+0000 7f3f81405700 1 -- 172.21.15.59:0/1173932401 >> 172.21.15.59:0/1173932401 conn(0x7f3f7c066f50 msgr2=0x7f3f7c06f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.297+0000 7f3f81405700 1 -- 172.21.15.59:0/1173932401 shutdown_connections 2023-09-30T22:31:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.297+0000 7f3f81405700 1 -- 172.21.15.59:0/1173932401 wait complete. 2023-09-30T22:31:39.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:39.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.368+0000 7fe036c26700 1 -- 172.21.15.59:0/2999991366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe030134150 con 0x7fe030134ec0 2023-09-30T22:31:39.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.368+0000 7fe02d7fa700 1 -- 172.21.15.59:0/2999991366 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe01c0102c0 con 0x7fe030134ec0 2023-09-30T22:31:39.369 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:39.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.371+0000 7fe036c26700 1 -- 172.21.15.59:0/2999991366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe030134ec0 msgr2=0x7fe0301cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.371+0000 7fe036c26700 1 --2- 172.21.15.59:0/2999991366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe030134ec0 0x7fe0301cd290 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe01c001eb0 tx=0x7fe01c00c800 comp rx=0 tx=0).stop 2023-09-30T22:31:39.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.371+0000 7fe036c26700 1 -- 172.21.15.59:0/2999991366 shutdown_connections 2023-09-30T22:31:39.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.371+0000 7fe036c26700 1 --2- 172.21.15.59:0/2999991366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0301380f0 0x7fe03011a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.371+0000 7fe036c26700 1 --2- 172.21.15.59:0/2999991366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe03006c0e0 0x7fe0301ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.371+0000 7fe036c26700 1 --2- 172.21.15.59:0/2999991366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe030134ec0 0x7fe0301cd290 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.371+0000 7fe036c26700 1 -- 172.21.15.59:0/2999991366 >> 172.21.15.59:0/2999991366 conn(0x7fe0300a4210 msgr2=0x7fe030099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:39.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.371+0000 7fe036c26700 1 -- 172.21.15.59:0/2999991366 shutdown_connections 2023-09-30T22:31:39.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:39.371+0000 7fe036c26700 1 -- 172.21.15.59:0/2999991366 wait complete. 2023-09-30T22:31:39.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:40.183 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:40.280 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:40.313 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.330+0000 7f58a88a3700 1 Processor -- start 2023-09-30T22:31:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.330+0000 7f58a88a3700 1 -- start start 2023-09-30T22:31:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.330+0000 7f58a88a3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58a4131630 0x7f58a4131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.330+0000 7f58a88a3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a4131f40 0x7f58a406e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.331+0000 7f58a88a3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a4071a00 con 0x7f58a406e9d0 2023-09-30T22:31:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.331+0000 7f58a88a3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a4131430 con 0x7f58a4131630 2023-09-30T22:31:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.331+0000 7f58a88a3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58a409a510 con 0x7f58a4131f40 2023-09-30T22:31:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.331+0000 7f58a1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a4131f40 0x7f58a406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.331+0000 7f58a1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a4131f40 0x7f58a406e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52832/0 (socket says 172.21.15.59:52832) 2023-09-30T22:31:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.331+0000 7f58a1d9b700 1 -- 172.21.15.59:0/1201623640 learned_addr learned my addr 172.21.15.59:0/1201623640 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.331+0000 7f58a259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58a4131630 0x7f58a4131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.331+0000 7f58a1d9b700 1 -- 172.21.15.59:0/1201623640 >> v2:172.21.15.59:3300/0 conn(0x7f58a4131630 msgr2=0x7f58a4131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.331+0000 7f58a1d9b700 1 --2- 172.21.15.59:0/1201623640 >> v2:172.21.15.59:3300/0 conn(0x7f58a4131630 0x7f58a4131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.331+0000 7f58a1d9b700 1 -- 172.21.15.59:0/1201623640 >> v1:172.21.15.59:6789/0 conn(0x7f58a406e9d0 legacy=0x7f58a4138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.331+0000 7f58a1d9b700 1 -- 172.21.15.59:0/1201623640 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a40721c0 con 0x7f58a4131f40 2023-09-30T22:31:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.331+0000 7f58a1d9b700 1 --2- 172.21.15.59:0/1201623640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a4131f40 0x7f58a406e490 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f58980098f0 tx=0x7f5898009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7176438e50eec79 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.332+0000 7f58a159a700 1 -- 172.21.15.59:0/1201623640 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898011830 con 0x7f58a4131f40 2023-09-30T22:31:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.332+0000 7f58a159a700 1 -- 172.21.15.59:0/1201623640 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5898011990 con 0x7f58a4131f40 2023-09-30T22:31:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.332+0000 7f58a159a700 1 -- 172.21.15.59:0/1201623640 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898011d20 con 0x7f58a4131f40 2023-09-30T22:31:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.333+0000 7f58a88a3700 1 -- 172.21.15.59:0/1201623640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a4131f40 msgr2=0x7f58a406e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.333+0000 7f58a88a3700 1 --2- 172.21.15.59:0/1201623640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a4131f40 0x7f58a406e490 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f58980098f0 tx=0x7f5898009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.333+0000 7f58a88a3700 1 -- 172.21.15.59:0/1201623640 shutdown_connections 2023-09-30T22:31:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.333+0000 7f58a88a3700 1 --2- 172.21.15.59:0/1201623640 >> v2:172.21.15.59:3300/0 conn(0x7f58a4131630 0x7f58a4131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.333+0000 7f58a88a3700 1 --2- 172.21.15.59:0/1201623640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a4131f40 0x7f58a406e490 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.333+0000 7f58a88a3700 1 -- 172.21.15.59:0/1201623640 >> 172.21.15.59:0/1201623640 conn(0x7f58a40a2aa0 msgr2=0x7f58a40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.333+0000 7f58a88a3700 1 -- 172.21.15.59:0/1201623640 shutdown_connections 2023-09-30T22:31:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.333+0000 7f58a88a3700 1 -- 172.21.15.59:0/1201623640 wait complete. 2023-09-30T22:31:40.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.335+0000 7f58a88a3700 1 Processor -- start 2023-09-30T22:31:40.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.335+0000 7f58a88a3700 1 -- start start 2023-09-30T22:31:40.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.335+0000 7f58a88a3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a406e9d0 0x7f58a406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.335+0000 7f58a88a3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a4131630 0x7f58a406fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.335+0000 7f58a88a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a4131f40 0x7f58a4070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.335+0000 7f58a88a3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4121530 con 0x7f58a4131630 2023-09-30T22:31:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.335+0000 7f58a88a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a411fec0 con 0x7f58a4131f40 2023-09-30T22:31:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.335+0000 7f58a88a3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4071220 con 0x7f58a406e9d0 2023-09-30T22:31:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.336+0000 7f58a259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a406e9d0 0x7f58a406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.336+0000 7f58a259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a406e9d0 0x7f58a406f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52834/0 (socket says 172.21.15.59:52834) 2023-09-30T22:31:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.336+0000 7f58a259c700 1 -- 172.21.15.59:0/2846036001 learned_addr learned my addr 172.21.15.59:0/2846036001 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.336+0000 7f58a2d9d700 1 --2- 172.21.15.59:0/2846036001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a4131f40 0x7f58a4070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.336+0000 7f58a1d9b700 1 --2- 172.21.15.59:0/2846036001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a4131630 0x7f58a406fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.336+0000 7f58a1d9b700 1 -- 172.21.15.59:0/2846036001 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a406e9d0 msgr2=0x7f58a406f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.336+0000 7f58a1d9b700 1 --2- 172.21.15.59:0/2846036001 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a406e9d0 0x7f58a406f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.336+0000 7f58a1d9b700 1 -- 172.21.15.59:0/2846036001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a4131f40 msgr2=0x7f58a4070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.336+0000 7f58a1d9b700 1 --2- 172.21.15.59:0/2846036001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a4131f40 0x7f58a4070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.336+0000 7f58a1d9b700 1 -- 172.21.15.59:0/2846036001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898009550 con 0x7f58a4131630 2023-09-30T22:31:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.336+0000 7f58a2d9d700 1 --2- 172.21.15.59:0/2846036001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a4131f40 0x7f58a4070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.336+0000 7f58a259c700 1 --2- 172.21.15.59:0/2846036001 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a406e9d0 0x7f58a406f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.336+0000 7f58a1d9b700 1 --2- 172.21.15.59:0/2846036001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a4131630 0x7f58a406fb50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5898016000 tx=0x7f5898004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.337+0000 7f5892ffd700 1 -- 172.21.15.59:0/2846036001 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898004400 con 0x7f58a4131630 2023-09-30T22:31:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.337+0000 7f5892ffd700 1 -- 172.21.15.59:0/2846036001 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589801f070 con 0x7f58a4131630 2023-09-30T22:31:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.337+0000 7f58a88a3700 1 -- 172.21.15.59:0/2846036001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a40a1cc0 con 0x7f58a4131630 2023-09-30T22:31:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.337+0000 7f5892ffd700 1 -- 172.21.15.59:0/2846036001 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58980038e0 con 0x7f58a4131630 2023-09-30T22:31:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.337+0000 7f58a88a3700 1 -- 172.21.15.59:0/2846036001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a412e530 con 0x7f58a4131630 2023-09-30T22:31:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.338+0000 7f5892ffd700 1 -- 172.21.15.59:0/2846036001 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5898021030 con 0x7f58a4131630 2023-09-30T22:31:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.338+0000 7f5892ffd700 1 -- 172.21.15.59:0/2846036001 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5898040ac0 con 0x7f58a4131630 2023-09-30T22:31:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.338+0000 7f58a88a3700 1 -- 172.21.15.59:0/2846036001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a4074ea0 con 0x7f58a4131630 2023-09-30T22:31:40.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.344+0000 7f5892ffd700 1 -- 172.21.15.59:0/2846036001 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5898004560 con 0x7f58a4131630 2023-09-30T22:31:40.386 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.437+0000 7f61808ca700 1 Processor -- start 2023-09-30T22:31:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.437+0000 7f61808ca700 1 -- start start 2023-09-30T22:31:40.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.437+0000 7f61808ca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f617c131810 0x7f617c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.437+0000 7f61808ca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f617c099a40 0x7f617c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.437+0000 7f61808ca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f617c09a3b0 0x7f617c138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.437+0000 7f61808ca700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617c09b580 con 0x7f617c09a3b0 2023-09-30T22:31:40.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.437+0000 7f61808ca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c1313c0 con 0x7f617c099a40 2023-09-30T22:31:40.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.437+0000 7f61808ca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f617c06e8c0 con 0x7f617c131810 2023-09-30T22:31:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.438+0000 7f617ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f617c09a3b0 0x7f617c138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.438+0000 7f6179d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f617c099a40 0x7f617c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.438+0000 7f617ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f617c09a3b0 0x7f617c138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53940/0 (socket says 172.21.15.59:53940) 2023-09-30T22:31:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.438+0000 7f617ad9d700 1 -- 172.21.15.59:0/3287242160 learned_addr learned my addr 172.21.15.59:0/3287242160 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.438+0000 7f617a59c700 1 --2- 172.21.15.59:0/3287242160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f617c131810 0x7f617c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.438+0000 7f617ad9d700 1 -- 172.21.15.59:0/3287242160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f617c131810 msgr2=0x7f617c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.438+0000 7f617ad9d700 1 --2- 172.21.15.59:0/3287242160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f617c131810 0x7f617c131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.438+0000 7f617ad9d700 1 -- 172.21.15.59:0/3287242160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f617c099a40 msgr2=0x7f617c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.438+0000 7f617ad9d700 1 --2- 172.21.15.59:0/3287242160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f617c099a40 0x7f617c099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.438+0000 7f617ad9d700 1 -- 172.21.15.59:0/3287242160 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c09a820 con 0x7f617c09a3b0 2023-09-30T22:31:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.438+0000 7f617ad9d700 1 --2- 172.21.15.59:0/3287242160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f617c09a3b0 0x7f617c138650 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6174009e50 tx=0x7f617400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26aaf8ff2ad721ac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.439+0000 7f617959a700 1 -- 172.21.15.59:0/3287242160 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617400e070 con 0x7f617c09a3b0 2023-09-30T22:31:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.439+0000 7f617959a700 1 -- 172.21.15.59:0/3287242160 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617400b910 con 0x7f617c09a3b0 2023-09-30T22:31:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.439+0000 7f617959a700 1 -- 172.21.15.59:0/3287242160 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617400bcc0 con 0x7f617c09a3b0 2023-09-30T22:31:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.439+0000 7f61808ca700 1 -- 172.21.15.59:0/3287242160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f617c09a3b0 msgr2=0x7f617c138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.439+0000 7f61808ca700 1 --2- 172.21.15.59:0/3287242160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f617c09a3b0 0x7f617c138650 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6174009e50 tx=0x7f617400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.439+0000 7f61808ca700 1 -- 172.21.15.59:0/3287242160 shutdown_connections 2023-09-30T22:31:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.439+0000 7f61808ca700 1 --2- 172.21.15.59:0/3287242160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f617c09a3b0 0x7f617c138650 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.440+0000 7f61808ca700 1 --2- 172.21.15.59:0/3287242160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f617c131810 0x7f617c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.440+0000 7f61808ca700 1 --2- 172.21.15.59:0/3287242160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f617c099a40 0x7f617c099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.440+0000 7f61808ca700 1 -- 172.21.15.59:0/3287242160 >> 172.21.15.59:0/3287242160 conn(0x7f617c0a2aa0 msgr2=0x7f617c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.440+0000 7f61808ca700 1 -- 172.21.15.59:0/3287242160 shutdown_connections 2023-09-30T22:31:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.440+0000 7f61808ca700 1 -- 172.21.15.59:0/3287242160 wait complete. 2023-09-30T22:31:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.441+0000 7f61808ca700 1 Processor -- start 2023-09-30T22:31:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.441+0000 7f61808ca700 1 -- start start 2023-09-30T22:31:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.441+0000 7f61808ca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f617c099a40 0x7f617c1c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.441+0000 7f61808ca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f617c09a3b0 0x7f617c1c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.441+0000 7f61808ca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f617c131810 0x7f617c1c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.441+0000 7f61808ca700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c11cd00 con 0x7f617c131810 2023-09-30T22:31:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.441+0000 7f61808ca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c1c6c80 con 0x7f617c09a3b0 2023-09-30T22:31:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.441+0000 7f61808ca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f617c11aff0 con 0x7f617c099a40 2023-09-30T22:31:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.442+0000 7f617a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f617c099a40 0x7f617c1c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.442+0000 7f617a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f617c099a40 0x7f617c1c6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52846/0 (socket says 172.21.15.59:52846) 2023-09-30T22:31:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.442+0000 7f617a59c700 1 -- 172.21.15.59:0/2519172268 learned_addr learned my addr 172.21.15.59:0/2519172268 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.442+0000 7f617ad9d700 1 --2- 172.21.15.59:0/2519172268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f617c131810 0x7f617c1c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.442+0000 7f6179d9b700 1 --2- 172.21.15.59:0/2519172268 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f617c09a3b0 0x7f617c1c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.442+0000 7f617a59c700 1 -- 172.21.15.59:0/2519172268 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f617c09a3b0 msgr2=0x7f617c1c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.442+0000 7f617a59c700 1 --2- 172.21.15.59:0/2519172268 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f617c09a3b0 0x7f617c1c6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.442+0000 7f617a59c700 1 -- 172.21.15.59:0/2519172268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f617c131810 msgr2=0x7f617c1c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.442+0000 7f617a59c700 1 --2- 172.21.15.59:0/2519172268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f617c131810 0x7f617c1c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.442+0000 7f617a59c700 1 -- 172.21.15.59:0/2519172268 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6174009b30 con 0x7f617c099a40 2023-09-30T22:31:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.442+0000 7f617a59c700 1 --2- 172.21.15.59:0/2519172268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f617c099a40 0x7f617c1c6200 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f616c00ea10 tx=0x7f616c00ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.442+0000 7f616affd700 1 -- 172.21.15.59:0/2519172268 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c009710 con 0x7f617c099a40 2023-09-30T22:31:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.443+0000 7f616affd700 1 -- 172.21.15.59:0/2519172268 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c00c850 con 0x7f617c099a40 2023-09-30T22:31:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.443+0000 7f61808ca700 1 -- 172.21.15.59:0/2519172268 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c130920 con 0x7f617c099a40 2023-09-30T22:31:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.443+0000 7f616affd700 1 -- 172.21.15.59:0/2519172268 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c00cbc0 con 0x7f617c099a40 2023-09-30T22:31:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.443+0000 7f61808ca700 1 -- 172.21.15.59:0/2519172268 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c11bdd0 con 0x7f617c099a40 2023-09-30T22:31:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.444+0000 7f61808ca700 1 -- 172.21.15.59:0/2519172268 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c074ea0 con 0x7f617c099a40 2023-09-30T22:31:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.444+0000 7f616affd700 1 -- 172.21.15.59:0/2519172268 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f616c00cd20 con 0x7f617c099a40 2023-09-30T22:31:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.444+0000 7f616affd700 1 -- 172.21.15.59:0/2519172268 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f616c03f7b0 con 0x7f617c099a40 2023-09-30T22:31:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.449+0000 7f616affd700 1 -- 172.21.15.59:0/2519172268 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f616c01be10 con 0x7f617c099a40 2023-09-30T22:31:40.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.479+0000 7f170e8bf700 1 Processor -- start 2023-09-30T22:31:40.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.479+0000 7f170e8bf700 1 -- start start 2023-09-30T22:31:40.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.480+0000 7f170e8bf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f170809e930 0x7f170809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.480+0000 7f170e8bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170809f650 0x7f1708131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.480+0000 7f170e8bf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1708070940 con 0x7f170809f240 2023-09-30T22:31:40.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.480+0000 7f170e8bf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170806fd60 con 0x7f170809e930 2023-09-30T22:31:40.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.480+0000 7f170e8bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170806fa80 con 0x7f170809f650 2023-09-30T22:31:40.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.480+0000 7f170ce5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170809f650 0x7f1708131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.480+0000 7f170ce5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170809f650 0x7f1708131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42084/0 (socket says 172.21.15.59:42084) 2023-09-30T22:31:40.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.480+0000 7f170ce5c700 1 -- 172.21.15.59:0/3809460451 learned_addr learned my addr 172.21.15.59:0/3809460451 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:40.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.480+0000 7f1707fff700 1 --2- 172.21.15.59:0/3809460451 >> v2:172.21.15.59:3300/0 conn(0x7f170809e930 0x7f170809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.481+0000 7f1706ffd700 1 -- 172.21.15.59:0/3809460451 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116184284 0 0) 0x7f1708070940 con 0x7f170809f240 2023-09-30T22:31:40.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.481+0000 7f170ce5c700 1 -- 172.21.15.59:0/3809460451 >> v2:172.21.15.59:3300/0 conn(0x7f170809e930 msgr2=0x7f170809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:40.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.481+0000 7f170ce5c700 1 --2- 172.21.15.59:0/3809460451 >> v2:172.21.15.59:3300/0 conn(0x7f170809e930 0x7f170809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.481+0000 7f170ce5c700 1 -- 172.21.15.59:0/3809460451 >> v1:172.21.15.59:6789/0 conn(0x7f170809f240 legacy=0x7f17081317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.481+0000 7f170ce5c700 1 -- 172.21.15.59:0/3809460451 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170809fb60 con 0x7f170809f650 2023-09-30T22:31:40.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.481+0000 7f170ce5c700 1 --2- 172.21.15.59:0/3809460451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170809f650 0x7f1708131f00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1700009e50 tx=0x7f170000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50f15742e56bdbfe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:40.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.481+0000 7f1706ffd700 1 -- 172.21.15.59:0/3809460451 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170000e070 con 0x7f170809f650 2023-09-30T22:31:40.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.482+0000 7f1706ffd700 1 -- 172.21.15.59:0/3809460451 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170000b910 con 0x7f170809f650 2023-09-30T22:31:40.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.482+0000 7f1706ffd700 1 -- 172.21.15.59:0/3809460451 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170000bcc0 con 0x7f170809f650 2023-09-30T22:31:40.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.482+0000 7f170e8bf700 1 -- 172.21.15.59:0/3809460451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170809f650 msgr2=0x7f1708131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.482+0000 7f170e8bf700 1 --2- 172.21.15.59:0/3809460451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170809f650 0x7f1708131f00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1700009e50 tx=0x7f170000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:40.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.482+0000 7f170e8bf700 1 -- 172.21.15.59:0/3809460451 shutdown_connections 2023-09-30T22:31:40.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.482+0000 7f170e8bf700 1 --2- 172.21.15.59:0/3809460451 >> v2:172.21.15.59:3300/0 conn(0x7f170809e930 0x7f170809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.482+0000 7f170e8bf700 1 --2- 172.21.15.59:0/3809460451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170809f650 0x7f1708131f00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.482+0000 7f170e8bf700 1 -- 172.21.15.59:0/3809460451 >> 172.21.15.59:0/3809460451 conn(0x7f17080a4210 msgr2=0x7f17080a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:40.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.482+0000 7f170e8bf700 1 -- 172.21.15.59:0/3809460451 shutdown_connections 2023-09-30T22:31:40.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.482+0000 7f170e8bf700 1 -- 172.21.15.59:0/3809460451 wait complete. 2023-09-30T22:31:40.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.484+0000 7f170e8bf700 1 Processor -- start 2023-09-30T22:31:40.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.484+0000 7f170e8bf700 1 -- start start 2023-09-30T22:31:40.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.485+0000 7f170e8bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170809e930 0x7f170806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.485+0000 7f170e8bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170809f240 0x7f170806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.485+0000 7f170e8bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170809f650 0x7f170806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.485+0000 7f170e8bf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17081b7210 con 0x7f170809e930 2023-09-30T22:31:40.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.485+0000 7f170e8bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17081a93c0 con 0x7f170809f240 2023-09-30T22:31:40.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.485+0000 7f170e8bf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17081a88e0 con 0x7f170809f650 2023-09-30T22:31:40.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.485+0000 7f1707fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170809e930 0x7f170806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.485+0000 7f1707fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170809e930 0x7f170806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53960/0 (socket says 172.21.15.59:53960) 2023-09-30T22:31:40.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.485+0000 7f1707fff700 1 -- 172.21.15.59:0/2957957800 learned_addr learned my addr 172.21.15.59:0/2957957800 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:40.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.485+0000 7f170ce5c700 1 --2- 172.21.15.59:0/2957957800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170809f650 0x7f170806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.485+0000 7f17077fe700 1 --2- 172.21.15.59:0/2957957800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170809f240 0x7f170806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.486+0000 7f1707fff700 1 -- 172.21.15.59:0/2957957800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170809f650 msgr2=0x7f170806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.486+0000 7f1707fff700 1 --2- 172.21.15.59:0/2957957800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170809f650 0x7f170806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.486+0000 7f1707fff700 1 -- 172.21.15.59:0/2957957800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170809f240 msgr2=0x7f170806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.486+0000 7f1707fff700 1 --2- 172.21.15.59:0/2957957800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170809f240 0x7f170806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.486+0000 7f1707fff700 1 -- 172.21.15.59:0/2957957800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700009b30 con 0x7f170809e930 2023-09-30T22:31:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.486+0000 7f1707fff700 1 --2- 172.21.15.59:0/2957957800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170809e930 0x7f170806b8b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f16f800e9e0 tx=0x7f16f800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.486+0000 7f1704ff9700 1 -- 172.21.15.59:0/2957957800 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800ee80 con 0x7f170809e930 2023-09-30T22:31:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.486+0000 7f1704ff9700 1 -- 172.21.15.59:0/2957957800 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f800c850 con 0x7f170809e930 2023-09-30T22:31:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.486+0000 7f170e8bf700 1 -- 172.21.15.59:0/2957957800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17080a0190 con 0x7f170809e930 2023-09-30T22:31:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.486+0000 7f1704ff9700 1 -- 172.21.15.59:0/2957957800 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800cbc0 con 0x7f170809e930 2023-09-30T22:31:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.486+0000 7f170e8bf700 1 -- 172.21.15.59:0/2957957800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17081a90f0 con 0x7f170809e930 2023-09-30T22:31:40.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.487+0000 7f170e8bf700 1 -- 172.21.15.59:0/2957957800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17081a0b30 con 0x7f170809e930 2023-09-30T22:31:40.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.488+0000 7f1704ff9700 1 -- 172.21.15.59:0/2957957800 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16f800cd20 con 0x7f170809e930 2023-09-30T22:31:40.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.488+0000 7f1704ff9700 1 -- 172.21.15.59:0/2957957800 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f16f803fef0 con 0x7f170809e930 2023-09-30T22:31:40.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.493+0000 7f1704ff9700 1 -- 172.21.15.59:0/2957957800 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16f8011350 con 0x7f170809e930 2023-09-30T22:31:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.535+0000 7efeb2841700 1 Processor -- start 2023-09-30T22:31:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.535+0000 7efeb2841700 1 -- start start 2023-09-30T22:31:40.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.536+0000 7efeb2841700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeac09e1d0 0x7efeac135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.536+0000 7efeb2841700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeac135e50 0x7efeac138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.536+0000 7efeb2841700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeac09f130 con 0x7efeac09d6f0 2023-09-30T22:31:40.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.536+0000 7efeb2841700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac09f520 con 0x7efeac135e50 2023-09-30T22:31:40.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.536+0000 7efeb2841700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efeac09e930 con 0x7efeac09e1d0 2023-09-30T22:31:40.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.536+0000 7efeabfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efeac09d6f0 0x7efeac09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47828/0 (socket says 172.21.15.59:47828) 2023-09-30T22:31:40.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.536+0000 7efeabfff700 1 -- 172.21.15.59:0/1333263160 learned_addr learned my addr 172.21.15.59:0/1333263160 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:40.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.536+0000 7efeab7fe700 1 --2- 172.21.15.59:0/1333263160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeac09e1d0 0x7efeac135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.536+0000 7efeb0dde700 1 --2- 172.21.15.59:0/1333263160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeac135e50 0x7efeac138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.536+0000 7efeab7fe700 1 -- 172.21.15.59:0/1333263160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeac135e50 msgr2=0x7efeac138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:40.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.536+0000 7efeab7fe700 1 --2- 172.21.15.59:0/1333263160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeac135e50 0x7efeac138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.536+0000 7efeaaffd700 1 -- 172.21.15.59:0/1333263160 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296160860 0 0) 0x7efeac09f130 con 0x7efeac09d6f0 2023-09-30T22:31:40.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.536+0000 7efeab7fe700 1 -- 172.21.15.59:0/1333263160 >> v1:172.21.15.59:6789/0 conn(0x7efeac09d6f0 legacy=0x7efeac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.536+0000 7efeab7fe700 1 -- 172.21.15.59:0/1333263160 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac09b2d0 con 0x7efeac09e1d0 2023-09-30T22:31:40.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.537+0000 7efeab7fe700 1 --2- 172.21.15.59:0/1333263160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeac09e1d0 0x7efeac135910 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efea0009870 tx=0x7efea0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c70d0b5136931514 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:40.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.537+0000 7efeaaffd700 1 -- 172.21.15.59:0/1333263160 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea000f8a0 con 0x7efeac09e1d0 2023-09-30T22:31:40.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.537+0000 7efeaaffd700 1 -- 172.21.15.59:0/1333263160 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea000fa00 con 0x7efeac09e1d0 2023-09-30T22:31:40.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.537+0000 7efeaaffd700 1 -- 172.21.15.59:0/1333263160 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea000fd90 con 0x7efeac09e1d0 2023-09-30T22:31:40.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.538+0000 7efeb2841700 1 -- 172.21.15.59:0/1333263160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeac09e1d0 msgr2=0x7efeac135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.538+0000 7efeb2841700 1 --2- 172.21.15.59:0/1333263160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeac09e1d0 0x7efeac135910 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efea0009870 tx=0x7efea0009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:40.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.538+0000 7efeb2841700 1 -- 172.21.15.59:0/1333263160 shutdown_connections 2023-09-30T22:31:40.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.538+0000 7efeb2841700 1 --2- 172.21.15.59:0/1333263160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeac135e50 0x7efeac138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.538+0000 7efeb2841700 1 --2- 172.21.15.59:0/1333263160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeac09e1d0 0x7efeac135910 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.538+0000 7efeb2841700 1 -- 172.21.15.59:0/1333263160 >> 172.21.15.59:0/1333263160 conn(0x7efeac066f50 msgr2=0x7efeac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:40.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.538+0000 7efeb2841700 1 -- 172.21.15.59:0/1333263160 shutdown_connections 2023-09-30T22:31:40.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.538+0000 7efeb2841700 1 -- 172.21.15.59:0/1333263160 wait complete. 2023-09-30T22:31:40.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.540+0000 7efeb2841700 1 Processor -- start 2023-09-30T22:31:40.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.540+0000 7efeb2841700 1 -- start start 2023-09-30T22:31:40.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeb2841700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeac09d6f0 0x7efeac11e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeb2841700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeac09e1d0 0x7efeac11e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeb2841700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeac135e50 0x7efeac1c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeb2841700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac11dd70 con 0x7efeac135e50 2023-09-30T22:31:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeb2841700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac12ffa0 con 0x7efeac09d6f0 2023-09-30T22:31:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeb2841700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efeac09c700 con 0x7efeac09e1d0 2023-09-30T22:31:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeb0dde700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeac135e50 0x7efeac1c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeb0dde700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeac135e50 0x7efeac1c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53968/0 (socket says 172.21.15.59:53968) 2023-09-30T22:31:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeb0dde700 1 -- 172.21.15.59:0/1647653175 learned_addr learned my addr 172.21.15.59:0/1647653175 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeab7fe700 1 --2- 172.21.15.59:0/1647653175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeac09e1d0 0x7efeac11e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeabfff700 1 --2- 172.21.15.59:0/1647653175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeac09d6f0 0x7efeac11e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeb0dde700 1 -- 172.21.15.59:0/1647653175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeac09e1d0 msgr2=0x7efeac11e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeb0dde700 1 --2- 172.21.15.59:0/1647653175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeac09e1d0 0x7efeac11e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeb0dde700 1 -- 172.21.15.59:0/1647653175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeac09d6f0 msgr2=0x7efeac11e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeb0dde700 1 --2- 172.21.15.59:0/1647653175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeac09d6f0 0x7efeac11e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.541+0000 7efeb0dde700 1 -- 172.21.15.59:0/1647653175 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea00094a0 con 0x7efeac135e50 2023-09-30T22:31:40.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.542+0000 7efeb0dde700 1 --2- 172.21.15.59:0/1647653175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeac135e50 0x7efeac1c80e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7efea4009e30 tx=0x7efea400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:40.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.542+0000 7efea8ff9700 1 -- 172.21.15.59:0/1647653175 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4009ca0 con 0x7efeac135e50 2023-09-30T22:31:40.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.542+0000 7efea8ff9700 1 -- 172.21.15.59:0/1647653175 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea400f040 con 0x7efeac135e50 2023-09-30T22:31:40.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.542+0000 7efeb2841700 1 -- 172.21.15.59:0/1647653175 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeac121250 con 0x7efeac135e50 2023-09-30T22:31:40.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.542+0000 7efea8ff9700 1 -- 172.21.15.59:0/1647653175 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4014480 con 0x7efeac135e50 2023-09-30T22:31:40.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.542+0000 7efeb2841700 1 -- 172.21.15.59:0/1647653175 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeac11eba0 con 0x7efeac135e50 2023-09-30T22:31:40.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.543+0000 7efea8ff9700 1 -- 172.21.15.59:0/1647653175 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efea40145e0 con 0x7efeac135e50 2023-09-30T22:31:40.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.543+0000 7efea8ff9700 1 -- 172.21.15.59:0/1647653175 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efea40402b0 con 0x7efeac135e50 2023-09-30T22:31:40.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.543+0000 7efeb2841700 1 -- 172.21.15.59:0/1647653175 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeac11f2a0 con 0x7efeac135e50 2023-09-30T22:31:40.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.548+0000 7efea8ff9700 1 -- 172.21.15.59:0/1647653175 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efea4018020 con 0x7efeac135e50 2023-09-30T22:31:40.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.582+0000 7f58a88a3700 1 -- 172.21.15.59:0/2846036001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f58a4121020 con 0x7f58a4131630 2023-09-30T22:31:40.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.582+0000 7f5892ffd700 1 -- 172.21.15.59:0/2846036001 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5898015030 con 0x7f58a4131630 2023-09-30T22:31:40.582 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:40.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.586+0000 7f58a88a3700 1 -- 172.21.15.59:0/2846036001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a4131630 msgr2=0x7f58a406fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.586+0000 7f58a88a3700 1 --2- 172.21.15.59:0/2846036001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a4131630 0x7f58a406fb50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5898016000 tx=0x7f5898004750 comp rx=0 tx=0).stop 2023-09-30T22:31:40.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.586+0000 7f58a88a3700 1 -- 172.21.15.59:0/2846036001 shutdown_connections 2023-09-30T22:31:40.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.586+0000 7f58a88a3700 1 --2- 172.21.15.59:0/2846036001 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a406e9d0 0x7f58a406f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.586+0000 7f58a88a3700 1 --2- 172.21.15.59:0/2846036001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a4131f40 0x7f58a4070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.586+0000 7f58a88a3700 1 --2- 172.21.15.59:0/2846036001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a4131630 0x7f58a406fb50 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.586+0000 7f58a88a3700 1 -- 172.21.15.59:0/2846036001 >> 172.21.15.59:0/2846036001 conn(0x7f58a40a2aa0 msgr2=0x7f58a409d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:40.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.586+0000 7f58a88a3700 1 -- 172.21.15.59:0/2846036001 shutdown_connections 2023-09-30T22:31:40.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.586+0000 7f58a88a3700 1 -- 172.21.15.59:0/2846036001 wait complete. 2023-09-30T22:31:40.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:40.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.676+0000 7f61808ca700 1 -- 172.21.15.59:0/2519172268 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f617c071d20 con 0x7f617c099a40 2023-09-30T22:31:40.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.677+0000 7f616affd700 1 -- 172.21.15.59:0/2519172268 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f616c01b3b0 con 0x7f617c099a40 2023-09-30T22:31:40.677 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.679+0000 7f61808ca700 1 -- 172.21.15.59:0/2519172268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f617c099a40 msgr2=0x7f617c1c6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.679+0000 7f61808ca700 1 --2- 172.21.15.59:0/2519172268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f617c099a40 0x7f617c1c6200 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f616c00ea10 tx=0x7f616c00ed20 comp rx=0 tx=0).stop 2023-09-30T22:31:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.679+0000 7f61808ca700 1 -- 172.21.15.59:0/2519172268 shutdown_connections 2023-09-30T22:31:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.679+0000 7f61808ca700 1 --2- 172.21.15.59:0/2519172268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f617c099a40 0x7f617c1c6200 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.679+0000 7f61808ca700 1 --2- 172.21.15.59:0/2519172268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f617c131810 0x7f617c1c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.679+0000 7f61808ca700 1 --2- 172.21.15.59:0/2519172268 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f617c09a3b0 0x7f617c1c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.679+0000 7f61808ca700 1 -- 172.21.15.59:0/2519172268 >> 172.21.15.59:0/2519172268 conn(0x7f617c0a2aa0 msgr2=0x7f617c12e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.679+0000 7f61808ca700 1 -- 172.21.15.59:0/2519172268 shutdown_connections 2023-09-30T22:31:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.679+0000 7f61808ca700 1 -- 172.21.15.59:0/2519172268 wait complete. 2023-09-30T22:31:40.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:40.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.713+0000 7f170e8bf700 1 -- 172.21.15.59:0/2957957800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f170804ea50 con 0x7f170809e930 2023-09-30T22:31:40.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.714+0000 7f1704ff9700 1 -- 172.21.15.59:0/2957957800 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16f8017070 con 0x7f170809e930 2023-09-30T22:31:40.714 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:40.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.716+0000 7f170e8bf700 1 -- 172.21.15.59:0/2957957800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170809e930 msgr2=0x7f170806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.716+0000 7f170e8bf700 1 --2- 172.21.15.59:0/2957957800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170809e930 0x7f170806b8b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f16f800e9e0 tx=0x7f16f800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.716+0000 7f170e8bf700 1 -- 172.21.15.59:0/2957957800 shutdown_connections 2023-09-30T22:31:40.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.716+0000 7f170e8bf700 1 --2- 172.21.15.59:0/2957957800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170809f650 0x7f170806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.716+0000 7f170e8bf700 1 --2- 172.21.15.59:0/2957957800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170809e930 0x7f170806b8b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.716+0000 7f170e8bf700 1 --2- 172.21.15.59:0/2957957800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170809f240 0x7f170806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.716+0000 7f170e8bf700 1 -- 172.21.15.59:0/2957957800 >> 172.21.15.59:0/2957957800 conn(0x7f17080a4210 msgr2=0x7f17081b8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:40.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.716+0000 7f170e8bf700 1 -- 172.21.15.59:0/2957957800 shutdown_connections 2023-09-30T22:31:40.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.716+0000 7f170e8bf700 1 -- 172.21.15.59:0/2957957800 wait complete. 2023-09-30T22:31:40.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:40.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.758+0000 7efeb2841700 1 -- 172.21.15.59:0/1647653175 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efeac074ea0 con 0x7efeac135e50 2023-09-30T22:31:40.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.758+0000 7efea8ff9700 1 -- 172.21.15.59:0/1647653175 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efea402b090 con 0x7efeac135e50 2023-09-30T22:31:40.759 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.760+0000 7efeb2841700 1 -- 172.21.15.59:0/1647653175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeac135e50 msgr2=0x7efeac1c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.760+0000 7efeb2841700 1 --2- 172.21.15.59:0/1647653175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeac135e50 0x7efeac1c80e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7efea4009e30 tx=0x7efea400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.760+0000 7efeb2841700 1 -- 172.21.15.59:0/1647653175 shutdown_connections 2023-09-30T22:31:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.760+0000 7efeb2841700 1 --2- 172.21.15.59:0/1647653175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeac135e50 0x7efeac1c80e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.760+0000 7efeb2841700 1 --2- 172.21.15.59:0/1647653175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeac09d6f0 0x7efeac11e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.760+0000 7efeb2841700 1 --2- 172.21.15.59:0/1647653175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeac09e1d0 0x7efeac11e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.761+0000 7efeb2841700 1 -- 172.21.15.59:0/1647653175 >> 172.21.15.59:0/1647653175 conn(0x7efeac066f50 msgr2=0x7efeac1328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.761+0000 7efeb2841700 1 -- 172.21.15.59:0/1647653175 shutdown_connections 2023-09-30T22:31:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:40.761+0000 7efeb2841700 1 -- 172.21.15.59:0/1647653175 wait complete. 2023-09-30T22:31:40.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:41.602 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:41.699 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:41.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:41.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.749+0000 7f6d22c0d700 1 Processor -- start 2023-09-30T22:31:41.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.749+0000 7f6d22c0d700 1 -- start start 2023-09-30T22:31:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.749+0000 7f6d22c0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09d6f0 0x7f6d1c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.749+0000 7f6d22c0d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d1c09e000 0x7f6d1c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.749+0000 7f6d22c0d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d1c09b120 con 0x7f6d1c09e410 2023-09-30T22:31:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.750+0000 7f6d22c0d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d1c06b460 con 0x7f6d1c09e000 2023-09-30T22:31:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.750+0000 7f6d22c0d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c09a7e0 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.750+0000 7f6d209a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09d6f0 0x7f6d1c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.750+0000 7f6d209a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09d6f0 0x7f6d1c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42132/0 (socket says 172.21.15.59:42132) 2023-09-30T22:31:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.750+0000 7f6d209a9700 1 -- 172.21.15.59:0/3107184396 learned_addr learned my addr 172.21.15.59:0/3107184396 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.750+0000 7f6d1bfff700 1 --2- 172.21.15.59:0/3107184396 >> v2:172.21.15.59:3300/0 conn(0x7f6d1c09e000 0x7f6d1c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.750+0000 7f6d209a9700 1 -- 172.21.15.59:0/3107184396 >> v2:172.21.15.59:3300/0 conn(0x7f6d1c09e000 msgr2=0x7f6d1c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.750+0000 7f6d209a9700 1 --2- 172.21.15.59:0/3107184396 >> v2:172.21.15.59:3300/0 conn(0x7f6d1c09e000 0x7f6d1c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.750+0000 7f6d209a9700 1 -- 172.21.15.59:0/3107184396 >> v1:172.21.15.59:6789/0 conn(0x7f6d1c09e410 legacy=0x7f6d1c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.750+0000 7f6d209a9700 1 -- 172.21.15.59:0/3107184396 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c09a500 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.750+0000 7f6d1bfff700 1 --2- 172.21.15.59:0/3107184396 >> v2:172.21.15.59:3300/0 conn(0x7f6d1c09e000 0x7f6d1c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.750+0000 7f6d209a9700 1 --2- 172.21.15.59:0/3107184396 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09d6f0 0x7f6d1c09dac0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009920 tx=0x7f6d10009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f6e4a3d85df91d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.751+0000 7f6d1b7fe700 1 -- 172.21.15.59:0/3107184396 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10011830 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.751+0000 7f6d1b7fe700 1 -- 172.21.15.59:0/3107184396 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d10011990 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.751+0000 7f6d1b7fe700 1 -- 172.21.15.59:0/3107184396 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10011d20 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.751+0000 7f6d22c0d700 1 -- 172.21.15.59:0/3107184396 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09d6f0 msgr2=0x7f6d1c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.751+0000 7f6d22c0d700 1 --2- 172.21.15.59:0/3107184396 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09d6f0 0x7f6d1c09dac0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009920 tx=0x7f6d10009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:41.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.751+0000 7f6d22c0d700 1 -- 172.21.15.59:0/3107184396 shutdown_connections 2023-09-30T22:31:41.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.751+0000 7f6d22c0d700 1 --2- 172.21.15.59:0/3107184396 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09d6f0 0x7f6d1c09dac0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.751+0000 7f6d22c0d700 1 --2- 172.21.15.59:0/3107184396 >> v2:172.21.15.59:3300/0 conn(0x7f6d1c09e000 0x7f6d1c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.751+0000 7f6d22c0d700 1 -- 172.21.15.59:0/3107184396 >> 172.21.15.59:0/3107184396 conn(0x7f6d1c066f50 msgr2=0x7f6d1c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:41.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.751+0000 7f6d22c0d700 1 -- 172.21.15.59:0/3107184396 shutdown_connections 2023-09-30T22:31:41.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.752+0000 7f6d22c0d700 1 -- 172.21.15.59:0/3107184396 wait complete. 2023-09-30T22:31:41.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.753+0000 7f6d22c0d700 1 Processor -- start 2023-09-30T22:31:41.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.753+0000 7f6d22c0d700 1 -- start start 2023-09-30T22:31:41.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.753+0000 7f6d22c0d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c09d6f0 0x7f6d1c1a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.753+0000 7f6d22c0d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c09e000 0x7f6d1c1a6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.753+0000 7f6d22c0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09e410 0x7f6d1c1a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.753+0000 7f6d22c0d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c1a7cb0 con 0x7f6d1c09e000 2023-09-30T22:31:41.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.753+0000 7f6d22c0d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c1a9820 con 0x7f6d1c09e410 2023-09-30T22:31:41.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.753+0000 7f6d22c0d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c0a3380 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.754+0000 7f6d1bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c09e000 0x7f6d1c1a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.754+0000 7f6d1bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c09e000 0x7f6d1c1a6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53976/0 (socket says 172.21.15.59:53976) 2023-09-30T22:31:41.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.754+0000 7f6d1bfff700 1 -- 172.21.15.59:0/220990019 learned_addr learned my addr 172.21.15.59:0/220990019 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:41.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.754+0000 7f6d209a9700 1 --2- 172.21.15.59:0/220990019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c09d6f0 0x7f6d1c1a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.754+0000 7f6d211aa700 1 --2- 172.21.15.59:0/220990019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09e410 0x7f6d1c1a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.754+0000 7f6d209a9700 1 -- 172.21.15.59:0/220990019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09e410 msgr2=0x7f6d1c1a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.754+0000 7f6d209a9700 1 --2- 172.21.15.59:0/220990019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09e410 0x7f6d1c1a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.754+0000 7f6d209a9700 1 -- 172.21.15.59:0/220990019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c09e000 msgr2=0x7f6d1c1a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.754+0000 7f6d209a9700 1 --2- 172.21.15.59:0/220990019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c09e000 0x7f6d1c1a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.754+0000 7f6d209a9700 1 -- 172.21.15.59:0/220990019 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d080094a0 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.754+0000 7f6d1bfff700 1 --2- 172.21.15.59:0/220990019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c09e000 0x7f6d1c1a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:41.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.754+0000 7f6d211aa700 1 --2- 172.21.15.59:0/220990019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09e410 0x7f6d1c1a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:41.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.754+0000 7f6d209a9700 1 --2- 172.21.15.59:0/220990019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c09d6f0 0x7f6d1c1a60f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c09ac00 tx=0x7f6d10004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.755+0000 7f6d197fa700 1 -- 172.21.15.59:0/220990019 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10004450 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.755+0000 7f6d197fa700 1 -- 172.21.15.59:0/220990019 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d100036a0 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.755+0000 7f6d22c0d700 1 -- 172.21.15.59:0/220990019 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d10009550 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.755+0000 7f6d197fa700 1 -- 172.21.15.59:0/220990019 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d100045f0 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.755+0000 7f6d22c0d700 1 -- 172.21.15.59:0/220990019 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1c1a8330 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.756+0000 7f6d197fa700 1 -- 172.21.15.59:0/220990019 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d10003a50 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.756+0000 7f6d197fa700 1 -- 172.21.15.59:0/220990019 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6d10021030 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.756+0000 7f6d22c0d700 1 -- 172.21.15.59:0/220990019 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1c074ea0 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.765+0000 7f6d197fa700 1 -- 172.21.15.59:0/220990019 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d10015070 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.775 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:41.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.857+0000 7fd4c33a9700 1 Processor -- start 2023-09-30T22:31:41.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.857+0000 7fd4c33a9700 1 -- start start 2023-09-30T22:31:41.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.858+0000 7fd4c33a9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4bc0a0a30 0x7fd4bc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.858+0000 7fd4c33a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09d630 0x7fd4bc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.858+0000 7fd4c33a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc133930 0x7fd4bc133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.858+0000 7fd4c33a9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc0a2a70 con 0x7fd4bc0a0a30 2023-09-30T22:31:41.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.858+0000 7fd4c33a9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0a01d0 con 0x7fd4bc09d630 2023-09-30T22:31:41.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.858+0000 7fd4c33a9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc09e2b0 con 0x7fd4bc133930 2023-09-30T22:31:41.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.858+0000 7fd4c0944700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09d630 0x7fd4bc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.858+0000 7fd4c1145700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4bc0a0a30 0x7fd4bc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.858+0000 7fd4c0944700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09d630 0x7fd4bc0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42158/0 (socket says 172.21.15.59:42158) 2023-09-30T22:31:41.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.858+0000 7fd4c0944700 1 -- 172.21.15.59:0/3806468109 learned_addr learned my addr 172.21.15.59:0/3806468109 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:41.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.858+0000 7fd4c1946700 1 --2- 172.21.15.59:0/3806468109 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc133930 0x7fd4bc133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.859+0000 7fd4c0944700 1 -- 172.21.15.59:0/3806468109 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc133930 msgr2=0x7fd4bc133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:41.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.859+0000 7fd4c0944700 1 --2- 172.21.15.59:0/3806468109 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc133930 0x7fd4bc133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.859+0000 7fd4c0944700 1 -- 172.21.15.59:0/3806468109 >> v2:172.21.15.59:3300/0 conn(0x7fd4bc0a0a30 msgr2=0x7fd4bc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:41.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.859+0000 7fd4c0944700 1 --2- 172.21.15.59:0/3806468109 >> v2:172.21.15.59:3300/0 conn(0x7fd4bc0a0a30 0x7fd4bc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.859+0000 7fd4c0944700 1 -- 172.21.15.59:0/3806468109 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc09dc50 con 0x7fd4bc09d630 2023-09-30T22:31:41.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.859+0000 7fd4c1145700 1 --2- 172.21.15.59:0/3806468109 >> v2:172.21.15.59:3300/0 conn(0x7fd4bc0a0a30 0x7fd4bc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:41.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.859+0000 7fd4c0944700 1 --2- 172.21.15.59:0/3806468109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09d630 0x7fd4bc0a1340 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0098f0 tx=0x7fd4ac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=736e926af2e61ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.859+0000 7fd4b3fff700 1 -- 172.21.15.59:0/3806468109 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac011830 con 0x7fd4bc09d630 2023-09-30T22:31:41.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.859+0000 7fd4b3fff700 1 -- 172.21.15.59:0/3806468109 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac011990 con 0x7fd4bc09d630 2023-09-30T22:31:41.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.859+0000 7fd4b3fff700 1 -- 172.21.15.59:0/3806468109 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac011d20 con 0x7fd4bc09d630 2023-09-30T22:31:41.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.860+0000 7fd4c33a9700 1 -- 172.21.15.59:0/3806468109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09d630 msgr2=0x7fd4bc0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.860+0000 7fd4c33a9700 1 --2- 172.21.15.59:0/3806468109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09d630 0x7fd4bc0a1340 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0098f0 tx=0x7fd4ac009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:41.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.860+0000 7fd4c33a9700 1 -- 172.21.15.59:0/3806468109 shutdown_connections 2023-09-30T22:31:41.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.860+0000 7fd4c33a9700 1 --2- 172.21.15.59:0/3806468109 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc133930 0x7fd4bc133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.860+0000 7fd4c33a9700 1 --2- 172.21.15.59:0/3806468109 >> v2:172.21.15.59:3300/0 conn(0x7fd4bc0a0a30 0x7fd4bc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.860+0000 7fd4c33a9700 1 --2- 172.21.15.59:0/3806468109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09d630 0x7fd4bc0a1340 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.860+0000 7fd4c33a9700 1 -- 172.21.15.59:0/3806468109 >> 172.21.15.59:0/3806468109 conn(0x7fd4bc0a3050 msgr2=0x7fd4bc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:41.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.860+0000 7fd4c33a9700 1 -- 172.21.15.59:0/3806468109 shutdown_connections 2023-09-30T22:31:41.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.860+0000 7fd4c33a9700 1 -- 172.21.15.59:0/3806468109 wait complete. 2023-09-30T22:31:41.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.862+0000 7fd4c33a9700 1 Processor -- start 2023-09-30T22:31:41.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.862+0000 7fd4c33a9700 1 -- start start 2023-09-30T22:31:41.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.862+0000 7fd4c33a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09d630 0x7fd4bc11f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.862+0000 7fd4c33a9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc0a0a30 0x7fd4bc11fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.862+0000 7fd4c33a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc133930 0x7fd4bc1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.862+0000 7fd4c33a9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc121fa0 con 0x7fd4bc0a0a30 2023-09-30T22:31:41.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.862+0000 7fd4c33a9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc122640 con 0x7fd4bc09d630 2023-09-30T22:31:41.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.862+0000 7fd4c33a9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc11ef70 con 0x7fd4bc133930 2023-09-30T22:31:41.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.863+0000 7fd4c1946700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc133930 0x7fd4bc1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.863+0000 7fd4c1946700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc133930 0x7fd4bc1c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52882/0 (socket says 172.21.15.59:52882) 2023-09-30T22:31:41.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.863+0000 7fd4c1946700 1 -- 172.21.15.59:0/3418759674 learned_addr learned my addr 172.21.15.59:0/3418759674 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:41.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.863+0000 7fd4c1145700 1 --2- 172.21.15.59:0/3418759674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09d630 0x7fd4bc11f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.863+0000 7fd4c0944700 1 --2- 172.21.15.59:0/3418759674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc0a0a30 0x7fd4bc11fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.863+0000 7fd4c1946700 1 -- 172.21.15.59:0/3418759674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09d630 msgr2=0x7fd4bc11f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.863+0000 7fd4c1946700 1 --2- 172.21.15.59:0/3418759674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09d630 0x7fd4bc11f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.863+0000 7fd4c1946700 1 -- 172.21.15.59:0/3418759674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc0a0a30 msgr2=0x7fd4bc11fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.863+0000 7fd4c1946700 1 --2- 172.21.15.59:0/3418759674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc0a0a30 0x7fd4bc11fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.863+0000 7fd4c1946700 1 -- 172.21.15.59:0/3418759674 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b80094a0 con 0x7fd4bc133930 2023-09-30T22:31:41.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.863+0000 7fd4c0944700 1 --2- 172.21.15.59:0/3418759674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc0a0a30 0x7fd4bc11fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:41.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.863+0000 7fd4c1946700 1 --2- 172.21.15.59:0/3418759674 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc133930 0x7fd4bc1c8090 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400efc0 tx=0x7fd4b400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.864+0000 7fd4b1ffb700 1 -- 172.21.15.59:0/3418759674 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4009ea0 con 0x7fd4bc133930 2023-09-30T22:31:41.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.864+0000 7fd4b1ffb700 1 -- 172.21.15.59:0/3418759674 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b400f040 con 0x7fd4bc133930 2023-09-30T22:31:41.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.864+0000 7fd4b1ffb700 1 -- 172.21.15.59:0/3418759674 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4014480 con 0x7fd4bc133930 2023-09-30T22:31:41.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.865+0000 7fd4c33a9700 1 -- 172.21.15.59:0/3418759674 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac009550 con 0x7fd4bc133930 2023-09-30T22:31:41.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.865+0000 7fd4c33a9700 1 -- 172.21.15.59:0/3418759674 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc0a0410 con 0x7fd4bc133930 2023-09-30T22:31:41.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.866+0000 7fd4b1ffb700 1 -- 172.21.15.59:0/3418759674 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd4b40145e0 con 0x7fd4bc133930 2023-09-30T22:31:41.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.866+0000 7fd4b1ffb700 1 -- 172.21.15.59:0/3418759674 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd4b4040040 con 0x7fd4bc133930 2023-09-30T22:31:41.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.866+0000 7fd4c33a9700 1 -- 172.21.15.59:0/3418759674 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc0747f0 con 0x7fd4bc133930 2023-09-30T22:31:41.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.871+0000 7fd4b1ffb700 1 -- 172.21.15.59:0/3418759674 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4b40248f0 con 0x7fd4bc133930 2023-09-30T22:31:41.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.895+0000 7fa46359e700 1 Processor -- start 2023-09-30T22:31:41.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.895+0000 7fa46359e700 1 -- start start 2023-09-30T22:31:41.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.896+0000 7fa46359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa46409e2e0 0x7fa464138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.896+0000 7fa46359e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa464138fe0 0x7fa46413b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.896+0000 7fa46359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa464099e10 con 0x7fa46409d800 2023-09-30T22:31:41.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.896+0000 7fa46359e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46409f560 con 0x7fa46409e2e0 2023-09-30T22:31:41.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.896+0000 7fa46359e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa46406b4d0 con 0x7fa464138fe0 2023-09-30T22:31:41.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.896+0000 7fa461d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa46409e2e0 0x7fa464138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.896+0000 7fa461d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa46409e2e0 0x7fa464138aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54000/0 (socket says 172.21.15.59:54000) 2023-09-30T22:31:41.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.896+0000 7fa461d9b700 1 -- 172.21.15.59:0/1675993475 learned_addr learned my addr 172.21.15.59:0/1675993475 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:41.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.897+0000 7fa462d9d700 1 --2- 172.21.15.59:0/1675993475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa464138fe0 0x7fa46413b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.897+0000 7fa461d9b700 1 -- 172.21.15.59:0/1675993475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa464138fe0 msgr2=0x7fa46413b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:41.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.897+0000 7fa461d9b700 1 --2- 172.21.15.59:0/1675993475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa464138fe0 0x7fa46413b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.897+0000 7fa461d9b700 1 -- 172.21.15.59:0/1675993475 >> v1:172.21.15.59:6789/0 conn(0x7fa46409d800 legacy=0x7fa46409dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.897+0000 7fa461d9b700 1 -- 172.21.15.59:0/1675993475 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46409a060 con 0x7fa46409e2e0 2023-09-30T22:31:41.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.897+0000 7fa462d9d700 1 --2- 172.21.15.59:0/1675993475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa464138fe0 0x7fa46413b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:41.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.897+0000 7fa461d9b700 1 --2- 172.21.15.59:0/1675993475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46409e2e0 0x7fa464138aa0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa458006fd0 tx=0x7fa458009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecb50f1d1329360 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.897+0000 7fa46159a700 1 -- 172.21.15.59:0/1675993475 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa458005e30 con 0x7fa46409e2e0 2023-09-30T22:31:41.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.897+0000 7fa46159a700 1 -- 172.21.15.59:0/1675993475 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa458004030 con 0x7fa46409e2e0 2023-09-30T22:31:41.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.897+0000 7fa46159a700 1 -- 172.21.15.59:0/1675993475 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4580043e0 con 0x7fa46409e2e0 2023-09-30T22:31:41.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.898+0000 7fa46359e700 1 -- 172.21.15.59:0/1675993475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46409e2e0 msgr2=0x7fa464138aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.898+0000 7fa46359e700 1 --2- 172.21.15.59:0/1675993475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46409e2e0 0x7fa464138aa0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa458006fd0 tx=0x7fa458009bd0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.898+0000 7fa46359e700 1 -- 172.21.15.59:0/1675993475 shutdown_connections 2023-09-30T22:31:41.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.898+0000 7fa46359e700 1 --2- 172.21.15.59:0/1675993475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa464138fe0 0x7fa46413b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.898+0000 7fa46359e700 1 --2- 172.21.15.59:0/1675993475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46409e2e0 0x7fa464138aa0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.898+0000 7fa46359e700 1 -- 172.21.15.59:0/1675993475 >> 172.21.15.59:0/1675993475 conn(0x7fa4640a2e20 msgr2=0x7fa4640a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:41.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.898+0000 7fa46359e700 1 -- 172.21.15.59:0/1675993475 shutdown_connections 2023-09-30T22:31:41.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.898+0000 7fa46359e700 1 -- 172.21.15.59:0/1675993475 wait complete. 2023-09-30T22:31:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.900+0000 7fa46359e700 1 Processor -- start 2023-09-30T22:31:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.900+0000 7fa46359e700 1 -- start start 2023-09-30T22:31:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa46359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46409d800 0x7fa46411e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa46359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46409e2e0 0x7fa46411ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa46359e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa464138fe0 0x7fa46411f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa46359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4640a1b50 con 0x7fa46409d800 2023-09-30T22:31:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa46359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4641203a0 con 0x7fa46409e2e0 2023-09-30T22:31:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa46359e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa46409c510 con 0x7fa464138fe0 2023-09-30T22:31:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa46259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46409d800 0x7fa46411e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa46259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46409d800 0x7fa46411e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54006/0 (socket says 172.21.15.59:54006) 2023-09-30T22:31:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa46259c700 1 -- 172.21.15.59:0/1140393336 learned_addr learned my addr 172.21.15.59:0/1140393336 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa462d9d700 1 --2- 172.21.15.59:0/1140393336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa464138fe0 0x7fa46411f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa46259c700 1 -- 172.21.15.59:0/1140393336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa464138fe0 msgr2=0x7fa46411f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa46259c700 1 --2- 172.21.15.59:0/1140393336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa464138fe0 0x7fa46411f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa46259c700 1 -- 172.21.15.59:0/1140393336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46409e2e0 msgr2=0x7fa46411ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa46259c700 1 --2- 172.21.15.59:0/1140393336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46409e2e0 0x7fa46411ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa46259c700 1 -- 172.21.15.59:0/1140393336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c009a70 con 0x7fa46409d800 2023-09-30T22:31:41.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.901+0000 7fa46259c700 1 --2- 172.21.15.59:0/1140393336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46409d800 0x7fa46411e6f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa45400c4e0 tx=0x7fa45400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.902+0000 7fa452ffd700 1 -- 172.21.15.59:0/1140393336 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4540052d0 con 0x7fa46409d800 2023-09-30T22:31:41.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.902+0000 7fa452ffd700 1 -- 172.21.15.59:0/1140393336 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa454005430 con 0x7fa46409d800 2023-09-30T22:31:41.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.902+0000 7fa452ffd700 1 -- 172.21.15.59:0/1140393336 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4540038c0 con 0x7fa46409d800 2023-09-30T22:31:41.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.902+0000 7fa46359e700 1 -- 172.21.15.59:0/1140393336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa458009500 con 0x7fa46409d800 2023-09-30T22:31:41.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.902+0000 7fa46359e700 1 -- 172.21.15.59:0/1140393336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa464120ad0 con 0x7fa46409d800 2023-09-30T22:31:41.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.903+0000 7fa46359e700 1 -- 172.21.15.59:0/1140393336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46404f2a0 con 0x7fa46409d800 2023-09-30T22:31:41.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.904+0000 7fa452ffd700 1 -- 172.21.15.59:0/1140393336 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa454003a20 con 0x7fa46409d800 2023-09-30T22:31:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.904+0000 7fa452ffd700 1 -- 172.21.15.59:0/1140393336 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa45403ed60 con 0x7fa46409d800 2023-09-30T22:31:41.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.912+0000 7fa452ffd700 1 -- 172.21.15.59:0/1140393336 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa454010cb0 con 0x7fa46409d800 2023-09-30T22:31:41.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.932+0000 7f51b6262700 1 Processor -- start 2023-09-30T22:31:41.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.932+0000 7f51b6262700 1 -- start start 2023-09-30T22:31:41.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.932+0000 7f51b6262700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b006f5d0 0x7f51b012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.932+0000 7f51b6262700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51b0135c20 0x7f51b0138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.932+0000 7f51b6262700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b006fa40 con 0x7f51b012cf60 2023-09-30T22:31:41.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.932+0000 7f51b6262700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b012cd90 con 0x7f51b0135c20 2023-09-30T22:31:41.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.932+0000 7f51b6262700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51b0071780 con 0x7f51b006f5d0 2023-09-30T22:31:41.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.932+0000 7f51aeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b006f5d0 0x7f51b012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.932+0000 7f51aeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b006f5d0 0x7f51b012ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52902/0 (socket says 172.21.15.59:52902) 2023-09-30T22:31:41.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.932+0000 7f51aeffd700 1 -- 172.21.15.59:0/1496044858 learned_addr learned my addr 172.21.15.59:0/1496044858 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:41.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.933+0000 7f51affff700 1 --2- 172.21.15.59:0/1496044858 >> v2:172.21.15.59:3300/0 conn(0x7f51b0135c20 0x7f51b0138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.933+0000 7f51aeffd700 1 -- 172.21.15.59:0/1496044858 >> v2:172.21.15.59:3300/0 conn(0x7f51b0135c20 msgr2=0x7f51b0138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:41.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.933+0000 7f51aeffd700 1 --2- 172.21.15.59:0/1496044858 >> v2:172.21.15.59:3300/0 conn(0x7f51b0135c20 0x7f51b0138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.933+0000 7f51aeffd700 1 -- 172.21.15.59:0/1496044858 >> v1:172.21.15.59:6789/0 conn(0x7f51b012cf60 legacy=0x7f51b012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.933+0000 7f51aeffd700 1 -- 172.21.15.59:0/1496044858 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b0071a40 con 0x7f51b006f5d0 2023-09-30T22:31:41.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.933+0000 7f51aeffd700 1 --2- 172.21.15.59:0/1496044858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b006f5d0 0x7f51b012ffc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f51a40098f0 tx=0x7f51a4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1098d40280aae2e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.933+0000 7f51ae7fc700 1 -- 172.21.15.59:0/1496044858 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a4011830 con 0x7f51b006f5d0 2023-09-30T22:31:41.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.934+0000 7f51ae7fc700 1 -- 172.21.15.59:0/1496044858 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a4011990 con 0x7f51b006f5d0 2023-09-30T22:31:41.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.934+0000 7f51ae7fc700 1 -- 172.21.15.59:0/1496044858 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a4011d20 con 0x7f51b006f5d0 2023-09-30T22:31:41.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.934+0000 7f51b6262700 1 -- 172.21.15.59:0/1496044858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b006f5d0 msgr2=0x7f51b012ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.934+0000 7f51b6262700 1 --2- 172.21.15.59:0/1496044858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b006f5d0 0x7f51b012ffc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f51a40098f0 tx=0x7f51a4009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:41.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.934+0000 7f51b6262700 1 -- 172.21.15.59:0/1496044858 shutdown_connections 2023-09-30T22:31:41.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.934+0000 7f51b6262700 1 --2- 172.21.15.59:0/1496044858 >> v2:172.21.15.59:3300/0 conn(0x7f51b0135c20 0x7f51b0138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.934+0000 7f51b6262700 1 --2- 172.21.15.59:0/1496044858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b006f5d0 0x7f51b012ffc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.934+0000 7f51b6262700 1 -- 172.21.15.59:0/1496044858 >> 172.21.15.59:0/1496044858 conn(0x7f51b00a2aa0 msgr2=0x7f51b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:41.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.934+0000 7f51b6262700 1 -- 172.21.15.59:0/1496044858 shutdown_connections 2023-09-30T22:31:41.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.934+0000 7f51b6262700 1 -- 172.21.15.59:0/1496044858 wait complete. 2023-09-30T22:31:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.936+0000 7f51b6262700 1 Processor -- start 2023-09-30T22:31:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.936+0000 7f51b6262700 1 -- start start 2023-09-30T22:31:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.937+0000 7f51b6262700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b006f5d0 0x7f51b009a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.937+0000 7f51b6262700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b012cf60 0x7f51b009a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.937+0000 7f51b6262700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b0135c20 0x7f51b009aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.937+0000 7f51b6262700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b009d660 con 0x7f51b012cf60 2023-09-30T22:31:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.937+0000 7f51b6262700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b0129fa0 con 0x7f51b006f5d0 2023-09-30T22:31:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.937+0000 7f51b6262700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51b009c6c0 con 0x7f51b0135c20 2023-09-30T22:31:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.937+0000 7f51affff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b0135c20 0x7f51b009aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.937+0000 7f51affff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b0135c20 0x7f51b009aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52904/0 (socket says 172.21.15.59:52904) 2023-09-30T22:31:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.937+0000 7f51affff700 1 -- 172.21.15.59:0/3035856406 learned_addr learned my addr 172.21.15.59:0/3035856406 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.937+0000 7f51af7fe700 1 --2- 172.21.15.59:0/3035856406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b006f5d0 0x7f51b009a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.937+0000 7f51aeffd700 1 --2- 172.21.15.59:0/3035856406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b012cf60 0x7f51b009a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.938+0000 7f51affff700 1 -- 172.21.15.59:0/3035856406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b006f5d0 msgr2=0x7f51b009a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.938+0000 7f51affff700 1 --2- 172.21.15.59:0/3035856406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b006f5d0 0x7f51b009a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.938+0000 7f51affff700 1 -- 172.21.15.59:0/3035856406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b012cf60 msgr2=0x7f51b009a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.938+0000 7f51affff700 1 --2- 172.21.15.59:0/3035856406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b012cf60 0x7f51b009a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.938+0000 7f51affff700 1 -- 172.21.15.59:0/3035856406 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a4009550 con 0x7f51b0135c20 2023-09-30T22:31:41.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.938+0000 7f51aeffd700 1 --2- 172.21.15.59:0/3035856406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b012cf60 0x7f51b009a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:41.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.938+0000 7f51affff700 1 --2- 172.21.15.59:0/3035856406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b0135c20 0x7f51b009aca0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f51a800efc0 tx=0x7f51a800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.938+0000 7f5197fff700 1 -- 172.21.15.59:0/3035856406 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a800cd40 con 0x7f51b0135c20 2023-09-30T22:31:41.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.938+0000 7f5197fff700 1 -- 172.21.15.59:0/3035856406 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a800f040 con 0x7f51b0135c20 2023-09-30T22:31:41.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.938+0000 7f5197fff700 1 -- 172.21.15.59:0/3035856406 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a80146c0 con 0x7f51b0135c20 2023-09-30T22:31:41.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.938+0000 7f51b6262700 1 -- 172.21.15.59:0/3035856406 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b00a1650 con 0x7f51b0135c20 2023-09-30T22:31:41.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.938+0000 7f51b6262700 1 -- 172.21.15.59:0/3035856406 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b0131880 con 0x7f51b0135c20 2023-09-30T22:31:41.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.940+0000 7f51b6262700 1 -- 172.21.15.59:0/3035856406 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b009b520 con 0x7f51b0135c20 2023-09-30T22:31:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.940+0000 7f5197fff700 1 -- 172.21.15.59:0/3035856406 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51a8014820 con 0x7f51b0135c20 2023-09-30T22:31:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.940+0000 7f5197fff700 1 -- 172.21.15.59:0/3035856406 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f51a80401a0 con 0x7f51b0135c20 2023-09-30T22:31:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.949+0000 7f5197fff700 1 -- 172.21.15.59:0/3035856406 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51a8014ad0 con 0x7f51b0135c20 2023-09-30T22:31:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.998+0000 7f6d22c0d700 1 -- 172.21.15.59:0/220990019 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6d1c1a9b60 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:41.998+0000 7f6d197fa700 1 -- 172.21.15.59:0/220990019 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d1002b020 con 0x7f6d1c09d6f0 2023-09-30T22:31:41.998 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.001+0000 7f6d22c0d700 1 -- 172.21.15.59:0/220990019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c09d6f0 msgr2=0x7f6d1c1a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.001+0000 7f6d22c0d700 1 --2- 172.21.15.59:0/220990019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c09d6f0 0x7f6d1c1a60f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c09ac00 tx=0x7f6d10004750 comp rx=0 tx=0).stop 2023-09-30T22:31:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.001+0000 7f6d22c0d700 1 -- 172.21.15.59:0/220990019 shutdown_connections 2023-09-30T22:31:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.001+0000 7f6d22c0d700 1 --2- 172.21.15.59:0/220990019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c09d6f0 0x7f6d1c1a60f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.001+0000 7f6d22c0d700 1 --2- 172.21.15.59:0/220990019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09e410 0x7f6d1c1a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.001+0000 7f6d22c0d700 1 --2- 172.21.15.59:0/220990019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c09e000 0x7f6d1c1a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.001+0000 7f6d22c0d700 1 -- 172.21.15.59:0/220990019 >> 172.21.15.59:0/220990019 conn(0x7f6d1c066f50 msgr2=0x7f6d1c1baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:42.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.001+0000 7f6d22c0d700 1 -- 172.21.15.59:0/220990019 shutdown_connections 2023-09-30T22:31:42.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.001+0000 7f6d22c0d700 1 -- 172.21.15.59:0/220990019 wait complete. 2023-09-30T22:31:42.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:42.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.085+0000 7fd4c33a9700 1 -- 172.21.15.59:0/3418759674 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd4bc072980 con 0x7fd4bc133930 2023-09-30T22:31:42.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.086+0000 7fd4b1ffb700 1 -- 172.21.15.59:0/3418759674 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd4b402b090 con 0x7fd4bc133930 2023-09-30T22:31:42.086 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:42.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.088+0000 7fd4c33a9700 1 -- 172.21.15.59:0/3418759674 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc133930 msgr2=0x7fd4bc1c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.088+0000 7fd4c33a9700 1 --2- 172.21.15.59:0/3418759674 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc133930 0x7fd4bc1c8090 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400efc0 tx=0x7fd4b400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.088+0000 7fd4c33a9700 1 -- 172.21.15.59:0/3418759674 shutdown_connections 2023-09-30T22:31:42.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.088+0000 7fd4c33a9700 1 --2- 172.21.15.59:0/3418759674 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc133930 0x7fd4bc1c8090 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.088+0000 7fd4c33a9700 1 --2- 172.21.15.59:0/3418759674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09d630 0x7fd4bc11f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.088+0000 7fd4c33a9700 1 --2- 172.21.15.59:0/3418759674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc0a0a30 0x7fd4bc11fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.088+0000 7fd4c33a9700 1 -- 172.21.15.59:0/3418759674 >> 172.21.15.59:0/3418759674 conn(0x7fd4bc0a3050 msgr2=0x7fd4bc1bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:42.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.088+0000 7fd4c33a9700 1 -- 172.21.15.59:0/3418759674 shutdown_connections 2023-09-30T22:31:42.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.088+0000 7fd4c33a9700 1 -- 172.21.15.59:0/3418759674 wait complete. 2023-09-30T22:31:42.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:42.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.121+0000 7fa46359e700 1 -- 172.21.15.59:0/1140393336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa46409a260 con 0x7fa46409d800 2023-09-30T22:31:42.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.122+0000 7fa452ffd700 1 -- 172.21.15.59:0/1140393336 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa454017070 con 0x7fa46409d800 2023-09-30T22:31:42.122 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.124+0000 7fa46359e700 1 -- 172.21.15.59:0/1140393336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46409d800 msgr2=0x7fa46411e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.124+0000 7fa46359e700 1 --2- 172.21.15.59:0/1140393336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46409d800 0x7fa46411e6f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa45400c4e0 tx=0x7fa45400c8a0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.124+0000 7fa46359e700 1 -- 172.21.15.59:0/1140393336 shutdown_connections 2023-09-30T22:31:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.124+0000 7fa46359e700 1 --2- 172.21.15.59:0/1140393336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa464138fe0 0x7fa46411f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.124+0000 7fa46359e700 1 --2- 172.21.15.59:0/1140393336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46409d800 0x7fa46411e6f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.124+0000 7fa46359e700 1 --2- 172.21.15.59:0/1140393336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46409e2e0 0x7fa46411ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.124+0000 7fa46359e700 1 -- 172.21.15.59:0/1140393336 >> 172.21.15.59:0/1140393336 conn(0x7fa4640a2e20 msgr2=0x7fa464137f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:42.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.124+0000 7fa46359e700 1 -- 172.21.15.59:0/1140393336 shutdown_connections 2023-09-30T22:31:42.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.124+0000 7fa46359e700 1 -- 172.21.15.59:0/1140393336 wait complete. 2023-09-30T22:31:42.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.160+0000 7f51b6262700 1 -- 172.21.15.59:0/3035856406 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f51b00a1650 con 0x7f51b0135c20 2023-09-30T22:31:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.160+0000 7f5197fff700 1 -- 172.21.15.59:0/3035856406 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51b00a1650 con 0x7f51b0135c20 2023-09-30T22:31:42.160 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:42.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.162+0000 7f51b6262700 1 -- 172.21.15.59:0/3035856406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b0135c20 msgr2=0x7f51b009aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.162+0000 7f51b6262700 1 --2- 172.21.15.59:0/3035856406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b0135c20 0x7f51b009aca0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f51a800efc0 tx=0x7f51a800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.162+0000 7f51b6262700 1 -- 172.21.15.59:0/3035856406 shutdown_connections 2023-09-30T22:31:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.162+0000 7f51b6262700 1 --2- 172.21.15.59:0/3035856406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b0135c20 0x7f51b009aca0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.162+0000 7f51b6262700 1 --2- 172.21.15.59:0/3035856406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b006f5d0 0x7f51b009a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.162+0000 7f51b6262700 1 --2- 172.21.15.59:0/3035856406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b012cf60 0x7f51b009a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.162+0000 7f51b6262700 1 -- 172.21.15.59:0/3035856406 >> 172.21.15.59:0/3035856406 conn(0x7f51b00a2aa0 msgr2=0x7f51b0134f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.163+0000 7f51b6262700 1 -- 172.21.15.59:0/3035856406 shutdown_connections 2023-09-30T22:31:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:42.163+0000 7f51b6262700 1 -- 172.21.15.59:0/3035856406 wait complete. 2023-09-30T22:31:42.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:43.016 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:43.103 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:43.139 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:43.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.165+0000 7f82b9c15700 1 Processor -- start 2023-09-30T22:31:43.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.165+0000 7f82b9c15700 1 -- start start 2023-09-30T22:31:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.165+0000 7f82b9c15700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82b409d6f0 0x7f82b409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.165+0000 7f82b9c15700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82b409e000 0x7f82b41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.165+0000 7f82b9c15700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b409b120 con 0x7f82b409e410 2023-09-30T22:31:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.165+0000 7f82b9c15700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b406b460 con 0x7f82b409e000 2023-09-30T22:31:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.165+0000 7f82b9c15700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b409a7e0 con 0x7f82b409d6f0 2023-09-30T22:31:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.165+0000 7f82b2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82b409e000 0x7f82b41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.165+0000 7f82b37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82b409d6f0 0x7f82b409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.165+0000 7f82b2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82b409e000 0x7f82b41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54042/0 (socket says 172.21.15.59:54042) 2023-09-30T22:31:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.165+0000 7f82b37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82b409d6f0 0x7f82b409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42196/0 (socket says 172.21.15.59:42196) 2023-09-30T22:31:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.165+0000 7f82b2ffd700 1 -- 172.21.15.59:0/3576714359 learned_addr learned my addr 172.21.15.59:0/3576714359 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.166+0000 7f82b37fe700 1 -- 172.21.15.59:0/3576714359 >> v2:172.21.15.59:3300/0 conn(0x7f82b409e000 msgr2=0x7f82b41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.166+0000 7f82b37fe700 1 --2- 172.21.15.59:0/3576714359 >> v2:172.21.15.59:3300/0 conn(0x7f82b409e000 0x7f82b41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.166+0000 7f82b37fe700 1 -- 172.21.15.59:0/3576714359 >> v1:172.21.15.59:6789/0 conn(0x7f82b409e410 legacy=0x7f82b4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.166+0000 7f82b37fe700 1 -- 172.21.15.59:0/3576714359 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b409a500 con 0x7f82b409d6f0 2023-09-30T22:31:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.166+0000 7f82b2ffd700 1 --2- 172.21.15.59:0/3576714359 >> v2:172.21.15.59:3300/0 conn(0x7f82b409e000 0x7f82b41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:43.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.166+0000 7f82b37fe700 1 --2- 172.21.15.59:0/3576714359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82b409d6f0 0x7f82b409dac0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009870 tx=0x7f82a4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=905a3c28e6e0be77 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:43.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.166+0000 7f82b27fc700 1 -- 172.21.15.59:0/3576714359 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4011830 con 0x7f82b409d6f0 2023-09-30T22:31:43.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.166+0000 7f82b27fc700 1 -- 172.21.15.59:0/3576714359 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a4011990 con 0x7f82b409d6f0 2023-09-30T22:31:43.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.166+0000 7f82b27fc700 1 -- 172.21.15.59:0/3576714359 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4011d20 con 0x7f82b409d6f0 2023-09-30T22:31:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.167+0000 7f82b9c15700 1 -- 172.21.15.59:0/3576714359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82b409d6f0 msgr2=0x7f82b409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.167+0000 7f82b9c15700 1 --2- 172.21.15.59:0/3576714359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82b409d6f0 0x7f82b409dac0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009870 tx=0x7f82a4009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.167+0000 7f82b9c15700 1 -- 172.21.15.59:0/3576714359 shutdown_connections 2023-09-30T22:31:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.167+0000 7f82b9c15700 1 --2- 172.21.15.59:0/3576714359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82b409d6f0 0x7f82b409dac0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.167+0000 7f82b9c15700 1 --2- 172.21.15.59:0/3576714359 >> v2:172.21.15.59:3300/0 conn(0x7f82b409e000 0x7f82b41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.167+0000 7f82b9c15700 1 -- 172.21.15.59:0/3576714359 >> 172.21.15.59:0/3576714359 conn(0x7f82b4066f50 msgr2=0x7f82b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.168+0000 7f82b9c15700 1 -- 172.21.15.59:0/3576714359 shutdown_connections 2023-09-30T22:31:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.168+0000 7f82b9c15700 1 -- 172.21.15.59:0/3576714359 wait complete. 2023-09-30T22:31:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.169+0000 7f82b9c15700 1 Processor -- start 2023-09-30T22:31:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.169+0000 7f82b9c15700 1 -- start start 2023-09-30T22:31:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.169+0000 7f82b9c15700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82b409d6f0 0x7f82b41a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.169+0000 7f82b9c15700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82b409e000 0x7f82b41a6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.169+0000 7f82b9c15700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82b409e410 0x7f82b41a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.169+0000 7f82b9c15700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b41a9990 con 0x7f82b409e000 2023-09-30T22:31:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.169+0000 7f82b9c15700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b41a7b20 con 0x7f82b409e410 2023-09-30T22:31:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.169+0000 7f82b9c15700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82b40a3320 con 0x7f82b409d6f0 2023-09-30T22:31:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.169+0000 7f82b3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82b409e410 0x7f82b41a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.170+0000 7f82b37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82b409d6f0 0x7f82b41a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.170+0000 7f82b2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82b409e000 0x7f82b41a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.170+0000 7f82b37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82b409d6f0 0x7f82b41a5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52910/0 (socket says 172.21.15.59:52910) 2023-09-30T22:31:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.170+0000 7f82b2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82b409e000 0x7f82b41a6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54044/0 (socket says 172.21.15.59:54044) 2023-09-30T22:31:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.170+0000 7f82b3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82b409e410 0x7f82b41a6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42210/0 (socket says 172.21.15.59:42210) 2023-09-30T22:31:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.170+0000 7f82b2ffd700 1 -- 172.21.15.59:0/2834975194 learned_addr learned my addr 172.21.15.59:0/2834975194 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.170+0000 7f82b3fff700 1 -- 172.21.15.59:0/2834975194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82b409d6f0 msgr2=0x7f82b41a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.170+0000 7f82b3fff700 1 --2- 172.21.15.59:0/2834975194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82b409d6f0 0x7f82b41a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.170+0000 7f82b3fff700 1 -- 172.21.15.59:0/2834975194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82b409e000 msgr2=0x7f82b41a6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.170+0000 7f82b3fff700 1 --2- 172.21.15.59:0/2834975194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82b409e000 0x7f82b41a6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.170+0000 7f82b3fff700 1 -- 172.21.15.59:0/2834975194 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a8009550 con 0x7f82b409e410 2023-09-30T22:31:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.170+0000 7f82b2ffd700 1 --2- 172.21.15.59:0/2834975194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82b409e000 0x7f82b41a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.170+0000 7f82b37fe700 1 --2- 172.21.15.59:0/2834975194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82b409d6f0 0x7f82b41a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.170+0000 7f82b3fff700 1 --2- 172.21.15.59:0/2834975194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82b409e410 0x7f82b41a6980 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00cb90 tx=0x7f82ac00cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.170+0000 7f829bfff700 1 -- 172.21.15.59:0/2834975194 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac003c00 con 0x7f82b409e410 2023-09-30T22:31:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.171+0000 7f829bfff700 1 -- 172.21.15.59:0/2834975194 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac003d60 con 0x7f82b409e410 2023-09-30T22:31:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.171+0000 7f82b9c15700 1 -- 172.21.15.59:0/2834975194 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a40094a0 con 0x7f82b409e410 2023-09-30T22:31:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.171+0000 7f829bfff700 1 -- 172.21.15.59:0/2834975194 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac00aa80 con 0x7f82b409e410 2023-09-30T22:31:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.171+0000 7f82b9c15700 1 -- 172.21.15.59:0/2834975194 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b41a8d40 con 0x7f82b409e410 2023-09-30T22:31:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.172+0000 7f82b9c15700 1 -- 172.21.15.59:0/2834975194 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b41a8940 con 0x7f82b409e410 2023-09-30T22:31:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.172+0000 7f829bfff700 1 -- 172.21.15.59:0/2834975194 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82ac00abe0 con 0x7f82b409e410 2023-09-30T22:31:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.172+0000 7f829bfff700 1 -- 172.21.15.59:0/2834975194 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f82ac03f550 con 0x7f82b409e410 2023-09-30T22:31:43.177 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:43.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.178+0000 7f829bfff700 1 -- 172.21.15.59:0/2834975194 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82ac0196c0 con 0x7f82b409e410 2023-09-30T22:31:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.251+0000 7f1795efc700 1 Processor -- start 2023-09-30T22:31:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.251+0000 7f1795efc700 1 -- start start 2023-09-30T22:31:43.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.252+0000 7f1795efc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1790136710 0x7f1790138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.252+0000 7f1795efc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1790139030 0x7f179013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.252+0000 7f1795efc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179006ef30 con 0x7f17901338a0 2023-09-30T22:31:43.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.252+0000 7f1795efc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179006fef0 con 0x7f1790139030 2023-09-30T22:31:43.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.252+0000 7f1795efc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17901334b0 con 0x7f1790136710 2023-09-30T22:31:43.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.252+0000 7f178f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f17901338a0 0x7f1790133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47874/0 (socket says 172.21.15.59:47874) 2023-09-30T22:31:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.252+0000 7f178f7fe700 1 -- 172.21.15.59:0/3365320591 learned_addr learned my addr 172.21.15.59:0/3365320591 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.252+0000 7f178effd700 1 --2- 172.21.15.59:0/3365320591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1790136710 0x7f1790138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.252+0000 7f178ffff700 1 --2- 172.21.15.59:0/3365320591 >> v2:172.21.15.59:3300/0 conn(0x7f1790139030 0x7f179013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.253+0000 7f178effd700 1 -- 172.21.15.59:0/3365320591 >> v2:172.21.15.59:3300/0 conn(0x7f1790139030 msgr2=0x7f179013b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.253+0000 7f178effd700 1 --2- 172.21.15.59:0/3365320591 >> v2:172.21.15.59:3300/0 conn(0x7f1790139030 0x7f179013b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.253+0000 7f178effd700 1 -- 172.21.15.59:0/3365320591 >> v1:172.21.15.59:6789/0 conn(0x7f17901338a0 legacy=0x7f1790133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.253+0000 7f178e7fc700 1 -- 172.21.15.59:0/3365320591 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891549250 0 0) 0x7f179006ef30 con 0x7f17901338a0 2023-09-30T22:31:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.253+0000 7f178effd700 1 -- 172.21.15.59:0/3365320591 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179006fc30 con 0x7f1790136710 2023-09-30T22:31:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.253+0000 7f178effd700 1 --2- 172.21.15.59:0/3365320591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1790136710 0x7f1790138af0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1784009840 tx=0x7f1784009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13c06388a88bf4de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.253+0000 7f178e7fc700 1 -- 172.21.15.59:0/3365320591 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784011830 con 0x7f1790136710 2023-09-30T22:31:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.253+0000 7f178e7fc700 1 -- 172.21.15.59:0/3365320591 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1784011990 con 0x7f1790136710 2023-09-30T22:31:43.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.253+0000 7f178e7fc700 1 -- 172.21.15.59:0/3365320591 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784011d20 con 0x7f1790136710 2023-09-30T22:31:43.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.254+0000 7f1795efc700 1 -- 172.21.15.59:0/3365320591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1790136710 msgr2=0x7f1790138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.254+0000 7f1795efc700 1 --2- 172.21.15.59:0/3365320591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1790136710 0x7f1790138af0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1784009840 tx=0x7f1784009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:43.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.254+0000 7f1795efc700 1 -- 172.21.15.59:0/3365320591 shutdown_connections 2023-09-30T22:31:43.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.254+0000 7f1795efc700 1 --2- 172.21.15.59:0/3365320591 >> v2:172.21.15.59:3300/0 conn(0x7f1790139030 0x7f179013b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.254+0000 7f1795efc700 1 --2- 172.21.15.59:0/3365320591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1790136710 0x7f1790138af0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.254+0000 7f1795efc700 1 -- 172.21.15.59:0/3365320591 >> 172.21.15.59:0/3365320591 conn(0x7f17900a2aa0 msgr2=0x7f17900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:43.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.254+0000 7f1795efc700 1 -- 172.21.15.59:0/3365320591 shutdown_connections 2023-09-30T22:31:43.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.254+0000 7f1795efc700 1 -- 172.21.15.59:0/3365320591 wait complete. 2023-09-30T22:31:43.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.255+0000 7f1795efc700 1 Processor -- start 2023-09-30T22:31:43.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.256+0000 7f1795efc700 1 -- start start 2023-09-30T22:31:43.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.256+0000 7f1795efc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17901338a0 0x7f179011acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.256+0000 7f1795efc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1790136710 0x7f179011b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.256+0000 7f1795efc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1790139030 0x7f179011b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.256+0000 7f1795efc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179011e770 con 0x7f1790139030 2023-09-30T22:31:43.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.256+0000 7f1795efc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179006f640 con 0x7f17901338a0 2023-09-30T22:31:43.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.256+0000 7f1795efc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1790138c90 con 0x7f1790136710 2023-09-30T22:31:43.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.256+0000 7f178effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1790136710 0x7f179011b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.256+0000 7f178effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1790136710 0x7f179011b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52926/0 (socket says 172.21.15.59:52926) 2023-09-30T22:31:43.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.256+0000 7f178effd700 1 -- 172.21.15.59:0/953684292 learned_addr learned my addr 172.21.15.59:0/953684292 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:43.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.256+0000 7f178ffff700 1 --2- 172.21.15.59:0/953684292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1790139030 0x7f179011b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.256+0000 7f178f7fe700 1 --2- 172.21.15.59:0/953684292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17901338a0 0x7f179011acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.257+0000 7f178effd700 1 -- 172.21.15.59:0/953684292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17901338a0 msgr2=0x7f179011acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.257+0000 7f178effd700 1 --2- 172.21.15.59:0/953684292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17901338a0 0x7f179011acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.257+0000 7f178effd700 1 -- 172.21.15.59:0/953684292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1790139030 msgr2=0x7f179011b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.257+0000 7f178effd700 1 --2- 172.21.15.59:0/953684292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1790139030 0x7f179011b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.257+0000 7f178effd700 1 -- 172.21.15.59:0/953684292 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17840094a0 con 0x7f1790136710 2023-09-30T22:31:43.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.257+0000 7f178ffff700 1 --2- 172.21.15.59:0/953684292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1790139030 0x7f179011b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:43.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.257+0000 7f178effd700 1 --2- 172.21.15.59:0/953684292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1790136710 0x7f179011b230 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f17840090b0 tx=0x7f1784004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:43.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.257+0000 7f1777fff700 1 -- 172.21.15.59:0/953684292 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17840036a0 con 0x7f1790136710 2023-09-30T22:31:43.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.257+0000 7f1777fff700 1 -- 172.21.15.59:0/953684292 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178401f070 con 0x7f1790136710 2023-09-30T22:31:43.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.257+0000 7f1795efc700 1 -- 172.21.15.59:0/953684292 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179011ce30 con 0x7f1790136710 2023-09-30T22:31:43.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.257+0000 7f1777fff700 1 -- 172.21.15.59:0/953684292 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784003a20 con 0x7f1790136710 2023-09-30T22:31:43.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.257+0000 7f1795efc700 1 -- 172.21.15.59:0/953684292 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179011d050 con 0x7f1790136710 2023-09-30T22:31:43.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.258+0000 7f1777fff700 1 -- 172.21.15.59:0/953684292 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1784003b80 con 0x7f1790136710 2023-09-30T22:31:43.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.258+0000 7f1795efc700 1 -- 172.21.15.59:0/953684292 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1790074ea0 con 0x7f1790136710 2023-09-30T22:31:43.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.259+0000 7f1777fff700 1 -- 172.21.15.59:0/953684292 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1784021070 con 0x7f1790136710 2023-09-30T22:31:43.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.268+0000 7f1777fff700 1 -- 172.21.15.59:0/953684292 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1784003e30 con 0x7f1790136710 2023-09-30T22:31:43.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.295+0000 7f1137bb5700 1 Processor -- start 2023-09-30T22:31:43.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.295+0000 7f1137bb5700 1 -- start start 2023-09-30T22:31:43.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.295+0000 7f1137bb5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11301316c0 0x7f1130131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.295+0000 7f1137bb5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f113009d9f0 0x7f113006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.295+0000 7f1137bb5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f113006acb0 0x7f113006b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.295+0000 7f1137bb5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113009e130 con 0x7f113006acb0 2023-09-30T22:31:43.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.295+0000 7f1137bb5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11301312b0 con 0x7f113009d9f0 2023-09-30T22:31:43.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.295+0000 7f1137bb5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f113009f6e0 con 0x7f11301316c0 2023-09-30T22:31:43.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.296+0000 7f1135951700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11301316c0 0x7f1130131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.296+0000 7f1135951700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11301316c0 0x7f1130131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52938/0 (socket says 172.21.15.59:52938) 2023-09-30T22:31:43.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.296+0000 7f1135951700 1 -- 172.21.15.59:0/2642791535 learned_addr learned my addr 172.21.15.59:0/2642791535 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:43.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.296+0000 7f1136152700 1 --2- 172.21.15.59:0/2642791535 >> v2:172.21.15.59:3300/0 conn(0x7f113006acb0 0x7f113006b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.296+0000 7f1135150700 1 --2- 172.21.15.59:0/2642791535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f113009d9f0 0x7f113006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.296+0000 7f1135951700 1 -- 172.21.15.59:0/2642791535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f113009d9f0 msgr2=0x7f113006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:43.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.296+0000 7f1135951700 1 --2- 172.21.15.59:0/2642791535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f113009d9f0 0x7f113006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.296+0000 7f1135951700 1 -- 172.21.15.59:0/2642791535 >> v2:172.21.15.59:3300/0 conn(0x7f113006acb0 msgr2=0x7f113006b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:43.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.296+0000 7f1135951700 1 --2- 172.21.15.59:0/2642791535 >> v2:172.21.15.59:3300/0 conn(0x7f113006acb0 0x7f113006b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.296+0000 7f1135951700 1 -- 172.21.15.59:0/2642791535 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113009e760 con 0x7f11301316c0 2023-09-30T22:31:43.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.296+0000 7f1136152700 1 --2- 172.21.15.59:0/2642791535 >> v2:172.21.15.59:3300/0 conn(0x7f113006acb0 0x7f113006b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:43.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.296+0000 7f1135951700 1 --2- 172.21.15.59:0/2642791535 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11301316c0 0x7f1130131a90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f112c0098f0 tx=0x7f112c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfec01a25f12063d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:43.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.297+0000 7f113494f700 1 -- 172.21.15.59:0/2642791535 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c011830 con 0x7f11301316c0 2023-09-30T22:31:43.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.297+0000 7f113494f700 1 -- 172.21.15.59:0/2642791535 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112c011990 con 0x7f11301316c0 2023-09-30T22:31:43.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.297+0000 7f113494f700 1 -- 172.21.15.59:0/2642791535 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c011d20 con 0x7f11301316c0 2023-09-30T22:31:43.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.297+0000 7f1137bb5700 1 -- 172.21.15.59:0/2642791535 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11301316c0 msgr2=0x7f1130131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.297+0000 7f1137bb5700 1 --2- 172.21.15.59:0/2642791535 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11301316c0 0x7f1130131a90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f112c0098f0 tx=0x7f112c009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:43.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.297+0000 7f1137bb5700 1 -- 172.21.15.59:0/2642791535 shutdown_connections 2023-09-30T22:31:43.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.297+0000 7f1137bb5700 1 --2- 172.21.15.59:0/2642791535 >> v2:172.21.15.59:3300/0 conn(0x7f113006acb0 0x7f113006b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.297+0000 7f1137bb5700 1 --2- 172.21.15.59:0/2642791535 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11301316c0 0x7f1130131a90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.297+0000 7f1137bb5700 1 --2- 172.21.15.59:0/2642791535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f113009d9f0 0x7f113006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.297+0000 7f1137bb5700 1 -- 172.21.15.59:0/2642791535 >> 172.21.15.59:0/2642791535 conn(0x7f1130066f50 msgr2=0x7f113009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:43.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.298+0000 7f1137bb5700 1 -- 172.21.15.59:0/2642791535 shutdown_connections 2023-09-30T22:31:43.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.298+0000 7f1137bb5700 1 -- 172.21.15.59:0/2642791535 wait complete. 2023-09-30T22:31:43.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.299+0000 7f1137bb5700 1 Processor -- start 2023-09-30T22:31:43.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.299+0000 7f1137bb5700 1 -- start start 2023-09-30T22:31:43.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1137bb5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f113006acb0 0x7f113006e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1137bb5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f113009d9f0 0x7f113006ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1137bb5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11301316c0 0x7f113006f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1137bb5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1130071370 con 0x7f113009d9f0 2023-09-30T22:31:43.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1137bb5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1130070dd0 con 0x7f11301316c0 2023-09-30T22:31:43.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1137bb5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1130071090 con 0x7f113006acb0 2023-09-30T22:31:43.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1135951700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f113006acb0 0x7f113006e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1135951700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f113006acb0 0x7f113006e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52950/0 (socket says 172.21.15.59:52950) 2023-09-30T22:31:43.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1135951700 1 -- 172.21.15.59:0/66927329 learned_addr learned my addr 172.21.15.59:0/66927329 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:43.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1135150700 1 --2- 172.21.15.59:0/66927329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f113009d9f0 0x7f113006ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1136152700 1 --2- 172.21.15.59:0/66927329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11301316c0 0x7f113006f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1135951700 1 -- 172.21.15.59:0/66927329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11301316c0 msgr2=0x7f113006f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1135951700 1 --2- 172.21.15.59:0/66927329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11301316c0 0x7f113006f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1135951700 1 -- 172.21.15.59:0/66927329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f113009d9f0 msgr2=0x7f113006ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1135951700 1 --2- 172.21.15.59:0/66927329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f113009d9f0 0x7f113006ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.300+0000 7f1135951700 1 -- 172.21.15.59:0/66927329 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1128009a70 con 0x7f113006acb0 2023-09-30T22:31:43.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.301+0000 7f1135951700 1 --2- 172.21.15.59:0/66927329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f113006acb0 0x7f113006e8e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f112c000c00 tx=0x7f112c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:43.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.301+0000 7f11267fc700 1 -- 172.21.15.59:0/66927329 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c004450 con 0x7f113006acb0 2023-09-30T22:31:43.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.301+0000 7f11267fc700 1 -- 172.21.15.59:0/66927329 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112c0045d0 con 0x7f113006acb0 2023-09-30T22:31:43.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.301+0000 7f1137bb5700 1 -- 172.21.15.59:0/66927329 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112c009550 con 0x7f113006acb0 2023-09-30T22:31:43.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.301+0000 7f11267fc700 1 -- 172.21.15.59:0/66927329 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c0038e0 con 0x7f113006acb0 2023-09-30T22:31:43.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.301+0000 7f1137bb5700 1 -- 172.21.15.59:0/66927329 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113012b3f0 con 0x7f113006acb0 2023-09-30T22:31:43.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.302+0000 7f11267fc700 1 -- 172.21.15.59:0/66927329 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f112c003a40 con 0x7f113006acb0 2023-09-30T22:31:43.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.302+0000 7f11267fc700 1 -- 172.21.15.59:0/66927329 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f112c021030 con 0x7f113006acb0 2023-09-30T22:31:43.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.303+0000 7f1137bb5700 1 -- 172.21.15.59:0/66927329 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1130074ea0 con 0x7f113006acb0 2023-09-30T22:31:43.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.308+0000 7f11267fc700 1 -- 172.21.15.59:0/66927329 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f112c01a430 con 0x7f113006acb0 2023-09-30T22:31:43.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.332+0000 7fcf4aa7d700 1 Processor -- start 2023-09-30T22:31:43.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.332+0000 7fcf4aa7d700 1 -- start start 2023-09-30T22:31:43.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf4aa7d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4409d6f0 0x7fcf4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf4aa7d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf4409e000 0x7fcf44130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf4aa7d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf4409e410 0x7fcf44130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf4aa7d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4409f520 con 0x7fcf4409e000 2023-09-30T22:31:43.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf4aa7d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4409f130 con 0x7fcf4409d6f0 2023-09-30T22:31:43.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf4aa7d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4409e930 con 0x7fcf4409e410 2023-09-30T22:31:43.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf48819700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4409d6f0 0x7fcf4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf43fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf4409e000 0x7fcf44130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf48819700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4409d6f0 0x7fcf4409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42246/0 (socket says 172.21.15.59:42246) 2023-09-30T22:31:43.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf48819700 1 -- 172.21.15.59:0/1569266569 learned_addr learned my addr 172.21.15.59:0/1569266569 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:43.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf4901a700 1 --2- 172.21.15.59:0/1569266569 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf4409e410 0x7fcf44130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf43fff700 1 -- 172.21.15.59:0/1569266569 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf4409e410 msgr2=0x7fcf44130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:43.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf43fff700 1 --2- 172.21.15.59:0/1569266569 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf4409e410 0x7fcf44130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf43fff700 1 -- 172.21.15.59:0/1569266569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4409d6f0 msgr2=0x7fcf4409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:43.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf43fff700 1 --2- 172.21.15.59:0/1569266569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4409d6f0 0x7fcf4409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf43fff700 1 -- 172.21.15.59:0/1569266569 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4409b2d0 con 0x7fcf4409e000 2023-09-30T22:31:43.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.333+0000 7fcf4901a700 1 --2- 172.21.15.59:0/1569266569 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf4409e410 0x7fcf44130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:43.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.334+0000 7fcf43fff700 1 --2- 172.21.15.59:0/1569266569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4409e000 0x7fcf44130660 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009870 tx=0x7fcf30009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b6e632beacb6cc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:43.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.334+0000 7fcf437fe700 1 -- 172.21.15.59:0/1569266569 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf30011830 con 0x7fcf4409e000 2023-09-30T22:31:43.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.334+0000 7fcf437fe700 1 -- 172.21.15.59:0/1569266569 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf30011990 con 0x7fcf4409e000 2023-09-30T22:31:43.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.334+0000 7fcf437fe700 1 -- 172.21.15.59:0/1569266569 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf30011d20 con 0x7fcf4409e000 2023-09-30T22:31:43.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.335+0000 7fcf4aa7d700 1 -- 172.21.15.59:0/1569266569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4409e000 msgr2=0x7fcf44130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.335+0000 7fcf4aa7d700 1 --2- 172.21.15.59:0/1569266569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4409e000 0x7fcf44130660 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009870 tx=0x7fcf30009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:43.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.335+0000 7fcf4aa7d700 1 -- 172.21.15.59:0/1569266569 shutdown_connections 2023-09-30T22:31:43.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.335+0000 7fcf4aa7d700 1 --2- 172.21.15.59:0/1569266569 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf4409e410 0x7fcf44130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.335+0000 7fcf4aa7d700 1 --2- 172.21.15.59:0/1569266569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4409d6f0 0x7fcf4409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.335+0000 7fcf4aa7d700 1 --2- 172.21.15.59:0/1569266569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4409e000 0x7fcf44130660 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.335+0000 7fcf4aa7d700 1 -- 172.21.15.59:0/1569266569 >> 172.21.15.59:0/1569266569 conn(0x7fcf44066f50 msgr2=0x7fcf4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:43.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.335+0000 7fcf4aa7d700 1 -- 172.21.15.59:0/1569266569 shutdown_connections 2023-09-30T22:31:43.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.335+0000 7fcf4aa7d700 1 -- 172.21.15.59:0/1569266569 wait complete. 2023-09-30T22:31:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.336+0000 7fcf4aa7d700 1 Processor -- start 2023-09-30T22:31:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.336+0000 7fcf4aa7d700 1 -- start start 2023-09-30T22:31:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.336+0000 7fcf4aa7d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf4409d6f0 0x7fcf441374e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.336+0000 7fcf4aa7d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4409e000 0x7fcf44137a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.336+0000 7fcf4aa7d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4409e410 0x7fcf44137f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.336+0000 7fcf4aa7d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44138940 con 0x7fcf4409e410 2023-09-30T22:31:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.336+0000 7fcf4aa7d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44139140 con 0x7fcf4409e000 2023-09-30T22:31:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.336+0000 7fcf4aa7d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4411a620 con 0x7fcf4409d6f0 2023-09-30T22:31:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.337+0000 7fcf48819700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf4409d6f0 0x7fcf441374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.337+0000 7fcf48819700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf4409d6f0 0x7fcf441374e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52970/0 (socket says 172.21.15.59:52970) 2023-09-30T22:31:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.337+0000 7fcf48819700 1 -- 172.21.15.59:0/407811629 learned_addr learned my addr 172.21.15.59:0/407811629 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.337+0000 7fcf43fff700 1 --2- 172.21.15.59:0/407811629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4409e000 0x7fcf44137a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.337+0000 7fcf4901a700 1 --2- 172.21.15.59:0/407811629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4409e410 0x7fcf44137f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.337+0000 7fcf48819700 1 -- 172.21.15.59:0/407811629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4409e000 msgr2=0x7fcf44137a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.337+0000 7fcf48819700 1 --2- 172.21.15.59:0/407811629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4409e000 0x7fcf44137a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.337+0000 7fcf48819700 1 -- 172.21.15.59:0/407811629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4409e410 msgr2=0x7fcf44137f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.337+0000 7fcf48819700 1 --2- 172.21.15.59:0/407811629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4409e410 0x7fcf44137f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.337+0000 7fcf48819700 1 -- 172.21.15.59:0/407811629 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf300094a0 con 0x7fcf4409d6f0 2023-09-30T22:31:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.337+0000 7fcf48819700 1 --2- 172.21.15.59:0/407811629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf4409d6f0 0x7fcf441374e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800e960 tx=0x7fcf3800ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.337+0000 7fcf417fa700 1 -- 172.21.15.59:0/407811629 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38013680 con 0x7fcf4409d6f0 2023-09-30T22:31:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.338+0000 7fcf417fa700 1 -- 172.21.15.59:0/407811629 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf380137e0 con 0x7fcf4409d6f0 2023-09-30T22:31:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.338+0000 7fcf417fa700 1 -- 172.21.15.59:0/407811629 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38013b50 con 0x7fcf4409d6f0 2023-09-30T22:31:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.338+0000 7fcf4aa7d700 1 -- 172.21.15.59:0/407811629 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf44072560 con 0x7fcf4409d6f0 2023-09-30T22:31:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.338+0000 7fcf4aa7d700 1 -- 172.21.15.59:0/407811629 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf44139890 con 0x7fcf4409d6f0 2023-09-30T22:31:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.339+0000 7fcf4aa7d700 1 -- 172.21.15.59:0/407811629 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf44074ea0 con 0x7fcf4409d6f0 2023-09-30T22:31:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.339+0000 7fcf417fa700 1 -- 172.21.15.59:0/407811629 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf38013cb0 con 0x7fcf4409d6f0 2023-09-30T22:31:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.340+0000 7fcf417fa700 1 -- 172.21.15.59:0/407811629 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcf3803fa30 con 0x7fcf4409d6f0 2023-09-30T22:31:43.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.349+0000 7fcf417fa700 1 -- 172.21.15.59:0/407811629 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf380119a0 con 0x7fcf4409d6f0 2023-09-30T22:31:43.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.401+0000 7f82b9c15700 1 -- 172.21.15.59:0/2834975194 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f82b4074ea0 con 0x7f82b409e410 2023-09-30T22:31:43.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.402+0000 7f829bfff700 1 -- 172.21.15.59:0/2834975194 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82ac019300 con 0x7f82b409e410 2023-09-30T22:31:43.402 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:43.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.404+0000 7f82b9c15700 1 -- 172.21.15.59:0/2834975194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82b409e410 msgr2=0x7f82b41a6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.404+0000 7f82b9c15700 1 --2- 172.21.15.59:0/2834975194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82b409e410 0x7f82b41a6980 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00cb90 tx=0x7f82ac00cea0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.404+0000 7f82b9c15700 1 -- 172.21.15.59:0/2834975194 shutdown_connections 2023-09-30T22:31:43.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.404+0000 7f82b9c15700 1 --2- 172.21.15.59:0/2834975194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82b409d6f0 0x7f82b41a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.404+0000 7f82b9c15700 1 --2- 172.21.15.59:0/2834975194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82b409e410 0x7f82b41a6980 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.404+0000 7f82b9c15700 1 --2- 172.21.15.59:0/2834975194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82b409e000 0x7f82b41a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.404+0000 7f82b9c15700 1 -- 172.21.15.59:0/2834975194 >> 172.21.15.59:0/2834975194 conn(0x7f82b4066f50 msgr2=0x7f82b41baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:43.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.404+0000 7f82b9c15700 1 -- 172.21.15.59:0/2834975194 shutdown_connections 2023-09-30T22:31:43.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.404+0000 7f82b9c15700 1 -- 172.21.15.59:0/2834975194 wait complete. 2023-09-30T22:31:43.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:43.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.487+0000 7f1795efc700 1 -- 172.21.15.59:0/953684292 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f179006b9e0 con 0x7f1790136710 2023-09-30T22:31:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.488+0000 7f1777fff700 1 -- 172.21.15.59:0/953684292 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1784034020 con 0x7f1790136710 2023-09-30T22:31:43.488 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:43.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.491+0000 7f1795efc700 1 -- 172.21.15.59:0/953684292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1790136710 msgr2=0x7f179011b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.491+0000 7f1795efc700 1 --2- 172.21.15.59:0/953684292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1790136710 0x7f179011b230 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f17840090b0 tx=0x7f1784004750 comp rx=0 tx=0).stop 2023-09-30T22:31:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.491+0000 7f1795efc700 1 -- 172.21.15.59:0/953684292 shutdown_connections 2023-09-30T22:31:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.491+0000 7f1795efc700 1 --2- 172.21.15.59:0/953684292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1790139030 0x7f179011b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.491+0000 7f1795efc700 1 --2- 172.21.15.59:0/953684292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17901338a0 0x7f179011acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.491+0000 7f1795efc700 1 --2- 172.21.15.59:0/953684292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1790136710 0x7f179011b230 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.491+0000 7f1795efc700 1 -- 172.21.15.59:0/953684292 >> 172.21.15.59:0/953684292 conn(0x7f17900a2aa0 msgr2=0x7f17901344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.491+0000 7f1795efc700 1 -- 172.21.15.59:0/953684292 shutdown_connections 2023-09-30T22:31:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.491+0000 7f1795efc700 1 -- 172.21.15.59:0/953684292 wait complete. 2023-09-30T22:31:43.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:43.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.538+0000 7f1137bb5700 1 -- 172.21.15.59:0/66927329 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f113009e980 con 0x7f113006acb0 2023-09-30T22:31:43.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.538+0000 7f11267fc700 1 -- 172.21.15.59:0/66927329 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f112c015030 con 0x7f113006acb0 2023-09-30T22:31:43.539 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:43.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.541+0000 7f1137bb5700 1 -- 172.21.15.59:0/66927329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f113006acb0 msgr2=0x7f113006e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.541+0000 7f1137bb5700 1 --2- 172.21.15.59:0/66927329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f113006acb0 0x7f113006e8e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f112c000c00 tx=0x7f112c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:43.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.541+0000 7f1137bb5700 1 -- 172.21.15.59:0/66927329 shutdown_connections 2023-09-30T22:31:43.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.541+0000 7f1137bb5700 1 --2- 172.21.15.59:0/66927329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f113006acb0 0x7f113006e8e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.541+0000 7f1137bb5700 1 --2- 172.21.15.59:0/66927329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11301316c0 0x7f113006f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.541+0000 7f1137bb5700 1 --2- 172.21.15.59:0/66927329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f113009d9f0 0x7f113006ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.541+0000 7f1137bb5700 1 -- 172.21.15.59:0/66927329 >> 172.21.15.59:0/66927329 conn(0x7f1130066f50 msgr2=0x7f113009a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:43.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.541+0000 7f1137bb5700 1 -- 172.21.15.59:0/66927329 shutdown_connections 2023-09-30T22:31:43.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.541+0000 7f1137bb5700 1 -- 172.21.15.59:0/66927329 wait complete. 2023-09-30T22:31:43.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:43.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.560+0000 7fcf4aa7d700 1 -- 172.21.15.59:0/407811629 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcf4406c360 con 0x7fcf4409d6f0 2023-09-30T22:31:43.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.561+0000 7fcf417fa700 1 -- 172.21.15.59:0/407811629 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf38011350 con 0x7fcf4409d6f0 2023-09-30T22:31:43.562 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:43.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.563+0000 7fcf4aa7d700 1 -- 172.21.15.59:0/407811629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf4409d6f0 msgr2=0x7fcf441374e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.563+0000 7fcf4aa7d700 1 --2- 172.21.15.59:0/407811629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf4409d6f0 0x7fcf441374e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800e960 tx=0x7fcf3800ec70 comp rx=0 tx=0).stop 2023-09-30T22:31:43.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.563+0000 7fcf4aa7d700 1 -- 172.21.15.59:0/407811629 shutdown_connections 2023-09-30T22:31:43.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.563+0000 7fcf4aa7d700 1 --2- 172.21.15.59:0/407811629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf4409d6f0 0x7fcf441374e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.563+0000 7fcf4aa7d700 1 --2- 172.21.15.59:0/407811629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4409e410 0x7fcf44137f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.563+0000 7fcf4aa7d700 1 --2- 172.21.15.59:0/407811629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4409e000 0x7fcf44137a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.563+0000 7fcf4aa7d700 1 -- 172.21.15.59:0/407811629 >> 172.21.15.59:0/407811629 conn(0x7fcf44066f50 msgr2=0x7fcf4406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:43.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.563+0000 7fcf4aa7d700 1 -- 172.21.15.59:0/407811629 shutdown_connections 2023-09-30T22:31:43.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:43.563+0000 7fcf4aa7d700 1 -- 172.21.15.59:0/407811629 wait complete. 2023-09-30T22:31:43.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:44.424 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:44.511 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:44.556 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:44.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.573+0000 7f8b4380f700 1 Processor -- start 2023-09-30T22:31:44.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.573+0000 7f8b4380f700 1 -- start start 2023-09-30T22:31:44.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.574+0000 7f8b4380f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b3c1338a0 0x7f8b3c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.574+0000 7f8b4380f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b3c09e930 0x7f8b3c13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.574+0000 7f8b4380f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3c06ef30 con 0x7f8b3c09de50 2023-09-30T22:31:44.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.574+0000 7f8b4380f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3c06fef0 con 0x7f8b3c1338a0 2023-09-30T22:31:44.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.574+0000 7f8b4380f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c1334b0 con 0x7f8b3c09e930 2023-09-30T22:31:44.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.574+0000 7f8b41dac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b3c09e930 0x7f8b3c13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.574+0000 7f8b415ab700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b3c1338a0 0x7f8b3c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.574+0000 7f8b41dac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b3c09e930 0x7f8b3c13b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38764/0 (socket says 172.21.15.59:38764) 2023-09-30T22:31:44.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.574+0000 7f8b415ab700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b3c1338a0 0x7f8b3c133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49300/0 (socket says 172.21.15.59:49300) 2023-09-30T22:31:44.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.574+0000 7f8b41dac700 1 -- 172.21.15.59:0/3534130358 learned_addr learned my addr 172.21.15.59:0/3534130358 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:44.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.574+0000 7f8b415ab700 1 -- 172.21.15.59:0/3534130358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b3c09e930 msgr2=0x7f8b3c13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:44.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.575+0000 7f8b415ab700 1 --2- 172.21.15.59:0/3534130358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b3c09e930 0x7f8b3c13b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.575+0000 7f8b415ab700 1 -- 172.21.15.59:0/3534130358 >> v1:172.21.15.59:6789/0 conn(0x7f8b3c09de50 legacy=0x7f8b3c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.575+0000 7f8b415ab700 1 -- 172.21.15.59:0/3534130358 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c06fc30 con 0x7f8b3c1338a0 2023-09-30T22:31:44.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.575+0000 7f8b41dac700 1 --2- 172.21.15.59:0/3534130358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b3c09e930 0x7f8b3c13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:44.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.575+0000 7f8b415ab700 1 --2- 172.21.15.59:0/3534130358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b3c1338a0 0x7f8b3c133c70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009840 tx=0x7f8b38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff5af5c95c3c7eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.575+0000 7f8b33fff700 1 -- 172.21.15.59:0/3534130358 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b38011830 con 0x7f8b3c1338a0 2023-09-30T22:31:44.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.575+0000 7f8b33fff700 1 -- 172.21.15.59:0/3534130358 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b38011990 con 0x7f8b3c1338a0 2023-09-30T22:31:44.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.575+0000 7f8b33fff700 1 -- 172.21.15.59:0/3534130358 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b38011d20 con 0x7f8b3c1338a0 2023-09-30T22:31:44.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.576+0000 7f8b4380f700 1 -- 172.21.15.59:0/3534130358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b3c1338a0 msgr2=0x7f8b3c133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.576+0000 7f8b4380f700 1 --2- 172.21.15.59:0/3534130358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b3c1338a0 0x7f8b3c133c70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009840 tx=0x7f8b38009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:44.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.576+0000 7f8b4380f700 1 -- 172.21.15.59:0/3534130358 shutdown_connections 2023-09-30T22:31:44.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.576+0000 7f8b4380f700 1 --2- 172.21.15.59:0/3534130358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b3c09e930 0x7f8b3c13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.576+0000 7f8b4380f700 1 --2- 172.21.15.59:0/3534130358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b3c1338a0 0x7f8b3c133c70 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.576+0000 7f8b4380f700 1 -- 172.21.15.59:0/3534130358 >> 172.21.15.59:0/3534130358 conn(0x7f8b3c0a2aa0 msgr2=0x7f8b3c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.576+0000 7f8b4380f700 1 -- 172.21.15.59:0/3534130358 shutdown_connections 2023-09-30T22:31:44.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.576+0000 7f8b4380f700 1 -- 172.21.15.59:0/3534130358 wait complete. 2023-09-30T22:31:44.579 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:44.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.577+0000 7f8b4380f700 1 Processor -- start 2023-09-30T22:31:44.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.577+0000 7f8b4380f700 1 -- start start 2023-09-30T22:31:44.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.577+0000 7f8b4380f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b3c09de50 0x7f8b3c11efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.577+0000 7f8b4380f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b3c09e930 0x7f8b3c11f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.577+0000 7f8b4380f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b3c1338a0 0x7f8b3c11fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.577+0000 7f8b4380f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c1210a0 con 0x7f8b3c1338a0 2023-09-30T22:31:44.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.577+0000 7f8b4380f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c1226e0 con 0x7f8b3c09de50 2023-09-30T22:31:44.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.577+0000 7f8b4380f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c1207d0 con 0x7f8b3c09e930 2023-09-30T22:31:44.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.577+0000 7f8b40daa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b3c09e930 0x7f8b3c11f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.578+0000 7f8b40daa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b3c09e930 0x7f8b3c11f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38778/0 (socket says 172.21.15.59:38778) 2023-09-30T22:31:44.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.578+0000 7f8b40daa700 1 -- 172.21.15.59:0/3225001390 learned_addr learned my addr 172.21.15.59:0/3225001390 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:44.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.578+0000 7f8b415ab700 1 --2- 172.21.15.59:0/3225001390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b3c09de50 0x7f8b3c11efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.578+0000 7f8b41dac700 1 --2- 172.21.15.59:0/3225001390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b3c1338a0 0x7f8b3c11fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.578+0000 7f8b40daa700 1 -- 172.21.15.59:0/3225001390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b3c09de50 msgr2=0x7f8b3c11efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.578+0000 7f8b40daa700 1 --2- 172.21.15.59:0/3225001390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b3c09de50 0x7f8b3c11efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.578+0000 7f8b40daa700 1 -- 172.21.15.59:0/3225001390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b3c1338a0 msgr2=0x7f8b3c11fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.578+0000 7f8b40daa700 1 --2- 172.21.15.59:0/3225001390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b3c1338a0 0x7f8b3c11fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.578+0000 7f8b40daa700 1 -- 172.21.15.59:0/3225001390 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b34009b30 con 0x7f8b3c09e930 2023-09-30T22:31:44.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.578+0000 7f8b40daa700 1 --2- 172.21.15.59:0/3225001390 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b3c09e930 0x7f8b3c11f4e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00c480 tx=0x7f8b2c00c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.578+0000 7f8b31ffb700 1 -- 172.21.15.59:0/3225001390 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c0052d0 con 0x7f8b3c09e930 2023-09-30T22:31:44.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.578+0000 7f8b31ffb700 1 -- 172.21.15.59:0/3225001390 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c005430 con 0x7f8b3c09e930 2023-09-30T22:31:44.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.578+0000 7f8b4380f700 1 -- 172.21.15.59:0/3225001390 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b380094a0 con 0x7f8b3c09e930 2023-09-30T22:31:44.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.578+0000 7f8b31ffb700 1 -- 172.21.15.59:0/3225001390 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c0038c0 con 0x7f8b3c09e930 2023-09-30T22:31:44.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.579+0000 7f8b4380f700 1 -- 172.21.15.59:0/3225001390 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c12f6e0 con 0x7f8b3c09e930 2023-09-30T22:31:44.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.579+0000 7f8b31ffb700 1 -- 172.21.15.59:0/3225001390 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b2c003a20 con 0x7f8b3c09e930 2023-09-30T22:31:44.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.580+0000 7f8b4380f700 1 -- 172.21.15.59:0/3225001390 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3c074ea0 con 0x7f8b3c09e930 2023-09-30T22:31:44.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.580+0000 7f8b31ffb700 1 -- 172.21.15.59:0/3225001390 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8b2c03ea30 con 0x7f8b3c09e930 2023-09-30T22:31:44.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.585+0000 7f8b31ffb700 1 -- 172.21.15.59:0/3225001390 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b2c011590 con 0x7f8b3c09e930 2023-09-30T22:31:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.659+0000 7f9824b2f700 1 Processor -- start 2023-09-30T22:31:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.659+0000 7f9824b2f700 1 -- start start 2023-09-30T22:31:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.660+0000 7f9824b2f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f982009e930 0x7f982009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.660+0000 7f9824b2f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f982009f650 0x7f9820131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.660+0000 7f9824b2f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9820070940 con 0x7f982009f240 2023-09-30T22:31:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.660+0000 7f9824b2f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982006fd60 con 0x7f982009f650 2023-09-30T22:31:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.660+0000 7f9824b2f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982006fa80 con 0x7f982009e930 2023-09-30T22:31:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.660+0000 7f981e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f982009e930 0x7f982009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.660+0000 7f981e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f982009e930 0x7f982009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60170/0 (socket says 172.21.15.59:60170) 2023-09-30T22:31:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.660+0000 7f981e59c700 1 -- 172.21.15.59:0/3034056723 learned_addr learned my addr 172.21.15.59:0/3034056723 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.660+0000 7f981ed9d700 1 --2- 172.21.15.59:0/3034056723 >> v2:172.21.15.59:3300/0 conn(0x7f982009f650 0x7f9820131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.661+0000 7f981e59c700 1 -- 172.21.15.59:0/3034056723 >> v2:172.21.15.59:3300/0 conn(0x7f982009f650 msgr2=0x7f9820131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:44.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.661+0000 7f981e59c700 1 --2- 172.21.15.59:0/3034056723 >> v2:172.21.15.59:3300/0 conn(0x7f982009f650 0x7f9820131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.661+0000 7f981e59c700 1 -- 172.21.15.59:0/3034056723 >> v1:172.21.15.59:6789/0 conn(0x7f982009f240 legacy=0x7f98201317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.661+0000 7f981e59c700 1 -- 172.21.15.59:0/3034056723 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982009fb60 con 0x7f982009e930 2023-09-30T22:31:44.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.661+0000 7f981e59c700 1 --2- 172.21.15.59:0/3034056723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f982009e930 0x7f982009ed00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f98100098f0 tx=0x7f9810009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbff8a069b834fa6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.661+0000 7f981d59a700 1 -- 172.21.15.59:0/3034056723 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000b8a0 con 0x7f982009e930 2023-09-30T22:31:44.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.661+0000 7f981d59a700 1 -- 172.21.15.59:0/3034056723 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981000ba00 con 0x7f982009e930 2023-09-30T22:31:44.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.661+0000 7f981d59a700 1 -- 172.21.15.59:0/3034056723 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000bd90 con 0x7f982009e930 2023-09-30T22:31:44.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.662+0000 7f9824b2f700 1 -- 172.21.15.59:0/3034056723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f982009e930 msgr2=0x7f982009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.662+0000 7f9824b2f700 1 --2- 172.21.15.59:0/3034056723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f982009e930 0x7f982009ed00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f98100098f0 tx=0x7f9810009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:44.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.662+0000 7f9824b2f700 1 -- 172.21.15.59:0/3034056723 shutdown_connections 2023-09-30T22:31:44.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.662+0000 7f9824b2f700 1 --2- 172.21.15.59:0/3034056723 >> v2:172.21.15.59:3300/0 conn(0x7f982009f650 0x7f9820131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.662+0000 7f9824b2f700 1 --2- 172.21.15.59:0/3034056723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f982009e930 0x7f982009ed00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.662+0000 7f9824b2f700 1 -- 172.21.15.59:0/3034056723 >> 172.21.15.59:0/3034056723 conn(0x7f98200a4210 msgr2=0x7f98200a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.662+0000 7f9824b2f700 1 -- 172.21.15.59:0/3034056723 shutdown_connections 2023-09-30T22:31:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.662+0000 7f9824b2f700 1 -- 172.21.15.59:0/3034056723 wait complete. 2023-09-30T22:31:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.664+0000 7f9824b2f700 1 Processor -- start 2023-09-30T22:31:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.664+0000 7f9824b2f700 1 -- start start 2023-09-30T22:31:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.665+0000 7f9824b2f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f982009e930 0x7f982012d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.665+0000 7f9824b2f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f982009f240 0x7f982012d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.665+0000 7f9824b2f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f982009f650 0x7f982012db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.665+0000 7f9824b2f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98200a33c0 con 0x7f982009f240 2023-09-30T22:31:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.665+0000 7f9824b2f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9820071d20 con 0x7f982009f650 2023-09-30T22:31:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.665+0000 7f9824b2f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98201307e0 con 0x7f982009e930 2023-09-30T22:31:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.665+0000 7f981ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f982009f650 0x7f982012db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.665+0000 7f981e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f982009e930 0x7f982012d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.665+0000 7f981ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f982009f650 0x7f982012db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60180/0 (socket says 172.21.15.59:60180) 2023-09-30T22:31:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.665+0000 7f981ed9d700 1 -- 172.21.15.59:0/3020096134 learned_addr learned my addr 172.21.15.59:0/3020096134 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.665+0000 7f981dd9b700 1 --2- 172.21.15.59:0/3020096134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f982009f240 0x7f982012d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.666+0000 7f981ed9d700 1 -- 172.21.15.59:0/3020096134 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f982009e930 msgr2=0x7f982012d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.666+0000 7f981ed9d700 1 --2- 172.21.15.59:0/3020096134 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f982009e930 0x7f982012d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.666+0000 7f981ed9d700 1 -- 172.21.15.59:0/3020096134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f982009f240 msgr2=0x7f982012d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.666+0000 7f981ed9d700 1 --2- 172.21.15.59:0/3020096134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f982009f240 0x7f982012d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.666+0000 7f981ed9d700 1 -- 172.21.15.59:0/3020096134 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810009550 con 0x7f982009f650 2023-09-30T22:31:44.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.666+0000 7f981ed9d700 1 --2- 172.21.15.59:0/3020096134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f982009f650 0x7f982012db20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9818007e40 tx=0x7f981800e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.666+0000 7f980effd700 1 -- 172.21.15.59:0/3020096134 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981800ed30 con 0x7f982009f650 2023-09-30T22:31:44.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.666+0000 7f980effd700 1 -- 172.21.15.59:0/3020096134 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981800ee90 con 0x7f982009f650 2023-09-30T22:31:44.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.666+0000 7f980effd700 1 -- 172.21.15.59:0/3020096134 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9818014660 con 0x7f982009f650 2023-09-30T22:31:44.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.666+0000 7f9824b2f700 1 -- 172.21.15.59:0/3020096134 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98200a0190 con 0x7f982009f650 2023-09-30T22:31:44.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.666+0000 7f9824b2f700 1 -- 172.21.15.59:0/3020096134 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982012f050 con 0x7f982009f650 2023-09-30T22:31:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.667+0000 7f9824b2f700 1 -- 172.21.15.59:0/3020096134 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9820074ea0 con 0x7f982009f650 2023-09-30T22:31:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.668+0000 7f980effd700 1 -- 172.21.15.59:0/3020096134 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98180147c0 con 0x7f982009f650 2023-09-30T22:31:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.668+0000 7f980effd700 1 -- 172.21.15.59:0/3020096134 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9818040870 con 0x7f982009f650 2023-09-30T22:31:44.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.677+0000 7f980effd700 1 -- 172.21.15.59:0/3020096134 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f981801c360 con 0x7f982009f650 2023-09-30T22:31:44.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.712+0000 7fe6986ac700 1 Processor -- start 2023-09-30T22:31:44.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.712+0000 7fe6986ac700 1 -- start start 2023-09-30T22:31:44.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.713+0000 7fe6986ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe69006e570 0x7fe69006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.713+0000 7fe6986ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69006ee80 0x7fe690134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.713+0000 7fe6986ac700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe690070ee0 con 0x7fe69009eca0 2023-09-30T22:31:44.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.713+0000 7fe6986ac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe690071480 con 0x7fe69006e570 2023-09-30T22:31:44.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.713+0000 7fe6986ac700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe690071b90 con 0x7fe69006ee80 2023-09-30T22:31:44.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.713+0000 7fe695c47700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe69009eca0 0x7fe690134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46654/0 (socket says 172.21.15.59:46654) 2023-09-30T22:31:44.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.713+0000 7fe695c47700 1 -- 172.21.15.59:0/2259031286 learned_addr learned my addr 172.21.15.59:0/2259031286 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:44.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.713+0000 7fe696448700 1 --2- 172.21.15.59:0/2259031286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe69006e570 0x7fe69006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.713+0000 7fe696c49700 1 --2- 172.21.15.59:0/2259031286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69006ee80 0x7fe690134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.713+0000 7fe695446700 1 -- 172.21.15.59:0/2259031286 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216603674 0 0) 0x7fe690070ee0 con 0x7fe69009eca0 2023-09-30T22:31:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.713+0000 7fe695446700 1 -- 172.21.15.59:0/2259031286 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe67c0035b0 con 0x7fe69009eca0 2023-09-30T22:31:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.713+0000 7fe696c49700 1 -- 172.21.15.59:0/2259031286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe69006e570 msgr2=0x7fe69006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.713+0000 7fe696c49700 1 --2- 172.21.15.59:0/2259031286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe69006e570 0x7fe69006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.713+0000 7fe696c49700 1 -- 172.21.15.59:0/2259031286 >> v1:172.21.15.59:6789/0 conn(0x7fe69009eca0 legacy=0x7fe690134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.713+0000 7fe696c49700 1 -- 172.21.15.59:0/2259031286 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6900711a0 con 0x7fe69006ee80 2023-09-30T22:31:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.714+0000 7fe696c49700 1 --2- 172.21.15.59:0/2259031286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69006ee80 0x7fe690134d20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe688009dc0 tx=0x7fe68800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1398a8e4c8c0dbc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.714+0000 7fe695446700 1 -- 172.21.15.59:0/2259031286 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68800e070 con 0x7fe69006ee80 2023-09-30T22:31:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.714+0000 7fe695446700 1 -- 172.21.15.59:0/2259031286 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68800bb20 con 0x7fe69006ee80 2023-09-30T22:31:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.714+0000 7fe695446700 1 -- 172.21.15.59:0/2259031286 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688012430 con 0x7fe69006ee80 2023-09-30T22:31:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.715+0000 7fe6986ac700 1 -- 172.21.15.59:0/2259031286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69006ee80 msgr2=0x7fe690134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.715+0000 7fe6986ac700 1 --2- 172.21.15.59:0/2259031286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69006ee80 0x7fe690134d20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe688009dc0 tx=0x7fe68800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.715+0000 7fe6986ac700 1 -- 172.21.15.59:0/2259031286 shutdown_connections 2023-09-30T22:31:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.715+0000 7fe6986ac700 1 --2- 172.21.15.59:0/2259031286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69006ee80 0x7fe690134d20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.715+0000 7fe6986ac700 1 --2- 172.21.15.59:0/2259031286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe69006e570 0x7fe69006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.715+0000 7fe6986ac700 1 -- 172.21.15.59:0/2259031286 >> 172.21.15.59:0/2259031286 conn(0x7fe6900a2aa0 msgr2=0x7fe6900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.715+0000 7fe6986ac700 1 -- 172.21.15.59:0/2259031286 shutdown_connections 2023-09-30T22:31:44.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.715+0000 7fe6986ac700 1 -- 172.21.15.59:0/2259031286 wait complete. 2023-09-30T22:31:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.716+0000 7fe6986ac700 1 Processor -- start 2023-09-30T22:31:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.716+0000 7fe6986ac700 1 -- start start 2023-09-30T22:31:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.717+0000 7fe6986ac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe69006e570 0x7fe690134990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.717+0000 7fe6986ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69006ee80 0x7fe6901389f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.717+0000 7fe6986ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe690138f30 0x7fe690139390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.717+0000 7fe6986ac700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69013b470 con 0x7fe69006e570 2023-09-30T22:31:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.717+0000 7fe6986ac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69013bfe0 con 0x7fe690138f30 2023-09-30T22:31:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.717+0000 7fe6986ac700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe69009e970 con 0x7fe69006ee80 2023-09-30T22:31:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.717+0000 7fe696448700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe69006e570 0x7fe690134990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.717+0000 7fe696448700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe69006e570 0x7fe690134990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49342/0 (socket says 172.21.15.59:49342) 2023-09-30T22:31:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.717+0000 7fe696448700 1 -- 172.21.15.59:0/2470974217 learned_addr learned my addr 172.21.15.59:0/2470974217 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.717+0000 7fe695c47700 1 --2- 172.21.15.59:0/2470974217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69006ee80 0x7fe6901389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.717+0000 7fe696c49700 1 --2- 172.21.15.59:0/2470974217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe690138f30 0x7fe690139390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.718+0000 7fe696c49700 1 -- 172.21.15.59:0/2470974217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69006ee80 msgr2=0x7fe6901389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.718+0000 7fe696c49700 1 --2- 172.21.15.59:0/2470974217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69006ee80 0x7fe6901389f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.718+0000 7fe696c49700 1 -- 172.21.15.59:0/2470974217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe69006e570 msgr2=0x7fe690134990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.718+0000 7fe696c49700 1 --2- 172.21.15.59:0/2470974217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe69006e570 0x7fe690134990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.718+0000 7fe696c49700 1 -- 172.21.15.59:0/2470974217 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe688009a70 con 0x7fe690138f30 2023-09-30T22:31:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.718+0000 7fe696448700 1 --2- 172.21.15.59:0/2470974217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe69006e570 0x7fe690134990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.718+0000 7fe696c49700 1 --2- 172.21.15.59:0/2470974217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe690138f30 0x7fe690139390 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe688016000 tx=0x7fe688004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.718+0000 7fe686ffd700 1 -- 172.21.15.59:0/2470974217 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688004800 con 0x7fe690138f30 2023-09-30T22:31:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.718+0000 7fe686ffd700 1 -- 172.21.15.59:0/2470974217 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe688020070 con 0x7fe690138f30 2023-09-30T22:31:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.718+0000 7fe6986ac700 1 -- 172.21.15.59:0/2470974217 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe690140a20 con 0x7fe690138f30 2023-09-30T22:31:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.718+0000 7fe686ffd700 1 -- 172.21.15.59:0/2470974217 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6880276c0 con 0x7fe690138f30 2023-09-30T22:31:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.718+0000 7fe6986ac700 1 -- 172.21.15.59:0/2470974217 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6901355b0 con 0x7fe690138f30 2023-09-30T22:31:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.720+0000 7fe6986ac700 1 -- 172.21.15.59:0/2470974217 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe690070670 con 0x7fe690138f30 2023-09-30T22:31:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.720+0000 7fe686ffd700 1 -- 172.21.15.59:0/2470974217 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe688012430 con 0x7fe690138f30 2023-09-30T22:31:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.720+0000 7fe686ffd700 1 -- 172.21.15.59:0/2470974217 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe688022070 con 0x7fe690138f30 2023-09-30T22:31:44.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.725+0000 7fe686ffd700 1 -- 172.21.15.59:0/2470974217 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe688046060 con 0x7fe690138f30 2023-09-30T22:31:44.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.735+0000 7f56beded700 1 Processor -- start 2023-09-30T22:31:44.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.735+0000 7f56beded700 1 -- start start 2023-09-30T22:31:44.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.736+0000 7f56beded700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56b809d6f0 0x7f56b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.736+0000 7f56beded700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b809e000 0x7f56b8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.736+0000 7f56beded700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b809f130 con 0x7f56b809e410 2023-09-30T22:31:44.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.736+0000 7f56beded700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b809f520 con 0x7f56b809e000 2023-09-30T22:31:44.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.736+0000 7f56beded700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56b809e930 con 0x7f56b809d6f0 2023-09-30T22:31:44.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.736+0000 7f56bcb89700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56b809d6f0 0x7f56b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.736+0000 7f56b7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b809e000 0x7f56b8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.736+0000 7f56bcb89700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56b809d6f0 0x7f56b809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38812/0 (socket says 172.21.15.59:38812) 2023-09-30T22:31:44.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.736+0000 7f56bcb89700 1 -- 172.21.15.59:0/2402984249 learned_addr learned my addr 172.21.15.59:0/2402984249 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:44.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.736+0000 7f56b7fff700 1 --2- 172.21.15.59:0/2402984249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b809e000 0x7f56b8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60206/0 (socket says 172.21.15.59:60206) 2023-09-30T22:31:44.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.737+0000 7f56bcb89700 1 -- 172.21.15.59:0/2402984249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b809e000 msgr2=0x7f56b8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:44.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.737+0000 7f56bcb89700 1 --2- 172.21.15.59:0/2402984249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b809e000 0x7f56b8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.737+0000 7f56bcb89700 1 -- 172.21.15.59:0/2402984249 >> v1:172.21.15.59:6789/0 conn(0x7f56b809e410 legacy=0x7f56b8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:44.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.737+0000 7f56bcb89700 1 -- 172.21.15.59:0/2402984249 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b809b2d0 con 0x7f56b809d6f0 2023-09-30T22:31:44.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.737+0000 7f56b7fff700 1 --2- 172.21.15.59:0/2402984249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b809e000 0x7f56b8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:44.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.737+0000 7f56bcb89700 1 --2- 172.21.15.59:0/2402984249 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56b809d6f0 0x7f56b809dac0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009950 tx=0x7f56ac009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef7b49c45066a816 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.737+0000 7f56b77fe700 1 -- 172.21.15.59:0/2402984249 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac004230 con 0x7f56b809d6f0 2023-09-30T22:31:44.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.737+0000 7f56b77fe700 1 -- 172.21.15.59:0/2402984249 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ac004390 con 0x7f56b809d6f0 2023-09-30T22:31:44.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.737+0000 7f56b77fe700 1 -- 172.21.15.59:0/2402984249 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0036a0 con 0x7f56b809d6f0 2023-09-30T22:31:44.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.738+0000 7f56beded700 1 -- 172.21.15.59:0/2402984249 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56b809d6f0 msgr2=0x7f56b809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.738+0000 7f56beded700 1 --2- 172.21.15.59:0/2402984249 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56b809d6f0 0x7f56b809dac0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009950 tx=0x7f56ac009c60 comp rx=0 tx=0).stop 2023-09-30T22:31:44.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.738+0000 7f56beded700 1 -- 172.21.15.59:0/2402984249 shutdown_connections 2023-09-30T22:31:44.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.738+0000 7f56beded700 1 --2- 172.21.15.59:0/2402984249 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56b809d6f0 0x7f56b809dac0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.738+0000 7f56beded700 1 --2- 172.21.15.59:0/2402984249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b809e000 0x7f56b8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.738+0000 7f56beded700 1 -- 172.21.15.59:0/2402984249 >> 172.21.15.59:0/2402984249 conn(0x7f56b8066f50 msgr2=0x7f56b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.738+0000 7f56beded700 1 -- 172.21.15.59:0/2402984249 shutdown_connections 2023-09-30T22:31:44.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.738+0000 7f56beded700 1 -- 172.21.15.59:0/2402984249 wait complete. 2023-09-30T22:31:44.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.739+0000 7f56beded700 1 Processor -- start 2023-09-30T22:31:44.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.739+0000 7f56beded700 1 -- start start 2023-09-30T22:31:44.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.740+0000 7f56beded700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b809d6f0 0x7f56b8119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.740+0000 7f56beded700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56b809e000 0x7f56b81199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.740+0000 7f56beded700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56b809e410 0x7f56b8119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.740+0000 7f56beded700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b811c600 con 0x7f56b809e000 2023-09-30T22:31:44.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.740+0000 7f56beded700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b811b9d0 con 0x7f56b809d6f0 2023-09-30T22:31:44.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.740+0000 7f56beded700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56b809c700 con 0x7f56b809e410 2023-09-30T22:31:44.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.740+0000 7f56b7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56b809e000 0x7f56b81199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.740+0000 7f56b7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56b809e000 0x7f56b81199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49358/0 (socket says 172.21.15.59:49358) 2023-09-30T22:31:44.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.740+0000 7f56b7fff700 1 -- 172.21.15.59:0/3906598506 learned_addr learned my addr 172.21.15.59:0/3906598506 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:44.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.740+0000 7f56bcb89700 1 --2- 172.21.15.59:0/3906598506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b809d6f0 0x7f56b8119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.740+0000 7f56bd38a700 1 --2- 172.21.15.59:0/3906598506 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56b809e410 0x7f56b8119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.741+0000 7f56b7fff700 1 -- 172.21.15.59:0/3906598506 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56b809e410 msgr2=0x7f56b8119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.741+0000 7f56b7fff700 1 --2- 172.21.15.59:0/3906598506 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56b809e410 0x7f56b8119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.741+0000 7f56b7fff700 1 -- 172.21.15.59:0/3906598506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b809d6f0 msgr2=0x7f56b8119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.741+0000 7f56b7fff700 1 --2- 172.21.15.59:0/3906598506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b809d6f0 0x7f56b8119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.741+0000 7f56b7fff700 1 -- 172.21.15.59:0/3906598506 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a40094a0 con 0x7f56b809e000 2023-09-30T22:31:44.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.741+0000 7f56b7fff700 1 --2- 172.21.15.59:0/3906598506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56b809e000 0x7f56b81199c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f56a400ebe0 tx=0x7f56a400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.742+0000 7f56b57fa700 1 -- 172.21.15.59:0/3906598506 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a400c850 con 0x7f56b809e000 2023-09-30T22:31:44.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.742+0000 7f56b57fa700 1 -- 172.21.15.59:0/3906598506 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a400c9b0 con 0x7f56b809e000 2023-09-30T22:31:44.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.742+0000 7f56b57fa700 1 -- 172.21.15.59:0/3906598506 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a400cd40 con 0x7f56b809e000 2023-09-30T22:31:44.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.742+0000 7f56beded700 1 -- 172.21.15.59:0/3906598506 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ac009550 con 0x7f56b809e000 2023-09-30T22:31:44.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.742+0000 7f56beded700 1 -- 172.21.15.59:0/3906598506 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b811af50 con 0x7f56b809e000 2023-09-30T22:31:44.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.743+0000 7f56b57fa700 1 -- 172.21.15.59:0/3906598506 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56a4013470 con 0x7f56b809e000 2023-09-30T22:31:44.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.743+0000 7f56beded700 1 -- 172.21.15.59:0/3906598506 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b8074ea0 con 0x7f56b809e000 2023-09-30T22:31:44.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.743+0000 7f56b57fa700 1 -- 172.21.15.59:0/3906598506 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f56a403fad0 con 0x7f56b809e000 2023-09-30T22:31:44.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.753+0000 7f56b57fa700 1 -- 172.21.15.59:0/3906598506 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56a4041e60 con 0x7f56b809e000 2023-09-30T22:31:44.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.809+0000 7f8b4380f700 1 -- 172.21.15.59:0/3225001390 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8b3c06b9e0 con 0x7f8b3c09e930 2023-09-30T22:31:44.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.809+0000 7f8b31ffb700 1 -- 172.21.15.59:0/3225001390 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b2c017020 con 0x7f8b3c09e930 2023-09-30T22:31:44.810 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:44.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.813+0000 7f8b4380f700 1 -- 172.21.15.59:0/3225001390 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b3c09e930 msgr2=0x7f8b3c11f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.813+0000 7f8b4380f700 1 --2- 172.21.15.59:0/3225001390 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b3c09e930 0x7f8b3c11f4e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00c480 tx=0x7f8b2c00c790 comp rx=0 tx=0).stop 2023-09-30T22:31:44.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.813+0000 7f8b4380f700 1 -- 172.21.15.59:0/3225001390 shutdown_connections 2023-09-30T22:31:44.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.813+0000 7f8b4380f700 1 --2- 172.21.15.59:0/3225001390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b3c1338a0 0x7f8b3c11fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.813+0000 7f8b4380f700 1 --2- 172.21.15.59:0/3225001390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b3c09de50 0x7f8b3c11efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.813+0000 7f8b4380f700 1 --2- 172.21.15.59:0/3225001390 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b3c09e930 0x7f8b3c11f4e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.813+0000 7f8b4380f700 1 -- 172.21.15.59:0/3225001390 >> 172.21.15.59:0/3225001390 conn(0x7f8b3c0a2aa0 msgr2=0x7f8b3c09ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.813+0000 7f8b4380f700 1 -- 172.21.15.59:0/3225001390 shutdown_connections 2023-09-30T22:31:44.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.813+0000 7f8b4380f700 1 -- 172.21.15.59:0/3225001390 wait complete. 2023-09-30T22:31:44.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:44.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.902+0000 7f9824b2f700 1 -- 172.21.15.59:0/3020096134 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f982006b250 con 0x7f982009f650 2023-09-30T22:31:44.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.902+0000 7f980effd700 1 -- 172.21.15.59:0/3020096134 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9818013b70 con 0x7f982009f650 2023-09-30T22:31:44.903 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:44.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.905+0000 7f9824b2f700 1 -- 172.21.15.59:0/3020096134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f982009f650 msgr2=0x7f982012db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.905+0000 7f9824b2f700 1 --2- 172.21.15.59:0/3020096134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f982009f650 0x7f982012db20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9818007e40 tx=0x7f981800e3c0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.905+0000 7f9824b2f700 1 -- 172.21.15.59:0/3020096134 shutdown_connections 2023-09-30T22:31:44.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.905+0000 7f9824b2f700 1 --2- 172.21.15.59:0/3020096134 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f982009e930 0x7f982012d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.905+0000 7f9824b2f700 1 --2- 172.21.15.59:0/3020096134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f982009f650 0x7f982012db20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.905+0000 7f9824b2f700 1 --2- 172.21.15.59:0/3020096134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f982009f240 0x7f982012d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.905+0000 7f9824b2f700 1 -- 172.21.15.59:0/3020096134 >> 172.21.15.59:0/3020096134 conn(0x7f98200a4210 msgr2=0x7f982006c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.905+0000 7f9824b2f700 1 -- 172.21.15.59:0/3020096134 shutdown_connections 2023-09-30T22:31:44.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.905+0000 7f9824b2f700 1 -- 172.21.15.59:0/3020096134 wait complete. 2023-09-30T22:31:44.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:44.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.939+0000 7fe6986ac700 1 -- 172.21.15.59:0/2470974217 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe690074ea0 con 0x7fe690138f30 2023-09-30T22:31:44.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.940+0000 7fe686ffd700 1 -- 172.21.15.59:0/2470974217 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe688046070 con 0x7fe690138f30 2023-09-30T22:31:44.940 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:44.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.942+0000 7fe6986ac700 1 -- 172.21.15.59:0/2470974217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe690138f30 msgr2=0x7fe690139390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.942+0000 7fe6986ac700 1 --2- 172.21.15.59:0/2470974217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe690138f30 0x7fe690139390 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe688016000 tx=0x7fe688004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.942+0000 7fe6986ac700 1 -- 172.21.15.59:0/2470974217 shutdown_connections 2023-09-30T22:31:44.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.942+0000 7fe6986ac700 1 --2- 172.21.15.59:0/2470974217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe690138f30 0x7fe690139390 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.942+0000 7fe6986ac700 1 --2- 172.21.15.59:0/2470974217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe69006e570 0x7fe690134990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.942+0000 7fe6986ac700 1 --2- 172.21.15.59:0/2470974217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69006ee80 0x7fe6901389f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.942+0000 7fe6986ac700 1 -- 172.21.15.59:0/2470974217 >> 172.21.15.59:0/2470974217 conn(0x7fe6900a2aa0 msgr2=0x7fe6900a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.942+0000 7fe6986ac700 1 -- 172.21.15.59:0/2470974217 shutdown_connections 2023-09-30T22:31:44.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.942+0000 7fe6986ac700 1 -- 172.21.15.59:0/2470974217 wait complete. 2023-09-30T22:31:44.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:44.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.964+0000 7f56beded700 1 -- 172.21.15.59:0/3906598506 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f56b806c360 con 0x7f56b809e000 2023-09-30T22:31:44.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.964+0000 7f56b57fa700 1 -- 172.21.15.59:0/3906598506 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56a4021020 con 0x7f56b809e000 2023-09-30T22:31:44.964 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:44.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.967+0000 7f56beded700 1 -- 172.21.15.59:0/3906598506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56b809e000 msgr2=0x7f56b81199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.967+0000 7f56beded700 1 --2- 172.21.15.59:0/3906598506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56b809e000 0x7f56b81199c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f56a400ebe0 tx=0x7f56a400eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.967+0000 7f56beded700 1 -- 172.21.15.59:0/3906598506 shutdown_connections 2023-09-30T22:31:44.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.967+0000 7f56beded700 1 --2- 172.21.15.59:0/3906598506 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56b809e410 0x7f56b8119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.967+0000 7f56beded700 1 --2- 172.21.15.59:0/3906598506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b809d6f0 0x7f56b8119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.967+0000 7f56beded700 1 --2- 172.21.15.59:0/3906598506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56b809e000 0x7f56b81199c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.967+0000 7f56beded700 1 -- 172.21.15.59:0/3906598506 >> 172.21.15.59:0/3906598506 conn(0x7f56b8066f50 msgr2=0x7f56b813ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.967+0000 7f56beded700 1 -- 172.21.15.59:0/3906598506 shutdown_connections 2023-09-30T22:31:44.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:44.967+0000 7f56beded700 1 -- 172.21.15.59:0/3906598506 wait complete. 2023-09-30T22:31:44.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:45.832 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:45.920 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:45.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.980+0000 7f2d3babe700 1 Processor -- start 2023-09-30T22:31:45.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.981+0000 7f2d3babe700 1 -- start start 2023-09-30T22:31:45.981 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:45.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.981+0000 7f2d3babe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d3409e1d0 0x7f2d34138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.981+0000 7f2d3babe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d34139170 0x7f2d3413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.981+0000 7f2d3babe700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3409b120 con 0x7f2d3409d6f0 2023-09-30T22:31:45.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.981+0000 7f2d3babe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3406b460 con 0x7f2d3409e1d0 2023-09-30T22:31:45.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.981+0000 7f2d3babe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3409a7e0 con 0x7f2d34139170 2023-09-30T22:31:45.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.981+0000 7f2d3a05b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d34139170 0x7f2d3413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.981+0000 7f2d39059700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d3409e1d0 0x7f2d34138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.981+0000 7f2d3985a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2d3409d6f0 0x7f2d3409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46682/0 (socket says 172.21.15.59:46682) 2023-09-30T22:31:45.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.981+0000 7f2d3985a700 1 -- 172.21.15.59:0/55449498 learned_addr learned my addr 172.21.15.59:0/55449498 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:45.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.982+0000 7f2d39059700 1 -- 172.21.15.59:0/55449498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d34139170 msgr2=0x7f2d3413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:45.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.982+0000 7f2d39059700 1 --2- 172.21.15.59:0/55449498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d34139170 0x7f2d3413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.982+0000 7f2d39059700 1 -- 172.21.15.59:0/55449498 >> v1:172.21.15.59:6789/0 conn(0x7f2d3409d6f0 legacy=0x7f2d3409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.982+0000 7f2d38858700 1 -- 172.21.15.59:0/55449498 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555077810 0 0) 0x7f2d3409b120 con 0x7f2d3409d6f0 2023-09-30T22:31:45.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.982+0000 7f2d39059700 1 -- 172.21.15.59:0/55449498 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3409a500 con 0x7f2d3409e1d0 2023-09-30T22:31:45.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.982+0000 7f2d39059700 1 --2- 172.21.15.59:0/55449498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d3409e1d0 0x7f2d34138c30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009870 tx=0x7f2d24009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f018c59a144af6a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:45.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.982+0000 7f2d38858700 1 -- 172.21.15.59:0/55449498 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24011830 con 0x7f2d3409e1d0 2023-09-30T22:31:45.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.982+0000 7f2d38858700 1 -- 172.21.15.59:0/55449498 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d24011990 con 0x7f2d3409e1d0 2023-09-30T22:31:45.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.982+0000 7f2d38858700 1 -- 172.21.15.59:0/55449498 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24011d20 con 0x7f2d3409e1d0 2023-09-30T22:31:45.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.983+0000 7f2d3babe700 1 -- 172.21.15.59:0/55449498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d3409e1d0 msgr2=0x7f2d34138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.983+0000 7f2d3babe700 1 --2- 172.21.15.59:0/55449498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d3409e1d0 0x7f2d34138c30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009870 tx=0x7f2d24009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:45.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.983+0000 7f2d3babe700 1 -- 172.21.15.59:0/55449498 shutdown_connections 2023-09-30T22:31:45.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.983+0000 7f2d3babe700 1 --2- 172.21.15.59:0/55449498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d34139170 0x7f2d3413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.983+0000 7f2d3babe700 1 --2- 172.21.15.59:0/55449498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d3409e1d0 0x7f2d34138c30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.983+0000 7f2d3babe700 1 -- 172.21.15.59:0/55449498 >> 172.21.15.59:0/55449498 conn(0x7f2d34066f50 msgr2=0x7f2d3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:45.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.983+0000 7f2d3babe700 1 -- 172.21.15.59:0/55449498 shutdown_connections 2023-09-30T22:31:45.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.983+0000 7f2d3babe700 1 -- 172.21.15.59:0/55449498 wait complete. 2023-09-30T22:31:45.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.984+0000 7f2d3babe700 1 Processor -- start 2023-09-30T22:31:45.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.984+0000 7f2d3babe700 1 -- start start 2023-09-30T22:31:45.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d3babe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d3409d6f0 0x7f2d341217b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d3babe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d3409e1d0 0x7f2d34121cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d3babe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d34139170 0x7f2d34122230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d3babe700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34124230 con 0x7f2d3409d6f0 2023-09-30T22:31:45.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d3babe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34124f50 con 0x7f2d34139170 2023-09-30T22:31:45.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d3babe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340a2090 con 0x7f2d3409e1d0 2023-09-30T22:31:45.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d39059700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d3409e1d0 0x7f2d34121cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d3a05b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d34139170 0x7f2d34122230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d39059700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d3409e1d0 0x7f2d34121cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38842/0 (socket says 172.21.15.59:38842) 2023-09-30T22:31:45.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d3a05b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d34139170 0x7f2d34122230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60236/0 (socket says 172.21.15.59:60236) 2023-09-30T22:31:45.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d39059700 1 -- 172.21.15.59:0/527829209 learned_addr learned my addr 172.21.15.59:0/527829209 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:45.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d39059700 1 -- 172.21.15.59:0/527829209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d34139170 msgr2=0x7f2d34122230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d39059700 1 --2- 172.21.15.59:0/527829209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d34139170 0x7f2d34122230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d39059700 1 -- 172.21.15.59:0/527829209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d3409d6f0 msgr2=0x7f2d341217b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d3985a700 1 --2- 172.21.15.59:0/527829209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d3409d6f0 0x7f2d341217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d39059700 1 --2- 172.21.15.59:0/527829209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d3409d6f0 0x7f2d341217b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.985+0000 7f2d39059700 1 -- 172.21.15.59:0/527829209 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d240094a0 con 0x7f2d3409e1d0 2023-09-30T22:31:45.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.986+0000 7f2d3985a700 1 --2- 172.21.15.59:0/527829209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d3409d6f0 0x7f2d341217b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:45.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.986+0000 7f2d39059700 1 --2- 172.21.15.59:0/527829209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d3409e1d0 0x7f2d34121cf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2d24000c00 tx=0x7f2d24004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:45.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.986+0000 7f2d2a7fc700 1 -- 172.21.15.59:0/527829209 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2401a6e0 con 0x7f2d3409e1d0 2023-09-30T22:31:45.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.986+0000 7f2d2a7fc700 1 -- 172.21.15.59:0/527829209 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2401a840 con 0x7f2d3409e1d0 2023-09-30T22:31:45.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.986+0000 7f2d3babe700 1 -- 172.21.15.59:0/527829209 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3409c710 con 0x7f2d3409e1d0 2023-09-30T22:31:45.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.986+0000 7f2d2a7fc700 1 -- 172.21.15.59:0/527829209 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2401abd0 con 0x7f2d3409e1d0 2023-09-30T22:31:45.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.986+0000 7f2d3babe700 1 -- 172.21.15.59:0/527829209 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d341259c0 con 0x7f2d3409e1d0 2023-09-30T22:31:45.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.987+0000 7f2d3babe700 1 -- 172.21.15.59:0/527829209 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d34074ea0 con 0x7f2d3409e1d0 2023-09-30T22:31:45.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.988+0000 7f2d2a7fc700 1 -- 172.21.15.59:0/527829209 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d24022070 con 0x7f2d3409e1d0 2023-09-30T22:31:45.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.988+0000 7f2d2a7fc700 1 -- 172.21.15.59:0/527829209 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d24040b20 con 0x7f2d3409e1d0 2023-09-30T22:31:45.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:45.994+0000 7f2d2a7fc700 1 -- 172.21.15.59:0/527829209 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d2402d3b0 con 0x7f2d3409e1d0 2023-09-30T22:31:46.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.067+0000 7fc5d7568700 1 Processor -- start 2023-09-30T22:31:46.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.067+0000 7fc5d7568700 1 -- start start 2023-09-30T22:31:46.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.068+0000 7fc5d7568700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc5d009e1d0 0x7fc5d0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.068+0000 7fc5d7568700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d0139170 0x7fc5d013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.068+0000 7fc5d7568700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d009b120 con 0x7fc5d009d6f0 2023-09-30T22:31:46.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.068+0000 7fc5d7568700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d006b460 con 0x7fc5d009e1d0 2023-09-30T22:31:46.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.068+0000 7fc5d7568700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d009a7e0 con 0x7fc5d0139170 2023-09-30T22:31:46.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.068+0000 7fc5d5b05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d0139170 0x7fc5d013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.068+0000 7fc5d5b05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d0139170 0x7fc5d013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60250/0 (socket says 172.21.15.59:60250) 2023-09-30T22:31:46.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.068+0000 7fc5d5b05700 1 -- 172.21.15.59:0/3143163193 learned_addr learned my addr 172.21.15.59:0/3143163193 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:46.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.068+0000 7fc5d4b03700 1 --2- 172.21.15.59:0/3143163193 >> v2:172.21.15.59:3300/0 conn(0x7fc5d009e1d0 0x7fc5d0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.069+0000 7fc5d5b05700 1 -- 172.21.15.59:0/3143163193 >> v2:172.21.15.59:3300/0 conn(0x7fc5d009e1d0 msgr2=0x7fc5d0138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:46.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.069+0000 7fc5d5b05700 1 --2- 172.21.15.59:0/3143163193 >> v2:172.21.15.59:3300/0 conn(0x7fc5d009e1d0 0x7fc5d0138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.069+0000 7fc5d5b05700 1 -- 172.21.15.59:0/3143163193 >> v1:172.21.15.59:6789/0 conn(0x7fc5d009d6f0 legacy=0x7fc5d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:46.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.069+0000 7fc5d5b05700 1 -- 172.21.15.59:0/3143163193 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d009a500 con 0x7fc5d0139170 2023-09-30T22:31:46.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.069+0000 7fc5d5b05700 1 --2- 172.21.15.59:0/3143163193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d0139170 0x7fc5d013b550 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009e80 tx=0x7fc5c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7518de82130e97ef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:46.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.069+0000 7fc5c7fff700 1 -- 172.21.15.59:0/3143163193 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c800e070 con 0x7fc5d0139170 2023-09-30T22:31:46.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.069+0000 7fc5c7fff700 1 -- 172.21.15.59:0/3143163193 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c800b8d0 con 0x7fc5d0139170 2023-09-30T22:31:46.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.069+0000 7fc5c7fff700 1 -- 172.21.15.59:0/3143163193 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c800bc80 con 0x7fc5d0139170 2023-09-30T22:31:46.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.070+0000 7fc5d7568700 1 -- 172.21.15.59:0/3143163193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d0139170 msgr2=0x7fc5d013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.070+0000 7fc5d7568700 1 --2- 172.21.15.59:0/3143163193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d0139170 0x7fc5d013b550 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009e80 tx=0x7fc5c800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.070+0000 7fc5d7568700 1 -- 172.21.15.59:0/3143163193 shutdown_connections 2023-09-30T22:31:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.070+0000 7fc5d7568700 1 --2- 172.21.15.59:0/3143163193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d0139170 0x7fc5d013b550 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.070+0000 7fc5d7568700 1 --2- 172.21.15.59:0/3143163193 >> v2:172.21.15.59:3300/0 conn(0x7fc5d009e1d0 0x7fc5d0138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.070+0000 7fc5d7568700 1 -- 172.21.15.59:0/3143163193 >> 172.21.15.59:0/3143163193 conn(0x7fc5d0066f50 msgr2=0x7fc5d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.070+0000 7fc5d7568700 1 -- 172.21.15.59:0/3143163193 shutdown_connections 2023-09-30T22:31:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.070+0000 7fc5d7568700 1 -- 172.21.15.59:0/3143163193 wait complete. 2023-09-30T22:31:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.071+0000 7fc5d7568700 1 Processor -- start 2023-09-30T22:31:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.071+0000 7fc5d7568700 1 -- start start 2023-09-30T22:31:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d7568700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009d6f0 0x7fc5d01c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d7568700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d009e1d0 0x7fc5d01c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d7568700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d0139170 0x7fc5d011e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d7568700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d01220c0 con 0x7fc5d0139170 2023-09-30T22:31:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d7568700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d01203b0 con 0x7fc5d009e1d0 2023-09-30T22:31:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d7568700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d0134670 con 0x7fc5d009d6f0 2023-09-30T22:31:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d5b05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d0139170 0x7fc5d011e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d5b05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d0139170 0x7fc5d011e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49382/0 (socket says 172.21.15.59:49382) 2023-09-30T22:31:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d5b05700 1 -- 172.21.15.59:0/3440872658 learned_addr learned my addr 172.21.15.59:0/3440872658 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d4b03700 1 --2- 172.21.15.59:0/3440872658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d009e1d0 0x7fc5d01c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d5b05700 1 -- 172.21.15.59:0/3440872658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009d6f0 msgr2=0x7fc5d01c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d5b05700 1 --2- 172.21.15.59:0/3440872658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009d6f0 0x7fc5d01c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d5b05700 1 -- 172.21.15.59:0/3440872658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d009e1d0 msgr2=0x7fc5d01c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d5b05700 1 --2- 172.21.15.59:0/3440872658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d009e1d0 0x7fc5d01c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d5b05700 1 -- 172.21.15.59:0/3440872658 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c8009b30 con 0x7fc5d0139170 2023-09-30T22:31:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.072+0000 7fc5d4b03700 1 --2- 172.21.15.59:0/3440872658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d009e1d0 0x7fc5d01c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.073+0000 7fc5d5b05700 1 --2- 172.21.15.59:0/3440872658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d0139170 0x7fc5d011e830 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8012000 tx=0x7fc5c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:46.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.073+0000 7fc5c5ffb700 1 -- 172.21.15.59:0/3440872658 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8004960 con 0x7fc5d0139170 2023-09-30T22:31:46.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.073+0000 7fc5c5ffb700 1 -- 172.21.15.59:0/3440872658 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c80092e0 con 0x7fc5d0139170 2023-09-30T22:31:46.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.073+0000 7fc5d7568700 1 -- 172.21.15.59:0/3440872658 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d00726b0 con 0x7fc5d0139170 2023-09-30T22:31:46.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.073+0000 7fc5c5ffb700 1 -- 172.21.15.59:0/3440872658 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c801c660 con 0x7fc5d0139170 2023-09-30T22:31:46.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.073+0000 7fc5d7568700 1 -- 172.21.15.59:0/3440872658 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d01c90f0 con 0x7fc5d0139170 2023-09-30T22:31:46.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.074+0000 7fc5c5ffb700 1 -- 172.21.15.59:0/3440872658 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5c801c7c0 con 0x7fc5d0139170 2023-09-30T22:31:46.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.075+0000 7fc5d7568700 1 -- 172.21.15.59:0/3440872658 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d0074ea0 con 0x7fc5d0139170 2023-09-30T22:31:46.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.075+0000 7fc5c5ffb700 1 -- 172.21.15.59:0/3440872658 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc5c8041090 con 0x7fc5d0139170 2023-09-30T22:31:46.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.080+0000 7fc5c5ffb700 1 -- 172.21.15.59:0/3440872658 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5c80123f0 con 0x7fc5d0139170 2023-09-30T22:31:46.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.123+0000 7f4c6ee19700 1 Processor -- start 2023-09-30T22:31:46.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.123+0000 7f4c6ee19700 1 -- start start 2023-09-30T22:31:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.124+0000 7f4c6ee19700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c6809e1d0 0x7f4c68138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.124+0000 7f4c6ee19700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c68139170 0x7f4c6813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.124+0000 7f4c6ee19700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c6809b120 con 0x7f4c6809d6f0 2023-09-30T22:31:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.124+0000 7f4c6ee19700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c6806b460 con 0x7f4c68139170 2023-09-30T22:31:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.124+0000 7f4c6ee19700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6809a7e0 con 0x7f4c6809e1d0 2023-09-30T22:31:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.124+0000 7f4c6cbb5700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4c6809d6f0 0x7f4c6809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46708/0 (socket says 172.21.15.59:46708) 2023-09-30T22:31:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.124+0000 7f4c6cbb5700 1 -- 172.21.15.59:0/3031030514 learned_addr learned my addr 172.21.15.59:0/3031030514 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.124+0000 7f4c67fff700 1 --2- 172.21.15.59:0/3031030514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c6809e1d0 0x7f4c68138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.124+0000 7f4c6d3b6700 1 --2- 172.21.15.59:0/3031030514 >> v2:172.21.15.59:3300/0 conn(0x7f4c68139170 0x7f4c6813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.125+0000 7f4c677fe700 1 -- 172.21.15.59:0/3031030514 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650245214 0 0) 0x7f4c6809b120 con 0x7f4c6809d6f0 2023-09-30T22:31:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.125+0000 7f4c677fe700 1 -- 172.21.15.59:0/3031030514 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c580035b0 con 0x7f4c6809d6f0 2023-09-30T22:31:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.125+0000 7f4c67fff700 1 -- 172.21.15.59:0/3031030514 >> v2:172.21.15.59:3300/0 conn(0x7f4c68139170 msgr2=0x7f4c6813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.125+0000 7f4c67fff700 1 --2- 172.21.15.59:0/3031030514 >> v2:172.21.15.59:3300/0 conn(0x7f4c68139170 0x7f4c6813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.125+0000 7f4c67fff700 1 -- 172.21.15.59:0/3031030514 >> v1:172.21.15.59:6789/0 conn(0x7f4c6809d6f0 legacy=0x7f4c6809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.125+0000 7f4c67fff700 1 -- 172.21.15.59:0/3031030514 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6809a500 con 0x7f4c6809e1d0 2023-09-30T22:31:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.125+0000 7f4c67fff700 1 --2- 172.21.15.59:0/3031030514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c6809e1d0 0x7f4c68138c30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009870 tx=0x7f4c54009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e451200f82deef50 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.125+0000 7f4c677fe700 1 -- 172.21.15.59:0/3031030514 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54011830 con 0x7f4c6809e1d0 2023-09-30T22:31:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.125+0000 7f4c677fe700 1 -- 172.21.15.59:0/3031030514 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c54011990 con 0x7f4c6809e1d0 2023-09-30T22:31:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.125+0000 7f4c677fe700 1 -- 172.21.15.59:0/3031030514 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54011d20 con 0x7f4c6809e1d0 2023-09-30T22:31:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.126+0000 7f4c6ee19700 1 -- 172.21.15.59:0/3031030514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c6809e1d0 msgr2=0x7f4c68138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.126+0000 7f4c6ee19700 1 --2- 172.21.15.59:0/3031030514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c6809e1d0 0x7f4c68138c30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009870 tx=0x7f4c54009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.126+0000 7f4c6ee19700 1 -- 172.21.15.59:0/3031030514 shutdown_connections 2023-09-30T22:31:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.126+0000 7f4c6ee19700 1 --2- 172.21.15.59:0/3031030514 >> v2:172.21.15.59:3300/0 conn(0x7f4c68139170 0x7f4c6813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.126+0000 7f4c6ee19700 1 --2- 172.21.15.59:0/3031030514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c6809e1d0 0x7f4c68138c30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.126+0000 7f4c6ee19700 1 -- 172.21.15.59:0/3031030514 >> 172.21.15.59:0/3031030514 conn(0x7f4c68066f50 msgr2=0x7f4c6809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.126+0000 7f4c6ee19700 1 -- 172.21.15.59:0/3031030514 shutdown_connections 2023-09-30T22:31:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.126+0000 7f4c6ee19700 1 -- 172.21.15.59:0/3031030514 wait complete. 2023-09-30T22:31:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.128+0000 7f4c6ee19700 1 Processor -- start 2023-09-30T22:31:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.128+0000 7f4c6ee19700 1 -- start start 2023-09-30T22:31:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c6ee19700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c6809d6f0 0x7f4c681216d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c6ee19700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c6809e1d0 0x7f4c68121c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c6ee19700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c68139170 0x7f4c68122150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c6ee19700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c681241a0 con 0x7f4c68139170 2023-09-30T22:31:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c6ee19700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c68124ec0 con 0x7f4c6809d6f0 2023-09-30T22:31:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c6ee19700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c680a2880 con 0x7f4c6809e1d0 2023-09-30T22:31:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c6d3b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c68139170 0x7f4c68122150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c6cbb5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c6809d6f0 0x7f4c681216d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c6d3b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c68139170 0x7f4c68122150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49406/0 (socket says 172.21.15.59:49406) 2023-09-30T22:31:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c6d3b6700 1 -- 172.21.15.59:0/1771051070 learned_addr learned my addr 172.21.15.59:0/1771051070 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c67fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c6809e1d0 0x7f4c68121c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c67fff700 1 -- 172.21.15.59:0/1771051070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c6809d6f0 msgr2=0x7f4c681216d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c67fff700 1 --2- 172.21.15.59:0/1771051070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c6809d6f0 0x7f4c681216d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c67fff700 1 -- 172.21.15.59:0/1771051070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c68139170 msgr2=0x7f4c68122150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c67fff700 1 --2- 172.21.15.59:0/1771051070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c68139170 0x7f4c68122150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c67fff700 1 -- 172.21.15.59:0/1771051070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c540094a0 con 0x7f4c6809e1d0 2023-09-30T22:31:46.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.129+0000 7f4c67fff700 1 --2- 172.21.15.59:0/1771051070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c6809e1d0 0x7f4c68121c10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4c54016000 tx=0x7f4c54004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:46.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.130+0000 7f4c657fa700 1 -- 172.21.15.59:0/1771051070 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54004510 con 0x7f4c6809e1d0 2023-09-30T22:31:46.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.130+0000 7f4c657fa700 1 -- 172.21.15.59:0/1771051070 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5401f070 con 0x7f4c6809e1d0 2023-09-30T22:31:46.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.130+0000 7f4c6ee19700 1 -- 172.21.15.59:0/1771051070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6809c710 con 0x7f4c6809e1d0 2023-09-30T22:31:46.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.130+0000 7f4c657fa700 1 -- 172.21.15.59:0/1771051070 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c540038a0 con 0x7f4c6809e1d0 2023-09-30T22:31:46.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.130+0000 7f4c6ee19700 1 -- 172.21.15.59:0/1771051070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c68125930 con 0x7f4c6809e1d0 2023-09-30T22:31:46.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.131+0000 7f4c6ee19700 1 -- 172.21.15.59:0/1771051070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c681245e0 con 0x7f4c6809e1d0 2023-09-30T22:31:46.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.132+0000 7f4c657fa700 1 -- 172.21.15.59:0/1771051070 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c54003a00 con 0x7f4c6809e1d0 2023-09-30T22:31:46.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.132+0000 7f4c657fa700 1 -- 172.21.15.59:0/1771051070 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4c54021070 con 0x7f4c6809e1d0 2023-09-30T22:31:46.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.134+0000 7fb3e3b9b700 1 Processor -- start 2023-09-30T22:31:46.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.134+0000 7fb3e3b9b700 1 -- start start 2023-09-30T22:31:46.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.135+0000 7fb3e3b9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3dc09d6f0 0x7fb3dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.135+0000 7fb3e3b9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3dc09e000 0x7fb3dc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.135+0000 7fb3e3b9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb3dc09e410 0x7fb3dc133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.135+0000 7fb3e3b9b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc06b460 con 0x7fb3dc09e410 2023-09-30T22:31:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.135+0000 7fb3e3b9b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc09b120 con 0x7fb3dc09e000 2023-09-30T22:31:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.135+0000 7fb3e3b9b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc09a7e0 con 0x7fb3dc09d6f0 2023-09-30T22:31:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.135+0000 7fb3e2138700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb3dc09e410 0x7fb3dc133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.135+0000 7fb3e1136700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3dc09e000 0x7fb3dc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.135+0000 7fb3e2138700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb3dc09e410 0x7fb3dc133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49408/0 (socket says 172.21.15.59:49408) 2023-09-30T22:31:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.135+0000 7fb3e2138700 1 -- 172.21.15.59:0/258065129 learned_addr learned my addr 172.21.15.59:0/258065129 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:46.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.136+0000 7fb3e1937700 1 --2- 172.21.15.59:0/258065129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3dc09d6f0 0x7fb3dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.136+0000 7fb3e2138700 1 -- 172.21.15.59:0/258065129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3dc09d6f0 msgr2=0x7fb3dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:46.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.136+0000 7fb3e2138700 1 --2- 172.21.15.59:0/258065129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3dc09d6f0 0x7fb3dc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.136+0000 7fb3e2138700 1 -- 172.21.15.59:0/258065129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3dc09e000 msgr2=0x7fb3dc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.136+0000 7fb3e2138700 1 --2- 172.21.15.59:0/258065129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3dc09e000 0x7fb3dc1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.136+0000 7fb3e2138700 1 -- 172.21.15.59:0/258065129 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc09a500 con 0x7fb3dc09e410 2023-09-30T22:31:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.136+0000 7fb3e1136700 1 --2- 172.21.15.59:0/258065129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3dc09e000 0x7fb3dc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.136+0000 7fb3e2138700 1 --2- 172.21.15.59:0/258065129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3dc09e410 0x7fb3dc133f30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4009e50 tx=0x7fb3d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3693c317638c2693 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.136+0000 7fb3e0935700 1 -- 172.21.15.59:0/258065129 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d400e070 con 0x7fb3dc09e410 2023-09-30T22:31:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.136+0000 7fb3e0935700 1 -- 172.21.15.59:0/258065129 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d400b910 con 0x7fb3dc09e410 2023-09-30T22:31:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.136+0000 7fb3e0935700 1 -- 172.21.15.59:0/258065129 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d400bcc0 con 0x7fb3dc09e410 2023-09-30T22:31:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.137+0000 7fb3e3b9b700 1 -- 172.21.15.59:0/258065129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3dc09e410 msgr2=0x7fb3dc133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.137+0000 7fb3e3b9b700 1 --2- 172.21.15.59:0/258065129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3dc09e410 0x7fb3dc133f30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4009e50 tx=0x7fb3d400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.137+0000 7fb3e3b9b700 1 -- 172.21.15.59:0/258065129 shutdown_connections 2023-09-30T22:31:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.137+0000 7fb3e3b9b700 1 --2- 172.21.15.59:0/258065129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3dc09e410 0x7fb3dc133f30 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.137+0000 7fb3e3b9b700 1 --2- 172.21.15.59:0/258065129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3dc09d6f0 0x7fb3dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.137+0000 7fb3e3b9b700 1 --2- 172.21.15.59:0/258065129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3dc09e000 0x7fb3dc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.137+0000 7fb3e3b9b700 1 -- 172.21.15.59:0/258065129 >> 172.21.15.59:0/258065129 conn(0x7fb3dc066f50 msgr2=0x7fb3dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:46.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.137+0000 7fb3e3b9b700 1 -- 172.21.15.59:0/258065129 shutdown_connections 2023-09-30T22:31:46.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.137+0000 7fb3e3b9b700 1 -- 172.21.15.59:0/258065129 wait complete. 2023-09-30T22:31:46.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.138+0000 7f4c657fa700 1 -- 172.21.15.59:0/1771051070 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c540199a0 con 0x7f4c6809e1d0 2023-09-30T22:31:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.138+0000 7fb3e3b9b700 1 Processor -- start 2023-09-30T22:31:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.138+0000 7fb3e3b9b700 1 -- start start 2023-09-30T22:31:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.139+0000 7fb3e3b9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3dc09d6f0 0x7fb3dc1c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.139+0000 7fb3e3b9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3dc09e000 0x7fb3dc1c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.139+0000 7fb3e3b9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3dc09e410 0x7fb3dc1c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.139+0000 7fb3e3b9b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc1c8e80 con 0x7fb3dc09e000 2023-09-30T22:31:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.139+0000 7fb3e3b9b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc1a8ea0 con 0x7fb3dc09e410 2023-09-30T22:31:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.139+0000 7fb3e3b9b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0a3080 con 0x7fb3dc09d6f0 2023-09-30T22:31:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.139+0000 7fb3e1136700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3dc09e000 0x7fb3dc1c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.139+0000 7fb3e1136700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3dc09e000 0x7fb3dc1c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49414/0 (socket says 172.21.15.59:49414) 2023-09-30T22:31:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.139+0000 7fb3e1937700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3dc09d6f0 0x7fb3dc1c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.139+0000 7fb3e1136700 1 -- 172.21.15.59:0/2935338074 learned_addr learned my addr 172.21.15.59:0/2935338074 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.139+0000 7fb3e2138700 1 --2- 172.21.15.59:0/2935338074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3dc09e410 0x7fb3dc1c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.140+0000 7fb3e1136700 1 -- 172.21.15.59:0/2935338074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3dc09d6f0 msgr2=0x7fb3dc1c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.140+0000 7fb3e1136700 1 --2- 172.21.15.59:0/2935338074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3dc09d6f0 0x7fb3dc1c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.140+0000 7fb3e1136700 1 -- 172.21.15.59:0/2935338074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3dc09e410 msgr2=0x7fb3dc1c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.140+0000 7fb3e1136700 1 --2- 172.21.15.59:0/2935338074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3dc09e410 0x7fb3dc1c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.140+0000 7fb3e1136700 1 -- 172.21.15.59:0/2935338074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4009b30 con 0x7fb3dc09e000 2023-09-30T22:31:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.140+0000 7fb3e1937700 1 --2- 172.21.15.59:0/2935338074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3dc09d6f0 0x7fb3dc1c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.140+0000 7fb3e2138700 1 --2- 172.21.15.59:0/2935338074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3dc09e410 0x7fb3dc1c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.140+0000 7fb3e1136700 1 --2- 172.21.15.59:0/2935338074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3dc09e000 0x7fb3dc1c8940 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009fd0 tx=0x7fb3cc00eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.140+0000 7fb3d27fc700 1 -- 172.21.15.59:0/2935338074 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc013610 con 0x7fb3dc09e000 2023-09-30T22:31:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.140+0000 7fb3d27fc700 1 -- 172.21.15.59:0/2935338074 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc013770 con 0x7fb3dc09e000 2023-09-30T22:31:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.140+0000 7fb3e3b9b700 1 -- 172.21.15.59:0/2935338074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc1a8990 con 0x7fb3dc09e000 2023-09-30T22:31:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.140+0000 7fb3d27fc700 1 -- 172.21.15.59:0/2935338074 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc013b20 con 0x7fb3dc09e000 2023-09-30T22:31:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.140+0000 7fb3e3b9b700 1 -- 172.21.15.59:0/2935338074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc1aad00 con 0x7fb3dc09e000 2023-09-30T22:31:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.141+0000 7fb3d27fc700 1 -- 172.21.15.59:0/2935338074 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3cc013c80 con 0x7fb3dc09e000 2023-09-30T22:31:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.142+0000 7fb3d27fc700 1 -- 172.21.15.59:0/2935338074 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb3cc03f230 con 0x7fb3dc09e000 2023-09-30T22:31:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.142+0000 7fb3e3b9b700 1 -- 172.21.15.59:0/2935338074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc074ea0 con 0x7fb3dc09e000 2023-09-30T22:31:46.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.151+0000 7fb3d27fc700 1 -- 172.21.15.59:0/2935338074 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3cc021020 con 0x7fb3dc09e000 2023-09-30T22:31:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.220+0000 7f2d3babe700 1 -- 172.21.15.59:0/527829209 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2d3406c360 con 0x7f2d3409e1d0 2023-09-30T22:31:46.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.221+0000 7f2d2a7fc700 1 -- 172.21.15.59:0/527829209 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d24029070 con 0x7f2d3409e1d0 2023-09-30T22:31:46.221 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.223+0000 7f2d3babe700 1 -- 172.21.15.59:0/527829209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d3409e1d0 msgr2=0x7f2d34121cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.223+0000 7f2d3babe700 1 --2- 172.21.15.59:0/527829209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d3409e1d0 0x7f2d34121cf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2d24000c00 tx=0x7f2d24004750 comp rx=0 tx=0).stop 2023-09-30T22:31:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.223+0000 7f2d3babe700 1 -- 172.21.15.59:0/527829209 shutdown_connections 2023-09-30T22:31:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.223+0000 7f2d3babe700 1 --2- 172.21.15.59:0/527829209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d34139170 0x7f2d34122230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.223+0000 7f2d3babe700 1 --2- 172.21.15.59:0/527829209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d3409d6f0 0x7f2d341217b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.223+0000 7f2d3babe700 1 --2- 172.21.15.59:0/527829209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d3409e1d0 0x7f2d34121cf0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.223+0000 7f2d3babe700 1 -- 172.21.15.59:0/527829209 >> 172.21.15.59:0/527829209 conn(0x7f2d34066f50 msgr2=0x7f2d34070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.223+0000 7f2d3babe700 1 -- 172.21.15.59:0/527829209 shutdown_connections 2023-09-30T22:31:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.223+0000 7f2d3babe700 1 -- 172.21.15.59:0/527829209 wait complete. 2023-09-30T22:31:46.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:46.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.309+0000 7fc5d7568700 1 -- 172.21.15.59:0/3440872658 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc5d009f420 con 0x7fc5d0139170 2023-09-30T22:31:46.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.309+0000 7fc5c5ffb700 1 -- 172.21.15.59:0/3440872658 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5c80243b0 con 0x7fc5d0139170 2023-09-30T22:31:46.309 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:46.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.311+0000 7fc5d7568700 1 -- 172.21.15.59:0/3440872658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d0139170 msgr2=0x7fc5d011e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.311+0000 7fc5d7568700 1 --2- 172.21.15.59:0/3440872658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d0139170 0x7fc5d011e830 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8012000 tx=0x7fc5c8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.311+0000 7fc5d7568700 1 -- 172.21.15.59:0/3440872658 shutdown_connections 2023-09-30T22:31:46.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.311+0000 7fc5d7568700 1 --2- 172.21.15.59:0/3440872658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009d6f0 0x7fc5d01c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.311+0000 7fc5d7568700 1 --2- 172.21.15.59:0/3440872658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d0139170 0x7fc5d011e830 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.311+0000 7fc5d7568700 1 --2- 172.21.15.59:0/3440872658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d009e1d0 0x7fc5d01c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.311+0000 7fc5d7568700 1 -- 172.21.15.59:0/3440872658 >> 172.21.15.59:0/3440872658 conn(0x7fc5d0066f50 msgr2=0x7fc5d00a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:46.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.311+0000 7fc5d7568700 1 -- 172.21.15.59:0/3440872658 shutdown_connections 2023-09-30T22:31:46.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.311+0000 7fc5d7568700 1 -- 172.21.15.59:0/3440872658 wait complete. 2023-09-30T22:31:46.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:46.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.349+0000 7f4c6ee19700 1 -- 172.21.15.59:0/1771051070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4c68074ea0 con 0x7f4c6809e1d0 2023-09-30T22:31:46.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.350+0000 7f4c657fa700 1 -- 172.21.15.59:0/1771051070 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c5402b030 con 0x7f4c6809e1d0 2023-09-30T22:31:46.350 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:46.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.352+0000 7f4c6ee19700 1 -- 172.21.15.59:0/1771051070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c6809e1d0 msgr2=0x7f4c68121c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.352+0000 7f4c6ee19700 1 --2- 172.21.15.59:0/1771051070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c6809e1d0 0x7f4c68121c10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4c54016000 tx=0x7f4c54004750 comp rx=0 tx=0).stop 2023-09-30T22:31:46.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.352+0000 7f4c6ee19700 1 -- 172.21.15.59:0/1771051070 shutdown_connections 2023-09-30T22:31:46.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.352+0000 7f4c6ee19700 1 --2- 172.21.15.59:0/1771051070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c68139170 0x7f4c68122150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.352+0000 7f4c6ee19700 1 --2- 172.21.15.59:0/1771051070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c6809d6f0 0x7f4c681216d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.352+0000 7f4c6ee19700 1 --2- 172.21.15.59:0/1771051070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c6809e1d0 0x7f4c68121c10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.352+0000 7f4c6ee19700 1 -- 172.21.15.59:0/1771051070 >> 172.21.15.59:0/1771051070 conn(0x7f4c68066f50 msgr2=0x7f4c680a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:46.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.352+0000 7f4c6ee19700 1 -- 172.21.15.59:0/1771051070 shutdown_connections 2023-09-30T22:31:46.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.352+0000 7f4c6ee19700 1 -- 172.21.15.59:0/1771051070 wait complete. 2023-09-30T22:31:46.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.360+0000 7fb3e3b9b700 1 -- 172.21.15.59:0/2935338074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb3dc1aa1c0 con 0x7fb3dc09e000 2023-09-30T22:31:46.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.361+0000 7fb3d27fc700 1 -- 172.21.15.59:0/2935338074 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3cc012370 con 0x7fb3dc09e000 2023-09-30T22:31:46.361 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:46.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.363+0000 7fb3e3b9b700 1 -- 172.21.15.59:0/2935338074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3dc09e000 msgr2=0x7fb3dc1c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.363+0000 7fb3e3b9b700 1 --2- 172.21.15.59:0/2935338074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3dc09e000 0x7fb3dc1c8940 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009fd0 tx=0x7fb3cc00eac0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.363+0000 7fb3e3b9b700 1 -- 172.21.15.59:0/2935338074 shutdown_connections 2023-09-30T22:31:46.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.363+0000 7fb3e3b9b700 1 --2- 172.21.15.59:0/2935338074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3dc09d6f0 0x7fb3dc1c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.363+0000 7fb3e3b9b700 1 --2- 172.21.15.59:0/2935338074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3dc09e410 0x7fb3dc1c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.363+0000 7fb3e3b9b700 1 --2- 172.21.15.59:0/2935338074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3dc09e000 0x7fb3dc1c8940 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.363+0000 7fb3e3b9b700 1 -- 172.21.15.59:0/2935338074 >> 172.21.15.59:0/2935338074 conn(0x7fb3dc066f50 msgr2=0x7fb3dc1bab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:46.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.363+0000 7fb3e3b9b700 1 -- 172.21.15.59:0/2935338074 shutdown_connections 2023-09-30T22:31:46.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:46.363+0000 7fb3e3b9b700 1 -- 172.21.15.59:0/2935338074 wait complete. 2023-09-30T22:31:46.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:46.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:47.238 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:47.327 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:47.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:47.378 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:47.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.390+0000 7faa98c54700 1 Processor -- start 2023-09-30T22:31:47.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.390+0000 7faa98c54700 1 -- start start 2023-09-30T22:31:47.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.391+0000 7faa98c54700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa9409d6f0 0x7faa9409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.391+0000 7faa98c54700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa9409e000 0x7faa941339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.391+0000 7faa98c54700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa9409e410 0x7faa94133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.391+0000 7faa98c54700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa9406b460 con 0x7faa9409d6f0 2023-09-30T22:31:47.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.391+0000 7faa98c54700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9409b120 con 0x7faa9409e410 2023-09-30T22:31:47.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.391+0000 7faa98c54700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa9409a7e0 con 0x7faa9409e000 2023-09-30T22:31:47.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.391+0000 7faa9259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa9409d6f0 0x7faa9409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.391+0000 7faa9259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa9409d6f0 0x7faa9409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49422/0 (socket says 172.21.15.59:49422) 2023-09-30T22:31:47.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.391+0000 7faa9259c700 1 -- 172.21.15.59:0/3267454584 learned_addr learned my addr 172.21.15.59:0/3267454584 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:47.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.391+0000 7faa9259c700 1 -- 172.21.15.59:0/3267454584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa9409e000 msgr2=0x7faa941339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:47.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.392+0000 7faa9259c700 1 --2- 172.21.15.59:0/3267454584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa9409e000 0x7faa941339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.392+0000 7faa9259c700 1 -- 172.21.15.59:0/3267454584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa9409e410 msgr2=0x7faa94133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:47.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.392+0000 7faa9259c700 1 --2- 172.21.15.59:0/3267454584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa9409e410 0x7faa94133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.392+0000 7faa9259c700 1 -- 172.21.15.59:0/3267454584 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9409a500 con 0x7faa9409d6f0 2023-09-30T22:31:47.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.392+0000 7faa9259c700 1 --2- 172.21.15.59:0/3267454584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9409d6f0 0x7faa9409dac0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7faa840098f0 tx=0x7faa84009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d2ce5fda8b8035 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:47.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.392+0000 7faa9159a700 1 -- 172.21.15.59:0/3267454584 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8400b8a0 con 0x7faa9409d6f0 2023-09-30T22:31:47.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.392+0000 7faa9159a700 1 -- 172.21.15.59:0/3267454584 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8400ba00 con 0x7faa9409d6f0 2023-09-30T22:31:47.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.392+0000 7faa9159a700 1 -- 172.21.15.59:0/3267454584 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8400bd70 con 0x7faa9409d6f0 2023-09-30T22:31:47.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.393+0000 7faa98c54700 1 -- 172.21.15.59:0/3267454584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9409d6f0 msgr2=0x7faa9409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.393+0000 7faa98c54700 1 --2- 172.21.15.59:0/3267454584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9409d6f0 0x7faa9409dac0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7faa840098f0 tx=0x7faa84009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:47.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.393+0000 7faa98c54700 1 -- 172.21.15.59:0/3267454584 shutdown_connections 2023-09-30T22:31:47.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.393+0000 7faa98c54700 1 --2- 172.21.15.59:0/3267454584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa9409e410 0x7faa94133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.393+0000 7faa98c54700 1 --2- 172.21.15.59:0/3267454584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9409d6f0 0x7faa9409dac0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.393+0000 7faa98c54700 1 --2- 172.21.15.59:0/3267454584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa9409e000 0x7faa941339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.393+0000 7faa98c54700 1 -- 172.21.15.59:0/3267454584 >> 172.21.15.59:0/3267454584 conn(0x7faa94066f50 msgr2=0x7faa9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:47.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.393+0000 7faa98c54700 1 -- 172.21.15.59:0/3267454584 shutdown_connections 2023-09-30T22:31:47.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.393+0000 7faa98c54700 1 -- 172.21.15.59:0/3267454584 wait complete. 2023-09-30T22:31:47.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.394+0000 7faa98c54700 1 Processor -- start 2023-09-30T22:31:47.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.395+0000 7faa98c54700 1 -- start start 2023-09-30T22:31:47.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.395+0000 7faa98c54700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa9409d6f0 0x7faa941a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.395+0000 7faa98c54700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9409e000 0x7faa941a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.395+0000 7faa98c54700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa9409e410 0x7faa941a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.395+0000 7faa98c54700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa941a7340 con 0x7faa9409e000 2023-09-30T22:31:47.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.395+0000 7faa98c54700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa941a7aa0 con 0x7faa9409e410 2023-09-30T22:31:47.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.395+0000 7faa98c54700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa941a80c0 con 0x7faa9409d6f0 2023-09-30T22:31:47.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.395+0000 7faa91d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9409e000 0x7faa941a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.395+0000 7faa9259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa9409d6f0 0x7faa941a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.395+0000 7faa91d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9409e000 0x7faa941a63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49432/0 (socket says 172.21.15.59:49432) 2023-09-30T22:31:47.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.395+0000 7faa91d9b700 1 -- 172.21.15.59:0/1772255386 learned_addr learned my addr 172.21.15.59:0/1772255386 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:47.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.396+0000 7faa9259c700 1 -- 172.21.15.59:0/1772255386 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa9409e410 msgr2=0x7faa941a6910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:31:47.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.396+0000 7faa9259c700 1 --2- 172.21.15.59:0/1772255386 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa9409e410 0x7faa941a6910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.396+0000 7faa9259c700 1 -- 172.21.15.59:0/1772255386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9409e000 msgr2=0x7faa941a63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.396+0000 7faa9259c700 1 --2- 172.21.15.59:0/1772255386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9409e000 0x7faa941a63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.396+0000 7faa9259c700 1 -- 172.21.15.59:0/1772255386 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa84009550 con 0x7faa9409d6f0 2023-09-30T22:31:47.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.396+0000 7faa91d9b700 1 --2- 172.21.15.59:0/1772255386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9409e000 0x7faa941a63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:47.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.396+0000 7faa9259c700 1 --2- 172.21.15.59:0/1772255386 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa9409d6f0 0x7faa941a5e90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7faa84016000 tx=0x7faa84004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:47.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.396+0000 7faa82ffd700 1 -- 172.21.15.59:0/1772255386 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84004590 con 0x7faa9409d6f0 2023-09-30T22:31:47.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.396+0000 7faa82ffd700 1 -- 172.21.15.59:0/1772255386 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8401f070 con 0x7faa9409d6f0 2023-09-30T22:31:47.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.396+0000 7faa82ffd700 1 -- 172.21.15.59:0/1772255386 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa840038e0 con 0x7faa9409d6f0 2023-09-30T22:31:47.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.397+0000 7faa98c54700 1 -- 172.21.15.59:0/1772255386 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa941a96d0 con 0x7faa9409d6f0 2023-09-30T22:31:47.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.397+0000 7faa98c54700 1 -- 172.21.15.59:0/1772255386 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa940a2200 con 0x7faa9409d6f0 2023-09-30T22:31:47.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.398+0000 7faa98c54700 1 -- 172.21.15.59:0/1772255386 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa941a8d50 con 0x7faa9409d6f0 2023-09-30T22:31:47.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.398+0000 7faa82ffd700 1 -- 172.21.15.59:0/1772255386 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa84003a40 con 0x7faa9409d6f0 2023-09-30T22:31:47.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.398+0000 7faa82ffd700 1 -- 172.21.15.59:0/1772255386 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faa84021070 con 0x7faa9409d6f0 2023-09-30T22:31:47.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.404+0000 7faa82ffd700 1 -- 172.21.15.59:0/1772255386 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa8401a7b0 con 0x7faa9409d6f0 2023-09-30T22:31:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.475+0000 7f1a458a3700 1 Processor -- start 2023-09-30T22:31:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.475+0000 7f1a458a3700 1 -- start start 2023-09-30T22:31:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.476+0000 7f1a458a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a4009d6f0 0x7f1a4009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.476+0000 7f1a458a3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a4009e000 0x7f1a401339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.476+0000 7f1a458a3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a4009e410 0x7f1a40133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.476+0000 7f1a458a3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4006b460 con 0x7f1a4009e410 2023-09-30T22:31:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.476+0000 7f1a458a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4009b120 con 0x7f1a4009d6f0 2023-09-30T22:31:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.476+0000 7f1a458a3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4009a7e0 con 0x7f1a4009e000 2023-09-30T22:31:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.476+0000 7f1a3e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a4009e000 0x7f1a401339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.476+0000 7f1a3effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a4009d6f0 0x7f1a4009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.476+0000 7f1a3e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a4009e000 0x7f1a401339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38912/0 (socket says 172.21.15.59:38912) 2023-09-30T22:31:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.476+0000 7f1a3e7fc700 1 -- 172.21.15.59:0/1324600152 learned_addr learned my addr 172.21.15.59:0/1324600152 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.476+0000 7f1a3effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a4009d6f0 0x7f1a4009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60294/0 (socket says 172.21.15.59:60294) 2023-09-30T22:31:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.476+0000 7f1a3f7fe700 1 --2- 172.21.15.59:0/1324600152 >> v2:172.21.15.59:3300/0 conn(0x7f1a4009e410 0x7f1a40133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.477+0000 7f1a3effd700 1 -- 172.21.15.59:0/1324600152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a4009e000 msgr2=0x7f1a401339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.477+0000 7f1a3effd700 1 --2- 172.21.15.59:0/1324600152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a4009e000 0x7f1a401339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.477+0000 7f1a3effd700 1 -- 172.21.15.59:0/1324600152 >> v2:172.21.15.59:3300/0 conn(0x7f1a4009e410 msgr2=0x7f1a40133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.477+0000 7f1a3effd700 1 --2- 172.21.15.59:0/1324600152 >> v2:172.21.15.59:3300/0 conn(0x7f1a4009e410 0x7f1a40133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.477+0000 7f1a3effd700 1 -- 172.21.15.59:0/1324600152 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4009a500 con 0x7f1a4009d6f0 2023-09-30T22:31:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.477+0000 7f1a3effd700 1 --2- 172.21.15.59:0/1324600152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a4009d6f0 0x7f1a4009dac0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009870 tx=0x7f1a30009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecc1ccd39bd934a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.477+0000 7f1a3dffb700 1 -- 172.21.15.59:0/1324600152 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30011830 con 0x7f1a4009d6f0 2023-09-30T22:31:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.477+0000 7f1a3dffb700 1 -- 172.21.15.59:0/1324600152 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a30011990 con 0x7f1a4009d6f0 2023-09-30T22:31:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.477+0000 7f1a3dffb700 1 -- 172.21.15.59:0/1324600152 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30011d20 con 0x7f1a4009d6f0 2023-09-30T22:31:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.478+0000 7f1a458a3700 1 -- 172.21.15.59:0/1324600152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a4009d6f0 msgr2=0x7f1a4009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.478+0000 7f1a458a3700 1 --2- 172.21.15.59:0/1324600152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a4009d6f0 0x7f1a4009dac0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009870 tx=0x7f1a30009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.478+0000 7f1a458a3700 1 -- 172.21.15.59:0/1324600152 shutdown_connections 2023-09-30T22:31:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.478+0000 7f1a458a3700 1 --2- 172.21.15.59:0/1324600152 >> v2:172.21.15.59:3300/0 conn(0x7f1a4009e410 0x7f1a40133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.478+0000 7f1a458a3700 1 --2- 172.21.15.59:0/1324600152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a4009d6f0 0x7f1a4009dac0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.478+0000 7f1a458a3700 1 --2- 172.21.15.59:0/1324600152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a4009e000 0x7f1a401339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.478+0000 7f1a458a3700 1 -- 172.21.15.59:0/1324600152 >> 172.21.15.59:0/1324600152 conn(0x7f1a40066f50 msgr2=0x7f1a4009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.478+0000 7f1a458a3700 1 -- 172.21.15.59:0/1324600152 shutdown_connections 2023-09-30T22:31:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.478+0000 7f1a458a3700 1 -- 172.21.15.59:0/1324600152 wait complete. 2023-09-30T22:31:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.479+0000 7f1a458a3700 1 Processor -- start 2023-09-30T22:31:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.480+0000 7f1a458a3700 1 -- start start 2023-09-30T22:31:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.480+0000 7f1a458a3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a4009d6f0 0x7f1a401a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.480+0000 7f1a458a3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a4009e000 0x7f1a401a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.480+0000 7f1a458a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a4009e410 0x7f1a401a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.480+0000 7f1a458a3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a401aa270 con 0x7f1a4009e000 2023-09-30T22:31:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.480+0000 7f1a458a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a401a79a0 con 0x7f1a4009e410 2023-09-30T22:31:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.480+0000 7f1a458a3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a401a7fc0 con 0x7f1a4009d6f0 2023-09-30T22:31:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.480+0000 7f1a3f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a4009e410 0x7f1a401a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.481+0000 7f1a3f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a4009e410 0x7f1a401a6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60296/0 (socket says 172.21.15.59:60296) 2023-09-30T22:31:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.481+0000 7f1a3f7fe700 1 -- 172.21.15.59:0/1784778146 learned_addr learned my addr 172.21.15.59:0/1784778146 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.481+0000 7f1a3e7fc700 1 --2- 172.21.15.59:0/1784778146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a4009e000 0x7f1a401a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.481+0000 7f1a3effd700 1 --2- 172.21.15.59:0/1784778146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a4009d6f0 0x7f1a401a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.481+0000 7f1a3f7fe700 1 -- 172.21.15.59:0/1784778146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a4009d6f0 msgr2=0x7f1a401a5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.481+0000 7f1a3f7fe700 1 --2- 172.21.15.59:0/1784778146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a4009d6f0 0x7f1a401a5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.481+0000 7f1a3f7fe700 1 -- 172.21.15.59:0/1784778146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a4009e000 msgr2=0x7f1a401a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.481+0000 7f1a3f7fe700 1 --2- 172.21.15.59:0/1784778146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a4009e000 0x7f1a401a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.481+0000 7f1a3f7fe700 1 -- 172.21.15.59:0/1784778146 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a300094a0 con 0x7f1a4009e410 2023-09-30T22:31:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.481+0000 7f1a3f7fe700 1 --2- 172.21.15.59:0/1784778146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a4009e410 0x7f1a401a6860 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009e30 tx=0x7f1a3800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.481+0000 7f1a27fff700 1 -- 172.21.15.59:0/1784778146 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800cd40 con 0x7f1a4009e410 2023-09-30T22:31:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.481+0000 7f1a27fff700 1 -- 172.21.15.59:0/1784778146 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3800f040 con 0x7f1a4009e410 2023-09-30T22:31:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.481+0000 7f1a458a3700 1 -- 172.21.15.59:0/1784778146 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a401a8bf0 con 0x7f1a4009e410 2023-09-30T22:31:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.481+0000 7f1a27fff700 1 -- 172.21.15.59:0/1784778146 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a380146c0 con 0x7f1a4009e410 2023-09-30T22:31:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.482+0000 7f1a458a3700 1 -- 172.21.15.59:0/1784778146 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4009c710 con 0x7f1a4009e410 2023-09-30T22:31:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.482+0000 7f1a27fff700 1 -- 172.21.15.59:0/1784778146 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a38014820 con 0x7f1a4009e410 2023-09-30T22:31:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.483+0000 7f1a27fff700 1 -- 172.21.15.59:0/1784778146 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1a38040330 con 0x7f1a4009e410 2023-09-30T22:31:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.483+0000 7f1a458a3700 1 -- 172.21.15.59:0/1784778146 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a40074ea0 con 0x7f1a4009e410 2023-09-30T22:31:47.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.488+0000 7f1a27fff700 1 -- 172.21.15.59:0/1784778146 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a38018070 con 0x7f1a4009e410 2023-09-30T22:31:47.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.516+0000 7f2e9e9fa700 1 Processor -- start 2023-09-30T22:31:47.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.516+0000 7f2e9e9fa700 1 -- start start 2023-09-30T22:31:47.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.517+0000 7f2e9e9fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e980a0a30 0x7f2e980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.517+0000 7f2e9e9fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e9809d630 0x7f2e980a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.517+0000 7f2e9e9fa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e98133930 0x7f2e98133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.517+0000 7f2e9e9fa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e980a2a70 con 0x7f2e98133930 2023-09-30T22:31:47.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.517+0000 7f2e9e9fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e980a01d0 con 0x7f2e9809d630 2023-09-30T22:31:47.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.517+0000 7f2e9e9fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9809e2b0 con 0x7f2e980a0a30 2023-09-30T22:31:47.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.517+0000 7f2e977fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e9809d630 0x7f2e980a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.517+0000 7f2e97fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e980a0a30 0x7f2e980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.517+0000 7f2e97fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e980a0a30 0x7f2e980a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38930/0 (socket says 172.21.15.59:38930) 2023-09-30T22:31:47.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.517+0000 7f2e97fff700 1 -- 172.21.15.59:0/1332755884 learned_addr learned my addr 172.21.15.59:0/1332755884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:47.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.517+0000 7f2e9cf97700 1 --2- 172.21.15.59:0/1332755884 >> v2:172.21.15.59:3300/0 conn(0x7f2e98133930 0x7f2e98133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.517+0000 7f2e977fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e9809d630 0x7f2e980a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60312/0 (socket says 172.21.15.59:60312) 2023-09-30T22:31:47.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.518+0000 7f2e9cf97700 1 -- 172.21.15.59:0/1332755884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e980a0a30 msgr2=0x7f2e980a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:47.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.518+0000 7f2e9cf97700 1 --2- 172.21.15.59:0/1332755884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e980a0a30 0x7f2e980a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.518+0000 7f2e9cf97700 1 -- 172.21.15.59:0/1332755884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e9809d630 msgr2=0x7f2e980a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:47.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.518+0000 7f2e9cf97700 1 --2- 172.21.15.59:0/1332755884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e9809d630 0x7f2e980a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.518+0000 7f2e9cf97700 1 -- 172.21.15.59:0/1332755884 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9809dc50 con 0x7f2e98133930 2023-09-30T22:31:47.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.518+0000 7f2e97fff700 1 --2- 172.21.15.59:0/1332755884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e980a0a30 0x7f2e980a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:47.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.518+0000 7f2e9cf97700 1 --2- 172.21.15.59:0/1332755884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e98133930 0x7f2e98133dd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009d90 tx=0x7f2e9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c010252fcbaca2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:47.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.518+0000 7f2e96ffd700 1 -- 172.21.15.59:0/1332755884 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9000e070 con 0x7f2e98133930 2023-09-30T22:31:47.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.518+0000 7f2e96ffd700 1 -- 172.21.15.59:0/1332755884 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9000bb20 con 0x7f2e98133930 2023-09-30T22:31:47.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.518+0000 7f2e96ffd700 1 -- 172.21.15.59:0/1332755884 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90012430 con 0x7f2e98133930 2023-09-30T22:31:47.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.519+0000 7f2e9e9fa700 1 -- 172.21.15.59:0/1332755884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e98133930 msgr2=0x7f2e98133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.519+0000 7f2e9e9fa700 1 --2- 172.21.15.59:0/1332755884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e98133930 0x7f2e98133dd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009d90 tx=0x7f2e9000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:47.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.519+0000 7f2e9e9fa700 1 -- 172.21.15.59:0/1332755884 shutdown_connections 2023-09-30T22:31:47.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.519+0000 7f2e9e9fa700 1 --2- 172.21.15.59:0/1332755884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e98133930 0x7f2e98133dd0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.519+0000 7f2e9e9fa700 1 --2- 172.21.15.59:0/1332755884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e980a0a30 0x7f2e980a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.519+0000 7f2e9e9fa700 1 --2- 172.21.15.59:0/1332755884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e9809d630 0x7f2e980a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.519+0000 7f2e9e9fa700 1 -- 172.21.15.59:0/1332755884 >> 172.21.15.59:0/1332755884 conn(0x7f2e980a3050 msgr2=0x7f2e980a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:47.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.519+0000 7f2e9e9fa700 1 -- 172.21.15.59:0/1332755884 shutdown_connections 2023-09-30T22:31:47.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.519+0000 7f2e9e9fa700 1 -- 172.21.15.59:0/1332755884 wait complete. 2023-09-30T22:31:47.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.520+0000 7f2e9e9fa700 1 Processor -- start 2023-09-30T22:31:47.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.520+0000 7f2e9e9fa700 1 -- start start 2023-09-30T22:31:47.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.521+0000 7f2e9e9fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e9809d630 0x7f2e9811e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.521+0000 7f2e9e9fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e980a0a30 0x7f2e9811ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.521+0000 7f2e9e9fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e98133930 0x7f2e9811f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.521+0000 7f2e9e9fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e98120510 con 0x7f2e98133930 2023-09-30T22:31:47.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.521+0000 7f2e9e9fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e980a50d0 con 0x7f2e980a0a30 2023-09-30T22:31:47.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.521+0000 7f2e9e9fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e980a0410 con 0x7f2e9809d630 2023-09-30T22:31:47.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.521+0000 7f2e97fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e9809d630 0x7f2e9811e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.521+0000 7f2e97fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e9809d630 0x7f2e9811e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38936/0 (socket says 172.21.15.59:38936) 2023-09-30T22:31:47.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.521+0000 7f2e97fff700 1 -- 172.21.15.59:0/723054372 learned_addr learned my addr 172.21.15.59:0/723054372 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:47.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.521+0000 7f2e977fe700 1 --2- 172.21.15.59:0/723054372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e980a0a30 0x7f2e9811ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.521+0000 7f2e9cf97700 1 --2- 172.21.15.59:0/723054372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e98133930 0x7f2e9811f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.522+0000 7f2e977fe700 1 -- 172.21.15.59:0/723054372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e9809d630 msgr2=0x7f2e9811e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.522+0000 7f2e977fe700 1 --2- 172.21.15.59:0/723054372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e9809d630 0x7f2e9811e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.522+0000 7f2e977fe700 1 -- 172.21.15.59:0/723054372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e98133930 msgr2=0x7f2e9811f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.522+0000 7f2e977fe700 1 --2- 172.21.15.59:0/723054372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e98133930 0x7f2e9811f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.522+0000 7f2e977fe700 1 -- 172.21.15.59:0/723054372 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e88009550 con 0x7f2e980a0a30 2023-09-30T22:31:47.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.522+0000 7f2e977fe700 1 --2- 172.21.15.59:0/723054372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e980a0a30 0x7f2e9811ed50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00e8d0 tx=0x7f2e8c00ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:47.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.522+0000 7f2e94ff9700 1 -- 172.21.15.59:0/723054372 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c013680 con 0x7f2e980a0a30 2023-09-30T22:31:47.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.522+0000 7f2e94ff9700 1 -- 172.21.15.59:0/723054372 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c0137e0 con 0x7f2e980a0a30 2023-09-30T22:31:47.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.522+0000 7f2e9e9fa700 1 -- 172.21.15.59:0/723054372 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e90009a70 con 0x7f2e980a0a30 2023-09-30T22:31:47.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.522+0000 7f2e94ff9700 1 -- 172.21.15.59:0/723054372 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c013b50 con 0x7f2e980a0a30 2023-09-30T22:31:47.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.523+0000 7f2e9e9fa700 1 -- 172.21.15.59:0/723054372 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e98133740 con 0x7f2e980a0a30 2023-09-30T22:31:47.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.523+0000 7f2e94ff9700 1 -- 172.21.15.59:0/723054372 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e8c013cb0 con 0x7f2e980a0a30 2023-09-30T22:31:47.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.524+0000 7f2e94ff9700 1 -- 172.21.15.59:0/723054372 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2e8c01ba00 con 0x7f2e980a0a30 2023-09-30T22:31:47.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.524+0000 7f2e9e9fa700 1 -- 172.21.15.59:0/723054372 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e981332f0 con 0x7f2e980a0a30 2023-09-30T22:31:47.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.529+0000 7f2e94ff9700 1 -- 172.21.15.59:0/723054372 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e981332f0 con 0x7f2e980a0a30 2023-09-30T22:31:47.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.561+0000 7f2684c21700 1 Processor -- start 2023-09-30T22:31:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.561+0000 7f2684c21700 1 -- start start 2023-09-30T22:31:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.562+0000 7f2684c21700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f268009eca0 0x7f268013cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.562+0000 7f2684c21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268006f050 0x7f268013f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.562+0000 7f2684c21700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2680070ee0 con 0x7f268006e570 2023-09-30T22:31:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.562+0000 7f2684c21700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2680071980 con 0x7f268009eca0 2023-09-30T22:31:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.562+0000 7f2684c21700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2680071480 con 0x7f268006f050 2023-09-30T22:31:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.562+0000 7f267dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f268009eca0 0x7f268013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.562+0000 7f267dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f268009eca0 0x7f268013cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49482/0 (socket says 172.21.15.59:49482) 2023-09-30T22:31:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.562+0000 7f267dd9b700 1 -- 172.21.15.59:0/639045274 learned_addr learned my addr 172.21.15.59:0/639045274 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.562+0000 7f267ed9d700 1 --2- 172.21.15.59:0/639045274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268006f050 0x7f268013f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.562+0000 7f267dd9b700 1 -- 172.21.15.59:0/639045274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268006f050 msgr2=0x7f268013f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.562+0000 7f267dd9b700 1 --2- 172.21.15.59:0/639045274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268006f050 0x7f268013f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.562+0000 7f267dd9b700 1 -- 172.21.15.59:0/639045274 >> v1:172.21.15.59:6789/0 conn(0x7f268006e570 legacy=0x7f268006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.562+0000 7f267dd9b700 1 -- 172.21.15.59:0/639045274 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2680071b90 con 0x7f268009eca0 2023-09-30T22:31:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.562+0000 7f267ed9d700 1 --2- 172.21.15.59:0/639045274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268006f050 0x7f268013f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:47.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.562+0000 7f267dd9b700 1 --2- 172.21.15.59:0/639045274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268009eca0 0x7f268013cea0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f26740098f0 tx=0x7f2674009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8204dfbc1424f7f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:47.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.563+0000 7f267d59a700 1 -- 172.21.15.59:0/639045274 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674004230 con 0x7f268009eca0 2023-09-30T22:31:47.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.563+0000 7f267d59a700 1 -- 172.21.15.59:0/639045274 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2674004390 con 0x7f268009eca0 2023-09-30T22:31:47.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.563+0000 7f267d59a700 1 -- 172.21.15.59:0/639045274 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26740036a0 con 0x7f268009eca0 2023-09-30T22:31:47.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.563+0000 7f2684c21700 1 -- 172.21.15.59:0/639045274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268009eca0 msgr2=0x7f268013cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.563+0000 7f2684c21700 1 --2- 172.21.15.59:0/639045274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268009eca0 0x7f268013cea0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f26740098f0 tx=0x7f2674009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:47.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.563+0000 7f2684c21700 1 -- 172.21.15.59:0/639045274 shutdown_connections 2023-09-30T22:31:47.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.563+0000 7f2684c21700 1 --2- 172.21.15.59:0/639045274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268006f050 0x7f268013f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.563+0000 7f2684c21700 1 --2- 172.21.15.59:0/639045274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268009eca0 0x7f268013cea0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.563+0000 7f2684c21700 1 -- 172.21.15.59:0/639045274 >> 172.21.15.59:0/639045274 conn(0x7f26800a2aa0 msgr2=0x7f26800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.564+0000 7f2684c21700 1 -- 172.21.15.59:0/639045274 shutdown_connections 2023-09-30T22:31:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.564+0000 7f2684c21700 1 -- 172.21.15.59:0/639045274 wait complete. 2023-09-30T22:31:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.565+0000 7f2684c21700 1 Processor -- start 2023-09-30T22:31:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.565+0000 7f2684c21700 1 -- start start 2023-09-30T22:31:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.565+0000 7f2684c21700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f268006e570 0x7f268013cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.565+0000 7f2684c21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268006f050 0x7f268013d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.565+0000 7f2684c21700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268013d970 0x7f268012adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.565+0000 7f2684c21700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268012c080 con 0x7f268013d970 2023-09-30T22:31:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.565+0000 7f2684c21700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268013e370 con 0x7f268006f050 2023-09-30T22:31:47.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.565+0000 7f2684c21700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2680138680 con 0x7f268006e570 2023-09-30T22:31:47.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.566+0000 7f267e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f268006e570 0x7f268013cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.566+0000 7f267e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f268006e570 0x7f268013cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38946/0 (socket says 172.21.15.59:38946) 2023-09-30T22:31:47.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.566+0000 7f267e59c700 1 -- 172.21.15.59:0/1769319215 learned_addr learned my addr 172.21.15.59:0/1769319215 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:47.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.566+0000 7f267ed9d700 1 --2- 172.21.15.59:0/1769319215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268013d970 0x7f268012adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.566+0000 7f267dd9b700 1 --2- 172.21.15.59:0/1769319215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268006f050 0x7f268013d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.566+0000 7f267e59c700 1 -- 172.21.15.59:0/1769319215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268006f050 msgr2=0x7f268013d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.566+0000 7f267e59c700 1 --2- 172.21.15.59:0/1769319215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268006f050 0x7f268013d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.566+0000 7f267e59c700 1 -- 172.21.15.59:0/1769319215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268013d970 msgr2=0x7f268012adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.566+0000 7f267e59c700 1 --2- 172.21.15.59:0/1769319215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268013d970 0x7f268012adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.566+0000 7f267e59c700 1 -- 172.21.15.59:0/1769319215 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2674009550 con 0x7f268006e570 2023-09-30T22:31:47.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.566+0000 7f267ed9d700 1 --2- 172.21.15.59:0/1769319215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268013d970 0x7f268012adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:47.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.566+0000 7f267e59c700 1 --2- 172.21.15.59:0/1769319215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f268006e570 0x7f268013cef0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f267000c530 tx=0x7f267000c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:47.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.566+0000 7f266effd700 1 -- 172.21.15.59:0/1769319215 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670011790 con 0x7f268006e570 2023-09-30T22:31:47.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.567+0000 7f266effd700 1 -- 172.21.15.59:0/1769319215 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26700118f0 con 0x7f268006e570 2023-09-30T22:31:47.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.567+0000 7f2684c21700 1 -- 172.21.15.59:0/1769319215 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268012daf0 con 0x7f268006e570 2023-09-30T22:31:47.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.567+0000 7f2684c21700 1 -- 172.21.15.59:0/1769319215 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268012d0d0 con 0x7f268006e570 2023-09-30T22:31:47.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.567+0000 7f266effd700 1 -- 172.21.15.59:0/1769319215 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670011ca0 con 0x7f268006e570 2023-09-30T22:31:47.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.568+0000 7f266effd700 1 -- 172.21.15.59:0/1769319215 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f267001c460 con 0x7f268006e570 2023-09-30T22:31:47.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.568+0000 7f266effd700 1 -- 172.21.15.59:0/1769319215 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f267003f3b0 con 0x7f268006e570 2023-09-30T22:31:47.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.568+0000 7f2684c21700 1 -- 172.21.15.59:0/1769319215 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26640052e0 con 0x7f268006e570 2023-09-30T22:31:47.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.573+0000 7f266effd700 1 -- 172.21.15.59:0/1769319215 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2670011e00 con 0x7f268006e570 2023-09-30T22:31:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.632+0000 7faa98c54700 1 -- 172.21.15.59:0/1772255386 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faa94074ea0 con 0x7faa9409d6f0 2023-09-30T22:31:47.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.633+0000 7faa82ffd700 1 -- 172.21.15.59:0/1772255386 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa8402a070 con 0x7faa9409d6f0 2023-09-30T22:31:47.633 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:47.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.636+0000 7faa98c54700 1 -- 172.21.15.59:0/1772255386 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa9409d6f0 msgr2=0x7faa941a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.636+0000 7faa98c54700 1 --2- 172.21.15.59:0/1772255386 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa9409d6f0 0x7faa941a5e90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7faa84016000 tx=0x7faa84004750 comp rx=0 tx=0).stop 2023-09-30T22:31:47.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.636+0000 7faa98c54700 1 -- 172.21.15.59:0/1772255386 shutdown_connections 2023-09-30T22:31:47.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.636+0000 7faa98c54700 1 --2- 172.21.15.59:0/1772255386 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa9409d6f0 0x7faa941a5e90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.636+0000 7faa98c54700 1 --2- 172.21.15.59:0/1772255386 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa9409e410 0x7faa941a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.636+0000 7faa98c54700 1 --2- 172.21.15.59:0/1772255386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9409e000 0x7faa941a63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.636+0000 7faa98c54700 1 -- 172.21.15.59:0/1772255386 >> 172.21.15.59:0/1772255386 conn(0x7faa94066f50 msgr2=0x7faa941bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:47.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.636+0000 7faa98c54700 1 -- 172.21.15.59:0/1772255386 shutdown_connections 2023-09-30T22:31:47.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.636+0000 7faa98c54700 1 -- 172.21.15.59:0/1772255386 wait complete. 2023-09-30T22:31:47.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:47.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.721+0000 7f1a458a3700 1 -- 172.21.15.59:0/1784778146 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1a4006c360 con 0x7f1a4009e410 2023-09-30T22:31:47.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.721+0000 7f1a27fff700 1 -- 172.21.15.59:0/1784778146 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a3802c090 con 0x7f1a4009e410 2023-09-30T22:31:47.722 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:47.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.724+0000 7f1a458a3700 1 -- 172.21.15.59:0/1784778146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a4009e410 msgr2=0x7f1a401a6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.724+0000 7f1a458a3700 1 --2- 172.21.15.59:0/1784778146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a4009e410 0x7f1a401a6860 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009e30 tx=0x7f1a3800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.724+0000 7f1a458a3700 1 -- 172.21.15.59:0/1784778146 shutdown_connections 2023-09-30T22:31:47.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.724+0000 7f1a458a3700 1 --2- 172.21.15.59:0/1784778146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a4009d6f0 0x7f1a401a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.724+0000 7f1a458a3700 1 --2- 172.21.15.59:0/1784778146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a4009e410 0x7f1a401a6860 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.724+0000 7f1a458a3700 1 --2- 172.21.15.59:0/1784778146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a4009e000 0x7f1a401a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.724+0000 7f1a458a3700 1 -- 172.21.15.59:0/1784778146 >> 172.21.15.59:0/1784778146 conn(0x7f1a40066f50 msgr2=0x7f1a400a3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:47.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.724+0000 7f1a458a3700 1 -- 172.21.15.59:0/1784778146 shutdown_connections 2023-09-30T22:31:47.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.724+0000 7f1a458a3700 1 -- 172.21.15.59:0/1784778146 wait complete. 2023-09-30T22:31:47.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:47.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.741+0000 7f2e9e9fa700 1 -- 172.21.15.59:0/723054372 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2e981332f0 con 0x7f2e980a0a30 2023-09-30T22:31:47.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.741+0000 7f2e94ff9700 1 -- 172.21.15.59:0/723054372 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e981332f0 con 0x7f2e980a0a30 2023-09-30T22:31:47.741 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:47.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.744+0000 7f2e9e9fa700 1 -- 172.21.15.59:0/723054372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e980a0a30 msgr2=0x7f2e9811ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.744+0000 7f2e9e9fa700 1 --2- 172.21.15.59:0/723054372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e980a0a30 0x7f2e9811ed50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00e8d0 tx=0x7f2e8c00ebe0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.744+0000 7f2e9e9fa700 1 -- 172.21.15.59:0/723054372 shutdown_connections 2023-09-30T22:31:47.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.744+0000 7f2e9e9fa700 1 --2- 172.21.15.59:0/723054372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e9809d630 0x7f2e9811e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.744+0000 7f2e9e9fa700 1 --2- 172.21.15.59:0/723054372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e98133930 0x7f2e9811f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.744+0000 7f2e9e9fa700 1 --2- 172.21.15.59:0/723054372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e980a0a30 0x7f2e9811ed50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.744+0000 7f2e9e9fa700 1 -- 172.21.15.59:0/723054372 >> 172.21.15.59:0/723054372 conn(0x7f2e980a3050 msgr2=0x7f2e980a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:47.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.744+0000 7f2e9e9fa700 1 -- 172.21.15.59:0/723054372 shutdown_connections 2023-09-30T22:31:47.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.744+0000 7f2e9e9fa700 1 -- 172.21.15.59:0/723054372 wait complete. 2023-09-30T22:31:47.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:47.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.780+0000 7f2684c21700 1 -- 172.21.15.59:0/1769319215 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2664005150 con 0x7f268006e570 2023-09-30T22:31:47.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.781+0000 7f266effd700 1 -- 172.21.15.59:0/1769319215 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f267001a360 con 0x7f268006e570 2023-09-30T22:31:47.781 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:47.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.783+0000 7f2684c21700 1 -- 172.21.15.59:0/1769319215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f268006e570 msgr2=0x7f268013cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.783+0000 7f2684c21700 1 --2- 172.21.15.59:0/1769319215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f268006e570 0x7f268013cef0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f267000c530 tx=0x7f267000c840 comp rx=0 tx=0).stop 2023-09-30T22:31:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.783+0000 7f2684c21700 1 -- 172.21.15.59:0/1769319215 shutdown_connections 2023-09-30T22:31:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.783+0000 7f2684c21700 1 --2- 172.21.15.59:0/1769319215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f268006e570 0x7f268013cef0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.783+0000 7f2684c21700 1 --2- 172.21.15.59:0/1769319215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268013d970 0x7f268012adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.783+0000 7f2684c21700 1 --2- 172.21.15.59:0/1769319215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268006f050 0x7f268013d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.783+0000 7f2684c21700 1 -- 172.21.15.59:0/1769319215 >> 172.21.15.59:0/1769319215 conn(0x7f26800a2aa0 msgr2=0x7f268009cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.783+0000 7f2684c21700 1 -- 172.21.15.59:0/1769319215 shutdown_connections 2023-09-30T22:31:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:47.783+0000 7f2684c21700 1 -- 172.21.15.59:0/1769319215 wait complete. 2023-09-30T22:31:47.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:48.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:48.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:48.759 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:48.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.798+0000 7f9e099fa700 1 Processor -- start 2023-09-30T22:31:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.798+0000 7f9e099fa700 1 -- start start 2023-09-30T22:31:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.799+0000 7f9e099fa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e0409e930 0x7f9e0409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.799+0000 7f9e099fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e0409f240 0x7f9e041317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.799+0000 7f9e099fa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e04070940 con 0x7f9e0409f650 2023-09-30T22:31:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.799+0000 7f9e099fa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0406fd60 con 0x7f9e0409e930 2023-09-30T22:31:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.799+0000 7f9e099fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0406fa80 con 0x7f9e0409f240 2023-09-30T22:31:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.799+0000 7f9e02ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e0409e930 0x7f9e0409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.799+0000 7f9e027fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e0409f240 0x7f9e041317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.799+0000 7f9e02ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e0409e930 0x7f9e0409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49494/0 (socket says 172.21.15.59:49494) 2023-09-30T22:31:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.799+0000 7f9e02ffd700 1 -- 172.21.15.59:0/1224485663 learned_addr learned my addr 172.21.15.59:0/1224485663 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.800+0000 7f9e02ffd700 1 -- 172.21.15.59:0/1224485663 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e0409f240 msgr2=0x7f9e041317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.800+0000 7f9e02ffd700 1 --2- 172.21.15.59:0/1224485663 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e0409f240 0x7f9e041317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.800+0000 7f9e02ffd700 1 -- 172.21.15.59:0/1224485663 >> v1:172.21.15.59:6789/0 conn(0x7f9e0409f650 legacy=0x7f9e04131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.800+0000 7f9e02ffd700 1 -- 172.21.15.59:0/1224485663 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0409fb60 con 0x7f9e0409e930 2023-09-30T22:31:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.800+0000 7f9e02ffd700 1 --2- 172.21.15.59:0/1224485663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e0409e930 0x7f9e0409ed00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9df40098f0 tx=0x7f9df4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b711d72d0f8457 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.800+0000 7f9e01ffb700 1 -- 172.21.15.59:0/1224485663 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4011830 con 0x7f9e0409e930 2023-09-30T22:31:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.800+0000 7f9e01ffb700 1 -- 172.21.15.59:0/1224485663 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df4011990 con 0x7f9e0409e930 2023-09-30T22:31:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.800+0000 7f9e01ffb700 1 -- 172.21.15.59:0/1224485663 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4011d20 con 0x7f9e0409e930 2023-09-30T22:31:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.801+0000 7f9e099fa700 1 -- 172.21.15.59:0/1224485663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e0409e930 msgr2=0x7f9e0409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.801+0000 7f9e099fa700 1 --2- 172.21.15.59:0/1224485663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e0409e930 0x7f9e0409ed00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9df40098f0 tx=0x7f9df4009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.801+0000 7f9e099fa700 1 -- 172.21.15.59:0/1224485663 shutdown_connections 2023-09-30T22:31:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.801+0000 7f9e099fa700 1 --2- 172.21.15.59:0/1224485663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e0409e930 0x7f9e0409ed00 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.801+0000 7f9e099fa700 1 --2- 172.21.15.59:0/1224485663 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e0409f240 0x7f9e041317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.801+0000 7f9e099fa700 1 -- 172.21.15.59:0/1224485663 >> 172.21.15.59:0/1224485663 conn(0x7f9e040a4210 msgr2=0x7f9e040a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:48.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.801+0000 7f9e099fa700 1 -- 172.21.15.59:0/1224485663 shutdown_connections 2023-09-30T22:31:48.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.801+0000 7f9e099fa700 1 -- 172.21.15.59:0/1224485663 wait complete. 2023-09-30T22:31:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.802+0000 7f9e099fa700 1 Processor -- start 2023-09-30T22:31:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.802+0000 7f9e099fa700 1 -- start start 2023-09-30T22:31:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.803+0000 7f9e099fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e0409e930 0x7f9e041c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.803+0000 7f9e099fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e0409f240 0x7f9e041c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.803+0000 7f9e099fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e0409f650 0x7f9e041c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.803+0000 7f9e099fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e041a47e0 con 0x7f9e0409f240 2023-09-30T22:31:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.803+0000 7f9e099fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e041a43b0 con 0x7f9e0409f650 2023-09-30T22:31:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.803+0000 7f9e099fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e041a4fd0 con 0x7f9e0409e930 2023-09-30T22:31:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.803+0000 7f9e02ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e0409e930 0x7f9e041c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.803+0000 7f9e02ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e0409e930 0x7f9e041c42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38956/0 (socket says 172.21.15.59:38956) 2023-09-30T22:31:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.803+0000 7f9e02ffd700 1 -- 172.21.15.59:0/1294192486 learned_addr learned my addr 172.21.15.59:0/1294192486 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.804+0000 7f9e027fc700 1 --2- 172.21.15.59:0/1294192486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e0409f240 0x7f9e041c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.804+0000 7f9e037fe700 1 --2- 172.21.15.59:0/1294192486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e0409f650 0x7f9e041c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.804+0000 7f9e02ffd700 1 -- 172.21.15.59:0/1294192486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e0409f650 msgr2=0x7f9e041c07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.804+0000 7f9e02ffd700 1 --2- 172.21.15.59:0/1294192486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e0409f650 0x7f9e041c07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.804+0000 7f9e02ffd700 1 -- 172.21.15.59:0/1294192486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e0409f240 msgr2=0x7f9e041c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.804+0000 7f9e02ffd700 1 --2- 172.21.15.59:0/1294192486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e0409f240 0x7f9e041c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.804+0000 7f9e02ffd700 1 -- 172.21.15.59:0/1294192486 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df4009550 con 0x7f9e0409e930 2023-09-30T22:31:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.804+0000 7f9e02ffd700 1 --2- 172.21.15.59:0/1294192486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e0409e930 0x7f9e041c42d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009c40 tx=0x7f9df4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.804+0000 7f9debfff700 1 -- 172.21.15.59:0/1294192486 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4004550 con 0x7f9e0409e930 2023-09-30T22:31:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.804+0000 7f9debfff700 1 -- 172.21.15.59:0/1294192486 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df40036a0 con 0x7f9e0409e930 2023-09-30T22:31:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.804+0000 7f9e099fa700 1 -- 172.21.15.59:0/1294192486 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e040a0190 con 0x7f9e0409e930 2023-09-30T22:31:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.804+0000 7f9debfff700 1 -- 172.21.15.59:0/1294192486 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4003a30 con 0x7f9e0409e930 2023-09-30T22:31:48.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.804+0000 7f9e099fa700 1 -- 172.21.15.59:0/1294192486 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e041a3660 con 0x7f9e0409e930 2023-09-30T22:31:48.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.805+0000 7f9debfff700 1 -- 172.21.15.59:0/1294192486 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9df4021070 con 0x7f9e0409e930 2023-09-30T22:31:48.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.805+0000 7f9debfff700 1 -- 172.21.15.59:0/1294192486 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9df4040a80 con 0x7f9e0409e930 2023-09-30T22:31:48.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.806+0000 7f9e099fa700 1 -- 172.21.15.59:0/1294192486 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e041a3850 con 0x7f9e0409e930 2023-09-30T22:31:48.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.812+0000 7f9debfff700 1 -- 172.21.15.59:0/1294192486 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9df4015080 con 0x7f9e0409e930 2023-09-30T22:31:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.895+0000 7fa5ada33700 1 Processor -- start 2023-09-30T22:31:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.895+0000 7fa5ada33700 1 -- start start 2023-09-30T22:31:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.895+0000 7fa5ada33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a809d6f0 0x7fa5a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.895+0000 7fa5ada33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a809e410 0x7fa5a8134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.895+0000 7fa5ada33700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a809b120 con 0x7fa5a809e000 2023-09-30T22:31:48.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.895+0000 7fa5ada33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a806b460 con 0x7fa5a809d6f0 2023-09-30T22:31:48.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.895+0000 7fa5ada33700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a809a7e0 con 0x7fa5a809e410 2023-09-30T22:31:48.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.896+0000 7fa5a77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a809e410 0x7fa5a8134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.896+0000 7fa5a77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a809e410 0x7fa5a8134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38968/0 (socket says 172.21.15.59:38968) 2023-09-30T22:31:48.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.896+0000 7fa5a77fe700 1 -- 172.21.15.59:0/3466052534 learned_addr learned my addr 172.21.15.59:0/3466052534 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:48.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.896+0000 7fa5a77fe700 1 -- 172.21.15.59:0/3466052534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a809d6f0 msgr2=0x7fa5a809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:48.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.896+0000 7fa5a77fe700 1 --2- 172.21.15.59:0/3466052534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a809d6f0 0x7fa5a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.896+0000 7fa5a77fe700 1 -- 172.21.15.59:0/3466052534 >> v1:172.21.15.59:6789/0 conn(0x7fa5a809e000 legacy=0x7fa5a81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:48.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.896+0000 7fa5a77fe700 1 -- 172.21.15.59:0/3466052534 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a809a500 con 0x7fa5a809e410 2023-09-30T22:31:48.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.896+0000 7fa5a77fe700 1 --2- 172.21.15.59:0/3466052534 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a809e410 0x7fa5a8134100 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009eb0 tx=0x7fa5a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0313f31819650e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.897+0000 7fa5a5ffb700 1 -- 172.21.15.59:0/3466052534 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000e070 con 0x7fa5a809e410 2023-09-30T22:31:48.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.897+0000 7fa5a5ffb700 1 -- 172.21.15.59:0/3466052534 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a000b980 con 0x7fa5a809e410 2023-09-30T22:31:48.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.897+0000 7fa5a5ffb700 1 -- 172.21.15.59:0/3466052534 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000bd30 con 0x7fa5a809e410 2023-09-30T22:31:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.897+0000 7fa5ada33700 1 -- 172.21.15.59:0/3466052534 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a809e410 msgr2=0x7fa5a8134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.897+0000 7fa5ada33700 1 --2- 172.21.15.59:0/3466052534 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a809e410 0x7fa5a8134100 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009eb0 tx=0x7fa5a000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.897+0000 7fa5ada33700 1 -- 172.21.15.59:0/3466052534 shutdown_connections 2023-09-30T22:31:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.897+0000 7fa5ada33700 1 --2- 172.21.15.59:0/3466052534 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a809e410 0x7fa5a8134100 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.897+0000 7fa5ada33700 1 --2- 172.21.15.59:0/3466052534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a809d6f0 0x7fa5a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.897+0000 7fa5ada33700 1 -- 172.21.15.59:0/3466052534 >> 172.21.15.59:0/3466052534 conn(0x7fa5a8066f50 msgr2=0x7fa5a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.898+0000 7fa5ada33700 1 -- 172.21.15.59:0/3466052534 shutdown_connections 2023-09-30T22:31:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.898+0000 7fa5ada33700 1 -- 172.21.15.59:0/3466052534 wait complete. 2023-09-30T22:31:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.899+0000 7fa5ada33700 1 Processor -- start 2023-09-30T22:31:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.899+0000 7fa5ada33700 1 -- start start 2023-09-30T22:31:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.899+0000 7fa5ada33700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a809d6f0 0x7fa5a8122680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.899+0000 7fa5ada33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a809e000 0x7fa5a8122bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.899+0000 7fa5ada33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a809e410 0x7fa5a8123100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.899+0000 7fa5ada33700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80a1e20 con 0x7fa5a809d6f0 2023-09-30T22:31:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.899+0000 7fa5ada33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8124310 con 0x7fa5a809e000 2023-09-30T22:31:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.899+0000 7fa5ada33700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8124a40 con 0x7fa5a809e410 2023-09-30T22:31:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.899+0000 7fa5a77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a809e410 0x7fa5a8123100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.899+0000 7fa5a6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a809d6f0 0x7fa5a8122680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.900+0000 7fa5a77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a809e410 0x7fa5a8123100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38976/0 (socket says 172.21.15.59:38976) 2023-09-30T22:31:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.900+0000 7fa5a77fe700 1 -- 172.21.15.59:0/2977105581 learned_addr learned my addr 172.21.15.59:0/2977105581 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.900+0000 7fa5a67fc700 1 --2- 172.21.15.59:0/2977105581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a809e000 0x7fa5a8122bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.900+0000 7fa5a77fe700 1 -- 172.21.15.59:0/2977105581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a809e000 msgr2=0x7fa5a8122bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.900+0000 7fa5a77fe700 1 --2- 172.21.15.59:0/2977105581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a809e000 0x7fa5a8122bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.900+0000 7fa5a77fe700 1 -- 172.21.15.59:0/2977105581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a809d6f0 msgr2=0x7fa5a8122680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.900+0000 7fa5a77fe700 1 --2- 172.21.15.59:0/2977105581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a809d6f0 0x7fa5a8122680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.900+0000 7fa5a77fe700 1 -- 172.21.15.59:0/2977105581 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a0009b30 con 0x7fa5a809e410 2023-09-30T22:31:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.900+0000 7fa5a67fc700 1 --2- 172.21.15.59:0/2977105581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a809e000 0x7fa5a8122bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.900+0000 7fa5a77fe700 1 --2- 172.21.15.59:0/2977105581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a809e410 0x7fa5a8123100 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa5a809a970 tx=0x7fa5a0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.900+0000 7fa58ffff700 1 -- 172.21.15.59:0/2977105581 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0004450 con 0x7fa5a809e410 2023-09-30T22:31:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.900+0000 7fa58ffff700 1 -- 172.21.15.59:0/2977105581 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a00045d0 con 0x7fa5a809e410 2023-09-30T22:31:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.900+0000 7fa5ada33700 1 -- 172.21.15.59:0/2977105581 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a809c710 con 0x7fa5a809e410 2023-09-30T22:31:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.900+0000 7fa58ffff700 1 -- 172.21.15.59:0/2977105581 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0025460 con 0x7fa5a809e410 2023-09-30T22:31:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.900+0000 7fa5ada33700 1 -- 172.21.15.59:0/2977105581 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a81268a0 con 0x7fa5a809e410 2023-09-30T22:31:48.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.902+0000 7fa58ffff700 1 -- 172.21.15.59:0/2977105581 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5a001c410 con 0x7fa5a809e410 2023-09-30T22:31:48.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.902+0000 7fa5ada33700 1 -- 172.21.15.59:0/2977105581 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a8074ea0 con 0x7fa5a809e410 2023-09-30T22:31:48.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.902+0000 7fa58ffff700 1 -- 172.21.15.59:0/2977105581 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa5a00414a0 con 0x7fa5a809e410 2023-09-30T22:31:48.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.911+0000 7fa58ffff700 1 -- 172.21.15.59:0/2977105581 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5a0011390 con 0x7fa5a809e410 2023-09-30T22:31:48.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.943+0000 7fd652e98700 1 Processor -- start 2023-09-30T22:31:48.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.943+0000 7fd652e98700 1 -- start start 2023-09-30T22:31:48.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.944+0000 7fd652e98700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd64c09d6f0 0x7fd64c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.944+0000 7fd652e98700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64c09e000 0x7fd64c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.944+0000 7fd652e98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64c09e410 0x7fd64c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.944+0000 7fd652e98700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64c09f520 con 0x7fd64c09d6f0 2023-09-30T22:31:48.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.944+0000 7fd652e98700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c09f130 con 0x7fd64c09e410 2023-09-30T22:31:48.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.944+0000 7fd652e98700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c09e930 con 0x7fd64c09e000 2023-09-30T22:31:48.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.944+0000 7fd650c34700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd64c09d6f0 0x7fd64c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.944+0000 7fd650c34700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd64c09d6f0 0x7fd64c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49514/0 (socket says 172.21.15.59:49514) 2023-09-30T22:31:48.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.944+0000 7fd650c34700 1 -- 172.21.15.59:0/406083268 learned_addr learned my addr 172.21.15.59:0/406083268 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:48.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.944+0000 7fd650c34700 1 -- 172.21.15.59:0/406083268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64c09e000 msgr2=0x7fd64c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:48.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.944+0000 7fd650c34700 1 --2- 172.21.15.59:0/406083268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64c09e000 0x7fd64c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.944+0000 7fd650c34700 1 -- 172.21.15.59:0/406083268 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64c09e410 msgr2=0x7fd64c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:48.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.944+0000 7fd650c34700 1 --2- 172.21.15.59:0/406083268 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64c09e410 0x7fd64c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.944+0000 7fd650c34700 1 -- 172.21.15.59:0/406083268 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c09b2d0 con 0x7fd64c09d6f0 2023-09-30T22:31:48.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.945+0000 7fd650c34700 1 --2- 172.21.15.59:0/406083268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c09d6f0 0x7fd64c09dac0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd63c009e80 tx=0x7fd63c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2cb8cfa7825847 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.945+0000 7fd64b7fe700 1 -- 172.21.15.59:0/406083268 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c00e070 con 0x7fd64c09d6f0 2023-09-30T22:31:48.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.945+0000 7fd64b7fe700 1 -- 172.21.15.59:0/406083268 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c00b980 con 0x7fd64c09d6f0 2023-09-30T22:31:48.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.945+0000 7fd64b7fe700 1 -- 172.21.15.59:0/406083268 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c00bd30 con 0x7fd64c09d6f0 2023-09-30T22:31:48.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.946+0000 7fd652e98700 1 -- 172.21.15.59:0/406083268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c09d6f0 msgr2=0x7fd64c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.946+0000 7fd652e98700 1 --2- 172.21.15.59:0/406083268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c09d6f0 0x7fd64c09dac0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd63c009e80 tx=0x7fd63c00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:48.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.946+0000 7fd652e98700 1 -- 172.21.15.59:0/406083268 shutdown_connections 2023-09-30T22:31:48.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.946+0000 7fd652e98700 1 --2- 172.21.15.59:0/406083268 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64c09e410 0x7fd64c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.946+0000 7fd652e98700 1 --2- 172.21.15.59:0/406083268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c09d6f0 0x7fd64c09dac0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.946+0000 7fd652e98700 1 --2- 172.21.15.59:0/406083268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64c09e000 0x7fd64c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.946+0000 7fd652e98700 1 -- 172.21.15.59:0/406083268 >> 172.21.15.59:0/406083268 conn(0x7fd64c066f50 msgr2=0x7fd64c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.946+0000 7fd652e98700 1 -- 172.21.15.59:0/406083268 shutdown_connections 2023-09-30T22:31:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.946+0000 7fd652e98700 1 -- 172.21.15.59:0/406083268 wait complete. 2023-09-30T22:31:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.947+0000 7fd652e98700 1 Processor -- start 2023-09-30T22:31:48.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.947+0000 7fd652e98700 1 -- start start 2023-09-30T22:31:48.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.948+0000 7fd652e98700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64c09d6f0 0x7fd64c1c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.948+0000 7f7d19171700 1 Processor -- start 2023-09-30T22:31:48.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.948+0000 7fd652e98700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c09e000 0x7fd64c1c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.948+0000 7fd652e98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64c09e410 0x7fd64c1c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.948+0000 7fd652e98700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c137cf0 con 0x7fd64c09e000 2023-09-30T22:31:48.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.948+0000 7fd652e98700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c1c5210 con 0x7fd64c09e410 2023-09-30T22:31:48.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.948+0000 7fd652e98700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c119bc0 con 0x7fd64c09d6f0 2023-09-30T22:31:48.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7fd651435700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64c09e410 0x7fd64c1c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7fd651435700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64c09e410 0x7fd64c1c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60384/0 (socket says 172.21.15.59:60384) 2023-09-30T22:31:48.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7fd651435700 1 -- 172.21.15.59:0/2718531276 learned_addr learned my addr 172.21.15.59:0/2718531276 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:48.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7fd651435700 1 -- 172.21.15.59:0/2718531276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64c09d6f0 msgr2=0x7fd64c1c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7fd651435700 1 --2- 172.21.15.59:0/2718531276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64c09d6f0 0x7fd64c1c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7fd651435700 1 -- 172.21.15.59:0/2718531276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c09e000 msgr2=0x7fd64c1c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7fd651435700 1 --2- 172.21.15.59:0/2718531276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c09e000 0x7fd64c1c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7fd651435700 1 -- 172.21.15.59:0/2718531276 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c009b30 con 0x7fd64c09e410 2023-09-30T22:31:48.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7fd651435700 1 --2- 172.21.15.59:0/2718531276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64c09e410 0x7fd64c1c8790 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd64400b550 tx=0x7fd64400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7fd6497fa700 1 -- 172.21.15.59:0/2718531276 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644011830 con 0x7fd64c09e410 2023-09-30T22:31:48.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.950+0000 7fd6497fa700 1 -- 172.21.15.59:0/2718531276 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd644011990 con 0x7fd64c09e410 2023-09-30T22:31:48.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.950+0000 7fd652e98700 1 -- 172.21.15.59:0/2718531276 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64c119ee0 con 0x7fd64c09e410 2023-09-30T22:31:48.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.950+0000 7fd6497fa700 1 -- 172.21.15.59:0/2718531276 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644011d40 con 0x7fd64c09e410 2023-09-30T22:31:48.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7f7d19171700 1 -- start start 2023-09-30T22:31:48.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7f7d19171700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d1406e570 0x7f7d1406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7f7d19171700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d1406ee80 0x7f7d14134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7f7d19171700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d14070ee0 con 0x7f7d1409eca0 2023-09-30T22:31:48.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7f7d19171700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14071480 con 0x7f7d1406ee80 2023-09-30T22:31:48.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.949+0000 7f7d19171700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14071b90 con 0x7f7d1406e570 2023-09-30T22:31:48.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.950+0000 7f7d1359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d1406ee80 0x7f7d14134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.950+0000 7f7d1359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d1406ee80 0x7f7d14134d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60400/0 (socket says 172.21.15.59:60400) 2023-09-30T22:31:48.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.950+0000 7f7d1359e700 1 -- 172.21.15.59:0/3177609079 learned_addr learned my addr 172.21.15.59:0/3177609079 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:48.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.950+0000 7fd652e98700 1 -- 172.21.15.59:0/2718531276 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64c11a2b0 con 0x7fd64c09e410 2023-09-30T22:31:48.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.951+0000 7f7d12d9d700 1 --2- 172.21.15.59:0/3177609079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d1406e570 0x7f7d1406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.951+0000 7f7d11d9b700 1 -- 172.21.15.59:0/3177609079 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963970582 0 0) 0x7f7d14070ee0 con 0x7f7d1409eca0 2023-09-30T22:31:48.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.951+0000 7f7d11d9b700 1 -- 172.21.15.59:0/3177609079 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cfc0035b0 con 0x7f7d1409eca0 2023-09-30T22:31:48.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.951+0000 7fd6497fa700 1 -- 172.21.15.59:0/2718531276 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd64401a400 con 0x7fd64c09e410 2023-09-30T22:31:48.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.951+0000 7fd652e98700 1 -- 172.21.15.59:0/2718531276 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64c074ea0 con 0x7fd64c09e410 2023-09-30T22:31:48.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.951+0000 7f7d1359e700 1 -- 172.21.15.59:0/3177609079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d1406e570 msgr2=0x7f7d1406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:48.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.951+0000 7f7d1359e700 1 --2- 172.21.15.59:0/3177609079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d1406e570 0x7f7d1406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.951+0000 7f7d1359e700 1 -- 172.21.15.59:0/3177609079 >> v1:172.21.15.59:6789/0 conn(0x7f7d1409eca0 legacy=0x7f7d14134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.951+0000 7f7d1359e700 1 -- 172.21.15.59:0/3177609079 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d140711a0 con 0x7f7d1406ee80 2023-09-30T22:31:48.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.951+0000 7fd6497fa700 1 -- 172.21.15.59:0/2718531276 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd64403f6c0 con 0x7fd64c09e410 2023-09-30T22:31:48.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.951+0000 7f7d1359e700 1 --2- 172.21.15.59:0/3177609079 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d1406ee80 0x7f7d14134d20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009e80 tx=0x7f7d0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68ef0f0029c909e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.956+0000 7f7d11d9b700 1 -- 172.21.15.59:0/3177609079 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c00e070 con 0x7f7d1406ee80 2023-09-30T22:31:48.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.956+0000 7f7d11d9b700 1 -- 172.21.15.59:0/3177609079 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c00b910 con 0x7f7d1406ee80 2023-09-30T22:31:48.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.956+0000 7f7d11d9b700 1 -- 172.21.15.59:0/3177609079 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c00bcc0 con 0x7f7d1406ee80 2023-09-30T22:31:48.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.956+0000 7fd6497fa700 1 -- 172.21.15.59:0/2718531276 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd64400f8d0 con 0x7fd64c09e410 2023-09-30T22:31:48.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.957+0000 7f7d19171700 1 -- 172.21.15.59:0/3177609079 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d1406ee80 msgr2=0x7f7d14134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.957+0000 7f7d19171700 1 --2- 172.21.15.59:0/3177609079 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d1406ee80 0x7f7d14134d20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009e80 tx=0x7f7d0c00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.957+0000 7f7d19171700 1 -- 172.21.15.59:0/3177609079 shutdown_connections 2023-09-30T22:31:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.957+0000 7f7d19171700 1 --2- 172.21.15.59:0/3177609079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d1406e570 0x7f7d1406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.957+0000 7f7d19171700 1 --2- 172.21.15.59:0/3177609079 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d1406ee80 0x7f7d14134d20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.957+0000 7f7d19171700 1 -- 172.21.15.59:0/3177609079 >> 172.21.15.59:0/3177609079 conn(0x7f7d140a2aa0 msgr2=0x7f7d140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.957+0000 7f7d19171700 1 -- 172.21.15.59:0/3177609079 shutdown_connections 2023-09-30T22:31:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.957+0000 7f7d19171700 1 -- 172.21.15.59:0/3177609079 wait complete. 2023-09-30T22:31:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.959+0000 7f7d19171700 1 Processor -- start 2023-09-30T22:31:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.959+0000 7f7d19171700 1 -- start start 2023-09-30T22:31:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.960+0000 7f7d19171700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d1406e570 0x7f7d141230c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.960+0000 7f7d19171700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d1406ee80 0x7f7d14123600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.960+0000 7f7d19171700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d14123b40 0x7f7d141d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.960+0000 7f7d19171700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14125510 con 0x7f7d14123b40 2023-09-30T22:31:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.960+0000 7f7d19171700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14126be0 con 0x7f7d1406ee80 2023-09-30T22:31:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.960+0000 7f7d19171700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14126370 con 0x7f7d1406e570 2023-09-30T22:31:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.960+0000 7f7d1259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d1406ee80 0x7f7d14123600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.960+0000 7f7d1259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d1406ee80 0x7f7d14123600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60414/0 (socket says 172.21.15.59:60414) 2023-09-30T22:31:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.960+0000 7f7d1259c700 1 -- 172.21.15.59:0/179810852 learned_addr learned my addr 172.21.15.59:0/179810852 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.960+0000 7f7d12d9d700 1 --2- 172.21.15.59:0/179810852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d1406e570 0x7f7d141230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.960+0000 7f7d1359e700 1 --2- 172.21.15.59:0/179810852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d14123b40 0x7f7d141d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.961+0000 7f7d1259c700 1 -- 172.21.15.59:0/179810852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d1406e570 msgr2=0x7f7d141230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.961+0000 7f7d1259c700 1 --2- 172.21.15.59:0/179810852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d1406e570 0x7f7d141230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.961+0000 7f7d1259c700 1 -- 172.21.15.59:0/179810852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d14123b40 msgr2=0x7f7d141d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.961+0000 7f7d1259c700 1 --2- 172.21.15.59:0/179810852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d14123b40 0x7f7d141d2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.961+0000 7f7d1259c700 1 -- 172.21.15.59:0/179810852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c009b30 con 0x7f7d1406ee80 2023-09-30T22:31:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.961+0000 7f7d1259c700 1 --2- 172.21.15.59:0/179810852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d1406ee80 0x7f7d14123600 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800c530 tx=0x7f7d0800c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.961+0000 7f7cfb7fe700 1 -- 172.21.15.59:0/179810852 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d080052d0 con 0x7f7d1406ee80 2023-09-30T22:31:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.961+0000 7f7cfb7fe700 1 -- 172.21.15.59:0/179810852 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d08005430 con 0x7f7d1406ee80 2023-09-30T22:31:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.961+0000 7f7cfb7fe700 1 -- 172.21.15.59:0/179810852 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d080038c0 con 0x7f7d1406ee80 2023-09-30T22:31:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.961+0000 7f7d19171700 1 -- 172.21.15.59:0/179810852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d14135780 con 0x7f7d1406ee80 2023-09-30T22:31:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.961+0000 7f7d19171700 1 -- 172.21.15.59:0/179810852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d14125af0 con 0x7f7d1406ee80 2023-09-30T22:31:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.963+0000 7f7cfb7fe700 1 -- 172.21.15.59:0/179810852 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d08003a20 con 0x7f7d1406ee80 2023-09-30T22:31:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.963+0000 7f7d19171700 1 -- 172.21.15.59:0/179810852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d14074ea0 con 0x7f7d1406ee80 2023-09-30T22:31:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.963+0000 7f7cfb7fe700 1 -- 172.21.15.59:0/179810852 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7d0803eba0 con 0x7f7d1406ee80 2023-09-30T22:31:48.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:48.972+0000 7f7cfb7fe700 1 -- 172.21.15.59:0/179810852 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d08019c50 con 0x7f7d1406ee80 2023-09-30T22:31:49.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.055+0000 7f9e099fa700 1 -- 172.21.15.59:0/1294192486 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9e04074ea0 con 0x7f9e0409e930 2023-09-30T22:31:49.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.055+0000 7f9debfff700 1 -- 172.21.15.59:0/1294192486 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9df401b7b0 con 0x7f9e0409e930 2023-09-30T22:31:49.056 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:49.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.059+0000 7f9e099fa700 1 -- 172.21.15.59:0/1294192486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e0409e930 msgr2=0x7f9e041c42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.059+0000 7f9e099fa700 1 --2- 172.21.15.59:0/1294192486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e0409e930 0x7f9e041c42d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009c40 tx=0x7f9df4004750 comp rx=0 tx=0).stop 2023-09-30T22:31:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.059+0000 7f9e099fa700 1 -- 172.21.15.59:0/1294192486 shutdown_connections 2023-09-30T22:31:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.059+0000 7f9e099fa700 1 --2- 172.21.15.59:0/1294192486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e0409e930 0x7f9e041c42d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.059+0000 7f9e099fa700 1 --2- 172.21.15.59:0/1294192486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e0409f650 0x7f9e041c07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.059+0000 7f9e099fa700 1 --2- 172.21.15.59:0/1294192486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e0409f240 0x7f9e041c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.059+0000 7f9e099fa700 1 -- 172.21.15.59:0/1294192486 >> 172.21.15.59:0/1294192486 conn(0x7f9e040a4210 msgr2=0x7f9e041b6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.059+0000 7f9e099fa700 1 -- 172.21.15.59:0/1294192486 shutdown_connections 2023-09-30T22:31:49.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.059+0000 7f9e099fa700 1 -- 172.21.15.59:0/1294192486 wait complete. 2023-09-30T22:31:49.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:49.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.140+0000 7fa5ada33700 1 -- 172.21.15.59:0/2977105581 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa5a806c360 con 0x7fa5a809e410 2023-09-30T22:31:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.140+0000 7fa58ffff700 1 -- 172.21.15.59:0/2977105581 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5a0011390 con 0x7fa5a809e410 2023-09-30T22:31:49.140 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:49.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.143+0000 7fa5ada33700 1 -- 172.21.15.59:0/2977105581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a809e410 msgr2=0x7fa5a8123100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.143+0000 7fa5ada33700 1 --2- 172.21.15.59:0/2977105581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a809e410 0x7fa5a8123100 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa5a809a970 tx=0x7fa5a0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.143+0000 7fa5ada33700 1 -- 172.21.15.59:0/2977105581 shutdown_connections 2023-09-30T22:31:49.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.143+0000 7fa5ada33700 1 --2- 172.21.15.59:0/2977105581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a809e410 0x7fa5a8123100 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.143+0000 7fa5ada33700 1 --2- 172.21.15.59:0/2977105581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a809d6f0 0x7fa5a8122680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.143+0000 7fa5ada33700 1 --2- 172.21.15.59:0/2977105581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a809e000 0x7fa5a8122bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.143+0000 7fa5ada33700 1 -- 172.21.15.59:0/2977105581 >> 172.21.15.59:0/2977105581 conn(0x7fa5a8066f50 msgr2=0x7fa5a80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:49.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.144+0000 7fa5ada33700 1 -- 172.21.15.59:0/2977105581 shutdown_connections 2023-09-30T22:31:49.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.144+0000 7fa5ada33700 1 -- 172.21.15.59:0/2977105581 wait complete. 2023-09-30T22:31:49.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:49.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.166+0000 7fd652e98700 1 -- 172.21.15.59:0/2718531276 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd64c1197e0 con 0x7fd64c09e410 2023-09-30T22:31:49.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.166+0000 7fd6497fa700 1 -- 172.21.15.59:0/2718531276 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd644015030 con 0x7fd64c09e410 2023-09-30T22:31:49.166 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.168+0000 7fd652e98700 1 -- 172.21.15.59:0/2718531276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64c09e410 msgr2=0x7fd64c1c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.168+0000 7fd652e98700 1 --2- 172.21.15.59:0/2718531276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64c09e410 0x7fd64c1c8790 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd64400b550 tx=0x7fd64400b910 comp rx=0 tx=0).stop 2023-09-30T22:31:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.169+0000 7fd652e98700 1 -- 172.21.15.59:0/2718531276 shutdown_connections 2023-09-30T22:31:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.169+0000 7fd652e98700 1 --2- 172.21.15.59:0/2718531276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64c09d6f0 0x7fd64c1c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.169+0000 7fd652e98700 1 --2- 172.21.15.59:0/2718531276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64c09e410 0x7fd64c1c8790 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.169+0000 7fd652e98700 1 --2- 172.21.15.59:0/2718531276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64c09e000 0x7fd64c1c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.169+0000 7fd652e98700 1 -- 172.21.15.59:0/2718531276 >> 172.21.15.59:0/2718531276 conn(0x7fd64c066f50 msgr2=0x7fd64c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.169+0000 7fd652e98700 1 -- 172.21.15.59:0/2718531276 shutdown_connections 2023-09-30T22:31:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.169+0000 7fd652e98700 1 -- 172.21.15.59:0/2718531276 wait complete. 2023-09-30T22:31:49.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.214+0000 7f7d19171700 1 -- 172.21.15.59:0/179810852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7d1406b9e0 con 0x7f7d1406ee80 2023-09-30T22:31:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.214+0000 7f7cfb7fe700 1 -- 172.21.15.59:0/179810852 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d08019a70 con 0x7f7d1406ee80 2023-09-30T22:31:49.214 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.216+0000 7f7d19171700 1 -- 172.21.15.59:0/179810852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d1406ee80 msgr2=0x7f7d14123600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.216+0000 7f7d19171700 1 --2- 172.21.15.59:0/179810852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d1406ee80 0x7f7d14123600 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800c530 tx=0x7f7d0800c840 comp rx=0 tx=0).stop 2023-09-30T22:31:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.216+0000 7f7d19171700 1 -- 172.21.15.59:0/179810852 shutdown_connections 2023-09-30T22:31:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.216+0000 7f7d19171700 1 --2- 172.21.15.59:0/179810852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d1406e570 0x7f7d141230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.216+0000 7f7d19171700 1 --2- 172.21.15.59:0/179810852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d14123b40 0x7f7d141d2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.216+0000 7f7d19171700 1 --2- 172.21.15.59:0/179810852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d1406ee80 0x7f7d14123600 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.216+0000 7f7d19171700 1 -- 172.21.15.59:0/179810852 >> 172.21.15.59:0/179810852 conn(0x7f7d140a2aa0 msgr2=0x7f7d140a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.216+0000 7f7d19171700 1 -- 172.21.15.59:0/179810852 shutdown_connections 2023-09-30T22:31:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:49.217+0000 7f7d19171700 1 -- 172.21.15.59:0/179810852 wait complete. 2023-09-30T22:31:49.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:50.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:50.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:50.183 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:50.231 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:50.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.233+0000 7f498f987700 1 Processor -- start 2023-09-30T22:31:50.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.234+0000 7f498f987700 1 -- start start 2023-09-30T22:31:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.234+0000 7f498f987700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f498809e1d0 0x7f4988138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.234+0000 7f498f987700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4988139170 0x7f498813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.234+0000 7f498f987700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498809b120 con 0x7f498809d6f0 2023-09-30T22:31:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.234+0000 7f498f987700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498806b460 con 0x7f498809e1d0 2023-09-30T22:31:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.234+0000 7f498f987700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f498809a7e0 con 0x7f4988139170 2023-09-30T22:31:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.234+0000 7f498cf22700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f498809e1d0 0x7f4988138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.234+0000 7f498cf22700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f498809e1d0 0x7f4988138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60418/0 (socket says 172.21.15.59:60418) 2023-09-30T22:31:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.234+0000 7f498cf22700 1 -- 172.21.15.59:0/2362232598 learned_addr learned my addr 172.21.15.59:0/2362232598 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.235+0000 7f498df24700 1 --2- 172.21.15.59:0/2362232598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4988139170 0x7f498813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.235+0000 7f498cf22700 1 -- 172.21.15.59:0/2362232598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4988139170 msgr2=0x7f498813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.235+0000 7f498cf22700 1 --2- 172.21.15.59:0/2362232598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4988139170 0x7f498813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.235+0000 7f498cf22700 1 -- 172.21.15.59:0/2362232598 >> v1:172.21.15.59:6789/0 conn(0x7f498809d6f0 legacy=0x7f498809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.235+0000 7f498cf22700 1 -- 172.21.15.59:0/2362232598 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498809a500 con 0x7f498809e1d0 2023-09-30T22:31:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.235+0000 7f498cf22700 1 --2- 172.21.15.59:0/2362232598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f498809e1d0 0x7f4988138c30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4978009920 tx=0x7f4978009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18d13a5abd57ca6a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.235+0000 7f497ffff700 1 -- 172.21.15.59:0/2362232598 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978011830 con 0x7f498809e1d0 2023-09-30T22:31:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.235+0000 7f497ffff700 1 -- 172.21.15.59:0/2362232598 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4978011990 con 0x7f498809e1d0 2023-09-30T22:31:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.235+0000 7f497ffff700 1 -- 172.21.15.59:0/2362232598 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978011d20 con 0x7f498809e1d0 2023-09-30T22:31:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.236+0000 7f498f987700 1 -- 172.21.15.59:0/2362232598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f498809e1d0 msgr2=0x7f4988138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.236+0000 7f498f987700 1 --2- 172.21.15.59:0/2362232598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f498809e1d0 0x7f4988138c30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4978009920 tx=0x7f4978009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.236+0000 7f498f987700 1 -- 172.21.15.59:0/2362232598 shutdown_connections 2023-09-30T22:31:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.236+0000 7f498f987700 1 --2- 172.21.15.59:0/2362232598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4988139170 0x7f498813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.236+0000 7f498f987700 1 --2- 172.21.15.59:0/2362232598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f498809e1d0 0x7f4988138c30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.236+0000 7f498f987700 1 -- 172.21.15.59:0/2362232598 >> 172.21.15.59:0/2362232598 conn(0x7f4988066f50 msgr2=0x7f498809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.236+0000 7f498f987700 1 -- 172.21.15.59:0/2362232598 shutdown_connections 2023-09-30T22:31:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.236+0000 7f498f987700 1 -- 172.21.15.59:0/2362232598 wait complete. 2023-09-30T22:31:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.238+0000 7f498f987700 1 Processor -- start 2023-09-30T22:31:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.238+0000 7f498f987700 1 -- start start 2023-09-30T22:31:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498f987700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f498809d6f0 0x7f498811e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498f987700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f498809e1d0 0x7f498811ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498f987700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4988139170 0x7f498811f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498f987700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498809c7a0 con 0x7f498809e1d0 2023-09-30T22:31:50.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498f987700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4988122030 con 0x7f498809d6f0 2023-09-30T22:31:50.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498f987700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4988121a80 con 0x7f4988139170 2023-09-30T22:31:50.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498d723700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f498809d6f0 0x7f498811e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498df24700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4988139170 0x7f498811f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498d723700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f498809d6f0 0x7f498811e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60426/0 (socket says 172.21.15.59:60426) 2023-09-30T22:31:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498d723700 1 -- 172.21.15.59:0/1573946382 learned_addr learned my addr 172.21.15.59:0/1573946382 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498cf22700 1 --2- 172.21.15.59:0/1573946382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f498809e1d0 0x7f498811ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498df24700 1 -- 172.21.15.59:0/1573946382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f498809d6f0 msgr2=0x7f498811e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498df24700 1 --2- 172.21.15.59:0/1573946382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f498809d6f0 0x7f498811e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498df24700 1 -- 172.21.15.59:0/1573946382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f498809e1d0 msgr2=0x7f498811ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498df24700 1 --2- 172.21.15.59:0/1573946382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f498809e1d0 0x7f498811ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.239+0000 7f498df24700 1 -- 172.21.15.59:0/1573946382 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4978009550 con 0x7f4988139170 2023-09-30T22:31:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.240+0000 7f498df24700 1 --2- 172.21.15.59:0/1573946382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4988139170 0x7f498811f270 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4980009d90 tx=0x7f498000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.240+0000 7f497dffb700 1 -- 172.21.15.59:0/1573946382 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498000cc90 con 0x7f4988139170 2023-09-30T22:31:50.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.240+0000 7f498f987700 1 -- 172.21.15.59:0/1573946382 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4988072090 con 0x7f4988139170 2023-09-30T22:31:50.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.240+0000 7f497dffb700 1 -- 172.21.15.59:0/1573946382 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498000f040 con 0x7f4988139170 2023-09-30T22:31:50.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.240+0000 7f497dffb700 1 -- 172.21.15.59:0/1573946382 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980014480 con 0x7f4988139170 2023-09-30T22:31:50.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.240+0000 7f498f987700 1 -- 172.21.15.59:0/1573946382 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4988120bf0 con 0x7f4988139170 2023-09-30T22:31:50.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.241+0000 7f498f987700 1 -- 172.21.15.59:0/1573946382 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4988121cd0 con 0x7f4988139170 2023-09-30T22:31:50.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.242+0000 7f497dffb700 1 -- 172.21.15.59:0/1573946382 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49800145e0 con 0x7f4988139170 2023-09-30T22:31:50.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.242+0000 7f497dffb700 1 -- 172.21.15.59:0/1573946382 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f498003ffe0 con 0x7f4988139170 2023-09-30T22:31:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.247+0000 7f497dffb700 1 -- 172.21.15.59:0/1573946382 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4988121cd0 con 0x7f4988139170 2023-09-30T22:31:50.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.310+0000 7f3b7e1b4700 1 Processor -- start 2023-09-30T22:31:50.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.310+0000 7f3b7e1b4700 1 -- start start 2023-09-30T22:31:50.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.310+0000 7f3b7e1b4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b781338a0 0x7f3b78133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.311+0000 7f3b7e1b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b7809e930 0x7f3b7813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.311+0000 7f3b7e1b4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7806ef30 con 0x7f3b7809de50 2023-09-30T22:31:50.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.311+0000 7f3b7e1b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7806fef0 con 0x7f3b7809e930 2023-09-30T22:31:50.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.311+0000 7f3b7e1b4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b781334b0 con 0x7f3b781338a0 2023-09-30T22:31:50.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.311+0000 7f3b777fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b781338a0 0x7f3b78133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.311+0000 7f3b777fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b781338a0 0x7f3b78133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39052/0 (socket says 172.21.15.59:39052) 2023-09-30T22:31:50.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.311+0000 7f3b777fe700 1 -- 172.21.15.59:0/2176673733 learned_addr learned my addr 172.21.15.59:0/2176673733 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:50.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.311+0000 7f3b777fe700 1 -- 172.21.15.59:0/2176673733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b7809e930 msgr2=0x7f3b7813b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:50.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.311+0000 7f3b777fe700 1 --2- 172.21.15.59:0/2176673733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b7809e930 0x7f3b7813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.311+0000 7f3b777fe700 1 -- 172.21.15.59:0/2176673733 >> v1:172.21.15.59:6789/0 conn(0x7f3b7809de50 legacy=0x7f3b7809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.311+0000 7f3b777fe700 1 -- 172.21.15.59:0/2176673733 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7806fc30 con 0x7f3b781338a0 2023-09-30T22:31:50.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.311+0000 7f3b777fe700 1 --2- 172.21.15.59:0/2176673733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b781338a0 0x7f3b78133c70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009920 tx=0x7f3b68009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e74256adcba4b79 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.312+0000 7f3b767fc700 1 -- 172.21.15.59:0/2176673733 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6800ba60 con 0x7f3b781338a0 2023-09-30T22:31:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.312+0000 7f3b767fc700 1 -- 172.21.15.59:0/2176673733 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6800bbc0 con 0x7f3b781338a0 2023-09-30T22:31:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.312+0000 7f3b767fc700 1 -- 172.21.15.59:0/2176673733 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68009e70 con 0x7f3b781338a0 2023-09-30T22:31:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.312+0000 7f3b7e1b4700 1 -- 172.21.15.59:0/2176673733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b781338a0 msgr2=0x7f3b78133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.312+0000 7f3b7e1b4700 1 --2- 172.21.15.59:0/2176673733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b781338a0 0x7f3b78133c70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009920 tx=0x7f3b68009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.313+0000 7f3b7e1b4700 1 -- 172.21.15.59:0/2176673733 shutdown_connections 2023-09-30T22:31:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.313+0000 7f3b7e1b4700 1 --2- 172.21.15.59:0/2176673733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b781338a0 0x7f3b78133c70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.313+0000 7f3b7e1b4700 1 --2- 172.21.15.59:0/2176673733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b7809e930 0x7f3b7813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.313+0000 7f3b7e1b4700 1 -- 172.21.15.59:0/2176673733 >> 172.21.15.59:0/2176673733 conn(0x7f3b780a2aa0 msgr2=0x7f3b780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.313+0000 7f3b7e1b4700 1 -- 172.21.15.59:0/2176673733 shutdown_connections 2023-09-30T22:31:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.313+0000 7f3b7e1b4700 1 -- 172.21.15.59:0/2176673733 wait complete. 2023-09-30T22:31:50.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.314+0000 7f3b7e1b4700 1 Processor -- start 2023-09-30T22:31:50.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.314+0000 7f3b7e1b4700 1 -- start start 2023-09-30T22:31:50.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b7e1b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7809de50 0x7f3b7811d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b7e1b4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b7809e930 0x7f3b7811dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b7e1b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b781338a0 0x7f3b7811e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b7e1b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b78121030 con 0x7f3b7809de50 2023-09-30T22:31:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b7e1b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7811f3a0 con 0x7f3b781338a0 2023-09-30T22:31:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b7e1b4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b78121280 con 0x7f3b7809e930 2023-09-30T22:31:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b76ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b7809e930 0x7f3b7811dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b777fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7809de50 0x7f3b7811d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b76ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b7809e930 0x7f3b7811dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39056/0 (socket says 172.21.15.59:39056) 2023-09-30T22:31:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b76ffd700 1 -- 172.21.15.59:0/2298053958 learned_addr learned my addr 172.21.15.59:0/2298053958 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b77fff700 1 --2- 172.21.15.59:0/2298053958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b781338a0 0x7f3b7811e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b76ffd700 1 -- 172.21.15.59:0/2298053958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b781338a0 msgr2=0x7f3b7811e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b76ffd700 1 --2- 172.21.15.59:0/2298053958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b781338a0 0x7f3b7811e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b76ffd700 1 -- 172.21.15.59:0/2298053958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7809de50 msgr2=0x7f3b7811d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b76ffd700 1 --2- 172.21.15.59:0/2298053958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7809de50 0x7f3b7811d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b76ffd700 1 -- 172.21.15.59:0/2298053958 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b68009550 con 0x7f3b7809e930 2023-09-30T22:31:50.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.315+0000 7f3b777fe700 1 --2- 172.21.15.59:0/2298053958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7809de50 0x7f3b7811d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.316+0000 7f3b76ffd700 1 --2- 172.21.15.59:0/2298053958 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b7809e930 0x7f3b7811dd20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00c4e0 tx=0x7f3b6c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.316+0000 7f3b5ffff700 1 -- 172.21.15.59:0/2298053958 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0052d0 con 0x7f3b7809e930 2023-09-30T22:31:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.316+0000 7f3b5ffff700 1 -- 172.21.15.59:0/2298053958 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c005430 con 0x7f3b7809e930 2023-09-30T22:31:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.316+0000 7f3b7e1b4700 1 -- 172.21.15.59:0/2298053958 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b780a1060 con 0x7f3b7809e930 2023-09-30T22:31:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.316+0000 7f3b5ffff700 1 -- 172.21.15.59:0/2298053958 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0038c0 con 0x7f3b7809e930 2023-09-30T22:31:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.316+0000 7f3b7e1b4700 1 -- 172.21.15.59:0/2298053958 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b78120100 con 0x7f3b7809e930 2023-09-30T22:31:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.317+0000 7f3b5ffff700 1 -- 172.21.15.59:0/2298053958 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b6c003a20 con 0x7f3b7809e930 2023-09-30T22:31:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.317+0000 7f3b7e1b4700 1 -- 172.21.15.59:0/2298053958 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b78074ea0 con 0x7f3b7809e930 2023-09-30T22:31:50.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.317+0000 7f3b5ffff700 1 -- 172.21.15.59:0/2298053958 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3b6c03eae0 con 0x7f3b7809e930 2023-09-30T22:31:50.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.323+0000 7f3b5ffff700 1 -- 172.21.15.59:0/2298053958 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b6c017070 con 0x7f3b7809e930 2023-09-30T22:31:50.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.357+0000 7fab58ed6700 1 Processor -- start 2023-09-30T22:31:50.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.357+0000 7fab58ed6700 1 -- start start 2023-09-30T22:31:50.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.358+0000 7fab58ed6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab541338a0 0x7fab54133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.358+0000 7fab58ed6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab5409de50 0x7fab5409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.358+0000 7fab58ed6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5406ef30 con 0x7fab5409e760 2023-09-30T22:31:50.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.358+0000 7fab58ed6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5406fef0 con 0x7fab5409de50 2023-09-30T22:31:50.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.358+0000 7fab58ed6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab541334b0 con 0x7fab541338a0 2023-09-30T22:31:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.358+0000 7fab52d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fab5409e760 0x7fab5413a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46776/0 (socket says 172.21.15.59:46776) 2023-09-30T22:31:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.358+0000 7fab5259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab541338a0 0x7fab54133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.358+0000 7fab52d9d700 1 -- 172.21.15.59:0/116841327 learned_addr learned my addr 172.21.15.59:0/116841327 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.358+0000 7fab51d9b700 1 --2- 172.21.15.59:0/116841327 >> v2:172.21.15.59:3300/0 conn(0x7fab5409de50 0x7fab5409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.358+0000 7fab5259c700 1 -- 172.21.15.59:0/116841327 >> v2:172.21.15.59:3300/0 conn(0x7fab5409de50 msgr2=0x7fab5409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.358+0000 7fab5259c700 1 --2- 172.21.15.59:0/116841327 >> v2:172.21.15.59:3300/0 conn(0x7fab5409de50 0x7fab5409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.358+0000 7fab5259c700 1 -- 172.21.15.59:0/116841327 >> v1:172.21.15.59:6789/0 conn(0x7fab5409e760 legacy=0x7fab5413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.358+0000 7fab5259c700 1 -- 172.21.15.59:0/116841327 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5406fc30 con 0x7fab541338a0 2023-09-30T22:31:50.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.359+0000 7fab5259c700 1 --2- 172.21.15.59:0/116841327 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab541338a0 0x7fab54133c70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fab44009840 tx=0x7fab44009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6757b991c352cace server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:50.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.359+0000 7fab5159a700 1 -- 172.21.15.59:0/116841327 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44004230 con 0x7fab541338a0 2023-09-30T22:31:50.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.359+0000 7fab5159a700 1 -- 172.21.15.59:0/116841327 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab44004390 con 0x7fab541338a0 2023-09-30T22:31:50.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.359+0000 7fab5159a700 1 -- 172.21.15.59:0/116841327 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440036a0 con 0x7fab541338a0 2023-09-30T22:31:50.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.360+0000 7fab58ed6700 1 -- 172.21.15.59:0/116841327 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab541338a0 msgr2=0x7fab54133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.360+0000 7fab58ed6700 1 --2- 172.21.15.59:0/116841327 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab541338a0 0x7fab54133c70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fab44009840 tx=0x7fab44009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:50.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.360+0000 7fab58ed6700 1 -- 172.21.15.59:0/116841327 shutdown_connections 2023-09-30T22:31:50.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.360+0000 7fab58ed6700 1 --2- 172.21.15.59:0/116841327 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab541338a0 0x7fab54133c70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.360+0000 7fab58ed6700 1 --2- 172.21.15.59:0/116841327 >> v2:172.21.15.59:3300/0 conn(0x7fab5409de50 0x7fab5409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.360+0000 7fab58ed6700 1 -- 172.21.15.59:0/116841327 >> 172.21.15.59:0/116841327 conn(0x7fab540a2aa0 msgr2=0x7fab540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:50.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.360+0000 7fab58ed6700 1 -- 172.21.15.59:0/116841327 shutdown_connections 2023-09-30T22:31:50.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.360+0000 7fab58ed6700 1 -- 172.21.15.59:0/116841327 wait complete. 2023-09-30T22:31:50.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.361+0000 7fab58ed6700 1 Processor -- start 2023-09-30T22:31:50.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.362+0000 7fab58ed6700 1 -- start start 2023-09-30T22:31:50.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.362+0000 7fab58ed6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5409de50 0x7fab5411eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.362+0000 7fab58ed6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5409e760 0x7fab5411f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.362+0000 7fab58ed6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab541338a0 0x7fab5411f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.362+0000 7fab58ed6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5412f6f0 con 0x7fab5409de50 2023-09-30T22:31:50.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.362+0000 7fab58ed6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab54121cf0 con 0x7fab5409e760 2023-09-30T22:31:50.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.362+0000 7fab58ed6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab54120730 con 0x7fab541338a0 2023-09-30T22:31:50.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.363+0000 7fab51d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5409e760 0x7fab5411f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.363+0000 7fab51d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5409e760 0x7fab5411f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60446/0 (socket says 172.21.15.59:60446) 2023-09-30T22:31:50.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.363+0000 7fab51d9b700 1 -- 172.21.15.59:0/2147265254 learned_addr learned my addr 172.21.15.59:0/2147265254 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:50.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.363+0000 7fab5259c700 1 --2- 172.21.15.59:0/2147265254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5409de50 0x7fab5411eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.363+0000 7fab52d9d700 1 --2- 172.21.15.59:0/2147265254 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab541338a0 0x7fab5411f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.363+0000 7fab5259c700 1 -- 172.21.15.59:0/2147265254 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab541338a0 msgr2=0x7fab5411f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.363+0000 7fab5259c700 1 --2- 172.21.15.59:0/2147265254 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab541338a0 0x7fab5411f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.363+0000 7fab5259c700 1 -- 172.21.15.59:0/2147265254 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5409e760 msgr2=0x7fab5411f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.363+0000 7fab5259c700 1 --2- 172.21.15.59:0/2147265254 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5409e760 0x7fab5411f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.363+0000 7fab5259c700 1 -- 172.21.15.59:0/2147265254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab440094a0 con 0x7fab5409de50 2023-09-30T22:31:50.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.363+0000 7fab5259c700 1 --2- 172.21.15.59:0/2147265254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5409de50 0x7fab5411eaf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fab44015000 tx=0x7fab44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:50.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.364+0000 7fab42ffd700 1 -- 172.21.15.59:0/2147265254 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44011630 con 0x7fab5409de50 2023-09-30T22:31:50.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.364+0000 7fab42ffd700 1 -- 172.21.15.59:0/2147265254 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4401f070 con 0x7fab5409de50 2023-09-30T22:31:50.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.364+0000 7fab58ed6700 1 -- 172.21.15.59:0/2147265254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab54122070 con 0x7fab5409de50 2023-09-30T22:31:50.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.364+0000 7fab58ed6700 1 -- 172.21.15.59:0/2147265254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab54122330 con 0x7fab5409de50 2023-09-30T22:31:50.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.364+0000 7fab42ffd700 1 -- 172.21.15.59:0/2147265254 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440119f0 con 0x7fab5409de50 2023-09-30T22:31:50.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.365+0000 7fab42ffd700 1 -- 172.21.15.59:0/2147265254 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab44011b50 con 0x7fab5409de50 2023-09-30T22:31:50.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.365+0000 7fab42ffd700 1 -- 172.21.15.59:0/2147265254 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab44021070 con 0x7fab5409de50 2023-09-30T22:31:50.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.365+0000 7fab58ed6700 1 -- 172.21.15.59:0/2147265254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab380052e0 con 0x7fab5409de50 2023-09-30T22:31:50.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.370+0000 7fab42ffd700 1 -- 172.21.15.59:0/2147265254 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab440197d0 con 0x7fab5409de50 2023-09-30T22:31:50.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.391+0000 7f1bdb0de700 1 Processor -- start 2023-09-30T22:31:50.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.391+0000 7f1bdb0de700 1 -- start start 2023-09-30T22:31:50.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.391+0000 7f1bdb0de700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1bd409d6f0 0x7f1bd409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.391+0000 7f1bdb0de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd409e000 0x7f1bd41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.391+0000 7f1bdb0de700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd409b120 con 0x7f1bd409e410 2023-09-30T22:31:50.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.392+0000 7f1bdb0de700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd406b460 con 0x7f1bd409d6f0 2023-09-30T22:31:50.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.392+0000 7f1bdb0de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd409a7e0 con 0x7f1bd409e000 2023-09-30T22:31:50.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.392+0000 7f1bd3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd409e000 0x7f1bd41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.392+0000 7f1bd967b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1bd409e410 0x7f1bd4133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46788/0 (socket says 172.21.15.59:46788) 2023-09-30T22:31:50.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.392+0000 7f1bd967b700 1 -- 172.21.15.59:0/1637398342 learned_addr learned my addr 172.21.15.59:0/1637398342 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:50.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.392+0000 7f1bd8e7a700 1 --2- 172.21.15.59:0/1637398342 >> v2:172.21.15.59:3300/0 conn(0x7f1bd409d6f0 0x7f1bd409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.392+0000 7f1bd3fff700 1 -- 172.21.15.59:0/1637398342 >> v2:172.21.15.59:3300/0 conn(0x7f1bd409d6f0 msgr2=0x7f1bd409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:50.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.392+0000 7f1bd3fff700 1 --2- 172.21.15.59:0/1637398342 >> v2:172.21.15.59:3300/0 conn(0x7f1bd409d6f0 0x7f1bd409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.392+0000 7f1bd3fff700 1 -- 172.21.15.59:0/1637398342 >> v1:172.21.15.59:6789/0 conn(0x7f1bd409e410 legacy=0x7f1bd4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.392+0000 7f1bd37fe700 1 -- 172.21.15.59:0/1637398342 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094232720 0 0) 0x7f1bd409b120 con 0x7f1bd409e410 2023-09-30T22:31:50.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.392+0000 7f1bd3fff700 1 -- 172.21.15.59:0/1637398342 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd409a500 con 0x7f1bd409e000 2023-09-30T22:31:50.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.392+0000 7f1bd3fff700 1 --2- 172.21.15.59:0/1637398342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd409e000 0x7f1bd41339f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009870 tx=0x7f1bc0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15d6f2e04e6b6e73 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:50.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.393+0000 7f1bd37fe700 1 -- 172.21.15.59:0/1637398342 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0011830 con 0x7f1bd409e000 2023-09-30T22:31:50.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.393+0000 7f1bd37fe700 1 -- 172.21.15.59:0/1637398342 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc0011990 con 0x7f1bd409e000 2023-09-30T22:31:50.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.393+0000 7f1bd37fe700 1 -- 172.21.15.59:0/1637398342 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0011d20 con 0x7f1bd409e000 2023-09-30T22:31:50.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.393+0000 7f1bdb0de700 1 -- 172.21.15.59:0/1637398342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd409e000 msgr2=0x7f1bd41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.393+0000 7f1bdb0de700 1 --2- 172.21.15.59:0/1637398342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd409e000 0x7f1bd41339f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009870 tx=0x7f1bc0009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:50.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.393+0000 7f1bdb0de700 1 -- 172.21.15.59:0/1637398342 shutdown_connections 2023-09-30T22:31:50.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.393+0000 7f1bdb0de700 1 --2- 172.21.15.59:0/1637398342 >> v2:172.21.15.59:3300/0 conn(0x7f1bd409d6f0 0x7f1bd409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.393+0000 7f1bdb0de700 1 --2- 172.21.15.59:0/1637398342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd409e000 0x7f1bd41339f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.393+0000 7f1bdb0de700 1 -- 172.21.15.59:0/1637398342 >> 172.21.15.59:0/1637398342 conn(0x7f1bd4066f50 msgr2=0x7f1bd409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:50.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.393+0000 7f1bdb0de700 1 -- 172.21.15.59:0/1637398342 shutdown_connections 2023-09-30T22:31:50.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.394+0000 7f1bdb0de700 1 -- 172.21.15.59:0/1637398342 wait complete. 2023-09-30T22:31:50.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.395+0000 7f1bdb0de700 1 Processor -- start 2023-09-30T22:31:50.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.395+0000 7f1bdb0de700 1 -- start start 2023-09-30T22:31:50.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.396+0000 7f1bdb0de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bd409d6f0 0x7f1bd41194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.396+0000 7f1bdb0de700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bd409e000 0x7f1bd41199f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.396+0000 7f1bdb0de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd409e410 0x7f1bd4119f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:50.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.396+0000 7f1bdb0de700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd411c820 con 0x7f1bd409e000 2023-09-30T22:31:50.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.396+0000 7f1bdb0de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd411b240 con 0x7f1bd409e410 2023-09-30T22:31:50.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.396+0000 7f1bdb0de700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd409c710 con 0x7f1bd409d6f0 2023-09-30T22:31:50.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.396+0000 7f1bd967b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd409e410 0x7f1bd4119f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.396+0000 7f1bd8e7a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bd409d6f0 0x7f1bd41194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.396+0000 7f1bd967b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd409e410 0x7f1bd4119f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60462/0 (socket says 172.21.15.59:60462) 2023-09-30T22:31:50.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.396+0000 7f1bd967b700 1 -- 172.21.15.59:0/1033445563 learned_addr learned my addr 172.21.15.59:0/1033445563 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.396+0000 7f1bd3fff700 1 --2- 172.21.15.59:0/1033445563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bd409e000 0x7f1bd41199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.397+0000 7f1bd967b700 1 -- 172.21.15.59:0/1033445563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bd409d6f0 msgr2=0x7f1bd41194b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.397+0000 7f1bd967b700 1 --2- 172.21.15.59:0/1033445563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bd409d6f0 0x7f1bd41194b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.397+0000 7f1bd967b700 1 -- 172.21.15.59:0/1033445563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bd409e000 msgr2=0x7f1bd41199f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.397+0000 7f1bd967b700 1 --2- 172.21.15.59:0/1033445563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bd409e000 0x7f1bd41199f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.397+0000 7f1bd967b700 1 -- 172.21.15.59:0/1033445563 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc00094a0 con 0x7f1bd409e410 2023-09-30T22:31:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.397+0000 7f1bd8e7a700 1 --2- 172.21.15.59:0/1033445563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bd409d6f0 0x7f1bd41194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.397+0000 7f1bd967b700 1 --2- 172.21.15.59:0/1033445563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd409e410 0x7f1bd4119f30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc002230 tx=0x7f1bcc00cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.397+0000 7f1bd17fa700 1 -- 172.21.15.59:0/1033445563 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc00aac0 con 0x7f1bd409e410 2023-09-30T22:31:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.397+0000 7f1bd17fa700 1 -- 172.21.15.59:0/1033445563 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc00ac40 con 0x7f1bd409e410 2023-09-30T22:31:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.397+0000 7f1bd17fa700 1 -- 172.21.15.59:0/1033445563 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0070d0 con 0x7f1bd409e410 2023-09-30T22:31:50.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.397+0000 7f1bdb0de700 1 -- 172.21.15.59:0/1033445563 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd411c0d0 con 0x7f1bd409e410 2023-09-30T22:31:50.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.397+0000 7f1bdb0de700 1 -- 172.21.15.59:0/1033445563 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd41cc370 con 0x7f1bd409e410 2023-09-30T22:31:50.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.399+0000 7f1bd17fa700 1 -- 172.21.15.59:0/1033445563 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1bcc007250 con 0x7f1bd409e410 2023-09-30T22:31:50.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.399+0000 7f1bd17fa700 1 -- 172.21.15.59:0/1033445563 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1bcc03f180 con 0x7f1bd409e410 2023-09-30T22:31:50.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.399+0000 7f1bdb0de700 1 -- 172.21.15.59:0/1033445563 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd4074ea0 con 0x7f1bd409e410 2023-09-30T22:31:50.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.408+0000 7f1bd17fa700 1 -- 172.21.15.59:0/1033445563 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1bcc018080 con 0x7f1bd409e410 2023-09-30T22:31:50.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.468+0000 7f498f987700 1 -- 172.21.15.59:0/1573946382 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4988121cd0 con 0x7f4988139170 2023-09-30T22:31:50.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.468+0000 7f497dffb700 1 -- 172.21.15.59:0/1573946382 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4988121cd0 con 0x7f4988139170 2023-09-30T22:31:50.469 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.471+0000 7f498f987700 1 -- 172.21.15.59:0/1573946382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4988139170 msgr2=0x7f498811f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.471+0000 7f498f987700 1 --2- 172.21.15.59:0/1573946382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4988139170 0x7f498811f270 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4980009d90 tx=0x7f498000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.471+0000 7f498f987700 1 -- 172.21.15.59:0/1573946382 shutdown_connections 2023-09-30T22:31:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.471+0000 7f498f987700 1 --2- 172.21.15.59:0/1573946382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4988139170 0x7f498811f270 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.471+0000 7f498f987700 1 --2- 172.21.15.59:0/1573946382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f498809d6f0 0x7f498811e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.471+0000 7f498f987700 1 --2- 172.21.15.59:0/1573946382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f498809e1d0 0x7f498811ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.471+0000 7f498f987700 1 -- 172.21.15.59:0/1573946382 >> 172.21.15.59:0/1573946382 conn(0x7f4988066f50 msgr2=0x7f4988136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.471+0000 7f498f987700 1 -- 172.21.15.59:0/1573946382 shutdown_connections 2023-09-30T22:31:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.471+0000 7f498f987700 1 -- 172.21.15.59:0/1573946382 wait complete. 2023-09-30T22:31:50.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:50.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.535+0000 7f3b7e1b4700 1 -- 172.21.15.59:0/2298053958 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3b78120e70 con 0x7f3b7809e930 2023-09-30T22:31:50.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.536+0000 7f3b5ffff700 1 -- 172.21.15.59:0/2298053958 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b78120e70 con 0x7f3b7809e930 2023-09-30T22:31:50.536 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:50.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.538+0000 7f3b7e1b4700 1 -- 172.21.15.59:0/2298053958 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b7809e930 msgr2=0x7f3b7811dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.538+0000 7f3b7e1b4700 1 --2- 172.21.15.59:0/2298053958 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b7809e930 0x7f3b7811dd20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00c4e0 tx=0x7f3b6c00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.539+0000 7f3b7e1b4700 1 -- 172.21.15.59:0/2298053958 shutdown_connections 2023-09-30T22:31:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.539+0000 7f3b7e1b4700 1 --2- 172.21.15.59:0/2298053958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b781338a0 0x7f3b7811e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.539+0000 7f3b7e1b4700 1 --2- 172.21.15.59:0/2298053958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7809de50 0x7f3b7811d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.539+0000 7f3b7e1b4700 1 --2- 172.21.15.59:0/2298053958 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b7809e930 0x7f3b7811dd20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.539+0000 7f3b7e1b4700 1 -- 172.21.15.59:0/2298053958 >> 172.21.15.59:0/2298053958 conn(0x7f3b780a2aa0 msgr2=0x7f3b781b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.539+0000 7f3b7e1b4700 1 -- 172.21.15.59:0/2298053958 shutdown_connections 2023-09-30T22:31:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.539+0000 7f3b7e1b4700 1 -- 172.21.15.59:0/2298053958 wait complete. 2023-09-30T22:31:50.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.601+0000 7fab58ed6700 1 -- 172.21.15.59:0/2147265254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fab38005590 con 0x7fab5409de50 2023-09-30T22:31:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.601+0000 7fab42ffd700 1 -- 172.21.15.59:0/2147265254 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab4402f3f0 con 0x7fab5409de50 2023-09-30T22:31:50.602 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.604+0000 7fab58ed6700 1 -- 172.21.15.59:0/2147265254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5409de50 msgr2=0x7fab5411eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.604+0000 7fab58ed6700 1 --2- 172.21.15.59:0/2147265254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5409de50 0x7fab5411eaf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fab44015000 tx=0x7fab44004750 comp rx=0 tx=0).stop 2023-09-30T22:31:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.604+0000 7fab58ed6700 1 -- 172.21.15.59:0/2147265254 shutdown_connections 2023-09-30T22:31:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.604+0000 7fab58ed6700 1 --2- 172.21.15.59:0/2147265254 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab541338a0 0x7fab5411f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.604+0000 7fab58ed6700 1 --2- 172.21.15.59:0/2147265254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5409de50 0x7fab5411eaf0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.604+0000 7fab58ed6700 1 --2- 172.21.15.59:0/2147265254 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5409e760 0x7fab5411f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.604+0000 7fab58ed6700 1 -- 172.21.15.59:0/2147265254 >> 172.21.15.59:0/2147265254 conn(0x7fab540a2aa0 msgr2=0x7fab5409edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.604+0000 7fab58ed6700 1 -- 172.21.15.59:0/2147265254 shutdown_connections 2023-09-30T22:31:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.604+0000 7fab58ed6700 1 -- 172.21.15.59:0/2147265254 wait complete. 2023-09-30T22:31:50.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:50.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.624+0000 7f1bdb0de700 1 -- 172.21.15.59:0/1033445563 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1bd406c360 con 0x7f1bd409e410 2023-09-30T22:31:50.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.625+0000 7f1bd17fa700 1 -- 172.21.15.59:0/1033445563 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1bcc007500 con 0x7f1bd409e410 2023-09-30T22:31:50.625 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:50.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.627+0000 7f1bdb0de700 1 -- 172.21.15.59:0/1033445563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd409e410 msgr2=0x7f1bd4119f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.627+0000 7f1bdb0de700 1 --2- 172.21.15.59:0/1033445563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd409e410 0x7f1bd4119f30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc002230 tx=0x7f1bcc00cf50 comp rx=0 tx=0).stop 2023-09-30T22:31:50.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.627+0000 7f1bdb0de700 1 -- 172.21.15.59:0/1033445563 shutdown_connections 2023-09-30T22:31:50.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.627+0000 7f1bdb0de700 1 --2- 172.21.15.59:0/1033445563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bd409d6f0 0x7f1bd41194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.627+0000 7f1bdb0de700 1 --2- 172.21.15.59:0/1033445563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd409e410 0x7f1bd4119f30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.627+0000 7f1bdb0de700 1 --2- 172.21.15.59:0/1033445563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bd409e000 0x7f1bd41199f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.627+0000 7f1bdb0de700 1 -- 172.21.15.59:0/1033445563 >> 172.21.15.59:0/1033445563 conn(0x7f1bd4066f50 msgr2=0x7f1bd409b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:50.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.627+0000 7f1bdb0de700 1 -- 172.21.15.59:0/1033445563 shutdown_connections 2023-09-30T22:31:50.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:50.627+0000 7f1bdb0de700 1 -- 172.21.15.59:0/1033445563 wait complete. 2023-09-30T22:31:50.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:51.486 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:51.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:51.618 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:51.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.635+0000 7f5d56bce700 1 Processor -- start 2023-09-30T22:31:51.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.635+0000 7f5d56bce700 1 -- start start 2023-09-30T22:31:51.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.636+0000 7f5d56bce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d5009d6f0 0x7f5d5009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.636+0000 7f5d56bce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d5009e410 0x7f5d50134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.636+0000 7f5d56bce700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5009b120 con 0x7f5d5009e000 2023-09-30T22:31:51.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.636+0000 7f5d56bce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5006b460 con 0x7f5d5009e410 2023-09-30T22:31:51.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.636+0000 7f5d56bce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5009a7e0 con 0x7f5d5009d6f0 2023-09-30T22:31:51.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.636+0000 7f5d5496a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d5009d6f0 0x7f5d5009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.636+0000 7f5d5496a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d5009d6f0 0x7f5d5009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39100/0 (socket says 172.21.15.59:39100) 2023-09-30T22:31:51.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.636+0000 7f5d5496a700 1 -- 172.21.15.59:0/635450648 learned_addr learned my addr 172.21.15.59:0/635450648 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:51.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.636+0000 7f5d5516b700 1 --2- 172.21.15.59:0/635450648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d5009e410 0x7f5d50134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.636+0000 7f5d5496a700 1 -- 172.21.15.59:0/635450648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d5009e410 msgr2=0x7f5d50134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:51.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.636+0000 7f5d5496a700 1 --2- 172.21.15.59:0/635450648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d5009e410 0x7f5d50134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.636+0000 7f5d5496a700 1 -- 172.21.15.59:0/635450648 >> v1:172.21.15.59:6789/0 conn(0x7f5d5009e000 legacy=0x7f5d501339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:51.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.636+0000 7f5d5496a700 1 -- 172.21.15.59:0/635450648 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5009a500 con 0x7f5d5009d6f0 2023-09-30T22:31:51.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.636+0000 7f5d5496a700 1 --2- 172.21.15.59:0/635450648 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d5009d6f0 0x7f5d5009dac0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009950 tx=0x7f5d44009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efff38a7f9c820e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.637+0000 7f5d4f7fe700 1 -- 172.21.15.59:0/635450648 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44004230 con 0x7f5d5009d6f0 2023-09-30T22:31:51.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.637+0000 7f5d4f7fe700 1 -- 172.21.15.59:0/635450648 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d44004390 con 0x7f5d5009d6f0 2023-09-30T22:31:51.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.637+0000 7f5d4f7fe700 1 -- 172.21.15.59:0/635450648 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d440036a0 con 0x7f5d5009d6f0 2023-09-30T22:31:51.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.637+0000 7f5d56bce700 1 -- 172.21.15.59:0/635450648 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d5009d6f0 msgr2=0x7f5d5009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.637+0000 7f5d56bce700 1 --2- 172.21.15.59:0/635450648 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d5009d6f0 0x7f5d5009dac0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009950 tx=0x7f5d44009c60 comp rx=0 tx=0).stop 2023-09-30T22:31:51.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.637+0000 7f5d56bce700 1 -- 172.21.15.59:0/635450648 shutdown_connections 2023-09-30T22:31:51.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.637+0000 7f5d56bce700 1 --2- 172.21.15.59:0/635450648 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d5009d6f0 0x7f5d5009dac0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.637+0000 7f5d56bce700 1 --2- 172.21.15.59:0/635450648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d5009e410 0x7f5d50134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.637+0000 7f5d56bce700 1 -- 172.21.15.59:0/635450648 >> 172.21.15.59:0/635450648 conn(0x7f5d50066f50 msgr2=0x7f5d5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.638+0000 7f5d56bce700 1 -- 172.21.15.59:0/635450648 shutdown_connections 2023-09-30T22:31:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.638+0000 7f5d56bce700 1 -- 172.21.15.59:0/635450648 wait complete. 2023-09-30T22:31:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.638+0000 7f5d56bce700 1 Processor -- start 2023-09-30T22:31:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.639+0000 7f5d56bce700 1 -- start start 2023-09-30T22:31:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.639+0000 7f5d56bce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d5009d6f0 0x7f5d501225d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.639+0000 7f5d56bce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d5009e000 0x7f5d50122b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.639+0000 7f5d56bce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d5009e410 0x7f5d50123050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.639+0000 7f5d56bce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d50125e10 con 0x7f5d5009e410 2023-09-30T22:31:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.639+0000 7f5d56bce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d501260f0 con 0x7f5d5009d6f0 2023-09-30T22:31:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.639+0000 7f5d56bce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500a1d00 con 0x7f5d5009e000 2023-09-30T22:31:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.639+0000 7f5d5496a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d5009d6f0 0x7f5d501225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.639+0000 7f5d5496a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d5009d6f0 0x7f5d501225d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60480/0 (socket says 172.21.15.59:60480) 2023-09-30T22:31:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.639+0000 7f5d5496a700 1 -- 172.21.15.59:0/2238983936 learned_addr learned my addr 172.21.15.59:0/2238983936 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.639+0000 7f5d5516b700 1 --2- 172.21.15.59:0/2238983936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d5009e410 0x7f5d50123050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.639+0000 7f5d4ffff700 1 --2- 172.21.15.59:0/2238983936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d5009e000 0x7f5d50122b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.640+0000 7f5d5496a700 1 -- 172.21.15.59:0/2238983936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d5009e000 msgr2=0x7f5d50122b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.640+0000 7f5d5496a700 1 --2- 172.21.15.59:0/2238983936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d5009e000 0x7f5d50122b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.640+0000 7f5d5496a700 1 -- 172.21.15.59:0/2238983936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d5009e410 msgr2=0x7f5d50123050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.640+0000 7f5d5496a700 1 --2- 172.21.15.59:0/2238983936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d5009e410 0x7f5d50123050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.640+0000 7f5d5496a700 1 -- 172.21.15.59:0/2238983936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d44009550 con 0x7f5d5009d6f0 2023-09-30T22:31:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.640+0000 7f5d5496a700 1 --2- 172.21.15.59:0/2238983936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d5009d6f0 0x7f5d501225d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5d44004000 tx=0x7f5d44004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.640+0000 7f5d4d7fa700 1 -- 172.21.15.59:0/2238983936 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44003c70 con 0x7f5d5009d6f0 2023-09-30T22:31:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.640+0000 7f5d4d7fa700 1 -- 172.21.15.59:0/2238983936 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d44003df0 con 0x7f5d5009d6f0 2023-09-30T22:31:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.640+0000 7f5d4d7fa700 1 -- 172.21.15.59:0/2238983936 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44011870 con 0x7f5d5009d6f0 2023-09-30T22:31:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.640+0000 7f5d56bce700 1 -- 172.21.15.59:0/2238983936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5009c710 con 0x7f5d5009d6f0 2023-09-30T22:31:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.640+0000 7f5d56bce700 1 -- 172.21.15.59:0/2238983936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d50125880 con 0x7f5d5009d6f0 2023-09-30T22:31:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.641+0000 7f5d4d7fa700 1 -- 172.21.15.59:0/2238983936 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d44021070 con 0x7f5d5009d6f0 2023-09-30T22:31:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.641+0000 7f5d4d7fa700 1 -- 172.21.15.59:0/2238983936 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5d44040dd0 con 0x7f5d5009d6f0 2023-09-30T22:31:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.642+0000 7f5d56bce700 1 -- 172.21.15.59:0/2238983936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d50125ab0 con 0x7f5d5009d6f0 2023-09-30T22:31:51.646 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:51.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.646+0000 7f5d4d7fa700 1 -- 172.21.15.59:0/2238983936 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d50125ab0 con 0x7f5d5009d6f0 2023-09-30T22:31:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.709+0000 7efe1dbaf700 1 Processor -- start 2023-09-30T22:31:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.709+0000 7efe1dbaf700 1 -- start start 2023-09-30T22:31:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.709+0000 7efe1dbaf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe1809d6f0 0x7efe1809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.709+0000 7efe1dbaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe1809e410 0x7efe18130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.709+0000 7efe1dbaf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1809f130 con 0x7efe1809e000 2023-09-30T22:31:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.710+0000 7efe1dbaf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1809f520 con 0x7efe1809d6f0 2023-09-30T22:31:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.710+0000 7efe1dbaf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe1809e930 con 0x7efe1809e410 2023-09-30T22:31:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.710+0000 7efe177fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe1809d6f0 0x7efe1809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.710+0000 7efe177fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe1809d6f0 0x7efe1809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49606/0 (socket says 172.21.15.59:49606) 2023-09-30T22:31:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.710+0000 7efe177fe700 1 -- 172.21.15.59:0/447607865 learned_addr learned my addr 172.21.15.59:0/447607865 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.710+0000 7efe17fff700 1 --2- 172.21.15.59:0/447607865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe1809e410 0x7efe18130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.710+0000 7efe17fff700 1 -- 172.21.15.59:0/447607865 >> v2:172.21.15.59:3300/0 conn(0x7efe1809d6f0 msgr2=0x7efe1809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:51.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.710+0000 7efe17fff700 1 --2- 172.21.15.59:0/447607865 >> v2:172.21.15.59:3300/0 conn(0x7efe1809d6f0 0x7efe1809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.710+0000 7efe17fff700 1 -- 172.21.15.59:0/447607865 >> v1:172.21.15.59:6789/0 conn(0x7efe1809e000 legacy=0x7efe18130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.710+0000 7efe17fff700 1 -- 172.21.15.59:0/447607865 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1809b2d0 con 0x7efe1809e410 2023-09-30T22:31:51.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.710+0000 7efe17fff700 1 --2- 172.21.15.59:0/447607865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe1809e410 0x7efe18130d70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efe1000f370 tx=0x7efe1000f680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e98b0a0fa86d92b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.711+0000 7efe167fc700 1 -- 172.21.15.59:0/447607865 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe10012070 con 0x7efe1809e410 2023-09-30T22:31:51.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.711+0000 7efe167fc700 1 -- 172.21.15.59:0/447607865 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1000fd70 con 0x7efe1809e410 2023-09-30T22:31:51.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.711+0000 7efe167fc700 1 -- 172.21.15.59:0/447607865 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1000fee0 con 0x7efe1809e410 2023-09-30T22:31:51.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.712+0000 7efe1dbaf700 1 -- 172.21.15.59:0/447607865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe1809e410 msgr2=0x7efe18130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.712+0000 7efe1dbaf700 1 --2- 172.21.15.59:0/447607865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe1809e410 0x7efe18130d70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efe1000f370 tx=0x7efe1000f680 comp rx=0 tx=0).stop 2023-09-30T22:31:51.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.712+0000 7efe1dbaf700 1 -- 172.21.15.59:0/447607865 shutdown_connections 2023-09-30T22:31:51.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.712+0000 7efe1dbaf700 1 --2- 172.21.15.59:0/447607865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe1809e410 0x7efe18130d70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.712+0000 7efe1dbaf700 1 --2- 172.21.15.59:0/447607865 >> v2:172.21.15.59:3300/0 conn(0x7efe1809d6f0 0x7efe1809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.712+0000 7efe1dbaf700 1 -- 172.21.15.59:0/447607865 >> 172.21.15.59:0/447607865 conn(0x7efe18066f50 msgr2=0x7efe1809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:51.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.712+0000 7efe1dbaf700 1 -- 172.21.15.59:0/447607865 shutdown_connections 2023-09-30T22:31:51.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.712+0000 7efe1dbaf700 1 -- 172.21.15.59:0/447607865 wait complete. 2023-09-30T22:31:51.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.713+0000 7efe1dbaf700 1 Processor -- start 2023-09-30T22:31:51.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.713+0000 7efe1dbaf700 1 -- start start 2023-09-30T22:31:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe1dbaf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe1809d6f0 0x7efe1811e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe1dbaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe1809e000 0x7efe1811e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe1dbaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe1809e410 0x7efe1811eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe1dbaf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1811f4f0 con 0x7efe1809d6f0 2023-09-30T22:31:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe1dbaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe18121af0 con 0x7efe1809e410 2023-09-30T22:31:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe1dbaf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe18120e30 con 0x7efe1809e000 2023-09-30T22:31:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe16ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe1809e000 0x7efe1811e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe177fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe1809d6f0 0x7efe1811e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe16ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe1809e000 0x7efe1811e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39128/0 (socket says 172.21.15.59:39128) 2023-09-30T22:31:51.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe16ffd700 1 -- 172.21.15.59:0/3257140005 learned_addr learned my addr 172.21.15.59:0/3257140005 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:51.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe17fff700 1 --2- 172.21.15.59:0/3257140005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe1809e410 0x7efe1811eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe17fff700 1 -- 172.21.15.59:0/3257140005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe1809e000 msgr2=0x7efe1811e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe17fff700 1 --2- 172.21.15.59:0/3257140005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe1809e000 0x7efe1811e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe17fff700 1 -- 172.21.15.59:0/3257140005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe1809d6f0 msgr2=0x7efe1811e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe17fff700 1 --2- 172.21.15.59:0/3257140005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe1809d6f0 0x7efe1811e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe17fff700 1 -- 172.21.15.59:0/3257140005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1000f050 con 0x7efe1809e410 2023-09-30T22:31:51.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe16ffd700 1 --2- 172.21.15.59:0/3257140005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe1809e000 0x7efe1811e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:51.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.714+0000 7efe177fe700 1 --2- 172.21.15.59:0/3257140005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe1809d6f0 0x7efe1811e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:51.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.715+0000 7efe17fff700 1 --2- 172.21.15.59:0/3257140005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe1809e410 0x7efe1811eaa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efe10018000 tx=0x7efe10004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.715+0000 7efdfffff700 1 -- 172.21.15.59:0/3257140005 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1000b940 con 0x7efe1809e410 2023-09-30T22:31:51.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.715+0000 7efdfffff700 1 -- 172.21.15.59:0/3257140005 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1000bae0 con 0x7efe1809e410 2023-09-30T22:31:51.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.715+0000 7efdfffff700 1 -- 172.21.15.59:0/3257140005 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1000be90 con 0x7efe1809e410 2023-09-30T22:31:51.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.715+0000 7efe1dbaf700 1 -- 172.21.15.59:0/3257140005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe181201c0 con 0x7efe1809e410 2023-09-30T22:31:51.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.715+0000 7efe1dbaf700 1 -- 172.21.15.59:0/3257140005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe180a1d00 con 0x7efe1809e410 2023-09-30T22:31:51.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.717+0000 7efdfffff700 1 -- 172.21.15.59:0/3257140005 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe10004030 con 0x7efe1809e410 2023-09-30T22:31:51.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.717+0000 7efe1dbaf700 1 -- 172.21.15.59:0/3257140005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe18130410 con 0x7efe1809e410 2023-09-30T22:31:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.717+0000 7efdfffff700 1 -- 172.21.15.59:0/3257140005 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efe100447e0 con 0x7efe1809e410 2023-09-30T22:31:51.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.726+0000 7efdfffff700 1 -- 172.21.15.59:0/3257140005 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe10016430 con 0x7efe1809e410 2023-09-30T22:31:51.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.778+0000 7f667a89e700 1 Processor -- start 2023-09-30T22:31:51.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.778+0000 7f667a89e700 1 -- start start 2023-09-30T22:31:51.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.779+0000 7f667a89e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66741338c0 0x7f6674133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.779+0000 7f667a89e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f667409e560 0x7f667413b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.779+0000 7f667a89e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667406f720 con 0x7f66741341d0 2023-09-30T22:31:51.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.779+0000 7f667a89e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6674070c80 con 0x7f667409e560 2023-09-30T22:31:51.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.779+0000 7f667a89e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f667406fce0 con 0x7f66741338c0 2023-09-30T22:31:51.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.779+0000 7f6678e3b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f667409e560 0x7f667413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.779+0000 7f6678e3b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f667409e560 0x7f667413b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49624/0 (socket says 172.21.15.59:49624) 2023-09-30T22:31:51.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.779+0000 7f6678e3b700 1 -- 172.21.15.59:0/3857462810 learned_addr learned my addr 172.21.15.59:0/3857462810 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:51.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.779+0000 7f6673fff700 1 --2- 172.21.15.59:0/3857462810 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66741338c0 0x7f6674133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.780+0000 7f6678e3b700 1 -- 172.21.15.59:0/3857462810 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66741338c0 msgr2=0x7f6674133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.780+0000 7f6678e3b700 1 --2- 172.21.15.59:0/3857462810 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66741338c0 0x7f6674133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.780+0000 7f6678e3b700 1 -- 172.21.15.59:0/3857462810 >> v1:172.21.15.59:6789/0 conn(0x7f66741341d0 legacy=0x7f667409de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.780+0000 7f6678e3b700 1 -- 172.21.15.59:0/3857462810 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66741336a0 con 0x7f667409e560 2023-09-30T22:31:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.780+0000 7f6678e3b700 1 --2- 172.21.15.59:0/3857462810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667409e560 0x7f667413b860 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f666c009e50 tx=0x7f666c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee32048072c6d51c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.781+0000 7f6672ffd700 1 -- 172.21.15.59:0/3857462810 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c00e070 con 0x7f667409e560 2023-09-30T22:31:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.781+0000 7f6672ffd700 1 -- 172.21.15.59:0/3857462810 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c003a20 con 0x7f667409e560 2023-09-30T22:31:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.781+0000 7f6672ffd700 1 -- 172.21.15.59:0/3857462810 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c003dd0 con 0x7f667409e560 2023-09-30T22:31:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.781+0000 7f667a89e700 1 -- 172.21.15.59:0/3857462810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667409e560 msgr2=0x7f667413b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.781+0000 7f667a89e700 1 --2- 172.21.15.59:0/3857462810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667409e560 0x7f667413b860 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f666c009e50 tx=0x7f666c00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.781+0000 7f667a89e700 1 -- 172.21.15.59:0/3857462810 shutdown_connections 2023-09-30T22:31:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.782+0000 7f667a89e700 1 --2- 172.21.15.59:0/3857462810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667409e560 0x7f667413b860 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.782+0000 7f667a89e700 1 --2- 172.21.15.59:0/3857462810 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66741338c0 0x7f6674133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.782+0000 7f667a89e700 1 -- 172.21.15.59:0/3857462810 >> 172.21.15.59:0/3857462810 conn(0x7f66740a2aa0 msgr2=0x7f66740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.782+0000 7f667a89e700 1 -- 172.21.15.59:0/3857462810 shutdown_connections 2023-09-30T22:31:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.782+0000 7f667a89e700 1 -- 172.21.15.59:0/3857462810 wait complete. 2023-09-30T22:31:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.783+0000 7f667a89e700 1 Processor -- start 2023-09-30T22:31:51.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.784+0000 7f667a89e700 1 -- start start 2023-09-30T22:31:51.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.784+0000 7f667a89e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f667409e560 0x7f667411e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.784+0000 7f667a89e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66741338c0 0x7f667411ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.784+0000 7f667a89e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66741341d0 0x7f667411f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.784+0000 7f667a89e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6674121450 con 0x7f66741338c0 2023-09-30T22:31:51.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.784+0000 7f667a89e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6674120a70 con 0x7f66741341d0 2023-09-30T22:31:51.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.784+0000 7f667a89e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66740a1310 con 0x7f667409e560 2023-09-30T22:31:51.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.784+0000 7f66737fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66741338c0 0x7f667411ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.784+0000 7f66737fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66741338c0 0x7f667411ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49634/0 (socket says 172.21.15.59:49634) 2023-09-30T22:31:51.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.784+0000 7f66737fe700 1 -- 172.21.15.59:0/774308870 learned_addr learned my addr 172.21.15.59:0/774308870 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:51.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.785+0000 7f6678e3b700 1 --2- 172.21.15.59:0/774308870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66741341d0 0x7f667411f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.785+0000 7f6673fff700 1 --2- 172.21.15.59:0/774308870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f667409e560 0x7f667411e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.785+0000 7f66737fe700 1 -- 172.21.15.59:0/774308870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f667409e560 msgr2=0x7f667411e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.785+0000 7f66737fe700 1 --2- 172.21.15.59:0/774308870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f667409e560 0x7f667411e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.785+0000 7f66737fe700 1 -- 172.21.15.59:0/774308870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66741341d0 msgr2=0x7f667411f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.785+0000 7f66737fe700 1 --2- 172.21.15.59:0/774308870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66741341d0 0x7f667411f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.785+0000 7f66737fe700 1 -- 172.21.15.59:0/774308870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c009b30 con 0x7f66741338c0 2023-09-30T22:31:51.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.785+0000 7f6678e3b700 1 --2- 172.21.15.59:0/774308870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66741341d0 0x7f667411f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:51.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.785+0000 7f66737fe700 1 --2- 172.21.15.59:0/774308870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66741338c0 0x7f667411ee70 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f666800c4a0 tx=0x7f666800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.785+0000 7f6670ff9700 1 -- 172.21.15.59:0/774308870 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668011790 con 0x7f66741338c0 2023-09-30T22:31:51.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.786+0000 7f6670ff9700 1 -- 172.21.15.59:0/774308870 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66680118f0 con 0x7f66741338c0 2023-09-30T22:31:51.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.786+0000 7f667a89e700 1 -- 172.21.15.59:0/774308870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667406f960 con 0x7f66741338c0 2023-09-30T22:31:51.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.786+0000 7f6670ff9700 1 -- 172.21.15.59:0/774308870 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668011ca0 con 0x7f66741338c0 2023-09-30T22:31:51.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.786+0000 7f667a89e700 1 -- 172.21.15.59:0/774308870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6674122be0 con 0x7f66741338c0 2023-09-30T22:31:51.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.787+0000 7f6670ff9700 1 -- 172.21.15.59:0/774308870 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f666801c460 con 0x7f66741338c0 2023-09-30T22:31:51.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.787+0000 7f6670ff9700 1 -- 172.21.15.59:0/774308870 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f666803f390 con 0x7f66741338c0 2023-09-30T22:31:51.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.787+0000 7f667a89e700 1 -- 172.21.15.59:0/774308870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6674074ea0 con 0x7f66741338c0 2023-09-30T22:31:51.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.792+0000 7f6670ff9700 1 -- 172.21.15.59:0/774308870 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66680108d0 con 0x7f66741338c0 2023-09-30T22:31:51.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.805+0000 7f019e628700 1 Processor -- start 2023-09-30T22:31:51.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.805+0000 7f019e628700 1 -- start start 2023-09-30T22:31:51.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f019e628700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019806a770 0x7f019809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f019e628700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f019809dc30 0x7f019809e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f019e628700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019813c1e0 0x7f019813e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f019e628700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019806ab40 con 0x7f019809dc30 2023-09-30T22:31:51.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f019e628700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019809ebc0 con 0x7f019813c1e0 2023-09-30T22:31:51.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f019e628700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f019809a810 con 0x7f019806a770 2023-09-30T22:31:51.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f01977fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f019809dc30 0x7f019809e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f01977fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f019809dc30 0x7f019809e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49642/0 (socket says 172.21.15.59:49642) 2023-09-30T22:31:51.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f01977fe700 1 -- 172.21.15.59:0/862665509 learned_addr learned my addr 172.21.15.59:0/862665509 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:51.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f0197fff700 1 --2- 172.21.15.59:0/862665509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019806a770 0x7f019809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f019cbc5700 1 --2- 172.21.15.59:0/862665509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019813c1e0 0x7f019813e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f01977fe700 1 -- 172.21.15.59:0/862665509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019806a770 msgr2=0x7f019809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:51.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f01977fe700 1 --2- 172.21.15.59:0/862665509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019806a770 0x7f019809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f01977fe700 1 -- 172.21.15.59:0/862665509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019813c1e0 msgr2=0x7f019813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:51.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f01977fe700 1 --2- 172.21.15.59:0/862665509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019813c1e0 0x7f019813e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.806+0000 7f01977fe700 1 -- 172.21.15.59:0/862665509 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019809e920 con 0x7f019809dc30 2023-09-30T22:31:51.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.807+0000 7f01977fe700 1 --2- 172.21.15.59:0/862665509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019809dc30 0x7f019809e080 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f018c009920 tx=0x7f018c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb222a6e139aa32e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.807+0000 7f0196ffd700 1 -- 172.21.15.59:0/862665509 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c011830 con 0x7f019809dc30 2023-09-30T22:31:51.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.807+0000 7f0196ffd700 1 -- 172.21.15.59:0/862665509 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c011990 con 0x7f019809dc30 2023-09-30T22:31:51.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.807+0000 7f0196ffd700 1 -- 172.21.15.59:0/862665509 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c011d20 con 0x7f019809dc30 2023-09-30T22:31:51.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.808+0000 7f019e628700 1 -- 172.21.15.59:0/862665509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019809dc30 msgr2=0x7f019809e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.808+0000 7f019e628700 1 --2- 172.21.15.59:0/862665509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019809dc30 0x7f019809e080 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f018c009920 tx=0x7f018c009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:51.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.808+0000 7f019e628700 1 -- 172.21.15.59:0/862665509 shutdown_connections 2023-09-30T22:31:51.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.808+0000 7f019e628700 1 --2- 172.21.15.59:0/862665509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019813c1e0 0x7f019813e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.808+0000 7f019e628700 1 --2- 172.21.15.59:0/862665509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019806a770 0x7f019809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.808+0000 7f019e628700 1 --2- 172.21.15.59:0/862665509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019809dc30 0x7f019809e080 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.808+0000 7f019e628700 1 -- 172.21.15.59:0/862665509 >> 172.21.15.59:0/862665509 conn(0x7f0198066f50 msgr2=0x7f019809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:51.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.808+0000 7f019e628700 1 -- 172.21.15.59:0/862665509 shutdown_connections 2023-09-30T22:31:51.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.808+0000 7f019e628700 1 -- 172.21.15.59:0/862665509 wait complete. 2023-09-30T22:31:51.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.809+0000 7f019e628700 1 Processor -- start 2023-09-30T22:31:51.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.809+0000 7f019e628700 1 -- start start 2023-09-30T22:31:51.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f019e628700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019806a770 0x7f01981cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f019e628700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019809dc30 0x7f01981cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f019e628700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019813c1e0 0x7f01981cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f019e628700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019809f1a0 con 0x7f019809dc30 2023-09-30T22:31:51.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f019e628700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0198128ef0 con 0x7f019813c1e0 2023-09-30T22:31:51.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f019e628700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0198129a50 con 0x7f019806a770 2023-09-30T22:31:51.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f019cbc5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019813c1e0 0x7f01981cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f019cbc5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019813c1e0 0x7f01981cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60498/0 (socket says 172.21.15.59:60498) 2023-09-30T22:31:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f019cbc5700 1 -- 172.21.15.59:0/780130758 learned_addr learned my addr 172.21.15.59:0/780130758 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f0197fff700 1 --2- 172.21.15.59:0/780130758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019806a770 0x7f01981cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f01977fe700 1 --2- 172.21.15.59:0/780130758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019809dc30 0x7f01981cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f0197fff700 1 -- 172.21.15.59:0/780130758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019813c1e0 msgr2=0x7f01981cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f0197fff700 1 --2- 172.21.15.59:0/780130758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019813c1e0 0x7f01981cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f0197fff700 1 -- 172.21.15.59:0/780130758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019809dc30 msgr2=0x7f01981cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f0197fff700 1 --2- 172.21.15.59:0/780130758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019809dc30 0x7f01981cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.810+0000 7f0197fff700 1 -- 172.21.15.59:0/780130758 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c009550 con 0x7f019806a770 2023-09-30T22:31:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.811+0000 7f0197fff700 1 --2- 172.21.15.59:0/780130758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019806a770 0x7f01981cc450 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f018800e900 tx=0x7f018800ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.811+0000 7f0194ff9700 1 -- 172.21.15.59:0/780130758 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018800ee50 con 0x7f019806a770 2023-09-30T22:31:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.811+0000 7f0194ff9700 1 -- 172.21.15.59:0/780130758 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018800c850 con 0x7f019806a770 2023-09-30T22:31:51.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.811+0000 7f019e628700 1 -- 172.21.15.59:0/780130758 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0198072400 con 0x7f019806a770 2023-09-30T22:31:51.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.811+0000 7f0194ff9700 1 -- 172.21.15.59:0/780130758 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018800cbc0 con 0x7f019806a770 2023-09-30T22:31:51.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.811+0000 7f019e628700 1 -- 172.21.15.59:0/780130758 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019813bc10 con 0x7f019806a770 2023-09-30T22:31:51.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.812+0000 7f0194ff9700 1 -- 172.21.15.59:0/780130758 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f018800cd20 con 0x7f019806a770 2023-09-30T22:31:51.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.812+0000 7f0194ff9700 1 -- 172.21.15.59:0/780130758 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f018803fb50 con 0x7f019806a770 2023-09-30T22:31:51.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.813+0000 7f019e628700 1 -- 172.21.15.59:0/780130758 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01780052e0 con 0x7f019806a770 2023-09-30T22:31:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.822+0000 7f0194ff9700 1 -- 172.21.15.59:0/780130758 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0188017080 con 0x7f019806a770 2023-09-30T22:31:51.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.875+0000 7f5d56bce700 1 -- 172.21.15.59:0/2238983936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5d50125ab0 con 0x7f5d5009d6f0 2023-09-30T22:31:51.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.876+0000 7f5d4d7fa700 1 -- 172.21.15.59:0/2238983936 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d50125ab0 con 0x7f5d5009d6f0 2023-09-30T22:31:51.876 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.878+0000 7f5d56bce700 1 -- 172.21.15.59:0/2238983936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d5009d6f0 msgr2=0x7f5d501225d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.878+0000 7f5d56bce700 1 --2- 172.21.15.59:0/2238983936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d5009d6f0 0x7f5d501225d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5d44004000 tx=0x7f5d44004750 comp rx=0 tx=0).stop 2023-09-30T22:31:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.878+0000 7f5d56bce700 1 -- 172.21.15.59:0/2238983936 shutdown_connections 2023-09-30T22:31:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.878+0000 7f5d56bce700 1 --2- 172.21.15.59:0/2238983936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d5009e410 0x7f5d50123050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.878+0000 7f5d56bce700 1 --2- 172.21.15.59:0/2238983936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d5009d6f0 0x7f5d501225d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.878+0000 7f5d56bce700 1 --2- 172.21.15.59:0/2238983936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d5009e000 0x7f5d50122b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.878+0000 7f5d56bce700 1 -- 172.21.15.59:0/2238983936 >> 172.21.15.59:0/2238983936 conn(0x7f5d50066f50 msgr2=0x7f5d500711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.878+0000 7f5d56bce700 1 -- 172.21.15.59:0/2238983936 shutdown_connections 2023-09-30T22:31:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.878+0000 7f5d56bce700 1 -- 172.21.15.59:0/2238983936 wait complete. 2023-09-30T22:31:51.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:51.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.940+0000 7efe1dbaf700 1 -- 172.21.15.59:0/3257140005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efe1809c700 con 0x7efe1809e410 2023-09-30T22:31:51.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.940+0000 7efdfffff700 1 -- 172.21.15.59:0/3257140005 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe1001f7d0 con 0x7efe1809e410 2023-09-30T22:31:51.941 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:51.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.944+0000 7efe1dbaf700 1 -- 172.21.15.59:0/3257140005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe1809e410 msgr2=0x7efe1811eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.944+0000 7efe1dbaf700 1 --2- 172.21.15.59:0/3257140005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe1809e410 0x7efe1811eaa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efe10018000 tx=0x7efe10004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.944+0000 7efe1dbaf700 1 -- 172.21.15.59:0/3257140005 shutdown_connections 2023-09-30T22:31:51.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.944+0000 7efe1dbaf700 1 --2- 172.21.15.59:0/3257140005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe1809e410 0x7efe1811eaa0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.944+0000 7efe1dbaf700 1 --2- 172.21.15.59:0/3257140005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe1809d6f0 0x7efe1811e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.944+0000 7efe1dbaf700 1 --2- 172.21.15.59:0/3257140005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe1809e000 0x7efe1811e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.944+0000 7efe1dbaf700 1 -- 172.21.15.59:0/3257140005 >> 172.21.15.59:0/3257140005 conn(0x7efe18066f50 msgr2=0x7efe18071050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.944+0000 7efe1dbaf700 1 -- 172.21.15.59:0/3257140005 shutdown_connections 2023-09-30T22:31:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:51.944+0000 7efe1dbaf700 1 -- 172.21.15.59:0/3257140005 wait complete. 2023-09-30T22:31:51.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:52.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.017+0000 7f667a89e700 1 -- 172.21.15.59:0/774308870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f667406b9e0 con 0x7f66741338c0 2023-09-30T22:31:52.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.017+0000 7f6670ff9700 1 -- 172.21.15.59:0/774308870 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f666801a360 con 0x7f66741338c0 2023-09-30T22:31:52.018 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.020+0000 7f667a89e700 1 -- 172.21.15.59:0/774308870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66741338c0 msgr2=0x7f667411ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.020+0000 7f667a89e700 1 --2- 172.21.15.59:0/774308870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66741338c0 0x7f667411ee70 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f666800c4a0 tx=0x7f666800c7b0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.020+0000 7f667a89e700 1 -- 172.21.15.59:0/774308870 shutdown_connections 2023-09-30T22:31:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.020+0000 7f667a89e700 1 --2- 172.21.15.59:0/774308870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f667409e560 0x7f667411e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.020+0000 7f667a89e700 1 --2- 172.21.15.59:0/774308870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66741341d0 0x7f667411f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.020+0000 7f667a89e700 1 --2- 172.21.15.59:0/774308870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66741338c0 0x7f667411ee70 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.020+0000 7f667a89e700 1 -- 172.21.15.59:0/774308870 >> 172.21.15.59:0/774308870 conn(0x7f66740a2aa0 msgr2=0x7f667409f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:52.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.020+0000 7f667a89e700 1 -- 172.21.15.59:0/774308870 shutdown_connections 2023-09-30T22:31:52.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.020+0000 7f667a89e700 1 -- 172.21.15.59:0/774308870 wait complete. 2023-09-30T22:31:52.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.032+0000 7f019e628700 1 -- 172.21.15.59:0/780130758 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0178005590 con 0x7f019806a770 2023-09-30T22:31:52.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.033+0000 7f0194ff9700 1 -- 172.21.15.59:0/780130758 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f018801a780 con 0x7f019806a770 2023-09-30T22:31:52.033 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:52.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:52.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.035+0000 7f019e628700 1 -- 172.21.15.59:0/780130758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019806a770 msgr2=0x7f01981cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.035+0000 7f019e628700 1 --2- 172.21.15.59:0/780130758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019806a770 0x7f01981cc450 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f018800e900 tx=0x7f018800ec10 comp rx=0 tx=0).stop 2023-09-30T22:31:52.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.035+0000 7f019e628700 1 -- 172.21.15.59:0/780130758 shutdown_connections 2023-09-30T22:31:52.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.035+0000 7f019e628700 1 --2- 172.21.15.59:0/780130758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019806a770 0x7f01981cc450 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.035+0000 7f019e628700 1 --2- 172.21.15.59:0/780130758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019813c1e0 0x7f01981cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.035+0000 7f019e628700 1 --2- 172.21.15.59:0/780130758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019809dc30 0x7f01981cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.035+0000 7f019e628700 1 -- 172.21.15.59:0/780130758 >> 172.21.15.59:0/780130758 conn(0x7f0198066f50 msgr2=0x7f01980a2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:52.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.035+0000 7f019e628700 1 -- 172.21.15.59:0/780130758 shutdown_connections 2023-09-30T22:31:52.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:52.035+0000 7f019e628700 1 -- 172.21.15.59:0/780130758 wait complete. 2023-09-30T22:31:52.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:52.895 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:52.964 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:53.035 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.044+0000 7f8e53d66700 1 Processor -- start 2023-09-30T22:31:53.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.044+0000 7f8e53d66700 1 -- start start 2023-09-30T22:31:53.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e53d66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c1338a0 0x7f8e4c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e53d66700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e4c09de50 0x7f8e4c09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e53d66700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09e760 0x7f8e4c13a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e53d66700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c06fef0 con 0x7f8e4c09de50 2023-09-30T22:31:53.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e53d66700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c06ef30 con 0x7f8e4c1338a0 2023-09-30T22:31:53.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e53d66700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c1334b0 con 0x7f8e4c09e760 2023-09-30T22:31:53.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e52303700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09e760 0x7f8e4c13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e51b02700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c1338a0 0x7f8e4c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e52303700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09e760 0x7f8e4c13a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39194/0 (socket says 172.21.15.59:39194) 2023-09-30T22:31:53.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e52303700 1 -- 172.21.15.59:0/2740641315 learned_addr learned my addr 172.21.15.59:0/2740641315 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:53.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e51301700 1 --2- 172.21.15.59:0/2740641315 >> v2:172.21.15.59:3300/0 conn(0x7f8e4c09de50 0x7f8e4c09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e52303700 1 -- 172.21.15.59:0/2740641315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c1338a0 msgr2=0x7f8e4c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:53.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e52303700 1 --2- 172.21.15.59:0/2740641315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c1338a0 0x7f8e4c133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e52303700 1 -- 172.21.15.59:0/2740641315 >> v2:172.21.15.59:3300/0 conn(0x7f8e4c09de50 msgr2=0x7f8e4c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:53.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e52303700 1 --2- 172.21.15.59:0/2740641315 >> v2:172.21.15.59:3300/0 conn(0x7f8e4c09de50 0x7f8e4c09e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e52303700 1 -- 172.21.15.59:0/2740641315 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c06fc30 con 0x7f8e4c09e760 2023-09-30T22:31:53.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e51301700 1 --2- 172.21.15.59:0/2740641315 >> v2:172.21.15.59:3300/0 conn(0x7f8e4c09de50 0x7f8e4c09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:53.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e51b02700 1 --2- 172.21.15.59:0/2740641315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c1338a0 0x7f8e4c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.045+0000 7f8e52303700 1 --2- 172.21.15.59:0/2740641315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09e760 0x7f8e4c13a730 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8e44009e50 tx=0x7f8e4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd2b4ca596c08d57 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.046+0000 7f8e50b00700 1 -- 172.21.15.59:0/2740641315 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4400e070 con 0x7f8e4c09e760 2023-09-30T22:31:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.046+0000 7f8e50b00700 1 -- 172.21.15.59:0/2740641315 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4400b910 con 0x7f8e4c09e760 2023-09-30T22:31:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.046+0000 7f8e50b00700 1 -- 172.21.15.59:0/2740641315 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4400bcc0 con 0x7f8e4c09e760 2023-09-30T22:31:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.047+0000 7f8e53d66700 1 -- 172.21.15.59:0/2740641315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09e760 msgr2=0x7f8e4c13a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.047+0000 7f8e53d66700 1 --2- 172.21.15.59:0/2740641315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09e760 0x7f8e4c13a730 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8e44009e50 tx=0x7f8e4400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.047+0000 7f8e53d66700 1 -- 172.21.15.59:0/2740641315 shutdown_connections 2023-09-30T22:31:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.047+0000 7f8e53d66700 1 --2- 172.21.15.59:0/2740641315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09e760 0x7f8e4c13a730 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.047+0000 7f8e53d66700 1 --2- 172.21.15.59:0/2740641315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c1338a0 0x7f8e4c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.047+0000 7f8e53d66700 1 --2- 172.21.15.59:0/2740641315 >> v2:172.21.15.59:3300/0 conn(0x7f8e4c09de50 0x7f8e4c09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.047+0000 7f8e53d66700 1 -- 172.21.15.59:0/2740641315 >> 172.21.15.59:0/2740641315 conn(0x7f8e4c0a2aa0 msgr2=0x7f8e4c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.047+0000 7f8e53d66700 1 -- 172.21.15.59:0/2740641315 shutdown_connections 2023-09-30T22:31:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.047+0000 7f8e53d66700 1 -- 172.21.15.59:0/2740641315 wait complete. 2023-09-30T22:31:53.049 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.048+0000 7f8e53d66700 1 Processor -- start 2023-09-30T22:31:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.048+0000 7f8e53d66700 1 -- start start 2023-09-30T22:31:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.049+0000 7f8e53d66700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09de50 0x7f8e4c099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.049+0000 7f8e53d66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e760 0x7f8e4c099f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.049+0000 7f8e53d66700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4c1338a0 0x7f8e4c09a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.049+0000 7f8e53d66700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c09c6e0 con 0x7f8e4c1338a0 2023-09-30T22:31:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.049+0000 7f8e53d66700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0a0f20 con 0x7f8e4c09e760 2023-09-30T22:31:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.049+0000 7f8e53d66700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c06f640 con 0x7f8e4c09de50 2023-09-30T22:31:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.049+0000 7f8e51301700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e760 0x7f8e4c099f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.049+0000 7f8e51301700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e760 0x7f8e4c099f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60526/0 (socket says 172.21.15.59:60526) 2023-09-30T22:31:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.049+0000 7f8e51301700 1 -- 172.21.15.59:0/709494048 learned_addr learned my addr 172.21.15.59:0/709494048 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.049+0000 7f8e52303700 1 --2- 172.21.15.59:0/709494048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4c1338a0 0x7f8e4c09a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.049+0000 7f8e51b02700 1 --2- 172.21.15.59:0/709494048 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09de50 0x7f8e4c099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.050+0000 7f8e51301700 1 -- 172.21.15.59:0/709494048 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09de50 msgr2=0x7f8e4c099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.050+0000 7f8e51301700 1 --2- 172.21.15.59:0/709494048 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09de50 0x7f8e4c099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.050+0000 7f8e51301700 1 -- 172.21.15.59:0/709494048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4c1338a0 msgr2=0x7f8e4c09a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.050+0000 7f8e51301700 1 --2- 172.21.15.59:0/709494048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4c1338a0 0x7f8e4c09a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.050+0000 7f8e51301700 1 -- 172.21.15.59:0/709494048 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c0094a0 con 0x7f8e4c09e760 2023-09-30T22:31:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.050+0000 7f8e52303700 1 --2- 172.21.15.59:0/709494048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4c1338a0 0x7f8e4c09a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.050+0000 7f8e51301700 1 --2- 172.21.15.59:0/709494048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e760 0x7f8e4c099f80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00ebb0 tx=0x7f8e3c00eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.050+0000 7f8e427fc700 1 -- 172.21.15.59:0/709494048 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00c850 con 0x7f8e4c09e760 2023-09-30T22:31:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.050+0000 7f8e427fc700 1 -- 172.21.15.59:0/709494048 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c00c9b0 con 0x7f8e4c09e760 2023-09-30T22:31:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.050+0000 7f8e53d66700 1 -- 172.21.15.59:0/709494048 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e480094a0 con 0x7f8e4c09e760 2023-09-30T22:31:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.050+0000 7f8e427fc700 1 -- 172.21.15.59:0/709494048 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00cd40 con 0x7f8e4c09e760 2023-09-30T22:31:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.050+0000 7f8e53d66700 1 -- 172.21.15.59:0/709494048 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e44009b30 con 0x7f8e4c09e760 2023-09-30T22:31:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.051+0000 7f8e427fc700 1 -- 172.21.15.59:0/709494048 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e3c013470 con 0x7f8e4c09e760 2023-09-30T22:31:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.052+0000 7f8e427fc700 1 -- 172.21.15.59:0/709494048 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e3c03fac0 con 0x7f8e4c09e760 2023-09-30T22:31:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.052+0000 7f8e53d66700 1 -- 172.21.15.59:0/709494048 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c09bc50 con 0x7f8e4c09e760 2023-09-30T22:31:53.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.059+0000 7f8e427fc700 1 -- 172.21.15.59:0/709494048 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e3c01b3b0 con 0x7f8e4c09e760 2023-09-30T22:31:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.114+0000 7f0384126700 1 Processor -- start 2023-09-30T22:31:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.114+0000 7f0384126700 1 -- start start 2023-09-30T22:31:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.115+0000 7f0384126700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f037c06e570 0x7f037c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.115+0000 7f0384126700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f037c09eca0 0x7f037c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.115+0000 7f0384126700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c070ee0 con 0x7f037c134610 2023-09-30T22:31:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.115+0000 7f0384126700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c071480 con 0x7f037c06e570 2023-09-30T22:31:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.115+0000 7f0384126700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f037c06f3c0 con 0x7f037c09eca0 2023-09-30T22:31:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.115+0000 7f0381ec2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f037c06e570 0x7f037c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.115+0000 7f0381ec2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f037c06e570 0x7f037c06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49690/0 (socket says 172.21.15.59:49690) 2023-09-30T22:31:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.115+0000 7f0381ec2700 1 -- 172.21.15.59:0/2800778946 learned_addr learned my addr 172.21.15.59:0/2800778946 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.115+0000 7f03816c1700 1 --2- 172.21.15.59:0/2800778946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f037c09eca0 0x7f037c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.115+0000 7f0381ec2700 1 -- 172.21.15.59:0/2800778946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f037c09eca0 msgr2=0x7f037c06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.115+0000 7f0381ec2700 1 --2- 172.21.15.59:0/2800778946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f037c09eca0 0x7f037c06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.115+0000 7f0381ec2700 1 -- 172.21.15.59:0/2800778946 >> v1:172.21.15.59:6789/0 conn(0x7f037c134610 legacy=0x7f037c134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.115+0000 7f0381ec2700 1 -- 172.21.15.59:0/2800778946 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c071b90 con 0x7f037c06e570 2023-09-30T22:31:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.116+0000 7f0381ec2700 1 --2- 172.21.15.59:0/2800778946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f037c06e570 0x7f037c06e940 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f03780098f0 tx=0x7f0378009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28ef33ac3cd4aff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.116+0000 7f0380ec0700 1 -- 172.21.15.59:0/2800778946 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0378011830 con 0x7f037c06e570 2023-09-30T22:31:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.116+0000 7f0380ec0700 1 -- 172.21.15.59:0/2800778946 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0378011990 con 0x7f037c06e570 2023-09-30T22:31:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.116+0000 7f0380ec0700 1 -- 172.21.15.59:0/2800778946 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0378011d20 con 0x7f037c06e570 2023-09-30T22:31:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.117+0000 7f0384126700 1 -- 172.21.15.59:0/2800778946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f037c06e570 msgr2=0x7f037c06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.117+0000 7f0384126700 1 --2- 172.21.15.59:0/2800778946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f037c06e570 0x7f037c06e940 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f03780098f0 tx=0x7f0378009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.117+0000 7f0384126700 1 -- 172.21.15.59:0/2800778946 shutdown_connections 2023-09-30T22:31:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.117+0000 7f0384126700 1 --2- 172.21.15.59:0/2800778946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f037c06e570 0x7f037c06e940 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.117+0000 7f0384126700 1 --2- 172.21.15.59:0/2800778946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f037c09eca0 0x7f037c06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.117+0000 7f0384126700 1 -- 172.21.15.59:0/2800778946 >> 172.21.15.59:0/2800778946 conn(0x7f037c0a2aa0 msgr2=0x7f037c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.117+0000 7f0384126700 1 -- 172.21.15.59:0/2800778946 shutdown_connections 2023-09-30T22:31:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.117+0000 7f0384126700 1 -- 172.21.15.59:0/2800778946 wait complete. 2023-09-30T22:31:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.118+0000 7f0384126700 1 Processor -- start 2023-09-30T22:31:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.118+0000 7f0384126700 1 -- start start 2023-09-30T22:31:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.118+0000 7f0384126700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f037c06e570 0x7f037c122530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.118+0000 7f0384126700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f037c134610 0x7f037c122a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.118+0000 7f0384126700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f037c122fb0 0x7f037c1cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.118+0000 7f0384126700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c123e70 con 0x7f037c06e570 2023-09-30T22:31:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.118+0000 7f0384126700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c124060 con 0x7f037c122fb0 2023-09-30T22:31:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.118+0000 7f0384126700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f037c070610 con 0x7f037c134610 2023-09-30T22:31:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.119+0000 7f0381ec2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f037c06e570 0x7f037c122530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.119+0000 7f0381ec2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f037c06e570 0x7f037c122530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49704/0 (socket says 172.21.15.59:49704) 2023-09-30T22:31:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.119+0000 7f0381ec2700 1 -- 172.21.15.59:0/2959629593 learned_addr learned my addr 172.21.15.59:0/2959629593 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.119+0000 7f03826c3700 1 --2- 172.21.15.59:0/2959629593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f037c122fb0 0x7f037c1cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.119+0000 7f03816c1700 1 --2- 172.21.15.59:0/2959629593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f037c134610 0x7f037c122a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.119+0000 7f0381ec2700 1 -- 172.21.15.59:0/2959629593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f037c134610 msgr2=0x7f037c122a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.119+0000 7f0381ec2700 1 --2- 172.21.15.59:0/2959629593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f037c134610 0x7f037c122a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.119+0000 7f0381ec2700 1 -- 172.21.15.59:0/2959629593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f037c122fb0 msgr2=0x7f037c1cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.119+0000 7f0381ec2700 1 --2- 172.21.15.59:0/2959629593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f037c122fb0 0x7f037c1cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.119+0000 7f0381ec2700 1 -- 172.21.15.59:0/2959629593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0378009550 con 0x7f037c06e570 2023-09-30T22:31:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.119+0000 7f0381ec2700 1 --2- 172.21.15.59:0/2959629593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f037c06e570 0x7f037c122530 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0378000c00 tx=0x7f0378004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.120+0000 7f03727fc700 1 -- 172.21.15.59:0/2959629593 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0378004400 con 0x7f037c06e570 2023-09-30T22:31:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.120+0000 7f03727fc700 1 -- 172.21.15.59:0/2959629593 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037801f070 con 0x7f037c06e570 2023-09-30T22:31:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.120+0000 7f03727fc700 1 -- 172.21.15.59:0/2959629593 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780038e0 con 0x7f037c06e570 2023-09-30T22:31:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.120+0000 7f0384126700 1 -- 172.21.15.59:0/2959629593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c125850 con 0x7f037c06e570 2023-09-30T22:31:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.120+0000 7f0384126700 1 -- 172.21.15.59:0/2959629593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c125b10 con 0x7f037c06e570 2023-09-30T22:31:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.121+0000 7f0384126700 1 -- 172.21.15.59:0/2959629593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037c0a1ba0 con 0x7f037c06e570 2023-09-30T22:31:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.121+0000 7f03727fc700 1 -- 172.21.15.59:0/2959629593 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0378021030 con 0x7f037c06e570 2023-09-30T22:31:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.122+0000 7f03727fc700 1 -- 172.21.15.59:0/2959629593 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f03780409f0 con 0x7f037c06e570 2023-09-30T22:31:53.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.130+0000 7f03727fc700 1 -- 172.21.15.59:0/2959629593 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0378042e60 con 0x7f037c06e570 2023-09-30T22:31:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.193+0000 7f00ac942700 1 Processor -- start 2023-09-30T22:31:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.193+0000 7f00ac942700 1 -- start start 2023-09-30T22:31:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.194+0000 7f00ac942700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f00a806b250 0x7f00a8136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.194+0000 7f00ac942700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8136d80 0x7f00a8139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.194+0000 7f00ac942700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a809ece0 con 0x7f00a806a770 2023-09-30T22:31:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.194+0000 7f00ac942700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a809e760 con 0x7f00a806b250 2023-09-30T22:31:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.194+0000 7f00ac942700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a809e040 con 0x7f00a8136d80 2023-09-30T22:31:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.195+0000 7f00a6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8136d80 0x7f00a8139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.195+0000 7f00a6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8136d80 0x7f00a8139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60548/0 (socket says 172.21.15.59:60548) 2023-09-30T22:31:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.195+0000 7f00a6d9d700 1 -- 172.21.15.59:0/346450226 learned_addr learned my addr 172.21.15.59:0/346450226 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:53.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.195+0000 7f00a6d9d700 1 -- 172.21.15.59:0/346450226 >> v2:172.21.15.59:3300/0 conn(0x7f00a806b250 msgr2=0x7f00a8136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.195+0000 7f00a6d9d700 1 --2- 172.21.15.59:0/346450226 >> v2:172.21.15.59:3300/0 conn(0x7f00a806b250 0x7f00a8136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.195+0000 7f00a6d9d700 1 -- 172.21.15.59:0/346450226 >> v1:172.21.15.59:6789/0 conn(0x7f00a806a770 legacy=0x7f00a806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.195+0000 7f00a6d9d700 1 -- 172.21.15.59:0/346450226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a809f630 con 0x7f00a8136d80 2023-09-30T22:31:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.195+0000 7f00a6d9d700 1 --2- 172.21.15.59:0/346450226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8136d80 0x7f00a8139160 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009e50 tx=0x7f00a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2df634bc462824c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.195+0000 7f00a559a700 1 -- 172.21.15.59:0/346450226 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a000e070 con 0x7f00a8136d80 2023-09-30T22:31:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.195+0000 7f00a559a700 1 -- 172.21.15.59:0/346450226 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a0003a20 con 0x7f00a8136d80 2023-09-30T22:31:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.195+0000 7f00a559a700 1 -- 172.21.15.59:0/346450226 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0003dd0 con 0x7f00a8136d80 2023-09-30T22:31:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.196+0000 7f00ac942700 1 -- 172.21.15.59:0/346450226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8136d80 msgr2=0x7f00a8139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.196+0000 7f00ac942700 1 --2- 172.21.15.59:0/346450226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8136d80 0x7f00a8139160 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009e50 tx=0x7f00a000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.196+0000 7f00ac942700 1 -- 172.21.15.59:0/346450226 shutdown_connections 2023-09-30T22:31:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.196+0000 7f00ac942700 1 --2- 172.21.15.59:0/346450226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8136d80 0x7f00a8139160 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.196+0000 7f00ac942700 1 --2- 172.21.15.59:0/346450226 >> v2:172.21.15.59:3300/0 conn(0x7f00a806b250 0x7f00a8136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.196+0000 7f00ac942700 1 -- 172.21.15.59:0/346450226 >> 172.21.15.59:0/346450226 conn(0x7f00a8066f50 msgr2=0x7f00a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.197+0000 7f00ac942700 1 -- 172.21.15.59:0/346450226 shutdown_connections 2023-09-30T22:31:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.197+0000 7f00ac942700 1 -- 172.21.15.59:0/346450226 wait complete. 2023-09-30T22:31:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.198+0000 7f00ac942700 1 Processor -- start 2023-09-30T22:31:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.198+0000 7f00ac942700 1 -- start start 2023-09-30T22:31:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.198+0000 7f00ac942700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00a806a770 0x7f00a811c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.198+0000 7f00ac942700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00a806b250 0x7f00a811c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.198+0000 7f00ac942700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8136d80 0x7f00a81c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.198+0000 7f00ac942700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a811bcb0 con 0x7f00a806a770 2023-09-30T22:31:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.198+0000 7f00ac942700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a811ebc0 con 0x7f00a8136d80 2023-09-30T22:31:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.198+0000 7f00ac942700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00a806ea00 con 0x7f00a806b250 2023-09-30T22:31:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.199+0000 7f00a5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00a806b250 0x7f00a811c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.199+0000 7f00a6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8136d80 0x7f00a81c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.199+0000 7f00a5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00a806b250 0x7f00a811c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39234/0 (socket says 172.21.15.59:39234) 2023-09-30T22:31:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.199+0000 7f00a6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8136d80 0x7f00a81c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60558/0 (socket says 172.21.15.59:60558) 2023-09-30T22:31:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.199+0000 7f00a5d9b700 1 -- 172.21.15.59:0/3457960332 learned_addr learned my addr 172.21.15.59:0/3457960332 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.199+0000 7f00a659c700 1 --2- 172.21.15.59:0/3457960332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00a806a770 0x7f00a811c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.199+0000 7f00a5d9b700 1 -- 172.21.15.59:0/3457960332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8136d80 msgr2=0x7f00a81c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.199+0000 7f00a5d9b700 1 --2- 172.21.15.59:0/3457960332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8136d80 0x7f00a81c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.199+0000 7f00a5d9b700 1 -- 172.21.15.59:0/3457960332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00a806a770 msgr2=0x7f00a811c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.199+0000 7f00a5d9b700 1 --2- 172.21.15.59:0/3457960332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00a806a770 0x7f00a811c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.199+0000 7f00a5d9b700 1 -- 172.21.15.59:0/3457960332 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a0009b30 con 0x7f00a806b250 2023-09-30T22:31:53.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.199+0000 7f00a5d9b700 1 --2- 172.21.15.59:0/3457960332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00a806b250 0x7f00a811c5d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f009c00f9e0 tx=0x7f009c00fcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:53.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.199+0000 7f0096ffd700 1 -- 172.21.15.59:0/3457960332 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c01a680 con 0x7f00a806b250 2023-09-30T22:31:53.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.200+0000 7f0096ffd700 1 -- 172.21.15.59:0/3457960332 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009c01a7e0 con 0x7f00a806b250 2023-09-30T22:31:53.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.200+0000 7f00ac942700 1 -- 172.21.15.59:0/3457960332 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a8071e60 con 0x7f00a806b250 2023-09-30T22:31:53.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.200+0000 7f0096ffd700 1 -- 172.21.15.59:0/3457960332 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c01ab70 con 0x7f00a806b250 2023-09-30T22:31:53.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.200+0000 7f00ac942700 1 -- 172.21.15.59:0/3457960332 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a811f160 con 0x7f00a806b250 2023-09-30T22:31:53.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.201+0000 7f0096ffd700 1 -- 172.21.15.59:0/3457960332 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f009c00b450 con 0x7f00a806b250 2023-09-30T22:31:53.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.201+0000 7f0096ffd700 1 -- 172.21.15.59:0/3457960332 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f009c015070 con 0x7f00a806b250 2023-09-30T22:31:53.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.201+0000 7f00ac942700 1 -- 172.21.15.59:0/3457960332 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a8074ea0 con 0x7f00a806b250 2023-09-30T22:31:53.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.206+0000 7fc6be417700 1 Processor -- start 2023-09-30T22:31:53.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.206+0000 7fc6be417700 1 -- start start 2023-09-30T22:31:53.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.206+0000 7f0096ffd700 1 -- 172.21.15.59:0/3457960332 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f009c0199d0 con 0x7f00a806b250 2023-09-30T22:31:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.207+0000 7fc6be417700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6b809d6f0 0x7fc6b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.207+0000 7fc6be417700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b809e000 0x7fc6b81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.207+0000 7fc6be417700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b809b120 con 0x7fc6b809e410 2023-09-30T22:31:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.207+0000 7fc6be417700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b806b460 con 0x7fc6b809d6f0 2023-09-30T22:31:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.207+0000 7fc6be417700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b809a7e0 con 0x7fc6b809e000 2023-09-30T22:31:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.207+0000 7fc6b7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6b809d6f0 0x7fc6b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.207+0000 7fc6b7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6b809d6f0 0x7fc6b809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49716/0 (socket says 172.21.15.59:49716) 2023-09-30T22:31:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.207+0000 7fc6b7fff700 1 -- 172.21.15.59:0/2881673361 learned_addr learned my addr 172.21.15.59:0/2881673361 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.207+0000 7fc6b7fff700 1 -- 172.21.15.59:0/2881673361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b809e000 msgr2=0x7fc6b81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.207+0000 7fc6b7fff700 1 --2- 172.21.15.59:0/2881673361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b809e000 0x7fc6b81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.207+0000 7fc6b7fff700 1 -- 172.21.15.59:0/2881673361 >> v1:172.21.15.59:6789/0 conn(0x7fc6b809e410 legacy=0x7fc6b8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.207+0000 7fc6b7fff700 1 -- 172.21.15.59:0/2881673361 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b809a500 con 0x7fc6b809d6f0 2023-09-30T22:31:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.207+0000 7fc6b7fff700 1 --2- 172.21.15.59:0/2881673361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b809d6f0 0x7fc6b809dac0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80098f0 tx=0x7fc6a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd173270a78788e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:53.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.208+0000 7fc6b6ffd700 1 -- 172.21.15.59:0/2881673361 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800b8a0 con 0x7fc6b809d6f0 2023-09-30T22:31:53.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.208+0000 7fc6b6ffd700 1 -- 172.21.15.59:0/2881673361 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a800ba00 con 0x7fc6b809d6f0 2023-09-30T22:31:53.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.208+0000 7fc6b6ffd700 1 -- 172.21.15.59:0/2881673361 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800bd90 con 0x7fc6b809d6f0 2023-09-30T22:31:53.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.209+0000 7fc6be417700 1 -- 172.21.15.59:0/2881673361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b809d6f0 msgr2=0x7fc6b809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.209+0000 7fc6be417700 1 --2- 172.21.15.59:0/2881673361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b809d6f0 0x7fc6b809dac0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80098f0 tx=0x7fc6a8009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:53.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.209+0000 7fc6be417700 1 -- 172.21.15.59:0/2881673361 shutdown_connections 2023-09-30T22:31:53.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.209+0000 7fc6be417700 1 --2- 172.21.15.59:0/2881673361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b809d6f0 0x7fc6b809dac0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.209+0000 7fc6be417700 1 --2- 172.21.15.59:0/2881673361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b809e000 0x7fc6b81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.209+0000 7fc6be417700 1 -- 172.21.15.59:0/2881673361 >> 172.21.15.59:0/2881673361 conn(0x7fc6b8066f50 msgr2=0x7fc6b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:53.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.212+0000 7fc6be417700 1 -- 172.21.15.59:0/2881673361 shutdown_connections 2023-09-30T22:31:53.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.212+0000 7fc6be417700 1 -- 172.21.15.59:0/2881673361 wait complete. 2023-09-30T22:31:53.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.213+0000 7fc6be417700 1 Processor -- start 2023-09-30T22:31:53.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.213+0000 7fc6be417700 1 -- start start 2023-09-30T22:31:53.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.214+0000 7fc6be417700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6b809d6f0 0x7fc6b81a6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.214+0000 7fc6be417700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b809e410 0x7fc6b81a65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.214+0000 7fc6be417700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b81a6b00 0x7fc6b81cea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.214+0000 7fc6be417700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b81a8a90 con 0x7fc6b81a6b00 2023-09-30T22:31:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.214+0000 7fc6be417700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b81b9490 con 0x7fc6b809d6f0 2023-09-30T22:31:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.214+0000 7fc6be417700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b81a9ba0 con 0x7fc6b809e410 2023-09-30T22:31:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.214+0000 7fc6b77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b809e410 0x7fc6b81a65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.214+0000 7fc6b77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b809e410 0x7fc6b81a65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39256/0 (socket says 172.21.15.59:39256) 2023-09-30T22:31:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.215+0000 7fc6b77fe700 1 -- 172.21.15.59:0/3958233445 learned_addr learned my addr 172.21.15.59:0/3958233445 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.215+0000 7fc6bc9b4700 1 --2- 172.21.15.59:0/3958233445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b81a6b00 0x7fc6b81cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.215+0000 7fc6bc9b4700 1 -- 172.21.15.59:0/3958233445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b809e410 msgr2=0x7fc6b81a65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.215+0000 7fc6bc9b4700 1 --2- 172.21.15.59:0/3958233445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b809e410 0x7fc6b81a65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.215+0000 7fc6bc9b4700 1 -- 172.21.15.59:0/3958233445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6b809d6f0 msgr2=0x7fc6b81a6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.215+0000 7fc6bc9b4700 1 --2- 172.21.15.59:0/3958233445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6b809d6f0 0x7fc6b81a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.215+0000 7fc6bc9b4700 1 -- 172.21.15.59:0/3958233445 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8009550 con 0x7fc6b81a6b00 2023-09-30T22:31:53.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.215+0000 7fc6bc9b4700 1 --2- 172.21.15.59:0/3958233445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b81a6b00 0x7fc6b81cea40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000cbc0 tx=0x7fc6b000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:53.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.216+0000 7fc6b4ff9700 1 -- 172.21.15.59:0/3958233445 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0003c00 con 0x7fc6b81a6b00 2023-09-30T22:31:53.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.216+0000 7fc6b4ff9700 1 -- 172.21.15.59:0/3958233445 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b0003d60 con 0x7fc6b81a6b00 2023-09-30T22:31:53.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.216+0000 7fc6be417700 1 -- 172.21.15.59:0/3958233445 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b81a8f50 con 0x7fc6b81a6b00 2023-09-30T22:31:53.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.216+0000 7fc6b4ff9700 1 -- 172.21.15.59:0/3958233445 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000aaa0 con 0x7fc6b81a6b00 2023-09-30T22:31:53.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.216+0000 7fc6be417700 1 -- 172.21.15.59:0/3958233445 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b809c710 con 0x7fc6b81a6b00 2023-09-30T22:31:53.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.217+0000 7fc6b4ff9700 1 -- 172.21.15.59:0/3958233445 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6b000ac00 con 0x7fc6b81a6b00 2023-09-30T22:31:53.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.217+0000 7fc6b4ff9700 1 -- 172.21.15.59:0/3958233445 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc6b003f730 con 0x7fc6b81a6b00 2023-09-30T22:31:53.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.217+0000 7fc6be417700 1 -- 172.21.15.59:0/3958233445 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b8074ea0 con 0x7fc6b81a6b00 2023-09-30T22:31:53.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.227+0000 7fc6b4ff9700 1 -- 172.21.15.59:0/3958233445 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6b00198f0 con 0x7fc6b81a6b00 2023-09-30T22:31:53.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.280+0000 7f8e53d66700 1 -- 172.21.15.59:0/709494048 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8e4c074ea0 con 0x7f8e4c09e760 2023-09-30T22:31:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.280+0000 7f8e427fc700 1 -- 172.21.15.59:0/709494048 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e3c017020 con 0x7f8e4c09e760 2023-09-30T22:31:53.281 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:53.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.283+0000 7f8e53d66700 1 -- 172.21.15.59:0/709494048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e760 msgr2=0x7f8e4c099f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.283+0000 7f8e53d66700 1 --2- 172.21.15.59:0/709494048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e760 0x7f8e4c099f80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00ebb0 tx=0x7f8e3c00eec0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.283+0000 7f8e53d66700 1 -- 172.21.15.59:0/709494048 shutdown_connections 2023-09-30T22:31:53.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.283+0000 7f8e53d66700 1 --2- 172.21.15.59:0/709494048 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e4c09de50 0x7f8e4c099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.283+0000 7f8e53d66700 1 --2- 172.21.15.59:0/709494048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4c1338a0 0x7f8e4c09a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.283+0000 7f8e53d66700 1 --2- 172.21.15.59:0/709494048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e4c09e760 0x7f8e4c099f80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.283+0000 7f8e53d66700 1 -- 172.21.15.59:0/709494048 >> 172.21.15.59:0/709494048 conn(0x7f8e4c0a2aa0 msgr2=0x7f8e4c130750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:53.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.283+0000 7f8e53d66700 1 -- 172.21.15.59:0/709494048 shutdown_connections 2023-09-30T22:31:53.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.283+0000 7f8e53d66700 1 -- 172.21.15.59:0/709494048 wait complete. 2023-09-30T22:31:53.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:53.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.373+0000 7f0384126700 1 -- 172.21.15.59:0/2959629593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f037c074ea0 con 0x7f037c06e570 2023-09-30T22:31:53.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.373+0000 7f03727fc700 1 -- 172.21.15.59:0/2959629593 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03780199a0 con 0x7f037c06e570 2023-09-30T22:31:53.373 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:53.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.375+0000 7f0384126700 1 -- 172.21.15.59:0/2959629593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f037c06e570 msgr2=0x7f037c122530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.375+0000 7f0384126700 1 --2- 172.21.15.59:0/2959629593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f037c06e570 0x7f037c122530 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0378000c00 tx=0x7f0378004750 comp rx=0 tx=0).stop 2023-09-30T22:31:53.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.375+0000 7f0384126700 1 -- 172.21.15.59:0/2959629593 shutdown_connections 2023-09-30T22:31:53.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.375+0000 7f0384126700 1 --2- 172.21.15.59:0/2959629593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f037c122fb0 0x7f037c1cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.375+0000 7f0384126700 1 --2- 172.21.15.59:0/2959629593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f037c06e570 0x7f037c122530 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.375+0000 7f0384126700 1 --2- 172.21.15.59:0/2959629593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f037c134610 0x7f037c122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.375+0000 7f0384126700 1 -- 172.21.15.59:0/2959629593 >> 172.21.15.59:0/2959629593 conn(0x7f037c0a2aa0 msgr2=0x7f037c0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:53.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.375+0000 7f0384126700 1 -- 172.21.15.59:0/2959629593 shutdown_connections 2023-09-30T22:31:53.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.375+0000 7f0384126700 1 -- 172.21.15.59:0/2959629593 wait complete. 2023-09-30T22:31:53.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.418+0000 7f00ac942700 1 -- 172.21.15.59:0/3457960332 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f00a811edc0 con 0x7f00a806b250 2023-09-30T22:31:53.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.419+0000 7f0096ffd700 1 -- 172.21.15.59:0/3457960332 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00a811edc0 con 0x7f00a806b250 2023-09-30T22:31:53.419 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.421+0000 7f00ac942700 1 -- 172.21.15.59:0/3457960332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00a806b250 msgr2=0x7f00a811c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.421+0000 7f00ac942700 1 --2- 172.21.15.59:0/3457960332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00a806b250 0x7f00a811c5d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f009c00f9e0 tx=0x7f009c00fcf0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.421+0000 7f00ac942700 1 -- 172.21.15.59:0/3457960332 shutdown_connections 2023-09-30T22:31:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.421+0000 7f00ac942700 1 --2- 172.21.15.59:0/3457960332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8136d80 0x7f00a81c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.421+0000 7f00ac942700 1 --2- 172.21.15.59:0/3457960332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00a806a770 0x7f00a811c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.421+0000 7f00ac942700 1 --2- 172.21.15.59:0/3457960332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00a806b250 0x7f00a811c5d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.421+0000 7f00ac942700 1 -- 172.21.15.59:0/3457960332 >> 172.21.15.59:0/3457960332 conn(0x7f00a8066f50 msgr2=0x7f00a806f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.421+0000 7f00ac942700 1 -- 172.21.15.59:0/3457960332 shutdown_connections 2023-09-30T22:31:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.422+0000 7f00ac942700 1 -- 172.21.15.59:0/3457960332 wait complete. 2023-09-30T22:31:53.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.436+0000 7fc6be417700 1 -- 172.21.15.59:0/3958233445 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc6b81a9980 con 0x7fc6b81a6b00 2023-09-30T22:31:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.436+0000 7fc6b4ff9700 1 -- 172.21.15.59:0/3958233445 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6b0019300 con 0x7fc6b81a6b00 2023-09-30T22:31:53.437 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:53.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.438+0000 7fc6be417700 1 -- 172.21.15.59:0/3958233445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b81a6b00 msgr2=0x7fc6b81cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.438+0000 7fc6be417700 1 --2- 172.21.15.59:0/3958233445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b81a6b00 0x7fc6b81cea40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000cbc0 tx=0x7fc6b000ced0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.439+0000 7fc6be417700 1 -- 172.21.15.59:0/3958233445 shutdown_connections 2023-09-30T22:31:53.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.439+0000 7fc6be417700 1 --2- 172.21.15.59:0/3958233445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b81a6b00 0x7fc6b81cea40 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.439+0000 7fc6be417700 1 --2- 172.21.15.59:0/3958233445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6b809d6f0 0x7fc6b81a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.439+0000 7fc6be417700 1 --2- 172.21.15.59:0/3958233445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b809e410 0x7fc6b81a65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.439+0000 7fc6be417700 1 -- 172.21.15.59:0/3958233445 >> 172.21.15.59:0/3958233445 conn(0x7fc6b8066f50 msgr2=0x7fc6b81bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:53.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.439+0000 7fc6be417700 1 -- 172.21.15.59:0/3958233445 shutdown_connections 2023-09-30T22:31:53.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:53.439+0000 7fc6be417700 1 -- 172.21.15.59:0/3958233445 wait complete. 2023-09-30T22:31:53.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:54.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:54.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:54.437 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:54.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.451+0000 7fb001af7700 1 Processor -- start 2023-09-30T22:31:54.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.451+0000 7fb001af7700 1 -- start start 2023-09-30T22:31:54.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.452+0000 7fb001af7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faffc1316c0 0x7faffc131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.452+0000 7fb001af7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faffc09d9f0 0x7faffc06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.452+0000 7fb001af7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faffc09e130 con 0x7faffc06acb0 2023-09-30T22:31:54.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.452+0000 7fb001af7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc1312b0 con 0x7faffc09d9f0 2023-09-30T22:31:54.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.452+0000 7fb001af7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faffc09f6e0 con 0x7faffc1316c0 2023-09-30T22:31:54.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.452+0000 7faffaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faffc09d9f0 0x7faffc06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.452+0000 7faffaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faffc09d9f0 0x7faffc06a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55004/0 (socket says 172.21.15.59:55004) 2023-09-30T22:31:54.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.452+0000 7faffbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faffc06acb0 0x7faffc138540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49786/0 (socket says 172.21.15.59:49786) 2023-09-30T22:31:54.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.452+0000 7faffaffd700 1 -- 172.21.15.59:0/2698047820 learned_addr learned my addr 172.21.15.59:0/2698047820 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:54.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.453+0000 7faffb7fe700 1 --2- 172.21.15.59:0/2698047820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faffc1316c0 0x7faffc131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.453+0000 7faffaffd700 1 -- 172.21.15.59:0/2698047820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faffc1316c0 msgr2=0x7faffc131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:54.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.453+0000 7faffaffd700 1 --2- 172.21.15.59:0/2698047820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faffc1316c0 0x7faffc131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.453+0000 7faffaffd700 1 -- 172.21.15.59:0/2698047820 >> v1:172.21.15.59:6789/0 conn(0x7faffc06acb0 legacy=0x7faffc138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.453+0000 7faffaffd700 1 -- 172.21.15.59:0/2698047820 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc09e760 con 0x7faffc09d9f0 2023-09-30T22:31:54.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.453+0000 7faffaffd700 1 --2- 172.21.15.59:0/2698047820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faffc09d9f0 0x7faffc06a770 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7faff00098f0 tx=0x7faff0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f91932afe9d0cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:54.454 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.453+0000 7faffa7fc700 1 -- 172.21.15.59:0/2698047820 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0011830 con 0x7faffc09d9f0 2023-09-30T22:31:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.453+0000 7faffa7fc700 1 -- 172.21.15.59:0/2698047820 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff0011990 con 0x7faffc09d9f0 2023-09-30T22:31:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.453+0000 7faffa7fc700 1 -- 172.21.15.59:0/2698047820 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0011d20 con 0x7faffc09d9f0 2023-09-30T22:31:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.454+0000 7fb001af7700 1 -- 172.21.15.59:0/2698047820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faffc09d9f0 msgr2=0x7faffc06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.454+0000 7fb001af7700 1 --2- 172.21.15.59:0/2698047820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faffc09d9f0 0x7faffc06a770 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7faff00098f0 tx=0x7faff0009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.454+0000 7fb001af7700 1 -- 172.21.15.59:0/2698047820 shutdown_connections 2023-09-30T22:31:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.454+0000 7fb001af7700 1 --2- 172.21.15.59:0/2698047820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faffc1316c0 0x7faffc131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.454+0000 7fb001af7700 1 --2- 172.21.15.59:0/2698047820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faffc09d9f0 0x7faffc06a770 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.454+0000 7fb001af7700 1 -- 172.21.15.59:0/2698047820 >> 172.21.15.59:0/2698047820 conn(0x7faffc066f50 msgr2=0x7faffc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.454+0000 7fb001af7700 1 -- 172.21.15.59:0/2698047820 shutdown_connections 2023-09-30T22:31:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.454+0000 7fb001af7700 1 -- 172.21.15.59:0/2698047820 wait complete. 2023-09-30T22:31:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.455+0000 7fb001af7700 1 Processor -- start 2023-09-30T22:31:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.455+0000 7fb001af7700 1 -- start start 2023-09-30T22:31:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.456+0000 7fb001af7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faffc06acb0 0x7faffc070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.456+0000 7fb001af7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faffc09d9f0 0x7faffc071090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.456+0000 7fb001af7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faffc1316c0 0x7faffc0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.456+0000 7fb001af7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc11b030 con 0x7faffc09d9f0 2023-09-30T22:31:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.456+0000 7fb001af7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc071fb0 con 0x7faffc06acb0 2023-09-30T22:31:54.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.456+0000 7fb001af7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faffc119980 con 0x7faffc1316c0 2023-09-30T22:31:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.456+0000 7faffaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faffc09d9f0 0x7faffc071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.456+0000 7faffaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faffc09d9f0 0x7faffc071090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55006/0 (socket says 172.21.15.59:55006) 2023-09-30T22:31:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.456+0000 7faffbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faffc1316c0 0x7faffc0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.456+0000 7faffaffd700 1 -- 172.21.15.59:0/3758595685 learned_addr learned my addr 172.21.15.59:0/3758595685 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.456+0000 7faffb7fe700 1 --2- 172.21.15.59:0/3758595685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faffc06acb0 0x7faffc070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.457+0000 7faffaffd700 1 -- 172.21.15.59:0/3758595685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faffc1316c0 msgr2=0x7faffc0715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.457+0000 7faffaffd700 1 --2- 172.21.15.59:0/3758595685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faffc1316c0 0x7faffc0715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.457+0000 7faffaffd700 1 -- 172.21.15.59:0/3758595685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faffc06acb0 msgr2=0x7faffc070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.457+0000 7faffaffd700 1 --2- 172.21.15.59:0/3758595685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faffc06acb0 0x7faffc070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.457+0000 7faffaffd700 1 -- 172.21.15.59:0/3758595685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff0009550 con 0x7faffc09d9f0 2023-09-30T22:31:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.457+0000 7faffaffd700 1 --2- 172.21.15.59:0/3758595685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faffc09d9f0 0x7faffc071090 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7faff0009c40 tx=0x7faff0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.457+0000 7fafe3fff700 1 -- 172.21.15.59:0/3758595685 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0004480 con 0x7faffc09d9f0 2023-09-30T22:31:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.457+0000 7fafe3fff700 1 -- 172.21.15.59:0/3758595685 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff001f070 con 0x7faffc09d9f0 2023-09-30T22:31:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.457+0000 7fafe3fff700 1 -- 172.21.15.59:0/3758595685 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff00038c0 con 0x7faffc09d9f0 2023-09-30T22:31:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.457+0000 7fb001af7700 1 -- 172.21.15.59:0/3758595685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faffc0726d0 con 0x7faffc09d9f0 2023-09-30T22:31:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.457+0000 7fb001af7700 1 -- 172.21.15.59:0/3758595685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faffc11a6f0 con 0x7faffc09d9f0 2023-09-30T22:31:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.458+0000 7fafe3fff700 1 -- 172.21.15.59:0/3758595685 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faff0021030 con 0x7faffc09d9f0 2023-09-30T22:31:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.458+0000 7fb001af7700 1 -- 172.21.15.59:0/3758595685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faffc074ea0 con 0x7faffc09d9f0 2023-09-30T22:31:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.459+0000 7fafe3fff700 1 -- 172.21.15.59:0/3758595685 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faff00409c0 con 0x7faffc09d9f0 2023-09-30T22:31:54.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.465+0000 7fafe3fff700 1 -- 172.21.15.59:0/3758595685 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faff0019770 con 0x7faffc09d9f0 2023-09-30T22:31:54.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.538+0000 7fac5d98e700 1 Processor -- start 2023-09-30T22:31:54.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.538+0000 7fac5d98e700 1 -- start start 2023-09-30T22:31:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.538+0000 7fac5d98e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5809d6d0 0x7fac5809daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.538+0000 7fac5d98e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5809dfe0 0x7fac58130600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.538+0000 7fac5d98e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac58130b40 0x7fac58130fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac5d98e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5809a920 con 0x7fac58130b40 2023-09-30T22:31:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac5d98e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5809b940 con 0x7fac5809dfe0 2023-09-30T22:31:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac5d98e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac5809ab10 con 0x7fac5809d6d0 2023-09-30T22:31:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac567fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5809dfe0 0x7fac58130600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac56ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5809d6d0 0x7fac5809daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac56ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5809d6d0 0x7fac5809daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55796/0 (socket says 172.21.15.59:55796) 2023-09-30T22:31:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac567fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5809dfe0 0x7fac58130600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49248/0 (socket says 172.21.15.59:49248) 2023-09-30T22:31:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac56ffd700 1 -- 172.21.15.59:0/4260335916 learned_addr learned my addr 172.21.15.59:0/4260335916 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac577fe700 1 --2- 172.21.15.59:0/4260335916 >> v2:172.21.15.59:3300/0 conn(0x7fac58130b40 0x7fac58130fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac567fc700 1 -- 172.21.15.59:0/4260335916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5809d6d0 msgr2=0x7fac5809daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac567fc700 1 --2- 172.21.15.59:0/4260335916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5809d6d0 0x7fac5809daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac567fc700 1 -- 172.21.15.59:0/4260335916 >> v2:172.21.15.59:3300/0 conn(0x7fac58130b40 msgr2=0x7fac58130fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac567fc700 1 --2- 172.21.15.59:0/4260335916 >> v2:172.21.15.59:3300/0 conn(0x7fac58130b40 0x7fac58130fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac567fc700 1 -- 172.21.15.59:0/4260335916 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5809c520 con 0x7fac5809dfe0 2023-09-30T22:31:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac577fe700 1 --2- 172.21.15.59:0/4260335916 >> v2:172.21.15.59:3300/0 conn(0x7fac58130b40 0x7fac58130fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.539+0000 7fac567fc700 1 --2- 172.21.15.59:0/4260335916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5809dfe0 0x7fac58130600 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009870 tx=0x7fac4c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a44a81821dd1ab4a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.540+0000 7fac55ffb700 1 -- 172.21.15.59:0/4260335916 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c011830 con 0x7fac5809dfe0 2023-09-30T22:31:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.540+0000 7fac55ffb700 1 -- 172.21.15.59:0/4260335916 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c011990 con 0x7fac5809dfe0 2023-09-30T22:31:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.540+0000 7fac55ffb700 1 -- 172.21.15.59:0/4260335916 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c011d20 con 0x7fac5809dfe0 2023-09-30T22:31:54.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.541+0000 7fac5d98e700 1 -- 172.21.15.59:0/4260335916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5809dfe0 msgr2=0x7fac58130600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.541+0000 7fac5d98e700 1 --2- 172.21.15.59:0/4260335916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5809dfe0 0x7fac58130600 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009870 tx=0x7fac4c009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:54.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.541+0000 7fac5d98e700 1 -- 172.21.15.59:0/4260335916 shutdown_connections 2023-09-30T22:31:54.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.541+0000 7fac5d98e700 1 --2- 172.21.15.59:0/4260335916 >> v2:172.21.15.59:3300/0 conn(0x7fac58130b40 0x7fac58130fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.541+0000 7fac5d98e700 1 --2- 172.21.15.59:0/4260335916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5809d6d0 0x7fac5809daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.541+0000 7fac5d98e700 1 --2- 172.21.15.59:0/4260335916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5809dfe0 0x7fac58130600 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.541+0000 7fac5d98e700 1 -- 172.21.15.59:0/4260335916 >> 172.21.15.59:0/4260335916 conn(0x7fac58099c20 msgr2=0x7fac580a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:54.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.541+0000 7fac5d98e700 1 -- 172.21.15.59:0/4260335916 shutdown_connections 2023-09-30T22:31:54.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.541+0000 7fac5d98e700 1 -- 172.21.15.59:0/4260335916 wait complete. 2023-09-30T22:31:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.542+0000 7fac5d98e700 1 Processor -- start 2023-09-30T22:31:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.542+0000 7fac5d98e700 1 -- start start 2023-09-30T22:31:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.543+0000 7fac5d98e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5809d6d0 0x7fac58136b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.543+0000 7fac5d98e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5809dfe0 0x7fac581370b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.543+0000 7fac5d98e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac58130b40 0x7fac581c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.543+0000 7fac5d98e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac58138110 con 0x7fac5809dfe0 2023-09-30T22:31:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.543+0000 7fac5d98e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac58137f20 con 0x7fac5809d6d0 2023-09-30T22:31:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.543+0000 7fac5d98e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac581387f0 con 0x7fac58130b40 2023-09-30T22:31:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.543+0000 7fac567fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5809dfe0 0x7fac581370b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.543+0000 7fac567fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5809dfe0 0x7fac581370b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55036/0 (socket says 172.21.15.59:55036) 2023-09-30T22:31:54.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.543+0000 7fac567fc700 1 -- 172.21.15.59:0/3325326484 learned_addr learned my addr 172.21.15.59:0/3325326484 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:54.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.543+0000 7fac56ffd700 1 --2- 172.21.15.59:0/3325326484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5809d6d0 0x7fac58136b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.544+0000 7fac577fe700 1 --2- 172.21.15.59:0/3325326484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac58130b40 0x7fac581c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.544+0000 7fac567fc700 1 -- 172.21.15.59:0/3325326484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac58130b40 msgr2=0x7fac581c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.544+0000 7fac567fc700 1 --2- 172.21.15.59:0/3325326484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac58130b40 0x7fac581c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.544+0000 7fac567fc700 1 -- 172.21.15.59:0/3325326484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5809d6d0 msgr2=0x7fac58136b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.544+0000 7fac567fc700 1 --2- 172.21.15.59:0/3325326484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5809d6d0 0x7fac58136b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.544+0000 7fac567fc700 1 -- 172.21.15.59:0/3325326484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac50009a70 con 0x7fac5809dfe0 2023-09-30T22:31:54.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.544+0000 7fac56ffd700 1 --2- 172.21.15.59:0/3325326484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5809d6d0 0x7fac58136b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:54.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.544+0000 7fac567fc700 1 --2- 172.21.15.59:0/3325326484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5809dfe0 0x7fac581370b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fac4c014040 tx=0x7fac4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:54.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.544+0000 7fac3ffff700 1 -- 172.21.15.59:0/3325326484 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c004450 con 0x7fac5809dfe0 2023-09-30T22:31:54.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.544+0000 7fac3ffff700 1 -- 172.21.15.59:0/3325326484 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c01e070 con 0x7fac5809dfe0 2023-09-30T22:31:54.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.544+0000 7fac3ffff700 1 -- 172.21.15.59:0/3325326484 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c0038c0 con 0x7fac5809dfe0 2023-09-30T22:31:54.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.544+0000 7fac5d98e700 1 -- 172.21.15.59:0/3325326484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4c0094a0 con 0x7fac5809dfe0 2023-09-30T22:31:54.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.545+0000 7fac5d98e700 1 -- 172.21.15.59:0/3325326484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac58119780 con 0x7fac5809dfe0 2023-09-30T22:31:54.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.546+0000 7fac5d98e700 1 -- 172.21.15.59:0/3325326484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac58119420 con 0x7fac5809dfe0 2023-09-30T22:31:54.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.546+0000 7fac3ffff700 1 -- 172.21.15.59:0/3325326484 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac4c003a20 con 0x7fac5809dfe0 2023-09-30T22:31:54.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.546+0000 7fac3ffff700 1 -- 172.21.15.59:0/3325326484 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fac4c0402e0 con 0x7fac5809dfe0 2023-09-30T22:31:54.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.556+0000 7fac3ffff700 1 -- 172.21.15.59:0/3325326484 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac58119420 con 0x7fac5809dfe0 2023-09-30T22:31:54.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.587+0000 7fc1c8cfd700 1 Processor -- start 2023-09-30T22:31:54.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.587+0000 7fc1c8cfd700 1 -- start start 2023-09-30T22:31:54.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.588+0000 7fc1c8cfd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1c409eca0 0x7fc1c413cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.588+0000 7fc1c8cfd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1c406f050 0x7fc1c413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.588+0000 7fc1c8cfd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c4070ee0 con 0x7fc1c406e570 2023-09-30T22:31:54.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.588+0000 7fc1c8cfd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c4071980 con 0x7fc1c406f050 2023-09-30T22:31:54.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.588+0000 7fc1c8cfd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c4071480 con 0x7fc1c409eca0 2023-09-30T22:31:54.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.588+0000 7fc1c2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1c406f050 0x7fc1c413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.588+0000 7fc1c2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1c406f050 0x7fc1c413f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49266/0 (socket says 172.21.15.59:49266) 2023-09-30T22:31:54.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.588+0000 7fc1c2d9d700 1 -- 172.21.15.59:0/1062909657 learned_addr learned my addr 172.21.15.59:0/1062909657 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:54.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.588+0000 7fc1c1d9b700 1 --2- 172.21.15.59:0/1062909657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1c409eca0 0x7fc1c413cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.588+0000 7fc1c159a700 1 -- 172.21.15.59:0/1062909657 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199549018 0 0) 0x7fc1c4070ee0 con 0x7fc1c406e570 2023-09-30T22:31:54.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.588+0000 7fc1c159a700 1 -- 172.21.15.59:0/1062909657 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1ac0035b0 con 0x7fc1c406e570 2023-09-30T22:31:54.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.588+0000 7fc1c2d9d700 1 -- 172.21.15.59:0/1062909657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1c409eca0 msgr2=0x7fc1c413cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:54.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.589+0000 7fc1c2d9d700 1 --2- 172.21.15.59:0/1062909657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1c409eca0 0x7fc1c413cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.589+0000 7fc1c2d9d700 1 -- 172.21.15.59:0/1062909657 >> v1:172.21.15.59:6789/0 conn(0x7fc1c406e570 legacy=0x7fc1c406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.589+0000 7fc1c2d9d700 1 -- 172.21.15.59:0/1062909657 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c4071b90 con 0x7fc1c406f050 2023-09-30T22:31:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.589+0000 7fc1c1d9b700 1 --2- 172.21.15.59:0/1062909657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1c409eca0 0x7fc1c413cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.589+0000 7fc1c2d9d700 1 --2- 172.21.15.59:0/1062909657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1c406f050 0x7fc1c413f3f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009e80 tx=0x7fc1bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24caf90d801e8f71 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.589+0000 7fc1c159a700 1 -- 172.21.15.59:0/1062909657 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc00e070 con 0x7fc1c406f050 2023-09-30T22:31:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.589+0000 7fc1c159a700 1 -- 172.21.15.59:0/1062909657 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc00b910 con 0x7fc1c406f050 2023-09-30T22:31:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.589+0000 7fc1c159a700 1 -- 172.21.15.59:0/1062909657 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc00bcc0 con 0x7fc1c406f050 2023-09-30T22:31:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.590+0000 7fc1c8cfd700 1 -- 172.21.15.59:0/1062909657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1c406f050 msgr2=0x7fc1c413f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.590+0000 7fc1c8cfd700 1 --2- 172.21.15.59:0/1062909657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1c406f050 0x7fc1c413f3f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009e80 tx=0x7fc1bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.590+0000 7fc1c8cfd700 1 -- 172.21.15.59:0/1062909657 shutdown_connections 2023-09-30T22:31:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.590+0000 7fc1c8cfd700 1 --2- 172.21.15.59:0/1062909657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1c406f050 0x7fc1c413f3f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.590+0000 7fc1c8cfd700 1 --2- 172.21.15.59:0/1062909657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1c409eca0 0x7fc1c413cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.590+0000 7fc1c8cfd700 1 -- 172.21.15.59:0/1062909657 >> 172.21.15.59:0/1062909657 conn(0x7fc1c40a2aa0 msgr2=0x7fc1c40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:54.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.590+0000 7fc1c8cfd700 1 -- 172.21.15.59:0/1062909657 shutdown_connections 2023-09-30T22:31:54.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.590+0000 7fc1c8cfd700 1 -- 172.21.15.59:0/1062909657 wait complete. 2023-09-30T22:31:54.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.591+0000 7fc1c8cfd700 1 Processor -- start 2023-09-30T22:31:54.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.591+0000 7fc1c8cfd700 1 -- start start 2023-09-30T22:31:54.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c8cfd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1c406e570 0x7fc1c4130500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c8cfd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1c406f050 0x7fc1c4130a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c8cfd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c413a2e0 0x7fc1c4130f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c8cfd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c4139c00 con 0x7fc1c413a2e0 2023-09-30T22:31:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c8cfd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c4137770 con 0x7fc1c406f050 2023-09-30T22:31:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c8cfd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c4139de0 con 0x7fc1c406e570 2023-09-30T22:31:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1c406f050 0x7fc1c4130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c413a2e0 0x7fc1c4130f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1c406f050 0x7fc1c4130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49274/0 (socket says 172.21.15.59:49274) 2023-09-30T22:31:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c1d9b700 1 -- 172.21.15.59:0/184881031 learned_addr learned my addr 172.21.15.59:0/184881031 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c413a2e0 0x7fc1c4130f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55046/0 (socket says 172.21.15.59:55046) 2023-09-30T22:31:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c259c700 1 --2- 172.21.15.59:0/184881031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1c406e570 0x7fc1c4130500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c1d9b700 1 -- 172.21.15.59:0/184881031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1c406e570 msgr2=0x7fc1c4130500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c1d9b700 1 --2- 172.21.15.59:0/184881031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1c406e570 0x7fc1c4130500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c1d9b700 1 -- 172.21.15.59:0/184881031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c413a2e0 msgr2=0x7fc1c4130f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c1d9b700 1 --2- 172.21.15.59:0/184881031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c413a2e0 0x7fc1c4130f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c1d9b700 1 -- 172.21.15.59:0/184881031 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b80094a0 con 0x7fc1c406f050 2023-09-30T22:31:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.592+0000 7fc1c259c700 1 --2- 172.21.15.59:0/184881031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1c406e570 0x7fc1c4130500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.593+0000 7fc1c1d9b700 1 --2- 172.21.15.59:0/184881031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1c406f050 0x7fc1c4130a40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800ec10 tx=0x7fc1b800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.593+0000 7fc1b2ffd700 1 -- 172.21.15.59:0/184881031 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b800c910 con 0x7fc1c406f050 2023-09-30T22:31:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.593+0000 7fc1b2ffd700 1 -- 172.21.15.59:0/184881031 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b800ca70 con 0x7fc1c406f050 2023-09-30T22:31:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.593+0000 7fc1b2ffd700 1 -- 172.21.15.59:0/184881031 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b800cde0 con 0x7fc1c406f050 2023-09-30T22:31:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.594+0000 7fc1c8cfd700 1 -- 172.21.15.59:0/184881031 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1bc009b30 con 0x7fc1c406f050 2023-09-30T22:31:54.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.594+0000 7fc1c8cfd700 1 -- 172.21.15.59:0/184881031 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c4139840 con 0x7fc1c406f050 2023-09-30T22:31:54.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.595+0000 7fc1b2ffd700 1 -- 172.21.15.59:0/184881031 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1b8013470 con 0x7fc1c406f050 2023-09-30T22:31:54.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.595+0000 7fc1c8cfd700 1 -- 172.21.15.59:0/184881031 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c4131c60 con 0x7fc1c406f050 2023-09-30T22:31:54.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.595+0000 7fc1b2ffd700 1 -- 172.21.15.59:0/184881031 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc1b803f8d0 con 0x7fc1c406f050 2023-09-30T22:31:54.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.600+0000 7fc1b2ffd700 1 -- 172.21.15.59:0/184881031 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1b80232f0 con 0x7fc1c406f050 2023-09-30T22:31:54.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.607+0000 7f83a6ea3700 1 Processor -- start 2023-09-30T22:31:54.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.607+0000 7f83a6ea3700 1 -- start start 2023-09-30T22:31:54.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.607+0000 7f83a6ea3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83a0133a80 0x7f83a0133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.607+0000 7f83a6ea3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83a012ff20 0x7f83a0130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.607+0000 7f83a6ea3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83a0130870 0x7f83a013a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.607+0000 7f83a6ea3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a006c570 con 0x7f83a0130870 2023-09-30T22:31:54.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.607+0000 7f83a6ea3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a006bc00 con 0x7f83a0133a80 2023-09-30T22:31:54.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.607+0000 7f83a6ea3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00a0040 con 0x7f83a012ff20 2023-09-30T22:31:54.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.607+0000 7f83a5440700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83a0130870 0x7f83a013a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.608+0000 7f83a5440700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83a0130870 0x7f83a013a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55058/0 (socket says 172.21.15.59:55058) 2023-09-30T22:31:54.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.608+0000 7f83a5440700 1 -- 172.21.15.59:0/1869337084 learned_addr learned my addr 172.21.15.59:0/1869337084 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:54.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.608+0000 7f83a4c3f700 1 --2- 172.21.15.59:0/1869337084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83a0133a80 0x7f83a0133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.608+0000 7f83a5440700 1 -- 172.21.15.59:0/1869337084 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83a012ff20 msgr2=0x7f83a0130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:54.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.608+0000 7f83a5440700 1 --2- 172.21.15.59:0/1869337084 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83a012ff20 0x7f83a0130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.608+0000 7f83a5440700 1 -- 172.21.15.59:0/1869337084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83a0133a80 msgr2=0x7f83a0133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:54.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.608+0000 7f83a5440700 1 --2- 172.21.15.59:0/1869337084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83a0133a80 0x7f83a0133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.608+0000 7f83a5440700 1 -- 172.21.15.59:0/1869337084 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a0133860 con 0x7f83a0130870 2023-09-30T22:31:54.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.608+0000 7f83a4c3f700 1 --2- 172.21.15.59:0/1869337084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83a0133a80 0x7f83a0133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:54.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.608+0000 7f83a5440700 1 --2- 172.21.15.59:0/1869337084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83a0130870 0x7f83a013a840 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8398009e50 tx=0x7f839800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23232456a3c16bd8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:54.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.608+0000 7f839f7fe700 1 -- 172.21.15.59:0/1869337084 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839800e070 con 0x7f83a0130870 2023-09-30T22:31:54.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.608+0000 7f839f7fe700 1 -- 172.21.15.59:0/1869337084 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839800b910 con 0x7f83a0130870 2023-09-30T22:31:54.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.608+0000 7f839f7fe700 1 -- 172.21.15.59:0/1869337084 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839800bcc0 con 0x7f83a0130870 2023-09-30T22:31:54.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.609+0000 7f83a6ea3700 1 -- 172.21.15.59:0/1869337084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83a0130870 msgr2=0x7f83a013a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.609+0000 7f83a6ea3700 1 --2- 172.21.15.59:0/1869337084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83a0130870 0x7f83a013a840 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8398009e50 tx=0x7f839800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:54.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.609+0000 7f83a6ea3700 1 -- 172.21.15.59:0/1869337084 shutdown_connections 2023-09-30T22:31:54.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.609+0000 7f83a6ea3700 1 --2- 172.21.15.59:0/1869337084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83a0130870 0x7f83a013a840 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.609+0000 7f83a6ea3700 1 --2- 172.21.15.59:0/1869337084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83a0133a80 0x7f83a0133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.609+0000 7f83a6ea3700 1 --2- 172.21.15.59:0/1869337084 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83a012ff20 0x7f83a0130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.609+0000 7f83a6ea3700 1 -- 172.21.15.59:0/1869337084 >> 172.21.15.59:0/1869337084 conn(0x7f83a00a4210 msgr2=0x7f83a00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:54.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.609+0000 7f83a6ea3700 1 -- 172.21.15.59:0/1869337084 shutdown_connections 2023-09-30T22:31:54.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.609+0000 7f83a6ea3700 1 -- 172.21.15.59:0/1869337084 wait complete. 2023-09-30T22:31:54.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.610+0000 7f83a6ea3700 1 Processor -- start 2023-09-30T22:31:54.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.610+0000 7f83a6ea3700 1 -- start start 2023-09-30T22:31:54.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f83a6ea3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83a012ff20 0x7f83a009c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f83a6ea3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83a0130870 0x7f83a009ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f83a6ea3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83a0133a80 0x7f83a009cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f83a6ea3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a01202c0 con 0x7f83a0130870 2023-09-30T22:31:54.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f83a6ea3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a01204a0 con 0x7f83a012ff20 2023-09-30T22:31:54.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f83a6ea3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83a006cf30 con 0x7f83a0133a80 2023-09-30T22:31:54.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f839ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83a0130870 0x7f83a009ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f839ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83a0130870 0x7f83a009ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55066/0 (socket says 172.21.15.59:55066) 2023-09-30T22:31:54.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f839ffff700 1 -- 172.21.15.59:0/2390819237 learned_addr learned my addr 172.21.15.59:0/2390819237 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:54.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f83a5440700 1 --2- 172.21.15.59:0/2390819237 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83a0133a80 0x7f83a009cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f83a4c3f700 1 --2- 172.21.15.59:0/2390819237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83a012ff20 0x7f83a009c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f839ffff700 1 -- 172.21.15.59:0/2390819237 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83a0133a80 msgr2=0x7f83a009cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f839ffff700 1 --2- 172.21.15.59:0/2390819237 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83a0133a80 0x7f83a009cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f839ffff700 1 -- 172.21.15.59:0/2390819237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83a012ff20 msgr2=0x7f83a009c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f839ffff700 1 --2- 172.21.15.59:0/2390819237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83a012ff20 0x7f83a009c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f839ffff700 1 -- 172.21.15.59:0/2390819237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83940094a0 con 0x7f83a0130870 2023-09-30T22:31:54.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.611+0000 7f83a4c3f700 1 --2- 172.21.15.59:0/2390819237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83a012ff20 0x7f83a009c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:54.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.612+0000 7f839ffff700 1 --2- 172.21.15.59:0/2390819237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83a0130870 0x7f83a009ca30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f838c00b500 tx=0x7f838c00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:54.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.612+0000 7f839d7fa700 1 -- 172.21.15.59:0/2390819237 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c011830 con 0x7f83a0130870 2023-09-30T22:31:54.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.612+0000 7f839d7fa700 1 -- 172.21.15.59:0/2390819237 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c0119b0 con 0x7f83a0130870 2023-09-30T22:31:54.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.612+0000 7f839d7fa700 1 -- 172.21.15.59:0/2390819237 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c011d60 con 0x7f83a0130870 2023-09-30T22:31:54.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.612+0000 7f83a6ea3700 1 -- 172.21.15.59:0/2390819237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8398009b30 con 0x7f83a0130870 2023-09-30T22:31:54.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.612+0000 7f83a6ea3700 1 -- 172.21.15.59:0/2390819237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a009e100 con 0x7f83a0130870 2023-09-30T22:31:54.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.613+0000 7f83a6ea3700 1 -- 172.21.15.59:0/2390819237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a01200e0 con 0x7f83a0130870 2023-09-30T22:31:54.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.614+0000 7f839d7fa700 1 -- 172.21.15.59:0/2390819237 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f838c01a400 con 0x7f83a0130870 2023-09-30T22:31:54.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.614+0000 7f839d7fa700 1 -- 172.21.15.59:0/2390819237 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f838c03fd00 con 0x7f83a0130870 2023-09-30T22:31:54.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.623+0000 7f839d7fa700 1 -- 172.21.15.59:0/2390819237 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f838c01ae60 con 0x7f83a0130870 2023-09-30T22:31:54.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.688+0000 7fb001af7700 1 -- 172.21.15.59:0/3758595685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faffc06c360 con 0x7faffc09d9f0 2023-09-30T22:31:54.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.688+0000 7fafe3fff700 1 -- 172.21.15.59:0/3758595685 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faff0015030 con 0x7faffc09d9f0 2023-09-30T22:31:54.689 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:54.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.690+0000 7fb001af7700 1 -- 172.21.15.59:0/3758595685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faffc09d9f0 msgr2=0x7faffc071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.690+0000 7fb001af7700 1 --2- 172.21.15.59:0/3758595685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faffc09d9f0 0x7faffc071090 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7faff0009c40 tx=0x7faff0004750 comp rx=0 tx=0).stop 2023-09-30T22:31:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.690+0000 7fb001af7700 1 -- 172.21.15.59:0/3758595685 shutdown_connections 2023-09-30T22:31:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.690+0000 7fb001af7700 1 --2- 172.21.15.59:0/3758595685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faffc1316c0 0x7faffc0715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.690+0000 7fb001af7700 1 --2- 172.21.15.59:0/3758595685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faffc06acb0 0x7faffc070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.690+0000 7fb001af7700 1 --2- 172.21.15.59:0/3758595685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faffc09d9f0 0x7faffc071090 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.690+0000 7fb001af7700 1 -- 172.21.15.59:0/3758595685 >> 172.21.15.59:0/3758595685 conn(0x7faffc066f50 msgr2=0x7faffc130160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.691+0000 7fb001af7700 1 -- 172.21.15.59:0/3758595685 shutdown_connections 2023-09-30T22:31:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.691+0000 7fb001af7700 1 -- 172.21.15.59:0/3758595685 wait complete. 2023-09-30T22:31:54.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:54.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.773+0000 7fac5d98e700 1 -- 172.21.15.59:0/3325326484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fac58119420 con 0x7fac5809dfe0 2023-09-30T22:31:54.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.773+0000 7fac3ffff700 1 -- 172.21.15.59:0/3325326484 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac58119420 con 0x7fac5809dfe0 2023-09-30T22:31:54.773 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.775+0000 7fac5d98e700 1 -- 172.21.15.59:0/3325326484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5809dfe0 msgr2=0x7fac581370b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.775+0000 7fac5d98e700 1 --2- 172.21.15.59:0/3325326484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5809dfe0 0x7fac581370b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fac4c014040 tx=0x7fac4c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.775+0000 7fac5d98e700 1 -- 172.21.15.59:0/3325326484 shutdown_connections 2023-09-30T22:31:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.775+0000 7fac5d98e700 1 --2- 172.21.15.59:0/3325326484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac58130b40 0x7fac581c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.775+0000 7fac5d98e700 1 --2- 172.21.15.59:0/3325326484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5809d6d0 0x7fac58136b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.775+0000 7fac5d98e700 1 --2- 172.21.15.59:0/3325326484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5809dfe0 0x7fac581370b0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.775+0000 7fac5d98e700 1 -- 172.21.15.59:0/3325326484 >> 172.21.15.59:0/3325326484 conn(0x7fac58099c20 msgr2=0x7fac580a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.776+0000 7fac5d98e700 1 -- 172.21.15.59:0/3325326484 shutdown_connections 2023-09-30T22:31:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.776+0000 7fac5d98e700 1 -- 172.21.15.59:0/3325326484 wait complete. 2023-09-30T22:31:54.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:54.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.816+0000 7fc1c8cfd700 1 -- 172.21.15.59:0/184881031 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc1c4070610 con 0x7fc1c406f050 2023-09-30T22:31:54.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.817+0000 7fc1b2ffd700 1 -- 172.21.15.59:0/184881031 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc1b801bb60 con 0x7fc1c406f050 2023-09-30T22:31:54.817 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:54.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.819+0000 7fc1c8cfd700 1 -- 172.21.15.59:0/184881031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1c406f050 msgr2=0x7fc1c4130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.819+0000 7fc1c8cfd700 1 --2- 172.21.15.59:0/184881031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1c406f050 0x7fc1c4130a40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800ec10 tx=0x7fc1b800ef20 comp rx=0 tx=0).stop 2023-09-30T22:31:54.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.819+0000 7fc1c8cfd700 1 -- 172.21.15.59:0/184881031 shutdown_connections 2023-09-30T22:31:54.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.819+0000 7fc1c8cfd700 1 --2- 172.21.15.59:0/184881031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1c406e570 0x7fc1c4130500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.819+0000 7fc1c8cfd700 1 --2- 172.21.15.59:0/184881031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c413a2e0 0x7fc1c4130f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.819+0000 7fc1c8cfd700 1 --2- 172.21.15.59:0/184881031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1c406f050 0x7fc1c4130a40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.819+0000 7fc1c8cfd700 1 -- 172.21.15.59:0/184881031 >> 172.21.15.59:0/184881031 conn(0x7fc1c40a2aa0 msgr2=0x7fc1c409ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:54.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.819+0000 7fc1c8cfd700 1 -- 172.21.15.59:0/184881031 shutdown_connections 2023-09-30T22:31:54.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.819+0000 7fc1c8cfd700 1 -- 172.21.15.59:0/184881031 wait complete. 2023-09-30T22:31:54.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:54.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.833+0000 7f83a6ea3700 1 -- 172.21.15.59:0/2390819237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f83a012f180 con 0x7f83a0130870 2023-09-30T22:31:54.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.833+0000 7f839d7fa700 1 -- 172.21.15.59:0/2390819237 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f838c028070 con 0x7f83a0130870 2023-09-30T22:31:54.834 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:54.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.836+0000 7f83a6ea3700 1 -- 172.21.15.59:0/2390819237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83a0130870 msgr2=0x7f83a009ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.836+0000 7f83a6ea3700 1 --2- 172.21.15.59:0/2390819237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83a0130870 0x7f83a009ca30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f838c00b500 tx=0x7f838c00b8c0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.836+0000 7f83a6ea3700 1 -- 172.21.15.59:0/2390819237 shutdown_connections 2023-09-30T22:31:54.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.836+0000 7f83a6ea3700 1 --2- 172.21.15.59:0/2390819237 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83a0133a80 0x7f83a009cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.836+0000 7f83a6ea3700 1 --2- 172.21.15.59:0/2390819237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83a012ff20 0x7f83a009c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.836+0000 7f83a6ea3700 1 --2- 172.21.15.59:0/2390819237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83a0130870 0x7f83a009ca30 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.836+0000 7f83a6ea3700 1 -- 172.21.15.59:0/2390819237 >> 172.21.15.59:0/2390819237 conn(0x7f83a00a4210 msgr2=0x7f83a00a0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:54.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.836+0000 7f83a6ea3700 1 -- 172.21.15.59:0/2390819237 shutdown_connections 2023-09-30T22:31:54.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:54.836+0000 7f83a6ea3700 1 -- 172.21.15.59:0/2390819237 wait complete. 2023-09-30T22:31:54.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:55.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:55.790 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:55.834 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:55.850 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:55.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.858+0000 7f71074a5700 1 Processor -- start 2023-09-30T22:31:55.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.858+0000 7f71074a5700 1 -- start start 2023-09-30T22:31:55.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.859+0000 7f71074a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f710006b250 0x7f7100136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.859+0000 7f71074a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7100136d80 0x7f7100139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.859+0000 7f71074a5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710009ece0 con 0x7f710006a770 2023-09-30T22:31:55.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.859+0000 7f71074a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710006b640 con 0x7f7100136d80 2023-09-30T22:31:55.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.859+0000 7f71074a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f710009e760 con 0x7f710006b250 2023-09-30T22:31:55.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.859+0000 7f7105241700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f710006a770 0x7f710006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49808/0 (socket says 172.21.15.59:49808) 2023-09-30T22:31:55.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.859+0000 7f7105241700 1 -- 172.21.15.59:0/3953567110 learned_addr learned my addr 172.21.15.59:0/3953567110 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:55.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.859+0000 7f7105a42700 1 --2- 172.21.15.59:0/3953567110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7100136d80 0x7f7100139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.859+0000 7f7104a40700 1 --2- 172.21.15.59:0/3953567110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f710006b250 0x7f7100136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.859+0000 7f7105a42700 1 -- 172.21.15.59:0/3953567110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f710006b250 msgr2=0x7f7100136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:55.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.859+0000 7f7105a42700 1 --2- 172.21.15.59:0/3953567110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f710006b250 0x7f7100136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.859+0000 7f7105a42700 1 -- 172.21.15.59:0/3953567110 >> v1:172.21.15.59:6789/0 conn(0x7f710006a770 legacy=0x7f710006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.860+0000 7f7105a42700 1 -- 172.21.15.59:0/3953567110 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710009e040 con 0x7f7100136d80 2023-09-30T22:31:55.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.860+0000 7f7105a42700 1 --2- 172.21.15.59:0/3953567110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7100136d80 0x7f7100139160 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009dc0 tx=0x7f70f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2613e89031c393fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:55.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.860+0000 7f70f7fff700 1 -- 172.21.15.59:0/3953567110 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f800e070 con 0x7f7100136d80 2023-09-30T22:31:55.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.860+0000 7f70f7fff700 1 -- 172.21.15.59:0/3953567110 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f800bb20 con 0x7f7100136d80 2023-09-30T22:31:55.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.860+0000 7f70f7fff700 1 -- 172.21.15.59:0/3953567110 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8012430 con 0x7f7100136d80 2023-09-30T22:31:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.861+0000 7f71074a5700 1 -- 172.21.15.59:0/3953567110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7100136d80 msgr2=0x7f7100139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.861+0000 7f71074a5700 1 --2- 172.21.15.59:0/3953567110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7100136d80 0x7f7100139160 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009dc0 tx=0x7f70f800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.861+0000 7f71074a5700 1 -- 172.21.15.59:0/3953567110 shutdown_connections 2023-09-30T22:31:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.861+0000 7f71074a5700 1 --2- 172.21.15.59:0/3953567110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7100136d80 0x7f7100139160 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.861+0000 7f71074a5700 1 --2- 172.21.15.59:0/3953567110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f710006b250 0x7f7100136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.861+0000 7f71074a5700 1 -- 172.21.15.59:0/3953567110 >> 172.21.15.59:0/3953567110 conn(0x7f7100066f50 msgr2=0x7f710009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.861+0000 7f71074a5700 1 -- 172.21.15.59:0/3953567110 shutdown_connections 2023-09-30T22:31:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.862+0000 7f71074a5700 1 -- 172.21.15.59:0/3953567110 wait complete. 2023-09-30T22:31:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.863+0000 7f71074a5700 1 Processor -- start 2023-09-30T22:31:55.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.863+0000 7f71074a5700 1 -- start start 2023-09-30T22:31:55.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.863+0000 7f71074a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f710006a770 0x7f710009ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.863+0000 7f71074a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f710006b250 0x7f710009b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.863+0000 7f71074a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7100136d80 0x7f71001c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.863+0000 7f71074a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710009b880 con 0x7f710006b250 2023-09-30T22:31:55.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.863+0000 7f71074a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710006e950 con 0x7f710006a770 2023-09-30T22:31:55.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.863+0000 7f71074a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7100122000 con 0x7f7100136d80 2023-09-30T22:31:55.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.864+0000 7f7105241700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f710006a770 0x7f710009ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.864+0000 7f7104a40700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f710006b250 0x7f710009b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.864+0000 7f7105241700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f710006a770 0x7f710009ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49330/0 (socket says 172.21.15.59:49330) 2023-09-30T22:31:55.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.864+0000 7f7105241700 1 -- 172.21.15.59:0/4040600477 learned_addr learned my addr 172.21.15.59:0/4040600477 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:55.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.864+0000 7f7105a42700 1 --2- 172.21.15.59:0/4040600477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7100136d80 0x7f71001c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.864+0000 7f7105241700 1 -- 172.21.15.59:0/4040600477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7100136d80 msgr2=0x7f71001c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.864+0000 7f7105241700 1 --2- 172.21.15.59:0/4040600477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7100136d80 0x7f71001c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.864+0000 7f7105241700 1 -- 172.21.15.59:0/4040600477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f710006b250 msgr2=0x7f710009b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.864+0000 7f7105241700 1 --2- 172.21.15.59:0/4040600477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f710006b250 0x7f710009b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.864+0000 7f7105241700 1 -- 172.21.15.59:0/4040600477 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f8009a70 con 0x7f710006a770 2023-09-30T22:31:55.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.864+0000 7f7104a40700 1 --2- 172.21.15.59:0/4040600477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f710006b250 0x7f710009b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:55.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.864+0000 7f7105241700 1 --2- 172.21.15.59:0/4040600477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f710006a770 0x7f710009ae00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00c550 tx=0x7f70fc00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:55.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.865+0000 7f70f5ffb700 1 -- 172.21.15.59:0/4040600477 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc005d70 con 0x7f710006a770 2023-09-30T22:31:55.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.865+0000 7f70f5ffb700 1 -- 172.21.15.59:0/4040600477 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc0070d0 con 0x7f710006a770 2023-09-30T22:31:55.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.865+0000 7f70f5ffb700 1 -- 172.21.15.59:0/4040600477 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc007440 con 0x7f710006a770 2023-09-30T22:31:55.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.865+0000 7f71074a5700 1 -- 172.21.15.59:0/4040600477 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71001322f0 con 0x7f710006a770 2023-09-30T22:31:55.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.865+0000 7f71074a5700 1 -- 172.21.15.59:0/4040600477 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7100121d40 con 0x7f710006a770 2023-09-30T22:31:55.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.866+0000 7f70f5ffb700 1 -- 172.21.15.59:0/4040600477 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70fc0075a0 con 0x7f710006a770 2023-09-30T22:31:55.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.866+0000 7f70f5ffb700 1 -- 172.21.15.59:0/4040600477 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f70fc03eb00 con 0x7f710006a770 2023-09-30T22:31:55.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.866+0000 7f71074a5700 1 -- 172.21.15.59:0/4040600477 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710009f630 con 0x7f710006a770 2023-09-30T22:31:55.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.873+0000 7f70f5ffb700 1 -- 172.21.15.59:0/4040600477 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70fc017020 con 0x7f710006a770 2023-09-30T22:31:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.947+0000 7f272ad5e700 1 Processor -- start 2023-09-30T22:31:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.947+0000 7f272ad5e700 1 -- start start 2023-09-30T22:31:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.947+0000 7f272ad5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272409f410 0x7f2724136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.947+0000 7f272ad5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2724136fe0 0x7f27241393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.947+0000 7f272ad5e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2724070940 con 0x7f272409e930 2023-09-30T22:31:55.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.947+0000 7f272ad5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272406fd60 con 0x7f272409f410 2023-09-30T22:31:55.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.947+0000 7f272ad5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f272406fa80 con 0x7f2724136fe0 2023-09-30T22:31:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.948+0000 7f2723fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272409f410 0x7f2724136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.948+0000 7f2728afa700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f272409e930 0x7f272409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49818/0 (socket says 172.21.15.59:49818) 2023-09-30T22:31:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.948+0000 7f2728afa700 1 -- 172.21.15.59:0/328331038 learned_addr learned my addr 172.21.15.59:0/328331038 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.948+0000 7f2723fff700 1 -- 172.21.15.59:0/328331038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2724136fe0 msgr2=0x7f27241393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.948+0000 7f2723fff700 1 --2- 172.21.15.59:0/328331038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2724136fe0 0x7f27241393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.948+0000 7f2723fff700 1 -- 172.21.15.59:0/328331038 >> v1:172.21.15.59:6789/0 conn(0x7f272409e930 legacy=0x7f272409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.948+0000 7f27237fe700 1 -- 172.21.15.59:0/328331038 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455494603 0 0) 0x7f2724070940 con 0x7f272409e930 2023-09-30T22:31:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.948+0000 7f2723fff700 1 -- 172.21.15.59:0/328331038 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272409fb60 con 0x7f272409f410 2023-09-30T22:31:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.948+0000 7f2723fff700 1 --2- 172.21.15.59:0/328331038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272409f410 0x7f2724136aa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2710009870 tx=0x7f2710009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ea213f66b12a27b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.949+0000 7f27237fe700 1 -- 172.21.15.59:0/328331038 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710011830 con 0x7f272409f410 2023-09-30T22:31:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.949+0000 7f27237fe700 1 -- 172.21.15.59:0/328331038 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2710011990 con 0x7f272409f410 2023-09-30T22:31:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.949+0000 7f27237fe700 1 -- 172.21.15.59:0/328331038 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710011d20 con 0x7f272409f410 2023-09-30T22:31:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.950+0000 7f272ad5e700 1 -- 172.21.15.59:0/328331038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272409f410 msgr2=0x7f2724136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.950+0000 7f272ad5e700 1 --2- 172.21.15.59:0/328331038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272409f410 0x7f2724136aa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2710009870 tx=0x7f2710009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.950+0000 7f272ad5e700 1 -- 172.21.15.59:0/328331038 shutdown_connections 2023-09-30T22:31:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.950+0000 7f272ad5e700 1 --2- 172.21.15.59:0/328331038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2724136fe0 0x7f27241393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.950+0000 7f272ad5e700 1 --2- 172.21.15.59:0/328331038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272409f410 0x7f2724136aa0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.950+0000 7f272ad5e700 1 -- 172.21.15.59:0/328331038 >> 172.21.15.59:0/328331038 conn(0x7f27240a4210 msgr2=0x7f27240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.950+0000 7f272ad5e700 1 -- 172.21.15.59:0/328331038 shutdown_connections 2023-09-30T22:31:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.950+0000 7f272ad5e700 1 -- 172.21.15.59:0/328331038 wait complete. 2023-09-30T22:31:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.951+0000 7f272ad5e700 1 Processor -- start 2023-09-30T22:31:55.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.951+0000 7f272ad5e700 1 -- start start 2023-09-30T22:31:55.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.952+0000 7f272ad5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272409e930 0x7f2724134d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.952+0000 7f272ad5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272409f410 0x7f27241352b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.952+0000 7f272ad5e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2724136fe0 0x7f27241357f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.952+0000 7f272ad5e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272411bf30 con 0x7f2724136fe0 2023-09-30T22:31:55.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.952+0000 7f272ad5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272406d740 con 0x7f272409e930 2023-09-30T22:31:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.952+0000 7f272ad5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2724071d20 con 0x7f272409f410 2023-09-30T22:31:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.952+0000 7f2728afa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272409e930 0x7f2724134d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.952+0000 7f2728afa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272409e930 0x7f2724134d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49344/0 (socket says 172.21.15.59:49344) 2023-09-30T22:31:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.952+0000 7f2728afa700 1 -- 172.21.15.59:0/2097217698 learned_addr learned my addr 172.21.15.59:0/2097217698 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.952+0000 7f27292fb700 1 --2- 172.21.15.59:0/2097217698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2724136fe0 0x7f27241357f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.953+0000 7f2723fff700 1 --2- 172.21.15.59:0/2097217698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272409f410 0x7f27241352b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.953+0000 7f27292fb700 1 -- 172.21.15.59:0/2097217698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272409f410 msgr2=0x7f27241352b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.953+0000 7f27292fb700 1 --2- 172.21.15.59:0/2097217698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272409f410 0x7f27241352b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.953+0000 7f27292fb700 1 -- 172.21.15.59:0/2097217698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272409e930 msgr2=0x7f2724134d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.953+0000 7f27292fb700 1 --2- 172.21.15.59:0/2097217698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272409e930 0x7f2724134d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.953+0000 7f27292fb700 1 -- 172.21.15.59:0/2097217698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27100094a0 con 0x7f2724136fe0 2023-09-30T22:31:55.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.953+0000 7f2723fff700 1 --2- 172.21.15.59:0/2097217698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272409f410 0x7f27241352b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:55.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.953+0000 7f27292fb700 1 --2- 172.21.15.59:0/2097217698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2724136fe0 0x7f27241357f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f27240a07c0 tx=0x7f271c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:55.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.953+0000 7f27217fa700 1 -- 172.21.15.59:0/2097217698 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c00cbb0 con 0x7f2724136fe0 2023-09-30T22:31:55.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.953+0000 7f27217fa700 1 -- 172.21.15.59:0/2097217698 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c00cd10 con 0x7f2724136fe0 2023-09-30T22:31:55.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.953+0000 7f272ad5e700 1 -- 172.21.15.59:0/2097217698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272411b990 con 0x7f2724136fe0 2023-09-30T22:31:55.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.953+0000 7f27217fa700 1 -- 172.21.15.59:0/2097217698 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c014680 con 0x7f2724136fe0 2023-09-30T22:31:55.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.953+0000 7f272ad5e700 1 -- 172.21.15.59:0/2097217698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272411a9f0 con 0x7f2724136fe0 2023-09-30T22:31:55.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.955+0000 7f27217fa700 1 -- 172.21.15.59:0/2097217698 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f271c01d3b0 con 0x7f2724136fe0 2023-09-30T22:31:55.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.955+0000 7f27217fa700 1 -- 172.21.15.59:0/2097217698 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f271c006e40 con 0x7f2724136fe0 2023-09-30T22:31:55.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.956+0000 7f272ad5e700 1 -- 172.21.15.59:0/2097217698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2724074ea0 con 0x7f2724136fe0 2023-09-30T22:31:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.965+0000 7f27217fa700 1 -- 172.21.15.59:0/2097217698 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f271c019080 con 0x7f2724136fe0 2023-09-30T22:31:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.982+0000 7fcfb592e700 1 Processor -- start 2023-09-30T22:31:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.982+0000 7fcfb592e700 1 -- start start 2023-09-30T22:31:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.982+0000 7fcfb592e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcfb00a0a30 0x7fcfb00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.982+0000 7fcfb592e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb009d630 0x7fcfb00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.982+0000 7fcfb592e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb00a2a70 con 0x7fcfb0133930 2023-09-30T22:31:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.983+0000 7fcfb592e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb00a01d0 con 0x7fcfb00a0a30 2023-09-30T22:31:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.983+0000 7fcfb592e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb009e2b0 con 0x7fcfb009d630 2023-09-30T22:31:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.983+0000 7fcfaeffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcfb00a0a30 0x7fcfb00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.983+0000 7fcfaf7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcfb0133930 0x7fcfb0133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49824/0 (socket says 172.21.15.59:49824) 2023-09-30T22:31:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.983+0000 7fcfaf7fe700 1 -- 172.21.15.59:0/1325160822 learned_addr learned my addr 172.21.15.59:0/1325160822 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.983+0000 7fcfae7fc700 1 --2- 172.21.15.59:0/1325160822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb009d630 0x7fcfb00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.983+0000 7fcfaeffd700 1 -- 172.21.15.59:0/1325160822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb009d630 msgr2=0x7fcfb00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.983+0000 7fcfaeffd700 1 --2- 172.21.15.59:0/1325160822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb009d630 0x7fcfb00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.983+0000 7fcfaeffd700 1 -- 172.21.15.59:0/1325160822 >> v1:172.21.15.59:6789/0 conn(0x7fcfb0133930 legacy=0x7fcfb0133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.983+0000 7fcfaeffd700 1 -- 172.21.15.59:0/1325160822 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb009dc50 con 0x7fcfb00a0a30 2023-09-30T22:31:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.983+0000 7fcfae7fc700 1 --2- 172.21.15.59:0/1325160822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb009d630 0x7fcfb00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.983+0000 7fcfaeffd700 1 --2- 172.21.15.59:0/1325160822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb00a0a30 0x7fcfb00a0e00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009d90 tx=0x7fcfa000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c939d05a4057a6e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.984+0000 7fcfadffb700 1 -- 172.21.15.59:0/1325160822 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000e070 con 0x7fcfb00a0a30 2023-09-30T22:31:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.984+0000 7fcfadffb700 1 -- 172.21.15.59:0/1325160822 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa000bb20 con 0x7fcfb00a0a30 2023-09-30T22:31:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.984+0000 7fcfadffb700 1 -- 172.21.15.59:0/1325160822 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0012430 con 0x7fcfb00a0a30 2023-09-30T22:31:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.984+0000 7fcfb592e700 1 -- 172.21.15.59:0/1325160822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb00a0a30 msgr2=0x7fcfb00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.984+0000 7fcfb592e700 1 --2- 172.21.15.59:0/1325160822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb00a0a30 0x7fcfb00a0e00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009d90 tx=0x7fcfa000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.984+0000 7fcfb592e700 1 -- 172.21.15.59:0/1325160822 shutdown_connections 2023-09-30T22:31:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.984+0000 7fcfb592e700 1 --2- 172.21.15.59:0/1325160822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb00a0a30 0x7fcfb00a0e00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.984+0000 7fcfb592e700 1 --2- 172.21.15.59:0/1325160822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb009d630 0x7fcfb00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.985+0000 7fcfb592e700 1 -- 172.21.15.59:0/1325160822 >> 172.21.15.59:0/1325160822 conn(0x7fcfb00a3050 msgr2=0x7fcfb00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.985+0000 7fcfb592e700 1 -- 172.21.15.59:0/1325160822 shutdown_connections 2023-09-30T22:31:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.985+0000 7fcfb592e700 1 -- 172.21.15.59:0/1325160822 wait complete. 2023-09-30T22:31:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.986+0000 7fcfb592e700 1 Processor -- start 2023-09-30T22:31:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.986+0000 7fcfb592e700 1 -- start start 2023-09-30T22:31:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.986+0000 7fcfb592e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb009d630 0x7fcfb0132a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.986+0000 7fcfb592e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcfb00a0a30 0x7fcfb0132f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.986+0000 7fcfb592e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb0133930 0x7fcfb01c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.986+0000 7fcfb592e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb01210a0 con 0x7fcfb009d630 2023-09-30T22:31:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.986+0000 7fcfb592e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb0121730 con 0x7fcfb0133930 2023-09-30T22:31:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.986+0000 7fcfb592e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb01207b0 con 0x7fcfb00a0a30 2023-09-30T22:31:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.987+0000 7fcfae7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcfb00a0a30 0x7fcfb0132f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.987+0000 7fcfaf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb0133930 0x7fcfb01c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.987+0000 7fcfae7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcfb00a0a30 0x7fcfb0132f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55896/0 (socket says 172.21.15.59:55896) 2023-09-30T22:31:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.987+0000 7fcfae7fc700 1 -- 172.21.15.59:0/717073015 learned_addr learned my addr 172.21.15.59:0/717073015 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.987+0000 7fcfaeffd700 1 --2- 172.21.15.59:0/717073015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb009d630 0x7fcfb0132a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.987+0000 7fcfaeffd700 1 -- 172.21.15.59:0/717073015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcfb00a0a30 msgr2=0x7fcfb0132f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.987+0000 7fcfaeffd700 1 --2- 172.21.15.59:0/717073015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcfb00a0a30 0x7fcfb0132f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.987+0000 7fcfaeffd700 1 -- 172.21.15.59:0/717073015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb0133930 msgr2=0x7fcfb01c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.987+0000 7fcfaeffd700 1 --2- 172.21.15.59:0/717073015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb0133930 0x7fcfb01c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.987+0000 7fcfaeffd700 1 -- 172.21.15.59:0/717073015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf980094a0 con 0x7fcfb009d630 2023-09-30T22:31:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.987+0000 7fcfae7fc700 1 --2- 172.21.15.59:0/717073015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcfb00a0a30 0x7fcfb0132f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.987+0000 7fcfaeffd700 1 --2- 172.21.15.59:0/717073015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb009d630 0x7fcfb0132a10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0016000 tx=0x7fcfa0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.988+0000 7fcfa7fff700 1 -- 172.21.15.59:0/717073015 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0012430 con 0x7fcfb009d630 2023-09-30T22:31:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.988+0000 7fcfa7fff700 1 -- 172.21.15.59:0/717073015 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa0020070 con 0x7fcfb009d630 2023-09-30T22:31:55.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.988+0000 7fcfb592e700 1 -- 172.21.15.59:0/717073015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa0009a70 con 0x7fcfb009d630 2023-09-30T22:31:55.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.988+0000 7fcfa7fff700 1 -- 172.21.15.59:0/717073015 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0004280 con 0x7fcfb009d630 2023-09-30T22:31:55.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.988+0000 7fcfb592e700 1 -- 172.21.15.59:0/717073015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb00a0410 con 0x7fcfb009d630 2023-09-30T22:31:55.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.989+0000 7fcfa7fff700 1 -- 172.21.15.59:0/717073015 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcfa00043e0 con 0x7fcfb009d630 2023-09-30T22:31:55.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.989+0000 7fcfa7fff700 1 -- 172.21.15.59:0/717073015 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcfa0022070 con 0x7fcfb009d630 2023-09-30T22:31:55.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.989+0000 7fcfb592e700 1 -- 172.21.15.59:0/717073015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb0122080 con 0x7fcfb009d630 2023-09-30T22:31:55.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:55.998+0000 7fcfa7fff700 1 -- 172.21.15.59:0/717073015 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcfa0012e40 con 0x7fcfb009d630 2023-09-30T22:31:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.011+0000 7f6ed63a6700 1 Processor -- start 2023-09-30T22:31:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.012+0000 7f6ed63a6700 1 -- start start 2023-09-30T22:31:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.012+0000 7f6ed63a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ed01338a0 0x7f6ed0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.012+0000 7f6ed63a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ed009de50 0x7f6ed009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.012+0000 7f6ed63a6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ed009e760 0x7f6ed013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.012+0000 7f6ed63a6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed006fef0 con 0x7f6ed009e760 2023-09-30T22:31:56.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.012+0000 7f6ed63a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed006ef30 con 0x7f6ed009de50 2023-09-30T22:31:56.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.012+0000 7f6ed63a6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed01334b0 con 0x7f6ed01338a0 2023-09-30T22:31:56.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.012+0000 7f6ecf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ed009de50 0x7f6ed009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:56.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.012+0000 7f6ecf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ed009de50 0x7f6ed009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49368/0 (socket says 172.21.15.59:49368) 2023-09-30T22:31:56.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.012+0000 7f6ecf7fe700 1 -- 172.21.15.59:0/3430201795 learned_addr learned my addr 172.21.15.59:0/3430201795 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:56.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.013+0000 7f6ed4943700 1 --2- 172.21.15.59:0/3430201795 >> v2:172.21.15.59:3300/0 conn(0x7f6ed009e760 0x7f6ed013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:56.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.013+0000 7f6ecf7fe700 1 -- 172.21.15.59:0/3430201795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ed01338a0 msgr2=0x7f6ed0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:56.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.013+0000 7f6ecf7fe700 1 --2- 172.21.15.59:0/3430201795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ed01338a0 0x7f6ed0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.013+0000 7f6ecf7fe700 1 -- 172.21.15.59:0/3430201795 >> v2:172.21.15.59:3300/0 conn(0x7f6ed009e760 msgr2=0x7f6ed013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:56.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.013+0000 7f6ecf7fe700 1 --2- 172.21.15.59:0/3430201795 >> v2:172.21.15.59:3300/0 conn(0x7f6ed009e760 0x7f6ed013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.013+0000 7f6ecf7fe700 1 -- 172.21.15.59:0/3430201795 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed006fc30 con 0x7f6ed009de50 2023-09-30T22:31:56.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.013+0000 7f6ecf7fe700 1 --2- 172.21.15.59:0/3430201795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ed009de50 0x7f6ed009e220 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009920 tx=0x7f6ec4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=918aca38179b7d05 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:56.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.013+0000 7f6eceffd700 1 -- 172.21.15.59:0/3430201795 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4011830 con 0x7f6ed009de50 2023-09-30T22:31:56.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.013+0000 7f6eceffd700 1 -- 172.21.15.59:0/3430201795 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec4011990 con 0x7f6ed009de50 2023-09-30T22:31:56.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.013+0000 7f6eceffd700 1 -- 172.21.15.59:0/3430201795 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4011d20 con 0x7f6ed009de50 2023-09-30T22:31:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.014+0000 7f6ed63a6700 1 -- 172.21.15.59:0/3430201795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ed009de50 msgr2=0x7f6ed009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.014+0000 7f6ed63a6700 1 --2- 172.21.15.59:0/3430201795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ed009de50 0x7f6ed009e220 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009920 tx=0x7f6ec4009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.014+0000 7f6ed63a6700 1 -- 172.21.15.59:0/3430201795 shutdown_connections 2023-09-30T22:31:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.014+0000 7f6ed63a6700 1 --2- 172.21.15.59:0/3430201795 >> v2:172.21.15.59:3300/0 conn(0x7f6ed009e760 0x7f6ed013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.014+0000 7f6ed63a6700 1 --2- 172.21.15.59:0/3430201795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ed01338a0 0x7f6ed0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.014+0000 7f6ed63a6700 1 --2- 172.21.15.59:0/3430201795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ed009de50 0x7f6ed009e220 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.014+0000 7f6ed63a6700 1 -- 172.21.15.59:0/3430201795 >> 172.21.15.59:0/3430201795 conn(0x7f6ed00a2aa0 msgr2=0x7f6ed00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.014+0000 7f6ed63a6700 1 -- 172.21.15.59:0/3430201795 shutdown_connections 2023-09-30T22:31:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.014+0000 7f6ed63a6700 1 -- 172.21.15.59:0/3430201795 wait complete. 2023-09-30T22:31:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.015+0000 7f6ed63a6700 1 Processor -- start 2023-09-30T22:31:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.015+0000 7f6ed63a6700 1 -- start start 2023-09-30T22:31:56.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.016+0000 7f6ed63a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ed009de50 0x7f6ed011eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.016+0000 7f6ed63a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ed009e760 0x7f6ed011f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.016+0000 7f6ed63a6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ed01338a0 0x7f6ed011f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.016+0000 7f6ed63a6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed01224d0 con 0x7f6ed01338a0 2023-09-30T22:31:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.016+0000 7f6ed63a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed0122720 con 0x7f6ed009de50 2023-09-30T22:31:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.016+0000 7f6ed63a6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed012fd90 con 0x7f6ed009e760 2023-09-30T22:31:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.016+0000 7f6ed4943700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ed01338a0 0x7f6ed011f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.016+0000 7f6ed4943700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ed01338a0 0x7f6ed011f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55110/0 (socket says 172.21.15.59:55110) 2023-09-30T22:31:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.016+0000 7f6ecffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ed009de50 0x7f6ed011eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.016+0000 7f6ed4943700 1 -- 172.21.15.59:0/900828640 learned_addr learned my addr 172.21.15.59:0/900828640 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.016+0000 7f6ecf7fe700 1 --2- 172.21.15.59:0/900828640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ed009e760 0x7f6ed011f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.017+0000 7f6ed4943700 1 -- 172.21.15.59:0/900828640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ed009e760 msgr2=0x7f6ed011f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.017+0000 7f6ed4943700 1 --2- 172.21.15.59:0/900828640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ed009e760 0x7f6ed011f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.017+0000 7f6ed4943700 1 -- 172.21.15.59:0/900828640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ed009de50 msgr2=0x7f6ed011eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:56.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.017+0000 7f6ed4943700 1 --2- 172.21.15.59:0/900828640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ed009de50 0x7f6ed011eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.017+0000 7f6ed4943700 1 -- 172.21.15.59:0/900828640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec4009550 con 0x7f6ed01338a0 2023-09-30T22:31:56.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.017+0000 7f6ecffff700 1 --2- 172.21.15.59:0/900828640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ed009de50 0x7f6ed011eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:56.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.017+0000 7f6ed4943700 1 --2- 172.21.15.59:0/900828640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ed01338a0 0x7f6ed011f720 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800efc0 tx=0x7f6ec800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:56.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.017+0000 7f6eccff9700 1 -- 172.21.15.59:0/900828640 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8009ea0 con 0x7f6ed01338a0 2023-09-30T22:31:56.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.017+0000 7f6eccff9700 1 -- 172.21.15.59:0/900828640 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec800f040 con 0x7f6ed01338a0 2023-09-30T22:31:56.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.017+0000 7f6eccff9700 1 -- 172.21.15.59:0/900828640 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec800ced0 con 0x7f6ed01338a0 2023-09-30T22:31:56.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.017+0000 7f6ed63a6700 1 -- 172.21.15.59:0/900828640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed0120870 con 0x7f6ed01338a0 2023-09-30T22:31:56.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.017+0000 7f6ed63a6700 1 -- 172.21.15.59:0/900828640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed0122180 con 0x7f6ed01338a0 2023-09-30T22:31:56.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.018+0000 7f6eccff9700 1 -- 172.21.15.59:0/900828640 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ec8014480 con 0x7f6ed01338a0 2023-09-30T22:31:56.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.018+0000 7f6ed63a6700 1 -- 172.21.15.59:0/900828640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed0134130 con 0x7f6ed01338a0 2023-09-30T22:31:56.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.018+0000 7f6eccff9700 1 -- 172.21.15.59:0/900828640 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6ec80400d0 con 0x7f6ed01338a0 2023-09-30T22:31:56.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.023+0000 7f6eccff9700 1 -- 172.21.15.59:0/900828640 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ec8007740 con 0x7f6ed01338a0 2023-09-30T22:31:56.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.146+0000 7f71074a5700 1 -- 172.21.15.59:0/4040600477 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7100074ea0 con 0x7f710006a770 2023-09-30T22:31:56.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.146+0000 7f70f5ffb700 1 -- 172.21.15.59:0/4040600477 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70fc019b40 con 0x7f710006a770 2023-09-30T22:31:56.147 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.149+0000 7f71074a5700 1 -- 172.21.15.59:0/4040600477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f710006a770 msgr2=0x7f710009ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.149+0000 7f71074a5700 1 --2- 172.21.15.59:0/4040600477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f710006a770 0x7f710009ae00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00c550 tx=0x7f70fc00c860 comp rx=0 tx=0).stop 2023-09-30T22:31:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.149+0000 7f71074a5700 1 -- 172.21.15.59:0/4040600477 shutdown_connections 2023-09-30T22:31:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.149+0000 7f71074a5700 1 --2- 172.21.15.59:0/4040600477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7100136d80 0x7f71001c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.149+0000 7f71074a5700 1 --2- 172.21.15.59:0/4040600477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f710006a770 0x7f710009ae00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.149+0000 7f71074a5700 1 --2- 172.21.15.59:0/4040600477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f710006b250 0x7f710009b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.149+0000 7f71074a5700 1 -- 172.21.15.59:0/4040600477 >> 172.21.15.59:0/4040600477 conn(0x7f7100066f50 msgr2=0x7f71000a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:56.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.149+0000 7f71074a5700 1 -- 172.21.15.59:0/4040600477 shutdown_connections 2023-09-30T22:31:56.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.149+0000 7f71074a5700 1 -- 172.21.15.59:0/4040600477 wait complete. 2023-09-30T22:31:56.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:56.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.206+0000 7fcfb592e700 1 -- 172.21.15.59:0/717073015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcfb0133490 con 0x7fcfb009d630 2023-09-30T22:31:56.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.206+0000 7fcfa7fff700 1 -- 172.21.15.59:0/717073015 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcfa00263e0 con 0x7fcfb009d630 2023-09-30T22:31:56.206 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:56.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.208+0000 7fcfb592e700 1 -- 172.21.15.59:0/717073015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb009d630 msgr2=0x7fcfb0132a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:56.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.208+0000 7fcfb592e700 1 --2- 172.21.15.59:0/717073015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb009d630 0x7fcfb0132a10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0016000 tx=0x7fcfa0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.208+0000 7fcfb592e700 1 -- 172.21.15.59:0/717073015 shutdown_connections 2023-09-30T22:31:56.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.208+0000 7fcfb592e700 1 --2- 172.21.15.59:0/717073015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb0133930 0x7fcfb01c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.208+0000 7fcfb592e700 1 --2- 172.21.15.59:0/717073015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb009d630 0x7fcfb0132a10 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.208+0000 7fcfb592e700 1 --2- 172.21.15.59:0/717073015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcfb00a0a30 0x7fcfb0132f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.208+0000 7fcfb592e700 1 -- 172.21.15.59:0/717073015 >> 172.21.15.59:0/717073015 conn(0x7fcfb00a3050 msgr2=0x7fcfb009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.209+0000 7fcfb592e700 1 -- 172.21.15.59:0/717073015 shutdown_connections 2023-09-30T22:31:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.209+0000 7fcfb592e700 1 -- 172.21.15.59:0/717073015 wait complete. 2023-09-30T22:31:56.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.219+0000 7f272ad5e700 1 -- 172.21.15.59:0/2097217698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f272406b250 con 0x7f2724136fe0 2023-09-30T22:31:56.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.220+0000 7f27217fa700 1 -- 172.21.15.59:0/2097217698 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f271c01c360 con 0x7f2724136fe0 2023-09-30T22:31:56.220 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:56.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:56.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.222+0000 7f272ad5e700 1 -- 172.21.15.59:0/2097217698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2724136fe0 msgr2=0x7f27241357f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:56.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.222+0000 7f272ad5e700 1 --2- 172.21.15.59:0/2097217698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2724136fe0 0x7f27241357f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f27240a07c0 tx=0x7f271c009ed0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.223+0000 7f272ad5e700 1 -- 172.21.15.59:0/2097217698 shutdown_connections 2023-09-30T22:31:56.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.223+0000 7f272ad5e700 1 --2- 172.21.15.59:0/2097217698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2724136fe0 0x7f27241357f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.223+0000 7f272ad5e700 1 --2- 172.21.15.59:0/2097217698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272409e930 0x7f2724134d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.223+0000 7f272ad5e700 1 --2- 172.21.15.59:0/2097217698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272409f410 0x7f27241352b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.223+0000 7f272ad5e700 1 -- 172.21.15.59:0/2097217698 >> 172.21.15.59:0/2097217698 conn(0x7f27240a4210 msgr2=0x7f27240a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:56.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.223+0000 7f272ad5e700 1 -- 172.21.15.59:0/2097217698 shutdown_connections 2023-09-30T22:31:56.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.223+0000 7f272ad5e700 1 -- 172.21.15.59:0/2097217698 wait complete. 2023-09-30T22:31:56.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.230+0000 7f6ed63a6700 1 -- 172.21.15.59:0/900828640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6ed0120870 con 0x7f6ed01338a0 2023-09-30T22:31:56.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.231+0000 7f6eccff9700 1 -- 172.21.15.59:0/900828640 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ed0120870 con 0x7f6ed01338a0 2023-09-30T22:31:56.231 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:56.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.233+0000 7f6ed63a6700 1 -- 172.21.15.59:0/900828640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ed01338a0 msgr2=0x7f6ed011f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:56.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.233+0000 7f6ed63a6700 1 --2- 172.21.15.59:0/900828640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ed01338a0 0x7f6ed011f720 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800efc0 tx=0x7f6ec800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.233+0000 7f6ed63a6700 1 -- 172.21.15.59:0/900828640 shutdown_connections 2023-09-30T22:31:56.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.233+0000 7f6ed63a6700 1 --2- 172.21.15.59:0/900828640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ed01338a0 0x7f6ed011f720 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.233+0000 7f6ed63a6700 1 --2- 172.21.15.59:0/900828640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ed009de50 0x7f6ed011eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.233+0000 7f6ed63a6700 1 --2- 172.21.15.59:0/900828640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ed009e760 0x7f6ed011f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.233+0000 7f6ed63a6700 1 -- 172.21.15.59:0/900828640 >> 172.21.15.59:0/900828640 conn(0x7f6ed00a2aa0 msgr2=0x7f6ed009ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:56.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.233+0000 7f6ed63a6700 1 -- 172.21.15.59:0/900828640 shutdown_connections 2023-09-30T22:31:56.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:56.233+0000 7f6ed63a6700 1 -- 172.21.15.59:0/900828640 wait complete. 2023-09-30T22:31:56.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:56.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:57.164 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:57.224 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:57.238 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:57.248 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:57.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.320+0000 7f746f3b2700 1 Processor -- start 2023-09-30T22:31:57.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.320+0000 7f746f3b2700 1 -- start start 2023-09-30T22:31:57.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.321+0000 7f746f3b2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f746809e1d0 0x7f7468138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.321+0000 7f746f3b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7468139170 0x7f746813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.321+0000 7f746f3b2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746809b120 con 0x7f746809d6f0 2023-09-30T22:31:57.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.321+0000 7f746f3b2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746806b460 con 0x7f746809e1d0 2023-09-30T22:31:57.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.321+0000 7f746f3b2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f746809a7e0 con 0x7f7468139170 2023-09-30T22:31:57.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.321+0000 7f746c94d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f746809e1d0 0x7f7468138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.321+0000 7f746c94d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f746809e1d0 0x7f7468138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55114/0 (socket says 172.21.15.59:55114) 2023-09-30T22:31:57.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.321+0000 7f746c94d700 1 -- 172.21.15.59:0/4052658884 learned_addr learned my addr 172.21.15.59:0/4052658884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:57.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.321+0000 7f746d94f700 1 --2- 172.21.15.59:0/4052658884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7468139170 0x7f746813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.321+0000 7f746c94d700 1 -- 172.21.15.59:0/4052658884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7468139170 msgr2=0x7f746813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:57.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.321+0000 7f746c94d700 1 --2- 172.21.15.59:0/4052658884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7468139170 0x7f746813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.321+0000 7f746c94d700 1 -- 172.21.15.59:0/4052658884 >> v1:172.21.15.59:6789/0 conn(0x7f746809d6f0 legacy=0x7f746809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.321+0000 7f746c94d700 1 -- 172.21.15.59:0/4052658884 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746809a500 con 0x7f746809e1d0 2023-09-30T22:31:57.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.321+0000 7f746d94f700 1 --2- 172.21.15.59:0/4052658884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7468139170 0x7f746813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:57.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.321+0000 7f746c94d700 1 --2- 172.21.15.59:0/4052658884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746809e1d0 0x7f7468138c30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7458009920 tx=0x7f7458009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2440d6dbac95de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:57.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.322+0000 7f745ffff700 1 -- 172.21.15.59:0/4052658884 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458011830 con 0x7f746809e1d0 2023-09-30T22:31:57.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.322+0000 7f745ffff700 1 -- 172.21.15.59:0/4052658884 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7458011990 con 0x7f746809e1d0 2023-09-30T22:31:57.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.322+0000 7f745ffff700 1 -- 172.21.15.59:0/4052658884 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458011d20 con 0x7f746809e1d0 2023-09-30T22:31:57.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.322+0000 7f746f3b2700 1 -- 172.21.15.59:0/4052658884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746809e1d0 msgr2=0x7f7468138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.322+0000 7f746f3b2700 1 --2- 172.21.15.59:0/4052658884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746809e1d0 0x7f7468138c30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7458009920 tx=0x7f7458009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:57.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.323+0000 7f746f3b2700 1 -- 172.21.15.59:0/4052658884 shutdown_connections 2023-09-30T22:31:57.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.323+0000 7f746f3b2700 1 --2- 172.21.15.59:0/4052658884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7468139170 0x7f746813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.323+0000 7f746f3b2700 1 --2- 172.21.15.59:0/4052658884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746809e1d0 0x7f7468138c30 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.323+0000 7f746f3b2700 1 -- 172.21.15.59:0/4052658884 >> 172.21.15.59:0/4052658884 conn(0x7f7468066f50 msgr2=0x7f746809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:57.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.323+0000 7f746f3b2700 1 -- 172.21.15.59:0/4052658884 shutdown_connections 2023-09-30T22:31:57.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.323+0000 7f746f3b2700 1 -- 172.21.15.59:0/4052658884 wait complete. 2023-09-30T22:31:57.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.324+0000 7f746f3b2700 1 Processor -- start 2023-09-30T22:31:57.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.324+0000 7f746f3b2700 1 -- start start 2023-09-30T22:31:57.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746f3b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746809d6f0 0x7f74681c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746f3b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746809e1d0 0x7f74681c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746f3b2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7468139170 0x7f746811e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746f3b2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74680a1a50 con 0x7f746809d6f0 2023-09-30T22:31:57.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746f3b2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7468121d20 con 0x7f7468139170 2023-09-30T22:31:57.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746f3b2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f746809c710 con 0x7f746809e1d0 2023-09-30T22:31:57.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746c94d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746809e1d0 0x7f74681c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746c94d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746809e1d0 0x7f74681c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55928/0 (socket says 172.21.15.59:55928) 2023-09-30T22:31:57.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746c94d700 1 -- 172.21.15.59:0/1008567239 learned_addr learned my addr 172.21.15.59:0/1008567239 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:57.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746d14e700 1 --2- 172.21.15.59:0/1008567239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746809d6f0 0x7f74681c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746d94f700 1 --2- 172.21.15.59:0/1008567239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7468139170 0x7f746811e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746c94d700 1 -- 172.21.15.59:0/1008567239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7468139170 msgr2=0x7f746811e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746c94d700 1 --2- 172.21.15.59:0/1008567239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7468139170 0x7f746811e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746c94d700 1 -- 172.21.15.59:0/1008567239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746809d6f0 msgr2=0x7f74681c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746c94d700 1 --2- 172.21.15.59:0/1008567239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746809d6f0 0x7f74681c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746c94d700 1 -- 172.21.15.59:0/1008567239 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7460009a70 con 0x7f746809e1d0 2023-09-30T22:31:57.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746d14e700 1 --2- 172.21.15.59:0/1008567239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746809d6f0 0x7f74681c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:57.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.325+0000 7f746d94f700 1 --2- 172.21.15.59:0/1008567239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7468139170 0x7f746811e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:57.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.326+0000 7f746c94d700 1 --2- 172.21.15.59:0/1008567239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746809e1d0 0x7f74681c8a30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7458009c70 tx=0x7f7458004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:57.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.326+0000 7f745dffb700 1 -- 172.21.15.59:0/1008567239 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458004300 con 0x7f746809e1d0 2023-09-30T22:31:57.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.326+0000 7f745dffb700 1 -- 172.21.15.59:0/1008567239 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745801f070 con 0x7f746809e1d0 2023-09-30T22:31:57.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.326+0000 7f746f3b2700 1 -- 172.21.15.59:0/1008567239 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7458009550 con 0x7f746809e1d0 2023-09-30T22:31:57.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.326+0000 7f745dffb700 1 -- 172.21.15.59:0/1008567239 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74580036a0 con 0x7f746809e1d0 2023-09-30T22:31:57.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.326+0000 7f746f3b2700 1 -- 172.21.15.59:0/1008567239 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7468122a50 con 0x7f746809e1d0 2023-09-30T22:31:57.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.328+0000 7f745dffb700 1 -- 172.21.15.59:0/1008567239 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7458021030 con 0x7f746809e1d0 2023-09-30T22:31:57.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.328+0000 7f746f3b2700 1 -- 172.21.15.59:0/1008567239 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7468121eb0 con 0x7f746809e1d0 2023-09-30T22:31:57.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.328+0000 7f745dffb700 1 -- 172.21.15.59:0/1008567239 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f74580408d0 con 0x7f746809e1d0 2023-09-30T22:31:57.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.337+0000 7f745dffb700 1 -- 172.21.15.59:0/1008567239 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7468121eb0 con 0x7f746809e1d0 2023-09-30T22:31:57.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.386+0000 7fa6ff880700 1 Processor -- start 2023-09-30T22:31:57.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.387+0000 7fa6ff880700 1 -- start start 2023-09-30T22:31:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.387+0000 7fa6ff880700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6f81338a0 0x7fa6f8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.387+0000 7fa6ff880700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6f809de50 0x7fa6f809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.387+0000 7fa6ff880700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f806ef30 con 0x7fa6f809e760 2023-09-30T22:31:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.387+0000 7fa6ff880700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f806fef0 con 0x7fa6f809de50 2023-09-30T22:31:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.387+0000 7fa6ff880700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f81334b0 con 0x7fa6f81338a0 2023-09-30T22:31:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.388+0000 7fa6fce1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6f809de50 0x7fa6f809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.388+0000 7fa6fce1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6f809de50 0x7fa6f809e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49386/0 (socket says 172.21.15.59:49386) 2023-09-30T22:31:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.388+0000 7fa6fce1b700 1 -- 172.21.15.59:0/1470385885 learned_addr learned my addr 172.21.15.59:0/1470385885 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:57.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.388+0000 7fa6fd61c700 1 --2- 172.21.15.59:0/1470385885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6f81338a0 0x7fa6f8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.388+0000 7fa6fce1b700 1 -- 172.21.15.59:0/1470385885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6f81338a0 msgr2=0x7fa6f8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:57.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.388+0000 7fa6fce1b700 1 --2- 172.21.15.59:0/1470385885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6f81338a0 0x7fa6f8133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.388+0000 7fa6fce1b700 1 -- 172.21.15.59:0/1470385885 >> v1:172.21.15.59:6789/0 conn(0x7fa6f809e760 legacy=0x7fa6f813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.388+0000 7fa6fce1b700 1 -- 172.21.15.59:0/1470385885 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f806fc30 con 0x7fa6f809de50 2023-09-30T22:31:57.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.388+0000 7fa6fd61c700 1 --2- 172.21.15.59:0/1470385885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6f81338a0 0x7fa6f8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:57.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.388+0000 7fa6fce1b700 1 --2- 172.21.15.59:0/1470385885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6f809de50 0x7fa6f809e220 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009920 tx=0x7fa6e8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91f78d865efd1da6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:57.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.389+0000 7fa6effff700 1 -- 172.21.15.59:0/1470385885 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8011830 con 0x7fa6f809de50 2023-09-30T22:31:57.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.389+0000 7fa6effff700 1 -- 172.21.15.59:0/1470385885 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e8011990 con 0x7fa6f809de50 2023-09-30T22:31:57.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.389+0000 7fa6effff700 1 -- 172.21.15.59:0/1470385885 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8011d20 con 0x7fa6f809de50 2023-09-30T22:31:57.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.390+0000 7fa6ff880700 1 -- 172.21.15.59:0/1470385885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6f809de50 msgr2=0x7fa6f809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.390+0000 7fa6ff880700 1 --2- 172.21.15.59:0/1470385885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6f809de50 0x7fa6f809e220 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009920 tx=0x7fa6e8009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:57.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.390+0000 7fa6ff880700 1 -- 172.21.15.59:0/1470385885 shutdown_connections 2023-09-30T22:31:57.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.390+0000 7fa6ff880700 1 --2- 172.21.15.59:0/1470385885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6f81338a0 0x7fa6f8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.390+0000 7fa6ff880700 1 --2- 172.21.15.59:0/1470385885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6f809de50 0x7fa6f809e220 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.390+0000 7fa6ff880700 1 -- 172.21.15.59:0/1470385885 >> 172.21.15.59:0/1470385885 conn(0x7fa6f80a2aa0 msgr2=0x7fa6f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:57.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.390+0000 7fa6ff880700 1 -- 172.21.15.59:0/1470385885 shutdown_connections 2023-09-30T22:31:57.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.390+0000 7fa6ff880700 1 -- 172.21.15.59:0/1470385885 wait complete. 2023-09-30T22:31:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.391+0000 7fa6ff880700 1 Processor -- start 2023-09-30T22:31:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.391+0000 7fa6ff880700 1 -- start start 2023-09-30T22:31:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.392+0000 7fa6ff880700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f809de50 0x7fa6f811fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.392+0000 7fa6ff880700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6f809e760 0x7fa6f811ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.392+0000 7fa6ff880700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6f81338a0 0x7fa6f8120490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.392+0000 7fa6ff880700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80a1270 con 0x7fa6f809de50 2023-09-30T22:31:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.392+0000 7fa6ff880700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f8121730 con 0x7fa6f809e760 2023-09-30T22:31:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.392+0000 7fa6ff880700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f806f640 con 0x7fa6f81338a0 2023-09-30T22:31:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.392+0000 7fa6fd61c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f809de50 0x7fa6f811fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.392+0000 7fa6fce1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6f809e760 0x7fa6f811ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.392+0000 7fa6fd61c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f809de50 0x7fa6f811fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55128/0 (socket says 172.21.15.59:55128) 2023-09-30T22:31:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.392+0000 7fa6fd61c700 1 -- 172.21.15.59:0/3454071683 learned_addr learned my addr 172.21.15.59:0/3454071683 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.392+0000 7fa6fde1d700 1 --2- 172.21.15.59:0/3454071683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6f81338a0 0x7fa6f8120490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.393+0000 7fa6fd61c700 1 -- 172.21.15.59:0/3454071683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6f81338a0 msgr2=0x7fa6f8120490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.393+0000 7fa6fd61c700 1 --2- 172.21.15.59:0/3454071683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6f81338a0 0x7fa6f8120490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.393+0000 7fa6fd61c700 1 -- 172.21.15.59:0/3454071683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6f809e760 msgr2=0x7fa6f811ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.393+0000 7fa6fd61c700 1 --2- 172.21.15.59:0/3454071683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6f809e760 0x7fa6f811ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.393+0000 7fa6fd61c700 1 -- 172.21.15.59:0/3454071683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f40094a0 con 0x7fa6f809de50 2023-09-30T22:31:57.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.393+0000 7fa6fce1b700 1 --2- 172.21.15.59:0/3454071683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6f809e760 0x7fa6f811ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:57.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.393+0000 7fa6fd61c700 1 --2- 172.21.15.59:0/3454071683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f809de50 0x7fa6f811fa10 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400ebe0 tx=0x7fa6f400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:57.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.393+0000 7fa6edffb700 1 -- 172.21.15.59:0/3454071683 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f400c850 con 0x7fa6f809de50 2023-09-30T22:31:57.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.393+0000 7fa6ff880700 1 -- 172.21.15.59:0/3454071683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e8009550 con 0x7fa6f809de50 2023-09-30T22:31:57.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.393+0000 7fa6ff880700 1 -- 172.21.15.59:0/3454071683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f8122fe0 con 0x7fa6f809de50 2023-09-30T22:31:57.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.394+0000 7fa6edffb700 1 -- 172.21.15.59:0/3454071683 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f400c9b0 con 0x7fa6f809de50 2023-09-30T22:31:57.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.394+0000 7fa6edffb700 1 -- 172.21.15.59:0/3454071683 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f400cd40 con 0x7fa6f809de50 2023-09-30T22:31:57.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.394+0000 7fa6edffb700 1 -- 172.21.15.59:0/3454071683 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6f4013470 con 0x7fa6f809de50 2023-09-30T22:31:57.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.395+0000 7fa6edffb700 1 -- 172.21.15.59:0/3454071683 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa6f403fd30 con 0x7fa6f809de50 2023-09-30T22:31:57.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.395+0000 7fa6ff880700 1 -- 172.21.15.59:0/3454071683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d80052e0 con 0x7fa6f809de50 2023-09-30T22:31:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.400+0000 7fa6edffb700 1 -- 172.21.15.59:0/3454071683 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6f4017070 con 0x7fa6f809de50 2023-09-30T22:31:57.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.426+0000 7f1da7f7f700 1 Processor -- start 2023-09-30T22:31:57.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.426+0000 7f1da7f7f700 1 -- start start 2023-09-30T22:31:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.426+0000 7f1da7f7f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1da009d6f0 0x7f1da009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.426+0000 7f1da7f7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1da009e000 0x7f1da01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.426+0000 7f1da7f7f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da009e410 0x7f1da0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.427+0000 7f1da7f7f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da006b460 con 0x7f1da009d6f0 2023-09-30T22:31:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.427+0000 7f1da7f7f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da009b120 con 0x7f1da009e410 2023-09-30T22:31:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.427+0000 7f1da7f7f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1da009a7e0 con 0x7f1da009e000 2023-09-30T22:31:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.427+0000 7f1da5d1b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1da009d6f0 0x7f1da009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.427+0000 7f1da5d1b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1da009d6f0 0x7f1da009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55138/0 (socket says 172.21.15.59:55138) 2023-09-30T22:31:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.427+0000 7f1da551a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1da009e000 0x7f1da01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.427+0000 7f1da5d1b700 1 -- 172.21.15.59:0/2422206798 learned_addr learned my addr 172.21.15.59:0/2422206798 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.427+0000 7f1da651c700 1 --2- 172.21.15.59:0/2422206798 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da009e410 0x7f1da0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.427+0000 7f1da5d1b700 1 -- 172.21.15.59:0/2422206798 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1da009e000 msgr2=0x7f1da01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.427+0000 7f1da5d1b700 1 --2- 172.21.15.59:0/2422206798 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1da009e000 0x7f1da01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.427+0000 7f1da5d1b700 1 -- 172.21.15.59:0/2422206798 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da009e410 msgr2=0x7f1da0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.427+0000 7f1da5d1b700 1 --2- 172.21.15.59:0/2422206798 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da009e410 0x7f1da0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.427+0000 7f1da5d1b700 1 -- 172.21.15.59:0/2422206798 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da009a500 con 0x7f1da009d6f0 2023-09-30T22:31:57.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.427+0000 7f1da5d1b700 1 --2- 172.21.15.59:0/2422206798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da009d6f0 0x7f1da009dac0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0098f0 tx=0x7f1d9c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de90d7d5f4545aa5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.428+0000 7f1da4d19700 1 -- 172.21.15.59:0/2422206798 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c011830 con 0x7f1da009d6f0 2023-09-30T22:31:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.428+0000 7f1da4d19700 1 -- 172.21.15.59:0/2422206798 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c011990 con 0x7f1da009d6f0 2023-09-30T22:31:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.428+0000 7f1da4d19700 1 -- 172.21.15.59:0/2422206798 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c011d20 con 0x7f1da009d6f0 2023-09-30T22:31:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.428+0000 7f1da7f7f700 1 -- 172.21.15.59:0/2422206798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da009d6f0 msgr2=0x7f1da009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.428+0000 7f1da7f7f700 1 --2- 172.21.15.59:0/2422206798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da009d6f0 0x7f1da009dac0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0098f0 tx=0x7f1d9c009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.428+0000 7f1da7f7f700 1 -- 172.21.15.59:0/2422206798 shutdown_connections 2023-09-30T22:31:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.428+0000 7f1da7f7f700 1 --2- 172.21.15.59:0/2422206798 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da009e410 0x7f1da0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.428+0000 7f1da7f7f700 1 --2- 172.21.15.59:0/2422206798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da009d6f0 0x7f1da009dac0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.428+0000 7f1da7f7f700 1 --2- 172.21.15.59:0/2422206798 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1da009e000 0x7f1da01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.428+0000 7f1da7f7f700 1 -- 172.21.15.59:0/2422206798 >> 172.21.15.59:0/2422206798 conn(0x7f1da0066f50 msgr2=0x7f1da009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.428+0000 7f1da7f7f700 1 -- 172.21.15.59:0/2422206798 shutdown_connections 2023-09-30T22:31:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.429+0000 7f1da7f7f700 1 -- 172.21.15.59:0/2422206798 wait complete. 2023-09-30T22:31:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.430+0000 7f1da7f7f700 1 Processor -- start 2023-09-30T22:31:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.430+0000 7f1da7f7f700 1 -- start start 2023-09-30T22:31:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.430+0000 7f118b889700 1 Processor -- start 2023-09-30T22:31:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.430+0000 7f118b889700 1 -- start start 2023-09-30T22:31:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.430+0000 7f1da7f7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1da009d6f0 0x7f1da01a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.430+0000 7f1da7f7f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da009e000 0x7f1da01a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1da7f7f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da009e410 0x7f1da01a6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1da7f7f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da01a9870 con 0x7f1da009e000 2023-09-30T22:31:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1da7f7f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da01aa210 con 0x7f1da009e410 2023-09-30T22:31:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1da7f7f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1da01a9000 con 0x7f1da009d6f0 2023-09-30T22:31:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1da651c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da009e410 0x7f1da01a6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1da651c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da009e410 0x7f1da01a6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49418/0 (socket says 172.21.15.59:49418) 2023-09-30T22:31:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1da651c700 1 -- 172.21.15.59:0/3777367470 learned_addr learned my addr 172.21.15.59:0/3777367470 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1da651c700 1 -- 172.21.15.59:0/3777367470 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1da009d6f0 msgr2=0x7f1da01a5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1da651c700 1 --2- 172.21.15.59:0/3777367470 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1da009d6f0 0x7f1da01a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1da651c700 1 -- 172.21.15.59:0/3777367470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da009e000 msgr2=0x7f1da01a62e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:31:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1da651c700 1 --2- 172.21.15.59:0/3777367470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da009e000 0x7f1da01a62e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1da651c700 1 -- 172.21.15.59:0/3777367470 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c009550 con 0x7f1da009e410 2023-09-30T22:31:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f118b889700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1184131630 0x7f1184131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f118b889700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1184131f40 0x7f118406e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f118b889700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1184071a00 con 0x7f118406e9d0 2023-09-30T22:31:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f118b889700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1184131430 con 0x7f1184131630 2023-09-30T22:31:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f118b889700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f118409a510 con 0x7f1184131f40 2023-09-30T22:31:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1189625700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1184131630 0x7f1184131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1189625700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1184131630 0x7f1184131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49426/0 (socket says 172.21.15.59:49426) 2023-09-30T22:31:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1189625700 1 -- 172.21.15.59:0/3479109389 learned_addr learned my addr 172.21.15.59:0/3479109389 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:57.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.431+0000 7f1da651c700 1 --2- 172.21.15.59:0/3777367470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da009e410 0x7f1da01a6820 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800efc0 tx=0x7f1d9800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:57.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.432+0000 7f1189625700 1 -- 172.21.15.59:0/3479109389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1184131f40 msgr2=0x7f118406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.432+0000 7f1189625700 1 --2- 172.21.15.59:0/3479109389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1184131f40 0x7f118406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.432+0000 7f1189625700 1 -- 172.21.15.59:0/3479109389 >> v1:172.21.15.59:6789/0 conn(0x7f118406e9d0 legacy=0x7f1184138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.432+0000 7f1d967fc700 1 -- 172.21.15.59:0/3777367470 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9800cd40 con 0x7f1da009e410 2023-09-30T22:31:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.432+0000 7f1189625700 1 -- 172.21.15.59:0/3479109389 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11840721c0 con 0x7f1184131630 2023-09-30T22:31:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.432+0000 7f1d967fc700 1 -- 172.21.15.59:0/3777367470 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9800f040 con 0x7f1da009e410 2023-09-30T22:31:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.432+0000 7f1d967fc700 1 -- 172.21.15.59:0/3777367470 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d980146c0 con 0x7f1da009e410 2023-09-30T22:31:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.432+0000 7f1189625700 1 --2- 172.21.15.59:0/3479109389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1184131630 0x7f1184131a00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1180009920 tx=0x7f1180009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5703f90b2f983fae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:57.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.432+0000 7f117bfff700 1 -- 172.21.15.59:0/3479109389 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118000ba60 con 0x7f1184131630 2023-09-30T22:31:57.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.432+0000 7f117bfff700 1 -- 172.21.15.59:0/3479109389 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118000bbc0 con 0x7f1184131630 2023-09-30T22:31:57.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.432+0000 7f117bfff700 1 -- 172.21.15.59:0/3479109389 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180009e70 con 0x7f1184131630 2023-09-30T22:31:57.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.433+0000 7f1da7f7f700 1 -- 172.21.15.59:0/3777367470 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da00a2160 con 0x7f1da009e410 2023-09-30T22:31:57.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.433+0000 7f1da7f7f700 1 -- 172.21.15.59:0/3777367470 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da01a7960 con 0x7f1da009e410 2023-09-30T22:31:57.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.433+0000 7f118b889700 1 -- 172.21.15.59:0/3479109389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1184131630 msgr2=0x7f1184131a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.433+0000 7f118b889700 1 --2- 172.21.15.59:0/3479109389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1184131630 0x7f1184131a00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1180009920 tx=0x7f1180009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:57.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.433+0000 7f118b889700 1 -- 172.21.15.59:0/3479109389 shutdown_connections 2023-09-30T22:31:57.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.433+0000 7f118b889700 1 --2- 172.21.15.59:0/3479109389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1184131630 0x7f1184131a00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.433+0000 7f118b889700 1 --2- 172.21.15.59:0/3479109389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1184131f40 0x7f118406e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.433+0000 7f118b889700 1 -- 172.21.15.59:0/3479109389 >> 172.21.15.59:0/3479109389 conn(0x7f11840a2aa0 msgr2=0x7f11840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:57.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.433+0000 7f118b889700 1 -- 172.21.15.59:0/3479109389 shutdown_connections 2023-09-30T22:31:57.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.434+0000 7f118b889700 1 -- 172.21.15.59:0/3479109389 wait complete. 2023-09-30T22:31:57.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.434+0000 7f1d967fc700 1 -- 172.21.15.59:0/3777367470 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d98014820 con 0x7f1da009e410 2023-09-30T22:31:57.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.434+0000 7f1da7f7f700 1 -- 172.21.15.59:0/3777367470 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da0074ea0 con 0x7f1da009e410 2023-09-30T22:31:57.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.434+0000 7f1d967fc700 1 -- 172.21.15.59:0/3777367470 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1d9803ffd0 con 0x7f1da009e410 2023-09-30T22:31:57.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.435+0000 7f118b889700 1 Processor -- start 2023-09-30T22:31:57.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.435+0000 7f118b889700 1 -- start start 2023-09-30T22:31:57.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f118b889700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f118406e9d0 0x7f11841c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f118b889700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1184131f40 0x7f11841c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f118b889700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11841c8fa0 0x7f11841c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f118b889700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1184122760 con 0x7f118406e9d0 2023-09-30T22:31:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f118b889700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1184121b60 con 0x7f1184131f40 2023-09-30T22:31:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f118b889700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1184120df0 con 0x7f11841c8fa0 2023-09-30T22:31:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f1188e24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1184131f40 0x7f11841c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f1188e24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1184131f40 0x7f11841c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49428/0 (socket says 172.21.15.59:49428) 2023-09-30T22:31:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f1188e24700 1 -- 172.21.15.59:0/3531339316 learned_addr learned my addr 172.21.15.59:0/3531339316 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f1189625700 1 --2- 172.21.15.59:0/3531339316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f118406e9d0 0x7f11841c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f1188e24700 1 -- 172.21.15.59:0/3531339316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11841c8fa0 msgr2=0x7f11841c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f1188e24700 1 --2- 172.21.15.59:0/3531339316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11841c8fa0 0x7f11841c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f1188e24700 1 -- 172.21.15.59:0/3531339316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f118406e9d0 msgr2=0x7f11841c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f1188e24700 1 --2- 172.21.15.59:0/3531339316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f118406e9d0 0x7f11841c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f1188e24700 1 -- 172.21.15.59:0/3531339316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1180009550 con 0x7f1184131f40 2023-09-30T22:31:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.436+0000 7f1188e24700 1 --2- 172.21.15.59:0/3531339316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1184131f40 0x7f11841c8a60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f117400b560 tx=0x7f117400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.443+0000 7f1179ffb700 1 -- 172.21.15.59:0/3531339316 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174011830 con 0x7f1184131f40 2023-09-30T22:31:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.443+0000 7f1179ffb700 1 -- 172.21.15.59:0/3531339316 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11740119b0 con 0x7f1184131f40 2023-09-30T22:31:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.443+0000 7f1179ffb700 1 -- 172.21.15.59:0/3531339316 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174011d60 con 0x7f1184131f40 2023-09-30T22:31:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.443+0000 7f118b889700 1 -- 172.21.15.59:0/3531339316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118411f630 con 0x7f1184131f40 2023-09-30T22:31:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.443+0000 7f1d967fc700 1 -- 172.21.15.59:0/3777367470 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d98018070 con 0x7f1da009e410 2023-09-30T22:31:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.443+0000 7f118b889700 1 -- 172.21.15.59:0/3531339316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1184099f20 con 0x7f1184131f40 2023-09-30T22:31:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.444+0000 7f1179ffb700 1 -- 172.21.15.59:0/3531339316 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f117401a400 con 0x7f1184131f40 2023-09-30T22:31:57.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.444+0000 7f1179ffb700 1 -- 172.21.15.59:0/3531339316 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f117403f540 con 0x7f1184131f40 2023-09-30T22:31:57.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.445+0000 7f118b889700 1 -- 172.21.15.59:0/3531339316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118411f630 con 0x7f1184131f40 2023-09-30T22:31:57.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.454+0000 7f1179ffb700 1 -- 172.21.15.59:0/3531339316 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f118411f630 con 0x7f1184131f40 2023-09-30T22:31:57.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.572+0000 7f746f3b2700 1 -- 172.21.15.59:0/1008567239 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f746809f420 con 0x7f746809e1d0 2023-09-30T22:31:57.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.573+0000 7f745dffb700 1 -- 172.21.15.59:0/1008567239 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7458015030 con 0x7f746809e1d0 2023-09-30T22:31:57.573 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:57.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.575+0000 7f746f3b2700 1 -- 172.21.15.59:0/1008567239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746809e1d0 msgr2=0x7f74681c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.575+0000 7f746f3b2700 1 --2- 172.21.15.59:0/1008567239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746809e1d0 0x7f74681c8a30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7458009c70 tx=0x7f7458004750 comp rx=0 tx=0).stop 2023-09-30T22:31:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.575+0000 7f746f3b2700 1 -- 172.21.15.59:0/1008567239 shutdown_connections 2023-09-30T22:31:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.575+0000 7f746f3b2700 1 --2- 172.21.15.59:0/1008567239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7468139170 0x7f746811e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.575+0000 7f746f3b2700 1 --2- 172.21.15.59:0/1008567239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746809d6f0 0x7f74681c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.575+0000 7f746f3b2700 1 --2- 172.21.15.59:0/1008567239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f746809e1d0 0x7f74681c8a30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.575+0000 7f746f3b2700 1 -- 172.21.15.59:0/1008567239 >> 172.21.15.59:0/1008567239 conn(0x7f7468066f50 msgr2=0x7f746809b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.575+0000 7f746f3b2700 1 -- 172.21.15.59:0/1008567239 shutdown_connections 2023-09-30T22:31:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.575+0000 7f746f3b2700 1 -- 172.21.15.59:0/1008567239 wait complete. 2023-09-30T22:31:57.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:57.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.645+0000 7fa6ff880700 1 -- 172.21.15.59:0/3454071683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa6d8005590 con 0x7fa6f809de50 2023-09-30T22:31:57.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.646+0000 7fa6edffb700 1 -- 172.21.15.59:0/3454071683 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6f4013720 con 0x7fa6f809de50 2023-09-30T22:31:57.646 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:57.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.648+0000 7fa6ff880700 1 -- 172.21.15.59:0/3454071683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f809de50 msgr2=0x7fa6f811fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.648+0000 7fa6ff880700 1 --2- 172.21.15.59:0/3454071683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f809de50 0x7fa6f811fa10 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400ebe0 tx=0x7fa6f400eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.648+0000 7fa6ff880700 1 -- 172.21.15.59:0/3454071683 shutdown_connections 2023-09-30T22:31:57.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.648+0000 7fa6ff880700 1 --2- 172.21.15.59:0/3454071683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6f81338a0 0x7fa6f8120490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.648+0000 7fa6ff880700 1 --2- 172.21.15.59:0/3454071683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f809de50 0x7fa6f811fa10 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.648+0000 7fa6ff880700 1 --2- 172.21.15.59:0/3454071683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6f809e760 0x7fa6f811ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.648+0000 7fa6ff880700 1 -- 172.21.15.59:0/3454071683 >> 172.21.15.59:0/3454071683 conn(0x7fa6f80a2aa0 msgr2=0x7fa6f809ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:57.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.648+0000 7fa6ff880700 1 -- 172.21.15.59:0/3454071683 shutdown_connections 2023-09-30T22:31:57.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.648+0000 7fa6ff880700 1 -- 172.21.15.59:0/3454071683 wait complete. 2023-09-30T22:31:57.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.653+0000 7f1da7f7f700 1 -- 172.21.15.59:0/3777367470 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1da01a8bb0 con 0x7f1da009e410 2023-09-30T22:31:57.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.653+0000 7f1d967fc700 1 -- 172.21.15.59:0/3777367470 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d9801a8b0 con 0x7f1da009e410 2023-09-30T22:31:57.653 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.656+0000 7f1da7f7f700 1 -- 172.21.15.59:0/3777367470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da009e410 msgr2=0x7f1da01a6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.656+0000 7f1da7f7f700 1 --2- 172.21.15.59:0/3777367470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da009e410 0x7f1da01a6820 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800efc0 tx=0x7f1d9800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.657+0000 7f1da7f7f700 1 -- 172.21.15.59:0/3777367470 shutdown_connections 2023-09-30T22:31:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.657+0000 7f1da7f7f700 1 --2- 172.21.15.59:0/3777367470 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1da009d6f0 0x7f1da01a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.657+0000 7f1da7f7f700 1 --2- 172.21.15.59:0/3777367470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da009e410 0x7f1da01a6820 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.657+0000 7f1da7f7f700 1 --2- 172.21.15.59:0/3777367470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da009e000 0x7f1da01a62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.657+0000 7f1da7f7f700 1 -- 172.21.15.59:0/3777367470 >> 172.21.15.59:0/3777367470 conn(0x7f1da0066f50 msgr2=0x7f1da01bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:57.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.657+0000 7f1da7f7f700 1 -- 172.21.15.59:0/3777367470 shutdown_connections 2023-09-30T22:31:57.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.657+0000 7f1da7f7f700 1 -- 172.21.15.59:0/3777367470 wait complete. 2023-09-30T22:31:57.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:57.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:57.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.705+0000 7f118b889700 1 -- 172.21.15.59:0/3531339316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f118411f630 con 0x7f1184131f40 2023-09-30T22:31:57.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.706+0000 7f1179ffb700 1 -- 172.21.15.59:0/3531339316 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f118411f630 con 0x7f1184131f40 2023-09-30T22:31:57.706 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.708+0000 7f118b889700 1 -- 172.21.15.59:0/3531339316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1184131f40 msgr2=0x7f11841c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.708+0000 7f118b889700 1 --2- 172.21.15.59:0/3531339316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1184131f40 0x7f11841c8a60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f117400b560 tx=0x7f117400b870 comp rx=0 tx=0).stop 2023-09-30T22:31:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.708+0000 7f118b889700 1 -- 172.21.15.59:0/3531339316 shutdown_connections 2023-09-30T22:31:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.708+0000 7f118b889700 1 --2- 172.21.15.59:0/3531339316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11841c8fa0 0x7f11841c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.708+0000 7f118b889700 1 --2- 172.21.15.59:0/3531339316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f118406e9d0 0x7f11841c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.708+0000 7f118b889700 1 --2- 172.21.15.59:0/3531339316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1184131f40 0x7f11841c8a60 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.708+0000 7f118b889700 1 -- 172.21.15.59:0/3531339316 >> 172.21.15.59:0/3531339316 conn(0x7f11840a2aa0 msgr2=0x7f11840a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.709+0000 7f118b889700 1 -- 172.21.15.59:0/3531339316 shutdown_connections 2023-09-30T22:31:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:57.709+0000 7f118b889700 1 -- 172.21.15.59:0/3531339316 wait complete. 2023-09-30T22:31:57.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:31:58.590 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:58.664 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:58.676 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:58.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.740+0000 7fb595dcc700 1 Processor -- start 2023-09-30T22:31:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.740+0000 7fb595dcc700 1 -- start start 2023-09-30T22:31:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.740+0000 7fb595dcc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb590133b10 0x7fb590133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.740+0000 7fb595dcc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59009e9b0 0x7fb59013b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.740+0000 7fb595dcc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5901334b0 con 0x7fb59009de50 2023-09-30T22:31:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.740+0000 7fb595dcc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59006fcb0 con 0x7fb590133b10 2023-09-30T22:31:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.740+0000 7fb595dcc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb590134420 con 0x7fb59009e9b0 2023-09-30T22:31:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.741+0000 7fb58ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59009e9b0 0x7fb59013b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.741+0000 7fb58f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb590133b10 0x7fb590133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.741+0000 7fb58ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59009e9b0 0x7fb59013b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55998/0 (socket says 172.21.15.59:55998) 2023-09-30T22:31:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.741+0000 7fb58ffff700 1 -- 172.21.15.59:0/76917970 learned_addr learned my addr 172.21.15.59:0/76917970 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.741+0000 7fb58ffff700 1 -- 172.21.15.59:0/76917970 >> v2:172.21.15.59:3300/0 conn(0x7fb590133b10 msgr2=0x7fb590133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.741+0000 7fb58ffff700 1 --2- 172.21.15.59:0/76917970 >> v2:172.21.15.59:3300/0 conn(0x7fb590133b10 0x7fb590133ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.741+0000 7fb58ffff700 1 -- 172.21.15.59:0/76917970 >> v1:172.21.15.59:6789/0 conn(0x7fb59009de50 legacy=0x7fb59009e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.741+0000 7fb58ffff700 1 -- 172.21.15.59:0/76917970 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb590070bc0 con 0x7fb59009e9b0 2023-09-30T22:31:58.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.741+0000 7fb58ffff700 1 --2- 172.21.15.59:0/76917970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59009e9b0 0x7fb59013b7f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb588009e50 tx=0x7fb58800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb4153730e98c582 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:58.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.741+0000 7fb58e7fc700 1 -- 172.21.15.59:0/76917970 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58800e070 con 0x7fb59009e9b0 2023-09-30T22:31:58.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.741+0000 7fb58e7fc700 1 -- 172.21.15.59:0/76917970 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58800b910 con 0x7fb59009e9b0 2023-09-30T22:31:58.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.742+0000 7fb58e7fc700 1 -- 172.21.15.59:0/76917970 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58800bcc0 con 0x7fb59009e9b0 2023-09-30T22:31:58.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.742+0000 7fb595dcc700 1 -- 172.21.15.59:0/76917970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59009e9b0 msgr2=0x7fb59013b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.742+0000 7fb595dcc700 1 --2- 172.21.15.59:0/76917970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59009e9b0 0x7fb59013b7f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb588009e50 tx=0x7fb58800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:58.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.742+0000 7fb595dcc700 1 -- 172.21.15.59:0/76917970 shutdown_connections 2023-09-30T22:31:58.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.742+0000 7fb595dcc700 1 --2- 172.21.15.59:0/76917970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59009e9b0 0x7fb59013b7f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.742+0000 7fb595dcc700 1 --2- 172.21.15.59:0/76917970 >> v2:172.21.15.59:3300/0 conn(0x7fb590133b10 0x7fb590133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.743+0000 7fb595dcc700 1 -- 172.21.15.59:0/76917970 >> 172.21.15.59:0/76917970 conn(0x7fb5900a2aa0 msgr2=0x7fb5900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.743+0000 7fb595dcc700 1 -- 172.21.15.59:0/76917970 shutdown_connections 2023-09-30T22:31:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.743+0000 7fb595dcc700 1 -- 172.21.15.59:0/76917970 wait complete. 2023-09-30T22:31:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.744+0000 7fb595dcc700 1 Processor -- start 2023-09-30T22:31:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.744+0000 7fb595dcc700 1 -- start start 2023-09-30T22:31:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.744+0000 7fb595dcc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009de50 0x7fb5901c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.744+0000 7fb595dcc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59009e9b0 0x7fb5901c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.745+0000 7fb595dcc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb590133b10 0x7fb59011fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.745+0000 7fb595dcc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb590121a40 con 0x7fb59009de50 2023-09-30T22:31:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.745+0000 7fb595dcc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb590130840 con 0x7fb59009e9b0 2023-09-30T22:31:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.745+0000 7fb595dcc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5901232a0 con 0x7fb590133b10 2023-09-30T22:31:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.745+0000 7fb58f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009de50 0x7fb5901c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.745+0000 7fb58f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009de50 0x7fb5901c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55182/0 (socket says 172.21.15.59:55182) 2023-09-30T22:31:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.745+0000 7fb58f7fe700 1 -- 172.21.15.59:0/4280422952 learned_addr learned my addr 172.21.15.59:0/4280422952 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.745+0000 7fb58ffff700 1 --2- 172.21.15.59:0/4280422952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb590133b10 0x7fb59011fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.745+0000 7fb58ffff700 1 -- 172.21.15.59:0/4280422952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59009e9b0 msgr2=0x7fb5901c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.745+0000 7fb58ffff700 1 --2- 172.21.15.59:0/4280422952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59009e9b0 0x7fb5901c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.745+0000 7fb58ffff700 1 -- 172.21.15.59:0/4280422952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009de50 msgr2=0x7fb5901c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.745+0000 7fb58ffff700 1 --2- 172.21.15.59:0/4280422952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009de50 0x7fb5901c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.745+0000 7fb58ffff700 1 -- 172.21.15.59:0/4280422952 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb588009b30 con 0x7fb590133b10 2023-09-30T22:31:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.745+0000 7fb58ffff700 1 --2- 172.21.15.59:0/4280422952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb590133b10 0x7fb59011fd20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb588015000 tx=0x7fb588004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.746+0000 7fb577fff700 1 -- 172.21.15.59:0/4280422952 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5880092e0 con 0x7fb590133b10 2023-09-30T22:31:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.746+0000 7fb577fff700 1 -- 172.21.15.59:0/4280422952 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb588004250 con 0x7fb590133b10 2023-09-30T22:31:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.746+0000 7fb595dcc700 1 -- 172.21.15.59:0/4280422952 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb590123560 con 0x7fb590133b10 2023-09-30T22:31:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.746+0000 7fb577fff700 1 -- 172.21.15.59:0/4280422952 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5880045e0 con 0x7fb590133b10 2023-09-30T22:31:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.746+0000 7fb595dcc700 1 -- 172.21.15.59:0/4280422952 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5901c9380 con 0x7fb590133b10 2023-09-30T22:31:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.747+0000 7fb577fff700 1 -- 172.21.15.59:0/4280422952 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb588004740 con 0x7fb590133b10 2023-09-30T22:31:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.747+0000 7fb577fff700 1 -- 172.21.15.59:0/4280422952 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb588044210 con 0x7fb590133b10 2023-09-30T22:31:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.747+0000 7fb595dcc700 1 -- 172.21.15.59:0/4280422952 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5901315d0 con 0x7fb590133b10 2023-09-30T22:31:58.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.752+0000 7fb577fff700 1 -- 172.21.15.59:0/4280422952 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb588020020 con 0x7fb590133b10 2023-09-30T22:31:58.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.821+0000 7f983a3b8700 1 Processor -- start 2023-09-30T22:31:58.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.821+0000 7f983a3b8700 1 -- start start 2023-09-30T22:31:58.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.822+0000 7f983a3b8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f983409e930 0x7f983409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.822+0000 7f983a3b8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983409f240 0x7f98341317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.822+0000 7f983a3b8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9834070940 con 0x7f983409f650 2023-09-30T22:31:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.822+0000 7f983a3b8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983406fd60 con 0x7f983409e930 2023-09-30T22:31:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.822+0000 7f983a3b8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f983406fa80 con 0x7f983409f240 2023-09-30T22:31:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.822+0000 7f9833fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f983409e930 0x7f983409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.822+0000 7f98337fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983409f240 0x7f98341317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.822+0000 7f9833fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f983409e930 0x7f983409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55194/0 (socket says 172.21.15.59:55194) 2023-09-30T22:31:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.823+0000 7f98337fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983409f240 0x7f98341317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56026/0 (socket says 172.21.15.59:56026) 2023-09-30T22:31:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.823+0000 7f9833fff700 1 -- 172.21.15.59:0/3107443175 learned_addr learned my addr 172.21.15.59:0/3107443175 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.823+0000 7f98337fe700 1 -- 172.21.15.59:0/3107443175 >> v2:172.21.15.59:3300/0 conn(0x7f983409e930 msgr2=0x7f983409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.823+0000 7f98337fe700 1 --2- 172.21.15.59:0/3107443175 >> v2:172.21.15.59:3300/0 conn(0x7f983409e930 0x7f983409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.823+0000 7f98337fe700 1 -- 172.21.15.59:0/3107443175 >> v1:172.21.15.59:6789/0 conn(0x7f983409f650 legacy=0x7f9834131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.823+0000 7f98337fe700 1 -- 172.21.15.59:0/3107443175 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983409fb60 con 0x7f983409f240 2023-09-30T22:31:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.823+0000 7f9833fff700 1 --2- 172.21.15.59:0/3107443175 >> v2:172.21.15.59:3300/0 conn(0x7f983409e930 0x7f983409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.823+0000 7f98337fe700 1 --2- 172.21.15.59:0/3107443175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983409f240 0x7f98341317f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9828009840 tx=0x7f9828009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa5561628d8760e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.823+0000 7f9832ffd700 1 -- 172.21.15.59:0/3107443175 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828011830 con 0x7f983409f240 2023-09-30T22:31:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.824+0000 7f9832ffd700 1 -- 172.21.15.59:0/3107443175 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9828011990 con 0x7f983409f240 2023-09-30T22:31:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.824+0000 7f9832ffd700 1 -- 172.21.15.59:0/3107443175 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828011d20 con 0x7f983409f240 2023-09-30T22:31:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.824+0000 7f983a3b8700 1 -- 172.21.15.59:0/3107443175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983409f240 msgr2=0x7f98341317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.824+0000 7f983a3b8700 1 --2- 172.21.15.59:0/3107443175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983409f240 0x7f98341317f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9828009840 tx=0x7f9828009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.824+0000 7f983a3b8700 1 -- 172.21.15.59:0/3107443175 shutdown_connections 2023-09-30T22:31:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.824+0000 7f983a3b8700 1 --2- 172.21.15.59:0/3107443175 >> v2:172.21.15.59:3300/0 conn(0x7f983409e930 0x7f983409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.824+0000 7f983a3b8700 1 --2- 172.21.15.59:0/3107443175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983409f240 0x7f98341317f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.824+0000 7f983a3b8700 1 -- 172.21.15.59:0/3107443175 >> 172.21.15.59:0/3107443175 conn(0x7f98340a4210 msgr2=0x7f98340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.824+0000 7f983a3b8700 1 -- 172.21.15.59:0/3107443175 shutdown_connections 2023-09-30T22:31:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.824+0000 7f983a3b8700 1 -- 172.21.15.59:0/3107443175 wait complete. 2023-09-30T22:31:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.826+0000 7f983a3b8700 1 Processor -- start 2023-09-30T22:31:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.826+0000 7f983a3b8700 1 -- start start 2023-09-30T22:31:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.827+0000 7f983a3b8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983409e930 0x7f983406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.827+0000 7f983a3b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983409f240 0x7f983406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.827+0000 7f983a3b8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983409f650 0x7f983406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.827+0000 7f983a3b8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98341b9260 con 0x7f983409f650 2023-09-30T22:31:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.827+0000 7f983a3b8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98341ab410 con 0x7f983409f240 2023-09-30T22:31:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.827+0000 7f983a3b8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98341aa930 con 0x7f983409e930 2023-09-30T22:31:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.827+0000 7f9833fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983409e930 0x7f983406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.827+0000 7f9833fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983409e930 0x7f983406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56042/0 (socket says 172.21.15.59:56042) 2023-09-30T22:31:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.827+0000 7f9833fff700 1 -- 172.21.15.59:0/294148306 learned_addr learned my addr 172.21.15.59:0/294148306 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.827+0000 7f9838955700 1 --2- 172.21.15.59:0/294148306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983409f650 0x7f983406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.827+0000 7f98337fe700 1 --2- 172.21.15.59:0/294148306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983409f240 0x7f983406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.828+0000 7f9833fff700 1 -- 172.21.15.59:0/294148306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983409f240 msgr2=0x7f983406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.828+0000 7f9833fff700 1 --2- 172.21.15.59:0/294148306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983409f240 0x7f983406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.828+0000 7f9833fff700 1 -- 172.21.15.59:0/294148306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983409f650 msgr2=0x7f983406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.828+0000 7f9833fff700 1 --2- 172.21.15.59:0/294148306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983409f650 0x7f983406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.828+0000 7f9833fff700 1 -- 172.21.15.59:0/294148306 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9824009550 con 0x7f983409e930 2023-09-30T22:31:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.828+0000 7f9838955700 1 --2- 172.21.15.59:0/294148306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983409f650 0x7f983406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.828+0000 7f9833fff700 1 --2- 172.21.15.59:0/294148306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983409e930 0x7f983406b8b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f982400ebe0 tx=0x7f982400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.828+0000 7f9830ff9700 1 -- 172.21.15.59:0/294148306 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982400c850 con 0x7f983409e930 2023-09-30T22:31:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.828+0000 7f9830ff9700 1 -- 172.21.15.59:0/294148306 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982400c9b0 con 0x7f983409e930 2023-09-30T22:31:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.828+0000 7f9830ff9700 1 -- 172.21.15.59:0/294148306 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982400cd40 con 0x7f983409e930 2023-09-30T22:31:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.828+0000 7f983a3b8700 1 -- 172.21.15.59:0/294148306 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98280094a0 con 0x7f983409e930 2023-09-30T22:31:58.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.828+0000 7f983a3b8700 1 -- 172.21.15.59:0/294148306 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98340a0190 con 0x7f983409e930 2023-09-30T22:31:58.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.830+0000 7f9830ff9700 1 -- 172.21.15.59:0/294148306 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9824013470 con 0x7f983409e930 2023-09-30T22:31:58.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.830+0000 7f9830ff9700 1 -- 172.21.15.59:0/294148306 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f982403fd10 con 0x7f983409e930 2023-09-30T22:31:58.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.830+0000 7f983a3b8700 1 -- 172.21.15.59:0/294148306 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98341ab1a0 con 0x7f983409e930 2023-09-30T22:31:58.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.839+0000 7f9830ff9700 1 -- 172.21.15.59:0/294148306 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98341ab1a0 con 0x7f983409e930 2023-09-30T22:31:58.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.869+0000 7f149eeb8700 1 Processor -- start 2023-09-30T22:31:58.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.869+0000 7f149eeb8700 1 -- start start 2023-09-30T22:31:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.870+0000 7f149eeb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1498134710 0x7f1498136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.870+0000 7f149eeb8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1498137030 0x7f1498139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.870+0000 7f149eeb8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1498131510 con 0x7f14981316d0 2023-09-30T22:31:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.870+0000 7f149eeb8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1498099e70 con 0x7f1498137030 2023-09-30T22:31:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.870+0000 7f149eeb8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1498066680 con 0x7f1498134710 2023-09-30T22:31:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.870+0000 7f149cc54700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f14981316d0 0x7f1498131aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49868/0 (socket says 172.21.15.59:49868) 2023-09-30T22:31:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.870+0000 7f149cc54700 1 -- 172.21.15.59:0/2141115367 learned_addr learned my addr 172.21.15.59:0/2141115367 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:31:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.870+0000 7f149d455700 1 --2- 172.21.15.59:0/2141115367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1498137030 0x7f1498139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.870+0000 7f149d455700 1 -- 172.21.15.59:0/2141115367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1498134710 msgr2=0x7f1498136af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.870+0000 7f149d455700 1 --2- 172.21.15.59:0/2141115367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1498134710 0x7f1498136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.870+0000 7f149d455700 1 -- 172.21.15.59:0/2141115367 >> v1:172.21.15.59:6789/0 conn(0x7f14981316d0 legacy=0x7f1498131aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.870+0000 7f149d455700 1 -- 172.21.15.59:0/2141115367 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149809ee00 con 0x7f1498137030 2023-09-30T22:31:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.870+0000 7f149d455700 1 --2- 172.21.15.59:0/2141115367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1498137030 0x7f1498139410 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1490009dc0 tx=0x7f149000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6096f4ed2b31649 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.871+0000 7f14977fe700 1 -- 172.21.15.59:0/2141115367 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149000e070 con 0x7f1498137030 2023-09-30T22:31:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.871+0000 7f14977fe700 1 -- 172.21.15.59:0/2141115367 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149000bbd0 con 0x7f1498137030 2023-09-30T22:31:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.871+0000 7f14977fe700 1 -- 172.21.15.59:0/2141115367 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490012430 con 0x7f1498137030 2023-09-30T22:31:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.871+0000 7f149eeb8700 1 -- 172.21.15.59:0/2141115367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1498137030 msgr2=0x7f1498139410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.871+0000 7f149eeb8700 1 --2- 172.21.15.59:0/2141115367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1498137030 0x7f1498139410 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1490009dc0 tx=0x7f149000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.871+0000 7f149eeb8700 1 -- 172.21.15.59:0/2141115367 shutdown_connections 2023-09-30T22:31:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.871+0000 7f149eeb8700 1 --2- 172.21.15.59:0/2141115367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1498137030 0x7f1498139410 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.871+0000 7f149eeb8700 1 --2- 172.21.15.59:0/2141115367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1498134710 0x7f1498136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.871+0000 7f149eeb8700 1 -- 172.21.15.59:0/2141115367 >> 172.21.15.59:0/2141115367 conn(0x7f14980a2aa0 msgr2=0x7f14980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.871+0000 7f149eeb8700 1 -- 172.21.15.59:0/2141115367 shutdown_connections 2023-09-30T22:31:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.871+0000 7f149eeb8700 1 -- 172.21.15.59:0/2141115367 wait complete. 2023-09-30T22:31:58.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.873+0000 7f149eeb8700 1 Processor -- start 2023-09-30T22:31:58.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.873+0000 7f149eeb8700 1 -- start start 2023-09-30T22:31:58.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.874+0000 7f149eeb8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14981316d0 0x7f14981c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.874+0000 7f149eeb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1498134710 0x7f14981c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.874+0000 7f149eeb8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1498137030 0x7f14981c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.874+0000 7f149eeb8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149809e5e0 con 0x7f14981316d0 2023-09-30T22:31:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.874+0000 7f149eeb8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1498136c20 con 0x7f1498137030 2023-09-30T22:31:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.874+0000 7f149eeb8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1498070a20 con 0x7f1498134710 2023-09-30T22:31:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.874+0000 7f149cc54700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14981316d0 0x7f14981c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.874+0000 7f149cc54700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14981316d0 0x7f14981c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55212/0 (socket says 172.21.15.59:55212) 2023-09-30T22:31:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.874+0000 7f149cc54700 1 -- 172.21.15.59:0/2491719495 learned_addr learned my addr 172.21.15.59:0/2491719495 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.874+0000 7f149d455700 1 --2- 172.21.15.59:0/2491719495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1498137030 0x7f14981c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.875+0000 7f149d455700 1 -- 172.21.15.59:0/2491719495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1498134710 msgr2=0x7f14981c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.875+0000 7f149d455700 1 --2- 172.21.15.59:0/2491719495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1498134710 0x7f14981c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.875+0000 7f149d455700 1 -- 172.21.15.59:0/2491719495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14981316d0 msgr2=0x7f14981c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.875+0000 7f149d455700 1 --2- 172.21.15.59:0/2491719495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14981316d0 0x7f14981c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.875+0000 7f149d455700 1 -- 172.21.15.59:0/2491719495 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1490009a70 con 0x7f1498137030 2023-09-30T22:31:58.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.875+0000 7f149cc54700 1 --2- 172.21.15.59:0/2491719495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14981316d0 0x7f14981c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:58.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.875+0000 7f149d455700 1 --2- 172.21.15.59:0/2491719495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1498137030 0x7f14981c8d30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1490016000 tx=0x7f1490004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:58.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.875+0000 7f14957fa700 1 -- 172.21.15.59:0/2491719495 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490012c90 con 0x7f1498137030 2023-09-30T22:31:58.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.875+0000 7f14957fa700 1 -- 172.21.15.59:0/2491719495 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1490020070 con 0x7f1498137030 2023-09-30T22:31:58.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.875+0000 7f14957fa700 1 -- 172.21.15.59:0/2491719495 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490004280 con 0x7f1498137030 2023-09-30T22:31:58.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.875+0000 7f149eeb8700 1 -- 172.21.15.59:0/2491719495 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149811d720 con 0x7f1498137030 2023-09-30T22:31:58.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.875+0000 7f149eeb8700 1 -- 172.21.15.59:0/2491719495 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149809db50 con 0x7f1498137030 2023-09-30T22:31:58.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.876+0000 7f14957fa700 1 -- 172.21.15.59:0/2491719495 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14900043e0 con 0x7f1498137030 2023-09-30T22:31:58.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.876+0000 7f14957fa700 1 -- 172.21.15.59:0/2491719495 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1490022070 con 0x7f1498137030 2023-09-30T22:31:58.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.876+0000 7f149eeb8700 1 -- 172.21.15.59:0/2491719495 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1498074ea0 con 0x7f1498137030 2023-09-30T22:31:58.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.882+0000 7f14957fa700 1 -- 172.21.15.59:0/2491719495 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f149001a970 con 0x7f1498137030 2023-09-30T22:31:58.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.897+0000 7f9302dea700 1 Processor -- start 2023-09-30T22:31:58.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.897+0000 7f9302dea700 1 -- start start 2023-09-30T22:31:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.897+0000 7f9302dea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f92fc06a770 0x7f92fc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.897+0000 7f9302dea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92fc131d10 0x7f92fc139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.897+0000 7f9302dea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92fc09ece0 con 0x7f92fc06b080 2023-09-30T22:31:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.897+0000 7f9302dea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92fc09e760 con 0x7f92fc06a770 2023-09-30T22:31:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.897+0000 7f9302dea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc09e040 con 0x7f92fc131d10 2023-09-30T22:31:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.898+0000 7f9300b86700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f92fc06a770 0x7f92fc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.898+0000 7f9300b86700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f92fc06a770 0x7f92fc06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55226/0 (socket says 172.21.15.59:55226) 2023-09-30T22:31:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.898+0000 7f9300b86700 1 -- 172.21.15.59:0/721062598 learned_addr learned my addr 172.21.15.59:0/721062598 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.898+0000 7f92fbfff700 1 --1- 172.21.15.59:0/721062598 >> v1:172.21.15.59:6789/0 conn(0x7f92fc06b080 0x7f92fc131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49870/0 (socket says 172.21.15.59:49870) 2023-09-30T22:31:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.898+0000 7f9301387700 1 --2- 172.21.15.59:0/721062598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92fc131d10 0x7f92fc139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.898+0000 7f9301387700 1 -- 172.21.15.59:0/721062598 >> v2:172.21.15.59:3300/0 conn(0x7f92fc06a770 msgr2=0x7f92fc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.898+0000 7f9301387700 1 --2- 172.21.15.59:0/721062598 >> v2:172.21.15.59:3300/0 conn(0x7f92fc06a770 0x7f92fc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.898+0000 7f9301387700 1 -- 172.21.15.59:0/721062598 >> v1:172.21.15.59:6789/0 conn(0x7f92fc06b080 legacy=0x7f92fc131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.898+0000 7f9301387700 1 -- 172.21.15.59:0/721062598 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc09f630 con 0x7f92fc131d10 2023-09-30T22:31:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.898+0000 7f9300b86700 1 --2- 172.21.15.59:0/721062598 >> v2:172.21.15.59:3300/0 conn(0x7f92fc06a770 0x7f92fc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.898+0000 7f9301387700 1 --2- 172.21.15.59:0/721062598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92fc131d10 0x7f92fc139860 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f92f4010350 tx=0x7f92f4010660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db4948bb636a6a1f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.899+0000 7f92fb7fe700 1 -- 172.21.15.59:0/721062598 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f401b680 con 0x7f92fc131d10 2023-09-30T22:31:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.899+0000 7f92fb7fe700 1 -- 172.21.15.59:0/721062598 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f401b7e0 con 0x7f92fc131d10 2023-09-30T22:31:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.899+0000 7f92fb7fe700 1 -- 172.21.15.59:0/721062598 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f401bb70 con 0x7f92fc131d10 2023-09-30T22:31:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.899+0000 7f9302dea700 1 -- 172.21.15.59:0/721062598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92fc131d10 msgr2=0x7f92fc139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.899+0000 7f9302dea700 1 --2- 172.21.15.59:0/721062598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92fc131d10 0x7f92fc139860 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f92f4010350 tx=0x7f92f4010660 comp rx=0 tx=0).stop 2023-09-30T22:31:58.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.900+0000 7f9302dea700 1 -- 172.21.15.59:0/721062598 shutdown_connections 2023-09-30T22:31:58.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.900+0000 7f9302dea700 1 --2- 172.21.15.59:0/721062598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92fc131d10 0x7f92fc139860 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.900+0000 7f9302dea700 1 --2- 172.21.15.59:0/721062598 >> v2:172.21.15.59:3300/0 conn(0x7f92fc06a770 0x7f92fc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.900+0000 7f9302dea700 1 -- 172.21.15.59:0/721062598 >> 172.21.15.59:0/721062598 conn(0x7f92fc066f50 msgr2=0x7f92fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:58.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.900+0000 7f9302dea700 1 -- 172.21.15.59:0/721062598 shutdown_connections 2023-09-30T22:31:58.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.900+0000 7f9302dea700 1 -- 172.21.15.59:0/721062598 wait complete. 2023-09-30T22:31:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.901+0000 7f9302dea700 1 Processor -- start 2023-09-30T22:31:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.901+0000 7f9302dea700 1 -- start start 2023-09-30T22:31:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.901+0000 7f9302dea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92fc06a770 0x7f92fc127610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.901+0000 7f9302dea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92fc06b080 0x7f92fc127b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.901+0000 7f9302dea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92fc131d10 0x7f92fc1cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.901+0000 7f9302dea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc127040 con 0x7f92fc06b080 2023-09-30T22:31:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.901+0000 7f9302dea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc071e60 con 0x7f92fc06a770 2023-09-30T22:31:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.901+0000 7f9302dea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc127230 con 0x7f92fc131d10 2023-09-30T22:31:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.902+0000 7f9300b86700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92fc06a770 0x7f92fc127610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.902+0000 7f9300b86700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92fc06a770 0x7f92fc127610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49474/0 (socket says 172.21.15.59:49474) 2023-09-30T22:31:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.902+0000 7f9300b86700 1 -- 172.21.15.59:0/3997988637 learned_addr learned my addr 172.21.15.59:0/3997988637 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:31:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.902+0000 7f92fbfff700 1 --2- 172.21.15.59:0/3997988637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92fc06b080 0x7f92fc127b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.902+0000 7f9300b86700 1 -- 172.21.15.59:0/3997988637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92fc131d10 msgr2=0x7f92fc1cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.902+0000 7f9300b86700 1 --2- 172.21.15.59:0/3997988637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92fc131d10 0x7f92fc1cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.902+0000 7f9300b86700 1 -- 172.21.15.59:0/3997988637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92fc06b080 msgr2=0x7f92fc127b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.902+0000 7f9300b86700 1 --2- 172.21.15.59:0/3997988637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92fc06b080 0x7f92fc127b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.902+0000 7f9300b86700 1 -- 172.21.15.59:0/3997988637 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f0009550 con 0x7f92fc06a770 2023-09-30T22:31:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.902+0000 7f92fbfff700 1 --2- 172.21.15.59:0/3997988637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92fc06b080 0x7f92fc127b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.902+0000 7f9300b86700 1 --2- 172.21.15.59:0/3997988637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92fc06a770 0x7f92fc127610 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f92f000ebe0 tx=0x7f92f0009e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.902+0000 7f92f97fa700 1 -- 172.21.15.59:0/3997988637 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f000c8b0 con 0x7f92fc06a770 2023-09-30T22:31:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.902+0000 7f92f97fa700 1 -- 172.21.15.59:0/3997988637 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f000ca10 con 0x7f92fc06a770 2023-09-30T22:31:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.903+0000 7f9302dea700 1 -- 172.21.15.59:0/3997988637 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f400bc50 con 0x7f92fc06a770 2023-09-30T22:31:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.903+0000 7f92f97fa700 1 -- 172.21.15.59:0/3997988637 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f000cd80 con 0x7f92fc06a770 2023-09-30T22:31:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.903+0000 7f9302dea700 1 -- 172.21.15.59:0/3997988637 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92fc129910 con 0x7f92fc06a770 2023-09-30T22:31:58.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.904+0000 7f9302dea700 1 -- 172.21.15.59:0/3997988637 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92fc12a2e0 con 0x7f92fc06a770 2023-09-30T22:31:58.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.904+0000 7f92f97fa700 1 -- 172.21.15.59:0/3997988637 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92f0013470 con 0x7f92fc06a770 2023-09-30T22:31:58.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.905+0000 7f92f97fa700 1 -- 172.21.15.59:0/3997988637 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f92f003f910 con 0x7f92fc06a770 2023-09-30T22:31:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:58.909+0000 7f92f97fa700 1 -- 172.21.15.59:0/3997988637 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92f00232f0 con 0x7f92fc06a770 2023-09-30T22:31:59.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.000+0000 7fb595dcc700 1 -- 172.21.15.59:0/4280422952 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb590074ea0 con 0x7fb590133b10 2023-09-30T22:31:59.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.000+0000 7fb577fff700 1 -- 172.21.15.59:0/4280422952 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb588045020 con 0x7fb590133b10 2023-09-30T22:31:59.000 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:31:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.002+0000 7fb595dcc700 1 -- 172.21.15.59:0/4280422952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb590133b10 msgr2=0x7fb59011fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.002+0000 7fb595dcc700 1 --2- 172.21.15.59:0/4280422952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb590133b10 0x7fb59011fd20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb588015000 tx=0x7fb588004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.003+0000 7fb595dcc700 1 -- 172.21.15.59:0/4280422952 shutdown_connections 2023-09-30T22:31:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.003+0000 7fb595dcc700 1 --2- 172.21.15.59:0/4280422952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb590133b10 0x7fb59011fd20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.003+0000 7fb595dcc700 1 --2- 172.21.15.59:0/4280422952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009de50 0x7fb5901c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.003+0000 7fb595dcc700 1 --2- 172.21.15.59:0/4280422952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59009e9b0 0x7fb5901c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.003+0000 7fb595dcc700 1 -- 172.21.15.59:0/4280422952 >> 172.21.15.59:0/4280422952 conn(0x7fb5900a2aa0 msgr2=0x7fb59009f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.003+0000 7fb595dcc700 1 -- 172.21.15.59:0/4280422952 shutdown_connections 2023-09-30T22:31:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.003+0000 7fb595dcc700 1 -- 172.21.15.59:0/4280422952 wait complete. 2023-09-30T22:31:59.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:31:59.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.102+0000 7f983a3b8700 1 -- 172.21.15.59:0/294148306 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f98341ab1a0 con 0x7f983409e930 2023-09-30T22:31:59.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.102+0000 7f9830ff9700 1 -- 172.21.15.59:0/294148306 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98341ab1a0 con 0x7f983409e930 2023-09-30T22:31:59.103 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:31:59.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.104+0000 7f983a3b8700 1 -- 172.21.15.59:0/294148306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983409e930 msgr2=0x7f983406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:59.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.104+0000 7f983a3b8700 1 --2- 172.21.15.59:0/294148306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983409e930 0x7f983406b8b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f982400ebe0 tx=0x7f982400eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:59.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.104+0000 7f983a3b8700 1 -- 172.21.15.59:0/294148306 shutdown_connections 2023-09-30T22:31:59.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.104+0000 7f983a3b8700 1 --2- 172.21.15.59:0/294148306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983409e930 0x7f983406b8b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:59.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.104+0000 7f983a3b8700 1 --2- 172.21.15.59:0/294148306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983409f650 0x7f983406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:59.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.104+0000 7f983a3b8700 1 --2- 172.21.15.59:0/294148306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983409f240 0x7f983406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:59.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.104+0000 7f983a3b8700 1 -- 172.21.15.59:0/294148306 >> 172.21.15.59:0/294148306 conn(0x7f98340a4210 msgr2=0x7f983409c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:59.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.104+0000 7f983a3b8700 1 -- 172.21.15.59:0/294148306 shutdown_connections 2023-09-30T22:31:59.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.104+0000 7f983a3b8700 1 -- 172.21.15.59:0/294148306 wait complete. 2023-09-30T22:31:59.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:31:59.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.137+0000 7f149eeb8700 1 -- 172.21.15.59:0/2491719495 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f149806b9e0 con 0x7f1498137030 2023-09-30T22:31:59.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.138+0000 7f14957fa700 1 -- 172.21.15.59:0/2491719495 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f149002c030 con 0x7f1498137030 2023-09-30T22:31:59.138 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:59.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.138+0000 7f9302dea700 1 -- 172.21.15.59:0/3997988637 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f92fc074ea0 con 0x7f92fc06a770 2023-09-30T22:31:59.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.138+0000 7f92f97fa700 1 -- 172.21.15.59:0/3997988637 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92f0021030 con 0x7f92fc06a770 2023-09-30T22:31:59.139 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:31:59.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.140+0000 7f149eeb8700 1 -- 172.21.15.59:0/2491719495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1498137030 msgr2=0x7f14981c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:59.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.140+0000 7f149eeb8700 1 --2- 172.21.15.59:0/2491719495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1498137030 0x7f14981c8d30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1490016000 tx=0x7f1490004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:59.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.140+0000 7f149eeb8700 1 -- 172.21.15.59:0/2491719495 shutdown_connections 2023-09-30T22:31:59.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.140+0000 7f149eeb8700 1 --2- 172.21.15.59:0/2491719495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1498137030 0x7f14981c8d30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:59.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.140+0000 7f149eeb8700 1 --2- 172.21.15.59:0/2491719495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14981316d0 0x7f14981c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:59.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.140+0000 7f149eeb8700 1 --2- 172.21.15.59:0/2491719495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1498134710 0x7f14981c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:59.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.140+0000 7f149eeb8700 1 -- 172.21.15.59:0/2491719495 >> 172.21.15.59:0/2491719495 conn(0x7f14980a2aa0 msgr2=0x7f149809f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:59.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.140+0000 7f149eeb8700 1 -- 172.21.15.59:0/2491719495 shutdown_connections 2023-09-30T22:31:59.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.140+0000 7f149eeb8700 1 -- 172.21.15.59:0/2491719495 wait complete. 2023-09-30T22:31:59.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.141+0000 7f9302dea700 1 -- 172.21.15.59:0/3997988637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92fc06a770 msgr2=0x7f92fc127610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:59.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.141+0000 7f9302dea700 1 --2- 172.21.15.59:0/3997988637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92fc06a770 0x7f92fc127610 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f92f000ebe0 tx=0x7f92f0009e70 comp rx=0 tx=0).stop 2023-09-30T22:31:59.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.141+0000 7f9302dea700 1 -- 172.21.15.59:0/3997988637 shutdown_connections 2023-09-30T22:31:59.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.141+0000 7f9302dea700 1 --2- 172.21.15.59:0/3997988637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92fc131d10 0x7f92fc1cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:59.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.141+0000 7f9302dea700 1 --2- 172.21.15.59:0/3997988637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92fc06a770 0x7f92fc127610 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:59.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.141+0000 7f9302dea700 1 --2- 172.21.15.59:0/3997988637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92fc06b080 0x7f92fc127b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:59.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.141+0000 7f9302dea700 1 -- 172.21.15.59:0/3997988637 >> 172.21.15.59:0/3997988637 conn(0x7f92fc066f50 msgr2=0x7f92fc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:59.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.141+0000 7f9302dea700 1 -- 172.21.15.59:0/3997988637 shutdown_connections 2023-09-30T22:31:59.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:31:59.141+0000 7f9302dea700 1 -- 172.21.15.59:0/3997988637 wait complete. 2023-09-30T22:31:59.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:31:59.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:00.018 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:00.120 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:00.156 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:00.156 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:00.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.165+0000 7f142cfdd700 1 Processor -- start 2023-09-30T22:32:00.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.165+0000 7f142cfdd700 1 -- start start 2023-09-30T22:32:00.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.166+0000 7f142cfdd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f142809e1d0 0x7f1428135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.166+0000 7f142cfdd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1428135e50 0x7f1428138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.166+0000 7f142cfdd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142809f130 con 0x7f142809d6f0 2023-09-30T22:32:00.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.166+0000 7f142cfdd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142809f520 con 0x7f142809e1d0 2023-09-30T22:32:00.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.166+0000 7f142cfdd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f142809e930 con 0x7f1428135e50 2023-09-30T22:32:00.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.166+0000 7f1425d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f142809e1d0 0x7f1428135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.166+0000 7f1426d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1428135e50 0x7f1428138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.166+0000 7f1425d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f142809e1d0 0x7f1428135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55240/0 (socket says 172.21.15.59:55240) 2023-09-30T22:32:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.166+0000 7f1426d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1428135e50 0x7f1428138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56092/0 (socket says 172.21.15.59:56092) 2023-09-30T22:32:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.166+0000 7f1425d9b700 1 -- 172.21.15.59:0/3139993759 learned_addr learned my addr 172.21.15.59:0/3139993759 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.166+0000 7f1426d9d700 1 -- 172.21.15.59:0/3139993759 >> v2:172.21.15.59:3300/0 conn(0x7f142809e1d0 msgr2=0x7f1428135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.166+0000 7f1426d9d700 1 --2- 172.21.15.59:0/3139993759 >> v2:172.21.15.59:3300/0 conn(0x7f142809e1d0 0x7f1428135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.166+0000 7f1426d9d700 1 -- 172.21.15.59:0/3139993759 >> v1:172.21.15.59:6789/0 conn(0x7f142809d6f0 legacy=0x7f142809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.166+0000 7f1426d9d700 1 -- 172.21.15.59:0/3139993759 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142809b2d0 con 0x7f1428135e50 2023-09-30T22:32:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.167+0000 7f1426d9d700 1 --2- 172.21.15.59:0/3139993759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1428135e50 0x7f1428138230 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1420009d90 tx=0x7f142000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35b43a24bfda7815 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.167+0000 7f142559a700 1 -- 172.21.15.59:0/3139993759 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142000e070 con 0x7f1428135e50 2023-09-30T22:32:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.167+0000 7f142559a700 1 -- 172.21.15.59:0/3139993759 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142000bb20 con 0x7f1428135e50 2023-09-30T22:32:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.167+0000 7f142559a700 1 -- 172.21.15.59:0/3139993759 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420012430 con 0x7f1428135e50 2023-09-30T22:32:00.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.168+0000 7f142cfdd700 1 -- 172.21.15.59:0/3139993759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1428135e50 msgr2=0x7f1428138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.168+0000 7f142cfdd700 1 --2- 172.21.15.59:0/3139993759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1428135e50 0x7f1428138230 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1420009d90 tx=0x7f142000b330 comp rx=0 tx=0).stop 2023-09-30T22:32:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.168+0000 7f142cfdd700 1 -- 172.21.15.59:0/3139993759 shutdown_connections 2023-09-30T22:32:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.168+0000 7f142cfdd700 1 --2- 172.21.15.59:0/3139993759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1428135e50 0x7f1428138230 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.168+0000 7f142cfdd700 1 --2- 172.21.15.59:0/3139993759 >> v2:172.21.15.59:3300/0 conn(0x7f142809e1d0 0x7f1428135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.168+0000 7f142cfdd700 1 -- 172.21.15.59:0/3139993759 >> 172.21.15.59:0/3139993759 conn(0x7f1428066f50 msgr2=0x7f142809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.168+0000 7f142cfdd700 1 -- 172.21.15.59:0/3139993759 shutdown_connections 2023-09-30T22:32:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.168+0000 7f142cfdd700 1 -- 172.21.15.59:0/3139993759 wait complete. 2023-09-30T22:32:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.169+0000 7f142cfdd700 1 Processor -- start 2023-09-30T22:32:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.169+0000 7f142cfdd700 1 -- start start 2023-09-30T22:32:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.170+0000 7f142cfdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f142809d6f0 0x7f14281347f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.170+0000 7f142cfdd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f142809e1d0 0x7f1428134d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.170+0000 7f142cfdd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1428135e50 0x7f1428135270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.170+0000 7f142cfdd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14280a2290 con 0x7f142809e1d0 2023-09-30T22:32:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.170+0000 7f142cfdd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1428139ae0 con 0x7f142809d6f0 2023-09-30T22:32:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.170+0000 7f142cfdd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1428135bc0 con 0x7f1428135e50 2023-09-30T22:32:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.170+0000 7f1425d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f142809e1d0 0x7f1428134d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.170+0000 7f1426d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1428135e50 0x7f1428135270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.170+0000 7f1425d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f142809e1d0 0x7f1428134d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55246/0 (socket says 172.21.15.59:55246) 2023-09-30T22:32:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.170+0000 7f1425d9b700 1 -- 172.21.15.59:0/2000766951 learned_addr learned my addr 172.21.15.59:0/2000766951 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.170+0000 7f1426d9d700 1 -- 172.21.15.59:0/2000766951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f142809d6f0 msgr2=0x7f14281347f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.170+0000 7f1426d9d700 1 --2- 172.21.15.59:0/2000766951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f142809d6f0 0x7f14281347f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.170+0000 7f1426d9d700 1 -- 172.21.15.59:0/2000766951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f142809e1d0 msgr2=0x7f1428134d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.170+0000 7f1426d9d700 1 --2- 172.21.15.59:0/2000766951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f142809e1d0 0x7f1428134d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.170+0000 7f1426d9d700 1 -- 172.21.15.59:0/2000766951 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1420009a70 con 0x7f1428135e50 2023-09-30T22:32:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.171+0000 7f1426d9d700 1 --2- 172.21.15.59:0/2000766951 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1428135e50 0x7f1428135270 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1420016000 tx=0x7f1420004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.171+0000 7f1416ffd700 1 -- 172.21.15.59:0/2000766951 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420012430 con 0x7f1428135e50 2023-09-30T22:32:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.171+0000 7f1416ffd700 1 -- 172.21.15.59:0/2000766951 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1420020070 con 0x7f1428135e50 2023-09-30T22:32:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.171+0000 7f142cfdd700 1 -- 172.21.15.59:0/2000766951 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1428138ce0 con 0x7f1428135e50 2023-09-30T22:32:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.171+0000 7f1416ffd700 1 -- 172.21.15.59:0/2000766951 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420004280 con 0x7f1428135e50 2023-09-30T22:32:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.171+0000 7f142cfdd700 1 -- 172.21.15.59:0/2000766951 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142809c700 con 0x7f1428135e50 2023-09-30T22:32:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.172+0000 7f1416ffd700 1 -- 172.21.15.59:0/2000766951 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14200043e0 con 0x7f1428135e50 2023-09-30T22:32:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.172+0000 7f142cfdd700 1 -- 172.21.15.59:0/2000766951 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142811dc10 con 0x7f1428135e50 2023-09-30T22:32:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.172+0000 7f1416ffd700 1 -- 172.21.15.59:0/2000766951 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1420022070 con 0x7f1428135e50 2023-09-30T22:32:00.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.179+0000 7f1416ffd700 1 -- 172.21.15.59:0/2000766951 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f142001c400 con 0x7f1428135e50 2023-09-30T22:32:00.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.276+0000 7f0fb3e00700 1 Processor -- start 2023-09-30T22:32:00.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.276+0000 7f0fb3e00700 1 -- start start 2023-09-30T22:32:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.277+0000 7f0fb3e00700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09e930 0x7f0fac09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.277+0000 7f0fb3e00700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0fac09f240 0x7f0fac1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.277+0000 7f0fb3e00700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 0x7f0fac131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.277+0000 7f0fb3e00700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac070940 con 0x7f0fac09f240 2023-09-30T22:32:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.277+0000 7f0fb3e00700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac06fd60 con 0x7f0fac09e930 2023-09-30T22:32:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.277+0000 7f0fb3e00700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac06fa80 con 0x7f0fac09f650 2023-09-30T22:32:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.278+0000 7f0fb139b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0fac09f240 0x7f0fac1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.278+0000 7f0fb1b9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09e930 0x7f0fac09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.278+0000 7f0fb139b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0fac09f240 0x7f0fac1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55252/0 (socket says 172.21.15.59:55252) 2023-09-30T22:32:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.278+0000 7f0fb239d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 0x7f0fac131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.278+0000 7f0fb139b700 1 -- 172.21.15.59:0/2690607239 learned_addr learned my addr 172.21.15.59:0/2690607239 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.278+0000 7f0fb239d700 1 -- 172.21.15.59:0/2690607239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09e930 msgr2=0x7f0fac09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.278+0000 7f0fb239d700 1 --2- 172.21.15.59:0/2690607239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09e930 0x7f0fac09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.278+0000 7f0fb239d700 1 -- 172.21.15.59:0/2690607239 >> v2:172.21.15.59:3300/0 conn(0x7f0fac09f240 msgr2=0x7f0fac1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.278+0000 7f0fb239d700 1 --2- 172.21.15.59:0/2690607239 >> v2:172.21.15.59:3300/0 conn(0x7f0fac09f240 0x7f0fac1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.278+0000 7f0fb239d700 1 -- 172.21.15.59:0/2690607239 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac09fb60 con 0x7f0fac09f650 2023-09-30T22:32:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.278+0000 7f0fb1b9c700 1 --2- 172.21.15.59:0/2690607239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09e930 0x7f0fac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.278+0000 7f0fb239d700 1 --2- 172.21.15.59:0/2690607239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 0x7f0fac131d30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009d90 tx=0x7f0fa400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9173f245e0803afa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.278+0000 7f0fb0b9a700 1 -- 172.21.15.59:0/2690607239 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa400e070 con 0x7f0fac09f650 2023-09-30T22:32:00.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.279+0000 7f0fb0b9a700 1 -- 172.21.15.59:0/2690607239 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa400bb20 con 0x7f0fac09f650 2023-09-30T22:32:00.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.279+0000 7f0fb0b9a700 1 -- 172.21.15.59:0/2690607239 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4012430 con 0x7f0fac09f650 2023-09-30T22:32:00.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.280+0000 7f0fb3e00700 1 -- 172.21.15.59:0/2690607239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 msgr2=0x7f0fac131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.280+0000 7f0fb3e00700 1 --2- 172.21.15.59:0/2690607239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 0x7f0fac131d30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009d90 tx=0x7f0fa400b330 comp rx=0 tx=0).stop 2023-09-30T22:32:00.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.280+0000 7f0fb3e00700 1 -- 172.21.15.59:0/2690607239 shutdown_connections 2023-09-30T22:32:00.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.280+0000 7f0fb3e00700 1 --2- 172.21.15.59:0/2690607239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 0x7f0fac131d30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.280+0000 7f0fb3e00700 1 --2- 172.21.15.59:0/2690607239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09e930 0x7f0fac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.280+0000 7f0fb3e00700 1 --2- 172.21.15.59:0/2690607239 >> v2:172.21.15.59:3300/0 conn(0x7f0fac09f240 0x7f0fac1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.280+0000 7f0fb3e00700 1 -- 172.21.15.59:0/2690607239 >> 172.21.15.59:0/2690607239 conn(0x7f0fac0a4210 msgr2=0x7f0fac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:00.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.280+0000 7f0fb3e00700 1 -- 172.21.15.59:0/2690607239 shutdown_connections 2023-09-30T22:32:00.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.280+0000 7f0fb3e00700 1 -- 172.21.15.59:0/2690607239 wait complete. 2023-09-30T22:32:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.282+0000 7f0fb3e00700 1 Processor -- start 2023-09-30T22:32:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.282+0000 7f0fb3e00700 1 -- start start 2023-09-30T22:32:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.282+0000 7f0fb3e00700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09e930 0x7f0fac1a34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.282+0000 7f0fb3e00700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f240 0x7f0fac1a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.282+0000 7f0fb3e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fac09f650 0x7f0fac1c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.282+0000 7f0fb3e00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac071dd0 con 0x7f0fac09f650 2023-09-30T22:32:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.282+0000 7f0fb3e00700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac1b6380 con 0x7f0fac09e930 2023-09-30T22:32:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.282+0000 7f0fb3e00700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac1a5720 con 0x7f0fac09f240 2023-09-30T22:32:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.283+0000 7f0fb139b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f240 0x7f0fac1a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.283+0000 7f0fb139b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f240 0x7f0fac1a39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56118/0 (socket says 172.21.15.59:56118) 2023-09-30T22:32:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.283+0000 7f0fb139b700 1 -- 172.21.15.59:0/2986728723 learned_addr learned my addr 172.21.15.59:0/2986728723 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.283+0000 7f0fb1b9c700 1 --2- 172.21.15.59:0/2986728723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09e930 0x7f0fac1a34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.283+0000 7f0fb239d700 1 --2- 172.21.15.59:0/2986728723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fac09f650 0x7f0fac1c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.283+0000 7f0fb139b700 1 -- 172.21.15.59:0/2986728723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09e930 msgr2=0x7f0fac1a34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.283+0000 7f0fb139b700 1 --2- 172.21.15.59:0/2986728723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09e930 0x7f0fac1a34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.283+0000 7f0fb139b700 1 -- 172.21.15.59:0/2986728723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fac09f650 msgr2=0x7f0fac1c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.283+0000 7f0fb139b700 1 --2- 172.21.15.59:0/2986728723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fac09f650 0x7f0fac1c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.283+0000 7f0fb139b700 1 -- 172.21.15.59:0/2986728723 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa80094a0 con 0x7f0fac09f240 2023-09-30T22:32:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.283+0000 7f0fb1b9c700 1 --2- 172.21.15.59:0/2986728723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09e930 0x7f0fac1a34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.283+0000 7f0fb139b700 1 --2- 172.21.15.59:0/2986728723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f240 0x7f0fac1a39f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c012bf0 tx=0x7f0f9c012f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.284+0000 7f0fa27fc700 1 -- 172.21.15.59:0/2986728723 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c010870 con 0x7f0fac09f240 2023-09-30T22:32:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.284+0000 7f0fa27fc700 1 -- 172.21.15.59:0/2986728723 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c013040 con 0x7f0fac09f240 2023-09-30T22:32:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.284+0000 7f0fb3e00700 1 -- 172.21.15.59:0/2986728723 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa4009a70 con 0x7f0fac09f240 2023-09-30T22:32:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.284+0000 7f0fa27fc700 1 -- 172.21.15.59:0/2986728723 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c010bd0 con 0x7f0fac09f240 2023-09-30T22:32:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.284+0000 7f0fb3e00700 1 -- 172.21.15.59:0/2986728723 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac0a0190 con 0x7f0fac09f240 2023-09-30T22:32:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.285+0000 7f0fa27fc700 1 -- 172.21.15.59:0/2986728723 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f9c010d30 con 0x7f0fac09f240 2023-09-30T22:32:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.285+0000 7f0fb3e00700 1 -- 172.21.15.59:0/2986728723 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac074ea0 con 0x7f0fac09f240 2023-09-30T22:32:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.285+0000 7f0fa27fc700 1 -- 172.21.15.59:0/2986728723 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f9c043490 con 0x7f0fac09f240 2023-09-30T22:32:00.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.295+0000 7f0fa27fc700 1 -- 172.21.15.59:0/2986728723 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f9c016750 con 0x7f0fac09f240 2023-09-30T22:32:00.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.312+0000 7f67ffefc700 1 Processor -- start 2023-09-30T22:32:00.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.312+0000 7f67ffefc700 1 -- start start 2023-09-30T22:32:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.313+0000 7f67ffefc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67f8136710 0x7f67f8138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.313+0000 7f67ffefc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67f8139030 0x7f67f813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.313+0000 7f67ffefc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f806ef30 con 0x7f67f81338a0 2023-09-30T22:32:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.313+0000 7f67ffefc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f806fef0 con 0x7f67f8136710 2023-09-30T22:32:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.313+0000 7f67ffefc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67f81334b0 con 0x7f67f8139030 2023-09-30T22:32:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.313+0000 7f67fd497700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67f8136710 0x7f67f8138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.313+0000 7f67fdc98700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f67f81338a0 0x7f67f8133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49888/0 (socket says 172.21.15.59:49888) 2023-09-30T22:32:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.313+0000 7f67fdc98700 1 -- 172.21.15.59:0/2464150072 learned_addr learned my addr 172.21.15.59:0/2464150072 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.313+0000 7f67fe499700 1 --2- 172.21.15.59:0/2464150072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67f8139030 0x7f67f813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.313+0000 7f67fd497700 1 -- 172.21.15.59:0/2464150072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67f8139030 msgr2=0x7f67f813b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.314+0000 7f67fd497700 1 --2- 172.21.15.59:0/2464150072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67f8139030 0x7f67f813b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.314+0000 7f67fd497700 1 -- 172.21.15.59:0/2464150072 >> v1:172.21.15.59:6789/0 conn(0x7f67f81338a0 legacy=0x7f67f8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.314+0000 7f67fd497700 1 -- 172.21.15.59:0/2464150072 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f806fc30 con 0x7f67f8136710 2023-09-30T22:32:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.314+0000 7f67fe499700 1 --2- 172.21.15.59:0/2464150072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67f8139030 0x7f67f813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:00.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.314+0000 7f67fd497700 1 --2- 172.21.15.59:0/2464150072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67f8136710 0x7f67f8138af0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009870 tx=0x7f67e8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec79a09a185aff37 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:00.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.314+0000 7f67fcc96700 1 -- 172.21.15.59:0/2464150072 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8004230 con 0x7f67f8136710 2023-09-30T22:32:00.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.314+0000 7f67fcc96700 1 -- 172.21.15.59:0/2464150072 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e8004390 con 0x7f67f8136710 2023-09-30T22:32:00.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.314+0000 7f67fcc96700 1 -- 172.21.15.59:0/2464150072 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e80036a0 con 0x7f67f8136710 2023-09-30T22:32:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.315+0000 7f67ffefc700 1 -- 172.21.15.59:0/2464150072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67f8136710 msgr2=0x7f67f8138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.315+0000 7f67ffefc700 1 --2- 172.21.15.59:0/2464150072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67f8136710 0x7f67f8138af0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009870 tx=0x7f67e8009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.315+0000 7f67ffefc700 1 -- 172.21.15.59:0/2464150072 shutdown_connections 2023-09-30T22:32:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.315+0000 7f67ffefc700 1 --2- 172.21.15.59:0/2464150072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67f8139030 0x7f67f813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.315+0000 7f67ffefc700 1 --2- 172.21.15.59:0/2464150072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67f8136710 0x7f67f8138af0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.315+0000 7f67ffefc700 1 -- 172.21.15.59:0/2464150072 >> 172.21.15.59:0/2464150072 conn(0x7f67f80a2aa0 msgr2=0x7f67f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.315+0000 7f67ffefc700 1 -- 172.21.15.59:0/2464150072 shutdown_connections 2023-09-30T22:32:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.315+0000 7f67ffefc700 1 -- 172.21.15.59:0/2464150072 wait complete. 2023-09-30T22:32:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.316+0000 7f67ffefc700 1 Processor -- start 2023-09-30T22:32:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.316+0000 7f67ffefc700 1 -- start start 2023-09-30T22:32:00.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.317+0000 7f67ffefc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67f81338a0 0x7f67f8119fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.317+0000 7f67ffefc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67f8136710 0x7f67f811a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.317+0000 7f67ffefc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67f8139030 0x7f67f811aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.317+0000 7f67ffefc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f811bb00 con 0x7f67f8139030 2023-09-30T22:32:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.317+0000 7f67ffefc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f811bf40 con 0x7f67f81338a0 2023-09-30T22:32:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.317+0000 7f67ffefc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67f811d020 con 0x7f67f8136710 2023-09-30T22:32:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.317+0000 7f67fdc98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67f81338a0 0x7f67f8119fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.317+0000 7f67fdc98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67f81338a0 0x7f67f8119fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49516/0 (socket says 172.21.15.59:49516) 2023-09-30T22:32:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.317+0000 7f67fdc98700 1 -- 172.21.15.59:0/3771828456 learned_addr learned my addr 172.21.15.59:0/3771828456 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.317+0000 7f67fe499700 1 --2- 172.21.15.59:0/3771828456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67f8139030 0x7f67f811aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.318+0000 7f67fd497700 1 --2- 172.21.15.59:0/3771828456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67f8136710 0x7f67f811a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.318+0000 7f67fdc98700 1 -- 172.21.15.59:0/3771828456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67f8136710 msgr2=0x7f67f811a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.318+0000 7f67fdc98700 1 --2- 172.21.15.59:0/3771828456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67f8136710 0x7f67f811a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.318+0000 7f67fdc98700 1 -- 172.21.15.59:0/3771828456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67f8139030 msgr2=0x7f67f811aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.318+0000 7f67fdc98700 1 --2- 172.21.15.59:0/3771828456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67f8139030 0x7f67f811aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.318+0000 7f67fdc98700 1 -- 172.21.15.59:0/3771828456 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f0009a70 con 0x7f67f81338a0 2023-09-30T22:32:00.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.318+0000 7f67fd497700 1 --2- 172.21.15.59:0/3771828456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67f8136710 0x7f67f811a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:00.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.318+0000 7f67fdc98700 1 --2- 172.21.15.59:0/3771828456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67f81338a0 0x7f67f8119fc0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f67f400c780 tx=0x7f67f400cb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:00.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.318+0000 7f67ee7fc700 1 -- 172.21.15.59:0/3771828456 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4004c80 con 0x7f67f81338a0 2023-09-30T22:32:00.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.318+0000 7f67ee7fc700 1 -- 172.21.15.59:0/3771828456 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f4004de0 con 0x7f67f81338a0 2023-09-30T22:32:00.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.318+0000 7f67ffefc700 1 -- 172.21.15.59:0/3771828456 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e80094a0 con 0x7f67f81338a0 2023-09-30T22:32:00.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.318+0000 7f67ee7fc700 1 -- 172.21.15.59:0/3771828456 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4007310 con 0x7f67f81338a0 2023-09-30T22:32:00.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.318+0000 7f67ffefc700 1 -- 172.21.15.59:0/3771828456 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f811d5b0 con 0x7f67f81338a0 2023-09-30T22:32:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.319+0000 7f67ee7fc700 1 -- 172.21.15.59:0/3771828456 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67f4007470 con 0x7f67f81338a0 2023-09-30T22:32:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.319+0000 7f67ee7fc700 1 -- 172.21.15.59:0/3771828456 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f67f403ed00 con 0x7f67f81338a0 2023-09-30T22:32:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.320+0000 7f67ffefc700 1 -- 172.21.15.59:0/3771828456 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f8074ea0 con 0x7f67f81338a0 2023-09-30T22:32:00.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.325+0000 7f67ee7fc700 1 -- 172.21.15.59:0/3771828456 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67f4018020 con 0x7f67f81338a0 2023-09-30T22:32:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.333+0000 7fe693982700 1 Processor -- start 2023-09-30T22:32:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.333+0000 7fe693982700 1 -- start start 2023-09-30T22:32:00.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.334+0000 7fe693982700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68c0a0a30 0x7fe68c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.334+0000 7fe693982700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe68c0a1340 0x7fe68c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.334+0000 7fe693982700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe68c09edd0 con 0x7fe68c133fa0 2023-09-30T22:32:00.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.334+0000 7fe693982700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68c09e1f0 con 0x7fe68c0a1340 2023-09-30T22:32:00.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.334+0000 7fe693982700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c09dc50 con 0x7fe68c0a0a30 2023-09-30T22:32:00.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.334+0000 7fe69171e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68c0a0a30 0x7fe68c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.334+0000 7fe69171e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68c0a0a30 0x7fe68c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56138/0 (socket says 172.21.15.59:56138) 2023-09-30T22:32:00.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.334+0000 7fe69171e700 1 -- 172.21.15.59:0/3381924536 learned_addr learned my addr 172.21.15.59:0/3381924536 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:00.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.335+0000 7fe690f1d700 1 --2- 172.21.15.59:0/3381924536 >> v2:172.21.15.59:3300/0 conn(0x7fe68c0a1340 0x7fe68c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.335+0000 7fe69171e700 1 -- 172.21.15.59:0/3381924536 >> v2:172.21.15.59:3300/0 conn(0x7fe68c0a1340 msgr2=0x7fe68c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:00.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.335+0000 7fe69171e700 1 --2- 172.21.15.59:0/3381924536 >> v2:172.21.15.59:3300/0 conn(0x7fe68c0a1340 0x7fe68c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.335+0000 7fe69171e700 1 -- 172.21.15.59:0/3381924536 >> v1:172.21.15.59:6789/0 conn(0x7fe68c133fa0 legacy=0x7fe68c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.335+0000 7fe69171e700 1 -- 172.21.15.59:0/3381924536 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c0a1fe0 con 0x7fe68c0a0a30 2023-09-30T22:32:00.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.335+0000 7fe69171e700 1 --2- 172.21.15.59:0/3381924536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68c0a0a30 0x7fe68c0a0e00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe6880098f0 tx=0x7fe688009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9618ba140a606b49 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:00.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.335+0000 7fe683fff700 1 -- 172.21.15.59:0/3381924536 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688011830 con 0x7fe68c0a0a30 2023-09-30T22:32:00.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.335+0000 7fe683fff700 1 -- 172.21.15.59:0/3381924536 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe688011990 con 0x7fe68c0a0a30 2023-09-30T22:32:00.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.335+0000 7fe683fff700 1 -- 172.21.15.59:0/3381924536 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688011d20 con 0x7fe68c0a0a30 2023-09-30T22:32:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.336+0000 7fe693982700 1 -- 172.21.15.59:0/3381924536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68c0a0a30 msgr2=0x7fe68c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.336+0000 7fe693982700 1 --2- 172.21.15.59:0/3381924536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68c0a0a30 0x7fe68c0a0e00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe6880098f0 tx=0x7fe688009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.336+0000 7fe693982700 1 -- 172.21.15.59:0/3381924536 shutdown_connections 2023-09-30T22:32:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.336+0000 7fe693982700 1 --2- 172.21.15.59:0/3381924536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68c0a0a30 0x7fe68c0a0e00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.336+0000 7fe693982700 1 --2- 172.21.15.59:0/3381924536 >> v2:172.21.15.59:3300/0 conn(0x7fe68c0a1340 0x7fe68c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.336+0000 7fe693982700 1 -- 172.21.15.59:0/3381924536 >> 172.21.15.59:0/3381924536 conn(0x7fe68c0a6550 msgr2=0x7fe68c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.337+0000 7fe693982700 1 -- 172.21.15.59:0/3381924536 shutdown_connections 2023-09-30T22:32:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.337+0000 7fe693982700 1 -- 172.21.15.59:0/3381924536 wait complete. 2023-09-30T22:32:00.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.338+0000 7fe693982700 1 Processor -- start 2023-09-30T22:32:00.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.338+0000 7fe693982700 1 -- start start 2023-09-30T22:32:00.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.339+0000 7fe693982700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68c0a0a30 0x7fe68c1c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.339+0000 7fe693982700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68c0a1340 0x7fe68c1c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.339+0000 7fe693982700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68c133fa0 0x7fe68c11e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:00.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.339+0000 7fe693982700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c133160 con 0x7fe68c133fa0 2023-09-30T22:32:00.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.339+0000 7fe693982700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c120560 con 0x7fe68c0a0a30 2023-09-30T22:32:00.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.339+0000 7fe693982700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c133760 con 0x7fe68c0a1340 2023-09-30T22:32:00.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.339+0000 7fe691f1f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68c133fa0 0x7fe68c11e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.339+0000 7fe691f1f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68c133fa0 0x7fe68c11e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55290/0 (socket says 172.21.15.59:55290) 2023-09-30T22:32:00.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.339+0000 7fe691f1f700 1 -- 172.21.15.59:0/755720340 learned_addr learned my addr 172.21.15.59:0/755720340 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:00.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.339+0000 7fe690f1d700 1 --2- 172.21.15.59:0/755720340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68c0a1340 0x7fe68c1c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:00.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.340+0000 7fe691f1f700 1 -- 172.21.15.59:0/755720340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68c0a1340 msgr2=0x7fe68c1c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.340+0000 7fe691f1f700 1 --2- 172.21.15.59:0/755720340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68c0a1340 0x7fe68c1c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.340+0000 7fe691f1f700 1 -- 172.21.15.59:0/755720340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68c0a0a30 msgr2=0x7fe68c1c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.340+0000 7fe691f1f700 1 --2- 172.21.15.59:0/755720340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68c0a0a30 0x7fe68c1c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.340+0000 7fe691f1f700 1 -- 172.21.15.59:0/755720340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe688009550 con 0x7fe68c133fa0 2023-09-30T22:32:00.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.340+0000 7fe691f1f700 1 --2- 172.21.15.59:0/755720340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68c133fa0 0x7fe68c11e7d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe68400cc80 tx=0x7fe68400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:00.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.340+0000 7fe681ffb700 1 -- 172.21.15.59:0/755720340 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68400ad40 con 0x7fe68c133fa0 2023-09-30T22:32:00.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.340+0000 7fe681ffb700 1 -- 172.21.15.59:0/755720340 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68400ce80 con 0x7fe68c133fa0 2023-09-30T22:32:00.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.340+0000 7fe681ffb700 1 -- 172.21.15.59:0/755720340 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68400aea0 con 0x7fe68c133fa0 2023-09-30T22:32:00.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.340+0000 7fe693982700 1 -- 172.21.15.59:0/755720340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68c1222f0 con 0x7fe68c133fa0 2023-09-30T22:32:00.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.340+0000 7fe693982700 1 -- 172.21.15.59:0/755720340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68c0a0220 con 0x7fe68c133fa0 2023-09-30T22:32:00.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.342+0000 7fe693982700 1 -- 172.21.15.59:0/755720340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe68c074ea0 con 0x7fe68c133fa0 2023-09-30T22:32:00.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.343+0000 7fe681ffb700 1 -- 172.21.15.59:0/755720340 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe684003c40 con 0x7fe68c133fa0 2023-09-30T22:32:00.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.343+0000 7fe681ffb700 1 -- 172.21.15.59:0/755720340 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe6840403b0 con 0x7fe68c133fa0 2023-09-30T22:32:00.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.352+0000 7fe681ffb700 1 -- 172.21.15.59:0/755720340 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe684011740 con 0x7fe68c133fa0 2023-09-30T22:32:00.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.400+0000 7f142cfdd700 1 -- 172.21.15.59:0/2000766951 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f142813a5b0 con 0x7f1428135e50 2023-09-30T22:32:00.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.400+0000 7f1416ffd700 1 -- 172.21.15.59:0/2000766951 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f142002c020 con 0x7f1428135e50 2023-09-30T22:32:00.401 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:00.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.402+0000 7f142cfdd700 1 -- 172.21.15.59:0/2000766951 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1428135e50 msgr2=0x7f1428135270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.403+0000 7f142cfdd700 1 --2- 172.21.15.59:0/2000766951 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1428135e50 0x7f1428135270 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1420016000 tx=0x7f1420004ad0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.403+0000 7f142cfdd700 1 -- 172.21.15.59:0/2000766951 shutdown_connections 2023-09-30T22:32:00.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.403+0000 7f142cfdd700 1 --2- 172.21.15.59:0/2000766951 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1428135e50 0x7f1428135270 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.403+0000 7f142cfdd700 1 --2- 172.21.15.59:0/2000766951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f142809d6f0 0x7f14281347f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.403+0000 7f142cfdd700 1 --2- 172.21.15.59:0/2000766951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f142809e1d0 0x7f1428134d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.403+0000 7f142cfdd700 1 -- 172.21.15.59:0/2000766951 >> 172.21.15.59:0/2000766951 conn(0x7f1428066f50 msgr2=0x7f14280a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:00.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.403+0000 7f142cfdd700 1 -- 172.21.15.59:0/2000766951 shutdown_connections 2023-09-30T22:32:00.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.403+0000 7f142cfdd700 1 -- 172.21.15.59:0/2000766951 wait complete. 2023-09-30T22:32:00.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.543+0000 7f67ffefc700 1 -- 172.21.15.59:0/3771828456 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f67f811c170 con 0x7f67f81338a0 2023-09-30T22:32:00.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.543+0000 7f67ee7fc700 1 -- 172.21.15.59:0/3771828456 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f67f4007720 con 0x7f67f81338a0 2023-09-30T22:32:00.544 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:00.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.546+0000 7f67ffefc700 1 -- 172.21.15.59:0/3771828456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67f81338a0 msgr2=0x7f67f8119fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.546+0000 7f67ffefc700 1 --2- 172.21.15.59:0/3771828456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67f81338a0 0x7f67f8119fc0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f67f400c780 tx=0x7f67f400cb40 comp rx=0 tx=0).stop 2023-09-30T22:32:00.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.546+0000 7f67ffefc700 1 -- 172.21.15.59:0/3771828456 shutdown_connections 2023-09-30T22:32:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.546+0000 7f67ffefc700 1 --2- 172.21.15.59:0/3771828456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67f8139030 0x7f67f811aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.546+0000 7f67ffefc700 1 --2- 172.21.15.59:0/3771828456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67f81338a0 0x7f67f8119fc0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.546+0000 7f67ffefc700 1 --2- 172.21.15.59:0/3771828456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67f8136710 0x7f67f811a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.546+0000 7f67ffefc700 1 -- 172.21.15.59:0/3771828456 >> 172.21.15.59:0/3771828456 conn(0x7f67f80a2aa0 msgr2=0x7f67f8130050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.546+0000 7f67ffefc700 1 -- 172.21.15.59:0/3771828456 shutdown_connections 2023-09-30T22:32:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.546+0000 7f67ffefc700 1 -- 172.21.15.59:0/3771828456 wait complete. 2023-09-30T22:32:00.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.551+0000 7f0fb3e00700 1 -- 172.21.15.59:0/2986728723 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0fac1a5ee0 con 0x7f0fac09f240 2023-09-30T22:32:00.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.552+0000 7f0fa27fc700 1 -- 172.21.15.59:0/2986728723 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f9c020370 con 0x7f0fac09f240 2023-09-30T22:32:00.552 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:00.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.555+0000 7f0fb3e00700 1 -- 172.21.15.59:0/2986728723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f240 msgr2=0x7f0fac1a39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.555+0000 7f0fb3e00700 1 --2- 172.21.15.59:0/2986728723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f240 0x7f0fac1a39f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c012bf0 tx=0x7f0f9c012f00 comp rx=0 tx=0).stop 2023-09-30T22:32:00.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.555+0000 7f0fb3e00700 1 -- 172.21.15.59:0/2986728723 shutdown_connections 2023-09-30T22:32:00.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.555+0000 7f0fb3e00700 1 --2- 172.21.15.59:0/2986728723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fac09f650 0x7f0fac1c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.555+0000 7f0fb3e00700 1 --2- 172.21.15.59:0/2986728723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09e930 0x7f0fac1a34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.555+0000 7f0fb3e00700 1 --2- 172.21.15.59:0/2986728723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f240 0x7f0fac1a39f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.555+0000 7f0fb3e00700 1 -- 172.21.15.59:0/2986728723 >> 172.21.15.59:0/2986728723 conn(0x7f0fac0a4210 msgr2=0x7f0fac1b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:00.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.555+0000 7f0fb3e00700 1 -- 172.21.15.59:0/2986728723 shutdown_connections 2023-09-30T22:32:00.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.555+0000 7f0fb3e00700 1 -- 172.21.15.59:0/2986728723 wait complete. 2023-09-30T22:32:00.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:00.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:00.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.600+0000 7fe693982700 1 -- 172.21.15.59:0/755720340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe68c0a1d90 con 0x7fe68c133fa0 2023-09-30T22:32:00.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.600+0000 7fe681ffb700 1 -- 172.21.15.59:0/755720340 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe684011380 con 0x7fe68c133fa0 2023-09-30T22:32:00.600 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:00.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.602+0000 7fe693982700 1 -- 172.21.15.59:0/755720340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68c133fa0 msgr2=0x7fe68c11e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.602+0000 7fe693982700 1 --2- 172.21.15.59:0/755720340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68c133fa0 0x7fe68c11e7d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe68400cc80 tx=0x7fe68400a340 comp rx=0 tx=0).stop 2023-09-30T22:32:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.602+0000 7fe693982700 1 -- 172.21.15.59:0/755720340 shutdown_connections 2023-09-30T22:32:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.602+0000 7fe693982700 1 --2- 172.21.15.59:0/755720340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68c133fa0 0x7fe68c11e7d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.602+0000 7fe693982700 1 --2- 172.21.15.59:0/755720340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68c0a0a30 0x7fe68c1c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.602+0000 7fe693982700 1 --2- 172.21.15.59:0/755720340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68c0a1340 0x7fe68c1c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.602+0000 7fe693982700 1 -- 172.21.15.59:0/755720340 >> 172.21.15.59:0/755720340 conn(0x7fe68c0a6550 msgr2=0x7fe68c1b9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.602+0000 7fe693982700 1 -- 172.21.15.59:0/755720340 shutdown_connections 2023-09-30T22:32:00.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:00.602+0000 7fe693982700 1 -- 172.21.15.59:0/755720340 wait complete. 2023-09-30T22:32:00.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:01.418 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:01.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.565+0000 7f9412aef700 1 Processor -- start 2023-09-30T22:32:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.565+0000 7f9412aef700 1 -- start start 2023-09-30T22:32:01.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f9412aef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f940c133a80 0x7f940c133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f9412aef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f940c130a40 0x7f940c13b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f9412aef700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940c06bc00 con 0x7f940c12ff20 2023-09-30T22:32:01.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f9412aef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940c06c570 con 0x7f940c133a80 2023-09-30T22:32:01.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f9412aef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f940c0a0040 con 0x7f940c130a40 2023-09-30T22:32:01.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f941088b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f940c133a80 0x7f940c133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f941108c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f940c130a40 0x7f940c13b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f940bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f940c12ff20 0x7f940c130330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49918/0 (socket says 172.21.15.59:49918) 2023-09-30T22:32:01.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f940bfff700 1 -- 172.21.15.59:0/884577466 learned_addr learned my addr 172.21.15.59:0/884577466 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:01.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f941088b700 1 -- 172.21.15.59:0/884577466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f940c130a40 msgr2=0x7f940c13b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:01.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f940b7fe700 1 -- 172.21.15.59:0/884577466 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968639368 0 0) 0x7f940c06bc00 con 0x7f940c12ff20 2023-09-30T22:32:01.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f941088b700 1 --2- 172.21.15.59:0/884577466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f940c130a40 0x7f940c13b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f941088b700 1 -- 172.21.15.59:0/884577466 >> v1:172.21.15.59:6789/0 conn(0x7f940c12ff20 legacy=0x7f940c130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f941088b700 1 -- 172.21.15.59:0/884577466 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c133860 con 0x7f940c133a80 2023-09-30T22:32:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f941108c700 1 --2- 172.21.15.59:0/884577466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f940c130a40 0x7f940c13b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.566+0000 7f941088b700 1 --2- 172.21.15.59:0/884577466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f940c133a80 0x7f940c133e50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9400009870 tx=0x7f9400009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83b86bd1727db1b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.567+0000 7f940b7fe700 1 -- 172.21.15.59:0/884577466 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400011830 con 0x7f940c133a80 2023-09-30T22:32:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.567+0000 7f940b7fe700 1 -- 172.21.15.59:0/884577466 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9400011990 con 0x7f940c133a80 2023-09-30T22:32:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.567+0000 7f940b7fe700 1 -- 172.21.15.59:0/884577466 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400011d20 con 0x7f940c133a80 2023-09-30T22:32:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.567+0000 7f9412aef700 1 -- 172.21.15.59:0/884577466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f940c133a80 msgr2=0x7f940c133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.567+0000 7f9412aef700 1 --2- 172.21.15.59:0/884577466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f940c133a80 0x7f940c133e50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9400009870 tx=0x7f9400009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:01.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.567+0000 7f9412aef700 1 -- 172.21.15.59:0/884577466 shutdown_connections 2023-09-30T22:32:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.567+0000 7f9412aef700 1 --2- 172.21.15.59:0/884577466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f940c130a40 0x7f940c13b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.567+0000 7f9412aef700 1 --2- 172.21.15.59:0/884577466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f940c133a80 0x7f940c133e50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.567+0000 7f9412aef700 1 -- 172.21.15.59:0/884577466 >> 172.21.15.59:0/884577466 conn(0x7f940c0a4210 msgr2=0x7f940c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.567+0000 7f9412aef700 1 -- 172.21.15.59:0/884577466 shutdown_connections 2023-09-30T22:32:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.567+0000 7f9412aef700 1 -- 172.21.15.59:0/884577466 wait complete. 2023-09-30T22:32:01.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.569+0000 7f9412aef700 1 Processor -- start 2023-09-30T22:32:01.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.569+0000 7f9412aef700 1 -- start start 2023-09-30T22:32:01.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f9412aef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f940c12ff20 0x7f940c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f9412aef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f940c130a40 0x7f940c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f9412aef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f940c133a80 0x7f940c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f9412aef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c09de50 con 0x7f940c133a80 2023-09-30T22:32:01.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f9412aef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940c09e080 con 0x7f940c12ff20 2023-09-30T22:32:01.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f9412aef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f940c11fb90 con 0x7f940c130a40 2023-09-30T22:32:01.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f940bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f940c130a40 0x7f940c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f941108c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f940c133a80 0x7f940c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f941088b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f940c12ff20 0x7f940c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f940bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f940c130a40 0x7f940c09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56154/0 (socket says 172.21.15.59:56154) 2023-09-30T22:32:01.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f940bfff700 1 -- 172.21.15.59:0/817175214 learned_addr learned my addr 172.21.15.59:0/817175214 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:01.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f941108c700 1 -- 172.21.15.59:0/817175214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f940c130a40 msgr2=0x7f940c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f941108c700 1 --2- 172.21.15.59:0/817175214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f940c130a40 0x7f940c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f941108c700 1 -- 172.21.15.59:0/817175214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f940c12ff20 msgr2=0x7f940c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f941108c700 1 --2- 172.21.15.59:0/817175214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f940c12ff20 0x7f940c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f941108c700 1 -- 172.21.15.59:0/817175214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9404009a70 con 0x7f940c133a80 2023-09-30T22:32:01.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f940bfff700 1 --2- 172.21.15.59:0/817175214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f940c130a40 0x7f940c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:01.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.570+0000 7f941088b700 1 --2- 172.21.15.59:0/817175214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f940c12ff20 0x7f940c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:01.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.571+0000 7f941108c700 1 --2- 172.21.15.59:0/817175214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f940c133a80 0x7f940c09cf00 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f940400efc0 tx=0x7f940400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:01.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.571+0000 7f94097fa700 1 -- 172.21.15.59:0/817175214 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940400ca90 con 0x7f940c133a80 2023-09-30T22:32:01.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.571+0000 7f94097fa700 1 -- 172.21.15.59:0/817175214 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940400f040 con 0x7f940c133a80 2023-09-30T22:32:01.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.571+0000 7f9412aef700 1 -- 172.21.15.59:0/817175214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94000094a0 con 0x7f940c133a80 2023-09-30T22:32:01.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.571+0000 7f94097fa700 1 -- 172.21.15.59:0/817175214 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940400ce30 con 0x7f940c133a80 2023-09-30T22:32:01.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.571+0000 7f9412aef700 1 -- 172.21.15.59:0/817175214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f940c12d990 con 0x7f940c133a80 2023-09-30T22:32:01.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.572+0000 7f94097fa700 1 -- 172.21.15.59:0/817175214 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9404014480 con 0x7f940c133a80 2023-09-30T22:32:01.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.572+0000 7f94097fa700 1 -- 172.21.15.59:0/817175214 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f940403fc20 con 0x7f940c133a80 2023-09-30T22:32:01.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.572+0000 7f9412aef700 1 -- 172.21.15.59:0/817175214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f940c074ea0 con 0x7f940c133a80 2023-09-30T22:32:01.576 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:01.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.577+0000 7f94097fa700 1 -- 172.21.15.59:0/817175214 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9404012930 con 0x7f940c133a80 2023-09-30T22:32:01.617 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:01.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.706+0000 7fd02c09b700 1 Processor -- start 2023-09-30T22:32:01.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.706+0000 7fd02c09b700 1 -- start start 2023-09-30T22:32:01.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.706+0000 7fd02c09b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd02409e1d0 0x7fd024138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.706+0000 7fd02c09b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024139170 0x7fd02413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.706+0000 7fd02c09b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd02409b120 con 0x7fd02409d6f0 2023-09-30T22:32:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.706+0000 7fd02c09b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02406b460 con 0x7fd024139170 2023-09-30T22:32:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.706+0000 7fd02c09b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd02409a7e0 con 0x7fd02409e1d0 2023-09-30T22:32:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.707+0000 7fd029636700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd02409e1d0 0x7fd024138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.707+0000 7fd02a638700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024139170 0x7fd02413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.707+0000 7fd029636700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd02409e1d0 0x7fd024138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56166/0 (socket says 172.21.15.59:56166) 2023-09-30T22:32:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.707+0000 7fd029e37700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd02409d6f0 0x7fd02409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49920/0 (socket says 172.21.15.59:49920) 2023-09-30T22:32:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.707+0000 7fd029636700 1 -- 172.21.15.59:0/913034952 learned_addr learned my addr 172.21.15.59:0/913034952 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.707+0000 7fd02a638700 1 -- 172.21.15.59:0/913034952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd02409e1d0 msgr2=0x7fd024138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.707+0000 7fd02a638700 1 --2- 172.21.15.59:0/913034952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd02409e1d0 0x7fd024138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.707+0000 7fd02a638700 1 -- 172.21.15.59:0/913034952 >> v1:172.21.15.59:6789/0 conn(0x7fd02409d6f0 legacy=0x7fd02409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.707+0000 7fd02a638700 1 -- 172.21.15.59:0/913034952 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02409a500 con 0x7fd024139170 2023-09-30T22:32:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.707+0000 7fd029636700 1 --2- 172.21.15.59:0/913034952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd02409e1d0 0x7fd024138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.707+0000 7fd02a638700 1 --2- 172.21.15.59:0/913034952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024139170 0x7fd02413b550 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd01c009dc0 tx=0x7fd01c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7401687040db8142 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.708+0000 7fd028e35700 1 -- 172.21.15.59:0/913034952 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c00e070 con 0x7fd024139170 2023-09-30T22:32:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.708+0000 7fd028e35700 1 -- 172.21.15.59:0/913034952 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c00bb20 con 0x7fd024139170 2023-09-30T22:32:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.708+0000 7fd028e35700 1 -- 172.21.15.59:0/913034952 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c012430 con 0x7fd024139170 2023-09-30T22:32:01.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.709+0000 7fd02c09b700 1 -- 172.21.15.59:0/913034952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024139170 msgr2=0x7fd02413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.709+0000 7fd02c09b700 1 --2- 172.21.15.59:0/913034952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024139170 0x7fd02413b550 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd01c009dc0 tx=0x7fd01c00b330 comp rx=0 tx=0).stop 2023-09-30T22:32:01.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.709+0000 7fd02c09b700 1 -- 172.21.15.59:0/913034952 shutdown_connections 2023-09-30T22:32:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.709+0000 7fd02c09b700 1 --2- 172.21.15.59:0/913034952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024139170 0x7fd02413b550 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.709+0000 7fd02c09b700 1 --2- 172.21.15.59:0/913034952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd02409e1d0 0x7fd024138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.709+0000 7fd02c09b700 1 -- 172.21.15.59:0/913034952 >> 172.21.15.59:0/913034952 conn(0x7fd024066f50 msgr2=0x7fd02409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.709+0000 7fd02c09b700 1 -- 172.21.15.59:0/913034952 shutdown_connections 2023-09-30T22:32:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.709+0000 7fd02c09b700 1 -- 172.21.15.59:0/913034952 wait complete. 2023-09-30T22:32:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.710+0000 7fd02c09b700 1 Processor -- start 2023-09-30T22:32:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.710+0000 7fd02c09b700 1 -- start start 2023-09-30T22:32:01.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.711+0000 7fd02c09b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd02409d6f0 0x7fd02411e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.711+0000 7fd02c09b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02409e1d0 0x7fd02411ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.711+0000 7fd02c09b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024139170 0x7fd02411f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.711+0000 7fd02c09b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0240a1990 con 0x7fd024139170 2023-09-30T22:32:01.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.711+0000 7fd02c09b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd024120490 con 0x7fd02409e1d0 2023-09-30T22:32:01.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.711+0000 7fd02c09b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd024121fb0 con 0x7fd02409d6f0 2023-09-30T22:32:01.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.711+0000 7fd029e37700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd02409d6f0 0x7fd02411e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.711+0000 7fd029e37700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd02409d6f0 0x7fd02411e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56174/0 (socket says 172.21.15.59:56174) 2023-09-30T22:32:01.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.711+0000 7fd029e37700 1 -- 172.21.15.59:0/3323563300 learned_addr learned my addr 172.21.15.59:0/3323563300 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:01.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.712+0000 7fd02a638700 1 --2- 172.21.15.59:0/3323563300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024139170 0x7fd02411f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.712+0000 7fd029e37700 1 -- 172.21.15.59:0/3323563300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02409e1d0 msgr2=0x7fd02411ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.712+0000 7fd029636700 1 --2- 172.21.15.59:0/3323563300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02409e1d0 0x7fd02411ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.712+0000 7fd029e37700 1 --2- 172.21.15.59:0/3323563300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02409e1d0 0x7fd02411ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.712+0000 7fd029e37700 1 -- 172.21.15.59:0/3323563300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024139170 msgr2=0x7fd02411f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.712+0000 7fd029e37700 1 --2- 172.21.15.59:0/3323563300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024139170 0x7fd02411f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.712+0000 7fd029e37700 1 -- 172.21.15.59:0/3323563300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd014009550 con 0x7fd02409d6f0 2023-09-30T22:32:01.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.712+0000 7fd02a638700 1 --2- 172.21.15.59:0/3323563300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024139170 0x7fd02411f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:01.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.712+0000 7fd029636700 1 --2- 172.21.15.59:0/3323563300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02409e1d0 0x7fd02411ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:01.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.712+0000 7fd029e37700 1 --2- 172.21.15.59:0/3323563300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd02409d6f0 0x7fd02411e8e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd02000c520 tx=0x7fd02000c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:01.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.712+0000 7fd01a7fc700 1 -- 172.21.15.59:0/3323563300 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020005cb0 con 0x7fd02409d6f0 2023-09-30T22:32:01.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.712+0000 7fd01a7fc700 1 -- 172.21.15.59:0/3323563300 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd020005e10 con 0x7fd02409d6f0 2023-09-30T22:32:01.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.712+0000 7fd02c09b700 1 -- 172.21.15.59:0/3323563300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd01c009a70 con 0x7fd02409d6f0 2023-09-30T22:32:01.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.712+0000 7fd01a7fc700 1 -- 172.21.15.59:0/3323563300 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0200072d0 con 0x7fd02409d6f0 2023-09-30T22:32:01.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.712+0000 7fd02c09b700 1 -- 172.21.15.59:0/3323563300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd024120b70 con 0x7fd02409d6f0 2023-09-30T22:32:01.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.713+0000 7fd01a7fc700 1 -- 172.21.15.59:0/3323563300 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd020007430 con 0x7fd02409d6f0 2023-09-30T22:32:01.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.713+0000 7fd01a7fc700 1 -- 172.21.15.59:0/3323563300 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd02003ecd0 con 0x7fd02409d6f0 2023-09-30T22:32:01.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.715+0000 7fd02c09b700 1 -- 172.21.15.59:0/3323563300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd024074ea0 con 0x7fd02409d6f0 2023-09-30T22:32:01.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.720+0000 7fd01a7fc700 1 -- 172.21.15.59:0/3323563300 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd020017070 con 0x7fd02409d6f0 2023-09-30T22:32:01.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.721+0000 7f9bc2b77700 1 Processor -- start 2023-09-30T22:32:01.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.721+0000 7f9bc2b77700 1 -- start start 2023-09-30T22:32:01.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.721+0000 7f9bc2b77700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc09d6f0 0x7f9bbc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.721+0000 7f9bc2b77700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bbc09e000 0x7f9bbc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.721+0000 7f9bc2b77700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc09b120 con 0x7f9bbc09e410 2023-09-30T22:32:01.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.721+0000 7f9bc2b77700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc06b460 con 0x7f9bbc09e000 2023-09-30T22:32:01.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.721+0000 7f9bc2b77700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc09a7e0 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.721+0000 7f9bc0913700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc09d6f0 0x7f9bbc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.721+0000 7f9bc0913700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc09d6f0 0x7f9bbc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56182/0 (socket says 172.21.15.59:56182) 2023-09-30T22:32:01.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.721+0000 7f9bc0913700 1 -- 172.21.15.59:0/4063533372 learned_addr learned my addr 172.21.15.59:0/4063533372 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:01.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.722+0000 7f9bc0913700 1 -- 172.21.15.59:0/4063533372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bbc09e000 msgr2=0x7f9bbc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:01.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.722+0000 7f9bc0913700 1 --2- 172.21.15.59:0/4063533372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bbc09e000 0x7f9bbc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.722+0000 7f9bc0913700 1 -- 172.21.15.59:0/4063533372 >> v1:172.21.15.59:6789/0 conn(0x7f9bbc09e410 legacy=0x7f9bbc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:01.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.722+0000 7f9bc0913700 1 -- 172.21.15.59:0/4063533372 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc09a500 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.722+0000 7f9bc0913700 1 --2- 172.21.15.59:0/4063533372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc09d6f0 0x7f9bbc09dac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009950 tx=0x7f9bb0009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50728034d8b58770 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:01.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.722+0000 7f9bbb7fe700 1 -- 172.21.15.59:0/4063533372 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0009ea0 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.722+0000 7f9bbb7fe700 1 -- 172.21.15.59:0/4063533372 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb0004230 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.722+0000 7f9bbb7fe700 1 -- 172.21.15.59:0/4063533372 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb000b7e0 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.723+0000 7f9bc2b77700 1 -- 172.21.15.59:0/4063533372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc09d6f0 msgr2=0x7f9bbc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.723+0000 7f9bc2b77700 1 --2- 172.21.15.59:0/4063533372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc09d6f0 0x7f9bbc09dac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009950 tx=0x7f9bb0009c60 comp rx=0 tx=0).stop 2023-09-30T22:32:01.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.723+0000 7f9bc2b77700 1 -- 172.21.15.59:0/4063533372 shutdown_connections 2023-09-30T22:32:01.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.723+0000 7f9bc2b77700 1 --2- 172.21.15.59:0/4063533372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc09d6f0 0x7f9bbc09dac0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.723+0000 7f9bc2b77700 1 --2- 172.21.15.59:0/4063533372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bbc09e000 0x7f9bbc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.723+0000 7f9bc2b77700 1 -- 172.21.15.59:0/4063533372 >> 172.21.15.59:0/4063533372 conn(0x7f9bbc066f50 msgr2=0x7f9bbc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:01.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.723+0000 7f9bc2b77700 1 -- 172.21.15.59:0/4063533372 shutdown_connections 2023-09-30T22:32:01.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.723+0000 7f9bc2b77700 1 -- 172.21.15.59:0/4063533372 wait complete. 2023-09-30T22:32:01.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.725+0000 7f9bc2b77700 1 Processor -- start 2023-09-30T22:32:01.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.725+0000 7f9bc2b77700 1 -- start start 2023-09-30T22:32:01.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.726+0000 7f9bc2b77700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc09d6f0 0x7f9bbc122580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.726+0000 7f9bc2b77700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc09e000 0x7f9bbc122ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.726+0000 7f9bc2b77700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bbc09e410 0x7f9bbc123000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.726+0000 7f9bc2b77700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc133080 con 0x7f9bbc09e000 2023-09-30T22:32:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.726+0000 7f9bc2b77700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc124230 con 0x7f9bbc09e410 2023-09-30T22:32:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.726+0000 7f9bc2b77700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc125b00 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.726+0000 7f9bc0913700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc09d6f0 0x7f9bbc122580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.726+0000 7f9bc0913700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc09d6f0 0x7f9bbc122580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56190/0 (socket says 172.21.15.59:56190) 2023-09-30T22:32:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.726+0000 7f9bc0913700 1 -- 172.21.15.59:0/3673581431 learned_addr learned my addr 172.21.15.59:0/3673581431 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.726+0000 7f9bc1114700 1 --2- 172.21.15.59:0/3673581431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bbc09e410 0x7f9bbc123000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.726+0000 7f9bbbfff700 1 --2- 172.21.15.59:0/3673581431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc09e000 0x7f9bbc122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.726+0000 7f9bc0913700 1 -- 172.21.15.59:0/3673581431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bbc09e410 msgr2=0x7f9bbc123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.726+0000 7f9bc0913700 1 --2- 172.21.15.59:0/3673581431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bbc09e410 0x7f9bbc123000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.726+0000 7f9bc0913700 1 -- 172.21.15.59:0/3673581431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc09e000 msgr2=0x7f9bbc122ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.726+0000 7f9bc0913700 1 --2- 172.21.15.59:0/3673581431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc09e000 0x7f9bbc122ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.727+0000 7f9bc0913700 1 -- 172.21.15.59:0/3673581431 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb0009550 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.727+0000 7f9bbbfff700 1 --2- 172.21.15.59:0/3673581431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc09e000 0x7f9bbc122ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.727+0000 7f9bc0913700 1 --2- 172.21.15.59:0/3673581431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc09d6f0 0x7f9bbc122580 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009130 tx=0x7f9bb0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.727+0000 7f9bb97fa700 1 -- 172.21.15.59:0/3673581431 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb00036a0 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.727+0000 7f9bb97fa700 1 -- 172.21.15.59:0/3673581431 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb001f070 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.727+0000 7f9bc2b77700 1 -- 172.21.15.59:0/3673581431 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc0a1e90 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.727+0000 7f9bb97fa700 1 -- 172.21.15.59:0/3673581431 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0003a20 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.727+0000 7f9bc2b77700 1 -- 172.21.15.59:0/3673581431 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc126830 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.728+0000 7f9bb97fa700 1 -- 172.21.15.59:0/3673581431 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9bb0021030 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.728+0000 7f9bb97fa700 1 -- 172.21.15.59:0/3673581431 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9bb0040cb0 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.732+0000 7f9bc2b77700 1 -- 172.21.15.59:0/3673581431 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc074ea0 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.742+0000 7f9bb97fa700 1 -- 172.21.15.59:0/3673581431 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9bb00233d0 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.763+0000 7f0d34e32700 1 Processor -- start 2023-09-30T22:32:01.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.763+0000 7f0d34e32700 1 -- start start 2023-09-30T22:32:01.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.764+0000 7f0d34e32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d3009e930 0x7f0d3009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.764+0000 7f0d34e32700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0d3009f650 0x7f0d30131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.764+0000 7f0d34e32700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d30070940 con 0x7f0d3009f240 2023-09-30T22:32:01.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.764+0000 7f0d34e32700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3006fd60 con 0x7f0d3009f650 2023-09-30T22:32:01.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.764+0000 7f0d34e32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3006fa80 con 0x7f0d3009e930 2023-09-30T22:32:01.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.764+0000 7f0d2dd9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0d3009f240 0x7f0d301317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49930/0 (socket says 172.21.15.59:49930) 2023-09-30T22:32:01.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.764+0000 7f0d2dd9b700 1 -- 172.21.15.59:0/3801065612 learned_addr learned my addr 172.21.15.59:0/3801065612 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:01.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.764+0000 7f0d2ed9d700 1 --2- 172.21.15.59:0/3801065612 >> v2:172.21.15.59:3300/0 conn(0x7f0d3009f650 0x7f0d30131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.764+0000 7f0d2e59c700 1 --2- 172.21.15.59:0/3801065612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d3009e930 0x7f0d3009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.764+0000 7f0d2ed9d700 1 -- 172.21.15.59:0/3801065612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d3009e930 msgr2=0x7f0d3009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.764+0000 7f0d2ed9d700 1 --2- 172.21.15.59:0/3801065612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d3009e930 0x7f0d3009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.764+0000 7f0d2ed9d700 1 -- 172.21.15.59:0/3801065612 >> v1:172.21.15.59:6789/0 conn(0x7f0d3009f240 legacy=0x7f0d301317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.764+0000 7f0d2ed9d700 1 -- 172.21.15.59:0/3801065612 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3009fb60 con 0x7f0d3009f650 2023-09-30T22:32:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.765+0000 7f0d2ed9d700 1 --2- 172.21.15.59:0/3801065612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d3009f650 0x7f0d30131f00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0d28009d90 tx=0x7f0d2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79859d9200430719 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.765+0000 7f0d2d59a700 1 -- 172.21.15.59:0/3801065612 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2800e070 con 0x7f0d3009f650 2023-09-30T22:32:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.765+0000 7f0d2d59a700 1 -- 172.21.15.59:0/3801065612 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2800bb20 con 0x7f0d3009f650 2023-09-30T22:32:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.765+0000 7f0d2d59a700 1 -- 172.21.15.59:0/3801065612 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28012430 con 0x7f0d3009f650 2023-09-30T22:32:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.766+0000 7f0d34e32700 1 -- 172.21.15.59:0/3801065612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d3009f650 msgr2=0x7f0d30131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.766+0000 7f0d34e32700 1 --2- 172.21.15.59:0/3801065612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d3009f650 0x7f0d30131f00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0d28009d90 tx=0x7f0d2800b330 comp rx=0 tx=0).stop 2023-09-30T22:32:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.766+0000 7f0d34e32700 1 -- 172.21.15.59:0/3801065612 shutdown_connections 2023-09-30T22:32:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.766+0000 7f0d34e32700 1 --2- 172.21.15.59:0/3801065612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d3009f650 0x7f0d30131f00 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.766+0000 7f0d34e32700 1 --2- 172.21.15.59:0/3801065612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d3009e930 0x7f0d3009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.766+0000 7f0d34e32700 1 -- 172.21.15.59:0/3801065612 >> 172.21.15.59:0/3801065612 conn(0x7f0d300a4210 msgr2=0x7f0d300a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.766+0000 7f0d34e32700 1 -- 172.21.15.59:0/3801065612 shutdown_connections 2023-09-30T22:32:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.766+0000 7f0d34e32700 1 -- 172.21.15.59:0/3801065612 wait complete. 2023-09-30T22:32:01.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.767+0000 7f0d34e32700 1 Processor -- start 2023-09-30T22:32:01.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.767+0000 7f0d34e32700 1 -- start start 2023-09-30T22:32:01.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.767+0000 7f0d34e32700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d3009e930 0x7f0d301c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d34e32700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d3009f240 0x7f0d301c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d34e32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d3009f650 0x7f0d301c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d34e32700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d301a8c20 con 0x7f0d3009e930 2023-09-30T22:32:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d34e32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d301a9970 con 0x7f0d3009f650 2023-09-30T22:32:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d34e32700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d301c9070 con 0x7f0d3009f240 2023-09-30T22:32:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d2e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d3009e930 0x7f0d301c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d2dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d3009f240 0x7f0d301c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d2ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d3009f650 0x7f0d301c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d2e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d3009e930 0x7f0d301c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55344/0 (socket says 172.21.15.59:55344) 2023-09-30T22:32:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d2e59c700 1 -- 172.21.15.59:0/140656738 learned_addr learned my addr 172.21.15.59:0/140656738 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d2e59c700 1 -- 172.21.15.59:0/140656738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d3009f240 msgr2=0x7f0d301c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d2e59c700 1 --2- 172.21.15.59:0/140656738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d3009f240 0x7f0d301c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d2e59c700 1 -- 172.21.15.59:0/140656738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d3009f650 msgr2=0x7f0d301c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d2e59c700 1 --2- 172.21.15.59:0/140656738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d3009f650 0x7f0d301c4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d2e59c700 1 -- 172.21.15.59:0/140656738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d28009a70 con 0x7f0d3009e930 2023-09-30T22:32:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d2dd9b700 1 --2- 172.21.15.59:0/140656738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d3009f240 0x7f0d301c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d2ed9d700 1 --2- 172.21.15.59:0/140656738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d3009f650 0x7f0d301c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.768+0000 7f0d2e59c700 1 --2- 172.21.15.59:0/140656738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d3009e930 0x7f0d301c85f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000e9b0 tx=0x7f0d2000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.769+0000 7f0d1effd700 1 -- 172.21.15.59:0/140656738 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d20009710 con 0x7f0d3009e930 2023-09-30T22:32:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.769+0000 7f0d1effd700 1 -- 172.21.15.59:0/140656738 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2000ee50 con 0x7f0d3009e930 2023-09-30T22:32:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.769+0000 7f0d1effd700 1 -- 172.21.15.59:0/140656738 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2000ca50 con 0x7f0d3009e930 2023-09-30T22:32:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.769+0000 7f0d34e32700 1 -- 172.21.15.59:0/140656738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d300a0190 con 0x7f0d3009e930 2023-09-30T22:32:01.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.769+0000 7f0d34e32700 1 -- 172.21.15.59:0/140656738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d301a87d0 con 0x7f0d3009e930 2023-09-30T22:32:01.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.770+0000 7f0d1effd700 1 -- 172.21.15.59:0/140656738 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d2000cbb0 con 0x7f0d3009e930 2023-09-30T22:32:01.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.770+0000 7f0d34e32700 1 -- 172.21.15.59:0/140656738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d30074ea0 con 0x7f0d3009e930 2023-09-30T22:32:01.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.770+0000 7f0d1effd700 1 -- 172.21.15.59:0/140656738 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0d2003f6b0 con 0x7f0d3009e930 2023-09-30T22:32:01.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.779+0000 7f0d1effd700 1 -- 172.21.15.59:0/140656738 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d200232f0 con 0x7f0d3009e930 2023-09-30T22:32:01.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.817+0000 7f9412aef700 1 -- 172.21.15.59:0/817175214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f940c11feb0 con 0x7f940c133a80 2023-09-30T22:32:01.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.818+0000 7f94097fa700 1 -- 172.21.15.59:0/817175214 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9404012340 con 0x7f940c133a80 2023-09-30T22:32:01.818 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:01.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.821+0000 7f9412aef700 1 -- 172.21.15.59:0/817175214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f940c133a80 msgr2=0x7f940c09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.821+0000 7f9412aef700 1 --2- 172.21.15.59:0/817175214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f940c133a80 0x7f940c09cf00 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f940400efc0 tx=0x7f940400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.821+0000 7f9412aef700 1 -- 172.21.15.59:0/817175214 shutdown_connections 2023-09-30T22:32:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.821+0000 7f9412aef700 1 --2- 172.21.15.59:0/817175214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f940c133a80 0x7f940c09cf00 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.821+0000 7f9412aef700 1 --2- 172.21.15.59:0/817175214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f940c12ff20 0x7f940c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.821+0000 7f9412aef700 1 --2- 172.21.15.59:0/817175214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f940c130a40 0x7f940c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.821+0000 7f9412aef700 1 -- 172.21.15.59:0/817175214 >> 172.21.15.59:0/817175214 conn(0x7f940c0a4210 msgr2=0x7f940c09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.821+0000 7f9412aef700 1 -- 172.21.15.59:0/817175214 shutdown_connections 2023-09-30T22:32:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.821+0000 7f9412aef700 1 -- 172.21.15.59:0/817175214 wait complete. 2023-09-30T22:32:01.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:01.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.951+0000 7fd02c09b700 1 -- 172.21.15.59:0/3323563300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd02406c360 con 0x7fd02409d6f0 2023-09-30T22:32:01.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.951+0000 7fd01a7fc700 1 -- 172.21.15.59:0/3323563300 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd02001b3b0 con 0x7fd02409d6f0 2023-09-30T22:32:01.951 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:01.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.953+0000 7fd02c09b700 1 -- 172.21.15.59:0/3323563300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd02409d6f0 msgr2=0x7fd02411e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.953+0000 7fd02c09b700 1 --2- 172.21.15.59:0/3323563300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd02409d6f0 0x7fd02411e8e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd02000c520 tx=0x7fd02000c8e0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.953+0000 7fd02c09b700 1 -- 172.21.15.59:0/3323563300 shutdown_connections 2023-09-30T22:32:01.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.953+0000 7fd02c09b700 1 --2- 172.21.15.59:0/3323563300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd02409d6f0 0x7fd02411e8e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.953+0000 7fd02c09b700 1 --2- 172.21.15.59:0/3323563300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024139170 0x7fd02411f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.953+0000 7fd02c09b700 1 --2- 172.21.15.59:0/3323563300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02409e1d0 0x7fd02411ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.953+0000 7fd02c09b700 1 -- 172.21.15.59:0/3323563300 >> 172.21.15.59:0/3323563300 conn(0x7fd024066f50 msgr2=0x7fd02409b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:01.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.954+0000 7fd02c09b700 1 -- 172.21.15.59:0/3323563300 shutdown_connections 2023-09-30T22:32:01.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.954+0000 7fd02c09b700 1 -- 172.21.15.59:0/3323563300 wait complete. 2023-09-30T22:32:01.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.961+0000 7f9bc2b77700 1 -- 172.21.15.59:0/3673581431 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9bbc074ea0 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.961+0000 7f9bb97fa700 1 -- 172.21.15.59:0/3673581431 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9bb0035090 con 0x7f9bbc09d6f0 2023-09-30T22:32:01.962 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:01.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.964+0000 7f9bc2b77700 1 -- 172.21.15.59:0/3673581431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc09d6f0 msgr2=0x7f9bbc122580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:01.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.964+0000 7f9bc2b77700 1 --2- 172.21.15.59:0/3673581431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc09d6f0 0x7f9bbc122580 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009130 tx=0x7f9bb0004750 comp rx=0 tx=0).stop 2023-09-30T22:32:01.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.964+0000 7f9bc2b77700 1 -- 172.21.15.59:0/3673581431 shutdown_connections 2023-09-30T22:32:01.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.964+0000 7f9bc2b77700 1 --2- 172.21.15.59:0/3673581431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc09d6f0 0x7f9bbc122580 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.964+0000 7f9bc2b77700 1 --2- 172.21.15.59:0/3673581431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bbc09e410 0x7f9bbc123000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.964+0000 7f9bc2b77700 1 --2- 172.21.15.59:0/3673581431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc09e000 0x7f9bbc122ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:01.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.964+0000 7f9bc2b77700 1 -- 172.21.15.59:0/3673581431 >> 172.21.15.59:0/3673581431 conn(0x7f9bbc066f50 msgr2=0x7f9bbc133f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:01.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.964+0000 7f9bc2b77700 1 -- 172.21.15.59:0/3673581431 shutdown_connections 2023-09-30T22:32:01.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:01.964+0000 7f9bc2b77700 1 -- 172.21.15.59:0/3673581431 wait complete. 2023-09-30T22:32:01.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:01.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:02.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.001+0000 7f0d34e32700 1 -- 172.21.15.59:0/140656738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d301a7a60 con 0x7f0d3009e930 2023-09-30T22:32:02.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.002+0000 7f0d1effd700 1 -- 172.21.15.59:0/140656738 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d20021070 con 0x7f0d3009e930 2023-09-30T22:32:02.002 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:02.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.004+0000 7f0d34e32700 1 -- 172.21.15.59:0/140656738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d3009e930 msgr2=0x7f0d301c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:02.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.004+0000 7f0d34e32700 1 --2- 172.21.15.59:0/140656738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d3009e930 0x7f0d301c85f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000e9b0 tx=0x7f0d2000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:32:02.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.004+0000 7f0d34e32700 1 -- 172.21.15.59:0/140656738 shutdown_connections 2023-09-30T22:32:02.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.004+0000 7f0d34e32700 1 --2- 172.21.15.59:0/140656738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d3009f650 0x7f0d301c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:02.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.004+0000 7f0d34e32700 1 --2- 172.21.15.59:0/140656738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d3009e930 0x7f0d301c85f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:02.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.004+0000 7f0d34e32700 1 --2- 172.21.15.59:0/140656738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d3009f240 0x7f0d301c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:02.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.004+0000 7f0d34e32700 1 -- 172.21.15.59:0/140656738 >> 172.21.15.59:0/140656738 conn(0x7f0d300a4210 msgr2=0x7f0d301bae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:02.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.004+0000 7f0d34e32700 1 -- 172.21.15.59:0/140656738 shutdown_connections 2023-09-30T22:32:02.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.004+0000 7f0d34e32700 1 -- 172.21.15.59:0/140656738 wait complete. 2023-09-30T22:32:02.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:02.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:02.969 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:02.979 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.991+0000 7f86407ff700 1 Processor -- start 2023-09-30T22:32:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.991+0000 7f86407ff700 1 -- start start 2023-09-30T22:32:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.991+0000 7f86407ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a09c0 0x7f86380a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.991+0000 7f86407ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f863809d5c0 0x7f86380a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.991+0000 7f86407ff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8638133920 0x7f8638133d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.991+0000 7f86407ff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86380a1810 con 0x7f8638133920 2023-09-30T22:32:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.991+0000 7f86407ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863809ea10 con 0x7f863809d5c0 2023-09-30T22:32:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.991+0000 7f86407ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f863809e210 con 0x7f86380a09c0 2023-09-30T22:32:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.991+0000 7f863ed9c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8638133920 0x7f8638133d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.991+0000 7f863dd9a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f863809d5c0 0x7f86380a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.992+0000 7f863ed9c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8638133920 0x7f8638133d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55356/0 (socket says 172.21.15.59:55356) 2023-09-30T22:32:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.992+0000 7f863ed9c700 1 -- 172.21.15.59:0/4061397102 learned_addr learned my addr 172.21.15.59:0/4061397102 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.992+0000 7f863e59b700 1 --2- 172.21.15.59:0/4061397102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a09c0 0x7f86380a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.992+0000 7f863dd9a700 1 -- 172.21.15.59:0/4061397102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a09c0 msgr2=0x7f86380a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.992+0000 7f863dd9a700 1 --2- 172.21.15.59:0/4061397102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a09c0 0x7f86380a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.992+0000 7f863dd9a700 1 -- 172.21.15.59:0/4061397102 >> v2:172.21.15.59:3300/0 conn(0x7f8638133920 msgr2=0x7f8638133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.992+0000 7f863dd9a700 1 --2- 172.21.15.59:0/4061397102 >> v2:172.21.15.59:3300/0 conn(0x7f8638133920 0x7f8638133d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.992+0000 7f863dd9a700 1 -- 172.21.15.59:0/4061397102 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86380a26f0 con 0x7f863809d5c0 2023-09-30T22:32:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.992+0000 7f863ed9c700 1 --2- 172.21.15.59:0/4061397102 >> v2:172.21.15.59:3300/0 conn(0x7f8638133920 0x7f8638133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.992+0000 7f863dd9a700 1 --2- 172.21.15.59:0/4061397102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f863809d5c0 0x7f86380a12d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f862c009840 tx=0x7f862c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1de3648c002f14c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.992+0000 7f863d599700 1 -- 172.21.15.59:0/4061397102 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c011830 con 0x7f863809d5c0 2023-09-30T22:32:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.992+0000 7f863d599700 1 -- 172.21.15.59:0/4061397102 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862c011990 con 0x7f863809d5c0 2023-09-30T22:32:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.992+0000 7f863d599700 1 -- 172.21.15.59:0/4061397102 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c011d20 con 0x7f863809d5c0 2023-09-30T22:32:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.993+0000 7f86407ff700 1 -- 172.21.15.59:0/4061397102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f863809d5c0 msgr2=0x7f86380a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.993+0000 7f86407ff700 1 --2- 172.21.15.59:0/4061397102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f863809d5c0 0x7f86380a12d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f862c009840 tx=0x7f862c009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.993+0000 7f86407ff700 1 -- 172.21.15.59:0/4061397102 shutdown_connections 2023-09-30T22:32:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.993+0000 7f86407ff700 1 --2- 172.21.15.59:0/4061397102 >> v2:172.21.15.59:3300/0 conn(0x7f8638133920 0x7f8638133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.993+0000 7f86407ff700 1 --2- 172.21.15.59:0/4061397102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a09c0 0x7f86380a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.993+0000 7f86407ff700 1 --2- 172.21.15.59:0/4061397102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f863809d5c0 0x7f86380a12d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.993+0000 7f86407ff700 1 -- 172.21.15.59:0/4061397102 >> 172.21.15.59:0/4061397102 conn(0x7f86380a2fe0 msgr2=0x7f86380a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.993+0000 7f86407ff700 1 -- 172.21.15.59:0/4061397102 shutdown_connections 2023-09-30T22:32:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.993+0000 7f86407ff700 1 -- 172.21.15.59:0/4061397102 wait complete. 2023-09-30T22:32:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.995+0000 7f86407ff700 1 Processor -- start 2023-09-30T22:32:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.995+0000 7f86407ff700 1 -- start start 2023-09-30T22:32:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.995+0000 7f86407ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f863809d5c0 0x7f863811f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.995+0000 7f86407ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86380a09c0 0x7f863811fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.995+0000 7f86407ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8638133920 0x7f86381c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.995+0000 7f86407ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86381222d0 con 0x7f863809d5c0 2023-09-30T22:32:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.995+0000 7f86407ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86381227f0 con 0x7f86380a09c0 2023-09-30T22:32:03.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.995+0000 7f86407ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8638133420 con 0x7f8638133920 2023-09-30T22:32:03.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.995+0000 7f863e59b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f863809d5c0 0x7f863811f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.995+0000 7f863dd9a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86380a09c0 0x7f863811fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.995+0000 7f863e59b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f863809d5c0 0x7f863811f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55370/0 (socket says 172.21.15.59:55370) 2023-09-30T22:32:03.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.995+0000 7f863e59b700 1 -- 172.21.15.59:0/1185128075 learned_addr learned my addr 172.21.15.59:0/1185128075 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:03.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.996+0000 7f863ed9c700 1 --2- 172.21.15.59:0/1185128075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8638133920 0x7f86381c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.996+0000 7f863e59b700 1 -- 172.21.15.59:0/1185128075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8638133920 msgr2=0x7f86381c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.996+0000 7f863e59b700 1 --2- 172.21.15.59:0/1185128075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8638133920 0x7f86381c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.996+0000 7f863e59b700 1 -- 172.21.15.59:0/1185128075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86380a09c0 msgr2=0x7f863811fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.996+0000 7f863e59b700 1 --2- 172.21.15.59:0/1185128075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86380a09c0 0x7f863811fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.996+0000 7f863e59b700 1 -- 172.21.15.59:0/1185128075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8630009550 con 0x7f863809d5c0 2023-09-30T22:32:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.996+0000 7f863e59b700 1 --2- 172.21.15.59:0/1185128075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f863809d5c0 0x7f863811f4f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f862800efc0 tx=0x7f862800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.996+0000 7f8636ffd700 1 -- 172.21.15.59:0/1185128075 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862800cd10 con 0x7f863809d5c0 2023-09-30T22:32:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.996+0000 7f8636ffd700 1 -- 172.21.15.59:0/1185128075 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862800f040 con 0x7f863809d5c0 2023-09-30T22:32:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.996+0000 7f86407ff700 1 -- 172.21.15.59:0/1185128075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862c0094a0 con 0x7f863809d5c0 2023-09-30T22:32:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.996+0000 7f8636ffd700 1 -- 172.21.15.59:0/1185128075 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86280146a0 con 0x7f863809d5c0 2023-09-30T22:32:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.996+0000 7f86407ff700 1 -- 172.21.15.59:0/1185128075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8638120e90 con 0x7f863809d5c0 2023-09-30T22:32:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.997+0000 7f8636ffd700 1 -- 172.21.15.59:0/1185128075 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8628014800 con 0x7f863809d5c0 2023-09-30T22:32:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.998+0000 7f8636ffd700 1 -- 172.21.15.59:0/1185128075 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8628040360 con 0x7f863809d5c0 2023-09-30T22:32:03.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:02.998+0000 7f86407ff700 1 -- 172.21.15.59:0/1185128075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8638122410 con 0x7f863809d5c0 2023-09-30T22:32:03.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.004+0000 7f8636ffd700 1 -- 172.21.15.59:0/1185128075 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8638122410 con 0x7f863809d5c0 2023-09-30T22:32:03.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:03.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.128+0000 7f815c0f7700 1 Processor -- start 2023-09-30T22:32:03.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.128+0000 7f815c0f7700 1 -- start start 2023-09-30T22:32:03.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.129+0000 7f815c0f7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8154133a80 0x7f8154133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.129+0000 7f815c0f7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f815412ff20 0x7f8154130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.129+0000 7f815c0f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8154130870 0x7f815413a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.129+0000 7f815c0f7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815406c570 con 0x7f815412ff20 2023-09-30T22:32:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.129+0000 7f815c0f7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815406bc00 con 0x7f8154130870 2023-09-30T22:32:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.129+0000 7f815c0f7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81540a0040 con 0x7f8154133a80 2023-09-30T22:32:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.129+0000 7f8159e93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8154133a80 0x7f8154133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.129+0000 7f815a694700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8154130870 0x7f815413a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.129+0000 7f8159e93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8154133a80 0x7f8154133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56230/0 (socket says 172.21.15.59:56230) 2023-09-30T22:32:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.129+0000 7f8159e93700 1 -- 172.21.15.59:0/836396045 learned_addr learned my addr 172.21.15.59:0/836396045 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.129+0000 7f8159692700 1 --2- 172.21.15.59:0/836396045 >> v2:172.21.15.59:3300/0 conn(0x7f815412ff20 0x7f8154130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.129+0000 7f815a694700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8154130870 0x7f815413a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49622/0 (socket says 172.21.15.59:49622) 2023-09-30T22:32:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.129+0000 7f8159692700 1 -- 172.21.15.59:0/836396045 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8154133a80 msgr2=0x7f8154133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.130+0000 7f8159692700 1 --2- 172.21.15.59:0/836396045 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8154133a80 0x7f8154133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.130+0000 7f8159692700 1 -- 172.21.15.59:0/836396045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8154130870 msgr2=0x7f815413a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.130+0000 7f8159692700 1 --2- 172.21.15.59:0/836396045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8154130870 0x7f815413a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.130+0000 7f8159692700 1 -- 172.21.15.59:0/836396045 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8154133860 con 0x7f815412ff20 2023-09-30T22:32:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.130+0000 7f815a694700 1 --2- 172.21.15.59:0/836396045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8154130870 0x7f815413a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.130+0000 7f8159692700 1 --2- 172.21.15.59:0/836396045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f815412ff20 0x7f8154130330 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8144009840 tx=0x7f8144009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf09dba0a46824c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.130+0000 7f8158e91700 1 -- 172.21.15.59:0/836396045 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8144011830 con 0x7f815412ff20 2023-09-30T22:32:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.130+0000 7f8158e91700 1 -- 172.21.15.59:0/836396045 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8144011990 con 0x7f815412ff20 2023-09-30T22:32:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.130+0000 7f8158e91700 1 -- 172.21.15.59:0/836396045 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8144011d20 con 0x7f815412ff20 2023-09-30T22:32:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.131+0000 7f815c0f7700 1 -- 172.21.15.59:0/836396045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f815412ff20 msgr2=0x7f8154130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.131+0000 7f815c0f7700 1 --2- 172.21.15.59:0/836396045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f815412ff20 0x7f8154130330 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8144009840 tx=0x7f8144009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.131+0000 7f815c0f7700 1 -- 172.21.15.59:0/836396045 shutdown_connections 2023-09-30T22:32:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.131+0000 7f815c0f7700 1 --2- 172.21.15.59:0/836396045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8154130870 0x7f815413a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.131+0000 7f815c0f7700 1 --2- 172.21.15.59:0/836396045 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8154133a80 0x7f8154133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.131+0000 7f815c0f7700 1 --2- 172.21.15.59:0/836396045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f815412ff20 0x7f8154130330 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.131+0000 7f815c0f7700 1 -- 172.21.15.59:0/836396045 >> 172.21.15.59:0/836396045 conn(0x7f81540a4210 msgr2=0x7f81540a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.131+0000 7f815c0f7700 1 -- 172.21.15.59:0/836396045 shutdown_connections 2023-09-30T22:32:03.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.131+0000 7f815c0f7700 1 -- 172.21.15.59:0/836396045 wait complete. 2023-09-30T22:32:03.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.133+0000 7f815c0f7700 1 Processor -- start 2023-09-30T22:32:03.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.133+0000 7f815c0f7700 1 -- start start 2023-09-30T22:32:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.133+0000 7f815c0f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f815412ff20 0x7f815409c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f815c0f7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8154130870 0x7f815409c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f815c0f7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8154133a80 0x7f815409ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f815c0f7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815411fda0 con 0x7f8154130870 2023-09-30T22:32:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f815c0f7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815409e040 con 0x7f815412ff20 2023-09-30T22:32:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f815c0f7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f815409d7e0 con 0x7f8154133a80 2023-09-30T22:32:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f8159e93700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f815412ff20 0x7f815409c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f815a694700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8154133a80 0x7f815409ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f8159e93700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f815412ff20 0x7f815409c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49634/0 (socket says 172.21.15.59:49634) 2023-09-30T22:32:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f8159e93700 1 -- 172.21.15.59:0/1092689697 learned_addr learned my addr 172.21.15.59:0/1092689697 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f815a694700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8154133a80 0x7f815409ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56246/0 (socket says 172.21.15.59:56246) 2023-09-30T22:32:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f8159692700 1 --2- 172.21.15.59:0/1092689697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8154130870 0x7f815409c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f815a694700 1 -- 172.21.15.59:0/1092689697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f815412ff20 msgr2=0x7f815409c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f815a694700 1 --2- 172.21.15.59:0/1092689697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f815412ff20 0x7f815409c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f815a694700 1 -- 172.21.15.59:0/1092689697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8154130870 msgr2=0x7f815409c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f815a694700 1 --2- 172.21.15.59:0/1092689697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8154130870 0x7f815409c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f815a694700 1 -- 172.21.15.59:0/1092689697 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c009a70 con 0x7f8154133a80 2023-09-30T22:32:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.134+0000 7f8159e93700 1 --2- 172.21.15.59:0/1092689697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f815412ff20 0x7f815409c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.135+0000 7f815a694700 1 --2- 172.21.15.59:0/1092689697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8154133a80 0x7f815409ce00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f814c00efc0 tx=0x7f814c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.135+0000 7f814a7fc700 1 -- 172.21.15.59:0/1092689697 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c00ca90 con 0x7f8154133a80 2023-09-30T22:32:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.135+0000 7f814a7fc700 1 -- 172.21.15.59:0/1092689697 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c00f040 con 0x7f8154133a80 2023-09-30T22:32:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.135+0000 7f815c0f7700 1 -- 172.21.15.59:0/1092689697 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81440094a0 con 0x7f8154133a80 2023-09-30T22:32:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.135+0000 7f814a7fc700 1 -- 172.21.15.59:0/1092689697 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c00ce30 con 0x7f8154133a80 2023-09-30T22:32:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.135+0000 7f815c0f7700 1 -- 172.21.15.59:0/1092689697 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8154120a20 con 0x7f8154133a80 2023-09-30T22:32:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.136+0000 7f814a7fc700 1 -- 172.21.15.59:0/1092689697 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f814c014480 con 0x7f8154133a80 2023-09-30T22:32:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.136+0000 7f814a7fc700 1 -- 172.21.15.59:0/1092689697 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f814c03fc80 con 0x7f8154133a80 2023-09-30T22:32:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.136+0000 7f815c0f7700 1 -- 172.21.15.59:0/1092689697 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8154074ea0 con 0x7f8154133a80 2023-09-30T22:32:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.138+0000 7f737d991700 1 Processor -- start 2023-09-30T22:32:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.139+0000 7f737d991700 1 -- start start 2023-09-30T22:32:03.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.139+0000 7f737d991700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7378136820 0x7f7378138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.139+0000 7f737d991700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7378139140 0x7f737813b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.139+0000 7f737d991700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737806bc00 con 0x7f7378133a80 2023-09-30T22:32:03.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.139+0000 7f737d991700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737806c570 con 0x7f7378139140 2023-09-30T22:32:03.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.139+0000 7f737d991700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73780a0040 con 0x7f7378136820 2023-09-30T22:32:03.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.139+0000 7f73767fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7378136820 0x7f7378138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.139+0000 7f7376ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7378133a80 0x7f7378133e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49934/0 (socket says 172.21.15.59:49934) 2023-09-30T22:32:03.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.139+0000 7f73767fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7378136820 0x7f7378138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56258/0 (socket says 172.21.15.59:56258) 2023-09-30T22:32:03.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.139+0000 7f7376ffd700 1 -- 172.21.15.59:0/4224522790 learned_addr learned my addr 172.21.15.59:0/4224522790 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:03.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.140+0000 7f73767fc700 1 -- 172.21.15.59:0/4224522790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7378139140 msgr2=0x7f737813b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.140+0000 7f73767fc700 1 --2- 172.21.15.59:0/4224522790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7378139140 0x7f737813b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.140+0000 7f73767fc700 1 -- 172.21.15.59:0/4224522790 >> v1:172.21.15.59:6789/0 conn(0x7f7378133a80 legacy=0x7f7378133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.140+0000 7f7375ffb700 1 -- 172.21.15.59:0/4224522790 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909826286 0 0) 0x7f737806bc00 con 0x7f7378133a80 2023-09-30T22:32:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.140+0000 7f73767fc700 1 -- 172.21.15.59:0/4224522790 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7378133860 con 0x7f7378136820 2023-09-30T22:32:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.140+0000 7f73767fc700 1 --2- 172.21.15.59:0/4224522790 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7378136820 0x7f7378138c00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f736c009870 tx=0x7f736c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c82ed1ab52d67a41 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:03.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.146+0000 7f7375ffb700 1 -- 172.21.15.59:0/4224522790 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c011830 con 0x7f7378136820 2023-09-30T22:32:03.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.146+0000 7f7375ffb700 1 -- 172.21.15.59:0/4224522790 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c011990 con 0x7f7378136820 2023-09-30T22:32:03.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.146+0000 7f7375ffb700 1 -- 172.21.15.59:0/4224522790 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c011d20 con 0x7f7378136820 2023-09-30T22:32:03.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.146+0000 7f814a7fc700 1 -- 172.21.15.59:0/1092689697 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f814c012930 con 0x7f8154133a80 2023-09-30T22:32:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.146+0000 7f737d991700 1 -- 172.21.15.59:0/4224522790 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7378136820 msgr2=0x7f7378138c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.146+0000 7f737d991700 1 --2- 172.21.15.59:0/4224522790 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7378136820 0x7f7378138c00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f736c009870 tx=0x7f736c009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.147+0000 7f737d991700 1 -- 172.21.15.59:0/4224522790 shutdown_connections 2023-09-30T22:32:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.147+0000 7f737d991700 1 --2- 172.21.15.59:0/4224522790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7378139140 0x7f737813b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.147+0000 7f737d991700 1 --2- 172.21.15.59:0/4224522790 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7378136820 0x7f7378138c00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.147+0000 7f737d991700 1 -- 172.21.15.59:0/4224522790 >> 172.21.15.59:0/4224522790 conn(0x7f73780a4210 msgr2=0x7f73780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.147+0000 7f737d991700 1 -- 172.21.15.59:0/4224522790 shutdown_connections 2023-09-30T22:32:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.147+0000 7f737d991700 1 -- 172.21.15.59:0/4224522790 wait complete. 2023-09-30T22:32:03.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.148+0000 7f737d991700 1 Processor -- start 2023-09-30T22:32:03.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.148+0000 7f737d991700 1 -- start start 2023-09-30T22:32:03.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.148+0000 7f737d991700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7378133a80 0x7f737806f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.148+0000 7f737d991700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7378136820 0x7f737806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.148+0000 7f737d991700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7378139140 0x7f73780703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.149+0000 7f737d991700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737809bb80 con 0x7f7378139140 2023-09-30T22:32:03.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.149+0000 7f737d991700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7378138c10 con 0x7f7378133a80 2023-09-30T22:32:03.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.149+0000 7f737d991700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7378071f50 con 0x7f7378136820 2023-09-30T22:32:03.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.149+0000 7f73777fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7378139140 0x7f73780703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.149+0000 7f73767fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7378136820 0x7f737806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.149+0000 7f73767fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7378136820 0x7f737806fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56260/0 (socket says 172.21.15.59:56260) 2023-09-30T22:32:03.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.149+0000 7f73777fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7378139140 0x7f73780703d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55406/0 (socket says 172.21.15.59:55406) 2023-09-30T22:32:03.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.149+0000 7f73767fc700 1 -- 172.21.15.59:0/3894178378 learned_addr learned my addr 172.21.15.59:0/3894178378 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:03.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.149+0000 7f7376ffd700 1 --2- 172.21.15.59:0/3894178378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7378133a80 0x7f737806f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.149+0000 7f73777fe700 1 -- 172.21.15.59:0/3894178378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7378136820 msgr2=0x7f737806fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.149+0000 7f73777fe700 1 --2- 172.21.15.59:0/3894178378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7378136820 0x7f737806fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.149+0000 7f73777fe700 1 -- 172.21.15.59:0/3894178378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7378133a80 msgr2=0x7f737806f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.149+0000 7f73777fe700 1 --2- 172.21.15.59:0/3894178378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7378133a80 0x7f737806f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.149+0000 7f73777fe700 1 -- 172.21.15.59:0/3894178378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c0094a0 con 0x7f7378139140 2023-09-30T22:32:03.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.149+0000 7f73777fe700 1 --2- 172.21.15.59:0/3894178378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7378139140 0x7f73780703d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f737809aa90 tx=0x7f7370009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:03.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.150+0000 7f735ffff700 1 -- 172.21.15.59:0/3894178378 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737000cb30 con 0x7f7378139140 2023-09-30T22:32:03.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.150+0000 7f735ffff700 1 -- 172.21.15.59:0/3894178378 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737000ccb0 con 0x7f7378139140 2023-09-30T22:32:03.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.150+0000 7f737d991700 1 -- 172.21.15.59:0/3894178378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737809bdb0 con 0x7f7378139140 2023-09-30T22:32:03.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.150+0000 7f735ffff700 1 -- 172.21.15.59:0/3894178378 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370014680 con 0x7f7378139140 2023-09-30T22:32:03.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.150+0000 7f737d991700 1 -- 172.21.15.59:0/3894178378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73780722c0 con 0x7f7378139140 2023-09-30T22:32:03.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.151+0000 7f735ffff700 1 -- 172.21.15.59:0/3894178378 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f737001c360 con 0x7f7378139140 2023-09-30T22:32:03.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.151+0000 7f735ffff700 1 -- 172.21.15.59:0/3894178378 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7370006e40 con 0x7f7378139140 2023-09-30T22:32:03.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.151+0000 7f737d991700 1 -- 172.21.15.59:0/3894178378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7378074ea0 con 0x7f7378139140 2023-09-30T22:32:03.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.156+0000 7f735ffff700 1 -- 172.21.15.59:0/3894178378 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7370019080 con 0x7f7378139140 2023-09-30T22:32:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.188+0000 7f5720248700 1 Processor -- start 2023-09-30T22:32:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.188+0000 7f5720248700 1 -- start start 2023-09-30T22:32:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.189+0000 7f5720248700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571806a770 0x7f571806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.189+0000 7f5720248700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f571806b080 0x7f5718131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.189+0000 7f5720248700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5718131b40 0x7f5718131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.189+0000 7f5720248700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571809ece0 con 0x7f571806b080 2023-09-30T22:32:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.189+0000 7f5720248700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571809e760 con 0x7f5718131b40 2023-09-30T22:32:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.189+0000 7f5720248700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f571809e040 con 0x7f571806a770 2023-09-30T22:32:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.189+0000 7f571dfe4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571806a770 0x7f571806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.189+0000 7f571d7e3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f571806b080 0x7f5718131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.189+0000 7f571dfe4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571806a770 0x7f571806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56264/0 (socket says 172.21.15.59:56264) 2023-09-30T22:32:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.189+0000 7f571d7e3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f571806b080 0x7f5718131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55416/0 (socket says 172.21.15.59:55416) 2023-09-30T22:32:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.189+0000 7f571dfe4700 1 -- 172.21.15.59:0/1464033898 learned_addr learned my addr 172.21.15.59:0/1464033898 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.189+0000 7f571e7e5700 1 --2- 172.21.15.59:0/1464033898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5718131b40 0x7f5718131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.190+0000 7f571dfe4700 1 -- 172.21.15.59:0/1464033898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5718131b40 msgr2=0x7f5718131fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.190+0000 7f571dfe4700 1 --2- 172.21.15.59:0/1464033898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5718131b40 0x7f5718131fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.190+0000 7f571dfe4700 1 -- 172.21.15.59:0/1464033898 >> v2:172.21.15.59:3300/0 conn(0x7f571806b080 msgr2=0x7f5718131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.190+0000 7f571dfe4700 1 --2- 172.21.15.59:0/1464033898 >> v2:172.21.15.59:3300/0 conn(0x7f571806b080 0x7f5718131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.190+0000 7f571dfe4700 1 -- 172.21.15.59:0/1464033898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571809f630 con 0x7f571806a770 2023-09-30T22:32:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.190+0000 7f571dfe4700 1 --2- 172.21.15.59:0/1464033898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571806a770 0x7f571806ab40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f57140098f0 tx=0x7f5714009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3890d49c76e1edd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.190+0000 7f571cfe2700 1 -- 172.21.15.59:0/1464033898 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714011830 con 0x7f571806a770 2023-09-30T22:32:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.190+0000 7f571cfe2700 1 -- 172.21.15.59:0/1464033898 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5714011990 con 0x7f571806a770 2023-09-30T22:32:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.190+0000 7f571cfe2700 1 -- 172.21.15.59:0/1464033898 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714011d20 con 0x7f571806a770 2023-09-30T22:32:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.191+0000 7f5720248700 1 -- 172.21.15.59:0/1464033898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571806a770 msgr2=0x7f571806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.191+0000 7f5720248700 1 --2- 172.21.15.59:0/1464033898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571806a770 0x7f571806ab40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f57140098f0 tx=0x7f5714009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.192+0000 7f5720248700 1 -- 172.21.15.59:0/1464033898 shutdown_connections 2023-09-30T22:32:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.192+0000 7f5720248700 1 --2- 172.21.15.59:0/1464033898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5718131b40 0x7f5718131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.192+0000 7f5720248700 1 --2- 172.21.15.59:0/1464033898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571806a770 0x7f571806ab40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.192+0000 7f5720248700 1 --2- 172.21.15.59:0/1464033898 >> v2:172.21.15.59:3300/0 conn(0x7f571806b080 0x7f5718131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.192+0000 7f5720248700 1 -- 172.21.15.59:0/1464033898 >> 172.21.15.59:0/1464033898 conn(0x7f5718066f50 msgr2=0x7f571809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.192+0000 7f5720248700 1 -- 172.21.15.59:0/1464033898 shutdown_connections 2023-09-30T22:32:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.192+0000 7f5720248700 1 -- 172.21.15.59:0/1464033898 wait complete. 2023-09-30T22:32:03.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.193+0000 7f5720248700 1 Processor -- start 2023-09-30T22:32:03.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.193+0000 7f5720248700 1 -- start start 2023-09-30T22:32:03.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.194+0000 7f5720248700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571806a770 0x7f57181270f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.194+0000 7f5720248700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571806b080 0x7f5718127630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.194+0000 7f5720248700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5718131b40 0x7f5718127b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.194+0000 7f5720248700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571811d110 con 0x7f5718131b40 2023-09-30T22:32:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.194+0000 7f5720248700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5718071e60 con 0x7f571806a770 2023-09-30T22:32:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.194+0000 7f5720248700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f571811d300 con 0x7f571806b080 2023-09-30T22:32:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.194+0000 7f571d7e3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571806b080 0x7f5718127630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.194+0000 7f571d7e3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571806b080 0x7f5718127630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56276/0 (socket says 172.21.15.59:56276) 2023-09-30T22:32:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.194+0000 7f571d7e3700 1 -- 172.21.15.59:0/1388750172 learned_addr learned my addr 172.21.15.59:0/1388750172 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.194+0000 7f571dfe4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571806a770 0x7f57181270f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.195+0000 7f571e7e5700 1 --2- 172.21.15.59:0/1388750172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5718131b40 0x7f5718127b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.195+0000 7f571dfe4700 1 -- 172.21.15.59:0/1388750172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571806b080 msgr2=0x7f5718127630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.195+0000 7f571dfe4700 1 --2- 172.21.15.59:0/1388750172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571806b080 0x7f5718127630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.195+0000 7f571dfe4700 1 -- 172.21.15.59:0/1388750172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5718131b40 msgr2=0x7f5718127b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.195+0000 7f571dfe4700 1 --2- 172.21.15.59:0/1388750172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5718131b40 0x7f5718127b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.195+0000 7f571dfe4700 1 -- 172.21.15.59:0/1388750172 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5714009550 con 0x7f571806a770 2023-09-30T22:32:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.195+0000 7f571d7e3700 1 --2- 172.21.15.59:0/1388750172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571806b080 0x7f5718127630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.195+0000 7f571dfe4700 1 --2- 172.21.15.59:0/1388750172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571806a770 0x7f57181270f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5714016000 tx=0x7f5714004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.195+0000 7f570e7fc700 1 -- 172.21.15.59:0/1388750172 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714004300 con 0x7f571806a770 2023-09-30T22:32:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.195+0000 7f570e7fc700 1 -- 172.21.15.59:0/1388750172 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571401f070 con 0x7f571806a770 2023-09-30T22:32:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.195+0000 7f570e7fc700 1 -- 172.21.15.59:0/1388750172 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57140036a0 con 0x7f571806a770 2023-09-30T22:32:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.196+0000 7f5720248700 1 -- 172.21.15.59:0/1388750172 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5718131600 con 0x7f571806a770 2023-09-30T22:32:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.196+0000 7f5720248700 1 -- 172.21.15.59:0/1388750172 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57181289d0 con 0x7f571806a770 2023-09-30T22:32:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.197+0000 7f570e7fc700 1 -- 172.21.15.59:0/1388750172 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5714021030 con 0x7f571806a770 2023-09-30T22:32:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.197+0000 7f570e7fc700 1 -- 172.21.15.59:0/1388750172 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5714040a20 con 0x7f571806a770 2023-09-30T22:32:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.197+0000 7f5720248700 1 -- 172.21.15.59:0/1388750172 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5718074ea0 con 0x7f571806a770 2023-09-30T22:32:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.207+0000 7f570e7fc700 1 -- 172.21.15.59:0/1388750172 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57140199a0 con 0x7f571806a770 2023-09-30T22:32:03.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.254+0000 7f86407ff700 1 -- 172.21.15.59:0/1185128075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8638121f50 con 0x7f863809d5c0 2023-09-30T22:32:03.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.255+0000 7f8636ffd700 1 -- 172.21.15.59:0/1185128075 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8638121f50 con 0x7f863809d5c0 2023-09-30T22:32:03.256 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:03.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.257+0000 7f86407ff700 1 -- 172.21.15.59:0/1185128075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f863809d5c0 msgr2=0x7f863811f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.257+0000 7f86407ff700 1 --2- 172.21.15.59:0/1185128075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f863809d5c0 0x7f863811f4f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f862800efc0 tx=0x7f862800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.257+0000 7f86407ff700 1 -- 172.21.15.59:0/1185128075 shutdown_connections 2023-09-30T22:32:03.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.257+0000 7f86407ff700 1 --2- 172.21.15.59:0/1185128075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8638133920 0x7f86381c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.257+0000 7f86407ff700 1 --2- 172.21.15.59:0/1185128075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f863809d5c0 0x7f863811f4f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.257+0000 7f86407ff700 1 --2- 172.21.15.59:0/1185128075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86380a09c0 0x7f863811fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.257+0000 7f86407ff700 1 -- 172.21.15.59:0/1185128075 >> 172.21.15.59:0/1185128075 conn(0x7f86380a2fe0 msgr2=0x7f86381bbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:03.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.257+0000 7f86407ff700 1 -- 172.21.15.59:0/1185128075 shutdown_connections 2023-09-30T22:32:03.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.257+0000 7f86407ff700 1 -- 172.21.15.59:0/1185128075 wait complete. 2023-09-30T22:32:03.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:03.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.365+0000 7f737d991700 1 -- 172.21.15.59:0/3894178378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7378072450 con 0x7f7378139140 2023-09-30T22:32:03.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.366+0000 7f735ffff700 1 -- 172.21.15.59:0/3894178378 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73700072b0 con 0x7f7378139140 2023-09-30T22:32:03.366 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:03.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.369+0000 7f737d991700 1 -- 172.21.15.59:0/3894178378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7378139140 msgr2=0x7f73780703d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.369+0000 7f737d991700 1 --2- 172.21.15.59:0/3894178378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7378139140 0x7f73780703d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f737809aa90 tx=0x7f7370009ed0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.369+0000 7f737d991700 1 -- 172.21.15.59:0/3894178378 shutdown_connections 2023-09-30T22:32:03.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.369+0000 7f737d991700 1 --2- 172.21.15.59:0/3894178378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7378139140 0x7f73780703d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.369+0000 7f737d991700 1 --2- 172.21.15.59:0/3894178378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7378133a80 0x7f737806f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.369+0000 7f737d991700 1 --2- 172.21.15.59:0/3894178378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7378136820 0x7f737806fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.369+0000 7f737d991700 1 -- 172.21.15.59:0/3894178378 >> 172.21.15.59:0/3894178378 conn(0x7f73780a4210 msgr2=0x7f73780a0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:03.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.369+0000 7f737d991700 1 -- 172.21.15.59:0/3894178378 shutdown_connections 2023-09-30T22:32:03.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.370+0000 7f737d991700 1 -- 172.21.15.59:0/3894178378 wait complete. 2023-09-30T22:32:03.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.371+0000 7f815c0f7700 1 -- 172.21.15.59:0/1092689697 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f815406b250 con 0x7f8154133a80 2023-09-30T22:32:03.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.371+0000 7f814a7fc700 1 -- 172.21.15.59:0/1092689697 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f814c012340 con 0x7f8154133a80 2023-09-30T22:32:03.371 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.373+0000 7f815c0f7700 1 -- 172.21.15.59:0/1092689697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8154133a80 msgr2=0x7f815409ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.373+0000 7f815c0f7700 1 --2- 172.21.15.59:0/1092689697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8154133a80 0x7f815409ce00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f814c00efc0 tx=0x7f814c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.373+0000 7f815c0f7700 1 -- 172.21.15.59:0/1092689697 shutdown_connections 2023-09-30T22:32:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.373+0000 7f815c0f7700 1 --2- 172.21.15.59:0/1092689697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8154133a80 0x7f815409ce00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.373+0000 7f815c0f7700 1 --2- 172.21.15.59:0/1092689697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f815412ff20 0x7f815409c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.373+0000 7f815c0f7700 1 --2- 172.21.15.59:0/1092689697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8154130870 0x7f815409c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.373+0000 7f815c0f7700 1 -- 172.21.15.59:0/1092689697 >> 172.21.15.59:0/1092689697 conn(0x7f81540a4210 msgr2=0x7f815409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.374+0000 7f815c0f7700 1 -- 172.21.15.59:0/1092689697 shutdown_connections 2023-09-30T22:32:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.374+0000 7f815c0f7700 1 -- 172.21.15.59:0/1092689697 wait complete. 2023-09-30T22:32:03.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:03.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:03.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.441+0000 7f5720248700 1 -- 172.21.15.59:0/1388750172 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f571806c360 con 0x7f571806a770 2023-09-30T22:32:03.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.442+0000 7f570e7fc700 1 -- 172.21.15.59:0/1388750172 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57140193b0 con 0x7f571806a770 2023-09-30T22:32:03.442 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:03.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.444+0000 7f5720248700 1 -- 172.21.15.59:0/1388750172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571806a770 msgr2=0x7f57181270f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:03.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.444+0000 7f5720248700 1 --2- 172.21.15.59:0/1388750172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571806a770 0x7f57181270f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5714016000 tx=0x7f5714004750 comp rx=0 tx=0).stop 2023-09-30T22:32:03.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.444+0000 7f5720248700 1 -- 172.21.15.59:0/1388750172 shutdown_connections 2023-09-30T22:32:03.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.444+0000 7f5720248700 1 --2- 172.21.15.59:0/1388750172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5718131b40 0x7f5718127b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.444+0000 7f5720248700 1 --2- 172.21.15.59:0/1388750172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571806a770 0x7f57181270f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.444+0000 7f5720248700 1 --2- 172.21.15.59:0/1388750172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571806b080 0x7f5718127630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:03.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.444+0000 7f5720248700 1 -- 172.21.15.59:0/1388750172 >> 172.21.15.59:0/1388750172 conn(0x7f5718066f50 msgr2=0x7f571806fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.444+0000 7f5720248700 1 -- 172.21.15.59:0/1388750172 shutdown_connections 2023-09-30T22:32:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:03.444+0000 7f5720248700 1 -- 172.21.15.59:0/1388750172 wait complete. 2023-09-30T22:32:03.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:04.273 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:04.389 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:04.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:04.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.420+0000 7f11d7252700 1 Processor -- start 2023-09-30T22:32:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.421+0000 7f11d7252700 1 -- start start 2023-09-30T22:32:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.421+0000 7f11d7252700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d0130540 0x7f11d0130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.421+0000 7f11d7252700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d006fcf0 0x7f11d0138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.421+0000 7f11d7252700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d00716a0 con 0x7f11d0130e50 2023-09-30T22:32:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.421+0000 7f11d7252700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d009a390 con 0x7f11d006fcf0 2023-09-30T22:32:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.421+0000 7f11d7252700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11d0071290 con 0x7f11d0130540 2023-09-30T22:32:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.421+0000 7f11d4fee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d0130540 0x7f11d0130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.421+0000 7f11cffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f11d0130e50 0x7f11d006f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44242/0 (socket says 172.21.15.59:44242) 2023-09-30T22:32:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.421+0000 7f11d4fee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d0130540 0x7f11d0130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42726/0 (socket says 172.21.15.59:42726) 2023-09-30T22:32:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.421+0000 7f11cffff700 1 -- 172.21.15.59:0/1594750792 learned_addr learned my addr 172.21.15.59:0/1594750792 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.421+0000 7f11d57ef700 1 --2- 172.21.15.59:0/1594750792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d006fcf0 0x7f11d0138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.422+0000 7f11d4fee700 1 -- 172.21.15.59:0/1594750792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d006fcf0 msgr2=0x7f11d0138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:04.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.422+0000 7f11d4fee700 1 --2- 172.21.15.59:0/1594750792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d006fcf0 0x7f11d0138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.422+0000 7f11d4fee700 1 -- 172.21.15.59:0/1594750792 >> v1:172.21.15.59:6789/0 conn(0x7f11d0130e50 legacy=0x7f11d006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.422+0000 7f11d4fee700 1 -- 172.21.15.59:0/1594750792 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d0130340 con 0x7f11d0130540 2023-09-30T22:32:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.422+0000 7f11d57ef700 1 --2- 172.21.15.59:0/1594750792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d006fcf0 0x7f11d0138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.422+0000 7f11d4fee700 1 --2- 172.21.15.59:0/1594750792 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d0130540 0x7f11d0130910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009870 tx=0x7f11c4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cfd86c1dd3efbf0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.422+0000 7f11cf7fe700 1 -- 172.21.15.59:0/1594750792 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4011830 con 0x7f11d0130540 2023-09-30T22:32:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.422+0000 7f11cf7fe700 1 -- 172.21.15.59:0/1594750792 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c4011990 con 0x7f11d0130540 2023-09-30T22:32:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.422+0000 7f11cf7fe700 1 -- 172.21.15.59:0/1594750792 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4011d20 con 0x7f11d0130540 2023-09-30T22:32:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.423+0000 7f11d7252700 1 -- 172.21.15.59:0/1594750792 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d0130540 msgr2=0x7f11d0130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.423+0000 7f11d7252700 1 --2- 172.21.15.59:0/1594750792 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d0130540 0x7f11d0130910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009870 tx=0x7f11c4009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.423+0000 7f11d7252700 1 -- 172.21.15.59:0/1594750792 shutdown_connections 2023-09-30T22:32:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.423+0000 7f11d7252700 1 --2- 172.21.15.59:0/1594750792 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d0130540 0x7f11d0130910 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.423+0000 7f11d7252700 1 --2- 172.21.15.59:0/1594750792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d006fcf0 0x7f11d0138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.423+0000 7f11d7252700 1 -- 172.21.15.59:0/1594750792 >> 172.21.15.59:0/1594750792 conn(0x7f11d00a2aa0 msgr2=0x7f11d00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:04.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.424+0000 7f11d7252700 1 -- 172.21.15.59:0/1594750792 shutdown_connections 2023-09-30T22:32:04.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.424+0000 7f11d7252700 1 -- 172.21.15.59:0/1594750792 wait complete. 2023-09-30T22:32:04.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.425+0000 7f11d7252700 1 Processor -- start 2023-09-30T22:32:04.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.425+0000 7f11d7252700 1 -- start start 2023-09-30T22:32:04.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.426+0000 7f11d7252700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d006fcf0 0x7f11d0139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.426+0000 7f11d7252700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d0130540 0x7f11d013a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.426+0000 7f11d7252700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0130e50 0x7f11d013a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.426+0000 7f11d7252700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00718e0 con 0x7f11d0130540 2023-09-30T22:32:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.426+0000 7f11d7252700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00a0830 con 0x7f11d0130e50 2023-09-30T22:32:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.426+0000 7f11d7252700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11d0138c90 con 0x7f11d006fcf0 2023-09-30T22:32:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.426+0000 7f11cffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d0130540 0x7f11d013a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.426+0000 7f11cffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d0130540 0x7f11d013a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39334/0 (socket says 172.21.15.59:39334) 2023-09-30T22:32:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.426+0000 7f11cffff700 1 -- 172.21.15.59:0/3743339854 learned_addr learned my addr 172.21.15.59:0/3743339854 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.426+0000 7f11d57ef700 1 --2- 172.21.15.59:0/3743339854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0130e50 0x7f11d013a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.426+0000 7f11d4fee700 1 --2- 172.21.15.59:0/3743339854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d006fcf0 0x7f11d0139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.427+0000 7f11cffff700 1 -- 172.21.15.59:0/3743339854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d006fcf0 msgr2=0x7f11d0139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.427+0000 7f11cffff700 1 --2- 172.21.15.59:0/3743339854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d006fcf0 0x7f11d0139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.427+0000 7f11cffff700 1 -- 172.21.15.59:0/3743339854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0130e50 msgr2=0x7f11d013a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.427+0000 7f11cffff700 1 --2- 172.21.15.59:0/3743339854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0130e50 0x7f11d013a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.427+0000 7f11cffff700 1 -- 172.21.15.59:0/3743339854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c8009a70 con 0x7f11d0130540 2023-09-30T22:32:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.427+0000 7f11d57ef700 1 --2- 172.21.15.59:0/3743339854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0130e50 0x7f11d013a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.427+0000 7f11d4fee700 1 --2- 172.21.15.59:0/3743339854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d006fcf0 0x7f11d0139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.427+0000 7f11cffff700 1 --2- 172.21.15.59:0/3743339854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d0130540 0x7f11d013a000 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00c530 tx=0x7f11bc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.427+0000 7f11cd7fa700 1 -- 172.21.15.59:0/3743339854 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc005d70 con 0x7f11d0130540 2023-09-30T22:32:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.427+0000 7f11cd7fa700 1 -- 172.21.15.59:0/3743339854 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc0070d0 con 0x7f11d0130540 2023-09-30T22:32:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.427+0000 7f11d7252700 1 -- 172.21.15.59:0/3743339854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c40094a0 con 0x7f11d0130540 2023-09-30T22:32:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.427+0000 7f11cd7fa700 1 -- 172.21.15.59:0/3743339854 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc007440 con 0x7f11d0130540 2023-09-30T22:32:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.427+0000 7f11d7252700 1 -- 172.21.15.59:0/3743339854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d013ac20 con 0x7f11d0130540 2023-09-30T22:32:04.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.429+0000 7f11d7252700 1 -- 172.21.15.59:0/3743339854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d009dd40 con 0x7f11d0130540 2023-09-30T22:32:04.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.429+0000 7f11cd7fa700 1 -- 172.21.15.59:0/3743339854 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11bc0075a0 con 0x7f11d0130540 2023-09-30T22:32:04.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.429+0000 7f11cd7fa700 1 -- 172.21.15.59:0/3743339854 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f11bc03f070 con 0x7f11d0130540 2023-09-30T22:32:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.438+0000 7f11cd7fa700 1 -- 172.21.15.59:0/3743339854 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11bc019b40 con 0x7f11d0130540 2023-09-30T22:32:04.459 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.533+0000 7f3a96be2700 1 Processor -- start 2023-09-30T22:32:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.533+0000 7f3a96be2700 1 -- start start 2023-09-30T22:32:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.533+0000 7f3a96be2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009d6f0 0x7f3a9009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.533+0000 7f3a96be2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9009e000 0x7f3a901339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.534+0000 7f3a96be2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a9009b120 con 0x7f3a9009e410 2023-09-30T22:32:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.534+0000 7f3a96be2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9006b460 con 0x7f3a9009e000 2023-09-30T22:32:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.534+0000 7f3a96be2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9009a7e0 con 0x7f3a9009d6f0 2023-09-30T22:32:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.534+0000 7f3a9497e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009d6f0 0x7f3a9009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.534+0000 7f3a9497e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009d6f0 0x7f3a9009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42742/0 (socket says 172.21.15.59:42742) 2023-09-30T22:32:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.534+0000 7f3a9497e700 1 -- 172.21.15.59:0/2374656621 learned_addr learned my addr 172.21.15.59:0/2374656621 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.534+0000 7f3a9497e700 1 -- 172.21.15.59:0/2374656621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9009e000 msgr2=0x7f3a901339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.534+0000 7f3a9497e700 1 --2- 172.21.15.59:0/2374656621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9009e000 0x7f3a901339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.534+0000 7f3a9497e700 1 -- 172.21.15.59:0/2374656621 >> v1:172.21.15.59:6789/0 conn(0x7f3a9009e410 legacy=0x7f3a90133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.534+0000 7f3a9497e700 1 -- 172.21.15.59:0/2374656621 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9009a500 con 0x7f3a9009d6f0 2023-09-30T22:32:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.534+0000 7f3a9497e700 1 --2- 172.21.15.59:0/2374656621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009d6f0 0x7f3a9009dac0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009950 tx=0x7f3a84009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f2669fb095871ef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.535+0000 7f3a8f7fe700 1 -- 172.21.15.59:0/2374656621 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84009ea0 con 0x7f3a9009d6f0 2023-09-30T22:32:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.535+0000 7f3a8f7fe700 1 -- 172.21.15.59:0/2374656621 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8400ba20 con 0x7f3a9009d6f0 2023-09-30T22:32:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.535+0000 7f3a8f7fe700 1 -- 172.21.15.59:0/2374656621 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8400bdb0 con 0x7f3a9009d6f0 2023-09-30T22:32:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.535+0000 7f3a96be2700 1 -- 172.21.15.59:0/2374656621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009d6f0 msgr2=0x7f3a9009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.535+0000 7f3a96be2700 1 --2- 172.21.15.59:0/2374656621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009d6f0 0x7f3a9009dac0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009950 tx=0x7f3a84009c60 comp rx=0 tx=0).stop 2023-09-30T22:32:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.535+0000 7f3a96be2700 1 -- 172.21.15.59:0/2374656621 shutdown_connections 2023-09-30T22:32:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.535+0000 7f3a96be2700 1 --2- 172.21.15.59:0/2374656621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009d6f0 0x7f3a9009dac0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.535+0000 7f3a96be2700 1 --2- 172.21.15.59:0/2374656621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9009e000 0x7f3a901339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.535+0000 7f3a96be2700 1 -- 172.21.15.59:0/2374656621 >> 172.21.15.59:0/2374656621 conn(0x7f3a90066f50 msgr2=0x7f3a9009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.535+0000 7f3a96be2700 1 -- 172.21.15.59:0/2374656621 shutdown_connections 2023-09-30T22:32:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.535+0000 7f3a96be2700 1 -- 172.21.15.59:0/2374656621 wait complete. 2023-09-30T22:32:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.537+0000 7f3a96be2700 1 Processor -- start 2023-09-30T22:32:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.537+0000 7f3a96be2700 1 -- start start 2023-09-30T22:32:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.537+0000 7f5bfb609700 1 Processor -- start 2023-09-30T22:32:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a96be2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a9009d6f0 0x7f3a901a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a96be2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9009e000 0x7f3a901a5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a96be2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009e410 0x7f3a901a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a96be2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a901a8ae0 con 0x7f3a9009d6f0 2023-09-30T22:32:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a96be2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a900a2310 con 0x7f3a9009e000 2023-09-30T22:32:04.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a96be2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a901a6490 con 0x7f3a9009e410 2023-09-30T22:32:04.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f5bfb609700 1 -- start start 2023-09-30T22:32:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a9497e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a9009d6f0 0x7f3a901a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a9497e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a9009d6f0 0x7f3a901a5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39344/0 (socket says 172.21.15.59:39344) 2023-09-30T22:32:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a9497e700 1 -- 172.21.15.59:0/1888054898 learned_addr learned my addr 172.21.15.59:0/1888054898 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a9517f700 1 --2- 172.21.15.59:0/1888054898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009e410 0x7f3a901a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a8ffff700 1 --2- 172.21.15.59:0/1888054898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9009e000 0x7f3a901a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a9517f700 1 -- 172.21.15.59:0/1888054898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9009e000 msgr2=0x7f3a901a5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a9517f700 1 --2- 172.21.15.59:0/1888054898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9009e000 0x7f3a901a5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a9517f700 1 -- 172.21.15.59:0/1888054898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a9009d6f0 msgr2=0x7f3a901a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a9517f700 1 --2- 172.21.15.59:0/1888054898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a9009d6f0 0x7f3a901a5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f3a9517f700 1 -- 172.21.15.59:0/1888054898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a84009550 con 0x7f3a9009e410 2023-09-30T22:32:04.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.538+0000 7f5bfb609700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf40a0a30 0x7f5bf40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bfb609700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf40a1340 0x7f5bf4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bfb609700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5bf4133fa0 0x7f5bf4134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bfb609700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf409edd0 con 0x7f5bf4133fa0 2023-09-30T22:32:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bfb609700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf409e1f0 con 0x7f5bf40a1340 2023-09-30T22:32:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bfb609700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf409dc50 con 0x7f5bf40a0a30 2023-09-30T22:32:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bf9ba6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5bf4133fa0 0x7f5bf4134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bf93a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf40a0a30 0x7f5bf40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bf9ba6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5bf4133fa0 0x7f5bf4134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39356/0 (socket says 172.21.15.59:39356) 2023-09-30T22:32:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bf9ba6700 1 -- 172.21.15.59:0/3154808364 learned_addr learned my addr 172.21.15.59:0/3154808364 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bf8ba4700 1 --2- 172.21.15.59:0/3154808364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf40a1340 0x7f5bf4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bf93a5700 1 -- 172.21.15.59:0/3154808364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf40a1340 msgr2=0x7f5bf4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bf93a5700 1 --2- 172.21.15.59:0/3154808364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf40a1340 0x7f5bf4133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bf93a5700 1 -- 172.21.15.59:0/3154808364 >> v2:172.21.15.59:3300/0 conn(0x7f5bf4133fa0 msgr2=0x7f5bf4134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bf93a5700 1 --2- 172.21.15.59:0/3154808364 >> v2:172.21.15.59:3300/0 conn(0x7f5bf4133fa0 0x7f5bf4134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bf93a5700 1 -- 172.21.15.59:0/3154808364 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf40a1fe0 con 0x7f5bf40a0a30 2023-09-30T22:32:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f3a9517f700 1 --2- 172.21.15.59:0/1888054898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009e410 0x7f3a901a5ad0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3a9009e8b0 tx=0x7f3a8800ce70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bf8ba4700 1 --2- 172.21.15.59:0/3154808364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf40a1340 0x7f5bf4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f5bf93a5700 1 --2- 172.21.15.59:0/3154808364 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf40a0a30 0x7f5bf40a0e00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009840 tx=0x7f5bf0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e32ff318b54589c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.539+0000 7f3a8d7fa700 1 -- 172.21.15.59:0/1888054898 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a88003c00 con 0x7f3a9009e410 2023-09-30T22:32:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.540+0000 7f3a8d7fa700 1 -- 172.21.15.59:0/1888054898 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a88003d60 con 0x7f3a9009e410 2023-09-30T22:32:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.540+0000 7f3a8d7fa700 1 -- 172.21.15.59:0/1888054898 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8800a9c0 con 0x7f3a9009e410 2023-09-30T22:32:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.540+0000 7f5bebfff700 1 -- 172.21.15.59:0/3154808364 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0011830 con 0x7f5bf40a0a30 2023-09-30T22:32:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.540+0000 7f5bebfff700 1 -- 172.21.15.59:0/3154808364 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf0011990 con 0x7f5bf40a0a30 2023-09-30T22:32:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.540+0000 7f5bebfff700 1 -- 172.21.15.59:0/3154808364 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0011d20 con 0x7f5bf40a0a30 2023-09-30T22:32:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.540+0000 7f5bfb609700 1 -- 172.21.15.59:0/3154808364 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf40a0a30 msgr2=0x7f5bf40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.540+0000 7f5bfb609700 1 --2- 172.21.15.59:0/3154808364 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf40a0a30 0x7f5bf40a0e00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009840 tx=0x7f5bf0009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.541+0000 7f5bfb609700 1 -- 172.21.15.59:0/3154808364 shutdown_connections 2023-09-30T22:32:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.541+0000 7f5bfb609700 1 --2- 172.21.15.59:0/3154808364 >> v2:172.21.15.59:3300/0 conn(0x7f5bf4133fa0 0x7f5bf4134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.541+0000 7f5bfb609700 1 --2- 172.21.15.59:0/3154808364 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf40a0a30 0x7f5bf40a0e00 secure :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009840 tx=0x7f5bf0009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.541+0000 7f5bfb609700 1 --2- 172.21.15.59:0/3154808364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf40a1340 0x7f5bf4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.541+0000 7f5bfb609700 1 -- 172.21.15.59:0/3154808364 >> 172.21.15.59:0/3154808364 conn(0x7f5bf40a6550 msgr2=0x7f5bf40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.540+0000 7f3a96be2700 1 -- 172.21.15.59:0/1888054898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a901a8270 con 0x7f3a9009e410 2023-09-30T22:32:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.540+0000 7f3a96be2700 1 -- 172.21.15.59:0/1888054898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a901a6bd0 con 0x7f3a9009e410 2023-09-30T22:32:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.541+0000 7f3a96be2700 1 -- 172.21.15.59:0/1888054898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a901a7e80 con 0x7f3a9009e410 2023-09-30T22:32:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.541+0000 7f5bfb609700 1 -- 172.21.15.59:0/3154808364 shutdown_connections 2023-09-30T22:32:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.542+0000 7f3a8d7fa700 1 -- 172.21.15.59:0/1888054898 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a8800ab20 con 0x7f3a9009e410 2023-09-30T22:32:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.542+0000 7f5bfb609700 1 -- 172.21.15.59:0/3154808364 wait complete. 2023-09-30T22:32:04.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.542+0000 7f3a8d7fa700 1 -- 172.21.15.59:0/1888054898 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3a8803f6f0 con 0x7f3a9009e410 2023-09-30T22:32:04.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.543+0000 7f5bfb609700 1 Processor -- start 2023-09-30T22:32:04.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.543+0000 7f5bfb609700 1 -- start start 2023-09-30T22:32:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bfb609700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf40a1340 0x7f5bf41201b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bfb609700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf4133fa0 0x7f5bf41206f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bfb609700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4120c30 0x7f5bf41ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bfb609700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4123ad0 con 0x7f5bf4120c30 2023-09-30T22:32:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bfb609700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4123cd0 con 0x7f5bf40a1340 2023-09-30T22:32:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bfb609700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4122bc0 con 0x7f5bf4133fa0 2023-09-30T22:32:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bf8ba4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf4133fa0 0x7f5bf41206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bf8ba4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf4133fa0 0x7f5bf41206f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42758/0 (socket says 172.21.15.59:42758) 2023-09-30T22:32:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bf8ba4700 1 -- 172.21.15.59:0/165334122 learned_addr learned my addr 172.21.15.59:0/165334122 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bf93a5700 1 --2- 172.21.15.59:0/165334122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf40a1340 0x7f5bf41201b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bf9ba6700 1 --2- 172.21.15.59:0/165334122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4120c30 0x7f5bf41ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bf8ba4700 1 -- 172.21.15.59:0/165334122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf40a1340 msgr2=0x7f5bf41201b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bf8ba4700 1 --2- 172.21.15.59:0/165334122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf40a1340 0x7f5bf41201b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bf8ba4700 1 -- 172.21.15.59:0/165334122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4120c30 msgr2=0x7f5bf41ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bf8ba4700 1 --2- 172.21.15.59:0/165334122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4120c30 0x7f5bf41ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bf8ba4700 1 -- 172.21.15.59:0/165334122 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf00094a0 con 0x7f5bf4133fa0 2023-09-30T22:32:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.544+0000 7f5bf93a5700 1 --2- 172.21.15.59:0/165334122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf40a1340 0x7f5bf41201b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.545+0000 7f5bf8ba4700 1 --2- 172.21.15.59:0/165334122 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf4133fa0 0x7f5bf41206f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5be400c750 tx=0x7f5be400cb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.547+0000 7f5be9ffb700 1 -- 172.21.15.59:0/165334122 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4011800 con 0x7f5bf4133fa0 2023-09-30T22:32:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.548+0000 7f5be9ffb700 1 -- 172.21.15.59:0/165334122 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be4011960 con 0x7f5bf4133fa0 2023-09-30T22:32:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.548+0000 7f5be9ffb700 1 -- 172.21.15.59:0/165334122 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4011cd0 con 0x7f5bf4133fa0 2023-09-30T22:32:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.548+0000 7f5bfb609700 1 -- 172.21.15.59:0/165334122 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf4121e60 con 0x7f5bf4133fa0 2023-09-30T22:32:04.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.548+0000 7f3a8d7fa700 1 -- 172.21.15.59:0/1888054898 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a8800add0 con 0x7f3a9009e410 2023-09-30T22:32:04.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.548+0000 7f5bfb609700 1 -- 172.21.15.59:0/165334122 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf40a35f0 con 0x7f5bf4133fa0 2023-09-30T22:32:04.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.549+0000 7f5be9ffb700 1 -- 172.21.15.59:0/165334122 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5be4010350 con 0x7f5bf4133fa0 2023-09-30T22:32:04.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.549+0000 7f5bfb609700 1 -- 172.21.15.59:0/165334122 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf4074ea0 con 0x7f5bf4133fa0 2023-09-30T22:32:04.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.550+0000 7f5be9ffb700 1 -- 172.21.15.59:0/165334122 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5be400fe90 con 0x7f5bf4133fa0 2023-09-30T22:32:04.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.559+0000 7f5be9ffb700 1 -- 172.21.15.59:0/165334122 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5be4044060 con 0x7f5bf4133fa0 2023-09-30T22:32:04.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.606+0000 7f16f7a12700 1 Processor -- start 2023-09-30T22:32:04.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.607+0000 7f16f7a12700 1 -- start start 2023-09-30T22:32:04.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.607+0000 7f16f7a12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f009f410 0x7f16f0136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.607+0000 7f16f7a12700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0136fe0 0x7f16f01393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.607+0000 7f16f7a12700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f0070940 con 0x7f16f009e930 2023-09-30T22:32:04.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.607+0000 7f16f7a12700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f006fd60 con 0x7f16f0136fe0 2023-09-30T22:32:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.607+0000 7f16f7a12700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16f006fa80 con 0x7f16f009f410 2023-09-30T22:32:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.607+0000 7f16f4fad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f009f410 0x7f16f0136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.607+0000 7f16f4fad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f009f410 0x7f16f0136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42772/0 (socket says 172.21.15.59:42772) 2023-09-30T22:32:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.608+0000 7f16f4fad700 1 -- 172.21.15.59:0/1752017107 learned_addr learned my addr 172.21.15.59:0/1752017107 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.608+0000 7f16f5faf700 1 --2- 172.21.15.59:0/1752017107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0136fe0 0x7f16f01393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.608+0000 7f16e7fff700 1 -- 172.21.15.59:0/1752017107 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878050368 0 0) 0x7f16f0070940 con 0x7f16f009e930 2023-09-30T22:32:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.608+0000 7f16f4fad700 1 -- 172.21.15.59:0/1752017107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0136fe0 msgr2=0x7f16f01393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.608+0000 7f16f4fad700 1 --2- 172.21.15.59:0/1752017107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0136fe0 0x7f16f01393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.608+0000 7f16f4fad700 1 -- 172.21.15.59:0/1752017107 >> v1:172.21.15.59:6789/0 conn(0x7f16f009e930 legacy=0x7f16f009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.608+0000 7f16f4fad700 1 -- 172.21.15.59:0/1752017107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f009fb60 con 0x7f16f009f410 2023-09-30T22:32:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.608+0000 7f16f4fad700 1 --2- 172.21.15.59:0/1752017107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f009f410 0x7f16f0136aa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009920 tx=0x7f16e0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5f7fc05bfa957b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.608+0000 7f16e7fff700 1 -- 172.21.15.59:0/1752017107 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0011830 con 0x7f16f009f410 2023-09-30T22:32:04.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.608+0000 7f16e7fff700 1 -- 172.21.15.59:0/1752017107 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e0011990 con 0x7f16f009f410 2023-09-30T22:32:04.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.608+0000 7f16e7fff700 1 -- 172.21.15.59:0/1752017107 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0011d20 con 0x7f16f009f410 2023-09-30T22:32:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.609+0000 7f16f7a12700 1 -- 172.21.15.59:0/1752017107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f009f410 msgr2=0x7f16f0136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.609+0000 7f16f7a12700 1 --2- 172.21.15.59:0/1752017107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f009f410 0x7f16f0136aa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009920 tx=0x7f16e0009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.609+0000 7f16f7a12700 1 -- 172.21.15.59:0/1752017107 shutdown_connections 2023-09-30T22:32:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.609+0000 7f16f7a12700 1 --2- 172.21.15.59:0/1752017107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0136fe0 0x7f16f01393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.609+0000 7f16f7a12700 1 --2- 172.21.15.59:0/1752017107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f009f410 0x7f16f0136aa0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.609+0000 7f16f7a12700 1 -- 172.21.15.59:0/1752017107 >> 172.21.15.59:0/1752017107 conn(0x7f16f00a4210 msgr2=0x7f16f00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.609+0000 7f16f7a12700 1 -- 172.21.15.59:0/1752017107 shutdown_connections 2023-09-30T22:32:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.609+0000 7f16f7a12700 1 -- 172.21.15.59:0/1752017107 wait complete. 2023-09-30T22:32:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.611+0000 7f16f7a12700 1 Processor -- start 2023-09-30T22:32:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.611+0000 7f16f7a12700 1 -- start start 2023-09-30T22:32:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f7a12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f009e930 0x7f16f011c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f7a12700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f009f410 0x7f16f011ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f7a12700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0136fe0 0x7f16f011cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f7a12700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f0120040 con 0x7f16f009f410 2023-09-30T22:32:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f7a12700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f0071d20 con 0x7f16f0136fe0 2023-09-30T22:32:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f7a12700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16f011f7f0 con 0x7f16f009e930 2023-09-30T22:32:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f57ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f009e930 0x7f16f011c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f57ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f009e930 0x7f16f011c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42774/0 (socket says 172.21.15.59:42774) 2023-09-30T22:32:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f57ae700 1 -- 172.21.15.59:0/2774259337 learned_addr learned my addr 172.21.15.59:0/2774259337 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f5faf700 1 --2- 172.21.15.59:0/2774259337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0136fe0 0x7f16f011cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f4fad700 1 --2- 172.21.15.59:0/2774259337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f009f410 0x7f16f011ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f57ae700 1 -- 172.21.15.59:0/2774259337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0136fe0 msgr2=0x7f16f011cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f57ae700 1 --2- 172.21.15.59:0/2774259337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0136fe0 0x7f16f011cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f57ae700 1 -- 172.21.15.59:0/2774259337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f009f410 msgr2=0x7f16f011ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f57ae700 1 --2- 172.21.15.59:0/2774259337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f009f410 0x7f16f011ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.612+0000 7f16f57ae700 1 -- 172.21.15.59:0/2774259337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e0009550 con 0x7f16f009e930 2023-09-30T22:32:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.613+0000 7f16f57ae700 1 --2- 172.21.15.59:0/2774259337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f009e930 0x7f16f011c520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f16ec001eb0 tx=0x7f16ec00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.613+0000 7f16e5ffb700 1 -- 172.21.15.59:0/2774259337 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0054e0 con 0x7f16f009e930 2023-09-30T22:32:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.613+0000 7f16e5ffb700 1 -- 172.21.15.59:0/2774259337 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec003680 con 0x7f16f009e930 2023-09-30T22:32:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.613+0000 7f16f7a12700 1 -- 172.21.15.59:0/2774259337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f011e130 con 0x7f16f009e930 2023-09-30T22:32:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.613+0000 7f16e5ffb700 1 -- 172.21.15.59:0/2774259337 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0039f0 con 0x7f16f009e930 2023-09-30T22:32:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.613+0000 7f16f7a12700 1 -- 172.21.15.59:0/2774259337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f00a2f90 con 0x7f16f009e930 2023-09-30T22:32:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.614+0000 7f16e5ffb700 1 -- 172.21.15.59:0/2774259337 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16ec003b50 con 0x7f16f009e930 2023-09-30T22:32:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.614+0000 7f16e5ffb700 1 -- 172.21.15.59:0/2774259337 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f16ec040b00 con 0x7f16f009e930 2023-09-30T22:32:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.614+0000 7f16f7a12700 1 -- 172.21.15.59:0/2774259337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f0074ea0 con 0x7f16f009e930 2023-09-30T22:32:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.619+0000 7f16e5ffb700 1 -- 172.21.15.59:0/2774259337 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16ec017030 con 0x7f16f009e930 2023-09-30T22:32:04.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.658+0000 7f11d7252700 1 -- 172.21.15.59:0/3743339854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f11d0074ea0 con 0x7f11d0130540 2023-09-30T22:32:04.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.659+0000 7f11cd7fa700 1 -- 172.21.15.59:0/3743339854 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11bc017020 con 0x7f11d0130540 2023-09-30T22:32:04.659 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:04.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.662+0000 7f11d7252700 1 -- 172.21.15.59:0/3743339854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d0130540 msgr2=0x7f11d013a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.662+0000 7f11d7252700 1 --2- 172.21.15.59:0/3743339854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d0130540 0x7f11d013a000 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00c530 tx=0x7f11bc00c840 comp rx=0 tx=0).stop 2023-09-30T22:32:04.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.662+0000 7f11d7252700 1 -- 172.21.15.59:0/3743339854 shutdown_connections 2023-09-30T22:32:04.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.662+0000 7f11d7252700 1 --2- 172.21.15.59:0/3743339854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11d006fcf0 0x7f11d0139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.662+0000 7f11d7252700 1 --2- 172.21.15.59:0/3743339854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11d0130e50 0x7f11d013a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.662+0000 7f11d7252700 1 --2- 172.21.15.59:0/3743339854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11d0130540 0x7f11d013a000 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.662+0000 7f11d7252700 1 -- 172.21.15.59:0/3743339854 >> 172.21.15.59:0/3743339854 conn(0x7f11d00a2aa0 msgr2=0x7f11d012f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:04.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.662+0000 7f11d7252700 1 -- 172.21.15.59:0/3743339854 shutdown_connections 2023-09-30T22:32:04.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.662+0000 7f11d7252700 1 -- 172.21.15.59:0/3743339854 wait complete. 2023-09-30T22:32:04.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:04.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.770+0000 7f5bfb609700 1 -- 172.21.15.59:0/165334122 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5bf4123930 con 0x7f5bf4133fa0 2023-09-30T22:32:04.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.770+0000 7f5be9ffb700 1 -- 172.21.15.59:0/165334122 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5bf4123930 con 0x7f5bf4133fa0 2023-09-30T22:32:04.771 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:04.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.772+0000 7f3a96be2700 1 -- 172.21.15.59:0/1888054898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3a90074ea0 con 0x7f3a9009e410 2023-09-30T22:32:04.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.773+0000 7f5bfb609700 1 -- 172.21.15.59:0/165334122 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf4133fa0 msgr2=0x7f5bf41206f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.773+0000 7f5bfb609700 1 --2- 172.21.15.59:0/165334122 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf4133fa0 0x7f5bf41206f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5be400c750 tx=0x7f5be400cb10 comp rx=0 tx=0).stop 2023-09-30T22:32:04.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.773+0000 7f3a8d7fa700 1 -- 172.21.15.59:0/1888054898 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a88011380 con 0x7f3a9009e410 2023-09-30T22:32:04.773 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:04.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.773+0000 7f5bfb609700 1 -- 172.21.15.59:0/165334122 shutdown_connections 2023-09-30T22:32:04.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.773+0000 7f5bfb609700 1 --2- 172.21.15.59:0/165334122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4120c30 0x7f5bf41ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.773+0000 7f5bfb609700 1 --2- 172.21.15.59:0/165334122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf40a1340 0x7f5bf41201b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.773+0000 7f5bfb609700 1 --2- 172.21.15.59:0/165334122 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf4133fa0 0x7f5bf41206f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.773+0000 7f5bfb609700 1 -- 172.21.15.59:0/165334122 >> 172.21.15.59:0/165334122 conn(0x7f5bf40a6550 msgr2=0x7f5bf409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:04.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.773+0000 7f5bfb609700 1 -- 172.21.15.59:0/165334122 shutdown_connections 2023-09-30T22:32:04.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.773+0000 7f5bfb609700 1 -- 172.21.15.59:0/165334122 wait complete. 2023-09-30T22:32:04.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.775+0000 7f3a96be2700 1 -- 172.21.15.59:0/1888054898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009e410 msgr2=0x7f3a901a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.775+0000 7f3a96be2700 1 --2- 172.21.15.59:0/1888054898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009e410 0x7f3a901a5ad0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3a9009e8b0 tx=0x7f3a8800ce70 comp rx=0 tx=0).stop 2023-09-30T22:32:04.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.775+0000 7f3a96be2700 1 -- 172.21.15.59:0/1888054898 shutdown_connections 2023-09-30T22:32:04.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.775+0000 7f3a96be2700 1 --2- 172.21.15.59:0/1888054898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009e410 0x7f3a901a5ad0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.775+0000 7f3a96be2700 1 --2- 172.21.15.59:0/1888054898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a9009d6f0 0x7f3a901a5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.775+0000 7f3a96be2700 1 --2- 172.21.15.59:0/1888054898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9009e000 0x7f3a901a5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.775+0000 7f3a96be2700 1 -- 172.21.15.59:0/1888054898 >> 172.21.15.59:0/1888054898 conn(0x7f3a90066f50 msgr2=0x7f3a901baff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:04.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.775+0000 7f3a96be2700 1 -- 172.21.15.59:0/1888054898 shutdown_connections 2023-09-30T22:32:04.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.775+0000 7f3a96be2700 1 -- 172.21.15.59:0/1888054898 wait complete. 2023-09-30T22:32:04.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:04.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:04.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.827+0000 7f16f7a12700 1 -- 172.21.15.59:0/2774259337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f16f006b250 con 0x7f16f009e930 2023-09-30T22:32:04.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.827+0000 7f16e5ffb700 1 -- 172.21.15.59:0/2774259337 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16ec030090 con 0x7f16f009e930 2023-09-30T22:32:04.827 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:04.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.829+0000 7f16f7a12700 1 -- 172.21.15.59:0/2774259337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f009e930 msgr2=0x7f16f011c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:04.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.829+0000 7f16f7a12700 1 --2- 172.21.15.59:0/2774259337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f009e930 0x7f16f011c520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f16ec001eb0 tx=0x7f16ec00c800 comp rx=0 tx=0).stop 2023-09-30T22:32:04.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.829+0000 7f16f7a12700 1 -- 172.21.15.59:0/2774259337 shutdown_connections 2023-09-30T22:32:04.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.829+0000 7f16f7a12700 1 --2- 172.21.15.59:0/2774259337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f009e930 0x7f16f011c520 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.829+0000 7f16f7a12700 1 --2- 172.21.15.59:0/2774259337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0136fe0 0x7f16f011cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.829+0000 7f16f7a12700 1 --2- 172.21.15.59:0/2774259337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f009f410 0x7f16f011ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:04.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.829+0000 7f16f7a12700 1 -- 172.21.15.59:0/2774259337 >> 172.21.15.59:0/2774259337 conn(0x7f16f00a4210 msgr2=0x7f16f00a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:04.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.829+0000 7f16f7a12700 1 -- 172.21.15.59:0/2774259337 shutdown_connections 2023-09-30T22:32:04.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:04.829+0000 7f16f7a12700 1 -- 172.21.15.59:0/2774259337 wait complete. 2023-09-30T22:32:04.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:05.682 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:05.789 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:05.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:05.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.831+0000 7fdddaf32700 1 Processor -- start 2023-09-30T22:32:05.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.831+0000 7fdddaf32700 1 -- start start 2023-09-30T22:32:05.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.832+0000 7fdddaf32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd41338c0 0x7fddd4133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.832+0000 7fdddaf32700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fddd41341d0 0x7fddd409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.832+0000 7fdddaf32700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd406f720 con 0x7fddd409e390 2023-09-30T22:32:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.832+0000 7fdddaf32700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd4070c80 con 0x7fddd41341d0 2023-09-30T22:32:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.832+0000 7fdddaf32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd406fce0 con 0x7fddd41338c0 2023-09-30T22:32:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.832+0000 7fddd3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fddd41341d0 0x7fddd409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.832+0000 7fddd8cce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd41338c0 0x7fddd4133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.832+0000 7fddd3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fddd41341d0 0x7fddd409de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39388/0 (socket says 172.21.15.59:39388) 2023-09-30T22:32:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.832+0000 7fddd3fff700 1 -- 172.21.15.59:0/4070616910 learned_addr learned my addr 172.21.15.59:0/4070616910 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.833+0000 7fddd3fff700 1 -- 172.21.15.59:0/4070616910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd41338c0 msgr2=0x7fddd4133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.833+0000 7fddd3fff700 1 --2- 172.21.15.59:0/4070616910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd41338c0 0x7fddd4133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.833+0000 7fddd3fff700 1 -- 172.21.15.59:0/4070616910 >> v1:172.21.15.59:6789/0 conn(0x7fddd409e390 legacy=0x7fddd413a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:05.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.833+0000 7fddd3fff700 1 -- 172.21.15.59:0/4070616910 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd41336a0 con 0x7fddd41341d0 2023-09-30T22:32:05.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.833+0000 7fddd3fff700 1 --2- 172.21.15.59:0/4070616910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd41341d0 0x7fddd409de50 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fddc00098f0 tx=0x7fddc0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5277f114b70aca43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:05.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.833+0000 7fddd37fe700 1 -- 172.21.15.59:0/4070616910 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0011830 con 0x7fddd41341d0 2023-09-30T22:32:05.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.833+0000 7fddd37fe700 1 -- 172.21.15.59:0/4070616910 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc0011990 con 0x7fddd41341d0 2023-09-30T22:32:05.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.833+0000 7fddd37fe700 1 -- 172.21.15.59:0/4070616910 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0011d20 con 0x7fddd41341d0 2023-09-30T22:32:05.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.834+0000 7fdddaf32700 1 -- 172.21.15.59:0/4070616910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd41341d0 msgr2=0x7fddd409de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:05.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.834+0000 7fdddaf32700 1 --2- 172.21.15.59:0/4070616910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd41341d0 0x7fddd409de50 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fddc00098f0 tx=0x7fddc0009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:05.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.834+0000 7fdddaf32700 1 -- 172.21.15.59:0/4070616910 shutdown_connections 2023-09-30T22:32:05.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.834+0000 7fdddaf32700 1 --2- 172.21.15.59:0/4070616910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd41338c0 0x7fddd4133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.834+0000 7fdddaf32700 1 --2- 172.21.15.59:0/4070616910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd41341d0 0x7fddd409de50 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.834+0000 7fdddaf32700 1 -- 172.21.15.59:0/4070616910 >> 172.21.15.59:0/4070616910 conn(0x7fddd40a2aa0 msgr2=0x7fddd40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:05.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.834+0000 7fdddaf32700 1 -- 172.21.15.59:0/4070616910 shutdown_connections 2023-09-30T22:32:05.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.834+0000 7fdddaf32700 1 -- 172.21.15.59:0/4070616910 wait complete. 2023-09-30T22:32:05.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.835+0000 7fdddaf32700 1 Processor -- start 2023-09-30T22:32:05.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.835+0000 7fdddaf32700 1 -- start start 2023-09-30T22:32:05.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.836+0000 7fdddaf32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd409e390 0x7fddd411c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.836+0000 7fdddaf32700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd41338c0 0x7fddd411cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.836+0000 7fdddaf32700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddd41341d0 0x7fddd411d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.836+0000 7fdddaf32700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4130ec0 con 0x7fddd41338c0 2023-09-30T22:32:05.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.836+0000 7fdddaf32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd411f3d0 con 0x7fddd409e390 2023-09-30T22:32:05.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.836+0000 7fdddaf32700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddd406f960 con 0x7fddd41341d0 2023-09-30T22:32:05.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.836+0000 7fddd8cce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd409e390 0x7fddd411c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.836+0000 7fddd8cce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd409e390 0x7fddd411c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54870/0 (socket says 172.21.15.59:54870) 2023-09-30T22:32:05.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.836+0000 7fddd8cce700 1 -- 172.21.15.59:0/948807180 learned_addr learned my addr 172.21.15.59:0/948807180 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:05.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.836+0000 7fddd3fff700 1 --2- 172.21.15.59:0/948807180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd41338c0 0x7fddd411cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.837+0000 7fddd94cf700 1 --2- 172.21.15.59:0/948807180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddd41341d0 0x7fddd411d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.837+0000 7fddd3fff700 1 -- 172.21.15.59:0/948807180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddd41341d0 msgr2=0x7fddd411d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:05.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.837+0000 7fddd3fff700 1 --2- 172.21.15.59:0/948807180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddd41341d0 0x7fddd411d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.837+0000 7fddd3fff700 1 -- 172.21.15.59:0/948807180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd409e390 msgr2=0x7fddd411c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:05.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.837+0000 7fddd3fff700 1 --2- 172.21.15.59:0/948807180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd409e390 0x7fddd411c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.837+0000 7fddd3fff700 1 -- 172.21.15.59:0/948807180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc0009550 con 0x7fddd41338c0 2023-09-30T22:32:05.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.837+0000 7fddd8cce700 1 --2- 172.21.15.59:0/948807180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd409e390 0x7fddd411c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:05.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.837+0000 7fddd94cf700 1 --2- 172.21.15.59:0/948807180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddd41341d0 0x7fddd411d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:05.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.837+0000 7fddd3fff700 1 --2- 172.21.15.59:0/948807180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd41338c0 0x7fddd411cec0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fddc0016000 tx=0x7fddc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:05.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.837+0000 7fddd17fa700 1 -- 172.21.15.59:0/948807180 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0004400 con 0x7fddd41338c0 2023-09-30T22:32:05.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.837+0000 7fddd17fa700 1 -- 172.21.15.59:0/948807180 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc001f070 con 0x7fddd41338c0 2023-09-30T22:32:05.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.837+0000 7fddd17fa700 1 -- 172.21.15.59:0/948807180 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc00038e0 con 0x7fddd41338c0 2023-09-30T22:32:05.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.837+0000 7fdddaf32700 1 -- 172.21.15.59:0/948807180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd411fe30 con 0x7fddd41338c0 2023-09-30T22:32:05.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.838+0000 7fdddaf32700 1 -- 172.21.15.59:0/948807180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd4120b60 con 0x7fddd41338c0 2023-09-30T22:32:05.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.839+0000 7fdddaf32700 1 -- 172.21.15.59:0/948807180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd4074ea0 con 0x7fddd41338c0 2023-09-30T22:32:05.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.839+0000 7fddd17fa700 1 -- 172.21.15.59:0/948807180 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddc0021030 con 0x7fddd41338c0 2023-09-30T22:32:05.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.839+0000 7fddd17fa700 1 -- 172.21.15.59:0/948807180 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fddc0040b20 con 0x7fddd41338c0 2023-09-30T22:32:05.844 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:05.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.844+0000 7fddd17fa700 1 -- 172.21.15.59:0/948807180 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddc0042e60 con 0x7fddd41338c0 2023-09-30T22:32:05.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.945+0000 7fd138822700 1 Processor -- start 2023-09-30T22:32:05.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.945+0000 7fd138822700 1 -- start start 2023-09-30T22:32:05.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.946+0000 7fd138822700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd13409d6f0 0x7fd13409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.946+0000 7fd138822700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13409e440 0x7fd134134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.946+0000 7fd138822700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13409b120 con 0x7fd13409e000 2023-09-30T22:32:05.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.946+0000 7fd138822700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13406b460 con 0x7fd13409d6f0 2023-09-30T22:32:05.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.946+0000 7fd138822700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13409a7e0 con 0x7fd13409e440 2023-09-30T22:32:05.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.946+0000 7fd132d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13409e440 0x7fd134134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.946+0000 7fd132d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13409e440 0x7fd134134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54884/0 (socket says 172.21.15.59:54884) 2023-09-30T22:32:05.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.946+0000 7fd131d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd13409e000 0x7fd1341339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44290/0 (socket says 172.21.15.59:44290) 2023-09-30T22:32:05.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.946+0000 7fd132d9d700 1 -- 172.21.15.59:0/4217379786 learned_addr learned my addr 172.21.15.59:0/4217379786 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:05.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.946+0000 7fd13259c700 1 --2- 172.21.15.59:0/4217379786 >> v2:172.21.15.59:3300/0 conn(0x7fd13409d6f0 0x7fd13409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.946+0000 7fd132d9d700 1 -- 172.21.15.59:0/4217379786 >> v2:172.21.15.59:3300/0 conn(0x7fd13409d6f0 msgr2=0x7fd13409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:05.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.946+0000 7fd132d9d700 1 --2- 172.21.15.59:0/4217379786 >> v2:172.21.15.59:3300/0 conn(0x7fd13409d6f0 0x7fd13409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.946+0000 7fd132d9d700 1 -- 172.21.15.59:0/4217379786 >> v1:172.21.15.59:6789/0 conn(0x7fd13409e000 legacy=0x7fd1341339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:05.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.946+0000 7fd132d9d700 1 -- 172.21.15.59:0/4217379786 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13409a500 con 0x7fd13409e440 2023-09-30T22:32:05.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.946+0000 7fd13159a700 1 -- 172.21.15.59:0/4217379786 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843260121 0 0) 0x7fd13409b120 con 0x7fd13409e000 2023-09-30T22:32:05.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.947+0000 7fd132d9d700 1 --2- 172.21.15.59:0/4217379786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13409e440 0x7fd134134100 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009e80 tx=0x7fd12c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7264eb06b5acfc2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:05.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.947+0000 7fd13159a700 1 -- 172.21.15.59:0/4217379786 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c00e070 con 0x7fd13409e440 2023-09-30T22:32:05.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.947+0000 7fd13159a700 1 -- 172.21.15.59:0/4217379786 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c00b8d0 con 0x7fd13409e440 2023-09-30T22:32:05.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.947+0000 7fd13159a700 1 -- 172.21.15.59:0/4217379786 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c00bc80 con 0x7fd13409e440 2023-09-30T22:32:05.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.948+0000 7fd138822700 1 -- 172.21.15.59:0/4217379786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13409e440 msgr2=0x7fd134134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:05.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.948+0000 7fd138822700 1 --2- 172.21.15.59:0/4217379786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13409e440 0x7fd134134100 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009e80 tx=0x7fd12c00b330 comp rx=0 tx=0).stop 2023-09-30T22:32:05.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.948+0000 7fd138822700 1 -- 172.21.15.59:0/4217379786 shutdown_connections 2023-09-30T22:32:05.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.948+0000 7fd138822700 1 --2- 172.21.15.59:0/4217379786 >> v2:172.21.15.59:3300/0 conn(0x7fd13409d6f0 0x7fd13409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.948+0000 7fd138822700 1 --2- 172.21.15.59:0/4217379786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13409e440 0x7fd134134100 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.948+0000 7fd138822700 1 -- 172.21.15.59:0/4217379786 >> 172.21.15.59:0/4217379786 conn(0x7fd134066f50 msgr2=0x7fd13409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:05.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.948+0000 7fd138822700 1 -- 172.21.15.59:0/4217379786 shutdown_connections 2023-09-30T22:32:05.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.948+0000 7fd138822700 1 -- 172.21.15.59:0/4217379786 wait complete. 2023-09-30T22:32:05.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.950+0000 7fd138822700 1 Processor -- start 2023-09-30T22:32:05.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.950+0000 7fd138822700 1 -- start start 2023-09-30T22:32:05.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.951+0000 7fd138822700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13409d6f0 0x7fd1341c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.951+0000 7fd138822700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13409e000 0x7fd1341c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.951+0000 7fd138822700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13409e440 0x7fd1341c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.951+0000 7fd138822700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1341a6950 con 0x7fd13409e440 2023-09-30T22:32:05.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.951+0000 7fd138822700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340a1d00 con 0x7fd13409d6f0 2023-09-30T22:32:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.951+0000 7fd138822700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1341a64b0 con 0x7fd13409e000 2023-09-30T22:32:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.951+0000 7fd13259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13409d6f0 0x7fd1341c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.951+0000 7fd13259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13409d6f0 0x7fd1341c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54896/0 (socket says 172.21.15.59:54896) 2023-09-30T22:32:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.951+0000 7fd13259c700 1 -- 172.21.15.59:0/4240223021 learned_addr learned my addr 172.21.15.59:0/4240223021 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.951+0000 7fd132d9d700 1 --2- 172.21.15.59:0/4240223021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13409e440 0x7fd1341c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.951+0000 7fd131d9b700 1 --2- 172.21.15.59:0/4240223021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13409e000 0x7fd1341c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.952+0000 7fd132d9d700 1 -- 172.21.15.59:0/4240223021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13409e000 msgr2=0x7fd1341c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.952+0000 7fd132d9d700 1 --2- 172.21.15.59:0/4240223021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13409e000 0x7fd1341c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.952+0000 7fd132d9d700 1 -- 172.21.15.59:0/4240223021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13409d6f0 msgr2=0x7fd1341c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.952+0000 7fd132d9d700 1 --2- 172.21.15.59:0/4240223021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13409d6f0 0x7fd1341c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.952+0000 7fd132d9d700 1 -- 172.21.15.59:0/4240223021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c009b30 con 0x7fd13409e440 2023-09-30T22:32:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.952+0000 7fd131d9b700 1 --2- 172.21.15.59:0/4240223021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13409e000 0x7fd1341c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.952+0000 7fd132d9d700 1 --2- 172.21.15.59:0/4240223021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13409e440 0x7fd1341c8aa0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd12c015000 tx=0x7fd12c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.952+0000 7fd122ffd700 1 -- 172.21.15.59:0/4240223021 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c004680 con 0x7fd13409e440 2023-09-30T22:32:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.952+0000 7fd122ffd700 1 -- 172.21.15.59:0/4240223021 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c0047e0 con 0x7fd13409e440 2023-09-30T22:32:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.952+0000 7fd138822700 1 -- 172.21.15.59:0/4240223021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1341a6b90 con 0x7fd13409e440 2023-09-30T22:32:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.952+0000 7fd122ffd700 1 -- 172.21.15.59:0/4240223021 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c02d690 con 0x7fd13409e440 2023-09-30T22:32:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.952+0000 7fd138822700 1 -- 172.21.15.59:0/4240223021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1341a82b0 con 0x7fd13409e440 2023-09-30T22:32:05.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.954+0000 7fd138822700 1 -- 172.21.15.59:0/4240223021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1341a7c70 con 0x7fd13409e440 2023-09-30T22:32:05.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.954+0000 7fd122ffd700 1 -- 172.21.15.59:0/4240223021 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd12c02d7f0 con 0x7fd13409e440 2023-09-30T22:32:05.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.954+0000 7fd122ffd700 1 -- 172.21.15.59:0/4240223021 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd12c051f70 con 0x7fd13409e440 2023-09-30T22:32:05.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.959+0000 7fd122ffd700 1 -- 172.21.15.59:0/4240223021 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd12c035960 con 0x7fd13409e440 2023-09-30T22:32:05.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.967+0000 7f895eae1700 1 Processor -- start 2023-09-30T22:32:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.967+0000 7f895eae1700 1 -- start start 2023-09-30T22:32:05.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.968+0000 7f895eae1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f895809d6f0 0x7f895809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.968+0000 7f895eae1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f895809e410 0x7f8958134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.968+0000 7f895eae1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895809b120 con 0x7f895809e000 2023-09-30T22:32:05.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.968+0000 7f895eae1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895806b460 con 0x7f895809e410 2023-09-30T22:32:05.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.968+0000 7f895eae1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895809a7e0 con 0x7f895809d6f0 2023-09-30T22:32:05.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.968+0000 7f8957fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f895809e000 0x7f89581339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44306/0 (socket says 172.21.15.59:44306) 2023-09-30T22:32:05.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.968+0000 7f8957fff700 1 -- 172.21.15.59:0/2697505300 learned_addr learned my addr 172.21.15.59:0/2697505300 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:05.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.968+0000 7f895d07e700 1 --2- 172.21.15.59:0/2697505300 >> v2:172.21.15.59:3300/0 conn(0x7f895809e410 0x7f8958134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.969+0000 7f895c87d700 1 --2- 172.21.15.59:0/2697505300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f895809d6f0 0x7f895809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.969+0000 7f895d07e700 1 -- 172.21.15.59:0/2697505300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f895809d6f0 msgr2=0x7f895809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:05.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.969+0000 7f89577fe700 1 -- 172.21.15.59:0/2697505300 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299445728 0 0) 0x7f895809b120 con 0x7f895809e000 2023-09-30T22:32:05.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.969+0000 7f895d07e700 1 --2- 172.21.15.59:0/2697505300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f895809d6f0 0x7f895809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.969+0000 7f895d07e700 1 -- 172.21.15.59:0/2697505300 >> v1:172.21.15.59:6789/0 conn(0x7f895809e000 legacy=0x7f89581339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:05.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.969+0000 7f895d07e700 1 -- 172.21.15.59:0/2697505300 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895809a500 con 0x7f895809e410 2023-09-30T22:32:05.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.969+0000 7f895d07e700 1 --2- 172.21.15.59:0/2697505300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f895809e410 0x7f8958134100 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8950009d90 tx=0x7f895000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac86fdd8f30332 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:05.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.969+0000 7f89577fe700 1 -- 172.21.15.59:0/2697505300 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000e070 con 0x7f895809e410 2023-09-30T22:32:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.969+0000 7f89577fe700 1 -- 172.21.15.59:0/2697505300 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895000bbd0 con 0x7f895809e410 2023-09-30T22:32:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.969+0000 7f89577fe700 1 -- 172.21.15.59:0/2697505300 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950012430 con 0x7f895809e410 2023-09-30T22:32:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.970+0000 7f895eae1700 1 -- 172.21.15.59:0/2697505300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f895809e410 msgr2=0x7f8958134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.970+0000 7f895eae1700 1 --2- 172.21.15.59:0/2697505300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f895809e410 0x7f8958134100 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8950009d90 tx=0x7f895000b330 comp rx=0 tx=0).stop 2023-09-30T22:32:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.970+0000 7f895eae1700 1 -- 172.21.15.59:0/2697505300 shutdown_connections 2023-09-30T22:32:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.970+0000 7f895eae1700 1 --2- 172.21.15.59:0/2697505300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f895809e410 0x7f8958134100 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.970+0000 7f895eae1700 1 --2- 172.21.15.59:0/2697505300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f895809d6f0 0x7f895809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.970+0000 7f895eae1700 1 -- 172.21.15.59:0/2697505300 >> 172.21.15.59:0/2697505300 conn(0x7f8958066f50 msgr2=0x7f895809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.970+0000 7f895eae1700 1 -- 172.21.15.59:0/2697505300 shutdown_connections 2023-09-30T22:32:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.970+0000 7f895eae1700 1 -- 172.21.15.59:0/2697505300 wait complete. 2023-09-30T22:32:05.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.971+0000 7f895eae1700 1 Processor -- start 2023-09-30T22:32:05.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.971+0000 7f895eae1700 1 -- start start 2023-09-30T22:32:05.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f895eae1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f895809d6f0 0x7f89581a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f895eae1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f895809e000 0x7f89581a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f895eae1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f895809e410 0x7f89581c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f895eae1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89581a8120 con 0x7f895809e000 2023-09-30T22:32:05.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f895eae1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89581a8300 con 0x7f895809d6f0 2023-09-30T22:32:05.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f895eae1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89581b9170 con 0x7f895809e410 2023-09-30T22:32:05.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f8957fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f895809e000 0x7f89581a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f895c87d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f895809d6f0 0x7f89581a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f8957fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f895809e000 0x7f89581a5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39424/0 (socket says 172.21.15.59:39424) 2023-09-30T22:32:05.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f8957fff700 1 -- 172.21.15.59:0/2185389355 learned_addr learned my addr 172.21.15.59:0/2185389355 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:05.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f895d07e700 1 --2- 172.21.15.59:0/2185389355 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f895809e410 0x7f89581c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f8957fff700 1 -- 172.21.15.59:0/2185389355 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f895809e410 msgr2=0x7f89581c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:05.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f8957fff700 1 --2- 172.21.15.59:0/2185389355 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f895809e410 0x7f89581c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f8957fff700 1 -- 172.21.15.59:0/2185389355 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f895809d6f0 msgr2=0x7f89581a5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:05.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f8957fff700 1 --2- 172.21.15.59:0/2185389355 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f895809d6f0 0x7f89581a5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.972+0000 7f8957fff700 1 -- 172.21.15.59:0/2185389355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8950009a70 con 0x7f895809e000 2023-09-30T22:32:05.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.973+0000 7f8957fff700 1 --2- 172.21.15.59:0/2185389355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f895809e000 0x7f89581a5780 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f894400c520 tx=0x7f894400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:05.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.973+0000 7f89557fa700 1 -- 172.21.15.59:0/2185389355 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944004c80 con 0x7f895809e000 2023-09-30T22:32:05.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.973+0000 7f895eae1700 1 -- 172.21.15.59:0/2185389355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89581a4ca0 con 0x7f895809e000 2023-09-30T22:32:05.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.973+0000 7f895eae1700 1 -- 172.21.15.59:0/2185389355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89581a7b00 con 0x7f895809e000 2023-09-30T22:32:05.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.974+0000 7f89557fa700 1 -- 172.21.15.59:0/2185389355 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8944004de0 con 0x7f895809e000 2023-09-30T22:32:05.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.974+0000 7f89557fa700 1 -- 172.21.15.59:0/2185389355 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944007310 con 0x7f895809e000 2023-09-30T22:32:05.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.974+0000 7f895eae1700 1 -- 172.21.15.59:0/2185389355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89380052e0 con 0x7f895809e000 2023-09-30T22:32:05.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.976+0000 7f89557fa700 1 -- 172.21.15.59:0/2185389355 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8944007470 con 0x7f895809e000 2023-09-30T22:32:05.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.976+0000 7f89557fa700 1 -- 172.21.15.59:0/2185389355 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f894403f980 con 0x7f895809e000 2023-09-30T22:32:05.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.980+0000 7f89557fa700 1 -- 172.21.15.59:0/2185389355 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f894401bd10 con 0x7f895809e000 2023-09-30T22:32:05.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.992+0000 7f176a668700 1 Processor -- start 2023-09-30T22:32:05.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.992+0000 7f176a668700 1 -- start start 2023-09-30T22:32:05.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.992+0000 7f176a668700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f176409e930 0x7f176409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.992+0000 7f176a668700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f176409f240 0x7f17641317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.992+0000 7f176a668700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f176409f650 0x7f1764131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.992+0000 7f176a668700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1764070940 con 0x7f176409e930 2023-09-30T22:32:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.992+0000 7f176a668700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176406fd60 con 0x7f176409f650 2023-09-30T22:32:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.992+0000 7f176a668700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f176406fa80 con 0x7f176409f240 2023-09-30T22:32:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.993+0000 7f1763fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f176409e930 0x7f176409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.993+0000 7f1763fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f176409e930 0x7f176409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39438/0 (socket says 172.21.15.59:39438) 2023-09-30T22:32:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.993+0000 7f1763fff700 1 -- 172.21.15.59:0/3530469560 learned_addr learned my addr 172.21.15.59:0/3530469560 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.993+0000 7f1768c05700 1 --2- 172.21.15.59:0/3530469560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f176409f650 0x7f1764131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.993+0000 7f17637fe700 1 --2- 172.21.15.59:0/3530469560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f176409f240 0x7f17641317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.993+0000 7f1763fff700 1 -- 172.21.15.59:0/3530469560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f176409f240 msgr2=0x7f17641317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.993+0000 7f1763fff700 1 --2- 172.21.15.59:0/3530469560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f176409f240 0x7f17641317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.993+0000 7f1763fff700 1 -- 172.21.15.59:0/3530469560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f176409f650 msgr2=0x7f1764131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.993+0000 7f1763fff700 1 --2- 172.21.15.59:0/3530469560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f176409f650 0x7f1764131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.993+0000 7f1763fff700 1 -- 172.21.15.59:0/3530469560 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176409fb60 con 0x7f176409e930 2023-09-30T22:32:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.993+0000 7f17637fe700 1 --2- 172.21.15.59:0/3530469560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f176409f240 0x7f17641317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.993+0000 7f1768c05700 1 --2- 172.21.15.59:0/3530469560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f176409f650 0x7f1764131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.993+0000 7f1763fff700 1 --2- 172.21.15.59:0/3530469560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176409e930 0x7f176409ed00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f17540098f0 tx=0x7f1754009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4646d2a88e81a9b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:05.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.994+0000 7f1762ffd700 1 -- 172.21.15.59:0/3530469560 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754011830 con 0x7f176409e930 2023-09-30T22:32:05.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.994+0000 7f1762ffd700 1 -- 172.21.15.59:0/3530469560 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1754011990 con 0x7f176409e930 2023-09-30T22:32:05.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.994+0000 7f1762ffd700 1 -- 172.21.15.59:0/3530469560 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754011d20 con 0x7f176409e930 2023-09-30T22:32:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.994+0000 7f176a668700 1 -- 172.21.15.59:0/3530469560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176409e930 msgr2=0x7f176409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.994+0000 7f176a668700 1 --2- 172.21.15.59:0/3530469560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176409e930 0x7f176409ed00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f17540098f0 tx=0x7f1754009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.994+0000 7f176a668700 1 -- 172.21.15.59:0/3530469560 shutdown_connections 2023-09-30T22:32:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.994+0000 7f176a668700 1 --2- 172.21.15.59:0/3530469560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f176409f650 0x7f1764131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.994+0000 7f176a668700 1 --2- 172.21.15.59:0/3530469560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176409e930 0x7f176409ed00 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.994+0000 7f176a668700 1 --2- 172.21.15.59:0/3530469560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f176409f240 0x7f17641317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.994+0000 7f176a668700 1 -- 172.21.15.59:0/3530469560 >> 172.21.15.59:0/3530469560 conn(0x7f17640a4210 msgr2=0x7f17640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.994+0000 7f176a668700 1 -- 172.21.15.59:0/3530469560 shutdown_connections 2023-09-30T22:32:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.994+0000 7f176a668700 1 -- 172.21.15.59:0/3530469560 wait complete. 2023-09-30T22:32:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.995+0000 7f176a668700 1 Processor -- start 2023-09-30T22:32:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.996+0000 7f176a668700 1 -- start start 2023-09-30T22:32:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.996+0000 7f176a668700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176409e930 0x7f17641a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.996+0000 7f176a668700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f176409f240 0x7f17641a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.996+0000 7f176a668700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f176409f650 0x7f17641a4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.996+0000 7f176a668700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17641a5260 con 0x7f176409e930 2023-09-30T22:32:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.996+0000 7f176a668700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17641a5930 con 0x7f176409f650 2023-09-30T22:32:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.996+0000 7f176a668700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17641a6b80 con 0x7f176409f240 2023-09-30T22:32:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.996+0000 7f1763fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176409e930 0x7f17641a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.996+0000 7f1768c05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f176409f650 0x7f17641a4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.996+0000 7f1763fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176409e930 0x7f17641a3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39444/0 (socket says 172.21.15.59:39444) 2023-09-30T22:32:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.996+0000 7f1763fff700 1 -- 172.21.15.59:0/106251832 learned_addr learned my addr 172.21.15.59:0/106251832 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.997+0000 7f17637fe700 1 --2- 172.21.15.59:0/106251832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f176409f240 0x7f17641a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.997+0000 7f1763fff700 1 -- 172.21.15.59:0/106251832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f176409f240 msgr2=0x7f17641a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.997+0000 7f1763fff700 1 --2- 172.21.15.59:0/106251832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f176409f240 0x7f17641a42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.997+0000 7f1763fff700 1 -- 172.21.15.59:0/106251832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f176409f650 msgr2=0x7f17641a4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.997+0000 7f1763fff700 1 --2- 172.21.15.59:0/106251832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f176409f650 0x7f17641a4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.997+0000 7f1763fff700 1 -- 172.21.15.59:0/106251832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c009a70 con 0x7f176409e930 2023-09-30T22:32:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.997+0000 7f1768c05700 1 --2- 172.21.15.59:0/106251832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f176409f650 0x7f17641a4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.997+0000 7f1763fff700 1 --2- 172.21.15.59:0/106251832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176409e930 0x7f17641a3db0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1754009c40 tx=0x7f1754004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.997+0000 7f1760ff9700 1 -- 172.21.15.59:0/106251832 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754004240 con 0x7f176409e930 2023-09-30T22:32:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.997+0000 7f1760ff9700 1 -- 172.21.15.59:0/106251832 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1754023070 con 0x7f176409e930 2023-09-30T22:32:06.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.998+0000 7f176a668700 1 -- 172.21.15.59:0/106251832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1754009550 con 0x7f176409e930 2023-09-30T22:32:06.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.998+0000 7f1760ff9700 1 -- 172.21.15.59:0/106251832 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17540045c0 con 0x7f176409e930 2023-09-30T22:32:06.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.998+0000 7f176a668700 1 -- 172.21.15.59:0/106251832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17640a0190 con 0x7f176409e930 2023-09-30T22:32:06.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.999+0000 7f176a668700 1 -- 172.21.15.59:0/106251832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17641a0b30 con 0x7f176409e930 2023-09-30T22:32:06.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:05.999+0000 7f1760ff9700 1 -- 172.21.15.59:0/106251832 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1754025030 con 0x7f176409e930 2023-09-30T22:32:06.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.000+0000 7f1760ff9700 1 -- 172.21.15.59:0/106251832 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1754044c90 con 0x7f176409e930 2023-09-30T22:32:06.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.009+0000 7f1760ff9700 1 -- 172.21.15.59:0/106251832 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f175400b3e0 con 0x7f176409e930 2023-09-30T22:32:06.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.140+0000 7fdddaf32700 1 -- 172.21.15.59:0/948807180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fddd406b9e0 con 0x7fddd41338c0 2023-09-30T22:32:06.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.141+0000 7fddd17fa700 1 -- 172.21.15.59:0/948807180 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddc0015020 con 0x7fddd41338c0 2023-09-30T22:32:06.141 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:06.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.144+0000 7fdddaf32700 1 -- 172.21.15.59:0/948807180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd41338c0 msgr2=0x7fddd411cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:06.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.144+0000 7fdddaf32700 1 --2- 172.21.15.59:0/948807180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd41338c0 0x7fddd411cec0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fddc0016000 tx=0x7fddc0004750 comp rx=0 tx=0).stop 2023-09-30T22:32:06.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.144+0000 7fdddaf32700 1 -- 172.21.15.59:0/948807180 shutdown_connections 2023-09-30T22:32:06.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.144+0000 7fdddaf32700 1 --2- 172.21.15.59:0/948807180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fddd41341d0 0x7fddd411d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:06.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.144+0000 7fdddaf32700 1 --2- 172.21.15.59:0/948807180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd409e390 0x7fddd411c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:06.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.144+0000 7fdddaf32700 1 --2- 172.21.15.59:0/948807180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd41338c0 0x7fddd411cec0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:06.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.144+0000 7fdddaf32700 1 -- 172.21.15.59:0/948807180 >> 172.21.15.59:0/948807180 conn(0x7fddd40a2aa0 msgr2=0x7fddd409f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:06.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.144+0000 7fdddaf32700 1 -- 172.21.15.59:0/948807180 shutdown_connections 2023-09-30T22:32:06.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.145+0000 7fdddaf32700 1 -- 172.21.15.59:0/948807180 wait complete. 2023-09-30T22:32:06.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:06.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.170+0000 7fd138822700 1 -- 172.21.15.59:0/4240223021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd13409f420 con 0x7fd13409e440 2023-09-30T22:32:06.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.170+0000 7fd122ffd700 1 -- 172.21.15.59:0/4240223021 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd12c035730 con 0x7fd13409e440 2023-09-30T22:32:06.171 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:06.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.172+0000 7fd138822700 1 -- 172.21.15.59:0/4240223021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13409e440 msgr2=0x7fd1341c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:06.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.172+0000 7fd138822700 1 --2- 172.21.15.59:0/4240223021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13409e440 0x7fd1341c8aa0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd12c015000 tx=0x7fd12c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:32:06.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.172+0000 7fd138822700 1 -- 172.21.15.59:0/4240223021 shutdown_connections 2023-09-30T22:32:06.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.172+0000 7fd138822700 1 --2- 172.21.15.59:0/4240223021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13409e440 0x7fd1341c8aa0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:06.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.172+0000 7fd138822700 1 --2- 172.21.15.59:0/4240223021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13409d6f0 0x7fd1341c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:06.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.172+0000 7fd138822700 1 --2- 172.21.15.59:0/4240223021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13409e000 0x7fd1341c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:06.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.172+0000 7fd138822700 1 -- 172.21.15.59:0/4240223021 >> 172.21.15.59:0/4240223021 conn(0x7fd134066f50 msgr2=0x7fd1341bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:06.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.173+0000 7fd138822700 1 -- 172.21.15.59:0/4240223021 shutdown_connections 2023-09-30T22:32:06.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.173+0000 7fd138822700 1 -- 172.21.15.59:0/4240223021 wait complete. 2023-09-30T22:32:06.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.195+0000 7f895eae1700 1 -- 172.21.15.59:0/2185389355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8938005860 con 0x7f895809e000 2023-09-30T22:32:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.195+0000 7f89557fa700 1 -- 172.21.15.59:0/2185389355 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8944011e80 con 0x7f895809e000 2023-09-30T22:32:06.196 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:06.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.197+0000 7f895eae1700 1 -- 172.21.15.59:0/2185389355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f895809e000 msgr2=0x7f89581a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:06.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.197+0000 7f895eae1700 1 --2- 172.21.15.59:0/2185389355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f895809e000 0x7f89581a5780 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f894400c520 tx=0x7f894400c830 comp rx=0 tx=0).stop 2023-09-30T22:32:06.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.197+0000 7f895eae1700 1 -- 172.21.15.59:0/2185389355 shutdown_connections 2023-09-30T22:32:06.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.197+0000 7f895eae1700 1 --2- 172.21.15.59:0/2185389355 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f895809e410 0x7f89581c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:06.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.197+0000 7f895eae1700 1 --2- 172.21.15.59:0/2185389355 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f895809d6f0 0x7f89581a5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:06.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.197+0000 7f895eae1700 1 --2- 172.21.15.59:0/2185389355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f895809e000 0x7f89581a5780 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:06.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.197+0000 7f895eae1700 1 -- 172.21.15.59:0/2185389355 >> 172.21.15.59:0/2185389355 conn(0x7f8958066f50 msgr2=0x7f895806f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:06.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.197+0000 7f895eae1700 1 -- 172.21.15.59:0/2185389355 shutdown_connections 2023-09-30T22:32:06.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.197+0000 7f895eae1700 1 -- 172.21.15.59:0/2185389355 wait complete. 2023-09-30T22:32:06.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.266+0000 7f176a668700 1 -- 172.21.15.59:0/106251832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f17641a5f10 con 0x7f176409e930 2023-09-30T22:32:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.266+0000 7f1760ff9700 1 -- 172.21.15.59:0/106251832 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17641a5f10 con 0x7f176409e930 2023-09-30T22:32:06.267 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.269+0000 7f176a668700 1 -- 172.21.15.59:0/106251832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176409e930 msgr2=0x7f17641a3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.269+0000 7f176a668700 1 --2- 172.21.15.59:0/106251832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176409e930 0x7f17641a3db0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1754009c40 tx=0x7f1754004750 comp rx=0 tx=0).stop 2023-09-30T22:32:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.269+0000 7f176a668700 1 -- 172.21.15.59:0/106251832 shutdown_connections 2023-09-30T22:32:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.269+0000 7f176a668700 1 --2- 172.21.15.59:0/106251832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f176409f650 0x7f17641a4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.269+0000 7f176a668700 1 --2- 172.21.15.59:0/106251832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176409e930 0x7f17641a3db0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.269+0000 7f176a668700 1 --2- 172.21.15.59:0/106251832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f176409f240 0x7f17641a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.269+0000 7f176a668700 1 -- 172.21.15.59:0/106251832 >> 172.21.15.59:0/106251832 conn(0x7f17640a4210 msgr2=0x7f17641b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.269+0000 7f176a668700 1 -- 172.21.15.59:0/106251832 shutdown_connections 2023-09-30T22:32:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:06.269+0000 7f176a668700 1 -- 172.21.15.59:0/106251832 wait complete. 2023-09-30T22:32:06.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:07.164 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:07.187 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:07.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:07.283 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:07.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.321+0000 7f0d93f4a700 1 Processor -- start 2023-09-30T22:32:07.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.321+0000 7f0d93f4a700 1 -- start start 2023-09-30T22:32:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.322+0000 7f0d93f4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d8c1338c0 0x7f0d8c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.322+0000 7f0d93f4a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0d8c1341d0 0x7f0d8c09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.322+0000 7f0d93f4a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8c06f720 con 0x7f0d8c09e390 2023-09-30T22:32:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.322+0000 7f0d93f4a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8c070c80 con 0x7f0d8c1341d0 2023-09-30T22:32:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.322+0000 7f0d93f4a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c06fce0 con 0x7f0d8c1338c0 2023-09-30T22:32:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.322+0000 7f0d91ce6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d8c1338c0 0x7f0d8c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.322+0000 7f0d914e5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0d8c1341d0 0x7f0d8c09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.322+0000 7f0d91ce6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d8c1338c0 0x7f0d8c133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42814/0 (socket says 172.21.15.59:42814) 2023-09-30T22:32:07.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.322+0000 7f0d91ce6700 1 -- 172.21.15.59:0/276323672 learned_addr learned my addr 172.21.15.59:0/276323672 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:07.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.322+0000 7f0d91ce6700 1 -- 172.21.15.59:0/276323672 >> v2:172.21.15.59:3300/0 conn(0x7f0d8c1341d0 msgr2=0x7f0d8c09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:07.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.323+0000 7f0d91ce6700 1 --2- 172.21.15.59:0/276323672 >> v2:172.21.15.59:3300/0 conn(0x7f0d8c1341d0 0x7f0d8c09de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.323+0000 7f0d91ce6700 1 -- 172.21.15.59:0/276323672 >> v1:172.21.15.59:6789/0 conn(0x7f0d8c09e390 legacy=0x7f0d8c13a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.323+0000 7f0d91ce6700 1 -- 172.21.15.59:0/276323672 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c1336a0 con 0x7f0d8c1338c0 2023-09-30T22:32:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.323+0000 7f0d90ce4700 1 -- 172.21.15.59:0/276323672 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561097716 0 0) 0x7f0d8c06f720 con 0x7f0d8c09e390 2023-09-30T22:32:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.323+0000 7f0d91ce6700 1 --2- 172.21.15.59:0/276323672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d8c1338c0 0x7f0d8c133c90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0d880098f0 tx=0x7f0d88009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e4f1345b9bad22a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.323+0000 7f0d90ce4700 1 -- 172.21.15.59:0/276323672 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88011830 con 0x7f0d8c1338c0 2023-09-30T22:32:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.323+0000 7f0d90ce4700 1 -- 172.21.15.59:0/276323672 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d88011990 con 0x7f0d8c1338c0 2023-09-30T22:32:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.323+0000 7f0d90ce4700 1 -- 172.21.15.59:0/276323672 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88011d20 con 0x7f0d8c1338c0 2023-09-30T22:32:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.324+0000 7f0d93f4a700 1 -- 172.21.15.59:0/276323672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d8c1338c0 msgr2=0x7f0d8c133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.324+0000 7f0d93f4a700 1 --2- 172.21.15.59:0/276323672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d8c1338c0 0x7f0d8c133c90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0d880098f0 tx=0x7f0d88009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.324+0000 7f0d93f4a700 1 -- 172.21.15.59:0/276323672 shutdown_connections 2023-09-30T22:32:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.324+0000 7f0d93f4a700 1 --2- 172.21.15.59:0/276323672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d8c1338c0 0x7f0d8c133c90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.324+0000 7f0d93f4a700 1 --2- 172.21.15.59:0/276323672 >> v2:172.21.15.59:3300/0 conn(0x7f0d8c1341d0 0x7f0d8c09de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.324+0000 7f0d93f4a700 1 -- 172.21.15.59:0/276323672 >> 172.21.15.59:0/276323672 conn(0x7f0d8c0a2aa0 msgr2=0x7f0d8c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:07.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.324+0000 7f0d93f4a700 1 -- 172.21.15.59:0/276323672 shutdown_connections 2023-09-30T22:32:07.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.324+0000 7f0d93f4a700 1 -- 172.21.15.59:0/276323672 wait complete. 2023-09-30T22:32:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.326+0000 7f0d93f4a700 1 Processor -- start 2023-09-30T22:32:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.326+0000 7f0d93f4a700 1 -- start start 2023-09-30T22:32:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.326+0000 7f0d93f4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d8c09e390 0x7f0d8c11a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.326+0000 7f0d93f4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d8c1338c0 0x7f0d8c11aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.326+0000 7f0d93f4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d8c1341d0 0x7f0d8c11afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.326+0000 7f0d93f4a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c11ba10 con 0x7f0d8c1341d0 2023-09-30T22:32:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.326+0000 7f0d93f4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c11c170 con 0x7f0d8c09e390 2023-09-30T22:32:07.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.326+0000 7f0d93f4a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c11c790 con 0x7f0d8c1338c0 2023-09-30T22:32:07.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.327+0000 7f0d91ce6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d8c09e390 0x7f0d8c11a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.327+0000 7f0d91ce6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d8c09e390 0x7f0d8c11a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54938/0 (socket says 172.21.15.59:54938) 2023-09-30T22:32:07.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.327+0000 7f0d91ce6700 1 -- 172.21.15.59:0/931252154 learned_addr learned my addr 172.21.15.59:0/931252154 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:07.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.327+0000 7f0d924e7700 1 --2- 172.21.15.59:0/931252154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d8c1341d0 0x7f0d8c11afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.327+0000 7f0d91ce6700 1 -- 172.21.15.59:0/931252154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d8c1338c0 msgr2=0x7f0d8c11aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.327+0000 7f0d91ce6700 1 --2- 172.21.15.59:0/931252154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d8c1338c0 0x7f0d8c11aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.327+0000 7f0d91ce6700 1 -- 172.21.15.59:0/931252154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d8c1341d0 msgr2=0x7f0d8c11afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.327+0000 7f0d91ce6700 1 --2- 172.21.15.59:0/931252154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d8c1341d0 0x7f0d8c11afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.327+0000 7f0d91ce6700 1 -- 172.21.15.59:0/931252154 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d88009550 con 0x7f0d8c09e390 2023-09-30T22:32:07.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.327+0000 7f0d91ce6700 1 --2- 172.21.15.59:0/931252154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d8c09e390 0x7f0d8c11a560 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009c40 tx=0x7f0d88004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:07.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.328+0000 7f0d827fc700 1 -- 172.21.15.59:0/931252154 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88004480 con 0x7f0d8c09e390 2023-09-30T22:32:07.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.328+0000 7f0d827fc700 1 -- 172.21.15.59:0/931252154 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8801f070 con 0x7f0d8c09e390 2023-09-30T22:32:07.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.328+0000 7f0d827fc700 1 -- 172.21.15.59:0/931252154 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d880038c0 con 0x7f0d8c09e390 2023-09-30T22:32:07.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.328+0000 7f0d93f4a700 1 -- 172.21.15.59:0/931252154 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8c11dda0 con 0x7f0d8c09e390 2023-09-30T22:32:07.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.328+0000 7f0d93f4a700 1 -- 172.21.15.59:0/931252154 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8c12fe40 con 0x7f0d8c09e390 2023-09-30T22:32:07.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.329+0000 7f0d93f4a700 1 -- 172.21.15.59:0/931252154 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8c06f9c0 con 0x7f0d8c09e390 2023-09-30T22:32:07.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.330+0000 7f0d827fc700 1 -- 172.21.15.59:0/931252154 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d88021030 con 0x7f0d8c09e390 2023-09-30T22:32:07.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.330+0000 7f0d827fc700 1 -- 172.21.15.59:0/931252154 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0d88040f80 con 0x7f0d8c09e390 2023-09-30T22:32:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.338+0000 7f0d827fc700 1 -- 172.21.15.59:0/931252154 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d880199a0 con 0x7f0d8c09e390 2023-09-30T22:32:07.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.356+0000 7f890bdb8700 1 Processor -- start 2023-09-30T22:32:07.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.356+0000 7f890bdb8700 1 -- start start 2023-09-30T22:32:07.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.356+0000 7f890bdb8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f890409d6d0 0x7f890409daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.356+0000 7f890bdb8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8904133cd0 0x7f890413ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.356+0000 7f890bdb8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f890409a570 con 0x7f890409dfe0 2023-09-30T22:32:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.356+0000 7f890bdb8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f890409b1c0 con 0x7f8904133cd0 2023-09-30T22:32:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.356+0000 7f890bdb8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890409f240 con 0x7f890409d6d0 2023-09-30T22:32:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.357+0000 7f8909b54700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f890409d6d0 0x7f890409daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.357+0000 7f8909b54700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f890409d6d0 0x7f890409daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54952/0 (socket says 172.21.15.59:54952) 2023-09-30T22:32:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.357+0000 7f8909b54700 1 -- 172.21.15.59:0/3829142733 learned_addr learned my addr 172.21.15.59:0/3829142733 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.357+0000 7f890a355700 1 --2- 172.21.15.59:0/3829142733 >> v2:172.21.15.59:3300/0 conn(0x7f8904133cd0 0x7f890413ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.357+0000 7f8909b54700 1 -- 172.21.15.59:0/3829142733 >> v2:172.21.15.59:3300/0 conn(0x7f8904133cd0 msgr2=0x7f890413ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.357+0000 7f8909b54700 1 --2- 172.21.15.59:0/3829142733 >> v2:172.21.15.59:3300/0 conn(0x7f8904133cd0 0x7f890413ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.357+0000 7f8909b54700 1 -- 172.21.15.59:0/3829142733 >> v1:172.21.15.59:6789/0 conn(0x7f890409dfe0 legacy=0x7f89041335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.357+0000 7f8909b54700 1 -- 172.21.15.59:0/3829142733 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890409a2d0 con 0x7f890409d6d0 2023-09-30T22:32:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.357+0000 7f8909b54700 1 --2- 172.21.15.59:0/3829142733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f890409d6d0 0x7f890409daa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f89000098f0 tx=0x7f8900009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53538f16d8617db8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.357+0000 7f8908b52700 1 -- 172.21.15.59:0/3829142733 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8900011830 con 0x7f890409d6d0 2023-09-30T22:32:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.358+0000 7f8908b52700 1 -- 172.21.15.59:0/3829142733 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8900011990 con 0x7f890409d6d0 2023-09-30T22:32:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.358+0000 7f8908b52700 1 -- 172.21.15.59:0/3829142733 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8900011d20 con 0x7f890409d6d0 2023-09-30T22:32:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.358+0000 7f890bdb8700 1 -- 172.21.15.59:0/3829142733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f890409d6d0 msgr2=0x7f890409daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.358+0000 7f890bdb8700 1 --2- 172.21.15.59:0/3829142733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f890409d6d0 0x7f890409daa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f89000098f0 tx=0x7f8900009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.358+0000 7f890bdb8700 1 -- 172.21.15.59:0/3829142733 shutdown_connections 2023-09-30T22:32:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.358+0000 7f890bdb8700 1 --2- 172.21.15.59:0/3829142733 >> v2:172.21.15.59:3300/0 conn(0x7f8904133cd0 0x7f890413ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.358+0000 7f890bdb8700 1 --2- 172.21.15.59:0/3829142733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f890409d6d0 0x7f890409daa0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.358+0000 7f890bdb8700 1 -- 172.21.15.59:0/3829142733 >> 172.21.15.59:0/3829142733 conn(0x7f8904099c20 msgr2=0x7f89040a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:07.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.358+0000 7f890bdb8700 1 -- 172.21.15.59:0/3829142733 shutdown_connections 2023-09-30T22:32:07.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.358+0000 7f890bdb8700 1 -- 172.21.15.59:0/3829142733 wait complete. 2023-09-30T22:32:07.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.359+0000 7f890bdb8700 1 Processor -- start 2023-09-30T22:32:07.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.360+0000 7f890bdb8700 1 -- start start 2023-09-30T22:32:07.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.360+0000 7f890bdb8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f890409d6d0 0x7f890411f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.360+0000 7f890bdb8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f890409dfe0 0x7f890411f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.360+0000 7f890bdb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8904133cd0 0x7f890411fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.360+0000 7f890bdb8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89041229b0 con 0x7f890409d6d0 2023-09-30T22:32:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.360+0000 7f890bdb8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8904122bb0 con 0x7f890409dfe0 2023-09-30T22:32:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.360+0000 7f890bdb8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8904121aa0 con 0x7f8904133cd0 2023-09-30T22:32:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.360+0000 7f8909b54700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f890409d6d0 0x7f890411f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.360+0000 7f8909b54700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f890409d6d0 0x7f890411f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39474/0 (socket says 172.21.15.59:39474) 2023-09-30T22:32:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.360+0000 7f8909b54700 1 -- 172.21.15.59:0/450966922 learned_addr learned my addr 172.21.15.59:0/450966922 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.360+0000 7f8909353700 1 --2- 172.21.15.59:0/450966922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f890409dfe0 0x7f890411f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.360+0000 7f890a355700 1 --2- 172.21.15.59:0/450966922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8904133cd0 0x7f890411fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.361+0000 7f8909353700 1 -- 172.21.15.59:0/450966922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8904133cd0 msgr2=0x7f890411fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.361+0000 7f8909353700 1 --2- 172.21.15.59:0/450966922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8904133cd0 0x7f890411fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.361+0000 7f8909353700 1 -- 172.21.15.59:0/450966922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f890409d6d0 msgr2=0x7f890411f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.361+0000 7f8909353700 1 --2- 172.21.15.59:0/450966922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f890409d6d0 0x7f890411f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.361+0000 7f8909353700 1 -- 172.21.15.59:0/450966922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8900009550 con 0x7f890409dfe0 2023-09-30T22:32:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.361+0000 7f8909b54700 1 --2- 172.21.15.59:0/450966922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f890409d6d0 0x7f890411f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.361+0000 7f8909353700 1 --2- 172.21.15.59:0/450966922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f890409dfe0 0x7f890411f5d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f88f4000f60 tx=0x7f88f400c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.361+0000 7f88fa7fc700 1 -- 172.21.15.59:0/450966922 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f40052d0 con 0x7f890409dfe0 2023-09-30T22:32:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.361+0000 7f88fa7fc700 1 -- 172.21.15.59:0/450966922 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f4005430 con 0x7f890409dfe0 2023-09-30T22:32:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.361+0000 7f890bdb8700 1 -- 172.21.15.59:0/450966922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8904120d40 con 0x7f890409dfe0 2023-09-30T22:32:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.361+0000 7f88fa7fc700 1 -- 172.21.15.59:0/450966922 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f40038c0 con 0x7f890409dfe0 2023-09-30T22:32:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.361+0000 7f890bdb8700 1 -- 172.21.15.59:0/450966922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f890409c900 con 0x7f890409dfe0 2023-09-30T22:32:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.362+0000 7f890bdb8700 1 -- 172.21.15.59:0/450966922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890406a9e0 con 0x7f890409dfe0 2023-09-30T22:32:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.362+0000 7f88fa7fc700 1 -- 172.21.15.59:0/450966922 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88f4003a20 con 0x7f890409dfe0 2023-09-30T22:32:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.363+0000 7f88fa7fc700 1 -- 172.21.15.59:0/450966922 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f88f403e8f0 con 0x7f890409dfe0 2023-09-30T22:32:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.371+0000 7f88fa7fc700 1 -- 172.21.15.59:0/450966922 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88f4003cd0 con 0x7f890409dfe0 2023-09-30T22:32:07.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.433+0000 7f3dc2348700 1 Processor -- start 2023-09-30T22:32:07.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.433+0000 7f3dc2348700 1 -- start start 2023-09-30T22:32:07.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.434+0000 7f3dc2348700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3dbc09d6f0 0x7f3dbc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.434+0000 7f3dc2348700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3dbc09e000 0x7f3dbc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.434+0000 7f3dc2348700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dbc09b120 con 0x7f3dbc09e410 2023-09-30T22:32:07.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.434+0000 7f3dc2348700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dbc06b460 con 0x7f3dbc09d6f0 2023-09-30T22:32:07.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.434+0000 7f3dc2348700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc09a7e0 con 0x7f3dbc09e000 2023-09-30T22:32:07.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.434+0000 7f3dc08e5700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3dbc09e410 0x7f3dbc133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44328/0 (socket says 172.21.15.59:44328) 2023-09-30T22:32:07.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.434+0000 7f3dc08e5700 1 -- 172.21.15.59:0/3376668884 learned_addr learned my addr 172.21.15.59:0/3376668884 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:07.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.434+0000 7f3dbbfff700 1 --2- 172.21.15.59:0/3376668884 >> v2:172.21.15.59:3300/0 conn(0x7f3dbc09d6f0 0x7f3dbc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.435+0000 7f3dbb7fe700 1 --2- 172.21.15.59:0/3376668884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3dbc09e000 0x7f3dbc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.435+0000 7f3dbbfff700 1 -- 172.21.15.59:0/3376668884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3dbc09e000 msgr2=0x7f3dbc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.435+0000 7f3dbbfff700 1 --2- 172.21.15.59:0/3376668884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3dbc09e000 0x7f3dbc1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.435+0000 7f3dbbfff700 1 -- 172.21.15.59:0/3376668884 >> v1:172.21.15.59:6789/0 conn(0x7f3dbc09e410 legacy=0x7f3dbc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.435+0000 7f3dbaffd700 1 -- 172.21.15.59:0/3376668884 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547260298 0 0) 0x7f3dbc09b120 con 0x7f3dbc09e410 2023-09-30T22:32:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.435+0000 7f3dbbfff700 1 -- 172.21.15.59:0/3376668884 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc09a500 con 0x7f3dbc09d6f0 2023-09-30T22:32:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.435+0000 7f3dbbfff700 1 --2- 172.21.15.59:0/3376668884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dbc09d6f0 0x7f3dbc09dac0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009840 tx=0x7f3dac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddedc1af50da3f5d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.435+0000 7f3dbaffd700 1 -- 172.21.15.59:0/3376668884 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac011830 con 0x7f3dbc09d6f0 2023-09-30T22:32:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.435+0000 7f3dbaffd700 1 -- 172.21.15.59:0/3376668884 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac011990 con 0x7f3dbc09d6f0 2023-09-30T22:32:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.435+0000 7f3dbaffd700 1 -- 172.21.15.59:0/3376668884 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac011d20 con 0x7f3dbc09d6f0 2023-09-30T22:32:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.436+0000 7f3dc2348700 1 -- 172.21.15.59:0/3376668884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dbc09d6f0 msgr2=0x7f3dbc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.436+0000 7f3dc2348700 1 --2- 172.21.15.59:0/3376668884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dbc09d6f0 0x7f3dbc09dac0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009840 tx=0x7f3dac009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.436+0000 7f3dc2348700 1 -- 172.21.15.59:0/3376668884 shutdown_connections 2023-09-30T22:32:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.436+0000 7f3dc2348700 1 --2- 172.21.15.59:0/3376668884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dbc09d6f0 0x7f3dbc09dac0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.436+0000 7f3dc2348700 1 --2- 172.21.15.59:0/3376668884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3dbc09e000 0x7f3dbc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.436+0000 7f3dc2348700 1 -- 172.21.15.59:0/3376668884 >> 172.21.15.59:0/3376668884 conn(0x7f3dbc066f50 msgr2=0x7f3dbc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:07.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.436+0000 7f3dc2348700 1 -- 172.21.15.59:0/3376668884 shutdown_connections 2023-09-30T22:32:07.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.436+0000 7f3dc2348700 1 -- 172.21.15.59:0/3376668884 wait complete. 2023-09-30T22:32:07.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.438+0000 7f3dc2348700 1 Processor -- start 2023-09-30T22:32:07.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.438+0000 7f3dc2348700 1 -- start start 2023-09-30T22:32:07.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.439+0000 7f3dc2348700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dbc09d6f0 0x7f3dbc1a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.439+0000 7f3dc2348700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3dbc09e000 0x7f3dbc1a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.439+0000 7f3dc2348700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dbc09e410 0x7f3dbc1c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.439+0000 7f3dc2348700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc09c710 con 0x7f3dbc09e410 2023-09-30T22:32:07.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.439+0000 7f3dc2348700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc1b9210 con 0x7f3dbc09d6f0 2023-09-30T22:32:07.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.439+0000 7f3dc2348700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc1a7e00 con 0x7f3dbc09e000 2023-09-30T22:32:07.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.439+0000 7f3dc08e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dbc09e410 0x7f3dbc1c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.439+0000 7f3dc08e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dbc09e410 0x7f3dbc1c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39494/0 (socket says 172.21.15.59:39494) 2023-09-30T22:32:07.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.439+0000 7f3dc08e5700 1 -- 172.21.15.59:0/4189908377 learned_addr learned my addr 172.21.15.59:0/4189908377 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:07.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.439+0000 7f3dbb7fe700 1 --2- 172.21.15.59:0/4189908377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3dbc09e000 0x7f3dbc1a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.439+0000 7f3dbbfff700 1 --2- 172.21.15.59:0/4189908377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dbc09d6f0 0x7f3dbc1a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.440+0000 7f3dbb7fe700 1 -- 172.21.15.59:0/4189908377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dbc09d6f0 msgr2=0x7f3dbc1a51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.440+0000 7f3dbb7fe700 1 --2- 172.21.15.59:0/4189908377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dbc09d6f0 0x7f3dbc1a51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.440+0000 7f3dbb7fe700 1 -- 172.21.15.59:0/4189908377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dbc09e410 msgr2=0x7f3dbc1c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.440+0000 7f3dbb7fe700 1 --2- 172.21.15.59:0/4189908377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dbc09e410 0x7f3dbc1c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.440+0000 7f3dbb7fe700 1 -- 172.21.15.59:0/4189908377 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac0094a0 con 0x7f3dbc09e000 2023-09-30T22:32:07.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.440+0000 7f3dbb7fe700 1 --2- 172.21.15.59:0/4189908377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3dbc09e000 0x7f3dbc1a5710 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3db000e900 tx=0x7f3db000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:07.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.440+0000 7f3db8ff9700 1 -- 172.21.15.59:0/4189908377 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0013680 con 0x7f3dbc09e000 2023-09-30T22:32:07.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.440+0000 7f3db8ff9700 1 -- 172.21.15.59:0/4189908377 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db00137e0 con 0x7f3dbc09e000 2023-09-30T22:32:07.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.440+0000 7f3db8ff9700 1 -- 172.21.15.59:0/4189908377 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0013b50 con 0x7f3dbc09e000 2023-09-30T22:32:07.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.440+0000 7f3dc2348700 1 -- 172.21.15.59:0/4189908377 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dbc1a80c0 con 0x7f3dbc09e000 2023-09-30T22:32:07.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.440+0000 7f3dc2348700 1 -- 172.21.15.59:0/4189908377 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dbc1a64e0 con 0x7f3dbc09e000 2023-09-30T22:32:07.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.442+0000 7f3dc2348700 1 -- 172.21.15.59:0/4189908377 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dbc074ea0 con 0x7f3dbc09e000 2023-09-30T22:32:07.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.442+0000 7f3db8ff9700 1 -- 172.21.15.59:0/4189908377 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3db0013cb0 con 0x7f3dbc09e000 2023-09-30T22:32:07.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.442+0000 7f3db8ff9700 1 -- 172.21.15.59:0/4189908377 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3db003f870 con 0x7f3dbc09e000 2023-09-30T22:32:07.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.448+0000 7f3db8ff9700 1 -- 172.21.15.59:0/4189908377 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3db001b3b0 con 0x7f3dbc09e000 2023-09-30T22:32:07.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.449+0000 7f107744c700 1 Processor -- start 2023-09-30T22:32:07.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.449+0000 7f107744c700 1 -- start start 2023-09-30T22:32:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.450+0000 7f107744c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10701337f0 0x7f1070138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.450+0000 7f107744c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1070138dc0 0x7f107013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.450+0000 7f107744c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107006b990 con 0x7f1070133420 2023-09-30T22:32:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.450+0000 7f107744c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107009b0e0 con 0x7f10701337f0 2023-09-30T22:32:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.450+0000 7f107744c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1070133c20 con 0x7f1070138dc0 2023-09-30T22:32:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.450+0000 7f10749e7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10701337f0 0x7f1070138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.450+0000 7f10759e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1070138dc0 0x7f107013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.450+0000 7f10749e7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10701337f0 0x7f1070138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39510/0 (socket says 172.21.15.59:39510) 2023-09-30T22:32:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.450+0000 7f10751e8700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1070133420 0x7f1070133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44332/0 (socket says 172.21.15.59:44332) 2023-09-30T22:32:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.450+0000 7f10749e7700 1 -- 172.21.15.59:0/3392521291 learned_addr learned my addr 172.21.15.59:0/3392521291 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.451+0000 7f10749e7700 1 -- 172.21.15.59:0/3392521291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1070138dc0 msgr2=0x7f107013b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:07.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.451+0000 7f10749e7700 1 --2- 172.21.15.59:0/3392521291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1070138dc0 0x7f107013b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.451+0000 7f10749e7700 1 -- 172.21.15.59:0/3392521291 >> v1:172.21.15.59:6789/0 conn(0x7f1070133420 legacy=0x7f1070133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.451+0000 7f10749e7700 1 -- 172.21.15.59:0/3392521291 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10700a0590 con 0x7f10701337f0 2023-09-30T22:32:07.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.451+0000 7f10759e9700 1 --2- 172.21.15.59:0/3392521291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1070138dc0 0x7f107013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:07.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.451+0000 7f10749e7700 1 --2- 172.21.15.59:0/3392521291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10701337f0 0x7f1070138880 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f10600098f0 tx=0x7f1060009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498f40b291855d26 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:07.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.451+0000 7f1067fff700 1 -- 172.21.15.59:0/3392521291 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060011830 con 0x7f10701337f0 2023-09-30T22:32:07.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.451+0000 7f1067fff700 1 -- 172.21.15.59:0/3392521291 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1060011990 con 0x7f10701337f0 2023-09-30T22:32:07.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.451+0000 7f1067fff700 1 -- 172.21.15.59:0/3392521291 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060011d20 con 0x7f10701337f0 2023-09-30T22:32:07.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.452+0000 7f107744c700 1 -- 172.21.15.59:0/3392521291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10701337f0 msgr2=0x7f1070138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.452+0000 7f107744c700 1 --2- 172.21.15.59:0/3392521291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10701337f0 0x7f1070138880 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f10600098f0 tx=0x7f1060009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:07.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.452+0000 7f107744c700 1 -- 172.21.15.59:0/3392521291 shutdown_connections 2023-09-30T22:32:07.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.452+0000 7f107744c700 1 --2- 172.21.15.59:0/3392521291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1070138dc0 0x7f107013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.452+0000 7f107744c700 1 --2- 172.21.15.59:0/3392521291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10701337f0 0x7f1070138880 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.452+0000 7f107744c700 1 -- 172.21.15.59:0/3392521291 >> 172.21.15.59:0/3392521291 conn(0x7f10700a4210 msgr2=0x7f10700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:07.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.452+0000 7f107744c700 1 -- 172.21.15.59:0/3392521291 shutdown_connections 2023-09-30T22:32:07.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.453+0000 7f107744c700 1 -- 172.21.15.59:0/3392521291 wait complete. 2023-09-30T22:32:07.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.454+0000 7f107744c700 1 Processor -- start 2023-09-30T22:32:07.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.454+0000 7f107744c700 1 -- start start 2023-09-30T22:32:07.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.455+0000 7f107744c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1070133420 0x7f107012db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.455+0000 7f107744c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1070138dc0 0x7f107009c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.455+0000 7f107744c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f107012e0c0 0x7f107009ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:07.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.455+0000 7f107744c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070134a00 con 0x7f107012e0c0 2023-09-30T22:32:07.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.455+0000 7f107744c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107009e310 con 0x7f1070133420 2023-09-30T22:32:07.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.455+0000 7f107744c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1070130670 con 0x7f1070138dc0 2023-09-30T22:32:07.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.455+0000 7f10749e7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1070138dc0 0x7f107009c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.455+0000 7f10749e7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1070138dc0 0x7f107009c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42892/0 (socket says 172.21.15.59:42892) 2023-09-30T22:32:07.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.455+0000 7f10749e7700 1 -- 172.21.15.59:0/3973548748 learned_addr learned my addr 172.21.15.59:0/3973548748 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:07.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.455+0000 7f10759e9700 1 --2- 172.21.15.59:0/3973548748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f107012e0c0 0x7f107009ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.455+0000 7f10751e8700 1 --2- 172.21.15.59:0/3973548748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1070133420 0x7f107012db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:07.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.456+0000 7f10751e8700 1 -- 172.21.15.59:0/3973548748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1070138dc0 msgr2=0x7f107009c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.456+0000 7f10751e8700 1 --2- 172.21.15.59:0/3973548748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1070138dc0 0x7f107009c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.456+0000 7f10751e8700 1 -- 172.21.15.59:0/3973548748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f107012e0c0 msgr2=0x7f107009ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.456+0000 7f10751e8700 1 --2- 172.21.15.59:0/3973548748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f107012e0c0 0x7f107009ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.456+0000 7f10751e8700 1 -- 172.21.15.59:0/3973548748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1068009a70 con 0x7f1070133420 2023-09-30T22:32:07.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.456+0000 7f10759e9700 1 --2- 172.21.15.59:0/3973548748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f107012e0c0 0x7f107009ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:07.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.456+0000 7f10751e8700 1 --2- 172.21.15.59:0/3973548748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1070133420 0x7f107012db80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f106c00c450 tx=0x7f106c00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:07.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.456+0000 7f1065ffb700 1 -- 172.21.15.59:0/3973548748 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c005cb0 con 0x7f1070133420 2023-09-30T22:32:07.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.456+0000 7f1065ffb700 1 -- 172.21.15.59:0/3973548748 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c005e10 con 0x7f1070133420 2023-09-30T22:32:07.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.456+0000 7f107744c700 1 -- 172.21.15.59:0/3973548748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1060009550 con 0x7f1070133420 2023-09-30T22:32:07.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.456+0000 7f1065ffb700 1 -- 172.21.15.59:0/3973548748 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c0072d0 con 0x7f1070133420 2023-09-30T22:32:07.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.456+0000 7f107744c700 1 -- 172.21.15.59:0/3973548748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107012fa00 con 0x7f1070133420 2023-09-30T22:32:07.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.457+0000 7f1065ffb700 1 -- 172.21.15.59:0/3973548748 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f106c007430 con 0x7f1070133420 2023-09-30T22:32:07.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.457+0000 7f1065ffb700 1 -- 172.21.15.59:0/3973548748 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f106c040a70 con 0x7f1070133420 2023-09-30T22:32:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.458+0000 7f107744c700 1 -- 172.21.15.59:0/3973548748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1070074ea0 con 0x7f1070133420 2023-09-30T22:32:07.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.463+0000 7f1065ffb700 1 -- 172.21.15.59:0/3973548748 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f106c017070 con 0x7f1070133420 2023-09-30T22:32:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.585+0000 7f890bdb8700 1 -- 172.21.15.59:0/450966922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f890404f2a0 con 0x7f890409dfe0 2023-09-30T22:32:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.585+0000 7f88fa7fc700 1 -- 172.21.15.59:0/450966922 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88f4017070 con 0x7f890409dfe0 2023-09-30T22:32:07.586 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:07.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.587+0000 7f890bdb8700 1 -- 172.21.15.59:0/450966922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f890409dfe0 msgr2=0x7f890411f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.587+0000 7f890bdb8700 1 --2- 172.21.15.59:0/450966922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f890409dfe0 0x7f890411f5d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f88f4000f60 tx=0x7f88f400c6e0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.588+0000 7f890bdb8700 1 -- 172.21.15.59:0/450966922 shutdown_connections 2023-09-30T22:32:07.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.588+0000 7f890bdb8700 1 --2- 172.21.15.59:0/450966922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8904133cd0 0x7f890411fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.588+0000 7f890bdb8700 1 --2- 172.21.15.59:0/450966922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f890409d6d0 0x7f890411f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.588+0000 7f890bdb8700 1 --2- 172.21.15.59:0/450966922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f890409dfe0 0x7f890411f5d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.588+0000 7f890bdb8700 1 -- 172.21.15.59:0/450966922 >> 172.21.15.59:0/450966922 conn(0x7f8904099c20 msgr2=0x7f89040a1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:07.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.588+0000 7f890bdb8700 1 -- 172.21.15.59:0/450966922 shutdown_connections 2023-09-30T22:32:07.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.588+0000 7f890bdb8700 1 -- 172.21.15.59:0/450966922 wait complete. 2023-09-30T22:32:07.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.598+0000 7f0d93f4a700 1 -- 172.21.15.59:0/931252154 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0d8c074ea0 con 0x7f0d8c09e390 2023-09-30T22:32:07.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.599+0000 7f0d827fc700 1 -- 172.21.15.59:0/931252154 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d880193b0 con 0x7f0d8c09e390 2023-09-30T22:32:07.599 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:07.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.602+0000 7f0d93f4a700 1 -- 172.21.15.59:0/931252154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d8c09e390 msgr2=0x7f0d8c11a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.602+0000 7f0d93f4a700 1 --2- 172.21.15.59:0/931252154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d8c09e390 0x7f0d8c11a560 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009c40 tx=0x7f0d88004750 comp rx=0 tx=0).stop 2023-09-30T22:32:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.602+0000 7f0d93f4a700 1 -- 172.21.15.59:0/931252154 shutdown_connections 2023-09-30T22:32:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.602+0000 7f0d93f4a700 1 --2- 172.21.15.59:0/931252154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d8c1341d0 0x7f0d8c11afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.602+0000 7f0d93f4a700 1 --2- 172.21.15.59:0/931252154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d8c09e390 0x7f0d8c11a560 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.602+0000 7f0d93f4a700 1 --2- 172.21.15.59:0/931252154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d8c1338c0 0x7f0d8c11aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.602+0000 7f0d93f4a700 1 -- 172.21.15.59:0/931252154 >> 172.21.15.59:0/931252154 conn(0x7f0d8c0a2aa0 msgr2=0x7f0d8c12f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.603+0000 7f0d93f4a700 1 -- 172.21.15.59:0/931252154 shutdown_connections 2023-09-30T22:32:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.603+0000 7f0d93f4a700 1 -- 172.21.15.59:0/931252154 wait complete. 2023-09-30T22:32:07.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:07.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.668+0000 7f3dc2348700 1 -- 172.21.15.59:0/4189908377 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3dbc1a8300 con 0x7f3dbc09e000 2023-09-30T22:32:07.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.669+0000 7f3db8ff9700 1 -- 172.21.15.59:0/4189908377 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3db0017070 con 0x7f3dbc09e000 2023-09-30T22:32:07.669 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:07.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.671+0000 7f3dc2348700 1 -- 172.21.15.59:0/4189908377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3dbc09e000 msgr2=0x7f3dbc1a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.671+0000 7f3dc2348700 1 --2- 172.21.15.59:0/4189908377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3dbc09e000 0x7f3dbc1a5710 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3db000e900 tx=0x7f3db000ec10 comp rx=0 tx=0).stop 2023-09-30T22:32:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.671+0000 7f3dc2348700 1 -- 172.21.15.59:0/4189908377 shutdown_connections 2023-09-30T22:32:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.671+0000 7f3dc2348700 1 --2- 172.21.15.59:0/4189908377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dbc09e410 0x7f3dbc1c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.671+0000 7f3dc2348700 1 --2- 172.21.15.59:0/4189908377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dbc09d6f0 0x7f3dbc1a51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.671+0000 7f3dc2348700 1 --2- 172.21.15.59:0/4189908377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3dbc09e000 0x7f3dbc1a5710 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.671+0000 7f3dc2348700 1 -- 172.21.15.59:0/4189908377 >> 172.21.15.59:0/4189908377 conn(0x7f3dbc066f50 msgr2=0x7f3dbc1bb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.671+0000 7f3dc2348700 1 -- 172.21.15.59:0/4189908377 shutdown_connections 2023-09-30T22:32:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.671+0000 7f3dc2348700 1 -- 172.21.15.59:0/4189908377 wait complete. 2023-09-30T22:32:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.676+0000 7f107744c700 1 -- 172.21.15.59:0/3973548748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f10700a0000 con 0x7f1070133420 2023-09-30T22:32:07.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.676+0000 7f1065ffb700 1 -- 172.21.15.59:0/3973548748 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f106c017020 con 0x7f1070133420 2023-09-30T22:32:07.676 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.678+0000 7f107744c700 1 -- 172.21.15.59:0/3973548748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1070133420 msgr2=0x7f107012db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.678+0000 7f107744c700 1 --2- 172.21.15.59:0/3973548748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1070133420 0x7f107012db80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f106c00c450 tx=0x7f106c00c760 comp rx=0 tx=0).stop 2023-09-30T22:32:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.679+0000 7f107744c700 1 -- 172.21.15.59:0/3973548748 shutdown_connections 2023-09-30T22:32:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.679+0000 7f107744c700 1 --2- 172.21.15.59:0/3973548748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f107012e0c0 0x7f107009ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.679+0000 7f107744c700 1 --2- 172.21.15.59:0/3973548748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1070133420 0x7f107012db80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.679+0000 7f107744c700 1 --2- 172.21.15.59:0/3973548748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1070138dc0 0x7f107009c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.679+0000 7f107744c700 1 -- 172.21.15.59:0/3973548748 >> 172.21.15.59:0/3973548748 conn(0x7f10700a4210 msgr2=0x7f10700a2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.679+0000 7f107744c700 1 -- 172.21.15.59:0/3973548748 shutdown_connections 2023-09-30T22:32:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:07.679+0000 7f107744c700 1 -- 172.21.15.59:0/3973548748 wait complete. 2023-09-30T22:32:07.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:07.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:08.602 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:08.622 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:08.687 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:08.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:08.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.758+0000 7f984dd1a700 1 Processor -- start 2023-09-30T22:32:08.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.758+0000 7f984dd1a700 1 -- start start 2023-09-30T22:32:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.759+0000 7f984dd1a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98481302b0 0x7f98480700d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.759+0000 7f984dd1a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984812cd80 0x7f9848137b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.759+0000 7f984dd1a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9848130090 con 0x7f984812c260 2023-09-30T22:32:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.759+0000 7f984dd1a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984809a3a0 con 0x7f984812cd80 2023-09-30T22:32:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.759+0000 7f984dd1a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9848070610 con 0x7f98481302b0 2023-09-30T22:32:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.760+0000 7f98477fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98481302b0 0x7f98480700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.760+0000 7f98477fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98481302b0 0x7f98480700d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42898/0 (socket says 172.21.15.59:42898) 2023-09-30T22:32:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.760+0000 7f98477fe700 1 -- 172.21.15.59:0/295441666 learned_addr learned my addr 172.21.15.59:0/295441666 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.760+0000 7f9847fff700 1 --2- 172.21.15.59:0/295441666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984812cd80 0x7f9848137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.760+0000 7f9847fff700 1 -- 172.21.15.59:0/295441666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98481302b0 msgr2=0x7f98480700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:08.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.760+0000 7f9847fff700 1 --2- 172.21.15.59:0/295441666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98481302b0 0x7f98480700d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.760+0000 7f9847fff700 1 -- 172.21.15.59:0/295441666 >> v1:172.21.15.59:6789/0 conn(0x7f984812c260 legacy=0x7f984812c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:08.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.760+0000 7f9847fff700 1 -- 172.21.15.59:0/295441666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9848099c70 con 0x7f984812cd80 2023-09-30T22:32:08.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.760+0000 7f9847fff700 1 --2- 172.21.15.59:0/295441666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984812cd80 0x7f9848137b70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9840009df0 tx=0x7f984000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdc5abc9820f9b30 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:08.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.761+0000 7f98467fc700 1 -- 172.21.15.59:0/295441666 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984000e070 con 0x7f984812cd80 2023-09-30T22:32:08.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.761+0000 7f98467fc700 1 -- 172.21.15.59:0/295441666 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984000bae0 con 0x7f984812cd80 2023-09-30T22:32:08.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.761+0000 7f98467fc700 1 -- 172.21.15.59:0/295441666 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984000be90 con 0x7f984812cd80 2023-09-30T22:32:08.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.761+0000 7f984dd1a700 1 -- 172.21.15.59:0/295441666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984812cd80 msgr2=0x7f9848137b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:08.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.761+0000 7f984dd1a700 1 --2- 172.21.15.59:0/295441666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984812cd80 0x7f9848137b70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9840009df0 tx=0x7f984000b330 comp rx=0 tx=0).stop 2023-09-30T22:32:08.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.762+0000 7f984dd1a700 1 -- 172.21.15.59:0/295441666 shutdown_connections 2023-09-30T22:32:08.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.762+0000 7f984dd1a700 1 --2- 172.21.15.59:0/295441666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98481302b0 0x7f98480700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.762+0000 7f984dd1a700 1 --2- 172.21.15.59:0/295441666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984812cd80 0x7f9848137b70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.762+0000 7f984dd1a700 1 -- 172.21.15.59:0/295441666 >> 172.21.15.59:0/295441666 conn(0x7f98480a27f0 msgr2=0x7f98480a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:08.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.762+0000 7f984dd1a700 1 -- 172.21.15.59:0/295441666 shutdown_connections 2023-09-30T22:32:08.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.762+0000 7f984dd1a700 1 -- 172.21.15.59:0/295441666 wait complete. 2023-09-30T22:32:08.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.763+0000 7f984dd1a700 1 Processor -- start 2023-09-30T22:32:08.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.764+0000 7f984dd1a700 1 -- start start 2023-09-30T22:32:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.764+0000 7f984dd1a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984812c260 0x7f984813a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.764+0000 7f984dd1a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984812cd80 0x7f984813a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.764+0000 7f984dd1a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98481302b0 0x7f984813ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.764+0000 7f984dd1a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9848136110 con 0x7f984812c260 2023-09-30T22:32:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.764+0000 7f984dd1a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98480a2190 con 0x7f984812cd80 2023-09-30T22:32:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.764+0000 7f984dd1a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9848135730 con 0x7f98481302b0 2023-09-30T22:32:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.764+0000 7f98477fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984812c260 0x7f984813a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.764+0000 7f9846ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984812cd80 0x7f984813a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.764+0000 7f98477fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984812c260 0x7f984813a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39526/0 (socket says 172.21.15.59:39526) 2023-09-30T22:32:08.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.764+0000 7f98477fe700 1 -- 172.21.15.59:0/1442495208 learned_addr learned my addr 172.21.15.59:0/1442495208 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:08.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.765+0000 7f9847fff700 1 --2- 172.21.15.59:0/1442495208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98481302b0 0x7f984813ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.765+0000 7f98477fe700 1 -- 172.21.15.59:0/1442495208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98481302b0 msgr2=0x7f984813ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:08.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.765+0000 7f98477fe700 1 --2- 172.21.15.59:0/1442495208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98481302b0 0x7f984813ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.765+0000 7f98477fe700 1 -- 172.21.15.59:0/1442495208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984812cd80 msgr2=0x7f984813a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:08.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.765+0000 7f98477fe700 1 --2- 172.21.15.59:0/1442495208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984812cd80 0x7f984813a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.765+0000 7f98477fe700 1 -- 172.21.15.59:0/1442495208 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9840009a70 con 0x7f984812c260 2023-09-30T22:32:08.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.765+0000 7f98477fe700 1 --2- 172.21.15.59:0/1442495208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984812c260 0x7f984813a1d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f983800e910 tx=0x7f983800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:08.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.765+0000 7f982ffff700 1 -- 172.21.15.59:0/1442495208 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98380096a0 con 0x7f984812c260 2023-09-30T22:32:08.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.765+0000 7f982ffff700 1 -- 172.21.15.59:0/1442495208 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983800ee60 con 0x7f984812c260 2023-09-30T22:32:08.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.765+0000 7f982ffff700 1 -- 172.21.15.59:0/1442495208 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983800ca90 con 0x7f984812c260 2023-09-30T22:32:08.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.766+0000 7f984dd1a700 1 -- 172.21.15.59:0/1442495208 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98481352b0 con 0x7f984812c260 2023-09-30T22:32:08.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.766+0000 7f984dd1a700 1 -- 172.21.15.59:0/1442495208 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984809f1d0 con 0x7f984812c260 2023-09-30T22:32:08.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.767+0000 7f982ffff700 1 -- 172.21.15.59:0/1442495208 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f983800cbf0 con 0x7f984812c260 2023-09-30T22:32:08.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.767+0000 7f984dd1a700 1 -- 172.21.15.59:0/1442495208 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9848071d90 con 0x7f984812c260 2023-09-30T22:32:08.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.767+0000 7f982ffff700 1 -- 172.21.15.59:0/1442495208 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f983803f740 con 0x7f984812c260 2023-09-30T22:32:08.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.777+0000 7f982ffff700 1 -- 172.21.15.59:0/1442495208 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9848071d90 con 0x7f984812c260 2023-09-30T22:32:08.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.804+0000 7fafd18be700 1 Processor -- start 2023-09-30T22:32:08.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.804+0000 7fafd18be700 1 -- start start 2023-09-30T22:32:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafd18be700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fafcc1316c0 0x7fafcc131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafd18be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafcc09d9f0 0x7fafcc06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafd18be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafcc06acb0 0x7fafcc06b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafd18be700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafcc09e130 con 0x7fafcc1316c0 2023-09-30T22:32:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafd18be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc1312b0 con 0x7fafcc09d9f0 2023-09-30T22:32:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafd18be700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc09f6e0 con 0x7fafcc06acb0 2023-09-30T22:32:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafcaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fafcc1316c0 0x7fafcc131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafcaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fafcc1316c0 0x7fafcc131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39530/0 (socket says 172.21.15.59:39530) 2023-09-30T22:32:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafcaffd700 1 -- 172.21.15.59:0/2706820753 learned_addr learned my addr 172.21.15.59:0/2706820753 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafca7fc700 1 --2- 172.21.15.59:0/2706820753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafcc09d9f0 0x7fafcc06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafcb7fe700 1 --2- 172.21.15.59:0/2706820753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafcc06acb0 0x7fafcc06b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafcaffd700 1 -- 172.21.15.59:0/2706820753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafcc06acb0 msgr2=0x7fafcc06b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafcaffd700 1 --2- 172.21.15.59:0/2706820753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafcc06acb0 0x7fafcc06b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafcaffd700 1 -- 172.21.15.59:0/2706820753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafcc09d9f0 msgr2=0x7fafcc06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafcaffd700 1 --2- 172.21.15.59:0/2706820753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafcc09d9f0 0x7fafcc06a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.805+0000 7fafcaffd700 1 -- 172.21.15.59:0/2706820753 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc09e760 con 0x7fafcc1316c0 2023-09-30T22:32:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.806+0000 7fafcaffd700 1 --2- 172.21.15.59:0/2706820753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafcc1316c0 0x7fafcc131a90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0098f0 tx=0x7fafbc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceaed617361d196 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.806+0000 7fafc9ffb700 1 -- 172.21.15.59:0/2706820753 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc011830 con 0x7fafcc1316c0 2023-09-30T22:32:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.806+0000 7fafc9ffb700 1 -- 172.21.15.59:0/2706820753 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc011990 con 0x7fafcc1316c0 2023-09-30T22:32:08.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.806+0000 7fafc9ffb700 1 -- 172.21.15.59:0/2706820753 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc011d20 con 0x7fafcc1316c0 2023-09-30T22:32:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.807+0000 7fafd18be700 1 -- 172.21.15.59:0/2706820753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafcc1316c0 msgr2=0x7fafcc131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.807+0000 7fafd18be700 1 --2- 172.21.15.59:0/2706820753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafcc1316c0 0x7fafcc131a90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0098f0 tx=0x7fafbc009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.807+0000 7fafd18be700 1 -- 172.21.15.59:0/2706820753 shutdown_connections 2023-09-30T22:32:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.807+0000 7fafd18be700 1 --2- 172.21.15.59:0/2706820753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafcc06acb0 0x7fafcc06b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.807+0000 7fafd18be700 1 --2- 172.21.15.59:0/2706820753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafcc1316c0 0x7fafcc131a90 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.807+0000 7fafd18be700 1 --2- 172.21.15.59:0/2706820753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafcc09d9f0 0x7fafcc06a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.807+0000 7fafd18be700 1 -- 172.21.15.59:0/2706820753 >> 172.21.15.59:0/2706820753 conn(0x7fafcc066f50 msgr2=0x7fafcc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.807+0000 7fafd18be700 1 -- 172.21.15.59:0/2706820753 shutdown_connections 2023-09-30T22:32:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.807+0000 7fafd18be700 1 -- 172.21.15.59:0/2706820753 wait complete. 2023-09-30T22:32:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.809+0000 7fafd18be700 1 Processor -- start 2023-09-30T22:32:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.809+0000 7fafd18be700 1 -- start start 2023-09-30T22:32:08.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafd18be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafcc06acb0 0x7fafcc1c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafd18be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafcc09d9f0 0x7fafcc1c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafd18be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafcc1316c0 0x7fafcc070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafd18be700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc09a460 con 0x7fafcc1316c0 2023-09-30T22:32:08.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafd18be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc09bb30 con 0x7fafcc06acb0 2023-09-30T22:32:08.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafd18be700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc09b4d0 con 0x7fafcc09d9f0 2023-09-30T22:32:08.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafcb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafcc1316c0 0x7fafcc070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafca7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafcc09d9f0 0x7fafcc1c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafcb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafcc1316c0 0x7fafcc070bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39536/0 (socket says 172.21.15.59:39536) 2023-09-30T22:32:08.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafcb7fe700 1 -- 172.21.15.59:0/2904537816 learned_addr learned my addr 172.21.15.59:0/2904537816 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:08.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafcaffd700 1 --2- 172.21.15.59:0/2904537816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafcc06acb0 0x7fafcc1c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafcaffd700 1 -- 172.21.15.59:0/2904537816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafcc09d9f0 msgr2=0x7fafcc1c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafcaffd700 1 --2- 172.21.15.59:0/2904537816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafcc09d9f0 0x7fafcc1c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafcaffd700 1 -- 172.21.15.59:0/2904537816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafcc1316c0 msgr2=0x7fafcc070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafcaffd700 1 --2- 172.21.15.59:0/2904537816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafcc1316c0 0x7fafcc070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafcaffd700 1 -- 172.21.15.59:0/2904537816 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc009550 con 0x7fafcc06acb0 2023-09-30T22:32:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.810+0000 7fafcb7fe700 1 --2- 172.21.15.59:0/2904537816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafcc1316c0 0x7fafcc070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.811+0000 7fafcaffd700 1 --2- 172.21.15.59:0/2904537816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafcc06acb0 0x7fafcc1c85a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fafbc016000 tx=0x7fafbc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:08.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.811+0000 7fafb3fff700 1 -- 172.21.15.59:0/2904537816 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc004240 con 0x7fafcc06acb0 2023-09-30T22:32:08.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.811+0000 7fafb3fff700 1 -- 172.21.15.59:0/2904537816 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc01f070 con 0x7fafcc06acb0 2023-09-30T22:32:08.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.811+0000 7fafb3fff700 1 -- 172.21.15.59:0/2904537816 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0045e0 con 0x7fafcc06acb0 2023-09-30T22:32:08.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.811+0000 7fafd18be700 1 -- 172.21.15.59:0/2904537816 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc11d890 con 0x7fafcc06acb0 2023-09-30T22:32:08.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.811+0000 7fafd18be700 1 -- 172.21.15.59:0/2904537816 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc1c9020 con 0x7fafcc06acb0 2023-09-30T22:32:08.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.812+0000 7fafb3fff700 1 -- 172.21.15.59:0/2904537816 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fafbc021030 con 0x7fafcc06acb0 2023-09-30T22:32:08.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.812+0000 7fafd18be700 1 -- 172.21.15.59:0/2904537816 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc09b690 con 0x7fafcc06acb0 2023-09-30T22:32:08.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.812+0000 7fafb3fff700 1 -- 172.21.15.59:0/2904537816 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fafbc040810 con 0x7fafcc06acb0 2023-09-30T22:32:08.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.817+0000 7fafb3fff700 1 -- 172.21.15.59:0/2904537816 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafbc0237e0 con 0x7fafcc06acb0 2023-09-30T22:32:08.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.847+0000 7f3828ac8700 1 Processor -- start 2023-09-30T22:32:08.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.847+0000 7f3828ac8700 1 -- start start 2023-09-30T22:32:08.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.847+0000 7f3828ac8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382409d6f0 0x7f382409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.847+0000 7f3828ac8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382409e000 0x7f3824130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.847+0000 7f3828ac8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f382409e410 0x7f3824130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.847+0000 7f3828ac8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382409f520 con 0x7f382409e410 2023-09-30T22:32:08.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.847+0000 7f3828ac8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382409f130 con 0x7f382409e000 2023-09-30T22:32:08.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.847+0000 7f3828ac8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382409e930 con 0x7f382409d6f0 2023-09-30T22:32:08.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.848+0000 7f3821d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382409e000 0x7f3824130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.848+0000 7f3821d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382409e000 0x7f3824130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55032/0 (socket says 172.21.15.59:55032) 2023-09-30T22:32:08.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.848+0000 7f3821d9b700 1 -- 172.21.15.59:0/1506331679 learned_addr learned my addr 172.21.15.59:0/1506331679 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:08.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.848+0000 7f3822d9d700 1 --2- 172.21.15.59:0/1506331679 >> v2:172.21.15.59:3300/0 conn(0x7f382409e410 0x7f3824130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.848+0000 7f382259c700 1 --2- 172.21.15.59:0/1506331679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382409d6f0 0x7f382409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.848+0000 7f3822d9d700 1 -- 172.21.15.59:0/1506331679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382409d6f0 msgr2=0x7f382409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:08.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.848+0000 7f3822d9d700 1 --2- 172.21.15.59:0/1506331679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382409d6f0 0x7f382409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.848+0000 7f3822d9d700 1 -- 172.21.15.59:0/1506331679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382409e000 msgr2=0x7f3824130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:08.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.848+0000 7f3822d9d700 1 --2- 172.21.15.59:0/1506331679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382409e000 0x7f3824130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.848+0000 7f3822d9d700 1 -- 172.21.15.59:0/1506331679 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382409b2d0 con 0x7f382409e410 2023-09-30T22:32:08.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.848+0000 7f3821d9b700 1 --2- 172.21.15.59:0/1506331679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382409e000 0x7f3824130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:08.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.848+0000 7f382259c700 1 --2- 172.21.15.59:0/1506331679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382409d6f0 0x7f382409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:08.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.848+0000 7f3822d9d700 1 --2- 172.21.15.59:0/1506331679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382409e410 0x7f3824130ba0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f381c009d90 tx=0x7f381c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76055a5cdaf7d46 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:08.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.849+0000 7f382159a700 1 -- 172.21.15.59:0/1506331679 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c00e070 con 0x7f382409e410 2023-09-30T22:32:08.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.849+0000 7f382159a700 1 -- 172.21.15.59:0/1506331679 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c00bb20 con 0x7f382409e410 2023-09-30T22:32:08.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.849+0000 7f382159a700 1 -- 172.21.15.59:0/1506331679 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c012430 con 0x7f382409e410 2023-09-30T22:32:08.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.849+0000 7f3828ac8700 1 -- 172.21.15.59:0/1506331679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382409e410 msgr2=0x7f3824130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:08.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.849+0000 7f3828ac8700 1 --2- 172.21.15.59:0/1506331679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382409e410 0x7f3824130ba0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f381c009d90 tx=0x7f381c00b330 comp rx=0 tx=0).stop 2023-09-30T22:32:08.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.849+0000 7f3828ac8700 1 -- 172.21.15.59:0/1506331679 shutdown_connections 2023-09-30T22:32:08.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.849+0000 7f3828ac8700 1 --2- 172.21.15.59:0/1506331679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382409e410 0x7f3824130ba0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.849+0000 7f3828ac8700 1 --2- 172.21.15.59:0/1506331679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382409d6f0 0x7f382409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.849+0000 7f3828ac8700 1 --2- 172.21.15.59:0/1506331679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382409e000 0x7f3824130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.849+0000 7f3828ac8700 1 -- 172.21.15.59:0/1506331679 >> 172.21.15.59:0/1506331679 conn(0x7f3824066f50 msgr2=0x7f382409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:08.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.849+0000 7f3828ac8700 1 -- 172.21.15.59:0/1506331679 shutdown_connections 2023-09-30T22:32:08.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.849+0000 7f3828ac8700 1 -- 172.21.15.59:0/1506331679 wait complete. 2023-09-30T22:32:08.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.851+0000 7f3828ac8700 1 Processor -- start 2023-09-30T22:32:08.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.851+0000 7f3828ac8700 1 -- start start 2023-09-30T22:32:08.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.852+0000 7f3828ac8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382409d6f0 0x7f382411de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.852+0000 7f3828ac8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382409e000 0x7f382411e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.852+0000 7f3828ac8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382409e410 0x7f382411e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.852+0000 7f3828ac8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382411fa00 con 0x7f382409e410 2023-09-30T22:32:08.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.852+0000 7f3828ac8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3824120c50 con 0x7f382409e000 2023-09-30T22:32:08.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.852+0000 7f3828ac8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382411fff0 con 0x7f382409d6f0 2023-09-30T22:32:08.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.852+0000 7f3822d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382409e410 0x7f382411e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.852+0000 7f3821d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382409e000 0x7f382411e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.852+0000 7f382259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382409d6f0 0x7f382411de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.852+0000 7f3822d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382409e410 0x7f382411e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39554/0 (socket says 172.21.15.59:39554) 2023-09-30T22:32:08.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.852+0000 7f3822d9d700 1 -- 172.21.15.59:0/664217848 learned_addr learned my addr 172.21.15.59:0/664217848 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:08.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.853+0000 7f3821d9b700 1 -- 172.21.15.59:0/664217848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382409d6f0 msgr2=0x7f382411de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:08.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.853+0000 7f3821d9b700 1 --2- 172.21.15.59:0/664217848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382409d6f0 0x7f382411de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.853+0000 7f3821d9b700 1 -- 172.21.15.59:0/664217848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382409e410 msgr2=0x7f382411e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:08.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.853+0000 7f3821d9b700 1 --2- 172.21.15.59:0/664217848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382409e410 0x7f382411e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.853+0000 7f3821d9b700 1 -- 172.21.15.59:0/664217848 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381800b600 con 0x7f382409e000 2023-09-30T22:32:08.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.853+0000 7f3821d9b700 1 --2- 172.21.15.59:0/664217848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382409e000 0x7f382411e380 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f38240a3e20 tx=0x7f381800d630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:08.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.853+0000 7f3812ffd700 1 -- 172.21.15.59:0/664217848 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800dd90 con 0x7f382409e000 2023-09-30T22:32:08.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.853+0000 7f3812ffd700 1 -- 172.21.15.59:0/664217848 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3818004030 con 0x7f382409e000 2023-09-30T22:32:08.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.853+0000 7f3828ac8700 1 -- 172.21.15.59:0/664217848 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381c009a70 con 0x7f382409e000 2023-09-30T22:32:08.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.853+0000 7f3812ffd700 1 -- 172.21.15.59:0/664217848 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180043e0 con 0x7f382409e000 2023-09-30T22:32:08.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.853+0000 7f3828ac8700 1 -- 172.21.15.59:0/664217848 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382409c700 con 0x7f382409e000 2023-09-30T22:32:08.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.854+0000 7f3812ffd700 1 -- 172.21.15.59:0/664217848 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38180036a0 con 0x7f382409e000 2023-09-30T22:32:08.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.854+0000 7f3828ac8700 1 -- 172.21.15.59:0/664217848 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382411ac20 con 0x7f382409e000 2023-09-30T22:32:08.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.855+0000 7f3812ffd700 1 -- 172.21.15.59:0/664217848 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f381803fc60 con 0x7f382409e000 2023-09-30T22:32:08.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.864+0000 7f3812ffd700 1 -- 172.21.15.59:0/664217848 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3818004540 con 0x7f382409e000 2023-09-30T22:32:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.883+0000 7fa1995a6700 1 Processor -- start 2023-09-30T22:32:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.883+0000 7fa1995a6700 1 -- start start 2023-09-30T22:32:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.884+0000 7fa1995a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa19406b250 0x7fa194136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.884+0000 7fa1995a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa194136d80 0x7fa194139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.884+0000 7fa1995a6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19409ece0 con 0x7fa19406a770 2023-09-30T22:32:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.884+0000 7fa1995a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19406b640 con 0x7fa194136d80 2023-09-30T22:32:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.884+0000 7fa1995a6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa19409e760 con 0x7fa19406b250 2023-09-30T22:32:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.884+0000 7fa192ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa19406a770 0x7fa19406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44360/0 (socket says 172.21.15.59:44360) 2023-09-30T22:32:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.884+0000 7fa192ffd700 1 -- 172.21.15.59:0/139761828 learned_addr learned my addr 172.21.15.59:0/139761828 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.884+0000 7fa1927fc700 1 --2- 172.21.15.59:0/139761828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa19406b250 0x7fa194136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.884+0000 7fa1937fe700 1 --2- 172.21.15.59:0/139761828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa194136d80 0x7fa194139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.885+0000 7fa1927fc700 1 -- 172.21.15.59:0/139761828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa194136d80 msgr2=0x7fa194139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.885+0000 7fa1927fc700 1 --2- 172.21.15.59:0/139761828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa194136d80 0x7fa194139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.885+0000 7fa191ffb700 1 -- 172.21.15.59:0/139761828 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872939488 0 0) 0x7fa19409ece0 con 0x7fa19406a770 2023-09-30T22:32:08.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.885+0000 7fa1927fc700 1 -- 172.21.15.59:0/139761828 >> v1:172.21.15.59:6789/0 conn(0x7fa19406a770 legacy=0x7fa19406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:08.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.885+0000 7fa1927fc700 1 -- 172.21.15.59:0/139761828 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19409e040 con 0x7fa19406b250 2023-09-30T22:32:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.885+0000 7fa1927fc700 1 --2- 172.21.15.59:0/139761828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa19406b250 0x7fa194136840 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa188009870 tx=0x7fa188009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb7fafdde9eb33df server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.886+0000 7fa191ffb700 1 -- 172.21.15.59:0/139761828 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188011830 con 0x7fa19406b250 2023-09-30T22:32:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.886+0000 7fa191ffb700 1 -- 172.21.15.59:0/139761828 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa188011990 con 0x7fa19406b250 2023-09-30T22:32:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.886+0000 7fa191ffb700 1 -- 172.21.15.59:0/139761828 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188011d20 con 0x7fa19406b250 2023-09-30T22:32:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.886+0000 7fa1995a6700 1 -- 172.21.15.59:0/139761828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa19406b250 msgr2=0x7fa194136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.886+0000 7fa1995a6700 1 --2- 172.21.15.59:0/139761828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa19406b250 0x7fa194136840 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa188009870 tx=0x7fa188009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.886+0000 7fa1995a6700 1 -- 172.21.15.59:0/139761828 shutdown_connections 2023-09-30T22:32:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.886+0000 7fa1995a6700 1 --2- 172.21.15.59:0/139761828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa194136d80 0x7fa194139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.886+0000 7fa1995a6700 1 --2- 172.21.15.59:0/139761828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa19406b250 0x7fa194136840 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.886+0000 7fa1995a6700 1 -- 172.21.15.59:0/139761828 >> 172.21.15.59:0/139761828 conn(0x7fa194066f50 msgr2=0x7fa19409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:08.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.886+0000 7fa1995a6700 1 -- 172.21.15.59:0/139761828 shutdown_connections 2023-09-30T22:32:08.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.886+0000 7fa1995a6700 1 -- 172.21.15.59:0/139761828 wait complete. 2023-09-30T22:32:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.888+0000 7fa1995a6700 1 Processor -- start 2023-09-30T22:32:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.888+0000 7fa1995a6700 1 -- start start 2023-09-30T22:32:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.888+0000 7fa1995a6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa19406a770 0x7fa1941c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.888+0000 7fa1995a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa19406b250 0x7fa1941c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.888+0000 7fa1995a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa194136d80 0x7fa19411c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.888+0000 7fa1995a6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa194071310 con 0x7fa19406a770 2023-09-30T22:32:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.888+0000 7fa1995a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19411f9f0 con 0x7fa194136d80 2023-09-30T22:32:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.888+0000 7fa1995a6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1941bbf00 con 0x7fa19406b250 2023-09-30T22:32:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.888+0000 7fa192ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa19406a770 0x7fa1941c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.888+0000 7fa192ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa19406a770 0x7fa1941c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39566/0 (socket says 172.21.15.59:39566) 2023-09-30T22:32:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.888+0000 7fa192ffd700 1 -- 172.21.15.59:0/2788465019 learned_addr learned my addr 172.21.15.59:0/2788465019 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.888+0000 7fa1927fc700 1 --2- 172.21.15.59:0/2788465019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa19406b250 0x7fa1941c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.889+0000 7fa1937fe700 1 --2- 172.21.15.59:0/2788465019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa194136d80 0x7fa19411c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.889+0000 7fa192ffd700 1 -- 172.21.15.59:0/2788465019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa19406b250 msgr2=0x7fa1941c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.889+0000 7fa192ffd700 1 --2- 172.21.15.59:0/2788465019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa19406b250 0x7fa1941c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.889+0000 7fa192ffd700 1 -- 172.21.15.59:0/2788465019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa194136d80 msgr2=0x7fa19411c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.889+0000 7fa192ffd700 1 --2- 172.21.15.59:0/2788465019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa194136d80 0x7fa19411c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.889+0000 7fa192ffd700 1 -- 172.21.15.59:0/2788465019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1880094a0 con 0x7fa19406a770 2023-09-30T22:32:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.889+0000 7fa1927fc700 1 --2- 172.21.15.59:0/2788465019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa19406b250 0x7fa1941c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.889+0000 7fa1937fe700 1 --2- 172.21.15.59:0/2788465019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa194136d80 0x7fa19411c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.889+0000 7fa192ffd700 1 --2- 172.21.15.59:0/2788465019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa19406a770 0x7fa1941c62e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fa18400c550 tx=0x7fa18400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:08.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.889+0000 7fa17b7fe700 1 -- 172.21.15.59:0/2788465019 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184004c80 con 0x7fa19406a770 2023-09-30T22:32:08.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.889+0000 7fa17b7fe700 1 -- 172.21.15.59:0/2788465019 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa184004e00 con 0x7fa19406a770 2023-09-30T22:32:08.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.889+0000 7fa1995a6700 1 -- 172.21.15.59:0/2788465019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19411ff90 con 0x7fa19406a770 2023-09-30T22:32:08.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.889+0000 7fa17b7fe700 1 -- 172.21.15.59:0/2788465019 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184007310 con 0x7fa19406a770 2023-09-30T22:32:08.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.889+0000 7fa1995a6700 1 -- 172.21.15.59:0/2788465019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1941c6d60 con 0x7fa19406a770 2023-09-30T22:32:08.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.890+0000 7fa17b7fe700 1 -- 172.21.15.59:0/2788465019 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa184007470 con 0x7fa19406a770 2023-09-30T22:32:08.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.890+0000 7fa17b7fe700 1 -- 172.21.15.59:0/2788465019 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa18403f430 con 0x7fa19406a770 2023-09-30T22:32:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.890+0000 7fa1995a6700 1 -- 172.21.15.59:0/2788465019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa194074ea0 con 0x7fa19406a770 2023-09-30T22:32:08.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:08.895+0000 7fa17b7fe700 1 -- 172.21.15.59:0/2788465019 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1840123b0 con 0x7fa19406a770 2023-09-30T22:32:09.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.011+0000 7f984dd1a700 1 -- 172.21.15.59:0/1442495208 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9848071d60 con 0x7f984812c260 2023-09-30T22:32:09.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.012+0000 7f982ffff700 1 -- 172.21.15.59:0/1442495208 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9838021070 con 0x7f984812c260 2023-09-30T22:32:09.012 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:09.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.014+0000 7f984dd1a700 1 -- 172.21.15.59:0/1442495208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984812c260 msgr2=0x7f984813a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:09.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.014+0000 7f984dd1a700 1 --2- 172.21.15.59:0/1442495208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984812c260 0x7f984813a1d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f983800e910 tx=0x7f983800ec20 comp rx=0 tx=0).stop 2023-09-30T22:32:09.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.014+0000 7f984dd1a700 1 -- 172.21.15.59:0/1442495208 shutdown_connections 2023-09-30T22:32:09.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.014+0000 7f984dd1a700 1 --2- 172.21.15.59:0/1442495208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98481302b0 0x7f984813ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:09.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.014+0000 7f984dd1a700 1 --2- 172.21.15.59:0/1442495208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984812c260 0x7f984813a1d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:09.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.014+0000 7f984dd1a700 1 --2- 172.21.15.59:0/1442495208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984812cd80 0x7f984813a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:09.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.014+0000 7f984dd1a700 1 -- 172.21.15.59:0/1442495208 >> 172.21.15.59:0/1442495208 conn(0x7f98480a27f0 msgr2=0x7f984806f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:09.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.014+0000 7f984dd1a700 1 -- 172.21.15.59:0/1442495208 shutdown_connections 2023-09-30T22:32:09.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.014+0000 7f984dd1a700 1 -- 172.21.15.59:0/1442495208 wait complete. 2023-09-30T22:32:09.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:09.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.059+0000 7fafd18be700 1 -- 172.21.15.59:0/2904537816 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fafcc074ea0 con 0x7fafcc06acb0 2023-09-30T22:32:09.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.060+0000 7fafb3fff700 1 -- 172.21.15.59:0/2904537816 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafbc015030 con 0x7fafcc06acb0 2023-09-30T22:32:09.060 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:09.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.062+0000 7fafd18be700 1 -- 172.21.15.59:0/2904537816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafcc06acb0 msgr2=0x7fafcc1c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:09.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.062+0000 7fafd18be700 1 --2- 172.21.15.59:0/2904537816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafcc06acb0 0x7fafcc1c85a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fafbc016000 tx=0x7fafbc004750 comp rx=0 tx=0).stop 2023-09-30T22:32:09.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.062+0000 7fafd18be700 1 -- 172.21.15.59:0/2904537816 shutdown_connections 2023-09-30T22:32:09.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.062+0000 7fafd18be700 1 --2- 172.21.15.59:0/2904537816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafcc1316c0 0x7fafcc070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:09.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.062+0000 7fafd18be700 1 --2- 172.21.15.59:0/2904537816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafcc06acb0 0x7fafcc1c85a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:09.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.062+0000 7fafd18be700 1 --2- 172.21.15.59:0/2904537816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafcc09d9f0 0x7fafcc1c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:09.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.062+0000 7fafd18be700 1 -- 172.21.15.59:0/2904537816 >> 172.21.15.59:0/2904537816 conn(0x7fafcc066f50 msgr2=0x7fafcc130130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:09.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.062+0000 7fafd18be700 1 -- 172.21.15.59:0/2904537816 shutdown_connections 2023-09-30T22:32:09.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.062+0000 7fafd18be700 1 -- 172.21.15.59:0/2904537816 wait complete. 2023-09-30T22:32:09.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:09.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.099+0000 7f3828ac8700 1 -- 172.21.15.59:0/664217848 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3824074ea0 con 0x7f382409e000 2023-09-30T22:32:09.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.099+0000 7f3812ffd700 1 -- 172.21.15.59:0/664217848 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f381801f310 con 0x7f382409e000 2023-09-30T22:32:09.100 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.101+0000 7f3828ac8700 1 -- 172.21.15.59:0/664217848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382409e000 msgr2=0x7f382411e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.101+0000 7f3828ac8700 1 --2- 172.21.15.59:0/664217848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382409e000 0x7f382411e380 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f38240a3e20 tx=0x7f381800d630 comp rx=0 tx=0).stop 2023-09-30T22:32:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.101+0000 7f3828ac8700 1 -- 172.21.15.59:0/664217848 shutdown_connections 2023-09-30T22:32:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.101+0000 7f3828ac8700 1 --2- 172.21.15.59:0/664217848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382409d6f0 0x7f382411de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.101+0000 7f3828ac8700 1 --2- 172.21.15.59:0/664217848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382409e410 0x7f382411e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.101+0000 7f3828ac8700 1 --2- 172.21.15.59:0/664217848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382409e000 0x7f382411e380 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.101+0000 7f3828ac8700 1 -- 172.21.15.59:0/664217848 >> 172.21.15.59:0/664217848 conn(0x7f3824066f50 msgr2=0x7f3824130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.102+0000 7f3828ac8700 1 -- 172.21.15.59:0/664217848 shutdown_connections 2023-09-30T22:32:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.102+0000 7f3828ac8700 1 -- 172.21.15.59:0/664217848 wait complete. 2023-09-30T22:32:09.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:09.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.124+0000 7fa1995a6700 1 -- 172.21.15.59:0/2788465019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa194120780 con 0x7fa19406a770 2023-09-30T22:32:09.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.125+0000 7fa17b7fe700 1 -- 172.21.15.59:0/2788465019 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa184011360 con 0x7fa19406a770 2023-09-30T22:32:09.125 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:09.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.127+0000 7fa1995a6700 1 -- 172.21.15.59:0/2788465019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa19406a770 msgr2=0x7fa1941c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:09.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.127+0000 7fa1995a6700 1 --2- 172.21.15.59:0/2788465019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa19406a770 0x7fa1941c62e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fa18400c550 tx=0x7fa18400c910 comp rx=0 tx=0).stop 2023-09-30T22:32:09.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.127+0000 7fa1995a6700 1 -- 172.21.15.59:0/2788465019 shutdown_connections 2023-09-30T22:32:09.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.127+0000 7fa1995a6700 1 --2- 172.21.15.59:0/2788465019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa194136d80 0x7fa19411c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:09.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.127+0000 7fa1995a6700 1 --2- 172.21.15.59:0/2788465019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa19406a770 0x7fa1941c62e0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:09.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.127+0000 7fa1995a6700 1 --2- 172.21.15.59:0/2788465019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa19406b250 0x7fa1941c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:09.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.127+0000 7fa1995a6700 1 -- 172.21.15.59:0/2788465019 >> 172.21.15.59:0/2788465019 conn(0x7fa194066f50 msgr2=0x7fa194070070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:09.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.127+0000 7fa1995a6700 1 -- 172.21.15.59:0/2788465019 shutdown_connections 2023-09-30T22:32:09.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:09.127+0000 7fa1995a6700 1 -- 172.21.15.59:0/2788465019 wait complete. 2023-09-30T22:32:09.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:10.029 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:10.078 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:10.116 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:10.141 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:10.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.185+0000 7f733d1d1700 1 Processor -- start 2023-09-30T22:32:10.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.185+0000 7f733d1d1700 1 -- start start 2023-09-30T22:32:10.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.186+0000 7f733d1d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7338130540 0x7f7338130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.186+0000 7f733d1d1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7338130e50 0x7f733806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.186+0000 7f733d1d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f733806fb20 0x7f733806ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.186+0000 7f733d1d1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73380704b0 con 0x7f7338130e50 2023-09-30T22:32:10.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.186+0000 7f733d1d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733809a390 con 0x7f733806fb20 2023-09-30T22:32:10.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.186+0000 7f733d1d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73380716a0 con 0x7f7338130540 2023-09-30T22:32:10.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.186+0000 7f733659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7338130e50 0x7f733806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.186+0000 7f733659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7338130e50 0x7f733806f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39582/0 (socket says 172.21.15.59:39582) 2023-09-30T22:32:10.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.186+0000 7f733659c700 1 -- 172.21.15.59:0/1911644576 learned_addr learned my addr 172.21.15.59:0/1911644576 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:10.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.186+0000 7f7336d9d700 1 --2- 172.21.15.59:0/1911644576 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7338130540 0x7f7338130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.186+0000 7f733759e700 1 --2- 172.21.15.59:0/1911644576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f733806fb20 0x7f733806ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.186+0000 7f7336d9d700 1 -- 172.21.15.59:0/1911644576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f733806fb20 msgr2=0x7f733806ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:10.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.186+0000 7f7336d9d700 1 --2- 172.21.15.59:0/1911644576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f733806fb20 0x7f733806ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.186+0000 7f7336d9d700 1 -- 172.21.15.59:0/1911644576 >> v2:172.21.15.59:3300/0 conn(0x7f7338130e50 msgr2=0x7f733806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:10.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.187+0000 7f7336d9d700 1 --2- 172.21.15.59:0/1911644576 >> v2:172.21.15.59:3300/0 conn(0x7f7338130e50 0x7f733806f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.187+0000 7f7336d9d700 1 -- 172.21.15.59:0/1911644576 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7338071290 con 0x7f7338130540 2023-09-30T22:32:10.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.187+0000 7f733659c700 1 --2- 172.21.15.59:0/1911644576 >> v2:172.21.15.59:3300/0 conn(0x7f7338130e50 0x7f733806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:10.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.187+0000 7f7336d9d700 1 --2- 172.21.15.59:0/1911644576 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7338130540 0x7f7338130910 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7328009870 tx=0x7f7328009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a617786c05867cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:10.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.187+0000 7f7335d9b700 1 -- 172.21.15.59:0/1911644576 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7328011830 con 0x7f7338130540 2023-09-30T22:32:10.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.187+0000 7f7335d9b700 1 -- 172.21.15.59:0/1911644576 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7328011990 con 0x7f7338130540 2023-09-30T22:32:10.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.187+0000 7f7335d9b700 1 -- 172.21.15.59:0/1911644576 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7328011d20 con 0x7f7338130540 2023-09-30T22:32:10.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.188+0000 7f733d1d1700 1 -- 172.21.15.59:0/1911644576 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7338130540 msgr2=0x7f7338130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.188+0000 7f733d1d1700 1 --2- 172.21.15.59:0/1911644576 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7338130540 0x7f7338130910 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7328009870 tx=0x7f7328009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:10.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.188+0000 7f733d1d1700 1 -- 172.21.15.59:0/1911644576 shutdown_connections 2023-09-30T22:32:10.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.188+0000 7f733d1d1700 1 --2- 172.21.15.59:0/1911644576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f733806fb20 0x7f733806ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.188+0000 7f733d1d1700 1 --2- 172.21.15.59:0/1911644576 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7338130540 0x7f7338130910 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.188+0000 7f733d1d1700 1 --2- 172.21.15.59:0/1911644576 >> v2:172.21.15.59:3300/0 conn(0x7f7338130e50 0x7f733806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.188+0000 7f733d1d1700 1 -- 172.21.15.59:0/1911644576 >> 172.21.15.59:0/1911644576 conn(0x7f73380a2aa0 msgr2=0x7f73380a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:10.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.188+0000 7f733d1d1700 1 -- 172.21.15.59:0/1911644576 shutdown_connections 2023-09-30T22:32:10.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.188+0000 7f733d1d1700 1 -- 172.21.15.59:0/1911644576 wait complete. 2023-09-30T22:32:10.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.190+0000 7f733d1d1700 1 Processor -- start 2023-09-30T22:32:10.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.190+0000 7f733d1d1700 1 -- start start 2023-09-30T22:32:10.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.190+0000 7f733d1d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f733806fb20 0x7f73381c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.190+0000 7f733d1d1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7338130540 0x7f73381c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.190+0000 7f733d1d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7338130e50 0x7f7338118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.190+0000 7f733d1d1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73380718e0 con 0x7f7338130540 2023-09-30T22:32:10.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.190+0000 7f733d1d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73381c4a90 con 0x7f7338130e50 2023-09-30T22:32:10.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.190+0000 7f733d1d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73381c3c00 con 0x7f733806fb20 2023-09-30T22:32:10.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.191+0000 7f733659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7338130540 0x7f73381c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.191+0000 7f733659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7338130540 0x7f73381c4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39586/0 (socket says 172.21.15.59:39586) 2023-09-30T22:32:10.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.191+0000 7f733659c700 1 -- 172.21.15.59:0/2058963449 learned_addr learned my addr 172.21.15.59:0/2058963449 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:10.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.191+0000 7f733759e700 1 --2- 172.21.15.59:0/2058963449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7338130e50 0x7f7338118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.191+0000 7f7336d9d700 1 --2- 172.21.15.59:0/2058963449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f733806fb20 0x7f73381c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.191+0000 7f733659c700 1 -- 172.21.15.59:0/2058963449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f733806fb20 msgr2=0x7f73381c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.191+0000 7f733659c700 1 --2- 172.21.15.59:0/2058963449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f733806fb20 0x7f73381c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.191+0000 7f733659c700 1 -- 172.21.15.59:0/2058963449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7338130e50 msgr2=0x7f7338118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.191+0000 7f733659c700 1 --2- 172.21.15.59:0/2058963449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7338130e50 0x7f7338118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.191+0000 7f733659c700 1 -- 172.21.15.59:0/2058963449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c00b7f0 con 0x7f7338130540 2023-09-30T22:32:10.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.191+0000 7f733659c700 1 --2- 172.21.15.59:0/2058963449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7338130540 0x7f73381c4550 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f732c010f10 tx=0x7f732c00e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:10.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.192+0000 7f731f7fe700 1 -- 172.21.15.59:0/2058963449 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c011650 con 0x7f7338130540 2023-09-30T22:32:10.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.192+0000 7f731f7fe700 1 -- 172.21.15.59:0/2058963449 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732c0117b0 con 0x7f7338130540 2023-09-30T22:32:10.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.192+0000 7f733d1d1700 1 -- 172.21.15.59:0/2058963449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73280094a0 con 0x7f7338130540 2023-09-30T22:32:10.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.192+0000 7f731f7fe700 1 -- 172.21.15.59:0/2058963449 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c011b60 con 0x7f7338130540 2023-09-30T22:32:10.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.192+0000 7f733d1d1700 1 -- 172.21.15.59:0/2058963449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733811bea0 con 0x7f7338130540 2023-09-30T22:32:10.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.193+0000 7f731f7fe700 1 -- 172.21.15.59:0/2058963449 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f732c011cc0 con 0x7f7338130540 2023-09-30T22:32:10.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.193+0000 7f731f7fe700 1 -- 172.21.15.59:0/2058963449 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f732c042340 con 0x7f7338130540 2023-09-30T22:32:10.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.195+0000 7f733d1d1700 1 -- 172.21.15.59:0/2058963449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7338074ea0 con 0x7f7338130540 2023-09-30T22:32:10.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.204+0000 7f731f7fe700 1 -- 172.21.15.59:0/2058963449 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f732c00ee70 con 0x7f7338130540 2023-09-30T22:32:10.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.238+0000 7f15af457700 1 Processor -- start 2023-09-30T22:32:10.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.238+0000 7f15af457700 1 -- start start 2023-09-30T22:32:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.239+0000 7f15af457700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15a80a1510 0x7f15a8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.239+0000 7f15af457700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15a8139250 0x7f15a813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.239+0000 7f15af457700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a809edd0 con 0x7f15a80a0a30 2023-09-30T22:32:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.239+0000 7f15af457700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a80a18e0 con 0x7f15a80a1510 2023-09-30T22:32:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.239+0000 7f15af457700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15a809e1f0 con 0x7f15a8139250 2023-09-30T22:32:10.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.239+0000 7f15ac9f2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15a80a1510 0x7f15a8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.239+0000 7f15ac9f2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15a80a1510 0x7f15a8138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39588/0 (socket says 172.21.15.59:39588) 2023-09-30T22:32:10.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.239+0000 7f15ac9f2700 1 -- 172.21.15.59:0/441568409 learned_addr learned my addr 172.21.15.59:0/441568409 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:10.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.239+0000 7f15ad9f4700 1 --2- 172.21.15.59:0/441568409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15a8139250 0x7f15a813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.240+0000 7f15ac9f2700 1 -- 172.21.15.59:0/441568409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15a8139250 msgr2=0x7f15a813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.240+0000 7f15ac9f2700 1 --2- 172.21.15.59:0/441568409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15a8139250 0x7f15a813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.240+0000 7f15ac9f2700 1 -- 172.21.15.59:0/441568409 >> v1:172.21.15.59:6789/0 conn(0x7f15a80a0a30 legacy=0x7f15a80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.240+0000 7f15ac9f2700 1 -- 172.21.15.59:0/441568409 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a809dc50 con 0x7f15a80a1510 2023-09-30T22:32:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.240+0000 7f15ac9f2700 1 --2- 172.21.15.59:0/441568409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80a1510 0x7f15a8138d10 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f15980098f0 tx=0x7f1598009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23773f64c5e9683a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.240+0000 7f159ffff700 1 -- 172.21.15.59:0/441568409 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598011830 con 0x7f15a80a1510 2023-09-30T22:32:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.240+0000 7f159ffff700 1 -- 172.21.15.59:0/441568409 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1598011990 con 0x7f15a80a1510 2023-09-30T22:32:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.240+0000 7f159ffff700 1 -- 172.21.15.59:0/441568409 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598011d20 con 0x7f15a80a1510 2023-09-30T22:32:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.241+0000 7f15af457700 1 -- 172.21.15.59:0/441568409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80a1510 msgr2=0x7f15a8138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.241+0000 7f15af457700 1 --2- 172.21.15.59:0/441568409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80a1510 0x7f15a8138d10 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f15980098f0 tx=0x7f1598009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.241+0000 7f15af457700 1 -- 172.21.15.59:0/441568409 shutdown_connections 2023-09-30T22:32:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.241+0000 7f15af457700 1 --2- 172.21.15.59:0/441568409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15a8139250 0x7f15a813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.241+0000 7f15af457700 1 --2- 172.21.15.59:0/441568409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80a1510 0x7f15a8138d10 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.241+0000 7f15af457700 1 -- 172.21.15.59:0/441568409 >> 172.21.15.59:0/441568409 conn(0x7f15a80a6550 msgr2=0x7f15a80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.241+0000 7f15af457700 1 -- 172.21.15.59:0/441568409 shutdown_connections 2023-09-30T22:32:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.241+0000 7f15af457700 1 -- 172.21.15.59:0/441568409 wait complete. 2023-09-30T22:32:10.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.242+0000 7f15af457700 1 Processor -- start 2023-09-30T22:32:10.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.242+0000 7f15af457700 1 -- start start 2023-09-30T22:32:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15af457700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80a0a30 0x7f15a81c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15af457700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15a80a1510 0x7f15a81c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15af457700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15a8139250 0x7f15a81218e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15af457700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a8123690 con 0x7f15a80a0a30 2023-09-30T22:32:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15af457700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a81234a0 con 0x7f15a80a1510 2023-09-30T22:32:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15af457700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15a81c92f0 con 0x7f15a8139250 2023-09-30T22:32:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15ad1f3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80a0a30 0x7f15a81c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15ad9f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15a8139250 0x7f15a81218e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15ad1f3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80a0a30 0x7f15a81c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39600/0 (socket says 172.21.15.59:39600) 2023-09-30T22:32:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15ad1f3700 1 -- 172.21.15.59:0/3147014356 learned_addr learned my addr 172.21.15.59:0/3147014356 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15ac9f2700 1 --2- 172.21.15.59:0/3147014356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15a80a1510 0x7f15a81c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15ad1f3700 1 -- 172.21.15.59:0/3147014356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15a8139250 msgr2=0x7f15a81218e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15ad1f3700 1 --2- 172.21.15.59:0/3147014356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15a8139250 0x7f15a81218e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15ad1f3700 1 -- 172.21.15.59:0/3147014356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15a80a1510 msgr2=0x7f15a81c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15ad1f3700 1 --2- 172.21.15.59:0/3147014356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15a80a1510 0x7f15a81c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.243+0000 7f15ad1f3700 1 -- 172.21.15.59:0/3147014356 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1598009550 con 0x7f15a80a0a30 2023-09-30T22:32:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.244+0000 7f15ad1f3700 1 --2- 172.21.15.59:0/3147014356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80a0a30 0x7f15a81c8870 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f15a400c510 tx=0x7f15a400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.244+0000 7f159dffb700 1 -- 172.21.15.59:0/3147014356 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a40052d0 con 0x7f15a80a0a30 2023-09-30T22:32:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.244+0000 7f159dffb700 1 -- 172.21.15.59:0/3147014356 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a4005430 con 0x7f15a80a0a30 2023-09-30T22:32:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.244+0000 7f159dffb700 1 -- 172.21.15.59:0/3147014356 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a40038c0 con 0x7f15a80a0a30 2023-09-30T22:32:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.244+0000 7f15af457700 1 -- 172.21.15.59:0/3147014356 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a8123a80 con 0x7f15a80a0a30 2023-09-30T22:32:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.244+0000 7f15af457700 1 -- 172.21.15.59:0/3147014356 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a8123c90 con 0x7f15a80a0a30 2023-09-30T22:32:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.245+0000 7f15af457700 1 -- 172.21.15.59:0/3147014356 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a8124d70 con 0x7f15a80a0a30 2023-09-30T22:32:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.246+0000 7f159dffb700 1 -- 172.21.15.59:0/3147014356 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15a4003a20 con 0x7f15a80a0a30 2023-09-30T22:32:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.246+0000 7f159dffb700 1 -- 172.21.15.59:0/3147014356 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f15a403eb40 con 0x7f15a80a0a30 2023-09-30T22:32:10.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.251+0000 7f159dffb700 1 -- 172.21.15.59:0/3147014356 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15a8124d70 con 0x7f15a80a0a30 2023-09-30T22:32:10.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.282+0000 7fe86f32c700 1 Processor -- start 2023-09-30T22:32:10.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.282+0000 7fe86f32c700 1 -- start start 2023-09-30T22:32:10.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.282+0000 7fe86f32c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe86809d6f0 0x7fe86809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.282+0000 7fe86f32c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe86809e000 0x7fe8681339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.282+0000 7fe86f32c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86809b120 con 0x7fe86809e410 2023-09-30T22:32:10.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.282+0000 7fe86f32c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86806b460 con 0x7fe86809e000 2023-09-30T22:32:10.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.282+0000 7fe86f32c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe86809a7e0 con 0x7fe86809d6f0 2023-09-30T22:32:10.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.283+0000 7fe86c8c7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe86809e000 0x7fe8681339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.283+0000 7fe86c8c7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe86809e000 0x7fe8681339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39614/0 (socket says 172.21.15.59:39614) 2023-09-30T22:32:10.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.283+0000 7fe86c8c7700 1 -- 172.21.15.59:0/3886846068 learned_addr learned my addr 172.21.15.59:0/3886846068 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:10.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.283+0000 7fe86d0c8700 1 --2- 172.21.15.59:0/3886846068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe86809d6f0 0x7fe86809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.283+0000 7fe86c8c7700 1 -- 172.21.15.59:0/3886846068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe86809d6f0 msgr2=0x7fe86809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:10.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.283+0000 7fe86c8c7700 1 --2- 172.21.15.59:0/3886846068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe86809d6f0 0x7fe86809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.283+0000 7fe86c8c7700 1 -- 172.21.15.59:0/3886846068 >> v1:172.21.15.59:6789/0 conn(0x7fe86809e410 legacy=0x7fe868133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.283+0000 7fe85ffff700 1 -- 172.21.15.59:0/3886846068 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603197254 0 0) 0x7fe86809b120 con 0x7fe86809e410 2023-09-30T22:32:10.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.283+0000 7fe86c8c7700 1 -- 172.21.15.59:0/3886846068 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86809a500 con 0x7fe86809e000 2023-09-30T22:32:10.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.283+0000 7fe86c8c7700 1 --2- 172.21.15.59:0/3886846068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe86809e000 0x7fe8681339f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe8580098f0 tx=0x7fe858009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b647cbcb6e2de83 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:10.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.284+0000 7fe85ffff700 1 -- 172.21.15.59:0/3886846068 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858011830 con 0x7fe86809e000 2023-09-30T22:32:10.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.284+0000 7fe85ffff700 1 -- 172.21.15.59:0/3886846068 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe858011990 con 0x7fe86809e000 2023-09-30T22:32:10.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.284+0000 7fe85ffff700 1 -- 172.21.15.59:0/3886846068 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858011d20 con 0x7fe86809e000 2023-09-30T22:32:10.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.284+0000 7fe86f32c700 1 -- 172.21.15.59:0/3886846068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe86809e000 msgr2=0x7fe8681339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.284+0000 7fe86f32c700 1 --2- 172.21.15.59:0/3886846068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe86809e000 0x7fe8681339f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe8580098f0 tx=0x7fe858009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:10.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.284+0000 7fe86f32c700 1 -- 172.21.15.59:0/3886846068 shutdown_connections 2023-09-30T22:32:10.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.284+0000 7fe86f32c700 1 --2- 172.21.15.59:0/3886846068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe86809d6f0 0x7fe86809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.284+0000 7fe86f32c700 1 --2- 172.21.15.59:0/3886846068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe86809e000 0x7fe8681339f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.284+0000 7fe86f32c700 1 -- 172.21.15.59:0/3886846068 >> 172.21.15.59:0/3886846068 conn(0x7fe868066f50 msgr2=0x7fe86809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:10.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.285+0000 7fe86f32c700 1 -- 172.21.15.59:0/3886846068 shutdown_connections 2023-09-30T22:32:10.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.285+0000 7fe86f32c700 1 -- 172.21.15.59:0/3886846068 wait complete. 2023-09-30T22:32:10.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.286+0000 7fe86f32c700 1 Processor -- start 2023-09-30T22:32:10.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.286+0000 7fe86f32c700 1 -- start start 2023-09-30T22:32:10.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.286+0000 7fe86f32c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe86809d6f0 0x7fe8681c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.286+0000 7fe86f32c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe86809e000 0x7fe8681c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.286+0000 7fe86f32c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe86809e410 0x7fe8681c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.286+0000 7fe86f32c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8681a8760 con 0x7fe86809e000 2023-09-30T22:32:10.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.286+0000 7fe86f32c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8681a8b20 con 0x7fe86809d6f0 2023-09-30T22:32:10.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.286+0000 7fe86f32c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8681a9260 con 0x7fe86809e410 2023-09-30T22:32:10.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.286+0000 7fe86c8c7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe86809e000 0x7fe8681c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.286+0000 7fe86c8c7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe86809e000 0x7fe8681c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39626/0 (socket says 172.21.15.59:39626) 2023-09-30T22:32:10.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.286+0000 7fe86c8c7700 1 -- 172.21.15.59:0/524846665 learned_addr learned my addr 172.21.15.59:0/524846665 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:10.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.286+0000 7fe86d8c9700 1 --2- 172.21.15.59:0/524846665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe86809e410 0x7fe8681c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.287+0000 7fe86c8c7700 1 -- 172.21.15.59:0/524846665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe86809e410 msgr2=0x7fe8681c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.287+0000 7fe86c8c7700 1 --2- 172.21.15.59:0/524846665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe86809e410 0x7fe8681c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.287+0000 7fe86c8c7700 1 -- 172.21.15.59:0/524846665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe86809d6f0 msgr2=0x7fe8681c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.287+0000 7fe86c8c7700 1 --2- 172.21.15.59:0/524846665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe86809d6f0 0x7fe8681c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.287+0000 7fe86c8c7700 1 -- 172.21.15.59:0/524846665 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe858009550 con 0x7fe86809e000 2023-09-30T22:32:10.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.287+0000 7fe86c8c7700 1 --2- 172.21.15.59:0/524846665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe86809e000 0x7fe8681c5610 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe858000c00 tx=0x7fe858004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:10.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.287+0000 7fe85dffb700 1 -- 172.21.15.59:0/524846665 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85801a910 con 0x7fe86809e000 2023-09-30T22:32:10.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.287+0000 7fe85dffb700 1 -- 172.21.15.59:0/524846665 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85801f070 con 0x7fe86809e000 2023-09-30T22:32:10.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.287+0000 7fe86f32c700 1 -- 172.21.15.59:0/524846665 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8681a9520 con 0x7fe86809e000 2023-09-30T22:32:10.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.287+0000 7fe85dffb700 1 -- 172.21.15.59:0/524846665 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85801ac70 con 0x7fe86809e000 2023-09-30T22:32:10.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.288+0000 7fe86f32c700 1 -- 172.21.15.59:0/524846665 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8681a7ad0 con 0x7fe86809e000 2023-09-30T22:32:10.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.289+0000 7fe86f32c700 1 -- 172.21.15.59:0/524846665 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe868074ea0 con 0x7fe86809e000 2023-09-30T22:32:10.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.289+0000 7fe85dffb700 1 -- 172.21.15.59:0/524846665 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe85801b430 con 0x7fe86809e000 2023-09-30T22:32:10.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.289+0000 7fe85dffb700 1 -- 172.21.15.59:0/524846665 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe8580406c0 con 0x7fe86809e000 2023-09-30T22:32:10.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.298+0000 7fe85dffb700 1 -- 172.21.15.59:0/524846665 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe858010c00 con 0x7fe86809e000 2023-09-30T22:32:10.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.324+0000 7faab72ed700 1 Processor -- start 2023-09-30T22:32:10.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.324+0000 7faab72ed700 1 -- start start 2023-09-30T22:32:10.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.325+0000 7faab72ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab009d6f0 0x7faab009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.325+0000 7faab72ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab009e000 0x7faab01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.325+0000 7faab72ed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faab009e410 0x7faab0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.325+0000 7faab72ed700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab006b460 con 0x7faab009e410 2023-09-30T22:32:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.325+0000 7faab72ed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab009b120 con 0x7faab009d6f0 2023-09-30T22:32:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.325+0000 7faab72ed700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faab009a7e0 con 0x7faab009e000 2023-09-30T22:32:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.325+0000 7faab5089700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab009d6f0 0x7faab009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.325+0000 7faab5089700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab009d6f0 0x7faab009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55084/0 (socket says 172.21.15.59:55084) 2023-09-30T22:32:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.325+0000 7faab5089700 1 -- 172.21.15.59:0/3912820642 learned_addr learned my addr 172.21.15.59:0/3912820642 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.326+0000 7faab4888700 1 --2- 172.21.15.59:0/3912820642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab009e000 0x7faab01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.326+0000 7faab588a700 1 --2- 172.21.15.59:0/3912820642 >> v2:172.21.15.59:3300/0 conn(0x7faab009e410 0x7faab0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.326+0000 7faab4888700 1 -- 172.21.15.59:0/3912820642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab009d6f0 msgr2=0x7faab009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:10.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.326+0000 7faab4888700 1 --2- 172.21.15.59:0/3912820642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab009d6f0 0x7faab009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.326+0000 7faab4888700 1 -- 172.21.15.59:0/3912820642 >> v2:172.21.15.59:3300/0 conn(0x7faab009e410 msgr2=0x7faab0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:10.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.326+0000 7faab4888700 1 --2- 172.21.15.59:0/3912820642 >> v2:172.21.15.59:3300/0 conn(0x7faab009e410 0x7faab0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.326+0000 7faab4888700 1 -- 172.21.15.59:0/3912820642 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab009a500 con 0x7faab009e000 2023-09-30T22:32:10.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.326+0000 7faab5089700 1 --2- 172.21.15.59:0/3912820642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab009d6f0 0x7faab009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:10.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.326+0000 7faab4888700 1 --2- 172.21.15.59:0/3912820642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab009e000 0x7faab01339f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009870 tx=0x7faaa0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fceb08796161899 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:10.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.326+0000 7faaa7fff700 1 -- 172.21.15.59:0/3912820642 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0011830 con 0x7faab009e000 2023-09-30T22:32:10.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.326+0000 7faaa7fff700 1 -- 172.21.15.59:0/3912820642 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa0011990 con 0x7faab009e000 2023-09-30T22:32:10.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.326+0000 7faaa7fff700 1 -- 172.21.15.59:0/3912820642 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0011d20 con 0x7faab009e000 2023-09-30T22:32:10.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.327+0000 7faab72ed700 1 -- 172.21.15.59:0/3912820642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab009e000 msgr2=0x7faab01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.327+0000 7faab72ed700 1 --2- 172.21.15.59:0/3912820642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab009e000 0x7faab01339f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009870 tx=0x7faaa0009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:10.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.327+0000 7faab72ed700 1 -- 172.21.15.59:0/3912820642 shutdown_connections 2023-09-30T22:32:10.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.327+0000 7faab72ed700 1 --2- 172.21.15.59:0/3912820642 >> v2:172.21.15.59:3300/0 conn(0x7faab009e410 0x7faab0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.327+0000 7faab72ed700 1 --2- 172.21.15.59:0/3912820642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab009d6f0 0x7faab009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.327+0000 7faab72ed700 1 --2- 172.21.15.59:0/3912820642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab009e000 0x7faab01339f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.327+0000 7faab72ed700 1 -- 172.21.15.59:0/3912820642 >> 172.21.15.59:0/3912820642 conn(0x7faab0066f50 msgr2=0x7faab009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:10.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.327+0000 7faab72ed700 1 -- 172.21.15.59:0/3912820642 shutdown_connections 2023-09-30T22:32:10.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.327+0000 7faab72ed700 1 -- 172.21.15.59:0/3912820642 wait complete. 2023-09-30T22:32:10.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.329+0000 7faab72ed700 1 Processor -- start 2023-09-30T22:32:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.329+0000 7faab72ed700 1 -- start start 2023-09-30T22:32:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab72ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab009d6f0 0x7faab01a5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab72ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faab009e000 0x7faab01a6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab72ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab009e410 0x7faab01a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab72ed700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab01a96c0 con 0x7faab009e000 2023-09-30T22:32:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab72ed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab01a9910 con 0x7faab009d6f0 2023-09-30T22:32:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab72ed700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faab009c6d0 con 0x7faab009e410 2023-09-30T22:32:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab4888700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faab009e000 0x7faab01a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab4888700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faab009e000 0x7faab01a6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39652/0 (socket says 172.21.15.59:39652) 2023-09-30T22:32:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab4888700 1 -- 172.21.15.59:0/3340855191 learned_addr learned my addr 172.21.15.59:0/3340855191 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab588a700 1 --2- 172.21.15.59:0/3340855191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab009e410 0x7faab01a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab5089700 1 --2- 172.21.15.59:0/3340855191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab009d6f0 0x7faab01a5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab4888700 1 -- 172.21.15.59:0/3340855191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab009e410 msgr2=0x7faab01a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab4888700 1 --2- 172.21.15.59:0/3340855191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab009e410 0x7faab01a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab4888700 1 -- 172.21.15.59:0/3340855191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab009d6f0 msgr2=0x7faab01a5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab4888700 1 --2- 172.21.15.59:0/3340855191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab009d6f0 0x7faab01a5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.330+0000 7faab4888700 1 -- 172.21.15.59:0/3340855191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac009550 con 0x7faab009e000 2023-09-30T22:32:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.331+0000 7faab4888700 1 --2- 172.21.15.59:0/3340855191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faab009e000 0x7faab01a6400 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7faaa0000c00 tx=0x7faaa0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.331+0000 7faaa5ffb700 1 -- 172.21.15.59:0/3340855191 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa00036a0 con 0x7faab009e000 2023-09-30T22:32:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.331+0000 7faaa5ffb700 1 -- 172.21.15.59:0/3340855191 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa001f070 con 0x7faab009e000 2023-09-30T22:32:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.331+0000 7faab72ed700 1 -- 172.21.15.59:0/3340855191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa00094a0 con 0x7faab009e000 2023-09-30T22:32:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.331+0000 7faaa5ffb700 1 -- 172.21.15.59:0/3340855191 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0003a20 con 0x7faab009e000 2023-09-30T22:32:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.331+0000 7faab72ed700 1 -- 172.21.15.59:0/3340855191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab00a30e0 con 0x7faab009e000 2023-09-30T22:32:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.332+0000 7faab72ed700 1 -- 172.21.15.59:0/3340855191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab0074ea0 con 0x7faab009e000 2023-09-30T22:32:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.333+0000 7faaa5ffb700 1 -- 172.21.15.59:0/3340855191 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faaa0003b80 con 0x7faab009e000 2023-09-30T22:32:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.333+0000 7faaa5ffb700 1 -- 172.21.15.59:0/3340855191 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faaa0021070 con 0x7faab009e000 2023-09-30T22:32:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.342+0000 7faaa5ffb700 1 -- 172.21.15.59:0/3340855191 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faaa0003e30 con 0x7faab009e000 2023-09-30T22:32:10.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.434+0000 7f733d1d1700 1 -- 172.21.15.59:0/2058963449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f733811b1e0 con 0x7f7338130540 2023-09-30T22:32:10.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.434+0000 7f731f7fe700 1 -- 172.21.15.59:0/2058963449 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f732c021e60 con 0x7f7338130540 2023-09-30T22:32:10.434 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:10.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.436+0000 7f733d1d1700 1 -- 172.21.15.59:0/2058963449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7338130540 msgr2=0x7f73381c4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.436+0000 7f733d1d1700 1 --2- 172.21.15.59:0/2058963449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7338130540 0x7f73381c4550 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f732c010f10 tx=0x7f732c00e640 comp rx=0 tx=0).stop 2023-09-30T22:32:10.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.437+0000 7f733d1d1700 1 -- 172.21.15.59:0/2058963449 shutdown_connections 2023-09-30T22:32:10.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.437+0000 7f733d1d1700 1 --2- 172.21.15.59:0/2058963449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f733806fb20 0x7f73381c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.437+0000 7f733d1d1700 1 --2- 172.21.15.59:0/2058963449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7338130e50 0x7f7338118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.437+0000 7f733d1d1700 1 --2- 172.21.15.59:0/2058963449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7338130540 0x7f73381c4550 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.437+0000 7f733d1d1700 1 -- 172.21.15.59:0/2058963449 >> 172.21.15.59:0/2058963449 conn(0x7f73380a2aa0 msgr2=0x7f733812d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:10.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.439+0000 7f733d1d1700 1 -- 172.21.15.59:0/2058963449 shutdown_connections 2023-09-30T22:32:10.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.439+0000 7f733d1d1700 1 -- 172.21.15.59:0/2058963449 wait complete. 2023-09-30T22:32:10.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.481+0000 7f15af457700 1 -- 172.21.15.59:0/3147014356 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f15a8124d70 con 0x7f15a80a0a30 2023-09-30T22:32:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.481+0000 7f159dffb700 1 -- 172.21.15.59:0/3147014356 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15a8124d70 con 0x7f15a80a0a30 2023-09-30T22:32:10.482 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:10.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.485+0000 7f15af457700 1 -- 172.21.15.59:0/3147014356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80a0a30 msgr2=0x7f15a81c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.485+0000 7f15af457700 1 --2- 172.21.15.59:0/3147014356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80a0a30 0x7f15a81c8870 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f15a400c510 tx=0x7f15a400c820 comp rx=0 tx=0).stop 2023-09-30T22:32:10.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.485+0000 7f15af457700 1 -- 172.21.15.59:0/3147014356 shutdown_connections 2023-09-30T22:32:10.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.485+0000 7f15af457700 1 --2- 172.21.15.59:0/3147014356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15a8139250 0x7f15a81218e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.485+0000 7f15af457700 1 --2- 172.21.15.59:0/3147014356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80a0a30 0x7f15a81c8870 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.485+0000 7f15af457700 1 --2- 172.21.15.59:0/3147014356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15a80a1510 0x7f15a81c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.485+0000 7f15af457700 1 -- 172.21.15.59:0/3147014356 >> 172.21.15.59:0/3147014356 conn(0x7f15a80a6550 msgr2=0x7f15a8137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:10.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.485+0000 7f15af457700 1 -- 172.21.15.59:0/3147014356 shutdown_connections 2023-09-30T22:32:10.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.485+0000 7f15af457700 1 -- 172.21.15.59:0/3147014356 wait complete. 2023-09-30T22:32:10.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:10.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.514+0000 7fe86f32c700 1 -- 172.21.15.59:0/524846665 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe8681a7ad0 con 0x7fe86809e000 2023-09-30T22:32:10.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.514+0000 7fe85dffb700 1 -- 172.21.15.59:0/524846665 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8681a7ad0 con 0x7fe86809e000 2023-09-30T22:32:10.514 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:10.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.516+0000 7fe86f32c700 1 -- 172.21.15.59:0/524846665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe86809e000 msgr2=0x7fe8681c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.516+0000 7fe86f32c700 1 --2- 172.21.15.59:0/524846665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe86809e000 0x7fe8681c5610 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe858000c00 tx=0x7fe858004750 comp rx=0 tx=0).stop 2023-09-30T22:32:10.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.517+0000 7fe86f32c700 1 -- 172.21.15.59:0/524846665 shutdown_connections 2023-09-30T22:32:10.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.517+0000 7fe86f32c700 1 --2- 172.21.15.59:0/524846665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe86809e410 0x7fe8681c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.517+0000 7fe86f32c700 1 --2- 172.21.15.59:0/524846665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe86809d6f0 0x7fe8681c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.517+0000 7fe86f32c700 1 --2- 172.21.15.59:0/524846665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe86809e000 0x7fe8681c5610 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.517+0000 7fe86f32c700 1 -- 172.21.15.59:0/524846665 >> 172.21.15.59:0/524846665 conn(0x7fe868066f50 msgr2=0x7fe8681bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:10.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.517+0000 7fe86f32c700 1 -- 172.21.15.59:0/524846665 shutdown_connections 2023-09-30T22:32:10.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.517+0000 7fe86f32c700 1 -- 172.21.15.59:0/524846665 wait complete. 2023-09-30T22:32:10.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:10.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.551+0000 7faab72ed700 1 -- 172.21.15.59:0/3340855191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faab01a8c50 con 0x7faab009e000 2023-09-30T22:32:10.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.551+0000 7faaa5ffb700 1 -- 172.21.15.59:0/3340855191 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faaa0015020 con 0x7faab009e000 2023-09-30T22:32:10.551 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.554+0000 7faab72ed700 1 -- 172.21.15.59:0/3340855191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faab009e000 msgr2=0x7faab01a6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.554+0000 7faab72ed700 1 --2- 172.21.15.59:0/3340855191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faab009e000 0x7faab01a6400 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7faaa0000c00 tx=0x7faaa0004750 comp rx=0 tx=0).stop 2023-09-30T22:32:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.554+0000 7faab72ed700 1 -- 172.21.15.59:0/3340855191 shutdown_connections 2023-09-30T22:32:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.554+0000 7faab72ed700 1 --2- 172.21.15.59:0/3340855191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab009e410 0x7faab01a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.554+0000 7faab72ed700 1 --2- 172.21.15.59:0/3340855191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab009d6f0 0x7faab01a5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.554+0000 7faab72ed700 1 --2- 172.21.15.59:0/3340855191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faab009e000 0x7faab01a6400 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.554+0000 7faab72ed700 1 -- 172.21.15.59:0/3340855191 >> 172.21.15.59:0/3340855191 conn(0x7faab0066f50 msgr2=0x7faab01baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.554+0000 7faab72ed700 1 -- 172.21.15.59:0/3340855191 shutdown_connections 2023-09-30T22:32:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:10.554+0000 7faab72ed700 1 -- 172.21.15.59:0/3340855191 wait complete. 2023-09-30T22:32:10.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:11.455 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:11.502 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:11.531 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:11.569 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:11.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.608+0000 7fca2a309700 1 Processor -- start 2023-09-30T22:32:11.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.608+0000 7fca2a309700 1 -- start start 2023-09-30T22:32:11.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.608+0000 7fca2a309700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca2406c0e0 0x7fca2409ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.608+0000 7fca2a309700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca241380f0 0x7fca2413fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.608+0000 7fca2a309700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca24134980 con 0x7fca24134ec0 2023-09-30T22:32:11.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.608+0000 7fca2a309700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2406c4b0 con 0x7fca2406c0e0 2023-09-30T22:32:11.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.608+0000 7fca2a309700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca240a09c0 con 0x7fca241380f0 2023-09-30T22:32:11.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.609+0000 7fca288a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca241380f0 0x7fca2413fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.609+0000 7fca288a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca241380f0 0x7fca2413fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43052/0 (socket says 172.21.15.59:43052) 2023-09-30T22:32:11.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.609+0000 7fca288a6700 1 -- 172.21.15.59:0/881190741 learned_addr learned my addr 172.21.15.59:0/881190741 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:11.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.609+0000 7fca23fff700 1 --2- 172.21.15.59:0/881190741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca2406c0e0 0x7fca2409ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.609+0000 7fca288a6700 1 -- 172.21.15.59:0/881190741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca2406c0e0 msgr2=0x7fca2409ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:11.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.609+0000 7fca288a6700 1 --2- 172.21.15.59:0/881190741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca2406c0e0 0x7fca2409ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.609+0000 7fca288a6700 1 -- 172.21.15.59:0/881190741 >> v1:172.21.15.59:6789/0 conn(0x7fca24134ec0 legacy=0x7fca241379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:11.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.609+0000 7fca288a6700 1 -- 172.21.15.59:0/881190741 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca240a0600 con 0x7fca241380f0 2023-09-30T22:32:11.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.609+0000 7fca288a6700 1 --2- 172.21.15.59:0/881190741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca241380f0 0x7fca2413fd20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009e80 tx=0x7fca1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=346e4a7317fb1752 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:11.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.609+0000 7fca22ffd700 1 -- 172.21.15.59:0/881190741 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c00e070 con 0x7fca241380f0 2023-09-30T22:32:11.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.610+0000 7fca22ffd700 1 -- 172.21.15.59:0/881190741 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c003a20 con 0x7fca241380f0 2023-09-30T22:32:11.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.610+0000 7fca22ffd700 1 -- 172.21.15.59:0/881190741 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c003dd0 con 0x7fca241380f0 2023-09-30T22:32:11.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.611+0000 7fca2a309700 1 -- 172.21.15.59:0/881190741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca241380f0 msgr2=0x7fca2413fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.611+0000 7fca2a309700 1 --2- 172.21.15.59:0/881190741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca241380f0 0x7fca2413fd20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009e80 tx=0x7fca1c00b330 comp rx=0 tx=0).stop 2023-09-30T22:32:11.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.611+0000 7fca2a309700 1 -- 172.21.15.59:0/881190741 shutdown_connections 2023-09-30T22:32:11.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.611+0000 7fca2a309700 1 --2- 172.21.15.59:0/881190741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca241380f0 0x7fca2413fd20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.611+0000 7fca2a309700 1 --2- 172.21.15.59:0/881190741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca2406c0e0 0x7fca2409ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.611+0000 7fca2a309700 1 -- 172.21.15.59:0/881190741 >> 172.21.15.59:0/881190741 conn(0x7fca240a4210 msgr2=0x7fca240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:11.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.611+0000 7fca2a309700 1 -- 172.21.15.59:0/881190741 shutdown_connections 2023-09-30T22:32:11.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.611+0000 7fca2a309700 1 -- 172.21.15.59:0/881190741 wait complete. 2023-09-30T22:32:11.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.612+0000 7fca2a309700 1 Processor -- start 2023-09-30T22:32:11.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.613+0000 7fca2a309700 1 -- start start 2023-09-30T22:32:11.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.613+0000 7fca2a309700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca2406c0e0 0x7fca2411a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.613+0000 7fca2a309700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca24134ec0 0x7fca2411ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.613+0000 7fca2a309700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca241380f0 0x7fca2411b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.613+0000 7fca2a309700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca241279f0 con 0x7fca241380f0 2023-09-30T22:32:11.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.613+0000 7fca2a309700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2411e450 con 0x7fca24134ec0 2023-09-30T22:32:11.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.613+0000 7fca2a309700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca2411df50 con 0x7fca2406c0e0 2023-09-30T22:32:11.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.614+0000 7fca23fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca2406c0e0 0x7fca2411a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.614+0000 7fca23fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca2406c0e0 0x7fca2411a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43054/0 (socket says 172.21.15.59:43054) 2023-09-30T22:32:11.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.614+0000 7fca23fff700 1 -- 172.21.15.59:0/27873814 learned_addr learned my addr 172.21.15.59:0/27873814 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:11.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.614+0000 7fca237fe700 1 --2- 172.21.15.59:0/27873814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca24134ec0 0x7fca2411ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.614+0000 7fca237fe700 1 -- 172.21.15.59:0/27873814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca2406c0e0 msgr2=0x7fca2411a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.614+0000 7fca237fe700 1 --2- 172.21.15.59:0/27873814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca2406c0e0 0x7fca2411a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.614+0000 7fca237fe700 1 -- 172.21.15.59:0/27873814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca241380f0 msgr2=0x7fca2411b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.614+0000 7fca237fe700 1 --2- 172.21.15.59:0/27873814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca241380f0 0x7fca2411b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.614+0000 7fca237fe700 1 -- 172.21.15.59:0/27873814 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1c009b30 con 0x7fca24134ec0 2023-09-30T22:32:11.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.614+0000 7fca23fff700 1 --2- 172.21.15.59:0/27873814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca2406c0e0 0x7fca2411a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:11.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.614+0000 7fca237fe700 1 --2- 172.21.15.59:0/27873814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca24134ec0 0x7fca2411ac50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fca2406f500 tx=0x7fca1800c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:11.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.614+0000 7fca20ff9700 1 -- 172.21.15.59:0/27873814 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18011790 con 0x7fca24134ec0 2023-09-30T22:32:11.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.615+0000 7fca20ff9700 1 -- 172.21.15.59:0/27873814 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1800ce90 con 0x7fca24134ec0 2023-09-30T22:32:11.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.615+0000 7fca20ff9700 1 -- 172.21.15.59:0/27873814 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18011b30 con 0x7fca24134ec0 2023-09-30T22:32:11.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.615+0000 7fca2a309700 1 -- 172.21.15.59:0/27873814 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2411cb10 con 0x7fca24134ec0 2023-09-30T22:32:11.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.615+0000 7fca2a309700 1 -- 172.21.15.59:0/27873814 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2411c850 con 0x7fca24134ec0 2023-09-30T22:32:11.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.616+0000 7fca20ff9700 1 -- 172.21.15.59:0/27873814 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca18011c90 con 0x7fca24134ec0 2023-09-30T22:32:11.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.617+0000 7fca20ff9700 1 -- 172.21.15.59:0/27873814 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fca1803f350 con 0x7fca24134ec0 2023-09-30T22:32:11.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.617+0000 7fca2a309700 1 -- 172.21.15.59:0/27873814 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2411dd90 con 0x7fca24134ec0 2023-09-30T22:32:11.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.623+0000 7fca20ff9700 1 -- 172.21.15.59:0/27873814 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca18012420 con 0x7fca24134ec0 2023-09-30T22:32:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.652+0000 7f19eee49700 1 Processor -- start 2023-09-30T22:32:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.652+0000 7f19eee49700 1 -- start start 2023-09-30T22:32:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19eee49700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e809d6f0 0x7f19e809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19eee49700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19e809e000 0x7f19e8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19eee49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e809e410 0x7f19e8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19eee49700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e809f520 con 0x7f19e809e000 2023-09-30T22:32:11.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19eee49700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e809f130 con 0x7f19e809e410 2023-09-30T22:32:11.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19eee49700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19e809e930 con 0x7f19e809d6f0 2023-09-30T22:32:11.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19ecbe5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e809d6f0 0x7f19e809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19ecbe5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e809d6f0 0x7f19e809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43062/0 (socket says 172.21.15.59:43062) 2023-09-30T22:32:11.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19ecbe5700 1 -- 172.21.15.59:0/3389428373 learned_addr learned my addr 172.21.15.59:0/3389428373 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:11.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19e7fff700 1 --2- 172.21.15.59:0/3389428373 >> v2:172.21.15.59:3300/0 conn(0x7f19e809e000 0x7f19e8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19ed3e6700 1 --2- 172.21.15.59:0/3389428373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e809e410 0x7f19e8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19ecbe5700 1 -- 172.21.15.59:0/3389428373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e809e410 msgr2=0x7f19e8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:11.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19ecbe5700 1 --2- 172.21.15.59:0/3389428373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e809e410 0x7f19e8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19ecbe5700 1 -- 172.21.15.59:0/3389428373 >> v2:172.21.15.59:3300/0 conn(0x7f19e809e000 msgr2=0x7f19e8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19ecbe5700 1 --2- 172.21.15.59:0/3389428373 >> v2:172.21.15.59:3300/0 conn(0x7f19e809e000 0x7f19e8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19ecbe5700 1 -- 172.21.15.59:0/3389428373 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e809b2d0 con 0x7f19e809d6f0 2023-09-30T22:32:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19ed3e6700 1 --2- 172.21.15.59:0/3389428373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e809e410 0x7f19e8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19e7fff700 1 --2- 172.21.15.59:0/3389428373 >> v2:172.21.15.59:3300/0 conn(0x7f19e809e000 0x7f19e8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.653+0000 7f19ecbe5700 1 --2- 172.21.15.59:0/3389428373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e809d6f0 0x7f19e809dac0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f19dc009920 tx=0x7f19dc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a82c0d8727ce1b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.654+0000 7f19e77fe700 1 -- 172.21.15.59:0/3389428373 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc011830 con 0x7f19e809d6f0 2023-09-30T22:32:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.654+0000 7f19e77fe700 1 -- 172.21.15.59:0/3389428373 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc011990 con 0x7f19e809d6f0 2023-09-30T22:32:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.654+0000 7f19e77fe700 1 -- 172.21.15.59:0/3389428373 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc011d20 con 0x7f19e809d6f0 2023-09-30T22:32:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.654+0000 7f19eee49700 1 -- 172.21.15.59:0/3389428373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e809d6f0 msgr2=0x7f19e809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.654+0000 7f19eee49700 1 --2- 172.21.15.59:0/3389428373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e809d6f0 0x7f19e809dac0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f19dc009920 tx=0x7f19dc009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.655+0000 7f19eee49700 1 -- 172.21.15.59:0/3389428373 shutdown_connections 2023-09-30T22:32:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.655+0000 7f19eee49700 1 --2- 172.21.15.59:0/3389428373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e809e410 0x7f19e8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.655+0000 7f19eee49700 1 --2- 172.21.15.59:0/3389428373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e809d6f0 0x7f19e809dac0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.655+0000 7f19eee49700 1 --2- 172.21.15.59:0/3389428373 >> v2:172.21.15.59:3300/0 conn(0x7f19e809e000 0x7f19e8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.655+0000 7f19eee49700 1 -- 172.21.15.59:0/3389428373 >> 172.21.15.59:0/3389428373 conn(0x7f19e8066f50 msgr2=0x7f19e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.655+0000 7f19eee49700 1 -- 172.21.15.59:0/3389428373 shutdown_connections 2023-09-30T22:32:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.655+0000 7f19eee49700 1 -- 172.21.15.59:0/3389428373 wait complete. 2023-09-30T22:32:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.656+0000 7f19eee49700 1 Processor -- start 2023-09-30T22:32:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.656+0000 7f19eee49700 1 -- start start 2023-09-30T22:32:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.656+0000 7f19eee49700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e809d6f0 0x7f19e806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.656+0000 7f19eee49700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e809e000 0x7f19e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.656+0000 7f19eee49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e809e410 0x7f19e806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.656+0000 7f19eee49700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8125cb0 con 0x7f19e809d6f0 2023-09-30T22:32:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.656+0000 7f19eee49700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e812fff0 con 0x7f19e809e410 2023-09-30T22:32:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.656+0000 7f19eee49700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8130710 con 0x7f19e809e000 2023-09-30T22:32:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.657+0000 7f19ecbe5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e809d6f0 0x7f19e806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.657+0000 7f19e7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e809e000 0x7f19e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.657+0000 7f19ed3e6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e809e410 0x7f19e806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.657+0000 7f19e7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e809e000 0x7f19e806edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43066/0 (socket says 172.21.15.59:43066) 2023-09-30T22:32:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.657+0000 7f19ecbe5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e809d6f0 0x7f19e806e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39664/0 (socket says 172.21.15.59:39664) 2023-09-30T22:32:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.657+0000 7f19e7fff700 1 -- 172.21.15.59:0/777305505 learned_addr learned my addr 172.21.15.59:0/777305505 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.657+0000 7f19e7fff700 1 -- 172.21.15.59:0/777305505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e809e410 msgr2=0x7f19e806f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.657+0000 7f19e7fff700 1 --2- 172.21.15.59:0/777305505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e809e410 0x7f19e806f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.657+0000 7f19e7fff700 1 -- 172.21.15.59:0/777305505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e809d6f0 msgr2=0x7f19e806e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.657+0000 7f19e7fff700 1 --2- 172.21.15.59:0/777305505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e809d6f0 0x7f19e806e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.657+0000 7f19e7fff700 1 -- 172.21.15.59:0/777305505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d40094a0 con 0x7f19e809e000 2023-09-30T22:32:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.657+0000 7f19ecbe5700 1 --2- 172.21.15.59:0/777305505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e809d6f0 0x7f19e806e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.657+0000 7f19e7fff700 1 --2- 172.21.15.59:0/777305505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e809e000 0x7f19e806edb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f19d400ebb0 tx=0x7f19d400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.658+0000 7f19e57fa700 1 -- 172.21.15.59:0/777305505 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d400c850 con 0x7f19e809e000 2023-09-30T22:32:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.658+0000 7f19eee49700 1 -- 172.21.15.59:0/777305505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc009550 con 0x7f19e809e000 2023-09-30T22:32:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.658+0000 7f19e57fa700 1 -- 172.21.15.59:0/777305505 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d400c9b0 con 0x7f19e809e000 2023-09-30T22:32:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.658+0000 7f19e57fa700 1 -- 172.21.15.59:0/777305505 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d400cd60 con 0x7f19e809e000 2023-09-30T22:32:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.658+0000 7f19eee49700 1 -- 172.21.15.59:0/777305505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e8124870 con 0x7f19e809e000 2023-09-30T22:32:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.659+0000 7f19e57fa700 1 -- 172.21.15.59:0/777305505 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19d4013470 con 0x7f19e809e000 2023-09-30T22:32:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.659+0000 7f19eee49700 1 -- 172.21.15.59:0/777305505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e8072320 con 0x7f19e809e000 2023-09-30T22:32:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.659+0000 7f19e57fa700 1 -- 172.21.15.59:0/777305505 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f19d403f810 con 0x7f19e809e000 2023-09-30T22:32:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.664+0000 7f19e57fa700 1 -- 172.21.15.59:0/777305505 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19d4021080 con 0x7f19e809e000 2023-09-30T22:32:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.720+0000 7f85cde91700 1 Processor -- start 2023-09-30T22:32:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.720+0000 7f85cde91700 1 -- start start 2023-09-30T22:32:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.720+0000 7f85cde91700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85c809d6f0 0x7f85c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.720+0000 7f85cde91700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f85c809e000 0x7f85c81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.720+0000 7f85cde91700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c809b120 con 0x7f85c809e410 2023-09-30T22:32:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.720+0000 7f85cde91700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c806b460 con 0x7f85c809e000 2023-09-30T22:32:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.720+0000 7f85cde91700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c809a7e0 con 0x7f85c809d6f0 2023-09-30T22:32:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.720+0000 7f85c6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f85c809e000 0x7f85c81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.721+0000 7f85c6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f85c809e000 0x7f85c81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39678/0 (socket says 172.21.15.59:39678) 2023-09-30T22:32:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.721+0000 7f85c6ffd700 1 -- 172.21.15.59:0/2891351761 learned_addr learned my addr 172.21.15.59:0/2891351761 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.721+0000 7f85c77fe700 1 --2- 172.21.15.59:0/2891351761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85c809d6f0 0x7f85c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.721+0000 7f85c6ffd700 1 -- 172.21.15.59:0/2891351761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85c809d6f0 msgr2=0x7f85c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.721+0000 7f85c6ffd700 1 --2- 172.21.15.59:0/2891351761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85c809d6f0 0x7f85c809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.721+0000 7f85c6ffd700 1 -- 172.21.15.59:0/2891351761 >> v1:172.21.15.59:6789/0 conn(0x7f85c809e410 legacy=0x7f85c8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.721+0000 7f85c6ffd700 1 -- 172.21.15.59:0/2891351761 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c809a500 con 0x7f85c809e000 2023-09-30T22:32:11.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.721+0000 7f85c6ffd700 1 --2- 172.21.15.59:0/2891351761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c809e000 0x7f85c81339f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f85bc0098f0 tx=0x7f85bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abda63d86e3b638d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:11.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.721+0000 7f85c67fc700 1 -- 172.21.15.59:0/2891351761 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc004230 con 0x7f85c809e000 2023-09-30T22:32:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.721+0000 7f85c67fc700 1 -- 172.21.15.59:0/2891351761 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc004390 con 0x7f85c809e000 2023-09-30T22:32:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.721+0000 7f85c67fc700 1 -- 172.21.15.59:0/2891351761 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0036a0 con 0x7f85c809e000 2023-09-30T22:32:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.722+0000 7f85cde91700 1 -- 172.21.15.59:0/2891351761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c809e000 msgr2=0x7f85c81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.722+0000 7f85cde91700 1 --2- 172.21.15.59:0/2891351761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c809e000 0x7f85c81339f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f85bc0098f0 tx=0x7f85bc009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.722+0000 7f85cde91700 1 -- 172.21.15.59:0/2891351761 shutdown_connections 2023-09-30T22:32:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.722+0000 7f85cde91700 1 --2- 172.21.15.59:0/2891351761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85c809d6f0 0x7f85c809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.722+0000 7f85cde91700 1 --2- 172.21.15.59:0/2891351761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c809e000 0x7f85c81339f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.722+0000 7f85cde91700 1 -- 172.21.15.59:0/2891351761 >> 172.21.15.59:0/2891351761 conn(0x7f85c8066f50 msgr2=0x7f85c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.722+0000 7f85cde91700 1 -- 172.21.15.59:0/2891351761 shutdown_connections 2023-09-30T22:32:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.722+0000 7f85cde91700 1 -- 172.21.15.59:0/2891351761 wait complete. 2023-09-30T22:32:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.723+0000 7f85cde91700 1 Processor -- start 2023-09-30T22:32:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.724+0000 7f85cde91700 1 -- start start 2023-09-30T22:32:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.724+0000 7f85cde91700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85c809d6f0 0x7f85c81a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.724+0000 7f85cde91700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c809e000 0x7f85c81a55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.724+0000 7f85cde91700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85c809e410 0x7f85c81a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.724+0000 7f85cde91700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c81a7a10 con 0x7f85c809e000 2023-09-30T22:32:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.724+0000 7f85cde91700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80a30d0 con 0x7f85c809e410 2023-09-30T22:32:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.724+0000 7f85cde91700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85c809c710 con 0x7f85c809d6f0 2023-09-30T22:32:11.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.724+0000 7f85c77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85c809d6f0 0x7f85c81a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.724+0000 7f85c6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c809e000 0x7f85c81a55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.724+0000 7f85c77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85c809d6f0 0x7f85c81a5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43078/0 (socket says 172.21.15.59:43078) 2023-09-30T22:32:11.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.724+0000 7f85c77fe700 1 -- 172.21.15.59:0/3517413209 learned_addr learned my addr 172.21.15.59:0/3517413209 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:11.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.724+0000 7f85c7fff700 1 --2- 172.21.15.59:0/3517413209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85c809e410 0x7f85c81a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.725+0000 7f85c6ffd700 1 -- 172.21.15.59:0/3517413209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85c809d6f0 msgr2=0x7f85c81a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.725+0000 7f85c6ffd700 1 --2- 172.21.15.59:0/3517413209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85c809d6f0 0x7f85c81a5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.725+0000 7f85c6ffd700 1 -- 172.21.15.59:0/3517413209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85c809e410 msgr2=0x7f85c81a5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.725+0000 7f85c6ffd700 1 --2- 172.21.15.59:0/3517413209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85c809e410 0x7f85c81a5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.725+0000 7f85c6ffd700 1 -- 172.21.15.59:0/3517413209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc009550 con 0x7f85c809e000 2023-09-30T22:32:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.725+0000 7f85c7fff700 1 --2- 172.21.15.59:0/3517413209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85c809e410 0x7f85c81a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.725+0000 7f85c6ffd700 1 --2- 172.21.15.59:0/3517413209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c809e000 0x7f85c81a55d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f85c806e510 tx=0x7f85bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.725+0000 7f85affff700 1 -- 172.21.15.59:0/3517413209 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc003ba0 con 0x7f85c809e000 2023-09-30T22:32:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.725+0000 7f85affff700 1 -- 172.21.15.59:0/3517413209 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc01f070 con 0x7f85c809e000 2023-09-30T22:32:11.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.725+0000 7f85cde91700 1 -- 172.21.15.59:0/3517413209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c81b84b0 con 0x7f85c809e000 2023-09-30T22:32:11.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.725+0000 7f85affff700 1 -- 172.21.15.59:0/3517413209 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc00b660 con 0x7f85c809e000 2023-09-30T22:32:11.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.725+0000 7f85cde91700 1 -- 172.21.15.59:0/3517413209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c81a92b0 con 0x7f85c809e000 2023-09-30T22:32:11.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.726+0000 7f85cde91700 1 -- 172.21.15.59:0/3517413209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c809d1b0 con 0x7f85c809e000 2023-09-30T22:32:11.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.726+0000 7f85affff700 1 -- 172.21.15.59:0/3517413209 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f85bc021070 con 0x7f85c809e000 2023-09-30T22:32:11.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.727+0000 7f85affff700 1 -- 172.21.15.59:0/3517413209 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f85bc040b20 con 0x7f85c809e000 2023-09-30T22:32:11.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.731+0000 7f85affff700 1 -- 172.21.15.59:0/3517413209 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85bc042e60 con 0x7f85c809e000 2023-09-30T22:32:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.737+0000 7f00b6fa0700 1 Processor -- start 2023-09-30T22:32:11.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.737+0000 7f00b6fa0700 1 -- start start 2023-09-30T22:32:11.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.738+0000 7f00b6fa0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f00b006a770 0x7f00b009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.738+0000 7f00b6fa0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00b013d1f0 0x7f00b013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.738+0000 7f00b6fa0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b009a810 con 0x7f00b009dc30 2023-09-30T22:32:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.738+0000 7f00b6fa0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b006ab40 con 0x7f00b006a770 2023-09-30T22:32:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.738+0000 7f00b6fa0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b009ebc0 con 0x7f00b013d1f0 2023-09-30T22:32:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.738+0000 7f00b553d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00b013d1f0 0x7f00b013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.738+0000 7f00b553d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00b013d1f0 0x7f00b013f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55182/0 (socket says 172.21.15.59:55182) 2023-09-30T22:32:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.738+0000 7f00b553d700 1 -- 172.21.15.59:0/52133877 learned_addr learned my addr 172.21.15.59:0/52133877 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.738+0000 7f00b4d3c700 1 --2- 172.21.15.59:0/52133877 >> v2:172.21.15.59:3300/0 conn(0x7f00b006a770 0x7f00b009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.739+0000 7f00b4d3c700 1 -- 172.21.15.59:0/52133877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00b013d1f0 msgr2=0x7f00b013f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:11.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.739+0000 7f00b4d3c700 1 --2- 172.21.15.59:0/52133877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00b013d1f0 0x7f00b013f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.739+0000 7f00b4d3c700 1 -- 172.21.15.59:0/52133877 >> v1:172.21.15.59:6789/0 conn(0x7f00b009dc30 legacy=0x7f00b009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.739+0000 7f00b4d3c700 1 -- 172.21.15.59:0/52133877 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b009e920 con 0x7f00b006a770 2023-09-30T22:32:11.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.739+0000 7f00b4d3c700 1 --2- 172.21.15.59:0/52133877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00b006a770 0x7f00b009d6f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009840 tx=0x7f00a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71bfe2fd92a112b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:11.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.739+0000 7f00af7fe700 1 -- 172.21.15.59:0/52133877 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4011830 con 0x7f00b006a770 2023-09-30T22:32:11.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.739+0000 7f00af7fe700 1 -- 172.21.15.59:0/52133877 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a4011990 con 0x7f00b006a770 2023-09-30T22:32:11.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.739+0000 7f00af7fe700 1 -- 172.21.15.59:0/52133877 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4011d20 con 0x7f00b006a770 2023-09-30T22:32:11.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.740+0000 7f00b6fa0700 1 -- 172.21.15.59:0/52133877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00b006a770 msgr2=0x7f00b009d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.740+0000 7f00b6fa0700 1 --2- 172.21.15.59:0/52133877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00b006a770 0x7f00b009d6f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009840 tx=0x7f00a4009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:11.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.740+0000 7f00b6fa0700 1 -- 172.21.15.59:0/52133877 shutdown_connections 2023-09-30T22:32:11.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.740+0000 7f00b6fa0700 1 --2- 172.21.15.59:0/52133877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00b006a770 0x7f00b009d6f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.740+0000 7f00b6fa0700 1 --2- 172.21.15.59:0/52133877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00b013d1f0 0x7f00b013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.740+0000 7f00b6fa0700 1 -- 172.21.15.59:0/52133877 >> 172.21.15.59:0/52133877 conn(0x7f00b0066f50 msgr2=0x7f00b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:11.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.740+0000 7f00b6fa0700 1 -- 172.21.15.59:0/52133877 shutdown_connections 2023-09-30T22:32:11.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.740+0000 7f00b6fa0700 1 -- 172.21.15.59:0/52133877 wait complete. 2023-09-30T22:32:11.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.741+0000 7f00b6fa0700 1 Processor -- start 2023-09-30T22:32:11.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.742+0000 7f00b6fa0700 1 -- start start 2023-09-30T22:32:11.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.742+0000 7f00b6fa0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00b006a770 0x7f00b013b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.742+0000 7f00b6fa0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00b009dc30 0x7f00b013bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.742+0000 7f00b6fa0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00b013d1f0 0x7f00b013c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:11.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.742+0000 7f00b6fa0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b011d810 con 0x7f00b013d1f0 2023-09-30T22:32:11.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.743+0000 7f00b6fa0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0135ec0 con 0x7f00b006a770 2023-09-30T22:32:11.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.743+0000 7f00b6fa0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00b011d1e0 con 0x7f00b009dc30 2023-09-30T22:32:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.743+0000 7f00b4d3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00b006a770 0x7f00b013b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.743+0000 7f00b4d3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00b006a770 0x7f00b013b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55194/0 (socket says 172.21.15.59:55194) 2023-09-30T22:32:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.743+0000 7f00b4d3c700 1 -- 172.21.15.59:0/846600974 learned_addr learned my addr 172.21.15.59:0/846600974 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.743+0000 7f00affff700 1 --2- 172.21.15.59:0/846600974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00b009dc30 0x7f00b013bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.743+0000 7f00b553d700 1 --2- 172.21.15.59:0/846600974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00b013d1f0 0x7f00b013c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.743+0000 7f00affff700 1 -- 172.21.15.59:0/846600974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00b006a770 msgr2=0x7f00b013b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.743+0000 7f00affff700 1 --2- 172.21.15.59:0/846600974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00b006a770 0x7f00b013b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.743+0000 7f00affff700 1 -- 172.21.15.59:0/846600974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00b013d1f0 msgr2=0x7f00b013c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.743+0000 7f00affff700 1 --2- 172.21.15.59:0/846600974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00b013d1f0 0x7f00b013c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.743+0000 7f00affff700 1 -- 172.21.15.59:0/846600974 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a40094a0 con 0x7f00b009dc30 2023-09-30T22:32:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.743+0000 7f00b553d700 1 --2- 172.21.15.59:0/846600974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00b013d1f0 0x7f00b013c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.743+0000 7f00b4d3c700 1 --2- 172.21.15.59:0/846600974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00b006a770 0x7f00b013b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.743+0000 7f00affff700 1 --2- 172.21.15.59:0/846600974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00b009dc30 0x7f00b013bca0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f009c00c450 tx=0x7f009c00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.744+0000 7f00ad7fa700 1 -- 172.21.15.59:0/846600974 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c0052d0 con 0x7f00b009dc30 2023-09-30T22:32:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.744+0000 7f00ad7fa700 1 -- 172.21.15.59:0/846600974 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009c005430 con 0x7f00b009dc30 2023-09-30T22:32:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.744+0000 7f00ad7fa700 1 -- 172.21.15.59:0/846600974 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c0038c0 con 0x7f00b009dc30 2023-09-30T22:32:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.744+0000 7f00b6fa0700 1 -- 172.21.15.59:0/846600974 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b009f1a0 con 0x7f00b009dc30 2023-09-30T22:32:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.744+0000 7f00b6fa0700 1 -- 172.21.15.59:0/846600974 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b011eb50 con 0x7f00b009dc30 2023-09-30T22:32:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.745+0000 7f00ad7fa700 1 -- 172.21.15.59:0/846600974 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f009c003a20 con 0x7f00b009dc30 2023-09-30T22:32:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.745+0000 7f00b6fa0700 1 -- 172.21.15.59:0/846600974 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b0074ea0 con 0x7f00b009dc30 2023-09-30T22:32:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.745+0000 7f00ad7fa700 1 -- 172.21.15.59:0/846600974 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f009c03e970 con 0x7f00b009dc30 2023-09-30T22:32:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.750+0000 7f00ad7fa700 1 -- 172.21.15.59:0/846600974 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f009c011590 con 0x7f00b009dc30 2023-09-30T22:32:11.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.871+0000 7fca2a309700 1 -- 172.21.15.59:0/27873814 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fca2411dbf0 con 0x7fca24134ec0 2023-09-30T22:32:11.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.871+0000 7fca20ff9700 1 -- 172.21.15.59:0/27873814 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca2411dbf0 con 0x7fca24134ec0 2023-09-30T22:32:11.871 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:11.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.874+0000 7fca2a309700 1 -- 172.21.15.59:0/27873814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca24134ec0 msgr2=0x7fca2411ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.874+0000 7fca2a309700 1 --2- 172.21.15.59:0/27873814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca24134ec0 0x7fca2411ac50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fca2406f500 tx=0x7fca1800c6e0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.874+0000 7fca2a309700 1 -- 172.21.15.59:0/27873814 shutdown_connections 2023-09-30T22:32:11.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.874+0000 7fca2a309700 1 --2- 172.21.15.59:0/27873814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca2406c0e0 0x7fca2411a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.874+0000 7fca2a309700 1 --2- 172.21.15.59:0/27873814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca241380f0 0x7fca2411b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.874+0000 7fca2a309700 1 --2- 172.21.15.59:0/27873814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca24134ec0 0x7fca2411ac50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.874+0000 7fca2a309700 1 -- 172.21.15.59:0/27873814 >> 172.21.15.59:0/27873814 conn(0x7fca240a4210 msgr2=0x7fca24071960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:11.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.874+0000 7fca2a309700 1 -- 172.21.15.59:0/27873814 shutdown_connections 2023-09-30T22:32:11.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.874+0000 7fca2a309700 1 -- 172.21.15.59:0/27873814 wait complete. 2023-09-30T22:32:11.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.879+0000 7f19eee49700 1 -- 172.21.15.59:0/777305505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f19e8074ea0 con 0x7f19e809e000 2023-09-30T22:32:11.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.879+0000 7f19e57fa700 1 -- 172.21.15.59:0/777305505 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19d40232f0 con 0x7f19e809e000 2023-09-30T22:32:11.879 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:11.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.882+0000 7f19eee49700 1 -- 172.21.15.59:0/777305505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e809e000 msgr2=0x7f19e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.882+0000 7f19eee49700 1 --2- 172.21.15.59:0/777305505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e809e000 0x7f19e806edb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f19d400ebb0 tx=0x7f19d400eec0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.882+0000 7f19eee49700 1 -- 172.21.15.59:0/777305505 shutdown_connections 2023-09-30T22:32:11.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.882+0000 7f19eee49700 1 --2- 172.21.15.59:0/777305505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e809e410 0x7f19e806f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.882+0000 7f19eee49700 1 --2- 172.21.15.59:0/777305505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e809d6f0 0x7f19e806e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.882+0000 7f19eee49700 1 --2- 172.21.15.59:0/777305505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e809e000 0x7f19e806edb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.882+0000 7f19eee49700 1 -- 172.21.15.59:0/777305505 >> 172.21.15.59:0/777305505 conn(0x7f19e8066f50 msgr2=0x7f19e80a21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:11.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.883+0000 7f19eee49700 1 -- 172.21.15.59:0/777305505 shutdown_connections 2023-09-30T22:32:11.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.883+0000 7f19eee49700 1 -- 172.21.15.59:0/777305505 wait complete. 2023-09-30T22:32:11.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:11.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.942+0000 7f85cde91700 1 -- 172.21.15.59:0/3517413209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f85c8074ea0 con 0x7f85c809e000 2023-09-30T22:32:11.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.942+0000 7f85affff700 1 -- 172.21.15.59:0/3517413209 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f85bc00b7c0 con 0x7f85c809e000 2023-09-30T22:32:11.943 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:11.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.945+0000 7f85cde91700 1 -- 172.21.15.59:0/3517413209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c809e000 msgr2=0x7f85c81a55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.945+0000 7f85cde91700 1 --2- 172.21.15.59:0/3517413209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c809e000 0x7f85c81a55d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f85c806e510 tx=0x7f85bc004750 comp rx=0 tx=0).stop 2023-09-30T22:32:11.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.945+0000 7f85cde91700 1 -- 172.21.15.59:0/3517413209 shutdown_connections 2023-09-30T22:32:11.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.945+0000 7f85cde91700 1 --2- 172.21.15.59:0/3517413209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85c809d6f0 0x7f85c81a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.945+0000 7f85cde91700 1 --2- 172.21.15.59:0/3517413209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85c809e410 0x7f85c81a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.945+0000 7f85cde91700 1 --2- 172.21.15.59:0/3517413209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c809e000 0x7f85c81a55d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.945+0000 7f85cde91700 1 -- 172.21.15.59:0/3517413209 >> 172.21.15.59:0/3517413209 conn(0x7f85c8066f50 msgr2=0x7f85c81b9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:11.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.945+0000 7f85cde91700 1 -- 172.21.15.59:0/3517413209 shutdown_connections 2023-09-30T22:32:11.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.945+0000 7f85cde91700 1 -- 172.21.15.59:0/3517413209 wait complete. 2023-09-30T22:32:11.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.959+0000 7f00b6fa0700 1 -- 172.21.15.59:0/846600974 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f00b009a3d0 con 0x7f00b009dc30 2023-09-30T22:32:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.960+0000 7f00ad7fa700 1 -- 172.21.15.59:0/846600974 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f009c017070 con 0x7f00b009dc30 2023-09-30T22:32:11.960 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:11.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.962+0000 7f00b6fa0700 1 -- 172.21.15.59:0/846600974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00b009dc30 msgr2=0x7f00b013bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.962+0000 7f00b6fa0700 1 --2- 172.21.15.59:0/846600974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00b009dc30 0x7f00b013bca0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f009c00c450 tx=0x7f009c00c760 comp rx=0 tx=0).stop 2023-09-30T22:32:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.962+0000 7f00b6fa0700 1 -- 172.21.15.59:0/846600974 shutdown_connections 2023-09-30T22:32:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.962+0000 7f00b6fa0700 1 --2- 172.21.15.59:0/846600974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00b013d1f0 0x7f00b013c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.962+0000 7f00b6fa0700 1 --2- 172.21.15.59:0/846600974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00b006a770 0x7f00b013b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.962+0000 7f00b6fa0700 1 --2- 172.21.15.59:0/846600974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00b009dc30 0x7f00b013bca0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.962+0000 7f00b6fa0700 1 -- 172.21.15.59:0/846600974 >> 172.21.15.59:0/846600974 conn(0x7f00b0066f50 msgr2=0x7f00b009b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.962+0000 7f00b6fa0700 1 -- 172.21.15.59:0/846600974 shutdown_connections 2023-09-30T22:32:11.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:11.962+0000 7f00b6fa0700 1 -- 172.21.15.59:0/846600974 wait complete. 2023-09-30T22:32:11.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:12.890 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:12.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:12.959 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:12.976 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:13.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.043+0000 7f7b5d316700 1 Processor -- start 2023-09-30T22:32:13.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.043+0000 7f7b5d316700 1 -- start start 2023-09-30T22:32:13.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.044+0000 7f7b5d316700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7b581338c0 0x7f7b58133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.044+0000 7f7b5d316700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b5809e560 0x7f7b5813b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.044+0000 7f7b5d316700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5806f720 con 0x7f7b581341d0 2023-09-30T22:32:13.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.044+0000 7f7b5d316700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b58070c80 con 0x7f7b581338c0 2023-09-30T22:32:13.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.044+0000 7f7b5d316700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5806fce0 con 0x7f7b5809e560 2023-09-30T22:32:13.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.044+0000 7f7b577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b5809e560 0x7f7b5813b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.044+0000 7f7b56ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7b581338c0 0x7f7b58133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.044+0000 7f7b56ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7b581338c0 0x7f7b58133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39706/0 (socket says 172.21.15.59:39706) 2023-09-30T22:32:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.044+0000 7f7b577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b5809e560 0x7f7b5813b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43084/0 (socket says 172.21.15.59:43084) 2023-09-30T22:32:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.045+0000 7f7b56ffd700 1 -- 172.21.15.59:0/2292516743 learned_addr learned my addr 172.21.15.59:0/2292516743 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.045+0000 7f7b56ffd700 1 -- 172.21.15.59:0/2292516743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b5809e560 msgr2=0x7f7b5813b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.045+0000 7f7b56ffd700 1 --2- 172.21.15.59:0/2292516743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b5809e560 0x7f7b5813b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.045+0000 7f7b56ffd700 1 -- 172.21.15.59:0/2292516743 >> v1:172.21.15.59:6789/0 conn(0x7f7b581341d0 legacy=0x7f7b5809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.045+0000 7f7b56ffd700 1 -- 172.21.15.59:0/2292516743 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b581336a0 con 0x7f7b581338c0 2023-09-30T22:32:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.045+0000 7f7b56ffd700 1 --2- 172.21.15.59:0/2292516743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b581338c0 0x7f7b58133c90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7b480098f0 tx=0x7f7b48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=decd0eebd5ec893f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.045+0000 7f7b55ffb700 1 -- 172.21.15.59:0/2292516743 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48011830 con 0x7f7b581338c0 2023-09-30T22:32:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.045+0000 7f7b55ffb700 1 -- 172.21.15.59:0/2292516743 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b48011990 con 0x7f7b581338c0 2023-09-30T22:32:13.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.045+0000 7f7b55ffb700 1 -- 172.21.15.59:0/2292516743 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48011d20 con 0x7f7b581338c0 2023-09-30T22:32:13.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.046+0000 7f7b5d316700 1 -- 172.21.15.59:0/2292516743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b581338c0 msgr2=0x7f7b58133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.046+0000 7f7b5d316700 1 --2- 172.21.15.59:0/2292516743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b581338c0 0x7f7b58133c90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7b480098f0 tx=0x7f7b48009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:13.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.046+0000 7f7b5d316700 1 -- 172.21.15.59:0/2292516743 shutdown_connections 2023-09-30T22:32:13.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.046+0000 7f7b5d316700 1 --2- 172.21.15.59:0/2292516743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b5809e560 0x7f7b5813b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.046+0000 7f7b5d316700 1 --2- 172.21.15.59:0/2292516743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b581338c0 0x7f7b58133c90 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.046+0000 7f7b5d316700 1 -- 172.21.15.59:0/2292516743 >> 172.21.15.59:0/2292516743 conn(0x7f7b580a2aa0 msgr2=0x7f7b580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:13.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.046+0000 7f7b5d316700 1 -- 172.21.15.59:0/2292516743 shutdown_connections 2023-09-30T22:32:13.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.046+0000 7f7b5d316700 1 -- 172.21.15.59:0/2292516743 wait complete. 2023-09-30T22:32:13.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.048+0000 7f7b5d316700 1 Processor -- start 2023-09-30T22:32:13.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.048+0000 7f7b5d316700 1 -- start start 2023-09-30T22:32:13.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.049+0000 7f7b5d316700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b5809e560 0x7f7b5811fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.049+0000 7f7b5d316700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b581338c0 0x7f7b581200c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.049+0000 7f7b5d316700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b581341d0 0x7f7b58120600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.049+0000 7f7b5d316700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b58122e10 con 0x7f7b581341d0 2023-09-30T22:32:13.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.049+0000 7f7b5d316700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b58130730 con 0x7f7b581338c0 2023-09-30T22:32:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.049+0000 7f7b5d316700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b58123190 con 0x7f7b5809e560 2023-09-30T22:32:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.049+0000 7f7b56ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b5809e560 0x7f7b5811fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.049+0000 7f7b577fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b581341d0 0x7f7b58120600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.049+0000 7f7b56ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b5809e560 0x7f7b5811fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43088/0 (socket says 172.21.15.59:43088) 2023-09-30T22:32:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.049+0000 7f7b56ffd700 1 -- 172.21.15.59:0/2072766727 learned_addr learned my addr 172.21.15.59:0/2072766727 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.049+0000 7f7b567fc700 1 --2- 172.21.15.59:0/2072766727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b581338c0 0x7f7b581200c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.049+0000 7f7b577fe700 1 -- 172.21.15.59:0/2072766727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b5809e560 msgr2=0x7f7b5811fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.050+0000 7f7b577fe700 1 --2- 172.21.15.59:0/2072766727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b5809e560 0x7f7b5811fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.050+0000 7f7b577fe700 1 -- 172.21.15.59:0/2072766727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b581338c0 msgr2=0x7f7b581200c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.050+0000 7f7b577fe700 1 --2- 172.21.15.59:0/2072766727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b581338c0 0x7f7b581200c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.050+0000 7f7b577fe700 1 -- 172.21.15.59:0/2072766727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b48009550 con 0x7f7b581341d0 2023-09-30T22:32:13.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.050+0000 7f7b56ffd700 1 --2- 172.21.15.59:0/2072766727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b5809e560 0x7f7b5811fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:13.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.050+0000 7f7b577fe700 1 --2- 172.21.15.59:0/2072766727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b581341d0 0x7f7b58120600 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7b50009d90 tx=0x7f7b5000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:13.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.050+0000 7f7b3f7fe700 1 -- 172.21.15.59:0/2072766727 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000cc90 con 0x7f7b581341d0 2023-09-30T22:32:13.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.050+0000 7f7b3f7fe700 1 -- 172.21.15.59:0/2072766727 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5000f040 con 0x7f7b581341d0 2023-09-30T22:32:13.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.050+0000 7f7b3f7fe700 1 -- 172.21.15.59:0/2072766727 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b50014480 con 0x7f7b581341d0 2023-09-30T22:32:13.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.050+0000 7f7b5d316700 1 -- 172.21.15.59:0/2072766727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b58072660 con 0x7f7b581341d0 2023-09-30T22:32:13.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.050+0000 7f7b5d316700 1 -- 172.21.15.59:0/2072766727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b58123700 con 0x7f7b581341d0 2023-09-30T22:32:13.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.051+0000 7f7b5d316700 1 -- 172.21.15.59:0/2072766727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b58074ea0 con 0x7f7b581341d0 2023-09-30T22:32:13.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.052+0000 7f7b3f7fe700 1 -- 172.21.15.59:0/2072766727 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b500145e0 con 0x7f7b581341d0 2023-09-30T22:32:13.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.052+0000 7f7b3f7fe700 1 -- 172.21.15.59:0/2072766727 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7b500406d0 con 0x7f7b581341d0 2023-09-30T22:32:13.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.057+0000 7f7b3f7fe700 1 -- 172.21.15.59:0/2072766727 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b50012910 con 0x7f7b581341d0 2023-09-30T22:32:13.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.093+0000 7fccea638700 1 Processor -- start 2023-09-30T22:32:13.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.093+0000 7fccea638700 1 -- start start 2023-09-30T22:32:13.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.094+0000 7fccea638700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcce409d6f0 0x7fcce409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.094+0000 7fccea638700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce409e000 0x7fcce4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.094+0000 7fccea638700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce409f130 con 0x7fcce409e410 2023-09-30T22:32:13.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.094+0000 7fccea638700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce409f520 con 0x7fcce409e000 2023-09-30T22:32:13.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.094+0000 7fccea638700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcce409e930 con 0x7fcce409d6f0 2023-09-30T22:32:13.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.095+0000 7fcce37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce409e000 0x7fcce4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.095+0000 7fcce8bd5700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcce409e410 0x7fcce4130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44430/0 (socket says 172.21.15.59:44430) 2023-09-30T22:32:13.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.095+0000 7fcce8bd5700 1 -- 172.21.15.59:0/37350640 learned_addr learned my addr 172.21.15.59:0/37350640 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:13.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.095+0000 7fcce3fff700 1 --2- 172.21.15.59:0/37350640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcce409d6f0 0x7fcce409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.095+0000 7fcce2ffd700 1 -- 172.21.15.59:0/37350640 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109616799 0 0) 0x7fcce409f130 con 0x7fcce409e410 2023-09-30T22:32:13.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.095+0000 7fcce2ffd700 1 -- 172.21.15.59:0/37350640 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcccc0035b0 con 0x7fcce409e410 2023-09-30T22:32:13.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.095+0000 7fcce37fe700 1 -- 172.21.15.59:0/37350640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcce409d6f0 msgr2=0x7fcce409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:13.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.095+0000 7fcce37fe700 1 --2- 172.21.15.59:0/37350640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcce409d6f0 0x7fcce409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.095+0000 7fcce37fe700 1 -- 172.21.15.59:0/37350640 >> v1:172.21.15.59:6789/0 conn(0x7fcce409e410 legacy=0x7fcce4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.095+0000 7fcce37fe700 1 -- 172.21.15.59:0/37350640 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce409b2d0 con 0x7fcce409e000 2023-09-30T22:32:13.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.095+0000 7fcce3fff700 1 --2- 172.21.15.59:0/37350640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcce409d6f0 0x7fcce409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:13.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.095+0000 7fcce37fe700 1 --2- 172.21.15.59:0/37350640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce409e000 0x7fcce4130660 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fccd800bb10 tx=0x7fccd800be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d147b38d2f9e74ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:13.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.096+0000 7fcce2ffd700 1 -- 172.21.15.59:0/37350640 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd800dc70 con 0x7fcce409e000 2023-09-30T22:32:13.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.096+0000 7fcce2ffd700 1 -- 172.21.15.59:0/37350640 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd800ddd0 con 0x7fcce409e000 2023-09-30T22:32:13.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.096+0000 7fcce2ffd700 1 -- 172.21.15.59:0/37350640 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8010690 con 0x7fcce409e000 2023-09-30T22:32:13.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.097+0000 7fccea638700 1 -- 172.21.15.59:0/37350640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce409e000 msgr2=0x7fcce4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.097+0000 7fccea638700 1 --2- 172.21.15.59:0/37350640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce409e000 0x7fcce4130660 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fccd800bb10 tx=0x7fccd800be20 comp rx=0 tx=0).stop 2023-09-30T22:32:13.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.097+0000 7fccea638700 1 -- 172.21.15.59:0/37350640 shutdown_connections 2023-09-30T22:32:13.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.097+0000 7fccea638700 1 --2- 172.21.15.59:0/37350640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcce409d6f0 0x7fcce409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.097+0000 7fccea638700 1 --2- 172.21.15.59:0/37350640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce409e000 0x7fcce4130660 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.097+0000 7fccea638700 1 -- 172.21.15.59:0/37350640 >> 172.21.15.59:0/37350640 conn(0x7fcce4066f50 msgr2=0x7fcce409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:13.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.097+0000 7fccea638700 1 -- 172.21.15.59:0/37350640 shutdown_connections 2023-09-30T22:32:13.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.097+0000 7fccea638700 1 -- 172.21.15.59:0/37350640 wait complete. 2023-09-30T22:32:13.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.098+0000 7fccea638700 1 Processor -- start 2023-09-30T22:32:13.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.099+0000 7fccea638700 1 -- start start 2023-09-30T22:32:13.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.099+0000 7fccea638700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce409d6f0 0x7fcce411e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.099+0000 7fccea638700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce409e000 0x7fcce411e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.099+0000 7fccea638700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcce409e410 0x7fcce411eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.099+0000 7fccea638700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4130460 con 0x7fcce409d6f0 2023-09-30T22:32:13.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.099+0000 7fccea638700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce41202b0 con 0x7fcce409e000 2023-09-30T22:32:13.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.099+0000 7fccea638700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4120ee0 con 0x7fcce409e410 2023-09-30T22:32:13.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.099+0000 7fcce37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce409e000 0x7fcce411e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.099+0000 7fcce37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce409e000 0x7fcce411e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55218/0 (socket says 172.21.15.59:55218) 2023-09-30T22:32:13.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.099+0000 7fcce37fe700 1 -- 172.21.15.59:0/3373573980 learned_addr learned my addr 172.21.15.59:0/3373573980 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:13.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.100+0000 7fcce8bd5700 1 --2- 172.21.15.59:0/3373573980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcce409e410 0x7fcce411eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.100+0000 7fcce3fff700 1 --2- 172.21.15.59:0/3373573980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce409d6f0 0x7fcce411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.100+0000 7fcce37fe700 1 -- 172.21.15.59:0/3373573980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcce409e410 msgr2=0x7fcce411eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.100+0000 7fcce37fe700 1 --2- 172.21.15.59:0/3373573980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcce409e410 0x7fcce411eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.100+0000 7fcce37fe700 1 -- 172.21.15.59:0/3373573980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce409d6f0 msgr2=0x7fcce411e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.100+0000 7fcce37fe700 1 --2- 172.21.15.59:0/3373573980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce409d6f0 0x7fcce411e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.100+0000 7fcce37fe700 1 -- 172.21.15.59:0/3373573980 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40094a0 con 0x7fcce409e000 2023-09-30T22:32:13.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.100+0000 7fcce8bd5700 1 --2- 172.21.15.59:0/3373573980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcce409e410 0x7fcce411eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:13.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.100+0000 7fcce3fff700 1 --2- 172.21.15.59:0/3373573980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce409d6f0 0x7fcce411e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:13.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.100+0000 7fcce37fe700 1 --2- 172.21.15.59:0/3373573980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce409e000 0x7fcce411e5c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fccd800b2c0 tx=0x7fccd8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:13.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.100+0000 7fcce0ff9700 1 -- 172.21.15.59:0/3373573980 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd801f070 con 0x7fcce409e000 2023-09-30T22:32:13.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.101+0000 7fcce0ff9700 1 -- 172.21.15.59:0/3373573980 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd8003970 con 0x7fcce409e000 2023-09-30T22:32:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.101+0000 7fcce0ff9700 1 -- 172.21.15.59:0/3373573980 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8003d00 con 0x7fcce409e000 2023-09-30T22:32:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.101+0000 7fccea638700 1 -- 172.21.15.59:0/3373573980 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd800b740 con 0x7fcce409e000 2023-09-30T22:32:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.101+0000 7fccea638700 1 -- 172.21.15.59:0/3373573980 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce40721b0 con 0x7fcce409e000 2023-09-30T22:32:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.102+0000 7fccea638700 1 -- 172.21.15.59:0/3373573980 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce411ac20 con 0x7fcce409e000 2023-09-30T22:32:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.103+0000 7fcce0ff9700 1 -- 172.21.15.59:0/3373573980 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fccd8019400 con 0x7fcce409e000 2023-09-30T22:32:13.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.103+0000 7fcce0ff9700 1 -- 172.21.15.59:0/3373573980 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fccd8042b00 con 0x7fcce409e000 2023-09-30T22:32:13.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.112+0000 7fcce0ff9700 1 -- 172.21.15.59:0/3373573980 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fccd8003e60 con 0x7fcce409e000 2023-09-30T22:32:13.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.126+0000 7f2fecc33700 1 Processor -- start 2023-09-30T22:32:13.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.127+0000 7f2fecc33700 1 -- start start 2023-09-30T22:32:13.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.127+0000 7f2fecc33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fe81316d0 0x7f2fe8131aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.127+0000 7f2fecc33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fe806ec60 0x7f2fe8139740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.127+0000 7f2fecc33700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe8131510 con 0x7f2fe8131fe0 2023-09-30T22:32:13.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.127+0000 7f2fecc33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe8099e70 con 0x7f2fe806ec60 2023-09-30T22:32:13.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.127+0000 7f2fecc33700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe8066680 con 0x7f2fe81316d0 2023-09-30T22:32:13.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.128+0000 7f2fe6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fe806ec60 0x7f2fe8139740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.128+0000 7f2fe6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fe806ec60 0x7f2fe8139740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55234/0 (socket says 172.21.15.59:55234) 2023-09-30T22:32:13.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.128+0000 7f2fe6d9d700 1 -- 172.21.15.59:0/145171431 learned_addr learned my addr 172.21.15.59:0/145171431 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:13.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.128+0000 7f2fe659c700 1 --2- 172.21.15.59:0/145171431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fe81316d0 0x7f2fe8131aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.128+0000 7f2fe559a700 1 -- 172.21.15.59:0/145171431 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197397859 0 0) 0x7f2fe8131510 con 0x7f2fe8131fe0 2023-09-30T22:32:13.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.128+0000 7f2fe6d9d700 1 -- 172.21.15.59:0/145171431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fe81316d0 msgr2=0x7f2fe8131aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:13.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.128+0000 7f2fe6d9d700 1 --2- 172.21.15.59:0/145171431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fe81316d0 0x7f2fe8131aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.128+0000 7f2fe6d9d700 1 -- 172.21.15.59:0/145171431 >> v1:172.21.15.59:6789/0 conn(0x7f2fe8131fe0 legacy=0x7f2fe806e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.128+0000 7f2fe6d9d700 1 -- 172.21.15.59:0/145171431 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe809ee00 con 0x7f2fe806ec60 2023-09-30T22:32:13.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.128+0000 7f2fe6d9d700 1 --2- 172.21.15.59:0/145171431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fe806ec60 0x7f2fe8139740 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009e80 tx=0x7f2fe000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f93463a9d8289ee6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:13.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.129+0000 7f2fe559a700 1 -- 172.21.15.59:0/145171431 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000e070 con 0x7f2fe806ec60 2023-09-30T22:32:13.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.129+0000 7f2fe559a700 1 -- 172.21.15.59:0/145171431 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe000b910 con 0x7f2fe806ec60 2023-09-30T22:32:13.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.129+0000 7f2fe559a700 1 -- 172.21.15.59:0/145171431 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000bcc0 con 0x7f2fe806ec60 2023-09-30T22:32:13.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.129+0000 7f2fecc33700 1 -- 172.21.15.59:0/145171431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fe806ec60 msgr2=0x7f2fe8139740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.129+0000 7f2fecc33700 1 --2- 172.21.15.59:0/145171431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fe806ec60 0x7f2fe8139740 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009e80 tx=0x7f2fe000b330 comp rx=0 tx=0).stop 2023-09-30T22:32:13.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.130+0000 7f2fecc33700 1 -- 172.21.15.59:0/145171431 shutdown_connections 2023-09-30T22:32:13.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.130+0000 7f2fecc33700 1 --2- 172.21.15.59:0/145171431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fe81316d0 0x7f2fe8131aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.130+0000 7f2fecc33700 1 --2- 172.21.15.59:0/145171431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fe806ec60 0x7f2fe8139740 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.130+0000 7f2fecc33700 1 -- 172.21.15.59:0/145171431 >> 172.21.15.59:0/145171431 conn(0x7f2fe80a2aa0 msgr2=0x7f2fe80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:13.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.130+0000 7f2fecc33700 1 -- 172.21.15.59:0/145171431 shutdown_connections 2023-09-30T22:32:13.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.130+0000 7f2fecc33700 1 -- 172.21.15.59:0/145171431 wait complete. 2023-09-30T22:32:13.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.131+0000 7f2fecc33700 1 Processor -- start 2023-09-30T22:32:13.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.131+0000 7f2fecc33700 1 -- start start 2023-09-30T22:32:13.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fecc33700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fe806ec60 0x7f2fe813da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fecc33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fe81316d0 0x7f2fe813ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fecc33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fe8131fe0 0x7f2fe813b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fecc33700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe813e3b0 con 0x7f2fe806ec60 2023-09-30T22:32:13.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fecc33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe809a0b0 con 0x7f2fe81316d0 2023-09-30T22:32:13.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fecc33700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe813e010 con 0x7f2fe8131fe0 2023-09-30T22:32:13.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fe5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fe81316d0 0x7f2fe813ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fe5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fe81316d0 0x7f2fe813ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55242/0 (socket says 172.21.15.59:55242) 2023-09-30T22:32:13.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fe6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fe8131fe0 0x7f2fe813b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fe5d9b700 1 -- 172.21.15.59:0/685191717 learned_addr learned my addr 172.21.15.59:0/685191717 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:13.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fe659c700 1 --2- 172.21.15.59:0/685191717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fe806ec60 0x7f2fe813da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fe5d9b700 1 -- 172.21.15.59:0/685191717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fe8131fe0 msgr2=0x7f2fe813b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fe5d9b700 1 --2- 172.21.15.59:0/685191717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fe8131fe0 0x7f2fe813b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fe5d9b700 1 -- 172.21.15.59:0/685191717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fe806ec60 msgr2=0x7f2fe813da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fe5d9b700 1 --2- 172.21.15.59:0/685191717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fe806ec60 0x7f2fe813da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fe5d9b700 1 -- 172.21.15.59:0/685191717 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe0009b30 con 0x7f2fe81316d0 2023-09-30T22:32:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.132+0000 7f2fe6d9d700 1 --2- 172.21.15.59:0/685191717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fe8131fe0 0x7f2fe813b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:13.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.133+0000 7f2fe5d9b700 1 --2- 172.21.15.59:0/685191717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fe81316d0 0x7f2fe813ac90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00c520 tx=0x7f2fdc00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:13.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.133+0000 7f2fd6ffd700 1 -- 172.21.15.59:0/685191717 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc0054e0 con 0x7f2fe81316d0 2023-09-30T22:32:13.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.133+0000 7f2fd6ffd700 1 -- 172.21.15.59:0/685191717 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc003680 con 0x7f2fe81316d0 2023-09-30T22:32:13.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.133+0000 7f2fd6ffd700 1 -- 172.21.15.59:0/685191717 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc003a30 con 0x7f2fe81316d0 2023-09-30T22:32:13.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.133+0000 7f2fecc33700 1 -- 172.21.15.59:0/685191717 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe813d600 con 0x7f2fe81316d0 2023-09-30T22:32:13.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.133+0000 7f2fecc33700 1 -- 172.21.15.59:0/685191717 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe813c6e0 con 0x7f2fe81316d0 2023-09-30T22:32:13.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.134+0000 7f2fecc33700 1 -- 172.21.15.59:0/685191717 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe813eab0 con 0x7f2fe81316d0 2023-09-30T22:32:13.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.135+0000 7f2fd6ffd700 1 -- 172.21.15.59:0/685191717 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2fdc003b90 con 0x7f2fe81316d0 2023-09-30T22:32:13.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.135+0000 7f2fd6ffd700 1 -- 172.21.15.59:0/685191717 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2fdc03efd0 con 0x7f2fe81316d0 2023-09-30T22:32:13.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.136+0000 7f2657fc9700 1 Processor -- start 2023-09-30T22:32:13.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.137+0000 7f2657fc9700 1 -- start start 2023-09-30T22:32:13.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.137+0000 7f2657fc9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265006ed50 0x7f26501367b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.137+0000 7f2657fc9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265006f140 0x7f2650138d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.137+0000 7f2657fc9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2650099b50 con 0x7f2650066410 2023-09-30T22:32:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.137+0000 7f2657fc9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26500667e0 con 0x7f265006ed50 2023-09-30T22:32:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.137+0000 7f2657fc9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2650099f60 con 0x7f265006f140 2023-09-30T22:32:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.138+0000 7f2655564700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265006ed50 0x7f26501367b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.138+0000 7f2655564700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265006ed50 0x7f26501367b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55244/0 (socket says 172.21.15.59:55244) 2023-09-30T22:32:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.138+0000 7f2655564700 1 -- 172.21.15.59:0/2600771888 learned_addr learned my addr 172.21.15.59:0/2600771888 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.138+0000 7f2656566700 1 --2- 172.21.15.59:0/2600771888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265006f140 0x7f2650138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.138+0000 7f2655564700 1 -- 172.21.15.59:0/2600771888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265006f140 msgr2=0x7f2650138d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.138+0000 7f2655564700 1 --2- 172.21.15.59:0/2600771888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265006f140 0x7f2650138d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.138+0000 7f2655564700 1 -- 172.21.15.59:0/2600771888 >> v1:172.21.15.59:6789/0 conn(0x7f2650066410 legacy=0x7f265006e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.138+0000 7f2655564700 1 -- 172.21.15.59:0/2600771888 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265009a920 con 0x7f265006ed50 2023-09-30T22:32:13.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.138+0000 7f2655564700 1 --2- 172.21.15.59:0/2600771888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265006ed50 0x7f26501367b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2640009920 tx=0x7f2640009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=133dd341b2f9ead2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.144+0000 7f2654d63700 1 -- 172.21.15.59:0/2600771888 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640004230 con 0x7f265006ed50 2023-09-30T22:32:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.144+0000 7f2654d63700 1 -- 172.21.15.59:0/2600771888 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2640004390 con 0x7f265006ed50 2023-09-30T22:32:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.144+0000 7f2654d63700 1 -- 172.21.15.59:0/2600771888 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26400036a0 con 0x7f265006ed50 2023-09-30T22:32:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.144+0000 7f2fd6ffd700 1 -- 172.21.15.59:0/685191717 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2fdc003e40 con 0x7f2fe81316d0 2023-09-30T22:32:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.144+0000 7f2657fc9700 1 -- 172.21.15.59:0/2600771888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265006ed50 msgr2=0x7f26501367b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.144+0000 7f2657fc9700 1 --2- 172.21.15.59:0/2600771888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265006ed50 0x7f26501367b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2640009920 tx=0x7f2640009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.145+0000 7f2657fc9700 1 -- 172.21.15.59:0/2600771888 shutdown_connections 2023-09-30T22:32:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.145+0000 7f2657fc9700 1 --2- 172.21.15.59:0/2600771888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265006f140 0x7f2650138d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.145+0000 7f2657fc9700 1 --2- 172.21.15.59:0/2600771888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265006ed50 0x7f26501367b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.145+0000 7f2657fc9700 1 -- 172.21.15.59:0/2600771888 >> 172.21.15.59:0/2600771888 conn(0x7f26500a2aa0 msgr2=0x7f26500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.145+0000 7f2657fc9700 1 -- 172.21.15.59:0/2600771888 shutdown_connections 2023-09-30T22:32:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.145+0000 7f2657fc9700 1 -- 172.21.15.59:0/2600771888 wait complete. 2023-09-30T22:32:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.146+0000 7f2657fc9700 1 Processor -- start 2023-09-30T22:32:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.146+0000 7f2657fc9700 1 -- start start 2023-09-30T22:32:13.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.147+0000 7f2657fc9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2650066410 0x7f26501368e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.147+0000 7f2657fc9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f265006ed50 0x7f2650136e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.147+0000 7f2657fc9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265006f140 0x7f2650137360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.147+0000 7f2657fc9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26501384f0 con 0x7f265006ed50 2023-09-30T22:32:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.147+0000 7f2657fc9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2650119050 con 0x7f265006f140 2023-09-30T22:32:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.147+0000 7f2657fc9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f265009a1f0 con 0x7f2650066410 2023-09-30T22:32:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.147+0000 7f2655564700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f265006ed50 0x7f2650136e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.147+0000 7f2655564700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f265006ed50 0x7f2650136e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39746/0 (socket says 172.21.15.59:39746) 2023-09-30T22:32:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.147+0000 7f2656566700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265006f140 0x7f2650137360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.147+0000 7f2655564700 1 -- 172.21.15.59:0/2263329744 learned_addr learned my addr 172.21.15.59:0/2263329744 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:13.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.147+0000 7f2655d65700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2650066410 0x7f26501368e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.148+0000 7f2655d65700 1 -- 172.21.15.59:0/2263329744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265006f140 msgr2=0x7f2650137360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.148+0000 7f2655d65700 1 --2- 172.21.15.59:0/2263329744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265006f140 0x7f2650137360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.148+0000 7f2655d65700 1 -- 172.21.15.59:0/2263329744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f265006ed50 msgr2=0x7f2650136e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.148+0000 7f2655d65700 1 --2- 172.21.15.59:0/2263329744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f265006ed50 0x7f2650136e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.148+0000 7f2655d65700 1 -- 172.21.15.59:0/2263329744 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2640009550 con 0x7f2650066410 2023-09-30T22:32:13.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.148+0000 7f2655564700 1 --2- 172.21.15.59:0/2263329744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f265006ed50 0x7f2650136e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:13.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.148+0000 7f2655d65700 1 --2- 172.21.15.59:0/2263329744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2650066410 0x7f26501368e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f264c00b440 tx=0x7f264c009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:13.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.148+0000 7f26467fc700 1 -- 172.21.15.59:0/2263329744 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c011620 con 0x7f2650066410 2023-09-30T22:32:13.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.148+0000 7f26467fc700 1 -- 172.21.15.59:0/2263329744 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c0117a0 con 0x7f2650066410 2023-09-30T22:32:13.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.148+0000 7f2657fc9700 1 -- 172.21.15.59:0/2263329744 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2650072290 con 0x7f2650066410 2023-09-30T22:32:13.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.148+0000 7f26467fc700 1 -- 172.21.15.59:0/2263329744 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c011b50 con 0x7f2650066410 2023-09-30T22:32:13.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.148+0000 7f2657fc9700 1 -- 172.21.15.59:0/2263329744 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265011a3a0 con 0x7f2650066410 2023-09-30T22:32:13.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.149+0000 7f26467fc700 1 -- 172.21.15.59:0/2263329744 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f264c011cb0 con 0x7f2650066410 2023-09-30T22:32:13.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.149+0000 7f26467fc700 1 -- 172.21.15.59:0/2263329744 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f264c03f5c0 con 0x7f2650066410 2023-09-30T22:32:13.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.151+0000 7f2657fc9700 1 -- 172.21.15.59:0/2263329744 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2650071900 con 0x7f2650066410 2023-09-30T22:32:13.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.156+0000 7f26467fc700 1 -- 172.21.15.59:0/2263329744 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f264c015020 con 0x7f2650066410 2023-09-30T22:32:13.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.280+0000 7f7b5d316700 1 -- 172.21.15.59:0/2072766727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7b58121010 con 0x7f7b581341d0 2023-09-30T22:32:13.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.281+0000 7f7b3f7fe700 1 -- 172.21.15.59:0/2072766727 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b5002a090 con 0x7f7b581341d0 2023-09-30T22:32:13.281 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:13.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.283+0000 7f7b5d316700 1 -- 172.21.15.59:0/2072766727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b581341d0 msgr2=0x7f7b58120600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.283+0000 7f7b5d316700 1 --2- 172.21.15.59:0/2072766727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b581341d0 0x7f7b58120600 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7b50009d90 tx=0x7f7b5000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.283+0000 7f7b5d316700 1 -- 172.21.15.59:0/2072766727 shutdown_connections 2023-09-30T22:32:13.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.283+0000 7f7b5d316700 1 --2- 172.21.15.59:0/2072766727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b5809e560 0x7f7b5811fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.283+0000 7f7b5d316700 1 --2- 172.21.15.59:0/2072766727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b581341d0 0x7f7b58120600 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.283+0000 7f7b5d316700 1 --2- 172.21.15.59:0/2072766727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b581338c0 0x7f7b581200c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.283+0000 7f7b5d316700 1 -- 172.21.15.59:0/2072766727 >> 172.21.15.59:0/2072766727 conn(0x7f7b580a2aa0 msgr2=0x7f7b581314c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:13.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.283+0000 7f7b5d316700 1 -- 172.21.15.59:0/2072766727 shutdown_connections 2023-09-30T22:32:13.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.283+0000 7f7b5d316700 1 -- 172.21.15.59:0/2072766727 wait complete. 2023-09-30T22:32:13.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:13.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.324+0000 7fccea638700 1 -- 172.21.15.59:0/3373573980 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcce4074ea0 con 0x7fcce409e000 2023-09-30T22:32:13.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.325+0000 7fcce0ff9700 1 -- 172.21.15.59:0/3373573980 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fccd8028070 con 0x7fcce409e000 2023-09-30T22:32:13.325 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:13.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.327+0000 7fccea638700 1 -- 172.21.15.59:0/3373573980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce409e000 msgr2=0x7fcce411e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.327+0000 7fccea638700 1 --2- 172.21.15.59:0/3373573980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce409e000 0x7fcce411e5c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fccd800b2c0 tx=0x7fccd8004750 comp rx=0 tx=0).stop 2023-09-30T22:32:13.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.327+0000 7fccea638700 1 -- 172.21.15.59:0/3373573980 shutdown_connections 2023-09-30T22:32:13.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.327+0000 7fccea638700 1 --2- 172.21.15.59:0/3373573980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcce409e410 0x7fcce411eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.327+0000 7fccea638700 1 --2- 172.21.15.59:0/3373573980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce409d6f0 0x7fcce411e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.327+0000 7fccea638700 1 --2- 172.21.15.59:0/3373573980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce409e000 0x7fcce411e5c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.327+0000 7fccea638700 1 -- 172.21.15.59:0/3373573980 >> 172.21.15.59:0/3373573980 conn(0x7fcce4066f50 msgr2=0x7fcce4130a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:13.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.327+0000 7fccea638700 1 -- 172.21.15.59:0/3373573980 shutdown_connections 2023-09-30T22:32:13.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.327+0000 7fccea638700 1 -- 172.21.15.59:0/3373573980 wait complete. 2023-09-30T22:32:13.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:13.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.371+0000 7f2fecc33700 1 -- 172.21.15.59:0/685191717 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2fe813c9c0 con 0x7f2fe81316d0 2023-09-30T22:32:13.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.372+0000 7f2fd6ffd700 1 -- 172.21.15.59:0/685191717 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2fdc017020 con 0x7f2fe81316d0 2023-09-30T22:32:13.373 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:13.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.374+0000 7f2fecc33700 1 -- 172.21.15.59:0/685191717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fe81316d0 msgr2=0x7f2fe813ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.374+0000 7f2fecc33700 1 --2- 172.21.15.59:0/685191717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fe81316d0 0x7f2fe813ac90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00c520 tx=0x7f2fdc00c830 comp rx=0 tx=0).stop 2023-09-30T22:32:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.374+0000 7f2fecc33700 1 -- 172.21.15.59:0/685191717 shutdown_connections 2023-09-30T22:32:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.374+0000 7f2fecc33700 1 --2- 172.21.15.59:0/685191717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fe8131fe0 0x7f2fe813b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.374+0000 7f2fecc33700 1 --2- 172.21.15.59:0/685191717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fe806ec60 0x7f2fe813da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.374+0000 7f2fecc33700 1 --2- 172.21.15.59:0/685191717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fe81316d0 0x7f2fe813ac90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.374+0000 7f2fecc33700 1 -- 172.21.15.59:0/685191717 >> 172.21.15.59:0/685191717 conn(0x7f2fe80a2aa0 msgr2=0x7f2fe812f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.374+0000 7f2fecc33700 1 -- 172.21.15.59:0/685191717 shutdown_connections 2023-09-30T22:32:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.374+0000 7f2fecc33700 1 -- 172.21.15.59:0/685191717 wait complete. 2023-09-30T22:32:13.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.383+0000 7f2657fc9700 1 -- 172.21.15.59:0/2263329744 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2650139210 con 0x7f2650066410 2023-09-30T22:32:13.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.383+0000 7f26467fc700 1 -- 172.21.15.59:0/2263329744 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f264c029090 con 0x7f2650066410 2023-09-30T22:32:13.384 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:13.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.385+0000 7f2657fc9700 1 -- 172.21.15.59:0/2263329744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2650066410 msgr2=0x7f26501368e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:13.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.385+0000 7f2657fc9700 1 --2- 172.21.15.59:0/2263329744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2650066410 0x7f26501368e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f264c00b440 tx=0x7f264c009f90 comp rx=0 tx=0).stop 2023-09-30T22:32:13.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.385+0000 7f2657fc9700 1 -- 172.21.15.59:0/2263329744 shutdown_connections 2023-09-30T22:32:13.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.385+0000 7f2657fc9700 1 --2- 172.21.15.59:0/2263329744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2650066410 0x7f26501368e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.385+0000 7f2657fc9700 1 --2- 172.21.15.59:0/2263329744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265006f140 0x7f2650137360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.385+0000 7f2657fc9700 1 --2- 172.21.15.59:0/2263329744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f265006ed50 0x7f2650136e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:13.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.385+0000 7f2657fc9700 1 -- 172.21.15.59:0/2263329744 >> 172.21.15.59:0/2263329744 conn(0x7f26500a2aa0 msgr2=0x7f26500a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:13.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.385+0000 7f2657fc9700 1 -- 172.21.15.59:0/2263329744 shutdown_connections 2023-09-30T22:32:13.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:13.385+0000 7f2657fc9700 1 -- 172.21.15.59:0/2263329744 wait complete. 2023-09-30T22:32:13.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:13.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:14.299 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:14.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:14.389 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:14.400 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:14.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.457+0000 7f8b52311700 1 Processor -- start 2023-09-30T22:32:14.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.457+0000 7f8b52311700 1 -- start start 2023-09-30T22:32:14.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.457+0000 7f8b52311700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c1316c0 0x7f8b4c131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.457+0000 7f8b52311700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b4c09d9f0 0x7f8b4c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.458+0000 7f8b52311700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c09e130 con 0x7f8b4c06acb0 2023-09-30T22:32:14.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.458+0000 7f8b52311700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4c1312b0 con 0x7f8b4c09d9f0 2023-09-30T22:32:14.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.458+0000 7f8b52311700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c09f6e0 con 0x7f8b4c1316c0 2023-09-30T22:32:14.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.458+0000 7f8b4bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c1316c0 0x7f8b4c131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.458+0000 7f8b4bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c1316c0 0x7f8b4c131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45946/0 (socket says 172.21.15.59:45946) 2023-09-30T22:32:14.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.458+0000 7f8b4bfff700 1 -- 172.21.15.59:0/1649190443 learned_addr learned my addr 172.21.15.59:0/1649190443 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:14.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.458+0000 7f8b4bfff700 1 -- 172.21.15.59:0/1649190443 >> v2:172.21.15.59:3300/0 conn(0x7f8b4c09d9f0 msgr2=0x7f8b4c06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:14.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.458+0000 7f8b4bfff700 1 --2- 172.21.15.59:0/1649190443 >> v2:172.21.15.59:3300/0 conn(0x7f8b4c09d9f0 0x7f8b4c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.458+0000 7f8b4bfff700 1 -- 172.21.15.59:0/1649190443 >> v1:172.21.15.59:6789/0 conn(0x7f8b4c06acb0 legacy=0x7f8b4c138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:14.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.458+0000 7f8b4bfff700 1 -- 172.21.15.59:0/1649190443 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c09e760 con 0x7f8b4c1316c0 2023-09-30T22:32:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.458+0000 7f8b4bfff700 1 --2- 172.21.15.59:0/1649190443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c1316c0 0x7f8b4c131a90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0098f0 tx=0x7f8b3c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdb8bc13dfa76994 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.458+0000 7f8b4affd700 1 -- 172.21.15.59:0/1649190443 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c004230 con 0x7f8b4c1316c0 2023-09-30T22:32:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.459+0000 7f8b4affd700 1 -- 172.21.15.59:0/1649190443 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c004390 con 0x7f8b4c1316c0 2023-09-30T22:32:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.459+0000 7f8b4affd700 1 -- 172.21.15.59:0/1649190443 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0036a0 con 0x7f8b4c1316c0 2023-09-30T22:32:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.459+0000 7f8b52311700 1 -- 172.21.15.59:0/1649190443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c1316c0 msgr2=0x7f8b4c131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.459+0000 7f8b52311700 1 --2- 172.21.15.59:0/1649190443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c1316c0 0x7f8b4c131a90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0098f0 tx=0x7f8b3c009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.459+0000 7f8b52311700 1 -- 172.21.15.59:0/1649190443 shutdown_connections 2023-09-30T22:32:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.459+0000 7f8b52311700 1 --2- 172.21.15.59:0/1649190443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c1316c0 0x7f8b4c131a90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.459+0000 7f8b52311700 1 --2- 172.21.15.59:0/1649190443 >> v2:172.21.15.59:3300/0 conn(0x7f8b4c09d9f0 0x7f8b4c06a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.459+0000 7f8b52311700 1 -- 172.21.15.59:0/1649190443 >> 172.21.15.59:0/1649190443 conn(0x7f8b4c066f50 msgr2=0x7f8b4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:14.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.459+0000 7f8b52311700 1 -- 172.21.15.59:0/1649190443 shutdown_connections 2023-09-30T22:32:14.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.459+0000 7f8b52311700 1 -- 172.21.15.59:0/1649190443 wait complete. 2023-09-30T22:32:14.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.460+0000 7f8b52311700 1 Processor -- start 2023-09-30T22:32:14.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.461+0000 7f8b52311700 1 -- start start 2023-09-30T22:32:14.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.461+0000 7f8b52311700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c06acb0 0x7f8b4c070c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.461+0000 7f8b52311700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b4c09d9f0 0x7f8b4c071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.461+0000 7f8b52311700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b4c1316c0 0x7f8b4c071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.461+0000 7f8b52311700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c11b2e0 con 0x7f8b4c1316c0 2023-09-30T22:32:14.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.461+0000 7f8b52311700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c11bd40 con 0x7f8b4c09d9f0 2023-09-30T22:32:14.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.461+0000 7f8b52311700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c072000 con 0x7f8b4c06acb0 2023-09-30T22:32:14.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.461+0000 7f8b4bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c06acb0 0x7f8b4c070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.461+0000 7f8b4bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c06acb0 0x7f8b4c070c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45956/0 (socket says 172.21.15.59:45956) 2023-09-30T22:32:14.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.461+0000 7f8b4bfff700 1 -- 172.21.15.59:0/1190330583 learned_addr learned my addr 172.21.15.59:0/1190330583 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:14.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.461+0000 7f8b4b7fe700 1 --2- 172.21.15.59:0/1190330583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b4c09d9f0 0x7f8b4c071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.462+0000 7f8b508ae700 1 --2- 172.21.15.59:0/1190330583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b4c1316c0 0x7f8b4c071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.462+0000 7f8b4b7fe700 1 -- 172.21.15.59:0/1190330583 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c06acb0 msgr2=0x7f8b4c070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.462+0000 7f8b4b7fe700 1 --2- 172.21.15.59:0/1190330583 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c06acb0 0x7f8b4c070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.462+0000 7f8b4b7fe700 1 -- 172.21.15.59:0/1190330583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b4c1316c0 msgr2=0x7f8b4c071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.462+0000 7f8b4b7fe700 1 --2- 172.21.15.59:0/1190330583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b4c1316c0 0x7f8b4c071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.462+0000 7f8b4b7fe700 1 -- 172.21.15.59:0/1190330583 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c009550 con 0x7f8b4c09d9f0 2023-09-30T22:32:14.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.462+0000 7f8b4b7fe700 1 --2- 172.21.15.59:0/1190330583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b4c09d9f0 0x7f8b4c071150 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c06deb0 tx=0x7f8b40008c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:14.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.462+0000 7f8b48ff9700 1 -- 172.21.15.59:0/1190330583 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000c780 con 0x7f8b4c09d9f0 2023-09-30T22:32:14.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.463+0000 7f8b48ff9700 1 -- 172.21.15.59:0/1190330583 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4000a040 con 0x7f8b4c09d9f0 2023-09-30T22:32:14.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.463+0000 7f8b48ff9700 1 -- 172.21.15.59:0/1190330583 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000cb00 con 0x7f8b4c09d9f0 2023-09-30T22:32:14.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.463+0000 7f8b52311700 1 -- 172.21.15.59:0/1190330583 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4c119ab0 con 0x7f8b4c09d9f0 2023-09-30T22:32:14.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.463+0000 7f8b52311700 1 -- 172.21.15.59:0/1190330583 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c119800 con 0x7f8b4c09d9f0 2023-09-30T22:32:14.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.464+0000 7f8b48ff9700 1 -- 172.21.15.59:0/1190330583 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b4000cc60 con 0x7f8b4c09d9f0 2023-09-30T22:32:14.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.464+0000 7f8b48ff9700 1 -- 172.21.15.59:0/1190330583 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8b4003f0c0 con 0x7f8b4c09d9f0 2023-09-30T22:32:14.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.464+0000 7f8b52311700 1 -- 172.21.15.59:0/1190330583 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4c12b8e0 con 0x7f8b4c09d9f0 2023-09-30T22:32:14.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.469+0000 7f8b48ff9700 1 -- 172.21.15.59:0/1190330583 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b40015d80 con 0x7f8b4c09d9f0 2023-09-30T22:32:14.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.492+0000 7fc785e49700 1 Processor -- start 2023-09-30T22:32:14.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.492+0000 7fc785e49700 1 -- start start 2023-09-30T22:32:14.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.493+0000 7fc785e49700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc7800a0a30 0x7fc7800a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.493+0000 7fc785e49700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc780134170 0x7fc78013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.493+0000 7fc785e49700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78009edd0 con 0x7fc7800a1340 2023-09-30T22:32:14.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.493+0000 7fc785e49700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78009e1f0 con 0x7fc7800a0a30 2023-09-30T22:32:14.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.493+0000 7fc785e49700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc78009dc50 con 0x7fc780134170 2023-09-30T22:32:14.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.493+0000 7fc77f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc7800a0a30 0x7fc7800a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.493+0000 7fc77f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc7800a0a30 0x7fc7800a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49644/0 (socket says 172.21.15.59:49644) 2023-09-30T22:32:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.493+0000 7fc77f7fe700 1 -- 172.21.15.59:0/1507021929 learned_addr learned my addr 172.21.15.59:0/1507021929 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.493+0000 7fc77ffff700 1 --2- 172.21.15.59:0/1507021929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc780134170 0x7fc78013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.493+0000 7fc77ffff700 1 -- 172.21.15.59:0/1507021929 >> v2:172.21.15.59:3300/0 conn(0x7fc7800a0a30 msgr2=0x7fc7800a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.493+0000 7fc77ffff700 1 --2- 172.21.15.59:0/1507021929 >> v2:172.21.15.59:3300/0 conn(0x7fc7800a0a30 0x7fc7800a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.493+0000 7fc77ffff700 1 -- 172.21.15.59:0/1507021929 >> v1:172.21.15.59:6789/0 conn(0x7fc7800a1340 legacy=0x7fc780133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.493+0000 7fc77ffff700 1 -- 172.21.15.59:0/1507021929 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7800a1fe0 con 0x7fc780134170 2023-09-30T22:32:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.494+0000 7fc77ffff700 1 --2- 172.21.15.59:0/1507021929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc780134170 0x7fc78013bd30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc778009840 tx=0x7fc778009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=532fc7617ed7e29c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.494+0000 7fc77e7fc700 1 -- 172.21.15.59:0/1507021929 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778004230 con 0x7fc780134170 2023-09-30T22:32:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.494+0000 7fc77e7fc700 1 -- 172.21.15.59:0/1507021929 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc778004390 con 0x7fc780134170 2023-09-30T22:32:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.494+0000 7fc77e7fc700 1 -- 172.21.15.59:0/1507021929 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7780036a0 con 0x7fc780134170 2023-09-30T22:32:14.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.495+0000 7fc785e49700 1 -- 172.21.15.59:0/1507021929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc780134170 msgr2=0x7fc78013bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.495+0000 7fc785e49700 1 --2- 172.21.15.59:0/1507021929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc780134170 0x7fc78013bd30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc778009840 tx=0x7fc778009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:14.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.495+0000 7fc785e49700 1 -- 172.21.15.59:0/1507021929 shutdown_connections 2023-09-30T22:32:14.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.495+0000 7fc785e49700 1 --2- 172.21.15.59:0/1507021929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc780134170 0x7fc78013bd30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.495+0000 7fc785e49700 1 --2- 172.21.15.59:0/1507021929 >> v2:172.21.15.59:3300/0 conn(0x7fc7800a0a30 0x7fc7800a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.495+0000 7fc785e49700 1 -- 172.21.15.59:0/1507021929 >> 172.21.15.59:0/1507021929 conn(0x7fc7800a6550 msgr2=0x7fc7800a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:14.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.495+0000 7fc785e49700 1 -- 172.21.15.59:0/1507021929 shutdown_connections 2023-09-30T22:32:14.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.495+0000 7fc785e49700 1 -- 172.21.15.59:0/1507021929 wait complete. 2023-09-30T22:32:14.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.496+0000 7fc785e49700 1 Processor -- start 2023-09-30T22:32:14.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.497+0000 7fc785e49700 1 -- start start 2023-09-30T22:32:14.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.497+0000 7fc785e49700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7800a0a30 0x7fc78011e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.497+0000 7fc785e49700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7800a1340 0x7fc78011ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.497+0000 7fc785e49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc780134170 0x7fc78011f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.497+0000 7fc785e49700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc780121890 con 0x7fc7800a0a30 2023-09-30T22:32:14.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.497+0000 7fc785e49700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc780132fb0 con 0x7fc780134170 2023-09-30T22:32:14.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.497+0000 7fc785e49700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800a0220 con 0x7fc7800a1340 2023-09-30T22:32:14.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.498+0000 7fc77f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7800a0a30 0x7fc78011e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.498+0000 7fc77ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc780134170 0x7fc78011f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.498+0000 7fc77f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7800a0a30 0x7fc78011e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49650/0 (socket says 172.21.15.59:49650) 2023-09-30T22:32:14.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.498+0000 7fc77f7fe700 1 -- 172.21.15.59:0/1467576497 learned_addr learned my addr 172.21.15.59:0/1467576497 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:14.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.498+0000 7fc77effd700 1 --2- 172.21.15.59:0/1467576497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7800a1340 0x7fc78011ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.498+0000 7fc77f7fe700 1 -- 172.21.15.59:0/1467576497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7800a1340 msgr2=0x7fc78011ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.498+0000 7fc77f7fe700 1 --2- 172.21.15.59:0/1467576497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7800a1340 0x7fc78011ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.498+0000 7fc77f7fe700 1 -- 172.21.15.59:0/1467576497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc780134170 msgr2=0x7fc78011f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.498+0000 7fc77f7fe700 1 --2- 172.21.15.59:0/1467576497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc780134170 0x7fc78011f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.498+0000 7fc77f7fe700 1 -- 172.21.15.59:0/1467576497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7780094a0 con 0x7fc7800a0a30 2023-09-30T22:32:14.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.498+0000 7fc77f7fe700 1 --2- 172.21.15.59:0/1467576497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7800a0a30 0x7fc78011e700 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc7700070b0 tx=0x7fc77000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:14.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.498+0000 7fc767fff700 1 -- 172.21.15.59:0/1467576497 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77000db10 con 0x7fc7800a0a30 2023-09-30T22:32:14.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.499+0000 7fc767fff700 1 -- 172.21.15.59:0/1467576497 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77000f040 con 0x7fc7800a0a30 2023-09-30T22:32:14.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.499+0000 7fc767fff700 1 -- 172.21.15.59:0/1467576497 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77000de90 con 0x7fc7800a0a30 2023-09-30T22:32:14.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.499+0000 7fc785e49700 1 -- 172.21.15.59:0/1467576497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7800a25e0 con 0x7fc7800a0a30 2023-09-30T22:32:14.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.499+0000 7fc785e49700 1 -- 172.21.15.59:0/1467576497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc780120a70 con 0x7fc7800a0a30 2023-09-30T22:32:14.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.500+0000 7fc767fff700 1 -- 172.21.15.59:0/1467576497 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc770015400 con 0x7fc7800a0a30 2023-09-30T22:32:14.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.500+0000 7fc767fff700 1 -- 172.21.15.59:0/1467576497 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc77003f4e0 con 0x7fc7800a0a30 2023-09-30T22:32:14.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.500+0000 7fc785e49700 1 -- 172.21.15.59:0/1467576497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7801202e0 con 0x7fc7800a0a30 2023-09-30T22:32:14.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.505+0000 7fc767fff700 1 -- 172.21.15.59:0/1467576497 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc77001a020 con 0x7fc7800a0a30 2023-09-30T22:32:14.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.539+0000 7f0cfee1d700 1 Processor -- start 2023-09-30T22:32:14.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.540+0000 7f0cfee1d700 1 -- start start 2023-09-30T22:32:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.540+0000 7f0cfee1d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf80a0a30 0x7f0cf80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.540+0000 7f0cfee1d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf8134170 0x7f0cf813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.540+0000 7f0cfee1d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf809edd0 con 0x7f0cf80a1340 2023-09-30T22:32:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.540+0000 7f0cfee1d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf809e1f0 con 0x7f0cf8134170 2023-09-30T22:32:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.540+0000 7f0cfee1d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf809dc50 con 0x7f0cf80a0a30 2023-09-30T22:32:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.540+0000 7f0cfd3ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf8134170 0x7f0cf813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.540+0000 7f0cf7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0cf80a1340 0x7f0cf8133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39732/0 (socket says 172.21.15.59:39732) 2023-09-30T22:32:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.540+0000 7f0cf7fff700 1 -- 172.21.15.59:0/813871351 learned_addr learned my addr 172.21.15.59:0/813871351 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.540+0000 7f0cfcbb9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf80a0a30 0x7f0cf80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.541+0000 7f0cfcbb9700 1 -- 172.21.15.59:0/813871351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf8134170 msgr2=0x7f0cf813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:14.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.541+0000 7f0cfcbb9700 1 --2- 172.21.15.59:0/813871351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf8134170 0x7f0cf813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.541+0000 7f0cfcbb9700 1 -- 172.21.15.59:0/813871351 >> v1:172.21.15.59:6789/0 conn(0x7f0cf80a1340 legacy=0x7f0cf8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.541+0000 7f0cfcbb9700 1 -- 172.21.15.59:0/813871351 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf80a1fe0 con 0x7f0cf80a0a30 2023-09-30T22:32:14.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.541+0000 7f0cf77fe700 1 -- 172.21.15.59:0/813871351 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122552967 0 0) 0x7f0cf809edd0 con 0x7f0cf80a1340 2023-09-30T22:32:14.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.541+0000 7f0cfcbb9700 1 --2- 172.21.15.59:0/813871351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf80a0a30 0x7f0cf80a0e00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009870 tx=0x7f0cec009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88f9287c97bfc188 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:14.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.541+0000 7f0cf77fe700 1 -- 172.21.15.59:0/813871351 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec011830 con 0x7f0cf80a0a30 2023-09-30T22:32:14.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.541+0000 7f0cf77fe700 1 -- 172.21.15.59:0/813871351 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec011990 con 0x7f0cf80a0a30 2023-09-30T22:32:14.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.541+0000 7f0cf77fe700 1 -- 172.21.15.59:0/813871351 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec011d20 con 0x7f0cf80a0a30 2023-09-30T22:32:14.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.542+0000 7f0cfee1d700 1 -- 172.21.15.59:0/813871351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf80a0a30 msgr2=0x7f0cf80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.542+0000 7f0cfee1d700 1 --2- 172.21.15.59:0/813871351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf80a0a30 0x7f0cf80a0e00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009870 tx=0x7f0cec009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:14.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.542+0000 7f0cfee1d700 1 -- 172.21.15.59:0/813871351 shutdown_connections 2023-09-30T22:32:14.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.542+0000 7f0cfee1d700 1 --2- 172.21.15.59:0/813871351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf80a0a30 0x7f0cf80a0e00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.542+0000 7f0cfee1d700 1 --2- 172.21.15.59:0/813871351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf8134170 0x7f0cf813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.542+0000 7f0cfee1d700 1 -- 172.21.15.59:0/813871351 >> 172.21.15.59:0/813871351 conn(0x7f0cf80a6550 msgr2=0x7f0cf80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:14.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.542+0000 7f0cfee1d700 1 -- 172.21.15.59:0/813871351 shutdown_connections 2023-09-30T22:32:14.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.542+0000 7f0cfee1d700 1 -- 172.21.15.59:0/813871351 wait complete. 2023-09-30T22:32:14.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.543+0000 7f0cfee1d700 1 Processor -- start 2023-09-30T22:32:14.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.543+0000 7f0cfee1d700 1 -- start start 2023-09-30T22:32:14.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.544+0000 7f0cfee1d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf80a0a30 0x7f0cf806dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.544+0000 7f0cfee1d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a1340 0x7f0cf806e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.544+0000 7f0cfee1d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf8134170 0x7f0cf806e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.544+0000 7f0cfee1d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf806f5f0 con 0x7f0cf8134170 2023-09-30T22:32:14.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.544+0000 7f0cfee1d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf812b0b0 con 0x7f0cf80a1340 2023-09-30T22:32:14.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.544+0000 7f0cfee1d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf806ef50 con 0x7f0cf80a0a30 2023-09-30T22:32:14.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.544+0000 7f0cf7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a1340 0x7f0cf806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.544+0000 7f0cfcbb9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf80a0a30 0x7f0cf806dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.544+0000 7f0cf7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a1340 0x7f0cf806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42658/0 (socket says 172.21.15.59:42658) 2023-09-30T22:32:14.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.544+0000 7f0cf7fff700 1 -- 172.21.15.59:0/1903639749 learned_addr learned my addr 172.21.15.59:0/1903639749 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:14.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.544+0000 7f0cfd3ba700 1 --2- 172.21.15.59:0/1903639749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf8134170 0x7f0cf806e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.544+0000 7f0cf7fff700 1 -- 172.21.15.59:0/1903639749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf80a0a30 msgr2=0x7f0cf806dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.544+0000 7f0cf7fff700 1 --2- 172.21.15.59:0/1903639749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf80a0a30 0x7f0cf806dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.544+0000 7f0cf7fff700 1 -- 172.21.15.59:0/1903639749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf8134170 msgr2=0x7f0cf806e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.545+0000 7f0cf7fff700 1 --2- 172.21.15.59:0/1903639749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf8134170 0x7f0cf806e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.545+0000 7f0cf7fff700 1 -- 172.21.15.59:0/1903639749 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec0094a0 con 0x7f0cf80a1340 2023-09-30T22:32:14.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.545+0000 7f0cf7fff700 1 --2- 172.21.15.59:0/1903639749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a1340 0x7f0cf806e000 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40011e0 tx=0x7f0ce400c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:14.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.545+0000 7f0cf57fa700 1 -- 172.21.15.59:0/1903639749 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4004a80 con 0x7f0cf80a1340 2023-09-30T22:32:14.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.545+0000 7f0cf57fa700 1 -- 172.21.15.59:0/1903639749 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce4004be0 con 0x7f0cf80a1340 2023-09-30T22:32:14.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.545+0000 7f0cfee1d700 1 -- 172.21.15.59:0/1903639749 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf80a25e0 con 0x7f0cf80a1340 2023-09-30T22:32:14.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.545+0000 7f0cf57fa700 1 -- 172.21.15.59:0/1903639749 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40070d0 con 0x7f0cf80a1340 2023-09-30T22:32:14.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.545+0000 7f0cfee1d700 1 -- 172.21.15.59:0/1903639749 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf8071220 con 0x7f0cf80a1340 2023-09-30T22:32:14.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.546+0000 7f0cfee1d700 1 -- 172.21.15.59:0/1903639749 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf8070ec0 con 0x7f0cf80a1340 2023-09-30T22:32:14.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.547+0000 7f0cf57fa700 1 -- 172.21.15.59:0/1903639749 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ce4007230 con 0x7f0cf80a1340 2023-09-30T22:32:14.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.547+0000 7f0cf57fa700 1 -- 172.21.15.59:0/1903639749 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0ce4061320 con 0x7f0cf80a1340 2023-09-30T22:32:14.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.552+0000 7f0cf57fa700 1 -- 172.21.15.59:0/1903639749 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cf8070ec0 con 0x7f0cf80a1340 2023-09-30T22:32:14.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.606+0000 7f0dc75d8700 1 Processor -- start 2023-09-30T22:32:14.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.606+0000 7f0dc75d8700 1 -- start start 2023-09-30T22:32:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.607+0000 7f0dc75d8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0dc00a1510 0x7f0dc0138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.607+0000 7f0dc75d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dc0139250 0x7f0dc013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.607+0000 7f0dc75d8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc009edd0 con 0x7f0dc00a0a30 2023-09-30T22:32:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.607+0000 7f0dc75d8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc00a18e0 con 0x7f0dc00a1510 2023-09-30T22:32:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.607+0000 7f0dc75d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc009e1f0 con 0x7f0dc0139250 2023-09-30T22:32:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.607+0000 7f0dc4b73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0dc00a1510 0x7f0dc0138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.607+0000 7f0dc4b73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0dc00a1510 0x7f0dc0138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49678/0 (socket says 172.21.15.59:49678) 2023-09-30T22:32:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.607+0000 7f0dc5374700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0dc00a0a30 0x7f0dc00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39734/0 (socket says 172.21.15.59:39734) 2023-09-30T22:32:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.607+0000 7f0dc4b73700 1 -- 172.21.15.59:0/2898481059 learned_addr learned my addr 172.21.15.59:0/2898481059 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.607+0000 7f0dc5b75700 1 --2- 172.21.15.59:0/2898481059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dc0139250 0x7f0dc013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.607+0000 7f0dc4b73700 1 -- 172.21.15.59:0/2898481059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dc0139250 msgr2=0x7f0dc013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.607+0000 7f0dc4b73700 1 --2- 172.21.15.59:0/2898481059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dc0139250 0x7f0dc013b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.607+0000 7f0dc4b73700 1 -- 172.21.15.59:0/2898481059 >> v1:172.21.15.59:6789/0 conn(0x7f0dc00a0a30 legacy=0x7f0dc00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.608+0000 7f0dc4b73700 1 -- 172.21.15.59:0/2898481059 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc009dc50 con 0x7f0dc00a1510 2023-09-30T22:32:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.607+0000 7f0db7fff700 1 -- 172.21.15.59:0/2898481059 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623871468 0 0) 0x7f0dc009edd0 con 0x7f0dc00a0a30 2023-09-30T22:32:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.608+0000 7f0dc5b75700 1 --2- 172.21.15.59:0/2898481059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dc0139250 0x7f0dc013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.608+0000 7f0dc4b73700 1 --2- 172.21.15.59:0/2898481059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc00a1510 0x7f0dc0138d10 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0db00098f0 tx=0x7f0db0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc431fb444a45c92 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.608+0000 7f0db7fff700 1 -- 172.21.15.59:0/2898481059 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db000b8a0 con 0x7f0dc00a1510 2023-09-30T22:32:14.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.608+0000 7f0db7fff700 1 -- 172.21.15.59:0/2898481059 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db000ba00 con 0x7f0dc00a1510 2023-09-30T22:32:14.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.608+0000 7f0db7fff700 1 -- 172.21.15.59:0/2898481059 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db000bd90 con 0x7f0dc00a1510 2023-09-30T22:32:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.609+0000 7f0dc75d8700 1 -- 172.21.15.59:0/2898481059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc00a1510 msgr2=0x7f0dc0138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.609+0000 7f0dc75d8700 1 --2- 172.21.15.59:0/2898481059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc00a1510 0x7f0dc0138d10 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0db00098f0 tx=0x7f0db0009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.609+0000 7f0dc75d8700 1 -- 172.21.15.59:0/2898481059 shutdown_connections 2023-09-30T22:32:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.609+0000 7f0dc75d8700 1 --2- 172.21.15.59:0/2898481059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dc0139250 0x7f0dc013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.609+0000 7f0dc75d8700 1 --2- 172.21.15.59:0/2898481059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc00a1510 0x7f0dc0138d10 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.609+0000 7f0dc75d8700 1 -- 172.21.15.59:0/2898481059 >> 172.21.15.59:0/2898481059 conn(0x7f0dc00a6550 msgr2=0x7f0dc00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.609+0000 7f0dc75d8700 1 -- 172.21.15.59:0/2898481059 shutdown_connections 2023-09-30T22:32:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.609+0000 7f0dc75d8700 1 -- 172.21.15.59:0/2898481059 wait complete. 2023-09-30T22:32:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.610+0000 7f0dc75d8700 1 Processor -- start 2023-09-30T22:32:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.610+0000 7f0dc75d8700 1 -- start start 2023-09-30T22:32:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.610+0000 7f0dc75d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc00a0a30 0x7f0dc0122770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.610+0000 7f0dc75d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dc00a1510 0x7f0dc0122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.610+0000 7f0dc75d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dc0139250 0x7f0dc01231f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.610+0000 7f0dc75d8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc01389a0 con 0x7f0dc00a0a30 2023-09-30T22:32:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.610+0000 7f0dc75d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc0124c50 con 0x7f0dc0139250 2023-09-30T22:32:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.610+0000 7f0dc75d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc0124380 con 0x7f0dc00a1510 2023-09-30T22:32:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0dc5b75700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dc0139250 0x7f0dc01231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0dc5b75700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dc0139250 0x7f0dc01231f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42664/0 (socket says 172.21.15.59:42664) 2023-09-30T22:32:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0dc5b75700 1 -- 172.21.15.59:0/4046886710 learned_addr learned my addr 172.21.15.59:0/4046886710 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0dc5374700 1 --2- 172.21.15.59:0/4046886710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc00a0a30 0x7f0dc0122770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0dc4b73700 1 --2- 172.21.15.59:0/4046886710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dc00a1510 0x7f0dc0122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0dc5b75700 1 -- 172.21.15.59:0/4046886710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dc00a1510 msgr2=0x7f0dc0122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0dc5b75700 1 --2- 172.21.15.59:0/4046886710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dc00a1510 0x7f0dc0122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0dc5b75700 1 -- 172.21.15.59:0/4046886710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc00a0a30 msgr2=0x7f0dc0122770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0dc5b75700 1 --2- 172.21.15.59:0/4046886710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc00a0a30 0x7f0dc0122770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0dc5b75700 1 -- 172.21.15.59:0/4046886710 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db0009550 con 0x7f0dc0139250 2023-09-30T22:32:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0dc4b73700 1 --2- 172.21.15.59:0/4046886710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dc00a1510 0x7f0dc0122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0dc5374700 1 --2- 172.21.15.59:0/4046886710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc00a0a30 0x7f0dc0122770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:14.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0dc5b75700 1 --2- 172.21.15.59:0/4046886710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dc0139250 0x7f0dc01231f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009f70 tx=0x7f0db800d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:14.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0db5ffb700 1 -- 172.21.15.59:0/4046886710 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db8003a20 con 0x7f0dc0139250 2023-09-30T22:32:14.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0db5ffb700 1 -- 172.21.15.59:0/4046886710 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db800f040 con 0x7f0dc0139250 2023-09-30T22:32:14.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.611+0000 7f0dc75d8700 1 -- 172.21.15.59:0/4046886710 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc01386f0 con 0x7f0dc0139250 2023-09-30T22:32:14.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.612+0000 7f0db5ffb700 1 -- 172.21.15.59:0/4046886710 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db8003de0 con 0x7f0dc0139250 2023-09-30T22:32:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.613+0000 7f0dc75d8700 1 -- 172.21.15.59:0/4046886710 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc00a0220 con 0x7f0dc0139250 2023-09-30T22:32:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.613+0000 7f0db5ffb700 1 -- 172.21.15.59:0/4046886710 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0db8004030 con 0x7f0dc0139250 2023-09-30T22:32:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.613+0000 7f0db5ffb700 1 -- 172.21.15.59:0/4046886710 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0db8041990 con 0x7f0dc0139250 2023-09-30T22:32:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.614+0000 7f0dc75d8700 1 -- 172.21.15.59:0/4046886710 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc0074ea0 con 0x7f0dc0139250 2023-09-30T22:32:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.623+0000 7f0db5ffb700 1 -- 172.21.15.59:0/4046886710 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0db801a080 con 0x7f0dc0139250 2023-09-30T22:32:14.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.717+0000 7fc785e49700 1 -- 172.21.15.59:0/1467576497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc780074ea0 con 0x7fc7800a0a30 2023-09-30T22:32:14.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.717+0000 7fc767fff700 1 -- 172.21.15.59:0/1467576497 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc770027070 con 0x7fc7800a0a30 2023-09-30T22:32:14.717 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:14.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.719+0000 7fc785e49700 1 -- 172.21.15.59:0/1467576497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7800a0a30 msgr2=0x7fc78011e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.719+0000 7fc785e49700 1 --2- 172.21.15.59:0/1467576497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7800a0a30 0x7fc78011e700 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc7700070b0 tx=0x7fc77000d3b0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.719+0000 7fc785e49700 1 -- 172.21.15.59:0/1467576497 shutdown_connections 2023-09-30T22:32:14.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.719+0000 7fc785e49700 1 --2- 172.21.15.59:0/1467576497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc780134170 0x7fc78011f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.719+0000 7fc785e49700 1 --2- 172.21.15.59:0/1467576497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7800a0a30 0x7fc78011e700 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.719+0000 7fc785e49700 1 --2- 172.21.15.59:0/1467576497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7800a1340 0x7fc78011ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.719+0000 7fc785e49700 1 -- 172.21.15.59:0/1467576497 >> 172.21.15.59:0/1467576497 conn(0x7fc7800a6550 msgr2=0x7fc78009ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:14.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.719+0000 7fc785e49700 1 -- 172.21.15.59:0/1467576497 shutdown_connections 2023-09-30T22:32:14.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.719+0000 7fc785e49700 1 -- 172.21.15.59:0/1467576497 wait complete. 2023-09-30T22:32:14.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.726+0000 7f8b52311700 1 -- 172.21.15.59:0/1190330583 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8b4c0a36f0 con 0x7f8b4c09d9f0 2023-09-30T22:32:14.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.727+0000 7f8b48ff9700 1 -- 172.21.15.59:0/1190330583 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b40015ba0 con 0x7f8b4c09d9f0 2023-09-30T22:32:14.727 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:14.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.730+0000 7f8b52311700 1 -- 172.21.15.59:0/1190330583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b4c09d9f0 msgr2=0x7f8b4c071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.730+0000 7f8b52311700 1 --2- 172.21.15.59:0/1190330583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b4c09d9f0 0x7f8b4c071150 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c06deb0 tx=0x7f8b40008c90 comp rx=0 tx=0).stop 2023-09-30T22:32:14.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.730+0000 7f8b52311700 1 -- 172.21.15.59:0/1190330583 shutdown_connections 2023-09-30T22:32:14.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.730+0000 7f8b52311700 1 --2- 172.21.15.59:0/1190330583 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c06acb0 0x7f8b4c070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.730+0000 7f8b52311700 1 --2- 172.21.15.59:0/1190330583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b4c1316c0 0x7f8b4c071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.730+0000 7f8b52311700 1 --2- 172.21.15.59:0/1190330583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b4c09d9f0 0x7f8b4c071150 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.730+0000 7f8b52311700 1 -- 172.21.15.59:0/1190330583 >> 172.21.15.59:0/1190330583 conn(0x7f8b4c066f50 msgr2=0x7f8b4c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:14.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.730+0000 7f8b52311700 1 -- 172.21.15.59:0/1190330583 shutdown_connections 2023-09-30T22:32:14.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.730+0000 7f8b52311700 1 -- 172.21.15.59:0/1190330583 wait complete. 2023-09-30T22:32:14.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:14.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:14.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.763+0000 7f0cfee1d700 1 -- 172.21.15.59:0/1903639749 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0cf8070ec0 con 0x7f0cf80a1340 2023-09-30T22:32:14.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.763+0000 7f0cf57fa700 1 -- 172.21.15.59:0/1903639749 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cf8070ec0 con 0x7f0cf80a1340 2023-09-30T22:32:14.763 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:14.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.765+0000 7f0cfee1d700 1 -- 172.21.15.59:0/1903639749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a1340 msgr2=0x7f0cf806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.765+0000 7f0cfee1d700 1 --2- 172.21.15.59:0/1903639749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a1340 0x7f0cf806e000 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40011e0 tx=0x7f0ce400c9b0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.765+0000 7f0cfee1d700 1 -- 172.21.15.59:0/1903639749 shutdown_connections 2023-09-30T22:32:14.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.765+0000 7f0cfee1d700 1 --2- 172.21.15.59:0/1903639749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf80a0a30 0x7f0cf806dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.765+0000 7f0cfee1d700 1 --2- 172.21.15.59:0/1903639749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf8134170 0x7f0cf806e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.765+0000 7f0cfee1d700 1 --2- 172.21.15.59:0/1903639749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a1340 0x7f0cf806e000 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.765+0000 7f0cfee1d700 1 -- 172.21.15.59:0/1903639749 >> 172.21.15.59:0/1903639749 conn(0x7f0cf80a6550 msgr2=0x7f0cf809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:14.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.765+0000 7f0cfee1d700 1 -- 172.21.15.59:0/1903639749 shutdown_connections 2023-09-30T22:32:14.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.765+0000 7f0cfee1d700 1 -- 172.21.15.59:0/1903639749 wait complete. 2023-09-30T22:32:14.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:14.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.832+0000 7f0dc75d8700 1 -- 172.21.15.59:0/4046886710 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0dc00a28e0 con 0x7f0dc0139250 2023-09-30T22:32:14.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.832+0000 7f0db5ffb700 1 -- 172.21.15.59:0/4046886710 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0db8045060 con 0x7f0dc0139250 2023-09-30T22:32:14.833 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:14.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.835+0000 7f0dc75d8700 1 -- 172.21.15.59:0/4046886710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dc0139250 msgr2=0x7f0dc01231f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:14.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.835+0000 7f0dc75d8700 1 --2- 172.21.15.59:0/4046886710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dc0139250 0x7f0dc01231f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009f70 tx=0x7f0db800d460 comp rx=0 tx=0).stop 2023-09-30T22:32:14.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.835+0000 7f0dc75d8700 1 -- 172.21.15.59:0/4046886710 shutdown_connections 2023-09-30T22:32:14.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.835+0000 7f0dc75d8700 1 --2- 172.21.15.59:0/4046886710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dc0139250 0x7f0dc01231f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.835+0000 7f0dc75d8700 1 --2- 172.21.15.59:0/4046886710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc00a0a30 0x7f0dc0122770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.835+0000 7f0dc75d8700 1 --2- 172.21.15.59:0/4046886710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0dc00a1510 0x7f0dc0122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:14.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.835+0000 7f0dc75d8700 1 -- 172.21.15.59:0/4046886710 >> 172.21.15.59:0/4046886710 conn(0x7f0dc00a6550 msgr2=0x7f0dc00a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:14.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.835+0000 7f0dc75d8700 1 -- 172.21.15.59:0/4046886710 shutdown_connections 2023-09-30T22:32:14.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:14.835+0000 7f0dc75d8700 1 -- 172.21.15.59:0/4046886710 wait complete. 2023-09-30T22:32:14.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:15.735 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:15.746 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:15.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:15.849 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:15.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.890+0000 7f3c728c3700 1 Processor -- start 2023-09-30T22:32:15.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.890+0000 7f3c728c3700 1 -- start start 2023-09-30T22:32:15.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c728c3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c6c09d6f0 0x7f3c6c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:15.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c728c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6c09e000 0x7f3c6c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:15.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c728c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6c09e410 0x7f3c6c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:15.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c728c3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6c06b460 con 0x7f3c6c09d6f0 2023-09-30T22:32:15.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c728c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c09b120 con 0x7f3c6c09e410 2023-09-30T22:32:15.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c728c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c09a7e0 con 0x7f3c6c09e000 2023-09-30T22:32:15.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c6bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c6c09d6f0 0x7f3c6c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:15.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c6b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6c09e000 0x7f3c6c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:15.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c6b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6c09e000 0x7f3c6c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45998/0 (socket says 172.21.15.59:45998) 2023-09-30T22:32:15.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c6bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c6c09d6f0 0x7f3c6c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49702/0 (socket says 172.21.15.59:49702) 2023-09-30T22:32:15.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c6b7fe700 1 -- 172.21.15.59:0/3215192692 learned_addr learned my addr 172.21.15.59:0/3215192692 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:15.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c70e60700 1 --2- 172.21.15.59:0/3215192692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6c09e410 0x7f3c6c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:15.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c70e60700 1 -- 172.21.15.59:0/3215192692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6c09e000 msgr2=0x7f3c6c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:15.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c70e60700 1 --2- 172.21.15.59:0/3215192692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6c09e000 0x7f3c6c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:15.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c70e60700 1 -- 172.21.15.59:0/3215192692 >> v2:172.21.15.59:3300/0 conn(0x7f3c6c09d6f0 msgr2=0x7f3c6c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:15.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.891+0000 7f3c70e60700 1 --2- 172.21.15.59:0/3215192692 >> v2:172.21.15.59:3300/0 conn(0x7f3c6c09d6f0 0x7f3c6c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:15.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.892+0000 7f3c70e60700 1 -- 172.21.15.59:0/3215192692 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c09a500 con 0x7f3c6c09e410 2023-09-30T22:32:15.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.892+0000 7f3c70e60700 1 --2- 172.21.15.59:0/3215192692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6c09e410 0x7f3c6c133f30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3c64009dc0 tx=0x7f3c6400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a23d1dd02bf6f68 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:15.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.892+0000 7f3c6affd700 1 -- 172.21.15.59:0/3215192692 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400e070 con 0x7f3c6c09e410 2023-09-30T22:32:15.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.892+0000 7f3c6affd700 1 -- 172.21.15.59:0/3215192692 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6400bae0 con 0x7f3c6c09e410 2023-09-30T22:32:15.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.892+0000 7f3c6affd700 1 -- 172.21.15.59:0/3215192692 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400be90 con 0x7f3c6c09e410 2023-09-30T22:32:15.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.893+0000 7f3c728c3700 1 -- 172.21.15.59:0/3215192692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6c09e410 msgr2=0x7f3c6c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:15.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.893+0000 7f3c728c3700 1 --2- 172.21.15.59:0/3215192692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6c09e410 0x7f3c6c133f30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3c64009dc0 tx=0x7f3c6400b330 comp rx=0 tx=0).stop 2023-09-30T22:32:15.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.893+0000 7f3c728c3700 1 -- 172.21.15.59:0/3215192692 shutdown_connections 2023-09-30T22:32:15.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.893+0000 7f3c728c3700 1 --2- 172.21.15.59:0/3215192692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6c09e410 0x7f3c6c133f30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:15.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.893+0000 7f3c728c3700 1 --2- 172.21.15.59:0/3215192692 >> v2:172.21.15.59:3300/0 conn(0x7f3c6c09d6f0 0x7f3c6c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:15.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.893+0000 7f3c728c3700 1 --2- 172.21.15.59:0/3215192692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6c09e000 0x7f3c6c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:15.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.893+0000 7f3c728c3700 1 -- 172.21.15.59:0/3215192692 >> 172.21.15.59:0/3215192692 conn(0x7f3c6c066f50 msgr2=0x7f3c6c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:15.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.893+0000 7f3c728c3700 1 -- 172.21.15.59:0/3215192692 shutdown_connections 2023-09-30T22:32:15.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.893+0000 7f3c728c3700 1 -- 172.21.15.59:0/3215192692 wait complete. 2023-09-30T22:32:15.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.894+0000 7f3c728c3700 1 Processor -- start 2023-09-30T22:32:15.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.895+0000 7f3c728c3700 1 -- start start 2023-09-30T22:32:15.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.895+0000 7f3c728c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6c09d6f0 0x7f3c6c1a25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:15.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.895+0000 7f3c728c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6c09e000 0x7f3c6c1a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:15.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.895+0000 7f3c728c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6c09e410 0x7f3c6c1a3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:15.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.895+0000 7f3c728c3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c072350 con 0x7f3c6c09e000 2023-09-30T22:32:15.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.895+0000 7f3c728c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c072120 con 0x7f3c6c09e410 2023-09-30T22:32:15.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.895+0000 7f3c728c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c1a5380 con 0x7f3c6c09d6f0 2023-09-30T22:32:15.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.895+0000 7f3c6bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6c09d6f0 0x7f3c6c1a25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:15.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.895+0000 7f3c6bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6c09d6f0 0x7f3c6c1a25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46012/0 (socket says 172.21.15.59:46012) 2023-09-30T22:32:15.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.895+0000 7f3c6bfff700 1 -- 172.21.15.59:0/3535010820 learned_addr learned my addr 172.21.15.59:0/3535010820 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:15.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.896+0000 7f3c6bfff700 1 -- 172.21.15.59:0/3535010820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6c09e410 msgr2=0x7f3c6c1a3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:15.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.896+0000 7f3c6bfff700 1 --2- 172.21.15.59:0/3535010820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6c09e410 0x7f3c6c1a3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:15.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.896+0000 7f3c6bfff700 1 -- 172.21.15.59:0/3535010820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6c09e000 msgr2=0x7f3c6c1a2ae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:32:15.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.896+0000 7f3c6bfff700 1 --2- 172.21.15.59:0/3535010820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6c09e000 0x7f3c6c1a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:15.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.896+0000 7f3c6bfff700 1 -- 172.21.15.59:0/3535010820 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c64009a70 con 0x7f3c6c09d6f0 2023-09-30T22:32:15.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.896+0000 7f3c6bfff700 1 --2- 172.21.15.59:0/3535010820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6c09d6f0 0x7f3c6c1a25a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00e9b0 tx=0x7f3c5c00ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:15.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.896+0000 7f3c68ff9700 1 -- 172.21.15.59:0/3535010820 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c009710 con 0x7f3c6c09d6f0 2023-09-30T22:32:15.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.896+0000 7f3c68ff9700 1 -- 172.21.15.59:0/3535010820 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c00c850 con 0x7f3c6c09d6f0 2023-09-30T22:32:15.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.896+0000 7f3c68ff9700 1 -- 172.21.15.59:0/3535010820 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c00cbc0 con 0x7f3c6c09d6f0 2023-09-30T22:32:15.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.896+0000 7f3c728c3700 1 -- 172.21.15.59:0/3535010820 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c6c0a1d20 con 0x7f3c6c09d6f0 2023-09-30T22:32:15.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.896+0000 7f3c728c3700 1 -- 172.21.15.59:0/3535010820 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6c1a4e60 con 0x7f3c6c09d6f0 2023-09-30T22:32:15.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.897+0000 7f3c68ff9700 1 -- 172.21.15.59:0/3535010820 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c5c00cd20 con 0x7f3c6c09d6f0 2023-09-30T22:32:15.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.897+0000 7f3c68ff9700 1 -- 172.21.15.59:0/3535010820 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3c5c03fc50 con 0x7f3c6c09d6f0 2023-09-30T22:32:15.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.898+0000 7f3c728c3700 1 -- 172.21.15.59:0/3535010820 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6c1b6610 con 0x7f3c6c09d6f0 2023-09-30T22:32:15.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.903+0000 7f3c68ff9700 1 -- 172.21.15.59:0/3535010820 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c6c1b6610 con 0x7f3c6c09d6f0 2023-09-30T22:32:15.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.930+0000 7f44aeff5700 1 Processor -- start 2023-09-30T22:32:15.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.930+0000 7f44aeff5700 1 -- start start 2023-09-30T22:32:15.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.931+0000 7f44aeff5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a8134630 0x7f44a8136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:15.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.931+0000 7f44aeff5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44a8136f50 0x7f44a8139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:15.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.931+0000 7f44aeff5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a8071a00 con 0x7f44a8131630 2023-09-30T22:32:15.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.931+0000 7f44aeff5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a8131430 con 0x7f44a8134630 2023-09-30T22:32:15.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.931+0000 7f44aeff5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44a809a510 con 0x7f44a8136f50 2023-09-30T22:32:15.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.931+0000 7f44a7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a8134630 0x7f44a8136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:15.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.931+0000 7f44a7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a8134630 0x7f44a8136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42698/0 (socket says 172.21.15.59:42698) 2023-09-30T22:32:15.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.931+0000 7f44a7fff700 1 -- 172.21.15.59:0/1698218459 learned_addr learned my addr 172.21.15.59:0/1698218459 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:15.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.931+0000 7f44ad592700 1 --2- 172.21.15.59:0/1698218459 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44a8136f50 0x7f44a8139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:15.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.932+0000 7f44a7fff700 1 -- 172.21.15.59:0/1698218459 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44a8136f50 msgr2=0x7f44a8139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:15.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.932+0000 7f44a7fff700 1 --2- 172.21.15.59:0/1698218459 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44a8136f50 0x7f44a8139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:15.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.932+0000 7f44a7fff700 1 -- 172.21.15.59:0/1698218459 >> v1:172.21.15.59:6789/0 conn(0x7f44a8131630 legacy=0x7f44a8131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:15.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.932+0000 7f44a7fff700 1 -- 172.21.15.59:0/1698218459 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a80721c0 con 0x7f44a8134630 2023-09-30T22:32:15.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.932+0000 7f44a7fff700 1 --2- 172.21.15.59:0/1698218459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a8134630 0x7f44a8136a10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4494009920 tx=0x7f4494009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b7ee134bfec4ab6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:15.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.932+0000 7f44a77fe700 1 -- 172.21.15.59:0/1698218459 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494011830 con 0x7f44a8134630 2023-09-30T22:32:15.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.932+0000 7f44a77fe700 1 -- 172.21.15.59:0/1698218459 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4494011990 con 0x7f44a8134630 2023-09-30T22:32:15.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.932+0000 7f44a77fe700 1 -- 172.21.15.59:0/1698218459 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494011d20 con 0x7f44a8134630 2023-09-30T22:32:15.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.933+0000 7f44aeff5700 1 -- 172.21.15.59:0/1698218459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a8134630 msgr2=0x7f44a8136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:15.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.933+0000 7f44aeff5700 1 --2- 172.21.15.59:0/1698218459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a8134630 0x7f44a8136a10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4494009920 tx=0x7f4494009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:15.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.933+0000 7f44aeff5700 1 -- 172.21.15.59:0/1698218459 shutdown_connections 2023-09-30T22:32:15.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.933+0000 7f44aeff5700 1 --2- 172.21.15.59:0/1698218459 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44a8136f50 0x7f44a8139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:15.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.933+0000 7f44aeff5700 1 --2- 172.21.15.59:0/1698218459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a8134630 0x7f44a8136a10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:15.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.933+0000 7f44aeff5700 1 -- 172.21.15.59:0/1698218459 >> 172.21.15.59:0/1698218459 conn(0x7f44a80a2aa0 msgr2=0x7f44a80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:15.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.933+0000 7f44aeff5700 1 -- 172.21.15.59:0/1698218459 shutdown_connections 2023-09-30T22:32:15.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.933+0000 7f44aeff5700 1 -- 172.21.15.59:0/1698218459 wait complete. 2023-09-30T22:32:15.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.935+0000 7f44aeff5700 1 Processor -- start 2023-09-30T22:32:15.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.935+0000 7f44aeff5700 1 -- start start 2023-09-30T22:32:15.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44aeff5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a8131630 0x7f44a81c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:15.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44aeff5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44a8134630 0x7f44a81c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:15.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44aeff5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a8136f50 0x7f44a8118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:15.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44aeff5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a81c6fa0 con 0x7f44a8136f50 2023-09-30T22:32:15.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44aeff5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a811c570 con 0x7f44a8131630 2023-09-30T22:32:15.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44aeff5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44a811a860 con 0x7f44a8134630 2023-09-30T22:32:15.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44acd91700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a8131630 0x7f44a81c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:15.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44ad592700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a8136f50 0x7f44a8118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:15.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44acd91700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a8131630 0x7f44a81c6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42708/0 (socket says 172.21.15.59:42708) 2023-09-30T22:32:15.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44acd91700 1 -- 172.21.15.59:0/3395194350 learned_addr learned my addr 172.21.15.59:0/3395194350 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:15.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44a7fff700 1 --2- 172.21.15.59:0/3395194350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44a8134630 0x7f44a81c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:15.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44acd91700 1 -- 172.21.15.59:0/3395194350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44a8134630 msgr2=0x7f44a81c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:15.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44acd91700 1 --2- 172.21.15.59:0/3395194350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44a8134630 0x7f44a81c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:15.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44acd91700 1 -- 172.21.15.59:0/3395194350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a8136f50 msgr2=0x7f44a8118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:15.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44acd91700 1 --2- 172.21.15.59:0/3395194350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a8136f50 0x7f44a8118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:15.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44acd91700 1 -- 172.21.15.59:0/3395194350 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494009550 con 0x7f44a8131630 2023-09-30T22:32:15.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44ad592700 1 --2- 172.21.15.59:0/3395194350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a8136f50 0x7f44a8118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:15.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.936+0000 7f44acd91700 1 --2- 172.21.15.59:0/3395194350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a8131630 0x7f44a81c6520 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f449c00c4e0 tx=0x7f449c00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:15.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.937+0000 7f44a57fa700 1 -- 172.21.15.59:0/3395194350 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c0052d0 con 0x7f44a8131630 2023-09-30T22:32:15.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.937+0000 7f44aeff5700 1 -- 172.21.15.59:0/3395194350 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a81338e0 con 0x7f44a8131630 2023-09-30T22:32:15.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.937+0000 7f44a57fa700 1 -- 172.21.15.59:0/3395194350 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c005430 con 0x7f44a8131630 2023-09-30T22:32:15.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.937+0000 7f44a57fa700 1 -- 172.21.15.59:0/3395194350 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c0119b0 con 0x7f44a8131630 2023-09-30T22:32:15.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.937+0000 7f44aeff5700 1 -- 172.21.15.59:0/3395194350 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a812eb20 con 0x7f44a8131630 2023-09-30T22:32:15.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.938+0000 7f44a57fa700 1 -- 172.21.15.59:0/3395194350 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f449c011b10 con 0x7f44a8131630 2023-09-30T22:32:15.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.938+0000 7f44aeff5700 1 -- 172.21.15.59:0/3395194350 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a8074ea0 con 0x7f44a8131630 2023-09-30T22:32:15.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.938+0000 7f44a57fa700 1 -- 172.21.15.59:0/3395194350 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f449c016c70 con 0x7f44a8131630 2023-09-30T22:32:15.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:15.943+0000 7f44a57fa700 1 -- 172.21.15.59:0/3395194350 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f449c016e80 con 0x7f44a8131630 2023-09-30T22:32:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.003+0000 7fb9fc45d700 1 Processor -- start 2023-09-30T22:32:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.003+0000 7fb9fc45d700 1 -- start start 2023-09-30T22:32:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.004+0000 7fb9fc45d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9f40a0a30 0x7fb9f40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.004+0000 7fb9fc45d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9f40a1340 0x7fb9f4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.004+0000 7fb9fc45d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f409edd0 con 0x7fb9f4133fa0 2023-09-30T22:32:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.004+0000 7fb9fc45d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f409e1f0 con 0x7fb9f40a0a30 2023-09-30T22:32:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.004+0000 7fb9fc45d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f409dc50 con 0x7fb9f40a1340 2023-09-30T22:32:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.004+0000 7fb9fa1f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9f40a0a30 0x7fb9f40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.004+0000 7fb9f99f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9f40a1340 0x7fb9f4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.004+0000 7fb9fa1f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9f40a0a30 0x7fb9f40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49722/0 (socket says 172.21.15.59:49722) 2023-09-30T22:32:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.004+0000 7fb9f99f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9f40a1340 0x7fb9f4133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42712/0 (socket says 172.21.15.59:42712) 2023-09-30T22:32:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.004+0000 7fb9fa1f9700 1 -- 172.21.15.59:0/769323822 learned_addr learned my addr 172.21.15.59:0/769323822 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.004+0000 7fb9f99f8700 1 -- 172.21.15.59:0/769323822 >> v2:172.21.15.59:3300/0 conn(0x7fb9f40a0a30 msgr2=0x7fb9f40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.004+0000 7fb9f99f8700 1 --2- 172.21.15.59:0/769323822 >> v2:172.21.15.59:3300/0 conn(0x7fb9f40a0a30 0x7fb9f40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.004+0000 7fb9f99f8700 1 -- 172.21.15.59:0/769323822 >> v1:172.21.15.59:6789/0 conn(0x7fb9f4133fa0 legacy=0x7fb9f413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.004+0000 7fb9f99f8700 1 -- 172.21.15.59:0/769323822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f40a1fe0 con 0x7fb9f40a1340 2023-09-30T22:32:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.005+0000 7fb9f99f8700 1 --2- 172.21.15.59:0/769323822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9f40a1340 0x7fb9f4133a60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4009840 tx=0x7fb9e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e5d6ea976a4107a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.005+0000 7fb9f91f7700 1 -- 172.21.15.59:0/769323822 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4011830 con 0x7fb9f40a1340 2023-09-30T22:32:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.005+0000 7fb9f91f7700 1 -- 172.21.15.59:0/769323822 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e4011990 con 0x7fb9f40a1340 2023-09-30T22:32:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.005+0000 7fb9f91f7700 1 -- 172.21.15.59:0/769323822 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4011d20 con 0x7fb9f40a1340 2023-09-30T22:32:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.006+0000 7fb9fc45d700 1 -- 172.21.15.59:0/769323822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9f40a1340 msgr2=0x7fb9f4133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.006+0000 7fb9fc45d700 1 --2- 172.21.15.59:0/769323822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9f40a1340 0x7fb9f4133a60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4009840 tx=0x7fb9e4009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.006+0000 7fb9fc45d700 1 -- 172.21.15.59:0/769323822 shutdown_connections 2023-09-30T22:32:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.006+0000 7fb9fc45d700 1 --2- 172.21.15.59:0/769323822 >> v2:172.21.15.59:3300/0 conn(0x7fb9f40a0a30 0x7fb9f40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.006+0000 7fb9fc45d700 1 --2- 172.21.15.59:0/769323822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9f40a1340 0x7fb9f4133a60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.006+0000 7fb9fc45d700 1 -- 172.21.15.59:0/769323822 >> 172.21.15.59:0/769323822 conn(0x7fb9f40a6550 msgr2=0x7fb9f40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.006+0000 7fb9fc45d700 1 -- 172.21.15.59:0/769323822 shutdown_connections 2023-09-30T22:32:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.006+0000 7fb9fc45d700 1 -- 172.21.15.59:0/769323822 wait complete. 2023-09-30T22:32:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.007+0000 7fb9fc45d700 1 Processor -- start 2023-09-30T22:32:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.007+0000 7fb9fc45d700 1 -- start start 2023-09-30T22:32:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.007+0000 7fb9fc45d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9f40a0a30 0x7fb9f411e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.007+0000 7fb9fc45d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9f40a1340 0x7fb9f411ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.007+0000 7fb9fc45d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9f4133fa0 0x7fb9f411f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.007+0000 7fb9fc45d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f4120bc0 con 0x7fb9f40a0a30 2023-09-30T22:32:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.007+0000 7fb9fc45d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f40a3760 con 0x7fb9f4133fa0 2023-09-30T22:32:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.007+0000 7fb9fc45d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f40a0220 con 0x7fb9f40a1340 2023-09-30T22:32:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.008+0000 7fb9fa1f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9f40a0a30 0x7fb9f411e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.008+0000 7fb9fa1f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9f40a0a30 0x7fb9f411e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49738/0 (socket says 172.21.15.59:49738) 2023-09-30T22:32:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.008+0000 7fb9fa1f9700 1 -- 172.21.15.59:0/274466508 learned_addr learned my addr 172.21.15.59:0/274466508 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.008+0000 7fb9f99f8700 1 --2- 172.21.15.59:0/274466508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9f40a1340 0x7fb9f411ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.008+0000 7fb9fa9fa700 1 --2- 172.21.15.59:0/274466508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9f4133fa0 0x7fb9f411f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.008+0000 7fb9fa1f9700 1 -- 172.21.15.59:0/274466508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9f40a1340 msgr2=0x7fb9f411ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.008+0000 7fb9fa1f9700 1 --2- 172.21.15.59:0/274466508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9f40a1340 0x7fb9f411ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.008+0000 7fb9fa1f9700 1 -- 172.21.15.59:0/274466508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9f4133fa0 msgr2=0x7fb9f411f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.008+0000 7fb9fa1f9700 1 --2- 172.21.15.59:0/274466508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9f4133fa0 0x7fb9f411f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.008+0000 7fb9fa1f9700 1 -- 172.21.15.59:0/274466508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40094a0 con 0x7fb9f40a0a30 2023-09-30T22:32:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.008+0000 7fb9fa9fa700 1 --2- 172.21.15.59:0/274466508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9f4133fa0 0x7fb9f411f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.008+0000 7fb9f99f8700 1 --2- 172.21.15.59:0/274466508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9f40a1340 0x7fb9f411ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.008+0000 7fb9fa1f9700 1 --2- 172.21.15.59:0/274466508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9f40a0a30 0x7fb9f411e750 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000e910 tx=0x7fb9f000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.008+0000 7fb9eaffd700 1 -- 172.21.15.59:0/274466508 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f00096a0 con 0x7fb9f40a0a30 2023-09-30T22:32:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.009+0000 7fb9eaffd700 1 -- 172.21.15.59:0/274466508 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f000ee60 con 0x7fb9f40a0a30 2023-09-30T22:32:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.009+0000 7fb9fc45d700 1 -- 172.21.15.59:0/274466508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f4120400 con 0x7fb9f40a0a30 2023-09-30T22:32:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.009+0000 7fb9eaffd700 1 -- 172.21.15.59:0/274466508 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f000ca90 con 0x7fb9f40a0a30 2023-09-30T22:32:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.009+0000 7fb9fc45d700 1 -- 172.21.15.59:0/274466508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f41336e0 con 0x7fb9f40a0a30 2023-09-30T22:32:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.010+0000 7fb9fc45d700 1 -- 172.21.15.59:0/274466508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f4074ea0 con 0x7fb9f40a0a30 2023-09-30T22:32:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.010+0000 7fb9eaffd700 1 -- 172.21.15.59:0/274466508 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9f000cbf0 con 0x7fb9f40a0a30 2023-09-30T22:32:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.010+0000 7fb9eaffd700 1 -- 172.21.15.59:0/274466508 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb9f003f6d0 con 0x7fb9f40a0a30 2023-09-30T22:32:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.013+0000 7fa40535a700 1 Processor -- start 2023-09-30T22:32:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.013+0000 7fa40535a700 1 -- start start 2023-09-30T22:32:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.013+0000 7fa40535a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa40006f5d0 0x7fa40012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.013+0000 7fa40535a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa400135c20 0x7fa400138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.013+0000 7fa40535a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40006fa40 con 0x7fa40012cf60 2023-09-30T22:32:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.013+0000 7fa40535a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40012cd90 con 0x7fa400135c20 2023-09-30T22:32:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.013+0000 7fa40535a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa400071780 con 0x7fa40006f5d0 2023-09-30T22:32:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.014+0000 7fa3fe7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa40006f5d0 0x7fa40012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.014+0000 7fa3fe7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa40006f5d0 0x7fa40012ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46038/0 (socket says 172.21.15.59:46038) 2023-09-30T22:32:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.014+0000 7fa3ff7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa400135c20 0x7fa400138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.014+0000 7fa3fe7fc700 1 -- 172.21.15.59:0/2553322857 learned_addr learned my addr 172.21.15.59:0/2553322857 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.014+0000 7fa3fe7fc700 1 -- 172.21.15.59:0/2553322857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa400135c20 msgr2=0x7fa400138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.014+0000 7fa3fe7fc700 1 --2- 172.21.15.59:0/2553322857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa400135c20 0x7fa400138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.014+0000 7fa3fe7fc700 1 -- 172.21.15.59:0/2553322857 >> v1:172.21.15.59:6789/0 conn(0x7fa40012cf60 legacy=0x7fa40012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.014+0000 7fa3fe7fc700 1 -- 172.21.15.59:0/2553322857 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa400071a40 con 0x7fa40006f5d0 2023-09-30T22:32:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.014+0000 7fa3fe7fc700 1 --2- 172.21.15.59:0/2553322857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa40006f5d0 0x7fa40012ffc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400ba00 tx=0x7fa3f400bd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=124a0f57af428a34 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.015+0000 7fa3fdffb700 1 -- 172.21.15.59:0/2553322857 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400bea0 con 0x7fa40006f5d0 2023-09-30T22:32:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.015+0000 7fa3fdffb700 1 -- 172.21.15.59:0/2553322857 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f400cc20 con 0x7fa40006f5d0 2023-09-30T22:32:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.015+0000 7fa3fdffb700 1 -- 172.21.15.59:0/2553322857 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400f460 con 0x7fa40006f5d0 2023-09-30T22:32:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.015+0000 7fb9eaffd700 1 -- 172.21.15.59:0/274466508 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9f00232f0 con 0x7fb9f40a0a30 2023-09-30T22:32:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.016+0000 7fa40535a700 1 -- 172.21.15.59:0/2553322857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa40006f5d0 msgr2=0x7fa40012ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.016+0000 7fa40535a700 1 --2- 172.21.15.59:0/2553322857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa40006f5d0 0x7fa40012ffc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400ba00 tx=0x7fa3f400bd10 comp rx=0 tx=0).stop 2023-09-30T22:32:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.016+0000 7fa40535a700 1 -- 172.21.15.59:0/2553322857 shutdown_connections 2023-09-30T22:32:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.016+0000 7fa40535a700 1 --2- 172.21.15.59:0/2553322857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa400135c20 0x7fa400138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.016+0000 7fa40535a700 1 --2- 172.21.15.59:0/2553322857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa40006f5d0 0x7fa40012ffc0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.016+0000 7fa40535a700 1 -- 172.21.15.59:0/2553322857 >> 172.21.15.59:0/2553322857 conn(0x7fa4000a2aa0 msgr2=0x7fa4000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.016+0000 7fa40535a700 1 -- 172.21.15.59:0/2553322857 shutdown_connections 2023-09-30T22:32:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.016+0000 7fa40535a700 1 -- 172.21.15.59:0/2553322857 wait complete. 2023-09-30T22:32:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.017+0000 7fa40535a700 1 Processor -- start 2023-09-30T22:32:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.018+0000 7fa40535a700 1 -- start start 2023-09-30T22:32:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.018+0000 7fa40535a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa40006f5d0 0x7fa400133ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.018+0000 7fa40535a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa40012cf60 0x7fa400134020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.018+0000 7fa40535a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa400135c20 0x7fa4001cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.018+0000 7fa40535a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa400134560 con 0x7fa400135c20 2023-09-30T22:32:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.018+0000 7fa40535a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4001358f0 con 0x7fa40006f5d0 2023-09-30T22:32:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.018+0000 7fa40535a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa40009a890 con 0x7fa40012cf60 2023-09-30T22:32:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.018+0000 7fa3feffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa40006f5d0 0x7fa400133ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.018+0000 7fa3feffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa40006f5d0 0x7fa400133ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42718/0 (socket says 172.21.15.59:42718) 2023-09-30T22:32:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.018+0000 7fa3feffd700 1 -- 172.21.15.59:0/3120193338 learned_addr learned my addr 172.21.15.59:0/3120193338 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.019+0000 7fa3fe7fc700 1 --2- 172.21.15.59:0/3120193338 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa40012cf60 0x7fa400134020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.019+0000 7fa3ff7fe700 1 --2- 172.21.15.59:0/3120193338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa400135c20 0x7fa4001cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:16.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.019+0000 7fa3fe7fc700 1 -- 172.21.15.59:0/3120193338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa40006f5d0 msgr2=0x7fa400133ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.019+0000 7fa3fe7fc700 1 --2- 172.21.15.59:0/3120193338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa40006f5d0 0x7fa400133ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.019+0000 7fa3fe7fc700 1 -- 172.21.15.59:0/3120193338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa400135c20 msgr2=0x7fa4001cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.019+0000 7fa3fe7fc700 1 --2- 172.21.15.59:0/3120193338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa400135c20 0x7fa4001cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.019+0000 7fa3fe7fc700 1 -- 172.21.15.59:0/3120193338 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f400b600 con 0x7fa40012cf60 2023-09-30T22:32:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.019+0000 7fa3ff7fe700 1 --2- 172.21.15.59:0/3120193338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa400135c20 0x7fa4001cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.019+0000 7fa3fe7fc700 1 --2- 172.21.15.59:0/3120193338 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa40012cf60 0x7fa400134020 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4016000 tx=0x7fa3f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.019+0000 7fa3e77fe700 1 -- 172.21.15.59:0/3120193338 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f401c070 con 0x7fa40012cf60 2023-09-30T22:32:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.019+0000 7fa3e77fe700 1 -- 172.21.15.59:0/3120193338 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f400ca20 con 0x7fa40012cf60 2023-09-30T22:32:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.019+0000 7fa40535a700 1 -- 172.21.15.59:0/3120193338 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa400134d20 con 0x7fa40012cf60 2023-09-30T22:32:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.019+0000 7fa3e77fe700 1 -- 172.21.15.59:0/3120193338 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4004270 con 0x7fa40012cf60 2023-09-30T22:32:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.019+0000 7fa40535a700 1 -- 172.21.15.59:0/3120193338 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40009b5c0 con 0x7fa40012cf60 2023-09-30T22:32:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.020+0000 7fa3e77fe700 1 -- 172.21.15.59:0/3120193338 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3f40043d0 con 0x7fa40012cf60 2023-09-30T22:32:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.021+0000 7fa3e77fe700 1 -- 172.21.15.59:0/3120193338 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa3f4040c50 con 0x7fa40012cf60 2023-09-30T22:32:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.022+0000 7fa40535a700 1 -- 172.21.15.59:0/3120193338 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa400074ea0 con 0x7fa40012cf60 2023-09-30T22:32:16.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.031+0000 7fa3e77fe700 1 -- 172.21.15.59:0/3120193338 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3f4017400 con 0x7fa40012cf60 2023-09-30T22:32:16.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.154+0000 7f44aeff5700 1 -- 172.21.15.59:0/3395194350 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f44a811cf60 con 0x7f44a8131630 2023-09-30T22:32:16.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.154+0000 7f44a57fa700 1 -- 172.21.15.59:0/3395194350 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f449c01e020 con 0x7f44a8131630 2023-09-30T22:32:16.155 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:16.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.157+0000 7f44aeff5700 1 -- 172.21.15.59:0/3395194350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a8131630 msgr2=0x7f44a81c6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:16.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.157+0000 7f44aeff5700 1 --2- 172.21.15.59:0/3395194350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a8131630 0x7f44a81c6520 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f449c00c4e0 tx=0x7f449c00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.157+0000 7f44aeff5700 1 -- 172.21.15.59:0/3395194350 shutdown_connections 2023-09-30T22:32:16.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.157+0000 7f44aeff5700 1 --2- 172.21.15.59:0/3395194350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a8136f50 0x7f44a8118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.157+0000 7f44aeff5700 1 --2- 172.21.15.59:0/3395194350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a8131630 0x7f44a81c6520 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.157+0000 7f44aeff5700 1 --2- 172.21.15.59:0/3395194350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44a8134630 0x7f44a81c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.157+0000 7f44aeff5700 1 -- 172.21.15.59:0/3395194350 >> 172.21.15.59:0/3395194350 conn(0x7f44a80a2aa0 msgr2=0x7f44a80a0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:16.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.157+0000 7f44aeff5700 1 -- 172.21.15.59:0/3395194350 shutdown_connections 2023-09-30T22:32:16.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.157+0000 7f44aeff5700 1 -- 172.21.15.59:0/3395194350 wait complete. 2023-09-30T22:32:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.167+0000 7f3c728c3700 1 -- 172.21.15.59:0/3535010820 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3c6c1b6610 con 0x7f3c6c09d6f0 2023-09-30T22:32:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.167+0000 7f3c68ff9700 1 -- 172.21.15.59:0/3535010820 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c6c1b6610 con 0x7f3c6c09d6f0 2023-09-30T22:32:16.167 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.171+0000 7f3c728c3700 1 -- 172.21.15.59:0/3535010820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6c09d6f0 msgr2=0x7f3c6c1a25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.171+0000 7f3c728c3700 1 --2- 172.21.15.59:0/3535010820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6c09d6f0 0x7f3c6c1a25a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00e9b0 tx=0x7f3c5c00ed70 comp rx=0 tx=0).stop 2023-09-30T22:32:16.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.171+0000 7f3c728c3700 1 -- 172.21.15.59:0/3535010820 shutdown_connections 2023-09-30T22:32:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.171+0000 7f3c728c3700 1 --2- 172.21.15.59:0/3535010820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6c09d6f0 0x7f3c6c1a25a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.171+0000 7f3c728c3700 1 --2- 172.21.15.59:0/3535010820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6c09e410 0x7f3c6c1a3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.171+0000 7f3c728c3700 1 --2- 172.21.15.59:0/3535010820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6c09e000 0x7f3c6c1a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.171+0000 7f3c728c3700 1 -- 172.21.15.59:0/3535010820 >> 172.21.15.59:0/3535010820 conn(0x7f3c6c066f50 msgr2=0x7f3c6c0a1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.171+0000 7f3c728c3700 1 -- 172.21.15.59:0/3535010820 shutdown_connections 2023-09-30T22:32:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.171+0000 7f3c728c3700 1 -- 172.21.15.59:0/3535010820 wait complete. 2023-09-30T22:32:16.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:16.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.234+0000 7fb9fc45d700 1 -- 172.21.15.59:0/274466508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb9f40a28e0 con 0x7fb9f40a0a30 2023-09-30T22:32:16.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.235+0000 7fb9eaffd700 1 -- 172.21.15.59:0/274466508 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9f0021020 con 0x7fb9f40a0a30 2023-09-30T22:32:16.235 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:16.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.237+0000 7fb9fc45d700 1 -- 172.21.15.59:0/274466508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9f40a0a30 msgr2=0x7fb9f411e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:16.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.237+0000 7fb9fc45d700 1 --2- 172.21.15.59:0/274466508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9f40a0a30 0x7fb9f411e750 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000e910 tx=0x7fb9f000ec20 comp rx=0 tx=0).stop 2023-09-30T22:32:16.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.237+0000 7fb9fc45d700 1 -- 172.21.15.59:0/274466508 shutdown_connections 2023-09-30T22:32:16.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.237+0000 7fb9fc45d700 1 --2- 172.21.15.59:0/274466508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9f4133fa0 0x7fb9f411f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.237+0000 7fb9fc45d700 1 --2- 172.21.15.59:0/274466508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9f40a0a30 0x7fb9f411e750 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.237+0000 7fb9fc45d700 1 --2- 172.21.15.59:0/274466508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9f40a1340 0x7fb9f411ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.237+0000 7fb9fc45d700 1 -- 172.21.15.59:0/274466508 >> 172.21.15.59:0/274466508 conn(0x7fb9f40a6550 msgr2=0x7fb9f40a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:16.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.237+0000 7fb9fc45d700 1 -- 172.21.15.59:0/274466508 shutdown_connections 2023-09-30T22:32:16.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.237+0000 7fb9fc45d700 1 -- 172.21.15.59:0/274466508 wait complete. 2023-09-30T22:32:16.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.238+0000 7fa40535a700 1 -- 172.21.15.59:0/3120193338 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa4000713a0 con 0x7fa40012cf60 2023-09-30T22:32:16.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.238+0000 7fa3e77fe700 1 -- 172.21.15.59:0/3120193338 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3f4026020 con 0x7fa40012cf60 2023-09-30T22:32:16.239 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:16.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.242+0000 7fa40535a700 1 -- 172.21.15.59:0/3120193338 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa40012cf60 msgr2=0x7fa400134020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:16.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.242+0000 7fa40535a700 1 --2- 172.21.15.59:0/3120193338 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa40012cf60 0x7fa400134020 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4016000 tx=0x7fa3f4004750 comp rx=0 tx=0).stop 2023-09-30T22:32:16.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.242+0000 7fa40535a700 1 -- 172.21.15.59:0/3120193338 shutdown_connections 2023-09-30T22:32:16.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.242+0000 7fa40535a700 1 --2- 172.21.15.59:0/3120193338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa400135c20 0x7fa4001cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.242+0000 7fa40535a700 1 --2- 172.21.15.59:0/3120193338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa40006f5d0 0x7fa400133ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.242+0000 7fa40535a700 1 --2- 172.21.15.59:0/3120193338 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa40012cf60 0x7fa400134020 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:16.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.242+0000 7fa40535a700 1 -- 172.21.15.59:0/3120193338 >> 172.21.15.59:0/3120193338 conn(0x7fa4000a2aa0 msgr2=0x7fa40006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:16.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.242+0000 7fa40535a700 1 -- 172.21.15.59:0/3120193338 shutdown_connections 2023-09-30T22:32:16.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:16.242+0000 7fa40535a700 1 -- 172.21.15.59:0/3120193338 wait complete. 2023-09-30T22:32:16.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:16.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:17.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:17.191 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:17.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:17.260 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:17.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.338+0000 7f3391815700 1 Processor -- start 2023-09-30T22:32:17.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.338+0000 7f3391815700 1 -- start start 2023-09-30T22:32:17.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f3391815700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338c1338a0 0x7f338c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f3391815700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f338c09de50 0x7f338c09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f3391815700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f338c09e760 0x7f338c13a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f3391815700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338c06fef0 con 0x7f338c09de50 2023-09-30T22:32:17.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f3391815700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338c06ef30 con 0x7f338c1338a0 2023-09-30T22:32:17.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f3391815700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f338c1334b0 con 0x7f338c09e760 2023-09-30T22:32:17.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f338affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338c1338a0 0x7f338c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f338affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338c1338a0 0x7f338c133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42732/0 (socket says 172.21.15.59:42732) 2023-09-30T22:32:17.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f338affd700 1 -- 172.21.15.59:0/3678464995 learned_addr learned my addr 172.21.15.59:0/3678464995 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:17.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f338a7fc700 1 --2- 172.21.15.59:0/3678464995 >> v2:172.21.15.59:3300/0 conn(0x7f338c09de50 0x7f338c09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f338b7fe700 1 --2- 172.21.15.59:0/3678464995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f338c09e760 0x7f338c13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f338a7fc700 1 -- 172.21.15.59:0/3678464995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f338c09e760 msgr2=0x7f338c13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:17.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f338a7fc700 1 --2- 172.21.15.59:0/3678464995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f338c09e760 0x7f338c13a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f338a7fc700 1 -- 172.21.15.59:0/3678464995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338c1338a0 msgr2=0x7f338c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:17.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f338a7fc700 1 --2- 172.21.15.59:0/3678464995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338c1338a0 0x7f338c133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f338a7fc700 1 -- 172.21.15.59:0/3678464995 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c06fc30 con 0x7f338c09de50 2023-09-30T22:32:17.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.339+0000 7f338affd700 1 --2- 172.21.15.59:0/3678464995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338c1338a0 0x7f338c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:17.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.340+0000 7f338a7fc700 1 --2- 172.21.15.59:0/3678464995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f338c09de50 0x7f338c09e220 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f3380009840 tx=0x7f3380009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d7c88b24001975 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:17.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.340+0000 7f3389ffb700 1 -- 172.21.15.59:0/3678464995 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380011830 con 0x7f338c09de50 2023-09-30T22:32:17.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.340+0000 7f3389ffb700 1 -- 172.21.15.59:0/3678464995 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380011990 con 0x7f338c09de50 2023-09-30T22:32:17.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.340+0000 7f3389ffb700 1 -- 172.21.15.59:0/3678464995 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380011d20 con 0x7f338c09de50 2023-09-30T22:32:17.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.341+0000 7f3391815700 1 -- 172.21.15.59:0/3678464995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f338c09de50 msgr2=0x7f338c09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.341+0000 7f3391815700 1 --2- 172.21.15.59:0/3678464995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f338c09de50 0x7f338c09e220 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f3380009840 tx=0x7f3380009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:17.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.341+0000 7f3391815700 1 -- 172.21.15.59:0/3678464995 shutdown_connections 2023-09-30T22:32:17.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.341+0000 7f3391815700 1 --2- 172.21.15.59:0/3678464995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f338c09e760 0x7f338c13a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.341+0000 7f3391815700 1 --2- 172.21.15.59:0/3678464995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338c1338a0 0x7f338c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.341+0000 7f3391815700 1 --2- 172.21.15.59:0/3678464995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f338c09de50 0x7f338c09e220 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.341+0000 7f3391815700 1 -- 172.21.15.59:0/3678464995 >> 172.21.15.59:0/3678464995 conn(0x7f338c0a2aa0 msgr2=0x7f338c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:17.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.341+0000 7f3391815700 1 -- 172.21.15.59:0/3678464995 shutdown_connections 2023-09-30T22:32:17.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.341+0000 7f3391815700 1 -- 172.21.15.59:0/3678464995 wait complete. 2023-09-30T22:32:17.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.342+0000 7f3391815700 1 Processor -- start 2023-09-30T22:32:17.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.343+0000 7f3391815700 1 -- start start 2023-09-30T22:32:17.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.343+0000 7f3391815700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f338c09de50 0x7f338c11ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.343+0000 7f3391815700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f338c09e760 0x7f338c11f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.343+0000 7f3391815700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338c1338a0 0x7f338c11f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.343+0000 7f3391815700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c122760 con 0x7f338c09e760 2023-09-30T22:32:17.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.343+0000 7f3391815700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338c06f640 con 0x7f338c1338a0 2023-09-30T22:32:17.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.343+0000 7f3391815700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f338c1208f0 con 0x7f338c09de50 2023-09-30T22:32:17.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.343+0000 7f338affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f338c09de50 0x7f338c11ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.343+0000 7f338a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f338c09e760 0x7f338c11f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.344+0000 7f338affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f338c09de50 0x7f338c11ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46060/0 (socket says 172.21.15.59:46060) 2023-09-30T22:32:17.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.344+0000 7f338a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f338c09e760 0x7f338c11f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49750/0 (socket says 172.21.15.59:49750) 2023-09-30T22:32:17.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.344+0000 7f338affd700 1 -- 172.21.15.59:0/946801992 learned_addr learned my addr 172.21.15.59:0/946801992 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:17.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.344+0000 7f338b7fe700 1 --2- 172.21.15.59:0/946801992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338c1338a0 0x7f338c11f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.344+0000 7f338a7fc700 1 -- 172.21.15.59:0/946801992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f338c09de50 msgr2=0x7f338c11ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.344+0000 7f338a7fc700 1 --2- 172.21.15.59:0/946801992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f338c09de50 0x7f338c11ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.344+0000 7f338a7fc700 1 -- 172.21.15.59:0/946801992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338c1338a0 msgr2=0x7f338c11f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.344+0000 7f338a7fc700 1 --2- 172.21.15.59:0/946801992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338c1338a0 0x7f338c11f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.344+0000 7f338a7fc700 1 -- 172.21.15.59:0/946801992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c009550 con 0x7f338c09e760 2023-09-30T22:32:17.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.344+0000 7f338affd700 1 --2- 172.21.15.59:0/946801992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f338c09de50 0x7f338c11ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:17.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.344+0000 7f338a7fc700 1 --2- 172.21.15.59:0/946801992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f338c09e760 0x7f338c11f180 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3380016000 tx=0x7f3380004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:17.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.344+0000 7f3373fff700 1 -- 172.21.15.59:0/946801992 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380004510 con 0x7f338c09e760 2023-09-30T22:32:17.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.345+0000 7f3373fff700 1 -- 172.21.15.59:0/946801992 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338001e070 con 0x7f338c09e760 2023-09-30T22:32:17.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.345+0000 7f3373fff700 1 -- 172.21.15.59:0/946801992 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33800038e0 con 0x7f338c09e760 2023-09-30T22:32:17.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.345+0000 7f3391815700 1 -- 172.21.15.59:0/946801992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33800094a0 con 0x7f338c09e760 2023-09-30T22:32:17.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.345+0000 7f3391815700 1 -- 172.21.15.59:0/946801992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338c120010 con 0x7f338c09e760 2023-09-30T22:32:17.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.346+0000 7f3391815700 1 -- 172.21.15.59:0/946801992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338c1223a0 con 0x7f338c09e760 2023-09-30T22:32:17.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.346+0000 7f3373fff700 1 -- 172.21.15.59:0/946801992 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3380003a40 con 0x7f338c09e760 2023-09-30T22:32:17.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.346+0000 7f3373fff700 1 -- 172.21.15.59:0/946801992 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3380040c20 con 0x7f338c09e760 2023-09-30T22:32:17.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.355+0000 7f3373fff700 1 -- 172.21.15.59:0/946801992 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f338002c8e0 con 0x7f338c09e760 2023-09-30T22:32:17.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.380+0000 7f1f906b0700 1 Processor -- start 2023-09-30T22:32:17.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.380+0000 7f1f906b0700 1 -- start start 2023-09-30T22:32:17.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.381+0000 7f1f906b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8809e1d0 0x7f1f88138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.381+0000 7f1f906b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f88139170 0x7f1f8813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.381+0000 7f1f906b0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8809b120 con 0x7f1f8809d6f0 2023-09-30T22:32:17.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.381+0000 7f1f906b0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8806b460 con 0x7f1f88139170 2023-09-30T22:32:17.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.381+0000 7f1f906b0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8809a7e0 con 0x7f1f8809e1d0 2023-09-30T22:32:17.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.382+0000 7f1f8e44c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1f8809d6f0 0x7f1f8809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39768/0 (socket says 172.21.15.59:39768) 2023-09-30T22:32:17.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.382+0000 7f1f8e44c700 1 -- 172.21.15.59:0/2361561007 learned_addr learned my addr 172.21.15.59:0/2361561007 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:17.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.382+0000 7f1f8dc4b700 1 --2- 172.21.15.59:0/2361561007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8809e1d0 0x7f1f88138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.382+0000 7f1f8ec4d700 1 --2- 172.21.15.59:0/2361561007 >> v2:172.21.15.59:3300/0 conn(0x7f1f88139170 0x7f1f8813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.382+0000 7f1f8ec4d700 1 -- 172.21.15.59:0/2361561007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8809e1d0 msgr2=0x7f1f88138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.382+0000 7f1f8ec4d700 1 --2- 172.21.15.59:0/2361561007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8809e1d0 0x7f1f88138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.382+0000 7f1f8ec4d700 1 -- 172.21.15.59:0/2361561007 >> v1:172.21.15.59:6789/0 conn(0x7f1f8809d6f0 legacy=0x7f1f8809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.382+0000 7f1f8ec4d700 1 -- 172.21.15.59:0/2361561007 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8809a500 con 0x7f1f88139170 2023-09-30T22:32:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.382+0000 7f1f8ec4d700 1 --2- 172.21.15.59:0/2361561007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f88139170 0x7f1f8813b550 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009d90 tx=0x7f1f8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a9be2a816275a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.383+0000 7f1f8d44a700 1 -- 172.21.15.59:0/2361561007 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8000e070 con 0x7f1f88139170 2023-09-30T22:32:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.383+0000 7f1f8d44a700 1 -- 172.21.15.59:0/2361561007 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8000bb20 con 0x7f1f88139170 2023-09-30T22:32:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.383+0000 7f1f8d44a700 1 -- 172.21.15.59:0/2361561007 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f80012430 con 0x7f1f88139170 2023-09-30T22:32:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.384+0000 7f1f906b0700 1 -- 172.21.15.59:0/2361561007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f88139170 msgr2=0x7f1f8813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.384+0000 7f1f906b0700 1 --2- 172.21.15.59:0/2361561007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f88139170 0x7f1f8813b550 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009d90 tx=0x7f1f8000b330 comp rx=0 tx=0).stop 2023-09-30T22:32:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.384+0000 7f1f906b0700 1 -- 172.21.15.59:0/2361561007 shutdown_connections 2023-09-30T22:32:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.384+0000 7f1f906b0700 1 --2- 172.21.15.59:0/2361561007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f88139170 0x7f1f8813b550 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.384+0000 7f1f906b0700 1 --2- 172.21.15.59:0/2361561007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8809e1d0 0x7f1f88138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.384+0000 7f1f906b0700 1 -- 172.21.15.59:0/2361561007 >> 172.21.15.59:0/2361561007 conn(0x7f1f88066f50 msgr2=0x7f1f8809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.384+0000 7f1f906b0700 1 -- 172.21.15.59:0/2361561007 shutdown_connections 2023-09-30T22:32:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.384+0000 7f1f906b0700 1 -- 172.21.15.59:0/2361561007 wait complete. 2023-09-30T22:32:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.385+0000 7f1f906b0700 1 Processor -- start 2023-09-30T22:32:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.385+0000 7f1f906b0700 1 -- start start 2023-09-30T22:32:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.386+0000 7f1f906b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f8809d6f0 0x7f1f881206c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.386+0000 7f1f906b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8809e1d0 0x7f1f88120c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.386+0000 7f1f906b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f88139170 0x7f1f88121140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.386+0000 7f1f906b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f880a2a30 con 0x7f1f8809d6f0 2023-09-30T22:32:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.386+0000 7f1f906b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f88123c40 con 0x7f1f88139170 2023-09-30T22:32:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.386+0000 7f1f906b0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f881223e0 con 0x7f1f8809e1d0 2023-09-30T22:32:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.386+0000 7f1f8ec4d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f88139170 0x7f1f88121140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.386+0000 7f1f8ec4d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f88139170 0x7f1f88121140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42762/0 (socket says 172.21.15.59:42762) 2023-09-30T22:32:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.386+0000 7f1f8ec4d700 1 -- 172.21.15.59:0/522659492 learned_addr learned my addr 172.21.15.59:0/522659492 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.386+0000 7f1f8e44c700 1 --2- 172.21.15.59:0/522659492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f8809d6f0 0x7f1f881206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.387+0000 7f1f8dc4b700 1 --2- 172.21.15.59:0/522659492 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8809e1d0 0x7f1f88120c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.387+0000 7f1f8e44c700 1 -- 172.21.15.59:0/522659492 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8809e1d0 msgr2=0x7f1f88120c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.387+0000 7f1f8e44c700 1 --2- 172.21.15.59:0/522659492 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8809e1d0 0x7f1f88120c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.387+0000 7f1f8e44c700 1 -- 172.21.15.59:0/522659492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f88139170 msgr2=0x7f1f88121140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.387+0000 7f1f8e44c700 1 --2- 172.21.15.59:0/522659492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f88139170 0x7f1f88121140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.387+0000 7f1f8e44c700 1 -- 172.21.15.59:0/522659492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f80009a70 con 0x7f1f8809d6f0 2023-09-30T22:32:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.387+0000 7f1f8e44c700 1 --2- 172.21.15.59:0/522659492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f8809d6f0 0x7f1f881206c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400c530 tx=0x7f1f8400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.387+0000 7f1f7effd700 1 -- 172.21.15.59:0/522659492 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8400cea0 con 0x7f1f8809d6f0 2023-09-30T22:32:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.388+0000 7f1f7effd700 1 -- 172.21.15.59:0/522659492 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f84005d70 con 0x7f1f8809d6f0 2023-09-30T22:32:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.388+0000 7f1f906b0700 1 -- 172.21.15.59:0/522659492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8809c710 con 0x7f1f8809d6f0 2023-09-30T22:32:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.388+0000 7f1f7effd700 1 -- 172.21.15.59:0/522659492 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f840072d0 con 0x7f1f8809d6f0 2023-09-30T22:32:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.388+0000 7f1f906b0700 1 -- 172.21.15.59:0/522659492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f88124970 con 0x7f1f8809d6f0 2023-09-30T22:32:17.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.389+0000 7f1f7effd700 1 -- 172.21.15.59:0/522659492 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f84007430 con 0x7f1f8809d6f0 2023-09-30T22:32:17.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.389+0000 7f1f7effd700 1 -- 172.21.15.59:0/522659492 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f8403eb80 con 0x7f1f8809d6f0 2023-09-30T22:32:17.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.389+0000 7f1f906b0700 1 -- 172.21.15.59:0/522659492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f88074ea0 con 0x7f1f8809d6f0 2023-09-30T22:32:17.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.398+0000 7f1f7effd700 1 -- 172.21.15.59:0/522659492 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f84017080 con 0x7f1f8809d6f0 2023-09-30T22:32:17.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.409+0000 7fb0b7c47700 1 Processor -- start 2023-09-30T22:32:17.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.409+0000 7fb0b7c47700 1 -- start start 2023-09-30T22:32:17.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.409+0000 7fb0b7c47700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb0b009eca0 0x7fb0b013cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.409+0000 7fb0b7c47700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b006f050 0x7fb0b013f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.409+0000 7fb0b7c47700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b0070ee0 con 0x7fb0b006e570 2023-09-30T22:32:17.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.410+0000 7fb0b7c47700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b0071980 con 0x7fb0b009eca0 2023-09-30T22:32:17.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.410+0000 7fb0b7c47700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0071480 con 0x7fb0b006f050 2023-09-30T22:32:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.410+0000 7fb0b51e2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb0b009eca0 0x7fb0b013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.410+0000 7fb0b59e3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb0b006e570 0x7fb0b006e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39778/0 (socket says 172.21.15.59:39778) 2023-09-30T22:32:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.410+0000 7fb0b59e3700 1 -- 172.21.15.59:0/3071212946 learned_addr learned my addr 172.21.15.59:0/3071212946 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.410+0000 7fb0b61e4700 1 --2- 172.21.15.59:0/3071212946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b006f050 0x7fb0b013f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.410+0000 7fb0b49e1700 1 -- 172.21.15.59:0/3071212946 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159456988 0 0) 0x7fb0b0070ee0 con 0x7fb0b006e570 2023-09-30T22:32:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.410+0000 7fb0b49e1700 1 -- 172.21.15.59:0/3071212946 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb09c0035b0 con 0x7fb0b006e570 2023-09-30T22:32:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.410+0000 7fb0b51e2700 1 -- 172.21.15.59:0/3071212946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b006f050 msgr2=0x7fb0b013f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.410+0000 7fb0b51e2700 1 --2- 172.21.15.59:0/3071212946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b006f050 0x7fb0b013f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.410+0000 7fb0b49e1700 1 -- 172.21.15.59:0/3071212946 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 14233010 0 0) 0x7fb09c0035b0 con 0x7fb0b006e570 2023-09-30T22:32:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.410+0000 7fb0b51e2700 1 -- 172.21.15.59:0/3071212946 >> v1:172.21.15.59:6789/0 conn(0x7fb0b006e570 legacy=0x7fb0b006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.410+0000 7fb0b51e2700 1 -- 172.21.15.59:0/3071212946 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b0071b90 con 0x7fb0b009eca0 2023-09-30T22:32:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.411+0000 7fb0b51e2700 1 --2- 172.21.15.59:0/3071212946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b009eca0 0x7fb0b013cea0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009840 tx=0x7fb0a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68051bf0aec7d7f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.411+0000 7fb0b49e1700 1 -- 172.21.15.59:0/3071212946 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac001670 con 0x7fb0b009eca0 2023-09-30T22:32:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.411+0000 7fb0b49e1700 1 -- 172.21.15.59:0/3071212946 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a0004030 con 0x7fb0b009eca0 2023-09-30T22:32:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.411+0000 7fb0b49e1700 1 -- 172.21.15.59:0/3071212946 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a00043c0 con 0x7fb0b009eca0 2023-09-30T22:32:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.412+0000 7fb0b7c47700 1 -- 172.21.15.59:0/3071212946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b009eca0 msgr2=0x7fb0b013cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.412+0000 7fb0b7c47700 1 --2- 172.21.15.59:0/3071212946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b009eca0 0x7fb0b013cea0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009840 tx=0x7fb0a0009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.412+0000 7fb0b7c47700 1 -- 172.21.15.59:0/3071212946 shutdown_connections 2023-09-30T22:32:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.412+0000 7fb0b7c47700 1 --2- 172.21.15.59:0/3071212946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b006f050 0x7fb0b013f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.412+0000 7fb0b7c47700 1 --2- 172.21.15.59:0/3071212946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b009eca0 0x7fb0b013cea0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.412+0000 7fb0b7c47700 1 -- 172.21.15.59:0/3071212946 >> 172.21.15.59:0/3071212946 conn(0x7fb0b00a2aa0 msgr2=0x7fb0b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:17.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.412+0000 7fb0b7c47700 1 -- 172.21.15.59:0/3071212946 shutdown_connections 2023-09-30T22:32:17.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.412+0000 7fb0b7c47700 1 -- 172.21.15.59:0/3071212946 wait complete. 2023-09-30T22:32:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.413+0000 7fb0b7c47700 1 Processor -- start 2023-09-30T22:32:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.413+0000 7fb0b7c47700 1 -- start start 2023-09-30T22:32:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.414+0000 7fb0b7c47700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b006e570 0x7fb0b0136f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.414+0000 7fb0b7c47700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b006f050 0x7fb0b01374a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.414+0000 7fb0b7c47700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b011add0 0x7fb0b01379e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.414+0000 7fb0b7c47700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b01316a0 con 0x7fb0b006f050 2023-09-30T22:32:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.414+0000 7fb0b7c47700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b011a330 con 0x7fb0b011add0 2023-09-30T22:32:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.414+0000 7fb0b7c47700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0070610 con 0x7fb0b006e570 2023-09-30T22:32:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.414+0000 7fb0b61e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b011add0 0x7fb0b01379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.414+0000 7fb0b61e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b011add0 0x7fb0b01379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42784/0 (socket says 172.21.15.59:42784) 2023-09-30T22:32:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.414+0000 7fb0b61e4700 1 -- 172.21.15.59:0/2320735203 learned_addr learned my addr 172.21.15.59:0/2320735203 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.414+0000 7fb0b51e2700 1 --2- 172.21.15.59:0/2320735203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b006f050 0x7fb0b01374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.415+0000 7fb0b59e3700 1 --2- 172.21.15.59:0/2320735203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b006e570 0x7fb0b0136f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.415+0000 7fb0b61e4700 1 -- 172.21.15.59:0/2320735203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b006e570 msgr2=0x7fb0b0136f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.415+0000 7fb0b61e4700 1 --2- 172.21.15.59:0/2320735203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b006e570 0x7fb0b0136f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.415+0000 7fb0b61e4700 1 -- 172.21.15.59:0/2320735203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b006f050 msgr2=0x7fb0b01374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.415+0000 7fb0b61e4700 1 --2- 172.21.15.59:0/2320735203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b006f050 0x7fb0b01374a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.415+0000 7fb0b61e4700 1 -- 172.21.15.59:0/2320735203 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a00094a0 con 0x7fb0b011add0 2023-09-30T22:32:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.415+0000 7fb0b51e2700 1 --2- 172.21.15.59:0/2320735203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b006f050 0x7fb0b01374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.415+0000 7fb0b59e3700 1 --2- 172.21.15.59:0/2320735203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b006e570 0x7fb0b0136f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.415+0000 7fb0b61e4700 1 --2- 172.21.15.59:0/2320735203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b011add0 0x7fb0b01379e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800efc0 tx=0x7fb0a800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.415+0000 7fb0a67fc700 1 -- 172.21.15.59:0/2320735203 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8009ea0 con 0x7fb0b011add0 2023-09-30T22:32:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.415+0000 7fb0a67fc700 1 -- 172.21.15.59:0/2320735203 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a800f040 con 0x7fb0b011add0 2023-09-30T22:32:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.415+0000 7fb0b7c47700 1 -- 172.21.15.59:0/2320735203 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b0138760 con 0x7fb0b011add0 2023-09-30T22:32:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.415+0000 7fb0a67fc700 1 -- 172.21.15.59:0/2320735203 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8014480 con 0x7fb0b011add0 2023-09-30T22:32:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.415+0000 7fb0b7c47700 1 -- 172.21.15.59:0/2320735203 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b01197c0 con 0x7fb0b011add0 2023-09-30T22:32:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.417+0000 7fb0a67fc700 1 -- 172.21.15.59:0/2320735203 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0a80145e0 con 0x7fb0b011add0 2023-09-30T22:32:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.417+0000 7fb0b7c47700 1 -- 172.21.15.59:0/2320735203 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b0074ea0 con 0x7fb0b011add0 2023-09-30T22:32:17.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.417+0000 7fb0a67fc700 1 -- 172.21.15.59:0/2320735203 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb0a803ff90 con 0x7fb0b011add0 2023-09-30T22:32:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.422+0000 7fb0a67fc700 1 -- 172.21.15.59:0/2320735203 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0a801a8b0 con 0x7fb0b011add0 2023-09-30T22:32:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.423+0000 7fb22518e700 1 Processor -- start 2023-09-30T22:32:17.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.423+0000 7fb22518e700 1 -- start start 2023-09-30T22:32:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.423+0000 7fb22518e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22009d6f0 0x7fb22009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.424+0000 7fb22518e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22009e410 0x7fb220130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.424+0000 7fb22518e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22009f130 con 0x7fb22009e000 2023-09-30T22:32:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.424+0000 7fb22518e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22009f520 con 0x7fb22009d6f0 2023-09-30T22:32:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.424+0000 7fb22518e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb22009e930 con 0x7fb22009e410 2023-09-30T22:32:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.424+0000 7fb21ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22009d6f0 0x7fb22009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.424+0000 7fb21ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22009d6f0 0x7fb22009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42792/0 (socket says 172.21.15.59:42792) 2023-09-30T22:32:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.424+0000 7fb21ed9d700 1 -- 172.21.15.59:0/58958446 learned_addr learned my addr 172.21.15.59:0/58958446 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.424+0000 7fb21ed9d700 1 -- 172.21.15.59:0/58958446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22009e410 msgr2=0x7fb220130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.424+0000 7fb21ed9d700 1 --2- 172.21.15.59:0/58958446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22009e410 0x7fb220130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.424+0000 7fb21ed9d700 1 -- 172.21.15.59:0/58958446 >> v1:172.21.15.59:6789/0 conn(0x7fb22009e000 legacy=0x7fb220130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.424+0000 7fb21ed9d700 1 -- 172.21.15.59:0/58958446 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22009b2d0 con 0x7fb22009d6f0 2023-09-30T22:32:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.424+0000 7fb21dd9b700 1 -- 172.21.15.59:0/58958446 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896085825 0 0) 0x7fb22009f130 con 0x7fb22009e000 2023-09-30T22:32:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.424+0000 7fb21ed9d700 1 --2- 172.21.15.59:0/58958446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22009d6f0 0x7fb22009dac0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb210009920 tx=0x7fb210009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9358de9e119d965b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:17.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.425+0000 7fb21dd9b700 1 -- 172.21.15.59:0/58958446 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21000ba60 con 0x7fb22009d6f0 2023-09-30T22:32:17.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.425+0000 7fb21dd9b700 1 -- 172.21.15.59:0/58958446 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21000bbc0 con 0x7fb22009d6f0 2023-09-30T22:32:17.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.425+0000 7fb21dd9b700 1 -- 172.21.15.59:0/58958446 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210009e70 con 0x7fb22009d6f0 2023-09-30T22:32:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.426+0000 7fb22518e700 1 -- 172.21.15.59:0/58958446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22009d6f0 msgr2=0x7fb22009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.426+0000 7fb22518e700 1 --2- 172.21.15.59:0/58958446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22009d6f0 0x7fb22009dac0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb210009920 tx=0x7fb210009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.426+0000 7fb22518e700 1 -- 172.21.15.59:0/58958446 shutdown_connections 2023-09-30T22:32:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.426+0000 7fb22518e700 1 --2- 172.21.15.59:0/58958446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22009e410 0x7fb220130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.426+0000 7fb22518e700 1 --2- 172.21.15.59:0/58958446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22009d6f0 0x7fb22009dac0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.426+0000 7fb22518e700 1 -- 172.21.15.59:0/58958446 >> 172.21.15.59:0/58958446 conn(0x7fb220066f50 msgr2=0x7fb22009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.426+0000 7fb22518e700 1 -- 172.21.15.59:0/58958446 shutdown_connections 2023-09-30T22:32:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.426+0000 7fb22518e700 1 -- 172.21.15.59:0/58958446 wait complete. 2023-09-30T22:32:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.428+0000 7fb22518e700 1 Processor -- start 2023-09-30T22:32:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.428+0000 7fb22518e700 1 -- start start 2023-09-30T22:32:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.428+0000 7fb22518e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22009d6f0 0x7fb22011ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.428+0000 7fb22518e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb22009e000 0x7fb22011e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.428+0000 7fb22518e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22009e410 0x7fb22011e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.428+0000 7fb22518e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22011ffe0 con 0x7fb22009e000 2023-09-30T22:32:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.428+0000 7fb22518e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb220120ca0 con 0x7fb22009d6f0 2023-09-30T22:32:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.428+0000 7fb22518e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb220072040 con 0x7fb22009e410 2023-09-30T22:32:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.429+0000 7fb21ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22009d6f0 0x7fb22011ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.429+0000 7fb21ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22009d6f0 0x7fb22011ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42802/0 (socket says 172.21.15.59:42802) 2023-09-30T22:32:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.429+0000 7fb21ed9d700 1 -- 172.21.15.59:0/2307981911 learned_addr learned my addr 172.21.15.59:0/2307981911 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.429+0000 7fb21e59c700 1 --2- 172.21.15.59:0/2307981911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb22009e000 0x7fb22011e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.429+0000 7fb21f59e700 1 --2- 172.21.15.59:0/2307981911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22009e410 0x7fb22011e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.429+0000 7fb21ed9d700 1 -- 172.21.15.59:0/2307981911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22009e410 msgr2=0x7fb22011e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.429+0000 7fb21ed9d700 1 --2- 172.21.15.59:0/2307981911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22009e410 0x7fb22011e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.429+0000 7fb21ed9d700 1 -- 172.21.15.59:0/2307981911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb22009e000 msgr2=0x7fb22011e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.429+0000 7fb21ed9d700 1 --2- 172.21.15.59:0/2307981911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb22009e000 0x7fb22011e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.429+0000 7fb21ed9d700 1 -- 172.21.15.59:0/2307981911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb210009550 con 0x7fb22009d6f0 2023-09-30T22:32:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.429+0000 7fb21e59c700 1 --2- 172.21.15.59:0/2307981911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb22009e000 0x7fb22011e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.430+0000 7fb21ed9d700 1 --2- 172.21.15.59:0/2307981911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22009d6f0 0x7fb22011ddb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb210000c00 tx=0x7fb210004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.430+0000 7fb2077fe700 1 -- 172.21.15.59:0/2307981911 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210004340 con 0x7fb22009d6f0 2023-09-30T22:32:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.430+0000 7fb2077fe700 1 -- 172.21.15.59:0/2307981911 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21001f070 con 0x7fb22009d6f0 2023-09-30T22:32:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.430+0000 7fb22518e700 1 -- 172.21.15.59:0/2307981911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb220121060 con 0x7fb22009d6f0 2023-09-30T22:32:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.430+0000 7fb2077fe700 1 -- 172.21.15.59:0/2307981911 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2100036a0 con 0x7fb22009d6f0 2023-09-30T22:32:17.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.430+0000 7fb22518e700 1 -- 172.21.15.59:0/2307981911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22011f9c0 con 0x7fb22009d6f0 2023-09-30T22:32:17.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.431+0000 7fb2077fe700 1 -- 172.21.15.59:0/2307981911 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb210021030 con 0x7fb22009d6f0 2023-09-30T22:32:17.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.431+0000 7fb2077fe700 1 -- 172.21.15.59:0/2307981911 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb210044460 con 0x7fb22009d6f0 2023-09-30T22:32:17.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.432+0000 7fb22518e700 1 -- 172.21.15.59:0/2307981911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb220121290 con 0x7fb22009d6f0 2023-09-30T22:32:17.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.441+0000 7fb2077fe700 1 -- 172.21.15.59:0/2307981911 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb220121290 con 0x7fb22009d6f0 2023-09-30T22:32:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.575+0000 7f3391815700 1 -- 172.21.15.59:0/946801992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f338c074ea0 con 0x7f338c09e760 2023-09-30T22:32:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.575+0000 7f3373fff700 1 -- 172.21.15.59:0/946801992 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3380015070 con 0x7f338c09e760 2023-09-30T22:32:17.575 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.577+0000 7f3391815700 1 -- 172.21.15.59:0/946801992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f338c09e760 msgr2=0x7f338c11f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.577+0000 7f3391815700 1 --2- 172.21.15.59:0/946801992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f338c09e760 0x7f338c11f180 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3380016000 tx=0x7f3380004750 comp rx=0 tx=0).stop 2023-09-30T22:32:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.577+0000 7f3391815700 1 -- 172.21.15.59:0/946801992 shutdown_connections 2023-09-30T22:32:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.577+0000 7f3391815700 1 --2- 172.21.15.59:0/946801992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f338c09de50 0x7f338c11ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.577+0000 7f3391815700 1 --2- 172.21.15.59:0/946801992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338c1338a0 0x7f338c11f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.577+0000 7f3391815700 1 --2- 172.21.15.59:0/946801992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f338c09e760 0x7f338c11f180 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.577+0000 7f3391815700 1 -- 172.21.15.59:0/946801992 >> 172.21.15.59:0/946801992 conn(0x7f338c0a2aa0 msgr2=0x7f338c09ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:17.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.578+0000 7f3391815700 1 -- 172.21.15.59:0/946801992 shutdown_connections 2023-09-30T22:32:17.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.578+0000 7f3391815700 1 -- 172.21.15.59:0/946801992 wait complete. 2023-09-30T22:32:17.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:17.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.614+0000 7f1f906b0700 1 -- 172.21.15.59:0/522659492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1f8806c360 con 0x7f1f8809d6f0 2023-09-30T22:32:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.615+0000 7f1f7effd700 1 -- 172.21.15.59:0/522659492 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f8401b3b0 con 0x7f1f8809d6f0 2023-09-30T22:32:17.615 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:17.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.617+0000 7f1f906b0700 1 -- 172.21.15.59:0/522659492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f8809d6f0 msgr2=0x7f1f881206c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.617+0000 7f1f906b0700 1 --2- 172.21.15.59:0/522659492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f8809d6f0 0x7f1f881206c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400c530 tx=0x7f1f8400c840 comp rx=0 tx=0).stop 2023-09-30T22:32:17.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.617+0000 7f1f906b0700 1 -- 172.21.15.59:0/522659492 shutdown_connections 2023-09-30T22:32:17.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.617+0000 7f1f906b0700 1 --2- 172.21.15.59:0/522659492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f88139170 0x7f1f88121140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.617+0000 7f1f906b0700 1 --2- 172.21.15.59:0/522659492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f8809d6f0 0x7f1f881206c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.617+0000 7f1f906b0700 1 --2- 172.21.15.59:0/522659492 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8809e1d0 0x7f1f88120c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.617+0000 7f1f906b0700 1 -- 172.21.15.59:0/522659492 >> 172.21.15.59:0/522659492 conn(0x7f1f88066f50 msgr2=0x7f1f880a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:17.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.617+0000 7f1f906b0700 1 -- 172.21.15.59:0/522659492 shutdown_connections 2023-09-30T22:32:17.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.617+0000 7f1f906b0700 1 -- 172.21.15.59:0/522659492 wait complete. 2023-09-30T22:32:17.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.657+0000 7fb0b7c47700 1 -- 172.21.15.59:0/2320735203 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb0b011a470 con 0x7fb0b011add0 2023-09-30T22:32:17.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.657+0000 7fb0a67fc700 1 -- 172.21.15.59:0/2320735203 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0a8018020 con 0x7fb0b011add0 2023-09-30T22:32:17.658 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.660+0000 7fb0b7c47700 1 -- 172.21.15.59:0/2320735203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b011add0 msgr2=0x7fb0b01379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.660+0000 7fb0b7c47700 1 --2- 172.21.15.59:0/2320735203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b011add0 0x7fb0b01379e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800efc0 tx=0x7fb0a800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.660+0000 7fb0b7c47700 1 -- 172.21.15.59:0/2320735203 shutdown_connections 2023-09-30T22:32:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.660+0000 7fb0b7c47700 1 --2- 172.21.15.59:0/2320735203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b006e570 0x7fb0b0136f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.660+0000 7fb0b7c47700 1 --2- 172.21.15.59:0/2320735203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b011add0 0x7fb0b01379e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.660+0000 7fb0b7c47700 1 --2- 172.21.15.59:0/2320735203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b006f050 0x7fb0b01374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.660+0000 7fb0b7c47700 1 -- 172.21.15.59:0/2320735203 >> 172.21.15.59:0/2320735203 conn(0x7fb0b00a2aa0 msgr2=0x7fb0b009ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.660+0000 7fb0b7c47700 1 -- 172.21.15.59:0/2320735203 shutdown_connections 2023-09-30T22:32:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.660+0000 7fb0b7c47700 1 -- 172.21.15.59:0/2320735203 wait complete. 2023-09-30T22:32:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.673+0000 7fb22518e700 1 -- 172.21.15.59:0/2307981911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb220121290 con 0x7fb22009d6f0 2023-09-30T22:32:17.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.673+0000 7fb2077fe700 1 -- 172.21.15.59:0/2307981911 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb220121290 con 0x7fb22009d6f0 2023-09-30T22:32:17.674 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.675+0000 7fb22518e700 1 -- 172.21.15.59:0/2307981911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22009d6f0 msgr2=0x7fb22011ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.675+0000 7fb22518e700 1 --2- 172.21.15.59:0/2307981911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22009d6f0 0x7fb22011ddb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb210000c00 tx=0x7fb210004750 comp rx=0 tx=0).stop 2023-09-30T22:32:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.675+0000 7fb22518e700 1 -- 172.21.15.59:0/2307981911 shutdown_connections 2023-09-30T22:32:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.675+0000 7fb22518e700 1 --2- 172.21.15.59:0/2307981911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22009e410 0x7fb22011e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.675+0000 7fb22518e700 1 --2- 172.21.15.59:0/2307981911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22009d6f0 0x7fb22011ddb0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.675+0000 7fb22518e700 1 --2- 172.21.15.59:0/2307981911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb22009e000 0x7fb22011e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.675+0000 7fb22518e700 1 -- 172.21.15.59:0/2307981911 >> 172.21.15.59:0/2307981911 conn(0x7fb220066f50 msgr2=0x7fb220130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.675+0000 7fb22518e700 1 -- 172.21.15.59:0/2307981911 shutdown_connections 2023-09-30T22:32:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:17.676+0000 7fb22518e700 1 -- 172.21.15.59:0/2307981911 wait complete. 2023-09-30T22:32:17.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:18.594 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:18.633 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:18.675 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:18.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:18.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.749+0000 7f9e49054700 1 Processor -- start 2023-09-30T22:32:18.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.749+0000 7f9e49054700 1 -- start start 2023-09-30T22:32:18.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.750+0000 7f9e49054700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e4409e1d0 0x7f9e44135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.750+0000 7f9e49054700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e44135e50 0x7f9e44138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.750+0000 7f9e49054700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4409f130 con 0x7f9e4409d6f0 2023-09-30T22:32:18.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.750+0000 7f9e49054700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4409f520 con 0x7f9e44135e50 2023-09-30T22:32:18.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.750+0000 7f9e49054700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4409e930 con 0x7f9e4409e1d0 2023-09-30T22:32:18.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.750+0000 7f9e42d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9e4409d6f0 0x7f9e4409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39802/0 (socket says 172.21.15.59:39802) 2023-09-30T22:32:18.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.750+0000 7f9e42d9d700 1 -- 172.21.15.59:0/1360094351 learned_addr learned my addr 172.21.15.59:0/1360094351 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:18.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.750+0000 7f9e4359e700 1 --2- 172.21.15.59:0/1360094351 >> v2:172.21.15.59:3300/0 conn(0x7f9e44135e50 0x7f9e44138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.750+0000 7f9e4259c700 1 --2- 172.21.15.59:0/1360094351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e4409e1d0 0x7f9e44135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.750+0000 7f9e4359e700 1 -- 172.21.15.59:0/1360094351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e4409e1d0 msgr2=0x7f9e44135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:18.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.750+0000 7f9e4359e700 1 --2- 172.21.15.59:0/1360094351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e4409e1d0 0x7f9e44135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.750+0000 7f9e4359e700 1 -- 172.21.15.59:0/1360094351 >> v1:172.21.15.59:6789/0 conn(0x7f9e4409d6f0 legacy=0x7f9e4409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.750+0000 7f9e41d9b700 1 -- 172.21.15.59:0/1360094351 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378421191 0 0) 0x7f9e4409f130 con 0x7f9e4409d6f0 2023-09-30T22:32:18.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.750+0000 7f9e4359e700 1 -- 172.21.15.59:0/1360094351 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4409b2d0 con 0x7f9e44135e50 2023-09-30T22:32:18.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.751+0000 7f9e4359e700 1 --2- 172.21.15.59:0/1360094351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e44135e50 0x7f9e44138230 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009dc0 tx=0x7f9e3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca72665b0f758774 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:18.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.751+0000 7f9e41d9b700 1 -- 172.21.15.59:0/1360094351 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c00e070 con 0x7f9e44135e50 2023-09-30T22:32:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.751+0000 7f9e41d9b700 1 -- 172.21.15.59:0/1360094351 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c00bae0 con 0x7f9e44135e50 2023-09-30T22:32:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.751+0000 7f9e41d9b700 1 -- 172.21.15.59:0/1360094351 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c00be90 con 0x7f9e44135e50 2023-09-30T22:32:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.752+0000 7f9e49054700 1 -- 172.21.15.59:0/1360094351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e44135e50 msgr2=0x7f9e44138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.752+0000 7f9e49054700 1 --2- 172.21.15.59:0/1360094351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e44135e50 0x7f9e44138230 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009dc0 tx=0x7f9e3c00b330 comp rx=0 tx=0).stop 2023-09-30T22:32:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.752+0000 7f9e49054700 1 -- 172.21.15.59:0/1360094351 shutdown_connections 2023-09-30T22:32:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.752+0000 7f9e49054700 1 --2- 172.21.15.59:0/1360094351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e44135e50 0x7f9e44138230 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.752+0000 7f9e49054700 1 --2- 172.21.15.59:0/1360094351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e4409e1d0 0x7f9e44135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.752+0000 7f9e49054700 1 -- 172.21.15.59:0/1360094351 >> 172.21.15.59:0/1360094351 conn(0x7f9e44066f50 msgr2=0x7f9e4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.752+0000 7f9e49054700 1 -- 172.21.15.59:0/1360094351 shutdown_connections 2023-09-30T22:32:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.752+0000 7f9e49054700 1 -- 172.21.15.59:0/1360094351 wait complete. 2023-09-30T22:32:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.753+0000 7f9e49054700 1 Processor -- start 2023-09-30T22:32:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.753+0000 7f9e49054700 1 -- start start 2023-09-30T22:32:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.754+0000 7f9e49054700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e4409d6f0 0x7f9e441c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.754+0000 7f9e49054700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e4409e1d0 0x7f9e441c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.754+0000 7f9e49054700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e44135e50 0x7f9e441c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.754+0000 7f9e49054700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e441313f0 con 0x7f9e4409e1d0 2023-09-30T22:32:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.754+0000 7f9e49054700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44121dc0 con 0x7f9e44135e50 2023-09-30T22:32:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.754+0000 7f9e49054700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4411b560 con 0x7f9e4409d6f0 2023-09-30T22:32:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.754+0000 7f9e4359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e44135e50 0x7f9e441c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.754+0000 7f9e4359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e44135e50 0x7f9e441c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42822/0 (socket says 172.21.15.59:42822) 2023-09-30T22:32:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.754+0000 7f9e42d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e4409d6f0 0x7f9e441c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.754+0000 7f9e4359e700 1 -- 172.21.15.59:0/1127370942 learned_addr learned my addr 172.21.15.59:0/1127370942 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.754+0000 7f9e4259c700 1 --2- 172.21.15.59:0/1127370942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e4409e1d0 0x7f9e441c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.755+0000 7f9e4359e700 1 -- 172.21.15.59:0/1127370942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e4409d6f0 msgr2=0x7f9e441c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.755+0000 7f9e4359e700 1 --2- 172.21.15.59:0/1127370942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e4409d6f0 0x7f9e441c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.755+0000 7f9e4359e700 1 -- 172.21.15.59:0/1127370942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e4409e1d0 msgr2=0x7f9e441c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.755+0000 7f9e4359e700 1 --2- 172.21.15.59:0/1127370942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e4409e1d0 0x7f9e441c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.755+0000 7f9e4359e700 1 -- 172.21.15.59:0/1127370942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c009a70 con 0x7f9e44135e50 2023-09-30T22:32:18.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.755+0000 7f9e4259c700 1 --2- 172.21.15.59:0/1127370942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e4409e1d0 0x7f9e441c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:18.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.755+0000 7f9e42d9d700 1 --2- 172.21.15.59:0/1127370942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e4409d6f0 0x7f9e441c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:18.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.755+0000 7f9e4359e700 1 --2- 172.21.15.59:0/1127370942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e44135e50 0x7f9e441c8d70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c014040 tx=0x7f9e3c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.755+0000 7f9e2b7fe700 1 -- 172.21.15.59:0/1127370942 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c027480 con 0x7f9e44135e50 2023-09-30T22:32:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.755+0000 7f9e2b7fe700 1 -- 172.21.15.59:0/1127370942 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c020070 con 0x7f9e44135e50 2023-09-30T22:32:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.755+0000 7f9e49054700 1 -- 172.21.15.59:0/1127370942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4411d450 con 0x7f9e44135e50 2023-09-30T22:32:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.755+0000 7f9e2b7fe700 1 -- 172.21.15.59:0/1127370942 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c027820 con 0x7f9e44135e50 2023-09-30T22:32:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.755+0000 7f9e49054700 1 -- 172.21.15.59:0/1127370942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4406a9e0 con 0x7f9e44135e50 2023-09-30T22:32:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.756+0000 7f9e2b7fe700 1 -- 172.21.15.59:0/1127370942 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e3c01b400 con 0x7f9e44135e50 2023-09-30T22:32:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.756+0000 7f9e2b7fe700 1 -- 172.21.15.59:0/1127370942 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9e3c022070 con 0x7f9e44135e50 2023-09-30T22:32:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.757+0000 7f9e49054700 1 -- 172.21.15.59:0/1127370942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e44074ea0 con 0x7f9e44135e50 2023-09-30T22:32:18.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.763+0000 7f9e2b7fe700 1 -- 172.21.15.59:0/1127370942 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e3c02c080 con 0x7f9e44135e50 2023-09-30T22:32:18.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.788+0000 7fbe02289700 1 Processor -- start 2023-09-30T22:32:18.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.788+0000 7fbe02289700 1 -- start start 2023-09-30T22:32:18.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.788+0000 7fbe02289700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdfc136710 0x7fbdfc138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.788+0000 7fbe02289700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdfc139030 0x7fbdfc13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.788+0000 7fbe02289700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdfc06ef30 con 0x7fbdfc1338a0 2023-09-30T22:32:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.788+0000 7fbe02289700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc06fef0 con 0x7fbdfc139030 2023-09-30T22:32:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.788+0000 7fbe02289700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc1334b0 con 0x7fbdfc136710 2023-09-30T22:32:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.789+0000 7fbdfb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdfc136710 0x7fbdfc138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.789+0000 7fbdfb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdfc136710 0x7fbdfc138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46146/0 (socket says 172.21.15.59:46146) 2023-09-30T22:32:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.789+0000 7fbdfb7fe700 1 -- 172.21.15.59:0/1395281180 learned_addr learned my addr 172.21.15.59:0/1395281180 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.789+0000 7fbe00826700 1 --2- 172.21.15.59:0/1395281180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdfc139030 0x7fbdfc13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.789+0000 7fbdfb7fe700 1 -- 172.21.15.59:0/1395281180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdfc139030 msgr2=0x7fbdfc13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.789+0000 7fbdfb7fe700 1 --2- 172.21.15.59:0/1395281180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdfc139030 0x7fbdfc13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.789+0000 7fbdfb7fe700 1 -- 172.21.15.59:0/1395281180 >> v1:172.21.15.59:6789/0 conn(0x7fbdfc1338a0 legacy=0x7fbdfc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.789+0000 7fbdfb7fe700 1 -- 172.21.15.59:0/1395281180 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc06fc30 con 0x7fbdfc136710 2023-09-30T22:32:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.789+0000 7fbdfb7fe700 1 --2- 172.21.15.59:0/1395281180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdfc136710 0x7fbdfc138af0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009920 tx=0x7fbdf0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afd3b046a667c96c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.790+0000 7fbdfaffd700 1 -- 172.21.15.59:0/1395281180 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0011830 con 0x7fbdfc136710 2023-09-30T22:32:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.790+0000 7fbdfaffd700 1 -- 172.21.15.59:0/1395281180 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf0011990 con 0x7fbdfc136710 2023-09-30T22:32:18.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.790+0000 7fbdfaffd700 1 -- 172.21.15.59:0/1395281180 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0011d00 con 0x7fbdfc136710 2023-09-30T22:32:18.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.790+0000 7fbe02289700 1 -- 172.21.15.59:0/1395281180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdfc136710 msgr2=0x7fbdfc138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.790+0000 7fbe02289700 1 --2- 172.21.15.59:0/1395281180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdfc136710 0x7fbdfc138af0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009920 tx=0x7fbdf0009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:18.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.790+0000 7fbe02289700 1 -- 172.21.15.59:0/1395281180 shutdown_connections 2023-09-30T22:32:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.790+0000 7fbe02289700 1 --2- 172.21.15.59:0/1395281180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdfc139030 0x7fbdfc13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.790+0000 7fbe02289700 1 --2- 172.21.15.59:0/1395281180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdfc136710 0x7fbdfc138af0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.790+0000 7fbe02289700 1 -- 172.21.15.59:0/1395281180 >> 172.21.15.59:0/1395281180 conn(0x7fbdfc0a2aa0 msgr2=0x7fbdfc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.791+0000 7fbe02289700 1 -- 172.21.15.59:0/1395281180 shutdown_connections 2023-09-30T22:32:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.791+0000 7fbe02289700 1 -- 172.21.15.59:0/1395281180 wait complete. 2023-09-30T22:32:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.792+0000 7fbe02289700 1 Processor -- start 2023-09-30T22:32:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.792+0000 7fbe02289700 1 -- start start 2023-09-30T22:32:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbe02289700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc1338a0 0x7fbdfc1c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbe02289700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdfc136710 0x7fbdfc1c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbe02289700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdfc139030 0x7fbdfc1c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbe02289700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc11d830 con 0x7fbdfc1338a0 2023-09-30T22:32:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbe02289700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc06f640 con 0x7fbdfc136710 2023-09-30T22:32:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbe02289700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc11db70 con 0x7fbdfc139030 2023-09-30T22:32:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbdfbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc1338a0 0x7fbdfc1c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbdfbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc1338a0 0x7fbdfc1c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49822/0 (socket says 172.21.15.59:49822) 2023-09-30T22:32:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbdfbfff700 1 -- 172.21.15.59:0/2646744224 learned_addr learned my addr 172.21.15.59:0/2646744224 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbdfb7fe700 1 --2- 172.21.15.59:0/2646744224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdfc136710 0x7fbdfc1c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbe00826700 1 --2- 172.21.15.59:0/2646744224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdfc139030 0x7fbdfc1c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbdfbfff700 1 -- 172.21.15.59:0/2646744224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdfc139030 msgr2=0x7fbdfc1c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbdfbfff700 1 --2- 172.21.15.59:0/2646744224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdfc139030 0x7fbdfc1c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbdfbfff700 1 -- 172.21.15.59:0/2646744224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdfc136710 msgr2=0x7fbdfc1c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbdfbfff700 1 --2- 172.21.15.59:0/2646744224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdfc136710 0x7fbdfc1c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbdfbfff700 1 -- 172.21.15.59:0/2646744224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0009550 con 0x7fbdfc1338a0 2023-09-30T22:32:18.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.793+0000 7fbdfbfff700 1 --2- 172.21.15.59:0/2646744224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc1338a0 0x7fbdfc1c8320 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00c4e0 tx=0x7fbdec00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.794+0000 7fbdf8ff9700 1 -- 172.21.15.59:0/2646744224 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0052d0 con 0x7fbdfc1338a0 2023-09-30T22:32:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.794+0000 7fbdf8ff9700 1 -- 172.21.15.59:0/2646744224 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec00ce90 con 0x7fbdfc1338a0 2023-09-30T22:32:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.794+0000 7fbdf8ff9700 1 -- 172.21.15.59:0/2646744224 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec003680 con 0x7fbdfc1338a0 2023-09-30T22:32:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.794+0000 7fbe02289700 1 -- 172.21.15.59:0/2646744224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc138b70 con 0x7fbdfc1338a0 2023-09-30T22:32:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.794+0000 7fbe02289700 1 -- 172.21.15.59:0/2646744224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc11c790 con 0x7fbdfc1338a0 2023-09-30T22:32:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.795+0000 7fbdf8ff9700 1 -- 172.21.15.59:0/2646744224 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbdec0037e0 con 0x7fbdfc1338a0 2023-09-30T22:32:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.795+0000 7fbe02289700 1 -- 172.21.15.59:0/2646744224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdfc11bca0 con 0x7fbdfc1338a0 2023-09-30T22:32:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.795+0000 7fbdf8ff9700 1 -- 172.21.15.59:0/2646744224 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbdec03ea80 con 0x7fbdfc1338a0 2023-09-30T22:32:18.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.800+0000 7fbdf8ff9700 1 -- 172.21.15.59:0/2646744224 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdec011590 con 0x7fbdfc1338a0 2023-09-30T22:32:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.837+0000 7f4117bb3700 1 Processor -- start 2023-09-30T22:32:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.837+0000 7f4117bb3700 1 -- start start 2023-09-30T22:32:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.838+0000 7f4117bb3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41100a0a30 0x7f41100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.838+0000 7f4117bb3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4110138d80 0x7f411013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.838+0000 7f4117bb3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41100a2a70 con 0x7f411009d630 2023-09-30T22:32:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.838+0000 7f4117bb3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41100a01d0 con 0x7f4110138d80 2023-09-30T22:32:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.838+0000 7f4117bb3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f411009e2b0 con 0x7f41100a0a30 2023-09-30T22:32:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.838+0000 7f4116150700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4110138d80 0x7f411013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.838+0000 7f411514e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f411009d630 0x7f41100a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39816/0 (socket says 172.21.15.59:39816) 2023-09-30T22:32:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.838+0000 7f411514e700 1 -- 172.21.15.59:0/2559771064 learned_addr learned my addr 172.21.15.59:0/2559771064 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.838+0000 7f411594f700 1 --2- 172.21.15.59:0/2559771064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41100a0a30 0x7f41100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.839+0000 7f411494d700 1 -- 172.21.15.59:0/2559771064 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148976678 0 0) 0x7f41100a2a70 con 0x7f411009d630 2023-09-30T22:32:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.839+0000 7f411494d700 1 -- 172.21.15.59:0/2559771064 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40fc0035b0 con 0x7f411009d630 2023-09-30T22:32:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.839+0000 7f4116150700 1 -- 172.21.15.59:0/2559771064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41100a0a30 msgr2=0x7f41100a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.839+0000 7f4116150700 1 --2- 172.21.15.59:0/2559771064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41100a0a30 0x7f41100a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.839+0000 7f4116150700 1 -- 172.21.15.59:0/2559771064 >> v1:172.21.15.59:6789/0 conn(0x7f411009d630 legacy=0x7f41100a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.839+0000 7f4116150700 1 -- 172.21.15.59:0/2559771064 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411009dc50 con 0x7f4110138d80 2023-09-30T22:32:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.839+0000 7f4116150700 1 --2- 172.21.15.59:0/2559771064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4110138d80 0x7f411013b160 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4108009dc0 tx=0x7f410800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7e1f305c6af1b8b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.839+0000 7f411494d700 1 -- 172.21.15.59:0/2559771064 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410800e070 con 0x7f4110138d80 2023-09-30T22:32:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.839+0000 7f411494d700 1 -- 172.21.15.59:0/2559771064 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410800bb20 con 0x7f4110138d80 2023-09-30T22:32:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.839+0000 7f411494d700 1 -- 172.21.15.59:0/2559771064 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108012430 con 0x7f4110138d80 2023-09-30T22:32:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.840+0000 7f4117bb3700 1 -- 172.21.15.59:0/2559771064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4110138d80 msgr2=0x7f411013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.840+0000 7f4117bb3700 1 --2- 172.21.15.59:0/2559771064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4110138d80 0x7f411013b160 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4108009dc0 tx=0x7f410800b330 comp rx=0 tx=0).stop 2023-09-30T22:32:18.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.840+0000 7f4117bb3700 1 -- 172.21.15.59:0/2559771064 shutdown_connections 2023-09-30T22:32:18.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.840+0000 7f4117bb3700 1 --2- 172.21.15.59:0/2559771064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41100a0a30 0x7f41100a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.840+0000 7f4117bb3700 1 --2- 172.21.15.59:0/2559771064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4110138d80 0x7f411013b160 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.840+0000 7f4117bb3700 1 -- 172.21.15.59:0/2559771064 >> 172.21.15.59:0/2559771064 conn(0x7f41100a3050 msgr2=0x7f41100a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:18.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.840+0000 7f4117bb3700 1 -- 172.21.15.59:0/2559771064 shutdown_connections 2023-09-30T22:32:18.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.840+0000 7f4117bb3700 1 -- 172.21.15.59:0/2559771064 wait complete. 2023-09-30T22:32:18.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.841+0000 7f4117bb3700 1 Processor -- start 2023-09-30T22:32:18.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.841+0000 7f4117bb3700 1 -- start start 2023-09-30T22:32:18.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f4117bb3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f411009d630 0x7f411012c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f4117bb3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41100a0a30 0x7f411012c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f4117bb3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4110138d80 0x7f411012cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f4117bb3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411012f4c0 con 0x7f4110138d80 2023-09-30T22:32:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f4117bb3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4110071670 con 0x7f41100a0a30 2023-09-30T22:32:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f4117bb3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41100a0410 con 0x7f411009d630 2023-09-30T22:32:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f411594f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f411009d630 0x7f411012c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f411594f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f411009d630 0x7f411012c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46180/0 (socket says 172.21.15.59:46180) 2023-09-30T22:32:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f411594f700 1 -- 172.21.15.59:0/2106184336 learned_addr learned my addr 172.21.15.59:0/2106184336 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f4116150700 1 --2- 172.21.15.59:0/2106184336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4110138d80 0x7f411012cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f411594f700 1 -- 172.21.15.59:0/2106184336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41100a0a30 msgr2=0x7f411012c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f411594f700 1 --2- 172.21.15.59:0/2106184336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41100a0a30 0x7f411012c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f411594f700 1 -- 172.21.15.59:0/2106184336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4110138d80 msgr2=0x7f411012cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f411594f700 1 --2- 172.21.15.59:0/2106184336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4110138d80 0x7f411012cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f411594f700 1 -- 172.21.15.59:0/2106184336 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4108009a70 con 0x7f411009d630 2023-09-30T22:32:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.842+0000 7f4116150700 1 --2- 172.21.15.59:0/2106184336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4110138d80 0x7f411012cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.843+0000 7f411594f700 1 --2- 172.21.15.59:0/2106184336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f411009d630 0x7f411012c470 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f410c00e9e0 tx=0x7f410c00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.843+0000 7f41067fc700 1 -- 172.21.15.59:0/2106184336 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c009710 con 0x7f411009d630 2023-09-30T22:32:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.843+0000 7f41067fc700 1 -- 172.21.15.59:0/2106184336 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410c00c850 con 0x7f411009d630 2023-09-30T22:32:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.843+0000 7f4117bb3700 1 -- 172.21.15.59:0/2106184336 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411012d590 con 0x7f411009d630 2023-09-30T22:32:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.843+0000 7f41067fc700 1 -- 172.21.15.59:0/2106184336 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c00cbc0 con 0x7f411009d630 2023-09-30T22:32:18.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.843+0000 7f4117bb3700 1 -- 172.21.15.59:0/2106184336 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411012dda0 con 0x7f411009d630 2023-09-30T22:32:18.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.844+0000 7f4117bb3700 1 -- 172.21.15.59:0/2106184336 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411013b660 con 0x7f411009d630 2023-09-30T22:32:18.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.844+0000 7f41067fc700 1 -- 172.21.15.59:0/2106184336 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f410c00cd20 con 0x7f411009d630 2023-09-30T22:32:18.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.849+0000 7f41067fc700 1 -- 172.21.15.59:0/2106184336 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f410c01a360 con 0x7f411009d630 2023-09-30T22:32:18.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.853+0000 7f41067fc700 1 -- 172.21.15.59:0/2106184336 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f410c0102b0 con 0x7f411009d630 2023-09-30T22:32:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.877+0000 7faf3903c700 1 Processor -- start 2023-09-30T22:32:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.877+0000 7faf3903c700 1 -- start start 2023-09-30T22:32:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.877+0000 7faf3903c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf3412cf60 0x7faf3406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf3903c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3412f8b0 0x7faf3412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf3903c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf34130260 0x7faf34136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf3903c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3412d330 con 0x7faf3412cf60 2023-09-30T22:32:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf3903c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3412cd90 con 0x7faf3412f8b0 2023-09-30T22:32:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf3903c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf341306d0 con 0x7faf34130260 2023-09-30T22:32:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf3259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3412f8b0 0x7faf3412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf32d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf3412cf60 0x7faf3406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf3259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3412f8b0 0x7faf3412fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42872/0 (socket says 172.21.15.59:42872) 2023-09-30T22:32:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf3259c700 1 -- 172.21.15.59:0/158117834 learned_addr learned my addr 172.21.15.59:0/158117834 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf3359e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf34130260 0x7faf34136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf3259c700 1 -- 172.21.15.59:0/158117834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf34130260 msgr2=0x7faf34136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:18.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf3259c700 1 --2- 172.21.15.59:0/158117834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf34130260 0x7faf34136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf3259c700 1 -- 172.21.15.59:0/158117834 >> v2:172.21.15.59:3300/0 conn(0x7faf3412cf60 msgr2=0x7faf3406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:18.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf3259c700 1 --2- 172.21.15.59:0/158117834 >> v2:172.21.15.59:3300/0 conn(0x7faf3412cf60 0x7faf3406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf3259c700 1 -- 172.21.15.59:0/158117834 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf34071780 con 0x7faf3412f8b0 2023-09-30T22:32:18.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.878+0000 7faf32d9d700 1 --2- 172.21.15.59:0/158117834 >> v2:172.21.15.59:3300/0 conn(0x7faf3412cf60 0x7faf3406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:18.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.879+0000 7faf3259c700 1 --2- 172.21.15.59:0/158117834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3412f8b0 0x7faf3412fd20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faf280098f0 tx=0x7faf28009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b38c23539c98b5ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:18.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.879+0000 7faf31d9b700 1 -- 172.21.15.59:0/158117834 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28011830 con 0x7faf3412f8b0 2023-09-30T22:32:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.879+0000 7faf31d9b700 1 -- 172.21.15.59:0/158117834 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf28011990 con 0x7faf3412f8b0 2023-09-30T22:32:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.879+0000 7faf31d9b700 1 -- 172.21.15.59:0/158117834 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28011d20 con 0x7faf3412f8b0 2023-09-30T22:32:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.879+0000 7faf3903c700 1 -- 172.21.15.59:0/158117834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3412f8b0 msgr2=0x7faf3412fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.879+0000 7faf3903c700 1 --2- 172.21.15.59:0/158117834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3412f8b0 0x7faf3412fd20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faf280098f0 tx=0x7faf28009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.879+0000 7faf3903c700 1 -- 172.21.15.59:0/158117834 shutdown_connections 2023-09-30T22:32:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.879+0000 7faf3903c700 1 --2- 172.21.15.59:0/158117834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf34130260 0x7faf34136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.879+0000 7faf3903c700 1 --2- 172.21.15.59:0/158117834 >> v2:172.21.15.59:3300/0 conn(0x7faf3412cf60 0x7faf3406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.879+0000 7faf3903c700 1 --2- 172.21.15.59:0/158117834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3412f8b0 0x7faf3412fd20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.879+0000 7faf3903c700 1 -- 172.21.15.59:0/158117834 >> 172.21.15.59:0/158117834 conn(0x7faf340a2aa0 msgr2=0x7faf340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.880+0000 7faf3903c700 1 -- 172.21.15.59:0/158117834 shutdown_connections 2023-09-30T22:32:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.880+0000 7faf3903c700 1 -- 172.21.15.59:0/158117834 wait complete. 2023-09-30T22:32:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.881+0000 7faf3903c700 1 Processor -- start 2023-09-30T22:32:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.882+0000 7faf3903c700 1 -- start start 2023-09-30T22:32:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.882+0000 7faf3903c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3412cf60 0x7faf3409b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.882+0000 7faf3903c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf3412f8b0 0x7faf3409b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.882+0000 7faf3903c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf34130260 0x7faf3409bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.882+0000 7faf3903c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3412a030 con 0x7faf3412f8b0 2023-09-30T22:32:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.882+0000 7faf3903c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3409dfd0 con 0x7faf34130260 2023-09-30T22:32:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.882+0000 7faf3903c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf3411d280 con 0x7faf3412cf60 2023-09-30T22:32:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.882+0000 7faf3259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf3412f8b0 0x7faf3409b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.883+0000 7faf3259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf3412f8b0 0x7faf3409b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49838/0 (socket says 172.21.15.59:49838) 2023-09-30T22:32:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.883+0000 7faf3259c700 1 -- 172.21.15.59:0/2322464038 learned_addr learned my addr 172.21.15.59:0/2322464038 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.883+0000 7faf32d9d700 1 --2- 172.21.15.59:0/2322464038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3412cf60 0x7faf3409b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.883+0000 7faf3359e700 1 --2- 172.21.15.59:0/2322464038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf34130260 0x7faf3409bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.883+0000 7faf3259c700 1 -- 172.21.15.59:0/2322464038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3412cf60 msgr2=0x7faf3409b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.883+0000 7faf3259c700 1 --2- 172.21.15.59:0/2322464038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3412cf60 0x7faf3409b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.883+0000 7faf3259c700 1 -- 172.21.15.59:0/2322464038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf34130260 msgr2=0x7faf3409bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.883+0000 7faf3259c700 1 --2- 172.21.15.59:0/2322464038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf34130260 0x7faf3409bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.883+0000 7faf3259c700 1 -- 172.21.15.59:0/2322464038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240094a0 con 0x7faf3412f8b0 2023-09-30T22:32:18.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.883+0000 7faf3259c700 1 --2- 172.21.15.59:0/2322464038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf3412f8b0 0x7faf3409b9a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7faf28012d40 tx=0x7faf28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:18.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.883+0000 7faf1b7fe700 1 -- 172.21.15.59:0/2322464038 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28004450 con 0x7faf3412f8b0 2023-09-30T22:32:18.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.884+0000 7faf1b7fe700 1 -- 172.21.15.59:0/2322464038 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf280045b0 con 0x7faf3412f8b0 2023-09-30T22:32:18.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.884+0000 7faf3903c700 1 -- 172.21.15.59:0/2322464038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf28009550 con 0x7faf3412f8b0 2023-09-30T22:32:18.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.884+0000 7faf1b7fe700 1 -- 172.21.15.59:0/2322464038 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf280038c0 con 0x7faf3412f8b0 2023-09-30T22:32:18.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.884+0000 7faf3903c700 1 -- 172.21.15.59:0/2322464038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3412da60 con 0x7faf3412f8b0 2023-09-30T22:32:18.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.885+0000 7faf1b7fe700 1 -- 172.21.15.59:0/2322464038 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf28003a20 con 0x7faf3412f8b0 2023-09-30T22:32:18.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.885+0000 7faf1b7fe700 1 -- 172.21.15.59:0/2322464038 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faf28040a40 con 0x7faf3412f8b0 2023-09-30T22:32:18.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.885+0000 7faf3903c700 1 -- 172.21.15.59:0/2322464038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3412c0a0 con 0x7faf3412f8b0 2023-09-30T22:32:18.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.894+0000 7faf1b7fe700 1 -- 172.21.15.59:0/2322464038 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf2802b080 con 0x7faf3412f8b0 2023-09-30T22:32:18.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.991+0000 7f9e49054700 1 -- 172.21.15.59:0/1127370942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9e4406ec80 con 0x7f9e44135e50 2023-09-30T22:32:18.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.992+0000 7f9e2b7fe700 1 -- 172.21.15.59:0/1127370942 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e3c02f760 con 0x7f9e44135e50 2023-09-30T22:32:18.992 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:18.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.994+0000 7f9e49054700 1 -- 172.21.15.59:0/1127370942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e44135e50 msgr2=0x7f9e441c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:18.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.994+0000 7f9e49054700 1 --2- 172.21.15.59:0/1127370942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e44135e50 0x7f9e441c8d70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c014040 tx=0x7f9e3c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.994+0000 7f9e49054700 1 -- 172.21.15.59:0/1127370942 shutdown_connections 2023-09-30T22:32:18.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.994+0000 7f9e49054700 1 --2- 172.21.15.59:0/1127370942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e4409d6f0 0x7f9e441c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.994+0000 7f9e49054700 1 --2- 172.21.15.59:0/1127370942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e44135e50 0x7f9e441c8d70 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.994+0000 7f9e49054700 1 --2- 172.21.15.59:0/1127370942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e4409e1d0 0x7f9e441c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:18.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.994+0000 7f9e49054700 1 -- 172.21.15.59:0/1127370942 >> 172.21.15.59:0/1127370942 conn(0x7f9e44066f50 msgr2=0x7f9e441339c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:18.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.995+0000 7f9e49054700 1 -- 172.21.15.59:0/1127370942 shutdown_connections 2023-09-30T22:32:18.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:18.995+0000 7f9e49054700 1 -- 172.21.15.59:0/1127370942 wait complete. 2023-09-30T22:32:19.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:19.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.026+0000 7fbe02289700 1 -- 172.21.15.59:0/2646744224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbdfc074ea0 con 0x7fbdfc1338a0 2023-09-30T22:32:19.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.026+0000 7fbdf8ff9700 1 -- 172.21.15.59:0/2646744224 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdec0192c0 con 0x7fbdfc1338a0 2023-09-30T22:32:19.027 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:19.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.028+0000 7fbe02289700 1 -- 172.21.15.59:0/2646744224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc1338a0 msgr2=0x7fbdfc1c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:19.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.028+0000 7fbe02289700 1 --2- 172.21.15.59:0/2646744224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc1338a0 0x7fbdfc1c8320 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00c4e0 tx=0x7fbdec00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:32:19.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.029+0000 7fbe02289700 1 -- 172.21.15.59:0/2646744224 shutdown_connections 2023-09-30T22:32:19.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.029+0000 7fbe02289700 1 --2- 172.21.15.59:0/2646744224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdfc139030 0x7fbdfc1c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:19.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.029+0000 7fbe02289700 1 --2- 172.21.15.59:0/2646744224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc1338a0 0x7fbdfc1c8320 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:19.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.029+0000 7fbe02289700 1 --2- 172.21.15.59:0/2646744224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdfc136710 0x7fbdfc1c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:19.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.029+0000 7fbe02289700 1 -- 172.21.15.59:0/2646744224 >> 172.21.15.59:0/2646744224 conn(0x7fbdfc0a2aa0 msgr2=0x7fbdfc0a10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:19.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.029+0000 7fbe02289700 1 -- 172.21.15.59:0/2646744224 shutdown_connections 2023-09-30T22:32:19.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.029+0000 7fbe02289700 1 -- 172.21.15.59:0/2646744224 wait complete. 2023-09-30T22:32:19.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:19.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.065+0000 7f4117bb3700 1 -- 172.21.15.59:0/2106184336 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f41100747f0 con 0x7f411009d630 2023-09-30T22:32:19.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.066+0000 7f41067fc700 1 -- 172.21.15.59:0/2106184336 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f410c017070 con 0x7f411009d630 2023-09-30T22:32:19.066 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.068+0000 7f4117bb3700 1 -- 172.21.15.59:0/2106184336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f411009d630 msgr2=0x7f411012c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.068+0000 7f4117bb3700 1 --2- 172.21.15.59:0/2106184336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f411009d630 0x7f411012c470 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f410c00e9e0 tx=0x7f410c00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:32:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.068+0000 7f4117bb3700 1 -- 172.21.15.59:0/2106184336 shutdown_connections 2023-09-30T22:32:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.068+0000 7f4117bb3700 1 --2- 172.21.15.59:0/2106184336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f411009d630 0x7f411012c470 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.068+0000 7f4117bb3700 1 --2- 172.21.15.59:0/2106184336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4110138d80 0x7f411012cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.068+0000 7f4117bb3700 1 --2- 172.21.15.59:0/2106184336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41100a0a30 0x7f411012c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.068+0000 7f4117bb3700 1 -- 172.21.15.59:0/2106184336 >> 172.21.15.59:0/2106184336 conn(0x7f41100a3050 msgr2=0x7f41100a4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.068+0000 7f4117bb3700 1 -- 172.21.15.59:0/2106184336 shutdown_connections 2023-09-30T22:32:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.068+0000 7f4117bb3700 1 -- 172.21.15.59:0/2106184336 wait complete. 2023-09-30T22:32:19.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:19.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.113+0000 7faf3903c700 1 -- 172.21.15.59:0/2322464038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faf3409eaa0 con 0x7faf3412f8b0 2023-09-30T22:32:19.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.113+0000 7faf1b7fe700 1 -- 172.21.15.59:0/2322464038 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf28015020 con 0x7faf3412f8b0 2023-09-30T22:32:19.114 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:19.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.116+0000 7faf3903c700 1 -- 172.21.15.59:0/2322464038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf3412f8b0 msgr2=0x7faf3409b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:19.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.116+0000 7faf3903c700 1 --2- 172.21.15.59:0/2322464038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf3412f8b0 0x7faf3409b9a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7faf28012d40 tx=0x7faf28004750 comp rx=0 tx=0).stop 2023-09-30T22:32:19.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.116+0000 7faf3903c700 1 -- 172.21.15.59:0/2322464038 shutdown_connections 2023-09-30T22:32:19.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.116+0000 7faf3903c700 1 --2- 172.21.15.59:0/2322464038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3412cf60 0x7faf3409b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:19.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.116+0000 7faf3903c700 1 --2- 172.21.15.59:0/2322464038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf34130260 0x7faf3409bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:19.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.116+0000 7faf3903c700 1 --2- 172.21.15.59:0/2322464038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf3412f8b0 0x7faf3409b9a0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:19.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.116+0000 7faf3903c700 1 -- 172.21.15.59:0/2322464038 >> 172.21.15.59:0/2322464038 conn(0x7faf340a2aa0 msgr2=0x7faf3412a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:19.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.116+0000 7faf3903c700 1 -- 172.21.15.59:0/2322464038 shutdown_connections 2023-09-30T22:32:19.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:19.116+0000 7faf3903c700 1 -- 172.21.15.59:0/2322464038 wait complete. 2023-09-30T22:32:19.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:20.010 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:20.044 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:20.083 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:20.131 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:20.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.163+0000 7f2a0279d700 1 Processor -- start 2023-09-30T22:32:20.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.164+0000 7f2a0279d700 1 -- start start 2023-09-30T22:32:20.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.164+0000 7f2a0279d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29fc09e2e0 0x7f29fc138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.164+0000 7f2a0279d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f29fc138fe0 0x7f29fc13b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.164+0000 7f2a0279d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc099e10 con 0x7f29fc09d800 2023-09-30T22:32:20.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.164+0000 7f2a0279d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29fc09f560 con 0x7f29fc138fe0 2023-09-30T22:32:20.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.164+0000 7f2a0279d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc09e6b0 con 0x7f29fc09e2e0 2023-09-30T22:32:20.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.165+0000 7f2a00f9a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29fc09e2e0 0x7f29fc138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.165+0000 7f2a00f9a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29fc09e2e0 0x7f29fc138aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46210/0 (socket says 172.21.15.59:46210) 2023-09-30T22:32:20.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.165+0000 7f2a00f9a700 1 -- 172.21.15.59:0/1753388064 learned_addr learned my addr 172.21.15.59:0/1753388064 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:20.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.165+0000 7f2a00f9a700 1 -- 172.21.15.59:0/1753388064 >> v2:172.21.15.59:3300/0 conn(0x7f29fc138fe0 msgr2=0x7f29fc13b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:20.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.165+0000 7f2a00f9a700 1 --2- 172.21.15.59:0/1753388064 >> v2:172.21.15.59:3300/0 conn(0x7f29fc138fe0 0x7f29fc13b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.165+0000 7f2a00f9a700 1 -- 172.21.15.59:0/1753388064 >> v1:172.21.15.59:6789/0 conn(0x7f29fc09d800 legacy=0x7f29fc09dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:20.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.165+0000 7f2a00f9a700 1 -- 172.21.15.59:0/1753388064 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc06b4d0 con 0x7f29fc09e2e0 2023-09-30T22:32:20.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.165+0000 7f2a00f9a700 1 --2- 172.21.15.59:0/1753388064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29fc09e2e0 0x7f29fc138aa0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0098f0 tx=0x7f29ec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34b7078465c1b32c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:20.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.166+0000 7f29f3fff700 1 -- 172.21.15.59:0/1753388064 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec005e30 con 0x7f29fc09e2e0 2023-09-30T22:32:20.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.166+0000 7f29f3fff700 1 -- 172.21.15.59:0/1753388064 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec006030 con 0x7f29fc09e2e0 2023-09-30T22:32:20.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.166+0000 7f29f3fff700 1 -- 172.21.15.59:0/1753388064 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec0063e0 con 0x7f29fc09e2e0 2023-09-30T22:32:20.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.166+0000 7f2a0279d700 1 -- 172.21.15.59:0/1753388064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29fc09e2e0 msgr2=0x7f29fc138aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.166+0000 7f2a0279d700 1 --2- 172.21.15.59:0/1753388064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29fc09e2e0 0x7f29fc138aa0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0098f0 tx=0x7f29ec009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:20.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.167+0000 7f2a0279d700 1 -- 172.21.15.59:0/1753388064 shutdown_connections 2023-09-30T22:32:20.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.167+0000 7f2a0279d700 1 --2- 172.21.15.59:0/1753388064 >> v2:172.21.15.59:3300/0 conn(0x7f29fc138fe0 0x7f29fc13b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.167+0000 7f2a0279d700 1 --2- 172.21.15.59:0/1753388064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29fc09e2e0 0x7f29fc138aa0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.167+0000 7f2a0279d700 1 -- 172.21.15.59:0/1753388064 >> 172.21.15.59:0/1753388064 conn(0x7f29fc0a2e20 msgr2=0x7f29fc0a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:20.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.167+0000 7f2a0279d700 1 -- 172.21.15.59:0/1753388064 shutdown_connections 2023-09-30T22:32:20.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.167+0000 7f2a0279d700 1 -- 172.21.15.59:0/1753388064 wait complete. 2023-09-30T22:32:20.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.168+0000 7f2a0279d700 1 Processor -- start 2023-09-30T22:32:20.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.168+0000 7f2a0279d700 1 -- start start 2023-09-30T22:32:20.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.168+0000 7f2a0279d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29fc09d800 0x7f29fc1c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a0279d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29fc09e2e0 0x7f29fc1c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a0279d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29fc138fe0 0x7f29fc11eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a0279d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc1220f0 con 0x7f29fc09e2e0 2023-09-30T22:32:20.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a0279d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc1222d0 con 0x7f29fc09d800 2023-09-30T22:32:20.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a0279d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc1be0c0 con 0x7f29fc138fe0 2023-09-30T22:32:20.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a01f9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29fc138fe0 0x7f29fc11eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a01f9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29fc138fe0 0x7f29fc11eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46214/0 (socket says 172.21.15.59:46214) 2023-09-30T22:32:20.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a01f9c700 1 -- 172.21.15.59:0/3168810382 learned_addr learned my addr 172.21.15.59:0/3168810382 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:20.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a0179b700 1 --2- 172.21.15.59:0/3168810382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29fc09d800 0x7f29fc1c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a00f9a700 1 --2- 172.21.15.59:0/3168810382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29fc09e2e0 0x7f29fc1c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a0179b700 1 -- 172.21.15.59:0/3168810382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29fc138fe0 msgr2=0x7f29fc11eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a0179b700 1 --2- 172.21.15.59:0/3168810382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29fc138fe0 0x7f29fc11eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a0179b700 1 -- 172.21.15.59:0/3168810382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29fc09e2e0 msgr2=0x7f29fc1c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a0179b700 1 --2- 172.21.15.59:0/3168810382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29fc09e2e0 0x7f29fc1c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a0179b700 1 -- 172.21.15.59:0/3168810382 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec009500 con 0x7f29fc09d800 2023-09-30T22:32:20.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.169+0000 7f2a00f9a700 1 --2- 172.21.15.59:0/3168810382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29fc09e2e0 0x7f29fc1c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:20.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.170+0000 7f2a0179b700 1 --2- 172.21.15.59:0/3168810382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29fc09d800 0x7f29fc1c8520 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c410 tx=0x7f29f800c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:20.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.171+0000 7f29f1ffb700 1 -- 172.21.15.59:0/3168810382 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f80052d0 con 0x7f29fc09d800 2023-09-30T22:32:20.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.171+0000 7f29f1ffb700 1 -- 172.21.15.59:0/3168810382 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f8005450 con 0x7f29fc09d800 2023-09-30T22:32:20.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.171+0000 7f29f1ffb700 1 -- 172.21.15.59:0/3168810382 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f80038c0 con 0x7f29fc09d800 2023-09-30T22:32:20.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.171+0000 7f2a0279d700 1 -- 172.21.15.59:0/3168810382 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29fc0a1b50 con 0x7f29fc09d800 2023-09-30T22:32:20.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.171+0000 7f2a0279d700 1 -- 172.21.15.59:0/3168810382 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29fc1c8fa0 con 0x7f29fc09d800 2023-09-30T22:32:20.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.172+0000 7f29f1ffb700 1 -- 172.21.15.59:0/3168810382 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29f8003a20 con 0x7f29fc09d800 2023-09-30T22:32:20.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.172+0000 7f29f1ffb700 1 -- 172.21.15.59:0/3168810382 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f29f8040970 con 0x7f29fc09d800 2023-09-30T22:32:20.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.173+0000 7f2a0279d700 1 -- 172.21.15.59:0/3168810382 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29fc04f2a0 con 0x7f29fc09d800 2023-09-30T22:32:20.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.182+0000 7f29f1ffb700 1 -- 172.21.15.59:0/3168810382 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29f8044060 con 0x7f29fc09d800 2023-09-30T22:32:20.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.204+0000 7f22ae213700 1 Processor -- start 2023-09-30T22:32:20.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.204+0000 7f22ae213700 1 -- start start 2023-09-30T22:32:20.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.205+0000 7f22ae213700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f22a806c0e0 0x7f22a809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.205+0000 7f22ae213700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22a8134ec0 0x7f22a81379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.205+0000 7f22ae213700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22a8137f20 0x7f22a8138370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.205+0000 7f22ae213700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a806c4b0 con 0x7f22a806c0e0 2023-09-30T22:32:20.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.205+0000 7f22ae213700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a81388b0 con 0x7f22a8134ec0 2023-09-30T22:32:20.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.205+0000 7f22ae213700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22a80a09c0 con 0x7f22a8137f20 2023-09-30T22:32:20.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.205+0000 7f22a77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f22a806c0e0 0x7f22a809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.205+0000 7f22a77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f22a806c0e0 0x7f22a809ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49862/0 (socket says 172.21.15.59:49862) 2023-09-30T22:32:20.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.205+0000 7f22a6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22a8134ec0 0x7f22a81379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.205+0000 7f22a77fe700 1 -- 172.21.15.59:0/2900746420 learned_addr learned my addr 172.21.15.59:0/2900746420 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:20.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.205+0000 7f22a7fff700 1 --2- 172.21.15.59:0/2900746420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22a8137f20 0x7f22a8138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.206+0000 7f22a7fff700 1 -- 172.21.15.59:0/2900746420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22a8134ec0 msgr2=0x7f22a81379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.206+0000 7f22a7fff700 1 --2- 172.21.15.59:0/2900746420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22a8134ec0 0x7f22a81379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.206+0000 7f22a7fff700 1 -- 172.21.15.59:0/2900746420 >> v2:172.21.15.59:3300/0 conn(0x7f22a806c0e0 msgr2=0x7f22a809ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.206+0000 7f22a7fff700 1 --2- 172.21.15.59:0/2900746420 >> v2:172.21.15.59:3300/0 conn(0x7f22a806c0e0 0x7f22a809ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.206+0000 7f22a7fff700 1 -- 172.21.15.59:0/2900746420 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a8134980 con 0x7f22a8137f20 2023-09-30T22:32:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.206+0000 7f22a77fe700 1 --2- 172.21.15.59:0/2900746420 >> v2:172.21.15.59:3300/0 conn(0x7f22a806c0e0 0x7f22a809ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.206+0000 7f22a7fff700 1 --2- 172.21.15.59:0/2900746420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22a8137f20 0x7f22a8138370 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009d90 tx=0x7f22a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abc76f28358a56f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.206+0000 7f22a67fc700 1 -- 172.21.15.59:0/2900746420 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000e070 con 0x7f22a8137f20 2023-09-30T22:32:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.206+0000 7f22a67fc700 1 -- 172.21.15.59:0/2900746420 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a000bb20 con 0x7f22a8137f20 2023-09-30T22:32:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.206+0000 7f22a67fc700 1 -- 172.21.15.59:0/2900746420 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0012430 con 0x7f22a8137f20 2023-09-30T22:32:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.207+0000 7f22ae213700 1 -- 172.21.15.59:0/2900746420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22a8137f20 msgr2=0x7f22a8138370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.207+0000 7f22ae213700 1 --2- 172.21.15.59:0/2900746420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22a8137f20 0x7f22a8138370 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009d90 tx=0x7f22a000b330 comp rx=0 tx=0).stop 2023-09-30T22:32:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.207+0000 7f22ae213700 1 -- 172.21.15.59:0/2900746420 shutdown_connections 2023-09-30T22:32:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.207+0000 7f22ae213700 1 --2- 172.21.15.59:0/2900746420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22a8137f20 0x7f22a8138370 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.207+0000 7f22ae213700 1 --2- 172.21.15.59:0/2900746420 >> v2:172.21.15.59:3300/0 conn(0x7f22a806c0e0 0x7f22a809ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.207+0000 7f22ae213700 1 --2- 172.21.15.59:0/2900746420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22a8134ec0 0x7f22a81379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.207+0000 7f22ae213700 1 -- 172.21.15.59:0/2900746420 >> 172.21.15.59:0/2900746420 conn(0x7f22a80a4210 msgr2=0x7f22a80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.207+0000 7f22ae213700 1 -- 172.21.15.59:0/2900746420 shutdown_connections 2023-09-30T22:32:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.207+0000 7f22ae213700 1 -- 172.21.15.59:0/2900746420 wait complete. 2023-09-30T22:32:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.209+0000 7f22ae213700 1 Processor -- start 2023-09-30T22:32:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.209+0000 7f22ae213700 1 -- start start 2023-09-30T22:32:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.209+0000 7f22ae213700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22a806c0e0 0x7f22a811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.209+0000 7f22ae213700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22a8134ec0 0x7f22a811abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.209+0000 7f22ae213700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22a8137f20 0x7f22a811b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.210+0000 7f22ae213700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a811d790 con 0x7f22a806c0e0 2023-09-30T22:32:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.210+0000 7f22ae213700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a80a1480 con 0x7f22a8137f20 2023-09-30T22:32:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.210+0000 7f22ae213700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22a80a03f0 con 0x7f22a8134ec0 2023-09-30T22:32:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.210+0000 7f22a6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22a8134ec0 0x7f22a811abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.210+0000 7f22a6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22a8134ec0 0x7f22a811abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46226/0 (socket says 172.21.15.59:46226) 2023-09-30T22:32:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.210+0000 7f22a6ffd700 1 -- 172.21.15.59:0/3820327319 learned_addr learned my addr 172.21.15.59:0/3820327319 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.210+0000 7f22a77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22a806c0e0 0x7f22a811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.210+0000 7f22a7fff700 1 --2- 172.21.15.59:0/3820327319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22a8137f20 0x7f22a811b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.210+0000 7f22a6ffd700 1 -- 172.21.15.59:0/3820327319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22a8137f20 msgr2=0x7f22a811b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.210+0000 7f22a6ffd700 1 --2- 172.21.15.59:0/3820327319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22a8137f20 0x7f22a811b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.210+0000 7f22a6ffd700 1 -- 172.21.15.59:0/3820327319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22a806c0e0 msgr2=0x7f22a811a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.210+0000 7f22a6ffd700 1 --2- 172.21.15.59:0/3820327319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22a806c0e0 0x7f22a811a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.210+0000 7f22a6ffd700 1 -- 172.21.15.59:0/3820327319 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2298009550 con 0x7f22a8134ec0 2023-09-30T22:32:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.211+0000 7f22a6ffd700 1 --2- 172.21.15.59:0/3820327319 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22a8134ec0 0x7f22a811abc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f229c00e9b0 tx=0x7f229c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.211+0000 7f228ffff700 1 -- 172.21.15.59:0/3820327319 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c009710 con 0x7f22a8134ec0 2023-09-30T22:32:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.211+0000 7f228ffff700 1 -- 172.21.15.59:0/3820327319 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c00ee50 con 0x7f22a8134ec0 2023-09-30T22:32:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.211+0000 7f22ae213700 1 -- 172.21.15.59:0/3820327319 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a0009a70 con 0x7f22a8134ec0 2023-09-30T22:32:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.211+0000 7f228ffff700 1 -- 172.21.15.59:0/3820327319 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c00ca50 con 0x7f22a8134ec0 2023-09-30T22:32:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.211+0000 7f22ae213700 1 -- 172.21.15.59:0/3820327319 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a811cbb0 con 0x7f22a8134ec0 2023-09-30T22:32:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.212+0000 7f22ae213700 1 -- 172.21.15.59:0/3820327319 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a8074ea0 con 0x7f22a8134ec0 2023-09-30T22:32:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.212+0000 7f228ffff700 1 -- 172.21.15.59:0/3820327319 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f229c00cbb0 con 0x7f22a8134ec0 2023-09-30T22:32:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.213+0000 7f228ffff700 1 -- 172.21.15.59:0/3820327319 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f229c03fa20 con 0x7f22a8134ec0 2023-09-30T22:32:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.218+0000 7f228ffff700 1 -- 172.21.15.59:0/3820327319 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f229c01b3b0 con 0x7f22a8134ec0 2023-09-30T22:32:20.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.279+0000 7f98eca40700 1 Processor -- start 2023-09-30T22:32:20.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.279+0000 7f98eca40700 1 -- start start 2023-09-30T22:32:20.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.280+0000 7f98eca40700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98e806c0e0 0x7f98e809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.280+0000 7f98eca40700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98e81380f0 0x7f98e813fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.280+0000 7f98eca40700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e8134980 con 0x7f98e8134ec0 2023-09-30T22:32:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.280+0000 7f98eca40700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e806c4b0 con 0x7f98e806c0e0 2023-09-30T22:32:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.280+0000 7f98eca40700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80a09c0 con 0x7f98e81380f0 2023-09-30T22:32:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.280+0000 7f98e659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98e806c0e0 0x7f98e809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.280+0000 7f98e5d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f98e8134ec0 0x7f98e81379e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39820/0 (socket says 172.21.15.59:39820) 2023-09-30T22:32:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.280+0000 7f98e5d9b700 1 -- 172.21.15.59:0/1395660376 learned_addr learned my addr 172.21.15.59:0/1395660376 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.280+0000 7f98e6d9d700 1 --2- 172.21.15.59:0/1395660376 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98e81380f0 0x7f98e813fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.281+0000 7f98e559a700 1 -- 172.21.15.59:0/1395660376 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906648966 0 0) 0x7f98e8134980 con 0x7f98e8134ec0 2023-09-30T22:32:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.281+0000 7f98e559a700 1 -- 172.21.15.59:0/1395660376 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98d00035b0 con 0x7f98e8134ec0 2023-09-30T22:32:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.281+0000 7f98e559a700 1 -- 172.21.15.59:0/1395660376 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1658749558 0 0) 0x7f98d00035b0 con 0x7f98e8134ec0 2023-09-30T22:32:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.281+0000 7f98e6d9d700 1 -- 172.21.15.59:0/1395660376 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98e806c0e0 msgr2=0x7f98e809ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.281+0000 7f98e6d9d700 1 --2- 172.21.15.59:0/1395660376 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98e806c0e0 0x7f98e809ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.281+0000 7f98e6d9d700 1 -- 172.21.15.59:0/1395660376 >> v1:172.21.15.59:6789/0 conn(0x7f98e8134ec0 legacy=0x7f98e81379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.281+0000 7f98e6d9d700 1 -- 172.21.15.59:0/1395660376 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e80a0600 con 0x7f98e81380f0 2023-09-30T22:32:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.281+0000 7f98e6d9d700 1 --2- 172.21.15.59:0/1395660376 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98e81380f0 0x7f98e813fd20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009dc0 tx=0x7f98e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e50649e46ba4c4f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.281+0000 7f98e559a700 1 -- 172.21.15.59:0/1395660376 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e000e070 con 0x7f98e81380f0 2023-09-30T22:32:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.281+0000 7f98e559a700 1 -- 172.21.15.59:0/1395660376 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e0003a20 con 0x7f98e81380f0 2023-09-30T22:32:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.281+0000 7f98e559a700 1 -- 172.21.15.59:0/1395660376 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc001670 con 0x7f98e81380f0 2023-09-30T22:32:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.282+0000 7f98eca40700 1 -- 172.21.15.59:0/1395660376 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98e81380f0 msgr2=0x7f98e813fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.282+0000 7f98eca40700 1 --2- 172.21.15.59:0/1395660376 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98e81380f0 0x7f98e813fd20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009dc0 tx=0x7f98e000b330 comp rx=0 tx=0).stop 2023-09-30T22:32:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.282+0000 7f98eca40700 1 -- 172.21.15.59:0/1395660376 shutdown_connections 2023-09-30T22:32:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.282+0000 7f98eca40700 1 --2- 172.21.15.59:0/1395660376 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98e81380f0 0x7f98e813fd20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.282+0000 7f98eca40700 1 --2- 172.21.15.59:0/1395660376 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98e806c0e0 0x7f98e809ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.282+0000 7f98eca40700 1 -- 172.21.15.59:0/1395660376 >> 172.21.15.59:0/1395660376 conn(0x7f98e80a4210 msgr2=0x7f98e80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.282+0000 7f98eca40700 1 -- 172.21.15.59:0/1395660376 shutdown_connections 2023-09-30T22:32:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.282+0000 7f98eca40700 1 -- 172.21.15.59:0/1395660376 wait complete. 2023-09-30T22:32:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.284+0000 7f98eca40700 1 Processor -- start 2023-09-30T22:32:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.284+0000 7f98eca40700 1 -- start start 2023-09-30T22:32:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.284+0000 7f98eca40700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98e806c0e0 0x7f98e811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.284+0000 7f98eca40700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98e8134ec0 0x7f98e811abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.284+0000 7f98eca40700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98e81380f0 0x7f98e811b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.284+0000 7f98eca40700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e811ba50 con 0x7f98e806c0e0 2023-09-30T22:32:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.284+0000 7f98eca40700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e811bf30 con 0x7f98e81380f0 2023-09-30T22:32:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.284+0000 7f98eca40700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98e811d710 con 0x7f98e8134ec0 2023-09-30T22:32:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.284+0000 7f98e5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98e8134ec0 0x7f98e811abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.284+0000 7f98e5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98e8134ec0 0x7f98e811abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46248/0 (socket says 172.21.15.59:46248) 2023-09-30T22:32:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.284+0000 7f98e5d9b700 1 -- 172.21.15.59:0/3373934281 learned_addr learned my addr 172.21.15.59:0/3373934281 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.285+0000 7f98e6d9d700 1 --2- 172.21.15.59:0/3373934281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98e81380f0 0x7f98e811b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.285+0000 7f98e5d9b700 1 -- 172.21.15.59:0/3373934281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98e81380f0 msgr2=0x7f98e811b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.285+0000 7f98e5d9b700 1 --2- 172.21.15.59:0/3373934281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98e81380f0 0x7f98e811b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.285+0000 7f98e5d9b700 1 -- 172.21.15.59:0/3373934281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98e806c0e0 msgr2=0x7f98e811a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.285+0000 7f98e5d9b700 1 --2- 172.21.15.59:0/3373934281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98e806c0e0 0x7f98e811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.285+0000 7f98e5d9b700 1 -- 172.21.15.59:0/3373934281 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0009a70 con 0x7f98e8134ec0 2023-09-30T22:32:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.285+0000 7f98e5d9b700 1 --2- 172.21.15.59:0/3373934281 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98e8134ec0 0x7f98e811abc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00c780 tx=0x7f98dc00ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.285+0000 7f7e44132700 1 Processor -- start 2023-09-30T22:32:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.285+0000 7f98d6ffd700 1 -- 172.21.15.59:0/3373934281 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc004c80 con 0x7f98e8134ec0 2023-09-30T22:32:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.285+0000 7f98d6ffd700 1 -- 172.21.15.59:0/3373934281 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc004de0 con 0x7f98e8134ec0 2023-09-30T22:32:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.285+0000 7f98d6ffd700 1 -- 172.21.15.59:0/3373934281 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc0072f0 con 0x7f98e8134ec0 2023-09-30T22:32:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.285+0000 7f98eca40700 1 -- 172.21.15.59:0/3373934281 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e811cff0 con 0x7f98e8134ec0 2023-09-30T22:32:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.286+0000 7f98eca40700 1 -- 172.21.15.59:0/3373934281 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e811e440 con 0x7f98e8134ec0 2023-09-30T22:32:20.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.285+0000 7f7e44132700 1 -- start start 2023-09-30T22:32:20.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.286+0000 7f7e44132700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e3c12cf60 0x7f7e3c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.286+0000 7f7e44132700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e3c12f8b0 0x7f7e3c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.286+0000 7f7e44132700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3c130260 0x7f7e3c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.286+0000 7f7e44132700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3c12d330 con 0x7f7e3c12f8b0 2023-09-30T22:32:20.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.286+0000 7f7e44132700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c12cd90 con 0x7f7e3c12cf60 2023-09-30T22:32:20.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.286+0000 7f7e44132700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c1306d0 con 0x7f7e3c130260 2023-09-30T22:32:20.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.286+0000 7f7e41ece700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e3c12cf60 0x7f7e3c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.286+0000 7f7e41ece700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e3c12cf60 0x7f7e3c06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42936/0 (socket says 172.21.15.59:42936) 2023-09-30T22:32:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.286+0000 7f7e41ece700 1 -- 172.21.15.59:0/1199723977 learned_addr learned my addr 172.21.15.59:0/1199723977 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.286+0000 7f7e426cf700 1 --2- 172.21.15.59:0/1199723977 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3c130260 0x7f7e3c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.286+0000 7f7e416cd700 1 --2- 172.21.15.59:0/1199723977 >> v2:172.21.15.59:3300/0 conn(0x7f7e3c12f8b0 0x7f7e3c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.287+0000 7f7e426cf700 1 -- 172.21.15.59:0/1199723977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e3c12cf60 msgr2=0x7f7e3c06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.287+0000 7f7e426cf700 1 --2- 172.21.15.59:0/1199723977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e3c12cf60 0x7f7e3c06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.287+0000 7f7e426cf700 1 -- 172.21.15.59:0/1199723977 >> v2:172.21.15.59:3300/0 conn(0x7f7e3c12f8b0 msgr2=0x7f7e3c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.287+0000 7f7e426cf700 1 --2- 172.21.15.59:0/1199723977 >> v2:172.21.15.59:3300/0 conn(0x7f7e3c12f8b0 0x7f7e3c12fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.287+0000 7f7e426cf700 1 -- 172.21.15.59:0/1199723977 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c071780 con 0x7f7e3c130260 2023-09-30T22:32:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.287+0000 7f98eca40700 1 -- 172.21.15.59:0/3373934281 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e81352f0 con 0x7f98e8134ec0 2023-09-30T22:32:20.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.287+0000 7f7e426cf700 1 --2- 172.21.15.59:0/1199723977 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3c130260 0x7f7e3c136c20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009dc0 tx=0x7f7e3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9704d1099e5eafb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:20.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.287+0000 7f7e40ecc700 1 -- 172.21.15.59:0/1199723977 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3400bce0 con 0x7f7e3c130260 2023-09-30T22:32:20.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.287+0000 7f7e40ecc700 1 -- 172.21.15.59:0/1199723977 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3400be40 con 0x7f7e3c130260 2023-09-30T22:32:20.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.287+0000 7f7e40ecc700 1 -- 172.21.15.59:0/1199723977 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e340106f0 con 0x7f7e3c130260 2023-09-30T22:32:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.287+0000 7f98d6ffd700 1 -- 172.21.15.59:0/3373934281 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98dc007450 con 0x7f98e8134ec0 2023-09-30T22:32:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.288+0000 7f98d6ffd700 1 -- 172.21.15.59:0/3373934281 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f98dc03f520 con 0x7f98e8134ec0 2023-09-30T22:32:20.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.288+0000 7f7e44132700 1 -- 172.21.15.59:0/1199723977 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3c130260 msgr2=0x7f7e3c136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.288+0000 7f7e44132700 1 --2- 172.21.15.59:0/1199723977 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3c130260 0x7f7e3c136c20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009dc0 tx=0x7f7e3400b330 comp rx=0 tx=0).stop 2023-09-30T22:32:20.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.288+0000 7f7e44132700 1 -- 172.21.15.59:0/1199723977 shutdown_connections 2023-09-30T22:32:20.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.288+0000 7f7e44132700 1 --2- 172.21.15.59:0/1199723977 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3c130260 0x7f7e3c136c20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.288+0000 7f7e44132700 1 --2- 172.21.15.59:0/1199723977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e3c12cf60 0x7f7e3c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.288+0000 7f7e44132700 1 --2- 172.21.15.59:0/1199723977 >> v2:172.21.15.59:3300/0 conn(0x7f7e3c12f8b0 0x7f7e3c12fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.288+0000 7f7e44132700 1 -- 172.21.15.59:0/1199723977 >> 172.21.15.59:0/1199723977 conn(0x7f7e3c0a2aa0 msgr2=0x7f7e3c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:20.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.288+0000 7f7e44132700 1 -- 172.21.15.59:0/1199723977 shutdown_connections 2023-09-30T22:32:20.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.288+0000 7f7e44132700 1 -- 172.21.15.59:0/1199723977 wait complete. 2023-09-30T22:32:20.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.289+0000 7f7e44132700 1 Processor -- start 2023-09-30T22:32:20.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.289+0000 7f7e44132700 1 -- start start 2023-09-30T22:32:20.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.290+0000 7f7e44132700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3c12cf60 0x7f7e3c09bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.290+0000 7f7e44132700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e3c12f8b0 0x7f7e3c09c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.290+0000 7f7e44132700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e3c130260 0x7f7e3c1c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:20.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.290+0000 7f7e44132700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c09cfb0 con 0x7f7e3c130260 2023-09-30T22:32:20.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.290+0000 7f7e44132700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c09c660 con 0x7f7e3c12f8b0 2023-09-30T22:32:20.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.290+0000 7f7e44132700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c09cd80 con 0x7f7e3c12cf60 2023-09-30T22:32:20.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.290+0000 7f7e41ece700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3c12cf60 0x7f7e3c09bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.290+0000 7f7e41ece700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3c12cf60 0x7f7e3c09bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46264/0 (socket says 172.21.15.59:46264) 2023-09-30T22:32:20.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.290+0000 7f7e41ece700 1 -- 172.21.15.59:0/1974344215 learned_addr learned my addr 172.21.15.59:0/1974344215 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:20.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.290+0000 7f7e416cd700 1 --2- 172.21.15.59:0/1974344215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e3c12f8b0 0x7f7e3c09c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:20.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.290+0000 7f7e41ece700 1 -- 172.21.15.59:0/1974344215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e3c12f8b0 msgr2=0x7f7e3c09c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.290+0000 7f7e41ece700 1 --2- 172.21.15.59:0/1974344215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e3c12f8b0 0x7f7e3c09c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.290+0000 7f7e41ece700 1 -- 172.21.15.59:0/1974344215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e3c130260 msgr2=0x7f7e3c1c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.290+0000 7f7e41ece700 1 --2- 172.21.15.59:0/1974344215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e3c130260 0x7f7e3c1c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.290+0000 7f7e41ece700 1 -- 172.21.15.59:0/1974344215 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e34009a70 con 0x7f7e3c12cf60 2023-09-30T22:32:20.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.291+0000 7f7e41ece700 1 --2- 172.21.15.59:0/1974344215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3c12cf60 0x7f7e3c09bbe0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000dd50 tx=0x7f7e30009400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:20.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.296+0000 7f7e2e7fc700 1 -- 172.21.15.59:0/1974344215 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30009a10 con 0x7f7e3c12cf60 2023-09-30T22:32:20.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.297+0000 7f7e2e7fc700 1 -- 172.21.15.59:0/1974344215 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e30009b70 con 0x7f7e3c12cf60 2023-09-30T22:32:20.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.297+0000 7f7e44132700 1 -- 172.21.15.59:0/1974344215 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3c09ed70 con 0x7f7e3c12cf60 2023-09-30T22:32:20.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.297+0000 7f7e2e7fc700 1 -- 172.21.15.59:0/1974344215 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30009ee0 con 0x7f7e3c12cf60 2023-09-30T22:32:20.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.297+0000 7f7e44132700 1 -- 172.21.15.59:0/1974344215 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3c09e6f0 con 0x7f7e3c12cf60 2023-09-30T22:32:20.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.297+0000 7f98d6ffd700 1 -- 172.21.15.59:0/3373934281 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98e81352f0 con 0x7f98e8134ec0 2023-09-30T22:32:20.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.298+0000 7f7e2e7fc700 1 -- 172.21.15.59:0/1974344215 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e30017410 con 0x7f7e3c12cf60 2023-09-30T22:32:20.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.298+0000 7f7e2e7fc700 1 -- 172.21.15.59:0/1974344215 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7e3000b050 con 0x7f7e3c12cf60 2023-09-30T22:32:20.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.298+0000 7f7e44132700 1 -- 172.21.15.59:0/1974344215 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3c074ea0 con 0x7f7e3c12cf60 2023-09-30T22:32:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.307+0000 7f7e2e7fc700 1 -- 172.21.15.59:0/1974344215 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e3001c080 con 0x7f7e3c12cf60 2023-09-30T22:32:20.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.447+0000 7f2a0279d700 1 -- 172.21.15.59:0/3168810382 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f29fc09a260 con 0x7f29fc09d800 2023-09-30T22:32:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.448+0000 7f29f1ffb700 1 -- 172.21.15.59:0/3168810382 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29f8017020 con 0x7f29fc09d800 2023-09-30T22:32:20.448 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.451+0000 7f2a0279d700 1 -- 172.21.15.59:0/3168810382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29fc09d800 msgr2=0x7f29fc1c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.451+0000 7f2a0279d700 1 --2- 172.21.15.59:0/3168810382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29fc09d800 0x7f29fc1c8520 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c410 tx=0x7f29f800c720 comp rx=0 tx=0).stop 2023-09-30T22:32:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.451+0000 7f2a0279d700 1 -- 172.21.15.59:0/3168810382 shutdown_connections 2023-09-30T22:32:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.451+0000 7f2a0279d700 1 --2- 172.21.15.59:0/3168810382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29fc138fe0 0x7f29fc11eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.451+0000 7f2a0279d700 1 --2- 172.21.15.59:0/3168810382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29fc09d800 0x7f29fc1c8520 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.451+0000 7f2a0279d700 1 --2- 172.21.15.59:0/3168810382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29fc09e2e0 0x7f29fc1c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.451+0000 7f2a0279d700 1 -- 172.21.15.59:0/3168810382 >> 172.21.15.59:0/3168810382 conn(0x7f29fc0a2e20 msgr2=0x7f29fc138090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.451+0000 7f22ae213700 1 -- 172.21.15.59:0/3820327319 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f22a811d9b0 con 0x7f22a8134ec0 2023-09-30T22:32:20.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.451+0000 7f2a0279d700 1 -- 172.21.15.59:0/3168810382 shutdown_connections 2023-09-30T22:32:20.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.452+0000 7f2a0279d700 1 -- 172.21.15.59:0/3168810382 wait complete. 2023-09-30T22:32:20.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.452+0000 7f228ffff700 1 -- 172.21.15.59:0/3820327319 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f229c021030 con 0x7f22a8134ec0 2023-09-30T22:32:20.453 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.455+0000 7f22ae213700 1 -- 172.21.15.59:0/3820327319 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22a8134ec0 msgr2=0x7f22a811abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.455+0000 7f22ae213700 1 --2- 172.21.15.59:0/3820327319 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22a8134ec0 0x7f22a811abc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f229c00e9b0 tx=0x7f229c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.456+0000 7f22ae213700 1 -- 172.21.15.59:0/3820327319 shutdown_connections 2023-09-30T22:32:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.456+0000 7f22ae213700 1 --2- 172.21.15.59:0/3820327319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22a8137f20 0x7f22a811b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.456+0000 7f22ae213700 1 --2- 172.21.15.59:0/3820327319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22a806c0e0 0x7f22a811a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.456+0000 7f22ae213700 1 --2- 172.21.15.59:0/3820327319 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22a8134ec0 0x7f22a811abc0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.456+0000 7f22ae213700 1 -- 172.21.15.59:0/3820327319 >> 172.21.15.59:0/3820327319 conn(0x7f22a80a4210 msgr2=0x7f22a8136940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.456+0000 7f22ae213700 1 -- 172.21.15.59:0/3820327319 shutdown_connections 2023-09-30T22:32:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.456+0000 7f22ae213700 1 -- 172.21.15.59:0/3820327319 wait complete. 2023-09-30T22:32:20.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:20.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:20.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.517+0000 7f7e44132700 1 -- 172.21.15.59:0/1974344215 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7e3c12c020 con 0x7f7e3c12cf60 2023-09-30T22:32:20.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.517+0000 7f7e2e7fc700 1 -- 172.21.15.59:0/1974344215 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e300176c0 con 0x7f7e3c12cf60 2023-09-30T22:32:20.518 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:20.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.519+0000 7f7e44132700 1 -- 172.21.15.59:0/1974344215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3c12cf60 msgr2=0x7f7e3c09bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.519+0000 7f7e44132700 1 --2- 172.21.15.59:0/1974344215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3c12cf60 0x7f7e3c09bbe0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000dd50 tx=0x7f7e30009400 comp rx=0 tx=0).stop 2023-09-30T22:32:20.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.519+0000 7f7e44132700 1 -- 172.21.15.59:0/1974344215 shutdown_connections 2023-09-30T22:32:20.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.519+0000 7f7e44132700 1 --2- 172.21.15.59:0/1974344215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3c12cf60 0x7f7e3c09bbe0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.519+0000 7f7e44132700 1 --2- 172.21.15.59:0/1974344215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e3c130260 0x7f7e3c1c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.519+0000 7f7e44132700 1 --2- 172.21.15.59:0/1974344215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e3c12f8b0 0x7f7e3c09c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.520+0000 7f7e44132700 1 -- 172.21.15.59:0/1974344215 >> 172.21.15.59:0/1974344215 conn(0x7f7e3c0a2aa0 msgr2=0x7f7e3c1b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:20.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.520+0000 7f7e44132700 1 -- 172.21.15.59:0/1974344215 shutdown_connections 2023-09-30T22:32:20.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.520+0000 7f7e44132700 1 -- 172.21.15.59:0/1974344215 wait complete. 2023-09-30T22:32:20.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.531+0000 7f98eca40700 1 -- 172.21.15.59:0/3373934281 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f98e81352f0 con 0x7f98e8134ec0 2023-09-30T22:32:20.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.532+0000 7f98d6ffd700 1 -- 172.21.15.59:0/3373934281 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98e81352f0 con 0x7f98e8134ec0 2023-09-30T22:32:20.532 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:20.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:20.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.534+0000 7f98eca40700 1 -- 172.21.15.59:0/3373934281 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98e8134ec0 msgr2=0x7f98e811abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:20.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.534+0000 7f98eca40700 1 --2- 172.21.15.59:0/3373934281 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98e8134ec0 0x7f98e811abc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00c780 tx=0x7f98dc00ca90 comp rx=0 tx=0).stop 2023-09-30T22:32:20.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.534+0000 7f98eca40700 1 -- 172.21.15.59:0/3373934281 shutdown_connections 2023-09-30T22:32:20.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.534+0000 7f98eca40700 1 --2- 172.21.15.59:0/3373934281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98e81380f0 0x7f98e811b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.534+0000 7f98eca40700 1 --2- 172.21.15.59:0/3373934281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98e806c0e0 0x7f98e811a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.534+0000 7f98eca40700 1 --2- 172.21.15.59:0/3373934281 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98e8134ec0 0x7f98e811abc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:20.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.534+0000 7f98eca40700 1 -- 172.21.15.59:0/3373934281 >> 172.21.15.59:0/3373934281 conn(0x7f98e80a4210 msgr2=0x7f98e81378d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:20.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.534+0000 7f98eca40700 1 -- 172.21.15.59:0/3373934281 shutdown_connections 2023-09-30T22:32:20.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:20.534+0000 7f98eca40700 1 -- 172.21.15.59:0/3373934281 wait complete. 2023-09-30T22:32:20.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:21.472 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:21.475 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:21.534 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:21.549 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:21.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.626+0000 7f7d2f1a2700 1 Processor -- start 2023-09-30T22:32:21.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.626+0000 7f7d2f1a2700 1 -- start start 2023-09-30T22:32:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.627+0000 7f7d2f1a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d280a0870 0x7f7d280a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.627+0000 7f7d2f1a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d280a1180 0x7f7d28133790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.627+0000 7f7d2f1a2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2809db90 con 0x7f7d280a15b0 2023-09-30T22:32:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.627+0000 7f7d2f1a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d280a1ce0 con 0x7f7d280a0870 2023-09-30T22:32:21.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.627+0000 7f7d2f1a2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d280a24f0 con 0x7f7d280a1180 2023-09-30T22:32:21.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.627+0000 7f7d2e9a1700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7d280a15b0 0x7f7d28133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39836/0 (socket says 172.21.15.59:39836) 2023-09-30T22:32:21.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.627+0000 7f7d2e9a1700 1 -- 172.21.15.59:0/124173845 learned_addr learned my addr 172.21.15.59:0/124173845 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:21.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.627+0000 7f7d2d99f700 1 --2- 172.21.15.59:0/124173845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d280a1180 0x7f7d28133790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.627+0000 7f7d2e1a0700 1 --2- 172.21.15.59:0/124173845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d280a0870 0x7f7d280a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.628+0000 7f7d2e1a0700 1 -- 172.21.15.59:0/124173845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d280a1180 msgr2=0x7f7d28133790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.628+0000 7f7d2e1a0700 1 --2- 172.21.15.59:0/124173845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d280a1180 0x7f7d28133790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.628+0000 7f7d2e1a0700 1 -- 172.21.15.59:0/124173845 >> v1:172.21.15.59:6789/0 conn(0x7f7d280a15b0 legacy=0x7f7d28133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.628+0000 7f7d2e1a0700 1 -- 172.21.15.59:0/124173845 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d280a1aa0 con 0x7f7d280a0870 2023-09-30T22:32:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.628+0000 7f7d2d19e700 1 -- 172.21.15.59:0/124173845 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221653317 0 0) 0x7f7d2809db90 con 0x7f7d280a15b0 2023-09-30T22:32:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.628+0000 7f7d2d99f700 1 --2- 172.21.15.59:0/124173845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d280a1180 0x7f7d28133790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.628+0000 7f7d2e1a0700 1 --2- 172.21.15.59:0/124173845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d280a0870 0x7f7d280a0c40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7d24009870 tx=0x7f7d24009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=521814ed8daceff5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.628+0000 7f7d2d19e700 1 -- 172.21.15.59:0/124173845 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d24011830 con 0x7f7d280a0870 2023-09-30T22:32:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.628+0000 7f7d2d19e700 1 -- 172.21.15.59:0/124173845 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d24011990 con 0x7f7d280a0870 2023-09-30T22:32:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.628+0000 7f7d2d19e700 1 -- 172.21.15.59:0/124173845 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d24011d20 con 0x7f7d280a0870 2023-09-30T22:32:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.629+0000 7f7d2f1a2700 1 -- 172.21.15.59:0/124173845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d280a0870 msgr2=0x7f7d280a0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.629+0000 7f7d2f1a2700 1 --2- 172.21.15.59:0/124173845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d280a0870 0x7f7d280a0c40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7d24009870 tx=0x7f7d24009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.629+0000 7f7d2f1a2700 1 -- 172.21.15.59:0/124173845 shutdown_connections 2023-09-30T22:32:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.629+0000 7f7d2f1a2700 1 --2- 172.21.15.59:0/124173845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d280a0870 0x7f7d280a0c40 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.629+0000 7f7d2f1a2700 1 --2- 172.21.15.59:0/124173845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d280a1180 0x7f7d28133790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.629+0000 7f7d2f1a2700 1 -- 172.21.15.59:0/124173845 >> 172.21.15.59:0/124173845 conn(0x7f7d280a6390 msgr2=0x7f7d280a6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.629+0000 7f7d2f1a2700 1 -- 172.21.15.59:0/124173845 shutdown_connections 2023-09-30T22:32:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.629+0000 7f7d2f1a2700 1 -- 172.21.15.59:0/124173845 wait complete. 2023-09-30T22:32:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.630+0000 7f7d2f1a2700 1 Processor -- start 2023-09-30T22:32:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.630+0000 7f7d2f1a2700 1 -- start start 2023-09-30T22:32:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2f1a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d280a0870 0x7f7d28121e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2f1a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d280a1180 0x7f7d281223d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2f1a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d280a15b0 0x7f7d28122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2f1a2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d28123aa0 con 0x7f7d280a15b0 2023-09-30T22:32:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2f1a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d28125410 con 0x7f7d280a0870 2023-09-30T22:32:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2f1a2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d28124930 con 0x7f7d280a1180 2023-09-30T22:32:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2e9a1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d280a15b0 0x7f7d28122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2e1a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d280a0870 0x7f7d28121e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2e9a1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d280a15b0 0x7f7d28122910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49900/0 (socket says 172.21.15.59:49900) 2023-09-30T22:32:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2e1a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d280a0870 0x7f7d28121e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42958/0 (socket says 172.21.15.59:42958) 2023-09-30T22:32:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2e9a1700 1 -- 172.21.15.59:0/722739767 learned_addr learned my addr 172.21.15.59:0/722739767 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2d99f700 1 --2- 172.21.15.59:0/722739767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d280a1180 0x7f7d281223d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2e1a0700 1 -- 172.21.15.59:0/722739767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d280a1180 msgr2=0x7f7d281223d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2e1a0700 1 --2- 172.21.15.59:0/722739767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d280a1180 0x7f7d281223d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2e1a0700 1 -- 172.21.15.59:0/722739767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d280a15b0 msgr2=0x7f7d28122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2e1a0700 1 --2- 172.21.15.59:0/722739767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d280a15b0 0x7f7d28122910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2e1a0700 1 -- 172.21.15.59:0/722739767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d180094a0 con 0x7f7d280a0870 2023-09-30T22:32:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.631+0000 7f7d2d99f700 1 --2- 172.21.15.59:0/722739767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d280a1180 0x7f7d281223d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:21.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.632+0000 7f7d2e1a0700 1 --2- 172.21.15.59:0/722739767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d280a0870 0x7f7d28121e90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7d24009870 tx=0x7f7d24004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.632+0000 7f7d1effd700 1 -- 172.21.15.59:0/722739767 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d24024620 con 0x7f7d280a0870 2023-09-30T22:32:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.632+0000 7f7d1effd700 1 -- 172.21.15.59:0/722739767 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d24024780 con 0x7f7d280a0870 2023-09-30T22:32:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.632+0000 7f7d2f1a2700 1 -- 172.21.15.59:0/722739767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d240094a0 con 0x7f7d280a0870 2023-09-30T22:32:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.632+0000 7f7d1effd700 1 -- 172.21.15.59:0/722739767 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d24024b10 con 0x7f7d280a0870 2023-09-30T22:32:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.632+0000 7f7d2f1a2700 1 -- 172.21.15.59:0/722739767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2809bf20 con 0x7f7d280a0870 2023-09-30T22:32:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.633+0000 7f7d1effd700 1 -- 172.21.15.59:0/722739767 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d24022070 con 0x7f7d280a0870 2023-09-30T22:32:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.633+0000 7f7d2f1a2700 1 -- 172.21.15.59:0/722739767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d28124cf0 con 0x7f7d280a0870 2023-09-30T22:32:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.633+0000 7f7d1effd700 1 -- 172.21.15.59:0/722739767 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7d24040990 con 0x7f7d280a0870 2023-09-30T22:32:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.634+0000 7f5b74501700 1 Processor -- start 2023-09-30T22:32:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.634+0000 7f5b74501700 1 -- start start 2023-09-30T22:32:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.635+0000 7f5b74501700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b6c09d6f0 0x7f5b6c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.635+0000 7f5b74501700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b6c09e000 0x7f5b6c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.635+0000 7f5b74501700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6c09b120 con 0x7f5b6c09e410 2023-09-30T22:32:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.635+0000 7f5b74501700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c06b460 con 0x7f5b6c09d6f0 2023-09-30T22:32:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.635+0000 7f5b74501700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c09a7e0 con 0x7f5b6c09e000 2023-09-30T22:32:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.635+0000 7f5b71a9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b6c09e000 0x7f5b6c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.635+0000 7f5b71a9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b6c09e000 0x7f5b6c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46300/0 (socket says 172.21.15.59:46300) 2023-09-30T22:32:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.635+0000 7f5b71a9c700 1 -- 172.21.15.59:0/1887947131 learned_addr learned my addr 172.21.15.59:0/1887947131 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.635+0000 7f5b71a9c700 1 -- 172.21.15.59:0/1887947131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b6c09d6f0 msgr2=0x7f5b6c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.635+0000 7f5b71a9c700 1 --2- 172.21.15.59:0/1887947131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b6c09d6f0 0x7f5b6c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.636+0000 7f5b71a9c700 1 -- 172.21.15.59:0/1887947131 >> v1:172.21.15.59:6789/0 conn(0x7f5b6c09e410 legacy=0x7f5b6c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.636+0000 7f5b71a9c700 1 -- 172.21.15.59:0/1887947131 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c09a500 con 0x7f5b6c09e000 2023-09-30T22:32:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.636+0000 7f5b71a9c700 1 --2- 172.21.15.59:0/1887947131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b6c09e000 0x7f5b6c1339f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009950 tx=0x7f5b5c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca15342fc3d8c401 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.636+0000 7f5b7129b700 1 -- 172.21.15.59:0/1887947131 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c009ea0 con 0x7f5b6c09e000 2023-09-30T22:32:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.636+0000 7f5b7129b700 1 -- 172.21.15.59:0/1887947131 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c00ba20 con 0x7f5b6c09e000 2023-09-30T22:32:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.636+0000 7f5b7129b700 1 -- 172.21.15.59:0/1887947131 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00bdb0 con 0x7f5b6c09e000 2023-09-30T22:32:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.637+0000 7f5b74501700 1 -- 172.21.15.59:0/1887947131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b6c09e000 msgr2=0x7f5b6c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.637+0000 7f5b74501700 1 --2- 172.21.15.59:0/1887947131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b6c09e000 0x7f5b6c1339f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009950 tx=0x7f5b5c009c60 comp rx=0 tx=0).stop 2023-09-30T22:32:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.637+0000 7f5b74501700 1 -- 172.21.15.59:0/1887947131 shutdown_connections 2023-09-30T22:32:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.637+0000 7f5b74501700 1 --2- 172.21.15.59:0/1887947131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b6c09d6f0 0x7f5b6c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.637+0000 7f5b74501700 1 --2- 172.21.15.59:0/1887947131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b6c09e000 0x7f5b6c1339f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.637+0000 7f5b74501700 1 -- 172.21.15.59:0/1887947131 >> 172.21.15.59:0/1887947131 conn(0x7f5b6c066f50 msgr2=0x7f5b6c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.637+0000 7f5b74501700 1 -- 172.21.15.59:0/1887947131 shutdown_connections 2023-09-30T22:32:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.637+0000 7f5b74501700 1 -- 172.21.15.59:0/1887947131 wait complete. 2023-09-30T22:32:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.638+0000 7f5b74501700 1 Processor -- start 2023-09-30T22:32:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.639+0000 7f5b74501700 1 -- start start 2023-09-30T22:32:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.639+0000 7f5b74501700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b6c09d6f0 0x7f5b6c1abac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.639+0000 7f5b74501700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b6c09e000 0x7f5b6c1ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.639+0000 7f5b74501700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b6c09e410 0x7f5b6c1ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.639+0000 7f5b74501700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c1af3e0 con 0x7f5b6c09e000 2023-09-30T22:32:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.639+0000 7f5b74501700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c1af5e0 con 0x7f5b6c09d6f0 2023-09-30T22:32:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.639+0000 7f5b74501700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c1ba5a0 con 0x7f5b6c09e410 2023-09-30T22:32:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.640+0000 7f7d1effd700 1 -- 172.21.15.59:0/722739767 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d24022320 con 0x7f7d280a0870 2023-09-30T22:32:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.640+0000 7f5b71a9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b6c09e000 0x7f5b6c1ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.640+0000 7f5b71a9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b6c09e000 0x7f5b6c1ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49914/0 (socket says 172.21.15.59:49914) 2023-09-30T22:32:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.640+0000 7f5b71a9c700 1 -- 172.21.15.59:0/1348553372 learned_addr learned my addr 172.21.15.59:0/1348553372 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.640+0000 7f5b72a9e700 1 --2- 172.21.15.59:0/1348553372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b6c09e410 0x7f5b6c1ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.640+0000 7f5b71a9c700 1 -- 172.21.15.59:0/1348553372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b6c09e410 msgr2=0x7f5b6c1ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.640+0000 7f5b71a9c700 1 --2- 172.21.15.59:0/1348553372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b6c09e410 0x7f5b6c1ac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.640+0000 7f5b71a9c700 1 -- 172.21.15.59:0/1348553372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b6c09d6f0 msgr2=0x7f5b6c1abac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.640+0000 7f5b71a9c700 1 --2- 172.21.15.59:0/1348553372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b6c09d6f0 0x7f5b6c1abac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.640+0000 7f5b71a9c700 1 -- 172.21.15.59:0/1348553372 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c009550 con 0x7f5b6c09e000 2023-09-30T22:32:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.640+0000 7f5b71a9c700 1 --2- 172.21.15.59:0/1348553372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b6c09e000 0x7f5b6c1ac000 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c000c00 tx=0x7f5b5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.641+0000 7f5b62ffd700 1 -- 172.21.15.59:0/1348553372 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00be90 con 0x7f5b6c09e000 2023-09-30T22:32:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.641+0000 7f5b62ffd700 1 -- 172.21.15.59:0/1348553372 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c01f070 con 0x7f5b6c09e000 2023-09-30T22:32:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.641+0000 7f5b62ffd700 1 -- 172.21.15.59:0/1348553372 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c0038e0 con 0x7f5b6c09e000 2023-09-30T22:32:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.641+0000 7f5b74501700 1 -- 172.21.15.59:0/1348553372 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6c1ad770 con 0x7f5b6c09e000 2023-09-30T22:32:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.641+0000 7f5b74501700 1 -- 172.21.15.59:0/1348553372 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6c09c710 con 0x7f5b6c09e000 2023-09-30T22:32:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.642+0000 7f5b62ffd700 1 -- 172.21.15.59:0/1348553372 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b5c021030 con 0x7f5b6c09e000 2023-09-30T22:32:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.642+0000 7f5b62ffd700 1 -- 172.21.15.59:0/1348553372 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5b5c020d00 con 0x7f5b6c09e000 2023-09-30T22:32:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.642+0000 7f5b74501700 1 -- 172.21.15.59:0/1348553372 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6c074ea0 con 0x7f5b6c09e000 2023-09-30T22:32:21.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.652+0000 7f5b62ffd700 1 -- 172.21.15.59:0/1348553372 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b5c015020 con 0x7f5b6c09e000 2023-09-30T22:32:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.695+0000 7f080f6d2700 1 Processor -- start 2023-09-30T22:32:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.695+0000 7f080f6d2700 1 -- start start 2023-09-30T22:32:21.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.696+0000 7f080f6d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f080809e1d0 0x7f0808135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.696+0000 7f080f6d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0808135e50 0x7f0808138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.696+0000 7f080f6d2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080809f130 con 0x7f080809d6f0 2023-09-30T22:32:21.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.696+0000 7f080f6d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080809f520 con 0x7f080809e1d0 2023-09-30T22:32:21.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.696+0000 7f080f6d2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f080809e930 con 0x7f0808135e50 2023-09-30T22:32:21.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.696+0000 7f080d46e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f080809d6f0 0x7f080809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39860/0 (socket says 172.21.15.59:39860) 2023-09-30T22:32:21.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.696+0000 7f080d46e700 1 -- 172.21.15.59:0/2566124957 learned_addr learned my addr 172.21.15.59:0/2566124957 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:21.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.696+0000 7f080dc6f700 1 --2- 172.21.15.59:0/2566124957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0808135e50 0x7f0808138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.696+0000 7f080cc6d700 1 --2- 172.21.15.59:0/2566124957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f080809e1d0 0x7f0808135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.697+0000 7f07fffff700 1 -- 172.21.15.59:0/2566124957 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601414812 0 0) 0x7f080809f130 con 0x7f080809d6f0 2023-09-30T22:32:21.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.697+0000 7f07fffff700 1 -- 172.21.15.59:0/2566124957 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07f40035b0 con 0x7f080809d6f0 2023-09-30T22:32:21.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.697+0000 7f080dc6f700 1 -- 172.21.15.59:0/2566124957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f080809e1d0 msgr2=0x7f0808135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:21.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.697+0000 7f080dc6f700 1 --2- 172.21.15.59:0/2566124957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f080809e1d0 0x7f0808135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.697+0000 7f080dc6f700 1 -- 172.21.15.59:0/2566124957 >> v1:172.21.15.59:6789/0 conn(0x7f080809d6f0 legacy=0x7f080809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.697+0000 7f080dc6f700 1 -- 172.21.15.59:0/2566124957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080809b2d0 con 0x7f0808135e50 2023-09-30T22:32:21.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.697+0000 7f080dc6f700 1 --2- 172.21.15.59:0/2566124957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0808135e50 0x7f0808138230 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0800009dc0 tx=0x7f080000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63bc339f22d2f782 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:21.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.697+0000 7f07fffff700 1 -- 172.21.15.59:0/2566124957 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080000e070 con 0x7f0808135e50 2023-09-30T22:32:21.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.697+0000 7f07fffff700 1 -- 172.21.15.59:0/2566124957 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080000bb20 con 0x7f0808135e50 2023-09-30T22:32:21.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.697+0000 7f07fffff700 1 -- 172.21.15.59:0/2566124957 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800012430 con 0x7f0808135e50 2023-09-30T22:32:21.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.698+0000 7f080f6d2700 1 -- 172.21.15.59:0/2566124957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0808135e50 msgr2=0x7f0808138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.698+0000 7f080f6d2700 1 --2- 172.21.15.59:0/2566124957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0808135e50 0x7f0808138230 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0800009dc0 tx=0x7f080000b330 comp rx=0 tx=0).stop 2023-09-30T22:32:21.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.698+0000 7f080f6d2700 1 -- 172.21.15.59:0/2566124957 shutdown_connections 2023-09-30T22:32:21.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.698+0000 7f080f6d2700 1 --2- 172.21.15.59:0/2566124957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0808135e50 0x7f0808138230 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.698+0000 7f080f6d2700 1 --2- 172.21.15.59:0/2566124957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f080809e1d0 0x7f0808135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.698+0000 7f080f6d2700 1 -- 172.21.15.59:0/2566124957 >> 172.21.15.59:0/2566124957 conn(0x7f0808066f50 msgr2=0x7f080809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:21.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.699+0000 7f080f6d2700 1 -- 172.21.15.59:0/2566124957 shutdown_connections 2023-09-30T22:32:21.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.699+0000 7f080f6d2700 1 -- 172.21.15.59:0/2566124957 wait complete. 2023-09-30T22:32:21.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.700+0000 7f080f6d2700 1 Processor -- start 2023-09-30T22:32:21.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.700+0000 7f080f6d2700 1 -- start start 2023-09-30T22:32:21.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.701+0000 7f080f6d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f080809d6f0 0x7f080811b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.701+0000 7f080f6d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f080809e1d0 0x7f080811b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.701+0000 7f080f6d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0808135e50 0x7f080811bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.701+0000 7f080f6d2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080809c700 con 0x7f080809e1d0 2023-09-30T22:32:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.701+0000 7f080f6d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08080a3bd0 con 0x7f080809d6f0 2023-09-30T22:32:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.701+0000 7f080f6d2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f080811c4f0 con 0x7f0808135e50 2023-09-30T22:32:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.701+0000 7f080cc6d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f080809e1d0 0x7f080811b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.701+0000 7f080d46e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f080809d6f0 0x7f080811b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.701+0000 7f080cc6d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f080809e1d0 0x7f080811b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49930/0 (socket says 172.21.15.59:49930) 2023-09-30T22:32:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.701+0000 7f080cc6d700 1 -- 172.21.15.59:0/3039741947 learned_addr learned my addr 172.21.15.59:0/3039741947 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.701+0000 7f080dc6f700 1 --2- 172.21.15.59:0/3039741947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0808135e50 0x7f080811bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.702+0000 7f080cc6d700 1 -- 172.21.15.59:0/3039741947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0808135e50 msgr2=0x7f080811bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.702+0000 7f080cc6d700 1 --2- 172.21.15.59:0/3039741947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0808135e50 0x7f080811bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.702+0000 7f080cc6d700 1 -- 172.21.15.59:0/3039741947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f080809d6f0 msgr2=0x7f080811b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.702+0000 7f080cc6d700 1 --2- 172.21.15.59:0/3039741947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f080809d6f0 0x7f080811b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.702+0000 7f080cc6d700 1 -- 172.21.15.59:0/3039741947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0800009a70 con 0x7f080809e1d0 2023-09-30T22:32:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.702+0000 7f080d46e700 1 --2- 172.21.15.59:0/3039741947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f080809d6f0 0x7f080811b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.702+0000 7f080cc6d700 1 --2- 172.21.15.59:0/3039741947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f080809e1d0 0x7f080811b640 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f07f8012fc0 tx=0x7f07f80100c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.702+0000 7f07fdffb700 1 -- 172.21.15.59:0/3039741947 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f800dbb0 con 0x7f080809e1d0 2023-09-30T22:32:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.702+0000 7f07fdffb700 1 -- 172.21.15.59:0/3039741947 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f8013040 con 0x7f080809e1d0 2023-09-30T22:32:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.702+0000 7f080f6d2700 1 -- 172.21.15.59:0/3039741947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080811e3b0 con 0x7f080809e1d0 2023-09-30T22:32:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.702+0000 7f07fdffb700 1 -- 172.21.15.59:0/3039741947 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8010bf0 con 0x7f080809e1d0 2023-09-30T22:32:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.703+0000 7f080f6d2700 1 -- 172.21.15.59:0/3039741947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080811d4c0 con 0x7f080809e1d0 2023-09-30T22:32:21.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.704+0000 7f07fdffb700 1 -- 172.21.15.59:0/3039741947 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07f8010d50 con 0x7f080809e1d0 2023-09-30T22:32:21.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.704+0000 7f080f6d2700 1 -- 172.21.15.59:0/3039741947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0808074ea0 con 0x7f080809e1d0 2023-09-30T22:32:21.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.704+0000 7f07fdffb700 1 -- 172.21.15.59:0/3039741947 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f07f8043690 con 0x7f080809e1d0 2023-09-30T22:32:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.709+0000 7f07fdffb700 1 -- 172.21.15.59:0/3039741947 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07f8018480 con 0x7f080809e1d0 2023-09-30T22:32:21.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.739+0000 7f23da892700 1 Processor -- start 2023-09-30T22:32:21.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.740+0000 7f23da892700 1 -- start start 2023-09-30T22:32:21.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.740+0000 7f23da892700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d409d6f0 0x7f23d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.740+0000 7f23da892700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23d409e410 0x7f23d4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.740+0000 7f23da892700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d409f130 con 0x7f23d409e000 2023-09-30T22:32:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.740+0000 7f23da892700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d409f520 con 0x7f23d409e410 2023-09-30T22:32:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.740+0000 7f23da892700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d409e930 con 0x7f23d409d6f0 2023-09-30T22:32:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.741+0000 7f23d37fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f23d409e000 0x7f23d4130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39866/0 (socket says 172.21.15.59:39866) 2023-09-30T22:32:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.741+0000 7f23d37fe700 1 -- 172.21.15.59:0/4022796446 learned_addr learned my addr 172.21.15.59:0/4022796446 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.741+0000 7f23d3fff700 1 --2- 172.21.15.59:0/4022796446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d409d6f0 0x7f23d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.741+0000 7f23d8e2f700 1 --2- 172.21.15.59:0/4022796446 >> v2:172.21.15.59:3300/0 conn(0x7f23d409e410 0x7f23d4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.741+0000 7f23d3fff700 1 -- 172.21.15.59:0/4022796446 >> v2:172.21.15.59:3300/0 conn(0x7f23d409e410 msgr2=0x7f23d4130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.741+0000 7f23d3fff700 1 --2- 172.21.15.59:0/4022796446 >> v2:172.21.15.59:3300/0 conn(0x7f23d409e410 0x7f23d4130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.741+0000 7f23d3fff700 1 -- 172.21.15.59:0/4022796446 >> v1:172.21.15.59:6789/0 conn(0x7f23d409e000 legacy=0x7f23d4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.741+0000 7f23d3fff700 1 -- 172.21.15.59:0/4022796446 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d409b2d0 con 0x7f23d409d6f0 2023-09-30T22:32:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.741+0000 7f23d8e2f700 1 --2- 172.21.15.59:0/4022796446 >> v2:172.21.15.59:3300/0 conn(0x7f23d409e410 0x7f23d4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.741+0000 7f23d3fff700 1 --2- 172.21.15.59:0/4022796446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d409d6f0 0x7f23d409dac0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009840 tx=0x7f23c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd52ff4fd2a7203a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.741+0000 7f23d2ffd700 1 -- 172.21.15.59:0/4022796446 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4011830 con 0x7f23d409d6f0 2023-09-30T22:32:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.742+0000 7f23d2ffd700 1 -- 172.21.15.59:0/4022796446 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c4011990 con 0x7f23d409d6f0 2023-09-30T22:32:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.742+0000 7f23d2ffd700 1 -- 172.21.15.59:0/4022796446 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4011d20 con 0x7f23d409d6f0 2023-09-30T22:32:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.743+0000 7f23da892700 1 -- 172.21.15.59:0/4022796446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d409d6f0 msgr2=0x7f23d409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.743+0000 7f23da892700 1 --2- 172.21.15.59:0/4022796446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d409d6f0 0x7f23d409dac0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009840 tx=0x7f23c4009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.743+0000 7f23da892700 1 -- 172.21.15.59:0/4022796446 shutdown_connections 2023-09-30T22:32:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.743+0000 7f23da892700 1 --2- 172.21.15.59:0/4022796446 >> v2:172.21.15.59:3300/0 conn(0x7f23d409e410 0x7f23d4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.743+0000 7f23da892700 1 --2- 172.21.15.59:0/4022796446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d409d6f0 0x7f23d409dac0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.743+0000 7f23da892700 1 -- 172.21.15.59:0/4022796446 >> 172.21.15.59:0/4022796446 conn(0x7f23d4066f50 msgr2=0x7f23d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.743+0000 7f23da892700 1 -- 172.21.15.59:0/4022796446 shutdown_connections 2023-09-30T22:32:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.743+0000 7f23da892700 1 -- 172.21.15.59:0/4022796446 wait complete. 2023-09-30T22:32:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.744+0000 7f23da892700 1 Processor -- start 2023-09-30T22:32:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.745+0000 7f23da892700 1 -- start start 2023-09-30T22:32:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.745+0000 7f23da892700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d409d6f0 0x7f23d41b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.745+0000 7f23da892700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23d409e000 0x7f23d41b6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.745+0000 7f23da892700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d409e410 0x7f23d41b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.745+0000 7f23da892700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d41b8750 con 0x7f23d409e000 2023-09-30T22:32:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.745+0000 7f23da892700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d4130ba0 con 0x7f23d409e410 2023-09-30T22:32:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.745+0000 7f23da892700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23d412fe10 con 0x7f23d409d6f0 2023-09-30T22:32:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.746+0000 7f23d37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23d409e000 0x7f23d41b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.746+0000 7f23d37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23d409e000 0x7f23d41b6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49944/0 (socket says 172.21.15.59:49944) 2023-09-30T22:32:21.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.746+0000 7f23d37fe700 1 -- 172.21.15.59:0/1306981891 learned_addr learned my addr 172.21.15.59:0/1306981891 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:21.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.746+0000 7f23d3fff700 1 --2- 172.21.15.59:0/1306981891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d409d6f0 0x7f23d41b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.746+0000 7f23d8e2f700 1 --2- 172.21.15.59:0/1306981891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d409e410 0x7f23d41b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:21.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.746+0000 7f23d3fff700 1 -- 172.21.15.59:0/1306981891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d409e410 msgr2=0x7f23d41b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.746+0000 7f23d3fff700 1 --2- 172.21.15.59:0/1306981891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d409e410 0x7f23d41b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.746+0000 7f23d3fff700 1 -- 172.21.15.59:0/1306981891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23d409e000 msgr2=0x7f23d41b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.746+0000 7f23d3fff700 1 --2- 172.21.15.59:0/1306981891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23d409e000 0x7f23d41b6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.746+0000 7f23d3fff700 1 -- 172.21.15.59:0/1306981891 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc009a70 con 0x7f23d409d6f0 2023-09-30T22:32:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.746+0000 7f23d3fff700 1 --2- 172.21.15.59:0/1306981891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d409d6f0 0x7f23d41b6330 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f23d40a3e50 tx=0x7f23c4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.747+0000 7f23d0ff9700 1 -- 172.21.15.59:0/1306981891 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c40036a0 con 0x7f23d409d6f0 2023-09-30T22:32:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.747+0000 7f23d0ff9700 1 -- 172.21.15.59:0/1306981891 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c401f070 con 0x7f23d409d6f0 2023-09-30T22:32:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.747+0000 7f23d0ff9700 1 -- 172.21.15.59:0/1306981891 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4003a60 con 0x7f23d409d6f0 2023-09-30T22:32:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.747+0000 7f23da892700 1 -- 172.21.15.59:0/1306981891 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c40094a0 con 0x7f23d409d6f0 2023-09-30T22:32:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.747+0000 7f23da892700 1 -- 172.21.15.59:0/1306981891 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d409c700 con 0x7f23d409d6f0 2023-09-30T22:32:21.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.748+0000 7f23d0ff9700 1 -- 172.21.15.59:0/1306981891 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23c4003bc0 con 0x7f23d409d6f0 2023-09-30T22:32:21.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.748+0000 7f23da892700 1 -- 172.21.15.59:0/1306981891 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d4074ea0 con 0x7f23d409d6f0 2023-09-30T22:32:21.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.749+0000 7f23d0ff9700 1 -- 172.21.15.59:0/1306981891 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f23c4021070 con 0x7f23d409d6f0 2023-09-30T22:32:21.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.758+0000 7f23d0ff9700 1 -- 172.21.15.59:0/1306981891 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23c40257f0 con 0x7f23d409d6f0 2023-09-30T22:32:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.878+0000 7f7d2f1a2700 1 -- 172.21.15.59:0/722739767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7d2809cf20 con 0x7f7d280a0870 2023-09-30T22:32:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.879+0000 7f7d1effd700 1 -- 172.21.15.59:0/722739767 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d24015070 con 0x7f7d280a0870 2023-09-30T22:32:21.879 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.881+0000 7f7d2f1a2700 1 -- 172.21.15.59:0/722739767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d280a0870 msgr2=0x7f7d28121e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.881+0000 7f7d2f1a2700 1 --2- 172.21.15.59:0/722739767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d280a0870 0x7f7d28121e90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7d24009870 tx=0x7f7d24004750 comp rx=0 tx=0).stop 2023-09-30T22:32:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.881+0000 7f7d2f1a2700 1 -- 172.21.15.59:0/722739767 shutdown_connections 2023-09-30T22:32:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.881+0000 7f7d2f1a2700 1 --2- 172.21.15.59:0/722739767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d280a15b0 0x7f7d28122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.881+0000 7f7d2f1a2700 1 --2- 172.21.15.59:0/722739767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d280a0870 0x7f7d28121e90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.881+0000 7f7d2f1a2700 1 --2- 172.21.15.59:0/722739767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d280a1180 0x7f7d281223d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.881+0000 7f7d2f1a2700 1 -- 172.21.15.59:0/722739767 >> 172.21.15.59:0/722739767 conn(0x7f7d280a6390 msgr2=0x7f7d28133a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.882+0000 7f7d2f1a2700 1 -- 172.21.15.59:0/722739767 shutdown_connections 2023-09-30T22:32:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.882+0000 7f7d2f1a2700 1 -- 172.21.15.59:0/722739767 wait complete. 2023-09-30T22:32:21.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:21.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.912+0000 7f5b74501700 1 -- 172.21.15.59:0/1348553372 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5b6c06c360 con 0x7f5b6c09e000 2023-09-30T22:32:21.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.913+0000 7f5b62ffd700 1 -- 172.21.15.59:0/1348553372 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b5c046060 con 0x7f5b6c09e000 2023-09-30T22:32:21.913 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.915+0000 7f5b74501700 1 -- 172.21.15.59:0/1348553372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b6c09e000 msgr2=0x7f5b6c1ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.915+0000 7f5b74501700 1 --2- 172.21.15.59:0/1348553372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b6c09e000 0x7f5b6c1ac000 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c000c00 tx=0x7f5b5c004750 comp rx=0 tx=0).stop 2023-09-30T22:32:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.915+0000 7f5b74501700 1 -- 172.21.15.59:0/1348553372 shutdown_connections 2023-09-30T22:32:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.915+0000 7f5b74501700 1 --2- 172.21.15.59:0/1348553372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b6c09e410 0x7f5b6c1ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.915+0000 7f5b74501700 1 --2- 172.21.15.59:0/1348553372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b6c09d6f0 0x7f5b6c1abac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.915+0000 7f5b74501700 1 --2- 172.21.15.59:0/1348553372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b6c09e000 0x7f5b6c1ac000 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.915+0000 7f5b74501700 1 -- 172.21.15.59:0/1348553372 >> 172.21.15.59:0/1348553372 conn(0x7f5b6c066f50 msgr2=0x7f5b6c06f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.915+0000 7f5b74501700 1 -- 172.21.15.59:0/1348553372 shutdown_connections 2023-09-30T22:32:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.915+0000 7f5b74501700 1 -- 172.21.15.59:0/1348553372 wait complete. 2023-09-30T22:32:21.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.920+0000 7f080f6d2700 1 -- 172.21.15.59:0/3039741947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f080811e540 con 0x7f080809e1d0 2023-09-30T22:32:21.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.920+0000 7f07fdffb700 1 -- 172.21.15.59:0/3039741947 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07f80173e0 con 0x7f080809e1d0 2023-09-30T22:32:21.921 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:21.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.925+0000 7f080f6d2700 1 -- 172.21.15.59:0/3039741947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f080809e1d0 msgr2=0x7f080811b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:21.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.925+0000 7f080f6d2700 1 --2- 172.21.15.59:0/3039741947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f080809e1d0 0x7f080811b640 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f07f8012fc0 tx=0x7f07f80100c0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.925+0000 7f080f6d2700 1 -- 172.21.15.59:0/3039741947 shutdown_connections 2023-09-30T22:32:21.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.925+0000 7f080f6d2700 1 --2- 172.21.15.59:0/3039741947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0808135e50 0x7f080811bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.925+0000 7f080f6d2700 1 --2- 172.21.15.59:0/3039741947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f080809d6f0 0x7f080811b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.925+0000 7f080f6d2700 1 --2- 172.21.15.59:0/3039741947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f080809e1d0 0x7f080811b640 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:21.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.925+0000 7f080f6d2700 1 -- 172.21.15.59:0/3039741947 >> 172.21.15.59:0/3039741947 conn(0x7f0808066f50 msgr2=0x7f08080a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.925+0000 7f080f6d2700 1 -- 172.21.15.59:0/3039741947 shutdown_connections 2023-09-30T22:32:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:21.925+0000 7f080f6d2700 1 -- 172.21.15.59:0/3039741947 wait complete. 2023-09-30T22:32:21.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:21.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:22.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:22.000+0000 7f23da892700 1 -- 172.21.15.59:0/1306981891 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f23d412f4e0 con 0x7f23d409d6f0 2023-09-30T22:32:22.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:22.000+0000 7f23d0ff9700 1 -- 172.21.15.59:0/1306981891 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23c4015020 con 0x7f23d409d6f0 2023-09-30T22:32:22.000 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:22.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:22.002+0000 7f23da892700 1 -- 172.21.15.59:0/1306981891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d409d6f0 msgr2=0x7f23d41b6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:22.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:22.002+0000 7f23da892700 1 --2- 172.21.15.59:0/1306981891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d409d6f0 0x7f23d41b6330 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f23d40a3e50 tx=0x7f23c4004750 comp rx=0 tx=0).stop 2023-09-30T22:32:22.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:22.002+0000 7f23da892700 1 -- 172.21.15.59:0/1306981891 shutdown_connections 2023-09-30T22:32:22.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:22.002+0000 7f23da892700 1 --2- 172.21.15.59:0/1306981891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d409d6f0 0x7f23d41b6330 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:22.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:22.002+0000 7f23da892700 1 --2- 172.21.15.59:0/1306981891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d409e410 0x7f23d41b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:22.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:22.002+0000 7f23da892700 1 --2- 172.21.15.59:0/1306981891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23d409e000 0x7f23d41b6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:22.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:22.002+0000 7f23da892700 1 -- 172.21.15.59:0/1306981891 >> 172.21.15.59:0/1306981891 conn(0x7f23d4066f50 msgr2=0x7f23d4071de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:22.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:22.003+0000 7f23da892700 1 -- 172.21.15.59:0/1306981891 shutdown_connections 2023-09-30T22:32:22.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:22.003+0000 7f23da892700 1 -- 172.21.15.59:0/1306981891 wait complete. 2023-09-30T22:32:22.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:22.897 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:22.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:22.941 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:23.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:23.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.055+0000 7efec826e700 1 Processor -- start 2023-09-30T22:32:23.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.055+0000 7efec826e700 1 -- start start 2023-09-30T22:32:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.056+0000 7efec826e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efec009d6f0 0x7efec009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.056+0000 7efec826e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efec009e000 0x7efec0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.056+0000 7efec826e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efec009e410 0x7efec0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.056+0000 7efec826e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec009f520 con 0x7efec009e000 2023-09-30T22:32:23.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.056+0000 7efec826e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec009f130 con 0x7efec009d6f0 2023-09-30T22:32:23.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.056+0000 7efec826e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efec009e930 con 0x7efec009e410 2023-09-30T22:32:23.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.056+0000 7efec680b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efec009e410 0x7efec0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.056+0000 7efec5809700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efec009e000 0x7efec0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.056+0000 7efec5809700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efec009e000 0x7efec0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49956/0 (socket says 172.21.15.59:49956) 2023-09-30T22:32:23.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.056+0000 7efec680b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efec009e410 0x7efec0130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46334/0 (socket says 172.21.15.59:46334) 2023-09-30T22:32:23.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.056+0000 7efec5809700 1 -- 172.21.15.59:0/3886173020 learned_addr learned my addr 172.21.15.59:0/3886173020 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.056+0000 7efec600a700 1 --2- 172.21.15.59:0/3886173020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efec009d6f0 0x7efec009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.057+0000 7efec5809700 1 -- 172.21.15.59:0/3886173020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efec009e410 msgr2=0x7efec0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.057+0000 7efec5809700 1 --2- 172.21.15.59:0/3886173020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efec009e410 0x7efec0130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.057+0000 7efec5809700 1 -- 172.21.15.59:0/3886173020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efec009d6f0 msgr2=0x7efec009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.057+0000 7efec5809700 1 --2- 172.21.15.59:0/3886173020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efec009d6f0 0x7efec009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.057+0000 7efec5809700 1 -- 172.21.15.59:0/3886173020 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec009b2d0 con 0x7efec009e000 2023-09-30T22:32:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.057+0000 7efec600a700 1 --2- 172.21.15.59:0/3886173020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efec009d6f0 0x7efec009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.057+0000 7efec5809700 1 --2- 172.21.15.59:0/3886173020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec009e000 0x7efec0130660 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7efeb000bbc0 tx=0x7efeb000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f7626388df2598 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.057+0000 7efec5008700 1 -- 172.21.15.59:0/3886173020 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb000dd50 con 0x7efec009e000 2023-09-30T22:32:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.057+0000 7efec5008700 1 -- 172.21.15.59:0/3886173020 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb0010470 con 0x7efec009e000 2023-09-30T22:32:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.057+0000 7efec5008700 1 -- 172.21.15.59:0/3886173020 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0010800 con 0x7efec009e000 2023-09-30T22:32:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.058+0000 7efec826e700 1 -- 172.21.15.59:0/3886173020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec009e000 msgr2=0x7efec0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.058+0000 7efec826e700 1 --2- 172.21.15.59:0/3886173020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec009e000 0x7efec0130660 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7efeb000bbc0 tx=0x7efeb000bed0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.058+0000 7efec826e700 1 -- 172.21.15.59:0/3886173020 shutdown_connections 2023-09-30T22:32:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.058+0000 7efec826e700 1 --2- 172.21.15.59:0/3886173020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efec009e410 0x7efec0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.058+0000 7efec826e700 1 --2- 172.21.15.59:0/3886173020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efec009d6f0 0x7efec009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.058+0000 7efec826e700 1 --2- 172.21.15.59:0/3886173020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec009e000 0x7efec0130660 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.058+0000 7efec826e700 1 -- 172.21.15.59:0/3886173020 >> 172.21.15.59:0/3886173020 conn(0x7efec0066f50 msgr2=0x7efec009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:23.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.058+0000 7efec826e700 1 -- 172.21.15.59:0/3886173020 shutdown_connections 2023-09-30T22:32:23.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.058+0000 7efec826e700 1 -- 172.21.15.59:0/3886173020 wait complete. 2023-09-30T22:32:23.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.060+0000 7efec826e700 1 Processor -- start 2023-09-30T22:32:23.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.060+0000 7efec826e700 1 -- start start 2023-09-30T22:32:23.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.060+0000 7efec826e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec009d6f0 0x7efec011e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.060+0000 7efec826e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efec009e000 0x7efec011e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.060+0000 7efec826e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efec009e410 0x7efec011ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec826e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec009c700 con 0x7efec009d6f0 2023-09-30T22:32:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec826e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec011f640 con 0x7efec009e410 2023-09-30T22:32:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec826e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efec011fe90 con 0x7efec009e000 2023-09-30T22:32:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec680b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efec009e410 0x7efec011ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec680b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efec009e410 0x7efec011ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43046/0 (socket says 172.21.15.59:43046) 2023-09-30T22:32:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec680b700 1 -- 172.21.15.59:0/1799382421 learned_addr learned my addr 172.21.15.59:0/1799382421 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec600a700 1 --2- 172.21.15.59:0/1799382421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec009d6f0 0x7efec011e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec5809700 1 --2- 172.21.15.59:0/1799382421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efec009e000 0x7efec011e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec600a700 1 -- 172.21.15.59:0/1799382421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efec009e000 msgr2=0x7efec011e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec600a700 1 --2- 172.21.15.59:0/1799382421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efec009e000 0x7efec011e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec600a700 1 -- 172.21.15.59:0/1799382421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efec009e410 msgr2=0x7efec011ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec600a700 1 --2- 172.21.15.59:0/1799382421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efec009e410 0x7efec011ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec600a700 1 -- 172.21.15.59:0/1799382421 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb000b7f0 con 0x7efec009d6f0 2023-09-30T22:32:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec5809700 1 --2- 172.21.15.59:0/1799382421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efec009e000 0x7efec011e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec680b700 1 --2- 172.21.15.59:0/1799382421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efec009e410 0x7efec011ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.061+0000 7efec600a700 1 --2- 172.21.15.59:0/1799382421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec009d6f0 0x7efec011e200 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7efebc009f30 tx=0x7efebc00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.062+0000 7efeb6ffd700 1 -- 172.21.15.59:0/1799382421 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc004230 con 0x7efec009d6f0 2023-09-30T22:32:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.062+0000 7efeb6ffd700 1 -- 172.21.15.59:0/1799382421 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc016070 con 0x7efec009d6f0 2023-09-30T22:32:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.062+0000 7efeb6ffd700 1 -- 172.21.15.59:0/1799382421 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc0045b0 con 0x7efec009d6f0 2023-09-30T22:32:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.062+0000 7efec826e700 1 -- 172.21.15.59:0/1799382421 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec01219b0 con 0x7efec009d6f0 2023-09-30T22:32:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.062+0000 7efec826e700 1 -- 172.21.15.59:0/1799382421 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec00a1d00 con 0x7efec009d6f0 2023-09-30T22:32:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.063+0000 7efeb6ffd700 1 -- 172.21.15.59:0/1799382421 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efebc0128b0 con 0x7efec009d6f0 2023-09-30T22:32:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.063+0000 7efeb6ffd700 1 -- 172.21.15.59:0/1799382421 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efebc018070 con 0x7efec009d6f0 2023-09-30T22:32:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.064+0000 7efec826e700 1 -- 172.21.15.59:0/1799382421 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec0074ea0 con 0x7efec009d6f0 2023-09-30T22:32:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.072+0000 7efeb6ffd700 1 -- 172.21.15.59:0/1799382421 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efebc0036a0 con 0x7efec009d6f0 2023-09-30T22:32:23.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.093+0000 7fe9c51ea700 1 Processor -- start 2023-09-30T22:32:23.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.093+0000 7efe19a20700 1 Processor -- start 2023-09-30T22:32:23.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.093+0000 7fe9c51ea700 1 -- start start 2023-09-30T22:32:23.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.093+0000 7efe19a20700 1 -- start start 2023-09-30T22:32:23.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.094+0000 7fe9c51ea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9c009d6f0 0x7fe9c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.094+0000 7efe19a20700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14133570 0x7efe14135950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.094+0000 7fe9c51ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c009e410 0x7fe9c0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.094+0000 7fe9c51ea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c009f130 con 0x7fe9c009e000 2023-09-30T22:32:23.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.094+0000 7fe9c51ea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c009f520 con 0x7fe9c009d6f0 2023-09-30T22:32:23.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.094+0000 7fe9c51ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c009e930 con 0x7fe9c009e410 2023-09-30T22:32:23.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.094+0000 7fe9bf59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c009e410 0x7fe9c0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.094+0000 7fe9bf59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c009e410 0x7fe9c0130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46356/0 (socket says 172.21.15.59:46356) 2023-09-30T22:32:23.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.094+0000 7fe9bed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9c009d6f0 0x7fe9c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.094+0000 7fe9bf59e700 1 -- 172.21.15.59:0/666155829 learned_addr learned my addr 172.21.15.59:0/666155829 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:23.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.094+0000 7fe9bf59e700 1 -- 172.21.15.59:0/666155829 >> v2:172.21.15.59:3300/0 conn(0x7fe9c009d6f0 msgr2=0x7fe9c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:23.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.094+0000 7fe9bf59e700 1 --2- 172.21.15.59:0/666155829 >> v2:172.21.15.59:3300/0 conn(0x7fe9c009d6f0 0x7fe9c009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.094+0000 7fe9bf59e700 1 -- 172.21.15.59:0/666155829 >> v1:172.21.15.59:6789/0 conn(0x7fe9c009e000 legacy=0x7fe9c0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.094+0000 7fe9bf59e700 1 -- 172.21.15.59:0/666155829 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c009b2d0 con 0x7fe9c009e410 2023-09-30T22:32:23.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.094+0000 7fe9bf59e700 1 --2- 172.21.15.59:0/666155829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c009e410 0x7fe9c0130d70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800d150 tx=0x7fe9b800d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c56a2de666315178 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:23.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.095+0000 7fe9bdd9b700 1 -- 172.21.15.59:0/666155829 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8010070 con 0x7fe9c009e410 2023-09-30T22:32:23.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.095+0000 7fe9bdd9b700 1 -- 172.21.15.59:0/666155829 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b800dd10 con 0x7fe9c009e410 2023-09-30T22:32:23.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.095+0000 7fe9bdd9b700 1 -- 172.21.15.59:0/666155829 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b800b310 con 0x7fe9c009e410 2023-09-30T22:32:23.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.095+0000 7fe9c51ea700 1 -- 172.21.15.59:0/666155829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c009e410 msgr2=0x7fe9c0130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.095+0000 7fe9c51ea700 1 --2- 172.21.15.59:0/666155829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c009e410 0x7fe9c0130d70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800d150 tx=0x7fe9b800d460 comp rx=0 tx=0).stop 2023-09-30T22:32:23.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.096+0000 7fe9c51ea700 1 -- 172.21.15.59:0/666155829 shutdown_connections 2023-09-30T22:32:23.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.096+0000 7fe9c51ea700 1 --2- 172.21.15.59:0/666155829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c009e410 0x7fe9c0130d70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.096+0000 7fe9c51ea700 1 --2- 172.21.15.59:0/666155829 >> v2:172.21.15.59:3300/0 conn(0x7fe9c009d6f0 0x7fe9c009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.096+0000 7fe9c51ea700 1 -- 172.21.15.59:0/666155829 >> 172.21.15.59:0/666155829 conn(0x7fe9c0066f50 msgr2=0x7fe9c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:23.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.096+0000 7fe9c51ea700 1 -- 172.21.15.59:0/666155829 shutdown_connections 2023-09-30T22:32:23.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.096+0000 7fe9c51ea700 1 -- 172.21.15.59:0/666155829 wait complete. 2023-09-30T22:32:23.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.097+0000 7efe19a20700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe14135e90 0x7efe14138270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.097+0000 7efe127fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14133570 0x7efe14135950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.097+0000 7efe19a20700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1409c280 con 0x7efe140954c0 2023-09-30T22:32:23.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.097+0000 7efe127fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14133570 0x7efe14135950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46370/0 (socket says 172.21.15.59:46370) 2023-09-30T22:32:23.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.097+0000 7efe127fc700 1 -- 172.21.15.59:0/2620122135 learned_addr learned my addr 172.21.15.59:0/2620122135 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:23.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.097+0000 7efe19a20700 1 -- 172.21.15.59:0/2620122135 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1409aaf0 con 0x7efe14135e90 2023-09-30T22:32:23.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.097+0000 7efe19a20700 1 -- 172.21.15.59:0/2620122135 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe1409b960 con 0x7efe14133570 2023-09-30T22:32:23.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.097+0000 7efe137fe700 1 --2- 172.21.15.59:0/2620122135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe14135e90 0x7efe14138270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.097+0000 7efe137fe700 1 -- 172.21.15.59:0/2620122135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14133570 msgr2=0x7efe14135950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:23.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.097+0000 7efe137fe700 1 --2- 172.21.15.59:0/2620122135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14133570 0x7efe14135950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.097+0000 7efe137fe700 1 -- 172.21.15.59:0/2620122135 >> v1:172.21.15.59:6789/0 conn(0x7efe140954c0 legacy=0x7efe14095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.097+0000 7efe137fe700 1 -- 172.21.15.59:0/2620122135 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1409a7b0 con 0x7efe14135e90 2023-09-30T22:32:23.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.097+0000 7fe9c51ea700 1 Processor -- start 2023-09-30T22:32:23.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.097+0000 7efe137fe700 1 --2- 172.21.15.59:0/2620122135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe14135e90 0x7efe14138270 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009dc0 tx=0x7efe0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d5a0628cd2e8bad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:23.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.098+0000 7efe11ffb700 1 -- 172.21.15.59:0/2620122135 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c00e070 con 0x7efe14135e90 2023-09-30T22:32:23.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.098+0000 7efe11ffb700 1 -- 172.21.15.59:0/2620122135 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c00bb20 con 0x7efe14135e90 2023-09-30T22:32:23.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.098+0000 7efe11ffb700 1 -- 172.21.15.59:0/2620122135 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c012430 con 0x7efe14135e90 2023-09-30T22:32:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.097+0000 7fe9c51ea700 1 -- start start 2023-09-30T22:32:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.098+0000 7fe9c51ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c009d6f0 0x7fe9c011ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.098+0000 7fe9c51ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c009e000 0x7fe9c011e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.098+0000 7fe9c51ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c009e410 0x7fe9c011e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.098+0000 7fe9c51ea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c011fa90 con 0x7fe9c009e410 2023-09-30T22:32:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.098+0000 7fe9c51ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c0120ce0 con 0x7fe9c009d6f0 2023-09-30T22:32:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.098+0000 7fe9c51ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c0120070 con 0x7fe9c009e000 2023-09-30T22:32:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.098+0000 7fe9bed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c009d6f0 0x7fe9c011ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.098+0000 7fe9be59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c009e000 0x7fe9c011e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.098+0000 7fe9bed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c009d6f0 0x7fe9c011ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43058/0 (socket says 172.21.15.59:43058) 2023-09-30T22:32:23.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.098+0000 7fe9bed9d700 1 -- 172.21.15.59:0/2775480489 learned_addr learned my addr 172.21.15.59:0/2775480489 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:23.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.098+0000 7fe9be59c700 1 --2- 172.21.15.59:0/2775480489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c009e000 0x7fe9c011e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46380/0 (socket says 172.21.15.59:46380) 2023-09-30T22:32:23.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7fe9be59c700 1 -- 172.21.15.59:0/2775480489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c009d6f0 msgr2=0x7fe9c011ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7fe9be59c700 1 --2- 172.21.15.59:0/2775480489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c009d6f0 0x7fe9c011ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7fe9bf59e700 1 --2- 172.21.15.59:0/2775480489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c009e410 0x7fe9c011e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7fe9be59c700 1 -- 172.21.15.59:0/2775480489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c009e410 msgr2=0x7fe9c011e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7fe9be59c700 1 --2- 172.21.15.59:0/2775480489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c009e410 0x7fe9c011e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7fe9be59c700 1 -- 172.21.15.59:0/2775480489 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b800bd40 con 0x7fe9c009e000 2023-09-30T22:32:23.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7fe9bf59e700 1 --2- 172.21.15.59:0/2775480489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c009e410 0x7fe9c011e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:23.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7efe19a20700 1 -- 172.21.15.59:0/2620122135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe14135e90 msgr2=0x7efe14138270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7efe19a20700 1 --2- 172.21.15.59:0/2620122135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe14135e90 0x7efe14138270 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009dc0 tx=0x7efe0c00b330 comp rx=0 tx=0).stop 2023-09-30T22:32:23.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7fe9be59c700 1 --2- 172.21.15.59:0/2775480489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c009e000 0x7fe9c011e410 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4000f60 tx=0x7fe9b4001a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:23.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7efe19a20700 1 -- 172.21.15.59:0/2620122135 shutdown_connections 2023-09-30T22:32:23.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7efe19a20700 1 --2- 172.21.15.59:0/2620122135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe14135e90 0x7efe14138270 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7efe19a20700 1 --2- 172.21.15.59:0/2620122135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14133570 0x7efe14135950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7efe19a20700 1 -- 172.21.15.59:0/2620122135 >> 172.21.15.59:0/2620122135 conn(0x7efe140a2360 msgr2=0x7efe140a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:23.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7fe9a77fe700 1 -- 172.21.15.59:0/2775480489 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4013070 con 0x7fe9c009e000 2023-09-30T22:32:23.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7efe19a20700 1 -- 172.21.15.59:0/2620122135 shutdown_connections 2023-09-30T22:32:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7fe9a77fe700 1 -- 172.21.15.59:0/2775480489 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b400e2e0 con 0x7fe9c009e000 2023-09-30T22:32:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7efe19a20700 1 -- 172.21.15.59:0/2620122135 wait complete. 2023-09-30T22:32:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.099+0000 7fe9a77fe700 1 -- 172.21.15.59:0/2775480489 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b40052f0 con 0x7fe9c009e000 2023-09-30T22:32:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.100+0000 7fe9c51ea700 1 -- 172.21.15.59:0/2775480489 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c0121720 con 0x7fe9c009e000 2023-09-30T22:32:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.100+0000 7fe9c51ea700 1 -- 172.21.15.59:0/2775480489 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c009c700 con 0x7fe9c009e000 2023-09-30T22:32:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.101+0000 7efe19a20700 1 Processor -- start 2023-09-30T22:32:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.101+0000 7fe9c51ea700 1 -- 172.21.15.59:0/2775480489 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c0074ea0 con 0x7fe9c009e000 2023-09-30T22:32:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.101+0000 7fe9a77fe700 1 -- 172.21.15.59:0/2775480489 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe9b4003680 con 0x7fe9c009e000 2023-09-30T22:32:23.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.101+0000 7fe9a77fe700 1 -- 172.21.15.59:0/2775480489 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe9b4042ce0 con 0x7fe9c009e000 2023-09-30T22:32:23.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.101+0000 7efe19a20700 1 -- start start 2023-09-30T22:32:23.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.102+0000 7efe19a20700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe140954c0 0x7efe141cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.102+0000 7efe19a20700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe14133570 0x7efe141cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.102+0000 7efe19a20700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14135e90 0x7efe141cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.102+0000 7efe19a20700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe14070a40 con 0x7efe14133570 2023-09-30T22:32:23.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.102+0000 7efe19a20700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe14130430 con 0x7efe140954c0 2023-09-30T22:32:23.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.102+0000 7efe19a20700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe1409b000 con 0x7efe14135e90 2023-09-30T22:32:23.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.102+0000 7efe127fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe14133570 0x7efe141cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.102+0000 7efe127fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe14133570 0x7efe141cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49984/0 (socket says 172.21.15.59:49984) 2023-09-30T22:32:23.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.102+0000 7efe127fc700 1 -- 172.21.15.59:0/188298604 learned_addr learned my addr 172.21.15.59:0/188298604 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:23.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.102+0000 7efe12ffd700 1 --2- 172.21.15.59:0/188298604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe140954c0 0x7efe141cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.102+0000 7efe137fe700 1 --2- 172.21.15.59:0/188298604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14135e90 0x7efe141cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.103+0000 7efe137fe700 1 -- 172.21.15.59:0/188298604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe140954c0 msgr2=0x7efe141cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.103+0000 7efe137fe700 1 --2- 172.21.15.59:0/188298604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe140954c0 0x7efe141cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.103+0000 7efe137fe700 1 -- 172.21.15.59:0/188298604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe14133570 msgr2=0x7efe141cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.103+0000 7efe137fe700 1 --2- 172.21.15.59:0/188298604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe14133570 0x7efe141cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.103+0000 7efe137fe700 1 -- 172.21.15.59:0/188298604 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c009a70 con 0x7efe14135e90 2023-09-30T22:32:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.103+0000 7efe12ffd700 1 --2- 172.21.15.59:0/188298604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe140954c0 0x7efe141cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.103+0000 7efe137fe700 1 --2- 172.21.15.59:0/188298604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14135e90 0x7efe141cc6b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efe1409d3b0 tx=0x7efe0c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.106+0000 7efdfbfff700 1 -- 172.21.15.59:0/188298604 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0048b0 con 0x7efe14135e90 2023-09-30T22:32:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.106+0000 7efdfbfff700 1 -- 172.21.15.59:0/188298604 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c020070 con 0x7efe14135e90 2023-09-30T22:32:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.106+0000 7efdfbfff700 1 -- 172.21.15.59:0/188298604 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0276c0 con 0x7efe14135e90 2023-09-30T22:32:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.107+0000 7fe9a77fe700 1 -- 172.21.15.59:0/2775480489 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9b4010940 con 0x7fe9c009e000 2023-09-30T22:32:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.107+0000 7efe19a20700 1 -- 172.21.15.59:0/188298604 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe14070c70 con 0x7efe14135e90 2023-09-30T22:32:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.107+0000 7efe19a20700 1 -- 172.21.15.59:0/188298604 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe141cc400 con 0x7efe14135e90 2023-09-30T22:32:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.108+0000 7efe19a20700 1 -- 172.21.15.59:0/188298604 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe14130240 con 0x7efe14135e90 2023-09-30T22:32:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.108+0000 7efdfbfff700 1 -- 172.21.15.59:0/188298604 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe0c027820 con 0x7efe14135e90 2023-09-30T22:32:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.108+0000 7efdfbfff700 1 -- 172.21.15.59:0/188298604 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efe0c022070 con 0x7efe14135e90 2023-09-30T22:32:23.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.113+0000 7efdfbfff700 1 -- 172.21.15.59:0/188298604 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe0c012430 con 0x7efe14135e90 2023-09-30T22:32:23.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.167+0000 7f2d77b47700 1 Processor -- start 2023-09-30T22:32:23.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.167+0000 7f2d77b47700 1 -- start start 2023-09-30T22:32:23.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.168+0000 7f2d77b47700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7009e930 0x7f2d7009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.168+0000 7f2d77b47700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d7009f650 0x7f2d70131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.168+0000 7f2d77b47700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d70070940 con 0x7f2d7009f240 2023-09-30T22:32:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.168+0000 7f2d77b47700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7006fd60 con 0x7f2d7009e930 2023-09-30T22:32:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.168+0000 7f2d77b47700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7006fa80 con 0x7f2d7009f650 2023-09-30T22:32:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.168+0000 7f2d750e2700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2d7009f240 0x7f2d701317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39888/0 (socket says 172.21.15.59:39888) 2023-09-30T22:32:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.168+0000 7f2d750e2700 1 -- 172.21.15.59:0/4178280657 learned_addr learned my addr 172.21.15.59:0/4178280657 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.168+0000 7f2d758e3700 1 --2- 172.21.15.59:0/4178280657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7009e930 0x7f2d7009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.169+0000 7f2d760e4700 1 --2- 172.21.15.59:0/4178280657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d7009f650 0x7f2d70131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.169+0000 7f2d748e1700 1 -- 172.21.15.59:0/4178280657 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267150279 0 0) 0x7f2d70070940 con 0x7f2d7009f240 2023-09-30T22:32:23.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.169+0000 7f2d748e1700 1 -- 172.21.15.59:0/4178280657 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d580035b0 con 0x7f2d7009f240 2023-09-30T22:32:23.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.169+0000 7f2d758e3700 1 -- 172.21.15.59:0/4178280657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d7009f650 msgr2=0x7f2d70131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:23.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.169+0000 7f2d758e3700 1 --2- 172.21.15.59:0/4178280657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d7009f650 0x7f2d70131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.169+0000 7f2d758e3700 1 -- 172.21.15.59:0/4178280657 >> v1:172.21.15.59:6789/0 conn(0x7f2d7009f240 legacy=0x7f2d701317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.169+0000 7f2d758e3700 1 -- 172.21.15.59:0/4178280657 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7009fb60 con 0x7f2d7009e930 2023-09-30T22:32:23.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.169+0000 7f2d758e3700 1 --2- 172.21.15.59:0/4178280657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7009e930 0x7f2d7009ed00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009dc0 tx=0x7f2d6000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc7245fd32dc6664 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:23.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.169+0000 7f2d748e1700 1 -- 172.21.15.59:0/4178280657 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6000e070 con 0x7f2d7009e930 2023-09-30T22:32:23.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.169+0000 7f2d748e1700 1 -- 172.21.15.59:0/4178280657 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6000bb20 con 0x7f2d7009e930 2023-09-30T22:32:23.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.169+0000 7f2d748e1700 1 -- 172.21.15.59:0/4178280657 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6000be90 con 0x7f2d7009e930 2023-09-30T22:32:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.170+0000 7f2d77b47700 1 -- 172.21.15.59:0/4178280657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7009e930 msgr2=0x7f2d7009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.170+0000 7f2d77b47700 1 --2- 172.21.15.59:0/4178280657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7009e930 0x7f2d7009ed00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009dc0 tx=0x7f2d6000b330 comp rx=0 tx=0).stop 2023-09-30T22:32:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.170+0000 7f2d77b47700 1 -- 172.21.15.59:0/4178280657 shutdown_connections 2023-09-30T22:32:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.170+0000 7f2d77b47700 1 --2- 172.21.15.59:0/4178280657 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d7009f650 0x7f2d70131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.170+0000 7f2d77b47700 1 --2- 172.21.15.59:0/4178280657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7009e930 0x7f2d7009ed00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.170+0000 7f2d77b47700 1 -- 172.21.15.59:0/4178280657 >> 172.21.15.59:0/4178280657 conn(0x7f2d700a4210 msgr2=0x7f2d700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:23.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.170+0000 7f2d77b47700 1 -- 172.21.15.59:0/4178280657 shutdown_connections 2023-09-30T22:32:23.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.170+0000 7f2d77b47700 1 -- 172.21.15.59:0/4178280657 wait complete. 2023-09-30T22:32:23.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.171+0000 7f2d77b47700 1 Processor -- start 2023-09-30T22:32:23.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.171+0000 7f2d77b47700 1 -- start start 2023-09-30T22:32:23.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d77b47700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d7009e930 0x7f2d701c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d77b47700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7009f240 0x7f2d701c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d77b47700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d7009f650 0x7f2d701c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d77b47700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d701a56d0 con 0x7f2d7009e930 2023-09-30T22:32:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d77b47700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d701a5fa0 con 0x7f2d7009f240 2023-09-30T22:32:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d77b47700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d700a34c0 con 0x7f2d7009f650 2023-09-30T22:32:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d758e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d7009e930 0x7f2d701c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d758e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d7009e930 0x7f2d701c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50000/0 (socket says 172.21.15.59:50000) 2023-09-30T22:32:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d758e3700 1 -- 172.21.15.59:0/1545501639 learned_addr learned my addr 172.21.15.59:0/1545501639 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d750e2700 1 --2- 172.21.15.59:0/1545501639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7009f240 0x7f2d701c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d760e4700 1 --2- 172.21.15.59:0/1545501639 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d7009f650 0x7f2d701c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d758e3700 1 -- 172.21.15.59:0/1545501639 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d7009f650 msgr2=0x7f2d701c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d758e3700 1 --2- 172.21.15.59:0/1545501639 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d7009f650 0x7f2d701c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d758e3700 1 -- 172.21.15.59:0/1545501639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7009f240 msgr2=0x7f2d701c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d758e3700 1 --2- 172.21.15.59:0/1545501639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7009f240 0x7f2d701c3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d758e3700 1 -- 172.21.15.59:0/1545501639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d60009a70 con 0x7f2d7009e930 2023-09-30T22:32:23.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d750e2700 1 --2- 172.21.15.59:0/1545501639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7009f240 0x7f2d701c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:23.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.172+0000 7f2d758e3700 1 --2- 172.21.15.59:0/1545501639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d7009e930 0x7f2d701c2e50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000b370 tx=0x7f2d60004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:23.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.173+0000 7f2d6e7fc700 1 -- 172.21.15.59:0/1545501639 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d60009480 con 0x7f2d7009e930 2023-09-30T22:32:23.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.173+0000 7f2d6e7fc700 1 -- 172.21.15.59:0/1545501639 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d60020070 con 0x7f2d7009e930 2023-09-30T22:32:23.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.173+0000 7f2d77b47700 1 -- 172.21.15.59:0/1545501639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d700a0190 con 0x7f2d7009e930 2023-09-30T22:32:23.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.173+0000 7f2d6e7fc700 1 -- 172.21.15.59:0/1545501639 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d600276c0 con 0x7f2d7009e930 2023-09-30T22:32:23.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.173+0000 7f2d77b47700 1 -- 172.21.15.59:0/1545501639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d701a6920 con 0x7f2d7009e930 2023-09-30T22:32:23.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.174+0000 7f2d6e7fc700 1 -- 172.21.15.59:0/1545501639 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d60012430 con 0x7f2d7009e930 2023-09-30T22:32:23.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.174+0000 7f2d77b47700 1 -- 172.21.15.59:0/1545501639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d70074ea0 con 0x7f2d7009e930 2023-09-30T22:32:23.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.174+0000 7f2d6e7fc700 1 -- 172.21.15.59:0/1545501639 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d60022070 con 0x7f2d7009e930 2023-09-30T22:32:23.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.179+0000 7f2d6e7fc700 1 -- 172.21.15.59:0/1545501639 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d6001a790 con 0x7f2d7009e930 2023-09-30T22:32:23.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.325+0000 7efec826e700 1 -- 172.21.15.59:0/1799382421 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efec0121d50 con 0x7efec009d6f0 2023-09-30T22:32:23.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.325+0000 7efeb6ffd700 1 -- 172.21.15.59:0/1799382421 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efebc01ab10 con 0x7efec009d6f0 2023-09-30T22:32:23.326 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.328+0000 7efec826e700 1 -- 172.21.15.59:0/1799382421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec009d6f0 msgr2=0x7efec011e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.328+0000 7efec826e700 1 --2- 172.21.15.59:0/1799382421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec009d6f0 0x7efec011e200 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7efebc009f30 tx=0x7efebc00da60 comp rx=0 tx=0).stop 2023-09-30T22:32:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.328+0000 7efec826e700 1 -- 172.21.15.59:0/1799382421 shutdown_connections 2023-09-30T22:32:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.328+0000 7efec826e700 1 --2- 172.21.15.59:0/1799382421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efec009e410 0x7efec011ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.328+0000 7efec826e700 1 --2- 172.21.15.59:0/1799382421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec009d6f0 0x7efec011e200 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.328+0000 7efec826e700 1 --2- 172.21.15.59:0/1799382421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efec009e000 0x7efec011e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.328+0000 7efec826e700 1 -- 172.21.15.59:0/1799382421 >> 172.21.15.59:0/1799382421 conn(0x7efec0066f50 msgr2=0x7efec006f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.329+0000 7efec826e700 1 -- 172.21.15.59:0/1799382421 shutdown_connections 2023-09-30T22:32:23.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.329+0000 7efec826e700 1 -- 172.21.15.59:0/1799382421 wait complete. 2023-09-30T22:32:23.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:23.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.364+0000 7fe9c51ea700 1 -- 172.21.15.59:0/2775480489 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe9c006c360 con 0x7fe9c009e000 2023-09-30T22:32:23.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.364+0000 7fe9a77fe700 1 -- 172.21.15.59:0/2775480489 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9b40173e0 con 0x7fe9c009e000 2023-09-30T22:32:23.367 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:23.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.367+0000 7efe19a20700 1 -- 172.21.15.59:0/188298604 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efe14074ea0 con 0x7efe14135e90 2023-09-30T22:32:23.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.367+0000 7efdfbfff700 1 -- 172.21.15.59:0/188298604 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe0c01a7a0 con 0x7efe14135e90 2023-09-30T22:32:23.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.367+0000 7fe9c51ea700 1 -- 172.21.15.59:0/2775480489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c009e000 msgr2=0x7fe9c011e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.367+0000 7fe9c51ea700 1 --2- 172.21.15.59:0/2775480489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c009e000 0x7fe9c011e410 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4000f60 tx=0x7fe9b4001a40 comp rx=0 tx=0).stop 2023-09-30T22:32:23.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.367+0000 7fe9c51ea700 1 -- 172.21.15.59:0/2775480489 shutdown_connections 2023-09-30T22:32:23.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.367+0000 7fe9c51ea700 1 --2- 172.21.15.59:0/2775480489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9c009e410 0x7fe9c011e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.367+0000 7fe9c51ea700 1 --2- 172.21.15.59:0/2775480489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9c009d6f0 0x7fe9c011ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.367+0000 7fe9c51ea700 1 --2- 172.21.15.59:0/2775480489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9c009e000 0x7fe9c011e410 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.367+0000 7fe9c51ea700 1 -- 172.21.15.59:0/2775480489 >> 172.21.15.59:0/2775480489 conn(0x7fe9c0066f50 msgr2=0x7fe9c0070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:23.369 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:23.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.367+0000 7fe9c51ea700 1 -- 172.21.15.59:0/2775480489 shutdown_connections 2023-09-30T22:32:23.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.367+0000 7fe9c51ea700 1 -- 172.21.15.59:0/2775480489 wait complete. 2023-09-30T22:32:23.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.369+0000 7efe19a20700 1 -- 172.21.15.59:0/188298604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14135e90 msgr2=0x7efe141cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.369+0000 7efe19a20700 1 --2- 172.21.15.59:0/188298604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14135e90 0x7efe141cc6b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efe1409d3b0 tx=0x7efe0c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.369+0000 7efe19a20700 1 -- 172.21.15.59:0/188298604 shutdown_connections 2023-09-30T22:32:23.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.369+0000 7efe19a20700 1 --2- 172.21.15.59:0/188298604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14135e90 0x7efe141cc6b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.369+0000 7efe19a20700 1 --2- 172.21.15.59:0/188298604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe140954c0 0x7efe141cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.369+0000 7efe19a20700 1 --2- 172.21.15.59:0/188298604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe14133570 0x7efe141cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.369+0000 7efe19a20700 1 -- 172.21.15.59:0/188298604 >> 172.21.15.59:0/188298604 conn(0x7efe140a2360 msgr2=0x7efe14133940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:23.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.370+0000 7efe19a20700 1 -- 172.21.15.59:0/188298604 shutdown_connections 2023-09-30T22:32:23.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.370+0000 7efe19a20700 1 -- 172.21.15.59:0/188298604 wait complete. 2023-09-30T22:32:23.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:23.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:23.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.421+0000 7f2d77b47700 1 -- 172.21.15.59:0/1545501639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2d7006b250 con 0x7f2d7009e930 2023-09-30T22:32:23.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.422+0000 7f2d6e7fc700 1 -- 172.21.15.59:0/1545501639 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d60011390 con 0x7f2d7009e930 2023-09-30T22:32:23.422 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:23.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.424+0000 7f2d77b47700 1 -- 172.21.15.59:0/1545501639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d7009e930 msgr2=0x7f2d701c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:23.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.424+0000 7f2d77b47700 1 --2- 172.21.15.59:0/1545501639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d7009e930 0x7f2d701c2e50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000b370 tx=0x7f2d60004ad0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.424+0000 7f2d77b47700 1 -- 172.21.15.59:0/1545501639 shutdown_connections 2023-09-30T22:32:23.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.424+0000 7f2d77b47700 1 --2- 172.21.15.59:0/1545501639 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d7009f650 0x7f2d701c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.424+0000 7f2d77b47700 1 --2- 172.21.15.59:0/1545501639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d7009e930 0x7f2d701c2e50 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.424+0000 7f2d77b47700 1 --2- 172.21.15.59:0/1545501639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7009f240 0x7f2d701c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:23.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.424+0000 7f2d77b47700 1 -- 172.21.15.59:0/1545501639 >> 172.21.15.59:0/1545501639 conn(0x7f2d700a4210 msgr2=0x7f2d701b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:23.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.424+0000 7f2d77b47700 1 -- 172.21.15.59:0/1545501639 shutdown_connections 2023-09-30T22:32:23.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:23.424+0000 7f2d77b47700 1 -- 172.21.15.59:0/1545501639 wait complete. 2023-09-30T22:32:23.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:24.343 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:24.383 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:24.385 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:24.439 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.509+0000 7f28548fc700 1 Processor -- start 2023-09-30T22:32:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.509+0000 7f28548fc700 1 -- start start 2023-09-30T22:32:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.510+0000 7f28548fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f285009e930 0x7f285009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.510+0000 7f28548fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285009f240 0x7f28501317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.510+0000 7f28548fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f285009f650 0x7f2850131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.510+0000 7f28548fc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2850070940 con 0x7f285009f650 2023-09-30T22:32:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.510+0000 7f28548fc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285006fd60 con 0x7f285009f240 2023-09-30T22:32:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.510+0000 7f28548fc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f285006fa80 con 0x7f285009e930 2023-09-30T22:32:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.510+0000 7f284e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f285009e930 0x7f285009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.510+0000 7f284dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285009f240 0x7f28501317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.510+0000 7f284e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f285009e930 0x7f285009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52786/0 (socket says 172.21.15.59:52786) 2023-09-30T22:32:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.510+0000 7f284dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285009f240 0x7f28501317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41200/0 (socket says 172.21.15.59:41200) 2023-09-30T22:32:24.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.510+0000 7f284e59c700 1 -- 172.21.15.59:0/2344604649 learned_addr learned my addr 172.21.15.59:0/2344604649 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:24.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.510+0000 7f284ed9d700 1 --2- 172.21.15.59:0/2344604649 >> v2:172.21.15.59:3300/0 conn(0x7f285009f650 0x7f2850131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.511+0000 7f284dd9b700 1 -- 172.21.15.59:0/2344604649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f285009e930 msgr2=0x7f285009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:24.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.511+0000 7f284dd9b700 1 --2- 172.21.15.59:0/2344604649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f285009e930 0x7f285009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.511+0000 7f284dd9b700 1 -- 172.21.15.59:0/2344604649 >> v2:172.21.15.59:3300/0 conn(0x7f285009f650 msgr2=0x7f2850131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:24.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.511+0000 7f284dd9b700 1 --2- 172.21.15.59:0/2344604649 >> v2:172.21.15.59:3300/0 conn(0x7f285009f650 0x7f2850131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.511+0000 7f284dd9b700 1 -- 172.21.15.59:0/2344604649 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285009fb60 con 0x7f285009f240 2023-09-30T22:32:24.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.511+0000 7f284dd9b700 1 --2- 172.21.15.59:0/2344604649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285009f240 0x7f28501317f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2844009840 tx=0x7f2844009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3189eb11e528df51 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.511+0000 7f284d59a700 1 -- 172.21.15.59:0/2344604649 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844011830 con 0x7f285009f240 2023-09-30T22:32:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.511+0000 7f284d59a700 1 -- 172.21.15.59:0/2344604649 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2844011990 con 0x7f285009f240 2023-09-30T22:32:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.511+0000 7f284d59a700 1 -- 172.21.15.59:0/2344604649 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844011d20 con 0x7f285009f240 2023-09-30T22:32:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.512+0000 7f28548fc700 1 -- 172.21.15.59:0/2344604649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285009f240 msgr2=0x7f28501317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.512+0000 7f28548fc700 1 --2- 172.21.15.59:0/2344604649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285009f240 0x7f28501317f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2844009840 tx=0x7f2844009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.512+0000 7f28548fc700 1 -- 172.21.15.59:0/2344604649 shutdown_connections 2023-09-30T22:32:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.512+0000 7f28548fc700 1 --2- 172.21.15.59:0/2344604649 >> v2:172.21.15.59:3300/0 conn(0x7f285009f650 0x7f2850131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.512+0000 7f28548fc700 1 --2- 172.21.15.59:0/2344604649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f285009e930 0x7f285009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.512+0000 7f28548fc700 1 --2- 172.21.15.59:0/2344604649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285009f240 0x7f28501317f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.512+0000 7f28548fc700 1 -- 172.21.15.59:0/2344604649 >> 172.21.15.59:0/2344604649 conn(0x7f28500a4210 msgr2=0x7f28500a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:24.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.512+0000 7f28548fc700 1 -- 172.21.15.59:0/2344604649 shutdown_connections 2023-09-30T22:32:24.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.512+0000 7f28548fc700 1 -- 172.21.15.59:0/2344604649 wait complete. 2023-09-30T22:32:24.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.514+0000 7f28548fc700 1 Processor -- start 2023-09-30T22:32:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.514+0000 7f28548fc700 1 -- start start 2023-09-30T22:32:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.515+0000 7f28548fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f285009e930 0x7f285012f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.515+0000 7f28548fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285009f240 0x7f285012f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.515+0000 7f28548fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285009f650 0x7f285012fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.515+0000 7f28548fc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28501232a0 con 0x7f285009f240 2023-09-30T22:32:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.515+0000 7f28548fc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28501321c0 con 0x7f285009f650 2023-09-30T22:32:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.515+0000 7f28548fc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28500a34c0 con 0x7f285009e930 2023-09-30T22:32:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.515+0000 7f284ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285009f650 0x7f285012fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.515+0000 7f284ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285009f650 0x7f285012fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41212/0 (socket says 172.21.15.59:41212) 2023-09-30T22:32:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.515+0000 7f284ed9d700 1 -- 172.21.15.59:0/3637806936 learned_addr learned my addr 172.21.15.59:0/3637806936 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:24.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.515+0000 7f284e59c700 1 --2- 172.21.15.59:0/3637806936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f285009e930 0x7f285012f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.515+0000 7f284dd9b700 1 --2- 172.21.15.59:0/3637806936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285009f240 0x7f285012f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.515+0000 7f284ed9d700 1 -- 172.21.15.59:0/3637806936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f285009e930 msgr2=0x7f285012f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.515+0000 7f284ed9d700 1 --2- 172.21.15.59:0/3637806936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f285009e930 0x7f285012f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.516+0000 7f284ed9d700 1 -- 172.21.15.59:0/3637806936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285009f240 msgr2=0x7f285012f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.516+0000 7f284ed9d700 1 --2- 172.21.15.59:0/3637806936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285009f240 0x7f285012f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.516+0000 7f284ed9d700 1 -- 172.21.15.59:0/3637806936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28440094a0 con 0x7f285009f650 2023-09-30T22:32:24.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.516+0000 7f284ed9d700 1 --2- 172.21.15.59:0/3637806936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285009f650 0x7f285012fb40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2848009e30 tx=0x7f284800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:24.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.516+0000 7f283effd700 1 -- 172.21.15.59:0/3637806936 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848009ca0 con 0x7f285009f650 2023-09-30T22:32:24.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.516+0000 7f283effd700 1 -- 172.21.15.59:0/3637806936 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284800f040 con 0x7f285009f650 2023-09-30T22:32:24.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.516+0000 7f28548fc700 1 -- 172.21.15.59:0/3637806936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28500a0190 con 0x7f285009f650 2023-09-30T22:32:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.516+0000 7f283effd700 1 -- 172.21.15.59:0/3637806936 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848014480 con 0x7f285009f650 2023-09-30T22:32:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.516+0000 7f28548fc700 1 -- 172.21.15.59:0/3637806936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28501313e0 con 0x7f285009f650 2023-09-30T22:32:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.517+0000 7f283effd700 1 -- 172.21.15.59:0/3637806936 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28480145e0 con 0x7f285009f650 2023-09-30T22:32:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.518+0000 7f283effd700 1 -- 172.21.15.59:0/3637806936 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2848041930 con 0x7f285009f650 2023-09-30T22:32:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.518+0000 7f28548fc700 1 -- 172.21.15.59:0/3637806936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28500a1760 con 0x7f285009f650 2023-09-30T22:32:24.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.523+0000 7f283effd700 1 -- 172.21.15.59:0/3637806936 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2848018020 con 0x7f285009f650 2023-09-30T22:32:24.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.538+0000 7f70ea872700 1 Processor -- start 2023-09-30T22:32:24.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.538+0000 7f70ea872700 1 -- start start 2023-09-30T22:32:24.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.539+0000 7f70ea872700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70e406a770 0x7f70e406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.539+0000 7f70ea872700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70e4131d10 0x7f70e4139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.539+0000 7f70ea872700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e409ece0 con 0x7f70e406b080 2023-09-30T22:32:24.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.539+0000 7f70ea872700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e409e760 con 0x7f70e4131d10 2023-09-30T22:32:24.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.539+0000 7f70ea872700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70e409e040 con 0x7f70e406a770 2023-09-30T22:32:24.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.539+0000 7f70e8e0f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70e4131d10 0x7f70e4139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.539+0000 7f70e8e0f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70e4131d10 0x7f70e4139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51870/0 (socket says 172.21.15.59:51870) 2023-09-30T22:32:24.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.539+0000 7f70e8e0f700 1 -- 172.21.15.59:0/728381662 learned_addr learned my addr 172.21.15.59:0/728381662 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:24.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.539+0000 7f70e3fff700 1 --2- 172.21.15.59:0/728381662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70e406a770 0x7f70e406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.539+0000 7f70e8e0f700 1 -- 172.21.15.59:0/728381662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70e406a770 msgr2=0x7f70e406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.539+0000 7f70e8e0f700 1 --2- 172.21.15.59:0/728381662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70e406a770 0x7f70e406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.539+0000 7f70e8e0f700 1 -- 172.21.15.59:0/728381662 >> v1:172.21.15.59:6789/0 conn(0x7f70e406b080 legacy=0x7f70e4131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.539+0000 7f70e8e0f700 1 -- 172.21.15.59:0/728381662 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e409f630 con 0x7f70e4131d10 2023-09-30T22:32:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.539+0000 7f70e8e0f700 1 --2- 172.21.15.59:0/728381662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e4131d10 0x7f70e4139860 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009e50 tx=0x7f70dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbb3d4e7c815394 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.540+0000 7f70e2ffd700 1 -- 172.21.15.59:0/728381662 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00e070 con 0x7f70e4131d10 2023-09-30T22:32:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.540+0000 7f70e2ffd700 1 -- 172.21.15.59:0/728381662 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc00b910 con 0x7f70e4131d10 2023-09-30T22:32:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.540+0000 7f70e2ffd700 1 -- 172.21.15.59:0/728381662 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00bcc0 con 0x7f70e4131d10 2023-09-30T22:32:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.541+0000 7f70ea872700 1 -- 172.21.15.59:0/728381662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e4131d10 msgr2=0x7f70e4139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.541+0000 7f70ea872700 1 --2- 172.21.15.59:0/728381662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e4131d10 0x7f70e4139860 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009e50 tx=0x7f70dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:32:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.541+0000 7f70ea872700 1 -- 172.21.15.59:0/728381662 shutdown_connections 2023-09-30T22:32:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.541+0000 7f70ea872700 1 --2- 172.21.15.59:0/728381662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e4131d10 0x7f70e4139860 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.541+0000 7f70ea872700 1 --2- 172.21.15.59:0/728381662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70e406a770 0x7f70e406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.541+0000 7f70ea872700 1 -- 172.21.15.59:0/728381662 >> 172.21.15.59:0/728381662 conn(0x7f70e4066f50 msgr2=0x7f70e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.541+0000 7f70ea872700 1 -- 172.21.15.59:0/728381662 shutdown_connections 2023-09-30T22:32:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.541+0000 7f70ea872700 1 -- 172.21.15.59:0/728381662 wait complete. 2023-09-30T22:32:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.542+0000 7f21fa4ad700 1 Processor -- start 2023-09-30T22:32:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.542+0000 7f21fa4ad700 1 -- start start 2023-09-30T22:32:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.542+0000 7f21fa4ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21f406e570 0x7f21f406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.542+0000 7f21fa4ad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21f409eca0 0x7f21f406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.542+0000 7f21fa4ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21f4134610 0x7f21f4134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.542+0000 7f21fa4ad700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f4070ee0 con 0x7f21f409eca0 2023-09-30T22:32:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.542+0000 7f21fa4ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f4071480 con 0x7f21f406e570 2023-09-30T22:32:24.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.542+0000 7f21fa4ad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21f406f3c0 con 0x7f21f4134610 2023-09-30T22:32:24.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.542+0000 7f21f8a4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21f4134610 0x7f21f4134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f21f37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21f409eca0 0x7f21f406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.542+0000 7f70ea872700 1 Processor -- start 2023-09-30T22:32:24.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f21f37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21f409eca0 0x7f21f406ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51876/0 (socket says 172.21.15.59:51876) 2023-09-30T22:32:24.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f21f37fe700 1 -- 172.21.15.59:0/2027512187 learned_addr learned my addr 172.21.15.59:0/2027512187 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:24.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f21f3fff700 1 --2- 172.21.15.59:0/2027512187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21f406e570 0x7f21f406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f21f8a4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21f4134610 0x7f21f4134a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52812/0 (socket says 172.21.15.59:52812) 2023-09-30T22:32:24.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f70ea872700 1 -- start start 2023-09-30T22:32:24.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f21f8a4a700 1 -- 172.21.15.59:0/2027512187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21f406e570 msgr2=0x7f21f406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:24.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f21f8a4a700 1 --2- 172.21.15.59:0/2027512187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21f406e570 0x7f21f406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f21f8a4a700 1 -- 172.21.15.59:0/2027512187 >> v2:172.21.15.59:3300/0 conn(0x7f21f409eca0 msgr2=0x7f21f406ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:24.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f21f8a4a700 1 --2- 172.21.15.59:0/2027512187 >> v2:172.21.15.59:3300/0 conn(0x7f21f409eca0 0x7f21f406ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f21f8a4a700 1 -- 172.21.15.59:0/2027512187 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f4071b90 con 0x7f21f4134610 2023-09-30T22:32:24.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f21f37fe700 1 --2- 172.21.15.59:0/2027512187 >> v2:172.21.15.59:3300/0 conn(0x7f21f409eca0 0x7f21f406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:24.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f21f8a4a700 1 --2- 172.21.15.59:0/2027512187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21f4134610 0x7f21f4134a40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009d90 tx=0x7f21ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1baa2d5014653ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:24.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f70ea872700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e406a770 0x7f70e4120090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f70ea872700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e406b080 0x7f70e411e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f70ea872700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70e4131d10 0x7f70e411ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f70ea872700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e4071ef0 con 0x7f70e406b080 2023-09-30T22:32:24.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f70ea872700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e4131480 con 0x7f70e406a770 2023-09-30T22:32:24.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.543+0000 7f70ea872700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70e411d7b0 con 0x7f70e4131d10 2023-09-30T22:32:24.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f70e8e0f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70e4131d10 0x7f70e411ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f70e8e0f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70e4131d10 0x7f70e411ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52828/0 (socket says 172.21.15.59:52828) 2023-09-30T22:32:24.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f70e8e0f700 1 -- 172.21.15.59:0/3540816080 learned_addr learned my addr 172.21.15.59:0/3540816080 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:24.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f21f2ffd700 1 -- 172.21.15.59:0/2027512187 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec00e070 con 0x7f21f4134610 2023-09-30T22:32:24.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f70e37fe700 1 --2- 172.21.15.59:0/3540816080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e406b080 0x7f70e411e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f21f2ffd700 1 -- 172.21.15.59:0/2027512187 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec00bb20 con 0x7f21f4134610 2023-09-30T22:32:24.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f21f2ffd700 1 -- 172.21.15.59:0/2027512187 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec012430 con 0x7f21f4134610 2023-09-30T22:32:24.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f70e3fff700 1 --2- 172.21.15.59:0/3540816080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e406a770 0x7f70e4120090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f70e8e0f700 1 -- 172.21.15.59:0/3540816080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e406a770 msgr2=0x7f70e4120090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f70e8e0f700 1 --2- 172.21.15.59:0/3540816080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e406a770 0x7f70e4120090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f70e8e0f700 1 -- 172.21.15.59:0/3540816080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e406b080 msgr2=0x7f70e411e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f70e8e0f700 1 --2- 172.21.15.59:0/3540816080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e406b080 0x7f70e411e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f70e8e0f700 1 -- 172.21.15.59:0/3540816080 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc009b30 con 0x7f70e4131d10 2023-09-30T22:32:24.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f70e3fff700 1 --2- 172.21.15.59:0/3540816080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e406a770 0x7f70e4120090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:24.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f70e37fe700 1 --2- 172.21.15.59:0/3540816080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e406b080 0x7f70e411e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:24.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f70e8e0f700 1 --2- 172.21.15.59:0/3540816080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70e4131d10 0x7f70e411ee70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00b680 tx=0x7f70dc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:24.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.544+0000 7f70e0ff9700 1 -- 172.21.15.59:0/3540816080 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc0099b0 con 0x7f70e4131d10 2023-09-30T22:32:24.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.545+0000 7f70e0ff9700 1 -- 172.21.15.59:0/3540816080 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc0092e0 con 0x7f70e4131d10 2023-09-30T22:32:24.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.545+0000 7f70e0ff9700 1 -- 172.21.15.59:0/3540816080 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc01c640 con 0x7f70e4131d10 2023-09-30T22:32:24.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.545+0000 7f70ea872700 1 -- 172.21.15.59:0/3540816080 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e411c4d0 con 0x7f70e4131d10 2023-09-30T22:32:24.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.545+0000 7f70ea872700 1 -- 172.21.15.59:0/3540816080 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e411db20 con 0x7f70e4131d10 2023-09-30T22:32:24.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.545+0000 7f21fa4ad700 1 -- 172.21.15.59:0/2027512187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21f4134610 msgr2=0x7f21f4134a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.545+0000 7f21fa4ad700 1 --2- 172.21.15.59:0/2027512187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21f4134610 0x7f21f4134a40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009d90 tx=0x7f21ec00b330 comp rx=0 tx=0).stop 2023-09-30T22:32:24.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.546+0000 7f70e0ff9700 1 -- 172.21.15.59:0/3540816080 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70dc01c7a0 con 0x7f70e4131d10 2023-09-30T22:32:24.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.546+0000 7f70e0ff9700 1 -- 172.21.15.59:0/3540816080 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f70dc0412f0 con 0x7f70e4131d10 2023-09-30T22:32:24.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.546+0000 7f21fa4ad700 1 -- 172.21.15.59:0/2027512187 shutdown_connections 2023-09-30T22:32:24.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.546+0000 7f21fa4ad700 1 --2- 172.21.15.59:0/2027512187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21f4134610 0x7f21f4134a40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.546+0000 7f21fa4ad700 1 --2- 172.21.15.59:0/2027512187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21f406e570 0x7f21f406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.546+0000 7f21fa4ad700 1 --2- 172.21.15.59:0/2027512187 >> v2:172.21.15.59:3300/0 conn(0x7f21f409eca0 0x7f21f406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.546+0000 7f21fa4ad700 1 -- 172.21.15.59:0/2027512187 >> 172.21.15.59:0/2027512187 conn(0x7f21f40a2aa0 msgr2=0x7f21f40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:24.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.546+0000 7f70ea872700 1 -- 172.21.15.59:0/3540816080 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c40052e0 con 0x7f70e4131d10 2023-09-30T22:32:24.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.546+0000 7f21fa4ad700 1 -- 172.21.15.59:0/2027512187 shutdown_connections 2023-09-30T22:32:24.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.546+0000 7f21fa4ad700 1 -- 172.21.15.59:0/2027512187 wait complete. 2023-09-30T22:32:24.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.547+0000 7f21fa4ad700 1 Processor -- start 2023-09-30T22:32:24.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.548+0000 7f21fa4ad700 1 -- start start 2023-09-30T22:32:24.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21fa4ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21f406e570 0x7f21f4127480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21fa4ad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21f4134610 0x7f21f4125ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21fa4ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21f41279c0 0x7f21f41263e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21fa4ad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40a1e50 con 0x7f21f4134610 2023-09-30T22:32:24.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21fa4ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f413e610 con 0x7f21f41279c0 2023-09-30T22:32:24.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21fa4ad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21f413c200 con 0x7f21f406e570 2023-09-30T22:32:24.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21f37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21f4134610 0x7f21f4125ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21f37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21f4134610 0x7f21f4125ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51902/0 (socket says 172.21.15.59:51902) 2023-09-30T22:32:24.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21f37fe700 1 -- 172.21.15.59:0/2101122978 learned_addr learned my addr 172.21.15.59:0/2101122978 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:24.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21f37fe700 1 -- 172.21.15.59:0/2101122978 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21f406e570 msgr2=0x7f21f4127480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21f37fe700 1 --2- 172.21.15.59:0/2101122978 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21f406e570 0x7f21f4127480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21f8a4a700 1 --2- 172.21.15.59:0/2101122978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21f41279c0 0x7f21f41263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21f37fe700 1 -- 172.21.15.59:0/2101122978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21f41279c0 msgr2=0x7f21f41263e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21f37fe700 1 --2- 172.21.15.59:0/2101122978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21f41279c0 0x7f21f41263e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21f37fe700 1 -- 172.21.15.59:0/2101122978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e8009550 con 0x7f21f4134610 2023-09-30T22:32:24.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.549+0000 7f21f8a4a700 1 --2- 172.21.15.59:0/2101122978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21f41279c0 0x7f21f41263e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:24.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.550+0000 7f21f37fe700 1 --2- 172.21.15.59:0/2101122978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21f4134610 0x7f21f4125ea0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f21e800ebb0 tx=0x7f21e800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:24.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.550+0000 7f21f0ff9700 1 -- 172.21.15.59:0/2101122978 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8004030 con 0x7f21f4134610 2023-09-30T22:32:24.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.550+0000 7f21f0ff9700 1 -- 172.21.15.59:0/2101122978 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e8004190 con 0x7f21f4134610 2023-09-30T22:32:24.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.550+0000 7f21f0ff9700 1 -- 172.21.15.59:0/2101122978 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8004540 con 0x7f21f4134610 2023-09-30T22:32:24.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.550+0000 7f21fa4ad700 1 -- 172.21.15.59:0/2101122978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ec009a70 con 0x7f21f4134610 2023-09-30T22:32:24.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.550+0000 7f21fa4ad700 1 -- 172.21.15.59:0/2101122978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f413bf20 con 0x7f21f4134610 2023-09-30T22:32:24.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.552+0000 7f21fa4ad700 1 -- 172.21.15.59:0/2101122978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f409d1f0 con 0x7f21f4134610 2023-09-30T22:32:24.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.553+0000 7f70e0ff9700 1 -- 172.21.15.59:0/3540816080 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70dc0257d0 con 0x7f70e4131d10 2023-09-30T22:32:24.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.553+0000 7f21f0ff9700 1 -- 172.21.15.59:0/2101122978 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21e800c910 con 0x7f21f4134610 2023-09-30T22:32:24.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.554+0000 7f21f0ff9700 1 -- 172.21.15.59:0/2101122978 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f21e803fe50 con 0x7f21f4134610 2023-09-30T22:32:24.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.562+0000 7f21f0ff9700 1 -- 172.21.15.59:0/2101122978 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21e80036a0 con 0x7f21f4134610 2023-09-30T22:32:24.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.598+0000 7fd88d5d2700 1 Processor -- start 2023-09-30T22:32:24.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.599+0000 7fd88d5d2700 1 -- start start 2023-09-30T22:32:24.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.599+0000 7fd88d5d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd88809d6f0 0x7fd88809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.599+0000 7fd88d5d2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd88809e000 0x7fd888130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.599+0000 7fd88d5d2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88809f130 con 0x7fd88809e410 2023-09-30T22:32:24.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.599+0000 7fd88d5d2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88809f520 con 0x7fd88809e000 2023-09-30T22:32:24.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.599+0000 7fd88d5d2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd88809e930 con 0x7fd88809d6f0 2023-09-30T22:32:24.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.600+0000 7fd8877fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd88809e410 0x7fd888130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57238/0 (socket says 172.21.15.59:57238) 2023-09-30T22:32:24.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.600+0000 7fd8877fe700 1 -- 172.21.15.59:0/2613064133 learned_addr learned my addr 172.21.15.59:0/2613064133 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:24.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.600+0000 7fd8867fc700 1 --2- 172.21.15.59:0/2613064133 >> v2:172.21.15.59:3300/0 conn(0x7fd88809e000 0x7fd888130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.600+0000 7fd886ffd700 1 --2- 172.21.15.59:0/2613064133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd88809d6f0 0x7fd88809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.600+0000 7fd886ffd700 1 -- 172.21.15.59:0/2613064133 >> v2:172.21.15.59:3300/0 conn(0x7fd88809e000 msgr2=0x7fd888130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:24.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.600+0000 7fd886ffd700 1 --2- 172.21.15.59:0/2613064133 >> v2:172.21.15.59:3300/0 conn(0x7fd88809e000 0x7fd888130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.600+0000 7fd886ffd700 1 -- 172.21.15.59:0/2613064133 >> v1:172.21.15.59:6789/0 conn(0x7fd88809e410 legacy=0x7fd888130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.600+0000 7fd886ffd700 1 -- 172.21.15.59:0/2613064133 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88809b2d0 con 0x7fd88809d6f0 2023-09-30T22:32:24.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.600+0000 7fd886ffd700 1 --2- 172.21.15.59:0/2613064133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd88809d6f0 0x7fd88809dac0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd87800f9b0 tx=0x7fd87800fcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15ba952ec2468487 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:24.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.600+0000 7fd885ffb700 1 -- 172.21.15.59:0/2613064133 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87800fe50 con 0x7fd88809d6f0 2023-09-30T22:32:24.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.600+0000 7fd885ffb700 1 -- 172.21.15.59:0/2613064133 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87800f240 con 0x7fd88809d6f0 2023-09-30T22:32:24.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.600+0000 7fd885ffb700 1 -- 172.21.15.59:0/2613064133 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8780098f0 con 0x7fd88809d6f0 2023-09-30T22:32:24.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.601+0000 7fd88d5d2700 1 -- 172.21.15.59:0/2613064133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd88809d6f0 msgr2=0x7fd88809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.601+0000 7fd88d5d2700 1 --2- 172.21.15.59:0/2613064133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd88809d6f0 0x7fd88809dac0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd87800f9b0 tx=0x7fd87800fcc0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.601+0000 7fd88d5d2700 1 -- 172.21.15.59:0/2613064133 shutdown_connections 2023-09-30T22:32:24.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.601+0000 7fd88d5d2700 1 --2- 172.21.15.59:0/2613064133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd88809d6f0 0x7fd88809dac0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.601+0000 7fd88d5d2700 1 --2- 172.21.15.59:0/2613064133 >> v2:172.21.15.59:3300/0 conn(0x7fd88809e000 0x7fd888130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.601+0000 7fd88d5d2700 1 -- 172.21.15.59:0/2613064133 >> 172.21.15.59:0/2613064133 conn(0x7fd888066f50 msgr2=0x7fd88809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:24.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.601+0000 7fd88d5d2700 1 -- 172.21.15.59:0/2613064133 shutdown_connections 2023-09-30T22:32:24.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.601+0000 7fd88d5d2700 1 -- 172.21.15.59:0/2613064133 wait complete. 2023-09-30T22:32:24.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.602+0000 7fd88d5d2700 1 Processor -- start 2023-09-30T22:32:24.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.603+0000 7fd88d5d2700 1 -- start start 2023-09-30T22:32:24.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.603+0000 7fd88d5d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd88809d6f0 0x7fd88811e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.603+0000 7fd88d5d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd88809e000 0x7fd88811e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.603+0000 7fd88d5d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd88809e410 0x7fd88811ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.603+0000 7fd88d5d2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88811f610 con 0x7fd88809d6f0 2023-09-30T22:32:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.603+0000 7fd88d5d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8881303f0 con 0x7fd88809e410 2023-09-30T22:32:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.603+0000 7fd88d5d2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd888120240 con 0x7fd88809e000 2023-09-30T22:32:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.603+0000 7fd8867fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd88809e000 0x7fd88811e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.603+0000 7fd8867fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd88809e000 0x7fd88811e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52854/0 (socket says 172.21.15.59:52854) 2023-09-30T22:32:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.603+0000 7fd8867fc700 1 -- 172.21.15.59:0/1857432035 learned_addr learned my addr 172.21.15.59:0/1857432035 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.603+0000 7fd8877fe700 1 --2- 172.21.15.59:0/1857432035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd88809e410 0x7fd88811ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.604+0000 7fd886ffd700 1 --2- 172.21.15.59:0/1857432035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd88809d6f0 0x7fd88811e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.604+0000 7fd8867fc700 1 -- 172.21.15.59:0/1857432035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd88809e410 msgr2=0x7fd88811ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.604+0000 7fd8867fc700 1 --2- 172.21.15.59:0/1857432035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd88809e410 0x7fd88811ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.604+0000 7fd8867fc700 1 -- 172.21.15.59:0/1857432035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd88809d6f0 msgr2=0x7fd88811e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.604+0000 7fd8867fc700 1 --2- 172.21.15.59:0/1857432035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd88809d6f0 0x7fd88811e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.604+0000 7fd8867fc700 1 -- 172.21.15.59:0/1857432035 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87800f610 con 0x7fd88809e000 2023-09-30T22:32:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.604+0000 7fd8877fe700 1 --2- 172.21.15.59:0/1857432035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd88809e410 0x7fd88811ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.604+0000 7fd8867fc700 1 --2- 172.21.15.59:0/1857432035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd88809e000 0x7fd88811e680 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00fde0 tx=0x7fd87c00d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.604+0000 7fd86f7fe700 1 -- 172.21.15.59:0/1857432035 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c00b7c0 con 0x7fd88809e000 2023-09-30T22:32:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.604+0000 7fd86f7fe700 1 -- 172.21.15.59:0/1857432035 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c00de40 con 0x7fd88809e000 2023-09-30T22:32:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.604+0000 7fd88d5d2700 1 -- 172.21.15.59:0/1857432035 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd888120e70 con 0x7fd88809e000 2023-09-30T22:32:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.604+0000 7fd86f7fe700 1 -- 172.21.15.59:0/1857432035 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c018640 con 0x7fd88809e000 2023-09-30T22:32:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.604+0000 7fd88d5d2700 1 -- 172.21.15.59:0/1857432035 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8880a1d00 con 0x7fd88809e000 2023-09-30T22:32:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.605+0000 7fd86f7fe700 1 -- 172.21.15.59:0/1857432035 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd87c0187a0 con 0x7fd88809e000 2023-09-30T22:32:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.605+0000 7fd88d5d2700 1 -- 172.21.15.59:0/1857432035 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd888074ea0 con 0x7fd88809e000 2023-09-30T22:32:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.606+0000 7fd86f7fe700 1 -- 172.21.15.59:0/1857432035 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd87c03fe20 con 0x7fd88809e000 2023-09-30T22:32:24.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.610+0000 7fd86f7fe700 1 -- 172.21.15.59:0/1857432035 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd87c010440 con 0x7fd88809e000 2023-09-30T22:32:24.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.740+0000 7f28548fc700 1 -- 172.21.15.59:0/3637806936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2850074ea0 con 0x7f285009f650 2023-09-30T22:32:24.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.741+0000 7f283effd700 1 -- 172.21.15.59:0/3637806936 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2848045060 con 0x7f285009f650 2023-09-30T22:32:24.741 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:24.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.744+0000 7f28548fc700 1 -- 172.21.15.59:0/3637806936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285009f650 msgr2=0x7f285012fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.744+0000 7f28548fc700 1 --2- 172.21.15.59:0/3637806936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285009f650 0x7f285012fb40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2848009e30 tx=0x7f284800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.744+0000 7f28548fc700 1 -- 172.21.15.59:0/3637806936 shutdown_connections 2023-09-30T22:32:24.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.744+0000 7f28548fc700 1 --2- 172.21.15.59:0/3637806936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f285009e930 0x7f285012f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.744+0000 7f28548fc700 1 --2- 172.21.15.59:0/3637806936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285009f650 0x7f285012fb40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.744+0000 7f28548fc700 1 --2- 172.21.15.59:0/3637806936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285009f240 0x7f285012f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.744+0000 7f28548fc700 1 -- 172.21.15.59:0/3637806936 >> 172.21.15.59:0/3637806936 conn(0x7f28500a4210 msgr2=0x7f285006c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:24.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.745+0000 7f28548fc700 1 -- 172.21.15.59:0/3637806936 shutdown_connections 2023-09-30T22:32:24.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.745+0000 7f28548fc700 1 -- 172.21.15.59:0/3637806936 wait complete. 2023-09-30T22:32:24.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:24.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.762+0000 7f70ea872700 1 -- 172.21.15.59:0/3540816080 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f70c4005150 con 0x7f70e4131d10 2023-09-30T22:32:24.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.762+0000 7f70e0ff9700 1 -- 172.21.15.59:0/3540816080 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70dc034090 con 0x7f70e4131d10 2023-09-30T22:32:24.763 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:24.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.765+0000 7f70ea872700 1 -- 172.21.15.59:0/3540816080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70e4131d10 msgr2=0x7f70e411ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.765+0000 7f70ea872700 1 --2- 172.21.15.59:0/3540816080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70e4131d10 0x7f70e411ee70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00b680 tx=0x7f70dc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.765+0000 7f70ea872700 1 -- 172.21.15.59:0/3540816080 shutdown_connections 2023-09-30T22:32:24.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.765+0000 7f70ea872700 1 --2- 172.21.15.59:0/3540816080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70e4131d10 0x7f70e411ee70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.765+0000 7f70ea872700 1 --2- 172.21.15.59:0/3540816080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e406a770 0x7f70e4120090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.765+0000 7f70ea872700 1 --2- 172.21.15.59:0/3540816080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e406b080 0x7f70e411e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.765+0000 7f70ea872700 1 -- 172.21.15.59:0/3540816080 >> 172.21.15.59:0/3540816080 conn(0x7f70e4066f50 msgr2=0x7f70e40a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:24.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.765+0000 7f70ea872700 1 -- 172.21.15.59:0/3540816080 shutdown_connections 2023-09-30T22:32:24.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.765+0000 7f70ea872700 1 -- 172.21.15.59:0/3540816080 wait complete. 2023-09-30T22:32:24.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:24.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.780+0000 7f21fa4ad700 1 -- 172.21.15.59:0/2101122978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f21f4074ea0 con 0x7f21f4134610 2023-09-30T22:32:24.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.780+0000 7f21f0ff9700 1 -- 172.21.15.59:0/2101122978 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21e8013e60 con 0x7f21f4134610 2023-09-30T22:32:24.780 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:24.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.782+0000 7f21fa4ad700 1 -- 172.21.15.59:0/2101122978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21f4134610 msgr2=0x7f21f4125ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.783+0000 7f21fa4ad700 1 --2- 172.21.15.59:0/2101122978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21f4134610 0x7f21f4125ea0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f21e800ebb0 tx=0x7f21e800ef70 comp rx=0 tx=0).stop 2023-09-30T22:32:24.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.783+0000 7f21fa4ad700 1 -- 172.21.15.59:0/2101122978 shutdown_connections 2023-09-30T22:32:24.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.783+0000 7f21fa4ad700 1 --2- 172.21.15.59:0/2101122978 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21f406e570 0x7f21f4127480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.783+0000 7f21fa4ad700 1 --2- 172.21.15.59:0/2101122978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21f41279c0 0x7f21f41263e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.783+0000 7f21fa4ad700 1 --2- 172.21.15.59:0/2101122978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21f4134610 0x7f21f4125ea0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.783+0000 7f21fa4ad700 1 -- 172.21.15.59:0/2101122978 >> 172.21.15.59:0/2101122978 conn(0x7f21f40a2aa0 msgr2=0x7f21f4137c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:24.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.783+0000 7f21fa4ad700 1 -- 172.21.15.59:0/2101122978 shutdown_connections 2023-09-30T22:32:24.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.783+0000 7f21fa4ad700 1 -- 172.21.15.59:0/2101122978 wait complete. 2023-09-30T22:32:24.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:24.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.818+0000 7fd88d5d2700 1 -- 172.21.15.59:0/1857432035 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd88806c360 con 0x7fd88809e000 2023-09-30T22:32:24.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.818+0000 7fd86f7fe700 1 -- 172.21.15.59:0/1857432035 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd87c01d030 con 0x7fd88809e000 2023-09-30T22:32:24.818 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:24.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.820+0000 7fd88d5d2700 1 -- 172.21.15.59:0/1857432035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd88809e000 msgr2=0x7fd88811e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.820+0000 7fd88d5d2700 1 --2- 172.21.15.59:0/1857432035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd88809e000 0x7fd88811e680 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00fde0 tx=0x7fd87c00d630 comp rx=0 tx=0).stop 2023-09-30T22:32:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.820+0000 7fd88d5d2700 1 -- 172.21.15.59:0/1857432035 shutdown_connections 2023-09-30T22:32:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.820+0000 7fd88d5d2700 1 --2- 172.21.15.59:0/1857432035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd88809e410 0x7fd88811ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.820+0000 7fd88d5d2700 1 --2- 172.21.15.59:0/1857432035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd88809d6f0 0x7fd88811e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.820+0000 7fd88d5d2700 1 --2- 172.21.15.59:0/1857432035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd88809e000 0x7fd88811e680 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.820+0000 7fd88d5d2700 1 -- 172.21.15.59:0/1857432035 >> 172.21.15.59:0/1857432035 conn(0x7fd888066f50 msgr2=0x7fd88806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.820+0000 7fd88d5d2700 1 -- 172.21.15.59:0/1857432035 shutdown_connections 2023-09-30T22:32:24.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:24.820+0000 7fd88d5d2700 1 -- 172.21.15.59:0/1857432035 wait complete. 2023-09-30T22:32:24.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:25.760 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:25.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:25.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:25.835 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.916+0000 7f43d3bb3700 1 Processor -- start 2023-09-30T22:32:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.917+0000 7f43d3bb3700 1 -- start start 2023-09-30T22:32:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.917+0000 7f43d3bb3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc09d6f0 0x7f43cc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.917+0000 7f43d3bb3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43cc09e000 0x7f43cc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.917+0000 7f43d3bb3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43cc09e410 0x7f43cc130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.917+0000 7f43d3bb3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43cc09f520 con 0x7f43cc09e000 2023-09-30T22:32:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.917+0000 7f43d3bb3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc09f130 con 0x7f43cc09d6f0 2023-09-30T22:32:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.917+0000 7f43d3bb3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc09e930 con 0x7f43cc09e410 2023-09-30T22:32:25.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.918+0000 7f43d114e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43cc09e000 0x7f43cc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:25.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.918+0000 7f43d114e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43cc09e000 0x7f43cc130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51928/0 (socket says 172.21.15.59:51928) 2023-09-30T22:32:25.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.918+0000 7f43d114e700 1 -- 172.21.15.59:0/3513708762 learned_addr learned my addr 172.21.15.59:0/3513708762 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:25.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.918+0000 7f43d194f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc09d6f0 0x7f43cc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:25.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.918+0000 7f43d2150700 1 --2- 172.21.15.59:0/3513708762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43cc09e410 0x7f43cc130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:25.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.918+0000 7f43d114e700 1 -- 172.21.15.59:0/3513708762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43cc09e410 msgr2=0x7f43cc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:25.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.918+0000 7f43d114e700 1 --2- 172.21.15.59:0/3513708762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43cc09e410 0x7f43cc130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.918+0000 7f43d114e700 1 -- 172.21.15.59:0/3513708762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc09d6f0 msgr2=0x7f43cc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.918+0000 7f43d114e700 1 --2- 172.21.15.59:0/3513708762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc09d6f0 0x7f43cc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.918+0000 7f43d114e700 1 -- 172.21.15.59:0/3513708762 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc09b2d0 con 0x7f43cc09e000 2023-09-30T22:32:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.918+0000 7f43d114e700 1 --2- 172.21.15.59:0/3513708762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc09e000 0x7f43cc130660 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009920 tx=0x7f43bc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad17ae41272ee50 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.919+0000 7f43d094d700 1 -- 172.21.15.59:0/3513708762 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc011830 con 0x7f43cc09e000 2023-09-30T22:32:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.919+0000 7f43d094d700 1 -- 172.21.15.59:0/3513708762 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc011990 con 0x7f43cc09e000 2023-09-30T22:32:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.919+0000 7f43d094d700 1 -- 172.21.15.59:0/3513708762 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc011d20 con 0x7f43cc09e000 2023-09-30T22:32:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.919+0000 7f43d3bb3700 1 -- 172.21.15.59:0/3513708762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc09e000 msgr2=0x7f43cc130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.919+0000 7f43d3bb3700 1 --2- 172.21.15.59:0/3513708762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc09e000 0x7f43cc130660 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009920 tx=0x7f43bc009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.919+0000 7f43d3bb3700 1 -- 172.21.15.59:0/3513708762 shutdown_connections 2023-09-30T22:32:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.919+0000 7f43d3bb3700 1 --2- 172.21.15.59:0/3513708762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43cc09e410 0x7f43cc130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.919+0000 7f43d3bb3700 1 --2- 172.21.15.59:0/3513708762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc09d6f0 0x7f43cc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.919+0000 7f43d3bb3700 1 --2- 172.21.15.59:0/3513708762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc09e000 0x7f43cc130660 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.919+0000 7f43d3bb3700 1 -- 172.21.15.59:0/3513708762 >> 172.21.15.59:0/3513708762 conn(0x7f43cc066f50 msgr2=0x7f43cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:25.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.920+0000 7f43d3bb3700 1 -- 172.21.15.59:0/3513708762 shutdown_connections 2023-09-30T22:32:25.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.920+0000 7f43d3bb3700 1 -- 172.21.15.59:0/3513708762 wait complete. 2023-09-30T22:32:25.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.921+0000 7f43d3bb3700 1 Processor -- start 2023-09-30T22:32:25.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.921+0000 7f43d3bb3700 1 -- start start 2023-09-30T22:32:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.922+0000 7f43d3bb3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43cc09d6f0 0x7f43cc11def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.922+0000 7f43d3bb3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc09e000 0x7f43cc11e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.922+0000 7f43d3bb3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc09e410 0x7f43cc11e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.922+0000 7f43d3bb3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc120130 con 0x7f43cc09e000 2023-09-30T22:32:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.922+0000 7f43d3bb3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc121a10 con 0x7f43cc09e410 2023-09-30T22:32:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.922+0000 7f43d3bb3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc0a1700 con 0x7f43cc09d6f0 2023-09-30T22:32:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.922+0000 7f43d194f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43cc09d6f0 0x7f43cc11def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.922+0000 7f43d194f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43cc09d6f0 0x7f43cc11def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52884/0 (socket says 172.21.15.59:52884) 2023-09-30T22:32:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.922+0000 7f43d194f700 1 -- 172.21.15.59:0/259493697 learned_addr learned my addr 172.21.15.59:0/259493697 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.922+0000 7f43d114e700 1 --2- 172.21.15.59:0/259493697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc09e000 0x7f43cc11e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.922+0000 7f43d2150700 1 --2- 172.21.15.59:0/259493697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc09e410 0x7f43cc11e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.923+0000 7f43d114e700 1 -- 172.21.15.59:0/259493697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43cc09d6f0 msgr2=0x7f43cc11def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.923+0000 7f43d114e700 1 --2- 172.21.15.59:0/259493697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43cc09d6f0 0x7f43cc11def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.923+0000 7f43d114e700 1 -- 172.21.15.59:0/259493697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc09e410 msgr2=0x7f43cc11e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:25.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.923+0000 7f43d114e700 1 --2- 172.21.15.59:0/259493697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc09e410 0x7f43cc11e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.923+0000 7f43d114e700 1 -- 172.21.15.59:0/259493697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc009550 con 0x7f43cc09e000 2023-09-30T22:32:25.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.923+0000 7f43d114e700 1 --2- 172.21.15.59:0/259493697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc09e000 0x7f43cc11e430 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f43bc016000 tx=0x7f43bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:25.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.923+0000 7f43c27fc700 1 -- 172.21.15.59:0/259493697 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc004450 con 0x7f43cc09e000 2023-09-30T22:32:25.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.923+0000 7f43c27fc700 1 -- 172.21.15.59:0/259493697 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc01f070 con 0x7f43cc09e000 2023-09-30T22:32:25.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.923+0000 7f43d3bb3700 1 -- 172.21.15.59:0/259493697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc1211a0 con 0x7f43cc09e000 2023-09-30T22:32:25.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.923+0000 7f43c27fc700 1 -- 172.21.15.59:0/259493697 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0045f0 con 0x7f43cc09e000 2023-09-30T22:32:25.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.923+0000 7f43d3bb3700 1 -- 172.21.15.59:0/259493697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc09c750 con 0x7f43cc09e000 2023-09-30T22:32:25.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.924+0000 7f43d3bb3700 1 -- 172.21.15.59:0/259493697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43cc11ac20 con 0x7f43cc09e000 2023-09-30T22:32:25.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.925+0000 7f43c27fc700 1 -- 172.21.15.59:0/259493697 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43bc0038e0 con 0x7f43cc09e000 2023-09-30T22:32:25.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.925+0000 7f43c27fc700 1 -- 172.21.15.59:0/259493697 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f43bc021070 con 0x7f43cc09e000 2023-09-30T22:32:25.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.930+0000 7f43c27fc700 1 -- 172.21.15.59:0/259493697 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43bc00b7a0 con 0x7f43cc09e000 2023-09-30T22:32:25.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.952+0000 7f024e92d700 1 Processor -- start 2023-09-30T22:32:25.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.952+0000 7f024e92d700 1 -- start start 2023-09-30T22:32:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.953+0000 7f024e92d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f024812cf60 0x7f024806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.953+0000 7f024e92d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024812f8b0 0x7f024812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.953+0000 7f024e92d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024812cd90 con 0x7f0248130260 2023-09-30T22:32:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.953+0000 7f024e92d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f024812d330 con 0x7f024812cf60 2023-09-30T22:32:25.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.953+0000 7f024e92d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02481306d0 con 0x7f024812f8b0 2023-09-30T22:32:25.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.954+0000 7f02477fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024812f8b0 0x7f024812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:25.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.954+0000 7f02477fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024812f8b0 0x7f024812fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41302/0 (socket says 172.21.15.59:41302) 2023-09-30T22:32:25.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.954+0000 7f02477fe700 1 -- 172.21.15.59:0/598257194 learned_addr learned my addr 172.21.15.59:0/598257194 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:25.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.954+0000 7f02477fe700 1 -- 172.21.15.59:0/598257194 >> v2:172.21.15.59:3300/0 conn(0x7f024812cf60 msgr2=0x7f024806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:25.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.954+0000 7f02477fe700 1 --2- 172.21.15.59:0/598257194 >> v2:172.21.15.59:3300/0 conn(0x7f024812cf60 0x7f024806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.954+0000 7f02477fe700 1 -- 172.21.15.59:0/598257194 >> v1:172.21.15.59:6789/0 conn(0x7f0248130260 legacy=0x7f0248136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:25.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.954+0000 7f02477fe700 1 -- 172.21.15.59:0/598257194 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0248071780 con 0x7f024812f8b0 2023-09-30T22:32:25.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.954+0000 7f02477fe700 1 --2- 172.21.15.59:0/598257194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024812f8b0 0x7f024812fd20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f023c00bb90 tx=0x7f023c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf500e93c49cc436 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:25.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.955+0000 7f0246ffd700 1 -- 172.21.15.59:0/598257194 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c00dc00 con 0x7f024812f8b0 2023-09-30T22:32:25.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.955+0000 7f0246ffd700 1 -- 172.21.15.59:0/598257194 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023c00dd60 con 0x7f024812f8b0 2023-09-30T22:32:25.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.955+0000 7f0246ffd700 1 -- 172.21.15.59:0/598257194 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c004270 con 0x7f024812f8b0 2023-09-30T22:32:25.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.956+0000 7f024e92d700 1 -- 172.21.15.59:0/598257194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024812f8b0 msgr2=0x7f024812fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.956+0000 7f024e92d700 1 --2- 172.21.15.59:0/598257194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024812f8b0 0x7f024812fd20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f023c00bb90 tx=0x7f023c00bea0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.956+0000 7f024e92d700 1 -- 172.21.15.59:0/598257194 shutdown_connections 2023-09-30T22:32:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.956+0000 7f024e92d700 1 --2- 172.21.15.59:0/598257194 >> v2:172.21.15.59:3300/0 conn(0x7f024812cf60 0x7f024806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.956+0000 7f024e92d700 1 --2- 172.21.15.59:0/598257194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024812f8b0 0x7f024812fd20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.956+0000 7f024e92d700 1 -- 172.21.15.59:0/598257194 >> 172.21.15.59:0/598257194 conn(0x7f02480a2aa0 msgr2=0x7f02480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.956+0000 7f024e92d700 1 -- 172.21.15.59:0/598257194 shutdown_connections 2023-09-30T22:32:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.956+0000 7f024e92d700 1 -- 172.21.15.59:0/598257194 wait complete. 2023-09-30T22:32:25.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.957+0000 7f024e92d700 1 Processor -- start 2023-09-30T22:32:25.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.957+0000 7f024e92d700 1 -- start start 2023-09-30T22:32:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.958+0000 7f024e92d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024812cf60 0x7f024809b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.958+0000 7f024e92d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024812f8b0 0x7f024809bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.958+0000 7f024e92d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0248130260 0x7f02481c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.958+0000 7f024e92d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024809b510 con 0x7f024812cf60 2023-09-30T22:32:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.958+0000 7f024e92d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0248129760 con 0x7f024812f8b0 2023-09-30T22:32:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.958+0000 7f024e92d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f024812f5d0 con 0x7f0248130260 2023-09-30T22:32:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.958+0000 7f024ceca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0248130260 0x7f02481c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.959+0000 7f024ceca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0248130260 0x7f02481c4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52892/0 (socket says 172.21.15.59:52892) 2023-09-30T22:32:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.959+0000 7f024ceca700 1 -- 172.21.15.59:0/1156697502 learned_addr learned my addr 172.21.15.59:0/1156697502 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.959+0000 7f0247fff700 1 --2- 172.21.15.59:0/1156697502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024812cf60 0x7f024809b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.959+0000 7f024ceca700 1 -- 172.21.15.59:0/1156697502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024812f8b0 msgr2=0x7f024809bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.959+0000 7f024ceca700 1 --2- 172.21.15.59:0/1156697502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024812f8b0 0x7f024809bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.959+0000 7f024ceca700 1 -- 172.21.15.59:0/1156697502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024812cf60 msgr2=0x7f024809b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.959+0000 7f024ceca700 1 --2- 172.21.15.59:0/1156697502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024812cf60 0x7f024809b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.959+0000 7f024ceca700 1 -- 172.21.15.59:0/1156697502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c00b7f0 con 0x7f0248130260 2023-09-30T22:32:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.959+0000 7f0247fff700 1 --2- 172.21.15.59:0/1156697502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024812cf60 0x7f024809b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.959+0000 7f024ceca700 1 --2- 172.21.15.59:0/1156697502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0248130260 0x7f02481c4130 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f024000c800 tx=0x7f024000cb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.960+0000 7f0244ff9700 1 -- 172.21.15.59:0/1156697502 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240003e10 con 0x7f0248130260 2023-09-30T22:32:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.960+0000 7f0244ff9700 1 -- 172.21.15.59:0/1156697502 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0240005070 con 0x7f0248130260 2023-09-30T22:32:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.960+0000 7f024e92d700 1 -- 172.21.15.59:0/1156697502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0248129fa0 con 0x7f0248130260 2023-09-30T22:32:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.960+0000 7f0244ff9700 1 -- 172.21.15.59:0/1156697502 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240005420 con 0x7f0248130260 2023-09-30T22:32:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.960+0000 7f024e92d700 1 -- 172.21.15.59:0/1156697502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024809e560 con 0x7f0248130260 2023-09-30T22:32:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.961+0000 7f0244ff9700 1 -- 172.21.15.59:0/1156697502 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0240005580 con 0x7f0248130260 2023-09-30T22:32:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.961+0000 7f024e92d700 1 -- 172.21.15.59:0/1156697502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02280052e0 con 0x7f0248130260 2023-09-30T22:32:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.961+0000 7f0244ff9700 1 -- 172.21.15.59:0/1156697502 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0240040d70 con 0x7f0248130260 2023-09-30T22:32:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.963+0000 7f97765b9700 1 Processor -- start 2023-09-30T22:32:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.964+0000 7f97765b9700 1 -- start start 2023-09-30T22:32:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.964+0000 7f97765b9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9770133540 0x7f9770135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.964+0000 7f97765b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9770135e60 0x7f9770138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.964+0000 7f97765b9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97700716a0 con 0x7f9770130540 2023-09-30T22:32:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.964+0000 7f97765b9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9770071290 con 0x7f9770133540 2023-09-30T22:32:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.964+0000 7f97765b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9770130340 con 0x7f9770135e60 2023-09-30T22:32:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.965+0000 7f976ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9770130540 0x7f9770130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57254/0 (socket says 172.21.15.59:57254) 2023-09-30T22:32:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.965+0000 7f976ffff700 1 -- 172.21.15.59:0/1174055463 learned_addr learned my addr 172.21.15.59:0/1174055463 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.965+0000 7f976f7fe700 1 --2- 172.21.15.59:0/1174055463 >> v2:172.21.15.59:3300/0 conn(0x7f9770133540 0x7f9770135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.965+0000 7f9774b56700 1 --2- 172.21.15.59:0/1174055463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9770135e60 0x7f9770138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.965+0000 7f976f7fe700 1 -- 172.21.15.59:0/1174055463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9770135e60 msgr2=0x7f9770138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.965+0000 7f976f7fe700 1 --2- 172.21.15.59:0/1174055463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9770135e60 0x7f9770138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.965+0000 7f976f7fe700 1 -- 172.21.15.59:0/1174055463 >> v1:172.21.15.59:6789/0 conn(0x7f9770130540 legacy=0x7f9770130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.965+0000 7f976f7fe700 1 -- 172.21.15.59:0/1174055463 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9770070b80 con 0x7f9770133540 2023-09-30T22:32:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.965+0000 7f976f7fe700 1 --2- 172.21.15.59:0/1174055463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9770133540 0x7f9770135920 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9764009840 tx=0x7f9764009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378fb63199c6bb19 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.966+0000 7f976effd700 1 -- 172.21.15.59:0/1174055463 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764011830 con 0x7f9770133540 2023-09-30T22:32:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.966+0000 7f976effd700 1 -- 172.21.15.59:0/1174055463 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764011990 con 0x7f9770133540 2023-09-30T22:32:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.966+0000 7f976effd700 1 -- 172.21.15.59:0/1174055463 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764011d20 con 0x7f9770133540 2023-09-30T22:32:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.966+0000 7f97765b9700 1 -- 172.21.15.59:0/1174055463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9770133540 msgr2=0x7f9770135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.966+0000 7f97765b9700 1 --2- 172.21.15.59:0/1174055463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9770133540 0x7f9770135920 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9764009840 tx=0x7f9764009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.966+0000 7f97765b9700 1 -- 172.21.15.59:0/1174055463 shutdown_connections 2023-09-30T22:32:25.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.966+0000 7f97765b9700 1 --2- 172.21.15.59:0/1174055463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9770135e60 0x7f9770138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.966+0000 7f97765b9700 1 --2- 172.21.15.59:0/1174055463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9770133540 0x7f9770135920 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.966+0000 7f97765b9700 1 -- 172.21.15.59:0/1174055463 >> 172.21.15.59:0/1174055463 conn(0x7f97700a2aa0 msgr2=0x7f97700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:25.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.966+0000 7f97765b9700 1 -- 172.21.15.59:0/1174055463 shutdown_connections 2023-09-30T22:32:25.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.966+0000 7f97765b9700 1 -- 172.21.15.59:0/1174055463 wait complete. 2023-09-30T22:32:25.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.967+0000 7f97765b9700 1 Processor -- start 2023-09-30T22:32:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.968+0000 7f97765b9700 1 -- start start 2023-09-30T22:32:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.968+0000 7f97765b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9770130540 0x7f977009a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.968+0000 7f97765b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9770133540 0x7f977009ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.968+0000 7f97765b9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9770135e60 0x7f977009b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.968+0000 7f97765b9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977009cc20 con 0x7f9770135e60 2023-09-30T22:32:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.968+0000 7f97765b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9770138250 con 0x7f9770130540 2023-09-30T22:32:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.968+0000 7f97765b9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97700718e0 con 0x7f9770133540 2023-09-30T22:32:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.968+0000 7f9774b56700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9770135e60 0x7f977009b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.968+0000 7f9774b56700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9770135e60 0x7f977009b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51970/0 (socket says 172.21.15.59:51970) 2023-09-30T22:32:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.969+0000 7f9774b56700 1 -- 172.21.15.59:0/4045307874 learned_addr learned my addr 172.21.15.59:0/4045307874 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.969+0000 7f976ffff700 1 --2- 172.21.15.59:0/4045307874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9770130540 0x7f977009a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.969+0000 7f976ffff700 1 -- 172.21.15.59:0/4045307874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9770133540 msgr2=0x7f977009ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.969+0000 7f976ffff700 1 --2- 172.21.15.59:0/4045307874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9770133540 0x7f977009ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.969+0000 7f976ffff700 1 -- 172.21.15.59:0/4045307874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9770135e60 msgr2=0x7f977009b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.969+0000 7f976ffff700 1 --2- 172.21.15.59:0/4045307874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9770135e60 0x7f977009b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.969+0000 7f976ffff700 1 -- 172.21.15.59:0/4045307874 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97640094a0 con 0x7f9770130540 2023-09-30T22:32:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.969+0000 7f9774b56700 1 --2- 172.21.15.59:0/4045307874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9770135e60 0x7f977009b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.969+0000 7f976ffff700 1 --2- 172.21.15.59:0/4045307874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9770130540 0x7f977009a800 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f976000c3c0 tx=0x7f976000c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.969+0000 7f976cff9700 1 -- 172.21.15.59:0/4045307874 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760005d70 con 0x7f9770130540 2023-09-30T22:32:25.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.969+0000 7f976cff9700 1 -- 172.21.15.59:0/4045307874 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976000ce80 con 0x7f9770130540 2023-09-30T22:32:25.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.969+0000 7f97765b9700 1 -- 172.21.15.59:0/4045307874 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977009d800 con 0x7f9770130540 2023-09-30T22:32:25.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.969+0000 7f976cff9700 1 -- 172.21.15.59:0/4045307874 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600072d0 con 0x7f9770130540 2023-09-30T22:32:25.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.969+0000 7f97765b9700 1 -- 172.21.15.59:0/4045307874 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977009dda0 con 0x7f9770130540 2023-09-30T22:32:25.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.970+0000 7f976cff9700 1 -- 172.21.15.59:0/4045307874 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9760007430 con 0x7f9770130540 2023-09-30T22:32:25.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.971+0000 7f976cff9700 1 -- 172.21.15.59:0/4045307874 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f976003eb30 con 0x7f9770130540 2023-09-30T22:32:25.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.971+0000 7f0244ff9700 1 -- 172.21.15.59:0/1156697502 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0240044060 con 0x7f0248130260 2023-09-30T22:32:25.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.972+0000 7f97765b9700 1 -- 172.21.15.59:0/4045307874 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977009db50 con 0x7f9770130540 2023-09-30T22:32:25.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.981+0000 7f976cff9700 1 -- 172.21.15.59:0/4045307874 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f976001b3b0 con 0x7f9770130540 2023-09-30T22:32:25.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.996+0000 7f7e05bb2700 1 Processor -- start 2023-09-30T22:32:25.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.996+0000 7f7e05bb2700 1 -- start start 2023-09-30T22:32:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.997+0000 7f7e05bb2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e0009e1d0 0x7f7e00138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.997+0000 7f7e05bb2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e00139170 0x7f7e0013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.997+0000 7f7e05bb2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0009b120 con 0x7f7e0009d6f0 2023-09-30T22:32:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.997+0000 7f7e05bb2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0006b460 con 0x7f7e00139170 2023-09-30T22:32:25.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.997+0000 7f7e05bb2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0009a7e0 con 0x7f7e0009e1d0 2023-09-30T22:32:25.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.997+0000 7f7dfeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e0009e1d0 0x7f7e00138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:25.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.997+0000 7f7dfffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e00139170 0x7f7e0013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:25.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.997+0000 7f7dfeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e0009e1d0 0x7f7e00138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52908/0 (socket says 172.21.15.59:52908) 2023-09-30T22:32:25.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.997+0000 7f7dfeffd700 1 -- 172.21.15.59:0/34648032 learned_addr learned my addr 172.21.15.59:0/34648032 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:25.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.997+0000 7f7dff7fe700 1 --1- 172.21.15.59:0/34648032 >> v1:172.21.15.59:6789/0 conn(0x7f7e0009d6f0 0x7f7e0009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57268/0 (socket says 172.21.15.59:57268) 2023-09-30T22:32:25.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.997+0000 7f7dfffff700 1 -- 172.21.15.59:0/34648032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e0009e1d0 msgr2=0x7f7e00138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:25.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.997+0000 7f7dfffff700 1 --2- 172.21.15.59:0/34648032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e0009e1d0 0x7f7e00138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:25.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.997+0000 7f7dfffff700 1 -- 172.21.15.59:0/34648032 >> v1:172.21.15.59:6789/0 conn(0x7f7e0009d6f0 legacy=0x7f7e0009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:25.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.997+0000 7f7dfffff700 1 -- 172.21.15.59:0/34648032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0009a500 con 0x7f7e00139170 2023-09-30T22:32:25.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.998+0000 7f7dfffff700 1 --2- 172.21.15.59:0/34648032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e00139170 0x7f7e0013b550 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7df8009dc0 tx=0x7f7df800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c07d4e61c357e29e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:25.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.998+0000 7f7dfe7fc700 1 -- 172.21.15.59:0/34648032 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df800e070 con 0x7f7e00139170 2023-09-30T22:32:25.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.998+0000 7f7dfe7fc700 1 -- 172.21.15.59:0/34648032 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df800bb20 con 0x7f7e00139170 2023-09-30T22:32:25.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.998+0000 7f7dfe7fc700 1 -- 172.21.15.59:0/34648032 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8012430 con 0x7f7e00139170 2023-09-30T22:32:26.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.999+0000 7f7e05bb2700 1 -- 172.21.15.59:0/34648032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e00139170 msgr2=0x7f7e0013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:26.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.999+0000 7f7e05bb2700 1 --2- 172.21.15.59:0/34648032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e00139170 0x7f7e0013b550 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7df8009dc0 tx=0x7f7df800b330 comp rx=0 tx=0).stop 2023-09-30T22:32:26.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.999+0000 7f7e05bb2700 1 -- 172.21.15.59:0/34648032 shutdown_connections 2023-09-30T22:32:26.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.999+0000 7f7e05bb2700 1 --2- 172.21.15.59:0/34648032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e00139170 0x7f7e0013b550 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.999+0000 7f7e05bb2700 1 --2- 172.21.15.59:0/34648032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e0009e1d0 0x7f7e00138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.999+0000 7f7e05bb2700 1 -- 172.21.15.59:0/34648032 >> 172.21.15.59:0/34648032 conn(0x7f7e00066f50 msgr2=0x7f7e0009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:26.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.999+0000 7f7e05bb2700 1 -- 172.21.15.59:0/34648032 shutdown_connections 2023-09-30T22:32:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:25.999+0000 7f7e05bb2700 1 -- 172.21.15.59:0/34648032 wait complete. 2023-09-30T22:32:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.000+0000 7f7e05bb2700 1 Processor -- start 2023-09-30T22:32:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.001+0000 7f7e05bb2700 1 -- start start 2023-09-30T22:32:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.001+0000 7f7e05bb2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e0009d6f0 0x7f7e0011e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.001+0000 7f7e05bb2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e0009e1d0 0x7f7e0011ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.001+0000 7f7e05bb2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e00139170 0x7f7e0011f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.001+0000 7f7e05bb2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e00122090 con 0x7f7e00139170 2023-09-30T22:32:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.001+0000 7f7e05bb2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e00120570 con 0x7f7e0009d6f0 2023-09-30T22:32:26.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.001+0000 7f7e05bb2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000a18e0 con 0x7f7e0009e1d0 2023-09-30T22:32:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.001+0000 7f7dfffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e00139170 0x7f7e0011f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.001+0000 7f7dfeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e0009e1d0 0x7f7e0011ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.001+0000 7f7dfffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e00139170 0x7f7e0011f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51986/0 (socket says 172.21.15.59:51986) 2023-09-30T22:32:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.001+0000 7f7dfffff700 1 -- 172.21.15.59:0/1775390445 learned_addr learned my addr 172.21.15.59:0/1775390445 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.001+0000 7f7dff7fe700 1 --2- 172.21.15.59:0/1775390445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e0009d6f0 0x7f7e0011e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:26.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.002+0000 7f7dfffff700 1 -- 172.21.15.59:0/1775390445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e0009e1d0 msgr2=0x7f7e0011ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:26.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.002+0000 7f7dfffff700 1 --2- 172.21.15.59:0/1775390445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e0009e1d0 0x7f7e0011ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.002+0000 7f7dfffff700 1 -- 172.21.15.59:0/1775390445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e0009d6f0 msgr2=0x7f7e0011e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:26.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.002+0000 7f7dfffff700 1 --2- 172.21.15.59:0/1775390445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e0009d6f0 0x7f7e0011e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.002+0000 7f7dfffff700 1 -- 172.21.15.59:0/1775390445 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df8009a70 con 0x7f7e00139170 2023-09-30T22:32:26.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.002+0000 7f7dfffff700 1 --2- 172.21.15.59:0/1775390445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e00139170 0x7f7e0011f3b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7df800b680 tx=0x7f7df8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:26.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.003+0000 7f7de7fff700 1 -- 172.21.15.59:0/1775390445 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8004830 con 0x7f7e00139170 2023-09-30T22:32:26.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.003+0000 7f7de7fff700 1 -- 172.21.15.59:0/1775390445 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df8020070 con 0x7f7e00139170 2023-09-30T22:32:26.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.003+0000 7f7de7fff700 1 -- 172.21.15.59:0/1775390445 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df80276c0 con 0x7f7e00139170 2023-09-30T22:32:26.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.003+0000 7f7e05bb2700 1 -- 172.21.15.59:0/1775390445 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0009c710 con 0x7f7e00139170 2023-09-30T22:32:26.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.003+0000 7f7e05bb2700 1 -- 172.21.15.59:0/1775390445 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e00122b00 con 0x7f7e00139170 2023-09-30T22:32:26.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.004+0000 7f7e05bb2700 1 -- 172.21.15.59:0/1775390445 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e00074ea0 con 0x7f7e00139170 2023-09-30T22:32:26.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.005+0000 7f7de7fff700 1 -- 172.21.15.59:0/1775390445 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7df8031430 con 0x7f7e00139170 2023-09-30T22:32:26.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.005+0000 7f7de7fff700 1 -- 172.21.15.59:0/1775390445 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7df8022070 con 0x7f7e00139170 2023-09-30T22:32:26.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.014+0000 7f7de7fff700 1 -- 172.21.15.59:0/1775390445 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7df8012430 con 0x7f7e00139170 2023-09-30T22:32:26.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.154+0000 7f43d3bb3700 1 -- 172.21.15.59:0/259493697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f43cc1213d0 con 0x7f43cc09e000 2023-09-30T22:32:26.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.155+0000 7f43c27fc700 1 -- 172.21.15.59:0/259493697 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43cc1213d0 con 0x7f43cc09e000 2023-09-30T22:32:26.155 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:26.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.158+0000 7f43d3bb3700 1 -- 172.21.15.59:0/259493697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc09e000 msgr2=0x7f43cc11e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:26.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.158+0000 7f43d3bb3700 1 --2- 172.21.15.59:0/259493697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc09e000 0x7f43cc11e430 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f43bc016000 tx=0x7f43bc004750 comp rx=0 tx=0).stop 2023-09-30T22:32:26.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.158+0000 7f43d3bb3700 1 -- 172.21.15.59:0/259493697 shutdown_connections 2023-09-30T22:32:26.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.158+0000 7f43d3bb3700 1 --2- 172.21.15.59:0/259493697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43cc09d6f0 0x7f43cc11def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.158+0000 7f43d3bb3700 1 --2- 172.21.15.59:0/259493697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc09e410 0x7f43cc11e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.158+0000 7f43d3bb3700 1 --2- 172.21.15.59:0/259493697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc09e000 0x7f43cc11e430 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.158+0000 7f43d3bb3700 1 -- 172.21.15.59:0/259493697 >> 172.21.15.59:0/259493697 conn(0x7f43cc066f50 msgr2=0x7f43cc130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:26.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.158+0000 7f43d3bb3700 1 -- 172.21.15.59:0/259493697 shutdown_connections 2023-09-30T22:32:26.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.158+0000 7f43d3bb3700 1 -- 172.21.15.59:0/259493697 wait complete. 2023-09-30T22:32:26.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.186+0000 7f024e92d700 1 -- 172.21.15.59:0/1156697502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0228005590 con 0x7f0248130260 2023-09-30T22:32:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.187+0000 7f0244ff9700 1 -- 172.21.15.59:0/1156697502 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0240017020 con 0x7f0248130260 2023-09-30T22:32:26.187 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:26.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.189+0000 7f024e92d700 1 -- 172.21.15.59:0/1156697502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0248130260 msgr2=0x7f02481c4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:26.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.189+0000 7f024e92d700 1 --2- 172.21.15.59:0/1156697502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0248130260 0x7f02481c4130 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f024000c800 tx=0x7f024000cb10 comp rx=0 tx=0).stop 2023-09-30T22:32:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.189+0000 7f024e92d700 1 -- 172.21.15.59:0/1156697502 shutdown_connections 2023-09-30T22:32:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.189+0000 7f024e92d700 1 --2- 172.21.15.59:0/1156697502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0248130260 0x7f02481c4130 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.189+0000 7f024e92d700 1 --2- 172.21.15.59:0/1156697502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024812cf60 0x7f024809b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.189+0000 7f024e92d700 1 --2- 172.21.15.59:0/1156697502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024812f8b0 0x7f024809bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.189+0000 7f024e92d700 1 -- 172.21.15.59:0/1156697502 >> 172.21.15.59:0/1156697502 conn(0x7f02480a2aa0 msgr2=0x7f024806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.189+0000 7f024e92d700 1 -- 172.21.15.59:0/1156697502 shutdown_connections 2023-09-30T22:32:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.189+0000 7f024e92d700 1 -- 172.21.15.59:0/1156697502 wait complete. 2023-09-30T22:32:26.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.198+0000 7f97765b9700 1 -- 172.21.15.59:0/4045307874 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9770074ea0 con 0x7f9770130540 2023-09-30T22:32:26.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.198+0000 7f976cff9700 1 -- 172.21.15.59:0/4045307874 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97600192c0 con 0x7f9770130540 2023-09-30T22:32:26.198 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:26.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.200+0000 7f97765b9700 1 -- 172.21.15.59:0/4045307874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9770130540 msgr2=0x7f977009a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:26.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.200+0000 7f97765b9700 1 --2- 172.21.15.59:0/4045307874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9770130540 0x7f977009a800 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f976000c3c0 tx=0x7f976000c6d0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.201+0000 7f97765b9700 1 -- 172.21.15.59:0/4045307874 shutdown_connections 2023-09-30T22:32:26.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.201+0000 7f97765b9700 1 --2- 172.21.15.59:0/4045307874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9770135e60 0x7f977009b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.201+0000 7f97765b9700 1 --2- 172.21.15.59:0/4045307874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9770130540 0x7f977009a800 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.201+0000 7f97765b9700 1 --2- 172.21.15.59:0/4045307874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9770133540 0x7f977009ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.201+0000 7f97765b9700 1 -- 172.21.15.59:0/4045307874 >> 172.21.15.59:0/4045307874 conn(0x7f97700a2aa0 msgr2=0x7f97700a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:26.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.201+0000 7f97765b9700 1 -- 172.21.15.59:0/4045307874 shutdown_connections 2023-09-30T22:32:26.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.201+0000 7f97765b9700 1 -- 172.21.15.59:0/4045307874 wait complete. 2023-09-30T22:32:26.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:26.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:26.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.235+0000 7f7e05bb2700 1 -- 172.21.15.59:0/1775390445 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7e001223d0 con 0x7f7e00139170 2023-09-30T22:32:26.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.236+0000 7f7de7fff700 1 -- 172.21.15.59:0/1775390445 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7df802c020 con 0x7f7e00139170 2023-09-30T22:32:26.238 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:26.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.238+0000 7f7e05bb2700 1 -- 172.21.15.59:0/1775390445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e00139170 msgr2=0x7f7e0011f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:26.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.238+0000 7f7e05bb2700 1 --2- 172.21.15.59:0/1775390445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e00139170 0x7f7e0011f3b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7df800b680 tx=0x7f7df8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.238+0000 7f7e05bb2700 1 -- 172.21.15.59:0/1775390445 shutdown_connections 2023-09-30T22:32:26.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.238+0000 7f7e05bb2700 1 --2- 172.21.15.59:0/1775390445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e00139170 0x7f7e0011f3b0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.238+0000 7f7e05bb2700 1 --2- 172.21.15.59:0/1775390445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e0009d6f0 0x7f7e0011e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.238+0000 7f7e05bb2700 1 --2- 172.21.15.59:0/1775390445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e0009e1d0 0x7f7e0011ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:26.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.238+0000 7f7e05bb2700 1 -- 172.21.15.59:0/1775390445 >> 172.21.15.59:0/1775390445 conn(0x7f7e00066f50 msgr2=0x7f7e0009b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:26.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.238+0000 7f7e05bb2700 1 -- 172.21.15.59:0/1775390445 shutdown_connections 2023-09-30T22:32:26.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:26.238+0000 7f7e05bb2700 1 -- 172.21.15.59:0/1775390445 wait complete. 2023-09-30T22:32:26.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:27.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:27.204 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:27.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:27.253 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.331+0000 7fe5f3d45700 1 Processor -- start 2023-09-30T22:32:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.331+0000 7fe5f3d45700 1 -- start start 2023-09-30T22:32:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.332+0000 7fe5f3d45700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5ec133a80 0x7fe5ec133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.332+0000 7fe5f3d45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5ec130a40 0x7fe5ec13b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.332+0000 7fe5f3d45700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ec06bc00 con 0x7fe5ec12ff20 2023-09-30T22:32:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.332+0000 7fe5f3d45700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec06c570 con 0x7fe5ec130a40 2023-09-30T22:32:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.332+0000 7fe5f3d45700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec0a0040 con 0x7fe5ec133a80 2023-09-30T22:32:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.332+0000 7fe5f22e2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5ec130a40 0x7fe5ec13b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.332+0000 7fe5f22e2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5ec130a40 0x7fe5ec13b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41360/0 (socket says 172.21.15.59:41360) 2023-09-30T22:32:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.332+0000 7fe5f22e2700 1 -- 172.21.15.59:0/1854446168 learned_addr learned my addr 172.21.15.59:0/1854446168 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.332+0000 7fe5f1ae1700 1 --2- 172.21.15.59:0/1854446168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5ec133a80 0x7fe5ec133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.332+0000 7fe5f22e2700 1 -- 172.21.15.59:0/1854446168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5ec133a80 msgr2=0x7fe5ec133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.332+0000 7fe5f22e2700 1 --2- 172.21.15.59:0/1854446168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5ec133a80 0x7fe5ec133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.332+0000 7fe5f22e2700 1 -- 172.21.15.59:0/1854446168 >> v1:172.21.15.59:6789/0 conn(0x7fe5ec12ff20 legacy=0x7fe5ec130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.332+0000 7fe5f22e2700 1 -- 172.21.15.59:0/1854446168 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec133860 con 0x7fe5ec130a40 2023-09-30T22:32:27.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.333+0000 7fe5f22e2700 1 --2- 172.21.15.59:0/1854446168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5ec130a40 0x7fe5ec13b850 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4009e80 tx=0x7fe5e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f0c93e90953afe9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.333+0000 7fe5f0adf700 1 -- 172.21.15.59:0/1854446168 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e400e070 con 0x7fe5ec130a40 2023-09-30T22:32:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.333+0000 7fe5f0adf700 1 -- 172.21.15.59:0/1854446168 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e400b9c0 con 0x7fe5ec130a40 2023-09-30T22:32:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.333+0000 7fe5f0adf700 1 -- 172.21.15.59:0/1854446168 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e400bd70 con 0x7fe5ec130a40 2023-09-30T22:32:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.334+0000 7fe5f3d45700 1 -- 172.21.15.59:0/1854446168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5ec130a40 msgr2=0x7fe5ec13b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.334+0000 7fe5f3d45700 1 --2- 172.21.15.59:0/1854446168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5ec130a40 0x7fe5ec13b850 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4009e80 tx=0x7fe5e400b330 comp rx=0 tx=0).stop 2023-09-30T22:32:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.334+0000 7fe5f3d45700 1 -- 172.21.15.59:0/1854446168 shutdown_connections 2023-09-30T22:32:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.334+0000 7fe5f3d45700 1 --2- 172.21.15.59:0/1854446168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5ec133a80 0x7fe5ec133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.334+0000 7fe5f3d45700 1 --2- 172.21.15.59:0/1854446168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5ec130a40 0x7fe5ec13b850 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.334+0000 7fe5f3d45700 1 -- 172.21.15.59:0/1854446168 >> 172.21.15.59:0/1854446168 conn(0x7fe5ec0a4210 msgr2=0x7fe5ec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:27.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.334+0000 7fe5f3d45700 1 -- 172.21.15.59:0/1854446168 shutdown_connections 2023-09-30T22:32:27.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.334+0000 7fe5f3d45700 1 -- 172.21.15.59:0/1854446168 wait complete. 2023-09-30T22:32:27.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.335+0000 7fe5f3d45700 1 Processor -- start 2023-09-30T22:32:27.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.335+0000 7fe5f3d45700 1 -- start start 2023-09-30T22:32:27.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f3d45700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5ec12ff20 0x7fe5ec09c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f3d45700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5ec130a40 0x7fe5ec09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f3d45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5ec133a80 0x7fe5ec09d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f3d45700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec120330 con 0x7fe5ec130a40 2023-09-30T22:32:27.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f3d45700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec120510 con 0x7fe5ec133a80 2023-09-30T22:32:27.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f3d45700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec1210f0 con 0x7fe5ec12ff20 2023-09-30T22:32:27.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f1ae1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5ec12ff20 0x7fe5ec09c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f1ae1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5ec12ff20 0x7fe5ec09c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52944/0 (socket says 172.21.15.59:52944) 2023-09-30T22:32:27.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f1ae1700 1 -- 172.21.15.59:0/3669902454 learned_addr learned my addr 172.21.15.59:0/3669902454 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:27.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f12e0700 1 --2- 172.21.15.59:0/3669902454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5ec130a40 0x7fe5ec09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f22e2700 1 --2- 172.21.15.59:0/3669902454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5ec133a80 0x7fe5ec09d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f1ae1700 1 -- 172.21.15.59:0/3669902454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5ec133a80 msgr2=0x7fe5ec09d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f1ae1700 1 --2- 172.21.15.59:0/3669902454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5ec133a80 0x7fe5ec09d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f1ae1700 1 -- 172.21.15.59:0/3669902454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5ec130a40 msgr2=0x7fe5ec09cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f1ae1700 1 --2- 172.21.15.59:0/3669902454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5ec130a40 0x7fe5ec09cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f1ae1700 1 -- 172.21.15.59:0/3669902454 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e4009b30 con 0x7fe5ec12ff20 2023-09-30T22:32:27.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.336+0000 7fe5f1ae1700 1 --2- 172.21.15.59:0/3669902454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5ec12ff20 0x7fe5ec09c6e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800e840 tx=0x7fe5e800eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:27.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.337+0000 7fe5e27fc700 1 -- 172.21.15.59:0/3669902454 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8013610 con 0x7fe5ec12ff20 2023-09-30T22:32:27.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.337+0000 7fe5e27fc700 1 -- 172.21.15.59:0/3669902454 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e8013770 con 0x7fe5ec12ff20 2023-09-30T22:32:27.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.337+0000 7fe5f3d45700 1 -- 172.21.15.59:0/3669902454 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ec11eb40 con 0x7fe5ec12ff20 2023-09-30T22:32:27.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.337+0000 7fe5e27fc700 1 -- 172.21.15.59:0/3669902454 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8013b00 con 0x7fe5ec12ff20 2023-09-30T22:32:27.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.337+0000 7fe5f3d45700 1 -- 172.21.15.59:0/3669902454 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ec09e0c0 con 0x7fe5ec12ff20 2023-09-30T22:32:27.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.338+0000 7fe5e27fc700 1 -- 172.21.15.59:0/3669902454 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5e8013c60 con 0x7fe5ec12ff20 2023-09-30T22:32:27.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.338+0000 7fe5f3d45700 1 -- 172.21.15.59:0/3669902454 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ec120150 con 0x7fe5ec12ff20 2023-09-30T22:32:27.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.338+0000 7fe5e27fc700 1 -- 172.21.15.59:0/3669902454 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe5e803f3c0 con 0x7fe5ec12ff20 2023-09-30T22:32:27.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.347+0000 7fe5e27fc700 1 -- 172.21.15.59:0/3669902454 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5e8012370 con 0x7fe5ec12ff20 2023-09-30T22:32:27.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.375+0000 7f498162a700 1 Processor -- start 2023-09-30T22:32:27.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.375+0000 7f498162a700 1 -- start start 2023-09-30T22:32:27.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.376+0000 7f351f697700 1 Processor -- start 2023-09-30T22:32:27.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.376+0000 7f498162a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497c133a80 0x7f497c133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.376+0000 7f498162a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f497c130a40 0x7f497c13b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.376+0000 7f498162a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c06bc00 con 0x7f497c12ff20 2023-09-30T22:32:27.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.376+0000 7f498162a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c06c570 con 0x7f497c130a40 2023-09-30T22:32:27.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.376+0000 7f498162a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0a0040 con 0x7f497c133a80 2023-09-30T22:32:27.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.376+0000 7f497affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497c133a80 0x7f497c133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.376+0000 7f497affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497c133a80 0x7f497c133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52956/0 (socket says 172.21.15.59:52956) 2023-09-30T22:32:27.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.376+0000 7f497affd700 1 -- 172.21.15.59:0/43496361 learned_addr learned my addr 172.21.15.59:0/43496361 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:27.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.376+0000 7f497b7fe700 1 --2- 172.21.15.59:0/43496361 >> v2:172.21.15.59:3300/0 conn(0x7f497c130a40 0x7f497c13b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.376+0000 7f351f697700 1 -- start start 2023-09-30T22:32:27.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f497b7fe700 1 -- 172.21.15.59:0/43496361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497c133a80 msgr2=0x7f497c133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:27.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f497b7fe700 1 --2- 172.21.15.59:0/43496361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497c133a80 0x7f497c133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f497b7fe700 1 -- 172.21.15.59:0/43496361 >> v1:172.21.15.59:6789/0 conn(0x7f497c12ff20 legacy=0x7f497c130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:27.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f497b7fe700 1 -- 172.21.15.59:0/43496361 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c133860 con 0x7f497c130a40 2023-09-30T22:32:27.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f497affd700 1 --2- 172.21.15.59:0/43496361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497c133a80 0x7f497c133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:27.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f497b7fe700 1 --2- 172.21.15.59:0/43496361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f497c130a40 0x7f497c13b850 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4974009d90 tx=0x7f497400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea8688f4a337f55 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:27.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f351f697700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806c0e0 0x7f351809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f351f697700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f35181380f0 0x7f351813fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f351f697700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3518134980 con 0x7f3518134ec0 2023-09-30T22:32:27.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f351f697700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351806c4b0 con 0x7f35181380f0 2023-09-30T22:32:27.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f351f697700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35180a09c0 con 0x7f351806c0e0 2023-09-30T22:32:27.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f4979ffb700 1 -- 172.21.15.59:0/43496361 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497400e070 con 0x7f497c130a40 2023-09-30T22:32:27.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f4979ffb700 1 -- 172.21.15.59:0/43496361 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497400bae0 con 0x7f497c130a40 2023-09-30T22:32:27.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f4979ffb700 1 -- 172.21.15.59:0/43496361 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497400be90 con 0x7f497c130a40 2023-09-30T22:32:27.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f351dc34700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f35181380f0 0x7f351813fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f351cc32700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3518134ec0 0x7f35181379e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57310/0 (socket says 172.21.15.59:57310) 2023-09-30T22:32:27.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.377+0000 7f351cc32700 1 -- 172.21.15.59:0/2427474655 learned_addr learned my addr 172.21.15.59:0/2427474655 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:27.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.378+0000 7f351dc34700 1 -- 172.21.15.59:0/2427474655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806c0e0 msgr2=0x7f351809ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.378+0000 7f351dc34700 1 --2- 172.21.15.59:0/2427474655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806c0e0 0x7f351809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.378+0000 7f351dc34700 1 -- 172.21.15.59:0/2427474655 >> v1:172.21.15.59:6789/0 conn(0x7f3518134ec0 legacy=0x7f35181379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.378+0000 7f351dc34700 1 -- 172.21.15.59:0/2427474655 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35180a0600 con 0x7f35181380f0 2023-09-30T22:32:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.378+0000 7f351dc34700 1 --2- 172.21.15.59:0/2427474655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35181380f0 0x7f351813fd20 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3510009d90 tx=0x7f351000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b938feb1b61084 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.378+0000 7f350ffff700 1 -- 172.21.15.59:0/2427474655 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351000e070 con 0x7f35181380f0 2023-09-30T22:32:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.378+0000 7f350ffff700 1 -- 172.21.15.59:0/2427474655 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351000bbd0 con 0x7f35181380f0 2023-09-30T22:32:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.378+0000 7f350ffff700 1 -- 172.21.15.59:0/2427474655 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510012430 con 0x7f35181380f0 2023-09-30T22:32:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.378+0000 7f498162a700 1 -- 172.21.15.59:0/43496361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f497c130a40 msgr2=0x7f497c13b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.378+0000 7f498162a700 1 --2- 172.21.15.59:0/43496361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f497c130a40 0x7f497c13b850 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4974009d90 tx=0x7f497400b330 comp rx=0 tx=0).stop 2023-09-30T22:32:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.378+0000 7f498162a700 1 -- 172.21.15.59:0/43496361 shutdown_connections 2023-09-30T22:32:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.378+0000 7f498162a700 1 --2- 172.21.15.59:0/43496361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f497c130a40 0x7f497c13b850 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.378+0000 7f498162a700 1 --2- 172.21.15.59:0/43496361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497c133a80 0x7f497c133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.378+0000 7f498162a700 1 -- 172.21.15.59:0/43496361 >> 172.21.15.59:0/43496361 conn(0x7f497c0a4210 msgr2=0x7f497c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:27.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.378+0000 7f498162a700 1 -- 172.21.15.59:0/43496361 shutdown_connections 2023-09-30T22:32:27.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.379+0000 7f498162a700 1 -- 172.21.15.59:0/43496361 wait complete. 2023-09-30T22:32:27.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.379+0000 7f351f697700 1 -- 172.21.15.59:0/2427474655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35181380f0 msgr2=0x7f351813fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.379+0000 7f351f697700 1 --2- 172.21.15.59:0/2427474655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35181380f0 0x7f351813fd20 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3510009d90 tx=0x7f351000b330 comp rx=0 tx=0).stop 2023-09-30T22:32:27.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.379+0000 7f351f697700 1 -- 172.21.15.59:0/2427474655 shutdown_connections 2023-09-30T22:32:27.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.379+0000 7f351f697700 1 --2- 172.21.15.59:0/2427474655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35181380f0 0x7f351813fd20 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.379+0000 7f351f697700 1 --2- 172.21.15.59:0/2427474655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806c0e0 0x7f351809ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.379+0000 7f351f697700 1 -- 172.21.15.59:0/2427474655 >> 172.21.15.59:0/2427474655 conn(0x7f35180a4210 msgr2=0x7f35180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:27.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.380+0000 7f498162a700 1 Processor -- start 2023-09-30T22:32:27.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.380+0000 7f351f697700 1 -- 172.21.15.59:0/2427474655 shutdown_connections 2023-09-30T22:32:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.380+0000 7f498162a700 1 -- start start 2023-09-30T22:32:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.380+0000 7f498162a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497c12ff20 0x7f497c09c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.380+0000 7f498162a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f497c130a40 0x7f497c09c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.380+0000 7f498162a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497c133a80 0x7f497c09cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.380+0000 7f498162a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c11b610 con 0x7f497c130a40 2023-09-30T22:32:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.380+0000 7f498162a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c12dc10 con 0x7f497c12ff20 2023-09-30T22:32:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.380+0000 7f498162a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f497c11b820 con 0x7f497c133a80 2023-09-30T22:32:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.380+0000 7f497b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497c133a80 0x7f497c09cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.380+0000 7f497a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f497c130a40 0x7f497c09c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.380+0000 7f497b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497c133a80 0x7f497c09cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52966/0 (socket says 172.21.15.59:52966) 2023-09-30T22:32:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.380+0000 7f497b7fe700 1 -- 172.21.15.59:0/621142403 learned_addr learned my addr 172.21.15.59:0/621142403 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.381+0000 7f497affd700 1 --2- 172.21.15.59:0/621142403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497c12ff20 0x7f497c09c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.381+0000 7f497b7fe700 1 -- 172.21.15.59:0/621142403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497c12ff20 msgr2=0x7f497c09c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.381+0000 7f497b7fe700 1 --2- 172.21.15.59:0/621142403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497c12ff20 0x7f497c09c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.381+0000 7f497b7fe700 1 -- 172.21.15.59:0/621142403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f497c130a40 msgr2=0x7f497c09c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.381+0000 7f497b7fe700 1 --2- 172.21.15.59:0/621142403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f497c130a40 0x7f497c09c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.381+0000 7f497b7fe700 1 -- 172.21.15.59:0/621142403 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c009550 con 0x7f497c133a80 2023-09-30T22:32:27.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.381+0000 7f497a7fc700 1 --2- 172.21.15.59:0/621142403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f497c130a40 0x7f497c09c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:27.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.381+0000 7f351f697700 1 -- 172.21.15.59:0/2427474655 wait complete. 2023-09-30T22:32:27.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.381+0000 7f497b7fe700 1 --2- 172.21.15.59:0/621142403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497c133a80 0x7f497c09cb90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f497c06c6b0 tx=0x7f4974004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:27.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.382+0000 7f49637fe700 1 -- 172.21.15.59:0/621142403 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49740045f0 con 0x7f497c133a80 2023-09-30T22:32:27.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.382+0000 7f351f697700 1 Processor -- start 2023-09-30T22:32:27.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.382+0000 7f351f697700 1 -- start start 2023-09-30T22:32:27.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.382+0000 7f49637fe700 1 -- 172.21.15.59:0/621142403 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4974004770 con 0x7f497c133a80 2023-09-30T22:32:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.382+0000 7f49637fe700 1 -- 172.21.15.59:0/621142403 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974012670 con 0x7f497c133a80 2023-09-30T22:32:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.382+0000 7f498162a700 1 -- 172.21.15.59:0/621142403 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4974009a70 con 0x7f497c133a80 2023-09-30T22:32:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.382+0000 7f498162a700 1 -- 172.21.15.59:0/621142403 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c09e480 con 0x7f497c133a80 2023-09-30T22:32:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.383+0000 7f351f697700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806c0e0 0x7f351811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.383+0000 7f351f697700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3518134ec0 0x7f351811abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.383+0000 7f351f697700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35181380f0 0x7f351811b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.383+0000 7f351f697700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351811de90 con 0x7f351806c0e0 2023-09-30T22:32:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.383+0000 7f351f697700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351811e070 con 0x7f3518134ec0 2023-09-30T22:32:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.383+0000 7f351f697700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35180a3d30 con 0x7f35181380f0 2023-09-30T22:32:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.383+0000 7f351d433700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806c0e0 0x7f351811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.383+0000 7f351d433700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806c0e0 0x7f351811a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52034/0 (socket says 172.21.15.59:52034) 2023-09-30T22:32:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.383+0000 7f351d433700 1 -- 172.21.15.59:0/596829070 learned_addr learned my addr 172.21.15.59:0/596829070 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.383+0000 7f351d433700 1 -- 172.21.15.59:0/596829070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35181380f0 msgr2=0x7f351811b100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:32:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.383+0000 7f351d433700 1 --2- 172.21.15.59:0/596829070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35181380f0 0x7f351811b100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.383+0000 7f351d433700 1 -- 172.21.15.59:0/596829070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3518134ec0 msgr2=0x7f351811abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:32:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.383+0000 7f351d433700 1 --2- 172.21.15.59:0/596829070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3518134ec0 0x7f351811abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.383+0000 7f351d433700 1 -- 172.21.15.59:0/596829070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3510009a70 con 0x7f351806c0e0 2023-09-30T22:32:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.383+0000 7f351d433700 1 --2- 172.21.15.59:0/596829070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806c0e0 0x7f351811a680 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f351400b4a0 tx=0x7f351400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.384+0000 7f350dffb700 1 -- 172.21.15.59:0/596829070 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514011830 con 0x7f351806c0e0 2023-09-30T22:32:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.384+0000 7f498162a700 1 -- 172.21.15.59:0/621142403 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c0a1fc0 con 0x7f497c133a80 2023-09-30T22:32:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.384+0000 7f351f697700 1 -- 172.21.15.59:0/596829070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35180a03f0 con 0x7f351806c0e0 2023-09-30T22:32:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.384+0000 7f350dffb700 1 -- 172.21.15.59:0/596829070 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3514011990 con 0x7f351806c0e0 2023-09-30T22:32:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.384+0000 7f350dffb700 1 -- 172.21.15.59:0/596829070 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514011d40 con 0x7f351806c0e0 2023-09-30T22:32:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.384+0000 7f351f697700 1 -- 172.21.15.59:0/596829070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351811dad0 con 0x7f351806c0e0 2023-09-30T22:32:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.385+0000 7f350dffb700 1 -- 172.21.15.59:0/596829070 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f351401a400 con 0x7f351806c0e0 2023-09-30T22:32:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.385+0000 7f350dffb700 1 -- 172.21.15.59:0/596829070 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f351403f800 con 0x7f351806c0e0 2023-09-30T22:32:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.385+0000 7f351f697700 1 -- 172.21.15.59:0/596829070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351811d7b0 con 0x7f351806c0e0 2023-09-30T22:32:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.385+0000 7f49637fe700 1 -- 172.21.15.59:0/621142403 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f497401d420 con 0x7f497c133a80 2023-09-30T22:32:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.385+0000 7f49637fe700 1 -- 172.21.15.59:0/621142403 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4974041e60 con 0x7f497c133a80 2023-09-30T22:32:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.389+0000 7f49637fe700 1 -- 172.21.15.59:0/621142403 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49740117a0 con 0x7f497c133a80 2023-09-30T22:32:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.394+0000 7f350dffb700 1 -- 172.21.15.59:0/596829070 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3514015020 con 0x7f351806c0e0 2023-09-30T22:32:27.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.426+0000 7fad30c9d700 1 Processor -- start 2023-09-30T22:32:27.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.426+0000 7fad30c9d700 1 -- start start 2023-09-30T22:32:27.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.427+0000 7fad30c9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad2c06a770 0x7fad2c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.427+0000 7fad30c9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2c131d10 0x7fad2c139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.427+0000 7fad30c9d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2c09ece0 con 0x7fad2c06b080 2023-09-30T22:32:27.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.427+0000 7fad30c9d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2c09e760 con 0x7fad2c06a770 2023-09-30T22:32:27.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.427+0000 7fad30c9d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c09e040 con 0x7fad2c131d10 2023-09-30T22:32:27.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.428+0000 7fad2ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2c131d10 0x7fad2c139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.428+0000 7fad29d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fad2c06b080 0x7fad2c131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57316/0 (socket says 172.21.15.59:57316) 2023-09-30T22:32:27.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.428+0000 7fad29d9b700 1 -- 172.21.15.59:0/1326960570 learned_addr learned my addr 172.21.15.59:0/1326960570 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:27.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.428+0000 7fad2a59c700 1 --2- 172.21.15.59:0/1326960570 >> v2:172.21.15.59:3300/0 conn(0x7fad2c06a770 0x7fad2c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.428+0000 7fad2ad9d700 1 -- 172.21.15.59:0/1326960570 >> v2:172.21.15.59:3300/0 conn(0x7fad2c06a770 msgr2=0x7fad2c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:27.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.428+0000 7fad2ad9d700 1 --2- 172.21.15.59:0/1326960570 >> v2:172.21.15.59:3300/0 conn(0x7fad2c06a770 0x7fad2c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.428+0000 7fad2ad9d700 1 -- 172.21.15.59:0/1326960570 >> v1:172.21.15.59:6789/0 conn(0x7fad2c06b080 legacy=0x7fad2c131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.428+0000 7fad2ad9d700 1 -- 172.21.15.59:0/1326960570 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c09f630 con 0x7fad2c131d10 2023-09-30T22:32:27.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.428+0000 7fad2ad9d700 1 --2- 172.21.15.59:0/1326960570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2c131d10 0x7fad2c139860 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fad24009d90 tx=0x7fad2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59452bab3358c43e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:27.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.428+0000 7fad2959a700 1 -- 172.21.15.59:0/1326960570 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2400e070 con 0x7fad2c131d10 2023-09-30T22:32:27.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.429+0000 7fad2959a700 1 -- 172.21.15.59:0/1326960570 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2400bb20 con 0x7fad2c131d10 2023-09-30T22:32:27.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.429+0000 7fad2959a700 1 -- 172.21.15.59:0/1326960570 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24012430 con 0x7fad2c131d10 2023-09-30T22:32:27.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.429+0000 7fad30c9d700 1 -- 172.21.15.59:0/1326960570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2c131d10 msgr2=0x7fad2c139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.429+0000 7fad30c9d700 1 --2- 172.21.15.59:0/1326960570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2c131d10 0x7fad2c139860 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fad24009d90 tx=0x7fad2400b330 comp rx=0 tx=0).stop 2023-09-30T22:32:27.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.430+0000 7fad30c9d700 1 -- 172.21.15.59:0/1326960570 shutdown_connections 2023-09-30T22:32:27.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.430+0000 7fad30c9d700 1 --2- 172.21.15.59:0/1326960570 >> v2:172.21.15.59:3300/0 conn(0x7fad2c06a770 0x7fad2c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.430+0000 7fad30c9d700 1 --2- 172.21.15.59:0/1326960570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2c131d10 0x7fad2c139860 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.430+0000 7fad30c9d700 1 -- 172.21.15.59:0/1326960570 >> 172.21.15.59:0/1326960570 conn(0x7fad2c066f50 msgr2=0x7fad2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:27.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.430+0000 7fad30c9d700 1 -- 172.21.15.59:0/1326960570 shutdown_connections 2023-09-30T22:32:27.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.430+0000 7fad30c9d700 1 -- 172.21.15.59:0/1326960570 wait complete. 2023-09-30T22:32:27.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.431+0000 7fad30c9d700 1 Processor -- start 2023-09-30T22:32:27.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.432+0000 7fad30c9d700 1 -- start start 2023-09-30T22:32:27.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.432+0000 7fad30c9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2c06a770 0x7fad2c1c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.432+0000 7fad30c9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad2c06b080 0x7fad2c1c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.432+0000 7fad30c9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad2c131d10 0x7fad2c1c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.432+0000 7fad30c9d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c125f60 con 0x7fad2c131d10 2023-09-30T22:32:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.432+0000 7fad30c9d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c125540 con 0x7fad2c06a770 2023-09-30T22:32:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.432+0000 7fad30c9d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c126160 con 0x7fad2c06b080 2023-09-30T22:32:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.433+0000 7fad29d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad2c06b080 0x7fad2c1c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.433+0000 7fad29d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad2c06b080 0x7fad2c1c8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52972/0 (socket says 172.21.15.59:52972) 2023-09-30T22:32:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.433+0000 7fad29d9b700 1 -- 172.21.15.59:0/3797049543 learned_addr learned my addr 172.21.15.59:0/3797049543 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.433+0000 7fad2a59c700 1 --2- 172.21.15.59:0/3797049543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2c06a770 0x7fad2c1c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.433+0000 7fad2ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad2c131d10 0x7fad2c1c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:27.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.433+0000 7fad2a59c700 1 -- 172.21.15.59:0/3797049543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad2c06b080 msgr2=0x7fad2c1c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.433+0000 7fad2a59c700 1 --2- 172.21.15.59:0/3797049543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad2c06b080 0x7fad2c1c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.433+0000 7fad2a59c700 1 -- 172.21.15.59:0/3797049543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad2c131d10 msgr2=0x7fad2c1c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.433+0000 7fad2a59c700 1 --2- 172.21.15.59:0/3797049543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad2c131d10 0x7fad2c1c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.433+0000 7fad2a59c700 1 -- 172.21.15.59:0/3797049543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad24009a70 con 0x7fad2c06a770 2023-09-30T22:32:27.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.433+0000 7fad2a59c700 1 --2- 172.21.15.59:0/3797049543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2c06a770 0x7fad2c1c8320 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00e900 tx=0x7fad1c00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:27.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.433+0000 7fad1affd700 1 -- 172.21.15.59:0/3797049543 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c013680 con 0x7fad2c06a770 2023-09-30T22:32:27.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.434+0000 7fad1affd700 1 -- 172.21.15.59:0/3797049543 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c0137e0 con 0x7fad2c06a770 2023-09-30T22:32:27.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.434+0000 7fad30c9d700 1 -- 172.21.15.59:0/3797049543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2c09bfc0 con 0x7fad2c06a770 2023-09-30T22:32:27.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.434+0000 7fad1affd700 1 -- 172.21.15.59:0/3797049543 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c013b50 con 0x7fad2c06a770 2023-09-30T22:32:27.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.434+0000 7fad1affd700 1 -- 172.21.15.59:0/3797049543 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad1c013cd0 con 0x7fad2c06a770 2023-09-30T22:32:27.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.435+0000 7fad30c9d700 1 -- 172.21.15.59:0/3797049543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2c1314b0 con 0x7fad2c06a770 2023-09-30T22:32:27.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.435+0000 7fad1affd700 1 -- 172.21.15.59:0/3797049543 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fad1c01ad30 con 0x7fad2c06a770 2023-09-30T22:32:27.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.436+0000 7fad30c9d700 1 -- 172.21.15.59:0/3797049543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2c06e970 con 0x7fad2c06a770 2023-09-30T22:32:27.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.440+0000 7fad1affd700 1 -- 172.21.15.59:0/3797049543 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad1c017030 con 0x7fad2c06a770 2023-09-30T22:32:27.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.568+0000 7fe5f3d45700 1 -- 172.21.15.59:0/3669902454 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe5ec074ea0 con 0x7fe5ec12ff20 2023-09-30T22:32:27.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.568+0000 7fe5e27fc700 1 -- 172.21.15.59:0/3669902454 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5e8010310 con 0x7fe5ec12ff20 2023-09-30T22:32:27.570 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:27.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.572+0000 7fe5f3d45700 1 -- 172.21.15.59:0/3669902454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5ec12ff20 msgr2=0x7fe5ec09c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.572+0000 7fe5f3d45700 1 --2- 172.21.15.59:0/3669902454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5ec12ff20 0x7fe5ec09c6e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800e840 tx=0x7fe5e800eb50 comp rx=0 tx=0).stop 2023-09-30T22:32:27.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.572+0000 7fe5f3d45700 1 -- 172.21.15.59:0/3669902454 shutdown_connections 2023-09-30T22:32:27.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.572+0000 7fe5f3d45700 1 --2- 172.21.15.59:0/3669902454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5ec12ff20 0x7fe5ec09c6e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.572+0000 7fe5f3d45700 1 --2- 172.21.15.59:0/3669902454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5ec133a80 0x7fe5ec09d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.572+0000 7fe5f3d45700 1 --2- 172.21.15.59:0/3669902454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5ec130a40 0x7fe5ec09cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.572+0000 7fe5f3d45700 1 -- 172.21.15.59:0/3669902454 >> 172.21.15.59:0/3669902454 conn(0x7fe5ec0a4210 msgr2=0x7fe5ec0a0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:27.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.572+0000 7fe5f3d45700 1 -- 172.21.15.59:0/3669902454 shutdown_connections 2023-09-30T22:32:27.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.572+0000 7fe5f3d45700 1 -- 172.21.15.59:0/3669902454 wait complete. 2023-09-30T22:32:27.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:27.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.600+0000 7f498162a700 1 -- 172.21.15.59:0/621142403 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f497c074ea0 con 0x7f497c133a80 2023-09-30T22:32:27.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.600+0000 7f49637fe700 1 -- 172.21.15.59:0/621142403 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f497402a030 con 0x7f497c133a80 2023-09-30T22:32:27.601 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:27.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.602+0000 7f498162a700 1 -- 172.21.15.59:0/621142403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497c133a80 msgr2=0x7f497c09cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.602+0000 7f498162a700 1 --2- 172.21.15.59:0/621142403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497c133a80 0x7f497c09cb90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f497c06c6b0 tx=0x7f4974004ad0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.602+0000 7f498162a700 1 -- 172.21.15.59:0/621142403 shutdown_connections 2023-09-30T22:32:27.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.602+0000 7f498162a700 1 --2- 172.21.15.59:0/621142403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497c133a80 0x7f497c09cb90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.602+0000 7f498162a700 1 --2- 172.21.15.59:0/621142403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497c12ff20 0x7f497c09c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.602+0000 7f498162a700 1 --2- 172.21.15.59:0/621142403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f497c130a40 0x7f497c09c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.602+0000 7f498162a700 1 -- 172.21.15.59:0/621142403 >> 172.21.15.59:0/621142403 conn(0x7f497c0a4210 msgr2=0x7f497c12f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:27.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.602+0000 7f498162a700 1 -- 172.21.15.59:0/621142403 shutdown_connections 2023-09-30T22:32:27.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.602+0000 7f498162a700 1 -- 172.21.15.59:0/621142403 wait complete. 2023-09-30T22:32:27.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.610+0000 7f351f697700 1 -- 172.21.15.59:0/596829070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3518074ea0 con 0x7f351806c0e0 2023-09-30T22:32:27.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.610+0000 7f350dffb700 1 -- 172.21.15.59:0/596829070 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f351400f8d0 con 0x7f351806c0e0 2023-09-30T22:32:27.611 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:27.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.612+0000 7f351f697700 1 -- 172.21.15.59:0/596829070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806c0e0 msgr2=0x7f351811a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.612+0000 7f351f697700 1 --2- 172.21.15.59:0/596829070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806c0e0 0x7f351811a680 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f351400b4a0 tx=0x7f351400b860 comp rx=0 tx=0).stop 2023-09-30T22:32:27.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.612+0000 7f351f697700 1 -- 172.21.15.59:0/596829070 shutdown_connections 2023-09-30T22:32:27.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.612+0000 7f351f697700 1 --2- 172.21.15.59:0/596829070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35181380f0 0x7f351811b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.612+0000 7f351f697700 1 --2- 172.21.15.59:0/596829070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806c0e0 0x7f351811a680 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.612+0000 7f351f697700 1 --2- 172.21.15.59:0/596829070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3518134ec0 0x7f351811abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.612+0000 7f351f697700 1 -- 172.21.15.59:0/596829070 >> 172.21.15.59:0/596829070 conn(0x7f35180a4210 msgr2=0x7f351806f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:27.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.612+0000 7f351f697700 1 -- 172.21.15.59:0/596829070 shutdown_connections 2023-09-30T22:32:27.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.612+0000 7f351f697700 1 -- 172.21.15.59:0/596829070 wait complete. 2023-09-30T22:32:27.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:27.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:27.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.658+0000 7fad30c9d700 1 -- 172.21.15.59:0/3797049543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fad2c074ea0 con 0x7fad2c06a770 2023-09-30T22:32:27.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.659+0000 7fad1affd700 1 -- 172.21.15.59:0/3797049543 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad1c017020 con 0x7fad2c06a770 2023-09-30T22:32:27.660 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:27.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.661+0000 7fad30c9d700 1 -- 172.21.15.59:0/3797049543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2c06a770 msgr2=0x7fad2c1c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:27.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.661+0000 7fad30c9d700 1 --2- 172.21.15.59:0/3797049543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2c06a770 0x7fad2c1c8320 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00e900 tx=0x7fad1c00ec10 comp rx=0 tx=0).stop 2023-09-30T22:32:27.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.661+0000 7fad30c9d700 1 -- 172.21.15.59:0/3797049543 shutdown_connections 2023-09-30T22:32:27.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.661+0000 7fad30c9d700 1 --2- 172.21.15.59:0/3797049543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad2c131d10 0x7fad2c1c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.661+0000 7fad30c9d700 1 --2- 172.21.15.59:0/3797049543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2c06a770 0x7fad2c1c8320 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.661+0000 7fad30c9d700 1 --2- 172.21.15.59:0/3797049543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad2c06b080 0x7fad2c1c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:27.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.661+0000 7fad30c9d700 1 -- 172.21.15.59:0/3797049543 >> 172.21.15.59:0/3797049543 conn(0x7fad2c066f50 msgr2=0x7fad2c0700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:27.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.661+0000 7fad30c9d700 1 -- 172.21.15.59:0/3797049543 shutdown_connections 2023-09-30T22:32:27.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:27.661+0000 7fad30c9d700 1 -- 172.21.15.59:0/3797049543 wait complete. 2023-09-30T22:32:27.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:28.592 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:28.619 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:28.629 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:28.677 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:28.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.745+0000 7f15531b0700 1 Processor -- start 2023-09-30T22:32:28.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.745+0000 7f15531b0700 1 -- start start 2023-09-30T22:32:28.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.746+0000 7f15531b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c134630 0x7f154c136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.746+0000 7f15531b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c136f50 0x7f154c139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.746+0000 7f15531b0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154c09b4f0 con 0x7f154c131810 2023-09-30T22:32:28.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.746+0000 7f15531b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154c1313c0 con 0x7f154c134630 2023-09-30T22:32:28.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.746+0000 7f15531b0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f154c06e8c0 con 0x7f154c136f50 2023-09-30T22:32:28.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.746+0000 7f154bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c134630 0x7f154c136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.746+0000 7f155174d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c136f50 0x7f154c139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.746+0000 7f154bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c134630 0x7f154c136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41406/0 (socket says 172.21.15.59:41406) 2023-09-30T22:32:28.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.746+0000 7f154bfff700 1 -- 172.21.15.59:0/577299782 learned_addr learned my addr 172.21.15.59:0/577299782 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:28.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.747+0000 7f154bfff700 1 -- 172.21.15.59:0/577299782 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c136f50 msgr2=0x7f154c139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:28.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.747+0000 7f154bfff700 1 --2- 172.21.15.59:0/577299782 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c136f50 0x7f154c139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.747+0000 7f154bfff700 1 -- 172.21.15.59:0/577299782 >> v1:172.21.15.59:6789/0 conn(0x7f154c131810 legacy=0x7f154c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:28.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.747+0000 7f154bfff700 1 -- 172.21.15.59:0/577299782 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c071d20 con 0x7f154c134630 2023-09-30T22:32:28.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.747+0000 7f154bfff700 1 --2- 172.21.15.59:0/577299782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c134630 0x7f154c136a10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1538009920 tx=0x7f1538009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79aec8b29d3b61ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:28.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.747+0000 7f154b7fe700 1 -- 172.21.15.59:0/577299782 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538011830 con 0x7f154c134630 2023-09-30T22:32:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.747+0000 7f154b7fe700 1 -- 172.21.15.59:0/577299782 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1538011990 con 0x7f154c134630 2023-09-30T22:32:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.747+0000 7f154b7fe700 1 -- 172.21.15.59:0/577299782 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538011d20 con 0x7f154c134630 2023-09-30T22:32:28.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.748+0000 7f15531b0700 1 -- 172.21.15.59:0/577299782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c134630 msgr2=0x7f154c136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:28.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.748+0000 7f15531b0700 1 --2- 172.21.15.59:0/577299782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c134630 0x7f154c136a10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1538009920 tx=0x7f1538009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:28.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.748+0000 7f15531b0700 1 -- 172.21.15.59:0/577299782 shutdown_connections 2023-09-30T22:32:28.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.748+0000 7f15531b0700 1 --2- 172.21.15.59:0/577299782 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c136f50 0x7f154c139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.748+0000 7f15531b0700 1 --2- 172.21.15.59:0/577299782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c134630 0x7f154c136a10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.748+0000 7f15531b0700 1 -- 172.21.15.59:0/577299782 >> 172.21.15.59:0/577299782 conn(0x7f154c0a2aa0 msgr2=0x7f154c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.748+0000 7f15531b0700 1 -- 172.21.15.59:0/577299782 shutdown_connections 2023-09-30T22:32:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.748+0000 7f15531b0700 1 -- 172.21.15.59:0/577299782 wait complete. 2023-09-30T22:32:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.749+0000 7f15531b0700 1 Processor -- start 2023-09-30T22:32:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.749+0000 7f15531b0700 1 -- start start 2023-09-30T22:32:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.750+0000 7f15531b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c131810 0x7f154c118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.750+0000 7f15531b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c134630 0x7f154c119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.750+0000 7f15531b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c136f50 0x7f154c119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.750+0000 7f15531b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c11a980 con 0x7f154c136f50 2023-09-30T22:32:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.750+0000 7f15531b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154c12eb50 con 0x7f154c134630 2023-09-30T22:32:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.750+0000 7f15531b0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f154c06eb00 con 0x7f154c131810 2023-09-30T22:32:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.750+0000 7f154bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c134630 0x7f154c119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.750+0000 7f154bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c134630 0x7f154c119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41408/0 (socket says 172.21.15.59:41408) 2023-09-30T22:32:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.750+0000 7f154bfff700 1 -- 172.21.15.59:0/531718050 learned_addr learned my addr 172.21.15.59:0/531718050 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.750+0000 7f155174d700 1 --2- 172.21.15.59:0/531718050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c136f50 0x7f154c119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.750+0000 7f1550f4c700 1 --2- 172.21.15.59:0/531718050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c131810 0x7f154c118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.750+0000 7f154bfff700 1 -- 172.21.15.59:0/531718050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c131810 msgr2=0x7f154c118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:28.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.751+0000 7f154bfff700 1 --2- 172.21.15.59:0/531718050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c131810 0x7f154c118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.751+0000 7f154bfff700 1 -- 172.21.15.59:0/531718050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c136f50 msgr2=0x7f154c119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:28.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.751+0000 7f154bfff700 1 --2- 172.21.15.59:0/531718050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c136f50 0x7f154c119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.751+0000 7f154bfff700 1 -- 172.21.15.59:0/531718050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1538009550 con 0x7f154c134630 2023-09-30T22:32:28.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.751+0000 7f1550f4c700 1 --2- 172.21.15.59:0/531718050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c131810 0x7f154c118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:28.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.751+0000 7f154bfff700 1 --2- 172.21.15.59:0/531718050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c134630 0x7f154c119210 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f15380098f0 tx=0x7f1538004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:28.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.751+0000 7f15497fa700 1 -- 172.21.15.59:0/531718050 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538004380 con 0x7f154c134630 2023-09-30T22:32:28.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.751+0000 7f15497fa700 1 -- 172.21.15.59:0/531718050 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153801f070 con 0x7f154c134630 2023-09-30T22:32:28.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.751+0000 7f15531b0700 1 -- 172.21.15.59:0/531718050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154c11cf10 con 0x7f154c134630 2023-09-30T22:32:28.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.751+0000 7f15497fa700 1 -- 172.21.15.59:0/531718050 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15380036a0 con 0x7f154c134630 2023-09-30T22:32:28.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.751+0000 7f15531b0700 1 -- 172.21.15.59:0/531718050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154c11c780 con 0x7f154c134630 2023-09-30T22:32:28.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.752+0000 7f15531b0700 1 -- 172.21.15.59:0/531718050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154c074ea0 con 0x7f154c134630 2023-09-30T22:32:28.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.753+0000 7f15497fa700 1 -- 172.21.15.59:0/531718050 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1538021030 con 0x7f154c134630 2023-09-30T22:32:28.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.753+0000 7f15497fa700 1 -- 172.21.15.59:0/531718050 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1538040d50 con 0x7f154c134630 2023-09-30T22:32:28.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.758+0000 7f15497fa700 1 -- 172.21.15.59:0/531718050 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15380199a0 con 0x7f154c134630 2023-09-30T22:32:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.784+0000 7fad35de7700 1 Processor -- start 2023-09-30T22:32:28.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.784+0000 7fad35de7700 1 -- start start 2023-09-30T22:32:28.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.785+0000 7fad35de7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3009d6f0 0x7fad3009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.785+0000 7fad35de7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad3009e000 0x7fad30130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.785+0000 7fad35de7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad3009f130 con 0x7fad3009e410 2023-09-30T22:32:28.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.785+0000 7fad35de7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3009f520 con 0x7fad3009e000 2023-09-30T22:32:28.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.785+0000 7fad35de7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3009e930 con 0x7fad3009d6f0 2023-09-30T22:32:28.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.785+0000 7fad2f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3009d6f0 0x7fad3009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.785+0000 7fad2f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3009d6f0 0x7fad3009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41414/0 (socket says 172.21.15.59:41414) 2023-09-30T22:32:28.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.785+0000 7fad2f7fe700 1 -- 172.21.15.59:0/4273758809 learned_addr learned my addr 172.21.15.59:0/4273758809 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:28.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.786+0000 7fad2effd700 1 --2- 172.21.15.59:0/4273758809 >> v2:172.21.15.59:3300/0 conn(0x7fad3009e000 0x7fad30130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.786+0000 7fad2f7fe700 1 -- 172.21.15.59:0/4273758809 >> v2:172.21.15.59:3300/0 conn(0x7fad3009e000 msgr2=0x7fad30130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:28.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.786+0000 7fad2f7fe700 1 --2- 172.21.15.59:0/4273758809 >> v2:172.21.15.59:3300/0 conn(0x7fad3009e000 0x7fad30130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.786+0000 7fad2f7fe700 1 -- 172.21.15.59:0/4273758809 >> v1:172.21.15.59:6789/0 conn(0x7fad3009e410 legacy=0x7fad30130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:28.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.786+0000 7fad2f7fe700 1 -- 172.21.15.59:0/4273758809 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3009b2d0 con 0x7fad3009d6f0 2023-09-30T22:32:28.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.786+0000 7fad2f7fe700 1 --2- 172.21.15.59:0/4273758809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3009d6f0 0x7fad3009dac0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fad2000bb90 tx=0x7fad2000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e3c57085dfc4bb0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:28.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.786+0000 7fad2e7fc700 1 -- 172.21.15.59:0/4273758809 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2000dcf0 con 0x7fad3009d6f0 2023-09-30T22:32:28.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.786+0000 7fad2e7fc700 1 -- 172.21.15.59:0/4273758809 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2000de50 con 0x7fad3009d6f0 2023-09-30T22:32:28.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.786+0000 7fad2e7fc700 1 -- 172.21.15.59:0/4273758809 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20004250 con 0x7fad3009d6f0 2023-09-30T22:32:28.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.787+0000 7fad35de7700 1 -- 172.21.15.59:0/4273758809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3009d6f0 msgr2=0x7fad3009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:28.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.787+0000 7fad35de7700 1 --2- 172.21.15.59:0/4273758809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3009d6f0 0x7fad3009dac0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fad2000bb90 tx=0x7fad2000bea0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.787+0000 7f05e0d9e700 1 Processor -- start 2023-09-30T22:32:28.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.787+0000 7fad35de7700 1 -- 172.21.15.59:0/4273758809 shutdown_connections 2023-09-30T22:32:28.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.787+0000 7fad35de7700 1 --2- 172.21.15.59:0/4273758809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3009d6f0 0x7fad3009dac0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.787+0000 7fad35de7700 1 --2- 172.21.15.59:0/4273758809 >> v2:172.21.15.59:3300/0 conn(0x7fad3009e000 0x7fad30130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.787+0000 7fad35de7700 1 -- 172.21.15.59:0/4273758809 >> 172.21.15.59:0/4273758809 conn(0x7fad30066f50 msgr2=0x7fad3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:28.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.787+0000 7f05e0d9e700 1 -- start start 2023-09-30T22:32:28.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.787+0000 7fad35de7700 1 -- 172.21.15.59:0/4273758809 shutdown_connections 2023-09-30T22:32:28.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.787+0000 7fad35de7700 1 -- 172.21.15.59:0/4273758809 wait complete. 2023-09-30T22:32:28.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.788+0000 7f05e0d9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05dc097cc0 0x7f05dc098090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.788+0000 7f05e0d9e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05dc09d230 0x7f05dc09d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.788+0000 7f05e0d9e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05dc09bd10 con 0x7f05dc09dbc0 2023-09-30T22:32:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.788+0000 7f05e0d9e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05dc096630 con 0x7f05dc09d230 2023-09-30T22:32:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.788+0000 7f05e0d9e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc0985d0 con 0x7f05dc097cc0 2023-09-30T22:32:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.788+0000 7f05db7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05dc097cc0 0x7f05dc098090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.788+0000 7f05db7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05dc097cc0 0x7f05dc098090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53008/0 (socket says 172.21.15.59:53008) 2023-09-30T22:32:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.788+0000 7f05db7fe700 1 -- 172.21.15.59:0/877619304 learned_addr learned my addr 172.21.15.59:0/877619304 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.788+0000 7f05db7fe700 1 -- 172.21.15.59:0/877619304 >> v2:172.21.15.59:3300/0 conn(0x7f05dc09d230 msgr2=0x7f05dc09d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.788+0000 7f05db7fe700 1 --2- 172.21.15.59:0/877619304 >> v2:172.21.15.59:3300/0 conn(0x7f05dc09d230 0x7f05dc09d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.788+0000 7f05db7fe700 1 -- 172.21.15.59:0/877619304 >> v1:172.21.15.59:6789/0 conn(0x7f05dc09dbc0 legacy=0x7f05dc138560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.788+0000 7f05db7fe700 1 -- 172.21.15.59:0/877619304 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc09e690 con 0x7f05dc097cc0 2023-09-30T22:32:28.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.789+0000 7fad35de7700 1 Processor -- start 2023-09-30T22:32:28.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.789+0000 7f05db7fe700 1 --2- 172.21.15.59:0/877619304 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05dc097cc0 0x7f05dc098090 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f05cc006fd0 tx=0x7f05cc009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7208c35f72be8d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:28.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.789+0000 7f05da7fc700 1 -- 172.21.15.59:0/877619304 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc005e30 con 0x7f05dc097cc0 2023-09-30T22:32:28.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.789+0000 7f05da7fc700 1 -- 172.21.15.59:0/877619304 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc006030 con 0x7f05dc097cc0 2023-09-30T22:32:28.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.789+0000 7f05da7fc700 1 -- 172.21.15.59:0/877619304 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0063c0 con 0x7f05dc097cc0 2023-09-30T22:32:28.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.790+0000 7f05e0d9e700 1 -- 172.21.15.59:0/877619304 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05dc097cc0 msgr2=0x7f05dc098090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:28.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.790+0000 7f05e0d9e700 1 --2- 172.21.15.59:0/877619304 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05dc097cc0 0x7f05dc098090 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f05cc006fd0 tx=0x7f05cc009bd0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.790+0000 7f05e0d9e700 1 -- 172.21.15.59:0/877619304 shutdown_connections 2023-09-30T22:32:28.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.790+0000 7f05e0d9e700 1 --2- 172.21.15.59:0/877619304 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05dc097cc0 0x7f05dc098090 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.790+0000 7f05e0d9e700 1 --2- 172.21.15.59:0/877619304 >> v2:172.21.15.59:3300/0 conn(0x7f05dc09d230 0x7f05dc09d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.790+0000 7f05e0d9e700 1 -- 172.21.15.59:0/877619304 >> 172.21.15.59:0/877619304 conn(0x7f05dc0a2540 msgr2=0x7f05dc0a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:28.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.790+0000 7f05e0d9e700 1 -- 172.21.15.59:0/877619304 shutdown_connections 2023-09-30T22:32:28.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.790+0000 7f05e0d9e700 1 -- 172.21.15.59:0/877619304 wait complete. 2023-09-30T22:32:28.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.790+0000 7fad35de7700 1 -- start start 2023-09-30T22:32:28.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.791+0000 7fad35de7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3009d6f0 0x7fad3011e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.791+0000 7fad35de7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad3009e000 0x7fad3011e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.791+0000 7fad35de7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3009e410 0x7fad3011eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.791+0000 7fad35de7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3011f500 con 0x7fad3009d6f0 2023-09-30T22:32:28.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.791+0000 7fad35de7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad30130370 con 0x7fad3009e410 2023-09-30T22:32:28.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.791+0000 7fad35de7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad301201c0 con 0x7fad3009e000 2023-09-30T22:32:28.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.791+0000 7fad2f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3009d6f0 0x7fad3011e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.791+0000 7fad2f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3009d6f0 0x7fad3011e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52086/0 (socket says 172.21.15.59:52086) 2023-09-30T22:32:28.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.791+0000 7fad2f7fe700 1 -- 172.21.15.59:0/3321401133 learned_addr learned my addr 172.21.15.59:0/3321401133 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:28.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.791+0000 7fad2ffff700 1 --2- 172.21.15.59:0/3321401133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3009e410 0x7fad3011eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.791+0000 7fad2effd700 1 --2- 172.21.15.59:0/3321401133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad3009e000 0x7fad3011e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.792+0000 7f05e0d9e700 1 Processor -- start 2023-09-30T22:32:28.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.792+0000 7fad2f7fe700 1 -- 172.21.15.59:0/3321401133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad3009e000 msgr2=0x7fad3011e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:28.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.792+0000 7fad2f7fe700 1 --2- 172.21.15.59:0/3321401133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad3009e000 0x7fad3011e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.792+0000 7fad2f7fe700 1 -- 172.21.15.59:0/3321401133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3009e410 msgr2=0x7fad3011eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:28.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.792+0000 7fad2f7fe700 1 --2- 172.21.15.59:0/3321401133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3009e410 0x7fad3011eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.792+0000 7fad2f7fe700 1 -- 172.21.15.59:0/3321401133 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2000b7f0 con 0x7fad3009d6f0 2023-09-30T22:32:28.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.792+0000 7fad2f7fe700 1 --2- 172.21.15.59:0/3321401133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3009d6f0 0x7fad3011e030 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fad2000b340 tx=0x7fad20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:28.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.792+0000 7fad17fff700 1 -- 172.21.15.59:0/3321401133 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20020070 con 0x7fad3009d6f0 2023-09-30T22:32:28.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.792+0000 7fad17fff700 1 -- 172.21.15.59:0/3321401133 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad200038b0 con 0x7fad3009d6f0 2023-09-30T22:32:28.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.792+0000 7fad17fff700 1 -- 172.21.15.59:0/3321401133 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20003c80 con 0x7fad3009d6f0 2023-09-30T22:32:28.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7fad35de7700 1 -- 172.21.15.59:0/3321401133 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad30120df0 con 0x7fad3009d6f0 2023-09-30T22:32:28.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7fad35de7700 1 -- 172.21.15.59:0/3321401133 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3009c700 con 0x7fad3009d6f0 2023-09-30T22:32:28.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.792+0000 7f05e0d9e700 1 -- start start 2023-09-30T22:32:28.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7f05e0d9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05dc097cc0 0x7f05dc0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7f05e0d9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05dc09d230 0x7f05dc071630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7f05e0d9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05dc09dbc0 0x7f05dc071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7f05e0d9e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc131510 con 0x7f05dc09dbc0 2023-09-30T22:32:28.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7f05e0d9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc072ab0 con 0x7f05dc09d230 2023-09-30T22:32:28.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7f05e0d9e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc09f850 con 0x7f05dc097cc0 2023-09-30T22:32:28.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7f05daffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05dc09d230 0x7f05dc071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7f05daffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05dc09d230 0x7f05dc071630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41434/0 (socket says 172.21.15.59:41434) 2023-09-30T22:32:28.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7f05daffd700 1 -- 172.21.15.59:0/874987053 learned_addr learned my addr 172.21.15.59:0/874987053 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:28.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7f05daffd700 1 -- 172.21.15.59:0/874987053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05dc097cc0 msgr2=0x7f05dc0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:28.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7f05daffd700 1 --2- 172.21.15.59:0/874987053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05dc097cc0 0x7f05dc0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7f05daffd700 1 -- 172.21.15.59:0/874987053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05dc09dbc0 msgr2=0x7f05dc071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:28.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7f05daffd700 1 --2- 172.21.15.59:0/874987053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05dc09dbc0 0x7f05dc071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.793+0000 7f05daffd700 1 -- 172.21.15.59:0/874987053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc009500 con 0x7f05dc09d230 2023-09-30T22:32:28.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.794+0000 7f05daffd700 1 --2- 172.21.15.59:0/874987053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05dc09d230 0x7f05dc071630 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f05d000b500 tx=0x7f05d000b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:28.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.794+0000 7f05c3fff700 1 -- 172.21.15.59:0/874987053 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0011830 con 0x7f05dc09d230 2023-09-30T22:32:28.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.794+0000 7fad35de7700 1 -- 172.21.15.59:0/3321401133 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad30074ea0 con 0x7fad3009d6f0 2023-09-30T22:32:28.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.794+0000 7f05c3fff700 1 -- 172.21.15.59:0/874987053 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d00119b0 con 0x7f05dc09d230 2023-09-30T22:32:28.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.794+0000 7f05c3fff700 1 -- 172.21.15.59:0/874987053 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0011d60 con 0x7f05dc09d230 2023-09-30T22:32:28.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.794+0000 7f05e0d9e700 1 -- 172.21.15.59:0/874987053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05dc0987b0 con 0x7f05dc09d230 2023-09-30T22:32:28.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.794+0000 7f05e0d9e700 1 -- 172.21.15.59:0/874987053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05dc130020 con 0x7f05dc09d230 2023-09-30T22:32:28.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.795+0000 7f05c3fff700 1 -- 172.21.15.59:0/874987053 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05d001a400 con 0x7f05dc09d230 2023-09-30T22:32:28.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.796+0000 7f05e0d9e700 1 -- 172.21.15.59:0/874987053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05dc04f2a0 con 0x7f05dc09d230 2023-09-30T22:32:28.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.796+0000 7f05c3fff700 1 -- 172.21.15.59:0/874987053 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f05d003f800 con 0x7f05dc09d230 2023-09-30T22:32:28.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.798+0000 7fad17fff700 1 -- 172.21.15.59:0/3321401133 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad2002d420 con 0x7fad3009d6f0 2023-09-30T22:32:28.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.798+0000 7fad17fff700 1 -- 172.21.15.59:0/3321401133 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fad200408f0 con 0x7fad3009d6f0 2023-09-30T22:32:28.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.800+0000 7f05c3fff700 1 -- 172.21.15.59:0/874987053 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05d000f8d0 con 0x7f05dc09d230 2023-09-30T22:32:28.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.804+0000 7fad17fff700 1 -- 172.21.15.59:0/3321401133 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad20003de0 con 0x7fad3009d6f0 2023-09-30T22:32:28.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.836+0000 7fe5d74fa700 1 Processor -- start 2023-09-30T22:32:28.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.837+0000 7fe5d74fa700 1 -- start start 2023-09-30T22:32:28.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.837+0000 7fe5d74fa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5d009d6f0 0x7fe5d009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.837+0000 7fe5d74fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d009e000 0x7fe5d0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.837+0000 7fe5d74fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d009e410 0x7fe5d0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.837+0000 7fe5d74fa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d009f520 con 0x7fe5d009d6f0 2023-09-30T22:32:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.837+0000 7fe5d74fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d009f130 con 0x7fe5d009e410 2023-09-30T22:32:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.837+0000 7fe5d74fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d009e930 con 0x7fe5d009e000 2023-09-30T22:32:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.837+0000 7fe5d4a95700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d009e000 0x7fe5d0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.838+0000 7fe5d4a95700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d009e000 0x7fe5d0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53028/0 (socket says 172.21.15.59:53028) 2023-09-30T22:32:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.838+0000 7fe5d4a95700 1 -- 172.21.15.59:0/4249013580 learned_addr learned my addr 172.21.15.59:0/4249013580 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.838+0000 7fe5d5296700 1 --2- 172.21.15.59:0/4249013580 >> v2:172.21.15.59:3300/0 conn(0x7fe5d009d6f0 0x7fe5d009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.838+0000 7fe5d5a97700 1 --2- 172.21.15.59:0/4249013580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d009e410 0x7fe5d0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.838+0000 7fe5d4a95700 1 -- 172.21.15.59:0/4249013580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d009e410 msgr2=0x7fe5d0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.838+0000 7fe5d4a95700 1 --2- 172.21.15.59:0/4249013580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d009e410 0x7fe5d0130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.838+0000 7fe5d4a95700 1 -- 172.21.15.59:0/4249013580 >> v2:172.21.15.59:3300/0 conn(0x7fe5d009d6f0 msgr2=0x7fe5d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.838+0000 7fe5d4a95700 1 --2- 172.21.15.59:0/4249013580 >> v2:172.21.15.59:3300/0 conn(0x7fe5d009d6f0 0x7fe5d009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.838+0000 7fe5d4a95700 1 -- 172.21.15.59:0/4249013580 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d009b2d0 con 0x7fe5d009e000 2023-09-30T22:32:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.838+0000 7fe5d5a97700 1 --2- 172.21.15.59:0/4249013580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d009e410 0x7fe5d0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.838+0000 7fe5d4a95700 1 --2- 172.21.15.59:0/4249013580 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d009e000 0x7fe5d0130660 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009920 tx=0x7fe5c0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7d1753dd18d67aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.838+0000 7fe5c7fff700 1 -- 172.21.15.59:0/4249013580 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0011830 con 0x7fe5d009e000 2023-09-30T22:32:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.838+0000 7fe5c7fff700 1 -- 172.21.15.59:0/4249013580 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c0011990 con 0x7fe5d009e000 2023-09-30T22:32:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.839+0000 7fe5c7fff700 1 -- 172.21.15.59:0/4249013580 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0011d20 con 0x7fe5d009e000 2023-09-30T22:32:28.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.839+0000 7fe5d74fa700 1 -- 172.21.15.59:0/4249013580 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d009e000 msgr2=0x7fe5d0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:28.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.839+0000 7fe5d74fa700 1 --2- 172.21.15.59:0/4249013580 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d009e000 0x7fe5d0130660 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009920 tx=0x7fe5c0009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:28.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.840+0000 7fe5d74fa700 1 -- 172.21.15.59:0/4249013580 shutdown_connections 2023-09-30T22:32:28.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.840+0000 7fe5d74fa700 1 --2- 172.21.15.59:0/4249013580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d009e410 0x7fe5d0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.840+0000 7fe5d74fa700 1 --2- 172.21.15.59:0/4249013580 >> v2:172.21.15.59:3300/0 conn(0x7fe5d009d6f0 0x7fe5d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.840+0000 7fe5d74fa700 1 --2- 172.21.15.59:0/4249013580 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d009e000 0x7fe5d0130660 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.840+0000 7fe5d74fa700 1 -- 172.21.15.59:0/4249013580 >> 172.21.15.59:0/4249013580 conn(0x7fe5d0066f50 msgr2=0x7fe5d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:28.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.840+0000 7fe5d74fa700 1 -- 172.21.15.59:0/4249013580 shutdown_connections 2023-09-30T22:32:28.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.840+0000 7fe5d74fa700 1 -- 172.21.15.59:0/4249013580 wait complete. 2023-09-30T22:32:28.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.841+0000 7fe5d74fa700 1 Processor -- start 2023-09-30T22:32:28.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.841+0000 7fe5d74fa700 1 -- start start 2023-09-30T22:32:28.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.841+0000 7fe5d74fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d009d6f0 0x7fe5d0137920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.841+0000 7fe5d74fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d009e000 0x7fe5d0137e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.841+0000 7fe5d74fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d009e410 0x7fe5d01383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:28.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.841+0000 7fe5d74fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d011a430 con 0x7fe5d009e410 2023-09-30T22:32:28.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.841+0000 7fe5d74fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0139080 con 0x7fe5d009e000 2023-09-30T22:32:28.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.841+0000 7fe5d74fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d009c770 con 0x7fe5d009d6f0 2023-09-30T22:32:28.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.841+0000 7fe5d5a97700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d009e410 0x7fe5d01383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.841+0000 7fe5d5a97700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d009e410 0x7fe5d01383a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52110/0 (socket says 172.21.15.59:52110) 2023-09-30T22:32:28.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.841+0000 7fe5d5a97700 1 -- 172.21.15.59:0/224520078 learned_addr learned my addr 172.21.15.59:0/224520078 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:28.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.842+0000 7fe5d5296700 1 --2- 172.21.15.59:0/224520078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d009d6f0 0x7fe5d0137920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:28.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.842+0000 7fe5d5a97700 1 -- 172.21.15.59:0/224520078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d009d6f0 msgr2=0x7fe5d0137920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:28.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.842+0000 7fe5d5a97700 1 --2- 172.21.15.59:0/224520078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d009d6f0 0x7fe5d0137920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.842+0000 7fe5d5a97700 1 -- 172.21.15.59:0/224520078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d009e000 msgr2=0x7fe5d0137e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:28.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.842+0000 7fe5d5a97700 1 --2- 172.21.15.59:0/224520078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d009e000 0x7fe5d0137e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.842+0000 7fe5d5a97700 1 -- 172.21.15.59:0/224520078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c0009550 con 0x7fe5d009e410 2023-09-30T22:32:28.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.842+0000 7fe5d5a97700 1 --2- 172.21.15.59:0/224520078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d009e410 0x7fe5d01383a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8007f20 tx=0x7fe5c800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:28.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.845+0000 7fe5c5ffb700 1 -- 172.21.15.59:0/224520078 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c800de30 con 0x7fe5d009e410 2023-09-30T22:32:28.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.845+0000 7fe5c5ffb700 1 -- 172.21.15.59:0/224520078 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c800f040 con 0x7fe5d009e410 2023-09-30T22:32:28.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.845+0000 7fe5c5ffb700 1 -- 172.21.15.59:0/224520078 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8003c60 con 0x7fe5d009e410 2023-09-30T22:32:28.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.845+0000 7fe5d74fa700 1 -- 172.21.15.59:0/224520078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d01370e0 con 0x7fe5d009e410 2023-09-30T22:32:28.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.846+0000 7fe5d74fa700 1 -- 172.21.15.59:0/224520078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d0119770 con 0x7fe5d009e410 2023-09-30T22:32:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.847+0000 7fe5d74fa700 1 -- 172.21.15.59:0/224520078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d0074ea0 con 0x7fe5d009e410 2023-09-30T22:32:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.848+0000 7fe5c5ffb700 1 -- 172.21.15.59:0/224520078 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5c8004030 con 0x7fe5d009e410 2023-09-30T22:32:28.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.848+0000 7fe5c5ffb700 1 -- 172.21.15.59:0/224520078 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe5c803fdf0 con 0x7fe5d009e410 2023-09-30T22:32:28.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.856+0000 7fe5c5ffb700 1 -- 172.21.15.59:0/224520078 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5c801e3b0 con 0x7fe5d009e410 2023-09-30T22:32:28.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.974+0000 7f15531b0700 1 -- 172.21.15.59:0/531718050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f154c06b9e0 con 0x7f154c134630 2023-09-30T22:32:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.974+0000 7f15497fa700 1 -- 172.21.15.59:0/531718050 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1538015030 con 0x7f154c134630 2023-09-30T22:32:28.975 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:28.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.976+0000 7f15531b0700 1 -- 172.21.15.59:0/531718050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c134630 msgr2=0x7f154c119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:28.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.976+0000 7f15531b0700 1 --2- 172.21.15.59:0/531718050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c134630 0x7f154c119210 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f15380098f0 tx=0x7f1538004750 comp rx=0 tx=0).stop 2023-09-30T22:32:28.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.977+0000 7f15531b0700 1 -- 172.21.15.59:0/531718050 shutdown_connections 2023-09-30T22:32:28.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.977+0000 7f15531b0700 1 --2- 172.21.15.59:0/531718050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c131810 0x7f154c118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.977+0000 7f15531b0700 1 --2- 172.21.15.59:0/531718050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c136f50 0x7f154c119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.977+0000 7f15531b0700 1 --2- 172.21.15.59:0/531718050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c134630 0x7f154c119210 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:28.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.977+0000 7f15531b0700 1 -- 172.21.15.59:0/531718050 >> 172.21.15.59:0/531718050 conn(0x7f154c0a2aa0 msgr2=0x7f154c09f920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:28.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.977+0000 7f15531b0700 1 -- 172.21.15.59:0/531718050 shutdown_connections 2023-09-30T22:32:28.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:28.977+0000 7f15531b0700 1 -- 172.21.15.59:0/531718050 wait complete. 2023-09-30T22:32:28.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:29.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.015+0000 7f05e0d9e700 1 -- 172.21.15.59:0/874987053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f05dc06b7c0 con 0x7f05dc09d230 2023-09-30T22:32:29.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.016+0000 7f05c3fff700 1 -- 172.21.15.59:0/874987053 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05d0015030 con 0x7f05dc09d230 2023-09-30T22:32:29.017 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:29.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.019+0000 7f05e0d9e700 1 -- 172.21.15.59:0/874987053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05dc09d230 msgr2=0x7f05dc071630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.019+0000 7f05e0d9e700 1 --2- 172.21.15.59:0/874987053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05dc09d230 0x7f05dc071630 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f05d000b500 tx=0x7f05d000b8c0 comp rx=0 tx=0).stop 2023-09-30T22:32:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.019+0000 7f05e0d9e700 1 -- 172.21.15.59:0/874987053 shutdown_connections 2023-09-30T22:32:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.019+0000 7f05e0d9e700 1 --2- 172.21.15.59:0/874987053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05dc097cc0 0x7f05dc0710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.019+0000 7f05e0d9e700 1 --2- 172.21.15.59:0/874987053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05dc09dbc0 0x7f05dc071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.019+0000 7f05e0d9e700 1 --2- 172.21.15.59:0/874987053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05dc09d230 0x7f05dc071630 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:29.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.019+0000 7f05e0d9e700 1 -- 172.21.15.59:0/874987053 >> 172.21.15.59:0/874987053 conn(0x7f05dc0a2540 msgr2=0x7f05dc08afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:29.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.019+0000 7f05e0d9e700 1 -- 172.21.15.59:0/874987053 shutdown_connections 2023-09-30T22:32:29.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.019+0000 7f05e0d9e700 1 -- 172.21.15.59:0/874987053 wait complete. 2023-09-30T22:32:29.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.026+0000 7fad35de7700 1 -- 172.21.15.59:0/3321401133 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fad3006c360 con 0x7fad3009d6f0 2023-09-30T22:32:29.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.026+0000 7fad17fff700 1 -- 172.21.15.59:0/3321401133 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad20029030 con 0x7fad3009d6f0 2023-09-30T22:32:29.028 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:29.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.029+0000 7fad35de7700 1 -- 172.21.15.59:0/3321401133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3009d6f0 msgr2=0x7fad3011e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:29.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.029+0000 7fad35de7700 1 --2- 172.21.15.59:0/3321401133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3009d6f0 0x7fad3011e030 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fad2000b340 tx=0x7fad20004750 comp rx=0 tx=0).stop 2023-09-30T22:32:29.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.029+0000 7fad35de7700 1 -- 172.21.15.59:0/3321401133 shutdown_connections 2023-09-30T22:32:29.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.029+0000 7fad35de7700 1 --2- 172.21.15.59:0/3321401133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3009e410 0x7fad3011eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:29.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.029+0000 7fad35de7700 1 --2- 172.21.15.59:0/3321401133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3009d6f0 0x7fad3011e030 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:29.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.029+0000 7fad35de7700 1 --2- 172.21.15.59:0/3321401133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad3009e000 0x7fad3011e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:29.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.029+0000 7fad35de7700 1 -- 172.21.15.59:0/3321401133 >> 172.21.15.59:0/3321401133 conn(0x7fad30066f50 msgr2=0x7fad300710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:29.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.029+0000 7fad35de7700 1 -- 172.21.15.59:0/3321401133 shutdown_connections 2023-09-30T22:32:29.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.029+0000 7fad35de7700 1 -- 172.21.15.59:0/3321401133 wait complete. 2023-09-30T22:32:29.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:29.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.079+0000 7fe5d74fa700 1 -- 172.21.15.59:0/224520078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe5d0138be0 con 0x7fe5d009e410 2023-09-30T22:32:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.079+0000 7fe5c5ffb700 1 -- 172.21.15.59:0/224520078 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5c801a030 con 0x7fe5d009e410 2023-09-30T22:32:29.081 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:29.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.082+0000 7fe5d74fa700 1 -- 172.21.15.59:0/224520078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d009e410 msgr2=0x7fe5d01383a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:29.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.082+0000 7fe5d74fa700 1 --2- 172.21.15.59:0/224520078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d009e410 0x7fe5d01383a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8007f20 tx=0x7fe5c800d3b0 comp rx=0 tx=0).stop 2023-09-30T22:32:29.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.082+0000 7fe5d74fa700 1 -- 172.21.15.59:0/224520078 shutdown_connections 2023-09-30T22:32:29.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.082+0000 7fe5d74fa700 1 --2- 172.21.15.59:0/224520078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d009d6f0 0x7fe5d0137920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:29.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.082+0000 7fe5d74fa700 1 --2- 172.21.15.59:0/224520078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d009e410 0x7fe5d01383a0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:29.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.082+0000 7fe5d74fa700 1 --2- 172.21.15.59:0/224520078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d009e000 0x7fe5d0137e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:29.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.082+0000 7fe5d74fa700 1 -- 172.21.15.59:0/224520078 >> 172.21.15.59:0/224520078 conn(0x7fe5d0066f50 msgr2=0x7fe5d012c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:29.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.082+0000 7fe5d74fa700 1 -- 172.21.15.59:0/224520078 shutdown_connections 2023-09-30T22:32:29.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:29.082+0000 7fe5d74fa700 1 -- 172.21.15.59:0/224520078 wait complete. 2023-09-30T22:32:29.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:29.993 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:30.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:30.045 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:30.098 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:30.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.147+0000 7fc7e5744700 1 Processor -- start 2023-09-30T22:32:30.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.147+0000 7fc7e5744700 1 -- start start 2023-09-30T22:32:30.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.148+0000 7fc7e5744700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e009d6f0 0x7fc7e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.148+0000 7fc7e5744700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e009e000 0x7fc7e01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.148+0000 7fc7e5744700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e009b120 con 0x7fc7e009e410 2023-09-30T22:32:30.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.148+0000 7fc7e5744700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e006b460 con 0x7fc7e009e000 2023-09-30T22:32:30.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.148+0000 7fc7e5744700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e009a7e0 con 0x7fc7e009d6f0 2023-09-30T22:32:30.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.148+0000 7fc7df7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc7e009e410 0x7fc7e0133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57350/0 (socket says 172.21.15.59:57350) 2023-09-30T22:32:30.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.148+0000 7fc7df7fe700 1 -- 172.21.15.59:0/2972176936 learned_addr learned my addr 172.21.15.59:0/2972176936 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:30.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.148+0000 7fc7de7fc700 1 --2- 172.21.15.59:0/2972176936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e009e000 0x7fc7e01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.148+0000 7fc7deffd700 1 --2- 172.21.15.59:0/2972176936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e009d6f0 0x7fc7e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.148+0000 7fc7ddffb700 1 -- 172.21.15.59:0/2972176936 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872346484 0 0) 0x7fc7e009b120 con 0x7fc7e009e410 2023-09-30T22:32:30.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.148+0000 7fc7de7fc700 1 -- 172.21.15.59:0/2972176936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e009d6f0 msgr2=0x7fc7e009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:30.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.148+0000 7fc7de7fc700 1 --2- 172.21.15.59:0/2972176936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e009d6f0 0x7fc7e009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.148+0000 7fc7de7fc700 1 -- 172.21.15.59:0/2972176936 >> v1:172.21.15.59:6789/0 conn(0x7fc7e009e410 legacy=0x7fc7e0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.148+0000 7fc7de7fc700 1 -- 172.21.15.59:0/2972176936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e009a500 con 0x7fc7e009e000 2023-09-30T22:32:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.149+0000 7fc7de7fc700 1 --2- 172.21.15.59:0/2972176936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e009e000 0x7fc7e01339f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009870 tx=0x7fc7d4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=200f800c3301cba7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:30.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.149+0000 7fc7ddffb700 1 -- 172.21.15.59:0/2972176936 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4011830 con 0x7fc7e009e000 2023-09-30T22:32:30.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.149+0000 7fc7ddffb700 1 -- 172.21.15.59:0/2972176936 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d4011990 con 0x7fc7e009e000 2023-09-30T22:32:30.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.149+0000 7fc7ddffb700 1 -- 172.21.15.59:0/2972176936 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4011d20 con 0x7fc7e009e000 2023-09-30T22:32:30.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.150+0000 7fc7e5744700 1 -- 172.21.15.59:0/2972176936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e009e000 msgr2=0x7fc7e01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.150+0000 7fc7e5744700 1 --2- 172.21.15.59:0/2972176936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e009e000 0x7fc7e01339f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009870 tx=0x7fc7d4009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.150+0000 7fc7e5744700 1 -- 172.21.15.59:0/2972176936 shutdown_connections 2023-09-30T22:32:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.150+0000 7fc7e5744700 1 --2- 172.21.15.59:0/2972176936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e009d6f0 0x7fc7e009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.150+0000 7fc7e5744700 1 --2- 172.21.15.59:0/2972176936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e009e000 0x7fc7e01339f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.150+0000 7fc7e5744700 1 -- 172.21.15.59:0/2972176936 >> 172.21.15.59:0/2972176936 conn(0x7fc7e0066f50 msgr2=0x7fc7e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.150+0000 7fc7e5744700 1 -- 172.21.15.59:0/2972176936 shutdown_connections 2023-09-30T22:32:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.150+0000 7fc7e5744700 1 -- 172.21.15.59:0/2972176936 wait complete. 2023-09-30T22:32:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.151+0000 7fc7e5744700 1 Processor -- start 2023-09-30T22:32:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.151+0000 7fc7e5744700 1 -- start start 2023-09-30T22:32:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7e5744700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e009d6f0 0x7fc7e0122330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7e5744700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e009e000 0x7fc7e0122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7e5744700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e009e410 0x7fc7e0122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7e5744700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0123800 con 0x7fc7e009d6f0 2023-09-30T22:32:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7e5744700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0133700 con 0x7fc7e009e410 2023-09-30T22:32:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7e5744700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0124dd0 con 0x7fc7e009e000 2023-09-30T22:32:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7deffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e009d6f0 0x7fc7e0122330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7deffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e009d6f0 0x7fc7e0122330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52118/0 (socket says 172.21.15.59:52118) 2023-09-30T22:32:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7deffd700 1 -- 172.21.15.59:0/2494982438 learned_addr learned my addr 172.21.15.59:0/2494982438 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7de7fc700 1 --2- 172.21.15.59:0/2494982438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e009e000 0x7fc7e0122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7df7fe700 1 --2- 172.21.15.59:0/2494982438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e009e410 0x7fc7e0122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7de7fc700 1 -- 172.21.15.59:0/2494982438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e009e410 msgr2=0x7fc7e0122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7de7fc700 1 --2- 172.21.15.59:0/2494982438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e009e410 0x7fc7e0122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7de7fc700 1 -- 172.21.15.59:0/2494982438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e009d6f0 msgr2=0x7fc7e0122330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7de7fc700 1 --2- 172.21.15.59:0/2494982438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e009d6f0 0x7fc7e0122330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.152+0000 7fc7de7fc700 1 -- 172.21.15.59:0/2494982438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d40094a0 con 0x7fc7e009e000 2023-09-30T22:32:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.153+0000 7fc7de7fc700 1 --2- 172.21.15.59:0/2494982438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e009e000 0x7fc7e0122870 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4016000 tx=0x7fc7d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.153+0000 7fc7c77fe700 1 -- 172.21.15.59:0/2494982438 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d401a6e0 con 0x7fc7e009e000 2023-09-30T22:32:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.153+0000 7fc7c77fe700 1 -- 172.21.15.59:0/2494982438 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d401a840 con 0x7fc7e009e000 2023-09-30T22:32:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.153+0000 7fc7e5744700 1 -- 172.21.15.59:0/2494982438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e01258b0 con 0x7fc7e009e000 2023-09-30T22:32:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.153+0000 7fc7c77fe700 1 -- 172.21.15.59:0/2494982438 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d401abb0 con 0x7fc7e009e000 2023-09-30T22:32:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.153+0000 7fc7e5744700 1 -- 172.21.15.59:0/2494982438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e00a1f00 con 0x7fc7e009e000 2023-09-30T22:32:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.154+0000 7fc7c77fe700 1 -- 172.21.15.59:0/2494982438 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7d4022070 con 0x7fc7e009e000 2023-09-30T22:32:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.154+0000 7fc7e5744700 1 -- 172.21.15.59:0/2494982438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e011f030 con 0x7fc7e009e000 2023-09-30T22:32:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.155+0000 7fc7c77fe700 1 -- 172.21.15.59:0/2494982438 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc7d4040700 con 0x7fc7e009e000 2023-09-30T22:32:30.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.160+0000 7fc7c77fe700 1 -- 172.21.15.59:0/2494982438 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7d4022910 con 0x7fc7e009e000 2023-09-30T22:32:30.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.190+0000 7f9f7b291700 1 Processor -- start 2023-09-30T22:32:30.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.191+0000 7f9f7b291700 1 -- start start 2023-09-30T22:32:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.192+0000 7f9f7b291700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f74130790 0x7f9f74130b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.192+0000 7f9f7b291700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f7406f640 0x7f9f7406fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.192+0000 7f9f7b291700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7409ef50 con 0x7f9f7406ffb0 2023-09-30T22:32:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.192+0000 7f9f7b291700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7409a370 con 0x7f9f7406f640 2023-09-30T22:32:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.192+0000 7f9f7b291700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f74070860 con 0x7f9f74130790 2023-09-30T22:32:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.192+0000 7f9f7882c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f7406f640 0x7f9f7406fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.192+0000 7f9f7882c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f7406f640 0x7f9f7406fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52126/0 (socket says 172.21.15.59:52126) 2023-09-30T22:32:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.192+0000 7f9f7902d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f74130790 0x7f9f74130b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.192+0000 7f9f7882c700 1 -- 172.21.15.59:0/2982266711 learned_addr learned my addr 172.21.15.59:0/2982266711 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.192+0000 7f9f7902d700 1 -- 172.21.15.59:0/2982266711 >> v2:172.21.15.59:3300/0 conn(0x7f9f7406f640 msgr2=0x7f9f7406fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.192+0000 7f9f7902d700 1 --2- 172.21.15.59:0/2982266711 >> v2:172.21.15.59:3300/0 conn(0x7f9f7406f640 0x7f9f7406fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.192+0000 7f9f7902d700 1 -- 172.21.15.59:0/2982266711 >> v1:172.21.15.59:6789/0 conn(0x7f9f7406ffb0 legacy=0x7f9f741374f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.192+0000 7f9f7902d700 1 -- 172.21.15.59:0/2982266711 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f741310a0 con 0x7f9f74130790 2023-09-30T22:32:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.193+0000 7f9f7902d700 1 --2- 172.21.15.59:0/2982266711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f74130790 0x7f9f74130b60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009840 tx=0x7f9f70009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4cebaa0cd45c051 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:30.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.193+0000 7f9f6bfff700 1 -- 172.21.15.59:0/2982266711 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f70011830 con 0x7f9f74130790 2023-09-30T22:32:30.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.193+0000 7f9f6bfff700 1 -- 172.21.15.59:0/2982266711 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f70011990 con 0x7f9f74130790 2023-09-30T22:32:30.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.193+0000 7f9f6bfff700 1 -- 172.21.15.59:0/2982266711 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f70011d00 con 0x7f9f74130790 2023-09-30T22:32:30.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.194+0000 7f9f7b291700 1 -- 172.21.15.59:0/2982266711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f74130790 msgr2=0x7f9f74130b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.194+0000 7f9f7b291700 1 --2- 172.21.15.59:0/2982266711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f74130790 0x7f9f74130b60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009840 tx=0x7f9f70009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:30.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.194+0000 7f9f7b291700 1 -- 172.21.15.59:0/2982266711 shutdown_connections 2023-09-30T22:32:30.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.194+0000 7f9f7b291700 1 --2- 172.21.15.59:0/2982266711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f74130790 0x7f9f74130b60 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.194+0000 7f9f7b291700 1 --2- 172.21.15.59:0/2982266711 >> v2:172.21.15.59:3300/0 conn(0x7f9f7406f640 0x7f9f7406fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.194+0000 7f9f7b291700 1 -- 172.21.15.59:0/2982266711 >> 172.21.15.59:0/2982266711 conn(0x7f9f740a2aa0 msgr2=0x7f9f740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:30.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.194+0000 7f9f7b291700 1 -- 172.21.15.59:0/2982266711 shutdown_connections 2023-09-30T22:32:30.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.194+0000 7f9f7b291700 1 -- 172.21.15.59:0/2982266711 wait complete. 2023-09-30T22:32:30.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.195+0000 7f9f7b291700 1 Processor -- start 2023-09-30T22:32:30.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.195+0000 7f9f7b291700 1 -- start start 2023-09-30T22:32:30.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.195+0000 7f9f7b291700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f7406f640 0x7f9f74139c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.195+0000 7f9f7b291700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f7406ffb0 0x7f9f7413a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.195+0000 7f9f7b291700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f74138070 0x7f9f7413a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.195+0000 7f9f7b291700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7413b2f0 con 0x7f9f74138070 2023-09-30T22:32:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.195+0000 7f9f7b291700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7412db50 con 0x7f9f7406f640 2023-09-30T22:32:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.195+0000 7f9f7b291700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f740a0970 con 0x7f9f7406ffb0 2023-09-30T22:32:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.195+0000 7f9f7902d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f7406f640 0x7f9f74139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.196+0000 7f9f7902d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f7406f640 0x7f9f74139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41470/0 (socket says 172.21.15.59:41470) 2023-09-30T22:32:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.196+0000 7f9f7902d700 1 -- 172.21.15.59:0/3656299673 learned_addr learned my addr 172.21.15.59:0/3656299673 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.196+0000 7f9f7882c700 1 --2- 172.21.15.59:0/3656299673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f7406ffb0 0x7f9f7413a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.196+0000 7f9f7982e700 1 --2- 172.21.15.59:0/3656299673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f74138070 0x7f9f7413a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.196+0000 7f9f7882c700 1 -- 172.21.15.59:0/3656299673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f7406f640 msgr2=0x7f9f74139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.196+0000 7f9f7882c700 1 --2- 172.21.15.59:0/3656299673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f7406f640 0x7f9f74139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.196+0000 7f9f7882c700 1 -- 172.21.15.59:0/3656299673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f74138070 msgr2=0x7f9f7413a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.196+0000 7f9f7882c700 1 --2- 172.21.15.59:0/3656299673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f74138070 0x7f9f7413a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.196+0000 7f9f7882c700 1 -- 172.21.15.59:0/3656299673 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700094a0 con 0x7f9f7406ffb0 2023-09-30T22:32:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.196+0000 7f9f7902d700 1 --2- 172.21.15.59:0/3656299673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f7406f640 0x7f9f74139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.197+0000 7f9f7882c700 1 --2- 172.21.15.59:0/3656299673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f7406ffb0 0x7f9f7413a160 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400e840 tx=0x7f9f6400eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.197+0000 7f9f69ffb700 1 -- 172.21.15.59:0/3656299673 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f64013680 con 0x7f9f7406ffb0 2023-09-30T22:32:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.197+0000 7f9f69ffb700 1 -- 172.21.15.59:0/3656299673 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f640137e0 con 0x7f9f7406ffb0 2023-09-30T22:32:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.197+0000 7f9f69ffb700 1 -- 172.21.15.59:0/3656299673 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f64013b50 con 0x7f9f7406ffb0 2023-09-30T22:32:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.197+0000 7f9f7b291700 1 -- 172.21.15.59:0/3656299673 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f74071800 con 0x7f9f7406ffb0 2023-09-30T22:32:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.197+0000 7f9f7b291700 1 -- 172.21.15.59:0/3656299673 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f74138c30 con 0x7f9f7406ffb0 2023-09-30T22:32:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.198+0000 7f9f69ffb700 1 -- 172.21.15.59:0/3656299673 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f64013cb0 con 0x7f9f7406ffb0 2023-09-30T22:32:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.198+0000 7f9f7b291700 1 -- 172.21.15.59:0/3656299673 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f74074ea0 con 0x7f9f7406ffb0 2023-09-30T22:32:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.199+0000 7f9f69ffb700 1 -- 172.21.15.59:0/3656299673 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9f6403f880 con 0x7f9f7406ffb0 2023-09-30T22:32:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.203+0000 7f9f69ffb700 1 -- 172.21.15.59:0/3656299673 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f6401ada0 con 0x7f9f7406ffb0 2023-09-30T22:32:30.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.233+0000 7f7353ec0700 1 Processor -- start 2023-09-30T22:32:30.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.234+0000 7f7353ec0700 1 -- start start 2023-09-30T22:32:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.235+0000 7f7353ec0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f734c09d6f0 0x7f734c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.235+0000 7f7353ec0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f734c09e410 0x7f734c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.235+0000 7f7353ec0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734c09b120 con 0x7f734c09e000 2023-09-30T22:32:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.235+0000 7f7353ec0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734c06b460 con 0x7f734c09e410 2023-09-30T22:32:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.235+0000 7f7353ec0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f734c09a7e0 con 0x7f734c09d6f0 2023-09-30T22:32:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.235+0000 7f7351c5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f734c09d6f0 0x7f734c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.235+0000 7f7351c5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f734c09d6f0 0x7f734c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53096/0 (socket says 172.21.15.59:53096) 2023-09-30T22:32:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.235+0000 7f7351c5c700 1 -- 172.21.15.59:0/1603927125 learned_addr learned my addr 172.21.15.59:0/1603927125 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:30.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.235+0000 7f735245d700 1 --2- 172.21.15.59:0/1603927125 >> v2:172.21.15.59:3300/0 conn(0x7f734c09e410 0x7f734c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.235+0000 7f7351c5c700 1 -- 172.21.15.59:0/1603927125 >> v2:172.21.15.59:3300/0 conn(0x7f734c09e410 msgr2=0x7f734c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:30.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.235+0000 7f7351c5c700 1 --2- 172.21.15.59:0/1603927125 >> v2:172.21.15.59:3300/0 conn(0x7f734c09e410 0x7f734c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.235+0000 7f7351c5c700 1 -- 172.21.15.59:0/1603927125 >> v1:172.21.15.59:6789/0 conn(0x7f734c09e000 legacy=0x7f734c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.235+0000 7f7351c5c700 1 -- 172.21.15.59:0/1603927125 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c09a500 con 0x7f734c09d6f0 2023-09-30T22:32:30.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.235+0000 7f7351c5c700 1 --2- 172.21.15.59:0/1603927125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f734c09d6f0 0x7f734c09dac0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7348009920 tx=0x7f7348009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6a9c4110c6a180f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:30.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.236+0000 7f7350c5a700 1 -- 172.21.15.59:0/1603927125 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348011830 con 0x7f734c09d6f0 2023-09-30T22:32:30.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.236+0000 7f7350c5a700 1 -- 172.21.15.59:0/1603927125 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7348011990 con 0x7f734c09d6f0 2023-09-30T22:32:30.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.236+0000 7f7350c5a700 1 -- 172.21.15.59:0/1603927125 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348011d20 con 0x7f734c09d6f0 2023-09-30T22:32:30.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.236+0000 7f7353ec0700 1 -- 172.21.15.59:0/1603927125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f734c09d6f0 msgr2=0x7f734c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.236+0000 7f7353ec0700 1 --2- 172.21.15.59:0/1603927125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f734c09d6f0 0x7f734c09dac0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7348009920 tx=0x7f7348009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:30.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.237+0000 7f7353ec0700 1 -- 172.21.15.59:0/1603927125 shutdown_connections 2023-09-30T22:32:30.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.237+0000 7f7353ec0700 1 --2- 172.21.15.59:0/1603927125 >> v2:172.21.15.59:3300/0 conn(0x7f734c09e410 0x7f734c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.237+0000 7f7353ec0700 1 --2- 172.21.15.59:0/1603927125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f734c09d6f0 0x7f734c09dac0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.237+0000 7f7353ec0700 1 -- 172.21.15.59:0/1603927125 >> 172.21.15.59:0/1603927125 conn(0x7f734c066f50 msgr2=0x7f734c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:30.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.237+0000 7f7353ec0700 1 -- 172.21.15.59:0/1603927125 shutdown_connections 2023-09-30T22:32:30.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.237+0000 7f7353ec0700 1 -- 172.21.15.59:0/1603927125 wait complete. 2023-09-30T22:32:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.238+0000 7f7353ec0700 1 Processor -- start 2023-09-30T22:32:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.238+0000 7f7353ec0700 1 -- start start 2023-09-30T22:32:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.238+0000 7f7353ec0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f734c09d6f0 0x7f734c1a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.238+0000 7f7353ec0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f734c09e000 0x7f734c1a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.238+0000 7f7353ec0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f734c09e410 0x7f734c1a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.238+0000 7f7353ec0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c1a8da0 con 0x7f734c09e410 2023-09-30T22:32:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.238+0000 7f7353ec0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734c1a7410 con 0x7f734c09e000 2023-09-30T22:32:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.238+0000 7f7353ec0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f734c1a97f0 con 0x7f734c09d6f0 2023-09-30T22:32:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.238+0000 7f7351c5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f734c09d6f0 0x7f734c1a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.238+0000 7f7351c5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f734c09d6f0 0x7f734c1a5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53098/0 (socket says 172.21.15.59:53098) 2023-09-30T22:32:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.238+0000 7f7351c5c700 1 -- 172.21.15.59:0/1136762743 learned_addr learned my addr 172.21.15.59:0/1136762743 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.239+0000 7f735245d700 1 --2- 172.21.15.59:0/1136762743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f734c09e410 0x7f734c1a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.239+0000 7f7351c5c700 1 -- 172.21.15.59:0/1136762743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f734c09e000 msgr2=0x7f734c1a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.239+0000 7f7351c5c700 1 --2- 172.21.15.59:0/1136762743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f734c09e000 0x7f734c1a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.239+0000 7f7351c5c700 1 -- 172.21.15.59:0/1136762743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f734c09e410 msgr2=0x7f734c1a69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.239+0000 7f7351c5c700 1 --2- 172.21.15.59:0/1136762743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f734c09e410 0x7f734c1a69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.239+0000 7f7351c5c700 1 -- 172.21.15.59:0/1136762743 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7348009550 con 0x7f734c09d6f0 2023-09-30T22:32:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.239+0000 7f7351c5c700 1 --2- 172.21.15.59:0/1136762743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f734c09d6f0 0x7f734c1a5f60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7348009870 tx=0x7f7348004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.239+0000 7f73427fc700 1 -- 172.21.15.59:0/1136762743 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348004380 con 0x7f734c09d6f0 2023-09-30T22:32:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.239+0000 7f73427fc700 1 -- 172.21.15.59:0/1136762743 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734801f070 con 0x7f734c09d6f0 2023-09-30T22:32:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.239+0000 7f73427fc700 1 -- 172.21.15.59:0/1136762743 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73480036a0 con 0x7f734c09d6f0 2023-09-30T22:32:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.239+0000 7f7353ec0700 1 -- 172.21.15.59:0/1136762743 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734c1a88e0 con 0x7f734c09d6f0 2023-09-30T22:32:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.239+0000 7f7353ec0700 1 -- 172.21.15.59:0/1136762743 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734c0a33b0 con 0x7f734c09d6f0 2023-09-30T22:32:30.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.240+0000 7f73427fc700 1 -- 172.21.15.59:0/1136762743 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7348021030 con 0x7f734c09d6f0 2023-09-30T22:32:30.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.240+0000 7f73427fc700 1 -- 172.21.15.59:0/1136762743 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7348040a30 con 0x7f734c09d6f0 2023-09-30T22:32:30.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.241+0000 7f7353ec0700 1 -- 172.21.15.59:0/1136762743 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734c09c770 con 0x7f734c09d6f0 2023-09-30T22:32:30.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.246+0000 7f73427fc700 1 -- 172.21.15.59:0/1136762743 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7348015020 con 0x7f734c09d6f0 2023-09-30T22:32:30.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.276+0000 7fca8ff8d700 1 Processor -- start 2023-09-30T22:32:30.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.276+0000 7fca8ff8d700 1 -- start start 2023-09-30T22:32:30.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.277+0000 7fca8ff8d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca8806a770 0x7fca8809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.277+0000 7fca8ff8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca8813d1f0 0x7fca8813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.277+0000 7fca8ff8d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8809a810 con 0x7fca8809dc30 2023-09-30T22:32:30.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.277+0000 7fca8ff8d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8806ab40 con 0x7fca8813d1f0 2023-09-30T22:32:30.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.277+0000 7fca8ff8d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca8809ebc0 con 0x7fca8806a770 2023-09-30T22:32:30.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.277+0000 7fca8d528700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fca8809dc30 0x7fca8809e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57374/0 (socket says 172.21.15.59:57374) 2023-09-30T22:32:30.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.277+0000 7fca8d528700 1 -- 172.21.15.59:0/616009963 learned_addr learned my addr 172.21.15.59:0/616009963 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:30.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.277+0000 7fca8e52a700 1 --2- 172.21.15.59:0/616009963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca8813d1f0 0x7fca8813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.277+0000 7fca8dd29700 1 --2- 172.21.15.59:0/616009963 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca8806a770 0x7fca8809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.278+0000 7fca8cd27700 1 -- 172.21.15.59:0/616009963 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336710054 0 0) 0x7fca8809a810 con 0x7fca8809dc30 2023-09-30T22:32:30.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.278+0000 7fca8e52a700 1 -- 172.21.15.59:0/616009963 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca8806a770 msgr2=0x7fca8809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:30.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.278+0000 7fca8e52a700 1 --2- 172.21.15.59:0/616009963 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca8806a770 0x7fca8809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.278+0000 7fca8e52a700 1 -- 172.21.15.59:0/616009963 >> v1:172.21.15.59:6789/0 conn(0x7fca8809dc30 legacy=0x7fca8809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.278+0000 7fca8e52a700 1 -- 172.21.15.59:0/616009963 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8809e920 con 0x7fca8813d1f0 2023-09-30T22:32:30.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.278+0000 7fca8e52a700 1 --2- 172.21.15.59:0/616009963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca8813d1f0 0x7fca8813f5d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fca80009dc0 tx=0x7fca8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cb9a65bcdcc904e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:30.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.278+0000 7fca8cd27700 1 -- 172.21.15.59:0/616009963 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8000e070 con 0x7fca8813d1f0 2023-09-30T22:32:30.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.278+0000 7fca8cd27700 1 -- 172.21.15.59:0/616009963 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8000bbd0 con 0x7fca8813d1f0 2023-09-30T22:32:30.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.278+0000 7fca8cd27700 1 -- 172.21.15.59:0/616009963 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80012430 con 0x7fca8813d1f0 2023-09-30T22:32:30.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.279+0000 7fca8ff8d700 1 -- 172.21.15.59:0/616009963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca8813d1f0 msgr2=0x7fca8813f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.279+0000 7fca8ff8d700 1 --2- 172.21.15.59:0/616009963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca8813d1f0 0x7fca8813f5d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fca80009dc0 tx=0x7fca8000b330 comp rx=0 tx=0).stop 2023-09-30T22:32:30.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.279+0000 7fca8ff8d700 1 -- 172.21.15.59:0/616009963 shutdown_connections 2023-09-30T22:32:30.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.279+0000 7fca8ff8d700 1 --2- 172.21.15.59:0/616009963 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca8806a770 0x7fca8809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.279+0000 7fca8ff8d700 1 --2- 172.21.15.59:0/616009963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca8813d1f0 0x7fca8813f5d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.279+0000 7fca8ff8d700 1 -- 172.21.15.59:0/616009963 >> 172.21.15.59:0/616009963 conn(0x7fca88066f50 msgr2=0x7fca8809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:30.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.279+0000 7fca8ff8d700 1 -- 172.21.15.59:0/616009963 shutdown_connections 2023-09-30T22:32:30.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.279+0000 7fca8ff8d700 1 -- 172.21.15.59:0/616009963 wait complete. 2023-09-30T22:32:30.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.280+0000 7fca8ff8d700 1 Processor -- start 2023-09-30T22:32:30.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.280+0000 7fca8ff8d700 1 -- start start 2023-09-30T22:32:30.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.280+0000 7fca8ff8d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca8806a770 0x7fca880714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.281+0000 7fca8ff8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca8809dc30 0x7fca8813b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.281+0000 7fca8ff8d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca8813d1f0 0x7fca8813bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:30.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.281+0000 7fca8ff8d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca88135cd0 con 0x7fca8806a770 2023-09-30T22:32:30.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.281+0000 7fca8ff8d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8811e960 con 0x7fca8809dc30 2023-09-30T22:32:30.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.281+0000 7fca8ff8d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca8813f6e0 con 0x7fca8813d1f0 2023-09-30T22:32:30.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.281+0000 7fca8dd29700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca8806a770 0x7fca880714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.281+0000 7fca8dd29700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca8806a770 0x7fca880714f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52156/0 (socket says 172.21.15.59:52156) 2023-09-30T22:32:30.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.281+0000 7fca8dd29700 1 -- 172.21.15.59:0/2697898652 learned_addr learned my addr 172.21.15.59:0/2697898652 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:30.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.281+0000 7fca8e52a700 1 --2- 172.21.15.59:0/2697898652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca8813d1f0 0x7fca8813bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.281+0000 7fca8d528700 1 --2- 172.21.15.59:0/2697898652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca8809dc30 0x7fca8813b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:30.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.281+0000 7fca8dd29700 1 -- 172.21.15.59:0/2697898652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca8813d1f0 msgr2=0x7fca8813bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.281+0000 7fca8dd29700 1 --2- 172.21.15.59:0/2697898652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca8813d1f0 0x7fca8813bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.281+0000 7fca8dd29700 1 -- 172.21.15.59:0/2697898652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca8809dc30 msgr2=0x7fca8813b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.281+0000 7fca8dd29700 1 --2- 172.21.15.59:0/2697898652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca8809dc30 0x7fca8813b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.281+0000 7fca8dd29700 1 -- 172.21.15.59:0/2697898652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca80009a70 con 0x7fca8806a770 2023-09-30T22:32:30.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.282+0000 7fca8dd29700 1 --2- 172.21.15.59:0/2697898652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca8806a770 0x7fca880714f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fca8400e810 tx=0x7fca8400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:30.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.282+0000 7fca7e7fc700 1 -- 172.21.15.59:0/2697898652 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8400c070 con 0x7fca8806a770 2023-09-30T22:32:30.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.282+0000 7fca7e7fc700 1 -- 172.21.15.59:0/2697898652 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca84013610 con 0x7fca8806a770 2023-09-30T22:32:30.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.282+0000 7fca8ff8d700 1 -- 172.21.15.59:0/2697898652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8813cc70 con 0x7fca8806a770 2023-09-30T22:32:30.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.282+0000 7fca8ff8d700 1 -- 172.21.15.59:0/2697898652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8811e240 con 0x7fca8806a770 2023-09-30T22:32:30.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.282+0000 7fca7e7fc700 1 -- 172.21.15.59:0/2697898652 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca840139a0 con 0x7fca8806a770 2023-09-30T22:32:30.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.283+0000 7fca8ff8d700 1 -- 172.21.15.59:0/2697898652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca700052e0 con 0x7fca8806a770 2023-09-30T22:32:30.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.284+0000 7fca7e7fc700 1 -- 172.21.15.59:0/2697898652 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca84013b00 con 0x7fca8806a770 2023-09-30T22:32:30.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.284+0000 7fca7e7fc700 1 -- 172.21.15.59:0/2697898652 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fca8403f9c0 con 0x7fca8806a770 2023-09-30T22:32:30.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.293+0000 7fca7e7fc700 1 -- 172.21.15.59:0/2697898652 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca84013e00 con 0x7fca8806a770 2023-09-30T22:32:30.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.376+0000 7fc7e5744700 1 -- 172.21.15.59:0/2494982438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc7e0125a40 con 0x7fc7e009e000 2023-09-30T22:32:30.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.377+0000 7fc7c77fe700 1 -- 172.21.15.59:0/2494982438 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7d4029020 con 0x7fc7e009e000 2023-09-30T22:32:30.378 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:30.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.380+0000 7fc7e5744700 1 -- 172.21.15.59:0/2494982438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e009e000 msgr2=0x7fc7e0122870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.380+0000 7fc7e5744700 1 --2- 172.21.15.59:0/2494982438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e009e000 0x7fc7e0122870 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4016000 tx=0x7fc7d4004750 comp rx=0 tx=0).stop 2023-09-30T22:32:30.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.380+0000 7fc7e5744700 1 -- 172.21.15.59:0/2494982438 shutdown_connections 2023-09-30T22:32:30.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.380+0000 7fc7e5744700 1 --2- 172.21.15.59:0/2494982438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e009e410 0x7fc7e0122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.380+0000 7fc7e5744700 1 --2- 172.21.15.59:0/2494982438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e009d6f0 0x7fc7e0122330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.380+0000 7fc7e5744700 1 --2- 172.21.15.59:0/2494982438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e009e000 0x7fc7e0122870 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.380+0000 7fc7e5744700 1 -- 172.21.15.59:0/2494982438 >> 172.21.15.59:0/2494982438 conn(0x7fc7e0066f50 msgr2=0x7fc7e0133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:30.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.380+0000 7fc7e5744700 1 -- 172.21.15.59:0/2494982438 shutdown_connections 2023-09-30T22:32:30.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.380+0000 7fc7e5744700 1 -- 172.21.15.59:0/2494982438 wait complete. 2023-09-30T22:32:30.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:30.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.425+0000 7f9f7b291700 1 -- 172.21.15.59:0/3656299673 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9f74072210 con 0x7f9f7406ffb0 2023-09-30T22:32:30.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.425+0000 7f9f69ffb700 1 -- 172.21.15.59:0/3656299673 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f64017070 con 0x7f9f7406ffb0 2023-09-30T22:32:30.427 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:30.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.429+0000 7f9f7b291700 1 -- 172.21.15.59:0/3656299673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f7406ffb0 msgr2=0x7f9f7413a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.429+0000 7f9f7b291700 1 --2- 172.21.15.59:0/3656299673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f7406ffb0 0x7f9f7413a160 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400e840 tx=0x7f9f6400eb50 comp rx=0 tx=0).stop 2023-09-30T22:32:30.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.429+0000 7f9f7b291700 1 -- 172.21.15.59:0/3656299673 shutdown_connections 2023-09-30T22:32:30.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.429+0000 7f9f7b291700 1 --2- 172.21.15.59:0/3656299673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f74138070 0x7f9f7413a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.429+0000 7f9f7b291700 1 --2- 172.21.15.59:0/3656299673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f7406f640 0x7f9f74139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.429+0000 7f9f7b291700 1 --2- 172.21.15.59:0/3656299673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f7406ffb0 0x7f9f7413a160 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.429+0000 7f9f7b291700 1 -- 172.21.15.59:0/3656299673 >> 172.21.15.59:0/3656299673 conn(0x7f9f740a2aa0 msgr2=0x7f9f7406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:30.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.429+0000 7f9f7b291700 1 -- 172.21.15.59:0/3656299673 shutdown_connections 2023-09-30T22:32:30.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.429+0000 7f9f7b291700 1 -- 172.21.15.59:0/3656299673 wait complete. 2023-09-30T22:32:30.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:30.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.461+0000 7f7353ec0700 1 -- 172.21.15.59:0/1136762743 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f734c074ea0 con 0x7f734c09d6f0 2023-09-30T22:32:30.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.461+0000 7f73427fc700 1 -- 172.21.15.59:0/1136762743 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7348023790 con 0x7f734c09d6f0 2023-09-30T22:32:30.463 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:30.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.464+0000 7f7353ec0700 1 -- 172.21.15.59:0/1136762743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f734c09d6f0 msgr2=0x7f734c1a5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.464+0000 7f7353ec0700 1 --2- 172.21.15.59:0/1136762743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f734c09d6f0 0x7f734c1a5f60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7348009870 tx=0x7f7348004750 comp rx=0 tx=0).stop 2023-09-30T22:32:30.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.464+0000 7f7353ec0700 1 -- 172.21.15.59:0/1136762743 shutdown_connections 2023-09-30T22:32:30.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.464+0000 7f7353ec0700 1 --2- 172.21.15.59:0/1136762743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f734c09d6f0 0x7f734c1a5f60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.464+0000 7f7353ec0700 1 --2- 172.21.15.59:0/1136762743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f734c09e410 0x7f734c1a69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.464+0000 7f7353ec0700 1 --2- 172.21.15.59:0/1136762743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f734c09e000 0x7f734c1a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.464+0000 7f7353ec0700 1 -- 172.21.15.59:0/1136762743 >> 172.21.15.59:0/1136762743 conn(0x7f734c066f50 msgr2=0x7f734c1baed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:30.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.464+0000 7f7353ec0700 1 -- 172.21.15.59:0/1136762743 shutdown_connections 2023-09-30T22:32:30.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.464+0000 7f7353ec0700 1 -- 172.21.15.59:0/1136762743 wait complete. 2023-09-30T22:32:30.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.511+0000 7fca8ff8d700 1 -- 172.21.15.59:0/2697898652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fca70005860 con 0x7fca8806a770 2023-09-30T22:32:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.511+0000 7fca7e7fc700 1 -- 172.21.15.59:0/2697898652 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca8402a030 con 0x7fca8806a770 2023-09-30T22:32:30.512 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:30.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.513+0000 7fca8ff8d700 1 -- 172.21.15.59:0/2697898652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca8806a770 msgr2=0x7fca880714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:30.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.513+0000 7fca8ff8d700 1 --2- 172.21.15.59:0/2697898652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca8806a770 0x7fca880714f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fca8400e810 tx=0x7fca8400eb20 comp rx=0 tx=0).stop 2023-09-30T22:32:30.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.513+0000 7fca8ff8d700 1 -- 172.21.15.59:0/2697898652 shutdown_connections 2023-09-30T22:32:30.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.513+0000 7fca8ff8d700 1 --2- 172.21.15.59:0/2697898652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca8813d1f0 0x7fca8813bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.513+0000 7fca8ff8d700 1 --2- 172.21.15.59:0/2697898652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca8806a770 0x7fca880714f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.513+0000 7fca8ff8d700 1 --2- 172.21.15.59:0/2697898652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca8809dc30 0x7fca8813b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:30.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.513+0000 7fca8ff8d700 1 -- 172.21.15.59:0/2697898652 >> 172.21.15.59:0/2697898652 conn(0x7fca88066f50 msgr2=0x7fca8813ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:30.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.513+0000 7fca8ff8d700 1 -- 172.21.15.59:0/2697898652 shutdown_connections 2023-09-30T22:32:30.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:30.513+0000 7fca8ff8d700 1 -- 172.21.15.59:0/2697898652 wait complete. 2023-09-30T22:32:30.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:31.401 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:31.450 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:31.480 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:31.529 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:31.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.557+0000 7f51080b7700 1 Processor -- start 2023-09-30T22:32:31.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.558+0000 7f51080b7700 1 -- start start 2023-09-30T22:32:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f51080b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51001338a0 0x7f5100133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f51080b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510009de50 0x7f510009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f51080b7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f510009e760 0x7f510013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f51080b7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510006fef0 con 0x7f510009e760 2023-09-30T22:32:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f51080b7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510006ef30 con 0x7f51001338a0 2023-09-30T22:32:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f51080b7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51001334b0 con 0x7f510009de50 2023-09-30T22:32:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f5106654700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f510009e760 0x7f510013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f5105652700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510009de50 0x7f510009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f5105e53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51001338a0 0x7f5100133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f5106654700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f510009e760 0x7f510013a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52166/0 (socket says 172.21.15.59:52166) 2023-09-30T22:32:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f5105e53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51001338a0 0x7f5100133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41500/0 (socket says 172.21.15.59:41500) 2023-09-30T22:32:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f5106654700 1 -- 172.21.15.59:0/2523642128 learned_addr learned my addr 172.21.15.59:0/2523642128 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f5105652700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510009de50 0x7f510009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53128/0 (socket says 172.21.15.59:53128) 2023-09-30T22:32:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f5105652700 1 -- 172.21.15.59:0/2523642128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51001338a0 msgr2=0x7f5100133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f5105652700 1 --2- 172.21.15.59:0/2523642128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51001338a0 0x7f5100133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f5105652700 1 -- 172.21.15.59:0/2523642128 >> v2:172.21.15.59:3300/0 conn(0x7f510009e760 msgr2=0x7f510013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f5105652700 1 --2- 172.21.15.59:0/2523642128 >> v2:172.21.15.59:3300/0 conn(0x7f510009e760 0x7f510013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f5105652700 1 -- 172.21.15.59:0/2523642128 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510006fc30 con 0x7f510009de50 2023-09-30T22:32:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.559+0000 7f5106654700 1 --2- 172.21.15.59:0/2523642128 >> v2:172.21.15.59:3300/0 conn(0x7f510009e760 0x7f510013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.560+0000 7f5105652700 1 --2- 172.21.15.59:0/2523642128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510009de50 0x7f510009e220 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009870 tx=0x7f50f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9db105502ae62811 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.560+0000 7f5104e51700 1 -- 172.21.15.59:0/2523642128 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f0011830 con 0x7f510009de50 2023-09-30T22:32:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.560+0000 7f5104e51700 1 -- 172.21.15.59:0/2523642128 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f0011990 con 0x7f510009de50 2023-09-30T22:32:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.560+0000 7f5104e51700 1 -- 172.21.15.59:0/2523642128 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f0011d20 con 0x7f510009de50 2023-09-30T22:32:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.561+0000 7f51080b7700 1 -- 172.21.15.59:0/2523642128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510009de50 msgr2=0x7f510009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.561+0000 7f51080b7700 1 --2- 172.21.15.59:0/2523642128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510009de50 0x7f510009e220 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009870 tx=0x7f50f0009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.561+0000 7f51080b7700 1 -- 172.21.15.59:0/2523642128 shutdown_connections 2023-09-30T22:32:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.561+0000 7f51080b7700 1 --2- 172.21.15.59:0/2523642128 >> v2:172.21.15.59:3300/0 conn(0x7f510009e760 0x7f510013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.561+0000 7f51080b7700 1 --2- 172.21.15.59:0/2523642128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51001338a0 0x7f5100133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.561+0000 7f51080b7700 1 --2- 172.21.15.59:0/2523642128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510009de50 0x7f510009e220 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.561+0000 7f51080b7700 1 -- 172.21.15.59:0/2523642128 >> 172.21.15.59:0/2523642128 conn(0x7f51000a2aa0 msgr2=0x7f51000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:31.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.561+0000 7f51080b7700 1 -- 172.21.15.59:0/2523642128 shutdown_connections 2023-09-30T22:32:31.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.561+0000 7f51080b7700 1 -- 172.21.15.59:0/2523642128 wait complete. 2023-09-30T22:32:31.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.563+0000 7f51080b7700 1 Processor -- start 2023-09-30T22:32:31.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.563+0000 7f51080b7700 1 -- start start 2023-09-30T22:32:31.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.563+0000 7f51080b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510009de50 0x7f5100123230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.563+0000 7f51080b7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f510009e760 0x7f5100123770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.563+0000 7f51080b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51001338a0 0x7f51001cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.563+0000 7f51080b7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510006f6b0 con 0x7f510009e760 2023-09-30T22:32:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.563+0000 7f51080b7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5100125d70 con 0x7f510009de50 2023-09-30T22:32:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.563+0000 7f51080b7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5100126030 con 0x7f51001338a0 2023-09-30T22:32:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.564+0000 7f5106654700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51001338a0 0x7f51001cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.564+0000 7f5106654700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51001338a0 0x7f51001cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53134/0 (socket says 172.21.15.59:53134) 2023-09-30T22:32:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.564+0000 7f5106654700 1 -- 172.21.15.59:0/1500591471 learned_addr learned my addr 172.21.15.59:0/1500591471 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.564+0000 7f5105e53700 1 --2- 172.21.15.59:0/1500591471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510009de50 0x7f5100123230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.564+0000 7f5105652700 1 --2- 172.21.15.59:0/1500591471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f510009e760 0x7f5100123770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.564+0000 7f5106654700 1 -- 172.21.15.59:0/1500591471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510009de50 msgr2=0x7f5100123230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.564+0000 7f5106654700 1 --2- 172.21.15.59:0/1500591471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510009de50 0x7f5100123230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.564+0000 7f5106654700 1 -- 172.21.15.59:0/1500591471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f510009e760 msgr2=0x7f5100123770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.564+0000 7f5106654700 1 --2- 172.21.15.59:0/1500591471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f510009e760 0x7f5100123770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.564+0000 7f5106654700 1 -- 172.21.15.59:0/1500591471 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f8009b30 con 0x7f51001338a0 2023-09-30T22:32:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.564+0000 7f5106654700 1 --2- 172.21.15.59:0/1500591471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51001338a0 0x7f51001cc720 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f50f800efc0 tx=0x7f50f800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.565+0000 7f50f67fc700 1 -- 172.21.15.59:0/1500591471 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8018070 con 0x7f51001338a0 2023-09-30T22:32:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.565+0000 7f50f67fc700 1 -- 172.21.15.59:0/1500591471 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f800f040 con 0x7f51001338a0 2023-09-30T22:32:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.565+0000 7f51080b7700 1 -- 172.21.15.59:0/1500591471 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f00094a0 con 0x7f51001338a0 2023-09-30T22:32:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.565+0000 7f50f67fc700 1 -- 172.21.15.59:0/1500591471 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8003c20 con 0x7f51001338a0 2023-09-30T22:32:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.565+0000 7f51080b7700 1 -- 172.21.15.59:0/1500591471 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5100123cb0 con 0x7f51001338a0 2023-09-30T22:32:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.566+0000 7f51080b7700 1 -- 172.21.15.59:0/1500591471 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5100124490 con 0x7f51001338a0 2023-09-30T22:32:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.567+0000 7f50f67fc700 1 -- 172.21.15.59:0/1500591471 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50f800c930 con 0x7f51001338a0 2023-09-30T22:32:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.568+0000 7f50f67fc700 1 -- 172.21.15.59:0/1500591471 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f50f8040730 con 0x7f51001338a0 2023-09-30T22:32:31.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.573+0000 7f50f67fc700 1 -- 172.21.15.59:0/1500591471 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50f800cbe0 con 0x7f51001338a0 2023-09-30T22:32:31.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.599+0000 7f956f92c700 1 Processor -- start 2023-09-30T22:32:31.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.599+0000 7f956f92c700 1 -- start start 2023-09-30T22:32:31.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.600+0000 7f956f92c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9568130540 0x7f9568130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.600+0000 7f956f92c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f956806fcf0 0x7f9568138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.600+0000 7f956f92c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95680716a0 con 0x7f9568130e50 2023-09-30T22:32:31.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.600+0000 7f956f92c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f956809a390 con 0x7f9568130540 2023-09-30T22:32:31.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.600+0000 7f956f92c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9568071290 con 0x7f956806fcf0 2023-09-30T22:32:31.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.600+0000 7f956d6c8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9568130540 0x7f9568130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.600+0000 7f956d6c8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9568130540 0x7f9568130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52188/0 (socket says 172.21.15.59:52188) 2023-09-30T22:32:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.600+0000 7f956d6c8700 1 -- 172.21.15.59:0/2145004992 learned_addr learned my addr 172.21.15.59:0/2145004992 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.600+0000 7f956dec9700 1 --2- 172.21.15.59:0/2145004992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f956806fcf0 0x7f9568138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.601+0000 7f956d6c8700 1 -- 172.21.15.59:0/2145004992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f956806fcf0 msgr2=0x7f9568138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.601+0000 7f956d6c8700 1 --2- 172.21.15.59:0/2145004992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f956806fcf0 0x7f9568138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.601+0000 7f956d6c8700 1 -- 172.21.15.59:0/2145004992 >> v1:172.21.15.59:6789/0 conn(0x7f9568130e50 legacy=0x7f956806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.601+0000 7f956d6c8700 1 -- 172.21.15.59:0/2145004992 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9568130340 con 0x7f9568130540 2023-09-30T22:32:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.601+0000 7f956dec9700 1 --2- 172.21.15.59:0/2145004992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f956806fcf0 0x7f9568138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.601+0000 7f956d6c8700 1 --2- 172.21.15.59:0/2145004992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9568130540 0x7f9568130910 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f956400bb90 tx=0x7f956400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2fb8bee758e797 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:31.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.601+0000 7f955ffff700 1 -- 172.21.15.59:0/2145004992 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956400dd30 con 0x7f9568130540 2023-09-30T22:32:31.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.601+0000 7f955ffff700 1 -- 172.21.15.59:0/2145004992 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956400de90 con 0x7f9568130540 2023-09-30T22:32:31.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.601+0000 7f955ffff700 1 -- 172.21.15.59:0/2145004992 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564010690 con 0x7f9568130540 2023-09-30T22:32:31.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.602+0000 7f956f92c700 1 -- 172.21.15.59:0/2145004992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9568130540 msgr2=0x7f9568130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.602+0000 7f956f92c700 1 --2- 172.21.15.59:0/2145004992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9568130540 0x7f9568130910 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f956400bb90 tx=0x7f956400bea0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.602+0000 7f956f92c700 1 -- 172.21.15.59:0/2145004992 shutdown_connections 2023-09-30T22:32:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.602+0000 7f956f92c700 1 --2- 172.21.15.59:0/2145004992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9568130540 0x7f9568130910 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.602+0000 7f956f92c700 1 --2- 172.21.15.59:0/2145004992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f956806fcf0 0x7f9568138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.602+0000 7f956f92c700 1 -- 172.21.15.59:0/2145004992 >> 172.21.15.59:0/2145004992 conn(0x7f95680a2aa0 msgr2=0x7f95680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.602+0000 7f956f92c700 1 -- 172.21.15.59:0/2145004992 shutdown_connections 2023-09-30T22:32:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.602+0000 7f956f92c700 1 -- 172.21.15.59:0/2145004992 wait complete. 2023-09-30T22:32:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.603+0000 7f956f92c700 1 Processor -- start 2023-09-30T22:32:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.603+0000 7f956f92c700 1 -- start start 2023-09-30T22:32:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.604+0000 7f956f92c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f956806fcf0 0x7f956811ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.604+0000 7f956f92c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9568130540 0x7f956811f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.604+0000 7f956f92c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9568130e50 0x7f956811f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.604+0000 7f956f92c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9568120410 con 0x7f9568130540 2023-09-30T22:32:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.604+0000 7f956f92c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95681229d0 con 0x7f956806fcf0 2023-09-30T22:32:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.604+0000 7f956f92c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f956812c980 con 0x7f9568130e50 2023-09-30T22:32:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.604+0000 7f956cec7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9568130540 0x7f956811f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.604+0000 7f956dec9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9568130e50 0x7f956811f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.604+0000 7f956cec7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9568130540 0x7f956811f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52204/0 (socket says 172.21.15.59:52204) 2023-09-30T22:32:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.604+0000 7f956cec7700 1 -- 172.21.15.59:0/1719871153 learned_addr learned my addr 172.21.15.59:0/1719871153 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.604+0000 7f956d6c8700 1 --2- 172.21.15.59:0/1719871153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f956806fcf0 0x7f956811ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.604+0000 7f956dec9700 1 -- 172.21.15.59:0/1719871153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f956806fcf0 msgr2=0x7f956811ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.605+0000 7f956dec9700 1 --2- 172.21.15.59:0/1719871153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f956806fcf0 0x7f956811ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.605+0000 7f956dec9700 1 -- 172.21.15.59:0/1719871153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9568130540 msgr2=0x7f956811f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.605+0000 7f956dec9700 1 --2- 172.21.15.59:0/1719871153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9568130540 0x7f956811f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.605+0000 7f956dec9700 1 -- 172.21.15.59:0/1719871153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9560009a70 con 0x7f9568130e50 2023-09-30T22:32:31.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.605+0000 7f956dec9700 1 --2- 172.21.15.59:0/1719871153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9568130e50 0x7f956811f9c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f956000efc0 tx=0x7f956000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:31.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.605+0000 7f955dffb700 1 -- 172.21.15.59:0/1719871153 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956000ca90 con 0x7f9568130e50 2023-09-30T22:32:31.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.605+0000 7f955dffb700 1 -- 172.21.15.59:0/1719871153 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956000f040 con 0x7f9568130e50 2023-09-30T22:32:31.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.605+0000 7f955dffb700 1 -- 172.21.15.59:0/1719871153 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956000ce30 con 0x7f9568130e50 2023-09-30T22:32:31.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.605+0000 7f956f92c700 1 -- 172.21.15.59:0/1719871153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956400b7f0 con 0x7f9568130e50 2023-09-30T22:32:31.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.605+0000 7f956f92c700 1 -- 172.21.15.59:0/1719871153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9568120bc0 con 0x7f9568130e50 2023-09-30T22:32:31.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.607+0000 7f956f92c700 1 -- 172.21.15.59:0/1719871153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95680718e0 con 0x7f9568130e50 2023-09-30T22:32:31.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.607+0000 7f955dffb700 1 -- 172.21.15.59:0/1719871153 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9560003a20 con 0x7f9568130e50 2023-09-30T22:32:31.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.608+0000 7f955dffb700 1 -- 172.21.15.59:0/1719871153 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9560040560 con 0x7f9568130e50 2023-09-30T22:32:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.616+0000 7f955dffb700 1 -- 172.21.15.59:0/1719871153 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f956001c3b0 con 0x7f9568130e50 2023-09-30T22:32:31.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.653+0000 7fe07e2b9700 1 Processor -- start 2023-09-30T22:32:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.653+0000 7fe07e2b9700 1 -- start start 2023-09-30T22:32:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.653+0000 7fe07e2b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe07809e930 0x7fe07809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.653+0000 7fe07e2b9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe07809f240 0x7fe0781317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.653+0000 7fe07e2b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07809f650 0x7fe078131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.653+0000 7fe07e2b9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe078070940 con 0x7fe07809f240 2023-09-30T22:32:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.653+0000 7fe07e2b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07806fd60 con 0x7fe07809e930 2023-09-30T22:32:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.653+0000 7fe07e2b9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe07806fa80 con 0x7fe07809f650 2023-09-30T22:32:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.654+0000 7fe0777fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe07809f240 0x7fe0781317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.654+0000 7fe07c856700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07809f650 0x7fe078131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.654+0000 7fe0777fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe07809f240 0x7fe0781317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52218/0 (socket says 172.21.15.59:52218) 2023-09-30T22:32:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.654+0000 7fe0777fe700 1 -- 172.21.15.59:0/2090420042 learned_addr learned my addr 172.21.15.59:0/2090420042 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.654+0000 7fe0777fe700 1 -- 172.21.15.59:0/2090420042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07809f650 msgr2=0x7fe078131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.654+0000 7fe0777fe700 1 --2- 172.21.15.59:0/2090420042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07809f650 0x7fe078131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.654+0000 7fe0777fe700 1 -- 172.21.15.59:0/2090420042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe07809e930 msgr2=0x7fe07809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.654+0000 7fe0777fe700 1 --2- 172.21.15.59:0/2090420042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe07809e930 0x7fe07809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.654+0000 7fe0777fe700 1 -- 172.21.15.59:0/2090420042 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07809fb60 con 0x7fe07809f240 2023-09-30T22:32:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.654+0000 7fe07c856700 1 --2- 172.21.15.59:0/2090420042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07809f650 0x7fe078131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.654+0000 7fe0777fe700 1 --2- 172.21.15.59:0/2090420042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07809f240 0x7fe0781317f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0098f0 tx=0x7fe06c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8ef2fcbdad363f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.654+0000 7fe076ffd700 1 -- 172.21.15.59:0/2090420042 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c011830 con 0x7fe07809f240 2023-09-30T22:32:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.655+0000 7fe076ffd700 1 -- 172.21.15.59:0/2090420042 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c011990 con 0x7fe07809f240 2023-09-30T22:32:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.655+0000 7fe076ffd700 1 -- 172.21.15.59:0/2090420042 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c011d20 con 0x7fe07809f240 2023-09-30T22:32:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.655+0000 7fe07e2b9700 1 -- 172.21.15.59:0/2090420042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07809f240 msgr2=0x7fe0781317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.655+0000 7fe07e2b9700 1 --2- 172.21.15.59:0/2090420042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07809f240 0x7fe0781317f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0098f0 tx=0x7fe06c009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.655+0000 7fe07e2b9700 1 -- 172.21.15.59:0/2090420042 shutdown_connections 2023-09-30T22:32:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.655+0000 7fe07e2b9700 1 --2- 172.21.15.59:0/2090420042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07809f650 0x7fe078131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.655+0000 7fe07e2b9700 1 --2- 172.21.15.59:0/2090420042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe07809e930 0x7fe07809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.655+0000 7fe07e2b9700 1 --2- 172.21.15.59:0/2090420042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07809f240 0x7fe0781317f0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.655+0000 7fe07e2b9700 1 -- 172.21.15.59:0/2090420042 >> 172.21.15.59:0/2090420042 conn(0x7fe0780a4210 msgr2=0x7fe0780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.655+0000 7fe07e2b9700 1 -- 172.21.15.59:0/2090420042 shutdown_connections 2023-09-30T22:32:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.655+0000 7fe07e2b9700 1 -- 172.21.15.59:0/2090420042 wait complete. 2023-09-30T22:32:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.656+0000 7fe07e2b9700 1 Processor -- start 2023-09-30T22:32:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.657+0000 7fe07e2b9700 1 -- start start 2023-09-30T22:32:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.657+0000 7fe07e2b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07809e930 0x7fe0781a6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.657+0000 7fe07e2b9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07809f240 0x7fe0781a6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.657+0000 7fe07e2b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe07809f650 0x7fe0781a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.657+0000 7fe07e2b9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe078071d90 con 0x7fe07809f240 2023-09-30T22:32:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.657+0000 7fe07e2b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780a3870 con 0x7fe07809f650 2023-09-30T22:32:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.657+0000 7fe07e2b9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0781a8780 con 0x7fe07809e930 2023-09-30T22:32:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.657+0000 7fe0777fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07809f240 0x7fe0781a6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.657+0000 7fe077fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07809e930 0x7fe0781a6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.657+0000 7fe0777fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07809f240 0x7fe0781a6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52232/0 (socket says 172.21.15.59:52232) 2023-09-30T22:32:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.657+0000 7fe0777fe700 1 -- 172.21.15.59:0/1674801852 learned_addr learned my addr 172.21.15.59:0/1674801852 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.657+0000 7fe07c856700 1 --2- 172.21.15.59:0/1674801852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe07809f650 0x7fe0781a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.658+0000 7fe07c856700 1 -- 172.21.15.59:0/1674801852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07809e930 msgr2=0x7fe0781a6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.658+0000 7fe07c856700 1 --2- 172.21.15.59:0/1674801852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07809e930 0x7fe0781a6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.658+0000 7fe07c856700 1 -- 172.21.15.59:0/1674801852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07809f240 msgr2=0x7fe0781a6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.658+0000 7fe07c856700 1 --2- 172.21.15.59:0/1674801852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07809f240 0x7fe0781a6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.658+0000 7fe07c856700 1 -- 172.21.15.59:0/1674801852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe070009a70 con 0x7fe07809f650 2023-09-30T22:32:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.658+0000 7fe07c856700 1 --2- 172.21.15.59:0/1674801852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe07809f650 0x7fe0781a6dd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe07000ef90 tx=0x7fe07000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.658+0000 7fe074ff9700 1 -- 172.21.15.59:0/1674801852 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07000cc90 con 0x7fe07809f650 2023-09-30T22:32:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.658+0000 7fe074ff9700 1 -- 172.21.15.59:0/1674801852 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07000f040 con 0x7fe07809f650 2023-09-30T22:32:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.658+0000 7fe074ff9700 1 -- 172.21.15.59:0/1674801852 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0700146c0 con 0x7fe07809f650 2023-09-30T22:32:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.658+0000 7fe07e2b9700 1 -- 172.21.15.59:0/1674801852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe06c009550 con 0x7fe07809f650 2023-09-30T22:32:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.658+0000 7fe07e2b9700 1 -- 172.21.15.59:0/1674801852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0780a0190 con 0x7fe07809f650 2023-09-30T22:32:31.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.659+0000 7fe074ff9700 1 -- 172.21.15.59:0/1674801852 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe070014820 con 0x7fe07809f650 2023-09-30T22:32:31.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.660+0000 7fe074ff9700 1 -- 172.21.15.59:0/1674801852 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe0700402e0 con 0x7fe07809f650 2023-09-30T22:32:31.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.660+0000 7fe07e2b9700 1 -- 172.21.15.59:0/1674801852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07809da60 con 0x7fe07809f650 2023-09-30T22:32:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.665+0000 7fe074ff9700 1 -- 172.21.15.59:0/1674801852 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe070007920 con 0x7fe07809f650 2023-09-30T22:32:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.690+0000 7f814ae15700 1 Processor -- start 2023-09-30T22:32:31.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.690+0000 7f814ae15700 1 -- start start 2023-09-30T22:32:31.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.691+0000 7f814ae15700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814409d6f0 0x7f814409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.691+0000 7f814ae15700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814409e000 0x7f8144130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.691+0000 7f814ae15700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f814409e410 0x7f8144130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.691+0000 7f814ae15700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814409f520 con 0x7f814409e410 2023-09-30T22:32:31.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.691+0000 7f814ae15700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814409f130 con 0x7f814409d6f0 2023-09-30T22:32:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.691+0000 7f814ae15700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f814409e930 con 0x7f814409e000 2023-09-30T22:32:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.691+0000 7f8143fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814409e000 0x7f8144130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.691+0000 7f8143fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814409e000 0x7f8144130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53170/0 (socket says 172.21.15.59:53170) 2023-09-30T22:32:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.691+0000 7f8143fff700 1 -- 172.21.15.59:0/4027553391 learned_addr learned my addr 172.21.15.59:0/4027553391 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.691+0000 7f81493b2700 1 --2- 172.21.15.59:0/4027553391 >> v2:172.21.15.59:3300/0 conn(0x7f814409e410 0x7f8144130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.692+0000 7f8148bb1700 1 --2- 172.21.15.59:0/4027553391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814409d6f0 0x7f814409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.692+0000 7f8143fff700 1 -- 172.21.15.59:0/4027553391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814409d6f0 msgr2=0x7f814409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:31.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.692+0000 7f8143fff700 1 --2- 172.21.15.59:0/4027553391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814409d6f0 0x7f814409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.692+0000 7f8143fff700 1 -- 172.21.15.59:0/4027553391 >> v2:172.21.15.59:3300/0 conn(0x7f814409e410 msgr2=0x7f8144130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:31.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.692+0000 7f8143fff700 1 --2- 172.21.15.59:0/4027553391 >> v2:172.21.15.59:3300/0 conn(0x7f814409e410 0x7f8144130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.692+0000 7f8143fff700 1 -- 172.21.15.59:0/4027553391 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814409b2d0 con 0x7f814409e000 2023-09-30T22:32:31.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.692+0000 7f81493b2700 1 --2- 172.21.15.59:0/4027553391 >> v2:172.21.15.59:3300/0 conn(0x7f814409e410 0x7f8144130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:31.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.692+0000 7f8143fff700 1 --2- 172.21.15.59:0/4027553391 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814409e000 0x7f8144130660 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f813000bbc0 tx=0x7f813000bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cef704163a81d524 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:31.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.692+0000 7f81437fe700 1 -- 172.21.15.59:0/4027553391 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813000dcf0 con 0x7f814409e000 2023-09-30T22:32:31.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.692+0000 7f81437fe700 1 -- 172.21.15.59:0/4027553391 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813000de50 con 0x7f814409e000 2023-09-30T22:32:31.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.692+0000 7f81437fe700 1 -- 172.21.15.59:0/4027553391 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130010690 con 0x7f814409e000 2023-09-30T22:32:31.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.693+0000 7f814ae15700 1 -- 172.21.15.59:0/4027553391 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814409e000 msgr2=0x7f8144130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.693+0000 7f814ae15700 1 --2- 172.21.15.59:0/4027553391 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814409e000 0x7f8144130660 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f813000bbc0 tx=0x7f813000bed0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.693+0000 7f814ae15700 1 -- 172.21.15.59:0/4027553391 shutdown_connections 2023-09-30T22:32:31.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.693+0000 7f814ae15700 1 --2- 172.21.15.59:0/4027553391 >> v2:172.21.15.59:3300/0 conn(0x7f814409e410 0x7f8144130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.693+0000 7f814ae15700 1 --2- 172.21.15.59:0/4027553391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814409d6f0 0x7f814409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.693+0000 7f814ae15700 1 --2- 172.21.15.59:0/4027553391 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814409e000 0x7f8144130660 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.693+0000 7f814ae15700 1 -- 172.21.15.59:0/4027553391 >> 172.21.15.59:0/4027553391 conn(0x7f8144066f50 msgr2=0x7f814409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.693+0000 7f814ae15700 1 -- 172.21.15.59:0/4027553391 shutdown_connections 2023-09-30T22:32:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.693+0000 7f814ae15700 1 -- 172.21.15.59:0/4027553391 wait complete. 2023-09-30T22:32:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.694+0000 7f814ae15700 1 Processor -- start 2023-09-30T22:32:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.694+0000 7f814ae15700 1 -- start start 2023-09-30T22:32:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.695+0000 7f814ae15700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814409d6f0 0x7f814411e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.695+0000 7f814ae15700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814409e000 0x7f814411e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.695+0000 7f814ae15700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814409e410 0x7f814411eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.695+0000 7f814ae15700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814411f4f0 con 0x7f814409e000 2023-09-30T22:32:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.695+0000 7f814ae15700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8144121bb0 con 0x7f814409d6f0 2023-09-30T22:32:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.695+0000 7f814ae15700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8144120250 con 0x7f814409e410 2023-09-30T22:32:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.695+0000 7f8148bb1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814409d6f0 0x7f814411e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.695+0000 7f8148bb1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814409d6f0 0x7f814411e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41570/0 (socket says 172.21.15.59:41570) 2023-09-30T22:32:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.695+0000 7f8148bb1700 1 -- 172.21.15.59:0/1282025780 learned_addr learned my addr 172.21.15.59:0/1282025780 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.695+0000 7f81493b2700 1 --2- 172.21.15.59:0/1282025780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814409e410 0x7f814411eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.695+0000 7f8143fff700 1 --2- 172.21.15.59:0/1282025780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814409e000 0x7f814411e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.696+0000 7f8148bb1700 1 -- 172.21.15.59:0/1282025780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814409e410 msgr2=0x7f814411eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.696+0000 7f8148bb1700 1 --2- 172.21.15.59:0/1282025780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814409e410 0x7f814411eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.696+0000 7f8148bb1700 1 -- 172.21.15.59:0/1282025780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814409e000 msgr2=0x7f814411e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.696+0000 7f8148bb1700 1 --2- 172.21.15.59:0/1282025780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814409e000 0x7f814411e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.696+0000 7f8148bb1700 1 -- 172.21.15.59:0/1282025780 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c009a70 con 0x7f814409d6f0 2023-09-30T22:32:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.696+0000 7f8148bb1700 1 --2- 172.21.15.59:0/1282025780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814409d6f0 0x7f814411e090 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f813800e930 tx=0x7f813800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.696+0000 7f81417fa700 1 -- 172.21.15.59:0/1282025780 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813800ee70 con 0x7f814409d6f0 2023-09-30T22:32:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.696+0000 7f81417fa700 1 -- 172.21.15.59:0/1282025780 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813800c850 con 0x7f814409d6f0 2023-09-30T22:32:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.696+0000 7f814ae15700 1 -- 172.21.15.59:0/1282025780 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813000b7f0 con 0x7f814409d6f0 2023-09-30T22:32:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.696+0000 7f81417fa700 1 -- 172.21.15.59:0/1282025780 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813800cbe0 con 0x7f814409d6f0 2023-09-30T22:32:31.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.696+0000 7f814ae15700 1 -- 172.21.15.59:0/1282025780 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81440a3b70 con 0x7f814409d6f0 2023-09-30T22:32:31.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.697+0000 7f81417fa700 1 -- 172.21.15.59:0/1282025780 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f813800cd40 con 0x7f814409d6f0 2023-09-30T22:32:31.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.697+0000 7f814ae15700 1 -- 172.21.15.59:0/1282025780 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8144120f80 con 0x7f814409d6f0 2023-09-30T22:32:31.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.698+0000 7f81417fa700 1 -- 172.21.15.59:0/1282025780 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f813803faf0 con 0x7f814409d6f0 2023-09-30T22:32:31.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.707+0000 7f81417fa700 1 -- 172.21.15.59:0/1282025780 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8138011d90 con 0x7f814409d6f0 2023-09-30T22:32:31.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.800+0000 7f51080b7700 1 -- 172.21.15.59:0/1500591471 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5100074ea0 con 0x7f51001338a0 2023-09-30T22:32:31.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.801+0000 7f50f67fc700 1 -- 172.21.15.59:0/1500591471 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50f802c090 con 0x7f51001338a0 2023-09-30T22:32:31.802 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:31.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.804+0000 7f51080b7700 1 -- 172.21.15.59:0/1500591471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51001338a0 msgr2=0x7f51001cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.804+0000 7f51080b7700 1 --2- 172.21.15.59:0/1500591471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51001338a0 0x7f51001cc720 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f50f800efc0 tx=0x7f50f800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.804+0000 7f51080b7700 1 -- 172.21.15.59:0/1500591471 shutdown_connections 2023-09-30T22:32:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.804+0000 7f51080b7700 1 --2- 172.21.15.59:0/1500591471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51001338a0 0x7f51001cc720 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.804+0000 7f51080b7700 1 --2- 172.21.15.59:0/1500591471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510009de50 0x7f5100123230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.804+0000 7f51080b7700 1 --2- 172.21.15.59:0/1500591471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f510009e760 0x7f5100123770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.804+0000 7f51080b7700 1 -- 172.21.15.59:0/1500591471 >> 172.21.15.59:0/1500591471 conn(0x7f51000a2aa0 msgr2=0x7f510009ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.804+0000 7f51080b7700 1 -- 172.21.15.59:0/1500591471 shutdown_connections 2023-09-30T22:32:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.804+0000 7f51080b7700 1 -- 172.21.15.59:0/1500591471 wait complete. 2023-09-30T22:32:31.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:31.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.842+0000 7f956f92c700 1 -- 172.21.15.59:0/1719871153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9568120ba0 con 0x7f9568130e50 2023-09-30T22:32:31.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.843+0000 7f955dffb700 1 -- 172.21.15.59:0/1719871153 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f956002b090 con 0x7f9568130e50 2023-09-30T22:32:31.844 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:31.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.845+0000 7f956f92c700 1 -- 172.21.15.59:0/1719871153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9568130e50 msgr2=0x7f956811f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.845+0000 7f956f92c700 1 --2- 172.21.15.59:0/1719871153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9568130e50 0x7f956811f9c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f956000efc0 tx=0x7f956000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.845+0000 7f956f92c700 1 -- 172.21.15.59:0/1719871153 shutdown_connections 2023-09-30T22:32:31.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.845+0000 7f956f92c700 1 --2- 172.21.15.59:0/1719871153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9568130e50 0x7f956811f9c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.845+0000 7f956f92c700 1 --2- 172.21.15.59:0/1719871153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f956806fcf0 0x7f956811ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.845+0000 7f956f92c700 1 --2- 172.21.15.59:0/1719871153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9568130540 0x7f956811f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.845+0000 7f956f92c700 1 -- 172.21.15.59:0/1719871153 >> 172.21.15.59:0/1719871153 conn(0x7f95680a2aa0 msgr2=0x7f956809a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:31.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.845+0000 7f956f92c700 1 -- 172.21.15.59:0/1719871153 shutdown_connections 2023-09-30T22:32:31.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.845+0000 7f956f92c700 1 -- 172.21.15.59:0/1719871153 wait complete. 2023-09-30T22:32:31.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:31.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.883+0000 7fe07e2b9700 1 -- 172.21.15.59:0/1674801852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe078074ea0 con 0x7fe07809f650 2023-09-30T22:32:31.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.884+0000 7fe074ff9700 1 -- 172.21.15.59:0/1674801852 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe07002c090 con 0x7fe07809f650 2023-09-30T22:32:31.885 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:31.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.886+0000 7fe07e2b9700 1 -- 172.21.15.59:0/1674801852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe07809f650 msgr2=0x7fe0781a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.886+0000 7fe07e2b9700 1 --2- 172.21.15.59:0/1674801852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe07809f650 0x7fe0781a6dd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe07000ef90 tx=0x7fe07000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.886+0000 7fe07e2b9700 1 -- 172.21.15.59:0/1674801852 shutdown_connections 2023-09-30T22:32:31.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.886+0000 7fe07e2b9700 1 --2- 172.21.15.59:0/1674801852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07809e930 0x7fe0781a6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.886+0000 7fe07e2b9700 1 --2- 172.21.15.59:0/1674801852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe07809f650 0x7fe0781a6dd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.886+0000 7fe07e2b9700 1 --2- 172.21.15.59:0/1674801852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07809f240 0x7fe0781a6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.886+0000 7fe07e2b9700 1 -- 172.21.15.59:0/1674801852 >> 172.21.15.59:0/1674801852 conn(0x7fe0780a4210 msgr2=0x7fe0781b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:31.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.886+0000 7fe07e2b9700 1 -- 172.21.15.59:0/1674801852 shutdown_connections 2023-09-30T22:32:31.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.886+0000 7fe07e2b9700 1 -- 172.21.15.59:0/1674801852 wait complete. 2023-09-30T22:32:31.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:31.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.915+0000 7f814ae15700 1 -- 172.21.15.59:0/1282025780 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8144121730 con 0x7f814409d6f0 2023-09-30T22:32:31.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.915+0000 7f81417fa700 1 -- 172.21.15.59:0/1282025780 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8144121730 con 0x7f814409d6f0 2023-09-30T22:32:31.916 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:31.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.917+0000 7f814ae15700 1 -- 172.21.15.59:0/1282025780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814409d6f0 msgr2=0x7f814411e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:31.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.917+0000 7f814ae15700 1 --2- 172.21.15.59:0/1282025780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814409d6f0 0x7f814411e090 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f813800e930 tx=0x7f813800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.918+0000 7f814ae15700 1 -- 172.21.15.59:0/1282025780 shutdown_connections 2023-09-30T22:32:31.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.918+0000 7f814ae15700 1 --2- 172.21.15.59:0/1282025780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814409e410 0x7f814411eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.918+0000 7f814ae15700 1 --2- 172.21.15.59:0/1282025780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814409d6f0 0x7f814411e090 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.918+0000 7f814ae15700 1 --2- 172.21.15.59:0/1282025780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814409e000 0x7f814411e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:31.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.918+0000 7f814ae15700 1 -- 172.21.15.59:0/1282025780 >> 172.21.15.59:0/1282025780 conn(0x7f8144066f50 msgr2=0x7f8144130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:31.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.918+0000 7f814ae15700 1 -- 172.21.15.59:0/1282025780 shutdown_connections 2023-09-30T22:32:31.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:31.918+0000 7f814ae15700 1 -- 172.21.15.59:0/1282025780 wait complete. 2023-09-30T22:32:31.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:32.826 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:32.863 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:32.902 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:32.933 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:32.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.985+0000 7f429212d700 1 Processor -- start 2023-09-30T22:32:32.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.985+0000 7f429212d700 1 -- start start 2023-09-30T22:32:32.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.986+0000 7f429212d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c0a0a30 0x7f428c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:32.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.986+0000 7f429212d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c0a1340 0x7f428c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:32.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.986+0000 7f429212d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428c09edd0 con 0x7f428c133fa0 2023-09-30T22:32:32.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.986+0000 7f429212d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c09e1f0 con 0x7f428c0a1340 2023-09-30T22:32:32.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.986+0000 7f429212d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f428c09dc50 con 0x7f428c0a0a30 2023-09-30T22:32:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.986+0000 7f428affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c0a1340 0x7f428c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.986+0000 7f428affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c0a1340 0x7f428c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41578/0 (socket says 172.21.15.59:41578) 2023-09-30T22:32:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.986+0000 7f428b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c0a0a30 0x7f428c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.986+0000 7f428affd700 1 -- 172.21.15.59:0/1013982960 learned_addr learned my addr 172.21.15.59:0/1013982960 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.987+0000 7f428affd700 1 -- 172.21.15.59:0/1013982960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c0a0a30 msgr2=0x7f428c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.987+0000 7f428affd700 1 --2- 172.21.15.59:0/1013982960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c0a0a30 0x7f428c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.987+0000 7f428affd700 1 -- 172.21.15.59:0/1013982960 >> v1:172.21.15.59:6789/0 conn(0x7f428c133fa0 legacy=0x7f428c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.987+0000 7f428affd700 1 -- 172.21.15.59:0/1013982960 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c0a1fe0 con 0x7f428c0a1340 2023-09-30T22:32:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.987+0000 7f428affd700 1 --2- 172.21.15.59:0/1013982960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c0a1340 0x7f428c133a60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4280009920 tx=0x7f4280009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe0a903356dbe01b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.987+0000 7f428a7fc700 1 -- 172.21.15.59:0/1013982960 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280011830 con 0x7f428c0a1340 2023-09-30T22:32:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.987+0000 7f428a7fc700 1 -- 172.21.15.59:0/1013982960 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4280011990 con 0x7f428c0a1340 2023-09-30T22:32:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.987+0000 7f428a7fc700 1 -- 172.21.15.59:0/1013982960 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280011d20 con 0x7f428c0a1340 2023-09-30T22:32:32.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.988+0000 7f429212d700 1 -- 172.21.15.59:0/1013982960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c0a1340 msgr2=0x7f428c133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:32.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.988+0000 7f429212d700 1 --2- 172.21.15.59:0/1013982960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c0a1340 0x7f428c133a60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4280009920 tx=0x7f4280009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:32.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.988+0000 7f429212d700 1 -- 172.21.15.59:0/1013982960 shutdown_connections 2023-09-30T22:32:32.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.988+0000 7f429212d700 1 --2- 172.21.15.59:0/1013982960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c0a0a30 0x7f428c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:32.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.988+0000 7f429212d700 1 --2- 172.21.15.59:0/1013982960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c0a1340 0x7f428c133a60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:32.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.988+0000 7f429212d700 1 -- 172.21.15.59:0/1013982960 >> 172.21.15.59:0/1013982960 conn(0x7f428c0a6550 msgr2=0x7f428c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:32.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.988+0000 7f429212d700 1 -- 172.21.15.59:0/1013982960 shutdown_connections 2023-09-30T22:32:32.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.988+0000 7f429212d700 1 -- 172.21.15.59:0/1013982960 wait complete. 2023-09-30T22:32:32.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.990+0000 7f429212d700 1 Processor -- start 2023-09-30T22:32:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.990+0000 7f429212d700 1 -- start start 2023-09-30T22:32:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.991+0000 7f429212d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c0a0a30 0x7f428c1c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.991+0000 7f429212d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c0a1340 0x7f428c1c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.991+0000 7f429212d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c133fa0 0x7f428c11e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.991+0000 7f429212d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c1205b0 con 0x7f428c0a1340 2023-09-30T22:32:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.991+0000 7f429212d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c1203c0 con 0x7f428c133fa0 2023-09-30T22:32:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.991+0000 7f429212d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f428c1c9320 con 0x7f428c0a0a30 2023-09-30T22:32:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.991+0000 7f428b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c0a0a30 0x7f428c1c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.991+0000 7f428b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c0a0a30 0x7f428c1c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53198/0 (socket says 172.21.15.59:53198) 2023-09-30T22:32:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.991+0000 7f428b7fe700 1 -- 172.21.15.59:0/1120502159 learned_addr learned my addr 172.21.15.59:0/1120502159 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.991+0000 7f428bfff700 1 --2- 172.21.15.59:0/1120502159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c133fa0 0x7f428c11e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:32.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.992+0000 7f428b7fe700 1 -- 172.21.15.59:0/1120502159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c133fa0 msgr2=0x7f428c11e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:32.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.992+0000 7f428b7fe700 1 --2- 172.21.15.59:0/1120502159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c133fa0 0x7f428c11e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:32.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.992+0000 7f428b7fe700 1 -- 172.21.15.59:0/1120502159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c0a1340 msgr2=0x7f428c1c8de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:32:32.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.992+0000 7f428b7fe700 1 --2- 172.21.15.59:0/1120502159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c0a1340 0x7f428c1c8de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:32.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.992+0000 7f428b7fe700 1 -- 172.21.15.59:0/1120502159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4280009550 con 0x7f428c0a0a30 2023-09-30T22:32:32.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.992+0000 7f428bfff700 1 --2- 172.21.15.59:0/1120502159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c133fa0 0x7f428c11e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.992+0000 7f428b7fe700 1 --2- 172.21.15.59:0/1120502159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c0a0a30 0x7f428c1c88a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f427c00e9b0 tx=0x7f427c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.992+0000 7f4273fff700 1 -- 172.21.15.59:0/1120502159 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c009710 con 0x7f428c0a0a30 2023-09-30T22:32:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.992+0000 7f4273fff700 1 -- 172.21.15.59:0/1120502159 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c00c850 con 0x7f428c0a0a30 2023-09-30T22:32:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.992+0000 7f4273fff700 1 -- 172.21.15.59:0/1120502159 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c00cbc0 con 0x7f428c0a0a30 2023-09-30T22:32:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.992+0000 7f429212d700 1 -- 172.21.15.59:0/1120502159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c0a25e0 con 0x7f428c0a0a30 2023-09-30T22:32:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.992+0000 7f429212d700 1 -- 172.21.15.59:0/1120502159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c0a3850 con 0x7f428c0a0a30 2023-09-30T22:32:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.994+0000 7f429212d700 1 -- 172.21.15.59:0/1120502159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c074ea0 con 0x7f428c0a0a30 2023-09-30T22:32:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.995+0000 7f4273fff700 1 -- 172.21.15.59:0/1120502159 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f427c00cd20 con 0x7f428c0a0a30 2023-09-30T22:32:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:32.995+0000 7f4273fff700 1 -- 172.21.15.59:0/1120502159 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f427c03fb90 con 0x7f428c0a0a30 2023-09-30T22:32:33.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.000+0000 7f4273fff700 1 -- 172.21.15.59:0/1120502159 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f427c01b3b0 con 0x7f428c0a0a30 2023-09-30T22:32:33.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.030+0000 7f31fae1b700 1 Processor -- start 2023-09-30T22:32:33.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.030+0000 7f31fae1b700 1 -- start start 2023-09-30T22:32:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.031+0000 7f31fae1b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f41337f0 0x7f31f4138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.031+0000 7f31fae1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f4138dc0 0x7f31f413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.031+0000 7f31fae1b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f406b990 con 0x7f31f4133420 2023-09-30T22:32:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.031+0000 7f31fae1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f409b0e0 con 0x7f31f4138dc0 2023-09-30T22:32:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.031+0000 7f31fae1b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31f4133c20 con 0x7f31f41337f0 2023-09-30T22:32:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.031+0000 7f31f3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f41337f0 0x7f31f4138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.031+0000 7f31f3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f41337f0 0x7f31f4138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53212/0 (socket says 172.21.15.59:53212) 2023-09-30T22:32:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.031+0000 7f31f3fff700 1 -- 172.21.15.59:0/3070752318 learned_addr learned my addr 172.21.15.59:0/3070752318 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.031+0000 7f31f93b8700 1 --2- 172.21.15.59:0/3070752318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f4138dc0 0x7f31f413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.031+0000 7f31f37fe700 1 -- 172.21.15.59:0/3070752318 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486073282 0 0) 0x7f31f406b990 con 0x7f31f4133420 2023-09-30T22:32:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.031+0000 7f31f37fe700 1 -- 172.21.15.59:0/3070752318 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e40035b0 con 0x7f31f4133420 2023-09-30T22:32:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.032+0000 7f31f93b8700 1 -- 172.21.15.59:0/3070752318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f41337f0 msgr2=0x7f31f4138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.032+0000 7f31f93b8700 1 --2- 172.21.15.59:0/3070752318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f41337f0 0x7f31f4138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.032+0000 7f31f93b8700 1 -- 172.21.15.59:0/3070752318 >> v1:172.21.15.59:6789/0 conn(0x7f31f4133420 legacy=0x7f31f4133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.032+0000 7f31f93b8700 1 -- 172.21.15.59:0/3070752318 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f40a0590 con 0x7f31f4138dc0 2023-09-30T22:32:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.032+0000 7f31f93b8700 1 --2- 172.21.15.59:0/3070752318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f4138dc0 0x7f31f413b1a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009dc0 tx=0x7f31ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a99077d571179f56 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.032+0000 7f31f37fe700 1 -- 172.21.15.59:0/3070752318 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec00e070 con 0x7f31f4138dc0 2023-09-30T22:32:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.032+0000 7f31f37fe700 1 -- 172.21.15.59:0/3070752318 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec00bb20 con 0x7f31f4138dc0 2023-09-30T22:32:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.032+0000 7f31f37fe700 1 -- 172.21.15.59:0/3070752318 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec012430 con 0x7f31f4138dc0 2023-09-30T22:32:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.033+0000 7f31fae1b700 1 -- 172.21.15.59:0/3070752318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f4138dc0 msgr2=0x7f31f413b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.033+0000 7f31fae1b700 1 --2- 172.21.15.59:0/3070752318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f4138dc0 0x7f31f413b1a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009dc0 tx=0x7f31ec00b330 comp rx=0 tx=0).stop 2023-09-30T22:32:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.033+0000 7f31fae1b700 1 -- 172.21.15.59:0/3070752318 shutdown_connections 2023-09-30T22:32:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.033+0000 7f31fae1b700 1 --2- 172.21.15.59:0/3070752318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f4138dc0 0x7f31f413b1a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.033+0000 7f31fae1b700 1 --2- 172.21.15.59:0/3070752318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f41337f0 0x7f31f4138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.033+0000 7f31fae1b700 1 -- 172.21.15.59:0/3070752318 >> 172.21.15.59:0/3070752318 conn(0x7f31f40a4210 msgr2=0x7f31f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.033+0000 7f31fae1b700 1 -- 172.21.15.59:0/3070752318 shutdown_connections 2023-09-30T22:32:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.033+0000 7f31fae1b700 1 -- 172.21.15.59:0/3070752318 wait complete. 2023-09-30T22:32:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.035+0000 7f31fae1b700 1 Processor -- start 2023-09-30T22:32:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.035+0000 7f31fae1b700 1 -- start start 2023-09-30T22:32:33.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.036+0000 7f31fae1b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f4133420 0x7f31f40709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:33.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.036+0000 7f31fae1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f4070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:33.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.036+0000 7f31fae1b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 0x7f31f4071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:33.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.036+0000 7f31fae1b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f4072270 con 0x7f31f4133420 2023-09-30T22:32:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.036+0000 7f31fae1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f409ccc0 con 0x7f31f41337f0 2023-09-30T22:32:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.036+0000 7f31fae1b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31f409b430 con 0x7f31f4138dc0 2023-09-30T22:32:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.036+0000 7f31f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f4070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.036+0000 7f31f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f4070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41622/0 (socket says 172.21.15.59:41622) 2023-09-30T22:32:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.036+0000 7f31f3fff700 1 -- 172.21.15.59:0/4102128822 learned_addr learned my addr 172.21.15.59:0/4102128822 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.036+0000 7f31f8bb7700 1 --2- 172.21.15.59:0/4102128822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f4133420 0x7f31f40709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.036+0000 7f31f93b8700 1 --2- 172.21.15.59:0/4102128822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 0x7f31f4071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.037+0000 7f31f3fff700 1 -- 172.21.15.59:0/4102128822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 msgr2=0x7f31f4071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.037+0000 7f31f3fff700 1 --2- 172.21.15.59:0/4102128822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 0x7f31f4071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.037+0000 7f31f3fff700 1 -- 172.21.15.59:0/4102128822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f4133420 msgr2=0x7f31f40709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.037+0000 7f31f3fff700 1 --2- 172.21.15.59:0/4102128822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f4133420 0x7f31f40709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.037+0000 7f31f3fff700 1 -- 172.21.15.59:0/4102128822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec009a70 con 0x7f31f41337f0 2023-09-30T22:32:33.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.037+0000 7f31f3fff700 1 --2- 172.21.15.59:0/4102128822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f4070ee0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f31e000e910 tx=0x7f31e000ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:33.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.037+0000 7f31f17fa700 1 -- 172.21.15.59:0/4102128822 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e00096a0 con 0x7f31f41337f0 2023-09-30T22:32:33.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.037+0000 7f31f17fa700 1 -- 172.21.15.59:0/4102128822 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e000ee60 con 0x7f31f41337f0 2023-09-30T22:32:33.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.037+0000 7f31fae1b700 1 -- 172.21.15.59:0/4102128822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f409c620 con 0x7f31f41337f0 2023-09-30T22:32:33.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.037+0000 7f31f17fa700 1 -- 172.21.15.59:0/4102128822 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e000ca50 con 0x7f31f41337f0 2023-09-30T22:32:33.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.037+0000 7f31fae1b700 1 -- 172.21.15.59:0/4102128822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f409d7a0 con 0x7f31f41337f0 2023-09-30T22:32:33.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.039+0000 7f31fae1b700 1 -- 172.21.15.59:0/4102128822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f4074ea0 con 0x7f31f41337f0 2023-09-30T22:32:33.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.039+0000 7f31f17fa700 1 -- 172.21.15.59:0/4102128822 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31e000cbb0 con 0x7f31f41337f0 2023-09-30T22:32:33.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.039+0000 7f31f17fa700 1 -- 172.21.15.59:0/4102128822 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f31e003fa90 con 0x7f31f41337f0 2023-09-30T22:32:33.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.048+0000 7f31f17fa700 1 -- 172.21.15.59:0/4102128822 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31e001b3b0 con 0x7f31f41337f0 2023-09-30T22:32:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.067+0000 7f78f16e4700 1 Processor -- start 2023-09-30T22:32:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.067+0000 7f78f16e4700 1 -- start start 2023-09-30T22:32:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.068+0000 7f78f16e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78ec09d6f0 0x7f78ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.068+0000 7f78f16e4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78ec09e000 0x7f78ec130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.068+0000 7f78f16e4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec09f130 con 0x7f78ec09e410 2023-09-30T22:32:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.068+0000 7f78f16e4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec09f520 con 0x7f78ec09d6f0 2023-09-30T22:32:33.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.068+0000 7f78f16e4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec09e930 con 0x7f78ec09e000 2023-09-30T22:32:33.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.068+0000 7f78ea7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78ec09e000 0x7f78ec130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:33.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.068+0000 7f78ea7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78ec09e000 0x7f78ec130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53238/0 (socket says 172.21.15.59:53238) 2023-09-30T22:32:33.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.068+0000 7f78ea7fc700 1 -- 172.21.15.59:0/503179372 learned_addr learned my addr 172.21.15.59:0/503179372 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:33.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.068+0000 7f78eaffd700 1 --2- 172.21.15.59:0/503179372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78ec09d6f0 0x7f78ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.068+0000 7f78eb7fe700 1 --1- 172.21.15.59:0/503179372 >> v1:172.21.15.59:6789/0 conn(0x7f78ec09e410 0x7f78ec130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57408/0 (socket says 172.21.15.59:57408) 2023-09-30T22:32:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.069+0000 7f78ea7fc700 1 -- 172.21.15.59:0/503179372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78ec09d6f0 msgr2=0x7f78ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.069+0000 7f78ea7fc700 1 --2- 172.21.15.59:0/503179372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78ec09d6f0 0x7f78ec09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.069+0000 7f78ea7fc700 1 -- 172.21.15.59:0/503179372 >> v1:172.21.15.59:6789/0 conn(0x7f78ec09e410 legacy=0x7f78ec130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.069+0000 7f78ea7fc700 1 -- 172.21.15.59:0/503179372 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec09b2d0 con 0x7f78ec09e000 2023-09-30T22:32:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.069+0000 7f78ea7fc700 1 --2- 172.21.15.59:0/503179372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78ec09e000 0x7f78ec130660 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f78e000bbf0 tx=0x7f78e000bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f842dcb7fb2798 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.069+0000 7f78e9ffb700 1 -- 172.21.15.59:0/503179372 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e000dcf0 con 0x7f78ec09e000 2023-09-30T22:32:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.069+0000 7f78e9ffb700 1 -- 172.21.15.59:0/503179372 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e000de50 con 0x7f78ec09e000 2023-09-30T22:32:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.069+0000 7f78e9ffb700 1 -- 172.21.15.59:0/503179372 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0010690 con 0x7f78ec09e000 2023-09-30T22:32:33.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.070+0000 7f78f16e4700 1 -- 172.21.15.59:0/503179372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78ec09e000 msgr2=0x7f78ec130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.070+0000 7f78f16e4700 1 --2- 172.21.15.59:0/503179372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78ec09e000 0x7f78ec130660 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f78e000bbf0 tx=0x7f78e000bf00 comp rx=0 tx=0).stop 2023-09-30T22:32:33.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.071+0000 7f78f16e4700 1 -- 172.21.15.59:0/503179372 shutdown_connections 2023-09-30T22:32:33.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.071+0000 7f78f16e4700 1 --2- 172.21.15.59:0/503179372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78ec09d6f0 0x7f78ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.071+0000 7f78f16e4700 1 --2- 172.21.15.59:0/503179372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78ec09e000 0x7f78ec130660 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.071+0000 7f78f16e4700 1 -- 172.21.15.59:0/503179372 >> 172.21.15.59:0/503179372 conn(0x7f78ec066f50 msgr2=0x7f78ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.071+0000 7f78f16e4700 1 -- 172.21.15.59:0/503179372 shutdown_connections 2023-09-30T22:32:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.071+0000 7f78f16e4700 1 -- 172.21.15.59:0/503179372 wait complete. 2023-09-30T22:32:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.072+0000 7f78f16e4700 1 Processor -- start 2023-09-30T22:32:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.072+0000 7f78f16e4700 1 -- start start 2023-09-30T22:32:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.073+0000 7f78f16e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec09d6f0 0x7f78ec11e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.073+0000 7f78f16e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78ec09e000 0x7f78ec11e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.073+0000 7f78f16e4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78ec09e410 0x7f78ec11eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.073+0000 7f78f16e4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec1303f0 con 0x7f78ec09d6f0 2023-09-30T22:32:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.073+0000 7f78f16e4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec120240 con 0x7f78ec09e000 2023-09-30T22:32:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.073+0000 7f78f16e4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec120e70 con 0x7f78ec09e410 2023-09-30T22:32:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.073+0000 7f78ea7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78ec09e000 0x7f78ec11e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.073+0000 7f78ea7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78ec09e000 0x7f78ec11e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41626/0 (socket says 172.21.15.59:41626) 2023-09-30T22:32:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.073+0000 7f78ea7fc700 1 -- 172.21.15.59:0/4130641796 learned_addr learned my addr 172.21.15.59:0/4130641796 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.073+0000 7f78eaffd700 1 --2- 172.21.15.59:0/4130641796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec09d6f0 0x7f78ec11e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.073+0000 7f78eb7fe700 1 --2- 172.21.15.59:0/4130641796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78ec09e410 0x7f78ec11eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.074+0000 7f78eaffd700 1 -- 172.21.15.59:0/4130641796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78ec09e410 msgr2=0x7f78ec11eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.074+0000 7f78eaffd700 1 --2- 172.21.15.59:0/4130641796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78ec09e410 0x7f78ec11eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.074+0000 7f78eaffd700 1 -- 172.21.15.59:0/4130641796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78ec09e000 msgr2=0x7f78ec11e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.074+0000 7f78eaffd700 1 --2- 172.21.15.59:0/4130641796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78ec09e000 0x7f78ec11e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.074+0000 7f78eaffd700 1 -- 172.21.15.59:0/4130641796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e000b7f0 con 0x7f78ec09d6f0 2023-09-30T22:32:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.074+0000 7f78ea7fc700 1 --2- 172.21.15.59:0/4130641796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78ec09e000 0x7f78ec11e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.074+0000 7f78eaffd700 1 --2- 172.21.15.59:0/4130641796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec09d6f0 0x7f78ec11e0f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009cd0 tx=0x7f78dc010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.074+0000 7f78d37fe700 1 -- 172.21.15.59:0/4130641796 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc015070 con 0x7f78ec09d6f0 2023-09-30T22:32:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.074+0000 7f78d37fe700 1 -- 172.21.15.59:0/4130641796 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc00b930 con 0x7f78ec09d6f0 2023-09-30T22:32:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.074+0000 7f78d37fe700 1 -- 172.21.15.59:0/4130641796 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc00bcc0 con 0x7f78ec09d6f0 2023-09-30T22:32:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.074+0000 7f78f16e4700 1 -- 172.21.15.59:0/4130641796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec1212c0 con 0x7f78ec09d6f0 2023-09-30T22:32:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.075+0000 7f78f16e4700 1 -- 172.21.15.59:0/4130641796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ec09c700 con 0x7f78ec09d6f0 2023-09-30T22:32:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.075+0000 7f78f16e4700 1 -- 172.21.15.59:0/4130641796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ec074ea0 con 0x7f78ec09d6f0 2023-09-30T22:32:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.076+0000 7f78d37fe700 1 -- 172.21.15.59:0/4130641796 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78dc019410 con 0x7f78ec09d6f0 2023-09-30T22:32:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.077+0000 7f78d37fe700 1 -- 172.21.15.59:0/4130641796 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f78dc043380 con 0x7f78ec09d6f0 2023-09-30T22:32:33.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.085+0000 7f78d37fe700 1 -- 172.21.15.59:0/4130641796 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78dc0196c0 con 0x7f78ec09d6f0 2023-09-30T22:32:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.114+0000 7f6eb4664700 1 Processor -- start 2023-09-30T22:32:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.114+0000 7f6eb4664700 1 -- start start 2023-09-30T22:32:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.115+0000 7f6eb4664700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eac09d6f0 0x7f6eac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.115+0000 7f6eb4664700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6eac09e000 0x7f6eac130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.115+0000 7f6eb4664700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eac09f130 con 0x7f6eac09e410 2023-09-30T22:32:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.115+0000 7f6eb4664700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac09f520 con 0x7f6eac09d6f0 2023-09-30T22:32:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.115+0000 7f6eb4664700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac09e930 con 0x7f6eac09e000 2023-09-30T22:32:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.115+0000 7f6eb2400700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eac09d6f0 0x7f6eac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.115+0000 7f6eb2400700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eac09d6f0 0x7f6eac09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41636/0 (socket says 172.21.15.59:41636) 2023-09-30T22:32:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.115+0000 7f6eb2400700 1 -- 172.21.15.59:0/4158782810 learned_addr learned my addr 172.21.15.59:0/4158782810 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.116+0000 7f6eb1bff700 1 --2- 172.21.15.59:0/4158782810 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6eac09e000 0x7f6eac130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.116+0000 7f6eb1bff700 1 -- 172.21.15.59:0/4158782810 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eac09d6f0 msgr2=0x7f6eac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.116+0000 7f6eb1bff700 1 --2- 172.21.15.59:0/4158782810 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eac09d6f0 0x7f6eac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.116+0000 7f6eb1bff700 1 -- 172.21.15.59:0/4158782810 >> v1:172.21.15.59:6789/0 conn(0x7f6eac09e410 legacy=0x7f6eac130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.116+0000 7f6eb1bff700 1 -- 172.21.15.59:0/4158782810 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac09b2d0 con 0x7f6eac09e000 2023-09-30T22:32:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.116+0000 7f6eb1bff700 1 --2- 172.21.15.59:0/4158782810 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6eac09e000 0x7f6eac130660 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0098a0 tx=0x7f6e9c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5e3484901b39b93 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.116+0000 7f6eb13fe700 1 -- 172.21.15.59:0/4158782810 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c011830 con 0x7f6eac09e000 2023-09-30T22:32:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.117+0000 7f6eb13fe700 1 -- 172.21.15.59:0/4158782810 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c011990 con 0x7f6eac09e000 2023-09-30T22:32:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.117+0000 7f6eb13fe700 1 -- 172.21.15.59:0/4158782810 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c011d20 con 0x7f6eac09e000 2023-09-30T22:32:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.118+0000 7f6eb4664700 1 -- 172.21.15.59:0/4158782810 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6eac09e000 msgr2=0x7f6eac130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.118+0000 7f6eb4664700 1 --2- 172.21.15.59:0/4158782810 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6eac09e000 0x7f6eac130660 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0098a0 tx=0x7f6e9c009bb0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.118+0000 7f6eb4664700 1 -- 172.21.15.59:0/4158782810 shutdown_connections 2023-09-30T22:32:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.118+0000 7f6eb4664700 1 --2- 172.21.15.59:0/4158782810 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eac09d6f0 0x7f6eac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.118+0000 7f6eb4664700 1 --2- 172.21.15.59:0/4158782810 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6eac09e000 0x7f6eac130660 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.118+0000 7f6eb4664700 1 -- 172.21.15.59:0/4158782810 >> 172.21.15.59:0/4158782810 conn(0x7f6eac066f50 msgr2=0x7f6eac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.118+0000 7f6eb4664700 1 -- 172.21.15.59:0/4158782810 shutdown_connections 2023-09-30T22:32:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.118+0000 7f6eb4664700 1 -- 172.21.15.59:0/4158782810 wait complete. 2023-09-30T22:32:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.119+0000 7f6eb4664700 1 Processor -- start 2023-09-30T22:32:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.119+0000 7f6eb4664700 1 -- start start 2023-09-30T22:32:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.120+0000 7f6eb4664700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eac09d6f0 0x7f6eac11e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.120+0000 7f6eb4664700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6eac09e000 0x7f6eac11e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.120+0000 7f6eb4664700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6eac09e410 0x7f6eac11eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.120+0000 7f6eb4664700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac121bb0 con 0x7f6eac09e410 2023-09-30T22:32:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.120+0000 7f6eb4664700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0a1d00 con 0x7f6eac09d6f0 2023-09-30T22:32:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.120+0000 7f6eb4664700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac09c700 con 0x7f6eac09e000 2023-09-30T22:32:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.120+0000 7f6eb1bff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6eac09e000 0x7f6eac11e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.120+0000 7f6eb1bff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6eac09e000 0x7f6eac11e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53268/0 (socket says 172.21.15.59:53268) 2023-09-30T22:32:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.120+0000 7f6eb1bff700 1 -- 172.21.15.59:0/2242774107 learned_addr learned my addr 172.21.15.59:0/2242774107 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.121+0000 7f6eb2400700 1 --2- 172.21.15.59:0/2242774107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eac09d6f0 0x7f6eac11e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.121+0000 7f6eb2c01700 1 --2- 172.21.15.59:0/2242774107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6eac09e410 0x7f6eac11eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.121+0000 7f6eb1bff700 1 -- 172.21.15.59:0/2242774107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eac09d6f0 msgr2=0x7f6eac11e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.121+0000 7f6eb1bff700 1 --2- 172.21.15.59:0/2242774107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eac09d6f0 0x7f6eac11e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.121+0000 7f6eb1bff700 1 -- 172.21.15.59:0/2242774107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6eac09e410 msgr2=0x7f6eac11eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.121+0000 7f6eb1bff700 1 --2- 172.21.15.59:0/2242774107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6eac09e410 0x7f6eac11eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.121+0000 7f6eb1bff700 1 -- 172.21.15.59:0/2242774107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c0094a0 con 0x7f6eac09e000 2023-09-30T22:32:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.121+0000 7f6eb1bff700 1 --2- 172.21.15.59:0/2242774107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6eac09e000 0x7f6eac11e5d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0090b0 tx=0x7f6e9c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.121+0000 7f6ea2ffd700 1 -- 172.21.15.59:0/2242774107 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c004450 con 0x7f6eac09e000 2023-09-30T22:32:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.122+0000 7f6ea2ffd700 1 -- 172.21.15.59:0/2242774107 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c01f070 con 0x7f6eac09e000 2023-09-30T22:32:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.122+0000 7f6ea2ffd700 1 -- 172.21.15.59:0/2242774107 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c0038e0 con 0x7f6eac09e000 2023-09-30T22:32:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.122+0000 7f6eb4664700 1 -- 172.21.15.59:0/2242774107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac121610 con 0x7f6eac09e000 2023-09-30T22:32:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.122+0000 7f6eb4664700 1 -- 172.21.15.59:0/2242774107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac1201f0 con 0x7f6eac09e000 2023-09-30T22:32:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.123+0000 7f6ea2ffd700 1 -- 172.21.15.59:0/2242774107 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e9c003a40 con 0x7f6eac09e000 2023-09-30T22:32:33.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.123+0000 7f6eb4664700 1 -- 172.21.15.59:0/2242774107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac074ea0 con 0x7f6eac09e000 2023-09-30T22:32:33.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.123+0000 7f6ea2ffd700 1 -- 172.21.15.59:0/2242774107 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6e9c021070 con 0x7f6eac09e000 2023-09-30T22:32:33.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.132+0000 7f6ea2ffd700 1 -- 172.21.15.59:0/2242774107 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e9c010380 con 0x7f6eac09e000 2023-09-30T22:32:33.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.239+0000 7f429212d700 1 -- 172.21.15.59:0/1120502159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f428c133160 con 0x7f428c0a0a30 2023-09-30T22:32:33.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.239+0000 7f4273fff700 1 -- 172.21.15.59:0/1120502159 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f427c021020 con 0x7f428c0a0a30 2023-09-30T22:32:33.241 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:33.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.243+0000 7f429212d700 1 -- 172.21.15.59:0/1120502159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c0a0a30 msgr2=0x7f428c1c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.243+0000 7f429212d700 1 --2- 172.21.15.59:0/1120502159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c0a0a30 0x7f428c1c88a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f427c00e9b0 tx=0x7f427c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.243+0000 7f429212d700 1 -- 172.21.15.59:0/1120502159 shutdown_connections 2023-09-30T22:32:33.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.243+0000 7f429212d700 1 --2- 172.21.15.59:0/1120502159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f428c0a0a30 0x7f428c1c88a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.243+0000 7f429212d700 1 --2- 172.21.15.59:0/1120502159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f428c133fa0 0x7f428c11e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.243+0000 7f429212d700 1 --2- 172.21.15.59:0/1120502159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c0a1340 0x7f428c1c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.243+0000 7f429212d700 1 -- 172.21.15.59:0/1120502159 >> 172.21.15.59:0/1120502159 conn(0x7f428c0a6550 msgr2=0x7f428c0a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:33.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.243+0000 7f429212d700 1 -- 172.21.15.59:0/1120502159 shutdown_connections 2023-09-30T22:32:33.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.243+0000 7f429212d700 1 -- 172.21.15.59:0/1120502159 wait complete. 2023-09-30T22:32:33.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:33.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.281+0000 7f31fae1b700 1 -- 172.21.15.59:0/4102128822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f31f406b250 con 0x7f31f41337f0 2023-09-30T22:32:33.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.281+0000 7f31f17fa700 1 -- 172.21.15.59:0/4102128822 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31e0021030 con 0x7f31f41337f0 2023-09-30T22:32:33.283 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.284+0000 7f31fae1b700 1 -- 172.21.15.59:0/4102128822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 msgr2=0x7f31f4070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.284+0000 7f31fae1b700 1 --2- 172.21.15.59:0/4102128822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f4070ee0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f31e000e910 tx=0x7f31e000ec20 comp rx=0 tx=0).stop 2023-09-30T22:32:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.284+0000 7f31fae1b700 1 -- 172.21.15.59:0/4102128822 shutdown_connections 2023-09-30T22:32:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.284+0000 7f31fae1b700 1 --2- 172.21.15.59:0/4102128822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 0x7f31f4071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.284+0000 7f31fae1b700 1 --2- 172.21.15.59:0/4102128822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f4133420 0x7f31f40709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.284+0000 7f31fae1b700 1 --2- 172.21.15.59:0/4102128822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f4070ee0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.284+0000 7f31fae1b700 1 -- 172.21.15.59:0/4102128822 >> 172.21.15.59:0/4102128822 conn(0x7f31f40a4210 msgr2=0x7f31f4099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:33.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.284+0000 7f31fae1b700 1 -- 172.21.15.59:0/4102128822 shutdown_connections 2023-09-30T22:32:33.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.284+0000 7f31fae1b700 1 -- 172.21.15.59:0/4102128822 wait complete. 2023-09-30T22:32:33.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:33.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.306+0000 7f78f16e4700 1 -- 172.21.15.59:0/4130641796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78ec121910 con 0x7f78ec09d6f0 2023-09-30T22:32:33.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.307+0000 7f78d37fe700 1 -- 172.21.15.59:0/4130641796 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78dc01e020 con 0x7f78ec09d6f0 2023-09-30T22:32:33.308 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:33.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.309+0000 7f78f16e4700 1 -- 172.21.15.59:0/4130641796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec09d6f0 msgr2=0x7f78ec11e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.309+0000 7f78f16e4700 1 --2- 172.21.15.59:0/4130641796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec09d6f0 0x7f78ec11e0f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009cd0 tx=0x7f78dc010f60 comp rx=0 tx=0).stop 2023-09-30T22:32:33.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.309+0000 7f78f16e4700 1 -- 172.21.15.59:0/4130641796 shutdown_connections 2023-09-30T22:32:33.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.309+0000 7f78f16e4700 1 --2- 172.21.15.59:0/4130641796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78ec09e410 0x7f78ec11eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.309+0000 7f78f16e4700 1 --2- 172.21.15.59:0/4130641796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec09d6f0 0x7f78ec11e0f0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.309+0000 7f78f16e4700 1 --2- 172.21.15.59:0/4130641796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78ec09e000 0x7f78ec11e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.309+0000 7f78f16e4700 1 -- 172.21.15.59:0/4130641796 >> 172.21.15.59:0/4130641796 conn(0x7f78ec066f50 msgr2=0x7f78ec071450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:33.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.309+0000 7f78f16e4700 1 -- 172.21.15.59:0/4130641796 shutdown_connections 2023-09-30T22:32:33.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.309+0000 7f78f16e4700 1 -- 172.21.15.59:0/4130641796 wait complete. 2023-09-30T22:32:33.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:33.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.355+0000 7f6eb4664700 1 -- 172.21.15.59:0/2242774107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6eac06c360 con 0x7f6eac09e000 2023-09-30T22:32:33.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.355+0000 7f6ea2ffd700 1 -- 172.21.15.59:0/2242774107 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e9c02b070 con 0x7f6eac09e000 2023-09-30T22:32:33.356 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:33.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.357+0000 7f6eb4664700 1 -- 172.21.15.59:0/2242774107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6eac09e000 msgr2=0x7f6eac11e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:33.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.357+0000 7f6eb4664700 1 --2- 172.21.15.59:0/2242774107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6eac09e000 0x7f6eac11e5d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0090b0 tx=0x7f6e9c004750 comp rx=0 tx=0).stop 2023-09-30T22:32:33.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.357+0000 7f6eb4664700 1 -- 172.21.15.59:0/2242774107 shutdown_connections 2023-09-30T22:32:33.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.357+0000 7f6eb4664700 1 --2- 172.21.15.59:0/2242774107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6eac09e410 0x7f6eac11eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.357+0000 7f6eb4664700 1 --2- 172.21.15.59:0/2242774107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eac09d6f0 0x7f6eac11e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.357+0000 7f6eb4664700 1 --2- 172.21.15.59:0/2242774107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6eac09e000 0x7f6eac11e5d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:33.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.357+0000 7f6eb4664700 1 -- 172.21.15.59:0/2242774107 >> 172.21.15.59:0/2242774107 conn(0x7f6eac066f50 msgr2=0x7f6eac0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:33.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.357+0000 7f6eb4664700 1 -- 172.21.15.59:0/2242774107 shutdown_connections 2023-09-30T22:32:33.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:33.357+0000 7f6eb4664700 1 -- 172.21.15.59:0/2242774107 wait complete. 2023-09-30T22:32:33.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:34.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:34.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:34.326 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:34.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:34.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.417+0000 7efee680e700 1 Processor -- start 2023-09-30T22:32:34.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.417+0000 7efee680e700 1 -- start start 2023-09-30T22:32:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.418+0000 7efee680e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efee009d6f0 0x7efee009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.418+0000 7efee680e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efee009e000 0x7efee0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.418+0000 7efee680e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efee009e410 0x7efee0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.418+0000 7efee680e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee009f520 con 0x7efee009e410 2023-09-30T22:32:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.418+0000 7efee680e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee009f130 con 0x7efee009e000 2023-09-30T22:32:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.418+0000 7efee680e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efee009e930 con 0x7efee009d6f0 2023-09-30T22:32:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.418+0000 7efedf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efee009e000 0x7efee0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.418+0000 7efedf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efee009e000 0x7efee0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60620/0 (socket says 172.21.15.59:60620) 2023-09-30T22:32:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.418+0000 7efedf7fe700 1 -- 172.21.15.59:0/1092823231 learned_addr learned my addr 172.21.15.59:0/1092823231 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.418+0000 7efedffff700 1 --2- 172.21.15.59:0/1092823231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efee009d6f0 0x7efee009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.418+0000 7efedf7fe700 1 -- 172.21.15.59:0/1092823231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efee009d6f0 msgr2=0x7efee009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:34.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.418+0000 7efedf7fe700 1 --2- 172.21.15.59:0/1092823231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efee009d6f0 0x7efee009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.418+0000 7efedf7fe700 1 -- 172.21.15.59:0/1092823231 >> v2:172.21.15.59:3300/0 conn(0x7efee009e410 msgr2=0x7efee0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:34.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.418+0000 7efedf7fe700 1 --2- 172.21.15.59:0/1092823231 >> v2:172.21.15.59:3300/0 conn(0x7efee009e410 0x7efee0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.418+0000 7efedf7fe700 1 -- 172.21.15.59:0/1092823231 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee009b2d0 con 0x7efee009e000 2023-09-30T22:32:34.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.419+0000 7efedf7fe700 1 --2- 172.21.15.59:0/1092823231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efee009e000 0x7efee0130660 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efed4009920 tx=0x7efed4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9dfbaca374469e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:34.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.419+0000 7efedeffd700 1 -- 172.21.15.59:0/1092823231 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed4011830 con 0x7efee009e000 2023-09-30T22:32:34.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.419+0000 7efedeffd700 1 -- 172.21.15.59:0/1092823231 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed4011990 con 0x7efee009e000 2023-09-30T22:32:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.419+0000 7efedeffd700 1 -- 172.21.15.59:0/1092823231 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed4011d20 con 0x7efee009e000 2023-09-30T22:32:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.420+0000 7efee680e700 1 -- 172.21.15.59:0/1092823231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efee009e000 msgr2=0x7efee0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.420+0000 7efee680e700 1 --2- 172.21.15.59:0/1092823231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efee009e000 0x7efee0130660 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efed4009920 tx=0x7efed4009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.421+0000 7efee680e700 1 -- 172.21.15.59:0/1092823231 shutdown_connections 2023-09-30T22:32:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.421+0000 7efee680e700 1 --2- 172.21.15.59:0/1092823231 >> v2:172.21.15.59:3300/0 conn(0x7efee009e410 0x7efee0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.421+0000 7efee680e700 1 --2- 172.21.15.59:0/1092823231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efee009d6f0 0x7efee009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.421+0000 7efee680e700 1 --2- 172.21.15.59:0/1092823231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efee009e000 0x7efee0130660 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.421+0000 7efee680e700 1 -- 172.21.15.59:0/1092823231 >> 172.21.15.59:0/1092823231 conn(0x7efee0066f50 msgr2=0x7efee009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.421+0000 7efee680e700 1 -- 172.21.15.59:0/1092823231 shutdown_connections 2023-09-30T22:32:34.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.421+0000 7efee680e700 1 -- 172.21.15.59:0/1092823231 wait complete. 2023-09-30T22:32:34.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.422+0000 7efee680e700 1 Processor -- start 2023-09-30T22:32:34.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.422+0000 7efee680e700 1 -- start start 2023-09-30T22:32:34.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.423+0000 7efee680e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efee009d6f0 0x7efee011df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.423+0000 7efee680e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efee009e000 0x7efee011e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.423+0000 7efee680e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efee009e410 0x7efee011ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.423+0000 7efee680e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee01201c0 con 0x7efee009e410 2023-09-30T22:32:34.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.423+0000 7efee680e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee0120e80 con 0x7efee009d6f0 2023-09-30T22:32:34.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.423+0000 7efee680e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efee00a1900 con 0x7efee009e000 2023-09-30T22:32:34.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.423+0000 7efee4dab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efee009e410 0x7efee011ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.423+0000 7efedf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efee009e000 0x7efee011e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.423+0000 7efedffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efee009d6f0 0x7efee011df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.423+0000 7efee4dab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efee009e410 0x7efee011ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56328/0 (socket says 172.21.15.59:56328) 2023-09-30T22:32:34.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.423+0000 7efedf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efee009e000 0x7efee011e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39384/0 (socket says 172.21.15.59:39384) 2023-09-30T22:32:34.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.423+0000 7efee4dab700 1 -- 172.21.15.59:0/60860312 learned_addr learned my addr 172.21.15.59:0/60860312 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:34.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.424+0000 7efee4dab700 1 -- 172.21.15.59:0/60860312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efee009e000 msgr2=0x7efee011e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.424+0000 7efee4dab700 1 --2- 172.21.15.59:0/60860312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efee009e000 0x7efee011e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.424+0000 7efee4dab700 1 -- 172.21.15.59:0/60860312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efee009d6f0 msgr2=0x7efee011df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.424+0000 7efee4dab700 1 --2- 172.21.15.59:0/60860312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efee009d6f0 0x7efee011df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.424+0000 7efee4dab700 1 -- 172.21.15.59:0/60860312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed4009550 con 0x7efee009e410 2023-09-30T22:32:34.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.424+0000 7efedffff700 1 --2- 172.21.15.59:0/60860312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efee009d6f0 0x7efee011df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:34.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.424+0000 7efee4dab700 1 --2- 172.21.15.59:0/60860312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efee009e410 0x7efee011ea10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7efed8009640 tx=0x7efed8009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:34.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.424+0000 7efedcff9700 1 -- 172.21.15.59:0/60860312 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed800b2e0 con 0x7efee009e410 2023-09-30T22:32:34.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.424+0000 7efedcff9700 1 -- 172.21.15.59:0/60860312 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed800b440 con 0x7efee009e410 2023-09-30T22:32:34.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.424+0000 7efee680e700 1 -- 172.21.15.59:0/60860312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee0121240 con 0x7efee009e410 2023-09-30T22:32:34.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.424+0000 7efedcff9700 1 -- 172.21.15.59:0/60860312 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed800d310 con 0x7efee009e410 2023-09-30T22:32:34.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.424+0000 7efee680e700 1 -- 172.21.15.59:0/60860312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee0130370 con 0x7efee009e410 2023-09-30T22:32:34.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.425+0000 7efedcff9700 1 -- 172.21.15.59:0/60860312 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efed800d470 con 0x7efee009e410 2023-09-30T22:32:34.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.426+0000 7efedcff9700 1 -- 172.21.15.59:0/60860312 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efed8006e40 con 0x7efee009e410 2023-09-30T22:32:34.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.426+0000 7efee680e700 1 -- 172.21.15.59:0/60860312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee0074ea0 con 0x7efee009e410 2023-09-30T22:32:34.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.431+0000 7efedcff9700 1 -- 172.21.15.59:0/60860312 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efed800b960 con 0x7efee009e410 2023-09-30T22:32:34.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.455+0000 7f8c793a8700 1 Processor -- start 2023-09-30T22:32:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.455+0000 7f8c793a8700 1 -- start start 2023-09-30T22:32:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.456+0000 7f8c793a8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c7409d630 0x7f8c740a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.456+0000 7f8c793a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c74138d80 0x7f8c7413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.456+0000 7f8c793a8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c740a2a70 con 0x7f8c740a0a30 2023-09-30T22:32:34.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.456+0000 7f8c793a8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c740a01d0 con 0x7f8c7409d630 2023-09-30T22:32:34.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.456+0000 7f8c793a8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7409e2b0 con 0x7f8c74138d80 2023-09-30T22:32:34.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.456+0000 7f8c72ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8c740a0a30 0x7f8c740a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52434/0 (socket says 172.21.15.59:52434) 2023-09-30T22:32:34.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.456+0000 7f8c72ffd700 1 -- 172.21.15.59:0/1456743734 learned_addr learned my addr 172.21.15.59:0/1456743734 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:34.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.456+0000 7f8c727fc700 1 --2- 172.21.15.59:0/1456743734 >> v2:172.21.15.59:3300/0 conn(0x7f8c7409d630 0x7f8c740a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.457+0000 7f8c737fe700 1 --2- 172.21.15.59:0/1456743734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c74138d80 0x7f8c7413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.457+0000 7f8c71ffb700 1 -- 172.21.15.59:0/1456743734 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 883657118 0 0) 0x7f8c740a2a70 con 0x7f8c740a0a30 2023-09-30T22:32:34.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.457+0000 7f8c71ffb700 1 -- 172.21.15.59:0/1456743734 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c5c0035b0 con 0x7f8c740a0a30 2023-09-30T22:32:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.457+0000 7f8c727fc700 1 -- 172.21.15.59:0/1456743734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c74138d80 msgr2=0x7f8c7413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.457+0000 7f8c727fc700 1 --2- 172.21.15.59:0/1456743734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c74138d80 0x7f8c7413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.457+0000 7f8c727fc700 1 -- 172.21.15.59:0/1456743734 >> v1:172.21.15.59:6789/0 conn(0x7f8c740a0a30 legacy=0x7f8c740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.457+0000 7f8c727fc700 1 -- 172.21.15.59:0/1456743734 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7409dc50 con 0x7f8c7409d630 2023-09-30T22:32:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.457+0000 7f8c727fc700 1 --2- 172.21.15.59:0/1456743734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c7409d630 0x7f8c740a1510 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009840 tx=0x7f8c68009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581b7806865d665a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.457+0000 7f8c71ffb700 1 -- 172.21.15.59:0/1456743734 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68011830 con 0x7f8c7409d630 2023-09-30T22:32:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.457+0000 7f8c71ffb700 1 -- 172.21.15.59:0/1456743734 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c68011990 con 0x7f8c7409d630 2023-09-30T22:32:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.457+0000 7f8c71ffb700 1 -- 172.21.15.59:0/1456743734 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68011d20 con 0x7f8c7409d630 2023-09-30T22:32:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.458+0000 7f8c793a8700 1 -- 172.21.15.59:0/1456743734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c7409d630 msgr2=0x7f8c740a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.458+0000 7f8c793a8700 1 --2- 172.21.15.59:0/1456743734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c7409d630 0x7f8c740a1510 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009840 tx=0x7f8c68009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.458+0000 7f8c793a8700 1 -- 172.21.15.59:0/1456743734 shutdown_connections 2023-09-30T22:32:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.458+0000 7f8c793a8700 1 --2- 172.21.15.59:0/1456743734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c74138d80 0x7f8c7413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.458+0000 7f8c793a8700 1 --2- 172.21.15.59:0/1456743734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c7409d630 0x7f8c740a1510 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.458+0000 7f8c793a8700 1 -- 172.21.15.59:0/1456743734 >> 172.21.15.59:0/1456743734 conn(0x7f8c740a3050 msgr2=0x7f8c740a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:34.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.458+0000 7f8c793a8700 1 -- 172.21.15.59:0/1456743734 shutdown_connections 2023-09-30T22:32:34.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.458+0000 7f8c793a8700 1 -- 172.21.15.59:0/1456743734 wait complete. 2023-09-30T22:32:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.459+0000 7f8c793a8700 1 Processor -- start 2023-09-30T22:32:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.460+0000 7f8c793a8700 1 -- start start 2023-09-30T22:32:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.460+0000 7f8c793a8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c7409d630 0x7f8c74133c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.460+0000 7f8c793a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c740a0a30 0x7f8c74134170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.460+0000 7f8c793a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c74138d80 0x7f8c741346b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.460+0000 7f8c793a8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c74137200 con 0x7f8c7409d630 2023-09-30T22:32:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.460+0000 7f8c793a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740a0410 con 0x7f8c74138d80 2023-09-30T22:32:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.460+0000 7f8c793a8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c741373e0 con 0x7f8c740a0a30 2023-09-30T22:32:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.460+0000 7f8c727fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c740a0a30 0x7f8c74134170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.460+0000 7f8c727fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c740a0a30 0x7f8c74134170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39388/0 (socket says 172.21.15.59:39388) 2023-09-30T22:32:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.460+0000 7f8c727fc700 1 -- 172.21.15.59:0/972800471 learned_addr learned my addr 172.21.15.59:0/972800471 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.460+0000 7f8c737fe700 1 --2- 172.21.15.59:0/972800471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c74138d80 0x7f8c741346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.460+0000 7f8c72ffd700 1 --2- 172.21.15.59:0/972800471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c7409d630 0x7f8c74133c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.461+0000 7f8c727fc700 1 -- 172.21.15.59:0/972800471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c74138d80 msgr2=0x7f8c741346b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.461+0000 7f8c727fc700 1 --2- 172.21.15.59:0/972800471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c74138d80 0x7f8c741346b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.461+0000 7f8c727fc700 1 -- 172.21.15.59:0/972800471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c7409d630 msgr2=0x7f8c74133c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.461+0000 7f8c727fc700 1 --2- 172.21.15.59:0/972800471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c7409d630 0x7f8c74133c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.461+0000 7f8c727fc700 1 -- 172.21.15.59:0/972800471 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680094a0 con 0x7f8c740a0a30 2023-09-30T22:32:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.461+0000 7f8c727fc700 1 --2- 172.21.15.59:0/972800471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c740a0a30 0x7f8c74134170 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8c68000c00 tx=0x7f8c68004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.461+0000 7f8c5b7fe700 1 -- 172.21.15.59:0/972800471 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c680036a0 con 0x7f8c740a0a30 2023-09-30T22:32:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.461+0000 7f8c5b7fe700 1 -- 172.21.15.59:0/972800471 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6801f070 con 0x7f8c740a0a30 2023-09-30T22:32:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.461+0000 7f8c5b7fe700 1 -- 172.21.15.59:0/972800471 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68003a60 con 0x7f8c740a0a30 2023-09-30T22:32:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.461+0000 7f8c793a8700 1 -- 172.21.15.59:0/972800471 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c741383b0 con 0x7f8c740a0a30 2023-09-30T22:32:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.461+0000 7f8c793a8700 1 -- 172.21.15.59:0/972800471 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c74135f20 con 0x7f8c740a0a30 2023-09-30T22:32:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.462+0000 7f8c793a8700 1 -- 172.21.15.59:0/972800471 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c740747f0 con 0x7f8c740a0a30 2023-09-30T22:32:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.463+0000 7f8c5b7fe700 1 -- 172.21.15.59:0/972800471 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c68003bc0 con 0x7f8c740a0a30 2023-09-30T22:32:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.463+0000 7f8c5b7fe700 1 -- 172.21.15.59:0/972800471 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8c68021070 con 0x7f8c740a0a30 2023-09-30T22:32:34.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.468+0000 7f8c5b7fe700 1 -- 172.21.15.59:0/972800471 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c6801a430 con 0x7f8c740a0a30 2023-09-30T22:32:34.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.499+0000 7fab50cca700 1 Processor -- start 2023-09-30T22:32:34.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.499+0000 7fab50cca700 1 -- start start 2023-09-30T22:32:34.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.500+0000 7fab50cca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab4c0a0a30 0x7fab4c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.500+0000 7fab50cca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4c0a1340 0x7fab4c1338f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.500+0000 7fab50cca700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4c09eaf0 con 0x7fab4c133e30 2023-09-30T22:32:34.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.500+0000 7fab50cca700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c0a27c0 con 0x7fab4c0a0a30 2023-09-30T22:32:34.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.500+0000 7fab50cca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c09dbe0 con 0x7fab4c0a1340 2023-09-30T22:32:34.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.500+0000 7fab4ad9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fab4c133e30 0x7fab4c13ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52448/0 (socket says 172.21.15.59:52448) 2023-09-30T22:32:34.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.500+0000 7fab4ad9d700 1 -- 172.21.15.59:0/4011227055 learned_addr learned my addr 172.21.15.59:0/4011227055 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:34.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.500+0000 7fab4a59c700 1 --2- 172.21.15.59:0/4011227055 >> v2:172.21.15.59:3300/0 conn(0x7fab4c0a0a30 0x7fab4c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.500+0000 7fab49d9b700 1 --2- 172.21.15.59:0/4011227055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4c0a1340 0x7fab4c1338f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.500+0000 7fab4959a700 1 -- 172.21.15.59:0/4011227055 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246980256 0 0) 0x7fab44001490 con 0x7fab4c133e30 2023-09-30T22:32:34.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.500+0000 7fab49d9b700 1 -- 172.21.15.59:0/4011227055 >> v2:172.21.15.59:3300/0 conn(0x7fab4c0a0a30 msgr2=0x7fab4c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:34.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.500+0000 7fab49d9b700 1 --2- 172.21.15.59:0/4011227055 >> v2:172.21.15.59:3300/0 conn(0x7fab4c0a0a30 0x7fab4c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.500+0000 7fab49d9b700 1 -- 172.21.15.59:0/4011227055 >> v1:172.21.15.59:6789/0 conn(0x7fab4c133e30 legacy=0x7fab4c13ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.500+0000 7fab49d9b700 1 -- 172.21.15.59:0/4011227055 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c0a1f90 con 0x7fab4c0a1340 2023-09-30T22:32:34.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.501+0000 7fab49d9b700 1 --2- 172.21.15.59:0/4011227055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4c0a1340 0x7fab4c1338f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fab40009840 tx=0x7fab40009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f92eb0026b93f9f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:34.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.501+0000 7fab4959a700 1 -- 172.21.15.59:0/4011227055 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40011830 con 0x7fab4c0a1340 2023-09-30T22:32:34.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.501+0000 7fab4959a700 1 -- 172.21.15.59:0/4011227055 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab40011990 con 0x7fab4c0a1340 2023-09-30T22:32:34.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.501+0000 7fab4959a700 1 -- 172.21.15.59:0/4011227055 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40011d20 con 0x7fab4c0a1340 2023-09-30T22:32:34.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.501+0000 7fab50cca700 1 -- 172.21.15.59:0/4011227055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4c0a1340 msgr2=0x7fab4c1338f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.501+0000 7fab50cca700 1 --2- 172.21.15.59:0/4011227055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4c0a1340 0x7fab4c1338f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fab40009840 tx=0x7fab40009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:34.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.502+0000 7fab50cca700 1 -- 172.21.15.59:0/4011227055 shutdown_connections 2023-09-30T22:32:34.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.502+0000 7fab50cca700 1 --2- 172.21.15.59:0/4011227055 >> v2:172.21.15.59:3300/0 conn(0x7fab4c0a0a30 0x7fab4c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.502+0000 7fab50cca700 1 --2- 172.21.15.59:0/4011227055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4c0a1340 0x7fab4c1338f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.502+0000 7fab50cca700 1 -- 172.21.15.59:0/4011227055 >> 172.21.15.59:0/4011227055 conn(0x7fab4c0a6550 msgr2=0x7fab4c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:34.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.502+0000 7fab50cca700 1 -- 172.21.15.59:0/4011227055 shutdown_connections 2023-09-30T22:32:34.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.502+0000 7fab50cca700 1 -- 172.21.15.59:0/4011227055 wait complete. 2023-09-30T22:32:34.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.503+0000 7fab50cca700 1 Processor -- start 2023-09-30T22:32:34.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.503+0000 7fab50cca700 1 -- start start 2023-09-30T22:32:34.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.504+0000 7fab50cca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4c0a0a30 0x7fab4c1c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.504+0000 7fab50cca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab4c0a1340 0x7fab4c1c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.504+0000 7fab50cca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab4c133e30 0x7fab4c1c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.504+0000 7fab50cca700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c124560 con 0x7fab4c133e30 2023-09-30T22:32:34.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.504+0000 7fab50cca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0a02e0 con 0x7fab4c0a0a30 2023-09-30T22:32:34.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.504+0000 7fab50cca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c122da0 con 0x7fab4c0a1340 2023-09-30T22:32:34.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.504+0000 7fab4ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab4c133e30 0x7fab4c1c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.504+0000 7fab4a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4c0a0a30 0x7fab4c1c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.504+0000 7fab4ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab4c133e30 0x7fab4c1c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56360/0 (socket says 172.21.15.59:56360) 2023-09-30T22:32:34.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.504+0000 7fab4ad9d700 1 -- 172.21.15.59:0/272729680 learned_addr learned my addr 172.21.15.59:0/272729680 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:34.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.504+0000 7fab4a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4c0a0a30 0x7fab4c1c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60654/0 (socket says 172.21.15.59:60654) 2023-09-30T22:32:34.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.504+0000 7fab49d9b700 1 --2- 172.21.15.59:0/272729680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab4c0a1340 0x7fab4c1c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.505+0000 7fab4ad9d700 1 -- 172.21.15.59:0/272729680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab4c0a1340 msgr2=0x7fab4c1c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.505+0000 7fab4ad9d700 1 --2- 172.21.15.59:0/272729680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab4c0a1340 0x7fab4c1c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.505+0000 7fab4ad9d700 1 -- 172.21.15.59:0/272729680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4c0a0a30 msgr2=0x7fab4c1c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.505+0000 7fab4ad9d700 1 --2- 172.21.15.59:0/272729680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4c0a0a30 0x7fab4c1c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.505+0000 7fab4ad9d700 1 -- 172.21.15.59:0/272729680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab400094a0 con 0x7fab4c133e30 2023-09-30T22:32:34.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.505+0000 7fab4a59c700 1 --2- 172.21.15.59:0/272729680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4c0a0a30 0x7fab4c1c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:34.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.505+0000 7fab4ad9d700 1 --2- 172.21.15.59:0/272729680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab4c133e30 0x7fab4c1c8ca0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fab4400ccd0 tx=0x7fab4400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:34.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.505+0000 7fab3affd700 1 -- 172.21.15.59:0/272729680 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4400ab20 con 0x7fab4c133e30 2023-09-30T22:32:34.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.505+0000 7fab3affd700 1 -- 172.21.15.59:0/272729680 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4400ac80 con 0x7fab4c133e30 2023-09-30T22:32:34.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.505+0000 7fab3affd700 1 -- 172.21.15.59:0/272729680 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440070d0 con 0x7fab4c133e30 2023-09-30T22:32:34.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.505+0000 7fab50cca700 1 -- 172.21.15.59:0/272729680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c09d380 con 0x7fab4c133e30 2023-09-30T22:32:34.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.505+0000 7fab50cca700 1 -- 172.21.15.59:0/272729680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4c1264e0 con 0x7fab4c133e30 2023-09-30T22:32:34.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.506+0000 7fab50cca700 1 -- 172.21.15.59:0/272729680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4c125e30 con 0x7fab4c133e30 2023-09-30T22:32:34.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.507+0000 7fab3affd700 1 -- 172.21.15.59:0/272729680 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab44007230 con 0x7fab4c133e30 2023-09-30T22:32:34.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.507+0000 7fab3affd700 1 -- 172.21.15.59:0/272729680 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab4403f520 con 0x7fab4c133e30 2023-09-30T22:32:34.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.511+0000 7fab3affd700 1 -- 172.21.15.59:0/272729680 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab4401b360 con 0x7fab4c133e30 2023-09-30T22:32:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.593+0000 7fbe314ea700 1 Processor -- start 2023-09-30T22:32:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.594+0000 7fbe314ea700 1 -- start start 2023-09-30T22:32:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.594+0000 7fbe314ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe2c09e930 0x7fbe2c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.594+0000 7fbe314ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe2c09f240 0x7fbe2c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.594+0000 7fbe314ea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2c070940 con 0x7fbe2c09f650 2023-09-30T22:32:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.594+0000 7fbe314ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c06fd60 con 0x7fbe2c09f240 2023-09-30T22:32:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.594+0000 7fbe314ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c06fa80 con 0x7fbe2c09e930 2023-09-30T22:32:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.594+0000 7fbe2b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbe2c09f650 0x7fbe2c131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52456/0 (socket says 172.21.15.59:52456) 2023-09-30T22:32:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.594+0000 7fbe2b7fe700 1 -- 172.21.15.59:0/895768508 learned_addr learned my addr 172.21.15.59:0/895768508 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.594+0000 7fbe2a7fc700 1 --2- 172.21.15.59:0/895768508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe2c09f240 0x7fbe2c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.594+0000 7fbe2affd700 1 --2- 172.21.15.59:0/895768508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe2c09e930 0x7fbe2c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.595+0000 7fbe29ffb700 1 -- 172.21.15.59:0/895768508 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229850204 0 0) 0x7fbe2c070940 con 0x7fbe2c09f650 2023-09-30T22:32:34.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.595+0000 7fbe29ffb700 1 -- 172.21.15.59:0/895768508 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe140035b0 con 0x7fbe2c09f650 2023-09-30T22:32:34.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.595+0000 7fbe2a7fc700 1 -- 172.21.15.59:0/895768508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe2c09e930 msgr2=0x7fbe2c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:34.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.595+0000 7fbe2a7fc700 1 --2- 172.21.15.59:0/895768508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe2c09e930 0x7fbe2c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.595+0000 7fbe2a7fc700 1 -- 172.21.15.59:0/895768508 >> v1:172.21.15.59:6789/0 conn(0x7fbe2c09f650 legacy=0x7fbe2c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.595+0000 7fbe2a7fc700 1 -- 172.21.15.59:0/895768508 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c09fb60 con 0x7fbe2c09f240 2023-09-30T22:32:34.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.595+0000 7fbe2a7fc700 1 --2- 172.21.15.59:0/895768508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe2c09f240 0x7fbe2c1317f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009870 tx=0x7fbe20009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=553b52f1fe992dfa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:34.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.595+0000 7fbe29ffb700 1 -- 172.21.15.59:0/895768508 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20011830 con 0x7fbe2c09f240 2023-09-30T22:32:34.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.595+0000 7fbe29ffb700 1 -- 172.21.15.59:0/895768508 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe20011990 con 0x7fbe2c09f240 2023-09-30T22:32:34.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.595+0000 7fbe29ffb700 1 -- 172.21.15.59:0/895768508 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20011d20 con 0x7fbe2c09f240 2023-09-30T22:32:34.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.596+0000 7fbe314ea700 1 -- 172.21.15.59:0/895768508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe2c09f240 msgr2=0x7fbe2c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.596+0000 7fbe314ea700 1 --2- 172.21.15.59:0/895768508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe2c09f240 0x7fbe2c1317f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009870 tx=0x7fbe20009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:34.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.596+0000 7fbe314ea700 1 -- 172.21.15.59:0/895768508 shutdown_connections 2023-09-30T22:32:34.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.596+0000 7fbe314ea700 1 --2- 172.21.15.59:0/895768508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe2c09e930 0x7fbe2c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.596+0000 7fbe314ea700 1 --2- 172.21.15.59:0/895768508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe2c09f240 0x7fbe2c1317f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.596+0000 7fbe314ea700 1 -- 172.21.15.59:0/895768508 >> 172.21.15.59:0/895768508 conn(0x7fbe2c0a4210 msgr2=0x7fbe2c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:34.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.596+0000 7fbe314ea700 1 -- 172.21.15.59:0/895768508 shutdown_connections 2023-09-30T22:32:34.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.596+0000 7fbe314ea700 1 -- 172.21.15.59:0/895768508 wait complete. 2023-09-30T22:32:34.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.597+0000 7fbe314ea700 1 Processor -- start 2023-09-30T22:32:34.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.597+0000 7fbe314ea700 1 -- start start 2023-09-30T22:32:34.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.598+0000 7fbe314ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe2c09e930 0x7fbe2c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.598+0000 7fbe314ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe2c09f240 0x7fbe2c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.598+0000 7fbe314ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe2c09f650 0x7fbe2c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.598+0000 7fbe314ea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c1b7230 con 0x7fbe2c09e930 2023-09-30T22:32:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.598+0000 7fbe314ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c1a93e0 con 0x7fbe2c09f240 2023-09-30T22:32:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.598+0000 7fbe314ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c1a8900 con 0x7fbe2c09f650 2023-09-30T22:32:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.598+0000 7fbe2b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe2c09f650 0x7fbe2c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.598+0000 7fbe2b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe2c09f650 0x7fbe2c06c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39420/0 (socket says 172.21.15.59:39420) 2023-09-30T22:32:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.598+0000 7fbe2b7fe700 1 -- 172.21.15.59:0/642218518 learned_addr learned my addr 172.21.15.59:0/642218518 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.598+0000 7fbe2affd700 1 --2- 172.21.15.59:0/642218518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe2c09e930 0x7fbe2c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.598+0000 7fbe2b7fe700 1 -- 172.21.15.59:0/642218518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe2c09f240 msgr2=0x7fbe2c06bdf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:32:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.598+0000 7fbe2b7fe700 1 --2- 172.21.15.59:0/642218518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe2c09f240 0x7fbe2c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.598+0000 7fbe2b7fe700 1 -- 172.21.15.59:0/642218518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe2c09e930 msgr2=0x7fbe2c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.598+0000 7fbe2b7fe700 1 --2- 172.21.15.59:0/642218518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe2c09e930 0x7fbe2c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.598+0000 7fbe2b7fe700 1 -- 172.21.15.59:0/642218518 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe200094a0 con 0x7fbe2c09f650 2023-09-30T22:32:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.599+0000 7fbe2b7fe700 1 --2- 172.21.15.59:0/642218518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe2c09f650 0x7fbe2c06c330 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400cbe0 tx=0x7fbe240021c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.599+0000 7fbe137fe700 1 -- 172.21.15.59:0/642218518 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2400aae0 con 0x7fbe2c09f650 2023-09-30T22:32:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.599+0000 7fbe137fe700 1 -- 172.21.15.59:0/642218518 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2400ac40 con 0x7fbe2c09f650 2023-09-30T22:32:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.599+0000 7fbe314ea700 1 -- 172.21.15.59:0/642218518 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2c0a0190 con 0x7fbe2c09f650 2023-09-30T22:32:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.599+0000 7fbe137fe700 1 -- 172.21.15.59:0/642218518 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24012400 con 0x7fbe2c09f650 2023-09-30T22:32:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.599+0000 7fbe314ea700 1 -- 172.21.15.59:0/642218518 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2c071d20 con 0x7fbe2c09f650 2023-09-30T22:32:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.600+0000 7fbe137fe700 1 -- 172.21.15.59:0/642218518 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe24012560 con 0x7fbe2c09f650 2023-09-30T22:32:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.600+0000 7fbe314ea700 1 -- 172.21.15.59:0/642218518 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2c1a9170 con 0x7fbe2c09f650 2023-09-30T22:32:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.600+0000 7fbe137fe700 1 -- 172.21.15.59:0/642218518 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbe2403f480 con 0x7fbe2c09f650 2023-09-30T22:32:34.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.605+0000 7fbe137fe700 1 -- 172.21.15.59:0/642218518 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe2c1a9170 con 0x7fbe2c09f650 2023-09-30T22:32:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.690+0000 7f8c793a8700 1 -- 172.21.15.59:0/972800471 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8c740a47b0 con 0x7f8c740a0a30 2023-09-30T22:32:34.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.691+0000 7f8c5b7fe700 1 -- 172.21.15.59:0/972800471 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c68015070 con 0x7f8c740a0a30 2023-09-30T22:32:34.692 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.694+0000 7f8c793a8700 1 -- 172.21.15.59:0/972800471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c740a0a30 msgr2=0x7f8c74134170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.694+0000 7f8c793a8700 1 --2- 172.21.15.59:0/972800471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c740a0a30 0x7f8c74134170 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8c68000c00 tx=0x7f8c68004750 comp rx=0 tx=0).stop 2023-09-30T22:32:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.694+0000 7f8c793a8700 1 -- 172.21.15.59:0/972800471 shutdown_connections 2023-09-30T22:32:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.694+0000 7f8c793a8700 1 --2- 172.21.15.59:0/972800471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c74138d80 0x7f8c741346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.694+0000 7f8c793a8700 1 --2- 172.21.15.59:0/972800471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c7409d630 0x7f8c74133c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.694+0000 7f8c793a8700 1 --2- 172.21.15.59:0/972800471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c740a0a30 0x7f8c74134170 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.694+0000 7f8c793a8700 1 -- 172.21.15.59:0/972800471 >> 172.21.15.59:0/972800471 conn(0x7f8c740a3050 msgr2=0x7f8c7409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.694+0000 7f8c793a8700 1 -- 172.21.15.59:0/972800471 shutdown_connections 2023-09-30T22:32:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.694+0000 7f8c793a8700 1 -- 172.21.15.59:0/972800471 wait complete. 2023-09-30T22:32:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.705+0000 7efee680e700 1 -- 172.21.15.59:0/60860312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efee006c360 con 0x7efee009e410 2023-09-30T22:32:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.706+0000 7efedcff9700 1 -- 172.21.15.59:0/60860312 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efed8013300 con 0x7efee009e410 2023-09-30T22:32:34.707 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:34.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.708+0000 7efee680e700 1 -- 172.21.15.59:0/60860312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efee009e410 msgr2=0x7efee011ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.708+0000 7efee680e700 1 --2- 172.21.15.59:0/60860312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efee009e410 0x7efee011ea10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7efed8009640 tx=0x7efed8009950 comp rx=0 tx=0).stop 2023-09-30T22:32:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.708+0000 7efee680e700 1 -- 172.21.15.59:0/60860312 shutdown_connections 2023-09-30T22:32:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.708+0000 7efee680e700 1 --2- 172.21.15.59:0/60860312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efee009e410 0x7efee011ea10 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.708+0000 7efee680e700 1 --2- 172.21.15.59:0/60860312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efee009d6f0 0x7efee011df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.708+0000 7efee680e700 1 --2- 172.21.15.59:0/60860312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efee009e000 0x7efee011e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.708+0000 7efee680e700 1 -- 172.21.15.59:0/60860312 >> 172.21.15.59:0/60860312 conn(0x7efee0066f50 msgr2=0x7efee006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.708+0000 7efee680e700 1 -- 172.21.15.59:0/60860312 shutdown_connections 2023-09-30T22:32:34.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.708+0000 7efee680e700 1 -- 172.21.15.59:0/60860312 wait complete. 2023-09-30T22:32:34.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:34.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.750+0000 7fab50cca700 1 -- 172.21.15.59:0/272729680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fab4c09eaf0 con 0x7fab4c133e30 2023-09-30T22:32:34.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.750+0000 7fab3affd700 1 -- 172.21.15.59:0/272729680 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab4c09eaf0 con 0x7fab4c133e30 2023-09-30T22:32:34.751 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:34.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.752+0000 7fab50cca700 1 -- 172.21.15.59:0/272729680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab4c133e30 msgr2=0x7fab4c1c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.752+0000 7fab50cca700 1 --2- 172.21.15.59:0/272729680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab4c133e30 0x7fab4c1c8ca0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fab4400ccd0 tx=0x7fab4400a060 comp rx=0 tx=0).stop 2023-09-30T22:32:34.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.752+0000 7fab50cca700 1 -- 172.21.15.59:0/272729680 shutdown_connections 2023-09-30T22:32:34.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.752+0000 7fab50cca700 1 --2- 172.21.15.59:0/272729680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab4c133e30 0x7fab4c1c8ca0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.752+0000 7fab50cca700 1 --2- 172.21.15.59:0/272729680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4c0a0a30 0x7fab4c1c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.752+0000 7fab50cca700 1 --2- 172.21.15.59:0/272729680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab4c0a1340 0x7fab4c1c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.752+0000 7fab50cca700 1 -- 172.21.15.59:0/272729680 >> 172.21.15.59:0/272729680 conn(0x7fab4c0a6550 msgr2=0x7fab4c0a5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:34.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.753+0000 7fab50cca700 1 -- 172.21.15.59:0/272729680 shutdown_connections 2023-09-30T22:32:34.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.753+0000 7fab50cca700 1 -- 172.21.15.59:0/272729680 wait complete. 2023-09-30T22:32:34.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:34.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.843+0000 7fbe314ea700 1 -- 172.21.15.59:0/642218518 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbe2c1a9170 con 0x7fbe2c09f650 2023-09-30T22:32:34.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.843+0000 7fbe137fe700 1 -- 172.21.15.59:0/642218518 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe2c1a9170 con 0x7fbe2c09f650 2023-09-30T22:32:34.845 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:34.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.845+0000 7fbe314ea700 1 -- 172.21.15.59:0/642218518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe2c09f650 msgr2=0x7fbe2c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:34.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.845+0000 7fbe314ea700 1 --2- 172.21.15.59:0/642218518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe2c09f650 0x7fbe2c06c330 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400cbe0 tx=0x7fbe240021c0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.845+0000 7fbe314ea700 1 -- 172.21.15.59:0/642218518 shutdown_connections 2023-09-30T22:32:34.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.845+0000 7fbe314ea700 1 --2- 172.21.15.59:0/642218518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe2c09f650 0x7fbe2c06c330 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.845+0000 7fbe314ea700 1 --2- 172.21.15.59:0/642218518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe2c09e930 0x7fbe2c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.845+0000 7fbe314ea700 1 --2- 172.21.15.59:0/642218518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe2c09f240 0x7fbe2c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:34.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.845+0000 7fbe314ea700 1 -- 172.21.15.59:0/642218518 >> 172.21.15.59:0/642218518 conn(0x7fbe2c0a4210 msgr2=0x7fbe2c1b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:34.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.846+0000 7fbe314ea700 1 -- 172.21.15.59:0/642218518 shutdown_connections 2023-09-30T22:32:34.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:34.846+0000 7fbe314ea700 1 -- 172.21.15.59:0/642218518 wait complete. 2023-09-30T22:32:34.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:35.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:35.773 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:35.773 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:35.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:35.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.924+0000 7fe560a80700 1 Processor -- start 2023-09-30T22:32:35.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.924+0000 7fe560a80700 1 -- start start 2023-09-30T22:32:35.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.924+0000 7fc3daafc700 1 Processor -- start 2023-09-30T22:32:35.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7f7a7df8c700 1 Processor -- start 2023-09-30T22:32:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7fc3daafc700 1 -- start start 2023-09-30T22:32:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7fc3daafc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3d40a0a30 0x7fc3d40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7fc3daafc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d409d630 0x7fc3d40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7fc3daafc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc3d4133930 0x7fc3d4133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7fc3daafc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d40a2a70 con 0x7fc3d4133930 2023-09-30T22:32:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7fc3daafc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d40a01d0 con 0x7fc3d409d630 2023-09-30T22:32:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7fc3daafc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d409e2b0 con 0x7fc3d40a0a30 2023-09-30T22:32:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7fc3d3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d409d630 0x7fc3d40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7fc3d3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d409d630 0x7fc3d40a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60678/0 (socket says 172.21.15.59:60678) 2023-09-30T22:32:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7fc3d3fff700 1 -- 172.21.15.59:0/3565204199 learned_addr learned my addr 172.21.15.59:0/3565204199 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7f7a7df8c700 1 -- start start 2023-09-30T22:32:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7f7a7df8c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a7809d630 0x7f7a780a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7f7a7df8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a78138d80 0x7f7a7813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7f7a7df8c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a780a2a70 con 0x7f7a780a0a30 2023-09-30T22:32:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7f7a7df8c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a780a01d0 con 0x7f7a7809d630 2023-09-30T22:32:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7f7a7df8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7809e2b0 con 0x7f7a78138d80 2023-09-30T22:32:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7fe560a80700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe55c09e1d0 0x7fe55c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7fe560a80700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe55c139170 0x7fe55c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7fe560a80700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55c09b120 con 0x7fe55c09d6f0 2023-09-30T22:32:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7fe560a80700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55c06b460 con 0x7fe55c09e1d0 2023-09-30T22:32:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7fe560a80700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c09a7e0 con 0x7fe55c139170 2023-09-30T22:32:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.925+0000 7f7a77fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a78138d80 0x7f7a7813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7f7a77fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a78138d80 0x7f7a7813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60682/0 (socket says 172.21.15.59:60682) 2023-09-30T22:32:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7f7a77fff700 1 -- 172.21.15.59:0/2476885317 learned_addr learned my addr 172.21.15.59:0/2476885317 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7f7a76ffd700 1 --2- 172.21.15.59:0/2476885317 >> v2:172.21.15.59:3300/0 conn(0x7f7a7809d630 0x7f7a780a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7fc3d9099700 1 --2- 172.21.15.59:0/3565204199 >> v2:172.21.15.59:3300/0 conn(0x7fc3d4133930 0x7fc3d4133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7fc3d3fff700 1 -- 172.21.15.59:0/3565204199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3d40a0a30 msgr2=0x7fc3d40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7fc3d3fff700 1 --2- 172.21.15.59:0/3565204199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3d40a0a30 0x7fc3d40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7fc3d3fff700 1 -- 172.21.15.59:0/3565204199 >> v2:172.21.15.59:3300/0 conn(0x7fc3d4133930 msgr2=0x7fc3d4133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7fc3d3fff700 1 --2- 172.21.15.59:0/3565204199 >> v2:172.21.15.59:3300/0 conn(0x7fc3d4133930 0x7fc3d4133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7fc3d3fff700 1 -- 172.21.15.59:0/3565204199 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d409dc50 con 0x7fc3d409d630 2023-09-30T22:32:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7fe55a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe55c09d6f0 0x7fe55c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52466/0 (socket says 172.21.15.59:52466) 2023-09-30T22:32:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7fe55a59c700 1 -- 172.21.15.59:0/940565194 learned_addr learned my addr 172.21.15.59:0/940565194 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7fe559d9b700 1 --2- 172.21.15.59:0/940565194 >> v2:172.21.15.59:3300/0 conn(0x7fe55c09e1d0 0x7fe55c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7fc3d3fff700 1 --2- 172.21.15.59:0/3565204199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d409d630 0x7fc3d40a1340 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00098f0 tx=0x7fc3c0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8327fd10e010ea58 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7f7a77fff700 1 -- 172.21.15.59:0/2476885317 >> v2:172.21.15.59:3300/0 conn(0x7f7a7809d630 msgr2=0x7f7a780a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7f7a77fff700 1 --2- 172.21.15.59:0/2476885317 >> v2:172.21.15.59:3300/0 conn(0x7f7a7809d630 0x7f7a780a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7f7a77fff700 1 -- 172.21.15.59:0/2476885317 >> v1:172.21.15.59:6789/0 conn(0x7f7a780a0a30 legacy=0x7f7a780a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7f7a77fff700 1 -- 172.21.15.59:0/2476885317 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7809dc50 con 0x7f7a78138d80 2023-09-30T22:32:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7fe559d9b700 1 -- 172.21.15.59:0/940565194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe55c139170 msgr2=0x7fe55c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7fe559d9b700 1 --2- 172.21.15.59:0/940565194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe55c139170 0x7fe55c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7fe559d9b700 1 -- 172.21.15.59:0/940565194 >> v1:172.21.15.59:6789/0 conn(0x7fe55c09d6f0 legacy=0x7fe55c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:35.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.926+0000 7fe559d9b700 1 -- 172.21.15.59:0/940565194 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c09a500 con 0x7fe55c09e1d0 2023-09-30T22:32:35.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.927+0000 7f7a77fff700 1 --2- 172.21.15.59:0/2476885317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a78138d80 0x7f7a7813b160 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009e50 tx=0x7f7a7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dd0fceccfd72637 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:35.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.927+0000 7fc3d37fe700 1 -- 172.21.15.59:0/3565204199 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000b8a0 con 0x7fc3d409d630 2023-09-30T22:32:35.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.927+0000 7fc3d37fe700 1 -- 172.21.15.59:0/3565204199 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c000ba00 con 0x7fc3d409d630 2023-09-30T22:32:35.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.927+0000 7fc3d37fe700 1 -- 172.21.15.59:0/3565204199 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000bd90 con 0x7fc3d409d630 2023-09-30T22:32:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.927+0000 7fe559d9b700 1 --2- 172.21.15.59:0/940565194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe55c09e1d0 0x7fe55c138c30 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe550009870 tx=0x7fe550009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff94911c67376009 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.927+0000 7f7a767fc700 1 -- 172.21.15.59:0/2476885317 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7000e070 con 0x7f7a78138d80 2023-09-30T22:32:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.927+0000 7f7a767fc700 1 -- 172.21.15.59:0/2476885317 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7000b910 con 0x7f7a78138d80 2023-09-30T22:32:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.927+0000 7fe55959a700 1 -- 172.21.15.59:0/940565194 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550011830 con 0x7fe55c09e1d0 2023-09-30T22:32:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.927+0000 7f7a767fc700 1 -- 172.21.15.59:0/2476885317 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7000bcc0 con 0x7f7a78138d80 2023-09-30T22:32:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.927+0000 7fe55959a700 1 -- 172.21.15.59:0/940565194 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe550011990 con 0x7fe55c09e1d0 2023-09-30T22:32:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.927+0000 7fe55959a700 1 -- 172.21.15.59:0/940565194 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550011d20 con 0x7fe55c09e1d0 2023-09-30T22:32:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7f7a7df8c700 1 -- 172.21.15.59:0/2476885317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a78138d80 msgr2=0x7f7a7813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7f7a7df8c700 1 --2- 172.21.15.59:0/2476885317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a78138d80 0x7f7a7813b160 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009e50 tx=0x7f7a7000b330 comp rx=0 tx=0).stop 2023-09-30T22:32:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fc3daafc700 1 -- 172.21.15.59:0/3565204199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d409d630 msgr2=0x7fc3d40a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fc3daafc700 1 --2- 172.21.15.59:0/3565204199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d409d630 0x7fc3d40a1340 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00098f0 tx=0x7fc3c0009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7f7a7df8c700 1 -- 172.21.15.59:0/2476885317 shutdown_connections 2023-09-30T22:32:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7f7a7df8c700 1 --2- 172.21.15.59:0/2476885317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a78138d80 0x7f7a7813b160 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7f7a7df8c700 1 --2- 172.21.15.59:0/2476885317 >> v2:172.21.15.59:3300/0 conn(0x7f7a7809d630 0x7f7a780a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7f7a7df8c700 1 -- 172.21.15.59:0/2476885317 >> 172.21.15.59:0/2476885317 conn(0x7f7a780a3050 msgr2=0x7f7a780a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:35.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fe560a80700 1 -- 172.21.15.59:0/940565194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe55c09e1d0 msgr2=0x7fe55c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:35.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fe560a80700 1 --2- 172.21.15.59:0/940565194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe55c09e1d0 0x7fe55c138c30 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe550009870 tx=0x7fe550009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:35.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7f7a7df8c700 1 -- 172.21.15.59:0/2476885317 shutdown_connections 2023-09-30T22:32:35.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7f7a7df8c700 1 -- 172.21.15.59:0/2476885317 wait complete. 2023-09-30T22:32:35.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fc3daafc700 1 -- 172.21.15.59:0/3565204199 shutdown_connections 2023-09-30T22:32:35.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fc3daafc700 1 --2- 172.21.15.59:0/3565204199 >> v2:172.21.15.59:3300/0 conn(0x7fc3d4133930 0x7fc3d4133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fc3daafc700 1 --2- 172.21.15.59:0/3565204199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3d40a0a30 0x7fc3d40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fc3daafc700 1 --2- 172.21.15.59:0/3565204199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d409d630 0x7fc3d40a1340 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fc3daafc700 1 -- 172.21.15.59:0/3565204199 >> 172.21.15.59:0/3565204199 conn(0x7fc3d40a3050 msgr2=0x7fc3d40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:35.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fe560a80700 1 -- 172.21.15.59:0/940565194 shutdown_connections 2023-09-30T22:32:35.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fe560a80700 1 --2- 172.21.15.59:0/940565194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe55c139170 0x7fe55c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fc3daafc700 1 -- 172.21.15.59:0/3565204199 shutdown_connections 2023-09-30T22:32:35.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fe560a80700 1 --2- 172.21.15.59:0/940565194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe55c09e1d0 0x7fe55c138c30 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fe560a80700 1 -- 172.21.15.59:0/940565194 >> 172.21.15.59:0/940565194 conn(0x7fe55c066f50 msgr2=0x7fe55c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:35.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fc3daafc700 1 -- 172.21.15.59:0/3565204199 wait complete. 2023-09-30T22:32:35.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fe560a80700 1 -- 172.21.15.59:0/940565194 shutdown_connections 2023-09-30T22:32:35.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.928+0000 7fe560a80700 1 -- 172.21.15.59:0/940565194 wait complete. 2023-09-30T22:32:35.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.929+0000 7f7a7df8c700 1 Processor -- start 2023-09-30T22:32:35.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.929+0000 7fc3daafc700 1 Processor -- start 2023-09-30T22:32:35.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.929+0000 7fc3daafc700 1 -- start start 2023-09-30T22:32:35.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7fe560a80700 1 Processor -- start 2023-09-30T22:32:35.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7fe560a80700 1 -- start start 2023-09-30T22:32:35.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7fc3daafc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d409d630 0x7fc3d4126020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7fc3daafc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d40a0a30 0x7fc3d4126560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7fc3daafc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3d4133930 0x7fc3d4126aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7fc3daafc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4128210 con 0x7fc3d40a0a30 2023-09-30T22:32:35.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7fc3daafc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4128f40 con 0x7fc3d409d630 2023-09-30T22:32:35.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7fc3daafc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d40a4030 con 0x7fc3d4133930 2023-09-30T22:32:35.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7f7a7df8c700 1 -- start start 2023-09-30T22:32:35.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7f7a7df8c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a7809d630 0x7f7a78138000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7f7a7df8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a780a0a30 0x7f7a78138540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7f7a7df8c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a78138d80 0x7f7a7806dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7f7a7df8c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7806ef70 con 0x7f7a78138d80 2023-09-30T22:32:35.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7f7a7df8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780715e0 con 0x7f7a780a0a30 2023-09-30T22:32:35.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7f7a7df8c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7813ad10 con 0x7f7a7809d630 2023-09-30T22:32:35.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7fc3d3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d40a0a30 0x7fc3d4126560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:35.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7fc3d3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d40a0a30 0x7fc3d4126560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56418/0 (socket says 172.21.15.59:56418) 2023-09-30T22:32:35.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fc3d3fff700 1 -- 172.21.15.59:0/2453286458 learned_addr learned my addr 172.21.15.59:0/2453286458 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:35.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fc3d9099700 1 --2- 172.21.15.59:0/2453286458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3d4133930 0x7fc3d4126aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:35.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fc3d8898700 1 --2- 172.21.15.59:0/2453286458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d409d630 0x7fc3d4126020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:35.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.930+0000 7fe560a80700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe55c09d6f0 0x7fe55c11f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fe560a80700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe55c09e1d0 0x7fe55c11fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fe560a80700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe55c139170 0x7fe55c1c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:35.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fe560a80700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c11ef30 con 0x7fe55c139170 2023-09-30T22:32:35.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fe560a80700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c0721e0 con 0x7fe55c09e1d0 2023-09-30T22:32:35.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fe560a80700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c09c710 con 0x7fe55c09d6f0 2023-09-30T22:32:35.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fe55ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe55c139170 0x7fe55c1c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:35.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fe55ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe55c139170 0x7fe55c1c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56422/0 (socket says 172.21.15.59:56422) 2023-09-30T22:32:35.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fe55ad9d700 1 -- 172.21.15.59:0/2194540260 learned_addr learned my addr 172.21.15.59:0/2194540260 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:35.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7f7a77fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a78138d80 0x7f7a7806dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:35.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7f7a77fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a78138d80 0x7f7a7806dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56436/0 (socket says 172.21.15.59:56436) 2023-09-30T22:32:35.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7f7a77fff700 1 -- 172.21.15.59:0/3193171144 learned_addr learned my addr 172.21.15.59:0/3193171144 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:35.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7f7a777fe700 1 --2- 172.21.15.59:0/3193171144 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a7809d630 0x7f7a78138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:35.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7f7a76ffd700 1 --2- 172.21.15.59:0/3193171144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a780a0a30 0x7f7a78138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:35.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7f7a777fe700 1 -- 172.21.15.59:0/3193171144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a780a0a30 msgr2=0x7f7a78138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:35.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7f7a777fe700 1 --2- 172.21.15.59:0/3193171144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a780a0a30 0x7f7a78138540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7f7a777fe700 1 -- 172.21.15.59:0/3193171144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a78138d80 msgr2=0x7f7a7806dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:35.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7f7a777fe700 1 --2- 172.21.15.59:0/3193171144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a78138d80 0x7f7a7806dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7f7a777fe700 1 -- 172.21.15.59:0/3193171144 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a70009b30 con 0x7f7a7809d630 2023-09-30T22:32:35.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fe559d9b700 1 --2- 172.21.15.59:0/2194540260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe55c09e1d0 0x7fe55c11fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:35.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fc3d9099700 1 -- 172.21.15.59:0/2453286458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d409d630 msgr2=0x7fc3d4126020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:35.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fc3d9099700 1 --2- 172.21.15.59:0/2453286458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d409d630 0x7fc3d4126020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fc3d9099700 1 -- 172.21.15.59:0/2453286458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d40a0a30 msgr2=0x7fc3d4126560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:35.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fc3d9099700 1 --2- 172.21.15.59:0/2453286458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d40a0a30 0x7fc3d4126560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.931+0000 7fc3d9099700 1 -- 172.21.15.59:0/2453286458 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c0009550 con 0x7fc3d4133930 2023-09-30T22:32:35.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.932+0000 7fe55ad9d700 1 -- 172.21.15.59:0/2194540260 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe55c09d6f0 msgr2=0x7fe55c11f580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:32:35.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.932+0000 7fe55ad9d700 1 --2- 172.21.15.59:0/2194540260 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe55c09d6f0 0x7fe55c11f580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.932+0000 7fe55ad9d700 1 -- 172.21.15.59:0/2194540260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe55c09e1d0 msgr2=0x7fe55c11fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:35.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.932+0000 7fe55ad9d700 1 --2- 172.21.15.59:0/2194540260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe55c09e1d0 0x7fe55c11fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:35.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.932+0000 7fe55ad9d700 1 -- 172.21.15.59:0/2194540260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5500094a0 con 0x7fe55c139170 2023-09-30T22:32:35.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.932+0000 7fe559d9b700 1 --2- 172.21.15.59:0/2194540260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe55c09e1d0 0x7fe55c11fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:35.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.932+0000 7fc3d9099700 1 --2- 172.21.15.59:0/2453286458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3d4133930 0x7fc3d4126aa0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc007dc0 tx=0x7fc3cc00e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:35.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.932+0000 7f7a777fe700 1 --2- 172.21.15.59:0/3193171144 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a7809d630 0x7f7a78138000 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7a68000f60 tx=0x7f7a6800c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:35.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.932+0000 7fe55ad9d700 1 --2- 172.21.15.59:0/2194540260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe55c139170 0x7fe55c1c83d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe55400b9e0 tx=0x7fe55400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:35.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.933+0000 7fc3d17fa700 1 -- 172.21.15.59:0/2453286458 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc018070 con 0x7fc3d4133930 2023-09-30T22:32:35.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.933+0000 7fc3d17fa700 1 -- 172.21.15.59:0/2453286458 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc00eb30 con 0x7fc3d4133930 2023-09-30T22:32:35.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.933+0000 7fc3d17fa700 1 -- 172.21.15.59:0/2453286458 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00eec0 con 0x7fc3d4133930 2023-09-30T22:32:35.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.932+0000 7f7a5ffff700 1 -- 172.21.15.59:0/3193171144 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680052d0 con 0x7f7a7809d630 2023-09-30T22:32:35.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.933+0000 7f7a5ffff700 1 -- 172.21.15.59:0/3193171144 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a68005430 con 0x7f7a7809d630 2023-09-30T22:32:35.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.933+0000 7f7a5ffff700 1 -- 172.21.15.59:0/3193171144 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680038c0 con 0x7f7a7809d630 2023-09-30T22:32:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.933+0000 7f7a7df8c700 1 -- 172.21.15.59:0/3193171144 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a780a0410 con 0x7f7a7809d630 2023-09-30T22:32:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.933+0000 7f7a7df8c700 1 -- 172.21.15.59:0/3193171144 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7812f530 con 0x7f7a7809d630 2023-09-30T22:32:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.932+0000 7fe54affd700 1 -- 172.21.15.59:0/2194540260 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55400c9b0 con 0x7fe55c139170 2023-09-30T22:32:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.933+0000 7fe54affd700 1 -- 172.21.15.59:0/2194540260 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55400cb50 con 0x7fe55c139170 2023-09-30T22:32:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.933+0000 7fe54affd700 1 -- 172.21.15.59:0/2194540260 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554014440 con 0x7fe55c139170 2023-09-30T22:32:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.933+0000 7fe560a80700 1 -- 172.21.15.59:0/2194540260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55c121f80 con 0x7fe55c139170 2023-09-30T22:32:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.933+0000 7fe560a80700 1 -- 172.21.15.59:0/2194540260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55c121280 con 0x7fe55c139170 2023-09-30T22:32:35.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.934+0000 7f7a5ffff700 1 -- 172.21.15.59:0/3193171144 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a68003a20 con 0x7f7a7809d630 2023-09-30T22:32:35.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.934+0000 7fc3daafc700 1 -- 172.21.15.59:0/2453286458 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d41295c0 con 0x7fc3d4133930 2023-09-30T22:32:35.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.934+0000 7fc3daafc700 1 -- 172.21.15.59:0/2453286458 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d4129290 con 0x7fc3d4133930 2023-09-30T22:32:35.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.934+0000 7fe560a80700 1 -- 172.21.15.59:0/2194540260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55c122110 con 0x7fe55c139170 2023-09-30T22:32:35.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.934+0000 7f7a5ffff700 1 -- 172.21.15.59:0/3193171144 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7a6803eb90 con 0x7f7a7809d630 2023-09-30T22:32:35.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.934+0000 7f7a7df8c700 1 -- 172.21.15.59:0/3193171144 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a78070d40 con 0x7f7a7809d630 2023-09-30T22:32:35.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.935+0000 7fc3daafc700 1 -- 172.21.15.59:0/2453286458 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d4129750 con 0x7fc3d4133930 2023-09-30T22:32:35.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.935+0000 7fc3d17fa700 1 -- 172.21.15.59:0/2453286458 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3cc003a20 con 0x7fc3d4133930 2023-09-30T22:32:35.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.935+0000 7fc3d17fa700 1 -- 172.21.15.59:0/2453286458 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc3cc03f690 con 0x7fc3d4133930 2023-09-30T22:32:35.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.938+0000 7fe54affd700 1 -- 172.21.15.59:0/2194540260 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5540145a0 con 0x7fe55c139170 2023-09-30T22:32:35.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.938+0000 7fe54affd700 1 -- 172.21.15.59:0/2194540260 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe554006e40 con 0x7fe55c139170 2023-09-30T22:32:35.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.940+0000 7fe54affd700 1 -- 172.21.15.59:0/2194540260 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe55401d3b0 con 0x7fe55c139170 2023-09-30T22:32:35.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.945+0000 7f7a5ffff700 1 -- 172.21.15.59:0/3193171144 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a68017080 con 0x7f7a7809d630 2023-09-30T22:32:35.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:35.945+0000 7fc3d17fa700 1 -- 172.21.15.59:0/2453286458 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3d4129750 con 0x7fc3d4133930 2023-09-30T22:32:36.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.013+0000 7f6426e35700 1 Processor -- start 2023-09-30T22:32:36.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.013+0000 7f6426e35700 1 -- start start 2023-09-30T22:32:36.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.014+0000 7f6426e35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6420131810 0x7f6420131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:36.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.014+0000 7f6426e35700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f642009a580 0x7f6420139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:36.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.014+0000 7f6426e35700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64201313c0 con 0x7f6420099a40 2023-09-30T22:32:36.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.014+0000 7f6426e35700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642009b580 con 0x7f642009a580 2023-09-30T22:32:36.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.014+0000 7f6426e35700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f642006e8c0 con 0x7f6420131810 2023-09-30T22:32:36.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.014+0000 7f6424bd1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6420131810 0x7f6420131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:36.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.014+0000 7f6424bd1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6420131810 0x7f6420131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39456/0 (socket says 172.21.15.59:39456) 2023-09-30T22:32:36.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.014+0000 7f6424bd1700 1 -- 172.21.15.59:0/2101429187 learned_addr learned my addr 172.21.15.59:0/2101429187 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:36.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.014+0000 7f64253d2700 1 --2- 172.21.15.59:0/2101429187 >> v2:172.21.15.59:3300/0 conn(0x7f642009a580 0x7f6420139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:36.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.015+0000 7f64253d2700 1 -- 172.21.15.59:0/2101429187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6420131810 msgr2=0x7f6420131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:36.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.015+0000 7f64253d2700 1 --2- 172.21.15.59:0/2101429187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6420131810 0x7f6420131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.015+0000 7f64253d2700 1 -- 172.21.15.59:0/2101429187 >> v1:172.21.15.59:6789/0 conn(0x7f6420099a40 legacy=0x7f6420099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:36.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.015+0000 7f64253d2700 1 -- 172.21.15.59:0/2101429187 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6420071d20 con 0x7f642009a580 2023-09-30T22:32:36.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.015+0000 7f6424bd1700 1 --2- 172.21.15.59:0/2101429187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6420131810 0x7f6420131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:36.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.015+0000 7f64253d2700 1 --2- 172.21.15.59:0/2101429187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f642009a580 0x7f6420139660 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6418009d90 tx=0x7f641800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57939c97da09ead server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:36.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.015+0000 7f641f7fe700 1 -- 172.21.15.59:0/2101429187 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641800e070 con 0x7f642009a580 2023-09-30T22:32:36.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.015+0000 7f641f7fe700 1 -- 172.21.15.59:0/2101429187 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6418003a20 con 0x7f642009a580 2023-09-30T22:32:36.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.015+0000 7f641f7fe700 1 -- 172.21.15.59:0/2101429187 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418003dd0 con 0x7f642009a580 2023-09-30T22:32:36.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.016+0000 7f6426e35700 1 -- 172.21.15.59:0/2101429187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f642009a580 msgr2=0x7f6420139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:36.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.016+0000 7f6426e35700 1 --2- 172.21.15.59:0/2101429187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f642009a580 0x7f6420139660 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6418009d90 tx=0x7f641800b330 comp rx=0 tx=0).stop 2023-09-30T22:32:36.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.016+0000 7f6426e35700 1 -- 172.21.15.59:0/2101429187 shutdown_connections 2023-09-30T22:32:36.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.016+0000 7f6426e35700 1 --2- 172.21.15.59:0/2101429187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f642009a580 0x7f6420139660 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.016+0000 7f6426e35700 1 --2- 172.21.15.59:0/2101429187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6420131810 0x7f6420131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.016+0000 7f6426e35700 1 -- 172.21.15.59:0/2101429187 >> 172.21.15.59:0/2101429187 conn(0x7f64200a2aa0 msgr2=0x7f64200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:36.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.016+0000 7f6426e35700 1 -- 172.21.15.59:0/2101429187 shutdown_connections 2023-09-30T22:32:36.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.016+0000 7f6426e35700 1 -- 172.21.15.59:0/2101429187 wait complete. 2023-09-30T22:32:36.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.018+0000 7f6426e35700 1 Processor -- start 2023-09-30T22:32:36.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.018+0000 7f6426e35700 1 -- start start 2023-09-30T22:32:36.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.019+0000 7f6426e35700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6420099a40 0x7f6420128490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:36.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.019+0000 7f6426e35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642009a580 0x7f64201289d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:36.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.019+0000 7f6426e35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6420131810 0x7f6420128f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:36.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.019+0000 7f6426e35700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64201295b0 con 0x7f6420099a40 2023-09-30T22:32:36.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.019+0000 7f6426e35700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6420071870 con 0x7f642009a580 2023-09-30T22:32:36.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.019+0000 7f6426e35700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f642012aff0 con 0x7f6420131810 2023-09-30T22:32:36.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.019+0000 7f6424bd1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6420099a40 0x7f6420128490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:36.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.019+0000 7f6424bd1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6420099a40 0x7f6420128490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56452/0 (socket says 172.21.15.59:56452) 2023-09-30T22:32:36.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.019+0000 7f6424bd1700 1 -- 172.21.15.59:0/1291761218 learned_addr learned my addr 172.21.15.59:0/1291761218 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:36.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.019+0000 7f64253d2700 1 --2- 172.21.15.59:0/1291761218 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6420131810 0x7f6420128f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:36.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.019+0000 7f6424bd1700 1 -- 172.21.15.59:0/1291761218 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6420131810 msgr2=0x7f6420128f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:36.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.019+0000 7f6424bd1700 1 --2- 172.21.15.59:0/1291761218 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6420131810 0x7f6420128f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.019+0000 7f6424bd1700 1 -- 172.21.15.59:0/1291761218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642009a580 msgr2=0x7f64201289d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:36.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.019+0000 7f6424bd1700 1 --2- 172.21.15.59:0/1291761218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642009a580 0x7f64201289d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.019+0000 7f6424bd1700 1 -- 172.21.15.59:0/1291761218 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6414009550 con 0x7f6420099a40 2023-09-30T22:32:36.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.020+0000 7f6424bd1700 1 --2- 172.21.15.59:0/1291761218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6420099a40 0x7f6420128490 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f641400ebe0 tx=0x7f641400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:36.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.020+0000 7f641d7fa700 1 -- 172.21.15.59:0/1291761218 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641400c850 con 0x7f6420099a40 2023-09-30T22:32:36.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.020+0000 7f641d7fa700 1 -- 172.21.15.59:0/1291761218 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641400c9b0 con 0x7f6420099a40 2023-09-30T22:32:36.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.020+0000 7f6426e35700 1 -- 172.21.15.59:0/1291761218 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6418009a70 con 0x7f6420099a40 2023-09-30T22:32:36.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.020+0000 7f641d7fa700 1 -- 172.21.15.59:0/1291761218 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641400cd20 con 0x7f6420099a40 2023-09-30T22:32:36.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.020+0000 7f6426e35700 1 -- 172.21.15.59:0/1291761218 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6420072250 con 0x7f6420099a40 2023-09-30T22:32:36.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.021+0000 7f641d7fa700 1 -- 172.21.15.59:0/1291761218 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6414013470 con 0x7f6420099a40 2023-09-30T22:32:36.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.021+0000 7f641d7fa700 1 -- 172.21.15.59:0/1291761218 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f641403f820 con 0x7f6420099a40 2023-09-30T22:32:36.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.021+0000 7f6426e35700 1 -- 172.21.15.59:0/1291761218 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642012bbd0 con 0x7f6420099a40 2023-09-30T22:32:36.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.026+0000 7f641d7fa700 1 -- 172.21.15.59:0/1291761218 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f64140232f0 con 0x7f6420099a40 2023-09-30T22:32:36.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.149+0000 7fe560a80700 1 -- 172.21.15.59:0/2194540260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe55c09f420 con 0x7fe55c139170 2023-09-30T22:32:36.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.149+0000 7fe54affd700 1 -- 172.21.15.59:0/2194540260 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe554019020 con 0x7fe55c139170 2023-09-30T22:32:36.150 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:36.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.151+0000 7fe560a80700 1 -- 172.21.15.59:0/2194540260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe55c139170 msgr2=0x7fe55c1c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:36.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.151+0000 7fe560a80700 1 --2- 172.21.15.59:0/2194540260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe55c139170 0x7fe55c1c83d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe55400b9e0 tx=0x7fe55400bda0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.151+0000 7fe560a80700 1 -- 172.21.15.59:0/2194540260 shutdown_connections 2023-09-30T22:32:36.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.151+0000 7fe560a80700 1 --2- 172.21.15.59:0/2194540260 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe55c09d6f0 0x7fe55c11f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.151+0000 7fe560a80700 1 --2- 172.21.15.59:0/2194540260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe55c139170 0x7fe55c1c83d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.151+0000 7fe560a80700 1 --2- 172.21.15.59:0/2194540260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe55c09e1d0 0x7fe55c11fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.151+0000 7fe560a80700 1 -- 172.21.15.59:0/2194540260 >> 172.21.15.59:0/2194540260 conn(0x7fe55c066f50 msgr2=0x7fe55c136c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:36.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.152+0000 7fe560a80700 1 -- 172.21.15.59:0/2194540260 shutdown_connections 2023-09-30T22:32:36.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.152+0000 7fe560a80700 1 -- 172.21.15.59:0/2194540260 wait complete. 2023-09-30T22:32:36.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.153+0000 7f7a7df8c700 1 -- 172.21.15.59:0/3193171144 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7a780747f0 con 0x7f7a7809d630 2023-09-30T22:32:36.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.154+0000 7f7a5ffff700 1 -- 172.21.15.59:0/3193171144 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a68018260 con 0x7f7a7809d630 2023-09-30T22:32:36.155 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:36.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.156+0000 7f7a7df8c700 1 -- 172.21.15.59:0/3193171144 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a7809d630 msgr2=0x7f7a78138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:36.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.156+0000 7f7a7df8c700 1 --2- 172.21.15.59:0/3193171144 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a7809d630 0x7f7a78138000 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7a68000f60 tx=0x7f7a6800c730 comp rx=0 tx=0).stop 2023-09-30T22:32:36.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.157+0000 7f7a7df8c700 1 -- 172.21.15.59:0/3193171144 shutdown_connections 2023-09-30T22:32:36.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.157+0000 7f7a7df8c700 1 --2- 172.21.15.59:0/3193171144 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a7809d630 0x7f7a78138000 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.157+0000 7f7a7df8c700 1 --2- 172.21.15.59:0/3193171144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a78138d80 0x7f7a7806dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.157+0000 7f7a7df8c700 1 --2- 172.21.15.59:0/3193171144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a780a0a30 0x7f7a78138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.157+0000 7f7a7df8c700 1 -- 172.21.15.59:0/3193171144 >> 172.21.15.59:0/3193171144 conn(0x7f7a780a3050 msgr2=0x7f7a7809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:36.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.158+0000 7f7a7df8c700 1 -- 172.21.15.59:0/3193171144 shutdown_connections 2023-09-30T22:32:36.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.158+0000 7f7a7df8c700 1 -- 172.21.15.59:0/3193171144 wait complete. 2023-09-30T22:32:36.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:36.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:36.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.193+0000 7fc3daafc700 1 -- 172.21.15.59:0/2453286458 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc3d4129750 con 0x7fc3d4133930 2023-09-30T22:32:36.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.193+0000 7fc3d17fa700 1 -- 172.21.15.59:0/2453286458 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3d4129750 con 0x7fc3d4133930 2023-09-30T22:32:36.194 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:36.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.195+0000 7fc3daafc700 1 -- 172.21.15.59:0/2453286458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3d4133930 msgr2=0x7fc3d4126aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:36.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.195+0000 7fc3daafc700 1 --2- 172.21.15.59:0/2453286458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3d4133930 0x7fc3d4126aa0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc007dc0 tx=0x7fc3cc00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.196+0000 7fc3daafc700 1 -- 172.21.15.59:0/2453286458 shutdown_connections 2023-09-30T22:32:36.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.196+0000 7fc3daafc700 1 --2- 172.21.15.59:0/2453286458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3d4133930 0x7fc3d4126aa0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.196+0000 7fc3daafc700 1 --2- 172.21.15.59:0/2453286458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d409d630 0x7fc3d4126020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.196+0000 7fc3daafc700 1 --2- 172.21.15.59:0/2453286458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d40a0a30 0x7fc3d4126560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.196+0000 7fc3daafc700 1 -- 172.21.15.59:0/2453286458 >> 172.21.15.59:0/2453286458 conn(0x7fc3d40a3050 msgr2=0x7fc3d409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:36.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.196+0000 7fc3daafc700 1 -- 172.21.15.59:0/2453286458 shutdown_connections 2023-09-30T22:32:36.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.196+0000 7fc3daafc700 1 -- 172.21.15.59:0/2453286458 wait complete. 2023-09-30T22:32:36.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:36.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.272+0000 7f6426e35700 1 -- 172.21.15.59:0/1291761218 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f642006eb00 con 0x7f6420099a40 2023-09-30T22:32:36.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.272+0000 7f641d7fa700 1 -- 172.21.15.59:0/1291761218 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6414021030 con 0x7f6420099a40 2023-09-30T22:32:36.273 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:36.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.274+0000 7f6426e35700 1 -- 172.21.15.59:0/1291761218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6420099a40 msgr2=0x7f6420128490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:36.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.274+0000 7f6426e35700 1 --2- 172.21.15.59:0/1291761218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6420099a40 0x7f6420128490 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f641400ebe0 tx=0x7f641400eef0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.274+0000 7f6426e35700 1 -- 172.21.15.59:0/1291761218 shutdown_connections 2023-09-30T22:32:36.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.274+0000 7f6426e35700 1 --2- 172.21.15.59:0/1291761218 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6420131810 0x7f6420128f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.274+0000 7f6426e35700 1 --2- 172.21.15.59:0/1291761218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6420099a40 0x7f6420128490 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.274+0000 7f6426e35700 1 --2- 172.21.15.59:0/1291761218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f642009a580 0x7f64201289d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:36.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.274+0000 7f6426e35700 1 -- 172.21.15.59:0/1291761218 >> 172.21.15.59:0/1291761218 conn(0x7f64200a2aa0 msgr2=0x7f64200a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:36.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.275+0000 7f6426e35700 1 -- 172.21.15.59:0/1291761218 shutdown_connections 2023-09-30T22:32:36.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:36.275+0000 7f6426e35700 1 -- 172.21.15.59:0/1291761218 wait complete. 2023-09-30T22:32:36.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:37.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:37.175 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:37.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:37.290 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.324+0000 7fe698b7e700 1 Processor -- start 2023-09-30T22:32:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.324+0000 7fe698b7e700 1 -- start start 2023-09-30T22:32:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.325+0000 7fe698b7e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69409d6f0 0x7fe69409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.325+0000 7fe698b7e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe69409e410 0x7fe694134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.325+0000 7fe698b7e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69409b120 con 0x7fe69409e000 2023-09-30T22:32:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.325+0000 7fe698b7e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69406b460 con 0x7fe69409e410 2023-09-30T22:32:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.325+0000 7fe698b7e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe69409a7e0 con 0x7fe69409d6f0 2023-09-30T22:32:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.325+0000 7fe69259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69409d6f0 0x7fe69409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.325+0000 7fe69259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69409d6f0 0x7fe69409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39484/0 (socket says 172.21.15.59:39484) 2023-09-30T22:32:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.325+0000 7fe691d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe69409e000 0x7fe6941339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52494/0 (socket says 172.21.15.59:52494) 2023-09-30T22:32:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.325+0000 7fe69259c700 1 -- 172.21.15.59:0/538793946 learned_addr learned my addr 172.21.15.59:0/538793946 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.325+0000 7fe692d9d700 1 --2- 172.21.15.59:0/538793946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe69409e410 0x7fe694134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.326+0000 7fe69259c700 1 -- 172.21.15.59:0/538793946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe69409e410 msgr2=0x7fe694134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.326+0000 7fe69259c700 1 --2- 172.21.15.59:0/538793946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe69409e410 0x7fe694134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.326+0000 7fe69259c700 1 -- 172.21.15.59:0/538793946 >> v1:172.21.15.59:6789/0 conn(0x7fe69409e000 legacy=0x7fe6941339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.326+0000 7fe69159a700 1 -- 172.21.15.59:0/538793946 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586456804 0 0) 0x7fe69409b120 con 0x7fe69409e000 2023-09-30T22:32:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.326+0000 7fe69259c700 1 -- 172.21.15.59:0/538793946 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69409a500 con 0x7fe69409d6f0 2023-09-30T22:32:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.326+0000 7fe69259c700 1 --2- 172.21.15.59:0/538793946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69409d6f0 0x7fe69409dac0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe684009950 tx=0x7fe684009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa5a8b97b39ef4e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.326+0000 7fe69159a700 1 -- 172.21.15.59:0/538793946 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe684009ea0 con 0x7fe69409d6f0 2023-09-30T22:32:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.326+0000 7fe69159a700 1 -- 172.21.15.59:0/538793946 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68400ba20 con 0x7fe69409d6f0 2023-09-30T22:32:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.326+0000 7fe69159a700 1 -- 172.21.15.59:0/538793946 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68400bdb0 con 0x7fe69409d6f0 2023-09-30T22:32:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.327+0000 7fe698b7e700 1 -- 172.21.15.59:0/538793946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69409d6f0 msgr2=0x7fe69409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.327+0000 7fe698b7e700 1 --2- 172.21.15.59:0/538793946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69409d6f0 0x7fe69409dac0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe684009950 tx=0x7fe684009c60 comp rx=0 tx=0).stop 2023-09-30T22:32:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.327+0000 7fe698b7e700 1 -- 172.21.15.59:0/538793946 shutdown_connections 2023-09-30T22:32:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.327+0000 7fe698b7e700 1 --2- 172.21.15.59:0/538793946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69409d6f0 0x7fe69409dac0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.327+0000 7fe698b7e700 1 --2- 172.21.15.59:0/538793946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe69409e410 0x7fe694134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.327+0000 7fe698b7e700 1 -- 172.21.15.59:0/538793946 >> 172.21.15.59:0/538793946 conn(0x7fe694066f50 msgr2=0x7fe69409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.327+0000 7fe698b7e700 1 -- 172.21.15.59:0/538793946 shutdown_connections 2023-09-30T22:32:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.327+0000 7fe698b7e700 1 -- 172.21.15.59:0/538793946 wait complete. 2023-09-30T22:32:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.328+0000 7fe698b7e700 1 Processor -- start 2023-09-30T22:32:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.328+0000 7fe698b7e700 1 -- start start 2023-09-30T22:32:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.329+0000 7fe698b7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe69409d6f0 0x7fe694122260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.329+0000 7fe698b7e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69409e000 0x7fe6941227a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.329+0000 7fe698b7e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe69409e410 0x7fe694122ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.329+0000 7fe698b7e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe694125850 con 0x7fe69409d6f0 2023-09-30T22:32:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.329+0000 7fe698b7e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe694125b40 con 0x7fe69409e410 2023-09-30T22:32:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.329+0000 7fe698b7e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe694123e70 con 0x7fe69409e000 2023-09-30T22:32:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.329+0000 7fe69259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe69409d6f0 0x7fe694122260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.329+0000 7fe691d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69409e000 0x7fe6941227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.329+0000 7fe69259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe69409d6f0 0x7fe694122260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56468/0 (socket says 172.21.15.59:56468) 2023-09-30T22:32:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.329+0000 7fe691d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69409e000 0x7fe6941227a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39492/0 (socket says 172.21.15.59:39492) 2023-09-30T22:32:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.329+0000 7fe69259c700 1 -- 172.21.15.59:0/3620829571 learned_addr learned my addr 172.21.15.59:0/3620829571 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.329+0000 7fe692d9d700 1 --2- 172.21.15.59:0/3620829571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe69409e410 0x7fe694122ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.330+0000 7fe691d9b700 1 -- 172.21.15.59:0/3620829571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe69409e410 msgr2=0x7fe694122ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.330+0000 7fe691d9b700 1 --2- 172.21.15.59:0/3620829571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe69409e410 0x7fe694122ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.330+0000 7fe691d9b700 1 -- 172.21.15.59:0/3620829571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe69409d6f0 msgr2=0x7fe694122260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.330+0000 7fe691d9b700 1 --2- 172.21.15.59:0/3620829571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe69409d6f0 0x7fe694122260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.330+0000 7fe691d9b700 1 -- 172.21.15.59:0/3620829571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe684009550 con 0x7fe69409e000 2023-09-30T22:32:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.330+0000 7fe69259c700 1 --2- 172.21.15.59:0/3620829571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe69409d6f0 0x7fe694122260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.330+0000 7fe691d9b700 1 --2- 172.21.15.59:0/3620829571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69409e000 0x7fe6941227a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe68800c4b0 tx=0x7fe68800c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.330+0000 7fe682ffd700 1 -- 172.21.15.59:0/3620829571 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688004c80 con 0x7fe69409e000 2023-09-30T22:32:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.330+0000 7fe682ffd700 1 -- 172.21.15.59:0/3620829571 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe688004e00 con 0x7fe69409e000 2023-09-30T22:32:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.330+0000 7fe682ffd700 1 -- 172.21.15.59:0/3620829571 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688007310 con 0x7fe69409e000 2023-09-30T22:32:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.330+0000 7fe698b7e700 1 -- 172.21.15.59:0/3620829571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe694124d00 con 0x7fe69409e000 2023-09-30T22:32:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.330+0000 7fe698b7e700 1 -- 172.21.15.59:0/3620829571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69409c710 con 0x7fe69409e000 2023-09-30T22:32:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.332+0000 7fe682ffd700 1 -- 172.21.15.59:0/3620829571 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe688007470 con 0x7fe69409e000 2023-09-30T22:32:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.332+0000 7fe698b7e700 1 -- 172.21.15.59:0/3620829571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69411f030 con 0x7fe69409e000 2023-09-30T22:32:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.332+0000 7fe682ffd700 1 -- 172.21.15.59:0/3620829571 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe68803f390 con 0x7fe69409e000 2023-09-30T22:32:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.341+0000 7fe682ffd700 1 -- 172.21.15.59:0/3620829571 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe68801a6c0 con 0x7fe69409e000 2023-09-30T22:32:37.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.364+0000 7f5db4935700 1 Processor -- start 2023-09-30T22:32:37.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.364+0000 7f5db4935700 1 -- start start 2023-09-30T22:32:37.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.365+0000 7f5db4935700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db009d6f0 0x7f5db009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.365+0000 7f5db4935700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5db009e000 0x7f5db0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.365+0000 7f5db4935700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db009e410 0x7f5db0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.365+0000 7f5db4935700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db009f520 con 0x7f5db009e000 2023-09-30T22:32:37.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.365+0000 7f5db4935700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db009f130 con 0x7f5db009e410 2023-09-30T22:32:37.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.365+0000 7f5db4935700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5db009e930 con 0x7f5db009d6f0 2023-09-30T22:32:37.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.365+0000 7f5daed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db009e410 0x7f5db0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.365+0000 7f5dae59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db009d6f0 0x7f5db009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.365+0000 7f5daed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db009e410 0x7f5db0130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60766/0 (socket says 172.21.15.59:60766) 2023-09-30T22:32:37.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.365+0000 7f5dae59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db009d6f0 0x7f5db009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39500/0 (socket says 172.21.15.59:39500) 2023-09-30T22:32:37.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.365+0000 7f5daed9d700 1 -- 172.21.15.59:0/3369003033 learned_addr learned my addr 172.21.15.59:0/3369003033 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:37.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.365+0000 7f5dadd9b700 1 --2- 172.21.15.59:0/3369003033 >> v2:172.21.15.59:3300/0 conn(0x7f5db009e000 0x7f5db0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.366+0000 7f5dae59c700 1 -- 172.21.15.59:0/3369003033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db009e410 msgr2=0x7f5db0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:37.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.366+0000 7f5dae59c700 1 --2- 172.21.15.59:0/3369003033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db009e410 0x7f5db0130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.366+0000 7f5dae59c700 1 -- 172.21.15.59:0/3369003033 >> v2:172.21.15.59:3300/0 conn(0x7f5db009e000 msgr2=0x7f5db0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:37.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.366+0000 7f5dae59c700 1 --2- 172.21.15.59:0/3369003033 >> v2:172.21.15.59:3300/0 conn(0x7f5db009e000 0x7f5db0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.366+0000 7f5dae59c700 1 -- 172.21.15.59:0/3369003033 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db009b2d0 con 0x7f5db009d6f0 2023-09-30T22:32:37.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.366+0000 7f5dae59c700 1 --2- 172.21.15.59:0/3369003033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db009d6f0 0x7f5db009dac0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009870 tx=0x7f5da0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=860978519750d117 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.366+0000 7f5dad59a700 1 -- 172.21.15.59:0/3369003033 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0011830 con 0x7f5db009d6f0 2023-09-30T22:32:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.366+0000 7f5dad59a700 1 -- 172.21.15.59:0/3369003033 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da0011990 con 0x7f5db009d6f0 2023-09-30T22:32:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.366+0000 7f5dad59a700 1 -- 172.21.15.59:0/3369003033 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0011d20 con 0x7f5db009d6f0 2023-09-30T22:32:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.367+0000 7f5db4935700 1 -- 172.21.15.59:0/3369003033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db009d6f0 msgr2=0x7f5db009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.367+0000 7f5db4935700 1 --2- 172.21.15.59:0/3369003033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db009d6f0 0x7f5db009dac0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009870 tx=0x7f5da0009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.367+0000 7f5db4935700 1 -- 172.21.15.59:0/3369003033 shutdown_connections 2023-09-30T22:32:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.367+0000 7f5db4935700 1 --2- 172.21.15.59:0/3369003033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db009e410 0x7f5db0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.367+0000 7f5db4935700 1 --2- 172.21.15.59:0/3369003033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db009d6f0 0x7f5db009dac0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.367+0000 7f5db4935700 1 --2- 172.21.15.59:0/3369003033 >> v2:172.21.15.59:3300/0 conn(0x7f5db009e000 0x7f5db0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.367+0000 7f5db4935700 1 -- 172.21.15.59:0/3369003033 >> 172.21.15.59:0/3369003033 conn(0x7f5db0066f50 msgr2=0x7f5db009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:37.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.368+0000 7f5db4935700 1 -- 172.21.15.59:0/3369003033 shutdown_connections 2023-09-30T22:32:37.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.368+0000 7f5db4935700 1 -- 172.21.15.59:0/3369003033 wait complete. 2023-09-30T22:32:37.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.369+0000 7f5db4935700 1 Processor -- start 2023-09-30T22:32:37.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.369+0000 7f5db4935700 1 -- start start 2023-09-30T22:32:37.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.370+0000 7f5db4935700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db009d6f0 0x7f5db01c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.370+0000 7f5db4935700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db009e000 0x7f5db01c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.370+0000 7f5db4935700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db009e410 0x7f5db01c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.370+0000 7f5db4935700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db0130f10 con 0x7f5db009e000 2023-09-30T22:32:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.370+0000 7f5db4935700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db0072410 con 0x7f5db009d6f0 2023-09-30T22:32:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.370+0000 7f5db4935700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5db009c700 con 0x7f5db009e410 2023-09-30T22:32:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.370+0000 7f5daed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db009e410 0x7f5db01c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.370+0000 7f5daed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db009e410 0x7f5db01c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39510/0 (socket says 172.21.15.59:39510) 2023-09-30T22:32:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.370+0000 7f5daed9d700 1 -- 172.21.15.59:0/4207335348 learned_addr learned my addr 172.21.15.59:0/4207335348 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.370+0000 7f5dadd9b700 1 --2- 172.21.15.59:0/4207335348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db009e000 0x7f5db01c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.370+0000 7f5dae59c700 1 --2- 172.21.15.59:0/4207335348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db009d6f0 0x7f5db01c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.370+0000 7f5daed9d700 1 -- 172.21.15.59:0/4207335348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db009d6f0 msgr2=0x7f5db01c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.370+0000 7f5daed9d700 1 --2- 172.21.15.59:0/4207335348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db009d6f0 0x7f5db01c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.371+0000 7f5daed9d700 1 -- 172.21.15.59:0/4207335348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db009e000 msgr2=0x7f5db01c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.371+0000 7f5daed9d700 1 --2- 172.21.15.59:0/4207335348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db009e000 0x7f5db01c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.371+0000 7f5daed9d700 1 -- 172.21.15.59:0/4207335348 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da00094a0 con 0x7f5db009e410 2023-09-30T22:32:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.371+0000 7f5dadd9b700 1 --2- 172.21.15.59:0/4207335348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db009e000 0x7f5db01c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.371+0000 7f5daed9d700 1 --2- 172.21.15.59:0/4207335348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db009e410 0x7f5db01c81b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5da800efc0 tx=0x7f5da800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.371+0000 7f5d9effd700 1 -- 172.21.15.59:0/4207335348 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8003c20 con 0x7f5db009e410 2023-09-30T22:32:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.371+0000 7f5d9effd700 1 -- 172.21.15.59:0/4207335348 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da800f040 con 0x7f5db009e410 2023-09-30T22:32:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.371+0000 7f5d9effd700 1 -- 172.21.15.59:0/4207335348 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8009e60 con 0x7f5db009e410 2023-09-30T22:32:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.371+0000 7f5db4935700 1 -- 172.21.15.59:0/4207335348 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db0138440 con 0x7f5db009e410 2023-09-30T22:32:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.371+0000 7f5db4935700 1 -- 172.21.15.59:0/4207335348 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db011a040 con 0x7f5db009e410 2023-09-30T22:32:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.372+0000 7f5d9effd700 1 -- 172.21.15.59:0/4207335348 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5da800c880 con 0x7f5db009e410 2023-09-30T22:32:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.372+0000 7f5db4935700 1 -- 172.21.15.59:0/4207335348 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db0074ea0 con 0x7f5db009e410 2023-09-30T22:32:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.373+0000 7f5d9effd700 1 -- 172.21.15.59:0/4207335348 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5da803f9d0 con 0x7f5db009e410 2023-09-30T22:32:37.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.376+0000 7f61f9147700 1 Processor -- start 2023-09-30T22:32:37.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.376+0000 7f61f9147700 1 -- start start 2023-09-30T22:32:37.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.377+0000 7f61f9147700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f41316c0 0x7f61f4131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.377+0000 7f61f9147700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f409ed20 0x7f61f406eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.377+0000 7f61f9147700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f409b420 con 0x7f61f4131fd0 2023-09-30T22:32:37.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.377+0000 7f61f9147700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f41314a0 con 0x7f61f41316c0 2023-09-30T22:32:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.377+0000 7f61f9147700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61f4099ce0 con 0x7f61f409ed20 2023-09-30T22:32:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.377+0000 7f61f2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f41316c0 0x7f61f4131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.377+0000 7f61f259c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f61f4131fd0 0x7f61f406e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52500/0 (socket says 172.21.15.59:52500) 2023-09-30T22:32:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.377+0000 7f61f259c700 1 -- 172.21.15.59:0/3673415356 learned_addr learned my addr 172.21.15.59:0/3673415356 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.378+0000 7f61f359e700 1 --2- 172.21.15.59:0/3673415356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f409ed20 0x7f61f406eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.378+0000 7f61f2d9d700 1 -- 172.21.15.59:0/3673415356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f409ed20 msgr2=0x7f61f406eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.378+0000 7f61f2d9d700 1 --2- 172.21.15.59:0/3673415356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f409ed20 0x7f61f406eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.378+0000 7f61f2d9d700 1 -- 172.21.15.59:0/3673415356 >> v1:172.21.15.59:6789/0 conn(0x7f61f4131fd0 legacy=0x7f61f406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.378+0000 7f61f2d9d700 1 -- 172.21.15.59:0/3673415356 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f409a510 con 0x7f61f41316c0 2023-09-30T22:32:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.378+0000 7f5d9effd700 1 -- 172.21.15.59:0/4207335348 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5da8013db0 con 0x7f5db009e410 2023-09-30T22:32:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.378+0000 7f61f2d9d700 1 --2- 172.21.15.59:0/3673415356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f41316c0 0x7f61f4131a90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009870 tx=0x7f61e4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba7e4b7e89265a8d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.378+0000 7f61f1d9b700 1 -- 172.21.15.59:0/3673415356 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4004230 con 0x7f61f41316c0 2023-09-30T22:32:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.378+0000 7f61f1d9b700 1 -- 172.21.15.59:0/3673415356 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e4004390 con 0x7f61f41316c0 2023-09-30T22:32:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.378+0000 7f61f1d9b700 1 -- 172.21.15.59:0/3673415356 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e40036a0 con 0x7f61f41316c0 2023-09-30T22:32:37.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.382+0000 7f61f9147700 1 -- 172.21.15.59:0/3673415356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f41316c0 msgr2=0x7f61f4131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.382+0000 7f61f9147700 1 --2- 172.21.15.59:0/3673415356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f41316c0 0x7f61f4131a90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009870 tx=0x7f61e4009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:37.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.382+0000 7f61f9147700 1 -- 172.21.15.59:0/3673415356 shutdown_connections 2023-09-30T22:32:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.382+0000 7f61f9147700 1 --2- 172.21.15.59:0/3673415356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f409ed20 0x7f61f406eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.382+0000 7f61f9147700 1 --2- 172.21.15.59:0/3673415356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f41316c0 0x7f61f4131a90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.382+0000 7f61f9147700 1 -- 172.21.15.59:0/3673415356 >> 172.21.15.59:0/3673415356 conn(0x7f61f40a2aa0 msgr2=0x7f61f40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.382+0000 7f61f9147700 1 -- 172.21.15.59:0/3673415356 shutdown_connections 2023-09-30T22:32:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.382+0000 7f61f9147700 1 -- 172.21.15.59:0/3673415356 wait complete. 2023-09-30T22:32:37.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.384+0000 7f61f9147700 1 Processor -- start 2023-09-30T22:32:37.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.384+0000 7f61f9147700 1 -- start start 2023-09-30T22:32:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.384+0000 7f61f9147700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f409ed20 0x7f61f4134f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.384+0000 7f61f9147700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f41316c0 0x7f61f4135440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.384+0000 7f61f9147700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f4131fd0 0x7f61f4135980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.384+0000 7f61f9147700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f4138480 con 0x7f61f41316c0 2023-09-30T22:32:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.384+0000 7f61f9147700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f4138b20 con 0x7f61f4131fd0 2023-09-30T22:32:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.384+0000 7f61f9147700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61f41378d0 con 0x7f61f409ed20 2023-09-30T22:32:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.385+0000 7f61f359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f4131fd0 0x7f61f4135980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.385+0000 7f61f259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f41316c0 0x7f61f4135440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.385+0000 7f61f359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f4131fd0 0x7f61f4135980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60782/0 (socket says 172.21.15.59:60782) 2023-09-30T22:32:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.385+0000 7f61f359e700 1 -- 172.21.15.59:0/1201085074 learned_addr learned my addr 172.21.15.59:0/1201085074 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.385+0000 7f61f2d9d700 1 --2- 172.21.15.59:0/1201085074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f409ed20 0x7f61f4134f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.385+0000 7f61f359e700 1 -- 172.21.15.59:0/1201085074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f409ed20 msgr2=0x7f61f4134f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.385+0000 7f61f359e700 1 --2- 172.21.15.59:0/1201085074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f409ed20 0x7f61f4134f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.385+0000 7f61f359e700 1 -- 172.21.15.59:0/1201085074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f41316c0 msgr2=0x7f61f4135440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.385+0000 7f61f359e700 1 --2- 172.21.15.59:0/1201085074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f41316c0 0x7f61f4135440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.385+0000 7f61f359e700 1 -- 172.21.15.59:0/1201085074 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e40094a0 con 0x7f61f4131fd0 2023-09-30T22:32:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.385+0000 7f61f259c700 1 --2- 172.21.15.59:0/1201085074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f41316c0 0x7f61f4135440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:37.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.385+0000 7f61f359e700 1 --2- 172.21.15.59:0/1201085074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f4131fd0 0x7f61f4135980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00efc0 tx=0x7f61ec00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:37.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.385+0000 7f61db7fe700 1 -- 172.21.15.59:0/1201085074 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec00cd40 con 0x7f61f4131fd0 2023-09-30T22:32:37.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.386+0000 7f61db7fe700 1 -- 172.21.15.59:0/1201085074 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec00f040 con 0x7f61f4131fd0 2023-09-30T22:32:37.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.386+0000 7f61db7fe700 1 -- 172.21.15.59:0/1201085074 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec0146c0 con 0x7f61f4131fd0 2023-09-30T22:32:37.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.386+0000 7f61f9147700 1 -- 172.21.15.59:0/1201085074 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f4130920 con 0x7f61f4131fd0 2023-09-30T22:32:37.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.386+0000 7f61f9147700 1 -- 172.21.15.59:0/1201085074 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f4136b10 con 0x7f61f4131fd0 2023-09-30T22:32:37.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.387+0000 7f61db7fe700 1 -- 172.21.15.59:0/1201085074 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61ec014820 con 0x7f61f4131fd0 2023-09-30T22:32:37.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.387+0000 7f61db7fe700 1 -- 172.21.15.59:0/1201085074 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f61ec040310 con 0x7f61f4131fd0 2023-09-30T22:32:37.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.387+0000 7f61f9147700 1 -- 172.21.15.59:0/1201085074 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f4138960 con 0x7f61f4131fd0 2023-09-30T22:32:37.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.392+0000 7f61db7fe700 1 -- 172.21.15.59:0/1201085074 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61f4138960 con 0x7f61f4131fd0 2023-09-30T22:32:37.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.462+0000 7f9535f70700 1 Processor -- start 2023-09-30T22:32:37.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.462+0000 7f9535f70700 1 -- start start 2023-09-30T22:32:37.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.462+0000 7f9535f70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9530133a80 0x7f9530133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.462+0000 7f9535f70700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9530130a40 0x7f953013b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.462+0000 7f9535f70700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953006bc00 con 0x7f953012ff20 2023-09-30T22:32:37.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.462+0000 7f9535f70700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953006c570 con 0x7f9530133a80 2023-09-30T22:32:37.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.462+0000 7f9535f70700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95300a0040 con 0x7f9530130a40 2023-09-30T22:32:37.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.463+0000 7f952f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9530133a80 0x7f9530133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.463+0000 7f952f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9530133a80 0x7f9530133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60786/0 (socket says 172.21.15.59:60786) 2023-09-30T22:32:37.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.463+0000 7f952f7fe700 1 -- 172.21.15.59:0/307579643 learned_addr learned my addr 172.21.15.59:0/307579643 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:37.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.463+0000 7f952f7fe700 1 -- 172.21.15.59:0/307579643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9530130a40 msgr2=0x7f953013b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:37.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.463+0000 7f952f7fe700 1 --2- 172.21.15.59:0/307579643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9530130a40 0x7f953013b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.463+0000 7f952f7fe700 1 -- 172.21.15.59:0/307579643 >> v1:172.21.15.59:6789/0 conn(0x7f953012ff20 legacy=0x7f9530130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.463+0000 7f952f7fe700 1 -- 172.21.15.59:0/307579643 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9530133860 con 0x7f9530133a80 2023-09-30T22:32:37.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.463+0000 7f952f7fe700 1 --2- 172.21.15.59:0/307579643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9530133a80 0x7f9530133e50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9520009920 tx=0x7f9520009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5392b77b3c4e9886 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:37.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.463+0000 7f952e7fc700 1 -- 172.21.15.59:0/307579643 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000ba60 con 0x7f9530133a80 2023-09-30T22:32:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.464+0000 7f952e7fc700 1 -- 172.21.15.59:0/307579643 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952000bbc0 con 0x7f9530133a80 2023-09-30T22:32:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.464+0000 7f952e7fc700 1 -- 172.21.15.59:0/307579643 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520009e70 con 0x7f9530133a80 2023-09-30T22:32:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.464+0000 7f9535f70700 1 -- 172.21.15.59:0/307579643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9530133a80 msgr2=0x7f9530133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.464+0000 7f9535f70700 1 --2- 172.21.15.59:0/307579643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9530133a80 0x7f9530133e50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9520009920 tx=0x7f9520009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.464+0000 7f9535f70700 1 -- 172.21.15.59:0/307579643 shutdown_connections 2023-09-30T22:32:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.465+0000 7f9535f70700 1 --2- 172.21.15.59:0/307579643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9530130a40 0x7f953013b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.465+0000 7f9535f70700 1 --2- 172.21.15.59:0/307579643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9530133a80 0x7f9530133e50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.465+0000 7f9535f70700 1 -- 172.21.15.59:0/307579643 >> 172.21.15.59:0/307579643 conn(0x7f95300a4210 msgr2=0x7f95300a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.465+0000 7f9535f70700 1 -- 172.21.15.59:0/307579643 shutdown_connections 2023-09-30T22:32:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.465+0000 7f9535f70700 1 -- 172.21.15.59:0/307579643 wait complete. 2023-09-30T22:32:37.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.466+0000 7f9535f70700 1 Processor -- start 2023-09-30T22:32:37.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.466+0000 7f9535f70700 1 -- start start 2023-09-30T22:32:37.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.467+0000 7f9535f70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f953012ff20 0x7f953009c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.467+0000 7f9535f70700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9530130a40 0x7f953009ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.467+0000 7f9535f70700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9530133a80 0x7f953009cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.467+0000 7f9535f70700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953009e0c0 con 0x7f9530133a80 2023-09-30T22:32:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.467+0000 7f9535f70700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953012d850 con 0x7f953012ff20 2023-09-30T22:32:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.467+0000 7f9535f70700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f953011fe10 con 0x7f9530130a40 2023-09-30T22:32:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.467+0000 7f952f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f953012ff20 0x7f953009c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.467+0000 7f952ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9530133a80 0x7f953009cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.467+0000 7f952f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f953012ff20 0x7f953009c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60790/0 (socket says 172.21.15.59:60790) 2023-09-30T22:32:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.467+0000 7f952f7fe700 1 -- 172.21.15.59:0/1489484083 learned_addr learned my addr 172.21.15.59:0/1489484083 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.467+0000 7f952effd700 1 --2- 172.21.15.59:0/1489484083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9530130a40 0x7f953009ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.468+0000 7f952ffff700 1 -- 172.21.15.59:0/1489484083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9530130a40 msgr2=0x7f953009ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.468+0000 7f952ffff700 1 --2- 172.21.15.59:0/1489484083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9530130a40 0x7f953009ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.468+0000 7f952ffff700 1 -- 172.21.15.59:0/1489484083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f953012ff20 msgr2=0x7f953009c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.468+0000 7f952ffff700 1 --2- 172.21.15.59:0/1489484083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f953012ff20 0x7f953009c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.468+0000 7f952ffff700 1 -- 172.21.15.59:0/1489484083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9520009550 con 0x7f9530133a80 2023-09-30T22:32:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.468+0000 7f952ffff700 1 --2- 172.21.15.59:0/1489484083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9530133a80 0x7f953009cf50 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f952800be20 tx=0x7f9528009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.468+0000 7f9517fff700 1 -- 172.21.15.59:0/1489484083 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952800cc10 con 0x7f9530133a80 2023-09-30T22:32:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.468+0000 7f9517fff700 1 -- 172.21.15.59:0/1489484083 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952800cd90 con 0x7f9530133a80 2023-09-30T22:32:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.468+0000 7f9535f70700 1 -- 172.21.15.59:0/1489484083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95301200d0 con 0x7f9530133a80 2023-09-30T22:32:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.468+0000 7f9517fff700 1 -- 172.21.15.59:0/1489484083 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528014680 con 0x7f9530133a80 2023-09-30T22:32:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.468+0000 7f9535f70700 1 -- 172.21.15.59:0/1489484083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953012d390 con 0x7f9530133a80 2023-09-30T22:32:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.469+0000 7f9517fff700 1 -- 172.21.15.59:0/1489484083 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f952801d3b0 con 0x7f9530133a80 2023-09-30T22:32:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.470+0000 7f9517fff700 1 -- 172.21.15.59:0/1489484083 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9528006e40 con 0x7f9530133a80 2023-09-30T22:32:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.470+0000 7f9535f70700 1 -- 172.21.15.59:0/1489484083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9530134600 con 0x7f9530133a80 2023-09-30T22:32:37.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.479+0000 7f9517fff700 1 -- 172.21.15.59:0/1489484083 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9528019070 con 0x7f9530133a80 2023-09-30T22:32:37.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.567+0000 7fe698b7e700 1 -- 172.21.15.59:0/3620829571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe694074ea0 con 0x7fe69409e000 2023-09-30T22:32:37.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.567+0000 7fe682ffd700 1 -- 172.21.15.59:0/3620829571 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe68801b340 con 0x7fe69409e000 2023-09-30T22:32:37.568 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:37.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.570+0000 7fe698b7e700 1 -- 172.21.15.59:0/3620829571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69409e000 msgr2=0x7fe6941227a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.570+0000 7fe698b7e700 1 --2- 172.21.15.59:0/3620829571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69409e000 0x7fe6941227a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe68800c4b0 tx=0x7fe68800c7c0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.571+0000 7fe698b7e700 1 -- 172.21.15.59:0/3620829571 shutdown_connections 2023-09-30T22:32:37.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.571+0000 7fe698b7e700 1 --2- 172.21.15.59:0/3620829571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe69409e410 0x7fe694122ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.571+0000 7fe698b7e700 1 --2- 172.21.15.59:0/3620829571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe69409d6f0 0x7fe694122260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.571+0000 7fe698b7e700 1 --2- 172.21.15.59:0/3620829571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe69409e000 0x7fe6941227a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.571+0000 7fe698b7e700 1 -- 172.21.15.59:0/3620829571 >> 172.21.15.59:0/3620829571 conn(0x7fe694066f50 msgr2=0x7fe694133e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:37.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.572+0000 7fe698b7e700 1 -- 172.21.15.59:0/3620829571 shutdown_connections 2023-09-30T22:32:37.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.572+0000 7fe698b7e700 1 -- 172.21.15.59:0/3620829571 wait complete. 2023-09-30T22:32:37.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.606+0000 7f61f9147700 1 -- 172.21.15.59:0/1201085074 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f61f4138960 con 0x7f61f4131fd0 2023-09-30T22:32:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.606+0000 7f61db7fe700 1 -- 172.21.15.59:0/1201085074 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61ec02c090 con 0x7f61f4131fd0 2023-09-30T22:32:37.607 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:37.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.609+0000 7f61f9147700 1 -- 172.21.15.59:0/1201085074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f4131fd0 msgr2=0x7f61f4135980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.609+0000 7f61f9147700 1 --2- 172.21.15.59:0/1201085074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f4131fd0 0x7f61f4135980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00efc0 tx=0x7f61ec00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.609+0000 7f61f9147700 1 -- 172.21.15.59:0/1201085074 shutdown_connections 2023-09-30T22:32:37.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.609+0000 7f61f9147700 1 --2- 172.21.15.59:0/1201085074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f409ed20 0x7f61f4134f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.609+0000 7f61f9147700 1 --2- 172.21.15.59:0/1201085074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f4131fd0 0x7f61f4135980 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.609+0000 7f61f9147700 1 --2- 172.21.15.59:0/1201085074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f41316c0 0x7f61f4135440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.609+0000 7f61f9147700 1 -- 172.21.15.59:0/1201085074 >> 172.21.15.59:0/1201085074 conn(0x7f61f40a2aa0 msgr2=0x7f61f4070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:37.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.609+0000 7f61f9147700 1 -- 172.21.15.59:0/1201085074 shutdown_connections 2023-09-30T22:32:37.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.609+0000 7f61f9147700 1 -- 172.21.15.59:0/1201085074 wait complete. 2023-09-30T22:32:37.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:37.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.629+0000 7f5db4935700 1 -- 172.21.15.59:0/4207335348 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5db006c360 con 0x7f5db009e410 2023-09-30T22:32:37.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.629+0000 7f5d9effd700 1 -- 172.21.15.59:0/4207335348 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5da8013bd0 con 0x7f5db009e410 2023-09-30T22:32:37.631 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:37.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.632+0000 7f5db4935700 1 -- 172.21.15.59:0/4207335348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db009e410 msgr2=0x7f5db01c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.632+0000 7f5db4935700 1 --2- 172.21.15.59:0/4207335348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db009e410 0x7f5db01c81b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5da800efc0 tx=0x7f5da800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.632+0000 7f5db4935700 1 -- 172.21.15.59:0/4207335348 shutdown_connections 2023-09-30T22:32:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.632+0000 7f5db4935700 1 --2- 172.21.15.59:0/4207335348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5db009e410 0x7f5db01c81b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.632+0000 7f5db4935700 1 --2- 172.21.15.59:0/4207335348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5db009d6f0 0x7f5db01c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.632+0000 7f5db4935700 1 --2- 172.21.15.59:0/4207335348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db009e000 0x7f5db01c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.632+0000 7f5db4935700 1 -- 172.21.15.59:0/4207335348 >> 172.21.15.59:0/4207335348 conn(0x7f5db0066f50 msgr2=0x7f5db006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.632+0000 7f5db4935700 1 -- 172.21.15.59:0/4207335348 shutdown_connections 2023-09-30T22:32:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.632+0000 7f5db4935700 1 -- 172.21.15.59:0/4207335348 wait complete. 2023-09-30T22:32:37.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:37.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.688+0000 7f9535f70700 1 -- 172.21.15.59:0/1489484083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9530074ea0 con 0x7f9530133a80 2023-09-30T22:32:37.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.688+0000 7f9517fff700 1 -- 172.21.15.59:0/1489484083 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f952801c360 con 0x7f9530133a80 2023-09-30T22:32:37.689 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:37.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.690+0000 7f9535f70700 1 -- 172.21.15.59:0/1489484083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9530133a80 msgr2=0x7f953009cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:37.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.690+0000 7f9535f70700 1 --2- 172.21.15.59:0/1489484083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9530133a80 0x7f953009cf50 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f952800be20 tx=0x7f9528009ed0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.690+0000 7f9535f70700 1 -- 172.21.15.59:0/1489484083 shutdown_connections 2023-09-30T22:32:37.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.690+0000 7f9535f70700 1 --2- 172.21.15.59:0/1489484083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9530133a80 0x7f953009cf50 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.690+0000 7f9535f70700 1 --2- 172.21.15.59:0/1489484083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f953012ff20 0x7f953009c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.690+0000 7f9535f70700 1 --2- 172.21.15.59:0/1489484083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9530130a40 0x7f953009ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:37.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.690+0000 7f9535f70700 1 -- 172.21.15.59:0/1489484083 >> 172.21.15.59:0/1489484083 conn(0x7f95300a4210 msgr2=0x7f95301313b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:37.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.690+0000 7f9535f70700 1 -- 172.21.15.59:0/1489484083 shutdown_connections 2023-09-30T22:32:37.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:37.690+0000 7f9535f70700 1 -- 172.21.15.59:0/1489484083 wait complete. 2023-09-30T22:32:37.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:38.588 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:38.625 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:38.647 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:38.705 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:38.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.748+0000 7f81fdb5c700 1 Processor -- start 2023-09-30T22:32:38.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.748+0000 7f81fdb5c700 1 -- start start 2023-09-30T22:32:38.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.748+0000 7f81fdb5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81f809e1d0 0x7f81f8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.748+0000 7f81fdb5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81f8139170 0x7f81f813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.748+0000 7f81fdb5c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f809b120 con 0x7f81f809d6f0 2023-09-30T22:32:38.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.748+0000 7f81fdb5c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f806b460 con 0x7f81f809e1d0 2023-09-30T22:32:38.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.749+0000 7f81fdb5c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81f809a7e0 con 0x7f81f8139170 2023-09-30T22:32:38.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.749+0000 7f81f77fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f81f809d6f0 0x7f81f809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52522/0 (socket says 172.21.15.59:52522) 2023-09-30T22:32:38.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.749+0000 7f81f77fe700 1 -- 172.21.15.59:0/3560806711 learned_addr learned my addr 172.21.15.59:0/3560806711 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:38.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.749+0000 7f81f6ffd700 1 --2- 172.21.15.59:0/3560806711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81f809e1d0 0x7f81f8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.749+0000 7f81f7fff700 1 --2- 172.21.15.59:0/3560806711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81f8139170 0x7f81f813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.749+0000 7f81f6ffd700 1 -- 172.21.15.59:0/3560806711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81f8139170 msgr2=0x7f81f813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:38.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.749+0000 7f81f6ffd700 1 --2- 172.21.15.59:0/3560806711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81f8139170 0x7f81f813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.749+0000 7f81f6ffd700 1 -- 172.21.15.59:0/3560806711 >> v1:172.21.15.59:6789/0 conn(0x7f81f809d6f0 legacy=0x7f81f809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.749+0000 7f81f6ffd700 1 -- 172.21.15.59:0/3560806711 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f809a500 con 0x7f81f809e1d0 2023-09-30T22:32:38.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.749+0000 7f81f67fc700 1 -- 172.21.15.59:0/3560806711 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114997572 0 0) 0x7f81f809b120 con 0x7f81f809d6f0 2023-09-30T22:32:38.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.750+0000 7f81f6ffd700 1 --2- 172.21.15.59:0/3560806711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81f809e1d0 0x7f81f8138c30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009870 tx=0x7f81ec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59a3e2b1c6620000 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:38.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.750+0000 7f81f67fc700 1 -- 172.21.15.59:0/3560806711 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec011830 con 0x7f81f809e1d0 2023-09-30T22:32:38.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.750+0000 7f81f67fc700 1 -- 172.21.15.59:0/3560806711 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec011990 con 0x7f81f809e1d0 2023-09-30T22:32:38.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.750+0000 7f81f67fc700 1 -- 172.21.15.59:0/3560806711 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec011d20 con 0x7f81f809e1d0 2023-09-30T22:32:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.751+0000 7f81fdb5c700 1 -- 172.21.15.59:0/3560806711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81f809e1d0 msgr2=0x7f81f8138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.751+0000 7f81fdb5c700 1 --2- 172.21.15.59:0/3560806711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81f809e1d0 0x7f81f8138c30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009870 tx=0x7f81ec009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.751+0000 7f81fdb5c700 1 -- 172.21.15.59:0/3560806711 shutdown_connections 2023-09-30T22:32:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.751+0000 7f81fdb5c700 1 --2- 172.21.15.59:0/3560806711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81f8139170 0x7f81f813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.751+0000 7f81fdb5c700 1 --2- 172.21.15.59:0/3560806711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81f809e1d0 0x7f81f8138c30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.751+0000 7f81fdb5c700 1 -- 172.21.15.59:0/3560806711 >> 172.21.15.59:0/3560806711 conn(0x7f81f8066f50 msgr2=0x7f81f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:38.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.751+0000 7f81fdb5c700 1 -- 172.21.15.59:0/3560806711 shutdown_connections 2023-09-30T22:32:38.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.751+0000 7f81fdb5c700 1 -- 172.21.15.59:0/3560806711 wait complete. 2023-09-30T22:32:38.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.753+0000 7f81fdb5c700 1 Processor -- start 2023-09-30T22:32:38.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.753+0000 7f81fdb5c700 1 -- start start 2023-09-30T22:32:38.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81fdb5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81f809d6f0 0x7f81f81206a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81fdb5c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f809e1d0 0x7f81f8120be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81fdb5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81f8139170 0x7f81f8121120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81fdb5c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8122450 con 0x7f81f809e1d0 2023-09-30T22:32:38.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81fdb5c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8122260 con 0x7f81f8139170 2023-09-30T22:32:38.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81fdb5c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81f809c710 con 0x7f81f809d6f0 2023-09-30T22:32:38.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81f77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81f809d6f0 0x7f81f81206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81f77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81f809d6f0 0x7f81f81206a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39564/0 (socket says 172.21.15.59:39564) 2023-09-30T22:32:38.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81f77fe700 1 -- 172.21.15.59:0/1777543132 learned_addr learned my addr 172.21.15.59:0/1777543132 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:38.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81f6ffd700 1 --2- 172.21.15.59:0/1777543132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f809e1d0 0x7f81f8120be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81f7fff700 1 --2- 172.21.15.59:0/1777543132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81f8139170 0x7f81f8121120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81f77fe700 1 -- 172.21.15.59:0/1777543132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81f8139170 msgr2=0x7f81f8121120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81f77fe700 1 --2- 172.21.15.59:0/1777543132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81f8139170 0x7f81f8121120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81f77fe700 1 -- 172.21.15.59:0/1777543132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f809e1d0 msgr2=0x7f81f8120be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81f77fe700 1 --2- 172.21.15.59:0/1777543132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f809e1d0 0x7f81f8120be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.754+0000 7f81f77fe700 1 -- 172.21.15.59:0/1777543132 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec0094a0 con 0x7f81f809d6f0 2023-09-30T22:32:38.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.755+0000 7f81f77fe700 1 --2- 172.21.15.59:0/1777543132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81f809d6f0 0x7f81f81206a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f81e80011e0 tx=0x7f81e800c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:38.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.755+0000 7f81dffff700 1 -- 172.21.15.59:0/1777543132 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e8015d70 con 0x7f81f809d6f0 2023-09-30T22:32:38.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.755+0000 7f81dffff700 1 -- 172.21.15.59:0/1777543132 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e8019070 con 0x7f81f809d6f0 2023-09-30T22:32:38.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.755+0000 7f81fdb5c700 1 -- 172.21.15.59:0/1777543132 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f8124170 con 0x7f81f809d6f0 2023-09-30T22:32:38.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.755+0000 7f81dffff700 1 -- 172.21.15.59:0/1777543132 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e8004ab0 con 0x7f81f809d6f0 2023-09-30T22:32:38.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.755+0000 7f81fdb5c700 1 -- 172.21.15.59:0/1777543132 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f8122a50 con 0x7f81f809d6f0 2023-09-30T22:32:38.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.756+0000 7f81fdb5c700 1 -- 172.21.15.59:0/1777543132 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f8074ea0 con 0x7f81f809d6f0 2023-09-30T22:32:38.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.757+0000 7f81dffff700 1 -- 172.21.15.59:0/1777543132 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81e8004c10 con 0x7f81f809d6f0 2023-09-30T22:32:38.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.757+0000 7f81dffff700 1 -- 172.21.15.59:0/1777543132 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f81e8047980 con 0x7f81f809d6f0 2023-09-30T22:32:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.766+0000 7f81dffff700 1 -- 172.21.15.59:0/1777543132 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81e80268f0 con 0x7f81f809d6f0 2023-09-30T22:32:38.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.779+0000 7fa4df52c700 1 Processor -- start 2023-09-30T22:32:38.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.780+0000 7fa4df52c700 1 -- start start 2023-09-30T22:32:38.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.780+0000 7fa4df52c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d809de00 0x7fa4d809e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.780+0000 7fa4df52c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4d813d1f0 0x7fa4d813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.780+0000 7fa4df52c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d809a810 con 0x7fa4d806a770 2023-09-30T22:32:38.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.780+0000 7fa4df52c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d806ab40 con 0x7fa4d813d1f0 2023-09-30T22:32:38.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.780+0000 7fa4df52c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d809ebc0 con 0x7fa4d809de00 2023-09-30T22:32:38.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.781+0000 7fa4ddac9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4d813d1f0 0x7fa4d813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.781+0000 7fa4ddac9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4d813d1f0 0x7fa4d813f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56518/0 (socket says 172.21.15.59:56518) 2023-09-30T22:32:38.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.781+0000 7fa4ddac9700 1 -- 172.21.15.59:0/568412966 learned_addr learned my addr 172.21.15.59:0/568412966 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:38.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.781+0000 7fa4dcac7700 1 --2- 172.21.15.59:0/568412966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d809de00 0x7fa4d809e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.781+0000 7fa4dcac7700 1 -- 172.21.15.59:0/568412966 >> v2:172.21.15.59:3300/0 conn(0x7fa4d813d1f0 msgr2=0x7fa4d813f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:38.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.781+0000 7fa4dcac7700 1 --2- 172.21.15.59:0/568412966 >> v2:172.21.15.59:3300/0 conn(0x7fa4d813d1f0 0x7fa4d813f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.781+0000 7fa4dcac7700 1 -- 172.21.15.59:0/568412966 >> v1:172.21.15.59:6789/0 conn(0x7fa4d806a770 legacy=0x7fa4d809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.781+0000 7fa4dcac7700 1 -- 172.21.15.59:0/568412966 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d809e920 con 0x7fa4d809de00 2023-09-30T22:32:38.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.781+0000 7fa4dcac7700 1 --2- 172.21.15.59:0/568412966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d809de00 0x7fa4d809e250 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009840 tx=0x7fa4c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f125e48b18eafaac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:38.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.782+0000 7fa4cffff700 1 -- 172.21.15.59:0/568412966 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8011830 con 0x7fa4d809de00 2023-09-30T22:32:38.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.782+0000 7fa4cffff700 1 -- 172.21.15.59:0/568412966 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c8011990 con 0x7fa4d809de00 2023-09-30T22:32:38.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.782+0000 7fa4cffff700 1 -- 172.21.15.59:0/568412966 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8011d20 con 0x7fa4d809de00 2023-09-30T22:32:38.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.782+0000 7fa4df52c700 1 -- 172.21.15.59:0/568412966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d809de00 msgr2=0x7fa4d809e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.782+0000 7fa4df52c700 1 --2- 172.21.15.59:0/568412966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d809de00 0x7fa4d809e250 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009840 tx=0x7fa4c8009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:38.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.783+0000 7fa4df52c700 1 -- 172.21.15.59:0/568412966 shutdown_connections 2023-09-30T22:32:38.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.783+0000 7fa4df52c700 1 --2- 172.21.15.59:0/568412966 >> v2:172.21.15.59:3300/0 conn(0x7fa4d813d1f0 0x7fa4d813f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.783+0000 7fa4df52c700 1 --2- 172.21.15.59:0/568412966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d809de00 0x7fa4d809e250 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.783+0000 7fa4df52c700 1 -- 172.21.15.59:0/568412966 >> 172.21.15.59:0/568412966 conn(0x7fa4d8066f50 msgr2=0x7fa4d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:38.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.783+0000 7fa4df52c700 1 -- 172.21.15.59:0/568412966 shutdown_connections 2023-09-30T22:32:38.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.783+0000 7fa4df52c700 1 -- 172.21.15.59:0/568412966 wait complete. 2023-09-30T22:32:38.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.784+0000 7fa4df52c700 1 Processor -- start 2023-09-30T22:32:38.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.784+0000 7fa4df52c700 1 -- start start 2023-09-30T22:32:38.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.784+0000 7fa4df52c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d806a770 0x7fa4d813b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.784+0000 7fa4df52c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4d809de00 0x7fa4d813bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.784+0000 7fa4df52c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4d813d1f0 0x7fa4d813c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.784+0000 7fa4df52c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d8135ee0 con 0x7fa4d813d1f0 2023-09-30T22:32:38.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.784+0000 7fa4df52c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d811f110 con 0x7fa4d806a770 2023-09-30T22:32:38.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.784+0000 7fa4df52c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d811e8a0 con 0x7fa4d809de00 2023-09-30T22:32:38.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.784+0000 7fa4dcac7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4d809de00 0x7fa4d813bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.785+0000 7fa4dcac7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4d809de00 0x7fa4d813bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39576/0 (socket says 172.21.15.59:39576) 2023-09-30T22:32:38.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.785+0000 7fa4dcac7700 1 -- 172.21.15.59:0/1103412685 learned_addr learned my addr 172.21.15.59:0/1103412685 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:38.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.785+0000 7fa4ddac9700 1 --2- 172.21.15.59:0/1103412685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4d813d1f0 0x7fa4d813c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.785+0000 7fa4dd2c8700 1 --2- 172.21.15.59:0/1103412685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d806a770 0x7fa4d813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.785+0000 7fa4dcac7700 1 -- 172.21.15.59:0/1103412685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d806a770 msgr2=0x7fa4d813b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.785+0000 7fa4dcac7700 1 --2- 172.21.15.59:0/1103412685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d806a770 0x7fa4d813b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.785+0000 7fa4dcac7700 1 -- 172.21.15.59:0/1103412685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4d813d1f0 msgr2=0x7fa4d813c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.785+0000 7fa4dcac7700 1 --2- 172.21.15.59:0/1103412685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4d813d1f0 0x7fa4d813c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.785+0000 7fa4dcac7700 1 -- 172.21.15.59:0/1103412685 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c80094a0 con 0x7fa4d809de00 2023-09-30T22:32:38.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.785+0000 7fa4dd2c8700 1 --2- 172.21.15.59:0/1103412685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d806a770 0x7fa4d813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:38.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.785+0000 7fa4dcac7700 1 --2- 172.21.15.59:0/1103412685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4d809de00 0x7fa4d813bcc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80090b0 tx=0x7fa4c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:38.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.785+0000 7fa4cdffb700 1 -- 172.21.15.59:0/1103412685 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c80036a0 con 0x7fa4d809de00 2023-09-30T22:32:38.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.785+0000 7fa4cdffb700 1 -- 172.21.15.59:0/1103412685 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c801f070 con 0x7fa4d809de00 2023-09-30T22:32:38.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.785+0000 7fa4df52c700 1 -- 172.21.15.59:0/1103412685 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d809f1a0 con 0x7fa4d809de00 2023-09-30T22:32:38.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.786+0000 7fa4cdffb700 1 -- 172.21.15.59:0/1103412685 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8003a60 con 0x7fa4d809de00 2023-09-30T22:32:38.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.786+0000 7fa4df52c700 1 -- 172.21.15.59:0/1103412685 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d811e450 con 0x7fa4d809de00 2023-09-30T22:32:38.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.787+0000 7fa4cdffb700 1 -- 172.21.15.59:0/1103412685 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4c8003bc0 con 0x7fa4d809de00 2023-09-30T22:32:38.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.787+0000 7fa4cdffb700 1 -- 172.21.15.59:0/1103412685 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa4c8021070 con 0x7fa4d809de00 2023-09-30T22:32:38.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.787+0000 7fa4df52c700 1 -- 172.21.15.59:0/1103412685 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d8074ea0 con 0x7fa4d809de00 2023-09-30T22:32:38.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.792+0000 7fa4cdffb700 1 -- 172.21.15.59:0/1103412685 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4c8015020 con 0x7fa4d809de00 2023-09-30T22:32:38.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.831+0000 7f3d626c3700 1 Processor -- start 2023-09-30T22:32:38.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.831+0000 7f3d626c3700 1 -- start start 2023-09-30T22:32:38.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.831+0000 7f3d626c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d5c09e1d0 0x7f3d5c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.831+0000 7f3d626c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d5c135e50 0x7f3d5c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.831+0000 7f3d626c3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c09f130 con 0x7f3d5c09d6f0 2023-09-30T22:32:38.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.831+0000 7f3d626c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c09f520 con 0x7f3d5c135e50 2023-09-30T22:32:38.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.831+0000 7f3d626c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c09e930 con 0x7f3d5c09e1d0 2023-09-30T22:32:38.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.832+0000 7f3d5bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3d5c09d6f0 0x7f3d5c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52540/0 (socket says 172.21.15.59:52540) 2023-09-30T22:32:38.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.832+0000 7f3d5bfff700 1 -- 172.21.15.59:0/337600307 learned_addr learned my addr 172.21.15.59:0/337600307 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:38.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.832+0000 7f3d5b7fe700 1 --2- 172.21.15.59:0/337600307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d5c09e1d0 0x7f3d5c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.832+0000 7f3d60c60700 1 --2- 172.21.15.59:0/337600307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d5c135e50 0x7f3d5c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.832+0000 7f3d5affd700 1 -- 172.21.15.59:0/337600307 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411861924 0 0) 0x7f3d5c09f130 con 0x7f3d5c09d6f0 2023-09-30T22:32:38.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.832+0000 7f3d5b7fe700 1 -- 172.21.15.59:0/337600307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d5c135e50 msgr2=0x7f3d5c138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:38.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.832+0000 7f3d5b7fe700 1 --2- 172.21.15.59:0/337600307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d5c135e50 0x7f3d5c138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.832+0000 7f3d5b7fe700 1 -- 172.21.15.59:0/337600307 >> v1:172.21.15.59:6789/0 conn(0x7f3d5c09d6f0 legacy=0x7f3d5c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.832+0000 7f3d5b7fe700 1 -- 172.21.15.59:0/337600307 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c09b2d0 con 0x7f3d5c09e1d0 2023-09-30T22:32:38.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.832+0000 7f3d60c60700 1 --2- 172.21.15.59:0/337600307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d5c135e50 0x7f3d5c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:38.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.832+0000 7f3d5b7fe700 1 --2- 172.21.15.59:0/337600307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d5c09e1d0 0x7f3d5c135910 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009870 tx=0x7f3d50009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f73378fc4bcdfe31 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:38.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.833+0000 7f3d5affd700 1 -- 172.21.15.59:0/337600307 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50011830 con 0x7f3d5c09e1d0 2023-09-30T22:32:38.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.833+0000 7f3d5affd700 1 -- 172.21.15.59:0/337600307 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50011990 con 0x7f3d5c09e1d0 2023-09-30T22:32:38.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.833+0000 7f3d5affd700 1 -- 172.21.15.59:0/337600307 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50011d20 con 0x7f3d5c09e1d0 2023-09-30T22:32:38.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.834+0000 7f3d626c3700 1 -- 172.21.15.59:0/337600307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d5c09e1d0 msgr2=0x7f3d5c135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.834+0000 7f3d626c3700 1 --2- 172.21.15.59:0/337600307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d5c09e1d0 0x7f3d5c135910 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009870 tx=0x7f3d50009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:38.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.834+0000 7f3d626c3700 1 -- 172.21.15.59:0/337600307 shutdown_connections 2023-09-30T22:32:38.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.834+0000 7f3d626c3700 1 --2- 172.21.15.59:0/337600307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d5c135e50 0x7f3d5c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.834+0000 7f3d626c3700 1 --2- 172.21.15.59:0/337600307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d5c09e1d0 0x7f3d5c135910 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.834+0000 7f3d626c3700 1 -- 172.21.15.59:0/337600307 >> 172.21.15.59:0/337600307 conn(0x7f3d5c066f50 msgr2=0x7f3d5c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:38.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.834+0000 7f3d626c3700 1 -- 172.21.15.59:0/337600307 shutdown_connections 2023-09-30T22:32:38.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.834+0000 7f3d626c3700 1 -- 172.21.15.59:0/337600307 wait complete. 2023-09-30T22:32:38.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.835+0000 7f3d626c3700 1 Processor -- start 2023-09-30T22:32:38.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.835+0000 7f3d626c3700 1 -- start start 2023-09-30T22:32:38.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d626c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d5c09d6f0 0x7f3d5c1c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d626c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d5c09e1d0 0x7f3d5c1c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d626c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d5c135e50 0x7f3d5c1194f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d626c3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c11cdf0 con 0x7f3d5c09e1d0 2023-09-30T22:32:38.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d626c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c11b0e0 con 0x7f3d5c135e50 2023-09-30T22:32:38.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d626c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0725b0 con 0x7f3d5c09d6f0 2023-09-30T22:32:38.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d5bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d5c09d6f0 0x7f3d5c1c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d5bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d5c09d6f0 0x7f3d5c1c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39592/0 (socket says 172.21.15.59:39592) 2023-09-30T22:32:38.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d5bfff700 1 -- 172.21.15.59:0/1250303302 learned_addr learned my addr 172.21.15.59:0/1250303302 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:38.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d5b7fe700 1 --2- 172.21.15.59:0/1250303302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d5c09e1d0 0x7f3d5c1c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d60c60700 1 --2- 172.21.15.59:0/1250303302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d5c135e50 0x7f3d5c1194f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d5bfff700 1 -- 172.21.15.59:0/1250303302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d5c135e50 msgr2=0x7f3d5c1194f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d5bfff700 1 --2- 172.21.15.59:0/1250303302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d5c135e50 0x7f3d5c1194f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d5bfff700 1 -- 172.21.15.59:0/1250303302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d5c09e1d0 msgr2=0x7f3d5c1c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d5bfff700 1 --2- 172.21.15.59:0/1250303302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d5c09e1d0 0x7f3d5c1c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d5bfff700 1 -- 172.21.15.59:0/1250303302 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d500094a0 con 0x7f3d5c09d6f0 2023-09-30T22:32:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.836+0000 7f3d5bfff700 1 --2- 172.21.15.59:0/1250303302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d5c09d6f0 0x7f3d5c1c4340 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00c520 tx=0x7f3d4c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:38.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.837+0000 7f3d58ff9700 1 -- 172.21.15.59:0/1250303302 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c004c80 con 0x7f3d5c09d6f0 2023-09-30T22:32:38.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.837+0000 7f3d58ff9700 1 -- 172.21.15.59:0/1250303302 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c004de0 con 0x7f3d5c09d6f0 2023-09-30T22:32:38.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.837+0000 7f3d626c3700 1 -- 172.21.15.59:0/1250303302 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c09c700 con 0x7f3d5c09d6f0 2023-09-30T22:32:38.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.837+0000 7f3d58ff9700 1 -- 172.21.15.59:0/1250303302 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c007310 con 0x7f3d5c09d6f0 2023-09-30T22:32:38.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.837+0000 7f3d626c3700 1 -- 172.21.15.59:0/1250303302 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c1c4dc0 con 0x7f3d5c09d6f0 2023-09-30T22:32:38.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.838+0000 7f3d626c3700 1 -- 172.21.15.59:0/1250303302 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5c09a520 con 0x7f3d5c09d6f0 2023-09-30T22:32:38.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.838+0000 7f3d58ff9700 1 -- 172.21.15.59:0/1250303302 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d4c007470 con 0x7f3d5c09d6f0 2023-09-30T22:32:38.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.846+0000 7f3d58ff9700 1 -- 172.21.15.59:0/1250303302 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3d4c013df0 con 0x7f3d5c09d6f0 2023-09-30T22:32:38.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.847+0000 7f3d58ff9700 1 -- 172.21.15.59:0/1250303302 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d4c044060 con 0x7f3d5c09d6f0 2023-09-30T22:32:38.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.877+0000 7fae4a007700 1 Processor -- start 2023-09-30T22:32:38.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.877+0000 7fae4a007700 1 -- start start 2023-09-30T22:32:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.878+0000 7fae4a007700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae4406a770 0x7fae4409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.878+0000 7fae4a007700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae4409dc30 0x7fae4409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.878+0000 7fae4a007700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4409a810 con 0x7fae4413c1e0 2023-09-30T22:32:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.878+0000 7fae4a007700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4406ab40 con 0x7fae4409dc30 2023-09-30T22:32:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.878+0000 7fae4a007700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4409ebc0 con 0x7fae4406a770 2023-09-30T22:32:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.878+0000 7fae437fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae4406a770 0x7fae4409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.878+0000 7fae42ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae4409dc30 0x7fae4409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.878+0000 7fae437fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae4406a770 0x7fae4409d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60854/0 (socket says 172.21.15.59:60854) 2023-09-30T22:32:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.878+0000 7fae437fe700 1 -- 172.21.15.59:0/1754885686 learned_addr learned my addr 172.21.15.59:0/1754885686 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.878+0000 7fae437fe700 1 -- 172.21.15.59:0/1754885686 >> v2:172.21.15.59:3300/0 conn(0x7fae4409dc30 msgr2=0x7fae4409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.878+0000 7fae437fe700 1 --2- 172.21.15.59:0/1754885686 >> v2:172.21.15.59:3300/0 conn(0x7fae4409dc30 0x7fae4409e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.878+0000 7fae437fe700 1 -- 172.21.15.59:0/1754885686 >> v1:172.21.15.59:6789/0 conn(0x7fae4413c1e0 legacy=0x7fae4413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.878+0000 7fae437fe700 1 -- 172.21.15.59:0/1754885686 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4409e920 con 0x7fae4406a770 2023-09-30T22:32:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.878+0000 7fae437fe700 1 --2- 172.21.15.59:0/1754885686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae4406a770 0x7fae4409d6f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fae34009920 tx=0x7fae34009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b23db8261b157101 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.879+0000 7fae427fc700 1 -- 172.21.15.59:0/1754885686 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34011830 con 0x7fae4406a770 2023-09-30T22:32:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.879+0000 7fae427fc700 1 -- 172.21.15.59:0/1754885686 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae34011990 con 0x7fae4406a770 2023-09-30T22:32:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.879+0000 7fae427fc700 1 -- 172.21.15.59:0/1754885686 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34011d20 con 0x7fae4406a770 2023-09-30T22:32:38.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.880+0000 7fae4a007700 1 -- 172.21.15.59:0/1754885686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae4406a770 msgr2=0x7fae4409d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.880+0000 7fae4a007700 1 --2- 172.21.15.59:0/1754885686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae4406a770 0x7fae4409d6f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fae34009920 tx=0x7fae34009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:38.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.880+0000 7fae4a007700 1 -- 172.21.15.59:0/1754885686 shutdown_connections 2023-09-30T22:32:38.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.880+0000 7fae4a007700 1 --2- 172.21.15.59:0/1754885686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae4406a770 0x7fae4409d6f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.880+0000 7fae4a007700 1 --2- 172.21.15.59:0/1754885686 >> v2:172.21.15.59:3300/0 conn(0x7fae4409dc30 0x7fae4409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.880+0000 7fae4a007700 1 -- 172.21.15.59:0/1754885686 >> 172.21.15.59:0/1754885686 conn(0x7fae44066f50 msgr2=0x7fae4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:38.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.880+0000 7fae4a007700 1 -- 172.21.15.59:0/1754885686 shutdown_connections 2023-09-30T22:32:38.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.880+0000 7fae4a007700 1 -- 172.21.15.59:0/1754885686 wait complete. 2023-09-30T22:32:38.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.881+0000 7fae4a007700 1 Processor -- start 2023-09-30T22:32:38.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.881+0000 7fae4a007700 1 -- start start 2023-09-30T22:32:38.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.882+0000 7fae4a007700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae4406a770 0x7fae44126e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.882+0000 7fae4a007700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae4409dc30 0x7fae441273a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.882+0000 7fae4a007700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae4413c1e0 0x7fae441cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:38.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.882+0000 7fae4a007700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae44128b30 con 0x7fae4413c1e0 2023-09-30T22:32:38.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.882+0000 7fae4a007700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4413ad70 con 0x7fae4409dc30 2023-09-30T22:32:38.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.882+0000 7fae4a007700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae441269a0 con 0x7fae4406a770 2023-09-30T22:32:38.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.882+0000 7fae42ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae4409dc30 0x7fae441273a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.882+0000 7fae437fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae4406a770 0x7fae44126e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.882+0000 7fae43fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae4413c1e0 0x7fae441cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:38.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.882+0000 7fae437fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae4406a770 0x7fae44126e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39594/0 (socket says 172.21.15.59:39594) 2023-09-30T22:32:38.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.882+0000 7fae437fe700 1 -- 172.21.15.59:0/375828514 learned_addr learned my addr 172.21.15.59:0/375828514 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:38.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.882+0000 7fae42ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae4409dc30 0x7fae441273a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60862/0 (socket says 172.21.15.59:60862) 2023-09-30T22:32:38.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.883+0000 7fae437fe700 1 -- 172.21.15.59:0/375828514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae4409dc30 msgr2=0x7fae441273a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.883+0000 7fae437fe700 1 --2- 172.21.15.59:0/375828514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae4409dc30 0x7fae441273a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.883+0000 7fae437fe700 1 -- 172.21.15.59:0/375828514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae4413c1e0 msgr2=0x7fae441cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.883+0000 7fae437fe700 1 --2- 172.21.15.59:0/375828514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae4413c1e0 0x7fae441cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.883+0000 7fae437fe700 1 -- 172.21.15.59:0/375828514 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae34009550 con 0x7fae4406a770 2023-09-30T22:32:38.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.883+0000 7fae42ffd700 1 --2- 172.21.15.59:0/375828514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae4409dc30 0x7fae441273a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.883+0000 7fae437fe700 1 --2- 172.21.15.59:0/375828514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae4406a770 0x7fae44126e60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fae34009c70 tx=0x7fae34004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.883+0000 7fae2bfff700 1 -- 172.21.15.59:0/375828514 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34004300 con 0x7fae4406a770 2023-09-30T22:32:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.883+0000 7fae2bfff700 1 -- 172.21.15.59:0/375828514 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3401f070 con 0x7fae4406a770 2023-09-30T22:32:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.883+0000 7fae4a007700 1 -- 172.21.15.59:0/375828514 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4409f1a0 con 0x7fae4406a770 2023-09-30T22:32:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.883+0000 7fae2bfff700 1 -- 172.21.15.59:0/375828514 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae340036a0 con 0x7fae4406a770 2023-09-30T22:32:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.883+0000 7fae4a007700 1 -- 172.21.15.59:0/375828514 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4412a460 con 0x7fae4406a770 2023-09-30T22:32:38.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.885+0000 7fae2bfff700 1 -- 172.21.15.59:0/375828514 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae34021030 con 0x7fae4406a770 2023-09-30T22:32:38.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.885+0000 7fae4a007700 1 -- 172.21.15.59:0/375828514 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae441297e0 con 0x7fae4406a770 2023-09-30T22:32:38.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.885+0000 7fae2bfff700 1 -- 172.21.15.59:0/375828514 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fae340408b0 con 0x7fae4406a770 2023-09-30T22:32:38.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.890+0000 7fae2bfff700 1 -- 172.21.15.59:0/375828514 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae340199a0 con 0x7fae4406a770 2023-09-30T22:32:38.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.987+0000 7f81fdb5c700 1 -- 172.21.15.59:0/1777543132 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f81f8123c60 con 0x7f81f809d6f0 2023-09-30T22:32:38.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.988+0000 7f81dffff700 1 -- 172.21.15.59:0/1777543132 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81e802d030 con 0x7f81f809d6f0 2023-09-30T22:32:38.989 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:38.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.990+0000 7f81fdb5c700 1 -- 172.21.15.59:0/1777543132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81f809d6f0 msgr2=0x7f81f81206a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:38.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.990+0000 7f81fdb5c700 1 --2- 172.21.15.59:0/1777543132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81f809d6f0 0x7f81f81206a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f81e80011e0 tx=0x7f81e800c9b0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.990+0000 7f81fdb5c700 1 -- 172.21.15.59:0/1777543132 shutdown_connections 2023-09-30T22:32:38.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.990+0000 7f81fdb5c700 1 --2- 172.21.15.59:0/1777543132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81f809d6f0 0x7f81f81206a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.990+0000 7f81fdb5c700 1 --2- 172.21.15.59:0/1777543132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81f8139170 0x7f81f8121120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.990+0000 7f81fdb5c700 1 --2- 172.21.15.59:0/1777543132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f809e1d0 0x7f81f8120be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:38.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.990+0000 7f81fdb5c700 1 -- 172.21.15.59:0/1777543132 >> 172.21.15.59:0/1777543132 conn(0x7f81f8066f50 msgr2=0x7f81f8136a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:38.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.991+0000 7f81fdb5c700 1 -- 172.21.15.59:0/1777543132 shutdown_connections 2023-09-30T22:32:38.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:38.991+0000 7f81fdb5c700 1 -- 172.21.15.59:0/1777543132 wait complete. 2023-09-30T22:32:39.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:39.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.019+0000 7fa4df52c700 1 -- 172.21.15.59:0/1103412685 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa4d809a3d0 con 0x7fa4d809de00 2023-09-30T22:32:39.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.019+0000 7fa4cdffb700 1 -- 172.21.15.59:0/1103412685 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4c80253e0 con 0x7fa4d809de00 2023-09-30T22:32:39.020 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.021+0000 7fa4df52c700 1 -- 172.21.15.59:0/1103412685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4d809de00 msgr2=0x7fa4d813bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.021+0000 7fa4df52c700 1 --2- 172.21.15.59:0/1103412685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4d809de00 0x7fa4d813bcc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80090b0 tx=0x7fa4c8004750 comp rx=0 tx=0).stop 2023-09-30T22:32:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.022+0000 7fa4df52c700 1 -- 172.21.15.59:0/1103412685 shutdown_connections 2023-09-30T22:32:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.022+0000 7fa4df52c700 1 --2- 172.21.15.59:0/1103412685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4d813d1f0 0x7fa4d813c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.022+0000 7fa4df52c700 1 --2- 172.21.15.59:0/1103412685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d806a770 0x7fa4d813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:39.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.022+0000 7fa4df52c700 1 --2- 172.21.15.59:0/1103412685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4d809de00 0x7fa4d813bcc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:39.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.022+0000 7fa4df52c700 1 -- 172.21.15.59:0/1103412685 >> 172.21.15.59:0/1103412685 conn(0x7fa4d8066f50 msgr2=0x7fa4d809b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:39.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.022+0000 7fa4df52c700 1 -- 172.21.15.59:0/1103412685 shutdown_connections 2023-09-30T22:32:39.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.022+0000 7fa4df52c700 1 -- 172.21.15.59:0/1103412685 wait complete. 2023-09-30T22:32:39.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.067+0000 7f3d626c3700 1 -- 172.21.15.59:0/1250303302 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3d5c074ea0 con 0x7f3d5c09d6f0 2023-09-30T22:32:39.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.067+0000 7f3d58ff9700 1 -- 172.21.15.59:0/1250303302 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d4c044030 con 0x7f3d5c09d6f0 2023-09-30T22:32:39.069 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.069+0000 7f3d626c3700 1 -- 172.21.15.59:0/1250303302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d5c09d6f0 msgr2=0x7f3d5c1c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.069+0000 7f3d626c3700 1 --2- 172.21.15.59:0/1250303302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d5c09d6f0 0x7f3d5c1c4340 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00c520 tx=0x7f3d4c00c830 comp rx=0 tx=0).stop 2023-09-30T22:32:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.069+0000 7f3d626c3700 1 -- 172.21.15.59:0/1250303302 shutdown_connections 2023-09-30T22:32:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.069+0000 7f3d626c3700 1 --2- 172.21.15.59:0/1250303302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d5c09d6f0 0x7f3d5c1c4340 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.069+0000 7f3d626c3700 1 --2- 172.21.15.59:0/1250303302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d5c135e50 0x7f3d5c1194f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:39.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.069+0000 7f3d626c3700 1 --2- 172.21.15.59:0/1250303302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d5c09e1d0 0x7f3d5c1c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.070+0000 7f3d626c3700 1 -- 172.21.15.59:0/1250303302 >> 172.21.15.59:0/1250303302 conn(0x7f3d5c066f50 msgr2=0x7f3d5c1329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.070+0000 7f3d626c3700 1 -- 172.21.15.59:0/1250303302 shutdown_connections 2023-09-30T22:32:39.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.070+0000 7f3d626c3700 1 -- 172.21.15.59:0/1250303302 wait complete. 2023-09-30T22:32:39.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:39.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.097+0000 7fae4a007700 1 -- 172.21.15.59:0/375828514 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fae44074ea0 con 0x7fae4406a770 2023-09-30T22:32:39.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.098+0000 7fae2bfff700 1 -- 172.21.15.59:0/375828514 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae34015030 con 0x7fae4406a770 2023-09-30T22:32:39.099 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.100+0000 7fae4a007700 1 -- 172.21.15.59:0/375828514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae4406a770 msgr2=0x7fae44126e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.100+0000 7fae4a007700 1 --2- 172.21.15.59:0/375828514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae4406a770 0x7fae44126e60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fae34009c70 tx=0x7fae34004750 comp rx=0 tx=0).stop 2023-09-30T22:32:39.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.100+0000 7fae4a007700 1 -- 172.21.15.59:0/375828514 shutdown_connections 2023-09-30T22:32:39.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.100+0000 7fae4a007700 1 --2- 172.21.15.59:0/375828514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae4406a770 0x7fae44126e60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:39.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.100+0000 7fae4a007700 1 --2- 172.21.15.59:0/375828514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae4413c1e0 0x7fae441cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:39.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.100+0000 7fae4a007700 1 --2- 172.21.15.59:0/375828514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae4409dc30 0x7fae441273a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:39.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.100+0000 7fae4a007700 1 -- 172.21.15.59:0/375828514 >> 172.21.15.59:0/375828514 conn(0x7fae44066f50 msgr2=0x7fae4413b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:39.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.100+0000 7fae4a007700 1 -- 172.21.15.59:0/375828514 shutdown_connections 2023-09-30T22:32:39.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:39.100+0000 7fae4a007700 1 -- 172.21.15.59:0/375828514 wait complete. 2023-09-30T22:32:39.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:40.008 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:40.038 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:40.085 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:40.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:40.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.159+0000 7f2b769a8700 1 Processor -- start 2023-09-30T22:32:40.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.159+0000 7f2b769a8700 1 -- start start 2023-09-30T22:32:40.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.159+0000 7f2b769a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b70136710 0x7f2b70138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.159+0000 7f2b769a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b70139030 0x7f2b7013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.159+0000 7f2b769a8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7006ef30 con 0x7f2b701338a0 2023-09-30T22:32:40.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.159+0000 7f2b769a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7006fef0 con 0x7f2b70139030 2023-09-30T22:32:40.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.159+0000 7f2b769a8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701334b0 con 0x7f2b70136710 2023-09-30T22:32:40.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.160+0000 7f2b6ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2b701338a0 0x7f2b70133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52550/0 (socket says 172.21.15.59:52550) 2023-09-30T22:32:40.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.160+0000 7f2b6ffff700 1 -- 172.21.15.59:0/3565358722 learned_addr learned my addr 172.21.15.59:0/3565358722 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:40.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.160+0000 7f2b74f45700 1 --2- 172.21.15.59:0/3565358722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b70139030 0x7f2b7013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.160+0000 7f2b6f7fe700 1 --2- 172.21.15.59:0/3565358722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b70136710 0x7f2b70138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.160+0000 7f2b74f45700 1 -- 172.21.15.59:0/3565358722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b70136710 msgr2=0x7f2b70138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:40.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.160+0000 7f2b74f45700 1 --2- 172.21.15.59:0/3565358722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b70136710 0x7f2b70138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.160+0000 7f2b74f45700 1 -- 172.21.15.59:0/3565358722 >> v1:172.21.15.59:6789/0 conn(0x7f2b701338a0 legacy=0x7f2b70133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.160+0000 7f2b74f45700 1 -- 172.21.15.59:0/3565358722 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7006fc30 con 0x7f2b70139030 2023-09-30T22:32:40.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.160+0000 7f2b6f7fe700 1 --2- 172.21.15.59:0/3565358722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b70136710 0x7f2b70138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:40.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.160+0000 7f2b74f45700 1 --2- 172.21.15.59:0/3565358722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b70139030 0x7f2b7013b410 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009dc0 tx=0x7f2b6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a3b3f9e46b09701 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.160+0000 7f2b6effd700 1 -- 172.21.15.59:0/3565358722 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6800e070 con 0x7f2b70139030 2023-09-30T22:32:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.161+0000 7f2b6effd700 1 -- 172.21.15.59:0/3565358722 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6800bbd0 con 0x7f2b70139030 2023-09-30T22:32:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.161+0000 7f2b6effd700 1 -- 172.21.15.59:0/3565358722 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68012430 con 0x7f2b70139030 2023-09-30T22:32:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.161+0000 7f2b769a8700 1 -- 172.21.15.59:0/3565358722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b70139030 msgr2=0x7f2b7013b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.161+0000 7f2b769a8700 1 --2- 172.21.15.59:0/3565358722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b70139030 0x7f2b7013b410 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009dc0 tx=0x7f2b6800b330 comp rx=0 tx=0).stop 2023-09-30T22:32:40.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.161+0000 7f2b769a8700 1 -- 172.21.15.59:0/3565358722 shutdown_connections 2023-09-30T22:32:40.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.161+0000 7f2b769a8700 1 --2- 172.21.15.59:0/3565358722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b70139030 0x7f2b7013b410 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.161+0000 7f2b769a8700 1 --2- 172.21.15.59:0/3565358722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b70136710 0x7f2b70138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.161+0000 7f2b769a8700 1 -- 172.21.15.59:0/3565358722 >> 172.21.15.59:0/3565358722 conn(0x7f2b700a2aa0 msgr2=0x7f2b700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:40.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.162+0000 7f2b769a8700 1 -- 172.21.15.59:0/3565358722 shutdown_connections 2023-09-30T22:32:40.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.162+0000 7f2b769a8700 1 -- 172.21.15.59:0/3565358722 wait complete. 2023-09-30T22:32:40.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.162+0000 7f2b769a8700 1 Processor -- start 2023-09-30T22:32:40.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.163+0000 7f2b769a8700 1 -- start start 2023-09-30T22:32:40.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.163+0000 7f2b769a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b701338a0 0x7f2b7011ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.163+0000 7f2b769a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b70136710 0x7f2b7011b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.163+0000 7f2b769a8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b70139030 0x7f2b7011b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.163+0000 7f2b769a8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7011e360 con 0x7f2b70139030 2023-09-30T22:32:40.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.163+0000 7f2b769a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7011e540 con 0x7f2b70136710 2023-09-30T22:32:40.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.163+0000 7f2b769a8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7006f640 con 0x7f2b701338a0 2023-09-30T22:32:40.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.163+0000 7f2b6f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b70136710 0x7f2b7011b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.163+0000 7f2b6f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b70136710 0x7f2b7011b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60890/0 (socket says 172.21.15.59:60890) 2023-09-30T22:32:40.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.163+0000 7f2b6f7fe700 1 -- 172.21.15.59:0/1692210142 learned_addr learned my addr 172.21.15.59:0/1692210142 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:40.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.164+0000 7f2b6ffff700 1 --2- 172.21.15.59:0/1692210142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b701338a0 0x7f2b7011ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.164+0000 7f2b74f45700 1 --2- 172.21.15.59:0/1692210142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b70139030 0x7f2b7011b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.164+0000 7f2b6ffff700 1 -- 172.21.15.59:0/1692210142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b70136710 msgr2=0x7f2b7011b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.164+0000 7f2b6ffff700 1 --2- 172.21.15.59:0/1692210142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b70136710 0x7f2b7011b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.164+0000 7f2b6ffff700 1 -- 172.21.15.59:0/1692210142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b70139030 msgr2=0x7f2b7011b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.164+0000 7f2b6ffff700 1 --2- 172.21.15.59:0/1692210142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b70139030 0x7f2b7011b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.164+0000 7f2b6ffff700 1 -- 172.21.15.59:0/1692210142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b68009a70 con 0x7f2b701338a0 2023-09-30T22:32:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.164+0000 7f2b6ffff700 1 --2- 172.21.15.59:0/1692210142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b701338a0 0x7f2b7011ad00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000c530 tx=0x7f2b6000c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.164+0000 7f2b6cff9700 1 -- 172.21.15.59:0/1692210142 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6000cea0 con 0x7f2b701338a0 2023-09-30T22:32:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.164+0000 7f2b6cff9700 1 -- 172.21.15.59:0/1692210142 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b60005d70 con 0x7f2b701338a0 2023-09-30T22:32:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.164+0000 7f2b6cff9700 1 -- 172.21.15.59:0/1692210142 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b600072d0 con 0x7f2b701338a0 2023-09-30T22:32:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.164+0000 7f2b769a8700 1 -- 172.21.15.59:0/1692210142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7011dff0 con 0x7f2b701338a0 2023-09-30T22:32:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.165+0000 7f2b769a8700 1 -- 172.21.15.59:0/1692210142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7011d0c0 con 0x7f2b701338a0 2023-09-30T22:32:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.166+0000 7f2b769a8700 1 -- 172.21.15.59:0/1692210142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b70138b60 con 0x7f2b701338a0 2023-09-30T22:32:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.166+0000 7f2b6cff9700 1 -- 172.21.15.59:0/1692210142 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b60007430 con 0x7f2b701338a0 2023-09-30T22:32:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.167+0000 7f2b6cff9700 1 -- 172.21.15.59:0/1692210142 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2b6003eca0 con 0x7f2b701338a0 2023-09-30T22:32:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.171+0000 7f2b6cff9700 1 -- 172.21.15.59:0/1692210142 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b600076e0 con 0x7f2b701338a0 2023-09-30T22:32:40.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.212+0000 7fdc2b753700 1 Processor -- start 2023-09-30T22:32:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.212+0000 7fdc2b753700 1 -- start start 2023-09-30T22:32:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.213+0000 7fdc2b753700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc2409f410 0x7fdc24136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.213+0000 7fdc2b753700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc24136fe0 0x7fdc241393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.213+0000 7fdc2b753700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc24070940 con 0x7fdc2409e930 2023-09-30T22:32:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.213+0000 7fdc2b753700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2406fd60 con 0x7fdc2409f410 2023-09-30T22:32:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.213+0000 7fdc2b753700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2406fa80 con 0x7fdc24136fe0 2023-09-30T22:32:40.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.213+0000 7fdc294ef700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdc2409e930 0x7fdc2409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52558/0 (socket says 172.21.15.59:52558) 2023-09-30T22:32:40.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.213+0000 7fdc294ef700 1 -- 172.21.15.59:0/1370351198 learned_addr learned my addr 172.21.15.59:0/1370351198 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:40.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.213+0000 7fdc29cf0700 1 --2- 172.21.15.59:0/1370351198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc24136fe0 0x7fdc241393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.213+0000 7fdc28cee700 1 --2- 172.21.15.59:0/1370351198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc2409f410 0x7fdc24136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.214+0000 7fdc29cf0700 1 -- 172.21.15.59:0/1370351198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc2409f410 msgr2=0x7fdc24136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:40.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.214+0000 7fdc29cf0700 1 --2- 172.21.15.59:0/1370351198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc2409f410 0x7fdc24136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.214+0000 7fdc29cf0700 1 -- 172.21.15.59:0/1370351198 >> v1:172.21.15.59:6789/0 conn(0x7fdc2409e930 legacy=0x7fdc2409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.214+0000 7fdc29cf0700 1 -- 172.21.15.59:0/1370351198 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2409fb60 con 0x7fdc24136fe0 2023-09-30T22:32:40.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.214+0000 7fdc29cf0700 1 --2- 172.21.15.59:0/1370351198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc24136fe0 0x7fdc241393c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c009dc0 tx=0x7fdc1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d22d1bb1d63a02e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:40.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.214+0000 7fdc1bfff700 1 -- 172.21.15.59:0/1370351198 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c00e070 con 0x7fdc24136fe0 2023-09-30T22:32:40.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.214+0000 7fdc1bfff700 1 -- 172.21.15.59:0/1370351198 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c003a20 con 0x7fdc24136fe0 2023-09-30T22:32:40.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.214+0000 7fdc1bfff700 1 -- 172.21.15.59:0/1370351198 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c003dd0 con 0x7fdc24136fe0 2023-09-30T22:32:40.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.215+0000 7fdc2b753700 1 -- 172.21.15.59:0/1370351198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc24136fe0 msgr2=0x7fdc241393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.215+0000 7fdc2b753700 1 --2- 172.21.15.59:0/1370351198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc24136fe0 0x7fdc241393c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c009dc0 tx=0x7fdc1c00b330 comp rx=0 tx=0).stop 2023-09-30T22:32:40.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.215+0000 7fdc2b753700 1 -- 172.21.15.59:0/1370351198 shutdown_connections 2023-09-30T22:32:40.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.215+0000 7fdc2b753700 1 --2- 172.21.15.59:0/1370351198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc24136fe0 0x7fdc241393c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.215+0000 7fdc2b753700 1 --2- 172.21.15.59:0/1370351198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc2409f410 0x7fdc24136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.215+0000 7fdc2b753700 1 -- 172.21.15.59:0/1370351198 >> 172.21.15.59:0/1370351198 conn(0x7fdc240a4210 msgr2=0x7fdc240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:40.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.216+0000 7fdc2b753700 1 -- 172.21.15.59:0/1370351198 shutdown_connections 2023-09-30T22:32:40.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.216+0000 7fdc2b753700 1 -- 172.21.15.59:0/1370351198 wait complete. 2023-09-30T22:32:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.217+0000 7fdc2b753700 1 Processor -- start 2023-09-30T22:32:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.217+0000 7fdc2b753700 1 -- start start 2023-09-30T22:32:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc2b753700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc2409e930 0x7fdc241c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc2b753700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc2409f410 0x7fdc241c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc2b753700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc24136fe0 0x7fdc241c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc2b753700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc24132380 con 0x7fdc2409e930 2023-09-30T22:32:40.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc2b753700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc24122150 con 0x7fdc2409f410 2023-09-30T22:32:40.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc2b753700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc241321b0 con 0x7fdc24136fe0 2023-09-30T22:32:40.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc29cf0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc24136fe0 0x7fdc241c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc29cf0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc24136fe0 0x7fdc241c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39638/0 (socket says 172.21.15.59:39638) 2023-09-30T22:32:40.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc29cf0700 1 -- 172.21.15.59:0/3683458738 learned_addr learned my addr 172.21.15.59:0/3683458738 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc294ef700 1 --2- 172.21.15.59:0/3683458738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc2409e930 0x7fdc241c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc28cee700 1 --2- 172.21.15.59:0/3683458738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc2409f410 0x7fdc241c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc29cf0700 1 -- 172.21.15.59:0/3683458738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc2409f410 msgr2=0x7fdc241c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc29cf0700 1 --2- 172.21.15.59:0/3683458738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc2409f410 0x7fdc241c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc29cf0700 1 -- 172.21.15.59:0/3683458738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc2409e930 msgr2=0x7fdc241c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc29cf0700 1 --2- 172.21.15.59:0/3683458738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc2409e930 0x7fdc241c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.218+0000 7fdc29cf0700 1 -- 172.21.15.59:0/3683458738 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c009a70 con 0x7fdc24136fe0 2023-09-30T22:32:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.219+0000 7fdc29cf0700 1 --2- 172.21.15.59:0/3683458738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc24136fe0 0x7fdc241c8c70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00b370 tx=0x7fdc1c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.219+0000 7fdc19ffb700 1 -- 172.21.15.59:0/3683458738 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c009450 con 0x7fdc24136fe0 2023-09-30T22:32:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.219+0000 7fdc19ffb700 1 -- 172.21.15.59:0/3683458738 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c004580 con 0x7fdc24136fe0 2023-09-30T22:32:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.219+0000 7fdc2b753700 1 -- 172.21.15.59:0/3683458738 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2406d390 con 0x7fdc24136fe0 2023-09-30T22:32:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.219+0000 7fdc19ffb700 1 -- 172.21.15.59:0/3683458738 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c004930 con 0x7fdc24136fe0 2023-09-30T22:32:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.219+0000 7fdc2b753700 1 -- 172.21.15.59:0/3683458738 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc24120dc0 con 0x7fdc24136fe0 2023-09-30T22:32:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.220+0000 7fdc19ffb700 1 -- 172.21.15.59:0/3683458738 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc1c012430 con 0x7fdc24136fe0 2023-09-30T22:32:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.220+0000 7fdc19ffb700 1 -- 172.21.15.59:0/3683458738 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc1c041200 con 0x7fdc24136fe0 2023-09-30T22:32:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.221+0000 7fdc2b753700 1 -- 172.21.15.59:0/3683458738 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc24074ea0 con 0x7fdc24136fe0 2023-09-30T22:32:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.226+0000 7fdc19ffb700 1 -- 172.21.15.59:0/3683458738 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc1c0126e0 con 0x7fdc24136fe0 2023-09-30T22:32:40.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.243+0000 7ff10bf11700 1 Processor -- start 2023-09-30T22:32:40.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.243+0000 7ff10bf11700 1 -- start start 2023-09-30T22:32:40.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.244+0000 7ff10bf11700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff10409d6f0 0x7ff10409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.244+0000 7ff10bf11700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10409e000 0x7ff1041339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.244+0000 7ff10bf11700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10409b120 con 0x7ff10409e410 2023-09-30T22:32:40.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.244+0000 7ff10bf11700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10406b460 con 0x7ff10409e000 2023-09-30T22:32:40.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.244+0000 7ff10bf11700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff10409a7e0 con 0x7ff10409d6f0 2023-09-30T22:32:40.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.244+0000 7ff1094ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10409e000 0x7ff1041339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.244+0000 7ff10a4ae700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff10409e410 0x7ff104133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52564/0 (socket says 172.21.15.59:52564) 2023-09-30T22:32:40.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.244+0000 7ff10a4ae700 1 -- 172.21.15.59:0/2520282564 learned_addr learned my addr 172.21.15.59:0/2520282564 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:40.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.244+0000 7ff109cad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff10409d6f0 0x7ff10409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.245+0000 7ff109cad700 1 -- 172.21.15.59:0/2520282564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10409e000 msgr2=0x7ff1041339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:40.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.245+0000 7ff109cad700 1 --2- 172.21.15.59:0/2520282564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10409e000 0x7ff1041339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.245+0000 7ff109cad700 1 -- 172.21.15.59:0/2520282564 >> v1:172.21.15.59:6789/0 conn(0x7ff10409e410 legacy=0x7ff104133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.245+0000 7ff108cab700 1 -- 172.21.15.59:0/2520282564 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472610267 0 0) 0x7ff10409b120 con 0x7ff10409e410 2023-09-30T22:32:40.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.245+0000 7ff109cad700 1 -- 172.21.15.59:0/2520282564 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10409a500 con 0x7ff10409d6f0 2023-09-30T22:32:40.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.245+0000 7ff109cad700 1 --2- 172.21.15.59:0/2520282564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff10409d6f0 0x7ff10409dac0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff1000098a0 tx=0x7ff100009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e54065043893e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:40.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.245+0000 7ff108cab700 1 -- 172.21.15.59:0/2520282564 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff100011830 con 0x7ff10409d6f0 2023-09-30T22:32:40.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.245+0000 7ff108cab700 1 -- 172.21.15.59:0/2520282564 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff100011990 con 0x7ff10409d6f0 2023-09-30T22:32:40.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.245+0000 7ff108cab700 1 -- 172.21.15.59:0/2520282564 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff100011d20 con 0x7ff10409d6f0 2023-09-30T22:32:40.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.246+0000 7ff10bf11700 1 -- 172.21.15.59:0/2520282564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff10409d6f0 msgr2=0x7ff10409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.246+0000 7ff10bf11700 1 --2- 172.21.15.59:0/2520282564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff10409d6f0 0x7ff10409dac0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff1000098a0 tx=0x7ff100009bb0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.246+0000 7ff10bf11700 1 -- 172.21.15.59:0/2520282564 shutdown_connections 2023-09-30T22:32:40.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.246+0000 7ff10bf11700 1 --2- 172.21.15.59:0/2520282564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff10409d6f0 0x7ff10409dac0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.246+0000 7ff10bf11700 1 --2- 172.21.15.59:0/2520282564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10409e000 0x7ff1041339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.246+0000 7ff10bf11700 1 -- 172.21.15.59:0/2520282564 >> 172.21.15.59:0/2520282564 conn(0x7ff104066f50 msgr2=0x7ff10409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:40.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.246+0000 7ff10bf11700 1 -- 172.21.15.59:0/2520282564 shutdown_connections 2023-09-30T22:32:40.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.246+0000 7ff10bf11700 1 -- 172.21.15.59:0/2520282564 wait complete. 2023-09-30T22:32:40.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.247+0000 7ff10bf11700 1 Processor -- start 2023-09-30T22:32:40.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.247+0000 7ff10bf11700 1 -- start start 2023-09-30T22:32:40.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff10bf11700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff10409d6f0 0x7ff1041a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff10bf11700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff10409e000 0x7ff1041a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff10bf11700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10409e410 0x7ff1041a4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff10bf11700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1041a4bb0 con 0x7ff10409e000 2023-09-30T22:32:40.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff10bf11700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1041a5260 con 0x7ff10409e410 2023-09-30T22:32:40.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff10bf11700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1041a7170 con 0x7ff10409d6f0 2023-09-30T22:32:40.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff1094ac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff10409e000 0x7ff1041a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff1094ac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff10409e000 0x7ff1041a3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56582/0 (socket says 172.21.15.59:56582) 2023-09-30T22:32:40.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff1094ac700 1 -- 172.21.15.59:0/606736737 learned_addr learned my addr 172.21.15.59:0/606736737 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:40.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff109cad700 1 --2- 172.21.15.59:0/606736737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff10409d6f0 0x7ff1041a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff10a4ae700 1 --2- 172.21.15.59:0/606736737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10409e410 0x7ff1041a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff1094ac700 1 -- 172.21.15.59:0/606736737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff10409d6f0 msgr2=0x7ff1041a36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff1094ac700 1 --2- 172.21.15.59:0/606736737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff10409d6f0 0x7ff1041a36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff1094ac700 1 -- 172.21.15.59:0/606736737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10409e410 msgr2=0x7ff1041a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff1094ac700 1 --2- 172.21.15.59:0/606736737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10409e410 0x7ff1041a4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.248+0000 7ff1094ac700 1 -- 172.21.15.59:0/606736737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1000094a0 con 0x7ff10409e000 2023-09-30T22:32:40.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.249+0000 7ff1094ac700 1 --2- 172.21.15.59:0/606736737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff10409e000 0x7ff1041a3c20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400e980 tx=0x7ff0f400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:40.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.249+0000 7ff0fa7fc700 1 -- 172.21.15.59:0/606736737 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4009710 con 0x7ff10409e000 2023-09-30T22:32:40.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.249+0000 7ff0fa7fc700 1 -- 172.21.15.59:0/606736737 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f400c690 con 0x7ff10409e000 2023-09-30T22:32:40.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.249+0000 7ff10bf11700 1 -- 172.21.15.59:0/606736737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1040a1e90 con 0x7ff10409e000 2023-09-30T22:32:40.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.249+0000 7ff0fa7fc700 1 -- 172.21.15.59:0/606736737 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f400ca20 con 0x7ff10409e000 2023-09-30T22:32:40.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.249+0000 7ff10bf11700 1 -- 172.21.15.59:0/606736737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1041a5a30 con 0x7ff10409e000 2023-09-30T22:32:40.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.250+0000 7ff0fa7fc700 1 -- 172.21.15.59:0/606736737 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0f400cb80 con 0x7ff10409e000 2023-09-30T22:32:40.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.250+0000 7ff10bf11700 1 -- 172.21.15.59:0/606736737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff104074ea0 con 0x7ff10409e000 2023-09-30T22:32:40.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.250+0000 7ff0fa7fc700 1 -- 172.21.15.59:0/606736737 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff0f403fae0 con 0x7ff10409e000 2023-09-30T22:32:40.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.259+0000 7ff0fa7fc700 1 -- 172.21.15.59:0/606736737 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0f401b3b0 con 0x7ff10409e000 2023-09-30T22:32:40.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.292+0000 7f98d75d2700 1 Processor -- start 2023-09-30T22:32:40.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.293+0000 7f98d75d2700 1 -- start start 2023-09-30T22:32:40.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.293+0000 7f98d75d2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98d00a0a30 0x7f98d00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.293+0000 7f98d75d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98d00a1340 0x7f98d013c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.293+0000 7f98d75d2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d009d920 con 0x7f98d013c640 2023-09-30T22:32:40.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.293+0000 7f98d75d2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d009d020 con 0x7f98d00a0a30 2023-09-30T22:32:40.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.293+0000 7f98d75d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d00a2010 con 0x7f98d00a1340 2023-09-30T22:32:40.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.293+0000 7f98d4b6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98d00a1340 0x7f98d013c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.293+0000 7f98d4b6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98d00a1340 0x7f98d013c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60924/0 (socket says 172.21.15.59:60924) 2023-09-30T22:32:40.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.293+0000 7f98d4b6d700 1 -- 172.21.15.59:0/4203140972 learned_addr learned my addr 172.21.15.59:0/4203140972 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:40.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.294+0000 7f98d536e700 1 --2- 172.21.15.59:0/4203140972 >> v2:172.21.15.59:3300/0 conn(0x7f98d00a0a30 0x7f98d00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.294+0000 7f98d4b6d700 1 -- 172.21.15.59:0/4203140972 >> v2:172.21.15.59:3300/0 conn(0x7f98d00a0a30 msgr2=0x7f98d00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:40.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.294+0000 7f98d4b6d700 1 --2- 172.21.15.59:0/4203140972 >> v2:172.21.15.59:3300/0 conn(0x7f98d00a0a30 0x7f98d00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.294+0000 7f98d4b6d700 1 -- 172.21.15.59:0/4203140972 >> v1:172.21.15.59:6789/0 conn(0x7f98d013c640 legacy=0x7f98d013ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.294+0000 7f98d4b6d700 1 -- 172.21.15.59:0/4203140972 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d009dbe0 con 0x7f98d00a1340 2023-09-30T22:32:40.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.294+0000 7f98d4b6d700 1 --2- 172.21.15.59:0/4203140972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98d00a1340 0x7f98d013c100 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f98c00098f0 tx=0x7f98c0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddd33778b4746801 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:40.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.294+0000 7f98c7fff700 1 -- 172.21.15.59:0/4203140972 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c000b8a0 con 0x7f98d00a1340 2023-09-30T22:32:40.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.294+0000 7f98c7fff700 1 -- 172.21.15.59:0/4203140972 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c000ba00 con 0x7f98d00a1340 2023-09-30T22:32:40.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.294+0000 7f98c7fff700 1 -- 172.21.15.59:0/4203140972 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c000bd90 con 0x7f98d00a1340 2023-09-30T22:32:40.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.295+0000 7f98d75d2700 1 -- 172.21.15.59:0/4203140972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98d00a1340 msgr2=0x7f98d013c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.295+0000 7f98d75d2700 1 --2- 172.21.15.59:0/4203140972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98d00a1340 0x7f98d013c100 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f98c00098f0 tx=0x7f98c0009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:40.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.295+0000 7f98d75d2700 1 -- 172.21.15.59:0/4203140972 shutdown_connections 2023-09-30T22:32:40.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.295+0000 7f98d75d2700 1 --2- 172.21.15.59:0/4203140972 >> v2:172.21.15.59:3300/0 conn(0x7f98d00a0a30 0x7f98d00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.295+0000 7f98d75d2700 1 --2- 172.21.15.59:0/4203140972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98d00a1340 0x7f98d013c100 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.295+0000 7f98d75d2700 1 -- 172.21.15.59:0/4203140972 >> 172.21.15.59:0/4203140972 conn(0x7f98d00a6550 msgr2=0x7f98d00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:40.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.295+0000 7f98d75d2700 1 -- 172.21.15.59:0/4203140972 shutdown_connections 2023-09-30T22:32:40.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.295+0000 7f98d75d2700 1 -- 172.21.15.59:0/4203140972 wait complete. 2023-09-30T22:32:40.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.297+0000 7f98d75d2700 1 Processor -- start 2023-09-30T22:32:40.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.297+0000 7f98d75d2700 1 -- start start 2023-09-30T22:32:40.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.297+0000 7f98d75d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98d00a0a30 0x7f98d013f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.297+0000 7f98d75d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98d00a1340 0x7f98d013a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.297+0000 7f98d75d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98d013c640 0x7f98d013ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:40.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.297+0000 7f98d75d2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d011de00 con 0x7f98d00a1340 2023-09-30T22:32:40.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.297+0000 7f98d75d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d0134db0 con 0x7f98d00a0a30 2023-09-30T22:32:40.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.297+0000 7f98d75d2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98d011dfe0 con 0x7f98d013c640 2023-09-30T22:32:40.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.298+0000 7f98d536e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98d00a0a30 0x7f98d013f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.298+0000 7f98d536e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98d00a0a30 0x7f98d013f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60940/0 (socket says 172.21.15.59:60940) 2023-09-30T22:32:40.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.298+0000 7f98d536e700 1 -- 172.21.15.59:0/2340688202 learned_addr learned my addr 172.21.15.59:0/2340688202 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:40.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.298+0000 7f98d4b6d700 1 --2- 172.21.15.59:0/2340688202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98d00a1340 0x7f98d013a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.298+0000 7f98d5b6f700 1 --2- 172.21.15.59:0/2340688202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98d013c640 0x7f98d013ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:40.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.298+0000 7f98d536e700 1 -- 172.21.15.59:0/2340688202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98d013c640 msgr2=0x7f98d013ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.298+0000 7f98d536e700 1 --2- 172.21.15.59:0/2340688202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98d013c640 0x7f98d013ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.298+0000 7f98d536e700 1 -- 172.21.15.59:0/2340688202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98d00a1340 msgr2=0x7f98d013a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.298+0000 7f98d536e700 1 --2- 172.21.15.59:0/2340688202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98d00a1340 0x7f98d013a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.298+0000 7f98d536e700 1 -- 172.21.15.59:0/2340688202 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c0009550 con 0x7f98d00a0a30 2023-09-30T22:32:40.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.298+0000 7f98d4b6d700 1 --2- 172.21.15.59:0/2340688202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98d00a1340 0x7f98d013a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:40.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.298+0000 7f98d536e700 1 --2- 172.21.15.59:0/2340688202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98d00a0a30 0x7f98d013f810 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00e870 tx=0x7f98cc00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:40.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.298+0000 7f98c5ffb700 1 -- 172.21.15.59:0/2340688202 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc013610 con 0x7f98d00a0a30 2023-09-30T22:32:40.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.299+0000 7f98c5ffb700 1 -- 172.21.15.59:0/2340688202 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc013770 con 0x7f98d00a0a30 2023-09-30T22:32:40.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.299+0000 7f98c5ffb700 1 -- 172.21.15.59:0/2340688202 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc013b20 con 0x7f98d00a0a30 2023-09-30T22:32:40.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.299+0000 7f98d75d2700 1 -- 172.21.15.59:0/2340688202 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d013bee0 con 0x7f98d00a0a30 2023-09-30T22:32:40.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.299+0000 7f98d75d2700 1 -- 172.21.15.59:0/2340688202 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d011d3b0 con 0x7f98d00a0a30 2023-09-30T22:32:40.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.300+0000 7f98d75d2700 1 -- 172.21.15.59:0/2340688202 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d0071e20 con 0x7f98d00a0a30 2023-09-30T22:32:40.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.301+0000 7f98c5ffb700 1 -- 172.21.15.59:0/2340688202 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98cc013c80 con 0x7f98d00a0a30 2023-09-30T22:32:40.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.301+0000 7f98c5ffb700 1 -- 172.21.15.59:0/2340688202 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f98cc03f790 con 0x7f98d00a0a30 2023-09-30T22:32:40.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.305+0000 7f98c5ffb700 1 -- 172.21.15.59:0/2340688202 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98cc026480 con 0x7f98d00a0a30 2023-09-30T22:32:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.439+0000 7f2b769a8700 1 -- 172.21.15.59:0/1692210142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2b7011e680 con 0x7f2b701338a0 2023-09-30T22:32:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.440+0000 7f2b6cff9700 1 -- 172.21.15.59:0/1692210142 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b7011e680 con 0x7f2b701338a0 2023-09-30T22:32:40.441 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.442+0000 7f2b769a8700 1 -- 172.21.15.59:0/1692210142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b701338a0 msgr2=0x7f2b7011ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.442+0000 7f2b769a8700 1 --2- 172.21.15.59:0/1692210142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b701338a0 0x7f2b7011ad00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000c530 tx=0x7f2b6000c840 comp rx=0 tx=0).stop 2023-09-30T22:32:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.442+0000 7f2b769a8700 1 -- 172.21.15.59:0/1692210142 shutdown_connections 2023-09-30T22:32:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.442+0000 7f2b769a8700 1 --2- 172.21.15.59:0/1692210142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b701338a0 0x7f2b7011ad00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.442+0000 7f2b769a8700 1 --2- 172.21.15.59:0/1692210142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b70139030 0x7f2b7011b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.442+0000 7f2b769a8700 1 --2- 172.21.15.59:0/1692210142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b70136710 0x7f2b7011b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.442+0000 7f2b769a8700 1 -- 172.21.15.59:0/1692210142 >> 172.21.15.59:0/1692210142 conn(0x7f2b700a2aa0 msgr2=0x7f2b701344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.443+0000 7f2b769a8700 1 -- 172.21.15.59:0/1692210142 shutdown_connections 2023-09-30T22:32:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.446+0000 7f2b769a8700 1 -- 172.21.15.59:0/1692210142 wait complete. 2023-09-30T22:32:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.458+0000 7fdc2b753700 1 -- 172.21.15.59:0/3683458738 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdc2406b250 con 0x7fdc24136fe0 2023-09-30T22:32:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.458+0000 7fdc19ffb700 1 -- 172.21.15.59:0/3683458738 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc1c011390 con 0x7fdc24136fe0 2023-09-30T22:32:40.459 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:40.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.461+0000 7fdc2b753700 1 -- 172.21.15.59:0/3683458738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc24136fe0 msgr2=0x7fdc241c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.461+0000 7fdc2b753700 1 --2- 172.21.15.59:0/3683458738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc24136fe0 0x7fdc241c8c70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00b370 tx=0x7fdc1c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.461+0000 7fdc2b753700 1 -- 172.21.15.59:0/3683458738 shutdown_connections 2023-09-30T22:32:40.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.461+0000 7fdc2b753700 1 --2- 172.21.15.59:0/3683458738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc24136fe0 0x7fdc241c8c70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.461+0000 7fdc2b753700 1 --2- 172.21.15.59:0/3683458738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc2409e930 0x7fdc241c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.461+0000 7fdc2b753700 1 --2- 172.21.15.59:0/3683458738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc2409f410 0x7fdc241c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.461+0000 7fdc2b753700 1 -- 172.21.15.59:0/3683458738 >> 172.21.15.59:0/3683458738 conn(0x7fdc240a4210 msgr2=0x7fdc24134b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:40.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.461+0000 7fdc2b753700 1 -- 172.21.15.59:0/3683458738 shutdown_connections 2023-09-30T22:32:40.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.461+0000 7fdc2b753700 1 -- 172.21.15.59:0/3683458738 wait complete. 2023-09-30T22:32:40.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:40.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.474+0000 7ff10bf11700 1 -- 172.21.15.59:0/606736737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff10406c360 con 0x7ff10409e000 2023-09-30T22:32:40.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.475+0000 7ff0fa7fc700 1 -- 172.21.15.59:0/606736737 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0f4017070 con 0x7ff10409e000 2023-09-30T22:32:40.476 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:40.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:40.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.477+0000 7ff10bf11700 1 -- 172.21.15.59:0/606736737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff10409e000 msgr2=0x7ff1041a3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.477+0000 7ff10bf11700 1 --2- 172.21.15.59:0/606736737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff10409e000 0x7ff1041a3c20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400e980 tx=0x7ff0f400ec90 comp rx=0 tx=0).stop 2023-09-30T22:32:40.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.477+0000 7ff10bf11700 1 -- 172.21.15.59:0/606736737 shutdown_connections 2023-09-30T22:32:40.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.477+0000 7ff10bf11700 1 --2- 172.21.15.59:0/606736737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff10409d6f0 0x7ff1041a36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.477+0000 7ff10bf11700 1 --2- 172.21.15.59:0/606736737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10409e410 0x7ff1041a4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.477+0000 7ff10bf11700 1 --2- 172.21.15.59:0/606736737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff10409e000 0x7ff1041a3c20 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.477+0000 7ff10bf11700 1 -- 172.21.15.59:0/606736737 >> 172.21.15.59:0/606736737 conn(0x7ff104066f50 msgr2=0x7ff1041bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:40.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.477+0000 7ff10bf11700 1 -- 172.21.15.59:0/606736737 shutdown_connections 2023-09-30T22:32:40.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.478+0000 7ff10bf11700 1 -- 172.21.15.59:0/606736737 wait complete. 2023-09-30T22:32:40.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:40.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.537+0000 7f98d75d2700 1 -- 172.21.15.59:0/2340688202 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f98d011dc60 con 0x7f98d00a0a30 2023-09-30T22:32:40.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.537+0000 7f98c5ffb700 1 -- 172.21.15.59:0/2340688202 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98d011dc60 con 0x7f98d00a0a30 2023-09-30T22:32:40.538 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:40.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.539+0000 7f98d75d2700 1 -- 172.21.15.59:0/2340688202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98d00a0a30 msgr2=0x7f98d013f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:40.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.539+0000 7f98d75d2700 1 --2- 172.21.15.59:0/2340688202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98d00a0a30 0x7f98d013f810 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00e870 tx=0x7f98cc00eb80 comp rx=0 tx=0).stop 2023-09-30T22:32:40.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.539+0000 7f98d75d2700 1 -- 172.21.15.59:0/2340688202 shutdown_connections 2023-09-30T22:32:40.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.539+0000 7f98d75d2700 1 --2- 172.21.15.59:0/2340688202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98d013c640 0x7f98d013ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.539+0000 7f98d75d2700 1 --2- 172.21.15.59:0/2340688202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98d00a0a30 0x7f98d013f810 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.539+0000 7f98d75d2700 1 --2- 172.21.15.59:0/2340688202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98d00a1340 0x7f98d013a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:40.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.539+0000 7f98d75d2700 1 -- 172.21.15.59:0/2340688202 >> 172.21.15.59:0/2340688202 conn(0x7f98d00a6550 msgr2=0x7f98d00a4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:40.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.539+0000 7f98d75d2700 1 -- 172.21.15.59:0/2340688202 shutdown_connections 2023-09-30T22:32:40.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:40.539+0000 7f98d75d2700 1 -- 172.21.15.59:0/2340688202 wait complete. 2023-09-30T22:32:40.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:41.467 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:41.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:41.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:41.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:41.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.632+0000 7f8fb25c7700 1 Processor -- start 2023-09-30T22:32:41.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.632+0000 7f8fb25c7700 1 -- start start 2023-09-30T22:32:41.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fb25c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fac133420 0x7f8fac1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fb25c7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8fac133e30 0x7f8fac12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fb25c7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fac134260 0x7f8fac1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fb25c7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fac06b990 con 0x7f8fac133e30 2023-09-30T22:32:41.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fb25c7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac0a0590 con 0x7f8fac133420 2023-09-30T22:32:41.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fb25c7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac09fb80 con 0x7f8fac134260 2023-09-30T22:32:41.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fabfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fac133420 0x7f8fac1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fabfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fac133420 0x7f8fac1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60948/0 (socket says 172.21.15.59:60948) 2023-09-30T22:32:41.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fabfff700 1 -- 172.21.15.59:0/2719939512 learned_addr learned my addr 172.21.15.59:0/2719939512 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:41.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fb0b64700 1 --2- 172.21.15.59:0/2719939512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fac134260 0x7f8fac1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fab7fe700 1 --2- 172.21.15.59:0/2719939512 >> v2:172.21.15.59:3300/0 conn(0x7f8fac133e30 0x7f8fac12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fabfff700 1 -- 172.21.15.59:0/2719939512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fac134260 msgr2=0x7f8fac1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:41.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fabfff700 1 --2- 172.21.15.59:0/2719939512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fac134260 0x7f8fac1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fabfff700 1 -- 172.21.15.59:0/2719939512 >> v2:172.21.15.59:3300/0 conn(0x7f8fac133e30 msgr2=0x7f8fac12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:41.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fabfff700 1 --2- 172.21.15.59:0/2719939512 >> v2:172.21.15.59:3300/0 conn(0x7f8fac133e30 0x7f8fac12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fabfff700 1 -- 172.21.15.59:0/2719939512 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac0a0030 con 0x7f8fac133420 2023-09-30T22:32:41.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.633+0000 7f8fb0b64700 1 --2- 172.21.15.59:0/2719939512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fac134260 0x7f8fac1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.634+0000 7f8fabfff700 1 --2- 172.21.15.59:0/2719939512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fac133420 0x7f8fac1337f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0098f0 tx=0x7f8f9c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11246da198a1a86b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.634+0000 7f8faaffd700 1 -- 172.21.15.59:0/2719939512 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c011830 con 0x7f8fac133420 2023-09-30T22:32:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.634+0000 7f8faaffd700 1 -- 172.21.15.59:0/2719939512 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c011990 con 0x7f8fac133420 2023-09-30T22:32:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.634+0000 7f8faaffd700 1 -- 172.21.15.59:0/2719939512 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c011d20 con 0x7f8fac133420 2023-09-30T22:32:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.635+0000 7f8fb25c7700 1 -- 172.21.15.59:0/2719939512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fac133420 msgr2=0x7f8fac1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.635+0000 7f8fb25c7700 1 --2- 172.21.15.59:0/2719939512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fac133420 0x7f8fac1337f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0098f0 tx=0x7f8f9c009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.635+0000 7f8fb25c7700 1 -- 172.21.15.59:0/2719939512 shutdown_connections 2023-09-30T22:32:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.635+0000 7f8fb25c7700 1 --2- 172.21.15.59:0/2719939512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fac134260 0x7f8fac1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.635+0000 7f8fb25c7700 1 --2- 172.21.15.59:0/2719939512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fac133420 0x7f8fac1337f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.635+0000 7f8fb25c7700 1 --2- 172.21.15.59:0/2719939512 >> v2:172.21.15.59:3300/0 conn(0x7f8fac133e30 0x7f8fac12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.635+0000 7f8fb25c7700 1 -- 172.21.15.59:0/2719939512 >> 172.21.15.59:0/2719939512 conn(0x7f8fac0a4210 msgr2=0x7f8fac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.635+0000 7f8fb25c7700 1 -- 172.21.15.59:0/2719939512 shutdown_connections 2023-09-30T22:32:41.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.635+0000 7f8fb25c7700 1 -- 172.21.15.59:0/2719939512 wait complete. 2023-09-30T22:32:41.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.637+0000 7f8fb25c7700 1 Processor -- start 2023-09-30T22:32:41.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.637+0000 7f8fb25c7700 1 -- start start 2023-09-30T22:32:41.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fb25c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fac133420 0x7f8fac09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fb25c7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fac133e30 0x7f8fac09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fb25c7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fac134260 0x7f8fac09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fb25c7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac12da80 con 0x7f8fac133e30 2023-09-30T22:32:41.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fb25c7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac12dc70 con 0x7f8fac133420 2023-09-30T22:32:41.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fb25c7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac11fc30 con 0x7f8fac134260 2023-09-30T22:32:41.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fb0b64700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fac134260 0x7f8fac09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fb0b64700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fac134260 0x7f8fac09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39680/0 (socket says 172.21.15.59:39680) 2023-09-30T22:32:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fb0b64700 1 -- 172.21.15.59:0/2777426846 learned_addr learned my addr 172.21.15.59:0/2777426846 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fabfff700 1 --2- 172.21.15.59:0/2777426846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fac133420 0x7f8fac09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fb0b64700 1 -- 172.21.15.59:0/2777426846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fac133420 msgr2=0x7f8fac09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fb0b64700 1 --2- 172.21.15.59:0/2777426846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fac133420 0x7f8fac09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fb0b64700 1 -- 172.21.15.59:0/2777426846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fac133e30 msgr2=0x7f8fac09c9c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:32:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fb0b64700 1 --2- 172.21.15.59:0/2777426846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fac133e30 0x7f8fac09c9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fb0b64700 1 -- 172.21.15.59:0/2777426846 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa4009a70 con 0x7f8fac134260 2023-09-30T22:32:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.638+0000 7f8fb0b64700 1 --2- 172.21.15.59:0/2777426846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fac134260 0x7f8fac09cf00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009eb0 tx=0x7f8fa400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.639+0000 7f8fa8ff9700 1 -- 172.21.15.59:0/2777426846 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4009d50 con 0x7f8fac134260 2023-09-30T22:32:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.639+0000 7f8fa8ff9700 1 -- 172.21.15.59:0/2777426846 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa400f040 con 0x7f8fac134260 2023-09-30T22:32:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.639+0000 7f8fa8ff9700 1 -- 172.21.15.59:0/2777426846 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4014480 con 0x7f8fac134260 2023-09-30T22:32:41.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.639+0000 7f8fb25c7700 1 -- 172.21.15.59:0/2777426846 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9c009550 con 0x7f8fac134260 2023-09-30T22:32:41.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.639+0000 7f8fb25c7700 1 -- 172.21.15.59:0/2777426846 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fac11fef0 con 0x7f8fac134260 2023-09-30T22:32:41.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.640+0000 7f8fa8ff9700 1 -- 172.21.15.59:0/2777426846 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8fa40145e0 con 0x7f8fac134260 2023-09-30T22:32:41.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.640+0000 7f8fa8ff9700 1 -- 172.21.15.59:0/2777426846 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8fa4040330 con 0x7f8fac134260 2023-09-30T22:32:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.640+0000 7f8fb25c7700 1 -- 172.21.15.59:0/2777426846 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fac11f540 con 0x7f8fac134260 2023-09-30T22:32:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.646+0000 7f8fa8ff9700 1 -- 172.21.15.59:0/2777426846 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8fa4007510 con 0x7f8fac134260 2023-09-30T22:32:41.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.665+0000 7f2f6f8f6700 1 Processor -- start 2023-09-30T22:32:41.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.665+0000 7f7bd666d700 1 Processor -- start 2023-09-30T22:32:41.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.665+0000 7f2f6f8f6700 1 -- start start 2023-09-30T22:32:41.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f2f6f8f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6809e1d0 0x7f2f68135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f2f6f8f6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f68135e50 0x7f2f68138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f2f6f8f6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6809f130 con 0x7f2f6809d6f0 2023-09-30T22:32:41.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f2f6f8f6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6809f520 con 0x7f2f6809e1d0 2023-09-30T22:32:41.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f2f6f8f6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6809e930 con 0x7f2f68135e50 2023-09-30T22:32:41.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f7bd666d700 1 -- start start 2023-09-30T22:32:41.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f2f6de93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f68135e50 0x7f2f68138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f2f6de93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f68135e50 0x7f2f68138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39690/0 (socket says 172.21.15.59:39690) 2023-09-30T22:32:41.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f2f6d692700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2f6809d6f0 0x7f2f6809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52568/0 (socket says 172.21.15.59:52568) 2023-09-30T22:32:41.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f2f6de93700 1 -- 172.21.15.59:0/3811461405 learned_addr learned my addr 172.21.15.59:0/3811461405 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:41.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f7bd666d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7bd009d6f0 0x7f7bd009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f7bd666d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd009e000 0x7f7bd0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f7bd666d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd009e410 0x7f7bd0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f7bd666d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd009f520 con 0x7f7bd009d6f0 2023-09-30T22:32:41.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f7bd666d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd009f130 con 0x7f7bd009e410 2023-09-30T22:32:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f7bd666d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd009e930 con 0x7f7bd009e000 2023-09-30T22:32:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f7bd4c0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd009e410 0x7f7bd0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f7bcf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd009e000 0x7f7bd0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f7bd4c0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd009e410 0x7f7bd0130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60970/0 (socket says 172.21.15.59:60970) 2023-09-30T22:32:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.666+0000 7f7bd4c0a700 1 -- 172.21.15.59:0/1674269636 learned_addr learned my addr 172.21.15.59:0/1674269636 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f7bcffff700 1 --2- 172.21.15.59:0/1674269636 >> v2:172.21.15.59:3300/0 conn(0x7f7bd009d6f0 0x7f7bd009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f2f6de93700 1 -- 172.21.15.59:0/3811461405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6809e1d0 msgr2=0x7f2f68135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f2f6de93700 1 --2- 172.21.15.59:0/3811461405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6809e1d0 0x7f2f68135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f2f6de93700 1 -- 172.21.15.59:0/3811461405 >> v1:172.21.15.59:6789/0 conn(0x7f2f6809d6f0 legacy=0x7f2f6809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f7bcf7fe700 1 -- 172.21.15.59:0/1674269636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd009e410 msgr2=0x7f7bd0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:41.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f7bcf7fe700 1 --2- 172.21.15.59:0/1674269636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd009e410 0x7f7bd0130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f7bcf7fe700 1 -- 172.21.15.59:0/1674269636 >> v2:172.21.15.59:3300/0 conn(0x7f7bd009d6f0 msgr2=0x7f7bd009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:41.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f7bcf7fe700 1 --2- 172.21.15.59:0/1674269636 >> v2:172.21.15.59:3300/0 conn(0x7f7bd009d6f0 0x7f7bd009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f7bcf7fe700 1 -- 172.21.15.59:0/1674269636 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd009b2d0 con 0x7f7bd009e000 2023-09-30T22:32:41.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f2f6de93700 1 -- 172.21.15.59:0/3811461405 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6809b2d0 con 0x7f2f68135e50 2023-09-30T22:32:41.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f7bd4c0a700 1 --2- 172.21.15.59:0/1674269636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd009e410 0x7f7bd0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:41.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f7bcf7fe700 1 --2- 172.21.15.59:0/1674269636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd009e000 0x7f7bd0130660 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009870 tx=0x7f7bc4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ad1bd01145a8fa3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:41.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f7bceffd700 1 -- 172.21.15.59:0/1674269636 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4011830 con 0x7f7bd009e000 2023-09-30T22:32:41.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f2f6de93700 1 --2- 172.21.15.59:0/3811461405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f68135e50 0x7f2f68138230 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000d180 tx=0x7f2f6000d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fab962d3d72ce099 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:41.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f7bceffd700 1 -- 172.21.15.59:0/1674269636 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc4011990 con 0x7f7bd009e000 2023-09-30T22:32:41.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.667+0000 7f7bceffd700 1 -- 172.21.15.59:0/1674269636 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4011d20 con 0x7f7bd009e000 2023-09-30T22:32:41.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.668+0000 7f2f5ffff700 1 -- 172.21.15.59:0/3811461405 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60010070 con 0x7f2f68135e50 2023-09-30T22:32:41.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.668+0000 7f2f5ffff700 1 -- 172.21.15.59:0/3811461405 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6000ddf0 con 0x7f2f68135e50 2023-09-30T22:32:41.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.668+0000 7f2f5ffff700 1 -- 172.21.15.59:0/3811461405 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6000b310 con 0x7f2f68135e50 2023-09-30T22:32:41.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.668+0000 7f7bd666d700 1 -- 172.21.15.59:0/1674269636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd009e000 msgr2=0x7f7bd0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.668+0000 7f7bd666d700 1 --2- 172.21.15.59:0/1674269636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd009e000 0x7f7bd0130660 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009870 tx=0x7f7bc4009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:41.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.668+0000 7f2f6f8f6700 1 -- 172.21.15.59:0/3811461405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f68135e50 msgr2=0x7f2f68138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.668+0000 7f2f6f8f6700 1 --2- 172.21.15.59:0/3811461405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f68135e50 0x7f2f68138230 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000d180 tx=0x7f2f6000d490 comp rx=0 tx=0).stop 2023-09-30T22:32:41.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.668+0000 7f2f6f8f6700 1 -- 172.21.15.59:0/3811461405 shutdown_connections 2023-09-30T22:32:41.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.668+0000 7f2f6f8f6700 1 --2- 172.21.15.59:0/3811461405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f68135e50 0x7f2f68138230 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.668+0000 7f2f6f8f6700 1 --2- 172.21.15.59:0/3811461405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6809e1d0 0x7f2f68135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.668+0000 7f2f6f8f6700 1 -- 172.21.15.59:0/3811461405 >> 172.21.15.59:0/3811461405 conn(0x7f2f68066f50 msgr2=0x7f2f6809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:41.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.669+0000 7f7bd666d700 1 -- 172.21.15.59:0/1674269636 shutdown_connections 2023-09-30T22:32:41.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.669+0000 7f7bd666d700 1 --2- 172.21.15.59:0/1674269636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd009e410 0x7f7bd0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.669+0000 7f7bd666d700 1 --2- 172.21.15.59:0/1674269636 >> v2:172.21.15.59:3300/0 conn(0x7f7bd009d6f0 0x7f7bd009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.669+0000 7f7bd666d700 1 --2- 172.21.15.59:0/1674269636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd009e000 0x7f7bd0130660 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.669+0000 7f7bd666d700 1 -- 172.21.15.59:0/1674269636 >> 172.21.15.59:0/1674269636 conn(0x7f7bd0066f50 msgr2=0x7f7bd009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:41.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.669+0000 7f2f6f8f6700 1 -- 172.21.15.59:0/3811461405 shutdown_connections 2023-09-30T22:32:41.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.669+0000 7f7bd666d700 1 -- 172.21.15.59:0/1674269636 shutdown_connections 2023-09-30T22:32:41.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.669+0000 7f7bd666d700 1 -- 172.21.15.59:0/1674269636 wait complete. 2023-09-30T22:32:41.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.669+0000 7f2f6f8f6700 1 -- 172.21.15.59:0/3811461405 wait complete. 2023-09-30T22:32:41.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.670+0000 7f2f6f8f6700 1 Processor -- start 2023-09-30T22:32:41.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.670+0000 7f2f6f8f6700 1 -- start start 2023-09-30T22:32:41.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.670+0000 7f7bd666d700 1 Processor -- start 2023-09-30T22:32:41.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.670+0000 7f2f6f8f6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6809d6f0 0x7f2f681c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.670+0000 7f2f6f8f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6809e1d0 0x7f2f681c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.670+0000 7f2f6f8f6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f68135e50 0x7f2f68119940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.670+0000 7f2f6f8f6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6811cef0 con 0x7f2f6809d6f0 2023-09-30T22:32:41.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.670+0000 7f2f6f8f6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f681baf30 con 0x7f2f6809e1d0 2023-09-30T22:32:41.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.670+0000 7f2f6f8f6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6809c700 con 0x7f2f68135e50 2023-09-30T22:32:41.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.670+0000 7f2f6d692700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6809d6f0 0x7f2f681c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.670+0000 7f2f6d692700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6809d6f0 0x7f2f681c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56634/0 (socket says 172.21.15.59:56634) 2023-09-30T22:32:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.670+0000 7f2f6d692700 1 -- 172.21.15.59:0/1107209074 learned_addr learned my addr 172.21.15.59:0/1107209074 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f2f6de93700 1 --2- 172.21.15.59:0/1107209074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f68135e50 0x7f2f68119940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f2f6d692700 1 -- 172.21.15.59:0/1107209074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f68135e50 msgr2=0x7f2f68119940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f2f6d692700 1 --2- 172.21.15.59:0/1107209074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f68135e50 0x7f2f68119940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f2f6d692700 1 -- 172.21.15.59:0/1107209074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6809e1d0 msgr2=0x7f2f681c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f2f6d692700 1 --2- 172.21.15.59:0/1107209074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6809e1d0 0x7f2f681c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f2f6d692700 1 -- 172.21.15.59:0/1107209074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6000bd40 con 0x7f2f6809d6f0 2023-09-30T22:32:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f2f6d692700 1 --2- 172.21.15.59:0/1107209074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6809d6f0 0x7f2f681c41c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c520 tx=0x7f2f6400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f2f5dffb700 1 -- 172.21.15.59:0/1107209074 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64005cb0 con 0x7f2f6809d6f0 2023-09-30T22:32:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f2f5dffb700 1 -- 172.21.15.59:0/1107209074 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f64005e10 con 0x7f2f6809d6f0 2023-09-30T22:32:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f2f5dffb700 1 -- 172.21.15.59:0/1107209074 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f640072d0 con 0x7f2f6809d6f0 2023-09-30T22:32:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.672+0000 7f2f6f8f6700 1 -- 172.21.15.59:0/1107209074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6811d150 con 0x7f2f6809d6f0 2023-09-30T22:32:41.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.672+0000 7f2f6f8f6700 1 -- 172.21.15.59:0/1107209074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f680a1d00 con 0x7f2f6809d6f0 2023-09-30T22:32:41.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.670+0000 7f7bd666d700 1 -- start start 2023-09-30T22:32:41.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f7bd666d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd009d6f0 0x7f7bd011e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f7bd666d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd009e000 0x7f7bd011e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f7bd666d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd009e410 0x7f7bd011eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f7bd666d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd0121be0 con 0x7f7bd009d6f0 2023-09-30T22:32:41.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f7bd666d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd00a3b10 con 0x7f7bd009e000 2023-09-30T22:32:41.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f7bd666d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd009c700 con 0x7f7bd009e410 2023-09-30T22:32:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f7bcf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd009e000 0x7f7bd011e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f7bcf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd009e000 0x7f7bd011e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60988/0 (socket says 172.21.15.59:60988) 2023-09-30T22:32:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f7bd4c0a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd009e410 0x7f7bd011eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.671+0000 7f7bcf7fe700 1 -- 172.21.15.59:0/4189081546 learned_addr learned my addr 172.21.15.59:0/4189081546 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.672+0000 7f7bcffff700 1 --2- 172.21.15.59:0/4189081546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd009d6f0 0x7f7bd011e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.672+0000 7f7bd4c0a700 1 -- 172.21.15.59:0/4189081546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd009e000 msgr2=0x7f7bd011e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.672+0000 7f7bd4c0a700 1 --2- 172.21.15.59:0/4189081546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd009e000 0x7f7bd011e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.672+0000 7f7bd4c0a700 1 -- 172.21.15.59:0/4189081546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd009d6f0 msgr2=0x7f7bd011e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.672+0000 7f7bd4c0a700 1 --2- 172.21.15.59:0/4189081546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd009d6f0 0x7f7bd011e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.672+0000 7f7bd4c0a700 1 -- 172.21.15.59:0/4189081546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc40094a0 con 0x7f7bd009e410 2023-09-30T22:32:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.673+0000 7f7bd4c0a700 1 --2- 172.21.15.59:0/4189081546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd009e410 0x7f7bd011eb40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009440 tx=0x7f7bc8007db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:41.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.673+0000 7f2f5dffb700 1 -- 172.21.15.59:0/1107209074 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f64007430 con 0x7f2f6809d6f0 2023-09-30T22:32:41.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.673+0000 7f2f5dffb700 1 -- 172.21.15.59:0/1107209074 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2f6403eb40 con 0x7f2f6809d6f0 2023-09-30T22:32:41.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.673+0000 7f2f6f8f6700 1 -- 172.21.15.59:0/1107209074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f68135c70 con 0x7f2f6809d6f0 2023-09-30T22:32:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.673+0000 7f7bccff9700 1 -- 172.21.15.59:0/4189081546 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8003c20 con 0x7f7bd009e410 2023-09-30T22:32:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.673+0000 7f7bd666d700 1 -- 172.21.15.59:0/4189081546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd0121640 con 0x7f7bd009e410 2023-09-30T22:32:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.673+0000 7f7bd666d700 1 -- 172.21.15.59:0/4189081546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd0120220 con 0x7f7bd009e410 2023-09-30T22:32:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.674+0000 7f7bccff9700 1 -- 172.21.15.59:0/4189081546 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc800f040 con 0x7f7bd009e410 2023-09-30T22:32:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.674+0000 7f7bccff9700 1 -- 172.21.15.59:0/4189081546 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc800d7a0 con 0x7f7bd009e410 2023-09-30T22:32:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.674+0000 7f7bccff9700 1 -- 172.21.15.59:0/4189081546 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7bc800d960 con 0x7f7bd009e410 2023-09-30T22:32:41.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.675+0000 7f7bccff9700 1 -- 172.21.15.59:0/4189081546 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7bc803f620 con 0x7f7bd009e410 2023-09-30T22:32:41.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.676+0000 7f7bd666d700 1 -- 172.21.15.59:0/4189081546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb00052e0 con 0x7f7bd009e410 2023-09-30T22:32:41.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.680+0000 7f2f5dffb700 1 -- 172.21.15.59:0/1107209074 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f64017070 con 0x7f2f6809d6f0 2023-09-30T22:32:41.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.683+0000 7f7bccff9700 1 -- 172.21.15.59:0/4189081546 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7bc801a080 con 0x7f7bd009e410 2023-09-30T22:32:41.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.720+0000 7f1faf11d700 1 Processor -- start 2023-09-30T22:32:41.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.720+0000 7f1faf11d700 1 -- start start 2023-09-30T22:32:41.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.721+0000 7f1faf11d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1fa809e1d0 0x7f1fa8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.721+0000 7f1faf11d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8139170 0x7f1fa813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.721+0000 7f1faf11d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa809b120 con 0x7f1fa809d6f0 2023-09-30T22:32:41.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.721+0000 7f1faf11d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa806b460 con 0x7f1fa809e1d0 2023-09-30T22:32:41.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.721+0000 7f1faf11d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa809a7e0 con 0x7f1fa8139170 2023-09-30T22:32:41.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.721+0000 7f1fad6ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8139170 0x7f1fa813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.721+0000 7f1f9ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1fa809e1d0 0x7f1fa8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.721+0000 7f1faceb9700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1fa809d6f0 0x7f1fa809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52584/0 (socket says 172.21.15.59:52584) 2023-09-30T22:32:41.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.721+0000 7f1faceb9700 1 -- 172.21.15.59:0/666179204 learned_addr learned my addr 172.21.15.59:0/666179204 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:41.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.721+0000 7f1f9f7fe700 1 -- 172.21.15.59:0/666179204 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922973663 0 0) 0x7f1fa809b120 con 0x7f1fa809d6f0 2023-09-30T22:32:41.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.721+0000 7f1f9f7fe700 1 -- 172.21.15.59:0/666179204 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f900035b0 con 0x7f1fa809d6f0 2023-09-30T22:32:41.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.721+0000 7f1f9ffff700 1 -- 172.21.15.59:0/666179204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8139170 msgr2=0x7f1fa813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:41.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.721+0000 7f1f9ffff700 1 --2- 172.21.15.59:0/666179204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8139170 0x7f1fa813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.721+0000 7f1f9ffff700 1 -- 172.21.15.59:0/666179204 >> v1:172.21.15.59:6789/0 conn(0x7f1fa809d6f0 legacy=0x7f1fa809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.721+0000 7f1f9ffff700 1 -- 172.21.15.59:0/666179204 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa809a500 con 0x7f1fa809e1d0 2023-09-30T22:32:41.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.722+0000 7f1f9ffff700 1 --2- 172.21.15.59:0/666179204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa809e1d0 0x7f1fa8138c30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009870 tx=0x7f1f98009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1067bee1d4ab25cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:41.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.722+0000 7f1f9f7fe700 1 -- 172.21.15.59:0/666179204 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98011830 con 0x7f1fa809e1d0 2023-09-30T22:32:41.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.722+0000 7f1f9f7fe700 1 -- 172.21.15.59:0/666179204 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f98011990 con 0x7f1fa809e1d0 2023-09-30T22:32:41.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.722+0000 7f1f9f7fe700 1 -- 172.21.15.59:0/666179204 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98011d20 con 0x7f1fa809e1d0 2023-09-30T22:32:41.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.723+0000 7f1faf11d700 1 -- 172.21.15.59:0/666179204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa809e1d0 msgr2=0x7f1fa8138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.723+0000 7f1faf11d700 1 --2- 172.21.15.59:0/666179204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa809e1d0 0x7f1fa8138c30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009870 tx=0x7f1f98009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:41.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.723+0000 7f1faf11d700 1 -- 172.21.15.59:0/666179204 shutdown_connections 2023-09-30T22:32:41.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.723+0000 7f1faf11d700 1 --2- 172.21.15.59:0/666179204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8139170 0x7f1fa813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.723+0000 7f1faf11d700 1 --2- 172.21.15.59:0/666179204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa809e1d0 0x7f1fa8138c30 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.723+0000 7f1faf11d700 1 -- 172.21.15.59:0/666179204 >> 172.21.15.59:0/666179204 conn(0x7f1fa8066f50 msgr2=0x7f1fa809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:41.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.723+0000 7f1faf11d700 1 -- 172.21.15.59:0/666179204 shutdown_connections 2023-09-30T22:32:41.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.723+0000 7f1faf11d700 1 -- 172.21.15.59:0/666179204 wait complete. 2023-09-30T22:32:41.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.724+0000 7f1faf11d700 1 Processor -- start 2023-09-30T22:32:41.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.724+0000 7f1faf11d700 1 -- start start 2023-09-30T22:32:41.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.724+0000 7f1faf11d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa809d6f0 0x7f1fa8126d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.724+0000 7f1faf11d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa809e1d0 0x7f1fa81272d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.725+0000 7f1faf11d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8139170 0x7f1fa81cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:41.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.725+0000 7f1faf11d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8128bd0 con 0x7f1fa809e1d0 2023-09-30T22:32:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.725+0000 7f1faf11d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8127810 con 0x7f1fa8139170 2023-09-30T22:32:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.725+0000 7f1faf11d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa809c780 con 0x7f1fa809d6f0 2023-09-30T22:32:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.725+0000 7f1faceb9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa809d6f0 0x7f1fa8126d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.725+0000 7f1faceb9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa809d6f0 0x7f1fa8126d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39732/0 (socket says 172.21.15.59:39732) 2023-09-30T22:32:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.725+0000 7f1faceb9700 1 -- 172.21.15.59:0/3347605563 learned_addr learned my addr 172.21.15.59:0/3347605563 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.725+0000 7f1f9ffff700 1 --2- 172.21.15.59:0/3347605563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa809e1d0 0x7f1fa81272d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.725+0000 7f1fad6ba700 1 --2- 172.21.15.59:0/3347605563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8139170 0x7f1fa81cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.725+0000 7f1f9ffff700 1 -- 172.21.15.59:0/3347605563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa809d6f0 msgr2=0x7f1fa8126d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.725+0000 7f1f9ffff700 1 --2- 172.21.15.59:0/3347605563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa809d6f0 0x7f1fa8126d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.725+0000 7f1f9ffff700 1 -- 172.21.15.59:0/3347605563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8139170 msgr2=0x7f1fa81cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.725+0000 7f1f9ffff700 1 --2- 172.21.15.59:0/3347605563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8139170 0x7f1fa81cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.725+0000 7f1f9ffff700 1 -- 172.21.15.59:0/3347605563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f980094a0 con 0x7f1fa809e1d0 2023-09-30T22:32:41.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.725+0000 7f1fad6ba700 1 --2- 172.21.15.59:0/3347605563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8139170 0x7f1fa81cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.726+0000 7f1f9ffff700 1 --2- 172.21.15.59:0/3347605563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa809e1d0 0x7f1fa81272d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1f98016000 tx=0x7f1f98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.726+0000 7f1f9d7fa700 1 -- 172.21.15.59:0/3347605563 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98004590 con 0x7f1fa809e1d0 2023-09-30T22:32:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.726+0000 7f1f9d7fa700 1 -- 172.21.15.59:0/3347605563 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9801f070 con 0x7f1fa809e1d0 2023-09-30T22:32:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.726+0000 7f1faf11d700 1 -- 172.21.15.59:0/3347605563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa8126960 con 0x7f1fa809e1d0 2023-09-30T22:32:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.726+0000 7f1f9d7fa700 1 -- 172.21.15.59:0/3347605563 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f980038e0 con 0x7f1fa809e1d0 2023-09-30T22:32:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.726+0000 7f1faf11d700 1 -- 172.21.15.59:0/3347605563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa812a500 con 0x7f1fa809e1d0 2023-09-30T22:32:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.727+0000 7f1f9d7fa700 1 -- 172.21.15.59:0/3347605563 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f98003a40 con 0x7f1fa809e1d0 2023-09-30T22:32:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.727+0000 7f1f9d7fa700 1 -- 172.21.15.59:0/3347605563 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f98021070 con 0x7f1fa809e1d0 2023-09-30T22:32:41.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.727+0000 7f1faf11d700 1 -- 172.21.15.59:0/3347605563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa8129e70 con 0x7f1fa809e1d0 2023-09-30T22:32:41.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.737+0000 7f1f9d7fa700 1 -- 172.21.15.59:0/3347605563 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f9802b020 con 0x7f1fa809e1d0 2023-09-30T22:32:41.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.869+0000 7f8fb25c7700 1 -- 172.21.15.59:0/2777426846 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8fac11f960 con 0x7f8fac134260 2023-09-30T22:32:41.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.869+0000 7f8fa8ff9700 1 -- 172.21.15.59:0/2777426846 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8fa402c090 con 0x7f8fac134260 2023-09-30T22:32:41.871 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:41.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.871+0000 7f8fb25c7700 1 -- 172.21.15.59:0/2777426846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fac134260 msgr2=0x7f8fac09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.871+0000 7f8fb25c7700 1 --2- 172.21.15.59:0/2777426846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fac134260 0x7f8fac09cf00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009eb0 tx=0x7f8fa400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.872+0000 7f8fb25c7700 1 -- 172.21.15.59:0/2777426846 shutdown_connections 2023-09-30T22:32:41.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.872+0000 7f8fb25c7700 1 --2- 172.21.15.59:0/2777426846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fac134260 0x7f8fac09cf00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.872+0000 7f8fb25c7700 1 --2- 172.21.15.59:0/2777426846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fac133420 0x7f8fac09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.872+0000 7f8fb25c7700 1 --2- 172.21.15.59:0/2777426846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fac133e30 0x7f8fac09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.872+0000 7f8fb25c7700 1 -- 172.21.15.59:0/2777426846 >> 172.21.15.59:0/2777426846 conn(0x7f8fac0a4210 msgr2=0x7f8fac0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:41.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.872+0000 7f8fb25c7700 1 -- 172.21.15.59:0/2777426846 shutdown_connections 2023-09-30T22:32:41.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.872+0000 7f8fb25c7700 1 -- 172.21.15.59:0/2777426846 wait complete. 2023-09-30T22:32:41.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:41.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.898+0000 7f7bd666d700 1 -- 172.21.15.59:0/4189081546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7bb0005150 con 0x7f7bd009e410 2023-09-30T22:32:41.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.898+0000 7f7bccff9700 1 -- 172.21.15.59:0/4189081546 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7bc8013300 con 0x7f7bd009e410 2023-09-30T22:32:41.900 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.901+0000 7f7bd666d700 1 -- 172.21.15.59:0/4189081546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd009e410 msgr2=0x7f7bd011eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.901+0000 7f7bd666d700 1 --2- 172.21.15.59:0/4189081546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd009e410 0x7f7bd011eb40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009440 tx=0x7f7bc8007db0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.901+0000 7f7bd666d700 1 -- 172.21.15.59:0/4189081546 shutdown_connections 2023-09-30T22:32:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.901+0000 7f7bd666d700 1 --2- 172.21.15.59:0/4189081546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd009e410 0x7f7bd011eb40 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.901+0000 7f7bd666d700 1 --2- 172.21.15.59:0/4189081546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd009d6f0 0x7f7bd011e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.901+0000 7f7bd666d700 1 --2- 172.21.15.59:0/4189081546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd009e000 0x7f7bd011e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.901+0000 7f7bd666d700 1 -- 172.21.15.59:0/4189081546 >> 172.21.15.59:0/4189081546 conn(0x7f7bd0066f50 msgr2=0x7f7bd0070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.901+0000 7f7bd666d700 1 -- 172.21.15.59:0/4189081546 shutdown_connections 2023-09-30T22:32:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.901+0000 7f7bd666d700 1 -- 172.21.15.59:0/4189081546 wait complete. 2023-09-30T22:32:41.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.911+0000 7f2f6f8f6700 1 -- 172.21.15.59:0/1107209074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2f68074ea0 con 0x7f2f6809d6f0 2023-09-30T22:32:41.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.911+0000 7f2f5dffb700 1 -- 172.21.15.59:0/1107209074 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f6403ce60 con 0x7f2f6809d6f0 2023-09-30T22:32:41.913 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:41.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.914+0000 7f2f6f8f6700 1 -- 172.21.15.59:0/1107209074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6809d6f0 msgr2=0x7f2f681c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.914+0000 7f2f6f8f6700 1 --2- 172.21.15.59:0/1107209074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6809d6f0 0x7f2f681c41c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c520 tx=0x7f2f6400c830 comp rx=0 tx=0).stop 2023-09-30T22:32:41.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.914+0000 7f2f6f8f6700 1 -- 172.21.15.59:0/1107209074 shutdown_connections 2023-09-30T22:32:41.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.914+0000 7f2f6f8f6700 1 --2- 172.21.15.59:0/1107209074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f68135e50 0x7f2f68119940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.914+0000 7f2f6f8f6700 1 --2- 172.21.15.59:0/1107209074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6809d6f0 0x7f2f681c41c0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.914+0000 7f2f6f8f6700 1 --2- 172.21.15.59:0/1107209074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6809e1d0 0x7f2f681c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.914+0000 7f2f6f8f6700 1 -- 172.21.15.59:0/1107209074 >> 172.21.15.59:0/1107209074 conn(0x7f2f68066f50 msgr2=0x7f2f680a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:41.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.914+0000 7f2f6f8f6700 1 -- 172.21.15.59:0/1107209074 shutdown_connections 2023-09-30T22:32:41.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.914+0000 7f2f6f8f6700 1 -- 172.21.15.59:0/1107209074 wait complete. 2023-09-30T22:32:41.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:41.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:41.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.949+0000 7f1faf11d700 1 -- 172.21.15.59:0/3347605563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1fa809f420 con 0x7f1fa809e1d0 2023-09-30T22:32:41.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.949+0000 7f1f9d7fa700 1 -- 172.21.15.59:0/3347605563 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f98015070 con 0x7f1fa809e1d0 2023-09-30T22:32:41.951 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:41.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.951+0000 7f1faf11d700 1 -- 172.21.15.59:0/3347605563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa809e1d0 msgr2=0x7f1fa81272d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:41.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.951+0000 7f1faf11d700 1 --2- 172.21.15.59:0/3347605563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa809e1d0 0x7f1fa81272d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1f98016000 tx=0x7f1f98004750 comp rx=0 tx=0).stop 2023-09-30T22:32:41.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.951+0000 7f1faf11d700 1 -- 172.21.15.59:0/3347605563 shutdown_connections 2023-09-30T22:32:41.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.951+0000 7f1faf11d700 1 --2- 172.21.15.59:0/3347605563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fa809d6f0 0x7f1fa8126d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.952+0000 7f1faf11d700 1 --2- 172.21.15.59:0/3347605563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fa8139170 0x7f1fa81cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.952+0000 7f1faf11d700 1 --2- 172.21.15.59:0/3347605563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa809e1d0 0x7f1fa81272d0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:41.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.952+0000 7f1faf11d700 1 -- 172.21.15.59:0/3347605563 >> 172.21.15.59:0/3347605563 conn(0x7f1fa8066f50 msgr2=0x7f1fa81383d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:41.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.952+0000 7f1faf11d700 1 -- 172.21.15.59:0/3347605563 shutdown_connections 2023-09-30T22:32:41.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:41.952+0000 7f1faf11d700 1 -- 172.21.15.59:0/3347605563 wait complete. 2023-09-30T22:32:41.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:42.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:42.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:42.930 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:42.966 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.052+0000 7f7d206c1700 1 Processor -- start 2023-09-30T22:32:43.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.052+0000 7f7d206c1700 1 -- start start 2023-09-30T22:32:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.053+0000 7f7d206c1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d18133420 0x7f7d181337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.053+0000 7f7d206c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d18133e30 0x7f7d1812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.053+0000 7f7d206c1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1806b990 con 0x7f7d18134260 2023-09-30T22:32:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.053+0000 7f7d206c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d180a0590 con 0x7f7d18133e30 2023-09-30T22:32:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.053+0000 7f7d206c1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1809fb80 con 0x7f7d18133420 2023-09-30T22:32:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.054+0000 7f7d1dc5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d18133e30 0x7f7d1812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.054+0000 7f7d1ec5e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7d18134260 0x7f7d181304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52592/0 (socket says 172.21.15.59:52592) 2023-09-30T22:32:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.054+0000 7f7d1ec5e700 1 -- 172.21.15.59:0/501607116 learned_addr learned my addr 172.21.15.59:0/501607116 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.054+0000 7f7d1e45d700 1 --2- 172.21.15.59:0/501607116 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d18133420 0x7f7d181337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.054+0000 7f7d1dc5c700 1 -- 172.21.15.59:0/501607116 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d18133420 msgr2=0x7f7d181337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.054+0000 7f7d1dc5c700 1 --2- 172.21.15.59:0/501607116 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d18133420 0x7f7d181337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.054+0000 7f7d1dc5c700 1 -- 172.21.15.59:0/501607116 >> v1:172.21.15.59:6789/0 conn(0x7f7d18134260 legacy=0x7f7d181304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.054+0000 7f7d1d45b700 1 -- 172.21.15.59:0/501607116 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103629686 0 0) 0x7f7d1806b990 con 0x7f7d18134260 2023-09-30T22:32:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.054+0000 7f7d1dc5c700 1 -- 172.21.15.59:0/501607116 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d180a0030 con 0x7f7d18133e30 2023-09-30T22:32:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.054+0000 7f7d1dc5c700 1 --2- 172.21.15.59:0/501607116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d18133e30 0x7f7d1812ff90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009870 tx=0x7f7d08009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d7b7a495546ae4b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.055+0000 7f7d1d45b700 1 -- 172.21.15.59:0/501607116 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08011830 con 0x7f7d18133e30 2023-09-30T22:32:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.055+0000 7f7d1d45b700 1 -- 172.21.15.59:0/501607116 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d08011990 con 0x7f7d18133e30 2023-09-30T22:32:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.055+0000 7f7d1d45b700 1 -- 172.21.15.59:0/501607116 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08011d20 con 0x7f7d18133e30 2023-09-30T22:32:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.056+0000 7f7d206c1700 1 -- 172.21.15.59:0/501607116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d18133e30 msgr2=0x7f7d1812ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.056+0000 7f7d206c1700 1 --2- 172.21.15.59:0/501607116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d18133e30 0x7f7d1812ff90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009870 tx=0x7f7d08009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.056+0000 7f7d206c1700 1 -- 172.21.15.59:0/501607116 shutdown_connections 2023-09-30T22:32:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.056+0000 7f7d206c1700 1 --2- 172.21.15.59:0/501607116 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d18133420 0x7f7d181337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.056+0000 7f7d206c1700 1 --2- 172.21.15.59:0/501607116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d18133e30 0x7f7d1812ff90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.056+0000 7f7d206c1700 1 -- 172.21.15.59:0/501607116 >> 172.21.15.59:0/501607116 conn(0x7f7d180a4210 msgr2=0x7f7d180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.056+0000 7f7d206c1700 1 -- 172.21.15.59:0/501607116 shutdown_connections 2023-09-30T22:32:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.056+0000 7f7d206c1700 1 -- 172.21.15.59:0/501607116 wait complete. 2023-09-30T22:32:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.058+0000 7f7d206c1700 1 Processor -- start 2023-09-30T22:32:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.058+0000 7f7d206c1700 1 -- start start 2023-09-30T22:32:43.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.058+0000 7f7d206c1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d18133420 0x7f7d1809c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.058+0000 7f7d206c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d18133e30 0x7f7d1809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.058+0000 7f7d206c1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d18134260 0x7f7d1809d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.058+0000 7f7d206c1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1809e110 con 0x7f7d18134260 2023-09-30T22:32:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.058+0000 7f7d206c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1811ffa0 con 0x7f7d18133e30 2023-09-30T22:32:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.059+0000 7f7d206c1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1811f9d0 con 0x7f7d18133420 2023-09-30T22:32:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.059+0000 7f7d1e45d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d18133420 0x7f7d1809c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.059+0000 7f7d1e45d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d18133420 0x7f7d1809c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39746/0 (socket says 172.21.15.59:39746) 2023-09-30T22:32:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.059+0000 7f7d1e45d700 1 -- 172.21.15.59:0/4271969389 learned_addr learned my addr 172.21.15.59:0/4271969389 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.059+0000 7f7d1dc5c700 1 --2- 172.21.15.59:0/4271969389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d18133e30 0x7f7d1809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.059+0000 7f7d1ec5e700 1 --2- 172.21.15.59:0/4271969389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d18134260 0x7f7d1809d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.059+0000 7f7d1e45d700 1 -- 172.21.15.59:0/4271969389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d18133e30 msgr2=0x7f7d1809cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.059+0000 7f7d1e45d700 1 --2- 172.21.15.59:0/4271969389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d18133e30 0x7f7d1809cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.059+0000 7f7d1e45d700 1 -- 172.21.15.59:0/4271969389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d18134260 msgr2=0x7f7d1809d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.059+0000 7f7d1e45d700 1 --2- 172.21.15.59:0/4271969389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d18134260 0x7f7d1809d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.059+0000 7f7d1e45d700 1 -- 172.21.15.59:0/4271969389 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d080094a0 con 0x7f7d18133420 2023-09-30T22:32:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.059+0000 7f7d1dc5c700 1 --2- 172.21.15.59:0/4271969389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d18133e30 0x7f7d1809cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.059+0000 7f7d1ec5e700 1 --2- 172.21.15.59:0/4271969389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d18134260 0x7f7d1809d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.059+0000 7f7d1e45d700 1 --2- 172.21.15.59:0/4271969389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d18133420 0x7f7d1809c6e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400e9b0 tx=0x7f7d1400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.059+0000 7f7d0effd700 1 -- 172.21.15.59:0/4271969389 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1400c850 con 0x7f7d18133420 2023-09-30T22:32:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.060+0000 7f7d0effd700 1 -- 172.21.15.59:0/4271969389 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1400c9b0 con 0x7f7d18133420 2023-09-30T22:32:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.060+0000 7f7d206c1700 1 -- 172.21.15.59:0/4271969389 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d18120280 con 0x7f7d18133420 2023-09-30T22:32:43.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.060+0000 7f7d0effd700 1 -- 172.21.15.59:0/4271969389 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1400cd20 con 0x7f7d18133420 2023-09-30T22:32:43.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.060+0000 7f7d206c1700 1 -- 172.21.15.59:0/4271969389 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1811ea90 con 0x7f7d18133420 2023-09-30T22:32:43.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.060+0000 7f7d0effd700 1 -- 172.21.15.59:0/4271969389 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d14013470 con 0x7f7d18133420 2023-09-30T22:32:43.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.061+0000 7f7d0effd700 1 -- 172.21.15.59:0/4271969389 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7d1403f8b0 con 0x7f7d18133420 2023-09-30T22:32:43.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.061+0000 7f7d206c1700 1 -- 172.21.15.59:0/4271969389 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d18074ea0 con 0x7f7d18133420 2023-09-30T22:32:43.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.066+0000 7f7d0effd700 1 -- 172.21.15.59:0/4271969389 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d140232f0 con 0x7f7d18133420 2023-09-30T22:32:43.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.079+0000 7f3471479700 1 Processor -- start 2023-09-30T22:32:43.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.079+0000 7f3471479700 1 -- start start 2023-09-30T22:32:43.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.080+0000 7f3471479700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346c131810 0x7f346c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.080+0000 7f3471479700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f346c099a40 0x7f346c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.080+0000 7f3471479700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c09a850 con 0x7f346c09a3b0 2023-09-30T22:32:43.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.080+0000 7f3471479700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c09b580 con 0x7f346c099a40 2023-09-30T22:32:43.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.080+0000 7f3471479700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f346c1313c0 con 0x7f346c131810 2023-09-30T22:32:43.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.080+0000 7f346a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f346c099a40 0x7f346c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.080+0000 7f346a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f346c099a40 0x7f346c099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56682/0 (socket says 172.21.15.59:56682) 2023-09-30T22:32:43.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.080+0000 7f346a7fc700 1 -- 172.21.15.59:0/195540894 learned_addr learned my addr 172.21.15.59:0/195540894 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:43.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.080+0000 7f346b7fe700 1 --1- 172.21.15.59:0/195540894 >> v1:172.21.15.59:6789/0 conn(0x7f346c09a3b0 0x7f346c138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52604/0 (socket says 172.21.15.59:52604) 2023-09-30T22:32:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.080+0000 7f346affd700 1 --2- 172.21.15.59:0/195540894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346c131810 0x7f346c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.080+0000 7f346a7fc700 1 -- 172.21.15.59:0/195540894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346c131810 msgr2=0x7f346c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.080+0000 7f346a7fc700 1 --2- 172.21.15.59:0/195540894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346c131810 0x7f346c131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.080+0000 7f346a7fc700 1 -- 172.21.15.59:0/195540894 >> v1:172.21.15.59:6789/0 conn(0x7f346c09a3b0 legacy=0x7f346c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.080+0000 7f346a7fc700 1 -- 172.21.15.59:0/195540894 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c06e8c0 con 0x7f346c099a40 2023-09-30T22:32:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.081+0000 7f346affd700 1 --2- 172.21.15.59:0/195540894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346c131810 0x7f346c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.081+0000 7f346a7fc700 1 --2- 172.21.15.59:0/195540894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346c099a40 0x7f346c099e70 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f3460009920 tx=0x7f3460009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e39b5e6e4fada0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.081+0000 7f3469ffb700 1 -- 172.21.15.59:0/195540894 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346000ba20 con 0x7f346c099a40 2023-09-30T22:32:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.081+0000 7f3469ffb700 1 -- 172.21.15.59:0/195540894 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346000bb80 con 0x7f346c099a40 2023-09-30T22:32:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.081+0000 7f3469ffb700 1 -- 172.21.15.59:0/195540894 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460009e70 con 0x7f346c099a40 2023-09-30T22:32:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.082+0000 7f3471479700 1 -- 172.21.15.59:0/195540894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346c099a40 msgr2=0x7f346c099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.082+0000 7f3471479700 1 --2- 172.21.15.59:0/195540894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346c099a40 0x7f346c099e70 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f3460009920 tx=0x7f3460009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.082+0000 7f3471479700 1 -- 172.21.15.59:0/195540894 shutdown_connections 2023-09-30T22:32:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.082+0000 7f3471479700 1 --2- 172.21.15.59:0/195540894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346c131810 0x7f346c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.082+0000 7f3471479700 1 --2- 172.21.15.59:0/195540894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346c099a40 0x7f346c099e70 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.082+0000 7f3471479700 1 -- 172.21.15.59:0/195540894 >> 172.21.15.59:0/195540894 conn(0x7f346c0a2aa0 msgr2=0x7f346c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.082+0000 7f3471479700 1 -- 172.21.15.59:0/195540894 shutdown_connections 2023-09-30T22:32:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.082+0000 7f3471479700 1 -- 172.21.15.59:0/195540894 wait complete. 2023-09-30T22:32:43.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.083+0000 7f3471479700 1 Processor -- start 2023-09-30T22:32:43.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.084+0000 7f3471479700 1 -- start start 2023-09-30T22:32:43.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.084+0000 7f3471479700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346c099a40 0x7f346c09c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.084+0000 7f3471479700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346c09a3b0 0x7f346c09c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.084+0000 7f3471479700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f346c131810 0x7f346c09cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.084+0000 7f3471479700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c119400 con 0x7f346c09a3b0 2023-09-30T22:32:43.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.084+0000 7f3471479700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c09d5d0 con 0x7f346c131810 2023-09-30T22:32:43.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.084+0000 7f3471479700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f346c09deb0 con 0x7f346c099a40 2023-09-30T22:32:43.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.084+0000 7f346a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346c09a3b0 0x7f346c09c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.084+0000 7f346a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346c09a3b0 0x7f346c09c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56686/0 (socket says 172.21.15.59:56686) 2023-09-30T22:32:43.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.084+0000 7f346a7fc700 1 -- 172.21.15.59:0/3654940284 learned_addr learned my addr 172.21.15.59:0/3654940284 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:43.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.085+0000 7f346a7fc700 1 -- 172.21.15.59:0/3654940284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346c099a40 msgr2=0x7f346c09c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.085+0000 7f346a7fc700 1 --2- 172.21.15.59:0/3654940284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346c099a40 0x7f346c09c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.085+0000 7f346a7fc700 1 -- 172.21.15.59:0/3654940284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f346c131810 msgr2=0x7f346c09cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.085+0000 7f346a7fc700 1 --2- 172.21.15.59:0/3654940284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f346c131810 0x7f346c09cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.085+0000 7f346a7fc700 1 -- 172.21.15.59:0/3654940284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3460009550 con 0x7f346c09a3b0 2023-09-30T22:32:43.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.085+0000 7f346a7fc700 1 --2- 172.21.15.59:0/3654940284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346c09a3b0 0x7f346c09c6b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f3460013000 tx=0x7f3460004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:43.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.085+0000 7f34537fe700 1 -- 172.21.15.59:0/3654940284 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34600036a0 con 0x7f346c09a3b0 2023-09-30T22:32:43.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.085+0000 7f34537fe700 1 -- 172.21.15.59:0/3654940284 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346001f070 con 0x7f346c09a3b0 2023-09-30T22:32:43.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.085+0000 7f34537fe700 1 -- 172.21.15.59:0/3654940284 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460003a40 con 0x7f346c09a3b0 2023-09-30T22:32:43.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.085+0000 7f3471479700 1 -- 172.21.15.59:0/3654940284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c0a1b40 con 0x7f346c09a3b0 2023-09-30T22:32:43.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.085+0000 7f3471479700 1 -- 172.21.15.59:0/3654940284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c09e310 con 0x7f346c09a3b0 2023-09-30T22:32:43.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.086+0000 7f3471479700 1 -- 172.21.15.59:0/3654940284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346c06eb60 con 0x7f346c09a3b0 2023-09-30T22:32:43.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.086+0000 7f34537fe700 1 -- 172.21.15.59:0/3654940284 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3460003ba0 con 0x7f346c09a3b0 2023-09-30T22:32:43.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.087+0000 7f34537fe700 1 -- 172.21.15.59:0/3654940284 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3460021070 con 0x7f346c09a3b0 2023-09-30T22:32:43.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.096+0000 7f34537fe700 1 -- 172.21.15.59:0/3654940284 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f346001ac60 con 0x7f346c09a3b0 2023-09-30T22:32:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.104+0000 7f5406f65700 1 Processor -- start 2023-09-30T22:32:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.104+0000 7f5406f65700 1 -- start start 2023-09-30T22:32:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.104+0000 7f5406f65700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f540012cf60 0x7f540006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.104+0000 7f5406f65700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f540012f8b0 0x7f540012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.104+0000 7f5406f65700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540012cd90 con 0x7f5400130260 2023-09-30T22:32:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.104+0000 7f5406f65700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540012d330 con 0x7f540012cf60 2023-09-30T22:32:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.104+0000 7f5406f65700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54001306d0 con 0x7f540012f8b0 2023-09-30T22:32:43.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.104+0000 7f5405502700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5400130260 0x7f5400136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52610/0 (socket says 172.21.15.59:52610) 2023-09-30T22:32:43.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f5405502700 1 -- 172.21.15.59:0/2468527760 learned_addr learned my addr 172.21.15.59:0/2468527760 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:43.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 -- 172.21.15.59:0/2468527760 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521922711 0 0) 0x7f540012cd90 con 0x7f5400130260 2023-09-30T22:32:43.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 -- 172.21.15.59:0/2468527760 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53f00035b0 con 0x7f5400130260 2023-09-30T22:32:43.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f5404d01700 1 --2- 172.21.15.59:0/2468527760 >> v2:172.21.15.59:3300/0 conn(0x7f540012cf60 0x7f540006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 -- 172.21.15.59:0/2468527760 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1231117954 0 0) 0x7f53f00035b0 con 0x7f5400130260 2023-09-30T22:32:43.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 -- 172.21.15.59:0/2468527760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f540012f8b0 msgr2=0x7f540012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 --2- 172.21.15.59:0/2468527760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f540012f8b0 0x7f540012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 -- 172.21.15.59:0/2468527760 >> v2:172.21.15.59:3300/0 conn(0x7f540012cf60 msgr2=0x7f540006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 --2- 172.21.15.59:0/2468527760 >> v2:172.21.15.59:3300/0 conn(0x7f540012cf60 0x7f540006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 -- 172.21.15.59:0/2468527760 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5400071780 con 0x7f5400130260 2023-09-30T22:32:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 -- 172.21.15.59:0/2468527760 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1997034051 0 0) 0x7f53f80019f0 con 0x7f5400130260 2023-09-30T22:32:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 -- 172.21.15.59:0/2468527760 >> v1:172.21.15.59:6789/0 conn(0x7f5400130260 legacy=0x7f5400136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 --2- 172.21.15.59:0/2468527760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f540012f8b0 0x7f53f0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 --2- 172.21.15.59:0/2468527760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53f0003f80 0x7f53f0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 --2- 172.21.15.59:0/2468527760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f0004d90 0x7f53f0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 -- 172.21.15.59:0/2468527760 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540012d330 con 0x7f53f0004d90 2023-09-30T22:32:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 -- 172.21.15.59:0/2468527760 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54001306d0 con 0x7f540012f8b0 2023-09-30T22:32:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53ff7fe700 1 -- 172.21.15.59:0/2468527760 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53f000bc20 con 0x7f53f0003f80 2023-09-30T22:32:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.105+0000 7f53fffff700 1 --2- 172.21.15.59:0/2468527760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53f0003f80 0x7f53f0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.106+0000 7f5405502700 1 --2- 172.21.15.59:0/2468527760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f0004d90 0x7f53f0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.106+0000 7f53fffff700 1 -- 172.21.15.59:0/2468527760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f540012f8b0 msgr2=0x7f53f0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.106+0000 7f53fffff700 1 --2- 172.21.15.59:0/2468527760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f540012f8b0 0x7f53f0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.106+0000 7f53fffff700 1 -- 172.21.15.59:0/2468527760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f0004d90 msgr2=0x7f53f0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.106+0000 7f53fffff700 1 --2- 172.21.15.59:0/2468527760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f0004d90 0x7f53f0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.106+0000 7f53fffff700 1 -- 172.21.15.59:0/2468527760 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5400071780 con 0x7f53f0003f80 2023-09-30T22:32:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.106+0000 7f53fffff700 1 --2- 172.21.15.59:0/2468527760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53f0003f80 0x7f53f0004850 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00bbb0 tx=0x7f53f0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9434b67cd0a11ab3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.106+0000 7f53ff7fe700 1 -- 172.21.15.59:0/2468527760 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec00da60 con 0x7f53f0003f80 2023-09-30T22:32:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.106+0000 7f53ff7fe700 1 -- 172.21.15.59:0/2468527760 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec00dbe0 con 0x7f53f0003f80 2023-09-30T22:32:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.106+0000 7f53ff7fe700 1 -- 172.21.15.59:0/2468527760 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec010470 con 0x7f53f0003f80 2023-09-30T22:32:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.107+0000 7f5406f65700 1 -- 172.21.15.59:0/2468527760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53f0003f80 msgr2=0x7f53f0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.107+0000 7f5406f65700 1 --2- 172.21.15.59:0/2468527760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53f0003f80 0x7f53f0004850 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00bbb0 tx=0x7f53f0005880 comp rx=0 tx=0).stop 2023-09-30T22:32:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.107+0000 7f5405502700 1 -- 172.21.15.59:0/2468527760 reap_dead start 2023-09-30T22:32:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.107+0000 7f5406f65700 1 -- 172.21.15.59:0/2468527760 shutdown_connections 2023-09-30T22:32:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.107+0000 7f5406f65700 1 -- 172.21.15.59:0/2468527760 >> 172.21.15.59:0/2468527760 conn(0x7f54000a2aa0 msgr2=0x7f54000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.107+0000 7f5406f65700 1 -- 172.21.15.59:0/2468527760 shutdown_connections 2023-09-30T22:32:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.107+0000 7f5406f65700 1 -- 172.21.15.59:0/2468527760 wait complete. 2023-09-30T22:32:43.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.109+0000 7f5406f65700 1 Processor -- start 2023-09-30T22:32:43.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.109+0000 7f5406f65700 1 -- start start 2023-09-30T22:32:43.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.110+0000 7f5406f65700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f0003f80 0x7f54001214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.110+0000 7f5406f65700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5400121a20 0x7f5400121e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.110+0000 7f5406f65700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54001ccae0 0x7f54001ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.110+0000 7f5406f65700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54001223b0 con 0x7f5400121a20 2023-09-30T22:32:43.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.110+0000 7f5406f65700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540009e6e0 con 0x7f53f0003f80 2023-09-30T22:32:43.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.110+0000 7f5406f65700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f540009ed10 con 0x7f54001ccae0 2023-09-30T22:32:43.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.110+0000 7f5404d01700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f0003f80 0x7f54001214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.110+0000 7f5405502700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54001ccae0 0x7f54001ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.110+0000 7f5404d01700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f0003f80 0x7f54001214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:32830/0 (socket says 172.21.15.59:32830) 2023-09-30T22:32:43.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.110+0000 7f5404d01700 1 -- 172.21.15.59:0/3000767129 learned_addr learned my addr 172.21.15.59:0/3000767129 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:43.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.110+0000 7f53fffff700 1 --2- 172.21.15.59:0/3000767129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5400121a20 0x7f5400121e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.111+0000 7f5404d01700 1 -- 172.21.15.59:0/3000767129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54001ccae0 msgr2=0x7f54001ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.111+0000 7f5404d01700 1 --2- 172.21.15.59:0/3000767129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54001ccae0 0x7f54001ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.111+0000 7f5404d01700 1 -- 172.21.15.59:0/3000767129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5400121a20 msgr2=0x7f5400121e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.111+0000 7f5404d01700 1 --2- 172.21.15.59:0/3000767129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5400121a20 0x7f5400121e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.111+0000 7f5404d01700 1 -- 172.21.15.59:0/3000767129 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54001236c0 con 0x7f53f0003f80 2023-09-30T22:32:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.111+0000 7f5404d01700 1 --2- 172.21.15.59:0/3000767129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f0003f80 0x7f54001214e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f53f400e8f0 tx=0x7f53f400ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.111+0000 7f53fd7fa700 1 -- 172.21.15.59:0/3000767129 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f400c8e0 con 0x7f53f0003f80 2023-09-30T22:32:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.111+0000 7f53fd7fa700 1 -- 172.21.15.59:0/3000767129 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f400ca60 con 0x7f53f0003f80 2023-09-30T22:32:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.111+0000 7f53fd7fa700 1 -- 172.21.15.59:0/3000767129 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f400ce10 con 0x7f53f0003f80 2023-09-30T22:32:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.112+0000 7f5406f65700 1 -- 172.21.15.59:0/3000767129 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540012d840 con 0x7f53f0003f80 2023-09-30T22:32:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.112+0000 7f5406f65700 1 -- 172.21.15.59:0/3000767129 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5400129fa0 con 0x7f53f0003f80 2023-09-30T22:32:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.113+0000 7f53fd7fa700 1 -- 172.21.15.59:0/3000767129 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53f40113f0 con 0x7f53f0003f80 2023-09-30T22:32:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.113+0000 7f53fd7fa700 1 -- 172.21.15.59:0/3000767129 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f53f403f2a0 con 0x7f53f0003f80 2023-09-30T22:32:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.113+0000 7f5406f65700 1 -- 172.21.15.59:0/3000767129 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5400123500 con 0x7f53f0003f80 2023-09-30T22:32:43.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.122+0000 7f53fd7fa700 1 -- 172.21.15.59:0/3000767129 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5400123500 con 0x7f53f0003f80 2023-09-30T22:32:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.127+0000 7f3de49d2700 1 Processor -- start 2023-09-30T22:32:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.127+0000 7f3de49d2700 1 -- start start 2023-09-30T22:32:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.128+0000 7f3de49d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de00a1510 0x7f3de0138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.128+0000 7f3de49d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0139250 0x7f3de013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.128+0000 7f3de49d2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de009edd0 con 0x7f3de00a0a30 2023-09-30T22:32:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.128+0000 7f3de49d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00a18e0 con 0x7f3de0139250 2023-09-30T22:32:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.128+0000 7f3de49d2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3de009e1f0 con 0x7f3de00a1510 2023-09-30T22:32:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.128+0000 7f3dd5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de00a1510 0x7f3de0138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.128+0000 7f3dd5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de00a1510 0x7f3de0138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39806/0 (socket says 172.21.15.59:39806) 2023-09-30T22:32:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.128+0000 7f3dd5d9b700 1 -- 172.21.15.59:0/3009427937 learned_addr learned my addr 172.21.15.59:0/3009427937 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.128+0000 7f3dded9d700 1 --2- 172.21.15.59:0/3009427937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0139250 0x7f3de013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.129+0000 7f3dd5d9b700 1 -- 172.21.15.59:0/3009427937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0139250 msgr2=0x7f3de013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.129+0000 7f3dd5d9b700 1 --2- 172.21.15.59:0/3009427937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0139250 0x7f3de013b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.129+0000 7f3dd5d9b700 1 -- 172.21.15.59:0/3009427937 >> v1:172.21.15.59:6789/0 conn(0x7f3de00a0a30 legacy=0x7f3de00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.129+0000 7f3dd5d9b700 1 -- 172.21.15.59:0/3009427937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de009dc50 con 0x7f3de00a1510 2023-09-30T22:32:43.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.129+0000 7f3dd5d9b700 1 --2- 172.21.15.59:0/3009427937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de00a1510 0x7f3de0138d10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009920 tx=0x7f3dc8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f1b2601424cd707 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.129+0000 7f3dddd9b700 1 -- 172.21.15.59:0/3009427937 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8004230 con 0x7f3de00a1510 2023-09-30T22:32:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.129+0000 7f3dddd9b700 1 -- 172.21.15.59:0/3009427937 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc8004390 con 0x7f3de00a1510 2023-09-30T22:32:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.129+0000 7f3dddd9b700 1 -- 172.21.15.59:0/3009427937 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8009e70 con 0x7f3de00a1510 2023-09-30T22:32:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.130+0000 7f3de49d2700 1 -- 172.21.15.59:0/3009427937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de00a1510 msgr2=0x7f3de0138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.130+0000 7f3de49d2700 1 --2- 172.21.15.59:0/3009427937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de00a1510 0x7f3de0138d10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009920 tx=0x7f3dc8009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.130+0000 7f3de49d2700 1 -- 172.21.15.59:0/3009427937 shutdown_connections 2023-09-30T22:32:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.130+0000 7f3de49d2700 1 --2- 172.21.15.59:0/3009427937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0139250 0x7f3de013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.130+0000 7f3de49d2700 1 --2- 172.21.15.59:0/3009427937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de00a1510 0x7f3de0138d10 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.130+0000 7f3de49d2700 1 -- 172.21.15.59:0/3009427937 >> 172.21.15.59:0/3009427937 conn(0x7f3de00a6550 msgr2=0x7f3de00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.130+0000 7f3de49d2700 1 -- 172.21.15.59:0/3009427937 shutdown_connections 2023-09-30T22:32:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.130+0000 7f3de49d2700 1 -- 172.21.15.59:0/3009427937 wait complete. 2023-09-30T22:32:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.131+0000 7f3de49d2700 1 Processor -- start 2023-09-30T22:32:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.131+0000 7f3de49d2700 1 -- start start 2023-09-30T22:32:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.132+0000 7f3de49d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de00a0a30 0x7f3de0121930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.132+0000 7f3de49d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de00a1510 0x7f3de0121e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.132+0000 7f3de49d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0139250 0x7f3de01223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.132+0000 7f3de49d2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de0123630 con 0x7f3de00a0a30 2023-09-30T22:32:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.132+0000 7f3de49d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de01255e0 con 0x7f3de0139250 2023-09-30T22:32:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.132+0000 7f3de49d2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3de01250e0 con 0x7f3de00a1510 2023-09-30T22:32:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.132+0000 7f3dde59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de00a0a30 0x7f3de0121930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.132+0000 7f3dd5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de00a1510 0x7f3de0121e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.132+0000 7f3dd5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de00a1510 0x7f3de0121e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39810/0 (socket says 172.21.15.59:39810) 2023-09-30T22:32:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.132+0000 7f3dde59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de00a0a30 0x7f3de0121930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56722/0 (socket says 172.21.15.59:56722) 2023-09-30T22:32:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.132+0000 7f3dd5d9b700 1 -- 172.21.15.59:0/1391484833 learned_addr learned my addr 172.21.15.59:0/1391484833 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.132+0000 7f3dded9d700 1 --2- 172.21.15.59:0/1391484833 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0139250 0x7f3de01223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.133+0000 7f3dde59c700 1 -- 172.21.15.59:0/1391484833 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de00a1510 msgr2=0x7f3de0121e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.133+0000 7f3dde59c700 1 --2- 172.21.15.59:0/1391484833 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de00a1510 0x7f3de0121e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.133+0000 7f3dde59c700 1 -- 172.21.15.59:0/1391484833 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0139250 msgr2=0x7f3de01223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.133+0000 7f3dde59c700 1 --2- 172.21.15.59:0/1391484833 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0139250 0x7f3de01223b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.133+0000 7f3dde59c700 1 -- 172.21.15.59:0/1391484833 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc8009550 con 0x7f3de00a0a30 2023-09-30T22:32:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.133+0000 7f3dded9d700 1 --2- 172.21.15.59:0/1391484833 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0139250 0x7f3de01223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.133+0000 7f3dde59c700 1 --2- 172.21.15.59:0/1391484833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de00a0a30 0x7f3de0121930 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000c400 tx=0x7f3dd000c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.133+0000 7f3dd77fe700 1 -- 172.21.15.59:0/1391484833 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0011790 con 0x7f3de00a0a30 2023-09-30T22:32:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.133+0000 7f3dd77fe700 1 -- 172.21.15.59:0/1391484833 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd00118f0 con 0x7f3de00a0a30 2023-09-30T22:32:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.133+0000 7f3de49d2700 1 -- 172.21.15.59:0/1391484833 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de0124b50 con 0x7f3de00a0a30 2023-09-30T22:32:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.133+0000 7f3dd77fe700 1 -- 172.21.15.59:0/1391484833 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0011ca0 con 0x7f3de00a0a30 2023-09-30T22:32:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.133+0000 7f3de49d2700 1 -- 172.21.15.59:0/1391484833 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de0123ca0 con 0x7f3de00a0a30 2023-09-30T22:32:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.134+0000 7f3de49d2700 1 -- 172.21.15.59:0/1391484833 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de0074ea0 con 0x7f3de00a0a30 2023-09-30T22:32:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.135+0000 7f3dd77fe700 1 -- 172.21.15.59:0/1391484833 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3dd001c460 con 0x7f3de00a0a30 2023-09-30T22:32:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.135+0000 7f3dd77fe700 1 -- 172.21.15.59:0/1391484833 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3dd003fdd0 con 0x7f3de00a0a30 2023-09-30T22:32:43.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.139+0000 7f3dd77fe700 1 -- 172.21.15.59:0/1391484833 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3dd001a770 con 0x7f3de00a0a30 2023-09-30T22:32:43.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.305+0000 7f7d206c1700 1 -- 172.21.15.59:0/4271969389 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7d1806b250 con 0x7f7d18133420 2023-09-30T22:32:43.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.305+0000 7f7d0effd700 1 -- 172.21.15.59:0/4271969389 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d1402b090 con 0x7f7d18133420 2023-09-30T22:32:43.306 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:43.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.307+0000 7f7d206c1700 1 -- 172.21.15.59:0/4271969389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d18133420 msgr2=0x7f7d1809c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.307+0000 7f7d206c1700 1 --2- 172.21.15.59:0/4271969389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d18133420 0x7f7d1809c6e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400e9b0 tx=0x7f7d1400ed70 comp rx=0 tx=0).stop 2023-09-30T22:32:43.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.307+0000 7f7d206c1700 1 -- 172.21.15.59:0/4271969389 shutdown_connections 2023-09-30T22:32:43.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.307+0000 7f7d206c1700 1 --2- 172.21.15.59:0/4271969389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d18133420 0x7f7d1809c6e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.307+0000 7f7d206c1700 1 --2- 172.21.15.59:0/4271969389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d18134260 0x7f7d1809d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.307+0000 7f7d206c1700 1 --2- 172.21.15.59:0/4271969389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d18133e30 0x7f7d1809cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.307+0000 7f7d206c1700 1 -- 172.21.15.59:0/4271969389 >> 172.21.15.59:0/4271969389 conn(0x7f7d180a4210 msgr2=0x7f7d180a3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:43.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.308+0000 7f7d206c1700 1 -- 172.21.15.59:0/4271969389 shutdown_connections 2023-09-30T22:32:43.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.308+0000 7f7d206c1700 1 -- 172.21.15.59:0/4271969389 wait complete. 2023-09-30T22:32:43.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.312+0000 7f3471479700 1 -- 172.21.15.59:0/3654940284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f346c071db0 con 0x7f346c09a3b0 2023-09-30T22:32:43.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.312+0000 7f34537fe700 1 -- 172.21.15.59:0/3654940284 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f346002a030 con 0x7f346c09a3b0 2023-09-30T22:32:43.313 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:43.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.314+0000 7f3471479700 1 -- 172.21.15.59:0/3654940284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346c09a3b0 msgr2=0x7f346c09c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.314+0000 7f3471479700 1 --2- 172.21.15.59:0/3654940284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346c09a3b0 0x7f346c09c6b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f3460013000 tx=0x7f3460004750 comp rx=0 tx=0).stop 2023-09-30T22:32:43.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.315+0000 7f3471479700 1 -- 172.21.15.59:0/3654940284 shutdown_connections 2023-09-30T22:32:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.315+0000 7f3471479700 1 --2- 172.21.15.59:0/3654940284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346c099a40 0x7f346c09c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.315+0000 7f3471479700 1 --2- 172.21.15.59:0/3654940284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f346c131810 0x7f346c09cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.315+0000 7f3471479700 1 --2- 172.21.15.59:0/3654940284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346c09a3b0 0x7f346c09c6b0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.315+0000 7f3471479700 1 -- 172.21.15.59:0/3654940284 >> 172.21.15.59:0/3654940284 conn(0x7f346c0a2aa0 msgr2=0x7f346c12d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.315+0000 7f3471479700 1 -- 172.21.15.59:0/3654940284 shutdown_connections 2023-09-30T22:32:43.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.315+0000 7f3471479700 1 -- 172.21.15.59:0/3654940284 wait complete. 2023-09-30T22:32:43.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:43.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:43.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.348+0000 7f3de49d2700 1 -- 172.21.15.59:0/1391484833 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3de0072420 con 0x7f3de00a0a30 2023-09-30T22:32:43.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.348+0000 7f3dd77fe700 1 -- 172.21.15.59:0/1391484833 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3de0072420 con 0x7f3de00a0a30 2023-09-30T22:32:43.349 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:43.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.350+0000 7f3de49d2700 1 -- 172.21.15.59:0/1391484833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de00a0a30 msgr2=0x7f3de0121930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.350+0000 7f3de49d2700 1 --2- 172.21.15.59:0/1391484833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de00a0a30 0x7f3de0121930 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000c400 tx=0x7f3dd000c710 comp rx=0 tx=0).stop 2023-09-30T22:32:43.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.350+0000 7f3de49d2700 1 -- 172.21.15.59:0/1391484833 shutdown_connections 2023-09-30T22:32:43.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.350+0000 7f3de49d2700 1 --2- 172.21.15.59:0/1391484833 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3de0139250 0x7f3de01223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.350+0000 7f3de49d2700 1 --2- 172.21.15.59:0/1391484833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3de00a0a30 0x7f3de0121930 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.350+0000 7f3de49d2700 1 --2- 172.21.15.59:0/1391484833 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3de00a1510 0x7f3de0121e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.350+0000 7f3de49d2700 1 -- 172.21.15.59:0/1391484833 >> 172.21.15.59:0/1391484833 conn(0x7f3de00a6550 msgr2=0x7f3de0137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:43.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.350+0000 7f3de49d2700 1 -- 172.21.15.59:0/1391484833 shutdown_connections 2023-09-30T22:32:43.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.350+0000 7f3de49d2700 1 -- 172.21.15.59:0/1391484833 wait complete. 2023-09-30T22:32:43.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.352+0000 7f5406f65700 1 -- 172.21.15.59:0/3000767129 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5400123500 con 0x7f53f0003f80 2023-09-30T22:32:43.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.352+0000 7f53fd7fa700 1 -- 172.21.15.59:0/3000767129 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5400123500 con 0x7f53f0003f80 2023-09-30T22:32:43.356 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.354+0000 7f5406f65700 1 -- 172.21.15.59:0/3000767129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f0003f80 msgr2=0x7f54001214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.354+0000 7f5406f65700 1 --2- 172.21.15.59:0/3000767129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f0003f80 0x7f54001214e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f53f400e8f0 tx=0x7f53f400ec00 comp rx=0 tx=0).stop 2023-09-30T22:32:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.355+0000 7f5406f65700 1 -- 172.21.15.59:0/3000767129 shutdown_connections 2023-09-30T22:32:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.355+0000 7f5406f65700 1 --2- 172.21.15.59:0/3000767129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54001ccae0 0x7f54001ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.355+0000 7f5406f65700 1 --2- 172.21.15.59:0/3000767129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f0003f80 0x7f54001214e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.355+0000 7f5406f65700 1 --2- 172.21.15.59:0/3000767129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5400121a20 0x7f5400121e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:43.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.355+0000 7f5406f65700 1 -- 172.21.15.59:0/3000767129 >> 172.21.15.59:0/3000767129 conn(0x7f54000a2aa0 msgr2=0x7f540012a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:43.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.355+0000 7f5406f65700 1 -- 172.21.15.59:0/3000767129 shutdown_connections 2023-09-30T22:32:43.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:43.355+0000 7f5406f65700 1 -- 172.21.15.59:0/3000767129 wait complete. 2023-09-30T22:32:43.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:43.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:44.326 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:44.338 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:44.368 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:44.370 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:44.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.483+0000 7fe18cdcf700 1 Processor -- start 2023-09-30T22:32:44.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.483+0000 7fe18cdcf700 1 -- start start 2023-09-30T22:32:44.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.484+0000 7fe18cdcf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe188134630 0x7fe188136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.484+0000 7fe18cdcf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe188136f50 0x7fe188139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.484+0000 7fe18cdcf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18809b4f0 con 0x7fe188131810 2023-09-30T22:32:44.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.484+0000 7fe18cdcf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1881313c0 con 0x7fe188136f50 2023-09-30T22:32:44.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.484+0000 7fe18cdcf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe18806e8c0 con 0x7fe188134630 2023-09-30T22:32:44.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.484+0000 7fe185d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe188134630 0x7fe188136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.484+0000 7fe185d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe188134630 0x7fe188136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50706/0 (socket says 172.21.15.59:50706) 2023-09-30T22:32:44.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.484+0000 7fe185d9b700 1 -- 172.21.15.59:0/2927303498 learned_addr learned my addr 172.21.15.59:0/2927303498 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:44.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.484+0000 7fe186d9d700 1 --2- 172.21.15.59:0/2927303498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe188136f50 0x7fe188139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.484+0000 7fe185d9b700 1 -- 172.21.15.59:0/2927303498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe188136f50 msgr2=0x7fe188139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:44.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.484+0000 7fe185d9b700 1 --2- 172.21.15.59:0/2927303498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe188136f50 0x7fe188139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.484+0000 7fe185d9b700 1 -- 172.21.15.59:0/2927303498 >> v1:172.21.15.59:6789/0 conn(0x7fe188131810 legacy=0x7fe188131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.484+0000 7fe185d9b700 1 -- 172.21.15.59:0/2927303498 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe188071d20 con 0x7fe188134630 2023-09-30T22:32:44.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.485+0000 7fe185d9b700 1 --2- 172.21.15.59:0/2927303498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe188134630 0x7fe188136a10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009920 tx=0x7fe17c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf0bf6d578c7ff15 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:44.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.485+0000 7fe18559a700 1 -- 172.21.15.59:0/2927303498 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c011830 con 0x7fe188134630 2023-09-30T22:32:44.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.485+0000 7fe18559a700 1 -- 172.21.15.59:0/2927303498 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c011990 con 0x7fe188134630 2023-09-30T22:32:44.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.485+0000 7fe18559a700 1 -- 172.21.15.59:0/2927303498 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c011d20 con 0x7fe188134630 2023-09-30T22:32:44.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.486+0000 7fe18cdcf700 1 -- 172.21.15.59:0/2927303498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe188134630 msgr2=0x7fe188136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.486+0000 7fe18cdcf700 1 --2- 172.21.15.59:0/2927303498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe188134630 0x7fe188136a10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009920 tx=0x7fe17c009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:44.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.486+0000 7fe18cdcf700 1 -- 172.21.15.59:0/2927303498 shutdown_connections 2023-09-30T22:32:44.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.486+0000 7fe18cdcf700 1 --2- 172.21.15.59:0/2927303498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe188136f50 0x7fe188139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.486+0000 7fe18cdcf700 1 --2- 172.21.15.59:0/2927303498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe188134630 0x7fe188136a10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.486+0000 7fe18cdcf700 1 -- 172.21.15.59:0/2927303498 >> 172.21.15.59:0/2927303498 conn(0x7fe1880a2aa0 msgr2=0x7fe1880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:44.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.486+0000 7fe18cdcf700 1 -- 172.21.15.59:0/2927303498 shutdown_connections 2023-09-30T22:32:44.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.486+0000 7fe18cdcf700 1 -- 172.21.15.59:0/2927303498 wait complete. 2023-09-30T22:32:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.487+0000 7fe18cdcf700 1 Processor -- start 2023-09-30T22:32:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.488+0000 7fe18cdcf700 1 -- start start 2023-09-30T22:32:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.488+0000 7fe18cdcf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe188131810 0x7fe18806ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.488+0000 7fe18cdcf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe188134630 0x7fe1880704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.488+0000 7fe18cdcf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe188136f50 0x7fe1881c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.488+0000 7fe18cdcf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1880709f0 con 0x7fe188134630 2023-09-30T22:32:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.488+0000 7fe18cdcf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18806fb90 con 0x7fe188136f50 2023-09-30T22:32:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.488+0000 7fe18cdcf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe18812eb50 con 0x7fe188131810 2023-09-30T22:32:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.489+0000 7fe18659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe188131810 0x7fe18806ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.489+0000 7fe18659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe188131810 0x7fe18806ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50716/0 (socket says 172.21.15.59:50716) 2023-09-30T22:32:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.489+0000 7fe18659c700 1 -- 172.21.15.59:0/981999734 learned_addr learned my addr 172.21.15.59:0/981999734 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.489+0000 7fe185d9b700 1 --2- 172.21.15.59:0/981999734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe188134630 0x7fe1880704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.489+0000 7fe186d9d700 1 --2- 172.21.15.59:0/981999734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe188136f50 0x7fe1881c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.489+0000 7fe18659c700 1 -- 172.21.15.59:0/981999734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe188136f50 msgr2=0x7fe1881c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.489+0000 7fe18659c700 1 --2- 172.21.15.59:0/981999734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe188136f50 0x7fe1881c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.489+0000 7fe18659c700 1 -- 172.21.15.59:0/981999734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe188134630 msgr2=0x7fe1880704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.489+0000 7fe18659c700 1 --2- 172.21.15.59:0/981999734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe188134630 0x7fe1880704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.489+0000 7fe18659c700 1 -- 172.21.15.59:0/981999734 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c009550 con 0x7fe188131810 2023-09-30T22:32:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.489+0000 7fe18659c700 1 --2- 172.21.15.59:0/981999734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe188131810 0x7fe18806ff70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c4e0 tx=0x7fe17800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.489+0000 7fe176ffd700 1 -- 172.21.15.59:0/981999734 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780052d0 con 0x7fe188131810 2023-09-30T22:32:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.489+0000 7fe176ffd700 1 -- 172.21.15.59:0/981999734 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe178005430 con 0x7fe188131810 2023-09-30T22:32:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.489+0000 7fe176ffd700 1 -- 172.21.15.59:0/981999734 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780038a0 con 0x7fe188131810 2023-09-30T22:32:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.489+0000 7fe18cdcf700 1 -- 172.21.15.59:0/981999734 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18811e520 con 0x7fe188131810 2023-09-30T22:32:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.490+0000 7fe18cdcf700 1 -- 172.21.15.59:0/981999734 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18811f250 con 0x7fe188131810 2023-09-30T22:32:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.491+0000 7fe176ffd700 1 -- 172.21.15.59:0/981999734 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe178003a00 con 0x7fe188131810 2023-09-30T22:32:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.491+0000 7fe176ffd700 1 -- 172.21.15.59:0/981999734 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe17803ea60 con 0x7fe188131810 2023-09-30T22:32:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.491+0000 7fe18cdcf700 1 -- 172.21.15.59:0/981999734 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe188074ea0 con 0x7fe188131810 2023-09-30T22:32:44.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.500+0000 7fe176ffd700 1 -- 172.21.15.59:0/981999734 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe178017030 con 0x7fe188131810 2023-09-30T22:32:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.524+0000 7f88d3f68700 1 Processor -- start 2023-09-30T22:32:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.524+0000 7f88d3f68700 1 -- start start 2023-09-30T22:32:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.525+0000 7f88d3f68700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88cc09d6f0 0x7f88cc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.525+0000 7f88d3f68700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88cc09e410 0x7f88cc134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.525+0000 7f88d3f68700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88cc09b120 con 0x7f88cc09e000 2023-09-30T22:32:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.525+0000 7f88d3f68700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc06b460 con 0x7f88cc09d6f0 2023-09-30T22:32:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.525+0000 7f88d3f68700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc09a7e0 con 0x7f88cc09e410 2023-09-30T22:32:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.525+0000 7f88d1d04700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88cc09d6f0 0x7f88cc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.525+0000 7f88d2505700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88cc09e410 0x7f88cc134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.525+0000 7f88d1d04700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88cc09d6f0 0x7f88cc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48470/0 (socket says 172.21.15.59:48470) 2023-09-30T22:32:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.525+0000 7f88d1d04700 1 -- 172.21.15.59:0/3228334003 learned_addr learned my addr 172.21.15.59:0/3228334003 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.525+0000 7f88d1503700 1 --1- 172.21.15.59:0/3228334003 >> v1:172.21.15.59:6789/0 conn(0x7f88cc09e000 0x7f88cc1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57906/0 (socket says 172.21.15.59:57906) 2023-09-30T22:32:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.525+0000 7f88d1d04700 1 -- 172.21.15.59:0/3228334003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88cc09e410 msgr2=0x7f88cc134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.525+0000 7f88d1d04700 1 --2- 172.21.15.59:0/3228334003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88cc09e410 0x7f88cc134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.525+0000 7f88d1d04700 1 -- 172.21.15.59:0/3228334003 >> v1:172.21.15.59:6789/0 conn(0x7f88cc09e000 legacy=0x7f88cc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.525+0000 7f88d1d04700 1 -- 172.21.15.59:0/3228334003 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc09a500 con 0x7f88cc09d6f0 2023-09-30T22:32:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.526+0000 7f88d1d04700 1 --2- 172.21.15.59:0/3228334003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88cc09d6f0 0x7f88cc09dac0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009920 tx=0x7f88c8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1f6cd649c747fe0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.526+0000 7f88d0d02700 1 -- 172.21.15.59:0/3228334003 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c8011830 con 0x7f88cc09d6f0 2023-09-30T22:32:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.526+0000 7f88d0d02700 1 -- 172.21.15.59:0/3228334003 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c8011990 con 0x7f88cc09d6f0 2023-09-30T22:32:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.526+0000 7f88d0d02700 1 -- 172.21.15.59:0/3228334003 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c8011d20 con 0x7f88cc09d6f0 2023-09-30T22:32:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.526+0000 7f3a95fb8700 1 Processor -- start 2023-09-30T22:32:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.526+0000 7f3a95fb8700 1 -- start start 2023-09-30T22:32:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f88d3f68700 1 -- 172.21.15.59:0/3228334003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88cc09d6f0 msgr2=0x7f88cc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f88d3f68700 1 --2- 172.21.15.59:0/3228334003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88cc09d6f0 0x7f88cc09dac0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009920 tx=0x7f88c8009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:44.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f3a95fb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009d630 0x7f3a900a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f3a95fb8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a90138d80 0x7f3a9013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f3a95fb8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a900a2a70 con 0x7f3a900a0a30 2023-09-30T22:32:44.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f3a95fb8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a900a01d0 con 0x7f3a90138d80 2023-09-30T22:32:44.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f3a95fb8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9009e2b0 con 0x7f3a9009d630 2023-09-30T22:32:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f88d3f68700 1 -- 172.21.15.59:0/3228334003 shutdown_connections 2023-09-30T22:32:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f88d3f68700 1 --2- 172.21.15.59:0/3228334003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88cc09e410 0x7f88cc134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f88d3f68700 1 --2- 172.21.15.59:0/3228334003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88cc09d6f0 0x7f88cc09dac0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f88d3f68700 1 -- 172.21.15.59:0/3228334003 >> 172.21.15.59:0/3228334003 conn(0x7f88cc066f50 msgr2=0x7f88cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f3a8ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a90138d80 0x7f3a9013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f3a8effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009d630 0x7f3a900a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f3a8ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a90138d80 0x7f3a9013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48482/0 (socket says 172.21.15.59:48482) 2023-09-30T22:32:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f3a8effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009d630 0x7f3a900a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50734/0 (socket says 172.21.15.59:50734) 2023-09-30T22:32:44.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f3a8ffff700 1 -- 172.21.15.59:0/4272356177 learned_addr learned my addr 172.21.15.59:0/4272356177 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:44.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f88d3f68700 1 -- 172.21.15.59:0/3228334003 shutdown_connections 2023-09-30T22:32:44.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.528+0000 7f3a8effd700 1 -- 172.21.15.59:0/4272356177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a90138d80 msgr2=0x7f3a9013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:44.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.528+0000 7f3a8effd700 1 --2- 172.21.15.59:0/4272356177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a90138d80 0x7f3a9013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.528+0000 7f3a8effd700 1 -- 172.21.15.59:0/4272356177 >> v1:172.21.15.59:6789/0 conn(0x7f3a900a0a30 legacy=0x7f3a900a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:44.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.528+0000 7f3a8effd700 1 -- 172.21.15.59:0/4272356177 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9009dc50 con 0x7f3a9009d630 2023-09-30T22:32:44.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.528+0000 7f3a8effd700 1 --2- 172.21.15.59:0/4272356177 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009d630 0x7f3a900a1510 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009870 tx=0x7f3a84009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=541262d6b5e5f3fc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:44.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.528+0000 7f3a8e7fc700 1 -- 172.21.15.59:0/4272356177 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84004230 con 0x7f3a9009d630 2023-09-30T22:32:44.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.528+0000 7f3a8e7fc700 1 -- 172.21.15.59:0/4272356177 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a84004390 con 0x7f3a9009d630 2023-09-30T22:32:44.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.528+0000 7f3a8e7fc700 1 -- 172.21.15.59:0/4272356177 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a840036a0 con 0x7f3a9009d630 2023-09-30T22:32:44.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.527+0000 7f88d3f68700 1 -- 172.21.15.59:0/3228334003 wait complete. 2023-09-30T22:32:44.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.529+0000 7f88d3f68700 1 Processor -- start 2023-09-30T22:32:44.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.529+0000 7f88d3f68700 1 -- start start 2023-09-30T22:32:44.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.529+0000 7f3a95fb8700 1 -- 172.21.15.59:0/4272356177 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009d630 msgr2=0x7f3a900a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.529+0000 7f3a95fb8700 1 --2- 172.21.15.59:0/4272356177 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009d630 0x7f3a900a1510 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009870 tx=0x7f3a84009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:44.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.529+0000 7f3a95fb8700 1 -- 172.21.15.59:0/4272356177 shutdown_connections 2023-09-30T22:32:44.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.529+0000 7f3a95fb8700 1 --2- 172.21.15.59:0/4272356177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a90138d80 0x7f3a9013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.529+0000 7f3a95fb8700 1 --2- 172.21.15.59:0/4272356177 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a9009d630 0x7f3a900a1510 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.529+0000 7f3a95fb8700 1 -- 172.21.15.59:0/4272356177 >> 172.21.15.59:0/4272356177 conn(0x7f3a900a3050 msgr2=0x7f3a900a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:44.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.529+0000 7f3a95fb8700 1 -- 172.21.15.59:0/4272356177 shutdown_connections 2023-09-30T22:32:44.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.529+0000 7f3a95fb8700 1 -- 172.21.15.59:0/4272356177 wait complete. 2023-09-30T22:32:44.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.530+0000 7f88d3f68700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88cc09d6f0 0x7f88cc12d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.530+0000 7f88d3f68700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88cc09e000 0x7f88cc12d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.530+0000 7f88d3f68700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88cc09e410 0x7f88cc1d4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.530+0000 7f88d3f68700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc12fd00 con 0x7f88cc09e410 2023-09-30T22:32:44.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.530+0000 7f88d3f68700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc0a1e20 con 0x7f88cc09e000 2023-09-30T22:32:44.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.530+0000 7f88d3f68700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc12cd30 con 0x7f88cc09d6f0 2023-09-30T22:32:44.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.530+0000 7f88d2505700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88cc09e410 0x7f88cc1d4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.530+0000 7f88d2505700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88cc09e410 0x7f88cc1d4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41428/0 (socket says 172.21.15.59:41428) 2023-09-30T22:32:44.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.530+0000 7f88d2505700 1 -- 172.21.15.59:0/2530461215 learned_addr learned my addr 172.21.15.59:0/2530461215 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:44.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.530+0000 7f88d2505700 1 -- 172.21.15.59:0/2530461215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88cc09d6f0 msgr2=0x7f88cc12d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.530+0000 7f88d2505700 1 --2- 172.21.15.59:0/2530461215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88cc09d6f0 0x7f88cc12d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.530+0000 7f88d2505700 1 -- 172.21.15.59:0/2530461215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88cc09e000 msgr2=0x7f88cc12d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.530+0000 7f88d2505700 1 --2- 172.21.15.59:0/2530461215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88cc09e000 0x7f88cc12d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.530+0000 7f88d2505700 1 -- 172.21.15.59:0/2530461215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c8009550 con 0x7f88cc09e410 2023-09-30T22:32:44.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.531+0000 7f88d2505700 1 --2- 172.21.15.59:0/2530461215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88cc09e410 0x7f88cc1d4ef0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f88c400efc0 tx=0x7f88c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:44.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.531+0000 7f88c27fc700 1 -- 172.21.15.59:0/2530461215 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c400cd40 con 0x7f88cc09e410 2023-09-30T22:32:44.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.531+0000 7f88c27fc700 1 -- 172.21.15.59:0/2530461215 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c400f040 con 0x7f88cc09e410 2023-09-30T22:32:44.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.531+0000 7f88d3f68700 1 -- 172.21.15.59:0/2530461215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88cc12eb60 con 0x7f88cc09e410 2023-09-30T22:32:44.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.531+0000 7f88c27fc700 1 -- 172.21.15.59:0/2530461215 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c40146c0 con 0x7f88cc09e410 2023-09-30T22:32:44.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.531+0000 7f88d3f68700 1 -- 172.21.15.59:0/2530461215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88cc12ef70 con 0x7f88cc09e410 2023-09-30T22:32:44.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.531+0000 7f3a95fb8700 1 Processor -- start 2023-09-30T22:32:44.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.532+0000 7f88c27fc700 1 -- 172.21.15.59:0/2530461215 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88c4014820 con 0x7f88cc09e410 2023-09-30T22:32:44.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.532+0000 7f88c27fc700 1 -- 172.21.15.59:0/2530461215 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f88c40402b0 con 0x7f88cc09e410 2023-09-30T22:32:44.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.531+0000 7f3a95fb8700 1 -- start start 2023-09-30T22:32:44.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.532+0000 7f3a95fb8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9009d630 0x7f3a90138080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.532+0000 7f3a95fb8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a900a0a30 0x7f3a901385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.532+0000 7f3a95fb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a90138d80 0x7f3a9006dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.532+0000 7f3a95fb8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a90071270 con 0x7f3a900a0a30 2023-09-30T22:32:44.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.532+0000 7f3a95fb8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9006ef20 con 0x7f3a9009d630 2023-09-30T22:32:44.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.532+0000 7f3a8effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a900a0a30 0x7f3a901385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.532+0000 7f3a8effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a900a0a30 0x7f3a901385c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41440/0 (socket says 172.21.15.59:41440) 2023-09-30T22:32:44.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.532+0000 7f3a8effd700 1 -- 172.21.15.59:0/1260060827 learned_addr learned my addr 172.21.15.59:0/1260060827 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:44.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.532+0000 7f3a8f7fe700 1 --2- 172.21.15.59:0/1260060827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9009d630 0x7f3a90138080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.532+0000 7f88d3f68700 1 -- 172.21.15.59:0/2530461215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88cc074ea0 con 0x7f88cc09e410 2023-09-30T22:32:44.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.533+0000 7f3a8ffff700 1 --2- 172.21.15.59:0/1260060827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a90138d80 0x7f3a9006dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.533+0000 7f3a95fb8700 1 -- 172.21.15.59:0/1260060827 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a900a0410 con 0x7f3a90138d80 2023-09-30T22:32:44.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.533+0000 7f3a8f7fe700 1 -- 172.21.15.59:0/1260060827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a90138d80 msgr2=0x7f3a9006dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.533+0000 7f3a8f7fe700 1 --2- 172.21.15.59:0/1260060827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a90138d80 0x7f3a9006dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.533+0000 7f3a8f7fe700 1 -- 172.21.15.59:0/1260060827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a900a0a30 msgr2=0x7f3a901385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.533+0000 7f3a8f7fe700 1 --2- 172.21.15.59:0/1260060827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a900a0a30 0x7f3a901385c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.533+0000 7f3a8f7fe700 1 -- 172.21.15.59:0/1260060827 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a840094a0 con 0x7f3a9009d630 2023-09-30T22:32:44.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.533+0000 7f3a8f7fe700 1 --2- 172.21.15.59:0/1260060827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9009d630 0x7f3a90138080 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000c3e0 tx=0x7f3a8000c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:44.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.537+0000 7f3a77fff700 1 -- 172.21.15.59:0/1260060827 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a800052d0 con 0x7f3a9009d630 2023-09-30T22:32:44.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.537+0000 7f3a77fff700 1 -- 172.21.15.59:0/1260060827 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a80005450 con 0x7f3a9009d630 2023-09-30T22:32:44.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.537+0000 7f3a77fff700 1 -- 172.21.15.59:0/1260060827 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a800038c0 con 0x7f3a9009d630 2023-09-30T22:32:44.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.537+0000 7f3a95fb8700 1 -- 172.21.15.59:0/1260060827 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a90138b00 con 0x7f3a9009d630 2023-09-30T22:32:44.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.537+0000 7f3a95fb8700 1 -- 172.21.15.59:0/1260060827 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9006fbc0 con 0x7f3a9009d630 2023-09-30T22:32:44.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.538+0000 7f3a77fff700 1 -- 172.21.15.59:0/1260060827 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a80003a20 con 0x7f3a9009d630 2023-09-30T22:32:44.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.538+0000 7f3a95fb8700 1 -- 172.21.15.59:0/1260060827 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a900747f0 con 0x7f3a9009d630 2023-09-30T22:32:44.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.538+0000 7f3a77fff700 1 -- 172.21.15.59:0/1260060827 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3a80040a10 con 0x7f3a9009d630 2023-09-30T22:32:44.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.539+0000 7fedb2be2700 1 Processor -- start 2023-09-30T22:32:44.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.539+0000 7fedb2be2700 1 -- start start 2023-09-30T22:32:44.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.540+0000 7fedb2be2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedac1316c0 0x7fedac131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.540+0000 7fedb2be2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedac09d9f0 0x7fedac06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.540+0000 7fedb2be2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac09e130 con 0x7fedac06acb0 2023-09-30T22:32:44.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.540+0000 7fedb2be2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac1312b0 con 0x7fedac09d9f0 2023-09-30T22:32:44.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.540+0000 7fedb2be2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedac09f6e0 con 0x7fedac1316c0 2023-09-30T22:32:44.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.540+0000 7fedb097e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedac1316c0 0x7fedac131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.540+0000 7fedb097e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedac1316c0 0x7fedac131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50768/0 (socket says 172.21.15.59:50768) 2023-09-30T22:32:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.540+0000 7fedb097e700 1 -- 172.21.15.59:0/1012525216 learned_addr learned my addr 172.21.15.59:0/1012525216 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.540+0000 7fedabfff700 1 --2- 172.21.15.59:0/1012525216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedac09d9f0 0x7fedac06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.540+0000 7fedabfff700 1 -- 172.21.15.59:0/1012525216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedac1316c0 msgr2=0x7fedac131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.540+0000 7fedabfff700 1 --2- 172.21.15.59:0/1012525216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedac1316c0 0x7fedac131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.540+0000 7fedabfff700 1 -- 172.21.15.59:0/1012525216 >> v1:172.21.15.59:6789/0 conn(0x7fedac06acb0 legacy=0x7fedac138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.540+0000 7fedabfff700 1 -- 172.21.15.59:0/1012525216 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac09e760 con 0x7fedac09d9f0 2023-09-30T22:32:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.540+0000 7fedb097e700 1 --2- 172.21.15.59:0/1012525216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedac1316c0 0x7fedac131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.541+0000 7f88c27fc700 1 -- 172.21.15.59:0/2530461215 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88c4018020 con 0x7f88cc09e410 2023-09-30T22:32:44.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.541+0000 7fedabfff700 1 --2- 172.21.15.59:0/1012525216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedac09d9f0 0x7fedac06a770 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feda0009870 tx=0x7feda0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a4eaac7bc22c6fc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:44.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.548+0000 7fedab7fe700 1 -- 172.21.15.59:0/1012525216 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0004230 con 0x7fedac09d9f0 2023-09-30T22:32:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.548+0000 7fedab7fe700 1 -- 172.21.15.59:0/1012525216 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda0004390 con 0x7fedac09d9f0 2023-09-30T22:32:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.548+0000 7fedab7fe700 1 -- 172.21.15.59:0/1012525216 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda00036a0 con 0x7fedac09d9f0 2023-09-30T22:32:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.548+0000 7f3a77fff700 1 -- 172.21.15.59:0/1260060827 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a80044060 con 0x7f3a9009d630 2023-09-30T22:32:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.549+0000 7fedb2be2700 1 -- 172.21.15.59:0/1012525216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedac09d9f0 msgr2=0x7fedac06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.549+0000 7fedb2be2700 1 --2- 172.21.15.59:0/1012525216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedac09d9f0 0x7fedac06a770 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feda0009870 tx=0x7feda0009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.549+0000 7fedb2be2700 1 -- 172.21.15.59:0/1012525216 shutdown_connections 2023-09-30T22:32:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.549+0000 7fedb2be2700 1 --2- 172.21.15.59:0/1012525216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedac1316c0 0x7fedac131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.549+0000 7fedb2be2700 1 --2- 172.21.15.59:0/1012525216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedac09d9f0 0x7fedac06a770 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.549+0000 7fedb2be2700 1 -- 172.21.15.59:0/1012525216 >> 172.21.15.59:0/1012525216 conn(0x7fedac066f50 msgr2=0x7fedac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.550+0000 7fedb2be2700 1 -- 172.21.15.59:0/1012525216 shutdown_connections 2023-09-30T22:32:44.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.550+0000 7fedb2be2700 1 -- 172.21.15.59:0/1012525216 wait complete. 2023-09-30T22:32:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.551+0000 7fedb2be2700 1 Processor -- start 2023-09-30T22:32:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.551+0000 7fedb2be2700 1 -- start start 2023-09-30T22:32:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.552+0000 7fedb2be2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedac06acb0 0x7fedac11a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.552+0000 7fedb2be2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedac09d9f0 0x7fedac11a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.552+0000 7fedb2be2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedac1316c0 0x7fedac11ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.552+0000 7fedb2be2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac11d9a0 con 0x7fedac1316c0 2023-09-30T22:32:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.552+0000 7fedb2be2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0a3740 con 0x7fedac09d9f0 2023-09-30T22:32:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.552+0000 7fedb2be2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedac12b900 con 0x7fedac06acb0 2023-09-30T22:32:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.552+0000 7fedb097e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedac06acb0 0x7fedac11a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.552+0000 7fedb097e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedac06acb0 0x7fedac11a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50776/0 (socket says 172.21.15.59:50776) 2023-09-30T22:32:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.552+0000 7fedb097e700 1 -- 172.21.15.59:0/3291327242 learned_addr learned my addr 172.21.15.59:0/3291327242 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.552+0000 7fedb117f700 1 --2- 172.21.15.59:0/3291327242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedac1316c0 0x7fedac11ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.552+0000 7fedabfff700 1 --2- 172.21.15.59:0/3291327242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedac09d9f0 0x7fedac11a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:44.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.553+0000 7fedb097e700 1 -- 172.21.15.59:0/3291327242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedac09d9f0 msgr2=0x7fedac11a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.553+0000 7fedb097e700 1 --2- 172.21.15.59:0/3291327242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedac09d9f0 0x7fedac11a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.553+0000 7fedb097e700 1 -- 172.21.15.59:0/3291327242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedac1316c0 msgr2=0x7fedac11ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.553+0000 7fedb097e700 1 --2- 172.21.15.59:0/3291327242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedac1316c0 0x7fedac11ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.553+0000 7fedb097e700 1 -- 172.21.15.59:0/3291327242 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c009550 con 0x7fedac06acb0 2023-09-30T22:32:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.553+0000 7fedb097e700 1 --2- 172.21.15.59:0/3291327242 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedac06acb0 0x7fedac11a390 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00ebe0 tx=0x7fed9c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.553+0000 7feda97fa700 1 -- 172.21.15.59:0/3291327242 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c00c850 con 0x7fedac06acb0 2023-09-30T22:32:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.553+0000 7feda97fa700 1 -- 172.21.15.59:0/3291327242 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c00c9b0 con 0x7fedac06acb0 2023-09-30T22:32:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.553+0000 7fedb2be2700 1 -- 172.21.15.59:0/3291327242 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda00094a0 con 0x7fedac06acb0 2023-09-30T22:32:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.553+0000 7feda97fa700 1 -- 172.21.15.59:0/3291327242 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c00cd40 con 0x7fedac06acb0 2023-09-30T22:32:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.554+0000 7fedb2be2700 1 -- 172.21.15.59:0/3291327242 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac11deb0 con 0x7fedac06acb0 2023-09-30T22:32:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.555+0000 7fedb2be2700 1 -- 172.21.15.59:0/3291327242 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac11dcf0 con 0x7fedac06acb0 2023-09-30T22:32:44.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.556+0000 7feda97fa700 1 -- 172.21.15.59:0/3291327242 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed9c013470 con 0x7fedac06acb0 2023-09-30T22:32:44.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.556+0000 7feda97fa700 1 -- 172.21.15.59:0/3291327242 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fed9c03f8b0 con 0x7fedac06acb0 2023-09-30T22:32:44.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.561+0000 7feda97fa700 1 -- 172.21.15.59:0/3291327242 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed9c0232f0 con 0x7fedac06acb0 2023-09-30T22:32:44.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.730+0000 7fe18cdcf700 1 -- 172.21.15.59:0/981999734 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe18806b9e0 con 0x7fe188131810 2023-09-30T22:32:44.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.730+0000 7fe176ffd700 1 -- 172.21.15.59:0/981999734 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe178019e60 con 0x7fe188131810 2023-09-30T22:32:44.731 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:44.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.734+0000 7fe18cdcf700 1 -- 172.21.15.59:0/981999734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe188131810 msgr2=0x7fe18806ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.734+0000 7fe18cdcf700 1 --2- 172.21.15.59:0/981999734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe188131810 0x7fe18806ff70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c4e0 tx=0x7fe17800c7f0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.734+0000 7fe18cdcf700 1 -- 172.21.15.59:0/981999734 shutdown_connections 2023-09-30T22:32:44.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.734+0000 7fe18cdcf700 1 --2- 172.21.15.59:0/981999734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe188131810 0x7fe18806ff70 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.734+0000 7fe18cdcf700 1 --2- 172.21.15.59:0/981999734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe188136f50 0x7fe1881c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.734+0000 7fe18cdcf700 1 --2- 172.21.15.59:0/981999734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe188134630 0x7fe1880704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.734+0000 7fe18cdcf700 1 -- 172.21.15.59:0/981999734 >> 172.21.15.59:0/981999734 conn(0x7fe1880a2aa0 msgr2=0x7fe1881332c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:44.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.734+0000 7fe18cdcf700 1 -- 172.21.15.59:0/981999734 shutdown_connections 2023-09-30T22:32:44.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.734+0000 7fe18cdcf700 1 -- 172.21.15.59:0/981999734 wait complete. 2023-09-30T22:32:44.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.751+0000 7f88d3f68700 1 -- 172.21.15.59:0/2530461215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f88cc06c360 con 0x7f88cc09e410 2023-09-30T22:32:44.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.752+0000 7f88c27fc700 1 -- 172.21.15.59:0/2530461215 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88c402b090 con 0x7f88cc09e410 2023-09-30T22:32:44.753 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:44.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:44.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.755+0000 7f88d3f68700 1 -- 172.21.15.59:0/2530461215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88cc09e410 msgr2=0x7f88cc1d4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.755+0000 7f88d3f68700 1 --2- 172.21.15.59:0/2530461215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88cc09e410 0x7f88cc1d4ef0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f88c400efc0 tx=0x7f88c400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.755+0000 7f88d3f68700 1 -- 172.21.15.59:0/2530461215 shutdown_connections 2023-09-30T22:32:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.755+0000 7f88d3f68700 1 --2- 172.21.15.59:0/2530461215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88cc09d6f0 0x7f88cc12d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.755+0000 7f88d3f68700 1 --2- 172.21.15.59:0/2530461215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88cc09e410 0x7f88cc1d4ef0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.755+0000 7f88d3f68700 1 --2- 172.21.15.59:0/2530461215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88cc09e000 0x7f88cc12d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.755+0000 7f88d3f68700 1 -- 172.21.15.59:0/2530461215 >> 172.21.15.59:0/2530461215 conn(0x7f88cc066f50 msgr2=0x7f88cc06f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.755+0000 7f88d3f68700 1 -- 172.21.15.59:0/2530461215 shutdown_connections 2023-09-30T22:32:44.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.755+0000 7f88d3f68700 1 -- 172.21.15.59:0/2530461215 wait complete. 2023-09-30T22:32:44.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.759+0000 7f3a95fb8700 1 -- 172.21.15.59:0/1260060827 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3a9013af30 con 0x7f3a9009d630 2023-09-30T22:32:44.760 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:44.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.759+0000 7f3a77fff700 1 -- 172.21.15.59:0/1260060827 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a80017020 con 0x7f3a9009d630 2023-09-30T22:32:44.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.761+0000 7f3a95fb8700 1 -- 172.21.15.59:0/1260060827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9009d630 msgr2=0x7f3a90138080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.761+0000 7f3a95fb8700 1 --2- 172.21.15.59:0/1260060827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9009d630 0x7f3a90138080 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000c3e0 tx=0x7f3a8000c6f0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.761+0000 7f3a95fb8700 1 -- 172.21.15.59:0/1260060827 shutdown_connections 2023-09-30T22:32:44.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.761+0000 7f3a95fb8700 1 --2- 172.21.15.59:0/1260060827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a90138d80 0x7f3a9006dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.761+0000 7f3a95fb8700 1 --2- 172.21.15.59:0/1260060827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9009d630 0x7f3a90138080 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.761+0000 7f3a95fb8700 1 --2- 172.21.15.59:0/1260060827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a900a0a30 0x7f3a901385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.761+0000 7f3a95fb8700 1 -- 172.21.15.59:0/1260060827 >> 172.21.15.59:0/1260060827 conn(0x7f3a900a3050 msgr2=0x7f3a9009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:44.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.761+0000 7f3a95fb8700 1 -- 172.21.15.59:0/1260060827 shutdown_connections 2023-09-30T22:32:44.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.761+0000 7f3a95fb8700 1 -- 172.21.15.59:0/1260060827 wait complete. 2023-09-30T22:32:44.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:44.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:44.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.778+0000 7fedb2be2700 1 -- 172.21.15.59:0/3291327242 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fedac074ea0 con 0x7fedac06acb0 2023-09-30T22:32:44.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.778+0000 7feda97fa700 1 -- 172.21.15.59:0/3291327242 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed9c021020 con 0x7fedac06acb0 2023-09-30T22:32:44.780 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:44.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.781+0000 7fedb2be2700 1 -- 172.21.15.59:0/3291327242 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedac06acb0 msgr2=0x7fedac11a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:44.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.781+0000 7fedb2be2700 1 --2- 172.21.15.59:0/3291327242 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedac06acb0 0x7fedac11a390 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00ebe0 tx=0x7fed9c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.781+0000 7fedb2be2700 1 -- 172.21.15.59:0/3291327242 shutdown_connections 2023-09-30T22:32:44.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.781+0000 7fedb2be2700 1 --2- 172.21.15.59:0/3291327242 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedac06acb0 0x7fedac11a390 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.781+0000 7fedb2be2700 1 --2- 172.21.15.59:0/3291327242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedac1316c0 0x7fedac11ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.781+0000 7fedb2be2700 1 --2- 172.21.15.59:0/3291327242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedac09d9f0 0x7fedac11a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:44.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.781+0000 7fedb2be2700 1 -- 172.21.15.59:0/3291327242 >> 172.21.15.59:0/3291327242 conn(0x7fedac066f50 msgr2=0x7fedac0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:44.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.781+0000 7fedb2be2700 1 -- 172.21.15.59:0/3291327242 shutdown_connections 2023-09-30T22:32:44.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:44.781+0000 7fedb2be2700 1 -- 172.21.15.59:0/3291327242 wait complete. 2023-09-30T22:32:44.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:45.755 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:45.772 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:45.778 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:45.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.912+0000 7f8a79624700 1 Processor -- start 2023-09-30T22:32:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.912+0000 7f8a79624700 1 -- start start 2023-09-30T22:32:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a79624700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a741338c0 0x7f8a74133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a79624700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a741341d0 0x7f8a7409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a79624700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8a7409e390 0x7f8a7409e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a79624700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a74070c80 con 0x7f8a7409e390 2023-09-30T22:32:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a79624700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7406f720 con 0x7f8a741341d0 2023-09-30T22:32:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a79624700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7406fce0 con 0x7f8a741338c0 2023-09-30T22:32:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a72ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a741338c0 0x7f8a74133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a72ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a741338c0 0x7f8a74133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50784/0 (socket says 172.21.15.59:50784) 2023-09-30T22:32:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a72ffd700 1 -- 172.21.15.59:0/982815795 learned_addr learned my addr 172.21.15.59:0/982815795 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a727fc700 1 --2- 172.21.15.59:0/982815795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a741341d0 0x7f8a7409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a737fe700 1 --2- 172.21.15.59:0/982815795 >> v2:172.21.15.59:3300/0 conn(0x7f8a7409e390 0x7f8a7409e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a727fc700 1 -- 172.21.15.59:0/982815795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a741338c0 msgr2=0x7f8a74133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a727fc700 1 --2- 172.21.15.59:0/982815795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a741338c0 0x7f8a74133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a727fc700 1 -- 172.21.15.59:0/982815795 >> v2:172.21.15.59:3300/0 conn(0x7f8a7409e390 msgr2=0x7f8a7409e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a727fc700 1 --2- 172.21.15.59:0/982815795 >> v2:172.21.15.59:3300/0 conn(0x7f8a7409e390 0x7f8a7409e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.913+0000 7f8a727fc700 1 -- 172.21.15.59:0/982815795 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a741336a0 con 0x7f8a741341d0 2023-09-30T22:32:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.914+0000 7f8a727fc700 1 --2- 172.21.15.59:0/982815795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a741341d0 0x7f8a7409de50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009840 tx=0x7f8a68009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1338035b37e92051 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:45.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.915+0000 7f8a71ffb700 1 -- 172.21.15.59:0/982815795 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68011830 con 0x7f8a741341d0 2023-09-30T22:32:45.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.915+0000 7f8a71ffb700 1 -- 172.21.15.59:0/982815795 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a68011990 con 0x7f8a741341d0 2023-09-30T22:32:45.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.915+0000 7f8a71ffb700 1 -- 172.21.15.59:0/982815795 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68011d20 con 0x7f8a741341d0 2023-09-30T22:32:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.915+0000 7f8a79624700 1 -- 172.21.15.59:0/982815795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a741341d0 msgr2=0x7f8a7409de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.915+0000 7f8a79624700 1 --2- 172.21.15.59:0/982815795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a741341d0 0x7f8a7409de50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009840 tx=0x7f8a68009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.916+0000 7f8a79624700 1 -- 172.21.15.59:0/982815795 shutdown_connections 2023-09-30T22:32:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.916+0000 7f8a79624700 1 --2- 172.21.15.59:0/982815795 >> v2:172.21.15.59:3300/0 conn(0x7f8a7409e390 0x7f8a7409e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.916+0000 7f8a79624700 1 --2- 172.21.15.59:0/982815795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a741338c0 0x7f8a74133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.916+0000 7f8a79624700 1 --2- 172.21.15.59:0/982815795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a741341d0 0x7f8a7409de50 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.916+0000 7f8a79624700 1 -- 172.21.15.59:0/982815795 >> 172.21.15.59:0/982815795 conn(0x7f8a740a2aa0 msgr2=0x7f8a740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.916+0000 7f8a79624700 1 -- 172.21.15.59:0/982815795 shutdown_connections 2023-09-30T22:32:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.916+0000 7f8a79624700 1 -- 172.21.15.59:0/982815795 wait complete. 2023-09-30T22:32:45.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.917+0000 7f8a79624700 1 Processor -- start 2023-09-30T22:32:45.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.917+0000 7f8a79624700 1 -- start start 2023-09-30T22:32:45.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.917+0000 7f8a79624700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a7409e390 0x7f8a7411e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.917+0000 7f8a79624700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a741338c0 0x7f8a7411ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.917+0000 7f8a79624700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a741341d0 0x7f8a7411f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.917+0000 7f8a79624700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a741221c0 con 0x7f8a7409e390 2023-09-30T22:32:45.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.917+0000 7f8a79624700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a741212b0 con 0x7f8a741338c0 2023-09-30T22:32:45.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.917+0000 7f8a79624700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7412fd30 con 0x7f8a741341d0 2023-09-30T22:32:45.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.918+0000 7f8a727fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a741338c0 0x7f8a7411ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.918+0000 7f8a727fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a741338c0 0x7f8a7411ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48522/0 (socket says 172.21.15.59:48522) 2023-09-30T22:32:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.918+0000 7f8a727fc700 1 -- 172.21.15.59:0/1323866850 learned_addr learned my addr 172.21.15.59:0/1323866850 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.918+0000 7f8a737fe700 1 --2- 172.21.15.59:0/1323866850 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a741341d0 0x7f8a7411f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.918+0000 7f8a72ffd700 1 --2- 172.21.15.59:0/1323866850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a7409e390 0x7f8a7411e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.918+0000 7f8a727fc700 1 -- 172.21.15.59:0/1323866850 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a741341d0 msgr2=0x7f8a7411f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.918+0000 7f8a727fc700 1 --2- 172.21.15.59:0/1323866850 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a741341d0 0x7f8a7411f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.918+0000 7f8a727fc700 1 -- 172.21.15.59:0/1323866850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a7409e390 msgr2=0x7f8a7411e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.918+0000 7f8a727fc700 1 --2- 172.21.15.59:0/1323866850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a7409e390 0x7f8a7411e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.918+0000 7f8a727fc700 1 -- 172.21.15.59:0/1323866850 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a680094a0 con 0x7f8a741338c0 2023-09-30T22:32:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.918+0000 7f8a72ffd700 1 --2- 172.21.15.59:0/1323866850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a7409e390 0x7f8a7411e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.919+0000 7f8a727fc700 1 --2- 172.21.15.59:0/1323866850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a741338c0 0x7f8a7411ee80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8a680090b0 tx=0x7f8a68004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:45.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.919+0000 7f8a5b7fe700 1 -- 172.21.15.59:0/1323866850 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68004450 con 0x7f8a741338c0 2023-09-30T22:32:45.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.919+0000 7f8a5b7fe700 1 -- 172.21.15.59:0/1323866850 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a680045b0 con 0x7f8a741338c0 2023-09-30T22:32:45.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.919+0000 7f8a79624700 1 -- 172.21.15.59:0/1323866850 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a74130e50 con 0x7f8a741338c0 2023-09-30T22:32:45.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.919+0000 7f8a5b7fe700 1 -- 172.21.15.59:0/1323866850 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a680038e0 con 0x7f8a741338c0 2023-09-30T22:32:45.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.920+0000 7f8a79624700 1 -- 172.21.15.59:0/1323866850 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a741228c0 con 0x7f8a741338c0 2023-09-30T22:32:45.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.921+0000 7f8a5b7fe700 1 -- 172.21.15.59:0/1323866850 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a68003a40 con 0x7f8a741338c0 2023-09-30T22:32:45.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.921+0000 7f8a5b7fe700 1 -- 172.21.15.59:0/1323866850 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8a68040820 con 0x7f8a741338c0 2023-09-30T22:32:45.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.921+0000 7f8a79624700 1 -- 172.21.15.59:0/1323866850 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a74122000 con 0x7f8a741338c0 2023-09-30T22:32:45.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.926+0000 7f8a5b7fe700 1 -- 172.21.15.59:0/1323866850 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a6802e970 con 0x7f8a741338c0 2023-09-30T22:32:45.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.950+0000 7fcd1c034700 1 Processor -- start 2023-09-30T22:32:45.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.951+0000 7fcd1c034700 1 -- start start 2023-09-30T22:32:45.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.951+0000 7fcd1c034700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd1409d6f0 0x7fcd1409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.951+0000 7fcd1c034700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd1409e410 0x7fcd14130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.951+0000 7fcd1c034700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1409f130 con 0x7fcd1409e000 2023-09-30T22:32:45.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.951+0000 7fcd1c034700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1409f520 con 0x7fcd1409e410 2023-09-30T22:32:45.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.951+0000 7fcd1c034700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1409e930 con 0x7fcd1409d6f0 2023-09-30T22:32:45.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.951+0000 7fcd1a5d1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd1409e410 0x7fcd14130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.952+0000 7fcd1a5d1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd1409e410 0x7fcd14130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41460/0 (socket says 172.21.15.59:41460) 2023-09-30T22:32:45.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.952+0000 7fcd1a5d1700 1 -- 172.21.15.59:0/659631864 learned_addr learned my addr 172.21.15.59:0/659631864 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:45.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.952+0000 7fcd19dd0700 1 --2- 172.21.15.59:0/659631864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd1409d6f0 0x7fcd1409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.952+0000 7fcd1a5d1700 1 -- 172.21.15.59:0/659631864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd1409d6f0 msgr2=0x7fcd1409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:45.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.952+0000 7fcd1a5d1700 1 --2- 172.21.15.59:0/659631864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd1409d6f0 0x7fcd1409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.952+0000 7fcd1a5d1700 1 -- 172.21.15.59:0/659631864 >> v1:172.21.15.59:6789/0 conn(0x7fcd1409e000 legacy=0x7fcd14130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:45.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.952+0000 7fcd1a5d1700 1 -- 172.21.15.59:0/659631864 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1409b2d0 con 0x7fcd1409e410 2023-09-30T22:32:45.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.952+0000 7fcd1a5d1700 1 --2- 172.21.15.59:0/659631864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd1409e410 0x7fcd14130d70 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00d150 tx=0x7fcd0c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a09743afd5f804 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:45.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.952+0000 7fcd18dce700 1 -- 172.21.15.59:0/659631864 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c010070 con 0x7fcd1409e410 2023-09-30T22:32:45.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.952+0000 7fcd18dce700 1 -- 172.21.15.59:0/659631864 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c00ddc0 con 0x7fcd1409e410 2023-09-30T22:32:45.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.952+0000 7fcd18dce700 1 -- 172.21.15.59:0/659631864 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00b310 con 0x7fcd1409e410 2023-09-30T22:32:45.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.953+0000 7fcd1c034700 1 -- 172.21.15.59:0/659631864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd1409e410 msgr2=0x7fcd14130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:45.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.953+0000 7fcd1c034700 1 --2- 172.21.15.59:0/659631864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd1409e410 0x7fcd14130d70 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00d150 tx=0x7fcd0c00d460 comp rx=0 tx=0).stop 2023-09-30T22:32:45.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.953+0000 7fcd1c034700 1 -- 172.21.15.59:0/659631864 shutdown_connections 2023-09-30T22:32:45.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.953+0000 7fcd1c034700 1 --2- 172.21.15.59:0/659631864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd1409e410 0x7fcd14130d70 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.953+0000 7fcd1c034700 1 --2- 172.21.15.59:0/659631864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd1409d6f0 0x7fcd1409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.953+0000 7fcd1c034700 1 -- 172.21.15.59:0/659631864 >> 172.21.15.59:0/659631864 conn(0x7fcd14066f50 msgr2=0x7fcd1409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:45.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.953+0000 7fcd1c034700 1 -- 172.21.15.59:0/659631864 shutdown_connections 2023-09-30T22:32:45.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.953+0000 7fcd1c034700 1 -- 172.21.15.59:0/659631864 wait complete. 2023-09-30T22:32:45.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.954+0000 7fcd1c034700 1 Processor -- start 2023-09-30T22:32:45.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.955+0000 7fcd1c034700 1 -- start start 2023-09-30T22:32:45.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.955+0000 7fcd1c034700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd1409d6f0 0x7fcd141223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.955+0000 7fcd1c034700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd1409e000 0x7fcd141228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.955+0000 7fcd1c034700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd1409e410 0x7fcd14122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.955+0000 7fcd1c034700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd14125cd0 con 0x7fcd1409e000 2023-09-30T22:32:45.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.955+0000 7fcd1c034700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd14125eb0 con 0x7fcd1409d6f0 2023-09-30T22:32:45.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.955+0000 7fcd1c034700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd14125910 con 0x7fcd1409e410 2023-09-30T22:32:45.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.955+0000 7fcd195cf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd1409e000 0x7fcd141228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.955+0000 7fcd1a5d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd1409e410 0x7fcd14122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.955+0000 7fcd195cf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd1409e000 0x7fcd141228f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41474/0 (socket says 172.21.15.59:41474) 2023-09-30T22:32:45.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.955+0000 7fcd1a5d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd1409e410 0x7fcd14122e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50798/0 (socket says 172.21.15.59:50798) 2023-09-30T22:32:45.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.955+0000 7fcd195cf700 1 -- 172.21.15.59:0/2850532097 learned_addr learned my addr 172.21.15.59:0/2850532097 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:45.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.955+0000 7fcd19dd0700 1 --2- 172.21.15.59:0/2850532097 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd1409d6f0 0x7fcd141223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.956+0000 7fcd195cf700 1 -- 172.21.15.59:0/2850532097 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd1409e410 msgr2=0x7fcd14122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:45.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.956+0000 7fcd195cf700 1 --2- 172.21.15.59:0/2850532097 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd1409e410 0x7fcd14122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.956+0000 7fcd195cf700 1 -- 172.21.15.59:0/2850532097 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd1409d6f0 msgr2=0x7fcd141223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:45.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.956+0000 7fcd195cf700 1 --2- 172.21.15.59:0/2850532097 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd1409d6f0 0x7fcd141223b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.956+0000 7fcd195cf700 1 -- 172.21.15.59:0/2850532097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c00bd40 con 0x7fcd1409e000 2023-09-30T22:32:45.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.956+0000 7fcd195cf700 1 --2- 172.21.15.59:0/2850532097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd1409e000 0x7fcd141228f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400c4e0 tx=0x7fcd0400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:45.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.956+0000 7fcd0a7fc700 1 -- 172.21.15.59:0/2850532097 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd040052d0 con 0x7fcd1409e000 2023-09-30T22:32:45.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.956+0000 7fcd0a7fc700 1 -- 172.21.15.59:0/2850532097 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd04005430 con 0x7fcd1409e000 2023-09-30T22:32:45.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.956+0000 7fcd0a7fc700 1 -- 172.21.15.59:0/2850532097 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04003880 con 0x7fcd1409e000 2023-09-30T22:32:45.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.956+0000 7fcd1c034700 1 -- 172.21.15.59:0/2850532097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd14124040 con 0x7fcd1409e000 2023-09-30T22:32:45.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.956+0000 7fcd1c034700 1 -- 172.21.15.59:0/2850532097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1409c700 con 0x7fcd1409e000 2023-09-30T22:32:45.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.957+0000 7fcd0a7fc700 1 -- 172.21.15.59:0/2850532097 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd040039e0 con 0x7fcd1409e000 2023-09-30T22:32:45.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.958+0000 7fcd0a7fc700 1 -- 172.21.15.59:0/2850532097 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcd0403e9b0 con 0x7fcd1409e000 2023-09-30T22:32:45.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.958+0000 7fcd1c034700 1 -- 172.21.15.59:0/2850532097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd14126700 con 0x7fcd1409e000 2023-09-30T22:32:45.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.960+0000 7fd808eb1700 1 Processor -- start 2023-09-30T22:32:45.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.960+0000 7fd808eb1700 1 -- start start 2023-09-30T22:32:45.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.960+0000 7f8c4cea5700 1 Processor -- start 2023-09-30T22:32:45.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.960+0000 7f8c4cea5700 1 -- start start 2023-09-30T22:32:45.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.961+0000 7fd808eb1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd804133420 0x7fd8041337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.961+0000 7fd808eb1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd804133e30 0x7fd80412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.961+0000 7fd808eb1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80406b990 con 0x7fd804134260 2023-09-30T22:32:45.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.961+0000 7fd808eb1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8040a0590 con 0x7fd804133e30 2023-09-30T22:32:45.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.961+0000 7fd808eb1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd80409fb80 con 0x7fd804133420 2023-09-30T22:32:45.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.961+0000 7fd802d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd804134260 0x7fd8041304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57936/0 (socket says 172.21.15.59:57936) 2023-09-30T22:32:45.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.961+0000 7fd802d9d700 1 -- 172.21.15.59:0/963103620 learned_addr learned my addr 172.21.15.59:0/963103620 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:45.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.961+0000 7fd801d9b700 1 --2- 172.21.15.59:0/963103620 >> v2:172.21.15.59:3300/0 conn(0x7fd804133e30 0x7fd80412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.961+0000 7f8c4cea5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c4806f5d0 0x7f8c4812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.961+0000 7f8c4cea5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c48066410 0x7f8c48138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.961+0000 7f8c4cea5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4806fa40 con 0x7f8c4812cf60 2023-09-30T22:32:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7f8c4659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8c4812cf60 0x7f8c4812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57950/0 (socket says 172.21.15.59:57950) 2023-09-30T22:32:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7f8c45d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c4806f5d0 0x7f8c4812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7f8c4659c700 1 -- 172.21.15.59:0/3987120728 learned_addr learned my addr 172.21.15.59:0/3987120728 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7f8c4cea5700 1 -- 172.21.15.59:0/3987120728 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4812cd90 con 0x7f8c4806f5d0 2023-09-30T22:32:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7f8c4cea5700 1 -- 172.21.15.59:0/3987120728 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c48071780 con 0x7f8c48066410 2023-09-30T22:32:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7f8c46d9d700 1 --2- 172.21.15.59:0/3987120728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c48066410 0x7f8c48138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7f8c45d9b700 1 -- 172.21.15.59:0/3987120728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c48066410 msgr2=0x7f8c48138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7f8c45d9b700 1 --2- 172.21.15.59:0/3987120728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c48066410 0x7f8c48138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7f8c45d9b700 1 -- 172.21.15.59:0/3987120728 >> v1:172.21.15.59:6789/0 conn(0x7f8c4812cf60 legacy=0x7f8c4812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7f8c45d9b700 1 -- 172.21.15.59:0/3987120728 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c48071a40 con 0x7f8c4806f5d0 2023-09-30T22:32:45.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7fd801d9b700 1 -- 172.21.15.59:0/963103620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd804133420 msgr2=0x7fd8041337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:45.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7fd801d9b700 1 --2- 172.21.15.59:0/963103620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd804133420 0x7fd8041337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7fd801d9b700 1 -- 172.21.15.59:0/963103620 >> v1:172.21.15.59:6789/0 conn(0x7fd804134260 legacy=0x7fd8041304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:45.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7fd801d9b700 1 -- 172.21.15.59:0/963103620 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8040a0030 con 0x7fd804133e30 2023-09-30T22:32:45.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7fd801d9b700 1 --2- 172.21.15.59:0/963103620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd804133e30 0x7fd80412ff90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009840 tx=0x7fd7f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c85e24cc181302b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:45.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.962+0000 7f8c45d9b700 1 --2- 172.21.15.59:0/3987120728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4806f5d0 0x7f8c4812ffc0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009840 tx=0x7f8c3c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732a1e5cd7b81c42 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:45.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.963+0000 7f8c4559a700 1 -- 172.21.15.59:0/3987120728 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c011830 con 0x7f8c4806f5d0 2023-09-30T22:32:45.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.963+0000 7f8c4559a700 1 -- 172.21.15.59:0/3987120728 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3c011990 con 0x7f8c4806f5d0 2023-09-30T22:32:45.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.963+0000 7f8c4559a700 1 -- 172.21.15.59:0/3987120728 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c011d20 con 0x7f8c4806f5d0 2023-09-30T22:32:45.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.963+0000 7fd80159a700 1 -- 172.21.15.59:0/963103620 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8011830 con 0x7fd804133e30 2023-09-30T22:32:45.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.963+0000 7fd80159a700 1 -- 172.21.15.59:0/963103620 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f8011990 con 0x7fd804133e30 2023-09-30T22:32:45.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.963+0000 7fd80159a700 1 -- 172.21.15.59:0/963103620 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8011d20 con 0x7fd804133e30 2023-09-30T22:32:45.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.963+0000 7fcd0a7fc700 1 -- 172.21.15.59:0/2850532097 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd040198b0 con 0x7fcd1409e000 2023-09-30T22:32:45.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.964+0000 7f8c4cea5700 1 -- 172.21.15.59:0/3987120728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4806f5d0 msgr2=0x7f8c4812ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:45.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.964+0000 7f8c4cea5700 1 --2- 172.21.15.59:0/3987120728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4806f5d0 0x7f8c4812ffc0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009840 tx=0x7f8c3c009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:45.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.964+0000 7fd808eb1700 1 -- 172.21.15.59:0/963103620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd804133e30 msgr2=0x7fd80412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:45.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.964+0000 7fd808eb1700 1 --2- 172.21.15.59:0/963103620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd804133e30 0x7fd80412ff90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009840 tx=0x7fd7f8009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:45.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.964+0000 7f8c4cea5700 1 -- 172.21.15.59:0/3987120728 shutdown_connections 2023-09-30T22:32:45.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.964+0000 7f8c4cea5700 1 --2- 172.21.15.59:0/3987120728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c48066410 0x7f8c48138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.964+0000 7f8c4cea5700 1 --2- 172.21.15.59:0/3987120728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4806f5d0 0x7f8c4812ffc0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.964+0000 7f8c4cea5700 1 -- 172.21.15.59:0/3987120728 >> 172.21.15.59:0/3987120728 conn(0x7f8c480a2aa0 msgr2=0x7f8c480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:45.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.965+0000 7f8c4cea5700 1 -- 172.21.15.59:0/3987120728 shutdown_connections 2023-09-30T22:32:45.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.965+0000 7f8c4cea5700 1 -- 172.21.15.59:0/3987120728 wait complete. 2023-09-30T22:32:45.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.966+0000 7f8c4cea5700 1 Processor -- start 2023-09-30T22:32:45.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.966+0000 7f8c4cea5700 1 -- start start 2023-09-30T22:32:45.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.966+0000 7f8c4cea5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c48066410 0x7f8c48139280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.966+0000 7f8c4cea5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4806f5d0 0x7f8c481397c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.966+0000 7f8c4cea5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4812cf60 0x7f8c48139d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.966+0000 7f8c4cea5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c481357f0 con 0x7f8c4806f5d0 2023-09-30T22:32:45.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.966+0000 7f8c4cea5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c48134da0 con 0x7f8c48066410 2023-09-30T22:32:45.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.966+0000 7f8c4cea5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4813b1a0 con 0x7f8c4812cf60 2023-09-30T22:32:45.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.966+0000 7f8c4659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c48066410 0x7f8c48139280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.966+0000 7f8c4659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c48066410 0x7f8c48139280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48562/0 (socket says 172.21.15.59:48562) 2023-09-30T22:32:45.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.967+0000 7f8c4659c700 1 -- 172.21.15.59:0/2670764379 learned_addr learned my addr 172.21.15.59:0/2670764379 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:45.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.967+0000 7f8c46d9d700 1 --2- 172.21.15.59:0/2670764379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4812cf60 0x7f8c48139d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.967+0000 7f8c45d9b700 1 --2- 172.21.15.59:0/2670764379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4806f5d0 0x7f8c481397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.967+0000 7f8c46d9d700 1 -- 172.21.15.59:0/2670764379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c48066410 msgr2=0x7f8c48139280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.967+0000 7f8c46d9d700 1 --2- 172.21.15.59:0/2670764379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c48066410 0x7f8c48139280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.967+0000 7f8c46d9d700 1 -- 172.21.15.59:0/2670764379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4806f5d0 msgr2=0x7f8c481397c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.967+0000 7f8c46d9d700 1 --2- 172.21.15.59:0/2670764379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4806f5d0 0x7f8c481397c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.967+0000 7f8c46d9d700 1 -- 172.21.15.59:0/2670764379 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0094a0 con 0x7f8c4812cf60 2023-09-30T22:32:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.967+0000 7f8c4659c700 1 --2- 172.21.15.59:0/2670764379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c48066410 0x7f8c48139280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.967+0000 7f8c46d9d700 1 --2- 172.21.15.59:0/2670764379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4812cf60 0x7f8c48139d00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000efc0 tx=0x7f8c4000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.967+0000 7f8c36ffd700 1 -- 172.21.15.59:0/2670764379 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4000cd40 con 0x7f8c4812cf60 2023-09-30T22:32:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.967+0000 7f8c36ffd700 1 -- 172.21.15.59:0/2670764379 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4000f040 con 0x7f8c4812cf60 2023-09-30T22:32:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.967+0000 7f8c4cea5700 1 -- 172.21.15.59:0/2670764379 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4812bc50 con 0x7f8c4812cf60 2023-09-30T22:32:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.968+0000 7f8c36ffd700 1 -- 172.21.15.59:0/2670764379 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c400146c0 con 0x7f8c4812cf60 2023-09-30T22:32:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.968+0000 7f8c4cea5700 1 -- 172.21.15.59:0/2670764379 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4809e3e0 con 0x7f8c4812cf60 2023-09-30T22:32:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.969+0000 7f8c36ffd700 1 -- 172.21.15.59:0/2670764379 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c40014820 con 0x7f8c4812cf60 2023-09-30T22:32:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.969+0000 7f8c4cea5700 1 -- 172.21.15.59:0/2670764379 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c48074ea0 con 0x7f8c4812cf60 2023-09-30T22:32:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.969+0000 7fd808eb1700 1 -- 172.21.15.59:0/963103620 shutdown_connections 2023-09-30T22:32:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.969+0000 7fd808eb1700 1 --2- 172.21.15.59:0/963103620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd804133420 0x7fd8041337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.969+0000 7fd808eb1700 1 --2- 172.21.15.59:0/963103620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd804133e30 0x7fd80412ff90 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.969+0000 7fd808eb1700 1 -- 172.21.15.59:0/963103620 >> 172.21.15.59:0/963103620 conn(0x7fd8040a4210 msgr2=0x7fd8040a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:45.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.969+0000 7f8c36ffd700 1 -- 172.21.15.59:0/2670764379 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8c40041890 con 0x7f8c4812cf60 2023-09-30T22:32:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.972+0000 7fd808eb1700 1 -- 172.21.15.59:0/963103620 shutdown_connections 2023-09-30T22:32:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.972+0000 7fd808eb1700 1 -- 172.21.15.59:0/963103620 wait complete. 2023-09-30T22:32:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.973+0000 7fd808eb1700 1 Processor -- start 2023-09-30T22:32:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.973+0000 7fd808eb1700 1 -- start start 2023-09-30T22:32:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.973+0000 7fd808eb1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd804133420 0x7fd80409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.973+0000 7fd808eb1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd804133e30 0x7fd80409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.973+0000 7fd808eb1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd804134260 0x7fd80409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.973+0000 7fd808eb1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd804120010 con 0x7fd804133420 2023-09-30T22:32:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.973+0000 7fd808eb1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8041201f0 con 0x7fd804134260 2023-09-30T22:32:45.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.973+0000 7fd808eb1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd80412da70 con 0x7fd804133e30 2023-09-30T22:32:45.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.974+0000 7fd80259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd804133420 0x7fd80409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.974+0000 7fd80259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd804133420 0x7fd80409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41500/0 (socket says 172.21.15.59:41500) 2023-09-30T22:32:45.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.974+0000 7fd802d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd804134260 0x7fd80409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:45.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.974+0000 7fd80259c700 1 -- 172.21.15.59:0/3524852246 learned_addr learned my addr 172.21.15.59:0/3524852246 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:45.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.974+0000 7fd80259c700 1 -- 172.21.15.59:0/3524852246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd804133e30 msgr2=0x7fd80409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:45.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.974+0000 7fd80259c700 1 --2- 172.21.15.59:0/3524852246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd804133e30 0x7fd80409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.974+0000 7fd80259c700 1 -- 172.21.15.59:0/3524852246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd804134260 msgr2=0x7fd80409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:45.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.974+0000 7fd80259c700 1 --2- 172.21.15.59:0/3524852246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd804134260 0x7fd80409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:45.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.974+0000 7fd80259c700 1 -- 172.21.15.59:0/3524852246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f80094a0 con 0x7fd804133420 2023-09-30T22:32:45.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.974+0000 7fd802d9d700 1 --2- 172.21.15.59:0/3524852246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd804134260 0x7fd80409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:45.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.974+0000 7fd80259c700 1 --2- 172.21.15.59:0/3524852246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd804133420 0x7fd80409c480 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4013f70 tx=0x7fd7f4011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:45.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.975+0000 7fd7f2ffd700 1 -- 172.21.15.59:0/3524852246 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4014d30 con 0x7fd804133420 2023-09-30T22:32:45.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.975+0000 7fd7f2ffd700 1 -- 172.21.15.59:0/3524852246 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f4014e90 con 0x7fd804133420 2023-09-30T22:32:45.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.975+0000 7fd7f2ffd700 1 -- 172.21.15.59:0/3524852246 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4011310 con 0x7fd804133420 2023-09-30T22:32:45.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.976+0000 7fd808eb1700 1 -- 172.21.15.59:0/3524852246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80411fc50 con 0x7fd804133420 2023-09-30T22:32:45.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.976+0000 7fd808eb1700 1 -- 172.21.15.59:0/3524852246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80412d620 con 0x7fd804133420 2023-09-30T22:32:45.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.977+0000 7fd7f2ffd700 1 -- 172.21.15.59:0/3524852246 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd7f4011470 con 0x7fd804133420 2023-09-30T22:32:45.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.977+0000 7fd7f2ffd700 1 -- 172.21.15.59:0/3524852246 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd7f40473a0 con 0x7fd804133420 2023-09-30T22:32:45.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.977+0000 7fd808eb1700 1 -- 172.21.15.59:0/3524852246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80409de40 con 0x7fd804133420 2023-09-30T22:32:45.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.979+0000 7f8c36ffd700 1 -- 172.21.15.59:0/2670764379 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c40045060 con 0x7f8c4812cf60 2023-09-30T22:32:45.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:45.983+0000 7fd7f2ffd700 1 -- 172.21.15.59:0/3524852246 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7f4019890 con 0x7fd804133420 2023-09-30T22:32:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.138+0000 7f8a79624700 1 -- 172.21.15.59:0/1323866850 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8a74074ea0 con 0x7f8a741338c0 2023-09-30T22:32:46.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.139+0000 7f8a5b7fe700 1 -- 172.21.15.59:0/1323866850 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a68015030 con 0x7f8a741338c0 2023-09-30T22:32:46.140 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.142+0000 7f8a79624700 1 -- 172.21.15.59:0/1323866850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a741338c0 msgr2=0x7f8a7411ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.142+0000 7f8a79624700 1 --2- 172.21.15.59:0/1323866850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a741338c0 0x7f8a7411ee80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8a680090b0 tx=0x7f8a68004750 comp rx=0 tx=0).stop 2023-09-30T22:32:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.142+0000 7f8a79624700 1 -- 172.21.15.59:0/1323866850 shutdown_connections 2023-09-30T22:32:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.142+0000 7f8a79624700 1 --2- 172.21.15.59:0/1323866850 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a741341d0 0x7f8a7411f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.142+0000 7f8a79624700 1 --2- 172.21.15.59:0/1323866850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a7409e390 0x7f8a7411e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.142+0000 7f8a79624700 1 --2- 172.21.15.59:0/1323866850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a741338c0 0x7f8a7411ee80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.142+0000 7f8a79624700 1 -- 172.21.15.59:0/1323866850 >> 172.21.15.59:0/1323866850 conn(0x7f8a740a2aa0 msgr2=0x7f8a741306a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.142+0000 7f8a79624700 1 -- 172.21.15.59:0/1323866850 shutdown_connections 2023-09-30T22:32:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.142+0000 7f8a79624700 1 -- 172.21.15.59:0/1323866850 wait complete. 2023-09-30T22:32:46.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:46.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.184+0000 7f8c4cea5700 1 -- 172.21.15.59:0/2670764379 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8c480713a0 con 0x7f8c4812cf60 2023-09-30T22:32:46.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.185+0000 7f8c36ffd700 1 -- 172.21.15.59:0/2670764379 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c40018020 con 0x7f8c4812cf60 2023-09-30T22:32:46.186 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:46.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.187+0000 7fcd1c034700 1 -- 172.21.15.59:0/2850532097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd14123860 con 0x7fcd1409e000 2023-09-30T22:32:46.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.187+0000 7fcd0a7fc700 1 -- 172.21.15.59:0/2850532097 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd14123860 con 0x7fcd1409e000 2023-09-30T22:32:46.188 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.187+0000 7f8c4cea5700 1 -- 172.21.15.59:0/2670764379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4812cf60 msgr2=0x7f8c48139d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.187+0000 7f8c4cea5700 1 --2- 172.21.15.59:0/2670764379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4812cf60 0x7f8c48139d00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000efc0 tx=0x7f8c4000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.187+0000 7f8c4cea5700 1 -- 172.21.15.59:0/2670764379 shutdown_connections 2023-09-30T22:32:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.187+0000 7f8c4cea5700 1 --2- 172.21.15.59:0/2670764379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4812cf60 0x7f8c48139d00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.187+0000 7f8c4cea5700 1 --2- 172.21.15.59:0/2670764379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c48066410 0x7f8c48139280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.187+0000 7f8c4cea5700 1 --2- 172.21.15.59:0/2670764379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4806f5d0 0x7f8c481397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.187+0000 7f8c4cea5700 1 -- 172.21.15.59:0/2670764379 >> 172.21.15.59:0/2670764379 conn(0x7f8c480a2aa0 msgr2=0x7f8c480a0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:46.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.187+0000 7f8c4cea5700 1 -- 172.21.15.59:0/2670764379 shutdown_connections 2023-09-30T22:32:46.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.187+0000 7f8c4cea5700 1 -- 172.21.15.59:0/2670764379 wait complete. 2023-09-30T22:32:46.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.189+0000 7fcd1c034700 1 -- 172.21.15.59:0/2850532097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd1409e000 msgr2=0x7fcd141228f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:46.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.189+0000 7fcd1c034700 1 --2- 172.21.15.59:0/2850532097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd1409e000 0x7fcd141228f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400c4e0 tx=0x7fcd0400c7f0 comp rx=0 tx=0).stop 2023-09-30T22:32:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.189+0000 7fcd1c034700 1 -- 172.21.15.59:0/2850532097 shutdown_connections 2023-09-30T22:32:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.189+0000 7fcd1c034700 1 --2- 172.21.15.59:0/2850532097 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd1409e410 0x7fcd14122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.189+0000 7fcd1c034700 1 --2- 172.21.15.59:0/2850532097 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd1409d6f0 0x7fcd141223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.189+0000 7fcd1c034700 1 --2- 172.21.15.59:0/2850532097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd1409e000 0x7fcd141228f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.189+0000 7fcd1c034700 1 -- 172.21.15.59:0/2850532097 >> 172.21.15.59:0/2850532097 conn(0x7fcd14066f50 msgr2=0x7fcd140710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.189+0000 7fcd1c034700 1 -- 172.21.15.59:0/2850532097 shutdown_connections 2023-09-30T22:32:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.190+0000 7fcd1c034700 1 -- 172.21.15.59:0/2850532097 wait complete. 2023-09-30T22:32:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.190+0000 7fd808eb1700 1 -- 172.21.15.59:0/3524852246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd80409e330 con 0x7fd804133420 2023-09-30T22:32:46.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.197+0000 7fd7f2ffd700 1 -- 172.21.15.59:0/3524852246 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd7f4047020 con 0x7fd804133420 2023-09-30T22:32:46.199 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:46.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.200+0000 7fd808eb1700 1 -- 172.21.15.59:0/3524852246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd804133420 msgr2=0x7fd80409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:46.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.200+0000 7fd808eb1700 1 --2- 172.21.15.59:0/3524852246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd804133420 0x7fd80409c480 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4013f70 tx=0x7fd7f4011e30 comp rx=0 tx=0).stop 2023-09-30T22:32:46.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.200+0000 7fd808eb1700 1 -- 172.21.15.59:0/3524852246 shutdown_connections 2023-09-30T22:32:46.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.200+0000 7fd808eb1700 1 --2- 172.21.15.59:0/3524852246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd804134260 0x7fd80409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:46.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.200+0000 7fd808eb1700 1 --2- 172.21.15.59:0/3524852246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd804133420 0x7fd80409c480 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:46.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.200+0000 7fd808eb1700 1 --2- 172.21.15.59:0/3524852246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd804133e30 0x7fd80409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:46.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.200+0000 7fd808eb1700 1 -- 172.21.15.59:0/3524852246 >> 172.21.15.59:0/3524852246 conn(0x7fd8040a4210 msgr2=0x7fd8040a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:46.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.200+0000 7fd808eb1700 1 -- 172.21.15.59:0/3524852246 shutdown_connections 2023-09-30T22:32:46.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:46.200+0000 7fd808eb1700 1 -- 172.21.15.59:0/3524852246 wait complete. 2023-09-30T22:32:46.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:46.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:46.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:47.164 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:47.206 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:47.209 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:47.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:47.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.320+0000 7f9eb9395700 1 Processor -- start 2023-09-30T22:32:47.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.320+0000 7f9eb9395700 1 -- start start 2023-09-30T22:32:47.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.321+0000 7f9eb9395700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb409e930 0x7f9eb409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.321+0000 7f9eb9395700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9eb409f240 0x7f9eb41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.321+0000 7f9eb9395700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eb409f650 0x7f9eb4131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.321+0000 7f9eb9395700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb4070940 con 0x7f9eb409f240 2023-09-30T22:32:47.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.321+0000 7f9eb9395700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb406fd60 con 0x7f9eb409e930 2023-09-30T22:32:47.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.321+0000 7f9eb9395700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb406fa80 con 0x7f9eb409f650 2023-09-30T22:32:47.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.321+0000 7f9eb27fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9eb409f240 0x7f9eb41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.321+0000 7f9eb2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb409e930 0x7f9eb409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.321+0000 7f9eb27fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9eb409f240 0x7f9eb41317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41514/0 (socket says 172.21.15.59:41514) 2023-09-30T22:32:47.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.321+0000 7f9eb27fc700 1 -- 172.21.15.59:0/229608557 learned_addr learned my addr 172.21.15.59:0/229608557 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:47.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.321+0000 7f9eb37fe700 1 --2- 172.21.15.59:0/229608557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eb409f650 0x7f9eb4131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.321+0000 7f9eb27fc700 1 -- 172.21.15.59:0/229608557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eb409f650 msgr2=0x7f9eb4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:47.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.321+0000 7f9eb27fc700 1 --2- 172.21.15.59:0/229608557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eb409f650 0x7f9eb4131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.321+0000 7f9eb27fc700 1 -- 172.21.15.59:0/229608557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb409e930 msgr2=0x7f9eb409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:47.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.322+0000 7f9eb27fc700 1 --2- 172.21.15.59:0/229608557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb409e930 0x7f9eb409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.322+0000 7f9eb27fc700 1 -- 172.21.15.59:0/229608557 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb409fb60 con 0x7f9eb409f240 2023-09-30T22:32:47.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.322+0000 7f9eb27fc700 1 --2- 172.21.15.59:0/229608557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb409f240 0x7f9eb41317f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80098f0 tx=0x7f9ea8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990ec268cbc255e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.322+0000 7f9eb1ffb700 1 -- 172.21.15.59:0/229608557 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8011830 con 0x7f9eb409f240 2023-09-30T22:32:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.322+0000 7f9eb1ffb700 1 -- 172.21.15.59:0/229608557 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea8011990 con 0x7f9eb409f240 2023-09-30T22:32:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.322+0000 7f9eb1ffb700 1 -- 172.21.15.59:0/229608557 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8011d20 con 0x7f9eb409f240 2023-09-30T22:32:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.323+0000 7f9eb9395700 1 -- 172.21.15.59:0/229608557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb409f240 msgr2=0x7f9eb41317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.323+0000 7f9eb9395700 1 --2- 172.21.15.59:0/229608557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb409f240 0x7f9eb41317f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80098f0 tx=0x7f9ea8009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.323+0000 7f9eb9395700 1 -- 172.21.15.59:0/229608557 shutdown_connections 2023-09-30T22:32:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.323+0000 7f9eb9395700 1 --2- 172.21.15.59:0/229608557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eb409f650 0x7f9eb4131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.323+0000 7f9eb9395700 1 --2- 172.21.15.59:0/229608557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb409e930 0x7f9eb409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.323+0000 7f9eb9395700 1 --2- 172.21.15.59:0/229608557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb409f240 0x7f9eb41317f0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.323+0000 7f9eb9395700 1 -- 172.21.15.59:0/229608557 >> 172.21.15.59:0/229608557 conn(0x7f9eb40a4210 msgr2=0x7f9eb40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.323+0000 7f9eb9395700 1 -- 172.21.15.59:0/229608557 shutdown_connections 2023-09-30T22:32:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.323+0000 7f9eb9395700 1 -- 172.21.15.59:0/229608557 wait complete. 2023-09-30T22:32:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.324+0000 7f9eb9395700 1 Processor -- start 2023-09-30T22:32:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.325+0000 7f9eb9395700 1 -- start start 2023-09-30T22:32:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.325+0000 7f9eb9395700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eb409e930 0x7f9eb411f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.325+0000 7f9eb9395700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb409f240 0x7f9eb411f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.325+0000 7f9eb9395700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb409f650 0x7f9eb411fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.325+0000 7f9eb9395700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb4120dd0 con 0x7f9eb409f650 2023-09-30T22:32:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.325+0000 7f9eb9395700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb4122020 con 0x7f9eb409f240 2023-09-30T22:32:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.325+0000 7f9eb9395700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb4122a00 con 0x7f9eb409e930 2023-09-30T22:32:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.325+0000 7f9eb2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eb409e930 0x7f9eb411f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.325+0000 7f9eb27fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb409f240 0x7f9eb411f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.325+0000 7f9eb2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eb409e930 0x7f9eb411f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50856/0 (socket says 172.21.15.59:50856) 2023-09-30T22:32:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.325+0000 7f9eb27fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb409f240 0x7f9eb411f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48592/0 (socket says 172.21.15.59:48592) 2023-09-30T22:32:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.325+0000 7f9eb2ffd700 1 -- 172.21.15.59:0/3011805381 learned_addr learned my addr 172.21.15.59:0/3011805381 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.325+0000 7f9eb37fe700 1 --2- 172.21.15.59:0/3011805381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb409f650 0x7f9eb411fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.326+0000 7f9eb27fc700 1 -- 172.21.15.59:0/3011805381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eb409e930 msgr2=0x7f9eb411f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.326+0000 7f9eb27fc700 1 --2- 172.21.15.59:0/3011805381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eb409e930 0x7f9eb411f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.326+0000 7f9eb27fc700 1 -- 172.21.15.59:0/3011805381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb409f650 msgr2=0x7f9eb411fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.326+0000 7f9eb27fc700 1 --2- 172.21.15.59:0/3011805381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb409f650 0x7f9eb411fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.326+0000 7f9eb27fc700 1 -- 172.21.15.59:0/3011805381 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea8009550 con 0x7f9eb409f240 2023-09-30T22:32:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.326+0000 7f9eb27fc700 1 --2- 172.21.15.59:0/3011805381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb409f240 0x7f9eb411f790 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8016000 tx=0x7f9ea8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.326+0000 7f9e9b7fe700 1 -- 172.21.15.59:0/3011805381 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8004240 con 0x7f9eb409f240 2023-09-30T22:32:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.326+0000 7f9e9b7fe700 1 -- 172.21.15.59:0/3011805381 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea801f070 con 0x7f9eb409f240 2023-09-30T22:32:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.326+0000 7f9eb9395700 1 -- 172.21.15.59:0/3011805381 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb40a0190 con 0x7f9eb409f240 2023-09-30T22:32:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.326+0000 7f9e9b7fe700 1 -- 172.21.15.59:0/3011805381 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80036a0 con 0x7f9eb409f240 2023-09-30T22:32:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.327+0000 7f9eb9395700 1 -- 172.21.15.59:0/3011805381 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb409b220 con 0x7f9eb409f240 2023-09-30T22:32:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.328+0000 7f9e9b7fe700 1 -- 172.21.15.59:0/3011805381 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ea8021030 con 0x7f9eb409f240 2023-09-30T22:32:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.328+0000 7f9e9b7fe700 1 -- 172.21.15.59:0/3011805381 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9ea8044280 con 0x7f9eb409f240 2023-09-30T22:32:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.328+0000 7f9eb9395700 1 -- 172.21.15.59:0/3011805381 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb4071d20 con 0x7f9eb409f240 2023-09-30T22:32:47.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.338+0000 7f9e9b7fe700 1 -- 172.21.15.59:0/3011805381 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ea8015020 con 0x7f9eb409f240 2023-09-30T22:32:47.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.359+0000 7ffa266cb700 1 Processor -- start 2023-09-30T22:32:47.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.359+0000 7ffa266cb700 1 -- start start 2023-09-30T22:32:47.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.360+0000 7ffa266cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 0x7ffa2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.360+0000 7ffa266cb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa2009e410 0x7ffa20134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.360+0000 7ffa266cb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2009b120 con 0x7ffa2009e000 2023-09-30T22:32:47.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.360+0000 7ffa266cb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2006b460 con 0x7ffa2009e410 2023-09-30T22:32:47.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.360+0000 7ffa266cb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2009a7e0 con 0x7ffa2009d6f0 2023-09-30T22:32:47.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.360+0000 7ffa1ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 0x7ffa2009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.360+0000 7ffa1ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 0x7ffa2009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48596/0 (socket says 172.21.15.59:48596) 2023-09-30T22:32:47.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.360+0000 7ffa1ffff700 1 -- 172.21.15.59:0/2643283279 learned_addr learned my addr 172.21.15.59:0/2643283279 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.360+0000 7ffa24c68700 1 --2- 172.21.15.59:0/2643283279 >> v2:172.21.15.59:3300/0 conn(0x7ffa2009e410 0x7ffa20134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.360+0000 7ffa1ffff700 1 -- 172.21.15.59:0/2643283279 >> v2:172.21.15.59:3300/0 conn(0x7ffa2009e410 msgr2=0x7ffa20134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.360+0000 7ffa1ffff700 1 --2- 172.21.15.59:0/2643283279 >> v2:172.21.15.59:3300/0 conn(0x7ffa2009e410 0x7ffa20134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.360+0000 7ffa1ffff700 1 -- 172.21.15.59:0/2643283279 >> v1:172.21.15.59:6789/0 conn(0x7ffa2009e000 legacy=0x7ffa201339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.361+0000 7ffa1ffff700 1 -- 172.21.15.59:0/2643283279 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2009a500 con 0x7ffa2009d6f0 2023-09-30T22:32:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.361+0000 7ffa24c68700 1 --2- 172.21.15.59:0/2643283279 >> v2:172.21.15.59:3300/0 conn(0x7ffa2009e410 0x7ffa20134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.361+0000 7ffa1ffff700 1 --2- 172.21.15.59:0/2643283279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 0x7ffa2009dac0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009920 tx=0x7ffa10009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5459d5255a0b2a76 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.361+0000 7ffa1effd700 1 -- 172.21.15.59:0/2643283279 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10004230 con 0x7ffa2009d6f0 2023-09-30T22:32:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.361+0000 7ffa1effd700 1 -- 172.21.15.59:0/2643283279 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa10004390 con 0x7ffa2009d6f0 2023-09-30T22:32:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.361+0000 7ffa1effd700 1 -- 172.21.15.59:0/2643283279 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa100036a0 con 0x7ffa2009d6f0 2023-09-30T22:32:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.362+0000 7ffa266cb700 1 -- 172.21.15.59:0/2643283279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 msgr2=0x7ffa2009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.362+0000 7ffa266cb700 1 --2- 172.21.15.59:0/2643283279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 0x7ffa2009dac0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009920 tx=0x7ffa10009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:47.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.362+0000 7ffa266cb700 1 -- 172.21.15.59:0/2643283279 shutdown_connections 2023-09-30T22:32:47.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.362+0000 7ffa266cb700 1 --2- 172.21.15.59:0/2643283279 >> v2:172.21.15.59:3300/0 conn(0x7ffa2009e410 0x7ffa20134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.362+0000 7ffa266cb700 1 --2- 172.21.15.59:0/2643283279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009d6f0 0x7ffa2009dac0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.362+0000 7ffa266cb700 1 -- 172.21.15.59:0/2643283279 >> 172.21.15.59:0/2643283279 conn(0x7ffa20066f50 msgr2=0x7ffa2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:47.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.362+0000 7ffa266cb700 1 -- 172.21.15.59:0/2643283279 shutdown_connections 2023-09-30T22:32:47.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.362+0000 7ffa266cb700 1 -- 172.21.15.59:0/2643283279 wait complete. 2023-09-30T22:32:47.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.363+0000 7ffa266cb700 1 Processor -- start 2023-09-30T22:32:47.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.363+0000 7ffa266cb700 1 -- start start 2023-09-30T22:32:47.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa266cb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009d6f0 0x7ffa201a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa266cb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2009e000 0x7ffa201a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa266cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009e410 0x7ffa201a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa266cb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa201a97f0 con 0x7ffa2009d6f0 2023-09-30T22:32:47.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa266cb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa201a88e0 con 0x7ffa2009e410 2023-09-30T22:32:47.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa266cb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa201a7b80 con 0x7ffa2009e000 2023-09-30T22:32:47.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa1ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009d6f0 0x7ffa201a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa1ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009d6f0 0x7ffa201a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41524/0 (socket says 172.21.15.59:41524) 2023-09-30T22:32:47.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa1ffff700 1 -- 172.21.15.59:0/221329105 learned_addr learned my addr 172.21.15.59:0/221329105 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:47.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa1f7fe700 1 --2- 172.21.15.59:0/221329105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2009e000 0x7ffa201a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa24c68700 1 --2- 172.21.15.59:0/221329105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009e410 0x7ffa201a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa1ffff700 1 -- 172.21.15.59:0/221329105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2009e000 msgr2=0x7ffa201a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa1ffff700 1 --2- 172.21.15.59:0/221329105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2009e000 0x7ffa201a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa1ffff700 1 -- 172.21.15.59:0/221329105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009e410 msgr2=0x7ffa201a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa1ffff700 1 --2- 172.21.15.59:0/221329105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009e410 0x7ffa201a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa1ffff700 1 -- 172.21.15.59:0/221329105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa18009a70 con 0x7ffa2009d6f0 2023-09-30T22:32:47.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.364+0000 7ffa24c68700 1 --2- 172.21.15.59:0/221329105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009e410 0x7ffa201a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:47.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.365+0000 7ffa1ffff700 1 --2- 172.21.15.59:0/221329105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009d6f0 0x7ffa201a5ed0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009fd0 tx=0x7ffa10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.365+0000 7ffa1cff9700 1 -- 172.21.15.59:0/221329105 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10003b90 con 0x7ffa2009d6f0 2023-09-30T22:32:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.365+0000 7ffa1cff9700 1 -- 172.21.15.59:0/221329105 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1001f070 con 0x7ffa2009d6f0 2023-09-30T22:32:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.365+0000 7ffa266cb700 1 -- 172.21.15.59:0/221329105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa10009550 con 0x7ffa2009d6f0 2023-09-30T22:32:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.365+0000 7ffa1cff9700 1 -- 172.21.15.59:0/221329105 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10011630 con 0x7ffa2009d6f0 2023-09-30T22:32:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.365+0000 7ffa266cb700 1 -- 172.21.15.59:0/221329105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2009c710 con 0x7ffa2009d6f0 2023-09-30T22:32:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.366+0000 7ffa1cff9700 1 -- 172.21.15.59:0/221329105 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa10021030 con 0x7ffa2009d6f0 2023-09-30T22:32:47.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.366+0000 7ffa1cff9700 1 -- 172.21.15.59:0/221329105 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffa10040b90 con 0x7ffa2009d6f0 2023-09-30T22:32:47.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.367+0000 7ffa266cb700 1 -- 172.21.15.59:0/221329105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa201a8e00 con 0x7ffa2009d6f0 2023-09-30T22:32:47.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.371+0000 7f3154d3d700 1 Processor -- start 2023-09-30T22:32:47.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.371+0000 7f3154d3d700 1 -- start start 2023-09-30T22:32:47.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.372+0000 7f3154d3d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009e1d0 0x7f3150138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.372+0000 7f3154d3d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3150139170 0x7f315013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.372+0000 7f3154d3d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315009b120 con 0x7f315009d6f0 2023-09-30T22:32:47.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.372+0000 7f3154d3d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315006b460 con 0x7f3150139170 2023-09-30T22:32:47.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.372+0000 7f3154d3d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f315009a7e0 con 0x7f315009e1d0 2023-09-30T22:32:47.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.372+0000 7ffa1cff9700 1 -- 172.21.15.59:0/221329105 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa100239a0 con 0x7ffa2009d6f0 2023-09-30T22:32:47.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.372+0000 7f314e59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f315009d6f0 0x7f315009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57968/0 (socket says 172.21.15.59:57968) 2023-09-30T22:32:47.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.372+0000 7f314e59c700 1 -- 172.21.15.59:0/3821994481 learned_addr learned my addr 172.21.15.59:0/3821994481 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:47.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.372+0000 7f314dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009e1d0 0x7f3150138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.372+0000 7f314ed9d700 1 --2- 172.21.15.59:0/3821994481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3150139170 0x7f315013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.373+0000 7f314dd9b700 1 -- 172.21.15.59:0/3821994481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3150139170 msgr2=0x7f315013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:47.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.373+0000 7f314dd9b700 1 --2- 172.21.15.59:0/3821994481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3150139170 0x7f315013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.373+0000 7f314dd9b700 1 -- 172.21.15.59:0/3821994481 >> v1:172.21.15.59:6789/0 conn(0x7f315009d6f0 legacy=0x7f315009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.373+0000 7f314dd9b700 1 -- 172.21.15.59:0/3821994481 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315009a500 con 0x7f315009e1d0 2023-09-30T22:32:47.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.373+0000 7f314dd9b700 1 --2- 172.21.15.59:0/3821994481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009e1d0 0x7f3150138c30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f31440098a0 tx=0x7f3144009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5beb0693d6814ad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:47.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.373+0000 7f314d59a700 1 -- 172.21.15.59:0/3821994481 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144011830 con 0x7f315009e1d0 2023-09-30T22:32:47.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.373+0000 7f314d59a700 1 -- 172.21.15.59:0/3821994481 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3144011990 con 0x7f315009e1d0 2023-09-30T22:32:47.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.373+0000 7f314d59a700 1 -- 172.21.15.59:0/3821994481 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144011d20 con 0x7f315009e1d0 2023-09-30T22:32:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.374+0000 7f3154d3d700 1 -- 172.21.15.59:0/3821994481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009e1d0 msgr2=0x7f3150138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.374+0000 7f3154d3d700 1 --2- 172.21.15.59:0/3821994481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009e1d0 0x7f3150138c30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f31440098a0 tx=0x7f3144009bb0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.374+0000 7f3154d3d700 1 -- 172.21.15.59:0/3821994481 shutdown_connections 2023-09-30T22:32:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.374+0000 7f3154d3d700 1 --2- 172.21.15.59:0/3821994481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3150139170 0x7f315013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.374+0000 7f3154d3d700 1 --2- 172.21.15.59:0/3821994481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009e1d0 0x7f3150138c30 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.374+0000 7f3154d3d700 1 -- 172.21.15.59:0/3821994481 >> 172.21.15.59:0/3821994481 conn(0x7f3150066f50 msgr2=0x7f315009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.374+0000 7f3154d3d700 1 -- 172.21.15.59:0/3821994481 shutdown_connections 2023-09-30T22:32:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.374+0000 7f3154d3d700 1 -- 172.21.15.59:0/3821994481 wait complete. 2023-09-30T22:32:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.375+0000 7f3154d3d700 1 Processor -- start 2023-09-30T22:32:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.375+0000 7f3154d3d700 1 -- start start 2023-09-30T22:32:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.376+0000 7f3154d3d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009d6f0 0x7f315011f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.376+0000 7f3154d3d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315009e1d0 0x7f315011f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.376+0000 7f3154d3d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3150139170 0x7f31501c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.376+0000 7f3154d3d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315011ef40 con 0x7f315009e1d0 2023-09-30T22:32:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.376+0000 7f3154d3d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3150120620 con 0x7f3150139170 2023-09-30T22:32:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.376+0000 7f3154d3d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3150121f90 con 0x7f315009d6f0 2023-09-30T22:32:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.376+0000 7f314e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009d6f0 0x7f315011f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.376+0000 7f314e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009d6f0 0x7f315011f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50888/0 (socket says 172.21.15.59:50888) 2023-09-30T22:32:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.376+0000 7f314e59c700 1 -- 172.21.15.59:0/4148906746 learned_addr learned my addr 172.21.15.59:0/4148906746 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.376+0000 7f314ed9d700 1 --2- 172.21.15.59:0/4148906746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3150139170 0x7f31501c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.376+0000 7f314dd9b700 1 --2- 172.21.15.59:0/4148906746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315009e1d0 0x7f315011f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.377+0000 7f314ed9d700 1 -- 172.21.15.59:0/4148906746 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009d6f0 msgr2=0x7f315011f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.377+0000 7f314ed9d700 1 --2- 172.21.15.59:0/4148906746 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009d6f0 0x7f315011f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.377+0000 7f314ed9d700 1 -- 172.21.15.59:0/4148906746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315009e1d0 msgr2=0x7f315011f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.377+0000 7f314ed9d700 1 --2- 172.21.15.59:0/4148906746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315009e1d0 0x7f315011f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.377+0000 7f314ed9d700 1 -- 172.21.15.59:0/4148906746 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31440094a0 con 0x7f3150139170 2023-09-30T22:32:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.377+0000 7f314ed9d700 1 --2- 172.21.15.59:0/4148906746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3150139170 0x7f31501c83d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f314800efc0 tx=0x7f314800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.377+0000 7f313effd700 1 -- 172.21.15.59:0/4148906746 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800cc90 con 0x7f3150139170 2023-09-30T22:32:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.377+0000 7f313effd700 1 -- 172.21.15.59:0/4148906746 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314800f040 con 0x7f3150139170 2023-09-30T22:32:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.377+0000 7f313effd700 1 -- 172.21.15.59:0/4148906746 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148009e60 con 0x7f3150139170 2023-09-30T22:32:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.377+0000 7f3154d3d700 1 -- 172.21.15.59:0/4148906746 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31500a20b0 con 0x7f3150139170 2023-09-30T22:32:47.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.377+0000 7f3154d3d700 1 -- 172.21.15.59:0/4148906746 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315011fe40 con 0x7f3150139170 2023-09-30T22:32:47.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.378+0000 7f313effd700 1 -- 172.21.15.59:0/4148906746 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3148014480 con 0x7f3150139170 2023-09-30T22:32:47.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.378+0000 7f313effd700 1 -- 172.21.15.59:0/4148906746 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f31480401b0 con 0x7f3150139170 2023-09-30T22:32:47.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.379+0000 7f3154d3d700 1 -- 172.21.15.59:0/4148906746 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3150074ea0 con 0x7f3150139170 2023-09-30T22:32:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.384+0000 7f313effd700 1 -- 172.21.15.59:0/4148906746 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3148007920 con 0x7f3150139170 2023-09-30T22:32:47.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.405+0000 7faf5620e700 1 Processor -- start 2023-09-30T22:32:47.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.405+0000 7faf5620e700 1 -- start start 2023-09-30T22:32:47.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.405+0000 7faf5620e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf5009d630 0x7faf500a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.405+0000 7faf5620e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf50138d80 0x7faf5013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.405+0000 7faf5620e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf500a2a70 con 0x7faf500a0a30 2023-09-30T22:32:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.405+0000 7faf5620e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf500a01d0 con 0x7faf50138d80 2023-09-30T22:32:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.405+0000 7faf5620e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5009e2b0 con 0x7faf5009d630 2023-09-30T22:32:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.405+0000 7faf4f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faf500a0a30 0x7faf500a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57970/0 (socket says 172.21.15.59:57970) 2023-09-30T22:32:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.405+0000 7faf4f7fe700 1 -- 172.21.15.59:0/3843363773 learned_addr learned my addr 172.21.15.59:0/3843363773 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.405+0000 7faf4ffff700 1 --2- 172.21.15.59:0/3843363773 >> v2:172.21.15.59:3300/0 conn(0x7faf50138d80 0x7faf5013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.405+0000 7faf4effd700 1 --2- 172.21.15.59:0/3843363773 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf5009d630 0x7faf500a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.406+0000 7faf4ffff700 1 -- 172.21.15.59:0/3843363773 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf5009d630 msgr2=0x7faf500a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.406+0000 7faf4ffff700 1 --2- 172.21.15.59:0/3843363773 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf5009d630 0x7faf500a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.406+0000 7faf4ffff700 1 -- 172.21.15.59:0/3843363773 >> v1:172.21.15.59:6789/0 conn(0x7faf500a0a30 legacy=0x7faf500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.406+0000 7faf4ffff700 1 -- 172.21.15.59:0/3843363773 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5009dc50 con 0x7faf50138d80 2023-09-30T22:32:47.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.406+0000 7faf4ffff700 1 --2- 172.21.15.59:0/3843363773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf50138d80 0x7faf5013b160 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7faf48009d90 tx=0x7faf4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5baaeb22f5bdcfb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:47.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.406+0000 7faf4e7fc700 1 -- 172.21.15.59:0/3843363773 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4800e070 con 0x7faf50138d80 2023-09-30T22:32:47.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.406+0000 7faf4e7fc700 1 -- 172.21.15.59:0/3843363773 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf48003a20 con 0x7faf50138d80 2023-09-30T22:32:47.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.406+0000 7faf4e7fc700 1 -- 172.21.15.59:0/3843363773 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48003dd0 con 0x7faf50138d80 2023-09-30T22:32:47.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.407+0000 7faf5620e700 1 -- 172.21.15.59:0/3843363773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf50138d80 msgr2=0x7faf5013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.407+0000 7faf5620e700 1 --2- 172.21.15.59:0/3843363773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf50138d80 0x7faf5013b160 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7faf48009d90 tx=0x7faf4800b330 comp rx=0 tx=0).stop 2023-09-30T22:32:47.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.407+0000 7faf5620e700 1 -- 172.21.15.59:0/3843363773 shutdown_connections 2023-09-30T22:32:47.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.407+0000 7faf5620e700 1 --2- 172.21.15.59:0/3843363773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf50138d80 0x7faf5013b160 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.407+0000 7faf5620e700 1 --2- 172.21.15.59:0/3843363773 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf5009d630 0x7faf500a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.407+0000 7faf5620e700 1 -- 172.21.15.59:0/3843363773 >> 172.21.15.59:0/3843363773 conn(0x7faf500a3050 msgr2=0x7faf500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:47.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.407+0000 7faf5620e700 1 -- 172.21.15.59:0/3843363773 shutdown_connections 2023-09-30T22:32:47.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.407+0000 7faf5620e700 1 -- 172.21.15.59:0/3843363773 wait complete. 2023-09-30T22:32:47.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.408+0000 7faf5620e700 1 Processor -- start 2023-09-30T22:32:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.408+0000 7faf5620e700 1 -- start start 2023-09-30T22:32:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.409+0000 7faf5620e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf5009d630 0x7faf501338c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.409+0000 7faf5620e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf500a0a30 0x7faf50133e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.409+0000 7faf5620e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf50138d80 0x7faf50134340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.409+0000 7faf5620e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf50136db0 con 0x7faf500a0a30 2023-09-30T22:32:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.409+0000 7faf5620e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf50137070 con 0x7faf50138d80 2023-09-30T22:32:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.409+0000 7faf5620e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf500a4c40 con 0x7faf5009d630 2023-09-30T22:32:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.409+0000 7faf4f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf5009d630 0x7faf501338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.409+0000 7faf4f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf5009d630 0x7faf501338c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50898/0 (socket says 172.21.15.59:50898) 2023-09-30T22:32:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.409+0000 7faf4f7fe700 1 -- 172.21.15.59:0/2121632793 learned_addr learned my addr 172.21.15.59:0/2121632793 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.409+0000 7faf4effd700 1 --2- 172.21.15.59:0/2121632793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf500a0a30 0x7faf50133e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.410+0000 7faf4f7fe700 1 -- 172.21.15.59:0/2121632793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf50138d80 msgr2=0x7faf50134340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:32:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.410+0000 7faf4f7fe700 1 --2- 172.21.15.59:0/2121632793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf50138d80 0x7faf50134340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.410+0000 7faf4f7fe700 1 -- 172.21.15.59:0/2121632793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf500a0a30 msgr2=0x7faf50133e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.410+0000 7faf4f7fe700 1 --2- 172.21.15.59:0/2121632793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf500a0a30 0x7faf50133e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.410+0000 7faf4f7fe700 1 -- 172.21.15.59:0/2121632793 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf48009a70 con 0x7faf5009d630 2023-09-30T22:32:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.410+0000 7faf4effd700 1 --2- 172.21.15.59:0/2121632793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf500a0a30 0x7faf50133e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.410+0000 7faf4f7fe700 1 --2- 172.21.15.59:0/2121632793 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf5009d630 0x7faf501338c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7faf4000c780 tx=0x7faf4000ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.410+0000 7faf37fff700 1 -- 172.21.15.59:0/2121632793 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf40004c80 con 0x7faf5009d630 2023-09-30T22:32:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.410+0000 7faf37fff700 1 -- 172.21.15.59:0/2121632793 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf40004de0 con 0x7faf5009d630 2023-09-30T22:32:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.410+0000 7faf37fff700 1 -- 172.21.15.59:0/2121632793 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf40007310 con 0x7faf5009d630 2023-09-30T22:32:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.410+0000 7faf5620e700 1 -- 172.21.15.59:0/2121632793 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf500a0410 con 0x7faf5009d630 2023-09-30T22:32:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.410+0000 7faf5620e700 1 -- 172.21.15.59:0/2121632793 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf50135aa0 con 0x7faf5009d630 2023-09-30T22:32:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.411+0000 7faf37fff700 1 -- 172.21.15.59:0/2121632793 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf40007470 con 0x7faf5009d630 2023-09-30T22:32:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.412+0000 7faf5620e700 1 -- 172.21.15.59:0/2121632793 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf500747f0 con 0x7faf5009d630 2023-09-30T22:32:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.412+0000 7faf37fff700 1 -- 172.21.15.59:0/2121632793 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faf4003e830 con 0x7faf5009d630 2023-09-30T22:32:47.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.417+0000 7faf37fff700 1 -- 172.21.15.59:0/2121632793 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf40007720 con 0x7faf5009d630 2023-09-30T22:32:47.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.577+0000 7f9eb9395700 1 -- 172.21.15.59:0/3011805381 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9eb4074ea0 con 0x7f9eb409f240 2023-09-30T22:32:47.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.578+0000 7f9e9b7fe700 1 -- 172.21.15.59:0/3011805381 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ea800b9d0 con 0x7f9eb409f240 2023-09-30T22:32:47.579 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:47.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.580+0000 7f9eb9395700 1 -- 172.21.15.59:0/3011805381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb409f240 msgr2=0x7f9eb411f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.580+0000 7f9eb9395700 1 --2- 172.21.15.59:0/3011805381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb409f240 0x7f9eb411f790 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8016000 tx=0x7f9ea8004750 comp rx=0 tx=0).stop 2023-09-30T22:32:47.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.580+0000 7f9eb9395700 1 -- 172.21.15.59:0/3011805381 shutdown_connections 2023-09-30T22:32:47.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.580+0000 7f9eb9395700 1 --2- 172.21.15.59:0/3011805381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9eb409e930 0x7f9eb411f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.580+0000 7f9eb9395700 1 --2- 172.21.15.59:0/3011805381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb409f650 0x7f9eb411fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.580+0000 7f9eb9395700 1 --2- 172.21.15.59:0/3011805381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb409f240 0x7f9eb411f790 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.580+0000 7f9eb9395700 1 -- 172.21.15.59:0/3011805381 >> 172.21.15.59:0/3011805381 conn(0x7f9eb40a4210 msgr2=0x7f9eb406c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:47.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.581+0000 7f9eb9395700 1 -- 172.21.15.59:0/3011805381 shutdown_connections 2023-09-30T22:32:47.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.581+0000 7f9eb9395700 1 -- 172.21.15.59:0/3011805381 wait complete. 2023-09-30T22:32:47.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:47.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.609+0000 7f3154d3d700 1 -- 172.21.15.59:0/4148906746 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3150071e90 con 0x7f3150139170 2023-09-30T22:32:47.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.609+0000 7f313effd700 1 -- 172.21.15.59:0/4148906746 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f314802a020 con 0x7f3150139170 2023-09-30T22:32:47.611 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:47.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.612+0000 7f3154d3d700 1 -- 172.21.15.59:0/4148906746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3150139170 msgr2=0x7f31501c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.612+0000 7f3154d3d700 1 --2- 172.21.15.59:0/4148906746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3150139170 0x7f31501c83d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f314800efc0 tx=0x7f314800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.612+0000 7f3154d3d700 1 -- 172.21.15.59:0/4148906746 shutdown_connections 2023-09-30T22:32:47.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.612+0000 7f3154d3d700 1 --2- 172.21.15.59:0/4148906746 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009d6f0 0x7f315011f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.612+0000 7f3154d3d700 1 --2- 172.21.15.59:0/4148906746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3150139170 0x7f31501c83d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.612+0000 7f3154d3d700 1 --2- 172.21.15.59:0/4148906746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315009e1d0 0x7f315011f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.612+0000 7f3154d3d700 1 -- 172.21.15.59:0/4148906746 >> 172.21.15.59:0/4148906746 conn(0x7f3150066f50 msgr2=0x7f3150136c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:47.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.612+0000 7f3154d3d700 1 -- 172.21.15.59:0/4148906746 shutdown_connections 2023-09-30T22:32:47.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.612+0000 7f3154d3d700 1 -- 172.21.15.59:0/4148906746 wait complete. 2023-09-30T22:32:47.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.618+0000 7ffa266cb700 1 -- 172.21.15.59:0/221329105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa201a8e00 con 0x7ffa2009d6f0 2023-09-30T22:32:47.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.618+0000 7ffa1cff9700 1 -- 172.21.15.59:0/221329105 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa100233d0 con 0x7ffa2009d6f0 2023-09-30T22:32:47.619 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.621+0000 7ffa266cb700 1 -- 172.21.15.59:0/221329105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009d6f0 msgr2=0x7ffa201a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.621+0000 7ffa266cb700 1 --2- 172.21.15.59:0/221329105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009d6f0 0x7ffa201a5ed0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009fd0 tx=0x7ffa10004750 comp rx=0 tx=0).stop 2023-09-30T22:32:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.621+0000 7ffa266cb700 1 -- 172.21.15.59:0/221329105 shutdown_connections 2023-09-30T22:32:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.621+0000 7ffa266cb700 1 --2- 172.21.15.59:0/221329105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa2009e410 0x7ffa201a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.621+0000 7ffa266cb700 1 --2- 172.21.15.59:0/221329105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2009d6f0 0x7ffa201a5ed0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.621+0000 7ffa266cb700 1 --2- 172.21.15.59:0/221329105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa2009e000 0x7ffa201a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.621+0000 7ffa266cb700 1 -- 172.21.15.59:0/221329105 >> 172.21.15.59:0/221329105 conn(0x7ffa20066f50 msgr2=0x7ffa200a36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.621+0000 7ffa266cb700 1 -- 172.21.15.59:0/221329105 shutdown_connections 2023-09-30T22:32:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.621+0000 7ffa266cb700 1 -- 172.21.15.59:0/221329105 wait complete. 2023-09-30T22:32:47.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:47.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.628+0000 7faf5620e700 1 -- 172.21.15.59:0/2121632793 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faf50072980 con 0x7faf5009d630 2023-09-30T22:32:47.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.628+0000 7faf37fff700 1 -- 172.21.15.59:0/2121632793 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf40018020 con 0x7faf5009d630 2023-09-30T22:32:47.630 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.631+0000 7faf5620e700 1 -- 172.21.15.59:0/2121632793 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf5009d630 msgr2=0x7faf501338c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.631+0000 7faf5620e700 1 --2- 172.21.15.59:0/2121632793 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf5009d630 0x7faf501338c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7faf4000c780 tx=0x7faf4000ca90 comp rx=0 tx=0).stop 2023-09-30T22:32:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.631+0000 7faf5620e700 1 -- 172.21.15.59:0/2121632793 shutdown_connections 2023-09-30T22:32:47.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.631+0000 7faf5620e700 1 --2- 172.21.15.59:0/2121632793 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf5009d630 0x7faf501338c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.631+0000 7faf5620e700 1 --2- 172.21.15.59:0/2121632793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf50138d80 0x7faf50134340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.631+0000 7faf5620e700 1 --2- 172.21.15.59:0/2121632793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf500a0a30 0x7faf50133e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:47.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.631+0000 7faf5620e700 1 -- 172.21.15.59:0/2121632793 >> 172.21.15.59:0/2121632793 conn(0x7faf500a3050 msgr2=0x7faf5009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:47.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.631+0000 7faf5620e700 1 -- 172.21.15.59:0/2121632793 shutdown_connections 2023-09-30T22:32:47.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:47.631+0000 7faf5620e700 1 -- 172.21.15.59:0/2121632793 wait complete. 2023-09-30T22:32:47.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:47.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:48.597 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:48.628 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:48.638 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:48.647 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:48.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.750+0000 7fba9205b700 1 Processor -- start 2023-09-30T22:32:48.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.750+0000 7fba9205b700 1 -- start start 2023-09-30T22:32:48.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.750+0000 7fba9205b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba8c0a1510 0x7fba8c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.750+0000 7fba9205b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba8c139250 0x7fba8c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.750+0000 7fba9205b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8c09edd0 con 0x7fba8c0a0a30 2023-09-30T22:32:48.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.750+0000 7fba9205b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c0a18e0 con 0x7fba8c0a1510 2023-09-30T22:32:48.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.750+0000 7fba9205b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c09e1f0 con 0x7fba8c139250 2023-09-30T22:32:48.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.750+0000 7fba8b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fba8c0a0a30 0x7fba8c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57982/0 (socket says 172.21.15.59:57982) 2023-09-30T22:32:48.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.750+0000 7fba8b7fe700 1 -- 172.21.15.59:0/2732857903 learned_addr learned my addr 172.21.15.59:0/2732857903 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:48.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.751+0000 7fba8bfff700 1 --2- 172.21.15.59:0/2732857903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba8c139250 0x7fba8c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.751+0000 7fba8affd700 1 --2- 172.21.15.59:0/2732857903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba8c0a1510 0x7fba8c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.751+0000 7fba8bfff700 1 -- 172.21.15.59:0/2732857903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba8c0a1510 msgr2=0x7fba8c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:48.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.751+0000 7fba8bfff700 1 --2- 172.21.15.59:0/2732857903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba8c0a1510 0x7fba8c138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.751+0000 7fba8bfff700 1 -- 172.21.15.59:0/2732857903 >> v1:172.21.15.59:6789/0 conn(0x7fba8c0a0a30 legacy=0x7fba8c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:48.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.751+0000 7fba8bfff700 1 -- 172.21.15.59:0/2732857903 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c09dc50 con 0x7fba8c139250 2023-09-30T22:32:48.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.751+0000 7fba8bfff700 1 --2- 172.21.15.59:0/2732857903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba8c139250 0x7fba8c13b630 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fba84009dc0 tx=0x7fba8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=514afaf5de19c718 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:48.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.751+0000 7fba8a7fc700 1 -- 172.21.15.59:0/2732857903 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8400e070 con 0x7fba8c139250 2023-09-30T22:32:48.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.751+0000 7fba8a7fc700 1 -- 172.21.15.59:0/2732857903 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8400bb20 con 0x7fba8c139250 2023-09-30T22:32:48.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.751+0000 7fba8a7fc700 1 -- 172.21.15.59:0/2732857903 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84012430 con 0x7fba8c139250 2023-09-30T22:32:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.752+0000 7fba9205b700 1 -- 172.21.15.59:0/2732857903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba8c139250 msgr2=0x7fba8c13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.752+0000 7fba9205b700 1 --2- 172.21.15.59:0/2732857903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba8c139250 0x7fba8c13b630 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fba84009dc0 tx=0x7fba8400b330 comp rx=0 tx=0).stop 2023-09-30T22:32:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.752+0000 7fba9205b700 1 -- 172.21.15.59:0/2732857903 shutdown_connections 2023-09-30T22:32:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.752+0000 7fba9205b700 1 --2- 172.21.15.59:0/2732857903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba8c139250 0x7fba8c13b630 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.752+0000 7fba9205b700 1 --2- 172.21.15.59:0/2732857903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba8c0a1510 0x7fba8c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.752+0000 7fba9205b700 1 -- 172.21.15.59:0/2732857903 >> 172.21.15.59:0/2732857903 conn(0x7fba8c0a6550 msgr2=0x7fba8c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.752+0000 7fba9205b700 1 -- 172.21.15.59:0/2732857903 shutdown_connections 2023-09-30T22:32:48.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.752+0000 7fba9205b700 1 -- 172.21.15.59:0/2732857903 wait complete. 2023-09-30T22:32:48.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.753+0000 7fba9205b700 1 Processor -- start 2023-09-30T22:32:48.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.754+0000 7fba9205b700 1 -- start start 2023-09-30T22:32:48.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.754+0000 7fba9205b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba8c0a0a30 0x7fba8c122a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.754+0000 7fba9205b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba8c0a1510 0x7fba8c122f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.754+0000 7fba9205b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba8c139250 0x7fba8c123480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.754+0000 7fba9205b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c126170 con 0x7fba8c139250 2023-09-30T22:32:48.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.754+0000 7fba9205b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c0a0220 con 0x7fba8c0a0a30 2023-09-30T22:32:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.754+0000 7fba9205b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c1245e0 con 0x7fba8c0a1510 2023-09-30T22:32:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.754+0000 7fba8b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba8c0a0a30 0x7fba8c122a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.754+0000 7fba8affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba8c0a1510 0x7fba8c122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.754+0000 7fba8b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba8c0a0a30 0x7fba8c122a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48656/0 (socket says 172.21.15.59:48656) 2023-09-30T22:32:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.754+0000 7fba8b7fe700 1 -- 172.21.15.59:0/3437189937 learned_addr learned my addr 172.21.15.59:0/3437189937 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.754+0000 7fba8bfff700 1 --2- 172.21.15.59:0/3437189937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba8c139250 0x7fba8c123480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.755+0000 7fba8affd700 1 -- 172.21.15.59:0/3437189937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba8c0a0a30 msgr2=0x7fba8c122a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.755+0000 7fba8affd700 1 --2- 172.21.15.59:0/3437189937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba8c0a0a30 0x7fba8c122a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.755+0000 7fba8affd700 1 -- 172.21.15.59:0/3437189937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba8c139250 msgr2=0x7fba8c123480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.755+0000 7fba8affd700 1 --2- 172.21.15.59:0/3437189937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba8c139250 0x7fba8c123480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.755+0000 7fba8affd700 1 -- 172.21.15.59:0/3437189937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba84009a70 con 0x7fba8c0a1510 2023-09-30T22:32:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.755+0000 7fba8affd700 1 --2- 172.21.15.59:0/3437189937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba8c0a1510 0x7fba8c122f40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fba8000e930 tx=0x7fba8000ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.755+0000 7fba73fff700 1 -- 172.21.15.59:0/3437189937 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80013680 con 0x7fba8c0a1510 2023-09-30T22:32:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.755+0000 7fba73fff700 1 -- 172.21.15.59:0/3437189937 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba800137e0 con 0x7fba8c0a1510 2023-09-30T22:32:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.755+0000 7fba73fff700 1 -- 172.21.15.59:0/3437189937 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80013b50 con 0x7fba8c0a1510 2023-09-30T22:32:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.755+0000 7fba9205b700 1 -- 172.21.15.59:0/3437189937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c138c20 con 0x7fba8c0a1510 2023-09-30T22:32:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.755+0000 7fba9205b700 1 -- 172.21.15.59:0/3437189937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8c126be0 con 0x7fba8c0a1510 2023-09-30T22:32:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.757+0000 7fba9205b700 1 -- 172.21.15.59:0/3437189937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8c074ea0 con 0x7fba8c0a1510 2023-09-30T22:32:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.757+0000 7fba73fff700 1 -- 172.21.15.59:0/3437189937 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba80013cb0 con 0x7fba8c0a1510 2023-09-30T22:32:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.757+0000 7fba73fff700 1 -- 172.21.15.59:0/3437189937 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fba8003f9c0 con 0x7fba8c0a1510 2023-09-30T22:32:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.766+0000 7fba73fff700 1 -- 172.21.15.59:0/3437189937 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba8001abe0 con 0x7fba8c0a1510 2023-09-30T22:32:48.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.789+0000 7f01c4352700 1 Processor -- start 2023-09-30T22:32:48.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.789+0000 7f01c4352700 1 -- start start 2023-09-30T22:32:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.789+0000 7f01c4352700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01bc0a0a30 0x7f01bc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.789+0000 7f01c4352700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc0a1340 0x7f01bc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c4352700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01bc133fa0 0x7f01bc134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c4352700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01bc09edd0 con 0x7f01bc133fa0 2023-09-30T22:32:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c4352700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc09e1f0 con 0x7f01bc0a1340 2023-09-30T22:32:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c4352700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc09dc50 con 0x7f01bc0a0a30 2023-09-30T22:32:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c20ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01bc0a0a30 0x7f01bc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c20ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01bc0a0a30 0x7f01bc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50924/0 (socket says 172.21.15.59:50924) 2023-09-30T22:32:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c20ee700 1 -- 172.21.15.59:0/921912584 learned_addr learned my addr 172.21.15.59:0/921912584 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c18ed700 1 --2- 172.21.15.59:0/921912584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc0a1340 0x7f01bc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c28ef700 1 --2- 172.21.15.59:0/921912584 >> v2:172.21.15.59:3300/0 conn(0x7f01bc133fa0 0x7f01bc134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c20ee700 1 -- 172.21.15.59:0/921912584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc0a1340 msgr2=0x7f01bc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c20ee700 1 --2- 172.21.15.59:0/921912584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc0a1340 0x7f01bc133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c20ee700 1 -- 172.21.15.59:0/921912584 >> v2:172.21.15.59:3300/0 conn(0x7f01bc133fa0 msgr2=0x7f01bc134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c20ee700 1 --2- 172.21.15.59:0/921912584 >> v2:172.21.15.59:3300/0 conn(0x7f01bc133fa0 0x7f01bc134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c20ee700 1 -- 172.21.15.59:0/921912584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc0a1fe0 con 0x7f01bc0a0a30 2023-09-30T22:32:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c28ef700 1 --2- 172.21.15.59:0/921912584 >> v2:172.21.15.59:3300/0 conn(0x7f01bc133fa0 0x7f01bc134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:48.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.790+0000 7f01c20ee700 1 --2- 172.21.15.59:0/921912584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01bc0a0a30 0x7f01bc0a0e00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f01b80098f0 tx=0x7f01b8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48900c682ffe1f17 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:48.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.791+0000 7f01c10ec700 1 -- 172.21.15.59:0/921912584 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b800b8a0 con 0x7f01bc0a0a30 2023-09-30T22:32:48.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.791+0000 7f01c10ec700 1 -- 172.21.15.59:0/921912584 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b800ba00 con 0x7f01bc0a0a30 2023-09-30T22:32:48.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.791+0000 7f01c10ec700 1 -- 172.21.15.59:0/921912584 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b800bd90 con 0x7f01bc0a0a30 2023-09-30T22:32:48.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.792+0000 7f01c4352700 1 -- 172.21.15.59:0/921912584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01bc0a0a30 msgr2=0x7f01bc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:48.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.792+0000 7f01c4352700 1 --2- 172.21.15.59:0/921912584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01bc0a0a30 0x7f01bc0a0e00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f01b80098f0 tx=0x7f01b8009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:48.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.792+0000 7f01c4352700 1 -- 172.21.15.59:0/921912584 shutdown_connections 2023-09-30T22:32:48.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.792+0000 7f01c4352700 1 --2- 172.21.15.59:0/921912584 >> v2:172.21.15.59:3300/0 conn(0x7f01bc133fa0 0x7f01bc134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.792+0000 7f01c4352700 1 --2- 172.21.15.59:0/921912584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01bc0a0a30 0x7f01bc0a0e00 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.792+0000 7f01c4352700 1 --2- 172.21.15.59:0/921912584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc0a1340 0x7f01bc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.792+0000 7f01c4352700 1 -- 172.21.15.59:0/921912584 >> 172.21.15.59:0/921912584 conn(0x7f01bc0a6550 msgr2=0x7f01bc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.792+0000 7f01c4352700 1 -- 172.21.15.59:0/921912584 shutdown_connections 2023-09-30T22:32:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.792+0000 7f01c4352700 1 -- 172.21.15.59:0/921912584 wait complete. 2023-09-30T22:32:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.793+0000 7f01c4352700 1 Processor -- start 2023-09-30T22:32:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.794+0000 7f01c4352700 1 -- start start 2023-09-30T22:32:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.794+0000 7f01c4352700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01bc0a0a30 0x7f01bc1c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.794+0000 7f01c4352700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01bc0a1340 0x7f01bc1c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.794+0000 7f01c4352700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc133fa0 0x7f01bc1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.794+0000 7f01c4352700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc11fc80 con 0x7f01bc0a1340 2023-09-30T22:32:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.794+0000 7f01c4352700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc11fa90 con 0x7f01bc133fa0 2023-09-30T22:32:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.794+0000 7f01c4352700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0a36e0 con 0x7f01bc0a0a30 2023-09-30T22:32:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.795+0000 7f01c20ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01bc0a0a30 0x7f01bc1c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.795+0000 7f01c20ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01bc0a0a30 0x7f01bc1c5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50940/0 (socket says 172.21.15.59:50940) 2023-09-30T22:32:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.795+0000 7f01c28ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc133fa0 0x7f01bc1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.795+0000 7f01c20ee700 1 -- 172.21.15.59:0/2820441278 learned_addr learned my addr 172.21.15.59:0/2820441278 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.795+0000 7f01c18ed700 1 --2- 172.21.15.59:0/2820441278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01bc0a1340 0x7f01bc1c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.795+0000 7f01c28ef700 1 -- 172.21.15.59:0/2820441278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01bc0a0a30 msgr2=0x7f01bc1c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.795+0000 7f01c28ef700 1 --2- 172.21.15.59:0/2820441278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01bc0a0a30 0x7f01bc1c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.795+0000 7f01c28ef700 1 -- 172.21.15.59:0/2820441278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01bc0a1340 msgr2=0x7f01bc1c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.795+0000 7f01c28ef700 1 --2- 172.21.15.59:0/2820441278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01bc0a1340 0x7f01bc1c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.795+0000 7f01c28ef700 1 -- 172.21.15.59:0/2820441278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b8009550 con 0x7f01bc133fa0 2023-09-30T22:32:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.795+0000 7f01c18ed700 1 --2- 172.21.15.59:0/2820441278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01bc0a1340 0x7f01bc1c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.795+0000 7f01c28ef700 1 --2- 172.21.15.59:0/2820441278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc133fa0 0x7f01bc1c8200 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f01b400cdf0 tx=0x7f01b400ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.796+0000 7f01b2ffd700 1 -- 172.21.15.59:0/2820441278 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b400ac80 con 0x7f01bc133fa0 2023-09-30T22:32:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.796+0000 7f01b2ffd700 1 -- 172.21.15.59:0/2820441278 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b400ade0 con 0x7f01bc133fa0 2023-09-30T22:32:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.796+0000 7f01c4352700 1 -- 172.21.15.59:0/2820441278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01bc1219a0 con 0x7f01bc133fa0 2023-09-30T22:32:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.796+0000 7f01b2ffd700 1 -- 172.21.15.59:0/2820441278 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4015680 con 0x7f01bc133fa0 2023-09-30T22:32:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.796+0000 7f01c4352700 1 -- 172.21.15.59:0/2820441278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01bc0a0270 con 0x7f01bc133fa0 2023-09-30T22:32:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.797+0000 7f01c4352700 1 -- 172.21.15.59:0/2820441278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01bc074ea0 con 0x7f01bc133fa0 2023-09-30T22:32:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.798+0000 7f01b2ffd700 1 -- 172.21.15.59:0/2820441278 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01b400d430 con 0x7f01bc133fa0 2023-09-30T22:32:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.798+0000 7f01b2ffd700 1 -- 172.21.15.59:0/2820441278 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f01b403fe70 con 0x7f01bc133fa0 2023-09-30T22:32:48.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.802+0000 7fb6b09f2700 1 Processor -- start 2023-09-30T22:32:48.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.802+0000 7fb6b09f2700 1 -- start start 2023-09-30T22:32:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.803+0000 7fb6b09f2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6ac09e930 0x7fb6ac09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.803+0000 7fb6b09f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09f240 0x7fb6ac1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.803+0000 7fb6b09f2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac070940 con 0x7fb6ac09f650 2023-09-30T22:32:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.803+0000 7fb6b09f2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ac06fd60 con 0x7fb6ac09e930 2023-09-30T22:32:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.803+0000 7fb6b09f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac06fa80 con 0x7fb6ac09f240 2023-09-30T22:32:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.803+0000 7fb6a9d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09f240 0x7fb6ac1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.803+0000 7fb6aa59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6ac09e930 0x7fb6ac09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.803+0000 7fb6a9d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09f240 0x7fb6ac1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48694/0 (socket says 172.21.15.59:48694) 2023-09-30T22:32:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.803+0000 7fb6aa59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6ac09e930 0x7fb6ac09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41578/0 (socket says 172.21.15.59:41578) 2023-09-30T22:32:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.803+0000 7fb6a9d9b700 1 -- 172.21.15.59:0/2207264692 learned_addr learned my addr 172.21.15.59:0/2207264692 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.803+0000 7fb6a9d9b700 1 -- 172.21.15.59:0/2207264692 >> v2:172.21.15.59:3300/0 conn(0x7fb6ac09e930 msgr2=0x7fb6ac09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.803+0000 7fb6a9d9b700 1 --2- 172.21.15.59:0/2207264692 >> v2:172.21.15.59:3300/0 conn(0x7fb6ac09e930 0x7fb6ac09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.803+0000 7fb6a9d9b700 1 -- 172.21.15.59:0/2207264692 >> v1:172.21.15.59:6789/0 conn(0x7fb6ac09f650 legacy=0x7fb6ac131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.803+0000 7fb6a9d9b700 1 -- 172.21.15.59:0/2207264692 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac09fb60 con 0x7fb6ac09f240 2023-09-30T22:32:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.804+0000 7fb6a9d9b700 1 --2- 172.21.15.59:0/2207264692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09f240 0x7fb6ac1317f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00098f0 tx=0x7fb6a0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d61ffa54425b060e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:48.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.806+0000 7fb6a959a700 1 -- 172.21.15.59:0/2207264692 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0011830 con 0x7fb6ac09f240 2023-09-30T22:32:48.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.806+0000 7fb6a959a700 1 -- 172.21.15.59:0/2207264692 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a0011990 con 0x7fb6ac09f240 2023-09-30T22:32:48.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.806+0000 7fb6a959a700 1 -- 172.21.15.59:0/2207264692 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0011d20 con 0x7fb6ac09f240 2023-09-30T22:32:48.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.807+0000 7f01b2ffd700 1 -- 172.21.15.59:0/2820441278 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01b401e3b0 con 0x7f01bc133fa0 2023-09-30T22:32:48.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.807+0000 7fb6b09f2700 1 -- 172.21.15.59:0/2207264692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09f240 msgr2=0x7fb6ac1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:48.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.807+0000 7fb6b09f2700 1 --2- 172.21.15.59:0/2207264692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09f240 0x7fb6ac1317f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00098f0 tx=0x7fb6a0009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:48.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.807+0000 7fb6b09f2700 1 -- 172.21.15.59:0/2207264692 shutdown_connections 2023-09-30T22:32:48.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.807+0000 7fb6b09f2700 1 --2- 172.21.15.59:0/2207264692 >> v2:172.21.15.59:3300/0 conn(0x7fb6ac09e930 0x7fb6ac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.807+0000 7fb6b09f2700 1 --2- 172.21.15.59:0/2207264692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09f240 0x7fb6ac1317f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.807+0000 7fb6b09f2700 1 -- 172.21.15.59:0/2207264692 >> 172.21.15.59:0/2207264692 conn(0x7fb6ac0a4210 msgr2=0x7fb6ac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:48.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.808+0000 7fb6b09f2700 1 -- 172.21.15.59:0/2207264692 shutdown_connections 2023-09-30T22:32:48.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.808+0000 7fb6b09f2700 1 -- 172.21.15.59:0/2207264692 wait complete. 2023-09-30T22:32:48.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.809+0000 7fb6b09f2700 1 Processor -- start 2023-09-30T22:32:48.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.809+0000 7fb6b09f2700 1 -- start start 2023-09-30T22:32:48.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.810+0000 7fb6b09f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09e930 0x7fb6ac1a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.810+0000 7fb6b09f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac09f240 0x7fb6ac1a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.810+0000 7fb6b09f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac09f650 0x7fb6ac1c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.810+0000 7fb6b09f2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac1b4ef0 con 0x7fb6ac09f240 2023-09-30T22:32:48.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.810+0000 7fb6b09f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac1a0a40 con 0x7fb6ac09e930 2023-09-30T22:32:48.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.810+0000 7fb6b09f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac1a2170 con 0x7fb6ac09f650 2023-09-30T22:32:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.810+0000 7fb6aad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac09f650 0x7fb6ac1c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.810+0000 7fb6aa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09e930 0x7fb6ac1a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.810+0000 7fb6aa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09e930 0x7fb6ac1a0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48696/0 (socket says 172.21.15.59:48696) 2023-09-30T22:32:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.810+0000 7fb6aa59c700 1 -- 172.21.15.59:0/3080137840 learned_addr learned my addr 172.21.15.59:0/3080137840 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.810+0000 7fb6aad9d700 1 --2- 172.21.15.59:0/3080137840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac09f650 0x7fb6ac1c3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50952/0 (socket says 172.21.15.59:50952) 2023-09-30T22:32:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.810+0000 7fb6a9d9b700 1 --2- 172.21.15.59:0/3080137840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac09f240 0x7fb6ac1a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.811+0000 7fb6aa59c700 1 -- 172.21.15.59:0/3080137840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac09f650 msgr2=0x7fb6ac1c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.811+0000 7fb6aa59c700 1 --2- 172.21.15.59:0/3080137840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac09f650 0x7fb6ac1c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.811+0000 7fb6aa59c700 1 -- 172.21.15.59:0/3080137840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac09f240 msgr2=0x7fb6ac1a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.811+0000 7fb6aa59c700 1 --2- 172.21.15.59:0/3080137840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac09f240 0x7fb6ac1a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.811+0000 7fb6aa59c700 1 -- 172.21.15.59:0/3080137840 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a0009550 con 0x7fb6ac09e930 2023-09-30T22:32:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.811+0000 7fb6aa59c700 1 --2- 172.21.15.59:0/3080137840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09e930 0x7fb6ac1a0e30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb69c012fc0 tx=0x7fb69c0100c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.811+0000 7fb69affd700 1 -- 172.21.15.59:0/3080137840 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c00dbb0 con 0x7fb6ac09e930 2023-09-30T22:32:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.811+0000 7fb69affd700 1 -- 172.21.15.59:0/3080137840 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c013040 con 0x7fb6ac09e930 2023-09-30T22:32:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.811+0000 7fb6b09f2700 1 -- 172.21.15.59:0/3080137840 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac0a0190 con 0x7fb6ac09e930 2023-09-30T22:32:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.811+0000 7fb69affd700 1 -- 172.21.15.59:0/3080137840 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c010b40 con 0x7fb6ac09e930 2023-09-30T22:32:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.811+0000 7fb6b09f2700 1 -- 172.21.15.59:0/3080137840 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac071d20 con 0x7fb6ac09e930 2023-09-30T22:32:48.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.812+0000 7fb69affd700 1 -- 172.21.15.59:0/3080137840 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb69c010ca0 con 0x7fb6ac09e930 2023-09-30T22:32:48.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.813+0000 7fb69affd700 1 -- 172.21.15.59:0/3080137840 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb69c0435d0 con 0x7fb6ac09e930 2023-09-30T22:32:48.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.813+0000 7fb6b09f2700 1 -- 172.21.15.59:0/3080137840 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ac074ea0 con 0x7fb6ac09e930 2023-09-30T22:32:48.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.822+0000 7fb69affd700 1 -- 172.21.15.59:0/3080137840 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb69c00b450 con 0x7fb6ac09e930 2023-09-30T22:32:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.838+0000 7f717ce4a700 1 Processor -- start 2023-09-30T22:32:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.838+0000 7f717ce4a700 1 -- start start 2023-09-30T22:32:48.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.839+0000 7f717ce4a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f717809f410 0x7f7178136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.839+0000 7f717ce4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7178136fe0 0x7f71781393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.839+0000 7f717ce4a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7178070940 con 0x7f717809e930 2023-09-30T22:32:48.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.839+0000 7f717ce4a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717806fd60 con 0x7f717809f410 2023-09-30T22:32:48.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.839+0000 7f717ce4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717806fa80 con 0x7f7178136fe0 2023-09-30T22:32:48.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.840+0000 7f7175d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f717809f410 0x7f7178136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.840+0000 7f7175d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f717809f410 0x7f7178136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41598/0 (socket says 172.21.15.59:41598) 2023-09-30T22:32:48.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.840+0000 7f717659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f717809e930 0x7f717809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58000/0 (socket says 172.21.15.59:58000) 2023-09-30T22:32:48.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.840+0000 7f7175d9b700 1 -- 172.21.15.59:0/2935510769 learned_addr learned my addr 172.21.15.59:0/2935510769 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:48.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.840+0000 7f7176d9d700 1 --2- 172.21.15.59:0/2935510769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7178136fe0 0x7f71781393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.840+0000 7f717559a700 1 -- 172.21.15.59:0/2935510769 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541489238 0 0) 0x7f7178070940 con 0x7f717809e930 2023-09-30T22:32:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.840+0000 7f717559a700 1 -- 172.21.15.59:0/2935510769 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71600035b0 con 0x7f717809e930 2023-09-30T22:32:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.840+0000 7f7175d9b700 1 -- 172.21.15.59:0/2935510769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7178136fe0 msgr2=0x7f71781393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.840+0000 7f7175d9b700 1 --2- 172.21.15.59:0/2935510769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7178136fe0 0x7f71781393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.840+0000 7f7175d9b700 1 -- 172.21.15.59:0/2935510769 >> v1:172.21.15.59:6789/0 conn(0x7f717809e930 legacy=0x7f717809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.840+0000 7f7175d9b700 1 -- 172.21.15.59:0/2935510769 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717809fb60 con 0x7f717809f410 2023-09-30T22:32:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.840+0000 7f7176d9d700 1 --2- 172.21.15.59:0/2935510769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7178136fe0 0x7f71781393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.841+0000 7f7175d9b700 1 --2- 172.21.15.59:0/2935510769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809f410 0x7f7178136aa0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f716c0098f0 tx=0x7f716c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f90c06d9256216 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.841+0000 7f717559a700 1 -- 172.21.15.59:0/2935510769 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c011830 con 0x7f717809f410 2023-09-30T22:32:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.841+0000 7f717559a700 1 -- 172.21.15.59:0/2935510769 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c011990 con 0x7f717809f410 2023-09-30T22:32:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.841+0000 7f717559a700 1 -- 172.21.15.59:0/2935510769 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c011d20 con 0x7f717809f410 2023-09-30T22:32:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.843+0000 7f717ce4a700 1 -- 172.21.15.59:0/2935510769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809f410 msgr2=0x7f7178136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.843+0000 7f717ce4a700 1 --2- 172.21.15.59:0/2935510769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809f410 0x7f7178136aa0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f716c0098f0 tx=0x7f716c009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.843+0000 7f717ce4a700 1 -- 172.21.15.59:0/2935510769 shutdown_connections 2023-09-30T22:32:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.843+0000 7f717ce4a700 1 --2- 172.21.15.59:0/2935510769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7178136fe0 0x7f71781393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.843+0000 7f717ce4a700 1 --2- 172.21.15.59:0/2935510769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809f410 0x7f7178136aa0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.843+0000 7f717ce4a700 1 -- 172.21.15.59:0/2935510769 >> 172.21.15.59:0/2935510769 conn(0x7f71780a4210 msgr2=0x7f71780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:48.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.843+0000 7f717ce4a700 1 -- 172.21.15.59:0/2935510769 shutdown_connections 2023-09-30T22:32:48.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.843+0000 7f717ce4a700 1 -- 172.21.15.59:0/2935510769 wait complete. 2023-09-30T22:32:48.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.845+0000 7f717ce4a700 1 Processor -- start 2023-09-30T22:32:48.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.845+0000 7f717ce4a700 1 -- start start 2023-09-30T22:32:48.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.845+0000 7f717ce4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809e930 0x7f717811b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.845+0000 7f717ce4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809f410 0x7f717811b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.846+0000 7f717ce4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7178136fe0 0x7f717811bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:48.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.846+0000 7f717ce4a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717811d4b0 con 0x7f717809e930 2023-09-30T22:32:48.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.846+0000 7f717ce4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7178071d20 con 0x7f717809f410 2023-09-30T22:32:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.846+0000 7f717ce4a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71780a3240 con 0x7f7178136fe0 2023-09-30T22:32:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.846+0000 7f717659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809e930 0x7f717811b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.846+0000 7f717659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809e930 0x7f717811b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41608/0 (socket says 172.21.15.59:41608) 2023-09-30T22:32:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.846+0000 7f717659c700 1 -- 172.21.15.59:0/2422356199 learned_addr learned my addr 172.21.15.59:0/2422356199 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.846+0000 7f7175d9b700 1 --2- 172.21.15.59:0/2422356199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809f410 0x7f717811b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.846+0000 7f7176d9d700 1 --2- 172.21.15.59:0/2422356199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7178136fe0 0x7f717811bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.846+0000 7f7175d9b700 1 -- 172.21.15.59:0/2422356199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7178136fe0 msgr2=0x7f717811bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.846+0000 7f7175d9b700 1 --2- 172.21.15.59:0/2422356199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7178136fe0 0x7f717811bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.846+0000 7f7175d9b700 1 -- 172.21.15.59:0/2422356199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809e930 msgr2=0x7f717811b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.846+0000 7f7175d9b700 1 --2- 172.21.15.59:0/2422356199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809e930 0x7f717811b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.846+0000 7f7175d9b700 1 -- 172.21.15.59:0/2422356199 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717000bc50 con 0x7f717809f410 2023-09-30T22:32:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.846+0000 7f7176d9d700 1 --2- 172.21.15.59:0/2422356199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7178136fe0 0x7f717811bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.847+0000 7f7175d9b700 1 --2- 172.21.15.59:0/2422356199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809f410 0x7f717811b7b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f717806f570 tx=0x7f716c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.847+0000 7f7166ffd700 1 -- 172.21.15.59:0/2422356199 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c0043c0 con 0x7f717809f410 2023-09-30T22:32:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.847+0000 7f7166ffd700 1 -- 172.21.15.59:0/2422356199 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c01f070 con 0x7f717809f410 2023-09-30T22:32:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.847+0000 7f7166ffd700 1 -- 172.21.15.59:0/2422356199 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c0036a0 con 0x7f717809f410 2023-09-30T22:32:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.848+0000 7f717ce4a700 1 -- 172.21.15.59:0/2422356199 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716c009550 con 0x7f717809f410 2023-09-30T22:32:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.848+0000 7f717ce4a700 1 -- 172.21.15.59:0/2422356199 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717811d670 con 0x7f717809f410 2023-09-30T22:32:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.849+0000 7f717ce4a700 1 -- 172.21.15.59:0/2422356199 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7178074ea0 con 0x7f717809f410 2023-09-30T22:32:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.849+0000 7f7166ffd700 1 -- 172.21.15.59:0/2422356199 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f716c021030 con 0x7f717809f410 2023-09-30T22:32:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.849+0000 7f7166ffd700 1 -- 172.21.15.59:0/2422356199 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f716c0408f0 con 0x7f717809f410 2023-09-30T22:32:48.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.859+0000 7f7166ffd700 1 -- 172.21.15.59:0/2422356199 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f716c0199a0 con 0x7f717809f410 2023-09-30T22:32:48.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.995+0000 7fba9205b700 1 -- 172.21.15.59:0/3437189937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fba8c0a28e0 con 0x7fba8c0a1510 2023-09-30T22:32:48.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.996+0000 7fba73fff700 1 -- 172.21.15.59:0/3437189937 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba80017030 con 0x7fba8c0a1510 2023-09-30T22:32:48.998 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.999+0000 7fba9205b700 1 -- 172.21.15.59:0/3437189937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba8c0a1510 msgr2=0x7fba8c122f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.999+0000 7fba9205b700 1 --2- 172.21.15.59:0/3437189937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba8c0a1510 0x7fba8c122f40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fba8000e930 tx=0x7fba8000ec40 comp rx=0 tx=0).stop 2023-09-30T22:32:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.999+0000 7fba9205b700 1 -- 172.21.15.59:0/3437189937 shutdown_connections 2023-09-30T22:32:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.999+0000 7fba9205b700 1 --2- 172.21.15.59:0/3437189937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba8c139250 0x7fba8c123480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.999+0000 7fba9205b700 1 --2- 172.21.15.59:0/3437189937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba8c0a0a30 0x7fba8c122a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.999+0000 7fba9205b700 1 --2- 172.21.15.59:0/3437189937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba8c0a1510 0x7fba8c122f40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:48.999+0000 7fba9205b700 1 -- 172.21.15.59:0/3437189937 >> 172.21.15.59:0/3437189937 conn(0x7fba8c0a6550 msgr2=0x7fba8c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.000+0000 7fba9205b700 1 -- 172.21.15.59:0/3437189937 shutdown_connections 2023-09-30T22:32:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.000+0000 7fba9205b700 1 -- 172.21.15.59:0/3437189937 wait complete. 2023-09-30T22:32:49.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:49.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.023+0000 7f01c4352700 1 -- 172.21.15.59:0/2820441278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f01bc121780 con 0x7f01bc133fa0 2023-09-30T22:32:49.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.023+0000 7f01b2ffd700 1 -- 172.21.15.59:0/2820441278 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f01b401a030 con 0x7f01bc133fa0 2023-09-30T22:32:49.025 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:49.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.026+0000 7f01c4352700 1 -- 172.21.15.59:0/2820441278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc133fa0 msgr2=0x7f01bc1c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:49.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.026+0000 7f01c4352700 1 --2- 172.21.15.59:0/2820441278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc133fa0 0x7f01bc1c8200 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f01b400cdf0 tx=0x7f01b400ce20 comp rx=0 tx=0).stop 2023-09-30T22:32:49.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.026+0000 7f01c4352700 1 -- 172.21.15.59:0/2820441278 shutdown_connections 2023-09-30T22:32:49.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.026+0000 7f01c4352700 1 --2- 172.21.15.59:0/2820441278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01bc0a0a30 0x7f01bc1c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:49.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.026+0000 7f01c4352700 1 --2- 172.21.15.59:0/2820441278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc133fa0 0x7f01bc1c8200 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:49.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.026+0000 7f01c4352700 1 --2- 172.21.15.59:0/2820441278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01bc0a1340 0x7f01bc1c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:49.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.026+0000 7f01c4352700 1 -- 172.21.15.59:0/2820441278 >> 172.21.15.59:0/2820441278 conn(0x7f01bc0a6550 msgr2=0x7f01bc133060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.026+0000 7f01c4352700 1 -- 172.21.15.59:0/2820441278 shutdown_connections 2023-09-30T22:32:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.026+0000 7f01c4352700 1 -- 172.21.15.59:0/2820441278 wait complete. 2023-09-30T22:32:49.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.032+0000 7fb6b09f2700 1 -- 172.21.15.59:0/3080137840 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb6ac1a3fe0 con 0x7fb6ac09e930 2023-09-30T22:32:49.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.032+0000 7fb69affd700 1 -- 172.21.15.59:0/3080137840 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6ac1a3fe0 con 0x7fb6ac09e930 2023-09-30T22:32:49.033 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:49.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.034+0000 7fb6b09f2700 1 -- 172.21.15.59:0/3080137840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09e930 msgr2=0x7fb6ac1a0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:49.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.034+0000 7fb6b09f2700 1 --2- 172.21.15.59:0/3080137840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09e930 0x7fb6ac1a0e30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb69c012fc0 tx=0x7fb69c0100c0 comp rx=0 tx=0).stop 2023-09-30T22:32:49.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.034+0000 7fb6b09f2700 1 -- 172.21.15.59:0/3080137840 shutdown_connections 2023-09-30T22:32:49.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.034+0000 7fb6b09f2700 1 --2- 172.21.15.59:0/3080137840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac09f650 0x7fb6ac1c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.034+0000 7fb6b09f2700 1 --2- 172.21.15.59:0/3080137840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09e930 0x7fb6ac1a0e30 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.034+0000 7fb6b09f2700 1 --2- 172.21.15.59:0/3080137840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac09f240 0x7fb6ac1a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.034+0000 7fb6b09f2700 1 -- 172.21.15.59:0/3080137840 >> 172.21.15.59:0/3080137840 conn(0x7fb6ac0a4210 msgr2=0x7fb6ac06c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.034+0000 7fb6b09f2700 1 -- 172.21.15.59:0/3080137840 shutdown_connections 2023-09-30T22:32:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.034+0000 7fb6b09f2700 1 -- 172.21.15.59:0/3080137840 wait complete. 2023-09-30T22:32:49.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:49.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.074+0000 7f717ce4a700 1 -- 172.21.15.59:0/2422356199 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7178000970 con 0x7f717809f410 2023-09-30T22:32:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.074+0000 7f7166ffd700 1 -- 172.21.15.59:0/2422356199 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f716c015070 con 0x7f717809f410 2023-09-30T22:32:49.075 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.076+0000 7f717ce4a700 1 -- 172.21.15.59:0/2422356199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809f410 msgr2=0x7f717811b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.076+0000 7f717ce4a700 1 --2- 172.21.15.59:0/2422356199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809f410 0x7f717811b7b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f717806f570 tx=0x7f716c004750 comp rx=0 tx=0).stop 2023-09-30T22:32:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.076+0000 7f717ce4a700 1 -- 172.21.15.59:0/2422356199 shutdown_connections 2023-09-30T22:32:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.076+0000 7f717ce4a700 1 --2- 172.21.15.59:0/2422356199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7178136fe0 0x7f717811bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.076+0000 7f717ce4a700 1 --2- 172.21.15.59:0/2422356199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809e930 0x7f717811b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.076+0000 7f717ce4a700 1 --2- 172.21.15.59:0/2422356199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809f410 0x7f717811b7b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.076+0000 7f717ce4a700 1 -- 172.21.15.59:0/2422356199 >> 172.21.15.59:0/2422356199 conn(0x7f71780a4210 msgr2=0x7f717806bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.076+0000 7f717ce4a700 1 -- 172.21.15.59:0/2422356199 shutdown_connections 2023-09-30T22:32:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:49.076+0000 7f717ce4a700 1 -- 172.21.15.59:0/2422356199 wait complete. 2023-09-30T22:32:49.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:50.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:50.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:50.051 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:50.092 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:50.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.183+0000 7f381e255700 1 Processor -- start 2023-09-30T22:32:50.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.183+0000 7f381e255700 1 -- start start 2023-09-30T22:32:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.184+0000 7f381e255700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f381809d6f0 0x7f381809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.184+0000 7f381e255700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f381809e000 0x7f3818130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.184+0000 7f381e255700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381809f130 con 0x7f381809e410 2023-09-30T22:32:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.184+0000 7f381e255700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381809f520 con 0x7f381809e000 2023-09-30T22:32:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.184+0000 7f381e255700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f381809e930 con 0x7f381809d6f0 2023-09-30T22:32:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.184+0000 7f3817fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f381809e410 0x7f3818130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58016/0 (socket says 172.21.15.59:58016) 2023-09-30T22:32:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.185+0000 7f38177fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f381809d6f0 0x7f381809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.185+0000 7f3817fff700 1 -- 172.21.15.59:0/466285036 learned_addr learned my addr 172.21.15.59:0/466285036 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.185+0000 7f3816ffd700 1 --2- 172.21.15.59:0/466285036 >> v2:172.21.15.59:3300/0 conn(0x7f381809e000 0x7f3818130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.185+0000 7f38177fe700 1 -- 172.21.15.59:0/466285036 >> v2:172.21.15.59:3300/0 conn(0x7f381809e000 msgr2=0x7f3818130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.185+0000 7f38177fe700 1 --2- 172.21.15.59:0/466285036 >> v2:172.21.15.59:3300/0 conn(0x7f381809e000 0x7f3818130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.185+0000 7f38177fe700 1 -- 172.21.15.59:0/466285036 >> v1:172.21.15.59:6789/0 conn(0x7f381809e410 legacy=0x7f3818130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.185+0000 7f38177fe700 1 -- 172.21.15.59:0/466285036 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381809b2d0 con 0x7f381809d6f0 2023-09-30T22:32:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.185+0000 7f38177fe700 1 --2- 172.21.15.59:0/466285036 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f381809d6f0 0x7f381809dac0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3808009840 tx=0x7f3808009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d19b616b19c7516c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.185+0000 7f38167fc700 1 -- 172.21.15.59:0/466285036 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808004230 con 0x7f381809d6f0 2023-09-30T22:32:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.185+0000 7f38167fc700 1 -- 172.21.15.59:0/466285036 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3808004390 con 0x7f381809d6f0 2023-09-30T22:32:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.185+0000 7f38167fc700 1 -- 172.21.15.59:0/466285036 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38080036a0 con 0x7f381809d6f0 2023-09-30T22:32:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.186+0000 7f381e255700 1 -- 172.21.15.59:0/466285036 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f381809d6f0 msgr2=0x7f381809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.186+0000 7f381e255700 1 --2- 172.21.15.59:0/466285036 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f381809d6f0 0x7f381809dac0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3808009840 tx=0x7f3808009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.186+0000 7f381e255700 1 -- 172.21.15.59:0/466285036 shutdown_connections 2023-09-30T22:32:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.186+0000 7f381e255700 1 --2- 172.21.15.59:0/466285036 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f381809d6f0 0x7f381809dac0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.186+0000 7f381e255700 1 --2- 172.21.15.59:0/466285036 >> v2:172.21.15.59:3300/0 conn(0x7f381809e000 0x7f3818130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.186+0000 7f381e255700 1 -- 172.21.15.59:0/466285036 >> 172.21.15.59:0/466285036 conn(0x7f3818066f50 msgr2=0x7f381809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.186+0000 7f381e255700 1 -- 172.21.15.59:0/466285036 shutdown_connections 2023-09-30T22:32:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.186+0000 7f381e255700 1 -- 172.21.15.59:0/466285036 wait complete. 2023-09-30T22:32:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.188+0000 7f381e255700 1 Processor -- start 2023-09-30T22:32:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.188+0000 7f381e255700 1 -- start start 2023-09-30T22:32:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.188+0000 7f381e255700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f381809d6f0 0x7f381811e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.188+0000 7f381e255700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f381809e000 0x7f381811e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.188+0000 7f381e255700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f381809e410 0x7f381811eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.189+0000 7f381e255700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381811f530 con 0x7f381809e000 2023-09-30T22:32:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.189+0000 7f381e255700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3818121b80 con 0x7f381809e410 2023-09-30T22:32:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.189+0000 7f381e255700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3818130440 con 0x7f381809d6f0 2023-09-30T22:32:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.189+0000 7f38177fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f381809d6f0 0x7f381811e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.189+0000 7f38177fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f381809d6f0 0x7f381811e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50978/0 (socket says 172.21.15.59:50978) 2023-09-30T22:32:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.189+0000 7f38177fe700 1 -- 172.21.15.59:0/2278597764 learned_addr learned my addr 172.21.15.59:0/2278597764 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.189+0000 7f3816ffd700 1 --2- 172.21.15.59:0/2278597764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f381809e000 0x7f381811e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.189+0000 7f3817fff700 1 --2- 172.21.15.59:0/2278597764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f381809e410 0x7f381811eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.189+0000 7f3816ffd700 1 -- 172.21.15.59:0/2278597764 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f381809d6f0 msgr2=0x7f381811e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.189+0000 7f3816ffd700 1 --2- 172.21.15.59:0/2278597764 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f381809d6f0 0x7f381811e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.189+0000 7f3816ffd700 1 -- 172.21.15.59:0/2278597764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f381809e410 msgr2=0x7f381811eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.189+0000 7f3816ffd700 1 --2- 172.21.15.59:0/2278597764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f381809e410 0x7f381811eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.189+0000 7f3816ffd700 1 -- 172.21.15.59:0/2278597764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38080094a0 con 0x7f381809e000 2023-09-30T22:32:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.189+0000 7f3817fff700 1 --2- 172.21.15.59:0/2278597764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f381809e410 0x7f381811eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.190+0000 7f3816ffd700 1 --2- 172.21.15.59:0/2278597764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f381809e000 0x7f381811e5a0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f380c00e900 tx=0x7f380c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.190+0000 7f37fffff700 1 -- 172.21.15.59:0/2278597764 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c013680 con 0x7f381809e000 2023-09-30T22:32:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.190+0000 7f37fffff700 1 -- 172.21.15.59:0/2278597764 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c0137e0 con 0x7f381809e000 2023-09-30T22:32:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.190+0000 7f37fffff700 1 -- 172.21.15.59:0/2278597764 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c013b50 con 0x7f381809e000 2023-09-30T22:32:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.190+0000 7f381e255700 1 -- 172.21.15.59:0/2278597764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3818120250 con 0x7f381809e000 2023-09-30T22:32:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.190+0000 7f381e255700 1 -- 172.21.15.59:0/2278597764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38181215e0 con 0x7f381809e000 2023-09-30T22:32:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.191+0000 7f381e255700 1 -- 172.21.15.59:0/2278597764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3818120ec0 con 0x7f381809e000 2023-09-30T22:32:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.191+0000 7f37fffff700 1 -- 172.21.15.59:0/2278597764 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f380c013cb0 con 0x7f381809e000 2023-09-30T22:32:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.192+0000 7f37fffff700 1 -- 172.21.15.59:0/2278597764 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f380c03f5e0 con 0x7f381809e000 2023-09-30T22:32:50.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.201+0000 7f37fffff700 1 -- 172.21.15.59:0/2278597764 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f380c01bc30 con 0x7f381809e000 2023-09-30T22:32:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.216+0000 7f8ed8bca700 1 Processor -- start 2023-09-30T22:32:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.216+0000 7f8ed8bca700 1 -- start start 2023-09-30T22:32:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.217+0000 7f8ed8bca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ed41338a0 0x7f8ed4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.217+0000 7f8ed8bca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed409de50 0x7f8ed409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.217+0000 7f8ed8bca700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed406ef30 con 0x7f8ed409e760 2023-09-30T22:32:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.217+0000 7f8ed8bca700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed406fef0 con 0x7f8ed41338a0 2023-09-30T22:32:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.217+0000 7f8ed8bca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed41334b0 con 0x7f8ed409de50 2023-09-30T22:32:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.217+0000 7f8ed259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ed41338a0 0x7f8ed4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.217+0000 7f8ed259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ed41338a0 0x7f8ed4133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41638/0 (socket says 172.21.15.59:41638) 2023-09-30T22:32:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.217+0000 7f8ed2d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8ed409e760 0x7f8ed413a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58022/0 (socket says 172.21.15.59:58022) 2023-09-30T22:32:50.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.217+0000 7f8ed259c700 1 -- 172.21.15.59:0/2406495416 learned_addr learned my addr 172.21.15.59:0/2406495416 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:50.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.217+0000 7f8ed1d9b700 1 --2- 172.21.15.59:0/2406495416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed409de50 0x7f8ed409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.217+0000 7f8ed259c700 1 -- 172.21.15.59:0/2406495416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed409de50 msgr2=0x7f8ed409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:50.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.217+0000 7f8ed259c700 1 --2- 172.21.15.59:0/2406495416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed409de50 0x7f8ed409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.217+0000 7f8ed259c700 1 -- 172.21.15.59:0/2406495416 >> v1:172.21.15.59:6789/0 conn(0x7f8ed409e760 legacy=0x7f8ed413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.217+0000 7f8ed259c700 1 -- 172.21.15.59:0/2406495416 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed406fc30 con 0x7f8ed41338a0 2023-09-30T22:32:50.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.217+0000 7f8ed259c700 1 --2- 172.21.15.59:0/2406495416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ed41338a0 0x7f8ed4133c70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40098f0 tx=0x7f8ec4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b502138ee29e9b32 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:50.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.218+0000 7f8ed159a700 1 -- 172.21.15.59:0/2406495416 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4011830 con 0x7f8ed41338a0 2023-09-30T22:32:50.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.218+0000 7f8ed159a700 1 -- 172.21.15.59:0/2406495416 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec4011990 con 0x7f8ed41338a0 2023-09-30T22:32:50.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.218+0000 7f8ed159a700 1 -- 172.21.15.59:0/2406495416 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4011d20 con 0x7f8ed41338a0 2023-09-30T22:32:50.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.218+0000 7f8ed8bca700 1 -- 172.21.15.59:0/2406495416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ed41338a0 msgr2=0x7f8ed4133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.218+0000 7f8ed8bca700 1 --2- 172.21.15.59:0/2406495416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ed41338a0 0x7f8ed4133c70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40098f0 tx=0x7f8ec4009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:50.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.219+0000 7f8ed8bca700 1 -- 172.21.15.59:0/2406495416 shutdown_connections 2023-09-30T22:32:50.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.219+0000 7f8ed8bca700 1 --2- 172.21.15.59:0/2406495416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ed41338a0 0x7f8ed4133c70 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.219+0000 7f8ed8bca700 1 --2- 172.21.15.59:0/2406495416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed409de50 0x7f8ed409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.219+0000 7f8ed8bca700 1 -- 172.21.15.59:0/2406495416 >> 172.21.15.59:0/2406495416 conn(0x7f8ed40a2aa0 msgr2=0x7f8ed40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:50.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.219+0000 7f8ed8bca700 1 -- 172.21.15.59:0/2406495416 shutdown_connections 2023-09-30T22:32:50.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.219+0000 7f8ed8bca700 1 -- 172.21.15.59:0/2406495416 wait complete. 2023-09-30T22:32:50.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.220+0000 7f8ed8bca700 1 Processor -- start 2023-09-30T22:32:50.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.220+0000 7f8ed8bca700 1 -- start start 2023-09-30T22:32:50.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.221+0000 7f8ed8bca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ed409de50 0x7f8ed411eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.221+0000 7f8ed8bca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ed409e760 0x7f8ed411f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.221+0000 7f8ed8bca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed41338a0 0x7f8ed411f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.221+0000 7f8ed8bca700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed412f6e0 con 0x7f8ed409de50 2023-09-30T22:32:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.221+0000 7f8ed8bca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed4121ce0 con 0x7f8ed41338a0 2023-09-30T22:32:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.221+0000 7f8ed8bca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed41206f0 con 0x7f8ed409e760 2023-09-30T22:32:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.221+0000 7f8ed1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ed409e760 0x7f8ed411f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.221+0000 7f8ed259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ed409de50 0x7f8ed411eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.221+0000 7f8ed1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ed409e760 0x7f8ed411f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50994/0 (socket says 172.21.15.59:50994) 2023-09-30T22:32:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.221+0000 7f8ed1d9b700 1 -- 172.21.15.59:0/1838014026 learned_addr learned my addr 172.21.15.59:0/1838014026 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:50.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.222+0000 7f8ed259c700 1 -- 172.21.15.59:0/1838014026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ed409e760 msgr2=0x7f8ed411f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.222+0000 7f8ed259c700 1 --2- 172.21.15.59:0/1838014026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ed409e760 0x7f8ed411f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.222+0000 7f8ed259c700 1 -- 172.21.15.59:0/1838014026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed41338a0 msgr2=0x7f8ed411f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.222+0000 7f8ed259c700 1 --2- 172.21.15.59:0/1838014026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed41338a0 0x7f8ed411f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.222+0000 7f8ed259c700 1 -- 172.21.15.59:0/1838014026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec4009550 con 0x7f8ed409de50 2023-09-30T22:32:50.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.222+0000 7f8ed1d9b700 1 --2- 172.21.15.59:0/1838014026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ed409e760 0x7f8ed411f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:50.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.222+0000 7f8ed259c700 1 --2- 172.21.15.59:0/1838014026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ed409de50 0x7f8ed411eae0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8ed406fae0 tx=0x7f8ec4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:50.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.222+0000 7f8ec2ffd700 1 -- 172.21.15.59:0/1838014026 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4004480 con 0x7f8ed409de50 2023-09-30T22:32:50.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.222+0000 7f8ec2ffd700 1 -- 172.21.15.59:0/1838014026 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec401f070 con 0x7f8ed409de50 2023-09-30T22:32:50.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.222+0000 7f8ed8bca700 1 -- 172.21.15.59:0/1838014026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed4122600 con 0x7f8ed409de50 2023-09-30T22:32:50.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.222+0000 7f8ec2ffd700 1 -- 172.21.15.59:0/1838014026 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec40038e0 con 0x7f8ed409de50 2023-09-30T22:32:50.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.222+0000 7f8ed8bca700 1 -- 172.21.15.59:0/1838014026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed406f6a0 con 0x7f8ed409de50 2023-09-30T22:32:50.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.223+0000 7f8ec2ffd700 1 -- 172.21.15.59:0/1838014026 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ec4021030 con 0x7f8ed409de50 2023-09-30T22:32:50.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.224+0000 7f8ec2ffd700 1 -- 172.21.15.59:0/1838014026 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8ec4040990 con 0x7f8ed409de50 2023-09-30T22:32:50.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.224+0000 7f8ed8bca700 1 -- 172.21.15.59:0/1838014026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed4074ea0 con 0x7f8ed409de50 2023-09-30T22:32:50.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.228+0000 7f8712a4b700 1 Processor -- start 2023-09-30T22:32:50.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.228+0000 7f8712a4b700 1 -- start start 2023-09-30T22:32:50.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.229+0000 7f8712a4b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f870c09d6f0 0x7f870c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.229+0000 7f8712a4b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f870c09e440 0x7f870c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.229+0000 7f8712a4b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870c09b120 con 0x7f870c09e000 2023-09-30T22:32:50.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.229+0000 7f8712a4b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870c06b460 con 0x7f870c09d6f0 2023-09-30T22:32:50.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.229+0000 7f8712a4b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c09a7e0 con 0x7f870c09e440 2023-09-30T22:32:50.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.229+0000 7f870b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f870c09e000 0x7f870c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58030/0 (socket says 172.21.15.59:58030) 2023-09-30T22:32:50.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.229+0000 7f870b7fe700 1 -- 172.21.15.59:0/3121505611 learned_addr learned my addr 172.21.15.59:0/3121505611 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:50.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.229+0000 7f870bfff700 1 --2- 172.21.15.59:0/3121505611 >> v2:172.21.15.59:3300/0 conn(0x7f870c09d6f0 0x7f870c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.229+0000 7f870bfff700 1 -- 172.21.15.59:0/3121505611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f870c09e440 msgr2=0x7f870c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:50.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.229+0000 7f870bfff700 1 --2- 172.21.15.59:0/3121505611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f870c09e440 0x7f870c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.229+0000 7f870bfff700 1 -- 172.21.15.59:0/3121505611 >> v1:172.21.15.59:6789/0 conn(0x7f870c09e000 legacy=0x7f870c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.230+0000 7f870bfff700 1 -- 172.21.15.59:0/3121505611 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c09a500 con 0x7f870c09d6f0 2023-09-30T22:32:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.230+0000 7f870bfff700 1 --2- 172.21.15.59:0/3121505611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870c09d6f0 0x7f870c09dac0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009870 tx=0x7f86fc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76060c9836336ee4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.231+0000 7f870affd700 1 -- 172.21.15.59:0/3121505611 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc011830 con 0x7f870c09d6f0 2023-09-30T22:32:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.231+0000 7f870affd700 1 -- 172.21.15.59:0/3121505611 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc011990 con 0x7f870c09d6f0 2023-09-30T22:32:50.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.231+0000 7f870affd700 1 -- 172.21.15.59:0/3121505611 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc011d20 con 0x7f870c09d6f0 2023-09-30T22:32:50.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.231+0000 7f8ec2ffd700 1 -- 172.21.15.59:0/1838014026 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ec401a450 con 0x7f8ed409de50 2023-09-30T22:32:50.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.232+0000 7f8712a4b700 1 -- 172.21.15.59:0/3121505611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870c09d6f0 msgr2=0x7f870c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.232+0000 7f8712a4b700 1 --2- 172.21.15.59:0/3121505611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870c09d6f0 0x7f870c09dac0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009870 tx=0x7f86fc009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:50.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.232+0000 7f8712a4b700 1 -- 172.21.15.59:0/3121505611 shutdown_connections 2023-09-30T22:32:50.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.232+0000 7f8712a4b700 1 --2- 172.21.15.59:0/3121505611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870c09d6f0 0x7f870c09dac0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.232+0000 7f8712a4b700 1 --2- 172.21.15.59:0/3121505611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f870c09e440 0x7f870c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.232+0000 7f8712a4b700 1 -- 172.21.15.59:0/3121505611 >> 172.21.15.59:0/3121505611 conn(0x7f870c066f50 msgr2=0x7f870c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:50.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.232+0000 7f8712a4b700 1 -- 172.21.15.59:0/3121505611 shutdown_connections 2023-09-30T22:32:50.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.232+0000 7f8712a4b700 1 -- 172.21.15.59:0/3121505611 wait complete. 2023-09-30T22:32:50.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.234+0000 7f8712a4b700 1 Processor -- start 2023-09-30T22:32:50.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.234+0000 7f8712a4b700 1 -- start start 2023-09-30T22:32:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.235+0000 7f8712a4b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870c09d6f0 0x7f870c1a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.235+0000 7f8712a4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f870c09e000 0x7f870c1a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.235+0000 7f8712a4b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f870c09e440 0x7f870c1a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.235+0000 7f8712a4b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c1a7410 con 0x7f870c09d6f0 2023-09-30T22:32:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.235+0000 7f8712a4b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c1a7b70 con 0x7f870c09e440 2023-09-30T22:32:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.235+0000 7f8712a4b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f870c1a8190 con 0x7f870c09e000 2023-09-30T22:32:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.235+0000 7f870bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870c09d6f0 0x7f870c1a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.235+0000 7f870b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f870c09e000 0x7f870c1a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.235+0000 7f870bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870c09d6f0 0x7f870c1a5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41656/0 (socket says 172.21.15.59:41656) 2023-09-30T22:32:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.235+0000 7f870bfff700 1 -- 172.21.15.59:0/3434211243 learned_addr learned my addr 172.21.15.59:0/3434211243 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.236+0000 7f8710fe8700 1 --2- 172.21.15.59:0/3434211243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f870c09e440 0x7f870c1a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.236+0000 7f8710fe8700 1 -- 172.21.15.59:0/3434211243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f870c09e000 msgr2=0x7f870c1a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.236+0000 7f8710fe8700 1 --2- 172.21.15.59:0/3434211243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f870c09e000 0x7f870c1a64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.236+0000 7f8710fe8700 1 -- 172.21.15.59:0/3434211243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870c09d6f0 msgr2=0x7f870c1a5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.236+0000 7f8710fe8700 1 --2- 172.21.15.59:0/3434211243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870c09d6f0 0x7f870c1a5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.236+0000 7f8710fe8700 1 -- 172.21.15.59:0/3434211243 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc0094a0 con 0x7f870c09e440 2023-09-30T22:32:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.236+0000 7f870b7fe700 1 --2- 172.21.15.59:0/3434211243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f870c09e000 0x7f870c1a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.236+0000 7f8710fe8700 1 --2- 172.21.15.59:0/3434211243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f870c09e440 0x7f870c1a69e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f870400be20 tx=0x7f8704009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.237+0000 7f8708ff9700 1 -- 172.21.15.59:0/3434211243 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870400cb90 con 0x7f870c09e440 2023-09-30T22:32:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.237+0000 7f8708ff9700 1 -- 172.21.15.59:0/3434211243 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870400cd10 con 0x7f870c09e440 2023-09-30T22:32:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.237+0000 7f8708ff9700 1 -- 172.21.15.59:0/3434211243 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704014680 con 0x7f870c09e440 2023-09-30T22:32:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.238+0000 7f8712a4b700 1 -- 172.21.15.59:0/3434211243 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870c1a97a0 con 0x7f870c09e440 2023-09-30T22:32:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.238+0000 7f8712a4b700 1 -- 172.21.15.59:0/3434211243 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870c1a9270 con 0x7f870c09e440 2023-09-30T22:32:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.239+0000 7f8708ff9700 1 -- 172.21.15.59:0/3434211243 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f870401d3b0 con 0x7f870c09e440 2023-09-30T22:32:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.239+0000 7f8708ff9700 1 -- 172.21.15.59:0/3434211243 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8704006e40 con 0x7f870c09e440 2023-09-30T22:32:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.239+0000 7f8712a4b700 1 -- 172.21.15.59:0/3434211243 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870c1a9210 con 0x7f870c09e440 2023-09-30T22:32:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.244+0000 7f8708ff9700 1 -- 172.21.15.59:0/3434211243 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8704019080 con 0x7f870c09e440 2023-09-30T22:32:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.257+0000 7f25aa76e700 1 Processor -- start 2023-09-30T22:32:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.257+0000 7f25aa76e700 1 -- start start 2023-09-30T22:32:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.258+0000 7f25aa76e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25a41337f0 0x7f25a4138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.258+0000 7f25aa76e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a4138dc0 0x7f25a413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.258+0000 7f25aa76e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a406b990 con 0x7f25a4133420 2023-09-30T22:32:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.258+0000 7f25aa76e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a409b0e0 con 0x7f25a41337f0 2023-09-30T22:32:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.258+0000 7f25aa76e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a4133c20 con 0x7f25a4138dc0 2023-09-30T22:32:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.258+0000 7f25a8d0b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a4138dc0 0x7f25a413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.258+0000 7f25a8d0b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a4138dc0 0x7f25a413b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48772/0 (socket says 172.21.15.59:48772) 2023-09-30T22:32:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.258+0000 7f25a8d0b700 1 -- 172.21.15.59:0/284973792 learned_addr learned my addr 172.21.15.59:0/284973792 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.258+0000 7f25a37fe700 1 --2- 172.21.15.59:0/284973792 >> v2:172.21.15.59:3300/0 conn(0x7f25a41337f0 0x7f25a4138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.259+0000 7f25a8d0b700 1 -- 172.21.15.59:0/284973792 >> v2:172.21.15.59:3300/0 conn(0x7f25a41337f0 msgr2=0x7f25a4138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:50.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.259+0000 7f25a8d0b700 1 --2- 172.21.15.59:0/284973792 >> v2:172.21.15.59:3300/0 conn(0x7f25a41337f0 0x7f25a4138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.259+0000 7f25a8d0b700 1 -- 172.21.15.59:0/284973792 >> v1:172.21.15.59:6789/0 conn(0x7f25a4133420 legacy=0x7f25a4133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.259+0000 7f25a2ffd700 1 -- 172.21.15.59:0/284973792 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183962813 0 0) 0x7f25a406b990 con 0x7f25a4133420 2023-09-30T22:32:50.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.259+0000 7f25a8d0b700 1 -- 172.21.15.59:0/284973792 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a40a0590 con 0x7f25a4138dc0 2023-09-30T22:32:50.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.259+0000 7f25a8d0b700 1 --2- 172.21.15.59:0/284973792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a4138dc0 0x7f25a413b1a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f259c009e50 tx=0x7f259c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=346763b00dea311 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:50.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.259+0000 7f25a2ffd700 1 -- 172.21.15.59:0/284973792 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c00e070 con 0x7f25a4138dc0 2023-09-30T22:32:50.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.259+0000 7f25a2ffd700 1 -- 172.21.15.59:0/284973792 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c00b910 con 0x7f25a4138dc0 2023-09-30T22:32:50.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.259+0000 7f25a2ffd700 1 -- 172.21.15.59:0/284973792 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c00bcc0 con 0x7f25a4138dc0 2023-09-30T22:32:50.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.260+0000 7f25aa76e700 1 -- 172.21.15.59:0/284973792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a4138dc0 msgr2=0x7f25a413b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.260+0000 7f25aa76e700 1 --2- 172.21.15.59:0/284973792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a4138dc0 0x7f25a413b1a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f259c009e50 tx=0x7f259c00b330 comp rx=0 tx=0).stop 2023-09-30T22:32:50.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.260+0000 7f25aa76e700 1 -- 172.21.15.59:0/284973792 shutdown_connections 2023-09-30T22:32:50.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.260+0000 7f25aa76e700 1 --2- 172.21.15.59:0/284973792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a4138dc0 0x7f25a413b1a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.260+0000 7f25aa76e700 1 --2- 172.21.15.59:0/284973792 >> v2:172.21.15.59:3300/0 conn(0x7f25a41337f0 0x7f25a4138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.260+0000 7f25aa76e700 1 -- 172.21.15.59:0/284973792 >> 172.21.15.59:0/284973792 conn(0x7f25a40a4210 msgr2=0x7f25a40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:50.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.260+0000 7f25aa76e700 1 -- 172.21.15.59:0/284973792 shutdown_connections 2023-09-30T22:32:50.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.260+0000 7f25aa76e700 1 -- 172.21.15.59:0/284973792 wait complete. 2023-09-30T22:32:50.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.261+0000 7f25aa76e700 1 Processor -- start 2023-09-30T22:32:50.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.261+0000 7f25aa76e700 1 -- start start 2023-09-30T22:32:50.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25aa76e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25a4133420 0x7f25a412eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25aa76e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a41337f0 0x7f25a412f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25aa76e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a4138dc0 0x7f25a412f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:50.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25aa76e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a409c660 con 0x7f25a4138dc0 2023-09-30T22:32:50.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25aa76e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a409b9d0 con 0x7f25a41337f0 2023-09-30T22:32:50.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25aa76e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25a4130820 con 0x7f25a4133420 2023-09-30T22:32:50.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25a37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a41337f0 0x7f25a412f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25a8d0b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a4138dc0 0x7f25a412f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:50.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25a37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a41337f0 0x7f25a412f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48788/0 (socket says 172.21.15.59:48788) 2023-09-30T22:32:50.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25a37fe700 1 -- 172.21.15.59:0/2933340035 learned_addr learned my addr 172.21.15.59:0/2933340035 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:50.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25a37fe700 1 -- 172.21.15.59:0/2933340035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25a4133420 msgr2=0x7f25a412eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25a37fe700 1 --2- 172.21.15.59:0/2933340035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25a4133420 0x7f25a412eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25a37fe700 1 -- 172.21.15.59:0/2933340035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a4138dc0 msgr2=0x7f25a412f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25a37fe700 1 --2- 172.21.15.59:0/2933340035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a4138dc0 0x7f25a412f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25a37fe700 1 -- 172.21.15.59:0/2933340035 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c009b30 con 0x7f25a41337f0 2023-09-30T22:32:50.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.262+0000 7f25a8d0b700 1 --2- 172.21.15.59:0/2933340035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a4138dc0 0x7f25a412f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:50.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.263+0000 7f25a37fe700 1 --2- 172.21.15.59:0/2933340035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a41337f0 0x7f25a412f0c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f259800e9b0 tx=0x7f259800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:50.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.263+0000 7f25a0ff9700 1 -- 172.21.15.59:0/2933340035 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2598009710 con 0x7f25a41337f0 2023-09-30T22:32:50.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.263+0000 7f25a0ff9700 1 -- 172.21.15.59:0/2933340035 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259800c850 con 0x7f25a41337f0 2023-09-30T22:32:50.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.263+0000 7f25aa76e700 1 -- 172.21.15.59:0/2933340035 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a409bde0 con 0x7f25a41337f0 2023-09-30T22:32:50.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.263+0000 7f25a0ff9700 1 -- 172.21.15.59:0/2933340035 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259800cbc0 con 0x7f25a41337f0 2023-09-30T22:32:50.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.263+0000 7f25aa76e700 1 -- 172.21.15.59:0/2933340035 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a409d390 con 0x7f25a41337f0 2023-09-30T22:32:50.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.264+0000 7f25a0ff9700 1 -- 172.21.15.59:0/2933340035 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f259800cd20 con 0x7f25a41337f0 2023-09-30T22:32:50.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.264+0000 7f25a0ff9700 1 -- 172.21.15.59:0/2933340035 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f259803f860 con 0x7f25a41337f0 2023-09-30T22:32:50.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.265+0000 7f25aa76e700 1 -- 172.21.15.59:0/2933340035 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a4074ea0 con 0x7f25a41337f0 2023-09-30T22:32:50.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.270+0000 7f25a0ff9700 1 -- 172.21.15.59:0/2933340035 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f259801be10 con 0x7f25a41337f0 2023-09-30T22:32:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.418+0000 7f381e255700 1 -- 172.21.15.59:0/2278597764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f38180a1d70 con 0x7f381809e000 2023-09-30T22:32:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.419+0000 7f37fffff700 1 -- 172.21.15.59:0/2278597764 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f380c021020 con 0x7f381809e000 2023-09-30T22:32:50.420 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.422+0000 7f381e255700 1 -- 172.21.15.59:0/2278597764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f381809e000 msgr2=0x7f381811e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.422+0000 7f381e255700 1 --2- 172.21.15.59:0/2278597764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f381809e000 0x7f381811e5a0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f380c00e900 tx=0x7f380c00ec10 comp rx=0 tx=0).stop 2023-09-30T22:32:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.422+0000 7f381e255700 1 -- 172.21.15.59:0/2278597764 shutdown_connections 2023-09-30T22:32:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.422+0000 7f381e255700 1 --2- 172.21.15.59:0/2278597764 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f381809d6f0 0x7f381811e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.422+0000 7f381e255700 1 --2- 172.21.15.59:0/2278597764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f381809e410 0x7f381811eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.422+0000 7f381e255700 1 --2- 172.21.15.59:0/2278597764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f381809e000 0x7f381811e5a0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.422+0000 7f381e255700 1 -- 172.21.15.59:0/2278597764 >> 172.21.15.59:0/2278597764 conn(0x7f3818066f50 msgr2=0x7f38180710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.423+0000 7f381e255700 1 -- 172.21.15.59:0/2278597764 shutdown_connections 2023-09-30T22:32:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.423+0000 7f381e255700 1 -- 172.21.15.59:0/2278597764 wait complete. 2023-09-30T22:32:50.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:50.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.452+0000 7f8712a4b700 1 -- 172.21.15.59:0/3434211243 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f870c074ea0 con 0x7f870c09e440 2023-09-30T22:32:50.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.453+0000 7f8708ff9700 1 -- 172.21.15.59:0/3434211243 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f87040072b0 con 0x7f870c09e440 2023-09-30T22:32:50.454 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:50.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.454+0000 7f8ed8bca700 1 -- 172.21.15.59:0/1838014026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8ed41223e0 con 0x7f8ed409de50 2023-09-30T22:32:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.455+0000 7f8ec2ffd700 1 -- 172.21.15.59:0/1838014026 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ec4015020 con 0x7f8ed409de50 2023-09-30T22:32:50.456 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.456+0000 7f8712a4b700 1 -- 172.21.15.59:0/3434211243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f870c09e440 msgr2=0x7f870c1a69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.456+0000 7f8712a4b700 1 --2- 172.21.15.59:0/3434211243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f870c09e440 0x7f870c1a69e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f870400be20 tx=0x7f8704009ed0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.456+0000 7f8712a4b700 1 -- 172.21.15.59:0/3434211243 shutdown_connections 2023-09-30T22:32:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.456+0000 7f8712a4b700 1 --2- 172.21.15.59:0/3434211243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f870c09e440 0x7f870c1a69e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.456+0000 7f8712a4b700 1 --2- 172.21.15.59:0/3434211243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870c09d6f0 0x7f870c1a5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.456+0000 7f8712a4b700 1 --2- 172.21.15.59:0/3434211243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f870c09e000 0x7f870c1a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.456+0000 7f8712a4b700 1 -- 172.21.15.59:0/3434211243 >> 172.21.15.59:0/3434211243 conn(0x7f870c066f50 msgr2=0x7f870c1baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.456+0000 7f8712a4b700 1 -- 172.21.15.59:0/3434211243 shutdown_connections 2023-09-30T22:32:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.456+0000 7f8712a4b700 1 -- 172.21.15.59:0/3434211243 wait complete. 2023-09-30T22:32:50.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.457+0000 7f8ed8bca700 1 -- 172.21.15.59:0/1838014026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ed409de50 msgr2=0x7f8ed411eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.457+0000 7f8ed8bca700 1 --2- 172.21.15.59:0/1838014026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ed409de50 0x7f8ed411eae0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8ed406fae0 tx=0x7f8ec4004750 comp rx=0 tx=0).stop 2023-09-30T22:32:50.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.457+0000 7f8ed8bca700 1 -- 172.21.15.59:0/1838014026 shutdown_connections 2023-09-30T22:32:50.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.457+0000 7f8ed8bca700 1 --2- 172.21.15.59:0/1838014026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed41338a0 0x7f8ed411f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.458+0000 7f8ed8bca700 1 --2- 172.21.15.59:0/1838014026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ed409de50 0x7f8ed411eae0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.458+0000 7f8ed8bca700 1 --2- 172.21.15.59:0/1838014026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ed409e760 0x7f8ed411f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.458+0000 7f8ed8bca700 1 -- 172.21.15.59:0/1838014026 >> 172.21.15.59:0/1838014026 conn(0x7f8ed40a2aa0 msgr2=0x7f8ed409ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:50.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.459+0000 7f8ed8bca700 1 -- 172.21.15.59:0/1838014026 shutdown_connections 2023-09-30T22:32:50.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.459+0000 7f8ed8bca700 1 -- 172.21.15.59:0/1838014026 wait complete. 2023-09-30T22:32:50.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:50.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.478+0000 7f25aa76e700 1 -- 172.21.15.59:0/2933340035 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f25a406b250 con 0x7f25a41337f0 2023-09-30T22:32:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.478+0000 7f25a0ff9700 1 -- 172.21.15.59:0/2933340035 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f259802a090 con 0x7f25a41337f0 2023-09-30T22:32:50.480 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.481+0000 7f25aa76e700 1 -- 172.21.15.59:0/2933340035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a41337f0 msgr2=0x7f25a412f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.481+0000 7f25aa76e700 1 --2- 172.21.15.59:0/2933340035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a41337f0 0x7f25a412f0c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f259800e9b0 tx=0x7f259800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.481+0000 7f25aa76e700 1 -- 172.21.15.59:0/2933340035 shutdown_connections 2023-09-30T22:32:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.481+0000 7f25aa76e700 1 --2- 172.21.15.59:0/2933340035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25a4133420 0x7f25a412eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.481+0000 7f25aa76e700 1 --2- 172.21.15.59:0/2933340035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a4138dc0 0x7f25a412f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.481+0000 7f25aa76e700 1 --2- 172.21.15.59:0/2933340035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a41337f0 0x7f25a412f0c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.481+0000 7f25aa76e700 1 -- 172.21.15.59:0/2933340035 >> 172.21.15.59:0/2933340035 conn(0x7f25a40a4210 msgr2=0x7f25a413aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.481+0000 7f25aa76e700 1 -- 172.21.15.59:0/2933340035 shutdown_connections 2023-09-30T22:32:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:50.481+0000 7f25aa76e700 1 -- 172.21.15.59:0/2933340035 wait complete. 2023-09-30T22:32:50.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:51.444 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:51.474 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:51.476 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:51.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:51.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.597+0000 7f5b86038700 1 Processor -- start 2023-09-30T22:32:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.598+0000 7f5b86038700 1 -- start start 2023-09-30T22:32:51.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.598+0000 7f5b86038700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5b8009d6f0 0x7f5b8009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.598+0000 7f5b86038700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8009e000 0x7f5b801339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.598+0000 7f5b86038700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8009e410 0x7f5b80133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.598+0000 7f5b86038700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8006b460 con 0x7f5b8009d6f0 2023-09-30T22:32:51.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.598+0000 7f5b86038700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8009b120 con 0x7f5b8009e410 2023-09-30T22:32:51.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.598+0000 7f5b86038700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8009a7e0 con 0x7f5b8009e000 2023-09-30T22:32:51.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.599+0000 7f5b7f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5b8009d6f0 0x7f5b8009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.599+0000 7f5b7f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5b8009d6f0 0x7f5b8009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41672/0 (socket says 172.21.15.59:41672) 2023-09-30T22:32:51.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.599+0000 7f5b7f7fe700 1 -- 172.21.15.59:0/3452053778 learned_addr learned my addr 172.21.15.59:0/3452053778 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:51.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.599+0000 7f5b7effd700 1 --2- 172.21.15.59:0/3452053778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8009e000 0x7f5b801339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.599+0000 7f5b7ffff700 1 --2- 172.21.15.59:0/3452053778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8009e410 0x7f5b80133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.599+0000 7f5b7f7fe700 1 -- 172.21.15.59:0/3452053778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8009e000 msgr2=0x7f5b801339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:51.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.599+0000 7f5b7f7fe700 1 --2- 172.21.15.59:0/3452053778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8009e000 0x7f5b801339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.599+0000 7f5b7f7fe700 1 -- 172.21.15.59:0/3452053778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8009e410 msgr2=0x7f5b80133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:51.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.599+0000 7f5b7f7fe700 1 --2- 172.21.15.59:0/3452053778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8009e410 0x7f5b80133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.599+0000 7f5b7f7fe700 1 -- 172.21.15.59:0/3452053778 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8009a500 con 0x7f5b8009d6f0 2023-09-30T22:32:51.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.599+0000 7f5b7ffff700 1 --2- 172.21.15.59:0/3452053778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8009e410 0x7f5b80133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:51.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.599+0000 7f5b7f7fe700 1 --2- 172.21.15.59:0/3452053778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8009d6f0 0x7f5b8009dac0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009e50 tx=0x7f5b7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbe65ab4713fc7d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:51.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.600+0000 7f5b7e7fc700 1 -- 172.21.15.59:0/3452053778 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7800e070 con 0x7f5b8009d6f0 2023-09-30T22:32:51.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.600+0000 7f5b7e7fc700 1 -- 172.21.15.59:0/3452053778 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7800b910 con 0x7f5b8009d6f0 2023-09-30T22:32:51.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.600+0000 7f5b7e7fc700 1 -- 172.21.15.59:0/3452053778 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7800bcc0 con 0x7f5b8009d6f0 2023-09-30T22:32:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.600+0000 7f5b86038700 1 -- 172.21.15.59:0/3452053778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8009d6f0 msgr2=0x7f5b8009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.600+0000 7f5b86038700 1 --2- 172.21.15.59:0/3452053778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8009d6f0 0x7f5b8009dac0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009e50 tx=0x7f5b7800b330 comp rx=0 tx=0).stop 2023-09-30T22:32:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.600+0000 7f5b86038700 1 -- 172.21.15.59:0/3452053778 shutdown_connections 2023-09-30T22:32:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.600+0000 7f5b86038700 1 --2- 172.21.15.59:0/3452053778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8009e410 0x7f5b80133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.600+0000 7f5b86038700 1 --2- 172.21.15.59:0/3452053778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8009d6f0 0x7f5b8009dac0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.600+0000 7f5b86038700 1 --2- 172.21.15.59:0/3452053778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8009e000 0x7f5b801339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.600+0000 7f5b86038700 1 -- 172.21.15.59:0/3452053778 >> 172.21.15.59:0/3452053778 conn(0x7f5b80066f50 msgr2=0x7f5b8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:51.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.601+0000 7f5b86038700 1 -- 172.21.15.59:0/3452053778 shutdown_connections 2023-09-30T22:32:51.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.601+0000 7f5b86038700 1 -- 172.21.15.59:0/3452053778 wait complete. 2023-09-30T22:32:51.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.602+0000 7f5b86038700 1 Processor -- start 2023-09-30T22:32:51.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.602+0000 7f5b86038700 1 -- start start 2023-09-30T22:32:51.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.603+0000 7f5b86038700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8009d6f0 0x7f5b801a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.603+0000 7f5b86038700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8009e000 0x7f5b801a6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.603+0000 7f5b86038700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8009e410 0x7f5b801a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.603+0000 7f5b86038700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b801a8130 con 0x7f5b8009e410 2023-09-30T22:32:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.603+0000 7f5b86038700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b801a9480 con 0x7f5b8009e000 2023-09-30T22:32:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.603+0000 7f5b86038700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b800a20d0 con 0x7f5b8009d6f0 2023-09-30T22:32:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.603+0000 7f5b7f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8009d6f0 0x7f5b801a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.603+0000 7f5b7effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8009e000 0x7f5b801a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.603+0000 7f5b7f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8009d6f0 0x7f5b801a5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51030/0 (socket says 172.21.15.59:51030) 2023-09-30T22:32:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.603+0000 7f5b7effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8009e000 0x7f5b801a6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48810/0 (socket says 172.21.15.59:48810) 2023-09-30T22:32:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.603+0000 7f5b7f7fe700 1 -- 172.21.15.59:0/1822382891 learned_addr learned my addr 172.21.15.59:0/1822382891 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.603+0000 7f5b7ffff700 1 --2- 172.21.15.59:0/1822382891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8009e410 0x7f5b801a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.604+0000 7f5b7ffff700 1 -- 172.21.15.59:0/1822382891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8009d6f0 msgr2=0x7f5b801a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.604+0000 7f5b7ffff700 1 --2- 172.21.15.59:0/1822382891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8009d6f0 0x7f5b801a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.604+0000 7f5b7ffff700 1 -- 172.21.15.59:0/1822382891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8009e000 msgr2=0x7f5b801a6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.604+0000 7f5b7ffff700 1 --2- 172.21.15.59:0/1822382891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8009e000 0x7f5b801a6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.604+0000 7f5b7ffff700 1 -- 172.21.15.59:0/1822382891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b78009b30 con 0x7f5b8009e410 2023-09-30T22:32:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.604+0000 7f5b7effd700 1 --2- 172.21.15.59:0/1822382891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8009e000 0x7f5b801a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.604+0000 7f5b7f7fe700 1 --2- 172.21.15.59:0/1822382891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8009d6f0 0x7f5b801a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.604+0000 7f5b7ffff700 1 --2- 172.21.15.59:0/1822382891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8009e410 0x7f5b801a6980 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000e810 tx=0x7f5b7000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.604+0000 7f5b67fff700 1 -- 172.21.15.59:0/1822382891 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000c070 con 0x7f5b8009e410 2023-09-30T22:32:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.604+0000 7f5b67fff700 1 -- 172.21.15.59:0/1822382891 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b70013610 con 0x7f5b8009e410 2023-09-30T22:32:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.604+0000 7f5b67fff700 1 -- 172.21.15.59:0/1822382891 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700139c0 con 0x7f5b8009e410 2023-09-30T22:32:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.604+0000 7f5b86038700 1 -- 172.21.15.59:0/1822382891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b801a8d60 con 0x7f5b8009e410 2023-09-30T22:32:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.605+0000 7f5b86038700 1 -- 172.21.15.59:0/1822382891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b801a9a20 con 0x7f5b8009e410 2023-09-30T22:32:51.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.606+0000 7f5b67fff700 1 -- 172.21.15.59:0/1822382891 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b70013b20 con 0x7f5b8009e410 2023-09-30T22:32:51.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.606+0000 7f5b67fff700 1 -- 172.21.15.59:0/1822382891 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5b7003ef70 con 0x7f5b8009e410 2023-09-30T22:32:51.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.606+0000 7f5b86038700 1 -- 172.21.15.59:0/1822382891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b80074ea0 con 0x7f5b8009e410 2023-09-30T22:32:51.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.611+0000 7f5b67fff700 1 -- 172.21.15.59:0/1822382891 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b70017020 con 0x7f5b8009e410 2023-09-30T22:32:51.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.640+0000 7fd5538b7700 1 Processor -- start 2023-09-30T22:32:51.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.641+0000 7f2f0d608700 1 Processor -- start 2023-09-30T22:32:51.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.641+0000 7fd5538b7700 1 -- start start 2023-09-30T22:32:51.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.641+0000 7fd5538b7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd54c09e1d0 0x7fd54c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.641+0000 7fd5538b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd54c135e50 0x7fd54c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.641+0000 7fd5538b7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c09f130 con 0x7fd54c09d6f0 2023-09-30T22:32:51.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.641+0000 7fd5538b7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c09f520 con 0x7fd54c09e1d0 2023-09-30T22:32:51.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.641+0000 7fd5538b7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c09e930 con 0x7fd54c135e50 2023-09-30T22:32:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.641+0000 7f2f0d608700 1 -- start start 2023-09-30T22:32:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.641+0000 7f2f0d608700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f0806f5d0 0x7f2f0812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.641+0000 7f2f0d608700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f08135c20 0x7f2f08138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.641+0000 7f2f0d608700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0806fa40 con 0x7f2f0812cf60 2023-09-30T22:32:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.641+0000 7f2f0d608700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0812cd90 con 0x7f2f08135c20 2023-09-30T22:32:51.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.641+0000 7f2f0d608700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f08071780 con 0x7f2f0806f5d0 2023-09-30T22:32:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.642+0000 7fd551653700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd54c09d6f0 0x7fd54c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58040/0 (socket says 172.21.15.59:58040) 2023-09-30T22:32:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.642+0000 7fd551653700 1 -- 172.21.15.59:0/1445738546 learned_addr learned my addr 172.21.15.59:0/1445738546 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.642+0000 7f2f077fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f08135c20 0x7f2f08138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.642+0000 7f2f077fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f08135c20 0x7f2f08138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41700/0 (socket says 172.21.15.59:41700) 2023-09-30T22:32:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.642+0000 7f2f077fe700 1 -- 172.21.15.59:0/861224566 learned_addr learned my addr 172.21.15.59:0/861224566 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:51.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.642+0000 7f2f077fe700 1 -- 172.21.15.59:0/861224566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f0806f5d0 msgr2=0x7f2f0812ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:51.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.642+0000 7f2f077fe700 1 --2- 172.21.15.59:0/861224566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f0806f5d0 0x7f2f0812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.642+0000 7f2f077fe700 1 -- 172.21.15.59:0/861224566 >> v1:172.21.15.59:6789/0 conn(0x7f2f0812cf60 legacy=0x7f2f0812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:51.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.642+0000 7f2f077fe700 1 -- 172.21.15.59:0/861224566 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f08071a40 con 0x7f2f08135c20 2023-09-30T22:32:51.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.642+0000 7fd543fff700 1 -- 172.21.15.59:0/1445738546 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422691629 0 0) 0x7fd54c09f130 con 0x7fd54c09d6f0 2023-09-30T22:32:51.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.642+0000 7fd543fff700 1 -- 172.21.15.59:0/1445738546 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5380035b0 con 0x7fd54c09d6f0 2023-09-30T22:32:51.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.642+0000 7f2f077fe700 1 --2- 172.21.15.59:0/861224566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f08135c20 0x7f2f08138000 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000af60 tx=0x7f2f0000af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b375fd3dc0b4b332 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:51.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd543fff700 1 -- 172.21.15.59:0/1445738546 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4238989408 0 0) 0x7fd5380035b0 con 0x7fd54c09d6f0 2023-09-30T22:32:51.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd543fff700 1 -- 172.21.15.59:0/1445738546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd54c135e50 msgr2=0x7fd54c138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:51.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd543fff700 1 --2- 172.21.15.59:0/1445738546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd54c135e50 0x7fd54c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd543fff700 1 -- 172.21.15.59:0/1445738546 >> v2:172.21.15.59:3300/0 conn(0x7fd54c09e1d0 msgr2=0x7fd54c135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd543fff700 1 --2- 172.21.15.59:0/1445738546 >> v2:172.21.15.59:3300/0 conn(0x7fd54c09e1d0 0x7fd54c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd543fff700 1 -- 172.21.15.59:0/1445738546 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c09b2d0 con 0x7fd54c09d6f0 2023-09-30T22:32:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7f2f05ffb700 1 -- 172.21.15.59:0/861224566 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000f070 con 0x7f2f08135c20 2023-09-30T22:32:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd543fff700 1 -- 172.21.15.59:0/1445738546 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1997034051 0 0) 0x7fd548001670 con 0x7fd54c09d6f0 2023-09-30T22:32:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd543fff700 1 -- 172.21.15.59:0/1445738546 >> v1:172.21.15.59:6789/0 conn(0x7fd54c09d6f0 legacy=0x7fd54c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd543fff700 1 --2- 172.21.15.59:0/1445738546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd54c135e50 0x7fd538003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd543fff700 1 --2- 172.21.15.59:0/1445738546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd538004110 0x7fd538004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd543fff700 1 --2- 172.21.15.59:0/1445738546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd538004d90 0x7fd538005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7f2f05ffb700 1 -- 172.21.15.59:0/861224566 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0000a2e0 con 0x7f2f08135c20 2023-09-30T22:32:51.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7f2f05ffb700 1 -- 172.21.15.59:0/861224566 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000cc70 con 0x7f2f08135c20 2023-09-30T22:32:51.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd543fff700 1 -- 172.21.15.59:0/1445738546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c09e930 con 0x7fd538004d90 2023-09-30T22:32:51.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd543fff700 1 -- 172.21.15.59:0/1445738546 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53800bcf0 con 0x7fd538004110 2023-09-30T22:32:51.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd543fff700 1 -- 172.21.15.59:0/1445738546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd53800beb0 con 0x7fd54c135e50 2023-09-30T22:32:51.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd551e54700 1 --2- 172.21.15.59:0/1445738546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd538004d90 0x7fd538005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd551e54700 1 -- 172.21.15.59:0/1445738546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd54c135e50 msgr2=0x7fd538003a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:32:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd551e54700 1 --2- 172.21.15.59:0/1445738546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd54c135e50 0x7fd538003a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd551e54700 1 -- 172.21.15.59:0/1445738546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd538004110 msgr2=0x7fd538004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd551e54700 1 --2- 172.21.15.59:0/1445738546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd538004110 0x7fd538004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7f2f0d608700 1 -- 172.21.15.59:0/861224566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f08135c20 msgr2=0x7f2f08138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7f2f0d608700 1 --2- 172.21.15.59:0/861224566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f08135c20 0x7f2f08138000 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000af60 tx=0x7f2f0000af90 comp rx=0 tx=0).stop 2023-09-30T22:32:51.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.643+0000 7fd551e54700 1 -- 172.21.15.59:0/1445738546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5380035b0 con 0x7fd538004d90 2023-09-30T22:32:51.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.644+0000 7fd551e54700 1 --2- 172.21.15.59:0/1445738546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd538004d90 0x7fd538005200 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fd54c09acc0 tx=0x7fd538005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1d8114e3976b5d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.644+0000 7f2f0d608700 1 -- 172.21.15.59:0/861224566 shutdown_connections 2023-09-30T22:32:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.644+0000 7f2f0d608700 1 --2- 172.21.15.59:0/861224566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f08135c20 0x7f2f08138000 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.644+0000 7f2f0d608700 1 --2- 172.21.15.59:0/861224566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f0806f5d0 0x7f2f0812ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.644+0000 7f2f0d608700 1 -- 172.21.15.59:0/861224566 >> 172.21.15.59:0/861224566 conn(0x7f2f080a2aa0 msgr2=0x7f2f080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.644+0000 7fd543fff700 1 -- 172.21.15.59:0/1445738546 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5440098b0 con 0x7fd538004d90 2023-09-30T22:32:51.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.644+0000 7f2f0d608700 1 -- 172.21.15.59:0/861224566 shutdown_connections 2023-09-30T22:32:51.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.644+0000 7fd543fff700 1 -- 172.21.15.59:0/1445738546 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54400baa0 con 0x7fd538004d90 2023-09-30T22:32:51.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.644+0000 7fd543fff700 1 -- 172.21.15.59:0/1445738546 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54400be10 con 0x7fd538004d90 2023-09-30T22:32:51.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.644+0000 7f2f0d608700 1 -- 172.21.15.59:0/861224566 wait complete. 2023-09-30T22:32:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.645+0000 7fd5538b7700 1 -- 172.21.15.59:0/1445738546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd538004d90 msgr2=0x7fd538005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.645+0000 7fd5538b7700 1 --2- 172.21.15.59:0/1445738546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd538004d90 0x7fd538005200 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fd54c09acc0 tx=0x7fd538005880 comp rx=0 tx=0).stop 2023-09-30T22:32:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.645+0000 7fd551e54700 1 -- 172.21.15.59:0/1445738546 reap_dead start 2023-09-30T22:32:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.645+0000 7fd5538b7700 1 -- 172.21.15.59:0/1445738546 shutdown_connections 2023-09-30T22:32:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.645+0000 7fd5538b7700 1 -- 172.21.15.59:0/1445738546 >> 172.21.15.59:0/1445738546 conn(0x7fd54c066f50 msgr2=0x7fd54c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.645+0000 7fd5538b7700 1 -- 172.21.15.59:0/1445738546 shutdown_connections 2023-09-30T22:32:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.645+0000 7fd5538b7700 1 -- 172.21.15.59:0/1445738546 wait complete. 2023-09-30T22:32:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.645+0000 7f2f0d608700 1 Processor -- start 2023-09-30T22:32:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.646+0000 7fd5538b7700 1 Processor -- start 2023-09-30T22:32:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.646+0000 7f2f0d608700 1 -- start start 2023-09-30T22:32:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.646+0000 7f2f0d608700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f0806f5d0 0x7f2f08132ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.646+0000 7f2f0d608700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f0812cf60 0x7f2f081333e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.646+0000 7f2f0d608700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f08135c20 0x7f2f08133920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.646+0000 7f2f0d608700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f08135570 con 0x7f2f0806f5d0 2023-09-30T22:32:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.646+0000 7f2f0d608700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f08129fa0 con 0x7f2f08135c20 2023-09-30T22:32:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.646+0000 7f2f0d608700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0809a570 con 0x7f2f0812cf60 2023-09-30T22:32:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.646+0000 7f2f077fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f08135c20 0x7f2f08133920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.646+0000 7f2f077fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f08135c20 0x7f2f08133920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48838/0 (socket says 172.21.15.59:48838) 2023-09-30T22:32:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.646+0000 7f2f077fe700 1 -- 172.21.15.59:0/206659116 learned_addr learned my addr 172.21.15.59:0/206659116 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7f2f077fe700 1 -- 172.21.15.59:0/206659116 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f0812cf60 msgr2=0x7f2f081333e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7f2f077fe700 1 --2- 172.21.15.59:0/206659116 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f0812cf60 0x7f2f081333e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7f2f077fe700 1 -- 172.21.15.59:0/206659116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f0806f5d0 msgr2=0x7f2f08132ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7f2f077fe700 1 --2- 172.21.15.59:0/206659116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f0806f5d0 0x7f2f08132ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7f2f077fe700 1 -- 172.21.15.59:0/206659116 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0000ac40 con 0x7f2f08135c20 2023-09-30T22:32:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.646+0000 7fd5538b7700 1 -- start start 2023-09-30T22:32:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd5538b7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd54c1ccc10 0x7fd54c1ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd5538b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd54c1cd520 0x7fd54c121c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd5538b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd54c1221d0 0x7fd54c122640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd5538b7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c1243e0 con 0x7fd54c1ccc10 2023-09-30T22:32:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd5538b7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c1245c0 con 0x7fd54c1cd520 2023-09-30T22:32:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd5538b7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c135940 con 0x7fd54c1221d0 2023-09-30T22:32:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd550e52700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd54c1cd520 0x7fd54c121c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd550e52700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd54c1cd520 0x7fd54c121c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48850/0 (socket says 172.21.15.59:48850) 2023-09-30T22:32:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd551653700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd54c1ccc10 0x7fd54c1ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd550e52700 1 -- 172.21.15.59:0/1177788107 learned_addr learned my addr 172.21.15.59:0/1177788107 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd550e52700 1 -- 172.21.15.59:0/1177788107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd54c1221d0 msgr2=0x7fd54c122640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd550e52700 1 --2- 172.21.15.59:0/1177788107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd54c1221d0 0x7fd54c122640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd550e52700 1 -- 172.21.15.59:0/1177788107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd54c1ccc10 msgr2=0x7fd54c1ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd550e52700 1 --2- 172.21.15.59:0/1177788107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd54c1ccc10 0x7fd54c1ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd550e52700 1 -- 172.21.15.59:0/1177788107 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c124080 con 0x7fd54c1cd520 2023-09-30T22:32:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7f2f077fe700 1 --2- 172.21.15.59:0/206659116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f08135c20 0x7f2f08133920 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2f0812ced0 tx=0x7f2f00004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.647+0000 7fd550e52700 1 --2- 172.21.15.59:0/1177788107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd54c1cd520 0x7fd54c121c90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00b580 tx=0x7fd53c00b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.648+0000 7f2eef7fe700 1 -- 172.21.15.59:0/206659116 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00004440 con 0x7f2f08135c20 2023-09-30T22:32:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.648+0000 7f2eef7fe700 1 -- 172.21.15.59:0/206659116 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f00007080 con 0x7f2f08135c20 2023-09-30T22:32:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.648+0000 7f2eef7fe700 1 -- 172.21.15.59:0/206659116 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f000047e0 con 0x7f2f08135c20 2023-09-30T22:32:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.648+0000 7fd541ffb700 1 -- 172.21.15.59:0/1177788107 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c011830 con 0x7fd54c1cd520 2023-09-30T22:32:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.648+0000 7fd541ffb700 1 -- 172.21.15.59:0/1177788107 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c011990 con 0x7fd54c1cd520 2023-09-30T22:32:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.648+0000 7fd541ffb700 1 -- 172.21.15.59:0/1177788107 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c011d40 con 0x7fd54c1cd520 2023-09-30T22:32:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.648+0000 7fd5538b7700 1 -- 172.21.15.59:0/1177788107 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c1cc880 con 0x7fd54c1cd520 2023-09-30T22:32:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.648+0000 7fd5538b7700 1 -- 172.21.15.59:0/1177788107 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54c123180 con 0x7fd54c1cd520 2023-09-30T22:32:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.648+0000 7f2f0d608700 1 -- 172.21.15.59:0/206659116 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f081349e0 con 0x7f2f08135c20 2023-09-30T22:32:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.648+0000 7f2f0d608700 1 -- 172.21.15.59:0/206659116 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0809b2a0 con 0x7f2f08135c20 2023-09-30T22:32:51.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.649+0000 7f2f0d608700 1 -- 172.21.15.59:0/206659116 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f08074ea0 con 0x7f2f08135c20 2023-09-30T22:32:51.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.649+0000 7f2eef7fe700 1 -- 172.21.15.59:0/206659116 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f00026450 con 0x7f2f08135c20 2023-09-30T22:32:51.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.649+0000 7fd5538b7700 1 -- 172.21.15.59:0/1177788107 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54c124210 con 0x7fd54c1cd520 2023-09-30T22:32:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.653+0000 7f2eef7fe700 1 -- 172.21.15.59:0/206659116 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2f0001d5c0 con 0x7f2f08135c20 2023-09-30T22:32:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.658+0000 7f2eef7fe700 1 -- 172.21.15.59:0/206659116 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f00024770 con 0x7f2f08135c20 2023-09-30T22:32:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.659+0000 7fd541ffb700 1 -- 172.21.15.59:0/1177788107 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd53c01a400 con 0x7fd54c1cd520 2023-09-30T22:32:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.659+0000 7fd541ffb700 1 -- 172.21.15.59:0/1177788107 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd53c03fe80 con 0x7fd54c1cd520 2023-09-30T22:32:51.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.667+0000 7fd541ffb700 1 -- 172.21.15.59:0/1177788107 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd53c0218f0 con 0x7fd54c1cd520 2023-09-30T22:32:51.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.688+0000 7f0c1cf74700 1 Processor -- start 2023-09-30T22:32:51.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.688+0000 7f0c1cf74700 1 -- start start 2023-09-30T22:32:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.689+0000 7f0c1cf74700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c1809e1d0 0x7f0c18135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.689+0000 7f0c1cf74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c18135e50 0x7f0c18138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.689+0000 7f0c1cf74700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1809f130 con 0x7f0c1809d6f0 2023-09-30T22:32:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.689+0000 7f0c1cf74700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1809f520 con 0x7f0c1809e1d0 2023-09-30T22:32:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.689+0000 7f0c1cf74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1809e930 con 0x7f0c18135e50 2023-09-30T22:32:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.689+0000 7f0c1659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0c1809d6f0 0x7f0c1809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58060/0 (socket says 172.21.15.59:58060) 2023-09-30T22:32:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.689+0000 7f0c1659c700 1 -- 172.21.15.59:0/24857777 learned_addr learned my addr 172.21.15.59:0/24857777 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.689+0000 7f0c15d9b700 1 --2- 172.21.15.59:0/24857777 >> v2:172.21.15.59:3300/0 conn(0x7f0c1809e1d0 0x7f0c18135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.689+0000 7f0c16d9d700 1 --2- 172.21.15.59:0/24857777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c18135e50 0x7f0c18138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.689+0000 7f0c1559a700 1 -- 172.21.15.59:0/24857777 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135779661 0 0) 0x7f0c1809f130 con 0x7f0c1809d6f0 2023-09-30T22:32:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.689+0000 7f0c1559a700 1 -- 172.21.15.59:0/24857777 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c000035b0 con 0x7f0c1809d6f0 2023-09-30T22:32:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.689+0000 7f0c15d9b700 1 -- 172.21.15.59:0/24857777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c18135e50 msgr2=0x7f0c18138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.689+0000 7f0c15d9b700 1 --2- 172.21.15.59:0/24857777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c18135e50 0x7f0c18138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.689+0000 7f0c15d9b700 1 -- 172.21.15.59:0/24857777 >> v1:172.21.15.59:6789/0 conn(0x7f0c1809d6f0 legacy=0x7f0c1809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.689+0000 7f0c15d9b700 1 -- 172.21.15.59:0/24857777 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1809b2d0 con 0x7f0c1809e1d0 2023-09-30T22:32:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.690+0000 7f0c15d9b700 1 --2- 172.21.15.59:0/24857777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c1809e1d0 0x7f0c18135910 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009840 tx=0x7f0c0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c3ab42ab369899 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:51.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.690+0000 7f0c1559a700 1 -- 172.21.15.59:0/24857777 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c011830 con 0x7f0c1809e1d0 2023-09-30T22:32:51.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.690+0000 7f0c1559a700 1 -- 172.21.15.59:0/24857777 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c011990 con 0x7f0c1809e1d0 2023-09-30T22:32:51.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.690+0000 7f0c1559a700 1 -- 172.21.15.59:0/24857777 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c011d00 con 0x7f0c1809e1d0 2023-09-30T22:32:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.691+0000 7f0c1cf74700 1 -- 172.21.15.59:0/24857777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c1809e1d0 msgr2=0x7f0c18135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.691+0000 7f0c1cf74700 1 --2- 172.21.15.59:0/24857777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c1809e1d0 0x7f0c18135910 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009840 tx=0x7f0c0c009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.691+0000 7f0c1cf74700 1 -- 172.21.15.59:0/24857777 shutdown_connections 2023-09-30T22:32:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.691+0000 7f0c1cf74700 1 --2- 172.21.15.59:0/24857777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c18135e50 0x7f0c18138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.691+0000 7f0c1cf74700 1 --2- 172.21.15.59:0/24857777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c1809e1d0 0x7f0c18135910 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.691+0000 7f0c1cf74700 1 -- 172.21.15.59:0/24857777 >> 172.21.15.59:0/24857777 conn(0x7f0c18066f50 msgr2=0x7f0c1809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:51.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.691+0000 7f0c1cf74700 1 -- 172.21.15.59:0/24857777 shutdown_connections 2023-09-30T22:32:51.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.691+0000 7f0c1cf74700 1 -- 172.21.15.59:0/24857777 wait complete. 2023-09-30T22:32:51.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.693+0000 7f0c1cf74700 1 Processor -- start 2023-09-30T22:32:51.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.693+0000 7f0c1cf74700 1 -- start start 2023-09-30T22:32:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c1cf74700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c1809d6f0 0x7f0c18134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c1cf74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c1809e1d0 0x7f0c18134ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c1cf74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c18135e50 0x7f0c18135530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c1cf74700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c18133cd0 con 0x7f0c1809d6f0 2023-09-30T22:32:51.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c1cf74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c18135a70 con 0x7f0c18135e50 2023-09-30T22:32:51.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c1cf74700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c181389a0 con 0x7f0c1809e1d0 2023-09-30T22:32:51.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c16d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c18135e50 0x7f0c18135530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c1659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c1809d6f0 0x7f0c18134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c16d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c18135e50 0x7f0c18135530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48864/0 (socket says 172.21.15.59:48864) 2023-09-30T22:32:51.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c1659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c1809d6f0 0x7f0c18134ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41734/0 (socket says 172.21.15.59:41734) 2023-09-30T22:32:51.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c16d9d700 1 -- 172.21.15.59:0/2336304676 learned_addr learned my addr 172.21.15.59:0/2336304676 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:51.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c15d9b700 1 --2- 172.21.15.59:0/2336304676 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c1809e1d0 0x7f0c18134ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:51.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c16d9d700 1 -- 172.21.15.59:0/2336304676 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c1809e1d0 msgr2=0x7f0c18134ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c16d9d700 1 --2- 172.21.15.59:0/2336304676 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c1809e1d0 0x7f0c18134ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c16d9d700 1 -- 172.21.15.59:0/2336304676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c1809d6f0 msgr2=0x7f0c18134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c16d9d700 1 --2- 172.21.15.59:0/2336304676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c1809d6f0 0x7f0c18134ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.694+0000 7f0c16d9d700 1 -- 172.21.15.59:0/2336304676 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c0094a0 con 0x7f0c18135e50 2023-09-30T22:32:51.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.695+0000 7f0c16d9d700 1 --2- 172.21.15.59:0/2336304676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c18135e50 0x7f0c18135530 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000efc0 tx=0x7f0c1000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:51.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.695+0000 7f0c06ffd700 1 -- 172.21.15.59:0/2336304676 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1000cc90 con 0x7f0c18135e50 2023-09-30T22:32:51.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.695+0000 7f0c06ffd700 1 -- 172.21.15.59:0/2336304676 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1000f040 con 0x7f0c18135e50 2023-09-30T22:32:51.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.695+0000 7f0c06ffd700 1 -- 172.21.15.59:0/2336304676 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c10014480 con 0x7f0c18135e50 2023-09-30T22:32:51.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.695+0000 7f0c1cf74700 1 -- 172.21.15.59:0/2336304676 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c1809c700 con 0x7f0c18135e50 2023-09-30T22:32:51.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.695+0000 7f0c1cf74700 1 -- 172.21.15.59:0/2336304676 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c18132c30 con 0x7f0c18135e50 2023-09-30T22:32:51.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.696+0000 7f0c06ffd700 1 -- 172.21.15.59:0/2336304676 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c100145e0 con 0x7f0c18135e50 2023-09-30T22:32:51.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.696+0000 7f0c1cf74700 1 -- 172.21.15.59:0/2336304676 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c18071700 con 0x7f0c18135e50 2023-09-30T22:32:51.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.696+0000 7f0c06ffd700 1 -- 172.21.15.59:0/2336304676 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0c10040280 con 0x7f0c18135e50 2023-09-30T22:32:51.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.701+0000 7f0c06ffd700 1 -- 172.21.15.59:0/2336304676 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c10007920 con 0x7f0c18135e50 2023-09-30T22:32:51.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.826+0000 7f5b86038700 1 -- 172.21.15.59:0/1822382891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5b800724a0 con 0x7f5b8009e410 2023-09-30T22:32:51.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.826+0000 7f5b67fff700 1 -- 172.21.15.59:0/1822382891 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b7002a090 con 0x7f5b8009e410 2023-09-30T22:32:51.828 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.828+0000 7f5b86038700 1 -- 172.21.15.59:0/1822382891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8009e410 msgr2=0x7f5b801a6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.828+0000 7f5b86038700 1 --2- 172.21.15.59:0/1822382891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8009e410 0x7f5b801a6980 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000e810 tx=0x7f5b7000eb20 comp rx=0 tx=0).stop 2023-09-30T22:32:51.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.828+0000 7f5b86038700 1 -- 172.21.15.59:0/1822382891 shutdown_connections 2023-09-30T22:32:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.828+0000 7f5b86038700 1 --2- 172.21.15.59:0/1822382891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8009d6f0 0x7f5b801a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.828+0000 7f5b86038700 1 --2- 172.21.15.59:0/1822382891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8009e410 0x7f5b801a6980 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.828+0000 7f5b86038700 1 --2- 172.21.15.59:0/1822382891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8009e000 0x7f5b801a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.828+0000 7f5b86038700 1 -- 172.21.15.59:0/1822382891 >> 172.21.15.59:0/1822382891 conn(0x7f5b80066f50 msgr2=0x7f5b801babc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.828+0000 7f5b86038700 1 -- 172.21.15.59:0/1822382891 shutdown_connections 2023-09-30T22:32:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.828+0000 7f5b86038700 1 -- 172.21.15.59:0/1822382891 wait complete. 2023-09-30T22:32:51.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:51.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.866+0000 7f2f0d608700 1 -- 172.21.15.59:0/206659116 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2f080713a0 con 0x7f2f08135c20 2023-09-30T22:32:51.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.866+0000 7f2eef7fe700 1 -- 172.21.15.59:0/206659116 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f0001d400 con 0x7f2f08135c20 2023-09-30T22:32:51.868 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:51.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.868+0000 7f2f0d608700 1 -- 172.21.15.59:0/206659116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f08135c20 msgr2=0x7f2f08133920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.868+0000 7f2f0d608700 1 --2- 172.21.15.59:0/206659116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f08135c20 0x7f2f08133920 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2f0812ced0 tx=0x7f2f00004ad0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.868+0000 7f2f0d608700 1 -- 172.21.15.59:0/206659116 shutdown_connections 2023-09-30T22:32:51.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.868+0000 7f2f0d608700 1 --2- 172.21.15.59:0/206659116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f08135c20 0x7f2f08133920 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.868+0000 7f2f0d608700 1 --2- 172.21.15.59:0/206659116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f0806f5d0 0x7f2f08132ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.868+0000 7f2f0d608700 1 --2- 172.21.15.59:0/206659116 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f0812cf60 0x7f2f081333e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.869+0000 7f2f0d608700 1 -- 172.21.15.59:0/206659116 >> 172.21.15.59:0/206659116 conn(0x7f2f080a2aa0 msgr2=0x7f2f0806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:51.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.869+0000 7f2f0d608700 1 -- 172.21.15.59:0/206659116 shutdown_connections 2023-09-30T22:32:51.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.869+0000 7f2f0d608700 1 -- 172.21.15.59:0/206659116 wait complete. 2023-09-30T22:32:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.877+0000 7fd5538b7700 1 -- 172.21.15.59:0/1177788107 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd54c072710 con 0x7fd54c1cd520 2023-09-30T22:32:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.878+0000 7fd541ffb700 1 -- 172.21.15.59:0/1177788107 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd53c028070 con 0x7fd54c1cd520 2023-09-30T22:32:51.879 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.881+0000 7fd5538b7700 1 -- 172.21.15.59:0/1177788107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd54c1cd520 msgr2=0x7fd54c121c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.881+0000 7fd5538b7700 1 --2- 172.21.15.59:0/1177788107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd54c1cd520 0x7fd54c121c90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00b580 tx=0x7fd53c00b890 comp rx=0 tx=0).stop 2023-09-30T22:32:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.881+0000 7fd5538b7700 1 -- 172.21.15.59:0/1177788107 shutdown_connections 2023-09-30T22:32:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.881+0000 7fd5538b7700 1 --2- 172.21.15.59:0/1177788107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd54c1221d0 0x7fd54c122640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.881+0000 7fd5538b7700 1 --2- 172.21.15.59:0/1177788107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd54c1ccc10 0x7fd54c1ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.881+0000 7fd5538b7700 1 --2- 172.21.15.59:0/1177788107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd54c1cd520 0x7fd54c121c90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.881+0000 7fd5538b7700 1 -- 172.21.15.59:0/1177788107 >> 172.21.15.59:0/1177788107 conn(0x7fd54c066f50 msgr2=0x7fd54c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:51.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.881+0000 7fd5538b7700 1 -- 172.21.15.59:0/1177788107 shutdown_connections 2023-09-30T22:32:51.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.881+0000 7fd5538b7700 1 -- 172.21.15.59:0/1177788107 wait complete. 2023-09-30T22:32:51.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:51.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:51.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.910+0000 7f0c1cf74700 1 -- 172.21.15.59:0/2336304676 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0c18133b10 con 0x7f0c18135e50 2023-09-30T22:32:51.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.911+0000 7f0c06ffd700 1 -- 172.21.15.59:0/2336304676 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c10018020 con 0x7f0c18135e50 2023-09-30T22:32:51.912 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:51.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.913+0000 7f0c1cf74700 1 -- 172.21.15.59:0/2336304676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c18135e50 msgr2=0x7f0c18135530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:51.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.913+0000 7f0c1cf74700 1 --2- 172.21.15.59:0/2336304676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c18135e50 0x7f0c18135530 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000efc0 tx=0x7f0c1000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.913+0000 7f0c1cf74700 1 -- 172.21.15.59:0/2336304676 shutdown_connections 2023-09-30T22:32:51.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.913+0000 7f0c1cf74700 1 --2- 172.21.15.59:0/2336304676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c18135e50 0x7f0c18135530 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.913+0000 7f0c1cf74700 1 --2- 172.21.15.59:0/2336304676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c1809d6f0 0x7f0c18134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.913+0000 7f0c1cf74700 1 --2- 172.21.15.59:0/2336304676 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c1809e1d0 0x7f0c18134ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:51.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.913+0000 7f0c1cf74700 1 -- 172.21.15.59:0/2336304676 >> 172.21.15.59:0/2336304676 conn(0x7f0c18066f50 msgr2=0x7f0c1806e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:51.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.913+0000 7f0c1cf74700 1 -- 172.21.15.59:0/2336304676 shutdown_connections 2023-09-30T22:32:51.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:51.913+0000 7f0c1cf74700 1 -- 172.21.15.59:0/2336304676 wait complete. 2023-09-30T22:32:51.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:52.845 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:52.884 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:52.897 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:52.928 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:53.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.005+0000 7f007bb56700 1 Processor -- start 2023-09-30T22:32:53.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.005+0000 7f007bb56700 1 -- start start 2023-09-30T22:32:53.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.006+0000 7f007bb56700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0074130540 0x7f0074130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.006+0000 7f007bb56700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f007406fcf0 0x7f0074138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.006+0000 7f007bb56700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00740716a0 con 0x7f0074130e50 2023-09-30T22:32:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.006+0000 7f007bb56700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007409a390 con 0x7f007406fcf0 2023-09-30T22:32:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.006+0000 7f007bb56700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0074071290 con 0x7f0074130540 2023-09-30T22:32:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.006+0000 7f007a0f3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f007406fcf0 0x7f0074138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.006+0000 7f007a0f3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f007406fcf0 0x7f0074138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41748/0 (socket says 172.21.15.59:41748) 2023-09-30T22:32:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.006+0000 7f007a0f3700 1 -- 172.21.15.59:0/2489236226 learned_addr learned my addr 172.21.15.59:0/2489236226 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.006+0000 7f00798f2700 1 --2- 172.21.15.59:0/2489236226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0074130540 0x7f0074130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.007+0000 7f007a0f3700 1 -- 172.21.15.59:0/2489236226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0074130540 msgr2=0x7f0074130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:53.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.007+0000 7f007a0f3700 1 --2- 172.21.15.59:0/2489236226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0074130540 0x7f0074130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.007+0000 7f007a0f3700 1 -- 172.21.15.59:0/2489236226 >> v1:172.21.15.59:6789/0 conn(0x7f0074130e50 legacy=0x7f007406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.007+0000 7f007a0f3700 1 -- 172.21.15.59:0/2489236226 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0074130340 con 0x7f007406fcf0 2023-09-30T22:32:53.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.007+0000 7f007a0f3700 1 --2- 172.21.15.59:0/2489236226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007406fcf0 0x7f0074138570 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f006c00d150 tx=0x7f006c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27baa4b1fe3b5d81 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:53.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.007+0000 7f00788f0700 1 -- 172.21.15.59:0/2489236226 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c010070 con 0x7f007406fcf0 2023-09-30T22:32:53.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.007+0000 7f00788f0700 1 -- 172.21.15.59:0/2489236226 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c00dd10 con 0x7f007406fcf0 2023-09-30T22:32:53.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.007+0000 7f00788f0700 1 -- 172.21.15.59:0/2489236226 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00b310 con 0x7f007406fcf0 2023-09-30T22:32:53.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.008+0000 7f007bb56700 1 -- 172.21.15.59:0/2489236226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007406fcf0 msgr2=0x7f0074138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.008+0000 7f007bb56700 1 --2- 172.21.15.59:0/2489236226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007406fcf0 0x7f0074138570 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f006c00d150 tx=0x7f006c00d460 comp rx=0 tx=0).stop 2023-09-30T22:32:53.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.008+0000 7f007bb56700 1 -- 172.21.15.59:0/2489236226 shutdown_connections 2023-09-30T22:32:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.008+0000 7f007bb56700 1 --2- 172.21.15.59:0/2489236226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007406fcf0 0x7f0074138570 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.008+0000 7f007bb56700 1 --2- 172.21.15.59:0/2489236226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0074130540 0x7f0074130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.008+0000 7f007bb56700 1 -- 172.21.15.59:0/2489236226 >> 172.21.15.59:0/2489236226 conn(0x7f00740a2aa0 msgr2=0x7f00740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.008+0000 7f007bb56700 1 -- 172.21.15.59:0/2489236226 shutdown_connections 2023-09-30T22:32:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.008+0000 7f007bb56700 1 -- 172.21.15.59:0/2489236226 wait complete. 2023-09-30T22:32:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.009+0000 7f007bb56700 1 Processor -- start 2023-09-30T22:32:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.009+0000 7f007bb56700 1 -- start start 2023-09-30T22:32:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.010+0000 7f007bb56700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007406fcf0 0x7f007411ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.010+0000 7f007bb56700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0074130540 0x7f007411ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.010+0000 7f007bb56700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0074130e50 0x7f007411f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.010+0000 7f007bb56700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007412c9a0 con 0x7f007406fcf0 2023-09-30T22:32:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.010+0000 7f007bb56700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0074120730 con 0x7f0074130540 2023-09-30T22:32:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.010+0000 7f007bb56700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0074121f90 con 0x7f0074130e50 2023-09-30T22:32:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.010+0000 7f007a0f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0074130e50 0x7f007411f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.010+0000 7f00790f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0074130540 0x7f007411ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.010+0000 7f007a0f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0074130e50 0x7f007411f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51068/0 (socket says 172.21.15.59:51068) 2023-09-30T22:32:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.010+0000 7f007a0f3700 1 -- 172.21.15.59:0/118257433 learned_addr learned my addr 172.21.15.59:0/118257433 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.010+0000 7f00798f2700 1 --2- 172.21.15.59:0/118257433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007406fcf0 0x7f007411ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.011+0000 7f00790f1700 1 -- 172.21.15.59:0/118257433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0074130e50 msgr2=0x7f007411f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.011+0000 7f00790f1700 1 --2- 172.21.15.59:0/118257433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0074130e50 0x7f007411f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.011+0000 7f00790f1700 1 -- 172.21.15.59:0/118257433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007406fcf0 msgr2=0x7f007411ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.011+0000 7f00790f1700 1 --2- 172.21.15.59:0/118257433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007406fcf0 0x7f007411ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.011+0000 7f00790f1700 1 -- 172.21.15.59:0/118257433 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c00bd40 con 0x7f0074130540 2023-09-30T22:32:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.011+0000 7f00790f1700 1 --2- 172.21.15.59:0/118257433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0074130540 0x7f007411ef50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0064000f60 tx=0x7f006400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.011+0000 7f006a7fc700 1 -- 172.21.15.59:0/118257433 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00640050d0 con 0x7f0074130540 2023-09-30T22:32:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.011+0000 7f006a7fc700 1 -- 172.21.15.59:0/118257433 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0064005230 con 0x7f0074130540 2023-09-30T22:32:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.011+0000 7f006a7fc700 1 -- 172.21.15.59:0/118257433 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0064003680 con 0x7f0074130540 2023-09-30T22:32:53.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.011+0000 7f007bb56700 1 -- 172.21.15.59:0/118257433 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007412c4e0 con 0x7f0074130540 2023-09-30T22:32:53.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.011+0000 7f007bb56700 1 -- 172.21.15.59:0/118257433 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0074122530 con 0x7f0074130540 2023-09-30T22:32:53.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.013+0000 7f007bb56700 1 -- 172.21.15.59:0/118257433 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0074074ea0 con 0x7f0074130540 2023-09-30T22:32:53.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.013+0000 7f006a7fc700 1 -- 172.21.15.59:0/118257433 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00640037e0 con 0x7f0074130540 2023-09-30T22:32:53.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.013+0000 7f006a7fc700 1 -- 172.21.15.59:0/118257433 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f006403e9c0 con 0x7f0074130540 2023-09-30T22:32:53.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.021+0000 7f006a7fc700 1 -- 172.21.15.59:0/118257433 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0064011590 con 0x7f0074130540 2023-09-30T22:32:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.051+0000 7f5e31f45700 1 Processor -- start 2023-09-30T22:32:53.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.051+0000 7f5e31f45700 1 -- start start 2023-09-30T22:32:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.052+0000 7f5e31f45700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e2c09d6f0 0x7f5e2c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.052+0000 7f5e31f45700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5e2c09e000 0x7f5e2c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.052+0000 7f5e31f45700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2c09f130 con 0x7f5e2c09e410 2023-09-30T22:32:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.052+0000 7f5e31f45700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e2c09f520 con 0x7f5e2c09e000 2023-09-30T22:32:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.052+0000 7f5e31f45700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c09e930 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.052+0000 7f5e2b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e2c09d6f0 0x7f5e2c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.052+0000 7f5e2b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e2c09d6f0 0x7f5e2c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51078/0 (socket says 172.21.15.59:51078) 2023-09-30T22:32:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.052+0000 7f5e2b7fe700 1 -- 172.21.15.59:0/3319240022 learned_addr learned my addr 172.21.15.59:0/3319240022 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.052+0000 7f5e2affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5e2c09e000 0x7f5e2c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.053+0000 7f5e2b7fe700 1 -- 172.21.15.59:0/3319240022 >> v2:172.21.15.59:3300/0 conn(0x7f5e2c09e000 msgr2=0x7f5e2c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.053+0000 7f5e2b7fe700 1 --2- 172.21.15.59:0/3319240022 >> v2:172.21.15.59:3300/0 conn(0x7f5e2c09e000 0x7f5e2c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.053+0000 7f5e2b7fe700 1 -- 172.21.15.59:0/3319240022 >> v1:172.21.15.59:6789/0 conn(0x7f5e2c09e410 legacy=0x7f5e2c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.053+0000 7f5e2b7fe700 1 -- 172.21.15.59:0/3319240022 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2c09b2d0 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.053+0000 7f5e2b7fe700 1 --2- 172.21.15.59:0/3319240022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e2c09d6f0 0x7f5e2c09dac0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00bb90 tx=0x7f5e1c00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e818c83bc5a413e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.053+0000 7f5e2a7fc700 1 -- 172.21.15.59:0/3319240022 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c00dd30 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.053+0000 7f5e2a7fc700 1 -- 172.21.15.59:0/3319240022 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c00de90 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.053+0000 7f5e2a7fc700 1 -- 172.21.15.59:0/3319240022 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c010690 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.054+0000 7f5e31f45700 1 -- 172.21.15.59:0/3319240022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e2c09d6f0 msgr2=0x7f5e2c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.054+0000 7f5e31f45700 1 --2- 172.21.15.59:0/3319240022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e2c09d6f0 0x7f5e2c09dac0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00bb90 tx=0x7f5e1c00bea0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.054+0000 7f5e31f45700 1 -- 172.21.15.59:0/3319240022 shutdown_connections 2023-09-30T22:32:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.054+0000 7f5e31f45700 1 --2- 172.21.15.59:0/3319240022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e2c09d6f0 0x7f5e2c09dac0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.054+0000 7f5e31f45700 1 --2- 172.21.15.59:0/3319240022 >> v2:172.21.15.59:3300/0 conn(0x7f5e2c09e000 0x7f5e2c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.054+0000 7f5e31f45700 1 -- 172.21.15.59:0/3319240022 >> 172.21.15.59:0/3319240022 conn(0x7f5e2c066f50 msgr2=0x7f5e2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.054+0000 7f5e31f45700 1 -- 172.21.15.59:0/3319240022 shutdown_connections 2023-09-30T22:32:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.054+0000 7f5e31f45700 1 -- 172.21.15.59:0/3319240022 wait complete. 2023-09-30T22:32:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.056+0000 7f5e31f45700 1 Processor -- start 2023-09-30T22:32:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.056+0000 7f5e31f45700 1 -- start start 2023-09-30T22:32:53.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.057+0000 7f5e31f45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e2c09d6f0 0x7f5e2c122430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.057+0000 7f5e31f45700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e2c09e000 0x7f5e2c122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.057+0000 7f5e31f45700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e2c09e410 0x7f5e2c122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.057+0000 7f5e31f45700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c124640 con 0x7f5e2c09e000 2023-09-30T22:32:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.057+0000 7f5e31f45700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c125f00 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.057+0000 7f5e31f45700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c0a1d90 con 0x7f5e2c09e410 2023-09-30T22:32:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.057+0000 7f5e2bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e2c09e410 0x7f5e2c122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.057+0000 7f5e2bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e2c09e410 0x7f5e2c122eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51088/0 (socket says 172.21.15.59:51088) 2023-09-30T22:32:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.057+0000 7f5e2bfff700 1 -- 172.21.15.59:0/2001195656 learned_addr learned my addr 172.21.15.59:0/2001195656 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.057+0000 7f5e2b7fe700 1 --2- 172.21.15.59:0/2001195656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e2c09d6f0 0x7f5e2c122430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.057+0000 7f5e2affd700 1 --2- 172.21.15.59:0/2001195656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e2c09e000 0x7f5e2c122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.058+0000 7f5e2b7fe700 1 -- 172.21.15.59:0/2001195656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e2c09e410 msgr2=0x7f5e2c122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.058+0000 7f5e2b7fe700 1 --2- 172.21.15.59:0/2001195656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e2c09e410 0x7f5e2c122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.058+0000 7f5e2b7fe700 1 -- 172.21.15.59:0/2001195656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e2c09e000 msgr2=0x7f5e2c122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.058+0000 7f5e2b7fe700 1 --2- 172.21.15.59:0/2001195656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e2c09e000 0x7f5e2c122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.058+0000 7f5e2b7fe700 1 -- 172.21.15.59:0/2001195656 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1c00b7f0 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.058+0000 7f5e2b7fe700 1 --2- 172.21.15.59:0/2001195656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e2c09d6f0 0x7f5e2c122430 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c018000 tx=0x7f5e1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:53.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.058+0000 7f5e13fff700 1 -- 172.21.15.59:0/2001195656 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c003bf0 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.058+0000 7f5e13fff700 1 -- 172.21.15.59:0/2001195656 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c003d70 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.058+0000 7f5e31f45700 1 -- 172.21.15.59:0/2001195656 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2c123ff0 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.058+0000 7f5e13fff700 1 -- 172.21.15.59:0/2001195656 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c0106b0 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.058+0000 7f5e31f45700 1 -- 172.21.15.59:0/2001195656 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2c09c750 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.059+0000 7f5e31f45700 1 -- 172.21.15.59:0/2001195656 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2c074ea0 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.059+0000 7f5e13fff700 1 -- 172.21.15.59:0/2001195656 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e1c019400 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.060+0000 7f5e13fff700 1 -- 172.21.15.59:0/2001195656 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5e1c040cc0 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.069+0000 7f5e13fff700 1 -- 172.21.15.59:0/2001195656 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e1c0223f0 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.084+0000 7feffa7dc700 1 Processor -- start 2023-09-30T22:32:53.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.084+0000 7feffa7dc700 1 -- start start 2023-09-30T22:32:53.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feffa7dc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feff406c0e0 0x7feff409ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feffa7dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feff4134ec0 0x7feff41379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feffa7dc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feff4137f20 0x7feff4138370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feffa7dc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff406c4b0 con 0x7feff406c0e0 2023-09-30T22:32:53.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feffa7dc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff41388b0 con 0x7feff4134ec0 2023-09-30T22:32:53.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feffa7dc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feff40a09c0 con 0x7feff4137f20 2023-09-30T22:32:53.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feff3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feff406c0e0 0x7feff409ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feff8d79700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feff4137f20 0x7feff4138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feff3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feff406c0e0 0x7feff409ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41780/0 (socket says 172.21.15.59:41780) 2023-09-30T22:32:53.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feff3fff700 1 -- 172.21.15.59:0/1422367830 learned_addr learned my addr 172.21.15.59:0/1422367830 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:53.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feff37fe700 1 --2- 172.21.15.59:0/1422367830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feff4134ec0 0x7feff41379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feff3fff700 1 -- 172.21.15.59:0/1422367830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feff4137f20 msgr2=0x7feff4138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:53.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feff3fff700 1 --2- 172.21.15.59:0/1422367830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feff4137f20 0x7feff4138370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feff3fff700 1 -- 172.21.15.59:0/1422367830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feff4134ec0 msgr2=0x7feff41379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:53.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feff3fff700 1 --2- 172.21.15.59:0/1422367830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feff4134ec0 0x7feff41379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feff3fff700 1 -- 172.21.15.59:0/1422367830 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff4134980 con 0x7feff406c0e0 2023-09-30T22:32:53.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.085+0000 7feff37fe700 1 --2- 172.21.15.59:0/1422367830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feff4134ec0 0x7feff41379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:53.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.086+0000 7feff3fff700 1 --2- 172.21.15.59:0/1422367830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feff406c0e0 0x7feff409ac90 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fefe40098f0 tx=0x7fefe4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3cd21cd31a557f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:53.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.086+0000 7feff2ffd700 1 -- 172.21.15.59:0/1422367830 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe4011830 con 0x7feff406c0e0 2023-09-30T22:32:53.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.086+0000 7feff2ffd700 1 -- 172.21.15.59:0/1422367830 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe4011990 con 0x7feff406c0e0 2023-09-30T22:32:53.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.086+0000 7feff2ffd700 1 -- 172.21.15.59:0/1422367830 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe4011d20 con 0x7feff406c0e0 2023-09-30T22:32:53.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.087+0000 7feffa7dc700 1 -- 172.21.15.59:0/1422367830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feff406c0e0 msgr2=0x7feff409ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.087+0000 7feffa7dc700 1 --2- 172.21.15.59:0/1422367830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feff406c0e0 0x7feff409ac90 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fefe40098f0 tx=0x7fefe4009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:53.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.087+0000 7feffa7dc700 1 -- 172.21.15.59:0/1422367830 shutdown_connections 2023-09-30T22:32:53.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.087+0000 7feffa7dc700 1 --2- 172.21.15.59:0/1422367830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feff4137f20 0x7feff4138370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.087+0000 7feffa7dc700 1 --2- 172.21.15.59:0/1422367830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feff406c0e0 0x7feff409ac90 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.087+0000 7feffa7dc700 1 --2- 172.21.15.59:0/1422367830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feff4134ec0 0x7feff41379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.087+0000 7feffa7dc700 1 -- 172.21.15.59:0/1422367830 >> 172.21.15.59:0/1422367830 conn(0x7feff40a4210 msgr2=0x7feff40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:53.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.087+0000 7feffa7dc700 1 -- 172.21.15.59:0/1422367830 shutdown_connections 2023-09-30T22:32:53.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.087+0000 7feffa7dc700 1 -- 172.21.15.59:0/1422367830 wait complete. 2023-09-30T22:32:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.088+0000 7feffa7dc700 1 Processor -- start 2023-09-30T22:32:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.089+0000 7feffa7dc700 1 -- start start 2023-09-30T22:32:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.089+0000 7feffa7dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feff406c0e0 0x7feff411a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.089+0000 7feffa7dc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feff4134ec0 0x7feff411abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7feffa7dc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feff4137f20 0x7feff411b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7feffa7dc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff411d800 con 0x7feff4134ec0 2023-09-30T22:32:53.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7feffa7dc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff4134400 con 0x7feff406c0e0 2023-09-30T22:32:53.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7feffa7dc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feff411c400 con 0x7feff4137f20 2023-09-30T22:32:53.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7feff8d79700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feff4137f20 0x7feff411b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7feff8d79700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feff4137f20 0x7feff411b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51108/0 (socket says 172.21.15.59:51108) 2023-09-30T22:32:53.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7feff8d79700 1 -- 172.21.15.59:0/4151876856 learned_addr learned my addr 172.21.15.59:0/4151876856 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:53.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7feff3fff700 1 --2- 172.21.15.59:0/4151876856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feff406c0e0 0x7feff411a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7feff8d79700 1 -- 172.21.15.59:0/4151876856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feff406c0e0 msgr2=0x7feff411a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7feff8d79700 1 --2- 172.21.15.59:0/4151876856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feff406c0e0 0x7feff411a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7feff8d79700 1 -- 172.21.15.59:0/4151876856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feff4134ec0 msgr2=0x7feff411abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7feff8d79700 1 --2- 172.21.15.59:0/4151876856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feff4134ec0 0x7feff411abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7feff8d79700 1 -- 172.21.15.59:0/4151876856 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe4009550 con 0x7feff4137f20 2023-09-30T22:32:53.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7f383c3d2700 1 Processor -- start 2023-09-30T22:32:53.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7f383c3d2700 1 -- start start 2023-09-30T22:32:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.090+0000 7feff8d79700 1 --2- 172.21.15.59:0/4151876856 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feff4137f20 0x7feff411b100 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fefec00efc0 tx=0x7fefec00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.091+0000 7feff0ff9700 1 -- 172.21.15.59:0/4151876856 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec009ea0 con 0x7feff4137f20 2023-09-30T22:32:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.091+0000 7feff0ff9700 1 -- 172.21.15.59:0/4151876856 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec00f040 con 0x7feff4137f20 2023-09-30T22:32:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.091+0000 7feffa7dc700 1 -- 172.21.15.59:0/4151876856 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff40a03f0 con 0x7feff4137f20 2023-09-30T22:32:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.091+0000 7feffa7dc700 1 -- 172.21.15.59:0/4151876856 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff411de40 con 0x7feff4137f20 2023-09-30T22:32:53.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.091+0000 7f383c3d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3834130660 0x7f3834130a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.091+0000 7f383c3d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f383406ae80 0x7f383406b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.091+0000 7f383c3d2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383409f130 con 0x7f3834130f70 2023-09-30T22:32:53.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.091+0000 7f383c3d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383409f520 con 0x7f383406ae80 2023-09-30T22:32:53.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.091+0000 7f383c3d2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f383409e930 con 0x7f3834130660 2023-09-30T22:32:53.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.091+0000 7f383a16e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3834130660 0x7f3834130a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.092+0000 7f383a16e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3834130660 0x7f3834130a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51120/0 (socket says 172.21.15.59:51120) 2023-09-30T22:32:53.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.092+0000 7f383a16e700 1 -- 172.21.15.59:0/525961300 learned_addr learned my addr 172.21.15.59:0/525961300 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:53.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.092+0000 7f383a16e700 1 -- 172.21.15.59:0/525961300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f383406ae80 msgr2=0x7f383406b320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:32:53.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.092+0000 7f383a16e700 1 --2- 172.21.15.59:0/525961300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f383406ae80 0x7f383406b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.092+0000 7f383a16e700 1 -- 172.21.15.59:0/525961300 >> v1:172.21.15.59:6789/0 conn(0x7f3834130f70 legacy=0x7f383406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.092+0000 7f383a16e700 1 -- 172.21.15.59:0/525961300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383409e700 con 0x7f3834130660 2023-09-30T22:32:53.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.091+0000 7feff0ff9700 1 -- 172.21.15.59:0/4151876856 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec014480 con 0x7feff4137f20 2023-09-30T22:32:53.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.092+0000 7feff0ff9700 1 -- 172.21.15.59:0/4151876856 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fefec0145e0 con 0x7feff4137f20 2023-09-30T22:32:53.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.092+0000 7f383a16e700 1 --2- 172.21.15.59:0/525961300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3834130660 0x7f3834130a30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3830009920 tx=0x7f3830009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e823958f4fe8644 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.092+0000 7feffa7dc700 1 -- 172.21.15.59:0/4151876856 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd40052e0 con 0x7feff4137f20 2023-09-30T22:32:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.092+0000 7feff0ff9700 1 -- 172.21.15.59:0/4151876856 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fefec040280 con 0x7feff4137f20 2023-09-30T22:32:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.092+0000 7f383916c700 1 -- 172.21.15.59:0/525961300 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383000ba60 con 0x7f3834130660 2023-09-30T22:32:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.093+0000 7f383916c700 1 -- 172.21.15.59:0/525961300 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383000bbc0 con 0x7f3834130660 2023-09-30T22:32:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.093+0000 7f383916c700 1 -- 172.21.15.59:0/525961300 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830009e70 con 0x7f3834130660 2023-09-30T22:32:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.093+0000 7f383c3d2700 1 -- 172.21.15.59:0/525961300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3834130660 msgr2=0x7f3834130a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.093+0000 7f383c3d2700 1 --2- 172.21.15.59:0/525961300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3834130660 0x7f3834130a30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3830009920 tx=0x7f3830009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.095+0000 7f383c3d2700 1 -- 172.21.15.59:0/525961300 shutdown_connections 2023-09-30T22:32:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.095+0000 7f383c3d2700 1 --2- 172.21.15.59:0/525961300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3834130660 0x7f3834130a30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.095+0000 7f383c3d2700 1 --2- 172.21.15.59:0/525961300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f383406ae80 0x7f383406b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.095+0000 7f383c3d2700 1 -- 172.21.15.59:0/525961300 >> 172.21.15.59:0/525961300 conn(0x7f3834066f50 msgr2=0x7f383409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.095+0000 7f383c3d2700 1 -- 172.21.15.59:0/525961300 shutdown_connections 2023-09-30T22:32:53.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.095+0000 7f383c3d2700 1 -- 172.21.15.59:0/525961300 wait complete. 2023-09-30T22:32:53.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.096+0000 7f383c3d2700 1 Processor -- start 2023-09-30T22:32:53.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.096+0000 7f383c3d2700 1 -- start start 2023-09-30T22:32:53.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.097+0000 7f383c3d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f383406ae80 0x7f383413d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.097+0000 7f383c3d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3834130660 0x7f3834129d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.097+0000 7f383a16e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f383406ae80 0x7f383413d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.097+0000 7f383a16e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f383406ae80 0x7f383413d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51126/0 (socket says 172.21.15.59:51126) 2023-09-30T22:32:53.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.097+0000 7f383c3d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3834130f70 0x7f383412a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:53.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.097+0000 7f383c3d2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383412b8c0 con 0x7f3834130f70 2023-09-30T22:32:53.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.097+0000 7f383c3d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383412d450 con 0x7f3834130660 2023-09-30T22:32:53.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.097+0000 7f383c3d2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f383412d120 con 0x7f383406ae80 2023-09-30T22:32:53.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.097+0000 7f383a16e700 1 -- 172.21.15.59:0/32183485 learned_addr learned my addr 172.21.15.59:0/32183485 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:53.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.097+0000 7f383a96f700 1 --2- 172.21.15.59:0/32183485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3834130f70 0x7f383412a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:53.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.098+0000 7f383a16e700 1 -- 172.21.15.59:0/32183485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3834130660 msgr2=0x7f3834129d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:32:53.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.098+0000 7f383a16e700 1 --2- 172.21.15.59:0/32183485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3834130660 0x7f3834129d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.098+0000 7f383a16e700 1 -- 172.21.15.59:0/32183485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3834130f70 msgr2=0x7f383412a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.098+0000 7f383a16e700 1 --2- 172.21.15.59:0/32183485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3834130f70 0x7f383412a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.098+0000 7f383a16e700 1 -- 172.21.15.59:0/32183485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3830009550 con 0x7f383406ae80 2023-09-30T22:32:53.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.098+0000 7f383a16e700 1 --2- 172.21.15.59:0/32183485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f383406ae80 0x7f383413d160 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3830000c00 tx=0x7f3830004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:53.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.099+0000 7f382affd700 1 -- 172.21.15.59:0/32183485 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830004380 con 0x7f383406ae80 2023-09-30T22:32:53.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.099+0000 7f382affd700 1 -- 172.21.15.59:0/32183485 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383001f070 con 0x7f383406ae80 2023-09-30T22:32:53.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.099+0000 7f382affd700 1 -- 172.21.15.59:0/32183485 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38300036a0 con 0x7f383406ae80 2023-09-30T22:32:53.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.100+0000 7f383c3d2700 1 -- 172.21.15.59:0/32183485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383406ab00 con 0x7f383406ae80 2023-09-30T22:32:53.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.100+0000 7feff0ff9700 1 -- 172.21.15.59:0/4151876856 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fefec018070 con 0x7feff4137f20 2023-09-30T22:32:53.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.100+0000 7f383c3d2700 1 -- 172.21.15.59:0/32183485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383412b100 con 0x7f383406ae80 2023-09-30T22:32:53.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.101+0000 7f382affd700 1 -- 172.21.15.59:0/32183485 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3830021030 con 0x7f383406ae80 2023-09-30T22:32:53.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.101+0000 7f383c3d2700 1 -- 172.21.15.59:0/32183485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383412c410 con 0x7f383406ae80 2023-09-30T22:32:53.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.101+0000 7f382affd700 1 -- 172.21.15.59:0/32183485 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f38300408b0 con 0x7f383406ae80 2023-09-30T22:32:53.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.110+0000 7f382affd700 1 -- 172.21.15.59:0/32183485 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3830003d40 con 0x7f383406ae80 2023-09-30T22:32:53.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.250+0000 7f007bb56700 1 -- 172.21.15.59:0/118257433 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0074122150 con 0x7f0074130540 2023-09-30T22:32:53.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.250+0000 7f006a7fc700 1 -- 172.21.15.59:0/118257433 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00640192c0 con 0x7f0074130540 2023-09-30T22:32:53.251 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:53.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.253+0000 7f007bb56700 1 -- 172.21.15.59:0/118257433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0074130540 msgr2=0x7f007411ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.253+0000 7f007bb56700 1 --2- 172.21.15.59:0/118257433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0074130540 0x7f007411ef50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0064000f60 tx=0x7f006400c730 comp rx=0 tx=0).stop 2023-09-30T22:32:53.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.253+0000 7f007bb56700 1 -- 172.21.15.59:0/118257433 shutdown_connections 2023-09-30T22:32:53.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.253+0000 7f007bb56700 1 --2- 172.21.15.59:0/118257433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0074130e50 0x7f007411f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.253+0000 7f007bb56700 1 --2- 172.21.15.59:0/118257433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007406fcf0 0x7f007411ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.253+0000 7f007bb56700 1 --2- 172.21.15.59:0/118257433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0074130540 0x7f007411ef50 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.254+0000 7f007bb56700 1 -- 172.21.15.59:0/118257433 >> 172.21.15.59:0/118257433 conn(0x7f00740a2aa0 msgr2=0x7f007412d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:53.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.254+0000 7f007bb56700 1 -- 172.21.15.59:0/118257433 shutdown_connections 2023-09-30T22:32:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.254+0000 7f007bb56700 1 -- 172.21.15.59:0/118257433 wait complete. 2023-09-30T22:32:53.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:53.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.297+0000 7f5e31f45700 1 -- 172.21.15.59:0/2001195656 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5e2c06c360 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.298+0000 7f5e13fff700 1 -- 172.21.15.59:0/2001195656 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e1c027070 con 0x7f5e2c09d6f0 2023-09-30T22:32:53.299 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:53.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.301+0000 7f5e31f45700 1 -- 172.21.15.59:0/2001195656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e2c09d6f0 msgr2=0x7f5e2c122430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.301+0000 7f5e31f45700 1 --2- 172.21.15.59:0/2001195656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e2c09d6f0 0x7f5e2c122430 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c018000 tx=0x7f5e1c004750 comp rx=0 tx=0).stop 2023-09-30T22:32:53.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.301+0000 7f5e31f45700 1 -- 172.21.15.59:0/2001195656 shutdown_connections 2023-09-30T22:32:53.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.301+0000 7f5e31f45700 1 --2- 172.21.15.59:0/2001195656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e2c09e410 0x7f5e2c122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.301+0000 7f5e31f45700 1 --2- 172.21.15.59:0/2001195656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e2c09d6f0 0x7f5e2c122430 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.301+0000 7f5e31f45700 1 --2- 172.21.15.59:0/2001195656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e2c09e000 0x7f5e2c122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.301+0000 7f5e31f45700 1 -- 172.21.15.59:0/2001195656 >> 172.21.15.59:0/2001195656 conn(0x7f5e2c066f50 msgr2=0x7f5e2c0710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:53.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.301+0000 7f5e31f45700 1 -- 172.21.15.59:0/2001195656 shutdown_connections 2023-09-30T22:32:53.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.301+0000 7f5e31f45700 1 -- 172.21.15.59:0/2001195656 wait complete. 2023-09-30T22:32:53.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:53.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.329+0000 7f383c3d2700 1 -- 172.21.15.59:0/32183485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f383412c850 con 0x7f383406ae80 2023-09-30T22:32:53.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.329+0000 7f382affd700 1 -- 172.21.15.59:0/32183485 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3830029020 con 0x7f383406ae80 2023-09-30T22:32:53.330 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.331+0000 7f383c3d2700 1 -- 172.21.15.59:0/32183485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f383406ae80 msgr2=0x7f383413d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.331+0000 7f383c3d2700 1 --2- 172.21.15.59:0/32183485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f383406ae80 0x7f383413d160 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3830000c00 tx=0x7f3830004750 comp rx=0 tx=0).stop 2023-09-30T22:32:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.331+0000 7f383c3d2700 1 -- 172.21.15.59:0/32183485 shutdown_connections 2023-09-30T22:32:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.331+0000 7f383c3d2700 1 --2- 172.21.15.59:0/32183485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f383406ae80 0x7f383413d160 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.331+0000 7f383c3d2700 1 --2- 172.21.15.59:0/32183485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3834130f70 0x7f383412a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.331+0000 7f383c3d2700 1 --2- 172.21.15.59:0/32183485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3834130660 0x7f3834129d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.331+0000 7f383c3d2700 1 -- 172.21.15.59:0/32183485 >> 172.21.15.59:0/32183485 conn(0x7f3834066f50 msgr2=0x7f38341255b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.331+0000 7f383c3d2700 1 -- 172.21.15.59:0/32183485 shutdown_connections 2023-09-30T22:32:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.331+0000 7f383c3d2700 1 -- 172.21.15.59:0/32183485 wait complete. 2023-09-30T22:32:53.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.334+0000 7feffa7dc700 1 -- 172.21.15.59:0/4151876856 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fefd4005150 con 0x7feff4137f20 2023-09-30T22:32:53.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.334+0000 7feff0ff9700 1 -- 172.21.15.59:0/4151876856 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fefec0076f0 con 0x7feff4137f20 2023-09-30T22:32:53.335 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:53.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.336+0000 7feffa7dc700 1 -- 172.21.15.59:0/4151876856 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feff4137f20 msgr2=0x7feff411b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:53.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.336+0000 7feffa7dc700 1 --2- 172.21.15.59:0/4151876856 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feff4137f20 0x7feff411b100 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fefec00efc0 tx=0x7fefec00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.336+0000 7feffa7dc700 1 -- 172.21.15.59:0/4151876856 shutdown_connections 2023-09-30T22:32:53.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.336+0000 7feffa7dc700 1 --2- 172.21.15.59:0/4151876856 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feff4137f20 0x7feff411b100 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.336+0000 7feffa7dc700 1 --2- 172.21.15.59:0/4151876856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feff406c0e0 0x7feff411a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.336+0000 7feffa7dc700 1 --2- 172.21.15.59:0/4151876856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feff4134ec0 0x7feff411abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:53.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.337+0000 7feffa7dc700 1 -- 172.21.15.59:0/4151876856 >> 172.21.15.59:0/4151876856 conn(0x7feff40a4210 msgr2=0x7feff4099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:53.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.337+0000 7feffa7dc700 1 -- 172.21.15.59:0/4151876856 shutdown_connections 2023-09-30T22:32:53.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:53.337+0000 7feffa7dc700 1 -- 172.21.15.59:0/4151876856 wait complete. 2023-09-30T22:32:53.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:53.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:54.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:54.322 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:54.349 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:54.352 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:54.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.430+0000 7ff71bf93700 1 Processor -- start 2023-09-30T22:32:54.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.430+0000 7ff71bf93700 1 -- start start 2023-09-30T22:32:54.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.431+0000 7ff71bf93700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff71409d6f0 0x7ff71409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.431+0000 7ff71bf93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71409e000 0x7ff714130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.431+0000 7ff71bf93700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71409e410 0x7ff714130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.431+0000 7ff71bf93700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71409f520 con 0x7ff71409d6f0 2023-09-30T22:32:54.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.431+0000 7ff71bf93700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71409f130 con 0x7ff71409e410 2023-09-30T22:32:54.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.431+0000 7ff71bf93700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff71409e930 con 0x7ff71409e000 2023-09-30T22:32:54.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.431+0000 7ff71952e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71409e000 0x7ff714130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.431+0000 7ff71952e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71409e000 0x7ff714130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53072/0 (socket says 172.21.15.59:53072) 2023-09-30T22:32:54.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.431+0000 7ff71952e700 1 -- 172.21.15.59:0/2598578794 learned_addr learned my addr 172.21.15.59:0/2598578794 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:54.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.431+0000 7ff719d2f700 1 --2- 172.21.15.59:0/2598578794 >> v2:172.21.15.59:3300/0 conn(0x7ff71409d6f0 0x7ff71409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.431+0000 7ff71952e700 1 -- 172.21.15.59:0/2598578794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71409e410 msgr2=0x7ff714130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:54.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.431+0000 7ff71952e700 1 --2- 172.21.15.59:0/2598578794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71409e410 0x7ff714130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.431+0000 7ff71952e700 1 -- 172.21.15.59:0/2598578794 >> v2:172.21.15.59:3300/0 conn(0x7ff71409d6f0 msgr2=0x7ff71409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:54.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.431+0000 7ff71952e700 1 --2- 172.21.15.59:0/2598578794 >> v2:172.21.15.59:3300/0 conn(0x7ff71409d6f0 0x7ff71409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.431+0000 7ff71952e700 1 -- 172.21.15.59:0/2598578794 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71409b2d0 con 0x7ff71409e000 2023-09-30T22:32:54.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.432+0000 7ff71952e700 1 --2- 172.21.15.59:0/2598578794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71409e000 0x7ff714130660 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff704013210 tx=0x7ff704013520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28f59ee7875112bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:54.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.432+0000 7ff718d2d700 1 -- 172.21.15.59:0/2598578794 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff704016070 con 0x7ff71409e000 2023-09-30T22:32:54.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.432+0000 7ff718d2d700 1 -- 172.21.15.59:0/2598578794 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff704013d70 con 0x7ff71409e000 2023-09-30T22:32:54.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.432+0000 7ff718d2d700 1 -- 172.21.15.59:0/2598578794 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7040112f0 con 0x7ff71409e000 2023-09-30T22:32:54.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.433+0000 7ff71bf93700 1 -- 172.21.15.59:0/2598578794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71409e000 msgr2=0x7ff714130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.433+0000 7ff71bf93700 1 --2- 172.21.15.59:0/2598578794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71409e000 0x7ff714130660 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff704013210 tx=0x7ff704013520 comp rx=0 tx=0).stop 2023-09-30T22:32:54.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.433+0000 7ff71bf93700 1 -- 172.21.15.59:0/2598578794 shutdown_connections 2023-09-30T22:32:54.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.433+0000 7ff71bf93700 1 --2- 172.21.15.59:0/2598578794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71409e410 0x7ff714130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.433+0000 7ff71bf93700 1 --2- 172.21.15.59:0/2598578794 >> v2:172.21.15.59:3300/0 conn(0x7ff71409d6f0 0x7ff71409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.433+0000 7ff71bf93700 1 --2- 172.21.15.59:0/2598578794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71409e000 0x7ff714130660 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.433+0000 7ff71bf93700 1 -- 172.21.15.59:0/2598578794 >> 172.21.15.59:0/2598578794 conn(0x7ff714066f50 msgr2=0x7ff71409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:54.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.433+0000 7ff71bf93700 1 -- 172.21.15.59:0/2598578794 shutdown_connections 2023-09-30T22:32:54.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.433+0000 7ff71bf93700 1 -- 172.21.15.59:0/2598578794 wait complete. 2023-09-30T22:32:54.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.434+0000 7ff71bf93700 1 Processor -- start 2023-09-30T22:32:54.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.434+0000 7ff71bf93700 1 -- start start 2023-09-30T22:32:54.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71bf93700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71409d6f0 0x7ff71411df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71bf93700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71409e000 0x7ff71411e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71bf93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71409e410 0x7ff71411e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71bf93700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff714120580 con 0x7ff71409e000 2023-09-30T22:32:54.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71bf93700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7141219b0 con 0x7ff71409d6f0 2023-09-30T22:32:54.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71bf93700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff714120d80 con 0x7ff71409e410 2023-09-30T22:32:54.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71a530700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71409e410 0x7ff71411e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71a530700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71409e410 0x7ff71411e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53088/0 (socket says 172.21.15.59:53088) 2023-09-30T22:32:54.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71a530700 1 -- 172.21.15.59:0/2959963115 learned_addr learned my addr 172.21.15.59:0/2959963115 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:54.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71952e700 1 --2- 172.21.15.59:0/2959963115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71409e000 0x7ff71411e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71a530700 1 -- 172.21.15.59:0/2959963115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71409d6f0 msgr2=0x7ff71411df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71a530700 1 --2- 172.21.15.59:0/2959963115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71409d6f0 0x7ff71411df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71a530700 1 -- 172.21.15.59:0/2959963115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71409e000 msgr2=0x7ff71411e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71a530700 1 --2- 172.21.15.59:0/2959963115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71409e000 0x7ff71411e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71a530700 1 -- 172.21.15.59:0/2959963115 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff704011df0 con 0x7ff71409e410 2023-09-30T22:32:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.435+0000 7ff71952e700 1 --2- 172.21.15.59:0/2959963115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71409e000 0x7ff71411e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.436+0000 7ff71a530700 1 --2- 172.21.15.59:0/2959963115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71409e410 0x7ff71411e9b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00b9a0 tx=0x7ff70c00bd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.436+0000 7ff70a7fc700 1 -- 172.21.15.59:0/2959963115 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c00c9b0 con 0x7ff71409e410 2023-09-30T22:32:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.436+0000 7ff70a7fc700 1 -- 172.21.15.59:0/2959963115 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c00cb30 con 0x7ff71409e410 2023-09-30T22:32:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.436+0000 7ff71bf93700 1 -- 172.21.15.59:0/2959963115 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7140a16d0 con 0x7ff71409e410 2023-09-30T22:32:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.436+0000 7ff70a7fc700 1 -- 172.21.15.59:0/2959963115 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c014440 con 0x7ff71409e410 2023-09-30T22:32:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.437+0000 7ff71bf93700 1 -- 172.21.15.59:0/2959963115 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71409c700 con 0x7ff71409e410 2023-09-30T22:32:54.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.437+0000 7ff70a7fc700 1 -- 172.21.15.59:0/2959963115 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff70c01d3b0 con 0x7ff71409e410 2023-09-30T22:32:54.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.437+0000 7ff70a7fc700 1 -- 172.21.15.59:0/2959963115 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff70c006e40 con 0x7ff71409e410 2023-09-30T22:32:54.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.438+0000 7ff71bf93700 1 -- 172.21.15.59:0/2959963115 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff714121550 con 0x7ff71409e410 2023-09-30T22:32:54.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.447+0000 7ff70a7fc700 1 -- 172.21.15.59:0/2959963115 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff70c01de60 con 0x7ff71409e410 2023-09-30T22:32:54.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.476+0000 7f435b7d0700 1 Processor -- start 2023-09-30T22:32:54.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.476+0000 7f435b7d0700 1 -- start start 2023-09-30T22:32:54.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f435b7d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f435409e930 0x7f435409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f435b7d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f435409f240 0x7f43541317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f435b7d0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f435409f650 0x7f4354131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f435b7d0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4354070940 con 0x7f435409f650 2023-09-30T22:32:54.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f435b7d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435406fd60 con 0x7f435409e930 2023-09-30T22:32:54.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f435b7d0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f435406fa80 con 0x7f435409f240 2023-09-30T22:32:54.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f4358d6b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f435409f240 0x7f43541317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f4358d6b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f435409f240 0x7f43541317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53094/0 (socket says 172.21.15.59:53094) 2023-09-30T22:32:54.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f4358d6b700 1 -- 172.21.15.59:0/4174483675 learned_addr learned my addr 172.21.15.59:0/4174483675 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:54.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f4359d6d700 1 --2- 172.21.15.59:0/4174483675 >> v2:172.21.15.59:3300/0 conn(0x7f435409f650 0x7f4354131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f435956c700 1 --2- 172.21.15.59:0/4174483675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f435409e930 0x7f435409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f4358d6b700 1 -- 172.21.15.59:0/4174483675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f435409e930 msgr2=0x7f435409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:54.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f4358d6b700 1 --2- 172.21.15.59:0/4174483675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f435409e930 0x7f435409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f4358d6b700 1 -- 172.21.15.59:0/4174483675 >> v2:172.21.15.59:3300/0 conn(0x7f435409f650 msgr2=0x7f4354131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:54.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f4358d6b700 1 --2- 172.21.15.59:0/4174483675 >> v2:172.21.15.59:3300/0 conn(0x7f435409f650 0x7f4354131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f4358d6b700 1 -- 172.21.15.59:0/4174483675 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435409fb60 con 0x7f435409f240 2023-09-30T22:32:54.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.477+0000 7f4359d6d700 1 --2- 172.21.15.59:0/4174483675 >> v2:172.21.15.59:3300/0 conn(0x7f435409f650 0x7f4354131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:54.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.478+0000 7f4358d6b700 1 --2- 172.21.15.59:0/4174483675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f435409f240 0x7f43541317f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f43440098f0 tx=0x7f4344009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f00bb577615a7e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:54.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.478+0000 7f434bfff700 1 -- 172.21.15.59:0/4174483675 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344011830 con 0x7f435409f240 2023-09-30T22:32:54.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.478+0000 7f434bfff700 1 -- 172.21.15.59:0/4174483675 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4344011990 con 0x7f435409f240 2023-09-30T22:32:54.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.478+0000 7f434bfff700 1 -- 172.21.15.59:0/4174483675 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344011d20 con 0x7f435409f240 2023-09-30T22:32:54.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.479+0000 7f435b7d0700 1 -- 172.21.15.59:0/4174483675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f435409f240 msgr2=0x7f43541317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.479+0000 7f435b7d0700 1 --2- 172.21.15.59:0/4174483675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f435409f240 0x7f43541317f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f43440098f0 tx=0x7f4344009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:54.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.479+0000 7f435b7d0700 1 -- 172.21.15.59:0/4174483675 shutdown_connections 2023-09-30T22:32:54.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.479+0000 7f435b7d0700 1 --2- 172.21.15.59:0/4174483675 >> v2:172.21.15.59:3300/0 conn(0x7f435409f650 0x7f4354131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.479+0000 7f435b7d0700 1 --2- 172.21.15.59:0/4174483675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f435409e930 0x7f435409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.479+0000 7f435b7d0700 1 --2- 172.21.15.59:0/4174483675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f435409f240 0x7f43541317f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.479+0000 7f435b7d0700 1 -- 172.21.15.59:0/4174483675 >> 172.21.15.59:0/4174483675 conn(0x7f43540a4210 msgr2=0x7f43540a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:54.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.479+0000 7f435b7d0700 1 -- 172.21.15.59:0/4174483675 shutdown_connections 2023-09-30T22:32:54.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.479+0000 7f435b7d0700 1 -- 172.21.15.59:0/4174483675 wait complete. 2023-09-30T22:32:54.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.480+0000 7f435b7d0700 1 Processor -- start 2023-09-30T22:32:54.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.480+0000 7f435b7d0700 1 -- start start 2023-09-30T22:32:54.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.481+0000 7f435b7d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f435409e930 0x7f43541a6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.481+0000 7f435b7d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f435409f240 0x7f43541a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.481+0000 7f435b7d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f435409f650 0x7f43541a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.481+0000 7f435b7d0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43541a7510 con 0x7f435409f240 2023-09-30T22:32:54.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.481+0000 7f435b7d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43541a7c20 con 0x7f435409f650 2023-09-30T22:32:54.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.481+0000 7f435b7d0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43541a8e70 con 0x7f435409e930 2023-09-30T22:32:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.481+0000 7f435956c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f435409e930 0x7f43541a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.481+0000 7f435956c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f435409e930 0x7f43541a6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53100/0 (socket says 172.21.15.59:53100) 2023-09-30T22:32:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.481+0000 7f435956c700 1 -- 172.21.15.59:0/384437169 learned_addr learned my addr 172.21.15.59:0/384437169 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.481+0000 7f4358d6b700 1 --2- 172.21.15.59:0/384437169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f435409f240 0x7f43541a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.481+0000 7f4359d6d700 1 --2- 172.21.15.59:0/384437169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f435409f650 0x7f43541a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.482+0000 7f435956c700 1 -- 172.21.15.59:0/384437169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f435409f650 msgr2=0x7f43541a6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.482+0000 7f435956c700 1 --2- 172.21.15.59:0/384437169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f435409f650 0x7f43541a6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.482+0000 7f435956c700 1 -- 172.21.15.59:0/384437169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f435409f240 msgr2=0x7f43541a65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.482+0000 7f435956c700 1 --2- 172.21.15.59:0/384437169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f435409f240 0x7f43541a65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.482+0000 7f435956c700 1 -- 172.21.15.59:0/384437169 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c009a70 con 0x7f435409e930 2023-09-30T22:32:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.482+0000 7f435956c700 1 --2- 172.21.15.59:0/384437169 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f435409e930 0x7f43541a6060 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f435000e960 tx=0x7f435000ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.482+0000 7f4349ffb700 1 -- 172.21.15.59:0/384437169 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4350013680 con 0x7f435409e930 2023-09-30T22:32:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.482+0000 7f4349ffb700 1 -- 172.21.15.59:0/384437169 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43500137e0 con 0x7f435409e930 2023-09-30T22:32:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.482+0000 7f435b7d0700 1 -- 172.21.15.59:0/384437169 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4344009550 con 0x7f435409e930 2023-09-30T22:32:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.482+0000 7f4349ffb700 1 -- 172.21.15.59:0/384437169 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4350013b70 con 0x7f435409e930 2023-09-30T22:32:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.483+0000 7f435b7d0700 1 -- 172.21.15.59:0/384437169 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43540a0190 con 0x7f435409e930 2023-09-30T22:32:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.484+0000 7f435b7d0700 1 -- 172.21.15.59:0/384437169 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435406d670 con 0x7f435409e930 2023-09-30T22:32:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.484+0000 7f4349ffb700 1 -- 172.21.15.59:0/384437169 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4350013cd0 con 0x7f435409e930 2023-09-30T22:32:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.484+0000 7f4349ffb700 1 -- 172.21.15.59:0/384437169 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f435003f660 con 0x7f435409e930 2023-09-30T22:32:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.493+0000 7f4349ffb700 1 -- 172.21.15.59:0/384437169 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f435001bc10 con 0x7f435409e930 2023-09-30T22:32:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.521+0000 7f9321e92700 1 Processor -- start 2023-09-30T22:32:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.521+0000 7f9321e92700 1 -- start start 2023-09-30T22:32:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f9321e92700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f931c09d6f0 0x7f931c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f9321e92700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f931c09e000 0x7f931c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f9321e92700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f931c09e410 0x7f931c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f9321e92700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931c09f520 con 0x7f931c09e000 2023-09-30T22:32:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f9321e92700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931c09f130 con 0x7f931c09e410 2023-09-30T22:32:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f9321e92700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f931c09e930 con 0x7f931c09d6f0 2023-09-30T22:32:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f931affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f931c09e000 0x7f931c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f931affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f931c09e000 0x7f931c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41784/0 (socket says 172.21.15.59:41784) 2023-09-30T22:32:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f931affd700 1 -- 172.21.15.59:0/475497209 learned_addr learned my addr 172.21.15.59:0/475497209 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f931b7fe700 1 --2- 172.21.15.59:0/475497209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f931c09d6f0 0x7f931c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f931bfff700 1 --2- 172.21.15.59:0/475497209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f931c09e410 0x7f931c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f931affd700 1 -- 172.21.15.59:0/475497209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f931c09d6f0 msgr2=0x7f931c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f931affd700 1 --2- 172.21.15.59:0/475497209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f931c09d6f0 0x7f931c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f931affd700 1 -- 172.21.15.59:0/475497209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f931c09e410 msgr2=0x7f931c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f931affd700 1 --2- 172.21.15.59:0/475497209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f931c09e410 0x7f931c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.522+0000 7f931affd700 1 -- 172.21.15.59:0/475497209 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c09b2d0 con 0x7f931c09e000 2023-09-30T22:32:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.523+0000 7f931affd700 1 --2- 172.21.15.59:0/475497209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f931c09e000 0x7f931c130660 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9310009920 tx=0x7f9310009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819b410de92d06e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.523+0000 7f931a7fc700 1 -- 172.21.15.59:0/475497209 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310011830 con 0x7f931c09e000 2023-09-30T22:32:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.523+0000 7f931a7fc700 1 -- 172.21.15.59:0/475497209 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9310011990 con 0x7f931c09e000 2023-09-30T22:32:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.523+0000 7f931a7fc700 1 -- 172.21.15.59:0/475497209 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310011d20 con 0x7f931c09e000 2023-09-30T22:32:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.524+0000 7f9321e92700 1 -- 172.21.15.59:0/475497209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f931c09e000 msgr2=0x7f931c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.524+0000 7f9321e92700 1 --2- 172.21.15.59:0/475497209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f931c09e000 0x7f931c130660 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9310009920 tx=0x7f9310009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.524+0000 7f9321e92700 1 -- 172.21.15.59:0/475497209 shutdown_connections 2023-09-30T22:32:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.524+0000 7f9321e92700 1 --2- 172.21.15.59:0/475497209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f931c09e410 0x7f931c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.524+0000 7f9321e92700 1 --2- 172.21.15.59:0/475497209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f931c09d6f0 0x7f931c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.524+0000 7f9321e92700 1 --2- 172.21.15.59:0/475497209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f931c09e000 0x7f931c130660 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.524+0000 7f9321e92700 1 -- 172.21.15.59:0/475497209 >> 172.21.15.59:0/475497209 conn(0x7f931c066f50 msgr2=0x7f931c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.524+0000 7f9321e92700 1 -- 172.21.15.59:0/475497209 shutdown_connections 2023-09-30T22:32:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.524+0000 7f9321e92700 1 -- 172.21.15.59:0/475497209 wait complete. 2023-09-30T22:32:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.525+0000 7f9321e92700 1 Processor -- start 2023-09-30T22:32:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.525+0000 7f9321e92700 1 -- start start 2023-09-30T22:32:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.526+0000 7f9321e92700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f931c09d6f0 0x7f931c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.526+0000 7f9321e92700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f931c09e000 0x7f931c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.526+0000 7f9321e92700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f931c09e410 0x7f931c11ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.526+0000 7f9321e92700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c121860 con 0x7f931c09e410 2023-09-30T22:32:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.526+0000 7f9321e92700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931c130360 con 0x7f931c09e000 2023-09-30T22:32:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.526+0000 7f9321e92700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f931c120de0 con 0x7f931c09d6f0 2023-09-30T22:32:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.526+0000 7f931b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f931c09d6f0 0x7f931c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.526+0000 7f931b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f931c09d6f0 0x7f931c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53114/0 (socket says 172.21.15.59:53114) 2023-09-30T22:32:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.526+0000 7f931b7fe700 1 -- 172.21.15.59:0/2787591430 learned_addr learned my addr 172.21.15.59:0/2787591430 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.527+0000 7f931bfff700 1 --2- 172.21.15.59:0/2787591430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f931c09e410 0x7f931c11ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.527+0000 7f931affd700 1 --2- 172.21.15.59:0/2787591430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f931c09e000 0x7f931c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.527+0000 7f931b7fe700 1 -- 172.21.15.59:0/2787591430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f931c09e000 msgr2=0x7f931c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.527+0000 7f931b7fe700 1 --2- 172.21.15.59:0/2787591430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f931c09e000 0x7f931c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.527+0000 7f931b7fe700 1 -- 172.21.15.59:0/2787591430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f931c09e410 msgr2=0x7f931c11ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.527+0000 7f931b7fe700 1 --2- 172.21.15.59:0/2787591430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f931c09e410 0x7f931c11ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.527+0000 7f931b7fe700 1 -- 172.21.15.59:0/2787591430 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9310009550 con 0x7f931c09d6f0 2023-09-30T22:32:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.527+0000 7f931b7fe700 1 --2- 172.21.15.59:0/2787591430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f931c09d6f0 0x7f931c11df80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f930c010f00 tx=0x7f930c00d390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.527+0000 7f9303fff700 1 -- 172.21.15.59:0/2787591430 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c012040 con 0x7f931c09d6f0 2023-09-30T22:32:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.528+0000 7f9303fff700 1 -- 172.21.15.59:0/2787591430 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c00dd00 con 0x7f931c09d6f0 2023-09-30T22:32:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.528+0000 7f9321e92700 1 -- 172.21.15.59:0/2787591430 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931c120170 con 0x7f931c09d6f0 2023-09-30T22:32:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.528+0000 7f9303fff700 1 -- 172.21.15.59:0/2787591430 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c016620 con 0x7f931c09d6f0 2023-09-30T22:32:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.528+0000 7f9321e92700 1 -- 172.21.15.59:0/2787591430 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931c09c700 con 0x7f931c09d6f0 2023-09-30T22:32:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.529+0000 7f9303fff700 1 -- 172.21.15.59:0/2787591430 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f930c016780 con 0x7f931c09d6f0 2023-09-30T22:32:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.529+0000 7f9321e92700 1 -- 172.21.15.59:0/2787591430 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931c11ac20 con 0x7f931c09d6f0 2023-09-30T22:32:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.529+0000 7f9303fff700 1 -- 172.21.15.59:0/2787591430 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f930c041c30 con 0x7f931c09d6f0 2023-09-30T22:32:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.531+0000 7f9e81a73700 1 Processor -- start 2023-09-30T22:32:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.531+0000 7f9e81a73700 1 -- start start 2023-09-30T22:32:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.532+0000 7f9e81a73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e7c09d6f0 0x7f9e7c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.532+0000 7f9e81a73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e7c09e000 0x7f9e7c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.532+0000 7f9e81a73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7c09e410 0x7f9e7c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.532+0000 7f9e81a73700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7c06b460 con 0x7f9e7c09d6f0 2023-09-30T22:32:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.532+0000 7f9e81a73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c09b120 con 0x7f9e7c09e410 2023-09-30T22:32:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.532+0000 7f9e81a73700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c09a7e0 con 0x7f9e7c09e000 2023-09-30T22:32:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.532+0000 7f9e7b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e7c09d6f0 0x7f9e7c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.532+0000 7f9e7b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e7c09d6f0 0x7f9e7c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41792/0 (socket says 172.21.15.59:41792) 2023-09-30T22:32:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.532+0000 7f9e7b7fe700 1 -- 172.21.15.59:0/2692049216 learned_addr learned my addr 172.21.15.59:0/2692049216 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.532+0000 7f9e7bfff700 1 --2- 172.21.15.59:0/2692049216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7c09e410 0x7f9e7c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.532+0000 7f9e7b7fe700 1 -- 172.21.15.59:0/2692049216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e7c09e000 msgr2=0x7f9e7c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.532+0000 7f9e7b7fe700 1 --2- 172.21.15.59:0/2692049216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e7c09e000 0x7f9e7c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.532+0000 7f9e7b7fe700 1 -- 172.21.15.59:0/2692049216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7c09e410 msgr2=0x7f9e7c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.532+0000 7f9e7b7fe700 1 --2- 172.21.15.59:0/2692049216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7c09e410 0x7f9e7c133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.532+0000 7f9e7b7fe700 1 -- 172.21.15.59:0/2692049216 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c09a500 con 0x7f9e7c09d6f0 2023-09-30T22:32:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.533+0000 7f9e7b7fe700 1 --2- 172.21.15.59:0/2692049216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7c09d6f0 0x7f9e7c09dac0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0098f0 tx=0x7f9e6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e8aeb89cae55b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.533+0000 7f9e7a7fc700 1 -- 172.21.15.59:0/2692049216 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c011830 con 0x7f9e7c09d6f0 2023-09-30T22:32:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.533+0000 7f9e7a7fc700 1 -- 172.21.15.59:0/2692049216 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6c011990 con 0x7f9e7c09d6f0 2023-09-30T22:32:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.533+0000 7f9e7a7fc700 1 -- 172.21.15.59:0/2692049216 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c011d20 con 0x7f9e7c09d6f0 2023-09-30T22:32:54.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.534+0000 7f9e81a73700 1 -- 172.21.15.59:0/2692049216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7c09d6f0 msgr2=0x7f9e7c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.534+0000 7f9e81a73700 1 --2- 172.21.15.59:0/2692049216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7c09d6f0 0x7f9e7c09dac0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0098f0 tx=0x7f9e6c009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:54.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.534+0000 7f9e81a73700 1 -- 172.21.15.59:0/2692049216 shutdown_connections 2023-09-30T22:32:54.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.534+0000 7f9e81a73700 1 --2- 172.21.15.59:0/2692049216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7c09e410 0x7f9e7c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.534+0000 7f9e81a73700 1 --2- 172.21.15.59:0/2692049216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7c09d6f0 0x7f9e7c09dac0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.534+0000 7f9e81a73700 1 --2- 172.21.15.59:0/2692049216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e7c09e000 0x7f9e7c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.534+0000 7f9e81a73700 1 -- 172.21.15.59:0/2692049216 >> 172.21.15.59:0/2692049216 conn(0x7f9e7c066f50 msgr2=0x7f9e7c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:54.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.534+0000 7f9e81a73700 1 -- 172.21.15.59:0/2692049216 shutdown_connections 2023-09-30T22:32:54.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.534+0000 7f9e81a73700 1 -- 172.21.15.59:0/2692049216 wait complete. 2023-09-30T22:32:54.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.535+0000 7f9303fff700 1 -- 172.21.15.59:0/2787591430 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f930c048080 con 0x7f931c09d6f0 2023-09-30T22:32:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.536+0000 7f9e81a73700 1 Processor -- start 2023-09-30T22:32:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.536+0000 7f9e81a73700 1 -- start start 2023-09-30T22:32:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e81a73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7c09d6f0 0x7f9e7c1a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e81a73700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7c09e000 0x7f9e7c1a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e81a73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e7c09e410 0x7f9e7c1a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e81a73700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c1a9630 con 0x7f9e7c09e000 2023-09-30T22:32:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e81a73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c1a7b10 con 0x7f9e7c09d6f0 2023-09-30T22:32:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e81a73700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0a21b0 con 0x7f9e7c09e410 2023-09-30T22:32:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e7bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e7c09e410 0x7f9e7c1a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e7bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e7c09e410 0x7f9e7c1a6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53118/0 (socket says 172.21.15.59:53118) 2023-09-30T22:32:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e7bfff700 1 -- 172.21.15.59:0/4195647543 learned_addr learned my addr 172.21.15.59:0/4195647543 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e7affd700 1 --2- 172.21.15.59:0/4195647543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7c09e000 0x7f9e7c1a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e7b7fe700 1 --2- 172.21.15.59:0/4195647543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7c09d6f0 0x7f9e7c1a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e7bfff700 1 -- 172.21.15.59:0/4195647543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7c09d6f0 msgr2=0x7f9e7c1a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e7bfff700 1 --2- 172.21.15.59:0/4195647543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7c09d6f0 0x7f9e7c1a5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e7bfff700 1 -- 172.21.15.59:0/4195647543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7c09e000 msgr2=0x7f9e7c1a6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e7bfff700 1 --2- 172.21.15.59:0/4195647543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7c09e000 0x7f9e7c1a6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.537+0000 7f9e7bfff700 1 -- 172.21.15.59:0/4195647543 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c009550 con 0x7f9e7c09e410 2023-09-30T22:32:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.538+0000 7f9e7bfff700 1 --2- 172.21.15.59:0/4195647543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e7c09e410 0x7f9e7c1a6870 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400efc0 tx=0x7f9e7400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.538+0000 7f9e63fff700 1 -- 172.21.15.59:0/4195647543 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7400cd40 con 0x7f9e7c09e410 2023-09-30T22:32:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.538+0000 7f9e63fff700 1 -- 172.21.15.59:0/4195647543 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7400f040 con 0x7f9e7c09e410 2023-09-30T22:32:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.538+0000 7f9e81a73700 1 -- 172.21.15.59:0/4195647543 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c09c710 con 0x7f9e7c09e410 2023-09-30T22:32:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.538+0000 7f9e63fff700 1 -- 172.21.15.59:0/4195647543 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e740146c0 con 0x7f9e7c09e410 2023-09-30T22:32:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.538+0000 7f9e81a73700 1 -- 172.21.15.59:0/4195647543 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7c1a9910 con 0x7f9e7c09e410 2023-09-30T22:32:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.539+0000 7f9e81a73700 1 -- 172.21.15.59:0/4195647543 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7c074ea0 con 0x7f9e7c09e410 2023-09-30T22:32:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.539+0000 7f9e63fff700 1 -- 172.21.15.59:0/4195647543 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e74014820 con 0x7f9e7c09e410 2023-09-30T22:32:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.540+0000 7f9e63fff700 1 -- 172.21.15.59:0/4195647543 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9e740401b0 con 0x7f9e7c09e410 2023-09-30T22:32:54.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.549+0000 7f9e63fff700 1 -- 172.21.15.59:0/4195647543 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e7401a8b0 con 0x7f9e7c09e410 2023-09-30T22:32:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.678+0000 7ff71bf93700 1 -- 172.21.15.59:0/2959963115 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff714074ea0 con 0x7ff71409e410 2023-09-30T22:32:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.678+0000 7ff70a7fc700 1 -- 172.21.15.59:0/2959963115 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff70c0133a0 con 0x7ff71409e410 2023-09-30T22:32:54.680 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:54.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.682+0000 7ff71bf93700 1 -- 172.21.15.59:0/2959963115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71409e410 msgr2=0x7ff71411e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.682+0000 7ff71bf93700 1 --2- 172.21.15.59:0/2959963115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71409e410 0x7ff71411e9b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00b9a0 tx=0x7ff70c00bd60 comp rx=0 tx=0).stop 2023-09-30T22:32:54.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.682+0000 7ff71bf93700 1 -- 172.21.15.59:0/2959963115 shutdown_connections 2023-09-30T22:32:54.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.682+0000 7ff71bf93700 1 --2- 172.21.15.59:0/2959963115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71409e410 0x7ff71411e9b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.682+0000 7ff71bf93700 1 --2- 172.21.15.59:0/2959963115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71409d6f0 0x7ff71411df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.682+0000 7ff71bf93700 1 --2- 172.21.15.59:0/2959963115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71409e000 0x7ff71411e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.682+0000 7ff71bf93700 1 -- 172.21.15.59:0/2959963115 >> 172.21.15.59:0/2959963115 conn(0x7ff714066f50 msgr2=0x7ff71406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:54.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.682+0000 7ff71bf93700 1 -- 172.21.15.59:0/2959963115 shutdown_connections 2023-09-30T22:32:54.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.682+0000 7ff71bf93700 1 -- 172.21.15.59:0/2959963115 wait complete. 2023-09-30T22:32:54.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:54.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.750+0000 7f9321e92700 1 -- 172.21.15.59:0/2787591430 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f931c074ea0 con 0x7f931c09d6f0 2023-09-30T22:32:54.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.750+0000 7f9303fff700 1 -- 172.21.15.59:0/2787591430 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f930c01c8b0 con 0x7f931c09d6f0 2023-09-30T22:32:54.751 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:54.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.752+0000 7f9321e92700 1 -- 172.21.15.59:0/2787591430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f931c09d6f0 msgr2=0x7f931c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.752+0000 7f9321e92700 1 --2- 172.21.15.59:0/2787591430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f931c09d6f0 0x7f931c11df80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f930c010f00 tx=0x7f930c00d390 comp rx=0 tx=0).stop 2023-09-30T22:32:54.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.752+0000 7f9321e92700 1 -- 172.21.15.59:0/2787591430 shutdown_connections 2023-09-30T22:32:54.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.752+0000 7f9321e92700 1 --2- 172.21.15.59:0/2787591430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f931c09d6f0 0x7f931c11df80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.752+0000 7f9321e92700 1 --2- 172.21.15.59:0/2787591430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f931c09e410 0x7f931c11ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.752+0000 7f9321e92700 1 --2- 172.21.15.59:0/2787591430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f931c09e000 0x7f931c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.752+0000 7f9321e92700 1 -- 172.21.15.59:0/2787591430 >> 172.21.15.59:0/2787591430 conn(0x7f931c066f50 msgr2=0x7f931c1308e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:54.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.753+0000 7f9321e92700 1 -- 172.21.15.59:0/2787591430 shutdown_connections 2023-09-30T22:32:54.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.753+0000 7f9321e92700 1 -- 172.21.15.59:0/2787591430 wait complete. 2023-09-30T22:32:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.764+0000 7f435b7d0700 1 -- 172.21.15.59:0/384437169 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f43540a33f0 con 0x7f435409e930 2023-09-30T22:32:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.764+0000 7f4349ffb700 1 -- 172.21.15.59:0/384437169 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4350017020 con 0x7f435409e930 2023-09-30T22:32:54.766 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:54.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.767+0000 7f435b7d0700 1 -- 172.21.15.59:0/384437169 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f435409e930 msgr2=0x7f43541a6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.767+0000 7f435b7d0700 1 --2- 172.21.15.59:0/384437169 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f435409e930 0x7f43541a6060 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f435000e960 tx=0x7f435000ec70 comp rx=0 tx=0).stop 2023-09-30T22:32:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.767+0000 7f435b7d0700 1 -- 172.21.15.59:0/384437169 shutdown_connections 2023-09-30T22:32:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.767+0000 7f435b7d0700 1 --2- 172.21.15.59:0/384437169 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f435409e930 0x7f43541a6060 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.767+0000 7f435b7d0700 1 --2- 172.21.15.59:0/384437169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f435409f650 0x7f43541a6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.767+0000 7f435b7d0700 1 --2- 172.21.15.59:0/384437169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f435409f240 0x7f43541a65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.767+0000 7f435b7d0700 1 -- 172.21.15.59:0/384437169 >> 172.21.15.59:0/384437169 conn(0x7f43540a4210 msgr2=0x7f43541bae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.767+0000 7f435b7d0700 1 -- 172.21.15.59:0/384437169 shutdown_connections 2023-09-30T22:32:54.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.767+0000 7f435b7d0700 1 -- 172.21.15.59:0/384437169 wait complete. 2023-09-30T22:32:54.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:54.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.799+0000 7f9e81a73700 1 -- 172.21.15.59:0/4195647543 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9e7c1a9770 con 0x7f9e7c09e410 2023-09-30T22:32:54.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.799+0000 7f9e63fff700 1 -- 172.21.15.59:0/4195647543 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e7c1a9770 con 0x7f9e7c09e410 2023-09-30T22:32:54.800 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:54.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.801+0000 7f9e81a73700 1 -- 172.21.15.59:0/4195647543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e7c09e410 msgr2=0x7f9e7c1a6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:54.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.801+0000 7f9e81a73700 1 --2- 172.21.15.59:0/4195647543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e7c09e410 0x7f9e7c1a6870 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400efc0 tx=0x7f9e7400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.801+0000 7f9e81a73700 1 -- 172.21.15.59:0/4195647543 shutdown_connections 2023-09-30T22:32:54.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.801+0000 7f9e81a73700 1 --2- 172.21.15.59:0/4195647543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e7c09e410 0x7f9e7c1a6870 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.801+0000 7f9e81a73700 1 --2- 172.21.15.59:0/4195647543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e7c09d6f0 0x7f9e7c1a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.801+0000 7f9e81a73700 1 --2- 172.21.15.59:0/4195647543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7c09e000 0x7f9e7c1a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:54.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.801+0000 7f9e81a73700 1 -- 172.21.15.59:0/4195647543 >> 172.21.15.59:0/4195647543 conn(0x7f9e7c066f50 msgr2=0x7f9e7c1bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:54.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.802+0000 7f9e81a73700 1 -- 172.21.15.59:0/4195647543 shutdown_connections 2023-09-30T22:32:54.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:54.802+0000 7f9e81a73700 1 -- 172.21.15.59:0/4195647543 wait complete. 2023-09-30T22:32:54.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:55.699 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:55.768 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:55.782 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:55.817 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:55.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.854+0000 7f3a75ec5700 1 Processor -- start 2023-09-30T22:32:55.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.854+0000 7f3a75ec5700 1 -- start start 2023-09-30T22:32:55.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.855+0000 7f3a75ec5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a70136890 0x7f3a70138c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:55.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.855+0000 7f3a75ec5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a701391b0 0x7f3a7013b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:55.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.855+0000 7f3a75ec5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a70133580 con 0x7f3a70133940 2023-09-30T22:32:55.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.855+0000 7f3a75ec5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7009abd0 con 0x7f3a70136890 2023-09-30T22:32:55.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.855+0000 7f3a75ec5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7009a2d0 con 0x7f3a701391b0 2023-09-30T22:32:55.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.855+0000 7f3a6effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a70136890 0x7f3a70138c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:55.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.855+0000 7f3a6f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3a70133940 0x7f3a70133d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52072/0 (socket says 172.21.15.59:52072) 2023-09-30T22:32:55.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.855+0000 7f3a6f7fe700 1 -- 172.21.15.59:0/1584171872 learned_addr learned my addr 172.21.15.59:0/1584171872 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:55.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.855+0000 7f3a6ffff700 1 --2- 172.21.15.59:0/1584171872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a701391b0 0x7f3a7013b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:55.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.856+0000 7f3a6effd700 1 -- 172.21.15.59:0/1584171872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a701391b0 msgr2=0x7f3a7013b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:55.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.856+0000 7f3a6effd700 1 --2- 172.21.15.59:0/1584171872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a701391b0 0x7f3a7013b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:55.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.856+0000 7f3a6effd700 1 -- 172.21.15.59:0/1584171872 >> v1:172.21.15.59:6789/0 conn(0x7f3a70133940 legacy=0x7f3a70133d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:55.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.856+0000 7f3a6effd700 1 -- 172.21.15.59:0/1584171872 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7009e950 con 0x7f3a70136890 2023-09-30T22:32:55.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.856+0000 7f3a6effd700 1 --2- 172.21.15.59:0/1584171872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70136890 0x7f3a70138c70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009840 tx=0x7f3a64009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188965dee6d8ea48 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:55.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.856+0000 7f3a6e7fc700 1 -- 172.21.15.59:0/1584171872 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64011830 con 0x7f3a70136890 2023-09-30T22:32:55.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.856+0000 7f3a6e7fc700 1 -- 172.21.15.59:0/1584171872 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a64011990 con 0x7f3a70136890 2023-09-30T22:32:55.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.856+0000 7f3a6e7fc700 1 -- 172.21.15.59:0/1584171872 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64011d20 con 0x7f3a70136890 2023-09-30T22:32:55.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.857+0000 7f3a75ec5700 1 -- 172.21.15.59:0/1584171872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70136890 msgr2=0x7f3a70138c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:55.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.857+0000 7f3a75ec5700 1 --2- 172.21.15.59:0/1584171872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70136890 0x7f3a70138c70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009840 tx=0x7f3a64009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:55.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.857+0000 7f3a75ec5700 1 -- 172.21.15.59:0/1584171872 shutdown_connections 2023-09-30T22:32:55.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.857+0000 7f3a75ec5700 1 --2- 172.21.15.59:0/1584171872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a701391b0 0x7f3a7013b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:55.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.857+0000 7f3a75ec5700 1 --2- 172.21.15.59:0/1584171872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70136890 0x7f3a70138c70 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:55.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.857+0000 7f3a75ec5700 1 -- 172.21.15.59:0/1584171872 >> 172.21.15.59:0/1584171872 conn(0x7f3a700a2360 msgr2=0x7f3a700a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:55.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.857+0000 7f3a75ec5700 1 -- 172.21.15.59:0/1584171872 shutdown_connections 2023-09-30T22:32:55.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.857+0000 7f3a75ec5700 1 -- 172.21.15.59:0/1584171872 wait complete. 2023-09-30T22:32:55.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.858+0000 7f3a75ec5700 1 Processor -- start 2023-09-30T22:32:55.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.859+0000 7f3a75ec5700 1 -- start start 2023-09-30T22:32:55.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.859+0000 7f3a75ec5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a70133940 0x7f3a7012c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:55.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.859+0000 7f3a75ec5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70136890 0x7f3a7012a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:55.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.859+0000 7f3a75ec5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a701391b0 0x7f3a7012ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:55.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.859+0000 7f3a75ec5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7012eb00 con 0x7f3a70136890 2023-09-30T22:32:55.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.859+0000 7f3a75ec5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7009c1e0 con 0x7f3a701391b0 2023-09-30T22:32:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.859+0000 7f3a75ec5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7012d980 con 0x7f3a70133940 2023-09-30T22:32:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.859+0000 7f3a6f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a70133940 0x7f3a7012c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.859+0000 7f3a6f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a70133940 0x7f3a7012c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53120/0 (socket says 172.21.15.59:53120) 2023-09-30T22:32:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.859+0000 7f3a6f7fe700 1 -- 172.21.15.59:0/2049603571 learned_addr learned my addr 172.21.15.59:0/2049603571 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.859+0000 7f3a6ffff700 1 --2- 172.21.15.59:0/2049603571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a701391b0 0x7f3a7012ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.859+0000 7f3a6effd700 1 --2- 172.21.15.59:0/2049603571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70136890 0x7f3a7012a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.860+0000 7f3a6ffff700 1 -- 172.21.15.59:0/2049603571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a70133940 msgr2=0x7f3a7012c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.860+0000 7f3a6ffff700 1 --2- 172.21.15.59:0/2049603571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a70133940 0x7f3a7012c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.860+0000 7f3a6ffff700 1 -- 172.21.15.59:0/2049603571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70136890 msgr2=0x7f3a7012a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.860+0000 7f3a6ffff700 1 --2- 172.21.15.59:0/2049603571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70136890 0x7f3a7012a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.860+0000 7f3a6ffff700 1 -- 172.21.15.59:0/2049603571 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a640094a0 con 0x7f3a701391b0 2023-09-30T22:32:55.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.860+0000 7f3a6effd700 1 --2- 172.21.15.59:0/2049603571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70136890 0x7f3a7012a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:55.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.860+0000 7f3a6ffff700 1 --2- 172.21.15.59:0/2049603571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a701391b0 0x7f3a7012ab50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800efc0 tx=0x7f3a6800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:55.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.860+0000 7f3a57fff700 1 -- 172.21.15.59:0/2049603571 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68017dd0 con 0x7f3a701391b0 2023-09-30T22:32:55.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.860+0000 7f3a57fff700 1 -- 172.21.15.59:0/2049603571 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6800f040 con 0x7f3a701391b0 2023-09-30T22:32:55.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.860+0000 7f3a75ec5700 1 -- 172.21.15.59:0/2049603571 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7012e480 con 0x7f3a701391b0 2023-09-30T22:32:55.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.860+0000 7f3a57fff700 1 -- 172.21.15.59:0/2049603571 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6800cac0 con 0x7f3a701391b0 2023-09-30T22:32:55.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.860+0000 7f3a75ec5700 1 -- 172.21.15.59:0/2049603571 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7012b090 con 0x7f3a701391b0 2023-09-30T22:32:55.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.862+0000 7f3a75ec5700 1 -- 172.21.15.59:0/2049603571 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a70074ea0 con 0x7f3a701391b0 2023-09-30T22:32:55.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.862+0000 7f3a57fff700 1 -- 172.21.15.59:0/2049603571 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a6800cc20 con 0x7f3a701391b0 2023-09-30T22:32:55.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.863+0000 7f3a57fff700 1 -- 172.21.15.59:0/2049603571 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3a680482e0 con 0x7f3a701391b0 2023-09-30T22:32:55.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.871+0000 7f3a57fff700 1 -- 172.21.15.59:0/2049603571 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a68009e60 con 0x7f3a701391b0 2023-09-30T22:32:55.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.925+0000 7f19a103f700 1 Processor -- start 2023-09-30T22:32:55.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.926+0000 7f19a103f700 1 -- start start 2023-09-30T22:32:55.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.926+0000 7f19a103f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199c09e930 0x7f199c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:55.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.926+0000 7f19a103f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199c09f240 0x7f199c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:55.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.926+0000 7f19a103f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c070940 con 0x7f199c09f650 2023-09-30T22:32:55.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.926+0000 7f19a103f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c06fd60 con 0x7f199c09f240 2023-09-30T22:32:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.926+0000 7f19a103f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f199c06fa80 con 0x7f199c09e930 2023-09-30T22:32:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.927+0000 7f199ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199c09e930 0x7f199c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.927+0000 7f199a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199c09f240 0x7f199c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.927+0000 7f199ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199c09e930 0x7f199c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53136/0 (socket says 172.21.15.59:53136) 2023-09-30T22:32:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.927+0000 7f199a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199c09f240 0x7f199c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33572/0 (socket says 172.21.15.59:33572) 2023-09-30T22:32:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.927+0000 7f199ad9d700 1 -- 172.21.15.59:0/4014977258 learned_addr learned my addr 172.21.15.59:0/4014977258 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.927+0000 7f199ad9d700 1 -- 172.21.15.59:0/4014977258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199c09f240 msgr2=0x7f199c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.927+0000 7f199ad9d700 1 --2- 172.21.15.59:0/4014977258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199c09f240 0x7f199c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.927+0000 7f199ad9d700 1 -- 172.21.15.59:0/4014977258 >> v1:172.21.15.59:6789/0 conn(0x7f199c09f650 legacy=0x7f199c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:55.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.927+0000 7f199ad9d700 1 -- 172.21.15.59:0/4014977258 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c09fb60 con 0x7f199c09e930 2023-09-30T22:32:55.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.927+0000 7f199ad9d700 1 --2- 172.21.15.59:0/4014977258 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199c09e930 0x7f199c09ed00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f198c00dd40 tx=0x7f198c00f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4f7d5fea227dde2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:55.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.927+0000 7f1999d9b700 1 -- 172.21.15.59:0/4014977258 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c012070 con 0x7f199c09e930 2023-09-30T22:32:55.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.928+0000 7f1999d9b700 1 -- 172.21.15.59:0/4014977258 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c00de90 con 0x7f199c09e930 2023-09-30T22:32:55.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.928+0000 7f1999d9b700 1 -- 172.21.15.59:0/4014977258 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c00fb30 con 0x7f199c09e930 2023-09-30T22:32:55.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.928+0000 7f19a103f700 1 -- 172.21.15.59:0/4014977258 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199c09e930 msgr2=0x7f199c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:55.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.928+0000 7f19a103f700 1 --2- 172.21.15.59:0/4014977258 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199c09e930 0x7f199c09ed00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f198c00dd40 tx=0x7f198c00f330 comp rx=0 tx=0).stop 2023-09-30T22:32:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.928+0000 7f19a103f700 1 -- 172.21.15.59:0/4014977258 shutdown_connections 2023-09-30T22:32:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.928+0000 7f19a103f700 1 --2- 172.21.15.59:0/4014977258 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199c09e930 0x7f199c09ed00 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.928+0000 7f19a103f700 1 --2- 172.21.15.59:0/4014977258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199c09f240 0x7f199c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.928+0000 7f19a103f700 1 -- 172.21.15.59:0/4014977258 >> 172.21.15.59:0/4014977258 conn(0x7f199c0a4210 msgr2=0x7f199c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.928+0000 7f19a103f700 1 -- 172.21.15.59:0/4014977258 shutdown_connections 2023-09-30T22:32:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.928+0000 7f19a103f700 1 -- 172.21.15.59:0/4014977258 wait complete. 2023-09-30T22:32:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.930+0000 7f19a103f700 1 Processor -- start 2023-09-30T22:32:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.930+0000 7f19a103f700 1 -- start start 2023-09-30T22:32:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.931+0000 7f19a103f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199c09e930 0x7f199c1c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.931+0000 7f19a103f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f199c09f240 0x7f199c1c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.931+0000 7f19a103f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199c09f650 0x7f199c1c06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.931+0000 7f19a103f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c1a6700 con 0x7f199c09f240 2023-09-30T22:32:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.931+0000 7f19a103f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0a32b0 con 0x7f199c09f650 2023-09-30T22:32:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.931+0000 7f19a103f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f199c071d20 con 0x7f199c09e930 2023-09-30T22:32:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.931+0000 7f199ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199c09e930 0x7f199c1c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:55.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.931+0000 7f199ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199c09e930 0x7f199c1c4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53144/0 (socket says 172.21.15.59:53144) 2023-09-30T22:32:55.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.931+0000 7f199ad9d700 1 -- 172.21.15.59:0/3235894093 learned_addr learned my addr 172.21.15.59:0/3235894093 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:55.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.931+0000 7f199b59e700 1 --2- 172.21.15.59:0/3235894093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199c09f650 0x7f199c1c06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:55.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.932+0000 7f199a59c700 1 --2- 172.21.15.59:0/3235894093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f199c09f240 0x7f199c1c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:55.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.932+0000 7f199ad9d700 1 -- 172.21.15.59:0/3235894093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199c09f650 msgr2=0x7f199c1c06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.932+0000 7f199ad9d700 1 --2- 172.21.15.59:0/3235894093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199c09f650 0x7f199c1c06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.932+0000 7f199ad9d700 1 -- 172.21.15.59:0/3235894093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f199c09f240 msgr2=0x7f199c1c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.932+0000 7f199ad9d700 1 --2- 172.21.15.59:0/3235894093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f199c09f240 0x7f199c1c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.932+0000 7f199ad9d700 1 -- 172.21.15.59:0/3235894093 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c00d9f0 con 0x7f199c09e930 2023-09-30T22:32:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.932+0000 7f199ad9d700 1 --2- 172.21.15.59:0/3235894093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199c09e930 0x7f199c1c4400 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f198c00f370 tx=0x7f198c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.932+0000 7f19837fe700 1 -- 172.21.15.59:0/3235894093 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c00d3b0 con 0x7f199c09e930 2023-09-30T22:32:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.932+0000 7f19837fe700 1 -- 172.21.15.59:0/3235894093 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c0036a0 con 0x7f199c09e930 2023-09-30T22:32:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.932+0000 7f19a103f700 1 -- 172.21.15.59:0/3235894093 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c0a0190 con 0x7f199c09e930 2023-09-30T22:32:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.932+0000 7f19837fe700 1 -- 172.21.15.59:0/3235894093 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c003a50 con 0x7f199c09e930 2023-09-30T22:32:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.932+0000 7f19a103f700 1 -- 172.21.15.59:0/3235894093 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c1a5ac0 con 0x7f199c09e930 2023-09-30T22:32:55.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.933+0000 7f19837fe700 1 -- 172.21.15.59:0/3235894093 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f198c003bb0 con 0x7f199c09e930 2023-09-30T22:32:55.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.934+0000 7f19a103f700 1 -- 172.21.15.59:0/3235894093 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c074ea0 con 0x7f199c09e930 2023-09-30T22:32:55.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.934+0000 7f19837fe700 1 -- 172.21.15.59:0/3235894093 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f198c044bb0 con 0x7f199c09e930 2023-09-30T22:32:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.943+0000 7f19837fe700 1 -- 172.21.15.59:0/3235894093 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f198c00b450 con 0x7f199c09e930 2023-09-30T22:32:55.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.970+0000 7f1c1763c700 1 Processor -- start 2023-09-30T22:32:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.971+0000 7f1c1763c700 1 -- start start 2023-09-30T22:32:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.971+0000 7f1c1763c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c10133540 0x7f1c10135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.971+0000 7f1c1763c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c10135e60 0x7f1c10138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.971+0000 7f1c1763c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c100716a0 con 0x7f1c10130540 2023-09-30T22:32:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.971+0000 7f1c1763c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c10071290 con 0x7f1c10133540 2023-09-30T22:32:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.971+0000 7f1c1763c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10130340 con 0x7f1c10135e60 2023-09-30T22:32:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.972+0000 7f1c14bd7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c10133540 0x7f1c10135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.972+0000 7f1c14bd7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c10133540 0x7f1c10135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41846/0 (socket says 172.21.15.59:41846) 2023-09-30T22:32:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.972+0000 7f1c14bd7700 1 -- 172.21.15.59:0/2094474851 learned_addr learned my addr 172.21.15.59:0/2094474851 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.972+0000 7f1c15bd9700 1 --2- 172.21.15.59:0/2094474851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c10135e60 0x7f1c10138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.972+0000 7f1c14bd7700 1 -- 172.21.15.59:0/2094474851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c10135e60 msgr2=0x7f1c10138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.972+0000 7f1c14bd7700 1 --2- 172.21.15.59:0/2094474851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c10135e60 0x7f1c10138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.972+0000 7f1c14bd7700 1 -- 172.21.15.59:0/2094474851 >> v1:172.21.15.59:6789/0 conn(0x7f1c10130540 legacy=0x7f1c10130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.972+0000 7f1c14bd7700 1 -- 172.21.15.59:0/2094474851 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c10070b80 con 0x7f1c10133540 2023-09-30T22:32:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.972+0000 7f1c15bd9700 1 --2- 172.21.15.59:0/2094474851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c10135e60 0x7f1c10138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.972+0000 7f1c14bd7700 1 --2- 172.21.15.59:0/2094474851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c10133540 0x7f1c10135920 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1c000098f0 tx=0x7f1c00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0862e425094b06 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.972+0000 7f1c07fff700 1 -- 172.21.15.59:0/2094474851 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00011830 con 0x7f1c10133540 2023-09-30T22:32:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.973+0000 7f1c07fff700 1 -- 172.21.15.59:0/2094474851 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c00011990 con 0x7f1c10133540 2023-09-30T22:32:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.973+0000 7f1c07fff700 1 -- 172.21.15.59:0/2094474851 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00011d20 con 0x7f1c10133540 2023-09-30T22:32:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.973+0000 7f1c1763c700 1 -- 172.21.15.59:0/2094474851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c10133540 msgr2=0x7f1c10135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.973+0000 7f1c1763c700 1 --2- 172.21.15.59:0/2094474851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c10133540 0x7f1c10135920 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1c000098f0 tx=0x7f1c00009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.973+0000 7f1c1763c700 1 -- 172.21.15.59:0/2094474851 shutdown_connections 2023-09-30T22:32:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.973+0000 7f1c1763c700 1 --2- 172.21.15.59:0/2094474851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c10135e60 0x7f1c10138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.973+0000 7f1c1763c700 1 --2- 172.21.15.59:0/2094474851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c10133540 0x7f1c10135920 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.973+0000 7f1c1763c700 1 -- 172.21.15.59:0/2094474851 >> 172.21.15.59:0/2094474851 conn(0x7f1c100a2aa0 msgr2=0x7f1c100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.974+0000 7f1c1763c700 1 -- 172.21.15.59:0/2094474851 shutdown_connections 2023-09-30T22:32:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.974+0000 7f1c1763c700 1 -- 172.21.15.59:0/2094474851 wait complete. 2023-09-30T22:32:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.975+0000 7f1c1763c700 1 Processor -- start 2023-09-30T22:32:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.975+0000 7f1c1763c700 1 -- start start 2023-09-30T22:32:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.976+0000 7f1c1763c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c10130540 0x7f1c10139790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.976+0000 7f1c1763c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c10133540 0x7f1c10139cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.976+0000 7f1c1763c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c10135e60 0x7f1c1013a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.976+0000 7f1c1763c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1009aaa0 con 0x7f1c10133540 2023-09-30T22:32:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.976+0000 7f1c1763c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10139260 con 0x7f1c10130540 2023-09-30T22:32:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.976+0000 7f1c1763c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100718e0 con 0x7f1c10135e60 2023-09-30T22:32:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.976+0000 7f1c15bd9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c10135e60 0x7f1c1013a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.976+0000 7f1c15bd9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c10135e60 0x7f1c1013a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53156/0 (socket says 172.21.15.59:53156) 2023-09-30T22:32:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.976+0000 7f1c15bd9700 1 -- 172.21.15.59:0/2856178941 learned_addr learned my addr 172.21.15.59:0/2856178941 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.976+0000 7f1c14bd7700 1 --2- 172.21.15.59:0/2856178941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c10133540 0x7f1c10139cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.976+0000 7f1c153d8700 1 --2- 172.21.15.59:0/2856178941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c10130540 0x7f1c10139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.976+0000 7f1c14bd7700 1 -- 172.21.15.59:0/2856178941 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c10135e60 msgr2=0x7f1c1013a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.976+0000 7f1c14bd7700 1 --2- 172.21.15.59:0/2856178941 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c10135e60 0x7f1c1013a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.976+0000 7f1c14bd7700 1 -- 172.21.15.59:0/2856178941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c10130540 msgr2=0x7f1c10139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.977+0000 7f1c14bd7700 1 --2- 172.21.15.59:0/2856178941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c10130540 0x7f1c10139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.977+0000 7f1c14bd7700 1 -- 172.21.15.59:0/2856178941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c08009a70 con 0x7f1c10133540 2023-09-30T22:32:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.977+0000 7f1c14bd7700 1 --2- 172.21.15.59:0/2856178941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c10133540 0x7f1c10139cd0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1c00016000 tx=0x7f1c00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.977+0000 7f1c05ffb700 1 -- 172.21.15.59:0/2856178941 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c000036a0 con 0x7f1c10133540 2023-09-30T22:32:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.977+0000 7f1c05ffb700 1 -- 172.21.15.59:0/2856178941 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c00003800 con 0x7f1c10133540 2023-09-30T22:32:55.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.977+0000 7f1c1763c700 1 -- 172.21.15.59:0/2856178941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c00009550 con 0x7f1c10133540 2023-09-30T22:32:55.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.977+0000 7f1c05ffb700 1 -- 172.21.15.59:0/2856178941 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00003bb0 con 0x7f1c10133540 2023-09-30T22:32:55.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.977+0000 7f1c1763c700 1 -- 172.21.15.59:0/2856178941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1013a830 con 0x7f1c10133540 2023-09-30T22:32:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.978+0000 7f1c1763c700 1 -- 172.21.15.59:0/2856178941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c10074ea0 con 0x7f1c10133540 2023-09-30T22:32:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.979+0000 7f1c05ffb700 1 -- 172.21.15.59:0/2856178941 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c00021070 con 0x7f1c10133540 2023-09-30T22:32:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.979+0000 7f1c05ffb700 1 -- 172.21.15.59:0/2856178941 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1c000409f0 con 0x7f1c10133540 2023-09-30T22:32:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:55.988+0000 7f1c05ffb700 1 -- 172.21.15.59:0/2856178941 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c00042e60 con 0x7f1c10133540 2023-09-30T22:32:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.014+0000 7f8e772e0700 1 Processor -- start 2023-09-30T22:32:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.014+0000 7f8e772e0700 1 -- start start 2023-09-30T22:32:56.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.015+0000 7f8e772e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e700a0a30 0x7f8e700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:56.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.015+0000 7f8e772e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e7009d630 0x7f8e700a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:56.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.015+0000 7f8e772e0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e700a2a70 con 0x7f8e70133930 2023-09-30T22:32:56.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.015+0000 7f8e772e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700a01d0 con 0x7f8e7009d630 2023-09-30T22:32:56.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.015+0000 7f8e772e0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7009e2b0 con 0x7f8e700a0a30 2023-09-30T22:32:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.015+0000 7f8e7587d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8e70133930 0x7f8e70133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52106/0 (socket says 172.21.15.59:52106) 2023-09-30T22:32:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.015+0000 7f8e7587d700 1 -- 172.21.15.59:0/2246047459 learned_addr learned my addr 172.21.15.59:0/2246047459 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.015+0000 7f8e7507c700 1 --2- 172.21.15.59:0/2246047459 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e700a0a30 0x7f8e700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.015+0000 7f8e7487b700 1 --2- 172.21.15.59:0/2246047459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e7009d630 0x7f8e700a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.016+0000 7f8e67fff700 1 -- 172.21.15.59:0/2246047459 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073965334 0 0) 0x7f8e700a2a70 con 0x7f8e70133930 2023-09-30T22:32:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.016+0000 7f8e67fff700 1 -- 172.21.15.59:0/2246047459 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e5c0035b0 con 0x7f8e70133930 2023-09-30T22:32:56.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.016+0000 7f8e7487b700 1 -- 172.21.15.59:0/2246047459 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e700a0a30 msgr2=0x7f8e700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:56.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.016+0000 7f8e7487b700 1 --2- 172.21.15.59:0/2246047459 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e700a0a30 0x7f8e700a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.016+0000 7f8e7487b700 1 -- 172.21.15.59:0/2246047459 >> v1:172.21.15.59:6789/0 conn(0x7f8e70133930 legacy=0x7f8e70133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:56.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.016+0000 7f8e7487b700 1 -- 172.21.15.59:0/2246047459 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7009dc50 con 0x7f8e7009d630 2023-09-30T22:32:56.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.016+0000 7f8e7487b700 1 --2- 172.21.15.59:0/2246047459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e7009d630 0x7f8e700a1340 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009870 tx=0x7f8e60009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=107c2c004e694c35 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:56.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.016+0000 7f8e67fff700 1 -- 172.21.15.59:0/2246047459 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60011830 con 0x7f8e7009d630 2023-09-30T22:32:56.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.016+0000 7f8e67fff700 1 -- 172.21.15.59:0/2246047459 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e60011990 con 0x7f8e7009d630 2023-09-30T22:32:56.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.016+0000 7f8e67fff700 1 -- 172.21.15.59:0/2246047459 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60011d00 con 0x7f8e7009d630 2023-09-30T22:32:56.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.017+0000 7f8e772e0700 1 -- 172.21.15.59:0/2246047459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e7009d630 msgr2=0x7f8e700a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:56.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.017+0000 7f8e772e0700 1 --2- 172.21.15.59:0/2246047459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e7009d630 0x7f8e700a1340 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009870 tx=0x7f8e60009b80 comp rx=0 tx=0).stop 2023-09-30T22:32:56.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.018+0000 7f8e772e0700 1 -- 172.21.15.59:0/2246047459 shutdown_connections 2023-09-30T22:32:56.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.018+0000 7f8e772e0700 1 --2- 172.21.15.59:0/2246047459 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e700a0a30 0x7f8e700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.018+0000 7f8e772e0700 1 --2- 172.21.15.59:0/2246047459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e7009d630 0x7f8e700a1340 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.018+0000 7f8e772e0700 1 -- 172.21.15.59:0/2246047459 >> 172.21.15.59:0/2246047459 conn(0x7f8e700a3050 msgr2=0x7f8e700a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:56.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.018+0000 7f8e772e0700 1 -- 172.21.15.59:0/2246047459 shutdown_connections 2023-09-30T22:32:56.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.018+0000 7f8e772e0700 1 -- 172.21.15.59:0/2246047459 wait complete. 2023-09-30T22:32:56.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.019+0000 7f8e772e0700 1 Processor -- start 2023-09-30T22:32:56.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.019+0000 7f8e772e0700 1 -- start start 2023-09-30T22:32:56.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.020+0000 7f8e772e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e7009d630 0x7f8e701c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:56.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.020+0000 7f8e772e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e700a0a30 0x7f8e701c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:56.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.020+0000 7f8e772e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e70133930 0x7f8e701c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:56.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.020+0000 7f8e772e0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70133570 con 0x7f8e700a0a30 2023-09-30T22:32:56.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.020+0000 7f8e772e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70120750 con 0x7f8e70133930 2023-09-30T22:32:56.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.020+0000 7f8e772e0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70121f40 con 0x7f8e7009d630 2023-09-30T22:32:56.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.020+0000 7f8e7507c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e7009d630 0x7f8e701c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:56.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.020+0000 7f8e7507c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e7009d630 0x7f8e701c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53160/0 (socket says 172.21.15.59:53160) 2023-09-30T22:32:56.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.020+0000 7f8e7507c700 1 -- 172.21.15.59:0/739928753 learned_addr learned my addr 172.21.15.59:0/739928753 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:56.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.020+0000 7f8e7487b700 1 --2- 172.21.15.59:0/739928753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e700a0a30 0x7f8e701c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:56.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.020+0000 7f8e7587d700 1 --2- 172.21.15.59:0/739928753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e70133930 0x7f8e701c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:56.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.021+0000 7f8e7487b700 1 -- 172.21.15.59:0/739928753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e7009d630 msgr2=0x7f8e701c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:56.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.021+0000 7f8e7487b700 1 --2- 172.21.15.59:0/739928753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e7009d630 0x7f8e701c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.021+0000 7f8e7487b700 1 -- 172.21.15.59:0/739928753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e70133930 msgr2=0x7f8e701c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:56.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.021+0000 7f8e7487b700 1 --2- 172.21.15.59:0/739928753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e70133930 0x7f8e701c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.021+0000 7f8e7487b700 1 -- 172.21.15.59:0/739928753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e600094a0 con 0x7f8e700a0a30 2023-09-30T22:32:56.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.021+0000 7f8e7507c700 1 --2- 172.21.15.59:0/739928753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e7009d630 0x7f8e701c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:56.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.021+0000 7f8e7587d700 1 --2- 172.21.15.59:0/739928753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e70133930 0x7f8e701c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:56.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.021+0000 7f8e7487b700 1 --2- 172.21.15.59:0/739928753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e700a0a30 0x7f8e701c83c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8e60016000 tx=0x7f8e60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:56.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.021+0000 7f8e65ffb700 1 -- 172.21.15.59:0/739928753 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e600043c0 con 0x7f8e700a0a30 2023-09-30T22:32:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.021+0000 7f8e65ffb700 1 -- 172.21.15.59:0/739928753 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6001f070 con 0x7f8e700a0a30 2023-09-30T22:32:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.021+0000 7f8e772e0700 1 -- 172.21.15.59:0/739928753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e700a0410 con 0x7f8e700a0a30 2023-09-30T22:32:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.021+0000 7f8e65ffb700 1 -- 172.21.15.59:0/739928753 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e600036a0 con 0x7f8e700a0a30 2023-09-30T22:32:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.022+0000 7f8e772e0700 1 -- 172.21.15.59:0/739928753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e70122c70 con 0x7f8e700a0a30 2023-09-30T22:32:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.023+0000 7f8e65ffb700 1 -- 172.21.15.59:0/739928753 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e60021030 con 0x7f8e700a0a30 2023-09-30T22:32:56.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.023+0000 7f8e65ffb700 1 -- 172.21.15.59:0/739928753 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e60040a00 con 0x7f8e700a0a30 2023-09-30T22:32:56.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.023+0000 7f8e772e0700 1 -- 172.21.15.59:0/739928753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e700747f0 con 0x7f8e700a0a30 2023-09-30T22:32:56.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.032+0000 7f8e65ffb700 1 -- 172.21.15.59:0/739928753 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e60015020 con 0x7f8e700a0a30 2023-09-30T22:32:56.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.128+0000 7f3a75ec5700 1 -- 172.21.15.59:0/2049603571 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3a7012dbd0 con 0x7f3a701391b0 2023-09-30T22:32:56.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.128+0000 7f3a57fff700 1 -- 172.21.15.59:0/2049603571 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a6801e810 con 0x7f3a701391b0 2023-09-30T22:32:56.131 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:56.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.131+0000 7f3a75ec5700 1 -- 172.21.15.59:0/2049603571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a701391b0 msgr2=0x7f3a7012ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:56.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.131+0000 7f3a75ec5700 1 --2- 172.21.15.59:0/2049603571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a701391b0 0x7f3a7012ab50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800efc0 tx=0x7f3a6800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.131+0000 7f3a75ec5700 1 -- 172.21.15.59:0/2049603571 shutdown_connections 2023-09-30T22:32:56.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.131+0000 7f3a75ec5700 1 --2- 172.21.15.59:0/2049603571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a70133940 0x7f3a7012c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.131+0000 7f3a75ec5700 1 --2- 172.21.15.59:0/2049603571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a701391b0 0x7f3a7012ab50 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.131+0000 7f3a75ec5700 1 --2- 172.21.15.59:0/2049603571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70136890 0x7f3a7012a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.131+0000 7f3a75ec5700 1 -- 172.21.15.59:0/2049603571 >> 172.21.15.59:0/2049603571 conn(0x7f3a700a2360 msgr2=0x7f3a70098340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:56.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.131+0000 7f3a75ec5700 1 -- 172.21.15.59:0/2049603571 shutdown_connections 2023-09-30T22:32:56.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.131+0000 7f3a75ec5700 1 -- 172.21.15.59:0/2049603571 wait complete. 2023-09-30T22:32:56.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:56.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.182+0000 7f19a103f700 1 -- 172.21.15.59:0/3235894093 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f199c1a5ac0 con 0x7f199c09e930 2023-09-30T22:32:56.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.182+0000 7f19837fe700 1 -- 172.21.15.59:0/3235894093 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f199c1a5ac0 con 0x7f199c09e930 2023-09-30T22:32:56.184 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:56.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.186+0000 7f19a103f700 1 -- 172.21.15.59:0/3235894093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199c09e930 msgr2=0x7f199c1c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:56.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.186+0000 7f19a103f700 1 --2- 172.21.15.59:0/3235894093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199c09e930 0x7f199c1c4400 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f198c00f370 tx=0x7f198c004750 comp rx=0 tx=0).stop 2023-09-30T22:32:56.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.186+0000 7f19a103f700 1 -- 172.21.15.59:0/3235894093 shutdown_connections 2023-09-30T22:32:56.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.186+0000 7f19a103f700 1 --2- 172.21.15.59:0/3235894093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199c09e930 0x7f199c1c4400 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.186+0000 7f19a103f700 1 --2- 172.21.15.59:0/3235894093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199c09f650 0x7f199c1c06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.186+0000 7f19a103f700 1 --2- 172.21.15.59:0/3235894093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f199c09f240 0x7f199c1c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.186+0000 7f19a103f700 1 -- 172.21.15.59:0/3235894093 >> 172.21.15.59:0/3235894093 conn(0x7f199c0a4210 msgr2=0x7f199c09df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:56.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.186+0000 7f19a103f700 1 -- 172.21.15.59:0/3235894093 shutdown_connections 2023-09-30T22:32:56.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.186+0000 7f19a103f700 1 -- 172.21.15.59:0/3235894093 wait complete. 2023-09-30T22:32:56.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:56.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.205+0000 7f1c1763c700 1 -- 172.21.15.59:0/2856178941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1c1006b9e0 con 0x7f1c10133540 2023-09-30T22:32:56.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.206+0000 7f1c05ffb700 1 -- 172.21.15.59:0/2856178941 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c00029070 con 0x7f1c10133540 2023-09-30T22:32:56.207 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:56.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.209+0000 7f1c1763c700 1 -- 172.21.15.59:0/2856178941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c10133540 msgr2=0x7f1c10139cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.209+0000 7f1c1763c700 1 --2- 172.21.15.59:0/2856178941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c10133540 0x7f1c10139cd0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1c00016000 tx=0x7f1c00004750 comp rx=0 tx=0).stop 2023-09-30T22:32:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.209+0000 7f1c1763c700 1 -- 172.21.15.59:0/2856178941 shutdown_connections 2023-09-30T22:32:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.209+0000 7f1c1763c700 1 --2- 172.21.15.59:0/2856178941 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c10135e60 0x7f1c1013a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.209+0000 7f1c1763c700 1 --2- 172.21.15.59:0/2856178941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c10130540 0x7f1c10139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.209+0000 7f1c1763c700 1 --2- 172.21.15.59:0/2856178941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c10133540 0x7f1c10139cd0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.209+0000 7f1c1763c700 1 -- 172.21.15.59:0/2856178941 >> 172.21.15.59:0/2856178941 conn(0x7f1c100a2aa0 msgr2=0x7f1c10131320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.209+0000 7f1c1763c700 1 -- 172.21.15.59:0/2856178941 shutdown_connections 2023-09-30T22:32:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.209+0000 7f1c1763c700 1 -- 172.21.15.59:0/2856178941 wait complete. 2023-09-30T22:32:56.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:56.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.266+0000 7f8e772e0700 1 -- 172.21.15.59:0/739928753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e701212a0 con 0x7f8e700a0a30 2023-09-30T22:32:56.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.266+0000 7f8e65ffb700 1 -- 172.21.15.59:0/739928753 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e60023790 con 0x7f8e700a0a30 2023-09-30T22:32:56.268 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:56.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.269+0000 7f8e772e0700 1 -- 172.21.15.59:0/739928753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e700a0a30 msgr2=0x7f8e701c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:56.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.269+0000 7f8e772e0700 1 --2- 172.21.15.59:0/739928753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e700a0a30 0x7f8e701c83c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8e60016000 tx=0x7f8e60004750 comp rx=0 tx=0).stop 2023-09-30T22:32:56.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.269+0000 7f8e772e0700 1 -- 172.21.15.59:0/739928753 shutdown_connections 2023-09-30T22:32:56.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.269+0000 7f8e772e0700 1 --2- 172.21.15.59:0/739928753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e7009d630 0x7f8e701c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.269+0000 7f8e772e0700 1 --2- 172.21.15.59:0/739928753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e70133930 0x7f8e701c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.269+0000 7f8e772e0700 1 --2- 172.21.15.59:0/739928753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e700a0a30 0x7f8e701c83c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:56.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.269+0000 7f8e772e0700 1 -- 172.21.15.59:0/739928753 >> 172.21.15.59:0/739928753 conn(0x7f8e700a3050 msgr2=0x7f8e701bb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:56.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.269+0000 7f8e772e0700 1 -- 172.21.15.59:0/739928753 shutdown_connections 2023-09-30T22:32:56.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:56.269+0000 7f8e772e0700 1 -- 172.21.15.59:0/739928753 wait complete. 2023-09-30T22:32:56.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:57.148 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:57.203 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:57.229 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:57.285 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:57.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.298+0000 7f88b324a700 1 Processor -- start 2023-09-30T22:32:57.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.298+0000 7f88b324a700 1 -- start start 2023-09-30T22:32:57.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.299+0000 7f88b324a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88ac06a770 0x7f88ac09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.299+0000 7f88b324a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88ac09dc30 0x7f88ac09e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.299+0000 7f88b324a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88ac13c1e0 0x7f88ac13e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.299+0000 7f88b324a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ac06ab40 con 0x7f88ac06a770 2023-09-30T22:32:57.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.299+0000 7f88b324a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac09ebc0 con 0x7f88ac13c1e0 2023-09-30T22:32:57.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.299+0000 7f88b324a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac09a810 con 0x7f88ac09dc30 2023-09-30T22:32:57.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.299+0000 7f88b0fe6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88ac06a770 0x7f88ac09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.299+0000 7f88b0fe6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88ac06a770 0x7f88ac09d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41886/0 (socket says 172.21.15.59:41886) 2023-09-30T22:32:57.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.299+0000 7f88b0fe6700 1 -- 172.21.15.59:0/4133819443 learned_addr learned my addr 172.21.15.59:0/4133819443 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:57.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.299+0000 7f88b17e7700 1 --2- 172.21.15.59:0/4133819443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88ac13c1e0 0x7f88ac13e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.300+0000 7f88abfff700 1 --2- 172.21.15.59:0/4133819443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88ac09dc30 0x7f88ac09e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.300+0000 7f88b0fe6700 1 -- 172.21.15.59:0/4133819443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88ac09dc30 msgr2=0x7f88ac09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.300+0000 7f88b0fe6700 1 --2- 172.21.15.59:0/4133819443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88ac09dc30 0x7f88ac09e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.300+0000 7f88b0fe6700 1 -- 172.21.15.59:0/4133819443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88ac13c1e0 msgr2=0x7f88ac13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.300+0000 7f88b0fe6700 1 --2- 172.21.15.59:0/4133819443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88ac13c1e0 0x7f88ac13e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.300+0000 7f88b0fe6700 1 -- 172.21.15.59:0/4133819443 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac09e920 con 0x7f88ac06a770 2023-09-30T22:32:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.300+0000 7f88b0fe6700 1 --2- 172.21.15.59:0/4133819443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88ac06a770 0x7f88ac09d6f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009920 tx=0x7f88a0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a2036dbc96a1b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:57.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.300+0000 7f88ab7fe700 1 -- 172.21.15.59:0/4133819443 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0011830 con 0x7f88ac06a770 2023-09-30T22:32:57.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.300+0000 7f88ab7fe700 1 -- 172.21.15.59:0/4133819443 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a0011990 con 0x7f88ac06a770 2023-09-30T22:32:57.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.300+0000 7f88ab7fe700 1 -- 172.21.15.59:0/4133819443 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0011d20 con 0x7f88ac06a770 2023-09-30T22:32:57.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.301+0000 7f88b324a700 1 -- 172.21.15.59:0/4133819443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88ac06a770 msgr2=0x7f88ac09d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.301+0000 7f88b324a700 1 --2- 172.21.15.59:0/4133819443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88ac06a770 0x7f88ac09d6f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009920 tx=0x7f88a0009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:57.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.301+0000 7f88b324a700 1 -- 172.21.15.59:0/4133819443 shutdown_connections 2023-09-30T22:32:57.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.301+0000 7f88b324a700 1 --2- 172.21.15.59:0/4133819443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88ac13c1e0 0x7f88ac13e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.301+0000 7f88b324a700 1 --2- 172.21.15.59:0/4133819443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88ac06a770 0x7f88ac09d6f0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.301+0000 7f88b324a700 1 --2- 172.21.15.59:0/4133819443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88ac09dc30 0x7f88ac09e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.301+0000 7f88b324a700 1 -- 172.21.15.59:0/4133819443 >> 172.21.15.59:0/4133819443 conn(0x7f88ac066f50 msgr2=0x7f88ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.301+0000 7f88b324a700 1 -- 172.21.15.59:0/4133819443 shutdown_connections 2023-09-30T22:32:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.301+0000 7f88b324a700 1 -- 172.21.15.59:0/4133819443 wait complete. 2023-09-30T22:32:57.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.303+0000 7f88b324a700 1 Processor -- start 2023-09-30T22:32:57.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.303+0000 7f88b324a700 1 -- start start 2023-09-30T22:32:57.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.304+0000 7f88b324a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88ac06a770 0x7f88ac12dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.304+0000 7f88b324a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88ac09dc30 0x7f88ac12e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.304+0000 7f88b324a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88ac13c1e0 0x7f88ac12e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.304+0000 7f88b324a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0723f0 con 0x7f88ac13c1e0 2023-09-30T22:32:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.304+0000 7f88b324a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac12fea0 con 0x7f88ac06a770 2023-09-30T22:32:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.304+0000 7f88b324a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac131640 con 0x7f88ac09dc30 2023-09-30T22:32:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.304+0000 7f88b0fe6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88ac06a770 0x7f88ac12dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.304+0000 7f88b0fe6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88ac06a770 0x7f88ac12dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33646/0 (socket says 172.21.15.59:33646) 2023-09-30T22:32:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.304+0000 7f88b0fe6700 1 -- 172.21.15.59:0/2317704402 learned_addr learned my addr 172.21.15.59:0/2317704402 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.304+0000 7f88abfff700 1 --2- 172.21.15.59:0/2317704402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88ac09dc30 0x7f88ac12e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.304+0000 7f88b0fe6700 1 -- 172.21.15.59:0/2317704402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88ac09dc30 msgr2=0x7f88ac12e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.304+0000 7f88b0fe6700 1 --2- 172.21.15.59:0/2317704402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88ac09dc30 0x7f88ac12e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.304+0000 7f88b0fe6700 1 -- 172.21.15.59:0/2317704402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88ac13c1e0 msgr2=0x7f88ac12e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.304+0000 7f88b0fe6700 1 --2- 172.21.15.59:0/2317704402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88ac13c1e0 0x7f88ac12e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.304+0000 7f88b0fe6700 1 -- 172.21.15.59:0/2317704402 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a0009550 con 0x7f88ac06a770 2023-09-30T22:32:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.305+0000 7f88b0fe6700 1 --2- 172.21.15.59:0/2317704402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88ac06a770 0x7f88ac12dd40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f88a0000c00 tx=0x7f88a0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.305+0000 7f88a97fa700 1 -- 172.21.15.59:0/2317704402 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a00043c0 con 0x7f88ac06a770 2023-09-30T22:32:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.305+0000 7f88a97fa700 1 -- 172.21.15.59:0/2317704402 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a001f070 con 0x7f88ac06a770 2023-09-30T22:32:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.305+0000 7f88b324a700 1 -- 172.21.15.59:0/2317704402 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ac132040 con 0x7f88ac06a770 2023-09-30T22:32:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.305+0000 7f88a97fa700 1 -- 172.21.15.59:0/2317704402 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a00036a0 con 0x7f88ac06a770 2023-09-30T22:32:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.305+0000 7f88b324a700 1 -- 172.21.15.59:0/2317704402 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ac131040 con 0x7f88ac06a770 2023-09-30T22:32:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.306+0000 7f88a97fa700 1 -- 172.21.15.59:0/2317704402 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88a0021030 con 0x7f88ac06a770 2023-09-30T22:32:57.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.306+0000 7f88a97fa700 1 -- 172.21.15.59:0/2317704402 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f88a0040950 con 0x7f88ac06a770 2023-09-30T22:32:57.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.306+0000 7f88b324a700 1 -- 172.21.15.59:0/2317704402 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ac11cc30 con 0x7f88ac06a770 2023-09-30T22:32:57.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.312+0000 7f88a97fa700 1 -- 172.21.15.59:0/2317704402 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88a00199a0 con 0x7f88ac06a770 2023-09-30T22:32:57.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.351+0000 7f81b7707700 1 Processor -- start 2023-09-30T22:32:57.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.351+0000 7f81b7707700 1 -- start start 2023-09-30T22:32:57.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.352+0000 7f81b7707700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b009e1d0 0x7f81b0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.352+0000 7f81b7707700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0135e50 0x7f81b0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.352+0000 7f81b7707700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b009f130 con 0x7f81b009d6f0 2023-09-30T22:32:57.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.352+0000 7f81b7707700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b009f520 con 0x7f81b0135e50 2023-09-30T22:32:57.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.352+0000 7f81b7707700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81b009e930 con 0x7f81b009e1d0 2023-09-30T22:32:57.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.352+0000 7f81b54a3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f81b009d6f0 0x7f81b009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52116/0 (socket says 172.21.15.59:52116) 2023-09-30T22:32:57.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.352+0000 7f81b54a3700 1 -- 172.21.15.59:0/2166754113 learned_addr learned my addr 172.21.15.59:0/2166754113 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:57.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.352+0000 7f81b5ca4700 1 --2- 172.21.15.59:0/2166754113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0135e50 0x7f81b0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.352+0000 7f81b4ca2700 1 --2- 172.21.15.59:0/2166754113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b009e1d0 0x7f81b0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.352+0000 7f81b5ca4700 1 -- 172.21.15.59:0/2166754113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b009e1d0 msgr2=0x7f81b0135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.352+0000 7f81b5ca4700 1 --2- 172.21.15.59:0/2166754113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b009e1d0 0x7f81b0135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.352+0000 7f81b5ca4700 1 -- 172.21.15.59:0/2166754113 >> v1:172.21.15.59:6789/0 conn(0x7f81b009d6f0 legacy=0x7f81b009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.352+0000 7f81b5ca4700 1 -- 172.21.15.59:0/2166754113 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b009b2d0 con 0x7f81b0135e50 2023-09-30T22:32:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.352+0000 7f81a7fff700 1 -- 172.21.15.59:0/2166754113 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372139496 0 0) 0x7f81b009f130 con 0x7f81b009d6f0 2023-09-30T22:32:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.352+0000 7f81b4ca2700 1 --2- 172.21.15.59:0/2166754113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b009e1d0 0x7f81b0135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.353+0000 7f81b5ca4700 1 --2- 172.21.15.59:0/2166754113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0135e50 0x7f81b0138230 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f81a800bfd0 tx=0x7f81a800d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afeba1ccedeb6de6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.353+0000 7f81a7fff700 1 -- 172.21.15.59:0/2166754113 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a8010070 con 0x7f81b0135e50 2023-09-30T22:32:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.353+0000 7f81a7fff700 1 -- 172.21.15.59:0/2166754113 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a800b2e0 con 0x7f81b0135e50 2023-09-30T22:32:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.353+0000 7f81a7fff700 1 -- 172.21.15.59:0/2166754113 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a800dc70 con 0x7f81b0135e50 2023-09-30T22:32:57.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.354+0000 7f81b7707700 1 -- 172.21.15.59:0/2166754113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0135e50 msgr2=0x7f81b0138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.354+0000 7f81b7707700 1 --2- 172.21.15.59:0/2166754113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0135e50 0x7f81b0138230 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f81a800bfd0 tx=0x7f81a800d330 comp rx=0 tx=0).stop 2023-09-30T22:32:57.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.354+0000 7f81b7707700 1 -- 172.21.15.59:0/2166754113 shutdown_connections 2023-09-30T22:32:57.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.354+0000 7f81b7707700 1 --2- 172.21.15.59:0/2166754113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0135e50 0x7f81b0138230 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.354+0000 7f81b7707700 1 --2- 172.21.15.59:0/2166754113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b009e1d0 0x7f81b0135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.354+0000 7f81b7707700 1 -- 172.21.15.59:0/2166754113 >> 172.21.15.59:0/2166754113 conn(0x7f81b0066f50 msgr2=0x7f81b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:57.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.354+0000 7f81b7707700 1 -- 172.21.15.59:0/2166754113 shutdown_connections 2023-09-30T22:32:57.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.354+0000 7f81b7707700 1 -- 172.21.15.59:0/2166754113 wait complete. 2023-09-30T22:32:57.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.355+0000 7f81b7707700 1 Processor -- start 2023-09-30T22:32:57.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.356+0000 7f81b7707700 1 -- start start 2023-09-30T22:32:57.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.356+0000 7f81b7707700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b009d6f0 0x7f81b011b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.356+0000 7f81b7707700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b009e1d0 0x7f81b011b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.356+0000 7f81b7707700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0135e50 0x7f81b011bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.356+0000 7f81b7707700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b011e750 con 0x7f81b009d6f0 2023-09-30T22:32:57.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.356+0000 7f81b7707700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b011cf60 con 0x7f81b0135e50 2023-09-30T22:32:57.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.356+0000 7f81b7707700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81b009c700 con 0x7f81b009e1d0 2023-09-30T22:32:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.356+0000 7f81b4ca2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b009e1d0 0x7f81b011b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.357+0000 7f81b4ca2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b009e1d0 0x7f81b011b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53208/0 (socket says 172.21.15.59:53208) 2023-09-30T22:32:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.357+0000 7f81b4ca2700 1 -- 172.21.15.59:0/2442003516 learned_addr learned my addr 172.21.15.59:0/2442003516 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.357+0000 7f81b5ca4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0135e50 0x7f81b011bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.357+0000 7f81b54a3700 1 --2- 172.21.15.59:0/2442003516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b009d6f0 0x7f81b011b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.357+0000 7f81b5ca4700 1 -- 172.21.15.59:0/2442003516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b009e1d0 msgr2=0x7f81b011b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.357+0000 7f81b5ca4700 1 --2- 172.21.15.59:0/2442003516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b009e1d0 0x7f81b011b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.357+0000 7f81b5ca4700 1 -- 172.21.15.59:0/2442003516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b009d6f0 msgr2=0x7f81b011b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.357+0000 7f81b5ca4700 1 --2- 172.21.15.59:0/2442003516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b009d6f0 0x7f81b011b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.357+0000 7f81b5ca4700 1 -- 172.21.15.59:0/2442003516 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a00094a0 con 0x7f81b0135e50 2023-09-30T22:32:57.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.357+0000 7f81b54a3700 1 --2- 172.21.15.59:0/2442003516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b009d6f0 0x7f81b011b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:57.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.357+0000 7f81b5ca4700 1 --2- 172.21.15.59:0/2442003516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0135e50 0x7f81b011bc50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f81a8017000 tx=0x7f81a8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:57.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.357+0000 7f81a5ffb700 1 -- 172.21.15.59:0/2442003516 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a8009300 con 0x7f81b0135e50 2023-09-30T22:32:57.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.358+0000 7f81a5ffb700 1 -- 172.21.15.59:0/2442003516 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a800b450 con 0x7f81b0135e50 2023-09-30T22:32:57.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.358+0000 7f81a5ffb700 1 -- 172.21.15.59:0/2442003516 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a80044b0 con 0x7f81b0135e50 2023-09-30T22:32:57.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.359+0000 7f81b7707700 1 -- 172.21.15.59:0/2442003516 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a800bc80 con 0x7f81b0135e50 2023-09-30T22:32:57.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.359+0000 7f81b7707700 1 -- 172.21.15.59:0/2442003516 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b011e030 con 0x7f81b0135e50 2023-09-30T22:32:57.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.360+0000 7f81b7707700 1 -- 172.21.15.59:0/2442003516 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b0074ea0 con 0x7f81b0135e50 2023-09-30T22:32:57.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.360+0000 7f81a5ffb700 1 -- 172.21.15.59:0/2442003516 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81a8009050 con 0x7f81b0135e50 2023-09-30T22:32:57.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.360+0000 7f81a5ffb700 1 -- 172.21.15.59:0/2442003516 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f81a80409a0 con 0x7f81b0135e50 2023-09-30T22:32:57.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.370+0000 7f81a5ffb700 1 -- 172.21.15.59:0/2442003516 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81a8013390 con 0x7f81b0135e50 2023-09-30T22:32:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.402+0000 7f40608be700 1 Processor -- start 2023-09-30T22:32:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.402+0000 7f40608be700 1 -- start start 2023-09-30T22:32:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f40608be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f405c0a0a30 0x7f405c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f40608be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f405c09d630 0x7f405c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f40608be700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f405c133930 0x7f405c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f40608be700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405c0a2a70 con 0x7f405c133930 2023-09-30T22:32:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f40608be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0a01d0 con 0x7f405c09d630 2023-09-30T22:32:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f40608be700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f405c09e2b0 con 0x7f405c0a0a30 2023-09-30T22:32:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f4059d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f405c09d630 0x7f405c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f405a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f405c0a0a30 0x7f405c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f405a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f405c0a0a30 0x7f405c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53220/0 (socket says 172.21.15.59:53220) 2023-09-30T22:32:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f405a59c700 1 -- 172.21.15.59:0/2165024498 learned_addr learned my addr 172.21.15.59:0/2165024498 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f4059d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f405c09d630 0x7f405c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33672/0 (socket says 172.21.15.59:33672) 2023-09-30T22:32:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f405ad9d700 1 --2- 172.21.15.59:0/2165024498 >> v2:172.21.15.59:3300/0 conn(0x7f405c133930 0x7f405c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f4059d9b700 1 -- 172.21.15.59:0/2165024498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f405c0a0a30 msgr2=0x7f405c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:57.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f4059d9b700 1 --2- 172.21.15.59:0/2165024498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f405c0a0a30 0x7f405c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f4059d9b700 1 -- 172.21.15.59:0/2165024498 >> v2:172.21.15.59:3300/0 conn(0x7f405c133930 msgr2=0x7f405c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:57.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f4059d9b700 1 --2- 172.21.15.59:0/2165024498 >> v2:172.21.15.59:3300/0 conn(0x7f405c133930 0x7f405c133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.403+0000 7f4059d9b700 1 -- 172.21.15.59:0/2165024498 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c09dc50 con 0x7f405c09d630 2023-09-30T22:32:57.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.404+0000 7f405a59c700 1 --2- 172.21.15.59:0/2165024498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f405c0a0a30 0x7f405c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:57.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.404+0000 7f405ad9d700 1 --2- 172.21.15.59:0/2165024498 >> v2:172.21.15.59:3300/0 conn(0x7f405c133930 0x7f405c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:57.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.404+0000 7f4059d9b700 1 --2- 172.21.15.59:0/2165024498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f405c09d630 0x7f405c0a1340 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4050009840 tx=0x7f4050009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62e8884794f5a8de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:57.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.404+0000 7f405959a700 1 -- 172.21.15.59:0/2165024498 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050011830 con 0x7f405c09d630 2023-09-30T22:32:57.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.404+0000 7f405959a700 1 -- 172.21.15.59:0/2165024498 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4050011990 con 0x7f405c09d630 2023-09-30T22:32:57.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.404+0000 7f405959a700 1 -- 172.21.15.59:0/2165024498 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050011d20 con 0x7f405c09d630 2023-09-30T22:32:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.405+0000 7f40608be700 1 -- 172.21.15.59:0/2165024498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f405c09d630 msgr2=0x7f405c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.405+0000 7f40608be700 1 --2- 172.21.15.59:0/2165024498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f405c09d630 0x7f405c0a1340 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4050009840 tx=0x7f4050009b50 comp rx=0 tx=0).stop 2023-09-30T22:32:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.405+0000 7f40608be700 1 -- 172.21.15.59:0/2165024498 shutdown_connections 2023-09-30T22:32:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.405+0000 7f40608be700 1 --2- 172.21.15.59:0/2165024498 >> v2:172.21.15.59:3300/0 conn(0x7f405c133930 0x7f405c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.405+0000 7f40608be700 1 --2- 172.21.15.59:0/2165024498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f405c0a0a30 0x7f405c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.405+0000 7f40608be700 1 --2- 172.21.15.59:0/2165024498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f405c09d630 0x7f405c0a1340 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.405+0000 7f40608be700 1 -- 172.21.15.59:0/2165024498 >> 172.21.15.59:0/2165024498 conn(0x7f405c0a3050 msgr2=0x7f405c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.405+0000 7f40608be700 1 -- 172.21.15.59:0/2165024498 shutdown_connections 2023-09-30T22:32:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.405+0000 7f40608be700 1 -- 172.21.15.59:0/2165024498 wait complete. 2023-09-30T22:32:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.407+0000 7f40608be700 1 Processor -- start 2023-09-30T22:32:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.407+0000 7f40608be700 1 -- start start 2023-09-30T22:32:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f40608be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f405c09d630 0x7f405c1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f40608be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f405c0a0a30 0x7f405c1c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f40608be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f405c133930 0x7f405c1c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f40608be700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c122250 con 0x7f405c133930 2023-09-30T22:32:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f40608be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c120540 con 0x7f405c09d630 2023-09-30T22:32:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f40608be700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0a50d0 con 0x7f405c0a0a30 2023-09-30T22:32:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f405a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f405c09d630 0x7f405c1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f405a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f405c09d630 0x7f405c1c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33676/0 (socket says 172.21.15.59:33676) 2023-09-30T22:32:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f405a59c700 1 -- 172.21.15.59:0/80209030 learned_addr learned my addr 172.21.15.59:0/80209030 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f405ad9d700 1 --2- 172.21.15.59:0/80209030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f405c133930 0x7f405c1c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f4059d9b700 1 --2- 172.21.15.59:0/80209030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f405c0a0a30 0x7f405c1c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f405a59c700 1 -- 172.21.15.59:0/80209030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f405c0a0a30 msgr2=0x7f405c1c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f405a59c700 1 --2- 172.21.15.59:0/80209030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f405c0a0a30 0x7f405c1c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f405a59c700 1 -- 172.21.15.59:0/80209030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f405c133930 msgr2=0x7f405c1c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f405a59c700 1 --2- 172.21.15.59:0/80209030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f405c133930 0x7f405c1c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f405a59c700 1 -- 172.21.15.59:0/80209030 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c009550 con 0x7f405c09d630 2023-09-30T22:32:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.408+0000 7f405ad9d700 1 --2- 172.21.15.59:0/80209030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f405c133930 0x7f405c1c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.409+0000 7f405a59c700 1 --2- 172.21.15.59:0/80209030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f405c09d630 0x7f405c1c8090 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f404c00ebe0 tx=0x7f404c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.409+0000 7f404affd700 1 -- 172.21.15.59:0/80209030 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c00c850 con 0x7f405c09d630 2023-09-30T22:32:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.409+0000 7f404affd700 1 -- 172.21.15.59:0/80209030 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c00c9b0 con 0x7f405c09d630 2023-09-30T22:32:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.409+0000 7f404affd700 1 -- 172.21.15.59:0/80209030 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c00cd20 con 0x7f405c09d630 2023-09-30T22:32:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.409+0000 7f40608be700 1 -- 172.21.15.59:0/80209030 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4054009a70 con 0x7f405c09d630 2023-09-30T22:32:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.409+0000 7f40608be700 1 -- 172.21.15.59:0/80209030 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40500094a0 con 0x7f405c09d630 2023-09-30T22:32:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.410+0000 7f404affd700 1 -- 172.21.15.59:0/80209030 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f404c013470 con 0x7f405c09d630 2023-09-30T22:32:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.410+0000 7f40608be700 1 -- 172.21.15.59:0/80209030 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405c120d90 con 0x7f405c09d630 2023-09-30T22:32:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.411+0000 7f404affd700 1 -- 172.21.15.59:0/80209030 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f404c011350 con 0x7f405c09d630 2023-09-30T22:32:57.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.419+0000 7f404affd700 1 -- 172.21.15.59:0/80209030 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f404c0102b0 con 0x7f405c09d630 2023-09-30T22:32:57.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.439+0000 7fca7a8f9700 1 Processor -- start 2023-09-30T22:32:57.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.439+0000 7fca7a8f9700 1 -- start start 2023-09-30T22:32:57.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.439+0000 7fca7a8f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca7409d6f0 0x7fca7409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.439+0000 7fca7a8f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca7409e000 0x7fca74130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.439+0000 7fca7a8f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca7409e410 0x7fca74130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.439+0000 7fca7a8f9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7409f520 con 0x7fca7409e410 2023-09-30T22:32:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.439+0000 7fca7a8f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7409f130 con 0x7fca7409e000 2023-09-30T22:32:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.439+0000 7fca7a8f9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca7409e930 con 0x7fca7409d6f0 2023-09-30T22:32:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.439+0000 7fca737fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca7409e000 0x7fca74130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.439+0000 7fca737fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca7409e000 0x7fca74130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33682/0 (socket says 172.21.15.59:33682) 2023-09-30T22:32:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.439+0000 7fca737fe700 1 -- 172.21.15.59:0/666641541 learned_addr learned my addr 172.21.15.59:0/666641541 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.440+0000 7fca73fff700 1 --2- 172.21.15.59:0/666641541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca7409d6f0 0x7fca7409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.440+0000 7fca78e96700 1 --2- 172.21.15.59:0/666641541 >> v2:172.21.15.59:3300/0 conn(0x7fca7409e410 0x7fca74130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.440+0000 7fca737fe700 1 -- 172.21.15.59:0/666641541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca7409d6f0 msgr2=0x7fca7409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.440+0000 7fca737fe700 1 --2- 172.21.15.59:0/666641541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca7409d6f0 0x7fca7409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.440+0000 7fca737fe700 1 -- 172.21.15.59:0/666641541 >> v2:172.21.15.59:3300/0 conn(0x7fca7409e410 msgr2=0x7fca74130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.440+0000 7fca737fe700 1 --2- 172.21.15.59:0/666641541 >> v2:172.21.15.59:3300/0 conn(0x7fca7409e410 0x7fca74130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.440+0000 7fca737fe700 1 -- 172.21.15.59:0/666641541 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7409b2d0 con 0x7fca7409e000 2023-09-30T22:32:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.440+0000 7fca78e96700 1 --2- 172.21.15.59:0/666641541 >> v2:172.21.15.59:3300/0 conn(0x7fca7409e410 0x7fca74130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.440+0000 7fca737fe700 1 --2- 172.21.15.59:0/666641541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca7409e000 0x7fca74130660 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fca68009920 tx=0x7fca68009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cb9c8b95f6d5e6d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.440+0000 7fca72ffd700 1 -- 172.21.15.59:0/666641541 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca68011830 con 0x7fca7409e000 2023-09-30T22:32:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.441+0000 7fca72ffd700 1 -- 172.21.15.59:0/666641541 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca68011990 con 0x7fca7409e000 2023-09-30T22:32:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.441+0000 7fca72ffd700 1 -- 172.21.15.59:0/666641541 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca68011d20 con 0x7fca7409e000 2023-09-30T22:32:57.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.441+0000 7fca7a8f9700 1 -- 172.21.15.59:0/666641541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca7409e000 msgr2=0x7fca74130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.441+0000 7fca7a8f9700 1 --2- 172.21.15.59:0/666641541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca7409e000 0x7fca74130660 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fca68009920 tx=0x7fca68009c30 comp rx=0 tx=0).stop 2023-09-30T22:32:57.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.441+0000 7fca7a8f9700 1 -- 172.21.15.59:0/666641541 shutdown_connections 2023-09-30T22:32:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.441+0000 7fca7a8f9700 1 --2- 172.21.15.59:0/666641541 >> v2:172.21.15.59:3300/0 conn(0x7fca7409e410 0x7fca74130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.441+0000 7fca7a8f9700 1 --2- 172.21.15.59:0/666641541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca7409d6f0 0x7fca7409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.441+0000 7fca7a8f9700 1 --2- 172.21.15.59:0/666641541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca7409e000 0x7fca74130660 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.441+0000 7fca7a8f9700 1 -- 172.21.15.59:0/666641541 >> 172.21.15.59:0/666641541 conn(0x7fca74066f50 msgr2=0x7fca7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.441+0000 7fca7a8f9700 1 -- 172.21.15.59:0/666641541 shutdown_connections 2023-09-30T22:32:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.441+0000 7fca7a8f9700 1 -- 172.21.15.59:0/666641541 wait complete. 2023-09-30T22:32:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.442+0000 7fca7a8f9700 1 Processor -- start 2023-09-30T22:32:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.443+0000 7fca7a8f9700 1 -- start start 2023-09-30T22:32:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.443+0000 7fca7a8f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7409d6f0 0x7fca7411f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.443+0000 7fca7a8f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca7409e000 0x7fca7411f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.443+0000 7fca7a8f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca7409e410 0x7fca7411fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.443+0000 7fca7a8f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca74122910 con 0x7fca7409d6f0 2023-09-30T22:32:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.443+0000 7fca7a8f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca741215b0 con 0x7fca7409e000 2023-09-30T22:32:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.443+0000 7fca7a8f9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca7406eb50 con 0x7fca7409e410 2023-09-30T22:32:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.443+0000 7fca78e96700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca7409e410 0x7fca7411fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.443+0000 7fca78e96700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca7409e410 0x7fca7411fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53240/0 (socket says 172.21.15.59:53240) 2023-09-30T22:32:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.443+0000 7fca78e96700 1 -- 172.21.15.59:0/1187621308 learned_addr learned my addr 172.21.15.59:0/1187621308 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.444+0000 7fca737fe700 1 --2- 172.21.15.59:0/1187621308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca7409e000 0x7fca7411f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.444+0000 7fca78e96700 1 -- 172.21.15.59:0/1187621308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca7409e000 msgr2=0x7fca7411f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.444+0000 7fca78e96700 1 --2- 172.21.15.59:0/1187621308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca7409e000 0x7fca7411f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.444+0000 7fca73fff700 1 --2- 172.21.15.59:0/1187621308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7409d6f0 0x7fca7411f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.444+0000 7fca78e96700 1 -- 172.21.15.59:0/1187621308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7409d6f0 msgr2=0x7fca7411f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.444+0000 7fca78e96700 1 --2- 172.21.15.59:0/1187621308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7409d6f0 0x7fca7411f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.444+0000 7fca78e96700 1 -- 172.21.15.59:0/1187621308 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68009550 con 0x7fca7409e410 2023-09-30T22:32:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.444+0000 7fca737fe700 1 --2- 172.21.15.59:0/1187621308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca7409e000 0x7fca7411f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.444+0000 7fca73fff700 1 --2- 172.21.15.59:0/1187621308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7409d6f0 0x7fca7411f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.444+0000 7fca78e96700 1 --2- 172.21.15.59:0/1187621308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca7409e410 0x7fca7411fb50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00e080 tx=0x7fca6c00e160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.444+0000 7fca70ff9700 1 -- 172.21.15.59:0/1187621308 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c011070 con 0x7fca7409e410 2023-09-30T22:32:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.444+0000 7fca70ff9700 1 -- 172.21.15.59:0/1187621308 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c00c2e0 con 0x7fca7409e410 2023-09-30T22:32:57.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.444+0000 7fca70ff9700 1 -- 172.21.15.59:0/1187621308 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c00ead0 con 0x7fca7409e410 2023-09-30T22:32:57.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.445+0000 7fca7a8f9700 1 -- 172.21.15.59:0/1187621308 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7409c700 con 0x7fca7409e410 2023-09-30T22:32:57.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.445+0000 7fca7a8f9700 1 -- 172.21.15.59:0/1187621308 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca74121f90 con 0x7fca7409e410 2023-09-30T22:32:57.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.446+0000 7fca70ff9700 1 -- 172.21.15.59:0/1187621308 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca6c00ec30 con 0x7fca7409e410 2023-09-30T22:32:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.446+0000 7fca7a8f9700 1 -- 172.21.15.59:0/1187621308 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca74074ea0 con 0x7fca7409e410 2023-09-30T22:32:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.446+0000 7fca70ff9700 1 -- 172.21.15.59:0/1187621308 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fca6c0415a0 con 0x7fca7409e410 2023-09-30T22:32:57.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.455+0000 7fca70ff9700 1 -- 172.21.15.59:0/1187621308 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca6c00a530 con 0x7fca7409e410 2023-09-30T22:32:57.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.542+0000 7f88b324a700 1 -- 172.21.15.59:0/2317704402 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f88ac074ea0 con 0x7f88ac06a770 2023-09-30T22:32:57.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.543+0000 7f88a97fa700 1 -- 172.21.15.59:0/2317704402 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88a001b430 con 0x7f88ac06a770 2023-09-30T22:32:57.544 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:57.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.545+0000 7f88b324a700 1 -- 172.21.15.59:0/2317704402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88ac06a770 msgr2=0x7f88ac12dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.545+0000 7f88b324a700 1 --2- 172.21.15.59:0/2317704402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88ac06a770 0x7f88ac12dd40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f88a0000c00 tx=0x7f88a0004750 comp rx=0 tx=0).stop 2023-09-30T22:32:57.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.545+0000 7f88b324a700 1 -- 172.21.15.59:0/2317704402 shutdown_connections 2023-09-30T22:32:57.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.545+0000 7f88b324a700 1 --2- 172.21.15.59:0/2317704402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88ac13c1e0 0x7f88ac12e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.545+0000 7f88b324a700 1 --2- 172.21.15.59:0/2317704402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88ac06a770 0x7f88ac12dd40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.545+0000 7f88b324a700 1 --2- 172.21.15.59:0/2317704402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88ac09dc30 0x7f88ac12e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.545+0000 7f88b324a700 1 -- 172.21.15.59:0/2317704402 >> 172.21.15.59:0/2317704402 conn(0x7f88ac066f50 msgr2=0x7f88ac13e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:57.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.545+0000 7f88b324a700 1 -- 172.21.15.59:0/2317704402 shutdown_connections 2023-09-30T22:32:57.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.545+0000 7f88b324a700 1 -- 172.21.15.59:0/2317704402 wait complete. 2023-09-30T22:32:57.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:57.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.586+0000 7f81b7707700 1 -- 172.21.15.59:0/2442003516 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f81b01323f0 con 0x7f81b0135e50 2023-09-30T22:32:57.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.587+0000 7f81a5ffb700 1 -- 172.21.15.59:0/2442003516 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81a8021070 con 0x7f81b0135e50 2023-09-30T22:32:57.588 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:57.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.589+0000 7f81b7707700 1 -- 172.21.15.59:0/2442003516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0135e50 msgr2=0x7f81b011bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.589+0000 7f81b7707700 1 --2- 172.21.15.59:0/2442003516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0135e50 0x7f81b011bc50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f81a8017000 tx=0x7f81a8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.589+0000 7f81b7707700 1 -- 172.21.15.59:0/2442003516 shutdown_connections 2023-09-30T22:32:57.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.589+0000 7f81b7707700 1 --2- 172.21.15.59:0/2442003516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0135e50 0x7f81b011bc50 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.589+0000 7f81b7707700 1 --2- 172.21.15.59:0/2442003516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b009d6f0 0x7f81b011b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.589+0000 7f81b7707700 1 --2- 172.21.15.59:0/2442003516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b009e1d0 0x7f81b011b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.589+0000 7f81b7707700 1 -- 172.21.15.59:0/2442003516 >> 172.21.15.59:0/2442003516 conn(0x7f81b0066f50 msgr2=0x7f81b00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:57.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.589+0000 7f81b7707700 1 -- 172.21.15.59:0/2442003516 shutdown_connections 2023-09-30T22:32:57.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.589+0000 7f81b7707700 1 -- 172.21.15.59:0/2442003516 wait complete. 2023-09-30T22:32:57.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:57.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.628+0000 7f40608be700 1 -- 172.21.15.59:0/80209030 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f405c0747f0 con 0x7f405c09d630 2023-09-30T22:32:57.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.629+0000 7f404affd700 1 -- 172.21.15.59:0/80209030 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f404c017030 con 0x7f405c09d630 2023-09-30T22:32:57.630 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:57.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.631+0000 7f40608be700 1 -- 172.21.15.59:0/80209030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f405c09d630 msgr2=0x7f405c1c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.631+0000 7f40608be700 1 --2- 172.21.15.59:0/80209030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f405c09d630 0x7f405c1c8090 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f404c00ebe0 tx=0x7f404c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.631+0000 7f40608be700 1 -- 172.21.15.59:0/80209030 shutdown_connections 2023-09-30T22:32:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.631+0000 7f40608be700 1 --2- 172.21.15.59:0/80209030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f405c133930 0x7f405c1c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.631+0000 7f40608be700 1 --2- 172.21.15.59:0/80209030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f405c09d630 0x7f405c1c8090 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.631+0000 7f40608be700 1 --2- 172.21.15.59:0/80209030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f405c0a0a30 0x7f405c1c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.631+0000 7f40608be700 1 -- 172.21.15.59:0/80209030 >> 172.21.15.59:0/80209030 conn(0x7f405c0a3050 msgr2=0x7f405c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.631+0000 7f40608be700 1 -- 172.21.15.59:0/80209030 shutdown_connections 2023-09-30T22:32:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.631+0000 7f40608be700 1 -- 172.21.15.59:0/80209030 wait complete. 2023-09-30T22:32:57.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:32:57.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.663+0000 7fca7a8f9700 1 -- 172.21.15.59:0/1187621308 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fca741226e0 con 0x7fca7409e410 2023-09-30T22:32:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.664+0000 7fca70ff9700 1 -- 172.21.15.59:0/1187621308 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca6c01c300 con 0x7fca7409e410 2023-09-30T22:32:57.665 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:57.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.666+0000 7fca7a8f9700 1 -- 172.21.15.59:0/1187621308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca7409e410 msgr2=0x7fca7411fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:57.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.666+0000 7fca7a8f9700 1 --2- 172.21.15.59:0/1187621308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca7409e410 0x7fca7411fb50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00e080 tx=0x7fca6c00e160 comp rx=0 tx=0).stop 2023-09-30T22:32:57.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.666+0000 7fca7a8f9700 1 -- 172.21.15.59:0/1187621308 shutdown_connections 2023-09-30T22:32:57.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.666+0000 7fca7a8f9700 1 --2- 172.21.15.59:0/1187621308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca7409e410 0x7fca7411fb50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.666+0000 7fca7a8f9700 1 --2- 172.21.15.59:0/1187621308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7409d6f0 0x7fca7411f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.666+0000 7fca7a8f9700 1 --2- 172.21.15.59:0/1187621308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca7409e000 0x7fca7411f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.666+0000 7fca7a8f9700 1 -- 172.21.15.59:0/1187621308 >> 172.21.15.59:0/1187621308 conn(0x7fca74066f50 msgr2=0x7fca74119480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.666+0000 7fca7a8f9700 1 -- 172.21.15.59:0/1187621308 shutdown_connections 2023-09-30T22:32:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:57.666+0000 7fca7a8f9700 1 -- 172.21.15.59:0/1187621308 wait complete. 2023-09-30T22:32:57.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:58.561 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:32:58.605 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:32:58.647 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:32:58.682 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:32:58.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.725+0000 7efc548bc700 1 Processor -- start 2023-09-30T22:32:58.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.725+0000 7efc548bc700 1 -- start start 2023-09-30T22:32:58.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.726+0000 7efc548bc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc50131810 0x7efc50131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.726+0000 7efc548bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc50099a40 0x7efc50099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.726+0000 7efc548bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc5009a3b0 0x7efc50138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.726+0000 7efc548bc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc501313c0 con 0x7efc50131810 2023-09-30T22:32:58.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.726+0000 7efc548bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5006e8c0 con 0x7efc50099a40 2023-09-30T22:32:58.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.726+0000 7efc548bc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc50071d20 con 0x7efc5009a3b0 2023-09-30T22:32:58.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.727+0000 7efc4e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc50131810 0x7efc50131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.727+0000 7efc4dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc50099a40 0x7efc50099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.727+0000 7efc4e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc50131810 0x7efc50131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41928/0 (socket says 172.21.15.59:41928) 2023-09-30T22:32:58.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.727+0000 7efc4dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc50099a40 0x7efc50099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33696/0 (socket says 172.21.15.59:33696) 2023-09-30T22:32:58.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.727+0000 7efc4e59c700 1 -- 172.21.15.59:0/567518331 learned_addr learned my addr 172.21.15.59:0/567518331 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:58.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.727+0000 7efc4ed9d700 1 --2- 172.21.15.59:0/567518331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc5009a3b0 0x7efc50138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.727+0000 7efc4dd9b700 1 -- 172.21.15.59:0/567518331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc5009a3b0 msgr2=0x7efc50138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:58.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.727+0000 7efc4dd9b700 1 --2- 172.21.15.59:0/567518331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc5009a3b0 0x7efc50138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.727+0000 7efc4dd9b700 1 -- 172.21.15.59:0/567518331 >> v2:172.21.15.59:3300/0 conn(0x7efc50131810 msgr2=0x7efc50131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:58.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.727+0000 7efc4dd9b700 1 --2- 172.21.15.59:0/567518331 >> v2:172.21.15.59:3300/0 conn(0x7efc50131810 0x7efc50131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.727+0000 7efc4dd9b700 1 -- 172.21.15.59:0/567518331 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc500721a0 con 0x7efc50099a40 2023-09-30T22:32:58.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.727+0000 7efc4dd9b700 1 --2- 172.21.15.59:0/567518331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc50099a40 0x7efc50099e70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efc4400dc60 tx=0x7efc4400df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f58621d89c1b6010 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:58.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.727+0000 7efc4d59a700 1 -- 172.21.15.59:0/567518331 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44012070 con 0x7efc50099a40 2023-09-30T22:32:58.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.728+0000 7efc4d59a700 1 -- 172.21.15.59:0/567518331 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4400d2e0 con 0x7efc50099a40 2023-09-30T22:32:58.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.728+0000 7efc4d59a700 1 -- 172.21.15.59:0/567518331 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4400f900 con 0x7efc50099a40 2023-09-30T22:32:58.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.728+0000 7efc548bc700 1 -- 172.21.15.59:0/567518331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc50099a40 msgr2=0x7efc50099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:58.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.728+0000 7efc548bc700 1 --2- 172.21.15.59:0/567518331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc50099a40 0x7efc50099e70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efc4400dc60 tx=0x7efc4400df70 comp rx=0 tx=0).stop 2023-09-30T22:32:58.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.728+0000 7efc548bc700 1 -- 172.21.15.59:0/567518331 shutdown_connections 2023-09-30T22:32:58.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.728+0000 7efc548bc700 1 --2- 172.21.15.59:0/567518331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc5009a3b0 0x7efc50138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.728+0000 7efc548bc700 1 --2- 172.21.15.59:0/567518331 >> v2:172.21.15.59:3300/0 conn(0x7efc50131810 0x7efc50131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.728+0000 7efc548bc700 1 --2- 172.21.15.59:0/567518331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc50099a40 0x7efc50099e70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.728+0000 7efc548bc700 1 -- 172.21.15.59:0/567518331 >> 172.21.15.59:0/567518331 conn(0x7efc500a2aa0 msgr2=0x7efc500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:58.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.729+0000 7efc548bc700 1 -- 172.21.15.59:0/567518331 shutdown_connections 2023-09-30T22:32:58.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.729+0000 7efc548bc700 1 -- 172.21.15.59:0/567518331 wait complete. 2023-09-30T22:32:58.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.730+0000 7efc548bc700 1 Processor -- start 2023-09-30T22:32:58.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.730+0000 7efc548bc700 1 -- start start 2023-09-30T22:32:58.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.730+0000 7efc548bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc50099a40 0x7efc50118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.730+0000 7efc548bc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc5009a3b0 0x7efc50119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.730+0000 7efc548bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc50131810 0x7efc50119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.730+0000 7efc548bc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5012bcf0 con 0x7efc5009a3b0 2023-09-30T22:32:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.730+0000 7efc548bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5011c030 con 0x7efc50099a40 2023-09-30T22:32:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.730+0000 7efc548bc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc50130990 con 0x7efc50131810 2023-09-30T22:32:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.731+0000 7efc4ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc50131810 0x7efc50119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.731+0000 7efc4ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc50131810 0x7efc50119750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53260/0 (socket says 172.21.15.59:53260) 2023-09-30T22:32:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.731+0000 7efc4ed9d700 1 -- 172.21.15.59:0/850675140 learned_addr learned my addr 172.21.15.59:0/850675140 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.731+0000 7efc4dd9b700 1 --2- 172.21.15.59:0/850675140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc5009a3b0 0x7efc50119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.731+0000 7efc4e59c700 1 --2- 172.21.15.59:0/850675140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc50099a40 0x7efc50118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.731+0000 7efc4dd9b700 1 -- 172.21.15.59:0/850675140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc50131810 msgr2=0x7efc50119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.731+0000 7efc4dd9b700 1 --2- 172.21.15.59:0/850675140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc50131810 0x7efc50119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.731+0000 7efc4dd9b700 1 -- 172.21.15.59:0/850675140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc50099a40 msgr2=0x7efc50118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:58.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.731+0000 7efc4dd9b700 1 --2- 172.21.15.59:0/850675140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc50099a40 0x7efc50118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.731+0000 7efc4dd9b700 1 -- 172.21.15.59:0/850675140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4400d940 con 0x7efc5009a3b0 2023-09-30T22:32:58.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.731+0000 7efc4ed9d700 1 --2- 172.21.15.59:0/850675140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc50131810 0x7efc50119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:58.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.731+0000 7efc4e59c700 1 --2- 172.21.15.59:0/850675140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc50099a40 0x7efc50118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:32:58.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.731+0000 7efc4dd9b700 1 --2- 172.21.15.59:0/850675140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc5009a3b0 0x7efc50119210 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7efc5006dd30 tx=0x7efc44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:58.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.732+0000 7efc3effd700 1 -- 172.21.15.59:0/850675140 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44010ee0 con 0x7efc5009a3b0 2023-09-30T22:32:58.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.732+0000 7efc3effd700 1 -- 172.21.15.59:0/850675140 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc440036a0 con 0x7efc5009a3b0 2023-09-30T22:32:58.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.732+0000 7efc548bc700 1 -- 172.21.15.59:0/850675140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5006eb00 con 0x7efc5009a3b0 2023-09-30T22:32:58.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.732+0000 7efc3effd700 1 -- 172.21.15.59:0/850675140 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44003a30 con 0x7efc5009a3b0 2023-09-30T22:32:58.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.732+0000 7efc548bc700 1 -- 172.21.15.59:0/850675140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5011caa0 con 0x7efc5009a3b0 2023-09-30T22:32:58.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.733+0000 7efc548bc700 1 -- 172.21.15.59:0/850675140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5011bba0 con 0x7efc5009a3b0 2023-09-30T22:32:58.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.733+0000 7efc3effd700 1 -- 172.21.15.59:0/850675140 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc44003b90 con 0x7efc5009a3b0 2023-09-30T22:32:58.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.733+0000 7efc3effd700 1 -- 172.21.15.59:0/850675140 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efc440449e0 con 0x7efc5009a3b0 2023-09-30T22:32:58.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.743+0000 7efc3effd700 1 -- 172.21.15.59:0/850675140 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc44003e40 con 0x7efc5009a3b0 2023-09-30T22:32:58.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.755+0000 7fee34dfc700 1 Processor -- start 2023-09-30T22:32:58.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.755+0000 7fee34dfc700 1 -- start start 2023-09-30T22:32:58.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.756+0000 7fee34dfc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee3009d6f0 0x7fee3009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.756+0000 7fee34dfc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fee3009e000 0x7fee301339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.756+0000 7fee34dfc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3009e410 0x7fee30133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.756+0000 7fee34dfc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3006b460 con 0x7fee3009e000 2023-09-30T22:32:58.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.756+0000 7fee34dfc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3009b120 con 0x7fee3009e410 2023-09-30T22:32:58.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.756+0000 7fee34dfc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee3009a7e0 con 0x7fee3009d6f0 2023-09-30T22:32:58.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.756+0000 7fee2e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee3009d6f0 0x7fee3009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.756+0000 7fee2e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee3009d6f0 0x7fee3009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53274/0 (socket says 172.21.15.59:53274) 2023-09-30T22:32:58.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.756+0000 7fee2e59c700 1 -- 172.21.15.59:0/2788154636 learned_addr learned my addr 172.21.15.59:0/2788154636 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:58.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.756+0000 7fee2ed9d700 1 --2- 172.21.15.59:0/2788154636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3009e410 0x7fee30133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.756+0000 7fee2dd9b700 1 --2- 172.21.15.59:0/2788154636 >> v2:172.21.15.59:3300/0 conn(0x7fee3009e000 0x7fee301339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.757+0000 7fee2e59c700 1 -- 172.21.15.59:0/2788154636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3009e410 msgr2=0x7fee30133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:58.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.757+0000 7fee2e59c700 1 --2- 172.21.15.59:0/2788154636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3009e410 0x7fee30133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.757+0000 7fee2e59c700 1 -- 172.21.15.59:0/2788154636 >> v2:172.21.15.59:3300/0 conn(0x7fee3009e000 msgr2=0x7fee301339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:58.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.757+0000 7fee2e59c700 1 --2- 172.21.15.59:0/2788154636 >> v2:172.21.15.59:3300/0 conn(0x7fee3009e000 0x7fee301339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.757+0000 7fee2e59c700 1 -- 172.21.15.59:0/2788154636 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3009a500 con 0x7fee3009d6f0 2023-09-30T22:32:58.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.757+0000 7fee2e59c700 1 --2- 172.21.15.59:0/2788154636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee3009d6f0 0x7fee3009dac0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fee20009e80 tx=0x7fee2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a19fbd8b762e218 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:58.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.757+0000 7fee2d59a700 1 -- 172.21.15.59:0/2788154636 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2000e070 con 0x7fee3009d6f0 2023-09-30T22:32:58.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.757+0000 7fee2d59a700 1 -- 172.21.15.59:0/2788154636 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2000b8d0 con 0x7fee3009d6f0 2023-09-30T22:32:58.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.757+0000 7fee2d59a700 1 -- 172.21.15.59:0/2788154636 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2000bc80 con 0x7fee3009d6f0 2023-09-30T22:32:58.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.758+0000 7fee34dfc700 1 -- 172.21.15.59:0/2788154636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee3009d6f0 msgr2=0x7fee3009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:58.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.758+0000 7fee34dfc700 1 --2- 172.21.15.59:0/2788154636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee3009d6f0 0x7fee3009dac0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fee20009e80 tx=0x7fee2000b330 comp rx=0 tx=0).stop 2023-09-30T22:32:58.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.758+0000 7fee34dfc700 1 -- 172.21.15.59:0/2788154636 shutdown_connections 2023-09-30T22:32:58.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.758+0000 7fee34dfc700 1 --2- 172.21.15.59:0/2788154636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3009e410 0x7fee30133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.758+0000 7fee34dfc700 1 --2- 172.21.15.59:0/2788154636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee3009d6f0 0x7fee3009dac0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.758+0000 7fee34dfc700 1 --2- 172.21.15.59:0/2788154636 >> v2:172.21.15.59:3300/0 conn(0x7fee3009e000 0x7fee301339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.758+0000 7fee34dfc700 1 -- 172.21.15.59:0/2788154636 >> 172.21.15.59:0/2788154636 conn(0x7fee30066f50 msgr2=0x7fee3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:58.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.758+0000 7fee34dfc700 1 -- 172.21.15.59:0/2788154636 shutdown_connections 2023-09-30T22:32:58.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.758+0000 7fee34dfc700 1 -- 172.21.15.59:0/2788154636 wait complete. 2023-09-30T22:32:58.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.759+0000 7fee34dfc700 1 Processor -- start 2023-09-30T22:32:58.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.759+0000 7fee34dfc700 1 -- start start 2023-09-30T22:32:58.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.760+0000 7fee34dfc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3009d6f0 0x7fee301a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.760+0000 7fee34dfc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee3009e000 0x7fee301a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.760+0000 7fee34dfc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee3009e410 0x7fee301a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.760+0000 7fee34dfc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee301a98c0 con 0x7fee3009e000 2023-09-30T22:32:58.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.760+0000 7fee34dfc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee301a7fd0 con 0x7fee3009d6f0 2023-09-30T22:32:58.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.760+0000 7fee34dfc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee301a8c90 con 0x7fee3009e410 2023-09-30T22:32:58.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.760+0000 7fee2dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee3009e000 0x7fee301a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.760+0000 7fee2dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee3009e000 0x7fee301a6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41950/0 (socket says 172.21.15.59:41950) 2023-09-30T22:32:58.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.760+0000 7fee2dd9b700 1 -- 172.21.15.59:0/3094332669 learned_addr learned my addr 172.21.15.59:0/3094332669 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:58.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.760+0000 7fee2ed9d700 1 --2- 172.21.15.59:0/3094332669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee3009e410 0x7fee301a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.761+0000 7fee2dd9b700 1 -- 172.21.15.59:0/3094332669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee3009e410 msgr2=0x7fee301a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:58.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.761+0000 7fee2dd9b700 1 --2- 172.21.15.59:0/3094332669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee3009e410 0x7fee301a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.761+0000 7fee2e59c700 1 --2- 172.21.15.59:0/3094332669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3009d6f0 0x7fee301a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.761+0000 7fee2dd9b700 1 -- 172.21.15.59:0/3094332669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3009d6f0 msgr2=0x7fee301a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:58.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.761+0000 7fee2dd9b700 1 --2- 172.21.15.59:0/3094332669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3009d6f0 0x7fee301a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.761+0000 7fee2dd9b700 1 -- 172.21.15.59:0/3094332669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee20009b30 con 0x7fee3009e000 2023-09-30T22:32:58.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.761+0000 7fee2e59c700 1 --2- 172.21.15.59:0/3094332669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3009d6f0 0x7fee301a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:32:58.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.761+0000 7fee2dd9b700 1 --2- 172.21.15.59:0/3094332669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee3009e000 0x7fee301a6370 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fee2400e9b0 tx=0x7fee2400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:58.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.761+0000 7fee1effd700 1 -- 172.21.15.59:0/3094332669 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24009710 con 0x7fee3009e000 2023-09-30T22:32:58.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.761+0000 7fee1effd700 1 -- 172.21.15.59:0/3094332669 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2400c850 con 0x7fee3009e000 2023-09-30T22:32:58.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.761+0000 7fee34dfc700 1 -- 172.21.15.59:0/3094332669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee301a7290 con 0x7fee3009e000 2023-09-30T22:32:58.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.761+0000 7fee1effd700 1 -- 172.21.15.59:0/3094332669 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2400cbe0 con 0x7fee3009e000 2023-09-30T22:32:58.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.761+0000 7fee34dfc700 1 -- 172.21.15.59:0/3094332669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee300a2260 con 0x7fee3009e000 2023-09-30T22:32:58.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.762+0000 7fee34dfc700 1 -- 172.21.15.59:0/3094332669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee301a9440 con 0x7fee3009e000 2023-09-30T22:32:58.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.763+0000 7fee1effd700 1 -- 172.21.15.59:0/3094332669 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee2400cd40 con 0x7fee3009e000 2023-09-30T22:32:58.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.763+0000 7fee1effd700 1 -- 172.21.15.59:0/3094332669 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fee24040160 con 0x7fee3009e000 2023-09-30T22:32:58.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.768+0000 7fee1effd700 1 -- 172.21.15.59:0/3094332669 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee24024350 con 0x7fee3009e000 2023-09-30T22:32:58.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.816+0000 7f7a87a18700 1 Processor -- start 2023-09-30T22:32:58.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.817+0000 7f7a87a18700 1 -- start start 2023-09-30T22:32:58.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.817+0000 7f7a87a18700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a80131810 0x7f7a80131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.817+0000 7f7a87a18700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8009a580 0x7f7a80139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.817+0000 7f7a87a18700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a801313c0 con 0x7f7a80099a40 2023-09-30T22:32:58.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.817+0000 7f7a87a18700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8006e8c0 con 0x7f7a80131810 2023-09-30T22:32:58.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.817+0000 7f7a87a18700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80071d20 con 0x7f7a8009a580 2023-09-30T22:32:58.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.817+0000 7f7a857b4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a80131810 0x7f7a80131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.818+0000 7f7a857b4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a80131810 0x7f7a80131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41966/0 (socket says 172.21.15.59:41966) 2023-09-30T22:32:58.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.818+0000 7f7a857b4700 1 -- 172.21.15.59:0/2447680739 learned_addr learned my addr 172.21.15.59:0/2447680739 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:58.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.818+0000 7f7a85fb5700 1 --2- 172.21.15.59:0/2447680739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8009a580 0x7f7a80139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.818+0000 7f7a857b4700 1 -- 172.21.15.59:0/2447680739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8009a580 msgr2=0x7f7a80139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:58.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.818+0000 7f7a857b4700 1 --2- 172.21.15.59:0/2447680739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8009a580 0x7f7a80139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.818+0000 7f7a77fff700 1 -- 172.21.15.59:0/2447680739 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561083115 0 0) 0x7f7a801313c0 con 0x7f7a80099a40 2023-09-30T22:32:58.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.818+0000 7f7a857b4700 1 -- 172.21.15.59:0/2447680739 >> v1:172.21.15.59:6789/0 conn(0x7f7a80099a40 legacy=0x7f7a80099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:58.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.818+0000 7f7a857b4700 1 -- 172.21.15.59:0/2447680739 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a800721a0 con 0x7f7a80131810 2023-09-30T22:32:58.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.818+0000 7f7a857b4700 1 --2- 172.21.15.59:0/2447680739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a80131810 0x7f7a80131be0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0098f0 tx=0x7f7a7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6743ba1301cd34a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:58.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.818+0000 7f7a77fff700 1 -- 172.21.15.59:0/2447680739 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c011830 con 0x7f7a80131810 2023-09-30T22:32:58.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.818+0000 7f7a77fff700 1 -- 172.21.15.59:0/2447680739 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c011990 con 0x7f7a80131810 2023-09-30T22:32:58.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.818+0000 7f7a77fff700 1 -- 172.21.15.59:0/2447680739 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c011d20 con 0x7f7a80131810 2023-09-30T22:32:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.819+0000 7f7a87a18700 1 -- 172.21.15.59:0/2447680739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a80131810 msgr2=0x7f7a80131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.819+0000 7f7a87a18700 1 --2- 172.21.15.59:0/2447680739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a80131810 0x7f7a80131be0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0098f0 tx=0x7f7a7c009c00 comp rx=0 tx=0).stop 2023-09-30T22:32:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.819+0000 7f7a87a18700 1 -- 172.21.15.59:0/2447680739 shutdown_connections 2023-09-30T22:32:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.819+0000 7f7a87a18700 1 --2- 172.21.15.59:0/2447680739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8009a580 0x7f7a80139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.819+0000 7f7a87a18700 1 --2- 172.21.15.59:0/2447680739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a80131810 0x7f7a80131be0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.819+0000 7f7a87a18700 1 -- 172.21.15.59:0/2447680739 >> 172.21.15.59:0/2447680739 conn(0x7f7a800a2aa0 msgr2=0x7f7a800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.819+0000 7f7a87a18700 1 -- 172.21.15.59:0/2447680739 shutdown_connections 2023-09-30T22:32:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.819+0000 7f7a87a18700 1 -- 172.21.15.59:0/2447680739 wait complete. 2023-09-30T22:32:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.821+0000 7f7a87a18700 1 Processor -- start 2023-09-30T22:32:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.821+0000 7f7a87a18700 1 -- start start 2023-09-30T22:32:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a87a18700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a80099a40 0x7f7a8011b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a87a18700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8009a580 0x7f7a8011bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a87a18700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a80131810 0x7f7a8011c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a87a18700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8011ef00 con 0x7f7a80131810 2023-09-30T22:32:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a87a18700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8011f0e0 con 0x7f7a80099a40 2023-09-30T22:32:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a87a18700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8011e420 con 0x7f7a8009a580 2023-09-30T22:32:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a84fb3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8009a580 0x7f7a8011bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a857b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a80099a40 0x7f7a8011b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a84fb3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8009a580 0x7f7a8011bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53302/0 (socket says 172.21.15.59:53302) 2023-09-30T22:32:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a857b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a80099a40 0x7f7a8011b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33724/0 (socket says 172.21.15.59:33724) 2023-09-30T22:32:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a84fb3700 1 -- 172.21.15.59:0/1906440542 learned_addr learned my addr 172.21.15.59:0/1906440542 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a85fb5700 1 --2- 172.21.15.59:0/1906440542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a80131810 0x7f7a8011c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a84fb3700 1 -- 172.21.15.59:0/1906440542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a80099a40 msgr2=0x7f7a8011b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a84fb3700 1 --2- 172.21.15.59:0/1906440542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a80099a40 0x7f7a8011b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a84fb3700 1 -- 172.21.15.59:0/1906440542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a80131810 msgr2=0x7f7a8011c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a84fb3700 1 --2- 172.21.15.59:0/1906440542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a80131810 0x7f7a8011c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a84fb3700 1 -- 172.21.15.59:0/1906440542 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c009550 con 0x7f7a8009a580 2023-09-30T22:32:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.822+0000 7f7a85fb5700 1 --2- 172.21.15.59:0/1906440542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a80131810 0x7f7a8011c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.823+0000 7f7a84fb3700 1 --2- 172.21.15.59:0/1906440542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8009a580 0x7f7a8011bb00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c580 tx=0x7f7a7000c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.823+0000 7f7a75ffb700 1 -- 172.21.15.59:0/1906440542 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a700054e0 con 0x7f7a8009a580 2023-09-30T22:32:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.823+0000 7f7a75ffb700 1 -- 172.21.15.59:0/1906440542 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a70003680 con 0x7f7a8009a580 2023-09-30T22:32:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.823+0000 7f7a75ffb700 1 -- 172.21.15.59:0/1906440542 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70003a30 con 0x7f7a8009a580 2023-09-30T22:32:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.823+0000 7f7a87a18700 1 -- 172.21.15.59:0/1906440542 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a800a1a80 con 0x7f7a8009a580 2023-09-30T22:32:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.823+0000 7f7a87a18700 1 -- 172.21.15.59:0/1906440542 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8011d2d0 con 0x7f7a8009a580 2023-09-30T22:32:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.824+0000 7f7a75ffb700 1 -- 172.21.15.59:0/1906440542 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a70003b90 con 0x7f7a8009a580 2023-09-30T22:32:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.824+0000 7f7a75ffb700 1 -- 172.21.15.59:0/1906440542 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7a70040aa0 con 0x7f7a8009a580 2023-09-30T22:32:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.825+0000 7f7a87a18700 1 -- 172.21.15.59:0/1906440542 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a8011ed20 con 0x7f7a8009a580 2023-09-30T22:32:58.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.830+0000 7f7a75ffb700 1 -- 172.21.15.59:0/1906440542 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a70017020 con 0x7f7a8009a580 2023-09-30T22:32:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.845+0000 7f4feeed6700 1 Processor -- start 2023-09-30T22:32:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.845+0000 7f4feeed6700 1 -- start start 2023-09-30T22:32:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.846+0000 7f4feeed6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe809e1d0 0x7f4fe8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.846+0000 7f4feeed6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe8139170 0x7f4fe813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.846+0000 7f4feeed6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe809b120 con 0x7f4fe809d6f0 2023-09-30T22:32:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.846+0000 7f4feeed6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe806b460 con 0x7f4fe809e1d0 2023-09-30T22:32:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.846+0000 7f4feeed6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe809a7e0 con 0x7f4fe8139170 2023-09-30T22:32:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.846+0000 7f4fecc72700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4fe809d6f0 0x7f4fe809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52136/0 (socket says 172.21.15.59:52136) 2023-09-30T22:32:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.846+0000 7f4fecc72700 1 -- 172.21.15.59:0/2521154521 learned_addr learned my addr 172.21.15.59:0/2521154521 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:32:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.846+0000 7f4fed473700 1 --2- 172.21.15.59:0/2521154521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe8139170 0x7f4fe813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.846+0000 7f4fe7fff700 1 --2- 172.21.15.59:0/2521154521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe809e1d0 0x7f4fe8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.846+0000 7f4fed473700 1 -- 172.21.15.59:0/2521154521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe809e1d0 msgr2=0x7f4fe8138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:32:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.846+0000 7f4fed473700 1 --2- 172.21.15.59:0/2521154521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe809e1d0 0x7f4fe8138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.846+0000 7f4fed473700 1 -- 172.21.15.59:0/2521154521 >> v1:172.21.15.59:6789/0 conn(0x7f4fe809d6f0 legacy=0x7f4fe809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.846+0000 7f4fed473700 1 -- 172.21.15.59:0/2521154521 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe809a500 con 0x7f4fe8139170 2023-09-30T22:32:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.847+0000 7f4fed473700 1 --2- 172.21.15.59:0/2521154521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe8139170 0x7f4fe813b550 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009df0 tx=0x7f4fe000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37e5e29dcb6b184f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.847+0000 7f4fe77fe700 1 -- 172.21.15.59:0/2521154521 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe000e070 con 0x7f4fe8139170 2023-09-30T22:32:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.847+0000 7f4fe77fe700 1 -- 172.21.15.59:0/2521154521 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe000bae0 con 0x7f4fe8139170 2023-09-30T22:32:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.847+0000 7f4fe77fe700 1 -- 172.21.15.59:0/2521154521 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe000be90 con 0x7f4fe8139170 2023-09-30T22:32:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.847+0000 7f4feeed6700 1 -- 172.21.15.59:0/2521154521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe8139170 msgr2=0x7f4fe813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.847+0000 7f4feeed6700 1 --2- 172.21.15.59:0/2521154521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe8139170 0x7f4fe813b550 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009df0 tx=0x7f4fe000b330 comp rx=0 tx=0).stop 2023-09-30T22:32:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.848+0000 7f4feeed6700 1 -- 172.21.15.59:0/2521154521 shutdown_connections 2023-09-30T22:32:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.848+0000 7f4feeed6700 1 --2- 172.21.15.59:0/2521154521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe8139170 0x7f4fe813b550 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.848+0000 7f4feeed6700 1 --2- 172.21.15.59:0/2521154521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe809e1d0 0x7f4fe8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.848+0000 7f4feeed6700 1 -- 172.21.15.59:0/2521154521 >> 172.21.15.59:0/2521154521 conn(0x7f4fe8066f50 msgr2=0x7f4fe809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.848+0000 7f4feeed6700 1 -- 172.21.15.59:0/2521154521 shutdown_connections 2023-09-30T22:32:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.848+0000 7f4feeed6700 1 -- 172.21.15.59:0/2521154521 wait complete. 2023-09-30T22:32:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.849+0000 7f4feeed6700 1 Processor -- start 2023-09-30T22:32:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.849+0000 7f4feeed6700 1 -- start start 2023-09-30T22:32:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.849+0000 7f4feeed6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe809d6f0 0x7f4fe8121900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.849+0000 7f4feeed6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe809e1d0 0x7f4fe8121e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.849+0000 7f4feeed6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe8139170 0x7f4fe8122380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:32:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.849+0000 7f4feeed6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe809c710 con 0x7f4fe809d6f0 2023-09-30T22:32:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.849+0000 7f4feeed6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe80a1fe0 con 0x7f4fe8139170 2023-09-30T22:32:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.849+0000 7f4feeed6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe8123a90 con 0x7f4fe809e1d0 2023-09-30T22:32:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.850+0000 7f4fed473700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe8139170 0x7f4fe8122380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.850+0000 7f4fed473700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe8139170 0x7f4fe8122380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33740/0 (socket says 172.21.15.59:33740) 2023-09-30T22:32:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.850+0000 7f4fed473700 1 -- 172.21.15.59:0/3249143003 learned_addr learned my addr 172.21.15.59:0/3249143003 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:32:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.850+0000 7f4fecc72700 1 --2- 172.21.15.59:0/3249143003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe809d6f0 0x7f4fe8121900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.850+0000 7f4fe7fff700 1 --2- 172.21.15.59:0/3249143003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe809e1d0 0x7f4fe8121e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:32:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.850+0000 7f4fed473700 1 -- 172.21.15.59:0/3249143003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe809e1d0 msgr2=0x7f4fe8121e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.850+0000 7f4fed473700 1 --2- 172.21.15.59:0/3249143003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe809e1d0 0x7f4fe8121e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.850+0000 7f4fed473700 1 -- 172.21.15.59:0/3249143003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe809d6f0 msgr2=0x7f4fe8121900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.850+0000 7f4fed473700 1 --2- 172.21.15.59:0/3249143003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe809d6f0 0x7f4fe8121900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.850+0000 7f4fed473700 1 -- 172.21.15.59:0/3249143003 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe0009a70 con 0x7f4fe8139170 2023-09-30T22:32:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.850+0000 7f4fecc72700 1 --2- 172.21.15.59:0/3249143003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe809d6f0 0x7f4fe8121900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.850+0000 7f4fe7fff700 1 --2- 172.21.15.59:0/3249143003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe809e1d0 0x7f4fe8121e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:32:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.850+0000 7f4fed473700 1 --2- 172.21.15.59:0/3249143003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe8139170 0x7f4fe8122380 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4fe809a970 tx=0x7f4fe0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:32:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.850+0000 7f4fe57fa700 1 -- 172.21.15.59:0/3249143003 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0004550 con 0x7f4fe8139170 2023-09-30T22:32:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.851+0000 7f4fe57fa700 1 -- 172.21.15.59:0/3249143003 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe0028070 con 0x7f4fe8139170 2023-09-30T22:32:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.851+0000 7f4fe57fa700 1 -- 172.21.15.59:0/3249143003 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0004910 con 0x7f4fe8139170 2023-09-30T22:32:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.851+0000 7f4feeed6700 1 -- 172.21.15.59:0/3249143003 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe81234c0 con 0x7f4fe8139170 2023-09-30T22:32:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.851+0000 7f4feeed6700 1 -- 172.21.15.59:0/3249143003 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe8123cb0 con 0x7f4fe8139170 2023-09-30T22:32:58.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.852+0000 7f4feeed6700 1 -- 172.21.15.59:0/3249143003 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe8125c20 con 0x7f4fe8139170 2023-09-30T22:32:58.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.852+0000 7f4fe57fa700 1 -- 172.21.15.59:0/3249143003 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fe0012430 con 0x7f4fe8139170 2023-09-30T22:32:58.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.852+0000 7f4fe57fa700 1 -- 172.21.15.59:0/3249143003 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4fe002a070 con 0x7f4fe8139170 2023-09-30T22:32:58.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.861+0000 7f4fe57fa700 1 -- 172.21.15.59:0/3249143003 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fe004f060 con 0x7f4fe8139170 2023-09-30T22:32:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.986+0000 7efc548bc700 1 -- 172.21.15.59:0/850675140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efc50074ea0 con 0x7efc5009a3b0 2023-09-30T22:32:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.986+0000 7efc3effd700 1 -- 172.21.15.59:0/850675140 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc4401fb90 con 0x7efc5009a3b0 2023-09-30T22:32:58.988 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.990+0000 7efc548bc700 1 -- 172.21.15.59:0/850675140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc5009a3b0 msgr2=0x7efc50119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.990+0000 7efc548bc700 1 --2- 172.21.15.59:0/850675140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc5009a3b0 0x7efc50119210 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7efc5006dd30 tx=0x7efc44004750 comp rx=0 tx=0).stop 2023-09-30T22:32:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.990+0000 7efc548bc700 1 -- 172.21.15.59:0/850675140 shutdown_connections 2023-09-30T22:32:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.990+0000 7efc548bc700 1 --2- 172.21.15.59:0/850675140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc50131810 0x7efc50119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.990+0000 7efc548bc700 1 --2- 172.21.15.59:0/850675140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc50099a40 0x7efc50118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.990+0000 7efc548bc700 1 --2- 172.21.15.59:0/850675140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc5009a3b0 0x7efc50119210 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.990+0000 7efc548bc700 1 -- 172.21.15.59:0/850675140 >> 172.21.15.59:0/850675140 conn(0x7efc500a2aa0 msgr2=0x7efc5012e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.990+0000 7efc548bc700 1 -- 172.21.15.59:0/850675140 shutdown_connections 2023-09-30T22:32:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:58.990+0000 7efc548bc700 1 -- 172.21.15.59:0/850675140 wait complete. 2023-09-30T22:32:59.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:32:59.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.025+0000 7fee34dfc700 1 -- 172.21.15.59:0/3094332669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fee3006c360 con 0x7fee3009e000 2023-09-30T22:32:59.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.025+0000 7fee1effd700 1 -- 172.21.15.59:0/3094332669 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee240123d0 con 0x7fee3009e000 2023-09-30T22:32:59.026 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:32:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.027+0000 7fee34dfc700 1 -- 172.21.15.59:0/3094332669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee3009e000 msgr2=0x7fee301a6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.027+0000 7fee34dfc700 1 --2- 172.21.15.59:0/3094332669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee3009e000 0x7fee301a6370 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fee2400e9b0 tx=0x7fee2400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:32:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.027+0000 7fee34dfc700 1 -- 172.21.15.59:0/3094332669 shutdown_connections 2023-09-30T22:32:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.027+0000 7fee34dfc700 1 --2- 172.21.15.59:0/3094332669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee3009e410 0x7fee301a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.027+0000 7fee34dfc700 1 --2- 172.21.15.59:0/3094332669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3009d6f0 0x7fee301a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.027+0000 7fee34dfc700 1 --2- 172.21.15.59:0/3094332669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee3009e000 0x7fee301a6370 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.027+0000 7fee34dfc700 1 -- 172.21.15.59:0/3094332669 >> 172.21.15.59:0/3094332669 conn(0x7fee30066f50 msgr2=0x7fee301baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.027+0000 7fee34dfc700 1 -- 172.21.15.59:0/3094332669 shutdown_connections 2023-09-30T22:32:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.027+0000 7fee34dfc700 1 -- 172.21.15.59:0/3094332669 wait complete. 2023-09-30T22:32:59.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:32:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.079+0000 7f4feeed6700 1 -- 172.21.15.59:0/3249143003 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4fe8074ea0 con 0x7f4fe8139170 2023-09-30T22:32:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.079+0000 7f4fe57fa700 1 -- 172.21.15.59:0/3249143003 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fe004f020 con 0x7f4fe8139170 2023-09-30T22:32:59.081 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:32:59.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.082+0000 7f4feeed6700 1 -- 172.21.15.59:0/3249143003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe8139170 msgr2=0x7f4fe8122380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:59.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.082+0000 7f4feeed6700 1 --2- 172.21.15.59:0/3249143003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe8139170 0x7f4fe8122380 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4fe809a970 tx=0x7f4fe0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:32:59.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.082+0000 7f4feeed6700 1 -- 172.21.15.59:0/3249143003 shutdown_connections 2023-09-30T22:32:59.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.082+0000 7f4feeed6700 1 --2- 172.21.15.59:0/3249143003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe8139170 0x7f4fe8122380 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:59.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.082+0000 7f4feeed6700 1 --2- 172.21.15.59:0/3249143003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe809d6f0 0x7f4fe8121900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:59.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.082+0000 7f4feeed6700 1 --2- 172.21.15.59:0/3249143003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe809e1d0 0x7f4fe8121e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:59.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.082+0000 7f4feeed6700 1 -- 172.21.15.59:0/3249143003 >> 172.21.15.59:0/3249143003 conn(0x7f4fe8066f50 msgr2=0x7f4fe8070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:59.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.082+0000 7f4feeed6700 1 -- 172.21.15.59:0/3249143003 shutdown_connections 2023-09-30T22:32:59.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.082+0000 7f4feeed6700 1 -- 172.21.15.59:0/3249143003 wait complete. 2023-09-30T22:32:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.085+0000 7f7a87a18700 1 -- 172.21.15.59:0/1906440542 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7a80074ea0 con 0x7f7a8009a580 2023-09-30T22:32:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.086+0000 7f7a75ffb700 1 -- 172.21.15.59:0/1906440542 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a70044060 con 0x7f7a8009a580 2023-09-30T22:32:59.087 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:32:59.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.088+0000 7f7a87a18700 1 -- 172.21.15.59:0/1906440542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8009a580 msgr2=0x7f7a8011bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:32:59.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.088+0000 7f7a87a18700 1 --2- 172.21.15.59:0/1906440542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8009a580 0x7f7a8011bb00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c580 tx=0x7f7a7000c890 comp rx=0 tx=0).stop 2023-09-30T22:32:59.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.088+0000 7f7a87a18700 1 -- 172.21.15.59:0/1906440542 shutdown_connections 2023-09-30T22:32:59.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.088+0000 7f7a87a18700 1 --2- 172.21.15.59:0/1906440542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a80131810 0x7f7a8011c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:59.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.088+0000 7f7a87a18700 1 --2- 172.21.15.59:0/1906440542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a80099a40 0x7f7a8011b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:59.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.088+0000 7f7a87a18700 1 --2- 172.21.15.59:0/1906440542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8009a580 0x7f7a8011bb00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:32:59.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.088+0000 7f7a87a18700 1 -- 172.21.15.59:0/1906440542 >> 172.21.15.59:0/1906440542 conn(0x7f7a800a2aa0 msgr2=0x7f7a801b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:32:59.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.088+0000 7f7a87a18700 1 -- 172.21.15.59:0/1906440542 shutdown_connections 2023-09-30T22:32:59.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:32:59.088+0000 7f7a87a18700 1 -- 172.21.15.59:0/1906440542 wait complete. 2023-09-30T22:32:59.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:32:59.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:00.011 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:00.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:00.099 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:00.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:00.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.165+0000 7fa880935700 1 Processor -- start 2023-09-30T22:33:00.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.165+0000 7fa880935700 1 -- start start 2023-09-30T22:33:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.166+0000 7fa880935700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09f410 0x7fa87c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.166+0000 7fa880935700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa87c136fe0 0x7fa87c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.166+0000 7fa880935700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c070940 con 0x7fa87c09e930 2023-09-30T22:33:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.166+0000 7fa880935700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c06fd60 con 0x7fa87c136fe0 2023-09-30T22:33:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.166+0000 7fa880935700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c06fa80 con 0x7fa87c09f410 2023-09-30T22:33:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.166+0000 7fa879d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09f410 0x7fa87c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.166+0000 7fa879d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09f410 0x7fa87c136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33754/0 (socket says 172.21.15.59:33754) 2023-09-30T22:33:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.166+0000 7fa879d9b700 1 -- 172.21.15.59:0/941967700 learned_addr learned my addr 172.21.15.59:0/941967700 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.166+0000 7fa87a59c700 1 --1- 172.21.15.59:0/941967700 >> v1:172.21.15.59:6789/0 conn(0x7fa87c09e930 0x7fa87c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52138/0 (socket says 172.21.15.59:52138) 2023-09-30T22:33:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.167+0000 7fa87ad9d700 1 --2- 172.21.15.59:0/941967700 >> v2:172.21.15.59:3300/0 conn(0x7fa87c136fe0 0x7fa87c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.167+0000 7fa879d9b700 1 -- 172.21.15.59:0/941967700 >> v2:172.21.15.59:3300/0 conn(0x7fa87c136fe0 msgr2=0x7fa87c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.167+0000 7fa879d9b700 1 --2- 172.21.15.59:0/941967700 >> v2:172.21.15.59:3300/0 conn(0x7fa87c136fe0 0x7fa87c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.167+0000 7fa879d9b700 1 -- 172.21.15.59:0/941967700 >> v1:172.21.15.59:6789/0 conn(0x7fa87c09e930 legacy=0x7fa87c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.167+0000 7fa879d9b700 1 -- 172.21.15.59:0/941967700 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c09fb60 con 0x7fa87c09f410 2023-09-30T22:33:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.167+0000 7fa879d9b700 1 --2- 172.21.15.59:0/941967700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09f410 0x7fa87c136aa0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa8700098f0 tx=0x7fa870009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f71b14434936359e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:00.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.167+0000 7fa87959a700 1 -- 172.21.15.59:0/941967700 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870011830 con 0x7fa87c09f410 2023-09-30T22:33:00.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.167+0000 7fa87959a700 1 -- 172.21.15.59:0/941967700 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa870011990 con 0x7fa87c09f410 2023-09-30T22:33:00.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.167+0000 7fa87959a700 1 -- 172.21.15.59:0/941967700 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870011d20 con 0x7fa87c09f410 2023-09-30T22:33:00.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.168+0000 7fa880935700 1 -- 172.21.15.59:0/941967700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09f410 msgr2=0x7fa87c136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.168+0000 7fa880935700 1 --2- 172.21.15.59:0/941967700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09f410 0x7fa87c136aa0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa8700098f0 tx=0x7fa870009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:00.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.168+0000 7fa880935700 1 -- 172.21.15.59:0/941967700 shutdown_connections 2023-09-30T22:33:00.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.168+0000 7fa880935700 1 --2- 172.21.15.59:0/941967700 >> v2:172.21.15.59:3300/0 conn(0x7fa87c136fe0 0x7fa87c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.168+0000 7fa880935700 1 --2- 172.21.15.59:0/941967700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09f410 0x7fa87c136aa0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.168+0000 7fa880935700 1 -- 172.21.15.59:0/941967700 >> 172.21.15.59:0/941967700 conn(0x7fa87c0a4210 msgr2=0x7fa87c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:00.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.168+0000 7fa880935700 1 -- 172.21.15.59:0/941967700 shutdown_connections 2023-09-30T22:33:00.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.168+0000 7fa880935700 1 -- 172.21.15.59:0/941967700 wait complete. 2023-09-30T22:33:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.170+0000 7fa880935700 1 Processor -- start 2023-09-30T22:33:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.170+0000 7fa880935700 1 -- start start 2023-09-30T22:33:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.171+0000 7fa880935700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c09e930 0x7fa87c1c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.171+0000 7fa880935700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09f410 0x7fa87c1c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.171+0000 7fa880935700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c136fe0 0x7fa87c1c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.171+0000 7fa880935700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c1221e0 con 0x7fa87c136fe0 2023-09-30T22:33:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.171+0000 7fa880935700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c071d20 con 0x7fa87c09f410 2023-09-30T22:33:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.171+0000 7fa880935700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c1204d0 con 0x7fa87c09e930 2023-09-30T22:33:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.171+0000 7fa879d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09f410 0x7fa87c1c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.171+0000 7fa87ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c136fe0 0x7fa87c1c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.171+0000 7fa879d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09f410 0x7fa87c1c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33762/0 (socket says 172.21.15.59:33762) 2023-09-30T22:33:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.171+0000 7fa879d9b700 1 -- 172.21.15.59:0/357721701 learned_addr learned my addr 172.21.15.59:0/357721701 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.171+0000 7fa87ad9d700 1 --2- 172.21.15.59:0/357721701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c136fe0 0x7fa87c1c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42018/0 (socket says 172.21.15.59:42018) 2023-09-30T22:33:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.171+0000 7fa87ad9d700 1 -- 172.21.15.59:0/357721701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c09e930 msgr2=0x7fa87c1c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.171+0000 7fa87ad9d700 1 --2- 172.21.15.59:0/357721701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c09e930 0x7fa87c1c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.171+0000 7fa87ad9d700 1 -- 172.21.15.59:0/357721701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09f410 msgr2=0x7fa87c1c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.171+0000 7fa87ad9d700 1 --2- 172.21.15.59:0/357721701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09f410 0x7fa87c1c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.172+0000 7fa87ad9d700 1 -- 172.21.15.59:0/357721701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870009550 con 0x7fa87c136fe0 2023-09-30T22:33:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.172+0000 7fa879d9b700 1 --2- 172.21.15.59:0/357721701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09f410 0x7fa87c1c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.172+0000 7fa87ad9d700 1 --2- 172.21.15.59:0/357721701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c136fe0 0x7fa87c1c6cc0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa87400ef90 tx=0x7fa87400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.172+0000 7fa86affd700 1 -- 172.21.15.59:0/357721701 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87400cd40 con 0x7fa87c136fe0 2023-09-30T22:33:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.172+0000 7fa86affd700 1 -- 172.21.15.59:0/357721701 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87400f040 con 0x7fa87c136fe0 2023-09-30T22:33:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.172+0000 7fa86affd700 1 -- 172.21.15.59:0/357721701 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740146c0 con 0x7fa87c136fe0 2023-09-30T22:33:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.172+0000 7fa880935700 1 -- 172.21.15.59:0/357721701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87c0a2f40 con 0x7fa87c136fe0 2023-09-30T22:33:00.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.172+0000 7fa880935700 1 -- 172.21.15.59:0/357721701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c121140 con 0x7fa87c136fe0 2023-09-30T22:33:00.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.173+0000 7fa86affd700 1 -- 172.21.15.59:0/357721701 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa874014820 con 0x7fa87c136fe0 2023-09-30T22:33:00.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.174+0000 7fa86affd700 1 -- 172.21.15.59:0/357721701 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa874040240 con 0x7fa87c136fe0 2023-09-30T22:33:00.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.174+0000 7fa880935700 1 -- 172.21.15.59:0/357721701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87c074ea0 con 0x7fa87c136fe0 2023-09-30T22:33:00.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.179+0000 7fa86affd700 1 -- 172.21.15.59:0/357721701 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa874018030 con 0x7fa87c136fe0 2023-09-30T22:33:00.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.219+0000 7f8f13947700 1 Processor -- start 2023-09-30T22:33:00.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.219+0000 7f8f13947700 1 -- start start 2023-09-30T22:33:00.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.220+0000 7f8f13947700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0c06e570 0x7f8f0c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.220+0000 7f8f13947700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f0c09eca0 0x7f8f0c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.220+0000 7f8f13947700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f0c070ee0 con 0x7f8f0c134610 2023-09-30T22:33:00.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.220+0000 7f8f13947700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c071480 con 0x7f8f0c06e570 2023-09-30T22:33:00.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.220+0000 7f8f13947700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c06f3c0 con 0x7f8f0c09eca0 2023-09-30T22:33:00.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.220+0000 7f8f116e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0c06e570 0x7f8f0c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.220+0000 7f8f116e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0c06e570 0x7f8f0c06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33764/0 (socket says 172.21.15.59:33764) 2023-09-30T22:33:00.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.220+0000 7f8f10ee2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f0c09eca0 0x7f8f0c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.220+0000 7f8f116e3700 1 -- 172.21.15.59:0/3936928784 learned_addr learned my addr 172.21.15.59:0/3936928784 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:00.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.221+0000 7f8f116e3700 1 -- 172.21.15.59:0/3936928784 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f0c09eca0 msgr2=0x7f8f0c06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:00.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.221+0000 7f8f116e3700 1 --2- 172.21.15.59:0/3936928784 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f0c09eca0 0x7f8f0c06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.221+0000 7f8f116e3700 1 -- 172.21.15.59:0/3936928784 >> v1:172.21.15.59:6789/0 conn(0x7f8f0c134610 legacy=0x7f8f0c134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.221+0000 7f8f116e3700 1 -- 172.21.15.59:0/3936928784 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c071b90 con 0x7f8f0c06e570 2023-09-30T22:33:00.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.221+0000 7f8f116e3700 1 --2- 172.21.15.59:0/3936928784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0c06e570 0x7f8f0c06e940 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009920 tx=0x7f8f08009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dffbbb4e8fa10814 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:00.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.221+0000 7f8f03fff700 1 -- 172.21.15.59:0/3936928784 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08011830 con 0x7f8f0c06e570 2023-09-30T22:33:00.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.221+0000 7f8f03fff700 1 -- 172.21.15.59:0/3936928784 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f08011990 con 0x7f8f0c06e570 2023-09-30T22:33:00.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.221+0000 7f8f03fff700 1 -- 172.21.15.59:0/3936928784 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08011d20 con 0x7f8f0c06e570 2023-09-30T22:33:00.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.222+0000 7f8f13947700 1 -- 172.21.15.59:0/3936928784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0c06e570 msgr2=0x7f8f0c06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.222+0000 7f8f13947700 1 --2- 172.21.15.59:0/3936928784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0c06e570 0x7f8f0c06e940 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009920 tx=0x7f8f08009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:00.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.222+0000 7f8f13947700 1 -- 172.21.15.59:0/3936928784 shutdown_connections 2023-09-30T22:33:00.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.222+0000 7f8f13947700 1 --2- 172.21.15.59:0/3936928784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0c06e570 0x7f8f0c06e940 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.222+0000 7f8f13947700 1 --2- 172.21.15.59:0/3936928784 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f0c09eca0 0x7f8f0c06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.222+0000 7f8f13947700 1 -- 172.21.15.59:0/3936928784 >> 172.21.15.59:0/3936928784 conn(0x7f8f0c0a2aa0 msgr2=0x7f8f0c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:00.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.222+0000 7f8f13947700 1 -- 172.21.15.59:0/3936928784 shutdown_connections 2023-09-30T22:33:00.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.222+0000 7f8f13947700 1 -- 172.21.15.59:0/3936928784 wait complete. 2023-09-30T22:33:00.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.224+0000 7f8f13947700 1 Processor -- start 2023-09-30T22:33:00.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.224+0000 7f8f13947700 1 -- start start 2023-09-30T22:33:00.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.224+0000 7f8f13947700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0c06e570 0x7f8f0c123340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f13947700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f0c134610 0x7f8f0c123880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f13947700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f0c123dc0 0x7f8f0c1cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f13947700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c124f50 con 0x7f8f0c123dc0 2023-09-30T22:33:00.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f13947700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c133ed0 con 0x7f8f0c06e570 2023-09-30T22:33:00.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f13947700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c1268c0 con 0x7f8f0c134610 2023-09-30T22:33:00.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f10ee2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f0c134610 0x7f8f0c123880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f10ee2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f0c134610 0x7f8f0c123880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53352/0 (socket says 172.21.15.59:53352) 2023-09-30T22:33:00.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f10ee2700 1 -- 172.21.15.59:0/2632721563 learned_addr learned my addr 172.21.15.59:0/2632721563 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:00.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f116e3700 1 --2- 172.21.15.59:0/2632721563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0c06e570 0x7f8f0c123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f11ee4700 1 --2- 172.21.15.59:0/2632721563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f0c123dc0 0x7f8f0c1cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f10ee2700 1 -- 172.21.15.59:0/2632721563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0c06e570 msgr2=0x7f8f0c123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f10ee2700 1 --2- 172.21.15.59:0/2632721563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0c06e570 0x7f8f0c123340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f10ee2700 1 -- 172.21.15.59:0/2632721563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f0c123dc0 msgr2=0x7f8f0c1cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f10ee2700 1 --2- 172.21.15.59:0/2632721563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f0c123dc0 0x7f8f0c1cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f10ee2700 1 -- 172.21.15.59:0/2632721563 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f08009550 con 0x7f8f0c134610 2023-09-30T22:33:00.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f116e3700 1 --2- 172.21.15.59:0/2632721563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0c06e570 0x7f8f0c123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:00.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.225+0000 7f8f11ee4700 1 --2- 172.21.15.59:0/2632721563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f0c123dc0 0x7f8f0c1cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:00.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.226+0000 7f8f10ee2700 1 --2- 172.21.15.59:0/2632721563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f0c134610 0x7f8f0c123880 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00e9e0 tx=0x7f8efc00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:00.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.226+0000 7f8f01ffb700 1 -- 172.21.15.59:0/2632721563 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc0096b0 con 0x7f8f0c134610 2023-09-30T22:33:00.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.226+0000 7f8f01ffb700 1 -- 172.21.15.59:0/2632721563 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8efc00ee80 con 0x7f8f0c134610 2023-09-30T22:33:00.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.226+0000 7f8f13947700 1 -- 172.21.15.59:0/2632721563 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c0a2000 con 0x7f8f0c134610 2023-09-30T22:33:00.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.226+0000 7f8f01ffb700 1 -- 172.21.15.59:0/2632721563 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc00c9f0 con 0x7f8f0c134610 2023-09-30T22:33:00.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.226+0000 7f8f13947700 1 -- 172.21.15.59:0/2632721563 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0c126b80 con 0x7f8f0c134610 2023-09-30T22:33:00.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.227+0000 7f8f13947700 1 -- 172.21.15.59:0/2632721563 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0c074ea0 con 0x7f8f0c134610 2023-09-30T22:33:00.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.227+0000 7f8f01ffb700 1 -- 172.21.15.59:0/2632721563 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8efc00cb50 con 0x7f8f0c134610 2023-09-30T22:33:00.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.227+0000 7f8f01ffb700 1 -- 172.21.15.59:0/2632721563 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8efc03f670 con 0x7f8f0c134610 2023-09-30T22:33:00.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.237+0000 7f8f01ffb700 1 -- 172.21.15.59:0/2632721563 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8efc013470 con 0x7f8f0c134610 2023-09-30T22:33:00.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.270+0000 7f9704b8a700 1 Processor -- start 2023-09-30T22:33:00.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.270+0000 7f9704b8a700 1 -- start start 2023-09-30T22:33:00.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.271+0000 7f9704b8a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9700134630 0x7f9700136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.271+0000 7f9704b8a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9700136f50 0x7f9700139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.271+0000 7f9704b8a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970009b4f0 con 0x7f9700131810 2023-09-30T22:33:00.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.271+0000 7f9704b8a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97001313c0 con 0x7f9700134630 2023-09-30T22:33:00.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.271+0000 7f9704b8a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970006e8c0 con 0x7f9700136f50 2023-09-30T22:33:00.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.271+0000 7f96fe59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9700131810 0x7f9700131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52162/0 (socket says 172.21.15.59:52162) 2023-09-30T22:33:00.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.271+0000 7f96fdd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9700134630 0x7f9700136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.271+0000 7f96fe59c700 1 -- 172.21.15.59:0/3782709860 learned_addr learned my addr 172.21.15.59:0/3782709860 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.272+0000 7f96fed9d700 1 --2- 172.21.15.59:0/3782709860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9700136f50 0x7f9700139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.272+0000 7f96fdd9b700 1 -- 172.21.15.59:0/3782709860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9700136f50 msgr2=0x7f9700139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.272+0000 7f96fdd9b700 1 --2- 172.21.15.59:0/3782709860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9700136f50 0x7f9700139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.272+0000 7f96fdd9b700 1 -- 172.21.15.59:0/3782709860 >> v1:172.21.15.59:6789/0 conn(0x7f9700131810 legacy=0x7f9700131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.272+0000 7f96fdd9b700 1 -- 172.21.15.59:0/3782709860 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9700071d20 con 0x7f9700134630 2023-09-30T22:33:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.272+0000 7f96fdd9b700 1 --2- 172.21.15.59:0/3782709860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9700134630 0x7f9700136a10 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009840 tx=0x7f96f4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf26d3e0bfe131b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.272+0000 7f96fd59a700 1 -- 172.21.15.59:0/3782709860 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f4011830 con 0x7f9700134630 2023-09-30T22:33:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.272+0000 7f96fd59a700 1 -- 172.21.15.59:0/3782709860 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f4011990 con 0x7f9700134630 2023-09-30T22:33:00.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.272+0000 7f96fd59a700 1 -- 172.21.15.59:0/3782709860 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f4011d20 con 0x7f9700134630 2023-09-30T22:33:00.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.273+0000 7f9704b8a700 1 -- 172.21.15.59:0/3782709860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9700134630 msgr2=0x7f9700136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.273+0000 7f9704b8a700 1 --2- 172.21.15.59:0/3782709860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9700134630 0x7f9700136a10 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009840 tx=0x7f96f4009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:00.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.274+0000 7f9704b8a700 1 -- 172.21.15.59:0/3782709860 shutdown_connections 2023-09-30T22:33:00.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.274+0000 7f9704b8a700 1 --2- 172.21.15.59:0/3782709860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9700136f50 0x7f9700139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.274+0000 7f9704b8a700 1 --2- 172.21.15.59:0/3782709860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9700134630 0x7f9700136a10 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.274+0000 7f9704b8a700 1 -- 172.21.15.59:0/3782709860 >> 172.21.15.59:0/3782709860 conn(0x7f97000a2aa0 msgr2=0x7f97000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:00.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.274+0000 7f9704b8a700 1 -- 172.21.15.59:0/3782709860 shutdown_connections 2023-09-30T22:33:00.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.274+0000 7f9704b8a700 1 -- 172.21.15.59:0/3782709860 wait complete. 2023-09-30T22:33:00.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.275+0000 7f9704b8a700 1 Processor -- start 2023-09-30T22:33:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.275+0000 7f9704b8a700 1 -- start start 2023-09-30T22:33:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.276+0000 7f9704b8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9700131810 0x7f97001c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.276+0000 7f9704b8a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9700134630 0x7f97001c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.276+0000 7f9704b8a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9700136f50 0x7f97001c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.276+0000 7f9704b8a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970011e850 con 0x7f9700131810 2023-09-30T22:33:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.276+0000 7f9704b8a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970012ebf0 con 0x7f9700134630 2023-09-30T22:33:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.276+0000 7f9704b8a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f970011e310 con 0x7f9700136f50 2023-09-30T22:33:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.276+0000 7f96fe59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9700131810 0x7f97001c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.276+0000 7f96fe59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9700131810 0x7f97001c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42036/0 (socket says 172.21.15.59:42036) 2023-09-30T22:33:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.276+0000 7f96fe59c700 1 -- 172.21.15.59:0/3153290184 learned_addr learned my addr 172.21.15.59:0/3153290184 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.276+0000 7f96fdd9b700 1 --2- 172.21.15.59:0/3153290184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9700134630 0x7f97001c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.277+0000 7f96fed9d700 1 --2- 172.21.15.59:0/3153290184 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9700136f50 0x7f97001c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.277+0000 7f96fe59c700 1 -- 172.21.15.59:0/3153290184 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9700136f50 msgr2=0x7f97001c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.277+0000 7f96fe59c700 1 --2- 172.21.15.59:0/3153290184 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9700136f50 0x7f97001c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.277+0000 7f96fe59c700 1 -- 172.21.15.59:0/3153290184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9700134630 msgr2=0x7f97001c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.277+0000 7f96fe59c700 1 --2- 172.21.15.59:0/3153290184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9700134630 0x7f97001c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.277+0000 7f96fe59c700 1 -- 172.21.15.59:0/3153290184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f40094a0 con 0x7f9700131810 2023-09-30T22:33:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.277+0000 7f96fe59c700 1 --2- 172.21.15.59:0/3153290184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9700131810 0x7f97001c8370 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f96f000c480 tx=0x7f96f000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.277+0000 7f96eeffd700 1 -- 172.21.15.59:0/3153290184 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0005d70 con 0x7f9700131810 2023-09-30T22:33:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.277+0000 7f96eeffd700 1 -- 172.21.15.59:0/3153290184 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f00070d0 con 0x7f9700131810 2023-09-30T22:33:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.277+0000 7f9704b8a700 1 -- 172.21.15.59:0/3153290184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9700071180 con 0x7f9700131810 2023-09-30T22:33:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.277+0000 7f96eeffd700 1 -- 172.21.15.59:0/3153290184 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0007440 con 0x7f9700131810 2023-09-30T22:33:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.277+0000 7f9704b8a700 1 -- 172.21.15.59:0/3153290184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970006eb00 con 0x7f9700131810 2023-09-30T22:33:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.278+0000 7f96eeffd700 1 -- 172.21.15.59:0/3153290184 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f96f00075a0 con 0x7f9700131810 2023-09-30T22:33:00.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.278+0000 7f9704b8a700 1 -- 172.21.15.59:0/3153290184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970009a7a0 con 0x7f9700131810 2023-09-30T22:33:00.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.279+0000 7f96eeffd700 1 -- 172.21.15.59:0/3153290184 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f96f003eb20 con 0x7f9700131810 2023-09-30T22:33:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.284+0000 7f96eeffd700 1 -- 172.21.15.59:0/3153290184 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96f0019d20 con 0x7f9700131810 2023-09-30T22:33:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.290+0000 7f2fa3ad3700 1 Processor -- start 2023-09-30T22:33:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.290+0000 7f2fa3ad3700 1 -- start start 2023-09-30T22:33:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.291+0000 7f2fa3ad3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9c133a80 0x7f2f9c133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.291+0000 7f2fa3ad3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f9c130a40 0x7f2f9c13b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.291+0000 7f2fa3ad3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9c06bc00 con 0x7f2f9c12ff20 2023-09-30T22:33:00.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.291+0000 7f2fa3ad3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9c06c570 con 0x7f2f9c130a40 2023-09-30T22:33:00.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.291+0000 7f2fa3ad3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c0a0040 con 0x7f2f9c133a80 2023-09-30T22:33:00.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.291+0000 7f2fa2070700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f9c130a40 0x7f2f9c13b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.291+0000 7f2fa106e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2f9c12ff20 0x7f2f9c130330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52170/0 (socket says 172.21.15.59:52170) 2023-09-30T22:33:00.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.291+0000 7f2fa106e700 1 -- 172.21.15.59:0/369854408 learned_addr learned my addr 172.21.15.59:0/369854408 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:00.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.291+0000 7f2fa186f700 1 --2- 172.21.15.59:0/369854408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9c133a80 0x7f2f9c133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.291+0000 7f2fa086d700 1 -- 172.21.15.59:0/369854408 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192351293 0 0) 0x7f2f9c06bc00 con 0x7f2f9c12ff20 2023-09-30T22:33:00.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.291+0000 7f2fa086d700 1 -- 172.21.15.59:0/369854408 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f880035b0 con 0x7f2f9c12ff20 2023-09-30T22:33:00.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.291+0000 7f2fa2070700 1 -- 172.21.15.59:0/369854408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9c133a80 msgr2=0x7f2f9c133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:00.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.291+0000 7f2fa2070700 1 --2- 172.21.15.59:0/369854408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9c133a80 0x7f2f9c133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.291+0000 7f2fa2070700 1 -- 172.21.15.59:0/369854408 >> v1:172.21.15.59:6789/0 conn(0x7f2f9c12ff20 legacy=0x7f2f9c130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.292+0000 7f2fa2070700 1 -- 172.21.15.59:0/369854408 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c133860 con 0x7f2f9c130a40 2023-09-30T22:33:00.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.292+0000 7f2fa186f700 1 --2- 172.21.15.59:0/369854408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9c133a80 0x7f2f9c133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:00.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.292+0000 7f2fa2070700 1 --2- 172.21.15.59:0/369854408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9c130a40 0x7f2f9c13b850 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009d90 tx=0x7f2f9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5084b6872fc53136 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:00.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.292+0000 7f2fa086d700 1 -- 172.21.15.59:0/369854408 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9400e070 con 0x7f2f9c130a40 2023-09-30T22:33:00.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.292+0000 7f2fa086d700 1 -- 172.21.15.59:0/369854408 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9400bb20 con 0x7f2f9c130a40 2023-09-30T22:33:00.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.292+0000 7f2fa086d700 1 -- 172.21.15.59:0/369854408 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94012430 con 0x7f2f9c130a40 2023-09-30T22:33:00.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.293+0000 7f2fa3ad3700 1 -- 172.21.15.59:0/369854408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9c130a40 msgr2=0x7f2f9c13b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.293+0000 7f2fa3ad3700 1 --2- 172.21.15.59:0/369854408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9c130a40 0x7f2f9c13b850 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009d90 tx=0x7f2f9400b330 comp rx=0 tx=0).stop 2023-09-30T22:33:00.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.293+0000 7f2fa3ad3700 1 -- 172.21.15.59:0/369854408 shutdown_connections 2023-09-30T22:33:00.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.293+0000 7f2fa3ad3700 1 --2- 172.21.15.59:0/369854408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9c130a40 0x7f2f9c13b850 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.293+0000 7f2fa3ad3700 1 --2- 172.21.15.59:0/369854408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9c133a80 0x7f2f9c133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.293+0000 7f2fa3ad3700 1 -- 172.21.15.59:0/369854408 >> 172.21.15.59:0/369854408 conn(0x7f2f9c0a4210 msgr2=0x7f2f9c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:00.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.293+0000 7f2fa3ad3700 1 -- 172.21.15.59:0/369854408 shutdown_connections 2023-09-30T22:33:00.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.293+0000 7f2fa3ad3700 1 -- 172.21.15.59:0/369854408 wait complete. 2023-09-30T22:33:00.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.294+0000 7f2fa3ad3700 1 Processor -- start 2023-09-30T22:33:00.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.294+0000 7f2fa3ad3700 1 -- start start 2023-09-30T22:33:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.295+0000 7f2fa3ad3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9c12ff20 0x7f2f9c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.295+0000 7f2fa3ad3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9c130a40 0x7f2f9c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.295+0000 7f2fa3ad3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9c133a80 0x7f2f9c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.295+0000 7f2fa3ad3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c11fab0 con 0x7f2f9c130a40 2023-09-30T22:33:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.295+0000 7f2fa3ad3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c11f3b0 con 0x7f2f9c133a80 2023-09-30T22:33:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.295+0000 7f2fa3ad3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c11ed40 con 0x7f2f9c12ff20 2023-09-30T22:33:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.295+0000 7f2fa2070700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9c133a80 0x7f2f9c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.295+0000 7f2fa2070700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9c133a80 0x7f2f9c09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33802/0 (socket says 172.21.15.59:33802) 2023-09-30T22:33:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.295+0000 7f2fa2070700 1 -- 172.21.15.59:0/787026895 learned_addr learned my addr 172.21.15.59:0/787026895 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.295+0000 7f2fa106e700 1 --2- 172.21.15.59:0/787026895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9c130a40 0x7f2f9c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.295+0000 7f2fa186f700 1 --2- 172.21.15.59:0/787026895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9c12ff20 0x7f2f9c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.296+0000 7f2fa2070700 1 -- 172.21.15.59:0/787026895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9c12ff20 msgr2=0x7f2f9c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.296+0000 7f2fa2070700 1 --2- 172.21.15.59:0/787026895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9c12ff20 0x7f2f9c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.296+0000 7f2fa2070700 1 -- 172.21.15.59:0/787026895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9c130a40 msgr2=0x7f2f9c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.296+0000 7f2fa2070700 1 --2- 172.21.15.59:0/787026895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9c130a40 0x7f2f9c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.296+0000 7f2fa2070700 1 -- 172.21.15.59:0/787026895 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f94009a70 con 0x7f2f9c133a80 2023-09-30T22:33:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.296+0000 7f2fa186f700 1 --2- 172.21.15.59:0/787026895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9c12ff20 0x7f2f9c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.296+0000 7f2fa106e700 1 --2- 172.21.15.59:0/787026895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9c130a40 0x7f2f9c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.296+0000 7f2fa2070700 1 --2- 172.21.15.59:0/787026895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9c133a80 0x7f2f9c09cf00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2f94014040 tx=0x7f2f94004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.296+0000 7f2f927fc700 1 -- 172.21.15.59:0/787026895 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94012430 con 0x7f2f9c133a80 2023-09-30T22:33:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.296+0000 7f2f927fc700 1 -- 172.21.15.59:0/787026895 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f94020070 con 0x7f2f9c133a80 2023-09-30T22:33:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.296+0000 7f2f927fc700 1 -- 172.21.15.59:0/787026895 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94003ea0 con 0x7f2f9c133a80 2023-09-30T22:33:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.297+0000 7f2fa3ad3700 1 -- 172.21.15.59:0/787026895 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9c11ea90 con 0x7f2f9c133a80 2023-09-30T22:33:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.297+0000 7f2fa3ad3700 1 -- 172.21.15.59:0/787026895 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9c09dee0 con 0x7f2f9c133a80 2023-09-30T22:33:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.298+0000 7f2f927fc700 1 -- 172.21.15.59:0/787026895 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f94004040 con 0x7f2f9c133a80 2023-09-30T22:33:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.298+0000 7f2f927fc700 1 -- 172.21.15.59:0/787026895 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2f94022070 con 0x7f2f9c133a80 2023-09-30T22:33:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.298+0000 7f2fa3ad3700 1 -- 172.21.15.59:0/787026895 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9c074ea0 con 0x7f2f9c133a80 2023-09-30T22:33:00.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.303+0000 7f2f927fc700 1 -- 172.21.15.59:0/787026895 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f9401a970 con 0x7f2f9c133a80 2023-09-30T22:33:00.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.401+0000 7fa880935700 1 -- 172.21.15.59:0/357721701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa87c09e100 con 0x7fa87c136fe0 2023-09-30T22:33:00.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.401+0000 7fa86affd700 1 -- 172.21.15.59:0/357721701 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa87402b090 con 0x7fa87c136fe0 2023-09-30T22:33:00.403 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:00.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.404+0000 7fa880935700 1 -- 172.21.15.59:0/357721701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c136fe0 msgr2=0x7fa87c1c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.404+0000 7fa880935700 1 --2- 172.21.15.59:0/357721701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c136fe0 0x7fa87c1c6cc0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa87400ef90 tx=0x7fa87400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.404+0000 7fa880935700 1 -- 172.21.15.59:0/357721701 shutdown_connections 2023-09-30T22:33:00.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.404+0000 7fa880935700 1 --2- 172.21.15.59:0/357721701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c09e930 0x7fa87c1c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.404+0000 7fa880935700 1 --2- 172.21.15.59:0/357721701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c136fe0 0x7fa87c1c6cc0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.404+0000 7fa880935700 1 --2- 172.21.15.59:0/357721701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09f410 0x7fa87c1c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.404+0000 7fa880935700 1 -- 172.21.15.59:0/357721701 >> 172.21.15.59:0/357721701 conn(0x7fa87c0a4210 msgr2=0x7fa87c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:00.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.404+0000 7fa880935700 1 -- 172.21.15.59:0/357721701 shutdown_connections 2023-09-30T22:33:00.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.404+0000 7fa880935700 1 -- 172.21.15.59:0/357721701 wait complete. 2023-09-30T22:33:00.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:00.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.450+0000 7f8f13947700 1 -- 172.21.15.59:0/2632721563 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f0c071100 con 0x7f8f0c134610 2023-09-30T22:33:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.451+0000 7f8f01ffb700 1 -- 172.21.15.59:0/2632721563 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8efc021020 con 0x7f8f0c134610 2023-09-30T22:33:00.452 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:00.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.453+0000 7f8f13947700 1 -- 172.21.15.59:0/2632721563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f0c134610 msgr2=0x7f8f0c123880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.453+0000 7f8f13947700 1 --2- 172.21.15.59:0/2632721563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f0c134610 0x7f8f0c123880 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00e9e0 tx=0x7f8efc00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.454+0000 7f8f13947700 1 -- 172.21.15.59:0/2632721563 shutdown_connections 2023-09-30T22:33:00.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.454+0000 7f8f13947700 1 --2- 172.21.15.59:0/2632721563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f0c123dc0 0x7f8f0c1cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.454+0000 7f8f13947700 1 --2- 172.21.15.59:0/2632721563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0c06e570 0x7f8f0c123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.454+0000 7f8f13947700 1 --2- 172.21.15.59:0/2632721563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f0c134610 0x7f8f0c123880 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.454+0000 7f8f13947700 1 -- 172.21.15.59:0/2632721563 >> 172.21.15.59:0/2632721563 conn(0x7f8f0c0a2aa0 msgr2=0x7f8f0c0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:00.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.454+0000 7f8f13947700 1 -- 172.21.15.59:0/2632721563 shutdown_connections 2023-09-30T22:33:00.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.454+0000 7f8f13947700 1 -- 172.21.15.59:0/2632721563 wait complete. 2023-09-30T22:33:00.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:00.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.513+0000 7f9704b8a700 1 -- 172.21.15.59:0/3153290184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9700074ea0 con 0x7f9700131810 2023-09-30T22:33:00.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.513+0000 7f96eeffd700 1 -- 172.21.15.59:0/3153290184 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f96f00192c0 con 0x7f9700131810 2023-09-30T22:33:00.514 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:00.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.515+0000 7f9704b8a700 1 -- 172.21.15.59:0/3153290184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9700131810 msgr2=0x7f97001c8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.515+0000 7f9704b8a700 1 --2- 172.21.15.59:0/3153290184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9700131810 0x7f97001c8370 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f96f000c480 tx=0x7f96f000c790 comp rx=0 tx=0).stop 2023-09-30T22:33:00.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.515+0000 7f9704b8a700 1 -- 172.21.15.59:0/3153290184 shutdown_connections 2023-09-30T22:33:00.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.515+0000 7f9704b8a700 1 --2- 172.21.15.59:0/3153290184 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9700136f50 0x7f97001c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.515+0000 7f9704b8a700 1 --2- 172.21.15.59:0/3153290184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9700131810 0x7f97001c8370 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.515+0000 7f9704b8a700 1 --2- 172.21.15.59:0/3153290184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9700134630 0x7f97001c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.515+0000 7f9704b8a700 1 -- 172.21.15.59:0/3153290184 >> 172.21.15.59:0/3153290184 conn(0x7f97000a2aa0 msgr2=0x7f9700099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:00.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.516+0000 7f9704b8a700 1 -- 172.21.15.59:0/3153290184 shutdown_connections 2023-09-30T22:33:00.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.516+0000 7f9704b8a700 1 -- 172.21.15.59:0/3153290184 wait complete. 2023-09-30T22:33:00.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.528+0000 7f2fa3ad3700 1 -- 172.21.15.59:0/787026895 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2f9c06b250 con 0x7f2f9c133a80 2023-09-30T22:33:00.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.529+0000 7f2f927fc700 1 -- 172.21.15.59:0/787026895 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f9401a380 con 0x7f2f9c133a80 2023-09-30T22:33:00.530 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:00.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:00.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.531+0000 7f2fa3ad3700 1 -- 172.21.15.59:0/787026895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9c133a80 msgr2=0x7f2f9c09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:00.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.531+0000 7f2fa3ad3700 1 --2- 172.21.15.59:0/787026895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9c133a80 0x7f2f9c09cf00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2f94014040 tx=0x7f2f94004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.531+0000 7f2fa3ad3700 1 -- 172.21.15.59:0/787026895 shutdown_connections 2023-09-30T22:33:00.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.531+0000 7f2fa3ad3700 1 --2- 172.21.15.59:0/787026895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9c12ff20 0x7f2f9c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.531+0000 7f2fa3ad3700 1 --2- 172.21.15.59:0/787026895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9c133a80 0x7f2f9c09cf00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.531+0000 7f2fa3ad3700 1 --2- 172.21.15.59:0/787026895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9c130a40 0x7f2f9c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:00.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.531+0000 7f2fa3ad3700 1 -- 172.21.15.59:0/787026895 >> 172.21.15.59:0/787026895 conn(0x7f2f9c0a4210 msgr2=0x7f2f9c09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:00.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.531+0000 7f2fa3ad3700 1 -- 172.21.15.59:0/787026895 shutdown_connections 2023-09-30T22:33:00.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:00.531+0000 7f2fa3ad3700 1 -- 172.21.15.59:0/787026895 wait complete. 2023-09-30T22:33:00.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:01.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:01.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:01.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:01.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:01.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.716+0000 7f5d0f4de700 1 Processor -- start 2023-09-30T22:33:01.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.717+0000 7f5d0f4de700 1 -- start start 2023-09-30T22:33:01.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.717+0000 7f78cba57700 1 Processor -- start 2023-09-30T22:33:01.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.717+0000 7f5d0f4de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0809d6f0 0x7f5d0809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.717+0000 7f5d0f4de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0809e000 0x7f5d081339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.717+0000 7f5d0f4de700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d0809e410 0x7f5d08133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.717+0000 7f5d0f4de700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0806b460 con 0x7f5d0809e410 2023-09-30T22:33:01.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.717+0000 7f5d0f4de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0809b120 con 0x7f5d0809e000 2023-09-30T22:33:01.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.717+0000 7f5d0f4de700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0809a7e0 con 0x7f5d0809d6f0 2023-09-30T22:33:01.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f5d0da7b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d0809e410 0x7f5d08133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f5d0da7b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d0809e410 0x7f5d08133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42068/0 (socket says 172.21.15.59:42068) 2023-09-30T22:33:01.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f5d0da7b700 1 -- 172.21.15.59:0/1493470154 learned_addr learned my addr 172.21.15.59:0/1493470154 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:01.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.717+0000 7f78cba57700 1 -- start start 2023-09-30T22:33:01.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f78cba57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c40a0a30 0x7f78c40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f78cba57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c40a1340 0x7f78c4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f78cba57700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f78c4133fa0 0x7f78c4134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f78cba57700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c409edd0 con 0x7f78c4133fa0 2023-09-30T22:33:01.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f78cba57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c409e1f0 con 0x7f78c40a1340 2023-09-30T22:33:01.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f78cba57700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78c409dc50 con 0x7f78c40a0a30 2023-09-30T22:33:01.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f78c8ff2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c40a1340 0x7f78c4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f5d0da7b700 1 -- 172.21.15.59:0/1493470154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0809d6f0 msgr2=0x7f5d0809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:01.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f5d0da7b700 1 --2- 172.21.15.59:0/1493470154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0809d6f0 0x7f5d0809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f5d0da7b700 1 -- 172.21.15.59:0/1493470154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0809e000 msgr2=0x7f5d081339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:01.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f5d0da7b700 1 --2- 172.21.15.59:0/1493470154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0809e000 0x7f5d081339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f5d0da7b700 1 -- 172.21.15.59:0/1493470154 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0809a500 con 0x7f5d0809e410 2023-09-30T22:33:01.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f78c8ff2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c40a1340 0x7f78c4133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33806/0 (socket says 172.21.15.59:33806) 2023-09-30T22:33:01.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f78c8ff2700 1 -- 172.21.15.59:0/997706525 learned_addr learned my addr 172.21.15.59:0/997706525 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:01.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f78c9ff4700 1 --2- 172.21.15.59:0/997706525 >> v2:172.21.15.59:3300/0 conn(0x7f78c4133fa0 0x7f78c4134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f78c97f3700 1 --2- 172.21.15.59:0/997706525 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c40a0a30 0x7f78c40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f78c9ff4700 1 -- 172.21.15.59:0/997706525 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c40a0a30 msgr2=0x7f78c40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:01.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f78c9ff4700 1 --2- 172.21.15.59:0/997706525 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c40a0a30 0x7f78c40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f78c9ff4700 1 -- 172.21.15.59:0/997706525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c40a1340 msgr2=0x7f78c4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:01.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f78c9ff4700 1 --2- 172.21.15.59:0/997706525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c40a1340 0x7f78c4133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.719+0000 7f78c9ff4700 1 -- 172.21.15.59:0/997706525 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c40a1fe0 con 0x7f78c4133fa0 2023-09-30T22:33:01.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.718+0000 7f5d0da7b700 1 --2- 172.21.15.59:0/1493470154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0809e410 0x7f5d08133f30 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009e50 tx=0x7f5d0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b47d7a2e652d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:01.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.719+0000 7f78c8ff2700 1 --2- 172.21.15.59:0/997706525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c40a1340 0x7f78c4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:01.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.719+0000 7f78c9ff4700 1 --2- 172.21.15.59:0/997706525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c4133fa0 0x7f78c4134410 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f78bc009d90 tx=0x7f78bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227018e9512a28d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:01.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.721+0000 7f5cfffff700 1 -- 172.21.15.59:0/1493470154 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0000e070 con 0x7f5d0809e410 2023-09-30T22:33:01.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.721+0000 7f78bbfff700 1 -- 172.21.15.59:0/997706525 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc00e070 con 0x7f78c4133fa0 2023-09-30T22:33:01.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.721+0000 7f5cfffff700 1 -- 172.21.15.59:0/1493470154 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0000b9c0 con 0x7f5d0809e410 2023-09-30T22:33:01.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.721+0000 7f78bbfff700 1 -- 172.21.15.59:0/997706525 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78bc00bb20 con 0x7f78c4133fa0 2023-09-30T22:33:01.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.721+0000 7f5cfffff700 1 -- 172.21.15.59:0/1493470154 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0000bd70 con 0x7f5d0809e410 2023-09-30T22:33:01.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.721+0000 7f78bbfff700 1 -- 172.21.15.59:0/997706525 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc012430 con 0x7f78c4133fa0 2023-09-30T22:33:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f5d0f4de700 1 -- 172.21.15.59:0/1493470154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0809e410 msgr2=0x7f5d08133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f5d0f4de700 1 --2- 172.21.15.59:0/1493470154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0809e410 0x7f5d08133f30 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009e50 tx=0x7f5d0000b330 comp rx=0 tx=0).stop 2023-09-30T22:33:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f5d0f4de700 1 -- 172.21.15.59:0/1493470154 shutdown_connections 2023-09-30T22:33:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f5d0f4de700 1 --2- 172.21.15.59:0/1493470154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0809e410 0x7f5d08133f30 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f5d0f4de700 1 --2- 172.21.15.59:0/1493470154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0809d6f0 0x7f5d0809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f5d0f4de700 1 --2- 172.21.15.59:0/1493470154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0809e000 0x7f5d081339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f5d0f4de700 1 -- 172.21.15.59:0/1493470154 >> 172.21.15.59:0/1493470154 conn(0x7f5d08066f50 msgr2=0x7f5d0809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f5d0f4de700 1 -- 172.21.15.59:0/1493470154 shutdown_connections 2023-09-30T22:33:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f5d0f4de700 1 -- 172.21.15.59:0/1493470154 wait complete. 2023-09-30T22:33:01.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f78cba57700 1 -- 172.21.15.59:0/997706525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c4133fa0 msgr2=0x7f78c4134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f78cba57700 1 --2- 172.21.15.59:0/997706525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c4133fa0 0x7f78c4134410 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f78bc009d90 tx=0x7f78bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:33:01.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f78cba57700 1 -- 172.21.15.59:0/997706525 shutdown_connections 2023-09-30T22:33:01.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f78cba57700 1 --2- 172.21.15.59:0/997706525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c4133fa0 0x7f78c4134410 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f78cba57700 1 --2- 172.21.15.59:0/997706525 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c40a0a30 0x7f78c40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f78cba57700 1 --2- 172.21.15.59:0/997706525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c40a1340 0x7f78c4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f78cba57700 1 -- 172.21.15.59:0/997706525 >> 172.21.15.59:0/997706525 conn(0x7f78c40a6550 msgr2=0x7f78c40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f78cba57700 1 -- 172.21.15.59:0/997706525 shutdown_connections 2023-09-30T22:33:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.722+0000 7f78cba57700 1 -- 172.21.15.59:0/997706525 wait complete. 2023-09-30T22:33:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.723+0000 7f5d0f4de700 1 Processor -- start 2023-09-30T22:33:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.723+0000 7f5d0f4de700 1 -- start start 2023-09-30T22:33:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f78cba57700 1 Processor -- start 2023-09-30T22:33:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f78cba57700 1 -- start start 2023-09-30T22:33:01.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f5d0f4de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0809d6f0 0x7f5d081c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f5d0f4de700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0809e000 0x7f5d081c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f5d0f4de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0809e410 0x7f5d081c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f5d0f4de700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d081a94f0 con 0x7f5d0809e000 2023-09-30T22:33:01.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f5d0f4de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d081a70d0 con 0x7f5d0809d6f0 2023-09-30T22:33:01.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f5d0f4de700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d081a86c0 con 0x7f5d0809e410 2023-09-30T22:33:01.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f5d0ca79700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0809e000 0x7f5d081c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f5d0ca79700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0809e000 0x7f5d081c5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42084/0 (socket says 172.21.15.59:42084) 2023-09-30T22:33:01.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f5d0ca79700 1 -- 172.21.15.59:0/2938195629 learned_addr learned my addr 172.21.15.59:0/2938195629 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:01.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f5d0d27a700 1 --2- 172.21.15.59:0/2938195629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0809d6f0 0x7f5d081c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f5d0ca79700 1 -- 172.21.15.59:0/2938195629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0809e410 msgr2=0x7f5d081c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f5d0ca79700 1 --2- 172.21.15.59:0/2938195629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0809e410 0x7f5d081c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f5d0ca79700 1 -- 172.21.15.59:0/2938195629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0809d6f0 msgr2=0x7f5d081c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f5d0ca79700 1 --2- 172.21.15.59:0/2938195629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0809d6f0 0x7f5d081c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f5d0ca79700 1 -- 172.21.15.59:0/2938195629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d00009b30 con 0x7f5d0809e000 2023-09-30T22:33:01.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f78cba57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c40a0a30 0x7f78c4120090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f78cba57700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c40a1340 0x7f78c41205d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f78cba57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c4133fa0 0x7f78c4120b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f78cba57700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c4123420 con 0x7f78c40a1340 2023-09-30T22:33:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f78cba57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c4121d40 con 0x7f78c40a0a30 2023-09-30T22:33:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f78cba57700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78c41238d0 con 0x7f78c4133fa0 2023-09-30T22:33:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.724+0000 7f78c8ff2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c40a1340 0x7f78c41205d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f78c8ff2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c40a1340 0x7f78c41205d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42096/0 (socket says 172.21.15.59:42096) 2023-09-30T22:33:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f78c8ff2700 1 -- 172.21.15.59:0/1075213642 learned_addr learned my addr 172.21.15.59:0/1075213642 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f78c97f3700 1 --2- 172.21.15.59:0/1075213642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c40a0a30 0x7f78c4120090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f78c8ff2700 1 -- 172.21.15.59:0/1075213642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c4133fa0 msgr2=0x7f78c4120b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f78c8ff2700 1 --2- 172.21.15.59:0/1075213642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c4133fa0 0x7f78c4120b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f78c8ff2700 1 -- 172.21.15.59:0/1075213642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c40a0a30 msgr2=0x7f78c4120090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f78c8ff2700 1 --2- 172.21.15.59:0/1075213642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c40a0a30 0x7f78c4120090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f78c8ff2700 1 -- 172.21.15.59:0/1075213642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b4009550 con 0x7f78c40a1340 2023-09-30T22:33:01.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f5d0ca79700 1 --2- 172.21.15.59:0/2938195629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0809e000 0x7f5d081c5630 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800b500 tx=0x7f5cf800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:01.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f78c8ff2700 1 --2- 172.21.15.59:0/1075213642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c40a1340 0x7f78c41205d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f78b400ebe0 tx=0x7f78b4009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:01.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f5cfdffb700 1 -- 172.21.15.59:0/2938195629 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8011830 con 0x7f5d0809e000 2023-09-30T22:33:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f5cfdffb700 1 -- 172.21.15.59:0/2938195629 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf80119b0 con 0x7f5d0809e000 2023-09-30T22:33:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f5cfdffb700 1 -- 172.21.15.59:0/2938195629 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8011d60 con 0x7f5d0809e000 2023-09-30T22:33:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f78b9ffb700 1 -- 172.21.15.59:0/1075213642 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b400c8b0 con 0x7f78c40a1340 2023-09-30T22:33:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f78b9ffb700 1 -- 172.21.15.59:0/1075213642 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b400ca10 con 0x7f78c40a1340 2023-09-30T22:33:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.725+0000 7f78b9ffb700 1 -- 172.21.15.59:0/1075213642 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b400cd80 con 0x7f78c40a1340 2023-09-30T22:33:01.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.726+0000 7f5d0f4de700 1 -- 172.21.15.59:0/2938195629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d081a8b80 con 0x7f5d0809e000 2023-09-30T22:33:01.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.726+0000 7f5d0f4de700 1 -- 172.21.15.59:0/2938195629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d081a7aa0 con 0x7f5d0809e000 2023-09-30T22:33:01.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.726+0000 7f78cba57700 1 -- 172.21.15.59:0/1075213642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc009a70 con 0x7f78c40a1340 2023-09-30T22:33:01.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.726+0000 7f78cba57700 1 -- 172.21.15.59:0/1075213642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c40a0220 con 0x7f78c40a1340 2023-09-30T22:33:01.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.728+0000 7f5cfdffb700 1 -- 172.21.15.59:0/2938195629 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5cf801a400 con 0x7f5d0809e000 2023-09-30T22:33:01.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.728+0000 7f5d0f4de700 1 -- 172.21.15.59:0/2938195629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d08074ea0 con 0x7f5d0809e000 2023-09-30T22:33:01.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.728+0000 7f5cfdffb700 1 -- 172.21.15.59:0/2938195629 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5cf803f650 con 0x7f5d0809e000 2023-09-30T22:33:01.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.729+0000 7f78b9ffb700 1 -- 172.21.15.59:0/1075213642 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78b4013470 con 0x7f78c40a1340 2023-09-30T22:33:01.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.729+0000 7f78b9ffb700 1 -- 172.21.15.59:0/1075213642 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f78b403fc50 con 0x7f78c40a1340 2023-09-30T22:33:01.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.729+0000 7f78cba57700 1 -- 172.21.15.59:0/1075213642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c4074ea0 con 0x7f78c40a1340 2023-09-30T22:33:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f12544c8700 1 Processor -- start 2023-09-30T22:33:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f12544c8700 1 -- start start 2023-09-30T22:33:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f5cf400f700 1 Processor -- start 2023-09-30T22:33:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f5cf400f700 1 -- start start 2023-09-30T22:33:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f5cf400f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5cec136710 0x7f5cec138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f5cf400f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cec139030 0x7f5cec13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f5cf400f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cec06ef30 con 0x7f5cec1338a0 2023-09-30T22:33:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f5cf400f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cec06fef0 con 0x7f5cec136710 2023-09-30T22:33:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f5cf400f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec1334b0 con 0x7f5cec139030 2023-09-30T22:33:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f5cf25ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cec139030 0x7f5cec13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f5cf1dab700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5cec1338a0 0x7f5cec133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52174/0 (socket says 172.21.15.59:52174) 2023-09-30T22:33:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f5cf15aa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5cec136710 0x7f5cec138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f5cf25ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cec139030 0x7f5cec13b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33822/0 (socket says 172.21.15.59:33822) 2023-09-30T22:33:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f5cf1dab700 1 -- 172.21.15.59:0/25632248 learned_addr learned my addr 172.21.15.59:0/25632248 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f12544c8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f124c09d6f0 0x7f124c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f12544c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124c09e410 0x7f124c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f12544c8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124c09f130 con 0x7f124c09e000 2023-09-30T22:33:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f12544c8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124c09f520 con 0x7f124c09d6f0 2023-09-30T22:33:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f12544c8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124c09e930 con 0x7f124c09e410 2023-09-30T22:33:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f1252a65700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124c09e410 0x7f124c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f1252a65700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124c09e410 0x7f124c130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33826/0 (socket says 172.21.15.59:33826) 2023-09-30T22:33:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f1251a63700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f124c09e000 0x7f124c130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52188/0 (socket says 172.21.15.59:52188) 2023-09-30T22:33:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.730+0000 7f1252a65700 1 -- 172.21.15.59:0/821235647 learned_addr learned my addr 172.21.15.59:0/821235647 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.731+0000 7f5cf15aa700 1 -- 172.21.15.59:0/25632248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cec139030 msgr2=0x7f5cec13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.731+0000 7f5cf15aa700 1 --2- 172.21.15.59:0/25632248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cec139030 0x7f5cec13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.731+0000 7f5cf15aa700 1 -- 172.21.15.59:0/25632248 >> v1:172.21.15.59:6789/0 conn(0x7f5cec1338a0 legacy=0x7f5cec133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.731+0000 7f5cf15aa700 1 -- 172.21.15.59:0/25632248 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec06fc30 con 0x7f5cec136710 2023-09-30T22:33:01.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.731+0000 7f1252a65700 1 -- 172.21.15.59:0/821235647 >> v2:172.21.15.59:3300/0 conn(0x7f124c09d6f0 msgr2=0x7f124c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:01.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.731+0000 7f1252a65700 1 --2- 172.21.15.59:0/821235647 >> v2:172.21.15.59:3300/0 conn(0x7f124c09d6f0 0x7f124c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.731+0000 7f1252a65700 1 -- 172.21.15.59:0/821235647 >> v1:172.21.15.59:6789/0 conn(0x7f124c09e000 legacy=0x7f124c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.731+0000 7f1252a65700 1 -- 172.21.15.59:0/821235647 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c09b2d0 con 0x7f124c09e410 2023-09-30T22:33:01.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.731+0000 7f5cf15aa700 1 --2- 172.21.15.59:0/25632248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cec136710 0x7f5cec138af0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009840 tx=0x7f5cdc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581dcfcbb9f4d5f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:01.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.731+0000 7f1252a65700 1 --2- 172.21.15.59:0/821235647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124c09e410 0x7f124c130d70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1244009e50 tx=0x7f124400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f6f192cd001297 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.731+0000 7f1251262700 1 -- 172.21.15.59:0/821235647 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400bbc0 con 0x7f124c09e410 2023-09-30T22:33:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.731+0000 7f1251262700 1 -- 172.21.15.59:0/821235647 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124400bd20 con 0x7f124c09e410 2023-09-30T22:33:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.731+0000 7f1251262700 1 -- 172.21.15.59:0/821235647 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440116a0 con 0x7f124c09e410 2023-09-30T22:33:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.733+0000 7f12544c8700 1 -- 172.21.15.59:0/821235647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124c09e410 msgr2=0x7f124c130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.733+0000 7f12544c8700 1 --2- 172.21.15.59:0/821235647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124c09e410 0x7f124c130d70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1244009e50 tx=0x7f124400b330 comp rx=0 tx=0).stop 2023-09-30T22:33:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.733+0000 7f12544c8700 1 -- 172.21.15.59:0/821235647 shutdown_connections 2023-09-30T22:33:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.733+0000 7f12544c8700 1 --2- 172.21.15.59:0/821235647 >> v2:172.21.15.59:3300/0 conn(0x7f124c09d6f0 0x7f124c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.733+0000 7f12544c8700 1 --2- 172.21.15.59:0/821235647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124c09e410 0x7f124c130d70 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.733+0000 7f12544c8700 1 -- 172.21.15.59:0/821235647 >> 172.21.15.59:0/821235647 conn(0x7f124c066f50 msgr2=0x7f124c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.733+0000 7f12544c8700 1 -- 172.21.15.59:0/821235647 shutdown_connections 2023-09-30T22:33:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.733+0000 7f12544c8700 1 -- 172.21.15.59:0/821235647 wait complete. 2023-09-30T22:33:01.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.733+0000 7f12544c8700 1 Processor -- start 2023-09-30T22:33:01.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.733+0000 7f12544c8700 1 -- start start 2023-09-30T22:33:01.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.733+0000 7f5cfdffb700 1 -- 172.21.15.59:0/2938195629 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5cf8021cd0 con 0x7f5d0809e000 2023-09-30T22:33:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f12544c8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f124c09d6f0 0x7f124c122510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f12544c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124c09e000 0x7f124c122a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f12544c8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f124c09e410 0x7f124c122f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f12544c8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c0a1d00 con 0x7f124c09d6f0 2023-09-30T22:33:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f12544c8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124c1240f0 con 0x7f124c09e000 2023-09-30T22:33:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f12544c8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f124c125c80 con 0x7f124c09e410 2023-09-30T22:33:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f1252a65700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f124c09e410 0x7f124c122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f1252a65700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f124c09e410 0x7f124c122f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53436/0 (socket says 172.21.15.59:53436) 2023-09-30T22:33:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f1252a65700 1 -- 172.21.15.59:0/2127321589 learned_addr learned my addr 172.21.15.59:0/2127321589 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f1251a63700 1 --2- 172.21.15.59:0/2127321589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124c09e000 0x7f124c122a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f1252a65700 1 -- 172.21.15.59:0/2127321589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124c09e000 msgr2=0x7f124c122a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f1252a65700 1 --2- 172.21.15.59:0/2127321589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124c09e000 0x7f124c122a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f1252a65700 1 -- 172.21.15.59:0/2127321589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f124c09d6f0 msgr2=0x7f124c122510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f1252a65700 1 --2- 172.21.15.59:0/2127321589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f124c09d6f0 0x7f124c122510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f1252a65700 1 -- 172.21.15.59:0/2127321589 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1244009b30 con 0x7f124c09e410 2023-09-30T22:33:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f1252a65700 1 --2- 172.21.15.59:0/2127321589 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f124c09e410 0x7f124c122f90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f124c09ea70 tx=0x7f1244004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.734+0000 7f1242ffd700 1 -- 172.21.15.59:0/2127321589 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244011c60 con 0x7f124c09e410 2023-09-30T22:33:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.735+0000 7f1242ffd700 1 -- 172.21.15.59:0/2127321589 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124400be90 con 0x7f124c09e410 2023-09-30T22:33:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.735+0000 7f12544c8700 1 -- 172.21.15.59:0/2127321589 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c09c700 con 0x7f124c09e410 2023-09-30T22:33:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.735+0000 7f1242ffd700 1 -- 172.21.15.59:0/2127321589 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440092e0 con 0x7f124c09e410 2023-09-30T22:33:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.735+0000 7f12544c8700 1 -- 172.21.15.59:0/2127321589 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c1266f0 con 0x7f124c09e410 2023-09-30T22:33:01.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.735+0000 7f1242ffd700 1 -- 172.21.15.59:0/2127321589 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1244004040 con 0x7f124c09e410 2023-09-30T22:33:01.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.736+0000 7f1242ffd700 1 -- 172.21.15.59:0/2127321589 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1244041460 con 0x7f124c09e410 2023-09-30T22:33:01.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.736+0000 7f12544c8700 1 -- 172.21.15.59:0/2127321589 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124c074ea0 con 0x7f124c09e410 2023-09-30T22:33:01.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.742+0000 7f5cf0da9700 1 -- 172.21.15.59:0/25632248 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc011830 con 0x7f5cec136710 2023-09-30T22:33:01.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.742+0000 7f5cf0da9700 1 -- 172.21.15.59:0/25632248 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc011990 con 0x7f5cec136710 2023-09-30T22:33:01.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.742+0000 7f5cf0da9700 1 -- 172.21.15.59:0/25632248 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc011d20 con 0x7f5cec136710 2023-09-30T22:33:01.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.742+0000 7f78b9ffb700 1 -- 172.21.15.59:0/1075213642 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78b401b3b0 con 0x7f78c40a1340 2023-09-30T22:33:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.742+0000 7f5cf400f700 1 -- 172.21.15.59:0/25632248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cec136710 msgr2=0x7f5cec138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.742+0000 7f5cf400f700 1 --2- 172.21.15.59:0/25632248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cec136710 0x7f5cec138af0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009840 tx=0x7f5cdc009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.742+0000 7f5cf400f700 1 -- 172.21.15.59:0/25632248 shutdown_connections 2023-09-30T22:33:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.742+0000 7f5cf400f700 1 --2- 172.21.15.59:0/25632248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cec139030 0x7f5cec13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.742+0000 7f5cf400f700 1 --2- 172.21.15.59:0/25632248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cec136710 0x7f5cec138af0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.742+0000 7f5cf400f700 1 -- 172.21.15.59:0/25632248 >> 172.21.15.59:0/25632248 conn(0x7f5cec0a2aa0 msgr2=0x7f5cec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.742+0000 7f5cf400f700 1 -- 172.21.15.59:0/25632248 shutdown_connections 2023-09-30T22:33:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.742+0000 7f5cf400f700 1 -- 172.21.15.59:0/25632248 wait complete. 2023-09-30T22:33:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf400f700 1 Processor -- start 2023-09-30T22:33:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf400f700 1 -- start start 2023-09-30T22:33:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf400f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cec1338a0 0x7f5cec09d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf400f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cec136710 0x7f5cec09dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf400f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cec139030 0x7f5cec09e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf400f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec11a250 con 0x7f5cec136710 2023-09-30T22:33:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf400f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec09eb60 con 0x7f5cec1338a0 2023-09-30T22:33:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf400f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec09f310 con 0x7f5cec139030 2023-09-30T22:33:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf1dab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cec1338a0 0x7f5cec09d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf1dab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cec1338a0 0x7f5cec09d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33844/0 (socket says 172.21.15.59:33844) 2023-09-30T22:33:01.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf1dab700 1 -- 172.21.15.59:0/3119369848 learned_addr learned my addr 172.21.15.59:0/3119369848 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:01.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf25ac700 1 --2- 172.21.15.59:0/3119369848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cec139030 0x7f5cec09e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf15aa700 1 --2- 172.21.15.59:0/3119369848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cec136710 0x7f5cec09dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:01.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f1242ffd700 1 -- 172.21.15.59:0/2127321589 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1244022750 con 0x7f124c09e410 2023-09-30T22:33:01.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf25ac700 1 -- 172.21.15.59:0/3119369848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cec1338a0 msgr2=0x7f5cec09d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf25ac700 1 --2- 172.21.15.59:0/3119369848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cec1338a0 0x7f5cec09d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf25ac700 1 -- 172.21.15.59:0/3119369848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cec136710 msgr2=0x7f5cec09dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf25ac700 1 --2- 172.21.15.59:0/3119369848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cec136710 0x7f5cec09dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf25ac700 1 -- 172.21.15.59:0/3119369848 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc0094a0 con 0x7f5cec139030 2023-09-30T22:33:01.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.744+0000 7f5cf25ac700 1 --2- 172.21.15.59:0/3119369848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cec139030 0x7f5cec09e180 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009d90 tx=0x7f5ce400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:01.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.745+0000 7f5ce27fc700 1 -- 172.21.15.59:0/3119369848 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4009c00 con 0x7f5cec139030 2023-09-30T22:33:01.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.745+0000 7f5ce27fc700 1 -- 172.21.15.59:0/3119369848 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce400f040 con 0x7f5cec139030 2023-09-30T22:33:01.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.745+0000 7f5ce27fc700 1 -- 172.21.15.59:0/3119369848 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4014480 con 0x7f5cec139030 2023-09-30T22:33:01.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.745+0000 7f5cf400f700 1 -- 172.21.15.59:0/3119369848 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cec11a4a0 con 0x7f5cec139030 2023-09-30T22:33:01.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.745+0000 7f5cf400f700 1 -- 172.21.15.59:0/3119369848 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cec119260 con 0x7f5cec139030 2023-09-30T22:33:01.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.745+0000 7f5ce27fc700 1 -- 172.21.15.59:0/3119369848 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ce40145e0 con 0x7f5cec139030 2023-09-30T22:33:01.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.747+0000 7f5ce27fc700 1 -- 172.21.15.59:0/3119369848 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5ce403fff0 con 0x7f5cec139030 2023-09-30T22:33:01.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.747+0000 7f5cf400f700 1 -- 172.21.15.59:0/3119369848 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cec119200 con 0x7f5cec139030 2023-09-30T22:33:01.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.752+0000 7f5ce27fc700 1 -- 172.21.15.59:0/3119369848 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ce4018070 con 0x7f5cec139030 2023-09-30T22:33:01.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.952+0000 7f78cba57700 1 -- 172.21.15.59:0/1075213642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78c40a28e0 con 0x7f78c40a1340 2023-09-30T22:33:01.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.953+0000 7f78b9ffb700 1 -- 172.21.15.59:0/1075213642 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78b401ab50 con 0x7f78c40a1340 2023-09-30T22:33:01.953 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:01.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.953+0000 7f12544c8700 1 -- 172.21.15.59:0/2127321589 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f124c06c360 con 0x7f124c09e410 2023-09-30T22:33:01.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.953+0000 7f1242ffd700 1 -- 172.21.15.59:0/2127321589 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12440233e0 con 0x7f124c09e410 2023-09-30T22:33:01.954 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:01.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.955+0000 7f78cba57700 1 -- 172.21.15.59:0/1075213642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c40a1340 msgr2=0x7f78c41205d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.955+0000 7f78cba57700 1 --2- 172.21.15.59:0/1075213642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c40a1340 0x7f78c41205d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f78b400ebe0 tx=0x7f78b4009e70 comp rx=0 tx=0).stop 2023-09-30T22:33:01.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.955+0000 7f78cba57700 1 -- 172.21.15.59:0/1075213642 shutdown_connections 2023-09-30T22:33:01.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.955+0000 7f78cba57700 1 --2- 172.21.15.59:0/1075213642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c4133fa0 0x7f78c4120b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.955+0000 7f78cba57700 1 --2- 172.21.15.59:0/1075213642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c40a0a30 0x7f78c4120090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.955+0000 7f78cba57700 1 --2- 172.21.15.59:0/1075213642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c40a1340 0x7f78c41205d0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.955+0000 7f78cba57700 1 -- 172.21.15.59:0/1075213642 >> 172.21.15.59:0/1075213642 conn(0x7f78c40a6550 msgr2=0x7f78c41bb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:01.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.955+0000 7f78cba57700 1 -- 172.21.15.59:0/1075213642 shutdown_connections 2023-09-30T22:33:01.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.955+0000 7f78cba57700 1 -- 172.21.15.59:0/1075213642 wait complete. 2023-09-30T22:33:01.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.956+0000 7f12544c8700 1 -- 172.21.15.59:0/2127321589 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f124c09e410 msgr2=0x7f124c122f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.956+0000 7f12544c8700 1 --2- 172.21.15.59:0/2127321589 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f124c09e410 0x7f124c122f90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f124c09ea70 tx=0x7f1244004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.956+0000 7f12544c8700 1 -- 172.21.15.59:0/2127321589 shutdown_connections 2023-09-30T22:33:01.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.956+0000 7f12544c8700 1 --2- 172.21.15.59:0/2127321589 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f124c09e410 0x7f124c122f90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.956+0000 7f12544c8700 1 --2- 172.21.15.59:0/2127321589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f124c09d6f0 0x7f124c122510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.956+0000 7f12544c8700 1 --2- 172.21.15.59:0/2127321589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f124c09e000 0x7f124c122a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.956+0000 7f12544c8700 1 -- 172.21.15.59:0/2127321589 >> 172.21.15.59:0/2127321589 conn(0x7f124c066f50 msgr2=0x7f124c0a1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:01.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.957+0000 7f12544c8700 1 -- 172.21.15.59:0/2127321589 shutdown_connections 2023-09-30T22:33:01.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.957+0000 7f12544c8700 1 -- 172.21.15.59:0/2127321589 wait complete. 2023-09-30T22:33:01.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.965+0000 7f5d0f4de700 1 -- 172.21.15.59:0/2938195629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5d081a7aa0 con 0x7f5d0809e000 2023-09-30T22:33:01.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.966+0000 7f5cfdffb700 1 -- 172.21.15.59:0/2938195629 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d081a7aa0 con 0x7f5d0809e000 2023-09-30T22:33:01.966 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:01.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.970+0000 7f5d0f4de700 1 -- 172.21.15.59:0/2938195629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0809e000 msgr2=0x7f5d081c5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.970+0000 7f5d0f4de700 1 --2- 172.21.15.59:0/2938195629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0809e000 0x7f5d081c5630 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800b500 tx=0x7f5cf800b810 comp rx=0 tx=0).stop 2023-09-30T22:33:01.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.970+0000 7f5d0f4de700 1 -- 172.21.15.59:0/2938195629 shutdown_connections 2023-09-30T22:33:01.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.970+0000 7f5d0f4de700 1 --2- 172.21.15.59:0/2938195629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0809e410 0x7f5d081c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.970+0000 7f5d0f4de700 1 --2- 172.21.15.59:0/2938195629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0809d6f0 0x7f5d081c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.970+0000 7f5d0f4de700 1 --2- 172.21.15.59:0/2938195629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0809e000 0x7f5d081c5630 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.970+0000 7f5d0f4de700 1 -- 172.21.15.59:0/2938195629 >> 172.21.15.59:0/2938195629 conn(0x7f5d08066f50 msgr2=0x7f5d081bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:01.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.970+0000 7f5d0f4de700 1 -- 172.21.15.59:0/2938195629 shutdown_connections 2023-09-30T22:33:01.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.970+0000 7f5d0f4de700 1 -- 172.21.15.59:0/2938195629 wait complete. 2023-09-30T22:33:01.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:01.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.977+0000 7f5cf400f700 1 -- 172.21.15.59:0/3119369848 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5cec06ea40 con 0x7f5cec139030 2023-09-30T22:33:01.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.978+0000 7f5ce27fc700 1 -- 172.21.15.59:0/3119369848 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ce402c090 con 0x7f5cec139030 2023-09-30T22:33:01.978 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:01.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.980+0000 7f5cf400f700 1 -- 172.21.15.59:0/3119369848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cec139030 msgr2=0x7f5cec09e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:01.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.980+0000 7f5cf400f700 1 --2- 172.21.15.59:0/3119369848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cec139030 0x7f5cec09e180 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009d90 tx=0x7f5ce400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.980+0000 7f5cf400f700 1 -- 172.21.15.59:0/3119369848 shutdown_connections 2023-09-30T22:33:01.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.980+0000 7f5cf400f700 1 --2- 172.21.15.59:0/3119369848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cec139030 0x7f5cec09e180 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.980+0000 7f5cf400f700 1 --2- 172.21.15.59:0/3119369848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cec1338a0 0x7f5cec09d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.980+0000 7f5cf400f700 1 --2- 172.21.15.59:0/3119369848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cec136710 0x7f5cec09dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:01.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.980+0000 7f5cf400f700 1 -- 172.21.15.59:0/3119369848 >> 172.21.15.59:0/3119369848 conn(0x7f5cec0a2aa0 msgr2=0x7f5cec1344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:01.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.980+0000 7f5cf400f700 1 -- 172.21.15.59:0/3119369848 shutdown_connections 2023-09-30T22:33:01.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:01.980+0000 7f5cf400f700 1 -- 172.21.15.59:0/3119369848 wait complete. 2023-09-30T22:33:01.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:01.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:02.973 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:02.974 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:02.986 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:02.995 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:03.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.128+0000 7f79e7f99700 1 Processor -- start 2023-09-30T22:33:03.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.128+0000 7f51ef30f700 1 Processor -- start 2023-09-30T22:33:03.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.128+0000 7f51ef30f700 1 -- start start 2023-09-30T22:33:03.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.128+0000 7f79e7f99700 1 -- start start 2023-09-30T22:33:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f51ef30f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51e809d6f0 0x7f51e809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f79e7f99700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e00a0a30 0x7f79e00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f79e7f99700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79e009d630 0x7f79e00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f51ef30f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51e809e000 0x7f51e81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f51ef30f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e809b120 con 0x7f51e809e410 2023-09-30T22:33:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f51ef30f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e806b460 con 0x7f51e809d6f0 2023-09-30T22:33:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f51ef30f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51e809a7e0 con 0x7f51e809e000 2023-09-30T22:33:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f79e7f99700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79e0133930 0x7f79e0133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f79e7f99700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e00a2a70 con 0x7f79e009d630 2023-09-30T22:33:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f79e7f99700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00a01d0 con 0x7f79e00a0a30 2023-09-30T22:33:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f79e7f99700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79e009e2b0 con 0x7f79e0133930 2023-09-30T22:33:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f79e5d35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e00a0a30 0x7f79e00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f79e5d35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e00a0a30 0x7f79e00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33860/0 (socket says 172.21.15.59:33860) 2023-09-30T22:33:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f79e5d35700 1 -- 172.21.15.59:0/400373882 learned_addr learned my addr 172.21.15.59:0/400373882 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f51ed8ac700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f51e809e410 0x7f51e8133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52202/0 (socket says 172.21.15.59:52202) 2023-09-30T22:33:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.129+0000 7f51ed8ac700 1 -- 172.21.15.59:0/3835483660 learned_addr learned my addr 172.21.15.59:0/3835483660 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f51ec8aa700 1 --2- 172.21.15.59:0/3835483660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51e809e000 0x7f51e81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f79e6536700 1 --2- 172.21.15.59:0/400373882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79e0133930 0x7f79e0133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f79e5d35700 1 -- 172.21.15.59:0/400373882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79e0133930 msgr2=0x7f79e0133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:03.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f79e5d35700 1 --2- 172.21.15.59:0/400373882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79e0133930 0x7f79e0133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f79e5d35700 1 -- 172.21.15.59:0/400373882 >> v2:172.21.15.59:3300/0 conn(0x7f79e009d630 msgr2=0x7f79e00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:03.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f79e5534700 1 --2- 172.21.15.59:0/400373882 >> v2:172.21.15.59:3300/0 conn(0x7f79e009d630 0x7f79e00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f51ed0ab700 1 --2- 172.21.15.59:0/3835483660 >> v2:172.21.15.59:3300/0 conn(0x7f51e809d6f0 0x7f51e809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f79e5d35700 1 --2- 172.21.15.59:0/400373882 >> v2:172.21.15.59:3300/0 conn(0x7f79e009d630 0x7f79e00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f79e5d35700 1 -- 172.21.15.59:0/400373882 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e009dc50 con 0x7f79e00a0a30 2023-09-30T22:33:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f79e5534700 1 --2- 172.21.15.59:0/400373882 >> v2:172.21.15.59:3300/0 conn(0x7f79e009d630 0x7f79e00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f51ec8aa700 1 -- 172.21.15.59:0/3835483660 >> v2:172.21.15.59:3300/0 conn(0x7f51e809d6f0 msgr2=0x7f51e809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f51ec8aa700 1 --2- 172.21.15.59:0/3835483660 >> v2:172.21.15.59:3300/0 conn(0x7f51e809d6f0 0x7f51e809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f51ec8aa700 1 -- 172.21.15.59:0/3835483660 >> v1:172.21.15.59:6789/0 conn(0x7f51e809e410 legacy=0x7f51e8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f51ec8aa700 1 -- 172.21.15.59:0/3835483660 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e809a500 con 0x7f51e809e000 2023-09-30T22:33:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f79e5d35700 1 --2- 172.21.15.59:0/400373882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e00a0a30 0x7f79e00a0e00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0098f0 tx=0x7f79dc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=873da9e1a5c3d5f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.130+0000 7f79e4d33700 1 -- 172.21.15.59:0/400373882 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc00b8a0 con 0x7f79e00a0a30 2023-09-30T22:33:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.131+0000 7f51ec8aa700 1 --2- 172.21.15.59:0/3835483660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51e809e000 0x7f51e81339f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009870 tx=0x7f51d8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=454ebf0fd48976ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.131+0000 7f79e4d33700 1 -- 172.21.15.59:0/400373882 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc00ba00 con 0x7f79e00a0a30 2023-09-30T22:33:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.131+0000 7f79e4d33700 1 -- 172.21.15.59:0/400373882 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc00bd90 con 0x7f79e00a0a30 2023-09-30T22:33:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.131+0000 7f51dffff700 1 -- 172.21.15.59:0/3835483660 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8011830 con 0x7f51e809e000 2023-09-30T22:33:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.131+0000 7f51dffff700 1 -- 172.21.15.59:0/3835483660 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d8011990 con 0x7f51e809e000 2023-09-30T22:33:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.131+0000 7f51dffff700 1 -- 172.21.15.59:0/3835483660 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8011d20 con 0x7f51e809e000 2023-09-30T22:33:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.131+0000 7f79e7f99700 1 -- 172.21.15.59:0/400373882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e00a0a30 msgr2=0x7f79e00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.131+0000 7f79e7f99700 1 --2- 172.21.15.59:0/400373882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e00a0a30 0x7f79e00a0e00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0098f0 tx=0x7f79dc009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.131+0000 7f79e7f99700 1 -- 172.21.15.59:0/400373882 shutdown_connections 2023-09-30T22:33:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.131+0000 7f79e7f99700 1 --2- 172.21.15.59:0/400373882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79e0133930 0x7f79e0133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.131+0000 7f79e7f99700 1 --2- 172.21.15.59:0/400373882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e00a0a30 0x7f79e00a0e00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.132+0000 7f79e7f99700 1 --2- 172.21.15.59:0/400373882 >> v2:172.21.15.59:3300/0 conn(0x7f79e009d630 0x7f79e00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.132+0000 7f79e7f99700 1 -- 172.21.15.59:0/400373882 >> 172.21.15.59:0/400373882 conn(0x7f79e00a3050 msgr2=0x7f79e00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:03.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.132+0000 7f79e7f99700 1 -- 172.21.15.59:0/400373882 shutdown_connections 2023-09-30T22:33:03.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.132+0000 7f79e7f99700 1 -- 172.21.15.59:0/400373882 wait complete. 2023-09-30T22:33:03.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.132+0000 7f51ef30f700 1 -- 172.21.15.59:0/3835483660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51e809e000 msgr2=0x7f51e81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.132+0000 7f51ef30f700 1 --2- 172.21.15.59:0/3835483660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51e809e000 0x7f51e81339f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009870 tx=0x7f51d8009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:03.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.132+0000 7f51ef30f700 1 -- 172.21.15.59:0/3835483660 shutdown_connections 2023-09-30T22:33:03.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.132+0000 7f51ef30f700 1 --2- 172.21.15.59:0/3835483660 >> v2:172.21.15.59:3300/0 conn(0x7f51e809d6f0 0x7f51e809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.132+0000 7f51ef30f700 1 --2- 172.21.15.59:0/3835483660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51e809e000 0x7f51e81339f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.132+0000 7f51ef30f700 1 -- 172.21.15.59:0/3835483660 >> 172.21.15.59:0/3835483660 conn(0x7f51e8066f50 msgr2=0x7f51e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:03.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.132+0000 7f51ef30f700 1 -- 172.21.15.59:0/3835483660 shutdown_connections 2023-09-30T22:33:03.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.132+0000 7f51ef30f700 1 -- 172.21.15.59:0/3835483660 wait complete. 2023-09-30T22:33:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.133+0000 7f79e7f99700 1 Processor -- start 2023-09-30T22:33:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.133+0000 7f79e7f99700 1 -- start start 2023-09-30T22:33:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.133+0000 7f79e7f99700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e009d630 0x7f79e011f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.133+0000 7f79e7f99700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79e00a0a30 0x7f79e011f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.133+0000 7f79e7f99700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e0133930 0x7f79e01c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.133+0000 7f79e7f99700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e01207f0 con 0x7f79e0133930 2023-09-30T22:33:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.133+0000 7f79e7f99700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0120600 con 0x7f79e009d630 2023-09-30T22:33:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.133+0000 7f79e7f99700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79e011fe90 con 0x7f79e00a0a30 2023-09-30T22:33:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.133+0000 7f79e5d35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e009d630 0x7f79e011f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.133+0000 7f79e5d35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e009d630 0x7f79e011f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33868/0 (socket says 172.21.15.59:33868) 2023-09-30T22:33:03.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.133+0000 7f79e5d35700 1 -- 172.21.15.59:0/2854133767 learned_addr learned my addr 172.21.15.59:0/2854133767 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:03.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f79e6536700 1 --2- 172.21.15.59:0/2854133767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e0133930 0x7f79e01c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f51ef30f700 1 Processor -- start 2023-09-30T22:33:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f79e5534700 1 --2- 172.21.15.59:0/2854133767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79e00a0a30 0x7f79e011f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f79e5d35700 1 -- 172.21.15.59:0/2854133767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79e00a0a30 msgr2=0x7f79e011f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f79e5d35700 1 --2- 172.21.15.59:0/2854133767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79e00a0a30 0x7f79e011f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f79e5d35700 1 -- 172.21.15.59:0/2854133767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e0133930 msgr2=0x7f79e01c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f79e5d35700 1 --2- 172.21.15.59:0/2854133767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e0133930 0x7f79e01c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f79e5d35700 1 -- 172.21.15.59:0/2854133767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc009550 con 0x7f79e009d630 2023-09-30T22:33:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f79e5d35700 1 --2- 172.21.15.59:0/2854133767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e009d630 0x7f79e011f3e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009c40 tx=0x7f79dc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f79e5534700 1 --2- 172.21.15.59:0/2854133767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79e00a0a30 0x7f79e011f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:03.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f79d67fc700 1 -- 172.21.15.59:0/2854133767 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc0044d0 con 0x7f79e009d630 2023-09-30T22:33:03.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f79d67fc700 1 -- 172.21.15.59:0/2854133767 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc0036a0 con 0x7f79e009d630 2023-09-30T22:33:03.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f79e7f99700 1 -- 172.21.15.59:0/2854133767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e0120be0 con 0x7f79e009d630 2023-09-30T22:33:03.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f79e7f99700 1 -- 172.21.15.59:0/2854133767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e00a40c0 con 0x7f79e009d630 2023-09-30T22:33:03.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f51ef30f700 1 -- start start 2023-09-30T22:33:03.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f51ef30f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e809d6f0 0x7f51e81a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f51ef30f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e809e000 0x7f51e81a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f51ef30f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51e809e410 0x7f51e81a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f51ef30f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e81a87a0 con 0x7f51e809e000 2023-09-30T22:33:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f51ef30f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e80a3240 con 0x7f51e809d6f0 2023-09-30T22:33:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.134+0000 7f51ef30f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51e809c710 con 0x7f51e809e410 2023-09-30T22:33:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.135+0000 7f51ed0ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e809d6f0 0x7f51e81a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.135+0000 7f51ed0ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e809d6f0 0x7f51e81a4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33874/0 (socket says 172.21.15.59:33874) 2023-09-30T22:33:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.135+0000 7f51ed0ab700 1 -- 172.21.15.59:0/2036555533 learned_addr learned my addr 172.21.15.59:0/2036555533 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.135+0000 7f51ec8aa700 1 --2- 172.21.15.59:0/2036555533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e809e000 0x7f51e81a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.135+0000 7f51ed8ac700 1 --2- 172.21.15.59:0/2036555533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51e809e410 0x7f51e81a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.135+0000 7f51ec8aa700 1 -- 172.21.15.59:0/2036555533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51e809e410 msgr2=0x7f51e81a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.135+0000 7f51ec8aa700 1 --2- 172.21.15.59:0/2036555533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51e809e410 0x7f51e81a5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.135+0000 7f51ec8aa700 1 -- 172.21.15.59:0/2036555533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e809d6f0 msgr2=0x7f51e81a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.135+0000 7f51ec8aa700 1 --2- 172.21.15.59:0/2036555533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e809d6f0 0x7f51e81a4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.135+0000 7f51ec8aa700 1 -- 172.21.15.59:0/2036555533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d80094a0 con 0x7f51e809e000 2023-09-30T22:33:03.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.135+0000 7f51ed8ac700 1 --2- 172.21.15.59:0/2036555533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51e809e410 0x7f51e81a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:03.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.135+0000 7f51ec8aa700 1 --2- 172.21.15.59:0/2036555533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e809e000 0x7f51e81a54e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f51d8016000 tx=0x7f51d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:03.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.136+0000 7f79d67fc700 1 -- 172.21.15.59:0/2854133767 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc003a30 con 0x7f79e009d630 2023-09-30T22:33:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.136+0000 7f51ddffb700 1 -- 172.21.15.59:0/2036555533 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8004590 con 0x7f51e809e000 2023-09-30T22:33:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.136+0000 7f51ddffb700 1 -- 172.21.15.59:0/2036555533 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d801f070 con 0x7f51e809e000 2023-09-30T22:33:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.136+0000 7f51ddffb700 1 -- 172.21.15.59:0/2036555533 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d80038e0 con 0x7f51e809e000 2023-09-30T22:33:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.136+0000 7f79e7f99700 1 -- 172.21.15.59:0/2854133767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e00747f0 con 0x7f79e009d630 2023-09-30T22:33:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.136+0000 7f51ef30f700 1 -- 172.21.15.59:0/2036555533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e81a6390 con 0x7f51e809e000 2023-09-30T22:33:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.136+0000 7f51ef30f700 1 -- 172.21.15.59:0/2036555533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e81a7dc0 con 0x7f51e809e000 2023-09-30T22:33:03.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.137+0000 7f79d67fc700 1 -- 172.21.15.59:0/2854133767 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79dc021070 con 0x7f79e009d630 2023-09-30T22:33:03.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.137+0000 7f79d67fc700 1 -- 172.21.15.59:0/2854133767 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f79dc041220 con 0x7f79e009d630 2023-09-30T22:33:03.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.137+0000 7f51ef30f700 1 -- 172.21.15.59:0/2036555533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e8074ea0 con 0x7f51e809e000 2023-09-30T22:33:03.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.138+0000 7f51ddffb700 1 -- 172.21.15.59:0/2036555533 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51d8003a40 con 0x7f51e809e000 2023-09-30T22:33:03.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.138+0000 7f51ddffb700 1 -- 172.21.15.59:0/2036555533 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f51d8021070 con 0x7f51e809e000 2023-09-30T22:33:03.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.143+0000 7f79d67fc700 1 -- 172.21.15.59:0/2854133767 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79dc0193b0 con 0x7f79e009d630 2023-09-30T22:33:03.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.147+0000 7f51ddffb700 1 -- 172.21.15.59:0/2036555533 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51d8010380 con 0x7f51e809e000 2023-09-30T22:33:03.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.168+0000 7fa9eba18700 1 Processor -- start 2023-09-30T22:33:03.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.169+0000 7fa9eba18700 1 -- start start 2023-09-30T22:33:03.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.169+0000 7fa9eba18700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9e409d6f0 0x7fa9e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.169+0000 7fa9eba18700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e409e410 0x7fa9e4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.169+0000 7fa9eba18700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e409f130 con 0x7fa9e409e000 2023-09-30T22:33:03.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.169+0000 7fa9eba18700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e409f520 con 0x7fa9e409d6f0 2023-09-30T22:33:03.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.169+0000 7fa9eba18700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e409e930 con 0x7fa9e409e410 2023-09-30T22:33:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.170+0000 7fa9e9fb5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e409e410 0x7fa9e4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.170+0000 7fa9e8fb3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa9e409e000 0x7fa9e4130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52206/0 (socket says 172.21.15.59:52206) 2023-09-30T22:33:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.170+0000 7fa9e8fb3700 1 -- 172.21.15.59:0/3882154620 learned_addr learned my addr 172.21.15.59:0/3882154620 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.170+0000 7fa9e97b4700 1 --2- 172.21.15.59:0/3882154620 >> v2:172.21.15.59:3300/0 conn(0x7fa9e409d6f0 0x7fa9e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.170+0000 7fa9e9fb5700 1 -- 172.21.15.59:0/3882154620 >> v2:172.21.15.59:3300/0 conn(0x7fa9e409d6f0 msgr2=0x7fa9e409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.170+0000 7fa9e9fb5700 1 --2- 172.21.15.59:0/3882154620 >> v2:172.21.15.59:3300/0 conn(0x7fa9e409d6f0 0x7fa9e409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.170+0000 7fa9e9fb5700 1 -- 172.21.15.59:0/3882154620 >> v1:172.21.15.59:6789/0 conn(0x7fa9e409e000 legacy=0x7fa9e4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.170+0000 7fa9e9fb5700 1 -- 172.21.15.59:0/3882154620 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e409b2d0 con 0x7fa9e409e410 2023-09-30T22:33:03.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.170+0000 7fa9e9fb5700 1 --2- 172.21.15.59:0/3882154620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e409e410 0x7fa9e4130d70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009d90 tx=0x7fa9dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a7c42459dd7122f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:03.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.171+0000 7fa9dbfff700 1 -- 172.21.15.59:0/3882154620 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc00bd20 con 0x7fa9e409e410 2023-09-30T22:33:03.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.171+0000 7fa9dbfff700 1 -- 172.21.15.59:0/3882154620 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc00be80 con 0x7fa9e409e410 2023-09-30T22:33:03.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.171+0000 7fa9dbfff700 1 -- 172.21.15.59:0/3882154620 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc0116a0 con 0x7fa9e409e410 2023-09-30T22:33:03.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.171+0000 7fa9eba18700 1 -- 172.21.15.59:0/3882154620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e409e410 msgr2=0x7fa9e4130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.171+0000 7fa9eba18700 1 --2- 172.21.15.59:0/3882154620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e409e410 0x7fa9e4130d70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009d90 tx=0x7fa9dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:33:03.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.171+0000 7fa9eba18700 1 -- 172.21.15.59:0/3882154620 shutdown_connections 2023-09-30T22:33:03.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.171+0000 7fa9eba18700 1 --2- 172.21.15.59:0/3882154620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e409e410 0x7fa9e4130d70 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.171+0000 7fa9eba18700 1 --2- 172.21.15.59:0/3882154620 >> v2:172.21.15.59:3300/0 conn(0x7fa9e409d6f0 0x7fa9e409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.171+0000 7fa9eba18700 1 -- 172.21.15.59:0/3882154620 >> 172.21.15.59:0/3882154620 conn(0x7fa9e4066f50 msgr2=0x7fa9e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:03.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.171+0000 7fa9eba18700 1 -- 172.21.15.59:0/3882154620 shutdown_connections 2023-09-30T22:33:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.172+0000 7fa9eba18700 1 -- 172.21.15.59:0/3882154620 wait complete. 2023-09-30T22:33:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.172+0000 7fa9eba18700 1 Processor -- start 2023-09-30T22:33:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.173+0000 7fa9eba18700 1 -- start start 2023-09-30T22:33:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.173+0000 7fa9eba18700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e409d6f0 0x7fa9e411e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.173+0000 7fa9eba18700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e409e000 0x7fa9e411e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.173+0000 7fa9eba18700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e409e410 0x7fa9e411ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.173+0000 7fa9eba18700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e4121490 con 0x7fa9e409e000 2023-09-30T22:33:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.173+0000 7fa9eba18700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e409c700 con 0x7fa9e409e410 2023-09-30T22:33:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.173+0000 7fa9eba18700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e411f5d0 con 0x7fa9e409d6f0 2023-09-30T22:33:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.173+0000 7fa9e97b4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e409d6f0 0x7fa9e411e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.173+0000 7fa9e97b4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e409d6f0 0x7fa9e411e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53512/0 (socket says 172.21.15.59:53512) 2023-09-30T22:33:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.173+0000 7fa9e97b4700 1 -- 172.21.15.59:0/786734142 learned_addr learned my addr 172.21.15.59:0/786734142 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.173+0000 7fa9e9fb5700 1 --2- 172.21.15.59:0/786734142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e409e410 0x7fa9e411ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.174+0000 7fa9e8fb3700 1 --2- 172.21.15.59:0/786734142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e409e000 0x7fa9e411e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.174+0000 7fa9e97b4700 1 -- 172.21.15.59:0/786734142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e409e410 msgr2=0x7fa9e411ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.174+0000 7fa9e97b4700 1 --2- 172.21.15.59:0/786734142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e409e410 0x7fa9e411ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.174+0000 7fa9e97b4700 1 -- 172.21.15.59:0/786734142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e409e000 msgr2=0x7fa9e411e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.174+0000 7fa9e97b4700 1 --2- 172.21.15.59:0/786734142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e409e000 0x7fa9e411e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.174+0000 7fa9e97b4700 1 -- 172.21.15.59:0/786734142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc009a70 con 0x7fa9e409d6f0 2023-09-30T22:33:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.174+0000 7fa9e9fb5700 1 --2- 172.21.15.59:0/786734142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e409e410 0x7fa9e411ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:03.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.174+0000 7fa9e97b4700 1 --2- 172.21.15.59:0/786734142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e409d6f0 0x7fa9e411e190 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000e870 tx=0x7fa9e000eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:03.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.174+0000 7fa9d9ffb700 1 -- 172.21.15.59:0/786734142 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0009590 con 0x7fa9e409d6f0 2023-09-30T22:33:03.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.174+0000 7fa9d9ffb700 1 -- 172.21.15.59:0/786734142 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e0013680 con 0x7fa9e409d6f0 2023-09-30T22:33:03.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.174+0000 7fa9eba18700 1 -- 172.21.15.59:0/786734142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e411fd50 con 0x7fa9e409d6f0 2023-09-30T22:33:03.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.174+0000 7fa9d9ffb700 1 -- 172.21.15.59:0/786734142 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00139f0 con 0x7fa9e409d6f0 2023-09-30T22:33:03.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.175+0000 7fa9eba18700 1 -- 172.21.15.59:0/786734142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e4120350 con 0x7fa9e409d6f0 2023-09-30T22:33:03.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.176+0000 7fa9eba18700 1 -- 172.21.15.59:0/786734142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e41217e0 con 0x7fa9e409d6f0 2023-09-30T22:33:03.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.177+0000 7fa9d9ffb700 1 -- 172.21.15.59:0/786734142 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9e0013b50 con 0x7fa9e409d6f0 2023-09-30T22:33:03.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.177+0000 7fa9d9ffb700 1 -- 172.21.15.59:0/786734142 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa9e003fcc0 con 0x7fa9e409d6f0 2023-09-30T22:33:03.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.180+0000 7f8eae8fb700 1 Processor -- start 2023-09-30T22:33:03.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.180+0000 7f8eae8fb700 1 -- start start 2023-09-30T22:33:03.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8eae8fb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea812cf60 0x7f8ea806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8eae8fb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ea812f8b0 0x7f8ea812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8eae8fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea8130260 0x7f8ea8136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8eae8fb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea812d330 con 0x7f8ea812f8b0 2023-09-30T22:33:03.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8eae8fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea812cd90 con 0x7f8ea8130260 2023-09-30T22:33:03.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8eae8fb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81306d0 con 0x7f8ea812cf60 2023-09-30T22:33:03.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8eace98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea8130260 0x7f8ea8136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8ea77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ea812f8b0 0x7f8ea812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8eace98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea8130260 0x7f8ea8136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33892/0 (socket says 172.21.15.59:33892) 2023-09-30T22:33:03.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8ea7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea812cf60 0x7f8ea806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8ea77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ea812f8b0 0x7f8ea812fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42168/0 (socket says 172.21.15.59:42168) 2023-09-30T22:33:03.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8eace98700 1 -- 172.21.15.59:0/778884871 learned_addr learned my addr 172.21.15.59:0/778884871 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:03.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8eace98700 1 -- 172.21.15.59:0/778884871 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea812cf60 msgr2=0x7f8ea806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:03.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8eace98700 1 --2- 172.21.15.59:0/778884871 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea812cf60 0x7f8ea806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8eace98700 1 -- 172.21.15.59:0/778884871 >> v2:172.21.15.59:3300/0 conn(0x7f8ea812f8b0 msgr2=0x7f8ea812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:03.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8eace98700 1 --2- 172.21.15.59:0/778884871 >> v2:172.21.15.59:3300/0 conn(0x7f8ea812f8b0 0x7f8ea812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8eace98700 1 -- 172.21.15.59:0/778884871 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea8071780 con 0x7f8ea8130260 2023-09-30T22:33:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.181+0000 7f8eace98700 1 --2- 172.21.15.59:0/778884871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea8130260 0x7f8ea8136c20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000bef0 tx=0x7f8ea0009370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adbe198f800a9163 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.182+0000 7f8ea6ffd700 1 -- 172.21.15.59:0/778884871 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000b480 con 0x7f8ea8130260 2023-09-30T22:33:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.182+0000 7f8ea6ffd700 1 -- 172.21.15.59:0/778884871 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea000c950 con 0x7f8ea8130260 2023-09-30T22:33:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.182+0000 7f8ea6ffd700 1 -- 172.21.15.59:0/778884871 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000cd00 con 0x7f8ea8130260 2023-09-30T22:33:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.183+0000 7f8eae8fb700 1 -- 172.21.15.59:0/778884871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea8130260 msgr2=0x7f8ea8136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.183+0000 7f8eae8fb700 1 --2- 172.21.15.59:0/778884871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea8130260 0x7f8ea8136c20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000bef0 tx=0x7f8ea0009370 comp rx=0 tx=0).stop 2023-09-30T22:33:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.183+0000 7f8eae8fb700 1 -- 172.21.15.59:0/778884871 shutdown_connections 2023-09-30T22:33:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.183+0000 7f8eae8fb700 1 --2- 172.21.15.59:0/778884871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea8130260 0x7f8ea8136c20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.183+0000 7f8eae8fb700 1 --2- 172.21.15.59:0/778884871 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea812cf60 0x7f8ea806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.183+0000 7f8eae8fb700 1 --2- 172.21.15.59:0/778884871 >> v2:172.21.15.59:3300/0 conn(0x7f8ea812f8b0 0x7f8ea812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.183+0000 7f8eae8fb700 1 -- 172.21.15.59:0/778884871 >> 172.21.15.59:0/778884871 conn(0x7f8ea80a2aa0 msgr2=0x7f8ea80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.183+0000 7f8eae8fb700 1 -- 172.21.15.59:0/778884871 shutdown_connections 2023-09-30T22:33:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.183+0000 7f8eae8fb700 1 -- 172.21.15.59:0/778884871 wait complete. 2023-09-30T22:33:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.184+0000 7f8eae8fb700 1 Processor -- start 2023-09-30T22:33:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.184+0000 7f8eae8fb700 1 -- start start 2023-09-30T22:33:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.185+0000 7f8eae8fb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea812cf60 0x7f8ea81c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.185+0000 7f8eae8fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea812f8b0 0x7f8ea81c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.185+0000 7f8eae8fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea8130260 0x7f8ea81c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.185+0000 7f8eae8fb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea809ce00 con 0x7f8ea812f8b0 2023-09-30T22:33:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.185+0000 7f8eae8fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea812da40 con 0x7f8ea8130260 2023-09-30T22:33:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.185+0000 7f8eae8fb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea8129bd0 con 0x7f8ea812cf60 2023-09-30T22:33:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.185+0000 7f8ea77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea812f8b0 0x7f8ea81c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.185+0000 7f8ea77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea812f8b0 0x7f8ea81c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42182/0 (socket says 172.21.15.59:42182) 2023-09-30T22:33:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.185+0000 7f8ea77fe700 1 -- 172.21.15.59:0/2992692952 learned_addr learned my addr 172.21.15.59:0/2992692952 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.185+0000 7f8ea7fff700 1 --2- 172.21.15.59:0/2992692952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea812cf60 0x7f8ea81c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.185+0000 7f8eace98700 1 --2- 172.21.15.59:0/2992692952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea8130260 0x7f8ea81c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.186+0000 7f8ea77fe700 1 -- 172.21.15.59:0/2992692952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea812cf60 msgr2=0x7f8ea81c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.186+0000 7f8ea77fe700 1 --2- 172.21.15.59:0/2992692952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea812cf60 0x7f8ea81c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.186+0000 7f8ea77fe700 1 -- 172.21.15.59:0/2992692952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea8130260 msgr2=0x7f8ea81c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.186+0000 7f8ea77fe700 1 --2- 172.21.15.59:0/2992692952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea8130260 0x7f8ea81c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.186+0000 7f8ea77fe700 1 -- 172.21.15.59:0/2992692952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea000bb50 con 0x7f8ea812f8b0 2023-09-30T22:33:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.186+0000 7f8eace98700 1 --2- 172.21.15.59:0/2992692952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea8130260 0x7f8ea81c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.186+0000 7fa9d9ffb700 1 -- 172.21.15.59:0/786734142 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9e0024bd0 con 0x7fa9e409d6f0 2023-09-30T22:33:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.186+0000 7f8ea77fe700 1 --2- 172.21.15.59:0/2992692952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea812f8b0 0x7f8ea81c4570 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c012fc0 tx=0x7f8e9c0100c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.186+0000 7f8ea4ff9700 1 -- 172.21.15.59:0/2992692952 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c00dbb0 con 0x7f8ea812f8b0 2023-09-30T22:33:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.186+0000 7f8ea4ff9700 1 -- 172.21.15.59:0/2992692952 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c013040 con 0x7f8ea812f8b0 2023-09-30T22:33:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.186+0000 7f8eae8fb700 1 -- 172.21.15.59:0/2992692952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea809ea30 con 0x7f8ea812f8b0 2023-09-30T22:33:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.186+0000 7f8ea4ff9700 1 -- 172.21.15.59:0/2992692952 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c010bb0 con 0x7f8ea812f8b0 2023-09-30T22:33:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.186+0000 7f8eae8fb700 1 -- 172.21.15.59:0/2992692952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea809d5f0 con 0x7f8ea812f8b0 2023-09-30T22:33:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.188+0000 7f8eae8fb700 1 -- 172.21.15.59:0/2992692952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea8074ea0 con 0x7f8ea812f8b0 2023-09-30T22:33:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.188+0000 7f8ea4ff9700 1 -- 172.21.15.59:0/2992692952 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e9c010d10 con 0x7f8ea812f8b0 2023-09-30T22:33:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.188+0000 7f8ea4ff9700 1 -- 172.21.15.59:0/2992692952 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e9c044530 con 0x7f8ea812f8b0 2023-09-30T22:33:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.193+0000 7f8ea4ff9700 1 -- 172.21.15.59:0/2992692952 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e9c018e60 con 0x7f8ea812f8b0 2023-09-30T22:33:03.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.353+0000 7f79e7f99700 1 -- 172.21.15.59:0/2854133767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f79e0133380 con 0x7f79e009d630 2023-09-30T22:33:03.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.354+0000 7f79d67fc700 1 -- 172.21.15.59:0/2854133767 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79dc011d00 con 0x7f79e009d630 2023-09-30T22:33:03.354 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.357+0000 7f79e7f99700 1 -- 172.21.15.59:0/2854133767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e009d630 msgr2=0x7f79e011f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.357+0000 7f79e7f99700 1 --2- 172.21.15.59:0/2854133767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e009d630 0x7f79e011f3e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009c40 tx=0x7f79dc004750 comp rx=0 tx=0).stop 2023-09-30T22:33:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.357+0000 7f79e7f99700 1 -- 172.21.15.59:0/2854133767 shutdown_connections 2023-09-30T22:33:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.357+0000 7f79e7f99700 1 --2- 172.21.15.59:0/2854133767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e0133930 0x7f79e01c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.357+0000 7f79e7f99700 1 --2- 172.21.15.59:0/2854133767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e009d630 0x7f79e011f3e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.357+0000 7f79e7f99700 1 --2- 172.21.15.59:0/2854133767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79e00a0a30 0x7f79e011f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.357+0000 7f79e7f99700 1 -- 172.21.15.59:0/2854133767 >> 172.21.15.59:0/2854133767 conn(0x7f79e00a3050 msgr2=0x7f79e01bba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.357+0000 7f79e7f99700 1 -- 172.21.15.59:0/2854133767 shutdown_connections 2023-09-30T22:33:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.357+0000 7f79e7f99700 1 -- 172.21.15.59:0/2854133767 wait complete. 2023-09-30T22:33:03.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:03.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.395+0000 7fa9eba18700 1 -- 172.21.15.59:0/786734142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa9e41217e0 con 0x7fa9e409d6f0 2023-09-30T22:33:03.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.396+0000 7fa9d9ffb700 1 -- 172.21.15.59:0/786734142 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9e41217e0 con 0x7fa9e409d6f0 2023-09-30T22:33:03.396 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:03.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.397+0000 7f51ef30f700 1 -- 172.21.15.59:0/2036555533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f51e806c360 con 0x7f51e809e000 2023-09-30T22:33:03.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.397+0000 7f51ddffb700 1 -- 172.21.15.59:0/2036555533 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51d8015020 con 0x7f51e809e000 2023-09-30T22:33:03.397 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:03.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.399+0000 7fa9eba18700 1 -- 172.21.15.59:0/786734142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e409d6f0 msgr2=0x7fa9e411e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.399+0000 7fa9eba18700 1 --2- 172.21.15.59:0/786734142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e409d6f0 0x7fa9e411e190 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000e870 tx=0x7fa9e000eb80 comp rx=0 tx=0).stop 2023-09-30T22:33:03.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7fa9eba18700 1 -- 172.21.15.59:0/786734142 shutdown_connections 2023-09-30T22:33:03.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7fa9eba18700 1 --2- 172.21.15.59:0/786734142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e409d6f0 0x7fa9e411e190 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7fa9eba18700 1 --2- 172.21.15.59:0/786734142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e409e410 0x7fa9e411ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7fa9eba18700 1 --2- 172.21.15.59:0/786734142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e409e000 0x7fa9e411e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7fa9eba18700 1 -- 172.21.15.59:0/786734142 >> 172.21.15.59:0/786734142 conn(0x7fa9e4066f50 msgr2=0x7fa9e4071050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:03.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7fa9eba18700 1 -- 172.21.15.59:0/786734142 shutdown_connections 2023-09-30T22:33:03.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7fa9eba18700 1 -- 172.21.15.59:0/786734142 wait complete. 2023-09-30T22:33:03.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7f51ef30f700 1 -- 172.21.15.59:0/2036555533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e809e000 msgr2=0x7f51e81a54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7f51ef30f700 1 --2- 172.21.15.59:0/2036555533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e809e000 0x7f51e81a54e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f51d8016000 tx=0x7f51d8004750 comp rx=0 tx=0).stop 2023-09-30T22:33:03.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7f51ef30f700 1 -- 172.21.15.59:0/2036555533 shutdown_connections 2023-09-30T22:33:03.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7f51ef30f700 1 --2- 172.21.15.59:0/2036555533 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51e809e410 0x7f51e81a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7f51ef30f700 1 --2- 172.21.15.59:0/2036555533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e809d6f0 0x7f51e81a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7f51ef30f700 1 --2- 172.21.15.59:0/2036555533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e809e000 0x7f51e81a54e0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7f51ef30f700 1 -- 172.21.15.59:0/2036555533 >> 172.21.15.59:0/2036555533 conn(0x7f51e8066f50 msgr2=0x7f51e806f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:03.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7f51ef30f700 1 -- 172.21.15.59:0/2036555533 shutdown_connections 2023-09-30T22:33:03.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.400+0000 7f51ef30f700 1 -- 172.21.15.59:0/2036555533 wait complete. 2023-09-30T22:33:03.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:03.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.436+0000 7f8eae8fb700 1 -- 172.21.15.59:0/2992692952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ea806fc40 con 0x7f8ea812f8b0 2023-09-30T22:33:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.436+0000 7f8ea4ff9700 1 -- 172.21.15.59:0/2992692952 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e9c02a380 con 0x7f8ea812f8b0 2023-09-30T22:33:03.436 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:03.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.439+0000 7f8eae8fb700 1 -- 172.21.15.59:0/2992692952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea812f8b0 msgr2=0x7f8ea81c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:03.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.439+0000 7f8eae8fb700 1 --2- 172.21.15.59:0/2992692952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea812f8b0 0x7f8ea81c4570 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c012fc0 tx=0x7f8e9c0100c0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.439+0000 7f8eae8fb700 1 -- 172.21.15.59:0/2992692952 shutdown_connections 2023-09-30T22:33:03.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.439+0000 7f8eae8fb700 1 --2- 172.21.15.59:0/2992692952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea812cf60 0x7f8ea81c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.439+0000 7f8eae8fb700 1 --2- 172.21.15.59:0/2992692952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea8130260 0x7f8ea81c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.439+0000 7f8eae8fb700 1 --2- 172.21.15.59:0/2992692952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea812f8b0 0x7f8ea81c4570 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:03.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.439+0000 7f8eae8fb700 1 -- 172.21.15.59:0/2992692952 >> 172.21.15.59:0/2992692952 conn(0x7f8ea80a2aa0 msgr2=0x7f8ea81b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:03.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.439+0000 7f8eae8fb700 1 -- 172.21.15.59:0/2992692952 shutdown_connections 2023-09-30T22:33:03.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:03.439+0000 7f8eae8fb700 1 -- 172.21.15.59:0/2992692952 wait complete. 2023-09-30T22:33:03.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:04.373 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:04.417 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:04.421 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:04.453 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.534+0000 7f19e4f37700 1 Processor -- start 2023-09-30T22:33:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.534+0000 7f19e4f37700 1 -- start start 2023-09-30T22:33:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.535+0000 7f19e4f37700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e009d6f0 0x7f19e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.535+0000 7f19e4f37700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19e009e410 0x7f19e0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.535+0000 7f19e4f37700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e009b120 con 0x7f19e009e000 2023-09-30T22:33:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.535+0000 7f19e4f37700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e006b460 con 0x7f19e009e410 2023-09-30T22:33:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.535+0000 7f19e4f37700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e009a7e0 con 0x7f19e009d6f0 2023-09-30T22:33:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.536+0000 7f19ded9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19e009e410 0x7f19e0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.536+0000 7f19ded9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19e009e410 0x7f19e0134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34384/0 (socket says 172.21.15.59:34384) 2023-09-30T22:33:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.536+0000 7f19ded9d700 1 -- 172.21.15.59:0/3630079398 learned_addr learned my addr 172.21.15.59:0/3630079398 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.536+0000 7f19de59c700 1 --2- 172.21.15.59:0/3630079398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e009d6f0 0x7f19e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.536+0000 7f19ded9d700 1 -- 172.21.15.59:0/3630079398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e009d6f0 msgr2=0x7f19e009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.536+0000 7f19ded9d700 1 --2- 172.21.15.59:0/3630079398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e009d6f0 0x7f19e009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.536+0000 7f19ded9d700 1 -- 172.21.15.59:0/3630079398 >> v1:172.21.15.59:6789/0 conn(0x7f19e009e000 legacy=0x7f19e01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.536+0000 7f19ded9d700 1 -- 172.21.15.59:0/3630079398 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e009a500 con 0x7f19e009e410 2023-09-30T22:33:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.536+0000 7f19ded9d700 1 --2- 172.21.15.59:0/3630079398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e009e410 0x7f19e0134100 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009e50 tx=0x7f19d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde2b159044b3267 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.536+0000 7f19dd59a700 1 -- 172.21.15.59:0/3630079398 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d800e070 con 0x7f19e009e410 2023-09-30T22:33:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.537+0000 7f19dd59a700 1 -- 172.21.15.59:0/3630079398 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d800b910 con 0x7f19e009e410 2023-09-30T22:33:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.537+0000 7f19dd59a700 1 -- 172.21.15.59:0/3630079398 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d800bcc0 con 0x7f19e009e410 2023-09-30T22:33:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.537+0000 7f19e4f37700 1 -- 172.21.15.59:0/3630079398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e009e410 msgr2=0x7f19e0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.537+0000 7f19e4f37700 1 --2- 172.21.15.59:0/3630079398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e009e410 0x7f19e0134100 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009e50 tx=0x7f19d800b330 comp rx=0 tx=0).stop 2023-09-30T22:33:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.537+0000 7f19e4f37700 1 -- 172.21.15.59:0/3630079398 shutdown_connections 2023-09-30T22:33:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.537+0000 7f19e4f37700 1 --2- 172.21.15.59:0/3630079398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e009e410 0x7f19e0134100 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.537+0000 7f19e4f37700 1 --2- 172.21.15.59:0/3630079398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e009d6f0 0x7f19e009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.537+0000 7f19e4f37700 1 -- 172.21.15.59:0/3630079398 >> 172.21.15.59:0/3630079398 conn(0x7f19e0066f50 msgr2=0x7f19e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.538+0000 7f19e4f37700 1 -- 172.21.15.59:0/3630079398 shutdown_connections 2023-09-30T22:33:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.538+0000 7f19e4f37700 1 -- 172.21.15.59:0/3630079398 wait complete. 2023-09-30T22:33:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.539+0000 7f19e4f37700 1 Processor -- start 2023-09-30T22:33:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.539+0000 7f19e4f37700 1 -- start start 2023-09-30T22:33:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.539+0000 7f19e4f37700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e009d6f0 0x7f19e01a5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.539+0000 7f19e4f37700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e009e000 0x7f19e01a64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.539+0000 7f19e4f37700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e009e410 0x7f19e01a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.539+0000 7f19e4f37700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e01a8090 con 0x7f19e009e000 2023-09-30T22:33:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.539+0000 7f19e4f37700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e01a9150 con 0x7f19e009d6f0 2023-09-30T22:33:04.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.539+0000 7f19e4f37700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19e009c710 con 0x7f19e009e410 2023-09-30T22:33:04.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.540+0000 7f19ddd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e009e000 0x7f19e01a64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.540+0000 7f19ded9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e009e410 0x7f19e01a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.540+0000 7f19ddd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e009e000 0x7f19e01a64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34388/0 (socket says 172.21.15.59:34388) 2023-09-30T22:33:04.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.540+0000 7f19ded9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e009e410 0x7f19e01a6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51838/0 (socket says 172.21.15.59:51838) 2023-09-30T22:33:04.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.540+0000 7f19ddd9b700 1 -- 172.21.15.59:0/1830786271 learned_addr learned my addr 172.21.15.59:0/1830786271 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:04.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.540+0000 7f19de59c700 1 --2- 172.21.15.59:0/1830786271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e009d6f0 0x7f19e01a5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.540+0000 7f19ded9d700 1 -- 172.21.15.59:0/1830786271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e009d6f0 msgr2=0x7f19e01a5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.540+0000 7f19ded9d700 1 --2- 172.21.15.59:0/1830786271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e009d6f0 0x7f19e01a5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.540+0000 7f19ded9d700 1 -- 172.21.15.59:0/1830786271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e009e000 msgr2=0x7f19e01a64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.540+0000 7f19ded9d700 1 --2- 172.21.15.59:0/1830786271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e009e000 0x7f19e01a64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.540+0000 7f19ded9d700 1 -- 172.21.15.59:0/1830786271 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d8009b30 con 0x7f19e009e410 2023-09-30T22:33:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.540+0000 7f19ded9d700 1 --2- 172.21.15.59:0/1830786271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e009e410 0x7f19e01a6a00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f19d8015000 tx=0x7f19d8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.541+0000 7f19ceffd700 1 -- 172.21.15.59:0/1830786271 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8004880 con 0x7f19e009e410 2023-09-30T22:33:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.541+0000 7f19ceffd700 1 -- 172.21.15.59:0/1830786271 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d80092e0 con 0x7f19e009e410 2023-09-30T22:33:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.541+0000 7f19e4f37700 1 -- 172.21.15.59:0/1830786271 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e00a30d0 con 0x7f19e009e410 2023-09-30T22:33:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.541+0000 7f19ceffd700 1 -- 172.21.15.59:0/1830786271 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d801c660 con 0x7f19e009e410 2023-09-30T22:33:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.541+0000 7f19e4f37700 1 -- 172.21.15.59:0/1830786271 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e01a8d00 con 0x7f19e009e410 2023-09-30T22:33:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.542+0000 7f19ceffd700 1 -- 172.21.15.59:0/1830786271 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19d801c7c0 con 0x7f19e009e410 2023-09-30T22:33:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.542+0000 7f19ceffd700 1 -- 172.21.15.59:0/1830786271 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f19d8040f00 con 0x7f19e009e410 2023-09-30T22:33:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.542+0000 7f19e4f37700 1 -- 172.21.15.59:0/1830786271 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e0074ea0 con 0x7f19e009e410 2023-09-30T22:33:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.551+0000 7f19ceffd700 1 -- 172.21.15.59:0/1830786271 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19d8024590 con 0x7f19e009e410 2023-09-30T22:33:04.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.580+0000 7fe644a5b700 1 Processor -- start 2023-09-30T22:33:04.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.580+0000 7fe644a5b700 1 -- start start 2023-09-30T22:33:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.580+0000 7fe644a5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64009d6f0 0x7fe64009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.580+0000 7fe644a5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64009e000 0x7fe6401339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.580+0000 7fe644a5b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64009b120 con 0x7fe64009e410 2023-09-30T22:33:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.580+0000 7fe644a5b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64006b460 con 0x7fe64009e000 2023-09-30T22:33:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.580+0000 7fe644a5b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe64009a7e0 con 0x7fe64009d6f0 2023-09-30T22:33:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.581+0000 7fe63e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64009d6f0 0x7fe64009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.581+0000 7fe63e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64009d6f0 0x7fe64009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51848/0 (socket says 172.21.15.59:51848) 2023-09-30T22:33:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.581+0000 7fe63e59c700 1 -- 172.21.15.59:0/463722796 learned_addr learned my addr 172.21.15.59:0/463722796 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.581+0000 7fe63ed9d700 1 --1- 172.21.15.59:0/463722796 >> v1:172.21.15.59:6789/0 conn(0x7fe64009e410 0x7fe640133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57068/0 (socket says 172.21.15.59:57068) 2023-09-30T22:33:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.581+0000 7fe63e59c700 1 -- 172.21.15.59:0/463722796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64009e000 msgr2=0x7fe6401339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.581+0000 7fe63e59c700 1 --2- 172.21.15.59:0/463722796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64009e000 0x7fe6401339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.581+0000 7fe63e59c700 1 -- 172.21.15.59:0/463722796 >> v1:172.21.15.59:6789/0 conn(0x7fe64009e410 legacy=0x7fe640133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.581+0000 7fe63e59c700 1 -- 172.21.15.59:0/463722796 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64009a500 con 0x7fe64009d6f0 2023-09-30T22:33:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.581+0000 7fe63e59c700 1 --2- 172.21.15.59:0/463722796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64009d6f0 0x7fe64009dac0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe630009950 tx=0x7fe630009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9c9c99f7684b8f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.582+0000 7fe63d59a700 1 -- 172.21.15.59:0/463722796 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630009ea0 con 0x7fe64009d6f0 2023-09-30T22:33:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.582+0000 7fe63d59a700 1 -- 172.21.15.59:0/463722796 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63000ba20 con 0x7fe64009d6f0 2023-09-30T22:33:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.582+0000 7fe63d59a700 1 -- 172.21.15.59:0/463722796 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000bdb0 con 0x7fe64009d6f0 2023-09-30T22:33:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.582+0000 7fe644a5b700 1 -- 172.21.15.59:0/463722796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64009d6f0 msgr2=0x7fe64009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.582+0000 7fe644a5b700 1 --2- 172.21.15.59:0/463722796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64009d6f0 0x7fe64009dac0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe630009950 tx=0x7fe630009c60 comp rx=0 tx=0).stop 2023-09-30T22:33:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.583+0000 7fe644a5b700 1 -- 172.21.15.59:0/463722796 shutdown_connections 2023-09-30T22:33:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.583+0000 7fe644a5b700 1 --2- 172.21.15.59:0/463722796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64009d6f0 0x7fe64009dac0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.583+0000 7fe644a5b700 1 --2- 172.21.15.59:0/463722796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64009e000 0x7fe6401339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.583+0000 7fe644a5b700 1 -- 172.21.15.59:0/463722796 >> 172.21.15.59:0/463722796 conn(0x7fe640066f50 msgr2=0x7fe64009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.583+0000 7fe644a5b700 1 -- 172.21.15.59:0/463722796 shutdown_connections 2023-09-30T22:33:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.583+0000 7fe644a5b700 1 -- 172.21.15.59:0/463722796 wait complete. 2023-09-30T22:33:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.584+0000 7fe644a5b700 1 Processor -- start 2023-09-30T22:33:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.584+0000 7fe644a5b700 1 -- start start 2023-09-30T22:33:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.584+0000 7fe644a5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64009d6f0 0x7fe640122530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.584+0000 7fe644a5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64009e000 0x7fe640122a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe644a5b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64009e410 0x7fe640122fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe644a5b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe640126050 con 0x7fe64009e410 2023-09-30T22:33:04.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe644a5b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6401241e0 con 0x7fe64009d6f0 2023-09-30T22:33:04.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe644a5b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400a1d90 con 0x7fe64009e000 2023-09-30T22:33:04.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe63e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64009d6f0 0x7fe640122530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe63e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64009d6f0 0x7fe640122530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35348/0 (socket says 172.21.15.59:35348) 2023-09-30T22:33:04.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe63e59c700 1 -- 172.21.15.59:0/2511591696 learned_addr learned my addr 172.21.15.59:0/2511591696 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:04.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe63dd9b700 1 --2- 172.21.15.59:0/2511591696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64009e000 0x7fe640122a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe63ed9d700 1 --2- 172.21.15.59:0/2511591696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64009e410 0x7fe640122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe63e59c700 1 -- 172.21.15.59:0/2511591696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64009e000 msgr2=0x7fe640122a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe63e59c700 1 --2- 172.21.15.59:0/2511591696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64009e000 0x7fe640122a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe63e59c700 1 -- 172.21.15.59:0/2511591696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64009e410 msgr2=0x7fe640122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe63e59c700 1 --2- 172.21.15.59:0/2511591696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64009e410 0x7fe640122fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe63e59c700 1 -- 172.21.15.59:0/2511591696 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe630009550 con 0x7fe64009d6f0 2023-09-30T22:33:04.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe63dd9b700 1 --2- 172.21.15.59:0/2511591696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64009e000 0x7fe640122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:04.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe63ed9d700 1 --2- 172.21.15.59:0/2511591696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64009e410 0x7fe640122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:04.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.585+0000 7fe63e59c700 1 --2- 172.21.15.59:0/2511591696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64009d6f0 0x7fe640122530 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe630000c00 tx=0x7fe630004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:04.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.586+0000 7fe62effd700 1 -- 172.21.15.59:0/2511591696 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000be90 con 0x7fe64009d6f0 2023-09-30T22:33:04.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.586+0000 7fe62effd700 1 -- 172.21.15.59:0/2511591696 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63001f070 con 0x7fe64009d6f0 2023-09-30T22:33:04.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.586+0000 7fe62effd700 1 -- 172.21.15.59:0/2511591696 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6300038e0 con 0x7fe64009d6f0 2023-09-30T22:33:04.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.586+0000 7fe644a5b700 1 -- 172.21.15.59:0/2511591696 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64009c710 con 0x7fe64009d6f0 2023-09-30T22:33:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.586+0000 7fe644a5b700 1 -- 172.21.15.59:0/2511591696 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe640124f40 con 0x7fe64009d6f0 2023-09-30T22:33:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.587+0000 7fe62effd700 1 -- 172.21.15.59:0/2511591696 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe630021030 con 0x7fe64009d6f0 2023-09-30T22:33:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.587+0000 7fe644a5b700 1 -- 172.21.15.59:0/2511591696 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe640074ea0 con 0x7fe64009d6f0 2023-09-30T22:33:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.587+0000 7fe62effd700 1 -- 172.21.15.59:0/2511591696 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe630040c30 con 0x7fe64009d6f0 2023-09-30T22:33:04.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.592+0000 7fe62effd700 1 -- 172.21.15.59:0/2511591696 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe6300199a0 con 0x7fe64009d6f0 2023-09-30T22:33:04.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.608+0000 7fabd2294700 1 Processor -- start 2023-09-30T22:33:04.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.609+0000 7fabd2294700 1 -- start start 2023-09-30T22:33:04.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.609+0000 7fabd2294700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabcc09d6f0 0x7fabcc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.609+0000 7fabd2294700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fabcc09e410 0x7fabcc130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.609+0000 7fabd2294700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabcc09f130 con 0x7fabcc09e000 2023-09-30T22:33:04.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.609+0000 7fabd2294700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabcc09f520 con 0x7fabcc09e410 2023-09-30T22:33:04.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.609+0000 7fabd2294700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc09e930 con 0x7fabcc09d6f0 2023-09-30T22:33:04.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.610+0000 7fabcbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabcc09d6f0 0x7fabcc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.610+0000 7fabcbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabcc09d6f0 0x7fabcc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51852/0 (socket says 172.21.15.59:51852) 2023-09-30T22:33:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.610+0000 7fabcbfff700 1 -- 172.21.15.59:0/1309652689 learned_addr learned my addr 172.21.15.59:0/1309652689 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.610+0000 7fabcbfff700 1 -- 172.21.15.59:0/1309652689 >> v2:172.21.15.59:3300/0 conn(0x7fabcc09e410 msgr2=0x7fabcc130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.610+0000 7fabcbfff700 1 --2- 172.21.15.59:0/1309652689 >> v2:172.21.15.59:3300/0 conn(0x7fabcc09e410 0x7fabcc130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.610+0000 7fabcbfff700 1 -- 172.21.15.59:0/1309652689 >> v1:172.21.15.59:6789/0 conn(0x7fabcc09e000 legacy=0x7fabcc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.610+0000 7fabcbfff700 1 -- 172.21.15.59:0/1309652689 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc09b2d0 con 0x7fabcc09d6f0 2023-09-30T22:33:04.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.610+0000 7fabcbfff700 1 --2- 172.21.15.59:0/1309652689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabcc09d6f0 0x7fabcc09dac0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00bb90 tx=0x7fabbc00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96d104100d81c2de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:04.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.611+0000 7fabcaffd700 1 -- 172.21.15.59:0/1309652689 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00dd10 con 0x7fabcc09d6f0 2023-09-30T22:33:04.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.611+0000 7fabcaffd700 1 -- 172.21.15.59:0/1309652689 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc00de70 con 0x7fabcc09d6f0 2023-09-30T22:33:04.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.611+0000 7fabcaffd700 1 -- 172.21.15.59:0/1309652689 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc004230 con 0x7fabcc09d6f0 2023-09-30T22:33:04.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.611+0000 7fabd2294700 1 -- 172.21.15.59:0/1309652689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabcc09d6f0 msgr2=0x7fabcc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.611+0000 7fabd2294700 1 --2- 172.21.15.59:0/1309652689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabcc09d6f0 0x7fabcc09dac0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00bb90 tx=0x7fabbc00bea0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.611+0000 7fabd2294700 1 -- 172.21.15.59:0/1309652689 shutdown_connections 2023-09-30T22:33:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.611+0000 7fabd2294700 1 --2- 172.21.15.59:0/1309652689 >> v2:172.21.15.59:3300/0 conn(0x7fabcc09e410 0x7fabcc130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.611+0000 7fabd2294700 1 --2- 172.21.15.59:0/1309652689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabcc09d6f0 0x7fabcc09dac0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.611+0000 7fabd2294700 1 -- 172.21.15.59:0/1309652689 >> 172.21.15.59:0/1309652689 conn(0x7fabcc066f50 msgr2=0x7fabcc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.612+0000 7fabd2294700 1 -- 172.21.15.59:0/1309652689 shutdown_connections 2023-09-30T22:33:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.612+0000 7fabd2294700 1 -- 172.21.15.59:0/1309652689 wait complete. 2023-09-30T22:33:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.613+0000 7fabd2294700 1 Processor -- start 2023-09-30T22:33:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.613+0000 7fabd2294700 1 -- start start 2023-09-30T22:33:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabd2294700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabcc09e000 0x7fabcc1c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabd2294700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabcc09e410 0x7fabcc1c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabd2294700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabcc1c9310 0x7fabcc1c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabd2294700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc1c9760 con 0x7fabcc09e000 2023-09-30T22:33:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabd2294700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc1262f0 con 0x7fabcc09e410 2023-09-30T22:33:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabd2294700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc122e20 con 0x7fabcc1c9310 2023-09-30T22:33:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabd0831700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabcc1c9310 0x7fabcc1c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabd0831700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabcc1c9310 0x7fabcc1c5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51858/0 (socket says 172.21.15.59:51858) 2023-09-30T22:33:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabd0831700 1 -- 172.21.15.59:0/1650600352 learned_addr learned my addr 172.21.15.59:0/1650600352 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabcbfff700 1 --2- 172.21.15.59:0/1650600352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabcc09e000 0x7fabcc1c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabcb7fe700 1 --2- 172.21.15.59:0/1650600352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabcc09e410 0x7fabcc1c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabd0831700 1 -- 172.21.15.59:0/1650600352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabcc09e410 msgr2=0x7fabcc1c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabd0831700 1 --2- 172.21.15.59:0/1650600352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabcc09e410 0x7fabcc1c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabd0831700 1 -- 172.21.15.59:0/1650600352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabcc09e000 msgr2=0x7fabcc1c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabd0831700 1 --2- 172.21.15.59:0/1650600352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabcc09e000 0x7fabcc1c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabd0831700 1 -- 172.21.15.59:0/1650600352 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc00b7f0 con 0x7fabcc1c9310 2023-09-30T22:33:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.614+0000 7fabcb7fe700 1 --2- 172.21.15.59:0/1650600352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabcc09e410 0x7fabcc1c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.615+0000 7fabd0831700 1 --2- 172.21.15.59:0/1650600352 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabcc1c9310 0x7fabcc1c5470 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fabc400b9e0 tx=0x7fabc400bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.615+0000 7fabc8ff9700 1 -- 172.21.15.59:0/1650600352 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc400c930 con 0x7fabcc1c9310 2023-09-30T22:33:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.615+0000 7fabc8ff9700 1 -- 172.21.15.59:0/1650600352 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc400cad0 con 0x7fabcc1c9310 2023-09-30T22:33:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.615+0000 7fabc8ff9700 1 -- 172.21.15.59:0/1650600352 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc400ce80 con 0x7fabcc1c9310 2023-09-30T22:33:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.615+0000 7fabd2294700 1 -- 172.21.15.59:0/1650600352 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabcc1245e0 con 0x7fabcc1c9310 2023-09-30T22:33:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.615+0000 7fabd2294700 1 -- 172.21.15.59:0/1650600352 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabcc1255f0 con 0x7fabcc1c9310 2023-09-30T22:33:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.616+0000 7fabd2294700 1 -- 172.21.15.59:0/1650600352 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabcc0a3540 con 0x7fabcc1c9310 2023-09-30T22:33:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.616+0000 7fabc8ff9700 1 -- 172.21.15.59:0/1650600352 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabc4014440 con 0x7fabcc1c9310 2023-09-30T22:33:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.616+0000 7fabc8ff9700 1 -- 172.21.15.59:0/1650600352 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fabc4006e40 con 0x7fabcc1c9310 2023-09-30T22:33:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.620+0000 7f15cb8cd700 1 Processor -- start 2023-09-30T22:33:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.621+0000 7f15cb8cd700 1 -- start start 2023-09-30T22:33:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.621+0000 7f15cb8cd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15c412cf60 0x7f15c406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.621+0000 7f15cb8cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15c412f8b0 0x7f15c412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.621+0000 7f15cb8cd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c412cd90 con 0x7f15c4130260 2023-09-30T22:33:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.622+0000 7f15cb8cd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c412d330 con 0x7f15c412cf60 2023-09-30T22:33:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.622+0000 7f15cb8cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15c41306d0 con 0x7f15c412f8b0 2023-09-30T22:33:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.622+0000 7f15c8e68700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15c412f8b0 0x7f15c412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.622+0000 7f15c9669700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15c412cf60 0x7f15c406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.622+0000 7f15c8e68700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15c412f8b0 0x7f15c412fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51860/0 (socket says 172.21.15.59:51860) 2023-09-30T22:33:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.622+0000 7f15c8e68700 1 -- 172.21.15.59:0/1099563682 learned_addr learned my addr 172.21.15.59:0/1099563682 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.622+0000 7fabc8ff9700 1 -- 172.21.15.59:0/1650600352 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabc40133a0 con 0x7fabcc1c9310 2023-09-30T22:33:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.622+0000 7f15c8e68700 1 -- 172.21.15.59:0/1099563682 >> v2:172.21.15.59:3300/0 conn(0x7f15c412cf60 msgr2=0x7f15c406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.622+0000 7f15c8e68700 1 --2- 172.21.15.59:0/1099563682 >> v2:172.21.15.59:3300/0 conn(0x7f15c412cf60 0x7f15c406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.622+0000 7f15c8e68700 1 -- 172.21.15.59:0/1099563682 >> v1:172.21.15.59:6789/0 conn(0x7f15c4130260 legacy=0x7f15c4136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.622+0000 7f15c8e68700 1 -- 172.21.15.59:0/1099563682 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c4071780 con 0x7f15c412f8b0 2023-09-30T22:33:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.622+0000 7f15c8e68700 1 --2- 172.21.15.59:0/1099563682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15c412f8b0 0x7f15c412fd20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f15b40098f0 tx=0x7f15b4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=748e5fe50c3ba6ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.623+0000 7f15bbfff700 1 -- 172.21.15.59:0/1099563682 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4011830 con 0x7f15c412f8b0 2023-09-30T22:33:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.623+0000 7f15bbfff700 1 -- 172.21.15.59:0/1099563682 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b4011990 con 0x7f15c412f8b0 2023-09-30T22:33:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.623+0000 7f15bbfff700 1 -- 172.21.15.59:0/1099563682 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4011d00 con 0x7f15c412f8b0 2023-09-30T22:33:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.624+0000 7f15cb8cd700 1 -- 172.21.15.59:0/1099563682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15c412f8b0 msgr2=0x7f15c412fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.624+0000 7f15cb8cd700 1 --2- 172.21.15.59:0/1099563682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15c412f8b0 0x7f15c412fd20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f15b40098f0 tx=0x7f15b4009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.624+0000 7f15cb8cd700 1 -- 172.21.15.59:0/1099563682 shutdown_connections 2023-09-30T22:33:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.624+0000 7f15cb8cd700 1 --2- 172.21.15.59:0/1099563682 >> v2:172.21.15.59:3300/0 conn(0x7f15c412cf60 0x7f15c406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.624+0000 7f15cb8cd700 1 --2- 172.21.15.59:0/1099563682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15c412f8b0 0x7f15c412fd20 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.624+0000 7f15cb8cd700 1 -- 172.21.15.59:0/1099563682 >> 172.21.15.59:0/1099563682 conn(0x7f15c40a2aa0 msgr2=0x7f15c40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.624+0000 7f15cb8cd700 1 -- 172.21.15.59:0/1099563682 shutdown_connections 2023-09-30T22:33:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.624+0000 7f15cb8cd700 1 -- 172.21.15.59:0/1099563682 wait complete. 2023-09-30T22:33:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.625+0000 7f15cb8cd700 1 Processor -- start 2023-09-30T22:33:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.625+0000 7f15cb8cd700 1 -- start start 2023-09-30T22:33:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.626+0000 7f15cb8cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c412cf60 0x7f15c41309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.626+0000 7f15cb8cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15c412f8b0 0x7f15c4130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.626+0000 7f15cb8cd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c4130260 0x7f15c4131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.626+0000 7f15cb8cd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4132fe0 con 0x7f15c4130260 2023-09-30T22:33:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.626+0000 7f15cb8cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4131ed0 con 0x7f15c412cf60 2023-09-30T22:33:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.626+0000 7f15cb8cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15c412da20 con 0x7f15c412f8b0 2023-09-30T22:33:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.626+0000 7f15c9e6a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c4130260 0x7f15c4131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.626+0000 7f15c9e6a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c4130260 0x7f15c4131460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34446/0 (socket says 172.21.15.59:34446) 2023-09-30T22:33:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.626+0000 7f15c9e6a700 1 -- 172.21.15.59:0/931021026 learned_addr learned my addr 172.21.15.59:0/931021026 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.626+0000 7f15c9669700 1 --2- 172.21.15.59:0/931021026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c412cf60 0x7f15c41309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.626+0000 7f15c9e6a700 1 -- 172.21.15.59:0/931021026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15c412f8b0 msgr2=0x7f15c4130f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.626+0000 7f15c9e6a700 1 --2- 172.21.15.59:0/931021026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15c412f8b0 0x7f15c4130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.626+0000 7f15c9e6a700 1 -- 172.21.15.59:0/931021026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c412cf60 msgr2=0x7f15c41309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.626+0000 7f15c9e6a700 1 --2- 172.21.15.59:0/931021026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c412cf60 0x7f15c41309e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.626+0000 7f15c9e6a700 1 -- 172.21.15.59:0/931021026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b4009550 con 0x7f15c4130260 2023-09-30T22:33:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.627+0000 7f15c9e6a700 1 --2- 172.21.15.59:0/931021026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c4130260 0x7f15c4131460 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00cc80 tx=0x7f15bc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.627+0000 7f15b9ffb700 1 -- 172.21.15.59:0/931021026 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc003c00 con 0x7f15c4130260 2023-09-30T22:33:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.627+0000 7f15b9ffb700 1 -- 172.21.15.59:0/931021026 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc003d60 con 0x7f15c4130260 2023-09-30T22:33:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.627+0000 7f15b9ffb700 1 -- 172.21.15.59:0/931021026 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc00ab50 con 0x7f15c4130260 2023-09-30T22:33:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.627+0000 7f15cb8cd700 1 -- 172.21.15.59:0/931021026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c4129fa0 con 0x7f15c4130260 2023-09-30T22:33:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.627+0000 7f15cb8cd700 1 -- 172.21.15.59:0/931021026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c409e120 con 0x7f15c4130260 2023-09-30T22:33:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.628+0000 7f15b9ffb700 1 -- 172.21.15.59:0/931021026 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15bc00acb0 con 0x7f15c4130260 2023-09-30T22:33:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.628+0000 7f15b9ffb700 1 -- 172.21.15.59:0/931021026 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f15bc011540 con 0x7f15c4130260 2023-09-30T22:33:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.629+0000 7f15cb8cd700 1 -- 172.21.15.59:0/931021026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c4074ea0 con 0x7f15c4130260 2023-09-30T22:33:04.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.634+0000 7f15b9ffb700 1 -- 172.21.15.59:0/931021026 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15bc044060 con 0x7f15c4130260 2023-09-30T22:33:04.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.817+0000 7f19e4f37700 1 -- 172.21.15.59:0/1830786271 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f19e006c360 con 0x7f19e009e410 2023-09-30T22:33:04.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.818+0000 7f19ceffd700 1 -- 172.21.15.59:0/1830786271 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19d80243b0 con 0x7f19e009e410 2023-09-30T22:33:04.818 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:04.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.820+0000 7f19e4f37700 1 -- 172.21.15.59:0/1830786271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e009e410 msgr2=0x7f19e01a6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.820+0000 7f19e4f37700 1 --2- 172.21.15.59:0/1830786271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e009e410 0x7f19e01a6a00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f19d8015000 tx=0x7f19d8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.820+0000 7f19e4f37700 1 -- 172.21.15.59:0/1830786271 shutdown_connections 2023-09-30T22:33:04.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.820+0000 7f19e4f37700 1 --2- 172.21.15.59:0/1830786271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e009e410 0x7f19e01a6a00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.820+0000 7f19e4f37700 1 --2- 172.21.15.59:0/1830786271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e009d6f0 0x7f19e01a5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.820+0000 7f19e4f37700 1 --2- 172.21.15.59:0/1830786271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e009e000 0x7f19e01a64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.820+0000 7f19e4f37700 1 -- 172.21.15.59:0/1830786271 >> 172.21.15.59:0/1830786271 conn(0x7f19e0066f50 msgr2=0x7f19e01baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:04.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.821+0000 7f19e4f37700 1 -- 172.21.15.59:0/1830786271 shutdown_connections 2023-09-30T22:33:04.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.821+0000 7f19e4f37700 1 -- 172.21.15.59:0/1830786271 wait complete. 2023-09-30T22:33:04.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:04.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.849+0000 7fabd2294700 1 -- 172.21.15.59:0/1650600352 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fabcc09ca30 con 0x7fabcc1c9310 2023-09-30T22:33:04.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.849+0000 7fabc8ff9700 1 -- 172.21.15.59:0/1650600352 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabc4019030 con 0x7fabcc1c9310 2023-09-30T22:33:04.850 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:04.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.851+0000 7fe644a5b700 1 -- 172.21.15.59:0/2511591696 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe64009ace0 con 0x7fe64009d6f0 2023-09-30T22:33:04.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.852+0000 7fe62effd700 1 -- 172.21.15.59:0/2511591696 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe63001b430 con 0x7fe64009d6f0 2023-09-30T22:33:04.852 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.852+0000 7fabd2294700 1 -- 172.21.15.59:0/1650600352 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabcc1c9310 msgr2=0x7fabcc1c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.852+0000 7fabd2294700 1 --2- 172.21.15.59:0/1650600352 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabcc1c9310 0x7fabcc1c5470 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fabc400b9e0 tx=0x7fabc400bcf0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.852+0000 7fabd2294700 1 -- 172.21.15.59:0/1650600352 shutdown_connections 2023-09-30T22:33:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.852+0000 7fabd2294700 1 --2- 172.21.15.59:0/1650600352 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabcc1c9310 0x7fabcc1c5470 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.852+0000 7fabd2294700 1 --2- 172.21.15.59:0/1650600352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabcc09e000 0x7fabcc1c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.852+0000 7fabd2294700 1 --2- 172.21.15.59:0/1650600352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabcc09e410 0x7fabcc1c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.852+0000 7fabd2294700 1 -- 172.21.15.59:0/1650600352 >> 172.21.15.59:0/1650600352 conn(0x7fabcc066f50 msgr2=0x7fabcc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.853+0000 7fabd2294700 1 -- 172.21.15.59:0/1650600352 shutdown_connections 2023-09-30T22:33:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.853+0000 7fabd2294700 1 -- 172.21.15.59:0/1650600352 wait complete. 2023-09-30T22:33:04.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.854+0000 7fe644a5b700 1 -- 172.21.15.59:0/2511591696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64009d6f0 msgr2=0x7fe640122530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.854+0000 7fe644a5b700 1 --2- 172.21.15.59:0/2511591696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64009d6f0 0x7fe640122530 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe630000c00 tx=0x7fe630004750 comp rx=0 tx=0).stop 2023-09-30T22:33:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.858+0000 7fe644a5b700 1 -- 172.21.15.59:0/2511591696 shutdown_connections 2023-09-30T22:33:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.858+0000 7fe644a5b700 1 --2- 172.21.15.59:0/2511591696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64009e410 0x7fe640122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.858+0000 7fe644a5b700 1 --2- 172.21.15.59:0/2511591696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64009d6f0 0x7fe640122530 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.858+0000 7fe644a5b700 1 --2- 172.21.15.59:0/2511591696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64009e000 0x7fe640122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.858+0000 7fe644a5b700 1 -- 172.21.15.59:0/2511591696 >> 172.21.15.59:0/2511591696 conn(0x7fe640066f50 msgr2=0x7fe6400a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.858+0000 7fe644a5b700 1 -- 172.21.15.59:0/2511591696 shutdown_connections 2023-09-30T22:33:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.858+0000 7fe644a5b700 1 -- 172.21.15.59:0/2511591696 wait complete. 2023-09-30T22:33:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.859+0000 7f15cb8cd700 1 -- 172.21.15.59:0/931021026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f15c4067d40 con 0x7f15c4130260 2023-09-30T22:33:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.859+0000 7f15b9ffb700 1 -- 172.21.15.59:0/931021026 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15bc0198f0 con 0x7f15c4130260 2023-09-30T22:33:04.859 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:04.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.863+0000 7f15cb8cd700 1 -- 172.21.15.59:0/931021026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c4130260 msgr2=0x7f15c4131460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:04.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.863+0000 7f15cb8cd700 1 --2- 172.21.15.59:0/931021026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c4130260 0x7f15c4131460 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00cc80 tx=0x7f15bc00cf90 comp rx=0 tx=0).stop 2023-09-30T22:33:04.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.863+0000 7f15cb8cd700 1 -- 172.21.15.59:0/931021026 shutdown_connections 2023-09-30T22:33:04.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.863+0000 7f15cb8cd700 1 --2- 172.21.15.59:0/931021026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c4130260 0x7f15c4131460 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.863+0000 7f15cb8cd700 1 --2- 172.21.15.59:0/931021026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c412cf60 0x7f15c41309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.863+0000 7f15cb8cd700 1 --2- 172.21.15.59:0/931021026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15c412f8b0 0x7f15c4130f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:04.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.863+0000 7f15cb8cd700 1 -- 172.21.15.59:0/931021026 >> 172.21.15.59:0/931021026 conn(0x7f15c40a2aa0 msgr2=0x7f15c412a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:04.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.863+0000 7f15cb8cd700 1 -- 172.21.15.59:0/931021026 shutdown_connections 2023-09-30T22:33:04.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:04.863+0000 7f15cb8cd700 1 -- 172.21.15.59:0/931021026 wait complete. 2023-09-30T22:33:04.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:04.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:04.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:05.836 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:05.868 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:05.880 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:05.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:05.998+0000 7fe068c79700 1 Processor -- start 2023-09-30T22:33:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:05.998+0000 7fe068c79700 1 -- start start 2023-09-30T22:33:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:05.999+0000 7fe068c79700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe064134630 0x7fe064136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:05.999+0000 7fe068c79700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe064136f50 0x7fe064139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:05.999+0000 7fe068c79700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe06409b4f0 con 0x7fe064131810 2023-09-30T22:33:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:05.999+0000 7fe068c79700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0641313c0 con 0x7fe064136f50 2023-09-30T22:33:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:05.999+0000 7fe068c79700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe06406e8c0 con 0x7fe064134630 2023-09-30T22:33:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:05.999+0000 7fe061d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe064134630 0x7fe064136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.000+0000 7fe061d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe064134630 0x7fe064136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51880/0 (socket says 172.21.15.59:51880) 2023-09-30T22:33:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.000+0000 7fe061d9b700 1 -- 172.21.15.59:0/2176050946 learned_addr learned my addr 172.21.15.59:0/2176050946 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.000+0000 7fe062d9d700 1 --2- 172.21.15.59:0/2176050946 >> v2:172.21.15.59:3300/0 conn(0x7fe064136f50 0x7fe064139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.000+0000 7fe061d9b700 1 -- 172.21.15.59:0/2176050946 >> v2:172.21.15.59:3300/0 conn(0x7fe064136f50 msgr2=0x7fe064139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.000+0000 7fe061d9b700 1 --2- 172.21.15.59:0/2176050946 >> v2:172.21.15.59:3300/0 conn(0x7fe064136f50 0x7fe064139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.000+0000 7fe061d9b700 1 -- 172.21.15.59:0/2176050946 >> v1:172.21.15.59:6789/0 conn(0x7fe064131810 legacy=0x7fe064131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.000+0000 7fe061d9b700 1 -- 172.21.15.59:0/2176050946 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe064071d20 con 0x7fe064134630 2023-09-30T22:33:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.000+0000 7fe062d9d700 1 --2- 172.21.15.59:0/2176050946 >> v2:172.21.15.59:3300/0 conn(0x7fe064136f50 0x7fe064139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.000+0000 7fe061d9b700 1 --2- 172.21.15.59:0/2176050946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe064134630 0x7fe064136a10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe0580098f0 tx=0x7fe058009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ead9331e87f52559 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:06.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.000+0000 7fe06159a700 1 -- 172.21.15.59:0/2176050946 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058011830 con 0x7fe064134630 2023-09-30T22:33:06.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.001+0000 7fe06159a700 1 -- 172.21.15.59:0/2176050946 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe058011990 con 0x7fe064134630 2023-09-30T22:33:06.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.001+0000 7fe06159a700 1 -- 172.21.15.59:0/2176050946 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058011d20 con 0x7fe064134630 2023-09-30T22:33:06.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.002+0000 7fe068c79700 1 -- 172.21.15.59:0/2176050946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe064134630 msgr2=0x7fe064136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.002+0000 7fe068c79700 1 --2- 172.21.15.59:0/2176050946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe064134630 0x7fe064136a10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe0580098f0 tx=0x7fe058009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:06.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.002+0000 7fe068c79700 1 -- 172.21.15.59:0/2176050946 shutdown_connections 2023-09-30T22:33:06.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.002+0000 7fe068c79700 1 --2- 172.21.15.59:0/2176050946 >> v2:172.21.15.59:3300/0 conn(0x7fe064136f50 0x7fe064139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.002+0000 7fe068c79700 1 --2- 172.21.15.59:0/2176050946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe064134630 0x7fe064136a10 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.002+0000 7fe068c79700 1 -- 172.21.15.59:0/2176050946 >> 172.21.15.59:0/2176050946 conn(0x7fe0640a2aa0 msgr2=0x7fe0640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:06.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.002+0000 7fe068c79700 1 -- 172.21.15.59:0/2176050946 shutdown_connections 2023-09-30T22:33:06.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.002+0000 7fe068c79700 1 -- 172.21.15.59:0/2176050946 wait complete. 2023-09-30T22:33:06.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.003+0000 7fe068c79700 1 Processor -- start 2023-09-30T22:33:06.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.004+0000 7fe068c79700 1 -- start start 2023-09-30T22:33:06.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.004+0000 7fe068c79700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe064131810 0x7fe0641c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.004+0000 7fe068c79700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe064134630 0x7fe0641c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.004+0000 7fe068c79700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe064136f50 0x7fe064118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.004+0000 7fe068c79700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0641bc030 con 0x7fe064134630 2023-09-30T22:33:06.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.004+0000 7fe068c79700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06411c4a0 con 0x7fe064131810 2023-09-30T22:33:06.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.004+0000 7fe068c79700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640a2100 con 0x7fe064136f50 2023-09-30T22:33:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.005+0000 7fe061d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe064134630 0x7fe0641c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.005+0000 7fe061d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe064134630 0x7fe0641c6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34464/0 (socket says 172.21.15.59:34464) 2023-09-30T22:33:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.005+0000 7fe061d9b700 1 -- 172.21.15.59:0/1259847786 learned_addr learned my addr 172.21.15.59:0/1259847786 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.005+0000 7fe062d9d700 1 --2- 172.21.15.59:0/1259847786 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe064136f50 0x7fe064118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.005+0000 7fe06259c700 1 --2- 172.21.15.59:0/1259847786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe064131810 0x7fe0641c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.005+0000 7fe061d9b700 1 -- 172.21.15.59:0/1259847786 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe064136f50 msgr2=0x7fe064118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.005+0000 7fe061d9b700 1 --2- 172.21.15.59:0/1259847786 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe064136f50 0x7fe064118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.005+0000 7fe061d9b700 1 -- 172.21.15.59:0/1259847786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe064131810 msgr2=0x7fe0641c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.005+0000 7fe061d9b700 1 --2- 172.21.15.59:0/1259847786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe064131810 0x7fe0641c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.005+0000 7fe061d9b700 1 -- 172.21.15.59:0/1259847786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c009a70 con 0x7fe064134630 2023-09-30T22:33:06.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.005+0000 7fe061d9b700 1 --2- 172.21.15.59:0/1259847786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe064134630 0x7fe0641c6930 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe058000c00 tx=0x7fe058004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:06.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.005+0000 7fe052ffd700 1 -- 172.21.15.59:0/1259847786 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0580036a0 con 0x7fe064134630 2023-09-30T22:33:06.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.006+0000 7fe052ffd700 1 -- 172.21.15.59:0/1259847786 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe058003800 con 0x7fe064134630 2023-09-30T22:33:06.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.006+0000 7fe068c79700 1 -- 172.21.15.59:0/1259847786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe058009550 con 0x7fe064134630 2023-09-30T22:33:06.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.006+0000 7fe052ffd700 1 -- 172.21.15.59:0/1259847786 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058003bb0 con 0x7fe064134630 2023-09-30T22:33:06.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.006+0000 7fe068c79700 1 -- 172.21.15.59:0/1259847786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe06411b060 con 0x7fe064134630 2023-09-30T22:33:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.007+0000 7fe050ff9700 1 -- 172.21.15.59:0/1259847786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03c0052e0 con 0x7fe064134630 2023-09-30T22:33:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.007+0000 7fe052ffd700 1 -- 172.21.15.59:0/1259847786 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe058021070 con 0x7fe064134630 2023-09-30T22:33:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.008+0000 7fe052ffd700 1 -- 172.21.15.59:0/1259847786 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe058040b20 con 0x7fe064134630 2023-09-30T22:33:06.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.013+0000 7fe052ffd700 1 -- 172.21.15.59:0/1259847786 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe058010380 con 0x7fe064134630 2023-09-30T22:33:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.034+0000 7fa8d6470700 1 Processor -- start 2023-09-30T22:33:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.034+0000 7fa8d6470700 1 -- start start 2023-09-30T22:33:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.035+0000 7fa8d6470700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8d012cf60 0x7fa8d006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.035+0000 7fa8d6470700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa8d012f8b0 0x7fa8d012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.035+0000 7fa8d6470700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8d0130260 0x7fa8d0136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.035+0000 7fa8d6470700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d012d330 con 0x7fa8d012f8b0 2023-09-30T22:33:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.035+0000 7fa8d6470700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d012cd90 con 0x7fa8d0130260 2023-09-30T22:33:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.035+0000 7fa8d6470700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d01306d0 con 0x7fa8d012cf60 2023-09-30T22:33:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.035+0000 7fa8cffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8d012cf60 0x7fa8d006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.035+0000 7fa8d4a0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8d0130260 0x7fa8d0136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7fa8cffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8d012cf60 0x7fa8d006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51902/0 (socket says 172.21.15.59:51902) 2023-09-30T22:33:06.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7fa8cffff700 1 -- 172.21.15.59:0/2066387466 learned_addr learned my addr 172.21.15.59:0/2066387466 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:06.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7ff30f10f700 1 Processor -- start 2023-09-30T22:33:06.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7fa8cf7fe700 1 --2- 172.21.15.59:0/2066387466 >> v2:172.21.15.59:3300/0 conn(0x7fa8d012f8b0 0x7fa8d012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7fa8d4a0d700 1 -- 172.21.15.59:0/2066387466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8d012cf60 msgr2=0x7fa8d006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7fa8d4a0d700 1 --2- 172.21.15.59:0/2066387466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8d012cf60 0x7fa8d006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7fa8d4a0d700 1 -- 172.21.15.59:0/2066387466 >> v2:172.21.15.59:3300/0 conn(0x7fa8d012f8b0 msgr2=0x7fa8d012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7fa8d4a0d700 1 --2- 172.21.15.59:0/2066387466 >> v2:172.21.15.59:3300/0 conn(0x7fa8d012f8b0 0x7fa8d012fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7fa8d4a0d700 1 -- 172.21.15.59:0/2066387466 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d0071780 con 0x7fa8d0130260 2023-09-30T22:33:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7fa8d4a0d700 1 --2- 172.21.15.59:0/2066387466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8d0130260 0x7fa8d0136c20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009e10 tx=0x7fa8c800f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f27a3a9fa3585b76 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7ff30f10f700 1 -- start start 2023-09-30T22:33:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7ff30f10f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3080a0a30 0x7ff3080a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7ff30f10f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff30813d820 0x7ff30813fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7ff30f10f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30809d920 con 0x7ff3080a1340 2023-09-30T22:33:06.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7ff30f10f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff30809d020 con 0x7ff30813d820 2023-09-30T22:33:06.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7ff30f10f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3080a2010 con 0x7ff3080a0a30 2023-09-30T22:33:06.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7ff307fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff3080a1340 0x7ff30813c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57096/0 (socket says 172.21.15.59:57096) 2023-09-30T22:33:06.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.036+0000 7ff307fff700 1 -- 172.21.15.59:0/4051220313 learned_addr learned my addr 172.21.15.59:0/4051220313 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:06.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.037+0000 7ff30d6ac700 1 --2- 172.21.15.59:0/4051220313 >> v2:172.21.15.59:3300/0 conn(0x7ff30813d820 0x7ff30813fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.037+0000 7ff30ceab700 1 --2- 172.21.15.59:0/4051220313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3080a0a30 0x7ff3080a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.037+0000 7fa8ceffd700 1 -- 172.21.15.59:0/2066387466 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8009ea0 con 0x7fa8d0130260 2023-09-30T22:33:06.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.037+0000 7fa8ceffd700 1 -- 172.21.15.59:0/2066387466 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c800f2d0 con 0x7fa8d0130260 2023-09-30T22:33:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.037+0000 7fa8ceffd700 1 -- 172.21.15.59:0/2066387466 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8018a70 con 0x7fa8d0130260 2023-09-30T22:33:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.037+0000 7ff30d6ac700 1 -- 172.21.15.59:0/4051220313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3080a0a30 msgr2=0x7ff3080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.037+0000 7ff30d6ac700 1 --2- 172.21.15.59:0/4051220313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3080a0a30 0x7ff3080a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.037+0000 7ff30d6ac700 1 -- 172.21.15.59:0/4051220313 >> v1:172.21.15.59:6789/0 conn(0x7ff3080a1340 legacy=0x7ff30813c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.037+0000 7ff30d6ac700 1 -- 172.21.15.59:0/4051220313 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30809dbe0 con 0x7ff30813d820 2023-09-30T22:33:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.037+0000 7ff30ceab700 1 --2- 172.21.15.59:0/4051220313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3080a0a30 0x7ff3080a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.037+0000 7ff30d6ac700 1 --2- 172.21.15.59:0/4051220313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30813d820 0x7ff30813fc00 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff300009d90 tx=0x7ff30000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29503bd27fceb006 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.038+0000 7fa8d6470700 1 -- 172.21.15.59:0/2066387466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8d0130260 msgr2=0x7fa8d0136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.038+0000 7fa8d6470700 1 --2- 172.21.15.59:0/2066387466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8d0130260 0x7fa8d0136c20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009e10 tx=0x7fa8c800f740 comp rx=0 tx=0).stop 2023-09-30T22:33:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.038+0000 7ff3077fe700 1 -- 172.21.15.59:0/4051220313 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30000e070 con 0x7ff30813d820 2023-09-30T22:33:06.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.038+0000 7fa8d6470700 1 -- 172.21.15.59:0/2066387466 shutdown_connections 2023-09-30T22:33:06.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.038+0000 7fa8d6470700 1 --2- 172.21.15.59:0/2066387466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8d0130260 0x7fa8d0136c20 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.038+0000 7fa8d6470700 1 --2- 172.21.15.59:0/2066387466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8d012cf60 0x7fa8d006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.038+0000 7fa8d6470700 1 --2- 172.21.15.59:0/2066387466 >> v2:172.21.15.59:3300/0 conn(0x7fa8d012f8b0 0x7fa8d012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.038+0000 7fa8d6470700 1 -- 172.21.15.59:0/2066387466 >> 172.21.15.59:0/2066387466 conn(0x7fa8d00a2aa0 msgr2=0x7fa8d00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:06.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.038+0000 7fa8d6470700 1 -- 172.21.15.59:0/2066387466 shutdown_connections 2023-09-30T22:33:06.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.039+0000 7fa8d6470700 1 -- 172.21.15.59:0/2066387466 wait complete. 2023-09-30T22:33:06.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.038+0000 7ff3077fe700 1 -- 172.21.15.59:0/4051220313 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30000bae0 con 0x7ff30813d820 2023-09-30T22:33:06.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.038+0000 7ff3077fe700 1 -- 172.21.15.59:0/4051220313 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30000be90 con 0x7ff30813d820 2023-09-30T22:33:06.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.039+0000 7ff30f10f700 1 -- 172.21.15.59:0/4051220313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30813d820 msgr2=0x7ff30813fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.039+0000 7ff30f10f700 1 --2- 172.21.15.59:0/4051220313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30813d820 0x7ff30813fc00 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff300009d90 tx=0x7ff30000b330 comp rx=0 tx=0).stop 2023-09-30T22:33:06.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.039+0000 7ff30f10f700 1 -- 172.21.15.59:0/4051220313 shutdown_connections 2023-09-30T22:33:06.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.039+0000 7ff30f10f700 1 --2- 172.21.15.59:0/4051220313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff30813d820 0x7ff30813fc00 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.039+0000 7ff30f10f700 1 --2- 172.21.15.59:0/4051220313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3080a0a30 0x7ff3080a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.039+0000 7ff30f10f700 1 -- 172.21.15.59:0/4051220313 >> 172.21.15.59:0/4051220313 conn(0x7ff3080a6550 msgr2=0x7ff3080a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:06.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.039+0000 7ff30f10f700 1 -- 172.21.15.59:0/4051220313 shutdown_connections 2023-09-30T22:33:06.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.040+0000 7fa8d6470700 1 Processor -- start 2023-09-30T22:33:06.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.040+0000 7fa8d6470700 1 -- start start 2023-09-30T22:33:06.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.039+0000 7ff30f10f700 1 -- 172.21.15.59:0/4051220313 wait complete. 2023-09-30T22:33:06.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.040+0000 7ff30f10f700 1 Processor -- start 2023-09-30T22:33:06.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8d6470700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8d012cf60 0x7fa8d009ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8d6470700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8d012f8b0 0x7fa8d009bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8d6470700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8d0130260 0x7fa8d01c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8d6470700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d009b540 con 0x7fa8d012f8b0 2023-09-30T22:33:06.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8d6470700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d009c4b0 con 0x7fa8d012cf60 2023-09-30T22:33:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8d6470700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d009e540 con 0x7fa8d0130260 2023-09-30T22:33:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8cffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8d012cf60 0x7fa8d009ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8cffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8d012cf60 0x7fa8d009ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35388/0 (socket says 172.21.15.59:35388) 2023-09-30T22:33:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8cffff700 1 -- 172.21.15.59:0/1487408251 learned_addr learned my addr 172.21.15.59:0/1487408251 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8d4a0d700 1 --2- 172.21.15.59:0/1487408251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8d0130260 0x7fa8d01c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8d4a0d700 1 -- 172.21.15.59:0/1487408251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8d012cf60 msgr2=0x7fa8d009ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8d4a0d700 1 --2- 172.21.15.59:0/1487408251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8d012cf60 0x7fa8d009ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8d4a0d700 1 -- 172.21.15.59:0/1487408251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8d012f8b0 msgr2=0x7fa8d009bf70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:33:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8d4a0d700 1 --2- 172.21.15.59:0/1487408251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8d012f8b0 0x7fa8d009bf70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8d4a0d700 1 -- 172.21.15.59:0/1487408251 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8009a70 con 0x7fa8d0130260 2023-09-30T22:33:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.041+0000 7fa8cffff700 1 --2- 172.21.15.59:0/1487408251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8d012cf60 0x7fa8d009ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.042+0000 7fa8d4a0d700 1 --2- 172.21.15.59:0/1487408251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8d0130260 0x7fa8d01c3db0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009e10 tx=0x7fa8c8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:06.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.042+0000 7ff30f10f700 1 -- start start 2023-09-30T22:33:06.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.042+0000 7ff30f10f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3080a0a30 0x7ff30813cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.042+0000 7ff30f10f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3080a1340 0x7ff30813d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.042+0000 7ff30f10f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30813d820 0x7ff30813b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.042+0000 7ff30f10f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30811faf0 con 0x7ff3080a0a30 2023-09-30T22:33:06.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.042+0000 7ff30f10f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30811f110 con 0x7ff3080a1340 2023-09-30T22:33:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.043+0000 7fa8ccff9700 1 -- 172.21.15.59:0/1487408251 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8009ea0 con 0x7fa8d0130260 2023-09-30T22:33:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.042+0000 7ff30f10f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff30811e450 con 0x7ff30813d820 2023-09-30T22:33:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.042+0000 7ff30d6ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30813d820 0x7ff30813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.042+0000 7ff30d6ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30813d820 0x7ff30813b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51938/0 (socket says 172.21.15.59:51938) 2023-09-30T22:33:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.042+0000 7ff30d6ac700 1 -- 172.21.15.59:0/4005072194 learned_addr learned my addr 172.21.15.59:0/4005072194 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.042+0000 7ff30ceab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3080a0a30 0x7ff30813cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.042+0000 7ff307fff700 1 --2- 172.21.15.59:0/4005072194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3080a1340 0x7ff30813d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.043+0000 7ff30d6ac700 1 -- 172.21.15.59:0/4005072194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3080a1340 msgr2=0x7ff30813d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.043+0000 7ff30d6ac700 1 --2- 172.21.15.59:0/4005072194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3080a1340 0x7ff30813d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.043+0000 7ff30d6ac700 1 -- 172.21.15.59:0/4005072194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3080a0a30 msgr2=0x7ff30813cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.043+0000 7ff30d6ac700 1 --2- 172.21.15.59:0/4005072194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3080a0a30 0x7ff30813cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.043+0000 7ff30d6ac700 1 -- 172.21.15.59:0/4005072194 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc0094a0 con 0x7ff30813d820 2023-09-30T22:33:06.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.043+0000 7ff30ceab700 1 --2- 172.21.15.59:0/4005072194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3080a0a30 0x7ff30813cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:06.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.043+0000 7ff30d6ac700 1 --2- 172.21.15.59:0/4005072194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30813d820 0x7ff30813b780 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff300004000 tx=0x7ff300004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:06.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.043+0000 7fa8ccff9700 1 -- 172.21.15.59:0/1487408251 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c8003e30 con 0x7fa8d0130260 2023-09-30T22:33:06.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.043+0000 7fa8d6470700 1 -- 172.21.15.59:0/1487408251 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d009ebe0 con 0x7fa8d0130260 2023-09-30T22:33:06.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.043+0000 7fa8ccff9700 1 -- 172.21.15.59:0/1487408251 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8024af0 con 0x7fa8d0130260 2023-09-30T22:33:06.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.043+0000 7fa8d6470700 1 -- 172.21.15.59:0/1487408251 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d0129fa0 con 0x7fa8d0130260 2023-09-30T22:33:06.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.044+0000 7fa8ccff9700 1 -- 172.21.15.59:0/1487408251 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8c8024c50 con 0x7fa8d0130260 2023-09-30T22:33:06.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.044+0000 7fa8d6470700 1 -- 172.21.15.59:0/1487408251 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d009cc90 con 0x7fa8d0130260 2023-09-30T22:33:06.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.044+0000 7ff3057fa700 1 -- 172.21.15.59:0/4005072194 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300004540 con 0x7ff30813d820 2023-09-30T22:33:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.044+0000 7ff3057fa700 1 -- 172.21.15.59:0/4005072194 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3000046a0 con 0x7ff30813d820 2023-09-30T22:33:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.044+0000 7ff3057fa700 1 -- 172.21.15.59:0/4005072194 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300012430 con 0x7ff30813d820 2023-09-30T22:33:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.045+0000 7fa8ccff9700 1 -- 172.21.15.59:0/1487408251 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa8c8049410 con 0x7fa8d0130260 2023-09-30T22:33:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.044+0000 7ff30f10f700 1 -- 172.21.15.59:0/4005072194 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff300009a70 con 0x7ff30813d820 2023-09-30T22:33:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.045+0000 7ff30f10f700 1 -- 172.21.15.59:0/4005072194 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff308071590 con 0x7ff30813d820 2023-09-30T22:33:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.045+0000 7ff30f10f700 1 -- 172.21.15.59:0/4005072194 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff308071e20 con 0x7ff30813d820 2023-09-30T22:33:06.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.054+0000 7fa8ccff9700 1 -- 172.21.15.59:0/1487408251 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8c8004030 con 0x7fa8d0130260 2023-09-30T22:33:06.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.054+0000 7ff3057fa700 1 -- 172.21.15.59:0/4005072194 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff30003f430 con 0x7ff30813d820 2023-09-30T22:33:06.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.054+0000 7ff3057fa700 1 -- 172.21.15.59:0/4005072194 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff300063b40 con 0x7ff30813d820 2023-09-30T22:33:06.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.062+0000 7ff3057fa700 1 -- 172.21.15.59:0/4005072194 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff30003f6e0 con 0x7ff30813d820 2023-09-30T22:33:06.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.081+0000 7fe0dad69700 1 Processor -- start 2023-09-30T22:33:06.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.081+0000 7fe0dad69700 1 -- start start 2023-09-30T22:33:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.082+0000 7fe0dad69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0d409d6f0 0x7fe0d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.082+0000 7fe0dad69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0d409e410 0x7fe0d4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.082+0000 7fe0dad69700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d409b120 con 0x7fe0d409e000 2023-09-30T22:33:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.082+0000 7fe0dad69700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d406b460 con 0x7fe0d409d6f0 2023-09-30T22:33:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.082+0000 7fe0dad69700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d409a7e0 con 0x7fe0d409e410 2023-09-30T22:33:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.083+0000 7fe0d8b05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0d409d6f0 0x7fe0d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.083+0000 7fe0d8b05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0d409d6f0 0x7fe0d409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35400/0 (socket says 172.21.15.59:35400) 2023-09-30T22:33:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.083+0000 7fe0d8b05700 1 -- 172.21.15.59:0/3828905556 learned_addr learned my addr 172.21.15.59:0/3828905556 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.083+0000 7fe0d9306700 1 --2- 172.21.15.59:0/3828905556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0d409e410 0x7fe0d4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.083+0000 7fe0d8b05700 1 -- 172.21.15.59:0/3828905556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0d409e410 msgr2=0x7fe0d4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.083+0000 7fe0d8b05700 1 --2- 172.21.15.59:0/3828905556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0d409e410 0x7fe0d4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.083+0000 7fe0d8b05700 1 -- 172.21.15.59:0/3828905556 >> v1:172.21.15.59:6789/0 conn(0x7fe0d409e000 legacy=0x7fe0d41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.083+0000 7fe0d8b05700 1 -- 172.21.15.59:0/3828905556 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d409a500 con 0x7fe0d409d6f0 2023-09-30T22:33:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.083+0000 7fe0d9306700 1 --2- 172.21.15.59:0/3828905556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0d409e410 0x7fe0d4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.083+0000 7fe0d8b05700 1 --2- 172.21.15.59:0/3828905556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0d409d6f0 0x7fe0d409dac0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009920 tx=0x7fe0c8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e936d05c767b5198 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:06.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.083+0000 7fe0d37fe700 1 -- 172.21.15.59:0/3828905556 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8011830 con 0x7fe0d409d6f0 2023-09-30T22:33:06.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.084+0000 7fe0d37fe700 1 -- 172.21.15.59:0/3828905556 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c8011990 con 0x7fe0d409d6f0 2023-09-30T22:33:06.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.084+0000 7fe0d37fe700 1 -- 172.21.15.59:0/3828905556 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8011d20 con 0x7fe0d409d6f0 2023-09-30T22:33:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.084+0000 7fe0dad69700 1 -- 172.21.15.59:0/3828905556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0d409d6f0 msgr2=0x7fe0d409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.084+0000 7fe0dad69700 1 --2- 172.21.15.59:0/3828905556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0d409d6f0 0x7fe0d409dac0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009920 tx=0x7fe0c8009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.085+0000 7fe0dad69700 1 -- 172.21.15.59:0/3828905556 shutdown_connections 2023-09-30T22:33:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.085+0000 7fe0dad69700 1 --2- 172.21.15.59:0/3828905556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0d409e410 0x7fe0d4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.085+0000 7fe0dad69700 1 --2- 172.21.15.59:0/3828905556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0d409d6f0 0x7fe0d409dac0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.085+0000 7fe0dad69700 1 -- 172.21.15.59:0/3828905556 >> 172.21.15.59:0/3828905556 conn(0x7fe0d4066f50 msgr2=0x7fe0d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.085+0000 7fe0dad69700 1 -- 172.21.15.59:0/3828905556 shutdown_connections 2023-09-30T22:33:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.085+0000 7fe0dad69700 1 -- 172.21.15.59:0/3828905556 wait complete. 2023-09-30T22:33:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.086+0000 7fe0dad69700 1 Processor -- start 2023-09-30T22:33:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.086+0000 7fe0dad69700 1 -- start start 2023-09-30T22:33:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.087+0000 7fe0dad69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0d409d6f0 0x7fe0d4122600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.087+0000 7fe0dad69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0d409e000 0x7fe0d4122b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.087+0000 7fe0dad69700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0d409e410 0x7fe0d4123080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.087+0000 7fe0dad69700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d40a1e90 con 0x7fe0d409e410 2023-09-30T22:33:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.087+0000 7fe0dad69700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4124720 con 0x7fe0d409e000 2023-09-30T22:33:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.087+0000 7fe0dad69700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d409c710 con 0x7fe0d409d6f0 2023-09-30T22:33:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.087+0000 7fe0d3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0d409e000 0x7fe0d4122b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.087+0000 7fe0d3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0d409e000 0x7fe0d4122b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35412/0 (socket says 172.21.15.59:35412) 2023-09-30T22:33:06.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.087+0000 7fe0d3fff700 1 -- 172.21.15.59:0/2113283462 learned_addr learned my addr 172.21.15.59:0/2113283462 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:06.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.087+0000 7fe0d8b05700 1 --2- 172.21.15.59:0/2113283462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0d409d6f0 0x7fe0d4122600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.088+0000 7fe0d9306700 1 --2- 172.21.15.59:0/2113283462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0d409e410 0x7fe0d4123080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:06.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.088+0000 7fe0d3fff700 1 -- 172.21.15.59:0/2113283462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0d409d6f0 msgr2=0x7fe0d4122600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.088+0000 7fe0d3fff700 1 --2- 172.21.15.59:0/2113283462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0d409d6f0 0x7fe0d4122600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.088+0000 7fe0d3fff700 1 -- 172.21.15.59:0/2113283462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0d409e410 msgr2=0x7fe0d4123080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.088+0000 7fe0d3fff700 1 --2- 172.21.15.59:0/2113283462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0d409e410 0x7fe0d4123080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.088+0000 7fe0d3fff700 1 -- 172.21.15.59:0/2113283462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc009a70 con 0x7fe0d409e000 2023-09-30T22:33:06.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.088+0000 7fe0d3fff700 1 --2- 172.21.15.59:0/2113283462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0d409e000 0x7fe0d4122b40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000c4b0 tx=0x7fe0c000c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:06.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.088+0000 7fe0d17fa700 1 -- 172.21.15.59:0/2113283462 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00052d0 con 0x7fe0d409e000 2023-09-30T22:33:06.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.088+0000 7fe0d17fa700 1 -- 172.21.15.59:0/2113283462 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c0005430 con 0x7fe0d409e000 2023-09-30T22:33:06.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.088+0000 7fe0d17fa700 1 -- 172.21.15.59:0/2113283462 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00038a0 con 0x7fe0d409e000 2023-09-30T22:33:06.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.088+0000 7fe0dad69700 1 -- 172.21.15.59:0/2113283462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c8009550 con 0x7fe0d409e000 2023-09-30T22:33:06.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.089+0000 7fe0dad69700 1 -- 172.21.15.59:0/2113283462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d4125820 con 0x7fe0d409e000 2023-09-30T22:33:06.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.089+0000 7fe0dad69700 1 -- 172.21.15.59:0/2113283462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d4074ea0 con 0x7fe0d409e000 2023-09-30T22:33:06.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.089+0000 7fe0d17fa700 1 -- 172.21.15.59:0/2113283462 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe0c0003a00 con 0x7fe0d409e000 2023-09-30T22:33:06.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.090+0000 7fe0d17fa700 1 -- 172.21.15.59:0/2113283462 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe0c003ea30 con 0x7fe0d409e000 2023-09-30T22:33:06.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.099+0000 7fe0d17fa700 1 -- 172.21.15.59:0/2113283462 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0c0018260 con 0x7fe0d409e000 2023-09-30T22:33:06.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.225+0000 7fe050ff9700 1 -- 172.21.15.59:0/1259847786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe03c005590 con 0x7fe064134630 2023-09-30T22:33:06.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.226+0000 7fe052ffd700 1 -- 172.21.15.59:0/1259847786 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe05802cb80 con 0x7fe064134630 2023-09-30T22:33:06.226 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:06.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.228+0000 7fe050ff9700 1 -- 172.21.15.59:0/1259847786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe064134630 msgr2=0x7fe0641c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.228+0000 7fe050ff9700 1 --2- 172.21.15.59:0/1259847786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe064134630 0x7fe0641c6930 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe058000c00 tx=0x7fe058004750 comp rx=0 tx=0).stop 2023-09-30T22:33:06.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.228+0000 7fe050ff9700 1 -- 172.21.15.59:0/1259847786 shutdown_connections 2023-09-30T22:33:06.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.228+0000 7fe050ff9700 1 --2- 172.21.15.59:0/1259847786 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe064136f50 0x7fe064118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.228+0000 7fe050ff9700 1 --2- 172.21.15.59:0/1259847786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe064131810 0x7fe0641c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.228+0000 7fe050ff9700 1 --2- 172.21.15.59:0/1259847786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe064134630 0x7fe0641c6930 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.228+0000 7fe050ff9700 1 -- 172.21.15.59:0/1259847786 >> 172.21.15.59:0/1259847786 conn(0x7fe0640a2aa0 msgr2=0x7fe06409f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:06.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.228+0000 7fe050ff9700 1 -- 172.21.15.59:0/1259847786 shutdown_connections 2023-09-30T22:33:06.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.228+0000 7fe050ff9700 1 -- 172.21.15.59:0/1259847786 wait complete. 2023-09-30T22:33:06.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:06.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.263+0000 7fa8d6470700 1 -- 172.21.15.59:0/1487408251 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa8d0074ea0 con 0x7fa8d0130260 2023-09-30T22:33:06.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.264+0000 7fa8ccff9700 1 -- 172.21.15.59:0/1487408251 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8c8032030 con 0x7fa8d0130260 2023-09-30T22:33:06.264 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.266+0000 7fa8d6470700 1 -- 172.21.15.59:0/1487408251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8d0130260 msgr2=0x7fa8d01c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.266+0000 7fa8d6470700 1 --2- 172.21.15.59:0/1487408251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8d0130260 0x7fa8d01c3db0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009e10 tx=0x7fa8c8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.266+0000 7fa8d6470700 1 -- 172.21.15.59:0/1487408251 shutdown_connections 2023-09-30T22:33:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.266+0000 7fa8d6470700 1 --2- 172.21.15.59:0/1487408251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8d0130260 0x7fa8d01c3db0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.266+0000 7fa8d6470700 1 --2- 172.21.15.59:0/1487408251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8d012cf60 0x7fa8d009ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.266+0000 7fa8d6470700 1 --2- 172.21.15.59:0/1487408251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8d012f8b0 0x7fa8d009bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.266+0000 7fa8d6470700 1 -- 172.21.15.59:0/1487408251 >> 172.21.15.59:0/1487408251 conn(0x7fa8d00a2aa0 msgr2=0x7fa8d01b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.266+0000 7fa8d6470700 1 -- 172.21.15.59:0/1487408251 shutdown_connections 2023-09-30T22:33:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.266+0000 7fa8d6470700 1 -- 172.21.15.59:0/1487408251 wait complete. 2023-09-30T22:33:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.275+0000 7ff30f10f700 1 -- 172.21.15.59:0/4005072194 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff3080a1750 con 0x7ff30813d820 2023-09-30T22:33:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.275+0000 7ff3057fa700 1 -- 172.21.15.59:0/4005072194 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff3080a1750 con 0x7ff30813d820 2023-09-30T22:33:06.276 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.278+0000 7ff30f10f700 1 -- 172.21.15.59:0/4005072194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30813d820 msgr2=0x7ff30813b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.278+0000 7ff30f10f700 1 --2- 172.21.15.59:0/4005072194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30813d820 0x7ff30813b780 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff300004000 tx=0x7ff300004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.278+0000 7ff30f10f700 1 -- 172.21.15.59:0/4005072194 shutdown_connections 2023-09-30T22:33:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.278+0000 7ff30f10f700 1 --2- 172.21.15.59:0/4005072194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff30813d820 0x7ff30813b780 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.278+0000 7ff30f10f700 1 --2- 172.21.15.59:0/4005072194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3080a0a30 0x7ff30813cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.278+0000 7ff30f10f700 1 --2- 172.21.15.59:0/4005072194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3080a1340 0x7ff30813d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.278+0000 7ff30f10f700 1 -- 172.21.15.59:0/4005072194 >> 172.21.15.59:0/4005072194 conn(0x7ff3080a6550 msgr2=0x7ff3080a4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.278+0000 7ff30f10f700 1 -- 172.21.15.59:0/4005072194 shutdown_connections 2023-09-30T22:33:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.278+0000 7ff30f10f700 1 -- 172.21.15.59:0/4005072194 wait complete. 2023-09-30T22:33:06.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:06.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:06.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.306+0000 7fe0dad69700 1 -- 172.21.15.59:0/2113283462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe0d406c360 con 0x7fe0d409e000 2023-09-30T22:33:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.307+0000 7fe0d17fa700 1 -- 172.21.15.59:0/2113283462 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0c0017030 con 0x7fe0d409e000 2023-09-30T22:33:06.307 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.309+0000 7fe0dad69700 1 -- 172.21.15.59:0/2113283462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0d409e000 msgr2=0x7fe0d4122b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.309+0000 7fe0dad69700 1 --2- 172.21.15.59:0/2113283462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0d409e000 0x7fe0d4122b40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000c4b0 tx=0x7fe0c000c7c0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.309+0000 7fe0dad69700 1 -- 172.21.15.59:0/2113283462 shutdown_connections 2023-09-30T22:33:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.309+0000 7fe0dad69700 1 --2- 172.21.15.59:0/2113283462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0d409d6f0 0x7fe0d4122600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.309+0000 7fe0dad69700 1 --2- 172.21.15.59:0/2113283462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0d409e410 0x7fe0d4123080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.309+0000 7fe0dad69700 1 --2- 172.21.15.59:0/2113283462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0d409e000 0x7fe0d4122b40 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:06.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.309+0000 7fe0dad69700 1 -- 172.21.15.59:0/2113283462 >> 172.21.15.59:0/2113283462 conn(0x7fe0d4066f50 msgr2=0x7fe0d406f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:06.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.309+0000 7fe0dad69700 1 -- 172.21.15.59:0/2113283462 shutdown_connections 2023-09-30T22:33:06.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:06.309+0000 7fe0dad69700 1 -- 172.21.15.59:0/2113283462 wait complete. 2023-09-30T22:33:06.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:07.243 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:07.281 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:07.292 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:07.323 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.401+0000 7fc418c8a700 1 Processor -- start 2023-09-30T22:33:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.401+0000 7fc418c8a700 1 -- start start 2023-09-30T22:33:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.402+0000 7fc418c8a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc41409e930 0x7fc41409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.402+0000 7fc418c8a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc41409f650 0x7fc414131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.402+0000 7fc418c8a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc414070940 con 0x7fc41409f240 2023-09-30T22:33:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.402+0000 7fc418c8a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41406fd60 con 0x7fc41409e930 2023-09-30T22:33:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.402+0000 7fc418c8a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc41406fa80 con 0x7fc41409f650 2023-09-30T22:33:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.402+0000 7fc412d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc41409f650 0x7fc414131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.402+0000 7fc41259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc41409e930 0x7fc41409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.402+0000 7fc41259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc41409e930 0x7fc41409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35426/0 (socket says 172.21.15.59:35426) 2023-09-30T22:33:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.402+0000 7fc41259c700 1 -- 172.21.15.59:0/2714466442 learned_addr learned my addr 172.21.15.59:0/2714466442 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.402+0000 7fc412d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc41409f650 0x7fc414131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51966/0 (socket says 172.21.15.59:51966) 2023-09-30T22:33:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.403+0000 7fc41259c700 1 -- 172.21.15.59:0/2714466442 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc41409f650 msgr2=0x7fc414131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.403+0000 7fc41259c700 1 --2- 172.21.15.59:0/2714466442 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc41409f650 0x7fc414131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.403+0000 7fc41259c700 1 -- 172.21.15.59:0/2714466442 >> v1:172.21.15.59:6789/0 conn(0x7fc41409f240 legacy=0x7fc4141317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.403+0000 7fc41259c700 1 -- 172.21.15.59:0/2714466442 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41409fb60 con 0x7fc41409e930 2023-09-30T22:33:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.403+0000 7fc41259c700 1 --2- 172.21.15.59:0/2714466442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc41409e930 0x7fc41409ed00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc404009920 tx=0x7fc404009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d31241dbdafe0697 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.403+0000 7fc41159a700 1 -- 172.21.15.59:0/2714466442 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404011830 con 0x7fc41409e930 2023-09-30T22:33:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.403+0000 7fc41159a700 1 -- 172.21.15.59:0/2714466442 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc404011990 con 0x7fc41409e930 2023-09-30T22:33:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.403+0000 7fc41159a700 1 -- 172.21.15.59:0/2714466442 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404011d20 con 0x7fc41409e930 2023-09-30T22:33:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.404+0000 7fc418c8a700 1 -- 172.21.15.59:0/2714466442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc41409e930 msgr2=0x7fc41409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.404+0000 7fc418c8a700 1 --2- 172.21.15.59:0/2714466442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc41409e930 0x7fc41409ed00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc404009920 tx=0x7fc404009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.404+0000 7fc418c8a700 1 -- 172.21.15.59:0/2714466442 shutdown_connections 2023-09-30T22:33:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.404+0000 7fc418c8a700 1 --2- 172.21.15.59:0/2714466442 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc41409f650 0x7fc414131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.404+0000 7fc418c8a700 1 --2- 172.21.15.59:0/2714466442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc41409e930 0x7fc41409ed00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.404+0000 7fc418c8a700 1 -- 172.21.15.59:0/2714466442 >> 172.21.15.59:0/2714466442 conn(0x7fc4140a4210 msgr2=0x7fc4140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:07.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.404+0000 7fc418c8a700 1 -- 172.21.15.59:0/2714466442 shutdown_connections 2023-09-30T22:33:07.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.404+0000 7fc418c8a700 1 -- 172.21.15.59:0/2714466442 wait complete. 2023-09-30T22:33:07.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.406+0000 7fc418c8a700 1 Processor -- start 2023-09-30T22:33:07.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.406+0000 7fc418c8a700 1 -- start start 2023-09-30T22:33:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.407+0000 7fc418c8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc41409e930 0x7fc41412d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.407+0000 7fc418c8a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc41409f240 0x7fc41412d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.407+0000 7fc418c8a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc41409f650 0x7fc41412dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.407+0000 7fc418c8a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc414130630 con 0x7fc41409e930 2023-09-30T22:33:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.407+0000 7fc418c8a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41412fab0 con 0x7fc41409f650 2023-09-30T22:33:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.407+0000 7fc418c8a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc414130810 con 0x7fc41409f240 2023-09-30T22:33:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.407+0000 7fc41259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc41409e930 0x7fc41412d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.407+0000 7fc41259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc41409e930 0x7fc41412d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34492/0 (socket says 172.21.15.59:34492) 2023-09-30T22:33:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.407+0000 7fc41259c700 1 -- 172.21.15.59:0/345606660 learned_addr learned my addr 172.21.15.59:0/345606660 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.407+0000 7fc412d9d700 1 --2- 172.21.15.59:0/345606660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc41409f650 0x7fc41412dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.407+0000 7fc411d9b700 1 --2- 172.21.15.59:0/345606660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc41409f240 0x7fc41412d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.408+0000 7fc41259c700 1 -- 172.21.15.59:0/345606660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc41409f240 msgr2=0x7fc41412d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.408+0000 7fc41259c700 1 --2- 172.21.15.59:0/345606660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc41409f240 0x7fc41412d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.408+0000 7fc41259c700 1 -- 172.21.15.59:0/345606660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc41409f650 msgr2=0x7fc41412dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.408+0000 7fc41259c700 1 --2- 172.21.15.59:0/345606660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc41409f650 0x7fc41412dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.408+0000 7fc41259c700 1 -- 172.21.15.59:0/345606660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc404009550 con 0x7fc41409e930 2023-09-30T22:33:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.408+0000 7fc411d9b700 1 --2- 172.21.15.59:0/345606660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc41409f240 0x7fc41412d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.408+0000 7fc41259c700 1 --2- 172.21.15.59:0/345606660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc41409e930 0x7fc41412d260 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc404000c00 tx=0x7fc404004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.408+0000 7fc402ffd700 1 -- 172.21.15.59:0/345606660 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404004510 con 0x7fc41409e930 2023-09-30T22:33:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.408+0000 7fc402ffd700 1 -- 172.21.15.59:0/345606660 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4040036a0 con 0x7fc41409e930 2023-09-30T22:33:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.408+0000 7fc418c8a700 1 -- 172.21.15.59:0/345606660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4140a0190 con 0x7fc41409e930 2023-09-30T22:33:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.408+0000 7fc402ffd700 1 -- 172.21.15.59:0/345606660 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404003a10 con 0x7fc41409e930 2023-09-30T22:33:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.408+0000 7fc418c8a700 1 -- 172.21.15.59:0/345606660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41412f150 con 0x7fc41409e930 2023-09-30T22:33:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.409+0000 7fc402ffd700 1 -- 172.21.15.59:0/345606660 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc404003b70 con 0x7fc41409e930 2023-09-30T22:33:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.409+0000 7fc402ffd700 1 -- 172.21.15.59:0/345606660 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc404021030 con 0x7fc41409e930 2023-09-30T22:33:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.410+0000 7fc418c8a700 1 -- 172.21.15.59:0/345606660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc414074ea0 con 0x7fc41409e930 2023-09-30T22:33:07.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.415+0000 7fc402ffd700 1 -- 172.21.15.59:0/345606660 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc40402b080 con 0x7fc41409e930 2023-09-30T22:33:07.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.442+0000 7f8fcb9ab700 1 Processor -- start 2023-09-30T22:33:07.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.443+0000 7f8fcb9ab700 1 -- start start 2023-09-30T22:33:07.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.443+0000 7f8fcb9ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc406c0e0 0x7f8fc409ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.443+0000 7f8fcb9ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc4134ec0 0x7f8fc41379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.443+0000 7f8fcb9ab700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc4134980 con 0x7f8fc4137f20 2023-09-30T22:33:07.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.443+0000 7f8fcb9ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc406c4b0 con 0x7f8fc4134ec0 2023-09-30T22:33:07.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.443+0000 7f8fcb9ab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40a09c0 con 0x7f8fc406c0e0 2023-09-30T22:33:07.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.444+0000 7f8fc9747700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc406c0e0 0x7f8fc409ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.444+0000 7f8fc9747700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc406c0e0 0x7f8fc409ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51984/0 (socket says 172.21.15.59:51984) 2023-09-30T22:33:07.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.444+0000 7f8fc9747700 1 -- 172.21.15.59:0/2817783179 learned_addr learned my addr 172.21.15.59:0/2817783179 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:07.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.444+0000 7f8fc8f46700 1 --2- 172.21.15.59:0/2817783179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc4134ec0 0x7f8fc41379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.444+0000 7f8fc9747700 1 -- 172.21.15.59:0/2817783179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc4134ec0 msgr2=0x7f8fc41379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:07.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.444+0000 7f8fc9747700 1 --2- 172.21.15.59:0/2817783179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc4134ec0 0x7f8fc41379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.444+0000 7f8fc9747700 1 -- 172.21.15.59:0/2817783179 >> v1:172.21.15.59:6789/0 conn(0x7f8fc4137f20 legacy=0x7f8fc413ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.444+0000 7f8fc9747700 1 -- 172.21.15.59:0/2817783179 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc40a0600 con 0x7f8fc406c0e0 2023-09-30T22:33:07.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.444+0000 7f8fbbfff700 1 -- 172.21.15.59:0/2817783179 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1795867617 0 0) 0x7f8fc4134980 con 0x7f8fc4137f20 2023-09-30T22:33:07.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.444+0000 7f8fc8f46700 1 --2- 172.21.15.59:0/2817783179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc4134ec0 0x7f8fc41379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:07.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.444+0000 7f8fc9747700 1 --2- 172.21.15.59:0/2817783179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc406c0e0 0x7f8fc409ac90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009950 tx=0x7f8fc0009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45d43ef4cb929e66 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:07.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.444+0000 7f8fbbfff700 1 -- 172.21.15.59:0/2817783179 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0011830 con 0x7f8fc406c0e0 2023-09-30T22:33:07.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.444+0000 7f8fbbfff700 1 -- 172.21.15.59:0/2817783179 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc0011990 con 0x7f8fc406c0e0 2023-09-30T22:33:07.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.444+0000 7f8fbbfff700 1 -- 172.21.15.59:0/2817783179 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0011d40 con 0x7f8fc406c0e0 2023-09-30T22:33:07.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.445+0000 7f8fcb9ab700 1 -- 172.21.15.59:0/2817783179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc406c0e0 msgr2=0x7f8fc409ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.445+0000 7f8fcb9ab700 1 --2- 172.21.15.59:0/2817783179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc406c0e0 0x7f8fc409ac90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009950 tx=0x7f8fc0009c60 comp rx=0 tx=0).stop 2023-09-30T22:33:07.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.445+0000 7f8fcb9ab700 1 -- 172.21.15.59:0/2817783179 shutdown_connections 2023-09-30T22:33:07.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.445+0000 7f8fcb9ab700 1 --2- 172.21.15.59:0/2817783179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc406c0e0 0x7f8fc409ac90 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.445+0000 7f8fcb9ab700 1 --2- 172.21.15.59:0/2817783179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc4134ec0 0x7f8fc41379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.445+0000 7f8fcb9ab700 1 -- 172.21.15.59:0/2817783179 >> 172.21.15.59:0/2817783179 conn(0x7f8fc40a4210 msgr2=0x7f8fc40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:07.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.445+0000 7f8fcb9ab700 1 -- 172.21.15.59:0/2817783179 shutdown_connections 2023-09-30T22:33:07.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.445+0000 7f8fcb9ab700 1 -- 172.21.15.59:0/2817783179 wait complete. 2023-09-30T22:33:07.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.446+0000 7f8fcb9ab700 1 Processor -- start 2023-09-30T22:33:07.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.446+0000 7f8fcb9ab700 1 -- start start 2023-09-30T22:33:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.447+0000 7f8fcb9ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc406c0e0 0x7f8fc411a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.447+0000 7f8fcb9ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc4134ec0 0x7f8fc411abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.447+0000 7f8fcb9ab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc4137f20 0x7f8fc411b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.447+0000 7f8fcb9ab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc411daf0 con 0x7f8fc4137f20 2023-09-30T22:33:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.447+0000 7f8fcb9ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40a03f0 con 0x7f8fc406c0e0 2023-09-30T22:33:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.447+0000 7f8fcb9ab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc411d280 con 0x7f8fc4134ec0 2023-09-30T22:33:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.447+0000 7f8fc9747700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc406c0e0 0x7f8fc411a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.447+0000 7f8fc9747700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc406c0e0 0x7f8fc411a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35464/0 (socket says 172.21.15.59:35464) 2023-09-30T22:33:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.447+0000 7f8fc9747700 1 -- 172.21.15.59:0/1095131098 learned_addr learned my addr 172.21.15.59:0/1095131098 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:07.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.447+0000 7f8fc9f48700 1 --2- 172.21.15.59:0/1095131098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc4137f20 0x7f8fc411b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.447+0000 7f8fc9747700 1 -- 172.21.15.59:0/1095131098 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc4134ec0 msgr2=0x7f8fc411abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.447+0000 7f8fc9747700 1 --2- 172.21.15.59:0/1095131098 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc4134ec0 0x7f8fc411abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.447+0000 7f8fc9747700 1 -- 172.21.15.59:0/1095131098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc4137f20 msgr2=0x7f8fc411b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.447+0000 7f8fc9747700 1 --2- 172.21.15.59:0/1095131098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc4137f20 0x7f8fc411b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.447+0000 7f8fc9747700 1 -- 172.21.15.59:0/1095131098 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40094a0 con 0x7f8fc406c0e0 2023-09-30T22:33:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.448+0000 7f8fc9747700 1 --2- 172.21.15.59:0/1095131098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc406c0e0 0x7f8fc411a680 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0000c00 tx=0x7f8fc0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.448+0000 7f8fb9ffb700 1 -- 172.21.15.59:0/1095131098 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc001a830 con 0x7f8fc406c0e0 2023-09-30T22:33:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.448+0000 7f8fb9ffb700 1 -- 172.21.15.59:0/1095131098 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc001e070 con 0x7f8fc406c0e0 2023-09-30T22:33:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.448+0000 7f8fcb9ab700 1 -- 172.21.15.59:0/1095131098 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc0009550 con 0x7f8fc406c0e0 2023-09-30T22:33:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.448+0000 7f8fb9ffb700 1 -- 172.21.15.59:0/1095131098 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc001abd0 con 0x7f8fc406c0e0 2023-09-30T22:33:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.448+0000 7f8fcb9ab700 1 -- 172.21.15.59:0/1095131098 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc411d550 con 0x7f8fc406c0e0 2023-09-30T22:33:07.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.449+0000 7f8fb9ffb700 1 -- 172.21.15.59:0/1095131098 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8fc001ad30 con 0x7f8fc406c0e0 2023-09-30T22:33:07.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.449+0000 7f8fcb9ab700 1 -- 172.21.15.59:0/1095131098 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc4074ea0 con 0x7f8fc406c0e0 2023-09-30T22:33:07.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.450+0000 7f8fb9ffb700 1 -- 172.21.15.59:0/1095131098 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8fc0040610 con 0x7f8fc406c0e0 2023-09-30T22:33:07.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.451+0000 7ff944ba1700 1 Processor -- start 2023-09-30T22:33:07.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.451+0000 7ff944ba1700 1 -- start start 2023-09-30T22:33:07.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.452+0000 7ff944ba1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff940133870 0x7ff940133c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.452+0000 7ff944ba1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff94009d810 0x7ff94013b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.452+0000 7ff944ba1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff940099780 con 0x7ff940134180 2023-09-30T22:33:07.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.452+0000 7ff944ba1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94009aa80 con 0x7ff940133870 2023-09-30T22:33:07.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.452+0000 7ff944ba1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff940133650 con 0x7ff94009d810 2023-09-30T22:33:07.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.452+0000 7ff93f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff940133870 0x7ff940133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.452+0000 7ff93effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff940134180 0x7ff94009d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57132/0 (socket says 172.21.15.59:57132) 2023-09-30T22:33:07.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.452+0000 7ff93effd700 1 -- 172.21.15.59:0/3106829385 learned_addr learned my addr 172.21.15.59:0/3106829385 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:07.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.452+0000 7ff93ffff700 1 --2- 172.21.15.59:0/3106829385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff94009d810 0x7ff94013b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.452+0000 7ff93f7fe700 1 -- 172.21.15.59:0/3106829385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff94009d810 msgr2=0x7ff94013b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.452+0000 7ff93f7fe700 1 --2- 172.21.15.59:0/3106829385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff94009d810 0x7ff94013b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.452+0000 7ff93f7fe700 1 -- 172.21.15.59:0/3106829385 >> v1:172.21.15.59:6789/0 conn(0x7ff940134180 legacy=0x7ff94009d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.453+0000 7ff93f7fe700 1 -- 172.21.15.59:0/3106829385 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94009ebc0 con 0x7ff940133870 2023-09-30T22:33:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.453+0000 7ff93f7fe700 1 --2- 172.21.15.59:0/3106829385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff940133870 0x7ff940133c40 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff930009820 tx=0x7ff930009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98121087b3b0c6d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.453+0000 7ff93e7fc700 1 -- 172.21.15.59:0/3106829385 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff930005e30 con 0x7ff940133870 2023-09-30T22:33:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.453+0000 7ff93e7fc700 1 -- 172.21.15.59:0/3106829385 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff930006030 con 0x7ff940133870 2023-09-30T22:33:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.453+0000 7ff93e7fc700 1 -- 172.21.15.59:0/3106829385 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9300063c0 con 0x7ff940133870 2023-09-30T22:33:07.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.454+0000 7ff944ba1700 1 -- 172.21.15.59:0/3106829385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff940133870 msgr2=0x7ff940133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.454+0000 7ff944ba1700 1 --2- 172.21.15.59:0/3106829385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff940133870 0x7ff940133c40 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff930009820 tx=0x7ff930009b30 comp rx=0 tx=0).stop 2023-09-30T22:33:07.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.454+0000 7ff944ba1700 1 -- 172.21.15.59:0/3106829385 shutdown_connections 2023-09-30T22:33:07.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.454+0000 7ff944ba1700 1 --2- 172.21.15.59:0/3106829385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff940133870 0x7ff940133c40 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.454+0000 7ff944ba1700 1 --2- 172.21.15.59:0/3106829385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff94009d810 0x7ff94013b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.454+0000 7ff944ba1700 1 -- 172.21.15.59:0/3106829385 >> 172.21.15.59:0/3106829385 conn(0x7ff9400a2540 msgr2=0x7ff9400a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:07.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.454+0000 7ff944ba1700 1 -- 172.21.15.59:0/3106829385 shutdown_connections 2023-09-30T22:33:07.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.454+0000 7ff944ba1700 1 -- 172.21.15.59:0/3106829385 wait complete. 2023-09-30T22:33:07.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.455+0000 7ff944ba1700 1 Processor -- start 2023-09-30T22:33:07.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.455+0000 7f8fb9ffb700 1 -- 172.21.15.59:0/1095131098 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8fc002d7c0 con 0x7f8fc406c0e0 2023-09-30T22:33:07.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.456+0000 7ff944ba1700 1 -- start start 2023-09-30T22:33:07.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.456+0000 7ff944ba1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94009d810 0x7ff94012ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.456+0000 7ff944ba1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff940133870 0x7ff94012f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff944ba1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff940134180 0x7ff94012f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff944ba1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff940131a50 con 0x7ff94009d810 2023-09-30T22:33:07.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff944ba1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9400987a0 con 0x7ff940133870 2023-09-30T22:33:07.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff944ba1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94008b7a0 con 0x7ff940134180 2023-09-30T22:33:07.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff93effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff940133870 0x7ff94012f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff93f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94009d810 0x7ff94012ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff93f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94009d810 0x7ff94012ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34512/0 (socket says 172.21.15.59:34512) 2023-09-30T22:33:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff93effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff940133870 0x7ff94012f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35480/0 (socket says 172.21.15.59:35480) 2023-09-30T22:33:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff93f7fe700 1 -- 172.21.15.59:0/362247585 learned_addr learned my addr 172.21.15.59:0/362247585 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff93ffff700 1 --2- 172.21.15.59:0/362247585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff940134180 0x7ff94012f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff93effd700 1 -- 172.21.15.59:0/362247585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff940134180 msgr2=0x7ff94012f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff93effd700 1 --2- 172.21.15.59:0/362247585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff940134180 0x7ff94012f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff93effd700 1 -- 172.21.15.59:0/362247585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94009d810 msgr2=0x7ff94012ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff93effd700 1 --2- 172.21.15.59:0/362247585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94009d810 0x7ff94012ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff93effd700 1 -- 172.21.15.59:0/362247585 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff930009430 con 0x7ff940133870 2023-09-30T22:33:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.457+0000 7ff93ffff700 1 --2- 172.21.15.59:0/362247585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff940134180 0x7ff94012f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.458+0000 7ff93effd700 1 --2- 172.21.15.59:0/362247585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff940133870 0x7ff94012f0f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c530 tx=0x7ff93400c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.462+0000 7ff927fff700 1 -- 172.21.15.59:0/362247585 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93400cea0 con 0x7ff940133870 2023-09-30T22:33:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.462+0000 7ff927fff700 1 -- 172.21.15.59:0/362247585 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff934005d70 con 0x7ff940133870 2023-09-30T22:33:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.462+0000 7ff927fff700 1 -- 172.21.15.59:0/362247585 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9340072d0 con 0x7ff940133870 2023-09-30T22:33:07.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.462+0000 7ff944ba1700 1 -- 172.21.15.59:0/362247585 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94009bfd0 con 0x7ff940133870 2023-09-30T22:33:07.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.462+0000 7ff944ba1700 1 -- 172.21.15.59:0/362247585 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff940130800 con 0x7ff940133870 2023-09-30T22:33:07.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.463+0000 7ff927fff700 1 -- 172.21.15.59:0/362247585 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff934007430 con 0x7ff940133870 2023-09-30T22:33:07.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.463+0000 7ff944ba1700 1 -- 172.21.15.59:0/362247585 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94004f2a0 con 0x7ff940133870 2023-09-30T22:33:07.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.463+0000 7ff927fff700 1 -- 172.21.15.59:0/362247585 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff93403ea20 con 0x7ff940133870 2023-09-30T22:33:07.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.473+0000 7ff927fff700 1 -- 172.21.15.59:0/362247585 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff93401b730 con 0x7ff940133870 2023-09-30T22:33:07.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.489+0000 7f1f9a01e700 1 Processor -- start 2023-09-30T22:33:07.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.489+0000 7f1f9a01e700 1 -- start start 2023-09-30T22:33:07.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.489+0000 7f1f9a01e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9409e1d0 0x7f1f94138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.489+0000 7f1f9a01e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f94139170 0x7f1f9413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.489+0000 7f1f9a01e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9409b120 con 0x7f1f9409d6f0 2023-09-30T22:33:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.489+0000 7f1f9a01e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9406b460 con 0x7f1f94139170 2023-09-30T22:33:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.489+0000 7f1f9a01e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9409a7e0 con 0x7f1f9409e1d0 2023-09-30T22:33:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.490+0000 7f1f92ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9409e1d0 0x7f1f94138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.490+0000 7f1f937fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1f9409d6f0 0x7f1f9409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57136/0 (socket says 172.21.15.59:57136) 2023-09-30T22:33:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.490+0000 7f1f937fe700 1 -- 172.21.15.59:0/3522338516 learned_addr learned my addr 172.21.15.59:0/3522338516 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.490+0000 7f1f93fff700 1 --2- 172.21.15.59:0/3522338516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f94139170 0x7f1f9413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.490+0000 7f1f927fc700 1 -- 172.21.15.59:0/3522338516 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834017676 0 0) 0x7f1f9409b120 con 0x7f1f9409d6f0 2023-09-30T22:33:07.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.490+0000 7f1f927fc700 1 -- 172.21.15.59:0/3522338516 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f7c0035b0 con 0x7f1f9409d6f0 2023-09-30T22:33:07.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.490+0000 7f1f93fff700 1 -- 172.21.15.59:0/3522338516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9409e1d0 msgr2=0x7f1f94138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:07.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.490+0000 7f1f93fff700 1 --2- 172.21.15.59:0/3522338516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9409e1d0 0x7f1f94138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.490+0000 7f1f93fff700 1 -- 172.21.15.59:0/3522338516 >> v1:172.21.15.59:6789/0 conn(0x7f1f9409d6f0 legacy=0x7f1f9409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.490+0000 7f1f93fff700 1 -- 172.21.15.59:0/3522338516 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9409a500 con 0x7f1f94139170 2023-09-30T22:33:07.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.490+0000 7f1f92ffd700 1 --2- 172.21.15.59:0/3522338516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9409e1d0 0x7f1f94138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:07.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.490+0000 7f1f93fff700 1 --2- 172.21.15.59:0/3522338516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f94139170 0x7f1f9413b550 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009dc0 tx=0x7f1f8c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12c769687895469f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.491+0000 7f1f927fc700 1 -- 172.21.15.59:0/3522338516 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00e070 con 0x7f1f94139170 2023-09-30T22:33:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.491+0000 7f1f927fc700 1 -- 172.21.15.59:0/3522338516 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c00bb20 con 0x7f1f94139170 2023-09-30T22:33:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.491+0000 7f1f927fc700 1 -- 172.21.15.59:0/3522338516 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c012430 con 0x7f1f94139170 2023-09-30T22:33:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.491+0000 7f1f9a01e700 1 -- 172.21.15.59:0/3522338516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f94139170 msgr2=0x7f1f9413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.491+0000 7f1f9a01e700 1 --2- 172.21.15.59:0/3522338516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f94139170 0x7f1f9413b550 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009dc0 tx=0x7f1f8c00b330 comp rx=0 tx=0).stop 2023-09-30T22:33:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.491+0000 7f1f9a01e700 1 -- 172.21.15.59:0/3522338516 shutdown_connections 2023-09-30T22:33:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.491+0000 7f1f9a01e700 1 --2- 172.21.15.59:0/3522338516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f94139170 0x7f1f9413b550 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.491+0000 7f1f9a01e700 1 --2- 172.21.15.59:0/3522338516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9409e1d0 0x7f1f94138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.491+0000 7f1f9a01e700 1 -- 172.21.15.59:0/3522338516 >> 172.21.15.59:0/3522338516 conn(0x7f1f94066f50 msgr2=0x7f1f9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.492+0000 7f1f9a01e700 1 -- 172.21.15.59:0/3522338516 shutdown_connections 2023-09-30T22:33:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.492+0000 7f1f9a01e700 1 -- 172.21.15.59:0/3522338516 wait complete. 2023-09-30T22:33:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.493+0000 7f1f9a01e700 1 Processor -- start 2023-09-30T22:33:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.493+0000 7f1f9a01e700 1 -- start start 2023-09-30T22:33:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.494+0000 7f1f9a01e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9409d6f0 0x7f1f941206c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.494+0000 7f1f9a01e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9409e1d0 0x7f1f94120c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.494+0000 7f1f9a01e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f94139170 0x7f1f94121140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.494+0000 7f1f9a01e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f94122280 con 0x7f1f9409d6f0 2023-09-30T22:33:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.494+0000 7f1f9a01e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f941228a0 con 0x7f1f9409e1d0 2023-09-30T22:33:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.494+0000 7f1f9a01e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9409c780 con 0x7f1f94139170 2023-09-30T22:33:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.494+0000 7f1f93fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f94139170 0x7f1f94121140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.494+0000 7f1f937fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9409d6f0 0x7f1f941206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.494+0000 7f1f93fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f94139170 0x7f1f94121140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52004/0 (socket says 172.21.15.59:52004) 2023-09-30T22:33:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.494+0000 7f1f93fff700 1 -- 172.21.15.59:0/2724578791 learned_addr learned my addr 172.21.15.59:0/2724578791 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.494+0000 7f1f92ffd700 1 --2- 172.21.15.59:0/2724578791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9409e1d0 0x7f1f94120c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.495+0000 7f1f937fe700 1 -- 172.21.15.59:0/2724578791 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f94139170 msgr2=0x7f1f94121140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.495+0000 7f1f937fe700 1 --2- 172.21.15.59:0/2724578791 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f94139170 0x7f1f94121140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.495+0000 7f1f937fe700 1 -- 172.21.15.59:0/2724578791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9409e1d0 msgr2=0x7f1f94120c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.495+0000 7f1f937fe700 1 --2- 172.21.15.59:0/2724578791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9409e1d0 0x7f1f94120c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.495+0000 7f1f937fe700 1 -- 172.21.15.59:0/2724578791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f880094a0 con 0x7f1f9409d6f0 2023-09-30T22:33:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.495+0000 7f1f937fe700 1 --2- 172.21.15.59:0/2724578791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9409d6f0 0x7f1f941206c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400c4c0 tx=0x7f1f8400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:07.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.495+0000 7f1f7bfff700 1 -- 172.21.15.59:0/2724578791 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84005d70 con 0x7f1f9409d6f0 2023-09-30T22:33:07.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.495+0000 7f1f7bfff700 1 -- 172.21.15.59:0/2724578791 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f840070d0 con 0x7f1f9409d6f0 2023-09-30T22:33:07.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.495+0000 7f1f9a01e700 1 -- 172.21.15.59:0/2724578791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8c009a70 con 0x7f1f9409d6f0 2023-09-30T22:33:07.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.495+0000 7f1f7bfff700 1 -- 172.21.15.59:0/2724578791 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84007440 con 0x7f1f9409d6f0 2023-09-30T22:33:07.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.495+0000 7f1f9a01e700 1 -- 172.21.15.59:0/2724578791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f94123f10 con 0x7f1f9409d6f0 2023-09-30T22:33:07.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.496+0000 7f1f7bfff700 1 -- 172.21.15.59:0/2724578791 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f840075a0 con 0x7f1f9409d6f0 2023-09-30T22:33:07.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.496+0000 7f1f9a01e700 1 -- 172.21.15.59:0/2724578791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f94123d10 con 0x7f1f9409d6f0 2023-09-30T22:33:07.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.497+0000 7f1f7bfff700 1 -- 172.21.15.59:0/2724578791 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f8403ea80 con 0x7f1f9409d6f0 2023-09-30T22:33:07.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.501+0000 7f1f7bfff700 1 -- 172.21.15.59:0/2724578791 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f8406c750 con 0x7f1f9409d6f0 2023-09-30T22:33:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.628+0000 7fc418c8a700 1 -- 172.21.15.59:0/345606660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc414130490 con 0x7fc41409e930 2023-09-30T22:33:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.628+0000 7fc402ffd700 1 -- 172.21.15.59:0/345606660 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc414130490 con 0x7fc41409e930 2023-09-30T22:33:07.628 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.630+0000 7fc418c8a700 1 -- 172.21.15.59:0/345606660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc41409e930 msgr2=0x7fc41412d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.630+0000 7fc418c8a700 1 --2- 172.21.15.59:0/345606660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc41409e930 0x7fc41412d260 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc404000c00 tx=0x7fc404004750 comp rx=0 tx=0).stop 2023-09-30T22:33:07.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.630+0000 7fc418c8a700 1 -- 172.21.15.59:0/345606660 shutdown_connections 2023-09-30T22:33:07.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.630+0000 7fc418c8a700 1 --2- 172.21.15.59:0/345606660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc41409f650 0x7fc41412dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.630+0000 7fc418c8a700 1 --2- 172.21.15.59:0/345606660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc41409e930 0x7fc41412d260 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.630+0000 7fc418c8a700 1 --2- 172.21.15.59:0/345606660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc41409f240 0x7fc41412d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.630+0000 7fc418c8a700 1 -- 172.21.15.59:0/345606660 >> 172.21.15.59:0/345606660 conn(0x7fc4140a4210 msgr2=0x7fc41412ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:07.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.631+0000 7fc418c8a700 1 -- 172.21.15.59:0/345606660 shutdown_connections 2023-09-30T22:33:07.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.631+0000 7fc418c8a700 1 -- 172.21.15.59:0/345606660 wait complete. 2023-09-30T22:33:07.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:07.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.699+0000 7f8fcb9ab700 1 -- 172.21.15.59:0/1095131098 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8fc411c3a0 con 0x7f8fc406c0e0 2023-09-30T22:33:07.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.700+0000 7f8fb9ffb700 1 -- 172.21.15.59:0/1095131098 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8fc0015030 con 0x7f8fc406c0e0 2023-09-30T22:33:07.700 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.702+0000 7f8fcb9ab700 1 -- 172.21.15.59:0/1095131098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc406c0e0 msgr2=0x7f8fc411a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.702+0000 7f8fcb9ab700 1 --2- 172.21.15.59:0/1095131098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc406c0e0 0x7f8fc411a680 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0000c00 tx=0x7f8fc0004750 comp rx=0 tx=0).stop 2023-09-30T22:33:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.702+0000 7f8fcb9ab700 1 -- 172.21.15.59:0/1095131098 shutdown_connections 2023-09-30T22:33:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.702+0000 7f8fcb9ab700 1 --2- 172.21.15.59:0/1095131098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc4137f20 0x7f8fc411b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.702+0000 7f8fcb9ab700 1 --2- 172.21.15.59:0/1095131098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc406c0e0 0x7f8fc411a680 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.702+0000 7f8fcb9ab700 1 --2- 172.21.15.59:0/1095131098 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc4134ec0 0x7f8fc411abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.702+0000 7f8fcb9ab700 1 -- 172.21.15.59:0/1095131098 >> 172.21.15.59:0/1095131098 conn(0x7f8fc40a4210 msgr2=0x7f8fc40a2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.702+0000 7f8fcb9ab700 1 -- 172.21.15.59:0/1095131098 shutdown_connections 2023-09-30T22:33:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.702+0000 7f8fcb9ab700 1 -- 172.21.15.59:0/1095131098 wait complete. 2023-09-30T22:33:07.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.708+0000 7ff944ba1700 1 -- 172.21.15.59:0/362247585 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff94006b7c0 con 0x7ff940133870 2023-09-30T22:33:07.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.708+0000 7ff927fff700 1 -- 172.21.15.59:0/362247585 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff934017030 con 0x7ff940133870 2023-09-30T22:33:07.708 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:07.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.712+0000 7ff944ba1700 1 -- 172.21.15.59:0/362247585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff940133870 msgr2=0x7ff94012f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.712+0000 7ff944ba1700 1 --2- 172.21.15.59:0/362247585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff940133870 0x7ff94012f0f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c530 tx=0x7ff93400c840 comp rx=0 tx=0).stop 2023-09-30T22:33:07.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.712+0000 7ff944ba1700 1 -- 172.21.15.59:0/362247585 shutdown_connections 2023-09-30T22:33:07.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.712+0000 7ff944ba1700 1 --2- 172.21.15.59:0/362247585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff940134180 0x7ff94012f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.712+0000 7ff944ba1700 1 --2- 172.21.15.59:0/362247585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94009d810 0x7ff94012ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.712+0000 7ff944ba1700 1 --2- 172.21.15.59:0/362247585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff940133870 0x7ff94012f0f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.712+0000 7ff944ba1700 1 -- 172.21.15.59:0/362247585 >> 172.21.15.59:0/362247585 conn(0x7ff9400a2540 msgr2=0x7ff9400a0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:07.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.712+0000 7f1f9a01e700 1 -- 172.21.15.59:0/2724578791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f94074ea0 con 0x7f1f9409d6f0 2023-09-30T22:33:07.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.712+0000 7ff944ba1700 1 -- 172.21.15.59:0/362247585 shutdown_connections 2023-09-30T22:33:07.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.713+0000 7ff944ba1700 1 -- 172.21.15.59:0/362247585 wait complete. 2023-09-30T22:33:07.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.713+0000 7f1f7bfff700 1 -- 172.21.15.59:0/2724578791 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f84017030 con 0x7f1f9409d6f0 2023-09-30T22:33:07.714 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.715+0000 7f1f9a01e700 1 -- 172.21.15.59:0/2724578791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9409d6f0 msgr2=0x7f1f941206c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.715+0000 7f1f9a01e700 1 --2- 172.21.15.59:0/2724578791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9409d6f0 0x7f1f941206c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400c4c0 tx=0x7f1f8400c7d0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.715+0000 7f1f9a01e700 1 -- 172.21.15.59:0/2724578791 shutdown_connections 2023-09-30T22:33:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.715+0000 7f1f9a01e700 1 --2- 172.21.15.59:0/2724578791 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f94139170 0x7f1f94121140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.715+0000 7f1f9a01e700 1 --2- 172.21.15.59:0/2724578791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9409d6f0 0x7f1f941206c0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.715+0000 7f1f9a01e700 1 --2- 172.21.15.59:0/2724578791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9409e1d0 0x7f1f94120c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.715+0000 7f1f9a01e700 1 -- 172.21.15.59:0/2724578791 >> 172.21.15.59:0/2724578791 conn(0x7f1f94066f50 msgr2=0x7f1f94070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.715+0000 7f1f9a01e700 1 -- 172.21.15.59:0/2724578791 shutdown_connections 2023-09-30T22:33:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:07.716+0000 7f1f9a01e700 1 -- 172.21.15.59:0/2724578791 wait complete. 2023-09-30T22:33:07.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:07.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:07.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:08.645 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:08.720 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:08.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:08.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.797+0000 7f5adbcc8700 1 Processor -- start 2023-09-30T22:33:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.797+0000 7f5adbcc8700 1 -- start start 2023-09-30T22:33:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.797+0000 7f5adbcc8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ad409d6f0 0x7f5ad409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.797+0000 7f5adbcc8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ad409e000 0x7f5ad41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.797+0000 7f5adbcc8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad409b120 con 0x7f5ad409e410 2023-09-30T22:33:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.797+0000 7f5adbcc8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad406b460 con 0x7f5ad409e000 2023-09-30T22:33:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.797+0000 7f5adbcc8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad409a7e0 con 0x7f5ad409d6f0 2023-09-30T22:33:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.798+0000 7f5ad9263700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ad409e000 0x7f5ad41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.798+0000 7f5ad9263700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ad409e000 0x7f5ad41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34540/0 (socket says 172.21.15.59:34540) 2023-09-30T22:33:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.798+0000 7f5ad9263700 1 -- 172.21.15.59:0/1428007946 learned_addr learned my addr 172.21.15.59:0/1428007946 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.798+0000 7f5ad9263700 1 -- 172.21.15.59:0/1428007946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ad409d6f0 msgr2=0x7f5ad409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.798+0000 7f5ad9263700 1 --2- 172.21.15.59:0/1428007946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ad409d6f0 0x7f5ad409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.798+0000 7f5ad9263700 1 -- 172.21.15.59:0/1428007946 >> v1:172.21.15.59:6789/0 conn(0x7f5ad409e410 legacy=0x7f5ad4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.798+0000 7f5ad9263700 1 -- 172.21.15.59:0/1428007946 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad409a500 con 0x7f5ad409e000 2023-09-30T22:33:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.798+0000 7f5ad9263700 1 --2- 172.21.15.59:0/1428007946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad409e000 0x7f5ad41339f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40098f0 tx=0x7f5ac4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4797b075d126727f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:08.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.799+0000 7f5ad8a62700 1 -- 172.21.15.59:0/1428007946 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac400b8a0 con 0x7f5ad409e000 2023-09-30T22:33:08.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.799+0000 7f5ad8a62700 1 -- 172.21.15.59:0/1428007946 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac400ba00 con 0x7f5ad409e000 2023-09-30T22:33:08.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.799+0000 7f5ad8a62700 1 -- 172.21.15.59:0/1428007946 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac400bd90 con 0x7f5ad409e000 2023-09-30T22:33:08.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.799+0000 7f5adbcc8700 1 -- 172.21.15.59:0/1428007946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad409e000 msgr2=0x7f5ad41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:08.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.800+0000 7f5adbcc8700 1 --2- 172.21.15.59:0/1428007946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad409e000 0x7f5ad41339f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40098f0 tx=0x7f5ac4009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:08.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.800+0000 7f5adbcc8700 1 -- 172.21.15.59:0/1428007946 shutdown_connections 2023-09-30T22:33:08.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.800+0000 7f5adbcc8700 1 --2- 172.21.15.59:0/1428007946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ad409d6f0 0x7f5ad409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.800+0000 7f5adbcc8700 1 --2- 172.21.15.59:0/1428007946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad409e000 0x7f5ad41339f0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.800+0000 7f5adbcc8700 1 -- 172.21.15.59:0/1428007946 >> 172.21.15.59:0/1428007946 conn(0x7f5ad4066f50 msgr2=0x7f5ad409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:08.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.800+0000 7f5adbcc8700 1 -- 172.21.15.59:0/1428007946 shutdown_connections 2023-09-30T22:33:08.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.800+0000 7f5adbcc8700 1 -- 172.21.15.59:0/1428007946 wait complete. 2023-09-30T22:33:08.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.801+0000 7f5adbcc8700 1 Processor -- start 2023-09-30T22:33:08.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.801+0000 7f5adbcc8700 1 -- start start 2023-09-30T22:33:08.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.801+0000 7f5adbcc8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad409d6f0 0x7f5ad41a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.801+0000 7f5adbcc8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ad409e000 0x7f5ad41a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.801+0000 7f5adbcc8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ad409e410 0x7f5ad41a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.801+0000 7f5adbcc8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad41a9b00 con 0x7f5ad409d6f0 2023-09-30T22:33:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.801+0000 7f5adbcc8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad41a7c90 con 0x7f5ad409e000 2023-09-30T22:33:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.801+0000 7f5adbcc8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40a3180 con 0x7f5ad409e410 2023-09-30T22:33:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.802+0000 7f5ada265700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ad409e410 0x7f5ad41a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.802+0000 7f5ada265700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ad409e410 0x7f5ad41a6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52020/0 (socket says 172.21.15.59:52020) 2023-09-30T22:33:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.802+0000 7f5ada265700 1 -- 172.21.15.59:0/1049129380 learned_addr learned my addr 172.21.15.59:0/1049129380 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.802+0000 7f5ad9a64700 1 --2- 172.21.15.59:0/1049129380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad409d6f0 0x7f5ad41a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.802+0000 7f5ad9263700 1 --2- 172.21.15.59:0/1049129380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ad409e000 0x7f5ad41a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.802+0000 7f5ada265700 1 -- 172.21.15.59:0/1049129380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ad409e000 msgr2=0x7f5ad41a65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.802+0000 7f5ada265700 1 --2- 172.21.15.59:0/1049129380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ad409e000 0x7f5ad41a65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.802+0000 7f5ada265700 1 -- 172.21.15.59:0/1049129380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad409d6f0 msgr2=0x7f5ad41a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.802+0000 7f5ada265700 1 --2- 172.21.15.59:0/1049129380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad409d6f0 0x7f5ad41a6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.802+0000 7f5ada265700 1 -- 172.21.15.59:0/1049129380 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac4009550 con 0x7f5ad409e410 2023-09-30T22:33:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.802+0000 7f5ad9a64700 1 --2- 172.21.15.59:0/1049129380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad409d6f0 0x7f5ad41a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.803+0000 7f5ada265700 1 --2- 172.21.15.59:0/1049129380 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ad409e410 0x7f5ad41a6af0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00cc50 tx=0x7f5acc00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.803+0000 7f5aca7fc700 1 -- 172.21.15.59:0/1049129380 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc003c00 con 0x7f5ad409e410 2023-09-30T22:33:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.803+0000 7f5aca7fc700 1 -- 172.21.15.59:0/1049129380 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc003d60 con 0x7f5ad409e410 2023-09-30T22:33:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.803+0000 7f5aca7fc700 1 -- 172.21.15.59:0/1049129380 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00aab0 con 0x7f5ad409e410 2023-09-30T22:33:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.803+0000 7f5adbcc8700 1 -- 172.21.15.59:0/1049129380 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad409c710 con 0x7f5ad409e410 2023-09-30T22:33:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.803+0000 7f5adbcc8700 1 -- 172.21.15.59:0/1049129380 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad41a8f10 con 0x7f5ad409e410 2023-09-30T22:33:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.804+0000 7f5aca7fc700 1 -- 172.21.15.59:0/1049129380 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5acc00ac10 con 0x7f5ad409e410 2023-09-30T22:33:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.804+0000 7f5adbcc8700 1 -- 172.21.15.59:0/1049129380 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad4074ea0 con 0x7f5ad409e410 2023-09-30T22:33:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.804+0000 7f5aca7fc700 1 -- 172.21.15.59:0/1049129380 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5acc03f610 con 0x7f5ad409e410 2023-09-30T22:33:08.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.814+0000 7f5aca7fc700 1 -- 172.21.15.59:0/1049129380 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5acc0198f0 con 0x7f5ad409e410 2023-09-30T22:33:08.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.874+0000 7fab74aaf700 1 Processor -- start 2023-09-30T22:33:08.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.874+0000 7fab74aaf700 1 -- start start 2023-09-30T22:33:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.875+0000 7fab74aaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab7009d6f0 0x7fab7009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.875+0000 7fab74aaf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab7009e000 0x7fab701339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.875+0000 7fab74aaf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7009b120 con 0x7fab7009e410 2023-09-30T22:33:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.875+0000 7fab74aaf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab7006b460 con 0x7fab7009e000 2023-09-30T22:33:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.875+0000 7fab74aaf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab7009a7e0 con 0x7fab7009d6f0 2023-09-30T22:33:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.875+0000 7fab6dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab7009e000 0x7fab701339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.875+0000 7fab6e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab7009d6f0 0x7fab7009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.875+0000 7fab6dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab7009e000 0x7fab701339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34562/0 (socket says 172.21.15.59:34562) 2023-09-30T22:33:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.875+0000 7fab6e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab7009d6f0 0x7fab7009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52028/0 (socket says 172.21.15.59:52028) 2023-09-30T22:33:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.875+0000 7fab6dd9b700 1 -- 172.21.15.59:0/821556772 learned_addr learned my addr 172.21.15.59:0/821556772 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.876+0000 7fab6dd9b700 1 -- 172.21.15.59:0/821556772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab7009d6f0 msgr2=0x7fab7009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.876+0000 7fab6dd9b700 1 --2- 172.21.15.59:0/821556772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab7009d6f0 0x7fab7009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.876+0000 7fab6dd9b700 1 -- 172.21.15.59:0/821556772 >> v1:172.21.15.59:6789/0 conn(0x7fab7009e410 legacy=0x7fab70133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.876+0000 7fab6dd9b700 1 -- 172.21.15.59:0/821556772 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7009a500 con 0x7fab7009e000 2023-09-30T22:33:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.876+0000 7fab6e59c700 1 --2- 172.21.15.59:0/821556772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab7009d6f0 0x7fab7009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.876+0000 7fab6dd9b700 1 --2- 172.21.15.59:0/821556772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab7009e000 0x7fab701339f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fab640098f0 tx=0x7fab64009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2975b5193a03b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.876+0000 7fab6d59a700 1 -- 172.21.15.59:0/821556772 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64011830 con 0x7fab7009e000 2023-09-30T22:33:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.876+0000 7fab6d59a700 1 -- 172.21.15.59:0/821556772 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab64011990 con 0x7fab7009e000 2023-09-30T22:33:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.876+0000 7fab6d59a700 1 -- 172.21.15.59:0/821556772 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64011d20 con 0x7fab7009e000 2023-09-30T22:33:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.877+0000 7fab74aaf700 1 -- 172.21.15.59:0/821556772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab7009e000 msgr2=0x7fab701339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.877+0000 7fab74aaf700 1 --2- 172.21.15.59:0/821556772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab7009e000 0x7fab701339f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fab640098f0 tx=0x7fab64009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.877+0000 7fab74aaf700 1 -- 172.21.15.59:0/821556772 shutdown_connections 2023-09-30T22:33:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.877+0000 7fab74aaf700 1 --2- 172.21.15.59:0/821556772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab7009d6f0 0x7fab7009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.877+0000 7fab74aaf700 1 --2- 172.21.15.59:0/821556772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab7009e000 0x7fab701339f0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.877+0000 7fab74aaf700 1 -- 172.21.15.59:0/821556772 >> 172.21.15.59:0/821556772 conn(0x7fab70066f50 msgr2=0x7fab7009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.877+0000 7fab74aaf700 1 -- 172.21.15.59:0/821556772 shutdown_connections 2023-09-30T22:33:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.877+0000 7fab74aaf700 1 -- 172.21.15.59:0/821556772 wait complete. 2023-09-30T22:33:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.879+0000 7fab74aaf700 1 Processor -- start 2023-09-30T22:33:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.879+0000 7fab74aaf700 1 -- start start 2023-09-30T22:33:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.879+0000 7fab74aaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab7009d6f0 0x7fab701a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.879+0000 7fab74aaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab7009e000 0x7fab701a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.879+0000 7fab74aaf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab7009e410 0x7fab701a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.879+0000 7fab74aaf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab701a91f0 con 0x7fab7009e410 2023-09-30T22:33:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.879+0000 7fab74aaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7009c710 con 0x7fab7009d6f0 2023-09-30T22:33:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.879+0000 7fab74aaf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab700a3160 con 0x7fab7009e000 2023-09-30T22:33:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.879+0000 7fab6ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab7009e410 0x7fab701a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.879+0000 7fab6ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab7009e410 0x7fab701a6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34578/0 (socket says 172.21.15.59:34578) 2023-09-30T22:33:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.879+0000 7fab6ed9d700 1 -- 172.21.15.59:0/1830768969 learned_addr learned my addr 172.21.15.59:0/1830768969 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.880+0000 7fab6e59c700 1 --2- 172.21.15.59:0/1830768969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab7009d6f0 0x7fab701a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.880+0000 7fab6ed9d700 1 -- 172.21.15.59:0/1830768969 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab7009e000 msgr2=0x7fab701a6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.880+0000 7fab6ed9d700 1 --2- 172.21.15.59:0/1830768969 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab7009e000 0x7fab701a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.880+0000 7fab6ed9d700 1 -- 172.21.15.59:0/1830768969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab7009d6f0 msgr2=0x7fab701a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.880+0000 7fab6ed9d700 1 --2- 172.21.15.59:0/1830768969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab7009d6f0 0x7fab701a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.880+0000 7fab6ed9d700 1 -- 172.21.15.59:0/1830768969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab600094a0 con 0x7fab7009e410 2023-09-30T22:33:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.880+0000 7fab6ed9d700 1 --2- 172.21.15.59:0/1830768969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab7009e410 0x7fab701a6a50 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fab6800cc50 tx=0x7fab6800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.880+0000 7fab5effd700 1 -- 172.21.15.59:0/1830768969 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab68003c00 con 0x7fab7009e410 2023-09-30T22:33:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.880+0000 7fab5effd700 1 -- 172.21.15.59:0/1830768969 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab68003d60 con 0x7fab7009e410 2023-09-30T22:33:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.880+0000 7fab74aaf700 1 -- 172.21.15.59:0/1830768969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab64009550 con 0x7fab7009e410 2023-09-30T22:33:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.880+0000 7fab5effd700 1 -- 172.21.15.59:0/1830768969 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6800ab60 con 0x7fab7009e410 2023-09-30T22:33:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.880+0000 7fab74aaf700 1 -- 172.21.15.59:0/1830768969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab701a8da0 con 0x7fab7009e410 2023-09-30T22:33:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.881+0000 7fab5effd700 1 -- 172.21.15.59:0/1830768969 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab6800acc0 con 0x7fab7009e410 2023-09-30T22:33:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.881+0000 7fab5effd700 1 -- 172.21.15.59:0/1830768969 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab6803f6d0 con 0x7fab7009e410 2023-09-30T22:33:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.882+0000 7fab74aaf700 1 -- 172.21.15.59:0/1830768969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab70074ea0 con 0x7fab7009e410 2023-09-30T22:33:08.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.891+0000 7fab5effd700 1 -- 172.21.15.59:0/1830768969 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab680198f0 con 0x7fab7009e410 2023-09-30T22:33:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.912+0000 7f6be68f9700 1 Processor -- start 2023-09-30T22:33:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.912+0000 7f6be68f9700 1 -- start start 2023-09-30T22:33:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6be68f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6be012cf60 0x7f6be006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6be68f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6be012f8b0 0x7f6be012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6be68f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6be0130260 0x7f6be0136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6be68f9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be012d330 con 0x7f6be0130260 2023-09-30T22:33:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6be68f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be012cd90 con 0x7f6be012f8b0 2023-09-30T22:33:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6be68f9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6be01306d0 con 0x7f6be012cf60 2023-09-30T22:33:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6bdf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6be012f8b0 0x7f6be012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6bdf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6be012f8b0 0x7f6be012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35534/0 (socket says 172.21.15.59:35534) 2023-09-30T22:33:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6bdf7fe700 1 -- 172.21.15.59:0/2861350923 learned_addr learned my addr 172.21.15.59:0/2861350923 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6bdffff700 1 --2- 172.21.15.59:0/2861350923 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6be012cf60 0x7f6be006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6bdf7fe700 1 -- 172.21.15.59:0/2861350923 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6be012cf60 msgr2=0x7f6be006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6bdf7fe700 1 --2- 172.21.15.59:0/2861350923 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6be012cf60 0x7f6be006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6bdf7fe700 1 -- 172.21.15.59:0/2861350923 >> v2:172.21.15.59:3300/0 conn(0x7f6be0130260 msgr2=0x7f6be0136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:08.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6bdf7fe700 1 --2- 172.21.15.59:0/2861350923 >> v2:172.21.15.59:3300/0 conn(0x7f6be0130260 0x7f6be0136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6bdf7fe700 1 -- 172.21.15.59:0/2861350923 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0071780 con 0x7f6be012f8b0 2023-09-30T22:33:08.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.913+0000 7f6bdffff700 1 --2- 172.21.15.59:0/2861350923 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6be012cf60 0x7f6be006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:08.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.914+0000 7f6bdf7fe700 1 --2- 172.21.15.59:0/2861350923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6be012f8b0 0x7f6be012fd20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40098f0 tx=0x7f6bd4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3337ef366d94c117 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.914+0000 7f6bdeffd700 1 -- 172.21.15.59:0/2861350923 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4013c90 con 0x7f6be012f8b0 2023-09-30T22:33:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.914+0000 7f6bdeffd700 1 -- 172.21.15.59:0/2861350923 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd4013df0 con 0x7f6be012f8b0 2023-09-30T22:33:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.914+0000 7f6bdeffd700 1 -- 172.21.15.59:0/2861350923 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd400b6b0 con 0x7f6be012f8b0 2023-09-30T22:33:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.915+0000 7f6be68f9700 1 -- 172.21.15.59:0/2861350923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6be012f8b0 msgr2=0x7f6be012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.915+0000 7f6be68f9700 1 --2- 172.21.15.59:0/2861350923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6be012f8b0 0x7f6be012fd20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40098f0 tx=0x7f6bd4009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.915+0000 7f6be68f9700 1 -- 172.21.15.59:0/2861350923 shutdown_connections 2023-09-30T22:33:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.915+0000 7f6be68f9700 1 --2- 172.21.15.59:0/2861350923 >> v2:172.21.15.59:3300/0 conn(0x7f6be0130260 0x7f6be0136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.915+0000 7f6be68f9700 1 --2- 172.21.15.59:0/2861350923 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6be012cf60 0x7f6be006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.915+0000 7f6be68f9700 1 --2- 172.21.15.59:0/2861350923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6be012f8b0 0x7f6be012fd20 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.915+0000 7f6be68f9700 1 -- 172.21.15.59:0/2861350923 >> 172.21.15.59:0/2861350923 conn(0x7f6be00a2aa0 msgr2=0x7f6be00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.915+0000 7f6be68f9700 1 -- 172.21.15.59:0/2861350923 shutdown_connections 2023-09-30T22:33:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.915+0000 7f6be68f9700 1 -- 172.21.15.59:0/2861350923 wait complete. 2023-09-30T22:33:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.916+0000 7f6be68f9700 1 Processor -- start 2023-09-30T22:33:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.916+0000 7f6be68f9700 1 -- start start 2023-09-30T22:33:08.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.917+0000 7f6be68f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6be012cf60 0x7f6be01c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.917+0000 7f6be68f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6be012f8b0 0x7f6be01c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.917+0000 7f6be68f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6be0130260 0x7f6be01c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.917+0000 7f6be68f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be009ead0 con 0x7f6be012cf60 2023-09-30T22:33:08.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.917+0000 7f6be68f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be009cdc0 con 0x7f6be012f8b0 2023-09-30T22:33:08.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.917+0000 7f6be68f9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6be012f590 con 0x7f6be0130260 2023-09-30T22:33:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.917+0000 7f6bdf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6be012f8b0 0x7f6be01c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.917+0000 7f6bdf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6be012f8b0 0x7f6be01c4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35542/0 (socket says 172.21.15.59:35542) 2023-09-30T22:33:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.917+0000 7f6bdf7fe700 1 -- 172.21.15.59:0/1139062890 learned_addr learned my addr 172.21.15.59:0/1139062890 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.917+0000 7f6be4e96700 1 --2- 172.21.15.59:0/1139062890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6be0130260 0x7f6be01c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.918+0000 7f6bdf7fe700 1 -- 172.21.15.59:0/1139062890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6be0130260 msgr2=0x7f6be01c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.918+0000 7f6bdf7fe700 1 --2- 172.21.15.59:0/1139062890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6be0130260 0x7f6be01c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.918+0000 7f6bdf7fe700 1 -- 172.21.15.59:0/1139062890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6be012cf60 msgr2=0x7f6be01c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.918+0000 7f6bdf7fe700 1 --2- 172.21.15.59:0/1139062890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6be012cf60 0x7f6be01c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.918+0000 7f6bdf7fe700 1 -- 172.21.15.59:0/1139062890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd4009550 con 0x7f6be012f8b0 2023-09-30T22:33:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.918+0000 7f6bdf7fe700 1 --2- 172.21.15.59:0/1139062890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6be012f8b0 0x7f6be01c4460 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4017000 tx=0x7f6bd4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.918+0000 7f6bdcff9700 1 -- 172.21.15.59:0/1139062890 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4020070 con 0x7f6be012f8b0 2023-09-30T22:33:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.918+0000 7f6bdcff9700 1 -- 172.21.15.59:0/1139062890 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd40038b0 con 0x7f6be012f8b0 2023-09-30T22:33:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.918+0000 7f6be68f9700 1 -- 172.21.15.59:0/1139062890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be009ecd0 con 0x7f6be012f8b0 2023-09-30T22:33:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.918+0000 7f6bdcff9700 1 -- 172.21.15.59:0/1139062890 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4003c60 con 0x7f6be012f8b0 2023-09-30T22:33:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.918+0000 7f6be68f9700 1 -- 172.21.15.59:0/1139062890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be0119220 con 0x7f6be012f8b0 2023-09-30T22:33:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.919+0000 7f6bdcff9700 1 -- 172.21.15.59:0/1139062890 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bd400b490 con 0x7f6be012f8b0 2023-09-30T22:33:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.920+0000 7f6bdcff9700 1 -- 172.21.15.59:0/1139062890 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6bd4044a40 con 0x7f6be012f8b0 2023-09-30T22:33:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.922+0000 7f23b6db9700 1 Processor -- start 2023-09-30T22:33:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.922+0000 7f23b6db9700 1 -- start start 2023-09-30T22:33:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b6db9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23b006e570 0x7f23b006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b6db9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23b009eca0 0x7f23b006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b6db9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23b0134610 0x7f23b0134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b6db9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b0070ee0 con 0x7f23b0134610 2023-09-30T22:33:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b6db9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b0071480 con 0x7f23b006e570 2023-09-30T22:33:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b6db9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23b006f3c0 con 0x7f23b009eca0 2023-09-30T22:33:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b4b55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23b006e570 0x7f23b006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b4b55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23b006e570 0x7f23b006e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35558/0 (socket says 172.21.15.59:35558) 2023-09-30T22:33:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b4b55700 1 -- 172.21.15.59:0/2375332126 learned_addr learned my addr 172.21.15.59:0/2375332126 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b5356700 1 --2- 172.21.15.59:0/2375332126 >> v2:172.21.15.59:3300/0 conn(0x7f23b0134610 0x7f23b0134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b4b55700 1 -- 172.21.15.59:0/2375332126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23b009eca0 msgr2=0x7f23b006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b4b55700 1 --2- 172.21.15.59:0/2375332126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23b009eca0 0x7f23b006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b4b55700 1 -- 172.21.15.59:0/2375332126 >> v2:172.21.15.59:3300/0 conn(0x7f23b0134610 msgr2=0x7f23b0134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b4b55700 1 --2- 172.21.15.59:0/2375332126 >> v2:172.21.15.59:3300/0 conn(0x7f23b0134610 0x7f23b0134ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b4b55700 1 -- 172.21.15.59:0/2375332126 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b0071b90 con 0x7f23b006e570 2023-09-30T22:33:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.923+0000 7f23b5356700 1 --2- 172.21.15.59:0/2375332126 >> v2:172.21.15.59:3300/0 conn(0x7f23b0134610 0x7f23b0134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.922+0000 7f6be68f9700 1 -- 172.21.15.59:0/1139062890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc00052e0 con 0x7f6be012f8b0 2023-09-30T22:33:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.924+0000 7f23b4b55700 1 --2- 172.21.15.59:0/2375332126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23b006e570 0x7f23b006e940 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f23a40098f0 tx=0x7f23a4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34395bc3f28a8b86 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.928+0000 7f23af7fe700 1 -- 172.21.15.59:0/2375332126 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4011830 con 0x7f23b006e570 2023-09-30T22:33:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.928+0000 7f23af7fe700 1 -- 172.21.15.59:0/2375332126 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a4011990 con 0x7f23b006e570 2023-09-30T22:33:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.928+0000 7f23af7fe700 1 -- 172.21.15.59:0/2375332126 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4011d20 con 0x7f23b006e570 2023-09-30T22:33:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.928+0000 7f6bdcff9700 1 -- 172.21.15.59:0/1139062890 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bd40247e0 con 0x7f6be012f8b0 2023-09-30T22:33:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.928+0000 7f23b6db9700 1 -- 172.21.15.59:0/2375332126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23b006e570 msgr2=0x7f23b006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.928+0000 7f23b6db9700 1 --2- 172.21.15.59:0/2375332126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23b006e570 0x7f23b006e940 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f23a40098f0 tx=0x7f23a4009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.929+0000 7f23b6db9700 1 -- 172.21.15.59:0/2375332126 shutdown_connections 2023-09-30T22:33:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.929+0000 7f23b6db9700 1 --2- 172.21.15.59:0/2375332126 >> v2:172.21.15.59:3300/0 conn(0x7f23b0134610 0x7f23b0134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.929+0000 7f23b6db9700 1 --2- 172.21.15.59:0/2375332126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23b006e570 0x7f23b006e940 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.929+0000 7f23b6db9700 1 --2- 172.21.15.59:0/2375332126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23b009eca0 0x7f23b006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.929+0000 7f23b6db9700 1 -- 172.21.15.59:0/2375332126 >> 172.21.15.59:0/2375332126 conn(0x7f23b00a2aa0 msgr2=0x7f23b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:08.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.929+0000 7f23b6db9700 1 -- 172.21.15.59:0/2375332126 shutdown_connections 2023-09-30T22:33:08.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.929+0000 7f23b6db9700 1 -- 172.21.15.59:0/2375332126 wait complete. 2023-09-30T22:33:08.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.930+0000 7f23b6db9700 1 Processor -- start 2023-09-30T22:33:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.930+0000 7f23b6db9700 1 -- start start 2023-09-30T22:33:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.931+0000 7f23b6db9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23b006e570 0x7f23b013b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.931+0000 7f23b6db9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23b0134610 0x7f23b0132870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.931+0000 7f23b6db9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23b0133cb0 0x7f23b0132db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.931+0000 7f23b6db9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b013dbb0 con 0x7f23b0134610 2023-09-30T22:33:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.931+0000 7f23b6db9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b013c4d0 con 0x7f23b0133cb0 2023-09-30T22:33:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.931+0000 7f23b6db9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23b013e060 con 0x7f23b006e570 2023-09-30T22:33:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.931+0000 7f23b5356700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23b0133cb0 0x7f23b0132db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.931+0000 7f23b5356700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23b0133cb0 0x7f23b0132db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35568/0 (socket says 172.21.15.59:35568) 2023-09-30T22:33:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.931+0000 7f23b5356700 1 -- 172.21.15.59:0/2308082612 learned_addr learned my addr 172.21.15.59:0/2308082612 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.931+0000 7f23b4b55700 1 --2- 172.21.15.59:0/2308082612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23b006e570 0x7f23b013b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.932+0000 7f23b5356700 1 -- 172.21.15.59:0/2308082612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23b006e570 msgr2=0x7f23b013b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.932+0000 7f23b5356700 1 --2- 172.21.15.59:0/2308082612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23b006e570 0x7f23b013b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.932+0000 7f23b5356700 1 -- 172.21.15.59:0/2308082612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23b0134610 msgr2=0x7f23b0132870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.932+0000 7f23b5356700 1 --2- 172.21.15.59:0/2308082612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23b0134610 0x7f23b0132870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.932+0000 7f23b5356700 1 -- 172.21.15.59:0/2308082612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a8009a70 con 0x7f23b0133cb0 2023-09-30T22:33:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.932+0000 7f23b5356700 1 --2- 172.21.15.59:0/2308082612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23b0133cb0 0x7f23b0132db0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f23a800efc0 tx=0x7f23a800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.932+0000 7f23ad7fa700 1 -- 172.21.15.59:0/2308082612 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a800cb40 con 0x7f23b0133cb0 2023-09-30T22:33:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.932+0000 7f23ad7fa700 1 -- 172.21.15.59:0/2308082612 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a800f040 con 0x7f23b0133cb0 2023-09-30T22:33:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.932+0000 7f23ad7fa700 1 -- 172.21.15.59:0/2308082612 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8003a20 con 0x7f23b0133cb0 2023-09-30T22:33:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.932+0000 7f23b6db9700 1 -- 172.21.15.59:0/2308082612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a4009550 con 0x7f23b0133cb0 2023-09-30T22:33:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.933+0000 7f23b6db9700 1 -- 172.21.15.59:0/2308082612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b0070610 con 0x7f23b0133cb0 2023-09-30T22:33:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.933+0000 7f23ad7fa700 1 -- 172.21.15.59:0/2308082612 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23a8014480 con 0x7f23b0133cb0 2023-09-30T22:33:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.934+0000 7f23ad7fa700 1 -- 172.21.15.59:0/2308082612 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f23a80401f0 con 0x7f23b0133cb0 2023-09-30T22:33:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.934+0000 7f23b6db9700 1 -- 172.21.15.59:0/2308082612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b009d290 con 0x7f23b0133cb0 2023-09-30T22:33:08.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:08.943+0000 7f23ad7fa700 1 -- 172.21.15.59:0/2308082612 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23a8012930 con 0x7f23b0133cb0 2023-09-30T22:33:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.051+0000 7f5adbcc8700 1 -- 172.21.15.59:0/1049129380 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5ad406c360 con 0x7f5ad409e410 2023-09-30T22:33:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.051+0000 7f5aca7fc700 1 -- 172.21.15.59:0/1049129380 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5acc019300 con 0x7f5ad409e410 2023-09-30T22:33:09.052 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:09.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.054+0000 7f5adbcc8700 1 -- 172.21.15.59:0/1049129380 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ad409e410 msgr2=0x7f5ad41a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:09.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.054+0000 7f5adbcc8700 1 --2- 172.21.15.59:0/1049129380 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ad409e410 0x7f5ad41a6af0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00cc50 tx=0x7f5acc00cf60 comp rx=0 tx=0).stop 2023-09-30T22:33:09.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.054+0000 7f5adbcc8700 1 -- 172.21.15.59:0/1049129380 shutdown_connections 2023-09-30T22:33:09.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.054+0000 7f5adbcc8700 1 --2- 172.21.15.59:0/1049129380 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ad409e410 0x7f5ad41a6af0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:09.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.054+0000 7f5adbcc8700 1 --2- 172.21.15.59:0/1049129380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad409d6f0 0x7f5ad41a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:09.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.054+0000 7f5adbcc8700 1 --2- 172.21.15.59:0/1049129380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ad409e000 0x7f5ad41a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:09.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.054+0000 7f5adbcc8700 1 -- 172.21.15.59:0/1049129380 >> 172.21.15.59:0/1049129380 conn(0x7f5ad4066f50 msgr2=0x7f5ad41baf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:09.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.054+0000 7f5adbcc8700 1 -- 172.21.15.59:0/1049129380 shutdown_connections 2023-09-30T22:33:09.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.054+0000 7f5adbcc8700 1 -- 172.21.15.59:0/1049129380 wait complete. 2023-09-30T22:33:09.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:09.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.103+0000 7fab74aaf700 1 -- 172.21.15.59:0/1830768969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fab7006c360 con 0x7fab7009e410 2023-09-30T22:33:09.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.103+0000 7fab5effd700 1 -- 172.21.15.59:0/1830768969 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab68019300 con 0x7fab7009e410 2023-09-30T22:33:09.104 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:09.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.106+0000 7fab74aaf700 1 -- 172.21.15.59:0/1830768969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab7009e410 msgr2=0x7fab701a6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:09.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.106+0000 7fab74aaf700 1 --2- 172.21.15.59:0/1830768969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab7009e410 0x7fab701a6a50 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fab6800cc50 tx=0x7fab6800cf60 comp rx=0 tx=0).stop 2023-09-30T22:33:09.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.106+0000 7fab74aaf700 1 -- 172.21.15.59:0/1830768969 shutdown_connections 2023-09-30T22:33:09.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.106+0000 7fab74aaf700 1 --2- 172.21.15.59:0/1830768969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab7009e410 0x7fab701a6a50 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:09.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.106+0000 7fab74aaf700 1 --2- 172.21.15.59:0/1830768969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab7009d6f0 0x7fab701a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:09.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.106+0000 7fab74aaf700 1 --2- 172.21.15.59:0/1830768969 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab7009e000 0x7fab701a6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:09.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.106+0000 7fab74aaf700 1 -- 172.21.15.59:0/1830768969 >> 172.21.15.59:0/1830768969 conn(0x7fab70066f50 msgr2=0x7fab701baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:09.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.106+0000 7fab74aaf700 1 -- 172.21.15.59:0/1830768969 shutdown_connections 2023-09-30T22:33:09.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.106+0000 7fab74aaf700 1 -- 172.21.15.59:0/1830768969 wait complete. 2023-09-30T22:33:09.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:09.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.139+0000 7f6be68f9700 1 -- 172.21.15.59:0/1139062890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6bc0005590 con 0x7f6be012f8b0 2023-09-30T22:33:09.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.140+0000 7f6bdcff9700 1 -- 172.21.15.59:0/1139062890 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bd4023370 con 0x7f6be012f8b0 2023-09-30T22:33:09.140 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:09.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.142+0000 7f6be68f9700 1 -- 172.21.15.59:0/1139062890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6be012f8b0 msgr2=0x7f6be01c4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:09.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.142+0000 7f6be68f9700 1 --2- 172.21.15.59:0/1139062890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6be012f8b0 0x7f6be01c4460 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4017000 tx=0x7f6bd4004750 comp rx=0 tx=0).stop 2023-09-30T22:33:09.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.142+0000 7f6be68f9700 1 -- 172.21.15.59:0/1139062890 shutdown_connections 2023-09-30T22:33:09.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.142+0000 7f6be68f9700 1 --2- 172.21.15.59:0/1139062890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6be0130260 0x7f6be01c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:09.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.142+0000 7f6be68f9700 1 --2- 172.21.15.59:0/1139062890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6be012cf60 0x7f6be01c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:09.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.142+0000 7f6be68f9700 1 --2- 172.21.15.59:0/1139062890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6be012f8b0 0x7f6be01c4460 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:09.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.142+0000 7f6be68f9700 1 -- 172.21.15.59:0/1139062890 >> 172.21.15.59:0/1139062890 conn(0x7f6be00a2aa0 msgr2=0x7f6be006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:09.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.142+0000 7f6be68f9700 1 -- 172.21.15.59:0/1139062890 shutdown_connections 2023-09-30T22:33:09.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.142+0000 7f6be68f9700 1 -- 172.21.15.59:0/1139062890 wait complete. 2023-09-30T22:33:09.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:09.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.163+0000 7f23b6db9700 1 -- 172.21.15.59:0/2308082612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f23b0074ea0 con 0x7f23b0133cb0 2023-09-30T22:33:09.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.164+0000 7f23ad7fa700 1 -- 172.21.15.59:0/2308082612 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23a802b090 con 0x7f23b0133cb0 2023-09-30T22:33:09.164 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:09.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.166+0000 7f23b6db9700 1 -- 172.21.15.59:0/2308082612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23b0133cb0 msgr2=0x7f23b0132db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:09.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.166+0000 7f23b6db9700 1 --2- 172.21.15.59:0/2308082612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23b0133cb0 0x7f23b0132db0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f23a800efc0 tx=0x7f23a800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:33:09.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.166+0000 7f23b6db9700 1 -- 172.21.15.59:0/2308082612 shutdown_connections 2023-09-30T22:33:09.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.166+0000 7f23b6db9700 1 --2- 172.21.15.59:0/2308082612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23b006e570 0x7f23b013b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:09.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.166+0000 7f23b6db9700 1 --2- 172.21.15.59:0/2308082612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23b0133cb0 0x7f23b0132db0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:09.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.166+0000 7f23b6db9700 1 --2- 172.21.15.59:0/2308082612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23b0134610 0x7f23b0132870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:09.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.166+0000 7f23b6db9700 1 -- 172.21.15.59:0/2308082612 >> 172.21.15.59:0/2308082612 conn(0x7f23b00a2aa0 msgr2=0x7f23b009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:09.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.166+0000 7f23b6db9700 1 -- 172.21.15.59:0/2308082612 shutdown_connections 2023-09-30T22:33:09.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:09.166+0000 7f23b6db9700 1 -- 172.21.15.59:0/2308082612 wait complete. 2023-09-30T22:33:09.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:10.069 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:10.121 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:10.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:10.181 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.219+0000 7f8eb5a11700 1 Processor -- start 2023-09-30T22:33:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.219+0000 7f8eb5a11700 1 -- start start 2023-09-30T22:33:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.220+0000 7f8eb5a11700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8eb0136710 0x7f8eb0138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.220+0000 7f8eb5a11700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb0139030 0x7f8eb013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.220+0000 7f8eb5a11700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb006ef30 con 0x7f8eb01338a0 2023-09-30T22:33:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.220+0000 7f8eb5a11700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb006fef0 con 0x7f8eb0136710 2023-09-30T22:33:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.220+0000 7f8eb5a11700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb01334b0 con 0x7f8eb0139030 2023-09-30T22:33:10.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.220+0000 7f8eae7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8eb0136710 0x7f8eb0138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.220+0000 7f8eaf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb0139030 0x7f8eb013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.220+0000 7f8eae7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8eb0136710 0x7f8eb0138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34622/0 (socket says 172.21.15.59:34622) 2023-09-30T22:33:10.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.220+0000 7f8eae7fc700 1 -- 172.21.15.59:0/2256269224 learned_addr learned my addr 172.21.15.59:0/2256269224 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:10.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.220+0000 7f8eae7fc700 1 -- 172.21.15.59:0/2256269224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb0139030 msgr2=0x7f8eb013b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:10.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.220+0000 7f8eae7fc700 1 --2- 172.21.15.59:0/2256269224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb0139030 0x7f8eb013b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.220+0000 7f8eae7fc700 1 -- 172.21.15.59:0/2256269224 >> v1:172.21.15.59:6789/0 conn(0x7f8eb01338a0 legacy=0x7f8eb0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.220+0000 7f8eae7fc700 1 -- 172.21.15.59:0/2256269224 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb006fc30 con 0x7f8eb0136710 2023-09-30T22:33:10.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.220+0000 7f8eaf7fe700 1 --2- 172.21.15.59:0/2256269224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb0139030 0x7f8eb013b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:10.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.221+0000 7f8eae7fc700 1 --2- 172.21.15.59:0/2256269224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eb0136710 0x7f8eb0138af0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40098f0 tx=0x7f8ea4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0015e6f33bb6e86 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:10.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.221+0000 7f8eadffb700 1 -- 172.21.15.59:0/2256269224 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4011830 con 0x7f8eb0136710 2023-09-30T22:33:10.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.221+0000 7f8eadffb700 1 -- 172.21.15.59:0/2256269224 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea4011990 con 0x7f8eb0136710 2023-09-30T22:33:10.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.221+0000 7f8eadffb700 1 -- 172.21.15.59:0/2256269224 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4011d20 con 0x7f8eb0136710 2023-09-30T22:33:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.222+0000 7f8eb5a11700 1 -- 172.21.15.59:0/2256269224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eb0136710 msgr2=0x7f8eb0138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.222+0000 7f8eb5a11700 1 --2- 172.21.15.59:0/2256269224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eb0136710 0x7f8eb0138af0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40098f0 tx=0x7f8ea4009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.222+0000 7f8eb5a11700 1 -- 172.21.15.59:0/2256269224 shutdown_connections 2023-09-30T22:33:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.222+0000 7f8eb5a11700 1 --2- 172.21.15.59:0/2256269224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb0139030 0x7f8eb013b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.222+0000 7f8eb5a11700 1 --2- 172.21.15.59:0/2256269224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eb0136710 0x7f8eb0138af0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.222+0000 7f8eb5a11700 1 -- 172.21.15.59:0/2256269224 >> 172.21.15.59:0/2256269224 conn(0x7f8eb00a2aa0 msgr2=0x7f8eb00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.222+0000 7f8eb5a11700 1 -- 172.21.15.59:0/2256269224 shutdown_connections 2023-09-30T22:33:10.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.222+0000 7f8eb5a11700 1 -- 172.21.15.59:0/2256269224 wait complete. 2023-09-30T22:33:10.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.224+0000 7f8eb5a11700 1 Processor -- start 2023-09-30T22:33:10.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.224+0000 7f8eb5a11700 1 -- start start 2023-09-30T22:33:10.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.225+0000 7f8eb5a11700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb01338a0 0x7f8eb011ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.225+0000 7f8eb5a11700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb0136710 0x7f8eb011b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.225+0000 7f8eb5a11700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eb0139030 0x7f8eb011b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.225+0000 7f8eb5a11700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb011cad0 con 0x7f8eb0139030 2023-09-30T22:33:10.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.225+0000 7f8eb5a11700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb011e330 con 0x7f8eb0136710 2023-09-30T22:33:10.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.225+0000 7f8eb5a11700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb0138b00 con 0x7f8eb01338a0 2023-09-30T22:33:10.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.225+0000 7f8eaeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb01338a0 0x7f8eb011ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.225+0000 7f8eaeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb01338a0 0x7f8eb011ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52074/0 (socket says 172.21.15.59:52074) 2023-09-30T22:33:10.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.225+0000 7f8eaeffd700 1 -- 172.21.15.59:0/2177477952 learned_addr learned my addr 172.21.15.59:0/2177477952 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:10.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.225+0000 7f8eae7fc700 1 --2- 172.21.15.59:0/2177477952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb0136710 0x7f8eb011b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.225+0000 7f8eaeffd700 1 -- 172.21.15.59:0/2177477952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb0136710 msgr2=0x7f8eb011b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.225+0000 7f8eaeffd700 1 --2- 172.21.15.59:0/2177477952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb0136710 0x7f8eb011b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.225+0000 7f8eaeffd700 1 -- 172.21.15.59:0/2177477952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eb0139030 msgr2=0x7f8eb011b8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:33:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.225+0000 7f8eaeffd700 1 --2- 172.21.15.59:0/2177477952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eb0139030 0x7f8eb011b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.226+0000 7f8eaeffd700 1 -- 172.21.15.59:0/2177477952 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea8009a70 con 0x7f8eb01338a0 2023-09-30T22:33:10.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.226+0000 7f8eaeffd700 1 --2- 172.21.15.59:0/2177477952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb01338a0 0x7f8eb011ae50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000c4e0 tx=0x7f8ea000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:10.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.226+0000 7f8e97fff700 1 -- 172.21.15.59:0/2177477952 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00052d0 con 0x7f8eb01338a0 2023-09-30T22:33:10.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.226+0000 7f8e97fff700 1 -- 172.21.15.59:0/2177477952 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea0005430 con 0x7f8eb01338a0 2023-09-30T22:33:10.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.226+0000 7f8eb5a11700 1 -- 172.21.15.59:0/2177477952 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea4009550 con 0x7f8eb01338a0 2023-09-30T22:33:10.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.226+0000 7f8e97fff700 1 -- 172.21.15.59:0/2177477952 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00038c0 con 0x7f8eb01338a0 2023-09-30T22:33:10.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.227+0000 7f8eb5a11700 1 -- 172.21.15.59:0/2177477952 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb011f060 con 0x7f8eb01338a0 2023-09-30T22:33:10.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.227+0000 7f8e97fff700 1 -- 172.21.15.59:0/2177477952 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ea0003a20 con 0x7f8eb01338a0 2023-09-30T22:33:10.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.227+0000 7f8e97fff700 1 -- 172.21.15.59:0/2177477952 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8ea003eab0 con 0x7f8eb01338a0 2023-09-30T22:33:10.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.228+0000 7f8eb5a11700 1 -- 172.21.15.59:0/2177477952 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb0074ea0 con 0x7f8eb01338a0 2023-09-30T22:33:10.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.233+0000 7f8e97fff700 1 -- 172.21.15.59:0/2177477952 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ea0019e60 con 0x7f8eb01338a0 2023-09-30T22:33:10.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.274+0000 7fa05056a700 1 Processor -- start 2023-09-30T22:33:10.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.274+0000 7fa05056a700 1 -- start start 2023-09-30T22:33:10.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.274+0000 7fa05056a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04806c0e0 0x7fa04809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.274+0000 7fa05056a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa048134ec0 0x7fa0481379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.274+0000 7fa05056a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa048137f20 0x7fa0481383c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.274+0000 7fa05056a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04806c4b0 con 0x7fa048134ec0 2023-09-30T22:33:10.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.274+0000 7fa05056a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480a09c0 con 0x7fa04806c0e0 2023-09-30T22:33:10.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.274+0000 7fa05056a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa048134980 con 0x7fa048137f20 2023-09-30T22:33:10.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.275+0000 7fa04eb07700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa048137f20 0x7fa0481383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.275+0000 7fa04eb07700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa048137f20 0x7fa0481383c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52078/0 (socket says 172.21.15.59:52078) 2023-09-30T22:33:10.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.275+0000 7fa04eb07700 1 -- 172.21.15.59:0/3791242187 learned_addr learned my addr 172.21.15.59:0/3791242187 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:10.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.275+0000 7fa04db05700 1 --2- 172.21.15.59:0/3791242187 >> v2:172.21.15.59:3300/0 conn(0x7fa048134ec0 0x7fa0481379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.275+0000 7fa04e306700 1 --2- 172.21.15.59:0/3791242187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04806c0e0 0x7fa04809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.275+0000 7fa04eb07700 1 -- 172.21.15.59:0/3791242187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04806c0e0 msgr2=0x7fa04809ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:10.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.275+0000 7fa04eb07700 1 --2- 172.21.15.59:0/3791242187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04806c0e0 0x7fa04809ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.275+0000 7fa04eb07700 1 -- 172.21.15.59:0/3791242187 >> v2:172.21.15.59:3300/0 conn(0x7fa048134ec0 msgr2=0x7fa0481379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:10.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.275+0000 7fa04eb07700 1 --2- 172.21.15.59:0/3791242187 >> v2:172.21.15.59:3300/0 conn(0x7fa048134ec0 0x7fa0481379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.275+0000 7fa04eb07700 1 -- 172.21.15.59:0/3791242187 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480a0600 con 0x7fa048137f20 2023-09-30T22:33:10.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.275+0000 7fa04db05700 1 --2- 172.21.15.59:0/3791242187 >> v2:172.21.15.59:3300/0 conn(0x7fa048134ec0 0x7fa0481379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:10.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.275+0000 7fa04eb07700 1 --2- 172.21.15.59:0/3791242187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa048137f20 0x7fa0481383c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa040009e50 tx=0x7fa04000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94db916d62e57663 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:10.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.276+0000 7fa04d304700 1 -- 172.21.15.59:0/3791242187 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04000e070 con 0x7fa048137f20 2023-09-30T22:33:10.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.276+0000 7fa04d304700 1 -- 172.21.15.59:0/3791242187 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04000b910 con 0x7fa048137f20 2023-09-30T22:33:10.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.276+0000 7fa04d304700 1 -- 172.21.15.59:0/3791242187 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04000bcc0 con 0x7fa048137f20 2023-09-30T22:33:10.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.276+0000 7fa05056a700 1 -- 172.21.15.59:0/3791242187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa048137f20 msgr2=0x7fa0481383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.276+0000 7fa05056a700 1 --2- 172.21.15.59:0/3791242187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa048137f20 0x7fa0481383c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa040009e50 tx=0x7fa04000b330 comp rx=0 tx=0).stop 2023-09-30T22:33:10.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.277+0000 7fa05056a700 1 -- 172.21.15.59:0/3791242187 shutdown_connections 2023-09-30T22:33:10.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.277+0000 7fa05056a700 1 --2- 172.21.15.59:0/3791242187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa048137f20 0x7fa0481383c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.277+0000 7fa05056a700 1 --2- 172.21.15.59:0/3791242187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04806c0e0 0x7fa04809ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.277+0000 7fa05056a700 1 --2- 172.21.15.59:0/3791242187 >> v2:172.21.15.59:3300/0 conn(0x7fa048134ec0 0x7fa0481379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.277+0000 7fa05056a700 1 -- 172.21.15.59:0/3791242187 >> 172.21.15.59:0/3791242187 conn(0x7fa0480a4210 msgr2=0x7fa0480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.277+0000 7fa05056a700 1 -- 172.21.15.59:0/3791242187 shutdown_connections 2023-09-30T22:33:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.277+0000 7fa05056a700 1 -- 172.21.15.59:0/3791242187 wait complete. 2023-09-30T22:33:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.278+0000 7fa05056a700 1 Processor -- start 2023-09-30T22:33:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.278+0000 7fa05056a700 1 -- start start 2023-09-30T22:33:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa05056a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04806c0e0 0x7fa04811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa05056a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa048134ec0 0x7fa04811abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa05056a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa048137f20 0x7fa04811b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa05056a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04811e440 con 0x7fa048137f20 2023-09-30T22:33:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa05056a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04811c030 con 0x7fa04806c0e0 2023-09-30T22:33:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa05056a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa04811cb00 con 0x7fa048134ec0 2023-09-30T22:33:10.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa04e306700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04806c0e0 0x7fa04811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa04e306700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04806c0e0 0x7fa04811a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35596/0 (socket says 172.21.15.59:35596) 2023-09-30T22:33:10.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa04e306700 1 -- 172.21.15.59:0/3874457480 learned_addr learned my addr 172.21.15.59:0/3874457480 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:10.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa04db05700 1 --2- 172.21.15.59:0/3874457480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa048134ec0 0x7fa04811abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa04eb07700 1 --2- 172.21.15.59:0/3874457480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa048137f20 0x7fa04811b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa04e306700 1 -- 172.21.15.59:0/3874457480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa048134ec0 msgr2=0x7fa04811abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa04e306700 1 --2- 172.21.15.59:0/3874457480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa048134ec0 0x7fa04811abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa04e306700 1 -- 172.21.15.59:0/3874457480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa048137f20 msgr2=0x7fa04811b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa04e306700 1 --2- 172.21.15.59:0/3874457480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa048137f20 0x7fa04811b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.279+0000 7fa04e306700 1 -- 172.21.15.59:0/3874457480 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0380094a0 con 0x7fa04806c0e0 2023-09-30T22:33:10.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.280+0000 7fa04e306700 1 --2- 172.21.15.59:0/3874457480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04806c0e0 0x7fa04811a680 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa04400e870 tx=0x7fa04400eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:10.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.280+0000 7fa03effd700 1 -- 172.21.15.59:0/3874457480 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044009590 con 0x7fa04806c0e0 2023-09-30T22:33:10.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.280+0000 7fa03effd700 1 -- 172.21.15.59:0/3874457480 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa044013680 con 0x7fa04806c0e0 2023-09-30T22:33:10.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.280+0000 7fa05056a700 1 -- 172.21.15.59:0/3874457480 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa040009b30 con 0x7fa04806c0e0 2023-09-30T22:33:10.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.280+0000 7fa03effd700 1 -- 172.21.15.59:0/3874457480 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0440139f0 con 0x7fa04806c0e0 2023-09-30T22:33:10.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.280+0000 7fa05056a700 1 -- 172.21.15.59:0/3874457480 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa048138cd0 con 0x7fa04806c0e0 2023-09-30T22:33:10.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.281+0000 7fa03effd700 1 -- 172.21.15.59:0/3874457480 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa044013b50 con 0x7fa04806c0e0 2023-09-30T22:33:10.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.281+0000 7fa03effd700 1 -- 172.21.15.59:0/3874457480 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa04403f670 con 0x7fa04806c0e0 2023-09-30T22:33:10.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.281+0000 7fa05056a700 1 -- 172.21.15.59:0/3874457480 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa048074ea0 con 0x7fa04806c0e0 2023-09-30T22:33:10.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.286+0000 7fa03effd700 1 -- 172.21.15.59:0/3874457480 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa044021080 con 0x7fa04806c0e0 2023-09-30T22:33:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.342+0000 7ff9566f1700 1 Processor -- start 2023-09-30T22:33:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.342+0000 7ff9566f1700 1 -- start start 2023-09-30T22:33:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.343+0000 7ff9566f1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff95009e1d0 0x7ff950138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.343+0000 7ff9566f1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff950139170 0x7ff95013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.343+0000 7ff9566f1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff95009b120 con 0x7ff95009d6f0 2023-09-30T22:33:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.343+0000 7ff9566f1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff95006b460 con 0x7ff950139170 2023-09-30T22:33:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.343+0000 7ff9566f1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff95009a7e0 con 0x7ff95009e1d0 2023-09-30T22:33:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.343+0000 7ff954c8e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff950139170 0x7ff95013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.343+0000 7ff954c8e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff950139170 0x7ff95013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34650/0 (socket says 172.21.15.59:34650) 2023-09-30T22:33:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.343+0000 7ff954c8e700 1 -- 172.21.15.59:0/3342489050 learned_addr learned my addr 172.21.15.59:0/3342489050 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.344+0000 7ff94f7fe700 1 --2- 172.21.15.59:0/3342489050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff95009e1d0 0x7ff950138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.344+0000 7ff954c8e700 1 -- 172.21.15.59:0/3342489050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff95009e1d0 msgr2=0x7ff950138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.344+0000 7ff954c8e700 1 --2- 172.21.15.59:0/3342489050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff95009e1d0 0x7ff950138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.344+0000 7ff954c8e700 1 -- 172.21.15.59:0/3342489050 >> v1:172.21.15.59:6789/0 conn(0x7ff95009d6f0 legacy=0x7ff95009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.344+0000 7ff954c8e700 1 -- 172.21.15.59:0/3342489050 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95009a500 con 0x7ff950139170 2023-09-30T22:33:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.344+0000 7ff94effd700 1 -- 172.21.15.59:0/3342489050 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564142180 0 0) 0x7ff95009b120 con 0x7ff95009d6f0 2023-09-30T22:33:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.344+0000 7ff94f7fe700 1 --2- 172.21.15.59:0/3342489050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff95009e1d0 0x7ff950138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.344+0000 7ff954c8e700 1 --2- 172.21.15.59:0/3342489050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff950139170 0x7ff95013b550 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff948009e50 tx=0x7ff94800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd8f7c4538500c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.344+0000 7ff94effd700 1 -- 172.21.15.59:0/3342489050 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94800e070 con 0x7ff950139170 2023-09-30T22:33:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.344+0000 7ff94effd700 1 -- 172.21.15.59:0/3342489050 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94800b910 con 0x7ff950139170 2023-09-30T22:33:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.344+0000 7ff94effd700 1 -- 172.21.15.59:0/3342489050 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94800bcc0 con 0x7ff950139170 2023-09-30T22:33:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.345+0000 7ff9566f1700 1 -- 172.21.15.59:0/3342489050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff950139170 msgr2=0x7ff95013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.345+0000 7ff9566f1700 1 --2- 172.21.15.59:0/3342489050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff950139170 0x7ff95013b550 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff948009e50 tx=0x7ff94800b330 comp rx=0 tx=0).stop 2023-09-30T22:33:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.345+0000 7ff9566f1700 1 -- 172.21.15.59:0/3342489050 shutdown_connections 2023-09-30T22:33:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.346+0000 7ff9566f1700 1 --2- 172.21.15.59:0/3342489050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff950139170 0x7ff95013b550 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.346+0000 7ff9566f1700 1 --2- 172.21.15.59:0/3342489050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff95009e1d0 0x7ff950138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.346+0000 7ff9566f1700 1 -- 172.21.15.59:0/3342489050 >> 172.21.15.59:0/3342489050 conn(0x7ff950066f50 msgr2=0x7ff95009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:10.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.346+0000 7ff9566f1700 1 -- 172.21.15.59:0/3342489050 shutdown_connections 2023-09-30T22:33:10.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.346+0000 7ff9566f1700 1 -- 172.21.15.59:0/3342489050 wait complete. 2023-09-30T22:33:10.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.347+0000 7ff9566f1700 1 Processor -- start 2023-09-30T22:33:10.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.347+0000 7ff9566f1700 1 -- start start 2023-09-30T22:33:10.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.348+0000 7ff9566f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff95009d6f0 0x7ff9501207a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.348+0000 7ff9566f1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff95009e1d0 0x7ff950120ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.348+0000 7ff9566f1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff950139170 0x7ff950121220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.348+0000 7ff9566f1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9501229e0 con 0x7ff95009e1d0 2023-09-30T22:33:10.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.348+0000 7ff9566f1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9501224c0 con 0x7ff95009d6f0 2023-09-30T22:33:10.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.348+0000 7ff9566f1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff950123fe0 con 0x7ff950139170 2023-09-30T22:33:10.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.348+0000 7ff94ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff95009d6f0 0x7ff9501207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.348+0000 7ff954c8e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff950139170 0x7ff950121220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.348+0000 7ff954c8e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff950139170 0x7ff950121220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52100/0 (socket says 172.21.15.59:52100) 2023-09-30T22:33:10.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.348+0000 7ff954c8e700 1 -- 172.21.15.59:0/2201146245 learned_addr learned my addr 172.21.15.59:0/2201146245 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:10.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.348+0000 7ff94f7fe700 1 --2- 172.21.15.59:0/2201146245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff95009e1d0 0x7ff950120ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.349+0000 7ff954c8e700 1 -- 172.21.15.59:0/2201146245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff95009d6f0 msgr2=0x7ff9501207a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.349+0000 7ff954c8e700 1 --2- 172.21.15.59:0/2201146245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff95009d6f0 0x7ff9501207a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.349+0000 7ff954c8e700 1 -- 172.21.15.59:0/2201146245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff95009e1d0 msgr2=0x7ff950120ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.349+0000 7ff954c8e700 1 --2- 172.21.15.59:0/2201146245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff95009e1d0 0x7ff950120ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.349+0000 7ff954c8e700 1 -- 172.21.15.59:0/2201146245 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9440094a0 con 0x7ff950139170 2023-09-30T22:33:10.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.349+0000 7ff94f7fe700 1 --2- 172.21.15.59:0/2201146245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff95009e1d0 0x7ff950120ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:10.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.349+0000 7ff954c8e700 1 --2- 172.21.15.59:0/2201146245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff950139170 0x7ff950121220 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff948008dd0 tx=0x7ff948004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:10.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.349+0000 7ff94cff9700 1 -- 172.21.15.59:0/2201146245 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94801c640 con 0x7ff950139170 2023-09-30T22:33:10.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.349+0000 7ff94cff9700 1 -- 172.21.15.59:0/2201146245 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94801c7a0 con 0x7ff950139170 2023-09-30T22:33:10.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.349+0000 7ff94cff9700 1 -- 172.21.15.59:0/2201146245 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94801cb50 con 0x7ff950139170 2023-09-30T22:33:10.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.350+0000 7ff9566f1700 1 -- 172.21.15.59:0/2201146245 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff948009b30 con 0x7ff950139170 2023-09-30T22:33:10.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.350+0000 7ff9566f1700 1 -- 172.21.15.59:0/2201146245 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff950122ba0 con 0x7ff950139170 2023-09-30T22:33:10.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.351+0000 7ff94cff9700 1 -- 172.21.15.59:0/2201146245 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff94801ccb0 con 0x7ff950139170 2023-09-30T22:33:10.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.351+0000 7ff9566f1700 1 -- 172.21.15.59:0/2201146245 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff950123e20 con 0x7ff950139170 2023-09-30T22:33:10.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.351+0000 7ff94cff9700 1 -- 172.21.15.59:0/2201146245 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff948041300 con 0x7ff950139170 2023-09-30T22:33:10.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.356+0000 7fe5dbd6b700 1 Processor -- start 2023-09-30T22:33:10.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.356+0000 7fe5dbd6b700 1 -- start start 2023-09-30T22:33:10.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.357+0000 7fe5dbd6b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d409d6f0 0x7fe5d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.357+0000 7fe5dbd6b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5d4130d70 0x7fe5d4138930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.357+0000 7fe5dbd6b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d409b8e0 con 0x7fe5d409e000 2023-09-30T22:33:10.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.357+0000 7fe5dbd6b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d409b420 con 0x7fe5d4130d70 2023-09-30T22:33:10.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.357+0000 7fe5dbd6b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d409a850 con 0x7fe5d409d6f0 2023-09-30T22:33:10.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.357+0000 7ff94cff9700 1 -- 172.21.15.59:0/2201146245 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff948025770 con 0x7ff950139170 2023-09-30T22:33:10.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.357+0000 7fe5da308700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5d4130d70 0x7fe5d4138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.357+0000 7fe5d9b07700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d409d6f0 0x7fe5d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.357+0000 7fe5da308700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5d4130d70 0x7fe5d4138930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34666/0 (socket says 172.21.15.59:34666) 2023-09-30T22:33:10.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.357+0000 7fe5da308700 1 -- 172.21.15.59:0/1661776648 learned_addr learned my addr 172.21.15.59:0/1661776648 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:10.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.357+0000 7fe5d9306700 1 --1- 172.21.15.59:0/1661776648 >> v1:172.21.15.59:6789/0 conn(0x7fe5d409e000 0x7fe5d4130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57182/0 (socket says 172.21.15.59:57182) 2023-09-30T22:33:10.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.357+0000 7fe5d9b07700 1 -- 172.21.15.59:0/1661776648 >> v2:172.21.15.59:3300/0 conn(0x7fe5d4130d70 msgr2=0x7fe5d4138930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:10.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.357+0000 7fe5d9b07700 1 --2- 172.21.15.59:0/1661776648 >> v2:172.21.15.59:3300/0 conn(0x7fe5d4130d70 0x7fe5d4138930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.357+0000 7fe5d9b07700 1 -- 172.21.15.59:0/1661776648 >> v1:172.21.15.59:6789/0 conn(0x7fe5d409e000 legacy=0x7fe5d4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.357+0000 7fe5d9b07700 1 -- 172.21.15.59:0/1661776648 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d409aa40 con 0x7fe5d409d6f0 2023-09-30T22:33:10.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.358+0000 7fe5d9b07700 1 --2- 172.21.15.59:0/1661776648 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d409d6f0 0x7fe5d409dac0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009870 tx=0x7fe5d0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fda7350ae27dcc80 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:10.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.358+0000 7fe5d8b05700 1 -- 172.21.15.59:0/1661776648 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0011830 con 0x7fe5d409d6f0 2023-09-30T22:33:10.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.358+0000 7fe5d8b05700 1 -- 172.21.15.59:0/1661776648 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d0011990 con 0x7fe5d409d6f0 2023-09-30T22:33:10.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.358+0000 7fe5d8b05700 1 -- 172.21.15.59:0/1661776648 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0011d00 con 0x7fe5d409d6f0 2023-09-30T22:33:10.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.359+0000 7fe5dbd6b700 1 -- 172.21.15.59:0/1661776648 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d409d6f0 msgr2=0x7fe5d409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.359+0000 7fe5dbd6b700 1 --2- 172.21.15.59:0/1661776648 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d409d6f0 0x7fe5d409dac0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009870 tx=0x7fe5d0009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:10.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.359+0000 7fe5dbd6b700 1 -- 172.21.15.59:0/1661776648 shutdown_connections 2023-09-30T22:33:10.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.359+0000 7fe5dbd6b700 1 --2- 172.21.15.59:0/1661776648 >> v2:172.21.15.59:3300/0 conn(0x7fe5d4130d70 0x7fe5d4138930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.359+0000 7fe5dbd6b700 1 --2- 172.21.15.59:0/1661776648 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d409d6f0 0x7fe5d409dac0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.359+0000 7fe5dbd6b700 1 -- 172.21.15.59:0/1661776648 >> 172.21.15.59:0/1661776648 conn(0x7fe5d4066f50 msgr2=0x7fe5d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:10.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.359+0000 7fe5dbd6b700 1 -- 172.21.15.59:0/1661776648 shutdown_connections 2023-09-30T22:33:10.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.359+0000 7fe5dbd6b700 1 -- 172.21.15.59:0/1661776648 wait complete. 2023-09-30T22:33:10.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.360+0000 7fe5dbd6b700 1 Processor -- start 2023-09-30T22:33:10.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.360+0000 7fe5dbd6b700 1 -- start start 2023-09-30T22:33:10.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5dbd6b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d409d6f0 0x7fe5d411e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5dbd6b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d409e000 0x7fe5d411e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5dbd6b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d4130d70 0x7fe5d411ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:10.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5dbd6b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d4121eb0 con 0x7fe5d409d6f0 2023-09-30T22:33:10.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5dbd6b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d411ffa0 con 0x7fe5d4130d70 2023-09-30T22:33:10.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5dbd6b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d4120550 con 0x7fe5d409e000 2023-09-30T22:33:10.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5da308700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d4130d70 0x7fe5d411ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5da308700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d4130d70 0x7fe5d411ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35610/0 (socket says 172.21.15.59:35610) 2023-09-30T22:33:10.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5da308700 1 -- 172.21.15.59:0/757445513 learned_addr learned my addr 172.21.15.59:0/757445513 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:10.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5d9b07700 1 --2- 172.21.15.59:0/757445513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d409d6f0 0x7fe5d411e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5d9306700 1 --2- 172.21.15.59:0/757445513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d409e000 0x7fe5d411e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:10.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5d9b07700 1 -- 172.21.15.59:0/757445513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d409e000 msgr2=0x7fe5d411e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5d9b07700 1 --2- 172.21.15.59:0/757445513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d409e000 0x7fe5d411e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5d9b07700 1 -- 172.21.15.59:0/757445513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d4130d70 msgr2=0x7fe5d411ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5d9b07700 1 --2- 172.21.15.59:0/757445513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d4130d70 0x7fe5d411ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.361+0000 7fe5d9b07700 1 -- 172.21.15.59:0/757445513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d00094a0 con 0x7fe5d409d6f0 2023-09-30T22:33:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.362+0000 7fe5d9b07700 1 --2- 172.21.15.59:0/757445513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d409d6f0 0x7fe5d411e3e0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0016000 tx=0x7fe5d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.362+0000 7fe5ca7fc700 1 -- 172.21.15.59:0/757445513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d00036a0 con 0x7fe5d409d6f0 2023-09-30T22:33:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.362+0000 7fe5ca7fc700 1 -- 172.21.15.59:0/757445513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d001f070 con 0x7fe5d409d6f0 2023-09-30T22:33:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.362+0000 7fe5dbd6b700 1 -- 172.21.15.59:0/757445513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d40a2a80 con 0x7fe5d409d6f0 2023-09-30T22:33:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.362+0000 7fe5ca7fc700 1 -- 172.21.15.59:0/757445513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0003a20 con 0x7fe5d409d6f0 2023-09-30T22:33:10.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.362+0000 7fe5dbd6b700 1 -- 172.21.15.59:0/757445513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d4122640 con 0x7fe5d409d6f0 2023-09-30T22:33:10.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.363+0000 7fe5ca7fc700 1 -- 172.21.15.59:0/757445513 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5d0003b80 con 0x7fe5d409d6f0 2023-09-30T22:33:10.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.363+0000 7fe5ca7fc700 1 -- 172.21.15.59:0/757445513 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe5d0021070 con 0x7fe5d409d6f0 2023-09-30T22:33:10.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.364+0000 7fe5b7fff700 1 -- 172.21.15.59:0/757445513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b00052e0 con 0x7fe5d409d6f0 2023-09-30T22:33:10.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.369+0000 7fe5ca7fc700 1 -- 172.21.15.59:0/757445513 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5d0019ba0 con 0x7fe5d409d6f0 2023-09-30T22:33:10.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.484+0000 7f8eb5a11700 1 -- 172.21.15.59:0/2177477952 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8eb006b9e0 con 0x7f8eb01338a0 2023-09-30T22:33:10.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.484+0000 7f8e97fff700 1 -- 172.21.15.59:0/2177477952 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ea0017020 con 0x7f8eb01338a0 2023-09-30T22:33:10.485 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:10.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.487+0000 7f8eb5a11700 1 -- 172.21.15.59:0/2177477952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb01338a0 msgr2=0x7f8eb011ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.487+0000 7f8eb5a11700 1 --2- 172.21.15.59:0/2177477952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb01338a0 0x7f8eb011ae50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000c4e0 tx=0x7f8ea000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.488+0000 7f8eb5a11700 1 -- 172.21.15.59:0/2177477952 shutdown_connections 2023-09-30T22:33:10.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.488+0000 7f8eb5a11700 1 --2- 172.21.15.59:0/2177477952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb01338a0 0x7f8eb011ae50 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.488+0000 7f8eb5a11700 1 --2- 172.21.15.59:0/2177477952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eb0139030 0x7f8eb011b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.488+0000 7f8eb5a11700 1 --2- 172.21.15.59:0/2177477952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb0136710 0x7f8eb011b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.488+0000 7f8eb5a11700 1 -- 172.21.15.59:0/2177477952 >> 172.21.15.59:0/2177477952 conn(0x7f8eb00a2aa0 msgr2=0x7f8eb0137360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:10.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.488+0000 7f8eb5a11700 1 -- 172.21.15.59:0/2177477952 shutdown_connections 2023-09-30T22:33:10.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.488+0000 7f8eb5a11700 1 -- 172.21.15.59:0/2177477952 wait complete. 2023-09-30T22:33:10.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:10.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.507+0000 7fa05056a700 1 -- 172.21.15.59:0/3874457480 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa04806b250 con 0x7fa04806c0e0 2023-09-30T22:33:10.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.507+0000 7fa03effd700 1 -- 172.21.15.59:0/3874457480 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa044017020 con 0x7fa04806c0e0 2023-09-30T22:33:10.508 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:10.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.509+0000 7fa05056a700 1 -- 172.21.15.59:0/3874457480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04806c0e0 msgr2=0x7fa04811a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.509+0000 7fa05056a700 1 --2- 172.21.15.59:0/3874457480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04806c0e0 0x7fa04811a680 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa04400e870 tx=0x7fa04400eb80 comp rx=0 tx=0).stop 2023-09-30T22:33:10.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.509+0000 7fa05056a700 1 -- 172.21.15.59:0/3874457480 shutdown_connections 2023-09-30T22:33:10.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.509+0000 7fa05056a700 1 --2- 172.21.15.59:0/3874457480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa048137f20 0x7fa04811b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.509+0000 7fa05056a700 1 --2- 172.21.15.59:0/3874457480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04806c0e0 0x7fa04811a680 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.509+0000 7fa05056a700 1 --2- 172.21.15.59:0/3874457480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa048134ec0 0x7fa04811abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.509+0000 7fa05056a700 1 -- 172.21.15.59:0/3874457480 >> 172.21.15.59:0/3874457480 conn(0x7fa0480a4210 msgr2=0x7fa048099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:10.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.509+0000 7fa05056a700 1 -- 172.21.15.59:0/3874457480 shutdown_connections 2023-09-30T22:33:10.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.509+0000 7fa05056a700 1 -- 172.21.15.59:0/3874457480 wait complete. 2023-09-30T22:33:10.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:10.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.566+0000 7ff9566f1700 1 -- 172.21.15.59:0/2201146245 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff950123c00 con 0x7ff950139170 2023-09-30T22:33:10.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.566+0000 7ff94cff9700 1 -- 172.21.15.59:0/2201146245 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff94802f350 con 0x7ff950139170 2023-09-30T22:33:10.567 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:10.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.568+0000 7ff9566f1700 1 -- 172.21.15.59:0/2201146245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff950139170 msgr2=0x7ff950121220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.568+0000 7ff9566f1700 1 --2- 172.21.15.59:0/2201146245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff950139170 0x7ff950121220 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff948008dd0 tx=0x7ff948004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.569+0000 7ff9566f1700 1 -- 172.21.15.59:0/2201146245 shutdown_connections 2023-09-30T22:33:10.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.569+0000 7ff9566f1700 1 --2- 172.21.15.59:0/2201146245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff950139170 0x7ff950121220 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.569+0000 7ff9566f1700 1 --2- 172.21.15.59:0/2201146245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff95009d6f0 0x7ff9501207a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.569+0000 7ff9566f1700 1 --2- 172.21.15.59:0/2201146245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff95009e1d0 0x7ff950120ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.569+0000 7ff9566f1700 1 -- 172.21.15.59:0/2201146245 >> 172.21.15.59:0/2201146245 conn(0x7ff950066f50 msgr2=0x7ff950136a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:10.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.569+0000 7ff9566f1700 1 -- 172.21.15.59:0/2201146245 shutdown_connections 2023-09-30T22:33:10.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.569+0000 7ff9566f1700 1 -- 172.21.15.59:0/2201146245 wait complete. 2023-09-30T22:33:10.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.574+0000 7fe5b7fff700 1 -- 172.21.15.59:0/757445513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe5b0005590 con 0x7fe5d409d6f0 2023-09-30T22:33:10.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.574+0000 7fe5ca7fc700 1 -- 172.21.15.59:0/757445513 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5d0006cc0 con 0x7fe5d409d6f0 2023-09-30T22:33:10.575 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.577+0000 7fe5b7fff700 1 -- 172.21.15.59:0/757445513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d409d6f0 msgr2=0x7fe5d411e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.577+0000 7fe5b7fff700 1 --2- 172.21.15.59:0/757445513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d409d6f0 0x7fe5d411e3e0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0016000 tx=0x7fe5d0004750 comp rx=0 tx=0).stop 2023-09-30T22:33:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.577+0000 7fe5b7fff700 1 -- 172.21.15.59:0/757445513 shutdown_connections 2023-09-30T22:33:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.577+0000 7fe5b7fff700 1 --2- 172.21.15.59:0/757445513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5d4130d70 0x7fe5d411ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.577+0000 7fe5b7fff700 1 --2- 172.21.15.59:0/757445513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d409d6f0 0x7fe5d411e3e0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.577+0000 7fe5b7fff700 1 --2- 172.21.15.59:0/757445513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5d409e000 0x7fe5d411e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:10.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.577+0000 7fe5b7fff700 1 -- 172.21.15.59:0/757445513 >> 172.21.15.59:0/757445513 conn(0x7fe5d4066f50 msgr2=0x7fe5d40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.577+0000 7fe5b7fff700 1 -- 172.21.15.59:0/757445513 shutdown_connections 2023-09-30T22:33:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:10.577+0000 7fe5b7fff700 1 -- 172.21.15.59:0/757445513 wait complete. 2023-09-30T22:33:10.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:10.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:11.509 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:11.524 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:11.585 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:11.592 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.663+0000 7f463a74e700 1 Processor -- start 2023-09-30T22:33:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.663+0000 7f463a74e700 1 -- start start 2023-09-30T22:33:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.664+0000 7f463a74e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4634131810 0x7f4634131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.664+0000 7f463a74e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f463409a580 0x7f4634139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.664+0000 7f463a74e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46341313c0 con 0x7f4634099a40 2023-09-30T22:33:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.664+0000 7f463a74e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463406e8c0 con 0x7f4634131810 2023-09-30T22:33:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.664+0000 7f463a74e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4634071d20 con 0x7f463409a580 2023-09-30T22:33:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.664+0000 7f4633fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4634131810 0x7f4634131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.664+0000 7f46337fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4634099a40 0x7f4634099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57188/0 (socket says 172.21.15.59:57188) 2023-09-30T22:33:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.664+0000 7f46337fe700 1 -- 172.21.15.59:0/2122430666 learned_addr learned my addr 172.21.15.59:0/2122430666 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.664+0000 7f4638ceb700 1 --2- 172.21.15.59:0/2122430666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f463409a580 0x7f4634139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.665+0000 7f4632ffd700 1 -- 172.21.15.59:0/2122430666 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976122658 0 0) 0x7f46341313c0 con 0x7f4634099a40 2023-09-30T22:33:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.665+0000 7f4632ffd700 1 -- 172.21.15.59:0/2122430666 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f461c0035b0 con 0x7f4634099a40 2023-09-30T22:33:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.665+0000 7f4633fff700 1 -- 172.21.15.59:0/2122430666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f463409a580 msgr2=0x7f4634139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.665+0000 7f4633fff700 1 --2- 172.21.15.59:0/2122430666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f463409a580 0x7f4634139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.665+0000 7f4633fff700 1 -- 172.21.15.59:0/2122430666 >> v1:172.21.15.59:6789/0 conn(0x7f4634099a40 legacy=0x7f4634099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.665+0000 7f4633fff700 1 -- 172.21.15.59:0/2122430666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46340721a0 con 0x7f4634131810 2023-09-30T22:33:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.665+0000 7f4638ceb700 1 --2- 172.21.15.59:0/2122430666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f463409a580 0x7f4634139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.665+0000 7f4633fff700 1 --2- 172.21.15.59:0/2122430666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4634131810 0x7f4634131be0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4624009870 tx=0x7f4624009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d70a83fe8aa24d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.665+0000 7f4632ffd700 1 -- 172.21.15.59:0/2122430666 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624011830 con 0x7f4634131810 2023-09-30T22:33:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.665+0000 7f4632ffd700 1 -- 172.21.15.59:0/2122430666 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4624011990 con 0x7f4634131810 2023-09-30T22:33:11.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.665+0000 7f4632ffd700 1 -- 172.21.15.59:0/2122430666 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624011d20 con 0x7f4634131810 2023-09-30T22:33:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.666+0000 7f463a74e700 1 -- 172.21.15.59:0/2122430666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4634131810 msgr2=0x7f4634131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.666+0000 7f463a74e700 1 --2- 172.21.15.59:0/2122430666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4634131810 0x7f4634131be0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4624009870 tx=0x7f4624009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.666+0000 7f463a74e700 1 -- 172.21.15.59:0/2122430666 shutdown_connections 2023-09-30T22:33:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.666+0000 7f463a74e700 1 --2- 172.21.15.59:0/2122430666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f463409a580 0x7f4634139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.666+0000 7f463a74e700 1 --2- 172.21.15.59:0/2122430666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4634131810 0x7f4634131be0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.666+0000 7f463a74e700 1 -- 172.21.15.59:0/2122430666 >> 172.21.15.59:0/2122430666 conn(0x7f46340a2aa0 msgr2=0x7f46340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.666+0000 7f463a74e700 1 -- 172.21.15.59:0/2122430666 shutdown_connections 2023-09-30T22:33:11.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.666+0000 7f463a74e700 1 -- 172.21.15.59:0/2122430666 wait complete. 2023-09-30T22:33:11.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.668+0000 7f463a74e700 1 Processor -- start 2023-09-30T22:33:11.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.668+0000 7f463a74e700 1 -- start start 2023-09-30T22:33:11.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f463a74e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4634099a40 0x7f4634118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f463a74e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409a580 0x7f4634119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f463a74e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4634131810 0x7f4634119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f463a74e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463411cb40 con 0x7f4634099a40 2023-09-30T22:33:11.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f463a74e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463411a8a0 con 0x7f463409a580 2023-09-30T22:33:11.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f463a74e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f463411c160 con 0x7f4634131810 2023-09-30T22:33:11.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f4633fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4634099a40 0x7f4634118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f46337fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409a580 0x7f4634119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f4633fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4634099a40 0x7f4634118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34682/0 (socket says 172.21.15.59:34682) 2023-09-30T22:33:11.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f4633fff700 1 -- 172.21.15.59:0/2045978520 learned_addr learned my addr 172.21.15.59:0/2045978520 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:11.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f4638ceb700 1 --2- 172.21.15.59:0/2045978520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4634131810 0x7f4634119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f46337fe700 1 -- 172.21.15.59:0/2045978520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4634131810 msgr2=0x7f4634119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f46337fe700 1 --2- 172.21.15.59:0/2045978520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4634131810 0x7f4634119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f46337fe700 1 -- 172.21.15.59:0/2045978520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4634099a40 msgr2=0x7f4634118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f46337fe700 1 --2- 172.21.15.59:0/2045978520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4634099a40 0x7f4634118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.669+0000 7f46337fe700 1 -- 172.21.15.59:0/2045978520 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c009a70 con 0x7f463409a580 2023-09-30T22:33:11.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.670+0000 7f46337fe700 1 --2- 172.21.15.59:0/2045978520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409a580 0x7f4634119210 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f462800c460 tx=0x7f462800c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:11.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.670+0000 7f4630ff9700 1 -- 172.21.15.59:0/2045978520 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628005d70 con 0x7f463409a580 2023-09-30T22:33:11.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.670+0000 7f4630ff9700 1 -- 172.21.15.59:0/2045978520 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46280070d0 con 0x7f463409a580 2023-09-30T22:33:11.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.670+0000 7f463a74e700 1 -- 172.21.15.59:0/2045978520 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46240094a0 con 0x7f463409a580 2023-09-30T22:33:11.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.670+0000 7f4630ff9700 1 -- 172.21.15.59:0/2045978520 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628007440 con 0x7f463409a580 2023-09-30T22:33:11.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.670+0000 7f463a74e700 1 -- 172.21.15.59:0/2045978520 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46340a1ab0 con 0x7f463409a580 2023-09-30T22:33:11.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.671+0000 7f4630ff9700 1 -- 172.21.15.59:0/2045978520 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46280075a0 con 0x7f463409a580 2023-09-30T22:33:11.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.671+0000 7f4630ff9700 1 -- 172.21.15.59:0/2045978520 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f462803e9c0 con 0x7f463409a580 2023-09-30T22:33:11.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.671+0000 7f463a74e700 1 -- 172.21.15.59:0/2045978520 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463411bb20 con 0x7f463409a580 2023-09-30T22:33:11.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.681+0000 7f4630ff9700 1 -- 172.21.15.59:0/2045978520 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f463411bb20 con 0x7f463409a580 2023-09-30T22:33:11.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.707+0000 7fc2360c4700 1 Processor -- start 2023-09-30T22:33:11.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.707+0000 7fc2360c4700 1 -- start start 2023-09-30T22:33:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc2360c4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc23009d6f0 0x7fc23009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc2360c4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23009e000 0x7fc2301339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc2360c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23009e410 0x7fc230133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc2360c4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23006b460 con 0x7fc23009d6f0 2023-09-30T22:33:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc2360c4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23009b120 con 0x7fc23009e410 2023-09-30T22:33:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc2360c4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc23009a7e0 con 0x7fc23009e000 2023-09-30T22:33:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc22f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc23009d6f0 0x7fc23009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc22f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc23009d6f0 0x7fc23009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34690/0 (socket says 172.21.15.59:34690) 2023-09-30T22:33:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc22f7fe700 1 -- 172.21.15.59:0/62693332 learned_addr learned my addr 172.21.15.59:0/62693332 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc22ffff700 1 --2- 172.21.15.59:0/62693332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23009e410 0x7fc230133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc22effd700 1 --2- 172.21.15.59:0/62693332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23009e000 0x7fc2301339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc22effd700 1 -- 172.21.15.59:0/62693332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23009e410 msgr2=0x7fc230133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc22effd700 1 --2- 172.21.15.59:0/62693332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23009e410 0x7fc230133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc22effd700 1 -- 172.21.15.59:0/62693332 >> v2:172.21.15.59:3300/0 conn(0x7fc23009d6f0 msgr2=0x7fc23009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc22effd700 1 --2- 172.21.15.59:0/62693332 >> v2:172.21.15.59:3300/0 conn(0x7fc23009d6f0 0x7fc23009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc22effd700 1 -- 172.21.15.59:0/62693332 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23009a500 con 0x7fc23009e000 2023-09-30T22:33:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.708+0000 7fc22f7fe700 1 --2- 172.21.15.59:0/62693332 >> v2:172.21.15.59:3300/0 conn(0x7fc23009d6f0 0x7fc23009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.709+0000 7fc22effd700 1 --2- 172.21.15.59:0/62693332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23009e000 0x7fc2301339f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc224009870 tx=0x7fc224009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49afbce93a792888 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.709+0000 7fc22e7fc700 1 -- 172.21.15.59:0/62693332 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224011830 con 0x7fc23009e000 2023-09-30T22:33:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.709+0000 7fc22e7fc700 1 -- 172.21.15.59:0/62693332 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc224011990 con 0x7fc23009e000 2023-09-30T22:33:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.709+0000 7fc22e7fc700 1 -- 172.21.15.59:0/62693332 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224011d20 con 0x7fc23009e000 2023-09-30T22:33:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.710+0000 7fc2360c4700 1 -- 172.21.15.59:0/62693332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23009e000 msgr2=0x7fc2301339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.710+0000 7fc2360c4700 1 --2- 172.21.15.59:0/62693332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23009e000 0x7fc2301339f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc224009870 tx=0x7fc224009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.710+0000 7fc2360c4700 1 -- 172.21.15.59:0/62693332 shutdown_connections 2023-09-30T22:33:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.710+0000 7fc2360c4700 1 --2- 172.21.15.59:0/62693332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23009e410 0x7fc230133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.710+0000 7fc2360c4700 1 --2- 172.21.15.59:0/62693332 >> v2:172.21.15.59:3300/0 conn(0x7fc23009d6f0 0x7fc23009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.710+0000 7fc2360c4700 1 --2- 172.21.15.59:0/62693332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23009e000 0x7fc2301339f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.710+0000 7fc2360c4700 1 -- 172.21.15.59:0/62693332 >> 172.21.15.59:0/62693332 conn(0x7fc230066f50 msgr2=0x7fc23009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.710+0000 7fc2360c4700 1 -- 172.21.15.59:0/62693332 shutdown_connections 2023-09-30T22:33:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.710+0000 7fc2360c4700 1 -- 172.21.15.59:0/62693332 wait complete. 2023-09-30T22:33:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.712+0000 7fc2360c4700 1 Processor -- start 2023-09-30T22:33:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.712+0000 7fc2360c4700 1 -- start start 2023-09-30T22:33:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc2360c4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc23009d6f0 0x7fc2301a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc2360c4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23009e000 0x7fc2301a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc2360c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23009e410 0x7fc2301a6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc2360c4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2301a9a40 con 0x7fc23009d6f0 2023-09-30T22:33:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc2360c4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2301aa280 con 0x7fc23009e410 2023-09-30T22:33:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc2360c4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2301a79b0 con 0x7fc23009e000 2023-09-30T22:33:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc22f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc23009d6f0 0x7fc2301a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc22ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23009e410 0x7fc2301a6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc22f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc23009d6f0 0x7fc2301a5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34706/0 (socket says 172.21.15.59:34706) 2023-09-30T22:33:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc22f7fe700 1 -- 172.21.15.59:0/3274681258 learned_addr learned my addr 172.21.15.59:0/3274681258 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc22effd700 1 --2- 172.21.15.59:0/3274681258 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23009e000 0x7fc2301a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc22ffff700 1 -- 172.21.15.59:0/3274681258 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23009e000 msgr2=0x7fc2301a62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc22ffff700 1 --2- 172.21.15.59:0/3274681258 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23009e000 0x7fc2301a62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc22ffff700 1 -- 172.21.15.59:0/3274681258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc23009d6f0 msgr2=0x7fc2301a5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc22ffff700 1 --2- 172.21.15.59:0/3274681258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc23009d6f0 0x7fc2301a5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc22ffff700 1 -- 172.21.15.59:0/3274681258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc220009550 con 0x7fc23009e410 2023-09-30T22:33:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.713+0000 7fc22f7fe700 1 --2- 172.21.15.59:0/3274681258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc23009d6f0 0x7fc2301a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.714+0000 7fc22ffff700 1 --2- 172.21.15.59:0/3274681258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23009e410 0x7fc2301a6820 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc22800efc0 tx=0x7fc22800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.714+0000 7fc217fff700 1 -- 172.21.15.59:0/3274681258 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22800cc90 con 0x7fc23009e410 2023-09-30T22:33:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.714+0000 7fc217fff700 1 -- 172.21.15.59:0/3274681258 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22800f040 con 0x7fc23009e410 2023-09-30T22:33:11.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.714+0000 7fc217fff700 1 -- 172.21.15.59:0/3274681258 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2280146c0 con 0x7fc23009e410 2023-09-30T22:33:11.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.714+0000 7fc2360c4700 1 -- 172.21.15.59:0/3274681258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2240094a0 con 0x7fc23009e410 2023-09-30T22:33:11.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.714+0000 7fc2360c4700 1 -- 172.21.15.59:0/3274681258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23009c710 con 0x7fc23009e410 2023-09-30T22:33:11.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.715+0000 7fc2360c4700 1 -- 172.21.15.59:0/3274681258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc230074ea0 con 0x7fc23009e410 2023-09-30T22:33:11.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.715+0000 7fc217fff700 1 -- 172.21.15.59:0/3274681258 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc228014820 con 0x7fc23009e410 2023-09-30T22:33:11.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.716+0000 7fc217fff700 1 -- 172.21.15.59:0/3274681258 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc228040290 con 0x7fc23009e410 2023-09-30T22:33:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.725+0000 7fc217fff700 1 -- 172.21.15.59:0/3274681258 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc228014ad0 con 0x7fc23009e410 2023-09-30T22:33:11.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.746+0000 7f420803b700 1 Processor -- start 2023-09-30T22:33:11.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.746+0000 7f420803b700 1 -- start start 2023-09-30T22:33:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.747+0000 7f420803b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f420009d6f0 0x7f420009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.747+0000 7f420803b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f420009e410 0x7f4200134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.747+0000 7f420803b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420009b120 con 0x7f420009e000 2023-09-30T22:33:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.747+0000 7f420803b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420006b460 con 0x7f420009d6f0 2023-09-30T22:33:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.747+0000 7f420803b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f420009a7e0 con 0x7f420009e410 2023-09-30T22:33:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.747+0000 7f42055d6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f420009e000 0x7f42001339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57196/0 (socket says 172.21.15.59:57196) 2023-09-30T22:33:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.747+0000 7f42055d6700 1 -- 172.21.15.59:0/3415709960 learned_addr learned my addr 172.21.15.59:0/3415709960 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.747+0000 7f42065d8700 1 --2- 172.21.15.59:0/3415709960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f420009e410 0x7f4200134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.748+0000 7f4204dd5700 1 -- 172.21.15.59:0/3415709960 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076764694 0 0) 0x7f420009b120 con 0x7f420009e000 2023-09-30T22:33:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.748+0000 7f4205dd7700 1 --2- 172.21.15.59:0/3415709960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f420009d6f0 0x7f420009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.748+0000 7f4204dd5700 1 -- 172.21.15.59:0/3415709960 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41ec0035b0 con 0x7f420009e000 2023-09-30T22:33:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.748+0000 7f42065d8700 1 -- 172.21.15.59:0/3415709960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f420009d6f0 msgr2=0x7f420009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.748+0000 7f42065d8700 1 --2- 172.21.15.59:0/3415709960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f420009d6f0 0x7f420009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.748+0000 7f42065d8700 1 -- 172.21.15.59:0/3415709960 >> v1:172.21.15.59:6789/0 conn(0x7f420009e000 legacy=0x7f42001339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.748+0000 7f42065d8700 1 -- 172.21.15.59:0/3415709960 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420009a500 con 0x7f420009e410 2023-09-30T22:33:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.748+0000 7f42065d8700 1 --2- 172.21.15.59:0/3415709960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f420009e410 0x7f4200134100 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009df0 tx=0x7f41f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4984708705deee08 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.748+0000 7f4204dd5700 1 -- 172.21.15.59:0/3415709960 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f800e070 con 0x7f420009e410 2023-09-30T22:33:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.748+0000 7f4204dd5700 1 -- 172.21.15.59:0/3415709960 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f800bae0 con 0x7f420009e410 2023-09-30T22:33:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.748+0000 7f4204dd5700 1 -- 172.21.15.59:0/3415709960 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f800be90 con 0x7f420009e410 2023-09-30T22:33:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.749+0000 7f420803b700 1 -- 172.21.15.59:0/3415709960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f420009e410 msgr2=0x7f4200134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.749+0000 7f420803b700 1 --2- 172.21.15.59:0/3415709960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f420009e410 0x7f4200134100 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009df0 tx=0x7f41f800b330 comp rx=0 tx=0).stop 2023-09-30T22:33:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.749+0000 7f420803b700 1 -- 172.21.15.59:0/3415709960 shutdown_connections 2023-09-30T22:33:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.749+0000 7f420803b700 1 --2- 172.21.15.59:0/3415709960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f420009e410 0x7f4200134100 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.749+0000 7f420803b700 1 --2- 172.21.15.59:0/3415709960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f420009d6f0 0x7f420009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.749+0000 7f420803b700 1 -- 172.21.15.59:0/3415709960 >> 172.21.15.59:0/3415709960 conn(0x7f4200066f50 msgr2=0x7f420009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:11.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.749+0000 7f420803b700 1 -- 172.21.15.59:0/3415709960 shutdown_connections 2023-09-30T22:33:11.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.750+0000 7f420803b700 1 -- 172.21.15.59:0/3415709960 wait complete. 2023-09-30T22:33:11.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.750+0000 7f0db76cf700 1 Processor -- start 2023-09-30T22:33:11.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.750+0000 7f0db76cf700 1 -- start start 2023-09-30T22:33:11.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.751+0000 7f0db76cf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0db012cf60 0x7f0db006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.751+0000 7f0db76cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0db012f8b0 0x7f0db012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.751+0000 7f0db76cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0db0130260 0x7f0db0136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.751+0000 7f0db76cf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db012d330 con 0x7f0db012cf60 2023-09-30T22:33:11.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.751+0000 7f0db76cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db012cd90 con 0x7f0db012f8b0 2023-09-30T22:33:11.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.751+0000 7f0db76cf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0db01306d0 con 0x7f0db0130260 2023-09-30T22:33:11.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.751+0000 7f420803b700 1 Processor -- start 2023-09-30T22:33:11.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.751+0000 7f420803b700 1 -- start start 2023-09-30T22:33:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.751+0000 7f0db5c6c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0db0130260 0x7f0db0136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.751+0000 7f0db4c6a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0db012f8b0 0x7f0db012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.751+0000 7f0db5c6c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0db0130260 0x7f0db0136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52164/0 (socket says 172.21.15.59:52164) 2023-09-30T22:33:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.751+0000 7f0db5c6c700 1 -- 172.21.15.59:0/3383263278 learned_addr learned my addr 172.21.15.59:0/3383263278 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.751+0000 7f0db4c6a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0db012f8b0 0x7f0db012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35686/0 (socket says 172.21.15.59:35686) 2023-09-30T22:33:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.751+0000 7f0db546b700 1 --2- 172.21.15.59:0/3383263278 >> v2:172.21.15.59:3300/0 conn(0x7f0db012cf60 0x7f0db006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f0db4c6a700 1 -- 172.21.15.59:0/3383263278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0db0130260 msgr2=0x7f0db0136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f0db4c6a700 1 --2- 172.21.15.59:0/3383263278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0db0130260 0x7f0db0136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f0db4c6a700 1 -- 172.21.15.59:0/3383263278 >> v2:172.21.15.59:3300/0 conn(0x7f0db012cf60 msgr2=0x7f0db006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f0db4c6a700 1 --2- 172.21.15.59:0/3383263278 >> v2:172.21.15.59:3300/0 conn(0x7f0db012cf60 0x7f0db006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f0db4c6a700 1 -- 172.21.15.59:0/3383263278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db0071780 con 0x7f0db012f8b0 2023-09-30T22:33:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f420803b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f420009d6f0 0x7f4200127d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f420803b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f420009e000 0x7f4200128250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f420803b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420009e410 0x7f42001cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f420803b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420012a9e0 con 0x7f420009e410 2023-09-30T22:33:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f420803b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4200071fd0 con 0x7f420009e000 2023-09-30T22:33:11.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f420803b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f420009c710 con 0x7f420009d6f0 2023-09-30T22:33:11.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f0db4c6a700 1 --2- 172.21.15.59:0/3383263278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0db012f8b0 0x7f0db012fd20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0da000bae0 tx=0x7f0da000bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=744478f125b0082b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:11.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f42055d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f420009e000 0x7f4200128250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f0da7fff700 1 -- 172.21.15.59:0/3383263278 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da000dc70 con 0x7f0db012f8b0 2023-09-30T22:33:11.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f42055d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f420009e000 0x7f4200128250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35700/0 (socket says 172.21.15.59:35700) 2023-09-30T22:33:11.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f42055d6700 1 -- 172.21.15.59:0/427182758 learned_addr learned my addr 172.21.15.59:0/427182758 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:11.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f0da7fff700 1 -- 172.21.15.59:0/3383263278 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da000ddd0 con 0x7f0db012f8b0 2023-09-30T22:33:11.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f0da7fff700 1 -- 172.21.15.59:0/3383263278 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0010690 con 0x7f0db012f8b0 2023-09-30T22:33:11.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.752+0000 7f42065d8700 1 --2- 172.21.15.59:0/427182758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420009e410 0x7f42001cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.753+0000 7f42055d6700 1 -- 172.21.15.59:0/427182758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f420009d6f0 msgr2=0x7f4200127d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.753+0000 7f42055d6700 1 --2- 172.21.15.59:0/427182758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f420009d6f0 0x7f4200127d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.753+0000 7f42055d6700 1 -- 172.21.15.59:0/427182758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420009e410 msgr2=0x7f42001cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.753+0000 7f42055d6700 1 --2- 172.21.15.59:0/427182758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420009e410 0x7f42001cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.753+0000 7f42055d6700 1 -- 172.21.15.59:0/427182758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f8009a70 con 0x7f420009e000 2023-09-30T22:33:11.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.753+0000 7f42055d6700 1 --2- 172.21.15.59:0/427182758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f420009e000 0x7f4200128250 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f41f0005910 tx=0x7f41f000ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:11.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.753+0000 7f41f67fc700 1 -- 172.21.15.59:0/427182758 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0005d70 con 0x7f420009e000 2023-09-30T22:33:11.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.753+0000 7f0db76cf700 1 -- 172.21.15.59:0/3383263278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0db012f8b0 msgr2=0x7f0db012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.753+0000 7f41f67fc700 1 -- 172.21.15.59:0/427182758 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f00070d0 con 0x7f420009e000 2023-09-30T22:33:11.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.753+0000 7f0db76cf700 1 --2- 172.21.15.59:0/3383263278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0db012f8b0 0x7f0db012fd20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0da000bae0 tx=0x7f0da000bdf0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.753+0000 7f41f67fc700 1 -- 172.21.15.59:0/427182758 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0007460 con 0x7f420009e000 2023-09-30T22:33:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.753+0000 7f420803b700 1 -- 172.21.15.59:0/427182758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4200129000 con 0x7f420009e000 2023-09-30T22:33:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.753+0000 7f420803b700 1 -- 172.21.15.59:0/427182758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4200128970 con 0x7f420009e000 2023-09-30T22:33:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.754+0000 7f0db76cf700 1 -- 172.21.15.59:0/3383263278 shutdown_connections 2023-09-30T22:33:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.754+0000 7f0db76cf700 1 --2- 172.21.15.59:0/3383263278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0db0130260 0x7f0db0136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.754+0000 7f0db76cf700 1 --2- 172.21.15.59:0/3383263278 >> v2:172.21.15.59:3300/0 conn(0x7f0db012cf60 0x7f0db006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.754+0000 7f0db76cf700 1 --2- 172.21.15.59:0/3383263278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0db012f8b0 0x7f0db012fd20 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.754+0000 7f0db76cf700 1 -- 172.21.15.59:0/3383263278 >> 172.21.15.59:0/3383263278 conn(0x7f0db00a2aa0 msgr2=0x7f0db00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:11.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.754+0000 7f41f67fc700 1 -- 172.21.15.59:0/427182758 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41f00075c0 con 0x7f420009e000 2023-09-30T22:33:11.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.754+0000 7f41f67fc700 1 -- 172.21.15.59:0/427182758 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f41f003ed90 con 0x7f420009e000 2023-09-30T22:33:11.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.755+0000 7f420803b700 1 -- 172.21.15.59:0/427182758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42001291f0 con 0x7f420009e000 2023-09-30T22:33:11.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.755+0000 7f0db76cf700 1 -- 172.21.15.59:0/3383263278 shutdown_connections 2023-09-30T22:33:11.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.755+0000 7f0db76cf700 1 -- 172.21.15.59:0/3383263278 wait complete. 2023-09-30T22:33:11.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.756+0000 7f0db76cf700 1 Processor -- start 2023-09-30T22:33:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.756+0000 7f0db76cf700 1 -- start start 2023-09-30T22:33:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.757+0000 7f0db76cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0db012cf60 0x7f0db01c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.757+0000 7f0db76cf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db012f8b0 0x7f0db01c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.757+0000 7f0db76cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0db0130260 0x7f0db01c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.757+0000 7f0db76cf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db009c660 con 0x7f0db012f8b0 2023-09-30T22:33:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.757+0000 7f0db76cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db01c9110 con 0x7f0db012cf60 2023-09-30T22:33:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.757+0000 7f0db76cf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0db012d9d0 con 0x7f0db0130260 2023-09-30T22:33:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.757+0000 7f0db5c6c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0db0130260 0x7f0db01c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.757+0000 7f0db5c6c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0db0130260 0x7f0db01c4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52190/0 (socket says 172.21.15.59:52190) 2023-09-30T22:33:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.757+0000 7f0db5c6c700 1 -- 172.21.15.59:0/427288473 learned_addr learned my addr 172.21.15.59:0/427288473 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.758+0000 7f0db5c6c700 1 -- 172.21.15.59:0/427288473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0db012cf60 msgr2=0x7f0db01c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.758+0000 7f0db5c6c700 1 --2- 172.21.15.59:0/427288473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0db012cf60 0x7f0db01c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.758+0000 7f0db5c6c700 1 -- 172.21.15.59:0/427288473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db012f8b0 msgr2=0x7f0db01c8bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:33:11.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.758+0000 7f0db5c6c700 1 --2- 172.21.15.59:0/427288473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db012f8b0 0x7f0db01c8bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.758+0000 7f0db5c6c700 1 -- 172.21.15.59:0/427288473 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da000b740 con 0x7f0db0130260 2023-09-30T22:33:11.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.758+0000 7f0db5c6c700 1 --2- 172.21.15.59:0/427288473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0db0130260 0x7f0db01c4c70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009da0 tx=0x7f0da800e3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:11.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.758+0000 7f0da5ffb700 1 -- 172.21.15.59:0/427288473 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da800eb40 con 0x7f0db0130260 2023-09-30T22:33:11.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.758+0000 7f0da5ffb700 1 -- 172.21.15.59:0/427288473 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8010040 con 0x7f0db0130260 2023-09-30T22:33:11.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.758+0000 7f0da5ffb700 1 -- 172.21.15.59:0/427288473 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8009e80 con 0x7f0db0130260 2023-09-30T22:33:11.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.758+0000 7f0db76cf700 1 -- 172.21.15.59:0/427288473 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db0129fa0 con 0x7f0db0130260 2023-09-30T22:33:11.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.759+0000 7f0db76cf700 1 -- 172.21.15.59:0/427288473 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db009cd80 con 0x7f0db0130260 2023-09-30T22:33:11.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.760+0000 7f0db76cf700 1 -- 172.21.15.59:0/427288473 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db0074ea0 con 0x7f0db0130260 2023-09-30T22:33:11.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.760+0000 7f0da5ffb700 1 -- 172.21.15.59:0/427288473 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0da801d410 con 0x7f0db0130260 2023-09-30T22:33:11.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.760+0000 7f0da5ffb700 1 -- 172.21.15.59:0/427288473 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0da803f5f0 con 0x7f0db0130260 2023-09-30T22:33:11.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.763+0000 7f41f67fc700 1 -- 172.21.15.59:0/427182758 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41f0017080 con 0x7f420009e000 2023-09-30T22:33:11.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.765+0000 7f0da5ffb700 1 -- 172.21.15.59:0/427288473 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0da801c730 con 0x7f0db0130260 2023-09-30T22:33:11.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.895+0000 7f463a74e700 1 -- 172.21.15.59:0/2045978520 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f463411bb20 con 0x7f463409a580 2023-09-30T22:33:11.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.895+0000 7f4630ff9700 1 -- 172.21.15.59:0/2045978520 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f463411bb20 con 0x7f463409a580 2023-09-30T22:33:11.896 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.898+0000 7f463a74e700 1 -- 172.21.15.59:0/2045978520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409a580 msgr2=0x7f4634119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.898+0000 7f463a74e700 1 --2- 172.21.15.59:0/2045978520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409a580 0x7f4634119210 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f462800c460 tx=0x7f462800c770 comp rx=0 tx=0).stop 2023-09-30T22:33:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.898+0000 7f463a74e700 1 -- 172.21.15.59:0/2045978520 shutdown_connections 2023-09-30T22:33:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.898+0000 7f463a74e700 1 --2- 172.21.15.59:0/2045978520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4634131810 0x7f4634119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.898+0000 7f463a74e700 1 --2- 172.21.15.59:0/2045978520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4634099a40 0x7f4634118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.899+0000 7f463a74e700 1 --2- 172.21.15.59:0/2045978520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409a580 0x7f4634119210 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.899+0000 7f463a74e700 1 -- 172.21.15.59:0/2045978520 >> 172.21.15.59:0/2045978520 conn(0x7f46340a2aa0 msgr2=0x7f463412e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:11.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.899+0000 7f463a74e700 1 -- 172.21.15.59:0/2045978520 shutdown_connections 2023-09-30T22:33:11.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.899+0000 7f463a74e700 1 -- 172.21.15.59:0/2045978520 wait complete. 2023-09-30T22:33:11.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:11.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.937+0000 7fc2360c4700 1 -- 172.21.15.59:0/3274681258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc23006c360 con 0x7fc23009e410 2023-09-30T22:33:11.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.937+0000 7fc217fff700 1 -- 172.21.15.59:0/3274681258 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc228012340 con 0x7fc23009e410 2023-09-30T22:33:11.938 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:11.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.940+0000 7fc2360c4700 1 -- 172.21.15.59:0/3274681258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23009e410 msgr2=0x7fc2301a6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.940+0000 7fc2360c4700 1 --2- 172.21.15.59:0/3274681258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23009e410 0x7fc2301a6820 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc22800efc0 tx=0x7fc22800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.940+0000 7fc2360c4700 1 -- 172.21.15.59:0/3274681258 shutdown_connections 2023-09-30T22:33:11.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.940+0000 7fc2360c4700 1 --2- 172.21.15.59:0/3274681258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc23009e410 0x7fc2301a6820 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.940+0000 7fc2360c4700 1 --2- 172.21.15.59:0/3274681258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc23009d6f0 0x7fc2301a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.940+0000 7fc2360c4700 1 --2- 172.21.15.59:0/3274681258 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc23009e000 0x7fc2301a62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.940+0000 7fc2360c4700 1 -- 172.21.15.59:0/3274681258 >> 172.21.15.59:0/3274681258 conn(0x7fc230066f50 msgr2=0x7fc2301bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:11.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.940+0000 7fc2360c4700 1 -- 172.21.15.59:0/3274681258 shutdown_connections 2023-09-30T22:33:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.940+0000 7fc2360c4700 1 -- 172.21.15.59:0/3274681258 wait complete. 2023-09-30T22:33:11.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:11.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.974+0000 7f420803b700 1 -- 172.21.15.59:0/427182758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f42000a1580 con 0x7f420009e000 2023-09-30T22:33:11.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.974+0000 7f41f67fc700 1 -- 172.21.15.59:0/427182758 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41f000e280 con 0x7f420009e000 2023-09-30T22:33:11.974 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:11.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.976+0000 7f0db76cf700 1 -- 172.21.15.59:0/427288473 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0db00713a0 con 0x7f0db0130260 2023-09-30T22:33:11.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.976+0000 7f0da5ffb700 1 -- 172.21.15.59:0/427288473 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0da801c370 con 0x7f0db0130260 2023-09-30T22:33:11.976 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.977+0000 7f420803b700 1 -- 172.21.15.59:0/427182758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f420009e000 msgr2=0x7f4200128250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.977+0000 7f420803b700 1 --2- 172.21.15.59:0/427182758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f420009e000 0x7f4200128250 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f41f0005910 tx=0x7f41f000ca90 comp rx=0 tx=0).stop 2023-09-30T22:33:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.977+0000 7f420803b700 1 -- 172.21.15.59:0/427182758 shutdown_connections 2023-09-30T22:33:11.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.977+0000 7f420803b700 1 --2- 172.21.15.59:0/427182758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f420009d6f0 0x7f4200127d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.977+0000 7f420803b700 1 --2- 172.21.15.59:0/427182758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420009e410 0x7f42001cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.977+0000 7f420803b700 1 --2- 172.21.15.59:0/427182758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f420009e000 0x7f4200128250 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.977+0000 7f420803b700 1 -- 172.21.15.59:0/427182758 >> 172.21.15.59:0/427182758 conn(0x7f4200066f50 msgr2=0x7f420006ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:11.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.977+0000 7f420803b700 1 -- 172.21.15.59:0/427182758 shutdown_connections 2023-09-30T22:33:11.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.977+0000 7f420803b700 1 -- 172.21.15.59:0/427182758 wait complete. 2023-09-30T22:33:11.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.979+0000 7f0db76cf700 1 -- 172.21.15.59:0/427288473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0db0130260 msgr2=0x7f0db01c4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:11.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.979+0000 7f0db76cf700 1 --2- 172.21.15.59:0/427288473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0db0130260 0x7f0db01c4c70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009da0 tx=0x7f0da800e3b0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.979+0000 7f0db76cf700 1 -- 172.21.15.59:0/427288473 shutdown_connections 2023-09-30T22:33:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.979+0000 7f0db76cf700 1 --2- 172.21.15.59:0/427288473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0db0130260 0x7f0db01c4c70 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.979+0000 7f0db76cf700 1 --2- 172.21.15.59:0/427288473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0db012cf60 0x7f0db01c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.979+0000 7f0db76cf700 1 --2- 172.21.15.59:0/427288473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db012f8b0 0x7f0db01c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.979+0000 7f0db76cf700 1 -- 172.21.15.59:0/427288473 >> 172.21.15.59:0/427288473 conn(0x7f0db00a2aa0 msgr2=0x7f0db00a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.979+0000 7f0db76cf700 1 -- 172.21.15.59:0/427288473 shutdown_connections 2023-09-30T22:33:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:11.979+0000 7f0db76cf700 1 -- 172.21.15.59:0/427288473 wait complete. 2023-09-30T22:33:11.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:11.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:12.914 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:12.956 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:12.992 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:12.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:13.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.077+0000 7f6dc1b9a700 1 Processor -- start 2023-09-30T22:33:13.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.077+0000 7f6dc1b9a700 1 -- start start 2023-09-30T22:33:13.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dc1b9a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dbc0a0a30 0x7f6dbc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dc1b9a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6dbc0a1340 0x7f6dbc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dc1b9a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dbc133fa0 0x7f6dbc134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dc1b9a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dbc09edd0 con 0x7f6dbc0a1340 2023-09-30T22:33:13.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dc1b9a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc09e1f0 con 0x7f6dbc133fa0 2023-09-30T22:33:13.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dc1b9a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc09dc50 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dbaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6dbc0a1340 0x7f6dbc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dbb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dbc0a0a30 0x7f6dbc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dbaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6dbc0a1340 0x7f6dbc133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34744/0 (socket says 172.21.15.59:34744) 2023-09-30T22:33:13.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dbaffd700 1 -- 172.21.15.59:0/1139674905 learned_addr learned my addr 172.21.15.59:0/1139674905 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:13.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dbbfff700 1 --2- 172.21.15.59:0/1139674905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dbc133fa0 0x7f6dbc134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dbb7fe700 1 -- 172.21.15.59:0/1139674905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dbc133fa0 msgr2=0x7f6dbc134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:13.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dbb7fe700 1 --2- 172.21.15.59:0/1139674905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dbc133fa0 0x7f6dbc134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dbb7fe700 1 -- 172.21.15.59:0/1139674905 >> v2:172.21.15.59:3300/0 conn(0x7f6dbc0a1340 msgr2=0x7f6dbc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:13.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dbb7fe700 1 --2- 172.21.15.59:0/1139674905 >> v2:172.21.15.59:3300/0 conn(0x7f6dbc0a1340 0x7f6dbc133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dbb7fe700 1 -- 172.21.15.59:0/1139674905 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc0a1fe0 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.078+0000 7f6dbaffd700 1 --2- 172.21.15.59:0/1139674905 >> v2:172.21.15.59:3300/0 conn(0x7f6dbc0a1340 0x7f6dbc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:13.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.079+0000 7f6dbb7fe700 1 --2- 172.21.15.59:0/1139674905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dbc0a0a30 0x7f6dbc0a0e00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009870 tx=0x7f6dac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da5e3fc559e3f012 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:13.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.079+0000 7f6dba7fc700 1 -- 172.21.15.59:0/1139674905 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac011830 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.079+0000 7f6dba7fc700 1 -- 172.21.15.59:0/1139674905 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac011990 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.079+0000 7f6dba7fc700 1 -- 172.21.15.59:0/1139674905 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac011d20 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.080+0000 7f6dc1b9a700 1 -- 172.21.15.59:0/1139674905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dbc0a0a30 msgr2=0x7f6dbc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.080+0000 7f6dc1b9a700 1 --2- 172.21.15.59:0/1139674905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dbc0a0a30 0x7f6dbc0a0e00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009870 tx=0x7f6dac009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:13.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.080+0000 7f6dc1b9a700 1 -- 172.21.15.59:0/1139674905 shutdown_connections 2023-09-30T22:33:13.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.080+0000 7f6dc1b9a700 1 --2- 172.21.15.59:0/1139674905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dbc133fa0 0x7f6dbc134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.080+0000 7f6dc1b9a700 1 --2- 172.21.15.59:0/1139674905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dbc0a0a30 0x7f6dbc0a0e00 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.080+0000 7f6dc1b9a700 1 --2- 172.21.15.59:0/1139674905 >> v2:172.21.15.59:3300/0 conn(0x7f6dbc0a1340 0x7f6dbc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.080+0000 7f6dc1b9a700 1 -- 172.21.15.59:0/1139674905 >> 172.21.15.59:0/1139674905 conn(0x7f6dbc0a6550 msgr2=0x7f6dbc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:13.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.080+0000 7f6dc1b9a700 1 -- 172.21.15.59:0/1139674905 shutdown_connections 2023-09-30T22:33:13.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.080+0000 7f6dc1b9a700 1 -- 172.21.15.59:0/1139674905 wait complete. 2023-09-30T22:33:13.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.081+0000 7f6dc1b9a700 1 Processor -- start 2023-09-30T22:33:13.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.082+0000 7f6dc1b9a700 1 -- start start 2023-09-30T22:33:13.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.082+0000 7f6dc1b9a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dbc0a0a30 0x7f6dbc1207a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.082+0000 7f6dc1b9a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dbc0a1340 0x7f6dbc120ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.082+0000 7f6dc1b9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dbc133fa0 0x7f6dbc121220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.082+0000 7f6dc1b9a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc124080 con 0x7f6dbc133fa0 2023-09-30T22:33:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.082+0000 7f6dc1b9a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc133b90 con 0x7f6dbc0a1340 2023-09-30T22:33:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.082+0000 7f6dc1b9a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc123600 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.083+0000 7f6dbbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dbc133fa0 0x7f6dbc121220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.083+0000 7f6dbaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dbc0a1340 0x7f6dbc120ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.083+0000 7f6dbbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dbc133fa0 0x7f6dbc121220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34758/0 (socket says 172.21.15.59:34758) 2023-09-30T22:33:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.083+0000 7f6dbbfff700 1 -- 172.21.15.59:0/2125302266 learned_addr learned my addr 172.21.15.59:0/2125302266 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.083+0000 7f6dbb7fe700 1 --2- 172.21.15.59:0/2125302266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dbc0a0a30 0x7f6dbc1207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.083+0000 7f6dbb7fe700 1 -- 172.21.15.59:0/2125302266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dbc0a1340 msgr2=0x7f6dbc120ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.083+0000 7f6dbb7fe700 1 --2- 172.21.15.59:0/2125302266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dbc0a1340 0x7f6dbc120ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.083+0000 7f6dbb7fe700 1 -- 172.21.15.59:0/2125302266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dbc133fa0 msgr2=0x7f6dbc121220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.083+0000 7f6dbb7fe700 1 --2- 172.21.15.59:0/2125302266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dbc133fa0 0x7f6dbc121220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.083+0000 7f6dbb7fe700 1 -- 172.21.15.59:0/2125302266 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db0009550 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.083+0000 7f6dbb7fe700 1 --2- 172.21.15.59:0/2125302266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dbc0a0a30 0x7f6dbc1207a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6dac016000 tx=0x7f6dac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:13.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.083+0000 7f6dbaffd700 1 --2- 172.21.15.59:0/2125302266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dbc0a1340 0x7f6dbc120ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:13.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.084+0000 7f6da3fff700 1 -- 172.21.15.59:0/2125302266 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac004450 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.084+0000 7f6da3fff700 1 -- 172.21.15.59:0/2125302266 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac01e070 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.084+0000 7f6dc1b9a700 1 -- 172.21.15.59:0/2125302266 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac0094a0 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.084+0000 7f6da3fff700 1 -- 172.21.15.59:0/2125302266 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0038a0 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.084+0000 7f6dc1b9a700 1 -- 172.21.15.59:0/2125302266 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc0a3750 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.085+0000 7f6da3fff700 1 -- 172.21.15.59:0/2125302266 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6dac003a00 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.085+0000 7f6da3fff700 1 -- 172.21.15.59:0/2125302266 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6dac040280 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.085+0000 7f6dc1b9a700 1 -- 172.21.15.59:0/2125302266 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc0a0280 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.094+0000 7f6da3fff700 1 -- 172.21.15.59:0/2125302266 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6dac003cb0 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.110+0000 7f3f9f437700 1 Processor -- start 2023-09-30T22:33:13.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.111+0000 7f3f9f437700 1 -- start start 2023-09-30T22:33:13.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.111+0000 7f3f9f437700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9812cf60 0x7f3f9806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.111+0000 7f3f9f437700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f9812f8b0 0x7f3f9812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.111+0000 7f3f9f437700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f98130260 0x7f3f98136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.111+0000 7f3f9f437700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9812d330 con 0x7f3f98130260 2023-09-30T22:33:13.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.111+0000 7f3f9f437700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9812cd90 con 0x7f3f9812f8b0 2023-09-30T22:33:13.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.111+0000 7f3f9f437700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f981306d0 con 0x7f3f9812cf60 2023-09-30T22:33:13.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.111+0000 7f3f9d1d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9812cf60 0x7f3f9806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.111+0000 7f3f9d1d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9812cf60 0x7f3f9806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52212/0 (socket says 172.21.15.59:52212) 2023-09-30T22:33:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.111+0000 7f3f9d1d3700 1 -- 172.21.15.59:0/113658161 learned_addr learned my addr 172.21.15.59:0/113658161 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.112+0000 7f3f9c9d2700 1 --2- 172.21.15.59:0/113658161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f9812f8b0 0x7f3f9812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.112+0000 7f3f9d9d4700 1 --2- 172.21.15.59:0/113658161 >> v2:172.21.15.59:3300/0 conn(0x7f3f98130260 0x7f3f98136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.112+0000 7f3f9d1d3700 1 -- 172.21.15.59:0/113658161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f9812f8b0 msgr2=0x7f3f9812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.112+0000 7f3f9d1d3700 1 --2- 172.21.15.59:0/113658161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f9812f8b0 0x7f3f9812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.112+0000 7f3f9d1d3700 1 -- 172.21.15.59:0/113658161 >> v2:172.21.15.59:3300/0 conn(0x7f3f98130260 msgr2=0x7f3f98136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.112+0000 7f3f9d1d3700 1 --2- 172.21.15.59:0/113658161 >> v2:172.21.15.59:3300/0 conn(0x7f3f98130260 0x7f3f98136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.112+0000 7f3f9d1d3700 1 -- 172.21.15.59:0/113658161 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f98071780 con 0x7f3f9812cf60 2023-09-30T22:33:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.112+0000 7f3f9d1d3700 1 --2- 172.21.15.59:0/113658161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9812cf60 0x7f3f9806f5d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400b9a0 tx=0x7f3f9400bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c65f8266375cd69 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.112+0000 7f3f8ffff700 1 -- 172.21.15.59:0/113658161 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94009030 con 0x7f3f9812cf60 2023-09-30T22:33:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.112+0000 7f3f8ffff700 1 -- 172.21.15.59:0/113658161 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9400cba0 con 0x7f3f9812cf60 2023-09-30T22:33:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.112+0000 7f3f8ffff700 1 -- 172.21.15.59:0/113658161 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400d450 con 0x7f3f9812cf60 2023-09-30T22:33:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.113+0000 7f3f9f437700 1 -- 172.21.15.59:0/113658161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9812cf60 msgr2=0x7f3f9806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.113+0000 7f3f9f437700 1 --2- 172.21.15.59:0/113658161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9812cf60 0x7f3f9806f5d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400b9a0 tx=0x7f3f9400bcb0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.113+0000 7f3f9f437700 1 -- 172.21.15.59:0/113658161 shutdown_connections 2023-09-30T22:33:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.113+0000 7f3f9f437700 1 --2- 172.21.15.59:0/113658161 >> v2:172.21.15.59:3300/0 conn(0x7f3f98130260 0x7f3f98136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.113+0000 7f3f9f437700 1 --2- 172.21.15.59:0/113658161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9812cf60 0x7f3f9806f5d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.113+0000 7f3f9f437700 1 --2- 172.21.15.59:0/113658161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f9812f8b0 0x7f3f9812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.113+0000 7f3f9f437700 1 -- 172.21.15.59:0/113658161 >> 172.21.15.59:0/113658161 conn(0x7f3f980a2aa0 msgr2=0x7f3f980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.113+0000 7f3f9f437700 1 -- 172.21.15.59:0/113658161 shutdown_connections 2023-09-30T22:33:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.113+0000 7f3f9f437700 1 -- 172.21.15.59:0/113658161 wait complete. 2023-09-30T22:33:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.115+0000 7f3f9f437700 1 Processor -- start 2023-09-30T22:33:13.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.115+0000 7f3f9f437700 1 -- start start 2023-09-30T22:33:13.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.115+0000 7f3f9f437700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9812cf60 0x7f3f981c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.115+0000 7f3f9f437700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f9812f8b0 0x7f3f981c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.115+0000 7f3f9f437700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f98130260 0x7f3f981c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.115+0000 7f3f9f437700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9809d180 con 0x7f3f9812cf60 2023-09-30T22:33:13.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.115+0000 7f3f9f437700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9809ded0 con 0x7f3f9812f8b0 2023-09-30T22:33:13.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.115+0000 7f3f9f437700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9809cf50 con 0x7f3f98130260 2023-09-30T22:33:13.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.115+0000 7f3f9d1d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9812cf60 0x7f3f981c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.115+0000 7f3f9d1d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9812cf60 0x7f3f981c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34772/0 (socket says 172.21.15.59:34772) 2023-09-30T22:33:13.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.115+0000 7f3f9d1d3700 1 -- 172.21.15.59:0/1158848267 learned_addr learned my addr 172.21.15.59:0/1158848267 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:13.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.116+0000 7f3f9d9d4700 1 --2- 172.21.15.59:0/1158848267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f98130260 0x7f3f981c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.116+0000 7f3f9c9d2700 1 --2- 172.21.15.59:0/1158848267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f9812f8b0 0x7f3f981c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.116+0000 7f3f9d1d3700 1 -- 172.21.15.59:0/1158848267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f98130260 msgr2=0x7f3f981c4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.116+0000 7f3f9d1d3700 1 --2- 172.21.15.59:0/1158848267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f98130260 0x7f3f981c4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.116+0000 7f3f9d1d3700 1 -- 172.21.15.59:0/1158848267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f9812f8b0 msgr2=0x7f3f981c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.116+0000 7f3f9d1d3700 1 --2- 172.21.15.59:0/1158848267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f9812f8b0 0x7f3f981c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.116+0000 7f3f9d1d3700 1 -- 172.21.15.59:0/1158848267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9400b600 con 0x7f3f9812cf60 2023-09-30T22:33:13.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.116+0000 7f3f9d1d3700 1 --2- 172.21.15.59:0/1158848267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9812cf60 0x7f3f981c3fe0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400bcf0 tx=0x7f3f94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:13.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.116+0000 7f3f8dffb700 1 -- 172.21.15.59:0/1158848267 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94022070 con 0x7f3f9812cf60 2023-09-30T22:33:13.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.116+0000 7f3f8dffb700 1 -- 172.21.15.59:0/1158848267 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f940038b0 con 0x7f3f9812cf60 2023-09-30T22:33:13.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.116+0000 7f3f8dffb700 1 -- 172.21.15.59:0/1158848267 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94009040 con 0x7f3f9812cf60 2023-09-30T22:33:13.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.116+0000 7f3f9f437700 1 -- 172.21.15.59:0/1158848267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9812f4f0 con 0x7f3f9812cf60 2023-09-30T22:33:13.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.117+0000 7f3f9f437700 1 -- 172.21.15.59:0/1158848267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f98119390 con 0x7f3f9812cf60 2023-09-30T22:33:13.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.118+0000 7f3f8dffb700 1 -- 172.21.15.59:0/1158848267 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f9401c070 con 0x7f3f9812cf60 2023-09-30T22:33:13.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.118+0000 7f3f8dffb700 1 -- 172.21.15.59:0/1158848267 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f94040410 con 0x7f3f9812cf60 2023-09-30T22:33:13.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.118+0000 7f3f9f437700 1 -- 172.21.15.59:0/1158848267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f980701b0 con 0x7f3f9812cf60 2023-09-30T22:33:13.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.123+0000 7f3f8dffb700 1 -- 172.21.15.59:0/1158848267 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f94026370 con 0x7f3f9812cf60 2023-09-30T22:33:13.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.151+0000 7fa5b73e5700 1 Processor -- start 2023-09-30T22:33:13.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.151+0000 7fa5b73e5700 1 -- start start 2023-09-30T22:33:13.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b73e5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b009d6f0 0x7fa5b009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b73e5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa5b009e000 0x7fa5b01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b73e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b009e410 0x7fa5b0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b73e5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b006b460 con 0x7fa5b009e000 2023-09-30T22:33:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b73e5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b009b120 con 0x7fa5b009e410 2023-09-30T22:33:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b73e5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b009a7e0 con 0x7fa5b009d6f0 2023-09-30T22:33:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b5181700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b009d6f0 0x7fa5b009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b5982700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b009e410 0x7fa5b0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b4980700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa5b009e000 0x7fa5b01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b5181700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b009d6f0 0x7fa5b009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52230/0 (socket says 172.21.15.59:52230) 2023-09-30T22:33:13.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b5982700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b009e410 0x7fa5b0133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35752/0 (socket says 172.21.15.59:35752) 2023-09-30T22:33:13.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b5181700 1 -- 172.21.15.59:0/592514722 learned_addr learned my addr 172.21.15.59:0/592514722 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:13.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b5181700 1 -- 172.21.15.59:0/592514722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b009e410 msgr2=0x7fa5b0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:13.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b5181700 1 --2- 172.21.15.59:0/592514722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b009e410 0x7fa5b0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b5181700 1 -- 172.21.15.59:0/592514722 >> v2:172.21.15.59:3300/0 conn(0x7fa5b009e000 msgr2=0x7fa5b01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:13.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b5181700 1 --2- 172.21.15.59:0/592514722 >> v2:172.21.15.59:3300/0 conn(0x7fa5b009e000 0x7fa5b01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b5181700 1 -- 172.21.15.59:0/592514722 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b009a500 con 0x7fa5b009d6f0 2023-09-30T22:33:13.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.152+0000 7fa5b5982700 1 --2- 172.21.15.59:0/592514722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b009e410 0x7fa5b0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:13.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.153+0000 7fa5b5181700 1 --2- 172.21.15.59:0/592514722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b009d6f0 0x7fa5b009dac0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac009920 tx=0x7fa5ac009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5216a3e1509ca9e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:13.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.153+0000 7fa5a7fff700 1 -- 172.21.15.59:0/592514722 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac011830 con 0x7fa5b009d6f0 2023-09-30T22:33:13.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.153+0000 7fa5a7fff700 1 -- 172.21.15.59:0/592514722 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac011990 con 0x7fa5b009d6f0 2023-09-30T22:33:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.153+0000 7fa5a7fff700 1 -- 172.21.15.59:0/592514722 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac011d20 con 0x7fa5b009d6f0 2023-09-30T22:33:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.154+0000 7fa5b73e5700 1 -- 172.21.15.59:0/592514722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b009d6f0 msgr2=0x7fa5b009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.154+0000 7fa5b73e5700 1 --2- 172.21.15.59:0/592514722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b009d6f0 0x7fa5b009dac0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac009920 tx=0x7fa5ac009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.154+0000 7fa5b73e5700 1 -- 172.21.15.59:0/592514722 shutdown_connections 2023-09-30T22:33:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.154+0000 7fa5b73e5700 1 --2- 172.21.15.59:0/592514722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b009e410 0x7fa5b0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.154+0000 7fa5b73e5700 1 --2- 172.21.15.59:0/592514722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b009d6f0 0x7fa5b009dac0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.154+0000 7fa5b73e5700 1 --2- 172.21.15.59:0/592514722 >> v2:172.21.15.59:3300/0 conn(0x7fa5b009e000 0x7fa5b01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.154+0000 7fa5b73e5700 1 -- 172.21.15.59:0/592514722 >> 172.21.15.59:0/592514722 conn(0x7fa5b0066f50 msgr2=0x7fa5b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.154+0000 7fa5b73e5700 1 -- 172.21.15.59:0/592514722 shutdown_connections 2023-09-30T22:33:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.154+0000 7fa5b73e5700 1 -- 172.21.15.59:0/592514722 wait complete. 2023-09-30T22:33:13.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.155+0000 7fa5b73e5700 1 Processor -- start 2023-09-30T22:33:13.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.155+0000 7fa5b73e5700 1 -- start start 2023-09-30T22:33:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.156+0000 7fa5b73e5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b009d6f0 0x7fa5b01a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.156+0000 7fa5b73e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b009e000 0x7fa5b01a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.156+0000 7fa5b73e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b009e410 0x7fa5b01a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.156+0000 7fa5b73e5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b01a9a40 con 0x7fa5b009e410 2023-09-30T22:33:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.156+0000 7fa5b73e5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b01aa280 con 0x7fa5b009e000 2023-09-30T22:33:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.156+0000 7fa5b73e5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b01a79b0 con 0x7fa5b009d6f0 2023-09-30T22:33:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.156+0000 7fa5b4980700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b009e000 0x7fa5b01a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.156+0000 7fa5b5982700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b009e410 0x7fa5b01a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.156+0000 7fa5b4980700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b009e000 0x7fa5b01a6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35768/0 (socket says 172.21.15.59:35768) 2023-09-30T22:33:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.156+0000 7fa5b4980700 1 -- 172.21.15.59:0/4103626294 learned_addr learned my addr 172.21.15.59:0/4103626294 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.157+0000 7fa5b5181700 1 --2- 172.21.15.59:0/4103626294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b009d6f0 0x7fa5b01a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.157+0000 7fa5b4980700 1 -- 172.21.15.59:0/4103626294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b009d6f0 msgr2=0x7fa5b01a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.157+0000 7fa5b4980700 1 --2- 172.21.15.59:0/4103626294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b009d6f0 0x7fa5b01a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.157+0000 7fa5b4980700 1 -- 172.21.15.59:0/4103626294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b009e410 msgr2=0x7fa5b01a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.157+0000 7fa5b4980700 1 --2- 172.21.15.59:0/4103626294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b009e410 0x7fa5b01a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.157+0000 7fa5b4980700 1 -- 172.21.15.59:0/4103626294 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a8009a70 con 0x7fa5b009e000 2023-09-30T22:33:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.157+0000 7fa5b5982700 1 --2- 172.21.15.59:0/4103626294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b009e410 0x7fa5b01a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.157+0000 7fa5b4980700 1 --2- 172.21.15.59:0/4103626294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b009e000 0x7fa5b01a6370 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000e980 tx=0x7fa5a000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.157+0000 7fa5a5ffb700 1 -- 172.21.15.59:0/4103626294 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0009710 con 0x7fa5b009e000 2023-09-30T22:33:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.157+0000 7fa5a5ffb700 1 -- 172.21.15.59:0/4103626294 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a000c640 con 0x7fa5b009e000 2023-09-30T22:33:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.157+0000 7fa5a5ffb700 1 -- 172.21.15.59:0/4103626294 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000c9b0 con 0x7fa5b009e000 2023-09-30T22:33:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.157+0000 7fa5b73e5700 1 -- 172.21.15.59:0/4103626294 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ac009550 con 0x7fa5b009e000 2023-09-30T22:33:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.158+0000 7fa5b73e5700 1 -- 172.21.15.59:0/4103626294 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b009c710 con 0x7fa5b009e000 2023-09-30T22:33:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.159+0000 7fa5a5ffb700 1 -- 172.21.15.59:0/4103626294 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5a000cb10 con 0x7fa5b009e000 2023-09-30T22:33:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.159+0000 7fa5b73e5700 1 -- 172.21.15.59:0/4103626294 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b0074ea0 con 0x7fa5b009e000 2023-09-30T22:33:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.159+0000 7fa5a5ffb700 1 -- 172.21.15.59:0/4103626294 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa5a003fab0 con 0x7fa5b009e000 2023-09-30T22:33:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.164+0000 7fa5a5ffb700 1 -- 172.21.15.59:0/4103626294 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5a001b3b0 con 0x7fa5b009e000 2023-09-30T22:33:13.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.190+0000 7f6c47ad3700 1 Processor -- start 2023-09-30T22:33:13.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.190+0000 7f6c47ad3700 1 -- start start 2023-09-30T22:33:13.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.191+0000 7f6c47ad3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c400a14a0 0x7f6c4006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.191+0000 7f6c47ad3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c40138cf0 0x7f6c4013b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.191+0000 7f6c47ad3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c400a2a20 con 0x7f6c400a09c0 2023-09-30T22:33:13.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.191+0000 7f6c47ad3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4009e690 con 0x7f6c400a14a0 2023-09-30T22:33:13.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.191+0000 7f6c47ad3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c400a1cc0 con 0x7f6c40138cf0 2023-09-30T22:33:13.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.191+0000 7f6c4506e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c400a14a0 0x7f6c4006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.191+0000 7f6c4586f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6c400a09c0 0x7f6c400a0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57212/0 (socket says 172.21.15.59:57212) 2023-09-30T22:33:13.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.191+0000 7f6c4586f700 1 -- 172.21.15.59:0/907003368 learned_addr learned my addr 172.21.15.59:0/907003368 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:13.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.191+0000 7f6c46070700 1 --2- 172.21.15.59:0/907003368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c40138cf0 0x7f6c4013b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.191+0000 7f6c4506e700 1 -- 172.21.15.59:0/907003368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c40138cf0 msgr2=0x7f6c4013b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:13.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.191+0000 7f6c4486d700 1 -- 172.21.15.59:0/907003368 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112995225 0 0) 0x7f6c3c001110 con 0x7f6c400a09c0 2023-09-30T22:33:13.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.191+0000 7f6c4506e700 1 --2- 172.21.15.59:0/907003368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c40138cf0 0x7f6c4013b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.191+0000 7f6c4506e700 1 -- 172.21.15.59:0/907003368 >> v1:172.21.15.59:6789/0 conn(0x7f6c400a09c0 legacy=0x7f6c400a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.191+0000 7f6c4506e700 1 -- 172.21.15.59:0/907003368 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c400a1f40 con 0x7f6c400a14a0 2023-09-30T22:33:13.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.192+0000 7f6c4506e700 1 --2- 172.21.15.59:0/907003368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c400a14a0 0x7f6c4006c5d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009870 tx=0x7f6c30009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=504fdeb5960e99f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:13.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.192+0000 7f6c4486d700 1 -- 172.21.15.59:0/907003368 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30011830 con 0x7f6c400a14a0 2023-09-30T22:33:13.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.192+0000 7f6c4486d700 1 -- 172.21.15.59:0/907003368 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c30011990 con 0x7f6c400a14a0 2023-09-30T22:33:13.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.192+0000 7f6c4486d700 1 -- 172.21.15.59:0/907003368 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30011d20 con 0x7f6c400a14a0 2023-09-30T22:33:13.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.193+0000 7f6c47ad3700 1 -- 172.21.15.59:0/907003368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c400a14a0 msgr2=0x7f6c4006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.193+0000 7f6c47ad3700 1 --2- 172.21.15.59:0/907003368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c400a14a0 0x7f6c4006c5d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009870 tx=0x7f6c30009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:13.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.193+0000 7f6c47ad3700 1 -- 172.21.15.59:0/907003368 shutdown_connections 2023-09-30T22:33:13.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.193+0000 7f6c47ad3700 1 --2- 172.21.15.59:0/907003368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c40138cf0 0x7f6c4013b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.193+0000 7f6c47ad3700 1 --2- 172.21.15.59:0/907003368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c400a14a0 0x7f6c4006c5d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.193+0000 7f6c47ad3700 1 -- 172.21.15.59:0/907003368 >> 172.21.15.59:0/907003368 conn(0x7f6c400a60c0 msgr2=0x7f6c400a64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:13.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.193+0000 7f6c47ad3700 1 -- 172.21.15.59:0/907003368 shutdown_connections 2023-09-30T22:33:13.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.193+0000 7f6c47ad3700 1 -- 172.21.15.59:0/907003368 wait complete. 2023-09-30T22:33:13.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.194+0000 7f6c47ad3700 1 Processor -- start 2023-09-30T22:33:13.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.194+0000 7f6c47ad3700 1 -- start start 2023-09-30T22:33:13.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.194+0000 7f6c47ad3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400a09c0 0x7f6c40133980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.194+0000 7f6c47ad3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c400a14a0 0x7f6c40133ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.194+0000 7f6c47ad3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c40138cf0 0x7f6c40134400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:13.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.195+0000 7f6c47ad3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c40137410 con 0x7f6c400a09c0 2023-09-30T22:33:13.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.195+0000 7f6c47ad3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c40138090 con 0x7f6c40138cf0 2023-09-30T22:33:13.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.195+0000 7f6c47ad3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c400a3630 con 0x7f6c400a14a0 2023-09-30T22:33:13.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.195+0000 7f6c4506e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c400a14a0 0x7f6c40133ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.195+0000 7f6c4586f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400a09c0 0x7f6c40133980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.195+0000 7f6c4506e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c400a14a0 0x7f6c40133ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52264/0 (socket says 172.21.15.59:52264) 2023-09-30T22:33:13.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.195+0000 7f6c4506e700 1 -- 172.21.15.59:0/502837093 learned_addr learned my addr 172.21.15.59:0/502837093 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:13.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.195+0000 7f6c46070700 1 --2- 172.21.15.59:0/502837093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c40138cf0 0x7f6c40134400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:13.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.195+0000 7f6c4506e700 1 -- 172.21.15.59:0/502837093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c40138cf0 msgr2=0x7f6c40134400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.195+0000 7f6c4506e700 1 --2- 172.21.15.59:0/502837093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c40138cf0 0x7f6c40134400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.195+0000 7f6c4506e700 1 -- 172.21.15.59:0/502837093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400a09c0 msgr2=0x7f6c40133980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.195+0000 7f6c4506e700 1 --2- 172.21.15.59:0/502837093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400a09c0 0x7f6c40133980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.195+0000 7f6c4506e700 1 -- 172.21.15.59:0/502837093 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c300094a0 con 0x7f6c400a14a0 2023-09-30T22:33:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.195+0000 7f6c4506e700 1 --2- 172.21.15.59:0/502837093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c400a14a0 0x7f6c40133ec0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6c30000c00 tx=0x7f6c30004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.196+0000 7f6c367fc700 1 -- 172.21.15.59:0/502837093 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30004400 con 0x7f6c400a14a0 2023-09-30T22:33:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.196+0000 7f6c367fc700 1 -- 172.21.15.59:0/502837093 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c30027070 con 0x7f6c400a14a0 2023-09-30T22:33:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.196+0000 7f6c367fc700 1 -- 172.21.15.59:0/502837093 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c300038a0 con 0x7f6c400a14a0 2023-09-30T22:33:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.196+0000 7f6c47ad3700 1 -- 172.21.15.59:0/502837093 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4009cea0 con 0x7f6c400a14a0 2023-09-30T22:33:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.196+0000 7f6c47ad3700 1 -- 172.21.15.59:0/502837093 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c40138330 con 0x7f6c400a14a0 2023-09-30T22:33:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.198+0000 7f6c367fc700 1 -- 172.21.15.59:0/502837093 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c30029030 con 0x7f6c400a14a0 2023-09-30T22:33:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.198+0000 7f6c47ad3700 1 -- 172.21.15.59:0/502837093 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4004f2a0 con 0x7f6c400a14a0 2023-09-30T22:33:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.198+0000 7f6c367fc700 1 -- 172.21.15.59:0/502837093 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6c30004560 con 0x7f6c400a14a0 2023-09-30T22:33:13.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.207+0000 7f6c367fc700 1 -- 172.21.15.59:0/502837093 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c30015030 con 0x7f6c400a14a0 2023-09-30T22:33:13.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.343+0000 7f3f9f437700 1 -- 172.21.15.59:0/1158848267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3f98074ea0 con 0x7f3f9812cf60 2023-09-30T22:33:13.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.343+0000 7f3f8dffb700 1 -- 172.21.15.59:0/1158848267 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f9401a030 con 0x7f3f9812cf60 2023-09-30T22:33:13.344 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:13.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.346+0000 7f3f9f437700 1 -- 172.21.15.59:0/1158848267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9812cf60 msgr2=0x7f3f981c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.346+0000 7f3f9f437700 1 --2- 172.21.15.59:0/1158848267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9812cf60 0x7f3f981c3fe0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400bcf0 tx=0x7f3f94004750 comp rx=0 tx=0).stop 2023-09-30T22:33:13.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.346+0000 7f3f9f437700 1 -- 172.21.15.59:0/1158848267 shutdown_connections 2023-09-30T22:33:13.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.346+0000 7f3f9f437700 1 --2- 172.21.15.59:0/1158848267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f98130260 0x7f3f981c4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.346+0000 7f3f9f437700 1 --2- 172.21.15.59:0/1158848267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9812cf60 0x7f3f981c3fe0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.346+0000 7f3f9f437700 1 --2- 172.21.15.59:0/1158848267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f9812f8b0 0x7f3f981c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.346+0000 7f3f9f437700 1 -- 172.21.15.59:0/1158848267 >> 172.21.15.59:0/1158848267 conn(0x7f3f980a2aa0 msgr2=0x7f3f9806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:13.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.346+0000 7f3f9f437700 1 -- 172.21.15.59:0/1158848267 shutdown_connections 2023-09-30T22:33:13.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.346+0000 7f3f9f437700 1 -- 172.21.15.59:0/1158848267 wait complete. 2023-09-30T22:33:13.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.376+0000 7f6dc1b9a700 1 -- 172.21.15.59:0/2125302266 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6dbc074ea0 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.376+0000 7f6da3fff700 1 -- 172.21.15.59:0/2125302266 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6dac040080 con 0x7f6dbc0a0a30 2023-09-30T22:33:13.376 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.378+0000 7f6dc1b9a700 1 -- 172.21.15.59:0/2125302266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dbc0a0a30 msgr2=0x7f6dbc1207a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.378+0000 7f6dc1b9a700 1 --2- 172.21.15.59:0/2125302266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dbc0a0a30 0x7f6dbc1207a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6dac016000 tx=0x7f6dac004750 comp rx=0 tx=0).stop 2023-09-30T22:33:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.378+0000 7f6dc1b9a700 1 -- 172.21.15.59:0/2125302266 shutdown_connections 2023-09-30T22:33:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.378+0000 7f6dc1b9a700 1 --2- 172.21.15.59:0/2125302266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dbc0a0a30 0x7f6dbc1207a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.378+0000 7f6dc1b9a700 1 --2- 172.21.15.59:0/2125302266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dbc133fa0 0x7f6dbc121220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.378+0000 7f6dc1b9a700 1 --2- 172.21.15.59:0/2125302266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dbc0a1340 0x7f6dbc120ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.378+0000 7f6dc1b9a700 1 -- 172.21.15.59:0/2125302266 >> 172.21.15.59:0/2125302266 conn(0x7f6dbc0a6550 msgr2=0x7f6dbc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.379+0000 7f6dc1b9a700 1 -- 172.21.15.59:0/2125302266 shutdown_connections 2023-09-30T22:33:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.379+0000 7f6dc1b9a700 1 -- 172.21.15.59:0/2125302266 wait complete. 2023-09-30T22:33:13.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.384+0000 7fa5b73e5700 1 -- 172.21.15.59:0/4103626294 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa5b009ace0 con 0x7fa5b009e000 2023-09-30T22:33:13.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.385+0000 7fa5a5ffb700 1 -- 172.21.15.59:0/4103626294 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5a0017070 con 0x7fa5b009e000 2023-09-30T22:33:13.385 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.387+0000 7fa5b73e5700 1 -- 172.21.15.59:0/4103626294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b009e000 msgr2=0x7fa5b01a6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.387+0000 7fa5b73e5700 1 --2- 172.21.15.59:0/4103626294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b009e000 0x7fa5b01a6370 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000e980 tx=0x7fa5a000ec90 comp rx=0 tx=0).stop 2023-09-30T22:33:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.387+0000 7fa5b73e5700 1 -- 172.21.15.59:0/4103626294 shutdown_connections 2023-09-30T22:33:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.387+0000 7fa5b73e5700 1 --2- 172.21.15.59:0/4103626294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b009d6f0 0x7fa5b01a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.387+0000 7fa5b73e5700 1 --2- 172.21.15.59:0/4103626294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b009e410 0x7fa5b01a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.387+0000 7fa5b73e5700 1 --2- 172.21.15.59:0/4103626294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b009e000 0x7fa5b01a6370 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.387+0000 7fa5b73e5700 1 -- 172.21.15.59:0/4103626294 >> 172.21.15.59:0/4103626294 conn(0x7fa5b0066f50 msgr2=0x7fa5b01bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.388+0000 7fa5b73e5700 1 -- 172.21.15.59:0/4103626294 shutdown_connections 2023-09-30T22:33:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.388+0000 7fa5b73e5700 1 -- 172.21.15.59:0/4103626294 wait complete. 2023-09-30T22:33:13.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:13.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:13.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.441+0000 7f6c47ad3700 1 -- 172.21.15.59:0/502837093 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6c4009dd50 con 0x7f6c400a14a0 2023-09-30T22:33:13.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.442+0000 7f6c367fc700 1 -- 172.21.15.59:0/502837093 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c30010970 con 0x7f6c400a14a0 2023-09-30T22:33:13.442 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:13.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.444+0000 7f6c47ad3700 1 -- 172.21.15.59:0/502837093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c400a14a0 msgr2=0x7f6c40133ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:13.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.444+0000 7f6c47ad3700 1 --2- 172.21.15.59:0/502837093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c400a14a0 0x7f6c40133ec0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6c30000c00 tx=0x7f6c30004750 comp rx=0 tx=0).stop 2023-09-30T22:33:13.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.444+0000 7f6c47ad3700 1 -- 172.21.15.59:0/502837093 shutdown_connections 2023-09-30T22:33:13.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.444+0000 7f6c47ad3700 1 --2- 172.21.15.59:0/502837093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c40138cf0 0x7f6c40134400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.444+0000 7f6c47ad3700 1 --2- 172.21.15.59:0/502837093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400a09c0 0x7f6c40133980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.444+0000 7f6c47ad3700 1 --2- 172.21.15.59:0/502837093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c400a14a0 0x7f6c40133ec0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:13.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.444+0000 7f6c47ad3700 1 -- 172.21.15.59:0/502837093 >> 172.21.15.59:0/502837093 conn(0x7f6c400a60c0 msgr2=0x7f6c401391d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:13.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.444+0000 7f6c47ad3700 1 -- 172.21.15.59:0/502837093 shutdown_connections 2023-09-30T22:33:13.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:13.444+0000 7f6c47ad3700 1 -- 172.21.15.59:0/502837093 wait complete. 2023-09-30T22:33:13.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:14.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:14.395 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:14.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:14.459 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.527+0000 7fef73bd4700 1 Processor -- start 2023-09-30T22:33:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.528+0000 7fef73bd4700 1 -- start start 2023-09-30T22:33:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef73bd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef6c09e930 0x7fef6c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef73bd4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef6c09f240 0x7fef6c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef73bd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef6c09f650 0x7fef6c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef73bd4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c070940 con 0x7fef6c09f240 2023-09-30T22:33:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef73bd4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c06fd60 con 0x7fef6c09e930 2023-09-30T22:33:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef73bd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c06fa80 con 0x7fef6c09f650 2023-09-30T22:33:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef71970700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef6c09e930 0x7fef6c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef7116f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef6c09f240 0x7fef6c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef7116f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef6c09f240 0x7fef6c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48784/0 (socket says 172.21.15.59:48784) 2023-09-30T22:33:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef71970700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef6c09e930 0x7fef6c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50882/0 (socket says 172.21.15.59:50882) 2023-09-30T22:33:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef7116f700 1 -- 172.21.15.59:0/697113884 learned_addr learned my addr 172.21.15.59:0/697113884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef72171700 1 --2- 172.21.15.59:0/697113884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef6c09f650 0x7fef6c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef71970700 1 -- 172.21.15.59:0/697113884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef6c09f650 msgr2=0x7fef6c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef71970700 1 --2- 172.21.15.59:0/697113884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef6c09f650 0x7fef6c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef71970700 1 -- 172.21.15.59:0/697113884 >> v2:172.21.15.59:3300/0 conn(0x7fef6c09f240 msgr2=0x7fef6c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef71970700 1 --2- 172.21.15.59:0/697113884 >> v2:172.21.15.59:3300/0 conn(0x7fef6c09f240 0x7fef6c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef71970700 1 -- 172.21.15.59:0/697113884 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c09fb60 con 0x7fef6c09e930 2023-09-30T22:33:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.529+0000 7fef7116f700 1 --2- 172.21.15.59:0/697113884 >> v2:172.21.15.59:3300/0 conn(0x7fef6c09f240 0x7fef6c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.530+0000 7fef71970700 1 --2- 172.21.15.59:0/697113884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef6c09e930 0x7fef6c09ed00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fef68009840 tx=0x7fef68009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b938328ecc209584 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.530+0000 7fef7096e700 1 -- 172.21.15.59:0/697113884 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef68011830 con 0x7fef6c09e930 2023-09-30T22:33:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.530+0000 7fef7096e700 1 -- 172.21.15.59:0/697113884 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef68011990 con 0x7fef6c09e930 2023-09-30T22:33:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.530+0000 7fef7096e700 1 -- 172.21.15.59:0/697113884 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef68011d20 con 0x7fef6c09e930 2023-09-30T22:33:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.531+0000 7fef73bd4700 1 -- 172.21.15.59:0/697113884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef6c09e930 msgr2=0x7fef6c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.531+0000 7fef73bd4700 1 --2- 172.21.15.59:0/697113884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef6c09e930 0x7fef6c09ed00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fef68009840 tx=0x7fef68009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.531+0000 7fef73bd4700 1 -- 172.21.15.59:0/697113884 shutdown_connections 2023-09-30T22:33:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.531+0000 7fef73bd4700 1 --2- 172.21.15.59:0/697113884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef6c09f650 0x7fef6c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.531+0000 7fef73bd4700 1 --2- 172.21.15.59:0/697113884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef6c09e930 0x7fef6c09ed00 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.531+0000 7fef73bd4700 1 --2- 172.21.15.59:0/697113884 >> v2:172.21.15.59:3300/0 conn(0x7fef6c09f240 0x7fef6c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.531+0000 7fef73bd4700 1 -- 172.21.15.59:0/697113884 >> 172.21.15.59:0/697113884 conn(0x7fef6c0a4210 msgr2=0x7fef6c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.531+0000 7fef73bd4700 1 -- 172.21.15.59:0/697113884 shutdown_connections 2023-09-30T22:33:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.531+0000 7fef73bd4700 1 -- 172.21.15.59:0/697113884 wait complete. 2023-09-30T22:33:14.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.532+0000 7fef73bd4700 1 Processor -- start 2023-09-30T22:33:14.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.533+0000 7fef73bd4700 1 -- start start 2023-09-30T22:33:14.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.533+0000 7fef73bd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef6c09e930 0x7fef6c1a4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.533+0000 7fef73bd4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef6c09f240 0x7fef6c1a4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.533+0000 7fef73bd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef6c09f650 0x7fef6c1a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.533+0000 7fef73bd4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c1a61e0 con 0x7fef6c09f240 2023-09-30T22:33:14.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.533+0000 7fef73bd4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0a3550 con 0x7fef6c09f650 2023-09-30T22:33:14.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.533+0000 7fef73bd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c071d20 con 0x7fef6c09e930 2023-09-30T22:33:14.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.534+0000 7fef71970700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef6c09e930 0x7fef6c1a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.534+0000 7fef72171700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef6c09f650 0x7fef6c1a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.534+0000 7fef71970700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef6c09e930 0x7fef6c1a4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51392/0 (socket says 172.21.15.59:51392) 2023-09-30T22:33:14.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.534+0000 7fef71970700 1 -- 172.21.15.59:0/795423212 learned_addr learned my addr 172.21.15.59:0/795423212 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:14.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.534+0000 7fef7116f700 1 --2- 172.21.15.59:0/795423212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef6c09f240 0x7fef6c1a4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.534+0000 7fef71970700 1 -- 172.21.15.59:0/795423212 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef6c09f650 msgr2=0x7fef6c1a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.534+0000 7fef71970700 1 --2- 172.21.15.59:0/795423212 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef6c09f650 0x7fef6c1a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.534+0000 7fef71970700 1 -- 172.21.15.59:0/795423212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef6c09f240 msgr2=0x7fef6c1a4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.534+0000 7fef71970700 1 --2- 172.21.15.59:0/795423212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef6c09f240 0x7fef6c1a4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.534+0000 7fef71970700 1 -- 172.21.15.59:0/795423212 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c009550 con 0x7fef6c09e930 2023-09-30T22:33:14.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.534+0000 7fef71970700 1 --2- 172.21.15.59:0/795423212 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef6c09e930 0x7fef6c1a4020 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fef68009fd0 tx=0x7fef68004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:14.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.534+0000 7fef627fc700 1 -- 172.21.15.59:0/795423212 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef68004450 con 0x7fef6c09e930 2023-09-30T22:33:14.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.535+0000 7fef627fc700 1 -- 172.21.15.59:0/795423212 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6801f070 con 0x7fef6c09e930 2023-09-30T22:33:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.535+0000 7fef627fc700 1 -- 172.21.15.59:0/795423212 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef680038e0 con 0x7fef6c09e930 2023-09-30T22:33:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.535+0000 7fef73bd4700 1 -- 172.21.15.59:0/795423212 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef680094a0 con 0x7fef6c09e930 2023-09-30T22:33:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.535+0000 7fef73bd4700 1 -- 172.21.15.59:0/795423212 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c0a0190 con 0x7fef6c09e930 2023-09-30T22:33:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.536+0000 7fef627fc700 1 -- 172.21.15.59:0/795423212 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef68003a40 con 0x7fef6c09e930 2023-09-30T22:33:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.536+0000 7fef627fc700 1 -- 172.21.15.59:0/795423212 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fef68021070 con 0x7fef6c09e930 2023-09-30T22:33:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.536+0000 7fef73bd4700 1 -- 172.21.15.59:0/795423212 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6c1a0b30 con 0x7fef6c09e930 2023-09-30T22:33:14.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.541+0000 7fef627fc700 1 -- 172.21.15.59:0/795423212 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef68015020 con 0x7fef6c09e930 2023-09-30T22:33:14.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.563+0000 7f8145ffa700 1 Processor -- start 2023-09-30T22:33:14.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.563+0000 7fb4e48b2700 1 Processor -- start 2023-09-30T22:33:14.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.563+0000 7fb4e48b2700 1 -- start start 2023-09-30T22:33:14.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7f8145ffa700 1 -- start start 2023-09-30T22:33:14.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7f8145ffa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8140131810 0x7f8140131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7f8145ffa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8140099a40 0x7f8140099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7f8145ffa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81401313c0 con 0x7f814009a3b0 2023-09-30T22:33:14.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7f8145ffa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814009b580 con 0x7f8140131810 2023-09-30T22:33:14.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7f8145ffa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f814006e8c0 con 0x7f8140099a40 2023-09-30T22:33:14.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7fb4e48b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e01338a0 0x7fb4e0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7fb4e48b2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4e009e930 0x7fb4e013b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7fb4e48b2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e006ef30 con 0x7fb4e009de50 2023-09-30T22:33:14.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7fb4e48b2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e006fef0 con 0x7fb4e009e930 2023-09-30T22:33:14.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7fb4e48b2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e01334b0 con 0x7fb4e01338a0 2023-09-30T22:33:14.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7f813effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8140099a40 0x7f8140099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7fb4de59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e01338a0 0x7fb4e0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7f813effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8140099a40 0x7f8140099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51398/0 (socket says 172.21.15.59:51398) 2023-09-30T22:33:14.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.565+0000 7f813effd700 1 -- 172.21.15.59:0/2585164977 learned_addr learned my addr 172.21.15.59:0/2585164977 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:14.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7fb4de59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e01338a0 0x7fb4e0133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51406/0 (socket says 172.21.15.59:51406) 2023-09-30T22:33:14.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.564+0000 7fb4de59c700 1 -- 172.21.15.59:0/1044027127 learned_addr learned my addr 172.21.15.59:0/1044027127 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:14.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.565+0000 7fb4ded9d700 1 --2- 172.21.15.59:0/1044027127 >> v2:172.21.15.59:3300/0 conn(0x7fb4e009e930 0x7fb4e013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.565+0000 7fb4de59c700 1 -- 172.21.15.59:0/1044027127 >> v2:172.21.15.59:3300/0 conn(0x7fb4e009e930 msgr2=0x7fb4e013b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:14.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.565+0000 7f813f7fe700 1 --2- 172.21.15.59:0/2585164977 >> v2:172.21.15.59:3300/0 conn(0x7f8140131810 0x7f8140131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.565+0000 7f813effd700 1 -- 172.21.15.59:0/2585164977 >> v2:172.21.15.59:3300/0 conn(0x7f8140131810 msgr2=0x7f8140131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:14.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.565+0000 7f813effd700 1 --2- 172.21.15.59:0/2585164977 >> v2:172.21.15.59:3300/0 conn(0x7f8140131810 0x7f8140131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.565+0000 7f813effd700 1 -- 172.21.15.59:0/2585164977 >> v1:172.21.15.59:6789/0 conn(0x7f814009a3b0 legacy=0x7f8140138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.565+0000 7f813effd700 1 -- 172.21.15.59:0/2585164977 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814009a830 con 0x7f8140099a40 2023-09-30T22:33:14.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.565+0000 7fb4de59c700 1 --2- 172.21.15.59:0/1044027127 >> v2:172.21.15.59:3300/0 conn(0x7fb4e009e930 0x7fb4e013b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.565+0000 7fb4de59c700 1 -- 172.21.15.59:0/1044027127 >> v1:172.21.15.59:6789/0 conn(0x7fb4e009de50 legacy=0x7fb4e009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:14.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.565+0000 7fb4de59c700 1 -- 172.21.15.59:0/1044027127 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e006fc30 con 0x7fb4e01338a0 2023-09-30T22:33:14.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.565+0000 7fb4ded9d700 1 --2- 172.21.15.59:0/1044027127 >> v2:172.21.15.59:3300/0 conn(0x7fb4e009e930 0x7fb4e013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:14.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.565+0000 7fb4de59c700 1 --2- 172.21.15.59:0/1044027127 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e01338a0 0x7fb4e0133c70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00098f0 tx=0x7fb4d0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfe6e630608cd1ad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:14.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.565+0000 7f813effd700 1 --2- 172.21.15.59:0/2585164977 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8140099a40 0x7f8140099e70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8134009920 tx=0x7f8134009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cec58518d854617 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:14.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.566+0000 7fb4dd59a700 1 -- 172.21.15.59:0/1044027127 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0004230 con 0x7fb4e01338a0 2023-09-30T22:33:14.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.566+0000 7fb4dd59a700 1 -- 172.21.15.59:0/1044027127 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d0004390 con 0x7fb4e01338a0 2023-09-30T22:33:14.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.566+0000 7fb4dd59a700 1 -- 172.21.15.59:0/1044027127 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00036a0 con 0x7fb4e01338a0 2023-09-30T22:33:14.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.566+0000 7f813e7fc700 1 -- 172.21.15.59:0/2585164977 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813400ba20 con 0x7f8140099a40 2023-09-30T22:33:14.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.566+0000 7f813e7fc700 1 -- 172.21.15.59:0/2585164977 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813400bb80 con 0x7f8140099a40 2023-09-30T22:33:14.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.566+0000 7f813e7fc700 1 -- 172.21.15.59:0/2585164977 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134009e70 con 0x7f8140099a40 2023-09-30T22:33:14.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.566+0000 7fb4e48b2700 1 -- 172.21.15.59:0/1044027127 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e01338a0 msgr2=0x7fb4e0133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.566+0000 7fb4e48b2700 1 --2- 172.21.15.59:0/1044027127 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e01338a0 0x7fb4e0133c70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00098f0 tx=0x7fb4d0009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:14.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.567+0000 7fb4e48b2700 1 -- 172.21.15.59:0/1044027127 shutdown_connections 2023-09-30T22:33:14.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.567+0000 7fb4e48b2700 1 --2- 172.21.15.59:0/1044027127 >> v2:172.21.15.59:3300/0 conn(0x7fb4e009e930 0x7fb4e013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.567+0000 7fb4e48b2700 1 --2- 172.21.15.59:0/1044027127 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e01338a0 0x7fb4e0133c70 secure :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00098f0 tx=0x7fb4d0009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:14.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.567+0000 7fb4e48b2700 1 -- 172.21.15.59:0/1044027127 >> 172.21.15.59:0/1044027127 conn(0x7fb4e00a2aa0 msgr2=0x7fb4e00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:14.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.567+0000 7f8145ffa700 1 -- 172.21.15.59:0/2585164977 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8140099a40 msgr2=0x7f8140099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.567+0000 7f8145ffa700 1 --2- 172.21.15.59:0/2585164977 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8140099a40 0x7f8140099e70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8134009920 tx=0x7f8134009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:14.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.567+0000 7fb4e48b2700 1 -- 172.21.15.59:0/1044027127 shutdown_connections 2023-09-30T22:33:14.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.567+0000 7fb4e48b2700 1 -- 172.21.15.59:0/1044027127 wait complete. 2023-09-30T22:33:14.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.567+0000 7f8145ffa700 1 -- 172.21.15.59:0/2585164977 shutdown_connections 2023-09-30T22:33:14.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.567+0000 7f8145ffa700 1 --2- 172.21.15.59:0/2585164977 >> v2:172.21.15.59:3300/0 conn(0x7f8140131810 0x7f8140131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.567+0000 7f8145ffa700 1 --2- 172.21.15.59:0/2585164977 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8140099a40 0x7f8140099e70 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.567+0000 7f8145ffa700 1 -- 172.21.15.59:0/2585164977 >> 172.21.15.59:0/2585164977 conn(0x7f81400a2aa0 msgr2=0x7f81400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:14.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.567+0000 7f8145ffa700 1 -- 172.21.15.59:0/2585164977 shutdown_connections 2023-09-30T22:33:14.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.567+0000 7f8145ffa700 1 -- 172.21.15.59:0/2585164977 wait complete. 2023-09-30T22:33:14.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.568+0000 7f8145ffa700 1 Processor -- start 2023-09-30T22:33:14.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.568+0000 7fb4e48b2700 1 Processor -- start 2023-09-30T22:33:14.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.568+0000 7fb4e48b2700 1 -- start start 2023-09-30T22:33:14.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7f8145ffa700 1 -- start start 2023-09-30T22:33:14.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7f8145ffa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8140099a40 0x7f814011a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7f8145ffa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814009a3b0 0x7f814011ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7f8145ffa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8140131810 0x7f814011b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7f8145ffa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81400a1fd0 con 0x7f8140131810 2023-09-30T22:33:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7f8145ffa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814011a630 con 0x7f8140099a40 2023-09-30T22:33:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7f8145ffa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f814011c0f0 con 0x7f814009a3b0 2023-09-30T22:33:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7f813effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814009a3b0 0x7f814011ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7f813f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8140099a40 0x7f814011a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7f813effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814009a3b0 0x7f814011ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51420/0 (socket says 172.21.15.59:51420) 2023-09-30T22:33:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7f813effd700 1 -- 172.21.15.59:0/2376372549 learned_addr learned my addr 172.21.15.59:0/2376372549 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.570+0000 7f813ffff700 1 --2- 172.21.15.59:0/2376372549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8140131810 0x7f814011b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.570+0000 7f813effd700 1 -- 172.21.15.59:0/2376372549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8140099a40 msgr2=0x7f814011a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.570+0000 7f813effd700 1 --2- 172.21.15.59:0/2376372549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8140099a40 0x7f814011a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.570+0000 7f813effd700 1 -- 172.21.15.59:0/2376372549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8140131810 msgr2=0x7f814011b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.570+0000 7f813effd700 1 --2- 172.21.15.59:0/2376372549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8140131810 0x7f814011b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.570+0000 7f813effd700 1 -- 172.21.15.59:0/2376372549 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8134009550 con 0x7f814009a3b0 2023-09-30T22:33:14.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.570+0000 7f813f7fe700 1 --2- 172.21.15.59:0/2376372549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8140099a40 0x7f814011a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:14.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.570+0000 7f813effd700 1 --2- 172.21.15.59:0/2376372549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814009a3b0 0x7f814011ade0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8134009870 tx=0x7f8134004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:14.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7fb4e48b2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e009de50 0x7fb4e012a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7fb4e48b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e009e930 0x7fb4e012ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7fb4e48b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e012b370 0x7fb4e0129a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7fb4e48b2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e01bbd30 con 0x7fb4e012b370 2023-09-30T22:33:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7fb4e48b2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e006f6b0 con 0x7fb4e009de50 2023-09-30T22:33:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7fb4e48b2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e01bb1d0 con 0x7fb4e009e930 2023-09-30T22:33:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7fb4ded9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e012b370 0x7fb4e0129a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7fb4ded9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e012b370 0x7fb4e0129a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48824/0 (socket says 172.21.15.59:48824) 2023-09-30T22:33:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7fb4ded9d700 1 -- 172.21.15.59:0/2932456206 learned_addr learned my addr 172.21.15.59:0/2932456206 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7fb4ddd9b700 1 --2- 172.21.15.59:0/2932456206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e009e930 0x7fb4e012ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7fb4ded9d700 1 -- 172.21.15.59:0/2932456206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e009e930 msgr2=0x7fb4e012ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7fb4ded9d700 1 --2- 172.21.15.59:0/2932456206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e009e930 0x7fb4e012ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7fb4ded9d700 1 -- 172.21.15.59:0/2932456206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e009de50 msgr2=0x7fb4e012a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:33:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7fb4ded9d700 1 --2- 172.21.15.59:0/2932456206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e009de50 0x7fb4e012a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.569+0000 7fb4ded9d700 1 -- 172.21.15.59:0/2932456206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d0009550 con 0x7fb4e012b370 2023-09-30T22:33:14.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.570+0000 7fb4ded9d700 1 --2- 172.21.15.59:0/2932456206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e012b370 0x7fb4e0129a60 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800cef0 tx=0x7fb4d800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:14.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.570+0000 7fb4ceffd700 1 -- 172.21.15.59:0/2932456206 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d800ad50 con 0x7fb4e012b370 2023-09-30T22:33:14.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.570+0000 7fb4ceffd700 1 -- 172.21.15.59:0/2932456206 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d8015440 con 0x7fb4e012b370 2023-09-30T22:33:14.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.570+0000 7fb4ceffd700 1 -- 172.21.15.59:0/2932456206 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80157d0 con 0x7fb4e012b370 2023-09-30T22:33:14.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.570+0000 7f8127fff700 1 -- 172.21.15.59:0/2376372549 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134004400 con 0x7f814009a3b0 2023-09-30T22:33:14.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.570+0000 7f8127fff700 1 -- 172.21.15.59:0/2376372549 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813401f070 con 0x7f814009a3b0 2023-09-30T22:33:14.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.570+0000 7f8127fff700 1 -- 172.21.15.59:0/2376372549 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81340038e0 con 0x7f814009a3b0 2023-09-30T22:33:14.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.571+0000 7f8145ffa700 1 -- 172.21.15.59:0/2376372549 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8140071dd0 con 0x7f814009a3b0 2023-09-30T22:33:14.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.571+0000 7f8145ffa700 1 -- 172.21.15.59:0/2376372549 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814011bb30 con 0x7f814009a3b0 2023-09-30T22:33:14.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.571+0000 7fb4e48b2700 1 -- 172.21.15.59:0/2932456206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e01c9fc0 con 0x7fb4e012b370 2023-09-30T22:33:14.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.571+0000 7fb4e48b2700 1 -- 172.21.15.59:0/2932456206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e01bb600 con 0x7fb4e012b370 2023-09-30T22:33:14.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.572+0000 7f8127fff700 1 -- 172.21.15.59:0/2376372549 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8134021070 con 0x7f814009a3b0 2023-09-30T22:33:14.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.573+0000 7f8145ffa700 1 -- 172.21.15.59:0/2376372549 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8140074ea0 con 0x7f814009a3b0 2023-09-30T22:33:14.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.573+0000 7fb4e48b2700 1 -- 172.21.15.59:0/2932456206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e01324d0 con 0x7fb4e012b370 2023-09-30T22:33:14.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.573+0000 7f8127fff700 1 -- 172.21.15.59:0/2376372549 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8134040790 con 0x7f814009a3b0 2023-09-30T22:33:14.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.573+0000 7fb4ceffd700 1 -- 172.21.15.59:0/2932456206 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4d800d430 con 0x7fb4e012b370 2023-09-30T22:33:14.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.573+0000 7fb4ceffd700 1 -- 172.21.15.59:0/2932456206 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb4d803fca0 con 0x7fb4e012b370 2023-09-30T22:33:14.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.578+0000 7fb4ceffd700 1 -- 172.21.15.59:0/2932456206 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4d8008910 con 0x7fb4e012b370 2023-09-30T22:33:14.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.582+0000 7f8127fff700 1 -- 172.21.15.59:0/2376372549 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8134003a40 con 0x7f814009a3b0 2023-09-30T22:33:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.609+0000 7f952f9cf700 1 Processor -- start 2023-09-30T22:33:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.609+0000 7f952f9cf700 1 -- start start 2023-09-30T22:33:14.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952f9cf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f952809d6f0 0x7f952809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952f9cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f952809e000 0x7f95281339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952f9cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952809e410 0x7f9528133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952f9cf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952806b460 con 0x7f952809d6f0 2023-09-30T22:33:14.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952f9cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952809b120 con 0x7f952809e410 2023-09-30T22:33:14.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952f9cf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f952809a7e0 con 0x7f952809e000 2023-09-30T22:33:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952cf6a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f952809e000 0x7f95281339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952cf6a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f952809e000 0x7f95281339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51430/0 (socket says 172.21.15.59:51430) 2023-09-30T22:33:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952cf6a700 1 -- 172.21.15.59:0/3989823997 learned_addr learned my addr 172.21.15.59:0/3989823997 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952df6c700 1 --2- 172.21.15.59:0/3989823997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952809e410 0x7f9528133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952cf6a700 1 -- 172.21.15.59:0/3989823997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952809e410 msgr2=0x7f9528133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952cf6a700 1 --2- 172.21.15.59:0/3989823997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952809e410 0x7f9528133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952cf6a700 1 -- 172.21.15.59:0/3989823997 >> v2:172.21.15.59:3300/0 conn(0x7f952809d6f0 msgr2=0x7f952809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952cf6a700 1 --2- 172.21.15.59:0/3989823997 >> v2:172.21.15.59:3300/0 conn(0x7f952809d6f0 0x7f952809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952cf6a700 1 -- 172.21.15.59:0/3989823997 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952809a500 con 0x7f952809e000 2023-09-30T22:33:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952df6c700 1 --2- 172.21.15.59:0/3989823997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952809e410 0x7f9528133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.610+0000 7f952cf6a700 1 --2- 172.21.15.59:0/3989823997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f952809e000 0x7f95281339f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9518009920 tx=0x7f9518009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37aa571241cc5f3f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.611+0000 7f951ffff700 1 -- 172.21.15.59:0/3989823997 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518011830 con 0x7f952809e000 2023-09-30T22:33:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.611+0000 7f951ffff700 1 -- 172.21.15.59:0/3989823997 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9518011990 con 0x7f952809e000 2023-09-30T22:33:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.611+0000 7f951ffff700 1 -- 172.21.15.59:0/3989823997 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518011d20 con 0x7f952809e000 2023-09-30T22:33:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.611+0000 7f952f9cf700 1 -- 172.21.15.59:0/3989823997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f952809e000 msgr2=0x7f95281339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.611+0000 7f952f9cf700 1 --2- 172.21.15.59:0/3989823997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f952809e000 0x7f95281339f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9518009920 tx=0x7f9518009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.611+0000 7f952f9cf700 1 -- 172.21.15.59:0/3989823997 shutdown_connections 2023-09-30T22:33:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.611+0000 7f952f9cf700 1 --2- 172.21.15.59:0/3989823997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952809e410 0x7f9528133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.611+0000 7f952f9cf700 1 --2- 172.21.15.59:0/3989823997 >> v2:172.21.15.59:3300/0 conn(0x7f952809d6f0 0x7f952809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.611+0000 7f952f9cf700 1 --2- 172.21.15.59:0/3989823997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f952809e000 0x7f95281339f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.612+0000 7f952f9cf700 1 -- 172.21.15.59:0/3989823997 >> 172.21.15.59:0/3989823997 conn(0x7f9528066f50 msgr2=0x7f952809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:14.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.612+0000 7f952f9cf700 1 -- 172.21.15.59:0/3989823997 shutdown_connections 2023-09-30T22:33:14.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.612+0000 7f952f9cf700 1 -- 172.21.15.59:0/3989823997 wait complete. 2023-09-30T22:33:14.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.613+0000 7f952f9cf700 1 Processor -- start 2023-09-30T22:33:14.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.613+0000 7f952f9cf700 1 -- start start 2023-09-30T22:33:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.613+0000 7f952f9cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952809d6f0 0x7f95281a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.613+0000 7f952f9cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f952809e000 0x7f95281a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.613+0000 7f952f9cf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952809e410 0x7f95281a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.613+0000 7f952f9cf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95281a6b20 con 0x7f952809e410 2023-09-30T22:33:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.613+0000 7f952f9cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95281a86b0 con 0x7f952809d6f0 2023-09-30T22:33:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.613+0000 7f952f9cf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95280a21f0 con 0x7f952809e000 2023-09-30T22:33:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.614+0000 7f952cf6a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f952809e000 0x7f95281a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.614+0000 7f952df6c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952809e410 0x7f95281a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.614+0000 7f952cf6a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f952809e000 0x7f95281a53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51436/0 (socket says 172.21.15.59:51436) 2023-09-30T22:33:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.614+0000 7f952cf6a700 1 -- 172.21.15.59:0/903189651 learned_addr learned my addr 172.21.15.59:0/903189651 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:14.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.614+0000 7f952d76b700 1 --2- 172.21.15.59:0/903189651 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952809d6f0 0x7f95281a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:14.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.614+0000 7f952cf6a700 1 -- 172.21.15.59:0/903189651 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952809d6f0 msgr2=0x7f95281a4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.614+0000 7f952cf6a700 1 --2- 172.21.15.59:0/903189651 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952809d6f0 0x7f95281a4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.614+0000 7f952cf6a700 1 -- 172.21.15.59:0/903189651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952809e410 msgr2=0x7f95281a58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.614+0000 7f952cf6a700 1 --2- 172.21.15.59:0/903189651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952809e410 0x7f95281a58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.614+0000 7f952cf6a700 1 -- 172.21.15.59:0/903189651 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9520009a70 con 0x7f952809e000 2023-09-30T22:33:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.614+0000 7f952df6c700 1 --2- 172.21.15.59:0/903189651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952809e410 0x7f95281a58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.614+0000 7f952cf6a700 1 --2- 172.21.15.59:0/903189651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f952809e000 0x7f95281a53b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f95180098f0 tx=0x7f9518004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.614+0000 7f951dffb700 1 -- 172.21.15.59:0/903189651 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518004380 con 0x7f952809e000 2023-09-30T22:33:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.615+0000 7f951dffb700 1 -- 172.21.15.59:0/903189651 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951801f070 con 0x7f952809e000 2023-09-30T22:33:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.615+0000 7f952f9cf700 1 -- 172.21.15.59:0/903189651 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9518009550 con 0x7f952809e000 2023-09-30T22:33:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.615+0000 7f951dffb700 1 -- 172.21.15.59:0/903189651 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95180036a0 con 0x7f952809e000 2023-09-30T22:33:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.615+0000 7f952f9cf700 1 -- 172.21.15.59:0/903189651 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95281a7cd0 con 0x7f952809e000 2023-09-30T22:33:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.616+0000 7f951dffb700 1 -- 172.21.15.59:0/903189651 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9518021030 con 0x7f952809e000 2023-09-30T22:33:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.616+0000 7f951dffb700 1 -- 172.21.15.59:0/903189651 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9518040850 con 0x7f952809e000 2023-09-30T22:33:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.616+0000 7f952f9cf700 1 -- 172.21.15.59:0/903189651 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9528074ea0 con 0x7f952809e000 2023-09-30T22:33:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.621+0000 7f951dffb700 1 -- 172.21.15.59:0/903189651 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9518015080 con 0x7f952809e000 2023-09-30T22:33:14.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.784+0000 7fb4e48b2700 1 -- 172.21.15.59:0/2932456206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb4e0074ea0 con 0x7fb4e012b370 2023-09-30T22:33:14.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.785+0000 7fb4ceffd700 1 -- 172.21.15.59:0/2932456206 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4d801a070 con 0x7fb4e012b370 2023-09-30T22:33:14.785 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.787+0000 7fb4e48b2700 1 -- 172.21.15.59:0/2932456206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e012b370 msgr2=0x7fb4e0129a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.787+0000 7fb4e48b2700 1 --2- 172.21.15.59:0/2932456206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e012b370 0x7fb4e0129a60 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800cef0 tx=0x7fb4d800cf20 comp rx=0 tx=0).stop 2023-09-30T22:33:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.787+0000 7fb4e48b2700 1 -- 172.21.15.59:0/2932456206 shutdown_connections 2023-09-30T22:33:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.787+0000 7fb4e48b2700 1 --2- 172.21.15.59:0/2932456206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e012b370 0x7fb4e0129a60 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.787+0000 7fb4e48b2700 1 --2- 172.21.15.59:0/2932456206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e009de50 0x7fb4e012a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.787+0000 7fb4e48b2700 1 --2- 172.21.15.59:0/2932456206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e009e930 0x7fb4e012ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.787+0000 7fb4e48b2700 1 -- 172.21.15.59:0/2932456206 >> 172.21.15.59:0/2932456206 conn(0x7fb4e00a2aa0 msgr2=0x7fb4e01312a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.787+0000 7fb4e48b2700 1 -- 172.21.15.59:0/2932456206 shutdown_connections 2023-09-30T22:33:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.787+0000 7fb4e48b2700 1 -- 172.21.15.59:0/2932456206 wait complete. 2023-09-30T22:33:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.795+0000 7fef73bd4700 1 -- 172.21.15.59:0/795423212 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fef6c1a74b0 con 0x7fef6c09e930 2023-09-30T22:33:14.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.796+0000 7fef627fc700 1 -- 172.21.15.59:0/795423212 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef68015020 con 0x7fef6c09e930 2023-09-30T22:33:14.796 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:14.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.798+0000 7fef73bd4700 1 -- 172.21.15.59:0/795423212 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef6c09e930 msgr2=0x7fef6c1a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.798+0000 7fef73bd4700 1 --2- 172.21.15.59:0/795423212 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef6c09e930 0x7fef6c1a4020 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fef68009fd0 tx=0x7fef68004750 comp rx=0 tx=0).stop 2023-09-30T22:33:14.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.798+0000 7fef73bd4700 1 -- 172.21.15.59:0/795423212 shutdown_connections 2023-09-30T22:33:14.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.798+0000 7fef73bd4700 1 --2- 172.21.15.59:0/795423212 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef6c09e930 0x7fef6c1a4020 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.798+0000 7fef73bd4700 1 --2- 172.21.15.59:0/795423212 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef6c09f650 0x7fef6c1a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.798+0000 7fef73bd4700 1 --2- 172.21.15.59:0/795423212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef6c09f240 0x7fef6c1a4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.798+0000 7fef73bd4700 1 -- 172.21.15.59:0/795423212 >> 172.21.15.59:0/795423212 conn(0x7fef6c0a4210 msgr2=0x7fef6c1b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:14.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.799+0000 7fef73bd4700 1 -- 172.21.15.59:0/795423212 shutdown_connections 2023-09-30T22:33:14.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.800+0000 7fef73bd4700 1 -- 172.21.15.59:0/795423212 wait complete. 2023-09-30T22:33:14.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:14.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:14.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.828+0000 7f8145ffa700 1 -- 172.21.15.59:0/2376372549 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f814006eb00 con 0x7f814009a3b0 2023-09-30T22:33:14.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.828+0000 7f8127fff700 1 -- 172.21.15.59:0/2376372549 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8134029020 con 0x7f814009a3b0 2023-09-30T22:33:14.828 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:14.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.828+0000 7f952f9cf700 1 -- 172.21.15.59:0/903189651 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f95281a8320 con 0x7f952809e000 2023-09-30T22:33:14.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.829+0000 7f951dffb700 1 -- 172.21.15.59:0/903189651 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95180239c0 con 0x7f952809e000 2023-09-30T22:33:14.829 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:14.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.830+0000 7f8145ffa700 1 -- 172.21.15.59:0/2376372549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814009a3b0 msgr2=0x7f814011ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.830+0000 7f8145ffa700 1 --2- 172.21.15.59:0/2376372549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814009a3b0 0x7f814011ade0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8134009870 tx=0x7f8134004750 comp rx=0 tx=0).stop 2023-09-30T22:33:14.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.830+0000 7f8145ffa700 1 -- 172.21.15.59:0/2376372549 shutdown_connections 2023-09-30T22:33:14.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.830+0000 7f8145ffa700 1 --2- 172.21.15.59:0/2376372549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8140131810 0x7f814011b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.830+0000 7f8145ffa700 1 --2- 172.21.15.59:0/2376372549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8140099a40 0x7f814011a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.830+0000 7f8145ffa700 1 --2- 172.21.15.59:0/2376372549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814009a3b0 0x7f814011ade0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.830+0000 7f8145ffa700 1 -- 172.21.15.59:0/2376372549 >> 172.21.15.59:0/2376372549 conn(0x7f81400a2aa0 msgr2=0x7f8140130400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:14.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.831+0000 7f8145ffa700 1 -- 172.21.15.59:0/2376372549 shutdown_connections 2023-09-30T22:33:14.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.831+0000 7f8145ffa700 1 -- 172.21.15.59:0/2376372549 wait complete. 2023-09-30T22:33:14.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.831+0000 7f952f9cf700 1 -- 172.21.15.59:0/903189651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f952809e000 msgr2=0x7f95281a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:14.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.831+0000 7f952f9cf700 1 --2- 172.21.15.59:0/903189651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f952809e000 0x7f95281a53b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f95180098f0 tx=0x7f9518004750 comp rx=0 tx=0).stop 2023-09-30T22:33:14.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.831+0000 7f952f9cf700 1 -- 172.21.15.59:0/903189651 shutdown_connections 2023-09-30T22:33:14.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.831+0000 7f952f9cf700 1 --2- 172.21.15.59:0/903189651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f952809e410 0x7f95281a58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.831+0000 7f952f9cf700 1 --2- 172.21.15.59:0/903189651 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952809d6f0 0x7f95281a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.831+0000 7f952f9cf700 1 --2- 172.21.15.59:0/903189651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f952809e000 0x7f95281a53b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:14.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.831+0000 7f952f9cf700 1 -- 172.21.15.59:0/903189651 >> 172.21.15.59:0/903189651 conn(0x7f9528066f50 msgr2=0x7f95281bb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:14.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.831+0000 7f952f9cf700 1 -- 172.21.15.59:0/903189651 shutdown_connections 2023-09-30T22:33:14.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:14.831+0000 7f952f9cf700 1 -- 172.21.15.59:0/903189651 wait complete. 2023-09-30T22:33:14.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:14.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:15.803 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:15.815 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:15.847 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:15.848 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:15.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.972+0000 7f57239d1700 1 Processor -- start 2023-09-30T22:33:15.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.972+0000 7f57239d1700 1 -- start start 2023-09-30T22:33:15.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.973+0000 7f57239d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571c1337f0 0x7f571c138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:15.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.973+0000 7f57239d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571c138dc0 0x7f571c13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:15.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.973+0000 7f57239d1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571c06b990 con 0x7f571c133420 2023-09-30T22:33:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.973+0000 7f57239d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c09b0e0 con 0x7f571c1337f0 2023-09-30T22:33:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.973+0000 7f57239d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f571c133c20 con 0x7f571c138dc0 2023-09-30T22:33:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.973+0000 7f572176d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f571c133420 0x7f571c133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34274/0 (socket says 172.21.15.59:34274) 2023-09-30T22:33:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.973+0000 7f572176d700 1 -- 172.21.15.59:0/2862477869 learned_addr learned my addr 172.21.15.59:0/2862477869 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.973+0000 7f5720f6c700 1 --2- 172.21.15.59:0/2862477869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571c1337f0 0x7f571c138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.973+0000 7f5721f6e700 1 --2- 172.21.15.59:0/2862477869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571c138dc0 0x7f571c13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.974+0000 7f5713fff700 1 -- 172.21.15.59:0/2862477869 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120667428 0 0) 0x7f571c06b990 con 0x7f571c133420 2023-09-30T22:33:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.974+0000 7f5713fff700 1 -- 172.21.15.59:0/2862477869 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57080035b0 con 0x7f571c133420 2023-09-30T22:33:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.974+0000 7f5720f6c700 1 -- 172.21.15.59:0/2862477869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571c138dc0 msgr2=0x7f571c13b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.974+0000 7f5720f6c700 1 --2- 172.21.15.59:0/2862477869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571c138dc0 0x7f571c13b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:15.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.974+0000 7f5720f6c700 1 -- 172.21.15.59:0/2862477869 >> v1:172.21.15.59:6789/0 conn(0x7f571c133420 legacy=0x7f571c133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:15.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.974+0000 7f5720f6c700 1 -- 172.21.15.59:0/2862477869 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c0a0590 con 0x7f571c1337f0 2023-09-30T22:33:15.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.974+0000 7f5720f6c700 1 --2- 172.21.15.59:0/2862477869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571c1337f0 0x7f571c138880 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f570c009870 tx=0x7f570c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d03e1a15f9749c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:15.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.974+0000 7f5713fff700 1 -- 172.21.15.59:0/2862477869 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c011830 con 0x7f571c1337f0 2023-09-30T22:33:15.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.974+0000 7f5713fff700 1 -- 172.21.15.59:0/2862477869 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570c011990 con 0x7f571c1337f0 2023-09-30T22:33:15.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.974+0000 7f5713fff700 1 -- 172.21.15.59:0/2862477869 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c011d20 con 0x7f571c1337f0 2023-09-30T22:33:15.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.975+0000 7f57239d1700 1 -- 172.21.15.59:0/2862477869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571c1337f0 msgr2=0x7f571c138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:15.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.975+0000 7f57239d1700 1 --2- 172.21.15.59:0/2862477869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571c1337f0 0x7f571c138880 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f570c009870 tx=0x7f570c009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:15.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.976+0000 7f57239d1700 1 -- 172.21.15.59:0/2862477869 shutdown_connections 2023-09-30T22:33:15.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.976+0000 7f57239d1700 1 --2- 172.21.15.59:0/2862477869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571c138dc0 0x7f571c13b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.976+0000 7f57239d1700 1 --2- 172.21.15.59:0/2862477869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571c1337f0 0x7f571c138880 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.976+0000 7f57239d1700 1 -- 172.21.15.59:0/2862477869 >> 172.21.15.59:0/2862477869 conn(0x7f571c0a4210 msgr2=0x7f571c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.976+0000 7f57239d1700 1 -- 172.21.15.59:0/2862477869 shutdown_connections 2023-09-30T22:33:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.976+0000 7f57239d1700 1 -- 172.21.15.59:0/2862477869 wait complete. 2023-09-30T22:33:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.977+0000 7f57239d1700 1 Processor -- start 2023-09-30T22:33:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.977+0000 7f57239d1700 1 -- start start 2023-09-30T22:33:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.978+0000 7f57239d1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f571c133420 0x7f571c0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.978+0000 7f57239d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571c1337f0 0x7f571c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.978+0000 7f57239d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571c138dc0 0x7f571c071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.978+0000 7f57239d1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c09c820 con 0x7f571c133420 2023-09-30T22:33:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.978+0000 7f57239d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c09e500 con 0x7f571c138dc0 2023-09-30T22:33:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.978+0000 7f57239d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f571c09ca00 con 0x7f571c1337f0 2023-09-30T22:33:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.978+0000 7f5721f6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571c138dc0 0x7f571c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.978+0000 7f5720f6c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571c1337f0 0x7f571c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.978+0000 7f5721f6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571c138dc0 0x7f571c071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50938/0 (socket says 172.21.15.59:50938) 2023-09-30T22:33:15.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.978+0000 7f5721f6e700 1 -- 172.21.15.59:0/1940085283 learned_addr learned my addr 172.21.15.59:0/1940085283 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:15.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.979+0000 7f5721f6e700 1 -- 172.21.15.59:0/1940085283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571c1337f0 msgr2=0x7f571c070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:15.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.979+0000 7f5721f6e700 1 --2- 172.21.15.59:0/1940085283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571c1337f0 0x7f571c070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:15.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.979+0000 7f5721f6e700 1 -- 172.21.15.59:0/1940085283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f571c133420 msgr2=0x7f571c0709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:15.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.979+0000 7f5721f6e700 1 --2- 172.21.15.59:0/1940085283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f571c133420 0x7f571c0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:15.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.979+0000 7f5721f6e700 1 -- 172.21.15.59:0/1940085283 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c0094a0 con 0x7f571c138dc0 2023-09-30T22:33:15.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.979+0000 7f5720f6c700 1 --2- 172.21.15.59:0/1940085283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571c1337f0 0x7f571c070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:15.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.979+0000 7f5721f6e700 1 --2- 172.21.15.59:0/1940085283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571c138dc0 0x7f571c071420 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5714009e30 tx=0x7f571400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:15.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.979+0000 7f5711ffb700 1 -- 172.21.15.59:0/1940085283 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714009ca0 con 0x7f571c138dc0 2023-09-30T22:33:15.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.979+0000 7f5711ffb700 1 -- 172.21.15.59:0/1940085283 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571400f040 con 0x7f571c138dc0 2023-09-30T22:33:15.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.979+0000 7f57239d1700 1 -- 172.21.15.59:0/1940085283 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c072860 con 0x7f571c138dc0 2023-09-30T22:33:15.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.979+0000 7f5711ffb700 1 -- 172.21.15.59:0/1940085283 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714014480 con 0x7f571c138dc0 2023-09-30T22:33:15.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.979+0000 7f57239d1700 1 -- 172.21.15.59:0/1940085283 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c09b780 con 0x7f571c138dc0 2023-09-30T22:33:15.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.981+0000 7f57239d1700 1 -- 172.21.15.59:0/1940085283 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571c09c680 con 0x7f571c138dc0 2023-09-30T22:33:15.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.981+0000 7f5711ffb700 1 -- 172.21.15.59:0/1940085283 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57140145e0 con 0x7f571c138dc0 2023-09-30T22:33:15.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.982+0000 7f5711ffb700 1 -- 172.21.15.59:0/1940085283 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5714040690 con 0x7f571c138dc0 2023-09-30T22:33:15.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.986+0000 7f5711ffb700 1 -- 172.21.15.59:0/1940085283 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5714012750 con 0x7f571c138dc0 2023-09-30T22:33:15.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.997+0000 7f3960c9e700 1 Processor -- start 2023-09-30T22:33:15.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.997+0000 7f3960c9e700 1 -- start start 2023-09-30T22:33:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.998+0000 7f3960c9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395c09f410 0x7f395c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.999+0000 7f3960c9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395c136fe0 0x7f395c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.999+0000 7f3960c9e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395c070940 con 0x7f395c09e930 2023-09-30T22:33:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.999+0000 7f3960c9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395c06fd60 con 0x7f395c136fe0 2023-09-30T22:33:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.999+0000 7f3960c9e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f395c06fa80 con 0x7f395c09f410 2023-09-30T22:33:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.999+0000 7f395a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f395c09e930 0x7f395c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34290/0 (socket says 172.21.15.59:34290) 2023-09-30T22:33:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.999+0000 7f395a59c700 1 -- 172.21.15.59:0/3963859556 learned_addr learned my addr 172.21.15.59:0/3963859556 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.999+0000 7f395ad9d700 1 --2- 172.21.15.59:0/3963859556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395c136fe0 0x7f395c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.999+0000 7f3959d9b700 1 --2- 172.21.15.59:0/3963859556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395c09f410 0x7f395c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.999+0000 7f395959a700 1 -- 172.21.15.59:0/3963859556 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339304843 0 0) 0x7f395c070940 con 0x7f395c09e930 2023-09-30T22:33:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.999+0000 7f3959d9b700 1 -- 172.21.15.59:0/3963859556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395c136fe0 msgr2=0x7f395c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.999+0000 7f3959d9b700 1 --2- 172.21.15.59:0/3963859556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395c136fe0 0x7f395c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.999+0000 7f3959d9b700 1 -- 172.21.15.59:0/3963859556 >> v1:172.21.15.59:6789/0 conn(0x7f395c09e930 legacy=0x7f395c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.999+0000 7f3959d9b700 1 -- 172.21.15.59:0/3963859556 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c09fb60 con 0x7f395c09f410 2023-09-30T22:33:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:15.999+0000 7f395ad9d700 1 --2- 172.21.15.59:0/3963859556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395c136fe0 0x7f395c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.000+0000 7f3959d9b700 1 --2- 172.21.15.59:0/3963859556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395c09f410 0x7f395c136aa0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3950009870 tx=0x7f3950009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c33601f0109db81a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.000+0000 7f395959a700 1 -- 172.21.15.59:0/3963859556 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950011830 con 0x7f395c09f410 2023-09-30T22:33:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.000+0000 7f395959a700 1 -- 172.21.15.59:0/3963859556 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3950011990 con 0x7f395c09f410 2023-09-30T22:33:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.000+0000 7f395959a700 1 -- 172.21.15.59:0/3963859556 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950011d20 con 0x7f395c09f410 2023-09-30T22:33:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.000+0000 7f3960c9e700 1 -- 172.21.15.59:0/3963859556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395c09f410 msgr2=0x7f395c136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.000+0000 7f3960c9e700 1 --2- 172.21.15.59:0/3963859556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395c09f410 0x7f395c136aa0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3950009870 tx=0x7f3950009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.001+0000 7f3960c9e700 1 -- 172.21.15.59:0/3963859556 shutdown_connections 2023-09-30T22:33:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.001+0000 7f3960c9e700 1 --2- 172.21.15.59:0/3963859556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395c136fe0 0x7f395c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.001+0000 7f3960c9e700 1 --2- 172.21.15.59:0/3963859556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395c09f410 0x7f395c136aa0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.001+0000 7f3960c9e700 1 -- 172.21.15.59:0/3963859556 >> 172.21.15.59:0/3963859556 conn(0x7f395c0a4210 msgr2=0x7f395c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.001+0000 7f3960c9e700 1 -- 172.21.15.59:0/3963859556 shutdown_connections 2023-09-30T22:33:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.001+0000 7f3960c9e700 1 -- 172.21.15.59:0/3963859556 wait complete. 2023-09-30T22:33:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.002+0000 7f3960c9e700 1 Processor -- start 2023-09-30T22:33:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.002+0000 7f3960c9e700 1 -- start start 2023-09-30T22:33:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.003+0000 7f3960c9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395c09e930 0x7f395c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.003+0000 7f3960c9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395c09f410 0x7f395c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.003+0000 7f3960c9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395c136fe0 0x7f395c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.003+0000 7f3960c9e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c071d90 con 0x7f395c09e930 2023-09-30T22:33:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.003+0000 7f3960c9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395c06d640 con 0x7f395c136fe0 2023-09-30T22:33:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.003+0000 7f3960c9e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f395c134660 con 0x7f395c09f410 2023-09-30T22:33:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.003+0000 7f395a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395c09e930 0x7f395c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.003+0000 7f395ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395c136fe0 0x7f395c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.003+0000 7f395a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395c09e930 0x7f395c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48868/0 (socket says 172.21.15.59:48868) 2023-09-30T22:33:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.003+0000 7f395ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395c136fe0 0x7f395c06c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50964/0 (socket says 172.21.15.59:50964) 2023-09-30T22:33:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.003+0000 7f395a59c700 1 -- 172.21.15.59:0/3512387351 learned_addr learned my addr 172.21.15.59:0/3512387351 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.004+0000 7f3959d9b700 1 --2- 172.21.15.59:0/3512387351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395c09f410 0x7f395c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.004+0000 7f395ad9d700 1 -- 172.21.15.59:0/3512387351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395c09f410 msgr2=0x7f395c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.004+0000 7f395ad9d700 1 --2- 172.21.15.59:0/3512387351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395c09f410 0x7f395c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.004+0000 7f395ad9d700 1 -- 172.21.15.59:0/3512387351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395c09e930 msgr2=0x7f395c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.004+0000 7f395ad9d700 1 --2- 172.21.15.59:0/3512387351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395c09e930 0x7f395c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.004+0000 7f395ad9d700 1 -- 172.21.15.59:0/3512387351 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3954009a70 con 0x7f395c136fe0 2023-09-30T22:33:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.004+0000 7f395ad9d700 1 --2- 172.21.15.59:0/3512387351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395c136fe0 0x7f395c06c330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f395c0a07c0 tx=0x7f395400ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.004+0000 7f394affd700 1 -- 172.21.15.59:0/3512387351 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395400ccd0 con 0x7f395c136fe0 2023-09-30T22:33:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.005+0000 7f394affd700 1 -- 172.21.15.59:0/3512387351 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395400f040 con 0x7f395c136fe0 2023-09-30T22:33:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.005+0000 7f3960c9e700 1 -- 172.21.15.59:0/3512387351 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39500094a0 con 0x7f395c136fe0 2023-09-30T22:33:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.005+0000 7f394affd700 1 -- 172.21.15.59:0/3512387351 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39540146c0 con 0x7f395c136fe0 2023-09-30T22:33:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.005+0000 7f3960c9e700 1 -- 172.21.15.59:0/3512387351 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395c1341f0 con 0x7f395c136fe0 2023-09-30T22:33:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.006+0000 7f394affd700 1 -- 172.21.15.59:0/3512387351 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3954014820 con 0x7f395c136fe0 2023-09-30T22:33:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.006+0000 7f394affd700 1 -- 172.21.15.59:0/3512387351 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3954040570 con 0x7f395c136fe0 2023-09-30T22:33:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.006+0000 7f3960c9e700 1 -- 172.21.15.59:0/3512387351 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395c074ea0 con 0x7f395c136fe0 2023-09-30T22:33:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.007+0000 7f17f3b08700 1 Processor -- start 2023-09-30T22:33:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.007+0000 7f17f3b08700 1 -- start start 2023-09-30T22:33:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.008+0000 7f17f3b08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17ec06f5d0 0x7f17ec12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.008+0000 7f17f3b08700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17ec135c20 0x7f17ec138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.008+0000 7f17f3b08700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec06fa40 con 0x7f17ec12cf60 2023-09-30T22:33:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.008+0000 7f17f3b08700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ec12cd90 con 0x7f17ec135c20 2023-09-30T22:33:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.008+0000 7f17f3b08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec071780 con 0x7f17ec06f5d0 2023-09-30T22:33:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.008+0000 7f17f20a5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17ec135c20 0x7f17ec138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.008+0000 7f17f20a5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17ec135c20 0x7f17ec138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48878/0 (socket says 172.21.15.59:48878) 2023-09-30T22:33:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.008+0000 7f17f20a5700 1 -- 172.21.15.59:0/2520115731 learned_addr learned my addr 172.21.15.59:0/2520115731 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.008+0000 7f17f20a5700 1 -- 172.21.15.59:0/2520115731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17ec06f5d0 msgr2=0x7f17ec12ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.008+0000 7f17f20a5700 1 --2- 172.21.15.59:0/2520115731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17ec06f5d0 0x7f17ec12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.008+0000 7f17f20a5700 1 -- 172.21.15.59:0/2520115731 >> v1:172.21.15.59:6789/0 conn(0x7f17ec12cf60 legacy=0x7f17ec12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.008+0000 7f17f20a5700 1 -- 172.21.15.59:0/2520115731 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec071a40 con 0x7f17ec135c20 2023-09-30T22:33:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.009+0000 7f17f20a5700 1 --2- 172.21.15.59:0/2520115731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17ec135c20 0x7f17ec138000 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009e50 tx=0x7f17e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19feb7875b8bbffc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.009+0000 7f17f08a2700 1 -- 172.21.15.59:0/2520115731 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e400e070 con 0x7f17ec135c20 2023-09-30T22:33:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.009+0000 7f17f08a2700 1 -- 172.21.15.59:0/2520115731 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e4003a20 con 0x7f17ec135c20 2023-09-30T22:33:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.009+0000 7f17f08a2700 1 -- 172.21.15.59:0/2520115731 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4003dd0 con 0x7f17ec135c20 2023-09-30T22:33:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.010+0000 7f17f3b08700 1 -- 172.21.15.59:0/2520115731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17ec135c20 msgr2=0x7f17ec138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.010+0000 7f17f3b08700 1 --2- 172.21.15.59:0/2520115731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17ec135c20 0x7f17ec138000 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009e50 tx=0x7f17e400b330 comp rx=0 tx=0).stop 2023-09-30T22:33:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.010+0000 7f17f3b08700 1 -- 172.21.15.59:0/2520115731 shutdown_connections 2023-09-30T22:33:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.010+0000 7f17f3b08700 1 --2- 172.21.15.59:0/2520115731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17ec135c20 0x7f17ec138000 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.010+0000 7f17f3b08700 1 --2- 172.21.15.59:0/2520115731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17ec06f5d0 0x7f17ec12ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.010+0000 7f17f3b08700 1 -- 172.21.15.59:0/2520115731 >> 172.21.15.59:0/2520115731 conn(0x7f17ec0a2aa0 msgr2=0x7f17ec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.010+0000 7f17f3b08700 1 -- 172.21.15.59:0/2520115731 shutdown_connections 2023-09-30T22:33:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.010+0000 7f17f3b08700 1 -- 172.21.15.59:0/2520115731 wait complete. 2023-09-30T22:33:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7f17f3b08700 1 Processor -- start 2023-09-30T22:33:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7f17f3b08700 1 -- start start 2023-09-30T22:33:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7fda65c74700 1 Processor -- start 2023-09-30T22:33:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7f17f3b08700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17ec06f5d0 0x7f17ec12d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7f17f3b08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17ec12cf60 0x7f17ec12dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7f17f3b08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17ec135c20 0x7f17ec12e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7f17f3b08700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec07b060 con 0x7f17ec06f5d0 2023-09-30T22:33:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7f17f3b08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec07bc20 con 0x7f17ec12cf60 2023-09-30T22:33:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7f17f3b08700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec07b260 con 0x7f17ec135c20 2023-09-30T22:33:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7fda65c74700 1 -- start start 2023-09-30T22:33:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7fda65c74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda6012cf60 0x7fda6006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7fda65c74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda6012f8b0 0x7fda6012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7fda65c74700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fda60130260 0x7fda60136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7fda65c74700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6012d330 con 0x7fda60130260 2023-09-30T22:33:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7fda65c74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6012cd90 con 0x7fda6012cf60 2023-09-30T22:33:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.012+0000 7fda65c74700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda601306d0 con 0x7fda6012f8b0 2023-09-30T22:33:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7fda5f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda6012cf60 0x7fda6006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7fda5f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda6012cf60 0x7fda6006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51000/0 (socket says 172.21.15.59:51000) 2023-09-30T22:33:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7fda5f7fe700 1 -- 172.21.15.59:0/3684628169 learned_addr learned my addr 172.21.15.59:0/3684628169 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7fda5ffff700 1 --2- 172.21.15.59:0/3684628169 >> v2:172.21.15.59:3300/0 conn(0x7fda60130260 0x7fda60136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7f17f18a4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17ec06f5d0 0x7f17ec12d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7f17f18a4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17ec06f5d0 0x7f17ec12d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48896/0 (socket says 172.21.15.59:48896) 2023-09-30T22:33:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7f17f18a4700 1 -- 172.21.15.59:0/1720867842 learned_addr learned my addr 172.21.15.59:0/1720867842 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7fda5f7fe700 1 -- 172.21.15.59:0/3684628169 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda6012f8b0 msgr2=0x7fda6012fd20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:33:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7fda5f7fe700 1 --2- 172.21.15.59:0/3684628169 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda6012f8b0 0x7fda6012fd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7fda5f7fe700 1 -- 172.21.15.59:0/3684628169 >> v2:172.21.15.59:3300/0 conn(0x7fda60130260 msgr2=0x7fda60136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7fda5f7fe700 1 --2- 172.21.15.59:0/3684628169 >> v2:172.21.15.59:3300/0 conn(0x7fda60130260 0x7fda60136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7fda5f7fe700 1 -- 172.21.15.59:0/3684628169 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda60071780 con 0x7fda6012cf60 2023-09-30T22:33:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7fda5f7fe700 1 --2- 172.21.15.59:0/3684628169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda6012cf60 0x7fda6006f5d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fda500098f0 tx=0x7fda50009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b54648ebdda49f5a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7fda5e7fc700 1 -- 172.21.15.59:0/3684628169 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5000c8b0 con 0x7fda6012cf60 2023-09-30T22:33:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7f17f18a4700 1 -- 172.21.15.59:0/1720867842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17ec135c20 msgr2=0x7f17ec12e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7f17f18a4700 1 --2- 172.21.15.59:0/1720867842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17ec135c20 0x7f17ec12e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7f17f18a4700 1 -- 172.21.15.59:0/1720867842 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17ec12cf60 msgr2=0x7f17ec12dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7f17f18a4700 1 --2- 172.21.15.59:0/1720867842 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17ec12cf60 0x7f17ec12dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7f17f18a4700 1 -- 172.21.15.59:0/1720867842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e4009b30 con 0x7f17ec06f5d0 2023-09-30T22:33:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.014+0000 7f394affd700 1 -- 172.21.15.59:0/3512387351 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3954012930 con 0x7f395c136fe0 2023-09-30T22:33:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.013+0000 7fda5e7fc700 1 -- 172.21.15.59:0/3684628169 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5000ca10 con 0x7fda6012cf60 2023-09-30T22:33:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.014+0000 7fda5e7fc700 1 -- 172.21.15.59:0/3684628169 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5000cda0 con 0x7fda6012cf60 2023-09-30T22:33:16.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.014+0000 7f17f18a4700 1 --2- 172.21.15.59:0/1720867842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17ec06f5d0 0x7f17ec12d7b0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00c500 tx=0x7f17dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:16.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.014+0000 7f17e27fc700 1 -- 172.21.15.59:0/1720867842 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc011790 con 0x7f17ec06f5d0 2023-09-30T22:33:16.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.014+0000 7f17e27fc700 1 -- 172.21.15.59:0/1720867842 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc0118f0 con 0x7f17ec06f5d0 2023-09-30T22:33:16.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.014+0000 7f17e27fc700 1 -- 172.21.15.59:0/1720867842 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc011ca0 con 0x7f17ec06f5d0 2023-09-30T22:33:16.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.014+0000 7f17f3b08700 1 -- 172.21.15.59:0/1720867842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ec07a1b0 con 0x7f17ec06f5d0 2023-09-30T22:33:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.014+0000 7f17f3b08700 1 -- 172.21.15.59:0/1720867842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ec129fa0 con 0x7f17ec06f5d0 2023-09-30T22:33:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.015+0000 7fda65c74700 1 -- 172.21.15.59:0/3684628169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda6012cf60 msgr2=0x7fda6006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.015+0000 7fda65c74700 1 --2- 172.21.15.59:0/3684628169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda6012cf60 0x7fda6006f5d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fda500098f0 tx=0x7fda50009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.015+0000 7fda65c74700 1 -- 172.21.15.59:0/3684628169 shutdown_connections 2023-09-30T22:33:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.015+0000 7fda65c74700 1 --2- 172.21.15.59:0/3684628169 >> v2:172.21.15.59:3300/0 conn(0x7fda60130260 0x7fda60136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.015+0000 7fda65c74700 1 --2- 172.21.15.59:0/3684628169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda6012cf60 0x7fda6006f5d0 secure :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fda500098f0 tx=0x7fda50009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.015+0000 7fda65c74700 1 --2- 172.21.15.59:0/3684628169 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda6012f8b0 0x7fda6012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.015+0000 7fda65c74700 1 -- 172.21.15.59:0/3684628169 >> 172.21.15.59:0/3684628169 conn(0x7fda600a2aa0 msgr2=0x7fda600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.015+0000 7fda65c74700 1 -- 172.21.15.59:0/3684628169 shutdown_connections 2023-09-30T22:33:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.016+0000 7f17f3b08700 1 -- 172.21.15.59:0/1720867842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ec074ea0 con 0x7f17ec06f5d0 2023-09-30T22:33:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.015+0000 7fda65c74700 1 -- 172.21.15.59:0/3684628169 wait complete. 2023-09-30T22:33:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.017+0000 7fda65c74700 1 Processor -- start 2023-09-30T22:33:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.017+0000 7fda65c74700 1 -- start start 2023-09-30T22:33:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda65c74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda6012f8b0 0x7fda60118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda65c74700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda60130260 0x7fda60119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda65c74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda60119750 0x7fda601cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda65c74700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6011aca0 con 0x7fda60130260 2023-09-30T22:33:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda65c74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6011bb70 con 0x7fda60119750 2023-09-30T22:33:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda65c74700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda6012d7b0 con 0x7fda6012f8b0 2023-09-30T22:33:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda5f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda6012f8b0 0x7fda60118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda5f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda6012f8b0 0x7fda60118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51500/0 (socket says 172.21.15.59:51500) 2023-09-30T22:33:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda5f7fe700 1 -- 172.21.15.59:0/1061891578 learned_addr learned my addr 172.21.15.59:0/1061891578 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda5ffff700 1 --2- 172.21.15.59:0/1061891578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda60119750 0x7fda601cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda5f7fe700 1 -- 172.21.15.59:0/1061891578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda60119750 msgr2=0x7fda601cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda5f7fe700 1 --2- 172.21.15.59:0/1061891578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda60119750 0x7fda601cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda5f7fe700 1 -- 172.21.15.59:0/1061891578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda60130260 msgr2=0x7fda60119210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:33:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda5f7fe700 1 --2- 172.21.15.59:0/1061891578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda60130260 0x7fda60119210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda5f7fe700 1 -- 172.21.15.59:0/1061891578 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda50009550 con 0x7fda6012f8b0 2023-09-30T22:33:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda5ffff700 1 --2- 172.21.15.59:0/1061891578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda60119750 0x7fda601cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.018+0000 7fda5f7fe700 1 --2- 172.21.15.59:0/1061891578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda6012f8b0 0x7fda60118cd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fda6012d470 tx=0x7fda50004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.019+0000 7fda47fff700 1 -- 172.21.15.59:0/1061891578 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5001e070 con 0x7fda6012f8b0 2023-09-30T22:33:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.019+0000 7fda47fff700 1 -- 172.21.15.59:0/1061891578 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda50004350 con 0x7fda6012f8b0 2023-09-30T22:33:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.019+0000 7fda47fff700 1 -- 172.21.15.59:0/1061891578 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda500036a0 con 0x7fda6012f8b0 2023-09-30T22:33:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.019+0000 7fda65c74700 1 -- 172.21.15.59:0/1061891578 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda60129fa0 con 0x7fda6012f8b0 2023-09-30T22:33:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.019+0000 7fda65c74700 1 -- 172.21.15.59:0/1061891578 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6009eaa0 con 0x7fda6012f8b0 2023-09-30T22:33:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.020+0000 7f17e27fc700 1 -- 172.21.15.59:0/1720867842 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17dc01c460 con 0x7f17ec06f5d0 2023-09-30T22:33:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.020+0000 7fda47fff700 1 -- 172.21.15.59:0/1061891578 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda50003800 con 0x7fda6012f8b0 2023-09-30T22:33:16.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.021+0000 7fda47fff700 1 -- 172.21.15.59:0/1061891578 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fda50040860 con 0x7fda6012f8b0 2023-09-30T22:33:16.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.020+0000 7f17e27fc700 1 -- 172.21.15.59:0/1720867842 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f17dc03ffe0 con 0x7f17ec06f5d0 2023-09-30T22:33:16.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.021+0000 7fda65c74700 1 -- 172.21.15.59:0/1061891578 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6011bcb0 con 0x7fda6012f8b0 2023-09-30T22:33:16.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.025+0000 7f17e27fc700 1 -- 172.21.15.59:0/1720867842 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17dc01a770 con 0x7f17ec06f5d0 2023-09-30T22:33:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.026+0000 7fda47fff700 1 -- 172.21.15.59:0/1061891578 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda50014080 con 0x7fda6012f8b0 2023-09-30T22:33:16.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.205+0000 7f57239d1700 1 -- 172.21.15.59:0/1940085283 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f571c09c620 con 0x7f571c138dc0 2023-09-30T22:33:16.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.205+0000 7f5711ffb700 1 -- 172.21.15.59:0/1940085283 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f571402a070 con 0x7f571c138dc0 2023-09-30T22:33:16.206 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:16.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.209+0000 7f57239d1700 1 -- 172.21.15.59:0/1940085283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571c138dc0 msgr2=0x7f571c071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:16.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.209+0000 7f57239d1700 1 --2- 172.21.15.59:0/1940085283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571c138dc0 0x7f571c071420 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5714009e30 tx=0x7f571400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.209+0000 7f57239d1700 1 -- 172.21.15.59:0/1940085283 shutdown_connections 2023-09-30T22:33:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.209+0000 7f57239d1700 1 --2- 172.21.15.59:0/1940085283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571c138dc0 0x7f571c071420 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.209+0000 7f57239d1700 1 --2- 172.21.15.59:0/1940085283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f571c133420 0x7f571c0709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.209+0000 7f57239d1700 1 --2- 172.21.15.59:0/1940085283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f571c1337f0 0x7f571c070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.209+0000 7f57239d1700 1 -- 172.21.15.59:0/1940085283 >> 172.21.15.59:0/1940085283 conn(0x7f571c0a4210 msgr2=0x7f571c13ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.209+0000 7f57239d1700 1 -- 172.21.15.59:0/1940085283 shutdown_connections 2023-09-30T22:33:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.209+0000 7f57239d1700 1 -- 172.21.15.59:0/1940085283 wait complete. 2023-09-30T22:33:16.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:16.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.228+0000 7f3960c9e700 1 -- 172.21.15.59:0/3512387351 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f395c122ae0 con 0x7f395c136fe0 2023-09-30T22:33:16.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.229+0000 7f394affd700 1 -- 172.21.15.59:0/3512387351 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3954012340 con 0x7f395c136fe0 2023-09-30T22:33:16.229 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:16.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.231+0000 7f3960c9e700 1 -- 172.21.15.59:0/3512387351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395c136fe0 msgr2=0x7f395c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:16.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.231+0000 7f3960c9e700 1 --2- 172.21.15.59:0/3512387351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395c136fe0 0x7f395c06c330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f395c0a07c0 tx=0x7f395400ef90 comp rx=0 tx=0).stop 2023-09-30T22:33:16.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.231+0000 7f3960c9e700 1 -- 172.21.15.59:0/3512387351 shutdown_connections 2023-09-30T22:33:16.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.231+0000 7f3960c9e700 1 --2- 172.21.15.59:0/3512387351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395c136fe0 0x7f395c06c330 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.231+0000 7f3960c9e700 1 --2- 172.21.15.59:0/3512387351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395c09e930 0x7f395c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.231+0000 7f3960c9e700 1 --2- 172.21.15.59:0/3512387351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395c09f410 0x7f395c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.231+0000 7f3960c9e700 1 -- 172.21.15.59:0/3512387351 >> 172.21.15.59:0/3512387351 conn(0x7f395c0a4210 msgr2=0x7f395c134890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:16.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.231+0000 7f3960c9e700 1 -- 172.21.15.59:0/3512387351 shutdown_connections 2023-09-30T22:33:16.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.231+0000 7f3960c9e700 1 -- 172.21.15.59:0/3512387351 wait complete. 2023-09-30T22:33:16.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.232+0000 7fda65c74700 1 -- 172.21.15.59:0/1061891578 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fda60074ea0 con 0x7fda6012f8b0 2023-09-30T22:33:16.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.232+0000 7fda47fff700 1 -- 172.21.15.59:0/1061891578 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda50019450 con 0x7fda6012f8b0 2023-09-30T22:33:16.234 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:16.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.234+0000 7f17f3b08700 1 -- 172.21.15.59:0/1720867842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f17ec07a180 con 0x7f17ec06f5d0 2023-09-30T22:33:16.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.234+0000 7fda65c74700 1 -- 172.21.15.59:0/1061891578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda6012f8b0 msgr2=0x7fda60118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:16.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.234+0000 7fda65c74700 1 --2- 172.21.15.59:0/1061891578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda6012f8b0 0x7fda60118cd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fda6012d470 tx=0x7fda50004750 comp rx=0 tx=0).stop 2023-09-30T22:33:16.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.235+0000 7fda65c74700 1 -- 172.21.15.59:0/1061891578 shutdown_connections 2023-09-30T22:33:16.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.235+0000 7fda65c74700 1 --2- 172.21.15.59:0/1061891578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda6012f8b0 0x7fda60118cd0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.235+0000 7fda65c74700 1 --2- 172.21.15.59:0/1061891578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda60119750 0x7fda601cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.235+0000 7fda65c74700 1 --2- 172.21.15.59:0/1061891578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda60130260 0x7fda60119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.235+0000 7fda65c74700 1 -- 172.21.15.59:0/1061891578 >> 172.21.15.59:0/1061891578 conn(0x7fda600a2aa0 msgr2=0x7fda6012b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:16.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.235+0000 7fda65c74700 1 -- 172.21.15.59:0/1061891578 shutdown_connections 2023-09-30T22:33:16.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.235+0000 7fda65c74700 1 -- 172.21.15.59:0/1061891578 wait complete. 2023-09-30T22:33:16.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.235+0000 7f17e27fc700 1 -- 172.21.15.59:0/1720867842 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17dc02a090 con 0x7f17ec06f5d0 2023-09-30T22:33:16.236 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:16.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.237+0000 7f17f3b08700 1 -- 172.21.15.59:0/1720867842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17ec06f5d0 msgr2=0x7f17ec12d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:16.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.237+0000 7f17f3b08700 1 --2- 172.21.15.59:0/1720867842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17ec06f5d0 0x7f17ec12d7b0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00c500 tx=0x7f17dc00c8c0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.241+0000 7f17f3b08700 1 -- 172.21.15.59:0/1720867842 shutdown_connections 2023-09-30T22:33:16.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.241+0000 7f17f3b08700 1 --2- 172.21.15.59:0/1720867842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17ec135c20 0x7f17ec12e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.241+0000 7f17f3b08700 1 --2- 172.21.15.59:0/1720867842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17ec06f5d0 0x7f17ec12d7b0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.241+0000 7f17f3b08700 1 --2- 172.21.15.59:0/1720867842 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17ec12cf60 0x7f17ec12dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:16.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.241+0000 7f17f3b08700 1 -- 172.21.15.59:0/1720867842 >> 172.21.15.59:0/1720867842 conn(0x7f17ec0a2aa0 msgr2=0x7f17ec08a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:16.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.241+0000 7f17f3b08700 1 -- 172.21.15.59:0/1720867842 shutdown_connections 2023-09-30T22:33:16.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:16.241+0000 7f17f3b08700 1 -- 172.21.15.59:0/1720867842 wait complete. 2023-09-30T22:33:16.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:16.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:16.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:17.225 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:17.249 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:17.252 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:17.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.392+0000 7f5f7581b700 1 Processor -- start 2023-09-30T22:33:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.392+0000 7f5f7581b700 1 -- start start 2023-09-30T22:33:17.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.393+0000 7f5f7581b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f7009e930 0x7f5f7009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.393+0000 7f5f7581b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5f7009f240 0x7f5f701317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.393+0000 7f5f7581b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f70070940 con 0x7f5f7009f650 2023-09-30T22:33:17.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.393+0000 7f5f7581b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7006fd60 con 0x7f5f7009f240 2023-09-30T22:33:17.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.393+0000 7f5f7581b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7006fa80 con 0x7f5f7009e930 2023-09-30T22:33:17.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.393+0000 7f5f6effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f7009e930 0x7f5f7009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.393+0000 7f5f6effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f7009e930 0x7f5f7009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51010/0 (socket says 172.21.15.59:51010) 2023-09-30T22:33:17.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.393+0000 7f5f6effd700 1 -- 172.21.15.59:0/1400331936 learned_addr learned my addr 172.21.15.59:0/1400331936 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:17.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.393+0000 7f5f6e7fc700 1 --2- 172.21.15.59:0/1400331936 >> v2:172.21.15.59:3300/0 conn(0x7f5f7009f240 0x7f5f701317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.393+0000 7f5f6e7fc700 1 -- 172.21.15.59:0/1400331936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f7009e930 msgr2=0x7f5f7009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:17.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.393+0000 7f5f6e7fc700 1 --2- 172.21.15.59:0/1400331936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f7009e930 0x7f5f7009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.393+0000 7f5f6e7fc700 1 -- 172.21.15.59:0/1400331936 >> v1:172.21.15.59:6789/0 conn(0x7f5f7009f650 legacy=0x7f5f70131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.393+0000 7f5f6e7fc700 1 -- 172.21.15.59:0/1400331936 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7009fb60 con 0x7f5f7009f240 2023-09-30T22:33:17.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.394+0000 7f5f6e7fc700 1 --2- 172.21.15.59:0/1400331936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7009f240 0x7f5f701317f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009840 tx=0x7f5f64009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97605faa12d3544 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:17.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.394+0000 7f5f6dffb700 1 -- 172.21.15.59:0/1400331936 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64011830 con 0x7f5f7009f240 2023-09-30T22:33:17.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.394+0000 7f5f6dffb700 1 -- 172.21.15.59:0/1400331936 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f64011990 con 0x7f5f7009f240 2023-09-30T22:33:17.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.394+0000 7f5f6dffb700 1 -- 172.21.15.59:0/1400331936 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64011d20 con 0x7f5f7009f240 2023-09-30T22:33:17.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.395+0000 7f5f7581b700 1 -- 172.21.15.59:0/1400331936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7009f240 msgr2=0x7f5f701317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.395+0000 7f5f7581b700 1 --2- 172.21.15.59:0/1400331936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7009f240 0x7f5f701317f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009840 tx=0x7f5f64009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:17.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.395+0000 7f5f7581b700 1 -- 172.21.15.59:0/1400331936 shutdown_connections 2023-09-30T22:33:17.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.395+0000 7f5f7581b700 1 --2- 172.21.15.59:0/1400331936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f7009e930 0x7f5f7009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.395+0000 7f5f7581b700 1 --2- 172.21.15.59:0/1400331936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7009f240 0x7f5f701317f0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.395+0000 7f5f7581b700 1 -- 172.21.15.59:0/1400331936 >> 172.21.15.59:0/1400331936 conn(0x7f5f700a4210 msgr2=0x7f5f700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:17.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.395+0000 7f5f7581b700 1 -- 172.21.15.59:0/1400331936 shutdown_connections 2023-09-30T22:33:17.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.395+0000 7f5f7581b700 1 -- 172.21.15.59:0/1400331936 wait complete. 2023-09-30T22:33:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.396+0000 7f5f7581b700 1 Processor -- start 2023-09-30T22:33:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.397+0000 7f5f7581b700 1 -- start start 2023-09-30T22:33:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.397+0000 7f5f7581b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7009e930 0x7f5f70120300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.397+0000 7f5f7581b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f7009f240 0x7f5f70120840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.397+0000 7f5f7581b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f7009f650 0x7f5f70120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.397+0000 7f5f7581b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f700a31d0 con 0x7f5f7009e930 2023-09-30T22:33:17.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.397+0000 7f5f7581b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f70071d20 con 0x7f5f7009f650 2023-09-30T22:33:17.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.397+0000 7f5f7581b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f70122700 con 0x7f5f7009f240 2023-09-30T22:33:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.398+0000 7f5f6effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7009e930 0x7f5f70120300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.398+0000 7f5f6effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7009e930 0x7f5f70120300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48918/0 (socket says 172.21.15.59:48918) 2023-09-30T22:33:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.398+0000 7f5f6effd700 1 -- 172.21.15.59:0/2368245268 learned_addr learned my addr 172.21.15.59:0/2368245268 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.398+0000 7f5f6e7fc700 1 --2- 172.21.15.59:0/2368245268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f7009f240 0x7f5f70120840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.398+0000 7f5f6f7fe700 1 --2- 172.21.15.59:0/2368245268 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f7009f650 0x7f5f70120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.398+0000 7f5f6effd700 1 -- 172.21.15.59:0/2368245268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f7009f240 msgr2=0x7f5f70120840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.398+0000 7f5f6effd700 1 --2- 172.21.15.59:0/2368245268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f7009f240 0x7f5f70120840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.398+0000 7f5f6effd700 1 -- 172.21.15.59:0/2368245268 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f7009f650 msgr2=0x7f5f70120d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.398+0000 7f5f6effd700 1 --2- 172.21.15.59:0/2368245268 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f7009f650 0x7f5f70120d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.398+0000 7f5f6effd700 1 -- 172.21.15.59:0/2368245268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f640094a0 con 0x7f5f7009e930 2023-09-30T22:33:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.398+0000 7f5f6effd700 1 --2- 172.21.15.59:0/2368245268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7009e930 0x7f5f70120300 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000e940 tx=0x7f5f6000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.399+0000 7f5f57fff700 1 -- 172.21.15.59:0/2368245268 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f600096a0 con 0x7f5f7009e930 2023-09-30T22:33:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.399+0000 7f5f57fff700 1 -- 172.21.15.59:0/2368245268 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f60013980 con 0x7f5f7009e930 2023-09-30T22:33:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.399+0000 7f5f7581b700 1 -- 172.21.15.59:0/2368245268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f700a0190 con 0x7f5f7009e930 2023-09-30T22:33:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.399+0000 7f5f57fff700 1 -- 172.21.15.59:0/2368245268 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60013d30 con 0x7f5f7009e930 2023-09-30T22:33:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.399+0000 7f5f7581b700 1 -- 172.21.15.59:0/2368245268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f70123e50 con 0x7f5f7009e930 2023-09-30T22:33:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.400+0000 7f5f7581b700 1 -- 172.21.15.59:0/2368245268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7011d540 con 0x7f5f7009e930 2023-09-30T22:33:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.401+0000 7f5f57fff700 1 -- 172.21.15.59:0/2368245268 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f6001b440 con 0x7f5f7009e930 2023-09-30T22:33:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.401+0000 7f5f57fff700 1 -- 172.21.15.59:0/2368245268 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5f600438f0 con 0x7f5f7009e930 2023-09-30T22:33:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.405+0000 7f5f57fff700 1 -- 172.21.15.59:0/2368245268 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f600243b0 con 0x7f5f7009e930 2023-09-30T22:33:17.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.420+0000 7f10be3f8700 1 Processor -- start 2023-09-30T22:33:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.420+0000 7f6445598700 1 Processor -- start 2023-09-30T22:33:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.420+0000 7f6445598700 1 -- start start 2023-09-30T22:33:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.420+0000 7f10be3f8700 1 -- start start 2023-09-30T22:33:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.420+0000 7f10be3f8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10b806e570 0x7f10b806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.420+0000 7f10be3f8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b809eca0 0x7f10b806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.420+0000 7f10be3f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b8134610 0x7f10b8134a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.420+0000 7f10be3f8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b8070ee0 con 0x7f10b806e570 2023-09-30T22:33:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.420+0000 7f10be3f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b8071480 con 0x7f10b8134610 2023-09-30T22:33:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.420+0000 7f10be3f8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10b806f3c0 con 0x7f10b809eca0 2023-09-30T22:33:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f6445598700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6440131810 0x7f6440131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f10b77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b809eca0 0x7f10b806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f10b77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b809eca0 0x7f10b806ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51528/0 (socket says 172.21.15.59:51528) 2023-09-30T22:33:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f10b77fe700 1 -- 172.21.15.59:0/3102184200 learned_addr learned my addr 172.21.15.59:0/3102184200 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f10bc995700 1 --2- 172.21.15.59:0/3102184200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b8134610 0x7f10b8134a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f6445598700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6440099a40 0x7f6440099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f6445598700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644009a3b0 0x7f6440138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f6445598700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64401313c0 con 0x7f6440131810 2023-09-30T22:33:17.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f6445598700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644006e8c0 con 0x7f6440099a40 2023-09-30T22:33:17.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f6445598700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6440071d20 con 0x7f644009a3b0 2023-09-30T22:33:17.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f643e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6440099a40 0x7f6440099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f643e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6440099a40 0x7f6440099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51026/0 (socket says 172.21.15.59:51026) 2023-09-30T22:33:17.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f643e7fc700 1 -- 172.21.15.59:0/2701309747 learned_addr learned my addr 172.21.15.59:0/2701309747 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:17.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f643f7fe700 1 --2- 172.21.15.59:0/2701309747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644009a3b0 0x7f6440138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f643effd700 1 --2- 172.21.15.59:0/2701309747 >> v2:172.21.15.59:3300/0 conn(0x7f6440131810 0x7f6440131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f10b77fe700 1 -- 172.21.15.59:0/3102184200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b8134610 msgr2=0x7f10b8134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f10b77fe700 1 --2- 172.21.15.59:0/3102184200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b8134610 0x7f10b8134a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f10b77fe700 1 -- 172.21.15.59:0/3102184200 >> v2:172.21.15.59:3300/0 conn(0x7f10b806e570 msgr2=0x7f10b806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f10b77fe700 1 --2- 172.21.15.59:0/3102184200 >> v2:172.21.15.59:3300/0 conn(0x7f10b806e570 0x7f10b806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.421+0000 7f10b77fe700 1 -- 172.21.15.59:0/3102184200 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b8071b90 con 0x7f10b809eca0 2023-09-30T22:33:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.422+0000 7f10b77fe700 1 --2- 172.21.15.59:0/3102184200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b809eca0 0x7f10b806ee80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0098f0 tx=0x7f10ac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a93af061940e1b76 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.422+0000 7f643f7fe700 1 -- 172.21.15.59:0/2701309747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6440099a40 msgr2=0x7f6440099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.422+0000 7f643f7fe700 1 --2- 172.21.15.59:0/2701309747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6440099a40 0x7f6440099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.422+0000 7f643f7fe700 1 -- 172.21.15.59:0/2701309747 >> v2:172.21.15.59:3300/0 conn(0x7f6440131810 msgr2=0x7f6440131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.422+0000 7f643f7fe700 1 --2- 172.21.15.59:0/2701309747 >> v2:172.21.15.59:3300/0 conn(0x7f6440131810 0x7f6440131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.422+0000 7f643f7fe700 1 -- 172.21.15.59:0/2701309747 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64400721a0 con 0x7f644009a3b0 2023-09-30T22:33:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.422+0000 7f643f7fe700 1 --2- 172.21.15.59:0/2701309747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644009a3b0 0x7f6440138650 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6438009d90 tx=0x7f643800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78230445a550d1b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:17.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.422+0000 7f643dffb700 1 -- 172.21.15.59:0/2701309747 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800e070 con 0x7f644009a3b0 2023-09-30T22:33:17.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.422+0000 7f10b6ffd700 1 -- 172.21.15.59:0/3102184200 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac00b8a0 con 0x7f10b809eca0 2023-09-30T22:33:17.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.422+0000 7f10b6ffd700 1 -- 172.21.15.59:0/3102184200 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac00ba00 con 0x7f10b809eca0 2023-09-30T22:33:17.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.422+0000 7f10b6ffd700 1 -- 172.21.15.59:0/3102184200 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac00bd90 con 0x7f10b809eca0 2023-09-30T22:33:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.422+0000 7f643dffb700 1 -- 172.21.15.59:0/2701309747 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643800bb20 con 0x7f644009a3b0 2023-09-30T22:33:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.422+0000 7f643dffb700 1 -- 172.21.15.59:0/2701309747 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6438012430 con 0x7f644009a3b0 2023-09-30T22:33:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f10be3f8700 1 -- 172.21.15.59:0/3102184200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b809eca0 msgr2=0x7f10b806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f10be3f8700 1 --2- 172.21.15.59:0/3102184200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b809eca0 0x7f10b806ee80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0098f0 tx=0x7f10ac009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f6445598700 1 -- 172.21.15.59:0/2701309747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644009a3b0 msgr2=0x7f6440138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f6445598700 1 --2- 172.21.15.59:0/2701309747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644009a3b0 0x7f6440138650 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6438009d90 tx=0x7f643800b330 comp rx=0 tx=0).stop 2023-09-30T22:33:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f6445598700 1 -- 172.21.15.59:0/2701309747 shutdown_connections 2023-09-30T22:33:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f6445598700 1 --2- 172.21.15.59:0/2701309747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644009a3b0 0x7f6440138650 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f6445598700 1 --2- 172.21.15.59:0/2701309747 >> v2:172.21.15.59:3300/0 conn(0x7f6440131810 0x7f6440131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f6445598700 1 --2- 172.21.15.59:0/2701309747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6440099a40 0x7f6440099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f6445598700 1 -- 172.21.15.59:0/2701309747 >> 172.21.15.59:0/2701309747 conn(0x7f64400a2aa0 msgr2=0x7f64400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f6445598700 1 -- 172.21.15.59:0/2701309747 shutdown_connections 2023-09-30T22:33:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f6445598700 1 -- 172.21.15.59:0/2701309747 wait complete. 2023-09-30T22:33:17.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f10be3f8700 1 -- 172.21.15.59:0/3102184200 shutdown_connections 2023-09-30T22:33:17.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f10be3f8700 1 --2- 172.21.15.59:0/3102184200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b8134610 0x7f10b8134a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f10be3f8700 1 --2- 172.21.15.59:0/3102184200 >> v2:172.21.15.59:3300/0 conn(0x7f10b806e570 0x7f10b806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f10be3f8700 1 --2- 172.21.15.59:0/3102184200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b809eca0 0x7f10b806ee80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f10be3f8700 1 -- 172.21.15.59:0/3102184200 >> 172.21.15.59:0/3102184200 conn(0x7f10b80a2aa0 msgr2=0x7f10b80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f10be3f8700 1 -- 172.21.15.59:0/3102184200 shutdown_connections 2023-09-30T22:33:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.423+0000 7f10be3f8700 1 -- 172.21.15.59:0/3102184200 wait complete. 2023-09-30T22:33:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.424+0000 7f10be3f8700 1 Processor -- start 2023-09-30T22:33:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.424+0000 7f6445598700 1 Processor -- start 2023-09-30T22:33:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.424+0000 7f6445598700 1 -- start start 2023-09-30T22:33:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f6445598700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6440099a40 0x7f6440119550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f6445598700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644009a3b0 0x7f6440119a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f6445598700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6440131810 0x7f6440119fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f6445598700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644011aa00 con 0x7f644009a3b0 2023-09-30T22:33:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f6445598700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644011b160 con 0x7f6440131810 2023-09-30T22:33:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f6445598700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f644011b780 con 0x7f6440099a40 2023-09-30T22:33:17.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f10be3f8700 1 -- start start 2023-09-30T22:33:17.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f10be3f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b806e570 0x7f10b813bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f10be3f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b8134610 0x7f10b81260d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f10be3f8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b8127940 0x7f10b8126610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f10be3f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b813dbb0 con 0x7f10b806e570 2023-09-30T22:33:17.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f10be3f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b813d4a0 con 0x7f10b8134610 2023-09-30T22:33:17.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f10be3f8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10b813d760 con 0x7f10b8127940 2023-09-30T22:33:17.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f10b77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b8134610 0x7f10b81260d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f10b77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b8134610 0x7f10b81260d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51034/0 (socket says 172.21.15.59:51034) 2023-09-30T22:33:17.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f10b77fe700 1 -- 172.21.15.59:0/844579936 learned_addr learned my addr 172.21.15.59:0/844579936 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:17.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f10bc995700 1 --2- 172.21.15.59:0/844579936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b8127940 0x7f10b8126610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.426+0000 7f10b7fff700 1 --2- 172.21.15.59:0/844579936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b806e570 0x7f10b813bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f643effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6440099a40 0x7f6440119550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f643effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6440099a40 0x7f6440119550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51542/0 (socket says 172.21.15.59:51542) 2023-09-30T22:33:17.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f643effd700 1 -- 172.21.15.59:0/2570294747 learned_addr learned my addr 172.21.15.59:0/2570294747 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:17.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f643e7fc700 1 --2- 172.21.15.59:0/2570294747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644009a3b0 0x7f6440119a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.425+0000 7f643f7fe700 1 --2- 172.21.15.59:0/2570294747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6440131810 0x7f6440119fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.426+0000 7f10bc995700 1 -- 172.21.15.59:0/844579936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b8134610 msgr2=0x7f10b81260d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.426+0000 7f10bc995700 1 --2- 172.21.15.59:0/844579936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b8134610 0x7f10b81260d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.426+0000 7f10bc995700 1 -- 172.21.15.59:0/844579936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b806e570 msgr2=0x7f10b813bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.426+0000 7f10bc995700 1 --2- 172.21.15.59:0/844579936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b806e570 0x7f10b813bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.426+0000 7f10bc995700 1 -- 172.21.15.59:0/844579936 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac009550 con 0x7f10b8127940 2023-09-30T22:33:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.426+0000 7f643e7fc700 1 -- 172.21.15.59:0/2570294747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6440099a40 msgr2=0x7f6440119550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.426+0000 7f643e7fc700 1 --2- 172.21.15.59:0/2570294747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6440099a40 0x7f6440119550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.426+0000 7f643e7fc700 1 -- 172.21.15.59:0/2570294747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6440131810 msgr2=0x7f6440119fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.426+0000 7f643e7fc700 1 --2- 172.21.15.59:0/2570294747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6440131810 0x7f6440119fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.426+0000 7f643e7fc700 1 -- 172.21.15.59:0/2570294747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6438009a70 con 0x7f644009a3b0 2023-09-30T22:33:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.427+0000 7f643e7fc700 1 --2- 172.21.15.59:0/2570294747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644009a3b0 0x7f6440119a90 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f643400e910 tx=0x7f643400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:17.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.427+0000 7f64277fe700 1 -- 172.21.15.59:0/2570294747 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434013680 con 0x7f644009a3b0 2023-09-30T22:33:17.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.427+0000 7f10bc995700 1 --2- 172.21.15.59:0/844579936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b8127940 0x7f10b8126610 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f10b0007d90 tx=0x7f10b000e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:17.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.427+0000 7f10b4ff9700 1 -- 172.21.15.59:0/844579936 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b0018070 con 0x7f10b8127940 2023-09-30T22:33:17.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.427+0000 7f10b4ff9700 1 -- 172.21.15.59:0/844579936 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b000eb30 con 0x7f10b8127940 2023-09-30T22:33:17.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.427+0000 7f10b4ff9700 1 -- 172.21.15.59:0/844579936 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b0003a20 con 0x7f10b8127940 2023-09-30T22:33:17.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.427+0000 7f64277fe700 1 -- 172.21.15.59:0/2570294747 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64340137e0 con 0x7f644009a3b0 2023-09-30T22:33:17.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.427+0000 7f6445598700 1 -- 172.21.15.59:0/2570294747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644011cd90 con 0x7f644009a3b0 2023-09-30T22:33:17.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.427+0000 7f64277fe700 1 -- 172.21.15.59:0/2570294747 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434013b70 con 0x7f644009a3b0 2023-09-30T22:33:17.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.427+0000 7f6445598700 1 -- 172.21.15.59:0/2570294747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64401308e0 con 0x7f644009a3b0 2023-09-30T22:33:17.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.428+0000 7f64277fe700 1 -- 172.21.15.59:0/2570294747 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6434013cd0 con 0x7f644009a3b0 2023-09-30T22:33:17.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.428+0000 7f6445598700 1 -- 172.21.15.59:0/2570294747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6440074ea0 con 0x7f644009a3b0 2023-09-30T22:33:17.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.428+0000 7f64277fe700 1 -- 172.21.15.59:0/2570294747 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f643403f690 con 0x7f644009a3b0 2023-09-30T22:33:17.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.430+0000 7f10be3f8700 1 -- 172.21.15.59:0/844579936 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b813e140 con 0x7f10b8127940 2023-09-30T22:33:17.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.430+0000 7f10be3f8700 1 -- 172.21.15.59:0/844579936 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b813c460 con 0x7f10b8127940 2023-09-30T22:33:17.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.430+0000 7f10b4ff9700 1 -- 172.21.15.59:0/844579936 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10b0014420 con 0x7f10b8127940 2023-09-30T22:33:17.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.431+0000 7f10b4ff9700 1 -- 172.21.15.59:0/844579936 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f10b003f6e0 con 0x7f10b8127940 2023-09-30T22:33:17.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.431+0000 7f10be3f8700 1 -- 172.21.15.59:0/844579936 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b813e620 con 0x7f10b8127940 2023-09-30T22:33:17.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.434+0000 7f64277fe700 1 -- 172.21.15.59:0/2570294747 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6434021080 con 0x7f644009a3b0 2023-09-30T22:33:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.440+0000 7f10b4ff9700 1 -- 172.21.15.59:0/844579936 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10b00148b0 con 0x7f10b8127940 2023-09-30T22:33:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.443+0000 7f8a6dfd7700 1 Processor -- start 2023-09-30T22:33:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.443+0000 7f8a6dfd7700 1 -- start start 2023-09-30T22:33:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.443+0000 7f8a6dfd7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a6809d6f0 0x7f8a6809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.444+0000 7f8a6dfd7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8a6809e410 0x7f8a68134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.444+0000 7f8a6dfd7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6809b120 con 0x7f8a6809e000 2023-09-30T22:33:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.444+0000 7f8a6dfd7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6806b460 con 0x7f8a6809e410 2023-09-30T22:33:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.444+0000 7f8a6dfd7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6809a7e0 con 0x7f8a6809d6f0 2023-09-30T22:33:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.444+0000 7f8a677fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a6809d6f0 0x7f8a6809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.444+0000 7f8a677fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a6809d6f0 0x7f8a6809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51560/0 (socket says 172.21.15.59:51560) 2023-09-30T22:33:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.444+0000 7f8a677fe700 1 -- 172.21.15.59:0/211730080 learned_addr learned my addr 172.21.15.59:0/211730080 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.444+0000 7f8a67fff700 1 --2- 172.21.15.59:0/211730080 >> v2:172.21.15.59:3300/0 conn(0x7f8a6809e410 0x7f8a68134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.444+0000 7f8a677fe700 1 -- 172.21.15.59:0/211730080 >> v2:172.21.15.59:3300/0 conn(0x7f8a6809e410 msgr2=0x7f8a68134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.444+0000 7f8a677fe700 1 --2- 172.21.15.59:0/211730080 >> v2:172.21.15.59:3300/0 conn(0x7f8a6809e410 0x7f8a68134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.444+0000 7f8a677fe700 1 -- 172.21.15.59:0/211730080 >> v1:172.21.15.59:6789/0 conn(0x7f8a6809e000 legacy=0x7f8a681339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.444+0000 7f8a677fe700 1 -- 172.21.15.59:0/211730080 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6809a500 con 0x7f8a6809d6f0 2023-09-30T22:33:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.444+0000 7f8a67fff700 1 --2- 172.21.15.59:0/211730080 >> v2:172.21.15.59:3300/0 conn(0x7f8a6809e410 0x7f8a68134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.445+0000 7f8a677fe700 1 --2- 172.21.15.59:0/211730080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a6809d6f0 0x7f8a6809dac0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009920 tx=0x7f8a58009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f574e647c5a536ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.445+0000 7f8a667fc700 1 -- 172.21.15.59:0/211730080 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58011830 con 0x7f8a6809d6f0 2023-09-30T22:33:17.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.445+0000 7f8a667fc700 1 -- 172.21.15.59:0/211730080 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a58011990 con 0x7f8a6809d6f0 2023-09-30T22:33:17.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.445+0000 7f8a667fc700 1 -- 172.21.15.59:0/211730080 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58011d20 con 0x7f8a6809d6f0 2023-09-30T22:33:17.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.446+0000 7f8a6dfd7700 1 -- 172.21.15.59:0/211730080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a6809d6f0 msgr2=0x7f8a6809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.446+0000 7f8a6dfd7700 1 --2- 172.21.15.59:0/211730080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a6809d6f0 0x7f8a6809dac0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009920 tx=0x7f8a58009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:17.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.446+0000 7f8a6dfd7700 1 -- 172.21.15.59:0/211730080 shutdown_connections 2023-09-30T22:33:17.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.446+0000 7f8a6dfd7700 1 --2- 172.21.15.59:0/211730080 >> v2:172.21.15.59:3300/0 conn(0x7f8a6809e410 0x7f8a68134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.446+0000 7f8a6dfd7700 1 --2- 172.21.15.59:0/211730080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a6809d6f0 0x7f8a6809dac0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.446+0000 7f8a6dfd7700 1 -- 172.21.15.59:0/211730080 >> 172.21.15.59:0/211730080 conn(0x7f8a68066f50 msgr2=0x7f8a6809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.446+0000 7f8a6dfd7700 1 -- 172.21.15.59:0/211730080 shutdown_connections 2023-09-30T22:33:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.446+0000 7f8a6dfd7700 1 -- 172.21.15.59:0/211730080 wait complete. 2023-09-30T22:33:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.447+0000 7f8a6dfd7700 1 Processor -- start 2023-09-30T22:33:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.447+0000 7f8a6dfd7700 1 -- start start 2023-09-30T22:33:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.448+0000 7f8a6dfd7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a6809d6f0 0x7f8a681a8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.448+0000 7f8a6dfd7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a6809e000 0x7f8a681a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.449+0000 7f8a677fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a6809d6f0 0x7f8a681a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.449+0000 7f8a677fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a6809d6f0 0x7f8a681a8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51038/0 (socket says 172.21.15.59:51038) 2023-09-30T22:33:17.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.449+0000 7f8a6dfd7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a6809e410 0x7f8a681a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:17.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.449+0000 7f8a6dfd7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a681abdb0 con 0x7f8a6809e410 2023-09-30T22:33:17.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.449+0000 7f8a6dfd7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a681bae00 con 0x7f8a6809d6f0 2023-09-30T22:33:17.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.449+0000 7f8a6dfd7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a681abfb0 con 0x7f8a6809e000 2023-09-30T22:33:17.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.449+0000 7f8a677fe700 1 -- 172.21.15.59:0/3781132315 learned_addr learned my addr 172.21.15.59:0/3781132315 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:17.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.448+0000 7f8a66ffd700 1 --2- 172.21.15.59:0/3781132315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a6809e000 0x7f8a681a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.449+0000 7f8a67fff700 1 --2- 172.21.15.59:0/3781132315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a6809e410 0x7f8a681a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.449+0000 7f8a67fff700 1 -- 172.21.15.59:0/3781132315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a6809e000 msgr2=0x7f8a681a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.449+0000 7f8a67fff700 1 --2- 172.21.15.59:0/3781132315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a6809e000 0x7f8a681a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.449+0000 7f8a67fff700 1 -- 172.21.15.59:0/3781132315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a6809d6f0 msgr2=0x7f8a681a8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.449+0000 7f8a67fff700 1 --2- 172.21.15.59:0/3781132315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a6809d6f0 0x7f8a681a8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.449+0000 7f8a67fff700 1 -- 172.21.15.59:0/3781132315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a60009a70 con 0x7f8a6809e410 2023-09-30T22:33:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.449+0000 7f8a67fff700 1 --2- 172.21.15.59:0/3781132315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a6809e410 0x7f8a681a8ff0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000efc0 tx=0x7f8a6000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.450+0000 7f8a4ffff700 1 -- 172.21.15.59:0/3781132315 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6000ca90 con 0x7f8a6809e410 2023-09-30T22:33:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.450+0000 7f8a4ffff700 1 -- 172.21.15.59:0/3781132315 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6000f040 con 0x7f8a6809e410 2023-09-30T22:33:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.450+0000 7f8a6dfd7700 1 -- 172.21.15.59:0/3781132315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a58009550 con 0x7f8a6809e410 2023-09-30T22:33:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.450+0000 7f8a4ffff700 1 -- 172.21.15.59:0/3781132315 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6000ce10 con 0x7f8a6809e410 2023-09-30T22:33:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.450+0000 7f8a6dfd7700 1 -- 172.21.15.59:0/3781132315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a681bb470 con 0x7f8a6809e410 2023-09-30T22:33:17.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.451+0000 7f8a6dfd7700 1 -- 172.21.15.59:0/3781132315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6804ea50 con 0x7f8a6809e410 2023-09-30T22:33:17.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.452+0000 7f8a4ffff700 1 -- 172.21.15.59:0/3781132315 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a60003a20 con 0x7f8a6809e410 2023-09-30T22:33:17.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.452+0000 7f8a4ffff700 1 -- 172.21.15.59:0/3781132315 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8a600406a0 con 0x7f8a6809e410 2023-09-30T22:33:17.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.461+0000 7f8a4ffff700 1 -- 172.21.15.59:0/3781132315 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a6001c7c0 con 0x7f8a6809e410 2023-09-30T22:33:17.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.644+0000 7f6445598700 1 -- 172.21.15.59:0/2570294747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f644011cb80 con 0x7f644009a3b0 2023-09-30T22:33:17.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.645+0000 7f64277fe700 1 -- 172.21.15.59:0/2570294747 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f643401be10 con 0x7f644009a3b0 2023-09-30T22:33:17.645 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:17.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.647+0000 7f10be3f8700 1 -- 172.21.15.59:0/844579936 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f10b809d1f0 con 0x7f10b8127940 2023-09-30T22:33:17.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.647+0000 7f10b4ff9700 1 -- 172.21.15.59:0/844579936 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10b00122e0 con 0x7f10b8127940 2023-09-30T22:33:17.648 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:17.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.648+0000 7f6445598700 1 -- 172.21.15.59:0/2570294747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644009a3b0 msgr2=0x7f6440119a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.648+0000 7f6445598700 1 --2- 172.21.15.59:0/2570294747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644009a3b0 0x7f6440119a90 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f643400e910 tx=0x7f643400ec20 comp rx=0 tx=0).stop 2023-09-30T22:33:17.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.649+0000 7f6445598700 1 -- 172.21.15.59:0/2570294747 shutdown_connections 2023-09-30T22:33:17.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.649+0000 7f6445598700 1 --2- 172.21.15.59:0/2570294747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6440099a40 0x7f6440119550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.649+0000 7f6445598700 1 --2- 172.21.15.59:0/2570294747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6440131810 0x7f6440119fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.649+0000 7f6445598700 1 --2- 172.21.15.59:0/2570294747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644009a3b0 0x7f6440119a90 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.649+0000 7f6445598700 1 -- 172.21.15.59:0/2570294747 >> 172.21.15.59:0/2570294747 conn(0x7f64400a2aa0 msgr2=0x7f644012e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:17.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.649+0000 7f6445598700 1 -- 172.21.15.59:0/2570294747 shutdown_connections 2023-09-30T22:33:17.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.649+0000 7f6445598700 1 -- 172.21.15.59:0/2570294747 wait complete. 2023-09-30T22:33:17.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.650+0000 7f10be3f8700 1 -- 172.21.15.59:0/844579936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b8127940 msgr2=0x7f10b8126610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.650+0000 7f10be3f8700 1 --2- 172.21.15.59:0/844579936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b8127940 0x7f10b8126610 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f10b0007d90 tx=0x7f10b000e3c0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.650+0000 7f10be3f8700 1 -- 172.21.15.59:0/844579936 shutdown_connections 2023-09-30T22:33:17.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.650+0000 7f10be3f8700 1 --2- 172.21.15.59:0/844579936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b8127940 0x7f10b8126610 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.650+0000 7f10be3f8700 1 --2- 172.21.15.59:0/844579936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b806e570 0x7f10b813bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.650+0000 7f10be3f8700 1 --2- 172.21.15.59:0/844579936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b8134610 0x7f10b81260d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.650+0000 7f10be3f8700 1 -- 172.21.15.59:0/844579936 >> 172.21.15.59:0/844579936 conn(0x7f10b80a2aa0 msgr2=0x7f10b8137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:17.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.650+0000 7f10be3f8700 1 -- 172.21.15.59:0/844579936 shutdown_connections 2023-09-30T22:33:17.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.650+0000 7f10be3f8700 1 -- 172.21.15.59:0/844579936 wait complete. 2023-09-30T22:33:17.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.653+0000 7f5f7581b700 1 -- 172.21.15.59:0/2368245268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5f70074ea0 con 0x7f5f7009e930 2023-09-30T22:33:17.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.654+0000 7f5f57fff700 1 -- 172.21.15.59:0/2368245268 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f60020030 con 0x7f5f7009e930 2023-09-30T22:33:17.654 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:17.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.656+0000 7f5f7581b700 1 -- 172.21.15.59:0/2368245268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7009e930 msgr2=0x7f5f70120300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.656+0000 7f5f7581b700 1 --2- 172.21.15.59:0/2368245268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7009e930 0x7f5f70120300 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000e940 tx=0x7f5f6000ec50 comp rx=0 tx=0).stop 2023-09-30T22:33:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.660+0000 7f5f7581b700 1 -- 172.21.15.59:0/2368245268 shutdown_connections 2023-09-30T22:33:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.660+0000 7f5f7581b700 1 --2- 172.21.15.59:0/2368245268 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f7009f650 0x7f5f70120d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.660+0000 7f5f7581b700 1 --2- 172.21.15.59:0/2368245268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7009e930 0x7f5f70120300 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.660+0000 7f5f7581b700 1 --2- 172.21.15.59:0/2368245268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f7009f240 0x7f5f70120840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.660+0000 7f5f7581b700 1 -- 172.21.15.59:0/2368245268 >> 172.21.15.59:0/2368245268 conn(0x7f5f700a4210 msgr2=0x7f5f7011a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.660+0000 7f5f7581b700 1 -- 172.21.15.59:0/2368245268 shutdown_connections 2023-09-30T22:33:17.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.660+0000 7f5f7581b700 1 -- 172.21.15.59:0/2368245268 wait complete. 2023-09-30T22:33:17.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:17.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:17.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:17.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.690+0000 7f8a6dfd7700 1 -- 172.21.15.59:0/3781132315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8a6806edd0 con 0x7f8a6809e410 2023-09-30T22:33:17.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.690+0000 7f8a4ffff700 1 -- 172.21.15.59:0/3781132315 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a6001c3b0 con 0x7f8a6809e410 2023-09-30T22:33:17.691 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.693+0000 7f8a6dfd7700 1 -- 172.21.15.59:0/3781132315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a6809e410 msgr2=0x7f8a681a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.693+0000 7f8a6dfd7700 1 --2- 172.21.15.59:0/3781132315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a6809e410 0x7f8a681a8ff0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000efc0 tx=0x7f8a6000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.693+0000 7f8a6dfd7700 1 -- 172.21.15.59:0/3781132315 shutdown_connections 2023-09-30T22:33:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.693+0000 7f8a6dfd7700 1 --2- 172.21.15.59:0/3781132315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a6809e410 0x7f8a681a8ff0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.693+0000 7f8a6dfd7700 1 --2- 172.21.15.59:0/3781132315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a6809d6f0 0x7f8a681a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.693+0000 7f8a6dfd7700 1 --2- 172.21.15.59:0/3781132315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a6809e000 0x7f8a681a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.693+0000 7f8a6dfd7700 1 -- 172.21.15.59:0/3781132315 >> 172.21.15.59:0/3781132315 conn(0x7f8a68066f50 msgr2=0x7f8a68072140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.693+0000 7f8a6dfd7700 1 -- 172.21.15.59:0/3781132315 shutdown_connections 2023-09-30T22:33:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:17.693+0000 7f8a6dfd7700 1 -- 172.21.15.59:0/3781132315 wait complete. 2023-09-30T22:33:17.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:18.673 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:18.674 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:18.676 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:18.708 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.826+0000 7f2991c7f700 1 Processor -- start 2023-09-30T22:33:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.826+0000 7f2991c7f700 1 -- start start 2023-09-30T22:33:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.826+0000 7fce90bcc700 1 Processor -- start 2023-09-30T22:33:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.826+0000 7fce90bcc700 1 -- start start 2023-09-30T22:33:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7f2991c7f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f298c09f410 0x7f298c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7f2991c7f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f298c136fe0 0x7f298c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7f2991c7f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298c070940 con 0x7f298c09e930 2023-09-30T22:33:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7f2991c7f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298c06fd60 con 0x7f298c09f410 2023-09-30T22:33:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7f2991c7f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c06fa80 con 0x7f298c136fe0 2023-09-30T22:33:18.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7fce90bcc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce8c09eca0 0x7fce8c13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7fce90bcc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8c06f050 0x7fce8c13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7fce90bcc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8c070ee0 con 0x7fce8c06e570 2023-09-30T22:33:18.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7fce90bcc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8c071980 con 0x7fce8c09eca0 2023-09-30T22:33:18.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7fce90bcc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c071480 con 0x7fce8c06f050 2023-09-30T22:33:18.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7f298b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f298c09e930 0x7f298c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34324/0 (socket says 172.21.15.59:34324) 2023-09-30T22:33:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7f298b7fe700 1 -- 172.21.15.59:0/738539009 learned_addr learned my addr 172.21.15.59:0/738539009 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7f298bfff700 1 --2- 172.21.15.59:0/738539009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f298c136fe0 0x7f298c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7fce8ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8c06f050 0x7fce8c13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7fce8ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8c06f050 0x7fce8c13f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51062/0 (socket says 172.21.15.59:51062) 2023-09-30T22:33:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7fce8ad9d700 1 -- 172.21.15.59:0/1716680197 learned_addr learned my addr 172.21.15.59:0/1716680197 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7fce89d9b700 1 --2- 172.21.15.59:0/1716680197 >> v2:172.21.15.59:3300/0 conn(0x7fce8c09eca0 0x7fce8c13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.827+0000 7f298affd700 1 --2- 172.21.15.59:0/738539009 >> v2:172.21.15.59:3300/0 conn(0x7f298c09f410 0x7f298c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7f298bfff700 1 -- 172.21.15.59:0/738539009 >> v2:172.21.15.59:3300/0 conn(0x7f298c09f410 msgr2=0x7f298c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7f298bfff700 1 --2- 172.21.15.59:0/738539009 >> v2:172.21.15.59:3300/0 conn(0x7f298c09f410 0x7f298c136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7f298bfff700 1 -- 172.21.15.59:0/738539009 >> v1:172.21.15.59:6789/0 conn(0x7f298c09e930 legacy=0x7f298c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7f298bfff700 1 -- 172.21.15.59:0/738539009 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c09fb60 con 0x7f298c136fe0 2023-09-30T22:33:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7fce89d9b700 1 -- 172.21.15.59:0/1716680197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8c06f050 msgr2=0x7fce8c13f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7fce89d9b700 1 --2- 172.21.15.59:0/1716680197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8c06f050 0x7fce8c13f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7fce89d9b700 1 -- 172.21.15.59:0/1716680197 >> v1:172.21.15.59:6789/0 conn(0x7fce8c06e570 legacy=0x7fce8c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:18.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7fce89d9b700 1 -- 172.21.15.59:0/1716680197 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c071b90 con 0x7fce8c09eca0 2023-09-30T22:33:18.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7fce8ad9d700 1 --2- 172.21.15.59:0/1716680197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8c06f050 0x7fce8c13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:18.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7f298bfff700 1 --2- 172.21.15.59:0/738539009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f298c136fe0 0x7f298c1393c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2984009d90 tx=0x7f298400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78a4fceccd202781 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:18.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7fce89d9b700 1 --2- 172.21.15.59:0/1716680197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c09eca0 0x7fce8c13cea0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fce80009840 tx=0x7fce80009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e136aeb215c418 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:18.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7f298a7fc700 1 -- 172.21.15.59:0/738539009 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298400e070 con 0x7f298c136fe0 2023-09-30T22:33:18.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7fce8959a700 1 -- 172.21.15.59:0/1716680197 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80011830 con 0x7fce8c09eca0 2023-09-30T22:33:18.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7f298a7fc700 1 -- 172.21.15.59:0/738539009 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298400bbd0 con 0x7f298c136fe0 2023-09-30T22:33:18.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7f298a7fc700 1 -- 172.21.15.59:0/738539009 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984012430 con 0x7f298c136fe0 2023-09-30T22:33:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7fce8959a700 1 -- 172.21.15.59:0/1716680197 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce80011990 con 0x7fce8c09eca0 2023-09-30T22:33:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.828+0000 7fce8959a700 1 -- 172.21.15.59:0/1716680197 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80011d20 con 0x7fce8c09eca0 2023-09-30T22:33:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7fce90bcc700 1 -- 172.21.15.59:0/1716680197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c09eca0 msgr2=0x7fce8c13cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7fce90bcc700 1 --2- 172.21.15.59:0/1716680197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c09eca0 0x7fce8c13cea0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fce80009840 tx=0x7fce80009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7fce90bcc700 1 -- 172.21.15.59:0/1716680197 shutdown_connections 2023-09-30T22:33:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7fce90bcc700 1 --2- 172.21.15.59:0/1716680197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8c06f050 0x7fce8c13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7fce90bcc700 1 --2- 172.21.15.59:0/1716680197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c09eca0 0x7fce8c13cea0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7fce90bcc700 1 -- 172.21.15.59:0/1716680197 >> 172.21.15.59:0/1716680197 conn(0x7fce8c0a2aa0 msgr2=0x7fce8c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7f2991c7f700 1 -- 172.21.15.59:0/738539009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f298c136fe0 msgr2=0x7f298c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7f2991c7f700 1 --2- 172.21.15.59:0/738539009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f298c136fe0 0x7f298c1393c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2984009d90 tx=0x7f298400b330 comp rx=0 tx=0).stop 2023-09-30T22:33:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7fce90bcc700 1 -- 172.21.15.59:0/1716680197 shutdown_connections 2023-09-30T22:33:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7fce90bcc700 1 -- 172.21.15.59:0/1716680197 wait complete. 2023-09-30T22:33:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7f2991c7f700 1 -- 172.21.15.59:0/738539009 shutdown_connections 2023-09-30T22:33:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7f2991c7f700 1 --2- 172.21.15.59:0/738539009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f298c136fe0 0x7f298c1393c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7f2991c7f700 1 --2- 172.21.15.59:0/738539009 >> v2:172.21.15.59:3300/0 conn(0x7f298c09f410 0x7f298c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7f2991c7f700 1 -- 172.21.15.59:0/738539009 >> 172.21.15.59:0/738539009 conn(0x7f298c0a4210 msgr2=0x7f298c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7f2991c7f700 1 -- 172.21.15.59:0/738539009 shutdown_connections 2023-09-30T22:33:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.829+0000 7f2991c7f700 1 -- 172.21.15.59:0/738539009 wait complete. 2023-09-30T22:33:18.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.830+0000 7f2991c7f700 1 Processor -- start 2023-09-30T22:33:18.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.830+0000 7fce90bcc700 1 Processor -- start 2023-09-30T22:33:18.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7fce90bcc700 1 -- start start 2023-09-30T22:33:18.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7f2991c7f700 1 -- start start 2023-09-30T22:33:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7fce90bcc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce8c06e570 0x7fce8c1232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7fce90bcc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8c06f050 0x7fce8c123820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7fce90bcc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c123d60 0x7fce8c1cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7fce90bcc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c126ba0 con 0x7fce8c123d60 2023-09-30T22:33:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7fce90bcc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c0706a0 con 0x7fce8c06f050 2023-09-30T22:33:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7fce90bcc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c126d80 con 0x7fce8c06e570 2023-09-30T22:33:18.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7f2991c7f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f298c09e930 0x7f298c11c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7fce8ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c123d60 0x7fce8c1cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7fce8ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c123d60 0x7fce8c1cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48964/0 (socket says 172.21.15.59:48964) 2023-09-30T22:33:18.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7fce8ad9d700 1 -- 172.21.15.59:0/1678352115 learned_addr learned my addr 172.21.15.59:0/1678352115 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:18.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7f2991c7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f298c09f410 0x7f298c11caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7f2991c7f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f298c136fe0 0x7f298c11cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7f2991c7f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0a2f40 con 0x7f298c09e930 2023-09-30T22:33:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7f2991c7f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c120190 con 0x7f298c136fe0 2023-09-30T22:33:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7f2991c7f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f298c11f830 con 0x7f298c09f410 2023-09-30T22:33:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7f298affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f298c09f410 0x7f298c11caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7f298affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f298c09f410 0x7f298c11caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51594/0 (socket says 172.21.15.59:51594) 2023-09-30T22:33:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7f298affd700 1 -- 172.21.15.59:0/725494928 learned_addr learned my addr 172.21.15.59:0/725494928 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.831+0000 7f298bfff700 1 --2- 172.21.15.59:0/725494928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f298c136fe0 0x7f298c11cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.832+0000 7fce89d9b700 1 --2- 172.21.15.59:0/1678352115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8c06f050 0x7fce8c123820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.832+0000 7f298affd700 1 -- 172.21.15.59:0/725494928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f298c136fe0 msgr2=0x7f298c11cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:18.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.832+0000 7f298affd700 1 --2- 172.21.15.59:0/725494928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f298c136fe0 0x7f298c11cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.832+0000 7f298affd700 1 -- 172.21.15.59:0/725494928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f298c09e930 msgr2=0x7f298c11c560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:33:18.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.832+0000 7f298affd700 1 --2- 172.21.15.59:0/725494928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f298c09e930 0x7f298c11c560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.832+0000 7f298affd700 1 -- 172.21.15.59:0/725494928 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2984009a70 con 0x7f298c09f410 2023-09-30T22:33:18.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.832+0000 7fce8ad9d700 1 -- 172.21.15.59:0/1678352115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce8c06e570 msgr2=0x7fce8c1232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:18.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.832+0000 7fce8ad9d700 1 --2- 172.21.15.59:0/1678352115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce8c06e570 0x7fce8c1232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.832+0000 7fce8ad9d700 1 -- 172.21.15.59:0/1678352115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8c06f050 msgr2=0x7fce8c123820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:18.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.832+0000 7fce8ad9d700 1 --2- 172.21.15.59:0/1678352115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8c06f050 0x7fce8c123820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.832+0000 7fce8ad9d700 1 -- 172.21.15.59:0/1678352115 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce84009b30 con 0x7fce8c123d60 2023-09-30T22:33:18.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.832+0000 7fce8ad9d700 1 --2- 172.21.15.59:0/1678352115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c123d60 0x7fce8c1cca40 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fce84009f10 tx=0x7fce8400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:18.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.832+0000 7f298affd700 1 --2- 172.21.15.59:0/725494928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f298c09f410 0x7f298c11caa0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f298000e840 tx=0x7f298000eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:18.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.832+0000 7fce7affd700 1 -- 172.21.15.59:0/1678352115 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84018070 con 0x7fce8c123d60 2023-09-30T22:33:18.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.833+0000 7fce7affd700 1 -- 172.21.15.59:0/1678352115 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8400f040 con 0x7fce8c123d60 2023-09-30T22:33:18.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.833+0000 7fce90bcc700 1 -- 172.21.15.59:0/1678352115 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce800094a0 con 0x7fce8c123d60 2023-09-30T22:33:18.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.833+0000 7f2973fff700 1 -- 172.21.15.59:0/725494928 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2980013610 con 0x7f298c09f410 2023-09-30T22:33:18.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.833+0000 7f2973fff700 1 -- 172.21.15.59:0/725494928 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2980013770 con 0x7f298c09f410 2023-09-30T22:33:18.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.833+0000 7f2973fff700 1 -- 172.21.15.59:0/725494928 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2980013b00 con 0x7f298c09f410 2023-09-30T22:33:18.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.833+0000 7fce90bcc700 1 -- 172.21.15.59:0/1678352115 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8c09a4b0 con 0x7fce8c123d60 2023-09-30T22:33:18.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.833+0000 7f2991c7f700 1 -- 172.21.15.59:0/725494928 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c11fae0 con 0x7f298c09f410 2023-09-30T22:33:18.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.833+0000 7f2991c7f700 1 -- 172.21.15.59:0/725494928 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c11e920 con 0x7f298c09f410 2023-09-30T22:33:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.834+0000 7fce7affd700 1 -- 172.21.15.59:0/1678352115 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84003c40 con 0x7fce8c123d60 2023-09-30T22:33:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.834+0000 7fce7affd700 1 -- 172.21.15.59:0/1678352115 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce8400c9f0 con 0x7fce8c123d60 2023-09-30T22:33:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.834+0000 7f2991c7f700 1 -- 172.21.15.59:0/725494928 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298c074ea0 con 0x7f298c09f410 2023-09-30T22:33:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.834+0000 7fce7affd700 1 -- 172.21.15.59:0/1678352115 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fce8403f960 con 0x7fce8c123d60 2023-09-30T22:33:18.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.835+0000 7fce90bcc700 1 -- 172.21.15.59:0/1678352115 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8c074ea0 con 0x7fce8c123d60 2023-09-30T22:33:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.835+0000 7f2973fff700 1 -- 172.21.15.59:0/725494928 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2980013c60 con 0x7f298c09f410 2023-09-30T22:33:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.835+0000 7f8cc434a700 1 Processor -- start 2023-09-30T22:33:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.835+0000 7f8cc434a700 1 -- start start 2023-09-30T22:33:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.835+0000 7f2973fff700 1 -- 172.21.15.59:0/725494928 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f298003f490 con 0x7f298c09f410 2023-09-30T22:33:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.836+0000 7f8cc434a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc1338c0 0x7f8cbc133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.836+0000 7f8cc434a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8cbc1341d0 0x7f8cbc09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.836+0000 7f8cc434a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cbc06f720 con 0x7f8cbc09e390 2023-09-30T22:33:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.836+0000 7f8cc434a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cbc070c80 con 0x7f8cbc1341d0 2023-09-30T22:33:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.836+0000 7f8cc434a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc06fce0 con 0x7f8cbc1338c0 2023-09-30T22:33:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.837+0000 7f8cc18e5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8cbc1341d0 0x7f8cbc09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.837+0000 7f8cc18e5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8cbc1341d0 0x7f8cbc09de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48966/0 (socket says 172.21.15.59:48966) 2023-09-30T22:33:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.837+0000 7f8cc18e5700 1 -- 172.21.15.59:0/950215459 learned_addr learned my addr 172.21.15.59:0/950215459 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.837+0000 7f8cc18e5700 1 -- 172.21.15.59:0/950215459 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc1338c0 msgr2=0x7f8cbc133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.837+0000 7f8cc18e5700 1 --2- 172.21.15.59:0/950215459 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc1338c0 0x7f8cbc133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.837+0000 7f8cc18e5700 1 -- 172.21.15.59:0/950215459 >> v1:172.21.15.59:6789/0 conn(0x7f8cbc09e390 legacy=0x7f8cbc13a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.837+0000 7f8cc18e5700 1 -- 172.21.15.59:0/950215459 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc1336a0 con 0x7f8cbc1341d0 2023-09-30T22:33:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.837+0000 7f8cc18e5700 1 --2- 172.21.15.59:0/950215459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc1341d0 0x7f8cbc09de50 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0098f0 tx=0x7f8cac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd81e545bfe2ee68 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.840+0000 7f8cc10e4700 1 -- 172.21.15.59:0/950215459 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac004230 con 0x7f8cbc1341d0 2023-09-30T22:33:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.841+0000 7f8cc10e4700 1 -- 172.21.15.59:0/950215459 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac004390 con 0x7f8cbc1341d0 2023-09-30T22:33:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.841+0000 7f8cc10e4700 1 -- 172.21.15.59:0/950215459 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac0036a0 con 0x7f8cbc1341d0 2023-09-30T22:33:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.841+0000 7f2973fff700 1 -- 172.21.15.59:0/725494928 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2980012370 con 0x7f298c09f410 2023-09-30T22:33:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.841+0000 7fce7affd700 1 -- 172.21.15.59:0/1678352115 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce8401c370 con 0x7fce8c123d60 2023-09-30T22:33:18.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.841+0000 7f8cc434a700 1 -- 172.21.15.59:0/950215459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc1341d0 msgr2=0x7f8cbc09de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:18.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.841+0000 7f8cc434a700 1 --2- 172.21.15.59:0/950215459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc1341d0 0x7f8cbc09de50 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0098f0 tx=0x7f8cac009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:18.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.842+0000 7f8cc434a700 1 -- 172.21.15.59:0/950215459 shutdown_connections 2023-09-30T22:33:18.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.842+0000 7f8cc434a700 1 --2- 172.21.15.59:0/950215459 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc1338c0 0x7f8cbc133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.842+0000 7f8cc434a700 1 --2- 172.21.15.59:0/950215459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc1341d0 0x7f8cbc09de50 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.842+0000 7f8cc434a700 1 -- 172.21.15.59:0/950215459 >> 172.21.15.59:0/950215459 conn(0x7f8cbc0a2aa0 msgr2=0x7f8cbc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.845+0000 7f8cc434a700 1 -- 172.21.15.59:0/950215459 shutdown_connections 2023-09-30T22:33:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.845+0000 7f8cc434a700 1 -- 172.21.15.59:0/950215459 wait complete. 2023-09-30T22:33:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.846+0000 7f8cc434a700 1 Processor -- start 2023-09-30T22:33:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.846+0000 7f8cc434a700 1 -- start start 2023-09-30T22:33:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.846+0000 7f8cc434a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc09e390 0x7f8cbc11e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.846+0000 7f8cc434a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cbc1338c0 0x7f8cbc11ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.846+0000 7f8cc434a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc1341d0 0x7f8cbc11f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.846+0000 7f8cc434a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc121f50 con 0x7f8cbc09e390 2023-09-30T22:33:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.846+0000 7f8cc434a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc120e20 con 0x7f8cbc1338c0 2023-09-30T22:33:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.846+0000 7f8cc434a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc130e50 con 0x7f8cbc1341d0 2023-09-30T22:33:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.847+0000 7f8cc18e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cbc1338c0 0x7f8cbc11ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.847+0000 7f8cc18e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cbc1338c0 0x7f8cbc11ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51090/0 (socket says 172.21.15.59:51090) 2023-09-30T22:33:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.847+0000 7f8cc18e5700 1 -- 172.21.15.59:0/3312884715 learned_addr learned my addr 172.21.15.59:0/3312884715 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.847+0000 7f8cc20e6700 1 --2- 172.21.15.59:0/3312884715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc09e390 0x7f8cbc11e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.847+0000 7f8cc18e5700 1 -- 172.21.15.59:0/3312884715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc1341d0 msgr2=0x7f8cbc11f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.847+0000 7f8cc18e5700 1 --2- 172.21.15.59:0/3312884715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc1341d0 0x7f8cbc11f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.847+0000 7f8cc18e5700 1 -- 172.21.15.59:0/3312884715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc09e390 msgr2=0x7f8cbc11e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.847+0000 7f8cc18e5700 1 --2- 172.21.15.59:0/3312884715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc09e390 0x7f8cbc11e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.847+0000 7f8cc18e5700 1 -- 172.21.15.59:0/3312884715 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac009550 con 0x7f8cbc1338c0 2023-09-30T22:33:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.847+0000 7f8cc20e6700 1 --2- 172.21.15.59:0/3312884715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc09e390 0x7f8cbc11e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.847+0000 7f8cc18e5700 1 --2- 172.21.15.59:0/3312884715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cbc1338c0 0x7f8cbc11ef10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc06f8b0 tx=0x7f8cac004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.847+0000 7f8cb2ffd700 1 -- 172.21.15.59:0/3312884715 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac003e30 con 0x7f8cbc1338c0 2023-09-30T22:33:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.848+0000 7f8cb2ffd700 1 -- 172.21.15.59:0/3312884715 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac01f070 con 0x7f8cbc1338c0 2023-09-30T22:33:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.848+0000 7f8cc434a700 1 -- 172.21.15.59:0/3312884715 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cbc06f960 con 0x7f8cbc1338c0 2023-09-30T22:33:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.848+0000 7f8cb2ffd700 1 -- 172.21.15.59:0/3312884715 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac00b8a0 con 0x7f8cbc1338c0 2023-09-30T22:33:18.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.848+0000 7f8cc434a700 1 -- 172.21.15.59:0/3312884715 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cbc122c80 con 0x7f8cbc1338c0 2023-09-30T22:33:18.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.849+0000 7f8cc434a700 1 -- 172.21.15.59:0/3312884715 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cbc074ea0 con 0x7f8cbc1338c0 2023-09-30T22:33:18.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.850+0000 7f8cb2ffd700 1 -- 172.21.15.59:0/3312884715 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8cac021030 con 0x7f8cbc1338c0 2023-09-30T22:33:18.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.850+0000 7f8cb2ffd700 1 -- 172.21.15.59:0/3312884715 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8cac0413b0 con 0x7f8cbc1338c0 2023-09-30T22:33:18.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.859+0000 7f8cb2ffd700 1 -- 172.21.15.59:0/3312884715 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8cac019e20 con 0x7f8cbc1338c0 2023-09-30T22:33:18.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.869+0000 7f19a788e700 1 Processor -- start 2023-09-30T22:33:18.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.870+0000 7f19a788e700 1 -- start start 2023-09-30T22:33:18.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.870+0000 7f19a788e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009d6f0 0x7f19a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.870+0000 7f19a788e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19a009e000 0x7f19a0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.870+0000 7f19a788e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009e410 0x7f19a0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.870+0000 7f19a788e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a009f520 con 0x7f19a009e000 2023-09-30T22:33:18.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.870+0000 7f19a788e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a009f130 con 0x7f19a009e410 2023-09-30T22:33:18.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.870+0000 7f19a788e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19a009e930 con 0x7f19a009d6f0 2023-09-30T22:33:18.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.870+0000 7f19a5e2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009e410 0x7f19a0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.870+0000 7f19a5e2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009e410 0x7f19a0130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51100/0 (socket says 172.21.15.59:51100) 2023-09-30T22:33:18.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.870+0000 7f19a562a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009d6f0 0x7f19a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.870+0000 7f19a5e2b700 1 -- 172.21.15.59:0/3546308489 learned_addr learned my addr 172.21.15.59:0/3546308489 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:18.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.871+0000 7f19a4e29700 1 --2- 172.21.15.59:0/3546308489 >> v2:172.21.15.59:3300/0 conn(0x7f19a009e000 0x7f19a0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.871+0000 7f19a5e2b700 1 -- 172.21.15.59:0/3546308489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009d6f0 msgr2=0x7f19a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:18.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.871+0000 7f19a5e2b700 1 --2- 172.21.15.59:0/3546308489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009d6f0 0x7f19a009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.871+0000 7f19a5e2b700 1 -- 172.21.15.59:0/3546308489 >> v2:172.21.15.59:3300/0 conn(0x7f19a009e000 msgr2=0x7f19a0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:18.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.871+0000 7f19a5e2b700 1 --2- 172.21.15.59:0/3546308489 >> v2:172.21.15.59:3300/0 conn(0x7f19a009e000 0x7f19a0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.871+0000 7f19a5e2b700 1 -- 172.21.15.59:0/3546308489 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a009b2d0 con 0x7f19a009e410 2023-09-30T22:33:18.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.871+0000 7f19a4e29700 1 --2- 172.21.15.59:0/3546308489 >> v2:172.21.15.59:3300/0 conn(0x7f19a009e000 0x7f19a0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:18.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.871+0000 7f19a5e2b700 1 --2- 172.21.15.59:0/3546308489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009e410 0x7f19a0130ba0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1998009e50 tx=0x7f199800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd82a622e2cb62d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:18.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.871+0000 7f1997fff700 1 -- 172.21.15.59:0/3546308489 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199800bb10 con 0x7f19a009e410 2023-09-30T22:33:18.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.871+0000 7f1997fff700 1 -- 172.21.15.59:0/3546308489 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199800bc70 con 0x7f19a009e410 2023-09-30T22:33:18.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.871+0000 7f1997fff700 1 -- 172.21.15.59:0/3546308489 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998011460 con 0x7f19a009e410 2023-09-30T22:33:18.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.872+0000 7f19a788e700 1 -- 172.21.15.59:0/3546308489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009e410 msgr2=0x7f19a0130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:18.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.872+0000 7f19a788e700 1 --2- 172.21.15.59:0/3546308489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009e410 0x7f19a0130ba0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1998009e50 tx=0x7f199800b330 comp rx=0 tx=0).stop 2023-09-30T22:33:18.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.872+0000 7f19a788e700 1 -- 172.21.15.59:0/3546308489 shutdown_connections 2023-09-30T22:33:18.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.872+0000 7f19a788e700 1 --2- 172.21.15.59:0/3546308489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009e410 0x7f19a0130ba0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.872+0000 7f19a788e700 1 --2- 172.21.15.59:0/3546308489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009d6f0 0x7f19a009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.872+0000 7f19a788e700 1 --2- 172.21.15.59:0/3546308489 >> v2:172.21.15.59:3300/0 conn(0x7f19a009e000 0x7f19a0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.872+0000 7f19a788e700 1 -- 172.21.15.59:0/3546308489 >> 172.21.15.59:0/3546308489 conn(0x7f19a0066f50 msgr2=0x7f19a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:18.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.872+0000 7f19a788e700 1 -- 172.21.15.59:0/3546308489 shutdown_connections 2023-09-30T22:33:18.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.872+0000 7f19a788e700 1 -- 172.21.15.59:0/3546308489 wait complete. 2023-09-30T22:33:18.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.873+0000 7f19a788e700 1 Processor -- start 2023-09-30T22:33:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.873+0000 7f19a788e700 1 -- start start 2023-09-30T22:33:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.874+0000 7f19a788e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009d6f0 0x7f19a0122420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.874+0000 7f19a788e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009e000 0x7f19a0122960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.874+0000 7f19a788e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009e410 0x7f19a0122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.874+0000 7f19a788e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a0124030 con 0x7f19a009d6f0 2023-09-30T22:33:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.874+0000 7f19a788e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a0124650 con 0x7f19a009e410 2023-09-30T22:33:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.874+0000 7f19a788e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19a009c770 con 0x7f19a009e000 2023-09-30T22:33:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.874+0000 7f19a5e2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009e410 0x7f19a0122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.874+0000 7f19a5e2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009e410 0x7f19a0122ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51104/0 (socket says 172.21.15.59:51104) 2023-09-30T22:33:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.874+0000 7f19a5e2b700 1 -- 172.21.15.59:0/2506135931 learned_addr learned my addr 172.21.15.59:0/2506135931 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.874+0000 7f19a4e29700 1 --2- 172.21.15.59:0/2506135931 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009e000 0x7f19a0122960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.875+0000 7f19a562a700 1 --2- 172.21.15.59:0/2506135931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009d6f0 0x7f19a0122420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.875+0000 7f19a5e2b700 1 -- 172.21.15.59:0/2506135931 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009e000 msgr2=0x7f19a0122960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.875+0000 7f19a5e2b700 1 --2- 172.21.15.59:0/2506135931 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009e000 0x7f19a0122960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.875+0000 7f19a5e2b700 1 -- 172.21.15.59:0/2506135931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009d6f0 msgr2=0x7f19a0122420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.875+0000 7f19a5e2b700 1 --2- 172.21.15.59:0/2506135931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009d6f0 0x7f19a0122420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.875+0000 7f19a5e2b700 1 -- 172.21.15.59:0/2506135931 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1998009b30 con 0x7f19a009e410 2023-09-30T22:33:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.875+0000 7f19a4e29700 1 --2- 172.21.15.59:0/2506135931 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009e000 0x7f19a0122960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.875+0000 7f19a562a700 1 --2- 172.21.15.59:0/2506135931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009d6f0 0x7f19a0122420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.875+0000 7f19a5e2b700 1 --2- 172.21.15.59:0/2506135931 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009e410 0x7f19a0122ea0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1998004270 tx=0x7f1998004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.875+0000 7f1995ffb700 1 -- 172.21.15.59:0/2506135931 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19980092e0 con 0x7f19a009e410 2023-09-30T22:33:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.875+0000 7f1995ffb700 1 -- 172.21.15.59:0/2506135931 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19980047c0 con 0x7f19a009e410 2023-09-30T22:33:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.875+0000 7f1995ffb700 1 -- 172.21.15.59:0/2506135931 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19980116a0 con 0x7f19a009e410 2023-09-30T22:33:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.875+0000 7f19a788e700 1 -- 172.21.15.59:0/2506135931 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a0123880 con 0x7f19a009e410 2023-09-30T22:33:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.875+0000 7f19a788e700 1 -- 172.21.15.59:0/2506135931 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a0125c60 con 0x7f19a009e410 2023-09-30T22:33:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.876+0000 7f19a788e700 1 -- 172.21.15.59:0/2506135931 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a0124880 con 0x7f19a009e410 2023-09-30T22:33:18.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.877+0000 7f1995ffb700 1 -- 172.21.15.59:0/2506135931 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1998011800 con 0x7f19a009e410 2023-09-30T22:33:18.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.877+0000 7f1995ffb700 1 -- 172.21.15.59:0/2506135931 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f19980414c0 con 0x7f19a009e410 2023-09-30T22:33:18.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:18.886+0000 7f1995ffb700 1 -- 172.21.15.59:0/2506135931 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1998011ab0 con 0x7f19a009e410 2023-09-30T22:33:19.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.049+0000 7fce90bcc700 1 -- 172.21.15.59:0/1678352115 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fce8c1255f0 con 0x7fce8c123d60 2023-09-30T22:33:19.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.050+0000 7fce7affd700 1 -- 172.21.15.59:0/1678352115 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce840045d0 con 0x7fce8c123d60 2023-09-30T22:33:19.050 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.052+0000 7fce90bcc700 1 -- 172.21.15.59:0/1678352115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c123d60 msgr2=0x7fce8c1cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.052+0000 7fce90bcc700 1 --2- 172.21.15.59:0/1678352115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c123d60 0x7fce8c1cca40 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fce84009f10 tx=0x7fce8400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:33:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.052+0000 7fce90bcc700 1 -- 172.21.15.59:0/1678352115 shutdown_connections 2023-09-30T22:33:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.052+0000 7fce90bcc700 1 --2- 172.21.15.59:0/1678352115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce8c06e570 0x7fce8c1232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.052+0000 7fce90bcc700 1 --2- 172.21.15.59:0/1678352115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c123d60 0x7fce8c1cca40 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.052+0000 7fce90bcc700 1 --2- 172.21.15.59:0/1678352115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8c06f050 0x7fce8c123820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.052+0000 7fce90bcc700 1 -- 172.21.15.59:0/1678352115 >> 172.21.15.59:0/1678352115 conn(0x7fce8c0a2aa0 msgr2=0x7fce8c09d880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.053+0000 7fce90bcc700 1 -- 172.21.15.59:0/1678352115 shutdown_connections 2023-09-30T22:33:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.053+0000 7fce90bcc700 1 -- 172.21.15.59:0/1678352115 wait complete. 2023-09-30T22:33:19.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.058+0000 7f2991c7f700 1 -- 172.21.15.59:0/725494928 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f298c071ce0 con 0x7f298c09f410 2023-09-30T22:33:19.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.059+0000 7f2973fff700 1 -- 172.21.15.59:0/725494928 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2980021070 con 0x7f298c09f410 2023-09-30T22:33:19.059 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:19.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.061+0000 7f2991c7f700 1 -- 172.21.15.59:0/725494928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f298c09f410 msgr2=0x7f298c11caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:19.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.061+0000 7f2991c7f700 1 --2- 172.21.15.59:0/725494928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f298c09f410 0x7f298c11caa0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f298000e840 tx=0x7f298000eb50 comp rx=0 tx=0).stop 2023-09-30T22:33:19.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.061+0000 7f2991c7f700 1 -- 172.21.15.59:0/725494928 shutdown_connections 2023-09-30T22:33:19.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.061+0000 7f2991c7f700 1 --2- 172.21.15.59:0/725494928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f298c136fe0 0x7f298c11cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:19.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.061+0000 7f2991c7f700 1 --2- 172.21.15.59:0/725494928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f298c09e930 0x7f298c11c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:19.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.061+0000 7f2991c7f700 1 --2- 172.21.15.59:0/725494928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f298c09f410 0x7f298c11caa0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:19.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.061+0000 7f2991c7f700 1 -- 172.21.15.59:0/725494928 >> 172.21.15.59:0/725494928 conn(0x7f298c0a4210 msgr2=0x7f298c134a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:19.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.062+0000 7f2991c7f700 1 -- 172.21.15.59:0/725494928 shutdown_connections 2023-09-30T22:33:19.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.062+0000 7f2991c7f700 1 -- 172.21.15.59:0/725494928 wait complete. 2023-09-30T22:33:19.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:19.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.081+0000 7f8cc434a700 1 -- 172.21.15.59:0/3312884715 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8cbc074ea0 con 0x7f8cbc1338c0 2023-09-30T22:33:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.082+0000 7f8cb2ffd700 1 -- 172.21.15.59:0/3312884715 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8cac0193c0 con 0x7f8cbc1338c0 2023-09-30T22:33:19.082 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.084+0000 7f8cc434a700 1 -- 172.21.15.59:0/3312884715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cbc1338c0 msgr2=0x7f8cbc11ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.084+0000 7f8cc434a700 1 --2- 172.21.15.59:0/3312884715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cbc1338c0 0x7f8cbc11ef10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc06f8b0 tx=0x7f8cac004750 comp rx=0 tx=0).stop 2023-09-30T22:33:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.084+0000 7f8cc434a700 1 -- 172.21.15.59:0/3312884715 shutdown_connections 2023-09-30T22:33:19.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.084+0000 7f8cc434a700 1 --2- 172.21.15.59:0/3312884715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc1341d0 0x7f8cbc11f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:19.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.084+0000 7f8cc434a700 1 --2- 172.21.15.59:0/3312884715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc09e390 0x7f8cbc11e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:19.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.084+0000 7f8cc434a700 1 --2- 172.21.15.59:0/3312884715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cbc1338c0 0x7f8cbc11ef10 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:19.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.084+0000 7f8cc434a700 1 -- 172.21.15.59:0/3312884715 >> 172.21.15.59:0/3312884715 conn(0x7f8cbc0a2aa0 msgr2=0x7f8cbc1306c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:19.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.084+0000 7f8cc434a700 1 -- 172.21.15.59:0/3312884715 shutdown_connections 2023-09-30T22:33:19.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.084+0000 7f8cc434a700 1 -- 172.21.15.59:0/3312884715 wait complete. 2023-09-30T22:33:19.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.093+0000 7f19a788e700 1 -- 172.21.15.59:0/2506135931 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f19a0074ea0 con 0x7f19a009e410 2023-09-30T22:33:19.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.093+0000 7f1995ffb700 1 -- 172.21.15.59:0/2506135931 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1998029020 con 0x7f19a009e410 2023-09-30T22:33:19.093 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:19.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.096+0000 7f19a788e700 1 -- 172.21.15.59:0/2506135931 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009e410 msgr2=0x7f19a0122ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:19.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.096+0000 7f19a788e700 1 --2- 172.21.15.59:0/2506135931 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009e410 0x7f19a0122ea0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1998004270 tx=0x7f1998004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:19.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.096+0000 7f19a788e700 1 -- 172.21.15.59:0/2506135931 shutdown_connections 2023-09-30T22:33:19.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.096+0000 7f19a788e700 1 --2- 172.21.15.59:0/2506135931 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009e410 0x7f19a0122ea0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:19.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.096+0000 7f19a788e700 1 --2- 172.21.15.59:0/2506135931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009d6f0 0x7f19a0122420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:19.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.096+0000 7f19a788e700 1 --2- 172.21.15.59:0/2506135931 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009e000 0x7f19a0122960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:19.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.096+0000 7f19a788e700 1 -- 172.21.15.59:0/2506135931 >> 172.21.15.59:0/2506135931 conn(0x7f19a0066f50 msgr2=0x7f19a006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:19.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.096+0000 7f19a788e700 1 -- 172.21.15.59:0/2506135931 shutdown_connections 2023-09-30T22:33:19.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:19.096+0000 7f19a788e700 1 -- 172.21.15.59:0/2506135931 wait complete. 2023-09-30T22:33:19.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:19.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:20.074 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:20.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:20.100 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:20.110 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:20.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.226+0000 7fb58f489700 1 Processor -- start 2023-09-30T22:33:20.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.227+0000 7fb58f489700 1 -- start start 2023-09-30T22:33:20.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.227+0000 7fb58f489700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb58806a770 0x7fb58809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.227+0000 7fb58f489700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb58809dc30 0x7fb58809e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.227+0000 7fb58f489700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58809a810 con 0x7fb58813c1e0 2023-09-30T22:33:20.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.227+0000 7fb58f489700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58806ab40 con 0x7fb58809dc30 2023-09-30T22:33:20.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.227+0000 7fb58f489700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb58809ebc0 con 0x7fb58806a770 2023-09-30T22:33:20.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.227+0000 7fb58d225700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb58806a770 0x7fb58809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.227+0000 7fb58d225700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb58806a770 0x7fb58809d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51642/0 (socket says 172.21.15.59:51642) 2023-09-30T22:33:20.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.227+0000 7fb58d225700 1 -- 172.21.15.59:0/1182687708 learned_addr learned my addr 172.21.15.59:0/1182687708 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:20.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.227+0000 7fb58ca24700 1 --2- 172.21.15.59:0/1182687708 >> v2:172.21.15.59:3300/0 conn(0x7fb58809dc30 0x7fb58809e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.228+0000 7fb58ca24700 1 -- 172.21.15.59:0/1182687708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb58806a770 msgr2=0x7fb58809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:20.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.228+0000 7fb58ca24700 1 --2- 172.21.15.59:0/1182687708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb58806a770 0x7fb58809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.228+0000 7fb58ca24700 1 -- 172.21.15.59:0/1182687708 >> v1:172.21.15.59:6789/0 conn(0x7fb58813c1e0 legacy=0x7fb58813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.228+0000 7fb58ca24700 1 -- 172.21.15.59:0/1182687708 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58809e920 con 0x7fb58809dc30 2023-09-30T22:33:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.228+0000 7fb58d225700 1 --2- 172.21.15.59:0/1182687708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb58806a770 0x7fb58809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.228+0000 7fb58ca24700 1 --2- 172.21.15.59:0/1182687708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58809dc30 0x7fb58809e080 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb578009870 tx=0x7fb578009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0a40938605f7c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.228+0000 7fb57ffff700 1 -- 172.21.15.59:0/1182687708 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578011830 con 0x7fb58809dc30 2023-09-30T22:33:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.228+0000 7fb57ffff700 1 -- 172.21.15.59:0/1182687708 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb578011990 con 0x7fb58809dc30 2023-09-30T22:33:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.228+0000 7fb57ffff700 1 -- 172.21.15.59:0/1182687708 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578011d20 con 0x7fb58809dc30 2023-09-30T22:33:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.229+0000 7fb58f489700 1 -- 172.21.15.59:0/1182687708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58809dc30 msgr2=0x7fb58809e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.229+0000 7fb58f489700 1 --2- 172.21.15.59:0/1182687708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58809dc30 0x7fb58809e080 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb578009870 tx=0x7fb578009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.229+0000 7fb58f489700 1 -- 172.21.15.59:0/1182687708 shutdown_connections 2023-09-30T22:33:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.229+0000 7fb58f489700 1 --2- 172.21.15.59:0/1182687708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb58806a770 0x7fb58809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.229+0000 7fb58f489700 1 --2- 172.21.15.59:0/1182687708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58809dc30 0x7fb58809e080 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.229+0000 7fb58f489700 1 -- 172.21.15.59:0/1182687708 >> 172.21.15.59:0/1182687708 conn(0x7fb588066f50 msgr2=0x7fb58809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:20.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.229+0000 7fb58f489700 1 -- 172.21.15.59:0/1182687708 shutdown_connections 2023-09-30T22:33:20.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.229+0000 7fb58f489700 1 -- 172.21.15.59:0/1182687708 wait complete. 2023-09-30T22:33:20.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.230+0000 7fb58f489700 1 Processor -- start 2023-09-30T22:33:20.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.230+0000 7fb58f489700 1 -- start start 2023-09-30T22:33:20.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.231+0000 7f000ebb8700 1 Processor -- start 2023-09-30T22:33:20.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.231+0000 7f000ebb8700 1 -- start start 2023-09-30T22:33:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.231+0000 7fb58f489700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58806a770 0x7fb58813e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.231+0000 7fb58f489700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb58809dc30 0x7fb58813a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.231+0000 7fb58f489700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb58813c1e0 0x7fb58813aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.231+0000 7fb58f489700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb588140090 con 0x7fb58806a770 2023-09-30T22:33:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.231+0000 7fb58f489700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58811de60 con 0x7fb58813c1e0 2023-09-30T22:33:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.231+0000 7fb58f489700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb58813eef0 con 0x7fb58809dc30 2023-09-30T22:33:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.231+0000 7fb58d225700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58806a770 0x7fb58813e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.231+0000 7fb58d225700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58806a770 0x7fb58813e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49030/0 (socket says 172.21.15.59:49030) 2023-09-30T22:33:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.231+0000 7fb58d225700 1 -- 172.21.15.59:0/3684838945 learned_addr learned my addr 172.21.15.59:0/3684838945 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.231+0000 7fb58ca24700 1 --2- 172.21.15.59:0/3684838945 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb58809dc30 0x7fb58813a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.231+0000 7f000ebb8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f000809d630 0x7f00080a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.231+0000 7f000ebb8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0008138d80 0x7f000813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7f000ebb8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00080a2a70 con 0x7f00080a0a30 2023-09-30T22:33:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7f000ebb8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00080a01d0 con 0x7f000809d630 2023-09-30T22:33:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7f000ebb8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000809e2b0 con 0x7f0008138d80 2023-09-30T22:33:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7f000c954700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f00080a0a30 0x7f00080a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34350/0 (socket says 172.21.15.59:34350) 2023-09-30T22:33:20.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7f000c954700 1 -- 172.21.15.59:0/1436807534 learned_addr learned my addr 172.21.15.59:0/1436807534 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:20.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7f0007fff700 1 --2- 172.21.15.59:0/1436807534 >> v2:172.21.15.59:3300/0 conn(0x7f000809d630 0x7f00080a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7fb58da26700 1 --2- 172.21.15.59:0/3684838945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb58813c1e0 0x7fb58813aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7fb58d225700 1 -- 172.21.15.59:0/3684838945 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb58809dc30 msgr2=0x7fb58813a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7fb58d225700 1 --2- 172.21.15.59:0/3684838945 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb58809dc30 0x7fb58813a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7fb58d225700 1 -- 172.21.15.59:0/3684838945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb58813c1e0 msgr2=0x7fb58813aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7fb58d225700 1 --2- 172.21.15.59:0/3684838945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb58813c1e0 0x7fb58813aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7fb58d225700 1 -- 172.21.15.59:0/3684838945 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb584009550 con 0x7fb58806a770 2023-09-30T22:33:20.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7fb58da26700 1 --2- 172.21.15.59:0/3684838945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb58813c1e0 0x7fb58813aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:20.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7f000d155700 1 --2- 172.21.15.59:0/1436807534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0008138d80 0x7f000813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7f00077fe700 1 -- 172.21.15.59:0/1436807534 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562808225 0 0) 0x7f00080a2a70 con 0x7f00080a0a30 2023-09-30T22:33:20.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7f00077fe700 1 -- 172.21.15.59:0/1436807534 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff80035b0 con 0x7f00080a0a30 2023-09-30T22:33:20.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7f0007fff700 1 -- 172.21.15.59:0/1436807534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0008138d80 msgr2=0x7f000813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:20.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7f0007fff700 1 --2- 172.21.15.59:0/1436807534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0008138d80 0x7f000813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7f0007fff700 1 -- 172.21.15.59:0/1436807534 >> v1:172.21.15.59:6789/0 conn(0x7f00080a0a30 legacy=0x7f00080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.232+0000 7f0007fff700 1 -- 172.21.15.59:0/1436807534 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000809dc50 con 0x7f000809d630 2023-09-30T22:33:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.233+0000 7f0007fff700 1 --2- 172.21.15.59:0/1436807534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000809d630 0x7f00080a1510 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7efff4009840 tx=0x7efff4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7851a80294042c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.233+0000 7fb58d225700 1 --2- 172.21.15.59:0/3684838945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58806a770 0x7fb58813e2f0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fb58400ec10 tx=0x7fb58400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.233+0000 7f00077fe700 1 -- 172.21.15.59:0/1436807534 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4011830 con 0x7f000809d630 2023-09-30T22:33:20.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.233+0000 7f00077fe700 1 -- 172.21.15.59:0/1436807534 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff4011990 con 0x7f000809d630 2023-09-30T22:33:20.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.233+0000 7f00077fe700 1 -- 172.21.15.59:0/1436807534 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4011d00 con 0x7f000809d630 2023-09-30T22:33:20.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.233+0000 7fb57dffb700 1 -- 172.21.15.59:0/3684838945 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58400c850 con 0x7fb58806a770 2023-09-30T22:33:20.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.233+0000 7fb57dffb700 1 -- 172.21.15.59:0/3684838945 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58400c9b0 con 0x7fb58806a770 2023-09-30T22:33:20.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.233+0000 7fb57dffb700 1 -- 172.21.15.59:0/3684838945 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58400cd20 con 0x7fb58806a770 2023-09-30T22:33:20.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.233+0000 7fb58f489700 1 -- 172.21.15.59:0/3684838945 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5780094a0 con 0x7fb58806a770 2023-09-30T22:33:20.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.233+0000 7fb58f489700 1 -- 172.21.15.59:0/3684838945 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58811e7f0 con 0x7fb58806a770 2023-09-30T22:33:20.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.234+0000 7f000ebb8700 1 -- 172.21.15.59:0/1436807534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000809d630 msgr2=0x7f00080a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.234+0000 7f000ebb8700 1 --2- 172.21.15.59:0/1436807534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000809d630 0x7f00080a1510 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7efff4009840 tx=0x7efff4009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:20.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.234+0000 7f000ebb8700 1 -- 172.21.15.59:0/1436807534 shutdown_connections 2023-09-30T22:33:20.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.234+0000 7f000ebb8700 1 --2- 172.21.15.59:0/1436807534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0008138d80 0x7f000813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.234+0000 7f000ebb8700 1 --2- 172.21.15.59:0/1436807534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000809d630 0x7f00080a1510 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.234+0000 7f000ebb8700 1 -- 172.21.15.59:0/1436807534 >> 172.21.15.59:0/1436807534 conn(0x7f00080a3050 msgr2=0x7f00080a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.234+0000 7f000ebb8700 1 -- 172.21.15.59:0/1436807534 shutdown_connections 2023-09-30T22:33:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.234+0000 7f000ebb8700 1 -- 172.21.15.59:0/1436807534 wait complete. 2023-09-30T22:33:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.234+0000 7fb57dffb700 1 -- 172.21.15.59:0/3684838945 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb584013470 con 0x7fb58806a770 2023-09-30T22:33:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.234+0000 7fb58f489700 1 -- 172.21.15.59:0/3684838945 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58809c800 con 0x7fb58806a770 2023-09-30T22:33:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.235+0000 7fb57dffb700 1 -- 172.21.15.59:0/3684838945 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb58403f8a0 con 0x7fb58806a770 2023-09-30T22:33:20.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.235+0000 7f000ebb8700 1 Processor -- start 2023-09-30T22:33:20.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.235+0000 7f000ebb8700 1 -- start start 2023-09-30T22:33:20.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.236+0000 7f000ebb8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f000809d630 0x7f0008120690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.236+0000 7f000ebb8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00080a0a30 0x7f0008120bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.236+0000 7f000ebb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0008138d80 0x7f0008121110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.236+0000 7f000ebb8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0008123140 con 0x7f00080a0a30 2023-09-30T22:33:20.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.236+0000 7f000ebb8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00080a4970 con 0x7f000809d630 2023-09-30T22:33:20.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.236+0000 7f000ebb8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00080a0410 con 0x7f0008138d80 2023-09-30T22:33:20.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.236+0000 7f000d155700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0008138d80 0x7f0008121110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.236+0000 7f000d155700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0008138d80 0x7f0008121110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51656/0 (socket says 172.21.15.59:51656) 2023-09-30T22:33:20.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.236+0000 7f000d155700 1 -- 172.21.15.59:0/796896627 learned_addr learned my addr 172.21.15.59:0/796896627 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:20.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.236+0000 7f0007fff700 1 --2- 172.21.15.59:0/796896627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00080a0a30 0x7f0008120bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.237+0000 7f0007fff700 1 -- 172.21.15.59:0/796896627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0008138d80 msgr2=0x7f0008121110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.237+0000 7f0007fff700 1 --2- 172.21.15.59:0/796896627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0008138d80 0x7f0008121110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.237+0000 7f0007fff700 1 -- 172.21.15.59:0/796896627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f000809d630 msgr2=0x7f0008120690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.237+0000 7f0007fff700 1 --2- 172.21.15.59:0/796896627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f000809d630 0x7f0008120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.237+0000 7f0007fff700 1 -- 172.21.15.59:0/796896627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff40094a0 con 0x7f00080a0a30 2023-09-30T22:33:20.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.237+0000 7f000d155700 1 --2- 172.21.15.59:0/796896627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0008138d80 0x7f0008121110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:20.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.237+0000 7f0007fff700 1 --2- 172.21.15.59:0/796896627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00080a0a30 0x7f0008120bd0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7efff4016000 tx=0x7efff4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:20.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.240+0000 7f00057fa700 1 -- 172.21.15.59:0/796896627 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff40043c0 con 0x7f00080a0a30 2023-09-30T22:33:20.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.240+0000 7f00057fa700 1 -- 172.21.15.59:0/796896627 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff401f070 con 0x7f00080a0a30 2023-09-30T22:33:20.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.240+0000 7f00057fa700 1 -- 172.21.15.59:0/796896627 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff40036a0 con 0x7f00080a0a30 2023-09-30T22:33:20.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.240+0000 7fb57dffb700 1 -- 172.21.15.59:0/3684838945 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb584013720 con 0x7fb58806a770 2023-09-30T22:33:20.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.241+0000 7f000ebb8700 1 -- 172.21.15.59:0/796896627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0008123560 con 0x7f00080a0a30 2023-09-30T22:33:20.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.241+0000 7f000ebb8700 1 -- 172.21.15.59:0/796896627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0008124940 con 0x7f00080a0a30 2023-09-30T22:33:20.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.242+0000 7f000ebb8700 1 -- 172.21.15.59:0/796896627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000809fbc0 con 0x7f00080a0a30 2023-09-30T22:33:20.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.242+0000 7f00057fa700 1 -- 172.21.15.59:0/796896627 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efff4021030 con 0x7f00080a0a30 2023-09-30T22:33:20.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.242+0000 7f00057fa700 1 -- 172.21.15.59:0/796896627 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efff40408f0 con 0x7f00080a0a30 2023-09-30T22:33:20.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.247+0000 7f00057fa700 1 -- 172.21.15.59:0/796896627 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efff40239c0 con 0x7f00080a0a30 2023-09-30T22:33:20.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.270+0000 7fe449ddc700 1 Processor -- start 2023-09-30T22:33:20.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.270+0000 7fe449ddc700 1 -- start start 2023-09-30T22:33:20.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.271+0000 7fe449ddc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe44409de00 0x7fe44409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.271+0000 7fe449ddc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe44413d1f0 0x7fe44413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.271+0000 7fe449ddc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44409a810 con 0x7fe44406a770 2023-09-30T22:33:20.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.271+0000 7fe449ddc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44406ab40 con 0x7fe44413d1f0 2023-09-30T22:33:20.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.271+0000 7fe449ddc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44409ebc0 con 0x7fe44409de00 2023-09-30T22:33:20.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.271+0000 7fce79078700 1 Processor -- start 2023-09-30T22:33:20.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.271+0000 7fe443fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe44413d1f0 0x7fe44413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.271+0000 7fe443fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe44413d1f0 0x7fe44413f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49044/0 (socket says 172.21.15.59:49044) 2023-09-30T22:33:20.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.271+0000 7fe4437fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe44406a770 0x7fe44409d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34354/0 (socket says 172.21.15.59:34354) 2023-09-30T22:33:20.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.271+0000 7fe443fff700 1 -- 172.21.15.59:0/1864374399 learned_addr learned my addr 172.21.15.59:0/1864374399 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:20.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.271+0000 7fe442ffd700 1 --2- 172.21.15.59:0/1864374399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe44409de00 0x7fe44409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 -- 172.21.15.59:0/1864374399 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136449852 0 0) 0x7fe44409a810 con 0x7fe44406a770 2023-09-30T22:33:20.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 -- 172.21.15.59:0/1864374399 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe42c0035b0 con 0x7fe44406a770 2023-09-30T22:33:20.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 -- 172.21.15.59:0/1864374399 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 975611934 0 0) 0x7fe42c0035b0 con 0x7fe44406a770 2023-09-30T22:33:20.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 -- 172.21.15.59:0/1864374399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe44409de00 msgr2=0x7fe44409e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:20.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.271+0000 7fce79078700 1 -- start start 2023-09-30T22:33:20.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fce79078700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce7409d6f0 0x7fce7409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fce79078700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce7409e000 0x7fce74130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fce79078700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7409f130 con 0x7fce7409e410 2023-09-30T22:33:20.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fce79078700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7409f520 con 0x7fce7409d6f0 2023-09-30T22:33:20.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fce79078700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce7409e930 con 0x7fce7409e000 2023-09-30T22:33:20.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 --2- 172.21.15.59:0/1864374399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe44409de00 0x7fe44409e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 -- 172.21.15.59:0/1864374399 >> v2:172.21.15.59:3300/0 conn(0x7fe44413d1f0 msgr2=0x7fe44413f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 --2- 172.21.15.59:0/1864374399 >> v2:172.21.15.59:3300/0 conn(0x7fe44413d1f0 0x7fe44413f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 -- 172.21.15.59:0/1864374399 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44409e920 con 0x7fe44406a770 2023-09-30T22:33:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 -- 172.21.15.59:0/1864374399 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1997034051 0 0) 0x7fe434001670 con 0x7fe44406a770 2023-09-30T22:33:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 -- 172.21.15.59:0/1864374399 >> v1:172.21.15.59:6789/0 conn(0x7fe44406a770 legacy=0x7fe44409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fce72d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce7409d6f0 0x7fce7409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fce72d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce7409d6f0 0x7fce7409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49048/0 (socket says 172.21.15.59:49048) 2023-09-30T22:33:20.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fce72d9d700 1 -- 172.21.15.59:0/2456434440 learned_addr learned my addr 172.21.15.59:0/2456434440 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:20.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 --2- 172.21.15.59:0/1864374399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42c003a00 0x7fe42c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 --2- 172.21.15.59:0/1864374399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe42c0043e0 0x7fe42c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 --2- 172.21.15.59:0/1864374399 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42c004fd0 0x7fe42c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 -- 172.21.15.59:0/1864374399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44406ab40 con 0x7fe42c0043e0 2023-09-30T22:33:20.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 -- 172.21.15.59:0/1864374399 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44409ebc0 con 0x7fe42c003a00 2023-09-30T22:33:20.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4427fc700 1 -- 172.21.15.59:0/1864374399 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c00bf80 con 0x7fe42c004fd0 2023-09-30T22:33:20.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fce72d9d700 1 -- 172.21.15.59:0/2456434440 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce7409e000 msgr2=0x7fce74130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:20.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fce72d9d700 1 --2- 172.21.15.59:0/2456434440 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce7409e000 0x7fce74130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fce72d9d700 1 -- 172.21.15.59:0/2456434440 >> v1:172.21.15.59:6789/0 conn(0x7fce7409e410 legacy=0x7fce74130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:20.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe4437fe700 1 --2- 172.21.15.59:0/1864374399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42c003a00 0x7fe42c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.272+0000 7fe443fff700 1 --2- 172.21.15.59:0/1864374399 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42c004fd0 0x7fe42c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.273+0000 7fe4437fe700 1 -- 172.21.15.59:0/1864374399 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42c004fd0 msgr2=0x7fe42c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:20.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.273+0000 7fe4437fe700 1 --2- 172.21.15.59:0/1864374399 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42c004fd0 0x7fe42c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.273+0000 7fe4437fe700 1 -- 172.21.15.59:0/1864374399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe42c0043e0 msgr2=0x7fe42c0048b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:33:20.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.273+0000 7fe4437fe700 1 --2- 172.21.15.59:0/1864374399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe42c0043e0 0x7fe42c0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.273+0000 7fe4437fe700 1 -- 172.21.15.59:0/1864374399 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0035b0 con 0x7fe42c003a00 2023-09-30T22:33:20.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.273+0000 7fce72d9d700 1 -- 172.21.15.59:0/2456434440 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7409b2d0 con 0x7fce7409d6f0 2023-09-30T22:33:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.273+0000 7fe4437fe700 1 --2- 172.21.15.59:0/1864374399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42c003a00 0x7fe42c003e10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe43400c110 tx=0x7fe42c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3c55fd4b71b1c49 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.273+0000 7fce72d9d700 1 --2- 172.21.15.59:0/2456434440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce7409d6f0 0x7fce7409dac0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fce6400bb90 tx=0x7fce6400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126739402422a107 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.273+0000 7fe4427fc700 1 -- 172.21.15.59:0/1864374399 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43400cc10 con 0x7fe42c003a00 2023-09-30T22:33:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.273+0000 7fe4427fc700 1 -- 172.21.15.59:0/1864374399 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43400cd70 con 0x7fe42c003a00 2023-09-30T22:33:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.273+0000 7fe4427fc700 1 -- 172.21.15.59:0/1864374399 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe434005ae0 con 0x7fe42c003a00 2023-09-30T22:33:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.274+0000 7fe449ddc700 1 -- 172.21.15.59:0/1864374399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42c003a00 msgr2=0x7fe42c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.274+0000 7fe449ddc700 1 --2- 172.21.15.59:0/1864374399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42c003a00 0x7fe42c003e10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe43400c110 tx=0x7fe42c005880 comp rx=0 tx=0).stop 2023-09-30T22:33:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.274+0000 7fe443fff700 1 -- 172.21.15.59:0/1864374399 reap_dead start 2023-09-30T22:33:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.274+0000 7fce71d9b700 1 -- 172.21.15.59:0/2456434440 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6400dd50 con 0x7fce7409d6f0 2023-09-30T22:33:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.274+0000 7fce71d9b700 1 -- 172.21.15.59:0/2456434440 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce64010470 con 0x7fce7409d6f0 2023-09-30T22:33:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.274+0000 7fe449ddc700 1 -- 172.21.15.59:0/1864374399 shutdown_connections 2023-09-30T22:33:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.274+0000 7fe449ddc700 1 -- 172.21.15.59:0/1864374399 >> 172.21.15.59:0/1864374399 conn(0x7fe444066f50 msgr2=0x7fe44409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.274+0000 7fce71d9b700 1 -- 172.21.15.59:0/2456434440 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640107e0 con 0x7fce7409d6f0 2023-09-30T22:33:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.275+0000 7fce79078700 1 -- 172.21.15.59:0/2456434440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce7409d6f0 msgr2=0x7fce7409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.275+0000 7fce79078700 1 --2- 172.21.15.59:0/2456434440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce7409d6f0 0x7fce7409dac0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fce6400bb90 tx=0x7fce6400bea0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.275+0000 7fce79078700 1 -- 172.21.15.59:0/2456434440 shutdown_connections 2023-09-30T22:33:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.275+0000 7fce79078700 1 --2- 172.21.15.59:0/2456434440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce7409d6f0 0x7fce7409dac0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.275+0000 7fce79078700 1 --2- 172.21.15.59:0/2456434440 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce7409e000 0x7fce74130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.275+0000 7fce79078700 1 -- 172.21.15.59:0/2456434440 >> 172.21.15.59:0/2456434440 conn(0x7fce74066f50 msgr2=0x7fce7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.275+0000 7fce79078700 1 -- 172.21.15.59:0/2456434440 shutdown_connections 2023-09-30T22:33:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.275+0000 7fce79078700 1 -- 172.21.15.59:0/2456434440 wait complete. 2023-09-30T22:33:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.276+0000 7fce79078700 1 Processor -- start 2023-09-30T22:33:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.276+0000 7fce79078700 1 -- start start 2023-09-30T22:33:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.277+0000 7fce79078700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce7409d6f0 0x7fce741278d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.277+0000 7fce79078700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce7409e000 0x7fce74127e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.277+0000 7fce79078700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce7409e410 0x7fce74128350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.277+0000 7fce79078700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7412bd60 con 0x7fce7409e000 2023-09-30T22:33:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.277+0000 7fce79078700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7412b3a0 con 0x7fce7409e410 2023-09-30T22:33:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.277+0000 7fce79078700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce7412ae90 con 0x7fce7409d6f0 2023-09-30T22:33:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.277+0000 7fce7259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce7409e000 0x7fce74127e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.277+0000 7fce7259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce7409e000 0x7fce74127e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49078/0 (socket says 172.21.15.59:49078) 2023-09-30T22:33:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.277+0000 7fce7259c700 1 -- 172.21.15.59:0/3923928349 learned_addr learned my addr 172.21.15.59:0/3923928349 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.277+0000 7fce7359e700 1 --2- 172.21.15.59:0/3923928349 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce7409e410 0x7fce74128350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.277+0000 7fce72d9d700 1 --2- 172.21.15.59:0/3923928349 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce7409d6f0 0x7fce741278d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.278+0000 7fe449ddc700 1 -- 172.21.15.59:0/1864374399 shutdown_connections 2023-09-30T22:33:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.278+0000 7fce72d9d700 1 -- 172.21.15.59:0/3923928349 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce7409e410 msgr2=0x7fce74128350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.278+0000 7fce72d9d700 1 --2- 172.21.15.59:0/3923928349 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce7409e410 0x7fce74128350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.278+0000 7fce72d9d700 1 -- 172.21.15.59:0/3923928349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce7409e000 msgr2=0x7fce74127e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.278+0000 7fce72d9d700 1 --2- 172.21.15.59:0/3923928349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce7409e000 0x7fce74127e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.278+0000 7fce72d9d700 1 -- 172.21.15.59:0/3923928349 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6400b7f0 con 0x7fce7409d6f0 2023-09-30T22:33:20.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.278+0000 7fe449ddc700 1 -- 172.21.15.59:0/1864374399 wait complete. 2023-09-30T22:33:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.278+0000 7fce72d9d700 1 --2- 172.21.15.59:0/3923928349 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce7409d6f0 0x7fce741278d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fce740a3e80 tx=0x7fce64004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.278+0000 7fce6b7fe700 1 -- 172.21.15.59:0/3923928349 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64003b70 con 0x7fce7409d6f0 2023-09-30T22:33:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.278+0000 7fce6b7fe700 1 -- 172.21.15.59:0/3923928349 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce64003cf0 con 0x7fce7409d6f0 2023-09-30T22:33:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.278+0000 7fce79078700 1 -- 172.21.15.59:0/3923928349 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7409c700 con 0x7fce7409d6f0 2023-09-30T22:33:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.278+0000 7fce6b7fe700 1 -- 172.21.15.59:0/3923928349 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64010820 con 0x7fce7409d6f0 2023-09-30T22:33:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.278+0000 7fce79078700 1 -- 172.21.15.59:0/3923928349 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce74129490 con 0x7fce7409d6f0 2023-09-30T22:33:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.279+0000 7fe449ddc700 1 Processor -- start 2023-09-30T22:33:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.279+0000 7fce6b7fe700 1 -- 172.21.15.59:0/3923928349 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce64019400 con 0x7fce7409d6f0 2023-09-30T22:33:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.279+0000 7fe449ddc700 1 -- start start 2023-09-30T22:33:20.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.280+0000 7fce6b7fe700 1 -- 172.21.15.59:0/3923928349 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fce640414b0 con 0x7fce7409d6f0 2023-09-30T22:33:20.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.280+0000 7fe449ddc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42c003a00 0x7fe4441279e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.280+0000 7fce79078700 1 -- 172.21.15.59:0/3923928349 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce740a3540 con 0x7fce7409d6f0 2023-09-30T22:33:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.280+0000 7fe449ddc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe444127f20 0x7fe4441cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.280+0000 7fe449ddc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe444128310 0x7fe4441cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:20.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.280+0000 7fe449ddc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44412acd0 con 0x7fe444128310 2023-09-30T22:33:20.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.280+0000 7fe449ddc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe444127670 con 0x7fe444127f20 2023-09-30T22:33:20.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.280+0000 7fe449ddc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe44412a730 con 0x7fe42c003a00 2023-09-30T22:33:20.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.280+0000 7fe442ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe444127f20 0x7fe4441cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.281+0000 7fe442ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe444127f20 0x7fe4441cc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51148/0 (socket says 172.21.15.59:51148) 2023-09-30T22:33:20.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.281+0000 7fe442ffd700 1 -- 172.21.15.59:0/4064141178 learned_addr learned my addr 172.21.15.59:0/4064141178 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:20.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.281+0000 7fe443fff700 1 --2- 172.21.15.59:0/4064141178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe444128310 0x7fe4441cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.281+0000 7fe4437fe700 1 --2- 172.21.15.59:0/4064141178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42c003a00 0x7fe4441279e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:20.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.281+0000 7fe443fff700 1 -- 172.21.15.59:0/4064141178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42c003a00 msgr2=0x7fe4441279e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.281+0000 7fe443fff700 1 --2- 172.21.15.59:0/4064141178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42c003a00 0x7fe4441279e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.281+0000 7fe443fff700 1 -- 172.21.15.59:0/4064141178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe444127f20 msgr2=0x7fe4441cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.281+0000 7fe443fff700 1 --2- 172.21.15.59:0/4064141178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe444127f20 0x7fe4441cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.281+0000 7fe443fff700 1 -- 172.21.15.59:0/4064141178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe444072480 con 0x7fe444128310 2023-09-30T22:33:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.282+0000 7fe443fff700 1 --2- 172.21.15.59:0/4064141178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe444128310 0x7fe4441cca20 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fe44409eff0 tx=0x7fe43c007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.282+0000 7fe42bfff700 1 -- 172.21.15.59:0/4064141178 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c00e050 con 0x7fe444128310 2023-09-30T22:33:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.282+0000 7fe42bfff700 1 -- 172.21.15.59:0/4064141178 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c00f040 con 0x7fe444128310 2023-09-30T22:33:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.282+0000 7fe42bfff700 1 -- 172.21.15.59:0/4064141178 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c015b50 con 0x7fe444128310 2023-09-30T22:33:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.282+0000 7fe449ddc700 1 -- 172.21.15.59:0/4064141178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44409f1a0 con 0x7fe444128310 2023-09-30T22:33:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.282+0000 7fe449ddc700 1 -- 172.21.15.59:0/4064141178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44412b460 con 0x7fe444128310 2023-09-30T22:33:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.283+0000 7fe42bfff700 1 -- 172.21.15.59:0/4064141178 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe43c015cb0 con 0x7fe444128310 2023-09-30T22:33:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.283+0000 7fe449ddc700 1 -- 172.21.15.59:0/4064141178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe444074ea0 con 0x7fe444128310 2023-09-30T22:33:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.284+0000 7fe42bfff700 1 -- 172.21.15.59:0/4064141178 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe43c03fbc0 con 0x7fe444128310 2023-09-30T22:33:20.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.289+0000 7fce6b7fe700 1 -- 172.21.15.59:0/3923928349 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce64003e60 con 0x7fce7409d6f0 2023-09-30T22:33:20.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.293+0000 7fe42bfff700 1 -- 172.21.15.59:0/4064141178 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe43c026710 con 0x7fe444128310 2023-09-30T22:33:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.470+0000 7fb58f489700 1 -- 172.21.15.59:0/3684838945 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb588074ea0 con 0x7fb58806a770 2023-09-30T22:33:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.470+0000 7fb57dffb700 1 -- 172.21.15.59:0/3684838945 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb584021020 con 0x7fb58806a770 2023-09-30T22:33:20.470 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:20.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.472+0000 7f000ebb8700 1 -- 172.21.15.59:0/796896627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f00080747f0 con 0x7f00080a0a30 2023-09-30T22:33:20.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.472+0000 7fb58f489700 1 -- 172.21.15.59:0/3684838945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58806a770 msgr2=0x7fb58813e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.472+0000 7fb58f489700 1 --2- 172.21.15.59:0/3684838945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58806a770 0x7fb58813e2f0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fb58400ec10 tx=0x7fb58400ef20 comp rx=0 tx=0).stop 2023-09-30T22:33:20.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.473+0000 7fb58f489700 1 -- 172.21.15.59:0/3684838945 shutdown_connections 2023-09-30T22:33:20.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.473+0000 7fb58f489700 1 --2- 172.21.15.59:0/3684838945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb58813c1e0 0x7fb58813aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.473+0000 7fb58f489700 1 --2- 172.21.15.59:0/3684838945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58806a770 0x7fb58813e2f0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.473+0000 7fb58f489700 1 --2- 172.21.15.59:0/3684838945 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb58809dc30 0x7fb58813a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.473+0000 7fb58f489700 1 -- 172.21.15.59:0/3684838945 >> 172.21.15.59:0/3684838945 conn(0x7fb588066f50 msgr2=0x7fb588070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:20.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.473+0000 7fb58f489700 1 -- 172.21.15.59:0/3684838945 shutdown_connections 2023-09-30T22:33:20.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.473+0000 7f00057fa700 1 -- 172.21.15.59:0/796896627 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efff4015070 con 0x7f00080a0a30 2023-09-30T22:33:20.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.473+0000 7fb58f489700 1 -- 172.21.15.59:0/3684838945 wait complete. 2023-09-30T22:33:20.475 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:20.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.476+0000 7f000ebb8700 1 -- 172.21.15.59:0/796896627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00080a0a30 msgr2=0x7f0008120bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.476+0000 7f000ebb8700 1 --2- 172.21.15.59:0/796896627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00080a0a30 0x7f0008120bd0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7efff4016000 tx=0x7efff4004750 comp rx=0 tx=0).stop 2023-09-30T22:33:20.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.477+0000 7f000ebb8700 1 -- 172.21.15.59:0/796896627 shutdown_connections 2023-09-30T22:33:20.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.477+0000 7f000ebb8700 1 --2- 172.21.15.59:0/796896627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0008138d80 0x7f0008121110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.477+0000 7f000ebb8700 1 --2- 172.21.15.59:0/796896627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f000809d630 0x7f0008120690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.477+0000 7f000ebb8700 1 --2- 172.21.15.59:0/796896627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00080a0a30 0x7f0008120bd0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.477+0000 7f000ebb8700 1 -- 172.21.15.59:0/796896627 >> 172.21.15.59:0/796896627 conn(0x7f00080a3050 msgr2=0x7f000809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:20.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.477+0000 7f000ebb8700 1 -- 172.21.15.59:0/796896627 shutdown_connections 2023-09-30T22:33:20.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.477+0000 7f000ebb8700 1 -- 172.21.15.59:0/796896627 wait complete. 2023-09-30T22:33:20.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:20.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:20.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.499+0000 7fce79078700 1 -- 172.21.15.59:0/3923928349 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fce7409ef50 con 0x7fce7409d6f0 2023-09-30T22:33:20.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.499+0000 7fce6b7fe700 1 -- 172.21.15.59:0/3923928349 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce64030090 con 0x7fce7409d6f0 2023-09-30T22:33:20.499 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:20.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.501+0000 7fe449ddc700 1 -- 172.21.15.59:0/4064141178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe44412a8a0 con 0x7fe444128310 2023-09-30T22:33:20.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.502+0000 7fce79078700 1 -- 172.21.15.59:0/3923928349 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce7409d6f0 msgr2=0x7fce741278d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.502+0000 7fce79078700 1 --2- 172.21.15.59:0/3923928349 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce7409d6f0 0x7fce741278d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fce740a3e80 tx=0x7fce64004750 comp rx=0 tx=0).stop 2023-09-30T22:33:20.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.502+0000 7fce79078700 1 -- 172.21.15.59:0/3923928349 shutdown_connections 2023-09-30T22:33:20.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.502+0000 7fce79078700 1 --2- 172.21.15.59:0/3923928349 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce7409d6f0 0x7fce741278d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.502+0000 7fce79078700 1 --2- 172.21.15.59:0/3923928349 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce7409e410 0x7fce74128350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.502+0000 7fce79078700 1 --2- 172.21.15.59:0/3923928349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce7409e000 0x7fce74127e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.502+0000 7fce79078700 1 -- 172.21.15.59:0/3923928349 >> 172.21.15.59:0/3923928349 conn(0x7fce74066f50 msgr2=0x7fce740719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:20.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.502+0000 7fce79078700 1 -- 172.21.15.59:0/3923928349 shutdown_connections 2023-09-30T22:33:20.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.502+0000 7fce79078700 1 -- 172.21.15.59:0/3923928349 wait complete. 2023-09-30T22:33:20.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.502+0000 7fe42bfff700 1 -- 172.21.15.59:0/4064141178 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe43c01a070 con 0x7fe444128310 2023-09-30T22:33:20.503 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:20.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.504+0000 7fe449ddc700 1 -- 172.21.15.59:0/4064141178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe444128310 msgr2=0x7fe4441cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:20.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.504+0000 7fe449ddc700 1 --2- 172.21.15.59:0/4064141178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe444128310 0x7fe4441cca20 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fe44409eff0 tx=0x7fe43c007c90 comp rx=0 tx=0).stop 2023-09-30T22:33:20.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.504+0000 7fe449ddc700 1 -- 172.21.15.59:0/4064141178 shutdown_connections 2023-09-30T22:33:20.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.504+0000 7fe449ddc700 1 --2- 172.21.15.59:0/4064141178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42c003a00 0x7fe4441279e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.504+0000 7fe449ddc700 1 --2- 172.21.15.59:0/4064141178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe444128310 0x7fe4441cca20 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.504+0000 7fe449ddc700 1 --2- 172.21.15.59:0/4064141178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe444127f20 0x7fe4441cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:20.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.504+0000 7fe449ddc700 1 -- 172.21.15.59:0/4064141178 >> 172.21.15.59:0/4064141178 conn(0x7fe444066f50 msgr2=0x7fe44409b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:20.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.504+0000 7fe449ddc700 1 -- 172.21.15.59:0/4064141178 shutdown_connections 2023-09-30T22:33:20.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:20.505+0000 7fe449ddc700 1 -- 172.21.15.59:0/4064141178 wait complete. 2023-09-30T22:33:20.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:20.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:21.490 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:21.492 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:21.518 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:21.520 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.648+0000 7f103cac3700 1 Processor -- start 2023-09-30T22:33:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.648+0000 7f8380d2d700 1 Processor -- start 2023-09-30T22:33:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.648+0000 7f103cac3700 1 -- start start 2023-09-30T22:33:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.648+0000 7f8380d2d700 1 -- start start 2023-09-30T22:33:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.649+0000 7f103cac3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103806f5d0 0x7f103812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.649+0000 7f103cac3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1038135c20 0x7f1038138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.649+0000 7f103cac3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103806fa40 con 0x7f103812cf60 2023-09-30T22:33:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.649+0000 7f103cac3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103812cd90 con 0x7f1038135c20 2023-09-30T22:33:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.649+0000 7f103cac3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1038071780 con 0x7f103806f5d0 2023-09-30T22:33:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.649+0000 7f8380d2d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837c09d5c0 0x7f837c138d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.649+0000 7f8380d2d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837c0a14a0 0x7f837c13b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.649+0000 7f8380d2d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837c09ea10 con 0x7f837c0a09c0 2023-09-30T22:33:21.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.649+0000 7f8380d2d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c09e210 con 0x7f837c09d5c0 2023-09-30T22:33:21.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.649+0000 7f8380d2d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f837c0a26f0 con 0x7f837c0a14a0 2023-09-30T22:33:21.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.650+0000 7f1036d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1038135c20 0x7f1038138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.650+0000 7f1036d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1038135c20 0x7f1038138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49088/0 (socket says 172.21.15.59:49088) 2023-09-30T22:33:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.650+0000 7f1036d9d700 1 -- 172.21.15.59:0/937448773 learned_addr learned my addr 172.21.15.59:0/937448773 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.650+0000 7f1036d9d700 1 -- 172.21.15.59:0/937448773 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103806f5d0 msgr2=0x7f103812ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.650+0000 7f1036d9d700 1 --2- 172.21.15.59:0/937448773 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103806f5d0 0x7f103812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.650+0000 7f1036d9d700 1 -- 172.21.15.59:0/937448773 >> v1:172.21.15.59:6789/0 conn(0x7f103812cf60 legacy=0x7f103812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.650+0000 7f837a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f837c0a09c0 0x7f837c0a0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34384/0 (socket says 172.21.15.59:34384) 2023-09-30T22:33:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.650+0000 7f837a59c700 1 -- 172.21.15.59:0/610492718 learned_addr learned my addr 172.21.15.59:0/610492718 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.650+0000 7f837ad9d700 1 --2- 172.21.15.59:0/610492718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837c0a14a0 0x7f837c13b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.650+0000 7f1036d9d700 1 -- 172.21.15.59:0/937448773 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1038071a40 con 0x7f1038135c20 2023-09-30T22:33:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.650+0000 7f837ad9d700 1 -- 172.21.15.59:0/610492718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837c09d5c0 msgr2=0x7f837c138d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.650+0000 7f837ad9d700 1 --2- 172.21.15.59:0/610492718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837c09d5c0 0x7f837c138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.650+0000 7f837ad9d700 1 -- 172.21.15.59:0/610492718 >> v1:172.21.15.59:6789/0 conn(0x7f837c0a09c0 legacy=0x7f837c0a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.650+0000 7f837ad9d700 1 -- 172.21.15.59:0/610492718 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c09db70 con 0x7f837c0a14a0 2023-09-30T22:33:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.650+0000 7f1036d9d700 1 --2- 172.21.15.59:0/937448773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1038135c20 0x7f1038138000 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f103000d150 tx=0x7f103000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8ee6386120e88f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.651+0000 7f837ad9d700 1 --2- 172.21.15.59:0/610492718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837c0a14a0 0x7f837c13b2c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8374009dc0 tx=0x7f837400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93f683df6abfe06c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.651+0000 7f103559a700 1 -- 172.21.15.59:0/937448773 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030010070 con 0x7f1038135c20 2023-09-30T22:33:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.651+0000 7f103559a700 1 -- 172.21.15.59:0/937448773 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103000ddc0 con 0x7f1038135c20 2023-09-30T22:33:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.651+0000 7f103559a700 1 -- 172.21.15.59:0/937448773 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103000b310 con 0x7f1038135c20 2023-09-30T22:33:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.651+0000 7f837959a700 1 -- 172.21.15.59:0/610492718 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837400e070 con 0x7f837c0a14a0 2023-09-30T22:33:21.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.651+0000 7f837959a700 1 -- 172.21.15.59:0/610492718 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837400bbd0 con 0x7f837c0a14a0 2023-09-30T22:33:21.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.651+0000 7f837959a700 1 -- 172.21.15.59:0/610492718 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374012430 con 0x7f837c0a14a0 2023-09-30T22:33:21.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f103cac3700 1 -- 172.21.15.59:0/937448773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1038135c20 msgr2=0x7f1038138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f103cac3700 1 --2- 172.21.15.59:0/937448773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1038135c20 0x7f1038138000 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f103000d150 tx=0x7f103000d460 comp rx=0 tx=0).stop 2023-09-30T22:33:21.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f8380d2d700 1 -- 172.21.15.59:0/610492718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837c0a14a0 msgr2=0x7f837c13b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f8380d2d700 1 --2- 172.21.15.59:0/610492718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837c0a14a0 0x7f837c13b2c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8374009dc0 tx=0x7f837400b330 comp rx=0 tx=0).stop 2023-09-30T22:33:21.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f103cac3700 1 -- 172.21.15.59:0/937448773 shutdown_connections 2023-09-30T22:33:21.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f103cac3700 1 --2- 172.21.15.59:0/937448773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1038135c20 0x7f1038138000 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f8380d2d700 1 -- 172.21.15.59:0/610492718 shutdown_connections 2023-09-30T22:33:21.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f8380d2d700 1 --2- 172.21.15.59:0/610492718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837c0a14a0 0x7f837c13b2c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f103cac3700 1 --2- 172.21.15.59:0/937448773 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103806f5d0 0x7f103812ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f103cac3700 1 -- 172.21.15.59:0/937448773 >> 172.21.15.59:0/937448773 conn(0x7f10380a2aa0 msgr2=0x7f10380a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:21.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f8380d2d700 1 --2- 172.21.15.59:0/610492718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837c09d5c0 0x7f837c138d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f8380d2d700 1 -- 172.21.15.59:0/610492718 >> 172.21.15.59:0/610492718 conn(0x7f837c0a2fe0 msgr2=0x7f837c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:21.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f103cac3700 1 -- 172.21.15.59:0/937448773 shutdown_connections 2023-09-30T22:33:21.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f103cac3700 1 -- 172.21.15.59:0/937448773 wait complete. 2023-09-30T22:33:21.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f8380d2d700 1 -- 172.21.15.59:0/610492718 shutdown_connections 2023-09-30T22:33:21.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.652+0000 7f8380d2d700 1 -- 172.21.15.59:0/610492718 wait complete. 2023-09-30T22:33:21.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.653+0000 7f103cac3700 1 Processor -- start 2023-09-30T22:33:21.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.653+0000 7f103cac3700 1 -- start start 2023-09-30T22:33:21.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f8380d2d700 1 Processor -- start 2023-09-30T22:33:21.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f103cac3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103806f5d0 0x7f10381291b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f103cac3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103812cf60 0x7f10381296f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f103cac3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1038135c20 0x7f1038099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f103cac3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103809adf0 con 0x7f1038135c20 2023-09-30T22:33:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f103cac3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103809ca70 con 0x7f103806f5d0 2023-09-30T22:33:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f103cac3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f103809ec10 con 0x7f103812cf60 2023-09-30T22:33:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f1035d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103812cf60 0x7f10381296f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f1035d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103812cf60 0x7f10381296f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51720/0 (socket says 172.21.15.59:51720) 2023-09-30T22:33:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f1035d9b700 1 -- 172.21.15.59:0/3453047083 learned_addr learned my addr 172.21.15.59:0/3453047083 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f103659c700 1 --2- 172.21.15.59:0/3453047083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103806f5d0 0x7f10381291b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f1036d9d700 1 --2- 172.21.15.59:0/3453047083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1038135c20 0x7f1038099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:21.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f1035d9b700 1 -- 172.21.15.59:0/3453047083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103806f5d0 msgr2=0x7f10381291b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f1035d9b700 1 --2- 172.21.15.59:0/3453047083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103806f5d0 0x7f10381291b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f1035d9b700 1 -- 172.21.15.59:0/3453047083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1038135c20 msgr2=0x7f1038099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f1035d9b700 1 --2- 172.21.15.59:0/3453047083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1038135c20 0x7f1038099d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.654+0000 7f1035d9b700 1 -- 172.21.15.59:0/3453047083 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103000bd40 con 0x7f103812cf60 2023-09-30T22:33:21.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.655+0000 7f1036d9d700 1 --2- 172.21.15.59:0/3453047083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1038135c20 0x7f1038099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:21.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.655+0000 7f1035d9b700 1 --2- 172.21.15.59:0/3453047083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103812cf60 0x7f10381296f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f102c00b530 tx=0x7f102c00b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:21.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.655+0000 7f1026ffd700 1 -- 172.21.15.59:0/3453047083 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c011830 con 0x7f103812cf60 2023-09-30T22:33:21.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.655+0000 7f1026ffd700 1 -- 172.21.15.59:0/3453047083 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c0119b0 con 0x7f103812cf60 2023-09-30T22:33:21.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.655+0000 7f103cac3700 1 -- 172.21.15.59:0/3453047083 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103812c010 con 0x7f103812cf60 2023-09-30T22:33:21.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.655+0000 7f8380d2d700 1 -- start start 2023-09-30T22:33:21.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.655+0000 7f8380d2d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837c09d5c0 0x7f837c122680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.655+0000 7f8380d2d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f837c0a09c0 0x7f837c122bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.655+0000 7f8380d2d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837c0a14a0 0x7f837c123100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.655+0000 7f8380d2d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c125e70 con 0x7f837c0a09c0 2023-09-30T22:33:21.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.655+0000 7f8380d2d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c125150 con 0x7f837c09d5c0 2023-09-30T22:33:21.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.655+0000 7f8380d2d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f837c09c3d0 con 0x7f837c0a14a0 2023-09-30T22:33:21.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.656+0000 7f837ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837c0a14a0 0x7f837c123100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:21.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.656+0000 7f837ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837c0a14a0 0x7f837c123100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51728/0 (socket says 172.21.15.59:51728) 2023-09-30T22:33:21.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.656+0000 7f837ad9d700 1 -- 172.21.15.59:0/652055610 learned_addr learned my addr 172.21.15.59:0/652055610 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:21.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.656+0000 7f837ad9d700 1 -- 172.21.15.59:0/652055610 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837c09d5c0 msgr2=0x7f837c122680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.656+0000 7f837ad9d700 1 --2- 172.21.15.59:0/652055610 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837c09d5c0 0x7f837c122680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.656+0000 7f837ad9d700 1 -- 172.21.15.59:0/652055610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f837c0a09c0 msgr2=0x7f837c122bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.656+0000 7f837ad9d700 1 --2- 172.21.15.59:0/652055610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f837c0a09c0 0x7f837c122bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.656+0000 7f837ad9d700 1 -- 172.21.15.59:0/652055610 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8374009a70 con 0x7f837c0a14a0 2023-09-30T22:33:21.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.656+0000 7f837ad9d700 1 --2- 172.21.15.59:0/652055610 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837c0a14a0 0x7f837c123100 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8374014040 tx=0x7f8374004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:21.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.655+0000 7f103cac3700 1 -- 172.21.15.59:0/3453047083 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1038129c30 con 0x7f103812cf60 2023-09-30T22:33:21.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.655+0000 7f1026ffd700 1 -- 172.21.15.59:0/3453047083 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c011d60 con 0x7f103812cf60 2023-09-30T22:33:21.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.656+0000 7f1026ffd700 1 -- 172.21.15.59:0/3453047083 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f102c01a400 con 0x7f103812cf60 2023-09-30T22:33:21.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.656+0000 7f103cac3700 1 -- 172.21.15.59:0/3453047083 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101c0052e0 con 0x7f103812cf60 2023-09-30T22:33:21.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.657+0000 7f1026ffd700 1 -- 172.21.15.59:0/3453047083 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f102c03f720 con 0x7f103812cf60 2023-09-30T22:33:21.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.657+0000 7f836affd700 1 -- 172.21.15.59:0/652055610 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374012cc0 con 0x7f837c0a14a0 2023-09-30T22:33:21.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.657+0000 7f8380d2d700 1 -- 172.21.15.59:0/652055610 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c09cec0 con 0x7f837c0a14a0 2023-09-30T22:33:21.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.657+0000 7f8380d2d700 1 -- 172.21.15.59:0/652055610 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c126150 con 0x7f837c0a14a0 2023-09-30T22:33:21.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.657+0000 7f836affd700 1 -- 172.21.15.59:0/652055610 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8374020070 con 0x7f837c0a14a0 2023-09-30T22:33:21.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.657+0000 7f836affd700 1 -- 172.21.15.59:0/652055610 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374004260 con 0x7f837c0a14a0 2023-09-30T22:33:21.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.658+0000 7f8380d2d700 1 -- 172.21.15.59:0/652055610 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83600052e0 con 0x7f837c0a14a0 2023-09-30T22:33:21.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.666+0000 7f1026ffd700 1 -- 172.21.15.59:0/3453047083 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f102c00f8d0 con 0x7f103812cf60 2023-09-30T22:33:21.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.666+0000 7f836affd700 1 -- 172.21.15.59:0/652055610 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83740043c0 con 0x7f837c0a14a0 2023-09-30T22:33:21.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.666+0000 7f836affd700 1 -- 172.21.15.59:0/652055610 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8374022070 con 0x7f837c0a14a0 2023-09-30T22:33:21.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.674+0000 7f836affd700 1 -- 172.21.15.59:0/652055610 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8374004900 con 0x7f837c0a14a0 2023-09-30T22:33:21.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.693+0000 7f2f95a96700 1 Processor -- start 2023-09-30T22:33:21.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.694+0000 7f2f95a96700 1 -- start start 2023-09-30T22:33:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.694+0000 7f2f95a96700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f9006a770 0x7f2f9006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.694+0000 7f2f95a96700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9006b080 0x7f2f90131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.694+0000 7f2f95a96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f90131b40 0x7f2f90131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.694+0000 7f2f95a96700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9009ece0 con 0x7f2f9006a770 2023-09-30T22:33:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.694+0000 7f2f95a96700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9009e760 con 0x7f2f90131b40 2023-09-30T22:33:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.694+0000 7f2f95a96700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9009e040 con 0x7f2f9006b080 2023-09-30T22:33:21.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.694+0000 7f2f8f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f9006a770 0x7f2f9006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:21.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.694+0000 7f2f8f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f9006a770 0x7f2f9006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49114/0 (socket says 172.21.15.59:49114) 2023-09-30T22:33:21.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.694+0000 7f2f8f7fe700 1 -- 172.21.15.59:0/343362705 learned_addr learned my addr 172.21.15.59:0/343362705 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:21.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.694+0000 7f2f8effd700 1 --2- 172.21.15.59:0/343362705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9006b080 0x7f2f90131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:21.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.694+0000 7f2f8ffff700 1 --2- 172.21.15.59:0/343362705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f90131b40 0x7f2f90131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:21.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.695+0000 7f2f8f7fe700 1 -- 172.21.15.59:0/343362705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9006b080 msgr2=0x7f2f90131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:21.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.695+0000 7f2f8f7fe700 1 --2- 172.21.15.59:0/343362705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9006b080 0x7f2f90131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.695+0000 7f2f8f7fe700 1 -- 172.21.15.59:0/343362705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f90131b40 msgr2=0x7f2f90131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:21.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.695+0000 7f2f8f7fe700 1 --2- 172.21.15.59:0/343362705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f90131b40 0x7f2f90131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.695+0000 7f2f8f7fe700 1 -- 172.21.15.59:0/343362705 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9009f630 con 0x7f2f9006a770 2023-09-30T22:33:21.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.695+0000 7f2f8ffff700 1 --2- 172.21.15.59:0/343362705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f90131b40 0x7f2f90131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:21.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.695+0000 7f2f8f7fe700 1 --2- 172.21.15.59:0/343362705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9006a770 0x7f2f9006ab40 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000dd10 tx=0x7f2f80008330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad66f568cf5a6a69 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:21.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.695+0000 7f2f8e7fc700 1 -- 172.21.15.59:0/343362705 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000b070 con 0x7f2f9006a770 2023-09-30T22:33:21.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.695+0000 7f2f8e7fc700 1 -- 172.21.15.59:0/343362705 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8000de60 con 0x7f2f9006a770 2023-09-30T22:33:21.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.695+0000 7f2f8e7fc700 1 -- 172.21.15.59:0/343362705 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80008d40 con 0x7f2f9006a770 2023-09-30T22:33:21.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.696+0000 7f8c75fac700 1 Processor -- start 2023-09-30T22:33:21.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.696+0000 7f2f95a96700 1 -- 172.21.15.59:0/343362705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9006a770 msgr2=0x7f2f9006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.696+0000 7f2f95a96700 1 --2- 172.21.15.59:0/343362705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9006a770 0x7f2f9006ab40 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000dd10 tx=0x7f2f80008330 comp rx=0 tx=0).stop 2023-09-30T22:33:21.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.696+0000 7f2f95a96700 1 -- 172.21.15.59:0/343362705 shutdown_connections 2023-09-30T22:33:21.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.696+0000 7f2f95a96700 1 --2- 172.21.15.59:0/343362705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f90131b40 0x7f2f90131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.696+0000 7f2f95a96700 1 --2- 172.21.15.59:0/343362705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9006a770 0x7f2f9006ab40 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.696+0000 7f2f95a96700 1 --2- 172.21.15.59:0/343362705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9006b080 0x7f2f90131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.696+0000 7f2f95a96700 1 -- 172.21.15.59:0/343362705 >> 172.21.15.59:0/343362705 conn(0x7f2f90066f50 msgr2=0x7f2f9009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:21.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.696+0000 7f8c75fac700 1 -- start start 2023-09-30T22:33:21.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.697+0000 7f8c75fac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c7009ac90 0x7f8c7013cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.697+0000 7f8c75fac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c7013d240 0x7f8c7013f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.697+0000 7f8c75fac700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c70134980 con 0x7f8c7006c0e0 2023-09-30T22:33:21.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.697+0000 7f8c75fac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7006c4b0 con 0x7f8c7013d240 2023-09-30T22:33:21.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.697+0000 7f8c75fac700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7009b0e0 con 0x7f8c7009ac90 2023-09-30T22:33:21.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.697+0000 7f8c6ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c7013d240 0x7f8c7013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:21.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.697+0000 7f8c6ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c7013d240 0x7f8c7013f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51190/0 (socket says 172.21.15.59:51190) 2023-09-30T22:33:21.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.697+0000 7f8c6effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c7009ac90 0x7f8c7013cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:21.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.697+0000 7f8c6ffff700 1 -- 172.21.15.59:0/618919077 learned_addr learned my addr 172.21.15.59:0/618919077 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:21.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.697+0000 7f2f95a96700 1 -- 172.21.15.59:0/343362705 shutdown_connections 2023-09-30T22:33:21.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.697+0000 7f2f95a96700 1 -- 172.21.15.59:0/343362705 wait complete. 2023-09-30T22:33:21.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.697+0000 7f8c6ffff700 1 -- 172.21.15.59:0/618919077 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c7009ac90 msgr2=0x7f8c7013cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:21.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.697+0000 7f8c6ffff700 1 --2- 172.21.15.59:0/618919077 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c7009ac90 0x7f8c7013cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.697+0000 7f8c6ffff700 1 -- 172.21.15.59:0/618919077 >> v1:172.21.15.59:6789/0 conn(0x7f8c7006c0e0 legacy=0x7f8c70134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:21.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.697+0000 7f8c6ffff700 1 -- 172.21.15.59:0/618919077 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c700a0600 con 0x7f8c7013d240 2023-09-30T22:33:21.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.698+0000 7f2f95a96700 1 Processor -- start 2023-09-30T22:33:21.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.698+0000 7f8c6ffff700 1 --2- 172.21.15.59:0/618919077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c7013d240 0x7f8c7013f620 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009e80 tx=0x7f8c6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2addf699f995c0f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:21.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f8c6e7fc700 1 -- 172.21.15.59:0/618919077 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800e070 con 0x7f8c7013d240 2023-09-30T22:33:21.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f8c6e7fc700 1 -- 172.21.15.59:0/618919077 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c68003a20 con 0x7f8c7013d240 2023-09-30T22:33:21.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f8c6e7fc700 1 -- 172.21.15.59:0/618919077 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68003dd0 con 0x7f8c7013d240 2023-09-30T22:33:21.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f2f95a96700 1 -- start start 2023-09-30T22:33:21.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f2f95a96700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9006a770 0x7f2f9011e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f2f95a96700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9006b080 0x7f2f9011ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f2f95a96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f90131b40 0x7f2f9011ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f2f95a96700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90120650 con 0x7f2f9006a770 2023-09-30T22:33:21.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f2f8ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f90131b40 0x7f2f9011ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:21.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f2f95a96700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90121cd0 con 0x7f2f90131b40 2023-09-30T22:33:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f2f8f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9006a770 0x7f2f9011e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f2f8effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9006b080 0x7f2f9011ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f2f95a96700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f901201b0 con 0x7f2f9006b080 2023-09-30T22:33:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f2f8ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f90131b40 0x7f2f9011ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51192/0 (socket says 172.21.15.59:51192) 2023-09-30T22:33:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f2f8ffff700 1 -- 172.21.15.59:0/1686268427 learned_addr learned my addr 172.21.15.59:0/1686268427 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:21.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f8c75fac700 1 -- 172.21.15.59:0/618919077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c7013d240 msgr2=0x7f8c7013f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.699+0000 7f8c75fac700 1 --2- 172.21.15.59:0/618919077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c7013d240 0x7f8c7013f620 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009e80 tx=0x7f8c6800b330 comp rx=0 tx=0).stop 2023-09-30T22:33:21.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f8c75fac700 1 -- 172.21.15.59:0/618919077 shutdown_connections 2023-09-30T22:33:21.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f8c75fac700 1 --2- 172.21.15.59:0/618919077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c7013d240 0x7f8c7013f620 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f8c75fac700 1 --2- 172.21.15.59:0/618919077 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c7009ac90 0x7f8c7013cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f8c75fac700 1 -- 172.21.15.59:0/618919077 >> 172.21.15.59:0/618919077 conn(0x7f8c700a4210 msgr2=0x7f8c700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:21.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f8c75fac700 1 -- 172.21.15.59:0/618919077 shutdown_connections 2023-09-30T22:33:21.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f8c75fac700 1 -- 172.21.15.59:0/618919077 wait complete. 2023-09-30T22:33:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f2f8effd700 1 -- 172.21.15.59:0/1686268427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f90131b40 msgr2=0x7f2f9011ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f2f8effd700 1 --2- 172.21.15.59:0/1686268427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f90131b40 0x7f2f9011ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f2f8effd700 1 -- 172.21.15.59:0/1686268427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9006a770 msgr2=0x7f2f9011e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f2f8effd700 1 --2- 172.21.15.59:0/1686268427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9006a770 0x7f2f9011e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f2f8effd700 1 -- 172.21.15.59:0/1686268427 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8000d9f0 con 0x7f2f9006b080 2023-09-30T22:33:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f2f8effd700 1 --2- 172.21.15.59:0/1686268427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9006b080 0x7f2f9011ea20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400e900 tx=0x7f2f8400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f2f77fff700 1 -- 172.21.15.59:0/1686268427 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84013680 con 0x7f2f9006b080 2023-09-30T22:33:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f2f77fff700 1 -- 172.21.15.59:0/1686268427 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f840137e0 con 0x7f2f9006b080 2023-09-30T22:33:21.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f2f95a96700 1 -- 172.21.15.59:0/1686268427 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f90131400 con 0x7f2f9006b080 2023-09-30T22:33:21.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f2f77fff700 1 -- 172.21.15.59:0/1686268427 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84013b50 con 0x7f2f9006b080 2023-09-30T22:33:21.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.700+0000 7f2f95a96700 1 -- 172.21.15.59:0/1686268427 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f90120890 con 0x7f2f9006b080 2023-09-30T22:33:21.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.701+0000 7f8c75fac700 1 Processor -- start 2023-09-30T22:33:21.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.701+0000 7f2f77fff700 1 -- 172.21.15.59:0/1686268427 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f84013cb0 con 0x7f2f9006b080 2023-09-30T22:33:21.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.702+0000 7f2f95a96700 1 -- 172.21.15.59:0/1686268427 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f90074ea0 con 0x7f2f9006b080 2023-09-30T22:33:21.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.702+0000 7f2f77fff700 1 -- 172.21.15.59:0/1686268427 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2f8403f670 con 0x7f2f9006b080 2023-09-30T22:33:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.702+0000 7f8c75fac700 1 -- start start 2023-09-30T22:33:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.702+0000 7f8c75fac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c7006c0e0 0x7f8c7011a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.702+0000 7f8c75fac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c7009ac90 0x7f8c7011abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.702+0000 7f8c75fac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c7013d240 0x7f8c7011b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.702+0000 7f8c75fac700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7013f630 con 0x7f8c7013d240 2023-09-30T22:33:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.702+0000 7f8c75fac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c701343b0 con 0x7f8c7006c0e0 2023-09-30T22:33:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.702+0000 7f8c75fac700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7011e200 con 0x7f8c7009ac90 2023-09-30T22:33:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.702+0000 7f8c6f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c7006c0e0 0x7f8c7011a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.702+0000 7f8c6f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c7006c0e0 0x7f8c7011a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51198/0 (socket says 172.21.15.59:51198) 2023-09-30T22:33:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.702+0000 7f8c6f7fe700 1 -- 172.21.15.59:0/547947092 learned_addr learned my addr 172.21.15.59:0/547947092 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.703+0000 7f8c6f7fe700 1 -- 172.21.15.59:0/547947092 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c7009ac90 msgr2=0x7f8c7011abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.703+0000 7f8c6f7fe700 1 --2- 172.21.15.59:0/547947092 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c7009ac90 0x7f8c7011abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.703+0000 7f8c6f7fe700 1 -- 172.21.15.59:0/547947092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c7013d240 msgr2=0x7f8c7011b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.703+0000 7f8c6f7fe700 1 --2- 172.21.15.59:0/547947092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c7013d240 0x7f8c7011b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.703+0000 7f8c6f7fe700 1 -- 172.21.15.59:0/547947092 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c68009b30 con 0x7f8c7006c0e0 2023-09-30T22:33:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.703+0000 7f8c6f7fe700 1 --2- 172.21.15.59:0/547947092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c7006c0e0 0x7f8c7011a680 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000b4a0 tx=0x7f8c6000b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.703+0000 7f8c57fff700 1 -- 172.21.15.59:0/547947092 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60011830 con 0x7f8c7006c0e0 2023-09-30T22:33:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.703+0000 7f8c57fff700 1 -- 172.21.15.59:0/547947092 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c60011990 con 0x7f8c7006c0e0 2023-09-30T22:33:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.703+0000 7f8c57fff700 1 -- 172.21.15.59:0/547947092 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60011d40 con 0x7f8c7006c0e0 2023-09-30T22:33:21.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.703+0000 7f8c75fac700 1 -- 172.21.15.59:0/547947092 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7009e3a0 con 0x7f8c7006c0e0 2023-09-30T22:33:21.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.703+0000 7f8c75fac700 1 -- 172.21.15.59:0/547947092 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7011be50 con 0x7f8c7006c0e0 2023-09-30T22:33:21.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.704+0000 7f8c75fac700 1 -- 172.21.15.59:0/547947092 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c70074ea0 con 0x7f8c7006c0e0 2023-09-30T22:33:21.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.705+0000 7f8c57fff700 1 -- 172.21.15.59:0/547947092 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c60004020 con 0x7f8c7006c0e0 2023-09-30T22:33:21.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.705+0000 7f8c57fff700 1 -- 172.21.15.59:0/547947092 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8c6003f8f0 con 0x7f8c7006c0e0 2023-09-30T22:33:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.712+0000 7f2f77fff700 1 -- 172.21.15.59:0/1686268427 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f84017020 con 0x7f2f9006b080 2023-09-30T22:33:21.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.714+0000 7f8c57fff700 1 -- 172.21.15.59:0/547947092 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c6000f6f0 con 0x7f8c7006c0e0 2023-09-30T22:33:21.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.889+0000 7f103cac3700 1 -- 172.21.15.59:0/3453047083 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f101c005590 con 0x7f103812cf60 2023-09-30T22:33:21.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.889+0000 7f1026ffd700 1 -- 172.21.15.59:0/3453047083 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f102c015030 con 0x7f103812cf60 2023-09-30T22:33:21.889 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:21.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.891+0000 7f103cac3700 1 -- 172.21.15.59:0/3453047083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103812cf60 msgr2=0x7f10381296f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.891+0000 7f103cac3700 1 --2- 172.21.15.59:0/3453047083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103812cf60 0x7f10381296f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f102c00b530 tx=0x7f102c00b8f0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.891+0000 7f103cac3700 1 -- 172.21.15.59:0/3453047083 shutdown_connections 2023-09-30T22:33:21.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.891+0000 7f103cac3700 1 --2- 172.21.15.59:0/3453047083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1038135c20 0x7f1038099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.891+0000 7f103cac3700 1 --2- 172.21.15.59:0/3453047083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f103806f5d0 0x7f10381291b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.891+0000 7f103cac3700 1 --2- 172.21.15.59:0/3453047083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f103812cf60 0x7f10381296f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.891+0000 7f103cac3700 1 -- 172.21.15.59:0/3453047083 >> 172.21.15.59:0/3453047083 conn(0x7f10380a2aa0 msgr2=0x7f103806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:21.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.892+0000 7f103cac3700 1 -- 172.21.15.59:0/3453047083 shutdown_connections 2023-09-30T22:33:21.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.892+0000 7f103cac3700 1 -- 172.21.15.59:0/3453047083 wait complete. 2023-09-30T22:33:21.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.893+0000 7f8380d2d700 1 -- 172.21.15.59:0/652055610 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8360005860 con 0x7f837c0a14a0 2023-09-30T22:33:21.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.893+0000 7f836affd700 1 -- 172.21.15.59:0/652055610 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8374034020 con 0x7f837c0a14a0 2023-09-30T22:33:21.894 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:21.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.896+0000 7f8380d2d700 1 -- 172.21.15.59:0/652055610 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837c0a14a0 msgr2=0x7f837c123100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.896+0000 7f8380d2d700 1 --2- 172.21.15.59:0/652055610 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837c0a14a0 0x7f837c123100 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8374014040 tx=0x7f8374004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.896+0000 7f8380d2d700 1 -- 172.21.15.59:0/652055610 shutdown_connections 2023-09-30T22:33:21.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.896+0000 7f8380d2d700 1 --2- 172.21.15.59:0/652055610 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837c0a14a0 0x7f837c123100 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.896+0000 7f8380d2d700 1 --2- 172.21.15.59:0/652055610 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837c09d5c0 0x7f837c122680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.896+0000 7f8380d2d700 1 --2- 172.21.15.59:0/652055610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f837c0a09c0 0x7f837c122bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.896+0000 7f8380d2d700 1 -- 172.21.15.59:0/652055610 >> 172.21.15.59:0/652055610 conn(0x7f837c0a2fe0 msgr2=0x7f837c0a4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:21.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.896+0000 7f8380d2d700 1 -- 172.21.15.59:0/652055610 shutdown_connections 2023-09-30T22:33:21.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.896+0000 7f8380d2d700 1 -- 172.21.15.59:0/652055610 wait complete. 2023-09-30T22:33:21.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:21.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:21.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.949+0000 7f8c75fac700 1 -- 172.21.15.59:0/547947092 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8c7006b250 con 0x7f8c7006c0e0 2023-09-30T22:33:21.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.949+0000 7f2f95a96700 1 -- 172.21.15.59:0/1686268427 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2f9006c360 con 0x7f2f9006b080 2023-09-30T22:33:21.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.949+0000 7f8c57fff700 1 -- 172.21.15.59:0/547947092 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c60028090 con 0x7f8c7006c0e0 2023-09-30T22:33:21.950 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:21.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.949+0000 7f2f77fff700 1 -- 172.21.15.59:0/1686268427 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f84017020 con 0x7f2f9006b080 2023-09-30T22:33:21.951 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.952+0000 7f8c75fac700 1 -- 172.21.15.59:0/547947092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c7006c0e0 msgr2=0x7f8c7011a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.952+0000 7f8c75fac700 1 --2- 172.21.15.59:0/547947092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c7006c0e0 0x7f8c7011a680 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000b4a0 tx=0x7f8c6000b860 comp rx=0 tx=0).stop 2023-09-30T22:33:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f8c75fac700 1 -- 172.21.15.59:0/547947092 shutdown_connections 2023-09-30T22:33:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f8c75fac700 1 --2- 172.21.15.59:0/547947092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c7013d240 0x7f8c7011b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f8c75fac700 1 --2- 172.21.15.59:0/547947092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c7006c0e0 0x7f8c7011a680 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f8c75fac700 1 --2- 172.21.15.59:0/547947092 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c7009ac90 0x7f8c7011abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f8c75fac700 1 -- 172.21.15.59:0/547947092 >> 172.21.15.59:0/547947092 conn(0x7f8c700a4210 msgr2=0x7f8c700a0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:21.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f8c75fac700 1 -- 172.21.15.59:0/547947092 shutdown_connections 2023-09-30T22:33:21.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f8c75fac700 1 -- 172.21.15.59:0/547947092 wait complete. 2023-09-30T22:33:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f2f95a96700 1 -- 172.21.15.59:0/1686268427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9006b080 msgr2=0x7f2f9011ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f2f95a96700 1 --2- 172.21.15.59:0/1686268427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9006b080 0x7f2f9011ea20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400e900 tx=0x7f2f8400ec10 comp rx=0 tx=0).stop 2023-09-30T22:33:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f2f95a96700 1 -- 172.21.15.59:0/1686268427 shutdown_connections 2023-09-30T22:33:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f2f95a96700 1 --2- 172.21.15.59:0/1686268427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f90131b40 0x7f2f9011ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f2f95a96700 1 --2- 172.21.15.59:0/1686268427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9006a770 0x7f2f9011e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f2f95a96700 1 --2- 172.21.15.59:0/1686268427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9006b080 0x7f2f9011ea20 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f2f95a96700 1 -- 172.21.15.59:0/1686268427 >> 172.21.15.59:0/1686268427 conn(0x7f2f90066f50 msgr2=0x7f2f900a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f2f95a96700 1 -- 172.21.15.59:0/1686268427 shutdown_connections 2023-09-30T22:33:21.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:21.953+0000 7f2f95a96700 1 -- 172.21.15.59:0/1686268427 wait complete. 2023-09-30T22:33:21.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:21.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:22.910 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:22.913 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:22.974 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:23.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.059+0000 7f69bb648700 1 Processor -- start 2023-09-30T22:33:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.059+0000 7f12bed29700 1 Processor -- start 2023-09-30T22:33:23.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.059+0000 7f69bb648700 1 -- start start 2023-09-30T22:33:23.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.059+0000 7f12bed29700 1 -- start start 2023-09-30T22:33:23.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69bb648700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69b40a0a30 0x7f69b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69bb648700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69b40a1340 0x7f69b4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69bb648700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69b4133fa0 0x7f69b4134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69bb648700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b409edd0 con 0x7f69b4133fa0 2023-09-30T22:33:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69bb648700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b409e1f0 con 0x7f69b40a1340 2023-09-30T22:33:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f12bed29700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b812cf60 0x7f12b806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f12bed29700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f12b8066410 0x7f12b812f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f12bed29700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b812cd90 con 0x7f12b8066880 2023-09-30T22:33:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f12bed29700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b812d330 con 0x7f12b8066410 2023-09-30T22:33:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f12bed29700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12b8071780 con 0x7f12b812cf60 2023-09-30T22:33:23.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69bb648700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69b409dc50 con 0x7f69b40a0a30 2023-09-30T22:33:23.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69b9be5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69b4133fa0 0x7f69b4134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f12b7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f12b8066410 0x7f12b812f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f12b7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f12b8066410 0x7f12b812f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49162/0 (socket says 172.21.15.59:49162) 2023-09-30T22:33:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f12b7fff700 1 -- 172.21.15.59:0/401175585 learned_addr learned my addr 172.21.15.59:0/401175585 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69b9be5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69b4133fa0 0x7f69b4134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49148/0 (socket says 172.21.15.59:49148) 2023-09-30T22:33:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69b9be5700 1 -- 172.21.15.59:0/3673802590 learned_addr learned my addr 172.21.15.59:0/3673802590 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69b8be3700 1 --2- 172.21.15.59:0/3673802590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69b40a1340 0x7f69b4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f12bcac5700 1 --2- 172.21.15.59:0/401175585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b812cf60 0x7f12b806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69b93e4700 1 --2- 172.21.15.59:0/3673802590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69b40a0a30 0x7f69b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f12b7fff700 1 -- 172.21.15.59:0/401175585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b812cf60 msgr2=0x7f12b806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f12b7fff700 1 --2- 172.21.15.59:0/401175585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b812cf60 0x7f12b806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f12b7fff700 1 -- 172.21.15.59:0/401175585 >> v1:172.21.15.59:6789/0 conn(0x7f12b8066880 legacy=0x7f12b812fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f12b7fff700 1 -- 172.21.15.59:0/401175585 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b8071a40 con 0x7f12b8066410 2023-09-30T22:33:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69b9be5700 1 -- 172.21.15.59:0/3673802590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69b40a0a30 msgr2=0x7f69b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69b9be5700 1 --2- 172.21.15.59:0/3673802590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69b40a0a30 0x7f69b40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69b9be5700 1 -- 172.21.15.59:0/3673802590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69b40a1340 msgr2=0x7f69b4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69b9be5700 1 --2- 172.21.15.59:0/3673802590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69b40a1340 0x7f69b4133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.060+0000 7f69b9be5700 1 -- 172.21.15.59:0/3673802590 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b40a1fe0 con 0x7f69b4133fa0 2023-09-30T22:33:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.061+0000 7f69b9be5700 1 --2- 172.21.15.59:0/3673802590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69b4133fa0 0x7f69b4134410 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f69ac009e50 tx=0x7f69ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54a1241cec3d43a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.061+0000 7f12b7fff700 1 --2- 172.21.15.59:0/401175585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b8066410 0x7f12b812f8b0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f12a40098f0 tx=0x7f12a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88dd3b50c54faeb3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.061+0000 7f69abfff700 1 -- 172.21.15.59:0/3673802590 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac00e070 con 0x7f69b4133fa0 2023-09-30T22:33:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.061+0000 7f69abfff700 1 -- 172.21.15.59:0/3673802590 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac00b910 con 0x7f69b4133fa0 2023-09-30T22:33:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.061+0000 7f69abfff700 1 -- 172.21.15.59:0/3673802590 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac00bcc0 con 0x7f69b4133fa0 2023-09-30T22:33:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.061+0000 7f12b77fe700 1 -- 172.21.15.59:0/401175585 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a400b8a0 con 0x7f12b8066410 2023-09-30T22:33:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.061+0000 7f12b77fe700 1 -- 172.21.15.59:0/401175585 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a400ba00 con 0x7f12b8066410 2023-09-30T22:33:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.061+0000 7f12b77fe700 1 -- 172.21.15.59:0/401175585 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a400bd90 con 0x7f12b8066410 2023-09-30T22:33:23.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f69bb648700 1 -- 172.21.15.59:0/3673802590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69b4133fa0 msgr2=0x7f69b4134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f69bb648700 1 --2- 172.21.15.59:0/3673802590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69b4133fa0 0x7f69b4134410 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f69ac009e50 tx=0x7f69ac00b330 comp rx=0 tx=0).stop 2023-09-30T22:33:23.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f12bed29700 1 -- 172.21.15.59:0/401175585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b8066410 msgr2=0x7f12b812f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f12bed29700 1 --2- 172.21.15.59:0/401175585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b8066410 0x7f12b812f8b0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f12a40098f0 tx=0x7f12a4009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f69bb648700 1 -- 172.21.15.59:0/3673802590 shutdown_connections 2023-09-30T22:33:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f69bb648700 1 --2- 172.21.15.59:0/3673802590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69b4133fa0 0x7f69b4134410 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f69bb648700 1 --2- 172.21.15.59:0/3673802590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69b40a0a30 0x7f69b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f69bb648700 1 --2- 172.21.15.59:0/3673802590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69b40a1340 0x7f69b4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f69bb648700 1 -- 172.21.15.59:0/3673802590 >> 172.21.15.59:0/3673802590 conn(0x7f69b40a6550 msgr2=0x7f69b40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f12bed29700 1 -- 172.21.15.59:0/401175585 shutdown_connections 2023-09-30T22:33:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f12bed29700 1 --2- 172.21.15.59:0/401175585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b812cf60 0x7f12b806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f12bed29700 1 --2- 172.21.15.59:0/401175585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b8066410 0x7f12b812f8b0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f12bed29700 1 -- 172.21.15.59:0/401175585 >> 172.21.15.59:0/401175585 conn(0x7f12b80a2aa0 msgr2=0x7f12b80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f12bed29700 1 -- 172.21.15.59:0/401175585 shutdown_connections 2023-09-30T22:33:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f69bb648700 1 -- 172.21.15.59:0/3673802590 shutdown_connections 2023-09-30T22:33:23.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f12bed29700 1 -- 172.21.15.59:0/401175585 wait complete. 2023-09-30T22:33:23.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.062+0000 7f69bb648700 1 -- 172.21.15.59:0/3673802590 wait complete. 2023-09-30T22:33:23.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.063+0000 7f12bed29700 1 Processor -- start 2023-09-30T22:33:23.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.063+0000 7f69bb648700 1 Processor -- start 2023-09-30T22:33:23.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.063+0000 7f12bed29700 1 -- start start 2023-09-30T22:33:23.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.063+0000 7f69bb648700 1 -- start start 2023-09-30T22:33:23.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.063+0000 7f69bb648700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69b40a0a30 0x7f69b41200b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.063+0000 7f69bb648700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69b40a1340 0x7f69b41205f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.063+0000 7f69bb648700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69b4133fa0 0x7f69b4120b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.063+0000 7f69bb648700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b41238f0 con 0x7f69b4133fa0 2023-09-30T22:33:23.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.063+0000 7f69bb648700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b4123af0 con 0x7f69b40a1340 2023-09-30T22:33:23.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.063+0000 7f69bb648700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69b41229e0 con 0x7f69b40a0a30 2023-09-30T22:33:23.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.063+0000 7f69b93e4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69b40a0a30 0x7f69b41200b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.063+0000 7f69b9be5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69b4133fa0 0x7f69b4120b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.063+0000 7f12bed29700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b8066410 0x7f12b81c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12bed29700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b8066880 0x7f12b81c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12bed29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b812cf60 0x7f12b81c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12bed29700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b8129fa0 con 0x7f12b8066410 2023-09-30T22:33:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12bed29700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b812c050 con 0x7f12b812cf60 2023-09-30T22:33:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12bed29700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12b809de00 con 0x7f12b8066880 2023-09-30T22:33:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12bcac5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b8066410 0x7f12b81c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12bcac5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b8066410 0x7f12b81c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49174/0 (socket says 172.21.15.59:49174) 2023-09-30T22:33:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12bcac5700 1 -- 172.21.15.59:0/3445965476 learned_addr learned my addr 172.21.15.59:0/3445965476 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12bd2c6700 1 --2- 172.21.15.59:0/3445965476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b812cf60 0x7f12b81c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12b7fff700 1 --2- 172.21.15.59:0/3445965476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b8066880 0x7f12b81c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.063+0000 7f69b93e4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69b40a0a30 0x7f69b41200b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51806/0 (socket says 172.21.15.59:51806) 2023-09-30T22:33:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.063+0000 7f69b93e4700 1 -- 172.21.15.59:0/2452092043 learned_addr learned my addr 172.21.15.59:0/2452092043 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f69b8be3700 1 --2- 172.21.15.59:0/2452092043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69b40a1340 0x7f69b41205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f69b93e4700 1 -- 172.21.15.59:0/2452092043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69b40a1340 msgr2=0x7f69b41205f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f69b93e4700 1 --2- 172.21.15.59:0/2452092043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69b40a1340 0x7f69b41205f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f69b93e4700 1 -- 172.21.15.59:0/2452092043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69b4133fa0 msgr2=0x7f69b4120b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f69b93e4700 1 --2- 172.21.15.59:0/2452092043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69b4133fa0 0x7f69b4120b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f69b93e4700 1 -- 172.21.15.59:0/2452092043 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac009b30 con 0x7f69b40a0a30 2023-09-30T22:33:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f69b93e4700 1 --2- 172.21.15.59:0/2452092043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69b40a0a30 0x7f69b41200b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f69b000c4b0 tx=0x7f69b000c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12b7fff700 1 -- 172.21.15.59:0/3445965476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b812cf60 msgr2=0x7f12b81c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12b7fff700 1 --2- 172.21.15.59:0/3445965476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b812cf60 0x7f12b81c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12b7fff700 1 -- 172.21.15.59:0/3445965476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b8066410 msgr2=0x7f12b81c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12b7fff700 1 --2- 172.21.15.59:0/3445965476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b8066410 0x7f12b81c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12b7fff700 1 -- 172.21.15.59:0/3445965476 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a4009550 con 0x7f12b8066880 2023-09-30T22:33:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f69a9ffb700 1 -- 172.21.15.59:0/2452092043 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b0015bd0 con 0x7f69b40a0a30 2023-09-30T22:33:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f12b7fff700 1 --2- 172.21.15.59:0/3445965476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b8066880 0x7f12b81c8970 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f12a4016000 tx=0x7f12a4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.064+0000 7f69a9ffb700 1 -- 172.21.15.59:0/2452092043 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b0015d30 con 0x7f69b40a0a30 2023-09-30T22:33:23.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.065+0000 7f69bb648700 1 -- 172.21.15.59:0/2452092043 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b4121c80 con 0x7f69b40a0a30 2023-09-30T22:33:23.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.065+0000 7f69a9ffb700 1 -- 172.21.15.59:0/2452092043 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b0015ea0 con 0x7f69b40a0a30 2023-09-30T22:33:23.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.065+0000 7f12b57fa700 1 -- 172.21.15.59:0/3445965476 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4004510 con 0x7f12b8066880 2023-09-30T22:33:23.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.065+0000 7f12b57fa700 1 -- 172.21.15.59:0/3445965476 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a40036a0 con 0x7f12b8066880 2023-09-30T22:33:23.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.065+0000 7f12bed29700 1 -- 172.21.15.59:0/3445965476 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b8123590 con 0x7f12b8066880 2023-09-30T22:33:23.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.065+0000 7f12b57fa700 1 -- 172.21.15.59:0/3445965476 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4003a30 con 0x7f12b8066880 2023-09-30T22:33:23.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.065+0000 7f69bb648700 1 -- 172.21.15.59:0/2452092043 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b40a34a0 con 0x7f69b40a0a30 2023-09-30T22:33:23.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.065+0000 7f12bed29700 1 -- 172.21.15.59:0/3445965476 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b809b610 con 0x7f12b8066880 2023-09-30T22:33:23.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.066+0000 7f69a9ffb700 1 -- 172.21.15.59:0/2452092043 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f69b0016250 con 0x7f69b40a0a30 2023-09-30T22:33:23.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.066+0000 7f69bb648700 1 -- 172.21.15.59:0/2452092043 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b4074ea0 con 0x7f69b40a0a30 2023-09-30T22:33:23.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.066+0000 7f12a2ffd700 1 -- 172.21.15.59:0/3445965476 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12900052e0 con 0x7f12b8066880 2023-09-30T22:33:23.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.066+0000 7f69a9ffb700 1 -- 172.21.15.59:0/2452092043 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f69b0047910 con 0x7f69b40a0a30 2023-09-30T22:33:23.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.066+0000 7f12b57fa700 1 -- 172.21.15.59:0/3445965476 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12a4021070 con 0x7f12b8066880 2023-09-30T22:33:23.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.067+0000 7f12b57fa700 1 -- 172.21.15.59:0/3445965476 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f12a40408d0 con 0x7f12b8066880 2023-09-30T22:33:23.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.071+0000 7f69a9ffb700 1 -- 172.21.15.59:0/2452092043 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f69b001d980 con 0x7f69b40a0a30 2023-09-30T22:33:23.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.076+0000 7f12b57fa700 1 -- 172.21.15.59:0/3445965476 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12a40193b0 con 0x7f12b8066880 2023-09-30T22:33:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.227+0000 7f60d35e2700 1 Processor -- start 2023-09-30T22:33:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.227+0000 7ff8ae7b7700 1 Processor -- start 2023-09-30T22:33:23.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.227+0000 7ff8ae7b7700 1 -- start start 2023-09-30T22:33:23.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.227+0000 7f60d35e2700 1 -- start start 2023-09-30T22:33:23.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7ff8ae7b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8a809d6f0 0x7ff8a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7ff8ae7b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8a809e000 0x7ff8a81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7ff8ae7b7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8a809e410 0x7ff8a8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7ff8ae7b7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a806b460 con 0x7ff8a809e410 2023-09-30T22:33:23.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7ff8ae7b7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a809b120 con 0x7ff8a809e000 2023-09-30T22:33:23.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7ff8ae7b7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a809a7e0 con 0x7ff8a809d6f0 2023-09-30T22:33:23.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7ff8a7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8a809d6f0 0x7ff8a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7ff8a7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8a809d6f0 0x7ff8a809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51824/0 (socket says 172.21.15.59:51824) 2023-09-30T22:33:23.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7ff8a7fff700 1 -- 172.21.15.59:0/2295768962 learned_addr learned my addr 172.21.15.59:0/2295768962 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:23.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7ff8acd54700 1 --2- 172.21.15.59:0/2295768962 >> v2:172.21.15.59:3300/0 conn(0x7ff8a809e410 0x7ff8a8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7f60d35e2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f60cc0a09c0 0x7f60cc0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7f60d35e2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60cc09d5c0 0x7f60cc0a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7f60d35e2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc0a1810 con 0x7f60cc133920 2023-09-30T22:33:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7f60d35e2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc09ea10 con 0x7f60cc0a09c0 2023-09-30T22:33:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7f60d35e2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc09e210 con 0x7f60cc09d5c0 2023-09-30T22:33:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7f60d1b7f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f60cc133920 0x7f60cc133d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34396/0 (socket says 172.21.15.59:34396) 2023-09-30T22:33:23.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7f60d1b7f700 1 -- 172.21.15.59:0/2892559293 learned_addr learned my addr 172.21.15.59:0/2892559293 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7ff8a7fff700 1 -- 172.21.15.59:0/2295768962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8a809e000 msgr2=0x7ff8a81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7ff8a7fff700 1 --2- 172.21.15.59:0/2295768962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8a809e000 0x7ff8a81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7ff8a7fff700 1 -- 172.21.15.59:0/2295768962 >> v2:172.21.15.59:3300/0 conn(0x7ff8a809e410 msgr2=0x7ff8a8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7ff8a7fff700 1 --2- 172.21.15.59:0/2295768962 >> v2:172.21.15.59:3300/0 conn(0x7ff8a809e410 0x7ff8a8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.228+0000 7ff8a7fff700 1 -- 172.21.15.59:0/2295768962 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a809a500 con 0x7ff8a809d6f0 2023-09-30T22:33:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.229+0000 7f60d0b7d700 1 --2- 172.21.15.59:0/2892559293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60cc09d5c0 0x7f60cc0a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.229+0000 7ff8a7fff700 1 --2- 172.21.15.59:0/2295768962 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8a809d6f0 0x7ff8a809dac0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff898009e80 tx=0x7ff89800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fcbdc26c2965d03 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:23.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.229+0000 7f60d137e700 1 --2- 172.21.15.59:0/2892559293 >> v2:172.21.15.59:3300/0 conn(0x7f60cc0a09c0 0x7f60cc0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.229+0000 7ff8a77fe700 1 -- 172.21.15.59:0/2295768962 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89800e070 con 0x7ff8a809d6f0 2023-09-30T22:33:23.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.229+0000 7ff8a77fe700 1 -- 172.21.15.59:0/2295768962 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89800b8d0 con 0x7ff8a809d6f0 2023-09-30T22:33:23.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.229+0000 7ff8a77fe700 1 -- 172.21.15.59:0/2295768962 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89800bc80 con 0x7ff8a809d6f0 2023-09-30T22:33:23.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.229+0000 7f60c3fff700 1 -- 172.21.15.59:0/2892559293 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347315627 0 0) 0x7f60cc0a1810 con 0x7f60cc133920 2023-09-30T22:33:23.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.229+0000 7f60c3fff700 1 -- 172.21.15.59:0/2892559293 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b80035b0 con 0x7f60cc133920 2023-09-30T22:33:23.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.229+0000 7f60d137e700 1 -- 172.21.15.59:0/2892559293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60cc09d5c0 msgr2=0x7f60cc0a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:23.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.229+0000 7f60d137e700 1 --2- 172.21.15.59:0/2892559293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60cc09d5c0 0x7f60cc0a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.229+0000 7f60d137e700 1 -- 172.21.15.59:0/2892559293 >> v1:172.21.15.59:6789/0 conn(0x7f60cc133920 legacy=0x7f60cc133d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.229+0000 7f60d137e700 1 -- 172.21.15.59:0/2892559293 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc0a26f0 con 0x7f60cc0a09c0 2023-09-30T22:33:23.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.230+0000 7f60d137e700 1 --2- 172.21.15.59:0/2892559293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60cc0a09c0 0x7f60cc0a0d90 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f60c8009840 tx=0x7f60c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5901842501108397 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:23.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.230+0000 7ff8ae7b7700 1 -- 172.21.15.59:0/2295768962 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8a809d6f0 msgr2=0x7ff8a809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.230+0000 7ff8ae7b7700 1 --2- 172.21.15.59:0/2295768962 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8a809d6f0 0x7ff8a809dac0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff898009e80 tx=0x7ff89800b330 comp rx=0 tx=0).stop 2023-09-30T22:33:23.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.230+0000 7ff8ae7b7700 1 -- 172.21.15.59:0/2295768962 shutdown_connections 2023-09-30T22:33:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.230+0000 7ff8ae7b7700 1 --2- 172.21.15.59:0/2295768962 >> v2:172.21.15.59:3300/0 conn(0x7ff8a809e410 0x7ff8a8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.230+0000 7ff8ae7b7700 1 --2- 172.21.15.59:0/2295768962 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8a809d6f0 0x7ff8a809dac0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.230+0000 7ff8ae7b7700 1 --2- 172.21.15.59:0/2295768962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8a809e000 0x7ff8a81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.230+0000 7f60c3fff700 1 -- 172.21.15.59:0/2892559293 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8011830 con 0x7f60cc0a09c0 2023-09-30T22:33:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.230+0000 7ff8ae7b7700 1 -- 172.21.15.59:0/2295768962 >> 172.21.15.59:0/2295768962 conn(0x7ff8a8066f50 msgr2=0x7ff8a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.230+0000 7f60c3fff700 1 -- 172.21.15.59:0/2892559293 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c8011990 con 0x7f60cc0a09c0 2023-09-30T22:33:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.230+0000 7f60c3fff700 1 -- 172.21.15.59:0/2892559293 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8011d20 con 0x7f60cc0a09c0 2023-09-30T22:33:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.230+0000 7ff8ae7b7700 1 -- 172.21.15.59:0/2295768962 shutdown_connections 2023-09-30T22:33:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.230+0000 7ff8ae7b7700 1 -- 172.21.15.59:0/2295768962 wait complete. 2023-09-30T22:33:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.231+0000 7f60d35e2700 1 -- 172.21.15.59:0/2892559293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60cc0a09c0 msgr2=0x7f60cc0a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.231+0000 7f60d35e2700 1 --2- 172.21.15.59:0/2892559293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60cc0a09c0 0x7f60cc0a0d90 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f60c8009840 tx=0x7f60c8009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.231+0000 7f60d35e2700 1 -- 172.21.15.59:0/2892559293 shutdown_connections 2023-09-30T22:33:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.231+0000 7f60d35e2700 1 --2- 172.21.15.59:0/2892559293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60cc0a09c0 0x7f60cc0a0d90 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.231+0000 7f60d35e2700 1 --2- 172.21.15.59:0/2892559293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60cc09d5c0 0x7f60cc0a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.231+0000 7f60d35e2700 1 -- 172.21.15.59:0/2892559293 >> 172.21.15.59:0/2892559293 conn(0x7f60cc0a2fe0 msgr2=0x7f60cc0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.231+0000 7f60d35e2700 1 -- 172.21.15.59:0/2892559293 shutdown_connections 2023-09-30T22:33:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.231+0000 7f60d35e2700 1 -- 172.21.15.59:0/2892559293 wait complete. 2023-09-30T22:33:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.231+0000 7ff8ae7b7700 1 Processor -- start 2023-09-30T22:33:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.232+0000 7ff8ae7b7700 1 -- start start 2023-09-30T22:33:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.232+0000 7f60d35e2700 1 Processor -- start 2023-09-30T22:33:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.232+0000 7f60d35e2700 1 -- start start 2023-09-30T22:33:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.232+0000 7f60d35e2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60cc09d5c0 0x7f60cc1c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.232+0000 7f60d35e2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60cc0a09c0 0x7f60cc1c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.232+0000 7f60d35e2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60cc133920 0x7f60cc11e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.232+0000 7f60d35e2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc1220c0 con 0x7f60cc133920 2023-09-30T22:33:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.232+0000 7f60d35e2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc133360 con 0x7f60cc09d5c0 2023-09-30T22:33:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.232+0000 7f60d35e2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc09cec0 con 0x7f60cc0a09c0 2023-09-30T22:33:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.232+0000 7ff8ae7b7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8a809d6f0 0x7ff8a81a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7ff8ae7b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8a809e000 0x7ff8a81a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7ff8ae7b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8a809e410 0x7ff8a81a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7ff8ae7b7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a81a73e0 con 0x7ff8a809d6f0 2023-09-30T22:33:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7ff8ae7b7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a81a7b40 con 0x7ff8a809e000 2023-09-30T22:33:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7ff8ae7b7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a81a8d90 con 0x7ff8a809e410 2023-09-30T22:33:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7ff8a7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8a809d6f0 0x7ff8a81a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7ff89f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8a809e000 0x7ff8a81a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7ff8a7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8a809d6f0 0x7ff8a81a5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49210/0 (socket says 172.21.15.59:49210) 2023-09-30T22:33:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7ff8a7fff700 1 -- 172.21.15.59:0/3663942866 learned_addr learned my addr 172.21.15.59:0/3663942866 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7f60d0b7d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60cc0a09c0 0x7f60cc1c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7f60d0b7d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60cc0a09c0 0x7f60cc1c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51832/0 (socket says 172.21.15.59:51832) 2023-09-30T22:33:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7f60d0b7d700 1 -- 172.21.15.59:0/475501609 learned_addr learned my addr 172.21.15.59:0/475501609 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7f60d1b7f700 1 --2- 172.21.15.59:0/475501609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60cc133920 0x7f60cc11e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7f60d137e700 1 --2- 172.21.15.59:0/475501609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60cc09d5c0 0x7f60cc1c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7f60d0b7d700 1 -- 172.21.15.59:0/475501609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60cc09d5c0 msgr2=0x7f60cc1c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7f60d0b7d700 1 --2- 172.21.15.59:0/475501609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60cc09d5c0 0x7f60cc1c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7f60d0b7d700 1 -- 172.21.15.59:0/475501609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60cc133920 msgr2=0x7f60cc11e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7f60d0b7d700 1 --2- 172.21.15.59:0/475501609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60cc133920 0x7f60cc11e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7f60d0b7d700 1 -- 172.21.15.59:0/475501609 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c80094a0 con 0x7f60cc0a09c0 2023-09-30T22:33:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7ff8a7fff700 1 -- 172.21.15.59:0/3663942866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8a809e410 msgr2=0x7ff8a81a69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7ff8a7fff700 1 --2- 172.21.15.59:0/3663942866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8a809e410 0x7ff8a81a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7ff8a7fff700 1 -- 172.21.15.59:0/3663942866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8a809e000 msgr2=0x7ff8a81a6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7ff8a7fff700 1 --2- 172.21.15.59:0/3663942866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8a809e000 0x7ff8a81a6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7ff8a7fff700 1 -- 172.21.15.59:0/3663942866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff898009b30 con 0x7ff8a809d6f0 2023-09-30T22:33:23.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.233+0000 7f60d0b7d700 1 --2- 172.21.15.59:0/475501609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60cc0a09c0 0x7f60cc1c8880 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00d830 tx=0x7f60bc00db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:23.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.234+0000 7ff8a7fff700 1 --2- 172.21.15.59:0/3663942866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8a809d6f0 0x7ff8a81a5f30 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff8a809a970 tx=0x7ff898004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.234+0000 7f60c1ffb700 1 -- 172.21.15.59:0/475501609 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0125f0 con 0x7f60cc0a09c0 2023-09-30T22:33:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.234+0000 7f60c1ffb700 1 -- 172.21.15.59:0/475501609 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc012750 con 0x7f60cc0a09c0 2023-09-30T22:33:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.234+0000 7f60c1ffb700 1 -- 172.21.15.59:0/475501609 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc012ae0 con 0x7f60cc0a09c0 2023-09-30T22:33:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.234+0000 7ff8a57fa700 1 -- 172.21.15.59:0/3663942866 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898004450 con 0x7ff8a809d6f0 2023-09-30T22:33:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.234+0000 7ff8a57fa700 1 -- 172.21.15.59:0/3663942866 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8980045d0 con 0x7ff8a809d6f0 2023-09-30T22:33:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.234+0000 7ff8a57fa700 1 -- 172.21.15.59:0/3663942866 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89801c440 con 0x7ff8a809d6f0 2023-09-30T22:33:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.234+0000 7f60d35e2700 1 -- 172.21.15.59:0/475501609 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc0a43f0 con 0x7f60cc0a09c0 2023-09-30T22:33:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.234+0000 7f60d35e2700 1 -- 172.21.15.59:0/475501609 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc1c8dc0 con 0x7f60cc0a09c0 2023-09-30T22:33:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.235+0000 7ff8ae7b7700 1 -- 172.21.15.59:0/3663942866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a81a9770 con 0x7ff8a809d6f0 2023-09-30T22:33:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.235+0000 7f60c1ffb700 1 -- 172.21.15.59:0/475501609 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f60bc012c40 con 0x7f60cc0a09c0 2023-09-30T22:33:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.235+0000 7ff8ae7b7700 1 -- 172.21.15.59:0/3663942866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a80a3170 con 0x7ff8a809d6f0 2023-09-30T22:33:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.235+0000 7f60c1ffb700 1 -- 172.21.15.59:0/475501609 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f60bc03f970 con 0x7f60cc0a09c0 2023-09-30T22:33:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.236+0000 7f60d35e2700 1 -- 172.21.15.59:0/475501609 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60cc1bd100 con 0x7f60cc0a09c0 2023-09-30T22:33:23.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.236+0000 7ff8ae7b7700 1 -- 172.21.15.59:0/3663942866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a81a8120 con 0x7ff8a809d6f0 2023-09-30T22:33:23.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.236+0000 7ff8a57fa700 1 -- 172.21.15.59:0/3663942866 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff89801c5a0 con 0x7ff8a809d6f0 2023-09-30T22:33:23.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.236+0000 7ff8a57fa700 1 -- 172.21.15.59:0/3663942866 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff8980412d0 con 0x7ff8a809d6f0 2023-09-30T22:33:23.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.241+0000 7ff8a57fa700 1 -- 172.21.15.59:0/3663942866 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff89802d940 con 0x7ff8a809d6f0 2023-09-30T22:33:23.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.241+0000 7f60c1ffb700 1 -- 172.21.15.59:0/475501609 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f60bc014430 con 0x7f60cc0a09c0 2023-09-30T22:33:23.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.288+0000 7f12a2ffd700 1 -- 172.21.15.59:0/3445965476 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1290005590 con 0x7f12b8066880 2023-09-30T22:33:23.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.289+0000 7f12b57fa700 1 -- 172.21.15.59:0/3445965476 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12a4015070 con 0x7f12b8066880 2023-09-30T22:33:23.289 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:23.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.289+0000 7f69bb648700 1 -- 172.21.15.59:0/2452092043 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f69b40a28e0 con 0x7f69b40a0a30 2023-09-30T22:33:23.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.289+0000 7f69a9ffb700 1 -- 172.21.15.59:0/2452092043 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f69b0023030 con 0x7f69b40a0a30 2023-09-30T22:33:23.290 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:23.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.292+0000 7f12a2ffd700 1 -- 172.21.15.59:0/3445965476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b8066880 msgr2=0x7f12b81c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.292+0000 7f12a2ffd700 1 --2- 172.21.15.59:0/3445965476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b8066880 0x7f12b81c8970 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f12a4016000 tx=0x7f12a4004750 comp rx=0 tx=0).stop 2023-09-30T22:33:23.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.293+0000 7f12a2ffd700 1 -- 172.21.15.59:0/3445965476 shutdown_connections 2023-09-30T22:33:23.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.293+0000 7f12a2ffd700 1 --2- 172.21.15.59:0/3445965476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b812cf60 0x7f12b81c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.293+0000 7f12a2ffd700 1 --2- 172.21.15.59:0/3445965476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b8066410 0x7f12b81c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.293+0000 7f12a2ffd700 1 --2- 172.21.15.59:0/3445965476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b8066880 0x7f12b81c8970 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.293+0000 7f12a2ffd700 1 -- 172.21.15.59:0/3445965476 >> 172.21.15.59:0/3445965476 conn(0x7f12b80a2aa0 msgr2=0x7f12b81328f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:23.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.293+0000 7f12a2ffd700 1 -- 172.21.15.59:0/3445965476 shutdown_connections 2023-09-30T22:33:23.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.293+0000 7f12a2ffd700 1 -- 172.21.15.59:0/3445965476 wait complete. 2023-09-30T22:33:23.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.293+0000 7f69bb648700 1 -- 172.21.15.59:0/2452092043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69b40a0a30 msgr2=0x7f69b41200b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.293+0000 7f69bb648700 1 --2- 172.21.15.59:0/2452092043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69b40a0a30 0x7f69b41200b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f69b000c4b0 tx=0x7f69b000c7c0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.294+0000 7f69bb648700 1 -- 172.21.15.59:0/2452092043 shutdown_connections 2023-09-30T22:33:23.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.294+0000 7f69bb648700 1 --2- 172.21.15.59:0/2452092043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69b40a0a30 0x7f69b41200b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.294+0000 7f69bb648700 1 --2- 172.21.15.59:0/2452092043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69b4133fa0 0x7f69b4120b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.294+0000 7f69bb648700 1 --2- 172.21.15.59:0/2452092043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69b40a1340 0x7f69b41205f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.294+0000 7f69bb648700 1 -- 172.21.15.59:0/2452092043 >> 172.21.15.59:0/2452092043 conn(0x7f69b40a6550 msgr2=0x7f69b409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:23.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.294+0000 7f69bb648700 1 -- 172.21.15.59:0/2452092043 shutdown_connections 2023-09-30T22:33:23.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.294+0000 7f69bb648700 1 -- 172.21.15.59:0/2452092043 wait complete. 2023-09-30T22:33:23.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:23.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.449+0000 7f60d35e2700 1 -- 172.21.15.59:0/475501609 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f60cc121f20 con 0x7f60cc0a09c0 2023-09-30T22:33:23.449 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.449+0000 7f60c1ffb700 1 -- 172.21.15.59:0/475501609 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f60cc121f20 con 0x7f60cc0a09c0 2023-09-30T22:33:23.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.451+0000 7f60d35e2700 1 -- 172.21.15.59:0/475501609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60cc0a09c0 msgr2=0x7f60cc1c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.451+0000 7f60d35e2700 1 --2- 172.21.15.59:0/475501609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60cc0a09c0 0x7f60cc1c8880 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00d830 tx=0x7f60bc00db40 comp rx=0 tx=0).stop 2023-09-30T22:33:23.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.451+0000 7f60d35e2700 1 -- 172.21.15.59:0/475501609 shutdown_connections 2023-09-30T22:33:23.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.451+0000 7f60d35e2700 1 --2- 172.21.15.59:0/475501609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60cc133920 0x7f60cc11e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.451+0000 7f60d35e2700 1 --2- 172.21.15.59:0/475501609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60cc09d5c0 0x7f60cc1c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.451+0000 7f60d35e2700 1 --2- 172.21.15.59:0/475501609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60cc0a09c0 0x7f60cc1c8880 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.451+0000 7f60d35e2700 1 -- 172.21.15.59:0/475501609 >> 172.21.15.59:0/475501609 conn(0x7f60cc0a2fe0 msgr2=0x7f60cc1bbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:23.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.451+0000 7f60d35e2700 1 -- 172.21.15.59:0/475501609 shutdown_connections 2023-09-30T22:33:23.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.451+0000 7f60d35e2700 1 -- 172.21.15.59:0/475501609 wait complete. 2023-09-30T22:33:23.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.452+0000 7ff8ae7b7700 1 -- 172.21.15.59:0/3663942866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff8a8074ea0 con 0x7ff8a809d6f0 2023-09-30T22:33:23.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.453+0000 7ff8a57fa700 1 -- 172.21.15.59:0/3663942866 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff89802d350 con 0x7ff8a809d6f0 2023-09-30T22:33:23.453 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:23.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.455+0000 7ff8ae7b7700 1 -- 172.21.15.59:0/3663942866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8a809d6f0 msgr2=0x7ff8a81a5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:23.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.455+0000 7ff8ae7b7700 1 --2- 172.21.15.59:0/3663942866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8a809d6f0 0x7ff8a81a5f30 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff8a809a970 tx=0x7ff898004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.455+0000 7ff8ae7b7700 1 -- 172.21.15.59:0/3663942866 shutdown_connections 2023-09-30T22:33:23.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.455+0000 7ff8ae7b7700 1 --2- 172.21.15.59:0/3663942866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8a809e410 0x7ff8a81a69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.455+0000 7ff8ae7b7700 1 --2- 172.21.15.59:0/3663942866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8a809d6f0 0x7ff8a81a5f30 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.455+0000 7ff8ae7b7700 1 --2- 172.21.15.59:0/3663942866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8a809e000 0x7ff8a81a6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:23.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.455+0000 7ff8ae7b7700 1 -- 172.21.15.59:0/3663942866 >> 172.21.15.59:0/3663942866 conn(0x7ff8a8066f50 msgr2=0x7ff8a80a36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:23.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.455+0000 7ff8ae7b7700 1 -- 172.21.15.59:0/3663942866 shutdown_connections 2023-09-30T22:33:23.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:23.455+0000 7ff8ae7b7700 1 -- 172.21.15.59:0/3663942866 wait complete. 2023-09-30T22:33:23.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:23.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:24.316 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:24.317 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.465+0000 7f2fb50ec700 1 Processor -- start 2023-09-30T22:33:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.465+0000 7f8fc4afd700 1 Processor -- start 2023-09-30T22:33:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.466+0000 7f2fb50ec700 1 -- start start 2023-09-30T22:33:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.466+0000 7f8fc4afd700 1 -- start start 2023-09-30T22:33:24.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.466+0000 7f2fb50ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a0a30 0x7f2fb00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.466+0000 7f2fb50ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fb0134170 0x7f2fb013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.466+0000 7f2fb50ec700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb009edd0 con 0x7f2fb00a1340 2023-09-30T22:33:24.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.466+0000 7f2fb50ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb009e1f0 con 0x7f2fb00a0a30 2023-09-30T22:33:24.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.466+0000 7f2fb50ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb009dc50 con 0x7f2fb0134170 2023-09-30T22:33:24.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.466+0000 7f2faed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a0a30 0x7f2fb00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.466+0000 7f2faf59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fb0134170 0x7f2fb013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.466+0000 7f2fa659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2fb00a1340 0x7f2fb0133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34860/0 (socket says 172.21.15.59:34860) 2023-09-30T22:33:24.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.466+0000 7f2fa659c700 1 -- 172.21.15.59:0/4112742099 learned_addr learned my addr 172.21.15.59:0/4112742099 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:24.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f2fae59c700 1 -- 172.21.15.59:0/4112742099 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337293561 0 0) 0x7f2fb009edd0 con 0x7f2fb00a1340 2023-09-30T22:33:24.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f2faed9d700 1 -- 172.21.15.59:0/4112742099 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fb0134170 msgr2=0x7f2fb013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:24.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f2faed9d700 1 --2- 172.21.15.59:0/4112742099 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fb0134170 0x7f2fb013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f2faed9d700 1 -- 172.21.15.59:0/4112742099 >> v1:172.21.15.59:6789/0 conn(0x7f2fb00a1340 legacy=0x7f2fb0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f2faed9d700 1 -- 172.21.15.59:0/4112742099 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00a1fe0 con 0x7f2fb00a0a30 2023-09-30T22:33:24.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f8fc4afd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc009d6f0 0x7f8fc009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f8fc4afd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc009e000 0x7f8fc01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f8fc4afd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc009b120 con 0x7f8fc009e410 2023-09-30T22:33:24.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f8fc4afd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc006b460 con 0x7f8fc009e000 2023-09-30T22:33:24.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f8fc4afd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc009a7e0 con 0x7f8fc009d6f0 2023-09-30T22:33:24.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f8fbdd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc009e000 0x7f8fc01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f8fbdd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc009e000 0x7f8fc01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57834/0 (socket says 172.21.15.59:57834) 2023-09-30T22:33:24.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f8fbdd9b700 1 -- 172.21.15.59:0/909746767 learned_addr learned my addr 172.21.15.59:0/909746767 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:24.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f8fbe59c700 1 --2- 172.21.15.59:0/909746767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc009d6f0 0x7f8fc009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f2faed9d700 1 --2- 172.21.15.59:0/4112742099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a0a30 0x7f2fb00a0e00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009870 tx=0x7f2fa0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b2816273ceeb68e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:24.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f8fbdd9b700 1 -- 172.21.15.59:0/909746767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc009d6f0 msgr2=0x7f8fc009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:24.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f8fbdd9b700 1 --2- 172.21.15.59:0/909746767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc009d6f0 0x7f8fc009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f8fbdd9b700 1 -- 172.21.15.59:0/909746767 >> v1:172.21.15.59:6789/0 conn(0x7f8fc009e410 legacy=0x7f8fc0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f8fbd59a700 1 -- 172.21.15.59:0/909746767 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387358590 0 0) 0x7f8fc009b120 con 0x7f8fc009e410 2023-09-30T22:33:24.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f8fbdd9b700 1 -- 172.21.15.59:0/909746767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc009a500 con 0x7f8fc009e000 2023-09-30T22:33:24.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f8fbe59c700 1 --2- 172.21.15.59:0/909746767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc009d6f0 0x7f8fc009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:24.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f2fae59c700 1 -- 172.21.15.59:0/4112742099 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0011830 con 0x7f2fb00a0a30 2023-09-30T22:33:24.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f2fae59c700 1 -- 172.21.15.59:0/4112742099 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa0011990 con 0x7f2fb00a0a30 2023-09-30T22:33:24.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.467+0000 7f2fae59c700 1 -- 172.21.15.59:0/4112742099 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0011d20 con 0x7f2fb00a0a30 2023-09-30T22:33:24.477 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:24.478 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:24.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.468+0000 7f8fbdd9b700 1 --2- 172.21.15.59:0/909746767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc009e000 0x7f8fc01339f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009920 tx=0x7f8fb4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a711dd766fa4058 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:24.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.468+0000 7f8fbd59a700 1 -- 172.21.15.59:0/909746767 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4011830 con 0x7f8fc009e000 2023-09-30T22:33:24.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.468+0000 7f8fbd59a700 1 -- 172.21.15.59:0/909746767 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb4011990 con 0x7f8fc009e000 2023-09-30T22:33:24.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.468+0000 7f8fbd59a700 1 -- 172.21.15.59:0/909746767 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4011d20 con 0x7f8fc009e000 2023-09-30T22:33:24.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.468+0000 7f2fb50ec700 1 -- 172.21.15.59:0/4112742099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a0a30 msgr2=0x7f2fb00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.468+0000 7f2fb50ec700 1 --2- 172.21.15.59:0/4112742099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a0a30 0x7f2fb00a0e00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009870 tx=0x7f2fa0009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:24.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.468+0000 7f2fb50ec700 1 -- 172.21.15.59:0/4112742099 shutdown_connections 2023-09-30T22:33:24.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.468+0000 7f2fb50ec700 1 --2- 172.21.15.59:0/4112742099 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fb0134170 0x7f2fb013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.468+0000 7f2fb50ec700 1 --2- 172.21.15.59:0/4112742099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a0a30 0x7f2fb00a0e00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.468+0000 7f2fb50ec700 1 -- 172.21.15.59:0/4112742099 >> 172.21.15.59:0/4112742099 conn(0x7f2fb00a6550 msgr2=0x7f2fb00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:24.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.468+0000 7f2fb50ec700 1 -- 172.21.15.59:0/4112742099 shutdown_connections 2023-09-30T22:33:24.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.468+0000 7f2fb50ec700 1 -- 172.21.15.59:0/4112742099 wait complete. 2023-09-30T22:33:24.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.468+0000 7f8fc4afd700 1 -- 172.21.15.59:0/909746767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc009e000 msgr2=0x7f8fc01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.468+0000 7f8fc4afd700 1 --2- 172.21.15.59:0/909746767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc009e000 0x7f8fc01339f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009920 tx=0x7f8fb4009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:24.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.469+0000 7f8fc4afd700 1 -- 172.21.15.59:0/909746767 shutdown_connections 2023-09-30T22:33:24.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.469+0000 7f8fc4afd700 1 --2- 172.21.15.59:0/909746767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc009d6f0 0x7f8fc009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.469+0000 7f8fc4afd700 1 --2- 172.21.15.59:0/909746767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc009e000 0x7f8fc01339f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.469+0000 7f8fc4afd700 1 -- 172.21.15.59:0/909746767 >> 172.21.15.59:0/909746767 conn(0x7f8fc0066f50 msgr2=0x7f8fc009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:24.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.469+0000 7f8fc4afd700 1 -- 172.21.15.59:0/909746767 shutdown_connections 2023-09-30T22:33:24.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.469+0000 7f8fc4afd700 1 -- 172.21.15.59:0/909746767 wait complete. 2023-09-30T22:33:24.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.469+0000 7f2fb50ec700 1 Processor -- start 2023-09-30T22:33:24.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f2fb50ec700 1 -- start start 2023-09-30T22:33:24.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f8fc4afd700 1 Processor -- start 2023-09-30T22:33:24.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f8fc4afd700 1 -- start start 2023-09-30T22:33:24.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f2fb50ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a0a30 0x7f2fb0122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f2fb50ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fb00a1340 0x7f2fb0122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f2fb50ec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fb0134170 0x7f2fb0123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f2fb50ec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb0125c80 con 0x7f2fb0134170 2023-09-30T22:33:24.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f2fb50ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb01243b0 con 0x7f2fb00a0a30 2023-09-30T22:33:24.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f2fb50ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00a4e90 con 0x7f2fb00a1340 2023-09-30T22:33:24.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f2faed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a0a30 0x7f2fb0122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f2faed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a0a30 0x7f2fb0122790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57848/0 (socket says 172.21.15.59:57848) 2023-09-30T22:33:24.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f2faed9d700 1 -- 172.21.15.59:0/3715763236 learned_addr learned my addr 172.21.15.59:0/3715763236 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:24.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f2faf59e700 1 --2- 172.21.15.59:0/3715763236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fb0134170 0x7f2fb0123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f8fc4afd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc009d6f0 0x7f8fc0122580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f8fc4afd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc009e000 0x7f8fc0122ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f8fc4afd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc009e410 0x7f8fc0123000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f8fc4afd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc0125f40 con 0x7f8fc009e410 2023-09-30T22:33:24.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f8fc4afd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc0072110 con 0x7f8fc009d6f0 2023-09-30T22:33:24.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f8fc4afd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc009c710 con 0x7f8fc009e000 2023-09-30T22:33:24.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.470+0000 7f2fa659c700 1 --2- 172.21.15.59:0/3715763236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fb00a1340 0x7f2fb0122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f8fbdd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc009e000 0x7f8fc0122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f8fbe59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc009d6f0 0x7f8fc0122580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f8fbdd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc009e000 0x7f8fc0122ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36752/0 (socket says 172.21.15.59:36752) 2023-09-30T22:33:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f8fbe59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc009d6f0 0x7f8fc0122580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57858/0 (socket says 172.21.15.59:57858) 2023-09-30T22:33:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f8fbdd9b700 1 -- 172.21.15.59:0/942469598 learned_addr learned my addr 172.21.15.59:0/942469598 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f2faf59e700 1 -- 172.21.15.59:0/3715763236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fb00a1340 msgr2=0x7f2fb0122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f2faf59e700 1 --2- 172.21.15.59:0/3715763236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fb00a1340 0x7f2fb0122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f2faf59e700 1 -- 172.21.15.59:0/3715763236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a0a30 msgr2=0x7f2fb0122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f2faf59e700 1 --2- 172.21.15.59:0/3715763236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a0a30 0x7f2fb0122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f2faf59e700 1 -- 172.21.15.59:0/3715763236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa00094a0 con 0x7f2fb0134170 2023-09-30T22:33:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f8fbed9d700 1 --2- 172.21.15.59:0/942469598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc009e410 0x7f8fc0123000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f8fbe59c700 1 -- 172.21.15.59:0/942469598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc009e000 msgr2=0x7f8fc0122ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f8fbe59c700 1 --2- 172.21.15.59:0/942469598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc009e000 0x7f8fc0122ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f8fbe59c700 1 -- 172.21.15.59:0/942469598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc009e410 msgr2=0x7f8fc0123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f8fbe59c700 1 --2- 172.21.15.59:0/942469598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc009e410 0x7f8fc0123000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f2faed9d700 1 --2- 172.21.15.59:0/3715763236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a0a30 0x7f2fb0122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:24.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f8fbe59c700 1 -- 172.21.15.59:0/942469598 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb00094a0 con 0x7f8fc009d6f0 2023-09-30T22:33:24.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f2faf59e700 1 --2- 172.21.15.59:0/3715763236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fb0134170 0x7f2fb0123210 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800efc0 tx=0x7f2fa800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:24.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f2fa659c700 1 --2- 172.21.15.59:0/3715763236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fb00a1340 0x7f2fb0122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:24.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f8fbe59c700 1 --2- 172.21.15.59:0/942469598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc009d6f0 0x7f8fc0122580 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000e9b0 tx=0x7f8fb000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:24.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f2fa7fff700 1 -- 172.21.15.59:0/3715763236 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa800cd40 con 0x7f2fb0134170 2023-09-30T22:33:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f2fa7fff700 1 -- 172.21.15.59:0/3715763236 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa800f040 con 0x7f2fb0134170 2023-09-30T22:33:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f2fb50ec700 1 -- 172.21.15.59:0/3715763236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb00a25e0 con 0x7f2fb0134170 2023-09-30T22:33:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.472+0000 7f2fa7fff700 1 -- 172.21.15.59:0/3715763236 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa800cea0 con 0x7f2fb0134170 2023-09-30T22:33:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.472+0000 7f2fb50ec700 1 -- 172.21.15.59:0/3715763236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb01269b0 con 0x7f2fb0134170 2023-09-30T22:33:24.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.471+0000 7f8faeffd700 1 -- 172.21.15.59:0/942469598 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb000c850 con 0x7f8fc009d6f0 2023-09-30T22:33:24.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.472+0000 7f8faeffd700 1 -- 172.21.15.59:0/942469598 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb000c9b0 con 0x7f8fc009d6f0 2023-09-30T22:33:24.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.472+0000 7f8faeffd700 1 -- 172.21.15.59:0/942469598 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb000cd60 con 0x7f8fc009d6f0 2023-09-30T22:33:24.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.472+0000 7f8fc4afd700 1 -- 172.21.15.59:0/942469598 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb4009550 con 0x7f8fc009d6f0 2023-09-30T22:33:24.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.472+0000 7f8fc4afd700 1 -- 172.21.15.59:0/942469598 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc0125c60 con 0x7f8fc009d6f0 2023-09-30T22:33:24.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.473+0000 7f2fb50ec700 1 -- 172.21.15.59:0/3715763236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb0125df0 con 0x7f2fb0134170 2023-09-30T22:33:24.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.473+0000 7f8fc4afd700 1 -- 172.21.15.59:0/942469598 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc0125900 con 0x7f8fc009d6f0 2023-09-30T22:33:24.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.473+0000 7f8faeffd700 1 -- 172.21.15.59:0/942469598 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8fb0013470 con 0x7f8fc009d6f0 2023-09-30T22:33:24.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.473+0000 7f2fa7fff700 1 -- 172.21.15.59:0/3715763236 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2fa80146a0 con 0x7f2fb0134170 2023-09-30T22:33:24.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.473+0000 7f8faeffd700 1 -- 172.21.15.59:0/942469598 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8fb003fb50 con 0x7f8fc009d6f0 2023-09-30T22:33:24.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.473+0000 7f2fa7fff700 1 -- 172.21.15.59:0/3715763236 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2fa80403b0 con 0x7f2fb0134170 2023-09-30T22:33:24.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.482+0000 7f8faeffd700 1 -- 172.21.15.59:0/942469598 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8fb001b3b0 con 0x7f8fc009d6f0 2023-09-30T22:33:24.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.482+0000 7f2fa7fff700 1 -- 172.21.15.59:0/3715763236 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2fa8007920 con 0x7f2fb0134170 2023-09-30T22:33:24.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.640+0000 7fe4138ea700 1 Processor -- start 2023-09-30T22:33:24.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.640+0000 7fded3e08700 1 Processor -- start 2023-09-30T22:33:24.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.641+0000 7fe4138ea700 1 -- start start 2023-09-30T22:33:24.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.641+0000 7fded3e08700 1 -- start start 2023-09-30T22:33:24.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.641+0000 7fe4138ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe40c09d6f0 0x7fe40c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.641+0000 7fe4138ea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe40c09e000 0x7fe40c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.641+0000 7fe4138ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe40c09e410 0x7fe40c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.641+0000 7fe4138ea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe40c06b460 con 0x7fe40c09e000 2023-09-30T22:33:24.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.641+0000 7fe4138ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c09b120 con 0x7fe40c09d6f0 2023-09-30T22:33:24.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.641+0000 7fe4138ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c09a7e0 con 0x7fe40c09e410 2023-09-30T22:33:24.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.641+0000 7fe411686700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe40c09d6f0 0x7fe40c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.641+0000 7fe411686700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe40c09d6f0 0x7fe40c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57870/0 (socket says 172.21.15.59:57870) 2023-09-30T22:33:24.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.641+0000 7fe411686700 1 -- 172.21.15.59:0/4049924729 learned_addr learned my addr 172.21.15.59:0/4049924729 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:24.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.641+0000 7fded3e08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdecc09e1d0 0x7fdecc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fded3e08700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdecc139170 0x7fdecc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fded3e08700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdecc09b120 con 0x7fdecc09d6f0 2023-09-30T22:33:24.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fded3e08700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdecc06b460 con 0x7fdecc139170 2023-09-30T22:33:24.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fded3e08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc09a7e0 con 0x7fdecc09e1d0 2023-09-30T22:33:24.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fded1ba4700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdecc09d6f0 0x7fdecc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34878/0 (socket says 172.21.15.59:34878) 2023-09-30T22:33:24.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fded23a5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdecc139170 0x7fdecc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fded1ba4700 1 -- 172.21.15.59:0/3389177318 learned_addr learned my addr 172.21.15.59:0/3389177318 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:24.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fe410e85700 1 --2- 172.21.15.59:0/4049924729 >> v2:172.21.15.59:3300/0 conn(0x7fe40c09e000 0x7fe40c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fe411686700 1 -- 172.21.15.59:0/4049924729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe40c09e410 msgr2=0x7fe40c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:24.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fe411686700 1 --2- 172.21.15.59:0/4049924729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe40c09e410 0x7fe40c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fe411686700 1 -- 172.21.15.59:0/4049924729 >> v2:172.21.15.59:3300/0 conn(0x7fe40c09e000 msgr2=0x7fe40c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:24.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fe411686700 1 --2- 172.21.15.59:0/4049924729 >> v2:172.21.15.59:3300/0 conn(0x7fe40c09e000 0x7fe40c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fe411686700 1 -- 172.21.15.59:0/4049924729 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c09a500 con 0x7fe40c09d6f0 2023-09-30T22:33:24.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fe410e85700 1 --2- 172.21.15.59:0/4049924729 >> v2:172.21.15.59:3300/0 conn(0x7fe40c09e000 0x7fe40c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:24.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fe411686700 1 --2- 172.21.15.59:0/4049924729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe40c09d6f0 0x7fe40c09dac0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe408009920 tx=0x7fe408009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52dff4808f1c29 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:24.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fded23a5700 1 -- 172.21.15.59:0/3389177318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdecc09e1d0 msgr2=0x7fdecc138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:24.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fded23a5700 1 --2- 172.21.15.59:0/3389177318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdecc09e1d0 0x7fdecc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fded23a5700 1 -- 172.21.15.59:0/3389177318 >> v1:172.21.15.59:6789/0 conn(0x7fdecc09d6f0 legacy=0x7fdecc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fded23a5700 1 -- 172.21.15.59:0/3389177318 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc09a500 con 0x7fdecc139170 2023-09-30T22:33:24.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.642+0000 7fded23a5700 1 --2- 172.21.15.59:0/3389177318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdecc139170 0x7fdecc13b550 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009d90 tx=0x7fdec400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47aeda293259eca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:24.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.643+0000 7fe403fff700 1 -- 172.21.15.59:0/4049924729 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40800ba20 con 0x7fe40c09d6f0 2023-09-30T22:33:24.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.643+0000 7fe403fff700 1 -- 172.21.15.59:0/4049924729 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40800bb80 con 0x7fe40c09d6f0 2023-09-30T22:33:24.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.643+0000 7fe403fff700 1 -- 172.21.15.59:0/4049924729 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408009e70 con 0x7fe40c09d6f0 2023-09-30T22:33:24.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.643+0000 7fded0ba2700 1 -- 172.21.15.59:0/3389177318 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec400e070 con 0x7fdecc139170 2023-09-30T22:33:24.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.643+0000 7fded0ba2700 1 -- 172.21.15.59:0/3389177318 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec400bbd0 con 0x7fdecc139170 2023-09-30T22:33:24.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.643+0000 7fded0ba2700 1 -- 172.21.15.59:0/3389177318 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4012430 con 0x7fdecc139170 2023-09-30T22:33:24.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fe4138ea700 1 -- 172.21.15.59:0/4049924729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe40c09d6f0 msgr2=0x7fe40c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fe4138ea700 1 --2- 172.21.15.59:0/4049924729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe40c09d6f0 0x7fe40c09dac0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe408009920 tx=0x7fe408009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:24.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fded3e08700 1 -- 172.21.15.59:0/3389177318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdecc139170 msgr2=0x7fdecc13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fded3e08700 1 --2- 172.21.15.59:0/3389177318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdecc139170 0x7fdecc13b550 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009d90 tx=0x7fdec400b330 comp rx=0 tx=0).stop 2023-09-30T22:33:24.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fe4138ea700 1 -- 172.21.15.59:0/4049924729 shutdown_connections 2023-09-30T22:33:24.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fe4138ea700 1 --2- 172.21.15.59:0/4049924729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe40c09e410 0x7fe40c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fe4138ea700 1 --2- 172.21.15.59:0/4049924729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe40c09d6f0 0x7fe40c09dac0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fe4138ea700 1 --2- 172.21.15.59:0/4049924729 >> v2:172.21.15.59:3300/0 conn(0x7fe40c09e000 0x7fe40c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fe4138ea700 1 -- 172.21.15.59:0/4049924729 >> 172.21.15.59:0/4049924729 conn(0x7fe40c066f50 msgr2=0x7fe40c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:24.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fded3e08700 1 -- 172.21.15.59:0/3389177318 shutdown_connections 2023-09-30T22:33:24.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fded3e08700 1 --2- 172.21.15.59:0/3389177318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdecc139170 0x7fdecc13b550 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fded3e08700 1 --2- 172.21.15.59:0/3389177318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdecc09e1d0 0x7fdecc138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fded3e08700 1 -- 172.21.15.59:0/3389177318 >> 172.21.15.59:0/3389177318 conn(0x7fdecc066f50 msgr2=0x7fdecc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:24.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fe4138ea700 1 -- 172.21.15.59:0/4049924729 shutdown_connections 2023-09-30T22:33:24.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fded3e08700 1 -- 172.21.15.59:0/3389177318 shutdown_connections 2023-09-30T22:33:24.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fe4138ea700 1 -- 172.21.15.59:0/4049924729 wait complete. 2023-09-30T22:33:24.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.644+0000 7fded3e08700 1 -- 172.21.15.59:0/3389177318 wait complete. 2023-09-30T22:33:24.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.645+0000 7fded3e08700 1 Processor -- start 2023-09-30T22:33:24.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.645+0000 7fded3e08700 1 -- start start 2023-09-30T22:33:24.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.645+0000 7fe4138ea700 1 Processor -- start 2023-09-30T22:33:24.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fded3e08700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdecc09d6f0 0x7fdecc1c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fded3e08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdecc09e1d0 0x7fdecc1c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fded3e08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdecc139170 0x7fdecc120870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fded3e08700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc1241b0 con 0x7fdecc09d6f0 2023-09-30T22:33:24.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fded3e08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc124390 con 0x7fdecc139170 2023-09-30T22:33:24.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fded3e08700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc1be250 con 0x7fdecc09e1d0 2023-09-30T22:33:24.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fded1ba4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdecc09d6f0 0x7fdecc1c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fded1ba4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdecc09d6f0 0x7fdecc1c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53106/0 (socket says 172.21.15.59:53106) 2023-09-30T22:33:24.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fded1ba4700 1 -- 172.21.15.59:0/164653201 learned_addr learned my addr 172.21.15.59:0/164653201 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:24.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fded23a5700 1 --2- 172.21.15.59:0/164653201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdecc139170 0x7fdecc120870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fded1ba4700 1 -- 172.21.15.59:0/164653201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdecc09e1d0 msgr2=0x7fdecc1c8bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:33:24.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fded1ba4700 1 --2- 172.21.15.59:0/164653201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdecc09e1d0 0x7fdecc1c8bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fded1ba4700 1 -- 172.21.15.59:0/164653201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdecc139170 msgr2=0x7fdecc120870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fded1ba4700 1 --2- 172.21.15.59:0/164653201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdecc139170 0x7fdecc120870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fded1ba4700 1 -- 172.21.15.59:0/164653201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4009a70 con 0x7fdecc09d6f0 2023-09-30T22:33:24.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.647+0000 7fded23a5700 1 --2- 172.21.15.59:0/164653201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdecc139170 0x7fdecc120870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:24.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fe4138ea700 1 -- start start 2023-09-30T22:33:24.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fe4138ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe40c09d6f0 0x7fe40c119720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fe4138ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe40c09e000 0x7fe40c119c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fe4138ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe40c09e410 0x7fe40c11a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:24.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fe4138ea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c11cd40 con 0x7fe40c09e410 2023-09-30T22:33:24.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fe4138ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c09c710 con 0x7fe40c09e000 2023-09-30T22:33:24.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fe4138ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c0a2170 con 0x7fe40c09d6f0 2023-09-30T22:33:24.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fe411e87700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe40c09e410 0x7fe40c11a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fe411e87700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe40c09e410 0x7fe40c11a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53112/0 (socket says 172.21.15.59:53112) 2023-09-30T22:33:24.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fe410e85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe40c09e000 0x7fe40c119c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:24.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.646+0000 7fe411e87700 1 -- 172.21.15.59:0/1501641563 learned_addr learned my addr 172.21.15.59:0/1501641563 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:24.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.647+0000 7fded1ba4700 1 --2- 172.21.15.59:0/164653201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdecc09d6f0 0x7fdecc1c86b0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fdec800c550 tx=0x7fdec800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:24.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.647+0000 7fe411e87700 1 -- 172.21.15.59:0/1501641563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe40c09d6f0 msgr2=0x7fe40c119720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.647+0000 7fe411e87700 1 --2- 172.21.15.59:0/1501641563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe40c09d6f0 0x7fe40c119720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.647+0000 7fe411e87700 1 -- 172.21.15.59:0/1501641563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe40c09e000 msgr2=0x7fe40c119c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.647+0000 7fe411e87700 1 --2- 172.21.15.59:0/1501641563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe40c09e000 0x7fe40c119c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.647+0000 7fe411e87700 1 -- 172.21.15.59:0/1501641563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe408009550 con 0x7fe40c09e410 2023-09-30T22:33:24.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.647+0000 7fdec27fc700 1 -- 172.21.15.59:0/164653201 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8005d70 con 0x7fdecc09d6f0 2023-09-30T22:33:24.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.647+0000 7fe411e87700 1 --2- 172.21.15.59:0/1501641563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe40c09e410 0x7fe40c11a1a0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fe40400b9a0 tx=0x7fe40400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:24.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.647+0000 7fdec27fc700 1 -- 172.21.15.59:0/164653201 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec80070d0 con 0x7fdecc09d6f0 2023-09-30T22:33:24.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.647+0000 7fded3e08700 1 -- 172.21.15.59:0/164653201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc0a3020 con 0x7fdecc09d6f0 2023-09-30T22:33:24.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.647+0000 7fdec27fc700 1 -- 172.21.15.59:0/164653201 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8007440 con 0x7fdecc09d6f0 2023-09-30T22:33:24.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.647+0000 7fded3e08700 1 -- 172.21.15.59:0/164653201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc1c9130 con 0x7fdecc09d6f0 2023-09-30T22:33:24.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.648+0000 7fe401ffb700 1 -- 172.21.15.59:0/1501641563 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40400c930 con 0x7fe40c09e410 2023-09-30T22:33:24.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.648+0000 7fe401ffb700 1 -- 172.21.15.59:0/1501641563 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40400cab0 con 0x7fe40c09e410 2023-09-30T22:33:24.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.648+0000 7fe401ffb700 1 -- 172.21.15.59:0/1501641563 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40400ce60 con 0x7fe40c09e410 2023-09-30T22:33:24.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.648+0000 7fded3e08700 1 -- 172.21.15.59:0/164653201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb40052e0 con 0x7fdecc09d6f0 2023-09-30T22:33:24.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.649+0000 7fdec27fc700 1 -- 172.21.15.59:0/164653201 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdec80075a0 con 0x7fdecc09d6f0 2023-09-30T22:33:24.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.649+0000 7fe4138ea700 1 -- 172.21.15.59:0/1501641563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40c11c710 con 0x7fe40c09e410 2023-09-30T22:33:24.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.649+0000 7fdec27fc700 1 -- 172.21.15.59:0/164653201 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdec803eb00 con 0x7fdecc09d6f0 2023-09-30T22:33:24.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.649+0000 7fe4138ea700 1 -- 172.21.15.59:0/1501641563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40c11a6e0 con 0x7fe40c09e410 2023-09-30T22:33:24.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.650+0000 7fe4138ea700 1 -- 172.21.15.59:0/1501641563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe40c074ea0 con 0x7fe40c09e410 2023-09-30T22:33:24.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.658+0000 7fdec27fc700 1 -- 172.21.15.59:0/164653201 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdec8019b40 con 0x7fdecc09d6f0 2023-09-30T22:33:24.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.658+0000 7fe401ffb700 1 -- 172.21.15.59:0/1501641563 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe40401d3b0 con 0x7fe40c09e410 2023-09-30T22:33:24.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.658+0000 7fe401ffb700 1 -- 172.21.15.59:0/1501641563 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe404006e40 con 0x7fe40c09e410 2023-09-30T22:33:24.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.667+0000 7fe401ffb700 1 -- 172.21.15.59:0/1501641563 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe404007370 con 0x7fe40c09e410 2023-09-30T22:33:24.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.704+0000 7f2fb50ec700 1 -- 172.21.15.59:0/3715763236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2fb00a0280 con 0x7f2fb0134170 2023-09-30T22:33:24.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.704+0000 7f8fc4afd700 1 -- 172.21.15.59:0/942469598 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8fc0074ea0 con 0x7f8fc009d6f0 2023-09-30T22:33:24.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.704+0000 7f2fa7fff700 1 -- 172.21.15.59:0/3715763236 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2fa8007330 con 0x7f2fb0134170 2023-09-30T22:33:24.705 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:24.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.704+0000 7f8faeffd700 1 -- 172.21.15.59:0/942469598 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8fb0011af0 con 0x7f8fc009d6f0 2023-09-30T22:33:24.706 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:24.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.707+0000 7f8fc4afd700 1 -- 172.21.15.59:0/942469598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc009d6f0 msgr2=0x7f8fc0122580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.707+0000 7f8fc4afd700 1 --2- 172.21.15.59:0/942469598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc009d6f0 0x7f8fc0122580 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000e9b0 tx=0x7f8fb000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.707+0000 7f8fc4afd700 1 -- 172.21.15.59:0/942469598 shutdown_connections 2023-09-30T22:33:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.707+0000 7f8fc4afd700 1 --2- 172.21.15.59:0/942469598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc009e410 0x7f8fc0123000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.707+0000 7f8fc4afd700 1 --2- 172.21.15.59:0/942469598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc009d6f0 0x7f8fc0122580 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.707+0000 7f8fc4afd700 1 --2- 172.21.15.59:0/942469598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fc009e000 0x7f8fc0122ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.707+0000 7f8fc4afd700 1 -- 172.21.15.59:0/942469598 >> 172.21.15.59:0/942469598 conn(0x7f8fc0066f50 msgr2=0x7f8fc0070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.707+0000 7f8fc4afd700 1 -- 172.21.15.59:0/942469598 shutdown_connections 2023-09-30T22:33:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.707+0000 7f8fc4afd700 1 -- 172.21.15.59:0/942469598 wait complete. 2023-09-30T22:33:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.707+0000 7f2fb50ec700 1 -- 172.21.15.59:0/3715763236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fb0134170 msgr2=0x7f2fb0123210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.707+0000 7f2fb50ec700 1 --2- 172.21.15.59:0/3715763236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fb0134170 0x7f2fb0123210 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800efc0 tx=0x7f2fa800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.708+0000 7f2fb50ec700 1 -- 172.21.15.59:0/3715763236 shutdown_connections 2023-09-30T22:33:24.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.708+0000 7f2fb50ec700 1 --2- 172.21.15.59:0/3715763236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fb0134170 0x7f2fb0123210 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.708+0000 7f2fb50ec700 1 --2- 172.21.15.59:0/3715763236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a0a30 0x7f2fb0122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.708+0000 7f2fb50ec700 1 --2- 172.21.15.59:0/3715763236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fb00a1340 0x7f2fb0122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.708+0000 7f2fb50ec700 1 -- 172.21.15.59:0/3715763236 >> 172.21.15.59:0/3715763236 conn(0x7f2fb00a6550 msgr2=0x7f2fb009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:24.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.708+0000 7f2fb50ec700 1 -- 172.21.15.59:0/3715763236 shutdown_connections 2023-09-30T22:33:24.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.708+0000 7f2fb50ec700 1 -- 172.21.15.59:0/3715763236 wait complete. 2023-09-30T22:33:24.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:24.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:24.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.872+0000 7fded3e08700 1 -- 172.21.15.59:0/164653201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdeb4005590 con 0x7fdecc09d6f0 2023-09-30T22:33:24.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.873+0000 7fe4138ea700 1 -- 172.21.15.59:0/1501641563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe40c06c360 con 0x7fe40c09e410 2023-09-30T22:33:24.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.873+0000 7fdec27fc700 1 -- 172.21.15.59:0/164653201 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdec8017020 con 0x7fdecc09d6f0 2023-09-30T22:33:24.873 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:24.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.873+0000 7fe401ffb700 1 -- 172.21.15.59:0/1501641563 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe404019030 con 0x7fe40c09e410 2023-09-30T22:33:24.874 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:24.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.875+0000 7fded3e08700 1 -- 172.21.15.59:0/164653201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdecc09d6f0 msgr2=0x7fdecc1c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.875+0000 7fded3e08700 1 --2- 172.21.15.59:0/164653201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdecc09d6f0 0x7fdecc1c86b0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fdec800c550 tx=0x7fdec800c860 comp rx=0 tx=0).stop 2023-09-30T22:33:24.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.875+0000 7fded3e08700 1 -- 172.21.15.59:0/164653201 shutdown_connections 2023-09-30T22:33:24.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.875+0000 7fded3e08700 1 --2- 172.21.15.59:0/164653201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdecc139170 0x7fdecc120870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.875+0000 7fded3e08700 1 --2- 172.21.15.59:0/164653201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdecc09d6f0 0x7fdecc1c86b0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.875+0000 7fded3e08700 1 --2- 172.21.15.59:0/164653201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdecc09e1d0 0x7fdecc1c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.875+0000 7fded3e08700 1 -- 172.21.15.59:0/164653201 >> 172.21.15.59:0/164653201 conn(0x7fdecc066f50 msgr2=0x7fdecc136a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:24.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.875+0000 7fded3e08700 1 -- 172.21.15.59:0/164653201 shutdown_connections 2023-09-30T22:33:24.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.875+0000 7fded3e08700 1 -- 172.21.15.59:0/164653201 wait complete. 2023-09-30T22:33:24.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.875+0000 7fe4138ea700 1 -- 172.21.15.59:0/1501641563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe40c09e410 msgr2=0x7fe40c11a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:24.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.875+0000 7fe4138ea700 1 --2- 172.21.15.59:0/1501641563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe40c09e410 0x7fe40c11a1a0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fe40400b9a0 tx=0x7fe40400bcb0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.876+0000 7fe4138ea700 1 -- 172.21.15.59:0/1501641563 shutdown_connections 2023-09-30T22:33:24.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.876+0000 7fe4138ea700 1 --2- 172.21.15.59:0/1501641563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe40c09d6f0 0x7fe40c119720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.876+0000 7fe4138ea700 1 --2- 172.21.15.59:0/1501641563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe40c09e410 0x7fe40c11a1a0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.876+0000 7fe4138ea700 1 --2- 172.21.15.59:0/1501641563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe40c09e000 0x7fe40c119c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:24.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.876+0000 7fe4138ea700 1 -- 172.21.15.59:0/1501641563 >> 172.21.15.59:0/1501641563 conn(0x7fe40c066f50 msgr2=0x7fe40c1bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:24.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.876+0000 7fe4138ea700 1 -- 172.21.15.59:0/1501641563 shutdown_connections 2023-09-30T22:33:24.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:24.876+0000 7fe4138ea700 1 -- 172.21.15.59:0/1501641563 wait complete. 2023-09-30T22:33:24.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:24.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:25.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:25.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:25.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.872+0000 7f999ed62700 1 Processor -- start 2023-09-30T22:33:25.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.872+0000 7f999ed62700 1 -- start start 2023-09-30T22:33:25.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.873+0000 7f999ed62700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f99980a0a30 0x7f99980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:25.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.873+0000 7f999ed62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9998134170 0x7f999813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:25.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.873+0000 7f999ed62700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f999809edd0 con 0x7f99980a1340 2023-09-30T22:33:25.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.873+0000 7f999ed62700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999809e1f0 con 0x7f99980a0a30 2023-09-30T22:33:25.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.873+0000 7f999ed62700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999809dc50 con 0x7f9998134170 2023-09-30T22:33:25.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.873+0000 7f999d2ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9998134170 0x7f999813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:25.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.873+0000 7f999d2ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9998134170 0x7f999813bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57918/0 (socket says 172.21.15.59:57918) 2023-09-30T22:33:25.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.873+0000 7f999cafe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f99980a0a30 0x7f99980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.873+0000 7f999d2ff700 1 -- 172.21.15.59:0/3111075839 learned_addr learned my addr 172.21.15.59:0/3111075839 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.874+0000 7f999d2ff700 1 -- 172.21.15.59:0/3111075839 >> v2:172.21.15.59:3300/0 conn(0x7f99980a0a30 msgr2=0x7f99980a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.874+0000 7f999d2ff700 1 --2- 172.21.15.59:0/3111075839 >> v2:172.21.15.59:3300/0 conn(0x7f99980a0a30 0x7f99980a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.874+0000 7f999d2ff700 1 -- 172.21.15.59:0/3111075839 >> v1:172.21.15.59:6789/0 conn(0x7f99980a1340 legacy=0x7f9998133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.874+0000 7f999d2ff700 1 -- 172.21.15.59:0/3111075839 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99980a1fe0 con 0x7f9998134170 2023-09-30T22:33:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.874+0000 7f999cafe700 1 --2- 172.21.15.59:0/3111075839 >> v2:172.21.15.59:3300/0 conn(0x7f99980a0a30 0x7f99980a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.874+0000 7f999d2ff700 1 --2- 172.21.15.59:0/3111075839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9998134170 0x7f999813bd30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f99880098f0 tx=0x7f9988009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=370b6507bdff0813 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.874+0000 7f99977fe700 1 -- 172.21.15.59:0/3111075839 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9988011830 con 0x7f9998134170 2023-09-30T22:33:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.874+0000 7f99977fe700 1 -- 172.21.15.59:0/3111075839 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9988011990 con 0x7f9998134170 2023-09-30T22:33:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.874+0000 7f99977fe700 1 -- 172.21.15.59:0/3111075839 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9988011d20 con 0x7f9998134170 2023-09-30T22:33:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.875+0000 7f999ed62700 1 -- 172.21.15.59:0/3111075839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9998134170 msgr2=0x7f999813bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.875+0000 7f999ed62700 1 --2- 172.21.15.59:0/3111075839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9998134170 0x7f999813bd30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f99880098f0 tx=0x7f9988009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:25.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.875+0000 7f999ed62700 1 -- 172.21.15.59:0/3111075839 shutdown_connections 2023-09-30T22:33:25.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.875+0000 7f999ed62700 1 --2- 172.21.15.59:0/3111075839 >> v2:172.21.15.59:3300/0 conn(0x7f99980a0a30 0x7f99980a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:25.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.875+0000 7f999ed62700 1 --2- 172.21.15.59:0/3111075839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9998134170 0x7f999813bd30 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:25.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.875+0000 7f999ed62700 1 -- 172.21.15.59:0/3111075839 >> 172.21.15.59:0/3111075839 conn(0x7f99980a6550 msgr2=0x7f99980a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:25.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.875+0000 7f999ed62700 1 -- 172.21.15.59:0/3111075839 shutdown_connections 2023-09-30T22:33:25.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.875+0000 7f999ed62700 1 -- 172.21.15.59:0/3111075839 wait complete. 2023-09-30T22:33:25.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.876+0000 7f999ed62700 1 Processor -- start 2023-09-30T22:33:25.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.876+0000 7f999ed62700 1 -- start start 2023-09-30T22:33:25.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.876+0000 7f999ed62700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99980a0a30 0x7f999811e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:25.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f999ed62700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99980a1340 0x7f999811ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:25.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f999ed62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9998134170 0x7f999811f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f999ed62700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999811fbe0 con 0x7f99980a1340 2023-09-30T22:33:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f999ed62700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99981221a0 con 0x7f9998134170 2023-09-30T22:33:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f999ed62700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9998120290 con 0x7f99980a0a30 2023-09-30T22:33:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f9997fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99980a1340 0x7f999811ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f999d2ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9998134170 0x7f999811f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f999d2ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9998134170 0x7f999811f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57928/0 (socket says 172.21.15.59:57928) 2023-09-30T22:33:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f999d2ff700 1 -- 172.21.15.59:0/3031261367 learned_addr learned my addr 172.21.15.59:0/3031261367 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f9997fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99980a1340 0x7f999811ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53120/0 (socket says 172.21.15.59:53120) 2023-09-30T22:33:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f999cafe700 1 --2- 172.21.15.59:0/3031261367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99980a0a30 0x7f999811e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f999d2ff700 1 -- 172.21.15.59:0/3031261367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99980a0a30 msgr2=0x7f999811e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f999d2ff700 1 --2- 172.21.15.59:0/3031261367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99980a0a30 0x7f999811e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f999d2ff700 1 -- 172.21.15.59:0/3031261367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99980a1340 msgr2=0x7f999811ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f999d2ff700 1 --2- 172.21.15.59:0/3031261367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99980a1340 0x7f999811ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f999d2ff700 1 -- 172.21.15.59:0/3031261367 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9990009a70 con 0x7f9998134170 2023-09-30T22:33:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f9997fff700 1 --2- 172.21.15.59:0/3031261367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99980a1340 0x7f999811ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f999d2ff700 1 --2- 172.21.15.59:0/3031261367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9998134170 0x7f999811f190 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f999809dd90 tx=0x7f9988004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.877+0000 7f99957fa700 1 -- 172.21.15.59:0/3031261367 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9988004510 con 0x7f9998134170 2023-09-30T22:33:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.878+0000 7f99957fa700 1 -- 172.21.15.59:0/3031261367 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99880036a0 con 0x7f9998134170 2023-09-30T22:33:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.878+0000 7f99957fa700 1 -- 172.21.15.59:0/3031261367 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9988003a50 con 0x7f9998134170 2023-09-30T22:33:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.878+0000 7f999ed62700 1 -- 172.21.15.59:0/3031261367 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9988009550 con 0x7f9998134170 2023-09-30T22:33:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.878+0000 7f999ed62700 1 -- 172.21.15.59:0/3031261367 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99980a25e0 con 0x7f9998134170 2023-09-30T22:33:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.879+0000 7f99957fa700 1 -- 172.21.15.59:0/3031261367 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9988003bb0 con 0x7f9998134170 2023-09-30T22:33:25.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.879+0000 7f999ed62700 1 -- 172.21.15.59:0/3031261367 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9998074ea0 con 0x7f9998134170 2023-09-30T22:33:25.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.879+0000 7f99957fa700 1 -- 172.21.15.59:0/3031261367 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f99880407b0 con 0x7f9998134170 2023-09-30T22:33:25.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.884+0000 7f99957fa700 1 -- 172.21.15.59:0/3031261367 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f998801a420 con 0x7f9998134170 2023-09-30T22:33:25.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:25.892 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:25.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.913+0000 7f65f0b42700 1 Processor -- start 2023-09-30T22:33:25.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.913+0000 7f65f0b42700 1 -- start start 2023-09-30T22:33:25.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.914+0000 7f65f0b42700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65ec09de00 0x7f65ec09e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:25.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.914+0000 7f65f0b42700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f65ec13d1f0 0x7f65ec13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:25.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.914+0000 7f65f0b42700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ec09a810 con 0x7f65ec06a770 2023-09-30T22:33:25.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.914+0000 7f65f0b42700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ec06ab40 con 0x7f65ec13d1f0 2023-09-30T22:33:25.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.914+0000 7f65f0b42700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec09ebc0 con 0x7f65ec09de00 2023-09-30T22:33:25.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.914+0000 7f65e9d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65ec09de00 0x7f65ec09e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:25.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.914+0000 7f65ead9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f65ec13d1f0 0x7f65ec13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.914+0000 7f65ead9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f65ec13d1f0 0x7f65ec13f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53130/0 (socket says 172.21.15.59:53130) 2023-09-30T22:33:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.914+0000 7f65ead9d700 1 -- 172.21.15.59:0/2721056961 learned_addr learned my addr 172.21.15.59:0/2721056961 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.914+0000 7f65e9d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65ec09de00 0x7f65ec09e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57930/0 (socket says 172.21.15.59:57930) 2023-09-30T22:33:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.914+0000 7f65e9d9b700 1 -- 172.21.15.59:0/2721056961 >> v2:172.21.15.59:3300/0 conn(0x7f65ec13d1f0 msgr2=0x7f65ec13f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.914+0000 7f65e9d9b700 1 --2- 172.21.15.59:0/2721056961 >> v2:172.21.15.59:3300/0 conn(0x7f65ec13d1f0 0x7f65ec13f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.914+0000 7f65e9d9b700 1 -- 172.21.15.59:0/2721056961 >> v1:172.21.15.59:6789/0 conn(0x7f65ec06a770 legacy=0x7f65ec09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.914+0000 7f65e959a700 1 -- 172.21.15.59:0/2721056961 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479260741 0 0) 0x7f65ec09a810 con 0x7f65ec06a770 2023-09-30T22:33:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.915+0000 7f65e9d9b700 1 -- 172.21.15.59:0/2721056961 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec09e920 con 0x7f65ec09de00 2023-09-30T22:33:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.915+0000 7f65ead9d700 1 --2- 172.21.15.59:0/2721056961 >> v2:172.21.15.59:3300/0 conn(0x7f65ec13d1f0 0x7f65ec13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.915+0000 7f65e9d9b700 1 --2- 172.21.15.59:0/2721056961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65ec09de00 0x7f65ec09e250 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009840 tx=0x7f65e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79a9cd8c0f45d382 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.915+0000 7f65e959a700 1 -- 172.21.15.59:0/2721056961 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0011830 con 0x7f65ec09de00 2023-09-30T22:33:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.915+0000 7f65e959a700 1 -- 172.21.15.59:0/2721056961 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e0011990 con 0x7f65ec09de00 2023-09-30T22:33:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.915+0000 7f65e959a700 1 -- 172.21.15.59:0/2721056961 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0011d20 con 0x7f65ec09de00 2023-09-30T22:33:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.916+0000 7f65f0b42700 1 -- 172.21.15.59:0/2721056961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65ec09de00 msgr2=0x7f65ec09e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.916+0000 7f65f0b42700 1 --2- 172.21.15.59:0/2721056961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65ec09de00 0x7f65ec09e250 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009840 tx=0x7f65e0009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.916+0000 7f65f0b42700 1 -- 172.21.15.59:0/2721056961 shutdown_connections 2023-09-30T22:33:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.916+0000 7f65f0b42700 1 --2- 172.21.15.59:0/2721056961 >> v2:172.21.15.59:3300/0 conn(0x7f65ec13d1f0 0x7f65ec13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.916+0000 7f65f0b42700 1 --2- 172.21.15.59:0/2721056961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65ec09de00 0x7f65ec09e250 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.916+0000 7f65f0b42700 1 -- 172.21.15.59:0/2721056961 >> 172.21.15.59:0/2721056961 conn(0x7f65ec066f50 msgr2=0x7f65ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.916+0000 7f65f0b42700 1 -- 172.21.15.59:0/2721056961 shutdown_connections 2023-09-30T22:33:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.916+0000 7f65f0b42700 1 -- 172.21.15.59:0/2721056961 wait complete. 2023-09-30T22:33:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.918+0000 7f65f0b42700 1 Processor -- start 2023-09-30T22:33:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.918+0000 7f65f0b42700 1 -- start start 2023-09-30T22:33:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.919+0000 7f65f0b42700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65ec06a770 0x7f65ec11c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.919+0000 7f65f0b42700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65ec09de00 0x7f65ec13b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.919+0000 7f65f0b42700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65ec13d1f0 0x7f65ec13bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.919+0000 7f65f0b42700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec13ccf0 con 0x7f65ec13d1f0 2023-09-30T22:33:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.919+0000 7f65f0b42700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec13f650 con 0x7f65ec06a770 2023-09-30T22:33:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.919+0000 7f65f0b42700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec135ce0 con 0x7f65ec09de00 2023-09-30T22:33:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.919+0000 7f65ea59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65ec06a770 0x7f65ec11c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.919+0000 7f65ea59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65ec06a770 0x7f65ec11c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57940/0 (socket says 172.21.15.59:57940) 2023-09-30T22:33:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.919+0000 7f65ea59c700 1 -- 172.21.15.59:0/844740894 learned_addr learned my addr 172.21.15.59:0/844740894 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.919+0000 7f65ead9d700 1 --2- 172.21.15.59:0/844740894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65ec13d1f0 0x7f65ec13bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.920+0000 7f65ea59c700 1 -- 172.21.15.59:0/844740894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65ec09de00 msgr2=0x7f65ec13b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.920+0000 7f65ea59c700 1 --2- 172.21.15.59:0/844740894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65ec09de00 0x7f65ec13b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:25.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.920+0000 7f65ea59c700 1 -- 172.21.15.59:0/844740894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65ec13d1f0 msgr2=0x7f65ec13bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:25.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.920+0000 7f65ea59c700 1 --2- 172.21.15.59:0/844740894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65ec13d1f0 0x7f65ec13bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:25.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.920+0000 7f65ea59c700 1 -- 172.21.15.59:0/844740894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e00094a0 con 0x7f65ec06a770 2023-09-30T22:33:25.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.920+0000 7f65ea59c700 1 --2- 172.21.15.59:0/844740894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65ec06a770 0x7f65ec11c3e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f65dc001eb0 tx=0x7f65dc00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:25.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.920+0000 7f65daffd700 1 -- 172.21.15.59:0/844740894 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0054e0 con 0x7f65ec06a770 2023-09-30T22:33:25.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.920+0000 7f65daffd700 1 -- 172.21.15.59:0/844740894 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc003680 con 0x7f65ec06a770 2023-09-30T22:33:25.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.920+0000 7f65f0b42700 1 -- 172.21.15.59:0/844740894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ec11e970 con 0x7f65ec06a770 2023-09-30T22:33:25.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.920+0000 7f65daffd700 1 -- 172.21.15.59:0/844740894 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0039f0 con 0x7f65ec06a770 2023-09-30T22:33:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.920+0000 7f65f0b42700 1 -- 172.21.15.59:0/844740894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ec11e250 con 0x7f65ec06a770 2023-09-30T22:33:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.921+0000 7f65daffd700 1 -- 172.21.15.59:0/844740894 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65dc003b50 con 0x7f65ec06a770 2023-09-30T22:33:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.921+0000 7f65daffd700 1 -- 172.21.15.59:0/844740894 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f65dc03eb60 con 0x7f65ec06a770 2023-09-30T22:33:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.921+0000 7f65f0b42700 1 -- 172.21.15.59:0/844740894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ec11d090 con 0x7f65ec06a770 2023-09-30T22:33:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:25.927+0000 7f65daffd700 1 -- 172.21.15.59:0/844740894 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65dc01b3b0 con 0x7f65ec06a770 2023-09-30T22:33:26.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.053+0000 7ff6cc2c6700 1 Processor -- start 2023-09-30T22:33:26.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.053+0000 7ff6cc2c6700 1 -- start start 2023-09-30T22:33:26.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.053+0000 7f12d639f700 1 Processor -- start 2023-09-30T22:33:26.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.053+0000 7f12d639f700 1 -- start start 2023-09-30T22:33:26.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.053+0000 7ff6cc2c6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6c406b250 0x7ff6c4136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:26.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.053+0000 7ff6cc2c6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6c4136d80 0x7ff6c4139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:26.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.053+0000 7f12d639f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12d009e3b0 0x7f12d01356a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:26.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.053+0000 7f12d639f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12d0135be0 0x7f12d0137fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:26.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.053+0000 7f12d639f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d009b6e0 con 0x7f12d009d8d0 2023-09-30T22:33:26.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.053+0000 7f12d639f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d009b470 con 0x7f12d0135be0 2023-09-30T22:33:26.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.053+0000 7f12d639f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12d009eb80 con 0x7f12d009e3b0 2023-09-30T22:33:26.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.053+0000 7ff6cc2c6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c409ece0 con 0x7ff6c406a770 2023-09-30T22:33:26.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.053+0000 7ff6cc2c6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c406b640 con 0x7ff6c4136d80 2023-09-30T22:33:26.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.053+0000 7ff6cc2c6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c409e760 con 0x7ff6c406b250 2023-09-30T22:33:26.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7f12d5b9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12d0135be0 0x7f12d0137fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:26.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7f12d4b9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12d009e3b0 0x7f12d01356a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:26.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7f12d5b9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12d0135be0 0x7f12d0137fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57944/0 (socket says 172.21.15.59:57944) 2023-09-30T22:33:26.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7f12d539d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f12d009d8d0 0x7f12d009dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34906/0 (socket says 172.21.15.59:34906) 2023-09-30T22:33:26.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7f12d5b9e700 1 -- 172.21.15.59:0/2867021229 learned_addr learned my addr 172.21.15.59:0/2867021229 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:26.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7ff6ca062700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff6c406a770 0x7ff6c406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34894/0 (socket says 172.21.15.59:34894) 2023-09-30T22:33:26.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7ff6ca062700 1 -- 172.21.15.59:0/507337039 learned_addr learned my addr 172.21.15.59:0/507337039 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7ff6ca863700 1 --2- 172.21.15.59:0/507337039 >> v2:172.21.15.59:3300/0 conn(0x7ff6c4136d80 0x7ff6c4139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7ff6c9861700 1 --2- 172.21.15.59:0/507337039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6c406b250 0x7ff6c4136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7f12d5b9e700 1 -- 172.21.15.59:0/2867021229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12d009e3b0 msgr2=0x7f12d01356a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7f12d5b9e700 1 --2- 172.21.15.59:0/2867021229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12d009e3b0 0x7f12d01356a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7f12d5b9e700 1 -- 172.21.15.59:0/2867021229 >> v1:172.21.15.59:6789/0 conn(0x7f12d009d8d0 legacy=0x7f12d009dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7f12d5b9e700 1 -- 172.21.15.59:0/2867021229 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d009ae00 con 0x7f12d0135be0 2023-09-30T22:33:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7ff6c9060700 1 -- 172.21.15.59:0/507337039 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076128146 0 0) 0x7ff6c409ece0 con 0x7ff6c406a770 2023-09-30T22:33:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7ff6c9861700 1 -- 172.21.15.59:0/507337039 >> v2:172.21.15.59:3300/0 conn(0x7ff6c4136d80 msgr2=0x7ff6c4139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7ff6c9861700 1 --2- 172.21.15.59:0/507337039 >> v2:172.21.15.59:3300/0 conn(0x7ff6c4136d80 0x7ff6c4139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7ff6c9861700 1 -- 172.21.15.59:0/507337039 >> v1:172.21.15.59:6789/0 conn(0x7ff6c406a770 legacy=0x7ff6c406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7ff6c9861700 1 -- 172.21.15.59:0/507337039 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c409e040 con 0x7ff6c406b250 2023-09-30T22:33:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.054+0000 7f12d5b9e700 1 --2- 172.21.15.59:0/2867021229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12d0135be0 0x7f12d0137fc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009e80 tx=0x7f12c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44cbff9d46c6878c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.055+0000 7ff6c9861700 1 --2- 172.21.15.59:0/507337039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6c406b250 0x7ff6c4136840 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009840 tx=0x7ff6b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84be99dc67d6614c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:26.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.055+0000 7f12c3fff700 1 -- 172.21.15.59:0/2867021229 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c800e070 con 0x7f12d0135be0 2023-09-30T22:33:26.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.055+0000 7f12c3fff700 1 -- 172.21.15.59:0/2867021229 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c800b9c0 con 0x7f12d0135be0 2023-09-30T22:33:26.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.055+0000 7f12c3fff700 1 -- 172.21.15.59:0/2867021229 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c800bd50 con 0x7f12d0135be0 2023-09-30T22:33:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.055+0000 7ff6c9060700 1 -- 172.21.15.59:0/507337039 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4011830 con 0x7ff6c406b250 2023-09-30T22:33:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.055+0000 7ff6c9060700 1 -- 172.21.15.59:0/507337039 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b4011990 con 0x7ff6c406b250 2023-09-30T22:33:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.055+0000 7ff6c9060700 1 -- 172.21.15.59:0/507337039 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4011d20 con 0x7ff6c406b250 2023-09-30T22:33:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7f12d639f700 1 -- 172.21.15.59:0/2867021229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12d0135be0 msgr2=0x7f12d0137fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7f12d639f700 1 --2- 172.21.15.59:0/2867021229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12d0135be0 0x7f12d0137fc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009e80 tx=0x7f12c800b330 comp rx=0 tx=0).stop 2023-09-30T22:33:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7f12d639f700 1 -- 172.21.15.59:0/2867021229 shutdown_connections 2023-09-30T22:33:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7f12d639f700 1 --2- 172.21.15.59:0/2867021229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12d0135be0 0x7f12d0137fc0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7f12d639f700 1 --2- 172.21.15.59:0/2867021229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12d009e3b0 0x7f12d01356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7f12d639f700 1 -- 172.21.15.59:0/2867021229 >> 172.21.15.59:0/2867021229 conn(0x7f12d00a2e20 msgr2=0x7f12d00a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7ff6cc2c6700 1 -- 172.21.15.59:0/507337039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6c406b250 msgr2=0x7ff6c4136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7ff6cc2c6700 1 --2- 172.21.15.59:0/507337039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6c406b250 0x7ff6c4136840 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009840 tx=0x7ff6b4009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7ff6cc2c6700 1 -- 172.21.15.59:0/507337039 shutdown_connections 2023-09-30T22:33:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7ff6cc2c6700 1 --2- 172.21.15.59:0/507337039 >> v2:172.21.15.59:3300/0 conn(0x7ff6c4136d80 0x7ff6c4139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7ff6cc2c6700 1 --2- 172.21.15.59:0/507337039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6c406b250 0x7ff6c4136840 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7ff6cc2c6700 1 -- 172.21.15.59:0/507337039 >> 172.21.15.59:0/507337039 conn(0x7ff6c4066f50 msgr2=0x7ff6c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7f12d639f700 1 -- 172.21.15.59:0/2867021229 shutdown_connections 2023-09-30T22:33:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7f12d639f700 1 -- 172.21.15.59:0/2867021229 wait complete. 2023-09-30T22:33:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7ff6cc2c6700 1 -- 172.21.15.59:0/507337039 shutdown_connections 2023-09-30T22:33:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.056+0000 7ff6cc2c6700 1 -- 172.21.15.59:0/507337039 wait complete. 2023-09-30T22:33:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.057+0000 7ff6cc2c6700 1 Processor -- start 2023-09-30T22:33:26.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.057+0000 7f12d639f700 1 Processor -- start 2023-09-30T22:33:26.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.057+0000 7ff6cc2c6700 1 -- start start 2023-09-30T22:33:26.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.057+0000 7f12d639f700 1 -- start start 2023-09-30T22:33:26.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7ff6cc2c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6c406a770 0x7ff6c41200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:26.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7ff6cc2c6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6c406b250 0x7ff6c411e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:26.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7ff6cc2c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6c4136d80 0x7ff6c411ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:26.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7ff6cc2c6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c409be60 con 0x7ff6c4136d80 2023-09-30T22:33:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7ff6cc2c6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c41205e0 con 0x7ff6c406a770 2023-09-30T22:33:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7ff6cc2c6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c411d670 con 0x7ff6c406b250 2023-09-30T22:33:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7ff6ca863700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6c4136d80 0x7ff6c411ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7ff6ca863700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6c4136d80 0x7ff6c411ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53168/0 (socket says 172.21.15.59:53168) 2023-09-30T22:33:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7ff6ca863700 1 -- 172.21.15.59:0/3960948432 learned_addr learned my addr 172.21.15.59:0/3960948432 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:26.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7f12d639f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12d009d8d0 0x7f12d0125f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:26.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7f12d639f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12d009e3b0 0x7f12d0126450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:26.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7f12d639f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12d0135be0 0x7f12d0126990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:26.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7f12d639f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d00a1ae0 con 0x7f12d009e3b0 2023-09-30T22:33:26.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7f12d639f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d0128f80 con 0x7f12d0135be0 2023-09-30T22:33:26.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7f12d639f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12d009c600 con 0x7f12d009d8d0 2023-09-30T22:33:26.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7f12d539d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12d009d8d0 0x7f12d0125f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:26.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7f12d539d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12d009d8d0 0x7f12d0125f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36822/0 (socket says 172.21.15.59:36822) 2023-09-30T22:33:26.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7f12d539d700 1 -- 172.21.15.59:0/406535597 learned_addr learned my addr 172.21.15.59:0/406535597 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:26.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7f12d5b9e700 1 --2- 172.21.15.59:0/406535597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12d0135be0 0x7f12d0126990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:26.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7ff6c9861700 1 --2- 172.21.15.59:0/3960948432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6c406b250 0x7ff6c411e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:26.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.058+0000 7ff6ca062700 1 --2- 172.21.15.59:0/3960948432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6c406a770 0x7ff6c41200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:26.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7ff6ca863700 1 -- 172.21.15.59:0/3960948432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6c406b250 msgr2=0x7ff6c411e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:26.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7ff6ca863700 1 --2- 172.21.15.59:0/3960948432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6c406b250 0x7ff6c411e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7ff6ca863700 1 -- 172.21.15.59:0/3960948432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6c406a770 msgr2=0x7ff6c41200a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:26.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7ff6ca863700 1 --2- 172.21.15.59:0/3960948432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6c406a770 0x7ff6c41200a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7ff6ca863700 1 -- 172.21.15.59:0/3960948432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40094a0 con 0x7ff6c4136d80 2023-09-30T22:33:26.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7ff6ca863700 1 --2- 172.21.15.59:0/3960948432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6c4136d80 0x7ff6c411ed30 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc007e30 tx=0x7ff6bc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:26.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7f12d5b9e700 1 -- 172.21.15.59:0/406535597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12d009d8d0 msgr2=0x7f12d0125f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:26.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7f12d5b9e700 1 --2- 172.21.15.59:0/406535597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12d009d8d0 0x7f12d0125f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7f12d5b9e700 1 -- 172.21.15.59:0/406535597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12d009e3b0 msgr2=0x7f12d0126450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:33:26.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7f12d5b9e700 1 --2- 172.21.15.59:0/406535597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12d009e3b0 0x7f12d0126450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7f12d5b9e700 1 -- 172.21.15.59:0/406535597 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c8009b30 con 0x7f12d0135be0 2023-09-30T22:33:26.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7f12d5b9e700 1 --2- 172.21.15.59:0/406535597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12d0135be0 0x7f12d0126990 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f12c8015000 tx=0x7f12c8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:26.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7f12c1ffb700 1 -- 172.21.15.59:0/406535597 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8004450 con 0x7f12d0135be0 2023-09-30T22:33:26.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7f12c1ffb700 1 -- 172.21.15.59:0/406535597 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c80045f0 con 0x7f12d0135be0 2023-09-30T22:33:26.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7f12c1ffb700 1 -- 172.21.15.59:0/406535597 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8007160 con 0x7f12d0135be0 2023-09-30T22:33:26.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.060+0000 7ff6baffd700 1 -- 172.21.15.59:0/3960948432 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc00eea0 con 0x7ff6c4136d80 2023-09-30T22:33:26.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.060+0000 7ff6baffd700 1 -- 172.21.15.59:0/3960948432 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc014420 con 0x7ff6c4136d80 2023-09-30T22:33:26.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.060+0000 7ff6baffd700 1 -- 172.21.15.59:0/3960948432 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0147d0 con 0x7ff6c4136d80 2023-09-30T22:33:26.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.060+0000 7ff6cc2c6700 1 -- 172.21.15.59:0/3960948432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c411dc10 con 0x7ff6c4136d80 2023-09-30T22:33:26.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.059+0000 7f12d639f700 1 -- 172.21.15.59:0/406535597 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d01280a0 con 0x7f12d0135be0 2023-09-30T22:33:26.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.060+0000 7f12d639f700 1 -- 172.21.15.59:0/406535597 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d0128770 con 0x7f12d0135be0 2023-09-30T22:33:26.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.061+0000 7ff6cc2c6700 1 -- 172.21.15.59:0/3960948432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c406ec40 con 0x7ff6c4136d80 2023-09-30T22:33:26.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.061+0000 7f12c1ffb700 1 -- 172.21.15.59:0/406535597 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12c8025460 con 0x7f12d0135be0 2023-09-30T22:33:26.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.061+0000 7f12d639f700 1 -- 172.21.15.59:0/406535597 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d01285a0 con 0x7f12d0135be0 2023-09-30T22:33:26.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.061+0000 7f12c1ffb700 1 -- 172.21.15.59:0/406535597 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f12c801bcf0 con 0x7f12d0135be0 2023-09-30T22:33:26.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.062+0000 7ff6cc2c6700 1 -- 172.21.15.59:0/3960948432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c4074ea0 con 0x7ff6c4136d80 2023-09-30T22:33:26.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.063+0000 7ff6baffd700 1 -- 172.21.15.59:0/3960948432 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff6bc014930 con 0x7ff6c4136d80 2023-09-30T22:33:26.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.064+0000 7ff6baffd700 1 -- 172.21.15.59:0/3960948432 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff6bc0139a0 con 0x7ff6c4136d80 2023-09-30T22:33:26.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.070+0000 7f12c1ffb700 1 -- 172.21.15.59:0/406535597 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12c8046060 con 0x7f12d0135be0 2023-09-30T22:33:26.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.072+0000 7ff6baffd700 1 -- 172.21.15.59:0/3960948432 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6bc045060 con 0x7ff6c4136d80 2023-09-30T22:33:26.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.110+0000 7f999ed62700 1 -- 172.21.15.59:0/3031261367 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f99980a28e0 con 0x7f9998134170 2023-09-30T22:33:26.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.110+0000 7f99957fa700 1 -- 172.21.15.59:0/3031261367 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9988028020 con 0x7f9998134170 2023-09-30T22:33:26.111 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.112+0000 7f999ed62700 1 -- 172.21.15.59:0/3031261367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9998134170 msgr2=0x7f999811f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.112+0000 7f999ed62700 1 --2- 172.21.15.59:0/3031261367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9998134170 0x7f999811f190 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f999809dd90 tx=0x7f9988004750 comp rx=0 tx=0).stop 2023-09-30T22:33:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.113+0000 7f999ed62700 1 -- 172.21.15.59:0/3031261367 shutdown_connections 2023-09-30T22:33:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.113+0000 7f999ed62700 1 --2- 172.21.15.59:0/3031261367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99980a0a30 0x7f999811e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.113+0000 7f999ed62700 1 --2- 172.21.15.59:0/3031261367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9998134170 0x7f999811f190 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.113+0000 7f999ed62700 1 --2- 172.21.15.59:0/3031261367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99980a1340 0x7f999811ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.113+0000 7f999ed62700 1 -- 172.21.15.59:0/3031261367 >> 172.21.15.59:0/3031261367 conn(0x7f99980a6550 msgr2=0x7f999809ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:26.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.113+0000 7f999ed62700 1 -- 172.21.15.59:0/3031261367 shutdown_connections 2023-09-30T22:33:26.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.113+0000 7f999ed62700 1 -- 172.21.15.59:0/3031261367 wait complete. 2023-09-30T22:33:26.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:26.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.142+0000 7f65f0b42700 1 -- 172.21.15.59:0/844740894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f65ec074ea0 con 0x7f65ec06a770 2023-09-30T22:33:26.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.143+0000 7f65daffd700 1 -- 172.21.15.59:0/844740894 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65dc017020 con 0x7f65ec06a770 2023-09-30T22:33:26.143 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:26.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.146+0000 7f65f0b42700 1 -- 172.21.15.59:0/844740894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65ec06a770 msgr2=0x7f65ec11c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:26.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.146+0000 7f65f0b42700 1 --2- 172.21.15.59:0/844740894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65ec06a770 0x7f65ec11c3e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f65dc001eb0 tx=0x7f65dc00c800 comp rx=0 tx=0).stop 2023-09-30T22:33:26.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.146+0000 7f65f0b42700 1 -- 172.21.15.59:0/844740894 shutdown_connections 2023-09-30T22:33:26.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.146+0000 7f65f0b42700 1 --2- 172.21.15.59:0/844740894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65ec13d1f0 0x7f65ec13bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.146+0000 7f65f0b42700 1 --2- 172.21.15.59:0/844740894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65ec06a770 0x7f65ec11c3e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.146+0000 7f65f0b42700 1 --2- 172.21.15.59:0/844740894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65ec09de00 0x7f65ec13b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.146+0000 7f65f0b42700 1 -- 172.21.15.59:0/844740894 >> 172.21.15.59:0/844740894 conn(0x7f65ec066f50 msgr2=0x7f65ec09b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:26.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.146+0000 7f65f0b42700 1 -- 172.21.15.59:0/844740894 shutdown_connections 2023-09-30T22:33:26.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.146+0000 7f65f0b42700 1 -- 172.21.15.59:0/844740894 wait complete. 2023-09-30T22:33:26.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:26.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.278+0000 7f12d639f700 1 -- 172.21.15.59:0/406535597 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f12d0128290 con 0x7f12d0135be0 2023-09-30T22:33:26.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.278+0000 7f12c1ffb700 1 -- 172.21.15.59:0/406535597 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12c8011390 con 0x7f12d0135be0 2023-09-30T22:33:26.278 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.280+0000 7f12d639f700 1 -- 172.21.15.59:0/406535597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12d0135be0 msgr2=0x7f12d0126990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.280+0000 7f12d639f700 1 --2- 172.21.15.59:0/406535597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12d0135be0 0x7f12d0126990 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f12c8015000 tx=0x7f12c8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.280+0000 7f12d639f700 1 -- 172.21.15.59:0/406535597 shutdown_connections 2023-09-30T22:33:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.280+0000 7f12d639f700 1 --2- 172.21.15.59:0/406535597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12d009d8d0 0x7f12d0125f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.280+0000 7f12d639f700 1 --2- 172.21.15.59:0/406535597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12d0135be0 0x7f12d0126990 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.280+0000 7f12d639f700 1 --2- 172.21.15.59:0/406535597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12d009e3b0 0x7f12d0126450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.280+0000 7f12d639f700 1 -- 172.21.15.59:0/406535597 >> 172.21.15.59:0/406535597 conn(0x7f12d00a2e20 msgr2=0x7f12d006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.280+0000 7f12d639f700 1 -- 172.21.15.59:0/406535597 shutdown_connections 2023-09-30T22:33:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.280+0000 7f12d639f700 1 -- 172.21.15.59:0/406535597 wait complete. 2023-09-30T22:33:26.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.289+0000 7ff6cc2c6700 1 -- 172.21.15.59:0/3960948432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff6c411d890 con 0x7ff6c4136d80 2023-09-30T22:33:26.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.289+0000 7ff6baffd700 1 -- 172.21.15.59:0/3960948432 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff6bc045070 con 0x7ff6c4136d80 2023-09-30T22:33:26.289 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:26.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.291+0000 7ff6cc2c6700 1 -- 172.21.15.59:0/3960948432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6c4136d80 msgr2=0x7ff6c411ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:26.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.291+0000 7ff6cc2c6700 1 --2- 172.21.15.59:0/3960948432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6c4136d80 0x7ff6c411ed30 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc007e30 tx=0x7ff6bc00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.292+0000 7ff6cc2c6700 1 -- 172.21.15.59:0/3960948432 shutdown_connections 2023-09-30T22:33:26.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.292+0000 7ff6cc2c6700 1 --2- 172.21.15.59:0/3960948432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6c4136d80 0x7ff6c411ed30 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.292+0000 7ff6cc2c6700 1 --2- 172.21.15.59:0/3960948432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6c406a770 0x7ff6c41200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.292+0000 7ff6cc2c6700 1 --2- 172.21.15.59:0/3960948432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6c406b250 0x7ff6c411e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:26.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.292+0000 7ff6cc2c6700 1 -- 172.21.15.59:0/3960948432 >> 172.21.15.59:0/3960948432 conn(0x7ff6c4066f50 msgr2=0x7ff6c41348d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:26.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.292+0000 7ff6cc2c6700 1 -- 172.21.15.59:0/3960948432 shutdown_connections 2023-09-30T22:33:26.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:26.292+0000 7ff6cc2c6700 1 -- 172.21.15.59:0/3960948432 wait complete. 2023-09-30T22:33:26.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:26.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:27.128 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:27.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.278+0000 7fe9495e0700 1 Processor -- start 2023-09-30T22:33:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.278+0000 7fe9495e0700 1 -- start start 2023-09-30T22:33:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.278+0000 7fe9495e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9441367b0 0x7fe944138b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.278+0000 7fe9495e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9441390d0 0x7fe94413b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.278+0000 7fe9495e0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94406f1c0 con 0x7fe944130410 2023-09-30T22:33:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.278+0000 7fe9495e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94406fd90 con 0x7fe9441390d0 2023-09-30T22:33:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.278+0000 7fe9495e0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe944070750 con 0x7fe9441367b0 2023-09-30T22:33:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.278+0000 7fe9437fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9441390d0 0x7fe94413b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.278+0000 7fe9427fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9441367b0 0x7fe944138b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.278+0000 7fe942ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe944130410 0x7fe9441307e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34918/0 (socket says 172.21.15.59:34918) 2023-09-30T22:33:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.278+0000 7fe942ffd700 1 -- 172.21.15.59:0/3365257292 learned_addr learned my addr 172.21.15.59:0/3365257292 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.279+0000 7fe9427fc700 1 -- 172.21.15.59:0/3365257292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9441390d0 msgr2=0x7fe94413b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.279+0000 7fe9427fc700 1 --2- 172.21.15.59:0/3365257292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9441390d0 0x7fe94413b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.279+0000 7fe9427fc700 1 -- 172.21.15.59:0/3365257292 >> v1:172.21.15.59:6789/0 conn(0x7fe944130410 legacy=0x7fe9441307e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.279+0000 7fe941ffb700 1 -- 172.21.15.59:0/3365257292 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934440623 0 0) 0x7fe94406f1c0 con 0x7fe944130410 2023-09-30T22:33:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.279+0000 7fe9427fc700 1 -- 172.21.15.59:0/3365257292 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94412ffe0 con 0x7fe9441367b0 2023-09-30T22:33:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.279+0000 7fe9437fe700 1 --2- 172.21.15.59:0/3365257292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9441390d0 0x7fe94413b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.279+0000 7fe9427fc700 1 --2- 172.21.15.59:0/3365257292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9441367b0 0x7fe944138b90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe938009870 tx=0x7fe938009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af4bcdfa76537ae9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.279+0000 7fe941ffb700 1 -- 172.21.15.59:0/3365257292 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe938011830 con 0x7fe9441367b0 2023-09-30T22:33:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.279+0000 7fe941ffb700 1 -- 172.21.15.59:0/3365257292 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe938011990 con 0x7fe9441367b0 2023-09-30T22:33:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.279+0000 7fe941ffb700 1 -- 172.21.15.59:0/3365257292 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe938011d20 con 0x7fe9441367b0 2023-09-30T22:33:27.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.280+0000 7fe9495e0700 1 -- 172.21.15.59:0/3365257292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9441367b0 msgr2=0x7fe944138b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.280+0000 7fe9495e0700 1 --2- 172.21.15.59:0/3365257292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9441367b0 0x7fe944138b90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe938009870 tx=0x7fe938009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.280+0000 7fe9495e0700 1 -- 172.21.15.59:0/3365257292 shutdown_connections 2023-09-30T22:33:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.280+0000 7fe9495e0700 1 --2- 172.21.15.59:0/3365257292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9441390d0 0x7fe94413b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.280+0000 7fe9495e0700 1 --2- 172.21.15.59:0/3365257292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9441367b0 0x7fe944138b90 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.280+0000 7fe9495e0700 1 -- 172.21.15.59:0/3365257292 >> 172.21.15.59:0/3365257292 conn(0x7fe9440a2610 msgr2=0x7fe9440a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.280+0000 7fe9495e0700 1 -- 172.21.15.59:0/3365257292 shutdown_connections 2023-09-30T22:33:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.280+0000 7fe9495e0700 1 -- 172.21.15.59:0/3365257292 wait complete. 2023-09-30T22:33:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.281+0000 7fe9495e0700 1 Processor -- start 2023-09-30T22:33:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.281+0000 7fe9495e0700 1 -- start start 2023-09-30T22:33:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9495e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe944130410 0x7fe9441c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9495e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9441367b0 0x7fe9441c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9495e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9441390d0 0x7fe944119db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9495e0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94411bac0 con 0x7fe9441367b0 2023-09-30T22:33:27.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9495e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94411b8d0 con 0x7fe9441390d0 2023-09-30T22:33:27.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9495e0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe94411b270 con 0x7fe944130410 2023-09-30T22:33:27.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9427fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9441367b0 0x7fe9441c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9437fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9441390d0 0x7fe944119db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9427fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9441367b0 0x7fe9441c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53174/0 (socket says 172.21.15.59:53174) 2023-09-30T22:33:27.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9427fc700 1 -- 172.21.15.59:0/170051654 learned_addr learned my addr 172.21.15.59:0/170051654 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:27.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9437fe700 1 --2- 172.21.15.59:0/170051654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9441390d0 0x7fe944119db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57968/0 (socket says 172.21.15.59:57968) 2023-09-30T22:33:27.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe942ffd700 1 --2- 172.21.15.59:0/170051654 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe944130410 0x7fe9441c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9437fe700 1 -- 172.21.15.59:0/170051654 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe944130410 msgr2=0x7fe9441c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9437fe700 1 --2- 172.21.15.59:0/170051654 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe944130410 0x7fe9441c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9437fe700 1 -- 172.21.15.59:0/170051654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9441367b0 msgr2=0x7fe9441c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9437fe700 1 --2- 172.21.15.59:0/170051654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9441367b0 0x7fe9441c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9437fe700 1 -- 172.21.15.59:0/170051654 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c0094a0 con 0x7fe9441390d0 2023-09-30T22:33:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9427fc700 1 --2- 172.21.15.59:0/170051654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9441367b0 0x7fe9441c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe942ffd700 1 --2- 172.21.15.59:0/170051654 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe944130410 0x7fe9441c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.282+0000 7fe9437fe700 1 --2- 172.21.15.59:0/170051654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9441390d0 0x7fe944119db0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00e910 tx=0x7fe93c00ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.283+0000 7fe92b7fe700 1 -- 172.21.15.59:0/170051654 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c004020 con 0x7fe9441390d0 2023-09-30T22:33:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.283+0000 7fe92b7fe700 1 -- 172.21.15.59:0/170051654 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c0041a0 con 0x7fe9441390d0 2023-09-30T22:33:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.283+0000 7fe9495e0700 1 -- 172.21.15.59:0/170051654 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9380094a0 con 0x7fe9441390d0 2023-09-30T22:33:27.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.283+0000 7fe92b7fe700 1 -- 172.21.15.59:0/170051654 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c004550 con 0x7fe9441390d0 2023-09-30T22:33:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.283+0000 7fe9495e0700 1 -- 172.21.15.59:0/170051654 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe944138cc0 con 0x7fe9441390d0 2023-09-30T22:33:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.283+0000 7fe92b7fe700 1 -- 172.21.15.59:0/170051654 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe93c0036a0 con 0x7fe9441390d0 2023-09-30T22:33:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.284+0000 7fe92b7fe700 1 -- 172.21.15.59:0/170051654 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe93c03f2d0 con 0x7fe9441390d0 2023-09-30T22:33:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.284+0000 7fe9495e0700 1 -- 172.21.15.59:0/170051654 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94411d1f0 con 0x7fe9441390d0 2023-09-30T22:33:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.289+0000 7fe92b7fe700 1 -- 172.21.15.59:0/170051654 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe93c020080 con 0x7fe9441390d0 2023-09-30T22:33:27.296 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:27.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:27.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.315+0000 7fb0b49f9700 1 Processor -- start 2023-09-30T22:33:27.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.315+0000 7fb0b49f9700 1 -- start start 2023-09-30T22:33:27.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.316+0000 7fb0b49f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b009d6f0 0x7fb0b009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.316+0000 7fb0b49f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b009e410 0x7fb0b0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.316+0000 7fb0b49f9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b009b120 con 0x7fb0b009e000 2023-09-30T22:33:27.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.316+0000 7fb0b49f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b006b460 con 0x7fb0b009d6f0 2023-09-30T22:33:27.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.316+0000 7fb0b49f9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b009a7e0 con 0x7fb0b009e410 2023-09-30T22:33:27.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.316+0000 7fb0ae59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b009d6f0 0x7fb0b009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.316+0000 7fb0ae59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b009d6f0 0x7fb0b009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57980/0 (socket says 172.21.15.59:57980) 2023-09-30T22:33:27.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.316+0000 7fb0ae59c700 1 -- 172.21.15.59:0/1306293757 learned_addr learned my addr 172.21.15.59:0/1306293757 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:27.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.317+0000 7fb0aed9d700 1 --2- 172.21.15.59:0/1306293757 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b009e410 0x7fb0b0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.317+0000 7fb0ae59c700 1 -- 172.21.15.59:0/1306293757 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b009e410 msgr2=0x7fb0b0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:27.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.317+0000 7fb0ae59c700 1 --2- 172.21.15.59:0/1306293757 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b009e410 0x7fb0b0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.317+0000 7fb0ae59c700 1 -- 172.21.15.59:0/1306293757 >> v1:172.21.15.59:6789/0 conn(0x7fb0b009e000 legacy=0x7fb0b01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.317+0000 7fb0ae59c700 1 -- 172.21.15.59:0/1306293757 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b009a500 con 0x7fb0b009d6f0 2023-09-30T22:33:27.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.317+0000 7fb0aed9d700 1 --2- 172.21.15.59:0/1306293757 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b009e410 0x7fb0b0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:27.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.317+0000 7fb0ae59c700 1 --2- 172.21.15.59:0/1306293757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b009d6f0 0x7fb0b009dac0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009920 tx=0x7fb0a0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b453627ecb8cf3f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:27.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.317+0000 7fb0ad59a700 1 -- 172.21.15.59:0/1306293757 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000ba60 con 0x7fb0b009d6f0 2023-09-30T22:33:27.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.317+0000 7fb0ad59a700 1 -- 172.21.15.59:0/1306293757 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a000bbc0 con 0x7fb0b009d6f0 2023-09-30T22:33:27.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.317+0000 7fb0ad59a700 1 -- 172.21.15.59:0/1306293757 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0009e70 con 0x7fb0b009d6f0 2023-09-30T22:33:27.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.318+0000 7fb0b49f9700 1 -- 172.21.15.59:0/1306293757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b009d6f0 msgr2=0x7fb0b009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.318+0000 7fb0b49f9700 1 --2- 172.21.15.59:0/1306293757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b009d6f0 0x7fb0b009dac0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009920 tx=0x7fb0a0009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:27.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.319+0000 7fb0b49f9700 1 -- 172.21.15.59:0/1306293757 shutdown_connections 2023-09-30T22:33:27.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.319+0000 7fb0b49f9700 1 --2- 172.21.15.59:0/1306293757 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b009e410 0x7fb0b0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.319+0000 7fb0b49f9700 1 --2- 172.21.15.59:0/1306293757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b009d6f0 0x7fb0b009dac0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.319+0000 7fb0b49f9700 1 -- 172.21.15.59:0/1306293757 >> 172.21.15.59:0/1306293757 conn(0x7fb0b0066f50 msgr2=0x7fb0b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:27.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.319+0000 7fb0b49f9700 1 -- 172.21.15.59:0/1306293757 shutdown_connections 2023-09-30T22:33:27.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.319+0000 7fb0b49f9700 1 -- 172.21.15.59:0/1306293757 wait complete. 2023-09-30T22:33:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.320+0000 7fb0b49f9700 1 Processor -- start 2023-09-30T22:33:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.320+0000 7fb0b49f9700 1 -- start start 2023-09-30T22:33:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.321+0000 7fb0b49f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b009d6f0 0x7fb0b0122560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.321+0000 7fb0b49f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b009e000 0x7fb0b0122aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.321+0000 7fb0b49f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b009e410 0x7fb0b0122fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.321+0000 7fb0b49f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0125d10 con 0x7fb0b009e000 2023-09-30T22:33:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.321+0000 7fb0b49f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b01249b0 con 0x7fb0b009e410 2023-09-30T22:33:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.321+0000 7fb0b49f9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00a1ea0 con 0x7fb0b009d6f0 2023-09-30T22:33:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.321+0000 7fb0ae59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b009d6f0 0x7fb0b0122560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.321+0000 7fb0ae59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b009d6f0 0x7fb0b0122560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36864/0 (socket says 172.21.15.59:36864) 2023-09-30T22:33:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.321+0000 7fb0ae59c700 1 -- 172.21.15.59:0/1348909213 learned_addr learned my addr 172.21.15.59:0/1348909213 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.321+0000 7fb0add9b700 1 --2- 172.21.15.59:0/1348909213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b009e000 0x7fb0b0122aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.322+0000 7fb0aed9d700 1 --2- 172.21.15.59:0/1348909213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b009e410 0x7fb0b0122fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.322+0000 7fb0add9b700 1 -- 172.21.15.59:0/1348909213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b009d6f0 msgr2=0x7fb0b0122560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.322+0000 7fb0add9b700 1 --2- 172.21.15.59:0/1348909213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b009d6f0 0x7fb0b0122560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.322+0000 7fb0add9b700 1 -- 172.21.15.59:0/1348909213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b009e410 msgr2=0x7fb0b0122fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.322+0000 7fb0add9b700 1 --2- 172.21.15.59:0/1348909213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b009e410 0x7fb0b0122fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.322+0000 7fb0add9b700 1 -- 172.21.15.59:0/1348909213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a0009550 con 0x7fb0b009e000 2023-09-30T22:33:27.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.322+0000 7fb0add9b700 1 --2- 172.21.15.59:0/1348909213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b009e000 0x7fb0b0122aa0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4000f60 tx=0x7fb0a400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:27.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.322+0000 7fb09effd700 1 -- 172.21.15.59:0/1348909213 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40050d0 con 0x7fb0b009e000 2023-09-30T22:33:27.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.322+0000 7fb09effd700 1 -- 172.21.15.59:0/1348909213 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a4005230 con 0x7fb0b009e000 2023-09-30T22:33:27.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.322+0000 7fb0b49f9700 1 -- 172.21.15.59:0/1348909213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b009c710 con 0x7fb0b009e000 2023-09-30T22:33:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.322+0000 7fb09effd700 1 -- 172.21.15.59:0/1348909213 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4003680 con 0x7fb0b009e000 2023-09-30T22:33:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.323+0000 7fb0b49f9700 1 -- 172.21.15.59:0/1348909213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b0125780 con 0x7fb0b009e000 2023-09-30T22:33:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.323+0000 7fb09effd700 1 -- 172.21.15.59:0/1348909213 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0a40037e0 con 0x7fb0b009e000 2023-09-30T22:33:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.324+0000 7fb09effd700 1 -- 172.21.15.59:0/1348909213 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb0a403e9c0 con 0x7fb0b009e000 2023-09-30T22:33:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.325+0000 7fb0b49f9700 1 -- 172.21.15.59:0/1348909213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b01259b0 con 0x7fb0b009e000 2023-09-30T22:33:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.334+0000 7fb09effd700 1 -- 172.21.15.59:0/1348909213 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0b01259b0 con 0x7fb0b009e000 2023-09-30T22:33:27.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.451+0000 7f6268c28700 1 Processor -- start 2023-09-30T22:33:27.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.451+0000 7f6268c28700 1 -- start start 2023-09-30T22:33:27.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.452+0000 7f6268c28700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626409d6d0 0x7f626409daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.452+0000 7f6268c28700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6264133cd0 0x7f626413ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.452+0000 7f6268c28700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626409a570 con 0x7f626409dfe0 2023-09-30T22:33:27.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.452+0000 7f6268c28700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626409b1c0 con 0x7f626409d6d0 2023-09-30T22:33:27.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.452+0000 7f6268c28700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f626409f240 con 0x7f6264133cd0 2023-09-30T22:33:27.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.453+0000 7f626259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626409d6d0 0x7f626409daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.453+0000 7f6261d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f626409dfe0 0x7f62641335c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34930/0 (socket says 172.21.15.59:34930) 2023-09-30T22:33:27.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.453+0000 7f6261d9b700 1 -- 172.21.15.59:0/798875544 learned_addr learned my addr 172.21.15.59:0/798875544 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:27.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.453+0000 7f6262d9d700 1 --2- 172.21.15.59:0/798875544 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6264133cd0 0x7f626413ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.453+0000 7f626159a700 1 -- 172.21.15.59:0/798875544 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162488792 0 0) 0x7f626409a570 con 0x7f626409dfe0 2023-09-30T22:33:27.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.453+0000 7f626159a700 1 -- 172.21.15.59:0/798875544 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f624c0035b0 con 0x7f626409dfe0 2023-09-30T22:33:27.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.453+0000 7f626259c700 1 -- 172.21.15.59:0/798875544 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6264133cd0 msgr2=0x7f626413ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:27.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.453+0000 7f626259c700 1 --2- 172.21.15.59:0/798875544 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6264133cd0 0x7f626413ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.453+0000 7f626259c700 1 -- 172.21.15.59:0/798875544 >> v1:172.21.15.59:6789/0 conn(0x7f626409dfe0 legacy=0x7f62641335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.453+0000 7f626259c700 1 -- 172.21.15.59:0/798875544 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626409a2d0 con 0x7f626409d6d0 2023-09-30T22:33:27.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.453+0000 7f6262d9d700 1 --2- 172.21.15.59:0/798875544 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6264133cd0 0x7f626413ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:27.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.453+0000 7f626259c700 1 --2- 172.21.15.59:0/798875544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626409d6d0 0x7f626409daa0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6254009870 tx=0x7f6254009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da67342bf18b093c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:27.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.454+0000 7f626159a700 1 -- 172.21.15.59:0/798875544 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254004230 con 0x7f626409d6d0 2023-09-30T22:33:27.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.454+0000 7f626159a700 1 -- 172.21.15.59:0/798875544 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6254004390 con 0x7f626409d6d0 2023-09-30T22:33:27.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.454+0000 7f626159a700 1 -- 172.21.15.59:0/798875544 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62540036a0 con 0x7f626409d6d0 2023-09-30T22:33:27.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.455+0000 7f6268c28700 1 -- 172.21.15.59:0/798875544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626409d6d0 msgr2=0x7f626409daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.455+0000 7f6268c28700 1 --2- 172.21.15.59:0/798875544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626409d6d0 0x7f626409daa0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6254009870 tx=0x7f6254009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:27.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.455+0000 7f6268c28700 1 -- 172.21.15.59:0/798875544 shutdown_connections 2023-09-30T22:33:27.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.455+0000 7f6268c28700 1 --2- 172.21.15.59:0/798875544 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6264133cd0 0x7f626413ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.455+0000 7f6268c28700 1 --2- 172.21.15.59:0/798875544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626409d6d0 0x7f626409daa0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.455+0000 7f6268c28700 1 -- 172.21.15.59:0/798875544 >> 172.21.15.59:0/798875544 conn(0x7f6264099c20 msgr2=0x7f62640a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:27.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.455+0000 7f6268c28700 1 -- 172.21.15.59:0/798875544 shutdown_connections 2023-09-30T22:33:27.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.455+0000 7f6268c28700 1 -- 172.21.15.59:0/798875544 wait complete. 2023-09-30T22:33:27.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.456+0000 7f6268c28700 1 Processor -- start 2023-09-30T22:33:27.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.457+0000 7f6268c28700 1 -- start start 2023-09-30T22:33:27.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.457+0000 7f6268c28700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f626409d6d0 0x7f626411c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.457+0000 7f6268c28700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626409dfe0 0x7f626411c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.457+0000 7f6268c28700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6264133cd0 0x7f626411cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.457+0000 7f6268c28700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6264132870 con 0x7f6264133cd0 2023-09-30T22:33:27.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.457+0000 7f6268c28700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626409c900 con 0x7f626409dfe0 2023-09-30T22:33:27.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.457+0000 7f6268c28700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f626411d530 con 0x7f626409d6d0 2023-09-30T22:33:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.457+0000 7f6261d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626409dfe0 0x7f626411c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.458+0000 7f6261d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626409dfe0 0x7f626411c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58002/0 (socket says 172.21.15.59:58002) 2023-09-30T22:33:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.458+0000 7f6261d9b700 1 -- 172.21.15.59:0/2281158336 learned_addr learned my addr 172.21.15.59:0/2281158336 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.458+0000 7f6262d9d700 1 --2- 172.21.15.59:0/2281158336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6264133cd0 0x7f626411cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.458+0000 7f626259c700 1 --2- 172.21.15.59:0/2281158336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f626409d6d0 0x7f626411c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.458+0000 7f6261d9b700 1 -- 172.21.15.59:0/2281158336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f626409d6d0 msgr2=0x7f626411c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.458+0000 7f6261d9b700 1 --2- 172.21.15.59:0/2281158336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f626409d6d0 0x7f626411c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.458+0000 7f6261d9b700 1 -- 172.21.15.59:0/2281158336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6264133cd0 msgr2=0x7f626411cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.458+0000 7f6261d9b700 1 --2- 172.21.15.59:0/2281158336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6264133cd0 0x7f626411cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.458+0000 7f6261d9b700 1 -- 172.21.15.59:0/2281158336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540094a0 con 0x7f626409dfe0 2023-09-30T22:33:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.458+0000 7f6261d9b700 1 --2- 172.21.15.59:0/2281158336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626409dfe0 0x7f626411c680 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f625800c540 tx=0x7f625800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:27.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.458+0000 7f6252ffd700 1 -- 172.21.15.59:0/2281158336 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258004c80 con 0x7f626409dfe0 2023-09-30T22:33:27.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.458+0000 7f6252ffd700 1 -- 172.21.15.59:0/2281158336 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6258004de0 con 0x7f626409dfe0 2023-09-30T22:33:27.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.459+0000 7f6268c28700 1 -- 172.21.15.59:0/2281158336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626411f3f0 con 0x7f626409dfe0 2023-09-30T22:33:27.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.459+0000 7f6268c28700 1 -- 172.21.15.59:0/2281158336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626411e2c0 con 0x7f626409dfe0 2023-09-30T22:33:27.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.459+0000 7f6252ffd700 1 -- 172.21.15.59:0/2281158336 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258007310 con 0x7f626409dfe0 2023-09-30T22:33:27.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.460+0000 7f6268c28700 1 -- 172.21.15.59:0/2281158336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62480052e0 con 0x7f626409dfe0 2023-09-30T22:33:27.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.460+0000 7f6252ffd700 1 -- 172.21.15.59:0/2281158336 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6258007470 con 0x7f626409dfe0 2023-09-30T22:33:27.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.460+0000 7f6252ffd700 1 -- 172.21.15.59:0/2281158336 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f625803f310 con 0x7f626409dfe0 2023-09-30T22:33:27.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.464+0000 7f38c17fe700 1 Processor -- start 2023-09-30T22:33:27.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.464+0000 7f38c17fe700 1 -- start start 2023-09-30T22:33:27.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.464+0000 7f38c17fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38bc09d6f0 0x7f38bc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.464+0000 7f38c17fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38bc09e000 0x7f38bc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.464+0000 7f38c17fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38bc09e410 0x7f38bc130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.464+0000 7f38c17fe700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38bc09f520 con 0x7f38bc09d6f0 2023-09-30T22:33:27.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.464+0000 7f38c17fe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc09f130 con 0x7f38bc09e000 2023-09-30T22:33:27.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.464+0000 7f38c17fe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc09e930 con 0x7f38bc09e410 2023-09-30T22:33:27.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.464+0000 7f38baffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38bc09d6f0 0x7f38bc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.464+0000 7f38baffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38bc09d6f0 0x7f38bc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53212/0 (socket says 172.21.15.59:53212) 2023-09-30T22:33:27.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.464+0000 7f38baffd700 1 -- 172.21.15.59:0/2965584703 learned_addr learned my addr 172.21.15.59:0/2965584703 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:27.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.464+0000 7f38bb7fe700 1 --2- 172.21.15.59:0/2965584703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38bc09e410 0x7f38bc130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.465+0000 7f38ba7fc700 1 --2- 172.21.15.59:0/2965584703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38bc09e000 0x7f38bc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.465+0000 7f38baffd700 1 -- 172.21.15.59:0/2965584703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38bc09e410 msgr2=0x7f38bc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:27.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.465+0000 7f38baffd700 1 --2- 172.21.15.59:0/2965584703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38bc09e410 0x7f38bc130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.465+0000 7f38baffd700 1 -- 172.21.15.59:0/2965584703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38bc09e000 msgr2=0x7f38bc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:27.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.465+0000 7f38baffd700 1 --2- 172.21.15.59:0/2965584703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38bc09e000 0x7f38bc130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.465+0000 7f38baffd700 1 -- 172.21.15.59:0/2965584703 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc09b2d0 con 0x7f38bc09d6f0 2023-09-30T22:33:27.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.465+0000 7f38ba7fc700 1 --2- 172.21.15.59:0/2965584703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38bc09e000 0x7f38bc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:27.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.465+0000 7f38baffd700 1 --2- 172.21.15.59:0/2965584703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38bc09d6f0 0x7f38bc09dac0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00bbc0 tx=0x7f38ac00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42677213a1483ed9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:27.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.465+0000 7f38b9ffb700 1 -- 172.21.15.59:0/2965584703 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac00dcf0 con 0x7f38bc09d6f0 2023-09-30T22:33:27.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.465+0000 7f38b9ffb700 1 -- 172.21.15.59:0/2965584703 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ac00de50 con 0x7f38bc09d6f0 2023-09-30T22:33:27.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.465+0000 7f38b9ffb700 1 -- 172.21.15.59:0/2965584703 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac010690 con 0x7f38bc09d6f0 2023-09-30T22:33:27.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.466+0000 7f38c17fe700 1 -- 172.21.15.59:0/2965584703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38bc09d6f0 msgr2=0x7f38bc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.466+0000 7f38c17fe700 1 --2- 172.21.15.59:0/2965584703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38bc09d6f0 0x7f38bc09dac0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00bbc0 tx=0x7f38ac00bed0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.466+0000 7f38c17fe700 1 -- 172.21.15.59:0/2965584703 shutdown_connections 2023-09-30T22:33:27.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.466+0000 7f38c17fe700 1 --2- 172.21.15.59:0/2965584703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38bc09e410 0x7f38bc130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.466+0000 7f38c17fe700 1 --2- 172.21.15.59:0/2965584703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38bc09d6f0 0x7f38bc09dac0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.466+0000 7f38c17fe700 1 --2- 172.21.15.59:0/2965584703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38bc09e000 0x7f38bc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.466+0000 7f38c17fe700 1 -- 172.21.15.59:0/2965584703 >> 172.21.15.59:0/2965584703 conn(0x7f38bc066f50 msgr2=0x7f38bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.466+0000 7f38c17fe700 1 -- 172.21.15.59:0/2965584703 shutdown_connections 2023-09-30T22:33:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.466+0000 7f38c17fe700 1 -- 172.21.15.59:0/2965584703 wait complete. 2023-09-30T22:33:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.467+0000 7f38c17fe700 1 Processor -- start 2023-09-30T22:33:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.467+0000 7f38c17fe700 1 -- start start 2023-09-30T22:33:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38c17fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38bc09d6f0 0x7f38bc123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38c17fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38bc09e000 0x7f38bc1238a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38c17fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38bc09e410 0x7f38bc1c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38c17fe700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc1260a0 con 0x7f38bc09d6f0 2023-09-30T22:33:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38c17fe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc122f70 con 0x7f38bc09e000 2023-09-30T22:33:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38c17fe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc1262d0 con 0x7f38bc09e410 2023-09-30T22:33:27.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38baffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38bc09d6f0 0x7f38bc123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38baffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38bc09d6f0 0x7f38bc123360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53228/0 (socket says 172.21.15.59:53228) 2023-09-30T22:33:27.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38baffd700 1 -- 172.21.15.59:0/1445035495 learned_addr learned my addr 172.21.15.59:0/1445035495 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:27.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38bb7fe700 1 --2- 172.21.15.59:0/1445035495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38bc09e410 0x7f38bc1c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38ba7fc700 1 --2- 172.21.15.59:0/1445035495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38bc09e000 0x7f38bc1238a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:27.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38baffd700 1 -- 172.21.15.59:0/1445035495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38bc09e410 msgr2=0x7f38bc1c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38baffd700 1 --2- 172.21.15.59:0/1445035495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38bc09e410 0x7f38bc1c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38baffd700 1 -- 172.21.15.59:0/1445035495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38bc09e000 msgr2=0x7f38bc1238a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38baffd700 1 --2- 172.21.15.59:0/1445035495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38bc09e000 0x7f38bc1238a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38baffd700 1 -- 172.21.15.59:0/1445035495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac00b7f0 con 0x7f38bc09d6f0 2023-09-30T22:33:27.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38bb7fe700 1 --2- 172.21.15.59:0/1445035495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38bc09e410 0x7f38bc1c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:27.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.468+0000 7f38baffd700 1 --2- 172.21.15.59:0/1445035495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38bc09d6f0 0x7f38bc123360 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f38ac000c00 tx=0x7f38ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:27.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.469+0000 7f38a37fe700 1 -- 172.21.15.59:0/1445035495 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac003cf0 con 0x7f38bc09d6f0 2023-09-30T22:33:27.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.469+0000 7f38a37fe700 1 -- 172.21.15.59:0/1445035495 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ac003e50 con 0x7f38bc09d6f0 2023-09-30T22:33:27.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.469+0000 7f38a37fe700 1 -- 172.21.15.59:0/1445035495 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac0106b0 con 0x7f38bc09d6f0 2023-09-30T22:33:27.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.469+0000 7f38c17fe700 1 -- 172.21.15.59:0/1445035495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38bc1246a0 con 0x7f38bc09d6f0 2023-09-30T22:33:27.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.469+0000 7f38c17fe700 1 -- 172.21.15.59:0/1445035495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38bc124c10 con 0x7f38bc09d6f0 2023-09-30T22:33:27.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.469+0000 7f6252ffd700 1 -- 172.21.15.59:0/2281158336 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f625801a6c0 con 0x7f626409dfe0 2023-09-30T22:33:27.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.470+0000 7f38c17fe700 1 -- 172.21.15.59:0/1445035495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38bc074ea0 con 0x7f38bc09d6f0 2023-09-30T22:33:27.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.470+0000 7f38a37fe700 1 -- 172.21.15.59:0/1445035495 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38ac019400 con 0x7f38bc09d6f0 2023-09-30T22:33:27.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.471+0000 7f38a37fe700 1 -- 172.21.15.59:0/1445035495 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f38ac040a60 con 0x7f38bc09d6f0 2023-09-30T22:33:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.480+0000 7f38a37fe700 1 -- 172.21.15.59:0/1445035495 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38ac018720 con 0x7f38bc09d6f0 2023-09-30T22:33:27.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.516+0000 7fe9495e0700 1 -- 172.21.15.59:0/170051654 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe9440747f0 con 0x7fe9441390d0 2023-09-30T22:33:27.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.516+0000 7fe92b7fe700 1 -- 172.21.15.59:0/170051654 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe93c017020 con 0x7fe9441390d0 2023-09-30T22:33:27.517 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.520+0000 7fe9495e0700 1 -- 172.21.15.59:0/170051654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9441390d0 msgr2=0x7fe944119db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.520+0000 7fe9495e0700 1 --2- 172.21.15.59:0/170051654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9441390d0 0x7fe944119db0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00e910 tx=0x7fe93c00ec20 comp rx=0 tx=0).stop 2023-09-30T22:33:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.520+0000 7fe9495e0700 1 -- 172.21.15.59:0/170051654 shutdown_connections 2023-09-30T22:33:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.520+0000 7fe9495e0700 1 --2- 172.21.15.59:0/170051654 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe944130410 0x7fe9441c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.520+0000 7fe9495e0700 1 --2- 172.21.15.59:0/170051654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9441390d0 0x7fe944119db0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.520+0000 7fe9495e0700 1 --2- 172.21.15.59:0/170051654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9441367b0 0x7fe9441c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.520+0000 7fe9495e0700 1 -- 172.21.15.59:0/170051654 >> 172.21.15.59:0/170051654 conn(0x7fe9440a2610 msgr2=0x7fe944070970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:27.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.520+0000 7fe9495e0700 1 -- 172.21.15.59:0/170051654 shutdown_connections 2023-09-30T22:33:27.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.520+0000 7fe9495e0700 1 -- 172.21.15.59:0/170051654 wait complete. 2023-09-30T22:33:27.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:27.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.557+0000 7fb0b49f9700 1 -- 172.21.15.59:0/1348909213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb0b01259b0 con 0x7fb0b009e000 2023-09-30T22:33:27.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.558+0000 7fb09effd700 1 -- 172.21.15.59:0/1348909213 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0b01259b0 con 0x7fb0b009e000 2023-09-30T22:33:27.558 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:27.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.560+0000 7fb0b49f9700 1 -- 172.21.15.59:0/1348909213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b009e000 msgr2=0x7fb0b0122aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.560+0000 7fb0b49f9700 1 --2- 172.21.15.59:0/1348909213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b009e000 0x7fb0b0122aa0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4000f60 tx=0x7fb0a400c730 comp rx=0 tx=0).stop 2023-09-30T22:33:27.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.560+0000 7fb0b49f9700 1 -- 172.21.15.59:0/1348909213 shutdown_connections 2023-09-30T22:33:27.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.560+0000 7fb0b49f9700 1 --2- 172.21.15.59:0/1348909213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0b009d6f0 0x7fb0b0122560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.560+0000 7fb0b49f9700 1 --2- 172.21.15.59:0/1348909213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b009e410 0x7fb0b0122fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.560+0000 7fb0b49f9700 1 --2- 172.21.15.59:0/1348909213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b009e000 0x7fb0b0122aa0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.560+0000 7fb0b49f9700 1 -- 172.21.15.59:0/1348909213 >> 172.21.15.59:0/1348909213 conn(0x7fb0b0066f50 msgr2=0x7fb0b006f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:27.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.561+0000 7fb0b49f9700 1 -- 172.21.15.59:0/1348909213 shutdown_connections 2023-09-30T22:33:27.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.561+0000 7fb0b49f9700 1 -- 172.21.15.59:0/1348909213 wait complete. 2023-09-30T22:33:27.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:27.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.682+0000 7f6268c28700 1 -- 172.21.15.59:0/2281158336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6248005590 con 0x7f626409dfe0 2023-09-30T22:33:27.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.682+0000 7f6252ffd700 1 -- 172.21.15.59:0/2281158336 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6258011360 con 0x7f626409dfe0 2023-09-30T22:33:27.683 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:27.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.685+0000 7f6268c28700 1 -- 172.21.15.59:0/2281158336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626409dfe0 msgr2=0x7f626411c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.685+0000 7f6268c28700 1 --2- 172.21.15.59:0/2281158336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626409dfe0 0x7f626411c680 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f625800c540 tx=0x7f625800c850 comp rx=0 tx=0).stop 2023-09-30T22:33:27.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.685+0000 7f6268c28700 1 -- 172.21.15.59:0/2281158336 shutdown_connections 2023-09-30T22:33:27.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.685+0000 7f6268c28700 1 --2- 172.21.15.59:0/2281158336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f626409d6d0 0x7f626411c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.685+0000 7f6268c28700 1 --2- 172.21.15.59:0/2281158336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6264133cd0 0x7f626411cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.685+0000 7f6268c28700 1 --2- 172.21.15.59:0/2281158336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626409dfe0 0x7f626411c680 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.685+0000 7f6268c28700 1 -- 172.21.15.59:0/2281158336 >> 172.21.15.59:0/2281158336 conn(0x7f6264099c20 msgr2=0x7f62640a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:27.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.685+0000 7f6268c28700 1 -- 172.21.15.59:0/2281158336 shutdown_connections 2023-09-30T22:33:27.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.685+0000 7f6268c28700 1 -- 172.21.15.59:0/2281158336 wait complete. 2023-09-30T22:33:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.688+0000 7f38c17fe700 1 -- 172.21.15.59:0/1445035495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f38bc071fa0 con 0x7f38bc09d6f0 2023-09-30T22:33:27.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.688+0000 7f38a37fe700 1 -- 172.21.15.59:0/1445035495 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38ac018360 con 0x7f38bc09d6f0 2023-09-30T22:33:27.689 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:27.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.691+0000 7f38c17fe700 1 -- 172.21.15.59:0/1445035495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38bc09d6f0 msgr2=0x7f38bc123360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:27.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.691+0000 7f38c17fe700 1 --2- 172.21.15.59:0/1445035495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38bc09d6f0 0x7f38bc123360 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f38ac000c00 tx=0x7f38ac004750 comp rx=0 tx=0).stop 2023-09-30T22:33:27.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.691+0000 7f38c17fe700 1 -- 172.21.15.59:0/1445035495 shutdown_connections 2023-09-30T22:33:27.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.691+0000 7f38c17fe700 1 --2- 172.21.15.59:0/1445035495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38bc09e410 0x7f38bc1c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.691+0000 7f38c17fe700 1 --2- 172.21.15.59:0/1445035495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38bc09d6f0 0x7f38bc123360 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.691+0000 7f38c17fe700 1 --2- 172.21.15.59:0/1445035495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38bc09e000 0x7f38bc1238a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:27.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.691+0000 7f38c17fe700 1 -- 172.21.15.59:0/1445035495 >> 172.21.15.59:0/1445035495 conn(0x7f38bc066f50 msgr2=0x7f38bc070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:27.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.691+0000 7f38c17fe700 1 -- 172.21.15.59:0/1445035495 shutdown_connections 2023-09-30T22:33:27.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:27.691+0000 7f38c17fe700 1 -- 172.21.15.59:0/1445035495 wait complete. 2023-09-30T22:33:27.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:27.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:28.536 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:28.576 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:28.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.684+0000 7feeb4111700 1 Processor -- start 2023-09-30T22:33:28.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.684+0000 7feeb4111700 1 -- start start 2023-09-30T22:33:28.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.685+0000 7feeb4111700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeac09d630 0x7feeac0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.685+0000 7feeb4111700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feeac138d80 0x7feeac13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.685+0000 7feeb4111700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac0a2a70 con 0x7feeac0a0a30 2023-09-30T22:33:28.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.685+0000 7feeb4111700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac0a01d0 con 0x7feeac138d80 2023-09-30T22:33:28.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.685+0000 7feeb4111700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac09e2b0 con 0x7feeac09d630 2023-09-30T22:33:28.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.685+0000 7feeb16ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeac09d630 0x7feeac0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.685+0000 7feeb26ae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feeac138d80 0x7feeac13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.685+0000 7feeb16ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeac09d630 0x7feeac0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58030/0 (socket says 172.21.15.59:58030) 2023-09-30T22:33:28.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.685+0000 7feeb16ac700 1 -- 172.21.15.59:0/3318049500 learned_addr learned my addr 172.21.15.59:0/3318049500 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.685+0000 7feeb16ac700 1 -- 172.21.15.59:0/3318049500 >> v2:172.21.15.59:3300/0 conn(0x7feeac138d80 msgr2=0x7feeac13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.685+0000 7feeb16ac700 1 --2- 172.21.15.59:0/3318049500 >> v2:172.21.15.59:3300/0 conn(0x7feeac138d80 0x7feeac13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.685+0000 7feeb16ac700 1 -- 172.21.15.59:0/3318049500 >> v1:172.21.15.59:6789/0 conn(0x7feeac0a0a30 legacy=0x7feeac0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.685+0000 7feeb16ac700 1 -- 172.21.15.59:0/3318049500 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac09dc50 con 0x7feeac09d630 2023-09-30T22:33:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.686+0000 7feeb16ac700 1 --2- 172.21.15.59:0/3318049500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeac09d630 0x7feeac0a1510 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0098f0 tx=0x7fee9c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f58b20f12c1d933 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.686+0000 7feeb0eab700 1 -- 172.21.15.59:0/3318049500 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c011830 con 0x7feeac09d630 2023-09-30T22:33:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.686+0000 7feeb0eab700 1 -- 172.21.15.59:0/3318049500 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c011990 con 0x7feeac09d630 2023-09-30T22:33:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.686+0000 7feeb0eab700 1 -- 172.21.15.59:0/3318049500 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c011d20 con 0x7feeac09d630 2023-09-30T22:33:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.687+0000 7feeb4111700 1 -- 172.21.15.59:0/3318049500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeac09d630 msgr2=0x7feeac0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.687+0000 7feeb4111700 1 --2- 172.21.15.59:0/3318049500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeac09d630 0x7feeac0a1510 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0098f0 tx=0x7fee9c009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.687+0000 7feeb4111700 1 -- 172.21.15.59:0/3318049500 shutdown_connections 2023-09-30T22:33:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.687+0000 7feeb4111700 1 --2- 172.21.15.59:0/3318049500 >> v2:172.21.15.59:3300/0 conn(0x7feeac138d80 0x7feeac13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.687+0000 7feeb4111700 1 --2- 172.21.15.59:0/3318049500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeac09d630 0x7feeac0a1510 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.687+0000 7feeb4111700 1 -- 172.21.15.59:0/3318049500 >> 172.21.15.59:0/3318049500 conn(0x7feeac0a3050 msgr2=0x7feeac0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:28.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.687+0000 7feeb4111700 1 -- 172.21.15.59:0/3318049500 shutdown_connections 2023-09-30T22:33:28.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.687+0000 7feeb4111700 1 -- 172.21.15.59:0/3318049500 wait complete. 2023-09-30T22:33:28.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.688+0000 7feeb4111700 1 Processor -- start 2023-09-30T22:33:28.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.688+0000 7feeb4111700 1 -- start start 2023-09-30T22:33:28.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.689+0000 7feeb4111700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeac09d630 0x7feeac120730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.689+0000 7feeb4111700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeac0a0a30 0x7feeac120c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.689+0000 7feeb4111700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeac138d80 0x7feeac1211b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.689+0000 7feeb4111700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac123250 con 0x7feeac0a0a30 2023-09-30T22:33:28.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.689+0000 7feeb4111700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac123f70 con 0x7feeac138d80 2023-09-30T22:33:28.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.689+0000 7feeb4111700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feeac13af80 con 0x7feeac09d630 2023-09-30T22:33:28.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.689+0000 7feeb26ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeac138d80 0x7feeac1211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.689+0000 7feeb16ac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeac0a0a30 0x7feeac120c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.689+0000 7feeb16ac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeac0a0a30 0x7feeac120c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53258/0 (socket says 172.21.15.59:53258) 2023-09-30T22:33:28.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.689+0000 7feeb16ac700 1 -- 172.21.15.59:0/4188700530 learned_addr learned my addr 172.21.15.59:0/4188700530 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:28.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.689+0000 7feeb26ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeac138d80 0x7feeac1211b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58036/0 (socket says 172.21.15.59:58036) 2023-09-30T22:33:28.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.690+0000 7feeb1ead700 1 --2- 172.21.15.59:0/4188700530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeac09d630 0x7feeac120730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.690+0000 7feeb26ae700 1 -- 172.21.15.59:0/4188700530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeac09d630 msgr2=0x7feeac120730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.690+0000 7feeb26ae700 1 --2- 172.21.15.59:0/4188700530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeac09d630 0x7feeac120730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.690+0000 7feeb26ae700 1 -- 172.21.15.59:0/4188700530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeac0a0a30 msgr2=0x7feeac120c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.690+0000 7feeb26ae700 1 --2- 172.21.15.59:0/4188700530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeac0a0a30 0x7feeac120c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.690+0000 7feeb26ae700 1 -- 172.21.15.59:0/4188700530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c009550 con 0x7feeac138d80 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.690+0000 7feeb16ac700 1 --2- 172.21.15.59:0/4188700530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeac0a0a30 0x7feeac120c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.690+0000 7feeb26ae700 1 --2- 172.21.15.59:0/4188700530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeac138d80 0x7feeac1211b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7feea400ef90 tx=0x7feea400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.690+0000 7feea27fc700 1 -- 172.21.15.59:0/4188700530 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400cd40 con 0x7feeac138d80 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.690+0000 7feea27fc700 1 -- 172.21.15.59:0/4188700530 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea400f040 con 0x7feeac138d80 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.690+0000 7feea27fc700 1 -- 172.21.15.59:0/4188700530 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea40146c0 con 0x7feeac138d80 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.690+0000 7feeb4111700 1 -- 172.21.15.59:0/4188700530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeac0a0410 con 0x7feeac138d80 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.690+0000 7feeb4111700 1 -- 172.21.15.59:0/4188700530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeac1249e0 con 0x7feeac138d80 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.691+0000 7feea27fc700 1 -- 172.21.15.59:0/4188700530 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feea4014820 con 0x7feeac138d80 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.691+0000 7feeb4111700 1 -- 172.21.15.59:0/4188700530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeac123db0 con 0x7feeac138d80 2023-09-30T22:33:28.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.691+0000 7feea27fc700 1 -- 172.21.15.59:0/4188700530 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feea4040240 con 0x7feeac138d80 2023-09-30T22:33:28.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.696+0000 7feea27fc700 1 -- 172.21.15.59:0/4188700530 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feea4007920 con 0x7feeac138d80 2023-09-30T22:33:28.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:28.705 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.727+0000 7fce35d8e700 1 Processor -- start 2023-09-30T22:33:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.728+0000 7fce35d8e700 1 -- start start 2023-09-30T22:33:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.728+0000 7fce35d8e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3009e1d0 0x7fce30138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.728+0000 7fce35d8e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce30139170 0x7fce3013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.728+0000 7fce35d8e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3009b120 con 0x7fce3009d6f0 2023-09-30T22:33:28.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.728+0000 7fce35d8e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3006b460 con 0x7fce30139170 2023-09-30T22:33:28.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.728+0000 7fce35d8e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3009a7e0 con 0x7fce3009e1d0 2023-09-30T22:33:28.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.728+0000 7fce27fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3009e1d0 0x7fce30138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.728+0000 7fce27fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3009e1d0 0x7fce30138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58038/0 (socket says 172.21.15.59:58038) 2023-09-30T22:33:28.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.728+0000 7fce27fff700 1 -- 172.21.15.59:0/2993507154 learned_addr learned my addr 172.21.15.59:0/2993507154 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:28.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.729+0000 7fce27fff700 1 -- 172.21.15.59:0/2993507154 >> v2:172.21.15.59:3300/0 conn(0x7fce30139170 msgr2=0x7fce3013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:28.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.729+0000 7fce2ffff700 1 --2- 172.21.15.59:0/2993507154 >> v2:172.21.15.59:3300/0 conn(0x7fce30139170 0x7fce3013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.729+0000 7fce27fff700 1 --2- 172.21.15.59:0/2993507154 >> v2:172.21.15.59:3300/0 conn(0x7fce30139170 0x7fce3013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.729+0000 7fce27fff700 1 -- 172.21.15.59:0/2993507154 >> v1:172.21.15.59:6789/0 conn(0x7fce3009d6f0 legacy=0x7fce3009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.729+0000 7fce27fff700 1 -- 172.21.15.59:0/2993507154 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3009a500 con 0x7fce3009e1d0 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.729+0000 7fce2ffff700 1 --2- 172.21.15.59:0/2993507154 >> v2:172.21.15.59:3300/0 conn(0x7fce30139170 0x7fce3013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.729+0000 7fce27fff700 1 --2- 172.21.15.59:0/2993507154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3009e1d0 0x7fce30138c30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fce18009920 tx=0x7fce18009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fa05ebcb4d888ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.729+0000 7fce2effd700 1 -- 172.21.15.59:0/2993507154 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1800ba20 con 0x7fce3009e1d0 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.729+0000 7fce2effd700 1 -- 172.21.15.59:0/2993507154 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1800bb80 con 0x7fce3009e1d0 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.729+0000 7fce2effd700 1 -- 172.21.15.59:0/2993507154 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18009e70 con 0x7fce3009e1d0 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.730+0000 7fce35d8e700 1 -- 172.21.15.59:0/2993507154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3009e1d0 msgr2=0x7fce30138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.730+0000 7fce35d8e700 1 --2- 172.21.15.59:0/2993507154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3009e1d0 0x7fce30138c30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fce18009920 tx=0x7fce18009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.730+0000 7fce35d8e700 1 -- 172.21.15.59:0/2993507154 shutdown_connections 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.730+0000 7fce35d8e700 1 --2- 172.21.15.59:0/2993507154 >> v2:172.21.15.59:3300/0 conn(0x7fce30139170 0x7fce3013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.730+0000 7fce35d8e700 1 --2- 172.21.15.59:0/2993507154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3009e1d0 0x7fce30138c30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.730+0000 7fce35d8e700 1 -- 172.21.15.59:0/2993507154 >> 172.21.15.59:0/2993507154 conn(0x7fce30066f50 msgr2=0x7fce3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:28.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.731+0000 7fce35d8e700 1 -- 172.21.15.59:0/2993507154 shutdown_connections 2023-09-30T22:33:28.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.731+0000 7fce35d8e700 1 -- 172.21.15.59:0/2993507154 wait complete. 2023-09-30T22:33:28.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.732+0000 7fce35d8e700 1 Processor -- start 2023-09-30T22:33:28.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.733+0000 7fce35d8e700 1 -- start start 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.733+0000 7fce35d8e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce3009d6f0 0x7fce301c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.733+0000 7fce35d8e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce3009e1d0 0x7fce301c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.733+0000 7fce35d8e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce30139170 0x7fce3011e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.733+0000 7fce35d8e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce30122200 con 0x7fce3009e1d0 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.733+0000 7fce35d8e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce30122620 con 0x7fce30139170 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.733+0000 7fce35d8e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce301c9210 con 0x7fce3009d6f0 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.734+0000 7fce2ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce30139170 0x7fce3011e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.734+0000 7fce2f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce3009d6f0 0x7fce301c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.734+0000 7fce2ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce30139170 0x7fce3011e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58042/0 (socket says 172.21.15.59:58042) 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.734+0000 7fce2ffff700 1 -- 172.21.15.59:0/888073804 learned_addr learned my addr 172.21.15.59:0/888073804 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.734+0000 7fce27fff700 1 --2- 172.21.15.59:0/888073804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce3009e1d0 0x7fce301c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.734+0000 7fce2f7fe700 1 -- 172.21.15.59:0/888073804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce30139170 msgr2=0x7fce3011e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.734+0000 7fce2f7fe700 1 --2- 172.21.15.59:0/888073804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce30139170 0x7fce3011e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.734+0000 7fce2f7fe700 1 -- 172.21.15.59:0/888073804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce3009e1d0 msgr2=0x7fce301c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.734+0000 7fce2f7fe700 1 --2- 172.21.15.59:0/888073804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce3009e1d0 0x7fce301c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.734+0000 7fce2f7fe700 1 -- 172.21.15.59:0/888073804 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce18009550 con 0x7fce3009d6f0 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.735+0000 7fce2f7fe700 1 --2- 172.21.15.59:0/888073804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce3009d6f0 0x7fce301c8790 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fce20000f60 tx=0x7fce2000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.735+0000 7fce2cff9700 1 -- 172.21.15.59:0/888073804 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce200052d0 con 0x7fce3009d6f0 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.735+0000 7fce2cff9700 1 -- 172.21.15.59:0/888073804 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce20005430 con 0x7fce3009d6f0 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.735+0000 7fce35d8e700 1 -- 172.21.15.59:0/888073804 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce300a29f0 con 0x7fce3009d6f0 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.735+0000 7fce2cff9700 1 -- 172.21.15.59:0/888073804 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce200038a0 con 0x7fce3009d6f0 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.735+0000 7fce35d8e700 1 -- 172.21.15.59:0/888073804 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce30134790 con 0x7fce3009d6f0 2023-09-30T22:33:28.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.736+0000 7fce2cff9700 1 -- 172.21.15.59:0/888073804 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce20003a00 con 0x7fce3009d6f0 2023-09-30T22:33:28.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.736+0000 7fce2cff9700 1 -- 172.21.15.59:0/888073804 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fce2003ea60 con 0x7fce3009d6f0 2023-09-30T22:33:28.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.737+0000 7fce35d8e700 1 -- 172.21.15.59:0/888073804 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce30122040 con 0x7fce3009d6f0 2023-09-30T22:33:28.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.743+0000 7fce2cff9700 1 -- 172.21.15.59:0/888073804 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce30122040 con 0x7fce3009d6f0 2023-09-30T22:33:28.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.846+0000 7fea1c054700 1 Processor -- start 2023-09-30T22:33:28.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.846+0000 7fea1c054700 1 -- start start 2023-09-30T22:33:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.846+0000 7fea1c054700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea140a1510 0x7fea14138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.846+0000 7fea1c054700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea14139250 0x7fea1413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.846+0000 7fea1c054700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1409edd0 con 0x7fea140a0a30 2023-09-30T22:33:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.846+0000 7fea1c054700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea140a18e0 con 0x7fea14139250 2023-09-30T22:33:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.846+0000 7fea1c054700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1409e1f0 con 0x7fea140a1510 2023-09-30T22:33:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.847+0000 7fea195ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea140a1510 0x7fea14138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.847+0000 7fea1a5f1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea14139250 0x7fea1413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.847+0000 7fea1a5f1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea14139250 0x7fea1413b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53272/0 (socket says 172.21.15.59:53272) 2023-09-30T22:33:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.847+0000 7fea195ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea140a1510 0x7fea14138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58056/0 (socket says 172.21.15.59:58056) 2023-09-30T22:33:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.847+0000 7fea1a5f1700 1 -- 172.21.15.59:0/930490967 learned_addr learned my addr 172.21.15.59:0/930490967 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:28.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.847+0000 7fea195ef700 1 -- 172.21.15.59:0/930490967 >> v2:172.21.15.59:3300/0 conn(0x7fea14139250 msgr2=0x7fea1413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:28.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.847+0000 7fea195ef700 1 --2- 172.21.15.59:0/930490967 >> v2:172.21.15.59:3300/0 conn(0x7fea14139250 0x7fea1413b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.847+0000 7fea195ef700 1 -- 172.21.15.59:0/930490967 >> v1:172.21.15.59:6789/0 conn(0x7fea140a0a30 legacy=0x7fea140a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.847+0000 7fea195ef700 1 -- 172.21.15.59:0/930490967 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1409dc50 con 0x7fea140a1510 2023-09-30T22:33:28.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.847+0000 7fea1a5f1700 1 --2- 172.21.15.59:0/930490967 >> v2:172.21.15.59:3300/0 conn(0x7fea14139250 0x7fea1413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:28.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.847+0000 7fea195ef700 1 --2- 172.21.15.59:0/930490967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea140a1510 0x7fea14138d10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fea04009870 tx=0x7fea04009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e765da0382048f01 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:28.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.847+0000 7fea18dee700 1 -- 172.21.15.59:0/930490967 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04011830 con 0x7fea140a1510 2023-09-30T22:33:28.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.848+0000 7fea18dee700 1 -- 172.21.15.59:0/930490967 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea04011990 con 0x7fea140a1510 2023-09-30T22:33:28.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.848+0000 7fea18dee700 1 -- 172.21.15.59:0/930490967 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04011d20 con 0x7fea140a1510 2023-09-30T22:33:28.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.848+0000 7fea1c054700 1 -- 172.21.15.59:0/930490967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea140a1510 msgr2=0x7fea14138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.848+0000 7fea1c054700 1 --2- 172.21.15.59:0/930490967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea140a1510 0x7fea14138d10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fea04009870 tx=0x7fea04009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:28.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.849+0000 7fea1c054700 1 -- 172.21.15.59:0/930490967 shutdown_connections 2023-09-30T22:33:28.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.849+0000 7fea1c054700 1 --2- 172.21.15.59:0/930490967 >> v2:172.21.15.59:3300/0 conn(0x7fea14139250 0x7fea1413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.849+0000 7fea1c054700 1 --2- 172.21.15.59:0/930490967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea140a1510 0x7fea14138d10 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.849+0000 7fea1c054700 1 -- 172.21.15.59:0/930490967 >> 172.21.15.59:0/930490967 conn(0x7fea140a6550 msgr2=0x7fea140a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.849+0000 7fea1c054700 1 -- 172.21.15.59:0/930490967 shutdown_connections 2023-09-30T22:33:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.849+0000 7fea1c054700 1 -- 172.21.15.59:0/930490967 wait complete. 2023-09-30T22:33:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.850+0000 7fea1c054700 1 Processor -- start 2023-09-30T22:33:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.850+0000 7fea1c054700 1 -- start start 2023-09-30T22:33:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea1c054700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea140a0a30 0x7fea1406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea1c054700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea140a1510 0x7fea1406e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea1c054700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea14139250 0x7fea141cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea1c054700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1406f900 con 0x7fea140a0a30 2023-09-30T22:33:28.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea1c054700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1406f6d0 con 0x7fea14139250 2023-09-30T22:33:28.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea1c054700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea140a0220 con 0x7fea140a1510 2023-09-30T22:33:28.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea19df0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea140a0a30 0x7fea1406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea19df0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea140a0a30 0x7fea1406dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53278/0 (socket says 172.21.15.59:53278) 2023-09-30T22:33:28.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea19df0700 1 -- 172.21.15.59:0/3024499628 learned_addr learned my addr 172.21.15.59:0/3024499628 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:28.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea195ef700 1 --2- 172.21.15.59:0/3024499628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea140a1510 0x7fea1406e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea1a5f1700 1 --2- 172.21.15.59:0/3024499628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea14139250 0x7fea141cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea19df0700 1 -- 172.21.15.59:0/3024499628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea140a1510 msgr2=0x7fea1406e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea19df0700 1 --2- 172.21.15.59:0/3024499628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea140a1510 0x7fea1406e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea19df0700 1 -- 172.21.15.59:0/3024499628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea14139250 msgr2=0x7fea141cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea19df0700 1 --2- 172.21.15.59:0/3024499628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea14139250 0x7fea141cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea19df0700 1 -- 172.21.15.59:0/3024499628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c009b30 con 0x7fea140a0a30 2023-09-30T22:33:28.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.851+0000 7fea1a5f1700 1 --2- 172.21.15.59:0/3024499628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea14139250 0x7fea141cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:28.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.852+0000 7fea19df0700 1 --2- 172.21.15.59:0/3024499628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea140a0a30 0x7fea1406dd30 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fea1000c4e0 tx=0x7fea1000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:28.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.852+0000 7fea0a7fc700 1 -- 172.21.15.59:0/3024499628 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea100052d0 con 0x7fea140a0a30 2023-09-30T22:33:28.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.852+0000 7fea0a7fc700 1 -- 172.21.15.59:0/3024499628 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea10005430 con 0x7fea140a0a30 2023-09-30T22:33:28.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.852+0000 7fea1c054700 1 -- 172.21.15.59:0/3024499628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea040094a0 con 0x7fea140a0a30 2023-09-30T22:33:28.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.852+0000 7fea0a7fc700 1 -- 172.21.15.59:0/3024499628 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea100038c0 con 0x7fea140a0a30 2023-09-30T22:33:28.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.852+0000 7fea1c054700 1 -- 172.21.15.59:0/3024499628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea14071040 con 0x7fea140a0a30 2023-09-30T22:33:28.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.853+0000 7fea0a7fc700 1 -- 172.21.15.59:0/3024499628 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea10003a20 con 0x7fea140a0a30 2023-09-30T22:33:28.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.853+0000 7fea1c054700 1 -- 172.21.15.59:0/3024499628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea14071230 con 0x7fea140a0a30 2023-09-30T22:33:28.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.853+0000 7fea0a7fc700 1 -- 172.21.15.59:0/3024499628 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fea1003eba0 con 0x7fea140a0a30 2023-09-30T22:33:28.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.862+0000 7fea0a7fc700 1 -- 172.21.15.59:0/3024499628 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea10018260 con 0x7fea140a0a30 2023-09-30T22:33:28.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.875+0000 7fdf27544700 1 Processor -- start 2023-09-30T22:33:28.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.875+0000 7fdf27544700 1 -- start start 2023-09-30T22:33:28.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.876+0000 7fdf27544700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2006cc90 0x7fdf200a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.876+0000 7fdf27544700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf200a13e0 0x7fdf2013f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.876+0000 7fdf27544700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf200a1850 con 0x7fdf200a0f70 2023-09-30T22:33:28.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.876+0000 7fdf27544700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf200a2550 con 0x7fdf200a13e0 2023-09-30T22:33:28.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.876+0000 7fdf27544700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf200a1e00 con 0x7fdf2006cc90 2023-09-30T22:33:28.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.876+0000 7fdf252e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2006cc90 0x7fdf200a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.876+0000 7fdf252e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2006cc90 0x7fdf200a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36960/0 (socket says 172.21.15.59:36960) 2023-09-30T22:33:28.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.876+0000 7fdf252e0700 1 -- 172.21.15.59:0/3813853662 learned_addr learned my addr 172.21.15.59:0/3813853662 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:28.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.876+0000 7fdf25ae1700 1 --2- 172.21.15.59:0/3813853662 >> v2:172.21.15.59:3300/0 conn(0x7fdf200a13e0 0x7fdf2013f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.876+0000 7fdf25ae1700 1 -- 172.21.15.59:0/3813853662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2006cc90 msgr2=0x7fdf200a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:28.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.876+0000 7fdf25ae1700 1 --2- 172.21.15.59:0/3813853662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2006cc90 0x7fdf200a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.876+0000 7fdf25ae1700 1 -- 172.21.15.59:0/3813853662 >> v1:172.21.15.59:6789/0 conn(0x7fdf200a0f70 legacy=0x7fdf2013c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.877+0000 7fdf25ae1700 1 -- 172.21.15.59:0/3813853662 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2009cfa0 con 0x7fdf200a13e0 2023-09-30T22:33:28.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.877+0000 7fdf252e0700 1 --2- 172.21.15.59:0/3813853662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2006cc90 0x7fdf200a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:28.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.877+0000 7fdf25ae1700 1 --2- 172.21.15.59:0/3813853662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf200a13e0 0x7fdf2013f850 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009d90 tx=0x7fdf1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c8110d8c902494 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:28.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.877+0000 7fdf17fff700 1 -- 172.21.15.59:0/3813853662 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1800e070 con 0x7fdf200a13e0 2023-09-30T22:33:28.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.877+0000 7fdf17fff700 1 -- 172.21.15.59:0/3813853662 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1800bb20 con 0x7fdf200a13e0 2023-09-30T22:33:28.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.877+0000 7fdf17fff700 1 -- 172.21.15.59:0/3813853662 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18012430 con 0x7fdf200a13e0 2023-09-30T22:33:28.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.878+0000 7fdf27544700 1 -- 172.21.15.59:0/3813853662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf200a13e0 msgr2=0x7fdf2013f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.878+0000 7fdf27544700 1 --2- 172.21.15.59:0/3813853662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf200a13e0 0x7fdf2013f850 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009d90 tx=0x7fdf1800b330 comp rx=0 tx=0).stop 2023-09-30T22:33:28.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.878+0000 7fdf27544700 1 -- 172.21.15.59:0/3813853662 shutdown_connections 2023-09-30T22:33:28.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.878+0000 7fdf27544700 1 --2- 172.21.15.59:0/3813853662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf200a13e0 0x7fdf2013f850 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.878+0000 7fdf27544700 1 --2- 172.21.15.59:0/3813853662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf2006cc90 0x7fdf200a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.878+0000 7fdf27544700 1 -- 172.21.15.59:0/3813853662 >> 172.21.15.59:0/3813853662 conn(0x7fdf200a3050 msgr2=0x7fdf200a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:28.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.878+0000 7fdf27544700 1 -- 172.21.15.59:0/3813853662 shutdown_connections 2023-09-30T22:33:28.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.878+0000 7fdf27544700 1 -- 172.21.15.59:0/3813853662 wait complete. 2023-09-30T22:33:28.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.879+0000 7fdf27544700 1 Processor -- start 2023-09-30T22:33:28.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.879+0000 7fdf27544700 1 -- start start 2023-09-30T22:33:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.879+0000 7fdf27544700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf2006cc90 0x7fdf20130ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.879+0000 7fdf27544700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf200a0f70 0x7fdf20131420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.879+0000 7fdf27544700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf200a13e0 0x7fdf20131960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.879+0000 7fdf27544700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf201367d0 con 0x7fdf2006cc90 2023-09-30T22:33:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.880+0000 7fdf27544700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf201370b0 con 0x7fdf200a13e0 2023-09-30T22:33:28.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.880+0000 7fdf27544700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2009b8a0 con 0x7fdf200a0f70 2023-09-30T22:33:28.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.880+0000 7fdf252e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf2006cc90 0x7fdf20130ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.880+0000 7fdf252e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf2006cc90 0x7fdf20130ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53302/0 (socket says 172.21.15.59:53302) 2023-09-30T22:33:28.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.880+0000 7fdf24adf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf200a0f70 0x7fdf20131420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:28.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.880+0000 7fdf252e0700 1 -- 172.21.15.59:0/3583407887 learned_addr learned my addr 172.21.15.59:0/3583407887 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:28.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.880+0000 7fdf24adf700 1 -- 172.21.15.59:0/3583407887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf200a13e0 msgr2=0x7fdf20131960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.880+0000 7fdf24adf700 1 --2- 172.21.15.59:0/3583407887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf200a13e0 0x7fdf20131960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.880+0000 7fdf24adf700 1 -- 172.21.15.59:0/3583407887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf2006cc90 msgr2=0x7fdf20130ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.880+0000 7fdf24adf700 1 --2- 172.21.15.59:0/3583407887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf2006cc90 0x7fdf20130ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.880+0000 7fdf24adf700 1 -- 172.21.15.59:0/3583407887 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c009550 con 0x7fdf200a0f70 2023-09-30T22:33:28.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.880+0000 7fdf252e0700 1 --2- 172.21.15.59:0/3583407887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf2006cc90 0x7fdf20130ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:28.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.880+0000 7fdf24adf700 1 --2- 172.21.15.59:0/3583407887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf200a0f70 0x7fdf20131420 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdf2009cd40 tx=0x7fdf1000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:28.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.881+0000 7fdf15ffb700 1 -- 172.21.15.59:0/3583407887 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1000cea0 con 0x7fdf200a0f70 2023-09-30T22:33:28.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.881+0000 7fdf15ffb700 1 -- 172.21.15.59:0/3583407887 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf100052d0 con 0x7fdf200a0f70 2023-09-30T22:33:28.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.881+0000 7fdf27544700 1 -- 172.21.15.59:0/3583407887 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf18009a70 con 0x7fdf200a0f70 2023-09-30T22:33:28.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.881+0000 7fdf15ffb700 1 -- 172.21.15.59:0/3583407887 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10003680 con 0x7fdf200a0f70 2023-09-30T22:33:28.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.881+0000 7fdf27544700 1 -- 172.21.15.59:0/3583407887 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf20138b60 con 0x7fdf200a0f70 2023-09-30T22:33:28.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.882+0000 7fdf15ffb700 1 -- 172.21.15.59:0/3583407887 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf100037e0 con 0x7fdf200a0f70 2023-09-30T22:33:28.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.882+0000 7fdf15ffb700 1 -- 172.21.15.59:0/3583407887 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdf1003ea60 con 0x7fdf200a0f70 2023-09-30T22:33:28.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.882+0000 7fdf27544700 1 -- 172.21.15.59:0/3583407887 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf20071e20 con 0x7fdf200a0f70 2023-09-30T22:33:28.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.891+0000 7fdf15ffb700 1 -- 172.21.15.59:0/3583407887 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf10011590 con 0x7fdf200a0f70 2023-09-30T22:33:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.914+0000 7feeb4111700 1 -- 172.21.15.59:0/4188700530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feeac123c10 con 0x7feeac138d80 2023-09-30T22:33:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.914+0000 7feea27fc700 1 -- 172.21.15.59:0/4188700530 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feeac123c10 con 0x7feeac138d80 2023-09-30T22:33:28.915 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.917+0000 7feeb4111700 1 -- 172.21.15.59:0/4188700530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeac138d80 msgr2=0x7feeac1211b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.917+0000 7feeb4111700 1 --2- 172.21.15.59:0/4188700530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeac138d80 0x7feeac1211b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7feea400ef90 tx=0x7feea400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.917+0000 7feeb4111700 1 -- 172.21.15.59:0/4188700530 shutdown_connections 2023-09-30T22:33:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.917+0000 7feeb4111700 1 --2- 172.21.15.59:0/4188700530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeac09d630 0x7feeac120730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.917+0000 7feeb4111700 1 --2- 172.21.15.59:0/4188700530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeac138d80 0x7feeac1211b0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.917+0000 7feeb4111700 1 --2- 172.21.15.59:0/4188700530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeac0a0a30 0x7feeac120c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.917+0000 7feeb4111700 1 -- 172.21.15.59:0/4188700530 >> 172.21.15.59:0/4188700530 conn(0x7feeac0a3050 msgr2=0x7feeac139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:28.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.917+0000 7feeb4111700 1 -- 172.21.15.59:0/4188700530 shutdown_connections 2023-09-30T22:33:28.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.917+0000 7feeb4111700 1 -- 172.21.15.59:0/4188700530 wait complete. 2023-09-30T22:33:28.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:28.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.959+0000 7fce35d8e700 1 -- 172.21.15.59:0/888073804 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fce30122040 con 0x7fce3009d6f0 2023-09-30T22:33:28.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.959+0000 7fce2cff9700 1 -- 172.21.15.59:0/888073804 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce30122040 con 0x7fce3009d6f0 2023-09-30T22:33:28.960 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:28.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.962+0000 7fce35d8e700 1 -- 172.21.15.59:0/888073804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce3009d6f0 msgr2=0x7fce301c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:28.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.962+0000 7fce35d8e700 1 --2- 172.21.15.59:0/888073804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce3009d6f0 0x7fce301c8790 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fce20000f60 tx=0x7fce2000c730 comp rx=0 tx=0).stop 2023-09-30T22:33:28.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.962+0000 7fce35d8e700 1 -- 172.21.15.59:0/888073804 shutdown_connections 2023-09-30T22:33:28.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.962+0000 7fce35d8e700 1 --2- 172.21.15.59:0/888073804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce3009d6f0 0x7fce301c8790 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.962+0000 7fce35d8e700 1 --2- 172.21.15.59:0/888073804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce30139170 0x7fce3011e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.962+0000 7fce35d8e700 1 --2- 172.21.15.59:0/888073804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce3009e1d0 0x7fce301c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:28.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.962+0000 7fce35d8e700 1 -- 172.21.15.59:0/888073804 >> 172.21.15.59:0/888073804 conn(0x7fce30066f50 msgr2=0x7fce300a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:28.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.962+0000 7fce35d8e700 1 -- 172.21.15.59:0/888073804 shutdown_connections 2023-09-30T22:33:28.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:28.962+0000 7fce35d8e700 1 -- 172.21.15.59:0/888073804 wait complete. 2023-09-30T22:33:28.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:29.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.075+0000 7fea1c054700 1 -- 172.21.15.59:0/3024499628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fea14074ea0 con 0x7fea140a0a30 2023-09-30T22:33:29.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.076+0000 7fea0a7fc700 1 -- 172.21.15.59:0/3024499628 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea10017030 con 0x7fea140a0a30 2023-09-30T22:33:29.076 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:29.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.078+0000 7fea1c054700 1 -- 172.21.15.59:0/3024499628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea140a0a30 msgr2=0x7fea1406dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:29.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.078+0000 7fea1c054700 1 --2- 172.21.15.59:0/3024499628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea140a0a30 0x7fea1406dd30 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fea1000c4e0 tx=0x7fea1000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:33:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.078+0000 7fea1c054700 1 -- 172.21.15.59:0/3024499628 shutdown_connections 2023-09-30T22:33:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.078+0000 7fea1c054700 1 --2- 172.21.15.59:0/3024499628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea14139250 0x7fea141cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.078+0000 7fea1c054700 1 --2- 172.21.15.59:0/3024499628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea140a0a30 0x7fea1406dd30 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.078+0000 7fea1c054700 1 --2- 172.21.15.59:0/3024499628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea140a1510 0x7fea1406e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.078+0000 7fea1c054700 1 -- 172.21.15.59:0/3024499628 >> 172.21.15.59:0/3024499628 conn(0x7fea140a6550 msgr2=0x7fea140a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.078+0000 7fea1c054700 1 -- 172.21.15.59:0/3024499628 shutdown_connections 2023-09-30T22:33:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.078+0000 7fea1c054700 1 -- 172.21.15.59:0/3024499628 wait complete. 2023-09-30T22:33:29.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.099+0000 7fdf27544700 1 -- 172.21.15.59:0/3583407887 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdf200747f0 con 0x7fdf200a0f70 2023-09-30T22:33:29.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.099+0000 7fdf15ffb700 1 -- 172.21.15.59:0/3583407887 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf100192c0 con 0x7fdf200a0f70 2023-09-30T22:33:29.099 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.101+0000 7fdf27544700 1 -- 172.21.15.59:0/3583407887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf200a0f70 msgr2=0x7fdf20131420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.101+0000 7fdf27544700 1 --2- 172.21.15.59:0/3583407887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf200a0f70 0x7fdf20131420 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdf2009cd40 tx=0x7fdf1000c730 comp rx=0 tx=0).stop 2023-09-30T22:33:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.101+0000 7fdf27544700 1 -- 172.21.15.59:0/3583407887 shutdown_connections 2023-09-30T22:33:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.101+0000 7fdf27544700 1 --2- 172.21.15.59:0/3583407887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf200a13e0 0x7fdf20131960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.101+0000 7fdf27544700 1 --2- 172.21.15.59:0/3583407887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf2006cc90 0x7fdf20130ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.101+0000 7fdf27544700 1 --2- 172.21.15.59:0/3583407887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf200a0f70 0x7fdf20131420 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.101+0000 7fdf27544700 1 -- 172.21.15.59:0/3583407887 >> 172.21.15.59:0/3583407887 conn(0x7fdf200a3050 msgr2=0x7fdf20132990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.101+0000 7fdf27544700 1 -- 172.21.15.59:0/3583407887 shutdown_connections 2023-09-30T22:33:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:29.101+0000 7fdf27544700 1 -- 172.21.15.59:0/3583407887 wait complete. 2023-09-30T22:33:29.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:29.933 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:29.977 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:30.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.081+0000 7fc8b89b9700 1 Processor -- start 2023-09-30T22:33:30.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.081+0000 7fc8b89b9700 1 -- start start 2023-09-30T22:33:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.082+0000 7fc8b89b9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc8b40a0a30 0x7fc8b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.082+0000 7fc8b89b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b4138d80 0x7fc8b413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.082+0000 7fc8b89b9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b40a2a70 con 0x7fc8b409d630 2023-09-30T22:33:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.082+0000 7fc8b89b9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b40a01d0 con 0x7fc8b40a0a30 2023-09-30T22:33:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.082+0000 7fc8b89b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b409e2b0 con 0x7fc8b4138d80 2023-09-30T22:33:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.082+0000 7fc8b2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b4138d80 0x7fc8b413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.082+0000 7fc8b259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc8b40a0a30 0x7fc8b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.082+0000 7fc8b259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc8b40a0a30 0x7fc8b40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53312/0 (socket says 172.21.15.59:53312) 2023-09-30T22:33:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.082+0000 7fc8b2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b4138d80 0x7fc8b413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58078/0 (socket says 172.21.15.59:58078) 2023-09-30T22:33:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.082+0000 7fc8b259c700 1 -- 172.21.15.59:0/2276976424 learned_addr learned my addr 172.21.15.59:0/2276976424 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.083+0000 7fc8b259c700 1 -- 172.21.15.59:0/2276976424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b4138d80 msgr2=0x7fc8b413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.083+0000 7fc8b259c700 1 --2- 172.21.15.59:0/2276976424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b4138d80 0x7fc8b413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.083+0000 7fc8b259c700 1 -- 172.21.15.59:0/2276976424 >> v1:172.21.15.59:6789/0 conn(0x7fc8b409d630 legacy=0x7fc8b40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.083+0000 7fc8b259c700 1 -- 172.21.15.59:0/2276976424 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b409dc50 con 0x7fc8b40a0a30 2023-09-30T22:33:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.083+0000 7fc8b2d9d700 1 --2- 172.21.15.59:0/2276976424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b4138d80 0x7fc8b413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:30.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.083+0000 7fc8b259c700 1 --2- 172.21.15.59:0/2276976424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b40a0a30 0x7fc8b40a0e00 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009e50 tx=0x7fc8a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d999591e5f286e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:30.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.083+0000 7fc8b159a700 1 -- 172.21.15.59:0/2276976424 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a400e070 con 0x7fc8b40a0a30 2023-09-30T22:33:30.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.083+0000 7fc8b159a700 1 -- 172.21.15.59:0/2276976424 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a400b910 con 0x7fc8b40a0a30 2023-09-30T22:33:30.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.083+0000 7fc8b159a700 1 -- 172.21.15.59:0/2276976424 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a400bcc0 con 0x7fc8b40a0a30 2023-09-30T22:33:30.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.084+0000 7fc8b89b9700 1 -- 172.21.15.59:0/2276976424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b40a0a30 msgr2=0x7fc8b40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.084+0000 7fc8b89b9700 1 --2- 172.21.15.59:0/2276976424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b40a0a30 0x7fc8b40a0e00 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009e50 tx=0x7fc8a400b330 comp rx=0 tx=0).stop 2023-09-30T22:33:30.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.084+0000 7fc8b89b9700 1 -- 172.21.15.59:0/2276976424 shutdown_connections 2023-09-30T22:33:30.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.084+0000 7fc8b89b9700 1 --2- 172.21.15.59:0/2276976424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b40a0a30 0x7fc8b40a0e00 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.084+0000 7fc8b89b9700 1 --2- 172.21.15.59:0/2276976424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b4138d80 0x7fc8b413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.084+0000 7fc8b89b9700 1 -- 172.21.15.59:0/2276976424 >> 172.21.15.59:0/2276976424 conn(0x7fc8b40a3050 msgr2=0x7fc8b40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:30.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.084+0000 7fc8b89b9700 1 -- 172.21.15.59:0/2276976424 shutdown_connections 2023-09-30T22:33:30.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.084+0000 7fc8b89b9700 1 -- 172.21.15.59:0/2276976424 wait complete. 2023-09-30T22:33:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.085+0000 7fc8b89b9700 1 Processor -- start 2023-09-30T22:33:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.085+0000 7fc8b89b9700 1 -- start start 2023-09-30T22:33:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b89b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d630 0x7fc8b41339a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b89b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b40a0a30 0x7fc8b4133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b89b9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4138d80 0x7fc8b4134420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b89b9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b41371e0 con 0x7fc8b4138d80 2023-09-30T22:33:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b89b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b41381b0 con 0x7fc8b40a0a30 2023-09-30T22:33:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b89b9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b40a0410 con 0x7fc8b409d630 2023-09-30T22:33:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d630 0x7fc8b41339a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4138d80 0x7fc8b4134420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d630 0x7fc8b41339a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36972/0 (socket says 172.21.15.59:36972) 2023-09-30T22:33:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b259c700 1 -- 172.21.15.59:0/624582295 learned_addr learned my addr 172.21.15.59:0/624582295 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b1d9b700 1 --2- 172.21.15.59:0/624582295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b40a0a30 0x7fc8b4133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b2d9d700 1 -- 172.21.15.59:0/624582295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d630 msgr2=0x7fc8b41339a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b2d9d700 1 --2- 172.21.15.59:0/624582295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d630 0x7fc8b41339a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b2d9d700 1 -- 172.21.15.59:0/624582295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b40a0a30 msgr2=0x7fc8b4133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b2d9d700 1 --2- 172.21.15.59:0/624582295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b40a0a30 0x7fc8b4133ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b2d9d700 1 -- 172.21.15.59:0/624582295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac0094a0 con 0x7fc8b4138d80 2023-09-30T22:33:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b1d9b700 1 --2- 172.21.15.59:0/624582295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b40a0a30 0x7fc8b4133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.086+0000 7fc8b2d9d700 1 --2- 172.21.15.59:0/624582295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4138d80 0x7fc8b4134420 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009fd0 tx=0x7fc8ac00ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.087+0000 7fc8aaffd700 1 -- 172.21.15.59:0/624582295 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac013680 con 0x7fc8b4138d80 2023-09-30T22:33:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.087+0000 7fc8aaffd700 1 -- 172.21.15.59:0/624582295 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac013800 con 0x7fc8b4138d80 2023-09-30T22:33:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.087+0000 7fc8b89b9700 1 -- 172.21.15.59:0/624582295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a4009b30 con 0x7fc8b4138d80 2023-09-30T22:33:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.087+0000 7fc8aaffd700 1 -- 172.21.15.59:0/624582295 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac013bb0 con 0x7fc8b4138d80 2023-09-30T22:33:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.087+0000 7fc8b89b9700 1 -- 172.21.15.59:0/624582295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b40a4e10 con 0x7fc8b4138d80 2023-09-30T22:33:30.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.088+0000 7fc8aaffd700 1 -- 172.21.15.59:0/624582295 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8ac013d10 con 0x7fc8b4138d80 2023-09-30T22:33:30.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.088+0000 7fc8b89b9700 1 -- 172.21.15.59:0/624582295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b40747f0 con 0x7fc8b4138d80 2023-09-30T22:33:30.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.088+0000 7fc8aaffd700 1 -- 172.21.15.59:0/624582295 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc8ac03fab0 con 0x7fc8b4138d80 2023-09-30T22:33:30.093 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:30.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.097+0000 7fc8aaffd700 1 -- 172.21.15.59:0/624582295 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8ac01adc0 con 0x7fc8b4138d80 2023-09-30T22:33:30.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:30.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.128+0000 7f000022d700 1 Processor -- start 2023-09-30T22:33:30.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.128+0000 7f000022d700 1 -- start start 2023-09-30T22:33:30.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.128+0000 7f000022d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efff8131810 0x7efff8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.128+0000 7f000022d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff8099a40 0x7efff8099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.128+0000 7f000022d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff81313c0 con 0x7efff809a3b0 2023-09-30T22:33:30.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.128+0000 7f000022d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff809b580 con 0x7efff8131810 2023-09-30T22:33:30.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.128+0000 7f000022d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efff806e8c0 con 0x7efff8099a40 2023-09-30T22:33:30.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.129+0000 7efffdfc9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efff8131810 0x7efff8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.129+0000 7efffdfc9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efff8131810 0x7efff8131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53332/0 (socket says 172.21.15.59:53332) 2023-09-30T22:33:30.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.129+0000 7efffdfc9700 1 -- 172.21.15.59:0/2578033605 learned_addr learned my addr 172.21.15.59:0/2578033605 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:30.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.129+0000 7efffd7c8700 1 --2- 172.21.15.59:0/2578033605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff8099a40 0x7efff8099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.129+0000 7efffdfc9700 1 -- 172.21.15.59:0/2578033605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff8099a40 msgr2=0x7efff8099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:30.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.129+0000 7efffdfc9700 1 --2- 172.21.15.59:0/2578033605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff8099a40 0x7efff8099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.129+0000 7efffdfc9700 1 -- 172.21.15.59:0/2578033605 >> v1:172.21.15.59:6789/0 conn(0x7efff809a3b0 legacy=0x7efff8138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.129+0000 7efffdfc9700 1 -- 172.21.15.59:0/2578033605 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff809a830 con 0x7efff8131810 2023-09-30T22:33:30.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.129+0000 7efffdfc9700 1 --2- 172.21.15.59:0/2578033605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff8131810 0x7efff8131be0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7efff40098f0 tx=0x7efff4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bdd729a1fa9f776 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:30.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.130+0000 7efffcfc7700 1 -- 172.21.15.59:0/2578033605 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff400b8a0 con 0x7efff8131810 2023-09-30T22:33:30.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.130+0000 7efffcfc7700 1 -- 172.21.15.59:0/2578033605 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff400ba00 con 0x7efff8131810 2023-09-30T22:33:30.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.130+0000 7efffcfc7700 1 -- 172.21.15.59:0/2578033605 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff400bd90 con 0x7efff8131810 2023-09-30T22:33:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.130+0000 7f000022d700 1 -- 172.21.15.59:0/2578033605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff8131810 msgr2=0x7efff8131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.130+0000 7f000022d700 1 --2- 172.21.15.59:0/2578033605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff8131810 0x7efff8131be0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7efff40098f0 tx=0x7efff4009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.131+0000 7f000022d700 1 -- 172.21.15.59:0/2578033605 shutdown_connections 2023-09-30T22:33:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.131+0000 7f000022d700 1 --2- 172.21.15.59:0/2578033605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff8131810 0x7efff8131be0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.131+0000 7f000022d700 1 --2- 172.21.15.59:0/2578033605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff8099a40 0x7efff8099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.131+0000 7f000022d700 1 -- 172.21.15.59:0/2578033605 >> 172.21.15.59:0/2578033605 conn(0x7efff80a2aa0 msgr2=0x7efff80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.131+0000 7f000022d700 1 -- 172.21.15.59:0/2578033605 shutdown_connections 2023-09-30T22:33:30.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.131+0000 7f000022d700 1 -- 172.21.15.59:0/2578033605 wait complete. 2023-09-30T22:33:30.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.132+0000 7f000022d700 1 Processor -- start 2023-09-30T22:33:30.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.132+0000 7f000022d700 1 -- start start 2023-09-30T22:33:30.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.132+0000 7f000022d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff8099a40 0x7efff806f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.132+0000 7f000022d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff809a3b0 0x7efff806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.132+0000 7f000022d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff8131810 0x7efff8070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.132+0000 7f000022d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff8120370 con 0x7efff8099a40 2023-09-30T22:33:30.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.132+0000 7f000022d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff81210d0 con 0x7efff809a3b0 2023-09-30T22:33:30.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.132+0000 7f000022d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efff8120b40 con 0x7efff8131810 2023-09-30T22:33:30.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.133+0000 7efffd7c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff809a3b0 0x7efff806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.133+0000 7efffd7c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff809a3b0 0x7efff806fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58102/0 (socket says 172.21.15.59:58102) 2023-09-30T22:33:30.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.133+0000 7efffd7c8700 1 -- 172.21.15.59:0/3650887404 learned_addr learned my addr 172.21.15.59:0/3650887404 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:30.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.133+0000 7efffe7ca700 1 --2- 172.21.15.59:0/3650887404 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff8131810 0x7efff8070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.133+0000 7efffdfc9700 1 --2- 172.21.15.59:0/3650887404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff8099a40 0x7efff806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.133+0000 7efffd7c8700 1 -- 172.21.15.59:0/3650887404 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff8131810 msgr2=0x7efff8070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.133+0000 7efffd7c8700 1 --2- 172.21.15.59:0/3650887404 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff8131810 0x7efff8070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.133+0000 7efffd7c8700 1 -- 172.21.15.59:0/3650887404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff8099a40 msgr2=0x7efff806f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.133+0000 7efffd7c8700 1 --2- 172.21.15.59:0/3650887404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff8099a40 0x7efff806f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.133+0000 7efffd7c8700 1 -- 172.21.15.59:0/3650887404 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff4009550 con 0x7efff809a3b0 2023-09-30T22:33:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.133+0000 7efffdfc9700 1 --2- 172.21.15.59:0/3650887404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff8099a40 0x7efff806f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.133+0000 7efffd7c8700 1 --2- 172.21.15.59:0/3650887404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff809a3b0 0x7efff806fb50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7effe800e810 tx=0x7effe800eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.134+0000 7effee7fc700 1 -- 172.21.15.59:0/3650887404 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8013610 con 0x7efff809a3b0 2023-09-30T22:33:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.134+0000 7effee7fc700 1 -- 172.21.15.59:0/3650887404 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe8013770 con 0x7efff809a3b0 2023-09-30T22:33:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.134+0000 7effee7fc700 1 -- 172.21.15.59:0/3650887404 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8013b20 con 0x7efff809a3b0 2023-09-30T22:33:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.134+0000 7f000022d700 1 -- 172.21.15.59:0/3650887404 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff80a1a60 con 0x7efff809a3b0 2023-09-30T22:33:30.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.134+0000 7f000022d700 1 -- 172.21.15.59:0/3650887404 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff8120e10 con 0x7efff809a3b0 2023-09-30T22:33:30.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.135+0000 7f000022d700 1 -- 172.21.15.59:0/3650887404 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff8074ea0 con 0x7efff809a3b0 2023-09-30T22:33:30.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.135+0000 7effee7fc700 1 -- 172.21.15.59:0/3650887404 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effe8013c80 con 0x7efff809a3b0 2023-09-30T22:33:30.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.135+0000 7effee7fc700 1 -- 172.21.15.59:0/3650887404 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7effe803f390 con 0x7efff809a3b0 2023-09-30T22:33:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.140+0000 7effee7fc700 1 -- 172.21.15.59:0/3650887404 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effe8012370 con 0x7efff809a3b0 2023-09-30T22:33:30.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.238+0000 7fba15391700 1 Processor -- start 2023-09-30T22:33:30.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.238+0000 7fba15391700 1 -- start start 2023-09-30T22:33:30.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.239+0000 7fba15391700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1009d6f0 0x7fba1009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.239+0000 7fba15391700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba1009e410 0x7fba10130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.239+0000 7fba15391700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1009f130 con 0x7fba1009e000 2023-09-30T22:33:30.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.239+0000 7fba15391700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1009f520 con 0x7fba1009d6f0 2023-09-30T22:33:30.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.239+0000 7fba15391700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba1009e930 con 0x7fba1009e410 2023-09-30T22:33:30.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.239+0000 7fba0e7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fba1009e000 0x7fba10130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34990/0 (socket says 172.21.15.59:34990) 2023-09-30T22:33:30.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.239+0000 7fba0e7fc700 1 -- 172.21.15.59:0/173556560 learned_addr learned my addr 172.21.15.59:0/173556560 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:30.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.239+0000 7fba0effd700 1 --2- 172.21.15.59:0/173556560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1009d6f0 0x7fba1009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.239+0000 7fba0f7fe700 1 --2- 172.21.15.59:0/173556560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba1009e410 0x7fba10130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.239+0000 7fba0dffb700 1 -- 172.21.15.59:0/173556560 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321618515 0 0) 0x7fba1009f130 con 0x7fba1009e000 2023-09-30T22:33:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.239+0000 7fba0dffb700 1 -- 172.21.15.59:0/173556560 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9f80035b0 con 0x7fba1009e000 2023-09-30T22:33:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.239+0000 7fba0f7fe700 1 -- 172.21.15.59:0/173556560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1009d6f0 msgr2=0x7fba1009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.239+0000 7fba0f7fe700 1 --2- 172.21.15.59:0/173556560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1009d6f0 0x7fba1009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.239+0000 7fba0f7fe700 1 -- 172.21.15.59:0/173556560 >> v1:172.21.15.59:6789/0 conn(0x7fba1009e000 legacy=0x7fba10130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.239+0000 7fba0f7fe700 1 -- 172.21.15.59:0/173556560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1009b2d0 con 0x7fba1009e410 2023-09-30T22:33:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.240+0000 7fba0f7fe700 1 --2- 172.21.15.59:0/173556560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba1009e410 0x7fba10130d70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fba0800be60 tx=0x7fba08010730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da48ec3a69f9ea8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.240+0000 7fba0dffb700 1 -- 172.21.15.59:0/173556560 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0800b2d0 con 0x7fba1009e410 2023-09-30T22:33:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.240+0000 7fba0dffb700 1 -- 172.21.15.59:0/173556560 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08009540 con 0x7fba1009e410 2023-09-30T22:33:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.240+0000 7fba0dffb700 1 -- 172.21.15.59:0/173556560 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080098f0 con 0x7fba1009e410 2023-09-30T22:33:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.241+0000 7fba15391700 1 -- 172.21.15.59:0/173556560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba1009e410 msgr2=0x7fba10130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.241+0000 7fba15391700 1 --2- 172.21.15.59:0/173556560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba1009e410 0x7fba10130d70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fba0800be60 tx=0x7fba08010730 comp rx=0 tx=0).stop 2023-09-30T22:33:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.241+0000 7fba15391700 1 -- 172.21.15.59:0/173556560 shutdown_connections 2023-09-30T22:33:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.241+0000 7fba15391700 1 --2- 172.21.15.59:0/173556560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba1009e410 0x7fba10130d70 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.241+0000 7fba15391700 1 --2- 172.21.15.59:0/173556560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1009d6f0 0x7fba1009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.241+0000 7fba15391700 1 -- 172.21.15.59:0/173556560 >> 172.21.15.59:0/173556560 conn(0x7fba10066f50 msgr2=0x7fba1009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.241+0000 7fba15391700 1 -- 172.21.15.59:0/173556560 shutdown_connections 2023-09-30T22:33:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.241+0000 7fba15391700 1 -- 172.21.15.59:0/173556560 wait complete. 2023-09-30T22:33:30.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.242+0000 7fba15391700 1 Processor -- start 2023-09-30T22:33:30.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.242+0000 7fba15391700 1 -- start start 2023-09-30T22:33:30.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.242+0000 7fba15391700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1009d6f0 0x7fba1011ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba15391700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba1009e000 0x7fba1011e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba15391700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba1009e410 0x7fba1011e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba15391700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1011f270 con 0x7fba1009e410 2023-09-30T22:33:30.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba15391700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1011f930 con 0x7fba1009d6f0 2023-09-30T22:33:30.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba15391700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba10120b80 con 0x7fba1009e000 2023-09-30T22:33:30.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba0effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1009d6f0 0x7fba1011ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba0e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba1009e000 0x7fba1011e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba0effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1009d6f0 0x7fba1011ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58116/0 (socket says 172.21.15.59:58116) 2023-09-30T22:33:30.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba0effd700 1 -- 172.21.15.59:0/2466652043 learned_addr learned my addr 172.21.15.59:0/2466652043 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:30.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba0f7fe700 1 --2- 172.21.15.59:0/2466652043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba1009e410 0x7fba1011e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba0effd700 1 -- 172.21.15.59:0/2466652043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba1009e000 msgr2=0x7fba1011e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba0effd700 1 --2- 172.21.15.59:0/2466652043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba1009e000 0x7fba1011e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba0effd700 1 -- 172.21.15.59:0/2466652043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba1009e410 msgr2=0x7fba1011e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba0effd700 1 --2- 172.21.15.59:0/2466652043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba1009e410 0x7fba1011e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba0effd700 1 -- 172.21.15.59:0/2466652043 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0800ba90 con 0x7fba1009d6f0 2023-09-30T22:33:30.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba0f7fe700 1 --2- 172.21.15.59:0/2466652043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba1009e410 0x7fba1011e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:30.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.243+0000 7fba0effd700 1 --2- 172.21.15.59:0/2466652043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1009d6f0 0x7fba1011ddc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fba0000ea10 tx=0x7fba0000ed20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:30.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.244+0000 7fb9f77fe700 1 -- 172.21.15.59:0/2466652043 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00009710 con 0x7fba1009d6f0 2023-09-30T22:33:30.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.244+0000 7fb9f77fe700 1 -- 172.21.15.59:0/2466652043 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0000eeb0 con 0x7fba1009d6f0 2023-09-30T22:33:30.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.244+0000 7fba15391700 1 -- 172.21.15.59:0/2466652043 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba10121560 con 0x7fba1009d6f0 2023-09-30T22:33:30.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.244+0000 7fb9f77fe700 1 -- 172.21.15.59:0/2466652043 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0000ca50 con 0x7fba1009d6f0 2023-09-30T22:33:30.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.244+0000 7fba15391700 1 -- 172.21.15.59:0/2466652043 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba10121020 con 0x7fba1009d6f0 2023-09-30T22:33:30.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.245+0000 7fb9f77fe700 1 -- 172.21.15.59:0/2466652043 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba0000cbb0 con 0x7fba1009d6f0 2023-09-30T22:33:30.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.245+0000 7fba15391700 1 -- 172.21.15.59:0/2466652043 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1011ac20 con 0x7fba1009d6f0 2023-09-30T22:33:30.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.245+0000 7fb9f77fe700 1 -- 172.21.15.59:0/2466652043 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fba0003f6c0 con 0x7fba1009d6f0 2023-09-30T22:33:30.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.254+0000 7fb9f77fe700 1 -- 172.21.15.59:0/2466652043 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba00021020 con 0x7fba1009d6f0 2023-09-30T22:33:30.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.260+0000 7f8c64a10700 1 Processor -- start 2023-09-30T22:33:30.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.260+0000 7f8c64a10700 1 -- start start 2023-09-30T22:33:30.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c64a10700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c6009d6f0 0x7f8c6009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c64a10700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c6009e000 0x7f8c601339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c64a10700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c6009e410 0x7f8c60133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c64a10700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6006b460 con 0x7f8c6009e000 2023-09-30T22:33:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c64a10700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6009b120 con 0x7f8c6009e410 2023-09-30T22:33:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c64a10700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6009a7e0 con 0x7f8c6009d6f0 2023-09-30T22:33:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c5dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c6009e000 0x7f8c601339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c5dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c6009e000 0x7f8c601339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53364/0 (socket says 172.21.15.59:53364) 2023-09-30T22:33:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c5dd9b700 1 -- 172.21.15.59:0/3052184627 learned_addr learned my addr 172.21.15.59:0/3052184627 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c5e59c700 1 --2- 172.21.15.59:0/3052184627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c6009d6f0 0x7f8c6009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c5dd9b700 1 -- 172.21.15.59:0/3052184627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c6009d6f0 msgr2=0x7f8c6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c5dd9b700 1 --2- 172.21.15.59:0/3052184627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c6009d6f0 0x7f8c6009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c5dd9b700 1 -- 172.21.15.59:0/3052184627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c6009e410 msgr2=0x7f8c60133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c5dd9b700 1 --2- 172.21.15.59:0/3052184627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c6009e410 0x7f8c60133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c5dd9b700 1 -- 172.21.15.59:0/3052184627 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6009a500 con 0x7f8c6009e000 2023-09-30T22:33:30.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.261+0000 7f8c5dd9b700 1 --2- 172.21.15.59:0/3052184627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c6009e000 0x7f8c601339f0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f8c540098f0 tx=0x7f8c54009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab25feb5ea58933 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:30.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.262+0000 7f8c5d59a700 1 -- 172.21.15.59:0/3052184627 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c54011830 con 0x7f8c6009e000 2023-09-30T22:33:30.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.262+0000 7f8c5d59a700 1 -- 172.21.15.59:0/3052184627 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c54011990 con 0x7f8c6009e000 2023-09-30T22:33:30.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.262+0000 7f8c5d59a700 1 -- 172.21.15.59:0/3052184627 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c54011d20 con 0x7f8c6009e000 2023-09-30T22:33:30.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.262+0000 7f8c64a10700 1 -- 172.21.15.59:0/3052184627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c6009e000 msgr2=0x7f8c601339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.262+0000 7f8c64a10700 1 --2- 172.21.15.59:0/3052184627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c6009e000 0x7f8c601339f0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f8c540098f0 tx=0x7f8c54009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:30.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.262+0000 7f8c64a10700 1 -- 172.21.15.59:0/3052184627 shutdown_connections 2023-09-30T22:33:30.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.262+0000 7f8c64a10700 1 --2- 172.21.15.59:0/3052184627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c6009e410 0x7f8c60133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.262+0000 7f8c64a10700 1 --2- 172.21.15.59:0/3052184627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c6009d6f0 0x7f8c6009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.262+0000 7f8c64a10700 1 --2- 172.21.15.59:0/3052184627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c6009e000 0x7f8c601339f0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.262+0000 7f8c64a10700 1 -- 172.21.15.59:0/3052184627 >> 172.21.15.59:0/3052184627 conn(0x7f8c60066f50 msgr2=0x7f8c6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:30.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.263+0000 7f8c64a10700 1 -- 172.21.15.59:0/3052184627 shutdown_connections 2023-09-30T22:33:30.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.263+0000 7f8c64a10700 1 -- 172.21.15.59:0/3052184627 wait complete. 2023-09-30T22:33:30.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.264+0000 7f8c64a10700 1 Processor -- start 2023-09-30T22:33:30.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.264+0000 7f8c64a10700 1 -- start start 2023-09-30T22:33:30.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.264+0000 7f8c64a10700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c6009d6f0 0x7f8c601a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.264+0000 7f8c64a10700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c6009e000 0x7f8c601a6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.264+0000 7f8c64a10700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c6009e410 0x7f8c601a6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:30.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.265+0000 7f8c64a10700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c601a8ea0 con 0x7f8c6009e410 2023-09-30T22:33:30.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.265+0000 7f8c64a10700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c601a98f0 con 0x7f8c6009d6f0 2023-09-30T22:33:30.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.265+0000 7f8c64a10700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c601a7520 con 0x7f8c6009e000 2023-09-30T22:33:30.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.265+0000 7f8c5dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c6009e000 0x7f8c601a6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.265+0000 7f8c5dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c6009e000 0x7f8c601a6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37032/0 (socket says 172.21.15.59:37032) 2023-09-30T22:33:30.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.265+0000 7f8c5dd9b700 1 -- 172.21.15.59:0/2611869148 learned_addr learned my addr 172.21.15.59:0/2611869148 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:30.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.265+0000 7f8c5ed9d700 1 --2- 172.21.15.59:0/2611869148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c6009e410 0x7f8c601a6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:30.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.265+0000 7f8c5dd9b700 1 -- 172.21.15.59:0/2611869148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c6009d6f0 msgr2=0x7f8c601a6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.265+0000 7f8c5dd9b700 1 --2- 172.21.15.59:0/2611869148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c6009d6f0 0x7f8c601a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.265+0000 7f8c5dd9b700 1 -- 172.21.15.59:0/2611869148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c6009e410 msgr2=0x7f8c601a6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.265+0000 7f8c5dd9b700 1 --2- 172.21.15.59:0/2611869148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c6009e410 0x7f8c601a6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.265+0000 7f8c5dd9b700 1 -- 172.21.15.59:0/2611869148 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c54009550 con 0x7f8c6009e000 2023-09-30T22:33:30.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.265+0000 7f8c5dd9b700 1 --2- 172.21.15.59:0/2611869148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c6009e000 0x7f8c601a6640 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8c54013000 tx=0x7f8c54004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:30.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.265+0000 7f8c4effd700 1 -- 172.21.15.59:0/2611869148 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c54004240 con 0x7f8c6009e000 2023-09-30T22:33:30.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.266+0000 7f8c4effd700 1 -- 172.21.15.59:0/2611869148 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5401f070 con 0x7f8c6009e000 2023-09-30T22:33:30.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.266+0000 7f8c4effd700 1 -- 172.21.15.59:0/2611869148 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c540045c0 con 0x7f8c6009e000 2023-09-30T22:33:30.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.266+0000 7f8c64a10700 1 -- 172.21.15.59:0/2611869148 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c601a89e0 con 0x7f8c6009e000 2023-09-30T22:33:30.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.266+0000 7f8c64a10700 1 -- 172.21.15.59:0/2611869148 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c600a1f90 con 0x7f8c6009e000 2023-09-30T22:33:30.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.267+0000 7f8c4effd700 1 -- 172.21.15.59:0/2611869148 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c54021030 con 0x7f8c6009e000 2023-09-30T22:33:30.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.267+0000 7f8c64a10700 1 -- 172.21.15.59:0/2611869148 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c601a9b50 con 0x7f8c6009e000 2023-09-30T22:33:30.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.267+0000 7f8c4effd700 1 -- 172.21.15.59:0/2611869148 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8c540408a0 con 0x7f8c6009e000 2023-09-30T22:33:30.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.277+0000 7f8c4effd700 1 -- 172.21.15.59:0/2611869148 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c540197c0 con 0x7f8c6009e000 2023-09-30T22:33:30.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.321+0000 7fc8b89b9700 1 -- 172.21.15.59:0/624582295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc8b4135d80 con 0x7fc8b4138d80 2023-09-30T22:33:30.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.321+0000 7fc8aaffd700 1 -- 172.21.15.59:0/624582295 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8ac017070 con 0x7fc8b4138d80 2023-09-30T22:33:30.321 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:30.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.324+0000 7fc8b89b9700 1 -- 172.21.15.59:0/624582295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4138d80 msgr2=0x7fc8b4134420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.324+0000 7fc8b89b9700 1 --2- 172.21.15.59:0/624582295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4138d80 0x7fc8b4134420 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009fd0 tx=0x7fc8ac00ebe0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.324+0000 7fc8b89b9700 1 -- 172.21.15.59:0/624582295 shutdown_connections 2023-09-30T22:33:30.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.324+0000 7fc8b89b9700 1 --2- 172.21.15.59:0/624582295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8b409d630 0x7fc8b41339a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.324+0000 7fc8b89b9700 1 --2- 172.21.15.59:0/624582295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b4138d80 0x7fc8b4134420 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.324+0000 7fc8b89b9700 1 --2- 172.21.15.59:0/624582295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8b40a0a30 0x7fc8b4133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.324+0000 7fc8b89b9700 1 -- 172.21.15.59:0/624582295 >> 172.21.15.59:0/624582295 conn(0x7fc8b40a3050 msgr2=0x7fc8b409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:30.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.324+0000 7fc8b89b9700 1 -- 172.21.15.59:0/624582295 shutdown_connections 2023-09-30T22:33:30.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.324+0000 7fc8b89b9700 1 -- 172.21.15.59:0/624582295 wait complete. 2023-09-30T22:33:30.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:30.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.366+0000 7f000022d700 1 -- 172.21.15.59:0/3650887404 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efff8121210 con 0x7efff809a3b0 2023-09-30T22:33:30.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.366+0000 7effee7fc700 1 -- 172.21.15.59:0/3650887404 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efff8121210 con 0x7efff809a3b0 2023-09-30T22:33:30.366 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:30.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.369+0000 7f000022d700 1 -- 172.21.15.59:0/3650887404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff809a3b0 msgr2=0x7efff806fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.369+0000 7f000022d700 1 --2- 172.21.15.59:0/3650887404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff809a3b0 0x7efff806fb50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7effe800e810 tx=0x7effe800eb20 comp rx=0 tx=0).stop 2023-09-30T22:33:30.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.369+0000 7f000022d700 1 -- 172.21.15.59:0/3650887404 shutdown_connections 2023-09-30T22:33:30.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.369+0000 7f000022d700 1 --2- 172.21.15.59:0/3650887404 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff8131810 0x7efff8070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.369+0000 7f000022d700 1 --2- 172.21.15.59:0/3650887404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff8099a40 0x7efff806f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.369+0000 7f000022d700 1 --2- 172.21.15.59:0/3650887404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff809a3b0 0x7efff806fb50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.369+0000 7f000022d700 1 -- 172.21.15.59:0/3650887404 >> 172.21.15.59:0/3650887404 conn(0x7efff80a2aa0 msgr2=0x7efff81b8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:30.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.369+0000 7f000022d700 1 -- 172.21.15.59:0/3650887404 shutdown_connections 2023-09-30T22:33:30.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.369+0000 7f000022d700 1 -- 172.21.15.59:0/3650887404 wait complete. 2023-09-30T22:33:30.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:30.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.476+0000 7fba15391700 1 -- 172.21.15.59:0/2466652043 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fba10074ea0 con 0x7fba1009d6f0 2023-09-30T22:33:30.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.477+0000 7fb9f77fe700 1 -- 172.21.15.59:0/2466652043 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba000232f0 con 0x7fba1009d6f0 2023-09-30T22:33:30.477 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:30.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.479+0000 7fba15391700 1 -- 172.21.15.59:0/2466652043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1009d6f0 msgr2=0x7fba1011ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.479+0000 7fba15391700 1 --2- 172.21.15.59:0/2466652043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1009d6f0 0x7fba1011ddc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fba0000ea10 tx=0x7fba0000ed20 comp rx=0 tx=0).stop 2023-09-30T22:33:30.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.479+0000 7fba15391700 1 -- 172.21.15.59:0/2466652043 shutdown_connections 2023-09-30T22:33:30.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.479+0000 7fba15391700 1 --2- 172.21.15.59:0/2466652043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba1009e410 0x7fba1011e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.479+0000 7fba15391700 1 --2- 172.21.15.59:0/2466652043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1009d6f0 0x7fba1011ddc0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.479+0000 7fba15391700 1 --2- 172.21.15.59:0/2466652043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba1009e000 0x7fba1011e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.479+0000 7fba15391700 1 -- 172.21.15.59:0/2466652043 >> 172.21.15.59:0/2466652043 conn(0x7fba10066f50 msgr2=0x7fba10130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:30.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.479+0000 7fba15391700 1 -- 172.21.15.59:0/2466652043 shutdown_connections 2023-09-30T22:33:30.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.479+0000 7fba15391700 1 -- 172.21.15.59:0/2466652043 wait complete. 2023-09-30T22:33:30.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.486+0000 7f8c64a10700 1 -- 172.21.15.59:0/2611869148 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8c60074ea0 con 0x7f8c6009e000 2023-09-30T22:33:30.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.486+0000 7f8c4effd700 1 -- 172.21.15.59:0/2611869148 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c54015030 con 0x7f8c6009e000 2023-09-30T22:33:30.490 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:30.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.489+0000 7f8c64a10700 1 -- 172.21.15.59:0/2611869148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c6009e000 msgr2=0x7f8c601a6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:30.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.489+0000 7f8c64a10700 1 --2- 172.21.15.59:0/2611869148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c6009e000 0x7f8c601a6640 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8c54013000 tx=0x7f8c54004750 comp rx=0 tx=0).stop 2023-09-30T22:33:30.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.489+0000 7f8c64a10700 1 -- 172.21.15.59:0/2611869148 shutdown_connections 2023-09-30T22:33:30.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.489+0000 7f8c64a10700 1 --2- 172.21.15.59:0/2611869148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c6009e410 0x7f8c601a6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.489+0000 7f8c64a10700 1 --2- 172.21.15.59:0/2611869148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c6009d6f0 0x7f8c601a6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.489+0000 7f8c64a10700 1 --2- 172.21.15.59:0/2611869148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c6009e000 0x7f8c601a6640 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.489+0000 7f8c64a10700 1 -- 172.21.15.59:0/2611869148 >> 172.21.15.59:0/2611869148 conn(0x7f8c60066f50 msgr2=0x7f8c601baf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.489+0000 7f8c64a10700 1 -- 172.21.15.59:0/2611869148 shutdown_connections 2023-09-30T22:33:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:30.489+0000 7f8c64a10700 1 -- 172.21.15.59:0/2611869148 wait complete. 2023-09-30T22:33:30.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:30.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:31.346 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:31.383 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:31.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.495+0000 7fdb714fa700 1 Processor -- start 2023-09-30T22:33:31.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.495+0000 7fdb714fa700 1 -- start start 2023-09-30T22:33:31.495 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:31.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.495+0000 7fdb714fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6c09d630 0x7fdb6c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.495+0000 7fdb714fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6c138d80 0x7fdb6c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.495+0000 7fdb714fa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6c0a2a70 con 0x7fdb6c0a0a30 2023-09-30T22:33:31.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.495+0000 7fdb714fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0a01d0 con 0x7fdb6c09d630 2023-09-30T22:33:31.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.495+0000 7fdb714fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c09e2b0 con 0x7fdb6c138d80 2023-09-30T22:33:31.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.495+0000 7fdb6b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6c138d80 0x7fdb6c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.495+0000 7fdb6a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6c09d630 0x7fdb6c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.495+0000 7fdb6affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdb6c0a0a30 0x7fdb6c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35004/0 (socket says 172.21.15.59:35004) 2023-09-30T22:33:31.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.495+0000 7fdb6affd700 1 -- 172.21.15.59:0/3364545591 learned_addr learned my addr 172.21.15.59:0/3364545591 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:31.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.496+0000 7fdb6b7fe700 1 -- 172.21.15.59:0/3364545591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6c09d630 msgr2=0x7fdb6c0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:31.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.496+0000 7fdb6b7fe700 1 --2- 172.21.15.59:0/3364545591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6c09d630 0x7fdb6c0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.496+0000 7fdb69ffb700 1 -- 172.21.15.59:0/3364545591 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114042131 0 0) 0x7fdb6c0a2a70 con 0x7fdb6c0a0a30 2023-09-30T22:33:31.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.496+0000 7fdb6b7fe700 1 -- 172.21.15.59:0/3364545591 >> v1:172.21.15.59:6789/0 conn(0x7fdb6c0a0a30 legacy=0x7fdb6c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.496+0000 7fdb6b7fe700 1 -- 172.21.15.59:0/3364545591 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c09dc50 con 0x7fdb6c138d80 2023-09-30T22:33:31.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.496+0000 7fdb6a7fc700 1 --2- 172.21.15.59:0/3364545591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6c09d630 0x7fdb6c0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:31.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.496+0000 7fdb6b7fe700 1 --2- 172.21.15.59:0/3364545591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6c138d80 0x7fdb6c13b160 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009dc0 tx=0x7fdb6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2de1d0ebd18582 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:31.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.496+0000 7fdb69ffb700 1 -- 172.21.15.59:0/3364545591 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6400e070 con 0x7fdb6c138d80 2023-09-30T22:33:31.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.496+0000 7fdb69ffb700 1 -- 172.21.15.59:0/3364545591 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6400bb20 con 0x7fdb6c138d80 2023-09-30T22:33:31.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.496+0000 7fdb69ffb700 1 -- 172.21.15.59:0/3364545591 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64012430 con 0x7fdb6c138d80 2023-09-30T22:33:31.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.497+0000 7fdb714fa700 1 -- 172.21.15.59:0/3364545591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6c138d80 msgr2=0x7fdb6c13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.497+0000 7fdb714fa700 1 --2- 172.21.15.59:0/3364545591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6c138d80 0x7fdb6c13b160 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009dc0 tx=0x7fdb6400b330 comp rx=0 tx=0).stop 2023-09-30T22:33:31.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.497+0000 7fdb714fa700 1 -- 172.21.15.59:0/3364545591 shutdown_connections 2023-09-30T22:33:31.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.497+0000 7fdb714fa700 1 --2- 172.21.15.59:0/3364545591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6c138d80 0x7fdb6c13b160 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.497+0000 7fdb714fa700 1 --2- 172.21.15.59:0/3364545591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6c09d630 0x7fdb6c0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.497+0000 7fdb714fa700 1 -- 172.21.15.59:0/3364545591 >> 172.21.15.59:0/3364545591 conn(0x7fdb6c0a3050 msgr2=0x7fdb6c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:31.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.497+0000 7fdb714fa700 1 -- 172.21.15.59:0/3364545591 shutdown_connections 2023-09-30T22:33:31.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.497+0000 7fdb714fa700 1 -- 172.21.15.59:0/3364545591 wait complete. 2023-09-30T22:33:31.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.498+0000 7fdb714fa700 1 Processor -- start 2023-09-30T22:33:31.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.498+0000 7fdb714fa700 1 -- start start 2023-09-30T22:33:31.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.499+0000 7fdb714fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6c09d630 0x7fdb6c1336e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.499+0000 7fdb714fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6c0a0a30 0x7fdb6c133c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.499+0000 7fdb714fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6c138d80 0x7fdb6c134160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.499+0000 7fdb714fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c136170 con 0x7fdb6c0a0a30 2023-09-30T22:33:31.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.499+0000 7fdb714fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c134b40 con 0x7fdb6c138d80 2023-09-30T22:33:31.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.499+0000 7fdb714fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c136e90 con 0x7fdb6c09d630 2023-09-30T22:33:31.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.499+0000 7fdb6affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6c09d630 0x7fdb6c1336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.499+0000 7fdb6a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6c0a0a30 0x7fdb6c133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.499+0000 7fdb6affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6c09d630 0x7fdb6c1336e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37048/0 (socket says 172.21.15.59:37048) 2023-09-30T22:33:31.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.499+0000 7fdb6affd700 1 -- 172.21.15.59:0/130175138 learned_addr learned my addr 172.21.15.59:0/130175138 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:31.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.499+0000 7fdb6b7fe700 1 --2- 172.21.15.59:0/130175138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6c138d80 0x7fdb6c134160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.500+0000 7fdb6affd700 1 -- 172.21.15.59:0/130175138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6c138d80 msgr2=0x7fdb6c134160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.500+0000 7fdb6affd700 1 --2- 172.21.15.59:0/130175138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6c138d80 0x7fdb6c134160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.500+0000 7fdb6affd700 1 -- 172.21.15.59:0/130175138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6c0a0a30 msgr2=0x7fdb6c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.500+0000 7fdb6affd700 1 --2- 172.21.15.59:0/130175138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6c0a0a30 0x7fdb6c133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.500+0000 7fdb6affd700 1 -- 172.21.15.59:0/130175138 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb600094a0 con 0x7fdb6c09d630 2023-09-30T22:33:31.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.500+0000 7fdb6b7fe700 1 --2- 172.21.15.59:0/130175138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6c138d80 0x7fdb6c134160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:31.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.500+0000 7fdb6a7fc700 1 --2- 172.21.15.59:0/130175138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6c0a0a30 0x7fdb6c133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:31.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.500+0000 7fdb6affd700 1 --2- 172.21.15.59:0/130175138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6c09d630 0x7fdb6c1336e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00c520 tx=0x7fdb5c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:31.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.500+0000 7fdb537fe700 1 -- 172.21.15.59:0/130175138 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c004c80 con 0x7fdb6c09d630 2023-09-30T22:33:31.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.500+0000 7fdb537fe700 1 -- 172.21.15.59:0/130175138 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c004e00 con 0x7fdb6c09d630 2023-09-30T22:33:31.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.500+0000 7fdb537fe700 1 -- 172.21.15.59:0/130175138 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c007310 con 0x7fdb6c09d630 2023-09-30T22:33:31.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.500+0000 7fdb714fa700 1 -- 172.21.15.59:0/130175138 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb64009a70 con 0x7fdb6c09d630 2023-09-30T22:33:31.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.500+0000 7fdb714fa700 1 -- 172.21.15.59:0/130175138 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c0a0410 con 0x7fdb6c09d630 2023-09-30T22:33:31.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.501+0000 7fdb537fe700 1 -- 172.21.15.59:0/130175138 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb5c007470 con 0x7fdb6c09d630 2023-09-30T22:33:31.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.501+0000 7fdb537fe700 1 -- 172.21.15.59:0/130175138 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb5c03f310 con 0x7fdb6c09d630 2023-09-30T22:33:31.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.501+0000 7fdb714fa700 1 -- 172.21.15.59:0/130175138 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c0747f0 con 0x7fdb6c09d630 2023-09-30T22:33:31.507 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:31.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.507+0000 7fdb537fe700 1 -- 172.21.15.59:0/130175138 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb5c0123b0 con 0x7fdb6c09d630 2023-09-30T22:33:31.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.537+0000 7f9e2b5e5700 1 Processor -- start 2023-09-30T22:33:31.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.537+0000 7f9e2b5e5700 1 -- start start 2023-09-30T22:33:31.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.538+0000 7f9e2b5e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e24133420 0x7f9e241337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.538+0000 7f9e2b5e5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e24134260 0x7f9e241306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.538+0000 7f9e2b5e5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e2406b990 con 0x7f9e24133e30 2023-09-30T22:33:31.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.538+0000 7f9e2b5e5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e240a0590 con 0x7f9e24133420 2023-09-30T22:33:31.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.538+0000 7f9e2b5e5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2409fb80 con 0x7f9e24134260 2023-09-30T22:33:31.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.538+0000 7f9e28b80700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9e24133e30 0x7f9e2412ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35014/0 (socket says 172.21.15.59:35014) 2023-09-30T22:33:31.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.538+0000 7f9e28b80700 1 -- 172.21.15.59:0/3845676485 learned_addr learned my addr 172.21.15.59:0/3845676485 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:31.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.538+0000 7f9e29381700 1 --2- 172.21.15.59:0/3845676485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e24133420 0x7f9e241337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.538+0000 7f9e1bfff700 1 -- 172.21.15.59:0/3845676485 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956812251 0 0) 0x7f9e2406b990 con 0x7f9e24133e30 2023-09-30T22:33:31.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.538+0000 7f9e1bfff700 1 -- 172.21.15.59:0/3845676485 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e100035b0 con 0x7f9e24133e30 2023-09-30T22:33:31.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.538+0000 7f9e29381700 1 -- 172.21.15.59:0/3845676485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e24134260 msgr2=0x7f9e241306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:31.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.538+0000 7f9e29381700 1 --2- 172.21.15.59:0/3845676485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e24134260 0x7f9e241306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.538+0000 7f9e29381700 1 -- 172.21.15.59:0/3845676485 >> v1:172.21.15.59:6789/0 conn(0x7f9e24133e30 legacy=0x7f9e2412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.538+0000 7f9e29381700 1 -- 172.21.15.59:0/3845676485 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e240a0030 con 0x7f9e24133420 2023-09-30T22:33:31.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.539+0000 7f9e29381700 1 --2- 172.21.15.59:0/3845676485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e24133420 0x7f9e241337f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009870 tx=0x7f9e20009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7bec2091a716adb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:31.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.539+0000 7f9e1bfff700 1 -- 172.21.15.59:0/3845676485 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e20004230 con 0x7f9e24133420 2023-09-30T22:33:31.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.539+0000 7f9e1bfff700 1 -- 172.21.15.59:0/3845676485 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e20004390 con 0x7f9e24133420 2023-09-30T22:33:31.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.539+0000 7f9e1bfff700 1 -- 172.21.15.59:0/3845676485 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e200036a0 con 0x7f9e24133420 2023-09-30T22:33:31.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.540+0000 7f9e2b5e5700 1 -- 172.21.15.59:0/3845676485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e24133420 msgr2=0x7f9e241337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.540+0000 7f9e2b5e5700 1 --2- 172.21.15.59:0/3845676485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e24133420 0x7f9e241337f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009870 tx=0x7f9e20009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:31.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.540+0000 7f9e2b5e5700 1 -- 172.21.15.59:0/3845676485 shutdown_connections 2023-09-30T22:33:31.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.540+0000 7f9e2b5e5700 1 --2- 172.21.15.59:0/3845676485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e24134260 0x7f9e241306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.540+0000 7f9e2b5e5700 1 --2- 172.21.15.59:0/3845676485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e24133420 0x7f9e241337f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.540+0000 7f9e2b5e5700 1 -- 172.21.15.59:0/3845676485 >> 172.21.15.59:0/3845676485 conn(0x7f9e240a4210 msgr2=0x7f9e240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:31.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.540+0000 7f9e2b5e5700 1 -- 172.21.15.59:0/3845676485 shutdown_connections 2023-09-30T22:33:31.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.540+0000 7f9e2b5e5700 1 -- 172.21.15.59:0/3845676485 wait complete. 2023-09-30T22:33:31.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.541+0000 7f9e2b5e5700 1 Processor -- start 2023-09-30T22:33:31.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.542+0000 7f9e2b5e5700 1 -- start start 2023-09-30T22:33:31.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.542+0000 7f9e2b5e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e24133420 0x7f9e2409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.542+0000 7f9e2b5e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e24133e30 0x7f9e2409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.542+0000 7f9e2b5e5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e24134260 0x7f9e2409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.542+0000 7f9e2b5e5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2412dca0 con 0x7f9e24133420 2023-09-30T22:33:31.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.542+0000 7f9e2b5e5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e24131620 con 0x7f9e24133e30 2023-09-30T22:33:31.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.542+0000 7f9e2b5e5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2409df30 con 0x7f9e24134260 2023-09-30T22:33:31.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.542+0000 7f9e29381700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e24133420 0x7f9e2409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.542+0000 7f9e29b82700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e24134260 0x7f9e2409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.542+0000 7f9e29b82700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e24134260 0x7f9e2409cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37066/0 (socket says 172.21.15.59:37066) 2023-09-30T22:33:31.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.542+0000 7f9e29381700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e24133420 0x7f9e2409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53404/0 (socket says 172.21.15.59:53404) 2023-09-30T22:33:31.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.542+0000 7f9e29b82700 1 -- 172.21.15.59:0/2136912066 learned_addr learned my addr 172.21.15.59:0/2136912066 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:31.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.543+0000 7f9e29b82700 1 -- 172.21.15.59:0/2136912066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e24133e30 msgr2=0x7f9e2409c9c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T22:33:31.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.543+0000 7f9e29b82700 1 --2- 172.21.15.59:0/2136912066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e24133e30 0x7f9e2409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.543+0000 7f9e29b82700 1 -- 172.21.15.59:0/2136912066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e24133420 msgr2=0x7f9e2409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.543+0000 7f9e29b82700 1 --2- 172.21.15.59:0/2136912066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e24133420 0x7f9e2409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.543+0000 7f9e29b82700 1 -- 172.21.15.59:0/2136912066 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e200094a0 con 0x7f9e24134260 2023-09-30T22:33:31.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.543+0000 7f9e29381700 1 --2- 172.21.15.59:0/2136912066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e24133420 0x7f9e2409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:31.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.543+0000 7f9e29b82700 1 --2- 172.21.15.59:0/2136912066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e24134260 0x7f9e2409cf00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00b9e0 tx=0x7f9e1c00bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:31.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.543+0000 7f9e19ffb700 1 -- 172.21.15.59:0/2136912066 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00d8e0 con 0x7f9e24134260 2023-09-30T22:33:31.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.543+0000 7f9e19ffb700 1 -- 172.21.15.59:0/2136912066 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c00da60 con 0x7f9e24134260 2023-09-30T22:33:31.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.543+0000 7f9e2b5e5700 1 -- 172.21.15.59:0/2136912066 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2409d850 con 0x7f9e24134260 2023-09-30T22:33:31.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.543+0000 7f9e19ffb700 1 -- 172.21.15.59:0/2136912066 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00de10 con 0x7f9e24134260 2023-09-30T22:33:31.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.544+0000 7f9e2b5e5700 1 -- 172.21.15.59:0/2136912066 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2411ff40 con 0x7f9e24134260 2023-09-30T22:33:31.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.544+0000 7f9e19ffb700 1 -- 172.21.15.59:0/2136912066 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e1c015420 con 0x7f9e24134260 2023-09-30T22:33:31.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.545+0000 7f9e19ffb700 1 -- 172.21.15.59:0/2136912066 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9e1c011070 con 0x7f9e24134260 2023-09-30T22:33:31.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.545+0000 7f9e2b5e5700 1 -- 172.21.15.59:0/2136912066 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e24074ea0 con 0x7f9e24134260 2023-09-30T22:33:31.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.550+0000 7f9e19ffb700 1 -- 172.21.15.59:0/2136912066 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e1c0136f0 con 0x7f9e24134260 2023-09-30T22:33:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.658+0000 7f159e16b700 1 Processor -- start 2023-09-30T22:33:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.658+0000 7f159e16b700 1 -- start start 2023-09-30T22:33:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.659+0000 7f159e16b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f159809d6f0 0x7f159809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.659+0000 7f159e16b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159809e000 0x7f15981339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.659+0000 7f159e16b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159809b120 con 0x7f159809e410 2023-09-30T22:33:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.659+0000 7f159e16b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159806b460 con 0x7f159809e000 2023-09-30T22:33:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.659+0000 7f159e16b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f159809a7e0 con 0x7f159809d6f0 2023-09-30T22:33:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.659+0000 7f1597fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f159809e410 0x7f1598133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35026/0 (socket says 172.21.15.59:35026) 2023-09-30T22:33:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.659+0000 7f1597fff700 1 -- 172.21.15.59:0/2091226860 learned_addr learned my addr 172.21.15.59:0/2091226860 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.659+0000 7f15977fe700 1 --2- 172.21.15.59:0/2091226860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f159809d6f0 0x7f159809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.659+0000 7f1596ffd700 1 --2- 172.21.15.59:0/2091226860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159809e000 0x7f15981339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.659+0000 7f15967fc700 1 -- 172.21.15.59:0/2091226860 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369465650 0 0) 0x7f159809b120 con 0x7f159809e410 2023-09-30T22:33:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.659+0000 7f15967fc700 1 -- 172.21.15.59:0/2091226860 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15800035b0 con 0x7f159809e410 2023-09-30T22:33:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.660+0000 7f1596ffd700 1 -- 172.21.15.59:0/2091226860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f159809d6f0 msgr2=0x7f159809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.660+0000 7f1596ffd700 1 --2- 172.21.15.59:0/2091226860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f159809d6f0 0x7f159809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.660+0000 7f1596ffd700 1 -- 172.21.15.59:0/2091226860 >> v1:172.21.15.59:6789/0 conn(0x7f159809e410 legacy=0x7f1598133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.660+0000 7f1596ffd700 1 -- 172.21.15.59:0/2091226860 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159809a500 con 0x7f159809e000 2023-09-30T22:33:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.660+0000 7f1596ffd700 1 --2- 172.21.15.59:0/2091226860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159809e000 0x7f15981339f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f158c009870 tx=0x7f158c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c80de33e6f500943 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.660+0000 7f15967fc700 1 -- 172.21.15.59:0/2091226860 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c011830 con 0x7f159809e000 2023-09-30T22:33:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.660+0000 7f15967fc700 1 -- 172.21.15.59:0/2091226860 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c011990 con 0x7f159809e000 2023-09-30T22:33:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.660+0000 7f15967fc700 1 -- 172.21.15.59:0/2091226860 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c011d20 con 0x7f159809e000 2023-09-30T22:33:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.661+0000 7f159e16b700 1 -- 172.21.15.59:0/2091226860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159809e000 msgr2=0x7f15981339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.661+0000 7f159e16b700 1 --2- 172.21.15.59:0/2091226860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159809e000 0x7f15981339f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f158c009870 tx=0x7f158c009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.661+0000 7f159e16b700 1 -- 172.21.15.59:0/2091226860 shutdown_connections 2023-09-30T22:33:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.661+0000 7f159e16b700 1 --2- 172.21.15.59:0/2091226860 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f159809d6f0 0x7f159809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.661+0000 7f159e16b700 1 --2- 172.21.15.59:0/2091226860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159809e000 0x7f15981339f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.661+0000 7f159e16b700 1 -- 172.21.15.59:0/2091226860 >> 172.21.15.59:0/2091226860 conn(0x7f1598066f50 msgr2=0x7f159809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.661+0000 7f159e16b700 1 -- 172.21.15.59:0/2091226860 shutdown_connections 2023-09-30T22:33:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.661+0000 7f159e16b700 1 -- 172.21.15.59:0/2091226860 wait complete. 2023-09-30T22:33:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.663+0000 7f159e16b700 1 Processor -- start 2023-09-30T22:33:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.663+0000 7f159e16b700 1 -- start start 2023-09-30T22:33:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f159e16b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f159809d6f0 0x7f15981224d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f159e16b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159809e000 0x7f1598122a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f159e16b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159809e410 0x7f1598122f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f159e16b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1598125a50 con 0x7f159809e000 2023-09-30T22:33:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f159e16b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159809c710 con 0x7f159809e410 2023-09-30T22:33:31.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f159e16b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1598123930 con 0x7f159809d6f0 2023-09-30T22:33:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f1597fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159809e410 0x7f1598122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f1596ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159809e000 0x7f1598122a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f1597fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159809e410 0x7f1598122f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58204/0 (socket says 172.21.15.59:58204) 2023-09-30T22:33:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f1597fff700 1 -- 172.21.15.59:0/3816410069 learned_addr learned my addr 172.21.15.59:0/3816410069 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f15977fe700 1 --2- 172.21.15.59:0/3816410069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f159809d6f0 0x7f15981224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f15977fe700 1 -- 172.21.15.59:0/3816410069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159809e410 msgr2=0x7f1598122f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f15977fe700 1 --2- 172.21.15.59:0/3816410069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159809e410 0x7f1598122f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f15977fe700 1 -- 172.21.15.59:0/3816410069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159809e000 msgr2=0x7f1598122a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f15977fe700 1 --2- 172.21.15.59:0/3816410069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159809e000 0x7f1598122a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f15977fe700 1 -- 172.21.15.59:0/3816410069 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c0094a0 con 0x7f159809d6f0 2023-09-30T22:33:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f1596ffd700 1 --2- 172.21.15.59:0/3816410069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159809e000 0x7f1598122a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.664+0000 7f1597fff700 1 --2- 172.21.15.59:0/3816410069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159809e410 0x7f1598122f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.665+0000 7f15977fe700 1 --2- 172.21.15.59:0/3816410069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f159809d6f0 0x7f15981224d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f158800e900 tx=0x7f158800ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.665+0000 7f157ffff700 1 -- 172.21.15.59:0/3816410069 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588013680 con 0x7f159809d6f0 2023-09-30T22:33:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.665+0000 7f157ffff700 1 -- 172.21.15.59:0/3816410069 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15880137e0 con 0x7f159809d6f0 2023-09-30T22:33:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.665+0000 7f157ffff700 1 -- 172.21.15.59:0/3816410069 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588013b50 con 0x7f159809d6f0 2023-09-30T22:33:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.665+0000 7f159e16b700 1 -- 172.21.15.59:0/3816410069 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1598125ff0 con 0x7f159809d6f0 2023-09-30T22:33:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.665+0000 7f159e16b700 1 -- 172.21.15.59:0/3816410069 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1598125d10 con 0x7f159809d6f0 2023-09-30T22:33:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.666+0000 7f159e16b700 1 -- 172.21.15.59:0/3816410069 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1598124930 con 0x7f159809d6f0 2023-09-30T22:33:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.667+0000 7f157ffff700 1 -- 172.21.15.59:0/3816410069 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1588013cb0 con 0x7f159809d6f0 2023-09-30T22:33:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.667+0000 7f157ffff700 1 -- 172.21.15.59:0/3816410069 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f158803f760 con 0x7f159809d6f0 2023-09-30T22:33:31.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.672+0000 7f157ffff700 1 -- 172.21.15.59:0/3816410069 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f158801be10 con 0x7f159809d6f0 2023-09-30T22:33:31.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.676+0000 7fb13af8c700 1 Processor -- start 2023-09-30T22:33:31.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.677+0000 7fb13af8c700 1 -- start start 2023-09-30T22:33:31.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.677+0000 7fb13af8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb13409d6f0 0x7fb13409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.677+0000 7fb13af8c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb13409e000 0x7fb134130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.677+0000 7fb13af8c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb13409e410 0x7fb134130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.677+0000 7fb13af8c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13409f520 con 0x7fb13409e410 2023-09-30T22:33:31.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.677+0000 7fb13af8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13409f130 con 0x7fb13409d6f0 2023-09-30T22:33:31.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.677+0000 7fb13af8c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb13409e930 con 0x7fb13409e000 2023-09-30T22:33:31.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.677+0000 7fb139529700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb13409e410 0x7fb134130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.677+0000 7fb138d28700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb13409d6f0 0x7fb13409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.677+0000 7fb139529700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb13409e410 0x7fb134130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53434/0 (socket says 172.21.15.59:53434) 2023-09-30T22:33:31.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.677+0000 7fb139529700 1 -- 172.21.15.59:0/3355155692 learned_addr learned my addr 172.21.15.59:0/3355155692 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.678+0000 7fb138d28700 1 -- 172.21.15.59:0/3355155692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb13409e000 msgr2=0x7fb134130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.678+0000 7fb138d28700 1 --2- 172.21.15.59:0/3355155692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb13409e000 0x7fb134130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.678+0000 7fb138d28700 1 -- 172.21.15.59:0/3355155692 >> v2:172.21.15.59:3300/0 conn(0x7fb13409e410 msgr2=0x7fb134130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.678+0000 7fb138d28700 1 --2- 172.21.15.59:0/3355155692 >> v2:172.21.15.59:3300/0 conn(0x7fb13409e410 0x7fb134130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.678+0000 7fb138d28700 1 -- 172.21.15.59:0/3355155692 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13409b2d0 con 0x7fb13409d6f0 2023-09-30T22:33:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.678+0000 7fb139529700 1 --2- 172.21.15.59:0/3355155692 >> v2:172.21.15.59:3300/0 conn(0x7fb13409e410 0x7fb134130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.678+0000 7fb138d28700 1 --2- 172.21.15.59:0/3355155692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb13409d6f0 0x7fb13409dac0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb128009870 tx=0x7fb128009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74efac0972525770 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.678+0000 7fb1337fe700 1 -- 172.21.15.59:0/3355155692 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb128011830 con 0x7fb13409d6f0 2023-09-30T22:33:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.678+0000 7fb1337fe700 1 -- 172.21.15.59:0/3355155692 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb128011990 con 0x7fb13409d6f0 2023-09-30T22:33:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.678+0000 7fb1337fe700 1 -- 172.21.15.59:0/3355155692 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb128011d20 con 0x7fb13409d6f0 2023-09-30T22:33:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.679+0000 7fb13af8c700 1 -- 172.21.15.59:0/3355155692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb13409d6f0 msgr2=0x7fb13409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.679+0000 7fb13af8c700 1 --2- 172.21.15.59:0/3355155692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb13409d6f0 0x7fb13409dac0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb128009870 tx=0x7fb128009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.679+0000 7fb13af8c700 1 -- 172.21.15.59:0/3355155692 shutdown_connections 2023-09-30T22:33:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.679+0000 7fb13af8c700 1 --2- 172.21.15.59:0/3355155692 >> v2:172.21.15.59:3300/0 conn(0x7fb13409e410 0x7fb134130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.679+0000 7fb13af8c700 1 --2- 172.21.15.59:0/3355155692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb13409d6f0 0x7fb13409dac0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.679+0000 7fb13af8c700 1 --2- 172.21.15.59:0/3355155692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb13409e000 0x7fb134130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.679+0000 7fb13af8c700 1 -- 172.21.15.59:0/3355155692 >> 172.21.15.59:0/3355155692 conn(0x7fb134066f50 msgr2=0x7fb13409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:31.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.679+0000 7fb13af8c700 1 -- 172.21.15.59:0/3355155692 shutdown_connections 2023-09-30T22:33:31.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.679+0000 7fb13af8c700 1 -- 172.21.15.59:0/3355155692 wait complete. 2023-09-30T22:33:31.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.680+0000 7fb13af8c700 1 Processor -- start 2023-09-30T22:33:31.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.680+0000 7fb13af8c700 1 -- start start 2023-09-30T22:33:31.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.681+0000 7fb13af8c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb13409d6f0 0x7fb13412e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.681+0000 7fb13af8c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb13409e000 0x7fb1341cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.681+0000 7fb13af8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb13409e410 0x7fb1341cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.681+0000 7fb13af8c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13406b500 con 0x7fb13409d6f0 2023-09-30T22:33:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.681+0000 7fb13af8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13412e230 con 0x7fb13409e410 2023-09-30T22:33:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.681+0000 7fb13af8c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1341302c0 con 0x7fb13409e000 2023-09-30T22:33:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.681+0000 7fb133fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb13409e000 0x7fb1341cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.681+0000 7fb133fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb13409e000 0x7fb1341cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37100/0 (socket says 172.21.15.59:37100) 2023-09-30T22:33:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.681+0000 7fb133fff700 1 -- 172.21.15.59:0/2961213339 learned_addr learned my addr 172.21.15.59:0/2961213339 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.682+0000 7fb138d28700 1 --2- 172.21.15.59:0/2961213339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb13409d6f0 0x7fb13412e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.682+0000 7fb133fff700 1 -- 172.21.15.59:0/2961213339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb13409e410 msgr2=0x7fb1341cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.682+0000 7fb133fff700 1 --2- 172.21.15.59:0/2961213339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb13409e410 0x7fb1341cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.682+0000 7fb133fff700 1 -- 172.21.15.59:0/2961213339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb13409d6f0 msgr2=0x7fb13412e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.682+0000 7fb133fff700 1 --2- 172.21.15.59:0/2961213339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb13409d6f0 0x7fb13412e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.682+0000 7fb133fff700 1 -- 172.21.15.59:0/2961213339 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c009b30 con 0x7fb13409e000 2023-09-30T22:33:31.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.682+0000 7fb133fff700 1 --2- 172.21.15.59:0/2961213339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb13409e000 0x7fb1341cc530 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb12000b500 tx=0x7fb12000b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:31.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.682+0000 7fb1317fa700 1 -- 172.21.15.59:0/2961213339 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120011830 con 0x7fb13409e000 2023-09-30T22:33:31.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.682+0000 7fb1317fa700 1 -- 172.21.15.59:0/2961213339 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1200119b0 con 0x7fb13409e000 2023-09-30T22:33:31.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.682+0000 7fb1317fa700 1 -- 172.21.15.59:0/2961213339 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120011d60 con 0x7fb13409e000 2023-09-30T22:33:31.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.683+0000 7fb13af8c700 1 -- 172.21.15.59:0/2961213339 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1280094a0 con 0x7fb13409e000 2023-09-30T22:33:31.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.683+0000 7fb13af8c700 1 -- 172.21.15.59:0/2961213339 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13411f230 con 0x7fb13409e000 2023-09-30T22:33:31.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.684+0000 7fb13af8c700 1 -- 172.21.15.59:0/2961213339 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13411c340 con 0x7fb13409e000 2023-09-30T22:33:31.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.684+0000 7fb1317fa700 1 -- 172.21.15.59:0/2961213339 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb12001a400 con 0x7fb13409e000 2023-09-30T22:33:31.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.684+0000 7fb1317fa700 1 -- 172.21.15.59:0/2961213339 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb12003f630 con 0x7fb13409e000 2023-09-30T22:33:31.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.693+0000 7fb1317fa700 1 -- 172.21.15.59:0/2961213339 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb12000f2e0 con 0x7fb13409e000 2023-09-30T22:33:31.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.732+0000 7fdb714fa700 1 -- 172.21.15.59:0/130175138 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb6c072980 con 0x7fdb6c09d630 2023-09-30T22:33:31.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.733+0000 7fdb537fe700 1 -- 172.21.15.59:0/130175138 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb5c011360 con 0x7fdb6c09d630 2023-09-30T22:33:31.733 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.736+0000 7fdb714fa700 1 -- 172.21.15.59:0/130175138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6c09d630 msgr2=0x7fdb6c1336e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.736+0000 7fdb714fa700 1 --2- 172.21.15.59:0/130175138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6c09d630 0x7fdb6c1336e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00c520 tx=0x7fdb5c00c830 comp rx=0 tx=0).stop 2023-09-30T22:33:31.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.737+0000 7fdb714fa700 1 -- 172.21.15.59:0/130175138 shutdown_connections 2023-09-30T22:33:31.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.737+0000 7fdb714fa700 1 --2- 172.21.15.59:0/130175138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6c09d630 0x7fdb6c1336e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.737+0000 7fdb714fa700 1 --2- 172.21.15.59:0/130175138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6c138d80 0x7fdb6c134160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.737+0000 7fdb714fa700 1 --2- 172.21.15.59:0/130175138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6c0a0a30 0x7fdb6c133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.737+0000 7fdb714fa700 1 -- 172.21.15.59:0/130175138 >> 172.21.15.59:0/130175138 conn(0x7fdb6c0a3050 msgr2=0x7fdb6c13ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:31.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.737+0000 7fdb714fa700 1 -- 172.21.15.59:0/130175138 shutdown_connections 2023-09-30T22:33:31.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.737+0000 7fdb714fa700 1 -- 172.21.15.59:0/130175138 wait complete. 2023-09-30T22:33:31.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:31.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.832+0000 7f9e2b5e5700 1 -- 172.21.15.59:0/2136912066 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9e24120a10 con 0x7f9e24134260 2023-09-30T22:33:31.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.832+0000 7f9e19ffb700 1 -- 172.21.15.59:0/2136912066 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e1c022030 con 0x7f9e24134260 2023-09-30T22:33:31.833 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.835+0000 7f9e2b5e5700 1 -- 172.21.15.59:0/2136912066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e24134260 msgr2=0x7f9e2409cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.835+0000 7f9e2b5e5700 1 --2- 172.21.15.59:0/2136912066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e24134260 0x7f9e2409cf00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00b9e0 tx=0x7f9e1c00bcf0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.835+0000 7f9e2b5e5700 1 -- 172.21.15.59:0/2136912066 shutdown_connections 2023-09-30T22:33:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.835+0000 7f9e2b5e5700 1 --2- 172.21.15.59:0/2136912066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e24134260 0x7f9e2409cf00 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.835+0000 7f9e2b5e5700 1 --2- 172.21.15.59:0/2136912066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e24133420 0x7f9e2409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.835+0000 7f9e2b5e5700 1 --2- 172.21.15.59:0/2136912066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e24133e30 0x7f9e2409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.835+0000 7f9e2b5e5700 1 -- 172.21.15.59:0/2136912066 >> 172.21.15.59:0/2136912066 conn(0x7f9e240a4210 msgr2=0x7f9e2412de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.836+0000 7f9e2b5e5700 1 -- 172.21.15.59:0/2136912066 shutdown_connections 2023-09-30T22:33:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.836+0000 7f9e2b5e5700 1 -- 172.21.15.59:0/2136912066 wait complete. 2023-09-30T22:33:31.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:31.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.894+0000 7f159e16b700 1 -- 172.21.15.59:0/3816410069 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1598074ea0 con 0x7f159809d6f0 2023-09-30T22:33:31.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.894+0000 7f157ffff700 1 -- 172.21.15.59:0/3816410069 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f158801b3b0 con 0x7f159809d6f0 2023-09-30T22:33:31.894 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:31.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.896+0000 7f159e16b700 1 -- 172.21.15.59:0/3816410069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f159809d6f0 msgr2=0x7f15981224d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.896+0000 7f159e16b700 1 --2- 172.21.15.59:0/3816410069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f159809d6f0 0x7f15981224d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f158800e900 tx=0x7f158800ec10 comp rx=0 tx=0).stop 2023-09-30T22:33:31.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.896+0000 7f159e16b700 1 -- 172.21.15.59:0/3816410069 shutdown_connections 2023-09-30T22:33:31.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.896+0000 7f159e16b700 1 --2- 172.21.15.59:0/3816410069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f159809d6f0 0x7f15981224d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.896+0000 7f159e16b700 1 --2- 172.21.15.59:0/3816410069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159809e410 0x7f1598122f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.896+0000 7f159e16b700 1 --2- 172.21.15.59:0/3816410069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159809e000 0x7f1598122a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.896+0000 7f159e16b700 1 -- 172.21.15.59:0/3816410069 >> 172.21.15.59:0/3816410069 conn(0x7f1598066f50 msgr2=0x7f1598133f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:31.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.896+0000 7f159e16b700 1 -- 172.21.15.59:0/3816410069 shutdown_connections 2023-09-30T22:33:31.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.896+0000 7f159e16b700 1 -- 172.21.15.59:0/3816410069 wait complete. 2023-09-30T22:33:31.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:31.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.928+0000 7fb13af8c700 1 -- 172.21.15.59:0/2961213339 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb134074ea0 con 0x7fb13409e000 2023-09-30T22:33:31.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.929+0000 7fb1317fa700 1 -- 172.21.15.59:0/2961213339 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb120015030 con 0x7fb13409e000 2023-09-30T22:33:31.929 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:31.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.931+0000 7fb13af8c700 1 -- 172.21.15.59:0/2961213339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb13409e000 msgr2=0x7fb1341cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:31.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.931+0000 7fb13af8c700 1 --2- 172.21.15.59:0/2961213339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb13409e000 0x7fb1341cc530 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb12000b500 tx=0x7fb12000b8c0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.931+0000 7fb13af8c700 1 -- 172.21.15.59:0/2961213339 shutdown_connections 2023-09-30T22:33:31.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.931+0000 7fb13af8c700 1 --2- 172.21.15.59:0/2961213339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb13409e410 0x7fb1341cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.931+0000 7fb13af8c700 1 --2- 172.21.15.59:0/2961213339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb13409d6f0 0x7fb13412e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.931+0000 7fb13af8c700 1 --2- 172.21.15.59:0/2961213339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb13409e000 0x7fb1341cc530 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:31.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.931+0000 7fb13af8c700 1 -- 172.21.15.59:0/2961213339 >> 172.21.15.59:0/2961213339 conn(0x7fb134066f50 msgr2=0x7fb134119480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:31.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.931+0000 7fb13af8c700 1 -- 172.21.15.59:0/2961213339 shutdown_connections 2023-09-30T22:33:31.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:31.931+0000 7fb13af8c700 1 -- 172.21.15.59:0/2961213339 wait complete. 2023-09-30T22:33:31.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:32.752 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:32.855 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:32.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.899+0000 7f80fa84c700 1 Processor -- start 2023-09-30T22:33:32.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.899+0000 7f80fa84c700 1 -- start start 2023-09-30T22:33:32.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.900+0000 7f80fa84c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80f40a0a30 0x7f80f40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:32.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.900+0000 7f80fa84c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f40a1340 0x7f80f4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:32.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.900+0000 7f80fa84c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f409edd0 con 0x7f80f4133fa0 2023-09-30T22:33:32.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.900+0000 7f80fa84c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f409e1f0 con 0x7f80f40a0a30 2023-09-30T22:33:32.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.900+0000 7f80fa84c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80f409dc50 con 0x7f80f40a1340 2023-09-30T22:33:32.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.900+0000 7f80f3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80f40a0a30 0x7f80f40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:32.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.900+0000 7f80f37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f40a1340 0x7f80f4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:32.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.900+0000 7f80f37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f40a1340 0x7f80f4133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37106/0 (socket says 172.21.15.59:37106) 2023-09-30T22:33:32.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.900+0000 7f80f3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80f40a0a30 0x7f80f40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53454/0 (socket says 172.21.15.59:53454) 2023-09-30T22:33:32.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.900+0000 7f80f37fe700 1 -- 172.21.15.59:0/3683671376 learned_addr learned my addr 172.21.15.59:0/3683671376 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.900+0000 7f80f3fff700 1 -- 172.21.15.59:0/3683671376 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f40a1340 msgr2=0x7f80f4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.900+0000 7f80f3fff700 1 --2- 172.21.15.59:0/3683671376 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f40a1340 0x7f80f4133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.900+0000 7f80f3fff700 1 -- 172.21.15.59:0/3683671376 >> v1:172.21.15.59:6789/0 conn(0x7f80f4133fa0 legacy=0x7f80f413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.900+0000 7f80f3fff700 1 -- 172.21.15.59:0/3683671376 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f40a1fe0 con 0x7f80f40a0a30 2023-09-30T22:33:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.900+0000 7f80f37fe700 1 --2- 172.21.15.59:0/3683671376 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f40a1340 0x7f80f4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.901+0000 7f80f3fff700 1 --2- 172.21.15.59:0/3683671376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f40a0a30 0x7f80f40a0e00 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f80e4009840 tx=0x7f80e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de17592e2568562 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.901+0000 7f80f2ffd700 1 -- 172.21.15.59:0/3683671376 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4011830 con 0x7f80f40a0a30 2023-09-30T22:33:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.901+0000 7f80f2ffd700 1 -- 172.21.15.59:0/3683671376 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e4011990 con 0x7f80f40a0a30 2023-09-30T22:33:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.901+0000 7f80f2ffd700 1 -- 172.21.15.59:0/3683671376 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4011d20 con 0x7f80f40a0a30 2023-09-30T22:33:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.901+0000 7f80fa84c700 1 -- 172.21.15.59:0/3683671376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f40a0a30 msgr2=0x7f80f40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.901+0000 7f80fa84c700 1 --2- 172.21.15.59:0/3683671376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f40a0a30 0x7f80f40a0e00 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f80e4009840 tx=0x7f80e4009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.902+0000 7f80fa84c700 1 -- 172.21.15.59:0/3683671376 shutdown_connections 2023-09-30T22:33:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.902+0000 7f80fa84c700 1 --2- 172.21.15.59:0/3683671376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f40a0a30 0x7f80f40a0e00 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.902+0000 7f80fa84c700 1 --2- 172.21.15.59:0/3683671376 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f40a1340 0x7f80f4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.902+0000 7f80fa84c700 1 -- 172.21.15.59:0/3683671376 >> 172.21.15.59:0/3683671376 conn(0x7f80f40a6550 msgr2=0x7f80f40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.902+0000 7f80fa84c700 1 -- 172.21.15.59:0/3683671376 shutdown_connections 2023-09-30T22:33:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.902+0000 7f80fa84c700 1 -- 172.21.15.59:0/3683671376 wait complete. 2023-09-30T22:33:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.903+0000 7f80fa84c700 1 Processor -- start 2023-09-30T22:33:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.903+0000 7f80fa84c700 1 -- start start 2023-09-30T22:33:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.903+0000 7f80fa84c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f40a0a30 0x7f80f411e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.903+0000 7f80fa84c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f40a1340 0x7f80f411ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.903+0000 7f80fa84c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4133fa0 0x7f80f411f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.903+0000 7f80fa84c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f4121f50 con 0x7f80f40a0a30 2023-09-30T22:33:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.903+0000 7f80fa84c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f4120430 con 0x7f80f4133fa0 2023-09-30T22:33:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.903+0000 7f80fa84c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80f40a37e0 con 0x7f80f40a1340 2023-09-30T22:33:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.903+0000 7f80f3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f40a0a30 0x7f80f411e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.903+0000 7f80f37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f40a1340 0x7f80f411ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.903+0000 7f80f3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f40a0a30 0x7f80f411e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53458/0 (socket says 172.21.15.59:53458) 2023-09-30T22:33:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.903+0000 7f80f3fff700 1 -- 172.21.15.59:0/284750369 learned_addr learned my addr 172.21.15.59:0/284750369 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.904+0000 7f80f37fe700 1 -- 172.21.15.59:0/284750369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4133fa0 msgr2=0x7f80f411f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.904+0000 7f80f37fe700 1 --2- 172.21.15.59:0/284750369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4133fa0 0x7f80f411f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.904+0000 7f80f37fe700 1 -- 172.21.15.59:0/284750369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f40a0a30 msgr2=0x7f80f411e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.904+0000 7f80f37fe700 1 --2- 172.21.15.59:0/284750369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f40a0a30 0x7f80f411e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.904+0000 7f80f37fe700 1 -- 172.21.15.59:0/284750369 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e8009550 con 0x7f80f40a1340 2023-09-30T22:33:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.904+0000 7f80f3fff700 1 --2- 172.21.15.59:0/284750369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f40a0a30 0x7f80f411e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:32.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.904+0000 7f80f37fe700 1 --2- 172.21.15.59:0/284750369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f40a1340 0x7f80f411ece0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f80e800e9d0 tx=0x7f80e800ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:32.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.904+0000 7f80f0ff9700 1 -- 172.21.15.59:0/284750369 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8004030 con 0x7f80f40a1340 2023-09-30T22:33:32.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.904+0000 7f80f0ff9700 1 -- 172.21.15.59:0/284750369 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e8004190 con 0x7f80f40a1340 2023-09-30T22:33:32.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.904+0000 7f80fa84c700 1 -- 172.21.15.59:0/284750369 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e40094a0 con 0x7f80f40a1340 2023-09-30T22:33:32.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.904+0000 7f80f0ff9700 1 -- 172.21.15.59:0/284750369 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8004520 con 0x7f80f40a1340 2023-09-30T22:33:32.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.904+0000 7f80fa84c700 1 -- 172.21.15.59:0/284750369 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f40a0270 con 0x7f80f40a1340 2023-09-30T22:33:32.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.905+0000 7f80f0ff9700 1 -- 172.21.15.59:0/284750369 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80e800c850 con 0x7f80f40a1340 2023-09-30T22:33:32.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.905+0000 7f80fa84c700 1 -- 172.21.15.59:0/284750369 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f4122a80 con 0x7f80f40a1340 2023-09-30T22:33:32.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.906+0000 7f80f0ff9700 1 -- 172.21.15.59:0/284750369 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f80e803f940 con 0x7f80f40a1340 2023-09-30T22:33:32.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:32.910+0000 7f80f0ff9700 1 -- 172.21.15.59:0/284750369 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80e80036a0 con 0x7f80f40a1340 2023-09-30T22:33:32.910 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:32.945 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.015+0000 7f2ac885f700 1 Processor -- start 2023-09-30T22:33:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.015+0000 7f2ac885f700 1 -- start start 2023-09-30T22:33:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.016+0000 7f2ac885f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ac409e1d0 0x7f2ac4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.016+0000 7f2ac885f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac4139170 0x7f2ac413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.016+0000 7f2ac885f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac409b120 con 0x7f2ac409d6f0 2023-09-30T22:33:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.016+0000 7f2ac885f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac406b460 con 0x7f2ac409e1d0 2023-09-30T22:33:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.016+0000 7f2ac885f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac409a7e0 con 0x7f2ac4139170 2023-09-30T22:33:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.016+0000 7f2ac1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ac409e1d0 0x7f2ac4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:33.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.016+0000 7f2ac2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac4139170 0x7f2ac413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:33.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.016+0000 7f2ac1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ac409e1d0 0x7f2ac4138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53474/0 (socket says 172.21.15.59:53474) 2023-09-30T22:33:33.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.016+0000 7f2ac2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac4139170 0x7f2ac413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58238/0 (socket says 172.21.15.59:58238) 2023-09-30T22:33:33.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.016+0000 7f2ac1d9b700 1 -- 172.21.15.59:0/1473760829 learned_addr learned my addr 172.21.15.59:0/1473760829 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:33.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.017+0000 7f2ac1d9b700 1 -- 172.21.15.59:0/1473760829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac4139170 msgr2=0x7f2ac413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:33.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.017+0000 7f2ac1d9b700 1 --2- 172.21.15.59:0/1473760829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac4139170 0x7f2ac413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.017+0000 7f2ac1d9b700 1 -- 172.21.15.59:0/1473760829 >> v1:172.21.15.59:6789/0 conn(0x7f2ac409d6f0 legacy=0x7f2ac409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.017+0000 7f2ac1d9b700 1 -- 172.21.15.59:0/1473760829 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac409a500 con 0x7f2ac409e1d0 2023-09-30T22:33:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.017+0000 7f2ac159a700 1 -- 172.21.15.59:0/1473760829 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252981831 0 0) 0x7f2ac409b120 con 0x7f2ac409d6f0 2023-09-30T22:33:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.017+0000 7f2ac1d9b700 1 --2- 172.21.15.59:0/1473760829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac409e1d0 0x7f2ac4138c30 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009920 tx=0x7f2ab8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f386d3dd63676276 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.017+0000 7f2ac159a700 1 -- 172.21.15.59:0/1473760829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8011830 con 0x7f2ac409e1d0 2023-09-30T22:33:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.017+0000 7f2ac159a700 1 -- 172.21.15.59:0/1473760829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab8011990 con 0x7f2ac409e1d0 2023-09-30T22:33:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.017+0000 7f2ac159a700 1 -- 172.21.15.59:0/1473760829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8011d20 con 0x7f2ac409e1d0 2023-09-30T22:33:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.018+0000 7f2ac885f700 1 -- 172.21.15.59:0/1473760829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac409e1d0 msgr2=0x7f2ac4138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.018+0000 7f2ac885f700 1 --2- 172.21.15.59:0/1473760829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac409e1d0 0x7f2ac4138c30 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009920 tx=0x7f2ab8009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.018+0000 7f2ac885f700 1 -- 172.21.15.59:0/1473760829 shutdown_connections 2023-09-30T22:33:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.018+0000 7f2ac885f700 1 --2- 172.21.15.59:0/1473760829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac4139170 0x7f2ac413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.018+0000 7f2ac885f700 1 --2- 172.21.15.59:0/1473760829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac409e1d0 0x7f2ac4138c30 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.018+0000 7f2ac885f700 1 -- 172.21.15.59:0/1473760829 >> 172.21.15.59:0/1473760829 conn(0x7f2ac4066f50 msgr2=0x7f2ac409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.018+0000 7f2ac885f700 1 -- 172.21.15.59:0/1473760829 shutdown_connections 2023-09-30T22:33:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.018+0000 7f2ac885f700 1 -- 172.21.15.59:0/1473760829 wait complete. 2023-09-30T22:33:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.020+0000 7f2ac885f700 1 Processor -- start 2023-09-30T22:33:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.020+0000 7f2ac885f700 1 -- start start 2023-09-30T22:33:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac885f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac409d6f0 0x7f2ac41c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac885f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac409e1d0 0x7f2ac41c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac885f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac4139170 0x7f2ac41c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac885f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac4120720 con 0x7f2ac409d6f0 2023-09-30T22:33:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac885f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac4121210 con 0x7f2ac4139170 2023-09-30T22:33:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac885f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac41224b0 con 0x7f2ac409e1d0 2023-09-30T22:33:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac409d6f0 0x7f2ac41c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac409d6f0 0x7f2ac41c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53482/0 (socket says 172.21.15.59:53482) 2023-09-30T22:33:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac259c700 1 -- 172.21.15.59:0/1601436577 learned_addr learned my addr 172.21.15.59:0/1601436577 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac2d9d700 1 --2- 172.21.15.59:0/1601436577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac4139170 0x7f2ac41c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac1d9b700 1 --2- 172.21.15.59:0/1601436577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac409e1d0 0x7f2ac41c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac259c700 1 -- 172.21.15.59:0/1601436577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac409e1d0 msgr2=0x7f2ac41c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac259c700 1 --2- 172.21.15.59:0/1601436577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac409e1d0 0x7f2ac41c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac259c700 1 -- 172.21.15.59:0/1601436577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac4139170 msgr2=0x7f2ac41c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac259c700 1 --2- 172.21.15.59:0/1601436577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac4139170 0x7f2ac41c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.021+0000 7f2ac259c700 1 -- 172.21.15.59:0/1601436577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab8009550 con 0x7f2ac409d6f0 2023-09-30T22:33:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.022+0000 7f2ac259c700 1 --2- 172.21.15.59:0/1601436577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac409d6f0 0x7f2ac41c8360 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400c520 tx=0x7f2ab400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.022+0000 7f2ab2ffd700 1 -- 172.21.15.59:0/1601436577 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab40054e0 con 0x7f2ac409d6f0 2023-09-30T22:33:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.022+0000 7f2ab2ffd700 1 -- 172.21.15.59:0/1601436577 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab4003680 con 0x7f2ac409d6f0 2023-09-30T22:33:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.022+0000 7f2ab2ffd700 1 -- 172.21.15.59:0/1601436577 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab40039f0 con 0x7f2ac409d6f0 2023-09-30T22:33:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.022+0000 7f2ac885f700 1 -- 172.21.15.59:0/1601436577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac40721c0 con 0x7f2ac409d6f0 2023-09-30T22:33:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.022+0000 7f2ac885f700 1 -- 172.21.15.59:0/1601436577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac409c770 con 0x7f2ac409d6f0 2023-09-30T22:33:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.023+0000 7f2ab2ffd700 1 -- 172.21.15.59:0/1601436577 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ab4003b50 con 0x7f2ac409d6f0 2023-09-30T22:33:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.023+0000 7f2ac885f700 1 -- 172.21.15.59:0/1601436577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac41222f0 con 0x7f2ac409d6f0 2023-09-30T22:33:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.024+0000 7f2ab2ffd700 1 -- 172.21.15.59:0/1601436577 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2ab403eb40 con 0x7f2ac409d6f0 2023-09-30T22:33:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.033+0000 7f2ab2ffd700 1 -- 172.21.15.59:0/1601436577 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ab4012400 con 0x7f2ac409d6f0 2023-09-30T22:33:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.071+0000 7f20f1f58700 1 Processor -- start 2023-09-30T22:33:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.071+0000 7f20f1f58700 1 -- start start 2023-09-30T22:33:33.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.071+0000 7f20f1f58700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20ec09d6f0 0x7f20ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:33.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.071+0000 7f20f1f58700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20ec09e000 0x7f20ec1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.071+0000 7f20f1f58700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec09b120 con 0x7f20ec09e410 2023-09-30T22:33:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.071+0000 7f20f1f58700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec06b460 con 0x7f20ec09e000 2023-09-30T22:33:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.071+0000 7f20f1f58700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec09a7e0 con 0x7f20ec09d6f0 2023-09-30T22:33:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.072+0000 7f20eb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20ec09d6f0 0x7f20ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.072+0000 7f20eb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20ec09d6f0 0x7f20ec09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37126/0 (socket says 172.21.15.59:37126) 2023-09-30T22:33:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.072+0000 7f20eb7fe700 1 -- 172.21.15.59:0/3995400818 learned_addr learned my addr 172.21.15.59:0/3995400818 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.072+0000 7f20eaffd700 1 --2- 172.21.15.59:0/3995400818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20ec09e000 0x7f20ec1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.072+0000 7f20eaffd700 1 -- 172.21.15.59:0/3995400818 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20ec09d6f0 msgr2=0x7f20ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.072+0000 7f20eaffd700 1 --2- 172.21.15.59:0/3995400818 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20ec09d6f0 0x7f20ec09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.072+0000 7f20eaffd700 1 -- 172.21.15.59:0/3995400818 >> v1:172.21.15.59:6789/0 conn(0x7f20ec09e410 legacy=0x7f20ec133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.072+0000 7f20eaffd700 1 -- 172.21.15.59:0/3995400818 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec09a500 con 0x7f20ec09e000 2023-09-30T22:33:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.072+0000 7f20eaffd700 1 --2- 172.21.15.59:0/3995400818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20ec09e000 0x7f20ec1339f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009870 tx=0x7f20e0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c92ba74c7d3de074 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.072+0000 7f20ea7fc700 1 -- 172.21.15.59:0/3995400818 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0004230 con 0x7f20ec09e000 2023-09-30T22:33:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.072+0000 7f20ea7fc700 1 -- 172.21.15.59:0/3995400818 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e0004390 con 0x7f20ec09e000 2023-09-30T22:33:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.072+0000 7f20ea7fc700 1 -- 172.21.15.59:0/3995400818 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e00036a0 con 0x7f20ec09e000 2023-09-30T22:33:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.073+0000 7f20f1f58700 1 -- 172.21.15.59:0/3995400818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20ec09e000 msgr2=0x7f20ec1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.073+0000 7f20f1f58700 1 --2- 172.21.15.59:0/3995400818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20ec09e000 0x7f20ec1339f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009870 tx=0x7f20e0009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.073+0000 7f20f1f58700 1 -- 172.21.15.59:0/3995400818 shutdown_connections 2023-09-30T22:33:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.073+0000 7f20f1f58700 1 --2- 172.21.15.59:0/3995400818 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20ec09d6f0 0x7f20ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.073+0000 7f20f1f58700 1 --2- 172.21.15.59:0/3995400818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20ec09e000 0x7f20ec1339f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.073+0000 7f20f1f58700 1 -- 172.21.15.59:0/3995400818 >> 172.21.15.59:0/3995400818 conn(0x7f20ec066f50 msgr2=0x7f20ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.073+0000 7f20f1f58700 1 -- 172.21.15.59:0/3995400818 shutdown_connections 2023-09-30T22:33:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.073+0000 7f20f1f58700 1 -- 172.21.15.59:0/3995400818 wait complete. 2023-09-30T22:33:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.075+0000 7f20f1f58700 1 Processor -- start 2023-09-30T22:33:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.075+0000 7f20f1f58700 1 -- start start 2023-09-30T22:33:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20f1f58700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20ec09d6f0 0x7f20ec122480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20f1f58700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20ec09e000 0x7f20ec1229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20f1f58700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20ec09e410 0x7f20ec122f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20f1f58700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec125a00 con 0x7f20ec09d6f0 2023-09-30T22:33:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20f1f58700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec09c710 con 0x7f20ec09e410 2023-09-30T22:33:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20f1f58700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec1238e0 con 0x7f20ec09e000 2023-09-30T22:33:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20eb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20ec09d6f0 0x7f20ec122480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20eaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20ec09e000 0x7f20ec1229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20eb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20ec09d6f0 0x7f20ec122480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53486/0 (socket says 172.21.15.59:53486) 2023-09-30T22:33:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20eb7fe700 1 -- 172.21.15.59:0/630295378 learned_addr learned my addr 172.21.15.59:0/630295378 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20ebfff700 1 --2- 172.21.15.59:0/630295378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20ec09e410 0x7f20ec122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20eb7fe700 1 -- 172.21.15.59:0/630295378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20ec09e000 msgr2=0x7f20ec1229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20eb7fe700 1 --2- 172.21.15.59:0/630295378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20ec09e000 0x7f20ec1229c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20eb7fe700 1 -- 172.21.15.59:0/630295378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20ec09e410 msgr2=0x7f20ec122f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20eb7fe700 1 --2- 172.21.15.59:0/630295378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20ec09e410 0x7f20ec122f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.076+0000 7f20eb7fe700 1 -- 172.21.15.59:0/630295378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e00094a0 con 0x7f20ec09d6f0 2023-09-30T22:33:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.077+0000 7f20eb7fe700 1 --2- 172.21.15.59:0/630295378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20ec09d6f0 0x7f20ec122480 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00e940 tx=0x7f20dc00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.077+0000 7f20d3fff700 1 -- 172.21.15.59:0/630295378 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0096a0 con 0x7f20ec09d6f0 2023-09-30T22:33:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.077+0000 7f20d3fff700 1 -- 172.21.15.59:0/630295378 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc013680 con 0x7f20ec09d6f0 2023-09-30T22:33:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.077+0000 7f20d3fff700 1 -- 172.21.15.59:0/630295378 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc013a30 con 0x7f20ec09d6f0 2023-09-30T22:33:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.077+0000 7f20f1f58700 1 -- 172.21.15.59:0/630295378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec125fa0 con 0x7f20ec09d6f0 2023-09-30T22:33:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.077+0000 7f20f1f58700 1 -- 172.21.15.59:0/630295378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec125cc0 con 0x7f20ec09d6f0 2023-09-30T22:33:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.078+0000 7f20f1f58700 1 -- 172.21.15.59:0/630295378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec1248e0 con 0x7f20ec09d6f0 2023-09-30T22:33:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.078+0000 7f20d3fff700 1 -- 172.21.15.59:0/630295378 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20dc013b90 con 0x7f20ec09d6f0 2023-09-30T22:33:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.079+0000 7f20d3fff700 1 -- 172.21.15.59:0/630295378 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f20dc03f6c0 con 0x7f20ec09d6f0 2023-09-30T22:33:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.088+0000 7f20d3fff700 1 -- 172.21.15.59:0/630295378 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20dc01ba00 con 0x7f20ec09d6f0 2023-09-30T22:33:33.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.111+0000 7fdde89fb700 1 Processor -- start 2023-09-30T22:33:33.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.111+0000 7fdde89fb700 1 -- start start 2023-09-30T22:33:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.112+0000 7fdde89fb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdde409d6f0 0x7fdde409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.112+0000 7fdde89fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdde4134100 0x7fdde413bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.112+0000 7fdde89fb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde409d2f0 con 0x7fdde409e000 2023-09-30T22:33:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.112+0000 7fdde89fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde409a810 con 0x7fdde4134100 2023-09-30T22:33:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.112+0000 7fdde89fb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdde409a470 con 0x7fdde409d6f0 2023-09-30T22:33:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.112+0000 7fdde259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdde409d6f0 0x7fdde409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.112+0000 7fdde1d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdde409e000 0x7fdde41339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35056/0 (socket says 172.21.15.59:35056) 2023-09-30T22:33:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.112+0000 7fdde1d9b700 1 -- 172.21.15.59:0/1017345949 learned_addr learned my addr 172.21.15.59:0/1017345949 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.112+0000 7fdde2d9d700 1 --2- 172.21.15.59:0/1017345949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdde4134100 0x7fdde413bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.112+0000 7fdde259c700 1 -- 172.21.15.59:0/1017345949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdde4134100 msgr2=0x7fdde413bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.113+0000 7fdde259c700 1 --2- 172.21.15.59:0/1017345949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdde4134100 0x7fdde413bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.113+0000 7fdde259c700 1 -- 172.21.15.59:0/1017345949 >> v1:172.21.15.59:6789/0 conn(0x7fdde409e000 legacy=0x7fdde41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.113+0000 7fdde259c700 1 -- 172.21.15.59:0/1017345949 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde409ec40 con 0x7fdde409d6f0 2023-09-30T22:33:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.113+0000 7fdde159a700 1 -- 172.21.15.59:0/1017345949 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208159619 0 0) 0x7fdde409d2f0 con 0x7fdde409e000 2023-09-30T22:33:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.113+0000 7fdde259c700 1 --2- 172.21.15.59:0/1017345949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdde409d6f0 0x7fdde409dac0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009870 tx=0x7fddd4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdf3c97a489550a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.113+0000 7fdde159a700 1 -- 172.21.15.59:0/1017345949 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4011830 con 0x7fdde409d6f0 2023-09-30T22:33:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.113+0000 7fdde159a700 1 -- 172.21.15.59:0/1017345949 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd4011990 con 0x7fdde409d6f0 2023-09-30T22:33:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.113+0000 7fdde159a700 1 -- 172.21.15.59:0/1017345949 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4011d20 con 0x7fdde409d6f0 2023-09-30T22:33:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.114+0000 7fdde89fb700 1 -- 172.21.15.59:0/1017345949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdde409d6f0 msgr2=0x7fdde409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.114+0000 7fdde89fb700 1 --2- 172.21.15.59:0/1017345949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdde409d6f0 0x7fdde409dac0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009870 tx=0x7fddd4009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.114+0000 7fdde89fb700 1 -- 172.21.15.59:0/1017345949 shutdown_connections 2023-09-30T22:33:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.114+0000 7fdde89fb700 1 --2- 172.21.15.59:0/1017345949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdde409d6f0 0x7fdde409dac0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.114+0000 7fdde89fb700 1 --2- 172.21.15.59:0/1017345949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdde4134100 0x7fdde413bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.114+0000 7fdde89fb700 1 -- 172.21.15.59:0/1017345949 >> 172.21.15.59:0/1017345949 conn(0x7fdde4066f50 msgr2=0x7fdde409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.114+0000 7fdde89fb700 1 -- 172.21.15.59:0/1017345949 shutdown_connections 2023-09-30T22:33:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.114+0000 7fdde89fb700 1 -- 172.21.15.59:0/1017345949 wait complete. 2023-09-30T22:33:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.116+0000 7fdde89fb700 1 Processor -- start 2023-09-30T22:33:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.116+0000 7fdde89fb700 1 -- start start 2023-09-30T22:33:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde89fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdde409d6f0 0x7fdde41c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde89fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdde409e000 0x7fdde41c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde89fb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdde4134100 0x7fdde41c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde89fb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde4124e80 con 0x7fdde409e000 2023-09-30T22:33:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde89fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde41247a0 con 0x7fdde409d6f0 2023-09-30T22:33:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde89fb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdde41264c0 con 0x7fdde4134100 2023-09-30T22:33:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdde409d6f0 0x7fdde41c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdde409d6f0 0x7fdde41c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58298/0 (socket says 172.21.15.59:58298) 2023-09-30T22:33:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde259c700 1 -- 172.21.15.59:0/95187025 learned_addr learned my addr 172.21.15.59:0/95187025 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde2d9d700 1 --2- 172.21.15.59:0/95187025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdde4134100 0x7fdde41c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde1d9b700 1 --2- 172.21.15.59:0/95187025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdde409e000 0x7fdde41c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde259c700 1 -- 172.21.15.59:0/95187025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdde4134100 msgr2=0x7fdde41c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde259c700 1 --2- 172.21.15.59:0/95187025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdde4134100 0x7fdde41c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde259c700 1 -- 172.21.15.59:0/95187025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdde409e000 msgr2=0x7fdde41c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde259c700 1 --2- 172.21.15.59:0/95187025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdde409e000 0x7fdde41c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde259c700 1 -- 172.21.15.59:0/95187025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd40094a0 con 0x7fdde409d6f0 2023-09-30T22:33:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde2d9d700 1 --2- 172.21.15.59:0/95187025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdde4134100 0x7fdde41c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.117+0000 7fdde1d9b700 1 --2- 172.21.15.59:0/95187025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdde409e000 0x7fdde41c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.118+0000 7fdde259c700 1 --2- 172.21.15.59:0/95187025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdde409d6f0 0x7fdde41c83f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fddd4000c00 tx=0x7fddd4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.118+0000 7fddd2ffd700 1 -- 172.21.15.59:0/95187025 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd40036a0 con 0x7fdde409d6f0 2023-09-30T22:33:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.118+0000 7fddd2ffd700 1 -- 172.21.15.59:0/95187025 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd401f070 con 0x7fdde409d6f0 2023-09-30T22:33:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.118+0000 7fdde89fb700 1 -- 172.21.15.59:0/95187025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde4124b60 con 0x7fdde409d6f0 2023-09-30T22:33:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.118+0000 7fddd2ffd700 1 -- 172.21.15.59:0/95187025 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4003a60 con 0x7fdde409d6f0 2023-09-30T22:33:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.118+0000 7fdde89fb700 1 -- 172.21.15.59:0/95187025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde409bfb0 con 0x7fdde409d6f0 2023-09-30T22:33:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.119+0000 7fdde89fb700 1 -- 172.21.15.59:0/95187025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde4074ea0 con 0x7fdde409d6f0 2023-09-30T22:33:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.119+0000 7fddd2ffd700 1 -- 172.21.15.59:0/95187025 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddd4003bc0 con 0x7fdde409d6f0 2023-09-30T22:33:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.119+0000 7fddd2ffd700 1 -- 172.21.15.59:0/95187025 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fddd4021070 con 0x7fdde409d6f0 2023-09-30T22:33:33.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.128+0000 7fddd2ffd700 1 -- 172.21.15.59:0/95187025 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddd402fd70 con 0x7fdde409d6f0 2023-09-30T22:33:33.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.130+0000 7f80fa84c700 1 -- 172.21.15.59:0/284750369 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f80f4074ea0 con 0x7f80f40a1340 2023-09-30T22:33:33.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.131+0000 7f80f0ff9700 1 -- 172.21.15.59:0/284750369 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f80e8013e60 con 0x7f80f40a1340 2023-09-30T22:33:33.131 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:33.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.133+0000 7f80fa84c700 1 -- 172.21.15.59:0/284750369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f40a1340 msgr2=0x7f80f411ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.133+0000 7f80fa84c700 1 --2- 172.21.15.59:0/284750369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f40a1340 0x7f80f411ece0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f80e800e9d0 tx=0x7f80e800ece0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.133+0000 7f80fa84c700 1 -- 172.21.15.59:0/284750369 shutdown_connections 2023-09-30T22:33:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.133+0000 7f80fa84c700 1 --2- 172.21.15.59:0/284750369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4133fa0 0x7f80f411f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.133+0000 7f80fa84c700 1 --2- 172.21.15.59:0/284750369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f40a0a30 0x7f80f411e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.133+0000 7f80fa84c700 1 --2- 172.21.15.59:0/284750369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f40a1340 0x7f80f411ece0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.133+0000 7f80fa84c700 1 -- 172.21.15.59:0/284750369 >> 172.21.15.59:0/284750369 conn(0x7f80f40a6550 msgr2=0x7f80f41b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.133+0000 7f80fa84c700 1 -- 172.21.15.59:0/284750369 shutdown_connections 2023-09-30T22:33:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.133+0000 7f80fa84c700 1 -- 172.21.15.59:0/284750369 wait complete. 2023-09-30T22:33:33.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:33.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.274+0000 7f2ac885f700 1 -- 172.21.15.59:0/1601436577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2ac409f420 con 0x7f2ac409d6f0 2023-09-30T22:33:33.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.275+0000 7f2ab2ffd700 1 -- 172.21.15.59:0/1601436577 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ab4017020 con 0x7f2ac409d6f0 2023-09-30T22:33:33.275 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:33.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.277+0000 7f2ac885f700 1 -- 172.21.15.59:0/1601436577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac409d6f0 msgr2=0x7f2ac41c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:33.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.277+0000 7f2ac885f700 1 --2- 172.21.15.59:0/1601436577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac409d6f0 0x7f2ac41c8360 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400c520 tx=0x7f2ab400c830 comp rx=0 tx=0).stop 2023-09-30T22:33:33.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.277+0000 7f2ac885f700 1 -- 172.21.15.59:0/1601436577 shutdown_connections 2023-09-30T22:33:33.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.277+0000 7f2ac885f700 1 --2- 172.21.15.59:0/1601436577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac4139170 0x7f2ac41c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.277+0000 7f2ac885f700 1 --2- 172.21.15.59:0/1601436577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac409d6f0 0x7f2ac41c8360 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.277+0000 7f2ac885f700 1 --2- 172.21.15.59:0/1601436577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac409e1d0 0x7f2ac41c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.277+0000 7f2ac885f700 1 -- 172.21.15.59:0/1601436577 >> 172.21.15.59:0/1601436577 conn(0x7f2ac4066f50 msgr2=0x7f2ac4136c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:33.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.277+0000 7f2ac885f700 1 -- 172.21.15.59:0/1601436577 shutdown_connections 2023-09-30T22:33:33.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.277+0000 7f2ac885f700 1 -- 172.21.15.59:0/1601436577 wait complete. 2023-09-30T22:33:33.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:33.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.308+0000 7f20f1f58700 1 -- 172.21.15.59:0/630295378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f20ec074ea0 con 0x7f20ec09d6f0 2023-09-30T22:33:33.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.309+0000 7f20d3fff700 1 -- 172.21.15.59:0/630295378 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20dc017070 con 0x7f20ec09d6f0 2023-09-30T22:33:33.309 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:33.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.311+0000 7f20f1f58700 1 -- 172.21.15.59:0/630295378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20ec09d6f0 msgr2=0x7f20ec122480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:33.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.311+0000 7f20f1f58700 1 --2- 172.21.15.59:0/630295378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20ec09d6f0 0x7f20ec122480 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00e940 tx=0x7f20dc00ec50 comp rx=0 tx=0).stop 2023-09-30T22:33:33.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.311+0000 7f20f1f58700 1 -- 172.21.15.59:0/630295378 shutdown_connections 2023-09-30T22:33:33.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.311+0000 7f20f1f58700 1 --2- 172.21.15.59:0/630295378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20ec09e410 0x7f20ec122f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.311+0000 7f20f1f58700 1 --2- 172.21.15.59:0/630295378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20ec09d6f0 0x7f20ec122480 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.311+0000 7f20f1f58700 1 --2- 172.21.15.59:0/630295378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20ec09e000 0x7f20ec1229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.311+0000 7f20f1f58700 1 -- 172.21.15.59:0/630295378 >> 172.21.15.59:0/630295378 conn(0x7f20ec066f50 msgr2=0x7f20ec133f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:33.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.311+0000 7f20f1f58700 1 -- 172.21.15.59:0/630295378 shutdown_connections 2023-09-30T22:33:33.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.311+0000 7f20f1f58700 1 -- 172.21.15.59:0/630295378 wait complete. 2023-09-30T22:33:33.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:33.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.351+0000 7fdde89fb700 1 -- 172.21.15.59:0/95187025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdde41262a0 con 0x7fdde409d6f0 2023-09-30T22:33:33.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.351+0000 7fddd2ffd700 1 -- 172.21.15.59:0/95187025 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddd4015020 con 0x7fdde409d6f0 2023-09-30T22:33:33.351 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:33.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.353+0000 7fdde89fb700 1 -- 172.21.15.59:0/95187025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdde409d6f0 msgr2=0x7fdde41c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:33.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.353+0000 7fdde89fb700 1 --2- 172.21.15.59:0/95187025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdde409d6f0 0x7fdde41c83f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fddd4000c00 tx=0x7fddd4004750 comp rx=0 tx=0).stop 2023-09-30T22:33:33.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.353+0000 7fdde89fb700 1 -- 172.21.15.59:0/95187025 shutdown_connections 2023-09-30T22:33:33.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.353+0000 7fdde89fb700 1 --2- 172.21.15.59:0/95187025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdde4134100 0x7fdde41c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.353+0000 7fdde89fb700 1 --2- 172.21.15.59:0/95187025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdde409d6f0 0x7fdde41c83f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.353+0000 7fdde89fb700 1 --2- 172.21.15.59:0/95187025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdde409e000 0x7fdde41c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:33.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.353+0000 7fdde89fb700 1 -- 172.21.15.59:0/95187025 >> 172.21.15.59:0/95187025 conn(0x7fdde4066f50 msgr2=0x7fdde4070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:33.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.353+0000 7fdde89fb700 1 -- 172.21.15.59:0/95187025 shutdown_connections 2023-09-30T22:33:33.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:33.353+0000 7fdde89fb700 1 -- 172.21.15.59:0/95187025 wait complete. 2023-09-30T22:33:33.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:34.148 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:34.292 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:34.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.294+0000 7f8917391700 1 Processor -- start 2023-09-30T22:33:34.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.294+0000 7f8917391700 1 -- start start 2023-09-30T22:33:34.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.295+0000 7f8917391700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f891009d6f0 0x7f891009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.295+0000 7f8917391700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f891009e000 0x7f89101339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.295+0000 7f8917391700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891009b120 con 0x7f891009e410 2023-09-30T22:33:34.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.295+0000 7f8917391700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f891006b460 con 0x7f891009e000 2023-09-30T22:33:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.295+0000 7f8917391700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f891009a7e0 con 0x7f891009d6f0 2023-09-30T22:33:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.295+0000 7f891512d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f891009d6f0 0x7f891009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.295+0000 7f891512d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f891009d6f0 0x7f891009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37164/0 (socket says 172.21.15.59:37164) 2023-09-30T22:33:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.295+0000 7f891512d700 1 -- 172.21.15.59:0/2790921437 learned_addr learned my addr 172.21.15.59:0/2790921437 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.295+0000 7f891492c700 1 --2- 172.21.15.59:0/2790921437 >> v2:172.21.15.59:3300/0 conn(0x7f891009e000 0x7f89101339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.295+0000 7f891512d700 1 -- 172.21.15.59:0/2790921437 >> v2:172.21.15.59:3300/0 conn(0x7f891009e000 msgr2=0x7f89101339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.295+0000 7f891512d700 1 --2- 172.21.15.59:0/2790921437 >> v2:172.21.15.59:3300/0 conn(0x7f891009e000 0x7f89101339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.295+0000 7f891512d700 1 -- 172.21.15.59:0/2790921437 >> v1:172.21.15.59:6789/0 conn(0x7f891009e410 legacy=0x7f8910133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.295+0000 7f891512d700 1 -- 172.21.15.59:0/2790921437 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891009a500 con 0x7f891009d6f0 2023-09-30T22:33:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.296+0000 7f891512d700 1 --2- 172.21.15.59:0/2790921437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f891009d6f0 0x7f891009dac0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f890c009920 tx=0x7f890c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dec42798c510c35 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.296+0000 7f8907fff700 1 -- 172.21.15.59:0/2790921437 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c011830 con 0x7f891009d6f0 2023-09-30T22:33:34.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.296+0000 7f8907fff700 1 -- 172.21.15.59:0/2790921437 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c011990 con 0x7f891009d6f0 2023-09-30T22:33:34.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.296+0000 7f8907fff700 1 -- 172.21.15.59:0/2790921437 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c011d20 con 0x7f891009d6f0 2023-09-30T22:33:34.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.296+0000 7f8917391700 1 -- 172.21.15.59:0/2790921437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f891009d6f0 msgr2=0x7f891009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.296+0000 7f8917391700 1 --2- 172.21.15.59:0/2790921437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f891009d6f0 0x7f891009dac0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f890c009920 tx=0x7f890c009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:34.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.296+0000 7f8917391700 1 -- 172.21.15.59:0/2790921437 shutdown_connections 2023-09-30T22:33:34.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.297+0000 7f8917391700 1 --2- 172.21.15.59:0/2790921437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f891009d6f0 0x7f891009dac0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.297+0000 7f8917391700 1 --2- 172.21.15.59:0/2790921437 >> v2:172.21.15.59:3300/0 conn(0x7f891009e000 0x7f89101339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.297+0000 7f8917391700 1 -- 172.21.15.59:0/2790921437 >> 172.21.15.59:0/2790921437 conn(0x7f8910066f50 msgr2=0x7f891009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:34.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.297+0000 7f8917391700 1 -- 172.21.15.59:0/2790921437 shutdown_connections 2023-09-30T22:33:34.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.297+0000 7f8917391700 1 -- 172.21.15.59:0/2790921437 wait complete. 2023-09-30T22:33:34.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.298+0000 7f8917391700 1 Processor -- start 2023-09-30T22:33:34.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.298+0000 7f8917391700 1 -- start start 2023-09-30T22:33:34.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.298+0000 7f8917391700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f891009d6f0 0x7f89101a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.298+0000 7f8917391700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f891009e000 0x7f89101a6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.298+0000 7f8917391700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891009e410 0x7f89101a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.298+0000 7f8917391700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89101a74a0 con 0x7f891009e410 2023-09-30T22:33:34.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.298+0000 7f8917391700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89101a7b60 con 0x7f891009e000 2023-09-30T22:33:34.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.298+0000 7f8917391700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89101a8180 con 0x7f891009d6f0 2023-09-30T22:33:34.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.298+0000 7f891512d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f891009d6f0 0x7f89101a5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.298+0000 7f891592e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891009e410 0x7f89101a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.298+0000 7f891512d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f891009d6f0 0x7f89101a5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37170/0 (socket says 172.21.15.59:37170) 2023-09-30T22:33:34.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.298+0000 7f891512d700 1 -- 172.21.15.59:0/1198609973 learned_addr learned my addr 172.21.15.59:0/1198609973 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:34.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.298+0000 7f891592e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891009e410 0x7f89101a6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53512/0 (socket says 172.21.15.59:53512) 2023-09-30T22:33:34.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.298+0000 7f891492c700 1 --2- 172.21.15.59:0/1198609973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f891009e000 0x7f89101a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.299+0000 7f891512d700 1 -- 172.21.15.59:0/1198609973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f891009e000 msgr2=0x7f89101a6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.299+0000 7f891512d700 1 --2- 172.21.15.59:0/1198609973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f891009e000 0x7f89101a6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.299+0000 7f891512d700 1 -- 172.21.15.59:0/1198609973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891009e410 msgr2=0x7f89101a6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.299+0000 7f891512d700 1 --2- 172.21.15.59:0/1198609973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891009e410 0x7f89101a6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.299+0000 7f891512d700 1 -- 172.21.15.59:0/1198609973 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c009550 con 0x7f891009d6f0 2023-09-30T22:33:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.299+0000 7f891512d700 1 --2- 172.21.15.59:0/1198609973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f891009d6f0 0x7f89101a5ff0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f890c009870 tx=0x7f890c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.299+0000 7f8905ffb700 1 -- 172.21.15.59:0/1198609973 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c004240 con 0x7f891009d6f0 2023-09-30T22:33:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.299+0000 7f8905ffb700 1 -- 172.21.15.59:0/1198609973 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c01f070 con 0x7f891009d6f0 2023-09-30T22:33:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.299+0000 7f8917391700 1 -- 172.21.15.59:0/1198609973 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89101a9790 con 0x7f891009d6f0 2023-09-30T22:33:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.299+0000 7f8905ffb700 1 -- 172.21.15.59:0/1198609973 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0036a0 con 0x7f891009d6f0 2023-09-30T22:33:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.300+0000 7f8917391700 1 -- 172.21.15.59:0/1198609973 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89101a9250 con 0x7f891009d6f0 2023-09-30T22:33:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.300+0000 7f8905ffb700 1 -- 172.21.15.59:0/1198609973 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f890c021030 con 0x7f891009d6f0 2023-09-30T22:33:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.300+0000 7f8905ffb700 1 -- 172.21.15.59:0/1198609973 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f890c040a80 con 0x7f891009d6f0 2023-09-30T22:33:34.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.301+0000 7f8917391700 1 -- 172.21.15.59:0/1198609973 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8910074ea0 con 0x7f891009d6f0 2023-09-30T22:33:34.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.306+0000 7f8905ffb700 1 -- 172.21.15.59:0/1198609973 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f890c015020 con 0x7f891009d6f0 2023-09-30T22:33:34.326 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:34.368 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:34.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.445+0000 7f2831347700 1 Processor -- start 2023-09-30T22:33:34.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.445+0000 7f2831347700 1 -- start start 2023-09-30T22:33:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.446+0000 7f2831347700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f282c09d6f0 0x7f282c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.446+0000 7f2831347700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f282c09e000 0x7f282c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.446+0000 7f2831347700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282c09b120 con 0x7f282c09e410 2023-09-30T22:33:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.446+0000 7f2831347700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c06b460 con 0x7f282c09d6f0 2023-09-30T22:33:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.446+0000 7f2831347700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f282c09a7e0 con 0x7f282c09e000 2023-09-30T22:33:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.446+0000 7f282a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f282c09e000 0x7f282c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.446+0000 7f282b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f282c09e410 0x7f282c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35704/0 (socket says 172.21.15.59:35704) 2023-09-30T22:33:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.446+0000 7f282b7fe700 1 -- 172.21.15.59:0/3713210891 learned_addr learned my addr 172.21.15.59:0/3713210891 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.446+0000 7f282affd700 1 --2- 172.21.15.59:0/3713210891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f282c09d6f0 0x7f282c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.446+0000 7f2829ffb700 1 -- 172.21.15.59:0/3713210891 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965429736 0 0) 0x7f282c09b120 con 0x7f282c09e410 2023-09-30T22:33:34.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.446+0000 7f2829ffb700 1 -- 172.21.15.59:0/3713210891 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28140035b0 con 0x7f282c09e410 2023-09-30T22:33:34.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.447+0000 7f282a7fc700 1 -- 172.21.15.59:0/3713210891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f282c09d6f0 msgr2=0x7f282c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:34.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.447+0000 7f282a7fc700 1 --2- 172.21.15.59:0/3713210891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f282c09d6f0 0x7f282c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.447+0000 7f282a7fc700 1 -- 172.21.15.59:0/3713210891 >> v1:172.21.15.59:6789/0 conn(0x7f282c09e410 legacy=0x7f282c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.447+0000 7f282a7fc700 1 -- 172.21.15.59:0/3713210891 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c09a500 con 0x7f282c09e000 2023-09-30T22:33:34.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.447+0000 7f282affd700 1 --2- 172.21.15.59:0/3713210891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f282c09d6f0 0x7f282c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:34.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.447+0000 7f282a7fc700 1 --2- 172.21.15.59:0/3713210891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f282c09e000 0x7f282c1339f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f28200098a0 tx=0x7f2820009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adeef2460d0e99d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:34.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.447+0000 7f2829ffb700 1 -- 172.21.15.59:0/3713210891 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2820011830 con 0x7f282c09e000 2023-09-30T22:33:34.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.447+0000 7f2829ffb700 1 -- 172.21.15.59:0/3713210891 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2820011990 con 0x7f282c09e000 2023-09-30T22:33:34.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.447+0000 7f2829ffb700 1 -- 172.21.15.59:0/3713210891 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2820011d00 con 0x7f282c09e000 2023-09-30T22:33:34.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.448+0000 7f2831347700 1 -- 172.21.15.59:0/3713210891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f282c09e000 msgr2=0x7f282c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.448+0000 7f2831347700 1 --2- 172.21.15.59:0/3713210891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f282c09e000 0x7f282c1339f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f28200098a0 tx=0x7f2820009bb0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.448+0000 7f2831347700 1 -- 172.21.15.59:0/3713210891 shutdown_connections 2023-09-30T22:33:34.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.448+0000 7f2831347700 1 --2- 172.21.15.59:0/3713210891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f282c09d6f0 0x7f282c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.448+0000 7f2831347700 1 --2- 172.21.15.59:0/3713210891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f282c09e000 0x7f282c1339f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.448+0000 7f2831347700 1 -- 172.21.15.59:0/3713210891 >> 172.21.15.59:0/3713210891 conn(0x7f282c066f50 msgr2=0x7f282c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.448+0000 7f2831347700 1 -- 172.21.15.59:0/3713210891 shutdown_connections 2023-09-30T22:33:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.448+0000 7f2831347700 1 -- 172.21.15.59:0/3713210891 wait complete. 2023-09-30T22:33:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.450+0000 7f2831347700 1 Processor -- start 2023-09-30T22:33:34.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.450+0000 7f2831347700 1 -- start start 2023-09-30T22:33:34.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.451+0000 7f2831347700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f282c09d6f0 0x7f282c1a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.451+0000 7f2831347700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282c09e000 0x7f282c1a5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.451+0000 7f2831347700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f282c09e410 0x7f282c1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.451+0000 7f2831347700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c1a8360 con 0x7f282c09e000 2023-09-30T22:33:34.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.451+0000 7f2831347700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0a2d40 con 0x7f282c09d6f0 2023-09-30T22:33:34.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.451+0000 7f2831347700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f282c09c710 con 0x7f282c09e410 2023-09-30T22:33:34.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.451+0000 7f282affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f282c09d6f0 0x7f282c1a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.451+0000 7f282b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f282c09e410 0x7f282c1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.451+0000 7f282affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f282c09d6f0 0x7f282c1a5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48580/0 (socket says 172.21.15.59:48580) 2023-09-30T22:33:34.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.451+0000 7f282affd700 1 -- 172.21.15.59:0/2873508298 learned_addr learned my addr 172.21.15.59:0/2873508298 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:34.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.452+0000 7f282affd700 1 -- 172.21.15.59:0/2873508298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f282c09e410 msgr2=0x7f282c1c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.452+0000 7f282affd700 1 --2- 172.21.15.59:0/2873508298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f282c09e410 0x7f282c1c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.452+0000 7f282affd700 1 -- 172.21.15.59:0/2873508298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282c09e000 msgr2=0x7f282c1a5680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:33:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.452+0000 7f282affd700 1 --2- 172.21.15.59:0/2873508298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282c09e000 0x7f282c1a5680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.452+0000 7f282affd700 1 -- 172.21.15.59:0/2873508298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c0094a0 con 0x7f282c09d6f0 2023-09-30T22:33:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.452+0000 7f282b7fe700 1 --2- 172.21.15.59:0/2873508298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f282c09e410 0x7f282c1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.452+0000 7f282affd700 1 --2- 172.21.15.59:0/2873508298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f282c09d6f0 0x7f282c1a5140 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f281c00ebe0 tx=0x7f281c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.452+0000 7f28137fe700 1 -- 172.21.15.59:0/2873508298 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c009800 con 0x7f282c09d6f0 2023-09-30T22:33:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.452+0000 7f28137fe700 1 -- 172.21.15.59:0/2873508298 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c00c910 con 0x7f282c09d6f0 2023-09-30T22:33:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.452+0000 7f2831347700 1 -- 172.21.15.59:0/2873508298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28200094a0 con 0x7f282c09d6f0 2023-09-30T22:33:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.452+0000 7f2831347700 1 -- 172.21.15.59:0/2873508298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282c1a5bc0 con 0x7f282c09d6f0 2023-09-30T22:33:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.452+0000 7f28137fe700 1 -- 172.21.15.59:0/2873508298 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c00cc80 con 0x7f282c09d6f0 2023-09-30T22:33:34.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.454+0000 7f2831347700 1 -- 172.21.15.59:0/2873508298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c0052e0 con 0x7f282c09d6f0 2023-09-30T22:33:34.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.454+0000 7f28137fe700 1 -- 172.21.15.59:0/2873508298 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f281c004020 con 0x7f282c09d6f0 2023-09-30T22:33:34.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.454+0000 7f28137fe700 1 -- 172.21.15.59:0/2873508298 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f281c03ff70 con 0x7f282c09d6f0 2023-09-30T22:33:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.463+0000 7f28137fe700 1 -- 172.21.15.59:0/2873508298 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f281c0042d0 con 0x7f282c09d6f0 2023-09-30T22:33:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.471+0000 7f06afc3f700 1 Processor -- start 2023-09-30T22:33:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.472+0000 7f06afc3f700 1 -- start start 2023-09-30T22:33:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.472+0000 7f06afc3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a806c0e0 0x7f06a809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.472+0000 7f06afc3f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06a81380f0 0x7f06a813fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.472+0000 7f06afc3f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a8134980 con 0x7f06a8134ec0 2023-09-30T22:33:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.472+0000 7f06afc3f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a806c4b0 con 0x7f06a81380f0 2023-09-30T22:33:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.472+0000 7f06afc3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a80a09c0 con 0x7f06a806c0e0 2023-09-30T22:33:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.472+0000 7f06ad9db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a806c0e0 0x7f06a809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.472+0000 7f06ad9db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a806c0e0 0x7f06a809ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48582/0 (socket says 172.21.15.59:48582) 2023-09-30T22:33:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.472+0000 7f06ad9db700 1 -- 172.21.15.59:0/278819736 learned_addr learned my addr 172.21.15.59:0/278819736 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.472+0000 7f06ae1dc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06a81380f0 0x7f06a813fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.473+0000 7f06ae1dc700 1 -- 172.21.15.59:0/278819736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a806c0e0 msgr2=0x7f06a809ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.473+0000 7f06ae1dc700 1 --2- 172.21.15.59:0/278819736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a806c0e0 0x7f06a809ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.473+0000 7f06ae1dc700 1 -- 172.21.15.59:0/278819736 >> v1:172.21.15.59:6789/0 conn(0x7f06a8134ec0 legacy=0x7f06a81379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.473+0000 7f06ae1dc700 1 -- 172.21.15.59:0/278819736 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a80a0600 con 0x7f06a81380f0 2023-09-30T22:33:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.473+0000 7f06ad9db700 1 --2- 172.21.15.59:0/278819736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a806c0e0 0x7f06a809ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.473+0000 7f06ae1dc700 1 --2- 172.21.15.59:0/278819736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a81380f0 0x7f06a813fd20 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f06a0009d90 tx=0x7f06a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b48a27bce3c820 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.473+0000 7f06ac9d9700 1 -- 172.21.15.59:0/278819736 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a000e070 con 0x7f06a81380f0 2023-09-30T22:33:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.473+0000 7f06ac9d9700 1 -- 172.21.15.59:0/278819736 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a000bae0 con 0x7f06a81380f0 2023-09-30T22:33:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.473+0000 7f06ac9d9700 1 -- 172.21.15.59:0/278819736 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a000be90 con 0x7f06a81380f0 2023-09-30T22:33:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.474+0000 7f06afc3f700 1 -- 172.21.15.59:0/278819736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a81380f0 msgr2=0x7f06a813fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.474+0000 7f06afc3f700 1 --2- 172.21.15.59:0/278819736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a81380f0 0x7f06a813fd20 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f06a0009d90 tx=0x7f06a000b330 comp rx=0 tx=0).stop 2023-09-30T22:33:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.474+0000 7f06afc3f700 1 -- 172.21.15.59:0/278819736 shutdown_connections 2023-09-30T22:33:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.474+0000 7f06afc3f700 1 --2- 172.21.15.59:0/278819736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a81380f0 0x7f06a813fd20 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.474+0000 7f06afc3f700 1 --2- 172.21.15.59:0/278819736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a806c0e0 0x7f06a809ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.474+0000 7f06afc3f700 1 -- 172.21.15.59:0/278819736 >> 172.21.15.59:0/278819736 conn(0x7f06a80a4210 msgr2=0x7f06a80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.474+0000 7f06afc3f700 1 -- 172.21.15.59:0/278819736 shutdown_connections 2023-09-30T22:33:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.474+0000 7f06afc3f700 1 -- 172.21.15.59:0/278819736 wait complete. 2023-09-30T22:33:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.475+0000 7f06afc3f700 1 Processor -- start 2023-09-30T22:33:34.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.475+0000 7f06afc3f700 1 -- start start 2023-09-30T22:33:34.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.476+0000 7f06afc3f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a806c0e0 0x7f06a811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.476+0000 7f06afc3f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a8134ec0 0x7f06a811abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.476+0000 7f06afc3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a81380f0 0x7f06a811b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.476+0000 7f06afc3f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a811ced0 con 0x7f06a806c0e0 2023-09-30T22:33:34.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.476+0000 7f06afc3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a811ca70 con 0x7f06a81380f0 2023-09-30T22:33:34.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.476+0000 7f06afc3f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06a811d880 con 0x7f06a8134ec0 2023-09-30T22:33:34.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.476+0000 7f06ae1dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a81380f0 0x7f06a811b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.476+0000 7f06ae1dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a81380f0 0x7f06a811b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48598/0 (socket says 172.21.15.59:48598) 2023-09-30T22:33:34.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.476+0000 7f06ae1dc700 1 -- 172.21.15.59:0/3552294885 learned_addr learned my addr 172.21.15.59:0/3552294885 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:34.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.476+0000 7f06ad1da700 1 --2- 172.21.15.59:0/3552294885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a8134ec0 0x7f06a811abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.476+0000 7f06ae1dc700 1 -- 172.21.15.59:0/3552294885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a8134ec0 msgr2=0x7f06a811abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.476+0000 7f06ae1dc700 1 --2- 172.21.15.59:0/3552294885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a8134ec0 0x7f06a811abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.476+0000 7f06ae1dc700 1 -- 172.21.15.59:0/3552294885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a806c0e0 msgr2=0x7f06a811a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.476+0000 7f06ae1dc700 1 --2- 172.21.15.59:0/3552294885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a806c0e0 0x7f06a811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.476+0000 7f06ae1dc700 1 -- 172.21.15.59:0/3552294885 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a4009550 con 0x7f06a81380f0 2023-09-30T22:33:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.477+0000 7f06ae1dc700 1 --2- 172.21.15.59:0/3552294885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a81380f0 0x7f06a811b100 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f06a000b680 tx=0x7f06a0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.477+0000 7f069e7fc700 1 -- 172.21.15.59:0/3552294885 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a00046a0 con 0x7f06a81380f0 2023-09-30T22:33:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.477+0000 7f069e7fc700 1 -- 172.21.15.59:0/3552294885 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a0004800 con 0x7f06a81380f0 2023-09-30T22:33:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.477+0000 7f069e7fc700 1 -- 172.21.15.59:0/3552294885 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0004970 con 0x7f06a81380f0 2023-09-30T22:33:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.477+0000 7f06afc3f700 1 -- 172.21.15.59:0/3552294885 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a0009a70 con 0x7f06a81380f0 2023-09-30T22:33:34.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.477+0000 7f06afc3f700 1 -- 172.21.15.59:0/3552294885 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a80a03f0 con 0x7f06a81380f0 2023-09-30T22:33:34.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.478+0000 7f069e7fc700 1 -- 172.21.15.59:0/3552294885 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06a0012650 con 0x7f06a81380f0 2023-09-30T22:33:34.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.478+0000 7f069e7fc700 1 -- 172.21.15.59:0/3552294885 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f06a0041770 con 0x7f06a81380f0 2023-09-30T22:33:34.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.478+0000 7f06afc3f700 1 -- 172.21.15.59:0/3552294885 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a811c6c0 con 0x7f06a81380f0 2023-09-30T22:33:34.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.483+0000 7f069e7fc700 1 -- 172.21.15.59:0/3552294885 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06a002a020 con 0x7f06a81380f0 2023-09-30T22:33:34.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.522+0000 7f0967a9d700 1 Processor -- start 2023-09-30T22:33:34.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.522+0000 7f0967a9d700 1 -- start start 2023-09-30T22:33:34.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.523+0000 7f0967a9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09600a0a30 0x7f09600a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.523+0000 7f0967a9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0960138d80 0x7f096013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.523+0000 7f0967a9d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09600a2a70 con 0x7f096009d630 2023-09-30T22:33:34.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.523+0000 7f0967a9d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09600a01d0 con 0x7f0960138d80 2023-09-30T22:33:34.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.523+0000 7f0967a9d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096009e2b0 con 0x7f09600a0a30 2023-09-30T22:33:34.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.523+0000 7f0965038700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f096009d630 0x7f09600a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35716/0 (socket says 172.21.15.59:35716) 2023-09-30T22:33:34.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.523+0000 7f0965038700 1 -- 172.21.15.59:0/1773962660 learned_addr learned my addr 172.21.15.59:0/1773962660 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:34.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.523+0000 7f096603a700 1 --2- 172.21.15.59:0/1773962660 >> v2:172.21.15.59:3300/0 conn(0x7f0960138d80 0x7f096013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.523+0000 7f0965839700 1 --2- 172.21.15.59:0/1773962660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09600a0a30 0x7f09600a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.523+0000 7f096603a700 1 -- 172.21.15.59:0/1773962660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09600a0a30 msgr2=0x7f09600a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:34.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.523+0000 7f096603a700 1 --2- 172.21.15.59:0/1773962660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09600a0a30 0x7f09600a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.523+0000 7f096603a700 1 -- 172.21.15.59:0/1773962660 >> v1:172.21.15.59:6789/0 conn(0x7f096009d630 legacy=0x7f09600a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.523+0000 7f096603a700 1 -- 172.21.15.59:0/1773962660 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096009dc50 con 0x7f0960138d80 2023-09-30T22:33:34.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.523+0000 7f0965839700 1 --2- 172.21.15.59:0/1773962660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09600a0a30 0x7f09600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:34.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.524+0000 7f096603a700 1 --2- 172.21.15.59:0/1773962660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0960138d80 0x7f096013b160 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f0958009d90 tx=0x7f095800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db16f3ca93668941 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:34.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.524+0000 7f0964837700 1 -- 172.21.15.59:0/1773962660 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095800e070 con 0x7f0960138d80 2023-09-30T22:33:34.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.524+0000 7f0964837700 1 -- 172.21.15.59:0/1773962660 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095800bbd0 con 0x7f0960138d80 2023-09-30T22:33:34.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.524+0000 7f0964837700 1 -- 172.21.15.59:0/1773962660 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0958012430 con 0x7f0960138d80 2023-09-30T22:33:34.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.525+0000 7f0967a9d700 1 -- 172.21.15.59:0/1773962660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0960138d80 msgr2=0x7f096013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.525+0000 7f0967a9d700 1 --2- 172.21.15.59:0/1773962660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0960138d80 0x7f096013b160 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f0958009d90 tx=0x7f095800b330 comp rx=0 tx=0).stop 2023-09-30T22:33:34.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.525+0000 7f0967a9d700 1 -- 172.21.15.59:0/1773962660 shutdown_connections 2023-09-30T22:33:34.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.525+0000 7f0967a9d700 1 --2- 172.21.15.59:0/1773962660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0960138d80 0x7f096013b160 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.525+0000 7f0967a9d700 1 --2- 172.21.15.59:0/1773962660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09600a0a30 0x7f09600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.525+0000 7f0967a9d700 1 -- 172.21.15.59:0/1773962660 >> 172.21.15.59:0/1773962660 conn(0x7f09600a3050 msgr2=0x7f09600a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:34.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.525+0000 7f0967a9d700 1 -- 172.21.15.59:0/1773962660 shutdown_connections 2023-09-30T22:33:34.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.525+0000 7f0967a9d700 1 -- 172.21.15.59:0/1773962660 wait complete. 2023-09-30T22:33:34.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.526+0000 7f0967a9d700 1 Processor -- start 2023-09-30T22:33:34.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.526+0000 7f0967a9d700 1 -- start start 2023-09-30T22:33:34.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.527+0000 7f0967a9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f096009d630 0x7f09601338c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.527+0000 7f0967a9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09600a0a30 0x7f0960133e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.527+0000 7f0967a9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0960138d80 0x7f0960134340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:34.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.527+0000 7f0967a9d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0960136e30 con 0x7f096009d630 2023-09-30T22:33:34.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.527+0000 7f0967a9d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09600a4e60 con 0x7f0960138d80 2023-09-30T22:33:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.527+0000 7f0967a9d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0960135ba0 con 0x7f09600a0a30 2023-09-30T22:33:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.527+0000 7f0965839700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f096009d630 0x7f09601338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.527+0000 7f0965839700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f096009d630 0x7f09601338c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44652/0 (socket says 172.21.15.59:44652) 2023-09-30T22:33:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.527+0000 7f0965839700 1 -- 172.21.15.59:0/1234821906 learned_addr learned my addr 172.21.15.59:0/1234821906 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.527+0000 7f096603a700 1 --2- 172.21.15.59:0/1234821906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0960138d80 0x7f0960134340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.527+0000 7f0965038700 1 --2- 172.21.15.59:0/1234821906 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09600a0a30 0x7f0960133e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.528+0000 7f0965839700 1 -- 172.21.15.59:0/1234821906 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09600a0a30 msgr2=0x7f0960133e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.528+0000 7f0965839700 1 --2- 172.21.15.59:0/1234821906 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09600a0a30 0x7f0960133e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.528+0000 7f0965839700 1 -- 172.21.15.59:0/1234821906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0960138d80 msgr2=0x7f0960134340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.528+0000 7f0965839700 1 --2- 172.21.15.59:0/1234821906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0960138d80 0x7f0960134340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.528+0000 7f0965839700 1 -- 172.21.15.59:0/1234821906 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0958009a70 con 0x7f096009d630 2023-09-30T22:33:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.528+0000 7f096603a700 1 --2- 172.21.15.59:0/1234821906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0960138d80 0x7f0960134340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.528+0000 7f0965839700 1 --2- 172.21.15.59:0/1234821906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f096009d630 0x7f09601338c0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f095c00c750 tx=0x7f095c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.528+0000 7f09567fc700 1 -- 172.21.15.59:0/1234821906 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c011800 con 0x7f096009d630 2023-09-30T22:33:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.528+0000 7f09567fc700 1 -- 172.21.15.59:0/1234821906 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c011960 con 0x7f096009d630 2023-09-30T22:33:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.528+0000 7f09567fc700 1 -- 172.21.15.59:0/1234821906 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c011cd0 con 0x7f096009d630 2023-09-30T22:33:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.528+0000 7f0967a9d700 1 -- 172.21.15.59:0/1234821906 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0960135430 con 0x7f096009d630 2023-09-30T22:33:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.528+0000 7f0967a9d700 1 -- 172.21.15.59:0/1234821906 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0960137310 con 0x7f096009d630 2023-09-30T22:33:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.529+0000 7f09567fc700 1 -- 172.21.15.59:0/1234821906 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f095c021350 con 0x7f096009d630 2023-09-30T22:33:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.529+0000 7f0967a9d700 1 -- 172.21.15.59:0/1234821906 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09600747f0 con 0x7f096009d630 2023-09-30T22:33:34.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.530+0000 7f09567fc700 1 -- 172.21.15.59:0/1234821906 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f095c03f6f0 con 0x7f096009d630 2023-09-30T22:33:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.535+0000 7f09567fc700 1 -- 172.21.15.59:0/1234821906 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f095c011e30 con 0x7f096009d630 2023-09-30T22:33:34.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.599+0000 7f8917391700 1 -- 172.21.15.59:0/1198609973 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f89101a9430 con 0x7f891009d6f0 2023-09-30T22:33:34.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.600+0000 7f8905ffb700 1 -- 172.21.15.59:0/1198609973 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f890c0239c0 con 0x7f891009d6f0 2023-09-30T22:33:34.600 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.603+0000 7f8917391700 1 -- 172.21.15.59:0/1198609973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f891009d6f0 msgr2=0x7f89101a5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.603+0000 7f8917391700 1 --2- 172.21.15.59:0/1198609973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f891009d6f0 0x7f89101a5ff0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f890c009870 tx=0x7f890c004750 comp rx=0 tx=0).stop 2023-09-30T22:33:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.604+0000 7f8917391700 1 -- 172.21.15.59:0/1198609973 shutdown_connections 2023-09-30T22:33:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.604+0000 7f8917391700 1 --2- 172.21.15.59:0/1198609973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f891009d6f0 0x7f89101a5ff0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.604+0000 7f8917391700 1 --2- 172.21.15.59:0/1198609973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f891009e410 0x7f89101a6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.604+0000 7f8917391700 1 --2- 172.21.15.59:0/1198609973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f891009e000 0x7f89101a6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.604+0000 7f8917391700 1 -- 172.21.15.59:0/1198609973 >> 172.21.15.59:0/1198609973 conn(0x7f8910066f50 msgr2=0x7f89101bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.604+0000 7f8917391700 1 -- 172.21.15.59:0/1198609973 shutdown_connections 2023-09-30T22:33:34.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.604+0000 7f8917391700 1 -- 172.21.15.59:0/1198609973 wait complete. 2023-09-30T22:33:34.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.695+0000 7f06afc3f700 1 -- 172.21.15.59:0/3552294885 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f06a8074ea0 con 0x7f06a81380f0 2023-09-30T22:33:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.695+0000 7f069e7fc700 1 -- 172.21.15.59:0/3552294885 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06a0012900 con 0x7f06a81380f0 2023-09-30T22:33:34.695 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:34.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.698+0000 7f06afc3f700 1 -- 172.21.15.59:0/3552294885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a81380f0 msgr2=0x7f06a811b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.698+0000 7f06afc3f700 1 --2- 172.21.15.59:0/3552294885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a81380f0 0x7f06a811b100 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f06a000b680 tx=0x7f06a0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.698+0000 7f06afc3f700 1 -- 172.21.15.59:0/3552294885 shutdown_connections 2023-09-30T22:33:34.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.698+0000 7f06afc3f700 1 --2- 172.21.15.59:0/3552294885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a81380f0 0x7f06a811b100 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.698+0000 7f06afc3f700 1 --2- 172.21.15.59:0/3552294885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a806c0e0 0x7f06a811a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.698+0000 7f06afc3f700 1 --2- 172.21.15.59:0/3552294885 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a8134ec0 0x7f06a811abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.698+0000 7f06afc3f700 1 -- 172.21.15.59:0/3552294885 >> 172.21.15.59:0/3552294885 conn(0x7f06a80a4210 msgr2=0x7f06a81377a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:34.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.698+0000 7f06afc3f700 1 -- 172.21.15.59:0/3552294885 shutdown_connections 2023-09-30T22:33:34.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.698+0000 7f06afc3f700 1 -- 172.21.15.59:0/3552294885 wait complete. 2023-09-30T22:33:34.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:34.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.743+0000 7f0967a9d700 1 -- 172.21.15.59:0/1234821906 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0960136f70 con 0x7f096009d630 2023-09-30T22:33:34.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.744+0000 7f09567fc700 1 -- 172.21.15.59:0/1234821906 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0960136f70 con 0x7f096009d630 2023-09-30T22:33:34.744 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:34.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.746+0000 7f0967a9d700 1 -- 172.21.15.59:0/1234821906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f096009d630 msgr2=0x7f09601338c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.746+0000 7f0967a9d700 1 --2- 172.21.15.59:0/1234821906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f096009d630 0x7f09601338c0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f095c00c750 tx=0x7f095c00cb10 comp rx=0 tx=0).stop 2023-09-30T22:33:34.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.746+0000 7f0967a9d700 1 -- 172.21.15.59:0/1234821906 shutdown_connections 2023-09-30T22:33:34.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.746+0000 7f0967a9d700 1 --2- 172.21.15.59:0/1234821906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0960138d80 0x7f0960134340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.746+0000 7f0967a9d700 1 --2- 172.21.15.59:0/1234821906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f096009d630 0x7f09601338c0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.746+0000 7f0967a9d700 1 --2- 172.21.15.59:0/1234821906 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09600a0a30 0x7f0960133e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.746+0000 7f0967a9d700 1 -- 172.21.15.59:0/1234821906 >> 172.21.15.59:0/1234821906 conn(0x7f09600a3050 msgr2=0x7f096009f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:34.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.746+0000 7f0967a9d700 1 -- 172.21.15.59:0/1234821906 shutdown_connections 2023-09-30T22:33:34.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.746+0000 7f0967a9d700 1 -- 172.21.15.59:0/1234821906 wait complete. 2023-09-30T22:33:34.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.754+0000 7f2831347700 1 -- 172.21.15.59:0/2873508298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f280c005150 con 0x7f282c09d6f0 2023-09-30T22:33:34.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.754+0000 7f28137fe700 1 -- 172.21.15.59:0/2873508298 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f281c021030 con 0x7f282c09d6f0 2023-09-30T22:33:34.754 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:34.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.756+0000 7f2831347700 1 -- 172.21.15.59:0/2873508298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f282c09d6f0 msgr2=0x7f282c1a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:34.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.756+0000 7f2831347700 1 --2- 172.21.15.59:0/2873508298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f282c09d6f0 0x7f282c1a5140 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f281c00ebe0 tx=0x7f281c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.757+0000 7f2831347700 1 -- 172.21.15.59:0/2873508298 shutdown_connections 2023-09-30T22:33:34.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.757+0000 7f2831347700 1 --2- 172.21.15.59:0/2873508298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f282c09e410 0x7f282c1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.757+0000 7f2831347700 1 --2- 172.21.15.59:0/2873508298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f282c09d6f0 0x7f282c1a5140 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.757+0000 7f2831347700 1 --2- 172.21.15.59:0/2873508298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282c09e000 0x7f282c1a5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:34.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.757+0000 7f2831347700 1 -- 172.21.15.59:0/2873508298 >> 172.21.15.59:0/2873508298 conn(0x7f282c066f50 msgr2=0x7f282c1bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:34.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.757+0000 7f2831347700 1 -- 172.21.15.59:0/2873508298 shutdown_connections 2023-09-30T22:33:34.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:34.757+0000 7f2831347700 1 -- 172.21.15.59:0/2873508298 wait complete. 2023-09-30T22:33:34.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:34.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:35.619 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:35.718 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:35.760 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:35.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.769+0000 7feee63e7700 1 Processor -- start 2023-09-30T22:33:35.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.769+0000 7feee63e7700 1 -- start start 2023-09-30T22:33:35.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.770+0000 7feee63e7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feee0131630 0x7feee0131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.770+0000 7feee63e7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee0131f40 0x7feee006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.770+0000 7feee63e7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feee006e9d0 0x7feee006ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.770+0000 7feee63e7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee0071a00 con 0x7feee0131630 2023-09-30T22:33:35.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.770+0000 7feee63e7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee0131430 con 0x7feee0131f40 2023-09-30T22:33:35.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.770+0000 7feee63e7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feee009a510 con 0x7feee006e9d0 2023-09-30T22:33:35.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.770+0000 7feedf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee0131f40 0x7feee006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.770+0000 7feedffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feee0131630 0x7feee0131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.770+0000 7feedffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feee0131630 0x7feee0131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44668/0 (socket says 172.21.15.59:44668) 2023-09-30T22:33:35.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.770+0000 7feee4984700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feee006e9d0 0x7feee006ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.770+0000 7feedffff700 1 -- 172.21.15.59:0/2769234195 learned_addr learned my addr 172.21.15.59:0/2769234195 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:35.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.770+0000 7feedf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee0131f40 0x7feee006e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48618/0 (socket says 172.21.15.59:48618) 2023-09-30T22:33:35.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.771+0000 7feee4984700 1 -- 172.21.15.59:0/2769234195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee0131f40 msgr2=0x7feee006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:35.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.771+0000 7feee4984700 1 --2- 172.21.15.59:0/2769234195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee0131f40 0x7feee006e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.771+0000 7feee4984700 1 -- 172.21.15.59:0/2769234195 >> v2:172.21.15.59:3300/0 conn(0x7feee0131630 msgr2=0x7feee0131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:35.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.771+0000 7feee4984700 1 --2- 172.21.15.59:0/2769234195 >> v2:172.21.15.59:3300/0 conn(0x7feee0131630 0x7feee0131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.771+0000 7feee4984700 1 -- 172.21.15.59:0/2769234195 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee00721c0 con 0x7feee006e9d0 2023-09-30T22:33:35.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.771+0000 7feedffff700 1 --2- 172.21.15.59:0/2769234195 >> v2:172.21.15.59:3300/0 conn(0x7feee0131630 0x7feee0131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:35.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.771+0000 7feedf7fe700 1 --2- 172.21.15.59:0/2769234195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee0131f40 0x7feee006e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:35.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.771+0000 7feee4984700 1 --2- 172.21.15.59:0/2769234195 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feee006e9d0 0x7feee006ee50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7feed8009d90 tx=0x7feed800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b392b9a37d6b1926 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:35.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.771+0000 7feedeffd700 1 -- 172.21.15.59:0/2769234195 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed800e070 con 0x7feee006e9d0 2023-09-30T22:33:35.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.771+0000 7feedeffd700 1 -- 172.21.15.59:0/2769234195 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed800bb20 con 0x7feee006e9d0 2023-09-30T22:33:35.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.771+0000 7feedeffd700 1 -- 172.21.15.59:0/2769234195 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8012430 con 0x7feee006e9d0 2023-09-30T22:33:35.773 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:35.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.772+0000 7feee63e7700 1 -- 172.21.15.59:0/2769234195 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feee006e9d0 msgr2=0x7feee006ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:35.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.772+0000 7feee63e7700 1 --2- 172.21.15.59:0/2769234195 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feee006e9d0 0x7feee006ee50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7feed8009d90 tx=0x7feed800b330 comp rx=0 tx=0).stop 2023-09-30T22:33:35.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.772+0000 7feee63e7700 1 -- 172.21.15.59:0/2769234195 shutdown_connections 2023-09-30T22:33:35.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.772+0000 7feee63e7700 1 --2- 172.21.15.59:0/2769234195 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feee006e9d0 0x7feee006ee50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.772+0000 7feee63e7700 1 --2- 172.21.15.59:0/2769234195 >> v2:172.21.15.59:3300/0 conn(0x7feee0131630 0x7feee0131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.772+0000 7feee63e7700 1 --2- 172.21.15.59:0/2769234195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee0131f40 0x7feee006e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.772+0000 7feee63e7700 1 -- 172.21.15.59:0/2769234195 >> 172.21.15.59:0/2769234195 conn(0x7feee00a2aa0 msgr2=0x7feee00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:35.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.772+0000 7feee63e7700 1 -- 172.21.15.59:0/2769234195 shutdown_connections 2023-09-30T22:33:35.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.773+0000 7feee63e7700 1 -- 172.21.15.59:0/2769234195 wait complete. 2023-09-30T22:33:35.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.773+0000 7feee63e7700 1 Processor -- start 2023-09-30T22:33:35.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.774+0000 7feee63e7700 1 -- start start 2023-09-30T22:33:35.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.774+0000 7feee63e7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee006e9d0 0x7feee01c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.774+0000 7feee63e7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee0131630 0x7feee01c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.774+0000 7feee63e7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feee0131f40 0x7feee01c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.774+0000 7feee63e7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee011d030 con 0x7feee006e9d0 2023-09-30T22:33:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.774+0000 7feee63e7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee011a7f0 con 0x7feee0131630 2023-09-30T22:33:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.774+0000 7feee63e7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feee009f7d0 con 0x7feee0131f40 2023-09-30T22:33:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.774+0000 7feedffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee006e9d0 0x7feee01c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.774+0000 7feedffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee006e9d0 0x7feee01c4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44676/0 (socket says 172.21.15.59:44676) 2023-09-30T22:33:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.774+0000 7feedf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee0131630 0x7feee01c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.774+0000 7feedffff700 1 -- 172.21.15.59:0/3940245806 learned_addr learned my addr 172.21.15.59:0/3940245806 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.775+0000 7feee4984700 1 --2- 172.21.15.59:0/3940245806 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feee0131f40 0x7feee01c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.775+0000 7feedffff700 1 -- 172.21.15.59:0/3940245806 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feee0131f40 msgr2=0x7feee01c05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.775+0000 7feedffff700 1 --2- 172.21.15.59:0/3940245806 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feee0131f40 0x7feee01c05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.775+0000 7feedffff700 1 -- 172.21.15.59:0/3940245806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee0131630 msgr2=0x7feee01c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.775+0000 7feedffff700 1 --2- 172.21.15.59:0/3940245806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee0131630 0x7feee01c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.775+0000 7feedffff700 1 -- 172.21.15.59:0/3940245806 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed0009550 con 0x7feee006e9d0 2023-09-30T22:33:35.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.775+0000 7feedf7fe700 1 --2- 172.21.15.59:0/3940245806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee0131630 0x7feee01c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:35.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.775+0000 7feedffff700 1 --2- 172.21.15.59:0/3940245806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee006e9d0 0x7feee01c4010 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7feed000ebe0 tx=0x7feed000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:35.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.775+0000 7feedcff9700 1 -- 172.21.15.59:0/3940245806 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed000c850 con 0x7feee006e9d0 2023-09-30T22:33:35.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.775+0000 7feedcff9700 1 -- 172.21.15.59:0/3940245806 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed000c9b0 con 0x7feee006e9d0 2023-09-30T22:33:35.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.775+0000 7feee63e7700 1 -- 172.21.15.59:0/3940245806 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed400d940 con 0x7feee006e9d0 2023-09-30T22:33:35.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.775+0000 7feedcff9700 1 -- 172.21.15.59:0/3940245806 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed000cd40 con 0x7feee006e9d0 2023-09-30T22:33:35.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.775+0000 7feee63e7700 1 -- 172.21.15.59:0/3940245806 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed8009a70 con 0x7feee006e9d0 2023-09-30T22:33:35.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.777+0000 7feee63e7700 1 -- 172.21.15.59:0/3940245806 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee01c4a90 con 0x7feee006e9d0 2023-09-30T22:33:35.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.777+0000 7feedcff9700 1 -- 172.21.15.59:0/3940245806 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feed0013470 con 0x7feee006e9d0 2023-09-30T22:33:35.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.777+0000 7feedcff9700 1 -- 172.21.15.59:0/3940245806 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feed0040040 con 0x7feee006e9d0 2023-09-30T22:33:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.786+0000 7feedcff9700 1 -- 172.21.15.59:0/3940245806 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feed0011760 con 0x7feee006e9d0 2023-09-30T22:33:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.879+0000 7fc35d6e4700 1 Processor -- start 2023-09-30T22:33:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.879+0000 7fc35d6e4700 1 -- start start 2023-09-30T22:33:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.880+0000 7fc35d6e4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc358130540 0x7fc358130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.880+0000 7fc35d6e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc35806fcf0 0x7fc358138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.880+0000 7fc35d6e4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3580716a0 con 0x7fc358130e50 2023-09-30T22:33:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.880+0000 7fc35d6e4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35809a390 con 0x7fc358130540 2023-09-30T22:33:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.880+0000 7fc35d6e4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc358071290 con 0x7fc35806fcf0 2023-09-30T22:33:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.880+0000 7fc3577fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc35806fcf0 0x7fc358138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.880+0000 7fc3577fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc35806fcf0 0x7fc358138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48628/0 (socket says 172.21.15.59:48628) 2023-09-30T22:33:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.880+0000 7fc3577fe700 1 -- 172.21.15.59:0/3016164790 learned_addr learned my addr 172.21.15.59:0/3016164790 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.880+0000 7fc356ffd700 1 --2- 172.21.15.59:0/3016164790 >> v2:172.21.15.59:3300/0 conn(0x7fc358130540 0x7fc358130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.880+0000 7fc355ffb700 1 -- 172.21.15.59:0/3016164790 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844055732 0 0) 0x7fc3580716a0 con 0x7fc358130e50 2023-09-30T22:33:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.881+0000 7fc355ffb700 1 -- 172.21.15.59:0/3016164790 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3400035b0 con 0x7fc358130e50 2023-09-30T22:33:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.881+0000 7fc3577fe700 1 -- 172.21.15.59:0/3016164790 >> v2:172.21.15.59:3300/0 conn(0x7fc358130540 msgr2=0x7fc358130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.881+0000 7fc3577fe700 1 --2- 172.21.15.59:0/3016164790 >> v2:172.21.15.59:3300/0 conn(0x7fc358130540 0x7fc358130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.881+0000 7fc3577fe700 1 -- 172.21.15.59:0/3016164790 >> v1:172.21.15.59:6789/0 conn(0x7fc358130e50 legacy=0x7fc35806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.881+0000 7fc3577fe700 1 -- 172.21.15.59:0/3016164790 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc358130340 con 0x7fc35806fcf0 2023-09-30T22:33:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.881+0000 7fc3577fe700 1 --2- 172.21.15.59:0/3016164790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc35806fcf0 0x7fc358138570 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc350009e80 tx=0x7fc35000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b56bb27a8d8a3cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.881+0000 7fc355ffb700 1 -- 172.21.15.59:0/3016164790 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35000e070 con 0x7fc35806fcf0 2023-09-30T22:33:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.881+0000 7fc355ffb700 1 -- 172.21.15.59:0/3016164790 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35000b8d0 con 0x7fc35806fcf0 2023-09-30T22:33:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.881+0000 7fc355ffb700 1 -- 172.21.15.59:0/3016164790 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35000bc80 con 0x7fc35806fcf0 2023-09-30T22:33:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.882+0000 7fc35d6e4700 1 -- 172.21.15.59:0/3016164790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc35806fcf0 msgr2=0x7fc358138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.882+0000 7fc35d6e4700 1 --2- 172.21.15.59:0/3016164790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc35806fcf0 0x7fc358138570 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc350009e80 tx=0x7fc35000b330 comp rx=0 tx=0).stop 2023-09-30T22:33:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.882+0000 7fc35d6e4700 1 -- 172.21.15.59:0/3016164790 shutdown_connections 2023-09-30T22:33:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.882+0000 7fc35d6e4700 1 --2- 172.21.15.59:0/3016164790 >> v2:172.21.15.59:3300/0 conn(0x7fc358130540 0x7fc358130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.882+0000 7fc35d6e4700 1 --2- 172.21.15.59:0/3016164790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc35806fcf0 0x7fc358138570 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.882+0000 7fc35d6e4700 1 -- 172.21.15.59:0/3016164790 >> 172.21.15.59:0/3016164790 conn(0x7fc3580a2aa0 msgr2=0x7fc3580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.882+0000 7fc35d6e4700 1 -- 172.21.15.59:0/3016164790 shutdown_connections 2023-09-30T22:33:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.882+0000 7fc35d6e4700 1 -- 172.21.15.59:0/3016164790 wait complete. 2023-09-30T22:33:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.883+0000 7fc35d6e4700 1 Processor -- start 2023-09-30T22:33:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.883+0000 7fc35d6e4700 1 -- start start 2023-09-30T22:33:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.884+0000 7fc35d6e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc35806fcf0 0x7fc35809a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.884+0000 7fc35d6e4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc358130540 0x7fc35809aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.884+0000 7fc35d6e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc358130e50 0x7fc35809b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.884+0000 7fc35d6e4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35809ca80 con 0x7fc358130e50 2023-09-30T22:33:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.884+0000 7fc35d6e4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35809b9f0 con 0x7fc35806fcf0 2023-09-30T22:33:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.884+0000 7fc35d6e4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3580718e0 con 0x7fc358130540 2023-09-30T22:33:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.884+0000 7fc3567fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc358130540 0x7fc35809aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.884+0000 7fc3567fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc358130540 0x7fc35809aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52402/0 (socket says 172.21.15.59:52402) 2023-09-30T22:33:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.884+0000 7fc3567fc700 1 -- 172.21.15.59:0/1876902571 learned_addr learned my addr 172.21.15.59:0/1876902571 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.884+0000 7fc3577fe700 1 --2- 172.21.15.59:0/1876902571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc358130e50 0x7fc35809b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.884+0000 7fc356ffd700 1 --2- 172.21.15.59:0/1876902571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc35806fcf0 0x7fc35809a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.885+0000 7fc3567fc700 1 -- 172.21.15.59:0/1876902571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc35806fcf0 msgr2=0x7fc35809a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.885+0000 7fc3567fc700 1 --2- 172.21.15.59:0/1876902571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc35806fcf0 0x7fc35809a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.885+0000 7fc3567fc700 1 -- 172.21.15.59:0/1876902571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc358130e50 msgr2=0x7fc35809b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:35.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.885+0000 7fc3567fc700 1 --2- 172.21.15.59:0/1876902571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc358130e50 0x7fc35809b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.885+0000 7fc3567fc700 1 -- 172.21.15.59:0/1876902571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc350009b30 con 0x7fc358130540 2023-09-30T22:33:35.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.885+0000 7fc3577fe700 1 --2- 172.21.15.59:0/1876902571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc358130e50 0x7fc35809b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:35.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.885+0000 7fc3567fc700 1 --2- 172.21.15.59:0/1876902571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc358130540 0x7fc35809aad0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00c520 tx=0x7fc34c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:35.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.885+0000 7fc33f7fe700 1 -- 172.21.15.59:0/1876902571 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c0052d0 con 0x7fc358130540 2023-09-30T22:33:35.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.885+0000 7fc33f7fe700 1 -- 172.21.15.59:0/1876902571 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c005430 con 0x7fc358130540 2023-09-30T22:33:35.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.885+0000 7fc35d6e4700 1 -- 172.21.15.59:0/1876902571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35809c550 con 0x7fc358130540 2023-09-30T22:33:35.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.885+0000 7fc33f7fe700 1 -- 172.21.15.59:0/1876902571 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c0038a0 con 0x7fc358130540 2023-09-30T22:33:35.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.885+0000 7fc35d6e4700 1 -- 172.21.15.59:0/1876902571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35812da40 con 0x7fc358130540 2023-09-30T22:33:35.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.886+0000 7fc33f7fe700 1 -- 172.21.15.59:0/1876902571 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc34c003a00 con 0x7fc358130540 2023-09-30T22:33:35.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.887+0000 7fc35d6e4700 1 -- 172.21.15.59:0/1876902571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc358074ea0 con 0x7fc358130540 2023-09-30T22:33:35.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.887+0000 7fc33f7fe700 1 -- 172.21.15.59:0/1876902571 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc34c03ead0 con 0x7fc358130540 2023-09-30T22:33:35.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.892+0000 7fc33f7fe700 1 -- 172.21.15.59:0/1876902571 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc34c017070 con 0x7fc358130540 2023-09-30T22:33:35.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.916+0000 7f0d61887700 1 Processor -- start 2023-09-30T22:33:35.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.916+0000 7f0d61887700 1 -- start start 2023-09-30T22:33:35.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.917+0000 7f0d61887700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0d5c09d6f0 0x7f0d5c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.917+0000 7f0d61887700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d5c09e440 0x7f0d5c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.917+0000 7f0d61887700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5c09b120 con 0x7f0d5c09e000 2023-09-30T22:33:35.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.917+0000 7f0d61887700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5c06b460 con 0x7f0d5c09d6f0 2023-09-30T22:33:35.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.917+0000 7f0d61887700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c09a7e0 con 0x7f0d5c09e440 2023-09-30T22:33:35.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.918+0000 7f0d5b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d5c09e440 0x7f0d5c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.918+0000 7f0d5b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d5c09e440 0x7f0d5c134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52408/0 (socket says 172.21.15.59:52408) 2023-09-30T22:33:35.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.918+0000 7f0d5b7fe700 1 -- 172.21.15.59:0/3455957829 learned_addr learned my addr 172.21.15.59:0/3455957829 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:35.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.918+0000 7f0d5affd700 1 --2- 172.21.15.59:0/3455957829 >> v2:172.21.15.59:3300/0 conn(0x7f0d5c09d6f0 0x7f0d5c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.918+0000 7fb46b5e3700 1 Processor -- start 2023-09-30T22:33:35.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.918+0000 7f0d59ffb700 1 -- 172.21.15.59:0/3455957829 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667757091 0 0) 0x7f0d5c09b120 con 0x7f0d5c09e000 2023-09-30T22:33:35.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.918+0000 7f0d59ffb700 1 -- 172.21.15.59:0/3455957829 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d440035b0 con 0x7f0d5c09e000 2023-09-30T22:33:35.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.918+0000 7f0d5b7fe700 1 -- 172.21.15.59:0/3455957829 >> v2:172.21.15.59:3300/0 conn(0x7f0d5c09d6f0 msgr2=0x7f0d5c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:35.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.918+0000 7f0d5b7fe700 1 --2- 172.21.15.59:0/3455957829 >> v2:172.21.15.59:3300/0 conn(0x7f0d5c09d6f0 0x7f0d5c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.918+0000 7f0d5b7fe700 1 -- 172.21.15.59:0/3455957829 >> v1:172.21.15.59:6789/0 conn(0x7f0d5c09e000 legacy=0x7f0d5c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:35.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.918+0000 7f0d5b7fe700 1 -- 172.21.15.59:0/3455957829 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c09a500 con 0x7f0d5c09e440 2023-09-30T22:33:35.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.918+0000 7f0d5affd700 1 --2- 172.21.15.59:0/3455957829 >> v2:172.21.15.59:3300/0 conn(0x7f0d5c09d6f0 0x7f0d5c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:35.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.918+0000 7f0d5b7fe700 1 --2- 172.21.15.59:0/3455957829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d5c09e440 0x7f0d5c134100 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009e80 tx=0x7f0d5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a4b72af95814ea1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:35.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.918+0000 7fb46b5e3700 1 -- start start 2023-09-30T22:33:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7f0d59ffb700 1 -- 172.21.15.59:0/3455957829 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5400e070 con 0x7f0d5c09e440 2023-09-30T22:33:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7f0d59ffb700 1 -- 172.21.15.59:0/3455957829 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5400b8d0 con 0x7f0d5c09e440 2023-09-30T22:33:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7f0d59ffb700 1 -- 172.21.15.59:0/3455957829 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5400bc40 con 0x7f0d5c09e440 2023-09-30T22:33:35.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7fb46b5e3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb46409e1d0 0x7fb464135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7fb46b5e3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb464135e50 0x7fb464138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7fb46b5e3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46409f130 con 0x7fb46409d6f0 2023-09-30T22:33:35.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7fb46b5e3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46409f520 con 0x7fb464135e50 2023-09-30T22:33:35.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7fb46b5e3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb46409e930 con 0x7fb46409e1d0 2023-09-30T22:33:35.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7fb469b80700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb464135e50 0x7fb464138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7fb469b80700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb464135e50 0x7fb464138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44710/0 (socket says 172.21.15.59:44710) 2023-09-30T22:33:35.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7fb469b80700 1 -- 172.21.15.59:0/3280609243 learned_addr learned my addr 172.21.15.59:0/3280609243 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:35.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7fb468b7e700 1 --2- 172.21.15.59:0/3280609243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb46409e1d0 0x7fb464135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7fb469b80700 1 -- 172.21.15.59:0/3280609243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb46409e1d0 msgr2=0x7fb464135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:35.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7fb469b80700 1 --2- 172.21.15.59:0/3280609243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb46409e1d0 0x7fb464135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7fb469b80700 1 -- 172.21.15.59:0/3280609243 >> v1:172.21.15.59:6789/0 conn(0x7fb46409d6f0 legacy=0x7fb46409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:35.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7fb469b80700 1 -- 172.21.15.59:0/3280609243 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46409b2d0 con 0x7fb464135e50 2023-09-30T22:33:35.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.919+0000 7fb468b7e700 1 --2- 172.21.15.59:0/3280609243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb46409e1d0 0x7fb464135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:35.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.920+0000 7fb469b80700 1 --2- 172.21.15.59:0/3280609243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb464135e50 0x7fb464138230 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009e80 tx=0x7fb45c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217363b4376093a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:35.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.920+0000 7f0d61887700 1 -- 172.21.15.59:0/3455957829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d5c09e440 msgr2=0x7f0d5c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:35.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.920+0000 7f0d61887700 1 --2- 172.21.15.59:0/3455957829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d5c09e440 0x7f0d5c134100 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009e80 tx=0x7f0d5400b330 comp rx=0 tx=0).stop 2023-09-30T22:33:35.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.920+0000 7f0d61887700 1 -- 172.21.15.59:0/3455957829 shutdown_connections 2023-09-30T22:33:35.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.920+0000 7f0d61887700 1 --2- 172.21.15.59:0/3455957829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d5c09e440 0x7f0d5c134100 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.920+0000 7f0d61887700 1 --2- 172.21.15.59:0/3455957829 >> v2:172.21.15.59:3300/0 conn(0x7f0d5c09d6f0 0x7f0d5c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.920+0000 7f0d61887700 1 -- 172.21.15.59:0/3455957829 >> 172.21.15.59:0/3455957829 conn(0x7f0d5c066f50 msgr2=0x7f0d5c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:35.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.920+0000 7f0d61887700 1 -- 172.21.15.59:0/3455957829 shutdown_connections 2023-09-30T22:33:35.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.920+0000 7f0d61887700 1 -- 172.21.15.59:0/3455957829 wait complete. 2023-09-30T22:33:35.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.920+0000 7fb45bfff700 1 -- 172.21.15.59:0/3280609243 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c00e070 con 0x7fb464135e50 2023-09-30T22:33:35.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.920+0000 7fb45bfff700 1 -- 172.21.15.59:0/3280609243 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c00b8d0 con 0x7fb464135e50 2023-09-30T22:33:35.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.920+0000 7fb45bfff700 1 -- 172.21.15.59:0/3280609243 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c00bc80 con 0x7fb464135e50 2023-09-30T22:33:35.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.921+0000 7f0d61887700 1 Processor -- start 2023-09-30T22:33:35.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.921+0000 7fb46b5e3700 1 -- 172.21.15.59:0/3280609243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb464135e50 msgr2=0x7fb464138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:35.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.921+0000 7fb46b5e3700 1 --2- 172.21.15.59:0/3280609243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb464135e50 0x7fb464138230 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009e80 tx=0x7fb45c00b330 comp rx=0 tx=0).stop 2023-09-30T22:33:35.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.921+0000 7fb46b5e3700 1 -- 172.21.15.59:0/3280609243 shutdown_connections 2023-09-30T22:33:35.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.921+0000 7fb46b5e3700 1 --2- 172.21.15.59:0/3280609243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb464135e50 0x7fb464138230 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.921+0000 7fb46b5e3700 1 --2- 172.21.15.59:0/3280609243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb46409e1d0 0x7fb464135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.921+0000 7fb46b5e3700 1 -- 172.21.15.59:0/3280609243 >> 172.21.15.59:0/3280609243 conn(0x7fb464066f50 msgr2=0x7fb46409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:35.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.921+0000 7fb46b5e3700 1 -- 172.21.15.59:0/3280609243 shutdown_connections 2023-09-30T22:33:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.921+0000 7f0d61887700 1 -- start start 2023-09-30T22:33:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.921+0000 7fb46b5e3700 1 -- 172.21.15.59:0/3280609243 wait complete. 2023-09-30T22:33:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.922+0000 7f0d61887700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d5c09d6f0 0x7f0d5c1a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.922+0000 7f0d61887700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d5c09e000 0x7f0d5c1c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.922+0000 7f0d61887700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d5c09e440 0x7f0d5c1c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.922+0000 7f0d61887700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c1a7080 con 0x7f0d5c09d6f0 2023-09-30T22:33:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.922+0000 7f0d61887700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c1a4db0 con 0x7f0d5c09e000 2023-09-30T22:33:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.922+0000 7f0d61887700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c1a7c80 con 0x7f0d5c09e440 2023-09-30T22:33:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.922+0000 7f0d5b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d5c09e440 0x7f0d5c1c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.922+0000 7f0d5b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d5c09e440 0x7f0d5c1c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52422/0 (socket says 172.21.15.59:52422) 2023-09-30T22:33:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.922+0000 7f0d5b7fe700 1 -- 172.21.15.59:0/1732436663 learned_addr learned my addr 172.21.15.59:0/1732436663 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.922+0000 7f0d5affd700 1 --2- 172.21.15.59:0/1732436663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d5c09d6f0 0x7f0d5c1a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.922+0000 7f0d5b7fe700 1 -- 172.21.15.59:0/1732436663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d5c09e000 msgr2=0x7f0d5c1c7f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:33:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.922+0000 7f0d5b7fe700 1 --2- 172.21.15.59:0/1732436663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d5c09e000 0x7f0d5c1c7f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.922+0000 7f0d5b7fe700 1 -- 172.21.15.59:0/1732436663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d5c09d6f0 msgr2=0x7f0d5c1a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.922+0000 7f0d5b7fe700 1 --2- 172.21.15.59:0/1732436663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d5c09d6f0 0x7f0d5c1a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.922+0000 7f0d5b7fe700 1 -- 172.21.15.59:0/1732436663 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c0094a0 con 0x7f0d5c09e440 2023-09-30T22:33:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.923+0000 7f0d5b7fe700 1 --2- 172.21.15.59:0/1732436663 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d5c09e440 0x7f0d5c1c8480 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c09a920 tx=0x7f0d54004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.923+0000 7fb46b5e3700 1 Processor -- start 2023-09-30T22:33:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.923+0000 7f0d43fff700 1 -- 172.21.15.59:0/1732436663 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54003e90 con 0x7f0d5c09e440 2023-09-30T22:33:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.923+0000 7f0d43fff700 1 -- 172.21.15.59:0/1732436663 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d54004250 con 0x7f0d5c09e440 2023-09-30T22:33:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.923+0000 7f0d43fff700 1 -- 172.21.15.59:0/1732436663 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54004600 con 0x7f0d5c09e440 2023-09-30T22:33:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.923+0000 7fb46b5e3700 1 -- start start 2023-09-30T22:33:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.923+0000 7f0d61887700 1 -- 172.21.15.59:0/1732436663 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d54009b30 con 0x7f0d5c09e440 2023-09-30T22:33:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.923+0000 7f0d61887700 1 -- 172.21.15.59:0/1732436663 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c1a89b0 con 0x7f0d5c09e440 2023-09-30T22:33:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.924+0000 7fb46b5e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb46409d6f0 0x7fb46411a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.924+0000 7fb46b5e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb46409e1d0 0x7fb46411ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.924+0000 7fb46b5e3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb464135e50 0x7fb46411b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.924+0000 7fb46b5e3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46411e000 con 0x7fb46409e1d0 2023-09-30T22:33:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.924+0000 7fb46b5e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb464135b90 con 0x7fb46409d6f0 2023-09-30T22:33:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.924+0000 7fb46b5e3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb46411d580 con 0x7fb464135e50 2023-09-30T22:33:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.924+0000 7fb468b7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb46409e1d0 0x7fb46411ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.924+0000 7fb468b7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb46409e1d0 0x7fb46411ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44734/0 (socket says 172.21.15.59:44734) 2023-09-30T22:33:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.924+0000 7fb468b7e700 1 -- 172.21.15.59:0/2165042502 learned_addr learned my addr 172.21.15.59:0/2165042502 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.924+0000 7fb46937f700 1 --2- 172.21.15.59:0/2165042502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb46409d6f0 0x7fb46411a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.924+0000 7f0d61887700 1 -- 172.21.15.59:0/1732436663 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c1b91b0 con 0x7f0d5c09e440 2023-09-30T22:33:35.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.924+0000 7fb468b7e700 1 -- 172.21.15.59:0/2165042502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb464135e50 msgr2=0x7fb46411b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:35.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.924+0000 7fb468b7e700 1 --2- 172.21.15.59:0/2165042502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb464135e50 0x7fb46411b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.925+0000 7fb468b7e700 1 -- 172.21.15.59:0/2165042502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb46409d6f0 msgr2=0x7fb46411a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:35.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.925+0000 7fb468b7e700 1 --2- 172.21.15.59:0/2165042502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb46409d6f0 0x7fb46411a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:35.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.925+0000 7fb468b7e700 1 -- 172.21.15.59:0/2165042502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540094a0 con 0x7fb46409e1d0 2023-09-30T22:33:35.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.925+0000 7fb468b7e700 1 --2- 172.21.15.59:0/2165042502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb46409e1d0 0x7fb46411ac60 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fb45400ebe0 tx=0x7fb45400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.925+0000 7fb459ffb700 1 -- 172.21.15.59:0/2165042502 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400c910 con 0x7fb46409e1d0 2023-09-30T22:33:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.925+0000 7fb459ffb700 1 -- 172.21.15.59:0/2165042502 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45400ca70 con 0x7fb46409e1d0 2023-09-30T22:33:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.925+0000 7fb46b5e3700 1 -- 172.21.15.59:0/2165042502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c009b30 con 0x7fb46409e1d0 2023-09-30T22:33:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.925+0000 7fb459ffb700 1 -- 172.21.15.59:0/2165042502 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400cde0 con 0x7fb46409e1d0 2023-09-30T22:33:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.925+0000 7f0d43fff700 1 -- 172.21.15.59:0/1732436663 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d54004760 con 0x7f0d5c09e440 2023-09-30T22:33:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.925+0000 7f0d43fff700 1 -- 172.21.15.59:0/1732436663 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0d54040b90 con 0x7f0d5c09e440 2023-09-30T22:33:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.925+0000 7fb46b5e3700 1 -- 172.21.15.59:0/2165042502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46409c700 con 0x7fb46409e1d0 2023-09-30T22:33:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.927+0000 7fb459ffb700 1 -- 172.21.15.59:0/2165042502 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb454013470 con 0x7fb46409e1d0 2023-09-30T22:33:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.927+0000 7fb459ffb700 1 -- 172.21.15.59:0/2165042502 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb45403f890 con 0x7fb46409e1d0 2023-09-30T22:33:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.929+0000 7fb46b5e3700 1 -- 172.21.15.59:0/2165042502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46404ea50 con 0x7fb46409e1d0 2023-09-30T22:33:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.931+0000 7f0d43fff700 1 -- 172.21.15.59:0/1732436663 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d54019350 con 0x7f0d5c09e440 2023-09-30T22:33:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:35.935+0000 7fb459ffb700 1 -- 172.21.15.59:0/2165042502 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4540232f0 con 0x7fb46409e1d0 2023-09-30T22:33:36.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.007+0000 7feee63e7700 1 -- 172.21.15.59:0/3940245806 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feee011c7e0 con 0x7feee006e9d0 2023-09-30T22:33:36.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.008+0000 7feedcff9700 1 -- 172.21.15.59:0/3940245806 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feed001a360 con 0x7feee006e9d0 2023-09-30T22:33:36.008 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:36.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.011+0000 7feee63e7700 1 -- 172.21.15.59:0/3940245806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee006e9d0 msgr2=0x7feee01c4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:36.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.011+0000 7feee63e7700 1 --2- 172.21.15.59:0/3940245806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee006e9d0 0x7feee01c4010 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7feed000ebe0 tx=0x7feed000eef0 comp rx=0 tx=0).stop 2023-09-30T22:33:36.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.011+0000 7feee63e7700 1 -- 172.21.15.59:0/3940245806 shutdown_connections 2023-09-30T22:33:36.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.011+0000 7feee63e7700 1 --2- 172.21.15.59:0/3940245806 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feee0131f40 0x7feee01c05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:36.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.011+0000 7feee63e7700 1 --2- 172.21.15.59:0/3940245806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee006e9d0 0x7feee01c4010 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:36.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.011+0000 7feee63e7700 1 --2- 172.21.15.59:0/3940245806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee0131630 0x7feee01c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:36.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.011+0000 7feee63e7700 1 -- 172.21.15.59:0/3940245806 >> 172.21.15.59:0/3940245806 conn(0x7feee00a2aa0 msgr2=0x7feee012e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:36.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.012+0000 7feee63e7700 1 -- 172.21.15.59:0/3940245806 shutdown_connections 2023-09-30T22:33:36.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.012+0000 7feee63e7700 1 -- 172.21.15.59:0/3940245806 wait complete. 2023-09-30T22:33:36.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:36.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.114+0000 7fc35d6e4700 1 -- 172.21.15.59:0/1876902571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc35806b9e0 con 0x7fc358130540 2023-09-30T22:33:36.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.115+0000 7fc33f7fe700 1 -- 172.21.15.59:0/1876902571 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc34c003cb0 con 0x7fc358130540 2023-09-30T22:33:36.115 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:36.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.117+0000 7fc35d6e4700 1 -- 172.21.15.59:0/1876902571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc358130540 msgr2=0x7fc35809aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:36.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.117+0000 7fc35d6e4700 1 --2- 172.21.15.59:0/1876902571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc358130540 0x7fc35809aad0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00c520 tx=0x7fc34c00c830 comp rx=0 tx=0).stop 2023-09-30T22:33:36.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.117+0000 7fc35d6e4700 1 -- 172.21.15.59:0/1876902571 shutdown_connections 2023-09-30T22:33:36.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.117+0000 7fc35d6e4700 1 --2- 172.21.15.59:0/1876902571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc358130e50 0x7fc35809b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:36.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.117+0000 7fc35d6e4700 1 --2- 172.21.15.59:0/1876902571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc35806fcf0 0x7fc35809a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:36.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.117+0000 7fc35d6e4700 1 --2- 172.21.15.59:0/1876902571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc358130540 0x7fc35809aad0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:36.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.117+0000 7fc35d6e4700 1 -- 172.21.15.59:0/1876902571 >> 172.21.15.59:0/1876902571 conn(0x7fc3580a2aa0 msgr2=0x7fc35806e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:36.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.117+0000 7fc35d6e4700 1 -- 172.21.15.59:0/1876902571 shutdown_connections 2023-09-30T22:33:36.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.117+0000 7fc35d6e4700 1 -- 172.21.15.59:0/1876902571 wait complete. 2023-09-30T22:33:36.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:36.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.141+0000 7f0d61887700 1 -- 172.21.15.59:0/1732436663 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d5c09acb0 con 0x7f0d5c09e440 2023-09-30T22:33:36.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.141+0000 7f0d43fff700 1 -- 172.21.15.59:0/1732436663 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d54011b80 con 0x7f0d5c09e440 2023-09-30T22:33:36.141 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:36.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.143+0000 7f0d61887700 1 -- 172.21.15.59:0/1732436663 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d5c09e440 msgr2=0x7f0d5c1c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:36.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.143+0000 7f0d61887700 1 --2- 172.21.15.59:0/1732436663 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d5c09e440 0x7f0d5c1c8480 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c09a920 tx=0x7f0d54004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:36.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.143+0000 7f0d61887700 1 -- 172.21.15.59:0/1732436663 shutdown_connections 2023-09-30T22:33:36.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.143+0000 7f0d61887700 1 --2- 172.21.15.59:0/1732436663 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d5c09e440 0x7f0d5c1c8480 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:36.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.143+0000 7f0d61887700 1 --2- 172.21.15.59:0/1732436663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d5c09d6f0 0x7f0d5c1a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:36.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.143+0000 7f0d61887700 1 --2- 172.21.15.59:0/1732436663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d5c09e000 0x7f0d5c1c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:36.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.143+0000 7f0d61887700 1 -- 172.21.15.59:0/1732436663 >> 172.21.15.59:0/1732436663 conn(0x7f0d5c066f50 msgr2=0x7f0d5c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:36.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.144+0000 7f0d61887700 1 -- 172.21.15.59:0/1732436663 shutdown_connections 2023-09-30T22:33:36.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.144+0000 7f0d61887700 1 -- 172.21.15.59:0/1732436663 wait complete. 2023-09-30T22:33:36.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.144+0000 7fb46b5e3700 1 -- 172.21.15.59:0/2165042502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb46409ef50 con 0x7fb46409e1d0 2023-09-30T22:33:36.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.144+0000 7fb459ffb700 1 -- 172.21.15.59:0/2165042502 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb454021030 con 0x7fb46409e1d0 2023-09-30T22:33:36.145 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:36.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.147+0000 7fb46b5e3700 1 -- 172.21.15.59:0/2165042502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb46409e1d0 msgr2=0x7fb46411ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:36.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.147+0000 7fb46b5e3700 1 --2- 172.21.15.59:0/2165042502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb46409e1d0 0x7fb46411ac60 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fb45400ebe0 tx=0x7fb45400eef0 comp rx=0 tx=0).stop 2023-09-30T22:33:36.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.147+0000 7fb46b5e3700 1 -- 172.21.15.59:0/2165042502 shutdown_connections 2023-09-30T22:33:36.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.147+0000 7fb46b5e3700 1 --2- 172.21.15.59:0/2165042502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb464135e50 0x7fb46411b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:36.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.147+0000 7fb46b5e3700 1 --2- 172.21.15.59:0/2165042502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb46409d6f0 0x7fb46411a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:36.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.147+0000 7fb46b5e3700 1 --2- 172.21.15.59:0/2165042502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb46409e1d0 0x7fb46411ac60 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:36.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.147+0000 7fb46b5e3700 1 -- 172.21.15.59:0/2165042502 >> 172.21.15.59:0/2165042502 conn(0x7fb464066f50 msgr2=0x7fb4640a1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:36.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.147+0000 7fb46b5e3700 1 -- 172.21.15.59:0/2165042502 shutdown_connections 2023-09-30T22:33:36.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:36.147+0000 7fb46b5e3700 1 -- 172.21.15.59:0/2165042502 wait complete. 2023-09-30T22:33:36.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:36.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:37.031 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:37.133 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:37.164 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:37.166 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:37.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.179+0000 7f69a66b0700 1 Processor -- start 2023-09-30T22:33:37.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.179+0000 7f69a66b0700 1 -- start start 2023-09-30T22:33:37.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.179+0000 7f69a66b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69a00a0a30 0x7f69a00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.179+0000 7f69a66b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69a00a1340 0x7f69a0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.179+0000 7f69a66b0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a009edd0 con 0x7f69a0133fa0 2023-09-30T22:33:37.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.179+0000 7f69a66b0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a009e1f0 con 0x7f69a00a0a30 2023-09-30T22:33:37.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.179+0000 7f69a66b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a009dc50 con 0x7f69a00a1340 2023-09-30T22:33:37.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.180+0000 7f699ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69a00a0a30 0x7f69a00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.180+0000 7f699f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69a00a1340 0x7f69a0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.180+0000 7f699ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69a00a0a30 0x7f69a00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44738/0 (socket says 172.21.15.59:44738) 2023-09-30T22:33:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.180+0000 7f699ffff700 1 -- 172.21.15.59:0/1219919581 learned_addr learned my addr 172.21.15.59:0/1219919581 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.180+0000 7f699ffff700 1 -- 172.21.15.59:0/1219919581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69a00a1340 msgr2=0x7f69a0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.180+0000 7f699ffff700 1 --2- 172.21.15.59:0/1219919581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69a00a1340 0x7f69a0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.180+0000 7f699ffff700 1 -- 172.21.15.59:0/1219919581 >> v1:172.21.15.59:6789/0 conn(0x7f69a0133fa0 legacy=0x7f69a013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.180+0000 7f699ffff700 1 -- 172.21.15.59:0/1219919581 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a00a1fe0 con 0x7f69a00a0a30 2023-09-30T22:33:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.180+0000 7f699ffff700 1 --2- 172.21.15.59:0/1219919581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a00a0a30 0x7f69a00a0e00 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f69900098f0 tx=0x7f6990009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a109fb6ca8a955a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.180+0000 7f699effd700 1 -- 172.21.15.59:0/1219919581 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990011830 con 0x7f69a00a0a30 2023-09-30T22:33:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.180+0000 7f699effd700 1 -- 172.21.15.59:0/1219919581 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6990011990 con 0x7f69a00a0a30 2023-09-30T22:33:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.180+0000 7f699effd700 1 -- 172.21.15.59:0/1219919581 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990011d20 con 0x7f69a00a0a30 2023-09-30T22:33:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.181+0000 7f69a66b0700 1 -- 172.21.15.59:0/1219919581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a00a0a30 msgr2=0x7f69a00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.181+0000 7f69a66b0700 1 --2- 172.21.15.59:0/1219919581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a00a0a30 0x7f69a00a0e00 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f69900098f0 tx=0x7f6990009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.181+0000 7f69a66b0700 1 -- 172.21.15.59:0/1219919581 shutdown_connections 2023-09-30T22:33:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.181+0000 7f69a66b0700 1 --2- 172.21.15.59:0/1219919581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a00a0a30 0x7f69a00a0e00 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.181+0000 7f69a66b0700 1 --2- 172.21.15.59:0/1219919581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69a00a1340 0x7f69a0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.181+0000 7f69a66b0700 1 -- 172.21.15.59:0/1219919581 >> 172.21.15.59:0/1219919581 conn(0x7f69a00a6550 msgr2=0x7f69a00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.181+0000 7f69a66b0700 1 -- 172.21.15.59:0/1219919581 shutdown_connections 2023-09-30T22:33:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.181+0000 7f69a66b0700 1 -- 172.21.15.59:0/1219919581 wait complete. 2023-09-30T22:33:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.182+0000 7f69a66b0700 1 Processor -- start 2023-09-30T22:33:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.182+0000 7f69a66b0700 1 -- start start 2023-09-30T22:33:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.183+0000 7f69a66b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69a00a0a30 0x7f69a01c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.183+0000 7f69a66b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a00a1340 0x7f69a01c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.183+0000 7f69a66b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69a0133fa0 0x7f69a01c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.183+0000 7f69a66b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a00a0220 con 0x7f69a00a1340 2023-09-30T22:33:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.183+0000 7f69a66b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a00a3710 con 0x7f69a00a0a30 2023-09-30T22:33:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.183+0000 7f69a66b0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69a0120580 con 0x7f69a0133fa0 2023-09-30T22:33:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.183+0000 7f699f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a00a1340 0x7f69a01c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.183+0000 7f699f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a00a1340 0x7f69a01c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44748/0 (socket says 172.21.15.59:44748) 2023-09-30T22:33:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.183+0000 7f699f7fe700 1 -- 172.21.15.59:0/2642834568 learned_addr learned my addr 172.21.15.59:0/2642834568 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.183+0000 7f699ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69a00a0a30 0x7f69a01c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.183+0000 7f69a4c4d700 1 --2- 172.21.15.59:0/2642834568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69a0133fa0 0x7f69a01c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.184+0000 7f699f7fe700 1 -- 172.21.15.59:0/2642834568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69a0133fa0 msgr2=0x7f69a01c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.184+0000 7f699f7fe700 1 --2- 172.21.15.59:0/2642834568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69a0133fa0 0x7f69a01c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.184+0000 7f699f7fe700 1 -- 172.21.15.59:0/2642834568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69a00a0a30 msgr2=0x7f69a01c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.184+0000 7f699f7fe700 1 --2- 172.21.15.59:0/2642834568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69a00a0a30 0x7f69a01c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.184+0000 7f699f7fe700 1 -- 172.21.15.59:0/2642834568 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6990009550 con 0x7f69a00a1340 2023-09-30T22:33:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.184+0000 7f699ffff700 1 --2- 172.21.15.59:0/2642834568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69a00a0a30 0x7f69a01c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.184+0000 7f699f7fe700 1 --2- 172.21.15.59:0/2642834568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a00a1340 0x7f69a01c8a70 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f699400e9b0 tx=0x7f699400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.184+0000 7f699cff9700 1 -- 172.21.15.59:0/2642834568 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6994009710 con 0x7f69a00a1340 2023-09-30T22:33:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.184+0000 7f699cff9700 1 -- 172.21.15.59:0/2642834568 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699400ee50 con 0x7f69a00a1340 2023-09-30T22:33:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.184+0000 7f699cff9700 1 -- 172.21.15.59:0/2642834568 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699400ca50 con 0x7f69a00a1340 2023-09-30T22:33:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.184+0000 7f69a66b0700 1 -- 172.21.15.59:0/2642834568 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a0120d00 con 0x7f69a00a1340 2023-09-30T22:33:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.184+0000 7f69a66b0700 1 -- 172.21.15.59:0/2642834568 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a0122bb0 con 0x7f69a00a1340 2023-09-30T22:33:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.185+0000 7f69a66b0700 1 -- 172.21.15.59:0/2642834568 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a0074ea0 con 0x7f69a00a1340 2023-09-30T22:33:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.185+0000 7f699cff9700 1 -- 172.21.15.59:0/2642834568 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f699400cbb0 con 0x7f69a00a1340 2023-09-30T22:33:37.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.186+0000 7f699cff9700 1 -- 172.21.15.59:0/2642834568 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f699403f710 con 0x7f69a00a1340 2023-09-30T22:33:37.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.191+0000 7f699cff9700 1 -- 172.21.15.59:0/2642834568 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f69940232f0 con 0x7f69a00a1340 2023-09-30T22:33:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.292+0000 7f6910d3f700 1 Processor -- start 2023-09-30T22:33:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.292+0000 7f6910d3f700 1 -- start start 2023-09-30T22:33:37.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.293+0000 7f6910d3f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f690c09e930 0x7f690c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.293+0000 7f6910d3f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09f240 0x7f690c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.293+0000 7f6910d3f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690c070940 con 0x7f690c09f650 2023-09-30T22:33:37.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.293+0000 7f6910d3f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690c06fd60 con 0x7f690c09e930 2023-09-30T22:33:37.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.293+0000 7f6910d3f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f690c06fa80 con 0x7f690c09f240 2023-09-30T22:33:37.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.293+0000 7f690ad9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f690c09f650 0x7f690c131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35764/0 (socket says 172.21.15.59:35764) 2023-09-30T22:33:37.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.293+0000 7f690ad9d700 1 -- 172.21.15.59:0/2890608241 learned_addr learned my addr 172.21.15.59:0/2890608241 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:37.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.293+0000 7f6909d9b700 1 --2- 172.21.15.59:0/2890608241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09f240 0x7f690c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.293+0000 7f690a59c700 1 --2- 172.21.15.59:0/2890608241 >> v2:172.21.15.59:3300/0 conn(0x7f690c09e930 0x7f690c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.293+0000 7f690959a700 1 -- 172.21.15.59:0/2890608241 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252914427 0 0) 0x7f690c070940 con 0x7f690c09f650 2023-09-30T22:33:37.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.293+0000 7f690959a700 1 -- 172.21.15.59:0/2890608241 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68f40035b0 con 0x7f690c09f650 2023-09-30T22:33:37.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.293+0000 7f690a59c700 1 -- 172.21.15.59:0/2890608241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09f240 msgr2=0x7f690c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:37.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.293+0000 7f690a59c700 1 --2- 172.21.15.59:0/2890608241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09f240 0x7f690c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.293+0000 7f690a59c700 1 -- 172.21.15.59:0/2890608241 >> v1:172.21.15.59:6789/0 conn(0x7f690c09f650 legacy=0x7f690c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.294+0000 7f690a59c700 1 -- 172.21.15.59:0/2890608241 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c09fb60 con 0x7f690c09e930 2023-09-30T22:33:37.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.294+0000 7f690a59c700 1 --2- 172.21.15.59:0/2890608241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c09e930 0x7f690c09ed00 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009840 tx=0x7f68fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a351e1c81e665b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:37.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.294+0000 7f690959a700 1 -- 172.21.15.59:0/2890608241 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc004230 con 0x7f690c09e930 2023-09-30T22:33:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.294+0000 7f690959a700 1 -- 172.21.15.59:0/2890608241 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc004390 con 0x7f690c09e930 2023-09-30T22:33:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.294+0000 7f690959a700 1 -- 172.21.15.59:0/2890608241 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc0036a0 con 0x7f690c09e930 2023-09-30T22:33:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.295+0000 7f6910d3f700 1 -- 172.21.15.59:0/2890608241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c09e930 msgr2=0x7f690c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.295+0000 7f6910d3f700 1 --2- 172.21.15.59:0/2890608241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c09e930 0x7f690c09ed00 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009840 tx=0x7f68fc009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.295+0000 7f6910d3f700 1 -- 172.21.15.59:0/2890608241 shutdown_connections 2023-09-30T22:33:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.295+0000 7f6910d3f700 1 --2- 172.21.15.59:0/2890608241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c09e930 0x7f690c09ed00 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.295+0000 7f6910d3f700 1 --2- 172.21.15.59:0/2890608241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09f240 0x7f690c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.295+0000 7f6910d3f700 1 -- 172.21.15.59:0/2890608241 >> 172.21.15.59:0/2890608241 conn(0x7f690c0a4210 msgr2=0x7f690c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:37.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.295+0000 7f6910d3f700 1 -- 172.21.15.59:0/2890608241 shutdown_connections 2023-09-30T22:33:37.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.295+0000 7f6910d3f700 1 -- 172.21.15.59:0/2890608241 wait complete. 2023-09-30T22:33:37.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.297+0000 7f6910d3f700 1 Processor -- start 2023-09-30T22:33:37.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.297+0000 7f6910d3f700 1 -- start start 2023-09-30T22:33:37.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.297+0000 7f6910d3f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c09e930 0x7f690c1a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.297+0000 7f6910d3f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09f240 0x7f690c1a4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.297+0000 7f6910d3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c09f650 0x7f690c1a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.297+0000 7f6910d3f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c1a80b0 con 0x7f690c09e930 2023-09-30T22:33:37.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.297+0000 7f6910d3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c1a57e0 con 0x7f690c09f650 2023-09-30T22:33:37.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.297+0000 7f6910d3f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f690c1a5e00 con 0x7f690c09f240 2023-09-30T22:33:37.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.298+0000 7f6909d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09f240 0x7f690c1a4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.298+0000 7f6909d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09f240 0x7f690c1a4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52450/0 (socket says 172.21.15.59:52450) 2023-09-30T22:33:37.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.298+0000 7f6909d9b700 1 -- 172.21.15.59:0/4179740683 learned_addr learned my addr 172.21.15.59:0/4179740683 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:37.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.298+0000 7f690a59c700 1 --2- 172.21.15.59:0/4179740683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c09e930 0x7f690c1a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.298+0000 7f6909d9b700 1 -- 172.21.15.59:0/4179740683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c09f650 msgr2=0x7f690c1a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.298+0000 7f6909d9b700 1 --2- 172.21.15.59:0/4179740683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c09f650 0x7f690c1a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.298+0000 7f6909d9b700 1 -- 172.21.15.59:0/4179740683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c09e930 msgr2=0x7f690c1a3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.298+0000 7f6909d9b700 1 --2- 172.21.15.59:0/4179740683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c09e930 0x7f690c1a3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.298+0000 7f6909d9b700 1 -- 172.21.15.59:0/4179740683 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc0094a0 con 0x7f690c09f240 2023-09-30T22:33:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.298+0000 7f690a59c700 1 --2- 172.21.15.59:0/4179740683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c09e930 0x7f690c1a3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.298+0000 7f6909d9b700 1 --2- 172.21.15.59:0/4179740683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09f240 0x7f690c1a4110 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f690000ea10 tx=0x7f690000ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.298+0000 7f68faffd700 1 -- 172.21.15.59:0/4179740683 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900009710 con 0x7f690c09f240 2023-09-30T22:33:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.299+0000 7f68faffd700 1 -- 172.21.15.59:0/4179740683 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690000c850 con 0x7f690c09f240 2023-09-30T22:33:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.299+0000 7f6910d3f700 1 -- 172.21.15.59:0/4179740683 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690c0a0190 con 0x7f690c09f240 2023-09-30T22:33:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.299+0000 7f68faffd700 1 -- 172.21.15.59:0/4179740683 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690000cbc0 con 0x7f690c09f240 2023-09-30T22:33:37.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.299+0000 7f6910d3f700 1 -- 172.21.15.59:0/4179740683 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c0a3410 con 0x7f690c09f240 2023-09-30T22:33:37.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.300+0000 7f68faffd700 1 -- 172.21.15.59:0/4179740683 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f690000cd20 con 0x7f690c09f240 2023-09-30T22:33:37.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.300+0000 7f68faffd700 1 -- 172.21.15.59:0/4179740683 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f690001a360 con 0x7f690c09f240 2023-09-30T22:33:37.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.300+0000 7f6910d3f700 1 -- 172.21.15.59:0/4179740683 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690c1a0b30 con 0x7f690c09f240 2023-09-30T22:33:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.309+0000 7f68faffd700 1 -- 172.21.15.59:0/4179740683 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f69000102b0 con 0x7f690c09f240 2023-09-30T22:33:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.326+0000 7f4f6ee9c700 1 Processor -- start 2023-09-30T22:33:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.326+0000 7f4f6ee9c700 1 -- start start 2023-09-30T22:33:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.327+0000 7f4f6ee9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6809e1d0 0x7f4f68135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.327+0000 7f4f6ee9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f68135e50 0x7f4f68138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.327+0000 7f4f6ee9c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6809f130 con 0x7f4f6809d6f0 2023-09-30T22:33:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.327+0000 7f4f6ee9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6809f520 con 0x7f4f68135e50 2023-09-30T22:33:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.327+0000 7f4f6ee9c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6809e930 con 0x7f4f6809e1d0 2023-09-30T22:33:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.327+0000 7f4f67fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6809e1d0 0x7f4f68135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.327+0000 7f4f67fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6809e1d0 0x7f4f68135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52464/0 (socket says 172.21.15.59:52464) 2023-09-30T22:33:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.327+0000 7f4f67fff700 1 -- 172.21.15.59:0/2565421825 learned_addr learned my addr 172.21.15.59:0/2565421825 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.327+0000 7f4f6cc38700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4f6809d6f0 0x7f4f6809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35780/0 (socket says 172.21.15.59:35780) 2023-09-30T22:33:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.327+0000 7f4f6d439700 1 --2- 172.21.15.59:0/2565421825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f68135e50 0x7f4f68138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.327+0000 7f4f67fff700 1 -- 172.21.15.59:0/2565421825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f68135e50 msgr2=0x7f4f68138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.327+0000 7f4f67fff700 1 --2- 172.21.15.59:0/2565421825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f68135e50 0x7f4f68138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.327+0000 7f4f67fff700 1 -- 172.21.15.59:0/2565421825 >> v1:172.21.15.59:6789/0 conn(0x7f4f6809d6f0 legacy=0x7f4f6809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.327+0000 7f4f677fe700 1 -- 172.21.15.59:0/2565421825 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143746466 0 0) 0x7f4f6809f130 con 0x7f4f6809d6f0 2023-09-30T22:33:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.327+0000 7f4f67fff700 1 -- 172.21.15.59:0/2565421825 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6809b2d0 con 0x7f4f6809e1d0 2023-09-30T22:33:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.328+0000 7f4f6d439700 1 --2- 172.21.15.59:0/2565421825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f68135e50 0x7f4f68138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.328+0000 7f4f67fff700 1 --2- 172.21.15.59:0/2565421825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6809e1d0 0x7f4f68135910 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009920 tx=0x7f4f54009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2542e43980200ea4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.328+0000 7f4f677fe700 1 -- 172.21.15.59:0/2565421825 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54011830 con 0x7f4f6809e1d0 2023-09-30T22:33:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.328+0000 7f4f677fe700 1 -- 172.21.15.59:0/2565421825 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f54011990 con 0x7f4f6809e1d0 2023-09-30T22:33:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.328+0000 7f4f677fe700 1 -- 172.21.15.59:0/2565421825 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54011d20 con 0x7f4f6809e1d0 2023-09-30T22:33:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.329+0000 7f4f6ee9c700 1 -- 172.21.15.59:0/2565421825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6809e1d0 msgr2=0x7f4f68135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.329+0000 7f4f6ee9c700 1 --2- 172.21.15.59:0/2565421825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6809e1d0 0x7f4f68135910 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009920 tx=0x7f4f54009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.329+0000 7f4f6ee9c700 1 -- 172.21.15.59:0/2565421825 shutdown_connections 2023-09-30T22:33:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.329+0000 7f4f6ee9c700 1 --2- 172.21.15.59:0/2565421825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f68135e50 0x7f4f68138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.329+0000 7f4f6ee9c700 1 --2- 172.21.15.59:0/2565421825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6809e1d0 0x7f4f68135910 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.329+0000 7f4f6ee9c700 1 -- 172.21.15.59:0/2565421825 >> 172.21.15.59:0/2565421825 conn(0x7f4f68066f50 msgr2=0x7f4f6809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.329+0000 7f4f6ee9c700 1 -- 172.21.15.59:0/2565421825 shutdown_connections 2023-09-30T22:33:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.329+0000 7f4f6ee9c700 1 -- 172.21.15.59:0/2565421825 wait complete. 2023-09-30T22:33:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.329+0000 7f29d789b700 1 Processor -- start 2023-09-30T22:33:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.330+0000 7f4f6ee9c700 1 Processor -- start 2023-09-30T22:33:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.330+0000 7f4f6ee9c700 1 -- start start 2023-09-30T22:33:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.330+0000 7f29d789b700 1 -- start start 2023-09-30T22:33:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.330+0000 7f29d789b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d009d6f0 0x7f29d009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.330+0000 7f29d789b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f29d009e000 0x7f29d0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.330+0000 7f29d789b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29d009e410 0x7f29d0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.330+0000 7f29d789b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d009f520 con 0x7f29d009e000 2023-09-30T22:33:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.330+0000 7f29d789b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d009f130 con 0x7f29d009d6f0 2023-09-30T22:33:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.330+0000 7f29d789b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29d009e930 con 0x7f29d009e410 2023-09-30T22:33:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.330+0000 7f29d5637700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d009d6f0 0x7f29d009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.330+0000 7f29d5637700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d009d6f0 0x7f29d009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48690/0 (socket says 172.21.15.59:48690) 2023-09-30T22:33:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.330+0000 7f29d5637700 1 -- 172.21.15.59:0/4122601997 learned_addr learned my addr 172.21.15.59:0/4122601997 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.330+0000 7f29d4e36700 1 --2- 172.21.15.59:0/4122601997 >> v2:172.21.15.59:3300/0 conn(0x7f29d009e000 0x7f29d0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f4f6ee9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6809d6f0 0x7f4f6811d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f4f6ee9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6809e1d0 0x7f4f6811ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f29d4e36700 1 -- 172.21.15.59:0/4122601997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29d009e410 msgr2=0x7f29d0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:37.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f29d4e36700 1 --2- 172.21.15.59:0/4122601997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29d009e410 0x7f29d0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f29d4e36700 1 -- 172.21.15.59:0/4122601997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d009d6f0 msgr2=0x7f29d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:37.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f29d4e36700 1 --2- 172.21.15.59:0/4122601997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d009d6f0 0x7f29d009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f29d4e36700 1 -- 172.21.15.59:0/4122601997 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d009b2d0 con 0x7f29d009e000 2023-09-30T22:33:37.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f29d4e36700 1 --2- 172.21.15.59:0/4122601997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d009e000 0x7f29d0130660 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009870 tx=0x7f29c0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c8779fbf29cf53 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:37.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f4f6ee9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f68135e50 0x7f4f6811e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f4f6ee9c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f68135bf0 con 0x7f4f68135e50 2023-09-30T22:33:37.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f4f6ee9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f68120610 con 0x7f4f6809d6f0 2023-09-30T22:33:37.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f4f6ee9c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6809c700 con 0x7f4f6809e1d0 2023-09-30T22:33:37.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f4f6d439700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f68135e50 0x7f4f6811e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f4f6d439700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f68135e50 0x7f4f6811e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44780/0 (socket says 172.21.15.59:44780) 2023-09-30T22:33:37.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f4f6d439700 1 -- 172.21.15.59:0/239794932 learned_addr learned my addr 172.21.15.59:0/239794932 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:37.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f4f67fff700 1 --2- 172.21.15.59:0/239794932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6809e1d0 0x7f4f6811ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f4f6cc38700 1 --2- 172.21.15.59:0/239794932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6809d6f0 0x7f4f6811d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.332+0000 7f4f67fff700 1 -- 172.21.15.59:0/239794932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6809d6f0 msgr2=0x7f4f6811d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.332+0000 7f4f67fff700 1 --2- 172.21.15.59:0/239794932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6809d6f0 0x7f4f6811d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.332+0000 7f4f67fff700 1 -- 172.21.15.59:0/239794932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f68135e50 msgr2=0x7f4f6811e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.332+0000 7f4f67fff700 1 --2- 172.21.15.59:0/239794932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f68135e50 0x7f4f6811e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.332+0000 7f4f67fff700 1 -- 172.21.15.59:0/239794932 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f60009a70 con 0x7f4f6809e1d0 2023-09-30T22:33:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f29c7fff700 1 -- 172.21.15.59:0/4122601997 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c0011830 con 0x7f29d009e000 2023-09-30T22:33:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f29c7fff700 1 -- 172.21.15.59:0/4122601997 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c0011990 con 0x7f29d009e000 2023-09-30T22:33:37.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.331+0000 7f29c7fff700 1 -- 172.21.15.59:0/4122601997 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c0011d20 con 0x7f29d009e000 2023-09-30T22:33:37.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.332+0000 7f4f6cc38700 1 --2- 172.21.15.59:0/239794932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6809d6f0 0x7f4f6811d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:37.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.332+0000 7f4f67fff700 1 --2- 172.21.15.59:0/239794932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6809e1d0 0x7f4f6811ddd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4f54016000 tx=0x7f4f54004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:37.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.332+0000 7f4f657fa700 1 -- 172.21.15.59:0/239794932 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54004300 con 0x7f4f6809e1d0 2023-09-30T22:33:37.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.332+0000 7f4f657fa700 1 -- 172.21.15.59:0/239794932 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5401f070 con 0x7f4f6809e1d0 2023-09-30T22:33:37.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.332+0000 7f4f6ee9c700 1 -- 172.21.15.59:0/239794932 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f54009550 con 0x7f4f6809e1d0 2023-09-30T22:33:37.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.332+0000 7f4f657fa700 1 -- 172.21.15.59:0/239794932 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f540036a0 con 0x7f4f6809e1d0 2023-09-30T22:33:37.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.332+0000 7f4f6ee9c700 1 -- 172.21.15.59:0/239794932 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f680a20b0 con 0x7f4f6809e1d0 2023-09-30T22:33:37.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.332+0000 7f29d789b700 1 -- 172.21.15.59:0/4122601997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d009e000 msgr2=0x7f29d0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.333+0000 7f29d789b700 1 --2- 172.21.15.59:0/4122601997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d009e000 0x7f29d0130660 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009870 tx=0x7f29c0009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:37.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.333+0000 7f29d789b700 1 -- 172.21.15.59:0/4122601997 shutdown_connections 2023-09-30T22:33:37.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.333+0000 7f29d789b700 1 --2- 172.21.15.59:0/4122601997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29d009e410 0x7f29d0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.333+0000 7f29d789b700 1 --2- 172.21.15.59:0/4122601997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d009d6f0 0x7f29d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.333+0000 7f29d789b700 1 --2- 172.21.15.59:0/4122601997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d009e000 0x7f29d0130660 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.333+0000 7f29d789b700 1 -- 172.21.15.59:0/4122601997 >> 172.21.15.59:0/4122601997 conn(0x7f29d0066f50 msgr2=0x7f29d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:37.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.333+0000 7f29d789b700 1 -- 172.21.15.59:0/4122601997 shutdown_connections 2023-09-30T22:33:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.333+0000 7f4f52ffd700 1 -- 172.21.15.59:0/239794932 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f400052e0 con 0x7f4f6809e1d0 2023-09-30T22:33:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.333+0000 7f29d789b700 1 -- 172.21.15.59:0/4122601997 wait complete. 2023-09-30T22:33:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.334+0000 7f4f657fa700 1 -- 172.21.15.59:0/239794932 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f54021030 con 0x7f4f6809e1d0 2023-09-30T22:33:37.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.334+0000 7f29d789b700 1 Processor -- start 2023-09-30T22:33:37.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.334+0000 7f4f657fa700 1 -- 172.21.15.59:0/239794932 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4f54040b90 con 0x7f4f6809e1d0 2023-09-30T22:33:37.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.334+0000 7f29d789b700 1 -- start start 2023-09-30T22:33:37.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.335+0000 7f29d789b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d009d6f0 0x7f29d011e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.335+0000 7f29d789b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29d009e000 0x7f29d011e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.335+0000 7f29d789b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d009e410 0x7f29d011ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:37.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.335+0000 7f29d789b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d0120c00 con 0x7f29d009d6f0 2023-09-30T22:33:37.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.335+0000 7f29d789b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d0121680 con 0x7f29d009e410 2023-09-30T22:33:37.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.335+0000 7f29d789b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29d011fe20 con 0x7f29d009e000 2023-09-30T22:33:37.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.335+0000 7f29d5637700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d009d6f0 0x7f29d011e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.335+0000 7f29d5e38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d009e410 0x7f29d011ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.335+0000 7f29d5637700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d009d6f0 0x7f29d011e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44790/0 (socket says 172.21.15.59:44790) 2023-09-30T22:33:37.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.335+0000 7f29d5637700 1 -- 172.21.15.59:0/2936267596 learned_addr learned my addr 172.21.15.59:0/2936267596 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:37.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.335+0000 7f29d4e36700 1 --2- 172.21.15.59:0/2936267596 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29d009e000 0x7f29d011e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:37.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.336+0000 7f29d5637700 1 -- 172.21.15.59:0/2936267596 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29d009e000 msgr2=0x7f29d011e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.336+0000 7f29d5637700 1 --2- 172.21.15.59:0/2936267596 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29d009e000 0x7f29d011e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.336+0000 7f29d5637700 1 -- 172.21.15.59:0/2936267596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d009e410 msgr2=0x7f29d011ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.336+0000 7f29d5637700 1 --2- 172.21.15.59:0/2936267596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d009e410 0x7f29d011ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.336+0000 7f29d5637700 1 -- 172.21.15.59:0/2936267596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c00094a0 con 0x7f29d009d6f0 2023-09-30T22:33:37.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.336+0000 7f29d5637700 1 --2- 172.21.15.59:0/2936267596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d009d6f0 0x7f29d011e150 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00b240 tx=0x7f29cc00d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:37.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.336+0000 7f29c5ffb700 1 -- 172.21.15.59:0/2936267596 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc00de40 con 0x7f29d009d6f0 2023-09-30T22:33:37.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.336+0000 7f29c5ffb700 1 -- 172.21.15.59:0/2936267596 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc010440 con 0x7f29d009d6f0 2023-09-30T22:33:37.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.336+0000 7f29d789b700 1 -- 172.21.15.59:0/2936267596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d00a1d00 con 0x7f29d009d6f0 2023-09-30T22:33:37.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.336+0000 7f29c5ffb700 1 -- 172.21.15.59:0/2936267596 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc0107d0 con 0x7f29d009d6f0 2023-09-30T22:33:37.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.337+0000 7f29d789b700 1 -- 172.21.15.59:0/2936267596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d0121940 con 0x7f29d009d6f0 2023-09-30T22:33:37.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.338+0000 7f29d789b700 1 -- 172.21.15.59:0/2936267596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d0074ea0 con 0x7f29d009d6f0 2023-09-30T22:33:37.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.340+0000 7f4f657fa700 1 -- 172.21.15.59:0/239794932 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f5400ba10 con 0x7f4f6809e1d0 2023-09-30T22:33:37.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.338+0000 7f29c5ffb700 1 -- 172.21.15.59:0/2936267596 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29cc010930 con 0x7f29d009d6f0 2023-09-30T22:33:37.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.339+0000 7f29c5ffb700 1 -- 172.21.15.59:0/2936267596 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f29cc040240 con 0x7f29d009d6f0 2023-09-30T22:33:37.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.343+0000 7f29c5ffb700 1 -- 172.21.15.59:0/2936267596 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29cc016770 con 0x7f29d009d6f0 2023-09-30T22:33:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.467+0000 7f69a66b0700 1 -- 172.21.15.59:0/2642834568 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f69a009be80 con 0x7f69a00a1340 2023-09-30T22:33:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.467+0000 7f699cff9700 1 -- 172.21.15.59:0/2642834568 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6994021070 con 0x7f69a00a1340 2023-09-30T22:33:37.468 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.471+0000 7f69a66b0700 1 -- 172.21.15.59:0/2642834568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a00a1340 msgr2=0x7f69a01c8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.471+0000 7f69a66b0700 1 --2- 172.21.15.59:0/2642834568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a00a1340 0x7f69a01c8a70 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f699400e9b0 tx=0x7f699400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.471+0000 7f69a66b0700 1 -- 172.21.15.59:0/2642834568 shutdown_connections 2023-09-30T22:33:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.471+0000 7f69a66b0700 1 --2- 172.21.15.59:0/2642834568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69a0133fa0 0x7f69a01c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.471+0000 7f69a66b0700 1 --2- 172.21.15.59:0/2642834568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69a00a0a30 0x7f69a01c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.471+0000 7f69a66b0700 1 --2- 172.21.15.59:0/2642834568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a00a1340 0x7f69a01c8a70 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.471+0000 7f69a66b0700 1 -- 172.21.15.59:0/2642834568 >> 172.21.15.59:0/2642834568 conn(0x7f69a00a6550 msgr2=0x7f69a01b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.471+0000 7f69a66b0700 1 -- 172.21.15.59:0/2642834568 shutdown_connections 2023-09-30T22:33:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.471+0000 7f69a66b0700 1 -- 172.21.15.59:0/2642834568 wait complete. 2023-09-30T22:33:37.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:37.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.548+0000 7f4f52ffd700 1 -- 172.21.15.59:0/239794932 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4f40005860 con 0x7f4f6809e1d0 2023-09-30T22:33:37.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.548+0000 7f4f657fa700 1 -- 172.21.15.59:0/239794932 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f54029020 con 0x7f4f6809e1d0 2023-09-30T22:33:37.548 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:37.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.550+0000 7f4f52ffd700 1 -- 172.21.15.59:0/239794932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6809e1d0 msgr2=0x7f4f6811ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.550+0000 7f4f52ffd700 1 --2- 172.21.15.59:0/239794932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6809e1d0 0x7f4f6811ddd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4f54016000 tx=0x7f4f54004750 comp rx=0 tx=0).stop 2023-09-30T22:33:37.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.550+0000 7f4f52ffd700 1 -- 172.21.15.59:0/239794932 shutdown_connections 2023-09-30T22:33:37.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.550+0000 7f4f52ffd700 1 --2- 172.21.15.59:0/239794932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f68135e50 0x7f4f6811e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.550+0000 7f4f52ffd700 1 --2- 172.21.15.59:0/239794932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6809d6f0 0x7f4f6811d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.550+0000 7f4f52ffd700 1 --2- 172.21.15.59:0/239794932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6809e1d0 0x7f4f6811ddd0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.550+0000 7f4f52ffd700 1 -- 172.21.15.59:0/239794932 >> 172.21.15.59:0/239794932 conn(0x7f4f68066f50 msgr2=0x7f4f68070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:37.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.551+0000 7f4f52ffd700 1 -- 172.21.15.59:0/239794932 shutdown_connections 2023-09-30T22:33:37.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.551+0000 7f4f52ffd700 1 -- 172.21.15.59:0/239794932 wait complete. 2023-09-30T22:33:37.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.552+0000 7f29d789b700 1 -- 172.21.15.59:0/2936267596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f29d006c360 con 0x7f29d009d6f0 2023-09-30T22:33:37.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.552+0000 7f29c5ffb700 1 -- 172.21.15.59:0/2936267596 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29cc009140 con 0x7f29d009d6f0 2023-09-30T22:33:37.553 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:37.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.555+0000 7f29d789b700 1 -- 172.21.15.59:0/2936267596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d009d6f0 msgr2=0x7f29d011e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.555+0000 7f29d789b700 1 --2- 172.21.15.59:0/2936267596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d009d6f0 0x7f29d011e150 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00b240 tx=0x7f29cc00d630 comp rx=0 tx=0).stop 2023-09-30T22:33:37.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.555+0000 7f29d789b700 1 -- 172.21.15.59:0/2936267596 shutdown_connections 2023-09-30T22:33:37.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.555+0000 7f29d789b700 1 --2- 172.21.15.59:0/2936267596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d009e410 0x7f29d011ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.555+0000 7f29d789b700 1 --2- 172.21.15.59:0/2936267596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d009d6f0 0x7f29d011e150 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.555+0000 7f29d789b700 1 --2- 172.21.15.59:0/2936267596 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29d009e000 0x7f29d011e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.555+0000 7f29d789b700 1 -- 172.21.15.59:0/2936267596 >> 172.21.15.59:0/2936267596 conn(0x7f29d0066f50 msgr2=0x7f29d0071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:37.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.555+0000 7f29d789b700 1 -- 172.21.15.59:0/2936267596 shutdown_connections 2023-09-30T22:33:37.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.555+0000 7f29d789b700 1 -- 172.21.15.59:0/2936267596 wait complete. 2023-09-30T22:33:37.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:37.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.580+0000 7f6910d3f700 1 -- 172.21.15.59:0/4179740683 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f690c09ffe0 con 0x7f690c09f240 2023-09-30T22:33:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.580+0000 7f68faffd700 1 -- 172.21.15.59:0/4179740683 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6900017030 con 0x7f690c09f240 2023-09-30T22:33:37.580 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.582+0000 7f6910d3f700 1 -- 172.21.15.59:0/4179740683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09f240 msgr2=0x7f690c1a4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.582+0000 7f6910d3f700 1 --2- 172.21.15.59:0/4179740683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09f240 0x7f690c1a4110 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f690000ea10 tx=0x7f690000ed20 comp rx=0 tx=0).stop 2023-09-30T22:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.582+0000 7f6910d3f700 1 -- 172.21.15.59:0/4179740683 shutdown_connections 2023-09-30T22:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.582+0000 7f6910d3f700 1 --2- 172.21.15.59:0/4179740683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c09f650 0x7f690c1a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.582+0000 7f6910d3f700 1 --2- 172.21.15.59:0/4179740683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c09e930 0x7f690c1a3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.582+0000 7f6910d3f700 1 --2- 172.21.15.59:0/4179740683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09f240 0x7f690c1a4110 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:37.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.582+0000 7f6910d3f700 1 -- 172.21.15.59:0/4179740683 >> 172.21.15.59:0/4179740683 conn(0x7f690c0a4210 msgr2=0x7f690c1b8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:37.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.582+0000 7f6910d3f700 1 -- 172.21.15.59:0/4179740683 shutdown_connections 2023-09-30T22:33:37.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:37.583+0000 7f6910d3f700 1 -- 172.21.15.59:0/4179740683 wait complete. 2023-09-30T22:33:37.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:38.491 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:38.567 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:38.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:38.597 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:38.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.645+0000 7f52f1786700 1 Processor -- start 2023-09-30T22:33:38.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.645+0000 7f52f1786700 1 -- start start 2023-09-30T22:33:38.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.646+0000 7f52f1786700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52ec06f5d0 0x7f52ec12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.646+0000 7f52f1786700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52ec135c20 0x7f52ec138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.646+0000 7f52f1786700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ec06fa40 con 0x7f52ec12cf60 2023-09-30T22:33:38.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.646+0000 7f52f1786700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec12cd90 con 0x7f52ec135c20 2023-09-30T22:33:38.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.646+0000 7f52f1786700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec071780 con 0x7f52ec06f5d0 2023-09-30T22:33:38.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.646+0000 7f52ea7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52ec06f5d0 0x7f52ec12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.646+0000 7f52ea7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52ec06f5d0 0x7f52ec12ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52512/0 (socket says 172.21.15.59:52512) 2023-09-30T22:33:38.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.646+0000 7f52ea7fc700 1 -- 172.21.15.59:0/3616040148 learned_addr learned my addr 172.21.15.59:0/3616040148 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:38.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.646+0000 7f52ea7fc700 1 -- 172.21.15.59:0/3616040148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52ec135c20 msgr2=0x7f52ec138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:38.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.646+0000 7f52ea7fc700 1 --2- 172.21.15.59:0/3616040148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52ec135c20 0x7f52ec138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.646+0000 7f52ea7fc700 1 -- 172.21.15.59:0/3616040148 >> v1:172.21.15.59:6789/0 conn(0x7f52ec12cf60 legacy=0x7f52ec12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.646+0000 7f52ea7fc700 1 -- 172.21.15.59:0/3616040148 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec071a40 con 0x7f52ec06f5d0 2023-09-30T22:33:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.646+0000 7f52ea7fc700 1 --2- 172.21.15.59:0/3616040148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52ec06f5d0 0x7f52ec12ffc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f52e000aaf0 tx=0x7f52e000ae00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf878741576702cc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.647+0000 7f52e9ffb700 1 -- 172.21.15.59:0/3616040148 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e000cbf0 con 0x7f52ec06f5d0 2023-09-30T22:33:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.647+0000 7f52e9ffb700 1 -- 172.21.15.59:0/3616040148 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e000cd50 con 0x7f52ec06f5d0 2023-09-30T22:33:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.647+0000 7f52e9ffb700 1 -- 172.21.15.59:0/3616040148 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e0018620 con 0x7f52ec06f5d0 2023-09-30T22:33:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.648+0000 7f52f1786700 1 -- 172.21.15.59:0/3616040148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52ec06f5d0 msgr2=0x7f52ec12ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.648+0000 7f52f1786700 1 --2- 172.21.15.59:0/3616040148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52ec06f5d0 0x7f52ec12ffc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f52e000aaf0 tx=0x7f52e000ae00 comp rx=0 tx=0).stop 2023-09-30T22:33:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.648+0000 7f52f1786700 1 -- 172.21.15.59:0/3616040148 shutdown_connections 2023-09-30T22:33:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.648+0000 7f52f1786700 1 --2- 172.21.15.59:0/3616040148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52ec135c20 0x7f52ec138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.648+0000 7f52f1786700 1 --2- 172.21.15.59:0/3616040148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52ec06f5d0 0x7f52ec12ffc0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.648+0000 7f52f1786700 1 -- 172.21.15.59:0/3616040148 >> 172.21.15.59:0/3616040148 conn(0x7f52ec0a2aa0 msgr2=0x7f52ec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.648+0000 7f52f1786700 1 -- 172.21.15.59:0/3616040148 shutdown_connections 2023-09-30T22:33:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.648+0000 7f52f1786700 1 -- 172.21.15.59:0/3616040148 wait complete. 2023-09-30T22:33:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.649+0000 7f52f1786700 1 Processor -- start 2023-09-30T22:33:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.649+0000 7f52f1786700 1 -- start start 2023-09-30T22:33:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52f1786700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52ec06f5d0 0x7f52ec132920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52f1786700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52ec12cf60 0x7f52ec132e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52f1786700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52ec135c20 0x7f52ec1c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52f1786700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec1325b0 con 0x7f52ec06f5d0 2023-09-30T22:33:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52f1786700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec099ed0 con 0x7f52ec12cf60 2023-09-30T22:33:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52f1786700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec129fa0 con 0x7f52ec135c20 2023-09-30T22:33:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52eaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52ec06f5d0 0x7f52ec132920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52eaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52ec06f5d0 0x7f52ec132920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44804/0 (socket says 172.21.15.59:44804) 2023-09-30T22:33:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52eb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52ec135c20 0x7f52ec1c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52eaffd700 1 -- 172.21.15.59:0/1788638426 learned_addr learned my addr 172.21.15.59:0/1788638426 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52eb7fe700 1 -- 172.21.15.59:0/1788638426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52ec12cf60 msgr2=0x7f52ec132e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52eb7fe700 1 --2- 172.21.15.59:0/1788638426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52ec12cf60 0x7f52ec132e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52eb7fe700 1 -- 172.21.15.59:0/1788638426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52ec06f5d0 msgr2=0x7f52ec132920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52eb7fe700 1 --2- 172.21.15.59:0/1788638426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52ec06f5d0 0x7f52ec132920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52eb7fe700 1 -- 172.21.15.59:0/1788638426 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e000a6f0 con 0x7f52ec135c20 2023-09-30T22:33:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.650+0000 7f52eb7fe700 1 --2- 172.21.15.59:0/1788638426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52ec135c20 0x7f52ec1c4110 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f52ec072e70 tx=0x7f52e4009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.651+0000 7f52d37fe700 1 -- 172.21.15.59:0/1788638426 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400cb90 con 0x7f52ec135c20 2023-09-30T22:33:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.651+0000 7f52d37fe700 1 -- 172.21.15.59:0/1788638426 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e400cd10 con 0x7f52ec135c20 2023-09-30T22:33:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.651+0000 7f52f1786700 1 -- 172.21.15.59:0/1788638426 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec134ad0 con 0x7f52ec135c20 2023-09-30T22:33:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.651+0000 7f52d37fe700 1 -- 172.21.15.59:0/1788638426 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4014680 con 0x7f52ec135c20 2023-09-30T22:33:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.651+0000 7f52f1786700 1 -- 172.21.15.59:0/1788638426 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ec133f30 con 0x7f52ec135c20 2023-09-30T22:33:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.652+0000 7f52d37fe700 1 -- 172.21.15.59:0/1788638426 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52e401c360 con 0x7f52ec135c20 2023-09-30T22:33:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.652+0000 7f52d37fe700 1 -- 172.21.15.59:0/1788638426 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f52e4006e40 con 0x7f52ec135c20 2023-09-30T22:33:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.652+0000 7f52f1786700 1 -- 172.21.15.59:0/1788638426 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ec074ea0 con 0x7f52ec135c20 2023-09-30T22:33:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.657+0000 7f52d37fe700 1 -- 172.21.15.59:0/1788638426 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52e4019020 con 0x7f52ec135c20 2023-09-30T22:33:38.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.735+0000 7f7121bb1700 1 Processor -- start 2023-09-30T22:33:38.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.736+0000 7f7121bb1700 1 -- start start 2023-09-30T22:33:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.736+0000 7f7121bb1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f711c09d6f0 0x7f711c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.736+0000 7f7121bb1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f711c09e000 0x7f711c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.736+0000 7f7121bb1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f711c09e410 0x7f711c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.736+0000 7f7121bb1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c09f520 con 0x7f711c09e000 2023-09-30T22:33:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.736+0000 7f7121bb1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c09f130 con 0x7f711c09e410 2023-09-30T22:33:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.736+0000 7f7121bb1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f711c09e930 con 0x7f711c09d6f0 2023-09-30T22:33:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.736+0000 7f711b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f711c09d6f0 0x7f711c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.736+0000 7f711bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f711c09e410 0x7f711c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.736+0000 7f711b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f711c09d6f0 0x7f711c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52542/0 (socket says 172.21.15.59:52542) 2023-09-30T22:33:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.736+0000 7f711bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f711c09e410 0x7f711c130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48738/0 (socket says 172.21.15.59:48738) 2023-09-30T22:33:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.736+0000 7f711b7fe700 1 -- 172.21.15.59:0/3495338923 learned_addr learned my addr 172.21.15.59:0/3495338923 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.736+0000 7f711affd700 1 --2- 172.21.15.59:0/3495338923 >> v2:172.21.15.59:3300/0 conn(0x7f711c09e000 0x7f711c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.737+0000 7f711b7fe700 1 -- 172.21.15.59:0/3495338923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f711c09e410 msgr2=0x7f711c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.737+0000 7f711b7fe700 1 --2- 172.21.15.59:0/3495338923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f711c09e410 0x7f711c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.737+0000 7f711b7fe700 1 -- 172.21.15.59:0/3495338923 >> v2:172.21.15.59:3300/0 conn(0x7f711c09e000 msgr2=0x7f711c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.737+0000 7f711b7fe700 1 --2- 172.21.15.59:0/3495338923 >> v2:172.21.15.59:3300/0 conn(0x7f711c09e000 0x7f711c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.737+0000 7f711b7fe700 1 -- 172.21.15.59:0/3495338923 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c09b2d0 con 0x7f711c09d6f0 2023-09-30T22:33:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.737+0000 7f711bfff700 1 --2- 172.21.15.59:0/3495338923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f711c09e410 0x7f711c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.737+0000 7f711affd700 1 --2- 172.21.15.59:0/3495338923 >> v2:172.21.15.59:3300/0 conn(0x7f711c09e000 0x7f711c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.737+0000 7f711b7fe700 1 --2- 172.21.15.59:0/3495338923 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f711c09d6f0 0x7f711c09dac0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f710c00dd50 tx=0x7f710c00f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=565ddd52ff64d22e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:38.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.737+0000 7f711a7fc700 1 -- 172.21.15.59:0/3495338923 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c012070 con 0x7f711c09d6f0 2023-09-30T22:33:38.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.737+0000 7f711a7fc700 1 -- 172.21.15.59:0/3495338923 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c00fae0 con 0x7f711c09d6f0 2023-09-30T22:33:38.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.737+0000 7f711a7fc700 1 -- 172.21.15.59:0/3495338923 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c00dea0 con 0x7f711c09d6f0 2023-09-30T22:33:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.738+0000 7f7121bb1700 1 -- 172.21.15.59:0/3495338923 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f711c09d6f0 msgr2=0x7f711c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.738+0000 7f7121bb1700 1 --2- 172.21.15.59:0/3495338923 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f711c09d6f0 0x7f711c09dac0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f710c00dd50 tx=0x7f710c00f330 comp rx=0 tx=0).stop 2023-09-30T22:33:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.738+0000 7f7121bb1700 1 -- 172.21.15.59:0/3495338923 shutdown_connections 2023-09-30T22:33:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.738+0000 7f7121bb1700 1 --2- 172.21.15.59:0/3495338923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f711c09e410 0x7f711c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.738+0000 7f7121bb1700 1 --2- 172.21.15.59:0/3495338923 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f711c09d6f0 0x7f711c09dac0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.738+0000 7f7121bb1700 1 --2- 172.21.15.59:0/3495338923 >> v2:172.21.15.59:3300/0 conn(0x7f711c09e000 0x7f711c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.738+0000 7f7121bb1700 1 -- 172.21.15.59:0/3495338923 >> 172.21.15.59:0/3495338923 conn(0x7f711c066f50 msgr2=0x7f711c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.738+0000 7f7121bb1700 1 -- 172.21.15.59:0/3495338923 shutdown_connections 2023-09-30T22:33:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.738+0000 7f7121bb1700 1 -- 172.21.15.59:0/3495338923 wait complete. 2023-09-30T22:33:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.739+0000 7f7121bb1700 1 Processor -- start 2023-09-30T22:33:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.740+0000 7f7121bb1700 1 -- start start 2023-09-30T22:33:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.740+0000 7f7121bb1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f711c09d6f0 0x7f711c11e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.740+0000 7f7121bb1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f711c09e000 0x7f711c11e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.740+0000 7f7121bb1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f711c09e410 0x7f711c11ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.740+0000 7f7121bb1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c121bd0 con 0x7f711c09e000 2023-09-30T22:33:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.740+0000 7f7121bb1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0a16b0 con 0x7f711c09e410 2023-09-30T22:33:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.740+0000 7f7121bb1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f711c1204e0 con 0x7f711c09d6f0 2023-09-30T22:33:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.741+0000 7f711affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f711c09e000 0x7f711c11e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.741+0000 7f711b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f711c09d6f0 0x7f711c11e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.741+0000 7f711b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f711c09d6f0 0x7f711c11e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52556/0 (socket says 172.21.15.59:52556) 2023-09-30T22:33:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.741+0000 7f711affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f711c09e000 0x7f711c11e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44818/0 (socket says 172.21.15.59:44818) 2023-09-30T22:33:38.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.741+0000 7f711b7fe700 1 -- 172.21.15.59:0/3856307999 learned_addr learned my addr 172.21.15.59:0/3856307999 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:38.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.741+0000 7f711bfff700 1 --2- 172.21.15.59:0/3856307999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f711c09e410 0x7f711c11ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.741+0000 7f711affd700 1 -- 172.21.15.59:0/3856307999 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f711c09d6f0 msgr2=0x7f711c11e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.741+0000 7f711affd700 1 --2- 172.21.15.59:0/3856307999 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f711c09d6f0 0x7f711c11e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.741+0000 7f711affd700 1 -- 172.21.15.59:0/3856307999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f711c09e410 msgr2=0x7f711c11ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.741+0000 7f711affd700 1 --2- 172.21.15.59:0/3856307999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f711c09e410 0x7f711c11ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.741+0000 7f711affd700 1 -- 172.21.15.59:0/3856307999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71100094a0 con 0x7f711c09e000 2023-09-30T22:33:38.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.741+0000 7f711affd700 1 --2- 172.21.15.59:0/3856307999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f711c09e000 0x7f711c11e6e0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f711c0a3e20 tx=0x7f711000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:38.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.741+0000 7f7103fff700 1 -- 172.21.15.59:0/3856307999 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110004030 con 0x7f711c09e000 2023-09-30T22:33:38.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.742+0000 7f7103fff700 1 -- 172.21.15.59:0/3856307999 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7110004190 con 0x7f711c09e000 2023-09-30T22:33:38.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.742+0000 7f7121bb1700 1 -- 172.21.15.59:0/3856307999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7114009a70 con 0x7f711c09e000 2023-09-30T22:33:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.742+0000 7f7103fff700 1 -- 172.21.15.59:0/3856307999 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110004520 con 0x7f711c09e000 2023-09-30T22:33:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.742+0000 7f7121bb1700 1 -- 172.21.15.59:0/3856307999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710c00da00 con 0x7f711c09e000 2023-09-30T22:33:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.743+0000 7f7103fff700 1 -- 172.21.15.59:0/3856307999 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71100036a0 con 0x7f711c09e000 2023-09-30T22:33:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.743+0000 7f7121bb1700 1 -- 172.21.15.59:0/3856307999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c11ac20 con 0x7f711c09e000 2023-09-30T22:33:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.743+0000 7f7103fff700 1 -- 172.21.15.59:0/3856307999 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f711003f780 con 0x7f711c09e000 2023-09-30T22:33:38.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.748+0000 7f7103fff700 1 -- 172.21.15.59:0/3856307999 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f711001be10 con 0x7f711c09e000 2023-09-30T22:33:38.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.759+0000 7fb3e05d6700 1 Processor -- start 2023-09-30T22:33:38.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.759+0000 7fb3e05d6700 1 -- start start 2023-09-30T22:33:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.760+0000 7fb3e05d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3d809d6f0 0x7fb3d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.760+0000 7fb3e05d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3d809e000 0x7fb3d81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.760+0000 7fb3e05d6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d809b120 con 0x7fb3d809e410 2023-09-30T22:33:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.760+0000 7fb3e05d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d806b460 con 0x7fb3d809d6f0 2023-09-30T22:33:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.760+0000 7fb3e05d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d809a7e0 con 0x7fb3d809e000 2023-09-30T22:33:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.760+0000 7fb3de372700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3d809d6f0 0x7fb3d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.760+0000 7fb3de372700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3d809d6f0 0x7fb3d809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48766/0 (socket says 172.21.15.59:48766) 2023-09-30T22:33:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.760+0000 7fb3de372700 1 -- 172.21.15.59:0/3309797994 learned_addr learned my addr 172.21.15.59:0/3309797994 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.760+0000 7fb3deb73700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb3d809e410 0x7fb3d8133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35792/0 (socket says 172.21.15.59:35792) 2023-09-30T22:33:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.760+0000 7fb3dd370700 1 -- 172.21.15.59:0/3309797994 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054842478 0 0) 0x7fb3d809b120 con 0x7fb3d809e410 2023-09-30T22:33:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.761+0000 7fb3de372700 1 -- 172.21.15.59:0/3309797994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3d809e000 msgr2=0x7fb3d81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.761+0000 7fb3de372700 1 --2- 172.21.15.59:0/3309797994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3d809e000 0x7fb3d81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.761+0000 7fb3de372700 1 -- 172.21.15.59:0/3309797994 >> v1:172.21.15.59:6789/0 conn(0x7fb3d809e410 legacy=0x7fb3d8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.761+0000 7fb3de372700 1 -- 172.21.15.59:0/3309797994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d809a500 con 0x7fb3d809d6f0 2023-09-30T22:33:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.761+0000 7fb3de372700 1 --2- 172.21.15.59:0/3309797994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3d809d6f0 0x7fb3d809dac0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4009920 tx=0x7fb3d4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2f8272717c80139 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.761+0000 7fb3dd370700 1 -- 172.21.15.59:0/3309797994 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d400ba60 con 0x7fb3d809d6f0 2023-09-30T22:33:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.761+0000 7fb3dd370700 1 -- 172.21.15.59:0/3309797994 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d400bbc0 con 0x7fb3d809d6f0 2023-09-30T22:33:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.761+0000 7fb3dd370700 1 -- 172.21.15.59:0/3309797994 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4009e70 con 0x7fb3d809d6f0 2023-09-30T22:33:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.762+0000 7fb3e05d6700 1 -- 172.21.15.59:0/3309797994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3d809d6f0 msgr2=0x7fb3d809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.762+0000 7fb3e05d6700 1 --2- 172.21.15.59:0/3309797994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3d809d6f0 0x7fb3d809dac0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4009920 tx=0x7fb3d4009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.762+0000 7fb3e05d6700 1 -- 172.21.15.59:0/3309797994 shutdown_connections 2023-09-30T22:33:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.762+0000 7fb3e05d6700 1 --2- 172.21.15.59:0/3309797994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3d809d6f0 0x7fb3d809dac0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.762+0000 7fb3e05d6700 1 --2- 172.21.15.59:0/3309797994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3d809e000 0x7fb3d81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.762+0000 7fb3e05d6700 1 -- 172.21.15.59:0/3309797994 >> 172.21.15.59:0/3309797994 conn(0x7fb3d8066f50 msgr2=0x7fb3d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.762+0000 7fb3e05d6700 1 -- 172.21.15.59:0/3309797994 shutdown_connections 2023-09-30T22:33:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.762+0000 7fb3e05d6700 1 -- 172.21.15.59:0/3309797994 wait complete. 2023-09-30T22:33:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.763+0000 7fb3e05d6700 1 Processor -- start 2023-09-30T22:33:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.763+0000 7fb3e05d6700 1 -- start start 2023-09-30T22:33:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.764+0000 7fb3e05d6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3d809d6f0 0x7fb3d8122430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.764+0000 7fb3e05d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3d809e000 0x7fb3d8122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.764+0000 7fb3e05d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3d809e410 0x7fb3d8122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.764+0000 7fb3e05d6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d809c710 con 0x7fb3d809d6f0 2023-09-30T22:33:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.764+0000 7fb3e05d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d81248b0 con 0x7fb3d809e410 2023-09-30T22:33:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.764+0000 7fb3e05d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d80a2c30 con 0x7fb3d809e000 2023-09-30T22:33:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.764+0000 7fb3ddb71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3d809e000 0x7fb3d8122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.764+0000 7fb3deb73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3d809e410 0x7fb3d8122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.764+0000 7fb3deb73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3d809e410 0x7fb3d8122eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48770/0 (socket says 172.21.15.59:48770) 2023-09-30T22:33:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.764+0000 7fb3ddb71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3d809e000 0x7fb3d8122970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52580/0 (socket says 172.21.15.59:52580) 2023-09-30T22:33:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.764+0000 7fb3deb73700 1 -- 172.21.15.59:0/168298604 learned_addr learned my addr 172.21.15.59:0/168298604 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.764+0000 7fb3de372700 1 --2- 172.21.15.59:0/168298604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3d809d6f0 0x7fb3d8122430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.764+0000 7fb3deb73700 1 -- 172.21.15.59:0/168298604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3d809e000 msgr2=0x7fb3d8122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.764+0000 7fb3deb73700 1 --2- 172.21.15.59:0/168298604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3d809e000 0x7fb3d8122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.764+0000 7fb3deb73700 1 -- 172.21.15.59:0/168298604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3d809d6f0 msgr2=0x7fb3d8122430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.765+0000 7fb3deb73700 1 --2- 172.21.15.59:0/168298604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3d809d6f0 0x7fb3d8122430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.765+0000 7fb3deb73700 1 -- 172.21.15.59:0/168298604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4009550 con 0x7fb3d809e410 2023-09-30T22:33:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.765+0000 7fb3de372700 1 --2- 172.21.15.59:0/168298604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3d809d6f0 0x7fb3d8122430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.765+0000 7fb3deb73700 1 --2- 172.21.15.59:0/168298604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3d809e410 0x7fb3d8122eb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000cc10 tx=0x7fb3d000cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.765+0000 7fb3ceffd700 1 -- 172.21.15.59:0/168298604 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d000aa60 con 0x7fb3d809e410 2023-09-30T22:33:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.765+0000 7fb3ceffd700 1 -- 172.21.15.59:0/168298604 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d000abc0 con 0x7fb3d809e410 2023-09-30T22:33:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.765+0000 7fb3ceffd700 1 -- 172.21.15.59:0/168298604 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d00070d0 con 0x7fb3d809e410 2023-09-30T22:33:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.765+0000 7fb3e05d6700 1 -- 172.21.15.59:0/168298604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d8124e60 con 0x7fb3d809e410 2023-09-30T22:33:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.765+0000 7fb3e05d6700 1 -- 172.21.15.59:0/168298604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d8125740 con 0x7fb3d809e410 2023-09-30T22:33:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.766+0000 7fb3ceffd700 1 -- 172.21.15.59:0/168298604 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3d0007230 con 0x7fb3d809e410 2023-09-30T22:33:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.766+0000 7fb3e05d6700 1 -- 172.21.15.59:0/168298604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d8074ea0 con 0x7fb3d809e410 2023-09-30T22:33:38.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.766+0000 7fb3ceffd700 1 -- 172.21.15.59:0/168298604 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb3d003f170 con 0x7fb3d809e410 2023-09-30T22:33:38.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.771+0000 7fb3ceffd700 1 -- 172.21.15.59:0/168298604 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3d00074e0 con 0x7fb3d809e410 2023-09-30T22:33:38.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.788+0000 7f0d78aa4700 1 Processor -- start 2023-09-30T22:33:38.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.788+0000 7f0d78aa4700 1 -- start start 2023-09-30T22:33:38.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.788+0000 7f0d78aa4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7409d6f0 0x7f0d7409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.788+0000 7f0d78aa4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d7409e000 0x7f0d741339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.788+0000 7f0d78aa4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7409b120 con 0x7f0d7409e410 2023-09-30T22:33:38.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.788+0000 7f0d78aa4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7406b460 con 0x7f0d7409d6f0 2023-09-30T22:33:38.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.788+0000 7f0d78aa4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7409a7e0 con 0x7f0d7409e000 2023-09-30T22:33:38.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.789+0000 7f0d7259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7409d6f0 0x7f0d7409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.789+0000 7f0d7259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7409d6f0 0x7f0d7409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48782/0 (socket says 172.21.15.59:48782) 2023-09-30T22:33:38.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.789+0000 7f0d7259c700 1 -- 172.21.15.59:0/1660161273 learned_addr learned my addr 172.21.15.59:0/1660161273 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:38.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.789+0000 7f0d71d9b700 1 --2- 172.21.15.59:0/1660161273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d7409e000 0x7f0d741339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.789+0000 7f0d7259c700 1 -- 172.21.15.59:0/1660161273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d7409e000 msgr2=0x7f0d741339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:38.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.789+0000 7f0d7259c700 1 --2- 172.21.15.59:0/1660161273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d7409e000 0x7f0d741339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.789+0000 7f0d7259c700 1 -- 172.21.15.59:0/1660161273 >> v1:172.21.15.59:6789/0 conn(0x7f0d7409e410 legacy=0x7f0d74133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.789+0000 7f0d7259c700 1 -- 172.21.15.59:0/1660161273 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7409a500 con 0x7f0d7409d6f0 2023-09-30T22:33:38.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.789+0000 7f0d7259c700 1 --2- 172.21.15.59:0/1660161273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7409d6f0 0x7f0d7409dac0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009920 tx=0x7f0d64009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ad5ee209ab2ca41 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:38.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.790+0000 7f0d7159a700 1 -- 172.21.15.59:0/1660161273 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6400ba60 con 0x7f0d7409d6f0 2023-09-30T22:33:38.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.790+0000 7f0d7159a700 1 -- 172.21.15.59:0/1660161273 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6400bbc0 con 0x7f0d7409d6f0 2023-09-30T22:33:38.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.790+0000 7f0d7159a700 1 -- 172.21.15.59:0/1660161273 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64009e70 con 0x7f0d7409d6f0 2023-09-30T22:33:38.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.791+0000 7f0d78aa4700 1 -- 172.21.15.59:0/1660161273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7409d6f0 msgr2=0x7f0d7409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.791+0000 7f0d78aa4700 1 --2- 172.21.15.59:0/1660161273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7409d6f0 0x7f0d7409dac0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009920 tx=0x7f0d64009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:38.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.791+0000 7f0d78aa4700 1 -- 172.21.15.59:0/1660161273 shutdown_connections 2023-09-30T22:33:38.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.791+0000 7f0d78aa4700 1 --2- 172.21.15.59:0/1660161273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7409d6f0 0x7f0d7409dac0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.791+0000 7f0d78aa4700 1 --2- 172.21.15.59:0/1660161273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d7409e000 0x7f0d741339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.791+0000 7f0d78aa4700 1 -- 172.21.15.59:0/1660161273 >> 172.21.15.59:0/1660161273 conn(0x7f0d74066f50 msgr2=0x7f0d7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:38.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.791+0000 7f0d78aa4700 1 -- 172.21.15.59:0/1660161273 shutdown_connections 2023-09-30T22:33:38.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.791+0000 7f0d78aa4700 1 -- 172.21.15.59:0/1660161273 wait complete. 2023-09-30T22:33:38.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.793+0000 7f0d78aa4700 1 Processor -- start 2023-09-30T22:33:38.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.793+0000 7f0d78aa4700 1 -- start start 2023-09-30T22:33:38.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.793+0000 7f0d78aa4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7409d6f0 0x7f0d741225e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.793+0000 7f0d78aa4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7409e000 0x7f0d74122b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.793+0000 7f0d78aa4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d7409e410 0x7f0d74123060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:38.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.793+0000 7f0d78aa4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d741241f0 con 0x7f0d7409d6f0 2023-09-30T22:33:38.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.793+0000 7f0d78aa4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7409c780 con 0x7f0d7409e000 2023-09-30T22:33:38.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.793+0000 7f0d78aa4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d74125e20 con 0x7f0d7409e410 2023-09-30T22:33:38.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.794+0000 7f0d7259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7409d6f0 0x7f0d741225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.794+0000 7f0d71d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7409e000 0x7f0d74122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.794+0000 7f0d7259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7409d6f0 0x7f0d741225e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44842/0 (socket says 172.21.15.59:44842) 2023-09-30T22:33:38.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.794+0000 7f0d7259c700 1 -- 172.21.15.59:0/530002590 learned_addr learned my addr 172.21.15.59:0/530002590 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:38.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.794+0000 7f0d71d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7409e000 0x7f0d74122b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48794/0 (socket says 172.21.15.59:48794) 2023-09-30T22:33:38.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.794+0000 7f0d72d9d700 1 --2- 172.21.15.59:0/530002590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d7409e410 0x7f0d74123060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:38.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.794+0000 7f0d71d9b700 1 -- 172.21.15.59:0/530002590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d7409e410 msgr2=0x7f0d74123060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.794+0000 7f0d71d9b700 1 --2- 172.21.15.59:0/530002590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d7409e410 0x7f0d74123060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.794+0000 7f0d71d9b700 1 -- 172.21.15.59:0/530002590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7409d6f0 msgr2=0x7f0d741225e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.794+0000 7f0d71d9b700 1 --2- 172.21.15.59:0/530002590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7409d6f0 0x7f0d741225e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.794+0000 7f0d71d9b700 1 -- 172.21.15.59:0/530002590 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d64009550 con 0x7f0d7409e000 2023-09-30T22:33:38.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.794+0000 7f0d71d9b700 1 --2- 172.21.15.59:0/530002590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7409e000 0x7f0d74122b20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800e7e0 tx=0x7f0d6800eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:38.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.794+0000 7f0d62ffd700 1 -- 172.21.15.59:0/530002590 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6800c070 con 0x7f0d7409e000 2023-09-30T22:33:38.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.794+0000 7f0d62ffd700 1 -- 172.21.15.59:0/530002590 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d68004020 con 0x7f0d7409e000 2023-09-30T22:33:38.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.794+0000 7f0d78aa4700 1 -- 172.21.15.59:0/530002590 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d74124a10 con 0x7f0d7409e000 2023-09-30T22:33:38.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.795+0000 7f0d62ffd700 1 -- 172.21.15.59:0/530002590 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68004390 con 0x7f0d7409e000 2023-09-30T22:33:38.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.795+0000 7f0d78aa4700 1 -- 172.21.15.59:0/530002590 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d740a2ce0 con 0x7f0d7409e000 2023-09-30T22:33:38.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.796+0000 7f0d62ffd700 1 -- 172.21.15.59:0/530002590 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d680036a0 con 0x7f0d7409e000 2023-09-30T22:33:38.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.796+0000 7f0d62ffd700 1 -- 172.21.15.59:0/530002590 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0d6803f080 con 0x7f0d7409e000 2023-09-30T22:33:38.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.796+0000 7f0d78aa4700 1 -- 172.21.15.59:0/530002590 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d74074ea0 con 0x7f0d7409e000 2023-09-30T22:33:38.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.805+0000 7f0d62ffd700 1 -- 172.21.15.59:0/530002590 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d6801a950 con 0x7f0d7409e000 2023-09-30T22:33:38.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.929+0000 7f52f1786700 1 -- 172.21.15.59:0/1788638426 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f52ec0713a0 con 0x7f52ec135c20 2023-09-30T22:33:38.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.930+0000 7f52d37fe700 1 -- 172.21.15.59:0/1788638426 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52e401d3b0 con 0x7f52ec135c20 2023-09-30T22:33:38.930 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:38.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.932+0000 7f52f1786700 1 -- 172.21.15.59:0/1788638426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52ec135c20 msgr2=0x7f52ec1c4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.932+0000 7f52f1786700 1 --2- 172.21.15.59:0/1788638426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52ec135c20 0x7f52ec1c4110 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f52ec072e70 tx=0x7f52e4009ed0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.932+0000 7f52f1786700 1 -- 172.21.15.59:0/1788638426 shutdown_connections 2023-09-30T22:33:38.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.932+0000 7f52f1786700 1 --2- 172.21.15.59:0/1788638426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52ec135c20 0x7f52ec1c4110 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.932+0000 7f52f1786700 1 --2- 172.21.15.59:0/1788638426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52ec06f5d0 0x7f52ec132920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.932+0000 7f52f1786700 1 --2- 172.21.15.59:0/1788638426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52ec12cf60 0x7f52ec132e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.932+0000 7f52f1786700 1 -- 172.21.15.59:0/1788638426 >> 172.21.15.59:0/1788638426 conn(0x7f52ec0a2aa0 msgr2=0x7f52ec06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:38.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.932+0000 7f52f1786700 1 -- 172.21.15.59:0/1788638426 shutdown_connections 2023-09-30T22:33:38.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.932+0000 7f52f1786700 1 -- 172.21.15.59:0/1788638426 wait complete. 2023-09-30T22:33:38.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:38.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.968+0000 7f7121bb1700 1 -- 172.21.15.59:0/3856307999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f711c074ea0 con 0x7f711c09e000 2023-09-30T22:33:38.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.968+0000 7f7103fff700 1 -- 172.21.15.59:0/3856307999 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f711001b3b0 con 0x7f711c09e000 2023-09-30T22:33:38.969 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:38.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.971+0000 7f7121bb1700 1 -- 172.21.15.59:0/3856307999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f711c09e000 msgr2=0x7f711c11e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.971+0000 7f7121bb1700 1 --2- 172.21.15.59:0/3856307999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f711c09e000 0x7f711c11e6e0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f711c0a3e20 tx=0x7f711000ec60 comp rx=0 tx=0).stop 2023-09-30T22:33:38.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.971+0000 7f7121bb1700 1 -- 172.21.15.59:0/3856307999 shutdown_connections 2023-09-30T22:33:38.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.971+0000 7f7121bb1700 1 --2- 172.21.15.59:0/3856307999 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f711c09d6f0 0x7f711c11e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.971+0000 7f7121bb1700 1 --2- 172.21.15.59:0/3856307999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f711c09e410 0x7f711c11ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.971+0000 7f7121bb1700 1 --2- 172.21.15.59:0/3856307999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f711c09e000 0x7f711c11e6e0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.971+0000 7f7121bb1700 1 -- 172.21.15.59:0/3856307999 >> 172.21.15.59:0/3856307999 conn(0x7f711c066f50 msgr2=0x7f711c130890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:38.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.971+0000 7f7121bb1700 1 -- 172.21.15.59:0/3856307999 shutdown_connections 2023-09-30T22:33:38.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.971+0000 7f7121bb1700 1 -- 172.21.15.59:0/3856307999 wait complete. 2023-09-30T22:33:38.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.982+0000 7fb3e05d6700 1 -- 172.21.15.59:0/168298604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb3d8125cd0 con 0x7fb3d809e410 2023-09-30T22:33:38.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.982+0000 7fb3ceffd700 1 -- 172.21.15.59:0/168298604 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3d0018020 con 0x7fb3d809e410 2023-09-30T22:33:38.982 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:38.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.985+0000 7fb3e05d6700 1 -- 172.21.15.59:0/168298604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3d809e410 msgr2=0x7fb3d8122eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:38.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.985+0000 7fb3e05d6700 1 --2- 172.21.15.59:0/168298604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3d809e410 0x7fb3d8122eb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000cc10 tx=0x7fb3d000cf20 comp rx=0 tx=0).stop 2023-09-30T22:33:38.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.985+0000 7fb3e05d6700 1 -- 172.21.15.59:0/168298604 shutdown_connections 2023-09-30T22:33:38.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.985+0000 7fb3e05d6700 1 --2- 172.21.15.59:0/168298604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3d809e410 0x7fb3d8122eb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.985+0000 7fb3e05d6700 1 --2- 172.21.15.59:0/168298604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3d809d6f0 0x7fb3d8122430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.985+0000 7fb3e05d6700 1 --2- 172.21.15.59:0/168298604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3d809e000 0x7fb3d8122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:38.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.985+0000 7fb3e05d6700 1 -- 172.21.15.59:0/168298604 >> 172.21.15.59:0/168298604 conn(0x7fb3d8066f50 msgr2=0x7fb3d80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:38.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.985+0000 7fb3e05d6700 1 -- 172.21.15.59:0/168298604 shutdown_connections 2023-09-30T22:33:38.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:38.985+0000 7fb3e05d6700 1 -- 172.21.15.59:0/168298604 wait complete. 2023-09-30T22:33:38.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:38.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:39.058+0000 7f0d78aa4700 1 -- 172.21.15.59:0/530002590 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0d7406c360 con 0x7f0d7409e000 2023-09-30T22:33:39.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:39.058+0000 7f0d62ffd700 1 -- 172.21.15.59:0/530002590 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d6802b090 con 0x7f0d7409e000 2023-09-30T22:33:39.059 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:39.061+0000 7f0d78aa4700 1 -- 172.21.15.59:0/530002590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7409e000 msgr2=0x7f0d74122b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:39.061+0000 7f0d78aa4700 1 --2- 172.21.15.59:0/530002590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7409e000 0x7f0d74122b20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800e7e0 tx=0x7f0d6800eaf0 comp rx=0 tx=0).stop 2023-09-30T22:33:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:39.061+0000 7f0d78aa4700 1 -- 172.21.15.59:0/530002590 shutdown_connections 2023-09-30T22:33:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:39.061+0000 7f0d78aa4700 1 --2- 172.21.15.59:0/530002590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d7409e410 0x7f0d74123060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:39.061+0000 7f0d78aa4700 1 --2- 172.21.15.59:0/530002590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7409d6f0 0x7f0d741225e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:39.061+0000 7f0d78aa4700 1 --2- 172.21.15.59:0/530002590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7409e000 0x7f0d74122b20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:39.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:39.061+0000 7f0d78aa4700 1 -- 172.21.15.59:0/530002590 >> 172.21.15.59:0/530002590 conn(0x7f0d74066f50 msgr2=0x7f0d74071150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:39.061+0000 7f0d78aa4700 1 -- 172.21.15.59:0/530002590 shutdown_connections 2023-09-30T22:33:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:39.061+0000 7f0d78aa4700 1 -- 172.21.15.59:0/530002590 wait complete. 2023-09-30T22:33:39.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:39.948 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:39.988 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:39.999 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:40.076 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:40.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.103+0000 7f08a667e700 1 Processor -- start 2023-09-30T22:33:40.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.103+0000 7f08a667e700 1 -- start start 2023-09-30T22:33:40.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.103+0000 7f08a667e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08a0131810 0x7f08a0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.103+0000 7f08a667e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08a0099a40 0x7f08a0099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.103+0000 7f08a667e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a01313c0 con 0x7f08a009a3b0 2023-09-30T22:33:40.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.103+0000 7f08a667e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a009b580 con 0x7f08a0131810 2023-09-30T22:33:40.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.103+0000 7f08a667e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08a006e8c0 con 0x7f08a0099a40 2023-09-30T22:33:40.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.104+0000 7f08a4c1b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f08a009a3b0 0x7f08a0138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35798/0 (socket says 172.21.15.59:35798) 2023-09-30T22:33:40.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.104+0000 7f089ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08a0131810 0x7f08a0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.104+0000 7f08a4c1b700 1 -- 172.21.15.59:0/2374276154 learned_addr learned my addr 172.21.15.59:0/2374276154 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:40.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.104+0000 7f089f7fe700 1 --2- 172.21.15.59:0/2374276154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08a0099a40 0x7f08a0099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.104+0000 7f089f7fe700 1 -- 172.21.15.59:0/2374276154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08a0131810 msgr2=0x7f08a0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:40.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.104+0000 7f089f7fe700 1 --2- 172.21.15.59:0/2374276154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08a0131810 0x7f08a0131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.104+0000 7f089f7fe700 1 -- 172.21.15.59:0/2374276154 >> v1:172.21.15.59:6789/0 conn(0x7f08a009a3b0 legacy=0x7f08a0138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.104+0000 7f089f7fe700 1 -- 172.21.15.59:0/2374276154 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a009a820 con 0x7f08a0099a40 2023-09-30T22:33:40.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.104+0000 7f089f7fe700 1 --2- 172.21.15.59:0/2374276154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08a0099a40 0x7f08a0099e70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0894009870 tx=0x7f0894009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3af8cc0ddc56e5d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:40.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.105+0000 7f089effd700 1 -- 172.21.15.59:0/2374276154 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894011830 con 0x7f08a0099a40 2023-09-30T22:33:40.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.105+0000 7f089effd700 1 -- 172.21.15.59:0/2374276154 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0894011990 con 0x7f08a0099a40 2023-09-30T22:33:40.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.105+0000 7f089effd700 1 -- 172.21.15.59:0/2374276154 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894011d20 con 0x7f08a0099a40 2023-09-30T22:33:40.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.106+0000 7f08a667e700 1 -- 172.21.15.59:0/2374276154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08a0099a40 msgr2=0x7f08a0099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.106+0000 7f08a667e700 1 --2- 172.21.15.59:0/2374276154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08a0099a40 0x7f08a0099e70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0894009870 tx=0x7f0894009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:40.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.106+0000 7f08a667e700 1 -- 172.21.15.59:0/2374276154 shutdown_connections 2023-09-30T22:33:40.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.106+0000 7f08a667e700 1 --2- 172.21.15.59:0/2374276154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08a0131810 0x7f08a0131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.106+0000 7f08a667e700 1 --2- 172.21.15.59:0/2374276154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08a0099a40 0x7f08a0099e70 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.106+0000 7f08a667e700 1 -- 172.21.15.59:0/2374276154 >> 172.21.15.59:0/2374276154 conn(0x7f08a00a2aa0 msgr2=0x7f08a00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:40.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.106+0000 7f08a667e700 1 -- 172.21.15.59:0/2374276154 shutdown_connections 2023-09-30T22:33:40.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.106+0000 7f08a667e700 1 -- 172.21.15.59:0/2374276154 wait complete. 2023-09-30T22:33:40.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.107+0000 7f08a667e700 1 Processor -- start 2023-09-30T22:33:40.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.107+0000 7f08a667e700 1 -- start start 2023-09-30T22:33:40.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f08a667e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08a0099a40 0x7f08a011b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f08a667e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08a009a3b0 0x7f08a011bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f08a667e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08a0131810 0x7f08a011c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f08a667e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a011ef70 con 0x7f08a0131810 2023-09-30T22:33:40.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f08a667e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a011e060 con 0x7f08a0099a40 2023-09-30T22:33:40.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f08a667e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08a011d300 con 0x7f08a009a3b0 2023-09-30T22:33:40.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f08a4c1b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08a0131810 0x7f08a011c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f089ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08a0099a40 0x7f08a011b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f08a4c1b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08a0131810 0x7f08a011c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44856/0 (socket says 172.21.15.59:44856) 2023-09-30T22:33:40.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f08a4c1b700 1 -- 172.21.15.59:0/3794820737 learned_addr learned my addr 172.21.15.59:0/3794820737 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:40.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f089f7fe700 1 --2- 172.21.15.59:0/3794820737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08a009a3b0 0x7f08a011bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f089ffff700 1 -- 172.21.15.59:0/3794820737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08a009a3b0 msgr2=0x7f08a011bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f089ffff700 1 --2- 172.21.15.59:0/3794820737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08a009a3b0 0x7f08a011bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f089ffff700 1 -- 172.21.15.59:0/3794820737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08a0131810 msgr2=0x7f08a011c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f089ffff700 1 --2- 172.21.15.59:0/3794820737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08a0131810 0x7f08a011c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f089ffff700 1 -- 172.21.15.59:0/3794820737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08940094a0 con 0x7f08a0099a40 2023-09-30T22:33:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.108+0000 7f08a4c1b700 1 --2- 172.21.15.59:0/3794820737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08a0131810 0x7f08a011c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.109+0000 7f089ffff700 1 --2- 172.21.15.59:0/3794820737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08a0099a40 0x7f08a011b6a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f089000e930 tx=0x7f089000ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.109+0000 7f089cff9700 1 -- 172.21.15.59:0/3794820737 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0890013680 con 0x7f08a0099a40 2023-09-30T22:33:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.109+0000 7f089cff9700 1 -- 172.21.15.59:0/3794820737 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08900137e0 con 0x7f08a0099a40 2023-09-30T22:33:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.109+0000 7f08a667e700 1 -- 172.21.15.59:0/3794820737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a011e520 con 0x7f08a0099a40 2023-09-30T22:33:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.109+0000 7f089cff9700 1 -- 172.21.15.59:0/3794820737 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0890013b50 con 0x7f08a0099a40 2023-09-30T22:33:40.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.109+0000 7f08a667e700 1 -- 172.21.15.59:0/3794820737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a006eb00 con 0x7f08a0099a40 2023-09-30T22:33:40.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.110+0000 7f089cff9700 1 -- 172.21.15.59:0/3794820737 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0890013cb0 con 0x7f08a0099a40 2023-09-30T22:33:40.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.110+0000 7f089cff9700 1 -- 172.21.15.59:0/3794820737 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f089003fb20 con 0x7f08a0099a40 2023-09-30T22:33:40.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.110+0000 7f08a667e700 1 -- 172.21.15.59:0/3794820737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a011f0b0 con 0x7f08a0099a40 2023-09-30T22:33:40.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.115+0000 7f089cff9700 1 -- 172.21.15.59:0/3794820737 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08a011f0b0 con 0x7f08a0099a40 2023-09-30T22:33:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.140+0000 7f1cd9405700 1 Processor -- start 2023-09-30T22:33:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.140+0000 7f1cd9405700 1 -- start start 2023-09-30T22:33:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.140+0000 7f1cd9405700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cd409d6f0 0x7f1cd409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.140+0000 7f1cd9405700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd409e000 0x7f1cd4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.141+0000 7f1cd9405700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd409f130 con 0x7f1cd409e410 2023-09-30T22:33:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.141+0000 7f1cd9405700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd409f520 con 0x7f1cd409d6f0 2023-09-30T22:33:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.141+0000 7f1cd9405700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd409e930 con 0x7f1cd409e000 2023-09-30T22:33:40.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.141+0000 7f1cd27fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd409e000 0x7f1cd4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.141+0000 7f1cd27fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd409e000 0x7f1cd4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48810/0 (socket says 172.21.15.59:48810) 2023-09-30T22:33:40.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.141+0000 7f1cd27fc700 1 -- 172.21.15.59:0/2532904331 learned_addr learned my addr 172.21.15.59:0/2532904331 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:40.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.141+0000 7f1cd2ffd700 1 --2- 172.21.15.59:0/2532904331 >> v2:172.21.15.59:3300/0 conn(0x7f1cd409d6f0 0x7f1cd409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.141+0000 7f1cd27fc700 1 -- 172.21.15.59:0/2532904331 >> v2:172.21.15.59:3300/0 conn(0x7f1cd409d6f0 msgr2=0x7f1cd409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:40.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.141+0000 7f1cd27fc700 1 --2- 172.21.15.59:0/2532904331 >> v2:172.21.15.59:3300/0 conn(0x7f1cd409d6f0 0x7f1cd409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.141+0000 7f1cd27fc700 1 -- 172.21.15.59:0/2532904331 >> v1:172.21.15.59:6789/0 conn(0x7f1cd409e410 legacy=0x7f1cd4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.141+0000 7f1cd27fc700 1 -- 172.21.15.59:0/2532904331 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd409b2d0 con 0x7f1cd409e000 2023-09-30T22:33:40.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.142+0000 7f1cd27fc700 1 --2- 172.21.15.59:0/2532904331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd409e000 0x7f1cd4130660 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800bb90 tx=0x7f1cc800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c321b80e28f1b6b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:40.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.142+0000 7f1cd1ffb700 1 -- 172.21.15.59:0/2532904331 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc800dd30 con 0x7f1cd409e000 2023-09-30T22:33:40.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.142+0000 7f1cd1ffb700 1 -- 172.21.15.59:0/2532904331 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc800de90 con 0x7f1cd409e000 2023-09-30T22:33:40.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.142+0000 7f1cd1ffb700 1 -- 172.21.15.59:0/2532904331 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8010690 con 0x7f1cd409e000 2023-09-30T22:33:40.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.143+0000 7f1cd9405700 1 -- 172.21.15.59:0/2532904331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd409e000 msgr2=0x7f1cd4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.143+0000 7f1cd9405700 1 --2- 172.21.15.59:0/2532904331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd409e000 0x7f1cd4130660 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800bb90 tx=0x7f1cc800bea0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.143+0000 7f1cd9405700 1 -- 172.21.15.59:0/2532904331 shutdown_connections 2023-09-30T22:33:40.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.143+0000 7f1cd9405700 1 --2- 172.21.15.59:0/2532904331 >> v2:172.21.15.59:3300/0 conn(0x7f1cd409d6f0 0x7f1cd409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.143+0000 7f1cd9405700 1 --2- 172.21.15.59:0/2532904331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd409e000 0x7f1cd4130660 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.143+0000 7f1cd9405700 1 -- 172.21.15.59:0/2532904331 >> 172.21.15.59:0/2532904331 conn(0x7f1cd4066f50 msgr2=0x7f1cd409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:40.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.143+0000 7f1cd9405700 1 -- 172.21.15.59:0/2532904331 shutdown_connections 2023-09-30T22:33:40.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.143+0000 7f1cd9405700 1 -- 172.21.15.59:0/2532904331 wait complete. 2023-09-30T22:33:40.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.145+0000 7f1cd9405700 1 Processor -- start 2023-09-30T22:33:40.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.145+0000 7f1cd9405700 1 -- start start 2023-09-30T22:33:40.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.146+0000 7f1cd9405700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd409d6f0 0x7f1cd411df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.146+0000 7f1cd9405700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd409e000 0x7f1cd411e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.146+0000 7f1cd9405700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd409e410 0x7f1cd411ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.146+0000 7f1cd9405700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd4121ab0 con 0x7f1cd409e410 2023-09-30T22:33:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.146+0000 7f1cd9405700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd4120180 con 0x7f1cd409d6f0 2023-09-30T22:33:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.146+0000 7f1cd9405700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd4121240 con 0x7f1cd409e000 2023-09-30T22:33:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.146+0000 7f1cd2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd409d6f0 0x7f1cd411df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.146+0000 7f1cd2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd409d6f0 0x7f1cd411df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48814/0 (socket says 172.21.15.59:48814) 2023-09-30T22:33:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.146+0000 7f1cd2ffd700 1 -- 172.21.15.59:0/1675832375 learned_addr learned my addr 172.21.15.59:0/1675832375 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.146+0000 7f1cd27fc700 1 --2- 172.21.15.59:0/1675832375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd409e000 0x7f1cd411e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.146+0000 7f1cd37fe700 1 --2- 172.21.15.59:0/1675832375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd409e410 0x7f1cd411ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.147+0000 7f1cd2ffd700 1 -- 172.21.15.59:0/1675832375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd409e000 msgr2=0x7f1cd411e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.147+0000 7f1cd2ffd700 1 --2- 172.21.15.59:0/1675832375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd409e000 0x7f1cd411e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.147+0000 7f1cd2ffd700 1 -- 172.21.15.59:0/1675832375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd409e410 msgr2=0x7f1cd411ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.147+0000 7f1cd2ffd700 1 --2- 172.21.15.59:0/1675832375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd409e410 0x7f1cd411ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.147+0000 7f1cd2ffd700 1 -- 172.21.15.59:0/1675832375 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc800b7f0 con 0x7f1cd409d6f0 2023-09-30T22:33:40.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.147+0000 7f1cd27fc700 1 --2- 172.21.15.59:0/1675832375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd409e000 0x7f1cd411e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.147+0000 7f1cd2ffd700 1 --2- 172.21.15.59:0/1675832375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd409d6f0 0x7f1cd411df90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400e9b0 tx=0x7f1cc400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.147+0000 7f1cbb7fe700 1 -- 172.21.15.59:0/1675832375 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4009710 con 0x7f1cd409d6f0 2023-09-30T22:33:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.147+0000 7f1cbb7fe700 1 -- 172.21.15.59:0/1675832375 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc400ee50 con 0x7f1cd409d6f0 2023-09-30T22:33:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.147+0000 7f1cd9405700 1 -- 172.21.15.59:0/1675832375 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd409c700 con 0x7f1cd409d6f0 2023-09-30T22:33:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.147+0000 7f1cbb7fe700 1 -- 172.21.15.59:0/1675832375 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc400ca50 con 0x7f1cd409d6f0 2023-09-30T22:33:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.147+0000 7f1cd9405700 1 -- 172.21.15.59:0/1675832375 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd4130370 con 0x7f1cd409d6f0 2023-09-30T22:33:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.148+0000 7f1cbb7fe700 1 -- 172.21.15.59:0/1675832375 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1cc400cbb0 con 0x7f1cd409d6f0 2023-09-30T22:33:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.149+0000 7f1cbb7fe700 1 -- 172.21.15.59:0/1675832375 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1cc403f7c0 con 0x7f1cd409d6f0 2023-09-30T22:33:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.149+0000 7f1cd9405700 1 -- 172.21.15.59:0/1675832375 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd4074ea0 con 0x7f1cd409d6f0 2023-09-30T22:33:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.158+0000 7f1cbb7fe700 1 -- 172.21.15.59:0/1675832375 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1cc4017080 con 0x7f1cd409d6f0 2023-09-30T22:33:40.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.195+0000 7f6643f58700 1 Processor -- start 2023-09-30T22:33:40.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.195+0000 7f6643f58700 1 -- start start 2023-09-30T22:33:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.196+0000 7f6643f58700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c09d9f0 0x7f663c136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.196+0000 7f6643f58700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f663c136a70 0x7f663c138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.196+0000 7f6643f58700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c09e130 con 0x7f663c1316c0 2023-09-30T22:33:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.196+0000 7f6643f58700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c1321a0 con 0x7f663c136a70 2023-09-30T22:33:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.196+0000 7f6643f58700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c1312b0 con 0x7f663c09d9f0 2023-09-30T22:33:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.196+0000 7f66414f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c09d9f0 0x7f663c136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.196+0000 7f66414f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c09d9f0 0x7f663c136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48830/0 (socket says 172.21.15.59:48830) 2023-09-30T22:33:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.196+0000 7f66414f3700 1 -- 172.21.15.59:0/1098572913 learned_addr learned my addr 172.21.15.59:0/1098572913 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.196+0000 7f66424f5700 1 --2- 172.21.15.59:0/1098572913 >> v2:172.21.15.59:3300/0 conn(0x7f663c136a70 0x7f663c138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.196+0000 7f66424f5700 1 -- 172.21.15.59:0/1098572913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c09d9f0 msgr2=0x7f663c136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.196+0000 7f66424f5700 1 --2- 172.21.15.59:0/1098572913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c09d9f0 0x7f663c136530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.196+0000 7f66424f5700 1 -- 172.21.15.59:0/1098572913 >> v1:172.21.15.59:6789/0 conn(0x7f663c1316c0 legacy=0x7f663c131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.197+0000 7f66424f5700 1 -- 172.21.15.59:0/1098572913 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c09f6e0 con 0x7f663c136a70 2023-09-30T22:33:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.197+0000 7f66424f5700 1 --2- 172.21.15.59:0/1098572913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c136a70 0x7f663c138e50 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f6634009d90 tx=0x7f663400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27deedc11a1b28fc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:40.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.197+0000 7f6640cf2700 1 -- 172.21.15.59:0/1098572913 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663400e070 con 0x7f663c136a70 2023-09-30T22:33:40.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.197+0000 7f6640cf2700 1 -- 172.21.15.59:0/1098572913 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663400bb20 con 0x7f663c136a70 2023-09-30T22:33:40.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.197+0000 7f6640cf2700 1 -- 172.21.15.59:0/1098572913 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634012430 con 0x7f663c136a70 2023-09-30T22:33:40.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.198+0000 7f6643f58700 1 -- 172.21.15.59:0/1098572913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c136a70 msgr2=0x7f663c138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.198+0000 7f6643f58700 1 --2- 172.21.15.59:0/1098572913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c136a70 0x7f663c138e50 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f6634009d90 tx=0x7f663400b330 comp rx=0 tx=0).stop 2023-09-30T22:33:40.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.198+0000 7f6643f58700 1 -- 172.21.15.59:0/1098572913 shutdown_connections 2023-09-30T22:33:40.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.198+0000 7f6643f58700 1 --2- 172.21.15.59:0/1098572913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c136a70 0x7f663c138e50 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.198+0000 7f6643f58700 1 --2- 172.21.15.59:0/1098572913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c09d9f0 0x7f663c136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.198+0000 7f6643f58700 1 -- 172.21.15.59:0/1098572913 >> 172.21.15.59:0/1098572913 conn(0x7f663c066f50 msgr2=0x7f663c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:40.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.198+0000 7f6643f58700 1 -- 172.21.15.59:0/1098572913 shutdown_connections 2023-09-30T22:33:40.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.198+0000 7f6643f58700 1 -- 172.21.15.59:0/1098572913 wait complete. 2023-09-30T22:33:40.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.200+0000 7f6643f58700 1 Processor -- start 2023-09-30T22:33:40.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.200+0000 7f6643f58700 1 -- start start 2023-09-30T22:33:40.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f6643f58700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c09d9f0 0x7f663c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f6643f58700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c1316c0 0x7f663c06f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f6643f58700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f663c136a70 0x7f663c06f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f6643f58700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0721a0 con 0x7f663c09d9f0 2023-09-30T22:33:40.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f6643f58700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c070940 con 0x7f663c1316c0 2023-09-30T22:33:40.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f6643f58700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f663c12ecf0 con 0x7f663c136a70 2023-09-30T22:33:40.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f66414f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c1316c0 0x7f663c06f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f66414f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c1316c0 0x7f663c06f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48836/0 (socket says 172.21.15.59:48836) 2023-09-30T22:33:40.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f66414f3700 1 -- 172.21.15.59:0/2847666373 learned_addr learned my addr 172.21.15.59:0/2847666373 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:40.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f66424f5700 1 --2- 172.21.15.59:0/2847666373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f663c136a70 0x7f663c06f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f6641cf4700 1 --2- 172.21.15.59:0/2847666373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c09d9f0 0x7f663c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f66414f3700 1 -- 172.21.15.59:0/2847666373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f663c136a70 msgr2=0x7f663c06f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f66414f3700 1 --2- 172.21.15.59:0/2847666373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f663c136a70 0x7f663c06f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f66414f3700 1 -- 172.21.15.59:0/2847666373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c09d9f0 msgr2=0x7f663c06eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f66414f3700 1 --2- 172.21.15.59:0/2847666373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c09d9f0 0x7f663c06eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f66414f3700 1 -- 172.21.15.59:0/2847666373 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634009a70 con 0x7f663c1316c0 2023-09-30T22:33:40.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.201+0000 7f6641cf4700 1 --2- 172.21.15.59:0/2847666373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c09d9f0 0x7f663c06eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:40.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.202+0000 7f66414f3700 1 --2- 172.21.15.59:0/2847666373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c1316c0 0x7f663c06f2e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f662c00e910 tx=0x7f662c00ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:40.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.202+0000 7f66327fc700 1 -- 172.21.15.59:0/2847666373 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0096a0 con 0x7f663c1316c0 2023-09-30T22:33:40.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.202+0000 7f66327fc700 1 -- 172.21.15.59:0/2847666373 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c00ee60 con 0x7f663c1316c0 2023-09-30T22:33:40.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.202+0000 7f66327fc700 1 -- 172.21.15.59:0/2847666373 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c00ca90 con 0x7f663c1316c0 2023-09-30T22:33:40.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.202+0000 7f6643f58700 1 -- 172.21.15.59:0/2847666373 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c12b900 con 0x7f663c1316c0 2023-09-30T22:33:40.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.202+0000 7f6643f58700 1 -- 172.21.15.59:0/2847666373 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c071de0 con 0x7f663c1316c0 2023-09-30T22:33:40.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.203+0000 7f66327fc700 1 -- 172.21.15.59:0/2847666373 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f662c00cbf0 con 0x7f663c1316c0 2023-09-30T22:33:40.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.203+0000 7f66327fc700 1 -- 172.21.15.59:0/2847666373 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f662c012dc0 con 0x7f663c1316c0 2023-09-30T22:33:40.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.204+0000 7f6643f58700 1 -- 172.21.15.59:0/2847666373 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c074ea0 con 0x7f663c1316c0 2023-09-30T22:33:40.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.209+0000 7f66327fc700 1 -- 172.21.15.59:0/2847666373 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f662c017080 con 0x7f663c1316c0 2023-09-30T22:33:40.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.240+0000 7fd3eec1a700 1 Processor -- start 2023-09-30T22:33:40.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.240+0000 7fd3eec1a700 1 -- start start 2023-09-30T22:33:40.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.240+0000 7fd3eec1a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3e80a0a30 0x7fd3e80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.240+0000 7fd3eec1a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3e8138d80 0x7fd3e813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.240+0000 7fd3eec1a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e80a2a70 con 0x7fd3e809d630 2023-09-30T22:33:40.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.240+0000 7fd3eec1a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e80a01d0 con 0x7fd3e8138d80 2023-09-30T22:33:40.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.240+0000 7fd3eec1a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e809e2b0 con 0x7fd3e80a0a30 2023-09-30T22:33:40.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.240+0000 7fd3e7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd3e809d630 0x7fd3e80a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35834/0 (socket says 172.21.15.59:35834) 2023-09-30T22:33:40.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.240+0000 7fd3e7fff700 1 -- 172.21.15.59:0/2295097095 learned_addr learned my addr 172.21.15.59:0/2295097095 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:40.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.241+0000 7fd3ec9b6700 1 --2- 172.21.15.59:0/2295097095 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3e80a0a30 0x7fd3e80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.241+0000 7fd3ed1b7700 1 --2- 172.21.15.59:0/2295097095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3e8138d80 0x7fd3e813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.241+0000 7fd3e77fe700 1 -- 172.21.15.59:0/2295097095 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584992922 0 0) 0x7fd3e80a2a70 con 0x7fd3e809d630 2023-09-30T22:33:40.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.241+0000 7fd3e77fe700 1 -- 172.21.15.59:0/2295097095 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3d80035b0 con 0x7fd3e809d630 2023-09-30T22:33:40.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.241+0000 7fd3ec9b6700 1 -- 172.21.15.59:0/2295097095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3e8138d80 msgr2=0x7fd3e813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:40.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.241+0000 7fd3ec9b6700 1 --2- 172.21.15.59:0/2295097095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3e8138d80 0x7fd3e813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.241+0000 7fd3ec9b6700 1 -- 172.21.15.59:0/2295097095 >> v1:172.21.15.59:6789/0 conn(0x7fd3e809d630 legacy=0x7fd3e80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.241+0000 7fd3ec9b6700 1 -- 172.21.15.59:0/2295097095 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e809dc50 con 0x7fd3e80a0a30 2023-09-30T22:33:40.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.241+0000 7fd3ec9b6700 1 --2- 172.21.15.59:0/2295097095 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3e80a0a30 0x7fd3e80a0e00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009870 tx=0x7fd3dc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=178de54aeb5a027e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:40.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.241+0000 7fd3e77fe700 1 -- 172.21.15.59:0/2295097095 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc011830 con 0x7fd3e80a0a30 2023-09-30T22:33:40.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.241+0000 7fd3e77fe700 1 -- 172.21.15.59:0/2295097095 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc011990 con 0x7fd3e80a0a30 2023-09-30T22:33:40.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.241+0000 7fd3e77fe700 1 -- 172.21.15.59:0/2295097095 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc011d20 con 0x7fd3e80a0a30 2023-09-30T22:33:40.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.242+0000 7fd3eec1a700 1 -- 172.21.15.59:0/2295097095 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3e80a0a30 msgr2=0x7fd3e80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.242+0000 7fd3eec1a700 1 --2- 172.21.15.59:0/2295097095 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3e80a0a30 0x7fd3e80a0e00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009870 tx=0x7fd3dc009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:40.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.242+0000 7fd3eec1a700 1 -- 172.21.15.59:0/2295097095 shutdown_connections 2023-09-30T22:33:40.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.242+0000 7fd3eec1a700 1 --2- 172.21.15.59:0/2295097095 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3e80a0a30 0x7fd3e80a0e00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.242+0000 7fd3eec1a700 1 --2- 172.21.15.59:0/2295097095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3e8138d80 0x7fd3e813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.242+0000 7fd3eec1a700 1 -- 172.21.15.59:0/2295097095 >> 172.21.15.59:0/2295097095 conn(0x7fd3e80a3050 msgr2=0x7fd3e80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:40.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.242+0000 7fd3eec1a700 1 -- 172.21.15.59:0/2295097095 shutdown_connections 2023-09-30T22:33:40.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.242+0000 7fd3eec1a700 1 -- 172.21.15.59:0/2295097095 wait complete. 2023-09-30T22:33:40.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.243+0000 7fd3eec1a700 1 Processor -- start 2023-09-30T22:33:40.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.243+0000 7fd3eec1a700 1 -- start start 2023-09-30T22:33:40.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.244+0000 7fd3eec1a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3e809d630 0x7fd3e8120800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.244+0000 7fd3eec1a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3e80a0a30 0x7fd3e8120d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.244+0000 7fd3eec1a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3e8138d80 0x7fd3e8121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:40.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.244+0000 7fd3eec1a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8123640 con 0x7fd3e80a0a30 2023-09-30T22:33:40.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.244+0000 7fd3eec1a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8121c60 con 0x7fd3e809d630 2023-09-30T22:33:40.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.244+0000 7fd3eec1a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8122be0 con 0x7fd3e8138d80 2023-09-30T22:33:40.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.244+0000 7fd3ec9b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3e809d630 0x7fd3e8120800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.244+0000 7fd3ec9b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3e809d630 0x7fd3e8120800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48856/0 (socket says 172.21.15.59:48856) 2023-09-30T22:33:40.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.244+0000 7fd3ec9b6700 1 -- 172.21.15.59:0/3440869994 learned_addr learned my addr 172.21.15.59:0/3440869994 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:40.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.244+0000 7fd3ed1b7700 1 --2- 172.21.15.59:0/3440869994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3e8138d80 0x7fd3e8121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.245+0000 7fd3e7fff700 1 --2- 172.21.15.59:0/3440869994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3e80a0a30 0x7fd3e8120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:40.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.245+0000 7fd3ec9b6700 1 -- 172.21.15.59:0/3440869994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3e8138d80 msgr2=0x7fd3e8121280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.245+0000 7fd3ec9b6700 1 --2- 172.21.15.59:0/3440869994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3e8138d80 0x7fd3e8121280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.245+0000 7fd3ec9b6700 1 -- 172.21.15.59:0/3440869994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3e80a0a30 msgr2=0x7fd3e8120d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.245+0000 7fd3ec9b6700 1 --2- 172.21.15.59:0/3440869994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3e80a0a30 0x7fd3e8120d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.245+0000 7fd3ec9b6700 1 -- 172.21.15.59:0/3440869994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc0094a0 con 0x7fd3e809d630 2023-09-30T22:33:40.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.245+0000 7fd3e7fff700 1 --2- 172.21.15.59:0/3440869994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3e80a0a30 0x7fd3e8120d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:40.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.245+0000 7fd3ec9b6700 1 --2- 172.21.15.59:0/3440869994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3e809d630 0x7fd3e8120800 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009840 tx=0x7fd3dc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:40.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.245+0000 7fd3e57fa700 1 -- 172.21.15.59:0/3440869994 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc004590 con 0x7fd3e809d630 2023-09-30T22:33:40.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.245+0000 7fd3eec1a700 1 -- 172.21.15.59:0/3440869994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e8124290 con 0x7fd3e809d630 2023-09-30T22:33:40.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.245+0000 7fd3e57fa700 1 -- 172.21.15.59:0/3440869994 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc01f070 con 0x7fd3e809d630 2023-09-30T22:33:40.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.245+0000 7fd3e57fa700 1 -- 172.21.15.59:0/3440869994 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0038e0 con 0x7fd3e809d630 2023-09-30T22:33:40.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.245+0000 7fd3eec1a700 1 -- 172.21.15.59:0/3440869994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e813ab20 con 0x7fd3e809d630 2023-09-30T22:33:40.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.246+0000 7fd3e57fa700 1 -- 172.21.15.59:0/3440869994 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3dc003a40 con 0x7fd3e809d630 2023-09-30T22:33:40.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.247+0000 7fd3e57fa700 1 -- 172.21.15.59:0/3440869994 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd3dc021070 con 0x7fd3e809d630 2023-09-30T22:33:40.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.247+0000 7fd3eec1a700 1 -- 172.21.15.59:0/3440869994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e81240d0 con 0x7fd3e809d630 2023-09-30T22:33:40.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.252+0000 7fd3e57fa700 1 -- 172.21.15.59:0/3440869994 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3dc02b080 con 0x7fd3e809d630 2023-09-30T22:33:40.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.388+0000 7f1cd9405700 1 -- 172.21.15.59:0/1675832375 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1cd4121650 con 0x7f1cd409d6f0 2023-09-30T22:33:40.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.388+0000 7f1cbb7fe700 1 -- 172.21.15.59:0/1675832375 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1cd4121650 con 0x7f1cd409d6f0 2023-09-30T22:33:40.389 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:40.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.391+0000 7f1cd9405700 1 -- 172.21.15.59:0/1675832375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd409d6f0 msgr2=0x7f1cd411df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.391+0000 7f1cd9405700 1 --2- 172.21.15.59:0/1675832375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd409d6f0 0x7f1cd411df90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400e9b0 tx=0x7f1cc400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.391+0000 7f1cd9405700 1 -- 172.21.15.59:0/1675832375 shutdown_connections 2023-09-30T22:33:40.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.391+0000 7f1cd9405700 1 --2- 172.21.15.59:0/1675832375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd409e410 0x7f1cd411ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.391+0000 7f1cd9405700 1 --2- 172.21.15.59:0/1675832375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd409d6f0 0x7f1cd411df90 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.391+0000 7f1cd9405700 1 --2- 172.21.15.59:0/1675832375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd409e000 0x7f1cd411e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.391+0000 7f1cd9405700 1 -- 172.21.15.59:0/1675832375 >> 172.21.15.59:0/1675832375 conn(0x7f1cd4066f50 msgr2=0x7f1cd40710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:40.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.393+0000 7f1cd9405700 1 -- 172.21.15.59:0/1675832375 shutdown_connections 2023-09-30T22:33:40.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.393+0000 7f1cd9405700 1 -- 172.21.15.59:0/1675832375 wait complete. 2023-09-30T22:33:40.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.394+0000 7f08a667e700 1 -- 172.21.15.59:0/3794820737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f08a011f0b0 con 0x7f08a0099a40 2023-09-30T22:33:40.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.394+0000 7f089cff9700 1 -- 172.21.15.59:0/3794820737 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08a011f0b0 con 0x7f08a0099a40 2023-09-30T22:33:40.395 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:40.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.398+0000 7f08a667e700 1 -- 172.21.15.59:0/3794820737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08a0099a40 msgr2=0x7f08a011b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.398+0000 7f08a667e700 1 --2- 172.21.15.59:0/3794820737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08a0099a40 0x7f08a011b6a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f089000e930 tx=0x7f089000ec40 comp rx=0 tx=0).stop 2023-09-30T22:33:40.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.398+0000 7f08a667e700 1 -- 172.21.15.59:0/3794820737 shutdown_connections 2023-09-30T22:33:40.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.398+0000 7f08a667e700 1 --2- 172.21.15.59:0/3794820737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08a0131810 0x7f08a011c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.398+0000 7f08a667e700 1 --2- 172.21.15.59:0/3794820737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08a0099a40 0x7f08a011b6a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.398+0000 7f08a667e700 1 --2- 172.21.15.59:0/3794820737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08a009a3b0 0x7f08a011bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.398+0000 7f08a667e700 1 -- 172.21.15.59:0/3794820737 >> 172.21.15.59:0/3794820737 conn(0x7f08a00a2aa0 msgr2=0x7f08a0071000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:40.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.398+0000 7f08a667e700 1 -- 172.21.15.59:0/3794820737 shutdown_connections 2023-09-30T22:33:40.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.398+0000 7f08a667e700 1 -- 172.21.15.59:0/3794820737 wait complete. 2023-09-30T22:33:40.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:40.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.457+0000 7fd3eec1a700 1 -- 172.21.15.59:0/3440869994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd3e80747f0 con 0x7fd3e809d630 2023-09-30T22:33:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.457+0000 7fd3e57fa700 1 -- 172.21.15.59:0/3440869994 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3dc01a430 con 0x7fd3e809d630 2023-09-30T22:33:40.457 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.459+0000 7fd3eec1a700 1 -- 172.21.15.59:0/3440869994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3e809d630 msgr2=0x7fd3e8120800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.459+0000 7fd3eec1a700 1 --2- 172.21.15.59:0/3440869994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3e809d630 0x7fd3e8120800 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009840 tx=0x7fd3dc004750 comp rx=0 tx=0).stop 2023-09-30T22:33:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.460+0000 7fd3eec1a700 1 -- 172.21.15.59:0/3440869994 shutdown_connections 2023-09-30T22:33:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.460+0000 7fd3eec1a700 1 --2- 172.21.15.59:0/3440869994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3e8138d80 0x7fd3e8121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.460+0000 7fd3eec1a700 1 --2- 172.21.15.59:0/3440869994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3e809d630 0x7fd3e8120800 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.460+0000 7fd3eec1a700 1 --2- 172.21.15.59:0/3440869994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3e80a0a30 0x7fd3e8120d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.460+0000 7fd3eec1a700 1 -- 172.21.15.59:0/3440869994 >> 172.21.15.59:0/3440869994 conn(0x7fd3e80a3050 msgr2=0x7fd3e809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.460+0000 7fd3eec1a700 1 -- 172.21.15.59:0/3440869994 shutdown_connections 2023-09-30T22:33:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.460+0000 7fd3eec1a700 1 -- 172.21.15.59:0/3440869994 wait complete. 2023-09-30T22:33:40.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:40.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.474+0000 7f6643f58700 1 -- 172.21.15.59:0/2847666373 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f663c09e980 con 0x7f663c1316c0 2023-09-30T22:33:40.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.474+0000 7f66327fc700 1 -- 172.21.15.59:0/2847666373 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f662c044060 con 0x7f663c1316c0 2023-09-30T22:33:40.474 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:40.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.477+0000 7f6643f58700 1 -- 172.21.15.59:0/2847666373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c1316c0 msgr2=0x7f663c06f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:40.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.477+0000 7f6643f58700 1 --2- 172.21.15.59:0/2847666373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c1316c0 0x7f663c06f2e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f662c00e910 tx=0x7f662c00ec20 comp rx=0 tx=0).stop 2023-09-30T22:33:40.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.477+0000 7f6643f58700 1 -- 172.21.15.59:0/2847666373 shutdown_connections 2023-09-30T22:33:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.477+0000 7f6643f58700 1 --2- 172.21.15.59:0/2847666373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f663c136a70 0x7f663c06f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.477+0000 7f6643f58700 1 --2- 172.21.15.59:0/2847666373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c09d9f0 0x7f663c06eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.477+0000 7f6643f58700 1 --2- 172.21.15.59:0/2847666373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c1316c0 0x7f663c06f2e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.477+0000 7f6643f58700 1 -- 172.21.15.59:0/2847666373 >> 172.21.15.59:0/2847666373 conn(0x7f663c066f50 msgr2=0x7f663c1304f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.477+0000 7f6643f58700 1 -- 172.21.15.59:0/2847666373 shutdown_connections 2023-09-30T22:33:40.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:40.477+0000 7f6643f58700 1 -- 172.21.15.59:0/2847666373 wait complete. 2023-09-30T22:33:40.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:41.410 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:41.419 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:41.475 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:41.491 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.564+0000 7f5c4fb26700 1 Processor -- start 2023-09-30T22:33:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.564+0000 7f5c4fb26700 1 -- start start 2023-09-30T22:33:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.565+0000 7f5c4fb26700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4809d6f0 0x7f5c4809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.565+0000 7f5c4fb26700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5c4809e000 0x7f5c48130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.565+0000 7f5c4fb26700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4809f130 con 0x7f5c4809e410 2023-09-30T22:33:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.565+0000 7f5c4fb26700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4809f520 con 0x7f5c4809e000 2023-09-30T22:33:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.565+0000 7f5c4fb26700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4809e930 con 0x7f5c4809d6f0 2023-09-30T22:33:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.565+0000 7f5c4d0c1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5c4809e000 0x7f5c48130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.565+0000 7f5c4d0c1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5c4809e000 0x7f5c48130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44914/0 (socket says 172.21.15.59:44914) 2023-09-30T22:33:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.565+0000 7f5c4d0c1700 1 -- 172.21.15.59:0/1268893821 learned_addr learned my addr 172.21.15.59:0/1268893821 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.565+0000 7f5c4d0c1700 1 -- 172.21.15.59:0/1268893821 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4809d6f0 msgr2=0x7f5c4809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.565+0000 7f5c4d0c1700 1 --2- 172.21.15.59:0/1268893821 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4809d6f0 0x7f5c4809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.565+0000 7f5c4d0c1700 1 -- 172.21.15.59:0/1268893821 >> v1:172.21.15.59:6789/0 conn(0x7f5c4809e410 legacy=0x7f5c48130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.565+0000 7f5c4d0c1700 1 -- 172.21.15.59:0/1268893821 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4809b2d0 con 0x7f5c4809e000 2023-09-30T22:33:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.566+0000 7f5c4d0c1700 1 --2- 172.21.15.59:0/1268893821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4809e000 0x7f5c48130660 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800bb90 tx=0x7f5c3800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45931b2163690880 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.566+0000 7f5c4c8c0700 1 -- 172.21.15.59:0/1268893821 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800dd50 con 0x7f5c4809e000 2023-09-30T22:33:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.566+0000 7f5c4c8c0700 1 -- 172.21.15.59:0/1268893821 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c38010470 con 0x7f5c4809e000 2023-09-30T22:33:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.566+0000 7f5c4c8c0700 1 -- 172.21.15.59:0/1268893821 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38010800 con 0x7f5c4809e000 2023-09-30T22:33:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.567+0000 7f5c4fb26700 1 -- 172.21.15.59:0/1268893821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4809e000 msgr2=0x7f5c48130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.567+0000 7f5c4fb26700 1 --2- 172.21.15.59:0/1268893821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4809e000 0x7f5c48130660 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800bb90 tx=0x7f5c3800bea0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.567+0000 7f5c4fb26700 1 -- 172.21.15.59:0/1268893821 shutdown_connections 2023-09-30T22:33:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.567+0000 7f5c4fb26700 1 --2- 172.21.15.59:0/1268893821 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4809d6f0 0x7f5c4809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.567+0000 7f5c4fb26700 1 --2- 172.21.15.59:0/1268893821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4809e000 0x7f5c48130660 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.567+0000 7f5c4fb26700 1 -- 172.21.15.59:0/1268893821 >> 172.21.15.59:0/1268893821 conn(0x7f5c48066f50 msgr2=0x7f5c4809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:41.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.567+0000 7f5c4fb26700 1 -- 172.21.15.59:0/1268893821 shutdown_connections 2023-09-30T22:33:41.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.567+0000 7f5c4fb26700 1 -- 172.21.15.59:0/1268893821 wait complete. 2023-09-30T22:33:41.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.568+0000 7f5c4fb26700 1 Processor -- start 2023-09-30T22:33:41.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.568+0000 7f5c4fb26700 1 -- start start 2023-09-30T22:33:41.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.569+0000 7f5c4fb26700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4809d6f0 0x7f5c4811e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.569+0000 7f5c4fb26700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4809e000 0x7f5c4811e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.569+0000 7f5c4fb26700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4809e410 0x7f5c4811eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.569+0000 7f5c4fb26700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c48120510 con 0x7f5c4809d6f0 2023-09-30T22:33:41.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.569+0000 7f5c4fb26700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c481201f0 con 0x7f5c4809e410 2023-09-30T22:33:41.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.569+0000 7f5c4fb26700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480a1f00 con 0x7f5c4809e000 2023-09-30T22:33:41.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.569+0000 7f5c4d8c2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4809d6f0 0x7f5c4811e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.569+0000 7f5c4d8c2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4809d6f0 0x7f5c4811e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44928/0 (socket says 172.21.15.59:44928) 2023-09-30T22:33:41.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.569+0000 7f5c4d8c2700 1 -- 172.21.15.59:0/3586222983 learned_addr learned my addr 172.21.15.59:0/3586222983 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:41.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.569+0000 7f5c4d0c1700 1 --2- 172.21.15.59:0/3586222983 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4809e000 0x7f5c4811e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.569+0000 7f5c4e0c3700 1 --2- 172.21.15.59:0/3586222983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4809e410 0x7f5c4811eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.570+0000 7f5c4d0c1700 1 -- 172.21.15.59:0/3586222983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4809e410 msgr2=0x7f5c4811eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.570+0000 7f5c4d0c1700 1 --2- 172.21.15.59:0/3586222983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4809e410 0x7f5c4811eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.570+0000 7f5c4d0c1700 1 -- 172.21.15.59:0/3586222983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4809d6f0 msgr2=0x7f5c4811e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.570+0000 7f5c4d0c1700 1 --2- 172.21.15.59:0/3586222983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4809d6f0 0x7f5c4811e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.570+0000 7f5c4d0c1700 1 -- 172.21.15.59:0/3586222983 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3800b7f0 con 0x7f5c4809e000 2023-09-30T22:33:41.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.570+0000 7f5c4e0c3700 1 --2- 172.21.15.59:0/3586222983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4809e410 0x7f5c4811eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:41.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.570+0000 7f5c4d8c2700 1 --2- 172.21.15.59:0/3586222983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4809d6f0 0x7f5c4811e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:41.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.570+0000 7f5c4d0c1700 1 --2- 172.21.15.59:0/3586222983 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4809e000 0x7f5c4811e570 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5c38018000 tx=0x7f5c38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:41.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.570+0000 7f5c3e7fc700 1 -- 172.21.15.59:0/3586222983 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38003b70 con 0x7f5c4809e000 2023-09-30T22:33:41.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.570+0000 7f5c3e7fc700 1 -- 172.21.15.59:0/3586222983 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c38003cd0 con 0x7f5c4809e000 2023-09-30T22:33:41.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.570+0000 7f5c4fb26700 1 -- 172.21.15.59:0/3586222983 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c481212e0 con 0x7f5c4809e000 2023-09-30T22:33:41.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.570+0000 7f5c4fb26700 1 -- 172.21.15.59:0/3586222983 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c48121870 con 0x7f5c4809e000 2023-09-30T22:33:41.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.571+0000 7f5c3e7fc700 1 -- 172.21.15.59:0/3586222983 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38010800 con 0x7f5c4809e000 2023-09-30T22:33:41.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.571+0000 7f5c3e7fc700 1 -- 172.21.15.59:0/3586222983 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c38019400 con 0x7f5c4809e000 2023-09-30T22:33:41.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.572+0000 7f5c4fb26700 1 -- 172.21.15.59:0/3586222983 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c300052e0 con 0x7f5c4809e000 2023-09-30T22:33:41.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.572+0000 7f5c3e7fc700 1 -- 172.21.15.59:0/3586222983 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5c38041200 con 0x7f5c4809e000 2023-09-30T22:33:41.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.577+0000 7f5c3e7fc700 1 -- 172.21.15.59:0/3586222983 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c38003e40 con 0x7f5c4809e000 2023-09-30T22:33:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.641+0000 7f52eb9c1700 1 Processor -- start 2023-09-30T22:33:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.641+0000 7f52eb9c1700 1 -- start start 2023-09-30T22:33:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52eb9c1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52e4133a80 0x7f52e4133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52eb9c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e412ff20 0x7f52e4130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52eb9c1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f52e4130870 0x7f52e413a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52eb9c1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e406c570 con 0x7f52e4130870 2023-09-30T22:33:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52eb9c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e406bc00 con 0x7f52e412ff20 2023-09-30T22:33:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52eb9c1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40a0040 con 0x7f52e4133a80 2023-09-30T22:33:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52e8f5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e412ff20 0x7f52e4130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52e8f5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e412ff20 0x7f52e4130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48876/0 (socket says 172.21.15.59:48876) 2023-09-30T22:33:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52e8f5c700 1 -- 172.21.15.59:0/3199467006 learned_addr learned my addr 172.21.15.59:0/3199467006 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52e9f5e700 1 --2- 172.21.15.59:0/3199467006 >> v2:172.21.15.59:3300/0 conn(0x7f52e4130870 0x7f52e413a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52e9f5e700 1 -- 172.21.15.59:0/3199467006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52e4133a80 msgr2=0x7f52e4133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52e9f5e700 1 --2- 172.21.15.59:0/3199467006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52e4133a80 0x7f52e4133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52e9f5e700 1 -- 172.21.15.59:0/3199467006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e412ff20 msgr2=0x7f52e4130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52e9f5e700 1 --2- 172.21.15.59:0/3199467006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e412ff20 0x7f52e4130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52e9f5e700 1 -- 172.21.15.59:0/3199467006 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e4133860 con 0x7f52e4130870 2023-09-30T22:33:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.642+0000 7f52e8f5c700 1 --2- 172.21.15.59:0/3199467006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e412ff20 0x7f52e4130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.643+0000 7f52e9f5e700 1 --2- 172.21.15.59:0/3199467006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e4130870 0x7f52e413a840 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009d90 tx=0x7f52dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b51ea7bd0b40ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:41.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.643+0000 7f52dbfff700 1 -- 172.21.15.59:0/3199467006 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc00e070 con 0x7f52e4130870 2023-09-30T22:33:41.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.643+0000 7f52dbfff700 1 -- 172.21.15.59:0/3199467006 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc00bb20 con 0x7f52e4130870 2023-09-30T22:33:41.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.643+0000 7f52dbfff700 1 -- 172.21.15.59:0/3199467006 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc012430 con 0x7f52e4130870 2023-09-30T22:33:41.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.644+0000 7f52eb9c1700 1 -- 172.21.15.59:0/3199467006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e4130870 msgr2=0x7f52e413a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.644+0000 7f52eb9c1700 1 --2- 172.21.15.59:0/3199467006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e4130870 0x7f52e413a840 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009d90 tx=0x7f52dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:33:41.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.644+0000 7f52eb9c1700 1 -- 172.21.15.59:0/3199467006 shutdown_connections 2023-09-30T22:33:41.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.644+0000 7f52eb9c1700 1 --2- 172.21.15.59:0/3199467006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e4130870 0x7f52e413a840 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.644+0000 7f52eb9c1700 1 --2- 172.21.15.59:0/3199467006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52e4133a80 0x7f52e4133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.644+0000 7f52eb9c1700 1 --2- 172.21.15.59:0/3199467006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e412ff20 0x7f52e4130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.644+0000 7f52eb9c1700 1 -- 172.21.15.59:0/3199467006 >> 172.21.15.59:0/3199467006 conn(0x7f52e40a4210 msgr2=0x7f52e40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:41.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.644+0000 7f52eb9c1700 1 -- 172.21.15.59:0/3199467006 shutdown_connections 2023-09-30T22:33:41.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.644+0000 7f52eb9c1700 1 -- 172.21.15.59:0/3199467006 wait complete. 2023-09-30T22:33:41.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.645+0000 7f52eb9c1700 1 Processor -- start 2023-09-30T22:33:41.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.645+0000 7f52eb9c1700 1 -- start start 2023-09-30T22:33:41.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52eb9c1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e412ff20 0x7f52e409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52eb9c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e4130870 0x7f52e409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52eb9c1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52e4133a80 0x7f52e409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52eb9c1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e411fa90 con 0x7f52e412ff20 2023-09-30T22:33:41.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52eb9c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e412dc00 con 0x7f52e4130870 2023-09-30T22:33:41.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52eb9c1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52e409df00 con 0x7f52e4133a80 2023-09-30T22:33:41.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52e975d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e412ff20 0x7f52e409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52e975d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e412ff20 0x7f52e409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44950/0 (socket says 172.21.15.59:44950) 2023-09-30T22:33:41.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52e975d700 1 -- 172.21.15.59:0/2931218740 learned_addr learned my addr 172.21.15.59:0/2931218740 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:41.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52e8f5c700 1 --2- 172.21.15.59:0/2931218740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e4130870 0x7f52e409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52e9f5e700 1 --2- 172.21.15.59:0/2931218740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52e4133a80 0x7f52e409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52e975d700 1 -- 172.21.15.59:0/2931218740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52e4133a80 msgr2=0x7f52e409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52e975d700 1 --2- 172.21.15.59:0/2931218740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52e4133a80 0x7f52e409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52e975d700 1 -- 172.21.15.59:0/2931218740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e4130870 msgr2=0x7f52e409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52e975d700 1 --2- 172.21.15.59:0/2931218740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e4130870 0x7f52e409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.646+0000 7f52e975d700 1 -- 172.21.15.59:0/2931218740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d4009550 con 0x7f52e412ff20 2023-09-30T22:33:41.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.647+0000 7f52e975d700 1 --2- 172.21.15.59:0/2931218740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e412ff20 0x7f52e409c480 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f52e000b560 tx=0x7f52e000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:41.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.647+0000 7f52d9ffb700 1 -- 172.21.15.59:0/2931218740 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e0011830 con 0x7f52e412ff20 2023-09-30T22:33:41.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.647+0000 7f52eb9c1700 1 -- 172.21.15.59:0/2931218740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52dc009a70 con 0x7f52e412ff20 2023-09-30T22:33:41.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.647+0000 7f52d9ffb700 1 -- 172.21.15.59:0/2931218740 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e0011990 con 0x7f52e412ff20 2023-09-30T22:33:41.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.647+0000 7f52d9ffb700 1 -- 172.21.15.59:0/2931218740 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e0011d40 con 0x7f52e412ff20 2023-09-30T22:33:41.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.647+0000 7f52eb9c1700 1 -- 172.21.15.59:0/2931218740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e411ff80 con 0x7f52e412ff20 2023-09-30T22:33:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.648+0000 7f52d9ffb700 1 -- 172.21.15.59:0/2931218740 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52e001a400 con 0x7f52e412ff20 2023-09-30T22:33:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.648+0000 7f52d9ffb700 1 -- 172.21.15.59:0/2931218740 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f52e003f650 con 0x7f52e412ff20 2023-09-30T22:33:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.648+0000 7f52eb9c1700 1 -- 172.21.15.59:0/2931218740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e4074ea0 con 0x7f52e412ff20 2023-09-30T22:33:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.650+0000 7f93b5f60700 1 Processor -- start 2023-09-30T22:33:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.650+0000 7f93b5f60700 1 -- start start 2023-09-30T22:33:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.650+0000 7f93b5f60700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b0130410 0x7f93b01307e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.650+0000 7f93b5f60700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93b009e990 0x7f93b013b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.650+0000 7f93b5f60700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b0070700 con 0x7f93b009de50 2023-09-30T22:33:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.650+0000 7f93b5f60700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b0071f20 con 0x7f93b009e990 2023-09-30T22:33:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.650+0000 7f93b5f60700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b012ffe0 con 0x7f93b0130410 2023-09-30T22:33:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.651+0000 7f93aeffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f93b009de50 0x7f93b009e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35842/0 (socket says 172.21.15.59:35842) 2023-09-30T22:33:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.651+0000 7f93aeffd700 1 -- 172.21.15.59:0/3761542754 learned_addr learned my addr 172.21.15.59:0/3761542754 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.651+0000 7f93af7fe700 1 --2- 172.21.15.59:0/3761542754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b0130410 0x7f93b01307e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.651+0000 7f93affff700 1 --2- 172.21.15.59:0/3761542754 >> v2:172.21.15.59:3300/0 conn(0x7f93b009e990 0x7f93b013b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.652+0000 7f93affff700 1 -- 172.21.15.59:0/3761542754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b0130410 msgr2=0x7f93b01307e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.652+0000 7f93affff700 1 --2- 172.21.15.59:0/3761542754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b0130410 0x7f93b01307e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.652+0000 7f93affff700 1 -- 172.21.15.59:0/3761542754 >> v1:172.21.15.59:6789/0 conn(0x7f93b009de50 legacy=0x7f93b009e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.652+0000 7f93affff700 1 -- 172.21.15.59:0/3761542754 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b006f7f0 con 0x7f93b009e990 2023-09-30T22:33:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.652+0000 7f93affff700 1 --2- 172.21.15.59:0/3761542754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009e990 0x7f93b013b7e0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009d90 tx=0x7f93a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7838889db0e1b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:41.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.653+0000 7f93ae7fc700 1 -- 172.21.15.59:0/3761542754 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a800e070 con 0x7f93b009e990 2023-09-30T22:33:41.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.653+0000 7f93ae7fc700 1 -- 172.21.15.59:0/3761542754 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a800bb20 con 0x7f93b009e990 2023-09-30T22:33:41.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.653+0000 7f93ae7fc700 1 -- 172.21.15.59:0/3761542754 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8012430 con 0x7f93b009e990 2023-09-30T22:33:41.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.654+0000 7f52d9ffb700 1 -- 172.21.15.59:0/2931218740 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52e00193b0 con 0x7f52e412ff20 2023-09-30T22:33:41.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.654+0000 7f93b5f60700 1 -- 172.21.15.59:0/3761542754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009e990 msgr2=0x7f93b013b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.654+0000 7f93b5f60700 1 --2- 172.21.15.59:0/3761542754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009e990 0x7f93b013b7e0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009d90 tx=0x7f93a800b330 comp rx=0 tx=0).stop 2023-09-30T22:33:41.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.654+0000 7f93b5f60700 1 -- 172.21.15.59:0/3761542754 shutdown_connections 2023-09-30T22:33:41.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.654+0000 7f93b5f60700 1 --2- 172.21.15.59:0/3761542754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009e990 0x7f93b013b7e0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.654+0000 7f93b5f60700 1 --2- 172.21.15.59:0/3761542754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b0130410 0x7f93b01307e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.654+0000 7f93b5f60700 1 -- 172.21.15.59:0/3761542754 >> 172.21.15.59:0/3761542754 conn(0x7f93b00a2610 msgr2=0x7f93b00a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:41.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.655+0000 7f93b5f60700 1 -- 172.21.15.59:0/3761542754 shutdown_connections 2023-09-30T22:33:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.655+0000 7f93b5f60700 1 -- 172.21.15.59:0/3761542754 wait complete. 2023-09-30T22:33:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.656+0000 7f93b5f60700 1 Processor -- start 2023-09-30T22:33:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.656+0000 7f93b5f60700 1 -- start start 2023-09-30T22:33:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.656+0000 7f93b5f60700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b009de50 0x7f93b0121470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.656+0000 7f93b5f60700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009e990 0x7f93b01219b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.656+0000 7f93b5f60700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b0130410 0x7f93b0121ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.656+0000 7f93b5f60700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b006f390 con 0x7f93b009e990 2023-09-30T22:33:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.656+0000 7f93b5f60700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b009d5a0 con 0x7f93b0130410 2023-09-30T22:33:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.656+0000 7f93b5f60700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93b0123b30 con 0x7f93b009de50 2023-09-30T22:33:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.657+0000 7f93af7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b009de50 0x7f93b0121470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.657+0000 7f93af7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b009de50 0x7f93b0121470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52708/0 (socket says 172.21.15.59:52708) 2023-09-30T22:33:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.657+0000 7f93af7fe700 1 -- 172.21.15.59:0/1211484277 learned_addr learned my addr 172.21.15.59:0/1211484277 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.657+0000 7f93af7fe700 1 -- 172.21.15.59:0/1211484277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b0130410 msgr2=0x7f93b0121ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.657+0000 7f93af7fe700 1 --2- 172.21.15.59:0/1211484277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b0130410 0x7f93b0121ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.657+0000 7f93af7fe700 1 -- 172.21.15.59:0/1211484277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009e990 msgr2=0x7f93b01219b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.657+0000 7f93af7fe700 1 --2- 172.21.15.59:0/1211484277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009e990 0x7f93b01219b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.657+0000 7f93af7fe700 1 -- 172.21.15.59:0/1211484277 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a8009a70 con 0x7f93b009de50 2023-09-30T22:33:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.657+0000 7f93af7fe700 1 --2- 172.21.15.59:0/1211484277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b009de50 0x7f93b0121470 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f93a000e9b0 tx=0x7f93a000ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.658+0000 7f9397fff700 1 -- 172.21.15.59:0/1211484277 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a0009710 con 0x7f93b009de50 2023-09-30T22:33:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.658+0000 7f9397fff700 1 -- 172.21.15.59:0/1211484277 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a000c850 con 0x7f93b009de50 2023-09-30T22:33:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.658+0000 7f9397fff700 1 -- 172.21.15.59:0/1211484277 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a000cbc0 con 0x7f93b009de50 2023-09-30T22:33:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.658+0000 7f93b5f60700 1 -- 172.21.15.59:0/1211484277 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b00a2d50 con 0x7f93b009de50 2023-09-30T22:33:41.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.658+0000 7f93b5f60700 1 -- 172.21.15.59:0/1211484277 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b0122680 con 0x7f93b009de50 2023-09-30T22:33:41.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.659+0000 7f9397fff700 1 -- 172.21.15.59:0/1211484277 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93a000cd20 con 0x7f93b009de50 2023-09-30T22:33:41.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.659+0000 7f9397fff700 1 -- 172.21.15.59:0/1211484277 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f93a003fd10 con 0x7f93b009de50 2023-09-30T22:33:41.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.662+0000 7f93b5f60700 1 -- 172.21.15.59:0/1211484277 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b00747f0 con 0x7f93b009de50 2023-09-30T22:33:41.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.667+0000 7f9397fff700 1 -- 172.21.15.59:0/1211484277 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93a0017070 con 0x7f93b009de50 2023-09-30T22:33:41.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.702+0000 7f04e84f7700 1 Processor -- start 2023-09-30T22:33:41.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.702+0000 7f04e84f7700 1 -- start start 2023-09-30T22:33:41.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.703+0000 7f04e84f7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04e0136710 0x7f04e0138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.703+0000 7f04e84f7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04e0139030 0x7f04e013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.703+0000 7f04e84f7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e006ef30 con 0x7f04e01338a0 2023-09-30T22:33:41.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.703+0000 7f04e84f7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e006fef0 con 0x7f04e0136710 2023-09-30T22:33:41.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.703+0000 7f04e84f7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04e01334b0 con 0x7f04e0139030 2023-09-30T22:33:41.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.703+0000 7f04e6293700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f04e01338a0 0x7f04e0133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35858/0 (socket says 172.21.15.59:35858) 2023-09-30T22:33:41.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.703+0000 7f04e6293700 1 -- 172.21.15.59:0/634085590 learned_addr learned my addr 172.21.15.59:0/634085590 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:41.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.703+0000 7f04e5a92700 1 --2- 172.21.15.59:0/634085590 >> v2:172.21.15.59:3300/0 conn(0x7f04e0136710 0x7f04e0138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.704+0000 7f04e6a94700 1 --2- 172.21.15.59:0/634085590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04e0139030 0x7f04e013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.704+0000 7f04e5a92700 1 -- 172.21.15.59:0/634085590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04e0139030 msgr2=0x7f04e013b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:41.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.704+0000 7f04e5a92700 1 --2- 172.21.15.59:0/634085590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04e0139030 0x7f04e013b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.704+0000 7f04e5a92700 1 -- 172.21.15.59:0/634085590 >> v1:172.21.15.59:6789/0 conn(0x7f04e01338a0 legacy=0x7f04e0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.704+0000 7f04e5a92700 1 -- 172.21.15.59:0/634085590 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e006fc30 con 0x7f04e0136710 2023-09-30T22:33:41.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.704+0000 7f04e5a92700 1 --2- 172.21.15.59:0/634085590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04e0136710 0x7f04e0138af0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009840 tx=0x7f04d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835ee4090820d7e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:41.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.704+0000 7f04e5291700 1 -- 172.21.15.59:0/634085590 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0011830 con 0x7f04e0136710 2023-09-30T22:33:41.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.704+0000 7f04e5291700 1 -- 172.21.15.59:0/634085590 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d0011990 con 0x7f04e0136710 2023-09-30T22:33:41.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.704+0000 7f04e5291700 1 -- 172.21.15.59:0/634085590 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0011d20 con 0x7f04e0136710 2023-09-30T22:33:41.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.705+0000 7f04e84f7700 1 -- 172.21.15.59:0/634085590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04e0136710 msgr2=0x7f04e0138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.705+0000 7f04e84f7700 1 --2- 172.21.15.59:0/634085590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04e0136710 0x7f04e0138af0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009840 tx=0x7f04d0009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:41.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.705+0000 7f04e84f7700 1 -- 172.21.15.59:0/634085590 shutdown_connections 2023-09-30T22:33:41.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.705+0000 7f04e84f7700 1 --2- 172.21.15.59:0/634085590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04e0139030 0x7f04e013b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.705+0000 7f04e84f7700 1 --2- 172.21.15.59:0/634085590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04e0136710 0x7f04e0138af0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.705+0000 7f04e84f7700 1 -- 172.21.15.59:0/634085590 >> 172.21.15.59:0/634085590 conn(0x7f04e00a2aa0 msgr2=0x7f04e00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:41.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.706+0000 7f04e84f7700 1 -- 172.21.15.59:0/634085590 shutdown_connections 2023-09-30T22:33:41.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.706+0000 7f04e84f7700 1 -- 172.21.15.59:0/634085590 wait complete. 2023-09-30T22:33:41.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.707+0000 7f04e84f7700 1 Processor -- start 2023-09-30T22:33:41.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.707+0000 7f04e84f7700 1 -- start start 2023-09-30T22:33:41.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.708+0000 7f04e84f7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04e01338a0 0x7f04e011add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.708+0000 7f04e84f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e0136710 0x7f04e011b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.708+0000 7f04e84f7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04e0139030 0x7f04e011b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:41.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.708+0000 7f04e84f7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e011d3e0 con 0x7f04e01338a0 2023-09-30T22:33:41.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.708+0000 7f04e84f7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e0130c20 con 0x7f04e0136710 2023-09-30T22:33:41.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.708+0000 7f04e84f7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04e011cac0 con 0x7f04e0139030 2023-09-30T22:33:41.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.708+0000 7f04e6a94700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04e0139030 0x7f04e011b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.708+0000 7f04e6a94700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04e0139030 0x7f04e011b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52722/0 (socket says 172.21.15.59:52722) 2023-09-30T22:33:41.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.708+0000 7f04e6a94700 1 -- 172.21.15.59:0/1569230393 learned_addr learned my addr 172.21.15.59:0/1569230393 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:41.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.708+0000 7f04e5a92700 1 --2- 172.21.15.59:0/1569230393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e0136710 0x7f04e011b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.708+0000 7f04e6293700 1 --2- 172.21.15.59:0/1569230393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04e01338a0 0x7f04e011add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:41.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.709+0000 7f04e5a92700 1 -- 172.21.15.59:0/1569230393 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04e0139030 msgr2=0x7f04e011b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.709+0000 7f04e5a92700 1 --2- 172.21.15.59:0/1569230393 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04e0139030 0x7f04e011b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.709+0000 7f04e5a92700 1 -- 172.21.15.59:0/1569230393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04e01338a0 msgr2=0x7f04e011add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.709+0000 7f04e5a92700 1 --2- 172.21.15.59:0/1569230393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04e01338a0 0x7f04e011add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.709+0000 7f04e5a92700 1 -- 172.21.15.59:0/1569230393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d00094a0 con 0x7f04e0136710 2023-09-30T22:33:41.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.709+0000 7f04e5a92700 1 --2- 172.21.15.59:0/1569230393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e0136710 0x7f04e011b310 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f04d0016000 tx=0x7f04d0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:41.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.709+0000 7f04d6ffd700 1 -- 172.21.15.59:0/1569230393 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d00036a0 con 0x7f04e0136710 2023-09-30T22:33:41.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.709+0000 7f04d6ffd700 1 -- 172.21.15.59:0/1569230393 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d001f070 con 0x7f04e0136710 2023-09-30T22:33:41.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.709+0000 7f04e84f7700 1 -- 172.21.15.59:0/1569230393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e011e850 con 0x7f04e0136710 2023-09-30T22:33:41.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.709+0000 7f04d6ffd700 1 -- 172.21.15.59:0/1569230393 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0003a40 con 0x7f04e0136710 2023-09-30T22:33:41.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.709+0000 7f04e84f7700 1 -- 172.21.15.59:0/1569230393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e011e570 con 0x7f04e0136710 2023-09-30T22:33:41.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.711+0000 7f04e84f7700 1 -- 172.21.15.59:0/1569230393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e0074ea0 con 0x7f04e0136710 2023-09-30T22:33:41.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.712+0000 7f04d6ffd700 1 -- 172.21.15.59:0/1569230393 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04d0003ba0 con 0x7f04e0136710 2023-09-30T22:33:41.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.713+0000 7f04d6ffd700 1 -- 172.21.15.59:0/1569230393 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f04d0021070 con 0x7f04e0136710 2023-09-30T22:33:41.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.721+0000 7f04d6ffd700 1 -- 172.21.15.59:0/1569230393 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04d002f3a0 con 0x7f04e0136710 2023-09-30T22:33:41.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.810+0000 7f5c4fb26700 1 -- 172.21.15.59:0/3586222983 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5c30005590 con 0x7f5c4809e000 2023-09-30T22:33:41.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.810+0000 7f5c3e7fc700 1 -- 172.21.15.59:0/3586222983 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c3802b340 con 0x7f5c4809e000 2023-09-30T22:33:41.811 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:41.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.813+0000 7f5c4fb26700 1 -- 172.21.15.59:0/3586222983 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4809e000 msgr2=0x7f5c4811e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.813+0000 7f5c4fb26700 1 --2- 172.21.15.59:0/3586222983 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4809e000 0x7f5c4811e570 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5c38018000 tx=0x7f5c38004750 comp rx=0 tx=0).stop 2023-09-30T22:33:41.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.813+0000 7f5c4fb26700 1 -- 172.21.15.59:0/3586222983 shutdown_connections 2023-09-30T22:33:41.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.813+0000 7f5c4fb26700 1 --2- 172.21.15.59:0/3586222983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c4809e410 0x7f5c4811eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.813+0000 7f5c4fb26700 1 --2- 172.21.15.59:0/3586222983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4809d6f0 0x7f5c4811e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.813+0000 7f5c4fb26700 1 --2- 172.21.15.59:0/3586222983 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5c4809e000 0x7f5c4811e570 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.813+0000 7f5c4fb26700 1 -- 172.21.15.59:0/3586222983 >> 172.21.15.59:0/3586222983 conn(0x7f5c48066f50 msgr2=0x7f5c480a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:41.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.813+0000 7f5c4fb26700 1 -- 172.21.15.59:0/3586222983 shutdown_connections 2023-09-30T22:33:41.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.813+0000 7f5c4fb26700 1 -- 172.21.15.59:0/3586222983 wait complete. 2023-09-30T22:33:41.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:41.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.878+0000 7f93b5f60700 1 -- 172.21.15.59:0/1211484277 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f93b006fa10 con 0x7f93b009de50 2023-09-30T22:33:41.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.878+0000 7f9397fff700 1 -- 172.21.15.59:0/1211484277 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f93a001b3b0 con 0x7f93b009de50 2023-09-30T22:33:41.879 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:41.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.881+0000 7f93b5f60700 1 -- 172.21.15.59:0/1211484277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b009de50 msgr2=0x7f93b0121470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.881+0000 7f93b5f60700 1 --2- 172.21.15.59:0/1211484277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b009de50 0x7f93b0121470 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f93a000e9b0 tx=0x7f93a000ed70 comp rx=0 tx=0).stop 2023-09-30T22:33:41.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.881+0000 7f93b5f60700 1 -- 172.21.15.59:0/1211484277 shutdown_connections 2023-09-30T22:33:41.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.881+0000 7f93b5f60700 1 --2- 172.21.15.59:0/1211484277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b009de50 0x7f93b0121470 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.881+0000 7f93b5f60700 1 --2- 172.21.15.59:0/1211484277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b0130410 0x7f93b0121ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.881+0000 7f93b5f60700 1 --2- 172.21.15.59:0/1211484277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009e990 0x7f93b01219b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.881+0000 7f93b5f60700 1 -- 172.21.15.59:0/1211484277 >> 172.21.15.59:0/1211484277 conn(0x7f93b00a2610 msgr2=0x7f93b00a12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:41.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.881+0000 7f93b5f60700 1 -- 172.21.15.59:0/1211484277 shutdown_connections 2023-09-30T22:33:41.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.881+0000 7f93b5f60700 1 -- 172.21.15.59:0/1211484277 wait complete. 2023-09-30T22:33:41.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.887+0000 7f52eb9c1700 1 -- 172.21.15.59:0/2931218740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f52e406b250 con 0x7f52e412ff20 2023-09-30T22:33:41.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.887+0000 7f52d9ffb700 1 -- 172.21.15.59:0/2931218740 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52e000f2e0 con 0x7f52e412ff20 2023-09-30T22:33:41.888 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:41.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.890+0000 7f52eb9c1700 1 -- 172.21.15.59:0/2931218740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e412ff20 msgr2=0x7f52e409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.890+0000 7f52eb9c1700 1 --2- 172.21.15.59:0/2931218740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e412ff20 0x7f52e409c480 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f52e000b560 tx=0x7f52e000b870 comp rx=0 tx=0).stop 2023-09-30T22:33:41.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.890+0000 7f52eb9c1700 1 -- 172.21.15.59:0/2931218740 shutdown_connections 2023-09-30T22:33:41.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.890+0000 7f52eb9c1700 1 --2- 172.21.15.59:0/2931218740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52e4133a80 0x7f52e409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.890+0000 7f52eb9c1700 1 --2- 172.21.15.59:0/2931218740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e412ff20 0x7f52e409c480 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.890+0000 7f52eb9c1700 1 --2- 172.21.15.59:0/2931218740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e4130870 0x7f52e409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.890+0000 7f52eb9c1700 1 -- 172.21.15.59:0/2931218740 >> 172.21.15.59:0/2931218740 conn(0x7f52e40a4210 msgr2=0x7f52e409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:41.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.890+0000 7f52eb9c1700 1 -- 172.21.15.59:0/2931218740 shutdown_connections 2023-09-30T22:33:41.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.890+0000 7f52eb9c1700 1 -- 172.21.15.59:0/2931218740 wait complete. 2023-09-30T22:33:41.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:41.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:41.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.945+0000 7f04e84f7700 1 -- 172.21.15.59:0/1569230393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f04e011e210 con 0x7f04e0136710 2023-09-30T22:33:41.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.946+0000 7f04d6ffd700 1 -- 172.21.15.59:0/1569230393 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04d002b030 con 0x7f04e0136710 2023-09-30T22:33:41.946 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:41.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.948+0000 7f04e84f7700 1 -- 172.21.15.59:0/1569230393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e0136710 msgr2=0x7f04e011b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.948+0000 7f04e84f7700 1 --2- 172.21.15.59:0/1569230393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e0136710 0x7f04e011b310 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f04d0016000 tx=0x7f04d0004750 comp rx=0 tx=0).stop 2023-09-30T22:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.948+0000 7f04e84f7700 1 -- 172.21.15.59:0/1569230393 shutdown_connections 2023-09-30T22:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.948+0000 7f04e84f7700 1 --2- 172.21.15.59:0/1569230393 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04e0139030 0x7f04e011b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.948+0000 7f04e84f7700 1 --2- 172.21.15.59:0/1569230393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04e01338a0 0x7f04e011add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.948+0000 7f04e84f7700 1 --2- 172.21.15.59:0/1569230393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e0136710 0x7f04e011b310 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.948+0000 7f04e84f7700 1 -- 172.21.15.59:0/1569230393 >> 172.21.15.59:0/1569230393 conn(0x7f04e00a2aa0 msgr2=0x7f04e01344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.948+0000 7f04e84f7700 1 -- 172.21.15.59:0/1569230393 shutdown_connections 2023-09-30T22:33:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:41.948+0000 7f04e84f7700 1 -- 172.21.15.59:0/1569230393 wait complete. 2023-09-30T22:33:41.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:42.828 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:42.897 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:42.905 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:42.962 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.979+0000 7eff9aa4b700 1 Processor -- start 2023-09-30T22:33:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.979+0000 7eff9aa4b700 1 -- start start 2023-09-30T22:33:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.979+0000 7eff9aa4b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff9409d6f0 0x7eff9409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff9aa4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff9409e000 0x7eff94130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff9aa4b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff9409e410 0x7eff94130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff9aa4b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9409f520 con 0x7eff9409d6f0 2023-09-30T22:33:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff9aa4b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9409f130 con 0x7eff9409e410 2023-09-30T22:33:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff9aa4b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff9409e930 con 0x7eff9409e000 2023-09-30T22:33:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff93fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff9409d6f0 0x7eff9409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff937fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff9409e000 0x7eff94130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff98fe8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff9409e410 0x7eff94130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff93fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff9409d6f0 0x7eff9409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45004/0 (socket says 172.21.15.59:45004) 2023-09-30T22:33:42.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff93fff700 1 -- 172.21.15.59:0/3335476920 learned_addr learned my addr 172.21.15.59:0/3335476920 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:42.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff937fe700 1 -- 172.21.15.59:0/3335476920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff9409e410 msgr2=0x7eff94130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:42.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff937fe700 1 --2- 172.21.15.59:0/3335476920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff9409e410 0x7eff94130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:42.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff937fe700 1 -- 172.21.15.59:0/3335476920 >> v2:172.21.15.59:3300/0 conn(0x7eff9409d6f0 msgr2=0x7eff9409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:42.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff937fe700 1 --2- 172.21.15.59:0/3335476920 >> v2:172.21.15.59:3300/0 conn(0x7eff9409d6f0 0x7eff9409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:42.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff937fe700 1 -- 172.21.15.59:0/3335476920 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9409b2d0 con 0x7eff9409e000 2023-09-30T22:33:42.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff93fff700 1 --2- 172.21.15.59:0/3335476920 >> v2:172.21.15.59:3300/0 conn(0x7eff9409d6f0 0x7eff9409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:42.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.980+0000 7eff937fe700 1 --2- 172.21.15.59:0/3335476920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff9409e000 0x7eff94130660 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7eff88009870 tx=0x7eff88009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c76d7471283cd8b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:42.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.981+0000 7eff92ffd700 1 -- 172.21.15.59:0/3335476920 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88011830 con 0x7eff9409e000 2023-09-30T22:33:42.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.981+0000 7eff92ffd700 1 -- 172.21.15.59:0/3335476920 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff88011990 con 0x7eff9409e000 2023-09-30T22:33:42.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.981+0000 7eff92ffd700 1 -- 172.21.15.59:0/3335476920 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88011d20 con 0x7eff9409e000 2023-09-30T22:33:42.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.982+0000 7eff9aa4b700 1 -- 172.21.15.59:0/3335476920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff9409e000 msgr2=0x7eff94130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:42.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.982+0000 7eff9aa4b700 1 --2- 172.21.15.59:0/3335476920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff9409e000 0x7eff94130660 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7eff88009870 tx=0x7eff88009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:42.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.982+0000 7eff9aa4b700 1 -- 172.21.15.59:0/3335476920 shutdown_connections 2023-09-30T22:33:42.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.982+0000 7eff9aa4b700 1 --2- 172.21.15.59:0/3335476920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff9409e410 0x7eff94130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:42.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.982+0000 7eff9aa4b700 1 --2- 172.21.15.59:0/3335476920 >> v2:172.21.15.59:3300/0 conn(0x7eff9409d6f0 0x7eff9409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:42.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.982+0000 7eff9aa4b700 1 --2- 172.21.15.59:0/3335476920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff9409e000 0x7eff94130660 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:42.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.982+0000 7eff9aa4b700 1 -- 172.21.15.59:0/3335476920 >> 172.21.15.59:0/3335476920 conn(0x7eff94066f50 msgr2=0x7eff9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:42.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.982+0000 7eff9aa4b700 1 -- 172.21.15.59:0/3335476920 shutdown_connections 2023-09-30T22:33:42.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.982+0000 7eff9aa4b700 1 -- 172.21.15.59:0/3335476920 wait complete. 2023-09-30T22:33:42.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.983+0000 7eff9aa4b700 1 Processor -- start 2023-09-30T22:33:42.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.983+0000 7eff9aa4b700 1 -- start start 2023-09-30T22:33:42.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.984+0000 7eff9aa4b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff9409d6f0 0x7eff9411df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:42.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.984+0000 7eff9aa4b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff9409e000 0x7eff9411e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:42.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.984+0000 7eff9aa4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff9409e410 0x7eff9411e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:42.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.984+0000 7eff9aa4b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9411f3a0 con 0x7eff9409e000 2023-09-30T22:33:42.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.984+0000 7eff9aa4b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff94120130 con 0x7eff9409d6f0 2023-09-30T22:33:42.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.984+0000 7eff9aa4b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff941211f0 con 0x7eff9409e410 2023-09-30T22:33:42.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.984+0000 7eff93fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff9409d6f0 0x7eff9411df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:42.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.984+0000 7eff937fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff9409e000 0x7eff9411e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:42.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.984+0000 7eff93fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff9409d6f0 0x7eff9411df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48902/0 (socket says 172.21.15.59:48902) 2023-09-30T22:33:42.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.984+0000 7eff93fff700 1 -- 172.21.15.59:0/3840293007 learned_addr learned my addr 172.21.15.59:0/3840293007 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:42.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.985+0000 7eff937fe700 1 -- 172.21.15.59:0/3840293007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff9409e410 msgr2=0x7eff9411e9c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:33:42.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.985+0000 7eff937fe700 1 --2- 172.21.15.59:0/3840293007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff9409e410 0x7eff9411e9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:42.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.985+0000 7eff937fe700 1 -- 172.21.15.59:0/3840293007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff9409d6f0 msgr2=0x7eff9411df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:42.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.985+0000 7eff937fe700 1 --2- 172.21.15.59:0/3840293007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff9409d6f0 0x7eff9411df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:42.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.985+0000 7eff937fe700 1 -- 172.21.15.59:0/3840293007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8400b7f0 con 0x7eff9409e000 2023-09-30T22:33:42.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.985+0000 7eff937fe700 1 --2- 172.21.15.59:0/3840293007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff9409e000 0x7eff9411e480 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7eff9409f6f0 tx=0x7eff88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:42.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.985+0000 7eff90ff9700 1 -- 172.21.15.59:0/3840293007 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88004450 con 0x7eff9409e000 2023-09-30T22:33:42.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.985+0000 7eff90ff9700 1 -- 172.21.15.59:0/3840293007 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff88023070 con 0x7eff9409e000 2023-09-30T22:33:42.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.985+0000 7eff90ff9700 1 -- 172.21.15.59:0/3840293007 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8801fa40 con 0x7eff9409e000 2023-09-30T22:33:42.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.985+0000 7eff9aa4b700 1 -- 172.21.15.59:0/3840293007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff880094a0 con 0x7eff9409e000 2023-09-30T22:33:42.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.985+0000 7eff9aa4b700 1 -- 172.21.15.59:0/3840293007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9409c750 con 0x7eff9409e000 2023-09-30T22:33:42.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.986+0000 7eff90ff9700 1 -- 172.21.15.59:0/3840293007 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff8801fba0 con 0x7eff9409e000 2023-09-30T22:33:42.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.987+0000 7eff90ff9700 1 -- 172.21.15.59:0/3840293007 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7eff88025070 con 0x7eff9409e000 2023-09-30T22:33:42.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.987+0000 7eff9aa4b700 1 -- 172.21.15.59:0/3840293007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9411ac20 con 0x7eff9409e000 2023-09-30T22:33:42.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:42.993+0000 7eff90ff9700 1 -- 172.21.15.59:0/3840293007 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff8802f080 con 0x7eff9409e000 2023-09-30T22:33:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.058+0000 7f83092d1700 1 Processor -- start 2023-09-30T22:33:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.058+0000 7f83092d1700 1 -- start start 2023-09-30T22:33:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.059+0000 7f83092d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8304136830 0x7f8304138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.059+0000 7f83092d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8304139150 0x7f830413b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.059+0000 7f83092d1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830406f720 con 0x7f83041338c0 2023-09-30T22:33:43.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.059+0000 7f83092d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8304070c80 con 0x7f8304139150 2023-09-30T22:33:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.059+0000 7f83092d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f830406fce0 con 0x7f8304136830 2023-09-30T22:33:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.060+0000 7f8302ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f83041338c0 0x7f8304133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35870/0 (socket says 172.21.15.59:35870) 2023-09-30T22:33:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.060+0000 7f8302ffd700 1 -- 172.21.15.59:0/75182536 learned_addr learned my addr 172.21.15.59:0/75182536 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.060+0000 7f83037fe700 1 --2- 172.21.15.59:0/75182536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8304139150 0x7f830413b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.060+0000 7f83027fc700 1 --2- 172.21.15.59:0/75182536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8304136830 0x7f8304138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.060+0000 7f83037fe700 1 -- 172.21.15.59:0/75182536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8304136830 msgr2=0x7f8304138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.060+0000 7f83037fe700 1 --2- 172.21.15.59:0/75182536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8304136830 0x7f8304138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.060+0000 7f8301ffb700 1 -- 172.21.15.59:0/75182536 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264247497 0 0) 0x7f830406f720 con 0x7f83041338c0 2023-09-30T22:33:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.060+0000 7f83037fe700 1 -- 172.21.15.59:0/75182536 >> v1:172.21.15.59:6789/0 conn(0x7f83041338c0 legacy=0x7f8304133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.060+0000 7f83037fe700 1 -- 172.21.15.59:0/75182536 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83041336a0 con 0x7f8304139150 2023-09-30T22:33:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.060+0000 7f83037fe700 1 --2- 172.21.15.59:0/75182536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8304139150 0x7f830413b530 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009dc0 tx=0x7f82fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cac9d521e66b6254 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.061+0000 7f8301ffb700 1 -- 172.21.15.59:0/75182536 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc00e070 con 0x7f8304139150 2023-09-30T22:33:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.061+0000 7f8301ffb700 1 -- 172.21.15.59:0/75182536 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82fc00bb20 con 0x7f8304139150 2023-09-30T22:33:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.061+0000 7f8301ffb700 1 -- 172.21.15.59:0/75182536 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc012430 con 0x7f8304139150 2023-09-30T22:33:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.062+0000 7f83092d1700 1 -- 172.21.15.59:0/75182536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8304139150 msgr2=0x7f830413b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.062+0000 7f83092d1700 1 --2- 172.21.15.59:0/75182536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8304139150 0x7f830413b530 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009dc0 tx=0x7f82fc00b330 comp rx=0 tx=0).stop 2023-09-30T22:33:43.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.062+0000 7f83092d1700 1 -- 172.21.15.59:0/75182536 shutdown_connections 2023-09-30T22:33:43.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.062+0000 7f83092d1700 1 --2- 172.21.15.59:0/75182536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8304139150 0x7f830413b530 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.062+0000 7f83092d1700 1 --2- 172.21.15.59:0/75182536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8304136830 0x7f8304138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.062+0000 7f83092d1700 1 -- 172.21.15.59:0/75182536 >> 172.21.15.59:0/75182536 conn(0x7f83040a2aa0 msgr2=0x7f83040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:43.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.062+0000 7f83092d1700 1 -- 172.21.15.59:0/75182536 shutdown_connections 2023-09-30T22:33:43.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.062+0000 7f83092d1700 1 -- 172.21.15.59:0/75182536 wait complete. 2023-09-30T22:33:43.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.063+0000 7f83092d1700 1 Processor -- start 2023-09-30T22:33:43.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.063+0000 7f83092d1700 1 -- start start 2023-09-30T22:33:43.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f83092d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83041338c0 0x7f8304119b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f83092d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8304136830 0x7f830411a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f83092d1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8304139150 0x7f830411a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f83092d1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830411d670 con 0x7f8304139150 2023-09-30T22:33:43.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f83092d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830411ca20 con 0x7f83041338c0 2023-09-30T22:33:43.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f83092d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f830411b800 con 0x7f8304136830 2023-09-30T22:33:43.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f83037fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8304139150 0x7f830411a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f83037fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8304139150 0x7f830411a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45016/0 (socket says 172.21.15.59:45016) 2023-09-30T22:33:43.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f83037fe700 1 -- 172.21.15.59:0/3397564727 learned_addr learned my addr 172.21.15.59:0/3397564727 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:43.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f8302ffd700 1 --2- 172.21.15.59:0/3397564727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83041338c0 0x7f8304119b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f83027fc700 1 --2- 172.21.15.59:0/3397564727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8304136830 0x7f830411a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f8302ffd700 1 -- 172.21.15.59:0/3397564727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8304136830 msgr2=0x7f830411a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:43.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f8302ffd700 1 --2- 172.21.15.59:0/3397564727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8304136830 0x7f830411a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f8302ffd700 1 -- 172.21.15.59:0/3397564727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8304139150 msgr2=0x7f830411a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:43.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f8302ffd700 1 --2- 172.21.15.59:0/3397564727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8304139150 0x7f830411a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.064+0000 7f8302ffd700 1 -- 172.21.15.59:0/3397564727 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc009a70 con 0x7f83041338c0 2023-09-30T22:33:43.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.065+0000 7f83037fe700 1 --2- 172.21.15.59:0/3397564727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8304139150 0x7f830411a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:43.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.065+0000 7f8302ffd700 1 --2- 172.21.15.59:0/3397564727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83041338c0 0x7f8304119b50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f82f400c470 tx=0x7f82f400c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:43.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.065+0000 7f82eb7fe700 1 -- 172.21.15.59:0/3397564727 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f4004c80 con 0x7f83041338c0 2023-09-30T22:33:43.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.065+0000 7f82eb7fe700 1 -- 172.21.15.59:0/3397564727 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f4004de0 con 0x7f83041338c0 2023-09-30T22:33:43.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.065+0000 7f83092d1700 1 -- 172.21.15.59:0/3397564727 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8304130000 con 0x7f83041338c0 2023-09-30T22:33:43.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.065+0000 7f82eb7fe700 1 -- 172.21.15.59:0/3397564727 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f4007310 con 0x7f83041338c0 2023-09-30T22:33:43.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.065+0000 7f83092d1700 1 -- 172.21.15.59:0/3397564727 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830411c560 con 0x7f83041338c0 2023-09-30T22:33:43.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.066+0000 7f82eb7fe700 1 -- 172.21.15.59:0/3397564727 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82f4007470 con 0x7f83041338c0 2023-09-30T22:33:43.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.066+0000 7f83092d1700 1 -- 172.21.15.59:0/3397564727 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830411d2f0 con 0x7f83041338c0 2023-09-30T22:33:43.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.066+0000 7f82eb7fe700 1 -- 172.21.15.59:0/3397564727 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f82f4040be0 con 0x7f83041338c0 2023-09-30T22:33:43.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.071+0000 7f82eb7fe700 1 -- 172.21.15.59:0/3397564727 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f830411d2f0 con 0x7f83041338c0 2023-09-30T22:33:43.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.097+0000 7f9d54bf4700 1 Processor -- start 2023-09-30T22:33:43.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.097+0000 7f9d54bf4700 1 -- start start 2023-09-30T22:33:43.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.098+0000 7f9d54bf4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9d5009d6f0 0x7f9d5009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.098+0000 7f9d54bf4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d5009e440 0x7f9d50134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.098+0000 7f9d54bf4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5009b120 con 0x7f9d5009e000 2023-09-30T22:33:43.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.098+0000 7f9d54bf4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5006b460 con 0x7f9d5009d6f0 2023-09-30T22:33:43.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.098+0000 7f9d54bf4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5009a7e0 con 0x7f9d5009e440 2023-09-30T22:33:43.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.099+0000 7f9d4dd9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9d5009e000 0x7f9d501339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35886/0 (socket says 172.21.15.59:35886) 2023-09-30T22:33:43.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.099+0000 7f9d4dd9b700 1 -- 172.21.15.59:0/2509016231 learned_addr learned my addr 172.21.15.59:0/2509016231 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:43.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.099+0000 7f9d4e59c700 1 --2- 172.21.15.59:0/2509016231 >> v2:172.21.15.59:3300/0 conn(0x7f9d5009d6f0 0x7f9d5009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.099+0000 7f9d4ed9d700 1 --2- 172.21.15.59:0/2509016231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d5009e440 0x7f9d50134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.099+0000 7f9d4d59a700 1 -- 172.21.15.59:0/2509016231 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260377172 0 0) 0x7f9d5009b120 con 0x7f9d5009e000 2023-09-30T22:33:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.099+0000 7f9d4d59a700 1 -- 172.21.15.59:0/2509016231 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d380035b0 con 0x7f9d5009e000 2023-09-30T22:33:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.099+0000 7f9d4e59c700 1 -- 172.21.15.59:0/2509016231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d5009e440 msgr2=0x7f9d50134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.099+0000 7f9d4e59c700 1 --2- 172.21.15.59:0/2509016231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d5009e440 0x7f9d50134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.099+0000 7f9d4e59c700 1 -- 172.21.15.59:0/2509016231 >> v1:172.21.15.59:6789/0 conn(0x7f9d5009e000 legacy=0x7f9d501339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.099+0000 7f9d4e59c700 1 -- 172.21.15.59:0/2509016231 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5009a500 con 0x7f9d5009d6f0 2023-09-30T22:33:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.100+0000 7f9d4e59c700 1 --2- 172.21.15.59:0/2509016231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d5009d6f0 0x7f9d5009dac0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009870 tx=0x7f9d40009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57785f77e1d16f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.100+0000 7f9d4d59a700 1 -- 172.21.15.59:0/2509016231 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40011830 con 0x7f9d5009d6f0 2023-09-30T22:33:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.100+0000 7f9d4d59a700 1 -- 172.21.15.59:0/2509016231 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d40011990 con 0x7f9d5009d6f0 2023-09-30T22:33:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.100+0000 7f9d4d59a700 1 -- 172.21.15.59:0/2509016231 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40011d00 con 0x7f9d5009d6f0 2023-09-30T22:33:43.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.101+0000 7f9d54bf4700 1 -- 172.21.15.59:0/2509016231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d5009d6f0 msgr2=0x7f9d5009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:43.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.101+0000 7f9d54bf4700 1 --2- 172.21.15.59:0/2509016231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d5009d6f0 0x7f9d5009dac0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009870 tx=0x7f9d40009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:43.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.101+0000 7f9d54bf4700 1 -- 172.21.15.59:0/2509016231 shutdown_connections 2023-09-30T22:33:43.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.101+0000 7f9d54bf4700 1 --2- 172.21.15.59:0/2509016231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d5009d6f0 0x7f9d5009dac0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.101+0000 7f9d54bf4700 1 --2- 172.21.15.59:0/2509016231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d5009e440 0x7f9d50134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.101+0000 7f9d54bf4700 1 -- 172.21.15.59:0/2509016231 >> 172.21.15.59:0/2509016231 conn(0x7f9d50066f50 msgr2=0x7f9d5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:43.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.101+0000 7f9d54bf4700 1 -- 172.21.15.59:0/2509016231 shutdown_connections 2023-09-30T22:33:43.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.101+0000 7f9d54bf4700 1 -- 172.21.15.59:0/2509016231 wait complete. 2023-09-30T22:33:43.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.103+0000 7f9d54bf4700 1 Processor -- start 2023-09-30T22:33:43.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.103+0000 7f9d54bf4700 1 -- start start 2023-09-30T22:33:43.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d54bf4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d5009d6f0 0x7f9d501a5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d54bf4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d5009e000 0x7f9d501a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d54bf4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d5009e440 0x7f9d501c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d54bf4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d501a75a0 con 0x7f9d5009d6f0 2023-09-30T22:33:43.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d54bf4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d501a8530 con 0x7f9d5009e440 2023-09-30T22:33:43.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d54bf4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d501a4fb0 con 0x7f9d5009e000 2023-09-30T22:33:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d4e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d5009d6f0 0x7f9d501a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d4e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d5009d6f0 0x7f9d501a5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45034/0 (socket says 172.21.15.59:45034) 2023-09-30T22:33:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d4e59c700 1 -- 172.21.15.59:0/656409243 learned_addr learned my addr 172.21.15.59:0/656409243 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d4ed9d700 1 --2- 172.21.15.59:0/656409243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d5009e440 0x7f9d501c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d4dd9b700 1 --2- 172.21.15.59:0/656409243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d5009e000 0x7f9d501a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d4e59c700 1 -- 172.21.15.59:0/656409243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d5009e000 msgr2=0x7f9d501a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d4e59c700 1 --2- 172.21.15.59:0/656409243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d5009e000 0x7f9d501a59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d4e59c700 1 -- 172.21.15.59:0/656409243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d5009e440 msgr2=0x7f9d501c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d4e59c700 1 --2- 172.21.15.59:0/656409243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d5009e440 0x7f9d501c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d4e59c700 1 -- 172.21.15.59:0/656409243 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d400094a0 con 0x7f9d5009d6f0 2023-09-30T22:33:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.104+0000 7f9d4ed9d700 1 --2- 172.21.15.59:0/656409243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d5009e440 0x7f9d501c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.105+0000 7f9d4e59c700 1 --2- 172.21.15.59:0/656409243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d5009d6f0 0x7f9d501a5470 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f9d400090b0 tx=0x7f9d40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.105+0000 7f9d3effd700 1 -- 172.21.15.59:0/656409243 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d400036a0 con 0x7f9d5009d6f0 2023-09-30T22:33:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.105+0000 7f9d3effd700 1 -- 172.21.15.59:0/656409243 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4001f070 con 0x7f9d5009d6f0 2023-09-30T22:33:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.105+0000 7f9d3effd700 1 -- 172.21.15.59:0/656409243 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40003a60 con 0x7f9d5009d6f0 2023-09-30T22:33:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.105+0000 7f9d54bf4700 1 -- 172.21.15.59:0/656409243 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d501b93a0 con 0x7f9d5009d6f0 2023-09-30T22:33:43.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.106+0000 7f9d54bf4700 1 -- 172.21.15.59:0/656409243 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5009c710 con 0x7f9d5009d6f0 2023-09-30T22:33:43.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.107+0000 7f9d54bf4700 1 -- 172.21.15.59:0/656409243 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d501a7ef0 con 0x7f9d5009d6f0 2023-09-30T22:33:43.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.107+0000 7f9d3effd700 1 -- 172.21.15.59:0/656409243 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d40003bc0 con 0x7f9d5009d6f0 2023-09-30T22:33:43.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.107+0000 7f9d3effd700 1 -- 172.21.15.59:0/656409243 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9d40021070 con 0x7f9d5009d6f0 2023-09-30T22:33:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.116+0000 7f9d3effd700 1 -- 172.21.15.59:0/656409243 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d40010380 con 0x7f9d5009d6f0 2023-09-30T22:33:43.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.149+0000 7fd97571c700 1 Processor -- start 2023-09-30T22:33:43.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.149+0000 7fd97571c700 1 -- start start 2023-09-30T22:33:43.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd97571c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9700a0a30 0x7fd9700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd97571c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9700a1340 0x7fd970133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd97571c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd970133fa0 0x7fd970134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd97571c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97009edd0 con 0x7fd9700a1340 2023-09-30T22:33:43.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd97571c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97009e1f0 con 0x7fd9700a0a30 2023-09-30T22:33:43.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd97571c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd97009dc50 con 0x7fd970133fa0 2023-09-30T22:33:43.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd96effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9700a0a30 0x7fd9700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd96f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd970133fa0 0x7fd970134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd96e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9700a1340 0x7fd970133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd96effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9700a0a30 0x7fd9700a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48950/0 (socket says 172.21.15.59:48950) 2023-09-30T22:33:43.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd96effd700 1 -- 172.21.15.59:0/2539764442 learned_addr learned my addr 172.21.15.59:0/2539764442 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:43.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd96effd700 1 -- 172.21.15.59:0/2539764442 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd970133fa0 msgr2=0x7fd970134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:43.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd96effd700 1 --2- 172.21.15.59:0/2539764442 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd970133fa0 0x7fd970134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd96effd700 1 -- 172.21.15.59:0/2539764442 >> v2:172.21.15.59:3300/0 conn(0x7fd9700a1340 msgr2=0x7fd970133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:43.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd96effd700 1 --2- 172.21.15.59:0/2539764442 >> v2:172.21.15.59:3300/0 conn(0x7fd9700a1340 0x7fd970133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.150+0000 7fd96effd700 1 -- 172.21.15.59:0/2539764442 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9700a1fe0 con 0x7fd9700a0a30 2023-09-30T22:33:43.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.151+0000 7fd96effd700 1 --2- 172.21.15.59:0/2539764442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9700a0a30 0x7fd9700a0e00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd960009920 tx=0x7fd960009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61f26f69df18ddb5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:43.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.151+0000 7fd96dffb700 1 -- 172.21.15.59:0/2539764442 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd960011830 con 0x7fd9700a0a30 2023-09-30T22:33:43.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.151+0000 7fd96dffb700 1 -- 172.21.15.59:0/2539764442 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd960011990 con 0x7fd9700a0a30 2023-09-30T22:33:43.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.151+0000 7fd96dffb700 1 -- 172.21.15.59:0/2539764442 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd960011d20 con 0x7fd9700a0a30 2023-09-30T22:33:43.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.152+0000 7fd97571c700 1 -- 172.21.15.59:0/2539764442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9700a0a30 msgr2=0x7fd9700a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:43.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.152+0000 7fd97571c700 1 --2- 172.21.15.59:0/2539764442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9700a0a30 0x7fd9700a0e00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd960009920 tx=0x7fd960009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:43.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.152+0000 7fd97571c700 1 -- 172.21.15.59:0/2539764442 shutdown_connections 2023-09-30T22:33:43.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.152+0000 7fd97571c700 1 --2- 172.21.15.59:0/2539764442 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd970133fa0 0x7fd970134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.152+0000 7fd97571c700 1 --2- 172.21.15.59:0/2539764442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9700a0a30 0x7fd9700a0e00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.152+0000 7fd97571c700 1 --2- 172.21.15.59:0/2539764442 >> v2:172.21.15.59:3300/0 conn(0x7fd9700a1340 0x7fd970133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.152+0000 7fd97571c700 1 -- 172.21.15.59:0/2539764442 >> 172.21.15.59:0/2539764442 conn(0x7fd9700a6550 msgr2=0x7fd9700a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:43.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.152+0000 7fd97571c700 1 -- 172.21.15.59:0/2539764442 shutdown_connections 2023-09-30T22:33:43.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.152+0000 7fd97571c700 1 -- 172.21.15.59:0/2539764442 wait complete. 2023-09-30T22:33:43.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.154+0000 7fd97571c700 1 Processor -- start 2023-09-30T22:33:43.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.154+0000 7fd97571c700 1 -- start start 2023-09-30T22:33:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd97571c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9700a0a30 0x7fd9701215b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd97571c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9700a1340 0x7fd970121af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd97571c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd970133fa0 0x7fd970122030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd97571c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd970124b30 con 0x7fd9700a1340 2023-09-30T22:33:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd97571c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd970132500 con 0x7fd9700a0a30 2023-09-30T22:33:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd97571c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700a0220 con 0x7fd970133fa0 2023-09-30T22:33:43.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd96effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9700a0a30 0x7fd9701215b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd96e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9700a1340 0x7fd970121af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd96effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9700a0a30 0x7fd9701215b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48964/0 (socket says 172.21.15.59:48964) 2023-09-30T22:33:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd96effd700 1 -- 172.21.15.59:0/2116749165 learned_addr learned my addr 172.21.15.59:0/2116749165 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd96e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9700a1340 0x7fd970121af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45048/0 (socket says 172.21.15.59:45048) 2023-09-30T22:33:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd96f7fe700 1 --2- 172.21.15.59:0/2116749165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd970133fa0 0x7fd970122030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd96effd700 1 -- 172.21.15.59:0/2116749165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd970133fa0 msgr2=0x7fd970122030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd96effd700 1 --2- 172.21.15.59:0/2116749165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd970133fa0 0x7fd970122030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd96effd700 1 -- 172.21.15.59:0/2116749165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9700a1340 msgr2=0x7fd970121af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd96effd700 1 --2- 172.21.15.59:0/2116749165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9700a1340 0x7fd970121af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd96effd700 1 -- 172.21.15.59:0/2116749165 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd960009550 con 0x7fd9700a0a30 2023-09-30T22:33:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd96f7fe700 1 --2- 172.21.15.59:0/2116749165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd970133fa0 0x7fd970122030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.155+0000 7fd96e7fc700 1 --2- 172.21.15.59:0/2116749165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9700a1340 0x7fd970121af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.156+0000 7fd96effd700 1 --2- 172.21.15.59:0/2116749165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9700a0a30 0x7fd9701215b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd960009130 tx=0x7fd960004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.156+0000 7fd9577fe700 1 -- 172.21.15.59:0/2116749165 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd960004450 con 0x7fd9700a0a30 2023-09-30T22:33:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.156+0000 7fd9577fe700 1 -- 172.21.15.59:0/2116749165 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96002f070 con 0x7fd9700a0a30 2023-09-30T22:33:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.156+0000 7fd97571c700 1 -- 172.21.15.59:0/2116749165 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd970125140 con 0x7fd9700a0a30 2023-09-30T22:33:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.156+0000 7fd9577fe700 1 -- 172.21.15.59:0/2116749165 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9600038e0 con 0x7fd9700a0a30 2023-09-30T22:33:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.156+0000 7fd97571c700 1 -- 172.21.15.59:0/2116749165 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd970132840 con 0x7fd9700a0a30 2023-09-30T22:33:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.157+0000 7fd97571c700 1 -- 172.21.15.59:0/2116749165 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd970074ea0 con 0x7fd9700a0a30 2023-09-30T22:33:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.158+0000 7fd9577fe700 1 -- 172.21.15.59:0/2116749165 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd960003a40 con 0x7fd9700a0a30 2023-09-30T22:33:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.158+0000 7fd9577fe700 1 -- 172.21.15.59:0/2116749165 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd960031070 con 0x7fd9700a0a30 2023-09-30T22:33:43.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.163+0000 7fd9577fe700 1 -- 172.21.15.59:0/2116749165 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd96000b990 con 0x7fd9700a0a30 2023-09-30T22:33:43.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.260+0000 7eff9aa4b700 1 -- 172.21.15.59:0/3840293007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7eff94074ea0 con 0x7eff9409e000 2023-09-30T22:33:43.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.260+0000 7eff90ff9700 1 -- 172.21.15.59:0/3840293007 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff88039090 con 0x7eff9409e000 2023-09-30T22:33:43.261 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:43.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.263+0000 7eff9aa4b700 1 -- 172.21.15.59:0/3840293007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff9409e000 msgr2=0x7eff9411e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:43.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.263+0000 7eff9aa4b700 1 --2- 172.21.15.59:0/3840293007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff9409e000 0x7eff9411e480 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7eff9409f6f0 tx=0x7eff88004750 comp rx=0 tx=0).stop 2023-09-30T22:33:43.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.264+0000 7eff9aa4b700 1 -- 172.21.15.59:0/3840293007 shutdown_connections 2023-09-30T22:33:43.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.264+0000 7eff9aa4b700 1 --2- 172.21.15.59:0/3840293007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff9409e410 0x7eff9411e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.264+0000 7eff9aa4b700 1 --2- 172.21.15.59:0/3840293007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff9409d6f0 0x7eff9411df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.264+0000 7eff9aa4b700 1 --2- 172.21.15.59:0/3840293007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff9409e000 0x7eff9411e480 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.264+0000 7eff9aa4b700 1 -- 172.21.15.59:0/3840293007 >> 172.21.15.59:0/3840293007 conn(0x7eff94066f50 msgr2=0x7eff94130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:43.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.264+0000 7eff9aa4b700 1 -- 172.21.15.59:0/3840293007 shutdown_connections 2023-09-30T22:33:43.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.264+0000 7eff9aa4b700 1 -- 172.21.15.59:0/3840293007 wait complete. 2023-09-30T22:33:43.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:43.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.285+0000 7f83092d1700 1 -- 172.21.15.59:0/3397564727 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8304074ea0 con 0x7f83041338c0 2023-09-30T22:33:43.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.285+0000 7f82eb7fe700 1 -- 172.21.15.59:0/3397564727 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82f4044060 con 0x7f83041338c0 2023-09-30T22:33:43.285 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:43.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.287+0000 7f83092d1700 1 -- 172.21.15.59:0/3397564727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83041338c0 msgr2=0x7f8304119b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:43.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.287+0000 7f83092d1700 1 --2- 172.21.15.59:0/3397564727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83041338c0 0x7f8304119b50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f82f400c470 tx=0x7f82f400c780 comp rx=0 tx=0).stop 2023-09-30T22:33:43.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.287+0000 7f83092d1700 1 -- 172.21.15.59:0/3397564727 shutdown_connections 2023-09-30T22:33:43.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.287+0000 7f83092d1700 1 --2- 172.21.15.59:0/3397564727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8304139150 0x7f830411a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.287+0000 7f83092d1700 1 --2- 172.21.15.59:0/3397564727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83041338c0 0x7f8304119b50 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.287+0000 7f83092d1700 1 --2- 172.21.15.59:0/3397564727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8304136830 0x7f830411a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.287+0000 7f83092d1700 1 -- 172.21.15.59:0/3397564727 >> 172.21.15.59:0/3397564727 conn(0x7f83040a2aa0 msgr2=0x7f8304134cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:43.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.287+0000 7f83092d1700 1 -- 172.21.15.59:0/3397564727 shutdown_connections 2023-09-30T22:33:43.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.288+0000 7f83092d1700 1 -- 172.21.15.59:0/3397564727 wait complete. 2023-09-30T22:33:43.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:43.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.336+0000 7f9d54bf4700 1 -- 172.21.15.59:0/656409243 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9d5009f420 con 0x7f9d5009d6f0 2023-09-30T22:33:43.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.336+0000 7f9d3effd700 1 -- 172.21.15.59:0/656409243 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d40024b30 con 0x7f9d5009d6f0 2023-09-30T22:33:43.337 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.338+0000 7f9d54bf4700 1 -- 172.21.15.59:0/656409243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d5009d6f0 msgr2=0x7f9d501a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.338+0000 7f9d54bf4700 1 --2- 172.21.15.59:0/656409243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d5009d6f0 0x7f9d501a5470 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f9d400090b0 tx=0x7f9d40004750 comp rx=0 tx=0).stop 2023-09-30T22:33:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.338+0000 7f9d54bf4700 1 -- 172.21.15.59:0/656409243 shutdown_connections 2023-09-30T22:33:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.338+0000 7f9d54bf4700 1 --2- 172.21.15.59:0/656409243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d5009e440 0x7f9d501c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.338+0000 7f9d54bf4700 1 --2- 172.21.15.59:0/656409243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d5009d6f0 0x7f9d501a5470 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.338+0000 7f9d54bf4700 1 --2- 172.21.15.59:0/656409243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d5009e000 0x7f9d501a59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.338+0000 7f9d54bf4700 1 -- 172.21.15.59:0/656409243 >> 172.21.15.59:0/656409243 conn(0x7f9d50066f50 msgr2=0x7f9d500a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.338+0000 7f9d54bf4700 1 -- 172.21.15.59:0/656409243 shutdown_connections 2023-09-30T22:33:43.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.339+0000 7f9d54bf4700 1 -- 172.21.15.59:0/656409243 wait complete. 2023-09-30T22:33:43.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:43.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.408+0000 7fd97571c700 1 -- 172.21.15.59:0/2116749165 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd9700a28e0 con 0x7fd9700a0a30 2023-09-30T22:33:43.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.408+0000 7fd9577fe700 1 -- 172.21.15.59:0/2116749165 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd960045090 con 0x7fd9700a0a30 2023-09-30T22:33:43.409 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:43.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.411+0000 7fd97571c700 1 -- 172.21.15.59:0/2116749165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9700a0a30 msgr2=0x7fd9701215b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:43.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.411+0000 7fd97571c700 1 --2- 172.21.15.59:0/2116749165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9700a0a30 0x7fd9701215b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd960009130 tx=0x7fd960004750 comp rx=0 tx=0).stop 2023-09-30T22:33:43.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.411+0000 7fd97571c700 1 -- 172.21.15.59:0/2116749165 shutdown_connections 2023-09-30T22:33:43.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.411+0000 7fd97571c700 1 --2- 172.21.15.59:0/2116749165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd970133fa0 0x7fd970122030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.411+0000 7fd97571c700 1 --2- 172.21.15.59:0/2116749165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9700a0a30 0x7fd9701215b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.411+0000 7fd97571c700 1 --2- 172.21.15.59:0/2116749165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9700a1340 0x7fd970121af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:43.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.411+0000 7fd97571c700 1 -- 172.21.15.59:0/2116749165 >> 172.21.15.59:0/2116749165 conn(0x7fd9700a6550 msgr2=0x7fd9700a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:43.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.411+0000 7fd97571c700 1 -- 172.21.15.59:0/2116749165 shutdown_connections 2023-09-30T22:33:43.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:43.411+0000 7fd97571c700 1 -- 172.21.15.59:0/2116749165 wait complete. 2023-09-30T22:33:43.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:44.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:44.303 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:44.353 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:44.427 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.430+0000 7f99e1dae700 1 Processor -- start 2023-09-30T22:33:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.430+0000 7f99e1dae700 1 -- start start 2023-09-30T22:33:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.430+0000 7f99e1dae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99dc1338a0 0x7f99dc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.430+0000 7f99e1dae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99dc09de50 0x7f99dc09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.430+0000 7f99e1dae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99dc06ef30 con 0x7f99dc09e760 2023-09-30T22:33:44.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.430+0000 7f99e1dae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc06fef0 con 0x7f99dc1338a0 2023-09-30T22:33:44.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.430+0000 7f99e1dae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc1334b0 con 0x7f99dc09de50 2023-09-30T22:33:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.431+0000 7f99dbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f99dc09e760 0x7f99dc13a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52344/0 (socket says 172.21.15.59:52344) 2023-09-30T22:33:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.431+0000 7f99dbfff700 1 -- 172.21.15.59:0/508786295 learned_addr learned my addr 172.21.15.59:0/508786295 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.431+0000 7f99daffd700 1 --2- 172.21.15.59:0/508786295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99dc09de50 0x7f99dc09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.431+0000 7f99db7fe700 1 --2- 172.21.15.59:0/508786295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99dc1338a0 0x7f99dc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.431+0000 7f99daffd700 1 -- 172.21.15.59:0/508786295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99dc1338a0 msgr2=0x7f99dc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.431+0000 7f99daffd700 1 --2- 172.21.15.59:0/508786295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99dc1338a0 0x7f99dc133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.431+0000 7f99daffd700 1 -- 172.21.15.59:0/508786295 >> v1:172.21.15.59:6789/0 conn(0x7f99dc09e760 legacy=0x7f99dc13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.431+0000 7f99daffd700 1 -- 172.21.15.59:0/508786295 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc06fc30 con 0x7f99dc09de50 2023-09-30T22:33:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.431+0000 7f99daffd700 1 --2- 172.21.15.59:0/508786295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99dc09de50 0x7f99dc09e220 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f99d00098a0 tx=0x7f99d0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1b4b92eb9030600 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.431+0000 7f99da7fc700 1 -- 172.21.15.59:0/508786295 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0011830 con 0x7f99dc09de50 2023-09-30T22:33:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.431+0000 7f99da7fc700 1 -- 172.21.15.59:0/508786295 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d0011990 con 0x7f99dc09de50 2023-09-30T22:33:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.432+0000 7f99da7fc700 1 -- 172.21.15.59:0/508786295 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0011d40 con 0x7f99dc09de50 2023-09-30T22:33:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.432+0000 7f99e1dae700 1 -- 172.21.15.59:0/508786295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99dc09de50 msgr2=0x7f99dc09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.432+0000 7f99e1dae700 1 --2- 172.21.15.59:0/508786295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99dc09de50 0x7f99dc09e220 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f99d00098a0 tx=0x7f99d0009bb0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.432+0000 7f99e1dae700 1 -- 172.21.15.59:0/508786295 shutdown_connections 2023-09-30T22:33:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.432+0000 7f99e1dae700 1 --2- 172.21.15.59:0/508786295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99dc1338a0 0x7f99dc133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.432+0000 7f99e1dae700 1 --2- 172.21.15.59:0/508786295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99dc09de50 0x7f99dc09e220 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.432+0000 7f99e1dae700 1 -- 172.21.15.59:0/508786295 >> 172.21.15.59:0/508786295 conn(0x7f99dc0a2aa0 msgr2=0x7f99dc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.432+0000 7f99e1dae700 1 -- 172.21.15.59:0/508786295 shutdown_connections 2023-09-30T22:33:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.432+0000 7f99e1dae700 1 -- 172.21.15.59:0/508786295 wait complete. 2023-09-30T22:33:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.434+0000 7f99e1dae700 1 Processor -- start 2023-09-30T22:33:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.434+0000 7f99e1dae700 1 -- start start 2023-09-30T22:33:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.434+0000 7f99e1dae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99dc09de50 0x7f99dc11eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.434+0000 7f99e1dae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99dc09e760 0x7f99dc11f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.434+0000 7f99e1dae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99dc1338a0 0x7f99dc11f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.434+0000 7f99e1dae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc121d20 con 0x7f99dc09de50 2023-09-30T22:33:44.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.434+0000 7f99e1dae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc12f6f0 con 0x7f99dc09e760 2023-09-30T22:33:44.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.434+0000 7f99e1dae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc120780 con 0x7f99dc1338a0 2023-09-30T22:33:44.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.435+0000 7f99dbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99dc1338a0 0x7f99dc11f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.435+0000 7f99daffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99dc09e760 0x7f99dc11f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.435+0000 7f99dbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99dc1338a0 0x7f99dc11f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36204/0 (socket says 172.21.15.59:36204) 2023-09-30T22:33:44.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.435+0000 7f99dbfff700 1 -- 172.21.15.59:0/3305026810 learned_addr learned my addr 172.21.15.59:0/3305026810 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:44.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.435+0000 7f99daffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99dc09e760 0x7f99dc11f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43270/0 (socket says 172.21.15.59:43270) 2023-09-30T22:33:44.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.435+0000 7f99daffd700 1 -- 172.21.15.59:0/3305026810 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99dc1338a0 msgr2=0x7f99dc11f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.435+0000 7f99daffd700 1 --2- 172.21.15.59:0/3305026810 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99dc1338a0 0x7f99dc11f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.435+0000 7f99daffd700 1 -- 172.21.15.59:0/3305026810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99dc09de50 msgr2=0x7f99dc11eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.435+0000 7f99daffd700 1 --2- 172.21.15.59:0/3305026810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99dc09de50 0x7f99dc11eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.435+0000 7f99daffd700 1 -- 172.21.15.59:0/3305026810 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d00094a0 con 0x7f99dc09e760 2023-09-30T22:33:44.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.435+0000 7f99daffd700 1 --2- 172.21.15.59:0/3305026810 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99dc09e760 0x7f99dc11f0b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f99dc072eb0 tx=0x7f99d0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:44.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.436+0000 7f99c3fff700 1 -- 172.21.15.59:0/3305026810 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0004590 con 0x7f99dc09e760 2023-09-30T22:33:44.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.436+0000 7f99c3fff700 1 -- 172.21.15.59:0/3305026810 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d001e070 con 0x7f99dc09e760 2023-09-30T22:33:44.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.436+0000 7f99e1dae700 1 -- 172.21.15.59:0/3305026810 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99dc122640 con 0x7f99dc09e760 2023-09-30T22:33:44.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.436+0000 7f99c3fff700 1 -- 172.21.15.59:0/3305026810 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d00038e0 con 0x7f99dc09e760 2023-09-30T22:33:44.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.436+0000 7f99e1dae700 1 -- 172.21.15.59:0/3305026810 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99dc06f640 con 0x7f99dc09e760 2023-09-30T22:33:44.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.437+0000 7f99e1dae700 1 -- 172.21.15.59:0/3305026810 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99dc074ea0 con 0x7f99dc09e760 2023-09-30T22:33:44.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.437+0000 7f99c3fff700 1 -- 172.21.15.59:0/3305026810 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99d0003a40 con 0x7f99dc09e760 2023-09-30T22:33:44.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.438+0000 7f99c3fff700 1 -- 172.21.15.59:0/3305026810 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f99d0040a50 con 0x7f99dc09e760 2023-09-30T22:33:44.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.443+0000 7f99c3fff700 1 -- 172.21.15.59:0/3305026810 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99d0006c60 con 0x7f99dc09e760 2023-09-30T22:33:44.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.472+0000 7f6a5380b700 1 Processor -- start 2023-09-30T22:33:44.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.472+0000 7f6a5380b700 1 -- start start 2023-09-30T22:33:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.472+0000 7f6a5380b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c09d6f0 0x7f6a4c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.472+0000 7f6a5380b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c09e000 0x7f6a4c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.472+0000 7f6a5380b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a4c09e410 0x7f6a4c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.472+0000 7f6a5380b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4c06b460 con 0x7f6a4c09e410 2023-09-30T22:33:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.472+0000 7f6a5380b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c09b120 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.472+0000 7f6a5380b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c09a7e0 con 0x7f6a4c09e000 2023-09-30T22:33:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.473+0000 7f6a515a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c09d6f0 0x7f6a4c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.473+0000 7f6a515a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c09d6f0 0x7f6a4c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43284/0 (socket says 172.21.15.59:43284) 2023-09-30T22:33:44.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.473+0000 7f6a515a7700 1 -- 172.21.15.59:0/1796933785 learned_addr learned my addr 172.21.15.59:0/1796933785 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:44.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.473+0000 7f6a50da6700 1 --2- 172.21.15.59:0/1796933785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c09e000 0x7f6a4c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.473+0000 7f6a51da8700 1 --2- 172.21.15.59:0/1796933785 >> v2:172.21.15.59:3300/0 conn(0x7f6a4c09e410 0x7f6a4c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.473+0000 7f6a515a7700 1 -- 172.21.15.59:0/1796933785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c09e000 msgr2=0x7f6a4c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:44.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.473+0000 7f6a515a7700 1 --2- 172.21.15.59:0/1796933785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c09e000 0x7f6a4c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.473+0000 7f6a515a7700 1 -- 172.21.15.59:0/1796933785 >> v2:172.21.15.59:3300/0 conn(0x7f6a4c09e410 msgr2=0x7f6a4c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:44.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.473+0000 7f6a515a7700 1 --2- 172.21.15.59:0/1796933785 >> v2:172.21.15.59:3300/0 conn(0x7f6a4c09e410 0x7f6a4c133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.473+0000 7f6a515a7700 1 -- 172.21.15.59:0/1796933785 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c09a500 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.473+0000 7f6a515a7700 1 --2- 172.21.15.59:0/1796933785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c09d6f0 0x7f6a4c09dac0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009920 tx=0x7f6a48009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d979f62b463cdaa4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:44.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.473+0000 7f6a43fff700 1 -- 172.21.15.59:0/1796933785 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48011830 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.474+0000 7f6a43fff700 1 -- 172.21.15.59:0/1796933785 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a48011990 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.474+0000 7f6a43fff700 1 -- 172.21.15.59:0/1796933785 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48011d20 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.474+0000 7f6a5380b700 1 -- 172.21.15.59:0/1796933785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c09d6f0 msgr2=0x7f6a4c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.474+0000 7f6a5380b700 1 --2- 172.21.15.59:0/1796933785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c09d6f0 0x7f6a4c09dac0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009920 tx=0x7f6a48009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:44.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.474+0000 7f6a5380b700 1 -- 172.21.15.59:0/1796933785 shutdown_connections 2023-09-30T22:33:44.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.474+0000 7f6a5380b700 1 --2- 172.21.15.59:0/1796933785 >> v2:172.21.15.59:3300/0 conn(0x7f6a4c09e410 0x7f6a4c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.474+0000 7f6a5380b700 1 --2- 172.21.15.59:0/1796933785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c09d6f0 0x7f6a4c09dac0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.474+0000 7f6a5380b700 1 --2- 172.21.15.59:0/1796933785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c09e000 0x7f6a4c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.474+0000 7f6a5380b700 1 -- 172.21.15.59:0/1796933785 >> 172.21.15.59:0/1796933785 conn(0x7f6a4c066f50 msgr2=0x7f6a4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:44.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.474+0000 7f6a5380b700 1 -- 172.21.15.59:0/1796933785 shutdown_connections 2023-09-30T22:33:44.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.474+0000 7f6a5380b700 1 -- 172.21.15.59:0/1796933785 wait complete. 2023-09-30T22:33:44.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.476+0000 7f6a5380b700 1 Processor -- start 2023-09-30T22:33:44.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.476+0000 7f6a5380b700 1 -- start start 2023-09-30T22:33:44.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.477+0000 7f6a5380b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c09d6f0 0x7f6a4c1a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.477+0000 7f6a5380b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c09e000 0x7f6a4c1a6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.477+0000 7f6a5380b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c09e410 0x7f6a4c1a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.477+0000 7f6a5380b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c1a9200 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.477+0000 7f6a5380b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c1a7b20 con 0x7f6a4c09e000 2023-09-30T22:33:44.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.477+0000 7f6a5380b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c1a96b0 con 0x7f6a4c09e410 2023-09-30T22:33:44.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.477+0000 7f6a515a7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c09d6f0 0x7f6a4c1a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.477+0000 7f6a515a7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c09d6f0 0x7f6a4c1a5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58886/0 (socket says 172.21.15.59:58886) 2023-09-30T22:33:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.477+0000 7f6a515a7700 1 -- 172.21.15.59:0/3688672927 learned_addr learned my addr 172.21.15.59:0/3688672927 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.477+0000 7f6a51da8700 1 --2- 172.21.15.59:0/3688672927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c09e410 0x7f6a4c1a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.477+0000 7f6a515a7700 1 -- 172.21.15.59:0/3688672927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c09e410 msgr2=0x7f6a4c1a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.477+0000 7f6a515a7700 1 --2- 172.21.15.59:0/3688672927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c09e410 0x7f6a4c1a6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.477+0000 7f6a515a7700 1 -- 172.21.15.59:0/3688672927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c09e000 msgr2=0x7f6a4c1a6440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:33:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.477+0000 7f6a515a7700 1 --2- 172.21.15.59:0/3688672927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c09e000 0x7f6a4c1a6440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.477+0000 7f6a515a7700 1 -- 172.21.15.59:0/3688672927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a48009550 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.478+0000 7f6a515a7700 1 --2- 172.21.15.59:0/3688672927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c09d6f0 0x7f6a4c1a5f00 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f6a48000c00 tx=0x7f6a48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.478+0000 7f6a41ffb700 1 -- 172.21.15.59:0/3688672927 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48004450 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.478+0000 7f6a41ffb700 1 -- 172.21.15.59:0/3688672927 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a480045b0 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.478+0000 7f6a5380b700 1 -- 172.21.15.59:0/3688672927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c0a3170 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.478+0000 7f6a41ffb700 1 -- 172.21.15.59:0/3688672927 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480038a0 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.478+0000 7f6a5380b700 1 -- 172.21.15.59:0/3688672927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c09c760 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.479+0000 7f6a5380b700 1 -- 172.21.15.59:0/3688672927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4c1a9ab0 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.480+0000 7f6a41ffb700 1 -- 172.21.15.59:0/3688672927 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a48021070 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.480+0000 7f6a41ffb700 1 -- 172.21.15.59:0/3688672927 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6a48040a40 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.489+0000 7f6a41ffb700 1 -- 172.21.15.59:0/3688672927 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a4800b7a0 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.515+0000 7f552c6ff700 1 Processor -- start 2023-09-30T22:33:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.515+0000 7f552c6ff700 1 -- start start 2023-09-30T22:33:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.515+0000 7f552c6ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f552409c650 0x7f552409ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.515+0000 7f552c6ff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55240a0090 0x7f552409cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.515+0000 7f552c6ff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552409ba70 con 0x7f5524131970 2023-09-30T22:33:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.515+0000 7f552c6ff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552409d4a0 con 0x7f55240a0090 2023-09-30T22:33:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.515+0000 7f552c6ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f552409e8f0 con 0x7f552409c650 2023-09-30T22:33:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.516+0000 7f552a49b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f552409c650 0x7f552409ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.516+0000 7f552ac9c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5524131970 0x7f5524131dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52350/0 (socket says 172.21.15.59:52350) 2023-09-30T22:33:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.516+0000 7f552ac9c700 1 -- 172.21.15.59:0/545137390 learned_addr learned my addr 172.21.15.59:0/545137390 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.516+0000 7f5529c9a700 1 --2- 172.21.15.59:0/545137390 >> v2:172.21.15.59:3300/0 conn(0x7f55240a0090 0x7f552409cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.516+0000 7f5529499700 1 -- 172.21.15.59:0/545137390 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802763035 0 0) 0x7f552409ba70 con 0x7f5524131970 2023-09-30T22:33:44.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.516+0000 7f5529499700 1 -- 172.21.15.59:0/545137390 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55100035b0 con 0x7f5524131970 2023-09-30T22:33:44.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.516+0000 7f5529c9a700 1 -- 172.21.15.59:0/545137390 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f552409c650 msgr2=0x7f552409ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:44.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.516+0000 7f5529c9a700 1 --2- 172.21.15.59:0/545137390 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f552409c650 0x7f552409ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.516+0000 7f5529c9a700 1 -- 172.21.15.59:0/545137390 >> v1:172.21.15.59:6789/0 conn(0x7f5524131970 legacy=0x7f5524131dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.516+0000 7f5529c9a700 1 -- 172.21.15.59:0/545137390 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55240a0760 con 0x7f55240a0090 2023-09-30T22:33:44.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.516+0000 7f5529c9a700 1 --2- 172.21.15.59:0/545137390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55240a0090 0x7f552409cf60 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f5514009840 tx=0x7f5514009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342386203fe81fad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:44.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.517+0000 7f5529499700 1 -- 172.21.15.59:0/545137390 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514011830 con 0x7f55240a0090 2023-09-30T22:33:44.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.517+0000 7f5529499700 1 -- 172.21.15.59:0/545137390 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5514011990 con 0x7f55240a0090 2023-09-30T22:33:44.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.517+0000 7f5529499700 1 -- 172.21.15.59:0/545137390 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514011d20 con 0x7f55240a0090 2023-09-30T22:33:44.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.518+0000 7f552c6ff700 1 -- 172.21.15.59:0/545137390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55240a0090 msgr2=0x7f552409cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.518+0000 7f552c6ff700 1 --2- 172.21.15.59:0/545137390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55240a0090 0x7f552409cf60 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f5514009840 tx=0x7f5514009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:44.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.518+0000 7f552c6ff700 1 -- 172.21.15.59:0/545137390 shutdown_connections 2023-09-30T22:33:44.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.518+0000 7f552c6ff700 1 --2- 172.21.15.59:0/545137390 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f552409c650 0x7f552409ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.518+0000 7f552c6ff700 1 --2- 172.21.15.59:0/545137390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55240a0090 0x7f552409cf60 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.518+0000 7f552c6ff700 1 -- 172.21.15.59:0/545137390 >> 172.21.15.59:0/545137390 conn(0x7f55240a3f70 msgr2=0x7f55240a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:44.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.518+0000 7f552c6ff700 1 -- 172.21.15.59:0/545137390 shutdown_connections 2023-09-30T22:33:44.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.518+0000 7f552c6ff700 1 -- 172.21.15.59:0/545137390 wait complete. 2023-09-30T22:33:44.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.519+0000 7f552c6ff700 1 Processor -- start 2023-09-30T22:33:44.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.519+0000 7f552c6ff700 1 -- start start 2023-09-30T22:33:44.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.519+0000 7f552c6ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f552409c650 0x7f552411a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.519+0000 7f552c6ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55240a0090 0x7f552411ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.519+0000 7f552c6ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5524131970 0x7f552411b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.519+0000 7f552c6ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552411bbd0 con 0x7f552409c650 2023-09-30T22:33:44.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.519+0000 7f552c6ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552411c1d0 con 0x7f55240a0090 2023-09-30T22:33:44.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.519+0000 7f552c6ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f552411ce00 con 0x7f5524131970 2023-09-30T22:33:44.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.520+0000 7f552ac9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5524131970 0x7f552411b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.520+0000 7f552ac9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5524131970 0x7f552411b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36236/0 (socket says 172.21.15.59:36236) 2023-09-30T22:33:44.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.520+0000 7f552ac9c700 1 -- 172.21.15.59:0/1407581612 learned_addr learned my addr 172.21.15.59:0/1407581612 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:44.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.520+0000 7f5529c9a700 1 --2- 172.21.15.59:0/1407581612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55240a0090 0x7f552411ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.520+0000 7f552a49b700 1 --2- 172.21.15.59:0/1407581612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f552409c650 0x7f552411a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.520+0000 7f552ac9c700 1 -- 172.21.15.59:0/1407581612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55240a0090 msgr2=0x7f552411ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.520+0000 7f552ac9c700 1 --2- 172.21.15.59:0/1407581612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55240a0090 0x7f552411ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.520+0000 7f552ac9c700 1 -- 172.21.15.59:0/1407581612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f552409c650 msgr2=0x7f552411a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.520+0000 7f552ac9c700 1 --2- 172.21.15.59:0/1407581612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f552409c650 0x7f552411a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.520+0000 7f552ac9c700 1 -- 172.21.15.59:0/1407581612 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55140094a0 con 0x7f5524131970 2023-09-30T22:33:44.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.520+0000 7f552ac9c700 1 --2- 172.21.15.59:0/1407581612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5524131970 0x7f552411b0a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f551c00cb40 tx=0x7f551c00ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:44.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.521+0000 7f551affd700 1 -- 172.21.15.59:0/1407581612 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c00a9e0 con 0x7f5524131970 2023-09-30T22:33:44.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.521+0000 7f551affd700 1 -- 172.21.15.59:0/1407581612 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c00ab40 con 0x7f5524131970 2023-09-30T22:33:44.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.521+0000 7f551affd700 1 -- 172.21.15.59:0/1407581612 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c012400 con 0x7f5524131970 2023-09-30T22:33:44.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.521+0000 7f552c6ff700 1 -- 172.21.15.59:0/1407581612 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552412fb70 con 0x7f5524131970 2023-09-30T22:33:44.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.521+0000 7f552c6ff700 1 -- 172.21.15.59:0/1407581612 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552411d250 con 0x7f5524131970 2023-09-30T22:33:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.522+0000 7f552c6ff700 1 -- 172.21.15.59:0/1407581612 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55240747f0 con 0x7f5524131970 2023-09-30T22:33:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.522+0000 7f551affd700 1 -- 172.21.15.59:0/1407581612 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f551c01b3b0 con 0x7f5524131970 2023-09-30T22:33:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.522+0000 7f551affd700 1 -- 172.21.15.59:0/1407581612 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f551c03f320 con 0x7f5524131970 2023-09-30T22:33:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.532+0000 7f551affd700 1 -- 172.21.15.59:0/1407581612 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f551c0192c0 con 0x7f5524131970 2023-09-30T22:33:44.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.590+0000 7f6025453700 1 Processor -- start 2023-09-30T22:33:44.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.590+0000 7f6025453700 1 -- start start 2023-09-30T22:33:44.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.591+0000 7f6025453700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200a0a30 0x7f60200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.591+0000 7f6025453700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f602009d630 0x7f60200a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.591+0000 7f6025453700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60200a2a70 con 0x7f6020133930 2023-09-30T22:33:44.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.591+0000 7f6025453700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60200a01d0 con 0x7f602009d630 2023-09-30T22:33:44.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.591+0000 7f6025453700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f602009e2b0 con 0x7f60200a0a30 2023-09-30T22:33:44.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.591+0000 7f601effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200a0a30 0x7f60200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.591+0000 7f601f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6020133930 0x7f6020133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52360/0 (socket says 172.21.15.59:52360) 2023-09-30T22:33:44.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.591+0000 7f601f7fe700 1 -- 172.21.15.59:0/3731125990 learned_addr learned my addr 172.21.15.59:0/3731125990 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:44.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.591+0000 7f601e7fc700 1 --2- 172.21.15.59:0/3731125990 >> v2:172.21.15.59:3300/0 conn(0x7f602009d630 0x7f60200a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.591+0000 7f601e7fc700 1 -- 172.21.15.59:0/3731125990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200a0a30 msgr2=0x7f60200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.591+0000 7f601e7fc700 1 --2- 172.21.15.59:0/3731125990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200a0a30 0x7f60200a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.591+0000 7f601e7fc700 1 -- 172.21.15.59:0/3731125990 >> v1:172.21.15.59:6789/0 conn(0x7f6020133930 legacy=0x7f6020133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.592+0000 7f601e7fc700 1 -- 172.21.15.59:0/3731125990 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602009dc50 con 0x7f602009d630 2023-09-30T22:33:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.592+0000 7f601e7fc700 1 --2- 172.21.15.59:0/3731125990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f602009d630 0x7f60200a1340 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f6014009840 tx=0x7f6014009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ee9beb5ec4a2b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.592+0000 7f601dffb700 1 -- 172.21.15.59:0/3731125990 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014004230 con 0x7f602009d630 2023-09-30T22:33:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.592+0000 7f601dffb700 1 -- 172.21.15.59:0/3731125990 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6014004390 con 0x7f602009d630 2023-09-30T22:33:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.592+0000 7f601dffb700 1 -- 172.21.15.59:0/3731125990 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60140036a0 con 0x7f602009d630 2023-09-30T22:33:44.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.593+0000 7f6025453700 1 -- 172.21.15.59:0/3731125990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f602009d630 msgr2=0x7f60200a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.593+0000 7f6025453700 1 --2- 172.21.15.59:0/3731125990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f602009d630 0x7f60200a1340 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f6014009840 tx=0x7f6014009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:44.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.593+0000 7f6025453700 1 -- 172.21.15.59:0/3731125990 shutdown_connections 2023-09-30T22:33:44.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.593+0000 7f6025453700 1 --2- 172.21.15.59:0/3731125990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60200a0a30 0x7f60200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.593+0000 7f6025453700 1 --2- 172.21.15.59:0/3731125990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f602009d630 0x7f60200a1340 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.593+0000 7f6025453700 1 -- 172.21.15.59:0/3731125990 >> 172.21.15.59:0/3731125990 conn(0x7f60200a3050 msgr2=0x7f60200a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:44.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.593+0000 7f6025453700 1 -- 172.21.15.59:0/3731125990 shutdown_connections 2023-09-30T22:33:44.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.593+0000 7f6025453700 1 -- 172.21.15.59:0/3731125990 wait complete. 2023-09-30T22:33:44.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.595+0000 7f6025453700 1 Processor -- start 2023-09-30T22:33:44.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.595+0000 7f6025453700 1 -- start start 2023-09-30T22:33:44.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.596+0000 7f6025453700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602009d630 0x7f60201c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.596+0000 7f6025453700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60200a0a30 0x7f60201c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.596+0000 7f6025453700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6020133930 0x7f60201c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:44.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.596+0000 7f6025453700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6020120d60 con 0x7f6020133930 2023-09-30T22:33:44.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.596+0000 7f6025453700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6020122410 con 0x7f60200a0a30 2023-09-30T22:33:44.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.596+0000 7f6025453700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6020120470 con 0x7f602009d630 2023-09-30T22:33:44.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.596+0000 7f601effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602009d630 0x7f60201c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.596+0000 7f601effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602009d630 0x7f60201c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36246/0 (socket says 172.21.15.59:36246) 2023-09-30T22:33:44.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.596+0000 7f601effd700 1 -- 172.21.15.59:0/1673683790 learned_addr learned my addr 172.21.15.59:0/1673683790 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:44.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.596+0000 7f601e7fc700 1 --2- 172.21.15.59:0/1673683790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60200a0a30 0x7f60201c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.596+0000 7f601f7fe700 1 --2- 172.21.15.59:0/1673683790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6020133930 0x7f60201c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:44.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.597+0000 7f601effd700 1 -- 172.21.15.59:0/1673683790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60200a0a30 msgr2=0x7f60201c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.597+0000 7f601effd700 1 --2- 172.21.15.59:0/1673683790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60200a0a30 0x7f60201c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.597+0000 7f601effd700 1 -- 172.21.15.59:0/1673683790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6020133930 msgr2=0x7f60201c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.597+0000 7f601effd700 1 --2- 172.21.15.59:0/1673683790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6020133930 0x7f60201c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.597+0000 7f601effd700 1 -- 172.21.15.59:0/1673683790 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60140094a0 con 0x7f602009d630 2023-09-30T22:33:44.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.597+0000 7f601e7fc700 1 --2- 172.21.15.59:0/1673683790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60200a0a30 0x7f60201c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:44.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.597+0000 7f601f7fe700 1 --2- 172.21.15.59:0/1673683790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6020133930 0x7f60201c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:44.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.597+0000 7f601effd700 1 --2- 172.21.15.59:0/1673683790 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602009d630 0x7f60201c8090 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f601000e9b0 tx=0x7f601000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:44.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.597+0000 7f60077fe700 1 -- 172.21.15.59:0/1673683790 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010009710 con 0x7f602009d630 2023-09-30T22:33:44.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.597+0000 7f60077fe700 1 -- 172.21.15.59:0/1673683790 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601000ee50 con 0x7f602009d630 2023-09-30T22:33:44.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.597+0000 7f6025453700 1 -- 172.21.15.59:0/1673683790 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60200a4030 con 0x7f602009d630 2023-09-30T22:33:44.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.597+0000 7f60077fe700 1 -- 172.21.15.59:0/1673683790 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601000ca50 con 0x7f602009d630 2023-09-30T22:33:44.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.597+0000 7f6025453700 1 -- 172.21.15.59:0/1673683790 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60200a0410 con 0x7f602009d630 2023-09-30T22:33:44.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.599+0000 7f6025453700 1 -- 172.21.15.59:0/1673683790 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60200747f0 con 0x7f602009d630 2023-09-30T22:33:44.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.599+0000 7f60077fe700 1 -- 172.21.15.59:0/1673683790 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f601000cbb0 con 0x7f602009d630 2023-09-30T22:33:44.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.599+0000 7f60077fe700 1 -- 172.21.15.59:0/1673683790 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f601003fae0 con 0x7f602009d630 2023-09-30T22:33:44.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.604+0000 7f60077fe700 1 -- 172.21.15.59:0/1673683790 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f601001b3b0 con 0x7f602009d630 2023-09-30T22:33:44.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.665+0000 7f99e1dae700 1 -- 172.21.15.59:0/3305026810 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f99dc06b9e0 con 0x7f99dc09e760 2023-09-30T22:33:44.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.665+0000 7f99c3fff700 1 -- 172.21.15.59:0/3305026810 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99d0015070 con 0x7f99dc09e760 2023-09-30T22:33:44.666 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.668+0000 7f99e1dae700 1 -- 172.21.15.59:0/3305026810 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99dc09e760 msgr2=0x7f99dc11f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.668+0000 7f99e1dae700 1 --2- 172.21.15.59:0/3305026810 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99dc09e760 0x7f99dc11f0b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f99dc072eb0 tx=0x7f99d0004750 comp rx=0 tx=0).stop 2023-09-30T22:33:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.668+0000 7f99e1dae700 1 -- 172.21.15.59:0/3305026810 shutdown_connections 2023-09-30T22:33:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.668+0000 7f99e1dae700 1 --2- 172.21.15.59:0/3305026810 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99dc1338a0 0x7f99dc11f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.668+0000 7f99e1dae700 1 --2- 172.21.15.59:0/3305026810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99dc09de50 0x7f99dc11eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.668+0000 7f99e1dae700 1 --2- 172.21.15.59:0/3305026810 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99dc09e760 0x7f99dc11f0b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.668+0000 7f99e1dae700 1 -- 172.21.15.59:0/3305026810 >> 172.21.15.59:0/3305026810 conn(0x7f99dc0a2aa0 msgr2=0x7f99dc09ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:44.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.668+0000 7f99e1dae700 1 -- 172.21.15.59:0/3305026810 shutdown_connections 2023-09-30T22:33:44.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.668+0000 7f99e1dae700 1 -- 172.21.15.59:0/3305026810 wait complete. 2023-09-30T22:33:44.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:44.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.713+0000 7f6a5380b700 1 -- 172.21.15.59:0/3688672927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6a4c074ea0 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.713+0000 7f6a41ffb700 1 -- 172.21.15.59:0/3688672927 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a48029070 con 0x7f6a4c09d6f0 2023-09-30T22:33:44.714 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.716+0000 7f6a5380b700 1 -- 172.21.15.59:0/3688672927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c09d6f0 msgr2=0x7f6a4c1a5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.716+0000 7f6a5380b700 1 --2- 172.21.15.59:0/3688672927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c09d6f0 0x7f6a4c1a5f00 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f6a48000c00 tx=0x7f6a48004750 comp rx=0 tx=0).stop 2023-09-30T22:33:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.716+0000 7f6a5380b700 1 -- 172.21.15.59:0/3688672927 shutdown_connections 2023-09-30T22:33:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.716+0000 7f6a5380b700 1 --2- 172.21.15.59:0/3688672927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c09e410 0x7f6a4c1a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.716+0000 7f6a5380b700 1 --2- 172.21.15.59:0/3688672927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c09d6f0 0x7f6a4c1a5f00 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.716+0000 7f6a5380b700 1 --2- 172.21.15.59:0/3688672927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c09e000 0x7f6a4c1a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.716+0000 7f6a5380b700 1 -- 172.21.15.59:0/3688672927 >> 172.21.15.59:0/3688672927 conn(0x7f6a4c066f50 msgr2=0x7f6a4c1baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.716+0000 7f6a5380b700 1 -- 172.21.15.59:0/3688672927 shutdown_connections 2023-09-30T22:33:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.716+0000 7f6a5380b700 1 -- 172.21.15.59:0/3688672927 wait complete. 2023-09-30T22:33:44.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:44.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.760+0000 7f552c6ff700 1 -- 172.21.15.59:0/1407581612 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5524072840 con 0x7f5524131970 2023-09-30T22:33:44.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.761+0000 7f551affd700 1 -- 172.21.15.59:0/1407581612 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f551c010af0 con 0x7f5524131970 2023-09-30T22:33:44.761 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:44.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.763+0000 7f552c6ff700 1 -- 172.21.15.59:0/1407581612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5524131970 msgr2=0x7f552411b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.763+0000 7f552c6ff700 1 --2- 172.21.15.59:0/1407581612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5524131970 0x7f552411b0a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f551c00cb40 tx=0x7f551c00ce50 comp rx=0 tx=0).stop 2023-09-30T22:33:44.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.763+0000 7f552c6ff700 1 -- 172.21.15.59:0/1407581612 shutdown_connections 2023-09-30T22:33:44.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.763+0000 7f552c6ff700 1 --2- 172.21.15.59:0/1407581612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5524131970 0x7f552411b0a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.763+0000 7f552c6ff700 1 --2- 172.21.15.59:0/1407581612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f552409c650 0x7f552411a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.763+0000 7f552c6ff700 1 --2- 172.21.15.59:0/1407581612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55240a0090 0x7f552411ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.763+0000 7f552c6ff700 1 -- 172.21.15.59:0/1407581612 >> 172.21.15.59:0/1407581612 conn(0x7f55240a3f70 msgr2=0x7f552412ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:44.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.763+0000 7f552c6ff700 1 -- 172.21.15.59:0/1407581612 shutdown_connections 2023-09-30T22:33:44.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.763+0000 7f552c6ff700 1 -- 172.21.15.59:0/1407581612 wait complete. 2023-09-30T22:33:44.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.831+0000 7f6025453700 1 -- 172.21.15.59:0/1673683790 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6020122250 con 0x7f602009d630 2023-09-30T22:33:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.831+0000 7f60077fe700 1 -- 172.21.15.59:0/1673683790 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6020122250 con 0x7f602009d630 2023-09-30T22:33:44.832 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.834+0000 7f6025453700 1 -- 172.21.15.59:0/1673683790 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602009d630 msgr2=0x7f60201c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.834+0000 7f6025453700 1 --2- 172.21.15.59:0/1673683790 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602009d630 0x7f60201c8090 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f601000e9b0 tx=0x7f601000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.834+0000 7f6025453700 1 -- 172.21.15.59:0/1673683790 shutdown_connections 2023-09-30T22:33:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.834+0000 7f6025453700 1 --2- 172.21.15.59:0/1673683790 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602009d630 0x7f60201c8090 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.834+0000 7f6025453700 1 --2- 172.21.15.59:0/1673683790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6020133930 0x7f60201c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.834+0000 7f6025453700 1 --2- 172.21.15.59:0/1673683790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60200a0a30 0x7f60201c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.834+0000 7f6025453700 1 -- 172.21.15.59:0/1673683790 >> 172.21.15.59:0/1673683790 conn(0x7f60200a3050 msgr2=0x7f60201bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.834+0000 7f6025453700 1 -- 172.21.15.59:0/1673683790 shutdown_connections 2023-09-30T22:33:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:44.834+0000 7f6025453700 1 -- 172.21.15.59:0/1673683790 wait complete. 2023-09-30T22:33:44.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:45.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:45.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:45.778 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:45.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.836+0000 7f3177db9700 1 Processor -- start 2023-09-30T22:33:45.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.836+0000 7f3177db9700 1 -- start start 2023-09-30T22:33:45.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3177db9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d6f0 0x7f317009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3177db9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f317009e000 0x7f31701339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3177db9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e410 0x7f3170133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3177db9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317006b460 con 0x7f317009e000 2023-09-30T22:33:45.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3177db9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317009b120 con 0x7f317009d6f0 2023-09-30T22:33:45.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3177db9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f317009a7e0 con 0x7f317009e410 2023-09-30T22:33:45.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3175354700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f317009e000 0x7f31701339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3175b55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d6f0 0x7f317009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3175354700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f317009e000 0x7f31701339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58940/0 (socket says 172.21.15.59:58940) 2023-09-30T22:33:45.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3175354700 1 -- 172.21.15.59:0/54173891 learned_addr learned my addr 172.21.15.59:0/54173891 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:45.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3176356700 1 --2- 172.21.15.59:0/54173891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e410 0x7f3170133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3175354700 1 -- 172.21.15.59:0/54173891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e410 msgr2=0x7f3170133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:45.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3175354700 1 --2- 172.21.15.59:0/54173891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e410 0x7f3170133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3175354700 1 -- 172.21.15.59:0/54173891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d6f0 msgr2=0x7f317009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:45.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3175354700 1 --2- 172.21.15.59:0/54173891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d6f0 0x7f317009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3175354700 1 -- 172.21.15.59:0/54173891 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317009a500 con 0x7f317009e000 2023-09-30T22:33:45.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3175b55700 1 --2- 172.21.15.59:0/54173891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d6f0 0x7f317009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:45.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.837+0000 7f3175354700 1 --2- 172.21.15.59:0/54173891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009e000 0x7f31701339f0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f31600098f0 tx=0x7f3160009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9887f071aa1b40 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:45.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.838+0000 7f3174b53700 1 -- 172.21.15.59:0/54173891 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160011830 con 0x7f317009e000 2023-09-30T22:33:45.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.838+0000 7f3174b53700 1 -- 172.21.15.59:0/54173891 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3160011990 con 0x7f317009e000 2023-09-30T22:33:45.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.838+0000 7f3174b53700 1 -- 172.21.15.59:0/54173891 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160011d20 con 0x7f317009e000 2023-09-30T22:33:45.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.838+0000 7f3177db9700 1 -- 172.21.15.59:0/54173891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009e000 msgr2=0x7f31701339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:45.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.838+0000 7f3177db9700 1 --2- 172.21.15.59:0/54173891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009e000 0x7f31701339f0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f31600098f0 tx=0x7f3160009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:45.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.838+0000 7f3177db9700 1 -- 172.21.15.59:0/54173891 shutdown_connections 2023-09-30T22:33:45.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.838+0000 7f3177db9700 1 --2- 172.21.15.59:0/54173891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e410 0x7f3170133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.838+0000 7f3177db9700 1 --2- 172.21.15.59:0/54173891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d6f0 0x7f317009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.838+0000 7f3177db9700 1 --2- 172.21.15.59:0/54173891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009e000 0x7f31701339f0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.838+0000 7f3177db9700 1 -- 172.21.15.59:0/54173891 >> 172.21.15.59:0/54173891 conn(0x7f3170066f50 msgr2=0x7f317009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:45.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.839+0000 7f3177db9700 1 -- 172.21.15.59:0/54173891 shutdown_connections 2023-09-30T22:33:45.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.839+0000 7f3177db9700 1 -- 172.21.15.59:0/54173891 wait complete. 2023-09-30T22:33:45.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.840+0000 7f3177db9700 1 Processor -- start 2023-09-30T22:33:45.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.840+0000 7f3177db9700 1 -- start start 2023-09-30T22:33:45.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.840+0000 7f3177db9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d6f0 0x7f31701a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.840+0000 7f3177db9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009e000 0x7f31701a6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.840+0000 7f3177db9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e410 0x7f31701a6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.840+0000 7f3177db9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31701a9cf0 con 0x7f317009e000 2023-09-30T22:33:45.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.840+0000 7f3177db9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31700a1fe0 con 0x7f317009d6f0 2023-09-30T22:33:45.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.840+0000 7f3177db9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f317009c710 con 0x7f317009e410 2023-09-30T22:33:45.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.840+0000 7f3175b55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d6f0 0x7f31701a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.840+0000 7f3175354700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009e000 0x7f31701a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.840+0000 7f3175b55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d6f0 0x7f31701a61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43308/0 (socket says 172.21.15.59:43308) 2023-09-30T22:33:45.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.840+0000 7f3175b55700 1 -- 172.21.15.59:0/3881706392 learned_addr learned my addr 172.21.15.59:0/3881706392 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:45.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.840+0000 7f3176356700 1 --2- 172.21.15.59:0/3881706392 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e410 0x7f31701a6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.841+0000 7f3175b55700 1 -- 172.21.15.59:0/3881706392 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e410 msgr2=0x7f31701a6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:45.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.841+0000 7f3175b55700 1 --2- 172.21.15.59:0/3881706392 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e410 0x7f31701a6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.841+0000 7f3175b55700 1 -- 172.21.15.59:0/3881706392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009e000 msgr2=0x7f31701a6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:45.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.841+0000 7f3175b55700 1 --2- 172.21.15.59:0/3881706392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009e000 0x7f31701a6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.841+0000 7f3175b55700 1 -- 172.21.15.59:0/3881706392 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c0094a0 con 0x7f317009d6f0 2023-09-30T22:33:45.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.841+0000 7f3175354700 1 --2- 172.21.15.59:0/3881706392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009e000 0x7f31701a6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.841+0000 7f3175b55700 1 --2- 172.21.15.59:0/3881706392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d6f0 0x7f31701a61d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f316c00ebe0 tx=0x7f316c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.841+0000 7f31667fc700 1 -- 172.21.15.59:0/3881706392 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c009800 con 0x7f317009d6f0 2023-09-30T22:33:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.841+0000 7f31667fc700 1 -- 172.21.15.59:0/3881706392 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c00c910 con 0x7f317009d6f0 2023-09-30T22:33:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.841+0000 7f3177db9700 1 -- 172.21.15.59:0/3881706392 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3160009550 con 0x7f317009d6f0 2023-09-30T22:33:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.841+0000 7f31667fc700 1 -- 172.21.15.59:0/3881706392 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c00cc80 con 0x7f317009d6f0 2023-09-30T22:33:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.841+0000 7f3177db9700 1 -- 172.21.15.59:0/3881706392 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31701a9480 con 0x7f317009d6f0 2023-09-30T22:33:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.842+0000 7f31667fc700 1 -- 172.21.15.59:0/3881706392 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f316c013470 con 0x7f317009d6f0 2023-09-30T22:33:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.842+0000 7f31667fc700 1 -- 172.21.15.59:0/3881706392 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f316c03fc20 con 0x7f317009d6f0 2023-09-30T22:33:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.843+0000 7f3177db9700 1 -- 172.21.15.59:0/3881706392 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31701a83f0 con 0x7f317009d6f0 2023-09-30T22:33:45.848 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.847+0000 7f31667fc700 1 -- 172.21.15.59:0/3881706392 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31701a83f0 con 0x7f317009d6f0 2023-09-30T22:33:45.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.891+0000 7f76e893a700 1 Processor -- start 2023-09-30T22:33:45.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.891+0000 7f76e893a700 1 -- start start 2023-09-30T22:33:45.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.892+0000 7f76e893a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e409d6f0 0x7f76e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.893+0000 7f76e893a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e409e410 0x7f76e4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.893+0000 7f76e893a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e409b120 con 0x7f76e409e000 2023-09-30T22:33:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.893+0000 7f76e893a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e406b460 con 0x7f76e409d6f0 2023-09-30T22:33:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.893+0000 7f76e893a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76e409a7e0 con 0x7f76e409e410 2023-09-30T22:33:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.893+0000 7f76e259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e409d6f0 0x7f76e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.893+0000 7f76e1d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f76e409e000 0x7f76e41339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52376/0 (socket says 172.21.15.59:52376) 2023-09-30T22:33:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.893+0000 7f76e1d9b700 1 -- 172.21.15.59:0/2583938404 learned_addr learned my addr 172.21.15.59:0/2583938404 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.893+0000 7f76e2d9d700 1 --2- 172.21.15.59:0/2583938404 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e409e410 0x7f76e4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.893+0000 7f76e159a700 1 -- 172.21.15.59:0/2583938404 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491282040 0 0) 0x7f76e409b120 con 0x7f76e409e000 2023-09-30T22:33:45.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.893+0000 7f76e159a700 1 -- 172.21.15.59:0/2583938404 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76cc0035b0 con 0x7f76e409e000 2023-09-30T22:33:45.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.893+0000 7f76e259c700 1 -- 172.21.15.59:0/2583938404 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e409e410 msgr2=0x7f76e4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:45.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.893+0000 7f76e259c700 1 --2- 172.21.15.59:0/2583938404 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e409e410 0x7f76e4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.893+0000 7f76e259c700 1 -- 172.21.15.59:0/2583938404 >> v1:172.21.15.59:6789/0 conn(0x7f76e409e000 legacy=0x7f76e41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.893+0000 7f76e259c700 1 -- 172.21.15.59:0/2583938404 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e409a500 con 0x7f76e409d6f0 2023-09-30T22:33:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.893+0000 7f76e2d9d700 1 --2- 172.21.15.59:0/2583938404 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e409e410 0x7f76e4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.894+0000 7f76e259c700 1 --2- 172.21.15.59:0/2583938404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e409d6f0 0x7f76e409dac0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009870 tx=0x7f76d4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f929d743ef43d75f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.894+0000 7f76e159a700 1 -- 172.21.15.59:0/2583938404 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4011830 con 0x7f76e409d6f0 2023-09-30T22:33:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.894+0000 7f76e159a700 1 -- 172.21.15.59:0/2583938404 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d4011990 con 0x7f76e409d6f0 2023-09-30T22:33:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.894+0000 7f76e159a700 1 -- 172.21.15.59:0/2583938404 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4011d20 con 0x7f76e409d6f0 2023-09-30T22:33:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.894+0000 7f76e893a700 1 -- 172.21.15.59:0/2583938404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e409d6f0 msgr2=0x7f76e409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.894+0000 7f76e893a700 1 --2- 172.21.15.59:0/2583938404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e409d6f0 0x7f76e409dac0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009870 tx=0x7f76d4009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.895+0000 7f76e893a700 1 -- 172.21.15.59:0/2583938404 shutdown_connections 2023-09-30T22:33:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.895+0000 7f76e893a700 1 --2- 172.21.15.59:0/2583938404 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e409e410 0x7f76e4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.895+0000 7f76e893a700 1 --2- 172.21.15.59:0/2583938404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e409d6f0 0x7f76e409dac0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.895+0000 7f76e893a700 1 -- 172.21.15.59:0/2583938404 >> 172.21.15.59:0/2583938404 conn(0x7f76e4066f50 msgr2=0x7f76e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.895+0000 7f76e893a700 1 -- 172.21.15.59:0/2583938404 shutdown_connections 2023-09-30T22:33:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.895+0000 7f76e893a700 1 -- 172.21.15.59:0/2583938404 wait complete. 2023-09-30T22:33:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.896+0000 7f76e893a700 1 Processor -- start 2023-09-30T22:33:45.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.897+0000 7f76e893a700 1 -- start start 2023-09-30T22:33:45.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.897+0000 7f76e893a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e409d6f0 0x7f76e41cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.897+0000 7f76e893a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e409e000 0x7f76e41cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.897+0000 7f76e893a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e409e410 0x7f76e41194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.897+0000 7f76e893a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e411b0a0 con 0x7f76e409d6f0 2023-09-30T22:33:45.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.897+0000 7f76e893a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e409c710 con 0x7f76e409e000 2023-09-30T22:33:45.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.897+0000 7f76e893a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76e411c900 con 0x7f76e409e410 2023-09-30T22:33:45.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.898+0000 7f76e1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e409e000 0x7f76e41cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.898+0000 7f76e1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e409e000 0x7f76e41cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43326/0 (socket says 172.21.15.59:43326) 2023-09-30T22:33:45.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.898+0000 7f76e1d9b700 1 -- 172.21.15.59:0/2141691208 learned_addr learned my addr 172.21.15.59:0/2141691208 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:45.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.898+0000 7f76e259c700 1 --2- 172.21.15.59:0/2141691208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e409d6f0 0x7f76e41cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.898+0000 7f76e2d9d700 1 --2- 172.21.15.59:0/2141691208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e409e410 0x7f76e41194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.898+0000 7f76e2d9d700 1 -- 172.21.15.59:0/2141691208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e409e000 msgr2=0x7f76e41cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:45.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.898+0000 7f76e2d9d700 1 --2- 172.21.15.59:0/2141691208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e409e000 0x7f76e41cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.898+0000 7f76e2d9d700 1 -- 172.21.15.59:0/2141691208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e409d6f0 msgr2=0x7f76e41cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:45.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.898+0000 7f76e2d9d700 1 --2- 172.21.15.59:0/2141691208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e409d6f0 0x7f76e41cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.898+0000 7f76e2d9d700 1 -- 172.21.15.59:0/2141691208 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc009a70 con 0x7f76e409e410 2023-09-30T22:33:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.898+0000 7f76e2d9d700 1 --2- 172.21.15.59:0/2141691208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e409e410 0x7f76e41194b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00efc0 tx=0x7f76dc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.899+0000 7f76d2ffd700 1 -- 172.21.15.59:0/2141691208 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc00ca90 con 0x7f76e409e410 2023-09-30T22:33:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.899+0000 7f76d2ffd700 1 -- 172.21.15.59:0/2141691208 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc00f040 con 0x7f76e409e410 2023-09-30T22:33:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.899+0000 7f76e893a700 1 -- 172.21.15.59:0/2141691208 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d40094a0 con 0x7f76e409e410 2023-09-30T22:33:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.899+0000 7f76d2ffd700 1 -- 172.21.15.59:0/2141691208 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc00ce30 con 0x7f76e409e410 2023-09-30T22:33:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.899+0000 7f76e893a700 1 -- 172.21.15.59:0/2141691208 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e411cea0 con 0x7f76e409e410 2023-09-30T22:33:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.900+0000 7f76d2ffd700 1 -- 172.21.15.59:0/2141691208 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f76dc014480 con 0x7f76e409e410 2023-09-30T22:33:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.900+0000 7f76d2ffd700 1 -- 172.21.15.59:0/2141691208 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f76dc03fc20 con 0x7f76e409e410 2023-09-30T22:33:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.900+0000 7f76e893a700 1 -- 172.21.15.59:0/2141691208 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e4074ea0 con 0x7f76e409e410 2023-09-30T22:33:45.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.910+0000 7f76d2ffd700 1 -- 172.21.15.59:0/2141691208 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76dc012930 con 0x7f76e409e410 2023-09-30T22:33:45.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.927+0000 7f2b0f085700 1 Processor -- start 2023-09-30T22:33:45.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.927+0000 7f2b0f085700 1 -- start start 2023-09-30T22:33:45.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.928+0000 7f2b0f085700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2b0809e1d0 0x7f2b08135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.928+0000 7f2b0f085700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b08135e50 0x7f2b08138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.928+0000 7f2b0f085700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0809f130 con 0x7f2b0809d6f0 2023-09-30T22:33:45.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.928+0000 7f2b0f085700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0809f520 con 0x7f2b0809e1d0 2023-09-30T22:33:45.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.928+0000 7f2b0f085700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0809e930 con 0x7f2b08135e50 2023-09-30T22:33:45.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.928+0000 7f2b07fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2b0809e1d0 0x7f2b08135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.928+0000 7f2b07fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2b0809e1d0 0x7f2b08135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58962/0 (socket says 172.21.15.59:58962) 2023-09-30T22:33:45.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.928+0000 7f2b07fff700 1 -- 172.21.15.59:0/748778291 learned_addr learned my addr 172.21.15.59:0/748778291 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:45.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.928+0000 7f2b0d622700 1 --2- 172.21.15.59:0/748778291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b08135e50 0x7f2b08138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.928+0000 7f2b07fff700 1 -- 172.21.15.59:0/748778291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b08135e50 msgr2=0x7f2b08138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:45.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.928+0000 7f2b07fff700 1 --2- 172.21.15.59:0/748778291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b08135e50 0x7f2b08138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.929+0000 7f2b07fff700 1 -- 172.21.15.59:0/748778291 >> v1:172.21.15.59:6789/0 conn(0x7f2b0809d6f0 legacy=0x7f2b0809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:45.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.929+0000 7f2b07fff700 1 -- 172.21.15.59:0/748778291 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0809b2d0 con 0x7f2b0809e1d0 2023-09-30T22:33:45.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.929+0000 7f2b07fff700 1 --2- 172.21.15.59:0/748778291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b0809e1d0 0x7f2b08135910 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2af400bb90 tx=0x7f2af400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef52e90a1b3b4283 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.929+0000 7f2b077fe700 1 -- 172.21.15.59:0/748778291 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400dd30 con 0x7f2b0809e1d0 2023-09-30T22:33:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.929+0000 7f2b077fe700 1 -- 172.21.15.59:0/748778291 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af400de90 con 0x7f2b0809e1d0 2023-09-30T22:33:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.929+0000 7f2b077fe700 1 -- 172.21.15.59:0/748778291 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4010690 con 0x7f2b0809e1d0 2023-09-30T22:33:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.930+0000 7f2b0f085700 1 -- 172.21.15.59:0/748778291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b0809e1d0 msgr2=0x7f2b08135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.930+0000 7f2b0f085700 1 --2- 172.21.15.59:0/748778291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b0809e1d0 0x7f2b08135910 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2af400bb90 tx=0x7f2af400bea0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.930+0000 7f2b0f085700 1 -- 172.21.15.59:0/748778291 shutdown_connections 2023-09-30T22:33:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.930+0000 7f2b0f085700 1 --2- 172.21.15.59:0/748778291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b08135e50 0x7f2b08138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.930+0000 7f2b0f085700 1 --2- 172.21.15.59:0/748778291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b0809e1d0 0x7f2b08135910 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.930+0000 7f2b0f085700 1 -- 172.21.15.59:0/748778291 >> 172.21.15.59:0/748778291 conn(0x7f2b08066f50 msgr2=0x7f2b0809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.930+0000 7f2b0f085700 1 -- 172.21.15.59:0/748778291 shutdown_connections 2023-09-30T22:33:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.930+0000 7f2b0f085700 1 -- 172.21.15.59:0/748778291 wait complete. 2023-09-30T22:33:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.931+0000 7f2b0f085700 1 Processor -- start 2023-09-30T22:33:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.931+0000 7f2b0f085700 1 -- start start 2023-09-30T22:33:45.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b0f085700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b0809d6f0 0x7f2b081205b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b0f085700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b0809e1d0 0x7f2b08120af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b0f085700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b08135e50 0x7f2b081c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b0f085700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b08132490 con 0x7f2b0809e1d0 2023-09-30T22:33:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b0f085700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b08123880 con 0x7f2b08135e50 2023-09-30T22:33:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b0f085700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b081200d0 con 0x7f2b0809d6f0 2023-09-30T22:33:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b0d622700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b08135e50 0x7f2b081c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b0d622700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b08135e50 0x7f2b081c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43338/0 (socket says 172.21.15.59:43338) 2023-09-30T22:33:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b0d622700 1 -- 172.21.15.59:0/2582570195 learned_addr learned my addr 172.21.15.59:0/2582570195 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b07fff700 1 --2- 172.21.15.59:0/2582570195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b0809e1d0 0x7f2b08120af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b07fff700 1 -- 172.21.15.59:0/2582570195 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b0809d6f0 msgr2=0x7f2b081205b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b07fff700 1 --2- 172.21.15.59:0/2582570195 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b0809d6f0 0x7f2b081205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b07fff700 1 -- 172.21.15.59:0/2582570195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b08135e50 msgr2=0x7f2b081c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b07fff700 1 --2- 172.21.15.59:0/2582570195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b08135e50 0x7f2b081c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b07fff700 1 -- 172.21.15.59:0/2582570195 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af400b7f0 con 0x7f2b0809e1d0 2023-09-30T22:33:45.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b0d622700 1 --2- 172.21.15.59:0/2582570195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b08135e50 0x7f2b081c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:45.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.932+0000 7f2b07fff700 1 --2- 172.21.15.59:0/2582570195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b0809e1d0 0x7f2b08120af0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f2b0809f6f0 tx=0x7f2af4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:45.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.933+0000 7f2b057fa700 1 -- 172.21.15.59:0/2582570195 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4003bf0 con 0x7f2b0809e1d0 2023-09-30T22:33:45.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.933+0000 7f2b057fa700 1 -- 172.21.15.59:0/2582570195 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af4003d70 con 0x7f2b0809e1d0 2023-09-30T22:33:45.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.933+0000 7f2b057fa700 1 -- 172.21.15.59:0/2582570195 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4003ee0 con 0x7f2b0809e1d0 2023-09-30T22:33:45.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.933+0000 7f2b0f085700 1 -- 172.21.15.59:0/2582570195 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b081233f0 con 0x7f2b0809e1d0 2023-09-30T22:33:45.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.933+0000 7f2b0f085700 1 -- 172.21.15.59:0/2582570195 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b081228a0 con 0x7f2b0809e1d0 2023-09-30T22:33:45.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.934+0000 7f2b057fa700 1 -- 172.21.15.59:0/2582570195 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2af4019400 con 0x7f2b0809e1d0 2023-09-30T22:33:45.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.934+0000 7f2b0f085700 1 -- 172.21.15.59:0/2582570195 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b08122450 con 0x7f2b0809e1d0 2023-09-30T22:33:45.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.934+0000 7f2b057fa700 1 -- 172.21.15.59:0/2582570195 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2af4040480 con 0x7f2b0809e1d0 2023-09-30T22:33:45.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.939+0000 7f2b057fa700 1 -- 172.21.15.59:0/2582570195 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2af400f3d0 con 0x7f2b0809e1d0 2023-09-30T22:33:45.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.993+0000 7ff684167700 1 Processor -- start 2023-09-30T22:33:45.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.993+0000 7ff684167700 1 -- start start 2023-09-30T22:33:45.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.994+0000 7ff684167700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff67c06a770 0x7ff67c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.994+0000 7ff684167700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c09dc30 0x7ff67c09e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:45.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.994+0000 7ff684167700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67c09a810 con 0x7ff67c13c1e0 2023-09-30T22:33:45.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.994+0000 7ff684167700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c06ab40 con 0x7ff67c09dc30 2023-09-30T22:33:45.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.994+0000 7ff684167700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c09ebc0 con 0x7ff67c06a770 2023-09-30T22:33:45.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.994+0000 7ff681f03700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff67c06a770 0x7ff67c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.994+0000 7ff682704700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff67c13c1e0 0x7ff67c13e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52398/0 (socket says 172.21.15.59:52398) 2023-09-30T22:33:45.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.994+0000 7ff682704700 1 -- 172.21.15.59:0/1838122978 learned_addr learned my addr 172.21.15.59:0/1838122978 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:45.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.994+0000 7ff681702700 1 --2- 172.21.15.59:0/1838122978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c09dc30 0x7ff67c09e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:45.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.995+0000 7ff681702700 1 -- 172.21.15.59:0/1838122978 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff67c06a770 msgr2=0x7ff67c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:45.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.995+0000 7ff680f01700 1 -- 172.21.15.59:0/1838122978 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510592188 0 0) 0x7ff67c09a810 con 0x7ff67c13c1e0 2023-09-30T22:33:45.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.995+0000 7ff681702700 1 --2- 172.21.15.59:0/1838122978 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff67c06a770 0x7ff67c09d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.995+0000 7ff681702700 1 -- 172.21.15.59:0/1838122978 >> v1:172.21.15.59:6789/0 conn(0x7ff67c13c1e0 legacy=0x7ff67c13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:45.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.995+0000 7ff681702700 1 -- 172.21.15.59:0/1838122978 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c09e920 con 0x7ff67c09dc30 2023-09-30T22:33:45.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.995+0000 7ff681f03700 1 --2- 172.21.15.59:0/1838122978 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff67c06a770 0x7ff67c09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:45.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.995+0000 7ff681702700 1 --2- 172.21.15.59:0/1838122978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c09dc30 0x7ff67c09e080 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009870 tx=0x7ff66c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf3f3b1dc38ad5bf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:45.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.995+0000 7ff680f01700 1 -- 172.21.15.59:0/1838122978 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c011830 con 0x7ff67c09dc30 2023-09-30T22:33:45.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.995+0000 7ff680f01700 1 -- 172.21.15.59:0/1838122978 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c011990 con 0x7ff67c09dc30 2023-09-30T22:33:45.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.995+0000 7ff680f01700 1 -- 172.21.15.59:0/1838122978 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c011d20 con 0x7ff67c09dc30 2023-09-30T22:33:45.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.996+0000 7ff684167700 1 -- 172.21.15.59:0/1838122978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c09dc30 msgr2=0x7ff67c09e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:45.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.996+0000 7ff684167700 1 --2- 172.21.15.59:0/1838122978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c09dc30 0x7ff67c09e080 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009870 tx=0x7ff66c009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:45.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.996+0000 7ff684167700 1 -- 172.21.15.59:0/1838122978 shutdown_connections 2023-09-30T22:33:45.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.996+0000 7ff684167700 1 --2- 172.21.15.59:0/1838122978 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff67c06a770 0x7ff67c09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.996+0000 7ff684167700 1 --2- 172.21.15.59:0/1838122978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c09dc30 0x7ff67c09e080 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:45.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.996+0000 7ff684167700 1 -- 172.21.15.59:0/1838122978 >> 172.21.15.59:0/1838122978 conn(0x7ff67c066f50 msgr2=0x7ff67c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:45.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.996+0000 7ff684167700 1 -- 172.21.15.59:0/1838122978 shutdown_connections 2023-09-30T22:33:45.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.996+0000 7ff684167700 1 -- 172.21.15.59:0/1838122978 wait complete. 2023-09-30T22:33:46.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.997+0000 7ff684167700 1 Processor -- start 2023-09-30T22:33:46.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.998+0000 7ff684167700 1 -- start start 2023-09-30T22:33:46.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.998+0000 7ff684167700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c06a770 0x7ff67c1cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:46.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.998+0000 7ff684167700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c09dc30 0x7ff67c1ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:46.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.998+0000 7ff684167700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff67c13c1e0 0x7ff67c127140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:46.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.998+0000 7ff684167700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c12a710 con 0x7ff67c06a770 2023-09-30T22:33:46.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.998+0000 7ff684167700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c1c12c0 con 0x7ff67c09dc30 2023-09-30T22:33:46.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.998+0000 7ff684167700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0a37b0 con 0x7ff67c13c1e0 2023-09-30T22:33:46.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.998+0000 7ff681702700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c09dc30 0x7ff67c1ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:46.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.998+0000 7ff681702700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c09dc30 0x7ff67c1ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43360/0 (socket says 172.21.15.59:43360) 2023-09-30T22:33:46.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.998+0000 7ff681702700 1 -- 172.21.15.59:0/3156222758 learned_addr learned my addr 172.21.15.59:0/3156222758 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:46.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.998+0000 7ff681f03700 1 --2- 172.21.15.59:0/3156222758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c06a770 0x7ff67c1cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:46.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.999+0000 7ff681702700 1 -- 172.21.15.59:0/3156222758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff67c13c1e0 msgr2=0x7ff67c127140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:46.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.999+0000 7ff681702700 1 --2- 172.21.15.59:0/3156222758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff67c13c1e0 0x7ff67c127140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.999+0000 7ff681702700 1 -- 172.21.15.59:0/3156222758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c06a770 msgr2=0x7ff67c1cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:46.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.999+0000 7ff681702700 1 --2- 172.21.15.59:0/3156222758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c06a770 0x7ff67c1cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.999+0000 7ff681702700 1 -- 172.21.15.59:0/3156222758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6780094a0 con 0x7ff67c09dc30 2023-09-30T22:33:46.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.999+0000 7ff681702700 1 --2- 172.21.15.59:0/3156222758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c09dc30 0x7ff67c1ccc70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0090b0 tx=0x7ff66c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:46.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.999+0000 7ff6727fc700 1 -- 172.21.15.59:0/3156222758 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c0045d0 con 0x7ff67c09dc30 2023-09-30T22:33:46.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.999+0000 7ff6727fc700 1 -- 172.21.15.59:0/3156222758 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c01f070 con 0x7ff67c09dc30 2023-09-30T22:33:46.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.999+0000 7ff684167700 1 -- 172.21.15.59:0/3156222758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c0094a0 con 0x7ff67c09dc30 2023-09-30T22:33:46.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.999+0000 7ff6727fc700 1 -- 172.21.15.59:0/3156222758 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c0038a0 con 0x7ff67c09dc30 2023-09-30T22:33:46.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:45.999+0000 7ff684167700 1 -- 172.21.15.59:0/3156222758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67c12b3b0 con 0x7ff67c09dc30 2023-09-30T22:33:46.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.000+0000 7ff6727fc700 1 -- 172.21.15.59:0/3156222758 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff66c003a00 con 0x7ff67c09dc30 2023-09-30T22:33:46.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.000+0000 7ff6727fc700 1 -- 172.21.15.59:0/3156222758 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff66c021070 con 0x7ff67c09dc30 2023-09-30T22:33:46.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.001+0000 7ff684167700 1 -- 172.21.15.59:0/3156222758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67c074ea0 con 0x7ff67c09dc30 2023-09-30T22:33:46.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.006+0000 7ff6727fc700 1 -- 172.21.15.59:0/3156222758 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff66c015020 con 0x7ff67c09dc30 2023-09-30T22:33:46.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.148+0000 7f2b0f085700 1 -- 172.21.15.59:0/2582570195 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2b08074ea0 con 0x7f2b0809e1d0 2023-09-30T22:33:46.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.148+0000 7f2b057fa700 1 -- 172.21.15.59:0/2582570195 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2af4027020 con 0x7f2b0809e1d0 2023-09-30T22:33:46.150 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:46.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.151+0000 7f2b0f085700 1 -- 172.21.15.59:0/2582570195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b0809e1d0 msgr2=0x7f2b08120af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:46.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.151+0000 7f2b0f085700 1 --2- 172.21.15.59:0/2582570195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b0809e1d0 0x7f2b08120af0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f2b0809f6f0 tx=0x7f2af4004750 comp rx=0 tx=0).stop 2023-09-30T22:33:46.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.151+0000 7f2b0f085700 1 -- 172.21.15.59:0/2582570195 shutdown_connections 2023-09-30T22:33:46.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.151+0000 7f2b0f085700 1 --2- 172.21.15.59:0/2582570195 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b0809d6f0 0x7f2b081205b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.151+0000 7f2b0f085700 1 --2- 172.21.15.59:0/2582570195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b08135e50 0x7f2b081c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.151+0000 7f2b0f085700 1 --2- 172.21.15.59:0/2582570195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b0809e1d0 0x7f2b08120af0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.151+0000 7f2b0f085700 1 -- 172.21.15.59:0/2582570195 >> 172.21.15.59:0/2582570195 conn(0x7f2b08066f50 msgr2=0x7f2b080a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:46.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.151+0000 7f2b0f085700 1 -- 172.21.15.59:0/2582570195 shutdown_connections 2023-09-30T22:33:46.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.151+0000 7f2b0f085700 1 -- 172.21.15.59:0/2582570195 wait complete. 2023-09-30T22:33:46.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.162+0000 7f76e893a700 1 -- 172.21.15.59:0/2141691208 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f76e406c360 con 0x7f76e409e410 2023-09-30T22:33:46.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.163+0000 7f76d2ffd700 1 -- 172.21.15.59:0/2141691208 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f76dc012340 con 0x7f76e409e410 2023-09-30T22:33:46.163 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:46.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:46.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.165+0000 7f76e893a700 1 -- 172.21.15.59:0/2141691208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e409e410 msgr2=0x7f76e41194b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:46.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.165+0000 7f76e893a700 1 --2- 172.21.15.59:0/2141691208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e409e410 0x7f76e41194b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00efc0 tx=0x7f76dc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.165+0000 7f76e893a700 1 -- 172.21.15.59:0/2141691208 shutdown_connections 2023-09-30T22:33:46.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.165+0000 7f76e893a700 1 --2- 172.21.15.59:0/2141691208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e409e410 0x7f76e41194b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.165+0000 7f76e893a700 1 --2- 172.21.15.59:0/2141691208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e409d6f0 0x7f76e41cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.165+0000 7f76e893a700 1 --2- 172.21.15.59:0/2141691208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e409e000 0x7f76e41cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.165+0000 7f76e893a700 1 -- 172.21.15.59:0/2141691208 >> 172.21.15.59:0/2141691208 conn(0x7f76e4066f50 msgr2=0x7f76e4133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:46.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.166+0000 7f76e893a700 1 -- 172.21.15.59:0/2141691208 shutdown_connections 2023-09-30T22:33:46.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.166+0000 7f76e893a700 1 -- 172.21.15.59:0/2141691208 wait complete. 2023-09-30T22:33:46.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.173+0000 7f3177db9700 1 -- 172.21.15.59:0/3881706392 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f31701a83f0 con 0x7f317009d6f0 2023-09-30T22:33:46.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.173+0000 7f31667fc700 1 -- 172.21.15.59:0/3881706392 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31701a83f0 con 0x7f317009d6f0 2023-09-30T22:33:46.174 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:46.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.175+0000 7f3177db9700 1 -- 172.21.15.59:0/3881706392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d6f0 msgr2=0x7f31701a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:46.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.175+0000 7f3177db9700 1 --2- 172.21.15.59:0/3881706392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d6f0 0x7f31701a61d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f316c00ebe0 tx=0x7f316c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.175+0000 7f3177db9700 1 -- 172.21.15.59:0/3881706392 shutdown_connections 2023-09-30T22:33:46.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.175+0000 7f3177db9700 1 --2- 172.21.15.59:0/3881706392 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e410 0x7f31701a6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.176+0000 7f3177db9700 1 --2- 172.21.15.59:0/3881706392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d6f0 0x7f31701a61d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.176+0000 7f3177db9700 1 --2- 172.21.15.59:0/3881706392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009e000 0x7f31701a6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.176+0000 7f3177db9700 1 -- 172.21.15.59:0/3881706392 >> 172.21.15.59:0/3881706392 conn(0x7f3170066f50 msgr2=0x7f31701bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:46.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.176+0000 7f3177db9700 1 -- 172.21.15.59:0/3881706392 shutdown_connections 2023-09-30T22:33:46.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.176+0000 7f3177db9700 1 -- 172.21.15.59:0/3881706392 wait complete. 2023-09-30T22:33:46.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:46.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:46.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.265+0000 7ff684167700 1 -- 172.21.15.59:0/3156222758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff67c06c360 con 0x7ff67c09dc30 2023-09-30T22:33:46.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.266+0000 7ff6727fc700 1 -- 172.21.15.59:0/3156222758 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff66c010380 con 0x7ff67c09dc30 2023-09-30T22:33:46.266 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:46.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.268+0000 7ff684167700 1 -- 172.21.15.59:0/3156222758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c09dc30 msgr2=0x7ff67c1ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:46.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.268+0000 7ff684167700 1 --2- 172.21.15.59:0/3156222758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c09dc30 0x7ff67c1ccc70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0090b0 tx=0x7ff66c004750 comp rx=0 tx=0).stop 2023-09-30T22:33:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.268+0000 7ff684167700 1 -- 172.21.15.59:0/3156222758 shutdown_connections 2023-09-30T22:33:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.268+0000 7ff684167700 1 --2- 172.21.15.59:0/3156222758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff67c13c1e0 0x7ff67c127140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.268+0000 7ff684167700 1 --2- 172.21.15.59:0/3156222758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c06a770 0x7ff67c1cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.268+0000 7ff684167700 1 --2- 172.21.15.59:0/3156222758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c09dc30 0x7ff67c1ccc70 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.268+0000 7ff684167700 1 -- 172.21.15.59:0/3156222758 >> 172.21.15.59:0/3156222758 conn(0x7ff67c066f50 msgr2=0x7ff67c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.268+0000 7ff684167700 1 -- 172.21.15.59:0/3156222758 shutdown_connections 2023-09-30T22:33:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:46.268+0000 7ff684167700 1 -- 172.21.15.59:0/3156222758 wait complete. 2023-09-30T22:33:46.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:47.166 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:47.182 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:47.190 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:47.283 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:47.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.323+0000 7f9522094700 1 Processor -- start 2023-09-30T22:33:47.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.323+0000 7f9522094700 1 -- start start 2023-09-30T22:33:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.324+0000 7f9522094700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f951c133420 0x7f951c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.324+0000 7f9522094700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f951c134260 0x7f951c1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.324+0000 7f9522094700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f951c06b990 con 0x7f951c133e30 2023-09-30T22:33:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.324+0000 7f9522094700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c0a0590 con 0x7f951c133420 2023-09-30T22:33:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.324+0000 7f9522094700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c09fb80 con 0x7f951c134260 2023-09-30T22:33:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.324+0000 7f951affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f951c133e30 0x7f951c12ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52412/0 (socket says 172.21.15.59:52412) 2023-09-30T22:33:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.324+0000 7f951affd700 1 -- 172.21.15.59:0/2306441198 learned_addr learned my addr 172.21.15.59:0/2306441198 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.324+0000 7f951b7fe700 1 --2- 172.21.15.59:0/2306441198 >> v2:172.21.15.59:3300/0 conn(0x7f951c133420 0x7f951c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.324+0000 7f951b7fe700 1 -- 172.21.15.59:0/2306441198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f951c134260 msgr2=0x7f951c1306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.324+0000 7f951b7fe700 1 --2- 172.21.15.59:0/2306441198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f951c134260 0x7f951c1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.324+0000 7f951b7fe700 1 -- 172.21.15.59:0/2306441198 >> v1:172.21.15.59:6789/0 conn(0x7f951c133e30 legacy=0x7f951c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.325+0000 7f951b7fe700 1 -- 172.21.15.59:0/2306441198 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c0a0030 con 0x7f951c133420 2023-09-30T22:33:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.325+0000 7f951b7fe700 1 --2- 172.21.15.59:0/2306441198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c133420 0x7f951c1337f0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f950c009840 tx=0x7f950c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b4c1031905104e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.325+0000 7f951a7fc700 1 -- 172.21.15.59:0/2306441198 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c011830 con 0x7f951c133420 2023-09-30T22:33:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.325+0000 7f951a7fc700 1 -- 172.21.15.59:0/2306441198 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c011990 con 0x7f951c133420 2023-09-30T22:33:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.325+0000 7f951a7fc700 1 -- 172.21.15.59:0/2306441198 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c011d20 con 0x7f951c133420 2023-09-30T22:33:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.326+0000 7f9522094700 1 -- 172.21.15.59:0/2306441198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c133420 msgr2=0x7f951c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.326+0000 7f9522094700 1 --2- 172.21.15.59:0/2306441198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c133420 0x7f951c1337f0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f950c009840 tx=0x7f950c009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.326+0000 7f9522094700 1 -- 172.21.15.59:0/2306441198 shutdown_connections 2023-09-30T22:33:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.326+0000 7f9522094700 1 --2- 172.21.15.59:0/2306441198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c133420 0x7f951c1337f0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.326+0000 7f9522094700 1 --2- 172.21.15.59:0/2306441198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f951c134260 0x7f951c1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.326+0000 7f9522094700 1 -- 172.21.15.59:0/2306441198 >> 172.21.15.59:0/2306441198 conn(0x7f951c0a4210 msgr2=0x7f951c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.326+0000 7f9522094700 1 -- 172.21.15.59:0/2306441198 shutdown_connections 2023-09-30T22:33:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.326+0000 7f9522094700 1 -- 172.21.15.59:0/2306441198 wait complete. 2023-09-30T22:33:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.327+0000 7f9522094700 1 Processor -- start 2023-09-30T22:33:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.327+0000 7f9522094700 1 -- start start 2023-09-30T22:33:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.328+0000 7f9522094700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c133420 0x7f951c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.328+0000 7f9522094700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f951c133e30 0x7f951c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.328+0000 7f9522094700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f951c134260 0x7f951c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.328+0000 7f9522094700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c12d730 con 0x7f951c133420 2023-09-30T22:33:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.328+0000 7f9522094700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c09e060 con 0x7f951c133e30 2023-09-30T22:33:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.328+0000 7f9522094700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f951c120040 con 0x7f951c134260 2023-09-30T22:33:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.328+0000 7f951b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c133420 0x7f951c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.328+0000 7f951b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c133420 0x7f951c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58990/0 (socket says 172.21.15.59:58990) 2023-09-30T22:33:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.328+0000 7f951b7fe700 1 -- 172.21.15.59:0/583841667 learned_addr learned my addr 172.21.15.59:0/583841667 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.328+0000 7f951bfff700 1 --2- 172.21.15.59:0/583841667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f951c134260 0x7f951c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.328+0000 7f951b7fe700 1 -- 172.21.15.59:0/583841667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f951c134260 msgr2=0x7f951c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.328+0000 7f951b7fe700 1 --2- 172.21.15.59:0/583841667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f951c134260 0x7f951c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.328+0000 7f951affd700 1 --2- 172.21.15.59:0/583841667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f951c133e30 0x7f951c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.328+0000 7f951b7fe700 1 -- 172.21.15.59:0/583841667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f951c133e30 msgr2=0x7f951c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.328+0000 7f951b7fe700 1 --2- 172.21.15.59:0/583841667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f951c133e30 0x7f951c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.329+0000 7f951b7fe700 1 -- 172.21.15.59:0/583841667 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950c0094a0 con 0x7f951c133420 2023-09-30T22:33:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.329+0000 7f951affd700 1 --2- 172.21.15.59:0/583841667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f951c133e30 0x7f951c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.329+0000 7f951b7fe700 1 --2- 172.21.15.59:0/583841667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c133420 0x7f951c09c480 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f951c0a06d0 tx=0x7f950c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.329+0000 7f9503fff700 1 -- 172.21.15.59:0/583841667 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c0044f0 con 0x7f951c133420 2023-09-30T22:33:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.329+0000 7f9503fff700 1 -- 172.21.15.59:0/583841667 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c01f070 con 0x7f951c133420 2023-09-30T22:33:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.329+0000 7f9522094700 1 -- 172.21.15.59:0/583841667 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951c1317d0 con 0x7f951c133420 2023-09-30T22:33:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.329+0000 7f9503fff700 1 -- 172.21.15.59:0/583841667 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c0038e0 con 0x7f951c133420 2023-09-30T22:33:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.329+0000 7f9522094700 1 -- 172.21.15.59:0/583841667 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951c120a90 con 0x7f951c133420 2023-09-30T22:33:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.330+0000 7f9503fff700 1 -- 172.21.15.59:0/583841667 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f950c021030 con 0x7f951c133420 2023-09-30T22:33:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.331+0000 7f9503fff700 1 -- 172.21.15.59:0/583841667 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f950c040b30 con 0x7f951c133420 2023-09-30T22:33:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.331+0000 7f9522094700 1 -- 172.21.15.59:0/583841667 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951c12eec0 con 0x7f951c133420 2023-09-30T22:33:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.336+0000 7f9503fff700 1 -- 172.21.15.59:0/583841667 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f950c01a7d0 con 0x7f951c133420 2023-09-30T22:33:47.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.362+0000 7fa4f8e59700 1 Processor -- start 2023-09-30T22:33:47.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.362+0000 7fa4f8e59700 1 -- start start 2023-09-30T22:33:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.363+0000 7fa4f8e59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f409e930 0x7fa4f409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.363+0000 7fa4f8e59700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4f409f240 0x7fa4f41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.363+0000 7fa4f8e59700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f4070940 con 0x7fa4f409f650 2023-09-30T22:33:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.363+0000 7fa4f8e59700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f406fd60 con 0x7fa4f409e930 2023-09-30T22:33:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.363+0000 7fa4f8e59700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f406fa80 con 0x7fa4f409f240 2023-09-30T22:33:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.363+0000 7fa4f2d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa4f409f650 0x7fa4f4131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52414/0 (socket says 172.21.15.59:52414) 2023-09-30T22:33:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.363+0000 7fa4f259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f409e930 0x7fa4f409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.363+0000 7fa4f2d9d700 1 -- 172.21.15.59:0/2977493114 learned_addr learned my addr 172.21.15.59:0/2977493114 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.363+0000 7fa4ebfff700 1 --2- 172.21.15.59:0/2977493114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4f409f240 0x7fa4f41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.363+0000 7fa4f259c700 1 -- 172.21.15.59:0/2977493114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4f409f240 msgr2=0x7fa4f41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.363+0000 7fa4f259c700 1 --2- 172.21.15.59:0/2977493114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4f409f240 0x7fa4f41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.363+0000 7fa4f259c700 1 -- 172.21.15.59:0/2977493114 >> v1:172.21.15.59:6789/0 conn(0x7fa4f409f650 legacy=0x7fa4f4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.363+0000 7fa4f259c700 1 -- 172.21.15.59:0/2977493114 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f409fb60 con 0x7fa4f409e930 2023-09-30T22:33:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.363+0000 7fa4f1d9b700 1 -- 172.21.15.59:0/2977493114 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255648019 0 0) 0x7fa4f4070940 con 0x7fa4f409f650 2023-09-30T22:33:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.363+0000 7fa4ebfff700 1 --2- 172.21.15.59:0/2977493114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4f409f240 0x7fa4f41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.364+0000 7fa4f259c700 1 --2- 172.21.15.59:0/2977493114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f409e930 0x7fa4f409ed00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4009870 tx=0x7fa4e4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0d68b85476d1c35 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.364+0000 7fa4f1d9b700 1 -- 172.21.15.59:0/2977493114 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4011830 con 0x7fa4f409e930 2023-09-30T22:33:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.364+0000 7fa4f1d9b700 1 -- 172.21.15.59:0/2977493114 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e4011990 con 0x7fa4f409e930 2023-09-30T22:33:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.364+0000 7fa4f1d9b700 1 -- 172.21.15.59:0/2977493114 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4011d20 con 0x7fa4f409e930 2023-09-30T22:33:47.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.365+0000 7fa4f8e59700 1 -- 172.21.15.59:0/2977493114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f409e930 msgr2=0x7fa4f409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.365+0000 7fa4f8e59700 1 --2- 172.21.15.59:0/2977493114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f409e930 0x7fa4f409ed00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4009870 tx=0x7fa4e4009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:47.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.365+0000 7fa4f8e59700 1 -- 172.21.15.59:0/2977493114 shutdown_connections 2023-09-30T22:33:47.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.365+0000 7fa4f8e59700 1 --2- 172.21.15.59:0/2977493114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f409e930 0x7fa4f409ed00 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.365+0000 7fa4f8e59700 1 --2- 172.21.15.59:0/2977493114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4f409f240 0x7fa4f41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.365+0000 7fa4f8e59700 1 -- 172.21.15.59:0/2977493114 >> 172.21.15.59:0/2977493114 conn(0x7fa4f40a4210 msgr2=0x7fa4f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:47.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.365+0000 7fa4f8e59700 1 -- 172.21.15.59:0/2977493114 shutdown_connections 2023-09-30T22:33:47.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.365+0000 7fa4f8e59700 1 -- 172.21.15.59:0/2977493114 wait complete. 2023-09-30T22:33:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.367+0000 7fa4f8e59700 1 Processor -- start 2023-09-30T22:33:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.367+0000 7fa4f8e59700 1 -- start start 2023-09-30T22:33:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.367+0000 7fa4f8e59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f409e930 0x7fa4f41a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.367+0000 7fa4f8e59700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4f409f240 0x7fa4f41a41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.367+0000 7fa4f8e59700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f409f650 0x7fa4f41a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.367+0000 7fa4f8e59700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f41a5140 con 0x7fa4f409f650 2023-09-30T22:33:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.367+0000 7fa4f8e59700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f41a58a0 con 0x7fa4f409e930 2023-09-30T22:33:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.367+0000 7fa4f8e59700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f41a6af0 con 0x7fa4f409f240 2023-09-30T22:33:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.368+0000 7fa4f259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f409e930 0x7fa4f41a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.368+0000 7fa4f259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f409e930 0x7fa4f41a3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43394/0 (socket says 172.21.15.59:43394) 2023-09-30T22:33:47.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.368+0000 7fa4f259c700 1 -- 172.21.15.59:0/962557040 learned_addr learned my addr 172.21.15.59:0/962557040 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:47.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.368+0000 7fa4ebfff700 1 --2- 172.21.15.59:0/962557040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4f409f240 0x7fa4f41a41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.368+0000 7fa4f259c700 1 -- 172.21.15.59:0/962557040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4f409f240 msgr2=0x7fa4f41a41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.368+0000 7fa4f259c700 1 --2- 172.21.15.59:0/962557040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4f409f240 0x7fa4f41a41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.368+0000 7fa4f259c700 1 -- 172.21.15.59:0/962557040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f409f650 msgr2=0x7fa4f41a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.368+0000 7fa4f259c700 1 --2- 172.21.15.59:0/962557040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f409f650 0x7fa4f41a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.368+0000 7fa4f259c700 1 -- 172.21.15.59:0/962557040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e40094a0 con 0x7fa4f409e930 2023-09-30T22:33:47.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.368+0000 7fa4f259c700 1 --2- 172.21.15.59:0/962557040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f409e930 0x7fa4f41a3c90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4000c00 tx=0x7fa4e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:47.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.369+0000 7fa4eaffd700 1 -- 172.21.15.59:0/962557040 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40036a0 con 0x7fa4f409e930 2023-09-30T22:33:47.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.369+0000 7fa4eaffd700 1 -- 172.21.15.59:0/962557040 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e401f070 con 0x7fa4f409e930 2023-09-30T22:33:47.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.369+0000 7fa4eaffd700 1 -- 172.21.15.59:0/962557040 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4003a40 con 0x7fa4f409e930 2023-09-30T22:33:47.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.369+0000 7fa4f8e59700 1 -- 172.21.15.59:0/962557040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f40a0190 con 0x7fa4f409e930 2023-09-30T22:33:47.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.369+0000 7fa4f8e59700 1 -- 172.21.15.59:0/962557040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f40a3410 con 0x7fa4f409e930 2023-09-30T22:33:47.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.370+0000 7fa4eaffd700 1 -- 172.21.15.59:0/962557040 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4e4003ba0 con 0x7fa4f409e930 2023-09-30T22:33:47.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.370+0000 7fa4f8e59700 1 -- 172.21.15.59:0/962557040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f41a0b30 con 0x7fa4f409e930 2023-09-30T22:33:47.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.370+0000 7fa4eaffd700 1 -- 172.21.15.59:0/962557040 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa4e4021070 con 0x7fa4f409e930 2023-09-30T22:33:47.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.371+0000 7f6527224700 1 Processor -- start 2023-09-30T22:33:47.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.371+0000 7f6527224700 1 -- start start 2023-09-30T22:33:47.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.372+0000 7f6527224700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652009e1d0 0x7f6520138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.372+0000 7f6527224700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520139170 0x7f652013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.372+0000 7f6527224700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652009b120 con 0x7f652009d6f0 2023-09-30T22:33:47.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.372+0000 7f6527224700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652006b460 con 0x7f652009e1d0 2023-09-30T22:33:47.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.372+0000 7f6527224700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f652009a7e0 con 0x7f6520139170 2023-09-30T22:33:47.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.372+0000 7f651ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652009e1d0 0x7f6520138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.372+0000 7f6524fc0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f652009d6f0 0x7f652009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52426/0 (socket says 172.21.15.59:52426) 2023-09-30T22:33:47.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.372+0000 7f6524fc0700 1 -- 172.21.15.59:0/2782612894 learned_addr learned my addr 172.21.15.59:0/2782612894 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:47.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.372+0000 7f651f7fe700 1 -- 172.21.15.59:0/2782612894 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370713237 0 0) 0x7f652009b120 con 0x7f652009d6f0 2023-09-30T22:33:47.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.372+0000 7f651f7fe700 1 -- 172.21.15.59:0/2782612894 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65100035b0 con 0x7f652009d6f0 2023-09-30T22:33:47.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.372+0000 7f651ffff700 1 -- 172.21.15.59:0/2782612894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520139170 msgr2=0x7f652013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:47.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.372+0000 7f651ffff700 1 --2- 172.21.15.59:0/2782612894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520139170 0x7f652013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.372+0000 7f651ffff700 1 -- 172.21.15.59:0/2782612894 >> v1:172.21.15.59:6789/0 conn(0x7f652009d6f0 legacy=0x7f652009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.372+0000 7f651ffff700 1 -- 172.21.15.59:0/2782612894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652009a500 con 0x7f652009e1d0 2023-09-30T22:33:47.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.373+0000 7f651ffff700 1 --2- 172.21.15.59:0/2782612894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652009e1d0 0x7f6520138c30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f650c009870 tx=0x7f650c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b96f8225a9e117c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:47.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.376+0000 7f651f7fe700 1 -- 172.21.15.59:0/2782612894 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c011830 con 0x7f652009e1d0 2023-09-30T22:33:47.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.376+0000 7f651f7fe700 1 -- 172.21.15.59:0/2782612894 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c011990 con 0x7f652009e1d0 2023-09-30T22:33:47.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.376+0000 7f651f7fe700 1 -- 172.21.15.59:0/2782612894 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c011d20 con 0x7f652009e1d0 2023-09-30T22:33:47.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.376+0000 7fa4eaffd700 1 -- 172.21.15.59:0/962557040 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4e402b080 con 0x7fa4f409e930 2023-09-30T22:33:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.377+0000 7f6527224700 1 -- 172.21.15.59:0/2782612894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652009e1d0 msgr2=0x7f6520138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.377+0000 7f6527224700 1 --2- 172.21.15.59:0/2782612894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652009e1d0 0x7f6520138c30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f650c009870 tx=0x7f650c009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.377+0000 7f6527224700 1 -- 172.21.15.59:0/2782612894 shutdown_connections 2023-09-30T22:33:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.377+0000 7f6527224700 1 --2- 172.21.15.59:0/2782612894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520139170 0x7f652013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.377+0000 7f6527224700 1 --2- 172.21.15.59:0/2782612894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652009e1d0 0x7f6520138c30 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.377+0000 7f6527224700 1 -- 172.21.15.59:0/2782612894 >> 172.21.15.59:0/2782612894 conn(0x7f6520066f50 msgr2=0x7f652009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:47.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.379+0000 7f6527224700 1 -- 172.21.15.59:0/2782612894 shutdown_connections 2023-09-30T22:33:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.379+0000 7f6527224700 1 -- 172.21.15.59:0/2782612894 wait complete. 2023-09-30T22:33:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.380+0000 7f6527224700 1 Processor -- start 2023-09-30T22:33:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.380+0000 7f6527224700 1 -- start start 2023-09-30T22:33:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.381+0000 7f6527224700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652009d6f0 0x7f65201217c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.381+0000 7f6527224700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652009e1d0 0x7f6520121d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.381+0000 7f6527224700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520139170 0x7f6520122240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.381+0000 7f6527224700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65200a3ba0 con 0x7f652009e1d0 2023-09-30T22:33:47.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.381+0000 7f6527224700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65201253f0 con 0x7f652009d6f0 2023-09-30T22:33:47.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.381+0000 7f6527224700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6520124a90 con 0x7f6520139170 2023-09-30T22:33:47.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.381+0000 7f65257c1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520139170 0x7f6520122240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.381+0000 7f65257c1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520139170 0x7f6520122240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36344/0 (socket says 172.21.15.59:36344) 2023-09-30T22:33:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.381+0000 7f65257c1700 1 -- 172.21.15.59:0/2106346472 learned_addr learned my addr 172.21.15.59:0/2106346472 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.381+0000 7f6524fc0700 1 --2- 172.21.15.59:0/2106346472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652009d6f0 0x7f65201217c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.382+0000 7f65257c1700 1 -- 172.21.15.59:0/2106346472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652009d6f0 msgr2=0x7f65201217c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.382+0000 7f65257c1700 1 --2- 172.21.15.59:0/2106346472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652009d6f0 0x7f65201217c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.382+0000 7f65257c1700 1 -- 172.21.15.59:0/2106346472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652009e1d0 msgr2=0x7f6520121d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.382+0000 7f65257c1700 1 --2- 172.21.15.59:0/2106346472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652009e1d0 0x7f6520121d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.382+0000 7f65257c1700 1 -- 172.21.15.59:0/2106346472 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c0094a0 con 0x7f6520139170 2023-09-30T22:33:47.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.382+0000 7f65257c1700 1 --2- 172.21.15.59:0/2106346472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520139170 0x7f6520122240 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f651800b9a0 tx=0x7f651800bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:47.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.382+0000 7f651d7fa700 1 -- 172.21.15.59:0/2106346472 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651800c930 con 0x7f6520139170 2023-09-30T22:33:47.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.382+0000 7f651d7fa700 1 -- 172.21.15.59:0/2106346472 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651800cab0 con 0x7f6520139170 2023-09-30T22:33:47.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.382+0000 7f6527224700 1 -- 172.21.15.59:0/2106346472 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6520124d40 con 0x7f6520139170 2023-09-30T22:33:47.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.382+0000 7f651d7fa700 1 -- 172.21.15.59:0/2106346472 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651800ce60 con 0x7f6520139170 2023-09-30T22:33:47.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.383+0000 7f6527224700 1 -- 172.21.15.59:0/2106346472 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6520123bc0 con 0x7f6520139170 2023-09-30T22:33:47.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.384+0000 7f651d7fa700 1 -- 172.21.15.59:0/2106346472 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f651801d3b0 con 0x7f6520139170 2023-09-30T22:33:47.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.384+0000 7f651d7fa700 1 -- 172.21.15.59:0/2106346472 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6518006e40 con 0x7f6520139170 2023-09-30T22:33:47.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.384+0000 7f6527224700 1 -- 172.21.15.59:0/2106346472 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6520074ea0 con 0x7f6520139170 2023-09-30T22:33:47.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.393+0000 7f651d7fa700 1 -- 172.21.15.59:0/2106346472 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6518019080 con 0x7f6520139170 2023-09-30T22:33:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.441+0000 7f61fee9c700 1 Processor -- start 2023-09-30T22:33:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.441+0000 7f61fee9c700 1 -- start start 2023-09-30T22:33:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.441+0000 7f61fee9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f806c0e0 0x7f61f809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.441+0000 7f61fee9c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61f8134ec0 0x7f61f81379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.441+0000 7f61fee9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f8137f20 0x7f61f81383c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.441+0000 7f61fee9c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f806c4b0 con 0x7f61f8134ec0 2023-09-30T22:33:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.441+0000 7f61fee9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80a09c0 con 0x7f61f8137f20 2023-09-30T22:33:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.441+0000 7f61fee9c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8134980 con 0x7f61f806c0e0 2023-09-30T22:33:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.442+0000 7f61f7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61f8134ec0 0x7f61f81379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.442+0000 7f61fcc38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f806c0e0 0x7f61f809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.442+0000 7f61f7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61f8134ec0 0x7f61f81379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59018/0 (socket says 172.21.15.59:59018) 2023-09-30T22:33:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.442+0000 7f61fcc38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f806c0e0 0x7f61f809ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36350/0 (socket says 172.21.15.59:36350) 2023-09-30T22:33:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.442+0000 7f61f7fff700 1 -- 172.21.15.59:0/2326271470 learned_addr learned my addr 172.21.15.59:0/2326271470 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.442+0000 7f61fd439700 1 --2- 172.21.15.59:0/2326271470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f8137f20 0x7f61f81383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.442+0000 7f61f7fff700 1 -- 172.21.15.59:0/2326271470 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f806c0e0 msgr2=0x7f61f809ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:47.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.442+0000 7f61f7fff700 1 --2- 172.21.15.59:0/2326271470 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f806c0e0 0x7f61f809ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.442+0000 7f61f7fff700 1 -- 172.21.15.59:0/2326271470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f8137f20 msgr2=0x7f61f81383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:47.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.442+0000 7f61f7fff700 1 --2- 172.21.15.59:0/2326271470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f8137f20 0x7f61f81383c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.442+0000 7f61f7fff700 1 -- 172.21.15.59:0/2326271470 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f80a0600 con 0x7f61f8134ec0 2023-09-30T22:33:47.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.442+0000 7f61f7fff700 1 --2- 172.21.15.59:0/2326271470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f8134ec0 0x7f61f81379e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f61e40098f0 tx=0x7f61e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bd86ec4ed7d518 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:47.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.442+0000 7f61f77fe700 1 -- 172.21.15.59:0/2326271470 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4011830 con 0x7f61f8134ec0 2023-09-30T22:33:47.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.442+0000 7f61f77fe700 1 -- 172.21.15.59:0/2326271470 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e4011990 con 0x7f61f8134ec0 2023-09-30T22:33:47.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.442+0000 7f61f77fe700 1 -- 172.21.15.59:0/2326271470 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4011d20 con 0x7f61f8134ec0 2023-09-30T22:33:47.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.443+0000 7f61fee9c700 1 -- 172.21.15.59:0/2326271470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f8134ec0 msgr2=0x7f61f81379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.443+0000 7f61fee9c700 1 --2- 172.21.15.59:0/2326271470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f8134ec0 0x7f61f81379e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f61e40098f0 tx=0x7f61e4009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:47.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.443+0000 7f61fee9c700 1 -- 172.21.15.59:0/2326271470 shutdown_connections 2023-09-30T22:33:47.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.443+0000 7f61fee9c700 1 --2- 172.21.15.59:0/2326271470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f8137f20 0x7f61f81383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.443+0000 7f61fee9c700 1 --2- 172.21.15.59:0/2326271470 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f806c0e0 0x7f61f809ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.443+0000 7f61fee9c700 1 --2- 172.21.15.59:0/2326271470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f8134ec0 0x7f61f81379e0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.443+0000 7f61fee9c700 1 -- 172.21.15.59:0/2326271470 >> 172.21.15.59:0/2326271470 conn(0x7f61f80a4210 msgr2=0x7f61f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:47.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.443+0000 7f61fee9c700 1 -- 172.21.15.59:0/2326271470 shutdown_connections 2023-09-30T22:33:47.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.443+0000 7f61fee9c700 1 -- 172.21.15.59:0/2326271470 wait complete. 2023-09-30T22:33:47.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.445+0000 7f61fee9c700 1 Processor -- start 2023-09-30T22:33:47.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.445+0000 7f61fee9c700 1 -- start start 2023-09-30T22:33:47.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61fee9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f806c0e0 0x7f61f81ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61fee9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f8134ec0 0x7f61f81cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61fee9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f8137f20 0x7f61f811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:47.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61fee9c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f811ddb0 con 0x7f61f806c0e0 2023-09-30T22:33:47.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61fee9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f811dfb0 con 0x7f61f8134ec0 2023-09-30T22:33:47.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61fee9c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80a14f0 con 0x7f61f8137f20 2023-09-30T22:33:47.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61fd439700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f8137f20 0x7f61f811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61fd439700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f8137f20 0x7f61f811a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36356/0 (socket says 172.21.15.59:36356) 2023-09-30T22:33:47.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61fd439700 1 -- 172.21.15.59:0/2771982696 learned_addr learned my addr 172.21.15.59:0/2771982696 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:47.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61f7fff700 1 --2- 172.21.15.59:0/2771982696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f8134ec0 0x7f61f81cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61fcc38700 1 --2- 172.21.15.59:0/2771982696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f806c0e0 0x7f61f81ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:47.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61fd439700 1 -- 172.21.15.59:0/2771982696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f8134ec0 msgr2=0x7f61f81cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61fd439700 1 --2- 172.21.15.59:0/2771982696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f8134ec0 0x7f61f81cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61fd439700 1 -- 172.21.15.59:0/2771982696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f806c0e0 msgr2=0x7f61f81ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61fd439700 1 --2- 172.21.15.59:0/2771982696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f806c0e0 0x7f61f81ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.446+0000 7f61fd439700 1 -- 172.21.15.59:0/2771982696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e4009550 con 0x7f61f8137f20 2023-09-30T22:33:47.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.447+0000 7f61fd439700 1 --2- 172.21.15.59:0/2771982696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f8137f20 0x7f61f811a680 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f61f000efc0 tx=0x7f61f000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:47.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.447+0000 7f61f57fa700 1 -- 172.21.15.59:0/2771982696 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0009ea0 con 0x7f61f8137f20 2023-09-30T22:33:47.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.447+0000 7f61f57fa700 1 -- 172.21.15.59:0/2771982696 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f000f040 con 0x7f61f8137f20 2023-09-30T22:33:47.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.447+0000 7f61f57fa700 1 -- 172.21.15.59:0/2771982696 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f000ceb0 con 0x7f61f8137f20 2023-09-30T22:33:47.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.447+0000 7f61fee9c700 1 -- 172.21.15.59:0/2771982696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f80a03f0 con 0x7f61f8137f20 2023-09-30T22:33:47.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.447+0000 7f61fee9c700 1 -- 172.21.15.59:0/2771982696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f811da10 con 0x7f61f8137f20 2023-09-30T22:33:47.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.448+0000 7f61f57fa700 1 -- 172.21.15.59:0/2771982696 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61f0014480 con 0x7f61f8137f20 2023-09-30T22:33:47.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.448+0000 7f61fee9c700 1 -- 172.21.15.59:0/2771982696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f811dc00 con 0x7f61f8137f20 2023-09-30T22:33:47.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.448+0000 7f61f57fa700 1 -- 172.21.15.59:0/2771982696 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f61f003ff10 con 0x7f61f8137f20 2023-09-30T22:33:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.453+0000 7f61f57fa700 1 -- 172.21.15.59:0/2771982696 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61f0011680 con 0x7f61f8137f20 2023-09-30T22:33:47.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.565+0000 7f9522094700 1 -- 172.21.15.59:0/583841667 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f951c074ea0 con 0x7f951c133420 2023-09-30T22:33:47.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.565+0000 7f9503fff700 1 -- 172.21.15.59:0/583841667 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f950c015020 con 0x7f951c133420 2023-09-30T22:33:47.566 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.568+0000 7f9522094700 1 -- 172.21.15.59:0/583841667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c133420 msgr2=0x7f951c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.568+0000 7f9522094700 1 --2- 172.21.15.59:0/583841667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c133420 0x7f951c09c480 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f951c0a06d0 tx=0x7f950c004750 comp rx=0 tx=0).stop 2023-09-30T22:33:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.568+0000 7f9522094700 1 -- 172.21.15.59:0/583841667 shutdown_connections 2023-09-30T22:33:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.568+0000 7f9522094700 1 --2- 172.21.15.59:0/583841667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f951c134260 0x7f951c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.568+0000 7f9522094700 1 --2- 172.21.15.59:0/583841667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c133420 0x7f951c09c480 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.568+0000 7f9522094700 1 --2- 172.21.15.59:0/583841667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f951c133e30 0x7f951c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.568+0000 7f9522094700 1 -- 172.21.15.59:0/583841667 >> 172.21.15.59:0/583841667 conn(0x7f951c0a4210 msgr2=0x7f951c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:47.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.568+0000 7f9522094700 1 -- 172.21.15.59:0/583841667 shutdown_connections 2023-09-30T22:33:47.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.568+0000 7f9522094700 1 -- 172.21.15.59:0/583841667 wait complete. 2023-09-30T22:33:47.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:47.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.605+0000 7fa4f8e59700 1 -- 172.21.15.59:0/962557040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa4f409efc0 con 0x7fa4f409e930 2023-09-30T22:33:47.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.605+0000 7fa4eaffd700 1 -- 172.21.15.59:0/962557040 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4e4015020 con 0x7fa4f409e930 2023-09-30T22:33:47.606 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:47.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.607+0000 7f6527224700 1 -- 172.21.15.59:0/2106346472 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f652006c360 con 0x7f6520139170 2023-09-30T22:33:47.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.607+0000 7f651d7fa700 1 -- 172.21.15.59:0/2106346472 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6518007370 con 0x7f6520139170 2023-09-30T22:33:47.608 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.608+0000 7fa4f8e59700 1 -- 172.21.15.59:0/962557040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f409e930 msgr2=0x7fa4f41a3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.608+0000 7fa4f8e59700 1 --2- 172.21.15.59:0/962557040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f409e930 0x7fa4f41a3c90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4000c00 tx=0x7fa4e4004750 comp rx=0 tx=0).stop 2023-09-30T22:33:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.608+0000 7fa4f8e59700 1 -- 172.21.15.59:0/962557040 shutdown_connections 2023-09-30T22:33:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.608+0000 7fa4f8e59700 1 --2- 172.21.15.59:0/962557040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f409f650 0x7fa4f41a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.608+0000 7fa4f8e59700 1 --2- 172.21.15.59:0/962557040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f409e930 0x7fa4f41a3c90 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.608+0000 7fa4f8e59700 1 --2- 172.21.15.59:0/962557040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4f409f240 0x7fa4f41a41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.608+0000 7fa4f8e59700 1 -- 172.21.15.59:0/962557040 >> 172.21.15.59:0/962557040 conn(0x7fa4f40a4210 msgr2=0x7fa4f41b8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.608+0000 7fa4f8e59700 1 -- 172.21.15.59:0/962557040 shutdown_connections 2023-09-30T22:33:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.608+0000 7fa4f8e59700 1 -- 172.21.15.59:0/962557040 wait complete. 2023-09-30T22:33:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.610+0000 7f6527224700 1 -- 172.21.15.59:0/2106346472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520139170 msgr2=0x7f6520122240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.610+0000 7f6527224700 1 --2- 172.21.15.59:0/2106346472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520139170 0x7f6520122240 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f651800b9a0 tx=0x7f651800bcb0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.610+0000 7f6527224700 1 -- 172.21.15.59:0/2106346472 shutdown_connections 2023-09-30T22:33:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.610+0000 7f6527224700 1 --2- 172.21.15.59:0/2106346472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520139170 0x7f6520122240 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.610+0000 7f6527224700 1 --2- 172.21.15.59:0/2106346472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652009d6f0 0x7f65201217c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.610+0000 7f6527224700 1 --2- 172.21.15.59:0/2106346472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652009e1d0 0x7f6520121d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.610+0000 7f6527224700 1 -- 172.21.15.59:0/2106346472 >> 172.21.15.59:0/2106346472 conn(0x7f6520066f50 msgr2=0x7f6520070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.611+0000 7f6527224700 1 -- 172.21.15.59:0/2106346472 shutdown_connections 2023-09-30T22:33:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.611+0000 7f6527224700 1 -- 172.21.15.59:0/2106346472 wait complete. 2023-09-30T22:33:47.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:47.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:47.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.660+0000 7f61fee9c700 1 -- 172.21.15.59:0/2771982696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f61f80a49a0 con 0x7f61f8137f20 2023-09-30T22:33:47.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.660+0000 7f61f57fa700 1 -- 172.21.15.59:0/2771982696 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61f0007c50 con 0x7f61f8137f20 2023-09-30T22:33:47.660 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.662+0000 7f61fee9c700 1 -- 172.21.15.59:0/2771982696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f8137f20 msgr2=0x7f61f811a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.662+0000 7f61fee9c700 1 --2- 172.21.15.59:0/2771982696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f8137f20 0x7f61f811a680 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f61f000efc0 tx=0x7f61f000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.662+0000 7f61fee9c700 1 -- 172.21.15.59:0/2771982696 shutdown_connections 2023-09-30T22:33:47.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.662+0000 7f61fee9c700 1 --2- 172.21.15.59:0/2771982696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61f8137f20 0x7f61f811a680 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.662+0000 7f61fee9c700 1 --2- 172.21.15.59:0/2771982696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f806c0e0 0x7f61f81ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.662+0000 7f61fee9c700 1 --2- 172.21.15.59:0/2771982696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f8134ec0 0x7f61f81cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:47.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.662+0000 7f61fee9c700 1 -- 172.21.15.59:0/2771982696 >> 172.21.15.59:0/2771982696 conn(0x7f61f80a4210 msgr2=0x7f61f8099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:47.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.663+0000 7f61fee9c700 1 -- 172.21.15.59:0/2771982696 shutdown_connections 2023-09-30T22:33:47.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:47.663+0000 7f61fee9c700 1 -- 172.21.15.59:0/2771982696 wait complete. 2023-09-30T22:33:47.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:48.583 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:48.624 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:48.626 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:48.677 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.737+0000 7fed2166c700 1 Processor -- start 2023-09-30T22:33:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.737+0000 7fed2166c700 1 -- start start 2023-09-30T22:33:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.737+0000 7fed2166c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed1c09f410 0x7fed1c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.737+0000 7fed2166c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed1c136fe0 0x7fed1c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.738+0000 7fed2166c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1c070940 con 0x7fed1c09e930 2023-09-30T22:33:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.738+0000 7fed2166c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1c06fd60 con 0x7fed1c09f410 2023-09-30T22:33:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.738+0000 7fed2166c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c06fa80 con 0x7fed1c136fe0 2023-09-30T22:33:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.738+0000 7fed1b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed1c136fe0 0x7fed1c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.738+0000 7fed1b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed1c136fe0 0x7fed1c1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43464/0 (socket says 172.21.15.59:43464) 2023-09-30T22:33:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.738+0000 7fed1b7fe700 1 -- 172.21.15.59:0/1255985603 learned_addr learned my addr 172.21.15.59:0/1255985603 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.738+0000 7fed1a7fc700 1 --2- 172.21.15.59:0/1255985603 >> v2:172.21.15.59:3300/0 conn(0x7fed1c09f410 0x7fed1c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.738+0000 7fed1b7fe700 1 -- 172.21.15.59:0/1255985603 >> v2:172.21.15.59:3300/0 conn(0x7fed1c09f410 msgr2=0x7fed1c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.738+0000 7fed1b7fe700 1 --2- 172.21.15.59:0/1255985603 >> v2:172.21.15.59:3300/0 conn(0x7fed1c09f410 0x7fed1c136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.738+0000 7fed1b7fe700 1 -- 172.21.15.59:0/1255985603 >> v1:172.21.15.59:6789/0 conn(0x7fed1c09e930 legacy=0x7fed1c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:48.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.738+0000 7fed1b7fe700 1 -- 172.21.15.59:0/1255985603 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c09fb60 con 0x7fed1c136fe0 2023-09-30T22:33:48.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.738+0000 7fed1b7fe700 1 --2- 172.21.15.59:0/1255985603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed1c136fe0 0x7fed1c1393c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fed14009e50 tx=0x7fed1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd3450483637c1d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:48.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.739+0000 7fed19ffb700 1 -- 172.21.15.59:0/1255985603 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1400e070 con 0x7fed1c136fe0 2023-09-30T22:33:48.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.739+0000 7fed19ffb700 1 -- 172.21.15.59:0/1255985603 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1400b910 con 0x7fed1c136fe0 2023-09-30T22:33:48.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.739+0000 7fed19ffb700 1 -- 172.21.15.59:0/1255985603 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1400bcc0 con 0x7fed1c136fe0 2023-09-30T22:33:48.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.739+0000 7fed2166c700 1 -- 172.21.15.59:0/1255985603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed1c136fe0 msgr2=0x7fed1c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:48.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.739+0000 7fed2166c700 1 --2- 172.21.15.59:0/1255985603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed1c136fe0 0x7fed1c1393c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fed14009e50 tx=0x7fed1400b330 comp rx=0 tx=0).stop 2023-09-30T22:33:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.740+0000 7fed2166c700 1 -- 172.21.15.59:0/1255985603 shutdown_connections 2023-09-30T22:33:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.740+0000 7fed2166c700 1 --2- 172.21.15.59:0/1255985603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed1c136fe0 0x7fed1c1393c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.740+0000 7fed2166c700 1 --2- 172.21.15.59:0/1255985603 >> v2:172.21.15.59:3300/0 conn(0x7fed1c09f410 0x7fed1c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.740+0000 7fed2166c700 1 -- 172.21.15.59:0/1255985603 >> 172.21.15.59:0/1255985603 conn(0x7fed1c0a4210 msgr2=0x7fed1c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.740+0000 7fed2166c700 1 -- 172.21.15.59:0/1255985603 shutdown_connections 2023-09-30T22:33:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.740+0000 7fed2166c700 1 -- 172.21.15.59:0/1255985603 wait complete. 2023-09-30T22:33:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.741+0000 7fed2166c700 1 Processor -- start 2023-09-30T22:33:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.741+0000 7fed2166c700 1 -- start start 2023-09-30T22:33:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.741+0000 7fed2166c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed1c09e930 0x7fed1c11a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.741+0000 7fed2166c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed1c09f410 0x7fed1c11abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.741+0000 7fed2166c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed1c136fe0 0x7fed1c11b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.741+0000 7fed2166c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c11df50 con 0x7fed1c09e930 2023-09-30T22:33:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.741+0000 7fed2166c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c11d8a0 con 0x7fed1c09f410 2023-09-30T22:33:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.741+0000 7fed2166c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c132660 con 0x7fed1c136fe0 2023-09-30T22:33:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.742+0000 7fed1a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed1c09f410 0x7fed1c11abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.742+0000 7fed1a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed1c09f410 0x7fed1c11abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43480/0 (socket says 172.21.15.59:43480) 2023-09-30T22:33:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.742+0000 7fed1a7fc700 1 -- 172.21.15.59:0/4065311664 learned_addr learned my addr 172.21.15.59:0/4065311664 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.742+0000 7fed1b7fe700 1 --2- 172.21.15.59:0/4065311664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed1c136fe0 0x7fed1c11b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.742+0000 7fed1affd700 1 --2- 172.21.15.59:0/4065311664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed1c09e930 0x7fed1c11a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.742+0000 7fed1a7fc700 1 -- 172.21.15.59:0/4065311664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed1c136fe0 msgr2=0x7fed1c11b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.742+0000 7fed1a7fc700 1 --2- 172.21.15.59:0/4065311664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed1c136fe0 0x7fed1c11b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.742+0000 7fed1a7fc700 1 -- 172.21.15.59:0/4065311664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed1c09e930 msgr2=0x7fed1c11a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.742+0000 7fed1a7fc700 1 --2- 172.21.15.59:0/4065311664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed1c09e930 0x7fed1c11a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.742+0000 7fed1a7fc700 1 -- 172.21.15.59:0/4065311664 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed14009b30 con 0x7fed1c09f410 2023-09-30T22:33:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.742+0000 7fed1a7fc700 1 --2- 172.21.15.59:0/4065311664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed1c09f410 0x7fed1c11abc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fed1000cb40 tx=0x7fed1000ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.742+0000 7fed037fe700 1 -- 172.21.15.59:0/4065311664 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1000b040 con 0x7fed1c09f410 2023-09-30T22:33:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.742+0000 7fed037fe700 1 -- 172.21.15.59:0/4065311664 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1001b070 con 0x7fed1c09f410 2023-09-30T22:33:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.742+0000 7fed2166c700 1 -- 172.21.15.59:0/4065311664 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1c0a32d0 con 0x7fed1c09f410 2023-09-30T22:33:48.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.743+0000 7fed037fe700 1 -- 172.21.15.59:0/4065311664 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10017e70 con 0x7fed1c09f410 2023-09-30T22:33:48.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.743+0000 7fed2166c700 1 -- 172.21.15.59:0/4065311664 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1c11e5d0 con 0x7fed1c09f410 2023-09-30T22:33:48.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.744+0000 7fed2166c700 1 -- 172.21.15.59:0/4065311664 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1c074ea0 con 0x7fed1c09f410 2023-09-30T22:33:48.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.744+0000 7fed037fe700 1 -- 172.21.15.59:0/4065311664 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed1000a620 con 0x7fed1c09f410 2023-09-30T22:33:48.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.748+0000 7fed037fe700 1 -- 172.21.15.59:0/4065311664 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fed1000a8d0 con 0x7fed1c09f410 2023-09-30T22:33:48.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.749+0000 7fed037fe700 1 -- 172.21.15.59:0/4065311664 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed100278b0 con 0x7fed1c09f410 2023-09-30T22:33:48.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.776+0000 7f5212f12700 1 Processor -- start 2023-09-30T22:33:48.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.776+0000 7f5212f12700 1 -- start start 2023-09-30T22:33:48.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.776+0000 7f5212f12700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c133420 0x7f520c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.776+0000 7f5212f12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c133e30 0x7f520c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.776+0000 7f5212f12700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c06b990 con 0x7f520c134260 2023-09-30T22:33:48.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.776+0000 7f5212f12700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0a0590 con 0x7f520c133420 2023-09-30T22:33:48.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.776+0000 7f5212f12700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f520c09fb80 con 0x7f520c133e30 2023-09-30T22:33:48.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.777+0000 7f52114af700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f520c134260 0x7f520c1304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52448/0 (socket says 172.21.15.59:52448) 2023-09-30T22:33:48.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.777+0000 7f52114af700 1 -- 172.21.15.59:0/2934624192 learned_addr learned my addr 172.21.15.59:0/2934624192 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:48.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.777+0000 7f5210cae700 1 --2- 172.21.15.59:0/2934624192 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c133420 0x7f520c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.777+0000 7f520bfff700 1 --2- 172.21.15.59:0/2934624192 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c133e30 0x7f520c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.777+0000 7f520b7fe700 1 -- 172.21.15.59:0/2934624192 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860398393 0 0) 0x7f520c06b990 con 0x7f520c134260 2023-09-30T22:33:48.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.777+0000 7f520b7fe700 1 -- 172.21.15.59:0/2934624192 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51fc0035b0 con 0x7f520c134260 2023-09-30T22:33:48.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.777+0000 7f520bfff700 1 -- 172.21.15.59:0/2934624192 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c133420 msgr2=0x7f520c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:48.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.777+0000 7f520bfff700 1 --2- 172.21.15.59:0/2934624192 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c133420 0x7f520c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.777+0000 7f520bfff700 1 -- 172.21.15.59:0/2934624192 >> v1:172.21.15.59:6789/0 conn(0x7f520c134260 legacy=0x7f520c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:48.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.777+0000 7f520bfff700 1 -- 172.21.15.59:0/2934624192 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c0a0030 con 0x7f520c133e30 2023-09-30T22:33:48.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.778+0000 7f520bfff700 1 --2- 172.21.15.59:0/2934624192 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c133e30 0x7f520c12ff90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009870 tx=0x7f51f8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a44fe57ee18ac7cc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:48.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.780+0000 7f520b7fe700 1 -- 172.21.15.59:0/2934624192 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8011830 con 0x7f520c133e30 2023-09-30T22:33:48.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.780+0000 7f520b7fe700 1 -- 172.21.15.59:0/2934624192 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f8011990 con 0x7f520c133e30 2023-09-30T22:33:48.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.780+0000 7f520b7fe700 1 -- 172.21.15.59:0/2934624192 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8011d20 con 0x7f520c133e30 2023-09-30T22:33:48.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.780+0000 7f5212f12700 1 -- 172.21.15.59:0/2934624192 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c133e30 msgr2=0x7f520c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:48.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.780+0000 7f5212f12700 1 --2- 172.21.15.59:0/2934624192 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c133e30 0x7f520c12ff90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009870 tx=0x7f51f8009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:48.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.781+0000 7f5212f12700 1 -- 172.21.15.59:0/2934624192 shutdown_connections 2023-09-30T22:33:48.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.781+0000 7f5212f12700 1 --2- 172.21.15.59:0/2934624192 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c133420 0x7f520c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.781+0000 7f5212f12700 1 --2- 172.21.15.59:0/2934624192 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c133e30 0x7f520c12ff90 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.781+0000 7f5212f12700 1 -- 172.21.15.59:0/2934624192 >> 172.21.15.59:0/2934624192 conn(0x7f520c0a4210 msgr2=0x7f520c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:48.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.781+0000 7f5212f12700 1 -- 172.21.15.59:0/2934624192 shutdown_connections 2023-09-30T22:33:48.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.781+0000 7f5212f12700 1 -- 172.21.15.59:0/2934624192 wait complete. 2023-09-30T22:33:48.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.782+0000 7f600a5f5700 1 Processor -- start 2023-09-30T22:33:48.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.782+0000 7f600a5f5700 1 -- start start 2023-09-30T22:33:48.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.782+0000 7f5212f12700 1 Processor -- start 2023-09-30T22:33:48.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.782+0000 7f5212f12700 1 -- start start 2023-09-30T22:33:48.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f5212f12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c133420 0x7f520c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f5212f12700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c133e30 0x7f520c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f5212f12700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c134260 0x7f520c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.782+0000 7f600a5f5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f600409e1d0 0x7f6004135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.782+0000 7f600a5f5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6004135e50 0x7f6004138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.782+0000 7f600a5f5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600409f130 con 0x7f600409d6f0 2023-09-30T22:33:48.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.782+0000 7f600a5f5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600409f520 con 0x7f6004135e50 2023-09-30T22:33:48.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.782+0000 7f600a5f5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f600409e930 con 0x7f600409e1d0 2023-09-30T22:33:48.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f60037fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f600409e1d0 0x7f6004135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f60037fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f600409e1d0 0x7f6004135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36378/0 (socket says 172.21.15.59:36378) 2023-09-30T22:33:48.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f60037fe700 1 -- 172.21.15.59:0/2345475547 learned_addr learned my addr 172.21.15.59:0/2345475547 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:48.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f6008b92700 1 --2- 172.21.15.59:0/2345475547 >> v2:172.21.15.59:3300/0 conn(0x7f6004135e50 0x7f6004138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f60037fe700 1 -- 172.21.15.59:0/2345475547 >> v2:172.21.15.59:3300/0 conn(0x7f6004135e50 msgr2=0x7f6004138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:48.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f60037fe700 1 --2- 172.21.15.59:0/2345475547 >> v2:172.21.15.59:3300/0 conn(0x7f6004135e50 0x7f6004138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f60037fe700 1 -- 172.21.15.59:0/2345475547 >> v1:172.21.15.59:6789/0 conn(0x7f600409d6f0 legacy=0x7f600409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:48.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f60037fe700 1 -- 172.21.15.59:0/2345475547 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600409b2d0 con 0x7f600409e1d0 2023-09-30T22:33:48.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f60037fe700 1 --2- 172.21.15.59:0/2345475547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f600409e1d0 0x7f6004135910 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009920 tx=0x7f5ff8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c75913b4b4d86ca5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:48.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f5212f12700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c120670 con 0x7f520c133e30 2023-09-30T22:33:48.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f5212f12700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c120170 con 0x7f520c134260 2023-09-30T22:33:48.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f5212f12700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f520c11eed0 con 0x7f520c133420 2023-09-30T22:33:48.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f52114af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c134260 0x7f520c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f52114af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c134260 0x7f520c09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43508/0 (socket says 172.21.15.59:43508) 2023-09-30T22:33:48.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f52114af700 1 -- 172.21.15.59:0/3353179398 learned_addr learned my addr 172.21.15.59:0/3353179398 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:48.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f520bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c133e30 0x7f520c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.783+0000 7f5210cae700 1 --2- 172.21.15.59:0/3353179398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c133420 0x7f520c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.784+0000 7f5210cae700 1 -- 172.21.15.59:0/3353179398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c134260 msgr2=0x7f520c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:48.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.784+0000 7f5210cae700 1 --2- 172.21.15.59:0/3353179398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c134260 0x7f520c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.784+0000 7f5210cae700 1 -- 172.21.15.59:0/3353179398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c133e30 msgr2=0x7f520c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:48.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.784+0000 7f5210cae700 1 --2- 172.21.15.59:0/3353179398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c133e30 0x7f520c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.784+0000 7f5210cae700 1 -- 172.21.15.59:0/3353179398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f80094a0 con 0x7f520c133420 2023-09-30T22:33:48.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.784+0000 7f6002ffd700 1 -- 172.21.15.59:0/2345475547 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8004230 con 0x7f600409e1d0 2023-09-30T22:33:48.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.784+0000 7f6002ffd700 1 -- 172.21.15.59:0/2345475547 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff8004390 con 0x7f600409e1d0 2023-09-30T22:33:48.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.784+0000 7f6002ffd700 1 -- 172.21.15.59:0/2345475547 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8009e70 con 0x7f600409e1d0 2023-09-30T22:33:48.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.784+0000 7f5210cae700 1 --2- 172.21.15.59:0/3353179398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c133420 0x7f520c09c480 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f520000e900 tx=0x7f520000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:48.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.784+0000 7f52097fa700 1 -- 172.21.15.59:0/3353179398 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200013680 con 0x7f520c133420 2023-09-30T22:33:48.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.784+0000 7f52097fa700 1 -- 172.21.15.59:0/3353179398 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52000137e0 con 0x7f520c133420 2023-09-30T22:33:48.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.784+0000 7f5212f12700 1 -- 172.21.15.59:0/3353179398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c120920 con 0x7f520c133420 2023-09-30T22:33:48.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.784+0000 7f5212f12700 1 -- 172.21.15.59:0/3353179398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c12da20 con 0x7f520c133420 2023-09-30T22:33:48.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.784+0000 7f52097fa700 1 -- 172.21.15.59:0/3353179398 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200013b50 con 0x7f520c133420 2023-09-30T22:33:48.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.785+0000 7f600a5f5700 1 -- 172.21.15.59:0/2345475547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f600409e1d0 msgr2=0x7f6004135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:48.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.785+0000 7f600a5f5700 1 --2- 172.21.15.59:0/2345475547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f600409e1d0 0x7f6004135910 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009920 tx=0x7f5ff8009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:48.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.785+0000 7f600a5f5700 1 -- 172.21.15.59:0/2345475547 shutdown_connections 2023-09-30T22:33:48.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.785+0000 7f600a5f5700 1 --2- 172.21.15.59:0/2345475547 >> v2:172.21.15.59:3300/0 conn(0x7f6004135e50 0x7f6004138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.785+0000 7f600a5f5700 1 --2- 172.21.15.59:0/2345475547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f600409e1d0 0x7f6004135910 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.785+0000 7f600a5f5700 1 -- 172.21.15.59:0/2345475547 >> 172.21.15.59:0/2345475547 conn(0x7f6004066f50 msgr2=0x7f600409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:48.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.785+0000 7f600a5f5700 1 -- 172.21.15.59:0/2345475547 shutdown_connections 2023-09-30T22:33:48.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.785+0000 7f600a5f5700 1 -- 172.21.15.59:0/2345475547 wait complete. 2023-09-30T22:33:48.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.785+0000 7f5212f12700 1 -- 172.21.15.59:0/3353179398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec0052e0 con 0x7f520c133420 2023-09-30T22:33:48.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.786+0000 7f52097fa700 1 -- 172.21.15.59:0/3353179398 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5200013cb0 con 0x7f520c133420 2023-09-30T22:33:48.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.786+0000 7f52097fa700 1 -- 172.21.15.59:0/3353179398 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f520003f700 con 0x7f520c133420 2023-09-30T22:33:48.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.786+0000 7f600a5f5700 1 Processor -- start 2023-09-30T22:33:48.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.786+0000 7f600a5f5700 1 -- start start 2023-09-30T22:33:48.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.787+0000 7f600a5f5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f600409d6f0 0x7f6004119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.787+0000 7f600a5f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f600409e1d0 0x7f60041199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.787+0000 7f600a5f5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6004135e50 0x7f6004119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.787+0000 7f600a5f5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600411cbd0 con 0x7f600409d6f0 2023-09-30T22:33:48.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.787+0000 7f600a5f5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600411b0b0 con 0x7f600409e1d0 2023-09-30T22:33:48.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.787+0000 7f600a5f5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60040a1d00 con 0x7f6004135e50 2023-09-30T22:33:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.787+0000 7f60037fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f600409e1d0 0x7f60041199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.787+0000 7f60037fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f600409e1d0 0x7f60041199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43524/0 (socket says 172.21.15.59:43524) 2023-09-30T22:33:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.787+0000 7f60037fe700 1 -- 172.21.15.59:0/1745973545 learned_addr learned my addr 172.21.15.59:0/1745973545 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.787+0000 7f6003fff700 1 --2- 172.21.15.59:0/1745973545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f600409d6f0 0x7f6004119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.787+0000 7f6008b92700 1 --2- 172.21.15.59:0/1745973545 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6004135e50 0x7f6004119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.788+0000 7f6003fff700 1 -- 172.21.15.59:0/1745973545 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6004135e50 msgr2=0x7f6004119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.788+0000 7f6003fff700 1 --2- 172.21.15.59:0/1745973545 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6004135e50 0x7f6004119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.788+0000 7f6003fff700 1 -- 172.21.15.59:0/1745973545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f600409e1d0 msgr2=0x7f60041199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.788+0000 7f6003fff700 1 --2- 172.21.15.59:0/1745973545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f600409e1d0 0x7f60041199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.788+0000 7f6003fff700 1 -- 172.21.15.59:0/1745973545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff8009550 con 0x7f600409d6f0 2023-09-30T22:33:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.788+0000 7f60037fe700 1 --2- 172.21.15.59:0/1745973545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f600409e1d0 0x7f60041199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.788+0000 7f6003fff700 1 --2- 172.21.15.59:0/1745973545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f600409d6f0 0x7f6004119480 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c3e0 tx=0x7f5ff400c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.788+0000 7f6000ff9700 1 -- 172.21.15.59:0/1745973545 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff40052d0 con 0x7f600409d6f0 2023-09-30T22:33:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.788+0000 7f6000ff9700 1 -- 172.21.15.59:0/1745973545 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff4005450 con 0x7f600409d6f0 2023-09-30T22:33:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.788+0000 7f6000ff9700 1 -- 172.21.15.59:0/1745973545 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff40038c0 con 0x7f600409d6f0 2023-09-30T22:33:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.788+0000 7f600a5f5700 1 -- 172.21.15.59:0/1745973545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600409c700 con 0x7f600409d6f0 2023-09-30T22:33:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.788+0000 7f600a5f5700 1 -- 172.21.15.59:0/1745973545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600411d640 con 0x7f600409d6f0 2023-09-30T22:33:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.789+0000 7f6000ff9700 1 -- 172.21.15.59:0/1745973545 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ff4003a20 con 0x7f600409d6f0 2023-09-30T22:33:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.790+0000 7f6000ff9700 1 -- 172.21.15.59:0/1745973545 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5ff403f520 con 0x7f600409d6f0 2023-09-30T22:33:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.790+0000 7f600a5f5700 1 -- 172.21.15.59:0/1745973545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6004130170 con 0x7f600409d6f0 2023-09-30T22:33:48.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.792+0000 7f52097fa700 1 -- 172.21.15.59:0/3353179398 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f520001be10 con 0x7f520c133420 2023-09-30T22:33:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.799+0000 7f6000ff9700 1 -- 172.21.15.59:0/1745973545 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ff4017070 con 0x7f600409d6f0 2023-09-30T22:33:48.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.838+0000 7f037e34f700 1 Processor -- start 2023-09-30T22:33:48.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.838+0000 7f037e34f700 1 -- start start 2023-09-30T22:33:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.839+0000 7f037e34f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03780a0a30 0x7f03780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.839+0000 7f037e34f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03780a1340 0x7f0378133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.839+0000 7f037e34f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0378133fa0 0x7f0378134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.839+0000 7f037e34f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037809edd0 con 0x7f0378133fa0 2023-09-30T22:33:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.839+0000 7f037e34f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037809e1f0 con 0x7f03780a1340 2023-09-30T22:33:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.839+0000 7f037e34f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f037809dc50 con 0x7f03780a0a30 2023-09-30T22:33:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.839+0000 7f036ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03780a1340 0x7f0378133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.839+0000 7f037c8ec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0378133fa0 0x7f0378134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.839+0000 7f036ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03780a1340 0x7f0378133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43536/0 (socket says 172.21.15.59:43536) 2023-09-30T22:33:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.839+0000 7f036ffff700 1 -- 172.21.15.59:0/36847453 learned_addr learned my addr 172.21.15.59:0/36847453 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.839+0000 7f0377fff700 1 --2- 172.21.15.59:0/36847453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03780a0a30 0x7f03780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.840+0000 7f036ffff700 1 -- 172.21.15.59:0/36847453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03780a0a30 msgr2=0x7f03780a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.840+0000 7f036ffff700 1 --2- 172.21.15.59:0/36847453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03780a0a30 0x7f03780a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.840+0000 7f036ffff700 1 -- 172.21.15.59:0/36847453 >> v2:172.21.15.59:3300/0 conn(0x7f0378133fa0 msgr2=0x7f0378134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.840+0000 7f036ffff700 1 --2- 172.21.15.59:0/36847453 >> v2:172.21.15.59:3300/0 conn(0x7f0378133fa0 0x7f0378134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.840+0000 7f036ffff700 1 -- 172.21.15.59:0/36847453 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03780a1fe0 con 0x7f03780a1340 2023-09-30T22:33:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.840+0000 7f037c8ec700 1 --2- 172.21.15.59:0/36847453 >> v2:172.21.15.59:3300/0 conn(0x7f0378133fa0 0x7f0378134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.840+0000 7f036ffff700 1 --2- 172.21.15.59:0/36847453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03780a1340 0x7f0378133a60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f03600098f0 tx=0x7f0360009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35fa03cf0a38c180 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.840+0000 7f03777fe700 1 -- 172.21.15.59:0/36847453 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0360011830 con 0x7f03780a1340 2023-09-30T22:33:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.840+0000 7f03777fe700 1 -- 172.21.15.59:0/36847453 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0360011990 con 0x7f03780a1340 2023-09-30T22:33:48.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.840+0000 7f03777fe700 1 -- 172.21.15.59:0/36847453 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0360011d20 con 0x7f03780a1340 2023-09-30T22:33:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.841+0000 7f037e34f700 1 -- 172.21.15.59:0/36847453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03780a1340 msgr2=0x7f0378133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.841+0000 7f037e34f700 1 --2- 172.21.15.59:0/36847453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03780a1340 0x7f0378133a60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f03600098f0 tx=0x7f0360009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.841+0000 7f037e34f700 1 -- 172.21.15.59:0/36847453 shutdown_connections 2023-09-30T22:33:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.841+0000 7f037e34f700 1 --2- 172.21.15.59:0/36847453 >> v2:172.21.15.59:3300/0 conn(0x7f0378133fa0 0x7f0378134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.841+0000 7f037e34f700 1 --2- 172.21.15.59:0/36847453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03780a0a30 0x7f03780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.841+0000 7f037e34f700 1 --2- 172.21.15.59:0/36847453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03780a1340 0x7f0378133a60 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.841+0000 7f037e34f700 1 -- 172.21.15.59:0/36847453 >> 172.21.15.59:0/36847453 conn(0x7f03780a6550 msgr2=0x7f03780a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.841+0000 7f037e34f700 1 -- 172.21.15.59:0/36847453 shutdown_connections 2023-09-30T22:33:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.841+0000 7f037e34f700 1 -- 172.21.15.59:0/36847453 wait complete. 2023-09-30T22:33:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.842+0000 7f037e34f700 1 Processor -- start 2023-09-30T22:33:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.842+0000 7f037e34f700 1 -- start start 2023-09-30T22:33:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.842+0000 7f037e34f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03780a0a30 0x7f0378120220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.842+0000 7f037e34f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03780a1340 0x7f0378120760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.842+0000 7f037e34f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0378133fa0 0x7f0378120ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.842+0000 7f037e34f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0378123430 con 0x7f03780a1340 2023-09-30T22:33:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.842+0000 7f037e34f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03780a0220 con 0x7f0378133fa0 2023-09-30T22:33:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.842+0000 7f037e34f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03780a3430 con 0x7f03780a0a30 2023-09-30T22:33:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.843+0000 7f036ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03780a1340 0x7f0378120760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.843+0000 7f036ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03780a1340 0x7f0378120760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59088/0 (socket says 172.21.15.59:59088) 2023-09-30T22:33:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.843+0000 7f036ffff700 1 -- 172.21.15.59:0/2185401413 learned_addr learned my addr 172.21.15.59:0/2185401413 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.843+0000 7f0377fff700 1 --2- 172.21.15.59:0/2185401413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03780a0a30 0x7f0378120220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.843+0000 7f037c8ec700 1 --2- 172.21.15.59:0/2185401413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0378133fa0 0x7f0378120ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.843+0000 7f036ffff700 1 -- 172.21.15.59:0/2185401413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03780a0a30 msgr2=0x7f0378120220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.843+0000 7f036ffff700 1 --2- 172.21.15.59:0/2185401413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03780a0a30 0x7f0378120220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.843+0000 7f036ffff700 1 -- 172.21.15.59:0/2185401413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0378133fa0 msgr2=0x7f0378120ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.843+0000 7f036ffff700 1 --2- 172.21.15.59:0/2185401413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0378133fa0 0x7f0378120ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.843+0000 7f036ffff700 1 -- 172.21.15.59:0/2185401413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0370009a70 con 0x7f03780a1340 2023-09-30T22:33:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.843+0000 7f0377fff700 1 --2- 172.21.15.59:0/2185401413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03780a0a30 0x7f0378120220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.843+0000 7f037c8ec700 1 --2- 172.21.15.59:0/2185401413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0378133fa0 0x7f0378120ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.843+0000 7f036ffff700 1 --2- 172.21.15.59:0/2185401413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03780a1340 0x7f0378120760 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f0360000c00 tx=0x7f0360004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.844+0000 7f03757fa700 1 -- 172.21.15.59:0/2185401413 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0360004240 con 0x7f03780a1340 2023-09-30T22:33:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.844+0000 7f03757fa700 1 -- 172.21.15.59:0/2185401413 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036001f070 con 0x7f03780a1340 2023-09-30T22:33:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.844+0000 7f037e34f700 1 -- 172.21.15.59:0/2185401413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0360009550 con 0x7f03780a1340 2023-09-30T22:33:48.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.844+0000 7f03757fa700 1 -- 172.21.15.59:0/2185401413 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03600045c0 con 0x7f03780a1340 2023-09-30T22:33:48.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.844+0000 7f037e34f700 1 -- 172.21.15.59:0/2185401413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0378122fe0 con 0x7f03780a1340 2023-09-30T22:33:48.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.845+0000 7f037e34f700 1 -- 172.21.15.59:0/2185401413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0378074ea0 con 0x7f03780a1340 2023-09-30T22:33:48.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.845+0000 7f03757fa700 1 -- 172.21.15.59:0/2185401413 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0360021030 con 0x7f03780a1340 2023-09-30T22:33:48.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.845+0000 7f03757fa700 1 -- 172.21.15.59:0/2185401413 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f03600408d0 con 0x7f03780a1340 2023-09-30T22:33:48.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.850+0000 7f03757fa700 1 -- 172.21.15.59:0/2185401413 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03600197c0 con 0x7f03780a1340 2023-09-30T22:33:48.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.995+0000 7fed2166c700 1 -- 172.21.15.59:0/4065311664 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fed1c06b250 con 0x7fed1c09f410 2023-09-30T22:33:48.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.995+0000 7fed037fe700 1 -- 172.21.15.59:0/4065311664 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed100272c0 con 0x7fed1c09f410 2023-09-30T22:33:48.996 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.999+0000 7fed2166c700 1 -- 172.21.15.59:0/4065311664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed1c09f410 msgr2=0x7fed1c11abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.999+0000 7fed2166c700 1 --2- 172.21.15.59:0/4065311664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed1c09f410 0x7fed1c11abc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fed1000cb40 tx=0x7fed1000ce50 comp rx=0 tx=0).stop 2023-09-30T22:33:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.999+0000 7fed2166c700 1 -- 172.21.15.59:0/4065311664 shutdown_connections 2023-09-30T22:33:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.999+0000 7fed2166c700 1 --2- 172.21.15.59:0/4065311664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed1c136fe0 0x7fed1c11b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.999+0000 7fed2166c700 1 --2- 172.21.15.59:0/4065311664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed1c09e930 0x7fed1c11a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.999+0000 7fed2166c700 1 --2- 172.21.15.59:0/4065311664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed1c09f410 0x7fed1c11abc0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.999+0000 7fed2166c700 1 -- 172.21.15.59:0/4065311664 >> 172.21.15.59:0/4065311664 conn(0x7fed1c0a4210 msgr2=0x7fed1c132870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.999+0000 7fed2166c700 1 -- 172.21.15.59:0/4065311664 shutdown_connections 2023-09-30T22:33:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:48.999+0000 7fed2166c700 1 -- 172.21.15.59:0/4065311664 wait complete. 2023-09-30T22:33:49.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.073+0000 7f600a5f5700 1 -- 172.21.15.59:0/1745973545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6004074ea0 con 0x7f600409d6f0 2023-09-30T22:33:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.074+0000 7f6000ff9700 1 -- 172.21.15.59:0/1745973545 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ff4017020 con 0x7f600409d6f0 2023-09-30T22:33:49.074 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.076+0000 7f600a5f5700 1 -- 172.21.15.59:0/1745973545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f600409d6f0 msgr2=0x7f6004119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.076+0000 7f600a5f5700 1 --2- 172.21.15.59:0/1745973545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f600409d6f0 0x7f6004119480 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c3e0 tx=0x7f5ff400c6f0 comp rx=0 tx=0).stop 2023-09-30T22:33:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.076+0000 7f600a5f5700 1 -- 172.21.15.59:0/1745973545 shutdown_connections 2023-09-30T22:33:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.076+0000 7f600a5f5700 1 --2- 172.21.15.59:0/1745973545 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6004135e50 0x7f6004119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.076+0000 7f600a5f5700 1 --2- 172.21.15.59:0/1745973545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f600409d6f0 0x7f6004119480 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.076+0000 7f600a5f5700 1 --2- 172.21.15.59:0/1745973545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f600409e1d0 0x7f60041199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.076+0000 7f600a5f5700 1 -- 172.21.15.59:0/1745973545 >> 172.21.15.59:0/1745973545 conn(0x7f6004066f50 msgr2=0x7f60041329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.076+0000 7f600a5f5700 1 -- 172.21.15.59:0/1745973545 shutdown_connections 2023-09-30T22:33:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.076+0000 7f600a5f5700 1 -- 172.21.15.59:0/1745973545 wait complete. 2023-09-30T22:33:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.079+0000 7f5212f12700 1 -- 172.21.15.59:0/3353179398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f51ec005590 con 0x7f520c133420 2023-09-30T22:33:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.079+0000 7f52097fa700 1 -- 172.21.15.59:0/3353179398 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5200021030 con 0x7f520c133420 2023-09-30T22:33:49.079 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.082+0000 7f5212f12700 1 -- 172.21.15.59:0/3353179398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c133420 msgr2=0x7f520c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.082+0000 7f5212f12700 1 --2- 172.21.15.59:0/3353179398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c133420 0x7f520c09c480 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f520000e900 tx=0x7f520000ec10 comp rx=0 tx=0).stop 2023-09-30T22:33:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.082+0000 7f5212f12700 1 -- 172.21.15.59:0/3353179398 shutdown_connections 2023-09-30T22:33:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.082+0000 7f5212f12700 1 --2- 172.21.15.59:0/3353179398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c133420 0x7f520c09c480 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.082+0000 7f5212f12700 1 --2- 172.21.15.59:0/3353179398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c134260 0x7f520c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.082+0000 7f5212f12700 1 --2- 172.21.15.59:0/3353179398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c133e30 0x7f520c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:49.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.082+0000 7f5212f12700 1 -- 172.21.15.59:0/3353179398 >> 172.21.15.59:0/3353179398 conn(0x7f520c0a4210 msgr2=0x7f520c12de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:49.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.082+0000 7f5212f12700 1 -- 172.21.15.59:0/3353179398 shutdown_connections 2023-09-30T22:33:49.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.082+0000 7f5212f12700 1 -- 172.21.15.59:0/3353179398 wait complete. 2023-09-30T22:33:49.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.087+0000 7f037e34f700 1 -- 172.21.15.59:0/2185401413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0378123820 con 0x7f03780a1340 2023-09-30T22:33:49.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.088+0000 7f03757fa700 1 -- 172.21.15.59:0/2185401413 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03600233d0 con 0x7f03780a1340 2023-09-30T22:33:49.088 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:49.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.090+0000 7f037e34f700 1 -- 172.21.15.59:0/2185401413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03780a1340 msgr2=0x7f0378120760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.090+0000 7f037e34f700 1 --2- 172.21.15.59:0/2185401413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03780a1340 0x7f0378120760 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f0360000c00 tx=0x7f0360004750 comp rx=0 tx=0).stop 2023-09-30T22:33:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.090+0000 7f037e34f700 1 -- 172.21.15.59:0/2185401413 shutdown_connections 2023-09-30T22:33:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.090+0000 7f037e34f700 1 --2- 172.21.15.59:0/2185401413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03780a0a30 0x7f0378120220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.090+0000 7f037e34f700 1 --2- 172.21.15.59:0/2185401413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0378133fa0 0x7f0378120ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.090+0000 7f037e34f700 1 --2- 172.21.15.59:0/2185401413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03780a1340 0x7f0378120760 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.090+0000 7f037e34f700 1 -- 172.21.15.59:0/2185401413 >> 172.21.15.59:0/2185401413 conn(0x7f03780a6550 msgr2=0x7f03781baff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.090+0000 7f037e34f700 1 -- 172.21.15.59:0/2185401413 shutdown_connections 2023-09-30T22:33:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:49.090+0000 7f037e34f700 1 -- 172.21.15.59:0/2185401413 wait complete. 2023-09-30T22:33:49.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:49.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:49.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:50.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:50.092 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:50.098 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:50.105 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:50.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.170+0000 7fa5ac6a5700 1 Processor -- start 2023-09-30T22:33:50.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.170+0000 7fa5ac6a5700 1 -- start start 2023-09-30T22:33:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.171+0000 7fa5ac6a5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa5a41338c0 0x7fa5a4133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.171+0000 7fa5ac6a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a41341d0 0x7fa5a409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.171+0000 7fa5ac6a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a409e390 0x7fa5a409e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.171+0000 7fa5ac6a5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a4070c80 con 0x7fa5a41338c0 2023-09-30T22:33:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.171+0000 7fa5ac6a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a409ed20 con 0x7fa5a409e390 2023-09-30T22:33:50.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.171+0000 7fa5ac6a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a406f720 con 0x7fa5a41341d0 2023-09-30T22:33:50.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.171+0000 7fa5aa441700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa5a41338c0 0x7fa5a4133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.171+0000 7fa5aa441700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa5a41338c0 0x7fa5a4133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59096/0 (socket says 172.21.15.59:59096) 2023-09-30T22:33:50.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.171+0000 7fa5aa441700 1 -- 172.21.15.59:0/2171118240 learned_addr learned my addr 172.21.15.59:0/2171118240 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:50.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.171+0000 7fa5aac42700 1 --2- 172.21.15.59:0/2171118240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a409e390 0x7fa5a409e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.172+0000 7fa5aa441700 1 -- 172.21.15.59:0/2171118240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a41341d0 msgr2=0x7fa5a409de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:50.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.172+0000 7fa5aa441700 1 --2- 172.21.15.59:0/2171118240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a41341d0 0x7fa5a409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.172+0000 7fa5aa441700 1 -- 172.21.15.59:0/2171118240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a409e390 msgr2=0x7fa5a409e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:50.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.172+0000 7fa5aa441700 1 --2- 172.21.15.59:0/2171118240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a409e390 0x7fa5a409e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.172+0000 7fa5aa441700 1 -- 172.21.15.59:0/2171118240 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a406fce0 con 0x7fa5a41338c0 2023-09-30T22:33:50.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.172+0000 7fa5aa441700 1 --2- 172.21.15.59:0/2171118240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a41338c0 0x7fa5a4133c90 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009e50 tx=0x7fa5a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c0d1cc6b190406 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:50.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.172+0000 7fa5a943f700 1 -- 172.21.15.59:0/2171118240 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000e070 con 0x7fa5a41338c0 2023-09-30T22:33:50.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.172+0000 7fa5a943f700 1 -- 172.21.15.59:0/2171118240 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a000b910 con 0x7fa5a41338c0 2023-09-30T22:33:50.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.172+0000 7fa5a943f700 1 -- 172.21.15.59:0/2171118240 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000bcc0 con 0x7fa5a41338c0 2023-09-30T22:33:50.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.173+0000 7fa5ac6a5700 1 -- 172.21.15.59:0/2171118240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a41338c0 msgr2=0x7fa5a4133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.173+0000 7fa5ac6a5700 1 --2- 172.21.15.59:0/2171118240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a41338c0 0x7fa5a4133c90 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009e50 tx=0x7fa5a000b330 comp rx=0 tx=0).stop 2023-09-30T22:33:50.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.173+0000 7fa5ac6a5700 1 -- 172.21.15.59:0/2171118240 shutdown_connections 2023-09-30T22:33:50.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.173+0000 7fa5ac6a5700 1 --2- 172.21.15.59:0/2171118240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a409e390 0x7fa5a409e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.173+0000 7fa5ac6a5700 1 --2- 172.21.15.59:0/2171118240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a41338c0 0x7fa5a4133c90 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.173+0000 7fa5ac6a5700 1 --2- 172.21.15.59:0/2171118240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a41341d0 0x7fa5a409de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.173+0000 7fa5ac6a5700 1 -- 172.21.15.59:0/2171118240 >> 172.21.15.59:0/2171118240 conn(0x7fa5a40a2aa0 msgr2=0x7fa5a40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.173+0000 7fa5ac6a5700 1 -- 172.21.15.59:0/2171118240 shutdown_connections 2023-09-30T22:33:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.173+0000 7fa5ac6a5700 1 -- 172.21.15.59:0/2171118240 wait complete. 2023-09-30T22:33:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.174+0000 7fa5ac6a5700 1 Processor -- start 2023-09-30T22:33:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.174+0000 7fa5ac6a5700 1 -- start start 2023-09-30T22:33:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.175+0000 7fa5ac6a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a409e390 0x7fa5a411ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.175+0000 7fa5ac6a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a41338c0 0x7fa5a411cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.175+0000 7fa5ac6a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a41341d0 0x7fa5a411d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.175+0000 7fa5ac6a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4120050 con 0x7fa5a41341d0 2023-09-30T22:33:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.175+0000 7fa5ac6a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a411e850 con 0x7fa5a41338c0 2023-09-30T22:33:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.175+0000 7fa5ac6a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a41202a0 con 0x7fa5a409e390 2023-09-30T22:33:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.175+0000 7fa5aac42700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a41341d0 0x7fa5a411d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.175+0000 7fa5aac42700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a41341d0 0x7fa5a411d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59102/0 (socket says 172.21.15.59:59102) 2023-09-30T22:33:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.175+0000 7fa5aac42700 1 -- 172.21.15.59:0/3656435069 learned_addr learned my addr 172.21.15.59:0/3656435069 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.176+0000 7fa5aa441700 1 --2- 172.21.15.59:0/3656435069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a409e390 0x7fa5a411ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.176+0000 7fa5aac42700 1 -- 172.21.15.59:0/3656435069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a409e390 msgr2=0x7fa5a411ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.176+0000 7fa5aac42700 1 --2- 172.21.15.59:0/3656435069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a409e390 0x7fa5a411ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.176+0000 7fa5aac42700 1 -- 172.21.15.59:0/3656435069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a41338c0 msgr2=0x7fa5a411cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.176+0000 7fa5aac42700 1 --2- 172.21.15.59:0/3656435069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a41338c0 0x7fa5a411cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.176+0000 7fa5aac42700 1 -- 172.21.15.59:0/3656435069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a0009b30 con 0x7fa5a41341d0 2023-09-30T22:33:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.176+0000 7fa5aa441700 1 --2- 172.21.15.59:0/3656435069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a409e390 0x7fa5a411ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.176+0000 7fa5aac42700 1 --2- 172.21.15.59:0/3656435069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a41341d0 0x7fa5a411d500 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fa59c00e800 tx=0x7fa59c00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.176+0000 7fa59affd700 1 -- 172.21.15.59:0/3656435069 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c0095b0 con 0x7fa5a41341d0 2023-09-30T22:33:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.176+0000 7fa59affd700 1 -- 172.21.15.59:0/3656435069 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c013680 con 0x7fa5a41341d0 2023-09-30T22:33:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.176+0000 7fa59affd700 1 -- 172.21.15.59:0/3656435069 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c013a10 con 0x7fa5a41341d0 2023-09-30T22:33:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.176+0000 7fa5ac6a5700 1 -- 172.21.15.59:0/3656435069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a411f190 con 0x7fa5a41341d0 2023-09-30T22:33:50.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.176+0000 7fa5ac6a5700 1 -- 172.21.15.59:0/3656435069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a406f960 con 0x7fa5a41341d0 2023-09-30T22:33:50.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.177+0000 7fa59affd700 1 -- 172.21.15.59:0/3656435069 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa59c013b90 con 0x7fa5a41341d0 2023-09-30T22:33:50.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.178+0000 7fa5ac6a5700 1 -- 172.21.15.59:0/3656435069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a412fc90 con 0x7fa5a41341d0 2023-09-30T22:33:50.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.178+0000 7fa59affd700 1 -- 172.21.15.59:0/3656435069 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa59c03fa60 con 0x7fa5a41341d0 2023-09-30T22:33:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.187+0000 7fa59affd700 1 -- 172.21.15.59:0/3656435069 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa59c00c480 con 0x7fa5a41341d0 2023-09-30T22:33:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.250+0000 7f4765cb9700 1 Processor -- start 2023-09-30T22:33:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.250+0000 7f4765cb9700 1 -- start start 2023-09-30T22:33:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.251+0000 7f4765cb9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47601338a0 0x7f4760133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.251+0000 7f4765cb9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f476009e930 0x7f476013b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.251+0000 7f4765cb9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476006ef30 con 0x7f476009de50 2023-09-30T22:33:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.251+0000 7f4765cb9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476006fef0 con 0x7f476009e930 2023-09-30T22:33:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.251+0000 7f4765cb9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47601334b0 con 0x7f47601338a0 2023-09-30T22:33:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.251+0000 7f475effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f476009de50 0x7f476009e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52468/0 (socket says 172.21.15.59:52468) 2023-09-30T22:33:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.251+0000 7f475effd700 1 -- 172.21.15.59:0/3127521329 learned_addr learned my addr 172.21.15.59:0/3127521329 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.251+0000 7f475ffff700 1 --2- 172.21.15.59:0/3127521329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f476009e930 0x7f476013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.251+0000 7f475f7fe700 1 --2- 172.21.15.59:0/3127521329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47601338a0 0x7f4760133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.252+0000 7f475e7fc700 1 -- 172.21.15.59:0/3127521329 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224867482 0 0) 0x7f476006ef30 con 0x7f476009de50 2023-09-30T22:33:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.252+0000 7f475e7fc700 1 -- 172.21.15.59:0/3127521329 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47480035b0 con 0x7f476009de50 2023-09-30T22:33:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.252+0000 7f475f7fe700 1 -- 172.21.15.59:0/3127521329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f476009e930 msgr2=0x7f476013b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.252+0000 7f475f7fe700 1 --2- 172.21.15.59:0/3127521329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f476009e930 0x7f476013b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.252+0000 7f475f7fe700 1 -- 172.21.15.59:0/3127521329 >> v1:172.21.15.59:6789/0 conn(0x7f476009de50 legacy=0x7f476009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.252+0000 7f475f7fe700 1 -- 172.21.15.59:0/3127521329 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476006fc30 con 0x7f47601338a0 2023-09-30T22:33:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.252+0000 7f475f7fe700 1 --2- 172.21.15.59:0/3127521329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47601338a0 0x7f4760133c70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4750009870 tx=0x7f4750009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81796da81038faea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.252+0000 7f475e7fc700 1 -- 172.21.15.59:0/3127521329 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750011830 con 0x7f47601338a0 2023-09-30T22:33:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.252+0000 7f475e7fc700 1 -- 172.21.15.59:0/3127521329 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4750011990 con 0x7f47601338a0 2023-09-30T22:33:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.252+0000 7f475e7fc700 1 -- 172.21.15.59:0/3127521329 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750011d20 con 0x7f47601338a0 2023-09-30T22:33:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.253+0000 7f4765cb9700 1 -- 172.21.15.59:0/3127521329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47601338a0 msgr2=0x7f4760133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.253+0000 7f4765cb9700 1 --2- 172.21.15.59:0/3127521329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47601338a0 0x7f4760133c70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4750009870 tx=0x7f4750009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.253+0000 7f4765cb9700 1 -- 172.21.15.59:0/3127521329 shutdown_connections 2023-09-30T22:33:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.253+0000 7f4765cb9700 1 --2- 172.21.15.59:0/3127521329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47601338a0 0x7f4760133c70 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.253+0000 7f4765cb9700 1 --2- 172.21.15.59:0/3127521329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f476009e930 0x7f476013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.253+0000 7f4765cb9700 1 -- 172.21.15.59:0/3127521329 >> 172.21.15.59:0/3127521329 conn(0x7f47600a2aa0 msgr2=0x7f47600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.253+0000 7f4765cb9700 1 -- 172.21.15.59:0/3127521329 shutdown_connections 2023-09-30T22:33:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.253+0000 7f4765cb9700 1 -- 172.21.15.59:0/3127521329 wait complete. 2023-09-30T22:33:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.255+0000 7f4765cb9700 1 Processor -- start 2023-09-30T22:33:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.255+0000 7f4765cb9700 1 -- start start 2023-09-30T22:33:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.256+0000 7f4765cb9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f476009de50 0x7f476011d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.256+0000 7f4765cb9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f476009e930 0x7f476011dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.256+0000 7f4765cb9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47601338a0 0x7f476011e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.256+0000 7f4765cb9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47601200e0 con 0x7f47601338a0 2023-09-30T22:33:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.256+0000 7f4765cb9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47600a0c20 con 0x7f476009de50 2023-09-30T22:33:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.256+0000 7f4765cb9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f476006f640 con 0x7f476009e930 2023-09-30T22:33:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.256+0000 7f475f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f476009de50 0x7f476011d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.256+0000 7f475f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f476009de50 0x7f476011d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43562/0 (socket says 172.21.15.59:43562) 2023-09-30T22:33:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.256+0000 7f475f7fe700 1 -- 172.21.15.59:0/438231739 learned_addr learned my addr 172.21.15.59:0/438231739 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.256+0000 7f475ffff700 1 --2- 172.21.15.59:0/438231739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47601338a0 0x7f476011e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.256+0000 7f475effd700 1 --2- 172.21.15.59:0/438231739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f476009e930 0x7f476011dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.257+0000 7f475f7fe700 1 -- 172.21.15.59:0/438231739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f476009e930 msgr2=0x7f476011dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.257+0000 7f475f7fe700 1 --2- 172.21.15.59:0/438231739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f476009e930 0x7f476011dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.257+0000 7f475f7fe700 1 -- 172.21.15.59:0/438231739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47601338a0 msgr2=0x7f476011e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.257+0000 7f475f7fe700 1 --2- 172.21.15.59:0/438231739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47601338a0 0x7f476011e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.257+0000 7f475f7fe700 1 -- 172.21.15.59:0/438231739 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47500094a0 con 0x7f476009de50 2023-09-30T22:33:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.257+0000 7f475f7fe700 1 --2- 172.21.15.59:0/438231739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f476009de50 0x7f476011d7f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f47500090b0 tx=0x7f4750004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.257+0000 7f4747fff700 1 -- 172.21.15.59:0/438231739 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750004450 con 0x7f476009de50 2023-09-30T22:33:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.257+0000 7f4747fff700 1 -- 172.21.15.59:0/438231739 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47500045b0 con 0x7f476009de50 2023-09-30T22:33:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.257+0000 7f4765cb9700 1 -- 172.21.15.59:0/438231739 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476011f310 con 0x7f476009de50 2023-09-30T22:33:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.257+0000 7f4747fff700 1 -- 172.21.15.59:0/438231739 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47500038e0 con 0x7f476009de50 2023-09-30T22:33:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.257+0000 7f4765cb9700 1 -- 172.21.15.59:0/438231739 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476011fa60 con 0x7f476009de50 2023-09-30T22:33:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.258+0000 7f4747fff700 1 -- 172.21.15.59:0/438231739 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4750003a40 con 0x7f476009de50 2023-09-30T22:33:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.259+0000 7f4765cb9700 1 -- 172.21.15.59:0/438231739 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476011a470 con 0x7f476009de50 2023-09-30T22:33:50.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.259+0000 7f4747fff700 1 -- 172.21.15.59:0/438231739 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4750003cf0 con 0x7f476009de50 2023-09-30T22:33:50.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.268+0000 7f4747fff700 1 -- 172.21.15.59:0/438231739 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4750015030 con 0x7f476009de50 2023-09-30T22:33:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.282+0000 7fa23b2cf700 1 Processor -- start 2023-09-30T22:33:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.283+0000 7fa23b2cf700 1 -- start start 2023-09-30T22:33:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.283+0000 7fa23b2cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa234130540 0x7fa234130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.283+0000 7fa23b2cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa234130e50 0x7fa23406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.283+0000 7fa23b2cf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2340716a0 con 0x7fa23406fb20 2023-09-30T22:33:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.283+0000 7fa23b2cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23409a390 con 0x7fa234130540 2023-09-30T22:33:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.284+0000 7fa23b2cf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa234071290 con 0x7fa234130e50 2023-09-30T22:33:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.284+0000 7fa23906b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa234130540 0x7fa234130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.284+0000 7fa23906b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa234130540 0x7fa234130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43566/0 (socket says 172.21.15.59:43566) 2023-09-30T22:33:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.284+0000 7fa23906b700 1 -- 172.21.15.59:0/645214457 learned_addr learned my addr 172.21.15.59:0/645214457 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.284+0000 7fa23886a700 1 --2- 172.21.15.59:0/645214457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa234130e50 0x7fa23406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.284+0000 7fa22bfff700 1 -- 172.21.15.59:0/645214457 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681436616 0 0) 0x7fa2340716a0 con 0x7fa23406fb20 2023-09-30T22:33:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.284+0000 7fa22bfff700 1 -- 172.21.15.59:0/645214457 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2200035b0 con 0x7fa23406fb20 2023-09-30T22:33:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.284+0000 7fa23906b700 1 -- 172.21.15.59:0/645214457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa234130e50 msgr2=0x7fa23406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.284+0000 7fa23906b700 1 --2- 172.21.15.59:0/645214457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa234130e50 0x7fa23406f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.284+0000 7fa23906b700 1 -- 172.21.15.59:0/645214457 >> v1:172.21.15.59:6789/0 conn(0x7fa23406fb20 legacy=0x7fa234137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.284+0000 7fa23906b700 1 -- 172.21.15.59:0/645214457 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa234130340 con 0x7fa234130540 2023-09-30T22:33:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.284+0000 7fa23906b700 1 --2- 172.21.15.59:0/645214457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa234130540 0x7fa234130910 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa23000bbf0 tx=0x7fa23000bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8184edfa763608a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.285+0000 7fa22bfff700 1 -- 172.21.15.59:0/645214457 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23000dcf0 con 0x7fa234130540 2023-09-30T22:33:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.285+0000 7fa22bfff700 1 -- 172.21.15.59:0/645214457 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23000de50 con 0x7fa234130540 2023-09-30T22:33:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.285+0000 7fa22bfff700 1 -- 172.21.15.59:0/645214457 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa230010690 con 0x7fa234130540 2023-09-30T22:33:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.286+0000 7fa23b2cf700 1 -- 172.21.15.59:0/645214457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa234130540 msgr2=0x7fa234130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.286+0000 7fa23b2cf700 1 --2- 172.21.15.59:0/645214457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa234130540 0x7fa234130910 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa23000bbf0 tx=0x7fa23000bf00 comp rx=0 tx=0).stop 2023-09-30T22:33:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.286+0000 7fa23b2cf700 1 -- 172.21.15.59:0/645214457 shutdown_connections 2023-09-30T22:33:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.286+0000 7fa23b2cf700 1 --2- 172.21.15.59:0/645214457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa234130540 0x7fa234130910 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.286+0000 7fa23b2cf700 1 --2- 172.21.15.59:0/645214457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa234130e50 0x7fa23406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.286+0000 7fa23b2cf700 1 -- 172.21.15.59:0/645214457 >> 172.21.15.59:0/645214457 conn(0x7fa2340a2aa0 msgr2=0x7fa2340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.286+0000 7fa23b2cf700 1 -- 172.21.15.59:0/645214457 shutdown_connections 2023-09-30T22:33:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.286+0000 7fa23b2cf700 1 -- 172.21.15.59:0/645214457 wait complete. 2023-09-30T22:33:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.287+0000 7fa23b2cf700 1 Processor -- start 2023-09-30T22:33:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.288+0000 7fa23b2cf700 1 -- start start 2023-09-30T22:33:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.288+0000 7fa23b2cf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23406fb20 0x7fa2341c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.288+0000 7fa23b2cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa234130540 0x7fa2341c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.288+0000 7fa23b2cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa234130e50 0x7fa234118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.288+0000 7fa23b2cf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2341c3b70 con 0x7fa23406fb20 2023-09-30T22:33:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.288+0000 7fa23b2cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2341c49d0 con 0x7fa234130e50 2023-09-30T22:33:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.288+0000 7fa23b2cf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa23411b940 con 0x7fa234130540 2023-09-30T22:33:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.289+0000 7fa23906b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23406fb20 0x7fa2341c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.289+0000 7fa23906b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23406fb20 0x7fa2341c3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59114/0 (socket says 172.21.15.59:59114) 2023-09-30T22:33:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.289+0000 7fa23906b700 1 -- 172.21.15.59:0/2432554546 learned_addr learned my addr 172.21.15.59:0/2432554546 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.289+0000 7fa23986c700 1 --2- 172.21.15.59:0/2432554546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa234130e50 0x7fa234118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.289+0000 7fa23886a700 1 --2- 172.21.15.59:0/2432554546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa234130540 0x7fa2341c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.289+0000 7fa23906b700 1 -- 172.21.15.59:0/2432554546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa234130540 msgr2=0x7fa2341c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.289+0000 7fa23906b700 1 --2- 172.21.15.59:0/2432554546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa234130540 0x7fa2341c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.289+0000 7fa23906b700 1 -- 172.21.15.59:0/2432554546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa234130e50 msgr2=0x7fa234118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.289+0000 7fa23906b700 1 --2- 172.21.15.59:0/2432554546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa234130e50 0x7fa234118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.289+0000 7fa23906b700 1 -- 172.21.15.59:0/2432554546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23000b7f0 con 0x7fa23406fb20 2023-09-30T22:33:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.289+0000 7fa23906b700 1 --2- 172.21.15.59:0/2432554546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23406fb20 0x7fa2341c3f50 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fa230000c00 tx=0x7fa230004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.289+0000 7fa229ffb700 1 -- 172.21.15.59:0/2432554546 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23001f070 con 0x7fa23406fb20 2023-09-30T22:33:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.290+0000 7fa229ffb700 1 -- 172.21.15.59:0/2432554546 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2300038b0 con 0x7fa23406fb20 2023-09-30T22:33:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.290+0000 7fa23b2cf700 1 -- 172.21.15.59:0/2432554546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23411b1b0 con 0x7fa23406fb20 2023-09-30T22:33:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.290+0000 7fa229ffb700 1 -- 172.21.15.59:0/2432554546 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa230003c60 con 0x7fa23406fb20 2023-09-30T22:33:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.290+0000 7fa23b2cf700 1 -- 172.21.15.59:0/2432554546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23409df10 con 0x7fa23406fb20 2023-09-30T22:33:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.291+0000 7fa23b2cf700 1 -- 172.21.15.59:0/2432554546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa234074ea0 con 0x7fa23406fb20 2023-09-30T22:33:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.292+0000 7fa229ffb700 1 -- 172.21.15.59:0/2432554546 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa230023410 con 0x7fa23406fb20 2023-09-30T22:33:50.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.292+0000 7fa229ffb700 1 -- 172.21.15.59:0/2432554546 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa230042840 con 0x7fa23406fb20 2023-09-30T22:33:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.297+0000 7fa229ffb700 1 -- 172.21.15.59:0/2432554546 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa230021720 con 0x7fa23406fb20 2023-09-30T22:33:50.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.306+0000 7f1f55e53700 1 Processor -- start 2023-09-30T22:33:50.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.306+0000 7f1f55e53700 1 -- start start 2023-09-30T22:33:50.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.306+0000 7f1f55e53700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5006cc90 0x7f1f500a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.306+0000 7f1f55e53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f500a0f70 0x7f1f500a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.306+0000 7f1f55e53700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f5013c120 0x7f1f5013e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.306+0000 7f1f55e53700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5006d060 con 0x7f1f5013c120 2023-09-30T22:33:50.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.306+0000 7f1f55e53700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500a2550 con 0x7f1f500a0f70 2023-09-30T22:33:50.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.306+0000 7f1f55e53700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500a1e00 con 0x7f1f5006cc90 2023-09-30T22:33:50.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.306+0000 7f1f4f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5006cc90 0x7f1f500a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.307+0000 7f1f4f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5006cc90 0x7f1f500a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36468/0 (socket says 172.21.15.59:36468) 2023-09-30T22:33:50.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.306+0000 7f1f4ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f5013c120 0x7f1f5013e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.307+0000 7f1f4f7fe700 1 -- 172.21.15.59:0/1445097695 learned_addr learned my addr 172.21.15.59:0/1445097695 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.307+0000 7f1f4effd700 1 --2- 172.21.15.59:0/1445097695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f500a0f70 0x7f1f500a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.307+0000 7f1f4f7fe700 1 -- 172.21.15.59:0/1445097695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f500a0f70 msgr2=0x7f1f500a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.307+0000 7f1f4f7fe700 1 --2- 172.21.15.59:0/1445097695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f500a0f70 0x7f1f500a13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.307+0000 7f1f4f7fe700 1 -- 172.21.15.59:0/1445097695 >> v2:172.21.15.59:3300/0 conn(0x7f1f5013c120 msgr2=0x7f1f5013e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.307+0000 7f1f4f7fe700 1 --2- 172.21.15.59:0/1445097695 >> v2:172.21.15.59:3300/0 conn(0x7f1f5013c120 0x7f1f5013e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.307+0000 7f1f4f7fe700 1 -- 172.21.15.59:0/1445097695 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5009cfa0 con 0x7f1f5006cc90 2023-09-30T22:33:50.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.307+0000 7f1f4f7fe700 1 --2- 172.21.15.59:0/1445097695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5006cc90 0x7f1f500a0a30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1f400098f0 tx=0x7f1f40009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a91ec4bda1b9c10 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:50.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.307+0000 7f1f4e7fc700 1 -- 172.21.15.59:0/1445097695 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40011830 con 0x7f1f5006cc90 2023-09-30T22:33:50.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.308+0000 7f1f4e7fc700 1 -- 172.21.15.59:0/1445097695 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f40011990 con 0x7f1f5006cc90 2023-09-30T22:33:50.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.308+0000 7f1f4e7fc700 1 -- 172.21.15.59:0/1445097695 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40011d20 con 0x7f1f5006cc90 2023-09-30T22:33:50.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.308+0000 7f1f55e53700 1 -- 172.21.15.59:0/1445097695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5006cc90 msgr2=0x7f1f500a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.309+0000 7f1f55e53700 1 --2- 172.21.15.59:0/1445097695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5006cc90 0x7f1f500a0a30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1f400098f0 tx=0x7f1f40009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:50.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.310+0000 7f1f55e53700 1 -- 172.21.15.59:0/1445097695 shutdown_connections 2023-09-30T22:33:50.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.310+0000 7f1f55e53700 1 --2- 172.21.15.59:0/1445097695 >> v2:172.21.15.59:3300/0 conn(0x7f1f5013c120 0x7f1f5013e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.310+0000 7f1f55e53700 1 --2- 172.21.15.59:0/1445097695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5006cc90 0x7f1f500a0a30 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.310+0000 7f1f55e53700 1 --2- 172.21.15.59:0/1445097695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f500a0f70 0x7f1f500a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.310+0000 7f1f55e53700 1 -- 172.21.15.59:0/1445097695 >> 172.21.15.59:0/1445097695 conn(0x7f1f500a3050 msgr2=0x7f1f500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:50.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.310+0000 7f1f55e53700 1 -- 172.21.15.59:0/1445097695 shutdown_connections 2023-09-30T22:33:50.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.310+0000 7f1f55e53700 1 -- 172.21.15.59:0/1445097695 wait complete. 2023-09-30T22:33:50.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.311+0000 7f1f55e53700 1 Processor -- start 2023-09-30T22:33:50.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.311+0000 7f1f55e53700 1 -- start start 2023-09-30T22:33:50.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.312+0000 7f1f55e53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5006cc90 0x7f1f5013a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.312+0000 7f1f55e53700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f500a0f70 0x7f1f5013ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.312+0000 7f1f55e53700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5013c120 0x7f1f5013b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.312+0000 7f1f55e53700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5011eee0 con 0x7f1f5013c120 2023-09-30T22:33:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.312+0000 7f1f55e53700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5011e190 con 0x7f1f5006cc90 2023-09-30T22:33:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.312+0000 7f1f55e53700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5013e280 con 0x7f1f500a0f70 2023-09-30T22:33:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.312+0000 7f1f4ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5013c120 0x7f1f5013b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.312+0000 7f1f4ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5013c120 0x7f1f5013b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59134/0 (socket says 172.21.15.59:59134) 2023-09-30T22:33:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.312+0000 7f1f4ffff700 1 -- 172.21.15.59:0/2506025136 learned_addr learned my addr 172.21.15.59:0/2506025136 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.312+0000 7f1f4f7fe700 1 --2- 172.21.15.59:0/2506025136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5006cc90 0x7f1f5013a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.312+0000 7f1f4effd700 1 --2- 172.21.15.59:0/2506025136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f500a0f70 0x7f1f5013ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:50.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.313+0000 7f1f4ffff700 1 -- 172.21.15.59:0/2506025136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f500a0f70 msgr2=0x7f1f5013ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.313+0000 7f1f4ffff700 1 --2- 172.21.15.59:0/2506025136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f500a0f70 0x7f1f5013ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.313+0000 7f1f4ffff700 1 -- 172.21.15.59:0/2506025136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5006cc90 msgr2=0x7f1f5013a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.313+0000 7f1f4ffff700 1 --2- 172.21.15.59:0/2506025136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5006cc90 0x7f1f5013a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.313+0000 7f1f4ffff700 1 -- 172.21.15.59:0/2506025136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f40009550 con 0x7f1f5013c120 2023-09-30T22:33:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.313+0000 7f1f4ffff700 1 --2- 172.21.15.59:0/2506025136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5013c120 0x7f1f5013b050 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009dd0 tx=0x7f1f4800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.313+0000 7f1f37fff700 1 -- 172.21.15.59:0/2506025136 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48009c40 con 0x7f1f5013c120 2023-09-30T22:33:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.313+0000 7f1f37fff700 1 -- 172.21.15.59:0/2506025136 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4800f040 con 0x7f1f5013c120 2023-09-30T22:33:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.313+0000 7f1f37fff700 1 -- 172.21.15.59:0/2506025136 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4800ceb0 con 0x7f1f5013c120 2023-09-30T22:33:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.313+0000 7f1f55e53700 1 -- 172.21.15.59:0/2506025136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f50120060 con 0x7f1f5013c120 2023-09-30T22:33:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.313+0000 7f1f55e53700 1 -- 172.21.15.59:0/2506025136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5011fd80 con 0x7f1f5013c120 2023-09-30T22:33:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.314+0000 7f1f55e53700 1 -- 172.21.15.59:0/2506025136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5011f9a0 con 0x7f1f5013c120 2023-09-30T22:33:50.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.315+0000 7f1f37fff700 1 -- 172.21.15.59:0/2506025136 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f48014480 con 0x7f1f5013c120 2023-09-30T22:33:50.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.315+0000 7f1f37fff700 1 -- 172.21.15.59:0/2506025136 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f480407b0 con 0x7f1f5013c120 2023-09-30T22:33:50.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.324+0000 7f1f37fff700 1 -- 172.21.15.59:0/2506025136 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f48012930 con 0x7f1f5013c120 2023-09-30T22:33:50.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.430+0000 7fa5ac6a5700 1 -- 172.21.15.59:0/3656435069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa5a4074ea0 con 0x7fa5a41341d0 2023-09-30T22:33:50.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.430+0000 7fa59affd700 1 -- 172.21.15.59:0/3656435069 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa59c021070 con 0x7fa5a41341d0 2023-09-30T22:33:50.432 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:50.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.433+0000 7fa5ac6a5700 1 -- 172.21.15.59:0/3656435069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a41341d0 msgr2=0x7fa5a411d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.433+0000 7fa5ac6a5700 1 --2- 172.21.15.59:0/3656435069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a41341d0 0x7fa5a411d500 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fa59c00e800 tx=0x7fa59c00ebc0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.433+0000 7fa5ac6a5700 1 -- 172.21.15.59:0/3656435069 shutdown_connections 2023-09-30T22:33:50.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.433+0000 7fa5ac6a5700 1 --2- 172.21.15.59:0/3656435069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5a409e390 0x7fa5a411ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.433+0000 7fa5ac6a5700 1 --2- 172.21.15.59:0/3656435069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5a41341d0 0x7fa5a411d500 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.433+0000 7fa5ac6a5700 1 --2- 172.21.15.59:0/3656435069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5a41338c0 0x7fa5a411cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.433+0000 7fa5ac6a5700 1 -- 172.21.15.59:0/3656435069 >> 172.21.15.59:0/3656435069 conn(0x7fa5a40a2aa0 msgr2=0x7fa5a41322d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:50.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.433+0000 7fa5ac6a5700 1 -- 172.21.15.59:0/3656435069 shutdown_connections 2023-09-30T22:33:50.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.433+0000 7fa5ac6a5700 1 -- 172.21.15.59:0/3656435069 wait complete. 2023-09-30T22:33:50.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.482+0000 7f4765cb9700 1 -- 172.21.15.59:0/438231739 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4760120e10 con 0x7f476009de50 2023-09-30T22:33:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.487+0000 7f4747fff700 1 -- 172.21.15.59:0/438231739 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4760120e10 con 0x7f476009de50 2023-09-30T22:33:50.488 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.489+0000 7f4765cb9700 1 -- 172.21.15.59:0/438231739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f476009de50 msgr2=0x7f476011d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.489+0000 7f4765cb9700 1 --2- 172.21.15.59:0/438231739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f476009de50 0x7f476011d7f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f47500090b0 tx=0x7f4750004750 comp rx=0 tx=0).stop 2023-09-30T22:33:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.489+0000 7f4765cb9700 1 -- 172.21.15.59:0/438231739 shutdown_connections 2023-09-30T22:33:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.489+0000 7f4765cb9700 1 --2- 172.21.15.59:0/438231739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47601338a0 0x7f476011e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.489+0000 7f4765cb9700 1 --2- 172.21.15.59:0/438231739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f476009de50 0x7f476011d7f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.489+0000 7f4765cb9700 1 --2- 172.21.15.59:0/438231739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f476009e930 0x7f476011dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.490+0000 7f4765cb9700 1 -- 172.21.15.59:0/438231739 >> 172.21.15.59:0/438231739 conn(0x7f47600a2aa0 msgr2=0x7f47601bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.490+0000 7f4765cb9700 1 -- 172.21.15.59:0/438231739 shutdown_connections 2023-09-30T22:33:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.490+0000 7f4765cb9700 1 -- 172.21.15.59:0/438231739 wait complete. 2023-09-30T22:33:50.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:50.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.514+0000 7fa23b2cf700 1 -- 172.21.15.59:0/2432554546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa23406b9e0 con 0x7fa23406fb20 2023-09-30T22:33:50.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.515+0000 7fa229ffb700 1 -- 172.21.15.59:0/2432554546 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa230028020 con 0x7fa23406fb20 2023-09-30T22:33:50.516 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:50.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.517+0000 7fa23b2cf700 1 -- 172.21.15.59:0/2432554546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23406fb20 msgr2=0x7fa2341c3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.517+0000 7fa23b2cf700 1 --2- 172.21.15.59:0/2432554546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23406fb20 0x7fa2341c3f50 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fa230000c00 tx=0x7fa230004750 comp rx=0 tx=0).stop 2023-09-30T22:33:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.517+0000 7fa23b2cf700 1 -- 172.21.15.59:0/2432554546 shutdown_connections 2023-09-30T22:33:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.517+0000 7fa23b2cf700 1 --2- 172.21.15.59:0/2432554546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa234130e50 0x7fa234118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.517+0000 7fa23b2cf700 1 --2- 172.21.15.59:0/2432554546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa23406fb20 0x7fa2341c3f50 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.517+0000 7fa23b2cf700 1 --2- 172.21.15.59:0/2432554546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa234130540 0x7fa2341c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.517+0000 7fa23b2cf700 1 -- 172.21.15.59:0/2432554546 >> 172.21.15.59:0/2432554546 conn(0x7fa2340a2aa0 msgr2=0x7fa23412d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.517+0000 7fa23b2cf700 1 -- 172.21.15.59:0/2432554546 shutdown_connections 2023-09-30T22:33:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.517+0000 7fa23b2cf700 1 -- 172.21.15.59:0/2432554546 wait complete. 2023-09-30T22:33:50.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:50.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.535+0000 7f1f55e53700 1 -- 172.21.15.59:0/2506025136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f50071e20 con 0x7f1f5013c120 2023-09-30T22:33:50.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.535+0000 7f1f37fff700 1 -- 172.21.15.59:0/2506025136 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f4802a070 con 0x7f1f5013c120 2023-09-30T22:33:50.538 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.538+0000 7f1f55e53700 1 -- 172.21.15.59:0/2506025136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5013c120 msgr2=0x7f1f5013b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.538+0000 7f1f55e53700 1 --2- 172.21.15.59:0/2506025136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5013c120 0x7f1f5013b050 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009dd0 tx=0x7f1f4800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.538+0000 7f1f55e53700 1 -- 172.21.15.59:0/2506025136 shutdown_connections 2023-09-30T22:33:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.538+0000 7f1f55e53700 1 --2- 172.21.15.59:0/2506025136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5013c120 0x7f1f5013b050 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.538+0000 7f1f55e53700 1 --2- 172.21.15.59:0/2506025136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5006cc90 0x7f1f5013a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.538+0000 7f1f55e53700 1 --2- 172.21.15.59:0/2506025136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f500a0f70 0x7f1f5013ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.538+0000 7f1f55e53700 1 -- 172.21.15.59:0/2506025136 >> 172.21.15.59:0/2506025136 conn(0x7f1f500a3050 msgr2=0x7f1f5009aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:50.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.538+0000 7f1f55e53700 1 -- 172.21.15.59:0/2506025136 shutdown_connections 2023-09-30T22:33:50.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:50.538+0000 7f1f55e53700 1 -- 172.21.15.59:0/2506025136 wait complete. 2023-09-30T22:33:50.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:51.448 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:51.506 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:51.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:51.553 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:51.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.600+0000 7f5a93d81700 1 Processor -- start 2023-09-30T22:33:51.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.601+0000 7f5a93d81700 1 -- start start 2023-09-30T22:33:51.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.601+0000 7f5a93d81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a8c09d6f0 0x7f5a8c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.601+0000 7f5a93d81700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a8c09e000 0x7f5a8c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.601+0000 7f5a93d81700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c09b120 con 0x7f5a8c09e410 2023-09-30T22:33:51.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.601+0000 7f5a93d81700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c06b460 con 0x7f5a8c09e000 2023-09-30T22:33:51.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.601+0000 7f5a93d81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c09a7e0 con 0x7f5a8c09d6f0 2023-09-30T22:33:51.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.602+0000 7f5a9231e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5a8c09e410 0x7f5a8c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52490/0 (socket says 172.21.15.59:52490) 2023-09-30T22:33:51.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.602+0000 7f5a9231e700 1 -- 172.21.15.59:0/3978057918 learned_addr learned my addr 172.21.15.59:0/3978057918 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:51.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.602+0000 7f5a90b1b700 1 -- 172.21.15.59:0/3978057918 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944610731 0 0) 0x7f5a8c09b120 con 0x7f5a8c09e410 2023-09-30T22:33:51.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.602+0000 7f5a90b1b700 1 -- 172.21.15.59:0/3978057918 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a780035b0 con 0x7f5a8c09e410 2023-09-30T22:33:51.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.602+0000 7f5a9131c700 1 --2- 172.21.15.59:0/3978057918 >> v2:172.21.15.59:3300/0 conn(0x7f5a8c09e000 0x7f5a8c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.602+0000 7f5a91b1d700 1 --2- 172.21.15.59:0/3978057918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a8c09d6f0 0x7f5a8c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.602+0000 7f5a9131c700 1 -- 172.21.15.59:0/3978057918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a8c09d6f0 msgr2=0x7f5a8c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:51.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.602+0000 7f5a9131c700 1 --2- 172.21.15.59:0/3978057918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a8c09d6f0 0x7f5a8c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.602+0000 7f5a9131c700 1 -- 172.21.15.59:0/3978057918 >> v1:172.21.15.59:6789/0 conn(0x7f5a8c09e410 legacy=0x7f5a8c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.602+0000 7f5a9131c700 1 -- 172.21.15.59:0/3978057918 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c09a500 con 0x7f5a8c09e000 2023-09-30T22:33:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.603+0000 7f5a9131c700 1 --2- 172.21.15.59:0/3978057918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a8c09e000 0x7f5a8c1339f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009840 tx=0x7f5a7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0ab46fd36fd6a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.603+0000 7f5a90b1b700 1 -- 172.21.15.59:0/3978057918 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c011830 con 0x7f5a8c09e000 2023-09-30T22:33:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.603+0000 7f5a90b1b700 1 -- 172.21.15.59:0/3978057918 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c011990 con 0x7f5a8c09e000 2023-09-30T22:33:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.603+0000 7f5a90b1b700 1 -- 172.21.15.59:0/3978057918 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c011d20 con 0x7f5a8c09e000 2023-09-30T22:33:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.604+0000 7f5a93d81700 1 -- 172.21.15.59:0/3978057918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a8c09e000 msgr2=0x7f5a8c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.604+0000 7f5a93d81700 1 --2- 172.21.15.59:0/3978057918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a8c09e000 0x7f5a8c1339f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009840 tx=0x7f5a7c009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.604+0000 7f5a93d81700 1 -- 172.21.15.59:0/3978057918 shutdown_connections 2023-09-30T22:33:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.604+0000 7f5a93d81700 1 --2- 172.21.15.59:0/3978057918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a8c09d6f0 0x7f5a8c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.604+0000 7f5a93d81700 1 --2- 172.21.15.59:0/3978057918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a8c09e000 0x7f5a8c1339f0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.604+0000 7f5a93d81700 1 -- 172.21.15.59:0/3978057918 >> 172.21.15.59:0/3978057918 conn(0x7f5a8c066f50 msgr2=0x7f5a8c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.604+0000 7f5a93d81700 1 -- 172.21.15.59:0/3978057918 shutdown_connections 2023-09-30T22:33:51.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.604+0000 7f5a93d81700 1 -- 172.21.15.59:0/3978057918 wait complete. 2023-09-30T22:33:51.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.605+0000 7f5a93d81700 1 Processor -- start 2023-09-30T22:33:51.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.605+0000 7f5a93d81700 1 -- start start 2023-09-30T22:33:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.606+0000 7f5a93d81700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a8c09d6f0 0x7f5a8c1a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.606+0000 7f5a93d81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a8c09e000 0x7f5a8c1a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.606+0000 7f5a93d81700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a8c09e410 0x7f5a8c1c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.606+0000 7f5a93d81700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1a8180 con 0x7f5a8c09d6f0 2023-09-30T22:33:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.606+0000 7f5a93d81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1a8360 con 0x7f5a8c09e000 2023-09-30T22:33:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.606+0000 7f5a93d81700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1b91d0 con 0x7f5a8c09e410 2023-09-30T22:33:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.606+0000 7f5a9131c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a8c09e000 0x7f5a8c1a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.606+0000 7f5a9131c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a8c09e000 0x7f5a8c1a5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43610/0 (socket says 172.21.15.59:43610) 2023-09-30T22:33:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.606+0000 7f5a9131c700 1 -- 172.21.15.59:0/1232821200 learned_addr learned my addr 172.21.15.59:0/1232821200 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.606+0000 7f5a9231e700 1 --2- 172.21.15.59:0/1232821200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a8c09e410 0x7f5a8c1c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.606+0000 7f5a91b1d700 1 --2- 172.21.15.59:0/1232821200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a8c09d6f0 0x7f5a8c1a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.607+0000 7f5a91b1d700 1 -- 172.21.15.59:0/1232821200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a8c09e410 msgr2=0x7f5a8c1c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.607+0000 7f5a91b1d700 1 --2- 172.21.15.59:0/1232821200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a8c09e410 0x7f5a8c1c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.607+0000 7f5a91b1d700 1 -- 172.21.15.59:0/1232821200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a8c09e000 msgr2=0x7f5a8c1a5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.607+0000 7f5a91b1d700 1 --2- 172.21.15.59:0/1232821200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a8c09e000 0x7f5a8c1a5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.607+0000 7f5a91b1d700 1 -- 172.21.15.59:0/1232821200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c0094a0 con 0x7f5a8c09d6f0 2023-09-30T22:33:51.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.607+0000 7f5a91b1d700 1 --2- 172.21.15.59:0/1232821200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a8c09d6f0 0x7f5a8c1a5210 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800e930 tx=0x7f5a8800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:51.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.607+0000 7f5a827fc700 1 -- 172.21.15.59:0/1232821200 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88013680 con 0x7f5a8c09d6f0 2023-09-30T22:33:51.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.607+0000 7f5a827fc700 1 -- 172.21.15.59:0/1232821200 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a880137e0 con 0x7f5a8c09d6f0 2023-09-30T22:33:51.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.607+0000 7f5a93d81700 1 -- 172.21.15.59:0/1232821200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c1a5c90 con 0x7f5a8c09d6f0 2023-09-30T22:33:51.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.607+0000 7f5a827fc700 1 -- 172.21.15.59:0/1232821200 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88013b50 con 0x7f5a8c09d6f0 2023-09-30T22:33:51.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.607+0000 7f5a93d81700 1 -- 172.21.15.59:0/1232821200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c0a2e70 con 0x7f5a8c09d6f0 2023-09-30T22:33:51.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.609+0000 7f5a93d81700 1 -- 172.21.15.59:0/1232821200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8c1a7fe0 con 0x7f5a8c09d6f0 2023-09-30T22:33:51.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.609+0000 7f5a827fc700 1 -- 172.21.15.59:0/1232821200 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a88013cb0 con 0x7f5a8c09d6f0 2023-09-30T22:33:51.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.610+0000 7f5a827fc700 1 -- 172.21.15.59:0/1232821200 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5a8803fdb0 con 0x7f5a8c09d6f0 2023-09-30T22:33:51.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.618+0000 7f5a827fc700 1 -- 172.21.15.59:0/1232821200 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a88026430 con 0x7f5a8c09d6f0 2023-09-30T22:33:51.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.672+0000 7fabdf225700 1 Processor -- start 2023-09-30T22:33:51.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.672+0000 7fabdf225700 1 -- start start 2023-09-30T22:33:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.673+0000 7fabdf225700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fabd806a770 0x7fabd806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.673+0000 7fabdf225700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabd806b080 0x7fabd8131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.673+0000 7fabdf225700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd809ece0 con 0x7fabd8131b40 2023-09-30T22:33:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.673+0000 7fabdf225700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd809e760 con 0x7fabd806a770 2023-09-30T22:33:51.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.673+0000 7fabdf225700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabd809e040 con 0x7fabd806b080 2023-09-30T22:33:51.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.673+0000 7fabd7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabd806b080 0x7fabd8131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.673+0000 7fabd7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabd806b080 0x7fabd8131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36474/0 (socket says 172.21.15.59:36474) 2023-09-30T22:33:51.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.673+0000 7fabd7fff700 1 -- 172.21.15.59:0/1224580949 learned_addr learned my addr 172.21.15.59:0/1224580949 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:51.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.673+0000 7fabdcfc1700 1 --2- 172.21.15.59:0/1224580949 >> v2:172.21.15.59:3300/0 conn(0x7fabd806a770 0x7fabd806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.674+0000 7fabd7fff700 1 -- 172.21.15.59:0/1224580949 >> v2:172.21.15.59:3300/0 conn(0x7fabd806a770 msgr2=0x7fabd806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:51.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.674+0000 7fabd7fff700 1 --2- 172.21.15.59:0/1224580949 >> v2:172.21.15.59:3300/0 conn(0x7fabd806a770 0x7fabd806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.674+0000 7fabd7fff700 1 -- 172.21.15.59:0/1224580949 >> v1:172.21.15.59:6789/0 conn(0x7fabd8131b40 legacy=0x7fabd8138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.674+0000 7fabd7fff700 1 -- 172.21.15.59:0/1224580949 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd809f630 con 0x7fabd806b080 2023-09-30T22:33:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.674+0000 7fabd7fff700 1 --2- 172.21.15.59:0/1224580949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabd806b080 0x7fabd8131600 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fabc40098f0 tx=0x7fabc4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0034b5f10892eca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.674+0000 7fabd77fe700 1 -- 172.21.15.59:0/1224580949 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4011830 con 0x7fabd806b080 2023-09-30T22:33:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.674+0000 7fabd77fe700 1 -- 172.21.15.59:0/1224580949 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc4011990 con 0x7fabd806b080 2023-09-30T22:33:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.674+0000 7fabd77fe700 1 -- 172.21.15.59:0/1224580949 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4011d00 con 0x7fabd806b080 2023-09-30T22:33:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.675+0000 7fabdf225700 1 -- 172.21.15.59:0/1224580949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabd806b080 msgr2=0x7fabd8131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.675+0000 7fabdf225700 1 --2- 172.21.15.59:0/1224580949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabd806b080 0x7fabd8131600 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fabc40098f0 tx=0x7fabc4009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.675+0000 7fabdf225700 1 -- 172.21.15.59:0/1224580949 shutdown_connections 2023-09-30T22:33:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.675+0000 7fabdf225700 1 --2- 172.21.15.59:0/1224580949 >> v2:172.21.15.59:3300/0 conn(0x7fabd806a770 0x7fabd806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.675+0000 7fabdf225700 1 --2- 172.21.15.59:0/1224580949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabd806b080 0x7fabd8131600 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.675+0000 7fabdf225700 1 -- 172.21.15.59:0/1224580949 >> 172.21.15.59:0/1224580949 conn(0x7fabd8066f50 msgr2=0x7fabd809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:51.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.675+0000 7fabdf225700 1 -- 172.21.15.59:0/1224580949 shutdown_connections 2023-09-30T22:33:51.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.675+0000 7fabdf225700 1 -- 172.21.15.59:0/1224580949 wait complete. 2023-09-30T22:33:51.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.677+0000 7fabdf225700 1 Processor -- start 2023-09-30T22:33:51.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.677+0000 7fabdf225700 1 -- start start 2023-09-30T22:33:51.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdf225700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd806a770 0x7fabd81c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdf225700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabd806b080 0x7fabd81c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdf225700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabd8131b40 0x7fabd81c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdf225700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8071e60 con 0x7fabd806a770 2023-09-30T22:33:51.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdf225700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd809bf30 con 0x7fabd8131b40 2023-09-30T22:33:51.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdf225700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8121cd0 con 0x7fabd806b080 2023-09-30T22:33:51.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdd7c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabd8131b40 0x7fabd81c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdd7c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabd8131b40 0x7fabd81c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43614/0 (socket says 172.21.15.59:43614) 2023-09-30T22:33:51.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdd7c2700 1 -- 172.21.15.59:0/4272231082 learned_addr learned my addr 172.21.15.59:0/4272231082 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:51.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdcfc1700 1 --2- 172.21.15.59:0/4272231082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd806a770 0x7fabd81c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdcfc1700 1 -- 172.21.15.59:0/4272231082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabd806b080 msgr2=0x7fabd81c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdcfc1700 1 --2- 172.21.15.59:0/4272231082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabd806b080 0x7fabd81c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdcfc1700 1 -- 172.21.15.59:0/4272231082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabd8131b40 msgr2=0x7fabd81c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdcfc1700 1 --2- 172.21.15.59:0/4272231082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabd8131b40 0x7fabd81c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdcfc1700 1 -- 172.21.15.59:0/4272231082 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc4009550 con 0x7fabd806a770 2023-09-30T22:33:51.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.678+0000 7fabdd7c2700 1 --2- 172.21.15.59:0/4272231082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabd8131b40 0x7fabd81c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:51.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.679+0000 7fabdcfc1700 1 --2- 172.21.15.59:0/4272231082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd806a770 0x7fabd81c8140 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fabcc00e900 tx=0x7fabcc00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:51.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.679+0000 7fabd57fa700 1 -- 172.21.15.59:0/4272231082 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc00ee50 con 0x7fabd806a770 2023-09-30T22:33:51.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.679+0000 7fabd57fa700 1 -- 172.21.15.59:0/4272231082 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc00c850 con 0x7fabd806a770 2023-09-30T22:33:51.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.679+0000 7fabdf225700 1 -- 172.21.15.59:0/4272231082 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd8121f90 con 0x7fabd806a770 2023-09-30T22:33:51.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.679+0000 7fabd57fa700 1 -- 172.21.15.59:0/4272231082 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc00cbc0 con 0x7fabd806a770 2023-09-30T22:33:51.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.679+0000 7fabdf225700 1 -- 172.21.15.59:0/4272231082 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd8131460 con 0x7fabd806a770 2023-09-30T22:33:51.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.680+0000 7fabd57fa700 1 -- 172.21.15.59:0/4272231082 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabcc00cd20 con 0x7fabd806a770 2023-09-30T22:33:51.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.680+0000 7fabd57fa700 1 -- 172.21.15.59:0/4272231082 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fabcc03f790 con 0x7fabd806a770 2023-09-30T22:33:51.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.680+0000 7fabdf225700 1 -- 172.21.15.59:0/4272231082 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd8122120 con 0x7fabd806a770 2023-09-30T22:33:51.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.685+0000 7fabd57fa700 1 -- 172.21.15.59:0/4272231082 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabcc01be10 con 0x7fabd806a770 2023-09-30T22:33:51.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.706+0000 7fe43bac3700 1 Processor -- start 2023-09-30T22:33:51.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.707+0000 7fe43bac3700 1 -- start start 2023-09-30T22:33:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43bac3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe434130540 0x7fe434130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43bac3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe434130e50 0x7fe43406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43bac3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe43406fb20 0x7fe43406ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43bac3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4340704b0 con 0x7fe434130e50 2023-09-30T22:33:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43bac3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43409a390 con 0x7fe434130540 2023-09-30T22:33:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43bac3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4340716a0 con 0x7fe43406fb20 2023-09-30T22:33:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43985f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe434130540 0x7fe434130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43985f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe434130540 0x7fe434130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43620/0 (socket says 172.21.15.59:43620) 2023-09-30T22:33:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43985f700 1 -- 172.21.15.59:0/1289503005 learned_addr learned my addr 172.21.15.59:0/1289503005 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43905e700 1 --2- 172.21.15.59:0/1289503005 >> v2:172.21.15.59:3300/0 conn(0x7fe434130e50 0x7fe43406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43905e700 1 -- 172.21.15.59:0/1289503005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe43406fb20 msgr2=0x7fe43406ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43905e700 1 --2- 172.21.15.59:0/1289503005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe43406fb20 0x7fe43406ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43905e700 1 -- 172.21.15.59:0/1289503005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe434130540 msgr2=0x7fe434130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43905e700 1 --2- 172.21.15.59:0/1289503005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe434130540 0x7fe434130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43905e700 1 -- 172.21.15.59:0/1289503005 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe434071290 con 0x7fe434130e50 2023-09-30T22:33:51.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.708+0000 7fe43985f700 1 --2- 172.21.15.59:0/1289503005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe434130540 0x7fe434130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:51.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.709+0000 7fe43905e700 1 --2- 172.21.15.59:0/1289503005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe434130e50 0x7fe43406f5e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fe424009870 tx=0x7fe424009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9b8a8e9ce10f96 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:51.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.709+0000 7fe43885d700 1 -- 172.21.15.59:0/1289503005 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424011830 con 0x7fe434130e50 2023-09-30T22:33:51.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.709+0000 7fe43885d700 1 -- 172.21.15.59:0/1289503005 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe424011990 con 0x7fe434130e50 2023-09-30T22:33:51.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.709+0000 7fe43885d700 1 -- 172.21.15.59:0/1289503005 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424011d20 con 0x7fe434130e50 2023-09-30T22:33:51.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.710+0000 7fe43bac3700 1 -- 172.21.15.59:0/1289503005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe434130e50 msgr2=0x7fe43406f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.710+0000 7fe43bac3700 1 --2- 172.21.15.59:0/1289503005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe434130e50 0x7fe43406f5e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fe424009870 tx=0x7fe424009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:51.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.710+0000 7fe43bac3700 1 -- 172.21.15.59:0/1289503005 shutdown_connections 2023-09-30T22:33:51.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.710+0000 7fe43bac3700 1 --2- 172.21.15.59:0/1289503005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe43406fb20 0x7fe43406ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.710+0000 7fe43bac3700 1 --2- 172.21.15.59:0/1289503005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe434130540 0x7fe434130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.710+0000 7fe43bac3700 1 --2- 172.21.15.59:0/1289503005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe434130e50 0x7fe43406f5e0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.710+0000 7fe43bac3700 1 -- 172.21.15.59:0/1289503005 >> 172.21.15.59:0/1289503005 conn(0x7fe4340a2aa0 msgr2=0x7fe4340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:51.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.710+0000 7fe43bac3700 1 -- 172.21.15.59:0/1289503005 shutdown_connections 2023-09-30T22:33:51.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.710+0000 7fe43bac3700 1 -- 172.21.15.59:0/1289503005 wait complete. 2023-09-30T22:33:51.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.711+0000 7fe43bac3700 1 Processor -- start 2023-09-30T22:33:51.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.711+0000 7fe43bac3700 1 -- start start 2023-09-30T22:33:51.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.712+0000 7fe43bac3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe43406fb20 0x7fe43411b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.712+0000 7fe43bac3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe434130540 0x7fe43411bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.712+0000 7fe43bac3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe434130e50 0x7fe43411c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.712+0000 7fe43bac3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43411f1c0 con 0x7fe43406fb20 2023-09-30T22:33:51.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.712+0000 7fe43bac3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43411e570 con 0x7fe434130e50 2023-09-30T22:33:51.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.712+0000 7fe43bac3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe43412db40 con 0x7fe434130540 2023-09-30T22:33:51.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.712+0000 7fe43985f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe43406fb20 0x7fe43411b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.712+0000 7fe43985f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe43406fb20 0x7fe43411b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59182/0 (socket says 172.21.15.59:59182) 2023-09-30T22:33:51.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.712+0000 7fe43905e700 1 --2- 172.21.15.59:0/2642282590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe434130540 0x7fe43411bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.712+0000 7fe43985f700 1 -- 172.21.15.59:0/2642282590 learned_addr learned my addr 172.21.15.59:0/2642282590 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:51.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.712+0000 7fe43a060700 1 --2- 172.21.15.59:0/2642282590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe434130e50 0x7fe43411c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.713+0000 7fe43985f700 1 -- 172.21.15.59:0/2642282590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe434130540 msgr2=0x7fe43411bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.713+0000 7fe43985f700 1 --2- 172.21.15.59:0/2642282590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe434130540 0x7fe43411bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.713+0000 7fe43985f700 1 -- 172.21.15.59:0/2642282590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe434130e50 msgr2=0x7fe43411c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.713+0000 7fe43985f700 1 --2- 172.21.15.59:0/2642282590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe434130e50 0x7fe43411c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.713+0000 7fe43985f700 1 -- 172.21.15.59:0/2642282590 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43000b7f0 con 0x7fe43406fb20 2023-09-30T22:33:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.713+0000 7fe43a060700 1 --2- 172.21.15.59:0/2642282590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe434130e50 0x7fe43411c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.713+0000 7fe43985f700 1 --2- 172.21.15.59:0/2642282590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe43406fb20 0x7fe43411b730 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fe43000d7c0 tx=0x7fe43000dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.713+0000 7fe42a7fc700 1 -- 172.21.15.59:0/2642282590 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43000c870 con 0x7fe43406fb20 2023-09-30T22:33:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.713+0000 7fe42a7fc700 1 -- 172.21.15.59:0/2642282590 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43000c9d0 con 0x7fe43406fb20 2023-09-30T22:33:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.713+0000 7fe42a7fc700 1 -- 172.21.15.59:0/2642282590 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43000cd40 con 0x7fe43406fb20 2023-09-30T22:33:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.713+0000 7fe43bac3700 1 -- 172.21.15.59:0/2642282590 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4240094a0 con 0x7fe43406fb20 2023-09-30T22:33:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.713+0000 7fe43bac3700 1 -- 172.21.15.59:0/2642282590 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43411e0b0 con 0x7fe43406fb20 2023-09-30T22:33:51.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.715+0000 7fe43bac3700 1 -- 172.21.15.59:0/2642282590 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43409dd40 con 0x7fe43406fb20 2023-09-30T22:33:51.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.715+0000 7fe42a7fc700 1 -- 172.21.15.59:0/2642282590 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe430028430 con 0x7fe43406fb20 2023-09-30T22:33:51.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.715+0000 7fe42a7fc700 1 -- 172.21.15.59:0/2642282590 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe430048310 con 0x7fe43406fb20 2023-09-30T22:33:51.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.724+0000 7fe42a7fc700 1 -- 172.21.15.59:0/2642282590 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4300252b0 con 0x7fe43406fb20 2023-09-30T22:33:51.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.742+0000 7f95f4d4e700 1 Processor -- start 2023-09-30T22:33:51.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.742+0000 7f95f4d4e700 1 -- start start 2023-09-30T22:33:51.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.743+0000 7f95f4d4e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95f00a0a30 0x7f95f00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.743+0000 7f95f4d4e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f009d630 0x7f95f00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.743+0000 7f95f4d4e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f00a2a70 con 0x7f95f0133930 2023-09-30T22:33:51.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.743+0000 7f95f4d4e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00a01d0 con 0x7f95f009d630 2023-09-30T22:33:51.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.743+0000 7f95f4d4e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95f009e2b0 con 0x7f95f00a0a30 2023-09-30T22:33:51.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.743+0000 7f95eed9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f95f0133930 0x7f95f0133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52506/0 (socket says 172.21.15.59:52506) 2023-09-30T22:33:51.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.743+0000 7f95eed9d700 1 -- 172.21.15.59:0/1190621939 learned_addr learned my addr 172.21.15.59:0/1190621939 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:51.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.743+0000 7f95edd9b700 1 --2- 172.21.15.59:0/1190621939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f009d630 0x7f95f00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.743+0000 7f95ee59c700 1 --2- 172.21.15.59:0/1190621939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95f00a0a30 0x7f95f00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.743+0000 7f95ed59a700 1 -- 172.21.15.59:0/1190621939 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868695561 0 0) 0x7f95f00a2a70 con 0x7f95f0133930 2023-09-30T22:33:51.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.743+0000 7f95ed59a700 1 -- 172.21.15.59:0/1190621939 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95d80035b0 con 0x7f95f0133930 2023-09-30T22:33:51.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.743+0000 7f95edd9b700 1 -- 172.21.15.59:0/1190621939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95f00a0a30 msgr2=0x7f95f00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:51.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.743+0000 7f95edd9b700 1 --2- 172.21.15.59:0/1190621939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95f00a0a30 0x7f95f00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.743+0000 7f95edd9b700 1 -- 172.21.15.59:0/1190621939 >> v1:172.21.15.59:6789/0 conn(0x7f95f0133930 legacy=0x7f95f0133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.743+0000 7f95edd9b700 1 -- 172.21.15.59:0/1190621939 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f009dc50 con 0x7f95f009d630 2023-09-30T22:33:51.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.744+0000 7f95edd9b700 1 --2- 172.21.15.59:0/1190621939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f009d630 0x7f95f00a1340 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009870 tx=0x7f95e4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f94cd05c5efc4f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:51.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.744+0000 7f95ed59a700 1 -- 172.21.15.59:0/1190621939 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e4011830 con 0x7f95f009d630 2023-09-30T22:33:51.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.744+0000 7f95ed59a700 1 -- 172.21.15.59:0/1190621939 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e4011990 con 0x7f95f009d630 2023-09-30T22:33:51.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.744+0000 7f95ed59a700 1 -- 172.21.15.59:0/1190621939 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e4011d20 con 0x7f95f009d630 2023-09-30T22:33:51.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.744+0000 7f95f4d4e700 1 -- 172.21.15.59:0/1190621939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f009d630 msgr2=0x7f95f00a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.744+0000 7f95f4d4e700 1 --2- 172.21.15.59:0/1190621939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f009d630 0x7f95f00a1340 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009870 tx=0x7f95e4009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:51.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.745+0000 7f95f4d4e700 1 -- 172.21.15.59:0/1190621939 shutdown_connections 2023-09-30T22:33:51.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.745+0000 7f95f4d4e700 1 --2- 172.21.15.59:0/1190621939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95f00a0a30 0x7f95f00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.745+0000 7f95f4d4e700 1 --2- 172.21.15.59:0/1190621939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f009d630 0x7f95f00a1340 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.745+0000 7f95f4d4e700 1 -- 172.21.15.59:0/1190621939 >> 172.21.15.59:0/1190621939 conn(0x7f95f00a3050 msgr2=0x7f95f00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:51.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.745+0000 7f95f4d4e700 1 -- 172.21.15.59:0/1190621939 shutdown_connections 2023-09-30T22:33:51.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.745+0000 7f95f4d4e700 1 -- 172.21.15.59:0/1190621939 wait complete. 2023-09-30T22:33:51.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.746+0000 7f95f4d4e700 1 Processor -- start 2023-09-30T22:33:51.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.746+0000 7f95f4d4e700 1 -- start start 2023-09-30T22:33:51.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.746+0000 7f95f4d4e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f009d630 0x7f95f011f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.746+0000 7f95f4d4e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95f00a0a30 0x7f95f011fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.746+0000 7f95f4d4e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f0133930 0x7f95f01c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:51.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.746+0000 7f95f4d4e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f0122620 con 0x7f95f009d630 2023-09-30T22:33:51.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.746+0000 7f95f4d4e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f011eeb0 con 0x7f95f0133930 2023-09-30T22:33:51.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.746+0000 7f95f4d4e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95f0120610 con 0x7f95f00a0a30 2023-09-30T22:33:51.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.747+0000 7f95edd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95f00a0a30 0x7f95f011fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.747+0000 7f95ee59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f009d630 0x7f95f011f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.747+0000 7f95edd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95f00a0a30 0x7f95f011fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36534/0 (socket says 172.21.15.59:36534) 2023-09-30T22:33:51.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.747+0000 7f95ee59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f009d630 0x7f95f011f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59198/0 (socket says 172.21.15.59:59198) 2023-09-30T22:33:51.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.747+0000 7f95edd9b700 1 -- 172.21.15.59:0/2260320142 learned_addr learned my addr 172.21.15.59:0/2260320142 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:51.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.747+0000 7f95eed9d700 1 --2- 172.21.15.59:0/2260320142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f0133930 0x7f95f01c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:51.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.747+0000 7f95ee59c700 1 -- 172.21.15.59:0/2260320142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95f00a0a30 msgr2=0x7f95f011fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.747+0000 7f95ee59c700 1 --2- 172.21.15.59:0/2260320142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95f00a0a30 0x7f95f011fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.747+0000 7f95ee59c700 1 -- 172.21.15.59:0/2260320142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f0133930 msgr2=0x7f95f01c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.747+0000 7f95ee59c700 1 --2- 172.21.15.59:0/2260320142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f0133930 0x7f95f01c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.747+0000 7f95ee59c700 1 -- 172.21.15.59:0/2260320142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e40094a0 con 0x7f95f009d630 2023-09-30T22:33:51.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.747+0000 7f95edd9b700 1 --2- 172.21.15.59:0/2260320142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95f00a0a30 0x7f95f011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:51.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.747+0000 7f95ee59c700 1 --2- 172.21.15.59:0/2260320142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f009d630 0x7f95f011f500 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f95e000e900 tx=0x7f95e000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:51.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.748+0000 7f95deffd700 1 -- 172.21.15.59:0/2260320142 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e000ee50 con 0x7f95f009d630 2023-09-30T22:33:51.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.748+0000 7f95deffd700 1 -- 172.21.15.59:0/2260320142 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e000c850 con 0x7f95f009d630 2023-09-30T22:33:51.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.748+0000 7f95deffd700 1 -- 172.21.15.59:0/2260320142 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e000cbc0 con 0x7f95f009d630 2023-09-30T22:33:51.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.748+0000 7f95f4d4e700 1 -- 172.21.15.59:0/2260320142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f00a5360 con 0x7f95f009d630 2023-09-30T22:33:51.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.748+0000 7f95f4d4e700 1 -- 172.21.15.59:0/2260320142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f0121f80 con 0x7f95f009d630 2023-09-30T22:33:51.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.749+0000 7f95deffd700 1 -- 172.21.15.59:0/2260320142 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95e000cd20 con 0x7f95f009d630 2023-09-30T22:33:51.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.749+0000 7f95deffd700 1 -- 172.21.15.59:0/2260320142 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f95e0050780 con 0x7f95f009d630 2023-09-30T22:33:51.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.749+0000 7f95f4d4e700 1 -- 172.21.15.59:0/2260320142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f00747f0 con 0x7f95f009d630 2023-09-30T22:33:51.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.754+0000 7f95deffd700 1 -- 172.21.15.59:0/2260320142 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95e002cc10 con 0x7f95f009d630 2023-09-30T22:33:51.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.863+0000 7f5a93d81700 1 -- 172.21.15.59:0/1232821200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5a8c1a7fe0 con 0x7f5a8c09d6f0 2023-09-30T22:33:51.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.863+0000 7f5a827fc700 1 -- 172.21.15.59:0/1232821200 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a8c1a7fe0 con 0x7f5a8c09d6f0 2023-09-30T22:33:51.865 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:51.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.865+0000 7f5a93d81700 1 -- 172.21.15.59:0/1232821200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a8c09d6f0 msgr2=0x7f5a8c1a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.865+0000 7f5a93d81700 1 --2- 172.21.15.59:0/1232821200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a8c09d6f0 0x7f5a8c1a5210 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800e930 tx=0x7f5a8800ec40 comp rx=0 tx=0).stop 2023-09-30T22:33:51.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.867+0000 7f5a93d81700 1 -- 172.21.15.59:0/1232821200 shutdown_connections 2023-09-30T22:33:51.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.867+0000 7f5a93d81700 1 --2- 172.21.15.59:0/1232821200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a8c09e410 0x7f5a8c1c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.867+0000 7f5a93d81700 1 --2- 172.21.15.59:0/1232821200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a8c09d6f0 0x7f5a8c1a5210 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.867+0000 7f5a93d81700 1 --2- 172.21.15.59:0/1232821200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a8c09e000 0x7f5a8c1a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.867+0000 7f5a93d81700 1 -- 172.21.15.59:0/1232821200 >> 172.21.15.59:0/1232821200 conn(0x7f5a8c066f50 msgr2=0x7f5a8c1bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:51.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.867+0000 7f5a93d81700 1 -- 172.21.15.59:0/1232821200 shutdown_connections 2023-09-30T22:33:51.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.867+0000 7f5a93d81700 1 -- 172.21.15.59:0/1232821200 wait complete. 2023-09-30T22:33:51.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:51.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.941+0000 7fabdf225700 1 -- 172.21.15.59:0/4272231082 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fabd8074ea0 con 0x7fabd806a770 2023-09-30T22:33:51.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.941+0000 7fabd57fa700 1 -- 172.21.15.59:0/4272231082 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabcc01b3b0 con 0x7fabd806a770 2023-09-30T22:33:51.942 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.943+0000 7fabdf225700 1 -- 172.21.15.59:0/4272231082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd806a770 msgr2=0x7fabd81c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.943+0000 7fabdf225700 1 --2- 172.21.15.59:0/4272231082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd806a770 0x7fabd81c8140 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fabcc00e900 tx=0x7fabcc00ec10 comp rx=0 tx=0).stop 2023-09-30T22:33:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.943+0000 7fabdf225700 1 -- 172.21.15.59:0/4272231082 shutdown_connections 2023-09-30T22:33:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.943+0000 7fabdf225700 1 --2- 172.21.15.59:0/4272231082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabd8131b40 0x7fabd81c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.943+0000 7fabdf225700 1 --2- 172.21.15.59:0/4272231082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabd806a770 0x7fabd81c8140 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.943+0000 7fabdf225700 1 --2- 172.21.15.59:0/4272231082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabd806b080 0x7fabd81c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.943+0000 7fabdf225700 1 -- 172.21.15.59:0/4272231082 >> 172.21.15.59:0/4272231082 conn(0x7fabd8066f50 msgr2=0x7fabd80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.943+0000 7fabdf225700 1 -- 172.21.15.59:0/4272231082 shutdown_connections 2023-09-30T22:33:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.944+0000 7fabdf225700 1 -- 172.21.15.59:0/4272231082 wait complete. 2023-09-30T22:33:51.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:51.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.963+0000 7f95f4d4e700 1 -- 172.21.15.59:0/2260320142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f95f01334b0 con 0x7f95f009d630 2023-09-30T22:33:51.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.963+0000 7f95deffd700 1 -- 172.21.15.59:0/2260320142 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95e0028020 con 0x7f95f009d630 2023-09-30T22:33:51.966 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:51.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.965+0000 7f95f4d4e700 1 -- 172.21.15.59:0/2260320142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f009d630 msgr2=0x7f95f011f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.965+0000 7f95f4d4e700 1 --2- 172.21.15.59:0/2260320142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f009d630 0x7f95f011f500 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f95e000e900 tx=0x7f95e000ec10 comp rx=0 tx=0).stop 2023-09-30T22:33:51.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.965+0000 7f95f4d4e700 1 -- 172.21.15.59:0/2260320142 shutdown_connections 2023-09-30T22:33:51.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.965+0000 7f95f4d4e700 1 --2- 172.21.15.59:0/2260320142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f0133930 0x7f95f01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.965+0000 7f95f4d4e700 1 --2- 172.21.15.59:0/2260320142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f009d630 0x7f95f011f500 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.965+0000 7f95f4d4e700 1 --2- 172.21.15.59:0/2260320142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95f00a0a30 0x7f95f011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.965+0000 7f95f4d4e700 1 -- 172.21.15.59:0/2260320142 >> 172.21.15.59:0/2260320142 conn(0x7f95f00a3050 msgr2=0x7f95f01bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:51.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.965+0000 7f95f4d4e700 1 -- 172.21.15.59:0/2260320142 shutdown_connections 2023-09-30T22:33:51.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.965+0000 7f95f4d4e700 1 -- 172.21.15.59:0/2260320142 wait complete. 2023-09-30T22:33:51.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.976+0000 7fe43bac3700 1 -- 172.21.15.59:0/2642282590 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe434074ea0 con 0x7fe43406fb20 2023-09-30T22:33:51.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.976+0000 7fe42a7fc700 1 -- 172.21.15.59:0/2642282590 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4300252b0 con 0x7fe43406fb20 2023-09-30T22:33:51.977 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:51.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.978+0000 7fe43bac3700 1 -- 172.21.15.59:0/2642282590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe43406fb20 msgr2=0x7fe43411b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:51.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.978+0000 7fe43bac3700 1 --2- 172.21.15.59:0/2642282590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe43406fb20 0x7fe43411b730 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fe43000d7c0 tx=0x7fe43000dad0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.978+0000 7fe43bac3700 1 -- 172.21.15.59:0/2642282590 shutdown_connections 2023-09-30T22:33:51.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.978+0000 7fe43bac3700 1 --2- 172.21.15.59:0/2642282590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe434130e50 0x7fe43411c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.978+0000 7fe43bac3700 1 --2- 172.21.15.59:0/2642282590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe43406fb20 0x7fe43411b730 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.978+0000 7fe43bac3700 1 --2- 172.21.15.59:0/2642282590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe434130540 0x7fe43411bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:51.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.978+0000 7fe43bac3700 1 -- 172.21.15.59:0/2642282590 >> 172.21.15.59:0/2642282590 conn(0x7fe4340a2aa0 msgr2=0x7fe43412fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:51.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.978+0000 7fe43bac3700 1 -- 172.21.15.59:0/2642282590 shutdown_connections 2023-09-30T22:33:51.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:51.978+0000 7fe43bac3700 1 -- 172.21.15.59:0/2642282590 wait complete. 2023-09-30T22:33:51.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:51.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:52.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:52.959 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:52.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:52.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:53.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.033+0000 7fdb3e3e2700 1 Processor -- start 2023-09-30T22:33:53.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.033+0000 7fdb3e3e2700 1 -- start start 2023-09-30T22:33:53.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.033+0000 7fdb3e3e2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb3809e1d0 0x7fdb38135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.033+0000 7fdb3e3e2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb38135e50 0x7fdb38138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.033+0000 7fdb3e3e2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3809f130 con 0x7fdb3809d6f0 2023-09-30T22:33:53.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.033+0000 7fdb3e3e2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb3809f520 con 0x7fdb3809e1d0 2023-09-30T22:33:53.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.033+0000 7fdb3e3e2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3809e930 con 0x7fdb38135e50 2023-09-30T22:33:53.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.034+0000 7fdb37fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdb3809d6f0 0x7fdb3809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52508/0 (socket says 172.21.15.59:52508) 2023-09-30T22:33:53.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.034+0000 7fdb377fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb3809e1d0 0x7fdb38135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.034+0000 7fdb37fff700 1 -- 172.21.15.59:0/193625702 learned_addr learned my addr 172.21.15.59:0/193625702 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:53.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.034+0000 7fdb3c97f700 1 --2- 172.21.15.59:0/193625702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb38135e50 0x7fdb38138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.034+0000 7fdb377fe700 1 -- 172.21.15.59:0/193625702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb38135e50 msgr2=0x7fdb38138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:53.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.034+0000 7fdb377fe700 1 --2- 172.21.15.59:0/193625702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb38135e50 0x7fdb38138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.034+0000 7fdb377fe700 1 -- 172.21.15.59:0/193625702 >> v1:172.21.15.59:6789/0 conn(0x7fdb3809d6f0 legacy=0x7fdb3809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.034+0000 7fdb36ffd700 1 -- 172.21.15.59:0/193625702 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329891586 0 0) 0x7fdb3809f130 con 0x7fdb3809d6f0 2023-09-30T22:33:53.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.034+0000 7fdb377fe700 1 -- 172.21.15.59:0/193625702 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3809b2d0 con 0x7fdb3809e1d0 2023-09-30T22:33:53.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.035+0000 7fdb377fe700 1 --2- 172.21.15.59:0/193625702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809e1d0 0x7fdb38135910 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009840 tx=0x7fdb2c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aac77cad728d4e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:53.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.035+0000 7fdb36ffd700 1 -- 172.21.15.59:0/193625702 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c011830 con 0x7fdb3809e1d0 2023-09-30T22:33:53.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.035+0000 7fdb36ffd700 1 -- 172.21.15.59:0/193625702 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c011990 con 0x7fdb3809e1d0 2023-09-30T22:33:53.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.035+0000 7fdb36ffd700 1 -- 172.21.15.59:0/193625702 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c011d20 con 0x7fdb3809e1d0 2023-09-30T22:33:53.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.036+0000 7fdb3e3e2700 1 -- 172.21.15.59:0/193625702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809e1d0 msgr2=0x7fdb38135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.036+0000 7fdb3e3e2700 1 --2- 172.21.15.59:0/193625702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809e1d0 0x7fdb38135910 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009840 tx=0x7fdb2c009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:53.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.036+0000 7fdb3e3e2700 1 -- 172.21.15.59:0/193625702 shutdown_connections 2023-09-30T22:33:53.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.036+0000 7fdb3e3e2700 1 --2- 172.21.15.59:0/193625702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb38135e50 0x7fdb38138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.036+0000 7fdb3e3e2700 1 --2- 172.21.15.59:0/193625702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809e1d0 0x7fdb38135910 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.036+0000 7fdb3e3e2700 1 -- 172.21.15.59:0/193625702 >> 172.21.15.59:0/193625702 conn(0x7fdb38066f50 msgr2=0x7fdb3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:53.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.036+0000 7fdb3e3e2700 1 -- 172.21.15.59:0/193625702 shutdown_connections 2023-09-30T22:33:53.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.036+0000 7fdb3e3e2700 1 -- 172.21.15.59:0/193625702 wait complete. 2023-09-30T22:33:53.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.037+0000 7fdb3e3e2700 1 Processor -- start 2023-09-30T22:33:53.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.037+0000 7fdb3e3e2700 1 -- start start 2023-09-30T22:33:53.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.038+0000 7fdb3e3e2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809d6f0 0x7fdb38136250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.038+0000 7fdb3e3e2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809e1d0 0x7fdb38136790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.038+0000 7fdb3e3e2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb38135e50 0x7fdb38136cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.038+0000 7fdb3e3e2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38071d80 con 0x7fdb3809d6f0 2023-09-30T22:33:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.038+0000 7fdb3e3e2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3809c700 con 0x7fdb38135e50 2023-09-30T22:33:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.038+0000 7fdb3e3e2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38121350 con 0x7fdb3809e1d0 2023-09-30T22:33:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.038+0000 7fdb3c97f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb38135e50 0x7fdb38136cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.038+0000 7fdb37fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809d6f0 0x7fdb38136250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.038+0000 7fdb3c97f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb38135e50 0x7fdb38136cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43664/0 (socket says 172.21.15.59:43664) 2023-09-30T22:33:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.038+0000 7fdb37fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809d6f0 0x7fdb38136250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59214/0 (socket says 172.21.15.59:59214) 2023-09-30T22:33:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.038+0000 7fdb3c97f700 1 -- 172.21.15.59:0/3078930732 learned_addr learned my addr 172.21.15.59:0/3078930732 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.039+0000 7fdb3c97f700 1 -- 172.21.15.59:0/3078930732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809e1d0 msgr2=0x7fdb38136790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:33:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.039+0000 7fdb3c97f700 1 --2- 172.21.15.59:0/3078930732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809e1d0 0x7fdb38136790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.039+0000 7fdb3c97f700 1 -- 172.21.15.59:0/3078930732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809d6f0 msgr2=0x7fdb38136250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.039+0000 7fdb3c97f700 1 --2- 172.21.15.59:0/3078930732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809d6f0 0x7fdb38136250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.039+0000 7fdb3c97f700 1 -- 172.21.15.59:0/3078930732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c0094a0 con 0x7fdb38135e50 2023-09-30T22:33:53.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.039+0000 7fdb37fff700 1 --2- 172.21.15.59:0/3078930732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809d6f0 0x7fdb38136250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:53.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.039+0000 7fdb3c97f700 1 --2- 172.21.15.59:0/3078930732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb38135e50 0x7fdb38136cd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000efc0 tx=0x7fdb3000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.039+0000 7fdb34ff9700 1 -- 172.21.15.59:0/3078930732 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3000cd40 con 0x7fdb38135e50 2023-09-30T22:33:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.039+0000 7fdb34ff9700 1 -- 172.21.15.59:0/3078930732 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3000f040 con 0x7fdb38135e50 2023-09-30T22:33:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.039+0000 7fdb3e3e2700 1 -- 172.21.15.59:0/3078930732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb38121c60 con 0x7fdb38135e50 2023-09-30T22:33:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.039+0000 7fdb3e3e2700 1 -- 172.21.15.59:0/3078930732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb381218e0 con 0x7fdb38135e50 2023-09-30T22:33:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.040+0000 7fdb34ff9700 1 -- 172.21.15.59:0/3078930732 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb300146c0 con 0x7fdb38135e50 2023-09-30T22:33:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.040+0000 7fdb34ff9700 1 -- 172.21.15.59:0/3078930732 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb30014820 con 0x7fdb38135e50 2023-09-30T22:33:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.041+0000 7fdb34ff9700 1 -- 172.21.15.59:0/3078930732 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb30040330 con 0x7fdb38135e50 2023-09-30T22:33:53.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.041+0000 7fdb3e3e2700 1 -- 172.21.15.59:0/3078930732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb180052e0 con 0x7fdb38135e50 2023-09-30T22:33:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.050+0000 7fdb34ff9700 1 -- 172.21.15.59:0/3078930732 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb3001d400 con 0x7fdb38135e50 2023-09-30T22:33:53.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.109+0000 7fc9ae6ed700 1 Processor -- start 2023-09-30T22:33:53.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.109+0000 7fc9ae6ed700 1 -- start start 2023-09-30T22:33:53.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.109+0000 7fc9ae6ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a809f330 0x7fc9a8136be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.109+0000 7fc9ae6ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a8137120 0x7fc9a8139500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.109+0000 7fc9ae6ed700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a809b560 con 0x7fc9a809e850 2023-09-30T22:33:53.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.109+0000 7fc9ae6ed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a809f720 con 0x7fc9a809f330 2023-09-30T22:33:53.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.109+0000 7fc9ae6ed700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80a0040 con 0x7fc9a8137120 2023-09-30T22:33:53.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.110+0000 7fc9a77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a809f330 0x7fc9a8136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.110+0000 7fc9a7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc9a809e850 0x7fc9a809ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52524/0 (socket says 172.21.15.59:52524) 2023-09-30T22:33:53.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.110+0000 7fc9a7fff700 1 -- 172.21.15.59:0/568502669 learned_addr learned my addr 172.21.15.59:0/568502669 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:53.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.110+0000 7fc9acc8a700 1 --2- 172.21.15.59:0/568502669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a8137120 0x7fc9a8139500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.110+0000 7fc9acc8a700 1 -- 172.21.15.59:0/568502669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a809f330 msgr2=0x7fc9a8136be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:53.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.110+0000 7fc9acc8a700 1 --2- 172.21.15.59:0/568502669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a809f330 0x7fc9a8136be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.110+0000 7fc9acc8a700 1 -- 172.21.15.59:0/568502669 >> v1:172.21.15.59:6789/0 conn(0x7fc9a809e850 legacy=0x7fc9a809ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.110+0000 7fc9acc8a700 1 -- 172.21.15.59:0/568502669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a80a02e0 con 0x7fc9a8137120 2023-09-30T22:33:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.110+0000 7fc9a6ffd700 1 -- 172.21.15.59:0/568502669 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835407697 0 0) 0x7fc9a809b560 con 0x7fc9a809e850 2023-09-30T22:33:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.110+0000 7fc9acc8a700 1 --2- 172.21.15.59:0/568502669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a8137120 0x7fc9a8139500 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009dc0 tx=0x7fc9a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a375405ebfd7abac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.111+0000 7fc9a6ffd700 1 -- 172.21.15.59:0/568502669 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a000e070 con 0x7fc9a8137120 2023-09-30T22:33:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.111+0000 7fc9a6ffd700 1 -- 172.21.15.59:0/568502669 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a000bb20 con 0x7fc9a8137120 2023-09-30T22:33:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.111+0000 7fc9a6ffd700 1 -- 172.21.15.59:0/568502669 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0012430 con 0x7fc9a8137120 2023-09-30T22:33:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.112+0000 7fc9ae6ed700 1 -- 172.21.15.59:0/568502669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a8137120 msgr2=0x7fc9a8139500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.112+0000 7fc9ae6ed700 1 --2- 172.21.15.59:0/568502669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a8137120 0x7fc9a8139500 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009dc0 tx=0x7fc9a000b330 comp rx=0 tx=0).stop 2023-09-30T22:33:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.112+0000 7fc9ae6ed700 1 -- 172.21.15.59:0/568502669 shutdown_connections 2023-09-30T22:33:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.112+0000 7fc9ae6ed700 1 --2- 172.21.15.59:0/568502669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a8137120 0x7fc9a8139500 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.112+0000 7fc9ae6ed700 1 --2- 172.21.15.59:0/568502669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a809f330 0x7fc9a8136be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.112+0000 7fc9ae6ed700 1 -- 172.21.15.59:0/568502669 >> 172.21.15.59:0/568502669 conn(0x7fc9a80a3f70 msgr2=0x7fc9a80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.112+0000 7fc9ae6ed700 1 -- 172.21.15.59:0/568502669 shutdown_connections 2023-09-30T22:33:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.112+0000 7fc9ae6ed700 1 -- 172.21.15.59:0/568502669 wait complete. 2023-09-30T22:33:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.113+0000 7fc9ae6ed700 1 Processor -- start 2023-09-30T22:33:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.114+0000 7fc9ae6ed700 1 -- start start 2023-09-30T22:33:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.114+0000 7fc9ae6ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a809e850 0x7fc9a806c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9ae6ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a809f330 0x7fc9a806c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9ae6ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a8137120 0x7fc9a81c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9ae6ed700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a81250d0 con 0x7fc9a809e850 2023-09-30T22:33:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9ae6ed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a81252b0 con 0x7fc9a8137120 2023-09-30T22:33:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9ae6ed700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a8135110 con 0x7fc9a809f330 2023-09-30T22:33:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9acc8a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a8137120 0x7fc9a81c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9acc8a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a8137120 0x7fc9a81c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43690/0 (socket says 172.21.15.59:43690) 2023-09-30T22:33:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9acc8a700 1 -- 172.21.15.59:0/1718001569 learned_addr learned my addr 172.21.15.59:0/1718001569 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9a77fe700 1 --2- 172.21.15.59:0/1718001569 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a809f330 0x7fc9a806c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9a7fff700 1 --2- 172.21.15.59:0/1718001569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a809e850 0x7fc9a806c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9acc8a700 1 -- 172.21.15.59:0/1718001569 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a809f330 msgr2=0x7fc9a806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9acc8a700 1 --2- 172.21.15.59:0/1718001569 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a809f330 0x7fc9a806c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9acc8a700 1 -- 172.21.15.59:0/1718001569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a809e850 msgr2=0x7fc9a806c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9acc8a700 1 --2- 172.21.15.59:0/1718001569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a809e850 0x7fc9a806c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9acc8a700 1 -- 172.21.15.59:0/1718001569 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a0009a70 con 0x7fc9a8137120 2023-09-30T22:33:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.115+0000 7fc9acc8a700 1 --2- 172.21.15.59:0/1718001569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a8137120 0x7fc9a81c8330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0014040 tx=0x7fc9a0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.116+0000 7fc9a4ff9700 1 -- 172.21.15.59:0/1718001569 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0012430 con 0x7fc9a8137120 2023-09-30T22:33:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.116+0000 7fc9a4ff9700 1 -- 172.21.15.59:0/1718001569 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a0020070 con 0x7fc9a8137120 2023-09-30T22:33:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.116+0000 7fc9a4ff9700 1 -- 172.21.15.59:0/1718001569 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0004280 con 0x7fc9a8137120 2023-09-30T22:33:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.116+0000 7fc9ae6ed700 1 -- 172.21.15.59:0/1718001569 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a806bd60 con 0x7fc9a8137120 2023-09-30T22:33:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.116+0000 7fc9ae6ed700 1 -- 172.21.15.59:0/1718001569 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a81369f0 con 0x7fc9a8137120 2023-09-30T22:33:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.117+0000 7fc9a4ff9700 1 -- 172.21.15.59:0/1718001569 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9a00043e0 con 0x7fc9a8137120 2023-09-30T22:33:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.117+0000 7fc9ae6ed700 1 -- 172.21.15.59:0/1718001569 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a80747f0 con 0x7fc9a8137120 2023-09-30T22:33:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.117+0000 7fc9a4ff9700 1 -- 172.21.15.59:0/1718001569 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc9a0022070 con 0x7fc9a8137120 2023-09-30T22:33:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.126+0000 7fc9a4ff9700 1 -- 172.21.15.59:0/1718001569 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9a0025b70 con 0x7fc9a8137120 2023-09-30T22:33:53.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.155+0000 7fc265a35700 1 Processor -- start 2023-09-30T22:33:53.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.155+0000 7fc265a35700 1 -- start start 2023-09-30T22:33:53.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.155+0000 7fc265a35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26009c650 0x7fc26009ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.155+0000 7fc265a35700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2600a0090 0x7fc26009cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.155+0000 7fc265a35700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26009ba70 con 0x7fc260131970 2023-09-30T22:33:53.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.155+0000 7fc265a35700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26009d4a0 con 0x7fc2600a0090 2023-09-30T22:33:53.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.155+0000 7fc265a35700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc26009e8f0 con 0x7fc26009c650 2023-09-30T22:33:53.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.155+0000 7fc25e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2600a0090 0x7fc26009cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.155+0000 7fc25f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc260131970 0x7fc260131dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52528/0 (socket says 172.21.15.59:52528) 2023-09-30T22:33:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.155+0000 7fc25effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26009c650 0x7fc26009ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.155+0000 7fc25f7fe700 1 -- 172.21.15.59:0/4289590102 learned_addr learned my addr 172.21.15.59:0/4289590102 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.156+0000 7fc25e7fc700 1 -- 172.21.15.59:0/4289590102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26009c650 msgr2=0x7fc26009ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.156+0000 7fc25e7fc700 1 --2- 172.21.15.59:0/4289590102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26009c650 0x7fc26009ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.156+0000 7fc25e7fc700 1 -- 172.21.15.59:0/4289590102 >> v1:172.21.15.59:6789/0 conn(0x7fc260131970 legacy=0x7fc260131dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.156+0000 7fc25e7fc700 1 -- 172.21.15.59:0/4289590102 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2600a0760 con 0x7fc2600a0090 2023-09-30T22:33:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.156+0000 7fc25dffb700 1 -- 172.21.15.59:0/4289590102 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33852995 0 0) 0x7fc26009ba70 con 0x7fc260131970 2023-09-30T22:33:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.156+0000 7fc25effd700 1 --2- 172.21.15.59:0/4289590102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26009c650 0x7fc26009ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.156+0000 7fc25e7fc700 1 --2- 172.21.15.59:0/4289590102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2600a0090 0x7fc26009cf60 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc254009840 tx=0x7fc254009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b960963982cda476 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:53.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.156+0000 7fc25dffb700 1 -- 172.21.15.59:0/4289590102 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254011830 con 0x7fc2600a0090 2023-09-30T22:33:53.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.156+0000 7fc25dffb700 1 -- 172.21.15.59:0/4289590102 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc254011990 con 0x7fc2600a0090 2023-09-30T22:33:53.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.156+0000 7fc25dffb700 1 -- 172.21.15.59:0/4289590102 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254011d20 con 0x7fc2600a0090 2023-09-30T22:33:53.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.157+0000 7fc265a35700 1 -- 172.21.15.59:0/4289590102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2600a0090 msgr2=0x7fc26009cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.157+0000 7fc265a35700 1 --2- 172.21.15.59:0/4289590102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2600a0090 0x7fc26009cf60 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc254009840 tx=0x7fc254009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:53.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.157+0000 7fc265a35700 1 -- 172.21.15.59:0/4289590102 shutdown_connections 2023-09-30T22:33:53.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.157+0000 7fc265a35700 1 --2- 172.21.15.59:0/4289590102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26009c650 0x7fc26009ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.157+0000 7fc265a35700 1 --2- 172.21.15.59:0/4289590102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2600a0090 0x7fc26009cf60 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.157+0000 7fc265a35700 1 -- 172.21.15.59:0/4289590102 >> 172.21.15.59:0/4289590102 conn(0x7fc2600a3f70 msgr2=0x7fc2600a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:53.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.157+0000 7fc265a35700 1 -- 172.21.15.59:0/4289590102 shutdown_connections 2023-09-30T22:33:53.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.157+0000 7fc265a35700 1 -- 172.21.15.59:0/4289590102 wait complete. 2023-09-30T22:33:53.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.158+0000 7fc265a35700 1 Processor -- start 2023-09-30T22:33:53.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.158+0000 7fc265a35700 1 -- start start 2023-09-30T22:33:53.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.159+0000 7fc265a35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26009c650 0x7fc26011bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.159+0000 7fc265a35700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2600a0090 0x7fc26011c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.159+0000 7fc265a35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc260131970 0x7fc26011c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.159+0000 7fc265a35700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26011d410 con 0x7fc2600a0090 2023-09-30T22:33:53.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.159+0000 7fc265a35700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26011dae0 con 0x7fc260131970 2023-09-30T22:33:53.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.159+0000 7fc265a35700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc26011e100 con 0x7fc26009c650 2023-09-30T22:33:53.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.159+0000 7fc25f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc260131970 0x7fc26011c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.159+0000 7fc25f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc260131970 0x7fc26011c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43702/0 (socket says 172.21.15.59:43702) 2023-09-30T22:33:53.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.159+0000 7fc25f7fe700 1 -- 172.21.15.59:0/3950338012 learned_addr learned my addr 172.21.15.59:0/3950338012 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:53.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.159+0000 7fc25e7fc700 1 --2- 172.21.15.59:0/3950338012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2600a0090 0x7fc26011c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.159+0000 7fc25f7fe700 1 -- 172.21.15.59:0/3950338012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26009c650 msgr2=0x7fc26011bf60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:33:53.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.159+0000 7fc25f7fe700 1 --2- 172.21.15.59:0/3950338012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26009c650 0x7fc26011bf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.159+0000 7fc25f7fe700 1 -- 172.21.15.59:0/3950338012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2600a0090 msgr2=0x7fc26011c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.159+0000 7fc25f7fe700 1 --2- 172.21.15.59:0/3950338012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2600a0090 0x7fc26011c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.159+0000 7fc25f7fe700 1 -- 172.21.15.59:0/3950338012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2500094a0 con 0x7fc260131970 2023-09-30T22:33:53.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.160+0000 7fc25f7fe700 1 --2- 172.21.15.59:0/3950338012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc260131970 0x7fc26011c9e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc25800cca0 tx=0x7fc25800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:53.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.160+0000 7f4e41d2b700 1 Processor -- start 2023-09-30T22:33:53.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.160+0000 7f4e41d2b700 1 -- start start 2023-09-30T22:33:53.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.160+0000 7fc247fff700 1 -- 172.21.15.59:0/3950338012 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25800ac20 con 0x7fc260131970 2023-09-30T22:33:53.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.160+0000 7fc247fff700 1 -- 172.21.15.59:0/3950338012 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25800ad80 con 0x7fc260131970 2023-09-30T22:33:53.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.160+0000 7fc247fff700 1 -- 172.21.15.59:0/3950338012 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc258007310 con 0x7fc260131970 2023-09-30T22:33:53.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.160+0000 7fc265a35700 1 -- 172.21.15.59:0/3950338012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2540094a0 con 0x7fc260131970 2023-09-30T22:33:53.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.160+0000 7fc265a35700 1 -- 172.21.15.59:0/3950338012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26012fdd0 con 0x7fc260131970 2023-09-30T22:33:53.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.161+0000 7f4e41d2b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4e3c1338a0 0x7f4e3c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.161+0000 7f4e41d2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e3c09e930 0x7f4e3c13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.161+0000 7f4e41d2b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c06ef30 con 0x7f4e3c09de50 2023-09-30T22:33:53.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.161+0000 7f4e41d2b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3c06fef0 con 0x7f4e3c1338a0 2023-09-30T22:33:53.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.161+0000 7f4e41d2b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c1334b0 con 0x7f4e3c09e930 2023-09-30T22:33:53.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.161+0000 7f4e3bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e3c09e930 0x7f4e3c13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.161+0000 7f4e3b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4e3c1338a0 0x7f4e3c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.161+0000 7f4e3bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e3c09e930 0x7f4e3c13b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43712/0 (socket says 172.21.15.59:43712) 2023-09-30T22:33:53.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.161+0000 7f4e3bfff700 1 -- 172.21.15.59:0/2870390230 learned_addr learned my addr 172.21.15.59:0/2870390230 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:53.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.161+0000 7f4e3bfff700 1 -- 172.21.15.59:0/2870390230 >> v2:172.21.15.59:3300/0 conn(0x7f4e3c1338a0 msgr2=0x7f4e3c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:53.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.161+0000 7f4e3bfff700 1 --2- 172.21.15.59:0/2870390230 >> v2:172.21.15.59:3300/0 conn(0x7f4e3c1338a0 0x7f4e3c133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.161+0000 7f4e3bfff700 1 -- 172.21.15.59:0/2870390230 >> v1:172.21.15.59:6789/0 conn(0x7f4e3c09de50 legacy=0x7f4e3c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.161+0000 7f4e3bfff700 1 -- 172.21.15.59:0/2870390230 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c06fc30 con 0x7f4e3c09e930 2023-09-30T22:33:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.162+0000 7f4e3bfff700 1 --2- 172.21.15.59:0/2870390230 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e3c09e930 0x7f4e3c13b740 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009e50 tx=0x7f4e3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2a138e822bbef7b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.162+0000 7f4e3a7fc700 1 -- 172.21.15.59:0/2870390230 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3400e070 con 0x7f4e3c09e930 2023-09-30T22:33:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.162+0000 7f4e3a7fc700 1 -- 172.21.15.59:0/2870390230 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e34003a20 con 0x7f4e3c09e930 2023-09-30T22:33:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.162+0000 7f4e3a7fc700 1 -- 172.21.15.59:0/2870390230 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34003dd0 con 0x7f4e3c09e930 2023-09-30T22:33:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.163+0000 7fc247fff700 1 -- 172.21.15.59:0/3950338012 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc258007470 con 0x7fc260131970 2023-09-30T22:33:53.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.163+0000 7fc247fff700 1 -- 172.21.15.59:0/3950338012 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc25803f2c0 con 0x7fc260131970 2023-09-30T22:33:53.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.163+0000 7f4e41d2b700 1 -- 172.21.15.59:0/2870390230 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e3c09e930 msgr2=0x7f4e3c13b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.163+0000 7f4e41d2b700 1 --2- 172.21.15.59:0/2870390230 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e3c09e930 0x7f4e3c13b740 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009e50 tx=0x7f4e3400b330 comp rx=0 tx=0).stop 2023-09-30T22:33:53.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.163+0000 7f4e41d2b700 1 -- 172.21.15.59:0/2870390230 shutdown_connections 2023-09-30T22:33:53.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.163+0000 7f4e41d2b700 1 --2- 172.21.15.59:0/2870390230 >> v2:172.21.15.59:3300/0 conn(0x7f4e3c1338a0 0x7f4e3c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.163+0000 7f4e41d2b700 1 --2- 172.21.15.59:0/2870390230 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e3c09e930 0x7f4e3c13b740 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.163+0000 7f4e41d2b700 1 -- 172.21.15.59:0/2870390230 >> 172.21.15.59:0/2870390230 conn(0x7f4e3c0a2aa0 msgr2=0x7f4e3c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:53.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.163+0000 7fc265a35700 1 -- 172.21.15.59:0/3950338012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc260070fb0 con 0x7fc260131970 2023-09-30T22:33:53.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.163+0000 7f4e41d2b700 1 -- 172.21.15.59:0/2870390230 shutdown_connections 2023-09-30T22:33:53.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.163+0000 7f4e41d2b700 1 -- 172.21.15.59:0/2870390230 wait complete. 2023-09-30T22:33:53.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.165+0000 7f4e41d2b700 1 Processor -- start 2023-09-30T22:33:53.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.165+0000 7f4e41d2b700 1 -- start start 2023-09-30T22:33:53.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e41d2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e3c09de50 0x7f4e3c11ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e41d2b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e3c09e930 0x7f4e3c11f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e41d2b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e3c1338a0 0x7f4e3c11f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e41d2b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c122340 con 0x7f4e3c09e930 2023-09-30T22:33:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e41d2b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c123430 con 0x7f4e3c09de50 2023-09-30T22:33:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e41d2b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c120f20 con 0x7f4e3c1338a0 2023-09-30T22:33:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e3affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e3c09e930 0x7f4e3c11f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e3affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e3c09e930 0x7f4e3c11f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59250/0 (socket says 172.21.15.59:59250) 2023-09-30T22:33:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e3affd700 1 -- 172.21.15.59:0/583130726 learned_addr learned my addr 172.21.15.59:0/583130726 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e3bfff700 1 --2- 172.21.15.59:0/583130726 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e3c1338a0 0x7f4e3c11f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e3b7fe700 1 --2- 172.21.15.59:0/583130726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e3c09de50 0x7f4e3c11ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e3affd700 1 -- 172.21.15.59:0/583130726 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e3c1338a0 msgr2=0x7f4e3c11f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e3affd700 1 --2- 172.21.15.59:0/583130726 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e3c1338a0 0x7f4e3c11f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e3affd700 1 -- 172.21.15.59:0/583130726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e3c09de50 msgr2=0x7f4e3c11ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e3affd700 1 --2- 172.21.15.59:0/583130726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e3c09de50 0x7f4e3c11ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e3affd700 1 -- 172.21.15.59:0/583130726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e34009b30 con 0x7f4e3c09e930 2023-09-30T22:33:53.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.166+0000 7f4e3affd700 1 --2- 172.21.15.59:0/583130726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e3c09e930 0x7f4e3c11f270 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f4e24013f70 tx=0x7f4e24007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:53.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.167+0000 7f4e33fff700 1 -- 172.21.15.59:0/583130726 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24011600 con 0x7f4e3c09e930 2023-09-30T22:33:53.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.167+0000 7f4e33fff700 1 -- 172.21.15.59:0/583130726 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2400b070 con 0x7f4e3c09e930 2023-09-30T22:33:53.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.167+0000 7f4e33fff700 1 -- 172.21.15.59:0/583130726 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24007ab0 con 0x7f4e3c09e930 2023-09-30T22:33:53.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.167+0000 7f4e41d2b700 1 -- 172.21.15.59:0/583130726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3c122570 con 0x7f4e3c09e930 2023-09-30T22:33:53.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.167+0000 7f4e41d2b700 1 -- 172.21.15.59:0/583130726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3c12f850 con 0x7f4e3c09e930 2023-09-30T22:33:53.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.168+0000 7f4e33fff700 1 -- 172.21.15.59:0/583130726 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e24007c10 con 0x7f4e3c09e930 2023-09-30T22:33:53.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.168+0000 7f4e33fff700 1 -- 172.21.15.59:0/583130726 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4e2403ebd0 con 0x7f4e3c09e930 2023-09-30T22:33:53.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.168+0000 7f4e41d2b700 1 -- 172.21.15.59:0/583130726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3c06ea40 con 0x7f4e3c09e930 2023-09-30T22:33:53.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.172+0000 7fc247fff700 1 -- 172.21.15.59:0/3950338012 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc25801b360 con 0x7fc260131970 2023-09-30T22:33:53.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.173+0000 7f4e33fff700 1 -- 172.21.15.59:0/583130726 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e2400f310 con 0x7f4e3c09e930 2023-09-30T22:33:53.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.269+0000 7fdb3e3e2700 1 -- 172.21.15.59:0/3078930732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb18005590 con 0x7fdb38135e50 2023-09-30T22:33:53.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.269+0000 7fdb34ff9700 1 -- 172.21.15.59:0/3078930732 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb3002c090 con 0x7fdb38135e50 2023-09-30T22:33:53.270 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:53.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.271+0000 7fdb3e3e2700 1 -- 172.21.15.59:0/3078930732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb38135e50 msgr2=0x7fdb38136cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.271+0000 7fdb3e3e2700 1 --2- 172.21.15.59:0/3078930732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb38135e50 0x7fdb38136cd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000efc0 tx=0x7fdb3000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.271+0000 7fdb3e3e2700 1 -- 172.21.15.59:0/3078930732 shutdown_connections 2023-09-30T22:33:53.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.271+0000 7fdb3e3e2700 1 --2- 172.21.15.59:0/3078930732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb38135e50 0x7fdb38136cd0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.271+0000 7fdb3e3e2700 1 --2- 172.21.15.59:0/3078930732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809d6f0 0x7fdb38136250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.271+0000 7fdb3e3e2700 1 --2- 172.21.15.59:0/3078930732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809e1d0 0x7fdb38136790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.271+0000 7fdb3e3e2700 1 -- 172.21.15.59:0/3078930732 >> 172.21.15.59:0/3078930732 conn(0x7fdb38066f50 msgr2=0x7fdb3806eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:53.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.272+0000 7fdb3e3e2700 1 -- 172.21.15.59:0/3078930732 shutdown_connections 2023-09-30T22:33:53.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.272+0000 7fdb3e3e2700 1 -- 172.21.15.59:0/3078930732 wait complete. 2023-09-30T22:33:53.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:53.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.345+0000 7fc9ae6ed700 1 -- 172.21.15.59:0/1718001569 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc9a809b780 con 0x7fc9a8137120 2023-09-30T22:33:53.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.345+0000 7fc9a4ff9700 1 -- 172.21.15.59:0/1718001569 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc9a001aeb0 con 0x7fc9a8137120 2023-09-30T22:33:53.347 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:53.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.348+0000 7fc9ae6ed700 1 -- 172.21.15.59:0/1718001569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a8137120 msgr2=0x7fc9a81c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.348+0000 7fc9ae6ed700 1 --2- 172.21.15.59:0/1718001569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a8137120 0x7fc9a81c8330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0014040 tx=0x7fc9a0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.348+0000 7fc9ae6ed700 1 -- 172.21.15.59:0/1718001569 shutdown_connections 2023-09-30T22:33:53.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.348+0000 7fc9ae6ed700 1 --2- 172.21.15.59:0/1718001569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a8137120 0x7fc9a81c8330 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.348+0000 7fc9ae6ed700 1 --2- 172.21.15.59:0/1718001569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a809e850 0x7fc9a806c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.348+0000 7fc9ae6ed700 1 --2- 172.21.15.59:0/1718001569 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a809f330 0x7fc9a806c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.348+0000 7fc9ae6ed700 1 -- 172.21.15.59:0/1718001569 >> 172.21.15.59:0/1718001569 conn(0x7fc9a80a3f70 msgr2=0x7fc9a81359e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:53.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.349+0000 7fc9ae6ed700 1 -- 172.21.15.59:0/1718001569 shutdown_connections 2023-09-30T22:33:53.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.349+0000 7fc9ae6ed700 1 -- 172.21.15.59:0/1718001569 wait complete. 2023-09-30T22:33:53.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:53.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.384+0000 7f4e41d2b700 1 -- 172.21.15.59:0/583130726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4e3c074ea0 con 0x7f4e3c09e930 2023-09-30T22:33:53.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.384+0000 7fc265a35700 1 -- 172.21.15.59:0/3950338012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc2600747f0 con 0x7fc260131970 2023-09-30T22:33:53.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.384+0000 7f4e33fff700 1 -- 172.21.15.59:0/583130726 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e2400eaa0 con 0x7f4e3c09e930 2023-09-30T22:33:53.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.384+0000 7fc247fff700 1 -- 172.21.15.59:0/3950338012 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc258019640 con 0x7fc260131970 2023-09-30T22:33:53.386 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:53.387 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:53.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7fc265a35700 1 -- 172.21.15.59:0/3950338012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc260131970 msgr2=0x7fc26011c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7fc265a35700 1 --2- 172.21.15.59:0/3950338012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc260131970 0x7fc26011c9e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc25800cca0 tx=0x7fc25800a060 comp rx=0 tx=0).stop 2023-09-30T22:33:53.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7f4e41d2b700 1 -- 172.21.15.59:0/583130726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e3c09e930 msgr2=0x7f4e3c11f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:53.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7f4e41d2b700 1 --2- 172.21.15.59:0/583130726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e3c09e930 0x7f4e3c11f270 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f4e24013f70 tx=0x7f4e24007040 comp rx=0 tx=0).stop 2023-09-30T22:33:53.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7f4e41d2b700 1 -- 172.21.15.59:0/583130726 shutdown_connections 2023-09-30T22:33:53.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7f4e41d2b700 1 --2- 172.21.15.59:0/583130726 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e3c1338a0 0x7f4e3c11f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7f4e41d2b700 1 --2- 172.21.15.59:0/583130726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e3c09de50 0x7f4e3c11ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7f4e41d2b700 1 --2- 172.21.15.59:0/583130726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e3c09e930 0x7f4e3c11f270 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7f4e41d2b700 1 -- 172.21.15.59:0/583130726 >> 172.21.15.59:0/583130726 conn(0x7f4e3c0a2aa0 msgr2=0x7f4e3c09ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:53.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7fc265a35700 1 -- 172.21.15.59:0/3950338012 shutdown_connections 2023-09-30T22:33:53.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7fc265a35700 1 --2- 172.21.15.59:0/3950338012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26009c650 0x7fc26011bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7fc265a35700 1 --2- 172.21.15.59:0/3950338012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc260131970 0x7fc26011c9e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7fc265a35700 1 --2- 172.21.15.59:0/3950338012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2600a0090 0x7fc26011c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:53.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7fc265a35700 1 -- 172.21.15.59:0/3950338012 >> 172.21.15.59:0/3950338012 conn(0x7fc2600a3f70 msgr2=0x7fc2600a3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:53.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7f4e41d2b700 1 -- 172.21.15.59:0/583130726 shutdown_connections 2023-09-30T22:33:53.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7f4e41d2b700 1 -- 172.21.15.59:0/583130726 wait complete. 2023-09-30T22:33:53.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7fc265a35700 1 -- 172.21.15.59:0/3950338012 shutdown_connections 2023-09-30T22:33:53.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:53.387+0000 7fc265a35700 1 -- 172.21.15.59:0/3950338012 wait complete. 2023-09-30T22:33:53.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:53.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:54.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:54.364 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:54.404 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:54.405 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:54.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.437+0000 7f53a0b0f700 1 Processor -- start 2023-09-30T22:33:54.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.438+0000 7f53a0b0f700 1 -- start start 2023-09-30T22:33:54.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.438+0000 7f53a0b0f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539c09eca0 0x7f539c13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.438+0000 7f53a0b0f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539c06f050 0x7f539c13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.438+0000 7f53a0b0f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f539c070ee0 con 0x7f539c06e570 2023-09-30T22:33:54.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.438+0000 7f53a0b0f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c071980 con 0x7f539c06f050 2023-09-30T22:33:54.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.438+0000 7f53a0b0f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f539c071480 con 0x7f539c09eca0 2023-09-30T22:33:54.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.439+0000 7f539a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f539c06e570 0x7f539c06e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37020/0 (socket says 172.21.15.59:37020) 2023-09-30T22:33:54.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.439+0000 7f539a59c700 1 -- 172.21.15.59:0/3931448014 learned_addr learned my addr 172.21.15.59:0/3931448014 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:54.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.439+0000 7f5399d9b700 1 --2- 172.21.15.59:0/3931448014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539c09eca0 0x7f539c13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.439+0000 7f539ad9d700 1 --2- 172.21.15.59:0/3931448014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539c06f050 0x7f539c13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.439+0000 7f539ad9d700 1 -- 172.21.15.59:0/3931448014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539c09eca0 msgr2=0x7f539c13cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:54.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.439+0000 7f539ad9d700 1 --2- 172.21.15.59:0/3931448014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539c09eca0 0x7f539c13cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.439+0000 7f539ad9d700 1 -- 172.21.15.59:0/3931448014 >> v1:172.21.15.59:6789/0 conn(0x7f539c06e570 legacy=0x7f539c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.439+0000 7f539ad9d700 1 -- 172.21.15.59:0/3931448014 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c071b90 con 0x7f539c06f050 2023-09-30T22:33:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.439+0000 7f5399d9b700 1 --2- 172.21.15.59:0/3931448014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539c09eca0 0x7f539c13cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.440+0000 7f539ad9d700 1 --2- 172.21.15.59:0/3931448014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539c06f050 0x7f539c13f3f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5394009dc0 tx=0x7f539400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1f16682773f2cf0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.440+0000 7f539959a700 1 -- 172.21.15.59:0/3931448014 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539400e070 con 0x7f539c06f050 2023-09-30T22:33:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.440+0000 7f539959a700 1 -- 172.21.15.59:0/3931448014 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539400bb20 con 0x7f539c06f050 2023-09-30T22:33:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.440+0000 7f539959a700 1 -- 172.21.15.59:0/3931448014 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394012430 con 0x7f539c06f050 2023-09-30T22:33:54.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.441+0000 7f53a0b0f700 1 -- 172.21.15.59:0/3931448014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539c06f050 msgr2=0x7f539c13f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.441+0000 7f53a0b0f700 1 --2- 172.21.15.59:0/3931448014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539c06f050 0x7f539c13f3f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5394009dc0 tx=0x7f539400b330 comp rx=0 tx=0).stop 2023-09-30T22:33:54.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.441+0000 7f53a0b0f700 1 -- 172.21.15.59:0/3931448014 shutdown_connections 2023-09-30T22:33:54.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.441+0000 7f53a0b0f700 1 --2- 172.21.15.59:0/3931448014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539c06f050 0x7f539c13f3f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.441+0000 7f53a0b0f700 1 --2- 172.21.15.59:0/3931448014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539c09eca0 0x7f539c13cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.441+0000 7f53a0b0f700 1 -- 172.21.15.59:0/3931448014 >> 172.21.15.59:0/3931448014 conn(0x7f539c0a2aa0 msgr2=0x7f539c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:54.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.441+0000 7f53a0b0f700 1 -- 172.21.15.59:0/3931448014 shutdown_connections 2023-09-30T22:33:54.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.441+0000 7f53a0b0f700 1 -- 172.21.15.59:0/3931448014 wait complete. 2023-09-30T22:33:54.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.443+0000 7f53a0b0f700 1 Processor -- start 2023-09-30T22:33:54.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.443+0000 7f53a0b0f700 1 -- start start 2023-09-30T22:33:54.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.444+0000 7f53a0b0f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c06e570 0x7f539c1214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.444+0000 7f53a0b0f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539c06f050 0x7f539c121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.444+0000 7f53a0b0f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539c121f60 0x7f539c1cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.444+0000 7f53a0b0f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c123c90 con 0x7f539c06e570 2023-09-30T22:33:54.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.444+0000 7f53a0b0f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c122f70 con 0x7f539c121f60 2023-09-30T22:33:54.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.444+0000 7f53a0b0f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f539c1248e0 con 0x7f539c06f050 2023-09-30T22:33:54.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.444+0000 7f539ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539c121f60 0x7f539c1cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.444+0000 7f539ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539c121f60 0x7f539c1cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49324/0 (socket says 172.21.15.59:49324) 2023-09-30T22:33:54.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.444+0000 7f539ad9d700 1 -- 172.21.15.59:0/2828816293 learned_addr learned my addr 172.21.15.59:0/2828816293 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:54.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.444+0000 7f5399d9b700 1 --2- 172.21.15.59:0/2828816293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539c06f050 0x7f539c121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.445+0000 7f5399d9b700 1 -- 172.21.15.59:0/2828816293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539c121f60 msgr2=0x7f539c1cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.445+0000 7f5399d9b700 1 --2- 172.21.15.59:0/2828816293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539c121f60 0x7f539c1cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.445+0000 7f5399d9b700 1 -- 172.21.15.59:0/2828816293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c06e570 msgr2=0x7f539c1214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.445+0000 7f5399d9b700 1 --2- 172.21.15.59:0/2828816293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c06e570 0x7f539c1214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.445+0000 7f5399d9b700 1 -- 172.21.15.59:0/2828816293 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53900094a0 con 0x7f539c06f050 2023-09-30T22:33:54.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.445+0000 7f539ad9d700 1 --2- 172.21.15.59:0/2828816293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539c121f60 0x7f539c1cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:54.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.445+0000 7f5399d9b700 1 --2- 172.21.15.59:0/2828816293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539c06f050 0x7f539c121a20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f539000e980 tx=0x7f539000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:54.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.445+0000 7f538affd700 1 -- 172.21.15.59:0/2828816293 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539000eed0 con 0x7f539c06f050 2023-09-30T22:33:54.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.445+0000 7f538affd700 1 -- 172.21.15.59:0/2828816293 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539000c7f0 con 0x7f539c06f050 2023-09-30T22:33:54.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.445+0000 7f53a0b0f700 1 -- 172.21.15.59:0/2828816293 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5394009a70 con 0x7f539c06f050 2023-09-30T22:33:54.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.445+0000 7f538affd700 1 -- 172.21.15.59:0/2828816293 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539000cb80 con 0x7f539c06f050 2023-09-30T22:33:54.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.445+0000 7f53a0b0f700 1 -- 172.21.15.59:0/2828816293 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539c122850 con 0x7f539c06f050 2023-09-30T22:33:54.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.446+0000 7f538affd700 1 -- 172.21.15.59:0/2828816293 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f539000cce0 con 0x7f539c06f050 2023-09-30T22:33:54.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.447+0000 7f538affd700 1 -- 172.21.15.59:0/2828816293 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f539003fb30 con 0x7f539c06f050 2023-09-30T22:33:54.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.447+0000 7f53a0b0f700 1 -- 172.21.15.59:0/2828816293 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539c074ea0 con 0x7f539c06f050 2023-09-30T22:33:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.456+0000 7f538affd700 1 -- 172.21.15.59:0/2828816293 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5390011d90 con 0x7f539c06f050 2023-09-30T22:33:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.524+0000 7fae1e9fa700 1 Processor -- start 2023-09-30T22:33:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.524+0000 7fae1e9fa700 1 -- start start 2023-09-30T22:33:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.525+0000 7fae1e9fa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae1806a770 0x7fae1806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.525+0000 7fae1e9fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae1806b080 0x7fae18131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.525+0000 7fae1e9fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae18131b40 0x7fae18131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.525+0000 7fae1e9fa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1809ece0 con 0x7fae1806a770 2023-09-30T22:33:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.525+0000 7fae1e9fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1809e760 con 0x7fae1806b080 2023-09-30T22:33:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.525+0000 7fae1e9fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae1809e040 con 0x7fae18131b40 2023-09-30T22:33:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.525+0000 7fae1cf97700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae18131b40 0x7fae18131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.525+0000 7fae1cf97700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae18131b40 0x7fae18131fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59580/0 (socket says 172.21.15.59:59580) 2023-09-30T22:33:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.525+0000 7fae1cf97700 1 -- 172.21.15.59:0/1201247805 learned_addr learned my addr 172.21.15.59:0/1201247805 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.525+0000 7fae17fff700 1 --2- 172.21.15.59:0/1201247805 >> v2:172.21.15.59:3300/0 conn(0x7fae1806a770 0x7fae1806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.525+0000 7fae177fe700 1 --2- 172.21.15.59:0/1201247805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae1806b080 0x7fae18131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.526+0000 7fae1cf97700 1 -- 172.21.15.59:0/1201247805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae1806b080 msgr2=0x7fae18131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.526+0000 7fae1cf97700 1 --2- 172.21.15.59:0/1201247805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae1806b080 0x7fae18131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.526+0000 7fae1cf97700 1 -- 172.21.15.59:0/1201247805 >> v2:172.21.15.59:3300/0 conn(0x7fae1806a770 msgr2=0x7fae1806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.526+0000 7fae1cf97700 1 --2- 172.21.15.59:0/1201247805 >> v2:172.21.15.59:3300/0 conn(0x7fae1806a770 0x7fae1806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.526+0000 7fae1cf97700 1 -- 172.21.15.59:0/1201247805 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1809f630 con 0x7fae18131b40 2023-09-30T22:33:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.526+0000 7fae177fe700 1 --2- 172.21.15.59:0/1201247805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae1806b080 0x7fae18131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.526+0000 7fae17fff700 1 --2- 172.21.15.59:0/1201247805 >> v2:172.21.15.59:3300/0 conn(0x7fae1806a770 0x7fae1806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.526+0000 7fae1cf97700 1 --2- 172.21.15.59:0/1201247805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae18131b40 0x7fae18131fa0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fae100085a0 tx=0x7fae100088b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b900d49be70c140d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.526+0000 7fae16ffd700 1 -- 172.21.15.59:0/1201247805 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1000d2d0 con 0x7fae18131b40 2023-09-30T22:33:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.526+0000 7fae16ffd700 1 -- 172.21.15.59:0/1201247805 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1000d430 con 0x7fae18131b40 2023-09-30T22:33:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.526+0000 7fae16ffd700 1 -- 172.21.15.59:0/1201247805 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1000b800 con 0x7fae18131b40 2023-09-30T22:33:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.527+0000 7fae1e9fa700 1 -- 172.21.15.59:0/1201247805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae18131b40 msgr2=0x7fae18131fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.527+0000 7fae1e9fa700 1 --2- 172.21.15.59:0/1201247805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae18131b40 0x7fae18131fa0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fae100085a0 tx=0x7fae100088b0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.527+0000 7fae1e9fa700 1 -- 172.21.15.59:0/1201247805 shutdown_connections 2023-09-30T22:33:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.527+0000 7fae1e9fa700 1 --2- 172.21.15.59:0/1201247805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae18131b40 0x7fae18131fa0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.527+0000 7fae1e9fa700 1 --2- 172.21.15.59:0/1201247805 >> v2:172.21.15.59:3300/0 conn(0x7fae1806a770 0x7fae1806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.527+0000 7fae1e9fa700 1 --2- 172.21.15.59:0/1201247805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae1806b080 0x7fae18131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.527+0000 7fae1e9fa700 1 -- 172.21.15.59:0/1201247805 >> 172.21.15.59:0/1201247805 conn(0x7fae18066f50 msgr2=0x7fae1809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.527+0000 7fae1e9fa700 1 -- 172.21.15.59:0/1201247805 shutdown_connections 2023-09-30T22:33:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.527+0000 7fae1e9fa700 1 -- 172.21.15.59:0/1201247805 wait complete. 2023-09-30T22:33:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.529+0000 7fae1e9fa700 1 Processor -- start 2023-09-30T22:33:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.529+0000 7fae1e9fa700 1 -- start start 2023-09-30T22:33:54.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae1e9fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae1806a770 0x7fae181c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae1e9fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae1806b080 0x7fae181c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae1e9fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae18131b40 0x7fae181c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae1e9fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae18120390 con 0x7fae1806b080 2023-09-30T22:33:54.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae1e9fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae181201a0 con 0x7fae1806a770 2023-09-30T22:33:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae1e9fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae18120a70 con 0x7fae18131b40 2023-09-30T22:33:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae1cf97700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae18131b40 0x7fae181c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae1cf97700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae18131b40 0x7fae181c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59584/0 (socket says 172.21.15.59:59584) 2023-09-30T22:33:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae1cf97700 1 -- 172.21.15.59:0/4150341894 learned_addr learned my addr 172.21.15.59:0/4150341894 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae177fe700 1 --2- 172.21.15.59:0/4150341894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae1806b080 0x7fae181c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae17fff700 1 --2- 172.21.15.59:0/4150341894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae1806a770 0x7fae181c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae1cf97700 1 -- 172.21.15.59:0/4150341894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae1806a770 msgr2=0x7fae181c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae1cf97700 1 --2- 172.21.15.59:0/4150341894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae1806a770 0x7fae181c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae1cf97700 1 -- 172.21.15.59:0/4150341894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae1806b080 msgr2=0x7fae181c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae1cf97700 1 --2- 172.21.15.59:0/4150341894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae1806b080 0x7fae181c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.530+0000 7fae1cf97700 1 -- 172.21.15.59:0/4150341894 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae08011d40 con 0x7fae18131b40 2023-09-30T22:33:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.531+0000 7fae1cf97700 1 --2- 172.21.15.59:0/4150341894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae18131b40 0x7fae181c4810 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fae10008c00 tx=0x7fae10004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.531+0000 7fae14ff9700 1 -- 172.21.15.59:0/4150341894 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1001d070 con 0x7fae18131b40 2023-09-30T22:33:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.531+0000 7fae14ff9700 1 -- 172.21.15.59:0/4150341894 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1000b590 con 0x7fae18131b40 2023-09-30T22:33:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.531+0000 7fae1e9fa700 1 -- 172.21.15.59:0/4150341894 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0c0094a0 con 0x7fae18131b40 2023-09-30T22:33:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.531+0000 7fae14ff9700 1 -- 172.21.15.59:0/4150341894 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1000bc30 con 0x7fae18131b40 2023-09-30T22:33:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.531+0000 7fae1e9fa700 1 -- 172.21.15.59:0/4150341894 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae10008200 con 0x7fae18131b40 2023-09-30T22:33:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.532+0000 7fae14ff9700 1 -- 172.21.15.59:0/4150341894 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae10004040 con 0x7fae18131b40 2023-09-30T22:33:54.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.532+0000 7fae14ff9700 1 -- 172.21.15.59:0/4150341894 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fae10040a40 con 0x7fae18131b40 2023-09-30T22:33:54.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.533+0000 7fae1e9fa700 1 -- 172.21.15.59:0/4150341894 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae18071e60 con 0x7fae18131b40 2023-09-30T22:33:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.541+0000 7fae14ff9700 1 -- 172.21.15.59:0/4150341894 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae10016450 con 0x7fae18131b40 2023-09-30T22:33:54.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.559+0000 7fe53abb5700 1 Processor -- start 2023-09-30T22:33:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.559+0000 7fe53abb5700 1 -- start start 2023-09-30T22:33:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.560+0000 7fe53abb5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe534133420 0x7fe5341337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.560+0000 7f6d22ac6700 1 Processor -- start 2023-09-30T22:33:54.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.560+0000 7fe53abb5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe534134260 0x7fe5341306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.560+0000 7fe53abb5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53406b990 con 0x7fe534133e30 2023-09-30T22:33:54.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.560+0000 7fe53abb5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5340a0590 con 0x7fe534134260 2023-09-30T22:33:54.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.560+0000 7fe53abb5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe53409fb80 con 0x7fe534133420 2023-09-30T22:33:54.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.560+0000 7fe539152700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe534134260 0x7fe5341306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.560+0000 7f6d22ac6700 1 -- start start 2023-09-30T22:33:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.560+0000 7fe539152700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe534134260 0x7fe5341306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35622/0 (socket says 172.21.15.59:35622) 2023-09-30T22:33:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.560+0000 7fe539152700 1 -- 172.21.15.59:0/595096727 learned_addr learned my addr 172.21.15.59:0/595096727 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7fe539152700 1 -- 172.21.15.59:0/595096727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe534133420 msgr2=0x7fe5341337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:54.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7fe538951700 1 --2- 172.21.15.59:0/595096727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe534133420 0x7fe5341337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7fe539152700 1 --2- 172.21.15.59:0/595096727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe534133420 0x7fe5341337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7fe539152700 1 -- 172.21.15.59:0/595096727 >> v1:172.21.15.59:6789/0 conn(0x7fe534133e30 legacy=0x7fe53412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7fe539152700 1 -- 172.21.15.59:0/595096727 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340a0030 con 0x7fe534134260 2023-09-30T22:33:54.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7f6d22ac6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c06e570 0x7f6d1c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7f6d22ac6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09eca0 0x7f6d1c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7f6d22ac6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d1c134610 0x7f6d1c134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7f6d22ac6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d1c070ee0 con 0x7f6d1c134610 2023-09-30T22:33:54.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7f6d22ac6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c071480 con 0x7f6d1c09eca0 2023-09-30T22:33:54.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7f6d22ac6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c06f3c0 con 0x7f6d1c06e570 2023-09-30T22:33:54.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7fe538951700 1 --2- 172.21.15.59:0/595096727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe534133420 0x7fe5341337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:54.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7fe539152700 1 --2- 172.21.15.59:0/595096727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe534134260 0x7fe5341306a0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009e50 tx=0x7fe52c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f35b1187f2622d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:54.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7f6d21063700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d1c134610 0x7f6d1c134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7f6d20862700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c06e570 0x7f6d1c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7fe5337fe700 1 -- 172.21.15.59:0/595096727 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c00e070 con 0x7fe534134260 2023-09-30T22:33:54.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7fe5337fe700 1 -- 172.21.15.59:0/595096727 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c00b9c0 con 0x7fe534134260 2023-09-30T22:33:54.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7fe5337fe700 1 -- 172.21.15.59:0/595096727 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c00bd70 con 0x7fe534134260 2023-09-30T22:33:54.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7f6d21063700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d1c134610 0x7f6d1c134ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35628/0 (socket says 172.21.15.59:35628) 2023-09-30T22:33:54.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.561+0000 7f6d21063700 1 -- 172.21.15.59:0/3861190145 learned_addr learned my addr 172.21.15.59:0/3861190145 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:54.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.562+0000 7f6d21063700 1 -- 172.21.15.59:0/3861190145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c06e570 msgr2=0x7f6d1c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:54.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.562+0000 7f6d21063700 1 --2- 172.21.15.59:0/3861190145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c06e570 0x7f6d1c06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.562+0000 7f6d21063700 1 -- 172.21.15.59:0/3861190145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09eca0 msgr2=0x7f6d1c06ee80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:33:54.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.562+0000 7f6d21063700 1 --2- 172.21.15.59:0/3861190145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09eca0 0x7f6d1c06ee80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.562+0000 7f6d21063700 1 -- 172.21.15.59:0/3861190145 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c071b90 con 0x7f6d1c134610 2023-09-30T22:33:54.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.562+0000 7f6d21063700 1 --2- 172.21.15.59:0/3861190145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c134610 0x7f6d1c134ab0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f6d14009e50 tx=0x7f6d1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836c9c81117d92a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:54.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.562+0000 7f6d1b7fe700 1 -- 172.21.15.59:0/3861190145 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1400e070 con 0x7f6d1c134610 2023-09-30T22:33:54.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.562+0000 7f6d1b7fe700 1 -- 172.21.15.59:0/3861190145 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1400b910 con 0x7f6d1c134610 2023-09-30T22:33:54.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.562+0000 7f6d1b7fe700 1 -- 172.21.15.59:0/3861190145 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1400bc80 con 0x7f6d1c134610 2023-09-30T22:33:54.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.562+0000 7fe53abb5700 1 -- 172.21.15.59:0/595096727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe534134260 msgr2=0x7fe5341306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.562+0000 7fe53abb5700 1 --2- 172.21.15.59:0/595096727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe534134260 0x7fe5341306a0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009e50 tx=0x7fe52c00b330 comp rx=0 tx=0).stop 2023-09-30T22:33:54.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.563+0000 7fe53abb5700 1 -- 172.21.15.59:0/595096727 shutdown_connections 2023-09-30T22:33:54.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.563+0000 7fe53abb5700 1 --2- 172.21.15.59:0/595096727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe534134260 0x7fe5341306a0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.563+0000 7fe53abb5700 1 --2- 172.21.15.59:0/595096727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe534133420 0x7fe5341337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.563+0000 7fe53abb5700 1 -- 172.21.15.59:0/595096727 >> 172.21.15.59:0/595096727 conn(0x7fe5340a4210 msgr2=0x7fe5340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:54.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.563+0000 7fe53abb5700 1 -- 172.21.15.59:0/595096727 shutdown_connections 2023-09-30T22:33:54.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.563+0000 7fe53abb5700 1 -- 172.21.15.59:0/595096727 wait complete. 2023-09-30T22:33:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.563+0000 7f6d22ac6700 1 -- 172.21.15.59:0/3861190145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c134610 msgr2=0x7f6d1c134ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.563+0000 7f6d22ac6700 1 --2- 172.21.15.59:0/3861190145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c134610 0x7f6d1c134ab0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f6d14009e50 tx=0x7f6d1400b330 comp rx=0 tx=0).stop 2023-09-30T22:33:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.564+0000 7f6d22ac6700 1 -- 172.21.15.59:0/3861190145 shutdown_connections 2023-09-30T22:33:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.564+0000 7f6d22ac6700 1 --2- 172.21.15.59:0/3861190145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c134610 0x7f6d1c134ab0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.564+0000 7f6d22ac6700 1 --2- 172.21.15.59:0/3861190145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c06e570 0x7f6d1c06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.564+0000 7f6d22ac6700 1 --2- 172.21.15.59:0/3861190145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c09eca0 0x7f6d1c06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.564+0000 7f6d22ac6700 1 -- 172.21.15.59:0/3861190145 >> 172.21.15.59:0/3861190145 conn(0x7f6d1c0a2aa0 msgr2=0x7f6d1c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:54.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.564+0000 7fe53abb5700 1 Processor -- start 2023-09-30T22:33:54.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.564+0000 7f6d22ac6700 1 -- 172.21.15.59:0/3861190145 shutdown_connections 2023-09-30T22:33:54.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.564+0000 7f6d22ac6700 1 -- 172.21.15.59:0/3861190145 wait complete. 2023-09-30T22:33:54.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.564+0000 7fe53abb5700 1 -- start start 2023-09-30T22:33:54.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.564+0000 7fe53abb5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe534133420 0x7fe53409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.564+0000 7fe53abb5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe534133e30 0x7fe53409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.564+0000 7fe53abb5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe534134260 0x7fe53409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.564+0000 7fe53abb5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53412d2a0 con 0x7fe534134260 2023-09-30T22:33:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.564+0000 7fe53abb5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53409df10 con 0x7fe534133e30 2023-09-30T22:33:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.564+0000 7fe53abb5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe53409e3b0 con 0x7fe534133420 2023-09-30T22:33:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.565+0000 7fe539152700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe534134260 0x7fe53409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.565+0000 7fe539152700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe534134260 0x7fe53409cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35642/0 (socket says 172.21.15.59:35642) 2023-09-30T22:33:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.565+0000 7fe539152700 1 -- 172.21.15.59:0/1371194382 learned_addr learned my addr 172.21.15.59:0/1371194382 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.565+0000 7fe538951700 1 --2- 172.21.15.59:0/1371194382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe534133420 0x7fe53409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.565+0000 7f6d22ac6700 1 Processor -- start 2023-09-30T22:33:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.565+0000 7fe539152700 1 -- 172.21.15.59:0/1371194382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe534133420 msgr2=0x7fe53409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.565+0000 7fe539152700 1 --2- 172.21.15.59:0/1371194382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe534133420 0x7fe53409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.565+0000 7fe539152700 1 -- 172.21.15.59:0/1371194382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe534133e30 msgr2=0x7fe53409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.565+0000 7fe539152700 1 --2- 172.21.15.59:0/1371194382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe534133e30 0x7fe53409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.565+0000 7fe539152700 1 -- 172.21.15.59:0/1371194382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c009b30 con 0x7fe534134260 2023-09-30T22:33:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.565+0000 7f6d22ac6700 1 -- start start 2023-09-30T22:33:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.565+0000 7fe539152700 1 --2- 172.21.15.59:0/1371194382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe534134260 0x7fe53409cf00 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fe52c012000 tx=0x7fe52c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.566+0000 7fe5317fa700 1 -- 172.21.15.59:0/1371194382 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0046a0 con 0x7fe534134260 2023-09-30T22:33:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.566+0000 7fe5317fa700 1 -- 172.21.15.59:0/1371194382 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c0092e0 con 0x7fe534134260 2023-09-30T22:33:54.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.566+0000 7fe53abb5700 1 -- 172.21.15.59:0/1371194382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53411fca0 con 0x7fe534134260 2023-09-30T22:33:54.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.566+0000 7fe53abb5700 1 -- 172.21.15.59:0/1371194382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5341209d0 con 0x7fe534134260 2023-09-30T22:33:54.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.566+0000 7f6d22ac6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c06e570 0x7f6d1c122210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.566+0000 7f6d22ac6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c134610 0x7f6d1c122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.566+0000 7f6d22ac6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c122c90 0x7f6d1c1d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:54.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.566+0000 7f6d22ac6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c125ce0 con 0x7f6d1c06e570 2023-09-30T22:33:54.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.566+0000 7f6d22ac6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c124660 con 0x7f6d1c122c90 2023-09-30T22:33:54.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.566+0000 7f6d22ac6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c0a2320 con 0x7f6d1c134610 2023-09-30T22:33:54.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.566+0000 7f6d1bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c134610 0x7f6d1c122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.566+0000 7f6d1bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c134610 0x7f6d1c122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59626/0 (socket says 172.21.15.59:59626) 2023-09-30T22:33:54.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.566+0000 7f6d1bfff700 1 -- 172.21.15.59:0/2611343935 learned_addr learned my addr 172.21.15.59:0/2611343935 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:54.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.566+0000 7fe5317fa700 1 -- 172.21.15.59:0/1371194382 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c01c410 con 0x7fe534134260 2023-09-30T22:33:54.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.567+0000 7f6d21063700 1 --2- 172.21.15.59:0/2611343935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c122c90 0x7f6d1c1d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:54.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.567+0000 7f6d1bfff700 1 -- 172.21.15.59:0/2611343935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c122c90 msgr2=0x7f6d1c1d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.567+0000 7f6d1bfff700 1 --2- 172.21.15.59:0/2611343935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c122c90 0x7f6d1c1d2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.567+0000 7f6d1bfff700 1 -- 172.21.15.59:0/2611343935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c06e570 msgr2=0x7f6d1c122210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.567+0000 7f6d1bfff700 1 --2- 172.21.15.59:0/2611343935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c06e570 0x7f6d1c122210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.567+0000 7f6d1bfff700 1 -- 172.21.15.59:0/2611343935 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d14009b30 con 0x7f6d1c134610 2023-09-30T22:33:54.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.567+0000 7f6d21063700 1 --2- 172.21.15.59:0/2611343935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c122c90 0x7f6d1c1d2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:33:54.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.567+0000 7fe53abb5700 1 -- 172.21.15.59:0/1371194382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5140052e0 con 0x7fe534134260 2023-09-30T22:33:54.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.567+0000 7f6d1bfff700 1 --2- 172.21.15.59:0/2611343935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c134610 0x7f6d1c122750 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800b520 tx=0x7f6d0800b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:54.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.567+0000 7f6d197fa700 1 -- 172.21.15.59:0/2611343935 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d08011830 con 0x7f6d1c134610 2023-09-30T22:33:54.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.567+0000 7f6d197fa700 1 -- 172.21.15.59:0/2611343935 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d08011990 con 0x7f6d1c134610 2023-09-30T22:33:54.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.567+0000 7f6d197fa700 1 -- 172.21.15.59:0/2611343935 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d08011d40 con 0x7f6d1c134610 2023-09-30T22:33:54.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.568+0000 7f6d22ac6700 1 -- 172.21.15.59:0/2611343935 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1c123dd0 con 0x7f6d1c134610 2023-09-30T22:33:54.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.568+0000 7f6d22ac6700 1 -- 172.21.15.59:0/2611343935 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1c070670 con 0x7f6d1c134610 2023-09-30T22:33:54.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.568+0000 7fe5317fa700 1 -- 172.21.15.59:0/1371194382 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe52c01c570 con 0x7fe534134260 2023-09-30T22:33:54.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.568+0000 7fe5317fa700 1 -- 172.21.15.59:0/1371194382 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe52c041410 con 0x7fe534134260 2023-09-30T22:33:54.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.569+0000 7f6d22ac6700 1 -- 172.21.15.59:0/2611343935 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1c074ea0 con 0x7f6d1c134610 2023-09-30T22:33:54.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.570+0000 7f6d197fa700 1 -- 172.21.15.59:0/2611343935 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d0801a400 con 0x7f6d1c134610 2023-09-30T22:33:54.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.570+0000 7f6d197fa700 1 -- 172.21.15.59:0/2611343935 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6d0803fe90 con 0x7f6d1c134610 2023-09-30T22:33:54.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.576+0000 7fe5317fa700 1 -- 172.21.15.59:0/1371194382 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe52c01a740 con 0x7fe534134260 2023-09-30T22:33:54.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.577+0000 7f6d197fa700 1 -- 172.21.15.59:0/2611343935 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d080218f0 con 0x7f6d1c134610 2023-09-30T22:33:54.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.723+0000 7f53a0b0f700 1 -- 172.21.15.59:0/2828816293 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f539c06b9e0 con 0x7f539c06f050 2023-09-30T22:33:54.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.724+0000 7f538affd700 1 -- 172.21.15.59:0/2828816293 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5390021020 con 0x7f539c06f050 2023-09-30T22:33:54.725 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:54.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.727+0000 7f53a0b0f700 1 -- 172.21.15.59:0/2828816293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539c06f050 msgr2=0x7f539c121a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.727+0000 7f53a0b0f700 1 --2- 172.21.15.59:0/2828816293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539c06f050 0x7f539c121a20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f539000e980 tx=0x7f539000ec90 comp rx=0 tx=0).stop 2023-09-30T22:33:54.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.727+0000 7f53a0b0f700 1 -- 172.21.15.59:0/2828816293 shutdown_connections 2023-09-30T22:33:54.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.727+0000 7f53a0b0f700 1 --2- 172.21.15.59:0/2828816293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539c121f60 0x7f539c1cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.727+0000 7f53a0b0f700 1 --2- 172.21.15.59:0/2828816293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c06e570 0x7f539c1214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.727+0000 7f53a0b0f700 1 --2- 172.21.15.59:0/2828816293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539c06f050 0x7f539c121a20 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.727+0000 7f53a0b0f700 1 -- 172.21.15.59:0/2828816293 >> 172.21.15.59:0/2828816293 conn(0x7f539c0a2aa0 msgr2=0x7f539c0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:54.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.727+0000 7f53a0b0f700 1 -- 172.21.15.59:0/2828816293 shutdown_connections 2023-09-30T22:33:54.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.727+0000 7f53a0b0f700 1 -- 172.21.15.59:0/2828816293 wait complete. 2023-09-30T22:33:54.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:54.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.752+0000 7fae1e9fa700 1 -- 172.21.15.59:0/4150341894 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae18074ea0 con 0x7fae18131b40 2023-09-30T22:33:54.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.752+0000 7fae14ff9700 1 -- 172.21.15.59:0/4150341894 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae10033090 con 0x7fae18131b40 2023-09-30T22:33:54.753 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:54.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.754+0000 7fae1e9fa700 1 -- 172.21.15.59:0/4150341894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae18131b40 msgr2=0x7fae181c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.754+0000 7fae1e9fa700 1 --2- 172.21.15.59:0/4150341894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae18131b40 0x7fae181c4810 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fae10008c00 tx=0x7fae10004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.754+0000 7fae1e9fa700 1 -- 172.21.15.59:0/4150341894 shutdown_connections 2023-09-30T22:33:54.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.754+0000 7fae1e9fa700 1 --2- 172.21.15.59:0/4150341894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae18131b40 0x7fae181c4810 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.754+0000 7fae1e9fa700 1 --2- 172.21.15.59:0/4150341894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae1806a770 0x7fae181c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.754+0000 7fae1e9fa700 1 --2- 172.21.15.59:0/4150341894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae1806b080 0x7fae181c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.754+0000 7fae1e9fa700 1 -- 172.21.15.59:0/4150341894 >> 172.21.15.59:0/4150341894 conn(0x7fae18066f50 msgr2=0x7fae180a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:54.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.754+0000 7fae1e9fa700 1 -- 172.21.15.59:0/4150341894 shutdown_connections 2023-09-30T22:33:54.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.754+0000 7fae1e9fa700 1 -- 172.21.15.59:0/4150341894 wait complete. 2023-09-30T22:33:54.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:54.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.783+0000 7fe53abb5700 1 -- 172.21.15.59:0/1371194382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe514005860 con 0x7fe534134260 2023-09-30T22:33:54.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.784+0000 7fe5317fa700 1 -- 172.21.15.59:0/1371194382 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe52c031020 con 0x7fe534134260 2023-09-30T22:33:54.785 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:54.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.786+0000 7fe53abb5700 1 -- 172.21.15.59:0/1371194382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe534134260 msgr2=0x7fe53409cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.786+0000 7fe53abb5700 1 --2- 172.21.15.59:0/1371194382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe534134260 0x7fe53409cf00 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fe52c012000 tx=0x7fe52c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.786+0000 7fe53abb5700 1 -- 172.21.15.59:0/1371194382 shutdown_connections 2023-09-30T22:33:54.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.786+0000 7fe53abb5700 1 --2- 172.21.15.59:0/1371194382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe534133420 0x7fe53409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.786+0000 7fe53abb5700 1 --2- 172.21.15.59:0/1371194382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe534134260 0x7fe53409cf00 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.786+0000 7fe53abb5700 1 --2- 172.21.15.59:0/1371194382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe534133e30 0x7fe53409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.786+0000 7fe53abb5700 1 -- 172.21.15.59:0/1371194382 >> 172.21.15.59:0/1371194382 conn(0x7fe5340a4210 msgr2=0x7fe5340a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:54.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.786+0000 7fe53abb5700 1 -- 172.21.15.59:0/1371194382 shutdown_connections 2023-09-30T22:33:54.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.786+0000 7fe53abb5700 1 -- 172.21.15.59:0/1371194382 wait complete. 2023-09-30T22:33:54.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:54.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.827+0000 7f6d22ac6700 1 -- 172.21.15.59:0/2611343935 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6d1c124210 con 0x7f6d1c134610 2023-09-30T22:33:54.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.827+0000 7f6d197fa700 1 -- 172.21.15.59:0/2611343935 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d1c124210 con 0x7f6d1c134610 2023-09-30T22:33:54.829 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.830+0000 7f6d22ac6700 1 -- 172.21.15.59:0/2611343935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c134610 msgr2=0x7f6d1c122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.830+0000 7f6d22ac6700 1 --2- 172.21.15.59:0/2611343935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c134610 0x7f6d1c122750 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800b520 tx=0x7f6d0800b8e0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.830+0000 7f6d22ac6700 1 -- 172.21.15.59:0/2611343935 shutdown_connections 2023-09-30T22:33:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.830+0000 7f6d22ac6700 1 --2- 172.21.15.59:0/2611343935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d1c122c90 0x7f6d1c1d2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.830+0000 7f6d22ac6700 1 --2- 172.21.15.59:0/2611343935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d1c06e570 0x7f6d1c122210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.830+0000 7f6d22ac6700 1 --2- 172.21.15.59:0/2611343935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d1c134610 0x7f6d1c122750 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:54.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.830+0000 7f6d22ac6700 1 -- 172.21.15.59:0/2611343935 >> 172.21.15.59:0/2611343935 conn(0x7f6d1c0a2aa0 msgr2=0x7f6d1c0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:54.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.830+0000 7f6d22ac6700 1 -- 172.21.15.59:0/2611343935 shutdown_connections 2023-09-30T22:33:54.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:54.830+0000 7f6d22ac6700 1 -- 172.21.15.59:0/2611343935 wait complete. 2023-09-30T22:33:54.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:55.744 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:55.771 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:55.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:55.845 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:55.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.901+0000 7f275d069700 1 Processor -- start 2023-09-30T22:33:55.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.902+0000 7f275d069700 1 -- start start 2023-09-30T22:33:55.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.902+0000 7f275d069700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2758130670 0x7f2758130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.902+0000 7f275d069700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f275806f680 0x7f275806fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.902+0000 7f275d069700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f275806ffd0 0x7f2758137530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.902+0000 7f275d069700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275809a350 con 0x7f275806f680 2023-09-30T22:33:55.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.902+0000 7f275d069700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2758130260 con 0x7f2758130670 2023-09-30T22:33:55.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.902+0000 7f275d069700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2758071ff0 con 0x7f275806ffd0 2023-09-30T22:33:55.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.903+0000 7f2756d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2758130670 0x7f2758130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.903+0000 7f2756d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2758130670 0x7f2758130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49362/0 (socket says 172.21.15.59:49362) 2023-09-30T22:33:55.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.903+0000 7f2756d9d700 1 -- 172.21.15.59:0/3617396299 learned_addr learned my addr 172.21.15.59:0/3617396299 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:55.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.903+0000 7f275759e700 1 --2- 172.21.15.59:0/3617396299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f275806ffd0 0x7f2758137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.903+0000 7f275659c700 1 --2- 172.21.15.59:0/3617396299 >> v2:172.21.15.59:3300/0 conn(0x7f275806f680 0x7f275806fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.903+0000 7f275759e700 1 -- 172.21.15.59:0/3617396299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2758130670 msgr2=0x7f2758130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:55.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.903+0000 7f275759e700 1 --2- 172.21.15.59:0/3617396299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2758130670 0x7f2758130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.903+0000 7f275759e700 1 -- 172.21.15.59:0/3617396299 >> v2:172.21.15.59:3300/0 conn(0x7f275806f680 msgr2=0x7f275806fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:55.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.903+0000 7f275759e700 1 --2- 172.21.15.59:0/3617396299 >> v2:172.21.15.59:3300/0 conn(0x7f275806f680 0x7f275806fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.903+0000 7f275759e700 1 -- 172.21.15.59:0/3617396299 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2758070470 con 0x7f275806ffd0 2023-09-30T22:33:55.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.903+0000 7f2756d9d700 1 --2- 172.21.15.59:0/3617396299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2758130670 0x7f2758130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:55.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.903+0000 7f275759e700 1 --2- 172.21.15.59:0/3617396299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f275806ffd0 0x7f2758137530 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2750009db0 tx=0x7f275001c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70e37d468adf05eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:55.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.904+0000 7f2755d9b700 1 -- 172.21.15.59:0/3617396299 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275001cae0 con 0x7f275806ffd0 2023-09-30T22:33:55.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.904+0000 7f2755d9b700 1 -- 172.21.15.59:0/3617396299 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275001f070 con 0x7f275806ffd0 2023-09-30T22:33:55.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.904+0000 7f2755d9b700 1 -- 172.21.15.59:0/3617396299 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275001ce80 con 0x7f275806ffd0 2023-09-30T22:33:55.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.905+0000 7f275d069700 1 -- 172.21.15.59:0/3617396299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f275806ffd0 msgr2=0x7f2758137530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.905+0000 7f275d069700 1 --2- 172.21.15.59:0/3617396299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f275806ffd0 0x7f2758137530 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2750009db0 tx=0x7f275001c340 comp rx=0 tx=0).stop 2023-09-30T22:33:55.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.905+0000 7f275d069700 1 -- 172.21.15.59:0/3617396299 shutdown_connections 2023-09-30T22:33:55.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.905+0000 7f275d069700 1 --2- 172.21.15.59:0/3617396299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f275806ffd0 0x7f2758137530 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.905+0000 7f275d069700 1 --2- 172.21.15.59:0/3617396299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2758130670 0x7f2758130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.905+0000 7f275d069700 1 --2- 172.21.15.59:0/3617396299 >> v2:172.21.15.59:3300/0 conn(0x7f275806f680 0x7f275806fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.905+0000 7f275d069700 1 -- 172.21.15.59:0/3617396299 >> 172.21.15.59:0/3617396299 conn(0x7f27580a2aa0 msgr2=0x7f27580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:55.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.905+0000 7f275d069700 1 -- 172.21.15.59:0/3617396299 shutdown_connections 2023-09-30T22:33:55.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.905+0000 7f275d069700 1 -- 172.21.15.59:0/3617396299 wait complete. 2023-09-30T22:33:55.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.907+0000 7f275d069700 1 Processor -- start 2023-09-30T22:33:55.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.907+0000 7f275d069700 1 -- start start 2023-09-30T22:33:55.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.907+0000 7f275d069700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f275806f680 0x7f275809bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.907+0000 7f275d069700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f275806ffd0 0x7f275809c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.907+0000 7f275d069700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2758130670 0x7f275809c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.907+0000 7f275d069700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275809e3c0 con 0x7f275806ffd0 2023-09-30T22:33:55.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.907+0000 7f275d069700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275811a020 con 0x7f2758130670 2023-09-30T22:33:55.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.907+0000 7f275d069700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f275812ebf0 con 0x7f275806f680 2023-09-30T22:33:55.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.907+0000 7f275659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f275806ffd0 0x7f275809c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.907+0000 7f275659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f275806ffd0 0x7f275809c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35662/0 (socket says 172.21.15.59:35662) 2023-09-30T22:33:55.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.907+0000 7f275659c700 1 -- 172.21.15.59:0/1602451843 learned_addr learned my addr 172.21.15.59:0/1602451843 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:55.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.907+0000 7f275759e700 1 --2- 172.21.15.59:0/1602451843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2758130670 0x7f275809c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.908+0000 7f275659c700 1 -- 172.21.15.59:0/1602451843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f275806f680 msgr2=0x7f275809bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.908+0000 7f275659c700 1 --2- 172.21.15.59:0/1602451843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f275806f680 0x7f275809bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.908+0000 7f275659c700 1 -- 172.21.15.59:0/1602451843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2758130670 msgr2=0x7f275809c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.908+0000 7f275659c700 1 --2- 172.21.15.59:0/1602451843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2758130670 0x7f275809c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.908+0000 7f275659c700 1 -- 172.21.15.59:0/1602451843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2748011df0 con 0x7f275806ffd0 2023-09-30T22:33:55.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.908+0000 7f275659c700 1 --2- 172.21.15.59:0/1602451843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f275806ffd0 0x7f275809c460 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f274c00e980 tx=0x7f274c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:55.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.908+0000 7f273f7fe700 1 -- 172.21.15.59:0/1602451843 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c009710 con 0x7f275806ffd0 2023-09-30T22:33:55.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.908+0000 7f273f7fe700 1 -- 172.21.15.59:0/1602451843 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c00eed0 con 0x7f275806ffd0 2023-09-30T22:33:55.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.908+0000 7f273f7fe700 1 -- 172.21.15.59:0/1602451843 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c00ca70 con 0x7f275806ffd0 2023-09-30T22:33:55.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.908+0000 7f275d069700 1 -- 172.21.15.59:0/1602451843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2750009a70 con 0x7f275806ffd0 2023-09-30T22:33:55.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.908+0000 7f275d069700 1 -- 172.21.15.59:0/1602451843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2758119800 con 0x7f275806ffd0 2023-09-30T22:33:55.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.910+0000 7f275d069700 1 -- 172.21.15.59:0/1602451843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2758071820 con 0x7f275806ffd0 2023-09-30T22:33:55.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.910+0000 7f273f7fe700 1 -- 172.21.15.59:0/1602451843 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f274c00cbd0 con 0x7f275806ffd0 2023-09-30T22:33:55.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.911+0000 7f273f7fe700 1 -- 172.21.15.59:0/1602451843 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f274c040090 con 0x7f275806ffd0 2023-09-30T22:33:55.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.919+0000 7f273f7fe700 1 -- 172.21.15.59:0/1602451843 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f274c011350 con 0x7f275806ffd0 2023-09-30T22:33:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.939+0000 7f63f7147700 1 Processor -- start 2023-09-30T22:33:55.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.940+0000 7f63f7147700 1 -- start start 2023-09-30T22:33:55.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.940+0000 7f63f7147700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f63f006c0e0 0x7f63f009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.940+0000 7f63f7147700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63f0134ec0 0x7f63f01379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.940+0000 7f63f7147700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f0134980 con 0x7f63f0137f20 2023-09-30T22:33:55.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.940+0000 7f63f7147700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f006c4b0 con 0x7f63f006c0e0 2023-09-30T22:33:55.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.940+0000 7f63f7147700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00a09c0 con 0x7f63f0134ec0 2023-09-30T22:33:55.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.940+0000 7f63f4ee3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f63f006c0e0 0x7f63f009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.940+0000 7f63f4ee3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f63f006c0e0 0x7f63f009ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35668/0 (socket says 172.21.15.59:35668) 2023-09-30T22:33:55.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.940+0000 7f63f4ee3700 1 -- 172.21.15.59:0/1139809202 learned_addr learned my addr 172.21.15.59:0/1139809202 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:55.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.941+0000 7f63f4ee3700 1 -- 172.21.15.59:0/1139809202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63f0134ec0 msgr2=0x7f63f01379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:55.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.941+0000 7f63f4ee3700 1 --2- 172.21.15.59:0/1139809202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63f0134ec0 0x7f63f01379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.941+0000 7f63f4ee3700 1 -- 172.21.15.59:0/1139809202 >> v1:172.21.15.59:6789/0 conn(0x7f63f0137f20 legacy=0x7f63f013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.941+0000 7f63f4ee3700 1 -- 172.21.15.59:0/1139809202 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f00a0600 con 0x7f63f006c0e0 2023-09-30T22:33:55.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.941+0000 7f63f4ee3700 1 --2- 172.21.15.59:0/1139809202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63f006c0e0 0x7f63f009ac90 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f63e40098f0 tx=0x7f63e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5112d32014ce1c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:55.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.941+0000 7f63ef7fe700 1 -- 172.21.15.59:0/1139809202 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400b8a0 con 0x7f63f006c0e0 2023-09-30T22:33:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.941+0000 7f63ef7fe700 1 -- 172.21.15.59:0/1139809202 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e400ba00 con 0x7f63f006c0e0 2023-09-30T22:33:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.941+0000 7f63ef7fe700 1 -- 172.21.15.59:0/1139809202 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400bd90 con 0x7f63f006c0e0 2023-09-30T22:33:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.942+0000 7f63f7147700 1 -- 172.21.15.59:0/1139809202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63f006c0e0 msgr2=0x7f63f009ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.942+0000 7f63f7147700 1 --2- 172.21.15.59:0/1139809202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63f006c0e0 0x7f63f009ac90 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f63e40098f0 tx=0x7f63e4009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.942+0000 7f63f7147700 1 -- 172.21.15.59:0/1139809202 shutdown_connections 2023-09-30T22:33:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.942+0000 7f63f7147700 1 --2- 172.21.15.59:0/1139809202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63f006c0e0 0x7f63f009ac90 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.942+0000 7f63f7147700 1 --2- 172.21.15.59:0/1139809202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63f0134ec0 0x7f63f01379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.942+0000 7f63f7147700 1 -- 172.21.15.59:0/1139809202 >> 172.21.15.59:0/1139809202 conn(0x7f63f00a4210 msgr2=0x7f63f00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.942+0000 7f63f7147700 1 -- 172.21.15.59:0/1139809202 shutdown_connections 2023-09-30T22:33:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.942+0000 7f63f7147700 1 -- 172.21.15.59:0/1139809202 wait complete. 2023-09-30T22:33:55.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.944+0000 7f63f7147700 1 Processor -- start 2023-09-30T22:33:55.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.944+0000 7f63f7147700 1 -- start start 2023-09-30T22:33:55.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.945+0000 7f63f7147700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63f006c0e0 0x7f63f011a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.945+0000 7f63f7147700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63f0134ec0 0x7f63f011abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.945+0000 7f63f7147700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63f0137f20 0x7f63f011b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.945+0000 7f63f7147700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00a03f0 con 0x7f63f0137f20 2023-09-30T22:33:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.945+0000 7f63f7147700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f011cff0 con 0x7f63f0134ec0 2023-09-30T22:33:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.945+0000 7f63f7147700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63f0137900 con 0x7f63f006c0e0 2023-09-30T22:33:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.945+0000 7f63f4ee3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63f006c0e0 0x7f63f011a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.945+0000 7f63f4ee3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63f006c0e0 0x7f63f011a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59664/0 (socket says 172.21.15.59:59664) 2023-09-30T22:33:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.945+0000 7f63f4ee3700 1 -- 172.21.15.59:0/3880208898 learned_addr learned my addr 172.21.15.59:0/3880208898 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.945+0000 7f63effff700 1 --2- 172.21.15.59:0/3880208898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63f0134ec0 0x7f63f011abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.945+0000 7f63f56e4700 1 --2- 172.21.15.59:0/3880208898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63f0137f20 0x7f63f011b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.946+0000 7f63effff700 1 -- 172.21.15.59:0/3880208898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63f006c0e0 msgr2=0x7f63f011a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.946+0000 7f63effff700 1 --2- 172.21.15.59:0/3880208898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63f006c0e0 0x7f63f011a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.946+0000 7f63effff700 1 -- 172.21.15.59:0/3880208898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63f0137f20 msgr2=0x7f63f011b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.946+0000 7f63effff700 1 --2- 172.21.15.59:0/3880208898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63f0137f20 0x7f63f011b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.946+0000 7f63effff700 1 -- 172.21.15.59:0/3880208898 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e4009550 con 0x7f63f0134ec0 2023-09-30T22:33:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.946+0000 7f63f56e4700 1 --2- 172.21.15.59:0/3880208898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63f0137f20 0x7f63f011b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.946+0000 7f63f4ee3700 1 --2- 172.21.15.59:0/3880208898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63f006c0e0 0x7f63f011a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.946+0000 7f63effff700 1 --2- 172.21.15.59:0/3880208898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63f0134ec0 0x7f63f011abc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00b450 tx=0x7f63dc00b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.946+0000 7f63ed7fa700 1 -- 172.21.15.59:0/3880208898 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc011830 con 0x7f63f0134ec0 2023-09-30T22:33:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.946+0000 7f63ed7fa700 1 -- 172.21.15.59:0/3880208898 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc011990 con 0x7f63f0134ec0 2023-09-30T22:33:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.946+0000 7f63f7147700 1 -- 172.21.15.59:0/3880208898 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f0140920 con 0x7f63f0134ec0 2023-09-30T22:33:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.946+0000 7f63ed7fa700 1 -- 172.21.15.59:0/3880208898 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc011d40 con 0x7f63f0134ec0 2023-09-30T22:33:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.946+0000 7f63f7147700 1 -- 172.21.15.59:0/3880208898 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f011e3b0 con 0x7f63f0134ec0 2023-09-30T22:33:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.948+0000 7f63f7147700 1 -- 172.21.15.59:0/3880208898 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f0074ea0 con 0x7f63f0134ec0 2023-09-30T22:33:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.948+0000 7f63ed7fa700 1 -- 172.21.15.59:0/3880208898 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63dc01a400 con 0x7f63f0134ec0 2023-09-30T22:33:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.948+0000 7f63ed7fa700 1 -- 172.21.15.59:0/3880208898 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f63dc03f4d0 con 0x7f63f0134ec0 2023-09-30T22:33:55.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.957+0000 7f63ed7fa700 1 -- 172.21.15.59:0/3880208898 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63dc009280 con 0x7f63f0134ec0 2023-09-30T22:33:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.977+0000 7fbea070c700 1 Processor -- start 2023-09-30T22:33:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.977+0000 7fbea070c700 1 -- start start 2023-09-30T22:33:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.978+0000 7fbea070c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe981338c0 0x7fbe98133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.979+0000 7fbea070c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe9809e560 0x7fbe9813b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.979+0000 7fbea070c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9806f720 con 0x7fbe981341d0 2023-09-30T22:33:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.979+0000 7fbea070c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe98070c80 con 0x7fbe981338c0 2023-09-30T22:33:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.979+0000 7fbea070c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9806fce0 con 0x7fbe9809e560 2023-09-30T22:33:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.979+0000 7fbe9eca9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe9809e560 0x7fbe9813b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.979+0000 7fbe9eca9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe9809e560 0x7fbe9813b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49394/0 (socket says 172.21.15.59:49394) 2023-09-30T22:33:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.979+0000 7fbe9eca9700 1 -- 172.21.15.59:0/4251468880 learned_addr learned my addr 172.21.15.59:0/4251468880 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.979+0000 7fbe9dca7700 1 --1- 172.21.15.59:0/4251468880 >> v1:172.21.15.59:6789/0 conn(0x7fbe981341d0 0x7fbe9809de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37052/0 (socket says 172.21.15.59:37052) 2023-09-30T22:33:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.979+0000 7fbe9e4a8700 1 --2- 172.21.15.59:0/4251468880 >> v2:172.21.15.59:3300/0 conn(0x7fbe981338c0 0x7fbe98133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.979+0000 7fbe9eca9700 1 -- 172.21.15.59:0/4251468880 >> v2:172.21.15.59:3300/0 conn(0x7fbe981338c0 msgr2=0x7fbe98133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.979+0000 7fbe9eca9700 1 --2- 172.21.15.59:0/4251468880 >> v2:172.21.15.59:3300/0 conn(0x7fbe981338c0 0x7fbe98133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.979+0000 7fbe9eca9700 1 -- 172.21.15.59:0/4251468880 >> v1:172.21.15.59:6789/0 conn(0x7fbe981341d0 legacy=0x7fbe9809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.979+0000 7fbe9eca9700 1 -- 172.21.15.59:0/4251468880 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe981336a0 con 0x7fbe9809e560 2023-09-30T22:33:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.979+0000 7fbe9eca9700 1 --2- 172.21.15.59:0/4251468880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe9809e560 0x7fbe9813b860 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009e50 tx=0x7fbe9000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8ef1b9c10423e1a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.980+0000 7fbe9d4a6700 1 -- 172.21.15.59:0/4251468880 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9000e070 con 0x7fbe9809e560 2023-09-30T22:33:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.980+0000 7fbe9d4a6700 1 -- 172.21.15.59:0/4251468880 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9000b910 con 0x7fbe9809e560 2023-09-30T22:33:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.980+0000 7fbe9d4a6700 1 -- 172.21.15.59:0/4251468880 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9000bcc0 con 0x7fbe9809e560 2023-09-30T22:33:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.980+0000 7fbea070c700 1 -- 172.21.15.59:0/4251468880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe9809e560 msgr2=0x7fbe9813b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.980+0000 7fbea070c700 1 --2- 172.21.15.59:0/4251468880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe9809e560 0x7fbe9813b860 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009e50 tx=0x7fbe9000b330 comp rx=0 tx=0).stop 2023-09-30T22:33:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.980+0000 7fbea070c700 1 -- 172.21.15.59:0/4251468880 shutdown_connections 2023-09-30T22:33:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.980+0000 7fbea070c700 1 --2- 172.21.15.59:0/4251468880 >> v2:172.21.15.59:3300/0 conn(0x7fbe981338c0 0x7fbe98133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.980+0000 7fbea070c700 1 --2- 172.21.15.59:0/4251468880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe9809e560 0x7fbe9813b860 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.980+0000 7fbea070c700 1 -- 172.21.15.59:0/4251468880 >> 172.21.15.59:0/4251468880 conn(0x7fbe980a2aa0 msgr2=0x7fbe980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.981+0000 7fbea070c700 1 -- 172.21.15.59:0/4251468880 shutdown_connections 2023-09-30T22:33:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.981+0000 7fbea070c700 1 -- 172.21.15.59:0/4251468880 wait complete. 2023-09-30T22:33:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.982+0000 7fbea070c700 1 Processor -- start 2023-09-30T22:33:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.982+0000 7fbea070c700 1 -- start start 2023-09-30T22:33:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.982+0000 7fbea070c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9809e560 0x7fbe9811fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.982+0000 7fbea070c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe981338c0 0x7fbe9811fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.982+0000 7fbea070c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe981341d0 0x7fbe98120530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.982+0000 7fbea070c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe980a1220 con 0x7fbe9809e560 2023-09-30T22:33:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.982+0000 7fbea070c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9806f960 con 0x7fbe981338c0 2023-09-30T22:33:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.982+0000 7fbea070c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe981309a0 con 0x7fbe981341d0 2023-09-30T22:33:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.982+0000 7fbe9dca7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe981338c0 0x7fbe9811fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.982+0000 7fbe9dca7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe981338c0 0x7fbe9811fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49402/0 (socket says 172.21.15.59:49402) 2023-09-30T22:33:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.982+0000 7fbe9dca7700 1 -- 172.21.15.59:0/1685499583 learned_addr learned my addr 172.21.15.59:0/1685499583 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.982+0000 7fbe9eca9700 1 --2- 172.21.15.59:0/1685499583 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe981341d0 0x7fbe98120530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.982+0000 7fbe9e4a8700 1 --2- 172.21.15.59:0/1685499583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9809e560 0x7fbe9811fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.983+0000 7fbe9dca7700 1 -- 172.21.15.59:0/1685499583 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe981341d0 msgr2=0x7fbe98120530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.983+0000 7fbe9dca7700 1 --2- 172.21.15.59:0/1685499583 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe981341d0 0x7fbe98120530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.983+0000 7fbe9dca7700 1 -- 172.21.15.59:0/1685499583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9809e560 msgr2=0x7fbe9811fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.983+0000 7fbe9dca7700 1 --2- 172.21.15.59:0/1685499583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9809e560 0x7fbe9811fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.983+0000 7fbe9dca7700 1 -- 172.21.15.59:0/1685499583 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe90009b30 con 0x7fbe981338c0 2023-09-30T22:33:55.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.983+0000 7fbe9dca7700 1 --2- 172.21.15.59:0/1685499583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe981338c0 0x7fbe9811fff0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800c580 tx=0x7fbe8800c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:55.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.983+0000 7fbe8effd700 1 -- 172.21.15.59:0/1685499583 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88015d70 con 0x7fbe981338c0 2023-09-30T22:33:55.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.983+0000 7fbea070c700 1 -- 172.21.15.59:0/1685499583 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe98122f60 con 0x7fbe981338c0 2023-09-30T22:33:55.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.983+0000 7fbea070c700 1 -- 172.21.15.59:0/1685499583 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe981304e0 con 0x7fbe981338c0 2023-09-30T22:33:55.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.983+0000 7fbe8effd700 1 -- 172.21.15.59:0/1685499583 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe88004870 con 0x7fbe981338c0 2023-09-30T22:33:55.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.983+0000 7fbe8effd700 1 -- 172.21.15.59:0/1685499583 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88004c00 con 0x7fbe981338c0 2023-09-30T22:33:55.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.984+0000 7fbe8effd700 1 -- 172.21.15.59:0/1685499583 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe8801c030 con 0x7fbe981338c0 2023-09-30T22:33:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.985+0000 7fbe8effd700 1 -- 172.21.15.59:0/1685499583 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbe880471f0 con 0x7fbe981338c0 2023-09-30T22:33:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.985+0000 7fbea070c700 1 -- 172.21.15.59:0/1685499583 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe800052e0 con 0x7fbe981338c0 2023-09-30T22:33:55.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:55.994+0000 7fbe8effd700 1 -- 172.21.15.59:0/1685499583 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe88024080 con 0x7fbe981338c0 2023-09-30T22:33:56.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.024+0000 7f912d94b700 1 Processor -- start 2023-09-30T22:33:56.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.024+0000 7f912d94b700 1 -- start start 2023-09-30T22:33:56.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.025+0000 7f912d94b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91280a0a30 0x7f91280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.025+0000 7f912d94b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f912809d630 0x7f91280a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.025+0000 7f912d94b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9128133930 0x7f9128133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.025+0000 7f912d94b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91280a2a70 con 0x7f912809d630 2023-09-30T22:33:56.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.025+0000 7f912d94b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91280a01d0 con 0x7f91280a0a30 2023-09-30T22:33:56.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.025+0000 7f912d94b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f912809e2b0 con 0x7f9128133930 2023-09-30T22:33:56.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.025+0000 7f91267fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f912809d630 0x7f91280a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.025+0000 7f91277fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9128133930 0x7f9128133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.025+0000 7f9126ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91280a0a30 0x7f91280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.025+0000 7f91267fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f912809d630 0x7f91280a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35696/0 (socket says 172.21.15.59:35696) 2023-09-30T22:33:56.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.025+0000 7f91267fc700 1 -- 172.21.15.59:0/811539559 learned_addr learned my addr 172.21.15.59:0/811539559 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:56.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.026+0000 7f9126ffd700 1 -- 172.21.15.59:0/811539559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9128133930 msgr2=0x7f9128133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:56.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.026+0000 7f9126ffd700 1 --2- 172.21.15.59:0/811539559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9128133930 0x7f9128133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.026+0000 7f9126ffd700 1 -- 172.21.15.59:0/811539559 >> v2:172.21.15.59:3300/0 conn(0x7f912809d630 msgr2=0x7f91280a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:56.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.026+0000 7f9126ffd700 1 --2- 172.21.15.59:0/811539559 >> v2:172.21.15.59:3300/0 conn(0x7f912809d630 0x7f91280a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.026+0000 7f9126ffd700 1 -- 172.21.15.59:0/811539559 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912809dc50 con 0x7f91280a0a30 2023-09-30T22:33:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.026+0000 7f91267fc700 1 --2- 172.21.15.59:0/811539559 >> v2:172.21.15.59:3300/0 conn(0x7f912809d630 0x7f91280a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.026+0000 7f9126ffd700 1 --2- 172.21.15.59:0/811539559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91280a0a30 0x7f91280a0e00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9118009840 tx=0x7f9118009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f2e1aa9fafa0af5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.026+0000 7f9125ffb700 1 -- 172.21.15.59:0/811539559 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118011830 con 0x7f91280a0a30 2023-09-30T22:33:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.026+0000 7f9125ffb700 1 -- 172.21.15.59:0/811539559 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9118011990 con 0x7f91280a0a30 2023-09-30T22:33:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.026+0000 7f9125ffb700 1 -- 172.21.15.59:0/811539559 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118011d20 con 0x7f91280a0a30 2023-09-30T22:33:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.027+0000 7f912d94b700 1 -- 172.21.15.59:0/811539559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91280a0a30 msgr2=0x7f91280a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.027+0000 7f912d94b700 1 --2- 172.21.15.59:0/811539559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91280a0a30 0x7f91280a0e00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9118009840 tx=0x7f9118009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.027+0000 7f912d94b700 1 -- 172.21.15.59:0/811539559 shutdown_connections 2023-09-30T22:33:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.027+0000 7f912d94b700 1 --2- 172.21.15.59:0/811539559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9128133930 0x7f9128133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.027+0000 7f912d94b700 1 --2- 172.21.15.59:0/811539559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91280a0a30 0x7f91280a0e00 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.027+0000 7f912d94b700 1 --2- 172.21.15.59:0/811539559 >> v2:172.21.15.59:3300/0 conn(0x7f912809d630 0x7f91280a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.027+0000 7f912d94b700 1 -- 172.21.15.59:0/811539559 >> 172.21.15.59:0/811539559 conn(0x7f91280a3050 msgr2=0x7f91280a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:56.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.027+0000 7f912d94b700 1 -- 172.21.15.59:0/811539559 shutdown_connections 2023-09-30T22:33:56.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.027+0000 7f912d94b700 1 -- 172.21.15.59:0/811539559 wait complete. 2023-09-30T22:33:56.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.028+0000 7f912d94b700 1 Processor -- start 2023-09-30T22:33:56.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.029+0000 7f912d94b700 1 -- start start 2023-09-30T22:33:56.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.029+0000 7f912d94b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f912809d630 0x7f9128121190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.029+0000 7f912d94b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91280a0a30 0x7f91281216d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.029+0000 7f912d94b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9128133930 0x7f9128121c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.029+0000 7f912d94b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9128124440 con 0x7f912809d630 2023-09-30T22:33:56.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.029+0000 7f912d94b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91281255e0 con 0x7f91280a0a30 2023-09-30T22:33:56.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.029+0000 7f912d94b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91280a0410 con 0x7f9128133930 2023-09-30T22:33:56.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.030+0000 7f9126ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f912809d630 0x7f9128121190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.030+0000 7f9126ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f912809d630 0x7f9128121190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35702/0 (socket says 172.21.15.59:35702) 2023-09-30T22:33:56.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.030+0000 7f9126ffd700 1 -- 172.21.15.59:0/2371283601 learned_addr learned my addr 172.21.15.59:0/2371283601 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:56.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.030+0000 7f91267fc700 1 --2- 172.21.15.59:0/2371283601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91280a0a30 0x7f91281216d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.030+0000 7f91277fe700 1 --2- 172.21.15.59:0/2371283601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9128133930 0x7f9128121c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.030+0000 7f9126ffd700 1 -- 172.21.15.59:0/2371283601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9128133930 msgr2=0x7f9128121c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.030+0000 7f9126ffd700 1 --2- 172.21.15.59:0/2371283601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9128133930 0x7f9128121c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.030+0000 7f9126ffd700 1 -- 172.21.15.59:0/2371283601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91280a0a30 msgr2=0x7f91281216d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.030+0000 7f9126ffd700 1 --2- 172.21.15.59:0/2371283601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91280a0a30 0x7f91281216d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.030+0000 7f9126ffd700 1 -- 172.21.15.59:0/2371283601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c009550 con 0x7f912809d630 2023-09-30T22:33:56.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.030+0000 7f91277fe700 1 --2- 172.21.15.59:0/2371283601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9128133930 0x7f9128121c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:56.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.030+0000 7f9126ffd700 1 --2- 172.21.15.59:0/2371283601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f912809d630 0x7f9128121190 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f91180090b0 tx=0x7f9118004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:56.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.030+0000 7f910ffff700 1 -- 172.21.15.59:0/2371283601 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118004300 con 0x7f912809d630 2023-09-30T22:33:56.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.031+0000 7f910ffff700 1 -- 172.21.15.59:0/2371283601 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911801f070 con 0x7f912809d630 2023-09-30T22:33:56.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.031+0000 7f912d94b700 1 -- 172.21.15.59:0/2371283601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91180094a0 con 0x7f912809d630 2023-09-30T22:33:56.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.031+0000 7f912d94b700 1 -- 172.21.15.59:0/2371283601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9128124940 con 0x7f912809d630 2023-09-30T22:33:56.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.031+0000 7f910ffff700 1 -- 172.21.15.59:0/2371283601 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91180036a0 con 0x7f912809d630 2023-09-30T22:33:56.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.032+0000 7f910ffff700 1 -- 172.21.15.59:0/2371283601 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9118021030 con 0x7f912809d630 2023-09-30T22:33:56.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.032+0000 7f910ffff700 1 -- 172.21.15.59:0/2371283601 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9118040700 con 0x7f912809d630 2023-09-30T22:33:56.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.032+0000 7f912d94b700 1 -- 172.21.15.59:0/2371283601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91080052e0 con 0x7f912809d630 2023-09-30T22:33:56.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.037+0000 7f910ffff700 1 -- 172.21.15.59:0/2371283601 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91180239c0 con 0x7f912809d630 2023-09-30T22:33:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.142+0000 7f275d069700 1 -- 172.21.15.59:0/1602451843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2758074ea0 con 0x7f275806ffd0 2023-09-30T22:33:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.143+0000 7f273f7fe700 1 -- 172.21.15.59:0/1602451843 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f274c021090 con 0x7f275806ffd0 2023-09-30T22:33:56.144 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.146+0000 7f275d069700 1 -- 172.21.15.59:0/1602451843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f275806ffd0 msgr2=0x7f275809c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.146+0000 7f275d069700 1 --2- 172.21.15.59:0/1602451843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f275806ffd0 0x7f275809c460 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f274c00e980 tx=0x7f274c00ec90 comp rx=0 tx=0).stop 2023-09-30T22:33:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.146+0000 7f275d069700 1 -- 172.21.15.59:0/1602451843 shutdown_connections 2023-09-30T22:33:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.146+0000 7f275d069700 1 --2- 172.21.15.59:0/1602451843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f275806f680 0x7f275809bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.146+0000 7f275d069700 1 --2- 172.21.15.59:0/1602451843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2758130670 0x7f275809c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.146+0000 7f275d069700 1 --2- 172.21.15.59:0/1602451843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f275806ffd0 0x7f275809c460 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.146+0000 7f275d069700 1 -- 172.21.15.59:0/1602451843 >> 172.21.15.59:0/1602451843 conn(0x7f27580a2aa0 msgr2=0x7f275812b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.146+0000 7f275d069700 1 -- 172.21.15.59:0/1602451843 shutdown_connections 2023-09-30T22:33:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.146+0000 7f275d069700 1 -- 172.21.15.59:0/1602451843 wait complete. 2023-09-30T22:33:56.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.170+0000 7f63f7147700 1 -- 172.21.15.59:0/3880208898 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f63f006b250 con 0x7f63f0134ec0 2023-09-30T22:33:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.170+0000 7f63ed7fa700 1 -- 172.21.15.59:0/3880208898 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63dc021ab0 con 0x7f63f0134ec0 2023-09-30T22:33:56.171 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.172+0000 7f63f7147700 1 -- 172.21.15.59:0/3880208898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63f0134ec0 msgr2=0x7f63f011abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.172+0000 7f63f7147700 1 --2- 172.21.15.59:0/3880208898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63f0134ec0 0x7f63f011abc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00b450 tx=0x7f63dc00b760 comp rx=0 tx=0).stop 2023-09-30T22:33:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.172+0000 7f63f7147700 1 -- 172.21.15.59:0/3880208898 shutdown_connections 2023-09-30T22:33:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.172+0000 7f63f7147700 1 --2- 172.21.15.59:0/3880208898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63f006c0e0 0x7f63f011a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.172+0000 7f63f7147700 1 --2- 172.21.15.59:0/3880208898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63f0137f20 0x7f63f011b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.172+0000 7f63f7147700 1 --2- 172.21.15.59:0/3880208898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63f0134ec0 0x7f63f011abc0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.172+0000 7f63f7147700 1 -- 172.21.15.59:0/3880208898 >> 172.21.15.59:0/3880208898 conn(0x7f63f00a4210 msgr2=0x7f63f00a0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.172+0000 7f63f7147700 1 -- 172.21.15.59:0/3880208898 shutdown_connections 2023-09-30T22:33:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.172+0000 7f63f7147700 1 -- 172.21.15.59:0/3880208898 wait complete. 2023-09-30T22:33:56.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:56.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.207+0000 7fbea070c700 1 -- 172.21.15.59:0/1685499583 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbe80005590 con 0x7fbe981338c0 2023-09-30T22:33:56.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.207+0000 7fbe8effd700 1 -- 172.21.15.59:0/1685499583 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe8801d380 con 0x7fbe981338c0 2023-09-30T22:33:56.208 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.209+0000 7fbea070c700 1 -- 172.21.15.59:0/1685499583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe981338c0 msgr2=0x7fbe9811fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.209+0000 7fbea070c700 1 --2- 172.21.15.59:0/1685499583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe981338c0 0x7fbe9811fff0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800c580 tx=0x7fbe8800c890 comp rx=0 tx=0).stop 2023-09-30T22:33:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.209+0000 7fbea070c700 1 -- 172.21.15.59:0/1685499583 shutdown_connections 2023-09-30T22:33:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.209+0000 7fbea070c700 1 --2- 172.21.15.59:0/1685499583 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe981341d0 0x7fbe98120530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.210+0000 7fbea070c700 1 --2- 172.21.15.59:0/1685499583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9809e560 0x7fbe9811fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.210+0000 7fbea070c700 1 --2- 172.21.15.59:0/1685499583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe981338c0 0x7fbe9811fff0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.210+0000 7fbea070c700 1 -- 172.21.15.59:0/1685499583 >> 172.21.15.59:0/1685499583 conn(0x7fbe980a2aa0 msgr2=0x7fbe9809fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.210+0000 7fbea070c700 1 -- 172.21.15.59:0/1685499583 shutdown_connections 2023-09-30T22:33:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.210+0000 7fbea070c700 1 -- 172.21.15.59:0/1685499583 wait complete. 2023-09-30T22:33:56.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:56.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.256+0000 7f912d94b700 1 -- 172.21.15.59:0/2371283601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9108005590 con 0x7f912809d630 2023-09-30T22:33:56.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.256+0000 7f910ffff700 1 -- 172.21.15.59:0/2371283601 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9118015020 con 0x7f912809d630 2023-09-30T22:33:56.257 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:56.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.258+0000 7f912d94b700 1 -- 172.21.15.59:0/2371283601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f912809d630 msgr2=0x7f9128121190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.259+0000 7f912d94b700 1 --2- 172.21.15.59:0/2371283601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f912809d630 0x7f9128121190 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f91180090b0 tx=0x7f9118004750 comp rx=0 tx=0).stop 2023-09-30T22:33:56.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.259+0000 7f912d94b700 1 -- 172.21.15.59:0/2371283601 shutdown_connections 2023-09-30T22:33:56.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.259+0000 7f912d94b700 1 --2- 172.21.15.59:0/2371283601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9128133930 0x7f9128121c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.259+0000 7f912d94b700 1 --2- 172.21.15.59:0/2371283601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f912809d630 0x7f9128121190 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.259+0000 7f912d94b700 1 --2- 172.21.15.59:0/2371283601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91280a0a30 0x7f91281216d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.259+0000 7f912d94b700 1 -- 172.21.15.59:0/2371283601 >> 172.21.15.59:0/2371283601 conn(0x7f91280a3050 msgr2=0x7f91281331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:56.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.259+0000 7f912d94b700 1 -- 172.21.15.59:0/2371283601 shutdown_connections 2023-09-30T22:33:56.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:56.259+0000 7f912d94b700 1 -- 172.21.15.59:0/2371283601 wait complete. 2023-09-30T22:33:56.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:57.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:57.188 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:57.225 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:57.274 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:57.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.329+0000 7fd5fb8c5700 1 Processor -- start 2023-09-30T22:33:57.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.329+0000 7fd5fb8c5700 1 -- start start 2023-09-30T22:33:57.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.330+0000 7fd5fb8c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f4134630 0x7fd5f4136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.330+0000 7fd5fb8c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd5f4136f50 0x7fd5f4139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.330+0000 7fd5fb8c5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f409b4f0 con 0x7fd5f4131810 2023-09-30T22:33:57.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.330+0000 7fd5fb8c5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f41313c0 con 0x7fd5f4136f50 2023-09-30T22:33:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.330+0000 7fd5fb8c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f406e8c0 con 0x7fd5f4134630 2023-09-30T22:33:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.330+0000 7fd5f9e62700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd5f4136f50 0x7fd5f4139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.330+0000 7fd5f9e62700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd5f4136f50 0x7fd5f4139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35706/0 (socket says 172.21.15.59:35706) 2023-09-30T22:33:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.330+0000 7fd5f9e62700 1 -- 172.21.15.59:0/3758591645 learned_addr learned my addr 172.21.15.59:0/3758591645 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:57.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.330+0000 7fd5f8e60700 1 --2- 172.21.15.59:0/3758591645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f4134630 0x7fd5f4136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.331+0000 7fd5f9e62700 1 -- 172.21.15.59:0/3758591645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f4134630 msgr2=0x7fd5f4136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:57.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.331+0000 7fd5f9e62700 1 --2- 172.21.15.59:0/3758591645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f4134630 0x7fd5f4136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.331+0000 7fd5f9e62700 1 -- 172.21.15.59:0/3758591645 >> v1:172.21.15.59:6789/0 conn(0x7fd5f4131810 legacy=0x7fd5f4131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.331+0000 7fd5ebfff700 1 -- 172.21.15.59:0/3758591645 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239611456 0 0) 0x7fd5f409b4f0 con 0x7fd5f4131810 2023-09-30T22:33:57.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.331+0000 7fd5f9e62700 1 -- 172.21.15.59:0/3758591645 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f4071d20 con 0x7fd5f4136f50 2023-09-30T22:33:57.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.331+0000 7fd5f8e60700 1 --2- 172.21.15.59:0/3758591645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f4134630 0x7fd5f4136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:57.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.331+0000 7fd5f9e62700 1 --2- 172.21.15.59:0/3758591645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f4136f50 0x7fd5f4139330 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009e50 tx=0x7fd5ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ea5cf37152f015 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:57.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.331+0000 7fd5ebfff700 1 -- 172.21.15.59:0/3758591645 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec00e070 con 0x7fd5f4136f50 2023-09-30T22:33:57.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.331+0000 7fd5ebfff700 1 -- 172.21.15.59:0/3758591645 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ec00b910 con 0x7fd5f4136f50 2023-09-30T22:33:57.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.331+0000 7fd5ebfff700 1 -- 172.21.15.59:0/3758591645 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec00bcc0 con 0x7fd5f4136f50 2023-09-30T22:33:57.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.332+0000 7fd5fb8c5700 1 -- 172.21.15.59:0/3758591645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f4136f50 msgr2=0x7fd5f4139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.332+0000 7fd5fb8c5700 1 --2- 172.21.15.59:0/3758591645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f4136f50 0x7fd5f4139330 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009e50 tx=0x7fd5ec00b330 comp rx=0 tx=0).stop 2023-09-30T22:33:57.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.332+0000 7fd5fb8c5700 1 -- 172.21.15.59:0/3758591645 shutdown_connections 2023-09-30T22:33:57.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.332+0000 7fd5fb8c5700 1 --2- 172.21.15.59:0/3758591645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f4136f50 0x7fd5f4139330 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.332+0000 7fd5fb8c5700 1 --2- 172.21.15.59:0/3758591645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f4134630 0x7fd5f4136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.332+0000 7fd5fb8c5700 1 -- 172.21.15.59:0/3758591645 >> 172.21.15.59:0/3758591645 conn(0x7fd5f40a2aa0 msgr2=0x7fd5f40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:57.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.333+0000 7fd5fb8c5700 1 -- 172.21.15.59:0/3758591645 shutdown_connections 2023-09-30T22:33:57.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.333+0000 7fd5fb8c5700 1 -- 172.21.15.59:0/3758591645 wait complete. 2023-09-30T22:33:57.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.334+0000 7fd5fb8c5700 1 Processor -- start 2023-09-30T22:33:57.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.334+0000 7fd5fb8c5700 1 -- start start 2023-09-30T22:33:57.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.335+0000 7fd5fb8c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5f4131810 0x7fd5f4118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.335+0000 7fd5fb8c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f4134630 0x7fd5f4119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.335+0000 7fd5fb8c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f4136f50 0x7fd5f4119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.335+0000 7fd5fb8c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f412e4c0 con 0x7fd5f4136f50 2023-09-30T22:33:57.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.335+0000 7fd5fb8c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f411a7a0 con 0x7fd5f4134630 2023-09-30T22:33:57.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.335+0000 7fd5fb8c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f411c3d0 con 0x7fd5f4131810 2023-09-30T22:33:57.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.335+0000 7fd5f9661700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5f4131810 0x7fd5f4118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.335+0000 7fd5f9661700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5f4131810 0x7fd5f4118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59702/0 (socket says 172.21.15.59:59702) 2023-09-30T22:33:57.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.335+0000 7fd5f9661700 1 -- 172.21.15.59:0/1354090864 learned_addr learned my addr 172.21.15.59:0/1354090864 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:57.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.335+0000 7fd5f9e62700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f4136f50 0x7fd5f4119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.335+0000 7fd5f8e60700 1 --2- 172.21.15.59:0/1354090864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f4134630 0x7fd5f4119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.336+0000 7fd5f8e60700 1 -- 172.21.15.59:0/1354090864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5f4131810 msgr2=0x7fd5f4118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.336+0000 7fd5f8e60700 1 --2- 172.21.15.59:0/1354090864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5f4131810 0x7fd5f4118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.336+0000 7fd5f8e60700 1 -- 172.21.15.59:0/1354090864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f4136f50 msgr2=0x7fd5f4119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.336+0000 7fd5f8e60700 1 --2- 172.21.15.59:0/1354090864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f4136f50 0x7fd5f4119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.336+0000 7fd5f8e60700 1 -- 172.21.15.59:0/1354090864 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e40094a0 con 0x7fd5f4134630 2023-09-30T22:33:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.336+0000 7fd5f9661700 1 --2- 172.21.15.59:0/1354090864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5f4131810 0x7fd5f4118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.336+0000 7fd5f8e60700 1 --2- 172.21.15.59:0/1354090864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f4134630 0x7fd5f4119210 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400e9b0 tx=0x7fd5e400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.336+0000 7fd5e9ffb700 1 -- 172.21.15.59:0/1354090864 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e400ee50 con 0x7fd5f4134630 2023-09-30T22:33:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.336+0000 7fd5e9ffb700 1 -- 172.21.15.59:0/1354090864 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e400c850 con 0x7fd5f4134630 2023-09-30T22:33:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.336+0000 7fd5fb8c5700 1 -- 172.21.15.59:0/1354090864 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ec009b30 con 0x7fd5f4134630 2023-09-30T22:33:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.336+0000 7fd5e9ffb700 1 -- 172.21.15.59:0/1354090864 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e400cc00 con 0x7fd5f4134630 2023-09-30T22:33:57.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.337+0000 7fd5fb8c5700 1 -- 172.21.15.59:0/1354090864 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f40a1e90 con 0x7fd5f4134630 2023-09-30T22:33:57.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.338+0000 7fd5fb8c5700 1 -- 172.21.15.59:0/1354090864 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f4074ea0 con 0x7fd5f4134630 2023-09-30T22:33:57.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.338+0000 7fd5e9ffb700 1 -- 172.21.15.59:0/1354090864 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5e4013470 con 0x7fd5f4134630 2023-09-30T22:33:57.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.339+0000 7fd5e9ffb700 1 -- 172.21.15.59:0/1354090864 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd5e403ffe0 con 0x7fd5f4134630 2023-09-30T22:33:57.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.343+0000 7fd5e9ffb700 1 -- 172.21.15.59:0/1354090864 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5e4013720 con 0x7fd5f4134630 2023-09-30T22:33:57.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.369+0000 7f0e5e8e3700 1 Processor -- start 2023-09-30T22:33:57.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.369+0000 7f0e5e8e3700 1 -- start start 2023-09-30T22:33:57.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.370+0000 7f0e5e8e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5809d6f0 0x7f0e5809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.370+0000 7f0e5e8e3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5809e000 0x7f0e58130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.370+0000 7f0e5e8e3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5809f130 con 0x7f0e5809e410 2023-09-30T22:33:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.370+0000 7f0e5e8e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5809f520 con 0x7f0e5809d6f0 2023-09-30T22:33:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.370+0000 7f0e5e8e3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5809e930 con 0x7f0e5809e000 2023-09-30T22:33:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.370+0000 7f0e57fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5809d6f0 0x7f0e5809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.370+0000 7f0e577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5809e000 0x7f0e58130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.370+0000 7f0e57fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5809d6f0 0x7f0e5809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49456/0 (socket says 172.21.15.59:49456) 2023-09-30T22:33:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.370+0000 7f0e577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5809e000 0x7f0e58130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59710/0 (socket says 172.21.15.59:59710) 2023-09-30T22:33:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.371+0000 7f0e57fff700 1 -- 172.21.15.59:0/920540756 learned_addr learned my addr 172.21.15.59:0/920540756 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.371+0000 7f0e57fff700 1 -- 172.21.15.59:0/920540756 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5809e000 msgr2=0x7f0e58130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.371+0000 7f0e57fff700 1 --2- 172.21.15.59:0/920540756 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5809e000 0x7f0e58130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.371+0000 7f0e57fff700 1 -- 172.21.15.59:0/920540756 >> v1:172.21.15.59:6789/0 conn(0x7f0e5809e410 legacy=0x7f0e58130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.371+0000 7f0e57fff700 1 -- 172.21.15.59:0/920540756 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5809b2d0 con 0x7f0e5809d6f0 2023-09-30T22:33:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.371+0000 7f0e577fe700 1 --2- 172.21.15.59:0/920540756 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5809e000 0x7f0e58130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.371+0000 7f0e57fff700 1 --2- 172.21.15.59:0/920540756 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5809d6f0 0x7f0e5809dac0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009920 tx=0x7f0e48009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37dac3401726ed17 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.371+0000 7f0e56ffd700 1 -- 172.21.15.59:0/920540756 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48011830 con 0x7f0e5809d6f0 2023-09-30T22:33:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.371+0000 7f0e56ffd700 1 -- 172.21.15.59:0/920540756 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e48011990 con 0x7f0e5809d6f0 2023-09-30T22:33:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.372+0000 7f0e56ffd700 1 -- 172.21.15.59:0/920540756 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48011d20 con 0x7f0e5809d6f0 2023-09-30T22:33:57.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.372+0000 7f0e5e8e3700 1 -- 172.21.15.59:0/920540756 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5809d6f0 msgr2=0x7f0e5809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.372+0000 7f0e5e8e3700 1 --2- 172.21.15.59:0/920540756 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5809d6f0 0x7f0e5809dac0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009920 tx=0x7f0e48009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:57.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.373+0000 7f0e5e8e3700 1 -- 172.21.15.59:0/920540756 shutdown_connections 2023-09-30T22:33:57.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.373+0000 7f0e5e8e3700 1 --2- 172.21.15.59:0/920540756 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5809d6f0 0x7f0e5809dac0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.373+0000 7f0e5e8e3700 1 --2- 172.21.15.59:0/920540756 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5809e000 0x7f0e58130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.373+0000 7f0e5e8e3700 1 -- 172.21.15.59:0/920540756 >> 172.21.15.59:0/920540756 conn(0x7f0e58066f50 msgr2=0x7f0e5809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:57.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.373+0000 7f0e5e8e3700 1 -- 172.21.15.59:0/920540756 shutdown_connections 2023-09-30T22:33:57.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.373+0000 7f0e5e8e3700 1 -- 172.21.15.59:0/920540756 wait complete. 2023-09-30T22:33:57.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.374+0000 7f0e5e8e3700 1 Processor -- start 2023-09-30T22:33:57.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.374+0000 7f0e5e8e3700 1 -- start start 2023-09-30T22:33:57.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.375+0000 7f0e5e8e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5809d6f0 0x7f0e5812de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.375+0000 7f0e5e8e3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5809e000 0x7f0e5812e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.375+0000 7f0e5e8e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5809e410 0x7f0e5812e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.375+0000 7f0e5e8e3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58136000 con 0x7f0e5809e410 2023-09-30T22:33:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.375+0000 7f0e5e8e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58131030 con 0x7f0e5809d6f0 2023-09-30T22:33:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.375+0000 7f0e5e8e3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58072550 con 0x7f0e5809e000 2023-09-30T22:33:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.375+0000 7f0e57fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5809d6f0 0x7f0e5812de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.375+0000 7f0e577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5809e000 0x7f0e5812e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.375+0000 7f0e57fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5809d6f0 0x7f0e5812de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49470/0 (socket says 172.21.15.59:49470) 2023-09-30T22:33:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.375+0000 7f0e57fff700 1 -- 172.21.15.59:0/42582073 learned_addr learned my addr 172.21.15.59:0/42582073 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.375+0000 7f0e577fe700 1 --2- 172.21.15.59:0/42582073 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5809e000 0x7f0e5812e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59718/0 (socket says 172.21.15.59:59718) 2023-09-30T22:33:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.376+0000 7f0e5ce80700 1 --2- 172.21.15.59:0/42582073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5809e410 0x7f0e5812e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.376+0000 7f0e5ce80700 1 -- 172.21.15.59:0/42582073 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5809e000 msgr2=0x7f0e5812e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.376+0000 7f0e5ce80700 1 --2- 172.21.15.59:0/42582073 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5809e000 0x7f0e5812e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.376+0000 7f0e5ce80700 1 -- 172.21.15.59:0/42582073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5809d6f0 msgr2=0x7f0e5812de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.376+0000 7f0e5ce80700 1 --2- 172.21.15.59:0/42582073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5809d6f0 0x7f0e5812de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.376+0000 7f0e5ce80700 1 -- 172.21.15.59:0/42582073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c0094a0 con 0x7f0e5809e410 2023-09-30T22:33:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.376+0000 7f0e57fff700 1 --2- 172.21.15.59:0/42582073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5809d6f0 0x7f0e5812de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.376+0000 7f0e5ce80700 1 --2- 172.21.15.59:0/42582073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5809e410 0x7f0e5812e8d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000cb90 tx=0x7f0e5000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.376+0000 7f0e54ff9700 1 -- 172.21.15.59:0/42582073 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50003c00 con 0x7f0e5809e410 2023-09-30T22:33:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.376+0000 7f0e54ff9700 1 -- 172.21.15.59:0/42582073 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50003d60 con 0x7f0e5809e410 2023-09-30T22:33:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.377+0000 7f0e5e8e3700 1 -- 172.21.15.59:0/42582073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e48009550 con 0x7f0e5809e410 2023-09-30T22:33:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.377+0000 7f0e54ff9700 1 -- 172.21.15.59:0/42582073 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000aa80 con 0x7f0e5809e410 2023-09-30T22:33:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.377+0000 7f0e5e8e3700 1 -- 172.21.15.59:0/42582073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5809c700 con 0x7f0e5809e410 2023-09-30T22:33:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.378+0000 7f0e5e8e3700 1 -- 172.21.15.59:0/42582073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e58135e30 con 0x7f0e5809e410 2023-09-30T22:33:57.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.378+0000 7f0e54ff9700 1 -- 172.21.15.59:0/42582073 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e5000abe0 con 0x7f0e5809e410 2023-09-30T22:33:57.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.379+0000 7f0e54ff9700 1 -- 172.21.15.59:0/42582073 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0e5003f610 con 0x7f0e5809e410 2023-09-30T22:33:57.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.383+0000 7f0e54ff9700 1 -- 172.21.15.59:0/42582073 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e500050d0 con 0x7f0e5809e410 2023-09-30T22:33:57.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.405+0000 7f26a079d700 1 Processor -- start 2023-09-30T22:33:57.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.405+0000 7f26a079d700 1 -- start start 2023-09-30T22:33:57.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.406+0000 7f26a079d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269809d6f0 0x7f269809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.406+0000 7f26a079d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269809e000 0x7f26981339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.406+0000 7f26a079d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269809b120 con 0x7f269809e410 2023-09-30T22:33:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.406+0000 7f26a079d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269806b460 con 0x7f269809e000 2023-09-30T22:33:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.406+0000 7f26a079d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f269809a7e0 con 0x7f269809d6f0 2023-09-30T22:33:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.406+0000 7f269e539700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269809d6f0 0x7f269809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.406+0000 7f269dd38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269809e000 0x7f26981339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.406+0000 7f269e539700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269809d6f0 0x7f269809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59724/0 (socket says 172.21.15.59:59724) 2023-09-30T22:33:57.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.406+0000 7f269e539700 1 -- 172.21.15.59:0/699994925 learned_addr learned my addr 172.21.15.59:0/699994925 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:57.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.406+0000 7f269dd38700 1 -- 172.21.15.59:0/699994925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269809d6f0 msgr2=0x7f269809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:57.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.406+0000 7f269dd38700 1 --2- 172.21.15.59:0/699994925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269809d6f0 0x7f269809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.406+0000 7f269dd38700 1 -- 172.21.15.59:0/699994925 >> v1:172.21.15.59:6789/0 conn(0x7f269809e410 legacy=0x7f2698133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.406+0000 7f269dd38700 1 -- 172.21.15.59:0/699994925 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269809a500 con 0x7f269809e000 2023-09-30T22:33:57.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.407+0000 7f269e539700 1 --2- 172.21.15.59:0/699994925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269809d6f0 0x7f269809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:57.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.407+0000 7f269dd38700 1 --2- 172.21.15.59:0/699994925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269809e000 0x7f26981339f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2688009870 tx=0x7f2688009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24ac9068e7c7e09f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:57.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.407+0000 7f269d537700 1 -- 172.21.15.59:0/699994925 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688011830 con 0x7f269809e000 2023-09-30T22:33:57.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.407+0000 7f269d537700 1 -- 172.21.15.59:0/699994925 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2688011990 con 0x7f269809e000 2023-09-30T22:33:57.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.407+0000 7f269d537700 1 -- 172.21.15.59:0/699994925 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688011d20 con 0x7f269809e000 2023-09-30T22:33:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.408+0000 7f26a079d700 1 -- 172.21.15.59:0/699994925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269809e000 msgr2=0x7f26981339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.408+0000 7f26a079d700 1 --2- 172.21.15.59:0/699994925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269809e000 0x7f26981339f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2688009870 tx=0x7f2688009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.408+0000 7f26a079d700 1 -- 172.21.15.59:0/699994925 shutdown_connections 2023-09-30T22:33:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.408+0000 7f26a079d700 1 --2- 172.21.15.59:0/699994925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269809d6f0 0x7f269809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.408+0000 7f26a079d700 1 --2- 172.21.15.59:0/699994925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269809e000 0x7f26981339f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.408+0000 7f26a079d700 1 -- 172.21.15.59:0/699994925 >> 172.21.15.59:0/699994925 conn(0x7f2698066f50 msgr2=0x7f269809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.408+0000 7f26a079d700 1 -- 172.21.15.59:0/699994925 shutdown_connections 2023-09-30T22:33:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.408+0000 7f26a079d700 1 -- 172.21.15.59:0/699994925 wait complete. 2023-09-30T22:33:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.409+0000 7f26a079d700 1 Processor -- start 2023-09-30T22:33:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.409+0000 7f26a079d700 1 -- start start 2023-09-30T22:33:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f26a079d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269809d6f0 0x7f2698122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f26a079d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269809e000 0x7f2698122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f26a079d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269809e410 0x7f2698122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f26a079d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2698126100 con 0x7f269809e000 2023-09-30T22:33:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f26a079d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2698124a20 con 0x7f269809d6f0 2023-09-30T22:33:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f26a079d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f269809c710 con 0x7f269809e410 2023-09-30T22:33:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f269dd38700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269809e000 0x7f2698122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f269ed3a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269809e410 0x7f2698122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f269dd38700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269809e000 0x7f2698122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35740/0 (socket says 172.21.15.59:35740) 2023-09-30T22:33:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f269dd38700 1 -- 172.21.15.59:0/2523962130 learned_addr learned my addr 172.21.15.59:0/2523962130 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f269dd38700 1 -- 172.21.15.59:0/2523962130 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269809e410 msgr2=0x7f2698122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f269dd38700 1 --2- 172.21.15.59:0/2523962130 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269809e410 0x7f2698122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f269dd38700 1 -- 172.21.15.59:0/2523962130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269809d6f0 msgr2=0x7f2698122540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:33:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f269dd38700 1 --2- 172.21.15.59:0/2523962130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269809d6f0 0x7f2698122540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f269dd38700 1 -- 172.21.15.59:0/2523962130 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2694009550 con 0x7f269809e000 2023-09-30T22:33:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f269ed3a700 1 --2- 172.21.15.59:0/2523962130 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269809e410 0x7f2698122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.410+0000 7f269dd38700 1 --2- 172.21.15.59:0/2523962130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269809e000 0x7f2698122a80 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f26880090b0 tx=0x7f2688004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.411+0000 7f268effd700 1 -- 172.21.15.59:0/2523962130 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688004590 con 0x7f269809e000 2023-09-30T22:33:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.411+0000 7f268effd700 1 -- 172.21.15.59:0/2523962130 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268801f070 con 0x7f269809e000 2023-09-30T22:33:57.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.411+0000 7f26a079d700 1 -- 172.21.15.59:0/2523962130 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26880094a0 con 0x7f269809e000 2023-09-30T22:33:57.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.411+0000 7f268effd700 1 -- 172.21.15.59:0/2523962130 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26880038c0 con 0x7f269809e000 2023-09-30T22:33:57.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.411+0000 7f26a079d700 1 -- 172.21.15.59:0/2523962130 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26981257f0 con 0x7f269809e000 2023-09-30T22:33:57.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.412+0000 7f268effd700 1 -- 172.21.15.59:0/2523962130 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2688003a20 con 0x7f269809e000 2023-09-30T22:33:57.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.412+0000 7f26a079d700 1 -- 172.21.15.59:0/2523962130 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2698074ea0 con 0x7f269809e000 2023-09-30T22:33:57.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.412+0000 7f268effd700 1 -- 172.21.15.59:0/2523962130 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2688021070 con 0x7f269809e000 2023-09-30T22:33:57.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.417+0000 7f268effd700 1 -- 172.21.15.59:0/2523962130 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2688010380 con 0x7f269809e000 2023-09-30T22:33:57.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.454+0000 7f1eae85c700 1 Processor -- start 2023-09-30T22:33:57.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.454+0000 7f1eae85c700 1 -- start start 2023-09-30T22:33:57.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.455+0000 7f1eae85c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea80a1510 0x7f1ea8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.455+0000 7f1eae85c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ea8139250 0x7f1ea813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.455+0000 7f1eae85c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea809edd0 con 0x7f1ea80a0a30 2023-09-30T22:33:57.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.455+0000 7f1eae85c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea80a18e0 con 0x7f1ea8139250 2023-09-30T22:33:57.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.455+0000 7f1eae85c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea809e1f0 con 0x7f1ea80a1510 2023-09-30T22:33:57.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.455+0000 7f1ea7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1ea80a0a30 0x7f1ea80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37086/0 (socket says 172.21.15.59:37086) 2023-09-30T22:33:57.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.455+0000 7f1ea7fff700 1 -- 172.21.15.59:0/3758161126 learned_addr learned my addr 172.21.15.59:0/3758161126 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:57.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.455+0000 7f1ea77fe700 1 --2- 172.21.15.59:0/3758161126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea80a1510 0x7f1ea8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.456+0000 7f1eacdf9700 1 --2- 172.21.15.59:0/3758161126 >> v2:172.21.15.59:3300/0 conn(0x7f1ea8139250 0x7f1ea813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.456+0000 7f1ea77fe700 1 -- 172.21.15.59:0/3758161126 >> v2:172.21.15.59:3300/0 conn(0x7f1ea8139250 msgr2=0x7f1ea813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:57.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.456+0000 7f1ea77fe700 1 --2- 172.21.15.59:0/3758161126 >> v2:172.21.15.59:3300/0 conn(0x7f1ea8139250 0x7f1ea813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.456+0000 7f1ea77fe700 1 -- 172.21.15.59:0/3758161126 >> v1:172.21.15.59:6789/0 conn(0x7f1ea80a0a30 legacy=0x7f1ea80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.456+0000 7f1ea77fe700 1 -- 172.21.15.59:0/3758161126 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea809dc50 con 0x7f1ea80a1510 2023-09-30T22:33:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.456+0000 7f1ea77fe700 1 --2- 172.21.15.59:0/3758161126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea80a1510 0x7f1ea8138d10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009870 tx=0x7f1e9c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6545d5ff82b34a7b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.456+0000 7f1ea6ffd700 1 -- 172.21.15.59:0/3758161126 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c011830 con 0x7f1ea80a1510 2023-09-30T22:33:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.456+0000 7f1ea6ffd700 1 -- 172.21.15.59:0/3758161126 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c011990 con 0x7f1ea80a1510 2023-09-30T22:33:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.456+0000 7f1ea6ffd700 1 -- 172.21.15.59:0/3758161126 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c011d20 con 0x7f1ea80a1510 2023-09-30T22:33:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.457+0000 7f1eae85c700 1 -- 172.21.15.59:0/3758161126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea80a1510 msgr2=0x7f1ea8138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.457+0000 7f1eae85c700 1 --2- 172.21.15.59:0/3758161126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea80a1510 0x7f1ea8138d10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009870 tx=0x7f1e9c009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.457+0000 7f1eae85c700 1 -- 172.21.15.59:0/3758161126 shutdown_connections 2023-09-30T22:33:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.457+0000 7f1eae85c700 1 --2- 172.21.15.59:0/3758161126 >> v2:172.21.15.59:3300/0 conn(0x7f1ea8139250 0x7f1ea813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.457+0000 7f1eae85c700 1 --2- 172.21.15.59:0/3758161126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea80a1510 0x7f1ea8138d10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.457+0000 7f1eae85c700 1 -- 172.21.15.59:0/3758161126 >> 172.21.15.59:0/3758161126 conn(0x7f1ea80a6550 msgr2=0x7f1ea80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.457+0000 7f1eae85c700 1 -- 172.21.15.59:0/3758161126 shutdown_connections 2023-09-30T22:33:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.458+0000 7f1eae85c700 1 -- 172.21.15.59:0/3758161126 wait complete. 2023-09-30T22:33:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.459+0000 7f1eae85c700 1 Processor -- start 2023-09-30T22:33:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.459+0000 7f1eae85c700 1 -- start start 2023-09-30T22:33:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.460+0000 7f1eae85c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea80a0a30 0x7f1ea81c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.460+0000 7f1eae85c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea80a1510 0x7f1ea81c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.460+0000 7f1eae85c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea8139250 0x7f1ea8122a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.460+0000 7f1eae85c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea8126740 con 0x7f1ea8139250 2023-09-30T22:33:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.460+0000 7f1eae85c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea81be3d0 con 0x7f1ea80a0a30 2023-09-30T22:33:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.460+0000 7f1eae85c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea81388d0 con 0x7f1ea80a1510 2023-09-30T22:33:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.460+0000 7f1ea7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea80a0a30 0x7f1ea81c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.460+0000 7f1ea7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea80a0a30 0x7f1ea81c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49498/0 (socket says 172.21.15.59:49498) 2023-09-30T22:33:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.460+0000 7f1ea7fff700 1 -- 172.21.15.59:0/392649372 learned_addr learned my addr 172.21.15.59:0/392649372 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.460+0000 7f1eacdf9700 1 --2- 172.21.15.59:0/392649372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea8139250 0x7f1ea8122a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.460+0000 7f1ea77fe700 1 --2- 172.21.15.59:0/392649372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea80a1510 0x7f1ea81c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.461+0000 7f1ea7fff700 1 -- 172.21.15.59:0/392649372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea80a1510 msgr2=0x7f1ea81c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.461+0000 7f1ea7fff700 1 --2- 172.21.15.59:0/392649372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea80a1510 0x7f1ea81c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.461+0000 7f1ea7fff700 1 -- 172.21.15.59:0/392649372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea8139250 msgr2=0x7f1ea8122a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.461+0000 7f1ea7fff700 1 --2- 172.21.15.59:0/392649372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea8139250 0x7f1ea8122a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.461+0000 7f1ea7fff700 1 -- 172.21.15.59:0/392649372 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c0094a0 con 0x7f1ea80a0a30 2023-09-30T22:33:57.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.461+0000 7f1ea7fff700 1 --2- 172.21.15.59:0/392649372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea80a0a30 0x7f1ea81c87e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c520 tx=0x7f1e9800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:57.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.461+0000 7f1ea4ff9700 1 -- 172.21.15.59:0/392649372 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98005d70 con 0x7f1ea80a0a30 2023-09-30T22:33:57.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.461+0000 7f1ea4ff9700 1 -- 172.21.15.59:0/392649372 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e980070d0 con 0x7f1ea80a0a30 2023-09-30T22:33:57.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.461+0000 7f1eae85c700 1 -- 172.21.15.59:0/392649372 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea8125f80 con 0x7f1ea80a0a30 2023-09-30T22:33:57.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.462+0000 7f1ea4ff9700 1 -- 172.21.15.59:0/392649372 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98007440 con 0x7f1ea80a0a30 2023-09-30T22:33:57.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.462+0000 7f1eae85c700 1 -- 172.21.15.59:0/392649372 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea81c9260 con 0x7f1ea80a0a30 2023-09-30T22:33:57.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.463+0000 7f1ea4ff9700 1 -- 172.21.15.59:0/392649372 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e980075a0 con 0x7f1ea80a0a30 2023-09-30T22:33:57.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.463+0000 7f1ea4ff9700 1 -- 172.21.15.59:0/392649372 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e9803ea10 con 0x7f1ea80a0a30 2023-09-30T22:33:57.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.464+0000 7f1e867fc700 1 -- 172.21.15.59:0/392649372 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea8074ea0 con 0x7f1ea80a0a30 2023-09-30T22:33:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.473+0000 7f1ea4ff9700 1 -- 172.21.15.59:0/392649372 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e98019b40 con 0x7f1ea80a0a30 2023-09-30T22:33:57.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.566+0000 7fd5fb8c5700 1 -- 172.21.15.59:0/1354090864 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd5f411af80 con 0x7fd5f4134630 2023-09-30T22:33:57.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.566+0000 7fd5e9ffb700 1 -- 172.21.15.59:0/1354090864 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd5e4017020 con 0x7fd5f4134630 2023-09-30T22:33:57.568 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:57.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.569+0000 7fd5fb8c5700 1 -- 172.21.15.59:0/1354090864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f4134630 msgr2=0x7fd5f4119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.569+0000 7fd5fb8c5700 1 --2- 172.21.15.59:0/1354090864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f4134630 0x7fd5f4119210 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400e9b0 tx=0x7fd5e400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.570+0000 7fd5fb8c5700 1 -- 172.21.15.59:0/1354090864 shutdown_connections 2023-09-30T22:33:57.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.570+0000 7fd5fb8c5700 1 --2- 172.21.15.59:0/1354090864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5f4131810 0x7fd5f4118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.570+0000 7fd5fb8c5700 1 --2- 172.21.15.59:0/1354090864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f4136f50 0x7fd5f4119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.570+0000 7fd5fb8c5700 1 --2- 172.21.15.59:0/1354090864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f4134630 0x7fd5f4119210 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.570+0000 7fd5fb8c5700 1 -- 172.21.15.59:0/1354090864 >> 172.21.15.59:0/1354090864 conn(0x7fd5f40a2aa0 msgr2=0x7fd5f40a0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:57.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.570+0000 7fd5fb8c5700 1 -- 172.21.15.59:0/1354090864 shutdown_connections 2023-09-30T22:33:57.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.570+0000 7fd5fb8c5700 1 -- 172.21.15.59:0/1354090864 wait complete. 2023-09-30T22:33:57.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:57.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.608+0000 7f0e5e8e3700 1 -- 172.21.15.59:0/42582073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0e58074ea0 con 0x7f0e5809e410 2023-09-30T22:33:57.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.609+0000 7f0e54ff9700 1 -- 172.21.15.59:0/42582073 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e50011380 con 0x7f0e5809e410 2023-09-30T22:33:57.610 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:57.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.611+0000 7f0e5e8e3700 1 -- 172.21.15.59:0/42582073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5809e410 msgr2=0x7f0e5812e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.611+0000 7f0e5e8e3700 1 --2- 172.21.15.59:0/42582073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5809e410 0x7f0e5812e8d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000cb90 tx=0x7f0e5000cea0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.611+0000 7f0e5e8e3700 1 -- 172.21.15.59:0/42582073 shutdown_connections 2023-09-30T22:33:57.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.611+0000 7f0e5e8e3700 1 --2- 172.21.15.59:0/42582073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5809e410 0x7f0e5812e8d0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.611+0000 7f0e5e8e3700 1 --2- 172.21.15.59:0/42582073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5809d6f0 0x7f0e5812de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.611+0000 7f0e5e8e3700 1 --2- 172.21.15.59:0/42582073 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5809e000 0x7f0e5812e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.611+0000 7f0e5e8e3700 1 -- 172.21.15.59:0/42582073 >> 172.21.15.59:0/42582073 conn(0x7f0e58066f50 msgr2=0x7f0e580a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:57.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.611+0000 7f0e5e8e3700 1 -- 172.21.15.59:0/42582073 shutdown_connections 2023-09-30T22:33:57.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.611+0000 7f0e5e8e3700 1 -- 172.21.15.59:0/42582073 wait complete. 2023-09-30T22:33:57.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:57.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.629+0000 7f26a079d700 1 -- 172.21.15.59:0/2523962130 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f269806c360 con 0x7f269809e000 2023-09-30T22:33:57.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.629+0000 7f268effd700 1 -- 172.21.15.59:0/2523962130 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2688015070 con 0x7f269809e000 2023-09-30T22:33:57.631 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.632+0000 7f26a079d700 1 -- 172.21.15.59:0/2523962130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269809e000 msgr2=0x7f2698122a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.632+0000 7f26a079d700 1 --2- 172.21.15.59:0/2523962130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269809e000 0x7f2698122a80 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f26880090b0 tx=0x7f2688004750 comp rx=0 tx=0).stop 2023-09-30T22:33:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.632+0000 7f26a079d700 1 -- 172.21.15.59:0/2523962130 shutdown_connections 2023-09-30T22:33:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.632+0000 7f26a079d700 1 --2- 172.21.15.59:0/2523962130 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269809e410 0x7f2698122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.632+0000 7f26a079d700 1 --2- 172.21.15.59:0/2523962130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269809d6f0 0x7f2698122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.632+0000 7f26a079d700 1 --2- 172.21.15.59:0/2523962130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269809e000 0x7f2698122a80 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.632+0000 7f26a079d700 1 -- 172.21.15.59:0/2523962130 >> 172.21.15.59:0/2523962130 conn(0x7f2698066f50 msgr2=0x7f2698071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:57.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.632+0000 7f26a079d700 1 -- 172.21.15.59:0/2523962130 shutdown_connections 2023-09-30T22:33:57.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.632+0000 7f26a079d700 1 -- 172.21.15.59:0/2523962130 wait complete. 2023-09-30T22:33:57.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:33:57.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.682+0000 7f1e867fc700 1 -- 172.21.15.59:0/392649372 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1ea80a28e0 con 0x7f1ea80a0a30 2023-09-30T22:33:57.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.682+0000 7f1ea4ff9700 1 -- 172.21.15.59:0/392649372 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e98017020 con 0x7f1ea80a0a30 2023-09-30T22:33:57.684 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:57.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.685+0000 7f1e867fc700 1 -- 172.21.15.59:0/392649372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea80a0a30 msgr2=0x7f1ea81c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.685+0000 7f1e867fc700 1 --2- 172.21.15.59:0/392649372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea80a0a30 0x7f1ea81c87e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c520 tx=0x7f1e9800c830 comp rx=0 tx=0).stop 2023-09-30T22:33:57.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.685+0000 7f1e867fc700 1 -- 172.21.15.59:0/392649372 shutdown_connections 2023-09-30T22:33:57.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.685+0000 7f1e867fc700 1 --2- 172.21.15.59:0/392649372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea8139250 0x7f1ea8122a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.685+0000 7f1e867fc700 1 --2- 172.21.15.59:0/392649372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea80a0a30 0x7f1ea81c87e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.685+0000 7f1e867fc700 1 --2- 172.21.15.59:0/392649372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea80a1510 0x7f1ea81c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.685+0000 7f1e867fc700 1 -- 172.21.15.59:0/392649372 >> 172.21.15.59:0/392649372 conn(0x7f1ea80a6550 msgr2=0x7f1ea80a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:57.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.685+0000 7f1e867fc700 1 -- 172.21.15.59:0/392649372 shutdown_connections 2023-09-30T22:33:57.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:57.685+0000 7f1e867fc700 1 -- 172.21.15.59:0/392649372 wait complete. 2023-09-30T22:33:57.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:58.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:33:58.628 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:33:58.648 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:33:58.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:33:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.741+0000 7f94e6a9b700 1 Processor -- start 2023-09-30T22:33:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.741+0000 7f94e6a9b700 1 -- start start 2023-09-30T22:33:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.742+0000 7f94e6a9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e012cf60 0x7f94e006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.742+0000 7f94e6a9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94e0130430 0x7f94e0137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.742+0000 7f94e6a9b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e012cd90 con 0x7f94e012f8b0 2023-09-30T22:33:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.742+0000 7f94e6a9b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e012d330 con 0x7f94e0130430 2023-09-30T22:33:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.742+0000 7f94e6a9b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0071780 con 0x7f94e012cf60 2023-09-30T22:33:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.742+0000 7f94e5038700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94e0130430 0x7f94e0137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.742+0000 7f94e5038700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94e0130430 0x7f94e0137c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35768/0 (socket says 172.21.15.59:35768) 2023-09-30T22:33:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.742+0000 7f94e5038700 1 -- 172.21.15.59:0/3652818337 learned_addr learned my addr 172.21.15.59:0/3652818337 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.743+0000 7f94e4837700 1 --2- 172.21.15.59:0/3652818337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e012cf60 0x7f94e006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.743+0000 7f94e5038700 1 -- 172.21.15.59:0/3652818337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e012cf60 msgr2=0x7f94e006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.743+0000 7f94e5038700 1 --2- 172.21.15.59:0/3652818337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e012cf60 0x7f94e006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.743+0000 7f94e5038700 1 -- 172.21.15.59:0/3652818337 >> v1:172.21.15.59:6789/0 conn(0x7f94e012f8b0 legacy=0x7f94e012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.743+0000 7f94e5038700 1 -- 172.21.15.59:0/3652818337 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e0071a40 con 0x7f94e0130430 2023-09-30T22:33:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.743+0000 7f94e5038700 1 --2- 172.21.15.59:0/3652818337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e0130430 0x7f94e0137c30 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009e50 tx=0x7f94d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02a25ce7d8a5b15 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.743+0000 7f94df7fe700 1 -- 172.21.15.59:0/3652818337 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d800e070 con 0x7f94e0130430 2023-09-30T22:33:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.743+0000 7f94df7fe700 1 -- 172.21.15.59:0/3652818337 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d800b910 con 0x7f94e0130430 2023-09-30T22:33:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.743+0000 7f94df7fe700 1 -- 172.21.15.59:0/3652818337 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d800bcc0 con 0x7f94e0130430 2023-09-30T22:33:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.744+0000 7f94e6a9b700 1 -- 172.21.15.59:0/3652818337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e0130430 msgr2=0x7f94e0137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.744+0000 7f94e6a9b700 1 --2- 172.21.15.59:0/3652818337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e0130430 0x7f94e0137c30 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009e50 tx=0x7f94d800b330 comp rx=0 tx=0).stop 2023-09-30T22:33:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.744+0000 7f94e6a9b700 1 -- 172.21.15.59:0/3652818337 shutdown_connections 2023-09-30T22:33:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.744+0000 7f94e6a9b700 1 --2- 172.21.15.59:0/3652818337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e0130430 0x7f94e0137c30 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.745+0000 7f94e6a9b700 1 --2- 172.21.15.59:0/3652818337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e012cf60 0x7f94e006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.745+0000 7f94e6a9b700 1 -- 172.21.15.59:0/3652818337 >> 172.21.15.59:0/3652818337 conn(0x7f94e00a2aa0 msgr2=0x7f94e00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.745+0000 7f94e6a9b700 1 -- 172.21.15.59:0/3652818337 shutdown_connections 2023-09-30T22:33:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.745+0000 7f94e6a9b700 1 -- 172.21.15.59:0/3652818337 wait complete. 2023-09-30T22:33:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.746+0000 7f94e6a9b700 1 Processor -- start 2023-09-30T22:33:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.747+0000 7f94e6a9b700 1 -- start start 2023-09-30T22:33:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.748+0000 7f94e6a9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e012cf60 0x7f94e01c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.748+0000 7f94e6a9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e012f8b0 0x7f94e01c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.748+0000 7f94e6a9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e0130430 0x7f94e01c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.748+0000 7f94e6a9b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0134170 con 0x7f94e012f8b0 2023-09-30T22:33:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.748+0000 7f94e6a9b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e012f570 con 0x7f94e012cf60 2023-09-30T22:33:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.748+0000 7f94e6a9b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0129fa0 con 0x7f94e0130430 2023-09-30T22:33:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.748+0000 7f94dffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e012f8b0 0x7f94e01c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.748+0000 7f94e5038700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e0130430 0x7f94e01c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.748+0000 7f94dffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e012f8b0 0x7f94e01c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35780/0 (socket says 172.21.15.59:35780) 2023-09-30T22:33:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.748+0000 7f94dffff700 1 -- 172.21.15.59:0/3098031844 learned_addr learned my addr 172.21.15.59:0/3098031844 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.748+0000 7f94e4837700 1 --2- 172.21.15.59:0/3098031844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e012cf60 0x7f94e01c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.749+0000 7f94e5038700 1 -- 172.21.15.59:0/3098031844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e012cf60 msgr2=0x7f94e01c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.749+0000 7f94e5038700 1 --2- 172.21.15.59:0/3098031844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e012cf60 0x7f94e01c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.749+0000 7f94e5038700 1 -- 172.21.15.59:0/3098031844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e012f8b0 msgr2=0x7f94e01c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.749+0000 7f94e5038700 1 --2- 172.21.15.59:0/3098031844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e012f8b0 0x7f94e01c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.749+0000 7f94e5038700 1 -- 172.21.15.59:0/3098031844 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d8009b30 con 0x7f94e0130430 2023-09-30T22:33:58.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.749+0000 7f94e5038700 1 --2- 172.21.15.59:0/3098031844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e0130430 0x7f94e01c9150 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f94e006dc90 tx=0x7f94d8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:58.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.750+0000 7f94dd7fa700 1 -- 172.21.15.59:0/3098031844 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8004800 con 0x7f94e0130430 2023-09-30T22:33:58.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.750+0000 7f94dd7fa700 1 -- 172.21.15.59:0/3098031844 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d80092e0 con 0x7f94e0130430 2023-09-30T22:33:58.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.750+0000 7f94dd7fa700 1 -- 172.21.15.59:0/3098031844 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d801c680 con 0x7f94e0130430 2023-09-30T22:33:58.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.750+0000 7f94e6a9b700 1 -- 172.21.15.59:0/3098031844 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e013b720 con 0x7f94e0130430 2023-09-30T22:33:58.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.750+0000 7f94e6a9b700 1 -- 172.21.15.59:0/3098031844 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e009ec30 con 0x7f94e0130430 2023-09-30T22:33:58.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.751+0000 7f94e6a9b700 1 -- 172.21.15.59:0/3098031844 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e0074ea0 con 0x7f94e0130430 2023-09-30T22:33:58.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.751+0000 7f94dd7fa700 1 -- 172.21.15.59:0/3098031844 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f94d801c7e0 con 0x7f94e0130430 2023-09-30T22:33:58.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.752+0000 7f94dd7fa700 1 -- 172.21.15.59:0/3098031844 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f94d8040dd0 con 0x7f94e0130430 2023-09-30T22:33:58.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.761+0000 7f94dd7fa700 1 -- 172.21.15.59:0/3098031844 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94d80249a0 con 0x7f94e0130430 2023-09-30T22:33:58.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.792+0000 7f0c9734d700 1 Processor -- start 2023-09-30T22:33:58.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.792+0000 7f0c9734d700 1 -- start start 2023-09-30T22:33:58.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.792+0000 7f0c9734d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c90131810 0x7f0c90131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.792+0000 7f0c9734d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c90099a40 0x7f0c90099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.792+0000 7f0c9734d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9009a3b0 0x7f0c90138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.793+0000 7f0c9734d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c901313c0 con 0x7f0c90131810 2023-09-30T22:33:58.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.793+0000 7f0c9734d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9006e8c0 con 0x7f0c9009a3b0 2023-09-30T22:33:58.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.793+0000 7f0c9734d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c90071d20 con 0x7f0c90099a40 2023-09-30T22:33:58.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.793+0000 7f0c958ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9009a3b0 0x7f0c90138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.793+0000 7f0c948e8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c90099a40 0x7f0c90099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.793+0000 7f0c958ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9009a3b0 0x7f0c90138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49516/0 (socket says 172.21.15.59:49516) 2023-09-30T22:33:58.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.793+0000 7f0c958ea700 1 -- 172.21.15.59:0/3862456974 learned_addr learned my addr 172.21.15.59:0/3862456974 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:58.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.793+0000 7f0c950e9700 1 --2- 172.21.15.59:0/3862456974 >> v2:172.21.15.59:3300/0 conn(0x7f0c90131810 0x7f0c90131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.793+0000 7f0c948e8700 1 -- 172.21.15.59:0/3862456974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9009a3b0 msgr2=0x7f0c90138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:58.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.793+0000 7f0c948e8700 1 --2- 172.21.15.59:0/3862456974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9009a3b0 0x7f0c90138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.793+0000 7f0c948e8700 1 -- 172.21.15.59:0/3862456974 >> v2:172.21.15.59:3300/0 conn(0x7f0c90131810 msgr2=0x7f0c90131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:58.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.793+0000 7f0c948e8700 1 --2- 172.21.15.59:0/3862456974 >> v2:172.21.15.59:3300/0 conn(0x7f0c90131810 0x7f0c90131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.793+0000 7f0c948e8700 1 -- 172.21.15.59:0/3862456974 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900721a0 con 0x7f0c90099a40 2023-09-30T22:33:58.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.793+0000 7f0c950e9700 1 --2- 172.21.15.59:0/3862456974 >> v2:172.21.15.59:3300/0 conn(0x7f0c90131810 0x7f0c90131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:58.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.794+0000 7f0c948e8700 1 --2- 172.21.15.59:0/3862456974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c90099a40 0x7f0c90099e70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0c80009840 tx=0x7f0c80009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e5377e83a7d65f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:58.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.794+0000 7f0c87fff700 1 -- 172.21.15.59:0/3862456974 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c80011830 con 0x7f0c90099a40 2023-09-30T22:33:58.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.794+0000 7f0c87fff700 1 -- 172.21.15.59:0/3862456974 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c80011990 con 0x7f0c90099a40 2023-09-30T22:33:58.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.794+0000 7f0c87fff700 1 -- 172.21.15.59:0/3862456974 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c80011d20 con 0x7f0c90099a40 2023-09-30T22:33:58.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.794+0000 7f0c9734d700 1 -- 172.21.15.59:0/3862456974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c90099a40 msgr2=0x7f0c90099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.794+0000 7f0c9734d700 1 --2- 172.21.15.59:0/3862456974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c90099a40 0x7f0c90099e70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0c80009840 tx=0x7f0c80009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:58.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.795+0000 7f0c9734d700 1 -- 172.21.15.59:0/3862456974 shutdown_connections 2023-09-30T22:33:58.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.795+0000 7f0c9734d700 1 --2- 172.21.15.59:0/3862456974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9009a3b0 0x7f0c90138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.795+0000 7f0c9734d700 1 --2- 172.21.15.59:0/3862456974 >> v2:172.21.15.59:3300/0 conn(0x7f0c90131810 0x7f0c90131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.795+0000 7f0c9734d700 1 --2- 172.21.15.59:0/3862456974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c90099a40 0x7f0c90099e70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.795+0000 7f0c9734d700 1 -- 172.21.15.59:0/3862456974 >> 172.21.15.59:0/3862456974 conn(0x7f0c900a2aa0 msgr2=0x7f0c900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:58.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.795+0000 7f0c9734d700 1 -- 172.21.15.59:0/3862456974 shutdown_connections 2023-09-30T22:33:58.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.795+0000 7f0c9734d700 1 -- 172.21.15.59:0/3862456974 wait complete. 2023-09-30T22:33:58.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.796+0000 7f0c9734d700 1 Processor -- start 2023-09-30T22:33:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.796+0000 7f0c9734d700 1 -- start start 2023-09-30T22:33:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.796+0000 7f0c9734d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c90099a40 0x7f0c9011d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.796+0000 7f0c9734d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9009a3b0 0x7f0c9011bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.796+0000 7f0c9734d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c90131810 0x7f0c9011c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.796+0000 7f0c9734d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9011a8f0 con 0x7f0c9009a3b0 2023-09-30T22:33:58.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.796+0000 7f0c9734d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9012cb50 con 0x7f0c90131810 2023-09-30T22:33:58.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.796+0000 7f0c9734d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9011b180 con 0x7f0c90099a40 2023-09-30T22:33:58.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.797+0000 7f0c950e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c90099a40 0x7f0c9011d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.797+0000 7f0c950e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c90099a40 0x7f0c9011d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59808/0 (socket says 172.21.15.59:59808) 2023-09-30T22:33:58.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.797+0000 7f0c950e9700 1 -- 172.21.15.59:0/4277926014 learned_addr learned my addr 172.21.15.59:0/4277926014 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:58.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.797+0000 7f0c948e8700 1 --2- 172.21.15.59:0/4277926014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9009a3b0 0x7f0c9011bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.797+0000 7f0c958ea700 1 --2- 172.21.15.59:0/4277926014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c90131810 0x7f0c9011c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.797+0000 7f0c948e8700 1 -- 172.21.15.59:0/4277926014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c90099a40 msgr2=0x7f0c9011d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.797+0000 7f0c948e8700 1 --2- 172.21.15.59:0/4277926014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c90099a40 0x7f0c9011d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.797+0000 7f0c948e8700 1 -- 172.21.15.59:0/4277926014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c90131810 msgr2=0x7f0c9011c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.797+0000 7f0c948e8700 1 --2- 172.21.15.59:0/4277926014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c90131810 0x7f0c9011c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.797+0000 7f0c948e8700 1 -- 172.21.15.59:0/4277926014 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c0094a0 con 0x7f0c9009a3b0 2023-09-30T22:33:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.797+0000 7f0c958ea700 1 --2- 172.21.15.59:0/4277926014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c90131810 0x7f0c9011c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.797+0000 7f0c948e8700 1 --2- 172.21.15.59:0/4277926014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9009a3b0 0x7f0c9011bd60 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0c9006dd30 tx=0x7f0c80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:58.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.797+0000 7f0c85ffb700 1 -- 172.21.15.59:0/4277926014 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c80004450 con 0x7f0c9009a3b0 2023-09-30T22:33:58.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.798+0000 7f0c9734d700 1 -- 172.21.15.59:0/4277926014 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c800094a0 con 0x7f0c9009a3b0 2023-09-30T22:33:58.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.798+0000 7f0c85ffb700 1 -- 172.21.15.59:0/4277926014 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8001f070 con 0x7f0c9009a3b0 2023-09-30T22:33:58.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.798+0000 7f0c85ffb700 1 -- 172.21.15.59:0/4277926014 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c800038e0 con 0x7f0c9009a3b0 2023-09-30T22:33:58.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.798+0000 7f0c9734d700 1 -- 172.21.15.59:0/4277926014 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9011abe0 con 0x7f0c9009a3b0 2023-09-30T22:33:58.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.799+0000 7f0c85ffb700 1 -- 172.21.15.59:0/4277926014 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c80003a40 con 0x7f0c9009a3b0 2023-09-30T22:33:58.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.799+0000 7f0c9734d700 1 -- 172.21.15.59:0/4277926014 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c90074ea0 con 0x7f0c9009a3b0 2023-09-30T22:33:58.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.799+0000 7f0c85ffb700 1 -- 172.21.15.59:0/4277926014 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0c80021070 con 0x7f0c9009a3b0 2023-09-30T22:33:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.809+0000 7f0c85ffb700 1 -- 172.21.15.59:0/4277926014 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c80015070 con 0x7f0c9009a3b0 2023-09-30T22:33:58.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.837+0000 7f61697f8700 1 Processor -- start 2023-09-30T22:33:58.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.837+0000 7f61697f8700 1 -- start start 2023-09-30T22:33:58.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.838+0000 7f61697f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61640a0a30 0x7f61640a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.838+0000 7f61697f8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6164134170 0x7f616413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.838+0000 7f61697f8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616409edd0 con 0x7f61640a1340 2023-09-30T22:33:58.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.838+0000 7f61697f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616409e1f0 con 0x7f61640a0a30 2023-09-30T22:33:58.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.838+0000 7f61697f8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f616409dc50 con 0x7f6164134170 2023-09-30T22:33:58.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.838+0000 7f61627fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f61640a1340 0x7f6164133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37100/0 (socket says 172.21.15.59:37100) 2023-09-30T22:33:58.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.838+0000 7f6162ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61640a0a30 0x7f61640a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.838+0000 7f61627fc700 1 -- 172.21.15.59:0/1181752453 learned_addr learned my addr 172.21.15.59:0/1181752453 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:58.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.838+0000 7f61637fe700 1 --2- 172.21.15.59:0/1181752453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6164134170 0x7f616413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.839+0000 7f6162ffd700 1 -- 172.21.15.59:0/1181752453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6164134170 msgr2=0x7f616413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:58.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.839+0000 7f6162ffd700 1 --2- 172.21.15.59:0/1181752453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6164134170 0x7f616413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.839+0000 7f6162ffd700 1 -- 172.21.15.59:0/1181752453 >> v1:172.21.15.59:6789/0 conn(0x7f61640a1340 legacy=0x7f6164133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.839+0000 7f6162ffd700 1 -- 172.21.15.59:0/1181752453 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61640a1fe0 con 0x7f61640a0a30 2023-09-30T22:33:58.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.839+0000 7f6162ffd700 1 --2- 172.21.15.59:0/1181752453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61640a0a30 0x7f61640a0e00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6154009870 tx=0x7f6154009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91c43083078b6fee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:58.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.839+0000 7f6161ffb700 1 -- 172.21.15.59:0/1181752453 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154011830 con 0x7f61640a0a30 2023-09-30T22:33:58.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.839+0000 7f6161ffb700 1 -- 172.21.15.59:0/1181752453 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6154011990 con 0x7f61640a0a30 2023-09-30T22:33:58.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.839+0000 7f6161ffb700 1 -- 172.21.15.59:0/1181752453 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154011d20 con 0x7f61640a0a30 2023-09-30T22:33:58.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.840+0000 7f61697f8700 1 -- 172.21.15.59:0/1181752453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61640a0a30 msgr2=0x7f61640a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.840+0000 7f61697f8700 1 --2- 172.21.15.59:0/1181752453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61640a0a30 0x7f61640a0e00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6154009870 tx=0x7f6154009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:58.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.840+0000 7f61697f8700 1 -- 172.21.15.59:0/1181752453 shutdown_connections 2023-09-30T22:33:58.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.840+0000 7f61697f8700 1 --2- 172.21.15.59:0/1181752453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6164134170 0x7f616413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.840+0000 7f61697f8700 1 --2- 172.21.15.59:0/1181752453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61640a0a30 0x7f61640a0e00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.840+0000 7f61697f8700 1 -- 172.21.15.59:0/1181752453 >> 172.21.15.59:0/1181752453 conn(0x7f61640a6550 msgr2=0x7f61640a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:58.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.840+0000 7f61697f8700 1 -- 172.21.15.59:0/1181752453 shutdown_connections 2023-09-30T22:33:58.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.840+0000 7f61697f8700 1 -- 172.21.15.59:0/1181752453 wait complete. 2023-09-30T22:33:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.842+0000 7f61697f8700 1 Processor -- start 2023-09-30T22:33:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.842+0000 7f61697f8700 1 -- start start 2023-09-30T22:33:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.843+0000 7f61697f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61640a0a30 0x7f61641231c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.843+0000 7f61697f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61640a1340 0x7f6164123700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.843+0000 7f61697f8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6164134170 0x7f61641c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.843+0000 7f61697f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6164126410 con 0x7f61640a1340 2023-09-30T22:33:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.843+0000 7f61697f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61641251e0 con 0x7f61640a0a30 2023-09-30T22:33:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.843+0000 7f61697f8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f616409bf20 con 0x7f6164134170 2023-09-30T22:33:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.843+0000 7f6162ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61640a0a30 0x7f61641231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.843+0000 7f6162ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61640a0a30 0x7f61641231c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49560/0 (socket says 172.21.15.59:49560) 2023-09-30T22:33:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.843+0000 7f6162ffd700 1 -- 172.21.15.59:0/3157238894 learned_addr learned my addr 172.21.15.59:0/3157238894 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.843+0000 7f61637fe700 1 --2- 172.21.15.59:0/3157238894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6164134170 0x7f61641c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.843+0000 7f61627fc700 1 --2- 172.21.15.59:0/3157238894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61640a1340 0x7f6164123700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.844+0000 7f6162ffd700 1 -- 172.21.15.59:0/3157238894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6164134170 msgr2=0x7f61641c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.844+0000 7f6162ffd700 1 --2- 172.21.15.59:0/3157238894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6164134170 0x7f61641c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.844+0000 7f6162ffd700 1 -- 172.21.15.59:0/3157238894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61640a1340 msgr2=0x7f6164123700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.844+0000 7f6162ffd700 1 --2- 172.21.15.59:0/3157238894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61640a1340 0x7f6164123700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.844+0000 7f6162ffd700 1 -- 172.21.15.59:0/3157238894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61540094a0 con 0x7f61640a0a30 2023-09-30T22:33:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.844+0000 7f61627fc700 1 --2- 172.21.15.59:0/3157238894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61640a1340 0x7f6164123700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.844+0000 7f6162ffd700 1 --2- 172.21.15.59:0/3157238894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61640a0a30 0x7f61641231c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f61540090b0 tx=0x7f6154004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.844+0000 7f614b7fe700 1 -- 172.21.15.59:0/3157238894 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154004450 con 0x7f61640a0a30 2023-09-30T22:33:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.844+0000 7f614b7fe700 1 -- 172.21.15.59:0/3157238894 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615401f070 con 0x7f61640a0a30 2023-09-30T22:33:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.844+0000 7f61697f8700 1 -- 172.21.15.59:0/3157238894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61640a25e0 con 0x7f61640a0a30 2023-09-30T22:33:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.844+0000 7f614b7fe700 1 -- 172.21.15.59:0/3157238894 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61540038e0 con 0x7f61640a0a30 2023-09-30T22:33:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.845+0000 7f61697f8700 1 -- 172.21.15.59:0/3157238894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6164122d40 con 0x7f61640a0a30 2023-09-30T22:33:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.846+0000 7f614b7fe700 1 -- 172.21.15.59:0/3157238894 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6154003a40 con 0x7f61640a0a30 2023-09-30T22:33:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.846+0000 7f614b7fe700 1 -- 172.21.15.59:0/3157238894 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6154021070 con 0x7f61640a0a30 2023-09-30T22:33:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.846+0000 7f61697f8700 1 -- 172.21.15.59:0/3157238894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6164074ea0 con 0x7f61640a0a30 2023-09-30T22:33:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.851+0000 7f614b7fe700 1 -- 172.21.15.59:0/3157238894 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6154015020 con 0x7f61640a0a30 2023-09-30T22:33:58.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.867+0000 7fa0fc092700 1 Processor -- start 2023-09-30T22:33:58.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.868+0000 7fa0fc092700 1 -- start start 2023-09-30T22:33:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.869+0000 7fa0fc092700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa0f409d630 0x7fa0f40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.869+0000 7fa0fc092700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0f4138d80 0x7fa0f413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.869+0000 7fa0fc092700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f40a2a70 con 0x7fa0f40a0a30 2023-09-30T22:33:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.869+0000 7fa0fc092700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f40a01d0 con 0x7fa0f409d630 2023-09-30T22:33:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.869+0000 7fa0fc092700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f409e2b0 con 0x7fa0f4138d80 2023-09-30T22:33:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.869+0000 7fa0f9e2e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa0f40a0a30 0x7fa0f40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37112/0 (socket says 172.21.15.59:37112) 2023-09-30T22:33:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.869+0000 7fa0f9e2e700 1 -- 172.21.15.59:0/2623376108 learned_addr learned my addr 172.21.15.59:0/2623376108 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:33:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.869+0000 7fa0fa62f700 1 --2- 172.21.15.59:0/2623376108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0f4138d80 0x7fa0f413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.869+0000 7fa0f962d700 1 --2- 172.21.15.59:0/2623376108 >> v2:172.21.15.59:3300/0 conn(0x7fa0f409d630 0x7fa0f40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.869+0000 7fa0f962d700 1 -- 172.21.15.59:0/2623376108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0f4138d80 msgr2=0x7fa0f413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.869+0000 7fa0f962d700 1 --2- 172.21.15.59:0/2623376108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0f4138d80 0x7fa0f413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.869+0000 7fa0f962d700 1 -- 172.21.15.59:0/2623376108 >> v1:172.21.15.59:6789/0 conn(0x7fa0f40a0a30 legacy=0x7fa0f40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.869+0000 7fa0f962d700 1 -- 172.21.15.59:0/2623376108 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f409dc50 con 0x7fa0f409d630 2023-09-30T22:33:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.869+0000 7fa0fa62f700 1 --2- 172.21.15.59:0/2623376108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0f4138d80 0x7fa0f413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.870+0000 7fa0f962d700 1 --2- 172.21.15.59:0/2623376108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0f409d630 0x7fa0f40a1510 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009840 tx=0x7fa0e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10e7dc71890f9ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.870+0000 7fa0f8e2c700 1 -- 172.21.15.59:0/2623376108 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4004230 con 0x7fa0f409d630 2023-09-30T22:33:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.870+0000 7fa0f8e2c700 1 -- 172.21.15.59:0/2623376108 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e4004390 con 0x7fa0f409d630 2023-09-30T22:33:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.870+0000 7fa0f8e2c700 1 -- 172.21.15.59:0/2623376108 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e40036a0 con 0x7fa0f409d630 2023-09-30T22:33:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.870+0000 7fa0fc092700 1 -- 172.21.15.59:0/2623376108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0f409d630 msgr2=0x7fa0f40a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.870+0000 7fa0fc092700 1 --2- 172.21.15.59:0/2623376108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0f409d630 0x7fa0f40a1510 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009840 tx=0x7fa0e4009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.870+0000 7fa0fc092700 1 -- 172.21.15.59:0/2623376108 shutdown_connections 2023-09-30T22:33:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.870+0000 7fa0fc092700 1 --2- 172.21.15.59:0/2623376108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0f4138d80 0x7fa0f413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.870+0000 7fa0fc092700 1 --2- 172.21.15.59:0/2623376108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0f409d630 0x7fa0f40a1510 secure :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009840 tx=0x7fa0e4009b50 comp rx=0 tx=0).stop 2023-09-30T22:33:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.870+0000 7fa0fc092700 1 -- 172.21.15.59:0/2623376108 >> 172.21.15.59:0/2623376108 conn(0x7fa0f40a3050 msgr2=0x7fa0f40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.871+0000 7fa0fc092700 1 -- 172.21.15.59:0/2623376108 shutdown_connections 2023-09-30T22:33:58.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.871+0000 7fa0fc092700 1 -- 172.21.15.59:0/2623376108 wait complete. 2023-09-30T22:33:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.872+0000 7fa0fc092700 1 Processor -- start 2023-09-30T22:33:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.872+0000 7fa0fc092700 1 -- start start 2023-09-30T22:33:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0fc092700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0f40a0a30 0x7fa0f41255c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0fc092700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0f4138d80 0x7fa0f4125b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0fc092700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0f41cc760 0x7fa0f41ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0fc092700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f40a04a0 con 0x7fa0f41cc760 2023-09-30T22:33:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0fc092700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f4126040 con 0x7fa0f4138d80 2023-09-30T22:33:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0fc092700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f4137b20 con 0x7fa0f40a0a30 2023-09-30T22:33:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0f962d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0f4138d80 0x7fa0f4125b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0f962d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0f4138d80 0x7fa0f4125b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49568/0 (socket says 172.21.15.59:49568) 2023-09-30T22:33:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0f962d700 1 -- 172.21.15.59:0/1649351334 learned_addr learned my addr 172.21.15.59:0/1649351334 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:33:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0fa62f700 1 --2- 172.21.15.59:0/1649351334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0f41cc760 0x7fa0f41ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0f962d700 1 -- 172.21.15.59:0/1649351334 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0f40a0a30 msgr2=0x7fa0f41255c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0f962d700 1 --2- 172.21.15.59:0/1649351334 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0f40a0a30 0x7fa0f41255c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0f962d700 1 -- 172.21.15.59:0/1649351334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0f41cc760 msgr2=0x7fa0f41ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0f962d700 1 --2- 172.21.15.59:0/1649351334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0f41cc760 0x7fa0f41ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0f962d700 1 -- 172.21.15.59:0/1649351334 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec009a70 con 0x7fa0f4138d80 2023-09-30T22:33:58.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.873+0000 7fa0fa62f700 1 --2- 172.21.15.59:0/1649351334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0f41cc760 0x7fa0f41ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:33:58.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.874+0000 7fa0f962d700 1 --2- 172.21.15.59:0/1649351334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0f4138d80 0x7fa0f4125b00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009ea0 tx=0x7fa0e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:58.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.874+0000 7fa0ea7fc700 1 -- 172.21.15.59:0/1649351334 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4003e60 con 0x7fa0f4138d80 2023-09-30T22:33:58.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.874+0000 7fa0ea7fc700 1 -- 172.21.15.59:0/1649351334 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e401f070 con 0x7fa0f4138d80 2023-09-30T22:33:58.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.874+0000 7fa0ea7fc700 1 -- 172.21.15.59:0/1649351334 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4011850 con 0x7fa0f4138d80 2023-09-30T22:33:58.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.874+0000 7fa0fc092700 1 -- 172.21.15.59:0/1649351334 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e40094a0 con 0x7fa0f4138d80 2023-09-30T22:33:58.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.874+0000 7fa0fc092700 1 -- 172.21.15.59:0/1649351334 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f4126650 con 0x7fa0f4138d80 2023-09-30T22:33:58.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.875+0000 7fa0ea7fc700 1 -- 172.21.15.59:0/1649351334 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa0e4021030 con 0x7fa0f4138d80 2023-09-30T22:33:58.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.875+0000 7fa0fc092700 1 -- 172.21.15.59:0/1649351334 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f4127940 con 0x7fa0f4138d80 2023-09-30T22:33:58.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.875+0000 7fa0ea7fc700 1 -- 172.21.15.59:0/1649351334 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa0e4040c00 con 0x7fa0f4138d80 2023-09-30T22:33:58.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.884+0000 7fa0ea7fc700 1 -- 172.21.15.59:0/1649351334 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0f4127940 con 0x7fa0f4138d80 2023-09-30T22:33:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.979+0000 7f94e6a9b700 1 -- 172.21.15.59:0/3098031844 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f94e0067e70 con 0x7f94e0130430 2023-09-30T22:33:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.980+0000 7f94dd7fa700 1 -- 172.21.15.59:0/3098031844 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94d80243b0 con 0x7f94e0130430 2023-09-30T22:33:58.981 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.983+0000 7f94e6a9b700 1 -- 172.21.15.59:0/3098031844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e0130430 msgr2=0x7f94e01c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.983+0000 7f94e6a9b700 1 --2- 172.21.15.59:0/3098031844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e0130430 0x7f94e01c9150 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f94e006dc90 tx=0x7f94d8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.983+0000 7f94e6a9b700 1 -- 172.21.15.59:0/3098031844 shutdown_connections 2023-09-30T22:33:58.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.983+0000 7f94e6a9b700 1 --2- 172.21.15.59:0/3098031844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e0130430 0x7f94e01c9150 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.983+0000 7f94e6a9b700 1 --2- 172.21.15.59:0/3098031844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e012cf60 0x7f94e01c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.983+0000 7f94e6a9b700 1 --2- 172.21.15.59:0/3098031844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e012f8b0 0x7f94e01c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.983+0000 7f94e6a9b700 1 -- 172.21.15.59:0/3098031844 >> 172.21.15.59:0/3098031844 conn(0x7f94e00a2aa0 msgr2=0x7f94e006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.983+0000 7f94e6a9b700 1 -- 172.21.15.59:0/3098031844 shutdown_connections 2023-09-30T22:33:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:58.983+0000 7f94e6a9b700 1 -- 172.21.15.59:0/3098031844 wait complete. 2023-09-30T22:33:59.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:33:59.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.092+0000 7f0c9734d700 1 -- 172.21.15.59:0/4277926014 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0c9012f220 con 0x7f0c9009a3b0 2023-09-30T22:33:59.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.092+0000 7f0c85ffb700 1 -- 172.21.15.59:0/4277926014 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c800253e0 con 0x7f0c9009a3b0 2023-09-30T22:33:59.094 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:33:59.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.093+0000 7fa0fc092700 1 -- 172.21.15.59:0/1649351334 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa0f4127940 con 0x7fa0f4138d80 2023-09-30T22:33:59.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.093+0000 7fa0ea7fc700 1 -- 172.21.15.59:0/1649351334 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa0f4127940 con 0x7fa0f4138d80 2023-09-30T22:33:59.096 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:33:59.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7fa0fc092700 1 -- 172.21.15.59:0/1649351334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0f4138d80 msgr2=0x7fa0f4125b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:59.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7fa0fc092700 1 --2- 172.21.15.59:0/1649351334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0f4138d80 0x7fa0f4125b00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009ea0 tx=0x7fa0e4004750 comp rx=0 tx=0).stop 2023-09-30T22:33:59.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7fa0fc092700 1 -- 172.21.15.59:0/1649351334 shutdown_connections 2023-09-30T22:33:59.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7fa0fc092700 1 --2- 172.21.15.59:0/1649351334 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0f40a0a30 0x7fa0f41255c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:59.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7fa0fc092700 1 --2- 172.21.15.59:0/1649351334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0f41cc760 0x7fa0f41ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:59.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7fa0fc092700 1 --2- 172.21.15.59:0/1649351334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0f4138d80 0x7fa0f4125b00 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:59.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7fa0fc092700 1 -- 172.21.15.59:0/1649351334 >> 172.21.15.59:0/1649351334 conn(0x7fa0f40a3050 msgr2=0x7fa0f40a5330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:59.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7fa0fc092700 1 -- 172.21.15.59:0/1649351334 shutdown_connections 2023-09-30T22:33:59.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7f0c9734d700 1 -- 172.21.15.59:0/4277926014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9009a3b0 msgr2=0x7f0c9011bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:59.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7f0c9734d700 1 --2- 172.21.15.59:0/4277926014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9009a3b0 0x7f0c9011bd60 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0c9006dd30 tx=0x7f0c80004750 comp rx=0 tx=0).stop 2023-09-30T22:33:59.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7fa0fc092700 1 -- 172.21.15.59:0/1649351334 wait complete. 2023-09-30T22:33:59.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7f0c9734d700 1 -- 172.21.15.59:0/4277926014 shutdown_connections 2023-09-30T22:33:59.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7f0c9734d700 1 --2- 172.21.15.59:0/4277926014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c90099a40 0x7f0c9011d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:59.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7f0c9734d700 1 --2- 172.21.15.59:0/4277926014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c90131810 0x7f0c9011c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:59.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7f0c9734d700 1 --2- 172.21.15.59:0/4277926014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9009a3b0 0x7f0c9011bd60 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:59.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7f0c9734d700 1 -- 172.21.15.59:0/4277926014 >> 172.21.15.59:0/4277926014 conn(0x7f0c900a2aa0 msgr2=0x7f0c9012e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:59.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7f0c9734d700 1 -- 172.21.15.59:0/4277926014 shutdown_connections 2023-09-30T22:33:59.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.096+0000 7f0c9734d700 1 -- 172.21.15.59:0/4277926014 wait complete. 2023-09-30T22:33:59.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:33:59.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:33:59.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.116+0000 7f61697f8700 1 -- 172.21.15.59:0/3157238894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f61640a28e0 con 0x7f61640a0a30 2023-09-30T22:33:59.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.117+0000 7f614b7fe700 1 -- 172.21.15.59:0/3157238894 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f615402b020 con 0x7f61640a0a30 2023-09-30T22:33:59.119 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:33:59.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.119+0000 7f61697f8700 1 -- 172.21.15.59:0/3157238894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61640a0a30 msgr2=0x7f61641231c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:59.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.119+0000 7f61697f8700 1 --2- 172.21.15.59:0/3157238894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61640a0a30 0x7f61641231c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f61540090b0 tx=0x7f6154004750 comp rx=0 tx=0).stop 2023-09-30T22:33:59.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.119+0000 7f61697f8700 1 -- 172.21.15.59:0/3157238894 shutdown_connections 2023-09-30T22:33:59.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.119+0000 7f61697f8700 1 --2- 172.21.15.59:0/3157238894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6164134170 0x7f61641c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:59.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.119+0000 7f61697f8700 1 --2- 172.21.15.59:0/3157238894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61640a0a30 0x7f61641231c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:59.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.119+0000 7f61697f8700 1 --2- 172.21.15.59:0/3157238894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61640a1340 0x7f6164123700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:59.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.119+0000 7f61697f8700 1 -- 172.21.15.59:0/3157238894 >> 172.21.15.59:0/3157238894 conn(0x7f61640a6550 msgr2=0x7f616411c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:59.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.119+0000 7f61697f8700 1 -- 172.21.15.59:0/3157238894 shutdown_connections 2023-09-30T22:33:59.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:33:59.119+0000 7f61697f8700 1 -- 172.21.15.59:0/3157238894 wait complete. 2023-09-30T22:33:59.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:00.004 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:00.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:00.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:00.136 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:00.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.151+0000 7f756373f700 1 Processor -- start 2023-09-30T22:34:00.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.152+0000 7f756373f700 1 -- start start 2023-09-30T22:34:00.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.152+0000 7f756373f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f755c09d6f0 0x7f755c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.152+0000 7f756373f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755c09e440 0x7f755c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.152+0000 7f756373f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755c09b120 con 0x7f755c09e000 2023-09-30T22:34:00.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.152+0000 7f756373f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755c06b460 con 0x7f755c09d6f0 2023-09-30T22:34:00.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.152+0000 7f756373f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f755c09a7e0 con 0x7f755c09e440 2023-09-30T22:34:00.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.152+0000 7f75614db700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f755c09d6f0 0x7f755c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.152+0000 7f75614db700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f755c09d6f0 0x7f755c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35828/0 (socket says 172.21.15.59:35828) 2023-09-30T22:34:00.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.152+0000 7f7560cda700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f755c09e000 0x7f755c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37126/0 (socket says 172.21.15.59:37126) 2023-09-30T22:34:00.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.152+0000 7f75614db700 1 -- 172.21.15.59:0/3230095816 learned_addr learned my addr 172.21.15.59:0/3230095816 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:00.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.152+0000 7f7561cdc700 1 --2- 172.21.15.59:0/3230095816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755c09e440 0x7f755c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.153+0000 7f7561cdc700 1 -- 172.21.15.59:0/3230095816 >> v2:172.21.15.59:3300/0 conn(0x7f755c09d6f0 msgr2=0x7f755c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:00.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.153+0000 7f7561cdc700 1 --2- 172.21.15.59:0/3230095816 >> v2:172.21.15.59:3300/0 conn(0x7f755c09d6f0 0x7f755c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.153+0000 7f7561cdc700 1 -- 172.21.15.59:0/3230095816 >> v1:172.21.15.59:6789/0 conn(0x7f755c09e000 legacy=0x7f755c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.153+0000 7f7561cdc700 1 -- 172.21.15.59:0/3230095816 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c09a500 con 0x7f755c09e440 2023-09-30T22:34:00.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.153+0000 7f7561cdc700 1 --2- 172.21.15.59:0/3230095816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755c09e440 0x7f755c134100 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7554009dc0 tx=0x7f755400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da030ca7145e8d63 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:00.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.153+0000 7f7553fff700 1 -- 172.21.15.59:0/3230095816 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755400e070 con 0x7f755c09e440 2023-09-30T22:34:00.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.153+0000 7f7553fff700 1 -- 172.21.15.59:0/3230095816 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755400bae0 con 0x7f755c09e440 2023-09-30T22:34:00.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.153+0000 7f7553fff700 1 -- 172.21.15.59:0/3230095816 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755400be90 con 0x7f755c09e440 2023-09-30T22:34:00.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.154+0000 7f756373f700 1 -- 172.21.15.59:0/3230095816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755c09e440 msgr2=0x7f755c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.154+0000 7f756373f700 1 --2- 172.21.15.59:0/3230095816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755c09e440 0x7f755c134100 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7554009dc0 tx=0x7f755400b330 comp rx=0 tx=0).stop 2023-09-30T22:34:00.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.155+0000 7f756373f700 1 -- 172.21.15.59:0/3230095816 shutdown_connections 2023-09-30T22:34:00.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.155+0000 7f756373f700 1 --2- 172.21.15.59:0/3230095816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755c09e440 0x7f755c134100 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.155+0000 7f756373f700 1 --2- 172.21.15.59:0/3230095816 >> v2:172.21.15.59:3300/0 conn(0x7f755c09d6f0 0x7f755c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.155+0000 7f756373f700 1 -- 172.21.15.59:0/3230095816 >> 172.21.15.59:0/3230095816 conn(0x7f755c066f50 msgr2=0x7f755c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:00.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.155+0000 7f756373f700 1 -- 172.21.15.59:0/3230095816 shutdown_connections 2023-09-30T22:34:00.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.155+0000 7f756373f700 1 -- 172.21.15.59:0/3230095816 wait complete. 2023-09-30T22:34:00.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.156+0000 7f756373f700 1 Processor -- start 2023-09-30T22:34:00.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.156+0000 7f756373f700 1 -- start start 2023-09-30T22:34:00.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.157+0000 7f756373f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755c09d6f0 0x7f755c1a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.157+0000 7f756373f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f755c09e000 0x7f755c1a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.157+0000 7f756373f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755c09e440 0x7f755c1a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.157+0000 7f756373f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c1aa360 con 0x7f755c09e000 2023-09-30T22:34:00.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.157+0000 7f756373f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c1a99a0 con 0x7f755c09e440 2023-09-30T22:34:00.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.157+0000 7f756373f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f755c1a8ce0 con 0x7f755c09d6f0 2023-09-30T22:34:00.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.157+0000 7f75614db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755c09d6f0 0x7f755c1a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.157+0000 7f7560cda700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f755c09e000 0x7f755c1a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.157+0000 7f75614db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755c09d6f0 0x7f755c1a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59882/0 (socket says 172.21.15.59:59882) 2023-09-30T22:34:00.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.157+0000 7f75614db700 1 -- 172.21.15.59:0/2587263758 learned_addr learned my addr 172.21.15.59:0/2587263758 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:00.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.157+0000 7f7561cdc700 1 --2- 172.21.15.59:0/2587263758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755c09e440 0x7f755c1a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.157+0000 7f75614db700 1 -- 172.21.15.59:0/2587263758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755c09e440 msgr2=0x7f755c1a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.157+0000 7f75614db700 1 --2- 172.21.15.59:0/2587263758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755c09e440 0x7f755c1a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.157+0000 7f75614db700 1 -- 172.21.15.59:0/2587263758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f755c09e000 msgr2=0x7f755c1a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.157+0000 7f75614db700 1 --2- 172.21.15.59:0/2587263758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f755c09e000 0x7f755c1a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.158+0000 7f75614db700 1 -- 172.21.15.59:0/2587263758 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7554009a70 con 0x7f755c09d6f0 2023-09-30T22:34:00.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.158+0000 7f75614db700 1 --2- 172.21.15.59:0/2587263758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755c09d6f0 0x7f755c1a5ed0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f755800e940 tx=0x7f755800ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:00.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.158+0000 7f7551ffb700 1 -- 172.21.15.59:0/2587263758 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75580096a0 con 0x7f755c09d6f0 2023-09-30T22:34:00.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.158+0000 7f7551ffb700 1 -- 172.21.15.59:0/2587263758 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755800ee90 con 0x7f755c09d6f0 2023-09-30T22:34:00.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.158+0000 7f756373f700 1 -- 172.21.15.59:0/2587263758 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c0a2000 con 0x7f755c09d6f0 2023-09-30T22:34:00.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.158+0000 7f7551ffb700 1 -- 172.21.15.59:0/2587263758 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755800ca90 con 0x7f755c09d6f0 2023-09-30T22:34:00.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.158+0000 7f756373f700 1 -- 172.21.15.59:0/2587263758 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755c09c760 con 0x7f755c09d6f0 2023-09-30T22:34:00.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.159+0000 7f7551ffb700 1 -- 172.21.15.59:0/2587263758 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f755800cbf0 con 0x7f755c09d6f0 2023-09-30T22:34:00.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.160+0000 7f7551ffb700 1 -- 172.21.15.59:0/2587263758 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f755803fa90 con 0x7f755c09d6f0 2023-09-30T22:34:00.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.160+0000 7f756373f700 1 -- 172.21.15.59:0/2587263758 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755c074ea0 con 0x7f755c09d6f0 2023-09-30T22:34:00.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.166+0000 7f7551ffb700 1 -- 172.21.15.59:0/2587263758 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f755801b3b0 con 0x7f755c09d6f0 2023-09-30T22:34:00.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.261+0000 7f7356247700 1 Processor -- start 2023-09-30T22:34:00.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.261+0000 7f7356247700 1 -- start start 2023-09-30T22:34:00.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.261+0000 7f7356247700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73501316c0 0x7f7350131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.261+0000 7f7356247700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f735009d9f0 0x7f735006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.261+0000 7f7356247700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f735006acb0 0x7f735006b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.261+0000 7f7356247700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f735006b630 con 0x7f735009d9f0 2023-09-30T22:34:00.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.261+0000 7f7356247700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735009e130 con 0x7f73501316c0 2023-09-30T22:34:00.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.261+0000 7f7356247700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73501312b0 con 0x7f735006acb0 2023-09-30T22:34:00.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.262+0000 7f734effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f735009d9f0 0x7f735006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.262+0000 7f734effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f735009d9f0 0x7f735006a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35848/0 (socket says 172.21.15.59:35848) 2023-09-30T22:34:00.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.262+0000 7f734effd700 1 -- 172.21.15.59:0/3628559162 learned_addr learned my addr 172.21.15.59:0/3628559162 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:00.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.262+0000 7f734ffff700 1 --2- 172.21.15.59:0/3628559162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f735006acb0 0x7f735006b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.262+0000 7f734f7fe700 1 --2- 172.21.15.59:0/3628559162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73501316c0 0x7f7350131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.262+0000 7f734ffff700 1 -- 172.21.15.59:0/3628559162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73501316c0 msgr2=0x7f7350131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:00.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.262+0000 7f734ffff700 1 --2- 172.21.15.59:0/3628559162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73501316c0 0x7f7350131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.262+0000 7f734ffff700 1 -- 172.21.15.59:0/3628559162 >> v2:172.21.15.59:3300/0 conn(0x7f735009d9f0 msgr2=0x7f735006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:00.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.262+0000 7f734ffff700 1 --2- 172.21.15.59:0/3628559162 >> v2:172.21.15.59:3300/0 conn(0x7f735009d9f0 0x7f735006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.262+0000 7f734ffff700 1 -- 172.21.15.59:0/3628559162 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735009f6e0 con 0x7f735006acb0 2023-09-30T22:34:00.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.262+0000 7f734f7fe700 1 --2- 172.21.15.59:0/3628559162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73501316c0 0x7f7350131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:00.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.262+0000 7f734ffff700 1 --2- 172.21.15.59:0/3628559162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f735006acb0 0x7f735006b0f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7348009dc0 tx=0x7f734800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f2d2ca9e0eaab3e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:00.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.263+0000 7f734e7fc700 1 -- 172.21.15.59:0/3628559162 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734800e070 con 0x7f735006acb0 2023-09-30T22:34:00.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.263+0000 7f734e7fc700 1 -- 172.21.15.59:0/3628559162 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734800bae0 con 0x7f735006acb0 2023-09-30T22:34:00.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.263+0000 7f734e7fc700 1 -- 172.21.15.59:0/3628559162 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734800be90 con 0x7f735006acb0 2023-09-30T22:34:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.263+0000 7f7356247700 1 -- 172.21.15.59:0/3628559162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f735006acb0 msgr2=0x7f735006b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.263+0000 7f7356247700 1 --2- 172.21.15.59:0/3628559162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f735006acb0 0x7f735006b0f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7348009dc0 tx=0x7f734800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.263+0000 7f7356247700 1 -- 172.21.15.59:0/3628559162 shutdown_connections 2023-09-30T22:34:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.263+0000 7f7356247700 1 --2- 172.21.15.59:0/3628559162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f735006acb0 0x7f735006b0f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.263+0000 7f7356247700 1 --2- 172.21.15.59:0/3628559162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73501316c0 0x7f7350131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.263+0000 7f7356247700 1 --2- 172.21.15.59:0/3628559162 >> v2:172.21.15.59:3300/0 conn(0x7f735009d9f0 0x7f735006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.263+0000 7f7356247700 1 -- 172.21.15.59:0/3628559162 >> 172.21.15.59:0/3628559162 conn(0x7f7350066f50 msgr2=0x7f735009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.264+0000 7f7356247700 1 -- 172.21.15.59:0/3628559162 shutdown_connections 2023-09-30T22:34:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.264+0000 7f7356247700 1 -- 172.21.15.59:0/3628559162 wait complete. 2023-09-30T22:34:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.265+0000 7f7356247700 1 Processor -- start 2023-09-30T22:34:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.265+0000 7f7356247700 1 -- start start 2023-09-30T22:34:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.265+0000 7f7356247700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f735006acb0 0x7f73501c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.265+0000 7f7356247700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f735009d9f0 0x7f73501c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.265+0000 7f7356247700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73501316c0 0x7f73500708c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.265+0000 7f7356247700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735011d890 con 0x7f735006acb0 2023-09-30T22:34:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.265+0000 7f7356247700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73500a36f0 con 0x7f735009d9f0 2023-09-30T22:34:00.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.265+0000 7f7356247700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f735012b900 con 0x7f73501316c0 2023-09-30T22:34:00.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.265+0000 7f734effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f735009d9f0 0x7f73501c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.265+0000 7f734ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73501316c0 0x7f73500708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.265+0000 7f734ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73501316c0 0x7f73500708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59898/0 (socket says 172.21.15.59:59898) 2023-09-30T22:34:00.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.265+0000 7f734effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f735009d9f0 0x7f73501c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49600/0 (socket says 172.21.15.59:49600) 2023-09-30T22:34:00.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.265+0000 7f734ffff700 1 -- 172.21.15.59:0/1427896646 learned_addr learned my addr 172.21.15.59:0/1427896646 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:00.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.266+0000 7f734effd700 1 -- 172.21.15.59:0/1427896646 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73501316c0 msgr2=0x7f73500708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.266+0000 7f734effd700 1 --2- 172.21.15.59:0/1427896646 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73501316c0 0x7f73500708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.266+0000 7f734effd700 1 -- 172.21.15.59:0/1427896646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f735006acb0 msgr2=0x7f73501c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.266+0000 7f734effd700 1 --2- 172.21.15.59:0/1427896646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f735006acb0 0x7f73501c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.266+0000 7f734effd700 1 -- 172.21.15.59:0/1427896646 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73400094a0 con 0x7f735009d9f0 2023-09-30T22:34:00.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.266+0000 7f734effd700 1 --2- 172.21.15.59:0/1427896646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f735009d9f0 0x7f73501c8ae0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f735006deb0 tx=0x7f734400eac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:00.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.266+0000 7f7337fff700 1 -- 172.21.15.59:0/1427896646 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734400c070 con 0x7f735009d9f0 2023-09-30T22:34:00.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.266+0000 7f7337fff700 1 -- 172.21.15.59:0/1427896646 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7344013610 con 0x7f735009d9f0 2023-09-30T22:34:00.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.266+0000 7f7356247700 1 -- 172.21.15.59:0/1427896646 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7348009a70 con 0x7f735009d9f0 2023-09-30T22:34:00.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.266+0000 7f7337fff700 1 -- 172.21.15.59:0/1427896646 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73440139a0 con 0x7f735009d9f0 2023-09-30T22:34:00.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.266+0000 7f7356247700 1 -- 172.21.15.59:0/1427896646 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735009b770 con 0x7f735009d9f0 2023-09-30T22:34:00.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.267+0000 7f7337fff700 1 -- 172.21.15.59:0/1427896646 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7344013b00 con 0x7f735009d9f0 2023-09-30T22:34:00.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.268+0000 7f7337fff700 1 -- 172.21.15.59:0/1427896646 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f734403f3c0 con 0x7f735009d9f0 2023-09-30T22:34:00.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.268+0000 7f7356247700 1 -- 172.21.15.59:0/1427896646 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7350074ea0 con 0x7f735009d9f0 2023-09-30T22:34:00.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.273+0000 7f7337fff700 1 -- 172.21.15.59:0/1427896646 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7344010900 con 0x7f735009d9f0 2023-09-30T22:34:00.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.294+0000 7fb455244700 1 Processor -- start 2023-09-30T22:34:00.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.294+0000 7fb455244700 1 -- start start 2023-09-30T22:34:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.295+0000 7fb455244700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4500a1510 0x7fb450138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.295+0000 7fb455244700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb450139250 0x7fb45013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.295+0000 7fb455244700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45009edd0 con 0x7fb4500a0a30 2023-09-30T22:34:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.295+0000 7fb455244700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4500a18e0 con 0x7fb4500a1510 2023-09-30T22:34:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.295+0000 7fb455244700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb45009e1f0 con 0x7fb450139250 2023-09-30T22:34:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.295+0000 7fb44f59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb450139250 0x7fb45013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.295+0000 7fb44f59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb450139250 0x7fb45013b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59904/0 (socket says 172.21.15.59:59904) 2023-09-30T22:34:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.295+0000 7fb44f59e700 1 -- 172.21.15.59:0/883640079 learned_addr learned my addr 172.21.15.59:0/883640079 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.295+0000 7fb44e59c700 1 --2- 172.21.15.59:0/883640079 >> v2:172.21.15.59:3300/0 conn(0x7fb4500a1510 0x7fb450138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.296+0000 7fb44f59e700 1 -- 172.21.15.59:0/883640079 >> v2:172.21.15.59:3300/0 conn(0x7fb4500a1510 msgr2=0x7fb450138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.296+0000 7fb44f59e700 1 --2- 172.21.15.59:0/883640079 >> v2:172.21.15.59:3300/0 conn(0x7fb4500a1510 0x7fb450138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.296+0000 7fb44f59e700 1 -- 172.21.15.59:0/883640079 >> v1:172.21.15.59:6789/0 conn(0x7fb4500a0a30 legacy=0x7fb4500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.296+0000 7fb44f59e700 1 -- 172.21.15.59:0/883640079 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45009dc50 con 0x7fb450139250 2023-09-30T22:34:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.296+0000 7fb44f59e700 1 --2- 172.21.15.59:0/883640079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb450139250 0x7fb45013b630 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb4480098f0 tx=0x7fb448009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c54a2b6cfbacaf5e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.296+0000 7fb44dd9b700 1 -- 172.21.15.59:0/883640079 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448011830 con 0x7fb450139250 2023-09-30T22:34:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.296+0000 7fb44dd9b700 1 -- 172.21.15.59:0/883640079 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb448011990 con 0x7fb450139250 2023-09-30T22:34:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.296+0000 7fb44dd9b700 1 -- 172.21.15.59:0/883640079 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448011d20 con 0x7fb450139250 2023-09-30T22:34:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.297+0000 7fb455244700 1 -- 172.21.15.59:0/883640079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb450139250 msgr2=0x7fb45013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.297+0000 7fb455244700 1 --2- 172.21.15.59:0/883640079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb450139250 0x7fb45013b630 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb4480098f0 tx=0x7fb448009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.297+0000 7fb455244700 1 -- 172.21.15.59:0/883640079 shutdown_connections 2023-09-30T22:34:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.297+0000 7fb455244700 1 --2- 172.21.15.59:0/883640079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb450139250 0x7fb45013b630 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.297+0000 7fb455244700 1 --2- 172.21.15.59:0/883640079 >> v2:172.21.15.59:3300/0 conn(0x7fb4500a1510 0x7fb450138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.297+0000 7fb455244700 1 -- 172.21.15.59:0/883640079 >> 172.21.15.59:0/883640079 conn(0x7fb4500a6550 msgr2=0x7fb4500a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.297+0000 7fb455244700 1 -- 172.21.15.59:0/883640079 shutdown_connections 2023-09-30T22:34:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.297+0000 7fb455244700 1 -- 172.21.15.59:0/883640079 wait complete. 2023-09-30T22:34:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.299+0000 7fb455244700 1 Processor -- start 2023-09-30T22:34:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.299+0000 7fb455244700 1 -- start start 2023-09-30T22:34:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.299+0000 7fb455244700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4500a0a30 0x7fb4501228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.299+0000 7fb455244700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4500a1510 0x7fb450122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.299+0000 7fb455244700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb450139250 0x7fb450123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.299+0000 7fb455244700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb450126170 con 0x7fb4500a0a30 2023-09-30T22:34:00.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.299+0000 7fb455244700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb450125ae0 con 0x7fb4500a1510 2023-09-30T22:34:00.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.299+0000 7fb455244700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb450138980 con 0x7fb450139250 2023-09-30T22:34:00.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.299+0000 7fb44e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4500a1510 0x7fb450122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.299+0000 7fb44ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4500a0a30 0x7fb4501228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.299+0000 7fb44e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4500a1510 0x7fb450122e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49602/0 (socket says 172.21.15.59:49602) 2023-09-30T22:34:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.299+0000 7fb44ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4500a0a30 0x7fb4501228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35872/0 (socket says 172.21.15.59:35872) 2023-09-30T22:34:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.299+0000 7fb44e59c700 1 -- 172.21.15.59:0/565131340 learned_addr learned my addr 172.21.15.59:0/565131340 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.299+0000 7fb44f59e700 1 --2- 172.21.15.59:0/565131340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb450139250 0x7fb450123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.300+0000 7fb44ed9d700 1 -- 172.21.15.59:0/565131340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb450139250 msgr2=0x7fb450123360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.300+0000 7fb44ed9d700 1 --2- 172.21.15.59:0/565131340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb450139250 0x7fb450123360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.300+0000 7fb44ed9d700 1 -- 172.21.15.59:0/565131340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4500a1510 msgr2=0x7fb450122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.300+0000 7fb44ed9d700 1 --2- 172.21.15.59:0/565131340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4500a1510 0x7fb450122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.300+0000 7fb44ed9d700 1 -- 172.21.15.59:0/565131340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb448009550 con 0x7fb4500a0a30 2023-09-30T22:34:00.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.300+0000 7fb44e59c700 1 --2- 172.21.15.59:0/565131340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4500a1510 0x7fb450122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:00.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.300+0000 7fb44ed9d700 1 --2- 172.21.15.59:0/565131340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4500a0a30 0x7fb4501228e0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fb44000cbb0 tx=0x7fb44000cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:00.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.300+0000 7fb4377fe700 1 -- 172.21.15.59:0/565131340 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440003c00 con 0x7fb4500a0a30 2023-09-30T22:34:00.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.300+0000 7fb4377fe700 1 -- 172.21.15.59:0/565131340 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb440003d60 con 0x7fb4500a0a30 2023-09-30T22:34:00.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.300+0000 7fb4377fe700 1 -- 172.21.15.59:0/565131340 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44000aae0 con 0x7fb4500a0a30 2023-09-30T22:34:00.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.300+0000 7fb455244700 1 -- 172.21.15.59:0/565131340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb450124460 con 0x7fb4500a0a30 2023-09-30T22:34:00.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.300+0000 7fb455244700 1 -- 172.21.15.59:0/565131340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4500a0270 con 0x7fb4500a0a30 2023-09-30T22:34:00.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.301+0000 7fb4377fe700 1 -- 172.21.15.59:0/565131340 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb44000ac40 con 0x7fb4500a0a30 2023-09-30T22:34:00.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.302+0000 7fb4377fe700 1 -- 172.21.15.59:0/565131340 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb44003f5a0 con 0x7fb4500a0a30 2023-09-30T22:34:00.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.302+0000 7fb455244700 1 -- 172.21.15.59:0/565131340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb450074ea0 con 0x7fb4500a0a30 2023-09-30T22:34:00.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.307+0000 7fb4377fe700 1 -- 172.21.15.59:0/565131340 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4400198f0 con 0x7fb4500a0a30 2023-09-30T22:34:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.312+0000 7f08b883d700 1 Processor -- start 2023-09-30T22:34:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.312+0000 7f08b883d700 1 -- start start 2023-09-30T22:34:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.313+0000 7f08b883d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08b412cf60 0x7f08b406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.313+0000 7f08b883d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f08b412f8b0 0x7f08b412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.313+0000 7f08b883d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08b4130260 0x7f08b4136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.313+0000 7f08b883d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b412d330 con 0x7f08b412f8b0 2023-09-30T22:34:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.313+0000 7f08b883d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b412cd90 con 0x7f08b412cf60 2023-09-30T22:34:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.313+0000 7f08b883d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08b41306d0 con 0x7f08b4130260 2023-09-30T22:34:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.313+0000 7f08b2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08b4130260 0x7f08b4136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.313+0000 7f08b2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08b4130260 0x7f08b4136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59914/0 (socket says 172.21.15.59:59914) 2023-09-30T22:34:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.313+0000 7f08b2d9d700 1 -- 172.21.15.59:0/3872015887 learned_addr learned my addr 172.21.15.59:0/3872015887 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.314+0000 7f08b2d9d700 1 -- 172.21.15.59:0/3872015887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08b412cf60 msgr2=0x7f08b406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.314+0000 7f08b2d9d700 1 --2- 172.21.15.59:0/3872015887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08b412cf60 0x7f08b406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.314+0000 7f08b2d9d700 1 -- 172.21.15.59:0/3872015887 >> v2:172.21.15.59:3300/0 conn(0x7f08b412f8b0 msgr2=0x7f08b412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:00.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.314+0000 7f08b2d9d700 1 --2- 172.21.15.59:0/3872015887 >> v2:172.21.15.59:3300/0 conn(0x7f08b412f8b0 0x7f08b412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.314+0000 7f08b2d9d700 1 -- 172.21.15.59:0/3872015887 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b4071780 con 0x7f08b4130260 2023-09-30T22:34:00.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.314+0000 7f08b2d9d700 1 --2- 172.21.15.59:0/3872015887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08b4130260 0x7f08b4136c20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00d180 tx=0x7f08ac00d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81ae8e8ccf696aad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:00.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.314+0000 7f08b159a700 1 -- 172.21.15.59:0/3872015887 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac010070 con 0x7f08b4130260 2023-09-30T22:34:00.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.314+0000 7f08b159a700 1 -- 172.21.15.59:0/3872015887 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac00dba0 con 0x7f08b4130260 2023-09-30T22:34:00.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.314+0000 7f08b159a700 1 -- 172.21.15.59:0/3872015887 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac016400 con 0x7f08b4130260 2023-09-30T22:34:00.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.315+0000 7f08b883d700 1 -- 172.21.15.59:0/3872015887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08b4130260 msgr2=0x7f08b4136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.315+0000 7f08b883d700 1 --2- 172.21.15.59:0/3872015887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08b4130260 0x7f08b4136c20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00d180 tx=0x7f08ac00d490 comp rx=0 tx=0).stop 2023-09-30T22:34:00.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.315+0000 7f08b883d700 1 -- 172.21.15.59:0/3872015887 shutdown_connections 2023-09-30T22:34:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.315+0000 7f08b883d700 1 --2- 172.21.15.59:0/3872015887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08b4130260 0x7f08b4136c20 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.315+0000 7f08b883d700 1 --2- 172.21.15.59:0/3872015887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08b412cf60 0x7f08b406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.315+0000 7f08b883d700 1 --2- 172.21.15.59:0/3872015887 >> v2:172.21.15.59:3300/0 conn(0x7f08b412f8b0 0x7f08b412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.315+0000 7f08b883d700 1 -- 172.21.15.59:0/3872015887 >> 172.21.15.59:0/3872015887 conn(0x7f08b40a2aa0 msgr2=0x7f08b40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.315+0000 7f08b883d700 1 -- 172.21.15.59:0/3872015887 shutdown_connections 2023-09-30T22:34:00.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.315+0000 7f08b883d700 1 -- 172.21.15.59:0/3872015887 wait complete. 2023-09-30T22:34:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.317+0000 7f08b883d700 1 Processor -- start 2023-09-30T22:34:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.317+0000 7f08b883d700 1 -- start start 2023-09-30T22:34:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.318+0000 7f08b883d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08b412cf60 0x7f08b41214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.318+0000 7f08b883d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08b412f8b0 0x7f08b4121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.318+0000 7f08b883d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08b4130260 0x7f08b4121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.318+0000 7f08b883d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b4123da0 con 0x7f08b412f8b0 2023-09-30T22:34:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.318+0000 7f08b883d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b412da40 con 0x7f08b4130260 2023-09-30T22:34:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.318+0000 7f08b883d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08b4129fa0 con 0x7f08b412cf60 2023-09-30T22:34:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.318+0000 7f08b259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08b412cf60 0x7f08b41214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.318+0000 7f08b259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08b412cf60 0x7f08b41214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59918/0 (socket says 172.21.15.59:59918) 2023-09-30T22:34:00.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.318+0000 7f08b259c700 1 -- 172.21.15.59:0/3332218416 learned_addr learned my addr 172.21.15.59:0/3332218416 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:00.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.318+0000 7f08b2d9d700 1 --2- 172.21.15.59:0/3332218416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08b4130260 0x7f08b4121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.319+0000 7f08b259c700 1 -- 172.21.15.59:0/3332218416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08b4130260 msgr2=0x7f08b4121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.319+0000 7f08b1d9b700 1 --2- 172.21.15.59:0/3332218416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08b412f8b0 0x7f08b4121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:00.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.319+0000 7f08b259c700 1 --2- 172.21.15.59:0/3332218416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08b4130260 0x7f08b4121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.319+0000 7f08b259c700 1 -- 172.21.15.59:0/3332218416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08b412f8b0 msgr2=0x7f08b4121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.319+0000 7f08b259c700 1 --2- 172.21.15.59:0/3332218416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08b412f8b0 0x7f08b4121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.319+0000 7f08b259c700 1 -- 172.21.15.59:0/3332218416 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac00bd40 con 0x7f08b412cf60 2023-09-30T22:34:00.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.319+0000 7f08b1d9b700 1 --2- 172.21.15.59:0/3332218416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08b412f8b0 0x7f08b4121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:34:00.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.319+0000 7f08b259c700 1 --2- 172.21.15.59:0/3332218416 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08b412cf60 0x7f08b41214e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f08a400b530 tx=0x7f08a400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:00.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.319+0000 7f08a2ffd700 1 -- 172.21.15.59:0/3332218416 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4011830 con 0x7f08b412cf60 2023-09-30T22:34:00.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.319+0000 7f08a2ffd700 1 -- 172.21.15.59:0/3332218416 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a4011990 con 0x7f08b412cf60 2023-09-30T22:34:00.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.320+0000 7f08b883d700 1 -- 172.21.15.59:0/3332218416 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b4124980 con 0x7f08b412cf60 2023-09-30T22:34:00.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.320+0000 7f08a2ffd700 1 -- 172.21.15.59:0/3332218416 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4011d20 con 0x7f08b412cf60 2023-09-30T22:34:00.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.320+0000 7f08b883d700 1 -- 172.21.15.59:0/3332218416 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b409e8b0 con 0x7f08b412cf60 2023-09-30T22:34:00.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.321+0000 7f08a2ffd700 1 -- 172.21.15.59:0/3332218416 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08a401a400 con 0x7f08b412cf60 2023-09-30T22:34:00.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.321+0000 7f08b883d700 1 -- 172.21.15.59:0/3332218416 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b4074ea0 con 0x7f08b412cf60 2023-09-30T22:34:00.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.321+0000 7f08a2ffd700 1 -- 172.21.15.59:0/3332218416 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f08a403f6f0 con 0x7f08b412cf60 2023-09-30T22:34:00.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.330+0000 7f08a2ffd700 1 -- 172.21.15.59:0/3332218416 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08a400f8d0 con 0x7f08b412cf60 2023-09-30T22:34:00.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.448+0000 7f756373f700 1 -- 172.21.15.59:0/2587263758 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f755c09f420 con 0x7f755c09d6f0 2023-09-30T22:34:00.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.448+0000 7f7551ffb700 1 -- 172.21.15.59:0/2587263758 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7558021030 con 0x7f755c09d6f0 2023-09-30T22:34:00.450 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.451+0000 7f756373f700 1 -- 172.21.15.59:0/2587263758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755c09d6f0 msgr2=0x7f755c1a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.451+0000 7f756373f700 1 --2- 172.21.15.59:0/2587263758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755c09d6f0 0x7f755c1a5ed0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f755800e940 tx=0x7f755800ec50 comp rx=0 tx=0).stop 2023-09-30T22:34:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.451+0000 7f756373f700 1 -- 172.21.15.59:0/2587263758 shutdown_connections 2023-09-30T22:34:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.451+0000 7f756373f700 1 --2- 172.21.15.59:0/2587263758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755c09d6f0 0x7f755c1a5ed0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.451+0000 7f756373f700 1 --2- 172.21.15.59:0/2587263758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755c09e440 0x7f755c1a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.451+0000 7f756373f700 1 --2- 172.21.15.59:0/2587263758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f755c09e000 0x7f755c1a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.451+0000 7f756373f700 1 -- 172.21.15.59:0/2587263758 >> 172.21.15.59:0/2587263758 conn(0x7f755c066f50 msgr2=0x7f755c1baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:00.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.451+0000 7f756373f700 1 -- 172.21.15.59:0/2587263758 shutdown_connections 2023-09-30T22:34:00.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.451+0000 7f756373f700 1 -- 172.21.15.59:0/2587263758 wait complete. 2023-09-30T22:34:00.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:00.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.485+0000 7f7356247700 1 -- 172.21.15.59:0/1427896646 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f735009e980 con 0x7f735009d9f0 2023-09-30T22:34:00.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.486+0000 7f7337fff700 1 -- 172.21.15.59:0/1427896646 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f734402b090 con 0x7f735009d9f0 2023-09-30T22:34:00.487 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:00.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.488+0000 7f7356247700 1 -- 172.21.15.59:0/1427896646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f735009d9f0 msgr2=0x7f73501c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.488+0000 7f7356247700 1 --2- 172.21.15.59:0/1427896646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f735009d9f0 0x7f73501c8ae0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f735006deb0 tx=0x7f734400eac0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.488+0000 7f7356247700 1 -- 172.21.15.59:0/1427896646 shutdown_connections 2023-09-30T22:34:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.488+0000 7f7356247700 1 --2- 172.21.15.59:0/1427896646 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73501316c0 0x7f73500708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.488+0000 7f7356247700 1 --2- 172.21.15.59:0/1427896646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f735006acb0 0x7f73501c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.488+0000 7f7356247700 1 --2- 172.21.15.59:0/1427896646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f735009d9f0 0x7f73501c8ae0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.488+0000 7f7356247700 1 -- 172.21.15.59:0/1427896646 >> 172.21.15.59:0/1427896646 conn(0x7f7350066f50 msgr2=0x7f73500a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.488+0000 7f7356247700 1 -- 172.21.15.59:0/1427896646 shutdown_connections 2023-09-30T22:34:00.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.488+0000 7f7356247700 1 -- 172.21.15.59:0/1427896646 wait complete. 2023-09-30T22:34:00.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:00.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.526+0000 7fb455244700 1 -- 172.21.15.59:0/565131340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb450125fd0 con 0x7fb4500a0a30 2023-09-30T22:34:00.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.526+0000 7fb4377fe700 1 -- 172.21.15.59:0/565131340 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb450125fd0 con 0x7fb4500a0a30 2023-09-30T22:34:00.527 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:00.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.528+0000 7fb455244700 1 -- 172.21.15.59:0/565131340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4500a0a30 msgr2=0x7fb4501228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.528+0000 7fb455244700 1 --2- 172.21.15.59:0/565131340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4500a0a30 0x7fb4501228e0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fb44000cbb0 tx=0x7fb44000cec0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.528+0000 7fb455244700 1 -- 172.21.15.59:0/565131340 shutdown_connections 2023-09-30T22:34:00.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.528+0000 7fb455244700 1 --2- 172.21.15.59:0/565131340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb450139250 0x7fb450123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.528+0000 7fb455244700 1 --2- 172.21.15.59:0/565131340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4500a0a30 0x7fb4501228e0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.528+0000 7fb455244700 1 --2- 172.21.15.59:0/565131340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4500a1510 0x7fb450122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.528+0000 7fb455244700 1 -- 172.21.15.59:0/565131340 >> 172.21.15.59:0/565131340 conn(0x7fb4500a6550 msgr2=0x7fb4500a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:00.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.528+0000 7fb455244700 1 -- 172.21.15.59:0/565131340 shutdown_connections 2023-09-30T22:34:00.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.528+0000 7fb455244700 1 -- 172.21.15.59:0/565131340 wait complete. 2023-09-30T22:34:00.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.538+0000 7f08b883d700 1 -- 172.21.15.59:0/3332218416 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f08b4071380 con 0x7f08b412cf60 2023-09-30T22:34:00.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.539+0000 7f08a2ffd700 1 -- 172.21.15.59:0/3332218416 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08a4015030 con 0x7f08b412cf60 2023-09-30T22:34:00.540 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.541+0000 7f08b883d700 1 -- 172.21.15.59:0/3332218416 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08b412cf60 msgr2=0x7f08b41214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.541+0000 7f08b883d700 1 --2- 172.21.15.59:0/3332218416 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08b412cf60 0x7f08b41214e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f08a400b530 tx=0x7f08a400b840 comp rx=0 tx=0).stop 2023-09-30T22:34:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.541+0000 7f08b883d700 1 -- 172.21.15.59:0/3332218416 shutdown_connections 2023-09-30T22:34:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.541+0000 7f08b883d700 1 --2- 172.21.15.59:0/3332218416 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08b412cf60 0x7f08b41214e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.541+0000 7f08b883d700 1 --2- 172.21.15.59:0/3332218416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08b4130260 0x7f08b4121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.541+0000 7f08b883d700 1 --2- 172.21.15.59:0/3332218416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08b412f8b0 0x7f08b4121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.541+0000 7f08b883d700 1 -- 172.21.15.59:0/3332218416 >> 172.21.15.59:0/3332218416 conn(0x7f08b40a2aa0 msgr2=0x7f08b412af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.541+0000 7f08b883d700 1 -- 172.21.15.59:0/3332218416 shutdown_connections 2023-09-30T22:34:00.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:00.541+0000 7f08b883d700 1 -- 172.21.15.59:0/3332218416 wait complete. 2023-09-30T22:34:00.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:00.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:01.467 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:01.505 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:01.545 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:01.556 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:01.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.633+0000 7f45fc3d5700 1 Processor -- start 2023-09-30T22:34:01.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.633+0000 7f45fc3d5700 1 -- start start 2023-09-30T22:34:01.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.634+0000 7f45fc3d5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45f409e930 0x7f45f409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.634+0000 7f45fc3d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f409f650 0x7f45f4131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.634+0000 7f45fc3d5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f4070940 con 0x7f45f409f240 2023-09-30T22:34:01.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.634+0000 7f45fc3d5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f406fd60 con 0x7f45f409e930 2023-09-30T22:34:01.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.634+0000 7f45fc3d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f406fa80 con 0x7f45f409f650 2023-09-30T22:34:01.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.634+0000 7f45fa972700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f409f650 0x7f45f4131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.634+0000 7f45fa171700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45f409e930 0x7f45f409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.634+0000 7f45f9970700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f45f409f240 0x7f45f41317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37140/0 (socket says 172.21.15.59:37140) 2023-09-30T22:34:01.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.634+0000 7f45f9970700 1 -- 172.21.15.59:0/1320087406 learned_addr learned my addr 172.21.15.59:0/1320087406 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:01.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.635+0000 7f45fa171700 1 -- 172.21.15.59:0/1320087406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f409f650 msgr2=0x7f45f4131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:01.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.635+0000 7f45fa171700 1 --2- 172.21.15.59:0/1320087406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f409f650 0x7f45f4131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.635+0000 7f45fa171700 1 -- 172.21.15.59:0/1320087406 >> v1:172.21.15.59:6789/0 conn(0x7f45f409f240 legacy=0x7f45f41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.635+0000 7f45fa171700 1 -- 172.21.15.59:0/1320087406 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f409fb60 con 0x7f45f409e930 2023-09-30T22:34:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.635+0000 7f45fa972700 1 --2- 172.21.15.59:0/1320087406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f409f650 0x7f45f4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.635+0000 7f45fa171700 1 --2- 172.21.15.59:0/1320087406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f409e930 0x7f45f409ed00 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009840 tx=0x7f45f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a8a6a9660950c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.635+0000 7f45f916f700 1 -- 172.21.15.59:0/1320087406 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0011830 con 0x7f45f409e930 2023-09-30T22:34:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.635+0000 7f45f916f700 1 -- 172.21.15.59:0/1320087406 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f0011990 con 0x7f45f409e930 2023-09-30T22:34:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.635+0000 7f45f916f700 1 -- 172.21.15.59:0/1320087406 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0011d20 con 0x7f45f409e930 2023-09-30T22:34:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.636+0000 7f45fc3d5700 1 -- 172.21.15.59:0/1320087406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f409e930 msgr2=0x7f45f409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.636+0000 7f45fc3d5700 1 --2- 172.21.15.59:0/1320087406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f409e930 0x7f45f409ed00 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009840 tx=0x7f45f0009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.636+0000 7f45fc3d5700 1 -- 172.21.15.59:0/1320087406 shutdown_connections 2023-09-30T22:34:01.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.636+0000 7f45fc3d5700 1 --2- 172.21.15.59:0/1320087406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f409e930 0x7f45f409ed00 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.636+0000 7f45fc3d5700 1 --2- 172.21.15.59:0/1320087406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f409f650 0x7f45f4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.636+0000 7f45fc3d5700 1 -- 172.21.15.59:0/1320087406 >> 172.21.15.59:0/1320087406 conn(0x7f45f40a4210 msgr2=0x7f45f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:01.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.636+0000 7f45fc3d5700 1 -- 172.21.15.59:0/1320087406 shutdown_connections 2023-09-30T22:34:01.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.636+0000 7f45fc3d5700 1 -- 172.21.15.59:0/1320087406 wait complete. 2023-09-30T22:34:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.637+0000 7f45fc3d5700 1 Processor -- start 2023-09-30T22:34:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.637+0000 7f45fc3d5700 1 -- start start 2023-09-30T22:34:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45fc3d5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f409e930 0x7f45f406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45fc3d5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f409f240 0x7f45f406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45fc3d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f409f650 0x7f45f406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45fc3d5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f41a99b0 con 0x7f45f409f240 2023-09-30T22:34:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45fc3d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f41a8950 con 0x7f45f409f650 2023-09-30T22:34:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45fc3d5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40a3540 con 0x7f45f409e930 2023-09-30T22:34:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45f9970700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f409f240 0x7f45f406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45f9970700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f409f240 0x7f45f406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35910/0 (socket says 172.21.15.59:35910) 2023-09-30T22:34:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45f9970700 1 -- 172.21.15.59:0/2582571803 learned_addr learned my addr 172.21.15.59:0/2582571803 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45fa972700 1 --2- 172.21.15.59:0/2582571803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f409f650 0x7f45f406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45f9970700 1 -- 172.21.15.59:0/2582571803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f409e930 msgr2=0x7f45f406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45f9970700 1 --2- 172.21.15.59:0/2582571803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f409e930 0x7f45f406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45f9970700 1 -- 172.21.15.59:0/2582571803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f409f650 msgr2=0x7f45f406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45f9970700 1 --2- 172.21.15.59:0/2582571803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f409f650 0x7f45f406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45f9970700 1 -- 172.21.15.59:0/2582571803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec009a70 con 0x7f45f409f240 2023-09-30T22:34:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.638+0000 7f45fa972700 1 --2- 172.21.15.59:0/2582571803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f409f650 0x7f45f406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.639+0000 7f45f9970700 1 --2- 172.21.15.59:0/2582571803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f409f240 0x7f45f406bdf0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f45e400c520 tx=0x7f45e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.639+0000 7f45eaffd700 1 -- 172.21.15.59:0/2582571803 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4005d70 con 0x7f45f409f240 2023-09-30T22:34:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.639+0000 7f45eaffd700 1 -- 172.21.15.59:0/2582571803 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e40070d0 con 0x7f45f409f240 2023-09-30T22:34:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.639+0000 7f45fc3d5700 1 -- 172.21.15.59:0/2582571803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f00094a0 con 0x7f45f409f240 2023-09-30T22:34:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.639+0000 7f45eaffd700 1 -- 172.21.15.59:0/2582571803 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4007440 con 0x7f45f409f240 2023-09-30T22:34:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.639+0000 7f45fc3d5700 1 -- 172.21.15.59:0/2582571803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f40a0190 con 0x7f45f409f240 2023-09-30T22:34:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.640+0000 7f45fc3d5700 1 -- 172.21.15.59:0/2582571803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f41a0b30 con 0x7f45f409f240 2023-09-30T22:34:01.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.641+0000 7f45eaffd700 1 -- 172.21.15.59:0/2582571803 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45e40075a0 con 0x7f45f409f240 2023-09-30T22:34:01.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.641+0000 7f45eaffd700 1 -- 172.21.15.59:0/2582571803 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f45e403eaf0 con 0x7f45f409f240 2023-09-30T22:34:01.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.650+0000 7f45eaffd700 1 -- 172.21.15.59:0/2582571803 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45e4019b40 con 0x7f45f409f240 2023-09-30T22:34:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.670+0000 7f920ddf1700 1 Processor -- start 2023-09-30T22:34:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.670+0000 7f920ddf1700 1 -- start start 2023-09-30T22:34:01.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.671+0000 7f920ddf1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9208136710 0x7f9208138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.671+0000 7f920ddf1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9208139030 0x7f920813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.671+0000 7f920ddf1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920806ef30 con 0x7f92081338a0 2023-09-30T22:34:01.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.671+0000 7f920ddf1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f920806fef0 con 0x7f9208136710 2023-09-30T22:34:01.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.671+0000 7f920ddf1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92081334b0 con 0x7f9208139030 2023-09-30T22:34:01.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.671+0000 7f9207fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9208139030 0x7f920813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.671+0000 7f92077fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f92081338a0 0x7f9208133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37144/0 (socket says 172.21.15.59:37144) 2023-09-30T22:34:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.671+0000 7f92077fe700 1 -- 172.21.15.59:0/1718329928 learned_addr learned my addr 172.21.15.59:0/1718329928 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.671+0000 7f9206ffd700 1 --2- 172.21.15.59:0/1718329928 >> v2:172.21.15.59:3300/0 conn(0x7f9208136710 0x7f9208138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.671+0000 7f9206ffd700 1 -- 172.21.15.59:0/1718329928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9208139030 msgr2=0x7f920813b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.671+0000 7f9206ffd700 1 --2- 172.21.15.59:0/1718329928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9208139030 0x7f920813b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.671+0000 7f9206ffd700 1 -- 172.21.15.59:0/1718329928 >> v1:172.21.15.59:6789/0 conn(0x7f92081338a0 legacy=0x7f9208133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.671+0000 7f9206ffd700 1 -- 172.21.15.59:0/1718329928 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920806fc30 con 0x7f9208136710 2023-09-30T22:34:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.672+0000 7f9206ffd700 1 --2- 172.21.15.59:0/1718329928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9208136710 0x7f9208138af0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009840 tx=0x7f91fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee5473da1be74fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.672+0000 7f92067fc700 1 -- 172.21.15.59:0/1718329928 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc011830 con 0x7f9208136710 2023-09-30T22:34:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.672+0000 7f92067fc700 1 -- 172.21.15.59:0/1718329928 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc011990 con 0x7f9208136710 2023-09-30T22:34:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.672+0000 7f92067fc700 1 -- 172.21.15.59:0/1718329928 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc011d20 con 0x7f9208136710 2023-09-30T22:34:01.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.673+0000 7f920ddf1700 1 -- 172.21.15.59:0/1718329928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9208136710 msgr2=0x7f9208138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.673+0000 7f920ddf1700 1 --2- 172.21.15.59:0/1718329928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9208136710 0x7f9208138af0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009840 tx=0x7f91fc009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:01.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.673+0000 7f920ddf1700 1 -- 172.21.15.59:0/1718329928 shutdown_connections 2023-09-30T22:34:01.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.673+0000 7f920ddf1700 1 --2- 172.21.15.59:0/1718329928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9208139030 0x7f920813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.673+0000 7f920ddf1700 1 --2- 172.21.15.59:0/1718329928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9208136710 0x7f9208138af0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.673+0000 7f920ddf1700 1 -- 172.21.15.59:0/1718329928 >> 172.21.15.59:0/1718329928 conn(0x7f92080a2aa0 msgr2=0x7f92080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:01.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.673+0000 7f920ddf1700 1 -- 172.21.15.59:0/1718329928 shutdown_connections 2023-09-30T22:34:01.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.673+0000 7f920ddf1700 1 -- 172.21.15.59:0/1718329928 wait complete. 2023-09-30T22:34:01.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.674+0000 7f920ddf1700 1 Processor -- start 2023-09-30T22:34:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.675+0000 7f920ddf1700 1 -- start start 2023-09-30T22:34:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.675+0000 7f920ddf1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92081338a0 0x7f920811b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.675+0000 7f920ddf1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9208136710 0x7f920811bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.675+0000 7f920ddf1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9208139030 0x7f92081c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.675+0000 7f920ddf1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920811d0e0 con 0x7f9208136710 2023-09-30T22:34:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.675+0000 7f920ddf1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920806f6d0 con 0x7f9208139030 2023-09-30T22:34:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.675+0000 7f920ddf1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f920811ec00 con 0x7f92081338a0 2023-09-30T22:34:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.676+0000 7f92077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92081338a0 0x7f920811b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.676+0000 7f9207fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9208139030 0x7f92081c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.676+0000 7f92077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92081338a0 0x7f920811b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59936/0 (socket says 172.21.15.59:59936) 2023-09-30T22:34:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.676+0000 7f9207fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9208139030 0x7f92081c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49660/0 (socket says 172.21.15.59:49660) 2023-09-30T22:34:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.676+0000 7f92077fe700 1 -- 172.21.15.59:0/2947630908 learned_addr learned my addr 172.21.15.59:0/2947630908 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.676+0000 7f9206ffd700 1 --2- 172.21.15.59:0/2947630908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9208136710 0x7f920811bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.676+0000 7f92077fe700 1 -- 172.21.15.59:0/2947630908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9208139030 msgr2=0x7f92081c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.676+0000 7f92077fe700 1 --2- 172.21.15.59:0/2947630908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9208139030 0x7f92081c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.676+0000 7f92077fe700 1 -- 172.21.15.59:0/2947630908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9208136710 msgr2=0x7f920811bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.676+0000 7f92077fe700 1 --2- 172.21.15.59:0/2947630908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9208136710 0x7f920811bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.676+0000 7f92077fe700 1 -- 172.21.15.59:0/2947630908 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc0094a0 con 0x7f92081338a0 2023-09-30T22:34:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.676+0000 7f9207fff700 1 --2- 172.21.15.59:0/2947630908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9208139030 0x7f92081c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:01.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.676+0000 7f92077fe700 1 --2- 172.21.15.59:0/2947630908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92081338a0 0x7f920811b7c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f91f800c580 tx=0x7f91f800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:01.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.677+0000 7f91effff700 1 -- 172.21.15.59:0/2947630908 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8005d70 con 0x7f92081338a0 2023-09-30T22:34:01.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.677+0000 7f91effff700 1 -- 172.21.15.59:0/2947630908 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f80070d0 con 0x7f92081338a0 2023-09-30T22:34:01.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.677+0000 7f91effff700 1 -- 172.21.15.59:0/2947630908 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8007440 con 0x7f92081338a0 2023-09-30T22:34:01.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.677+0000 7f920ddf1700 1 -- 172.21.15.59:0/2947630908 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920811e6e0 con 0x7f92081338a0 2023-09-30T22:34:01.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.677+0000 7f920ddf1700 1 -- 172.21.15.59:0/2947630908 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920811d2a0 con 0x7f92081338a0 2023-09-30T22:34:01.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.678+0000 7f920ddf1700 1 -- 172.21.15.59:0/2947630908 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9208074ea0 con 0x7f92081338a0 2023-09-30T22:34:01.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.678+0000 7f91effff700 1 -- 172.21.15.59:0/2947630908 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91f80075a0 con 0x7f92081338a0 2023-09-30T22:34:01.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.678+0000 7f91effff700 1 -- 172.21.15.59:0/2947630908 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f91f803eb20 con 0x7f92081338a0 2023-09-30T22:34:01.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.688+0000 7f91effff700 1 -- 172.21.15.59:0/2947630908 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91f8019b40 con 0x7f92081338a0 2023-09-30T22:34:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.703+0000 7f7ddf10b700 1 Processor -- start 2023-09-30T22:34:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.703+0000 7f7ddf10b700 1 -- start start 2023-09-30T22:34:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.703+0000 7f7ddf10b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd8133510 0x7f7dd81358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.703+0000 7f7ddf10b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd8135e30 0x7f7dd8138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.703+0000 7f7ddf10b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd8130260 con 0x7f7dd8130670 2023-09-30T22:34:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.703+0000 7f7ddf10b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd809a350 con 0x7f7dd8133510 2023-09-30T22:34:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.703+0000 7f7ddf10b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd8071ff0 con 0x7f7dd8135e30 2023-09-30T22:34:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.704+0000 7f7ddcea7700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7dd8130670 0x7f7dd8130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37154/0 (socket says 172.21.15.59:37154) 2023-09-30T22:34:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.704+0000 7f7ddcea7700 1 -- 172.21.15.59:0/78760473 learned_addr learned my addr 172.21.15.59:0/78760473 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:01.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.704+0000 7f7dd7fff700 1 --2- 172.21.15.59:0/78760473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd8133510 0x7f7dd81358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.704+0000 7f7ddd6a8700 1 --2- 172.21.15.59:0/78760473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd8135e30 0x7f7dd8138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.704+0000 7f7dd77fe700 1 -- 172.21.15.59:0/78760473 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993988543 0 0) 0x7f7dd8130260 con 0x7f7dd8130670 2023-09-30T22:34:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.704+0000 7f7dd77fe700 1 -- 172.21.15.59:0/78760473 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc80057c0 con 0x7f7dd8130670 2023-09-30T22:34:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.704+0000 7f7dd7fff700 1 -- 172.21.15.59:0/78760473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd8135e30 msgr2=0x7f7dd8138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.704+0000 7f7dd7fff700 1 --2- 172.21.15.59:0/78760473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd8135e30 0x7f7dd8138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.704+0000 7f7dd7fff700 1 -- 172.21.15.59:0/78760473 >> v1:172.21.15.59:6789/0 conn(0x7f7dd8130670 legacy=0x7f7dd8130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.704+0000 7f7dd7fff700 1 -- 172.21.15.59:0/78760473 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd809ecf0 con 0x7f7dd8133510 2023-09-30T22:34:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.704+0000 7f7dd7fff700 1 --2- 172.21.15.59:0/78760473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd8133510 0x7f7dd81358f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009870 tx=0x7f7dc4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c237361e64b30e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.705+0000 7f7dd77fe700 1 -- 172.21.15.59:0/78760473 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4011830 con 0x7f7dd8133510 2023-09-30T22:34:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.705+0000 7f7dd77fe700 1 -- 172.21.15.59:0/78760473 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc4011990 con 0x7f7dd8133510 2023-09-30T22:34:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.705+0000 7f7dd77fe700 1 -- 172.21.15.59:0/78760473 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4011d20 con 0x7f7dd8133510 2023-09-30T22:34:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.705+0000 7f7ddf10b700 1 -- 172.21.15.59:0/78760473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd8133510 msgr2=0x7f7dd81358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.705+0000 7f7ddf10b700 1 --2- 172.21.15.59:0/78760473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd8133510 0x7f7dd81358f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009870 tx=0x7f7dc4009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.706+0000 7f7ddf10b700 1 -- 172.21.15.59:0/78760473 shutdown_connections 2023-09-30T22:34:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.706+0000 7f7ddf10b700 1 --2- 172.21.15.59:0/78760473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd8135e30 0x7f7dd8138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.706+0000 7f7ddf10b700 1 --2- 172.21.15.59:0/78760473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd8133510 0x7f7dd81358f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.706+0000 7f7ddf10b700 1 -- 172.21.15.59:0/78760473 >> 172.21.15.59:0/78760473 conn(0x7f7dd80a2aa0 msgr2=0x7f7dd80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.706+0000 7f7ddf10b700 1 -- 172.21.15.59:0/78760473 shutdown_connections 2023-09-30T22:34:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.706+0000 7f7ddf10b700 1 -- 172.21.15.59:0/78760473 wait complete. 2023-09-30T22:34:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.707+0000 7f7ddf10b700 1 Processor -- start 2023-09-30T22:34:01.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.707+0000 7f7ddf10b700 1 -- start start 2023-09-30T22:34:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.707+0000 7f7ddf10b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd8130670 0x7f7dd809d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.707+0000 7f7ddf10b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd8133510 0x7f7dd809d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.707+0000 7f7ddf10b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd8135e30 0x7f7dd81c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.707+0000 7f7ddf10b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd811ea70 con 0x7f7dd8130670 2023-09-30T22:34:01.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.707+0000 7f7ddf10b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd811d630 con 0x7f7dd8135e30 2023-09-30T22:34:01.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.707+0000 7f7ddf10b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd812ddb0 con 0x7f7dd8133510 2023-09-30T22:34:01.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.708+0000 7f7dd7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd8133510 0x7f7dd809d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.708+0000 7f7dd7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd8133510 0x7f7dd809d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59966/0 (socket says 172.21.15.59:59966) 2023-09-30T22:34:01.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.708+0000 7f7ddd6a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd8135e30 0x7f7dd81c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.708+0000 7f7dd7fff700 1 -- 172.21.15.59:0/1764786814 learned_addr learned my addr 172.21.15.59:0/1764786814 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:01.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.708+0000 7f7ddcea7700 1 --2- 172.21.15.59:0/1764786814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd8130670 0x7f7dd809d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.708+0000 7f7dd7fff700 1 -- 172.21.15.59:0/1764786814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd8135e30 msgr2=0x7f7dd81c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.708+0000 7f7dd7fff700 1 --2- 172.21.15.59:0/1764786814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd8135e30 0x7f7dd81c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.708+0000 7f7dd7fff700 1 -- 172.21.15.59:0/1764786814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd8130670 msgr2=0x7f7dd809d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.708+0000 7f7dd7fff700 1 --2- 172.21.15.59:0/1764786814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd8130670 0x7f7dd809d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.708+0000 7f7dd7fff700 1 -- 172.21.15.59:0/1764786814 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc40094a0 con 0x7f7dd8133510 2023-09-30T22:34:01.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.708+0000 7f7ddd6a8700 1 --2- 172.21.15.59:0/1764786814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd8135e30 0x7f7dd81c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:01.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.708+0000 7f7dd7fff700 1 --2- 172.21.15.59:0/1764786814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd8133510 0x7f7dd809d710 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009840 tx=0x7f7dc4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:01.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.709+0000 7f7dd57fa700 1 -- 172.21.15.59:0/1764786814 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4004510 con 0x7f7dd8133510 2023-09-30T22:34:01.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.709+0000 7f7dd57fa700 1 -- 172.21.15.59:0/1764786814 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc401f070 con 0x7f7dd8133510 2023-09-30T22:34:01.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.709+0000 7f7dd57fa700 1 -- 172.21.15.59:0/1764786814 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40038e0 con 0x7f7dd8133510 2023-09-30T22:34:01.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.709+0000 7f7ddf10b700 1 -- 172.21.15.59:0/1764786814 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd811ec50 con 0x7f7dd8133510 2023-09-30T22:34:01.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.709+0000 7f7ddf10b700 1 -- 172.21.15.59:0/1764786814 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd8135900 con 0x7f7dd8133510 2023-09-30T22:34:01.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.710+0000 7f7ddf10b700 1 -- 172.21.15.59:0/1764786814 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd811d2f0 con 0x7f7dd8133510 2023-09-30T22:34:01.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.711+0000 7f7dd57fa700 1 -- 172.21.15.59:0/1764786814 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7dc4003a40 con 0x7f7dd8133510 2023-09-30T22:34:01.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.711+0000 7f7dd57fa700 1 -- 172.21.15.59:0/1764786814 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7dc4021070 con 0x7f7dd8133510 2023-09-30T22:34:01.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.720+0000 7f7dd57fa700 1 -- 172.21.15.59:0/1764786814 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7dc4010380 con 0x7f7dd8133510 2023-09-30T22:34:01.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.743+0000 7f7cd5bee700 1 Processor -- start 2023-09-30T22:34:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.744+0000 7f7cd5bee700 1 -- start start 2023-09-30T22:34:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.744+0000 7f7cd5bee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7cd009f410 0x7f7cd0136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.744+0000 7f7cd5bee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd0136fe0 0x7f7cd01393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.744+0000 7f7cd5bee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd0070940 con 0x7f7cd009e930 2023-09-30T22:34:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.744+0000 7f7cd5bee700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd006fd60 con 0x7f7cd009f410 2023-09-30T22:34:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.744+0000 7f7cd5bee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd006fa80 con 0x7f7cd0136fe0 2023-09-30T22:34:01.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.744+0000 7f7cceffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7cd009f410 0x7f7cd0136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.744+0000 7f7cceffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7cd009f410 0x7f7cd0136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35936/0 (socket says 172.21.15.59:35936) 2023-09-30T22:34:01.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.744+0000 7f7cceffd700 1 -- 172.21.15.59:0/2610082139 learned_addr learned my addr 172.21.15.59:0/2610082139 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:01.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.745+0000 7f7cceffd700 1 -- 172.21.15.59:0/2610082139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd0136fe0 msgr2=0x7f7cd01393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:01.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.745+0000 7f7ccffff700 1 --2- 172.21.15.59:0/2610082139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd0136fe0 0x7f7cd01393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.745+0000 7f7cceffd700 1 --2- 172.21.15.59:0/2610082139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd0136fe0 0x7f7cd01393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.745+0000 7f7cceffd700 1 -- 172.21.15.59:0/2610082139 >> v1:172.21.15.59:6789/0 conn(0x7f7cd009e930 legacy=0x7f7cd009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.745+0000 7f7cceffd700 1 -- 172.21.15.59:0/2610082139 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd009fb60 con 0x7f7cd009f410 2023-09-30T22:34:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.745+0000 7f7ccffff700 1 --2- 172.21.15.59:0/2610082139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd0136fe0 0x7f7cd01393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:34:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.745+0000 7f7cceffd700 1 --2- 172.21.15.59:0/2610082139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd009f410 0x7f7cd0136aa0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40098f0 tx=0x7f7cc4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535d0c1cb619b37e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.745+0000 7f7cce7fc700 1 -- 172.21.15.59:0/2610082139 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc400b8a0 con 0x7f7cd009f410 2023-09-30T22:34:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.745+0000 7f7cce7fc700 1 -- 172.21.15.59:0/2610082139 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc400ba00 con 0x7f7cd009f410 2023-09-30T22:34:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.745+0000 7f7cce7fc700 1 -- 172.21.15.59:0/2610082139 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc400bd90 con 0x7f7cd009f410 2023-09-30T22:34:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.746+0000 7f7cd5bee700 1 -- 172.21.15.59:0/2610082139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd009f410 msgr2=0x7f7cd0136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.746+0000 7f7cd5bee700 1 --2- 172.21.15.59:0/2610082139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd009f410 0x7f7cd0136aa0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40098f0 tx=0x7f7cc4009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.746+0000 7f7cd5bee700 1 -- 172.21.15.59:0/2610082139 shutdown_connections 2023-09-30T22:34:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.746+0000 7f7cd5bee700 1 --2- 172.21.15.59:0/2610082139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd0136fe0 0x7f7cd01393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.746+0000 7f7cd5bee700 1 --2- 172.21.15.59:0/2610082139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd009f410 0x7f7cd0136aa0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.746+0000 7f7cd5bee700 1 -- 172.21.15.59:0/2610082139 >> 172.21.15.59:0/2610082139 conn(0x7f7cd00a4210 msgr2=0x7f7cd00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.746+0000 7f7cd5bee700 1 -- 172.21.15.59:0/2610082139 shutdown_connections 2023-09-30T22:34:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.746+0000 7f7cd5bee700 1 -- 172.21.15.59:0/2610082139 wait complete. 2023-09-30T22:34:01.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.747+0000 7f7cd5bee700 1 Processor -- start 2023-09-30T22:34:01.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.748+0000 7f7cd5bee700 1 -- start start 2023-09-30T22:34:01.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.748+0000 7f7cd5bee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cd009e930 0x7f7cd011e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.748+0000 7f7cd5bee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd009f410 0x7f7cd011eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.748+0000 7f7cd5bee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd0136fe0 0x7f7cd011f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:01.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.748+0000 7f7cd5bee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd0121ed0 con 0x7f7cd009f410 2023-09-30T22:34:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.748+0000 7f7cd5bee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd01220b0 con 0x7f7cd0136fe0 2023-09-30T22:34:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.748+0000 7f7cd5bee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd00a2f40 con 0x7f7cd009e930 2023-09-30T22:34:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.748+0000 7f7cceffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd009f410 0x7f7cd011eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.748+0000 7f7cceffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd009f410 0x7f7cd011eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35948/0 (socket says 172.21.15.59:35948) 2023-09-30T22:34:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.748+0000 7f7cceffd700 1 -- 172.21.15.59:0/1617991187 learned_addr learned my addr 172.21.15.59:0/1617991187 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.748+0000 7f7ccf7fe700 1 --2- 172.21.15.59:0/1617991187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cd009e930 0x7f7cd011e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.748+0000 7f7ccffff700 1 --2- 172.21.15.59:0/1617991187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd0136fe0 0x7f7cd011f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.749+0000 7f7cceffd700 1 -- 172.21.15.59:0/1617991187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cd009e930 msgr2=0x7f7cd011e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.749+0000 7f7cceffd700 1 --2- 172.21.15.59:0/1617991187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cd009e930 0x7f7cd011e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.749+0000 7f7cceffd700 1 -- 172.21.15.59:0/1617991187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd0136fe0 msgr2=0x7f7cd011f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.749+0000 7f7cceffd700 1 --2- 172.21.15.59:0/1617991187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd0136fe0 0x7f7cd011f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.749+0000 7f7cceffd700 1 -- 172.21.15.59:0/1617991187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc4009550 con 0x7f7cd009f410 2023-09-30T22:34:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.749+0000 7f7cceffd700 1 --2- 172.21.15.59:0/1617991187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd009f410 0x7f7cd011eb10 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4000c00 tx=0x7f7cc4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.749+0000 7f7cb7fff700 1 -- 172.21.15.59:0/1617991187 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4004480 con 0x7f7cd009f410 2023-09-30T22:34:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.749+0000 7f7cb7fff700 1 -- 172.21.15.59:0/1617991187 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc401f070 con 0x7f7cd009f410 2023-09-30T22:34:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.749+0000 7f7cd5bee700 1 -- 172.21.15.59:0/1617991187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd01202b0 con 0x7f7cd009f410 2023-09-30T22:34:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.749+0000 7f7cb7fff700 1 -- 172.21.15.59:0/1617991187 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc40038a0 con 0x7f7cd009f410 2023-09-30T22:34:01.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.749+0000 7f7cd5bee700 1 -- 172.21.15.59:0/1617991187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd0071ce0 con 0x7f7cd009f410 2023-09-30T22:34:01.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.750+0000 7f7cd5bee700 1 -- 172.21.15.59:0/1617991187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd0121d30 con 0x7f7cd009f410 2023-09-30T22:34:01.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.751+0000 7f7cb7fff700 1 -- 172.21.15.59:0/1617991187 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7cc4021030 con 0x7f7cd009f410 2023-09-30T22:34:01.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.751+0000 7f7cb7fff700 1 -- 172.21.15.59:0/1617991187 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7cc4023cd0 con 0x7f7cd009f410 2023-09-30T22:34:01.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.760+0000 7f7cb7fff700 1 -- 172.21.15.59:0/1617991187 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7cd0121d30 con 0x7f7cd009f410 2023-09-30T22:34:01.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.878+0000 7f45fc3d5700 1 -- 172.21.15.59:0/2582571803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f45f409fff0 con 0x7f45f409f240 2023-09-30T22:34:01.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.879+0000 7f45eaffd700 1 -- 172.21.15.59:0/2582571803 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45f409fff0 con 0x7f45f409f240 2023-09-30T22:34:01.880 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.881+0000 7f45fc3d5700 1 -- 172.21.15.59:0/2582571803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f409f240 msgr2=0x7f45f406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.881+0000 7f45fc3d5700 1 --2- 172.21.15.59:0/2582571803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f409f240 0x7f45f406bdf0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f45e400c520 tx=0x7f45e400c8e0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.881+0000 7f45fc3d5700 1 -- 172.21.15.59:0/2582571803 shutdown_connections 2023-09-30T22:34:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.881+0000 7f45fc3d5700 1 --2- 172.21.15.59:0/2582571803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45f409e930 0x7f45f406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.881+0000 7f45fc3d5700 1 --2- 172.21.15.59:0/2582571803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f409f650 0x7f45f406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.881+0000 7f45fc3d5700 1 --2- 172.21.15.59:0/2582571803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f409f240 0x7f45f406bdf0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.881+0000 7f45fc3d5700 1 -- 172.21.15.59:0/2582571803 >> 172.21.15.59:0/2582571803 conn(0x7f45f40a4210 msgr2=0x7f45f41b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.881+0000 7f45fc3d5700 1 -- 172.21.15.59:0/2582571803 shutdown_connections 2023-09-30T22:34:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.881+0000 7f45fc3d5700 1 -- 172.21.15.59:0/2582571803 wait complete. 2023-09-30T22:34:01.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:01.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.910+0000 7f920ddf1700 1 -- 172.21.15.59:0/2947630908 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f920811cab0 con 0x7f92081338a0 2023-09-30T22:34:01.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.911+0000 7f91effff700 1 -- 172.21.15.59:0/2947630908 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91f8017030 con 0x7f92081338a0 2023-09-30T22:34:01.912 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.913+0000 7f920ddf1700 1 -- 172.21.15.59:0/2947630908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92081338a0 msgr2=0x7f920811b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.913+0000 7f920ddf1700 1 --2- 172.21.15.59:0/2947630908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92081338a0 0x7f920811b7c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f91f800c580 tx=0x7f91f800c890 comp rx=0 tx=0).stop 2023-09-30T22:34:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.913+0000 7f920ddf1700 1 -- 172.21.15.59:0/2947630908 shutdown_connections 2023-09-30T22:34:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.913+0000 7f920ddf1700 1 --2- 172.21.15.59:0/2947630908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92081338a0 0x7f920811b7c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.913+0000 7f920ddf1700 1 --2- 172.21.15.59:0/2947630908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9208139030 0x7f92081c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.913+0000 7f920ddf1700 1 --2- 172.21.15.59:0/2947630908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9208136710 0x7f920811bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.913+0000 7f920ddf1700 1 -- 172.21.15.59:0/2947630908 >> 172.21.15.59:0/2947630908 conn(0x7f92080a2aa0 msgr2=0x7f92081344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.913+0000 7f920ddf1700 1 -- 172.21.15.59:0/2947630908 shutdown_connections 2023-09-30T22:34:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.913+0000 7f920ddf1700 1 -- 172.21.15.59:0/2947630908 wait complete. 2023-09-30T22:34:01.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:01.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.933+0000 7f7ddf10b700 1 -- 172.21.15.59:0/1764786814 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7dd8071820 con 0x7f7dd8133510 2023-09-30T22:34:01.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.933+0000 7f7dd57fa700 1 -- 172.21.15.59:0/1764786814 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7dc402b020 con 0x7f7dd8133510 2023-09-30T22:34:01.934 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.935+0000 7f7ddf10b700 1 -- 172.21.15.59:0/1764786814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd8133510 msgr2=0x7f7dd809d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.935+0000 7f7ddf10b700 1 --2- 172.21.15.59:0/1764786814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd8133510 0x7f7dd809d710 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009840 tx=0x7f7dc4004750 comp rx=0 tx=0).stop 2023-09-30T22:34:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.936+0000 7f7ddf10b700 1 -- 172.21.15.59:0/1764786814 shutdown_connections 2023-09-30T22:34:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.936+0000 7f7ddf10b700 1 --2- 172.21.15.59:0/1764786814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd8135e30 0x7f7dd81c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.936+0000 7f7ddf10b700 1 --2- 172.21.15.59:0/1764786814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd8130670 0x7f7dd809d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.936+0000 7f7ddf10b700 1 --2- 172.21.15.59:0/1764786814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd8133510 0x7f7dd809d710 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.936+0000 7f7ddf10b700 1 -- 172.21.15.59:0/1764786814 >> 172.21.15.59:0/1764786814 conn(0x7f7dd80a2aa0 msgr2=0x7f7dd8132390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.936+0000 7f7ddf10b700 1 -- 172.21.15.59:0/1764786814 shutdown_connections 2023-09-30T22:34:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.936+0000 7f7ddf10b700 1 -- 172.21.15.59:0/1764786814 wait complete. 2023-09-30T22:34:01.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:01.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.972+0000 7f7cd5bee700 1 -- 172.21.15.59:0/1617991187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7cd0121d30 con 0x7f7cd009f410 2023-09-30T22:34:01.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.973+0000 7f7cb7fff700 1 -- 172.21.15.59:0/1617991187 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7cd0121d30 con 0x7f7cd009f410 2023-09-30T22:34:01.974 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.975+0000 7f7cd5bee700 1 -- 172.21.15.59:0/1617991187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd009f410 msgr2=0x7f7cd011eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.975+0000 7f7cd5bee700 1 --2- 172.21.15.59:0/1617991187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd009f410 0x7f7cd011eb10 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4000c00 tx=0x7f7cc4004750 comp rx=0 tx=0).stop 2023-09-30T22:34:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.975+0000 7f7cd5bee700 1 -- 172.21.15.59:0/1617991187 shutdown_connections 2023-09-30T22:34:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.975+0000 7f7cd5bee700 1 --2- 172.21.15.59:0/1617991187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cd009e930 0x7f7cd011e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.975+0000 7f7cd5bee700 1 --2- 172.21.15.59:0/1617991187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd0136fe0 0x7f7cd011f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.975+0000 7f7cd5bee700 1 --2- 172.21.15.59:0/1617991187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd009f410 0x7f7cd011eb10 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.975+0000 7f7cd5bee700 1 -- 172.21.15.59:0/1617991187 >> 172.21.15.59:0/1617991187 conn(0x7f7cd00a4210 msgr2=0x7f7cd00a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.975+0000 7f7cd5bee700 1 -- 172.21.15.59:0/1617991187 shutdown_connections 2023-09-30T22:34:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:01.975+0000 7f7cd5bee700 1 -- 172.21.15.59:0/1617991187 wait complete. 2023-09-30T22:34:01.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:02.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:03.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:03.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:03.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:03.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.173+0000 7fbae3826700 1 Processor -- start 2023-09-30T22:34:03.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.173+0000 7ff4936ca700 1 Processor -- start 2023-09-30T22:34:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.173+0000 7fbae3826700 1 -- start start 2023-09-30T22:34:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7fbae3826700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbadc09d6f0 0x7fbadc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7fbae3826700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbadc09e000 0x7fbadc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.173+0000 7ff4936ca700 1 -- start start 2023-09-30T22:34:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7ff4936ca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c06e570 0x7ff48c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7ff4936ca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff48c09eca0 0x7ff48c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7ff4936ca700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48c070ee0 con 0x7ff48c134610 2023-09-30T22:34:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7ff4936ca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c071480 con 0x7ff48c06e570 2023-09-30T22:34:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7ff4936ca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c06f3c0 con 0x7ff48c09eca0 2023-09-30T22:34:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7fbae3826700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbadc09f130 con 0x7fbadc09e410 2023-09-30T22:34:03.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7fbae3826700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbadc09f520 con 0x7fbadc09e000 2023-09-30T22:34:03.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7fbae3826700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc09e930 con 0x7fbadc09d6f0 2023-09-30T22:34:03.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7fbae0dc1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbadc09e000 0x7fbadc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7fbae0dc1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbadc09e000 0x7fbadc130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35956/0 (socket says 172.21.15.59:35956) 2023-09-30T22:34:03.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7fbae0dc1700 1 -- 172.21.15.59:0/2076396578 learned_addr learned my addr 172.21.15.59:0/2076396578 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:03.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7ff491c67700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff48c134610 0x7ff48c134ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37170/0 (socket says 172.21.15.59:37170) 2023-09-30T22:34:03.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7ff491c67700 1 -- 172.21.15.59:0/2634435267 learned_addr learned my addr 172.21.15.59:0/2634435267 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:03.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7fbae15c2700 1 --2- 172.21.15.59:0/2076396578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbadc09d6f0 0x7fbadc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.174+0000 7ff491466700 1 --2- 172.21.15.59:0/2634435267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c06e570 0x7ff48c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.175+0000 7ff490c65700 1 --2- 172.21.15.59:0/2634435267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff48c09eca0 0x7ff48c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.175+0000 7fbae0dc1700 1 -- 172.21.15.59:0/2076396578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbadc09d6f0 msgr2=0x7fbadc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:03.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.175+0000 7fbae0dc1700 1 --2- 172.21.15.59:0/2076396578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbadc09d6f0 0x7fbadc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.175+0000 7fbae0dc1700 1 -- 172.21.15.59:0/2076396578 >> v1:172.21.15.59:6789/0 conn(0x7fbadc09e410 legacy=0x7fbadc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.175+0000 7fbae0dc1700 1 -- 172.21.15.59:0/2076396578 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbadc09b2d0 con 0x7fbadc09e000 2023-09-30T22:34:03.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.175+0000 7ff490c65700 1 -- 172.21.15.59:0/2634435267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c06e570 msgr2=0x7ff48c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:03.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.175+0000 7ff490c65700 1 --2- 172.21.15.59:0/2634435267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c06e570 0x7ff48c06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.175+0000 7ff490c65700 1 -- 172.21.15.59:0/2634435267 >> v1:172.21.15.59:6789/0 conn(0x7ff48c134610 legacy=0x7ff48c134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.175+0000 7ff490c65700 1 -- 172.21.15.59:0/2634435267 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c071b90 con 0x7ff48c09eca0 2023-09-30T22:34:03.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.175+0000 7ff490c65700 1 --2- 172.21.15.59:0/2634435267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff48c09eca0 0x7ff48c06ee80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff47c009870 tx=0x7ff47c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53a67fbfe18189e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:03.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.175+0000 7fbae0dc1700 1 --2- 172.21.15.59:0/2076396578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbadc09e000 0x7fbadc130660 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00de50 tx=0x7fbacc00f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2450720dac53b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:03.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.175+0000 7ff483fff700 1 -- 172.21.15.59:0/2634435267 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c011830 con 0x7ff48c09eca0 2023-09-30T22:34:03.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.176+0000 7ff483fff700 1 -- 172.21.15.59:0/2634435267 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c011990 con 0x7ff48c09eca0 2023-09-30T22:34:03.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.176+0000 7ff483fff700 1 -- 172.21.15.59:0/2634435267 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c011d20 con 0x7ff48c09eca0 2023-09-30T22:34:03.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.176+0000 7fbad3fff700 1 -- 172.21.15.59:0/2076396578 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc012070 con 0x7fbadc09e000 2023-09-30T22:34:03.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.176+0000 7fbad3fff700 1 -- 172.21.15.59:0/2076396578 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc00f910 con 0x7fbadc09e000 2023-09-30T22:34:03.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.176+0000 7fbad3fff700 1 -- 172.21.15.59:0/2076396578 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc00fcc0 con 0x7fbadc09e000 2023-09-30T22:34:03.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.176+0000 7ff4936ca700 1 -- 172.21.15.59:0/2634435267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff48c09eca0 msgr2=0x7ff48c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.176+0000 7ff4936ca700 1 --2- 172.21.15.59:0/2634435267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff48c09eca0 0x7ff48c06ee80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff47c009870 tx=0x7ff47c009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:03.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.176+0000 7fbae3826700 1 -- 172.21.15.59:0/2076396578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbadc09e000 msgr2=0x7fbadc130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.176+0000 7fbae3826700 1 --2- 172.21.15.59:0/2076396578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbadc09e000 0x7fbadc130660 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00de50 tx=0x7fbacc00f330 comp rx=0 tx=0).stop 2023-09-30T22:34:03.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.176+0000 7ff4936ca700 1 -- 172.21.15.59:0/2634435267 shutdown_connections 2023-09-30T22:34:03.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.176+0000 7ff4936ca700 1 --2- 172.21.15.59:0/2634435267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c06e570 0x7ff48c06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.176+0000 7ff4936ca700 1 --2- 172.21.15.59:0/2634435267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff48c09eca0 0x7ff48c06ee80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.177+0000 7ff4936ca700 1 -- 172.21.15.59:0/2634435267 >> 172.21.15.59:0/2634435267 conn(0x7ff48c0a2aa0 msgr2=0x7ff48c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.177+0000 7fbae3826700 1 -- 172.21.15.59:0/2076396578 shutdown_connections 2023-09-30T22:34:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.177+0000 7fbae3826700 1 --2- 172.21.15.59:0/2076396578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbadc09d6f0 0x7fbadc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.177+0000 7fbae3826700 1 --2- 172.21.15.59:0/2076396578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbadc09e000 0x7fbadc130660 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.177+0000 7fbae3826700 1 -- 172.21.15.59:0/2076396578 >> 172.21.15.59:0/2076396578 conn(0x7fbadc066f50 msgr2=0x7fbadc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.177+0000 7ff4936ca700 1 -- 172.21.15.59:0/2634435267 shutdown_connections 2023-09-30T22:34:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.177+0000 7ff4936ca700 1 -- 172.21.15.59:0/2634435267 wait complete. 2023-09-30T22:34:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.177+0000 7fbae3826700 1 -- 172.21.15.59:0/2076396578 shutdown_connections 2023-09-30T22:34:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.177+0000 7fbae3826700 1 -- 172.21.15.59:0/2076396578 wait complete. 2023-09-30T22:34:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.178+0000 7fbae3826700 1 Processor -- start 2023-09-30T22:34:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.178+0000 7fbae3826700 1 -- start start 2023-09-30T22:34:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.178+0000 7ff4936ca700 1 Processor -- start 2023-09-30T22:34:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.178+0000 7ff4936ca700 1 -- start start 2023-09-30T22:34:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.178+0000 7fbae3826700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbadc09d6f0 0x7fbadc11dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.178+0000 7fbae3826700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbadc09e000 0x7fbadc11e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.178+0000 7fbae3826700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbadc09e410 0x7fbadc11ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.178+0000 7fbae3826700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc11f4b0 con 0x7fbadc09e000 2023-09-30T22:34:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.178+0000 7fbae3826700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc1303c0 con 0x7fbadc09d6f0 2023-09-30T22:34:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.178+0000 7fbae3826700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc120210 con 0x7fbadc09e410 2023-09-30T22:34:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7fbae0dc1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbadc09e000 0x7fbadc11e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7fbae0dc1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbadc09e000 0x7fbadc11e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35970/0 (socket says 172.21.15.59:35970) 2023-09-30T22:34:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7fbae15c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbadc09d6f0 0x7fbadc11dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7fbae0dc1700 1 -- 172.21.15.59:0/1940833629 learned_addr learned my addr 172.21.15.59:0/1940833629 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7ff4936ca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48c06e570 0x7ff48c1401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7ff4936ca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c134610 0x7ff48c133080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7ff4936ca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff48c1335c0 0x7ff48c133a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7ff4936ca700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c070680 con 0x7ff48c06e570 2023-09-30T22:34:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7ff4936ca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c13e6b0 con 0x7ff48c134610 2023-09-30T22:34:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7ff4936ca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c134440 con 0x7ff48c1335c0 2023-09-30T22:34:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7ff491c67700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff48c1335c0 0x7ff48c133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7ff491c67700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff48c1335c0 0x7ff48c133a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59996/0 (socket says 172.21.15.59:59996) 2023-09-30T22:34:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7ff491c67700 1 -- 172.21.15.59:0/2507058664 learned_addr learned my addr 172.21.15.59:0/2507058664 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7fbae0dc1700 1 -- 172.21.15.59:0/1940833629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbadc09e410 msgr2=0x7fbadc11ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7fbae0dc1700 1 --2- 172.21.15.59:0/1940833629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbadc09e410 0x7fbadc11ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7fbae0dc1700 1 -- 172.21.15.59:0/1940833629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbadc09d6f0 msgr2=0x7fbadc11dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7fbae0dc1700 1 --2- 172.21.15.59:0/1940833629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbadc09d6f0 0x7fbadc11dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7fbae0dc1700 1 -- 172.21.15.59:0/1940833629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc00db30 con 0x7fbadc09e000 2023-09-30T22:34:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7fbae15c2700 1 --2- 172.21.15.59:0/1940833629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbadc09d6f0 0x7fbadc11dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.179+0000 7ff490c65700 1 --2- 172.21.15.59:0/2507058664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c134610 0x7ff48c133080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7fbae0dc1700 1 --2- 172.21.15.59:0/1940833629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbadc09e000 0x7fbadc11e520 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fbacc016000 tx=0x7fbacc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7ff491466700 1 --2- 172.21.15.59:0/2507058664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48c06e570 0x7ff48c1401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7ff491c67700 1 -- 172.21.15.59:0/2507058664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c134610 msgr2=0x7ff48c133080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7ff491c67700 1 --2- 172.21.15.59:0/2507058664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c134610 0x7ff48c133080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7ff491c67700 1 -- 172.21.15.59:0/2507058664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48c06e570 msgr2=0x7ff48c1401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7ff491c67700 1 --2- 172.21.15.59:0/2507058664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48c06e570 0x7ff48c1401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7ff491c67700 1 -- 172.21.15.59:0/2507058664 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c0094a0 con 0x7ff48c1335c0 2023-09-30T22:34:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7ff491466700 1 --2- 172.21.15.59:0/2507058664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48c06e570 0x7ff48c1401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:34:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7ff491c67700 1 --2- 172.21.15.59:0/2507058664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff48c1335c0 0x7ff48c133a20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff48400cbf0 tx=0x7ff48400cf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7fbad1ffb700 1 -- 172.21.15.59:0/1940833629 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc003ab0 con 0x7fbadc09e000 2023-09-30T22:34:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7fbad1ffb700 1 -- 172.21.15.59:0/1940833629 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc003c30 con 0x7fbadc09e000 2023-09-30T22:34:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7fbad1ffb700 1 -- 172.21.15.59:0/1940833629 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc020440 con 0x7fbadc09e000 2023-09-30T22:34:03.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7ff481ffb700 1 -- 172.21.15.59:0/2507058664 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48400ab10 con 0x7ff48c1335c0 2023-09-30T22:34:03.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7fbae3826700 1 -- 172.21.15.59:0/1940833629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbadc120e40 con 0x7fbadc09e000 2023-09-30T22:34:03.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7ff4936ca700 1 -- 172.21.15.59:0/2507058664 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48c13d790 con 0x7ff48c1335c0 2023-09-30T22:34:03.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.181+0000 7fbae3826700 1 -- 172.21.15.59:0/1940833629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbadc0a1d90 con 0x7fbadc09e000 2023-09-30T22:34:03.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.181+0000 7ff4936ca700 1 -- 172.21.15.59:0/2507058664 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48c13c070 con 0x7ff48c1335c0 2023-09-30T22:34:03.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.180+0000 7ff481ffb700 1 -- 172.21.15.59:0/2507058664 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48400ac70 con 0x7ff48c1335c0 2023-09-30T22:34:03.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.181+0000 7ff481ffb700 1 -- 172.21.15.59:0/2507058664 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff484012400 con 0x7ff48c1335c0 2023-09-30T22:34:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.181+0000 7ff481ffb700 1 -- 172.21.15.59:0/2507058664 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff48401b3b0 con 0x7ff48c1335c0 2023-09-30T22:34:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.182+0000 7ff481ffb700 1 -- 172.21.15.59:0/2507058664 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff48403f160 con 0x7ff48c1335c0 2023-09-30T22:34:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.182+0000 7ff4936ca700 1 -- 172.21.15.59:0/2507058664 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46c0052e0 con 0x7ff48c1335c0 2023-09-30T22:34:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.183+0000 7fbad1ffb700 1 -- 172.21.15.59:0/1940833629 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbacc0205a0 con 0x7fbadc09e000 2023-09-30T22:34:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.183+0000 7fbae3826700 1 -- 172.21.15.59:0/1940833629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbadc074ea0 con 0x7fbadc09e000 2023-09-30T22:34:03.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.183+0000 7fbad1ffb700 1 -- 172.21.15.59:0/1940833629 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbacc045410 con 0x7fbadc09e000 2023-09-30T22:34:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.185+0000 7f4a03b17700 1 Processor -- start 2023-09-30T22:34:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.186+0000 7f4a03b17700 1 -- start start 2023-09-30T22:34:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.186+0000 7f4a03b17700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc1338a0 0x7f49fc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.186+0000 7f4a03b17700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49fc09de50 0x7f49fc09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.186+0000 7f4a03b17700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49fc06ef30 con 0x7f49fc09e760 2023-09-30T22:34:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.186+0000 7f4a03b17700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49fc06fef0 con 0x7f49fc09de50 2023-09-30T22:34:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.186+0000 7f4a018b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc1338a0 0x7f49fc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.186+0000 7f4a010b2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49fc09de50 0x7f49fc09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.186+0000 7f4a018b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc1338a0 0x7f49fc133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49738/0 (socket says 172.21.15.59:49738) 2023-09-30T22:34:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.186+0000 7f4a018b3700 1 -- 172.21.15.59:0/3188945144 learned_addr learned my addr 172.21.15.59:0/3188945144 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.186+0000 7f4a03b17700 1 -- 172.21.15.59:0/3188945144 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc1334b0 con 0x7f49fc1338a0 2023-09-30T22:34:03.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.186+0000 7fd5a9411700 1 Processor -- start 2023-09-30T22:34:03.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.186+0000 7fd5a9411700 1 -- start start 2023-09-30T22:34:03.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.187+0000 7f4a018b3700 1 -- 172.21.15.59:0/3188945144 >> v2:172.21.15.59:3300/0 conn(0x7f49fc09de50 msgr2=0x7f49fc09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:03.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.187+0000 7f4a018b3700 1 --2- 172.21.15.59:0/3188945144 >> v2:172.21.15.59:3300/0 conn(0x7f49fc09de50 0x7f49fc09e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.187+0000 7f4a018b3700 1 -- 172.21.15.59:0/3188945144 >> v1:172.21.15.59:6789/0 conn(0x7f49fc09e760 legacy=0x7f49fc13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.187+0000 7f4a018b3700 1 -- 172.21.15.59:0/3188945144 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc06fc30 con 0x7f49fc1338a0 2023-09-30T22:34:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.187+0000 7f4a018b3700 1 --2- 172.21.15.59:0/3188945144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc1338a0 0x7f49fc133c70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f49f80098f0 tx=0x7f49f8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b9b562837fe61a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.187+0000 7fd5a9411700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a406a770 0x7fd5a406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.187+0000 7fd5a9411700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a406b080 0x7fd5a4131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.187+0000 7fd5a9411700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd5a4131b40 0x7fd5a4131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.187+0000 7fd5a9411700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a409ece0 con 0x7fd5a4131b40 2023-09-30T22:34:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.187+0000 7fd5a9411700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a409e760 con 0x7fd5a406b080 2023-09-30T22:34:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.187+0000 7fd5a9411700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a409e040 con 0x7fd5a406a770 2023-09-30T22:34:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.187+0000 7f4a008b1700 1 -- 172.21.15.59:0/3188945144 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f8011830 con 0x7f49fc1338a0 2023-09-30T22:34:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.187+0000 7f4a008b1700 1 -- 172.21.15.59:0/3188945144 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f8011990 con 0x7f49fc1338a0 2023-09-30T22:34:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.187+0000 7f4a008b1700 1 -- 172.21.15.59:0/3188945144 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f8011d20 con 0x7f49fc1338a0 2023-09-30T22:34:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7fd5a27fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a406b080 0x7fd5a4131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7fd5a27fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a406b080 0x7fd5a4131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49740/0 (socket says 172.21.15.59:49740) 2023-09-30T22:34:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7fd5a27fc700 1 -- 172.21.15.59:0/2474838765 learned_addr learned my addr 172.21.15.59:0/2474838765 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7fd5a2ffd700 1 --2- 172.21.15.59:0/2474838765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a406a770 0x7fd5a406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7fd5a27fc700 1 -- 172.21.15.59:0/2474838765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a406a770 msgr2=0x7fd5a406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:03.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7fd5a27fc700 1 --2- 172.21.15.59:0/2474838765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a406a770 0x7fd5a406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7fd5a27fc700 1 -- 172.21.15.59:0/2474838765 >> v2:172.21.15.59:3300/0 conn(0x7fd5a4131b40 msgr2=0x7fd5a4131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:03.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7fd5a27fc700 1 --2- 172.21.15.59:0/2474838765 >> v2:172.21.15.59:3300/0 conn(0x7fd5a4131b40 0x7fd5a4131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7fd5a27fc700 1 -- 172.21.15.59:0/2474838765 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a409f630 con 0x7fd5a406b080 2023-09-30T22:34:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7fd5a27fc700 1 --2- 172.21.15.59:0/2474838765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a406b080 0x7fd5a4131600 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd5940098f0 tx=0x7fd594009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95b54e298d6a399a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7ff481ffb700 1 -- 172.21.15.59:0/2507058664 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff48401b660 con 0x7ff48c1335c0 2023-09-30T22:34:03.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7fd5a1ffb700 1 -- 172.21.15.59:0/2474838765 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59400b8a0 con 0x7fd5a406b080 2023-09-30T22:34:03.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7fd5a1ffb700 1 -- 172.21.15.59:0/2474838765 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59400ba00 con 0x7fd5a406b080 2023-09-30T22:34:03.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7fd5a1ffb700 1 -- 172.21.15.59:0/2474838765 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59400bd90 con 0x7fd5a406b080 2023-09-30T22:34:03.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7f4a03b17700 1 -- 172.21.15.59:0/3188945144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc1338a0 msgr2=0x7f49fc133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.188+0000 7f4a03b17700 1 --2- 172.21.15.59:0/3188945144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc1338a0 0x7f49fc133c70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f49f80098f0 tx=0x7f49f8009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:03.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.189+0000 7f4a03b17700 1 -- 172.21.15.59:0/3188945144 shutdown_connections 2023-09-30T22:34:03.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.189+0000 7f4a03b17700 1 --2- 172.21.15.59:0/3188945144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc1338a0 0x7f49fc133c70 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.189+0000 7f4a03b17700 1 --2- 172.21.15.59:0/3188945144 >> v2:172.21.15.59:3300/0 conn(0x7f49fc09de50 0x7f49fc09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.189+0000 7f4a03b17700 1 -- 172.21.15.59:0/3188945144 >> 172.21.15.59:0/3188945144 conn(0x7f49fc0a2aa0 msgr2=0x7f49fc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:03.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.189+0000 7f4a03b17700 1 -- 172.21.15.59:0/3188945144 shutdown_connections 2023-09-30T22:34:03.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.189+0000 7f4a03b17700 1 -- 172.21.15.59:0/3188945144 wait complete. 2023-09-30T22:34:03.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.189+0000 7fd5a9411700 1 -- 172.21.15.59:0/2474838765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a406b080 msgr2=0x7fd5a4131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.189+0000 7fd5a9411700 1 --2- 172.21.15.59:0/2474838765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a406b080 0x7fd5a4131600 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd5940098f0 tx=0x7fd594009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:03.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.190+0000 7fd5a9411700 1 -- 172.21.15.59:0/2474838765 shutdown_connections 2023-09-30T22:34:03.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.190+0000 7fd5a9411700 1 --2- 172.21.15.59:0/2474838765 >> v2:172.21.15.59:3300/0 conn(0x7fd5a4131b40 0x7fd5a4131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.190+0000 7fd5a9411700 1 --2- 172.21.15.59:0/2474838765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a406a770 0x7fd5a406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.190+0000 7fd5a9411700 1 --2- 172.21.15.59:0/2474838765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a406b080 0x7fd5a4131600 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.190+0000 7fd5a9411700 1 -- 172.21.15.59:0/2474838765 >> 172.21.15.59:0/2474838765 conn(0x7fd5a4066f50 msgr2=0x7fd5a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:03.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.190+0000 7fd5a9411700 1 -- 172.21.15.59:0/2474838765 shutdown_connections 2023-09-30T22:34:03.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.190+0000 7fd5a9411700 1 -- 172.21.15.59:0/2474838765 wait complete. 2023-09-30T22:34:03.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.190+0000 7f4a03b17700 1 Processor -- start 2023-09-30T22:34:03.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.190+0000 7f4a03b17700 1 -- start start 2023-09-30T22:34:03.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a03b17700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49fc09de50 0x7f49fc1214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a03b17700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc09e760 0x7f49fc121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a03b17700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc1338a0 0x7f49fc121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a03b17700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc123000 con 0x7f49fc09de50 2023-09-30T22:34:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a03b17700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc124b20 con 0x7f49fc09e760 2023-09-30T22:34:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a03b17700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc0a1040 con 0x7f49fc1338a0 2023-09-30T22:34:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7fbad1ffb700 1 -- 172.21.15.59:0/1940833629 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbacc031940 con 0x7fbadc09e000 2023-09-30T22:34:03.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a018b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49fc09de50 0x7f49fc1214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a018b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49fc09de50 0x7f49fc1214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36022/0 (socket says 172.21.15.59:36022) 2023-09-30T22:34:03.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a018b3700 1 -- 172.21.15.59:0/1942874588 learned_addr learned my addr 172.21.15.59:0/1942874588 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:03.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a010b2700 1 --2- 172.21.15.59:0/1942874588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc09e760 0x7f49fc121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7fd5a9411700 1 Processor -- start 2023-09-30T22:34:03.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a018b3700 1 -- 172.21.15.59:0/1942874588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc1338a0 msgr2=0x7f49fc121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a018b3700 1 --2- 172.21.15.59:0/1942874588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc1338a0 0x7f49fc121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a018b3700 1 -- 172.21.15.59:0/1942874588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc09e760 msgr2=0x7f49fc121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a018b3700 1 --2- 172.21.15.59:0/1942874588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc09e760 0x7f49fc121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a018b3700 1 -- 172.21.15.59:0/1942874588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f8009550 con 0x7f49fc09de50 2023-09-30T22:34:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7f4a010b2700 1 --2- 172.21.15.59:0/1942874588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc09e760 0x7f49fc121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7f4a018b3700 1 --2- 172.21.15.59:0/1942874588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49fc09de50 0x7f49fc1214e0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009c40 tx=0x7f49f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7f49f27fc700 1 -- 172.21.15.59:0/1942874588 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f80036a0 con 0x7f49fc09de50 2023-09-30T22:34:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7f49f27fc700 1 -- 172.21.15.59:0/1942874588 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f801f070 con 0x7f49fc09de50 2023-09-30T22:34:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7f4a03b17700 1 -- 172.21.15.59:0/1942874588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49fc06f640 con 0x7f49fc09de50 2023-09-30T22:34:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7f49f27fc700 1 -- 172.21.15.59:0/1942874588 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f8003a40 con 0x7f49fc09de50 2023-09-30T22:34:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7f4a03b17700 1 -- 172.21.15.59:0/1942874588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49fc125590 con 0x7f49fc09de50 2023-09-30T22:34:03.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.191+0000 7fd5a9411700 1 -- start start 2023-09-30T22:34:03.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7fd5a9411700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a406a770 0x7fd5a4120150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7fd5a9411700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a406b080 0x7fd5a4120690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7fd5a9411700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a4131b40 0x7fd5a4120bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:03.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7fd5a9411700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a4123a70 con 0x7fd5a406a770 2023-09-30T22:34:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7fd5a9411700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a41215b0 con 0x7fd5a406b080 2023-09-30T22:34:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7fd5a9411700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a4130c50 con 0x7fd5a4131b40 2023-09-30T22:34:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7fd5a27fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a406b080 0x7fd5a4120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7fd5a27fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a406b080 0x7fd5a4120690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49768/0 (socket says 172.21.15.59:49768) 2023-09-30T22:34:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7fd5a27fc700 1 -- 172.21.15.59:0/882300852 learned_addr learned my addr 172.21.15.59:0/882300852 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:03.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7fd5a37fe700 1 --2- 172.21.15.59:0/882300852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a4131b40 0x7fd5a4120bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.192+0000 7fd5a2ffd700 1 --2- 172.21.15.59:0/882300852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a406a770 0x7fd5a4120150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:03.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.193+0000 7fd5a27fc700 1 -- 172.21.15.59:0/882300852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a4131b40 msgr2=0x7fd5a4120bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.193+0000 7fd5a27fc700 1 --2- 172.21.15.59:0/882300852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a4131b40 0x7fd5a4120bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.193+0000 7fd5a27fc700 1 -- 172.21.15.59:0/882300852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a406a770 msgr2=0x7fd5a4120150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.193+0000 7fd5a27fc700 1 --2- 172.21.15.59:0/882300852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a406a770 0x7fd5a4120150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.193+0000 7fd5a27fc700 1 -- 172.21.15.59:0/882300852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd594009550 con 0x7fd5a406b080 2023-09-30T22:34:03.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.193+0000 7fd5a27fc700 1 --2- 172.21.15.59:0/882300852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a406b080 0x7fd5a4120690 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd594000c00 tx=0x7fd594004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:03.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.194+0000 7fd58b7fe700 1 -- 172.21.15.59:0/882300852 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594004300 con 0x7fd5a406b080 2023-09-30T22:34:03.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.194+0000 7fd58b7fe700 1 -- 172.21.15.59:0/882300852 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd594027070 con 0x7fd5a406b080 2023-09-30T22:34:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.194+0000 7fd58b7fe700 1 -- 172.21.15.59:0/882300852 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5940036a0 con 0x7fd5a406b080 2023-09-30T22:34:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.194+0000 7f49f27fc700 1 -- 172.21.15.59:0/1942874588 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49f8003ba0 con 0x7f49fc09de50 2023-09-30T22:34:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.194+0000 7f4a03b17700 1 -- 172.21.15.59:0/1942874588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49fc074ea0 con 0x7f49fc09de50 2023-09-30T22:34:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.194+0000 7fd5a9411700 1 -- 172.21.15.59:0/882300852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a4121e00 con 0x7fd5a406b080 2023-09-30T22:34:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.194+0000 7fd5a9411700 1 -- 172.21.15.59:0/882300852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a40a39c0 con 0x7fd5a406b080 2023-09-30T22:34:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.196+0000 7fd5897fa700 1 -- 172.21.15.59:0/882300852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57c0052e0 con 0x7fd5a406b080 2023-09-30T22:34:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.197+0000 7fd58b7fe700 1 -- 172.21.15.59:0/882300852 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd594029030 con 0x7fd5a406b080 2023-09-30T22:34:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.197+0000 7fd58b7fe700 1 -- 172.21.15.59:0/882300852 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd594049310 con 0x7fd5a406b080 2023-09-30T22:34:03.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.194+0000 7f49f27fc700 1 -- 172.21.15.59:0/1942874588 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f49f8021070 con 0x7f49fc09de50 2023-09-30T22:34:03.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.200+0000 7f49f27fc700 1 -- 172.21.15.59:0/1942874588 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49f800bd70 con 0x7f49fc09de50 2023-09-30T22:34:03.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.205+0000 7fd58b7fe700 1 -- 172.21.15.59:0/882300852 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5940199a0 con 0x7fd5a406b080 2023-09-30T22:34:03.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.399+0000 7ff4936ca700 1 -- 172.21.15.59:0/2507058664 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff46c005590 con 0x7ff48c1335c0 2023-09-30T22:34:03.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.399+0000 7ff481ffb700 1 -- 172.21.15.59:0/2507058664 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff484017020 con 0x7ff48c1335c0 2023-09-30T22:34:03.400 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:03.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.400+0000 7fbae3826700 1 -- 172.21.15.59:0/1940833629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbadc09c700 con 0x7fbadc09e000 2023-09-30T22:34:03.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.401+0000 7fbad1ffb700 1 -- 172.21.15.59:0/1940833629 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbacc031350 con 0x7fbadc09e000 2023-09-30T22:34:03.402 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:03.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.402+0000 7ff4936ca700 1 -- 172.21.15.59:0/2507058664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff48c1335c0 msgr2=0x7ff48c133a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.402+0000 7ff4936ca700 1 --2- 172.21.15.59:0/2507058664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff48c1335c0 0x7ff48c133a20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff48400cbf0 tx=0x7ff48400cf00 comp rx=0 tx=0).stop 2023-09-30T22:34:03.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.403+0000 7ff4936ca700 1 -- 172.21.15.59:0/2507058664 shutdown_connections 2023-09-30T22:34:03.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.403+0000 7ff4936ca700 1 --2- 172.21.15.59:0/2507058664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff48c1335c0 0x7ff48c133a20 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.403+0000 7ff4936ca700 1 --2- 172.21.15.59:0/2507058664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48c06e570 0x7ff48c1401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.403+0000 7ff4936ca700 1 --2- 172.21.15.59:0/2507058664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c134610 0x7ff48c133080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.403+0000 7ff4936ca700 1 -- 172.21.15.59:0/2507058664 >> 172.21.15.59:0/2507058664 conn(0x7ff48c0a2aa0 msgr2=0x7ff48c137e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:03.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.403+0000 7ff4936ca700 1 -- 172.21.15.59:0/2507058664 shutdown_connections 2023-09-30T22:34:03.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.403+0000 7ff4936ca700 1 -- 172.21.15.59:0/2507058664 wait complete. 2023-09-30T22:34:03.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.404+0000 7fbae3826700 1 -- 172.21.15.59:0/1940833629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbadc09e000 msgr2=0x7fbadc11e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.404+0000 7fbae3826700 1 --2- 172.21.15.59:0/1940833629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbadc09e000 0x7fbadc11e520 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fbacc016000 tx=0x7fbacc004750 comp rx=0 tx=0).stop 2023-09-30T22:34:03.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.404+0000 7fbae3826700 1 -- 172.21.15.59:0/1940833629 shutdown_connections 2023-09-30T22:34:03.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.404+0000 7fbae3826700 1 --2- 172.21.15.59:0/1940833629 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbadc09e410 0x7fbadc11ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.404+0000 7fbae3826700 1 --2- 172.21.15.59:0/1940833629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbadc09d6f0 0x7fbadc11dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.404+0000 7fbae3826700 1 --2- 172.21.15.59:0/1940833629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbadc09e000 0x7fbadc11e520 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.404+0000 7fbae3826700 1 -- 172.21.15.59:0/1940833629 >> 172.21.15.59:0/1940833629 conn(0x7fbadc066f50 msgr2=0x7fbadc071080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:03.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.404+0000 7fbae3826700 1 -- 172.21.15.59:0/1940833629 shutdown_connections 2023-09-30T22:34:03.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.404+0000 7fbae3826700 1 -- 172.21.15.59:0/1940833629 wait complete. 2023-09-30T22:34:03.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:03.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.421+0000 7f4a03b17700 1 -- 172.21.15.59:0/1942874588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f49fc06b9e0 con 0x7f49fc09de50 2023-09-30T22:34:03.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.422+0000 7f49f27fc700 1 -- 172.21.15.59:0/1942874588 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49f8034020 con 0x7f49fc09de50 2023-09-30T22:34:03.423 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:03.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.424+0000 7f4a03b17700 1 -- 172.21.15.59:0/1942874588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49fc09de50 msgr2=0x7f49fc1214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.424+0000 7f4a03b17700 1 --2- 172.21.15.59:0/1942874588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49fc09de50 0x7f49fc1214e0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009c40 tx=0x7f49f8004750 comp rx=0 tx=0).stop 2023-09-30T22:34:03.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.424+0000 7f4a03b17700 1 -- 172.21.15.59:0/1942874588 shutdown_connections 2023-09-30T22:34:03.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.424+0000 7f4a03b17700 1 --2- 172.21.15.59:0/1942874588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc1338a0 0x7f49fc121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.424+0000 7f4a03b17700 1 --2- 172.21.15.59:0/1942874588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49fc09de50 0x7f49fc1214e0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.424+0000 7f4a03b17700 1 --2- 172.21.15.59:0/1942874588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc09e760 0x7f49fc121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.424+0000 7f4a03b17700 1 -- 172.21.15.59:0/1942874588 >> 172.21.15.59:0/1942874588 conn(0x7f49fc0a2aa0 msgr2=0x7f49fc1ba5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:03.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.424+0000 7f4a03b17700 1 -- 172.21.15.59:0/1942874588 shutdown_connections 2023-09-30T22:34:03.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.424+0000 7f4a03b17700 1 -- 172.21.15.59:0/1942874588 wait complete. 2023-09-30T22:34:03.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:03.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.442+0000 7fd5897fa700 1 -- 172.21.15.59:0/882300852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd57c005590 con 0x7fd5a406b080 2023-09-30T22:34:03.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.442+0000 7fd58b7fe700 1 -- 172.21.15.59:0/882300852 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd594015030 con 0x7fd5a406b080 2023-09-30T22:34:03.444 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:03.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.444+0000 7fd5897fa700 1 -- 172.21.15.59:0/882300852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a406b080 msgr2=0x7fd5a4120690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.444+0000 7fd5897fa700 1 --2- 172.21.15.59:0/882300852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a406b080 0x7fd5a4120690 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd594000c00 tx=0x7fd594004750 comp rx=0 tx=0).stop 2023-09-30T22:34:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.444+0000 7fd5897fa700 1 -- 172.21.15.59:0/882300852 shutdown_connections 2023-09-30T22:34:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.444+0000 7fd5897fa700 1 --2- 172.21.15.59:0/882300852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a4131b40 0x7fd5a4120bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.444+0000 7fd5897fa700 1 --2- 172.21.15.59:0/882300852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a406a770 0x7fd5a4120150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.444+0000 7fd5897fa700 1 --2- 172.21.15.59:0/882300852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a406b080 0x7fd5a4120690 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.444+0000 7fd5897fa700 1 -- 172.21.15.59:0/882300852 >> 172.21.15.59:0/882300852 conn(0x7fd5a4066f50 msgr2=0x7fd5a406fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.444+0000 7fd5897fa700 1 -- 172.21.15.59:0/882300852 shutdown_connections 2023-09-30T22:34:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:03.445+0000 7fd5897fa700 1 -- 172.21.15.59:0/882300852 wait complete. 2023-09-30T22:34:03.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:04.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:04.430 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:04.445 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:04.459 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.588+0000 7f2a31f50700 1 Processor -- start 2023-09-30T22:34:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.588+0000 7f2a31f50700 1 -- start start 2023-09-30T22:34:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.589+0000 7f2a31f50700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a2c12cc20 0x7f2a2c12f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.589+0000 7f2a31f50700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2c12c2f0 0x7f2a2c12fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.589+0000 7f2a31f50700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2c09a510 con 0x7f2a2c12cff0 2023-09-30T22:34:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.589+0000 7f2a31f50700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c12c7d0 con 0x7f2a2c12c2f0 2023-09-30T22:34:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.589+0000 7f2a31f50700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c09c190 con 0x7f2a2c12cc20 2023-09-30T22:34:04.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.589+0000 7f2a2affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2c12c2f0 0x7f2a2c12fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.589+0000 7f2a2b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a2c12cc20 0x7f2a2c12f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.589+0000 7f2a2affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2c12c2f0 0x7f2a2c12fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58404/0 (socket says 172.21.15.59:58404) 2023-09-30T22:34:04.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.589+0000 7f2a2affd700 1 -- 172.21.15.59:0/2938275770 learned_addr learned my addr 172.21.15.59:0/2938275770 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:04.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.589+0000 7f2a2affd700 1 -- 172.21.15.59:0/2938275770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a2c12cc20 msgr2=0x7f2a2c12f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:04.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.589+0000 7f2a2affd700 1 --2- 172.21.15.59:0/2938275770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a2c12cc20 0x7f2a2c12f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.589+0000 7f2a2affd700 1 -- 172.21.15.59:0/2938275770 >> v1:172.21.15.59:6789/0 conn(0x7f2a2c12cff0 legacy=0x7f2a2c136cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.589+0000 7f2a2affd700 1 -- 172.21.15.59:0/2938275770 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c09b540 con 0x7f2a2c12c2f0 2023-09-30T22:34:04.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.590+0000 7f2a2affd700 1 --2- 172.21.15.59:0/2938275770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2c12c2f0 0x7f2a2c12fe70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000bbc0 tx=0x7f2a2000bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=438b4db5cf09a2d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:04.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.590+0000 7f2a2a7fc700 1 -- 172.21.15.59:0/2938275770 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2000dc80 con 0x7f2a2c12c2f0 2023-09-30T22:34:04.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.590+0000 7f2a2a7fc700 1 -- 172.21.15.59:0/2938275770 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2000dde0 con 0x7f2a2c12c2f0 2023-09-30T22:34:04.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.590+0000 7f2a2a7fc700 1 -- 172.21.15.59:0/2938275770 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20017630 con 0x7f2a2c12c2f0 2023-09-30T22:34:04.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.591+0000 7f2a31f50700 1 -- 172.21.15.59:0/2938275770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2c12c2f0 msgr2=0x7f2a2c12fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.591+0000 7f2a31f50700 1 --2- 172.21.15.59:0/2938275770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2c12c2f0 0x7f2a2c12fe70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000bbc0 tx=0x7f2a2000bed0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.591+0000 7f2a31f50700 1 -- 172.21.15.59:0/2938275770 shutdown_connections 2023-09-30T22:34:04.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.591+0000 7f2a31f50700 1 --2- 172.21.15.59:0/2938275770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a2c12cc20 0x7f2a2c12f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.591+0000 7f2a31f50700 1 --2- 172.21.15.59:0/2938275770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2c12c2f0 0x7f2a2c12fe70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.591+0000 7f2a31f50700 1 -- 172.21.15.59:0/2938275770 >> 172.21.15.59:0/2938275770 conn(0x7f2a2c09f470 msgr2=0x7f2a2c0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.591+0000 7f2a31f50700 1 -- 172.21.15.59:0/2938275770 shutdown_connections 2023-09-30T22:34:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.591+0000 7f2a31f50700 1 -- 172.21.15.59:0/2938275770 wait complete. 2023-09-30T22:34:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.593+0000 7f2a31f50700 1 Processor -- start 2023-09-30T22:34:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.593+0000 7f2a31f50700 1 -- start start 2023-09-30T22:34:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.594+0000 7f2a31f50700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2c12c2f0 0x7f2a2c128cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.594+0000 7f2a31f50700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a2c12cc20 0x7f2a2c129230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.594+0000 7f2a31f50700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2c12cff0 0x7f2a2c1c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.594+0000 7f2a31f50700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c06f4f0 con 0x7f2a2c12c2f0 2023-09-30T22:34:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.594+0000 7f2a31f50700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c06f6d0 con 0x7f2a2c12cff0 2023-09-30T22:34:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.594+0000 7f2a31f50700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c129f10 con 0x7f2a2c12cc20 2023-09-30T22:34:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.594+0000 7f2a2bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2c12cff0 0x7f2a2c1c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.594+0000 7f2a2bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2c12cff0 0x7f2a2c1c3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58406/0 (socket says 172.21.15.59:58406) 2023-09-30T22:34:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.594+0000 7f2a2bfff700 1 -- 172.21.15.59:0/1287356517 learned_addr learned my addr 172.21.15.59:0/1287356517 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.594+0000 7f2a2b7fe700 1 --2- 172.21.15.59:0/1287356517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2c12c2f0 0x7f2a2c128cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.594+0000 7f2a2bfff700 1 -- 172.21.15.59:0/1287356517 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a2c12cc20 msgr2=0x7f2a2c129230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.594+0000 7f2a2bfff700 1 --2- 172.21.15.59:0/1287356517 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a2c12cc20 0x7f2a2c129230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.594+0000 7f2a2bfff700 1 -- 172.21.15.59:0/1287356517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2c12c2f0 msgr2=0x7f2a2c128cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.594+0000 7f2a2bfff700 1 --2- 172.21.15.59:0/1287356517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2c12c2f0 0x7f2a2c128cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.594+0000 7f2a2bfff700 1 -- 172.21.15.59:0/1287356517 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2000b7f0 con 0x7f2a2c12cff0 2023-09-30T22:34:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.595+0000 7f2a2bfff700 1 --2- 172.21.15.59:0/1287356517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2c12cff0 0x7f2a2c1c3f80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400cc80 tx=0x7f2a2400a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.595+0000 7f2a13fff700 1 -- 172.21.15.59:0/1287356517 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2400ad40 con 0x7f2a2c12cff0 2023-09-30T22:34:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.595+0000 7f2a13fff700 1 -- 172.21.15.59:0/1287356517 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2400ce80 con 0x7f2a2c12cff0 2023-09-30T22:34:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.595+0000 7f2a13fff700 1 -- 172.21.15.59:0/1287356517 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2400aea0 con 0x7f2a2c12cff0 2023-09-30T22:34:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.595+0000 7f2a31f50700 1 -- 172.21.15.59:0/1287356517 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c1288e0 con 0x7f2a2c12cff0 2023-09-30T22:34:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.595+0000 7f2a31f50700 1 -- 172.21.15.59:0/1287356517 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c06d7c0 con 0x7f2a2c12cff0 2023-09-30T22:34:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.597+0000 7f2a31f50700 1 -- 172.21.15.59:0/1287356517 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c0a0800 con 0x7f2a2c12cff0 2023-09-30T22:34:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.597+0000 7f2a13fff700 1 -- 172.21.15.59:0/1287356517 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a24003c40 con 0x7f2a2c12cff0 2023-09-30T22:34:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.599+0000 7f2a13fff700 1 -- 172.21.15.59:0/1287356517 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2a24011540 con 0x7f2a2c12cff0 2023-09-30T22:34:04.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.606+0000 7f2a13fff700 1 -- 172.21.15.59:0/1287356517 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a240198f0 con 0x7f2a2c12cff0 2023-09-30T22:34:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.616+0000 7f4543dce700 1 Processor -- start 2023-09-30T22:34:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.616+0000 7f3f330f2700 1 Processor -- start 2023-09-30T22:34:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.616+0000 7f3f330f2700 1 -- start start 2023-09-30T22:34:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.616+0000 7f4543dce700 1 -- start start 2023-09-30T22:34:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f4543dce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c09e930 0x7f453c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f4543dce700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f453c09f240 0x7f453c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f4543dce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c09f650 0x7f453c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f4543dce700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c070940 con 0x7f453c09f240 2023-09-30T22:34:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f4543dce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c06fd60 con 0x7f453c09e930 2023-09-30T22:34:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f4543dce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f453c06fa80 con 0x7f453c09f650 2023-09-30T22:34:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f3f330f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2c0a0a30 0x7f3f2c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f3f330f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2c09d630 0x7f3f2c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f3f330f2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f2c133930 0x7f3f2c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f3f330f2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2c0a2a70 con 0x7f3f2c133930 2023-09-30T22:34:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f3f330f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c0a01d0 con 0x7f3f2c0a0a30 2023-09-30T22:34:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f3f330f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c09e2b0 con 0x7f3f2c09d630 2023-09-30T22:34:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f454236b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c09f650 0x7f453c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f4541369700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f453c09f240 0x7f453c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f454236b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c09f650 0x7f453c131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41310/0 (socket says 172.21.15.59:41310) 2023-09-30T22:34:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f4541369700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f453c09f240 0x7f453c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35754/0 (socket says 172.21.15.59:35754) 2023-09-30T22:34:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f3f2bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2c09d630 0x7f3f2c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f3f3168f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f2c133930 0x7f3f2c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f3f2bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2c09d630 0x7f3f2c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41322/0 (socket says 172.21.15.59:41322) 2023-09-30T22:34:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f3f2bfff700 1 -- 172.21.15.59:0/1052628845 learned_addr learned my addr 172.21.15.59:0/1052628845 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f454236b700 1 -- 172.21.15.59:0/2749107598 learned_addr learned my addr 172.21.15.59:0/2749107598 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.618+0000 7f3f3168f700 1 -- 172.21.15.59:0/1052628845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2c09d630 msgr2=0x7f3f2c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.618+0000 7f3f3168f700 1 --2- 172.21.15.59:0/1052628845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2c09d630 0x7f3f2c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.618+0000 7f3f3168f700 1 -- 172.21.15.59:0/1052628845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2c0a0a30 msgr2=0x7f3f2c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.618+0000 7f3f3168f700 1 --2- 172.21.15.59:0/1052628845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2c0a0a30 0x7f3f2c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f454236b700 1 -- 172.21.15.59:0/2749107598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c09e930 msgr2=0x7f453c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f454236b700 1 --2- 172.21.15.59:0/2749107598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c09e930 0x7f453c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f454236b700 1 -- 172.21.15.59:0/2749107598 >> v2:172.21.15.59:3300/0 conn(0x7f453c09f240 msgr2=0x7f453c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f454236b700 1 --2- 172.21.15.59:0/2749107598 >> v2:172.21.15.59:3300/0 conn(0x7f453c09f240 0x7f453c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.617+0000 7f454236b700 1 -- 172.21.15.59:0/2749107598 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c09fb60 con 0x7f453c09f650 2023-09-30T22:34:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.618+0000 7f4541369700 1 --2- 172.21.15.59:0/2749107598 >> v2:172.21.15.59:3300/0 conn(0x7f453c09f240 0x7f453c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.618+0000 7f3f3168f700 1 -- 172.21.15.59:0/1052628845 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c09dc50 con 0x7f3f2c133930 2023-09-30T22:34:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.618+0000 7f454236b700 1 --2- 172.21.15.59:0/2749107598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c09f650 0x7f453c131d30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4534009e50 tx=0x7f453400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fe9dc260541c96e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.618+0000 7f3f3168f700 1 --2- 172.21.15.59:0/1052628845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2c133930 0x7f3f2c133dd0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009d90 tx=0x7f3f2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81a4239877d4abe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.618+0000 7f3f2b7fe700 1 -- 172.21.15.59:0/1052628845 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2400e070 con 0x7f3f2c133930 2023-09-30T22:34:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.618+0000 7f3f2b7fe700 1 -- 172.21.15.59:0/1052628845 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2400bb20 con 0x7f3f2c133930 2023-09-30T22:34:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.618+0000 7f3f2b7fe700 1 -- 172.21.15.59:0/1052628845 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24012430 con 0x7f3f2c133930 2023-09-30T22:34:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f4540b68700 1 -- 172.21.15.59:0/2749107598 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453400e070 con 0x7f453c09f650 2023-09-30T22:34:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f4540b68700 1 -- 172.21.15.59:0/2749107598 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453400b910 con 0x7f453c09f650 2023-09-30T22:34:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f4540b68700 1 -- 172.21.15.59:0/2749107598 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453400bcc0 con 0x7f453c09f650 2023-09-30T22:34:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f3f330f2700 1 -- 172.21.15.59:0/1052628845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2c133930 msgr2=0x7f3f2c133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f3f330f2700 1 --2- 172.21.15.59:0/1052628845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2c133930 0x7f3f2c133dd0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009d90 tx=0x7f3f2400b330 comp rx=0 tx=0).stop 2023-09-30T22:34:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f3f330f2700 1 -- 172.21.15.59:0/1052628845 shutdown_connections 2023-09-30T22:34:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f3f330f2700 1 --2- 172.21.15.59:0/1052628845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2c133930 0x7f3f2c133dd0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f3f330f2700 1 --2- 172.21.15.59:0/1052628845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2c0a0a30 0x7f3f2c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f3f330f2700 1 --2- 172.21.15.59:0/1052628845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2c09d630 0x7f3f2c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f3f330f2700 1 -- 172.21.15.59:0/1052628845 >> 172.21.15.59:0/1052628845 conn(0x7f3f2c0a3050 msgr2=0x7f3f2c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f3f330f2700 1 -- 172.21.15.59:0/1052628845 shutdown_connections 2023-09-30T22:34:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f3f330f2700 1 -- 172.21.15.59:0/1052628845 wait complete. 2023-09-30T22:34:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f4543dce700 1 -- 172.21.15.59:0/2749107598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c09f650 msgr2=0x7f453c131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f4543dce700 1 --2- 172.21.15.59:0/2749107598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c09f650 0x7f453c131d30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4534009e50 tx=0x7f453400b330 comp rx=0 tx=0).stop 2023-09-30T22:34:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f4543dce700 1 -- 172.21.15.59:0/2749107598 shutdown_connections 2023-09-30T22:34:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f4543dce700 1 --2- 172.21.15.59:0/2749107598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c09f650 0x7f453c131d30 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f4543dce700 1 --2- 172.21.15.59:0/2749107598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c09e930 0x7f453c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f4543dce700 1 --2- 172.21.15.59:0/2749107598 >> v2:172.21.15.59:3300/0 conn(0x7f453c09f240 0x7f453c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.619+0000 7f4543dce700 1 -- 172.21.15.59:0/2749107598 >> 172.21.15.59:0/2749107598 conn(0x7f453c0a4210 msgr2=0x7f453c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.620+0000 7f4543dce700 1 -- 172.21.15.59:0/2749107598 shutdown_connections 2023-09-30T22:34:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.620+0000 7f4543dce700 1 -- 172.21.15.59:0/2749107598 wait complete. 2023-09-30T22:34:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.620+0000 7f3f330f2700 1 Processor -- start 2023-09-30T22:34:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.620+0000 7f3f330f2700 1 -- start start 2023-09-30T22:34:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f4543dce700 1 Processor -- start 2023-09-30T22:34:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f4543dce700 1 -- start start 2023-09-30T22:34:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f3f330f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2c09d630 0x7f3f2c11f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f3f330f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2c0a0a30 0x7f3f2c1c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f3f330f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2c133930 0x7f3f2c1c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f3f330f2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c0a0410 con 0x7f3f2c09d630 2023-09-30T22:34:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f3f330f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c11f340 con 0x7f3f2c133930 2023-09-30T22:34:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f3f330f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c121f30 con 0x7f3f2c0a0a30 2023-09-30T22:34:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f3f3168f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2c133930 0x7f3f2c1c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f3f2bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2c0a0a30 0x7f3f2c1c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f3f3168f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2c133930 0x7f3f2c1c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58440/0 (socket says 172.21.15.59:58440) 2023-09-30T22:34:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f3f3168f700 1 -- 172.21.15.59:0/2146487611 learned_addr learned my addr 172.21.15.59:0/2146487611 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f4543dce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f453c09e930 0x7f453c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f4543dce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c09f240 0x7f453c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f4543dce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c09f650 0x7f453c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f4543dce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c1a9970 con 0x7f453c09e930 2023-09-30T22:34:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f4543dce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c1a8910 con 0x7f453c09f650 2023-09-30T22:34:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f4543dce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f453c1a9100 con 0x7f453c09f240 2023-09-30T22:34:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.621+0000 7f4541369700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c09f240 0x7f453c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f4541369700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c09f240 0x7f453c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41330/0 (socket says 172.21.15.59:41330) 2023-09-30T22:34:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f4541369700 1 -- 172.21.15.59:0/147720939 learned_addr learned my addr 172.21.15.59:0/147720939 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f4541b6a700 1 --2- 172.21.15.59:0/147720939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f453c09e930 0x7f453c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f4541369700 1 -- 172.21.15.59:0/147720939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c09f650 msgr2=0x7f453c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f4541369700 1 --2- 172.21.15.59:0/147720939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c09f650 0x7f453c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f4541369700 1 -- 172.21.15.59:0/147720939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f453c09e930 msgr2=0x7f453c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f4541369700 1 --2- 172.21.15.59:0/147720939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f453c09e930 0x7f453c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f4541369700 1 -- 172.21.15.59:0/147720939 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c0094a0 con 0x7f453c09f240 2023-09-30T22:34:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f4541b6a700 1 --2- 172.21.15.59:0/147720939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f453c09e930 0x7f453c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f3f30e8e700 1 --2- 172.21.15.59:0/2146487611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2c09d630 0x7f3f2c11f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f3f3168f700 1 -- 172.21.15.59:0/2146487611 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2c0a0a30 msgr2=0x7f3f2c1c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f3f3168f700 1 --2- 172.21.15.59:0/2146487611 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2c0a0a30 0x7f3f2c1c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f3f3168f700 1 -- 172.21.15.59:0/2146487611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2c09d630 msgr2=0x7f3f2c11f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f3f3168f700 1 --2- 172.21.15.59:0/2146487611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2c09d630 0x7f3f2c11f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f3f3168f700 1 -- 172.21.15.59:0/2146487611 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f24009a70 con 0x7f3f2c133930 2023-09-30T22:34:04.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.622+0000 7f4541369700 1 --2- 172.21.15.59:0/147720939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c09f240 0x7f453c06bdf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f452c00eb30 tx=0x7f452c00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:04.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.623+0000 7f45327fc700 1 -- 172.21.15.59:0/147720939 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c00c850 con 0x7f453c09f240 2023-09-30T22:34:04.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.623+0000 7f45327fc700 1 -- 172.21.15.59:0/147720939 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c00c9b0 con 0x7f453c09f240 2023-09-30T22:34:04.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.623+0000 7f45327fc700 1 -- 172.21.15.59:0/147720939 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c00cd40 con 0x7f453c09f240 2023-09-30T22:34:04.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.623+0000 7f4543dce700 1 -- 172.21.15.59:0/147720939 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4534009b30 con 0x7f453c09f240 2023-09-30T22:34:04.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.623+0000 7f4543dce700 1 -- 172.21.15.59:0/147720939 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453c0a0190 con 0x7f453c09f240 2023-09-30T22:34:04.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.623+0000 7f3f3168f700 1 --2- 172.21.15.59:0/2146487611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2c133930 0x7f3f2c1c8460 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3f24014040 tx=0x7f3f24004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:04.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.625+0000 7f45327fc700 1 -- 172.21.15.59:0/147720939 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f452c013470 con 0x7f453c09f240 2023-09-30T22:34:04.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.625+0000 7f45327fc700 1 -- 172.21.15.59:0/147720939 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f452c03fcc0 con 0x7f453c09f240 2023-09-30T22:34:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.623+0000 7f3f297fa700 1 -- 172.21.15.59:0/2146487611 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24012430 con 0x7f3f2c133930 2023-09-30T22:34:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.623+0000 7f3f297fa700 1 -- 172.21.15.59:0/2146487611 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f24020070 con 0x7f3f2c133930 2023-09-30T22:34:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.623+0000 7f3f297fa700 1 -- 172.21.15.59:0/2146487611 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24003ea0 con 0x7f3f2c133930 2023-09-30T22:34:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.623+0000 7f3f330f2700 1 -- 172.21.15.59:0/2146487611 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2c120650 con 0x7f3f2c133930 2023-09-30T22:34:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.624+0000 7f3f330f2700 1 -- 172.21.15.59:0/2146487611 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2c11ef30 con 0x7f3f2c133930 2023-09-30T22:34:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.625+0000 7f3f330f2700 1 -- 172.21.15.59:0/2146487611 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2c11f0c0 con 0x7f3f2c133930 2023-09-30T22:34:04.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.628+0000 7f4543dce700 1 -- 172.21.15.59:0/147720939 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453c1a0b30 con 0x7f453c09f240 2023-09-30T22:34:04.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.629+0000 7f1f9b101700 1 Processor -- start 2023-09-30T22:34:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.629+0000 7f3f297fa700 1 -- 172.21.15.59:0/2146487611 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f24004280 con 0x7f3f2c133930 2023-09-30T22:34:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.629+0000 7f3f297fa700 1 -- 172.21.15.59:0/2146487611 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f24022070 con 0x7f3f2c133930 2023-09-30T22:34:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.629+0000 7f1f9b101700 1 -- start start 2023-09-30T22:34:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.630+0000 7f1f9b101700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9409de00 0x7f1f9409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.630+0000 7f1f9b101700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9413d1f0 0x7f1f9413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.630+0000 7f1f9b101700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9409a810 con 0x7f1f9406a770 2023-09-30T22:34:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.630+0000 7f1f9b101700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9406ab40 con 0x7f1f9413d1f0 2023-09-30T22:34:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.630+0000 7f1f9b101700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9409ebc0 con 0x7f1f9409de00 2023-09-30T22:34:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.630+0000 7f1f9969e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9413d1f0 0x7f1f9413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.630+0000 7f1f9969e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9413d1f0 0x7f1f9413f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58460/0 (socket says 172.21.15.59:58460) 2023-09-30T22:34:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.630+0000 7f1f9969e700 1 -- 172.21.15.59:0/2183432082 learned_addr learned my addr 172.21.15.59:0/2183432082 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.630+0000 7f1f9969e700 1 -- 172.21.15.59:0/2183432082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9409de00 msgr2=0x7f1f9409e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.630+0000 7f1f9969e700 1 --2- 172.21.15.59:0/2183432082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9409de00 0x7f1f9409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.630+0000 7f1f9969e700 1 -- 172.21.15.59:0/2183432082 >> v1:172.21.15.59:6789/0 conn(0x7f1f9406a770 legacy=0x7f1f9409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.630+0000 7f1f9969e700 1 -- 172.21.15.59:0/2183432082 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9409e920 con 0x7f1f9413d1f0 2023-09-30T22:34:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.631+0000 7f1f9969e700 1 --2- 172.21.15.59:0/2183432082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9413d1f0 0x7f1f9413f5d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009e80 tx=0x7f1f8c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75fe379431eecfb4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.634+0000 7f1f937fe700 1 -- 172.21.15.59:0/2183432082 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00e070 con 0x7f1f9413d1f0 2023-09-30T22:34:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.634+0000 7f1f937fe700 1 -- 172.21.15.59:0/2183432082 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c003a20 con 0x7f1f9413d1f0 2023-09-30T22:34:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.634+0000 7f1f937fe700 1 -- 172.21.15.59:0/2183432082 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c003dd0 con 0x7f1f9413d1f0 2023-09-30T22:34:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.634+0000 7f45327fc700 1 -- 172.21.15.59:0/147720939 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f452c017020 con 0x7f453c09f240 2023-09-30T22:34:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.634+0000 7f3f297fa700 1 -- 172.21.15.59:0/2146487611 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f24012e10 con 0x7f3f2c133930 2023-09-30T22:34:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.635+0000 7f1f9b101700 1 -- 172.21.15.59:0/2183432082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9413d1f0 msgr2=0x7f1f9413f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.635+0000 7f1f9b101700 1 --2- 172.21.15.59:0/2183432082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9413d1f0 0x7f1f9413f5d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009e80 tx=0x7f1f8c00b330 comp rx=0 tx=0).stop 2023-09-30T22:34:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.635+0000 7f1f9b101700 1 -- 172.21.15.59:0/2183432082 shutdown_connections 2023-09-30T22:34:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.635+0000 7f1f9b101700 1 --2- 172.21.15.59:0/2183432082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9413d1f0 0x7f1f9413f5d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.635+0000 7f1f9b101700 1 --2- 172.21.15.59:0/2183432082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9409de00 0x7f1f9409e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.635+0000 7f1f9b101700 1 -- 172.21.15.59:0/2183432082 >> 172.21.15.59:0/2183432082 conn(0x7f1f94066f50 msgr2=0x7f1f9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.635+0000 7f1f9b101700 1 -- 172.21.15.59:0/2183432082 shutdown_connections 2023-09-30T22:34:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.635+0000 7f1f9b101700 1 -- 172.21.15.59:0/2183432082 wait complete. 2023-09-30T22:34:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.636+0000 7f1f9b101700 1 Processor -- start 2023-09-30T22:34:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.636+0000 7f1f9b101700 1 -- start start 2023-09-30T22:34:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.637+0000 7f1f9b101700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9406a770 0x7f1f9413b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.637+0000 7f1f9b101700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9409de00 0x7f1f9413bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.637+0000 7f1f9b101700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9413d1f0 0x7f1f9413c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.637+0000 7f1f9b101700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9411e490 con 0x7f1f9406a770 2023-09-30T22:34:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.637+0000 7f1f98e9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9406a770 0x7f1f9413b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.637+0000 7f1f9b101700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f94071c10 con 0x7f1f9413d1f0 2023-09-30T22:34:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.637+0000 7f1f9b101700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f94135e70 con 0x7f1f9409de00 2023-09-30T22:34:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.637+0000 7f1f9969e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9413d1f0 0x7f1f9413c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.637+0000 7f1f9969e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9413d1f0 0x7f1f9413c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58464/0 (socket says 172.21.15.59:58464) 2023-09-30T22:34:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.637+0000 7f1f9969e700 1 -- 172.21.15.59:0/3267063414 learned_addr learned my addr 172.21.15.59:0/3267063414 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.638+0000 7f1f93fff700 1 --2- 172.21.15.59:0/3267063414 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9409de00 0x7f1f9413bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.638+0000 7f1f98e9d700 1 -- 172.21.15.59:0/3267063414 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9409de00 msgr2=0x7f1f9413bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.638+0000 7f1f98e9d700 1 --2- 172.21.15.59:0/3267063414 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9409de00 0x7f1f9413bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.638+0000 7f1f98e9d700 1 -- 172.21.15.59:0/3267063414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9413d1f0 msgr2=0x7f1f9413c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.638+0000 7f1f98e9d700 1 --2- 172.21.15.59:0/3267063414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9413d1f0 0x7f1f9413c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.638+0000 7f1f98e9d700 1 -- 172.21.15.59:0/3267063414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c009b30 con 0x7f1f9406a770 2023-09-30T22:34:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.638+0000 7f1f98e9d700 1 --2- 172.21.15.59:0/3267063414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9406a770 0x7f1f9413b710 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800c430 tx=0x7f1f8800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.638+0000 7f1f917fa700 1 -- 172.21.15.59:0/3267063414 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88011790 con 0x7f1f9406a770 2023-09-30T22:34:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.639+0000 7f1f917fa700 1 -- 172.21.15.59:0/3267063414 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f880118f0 con 0x7f1f9406a770 2023-09-30T22:34:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.639+0000 7f1f9b101700 1 -- 172.21.15.59:0/3267063414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9411e830 con 0x7f1f9406a770 2023-09-30T22:34:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.639+0000 7f1f9b101700 1 -- 172.21.15.59:0/3267063414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9411eb60 con 0x7f1f9406a770 2023-09-30T22:34:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.639+0000 7f1f917fa700 1 -- 172.21.15.59:0/3267063414 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88011ca0 con 0x7f1f9406a770 2023-09-30T22:34:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.640+0000 7f1f9b101700 1 -- 172.21.15.59:0/3267063414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9413f6f0 con 0x7f1f9406a770 2023-09-30T22:34:04.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.640+0000 7f1f917fa700 1 -- 172.21.15.59:0/3267063414 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f8801c460 con 0x7f1f9406a770 2023-09-30T22:34:04.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.640+0000 7f1f917fa700 1 -- 172.21.15.59:0/3267063414 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f8803f420 con 0x7f1f9406a770 2023-09-30T22:34:04.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.645+0000 7f1f917fa700 1 -- 172.21.15.59:0/3267063414 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f880106d0 con 0x7f1f9406a770 2023-09-30T22:34:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.841+0000 7f3f330f2700 1 -- 172.21.15.59:0/2146487611 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f2c0747f0 con 0x7f3f2c133930 2023-09-30T22:34:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.842+0000 7f3f297fa700 1 -- 172.21.15.59:0/2146487611 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f24011390 con 0x7f3f2c133930 2023-09-30T22:34:04.843 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:04.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.844+0000 7f3f330f2700 1 -- 172.21.15.59:0/2146487611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2c133930 msgr2=0x7f3f2c1c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.844+0000 7f3f330f2700 1 --2- 172.21.15.59:0/2146487611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2c133930 0x7f3f2c1c8460 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3f24014040 tx=0x7f3f24004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.844+0000 7f3f330f2700 1 -- 172.21.15.59:0/2146487611 shutdown_connections 2023-09-30T22:34:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.844+0000 7f3f330f2700 1 --2- 172.21.15.59:0/2146487611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2c133930 0x7f3f2c1c8460 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.844+0000 7f3f330f2700 1 --2- 172.21.15.59:0/2146487611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2c09d630 0x7f3f2c11f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.844+0000 7f3f330f2700 1 --2- 172.21.15.59:0/2146487611 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2c0a0a30 0x7f3f2c1c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.844+0000 7f3f330f2700 1 -- 172.21.15.59:0/2146487611 >> 172.21.15.59:0/2146487611 conn(0x7f3f2c0a3050 msgr2=0x7f3f2c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.845+0000 7f3f330f2700 1 -- 172.21.15.59:0/2146487611 shutdown_connections 2023-09-30T22:34:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.845+0000 7f3f330f2700 1 -- 172.21.15.59:0/2146487611 wait complete. 2023-09-30T22:34:04.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.849+0000 7f2a31f50700 1 -- 172.21.15.59:0/1287356517 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2a2c130390 con 0x7f2a2c12cff0 2023-09-30T22:34:04.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.849+0000 7f2a13fff700 1 -- 172.21.15.59:0/1287356517 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a2c130390 con 0x7f2a2c12cff0 2023-09-30T22:34:04.850 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.852+0000 7f2a31f50700 1 -- 172.21.15.59:0/1287356517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2c12cff0 msgr2=0x7f2a2c1c3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.852+0000 7f2a31f50700 1 --2- 172.21.15.59:0/1287356517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2c12cff0 0x7f2a2c1c3f80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400cc80 tx=0x7f2a2400a340 comp rx=0 tx=0).stop 2023-09-30T22:34:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.852+0000 7f2a31f50700 1 -- 172.21.15.59:0/1287356517 shutdown_connections 2023-09-30T22:34:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.852+0000 7f2a31f50700 1 --2- 172.21.15.59:0/1287356517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a2c12cff0 0x7f2a2c1c3f80 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.852+0000 7f2a31f50700 1 --2- 172.21.15.59:0/1287356517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2c12c2f0 0x7f2a2c128cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.852+0000 7f2a31f50700 1 --2- 172.21.15.59:0/1287356517 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a2c12cc20 0x7f2a2c129230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.852+0000 7f2a31f50700 1 -- 172.21.15.59:0/1287356517 >> 172.21.15.59:0/1287356517 conn(0x7f2a2c09f470 msgr2=0x7f2a2c12d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:04.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.852+0000 7f1f9b101700 1 -- 172.21.15.59:0/3267063414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1f94074ea0 con 0x7f1f9406a770 2023-09-30T22:34:04.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.852+0000 7f2a31f50700 1 -- 172.21.15.59:0/1287356517 shutdown_connections 2023-09-30T22:34:04.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.852+0000 7f2a31f50700 1 -- 172.21.15.59:0/1287356517 wait complete. 2023-09-30T22:34:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.852+0000 7f1f917fa700 1 -- 172.21.15.59:0/3267063414 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f8801a360 con 0x7f1f9406a770 2023-09-30T22:34:04.858 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.855+0000 7f1f9b101700 1 -- 172.21.15.59:0/3267063414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9406a770 msgr2=0x7f1f9413b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.855+0000 7f1f9b101700 1 --2- 172.21.15.59:0/3267063414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9406a770 0x7f1f9413b710 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800c430 tx=0x7f1f8800c740 comp rx=0 tx=0).stop 2023-09-30T22:34:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.855+0000 7f1f9b101700 1 -- 172.21.15.59:0/3267063414 shutdown_connections 2023-09-30T22:34:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.855+0000 7f1f9b101700 1 --2- 172.21.15.59:0/3267063414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9413d1f0 0x7f1f9413c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.855+0000 7f1f9b101700 1 --2- 172.21.15.59:0/3267063414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9406a770 0x7f1f9413b710 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.855+0000 7f1f9b101700 1 --2- 172.21.15.59:0/3267063414 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9409de00 0x7f1f9413bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.855+0000 7f1f9b101700 1 -- 172.21.15.59:0/3267063414 >> 172.21.15.59:0/3267063414 conn(0x7f1f94066f50 msgr2=0x7f1f940a2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:04.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.855+0000 7f1f9b101700 1 -- 172.21.15.59:0/3267063414 shutdown_connections 2023-09-30T22:34:04.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.855+0000 7f1f9b101700 1 -- 172.21.15.59:0/3267063414 wait complete. 2023-09-30T22:34:04.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:04.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.866+0000 7f4543dce700 1 -- 172.21.15.59:0/147720939 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f453c074ea0 con 0x7f453c09f240 2023-09-30T22:34:04.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.866+0000 7f45327fc700 1 -- 172.21.15.59:0/147720939 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f452c02b090 con 0x7f453c09f240 2023-09-30T22:34:04.868 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:04.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.869+0000 7f4543dce700 1 -- 172.21.15.59:0/147720939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c09f240 msgr2=0x7f453c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.869+0000 7f4543dce700 1 --2- 172.21.15.59:0/147720939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c09f240 0x7f453c06bdf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f452c00eb30 tx=0x7f452c00ee40 comp rx=0 tx=0).stop 2023-09-30T22:34:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.870+0000 7f4543dce700 1 -- 172.21.15.59:0/147720939 shutdown_connections 2023-09-30T22:34:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.870+0000 7f4543dce700 1 --2- 172.21.15.59:0/147720939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f453c09f650 0x7f453c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.870+0000 7f4543dce700 1 --2- 172.21.15.59:0/147720939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f453c09e930 0x7f453c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.870+0000 7f4543dce700 1 --2- 172.21.15.59:0/147720939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f453c09f240 0x7f453c06bdf0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.870+0000 7f4543dce700 1 -- 172.21.15.59:0/147720939 >> 172.21.15.59:0/147720939 conn(0x7f453c0a4210 msgr2=0x7f453c1b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.870+0000 7f4543dce700 1 -- 172.21.15.59:0/147720939 shutdown_connections 2023-09-30T22:34:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:04.870+0000 7f4543dce700 1 -- 172.21.15.59:0/147720939 wait complete. 2023-09-30T22:34:04.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:04.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:05.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:05.871 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:05.876 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:05.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:06.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.029+0000 7fcecaf34700 1 Processor -- start 2023-09-30T22:34:06.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.029+0000 7fcecaf34700 1 -- start start 2023-09-30T22:34:06.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.030+0000 7fcecaf34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcec4133420 0x7fcec41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.030+0000 7fcecaf34700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcec4133e30 0x7fcec412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.030+0000 7fcecaf34700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec406b990 con 0x7fcec4134260 2023-09-30T22:34:06.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.030+0000 7fcecaf34700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec40a0590 con 0x7fcec4133e30 2023-09-30T22:34:06.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.030+0000 7fcecaf34700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec409fb80 con 0x7fcec4133420 2023-09-30T22:34:06.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.031+0000 7fcec3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcec4133e30 0x7fcec412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.031+0000 7fcec3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcec4133e30 0x7fcec412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35792/0 (socket says 172.21.15.59:35792) 2023-09-30T22:34:06.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.031+0000 7fcec3fff700 1 -- 172.21.15.59:0/1472518602 learned_addr learned my addr 172.21.15.59:0/1472518602 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:06.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.031+0000 7fcec8cd0700 1 --2- 172.21.15.59:0/1472518602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcec4133420 0x7fcec41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.031+0000 7fcec3fff700 1 -- 172.21.15.59:0/1472518602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcec4133420 msgr2=0x7fcec41337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:06.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.031+0000 7fcec3fff700 1 --2- 172.21.15.59:0/1472518602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcec4133420 0x7fcec41337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.031+0000 7fcec3fff700 1 -- 172.21.15.59:0/1472518602 >> v1:172.21.15.59:6789/0 conn(0x7fcec4134260 legacy=0x7fcec41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.031+0000 7fcec3fff700 1 -- 172.21.15.59:0/1472518602 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec40a0030 con 0x7fcec4133e30 2023-09-30T22:34:06.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.031+0000 7fcec3fff700 1 --2- 172.21.15.59:0/1472518602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4133e30 0x7fcec412ff90 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fceb00098f0 tx=0x7fceb0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f007cb37df422e89 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:06.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.031+0000 7fcec37fe700 1 -- 172.21.15.59:0/1472518602 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb000b8a0 con 0x7fcec4133e30 2023-09-30T22:34:06.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.032+0000 7fcec37fe700 1 -- 172.21.15.59:0/1472518602 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb000ba00 con 0x7fcec4133e30 2023-09-30T22:34:06.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.032+0000 7fcec37fe700 1 -- 172.21.15.59:0/1472518602 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb000bd90 con 0x7fcec4133e30 2023-09-30T22:34:06.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.032+0000 7fcecaf34700 1 -- 172.21.15.59:0/1472518602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4133e30 msgr2=0x7fcec412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.032+0000 7fcecaf34700 1 --2- 172.21.15.59:0/1472518602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4133e30 0x7fcec412ff90 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fceb00098f0 tx=0x7fceb0009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.032+0000 7fcecaf34700 1 -- 172.21.15.59:0/1472518602 shutdown_connections 2023-09-30T22:34:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.032+0000 7fcecaf34700 1 --2- 172.21.15.59:0/1472518602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcec4133420 0x7fcec41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.032+0000 7fcecaf34700 1 --2- 172.21.15.59:0/1472518602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4133e30 0x7fcec412ff90 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.032+0000 7fcecaf34700 1 -- 172.21.15.59:0/1472518602 >> 172.21.15.59:0/1472518602 conn(0x7fcec40a4210 msgr2=0x7fcec40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.032+0000 7fcecaf34700 1 -- 172.21.15.59:0/1472518602 shutdown_connections 2023-09-30T22:34:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.032+0000 7fcecaf34700 1 -- 172.21.15.59:0/1472518602 wait complete. 2023-09-30T22:34:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.034+0000 7fcecaf34700 1 Processor -- start 2023-09-30T22:34:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.034+0000 7fcecaf34700 1 -- start start 2023-09-30T22:34:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.035+0000 7fcecaf34700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4133420 0x7fcec409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.035+0000 7fcecaf34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcec4133e30 0x7fcec409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.035+0000 7fcecaf34700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec4134260 0x7fcec409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.035+0000 7fcecaf34700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec409ddd0 con 0x7fcec4133420 2023-09-30T22:34:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.035+0000 7fcecaf34700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec409d870 con 0x7fcec4133e30 2023-09-30T22:34:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.035+0000 7fcecaf34700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcec409e380 con 0x7fcec4134260 2023-09-30T22:34:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.035+0000 7fcec8cd0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4133420 0x7fcec409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.035+0000 7fcec8cd0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4133420 0x7fcec409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35806/0 (socket says 172.21.15.59:35806) 2023-09-30T22:34:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.035+0000 7fcec8cd0700 1 -- 172.21.15.59:0/410554333 learned_addr learned my addr 172.21.15.59:0/410554333 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.035+0000 7fcec94d1700 1 --2- 172.21.15.59:0/410554333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec4134260 0x7fcec409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.035+0000 7fcec3fff700 1 --2- 172.21.15.59:0/410554333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcec4133e30 0x7fcec409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.036+0000 7fcec8cd0700 1 -- 172.21.15.59:0/410554333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec4134260 msgr2=0x7fcec409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.036+0000 7fcec8cd0700 1 --2- 172.21.15.59:0/410554333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec4134260 0x7fcec409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.036+0000 7fcec8cd0700 1 -- 172.21.15.59:0/410554333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcec4133e30 msgr2=0x7fcec409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.036+0000 7fcec8cd0700 1 --2- 172.21.15.59:0/410554333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcec4133e30 0x7fcec409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.036+0000 7fcec8cd0700 1 -- 172.21.15.59:0/410554333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb0009550 con 0x7fcec4133420 2023-09-30T22:34:06.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.036+0000 7fcec94d1700 1 --2- 172.21.15.59:0/410554333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec4134260 0x7fcec409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:06.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.036+0000 7fcec8cd0700 1 --2- 172.21.15.59:0/410554333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4133420 0x7fcec409c480 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fceb800e840 tx=0x7fceb800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:06.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.036+0000 7fcec17fa700 1 -- 172.21.15.59:0/410554333 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb8013610 con 0x7fcec4133420 2023-09-30T22:34:06.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.036+0000 7fcec17fa700 1 -- 172.21.15.59:0/410554333 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb8013770 con 0x7fcec4133420 2023-09-30T22:34:06.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.036+0000 7fcecaf34700 1 -- 172.21.15.59:0/410554333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec412dae0 con 0x7fcec4133420 2023-09-30T22:34:06.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.036+0000 7fcec17fa700 1 -- 172.21.15.59:0/410554333 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb8013b20 con 0x7fcec4133420 2023-09-30T22:34:06.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.037+0000 7fcecaf34700 1 -- 172.21.15.59:0/410554333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec41318d0 con 0x7fcec4133420 2023-09-30T22:34:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.037+0000 7fcec17fa700 1 -- 172.21.15.59:0/410554333 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fceb8013c80 con 0x7fcec4133420 2023-09-30T22:34:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.038+0000 7fcec17fa700 1 -- 172.21.15.59:0/410554333 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fceb803f390 con 0x7fcec4133420 2023-09-30T22:34:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.038+0000 7fcecaf34700 1 -- 172.21.15.59:0/410554333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec4074ea0 con 0x7fcec4133420 2023-09-30T22:34:06.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.047+0000 7fcec17fa700 1 -- 172.21.15.59:0/410554333 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fceb8012370 con 0x7fcec4133420 2023-09-30T22:34:06.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.058+0000 7f3832b9e700 1 Processor -- start 2023-09-30T22:34:06.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.059+0000 7f3832b9e700 1 -- start start 2023-09-30T22:34:06.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.059+0000 7f3832b9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c1348a0 0x7f382c134c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.059+0000 7f3832b9e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f382c09dc40 0x7f382c13fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.059+0000 7f3832b9e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382c09ebc0 con 0x7f382c09d100 2023-09-30T22:34:06.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.059+0000 7f3832b9e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c095cb0 con 0x7f382c09dc40 2023-09-30T22:34:06.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.059+0000 7f3832b9e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382c09e980 con 0x7f382c1348a0 2023-09-30T22:34:06.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.059+0000 7f383139b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f382c09d100 0x7f382c09d530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46378/0 (socket says 172.21.15.59:46378) 2023-09-30T22:34:06.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.059+0000 7f383139b700 1 -- 172.21.15.59:0/2629743543 learned_addr learned my addr 172.21.15.59:0/2629743543 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:06.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.059+0000 7f383239d700 1 --2- 172.21.15.59:0/2629743543 >> v2:172.21.15.59:3300/0 conn(0x7f382c09dc40 0x7f382c13fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.060+0000 7f3831b9c700 1 --2- 172.21.15.59:0/2629743543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c1348a0 0x7f382c134c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.060+0000 7f383239d700 1 -- 172.21.15.59:0/2629743543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c1348a0 msgr2=0x7f382c134c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:06.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.060+0000 7f383239d700 1 --2- 172.21.15.59:0/2629743543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c1348a0 0x7f382c134c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.060+0000 7f383239d700 1 -- 172.21.15.59:0/2629743543 >> v1:172.21.15.59:6789/0 conn(0x7f382c09d100 legacy=0x7f382c09d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.060+0000 7f3830b9a700 1 -- 172.21.15.59:0/2629743543 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903114448 0 0) 0x7f382c09ebc0 con 0x7f382c09d100 2023-09-30T22:34:06.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.060+0000 7f383239d700 1 -- 172.21.15.59:0/2629743543 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c094ec0 con 0x7f382c09dc40 2023-09-30T22:34:06.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.060+0000 7f383239d700 1 --2- 172.21.15.59:0/2629743543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c09dc40 0x7f382c13fc40 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f3824009d90 tx=0x7f382400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3894a0a4e92b9c08 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:06.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.060+0000 7f3830b9a700 1 -- 172.21.15.59:0/2629743543 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382400e070 con 0x7f382c09dc40 2023-09-30T22:34:06.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.060+0000 7f3830b9a700 1 -- 172.21.15.59:0/2629743543 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382400bb20 con 0x7f382c09dc40 2023-09-30T22:34:06.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.060+0000 7f3830b9a700 1 -- 172.21.15.59:0/2629743543 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824012430 con 0x7f382c09dc40 2023-09-30T22:34:06.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.061+0000 7f3832b9e700 1 -- 172.21.15.59:0/2629743543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c09dc40 msgr2=0x7f382c13fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.061+0000 7f3832b9e700 1 --2- 172.21.15.59:0/2629743543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c09dc40 0x7f382c13fc40 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f3824009d90 tx=0x7f382400b330 comp rx=0 tx=0).stop 2023-09-30T22:34:06.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.061+0000 7f3832b9e700 1 -- 172.21.15.59:0/2629743543 shutdown_connections 2023-09-30T22:34:06.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.061+0000 7f3832b9e700 1 --2- 172.21.15.59:0/2629743543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c09dc40 0x7f382c13fc40 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.061+0000 7f3832b9e700 1 --2- 172.21.15.59:0/2629743543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c1348a0 0x7f382c134c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.061+0000 7f3832b9e700 1 -- 172.21.15.59:0/2629743543 >> 172.21.15.59:0/2629743543 conn(0x7f382c0a2540 msgr2=0x7f382c0a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:06.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.061+0000 7f3832b9e700 1 -- 172.21.15.59:0/2629743543 shutdown_connections 2023-09-30T22:34:06.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.061+0000 7f3832b9e700 1 -- 172.21.15.59:0/2629743543 wait complete. 2023-09-30T22:34:06.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.062+0000 7fd7ea5aa700 1 Processor -- start 2023-09-30T22:34:06.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.062+0000 7fd7ea5aa700 1 -- start start 2023-09-30T22:34:06.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.062+0000 7fd7ea5aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7e4130670 0x7fd7e4130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.063+0000 7fd7ea5aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7e406f680 0x7fd7e406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.063+0000 7fd7ea5aa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e4130260 con 0x7fd7e406ffd0 2023-09-30T22:34:06.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.063+0000 7fd7ea5aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e409a350 con 0x7fd7e4130670 2023-09-30T22:34:06.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.063+0000 7fd7ea5aa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e4071ff0 con 0x7fd7e406f680 2023-09-30T22:34:06.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.063+0000 7f3832b9e700 1 Processor -- start 2023-09-30T22:34:06.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.063+0000 7fd7e3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7e4130670 0x7fd7e4130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.063+0000 7fd7e3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7e4130670 0x7fd7e4130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58488/0 (socket says 172.21.15.59:58488) 2023-09-30T22:34:06.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.063+0000 7fd7e3fff700 1 -- 172.21.15.59:0/3477008745 learned_addr learned my addr 172.21.15.59:0/3477008745 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:06.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.063+0000 7fd7e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7e406f680 0x7fd7e406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.063+0000 7fd7e3fff700 1 -- 172.21.15.59:0/3477008745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7e406f680 msgr2=0x7fd7e406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:06.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.063+0000 7fd7e3fff700 1 --2- 172.21.15.59:0/3477008745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7e406f680 0x7fd7e406fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.063+0000 7fd7e3fff700 1 -- 172.21.15.59:0/3477008745 >> v1:172.21.15.59:6789/0 conn(0x7fd7e406ffd0 legacy=0x7fd7e4137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.063+0000 7fd7e3fff700 1 -- 172.21.15.59:0/3477008745 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e4070470 con 0x7fd7e4130670 2023-09-30T22:34:06.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.063+0000 7fd7e37fe700 1 --2- 172.21.15.59:0/3477008745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7e406f680 0x7fd7e406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:06.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.063+0000 7f3832b9e700 1 -- start start 2023-09-30T22:34:06.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f3832b9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c09d100 0x7f382c133980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f3832b9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c09dc40 0x7f382c133ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f3832b9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c1348a0 0x7f382c06dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f3832b9e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c072a80 con 0x7f382c09dc40 2023-09-30T22:34:06.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f3832b9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c071340 con 0x7f382c09d100 2023-09-30T22:34:06.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f3832b9e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382c071600 con 0x7f382c1348a0 2023-09-30T22:34:06.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7fd7e3fff700 1 --2- 172.21.15.59:0/3477008745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7e4130670 0x7fd7e4130a40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400b9d0 tx=0x7fd7d400bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=173ec1fb55681eb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:06.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7fd7e2ffd700 1 -- 172.21.15.59:0/3477008745 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d400cc60 con 0x7fd7e4130670 2023-09-30T22:34:06.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f383139b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c09dc40 0x7f382c133ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f383139b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c09dc40 0x7f382c133ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35810/0 (socket says 172.21.15.59:35810) 2023-09-30T22:34:06.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f383139b700 1 -- 172.21.15.59:0/67773202 learned_addr learned my addr 172.21.15.59:0/67773202 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:06.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f383239d700 1 --2- 172.21.15.59:0/67773202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c1348a0 0x7f382c06dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7fd7e2ffd700 1 -- 172.21.15.59:0/3477008745 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d400cdc0 con 0x7fd7e4130670 2023-09-30T22:34:06.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7fd7e2ffd700 1 -- 172.21.15.59:0/3477008745 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d400f680 con 0x7fd7e4130670 2023-09-30T22:34:06.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f383239d700 1 -- 172.21.15.59:0/67773202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c09d100 msgr2=0x7f382c133980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f383239d700 1 --2- 172.21.15.59:0/67773202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c09d100 0x7f382c133980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f383239d700 1 -- 172.21.15.59:0/67773202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c09dc40 msgr2=0x7f382c133ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f383239d700 1 --2- 172.21.15.59:0/67773202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c09dc40 0x7f382c133ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f383239d700 1 -- 172.21.15.59:0/67773202 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3824009a70 con 0x7f382c1348a0 2023-09-30T22:34:06.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.064+0000 7f383239d700 1 --2- 172.21.15.59:0/67773202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c1348a0 0x7f382c06dfb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3824016000 tx=0x7f3824004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:06.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.065+0000 7fd7ea5aa700 1 -- 172.21.15.59:0/3477008745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7e4130670 msgr2=0x7fd7e4130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.065+0000 7fd7ea5aa700 1 --2- 172.21.15.59:0/3477008745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7e4130670 0x7fd7e4130a40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400b9d0 tx=0x7fd7d400bce0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.065+0000 7fd7ea5aa700 1 -- 172.21.15.59:0/3477008745 shutdown_connections 2023-09-30T22:34:06.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.065+0000 7fd7ea5aa700 1 --2- 172.21.15.59:0/3477008745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7e4130670 0x7fd7e4130a40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.065+0000 7fd7ea5aa700 1 --2- 172.21.15.59:0/3477008745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7e406f680 0x7fd7e406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.065+0000 7fd7ea5aa700 1 -- 172.21.15.59:0/3477008745 >> 172.21.15.59:0/3477008745 conn(0x7fd7e40a2aa0 msgr2=0x7fd7e40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:06.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.065+0000 7fd7ea5aa700 1 -- 172.21.15.59:0/3477008745 shutdown_connections 2023-09-30T22:34:06.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.065+0000 7fd7ea5aa700 1 -- 172.21.15.59:0/3477008745 wait complete. 2023-09-30T22:34:06.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.066+0000 7fd7ea5aa700 1 Processor -- start 2023-09-30T22:34:06.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.066+0000 7fd7ea5aa700 1 -- start start 2023-09-30T22:34:06.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7f38227fc700 1 -- 172.21.15.59:0/67773202 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824012430 con 0x7f382c1348a0 2023-09-30T22:34:06.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7f38227fc700 1 -- 172.21.15.59:0/67773202 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3824020070 con 0x7f382c1348a0 2023-09-30T22:34:06.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7f3832b9e700 1 -- 172.21.15.59:0/67773202 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382c134400 con 0x7f382c1348a0 2023-09-30T22:34:06.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7f38227fc700 1 -- 172.21.15.59:0/67773202 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824004280 con 0x7f382c1348a0 2023-09-30T22:34:06.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7f3832b9e700 1 -- 172.21.15.59:0/67773202 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c072070 con 0x7f382c1348a0 2023-09-30T22:34:06.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7fd7ea5aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7e406f680 0x7fd7e411b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7fd7ea5aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7e406ffd0 0x7fd7e411be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7fd7ea5aa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e4130670 0x7fd7e411c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7fd7ea5aa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e411e820 con 0x7fd7e4130670 2023-09-30T22:34:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7fd7ea5aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e411cdb0 con 0x7fd7e406f680 2023-09-30T22:34:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7fd7ea5aa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e4071820 con 0x7fd7e406ffd0 2023-09-30T22:34:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7fd7e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7e406ffd0 0x7fd7e411be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7fd7e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7e406ffd0 0x7fd7e411be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41410/0 (socket says 172.21.15.59:41410) 2023-09-30T22:34:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7fd7e37fe700 1 -- 172.21.15.59:0/1722782022 learned_addr learned my addr 172.21.15.59:0/1722782022 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7fd7e3fff700 1 --2- 172.21.15.59:0/1722782022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7e406f680 0x7fd7e411b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.067+0000 7fd7e8b47700 1 --2- 172.21.15.59:0/1722782022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e4130670 0x7fd7e411c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.068+0000 7fd7e3fff700 1 -- 172.21.15.59:0/1722782022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7e406ffd0 msgr2=0x7fd7e411be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.068+0000 7fd7e3fff700 1 --2- 172.21.15.59:0/1722782022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7e406ffd0 0x7fd7e411be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.068+0000 7fd7e3fff700 1 -- 172.21.15.59:0/1722782022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e4130670 msgr2=0x7fd7e411c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.068+0000 7fd7e3fff700 1 --2- 172.21.15.59:0/1722782022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e4130670 0x7fd7e411c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.068+0000 7fd7e3fff700 1 -- 172.21.15.59:0/1722782022 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d800d940 con 0x7fd7e406f680 2023-09-30T22:34:06.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.068+0000 7f3832b9e700 1 -- 172.21.15.59:0/67773202 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c04f2a0 con 0x7f382c1348a0 2023-09-30T22:34:06.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.068+0000 7fd7e3fff700 1 --2- 172.21.15.59:0/1722782022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7e406f680 0x7fd7e411b950 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400b9d0 tx=0x7fd7d4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.069+0000 7fd7e0ff9700 1 -- 172.21.15.59:0/1722782022 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d401d070 con 0x7fd7e406f680 2023-09-30T22:34:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.069+0000 7fd7e0ff9700 1 -- 172.21.15.59:0/1722782022 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d400be70 con 0x7fd7e406f680 2023-09-30T22:34:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.069+0000 7fd7e0ff9700 1 -- 172.21.15.59:0/1722782022 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4004290 con 0x7fd7e406f680 2023-09-30T22:34:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.069+0000 7fd7ea5aa700 1 -- 172.21.15.59:0/1722782022 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d400b600 con 0x7fd7e406f680 2023-09-30T22:34:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.069+0000 7fd7ea5aa700 1 -- 172.21.15.59:0/1722782022 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e412ec60 con 0x7fd7e406f680 2023-09-30T22:34:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.069+0000 7f38227fc700 1 -- 172.21.15.59:0/67773202 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38240043e0 con 0x7f382c1348a0 2023-09-30T22:34:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.069+0000 7f38227fc700 1 -- 172.21.15.59:0/67773202 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3824022070 con 0x7f382c1348a0 2023-09-30T22:34:06.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.070+0000 7fd7e0ff9700 1 -- 172.21.15.59:0/1722782022 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd7d40043f0 con 0x7fd7e406f680 2023-09-30T22:34:06.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.071+0000 7fd2c3453700 1 Processor -- start 2023-09-30T22:34:06.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.071+0000 7fd2c3453700 1 -- start start 2023-09-30T22:34:06.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.072+0000 7fd2c3453700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2bc095690 0x7fd2bc134cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.072+0000 7fd2c3453700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc1378f0 0x7fd2bc137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.072+0000 7fd2c3453700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc138260 0x7fd2bc13ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.072+0000 7fd2c3453700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc095a60 con 0x7fd2bc095690 2023-09-30T22:34:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.072+0000 7fd2c3453700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc09e800 con 0x7fd2bc138260 2023-09-30T22:34:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.072+0000 7fd2c3453700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc094bd0 con 0x7fd2bc1378f0 2023-09-30T22:34:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.072+0000 7fd2c09ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc1378f0 0x7fd2bc137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.072+0000 7fd2c09ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc1378f0 0x7fd2bc137d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41416/0 (socket says 172.21.15.59:41416) 2023-09-30T22:34:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.072+0000 7fd2c09ee700 1 -- 172.21.15.59:0/19785633 learned_addr learned my addr 172.21.15.59:0/19785633 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.072+0000 7fd2c19f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc138260 0x7fd2bc13ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.072+0000 7fd2c09ee700 1 -- 172.21.15.59:0/19785633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc138260 msgr2=0x7fd2bc13ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.072+0000 7fd2c09ee700 1 --2- 172.21.15.59:0/19785633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc138260 0x7fd2bc13ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.072+0000 7fd2c09ee700 1 -- 172.21.15.59:0/19785633 >> v2:172.21.15.59:3300/0 conn(0x7fd2bc095690 msgr2=0x7fd2bc134cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.072+0000 7fd2c09ee700 1 --2- 172.21.15.59:0/19785633 >> v2:172.21.15.59:3300/0 conn(0x7fd2bc095690 0x7fd2bc134cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.072+0000 7fd2c09ee700 1 -- 172.21.15.59:0/19785633 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc0940e0 con 0x7fd2bc1378f0 2023-09-30T22:34:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.073+0000 7fd2c09ee700 1 --2- 172.21.15.59:0/19785633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc1378f0 0x7fd2bc137d20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0098f0 tx=0x7fd2ac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f8544e3cec90514 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:06.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.073+0000 7fd7ea5aa700 1 -- 172.21.15.59:0/1722782022 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e4074ea0 con 0x7fd7e406f680 2023-09-30T22:34:06.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.073+0000 7fd7e0ff9700 1 -- 172.21.15.59:0/1722782022 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd7d40036a0 con 0x7fd7e406f680 2023-09-30T22:34:06.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.074+0000 7fd2b3fff700 1 -- 172.21.15.59:0/19785633 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac011830 con 0x7fd2bc1378f0 2023-09-30T22:34:06.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.074+0000 7fd2b3fff700 1 -- 172.21.15.59:0/19785633 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac011990 con 0x7fd2bc1378f0 2023-09-30T22:34:06.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.074+0000 7fd2b3fff700 1 -- 172.21.15.59:0/19785633 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac011d20 con 0x7fd2bc1378f0 2023-09-30T22:34:06.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.074+0000 7f38227fc700 1 -- 172.21.15.59:0/67773202 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3824004690 con 0x7f382c1348a0 2023-09-30T22:34:06.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.075+0000 7fd2c3453700 1 -- 172.21.15.59:0/19785633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc1378f0 msgr2=0x7fd2bc137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.075+0000 7fd2c3453700 1 --2- 172.21.15.59:0/19785633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc1378f0 0x7fd2bc137d20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0098f0 tx=0x7fd2ac009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:06.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.078+0000 7fd2c3453700 1 -- 172.21.15.59:0/19785633 shutdown_connections 2023-09-30T22:34:06.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.078+0000 7fd2c3453700 1 --2- 172.21.15.59:0/19785633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc138260 0x7fd2bc13ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.078+0000 7fd2c3453700 1 --2- 172.21.15.59:0/19785633 >> v2:172.21.15.59:3300/0 conn(0x7fd2bc095690 0x7fd2bc134cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.078+0000 7fd2c3453700 1 --2- 172.21.15.59:0/19785633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc1378f0 0x7fd2bc137d20 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.078+0000 7fd2c3453700 1 -- 172.21.15.59:0/19785633 >> 172.21.15.59:0/19785633 conn(0x7fd2bc0a2360 msgr2=0x7fd2bc0a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:06.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.078+0000 7fd2c3453700 1 -- 172.21.15.59:0/19785633 shutdown_connections 2023-09-30T22:34:06.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.078+0000 7fd2c3453700 1 -- 172.21.15.59:0/19785633 wait complete. 2023-09-30T22:34:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.078+0000 7fd7e0ff9700 1 -- 172.21.15.59:0/1722782022 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7d4046060 con 0x7fd7e406f680 2023-09-30T22:34:06.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.079+0000 7fd2c3453700 1 Processor -- start 2023-09-30T22:34:06.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.079+0000 7fd2c3453700 1 -- start start 2023-09-30T22:34:06.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.079+0000 7fd2c3453700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc095690 0x7fd2bc071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.079+0000 7fd2c3453700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc1378f0 0x7fd2bc0715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.079+0000 7fd2c3453700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc138260 0x7fd2bc06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.079+0000 7fd2c3453700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc070530 con 0x7fd2bc138260 2023-09-30T22:34:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.079+0000 7fd2c3453700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc093630 con 0x7fd2bc095690 2023-09-30T22:34:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.079+0000 7fd2c3453700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc071d70 con 0x7fd2bc1378f0 2023-09-30T22:34:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.079+0000 7fd2c09ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc1378f0 0x7fd2bc0715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.079+0000 7fd2c19f0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc138260 0x7fd2bc06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.080+0000 7fd2c09ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc1378f0 0x7fd2bc0715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41430/0 (socket says 172.21.15.59:41430) 2023-09-30T22:34:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.080+0000 7fd2c09ee700 1 -- 172.21.15.59:0/2333427908 learned_addr learned my addr 172.21.15.59:0/2333427908 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.080+0000 7fd2c09ee700 1 -- 172.21.15.59:0/2333427908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc095690 msgr2=0x7fd2bc071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.080+0000 7fd2c09ee700 1 --2- 172.21.15.59:0/2333427908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc095690 0x7fd2bc071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.080+0000 7fd2c09ee700 1 -- 172.21.15.59:0/2333427908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc138260 msgr2=0x7fd2bc06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.080+0000 7fd2c09ee700 1 --2- 172.21.15.59:0/2333427908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc138260 0x7fd2bc06eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.080+0000 7fd2c09ee700 1 -- 172.21.15.59:0/2333427908 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac009550 con 0x7fd2bc1378f0 2023-09-30T22:34:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.080+0000 7fd2c19f0700 1 --2- 172.21.15.59:0/2333427908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc138260 0x7fd2bc06eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.080+0000 7fd2c09ee700 1 --2- 172.21.15.59:0/2333427908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc1378f0 0x7fd2bc0715b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac000c00 tx=0x7fd2ac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.080+0000 7fd2b1ffb700 1 -- 172.21.15.59:0/2333427908 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac004590 con 0x7fd2bc1378f0 2023-09-30T22:34:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.080+0000 7fd2b1ffb700 1 -- 172.21.15.59:0/2333427908 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac0036a0 con 0x7fd2bc1378f0 2023-09-30T22:34:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.080+0000 7fd2c3453700 1 -- 172.21.15.59:0/2333427908 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc093170 con 0x7fd2bc1378f0 2023-09-30T22:34:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.080+0000 7fd2b1ffb700 1 -- 172.21.15.59:0/2333427908 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac003a30 con 0x7fd2bc1378f0 2023-09-30T22:34:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.081+0000 7fd2c3453700 1 -- 172.21.15.59:0/2333427908 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc1389e0 con 0x7fd2bc1378f0 2023-09-30T22:34:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.082+0000 7fd2b1ffb700 1 -- 172.21.15.59:0/2333427908 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2ac021070 con 0x7fd2bc1378f0 2023-09-30T22:34:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.082+0000 7fd2b1ffb700 1 -- 172.21.15.59:0/2333427908 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd2ac040aa0 con 0x7fd2bc1378f0 2023-09-30T22:34:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.086+0000 7fd2c3453700 1 -- 172.21.15.59:0/2333427908 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc071bb0 con 0x7fd2bc1378f0 2023-09-30T22:34:06.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.091+0000 7fd2b1ffb700 1 -- 172.21.15.59:0/2333427908 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2ac015020 con 0x7fd2bc1378f0 2023-09-30T22:34:06.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.284+0000 7f3832b9e700 1 -- 172.21.15.59:0/67773202 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f382c06b7c0 con 0x7f382c1348a0 2023-09-30T22:34:06.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.284+0000 7f38227fc700 1 -- 172.21.15.59:0/67773202 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3824035090 con 0x7f382c1348a0 2023-09-30T22:34:06.286 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:06.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.286+0000 7fd7ea5aa700 1 -- 172.21.15.59:0/1722782022 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd7e4072210 con 0x7fd7e406f680 2023-09-30T22:34:06.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.286+0000 7fd7e0ff9700 1 -- 172.21.15.59:0/1722782022 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd7d4026030 con 0x7fd7e406f680 2023-09-30T22:34:06.287 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:06.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.287+0000 7f3832b9e700 1 -- 172.21.15.59:0/67773202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c1348a0 msgr2=0x7f382c06dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.287+0000 7f3832b9e700 1 --2- 172.21.15.59:0/67773202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c1348a0 0x7f382c06dfb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3824016000 tx=0x7f3824004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.287+0000 7f3832b9e700 1 -- 172.21.15.59:0/67773202 shutdown_connections 2023-09-30T22:34:06.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.287+0000 7f3832b9e700 1 --2- 172.21.15.59:0/67773202 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c1348a0 0x7f382c06dfb0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.287+0000 7f3832b9e700 1 --2- 172.21.15.59:0/67773202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c09d100 0x7f382c133980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.287+0000 7f3832b9e700 1 --2- 172.21.15.59:0/67773202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c09dc40 0x7f382c133ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.287+0000 7f3832b9e700 1 -- 172.21.15.59:0/67773202 >> 172.21.15.59:0/67773202 conn(0x7f382c0a2540 msgr2=0x7f382c0a14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:06.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.287+0000 7f3832b9e700 1 -- 172.21.15.59:0/67773202 shutdown_connections 2023-09-30T22:34:06.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.287+0000 7f3832b9e700 1 -- 172.21.15.59:0/67773202 wait complete. 2023-09-30T22:34:06.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.288+0000 7fd7ea5aa700 1 -- 172.21.15.59:0/1722782022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7e406f680 msgr2=0x7fd7e411b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.288+0000 7fd7ea5aa700 1 --2- 172.21.15.59:0/1722782022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7e406f680 0x7fd7e411b950 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400b9d0 tx=0x7fd7d4004750 comp rx=0 tx=0).stop 2023-09-30T22:34:06.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.289+0000 7fd7ea5aa700 1 -- 172.21.15.59:0/1722782022 shutdown_connections 2023-09-30T22:34:06.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.289+0000 7fd7ea5aa700 1 --2- 172.21.15.59:0/1722782022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e4130670 0x7fd7e411c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.289+0000 7fd7ea5aa700 1 --2- 172.21.15.59:0/1722782022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7e406f680 0x7fd7e411b950 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.289+0000 7fd7ea5aa700 1 --2- 172.21.15.59:0/1722782022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7e406ffd0 0x7fd7e411be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.289+0000 7fd7ea5aa700 1 -- 172.21.15.59:0/1722782022 >> 172.21.15.59:0/1722782022 conn(0x7fd7e40a2aa0 msgr2=0x7fd7e406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:06.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.289+0000 7fd7ea5aa700 1 -- 172.21.15.59:0/1722782022 shutdown_connections 2023-09-30T22:34:06.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.289+0000 7fd7ea5aa700 1 -- 172.21.15.59:0/1722782022 wait complete. 2023-09-30T22:34:06.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.295+0000 7fcecaf34700 1 -- 172.21.15.59:0/410554333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcec411fd20 con 0x7fcec4133420 2023-09-30T22:34:06.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.295+0000 7fcec17fa700 1 -- 172.21.15.59:0/410554333 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fceb8010310 con 0x7fcec4133420 2023-09-30T22:34:06.296 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.298+0000 7fcecaf34700 1 -- 172.21.15.59:0/410554333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4133420 msgr2=0x7fcec409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.298+0000 7fcecaf34700 1 --2- 172.21.15.59:0/410554333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4133420 0x7fcec409c480 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fceb800e840 tx=0x7fceb800eb50 comp rx=0 tx=0).stop 2023-09-30T22:34:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.298+0000 7fcecaf34700 1 -- 172.21.15.59:0/410554333 shutdown_connections 2023-09-30T22:34:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.298+0000 7fcecaf34700 1 --2- 172.21.15.59:0/410554333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec4134260 0x7fcec409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.298+0000 7fcecaf34700 1 --2- 172.21.15.59:0/410554333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4133420 0x7fcec409c480 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.298+0000 7fcecaf34700 1 --2- 172.21.15.59:0/410554333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcec4133e30 0x7fcec409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.298+0000 7fcecaf34700 1 -- 172.21.15.59:0/410554333 >> 172.21.15.59:0/410554333 conn(0x7fcec40a4210 msgr2=0x7fcec40a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.298+0000 7fcecaf34700 1 -- 172.21.15.59:0/410554333 shutdown_connections 2023-09-30T22:34:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.298+0000 7fcecaf34700 1 -- 172.21.15.59:0/410554333 wait complete. 2023-09-30T22:34:06.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:06.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:06.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:06.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.327+0000 7fd2c3453700 1 -- 172.21.15.59:0/2333427908 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd2bc074ea0 con 0x7fd2bc1378f0 2023-09-30T22:34:06.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.327+0000 7fd2b1ffb700 1 -- 172.21.15.59:0/2333427908 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd2ac032070 con 0x7fd2bc1378f0 2023-09-30T22:34:06.328 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:06.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.329+0000 7fd2c3453700 1 -- 172.21.15.59:0/2333427908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc1378f0 msgr2=0x7fd2bc0715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:06.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.329+0000 7fd2c3453700 1 --2- 172.21.15.59:0/2333427908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc1378f0 0x7fd2bc0715b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac000c00 tx=0x7fd2ac004750 comp rx=0 tx=0).stop 2023-09-30T22:34:06.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.329+0000 7fd2c3453700 1 -- 172.21.15.59:0/2333427908 shutdown_connections 2023-09-30T22:34:06.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.329+0000 7fd2c3453700 1 --2- 172.21.15.59:0/2333427908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc138260 0x7fd2bc06eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.329+0000 7fd2c3453700 1 --2- 172.21.15.59:0/2333427908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc095690 0x7fd2bc071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.330+0000 7fd2c3453700 1 --2- 172.21.15.59:0/2333427908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc1378f0 0x7fd2bc0715b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:06.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.330+0000 7fd2c3453700 1 -- 172.21.15.59:0/2333427908 >> 172.21.15.59:0/2333427908 conn(0x7fd2bc0a2360 msgr2=0x7fd2bc09b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:06.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.330+0000 7fd2c3453700 1 -- 172.21.15.59:0/2333427908 shutdown_connections 2023-09-30T22:34:06.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:06.330+0000 7fd2c3453700 1 -- 172.21.15.59:0/2333427908 wait complete. 2023-09-30T22:34:06.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:07.305 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:07.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:07.315 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:07.346 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:07.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.461+0000 7f9acb88c700 1 Processor -- start 2023-09-30T22:34:07.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.461+0000 7f9acb88c700 1 -- start start 2023-09-30T22:34:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.462+0000 7f9acb88c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ac409e1d0 0x7f9ac4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.462+0000 7f9acb88c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ac4139170 0x7f9ac413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.462+0000 7f9acb88c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac409b120 con 0x7f9ac409d6f0 2023-09-30T22:34:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.462+0000 7f9acb88c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac406b460 con 0x7f9ac4139170 2023-09-30T22:34:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.462+0000 7f9acb88c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac409a7e0 con 0x7f9ac409e1d0 2023-09-30T22:34:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.462+0000 7f9ac8e27700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ac409e1d0 0x7f9ac4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.462+0000 7f9ac8e27700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ac409e1d0 0x7f9ac4138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41438/0 (socket says 172.21.15.59:41438) 2023-09-30T22:34:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.462+0000 7f9ac8e27700 1 -- 172.21.15.59:0/4259083785 learned_addr learned my addr 172.21.15.59:0/4259083785 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:07.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.462+0000 7f9ac9e29700 1 --2- 172.21.15.59:0/4259083785 >> v2:172.21.15.59:3300/0 conn(0x7f9ac4139170 0x7f9ac413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.463+0000 7f9ac8e27700 1 -- 172.21.15.59:0/4259083785 >> v2:172.21.15.59:3300/0 conn(0x7f9ac4139170 msgr2=0x7f9ac413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:07.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.463+0000 7f9ac8e27700 1 --2- 172.21.15.59:0/4259083785 >> v2:172.21.15.59:3300/0 conn(0x7f9ac4139170 0x7f9ac413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.463+0000 7f9ac8e27700 1 -- 172.21.15.59:0/4259083785 >> v1:172.21.15.59:6789/0 conn(0x7f9ac409d6f0 legacy=0x7f9ac409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:07.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.463+0000 7f9ac8e27700 1 -- 172.21.15.59:0/4259083785 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac409a500 con 0x7f9ac409e1d0 2023-09-30T22:34:07.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.463+0000 7f8392ba0700 1 Processor -- start 2023-09-30T22:34:07.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.463+0000 7f8392ba0700 1 -- start start 2023-09-30T22:34:07.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.463+0000 7f9ac8e27700 1 --2- 172.21.15.59:0/4259083785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ac409e1d0 0x7f9ac4138c30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009920 tx=0x7f9ab4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7060dfb58e7c467b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:07.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.463+0000 7f8392ba0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f838c130540 0x7f838c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.463+0000 7f8392ba0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f838c130e50 0x7f838c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.463+0000 7f8392ba0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838c0716a0 con 0x7f838c06fb20 2023-09-30T22:34:07.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.463+0000 7f8392ba0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c09a390 con 0x7f838c130540 2023-09-30T22:34:07.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.463+0000 7f8392ba0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f838c071290 con 0x7f838c130e50 2023-09-30T22:34:07.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.463+0000 7f9abbfff700 1 -- 172.21.15.59:0/4259083785 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4004230 con 0x7f9ac409e1d0 2023-09-30T22:34:07.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f9abbfff700 1 -- 172.21.15.59:0/4259083785 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab4004390 con 0x7f9ac409e1d0 2023-09-30T22:34:07.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f9abbfff700 1 -- 172.21.15.59:0/4259083785 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4009e70 con 0x7f9ac409e1d0 2023-09-30T22:34:07.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f839113d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f838c06fb20 0x7f838c137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46400/0 (socket says 172.21.15.59:46400) 2023-09-30T22:34:07.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f839113d700 1 -- 172.21.15.59:0/3789475445 learned_addr learned my addr 172.21.15.59:0/3789475445 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:07.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f838bfff700 1 --2- 172.21.15.59:0/3789475445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f838c130e50 0x7f838c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f839093c700 1 --2- 172.21.15.59:0/3789475445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f838c130540 0x7f838c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f838b7fe700 1 -- 172.21.15.59:0/3789475445 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888340796 0 0) 0x7f838c0716a0 con 0x7f838c06fb20 2023-09-30T22:34:07.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f838b7fe700 1 -- 172.21.15.59:0/3789475445 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f837c0057c0 con 0x7f838c06fb20 2023-09-30T22:34:07.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f839093c700 1 -- 172.21.15.59:0/3789475445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f838c130e50 msgr2=0x7f838c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:07.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f839093c700 1 --2- 172.21.15.59:0/3789475445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f838c130e50 0x7f838c06f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f839093c700 1 -- 172.21.15.59:0/3789475445 >> v1:172.21.15.59:6789/0 conn(0x7f838c06fb20 legacy=0x7f838c137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f839093c700 1 -- 172.21.15.59:0/3789475445 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c130340 con 0x7f838c130540 2023-09-30T22:34:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f838bfff700 1 --2- 172.21.15.59:0/3789475445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f838c130e50 0x7f838c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f9acb88c700 1 -- 172.21.15.59:0/4259083785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ac409e1d0 msgr2=0x7f9ac4138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f9acb88c700 1 --2- 172.21.15.59:0/4259083785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ac409e1d0 0x7f9ac4138c30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009920 tx=0x7f9ab4009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.464+0000 7f839093c700 1 --2- 172.21.15.59:0/3789475445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f838c130540 0x7f838c130910 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f83800098a0 tx=0x7f8380009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95802f3dcf3cc6d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:07.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.465+0000 7f9acb88c700 1 -- 172.21.15.59:0/4259083785 shutdown_connections 2023-09-30T22:34:07.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.465+0000 7f9acb88c700 1 --2- 172.21.15.59:0/4259083785 >> v2:172.21.15.59:3300/0 conn(0x7f9ac4139170 0x7f9ac413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.465+0000 7f9acb88c700 1 --2- 172.21.15.59:0/4259083785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ac409e1d0 0x7f9ac4138c30 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.465+0000 7f9acb88c700 1 -- 172.21.15.59:0/4259083785 >> 172.21.15.59:0/4259083785 conn(0x7f9ac4066f50 msgr2=0x7f9ac409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:07.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.465+0000 7f838b7fe700 1 -- 172.21.15.59:0/3789475445 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380011830 con 0x7f838c130540 2023-09-30T22:34:07.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.465+0000 7f9acb88c700 1 -- 172.21.15.59:0/4259083785 shutdown_connections 2023-09-30T22:34:07.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.465+0000 7f9acb88c700 1 -- 172.21.15.59:0/4259083785 wait complete. 2023-09-30T22:34:07.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.465+0000 7f838b7fe700 1 -- 172.21.15.59:0/3789475445 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8380011990 con 0x7f838c130540 2023-09-30T22:34:07.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.465+0000 7f838b7fe700 1 -- 172.21.15.59:0/3789475445 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380011d20 con 0x7f838c130540 2023-09-30T22:34:07.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f9acb88c700 1 Processor -- start 2023-09-30T22:34:07.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f9acb88c700 1 -- start start 2023-09-30T22:34:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f8392ba0700 1 -- 172.21.15.59:0/3789475445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f838c130540 msgr2=0x7f838c130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f8392ba0700 1 --2- 172.21.15.59:0/3789475445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f838c130540 0x7f838c130910 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f83800098a0 tx=0x7f8380009bb0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f8392ba0700 1 -- 172.21.15.59:0/3789475445 shutdown_connections 2023-09-30T22:34:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f8392ba0700 1 --2- 172.21.15.59:0/3789475445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f838c130540 0x7f838c130910 secure :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f83800098a0 tx=0x7f8380009bb0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f8392ba0700 1 --2- 172.21.15.59:0/3789475445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f838c130e50 0x7f838c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f8392ba0700 1 -- 172.21.15.59:0/3789475445 >> 172.21.15.59:0/3789475445 conn(0x7f838c0a2aa0 msgr2=0x7f838c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f8392ba0700 1 -- 172.21.15.59:0/3789475445 shutdown_connections 2023-09-30T22:34:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f8392ba0700 1 -- 172.21.15.59:0/3789475445 wait complete. 2023-09-30T22:34:07.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f9acb88c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ac409d6f0 0x7f9ac41c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f9acb88c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ac409e1d0 0x7f9ac41c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f9acb88c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ac4139170 0x7f9ac411e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f9acb88c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac4134780 con 0x7f9ac409d6f0 2023-09-30T22:34:07.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f9acb88c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac41203c0 con 0x7f9ac409e1d0 2023-09-30T22:34:07.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.466+0000 7f9acb88c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40a2b90 con 0x7f9ac4139170 2023-09-30T22:34:07.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.467+0000 7f9ac8e27700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ac409e1d0 0x7f9ac41c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.467+0000 7f9ac9628700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ac409d6f0 0x7f9ac41c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.467+0000 7f9ac8e27700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ac409e1d0 0x7f9ac41c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58552/0 (socket says 172.21.15.59:58552) 2023-09-30T22:34:07.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.467+0000 7f9ac8e27700 1 -- 172.21.15.59:0/3383841632 learned_addr learned my addr 172.21.15.59:0/3383841632 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:07.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.467+0000 7f9ac9e29700 1 --2- 172.21.15.59:0/3383841632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ac4139170 0x7f9ac411e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.467+0000 7f9ac9e29700 1 -- 172.21.15.59:0/3383841632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ac409e1d0 msgr2=0x7f9ac41c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.467+0000 7f9ac9e29700 1 --2- 172.21.15.59:0/3383841632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ac409e1d0 0x7f9ac41c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.467+0000 7f9ac9e29700 1 -- 172.21.15.59:0/3383841632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ac409d6f0 msgr2=0x7f9ac41c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.467+0000 7f9ac9e29700 1 --2- 172.21.15.59:0/3383841632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ac409d6f0 0x7f9ac41c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.467+0000 7f9ac9e29700 1 -- 172.21.15.59:0/3383841632 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab4009550 con 0x7f9ac4139170 2023-09-30T22:34:07.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.467+0000 7f9ac9e29700 1 --2- 172.21.15.59:0/3383841632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ac4139170 0x7f9ac411e8e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9abc007d90 tx=0x7f9abc00e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:07.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.468+0000 7f9ab9ffb700 1 -- 172.21.15.59:0/3383841632 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc018070 con 0x7f9ac4139170 2023-09-30T22:34:07.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.468+0000 7f9ab9ffb700 1 -- 172.21.15.59:0/3383841632 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc00eb30 con 0x7f9ac4139170 2023-09-30T22:34:07.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.468+0000 7f9ab9ffb700 1 -- 172.21.15.59:0/3383841632 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc003a20 con 0x7f9ac4139170 2023-09-30T22:34:07.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.468+0000 7f8392ba0700 1 Processor -- start 2023-09-30T22:34:07.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.468+0000 7f9acb88c700 1 -- 172.21.15.59:0/3383841632 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac409c710 con 0x7f9ac4139170 2023-09-30T22:34:07.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.468+0000 7f9acb88c700 1 -- 172.21.15.59:0/3383841632 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac4121a60 con 0x7f9ac4139170 2023-09-30T22:34:07.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.468+0000 7f8392ba0700 1 -- start start 2023-09-30T22:34:07.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.469+0000 7f8392ba0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838c06fb20 0x7f838c122580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.469+0000 7f8392ba0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f838c130e50 0x7f838c122ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.469+0000 7f8392ba0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f838c123000 0x7f838c1cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.469+0000 7f8392ba0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c1239c0 con 0x7f838c06fb20 2023-09-30T22:34:07.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.469+0000 7f8392ba0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c0718e0 con 0x7f838c123000 2023-09-30T22:34:07.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.469+0000 7f8392ba0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f838c126c20 con 0x7f838c130e50 2023-09-30T22:34:07.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.469+0000 7f839093c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838c06fb20 0x7f838c122580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.469+0000 7f839093c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838c06fb20 0x7f838c122580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35866/0 (socket says 172.21.15.59:35866) 2023-09-30T22:34:07.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.469+0000 7f839093c700 1 -- 172.21.15.59:0/649776915 learned_addr learned my addr 172.21.15.59:0/649776915 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:07.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.470+0000 7f839093c700 1 -- 172.21.15.59:0/649776915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f838c130e50 msgr2=0x7f838c122ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.470+0000 7f839093c700 1 --2- 172.21.15.59:0/649776915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f838c130e50 0x7f838c122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.470+0000 7f839093c700 1 -- 172.21.15.59:0/649776915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f838c123000 msgr2=0x7f838c1cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.470+0000 7f839093c700 1 --2- 172.21.15.59:0/649776915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f838c123000 0x7f838c1cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.470+0000 7f839093c700 1 -- 172.21.15.59:0/649776915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83780094a0 con 0x7f838c06fb20 2023-09-30T22:34:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.470+0000 7f9acb88c700 1 -- 172.21.15.59:0/3383841632 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac4074ea0 con 0x7f9ac4139170 2023-09-30T22:34:07.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.470+0000 7f839093c700 1 --2- 172.21.15.59:0/649776915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838c06fb20 0x7f838c122580 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f83800090b0 tx=0x7f8380004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:07.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.470+0000 7f83897fa700 1 -- 172.21.15.59:0/649776915 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83800042c0 con 0x7f838c06fb20 2023-09-30T22:34:07.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.470+0000 7f83897fa700 1 -- 172.21.15.59:0/649776915 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838001f070 con 0x7f838c06fb20 2023-09-30T22:34:07.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.470+0000 7f83897fa700 1 -- 172.21.15.59:0/649776915 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83800036a0 con 0x7f838c06fb20 2023-09-30T22:34:07.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.470+0000 7f8392ba0700 1 -- 172.21.15.59:0/649776915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83800094a0 con 0x7f838c06fb20 2023-09-30T22:34:07.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.470+0000 7f8392ba0700 1 -- 172.21.15.59:0/649776915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838c124880 con 0x7f838c06fb20 2023-09-30T22:34:07.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.471+0000 7f83897fa700 1 -- 172.21.15.59:0/649776915 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8380021030 con 0x7f838c06fb20 2023-09-30T22:34:07.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.471+0000 7f8392ba0700 1 -- 172.21.15.59:0/649776915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838c125b20 con 0x7f838c06fb20 2023-09-30T22:34:07.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.472+0000 7f83897fa700 1 -- 172.21.15.59:0/649776915 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8380048350 con 0x7f838c06fb20 2023-09-30T22:34:07.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.470+0000 7f9ab9ffb700 1 -- 172.21.15.59:0/3383841632 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9abc014420 con 0x7f9ac4139170 2023-09-30T22:34:07.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.470+0000 7f9ab9ffb700 1 -- 172.21.15.59:0/3383841632 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9abc03f6e0 con 0x7f9ac4139170 2023-09-30T22:34:07.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.479+0000 7f9ab9ffb700 1 -- 172.21.15.59:0/3383841632 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9abc0146d0 con 0x7f9ac4139170 2023-09-30T22:34:07.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.480+0000 7f83897fa700 1 -- 172.21.15.59:0/649776915 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f838c125b20 con 0x7f838c06fb20 2023-09-30T22:34:07.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.502+0000 7f6e8cc88700 1 Processor -- start 2023-09-30T22:34:07.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.502+0000 7eff6841f700 1 Processor -- start 2023-09-30T22:34:07.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.502+0000 7f6e8cc88700 1 -- start start 2023-09-30T22:34:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.502+0000 7eff6841f700 1 -- start start 2023-09-30T22:34:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7f6e8cc88700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6e880a09c0 0x7f6e880a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7eff6841f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6009d6f0 0x7eff6009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7f6e8cc88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e8809d5c0 0x7f6e880a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7f6e8cc88700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e880a1810 con 0x7f6e88133920 2023-09-30T22:34:07.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7f6e8cc88700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8809ea10 con 0x7f6e880a09c0 2023-09-30T22:34:07.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7f6e8cc88700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8809e210 con 0x7f6e8809d5c0 2023-09-30T22:34:07.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7eff6841f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff6009e410 0x7eff60134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7eff6841f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6009b120 con 0x7eff6009e000 2023-09-30T22:34:07.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7eff6841f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6006b460 con 0x7eff6009e410 2023-09-30T22:34:07.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7eff6841f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6009a7e0 con 0x7eff6009d6f0 2023-09-30T22:34:07.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7f6e85d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e8809d5c0 0x7f6e880a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7f6e85d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e8809d5c0 0x7f6e880a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41468/0 (socket says 172.21.15.59:41468) 2023-09-30T22:34:07.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7f6e85d9b700 1 -- 172.21.15.59:0/3817817817 learned_addr learned my addr 172.21.15.59:0/3817817817 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:07.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7eff661bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6009d6f0 0x7eff6009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7eff661bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6009d6f0 0x7eff6009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58578/0 (socket says 172.21.15.59:58578) 2023-09-30T22:34:07.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7eff661bb700 1 -- 172.21.15.59:0/796586168 learned_addr learned my addr 172.21.15.59:0/796586168 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:07.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.503+0000 7eff669bc700 1 --2- 172.21.15.59:0/796586168 >> v2:172.21.15.59:3300/0 conn(0x7eff6009e410 0x7eff60134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7eff661bb700 1 -- 172.21.15.59:0/796586168 >> v2:172.21.15.59:3300/0 conn(0x7eff6009e410 msgr2=0x7eff60134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:07.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7eff661bb700 1 --2- 172.21.15.59:0/796586168 >> v2:172.21.15.59:3300/0 conn(0x7eff6009e410 0x7eff60134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7eff661bb700 1 -- 172.21.15.59:0/796586168 >> v1:172.21.15.59:6789/0 conn(0x7eff6009e000 legacy=0x7eff601339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7eff661bb700 1 -- 172.21.15.59:0/796586168 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6009a500 con 0x7eff6009d6f0 2023-09-30T22:34:07.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7f6e8659c700 1 --2- 172.21.15.59:0/3817817817 >> v2:172.21.15.59:3300/0 conn(0x7f6e880a09c0 0x7f6e880a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7f6e85d9b700 1 -- 172.21.15.59:0/3817817817 >> v2:172.21.15.59:3300/0 conn(0x7f6e880a09c0 msgr2=0x7f6e880a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:07.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7f6e85d9b700 1 --2- 172.21.15.59:0/3817817817 >> v2:172.21.15.59:3300/0 conn(0x7f6e880a09c0 0x7f6e880a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7f6e85d9b700 1 -- 172.21.15.59:0/3817817817 >> v1:172.21.15.59:6789/0 conn(0x7f6e88133920 legacy=0x7f6e88133d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7f6e85d9b700 1 -- 172.21.15.59:0/3817817817 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e880a26f0 con 0x7f6e8809d5c0 2023-09-30T22:34:07.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7eff661bb700 1 --2- 172.21.15.59:0/796586168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6009d6f0 0x7eff6009dac0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7eff58009920 tx=0x7eff58009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36221b9299f8aaac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:07.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7f6e85d9b700 1 --2- 172.21.15.59:0/3817817817 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e8809d5c0 0x7f6e880a12d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6e780098f0 tx=0x7f6e78009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6d859de508a42af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:07.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7eff651b9700 1 -- 172.21.15.59:0/796586168 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5800ba20 con 0x7eff6009d6f0 2023-09-30T22:34:07.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7eff651b9700 1 -- 172.21.15.59:0/796586168 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5800bb80 con 0x7eff6009d6f0 2023-09-30T22:34:07.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7eff651b9700 1 -- 172.21.15.59:0/796586168 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58009e70 con 0x7eff6009d6f0 2023-09-30T22:34:07.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7f6e8559a700 1 -- 172.21.15.59:0/3817817817 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800b8a0 con 0x7f6e8809d5c0 2023-09-30T22:34:07.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.504+0000 7f6e8559a700 1 -- 172.21.15.59:0/3817817817 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7800ba00 con 0x7f6e8809d5c0 2023-09-30T22:34:07.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.505+0000 7f6e8559a700 1 -- 172.21.15.59:0/3817817817 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800bd90 con 0x7f6e8809d5c0 2023-09-30T22:34:07.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.505+0000 7eff6841f700 1 -- 172.21.15.59:0/796586168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6009d6f0 msgr2=0x7eff6009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.505+0000 7eff6841f700 1 --2- 172.21.15.59:0/796586168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6009d6f0 0x7eff6009dac0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7eff58009920 tx=0x7eff58009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:07.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.505+0000 7f6e8cc88700 1 -- 172.21.15.59:0/3817817817 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e8809d5c0 msgr2=0x7f6e880a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.505+0000 7f6e8cc88700 1 --2- 172.21.15.59:0/3817817817 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e8809d5c0 0x7f6e880a12d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6e780098f0 tx=0x7f6e78009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:07.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.505+0000 7eff6841f700 1 -- 172.21.15.59:0/796586168 shutdown_connections 2023-09-30T22:34:07.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.505+0000 7eff6841f700 1 --2- 172.21.15.59:0/796586168 >> v2:172.21.15.59:3300/0 conn(0x7eff6009e410 0x7eff60134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.505+0000 7eff6841f700 1 --2- 172.21.15.59:0/796586168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6009d6f0 0x7eff6009dac0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.505+0000 7eff6841f700 1 -- 172.21.15.59:0/796586168 >> 172.21.15.59:0/796586168 conn(0x7eff60066f50 msgr2=0x7eff6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:07.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.506+0000 7f6e8cc88700 1 -- 172.21.15.59:0/3817817817 shutdown_connections 2023-09-30T22:34:07.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.506+0000 7f6e8cc88700 1 --2- 172.21.15.59:0/3817817817 >> v2:172.21.15.59:3300/0 conn(0x7f6e880a09c0 0x7f6e880a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.506+0000 7f6e8cc88700 1 --2- 172.21.15.59:0/3817817817 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e8809d5c0 0x7f6e880a12d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.506+0000 7f6e8cc88700 1 -- 172.21.15.59:0/3817817817 >> 172.21.15.59:0/3817817817 conn(0x7f6e880a2fe0 msgr2=0x7f6e880a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:07.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.506+0000 7eff6841f700 1 -- 172.21.15.59:0/796586168 shutdown_connections 2023-09-30T22:34:07.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.506+0000 7eff6841f700 1 -- 172.21.15.59:0/796586168 wait complete. 2023-09-30T22:34:07.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.506+0000 7f6e8cc88700 1 -- 172.21.15.59:0/3817817817 shutdown_connections 2023-09-30T22:34:07.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.506+0000 7f6e8cc88700 1 -- 172.21.15.59:0/3817817817 wait complete. 2023-09-30T22:34:07.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7eff6841f700 1 Processor -- start 2023-09-30T22:34:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7eff6841f700 1 -- start start 2023-09-30T22:34:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7f6e8cc88700 1 Processor -- start 2023-09-30T22:34:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7f6e8cc88700 1 -- start start 2023-09-30T22:34:07.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7eff6841f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6009d6f0 0x7eff601a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7eff6841f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6009e000 0x7eff601a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7eff6841f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff6009e410 0x7eff601a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7eff6841f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff601a72e0 con 0x7eff6009d6f0 2023-09-30T22:34:07.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7eff6841f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff601a7a40 con 0x7eff6009e000 2023-09-30T22:34:07.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7eff6841f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff601a8060 con 0x7eff6009e410 2023-09-30T22:34:07.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7f6e8cc88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e8809d5c0 0x7f6e8811f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7f6e8cc88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e880a09c0 0x7f6e8811fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7f6e8cc88700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e88133920 0x7f6e881c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:07.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7f6e8cc88700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e88122340 con 0x7f6e88133920 2023-09-30T22:34:07.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7f6e8cc88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8809cec0 con 0x7f6e8809d5c0 2023-09-30T22:34:07.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.507+0000 7f6e8cc88700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8811ef50 con 0x7f6e880a09c0 2023-09-30T22:34:07.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7eff661bb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6009d6f0 0x7eff601a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7eff661bb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6009d6f0 0x7eff601a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35896/0 (socket says 172.21.15.59:35896) 2023-09-30T22:34:07.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7eff661bb700 1 -- 172.21.15.59:0/1179553414 learned_addr learned my addr 172.21.15.59:0/1179553414 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:07.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7f6e8659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e8809d5c0 0x7f6e8811f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7f6e8659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e8809d5c0 0x7f6e8811f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58608/0 (socket says 172.21.15.59:58608) 2023-09-30T22:34:07.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7f6e8659c700 1 -- 172.21.15.59:0/3104421723 learned_addr learned my addr 172.21.15.59:0/3104421723 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:07.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7f6e86d9d700 1 --2- 172.21.15.59:0/3104421723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e88133920 0x7f6e881c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7eff669bc700 1 --2- 172.21.15.59:0/1179553414 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff6009e410 0x7eff601a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:07.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7eff661bb700 1 -- 172.21.15.59:0/1179553414 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff6009e410 msgr2=0x7eff601a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7eff661bb700 1 --2- 172.21.15.59:0/1179553414 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff6009e410 0x7eff601a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7eff661bb700 1 -- 172.21.15.59:0/1179553414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6009e000 msgr2=0x7eff601a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7eff661bb700 1 --2- 172.21.15.59:0/1179553414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6009e000 0x7eff601a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7eff661bb700 1 -- 172.21.15.59:0/1179553414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff58009550 con 0x7eff6009d6f0 2023-09-30T22:34:07.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7f6e86d9d700 1 -- 172.21.15.59:0/3104421723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e880a09c0 msgr2=0x7f6e8811fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7f6e86d9d700 1 --2- 172.21.15.59:0/3104421723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e880a09c0 0x7f6e8811fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7f6e86d9d700 1 -- 172.21.15.59:0/3104421723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e8809d5c0 msgr2=0x7f6e8811f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7f6e86d9d700 1 --2- 172.21.15.59:0/3104421723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e8809d5c0 0x7f6e8811f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7f6e86d9d700 1 -- 172.21.15.59:0/3104421723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e78009550 con 0x7f6e88133920 2023-09-30T22:34:07.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.508+0000 7eff661bb700 1 --2- 172.21.15.59:0/1179553414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6009d6f0 0x7eff601a5e30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7eff58009870 tx=0x7eff58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:07.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.509+0000 7eff56ffd700 1 -- 172.21.15.59:0/1179553414 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58004240 con 0x7eff6009d6f0 2023-09-30T22:34:07.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.509+0000 7f6e86d9d700 1 --2- 172.21.15.59:0/3104421723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e88133920 0x7f6e881c8260 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000cbc0 tx=0x7f6e8000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:07.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.509+0000 7eff56ffd700 1 -- 172.21.15.59:0/1179553414 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5801f070 con 0x7eff6009d6f0 2023-09-30T22:34:07.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.509+0000 7eff6841f700 1 -- 172.21.15.59:0/1179553414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff601a8c90 con 0x7eff6009d6f0 2023-09-30T22:34:07.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.509+0000 7eff56ffd700 1 -- 172.21.15.59:0/1179553414 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff580045e0 con 0x7eff6009d6f0 2023-09-30T22:34:07.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.509+0000 7eff6841f700 1 -- 172.21.15.59:0/1179553414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff600a3250 con 0x7eff6009d6f0 2023-09-30T22:34:07.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.510+0000 7eff56ffd700 1 -- 172.21.15.59:0/1179553414 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff58021030 con 0x7eff6009d6f0 2023-09-30T22:34:07.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.510+0000 7eff56ffd700 1 -- 172.21.15.59:0/1179553414 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7eff5801a820 con 0x7eff6009d6f0 2023-09-30T22:34:07.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.510+0000 7eff6841f700 1 -- 172.21.15.59:0/1179553414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6009c710 con 0x7eff6009d6f0 2023-09-30T22:34:07.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.510+0000 7f6e7effd700 1 -- 172.21.15.59:0/3104421723 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80003c00 con 0x7f6e88133920 2023-09-30T22:34:07.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.510+0000 7f6e7effd700 1 -- 172.21.15.59:0/3104421723 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e80003d60 con 0x7f6e88133920 2023-09-30T22:34:07.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.510+0000 7f6e7effd700 1 -- 172.21.15.59:0/3104421723 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8000ab50 con 0x7f6e88133920 2023-09-30T22:34:07.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.510+0000 7f6e8cc88700 1 -- 172.21.15.59:0/3104421723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e880a4000 con 0x7f6e88133920 2023-09-30T22:34:07.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.511+0000 7f6e8cc88700 1 -- 172.21.15.59:0/3104421723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e88120610 con 0x7f6e88133920 2023-09-30T22:34:07.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.511+0000 7f6e8cc88700 1 -- 172.21.15.59:0/3104421723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8811ff70 con 0x7f6e88133920 2023-09-30T22:34:07.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.519+0000 7f6e7effd700 1 -- 172.21.15.59:0/3104421723 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e8000acb0 con 0x7f6e88133920 2023-09-30T22:34:07.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.520+0000 7f6e7effd700 1 -- 172.21.15.59:0/3104421723 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6e800402e0 con 0x7f6e88133920 2023-09-30T22:34:07.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.520+0000 7eff56ffd700 1 -- 172.21.15.59:0/1179553414 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff58015070 con 0x7eff6009d6f0 2023-09-30T22:34:07.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.521+0000 7f6e7effd700 1 -- 172.21.15.59:0/3104421723 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e800050d0 con 0x7f6e88133920 2023-09-30T22:34:07.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.733+0000 7f8392ba0700 1 -- 172.21.15.59:0/649776915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f838c125b20 con 0x7f838c06fb20 2023-09-30T22:34:07.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.734+0000 7f9acb88c700 1 -- 172.21.15.59:0/3383841632 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9ac406c360 con 0x7f9ac4139170 2023-09-30T22:34:07.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.734+0000 7f83897fa700 1 -- 172.21.15.59:0/649776915 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f838c125b20 con 0x7f838c06fb20 2023-09-30T22:34:07.735 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:07.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.734+0000 7f9ab9ffb700 1 -- 172.21.15.59:0/3383841632 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9abc0122e0 con 0x7f9ac4139170 2023-09-30T22:34:07.736 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:07.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.736+0000 7f9acb88c700 1 -- 172.21.15.59:0/3383841632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ac4139170 msgr2=0x7f9ac411e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.737+0000 7f9acb88c700 1 --2- 172.21.15.59:0/3383841632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ac4139170 0x7f9ac411e8e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9abc007d90 tx=0x7f9abc00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.737+0000 7f9acb88c700 1 -- 172.21.15.59:0/3383841632 shutdown_connections 2023-09-30T22:34:07.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.737+0000 7f9acb88c700 1 --2- 172.21.15.59:0/3383841632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ac4139170 0x7f9ac411e8e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.737+0000 7f9acb88c700 1 --2- 172.21.15.59:0/3383841632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ac409d6f0 0x7f9ac41c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.737+0000 7f9acb88c700 1 --2- 172.21.15.59:0/3383841632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ac409e1d0 0x7f9ac41c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.737+0000 7f9acb88c700 1 -- 172.21.15.59:0/3383841632 >> 172.21.15.59:0/3383841632 conn(0x7f9ac4066f50 msgr2=0x7f9ac40a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:07.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.737+0000 7f8392ba0700 1 -- 172.21.15.59:0/649776915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838c06fb20 msgr2=0x7f838c122580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.737+0000 7f8392ba0700 1 --2- 172.21.15.59:0/649776915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838c06fb20 0x7f838c122580 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f83800090b0 tx=0x7f8380004750 comp rx=0 tx=0).stop 2023-09-30T22:34:07.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.737+0000 7f9acb88c700 1 -- 172.21.15.59:0/3383841632 shutdown_connections 2023-09-30T22:34:07.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.737+0000 7f8392ba0700 1 -- 172.21.15.59:0/649776915 shutdown_connections 2023-09-30T22:34:07.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.737+0000 7f8392ba0700 1 --2- 172.21.15.59:0/649776915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f838c123000 0x7f838c1cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.737+0000 7f8392ba0700 1 --2- 172.21.15.59:0/649776915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838c06fb20 0x7f838c122580 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.737+0000 7f9acb88c700 1 -- 172.21.15.59:0/3383841632 wait complete. 2023-09-30T22:34:07.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.737+0000 7f8392ba0700 1 --2- 172.21.15.59:0/649776915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f838c130e50 0x7f838c122ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.737+0000 7f8392ba0700 1 -- 172.21.15.59:0/649776915 >> 172.21.15.59:0/649776915 conn(0x7f838c0a2aa0 msgr2=0x7f838c06e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:07.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.738+0000 7f8392ba0700 1 -- 172.21.15.59:0/649776915 shutdown_connections 2023-09-30T22:34:07.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.738+0000 7f8392ba0700 1 -- 172.21.15.59:0/649776915 wait complete. 2023-09-30T22:34:07.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.748+0000 7f6e8cc88700 1 -- 172.21.15.59:0/3104421723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6e88121df0 con 0x7f6e88133920 2023-09-30T22:34:07.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.748+0000 7f6e7effd700 1 -- 172.21.15.59:0/3104421723 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e80029090 con 0x7f6e88133920 2023-09-30T22:34:07.750 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:07.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.751+0000 7f6e8cc88700 1 -- 172.21.15.59:0/3104421723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e88133920 msgr2=0x7f6e881c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.751+0000 7f6e8cc88700 1 --2- 172.21.15.59:0/3104421723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e88133920 0x7f6e881c8260 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000cbc0 tx=0x7f6e8000cf80 comp rx=0 tx=0).stop 2023-09-30T22:34:07.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.751+0000 7f6e8cc88700 1 -- 172.21.15.59:0/3104421723 shutdown_connections 2023-09-30T22:34:07.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.751+0000 7f6e8cc88700 1 --2- 172.21.15.59:0/3104421723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e88133920 0x7f6e881c8260 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.751+0000 7f6e8cc88700 1 --2- 172.21.15.59:0/3104421723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e8809d5c0 0x7f6e8811f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.751+0000 7f6e8cc88700 1 --2- 172.21.15.59:0/3104421723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e880a09c0 0x7f6e8811fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.751+0000 7f6e8cc88700 1 -- 172.21.15.59:0/3104421723 >> 172.21.15.59:0/3104421723 conn(0x7f6e880a2fe0 msgr2=0x7f6e881bbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:07.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.751+0000 7f6e8cc88700 1 -- 172.21.15.59:0/3104421723 shutdown_connections 2023-09-30T22:34:07.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.751+0000 7f6e8cc88700 1 -- 172.21.15.59:0/3104421723 wait complete. 2023-09-30T22:34:07.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:07.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.757+0000 7eff6841f700 1 -- 172.21.15.59:0/1179553414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7eff60074ea0 con 0x7eff6009d6f0 2023-09-30T22:34:07.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:07.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.758+0000 7eff56ffd700 1 -- 172.21.15.59:0/1179553414 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff58015020 con 0x7eff6009d6f0 2023-09-30T22:34:07.759 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:07.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.760+0000 7eff6841f700 1 -- 172.21.15.59:0/1179553414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6009d6f0 msgr2=0x7eff601a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:07.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.760+0000 7eff6841f700 1 --2- 172.21.15.59:0/1179553414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6009d6f0 0x7eff601a5e30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7eff58009870 tx=0x7eff58004750 comp rx=0 tx=0).stop 2023-09-30T22:34:07.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.760+0000 7eff6841f700 1 -- 172.21.15.59:0/1179553414 shutdown_connections 2023-09-30T22:34:07.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.760+0000 7eff6841f700 1 --2- 172.21.15.59:0/1179553414 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff6009e410 0x7eff601a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.760+0000 7eff6841f700 1 --2- 172.21.15.59:0/1179553414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6009d6f0 0x7eff601a5e30 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.760+0000 7eff6841f700 1 --2- 172.21.15.59:0/1179553414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6009e000 0x7eff601a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:07.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.760+0000 7eff6841f700 1 -- 172.21.15.59:0/1179553414 >> 172.21.15.59:0/1179553414 conn(0x7eff60066f50 msgr2=0x7eff601bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:07.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.760+0000 7eff6841f700 1 -- 172.21.15.59:0/1179553414 shutdown_connections 2023-09-30T22:34:07.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:07.760+0000 7eff6841f700 1 -- 172.21.15.59:0/1179553414 wait complete. 2023-09-30T22:34:07.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:07.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:08.755 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:08.759 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:08.768 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:08.775 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.922+0000 7f7bc512e700 1 Processor -- start 2023-09-30T22:34:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.922+0000 7f7bc512e700 1 -- start start 2023-09-30T22:34:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.923+0000 7f7bc512e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bc009ac90 0x7f7bc013cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.923+0000 7f7bc512e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bc013d240 0x7f7bc013f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.923+0000 7f7bc512e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc0134980 con 0x7f7bc006c0e0 2023-09-30T22:34:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.923+0000 7f7bc512e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc006c4b0 con 0x7f7bc009ac90 2023-09-30T22:34:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.923+0000 7f7bc512e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc009b0e0 con 0x7f7bc013d240 2023-09-30T22:34:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.923+0000 7f7bbf59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bc013d240 0x7f7bc013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.923+0000 7f7bbf59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bc013d240 0x7f7bc013f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41498/0 (socket says 172.21.15.59:41498) 2023-09-30T22:34:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.923+0000 7f7bbf59e700 1 -- 172.21.15.59:0/585858259 learned_addr learned my addr 172.21.15.59:0/585858259 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.923+0000 7f7bbed9d700 1 --1- 172.21.15.59:0/585858259 >> v1:172.21.15.59:6789/0 conn(0x7f7bc006c0e0 0x7f7bc0134ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46418/0 (socket says 172.21.15.59:46418) 2023-09-30T22:34:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.923+0000 7f7bbf59e700 1 -- 172.21.15.59:0/585858259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bc009ac90 msgr2=0x7f7bc013cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.923+0000 7f7bbdd9b700 1 -- 172.21.15.59:0/585858259 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823897073 0 0) 0x7f7bc0134980 con 0x7f7bc006c0e0 2023-09-30T22:34:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.923+0000 7f7bbf59e700 1 --2- 172.21.15.59:0/585858259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bc009ac90 0x7f7bc013cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.923+0000 7f7bbf59e700 1 -- 172.21.15.59:0/585858259 >> v1:172.21.15.59:6789/0 conn(0x7f7bc006c0e0 legacy=0x7f7bc0134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.923+0000 7f7bbf59e700 1 -- 172.21.15.59:0/585858259 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc00a0600 con 0x7f7bc013d240 2023-09-30T22:34:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.924+0000 7f7bbf59e700 1 --2- 172.21.15.59:0/585858259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bc013d240 0x7f7bc013f620 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009e80 tx=0x7f7bb800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=661468907369dc39 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.924+0000 7f7bbdd9b700 1 -- 172.21.15.59:0/585858259 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800e070 con 0x7f7bc013d240 2023-09-30T22:34:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.924+0000 7f7bbdd9b700 1 -- 172.21.15.59:0/585858259 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb800b9c0 con 0x7f7bc013d240 2023-09-30T22:34:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.924+0000 7f7bbdd9b700 1 -- 172.21.15.59:0/585858259 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800bd70 con 0x7f7bc013d240 2023-09-30T22:34:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.925+0000 7f7bc512e700 1 -- 172.21.15.59:0/585858259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bc013d240 msgr2=0x7f7bc013f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.925+0000 7f7bc512e700 1 --2- 172.21.15.59:0/585858259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bc013d240 0x7f7bc013f620 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009e80 tx=0x7f7bb800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.925+0000 7f7bc512e700 1 -- 172.21.15.59:0/585858259 shutdown_connections 2023-09-30T22:34:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.925+0000 7f7bc512e700 1 --2- 172.21.15.59:0/585858259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bc013d240 0x7f7bc013f620 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.925+0000 7f7bc512e700 1 --2- 172.21.15.59:0/585858259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bc009ac90 0x7f7bc013cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.925+0000 7f7bc512e700 1 -- 172.21.15.59:0/585858259 >> 172.21.15.59:0/585858259 conn(0x7f7bc00a4210 msgr2=0x7f7bc00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.925+0000 7f7bc512e700 1 -- 172.21.15.59:0/585858259 shutdown_connections 2023-09-30T22:34:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.925+0000 7f7bc512e700 1 -- 172.21.15.59:0/585858259 wait complete. 2023-09-30T22:34:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.927+0000 7f7bc512e700 1 Processor -- start 2023-09-30T22:34:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.927+0000 7f7bc512e700 1 -- start start 2023-09-30T22:34:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.928+0000 7f7bc512e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bc006c0e0 0x7f7bc01ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.928+0000 7f7bc512e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bc009ac90 0x7f7bc01cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.928+0000 7f7bc512e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bc013d240 0x7f7bc011a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.928+0000 7f7bc512e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc011dd90 con 0x7f7bc006c0e0 2023-09-30T22:34:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.928+0000 7f7bc512e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc011c190 con 0x7f7bc013d240 2023-09-30T22:34:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.928+0000 7f7bc512e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc013cf90 con 0x7f7bc009ac90 2023-09-30T22:34:08.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.928+0000 7f7bbed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bc006c0e0 0x7f7bc01ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.928+0000 7f7bbe59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bc009ac90 0x7f7bc01cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.928+0000 7f7bbed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bc006c0e0 0x7f7bc01ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35914/0 (socket says 172.21.15.59:35914) 2023-09-30T22:34:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.928+0000 7f7bbed9d700 1 -- 172.21.15.59:0/2235757211 learned_addr learned my addr 172.21.15.59:0/2235757211 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.928+0000 7f7bbf59e700 1 --2- 172.21.15.59:0/2235757211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bc013d240 0x7f7bc011a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.928+0000 7f7bbe59c700 1 --2- 172.21.15.59:0/2235757211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bc009ac90 0x7f7bc01cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41500/0 (socket says 172.21.15.59:41500) 2023-09-30T22:34:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.929+0000 7f7bbf59e700 1 -- 172.21.15.59:0/2235757211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bc009ac90 msgr2=0x7f7bc01cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.929+0000 7f7bbf59e700 1 --2- 172.21.15.59:0/2235757211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bc009ac90 0x7f7bc01cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.929+0000 7f7bbf59e700 1 -- 172.21.15.59:0/2235757211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bc006c0e0 msgr2=0x7f7bc01ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.929+0000 7f7bbf59e700 1 --2- 172.21.15.59:0/2235757211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bc006c0e0 0x7f7bc01ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.929+0000 7f7bbf59e700 1 -- 172.21.15.59:0/2235757211 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb8009b30 con 0x7f7bc013d240 2023-09-30T22:34:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.929+0000 7f7bbf59e700 1 --2- 172.21.15.59:0/2235757211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bc013d240 0x7f7bc011a680 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8015000 tx=0x7f7bb8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.929+0000 7f7ba77fe700 1 -- 172.21.15.59:0/2235757211 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8004900 con 0x7f7bc013d240 2023-09-30T22:34:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.929+0000 7f7ba77fe700 1 -- 172.21.15.59:0/2235757211 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb80092e0 con 0x7f7bc013d240 2023-09-30T22:34:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.929+0000 7f7ba77fe700 1 -- 172.21.15.59:0/2235757211 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb801c650 con 0x7f7bc013d240 2023-09-30T22:34:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.929+0000 7f7bc512e700 1 -- 172.21.15.59:0/2235757211 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc00a03f0 con 0x7f7bc013d240 2023-09-30T22:34:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.929+0000 7f7bc512e700 1 -- 172.21.15.59:0/2235757211 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc011d730 con 0x7f7bc013d240 2023-09-30T22:34:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.930+0000 7f7ba77fe700 1 -- 172.21.15.59:0/2235757211 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7bb801c7b0 con 0x7f7bc013d240 2023-09-30T22:34:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.931+0000 7f7ba77fe700 1 -- 172.21.15.59:0/2235757211 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7bb8042910 con 0x7f7bc013d240 2023-09-30T22:34:08.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.931+0000 7f7bc512e700 1 -- 172.21.15.59:0/2235757211 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc011e540 con 0x7f7bc013d240 2023-09-30T22:34:08.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.936+0000 7f7ba77fe700 1 -- 172.21.15.59:0/2235757211 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7bb8046060 con 0x7f7bc013d240 2023-09-30T22:34:08.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.950+0000 7fb048617700 1 Processor -- start 2023-09-30T22:34:08.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.950+0000 7f0cb4ad5700 1 Processor -- start 2023-09-30T22:34:08.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.950+0000 7f0cb4ad5700 1 -- start start 2023-09-30T22:34:08.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.950+0000 7fb048617700 1 -- start start 2023-09-30T22:34:08.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7f0cb4ad5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cb00a0a30 0x7f0cb00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7f0cb4ad5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cb009d630 0x7f0cb00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7f0cb4ad5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cb0133930 0x7f0cb0133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7f0cb4ad5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb00a2a70 con 0x7f0cb00a0a30 2023-09-30T22:34:08.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7f0cb4ad5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb00a01d0 con 0x7f0cb009d630 2023-09-30T22:34:08.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7f0cb4ad5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb009e2b0 con 0x7f0cb0133930 2023-09-30T22:34:08.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7fb048617700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb04009eca0 0x7fb04013cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7fb048617700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04006f050 0x7fb04013f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7fb048617700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb040070ee0 con 0x7fb04006e570 2023-09-30T22:34:08.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7fb048617700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb040071980 con 0x7fb04009eca0 2023-09-30T22:34:08.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7fb048617700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb040071480 con 0x7fb04006f050 2023-09-30T22:34:08.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7fb046bb4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04006f050 0x7fb04013f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7f0caed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cb0133930 0x7f0cb0133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7f0cae59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cb00a0a30 0x7f0cb00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7f0caed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cb0133930 0x7f0cb0133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41504/0 (socket says 172.21.15.59:41504) 2023-09-30T22:34:08.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7f0caed9d700 1 -- 172.21.15.59:0/458794971 learned_addr learned my addr 172.21.15.59:0/458794971 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:08.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7f0cae59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cb00a0a30 0x7f0cb00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35938/0 (socket says 172.21.15.59:35938) 2023-09-30T22:34:08.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7fb046bb4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04006f050 0x7fb04013f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41510/0 (socket says 172.21.15.59:41510) 2023-09-30T22:34:08.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7fb046bb4700 1 -- 172.21.15.59:0/2625538107 learned_addr learned my addr 172.21.15.59:0/2625538107 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:08.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.951+0000 7fb045bb2700 1 --2- 172.21.15.59:0/2625538107 >> v2:172.21.15.59:3300/0 conn(0x7fb04009eca0 0x7fb04013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7fb046bb4700 1 -- 172.21.15.59:0/2625538107 >> v2:172.21.15.59:3300/0 conn(0x7fb04009eca0 msgr2=0x7fb04013cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7fb046bb4700 1 --2- 172.21.15.59:0/2625538107 >> v2:172.21.15.59:3300/0 conn(0x7fb04009eca0 0x7fb04013cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7fb046bb4700 1 -- 172.21.15.59:0/2625538107 >> v1:172.21.15.59:6789/0 conn(0x7fb04006e570 legacy=0x7fb04006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7fb046bb4700 1 -- 172.21.15.59:0/2625538107 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb040071b90 con 0x7fb04006f050 2023-09-30T22:34:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7f0caed9d700 1 -- 172.21.15.59:0/458794971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cb009d630 msgr2=0x7f0cb00a1340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:34:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7f0caed9d700 1 --2- 172.21.15.59:0/458794971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cb009d630 0x7f0cb00a1340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7f0caed9d700 1 -- 172.21.15.59:0/458794971 >> v2:172.21.15.59:3300/0 conn(0x7f0cb00a0a30 msgr2=0x7f0cb00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7f0caed9d700 1 --2- 172.21.15.59:0/458794971 >> v2:172.21.15.59:3300/0 conn(0x7f0cb00a0a30 0x7f0cb00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7f0caed9d700 1 -- 172.21.15.59:0/458794971 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb009dc50 con 0x7f0cb0133930 2023-09-30T22:34:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7fb046bb4700 1 --2- 172.21.15.59:0/2625538107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04006f050 0x7fb04013f3f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb038009e50 tx=0x7fb03800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fead1435af6350fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7f0caed9d700 1 --2- 172.21.15.59:0/458794971 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cb0133930 0x7f0cb0133db0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009e50 tx=0x7f0ca800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e57db15da834fca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7f0cad59a700 1 -- 172.21.15.59:0/458794971 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca800e070 con 0x7f0cb0133930 2023-09-30T22:34:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7f0cad59a700 1 -- 172.21.15.59:0/458794971 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca800b910 con 0x7f0cb0133930 2023-09-30T22:34:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7f0cad59a700 1 -- 172.21.15.59:0/458794971 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca800bcc0 con 0x7f0cb0133930 2023-09-30T22:34:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7fb0453b1700 1 -- 172.21.15.59:0/2625538107 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03800e070 con 0x7fb04006f050 2023-09-30T22:34:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7fb0453b1700 1 -- 172.21.15.59:0/2625538107 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03800b910 con 0x7fb04006f050 2023-09-30T22:34:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.952+0000 7fb0453b1700 1 -- 172.21.15.59:0/2625538107 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03800bcc0 con 0x7fb04006f050 2023-09-30T22:34:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.953+0000 7f0cb4ad5700 1 -- 172.21.15.59:0/458794971 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cb0133930 msgr2=0x7f0cb0133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.953+0000 7f0cb4ad5700 1 --2- 172.21.15.59:0/458794971 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cb0133930 0x7f0cb0133db0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009e50 tx=0x7f0ca800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.953+0000 7fb048617700 1 -- 172.21.15.59:0/2625538107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04006f050 msgr2=0x7fb04013f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.953+0000 7fb048617700 1 --2- 172.21.15.59:0/2625538107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04006f050 0x7fb04013f3f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb038009e50 tx=0x7fb03800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.953+0000 7fb048617700 1 -- 172.21.15.59:0/2625538107 shutdown_connections 2023-09-30T22:34:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.953+0000 7fb048617700 1 --2- 172.21.15.59:0/2625538107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04006f050 0x7fb04013f3f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.953+0000 7fb048617700 1 --2- 172.21.15.59:0/2625538107 >> v2:172.21.15.59:3300/0 conn(0x7fb04009eca0 0x7fb04013cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.953+0000 7fb048617700 1 -- 172.21.15.59:0/2625538107 >> 172.21.15.59:0/2625538107 conn(0x7fb0400a2aa0 msgr2=0x7fb0400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.954+0000 7fb048617700 1 -- 172.21.15.59:0/2625538107 shutdown_connections 2023-09-30T22:34:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.954+0000 7fb048617700 1 -- 172.21.15.59:0/2625538107 wait complete. 2023-09-30T22:34:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.954+0000 7f0cb4ad5700 1 -- 172.21.15.59:0/458794971 shutdown_connections 2023-09-30T22:34:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.954+0000 7f0cb4ad5700 1 --2- 172.21.15.59:0/458794971 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cb0133930 0x7f0cb0133db0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.954+0000 7f0cb4ad5700 1 --2- 172.21.15.59:0/458794971 >> v2:172.21.15.59:3300/0 conn(0x7f0cb00a0a30 0x7f0cb00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.954+0000 7f0cb4ad5700 1 --2- 172.21.15.59:0/458794971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cb009d630 0x7f0cb00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.954+0000 7f0cb4ad5700 1 -- 172.21.15.59:0/458794971 >> 172.21.15.59:0/458794971 conn(0x7f0cb00a3050 msgr2=0x7f0cb00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:08.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.954+0000 7f0cb4ad5700 1 -- 172.21.15.59:0/458794971 shutdown_connections 2023-09-30T22:34:08.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.955+0000 7fb048617700 1 Processor -- start 2023-09-30T22:34:08.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.954+0000 7f0cb4ad5700 1 -- 172.21.15.59:0/458794971 wait complete. 2023-09-30T22:34:08.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.955+0000 7fb048617700 1 -- start start 2023-09-30T22:34:08.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7fb048617700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04006e570 0x7fb0401214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7fb048617700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04006f050 0x7fb040121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7fb048617700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb040121f60 0x7fb040136d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.955+0000 7f0cb4ad5700 1 Processor -- start 2023-09-30T22:34:08.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.955+0000 7f0cb4ad5700 1 -- start start 2023-09-30T22:34:08.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7fb048617700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0401227e0 con 0x7fb04006e570 2023-09-30T22:34:08.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7fb048617700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb040123da0 con 0x7fb040121f60 2023-09-30T22:34:08.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7fb048617700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb04009a170 con 0x7fb04006f050 2023-09-30T22:34:08.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cb4ad5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cb009d630 0x7f0cb012e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cb4ad5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cb00a0a30 0x7f0cb012eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cb4ad5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cb0133930 0x7f0cb012eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cb4ad5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb01307a0 con 0x7f0cb009d630 2023-09-30T22:34:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cb4ad5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb012f9d0 con 0x7f0cb0133930 2023-09-30T22:34:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cb4ad5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb00a0410 con 0x7f0cb00a0a30 2023-09-30T22:34:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cae59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cb009d630 0x7f0cb012e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cae59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cb009d630 0x7f0cb012e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35940/0 (socket says 172.21.15.59:35940) 2023-09-30T22:34:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cae59c700 1 -- 172.21.15.59:0/2423028573 learned_addr learned my addr 172.21.15.59:0/2423028573 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:08.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7fb045bb2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04006f050 0x7fb040121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7fb045bb2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04006f050 0x7fb040121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41516/0 (socket says 172.21.15.59:41516) 2023-09-30T22:34:08.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7fb045bb2700 1 -- 172.21.15.59:0/1592231769 learned_addr learned my addr 172.21.15.59:0/1592231769 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:08.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7fb046bb4700 1 --2- 172.21.15.59:0/1592231769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb040121f60 0x7fb040136d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0caed9d700 1 --2- 172.21.15.59:0/2423028573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cb0133930 0x7f0cb012eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cadd9b700 1 --2- 172.21.15.59:0/2423028573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cb00a0a30 0x7f0cb012eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cae59c700 1 -- 172.21.15.59:0/2423028573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cb00a0a30 msgr2=0x7f0cb012eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:08.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cae59c700 1 --2- 172.21.15.59:0/2423028573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cb00a0a30 0x7f0cb012eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cae59c700 1 -- 172.21.15.59:0/2423028573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cb0133930 msgr2=0x7f0cb012eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:08.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cae59c700 1 --2- 172.21.15.59:0/2423028573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cb0133930 0x7f0cb012eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cae59c700 1 -- 172.21.15.59:0/2423028573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca8009b30 con 0x7f0cb009d630 2023-09-30T22:34:08.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.956+0000 7f0cadd9b700 1 --2- 172.21.15.59:0/2423028573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cb00a0a30 0x7f0cb012eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:08.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7fb046bb4700 1 -- 172.21.15.59:0/1592231769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04006f050 msgr2=0x7fb040121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:08.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7fb046bb4700 1 --2- 172.21.15.59:0/1592231769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04006f050 0x7fb040121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7fb046bb4700 1 -- 172.21.15.59:0/1592231769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04006e570 msgr2=0x7fb0401214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:08.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7fb046bb4700 1 --2- 172.21.15.59:0/1592231769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04006e570 0x7fb0401214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7fb046bb4700 1 -- 172.21.15.59:0/1592231769 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb038009b30 con 0x7fb040121f60 2023-09-30T22:34:08.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7f0cae59c700 1 --2- 172.21.15.59:0/2423028573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cb009d630 0x7f0cb012e570 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000e9e0 tx=0x7f0ca000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:08.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7fb046bb4700 1 --2- 172.21.15.59:0/1592231769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb040121f60 0x7fb040136d80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb040070170 tx=0x7fb038004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:08.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7fb036ffd700 1 -- 172.21.15.59:0/1592231769 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0380099b0 con 0x7fb040121f60 2023-09-30T22:34:08.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7f0c9effd700 1 -- 172.21.15.59:0/2423028573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0009710 con 0x7f0cb009d630 2023-09-30T22:34:08.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7fb036ffd700 1 -- 172.21.15.59:0/1592231769 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0380092e0 con 0x7fb040121f60 2023-09-30T22:34:08.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7fb036ffd700 1 -- 172.21.15.59:0/1592231769 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038004450 con 0x7fb040121f60 2023-09-30T22:34:08.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7f0c9effd700 1 -- 172.21.15.59:0/2423028573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca000c850 con 0x7f0cb009d630 2023-09-30T22:34:08.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7f0c9effd700 1 -- 172.21.15.59:0/2423028573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000cbc0 con 0x7f0cb009d630 2023-09-30T22:34:08.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7f0cb4ad5700 1 -- 172.21.15.59:0/2423028573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb00a4030 con 0x7f0cb009d630 2023-09-30T22:34:08.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7f0cb4ad5700 1 -- 172.21.15.59:0/2423028573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb0133400 con 0x7f0cb009d630 2023-09-30T22:34:08.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7fb048617700 1 -- 172.21.15.59:0/1592231769 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb040124080 con 0x7fb040121f60 2023-09-30T22:34:08.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.957+0000 7fb048617700 1 -- 172.21.15.59:0/1592231769 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb040070670 con 0x7fb040121f60 2023-09-30T22:34:08.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.959+0000 7f0c9effd700 1 -- 172.21.15.59:0/2423028573 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ca000cd20 con 0x7f0cb009d630 2023-09-30T22:34:08.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.959+0000 7fb036ffd700 1 -- 172.21.15.59:0/1592231769 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0380045b0 con 0x7fb040121f60 2023-09-30T22:34:08.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.959+0000 7f0c9effd700 1 -- 172.21.15.59:0/2423028573 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0ca003fcc0 con 0x7f0cb009d630 2023-09-30T22:34:08.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.959+0000 7fb036ffd700 1 -- 172.21.15.59:0/1592231769 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb038040be0 con 0x7fb040121f60 2023-09-30T22:34:08.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.959+0000 7f0cb4ad5700 1 -- 172.21.15.59:0/2423028573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb0131a50 con 0x7f0cb009d630 2023-09-30T22:34:08.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.959+0000 7fb048617700 1 -- 172.21.15.59:0/1592231769 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb040123930 con 0x7fb040121f60 2023-09-30T22:34:08.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.965+0000 7fb036ffd700 1 -- 172.21.15.59:0/1592231769 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb03801a330 con 0x7fb040121f60 2023-09-30T22:34:08.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.965+0000 7f17016d0700 1 Processor -- start 2023-09-30T22:34:08.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.965+0000 7f17016d0700 1 -- start start 2023-09-30T22:34:08.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.965+0000 7f0c9effd700 1 -- 172.21.15.59:0/2423028573 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cb0131a50 con 0x7f0cb009d630 2023-09-30T22:34:08.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.965+0000 7f17016d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16fc06f5d0 0x7f16fc12cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.965+0000 7f17016d0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16fc066410 0x7f16fc12f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f17016d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16fc066880 0x7f16fc12fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f17016d0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16fc071780 con 0x7f16fc066410 2023-09-30T22:34:08.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f17016d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc06f9a0 con 0x7f16fc06f5d0 2023-09-30T22:34:08.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f17016d0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc071a40 con 0x7f16fc066880 2023-09-30T22:34:08.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f16fa7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16fc066410 0x7f16fc12f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f16faffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16fc06f5d0 0x7f16fc12cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f16fa7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16fc066410 0x7f16fc12f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35958/0 (socket says 172.21.15.59:35958) 2023-09-30T22:34:08.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f16fa7fc700 1 -- 172.21.15.59:0/2113053012 learned_addr learned my addr 172.21.15.59:0/2113053012 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:08.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f16faffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16fc06f5d0 0x7f16fc12cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58664/0 (socket says 172.21.15.59:58664) 2023-09-30T22:34:08.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f16fb7fe700 1 --2- 172.21.15.59:0/2113053012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16fc066880 0x7f16fc12fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f16fa7fc700 1 -- 172.21.15.59:0/2113053012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16fc066880 msgr2=0x7f16fc12fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:08.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f16fa7fc700 1 --2- 172.21.15.59:0/2113053012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16fc066880 0x7f16fc12fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f16fa7fc700 1 -- 172.21.15.59:0/2113053012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16fc06f5d0 msgr2=0x7f16fc12cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:08.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f16fa7fc700 1 --2- 172.21.15.59:0/2113053012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16fc06f5d0 0x7f16fc12cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f16fa7fc700 1 -- 172.21.15.59:0/2113053012 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc072220 con 0x7f16fc066410 2023-09-30T22:34:08.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f16faffd700 1 --2- 172.21.15.59:0/2113053012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16fc06f5d0 0x7f16fc12cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:08.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.966+0000 7f16fa7fc700 1 --2- 172.21.15.59:0/2113053012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16fc066410 0x7f16fc12f8b0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009920 tx=0x7f16f0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a97a3d928e287e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:08.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.967+0000 7f16f9ffb700 1 -- 172.21.15.59:0/2113053012 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0011830 con 0x7f16fc066410 2023-09-30T22:34:08.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.967+0000 7f16f9ffb700 1 -- 172.21.15.59:0/2113053012 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f0011990 con 0x7f16fc066410 2023-09-30T22:34:08.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.967+0000 7f16f9ffb700 1 -- 172.21.15.59:0/2113053012 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0011d20 con 0x7f16fc066410 2023-09-30T22:34:08.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.967+0000 7f17016d0700 1 -- 172.21.15.59:0/2113053012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16fc066410 msgr2=0x7f16fc12f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:08.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.967+0000 7f17016d0700 1 --2- 172.21.15.59:0/2113053012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16fc066410 0x7f16fc12f8b0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009920 tx=0x7f16f0009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:08.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.967+0000 7f17016d0700 1 -- 172.21.15.59:0/2113053012 shutdown_connections 2023-09-30T22:34:08.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.967+0000 7f17016d0700 1 --2- 172.21.15.59:0/2113053012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16fc066880 0x7f16fc12fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.967+0000 7f17016d0700 1 --2- 172.21.15.59:0/2113053012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16fc06f5d0 0x7f16fc12cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.967+0000 7f17016d0700 1 --2- 172.21.15.59:0/2113053012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16fc066410 0x7f16fc12f8b0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.968+0000 7f17016d0700 1 -- 172.21.15.59:0/2113053012 >> 172.21.15.59:0/2113053012 conn(0x7f16fc0a2aa0 msgr2=0x7f16fc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:08.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.968+0000 7f17016d0700 1 -- 172.21.15.59:0/2113053012 shutdown_connections 2023-09-30T22:34:08.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.968+0000 7f17016d0700 1 -- 172.21.15.59:0/2113053012 wait complete. 2023-09-30T22:34:08.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.969+0000 7f17016d0700 1 Processor -- start 2023-09-30T22:34:08.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.969+0000 7f17016d0700 1 -- start start 2023-09-30T22:34:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.969+0000 7f17016d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16fc066410 0x7f16fc09bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.969+0000 7f17016d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16fc066880 0x7f16fc09c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.969+0000 7f17016d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16fc06f5d0 0x7f16fc1c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.969+0000 7f17016d0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc09e710 con 0x7f16fc06f5d0 2023-09-30T22:34:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.969+0000 7f17016d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc129fa0 con 0x7f16fc066880 2023-09-30T22:34:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.969+0000 7f17016d0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc09b940 con 0x7f16fc066410 2023-09-30T22:34:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.970+0000 7f16fb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16fc06f5d0 0x7f16fc1c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.970+0000 7f16faffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16fc066410 0x7f16fc09bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.970+0000 7f16fb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16fc06f5d0 0x7f16fc1c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35972/0 (socket says 172.21.15.59:35972) 2023-09-30T22:34:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.970+0000 7f16fb7fe700 1 -- 172.21.15.59:0/3609124253 learned_addr learned my addr 172.21.15.59:0/3609124253 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.970+0000 7f16fa7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16fc066880 0x7f16fc09c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:08.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.970+0000 7f16fb7fe700 1 -- 172.21.15.59:0/3609124253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16fc066410 msgr2=0x7f16fc09bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.970+0000 7f16fb7fe700 1 --2- 172.21.15.59:0/3609124253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16fc066410 0x7f16fc09bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.970+0000 7f16fb7fe700 1 -- 172.21.15.59:0/3609124253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16fc066880 msgr2=0x7f16fc09c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.970+0000 7f16fb7fe700 1 --2- 172.21.15.59:0/3609124253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16fc066880 0x7f16fc09c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.970+0000 7f16fb7fe700 1 -- 172.21.15.59:0/3609124253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec0094a0 con 0x7f16fc06f5d0 2023-09-30T22:34:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.970+0000 7f16fb7fe700 1 --2- 172.21.15.59:0/3609124253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16fc06f5d0 0x7f16fc1c3fb0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f16f401ffc0 tx=0x7f16f401d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.970+0000 7f16e37fe700 1 -- 172.21.15.59:0/3609124253 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f401aea0 con 0x7f16fc06f5d0 2023-09-30T22:34:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.970+0000 7f16e37fe700 1 -- 172.21.15.59:0/3609124253 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f4020040 con 0x7f16fc06f5d0 2023-09-30T22:34:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.970+0000 7f16e37fe700 1 -- 172.21.15.59:0/3609124253 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4025480 con 0x7f16fc06f5d0 2023-09-30T22:34:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.971+0000 7f17016d0700 1 -- 172.21.15.59:0/3609124253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f0009550 con 0x7f16fc06f5d0 2023-09-30T22:34:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.971+0000 7f17016d0700 1 -- 172.21.15.59:0/3609124253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16fc09cda0 con 0x7f16fc06f5d0 2023-09-30T22:34:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.972+0000 7f17016d0700 1 -- 172.21.15.59:0/3609124253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16fc074ea0 con 0x7f16fc06f5d0 2023-09-30T22:34:08.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.973+0000 7f16e37fe700 1 -- 172.21.15.59:0/3609124253 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16f40255e0 con 0x7f16fc06f5d0 2023-09-30T22:34:08.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.975+0000 7f16e37fe700 1 -- 172.21.15.59:0/3609124253 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f16f4017e40 con 0x7f16fc06f5d0 2023-09-30T22:34:08.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:08.982+0000 7f16e37fe700 1 -- 172.21.15.59:0/3609124253 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16f4065750 con 0x7f16fc06f5d0 2023-09-30T22:34:09.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.146+0000 7f7bc512e700 1 -- 172.21.15.59:0/2235757211 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7bc0074ea0 con 0x7f7bc013d240 2023-09-30T22:34:09.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.146+0000 7f7ba77fe700 1 -- 172.21.15.59:0/2235757211 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7bb8024400 con 0x7f7bc013d240 2023-09-30T22:34:09.147 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:09.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.149+0000 7f7bc512e700 1 -- 172.21.15.59:0/2235757211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bc013d240 msgr2=0x7f7bc011a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:09.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.149+0000 7f7bc512e700 1 --2- 172.21.15.59:0/2235757211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bc013d240 0x7f7bc011a680 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8015000 tx=0x7f7bb8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.150+0000 7f7bc512e700 1 -- 172.21.15.59:0/2235757211 shutdown_connections 2023-09-30T22:34:09.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.150+0000 7f7bc512e700 1 --2- 172.21.15.59:0/2235757211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bc013d240 0x7f7bc011a680 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.150+0000 7f7bc512e700 1 --2- 172.21.15.59:0/2235757211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bc006c0e0 0x7f7bc01ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.150+0000 7f7bc512e700 1 --2- 172.21.15.59:0/2235757211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bc009ac90 0x7f7bc01cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.150+0000 7f7bc512e700 1 -- 172.21.15.59:0/2235757211 >> 172.21.15.59:0/2235757211 conn(0x7f7bc00a4210 msgr2=0x7f7bc00a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:09.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.150+0000 7f7bc512e700 1 -- 172.21.15.59:0/2235757211 shutdown_connections 2023-09-30T22:34:09.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.150+0000 7f7bc512e700 1 -- 172.21.15.59:0/2235757211 wait complete. 2023-09-30T22:34:09.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:09.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.188+0000 7f0cb4ad5700 1 -- 172.21.15.59:0/2423028573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0cb0131a50 con 0x7f0cb009d630 2023-09-30T22:34:09.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.189+0000 7f0c9effd700 1 -- 172.21.15.59:0/2423028573 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cb0131a50 con 0x7f0cb009d630 2023-09-30T22:34:09.190 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:09.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.191+0000 7f0cb4ad5700 1 -- 172.21.15.59:0/2423028573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cb009d630 msgr2=0x7f0cb012e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:09.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.191+0000 7f0cb4ad5700 1 --2- 172.21.15.59:0/2423028573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cb009d630 0x7f0cb012e570 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000e9e0 tx=0x7f0ca000eda0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.191+0000 7f0cb4ad5700 1 -- 172.21.15.59:0/2423028573 shutdown_connections 2023-09-30T22:34:09.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.191+0000 7f0cb4ad5700 1 --2- 172.21.15.59:0/2423028573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cb0133930 0x7f0cb012eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.191+0000 7f0cb4ad5700 1 --2- 172.21.15.59:0/2423028573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cb009d630 0x7f0cb012e570 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.191+0000 7f0cb4ad5700 1 --2- 172.21.15.59:0/2423028573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cb00a0a30 0x7f0cb012eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.191+0000 7f0cb4ad5700 1 -- 172.21.15.59:0/2423028573 >> 172.21.15.59:0/2423028573 conn(0x7f0cb00a3050 msgr2=0x7f0cb009c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:09.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.191+0000 7f0cb4ad5700 1 -- 172.21.15.59:0/2423028573 shutdown_connections 2023-09-30T22:34:09.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.191+0000 7f0cb4ad5700 1 -- 172.21.15.59:0/2423028573 wait complete. 2023-09-30T22:34:09.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.192+0000 7fb048617700 1 -- 172.21.15.59:0/1592231769 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb040074ea0 con 0x7fb040121f60 2023-09-30T22:34:09.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.193+0000 7fb036ffd700 1 -- 172.21.15.59:0/1592231769 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb038011b40 con 0x7fb040121f60 2023-09-30T22:34:09.194 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:09.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.196+0000 7fb048617700 1 -- 172.21.15.59:0/1592231769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb040121f60 msgr2=0x7fb040136d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:09.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.196+0000 7fb048617700 1 --2- 172.21.15.59:0/1592231769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb040121f60 0x7fb040136d80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb040070170 tx=0x7fb038004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.196+0000 7fb048617700 1 -- 172.21.15.59:0/1592231769 shutdown_connections 2023-09-30T22:34:09.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.196+0000 7fb048617700 1 --2- 172.21.15.59:0/1592231769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb040121f60 0x7fb040136d80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.196+0000 7fb048617700 1 --2- 172.21.15.59:0/1592231769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04006e570 0x7fb0401214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.196+0000 7fb048617700 1 --2- 172.21.15.59:0/1592231769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04006f050 0x7fb040121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.197+0000 7fb048617700 1 -- 172.21.15.59:0/1592231769 >> 172.21.15.59:0/1592231769 conn(0x7fb0400a2aa0 msgr2=0x7fb04009a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:09.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.198+0000 7fb048617700 1 -- 172.21.15.59:0/1592231769 shutdown_connections 2023-09-30T22:34:09.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.198+0000 7fb048617700 1 -- 172.21.15.59:0/1592231769 wait complete. 2023-09-30T22:34:09.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.210+0000 7f17016d0700 1 -- 172.21.15.59:0/3609124253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f16fc0713a0 con 0x7f16fc06f5d0 2023-09-30T22:34:09.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:09.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.210+0000 7f16e37fe700 1 -- 172.21.15.59:0/3609124253 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16f403b030 con 0x7f16fc06f5d0 2023-09-30T22:34:09.212 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:09.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.213+0000 7f17016d0700 1 -- 172.21.15.59:0/3609124253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16fc06f5d0 msgr2=0x7f16fc1c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:09.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.213+0000 7f17016d0700 1 --2- 172.21.15.59:0/3609124253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16fc06f5d0 0x7f16fc1c3fb0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f16f401ffc0 tx=0x7f16f401d3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.213+0000 7f17016d0700 1 -- 172.21.15.59:0/3609124253 shutdown_connections 2023-09-30T22:34:09.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.213+0000 7f17016d0700 1 --2- 172.21.15.59:0/3609124253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16fc066410 0x7f16fc09bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.213+0000 7f17016d0700 1 --2- 172.21.15.59:0/3609124253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16fc06f5d0 0x7f16fc1c3fb0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.213+0000 7f17016d0700 1 --2- 172.21.15.59:0/3609124253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16fc066880 0x7f16fc09c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:09.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.213+0000 7f17016d0700 1 -- 172.21.15.59:0/3609124253 >> 172.21.15.59:0/3609124253 conn(0x7f16fc0a2aa0 msgr2=0x7f16fc0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:09.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.213+0000 7f17016d0700 1 -- 172.21.15.59:0/3609124253 shutdown_connections 2023-09-30T22:34:09.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:09.213+0000 7f17016d0700 1 -- 172.21.15.59:0/3609124253 wait complete. 2023-09-30T22:34:09.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:09.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:10.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:10.213 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:10.218 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:10.229 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:10.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.334+0000 7f2018a26700 1 Processor -- start 2023-09-30T22:34:10.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.334+0000 7f2018a26700 1 -- start start 2023-09-30T22:34:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.335+0000 7f2018a26700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f201409d6f0 0x7f201409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.335+0000 7f2018a26700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f201409e410 0x7f2014130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.335+0000 7f2018a26700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201409f130 con 0x7f201409e000 2023-09-30T22:34:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.335+0000 7f2018a26700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201409f520 con 0x7f201409e410 2023-09-30T22:34:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.335+0000 7f2018a26700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f201409e930 con 0x7f201409d6f0 2023-09-30T22:34:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.335+0000 7f201259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f201409d6f0 0x7f201409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.335+0000 7f2012d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f201409e410 0x7f2014130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.335+0000 7f201259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f201409d6f0 0x7f201409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41548/0 (socket says 172.21.15.59:41548) 2023-09-30T22:34:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.335+0000 7f201259c700 1 -- 172.21.15.59:0/1454128239 learned_addr learned my addr 172.21.15.59:0/1454128239 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.336+0000 7f201259c700 1 -- 172.21.15.59:0/1454128239 >> v2:172.21.15.59:3300/0 conn(0x7f201409e410 msgr2=0x7f2014130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.336+0000 7f201259c700 1 --2- 172.21.15.59:0/1454128239 >> v2:172.21.15.59:3300/0 conn(0x7f201409e410 0x7f2014130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.336+0000 7f201259c700 1 -- 172.21.15.59:0/1454128239 >> v1:172.21.15.59:6789/0 conn(0x7f201409e000 legacy=0x7f2014130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.336+0000 7f201259c700 1 -- 172.21.15.59:0/1454128239 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201409b2d0 con 0x7f201409d6f0 2023-09-30T22:34:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.336+0000 7f201259c700 1 --2- 172.21.15.59:0/1454128239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f201409d6f0 0x7f201409dac0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f20040098f0 tx=0x7f2004009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5ef46108809875 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.336+0000 7f201159a700 1 -- 172.21.15.59:0/1454128239 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004011830 con 0x7f201409d6f0 2023-09-30T22:34:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.336+0000 7f201159a700 1 -- 172.21.15.59:0/1454128239 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2004011990 con 0x7f201409d6f0 2023-09-30T22:34:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.336+0000 7f201159a700 1 -- 172.21.15.59:0/1454128239 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004011d20 con 0x7f201409d6f0 2023-09-30T22:34:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.337+0000 7f2018a26700 1 -- 172.21.15.59:0/1454128239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f201409d6f0 msgr2=0x7f201409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.337+0000 7f2018a26700 1 --2- 172.21.15.59:0/1454128239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f201409d6f0 0x7f201409dac0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f20040098f0 tx=0x7f2004009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.337+0000 7f2018a26700 1 -- 172.21.15.59:0/1454128239 shutdown_connections 2023-09-30T22:34:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.337+0000 7f2018a26700 1 --2- 172.21.15.59:0/1454128239 >> v2:172.21.15.59:3300/0 conn(0x7f201409e410 0x7f2014130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.337+0000 7f2018a26700 1 --2- 172.21.15.59:0/1454128239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f201409d6f0 0x7f201409dac0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.337+0000 7f2018a26700 1 -- 172.21.15.59:0/1454128239 >> 172.21.15.59:0/1454128239 conn(0x7f2014066f50 msgr2=0x7f201409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.337+0000 7f2018a26700 1 -- 172.21.15.59:0/1454128239 shutdown_connections 2023-09-30T22:34:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.337+0000 7f2018a26700 1 -- 172.21.15.59:0/1454128239 wait complete. 2023-09-30T22:34:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.338+0000 7f2018a26700 1 Processor -- start 2023-09-30T22:34:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.338+0000 7f2018a26700 1 -- start start 2023-09-30T22:34:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.339+0000 7f2018a26700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f201409d6f0 0x7f201411dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.339+0000 7f2018a26700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f201409e000 0x7f201411e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.339+0000 7f2018a26700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f201409e410 0x7f201411ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.339+0000 7f2018a26700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201411f490 con 0x7f201409d6f0 2023-09-30T22:34:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.339+0000 7f2018a26700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20141303a0 con 0x7f201409e410 2023-09-30T22:34:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.339+0000 7f2018a26700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2014120e20 con 0x7f201409e000 2023-09-30T22:34:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.339+0000 7f2012d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f201409e410 0x7f201411ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.339+0000 7f2012d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f201409e410 0x7f201411ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58674/0 (socket says 172.21.15.59:58674) 2023-09-30T22:34:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.339+0000 7f2012d9d700 1 -- 172.21.15.59:0/19025310 learned_addr learned my addr 172.21.15.59:0/19025310 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.339+0000 7f201259c700 1 --2- 172.21.15.59:0/19025310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f201409d6f0 0x7f201411dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.339+0000 7f2011d9b700 1 --2- 172.21.15.59:0/19025310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f201409e000 0x7f201411e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.340+0000 7f2012d9d700 1 -- 172.21.15.59:0/19025310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f201409e000 msgr2=0x7f201411e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.340+0000 7f2012d9d700 1 --2- 172.21.15.59:0/19025310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f201409e000 0x7f201411e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.340+0000 7f2012d9d700 1 -- 172.21.15.59:0/19025310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f201409d6f0 msgr2=0x7f201411dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.340+0000 7f2012d9d700 1 --2- 172.21.15.59:0/19025310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f201409d6f0 0x7f201411dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.340+0000 7f2012d9d700 1 -- 172.21.15.59:0/19025310 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2004009550 con 0x7f201409e410 2023-09-30T22:34:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.340+0000 7f2012d9d700 1 --2- 172.21.15.59:0/19025310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f201409e410 0x7f201411ea40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f200c00efc0 tx=0x7f200c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.340+0000 7f2002ffd700 1 -- 172.21.15.59:0/19025310 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00cc90 con 0x7f201409e410 2023-09-30T22:34:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.340+0000 7f2002ffd700 1 -- 172.21.15.59:0/19025310 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c00f040 con 0x7f201409e410 2023-09-30T22:34:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.340+0000 7f2018a26700 1 -- 172.21.15.59:0/19025310 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2014121800 con 0x7f201409e410 2023-09-30T22:34:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.340+0000 7f2002ffd700 1 -- 172.21.15.59:0/19025310 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c0146c0 con 0x7f201409e410 2023-09-30T22:34:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.340+0000 7f2018a26700 1 -- 172.21.15.59:0/19025310 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20140a1e00 con 0x7f201409e410 2023-09-30T22:34:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.341+0000 7f2002ffd700 1 -- 172.21.15.59:0/19025310 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f200c014820 con 0x7f201409e410 2023-09-30T22:34:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.341+0000 7f2018a26700 1 -- 172.21.15.59:0/19025310 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201409c760 con 0x7f201409e410 2023-09-30T22:34:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.342+0000 7f2002ffd700 1 -- 172.21.15.59:0/19025310 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f200c040270 con 0x7f201409e410 2023-09-30T22:34:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.346+0000 7f2002ffd700 1 -- 172.21.15.59:0/19025310 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f200c007920 con 0x7f201409e410 2023-09-30T22:34:10.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.365+0000 7fc97e791700 1 Processor -- start 2023-09-30T22:34:10.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.365+0000 7fc97e791700 1 -- start start 2023-09-30T22:34:10.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.366+0000 7fc97e791700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc97806a770 0x7fc97806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.366+0000 7fc97e791700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc97806b080 0x7fc978131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.366+0000 7fc97e791700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97809ece0 con 0x7fc978131b40 2023-09-30T22:34:10.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.366+0000 7fc97e791700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97809e760 con 0x7fc97806b080 2023-09-30T22:34:10.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.366+0000 7fc97e791700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc97809e040 con 0x7fc97806a770 2023-09-30T22:34:10.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.366+0000 7fc9777fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc97806b080 0x7fc978131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.366+0000 7fc9777fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc97806b080 0x7fc978131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58676/0 (socket says 172.21.15.59:58676) 2023-09-30T22:34:10.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.366+0000 7fc9777fe700 1 -- 172.21.15.59:0/664718015 learned_addr learned my addr 172.21.15.59:0/664718015 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:10.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.366+0000 7fc976ffd700 1 -- 172.21.15.59:0/664718015 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898401222 0 0) 0x7fc97809ece0 con 0x7fc978131b40 2023-09-30T22:34:10.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.366+0000 7fc9777fe700 1 -- 172.21.15.59:0/664718015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc97806a770 msgr2=0x7fc97806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:10.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.366+0000 7fc977fff700 1 --2- 172.21.15.59:0/664718015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc97806a770 0x7fc97806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.367+0000 7fc9777fe700 1 --2- 172.21.15.59:0/664718015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc97806a770 0x7fc97806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.367+0000 7fc9777fe700 1 -- 172.21.15.59:0/664718015 >> v1:172.21.15.59:6789/0 conn(0x7fc978131b40 legacy=0x7fc978138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.367+0000 7fc9777fe700 1 -- 172.21.15.59:0/664718015 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97809f630 con 0x7fc97806b080 2023-09-30T22:34:10.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.367+0000 7fc977fff700 1 --2- 172.21.15.59:0/664718015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc97806a770 0x7fc97806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:34:10.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.367+0000 7fc9777fe700 1 --2- 172.21.15.59:0/664718015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc97806b080 0x7fc978131600 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009920 tx=0x7fc96c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2676445ba32b3fb3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:10.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.367+0000 7fc976ffd700 1 -- 172.21.15.59:0/664718015 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00ba60 con 0x7fc97806b080 2023-09-30T22:34:10.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.367+0000 7fc976ffd700 1 -- 172.21.15.59:0/664718015 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c00bbc0 con 0x7fc97806b080 2023-09-30T22:34:10.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.367+0000 7fc976ffd700 1 -- 172.21.15.59:0/664718015 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c009e70 con 0x7fc97806b080 2023-09-30T22:34:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.368+0000 7fc97e791700 1 -- 172.21.15.59:0/664718015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc97806b080 msgr2=0x7fc978131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.368+0000 7fc97e791700 1 --2- 172.21.15.59:0/664718015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc97806b080 0x7fc978131600 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009920 tx=0x7fc96c009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.368+0000 7fc97e791700 1 -- 172.21.15.59:0/664718015 shutdown_connections 2023-09-30T22:34:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.368+0000 7fc97e791700 1 --2- 172.21.15.59:0/664718015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc97806a770 0x7fc97806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.368+0000 7fc97e791700 1 --2- 172.21.15.59:0/664718015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc97806b080 0x7fc978131600 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.368+0000 7fc97e791700 1 -- 172.21.15.59:0/664718015 >> 172.21.15.59:0/664718015 conn(0x7fc978066f50 msgr2=0x7fc97809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.368+0000 7fc97e791700 1 -- 172.21.15.59:0/664718015 shutdown_connections 2023-09-30T22:34:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.368+0000 7fc97e791700 1 -- 172.21.15.59:0/664718015 wait complete. 2023-09-30T22:34:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.369+0000 7fc97e791700 1 Processor -- start 2023-09-30T22:34:10.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.369+0000 7fc97e791700 1 -- start start 2023-09-30T22:34:10.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.370+0000 7fc97e791700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97806a770 0x7fc97809ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.370+0000 7fc97e791700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc97806b080 0x7fc97809b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.370+0000 7fc97e791700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc978131b40 0x7fc9781c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.370+0000 7fc97e791700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97809a9b0 con 0x7fc97806a770 2023-09-30T22:34:10.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.370+0000 7fc97e791700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc978071e60 con 0x7fc978131b40 2023-09-30T22:34:10.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.370+0000 7fc97e791700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc978121dd0 con 0x7fc97806b080 2023-09-30T22:34:10.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.370+0000 7fc977fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97806a770 0x7fc97809ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.370+0000 7fc977fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97806a770 0x7fc97809ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36008/0 (socket says 172.21.15.59:36008) 2023-09-30T22:34:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.370+0000 7fc977fff700 1 -- 172.21.15.59:0/819710162 learned_addr learned my addr 172.21.15.59:0/819710162 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.370+0000 7fc97cd2e700 1 --2- 172.21.15.59:0/819710162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc978131b40 0x7fc9781c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.370+0000 7fc9777fe700 1 --2- 172.21.15.59:0/819710162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc97806b080 0x7fc97809b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.371+0000 7fc97cd2e700 1 -- 172.21.15.59:0/819710162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc97806b080 msgr2=0x7fc97809b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.371+0000 7fc97cd2e700 1 --2- 172.21.15.59:0/819710162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc97806b080 0x7fc97809b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.371+0000 7fc97cd2e700 1 -- 172.21.15.59:0/819710162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97806a770 msgr2=0x7fc97809ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.371+0000 7fc97cd2e700 1 --2- 172.21.15.59:0/819710162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97806a770 0x7fc97809ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.371+0000 7fc97cd2e700 1 -- 172.21.15.59:0/819710162 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c009550 con 0x7fc978131b40 2023-09-30T22:34:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.371+0000 7fc977fff700 1 --2- 172.21.15.59:0/819710162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97806a770 0x7fc97809ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.371+0000 7fc97cd2e700 1 --2- 172.21.15.59:0/819710162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc978131b40 0x7fc9781c8300 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc97000c730 tx=0x7fc97000ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.371+0000 7fc974ff9700 1 -- 172.21.15.59:0/819710162 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970003e30 con 0x7fc978131b40 2023-09-30T22:34:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.371+0000 7fc974ff9700 1 -- 172.21.15.59:0/819710162 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc970005070 con 0x7fc978131b40 2023-09-30T22:34:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.371+0000 7fc974ff9700 1 -- 172.21.15.59:0/819710162 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970005420 con 0x7fc978131b40 2023-09-30T22:34:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.371+0000 7fc97e791700 1 -- 172.21.15.59:0/819710162 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc978131370 con 0x7fc978131b40 2023-09-30T22:34:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.371+0000 7fc97e791700 1 -- 172.21.15.59:0/819710162 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97809b7f0 con 0x7fc978131b40 2023-09-30T22:34:10.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.372+0000 7fc974ff9700 1 -- 172.21.15.59:0/819710162 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc970005580 con 0x7fc978131b40 2023-09-30T22:34:10.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.372+0000 7fc974ff9700 1 -- 172.21.15.59:0/819710162 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc97003f1f0 con 0x7fc978131b40 2023-09-30T22:34:10.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.373+0000 7fc97e791700 1 -- 172.21.15.59:0/819710162 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc978121f40 con 0x7fc978131b40 2023-09-30T22:34:10.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.378+0000 7fc974ff9700 1 -- 172.21.15.59:0/819710162 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc970010710 con 0x7fc978131b40 2023-09-30T22:34:10.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.412+0000 7f8fa9a84700 1 Processor -- start 2023-09-30T22:34:10.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.412+0000 7f8fa9a84700 1 -- start start 2023-09-30T22:34:10.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.413+0000 7f8fa9a84700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8fa409c650 0x7f8fa409ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.413+0000 7f8fa9a84700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fa409cf60 0x7f8fa4132080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.413+0000 7f8fa9a84700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa409ba70 con 0x7f8fa40a0090 2023-09-30T22:34:10.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.413+0000 7f8fa9a84700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa409e8f0 con 0x7f8fa409c650 2023-09-30T22:34:10.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.413+0000 7f8fa9a84700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa40a0760 con 0x7f8fa409cf60 2023-09-30T22:34:10.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.413+0000 7f8fa37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8fa409c650 0x7f8fa409ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.413+0000 7f8fa37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8fa409c650 0x7f8fa409ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36018/0 (socket says 172.21.15.59:36018) 2023-09-30T22:34:10.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.413+0000 7f8fa37fe700 1 -- 172.21.15.59:0/690692421 learned_addr learned my addr 172.21.15.59:0/690692421 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:10.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.413+0000 7f8fa2ffd700 1 --1- 172.21.15.59:0/690692421 >> v1:172.21.15.59:6789/0 conn(0x7f8fa40a0090 0x7f8fa4131970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46464/0 (socket says 172.21.15.59:46464) 2023-09-30T22:34:10.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.413+0000 7f8fa3fff700 1 --2- 172.21.15.59:0/690692421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fa409cf60 0x7f8fa4132080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.413+0000 7f8fa37fe700 1 -- 172.21.15.59:0/690692421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fa409cf60 msgr2=0x7f8fa4132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:10.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.413+0000 7f8fa37fe700 1 --2- 172.21.15.59:0/690692421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fa409cf60 0x7f8fa4132080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.413+0000 7f8fa37fe700 1 -- 172.21.15.59:0/690692421 >> v1:172.21.15.59:6789/0 conn(0x7f8fa40a0090 legacy=0x7f8fa4131970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.413+0000 7f8fa37fe700 1 -- 172.21.15.59:0/690692421 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa409a080 con 0x7f8fa409c650 2023-09-30T22:34:10.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.414+0000 7f8fa37fe700 1 --2- 172.21.15.59:0/690692421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa409c650 0x7f8fa409ca20 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8f940098f0 tx=0x7f8f94009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749772deb391114d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:10.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.414+0000 7f8fa27fc700 1 -- 172.21.15.59:0/690692421 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9400b8a0 con 0x7f8fa409c650 2023-09-30T22:34:10.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.414+0000 7f8fa27fc700 1 -- 172.21.15.59:0/690692421 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9400ba00 con 0x7f8fa409c650 2023-09-30T22:34:10.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.414+0000 7f8fa27fc700 1 -- 172.21.15.59:0/690692421 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9400bd90 con 0x7f8fa409c650 2023-09-30T22:34:10.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.414+0000 7f8fa9a84700 1 -- 172.21.15.59:0/690692421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa409c650 msgr2=0x7f8fa409ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.414+0000 7f8fa9a84700 1 --2- 172.21.15.59:0/690692421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa409c650 0x7f8fa409ca20 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8f940098f0 tx=0x7f8f94009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:10.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.414+0000 7f8fa9a84700 1 -- 172.21.15.59:0/690692421 shutdown_connections 2023-09-30T22:34:10.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.414+0000 7f8fa9a84700 1 --2- 172.21.15.59:0/690692421 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fa409cf60 0x7f8fa4132080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.414+0000 7f8fa9a84700 1 --2- 172.21.15.59:0/690692421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa409c650 0x7f8fa409ca20 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.415+0000 7f8fa9a84700 1 -- 172.21.15.59:0/690692421 >> 172.21.15.59:0/690692421 conn(0x7f8fa40a3f70 msgr2=0x7f8fa40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:10.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.415+0000 7f8fa9a84700 1 -- 172.21.15.59:0/690692421 shutdown_connections 2023-09-30T22:34:10.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.415+0000 7f8fa9a84700 1 -- 172.21.15.59:0/690692421 wait complete. 2023-09-30T22:34:10.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.416+0000 7f8fa9a84700 1 Processor -- start 2023-09-30T22:34:10.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.416+0000 7f8fa9a84700 1 -- start start 2023-09-30T22:34:10.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f8fa9a84700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa409c650 0x7f8fa411c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f857ab5f700 1 Processor -- start 2023-09-30T22:34:10.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f8fa9a84700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fa409cf60 0x7f8fa411c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f8fa9a84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa40a0090 0x7f8fa411caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f8fa9a84700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa411dbe0 con 0x7f8fa409c650 2023-09-30T22:34:10.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f8fa9a84700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa411e200 con 0x7f8fa40a0090 2023-09-30T22:34:10.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f8fa9a84700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa411ee30 con 0x7f8fa409cf60 2023-09-30T22:34:10.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f857ab5f700 1 -- start start 2023-09-30T22:34:10.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f8fa3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa40a0090 0x7f8fa411caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f8fa3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa40a0090 0x7f8fa411caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58694/0 (socket says 172.21.15.59:58694) 2023-09-30T22:34:10.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f8fa3fff700 1 -- 172.21.15.59:0/3760929593 learned_addr learned my addr 172.21.15.59:0/3760929593 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:10.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f8fa3fff700 1 -- 172.21.15.59:0/3760929593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fa409cf60 msgr2=0x7f8fa411c560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:34:10.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f857ab5f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8574134630 0x7f8574136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f857ab5f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8574136f50 0x7f8574139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f857ab5f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857409b4f0 con 0x7f8574131810 2023-09-30T22:34:10.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f857ab5f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85741313c0 con 0x7f8574134630 2023-09-30T22:34:10.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f857ab5f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857406e8c0 con 0x7f8574136f50 2023-09-30T22:34:10.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f8fa3fff700 1 --2- 172.21.15.59:0/3760929593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fa409cf60 0x7f8fa411c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f8fa3fff700 1 -- 172.21.15.59:0/3760929593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa409c650 msgr2=0x7f8fa411c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f8fa3fff700 1 --2- 172.21.15.59:0/3760929593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa409c650 0x7f8fa411c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.417+0000 7f8fa3fff700 1 -- 172.21.15.59:0/3760929593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f94009550 con 0x7f8fa40a0090 2023-09-30T22:34:10.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.418+0000 7f85790fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8574136f50 0x7f8574139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.418+0000 7f85790fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8574136f50 0x7f8574139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58708/0 (socket says 172.21.15.59:58708) 2023-09-30T22:34:10.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.418+0000 7f85790fc700 1 -- 172.21.15.59:0/3457922629 learned_addr learned my addr 172.21.15.59:0/3457922629 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:10.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.418+0000 7f8573fff700 1 --2- 172.21.15.59:0/3457922629 >> v2:172.21.15.59:3300/0 conn(0x7f8574134630 0x7f8574136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.418+0000 7f8fa3fff700 1 --2- 172.21.15.59:0/3760929593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa40a0090 0x7f8fa411caa0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c007e70 tx=0x7f8f9c00e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:10.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.418+0000 7f85790fc700 1 -- 172.21.15.59:0/3457922629 >> v2:172.21.15.59:3300/0 conn(0x7f8574134630 msgr2=0x7f8574136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:10.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.418+0000 7f85790fc700 1 --2- 172.21.15.59:0/3457922629 >> v2:172.21.15.59:3300/0 conn(0x7f8574134630 0x7f8574136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.418+0000 7f85790fc700 1 -- 172.21.15.59:0/3457922629 >> v1:172.21.15.59:6789/0 conn(0x7f8574131810 legacy=0x7f8574131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.418+0000 7f85790fc700 1 -- 172.21.15.59:0/3457922629 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8574071d20 con 0x7f8574136f50 2023-09-30T22:34:10.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.418+0000 7f8f8bfff700 1 -- 172.21.15.59:0/3760929593 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00ee50 con 0x7f8fa40a0090 2023-09-30T22:34:10.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.418+0000 7f8fa9a84700 1 -- 172.21.15.59:0/3760929593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa411f810 con 0x7f8fa40a0090 2023-09-30T22:34:10.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.418+0000 7f8fa9a84700 1 -- 172.21.15.59:0/3760929593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa409d980 con 0x7f8fa40a0090 2023-09-30T22:34:10.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.418+0000 7f8f8bfff700 1 -- 172.21.15.59:0/3760929593 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c014420 con 0x7f8fa40a0090 2023-09-30T22:34:10.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.418+0000 7f8f8bfff700 1 -- 172.21.15.59:0/3760929593 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c0147d0 con 0x7f8fa40a0090 2023-09-30T22:34:10.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.419+0000 7f85790fc700 1 --2- 172.21.15.59:0/3457922629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8574136f50 0x7f8574139330 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f856c009e50 tx=0x7f856c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5701a65cfec9ac9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:10.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.419+0000 7f85737fe700 1 -- 172.21.15.59:0/3457922629 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c00e070 con 0x7f8574136f50 2023-09-30T22:34:10.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.419+0000 7f85737fe700 1 -- 172.21.15.59:0/3457922629 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c00b9c0 con 0x7f8574136f50 2023-09-30T22:34:10.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.419+0000 7f85737fe700 1 -- 172.21.15.59:0/3457922629 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c00bd30 con 0x7f8574136f50 2023-09-30T22:34:10.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.419+0000 7f8fa9a84700 1 -- 172.21.15.59:0/3760929593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f840052e0 con 0x7f8fa40a0090 2023-09-30T22:34:10.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.420+0000 7f8f8bfff700 1 -- 172.21.15.59:0/3760929593 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f9c014930 con 0x7f8fa40a0090 2023-09-30T22:34:10.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.420+0000 7f8f8bfff700 1 -- 172.21.15.59:0/3760929593 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f9c03ff80 con 0x7f8fa40a0090 2023-09-30T22:34:10.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.420+0000 7f857ab5f700 1 -- 172.21.15.59:0/3457922629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8574136f50 msgr2=0x7f8574139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.420+0000 7f857ab5f700 1 --2- 172.21.15.59:0/3457922629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8574136f50 0x7f8574139330 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f856c009e50 tx=0x7f856c00b330 comp rx=0 tx=0).stop 2023-09-30T22:34:10.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.420+0000 7f857ab5f700 1 -- 172.21.15.59:0/3457922629 shutdown_connections 2023-09-30T22:34:10.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.420+0000 7f857ab5f700 1 --2- 172.21.15.59:0/3457922629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8574136f50 0x7f8574139330 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.420+0000 7f857ab5f700 1 --2- 172.21.15.59:0/3457922629 >> v2:172.21.15.59:3300/0 conn(0x7f8574134630 0x7f8574136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.420+0000 7f857ab5f700 1 -- 172.21.15.59:0/3457922629 >> 172.21.15.59:0/3457922629 conn(0x7f85740a2aa0 msgr2=0x7f85740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.420+0000 7f857ab5f700 1 -- 172.21.15.59:0/3457922629 shutdown_connections 2023-09-30T22:34:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.425+0000 7f857ab5f700 1 -- 172.21.15.59:0/3457922629 wait complete. 2023-09-30T22:34:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.426+0000 7f857ab5f700 1 Processor -- start 2023-09-30T22:34:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.426+0000 7f857ab5f700 1 -- start start 2023-09-30T22:34:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.426+0000 7f857ab5f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8574131810 0x7f857412b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.426+0000 7f857ab5f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8574134630 0x7f857412b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.426+0000 7f857ab5f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8574136f50 0x7f857409c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.426+0000 7f857ab5f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857412d660 con 0x7f8574134630 2023-09-30T22:34:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.426+0000 7f857ab5f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8574071570 con 0x7f8574136f50 2023-09-30T22:34:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.426+0000 7f857ab5f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f857412e810 con 0x7f8574131810 2023-09-30T22:34:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.427+0000 7f85790fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8574136f50 0x7f857409c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.427+0000 7f85788fb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8574131810 0x7f857412b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.427+0000 7f85790fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8574136f50 0x7f857409c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58716/0 (socket says 172.21.15.59:58716) 2023-09-30T22:34:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.427+0000 7f85790fc700 1 -- 172.21.15.59:0/87514090 learned_addr learned my addr 172.21.15.59:0/87514090 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.427+0000 7f8573fff700 1 --2- 172.21.15.59:0/87514090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8574134630 0x7f857412b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.427+0000 7f85790fc700 1 -- 172.21.15.59:0/87514090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8574131810 msgr2=0x7f857412b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.427+0000 7f85790fc700 1 --2- 172.21.15.59:0/87514090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8574131810 0x7f857412b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.427+0000 7f85790fc700 1 -- 172.21.15.59:0/87514090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8574134630 msgr2=0x7f857412b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.427+0000 7f85790fc700 1 --2- 172.21.15.59:0/87514090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8574134630 0x7f857412b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.427+0000 7f85790fc700 1 -- 172.21.15.59:0/87514090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c009b30 con 0x7f8574136f50 2023-09-30T22:34:10.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.427+0000 7f85790fc700 1 --2- 172.21.15.59:0/87514090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8574136f50 0x7f857409c750 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f857406ea00 tx=0x7f856c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:10.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.429+0000 7f85717fa700 1 -- 172.21.15.59:0/87514090 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c004840 con 0x7f8574136f50 2023-09-30T22:34:10.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.429+0000 7f85717fa700 1 -- 172.21.15.59:0/87514090 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c0092e0 con 0x7f8574136f50 2023-09-30T22:34:10.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.429+0000 7f85717fa700 1 -- 172.21.15.59:0/87514090 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c01c650 con 0x7f8574136f50 2023-09-30T22:34:10.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.429+0000 7f857ab5f700 1 -- 172.21.15.59:0/87514090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857412ee90 con 0x7f8574136f50 2023-09-30T22:34:10.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.430+0000 7f857ab5f700 1 -- 172.21.15.59:0/87514090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857412d840 con 0x7f8574136f50 2023-09-30T22:34:10.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.430+0000 7f8f8bfff700 1 -- 172.21.15.59:0/3760929593 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f9c01b960 con 0x7f8fa40a0090 2023-09-30T22:34:10.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.430+0000 7f85717fa700 1 -- 172.21.15.59:0/87514090 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f856c01c7b0 con 0x7f8574136f50 2023-09-30T22:34:10.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.431+0000 7f85717fa700 1 -- 172.21.15.59:0/87514090 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f856c040d50 con 0x7f8574136f50 2023-09-30T22:34:10.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.431+0000 7f857ab5f700 1 -- 172.21.15.59:0/87514090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857412c460 con 0x7f8574136f50 2023-09-30T22:34:10.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.441+0000 7f85717fa700 1 -- 172.21.15.59:0/87514090 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f856c029080 con 0x7f8574136f50 2023-09-30T22:34:10.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.574+0000 7f2018a26700 1 -- 172.21.15.59:0/19025310 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2014074ea0 con 0x7f201409e410 2023-09-30T22:34:10.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.574+0000 7f2002ffd700 1 -- 172.21.15.59:0/19025310 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f200c018020 con 0x7f201409e410 2023-09-30T22:34:10.576 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.578+0000 7f2018a26700 1 -- 172.21.15.59:0/19025310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f201409e410 msgr2=0x7f201411ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.578+0000 7f2018a26700 1 --2- 172.21.15.59:0/19025310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f201409e410 0x7f201411ea40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f200c00efc0 tx=0x7f200c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.578+0000 7f2018a26700 1 -- 172.21.15.59:0/19025310 shutdown_connections 2023-09-30T22:34:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.578+0000 7f2018a26700 1 --2- 172.21.15.59:0/19025310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f201409e410 0x7f201411ea40 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.578+0000 7f2018a26700 1 --2- 172.21.15.59:0/19025310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f201409d6f0 0x7f201411dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.578+0000 7f2018a26700 1 --2- 172.21.15.59:0/19025310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f201409e000 0x7f201411e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.578+0000 7f2018a26700 1 -- 172.21.15.59:0/19025310 >> 172.21.15.59:0/19025310 conn(0x7f2014066f50 msgr2=0x7f2014071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:10.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.578+0000 7f2018a26700 1 -- 172.21.15.59:0/19025310 shutdown_connections 2023-09-30T22:34:10.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.578+0000 7f2018a26700 1 -- 172.21.15.59:0/19025310 wait complete. 2023-09-30T22:34:10.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:10.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.620+0000 7fc97e791700 1 -- 172.21.15.59:0/819710162 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc97806f5c0 con 0x7fc978131b40 2023-09-30T22:34:10.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.620+0000 7fc974ff9700 1 -- 172.21.15.59:0/819710162 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc97001a360 con 0x7fc978131b40 2023-09-30T22:34:10.621 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.622+0000 7fc97e791700 1 -- 172.21.15.59:0/819710162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc978131b40 msgr2=0x7fc9781c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.622+0000 7fc97e791700 1 --2- 172.21.15.59:0/819710162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc978131b40 0x7fc9781c8300 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc97000c730 tx=0x7fc97000ca40 comp rx=0 tx=0).stop 2023-09-30T22:34:10.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.622+0000 7fc97e791700 1 -- 172.21.15.59:0/819710162 shutdown_connections 2023-09-30T22:34:10.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.622+0000 7fc97e791700 1 --2- 172.21.15.59:0/819710162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc978131b40 0x7fc9781c8300 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.622+0000 7fc97e791700 1 --2- 172.21.15.59:0/819710162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97806a770 0x7fc97809ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.622+0000 7fc97e791700 1 --2- 172.21.15.59:0/819710162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc97806b080 0x7fc97809b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.622+0000 7fc97e791700 1 -- 172.21.15.59:0/819710162 >> 172.21.15.59:0/819710162 conn(0x7fc978066f50 msgr2=0x7fc9780700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:10.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.622+0000 7fc97e791700 1 -- 172.21.15.59:0/819710162 shutdown_connections 2023-09-30T22:34:10.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.622+0000 7fc97e791700 1 -- 172.21.15.59:0/819710162 wait complete. 2023-09-30T22:34:10.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:10.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.640+0000 7f8fa9a84700 1 -- 172.21.15.59:0/3760929593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f84005590 con 0x7f8fa40a0090 2023-09-30T22:34:10.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.640+0000 7f8f8bfff700 1 -- 172.21.15.59:0/3760929593 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f9c01b310 con 0x7f8fa40a0090 2023-09-30T22:34:10.641 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:10.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.643+0000 7f8fa9a84700 1 -- 172.21.15.59:0/3760929593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa40a0090 msgr2=0x7f8fa411caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.643+0000 7f8fa9a84700 1 --2- 172.21.15.59:0/3760929593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa40a0090 0x7f8fa411caa0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c007e70 tx=0x7f8f9c00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.643+0000 7f8fa9a84700 1 -- 172.21.15.59:0/3760929593 shutdown_connections 2023-09-30T22:34:10.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.643+0000 7f8fa9a84700 1 --2- 172.21.15.59:0/3760929593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa40a0090 0x7f8fa411caa0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.643+0000 7f8fa9a84700 1 --2- 172.21.15.59:0/3760929593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa409c650 0x7f8fa411c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.643+0000 7f8fa9a84700 1 --2- 172.21.15.59:0/3760929593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fa409cf60 0x7f8fa411c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.643+0000 7f8fa9a84700 1 -- 172.21.15.59:0/3760929593 >> 172.21.15.59:0/3760929593 conn(0x7f8fa40a3f70 msgr2=0x7f8fa40a3730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:10.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.644+0000 7f8fa9a84700 1 -- 172.21.15.59:0/3760929593 shutdown_connections 2023-09-30T22:34:10.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.644+0000 7f8fa9a84700 1 -- 172.21.15.59:0/3760929593 wait complete. 2023-09-30T22:34:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.659+0000 7f857ab5f700 1 -- 172.21.15.59:0/87514090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f85740721a0 con 0x7f8574136f50 2023-09-30T22:34:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.659+0000 7f85717fa700 1 -- 172.21.15.59:0/87514090 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f856c02c940 con 0x7f8574136f50 2023-09-30T22:34:10.661 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:10.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:10.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.662+0000 7f857ab5f700 1 -- 172.21.15.59:0/87514090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8574136f50 msgr2=0x7f857409c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:10.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.662+0000 7f857ab5f700 1 --2- 172.21.15.59:0/87514090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8574136f50 0x7f857409c750 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f857406ea00 tx=0x7f856c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.662+0000 7f857ab5f700 1 -- 172.21.15.59:0/87514090 shutdown_connections 2023-09-30T22:34:10.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.662+0000 7f857ab5f700 1 --2- 172.21.15.59:0/87514090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8574131810 0x7f857412b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.662+0000 7f857ab5f700 1 --2- 172.21.15.59:0/87514090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8574136f50 0x7f857409c750 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.662+0000 7f857ab5f700 1 --2- 172.21.15.59:0/87514090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8574134630 0x7f857412b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:10.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.663+0000 7f857ab5f700 1 -- 172.21.15.59:0/87514090 >> 172.21.15.59:0/87514090 conn(0x7f85740a2aa0 msgr2=0x7f8574132410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:10.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.663+0000 7f857ab5f700 1 -- 172.21.15.59:0/87514090 shutdown_connections 2023-09-30T22:34:10.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:10.663+0000 7f857ab5f700 1 -- 172.21.15.59:0/87514090 wait complete. 2023-09-30T22:34:10.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:11.599 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:11.641 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:11.664 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:11.678 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.763+0000 7f5da680f700 1 Processor -- start 2023-09-30T22:34:11.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.763+0000 7f5da680f700 1 -- start start 2023-09-30T22:34:11.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.764+0000 7f5da680f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5da0131810 0x7f5da0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.764+0000 7f5da680f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5da0099a40 0x7f5da0099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.764+0000 7f5da680f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5da009a3b0 0x7f5da0138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.764+0000 7f5da680f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da009b580 con 0x7f5da009a3b0 2023-09-30T22:34:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.764+0000 7f5da680f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da01313c0 con 0x7f5da0099a40 2023-09-30T22:34:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.764+0000 7f5da680f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5da006e8c0 con 0x7f5da0131810 2023-09-30T22:34:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.764+0000 7f5d9f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5da0099a40 0x7f5da0099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.764+0000 7f5d9f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5da0099a40 0x7f5da0099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58732/0 (socket says 172.21.15.59:58732) 2023-09-30T22:34:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.764+0000 7f5d9f7fe700 1 -- 172.21.15.59:0/3376697909 learned_addr learned my addr 172.21.15.59:0/3376697909 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.764+0000 7f5da4dac700 1 --2- 172.21.15.59:0/3376697909 >> v2:172.21.15.59:3300/0 conn(0x7f5da009a3b0 0x7f5da0138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.764+0000 7f5d9ffff700 1 --2- 172.21.15.59:0/3376697909 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5da0131810 0x7f5da0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.765+0000 7f5d9f7fe700 1 -- 172.21.15.59:0/3376697909 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5da0131810 msgr2=0x7f5da0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.765+0000 7f5d9f7fe700 1 --2- 172.21.15.59:0/3376697909 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5da0131810 0x7f5da0131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.765+0000 7f5d9f7fe700 1 -- 172.21.15.59:0/3376697909 >> v2:172.21.15.59:3300/0 conn(0x7f5da009a3b0 msgr2=0x7f5da0138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.765+0000 7f5d9f7fe700 1 --2- 172.21.15.59:0/3376697909 >> v2:172.21.15.59:3300/0 conn(0x7f5da009a3b0 0x7f5da0138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.765+0000 7f5d9f7fe700 1 -- 172.21.15.59:0/3376697909 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da009a820 con 0x7f5da0099a40 2023-09-30T22:34:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.765+0000 7f5d9f7fe700 1 --2- 172.21.15.59:0/3376697909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5da0099a40 0x7f5da0099e70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5d940098f0 tx=0x7f5d94009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91d2440abf9bad4d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.765+0000 7f5d9effd700 1 -- 172.21.15.59:0/3376697909 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94011830 con 0x7f5da0099a40 2023-09-30T22:34:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.765+0000 7f5d9effd700 1 -- 172.21.15.59:0/3376697909 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d94011990 con 0x7f5da0099a40 2023-09-30T22:34:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.765+0000 7f5d9effd700 1 -- 172.21.15.59:0/3376697909 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94011d20 con 0x7f5da0099a40 2023-09-30T22:34:11.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.766+0000 7f5da680f700 1 -- 172.21.15.59:0/3376697909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5da0099a40 msgr2=0x7f5da0099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:11.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.766+0000 7f5da680f700 1 --2- 172.21.15.59:0/3376697909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5da0099a40 0x7f5da0099e70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5d940098f0 tx=0x7f5d94009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:11.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.766+0000 7f5da680f700 1 -- 172.21.15.59:0/3376697909 shutdown_connections 2023-09-30T22:34:11.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.766+0000 7f5da680f700 1 --2- 172.21.15.59:0/3376697909 >> v2:172.21.15.59:3300/0 conn(0x7f5da009a3b0 0x7f5da0138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.766+0000 7f5da680f700 1 --2- 172.21.15.59:0/3376697909 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5da0131810 0x7f5da0131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.766+0000 7f5da680f700 1 --2- 172.21.15.59:0/3376697909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5da0099a40 0x7f5da0099e70 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.766+0000 7f5da680f700 1 -- 172.21.15.59:0/3376697909 >> 172.21.15.59:0/3376697909 conn(0x7f5da00a2aa0 msgr2=0x7f5da00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:11.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.766+0000 7f5da680f700 1 -- 172.21.15.59:0/3376697909 shutdown_connections 2023-09-30T22:34:11.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.766+0000 7f5da680f700 1 -- 172.21.15.59:0/3376697909 wait complete. 2023-09-30T22:34:11.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.768+0000 7f5da680f700 1 Processor -- start 2023-09-30T22:34:11.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.768+0000 7f5da680f700 1 -- start start 2023-09-30T22:34:11.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5da680f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5da0099a40 0x7f5da0118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5da680f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da009a3b0 0x7f5da0119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5da680f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5da0131810 0x7f5da0119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5da680f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da011c170 con 0x7f5da009a3b0 2023-09-30T22:34:11.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5da680f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da0130790 con 0x7f5da0099a40 2023-09-30T22:34:11.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5da680f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5da006eb00 con 0x7f5da0131810 2023-09-30T22:34:11.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5da4dac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5da0131810 0x7f5da0119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5da4dac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5da0131810 0x7f5da0119750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41612/0 (socket says 172.21.15.59:41612) 2023-09-30T22:34:11.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5da4dac700 1 -- 172.21.15.59:0/849447550 learned_addr learned my addr 172.21.15.59:0/849447550 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:11.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5d9f7fe700 1 --2- 172.21.15.59:0/849447550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da009a3b0 0x7f5da0119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5d9ffff700 1 --2- 172.21.15.59:0/849447550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5da0099a40 0x7f5da0118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5da4dac700 1 -- 172.21.15.59:0/849447550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5da0099a40 msgr2=0x7f5da0118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:11.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5da4dac700 1 --2- 172.21.15.59:0/849447550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5da0099a40 0x7f5da0118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5da4dac700 1 -- 172.21.15.59:0/849447550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da009a3b0 msgr2=0x7f5da0119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:11.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5da4dac700 1 --2- 172.21.15.59:0/849447550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da009a3b0 0x7f5da0119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.769+0000 7f5da4dac700 1 -- 172.21.15.59:0/849447550 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d94009550 con 0x7f5da0131810 2023-09-30T22:34:11.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.770+0000 7f5da4dac700 1 --2- 172.21.15.59:0/849447550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5da0131810 0x7f5da0119750 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800efc0 tx=0x7f5d9800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:11.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.770+0000 7f5d9cff9700 1 -- 172.21.15.59:0/849447550 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98009ea0 con 0x7f5da0131810 2023-09-30T22:34:11.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.770+0000 7f5da680f700 1 -- 172.21.15.59:0/849447550 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da011b900 con 0x7f5da0131810 2023-09-30T22:34:11.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.770+0000 7f5d9cff9700 1 -- 172.21.15.59:0/849447550 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9800f040 con 0x7f5da0131810 2023-09-30T22:34:11.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.770+0000 7f5d9cff9700 1 -- 172.21.15.59:0/849447550 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9800ced0 con 0x7f5da0131810 2023-09-30T22:34:11.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.770+0000 7f5da680f700 1 -- 172.21.15.59:0/849447550 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da011a280 con 0x7f5da0131810 2023-09-30T22:34:11.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.771+0000 7f5da680f700 1 -- 172.21.15.59:0/849447550 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da0074ea0 con 0x7f5da0131810 2023-09-30T22:34:11.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.772+0000 7f5d9cff9700 1 -- 172.21.15.59:0/849447550 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d98014480 con 0x7f5da0131810 2023-09-30T22:34:11.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.772+0000 7f5d9cff9700 1 -- 172.21.15.59:0/849447550 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5d98040170 con 0x7f5da0131810 2023-09-30T22:34:11.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.777+0000 7f5d9cff9700 1 -- 172.21.15.59:0/849447550 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d980248f0 con 0x7f5da0131810 2023-09-30T22:34:11.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.794+0000 7fc8fbd09700 1 Processor -- start 2023-09-30T22:34:11.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.795+0000 7fc8fbd09700 1 -- start start 2023-09-30T22:34:11.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.795+0000 7fc8fbd09700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8f409d6f0 0x7fc8f409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.795+0000 7fc8fbd09700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc8f409e000 0x7fc8f4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.795+0000 7fc8fbd09700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8f409e410 0x7fc8f4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.795+0000 7fc8fbd09700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f409f520 con 0x7fc8f409e000 2023-09-30T22:34:11.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.795+0000 7fc8fbd09700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f409f130 con 0x7fc8f409d6f0 2023-09-30T22:34:11.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.795+0000 7fc8fbd09700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f409e930 con 0x7fc8f409e410 2023-09-30T22:34:11.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.795+0000 7fc8f9aa5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8f409d6f0 0x7fc8f409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.795+0000 7fc8f9aa5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8f409d6f0 0x7fc8f409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58750/0 (socket says 172.21.15.59:58750) 2023-09-30T22:34:11.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.795+0000 7fc8f9aa5700 1 -- 172.21.15.59:0/3245501624 learned_addr learned my addr 172.21.15.59:0/3245501624 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:11.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.796+0000 7fc8f92a4700 1 --2- 172.21.15.59:0/3245501624 >> v2:172.21.15.59:3300/0 conn(0x7fc8f409e000 0x7fc8f4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.796+0000 7fc8fa2a6700 1 --2- 172.21.15.59:0/3245501624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8f409e410 0x7fc8f4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.796+0000 7fc8f92a4700 1 -- 172.21.15.59:0/3245501624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8f409e410 msgr2=0x7fc8f4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.796+0000 7fc8f92a4700 1 --2- 172.21.15.59:0/3245501624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8f409e410 0x7fc8f4130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.796+0000 7fc8f92a4700 1 -- 172.21.15.59:0/3245501624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8f409d6f0 msgr2=0x7fc8f409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.796+0000 7fc8f92a4700 1 --2- 172.21.15.59:0/3245501624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8f409d6f0 0x7fc8f409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.796+0000 7fc8f92a4700 1 -- 172.21.15.59:0/3245501624 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f409b2d0 con 0x7fc8f409e000 2023-09-30T22:34:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.796+0000 7fc8fa2a6700 1 --2- 172.21.15.59:0/3245501624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8f409e410 0x7fc8f4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.796+0000 7fc8f9aa5700 1 --2- 172.21.15.59:0/3245501624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8f409d6f0 0x7fc8f409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.796+0000 7fc8f92a4700 1 --2- 172.21.15.59:0/3245501624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8f409e000 0x7fc8f4130660 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009870 tx=0x7fc8e8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4570af9c3c70e4eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.796+0000 7fc8f8aa3700 1 -- 172.21.15.59:0/3245501624 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8011830 con 0x7fc8f409e000 2023-09-30T22:34:11.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.797+0000 7fc8f8aa3700 1 -- 172.21.15.59:0/3245501624 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e8011990 con 0x7fc8f409e000 2023-09-30T22:34:11.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.797+0000 7fc8f8aa3700 1 -- 172.21.15.59:0/3245501624 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8011d20 con 0x7fc8f409e000 2023-09-30T22:34:11.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.797+0000 7fc8fbd09700 1 -- 172.21.15.59:0/3245501624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8f409e000 msgr2=0x7fc8f4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:11.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.797+0000 7fc8fbd09700 1 --2- 172.21.15.59:0/3245501624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8f409e000 0x7fc8f4130660 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009870 tx=0x7fc8e8009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:11.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.797+0000 7fc8fbd09700 1 -- 172.21.15.59:0/3245501624 shutdown_connections 2023-09-30T22:34:11.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.797+0000 7fc8fbd09700 1 --2- 172.21.15.59:0/3245501624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8f409e410 0x7fc8f4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.797+0000 7fc8fbd09700 1 --2- 172.21.15.59:0/3245501624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8f409d6f0 0x7fc8f409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.797+0000 7fc8fbd09700 1 --2- 172.21.15.59:0/3245501624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8f409e000 0x7fc8f4130660 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.797+0000 7fc8fbd09700 1 -- 172.21.15.59:0/3245501624 >> 172.21.15.59:0/3245501624 conn(0x7fc8f4066f50 msgr2=0x7fc8f409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:11.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.797+0000 7fc8fbd09700 1 -- 172.21.15.59:0/3245501624 shutdown_connections 2023-09-30T22:34:11.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.797+0000 7fc8fbd09700 1 -- 172.21.15.59:0/3245501624 wait complete. 2023-09-30T22:34:11.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.799+0000 7fc8fbd09700 1 Processor -- start 2023-09-30T22:34:11.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.799+0000 7fc8fbd09700 1 -- start start 2023-09-30T22:34:11.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8fbd09700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8f409d6f0 0x7fc8f41223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8fbd09700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8f409e000 0x7fc8f4122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8fbd09700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8f409e410 0x7fc8f4122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8fbd09700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4125c70 con 0x7fc8f409e000 2023-09-30T22:34:11.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8fbd09700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4123f60 con 0x7fc8f409e410 2023-09-30T22:34:11.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8fbd09700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4125e70 con 0x7fc8f409d6f0 2023-09-30T22:34:11.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8f92a4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8f409e000 0x7fc8f4122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8f92a4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8f409e000 0x7fc8f4122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36082/0 (socket says 172.21.15.59:36082) 2023-09-30T22:34:11.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8f92a4700 1 -- 172.21.15.59:0/568229103 learned_addr learned my addr 172.21.15.59:0/568229103 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:11.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8f9aa5700 1 --2- 172.21.15.59:0/568229103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8f409d6f0 0x7fc8f41223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8fa2a6700 1 --2- 172.21.15.59:0/568229103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8f409e410 0x7fc8f4122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8f92a4700 1 -- 172.21.15.59:0/568229103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8f409d6f0 msgr2=0x7fc8f41223c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:11.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8f92a4700 1 --2- 172.21.15.59:0/568229103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8f409d6f0 0x7fc8f41223c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8f92a4700 1 -- 172.21.15.59:0/568229103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8f409e410 msgr2=0x7fc8f4122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:11.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8f92a4700 1 --2- 172.21.15.59:0/568229103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8f409e410 0x7fc8f4122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8f92a4700 1 -- 172.21.15.59:0/568229103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e400bd40 con 0x7fc8f409e000 2023-09-30T22:34:11.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.800+0000 7fc8fa2a6700 1 --2- 172.21.15.59:0/568229103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8f409e410 0x7fc8f4122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:34:11.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.801+0000 7fc8f92a4700 1 --2- 172.21.15.59:0/568229103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8f409e000 0x7fc8f4122900 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80090b0 tx=0x7fc8e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:11.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.801+0000 7fc8f27fc700 1 -- 172.21.15.59:0/568229103 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8004550 con 0x7fc8f409e000 2023-09-30T22:34:11.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.801+0000 7fc8f27fc700 1 -- 172.21.15.59:0/568229103 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e801f070 con 0x7fc8f409e000 2023-09-30T22:34:11.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.801+0000 7fc8fbd09700 1 -- 172.21.15.59:0/568229103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e80094a0 con 0x7fc8f409e000 2023-09-30T22:34:11.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.801+0000 7fc8f27fc700 1 -- 172.21.15.59:0/568229103 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e80038e0 con 0x7fc8f409e000 2023-09-30T22:34:11.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.801+0000 7fc8fbd09700 1 -- 172.21.15.59:0/568229103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f409c700 con 0x7fc8f409e000 2023-09-30T22:34:11.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.802+0000 7fc8f27fc700 1 -- 172.21.15.59:0/568229103 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8e8003a40 con 0x7fc8f409e000 2023-09-30T22:34:11.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.802+0000 7fc8fbd09700 1 -- 172.21.15.59:0/568229103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f4074ea0 con 0x7fc8f409e000 2023-09-30T22:34:11.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.802+0000 7fc8f27fc700 1 -- 172.21.15.59:0/568229103 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc8e8021070 con 0x7fc8f409e000 2023-09-30T22:34:11.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.807+0000 7fc8f27fc700 1 -- 172.21.15.59:0/568229103 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8e8026480 con 0x7fc8f409e000 2023-09-30T22:34:11.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.836+0000 7f90871fb700 1 Processor -- start 2023-09-30T22:34:11.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.836+0000 7f90871fb700 1 -- start start 2023-09-30T22:34:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f90871fb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f908006a770 0x7f908009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f90871fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f908009dc30 0x7f908009e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f90871fb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f908013c1e0 0x7f908013e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f90871fb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908006ab40 con 0x7f908006a770 2023-09-30T22:34:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f90871fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908009ebc0 con 0x7f908009dc30 2023-09-30T22:34:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f90871fb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f908009a810 con 0x7f908013c1e0 2023-09-30T22:34:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f9084f97700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f908006a770 0x7f908009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f9084f97700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f908006a770 0x7f908009d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36090/0 (socket says 172.21.15.59:36090) 2023-09-30T22:34:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f9084f97700 1 -- 172.21.15.59:0/3910059848 learned_addr learned my addr 172.21.15.59:0/3910059848 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:11.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f9085798700 1 --2- 172.21.15.59:0/3910059848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f908013c1e0 0x7f908013e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f907ffff700 1 --2- 172.21.15.59:0/3910059848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f908009dc30 0x7f908009e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f9085798700 1 -- 172.21.15.59:0/3910059848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f908009dc30 msgr2=0x7f908009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:11.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f9085798700 1 --2- 172.21.15.59:0/3910059848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f908009dc30 0x7f908009e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f9085798700 1 -- 172.21.15.59:0/3910059848 >> v2:172.21.15.59:3300/0 conn(0x7f908006a770 msgr2=0x7f908009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:11.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f9085798700 1 --2- 172.21.15.59:0/3910059848 >> v2:172.21.15.59:3300/0 conn(0x7f908006a770 0x7f908009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f9085798700 1 -- 172.21.15.59:0/3910059848 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908009e920 con 0x7f908013c1e0 2023-09-30T22:34:11.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.837+0000 7f9084f97700 1 --2- 172.21.15.59:0/3910059848 >> v2:172.21.15.59:3300/0 conn(0x7f908006a770 0x7f908009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:11.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.838+0000 7f9085798700 1 --2- 172.21.15.59:0/3910059848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f908013c1e0 0x7f908013e5c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9078009dc0 tx=0x7f907800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f3b1bfbe668be97 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:11.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.838+0000 7f907f7fe700 1 -- 172.21.15.59:0/3910059848 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907800e070 con 0x7f908013c1e0 2023-09-30T22:34:11.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.838+0000 7f907f7fe700 1 -- 172.21.15.59:0/3910059848 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907800bae0 con 0x7f908013c1e0 2023-09-30T22:34:11.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.838+0000 7f907f7fe700 1 -- 172.21.15.59:0/3910059848 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907800be90 con 0x7f908013c1e0 2023-09-30T22:34:11.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.838+0000 7f90871fb700 1 -- 172.21.15.59:0/3910059848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f908013c1e0 msgr2=0x7f908013e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:11.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.838+0000 7f90871fb700 1 --2- 172.21.15.59:0/3910059848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f908013c1e0 0x7f908013e5c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9078009dc0 tx=0x7f907800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:11.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.839+0000 7f90871fb700 1 -- 172.21.15.59:0/3910059848 shutdown_connections 2023-09-30T22:34:11.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.839+0000 7f90871fb700 1 --2- 172.21.15.59:0/3910059848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f908013c1e0 0x7f908013e5c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.839+0000 7f90871fb700 1 --2- 172.21.15.59:0/3910059848 >> v2:172.21.15.59:3300/0 conn(0x7f908006a770 0x7f908009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.839+0000 7f90871fb700 1 --2- 172.21.15.59:0/3910059848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f908009dc30 0x7f908009e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.839+0000 7f90871fb700 1 -- 172.21.15.59:0/3910059848 >> 172.21.15.59:0/3910059848 conn(0x7f9080066f50 msgr2=0x7f908009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:11.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.839+0000 7f90871fb700 1 -- 172.21.15.59:0/3910059848 shutdown_connections 2023-09-30T22:34:11.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.839+0000 7f90871fb700 1 -- 172.21.15.59:0/3910059848 wait complete. 2023-09-30T22:34:11.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.840+0000 7f90871fb700 1 Processor -- start 2023-09-30T22:34:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.840+0000 7f90871fb700 1 -- start start 2023-09-30T22:34:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.840+0000 7f90871fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f908006a770 0x7f90801cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.840+0000 7f90871fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f908009dc30 0x7f90801cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.840+0000 7f90871fb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f908013c1e0 0x7f90801cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.840+0000 7f90871fb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90801283a0 con 0x7f908009dc30 2023-09-30T22:34:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.840+0000 7f90871fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908009f210 con 0x7f908006a770 2023-09-30T22:34:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.840+0000 7f90871fb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9080127f00 con 0x7f908013c1e0 2023-09-30T22:34:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.841+0000 7f9084f97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f908006a770 0x7f90801cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.841+0000 7f9084f97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f908006a770 0x7f90801cc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58782/0 (socket says 172.21.15.59:58782) 2023-09-30T22:34:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.841+0000 7f9084f97700 1 -- 172.21.15.59:0/1441880951 learned_addr learned my addr 172.21.15.59:0/1441880951 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.841+0000 7f907ffff700 1 --2- 172.21.15.59:0/1441880951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f908009dc30 0x7f90801cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.841+0000 7f9085798700 1 --2- 172.21.15.59:0/1441880951 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f908013c1e0 0x7f90801cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.841+0000 7f9084f97700 1 -- 172.21.15.59:0/1441880951 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f908013c1e0 msgr2=0x7f90801cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.841+0000 7f9084f97700 1 --2- 172.21.15.59:0/1441880951 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f908013c1e0 0x7f90801cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.841+0000 7f9084f97700 1 -- 172.21.15.59:0/1441880951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f908009dc30 msgr2=0x7f90801cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.841+0000 7f9084f97700 1 --2- 172.21.15.59:0/1441880951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f908009dc30 0x7f90801cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.841+0000 7f9084f97700 1 -- 172.21.15.59:0/1441880951 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9074009550 con 0x7f908006a770 2023-09-30T22:34:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.841+0000 7f9084f97700 1 --2- 172.21.15.59:0/1441880951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f908006a770 0x7f90801cc3e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f907400ec10 tx=0x7f907400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.841+0000 7f907d7fa700 1 -- 172.21.15.59:0/1441880951 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907400c850 con 0x7f908006a770 2023-09-30T22:34:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.841+0000 7f907d7fa700 1 -- 172.21.15.59:0/1441880951 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907400c9b0 con 0x7f908006a770 2023-09-30T22:34:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.842+0000 7f90871fb700 1 -- 172.21.15.59:0/1441880951 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9078009a70 con 0x7f908006a770 2023-09-30T22:34:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.842+0000 7f907d7fa700 1 -- 172.21.15.59:0/1441880951 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907400cd40 con 0x7f908006a770 2023-09-30T22:34:11.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.842+0000 7f90871fb700 1 -- 172.21.15.59:0/1441880951 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90801299b0 con 0x7f908006a770 2023-09-30T22:34:11.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.842+0000 7f907d7fa700 1 -- 172.21.15.59:0/1441880951 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9074013470 con 0x7f908006a770 2023-09-30T22:34:11.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.843+0000 7f907d7fa700 1 -- 172.21.15.59:0/1441880951 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f907403fc70 con 0x7f908006a770 2023-09-30T22:34:11.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.843+0000 7f90871fb700 1 -- 172.21.15.59:0/1441880951 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90801285d0 con 0x7f908006a770 2023-09-30T22:34:11.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.848+0000 7f907d7fa700 1 -- 172.21.15.59:0/1441880951 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9074013720 con 0x7f908006a770 2023-09-30T22:34:11.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.883+0000 7f6aa9d27700 1 Processor -- start 2023-09-30T22:34:11.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.883+0000 7f6aa9d27700 1 -- start start 2023-09-30T22:34:11.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.884+0000 7f6aa9d27700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4133420 0x7f6aa41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.884+0000 7f6aa9d27700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa4133e30 0x7f6aa412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.884+0000 7f6aa9d27700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6aa4134260 0x7f6aa41304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.884+0000 7f6aa9d27700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa406b990 con 0x7f6aa4134260 2023-09-30T22:34:11.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.884+0000 7f6aa9d27700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa40a0590 con 0x7f6aa4133420 2023-09-30T22:34:11.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.884+0000 7f6aa9d27700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa409fb80 con 0x7f6aa4133e30 2023-09-30T22:34:11.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.884+0000 7f6aa37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4133420 0x7f6aa41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.884+0000 7f6aa37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4133420 0x7f6aa41337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58798/0 (socket says 172.21.15.59:58798) 2023-09-30T22:34:11.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.884+0000 7f6aa37fe700 1 -- 172.21.15.59:0/1872249564 learned_addr learned my addr 172.21.15.59:0/1872249564 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.884+0000 7f6aa3fff700 1 --2- 172.21.15.59:0/1872249564 >> v2:172.21.15.59:3300/0 conn(0x7f6aa4134260 0x7f6aa41304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.884+0000 7f6aa2ffd700 1 --2- 172.21.15.59:0/1872249564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa4133e30 0x7f6aa412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.885+0000 7f6aa37fe700 1 -- 172.21.15.59:0/1872249564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa4133e30 msgr2=0x7f6aa412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.885+0000 7f6aa37fe700 1 --2- 172.21.15.59:0/1872249564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa4133e30 0x7f6aa412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.885+0000 7f6aa37fe700 1 -- 172.21.15.59:0/1872249564 >> v2:172.21.15.59:3300/0 conn(0x7f6aa4134260 msgr2=0x7f6aa41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.885+0000 7f6aa37fe700 1 --2- 172.21.15.59:0/1872249564 >> v2:172.21.15.59:3300/0 conn(0x7f6aa4134260 0x7f6aa41304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.885+0000 7f6aa37fe700 1 -- 172.21.15.59:0/1872249564 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa40a0030 con 0x7f6aa4133420 2023-09-30T22:34:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.885+0000 7f6aa2ffd700 1 --2- 172.21.15.59:0/1872249564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa4133e30 0x7f6aa412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.885+0000 7f6aa37fe700 1 --2- 172.21.15.59:0/1872249564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4133420 0x7f6aa41337f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6a940098f0 tx=0x7f6a94009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a3e73580b13bc02 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.885+0000 7f6aa27fc700 1 -- 172.21.15.59:0/1872249564 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94011830 con 0x7f6aa4133420 2023-09-30T22:34:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.885+0000 7f6aa27fc700 1 -- 172.21.15.59:0/1872249564 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a94011990 con 0x7f6aa4133420 2023-09-30T22:34:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.885+0000 7f6aa27fc700 1 -- 172.21.15.59:0/1872249564 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94011d20 con 0x7f6aa4133420 2023-09-30T22:34:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.886+0000 7f6aa9d27700 1 -- 172.21.15.59:0/1872249564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4133420 msgr2=0x7f6aa41337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.886+0000 7f6aa9d27700 1 --2- 172.21.15.59:0/1872249564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4133420 0x7f6aa41337f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6a940098f0 tx=0x7f6a94009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.886+0000 7f6aa9d27700 1 -- 172.21.15.59:0/1872249564 shutdown_connections 2023-09-30T22:34:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.886+0000 7f6aa9d27700 1 --2- 172.21.15.59:0/1872249564 >> v2:172.21.15.59:3300/0 conn(0x7f6aa4134260 0x7f6aa41304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.886+0000 7f6aa9d27700 1 --2- 172.21.15.59:0/1872249564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4133420 0x7f6aa41337f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.886+0000 7f6aa9d27700 1 --2- 172.21.15.59:0/1872249564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa4133e30 0x7f6aa412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.886+0000 7f6aa9d27700 1 -- 172.21.15.59:0/1872249564 >> 172.21.15.59:0/1872249564 conn(0x7f6aa40a4210 msgr2=0x7f6aa40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.886+0000 7f6aa9d27700 1 -- 172.21.15.59:0/1872249564 shutdown_connections 2023-09-30T22:34:11.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.886+0000 7f6aa9d27700 1 -- 172.21.15.59:0/1872249564 wait complete. 2023-09-30T22:34:11.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.888+0000 7f6aa9d27700 1 Processor -- start 2023-09-30T22:34:11.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.889+0000 7f6aa9d27700 1 -- start start 2023-09-30T22:34:11.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa9d27700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa4133420 0x7f6aa40709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa9d27700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4133e30 0x7f6aa4070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa9d27700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa4134260 0x7f6aa4071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:11.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa9d27700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa40723a0 con 0x7f6aa4134260 2023-09-30T22:34:11.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa9d27700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa411f420 con 0x7f6aa4133e30 2023-09-30T22:34:11.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa9d27700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa411fb60 con 0x7f6aa4133420 2023-09-30T22:34:11.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa4133420 0x7f6aa40709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa4133420 0x7f6aa40709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41670/0 (socket says 172.21.15.59:41670) 2023-09-30T22:34:11.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa37fe700 1 -- 172.21.15.59:0/1506783309 learned_addr learned my addr 172.21.15.59:0/1506783309 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:11.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa2ffd700 1 --2- 172.21.15.59:0/1506783309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4133e30 0x7f6aa4070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa3fff700 1 --2- 172.21.15.59:0/1506783309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa4134260 0x7f6aa4071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:11.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa37fe700 1 -- 172.21.15.59:0/1506783309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4133e30 msgr2=0x7f6aa4070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:11.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa37fe700 1 --2- 172.21.15.59:0/1506783309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4133e30 0x7f6aa4070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa37fe700 1 -- 172.21.15.59:0/1506783309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa4134260 msgr2=0x7f6aa4071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:11.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa37fe700 1 --2- 172.21.15.59:0/1506783309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa4134260 0x7f6aa4071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:11.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa37fe700 1 -- 172.21.15.59:0/1506783309 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a94009550 con 0x7f6aa4133420 2023-09-30T22:34:11.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.890+0000 7f6aa37fe700 1 --2- 172.21.15.59:0/1506783309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa4133420 0x7f6aa40709a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40a06d0 tx=0x7f6a94004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.891+0000 7f6a8bfff700 1 -- 172.21.15.59:0/1506783309 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94004450 con 0x7f6aa4133420 2023-09-30T22:34:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.891+0000 7f6a8bfff700 1 -- 172.21.15.59:0/1506783309 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a940045b0 con 0x7f6aa4133420 2023-09-30T22:34:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.891+0000 7f6a8bfff700 1 -- 172.21.15.59:0/1506783309 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a940038e0 con 0x7f6aa4133420 2023-09-30T22:34:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.891+0000 7f6aa9d27700 1 -- 172.21.15.59:0/1506783309 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa4120890 con 0x7f6aa4133420 2023-09-30T22:34:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.891+0000 7f6aa9d27700 1 -- 172.21.15.59:0/1506783309 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa412db00 con 0x7f6aa4133420 2023-09-30T22:34:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.892+0000 7f6a8bfff700 1 -- 172.21.15.59:0/1506783309 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a94003a40 con 0x7f6aa4133420 2023-09-30T22:34:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.892+0000 7f6a8bfff700 1 -- 172.21.15.59:0/1506783309 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6a94010df0 con 0x7f6aa4133420 2023-09-30T22:34:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.892+0000 7f6aa9d27700 1 -- 172.21.15.59:0/1506783309 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa4074ea0 con 0x7f6aa4133420 2023-09-30T22:34:11.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:11.897+0000 7f6a8bfff700 1 -- 172.21.15.59:0/1506783309 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a94015080 con 0x7f6aa4133420 2023-09-30T22:34:12.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.021+0000 7fc8fbd09700 1 -- 172.21.15.59:0/568229103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc8f406c360 con 0x7fc8f409e000 2023-09-30T22:34:12.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.022+0000 7fc8f27fc700 1 -- 172.21.15.59:0/568229103 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8e802b020 con 0x7fc8f409e000 2023-09-30T22:34:12.023 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:12.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.023+0000 7f5da680f700 1 -- 172.21.15.59:0/849447550 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5da0071d80 con 0x7f5da0131810 2023-09-30T22:34:12.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.023+0000 7f5d9cff9700 1 -- 172.21.15.59:0/849447550 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d98024300 con 0x7f5da0131810 2023-09-30T22:34:12.025 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:12.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.024+0000 7fc8fbd09700 1 -- 172.21.15.59:0/568229103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8f409e000 msgr2=0x7fc8f4122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:12.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.024+0000 7fc8fbd09700 1 --2- 172.21.15.59:0/568229103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8f409e000 0x7fc8f4122900 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80090b0 tx=0x7fc8e8004750 comp rx=0 tx=0).stop 2023-09-30T22:34:12.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.025+0000 7fc8fbd09700 1 -- 172.21.15.59:0/568229103 shutdown_connections 2023-09-30T22:34:12.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.025+0000 7fc8fbd09700 1 --2- 172.21.15.59:0/568229103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8f409d6f0 0x7fc8f41223c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:12.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.025+0000 7fc8fbd09700 1 --2- 172.21.15.59:0/568229103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8f409e410 0x7fc8f4122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:12.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.025+0000 7fc8fbd09700 1 --2- 172.21.15.59:0/568229103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8f409e000 0x7fc8f4122900 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:12.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.025+0000 7fc8fbd09700 1 -- 172.21.15.59:0/568229103 >> 172.21.15.59:0/568229103 conn(0x7fc8f4066f50 msgr2=0x7fc8f406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:12.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.025+0000 7fc8fbd09700 1 -- 172.21.15.59:0/568229103 shutdown_connections 2023-09-30T22:34:12.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.025+0000 7fc8fbd09700 1 -- 172.21.15.59:0/568229103 wait complete. 2023-09-30T22:34:12.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.026+0000 7f5da680f700 1 -- 172.21.15.59:0/849447550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5da0131810 msgr2=0x7f5da0119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:12.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.026+0000 7f5da680f700 1 --2- 172.21.15.59:0/849447550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5da0131810 0x7f5da0119750 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800efc0 tx=0x7f5d9800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:12.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.026+0000 7f5da680f700 1 -- 172.21.15.59:0/849447550 shutdown_connections 2023-09-30T22:34:12.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.026+0000 7f5da680f700 1 --2- 172.21.15.59:0/849447550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5da0131810 0x7f5da0119750 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:12.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.026+0000 7f5da680f700 1 --2- 172.21.15.59:0/849447550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5da0099a40 0x7f5da0118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:12.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.026+0000 7f5da680f700 1 --2- 172.21.15.59:0/849447550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da009a3b0 0x7f5da0119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:12.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.026+0000 7f5da680f700 1 -- 172.21.15.59:0/849447550 >> 172.21.15.59:0/849447550 conn(0x7f5da00a2aa0 msgr2=0x7f5da012e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:12.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.027+0000 7f5da680f700 1 -- 172.21.15.59:0/849447550 shutdown_connections 2023-09-30T22:34:12.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.027+0000 7f5da680f700 1 -- 172.21.15.59:0/849447550 wait complete. 2023-09-30T22:34:12.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:12.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:12.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.097+0000 7f90871fb700 1 -- 172.21.15.59:0/1441880951 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9080074ea0 con 0x7f908006a770 2023-09-30T22:34:12.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.097+0000 7f907d7fa700 1 -- 172.21.15.59:0/1441880951 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9074021020 con 0x7f908006a770 2023-09-30T22:34:12.099 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:12.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.099+0000 7f90871fb700 1 -- 172.21.15.59:0/1441880951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f908006a770 msgr2=0x7f90801cc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:12.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.099+0000 7f90871fb700 1 --2- 172.21.15.59:0/1441880951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f908006a770 0x7f90801cc3e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f907400ec10 tx=0x7f907400ef20 comp rx=0 tx=0).stop 2023-09-30T22:34:12.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.100+0000 7f90871fb700 1 -- 172.21.15.59:0/1441880951 shutdown_connections 2023-09-30T22:34:12.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.100+0000 7f90871fb700 1 --2- 172.21.15.59:0/1441880951 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f908013c1e0 0x7f90801cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:12.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.100+0000 7f90871fb700 1 --2- 172.21.15.59:0/1441880951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f908006a770 0x7f90801cc3e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:12.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.100+0000 7f90871fb700 1 --2- 172.21.15.59:0/1441880951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f908009dc30 0x7f90801cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.100+0000 7f90871fb700 1 -- 172.21.15.59:0/1441880951 >> 172.21.15.59:0/1441880951 conn(0x7f9080066f50 msgr2=0x7f908013b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.100+0000 7f90871fb700 1 -- 172.21.15.59:0/1441880951 shutdown_connections 2023-09-30T22:34:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.100+0000 7f90871fb700 1 -- 172.21.15.59:0/1441880951 wait complete. 2023-09-30T22:34:12.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:12.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.137+0000 7f6aa9d27700 1 -- 172.21.15.59:0/1506783309 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6aa406b250 con 0x7f6aa4133420 2023-09-30T22:34:12.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.137+0000 7f6a8bfff700 1 -- 172.21.15.59:0/1506783309 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a94028030 con 0x7f6aa4133420 2023-09-30T22:34:12.138 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.139+0000 7f6aa9d27700 1 -- 172.21.15.59:0/1506783309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa4133420 msgr2=0x7f6aa40709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.139+0000 7f6aa9d27700 1 --2- 172.21.15.59:0/1506783309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa4133420 0x7f6aa40709a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40a06d0 tx=0x7f6a94004750 comp rx=0 tx=0).stop 2023-09-30T22:34:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.139+0000 7f6aa9d27700 1 -- 172.21.15.59:0/1506783309 shutdown_connections 2023-09-30T22:34:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.139+0000 7f6aa9d27700 1 --2- 172.21.15.59:0/1506783309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa4133420 0x7f6aa40709a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.139+0000 7f6aa9d27700 1 --2- 172.21.15.59:0/1506783309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa4134260 0x7f6aa4071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.139+0000 7f6aa9d27700 1 --2- 172.21.15.59:0/1506783309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4133e30 0x7f6aa4070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.139+0000 7f6aa9d27700 1 -- 172.21.15.59:0/1506783309 >> 172.21.15.59:0/1506783309 conn(0x7f6aa40a4210 msgr2=0x7f6aa4130250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:12.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.140+0000 7f6aa9d27700 1 -- 172.21.15.59:0/1506783309 shutdown_connections 2023-09-30T22:34:12.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:12.140+0000 7f6aa9d27700 1 -- 172.21.15.59:0/1506783309 wait complete. 2023-09-30T22:34:12.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:13.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:13.044 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:13.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:13.155 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:13.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.193+0000 7fc2d9924700 1 Processor -- start 2023-09-30T22:34:13.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.193+0000 7fc2d9924700 1 -- start start 2023-09-30T22:34:13.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.193+0000 7fc2d9924700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d409d6f0 0x7fc2d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.193+0000 7fc2d9924700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2d409e410 0x7fc2d4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.193+0000 7fc2d9924700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d409f130 con 0x7fc2d409e000 2023-09-30T22:34:13.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.193+0000 7fc2d9924700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d409f520 con 0x7fc2d409e410 2023-09-30T22:34:13.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.193+0000 7fc2d9924700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d409e930 con 0x7fc2d409d6f0 2023-09-30T22:34:13.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.194+0000 7fc2d37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2d409e410 0x7fc2d4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.194+0000 7fc2d2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d409d6f0 0x7fc2d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.194+0000 7fc2d37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2d409e410 0x7fc2d4130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36130/0 (socket says 172.21.15.59:36130) 2023-09-30T22:34:13.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.194+0000 7fc2d37fe700 1 -- 172.21.15.59:0/2163922092 learned_addr learned my addr 172.21.15.59:0/2163922092 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:13.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.194+0000 7fc2d2ffd700 1 -- 172.21.15.59:0/2163922092 >> v2:172.21.15.59:3300/0 conn(0x7fc2d409e410 msgr2=0x7fc2d4130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:13.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.194+0000 7fc2d2ffd700 1 --2- 172.21.15.59:0/2163922092 >> v2:172.21.15.59:3300/0 conn(0x7fc2d409e410 0x7fc2d4130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.194+0000 7fc2d2ffd700 1 -- 172.21.15.59:0/2163922092 >> v1:172.21.15.59:6789/0 conn(0x7fc2d409e000 legacy=0x7fc2d4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.194+0000 7fc2d2ffd700 1 -- 172.21.15.59:0/2163922092 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d409b2d0 con 0x7fc2d409d6f0 2023-09-30T22:34:13.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.194+0000 7fc2d2ffd700 1 --2- 172.21.15.59:0/2163922092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d409d6f0 0x7fc2d409dac0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009840 tx=0x7fc2c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1372477919d07b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:13.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.195+0000 7fc2d1ffb700 1 -- 172.21.15.59:0/2163922092 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8011830 con 0x7fc2d409d6f0 2023-09-30T22:34:13.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.195+0000 7fc2d1ffb700 1 -- 172.21.15.59:0/2163922092 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c8011990 con 0x7fc2d409d6f0 2023-09-30T22:34:13.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.195+0000 7fc2d1ffb700 1 -- 172.21.15.59:0/2163922092 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8011d20 con 0x7fc2d409d6f0 2023-09-30T22:34:13.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.196+0000 7fc2d9924700 1 -- 172.21.15.59:0/2163922092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d409d6f0 msgr2=0x7fc2d409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.196+0000 7fc2d9924700 1 --2- 172.21.15.59:0/2163922092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d409d6f0 0x7fc2d409dac0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009840 tx=0x7fc2c8009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:13.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.196+0000 7fc2d9924700 1 -- 172.21.15.59:0/2163922092 shutdown_connections 2023-09-30T22:34:13.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.196+0000 7fc2d9924700 1 --2- 172.21.15.59:0/2163922092 >> v2:172.21.15.59:3300/0 conn(0x7fc2d409e410 0x7fc2d4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.196+0000 7fc2d9924700 1 --2- 172.21.15.59:0/2163922092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d409d6f0 0x7fc2d409dac0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.196+0000 7fc2d9924700 1 -- 172.21.15.59:0/2163922092 >> 172.21.15.59:0/2163922092 conn(0x7fc2d4066f50 msgr2=0x7fc2d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:13.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.196+0000 7fc2d9924700 1 -- 172.21.15.59:0/2163922092 shutdown_connections 2023-09-30T22:34:13.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.196+0000 7fc2d9924700 1 -- 172.21.15.59:0/2163922092 wait complete. 2023-09-30T22:34:13.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.197+0000 7fc2d9924700 1 Processor -- start 2023-09-30T22:34:13.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.197+0000 7fc2d9924700 1 -- start start 2023-09-30T22:34:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d9924700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d409d6f0 0x7fc2d4131630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d9924700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2d409e000 0x7fc2d4131b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d9924700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d409e410 0x7fc2d41320b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d9924700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d41347c0 con 0x7fc2d409e000 2023-09-30T22:34:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d9924700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d4130f50 con 0x7fc2d409e410 2023-09-30T22:34:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d9924700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d41349a0 con 0x7fc2d409d6f0 2023-09-30T22:34:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d409d6f0 0x7fc2d4131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d409e410 0x7fc2d41320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d409e410 0x7fc2d41320b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58820/0 (socket says 172.21.15.59:58820) 2023-09-30T22:34:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d409d6f0 0x7fc2d4131630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41686/0 (socket says 172.21.15.59:41686) 2023-09-30T22:34:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d37fe700 1 -- 172.21.15.59:0/2140994820 learned_addr learned my addr 172.21.15.59:0/2140994820 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d27fc700 1 --2- 172.21.15.59:0/2140994820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2d409e000 0x7fc2d4131b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d2ffd700 1 -- 172.21.15.59:0/2140994820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d409e410 msgr2=0x7fc2d41320b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d2ffd700 1 --2- 172.21.15.59:0/2140994820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d409e410 0x7fc2d41320b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d2ffd700 1 -- 172.21.15.59:0/2140994820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2d409e000 msgr2=0x7fc2d4131b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d2ffd700 1 --2- 172.21.15.59:0/2140994820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2d409e000 0x7fc2d4131b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.198+0000 7fc2d2ffd700 1 -- 172.21.15.59:0/2140994820 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c80094a0 con 0x7fc2d409d6f0 2023-09-30T22:34:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.199+0000 7fc2d2ffd700 1 --2- 172.21.15.59:0/2140994820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d409d6f0 0x7fc2d4131630 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009840 tx=0x7fc2c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.199+0000 7fc2bbfff700 1 -- 172.21.15.59:0/2140994820 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80036a0 con 0x7fc2d409d6f0 2023-09-30T22:34:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.199+0000 7fc2bbfff700 1 -- 172.21.15.59:0/2140994820 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c801f070 con 0x7fc2d409d6f0 2023-09-30T22:34:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.199+0000 7fc2d9924700 1 -- 172.21.15.59:0/2140994820 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d4132b30 con 0x7fc2d409d6f0 2023-09-30T22:34:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.199+0000 7fc2bbfff700 1 -- 172.21.15.59:0/2140994820 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8003a40 con 0x7fc2d409d6f0 2023-09-30T22:34:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.199+0000 7fc2d9924700 1 -- 172.21.15.59:0/2140994820 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d41331e0 con 0x7fc2d409d6f0 2023-09-30T22:34:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.200+0000 7fc2bbfff700 1 -- 172.21.15.59:0/2140994820 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2c8003ba0 con 0x7fc2d409d6f0 2023-09-30T22:34:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.200+0000 7fc2bbfff700 1 -- 172.21.15.59:0/2140994820 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc2c8021070 con 0x7fc2d409d6f0 2023-09-30T22:34:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.200+0000 7fc2d9924700 1 -- 172.21.15.59:0/2140994820 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d4074ea0 con 0x7fc2d409d6f0 2023-09-30T22:34:13.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.205+0000 7fc2bbfff700 1 -- 172.21.15.59:0/2140994820 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2c8015070 con 0x7fc2d409d6f0 2023-09-30T22:34:13.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.209+0000 7f58f4a8c700 1 Processor -- start 2023-09-30T22:34:13.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.210+0000 7f58f4a8c700 1 -- start start 2023-09-30T22:34:13.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.211+0000 7f58f4a8c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58f009d6f0 0x7f58f009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.211+0000 7f58f4a8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f009e440 0x7f58f0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.211+0000 7f58f4a8c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f009b120 con 0x7f58f009e000 2023-09-30T22:34:13.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.211+0000 7f58f4a8c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f006b460 con 0x7f58f009d6f0 2023-09-30T22:34:13.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.211+0000 7f58f4a8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f009a7e0 con 0x7f58f009e440 2023-09-30T22:34:13.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.211+0000 7f58edd9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f58f009e000 0x7f58f01339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46492/0 (socket says 172.21.15.59:46492) 2023-09-30T22:34:13.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.211+0000 7f58edd9b700 1 -- 172.21.15.59:0/2813384675 learned_addr learned my addr 172.21.15.59:0/2813384675 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:13.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.211+0000 7f58eed9d700 1 --2- 172.21.15.59:0/2813384675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f009e440 0x7f58f0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.211+0000 7f58ee59c700 1 --2- 172.21.15.59:0/2813384675 >> v2:172.21.15.59:3300/0 conn(0x7f58f009d6f0 0x7f58f009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.211+0000 7f58ed59a700 1 -- 172.21.15.59:0/2813384675 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625568025 0 0) 0x7f58f009b120 con 0x7f58f009e000 2023-09-30T22:34:13.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.211+0000 7f58ed59a700 1 -- 172.21.15.59:0/2813384675 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58d80035b0 con 0x7f58f009e000 2023-09-30T22:34:13.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.211+0000 7f58eed9d700 1 -- 172.21.15.59:0/2813384675 >> v2:172.21.15.59:3300/0 conn(0x7f58f009d6f0 msgr2=0x7f58f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:13.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.212+0000 7f58eed9d700 1 --2- 172.21.15.59:0/2813384675 >> v2:172.21.15.59:3300/0 conn(0x7f58f009d6f0 0x7f58f009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.212+0000 7f58eed9d700 1 -- 172.21.15.59:0/2813384675 >> v1:172.21.15.59:6789/0 conn(0x7f58f009e000 legacy=0x7f58f01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.212+0000 7f58eed9d700 1 -- 172.21.15.59:0/2813384675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f009a500 con 0x7f58f009e440 2023-09-30T22:34:13.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.212+0000 7f58eed9d700 1 --2- 172.21.15.59:0/2813384675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f009e440 0x7f58f0134100 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009dc0 tx=0x7f58e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0bc35eb86026ec3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:13.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.212+0000 7f58ed59a700 1 -- 172.21.15.59:0/2813384675 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e800e070 con 0x7f58f009e440 2023-09-30T22:34:13.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.212+0000 7f58ed59a700 1 -- 172.21.15.59:0/2813384675 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e800bae0 con 0x7f58f009e440 2023-09-30T22:34:13.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.212+0000 7f58ed59a700 1 -- 172.21.15.59:0/2813384675 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e800be90 con 0x7f58f009e440 2023-09-30T22:34:13.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.213+0000 7f58f4a8c700 1 -- 172.21.15.59:0/2813384675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f009e440 msgr2=0x7f58f0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.213+0000 7f58f4a8c700 1 --2- 172.21.15.59:0/2813384675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f009e440 0x7f58f0134100 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009dc0 tx=0x7f58e800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:13.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.213+0000 7f58f4a8c700 1 -- 172.21.15.59:0/2813384675 shutdown_connections 2023-09-30T22:34:13.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.213+0000 7f58f4a8c700 1 --2- 172.21.15.59:0/2813384675 >> v2:172.21.15.59:3300/0 conn(0x7f58f009d6f0 0x7f58f009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.213+0000 7f58f4a8c700 1 --2- 172.21.15.59:0/2813384675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f009e440 0x7f58f0134100 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.213+0000 7f58f4a8c700 1 -- 172.21.15.59:0/2813384675 >> 172.21.15.59:0/2813384675 conn(0x7f58f0066f50 msgr2=0x7f58f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.213+0000 7f58f4a8c700 1 -- 172.21.15.59:0/2813384675 shutdown_connections 2023-09-30T22:34:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.214+0000 7f58f4a8c700 1 -- 172.21.15.59:0/2813384675 wait complete. 2023-09-30T22:34:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.215+0000 7f58f4a8c700 1 Processor -- start 2023-09-30T22:34:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.215+0000 7f58f4a8c700 1 -- start start 2023-09-30T22:34:13.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.216+0000 7f58f4a8c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f009d6f0 0x7f58f01c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.216+0000 7f58f4a8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f009e000 0x7f58f01c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.216+0000 7f58f4a8c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58f009e440 0x7f58f01c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.216+0000 7f58f4a8c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f01a7ca0 con 0x7f58f009d6f0 2023-09-30T22:34:13.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.216+0000 7f58f4a8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f009c710 con 0x7f58f009e000 2023-09-30T22:34:13.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.216+0000 7f58f4a8c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58f01a68f0 con 0x7f58f009e440 2023-09-30T22:34:13.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.216+0000 7f58eed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58f009e440 0x7f58f01c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.216+0000 7f58eed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58f009e440 0x7f58f01c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41690/0 (socket says 172.21.15.59:41690) 2023-09-30T22:34:13.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.216+0000 7f58eed9d700 1 -- 172.21.15.59:0/2745153937 learned_addr learned my addr 172.21.15.59:0/2745153937 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:13.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.216+0000 7f58edd9b700 1 --2- 172.21.15.59:0/2745153937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f009e000 0x7f58f01c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.217+0000 7f58ee59c700 1 --2- 172.21.15.59:0/2745153937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f009d6f0 0x7f58f01c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.217+0000 7f58eed9d700 1 -- 172.21.15.59:0/2745153937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f009e000 msgr2=0x7f58f01c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.217+0000 7f58eed9d700 1 --2- 172.21.15.59:0/2745153937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f009e000 0x7f58f01c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.217+0000 7f58eed9d700 1 -- 172.21.15.59:0/2745153937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f009d6f0 msgr2=0x7f58f01c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.217+0000 7f58eed9d700 1 --2- 172.21.15.59:0/2745153937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f009d6f0 0x7f58f01c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.217+0000 7f58eed9d700 1 -- 172.21.15.59:0/2745153937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e8009a70 con 0x7f58f009e440 2023-09-30T22:34:13.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.217+0000 7f58edd9b700 1 --2- 172.21.15.59:0/2745153937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f009e000 0x7f58f01c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:13.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.217+0000 7f58eed9d700 1 --2- 172.21.15.59:0/2745153937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58f009e440 0x7f58f01c8a30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f58e800b370 tx=0x7f58e8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:13.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.217+0000 7f58deffd700 1 -- 172.21.15.59:0/2745153937 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e80048e0 con 0x7f58f009e440 2023-09-30T22:34:13.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.217+0000 7f58deffd700 1 -- 172.21.15.59:0/2745153937 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e8020070 con 0x7f58f009e440 2023-09-30T22:34:13.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.217+0000 7f58f4a8c700 1 -- 172.21.15.59:0/2745153937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f01a64b0 con 0x7f58f009e440 2023-09-30T22:34:13.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.217+0000 7f58deffd700 1 -- 172.21.15.59:0/2745153937 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e80276c0 con 0x7f58f009e440 2023-09-30T22:34:13.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.217+0000 7f58f4a8c700 1 -- 172.21.15.59:0/2745153937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f01a89b0 con 0x7f58f009e440 2023-09-30T22:34:13.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.219+0000 7f58f4a8c700 1 -- 172.21.15.59:0/2745153937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f0074ea0 con 0x7f58f009e440 2023-09-30T22:34:13.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.220+0000 7f58deffd700 1 -- 172.21.15.59:0/2745153937 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f58e8031430 con 0x7f58f009e440 2023-09-30T22:34:13.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.220+0000 7f58deffd700 1 -- 172.21.15.59:0/2745153937 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f58e8022070 con 0x7f58f009e440 2023-09-30T22:34:13.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.228+0000 7f58deffd700 1 -- 172.21.15.59:0/2745153937 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58e8003e10 con 0x7f58f009e440 2023-09-30T22:34:13.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.289+0000 7fbe7c831700 1 Processor -- start 2023-09-30T22:34:13.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.289+0000 7fbe7c831700 1 -- start start 2023-09-30T22:34:13.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.289+0000 7fbe7c831700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe78130540 0x7fbe78130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.290+0000 7fbe7c831700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe78130e50 0x7fbe7806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.290+0000 7fbe7c831700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe780716a0 con 0x7fbe7806fb20 2023-09-30T22:34:13.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.290+0000 7fbe7c831700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7809a390 con 0x7fbe78130e50 2023-09-30T22:34:13.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.290+0000 7fbe7c831700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe78071290 con 0x7fbe78130540 2023-09-30T22:34:13.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.290+0000 7fbe7659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe78130540 0x7fbe78130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.290+0000 7fbe7659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe78130540 0x7fbe78130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58838/0 (socket says 172.21.15.59:58838) 2023-09-30T22:34:13.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.290+0000 7fbe7659c700 1 -- 172.21.15.59:0/917718935 learned_addr learned my addr 172.21.15.59:0/917718935 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:13.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.290+0000 7fbe75d9b700 1 --2- 172.21.15.59:0/917718935 >> v2:172.21.15.59:3300/0 conn(0x7fbe78130e50 0x7fbe7806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.290+0000 7fbe7659c700 1 -- 172.21.15.59:0/917718935 >> v2:172.21.15.59:3300/0 conn(0x7fbe78130e50 msgr2=0x7fbe7806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:13.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.290+0000 7fbe7659c700 1 --2- 172.21.15.59:0/917718935 >> v2:172.21.15.59:3300/0 conn(0x7fbe78130e50 0x7fbe7806f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.290+0000 7fbe7659c700 1 -- 172.21.15.59:0/917718935 >> v1:172.21.15.59:6789/0 conn(0x7fbe7806fb20 legacy=0x7fbe78137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:13.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.290+0000 7fbe7659c700 1 -- 172.21.15.59:0/917718935 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe78130340 con 0x7fbe78130540 2023-09-30T22:34:13.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.290+0000 7fbe7659c700 1 --2- 172.21.15.59:0/917718935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe78130540 0x7fbe78130910 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009920 tx=0x7fbe68009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d5d690789bff4e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:13.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.291+0000 7fbe7559a700 1 -- 172.21.15.59:0/917718935 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68004230 con 0x7fbe78130540 2023-09-30T22:34:13.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.291+0000 7fbe7559a700 1 -- 172.21.15.59:0/917718935 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe68004390 con 0x7fbe78130540 2023-09-30T22:34:13.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.291+0000 7fbe7559a700 1 -- 172.21.15.59:0/917718935 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe680036a0 con 0x7fbe78130540 2023-09-30T22:34:13.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.292+0000 7fbe7c831700 1 -- 172.21.15.59:0/917718935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe78130540 msgr2=0x7fbe78130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.292+0000 7fbe7c831700 1 --2- 172.21.15.59:0/917718935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe78130540 0x7fbe78130910 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009920 tx=0x7fbe68009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:13.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.292+0000 7fbe7c831700 1 -- 172.21.15.59:0/917718935 shutdown_connections 2023-09-30T22:34:13.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.292+0000 7fbe7c831700 1 --2- 172.21.15.59:0/917718935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe78130540 0x7fbe78130910 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.292+0000 7fbe7c831700 1 --2- 172.21.15.59:0/917718935 >> v2:172.21.15.59:3300/0 conn(0x7fbe78130e50 0x7fbe7806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.292+0000 7fbe7c831700 1 -- 172.21.15.59:0/917718935 >> 172.21.15.59:0/917718935 conn(0x7fbe780a2aa0 msgr2=0x7fbe780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:13.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.292+0000 7fbe7c831700 1 -- 172.21.15.59:0/917718935 shutdown_connections 2023-09-30T22:34:13.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.292+0000 7fbe7c831700 1 -- 172.21.15.59:0/917718935 wait complete. 2023-09-30T22:34:13.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.294+0000 7fbe7c831700 1 Processor -- start 2023-09-30T22:34:13.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.294+0000 7fbe7c831700 1 -- start start 2023-09-30T22:34:13.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.294+0000 7fbe7c831700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7806fb20 0x7fbe7812abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe7c831700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe78130540 0x7fbe7812b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe7c831700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe78130e50 0x7fbe781c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe7c831700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7812c690 con 0x7fbe78130e50 2023-09-30T22:34:13.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe7c831700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7812a820 con 0x7fbe7806fb20 2023-09-30T22:34:13.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe7c831700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7812b660 con 0x7fbe78130540 2023-09-30T22:34:13.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe7659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7806fb20 0x7fbe7812abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe7659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7806fb20 0x7fbe7812abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58840/0 (socket says 172.21.15.59:58840) 2023-09-30T22:34:13.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe7659c700 1 -- 172.21.15.59:0/2788167774 learned_addr learned my addr 172.21.15.59:0/2788167774 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:13.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe76d9d700 1 --2- 172.21.15.59:0/2788167774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe78130e50 0x7fbe781c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe75d9b700 1 --2- 172.21.15.59:0/2788167774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe78130540 0x7fbe7812b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe7659c700 1 -- 172.21.15.59:0/2788167774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe78130540 msgr2=0x7fbe7812b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe7659c700 1 --2- 172.21.15.59:0/2788167774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe78130540 0x7fbe7812b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe7659c700 1 -- 172.21.15.59:0/2788167774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe78130e50 msgr2=0x7fbe781c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe7659c700 1 --2- 172.21.15.59:0/2788167774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe78130e50 0x7fbe781c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe7659c700 1 -- 172.21.15.59:0/2788167774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe68009550 con 0x7fbe7806fb20 2023-09-30T22:34:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe76d9d700 1 --2- 172.21.15.59:0/2788167774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe78130e50 0x7fbe781c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:34:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe75d9b700 1 --2- 172.21.15.59:0/2788167774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe78130540 0x7fbe7812b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.295+0000 7fbe7659c700 1 --2- 172.21.15.59:0/2788167774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7806fb20 0x7fbe7812abe0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbe780713d0 tx=0x7fbe68004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.296+0000 7fbe66ffd700 1 -- 172.21.15.59:0/2788167774 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68011630 con 0x7fbe7806fb20 2023-09-30T22:34:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.296+0000 7fbe66ffd700 1 -- 172.21.15.59:0/2788167774 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe68011790 con 0x7fbe7806fb20 2023-09-30T22:34:13.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.296+0000 7fbe7c831700 1 -- 172.21.15.59:0/2788167774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe780a05f0 con 0x7fbe7806fb20 2023-09-30T22:34:13.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.296+0000 7fbe66ffd700 1 -- 172.21.15.59:0/2788167774 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68011b40 con 0x7fbe7806fb20 2023-09-30T22:34:13.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.296+0000 7fbe7c831700 1 -- 172.21.15.59:0/2788167774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe78131740 con 0x7fbe7806fb20 2023-09-30T22:34:13.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.297+0000 7fbe66ffd700 1 -- 172.21.15.59:0/2788167774 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe68021070 con 0x7fbe7806fb20 2023-09-30T22:34:13.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.297+0000 7fbe7c831700 1 -- 172.21.15.59:0/2788167774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7812da80 con 0x7fbe7806fb20 2023-09-30T22:34:13.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.297+0000 7fbe66ffd700 1 -- 172.21.15.59:0/2788167774 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbe680410f0 con 0x7fbe7806fb20 2023-09-30T22:34:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.306+0000 7fbe66ffd700 1 -- 172.21.15.59:0/2788167774 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe6800b3e0 con 0x7fbe7806fb20 2023-09-30T22:34:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.307+0000 7f116ffb8700 1 Processor -- start 2023-09-30T22:34:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.308+0000 7f116ffb8700 1 -- start start 2023-09-30T22:34:13.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.308+0000 7f116ffb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f116812cf60 0x7f116806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.309+0000 7f116ffb8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f116812f8b0 0x7f116812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.309+0000 7f116ffb8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f116812cd90 con 0x7f1168130260 2023-09-30T22:34:13.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.309+0000 7f116ffb8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f116812d330 con 0x7f116812f8b0 2023-09-30T22:34:13.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.309+0000 7f116ffb8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11681306e0 con 0x7f116812cf60 2023-09-30T22:34:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.309+0000 7f116dd54700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f116812cf60 0x7f116806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.309+0000 7f116dd54700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f116812cf60 0x7f116806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41702/0 (socket says 172.21.15.59:41702) 2023-09-30T22:34:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.309+0000 7f116dd54700 1 -- 172.21.15.59:0/2509270946 learned_addr learned my addr 172.21.15.59:0/2509270946 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.309+0000 7f116d553700 1 --2- 172.21.15.59:0/2509270946 >> v2:172.21.15.59:3300/0 conn(0x7f116812f8b0 0x7f116812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.309+0000 7f116dd54700 1 -- 172.21.15.59:0/2509270946 >> v2:172.21.15.59:3300/0 conn(0x7f116812f8b0 msgr2=0x7f116812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.309+0000 7f116dd54700 1 --2- 172.21.15.59:0/2509270946 >> v2:172.21.15.59:3300/0 conn(0x7f116812f8b0 0x7f116812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.309+0000 7f116dd54700 1 -- 172.21.15.59:0/2509270946 >> v1:172.21.15.59:6789/0 conn(0x7f1168130260 legacy=0x7f1168136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.309+0000 7f116dd54700 1 -- 172.21.15.59:0/2509270946 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1168071780 con 0x7f116812cf60 2023-09-30T22:34:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.309+0000 7f116dd54700 1 --2- 172.21.15.59:0/2509270946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f116812cf60 0x7f116806f5d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f116400de50 tx=0x7f116400f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=718a267d03a2d3d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.310+0000 7f116cd52700 1 -- 172.21.15.59:0/2509270946 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164012070 con 0x7f116812cf60 2023-09-30T22:34:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.310+0000 7f116cd52700 1 -- 172.21.15.59:0/2509270946 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116400f910 con 0x7f116812cf60 2023-09-30T22:34:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.310+0000 7f116cd52700 1 -- 172.21.15.59:0/2509270946 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116400fcc0 con 0x7f116812cf60 2023-09-30T22:34:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.311+0000 7f116ffb8700 1 -- 172.21.15.59:0/2509270946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f116812cf60 msgr2=0x7f116806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.311+0000 7f116ffb8700 1 --2- 172.21.15.59:0/2509270946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f116812cf60 0x7f116806f5d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f116400de50 tx=0x7f116400f330 comp rx=0 tx=0).stop 2023-09-30T22:34:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.311+0000 7f116ffb8700 1 -- 172.21.15.59:0/2509270946 shutdown_connections 2023-09-30T22:34:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.311+0000 7f116ffb8700 1 --2- 172.21.15.59:0/2509270946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f116812cf60 0x7f116806f5d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.311+0000 7f116ffb8700 1 --2- 172.21.15.59:0/2509270946 >> v2:172.21.15.59:3300/0 conn(0x7f116812f8b0 0x7f116812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.311+0000 7f116ffb8700 1 -- 172.21.15.59:0/2509270946 >> 172.21.15.59:0/2509270946 conn(0x7f11680a2aa0 msgr2=0x7f11680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:13.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.311+0000 7f116ffb8700 1 -- 172.21.15.59:0/2509270946 shutdown_connections 2023-09-30T22:34:13.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.311+0000 7f116ffb8700 1 -- 172.21.15.59:0/2509270946 wait complete. 2023-09-30T22:34:13.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.312+0000 7f116ffb8700 1 Processor -- start 2023-09-30T22:34:13.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.312+0000 7f116ffb8700 1 -- start start 2023-09-30T22:34:13.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.313+0000 7f116ffb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f116812cf60 0x7f11681214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.313+0000 7f116ffb8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f116812f8b0 0x7f1168121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.313+0000 7f116ffb8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1168130260 0x7f1168121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:13.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.313+0000 7f116ffb8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1168123e90 con 0x7f1168130260 2023-09-30T22:34:13.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.313+0000 7f116ffb8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116812f680 con 0x7f116812f8b0 2023-09-30T22:34:13.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.313+0000 7f116ffb8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f116809e9a0 con 0x7f116812cf60 2023-09-30T22:34:13.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.313+0000 7f116d553700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f116812f8b0 0x7f1168121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.313+0000 7f116d553700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f116812f8b0 0x7f1168121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58854/0 (socket says 172.21.15.59:58854) 2023-09-30T22:34:13.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.313+0000 7f116d553700 1 -- 172.21.15.59:0/152283655 learned_addr learned my addr 172.21.15.59:0/152283655 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:13.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.313+0000 7f116e555700 1 --2- 172.21.15.59:0/152283655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1168130260 0x7f1168121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.313+0000 7f116dd54700 1 --2- 172.21.15.59:0/152283655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f116812cf60 0x7f11681214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:13.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.314+0000 7f116d553700 1 -- 172.21.15.59:0/152283655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f116812cf60 msgr2=0x7f11681214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.314+0000 7f116d553700 1 --2- 172.21.15.59:0/152283655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f116812cf60 0x7f11681214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.314+0000 7f116d553700 1 -- 172.21.15.59:0/152283655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1168130260 msgr2=0x7f1168121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.314+0000 7f116d553700 1 --2- 172.21.15.59:0/152283655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1168130260 0x7f1168121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.314+0000 7f116d553700 1 -- 172.21.15.59:0/152283655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116400db30 con 0x7f116812f8b0 2023-09-30T22:34:13.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.314+0000 7f116dd54700 1 --2- 172.21.15.59:0/152283655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f116812cf60 0x7f11681214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:13.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.314+0000 7f116d553700 1 --2- 172.21.15.59:0/152283655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f116812f8b0 0x7f1168121a20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f115800e980 tx=0x7f115800ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:13.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.314+0000 7f115e7fc700 1 -- 172.21.15.59:0/152283655 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158009710 con 0x7f116812f8b0 2023-09-30T22:34:13.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.314+0000 7f115e7fc700 1 -- 172.21.15.59:0/152283655 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115800eed0 con 0x7f116812f8b0 2023-09-30T22:34:13.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.314+0000 7f115e7fc700 1 -- 172.21.15.59:0/152283655 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115800ca70 con 0x7f116812f8b0 2023-09-30T22:34:13.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.314+0000 7f116ffb8700 1 -- 172.21.15.59:0/152283655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1168129240 con 0x7f116812f8b0 2023-09-30T22:34:13.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.314+0000 7f116ffb8700 1 -- 172.21.15.59:0/152283655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f116809dec0 con 0x7f116812f8b0 2023-09-30T22:34:13.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.316+0000 7f116ffb8700 1 -- 172.21.15.59:0/152283655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1168074ea0 con 0x7f116812f8b0 2023-09-30T22:34:13.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.317+0000 7f115e7fc700 1 -- 172.21.15.59:0/152283655 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f115800cbd0 con 0x7f116812f8b0 2023-09-30T22:34:13.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.317+0000 7f115e7fc700 1 -- 172.21.15.59:0/152283655 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f115803f780 con 0x7f116812f8b0 2023-09-30T22:34:13.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.326+0000 7f115e7fc700 1 -- 172.21.15.59:0/152283655 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f115801bc50 con 0x7f116812f8b0 2023-09-30T22:34:13.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.433+0000 7fc2d9924700 1 -- 172.21.15.59:0/2140994820 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc2d406c360 con 0x7fc2d409d6f0 2023-09-30T22:34:13.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.433+0000 7fc2bbfff700 1 -- 172.21.15.59:0/2140994820 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2c8019ba0 con 0x7fc2d409d6f0 2023-09-30T22:34:13.434 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:13.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.435+0000 7fc2d9924700 1 -- 172.21.15.59:0/2140994820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d409d6f0 msgr2=0x7fc2d4131630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.435+0000 7fc2d9924700 1 --2- 172.21.15.59:0/2140994820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d409d6f0 0x7fc2d4131630 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009840 tx=0x7fc2c8004750 comp rx=0 tx=0).stop 2023-09-30T22:34:13.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.435+0000 7fc2d9924700 1 -- 172.21.15.59:0/2140994820 shutdown_connections 2023-09-30T22:34:13.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.435+0000 7fc2d9924700 1 --2- 172.21.15.59:0/2140994820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d409d6f0 0x7fc2d4131630 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.435+0000 7fc2d9924700 1 --2- 172.21.15.59:0/2140994820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d409e410 0x7fc2d41320b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.435+0000 7fc2d9924700 1 --2- 172.21.15.59:0/2140994820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2d409e000 0x7fc2d4131b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.435+0000 7fc2d9924700 1 -- 172.21.15.59:0/2140994820 >> 172.21.15.59:0/2140994820 conn(0x7fc2d4066f50 msgr2=0x7fc2d40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:13.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.435+0000 7fc2d9924700 1 -- 172.21.15.59:0/2140994820 shutdown_connections 2023-09-30T22:34:13.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.436+0000 7fc2d9924700 1 -- 172.21.15.59:0/2140994820 wait complete. 2023-09-30T22:34:13.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.517+0000 7fbe7c831700 1 -- 172.21.15.59:0/2788167774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbe78074ea0 con 0x7fbe7806fb20 2023-09-30T22:34:13.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.518+0000 7fbe66ffd700 1 -- 172.21.15.59:0/2788167774 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe68029020 con 0x7fbe7806fb20 2023-09-30T22:34:13.519 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:13.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.520+0000 7fbe7c831700 1 -- 172.21.15.59:0/2788167774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7806fb20 msgr2=0x7fbe7812abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.520+0000 7fbe7c831700 1 --2- 172.21.15.59:0/2788167774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7806fb20 0x7fbe7812abe0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbe780713d0 tx=0x7fbe68004750 comp rx=0 tx=0).stop 2023-09-30T22:34:13.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.520+0000 7fbe7c831700 1 -- 172.21.15.59:0/2788167774 shutdown_connections 2023-09-30T22:34:13.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.520+0000 7fbe7c831700 1 --2- 172.21.15.59:0/2788167774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe78130e50 0x7fbe781c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.520+0000 7fbe7c831700 1 --2- 172.21.15.59:0/2788167774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7806fb20 0x7fbe7812abe0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.520+0000 7fbe7c831700 1 --2- 172.21.15.59:0/2788167774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe78130540 0x7fbe7812b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.520+0000 7fbe7c831700 1 -- 172.21.15.59:0/2788167774 >> 172.21.15.59:0/2788167774 conn(0x7fbe780a2aa0 msgr2=0x7fbe7806e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:13.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.520+0000 7fbe7c831700 1 -- 172.21.15.59:0/2788167774 shutdown_connections 2023-09-30T22:34:13.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.520+0000 7fbe7c831700 1 -- 172.21.15.59:0/2788167774 wait complete. 2023-09-30T22:34:13.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:13.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.534+0000 7f58f4a8c700 1 -- 172.21.15.59:0/2745153937 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f58f009f420 con 0x7f58f009e440 2023-09-30T22:34:13.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.534+0000 7f58deffd700 1 -- 172.21.15.59:0/2745153937 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58e802c020 con 0x7f58f009e440 2023-09-30T22:34:13.535 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:13.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.538+0000 7f58f4a8c700 1 -- 172.21.15.59:0/2745153937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58f009e440 msgr2=0x7f58f01c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.538+0000 7f58f4a8c700 1 --2- 172.21.15.59:0/2745153937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58f009e440 0x7f58f01c8a30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f58e800b370 tx=0x7f58e8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.538+0000 7f58f4a8c700 1 -- 172.21.15.59:0/2745153937 shutdown_connections 2023-09-30T22:34:13.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.538+0000 7f58f4a8c700 1 --2- 172.21.15.59:0/2745153937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58f009e440 0x7f58f01c8a30 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.538+0000 7f58f4a8c700 1 --2- 172.21.15.59:0/2745153937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f009d6f0 0x7f58f01c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.538+0000 7f58f4a8c700 1 --2- 172.21.15.59:0/2745153937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f009e000 0x7f58f01c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.538+0000 7f58f4a8c700 1 -- 172.21.15.59:0/2745153937 >> 172.21.15.59:0/2745153937 conn(0x7f58f0066f50 msgr2=0x7f58f01bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:13.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.538+0000 7f58f4a8c700 1 -- 172.21.15.59:0/2745153937 shutdown_connections 2023-09-30T22:34:13.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.538+0000 7f58f4a8c700 1 -- 172.21.15.59:0/2745153937 wait complete. 2023-09-30T22:34:13.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:13.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.609+0000 7f116ffb8700 1 -- 172.21.15.59:0/152283655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1168129fa0 con 0x7f116812f8b0 2023-09-30T22:34:13.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.609+0000 7f115e7fc700 1 -- 172.21.15.59:0/152283655 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1158017070 con 0x7f116812f8b0 2023-09-30T22:34:13.611 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.612+0000 7f116ffb8700 1 -- 172.21.15.59:0/152283655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f116812f8b0 msgr2=0x7f1168121a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.612+0000 7f116ffb8700 1 --2- 172.21.15.59:0/152283655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f116812f8b0 0x7f1168121a20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f115800e980 tx=0x7f115800ec90 comp rx=0 tx=0).stop 2023-09-30T22:34:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.612+0000 7f116ffb8700 1 -- 172.21.15.59:0/152283655 shutdown_connections 2023-09-30T22:34:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.612+0000 7f116ffb8700 1 --2- 172.21.15.59:0/152283655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f116812cf60 0x7f11681214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.612+0000 7f116ffb8700 1 --2- 172.21.15.59:0/152283655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1168130260 0x7f1168121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.612+0000 7f116ffb8700 1 --2- 172.21.15.59:0/152283655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f116812f8b0 0x7f1168121a20 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:13.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.612+0000 7f116ffb8700 1 -- 172.21.15.59:0/152283655 >> 172.21.15.59:0/152283655 conn(0x7f11680a2aa0 msgr2=0x7f116806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:13.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.612+0000 7f116ffb8700 1 -- 172.21.15.59:0/152283655 shutdown_connections 2023-09-30T22:34:13.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:13.612+0000 7f116ffb8700 1 -- 172.21.15.59:0/152283655 wait complete. 2023-09-30T22:34:13.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:14.451 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:14.536 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:14.558 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:14.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.599+0000 7f2fd67f4700 1 Processor -- start 2023-09-30T22:34:14.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.599+0000 7f2fd67f4700 1 -- start start 2023-09-30T22:34:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fd67f4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2fd009e930 0x7f2fd009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fd67f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f240 0x7f2fd01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fd67f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009f650 0x7f2fd0131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fd67f4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd0070940 con 0x7f2fd009e930 2023-09-30T22:34:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fd67f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd006fd60 con 0x7f2fd009f650 2023-09-30T22:34:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fd67f4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd006fa80 con 0x7f2fd009f240 2023-09-30T22:34:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fcf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f240 0x7f2fd01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fcffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2fd009e930 0x7f2fd009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fcffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2fd009e930 0x7f2fd009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56512/0 (socket says 172.21.15.59:56512) 2023-09-30T22:34:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fcf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f240 0x7f2fd01317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40400/0 (socket says 172.21.15.59:40400) 2023-09-30T22:34:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fcffff700 1 -- 172.21.15.59:0/4072346988 learned_addr learned my addr 172.21.15.59:0/4072346988 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fd4d91700 1 --2- 172.21.15.59:0/4072346988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009f650 0x7f2fd0131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fcf7fe700 1 -- 172.21.15.59:0/4072346988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009f650 msgr2=0x7f2fd0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fcf7fe700 1 --2- 172.21.15.59:0/4072346988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009f650 0x7f2fd0131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fcf7fe700 1 -- 172.21.15.59:0/4072346988 >> v2:172.21.15.59:3300/0 conn(0x7f2fd009e930 msgr2=0x7f2fd009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fcf7fe700 1 --2- 172.21.15.59:0/4072346988 >> v2:172.21.15.59:3300/0 conn(0x7f2fd009e930 0x7f2fd009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fcf7fe700 1 -- 172.21.15.59:0/4072346988 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd009fb60 con 0x7f2fd009f240 2023-09-30T22:34:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fcffff700 1 --2- 172.21.15.59:0/4072346988 >> v2:172.21.15.59:3300/0 conn(0x7f2fd009e930 0x7f2fd009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fd4d91700 1 --2- 172.21.15.59:0/4072346988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009f650 0x7f2fd0131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:34:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.600+0000 7f2fcf7fe700 1 --2- 172.21.15.59:0/4072346988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f240 0x7f2fd01317f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009840 tx=0x7f2fc4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5958921a2692358 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.601+0000 7f2fceffd700 1 -- 172.21.15.59:0/4072346988 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4011830 con 0x7f2fd009f240 2023-09-30T22:34:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.601+0000 7f2fceffd700 1 -- 172.21.15.59:0/4072346988 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc4011990 con 0x7f2fd009f240 2023-09-30T22:34:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.601+0000 7f2fceffd700 1 -- 172.21.15.59:0/4072346988 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4011d20 con 0x7f2fd009f240 2023-09-30T22:34:14.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.601+0000 7f2fd67f4700 1 -- 172.21.15.59:0/4072346988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f240 msgr2=0x7f2fd01317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.601+0000 7f2fd67f4700 1 --2- 172.21.15.59:0/4072346988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f240 0x7f2fd01317f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009840 tx=0x7f2fc4009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:14.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.601+0000 7f2fd67f4700 1 -- 172.21.15.59:0/4072346988 shutdown_connections 2023-09-30T22:34:14.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.601+0000 7f2fd67f4700 1 --2- 172.21.15.59:0/4072346988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009f650 0x7f2fd0131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.601+0000 7f2fd67f4700 1 --2- 172.21.15.59:0/4072346988 >> v2:172.21.15.59:3300/0 conn(0x7f2fd009e930 0x7f2fd009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.601+0000 7f2fd67f4700 1 --2- 172.21.15.59:0/4072346988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f240 0x7f2fd01317f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.601+0000 7f2fd67f4700 1 -- 172.21.15.59:0/4072346988 >> 172.21.15.59:0/4072346988 conn(0x7f2fd00a4210 msgr2=0x7f2fd00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:14.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.602+0000 7f2fd67f4700 1 -- 172.21.15.59:0/4072346988 shutdown_connections 2023-09-30T22:34:14.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.602+0000 7f2fd67f4700 1 -- 172.21.15.59:0/4072346988 wait complete. 2023-09-30T22:34:14.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.603+0000 7f2fd67f4700 1 Processor -- start 2023-09-30T22:34:14.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.603+0000 7f2fd67f4700 1 -- start start 2023-09-30T22:34:14.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.604+0000 7f2fd67f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009e930 0x7f2fd006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.604+0000 7f2fd67f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f240 0x7f2fd006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.604+0000 7f2fd67f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd009f650 0x7f2fd006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.604+0000 7f2fd67f4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01a99b0 con 0x7f2fd009f650 2023-09-30T22:34:14.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.604+0000 7f2fd67f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd00a3550 con 0x7f2fd009e930 2023-09-30T22:34:14.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.604+0000 7f2fd67f4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0071d20 con 0x7f2fd009f240 2023-09-30T22:34:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.604+0000 7f2fcffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009e930 0x7f2fd006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.604+0000 7f2fd4d91700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd009f650 0x7f2fd006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.604+0000 7f2fcffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009e930 0x7f2fd006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57994/0 (socket says 172.21.15.59:57994) 2023-09-30T22:34:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.604+0000 7f2fcffff700 1 -- 172.21.15.59:0/3631173979 learned_addr learned my addr 172.21.15.59:0/3631173979 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.604+0000 7f2fcf7fe700 1 --2- 172.21.15.59:0/3631173979 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f240 0x7f2fd006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.605+0000 7f2fcffff700 1 -- 172.21.15.59:0/3631173979 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f240 msgr2=0x7f2fd006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.605+0000 7f2fcffff700 1 --2- 172.21.15.59:0/3631173979 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f240 0x7f2fd006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.605+0000 7f2fcffff700 1 -- 172.21.15.59:0/3631173979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd009f650 msgr2=0x7f2fd006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.605+0000 7f2fcffff700 1 --2- 172.21.15.59:0/3631173979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd009f650 0x7f2fd006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.605+0000 7f2fcffff700 1 -- 172.21.15.59:0/3631173979 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc0009550 con 0x7f2fd009e930 2023-09-30T22:34:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.605+0000 7f2fcf7fe700 1 --2- 172.21.15.59:0/3631173979 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f240 0x7f2fd006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.605+0000 7f2fd4d91700 1 --2- 172.21.15.59:0/3631173979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd009f650 0x7f2fd006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.605+0000 7f2fcffff700 1 --2- 172.21.15.59:0/3631173979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009e930 0x7f2fd006b8b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000ebb0 tx=0x7f2fc000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.605+0000 7f2fccff9700 1 -- 172.21.15.59:0/3631173979 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0004030 con 0x7f2fd009e930 2023-09-30T22:34:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.605+0000 7f2fccff9700 1 -- 172.21.15.59:0/3631173979 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc0004190 con 0x7f2fd009e930 2023-09-30T22:34:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.605+0000 7f2fccff9700 1 -- 172.21.15.59:0/3631173979 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0004520 con 0x7f2fd009e930 2023-09-30T22:34:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.605+0000 7f2fd67f4700 1 -- 172.21.15.59:0/3631173979 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc40094a0 con 0x7f2fd009e930 2023-09-30T22:34:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.605+0000 7f2fd67f4700 1 -- 172.21.15.59:0/3631173979 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd00a0190 con 0x7f2fd009e930 2023-09-30T22:34:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.606+0000 7f2fccff9700 1 -- 172.21.15.59:0/3631173979 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2fc000c850 con 0x7f2fd009e930 2023-09-30T22:34:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.606+0000 7f2fccff9700 1 -- 172.21.15.59:0/3631173979 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2fc003f5c0 con 0x7f2fd009e930 2023-09-30T22:34:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.606+0000 7f2fd67f4700 1 -- 172.21.15.59:0/3631173979 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd01a0b30 con 0x7f2fd009e930 2023-09-30T22:34:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.612+0000 7f2fccff9700 1 -- 172.21.15.59:0/3631173979 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2fc00036a0 con 0x7f2fd009e930 2023-09-30T22:34:14.628 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:14.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.691+0000 7f78c14d1700 1 Processor -- start 2023-09-30T22:34:14.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.691+0000 7f78c14d1700 1 -- start start 2023-09-30T22:34:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.692+0000 7f78c14d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78bc09d6f0 0x7f78bc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.692+0000 7f78c14d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78bc09e410 0x7f78bc130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.692+0000 7f78c14d1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc09f130 con 0x7f78bc09e000 2023-09-30T22:34:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.692+0000 7f78c14d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc09f520 con 0x7f78bc09d6f0 2023-09-30T22:34:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.692+0000 7f78c14d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc09e930 con 0x7f78bc09e410 2023-09-30T22:34:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.692+0000 7f78baffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78bc09d6f0 0x7f78bc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.692+0000 7f78baffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78bc09d6f0 0x7f78bc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58004/0 (socket says 172.21.15.59:58004) 2023-09-30T22:34:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.692+0000 7f78baffd700 1 -- 172.21.15.59:0/1864168107 learned_addr learned my addr 172.21.15.59:0/1864168107 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:14.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.692+0000 7f78bb7fe700 1 --2- 172.21.15.59:0/1864168107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78bc09e410 0x7f78bc130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.692+0000 7f78baffd700 1 -- 172.21.15.59:0/1864168107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78bc09e410 msgr2=0x7f78bc130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.692+0000 7f78baffd700 1 --2- 172.21.15.59:0/1864168107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78bc09e410 0x7f78bc130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.692+0000 7f78baffd700 1 -- 172.21.15.59:0/1864168107 >> v1:172.21.15.59:6789/0 conn(0x7f78bc09e000 legacy=0x7f78bc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.692+0000 7f78ba7fc700 1 -- 172.21.15.59:0/1864168107 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684322995 0 0) 0x7f78bc09f130 con 0x7f78bc09e000 2023-09-30T22:34:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.692+0000 7f78baffd700 1 -- 172.21.15.59:0/1864168107 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc09b2d0 con 0x7f78bc09d6f0 2023-09-30T22:34:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.693+0000 7f78baffd700 1 --2- 172.21.15.59:0/1864168107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78bc09d6f0 0x7f78bc09dac0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009920 tx=0x7f78ac009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=841cab4ddbf47ff5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.693+0000 7f78ba7fc700 1 -- 172.21.15.59:0/1864168107 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac011830 con 0x7f78bc09d6f0 2023-09-30T22:34:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.693+0000 7f78ba7fc700 1 -- 172.21.15.59:0/1864168107 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac011990 con 0x7f78bc09d6f0 2023-09-30T22:34:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.693+0000 7f78ba7fc700 1 -- 172.21.15.59:0/1864168107 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac011d20 con 0x7f78bc09d6f0 2023-09-30T22:34:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.694+0000 7f78c14d1700 1 -- 172.21.15.59:0/1864168107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78bc09d6f0 msgr2=0x7f78bc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.694+0000 7f78c14d1700 1 --2- 172.21.15.59:0/1864168107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78bc09d6f0 0x7f78bc09dac0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009920 tx=0x7f78ac009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:14.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.694+0000 7f78c14d1700 1 -- 172.21.15.59:0/1864168107 shutdown_connections 2023-09-30T22:34:14.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.694+0000 7f78c14d1700 1 --2- 172.21.15.59:0/1864168107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78bc09e410 0x7f78bc130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.694+0000 7f78c14d1700 1 --2- 172.21.15.59:0/1864168107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78bc09d6f0 0x7f78bc09dac0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.694+0000 7f78c14d1700 1 -- 172.21.15.59:0/1864168107 >> 172.21.15.59:0/1864168107 conn(0x7f78bc066f50 msgr2=0x7f78bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:14.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.694+0000 7f78c14d1700 1 -- 172.21.15.59:0/1864168107 shutdown_connections 2023-09-30T22:34:14.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.694+0000 7f78c14d1700 1 -- 172.21.15.59:0/1864168107 wait complete. 2023-09-30T22:34:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.695+0000 7f78c14d1700 1 Processor -- start 2023-09-30T22:34:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.695+0000 7f78c14d1700 1 -- start start 2023-09-30T22:34:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.696+0000 7f78c14d1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78bc09d6f0 0x7f78bc11e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.696+0000 7f78c14d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78bc09e000 0x7f78bc11e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.696+0000 7f78c14d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78bc09e410 0x7f78bc11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.696+0000 7f78c14d1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc11f520 con 0x7f78bc09d6f0 2023-09-30T22:34:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.696+0000 7f78c14d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc121b70 con 0x7f78bc09e000 2023-09-30T22:34:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.696+0000 7f78c14d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc120eb0 con 0x7f78bc09e410 2023-09-30T22:34:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.696+0000 7f78b3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78bc09e000 0x7f78bc11e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.696+0000 7f78baffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78bc09d6f0 0x7f78bc11e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.696+0000 7f78b3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78bc09e000 0x7f78bc11e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58020/0 (socket says 172.21.15.59:58020) 2023-09-30T22:34:14.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.696+0000 7f78baffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78bc09d6f0 0x7f78bc11e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56528/0 (socket says 172.21.15.59:56528) 2023-09-30T22:34:14.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.696+0000 7f78b3fff700 1 -- 172.21.15.59:0/1465988187 learned_addr learned my addr 172.21.15.59:0/1465988187 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:14.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.696+0000 7f78bb7fe700 1 --2- 172.21.15.59:0/1465988187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78bc09e410 0x7f78bc11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.697+0000 7f78bb7fe700 1 -- 172.21.15.59:0/1465988187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78bc09e000 msgr2=0x7f78bc11e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.697+0000 7f78bb7fe700 1 --2- 172.21.15.59:0/1465988187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78bc09e000 0x7f78bc11e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.697+0000 7f78bb7fe700 1 -- 172.21.15.59:0/1465988187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78bc09d6f0 msgr2=0x7f78bc11e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.697+0000 7f78bb7fe700 1 --2- 172.21.15.59:0/1465988187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78bc09d6f0 0x7f78bc11e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.697+0000 7f78bb7fe700 1 -- 172.21.15.59:0/1465988187 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac009550 con 0x7f78bc09e410 2023-09-30T22:34:14.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.697+0000 7f78bb7fe700 1 --2- 172.21.15.59:0/1465988187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78bc09e410 0x7f78bc11ead0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009310 tx=0x7f78b400e3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:14.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.697+0000 7f78b37fe700 1 -- 172.21.15.59:0/1465988187 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4010040 con 0x7f78bc09e410 2023-09-30T22:34:14.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.697+0000 7f78b37fe700 1 -- 172.21.15.59:0/1465988187 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b4003a20 con 0x7f78bc09e410 2023-09-30T22:34:14.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.697+0000 7f78c14d1700 1 -- 172.21.15.59:0/1465988187 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc120240 con 0x7f78bc09e410 2023-09-30T22:34:14.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.697+0000 7f78b37fe700 1 -- 172.21.15.59:0/1465988187 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4003dd0 con 0x7f78bc09e410 2023-09-30T22:34:14.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.697+0000 7f78c14d1700 1 -- 172.21.15.59:0/1465988187 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc09c700 con 0x7f78bc09e410 2023-09-30T22:34:14.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.698+0000 7f78c14d1700 1 -- 172.21.15.59:0/1465988187 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc074ea0 con 0x7f78bc09e410 2023-09-30T22:34:14.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.699+0000 7f78b37fe700 1 -- 172.21.15.59:0/1465988187 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78b400e880 con 0x7f78bc09e410 2023-09-30T22:34:14.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.699+0000 7f78b37fe700 1 -- 172.21.15.59:0/1465988187 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f78b401e3b0 con 0x7f78bc09e410 2023-09-30T22:34:14.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.708+0000 7f78b37fe700 1 -- 172.21.15.59:0/1465988187 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78b4004030 con 0x7f78bc09e410 2023-09-30T22:34:14.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.729+0000 7fb03907f700 1 Processor -- start 2023-09-30T22:34:14.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.729+0000 7fb03907f700 1 -- start start 2023-09-30T22:34:14.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.730+0000 7fb03907f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb034130670 0x7fb034130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.730+0000 7fb03907f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03406f680 0x7fb03406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.730+0000 7fb03907f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb034130260 con 0x7fb03406ffd0 2023-09-30T22:34:14.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.730+0000 7fb03907f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb034071ff0 con 0x7fb034130670 2023-09-30T22:34:14.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.730+0000 7fb03907f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03409ecf0 con 0x7fb03406f680 2023-09-30T22:34:14.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.730+0000 7fb032d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb034130670 0x7fb034130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.730+0000 7fb032d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb034130670 0x7fb034130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56532/0 (socket says 172.21.15.59:56532) 2023-09-30T22:34:14.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.730+0000 7fb032d9d700 1 -- 172.21.15.59:0/2245466498 learned_addr learned my addr 172.21.15.59:0/2245466498 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:14.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.730+0000 7fb03259c700 1 --2- 172.21.15.59:0/2245466498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03406f680 0x7fb03406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.731+0000 7fb032d9d700 1 -- 172.21.15.59:0/2245466498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03406f680 msgr2=0x7fb03406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:14.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.731+0000 7fb032d9d700 1 --2- 172.21.15.59:0/2245466498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03406f680 0x7fb03406fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.731+0000 7fb032d9d700 1 -- 172.21.15.59:0/2245466498 >> v1:172.21.15.59:6789/0 conn(0x7fb03406ffd0 legacy=0x7fb034137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.731+0000 7fb032d9d700 1 -- 172.21.15.59:0/2245466498 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb034070e70 con 0x7fb034130670 2023-09-30T22:34:14.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.731+0000 7fb03259c700 1 --2- 172.21.15.59:0/2245466498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03406f680 0x7fb03406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:14.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.731+0000 7fb032d9d700 1 --2- 172.21.15.59:0/2245466498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb034130670 0x7fb034130a40 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fb0240098f0 tx=0x7fb024009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ae0c2a2c8955ed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:14.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.731+0000 7fb031d9b700 1 -- 172.21.15.59:0/2245466498 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024011830 con 0x7fb034130670 2023-09-30T22:34:14.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.731+0000 7fb031d9b700 1 -- 172.21.15.59:0/2245466498 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb024011990 con 0x7fb034130670 2023-09-30T22:34:14.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.731+0000 7fb031d9b700 1 -- 172.21.15.59:0/2245466498 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024011d20 con 0x7fb034130670 2023-09-30T22:34:14.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.732+0000 7fb03907f700 1 -- 172.21.15.59:0/2245466498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb034130670 msgr2=0x7fb034130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.732+0000 7fb03907f700 1 --2- 172.21.15.59:0/2245466498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb034130670 0x7fb034130a40 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fb0240098f0 tx=0x7fb024009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:14.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.732+0000 7fb03907f700 1 -- 172.21.15.59:0/2245466498 shutdown_connections 2023-09-30T22:34:14.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.732+0000 7fb03907f700 1 --2- 172.21.15.59:0/2245466498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb034130670 0x7fb034130a40 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.732+0000 7fb03907f700 1 --2- 172.21.15.59:0/2245466498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03406f680 0x7fb03406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.732+0000 7fb03907f700 1 -- 172.21.15.59:0/2245466498 >> 172.21.15.59:0/2245466498 conn(0x7fb0340a2aa0 msgr2=0x7fb0340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:14.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.732+0000 7fb03907f700 1 -- 172.21.15.59:0/2245466498 shutdown_connections 2023-09-30T22:34:14.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.732+0000 7fb03907f700 1 -- 172.21.15.59:0/2245466498 wait complete. 2023-09-30T22:34:14.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.733+0000 7fb03907f700 1 Processor -- start 2023-09-30T22:34:14.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.733+0000 7fb03907f700 1 -- start start 2023-09-30T22:34:14.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.734+0000 7fb03907f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03406f680 0x7fb034133b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.734+0000 7fb03907f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03406ffd0 0x7fb0341340b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.734+0000 7fb03907f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb034130670 0x7fb0341345f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.734+0000 7fb03907f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb034138220 con 0x7fb034130670 2023-09-30T22:34:14.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.734+0000 7fb03907f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb034135730 con 0x7fb03406f680 2023-09-30T22:34:14.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.734+0000 7fb03907f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb034071820 con 0x7fb03406ffd0 2023-09-30T22:34:14.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.734+0000 7fb03259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03406ffd0 0x7fb0341340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.734+0000 7fb03259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03406ffd0 0x7fb0341340b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40450/0 (socket says 172.21.15.59:40450) 2023-09-30T22:34:14.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.734+0000 7fb03259c700 1 -- 172.21.15.59:0/2455410711 learned_addr learned my addr 172.21.15.59:0/2455410711 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:14.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.734+0000 7fb032d9d700 1 --2- 172.21.15.59:0/2455410711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03406f680 0x7fb034133b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.734+0000 7fb03359e700 1 --2- 172.21.15.59:0/2455410711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb034130670 0x7fb0341345f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.735+0000 7fb03259c700 1 -- 172.21.15.59:0/2455410711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03406f680 msgr2=0x7fb034133b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.735+0000 7fb03259c700 1 --2- 172.21.15.59:0/2455410711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03406f680 0x7fb034133b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.735+0000 7fb03259c700 1 -- 172.21.15.59:0/2455410711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb034130670 msgr2=0x7fb0341345f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.735+0000 7fb03259c700 1 --2- 172.21.15.59:0/2455410711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb034130670 0x7fb0341345f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.735+0000 7fb03259c700 1 -- 172.21.15.59:0/2455410711 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0280094a0 con 0x7fb03406ffd0 2023-09-30T22:34:14.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.735+0000 7fb03259c700 1 --2- 172.21.15.59:0/2455410711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03406ffd0 0x7fb0341340b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb02800ebe0 tx=0x7fb02800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:14.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.735+0000 7fb01b7fe700 1 -- 172.21.15.59:0/2455410711 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02800c850 con 0x7fb03406ffd0 2023-09-30T22:34:14.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.735+0000 7fb01b7fe700 1 -- 172.21.15.59:0/2455410711 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02800c9b0 con 0x7fb03406ffd0 2023-09-30T22:34:14.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.735+0000 7fb01b7fe700 1 -- 172.21.15.59:0/2455410711 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02800cd40 con 0x7fb03406ffd0 2023-09-30T22:34:14.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.735+0000 7fb03907f700 1 -- 172.21.15.59:0/2455410711 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb024009550 con 0x7fb03406ffd0 2023-09-30T22:34:14.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.735+0000 7fb03907f700 1 -- 172.21.15.59:0/2455410711 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03412e590 con 0x7fb03406ffd0 2023-09-30T22:34:14.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.737+0000 7fb03907f700 1 -- 172.21.15.59:0/2455410711 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb034136f10 con 0x7fb03406ffd0 2023-09-30T22:34:14.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.737+0000 7fb01b7fe700 1 -- 172.21.15.59:0/2455410711 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb028013470 con 0x7fb03406ffd0 2023-09-30T22:34:14.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.737+0000 7fb01b7fe700 1 -- 172.21.15.59:0/2455410711 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb02803f800 con 0x7fb03406ffd0 2023-09-30T22:34:14.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.746+0000 7fb01b7fe700 1 -- 172.21.15.59:0/2455410711 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb028013720 con 0x7fb03406ffd0 2023-09-30T22:34:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.785+0000 7f0a2a14c700 1 Processor -- start 2023-09-30T22:34:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.785+0000 7f0a2a14c700 1 -- start start 2023-09-30T22:34:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a2a14c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2409e930 0x7f0a2409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a2a14c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2409f240 0x7f0a241317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a2a14c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a2409f650 0x7f0a24131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a2a14c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a24070940 con 0x7f0a2409f650 2023-09-30T22:34:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a2a14c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2406fd60 con 0x7f0a2409f240 2023-09-30T22:34:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a2a14c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2406fa80 con 0x7f0a2409e930 2023-09-30T22:34:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a23fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a2409f650 0x7f0a24131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a23fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a2409f650 0x7f0a24131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56558/0 (socket says 172.21.15.59:56558) 2023-09-30T22:34:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a23fff700 1 -- 172.21.15.59:0/3660674461 learned_addr learned my addr 172.21.15.59:0/3660674461 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a22ffd700 1 --2- 172.21.15.59:0/3660674461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2409f240 0x7f0a241317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a237fe700 1 --2- 172.21.15.59:0/3660674461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2409e930 0x7f0a2409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a22ffd700 1 -- 172.21.15.59:0/3660674461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2409e930 msgr2=0x7f0a2409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a22ffd700 1 --2- 172.21.15.59:0/3660674461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2409e930 0x7f0a2409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a22ffd700 1 -- 172.21.15.59:0/3660674461 >> v2:172.21.15.59:3300/0 conn(0x7f0a2409f650 msgr2=0x7f0a24131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a22ffd700 1 --2- 172.21.15.59:0/3660674461 >> v2:172.21.15.59:3300/0 conn(0x7f0a2409f650 0x7f0a24131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a22ffd700 1 -- 172.21.15.59:0/3660674461 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2409fb60 con 0x7f0a2409f240 2023-09-30T22:34:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.786+0000 7f0a23fff700 1 --2- 172.21.15.59:0/3660674461 >> v2:172.21.15.59:3300/0 conn(0x7f0a2409f650 0x7f0a24131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.787+0000 7f0a22ffd700 1 --2- 172.21.15.59:0/3660674461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2409f240 0x7f0a241317f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009840 tx=0x7f0a18009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e30beb5e3ae6de33 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.787+0000 7f0a227fc700 1 -- 172.21.15.59:0/3660674461 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18011830 con 0x7f0a2409f240 2023-09-30T22:34:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.787+0000 7f0a227fc700 1 -- 172.21.15.59:0/3660674461 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a18011990 con 0x7f0a2409f240 2023-09-30T22:34:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.787+0000 7f0a227fc700 1 -- 172.21.15.59:0/3660674461 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18011d20 con 0x7f0a2409f240 2023-09-30T22:34:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.788+0000 7f0a2a14c700 1 -- 172.21.15.59:0/3660674461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2409f240 msgr2=0x7f0a241317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.788+0000 7f0a2a14c700 1 --2- 172.21.15.59:0/3660674461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2409f240 0x7f0a241317f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009840 tx=0x7f0a18009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.788+0000 7f0a2a14c700 1 -- 172.21.15.59:0/3660674461 shutdown_connections 2023-09-30T22:34:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.788+0000 7f0a2a14c700 1 --2- 172.21.15.59:0/3660674461 >> v2:172.21.15.59:3300/0 conn(0x7f0a2409f650 0x7f0a24131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.788+0000 7f0a2a14c700 1 --2- 172.21.15.59:0/3660674461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2409e930 0x7f0a2409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.788+0000 7f0a2a14c700 1 --2- 172.21.15.59:0/3660674461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2409f240 0x7f0a241317f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.788+0000 7f0a2a14c700 1 -- 172.21.15.59:0/3660674461 >> 172.21.15.59:0/3660674461 conn(0x7f0a240a4210 msgr2=0x7f0a240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.788+0000 7f0a2a14c700 1 -- 172.21.15.59:0/3660674461 shutdown_connections 2023-09-30T22:34:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.788+0000 7f0a2a14c700 1 -- 172.21.15.59:0/3660674461 wait complete. 2023-09-30T22:34:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.789+0000 7f0a2a14c700 1 Processor -- start 2023-09-30T22:34:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.789+0000 7f0a2a14c700 1 -- start start 2023-09-30T22:34:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.790+0000 7f0a2a14c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2409e930 0x7f0a2406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.790+0000 7f0a2a14c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2409f240 0x7f0a2406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.790+0000 7f0a2a14c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2409f650 0x7f0a2406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.790+0000 7f0a2a14c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2406cd80 con 0x7f0a2409e930 2023-09-30T22:34:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.790+0000 7f0a2a14c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a241b7240 con 0x7f0a2409f240 2023-09-30T22:34:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.790+0000 7f0a2a14c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a241a93f0 con 0x7f0a2409f650 2023-09-30T22:34:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.790+0000 7f0a22ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2409f240 0x7f0a2406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.790+0000 7f0a22ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2409f240 0x7f0a2406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58060/0 (socket says 172.21.15.59:58060) 2023-09-30T22:34:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.790+0000 7f0a22ffd700 1 -- 172.21.15.59:0/474496750 learned_addr learned my addr 172.21.15.59:0/474496750 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.790+0000 7f0a237fe700 1 --2- 172.21.15.59:0/474496750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2409e930 0x7f0a2406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.790+0000 7f0a23fff700 1 --2- 172.21.15.59:0/474496750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2409f650 0x7f0a2406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:14.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.791+0000 7f0a22ffd700 1 -- 172.21.15.59:0/474496750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2409f650 msgr2=0x7f0a2406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.791+0000 7f0a22ffd700 1 --2- 172.21.15.59:0/474496750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2409f650 0x7f0a2406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.791+0000 7f0a22ffd700 1 -- 172.21.15.59:0/474496750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2409e930 msgr2=0x7f0a2406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.791+0000 7f0a22ffd700 1 --2- 172.21.15.59:0/474496750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2409e930 0x7f0a2406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.791+0000 7f0a22ffd700 1 -- 172.21.15.59:0/474496750 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c009b30 con 0x7f0a2409f240 2023-09-30T22:34:14.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.791+0000 7f0a237fe700 1 --2- 172.21.15.59:0/474496750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2409e930 0x7f0a2406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:14.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.791+0000 7f0a22ffd700 1 --2- 172.21.15.59:0/474496750 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2409f240 0x7f0a2406bdf0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0a180090b0 tx=0x7f0a18004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.791+0000 7f0a0bfff700 1 -- 172.21.15.59:0/474496750 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18011dc0 con 0x7f0a2409f240 2023-09-30T22:34:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.791+0000 7f0a0bfff700 1 -- 172.21.15.59:0/474496750 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a18004040 con 0x7f0a2409f240 2023-09-30T22:34:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.791+0000 7f0a2a14c700 1 -- 172.21.15.59:0/474496750 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a180094a0 con 0x7f0a2409f240 2023-09-30T22:34:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.791+0000 7f0a0bfff700 1 -- 172.21.15.59:0/474496750 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a180043f0 con 0x7f0a2409f240 2023-09-30T22:34:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.791+0000 7f0a2a14c700 1 -- 172.21.15.59:0/474496750 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a240a0190 con 0x7f0a2409f240 2023-09-30T22:34:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.792+0000 7f0a0bfff700 1 -- 172.21.15.59:0/474496750 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a1802a070 con 0x7f0a2409f240 2023-09-30T22:34:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.792+0000 7f0a0bfff700 1 -- 172.21.15.59:0/474496750 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0a180489d0 con 0x7f0a2409f240 2023-09-30T22:34:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.793+0000 7f0a2a14c700 1 -- 172.21.15.59:0/474496750 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a241a9180 con 0x7f0a2409f240 2023-09-30T22:34:14.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.799+0000 7f0a0bfff700 1 -- 172.21.15.59:0/474496750 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a241a9180 con 0x7f0a2409f240 2023-09-30T22:34:14.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.835+0000 7f2fd67f4700 1 -- 172.21.15.59:0/3631173979 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2fd0074ea0 con 0x7f2fd009e930 2023-09-30T22:34:14.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.836+0000 7f2fccff9700 1 -- 172.21.15.59:0/3631173979 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2fc0019af0 con 0x7f2fd009e930 2023-09-30T22:34:14.837 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:14.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.838+0000 7f2fd67f4700 1 -- 172.21.15.59:0/3631173979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009e930 msgr2=0x7f2fd006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.838+0000 7f2fd67f4700 1 --2- 172.21.15.59:0/3631173979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009e930 0x7f2fd006b8b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000ebb0 tx=0x7f2fc000eec0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.839+0000 7f2fd67f4700 1 -- 172.21.15.59:0/3631173979 shutdown_connections 2023-09-30T22:34:14.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.839+0000 7f2fd67f4700 1 --2- 172.21.15.59:0/3631173979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd009f650 0x7f2fd006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.839+0000 7f2fd67f4700 1 --2- 172.21.15.59:0/3631173979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009e930 0x7f2fd006b8b0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.839+0000 7f2fd67f4700 1 --2- 172.21.15.59:0/3631173979 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f240 0x7f2fd006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.839+0000 7f2fd67f4700 1 -- 172.21.15.59:0/3631173979 >> 172.21.15.59:0/3631173979 conn(0x7f2fd00a4210 msgr2=0x7f2fd01b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:14.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.839+0000 7f2fd67f4700 1 -- 172.21.15.59:0/3631173979 shutdown_connections 2023-09-30T22:34:14.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.839+0000 7f2fd67f4700 1 -- 172.21.15.59:0/3631173979 wait complete. 2023-09-30T22:34:14.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:14.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.922+0000 7f78c14d1700 1 -- 172.21.15.59:0/1465988187 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78bc0a2140 con 0x7f78bc09e410 2023-09-30T22:34:14.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.922+0000 7f78b37fe700 1 -- 172.21.15.59:0/1465988187 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78b401db10 con 0x7f78bc09e410 2023-09-30T22:34:14.923 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:14.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.925+0000 7f78c14d1700 1 -- 172.21.15.59:0/1465988187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78bc09e410 msgr2=0x7f78bc11ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:14.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.925+0000 7f78c14d1700 1 --2- 172.21.15.59:0/1465988187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78bc09e410 0x7f78bc11ead0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009310 tx=0x7f78b400e3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.925+0000 7f78c14d1700 1 -- 172.21.15.59:0/1465988187 shutdown_connections 2023-09-30T22:34:14.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.925+0000 7f78c14d1700 1 --2- 172.21.15.59:0/1465988187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78bc09e410 0x7f78bc11ead0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.925+0000 7f78c14d1700 1 --2- 172.21.15.59:0/1465988187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78bc09d6f0 0x7f78bc11e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.925+0000 7f78c14d1700 1 --2- 172.21.15.59:0/1465988187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78bc09e000 0x7f78bc11e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:14.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.926+0000 7f78c14d1700 1 -- 172.21.15.59:0/1465988187 >> 172.21.15.59:0/1465988187 conn(0x7f78bc066f50 msgr2=0x7f78bc070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:14.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.926+0000 7f78c14d1700 1 -- 172.21.15.59:0/1465988187 shutdown_connections 2023-09-30T22:34:14.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.926+0000 7f78c14d1700 1 -- 172.21.15.59:0/1465988187 wait complete. 2023-09-30T22:34:14.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:14.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.998+0000 7fb03907f700 1 -- 172.21.15.59:0/2455410711 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb03409dd00 con 0x7fb03406ffd0 2023-09-30T22:34:14.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:14.999+0000 7fb01b7fe700 1 -- 172.21.15.59:0/2455410711 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb02801b3b0 con 0x7fb03406ffd0 2023-09-30T22:34:15.000 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:15.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.001+0000 7fb03907f700 1 -- 172.21.15.59:0/2455410711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03406ffd0 msgr2=0x7fb0341340b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:15.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.001+0000 7fb03907f700 1 --2- 172.21.15.59:0/2455410711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03406ffd0 0x7fb0341340b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb02800ebe0 tx=0x7fb02800eef0 comp rx=0 tx=0).stop 2023-09-30T22:34:15.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.001+0000 7fb03907f700 1 -- 172.21.15.59:0/2455410711 shutdown_connections 2023-09-30T22:34:15.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.001+0000 7fb03907f700 1 --2- 172.21.15.59:0/2455410711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb034130670 0x7fb0341345f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:15.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.001+0000 7fb03907f700 1 --2- 172.21.15.59:0/2455410711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03406f680 0x7fb034133b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:15.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.001+0000 7fb03907f700 1 --2- 172.21.15.59:0/2455410711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03406ffd0 0x7fb0341340b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:15.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.001+0000 7fb03907f700 1 -- 172.21.15.59:0/2455410711 >> 172.21.15.59:0/2455410711 conn(0x7fb0340a2aa0 msgr2=0x7fb0340a1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:15.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.001+0000 7fb03907f700 1 -- 172.21.15.59:0/2455410711 shutdown_connections 2023-09-30T22:34:15.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.001+0000 7fb03907f700 1 -- 172.21.15.59:0/2455410711 wait complete. 2023-09-30T22:34:15.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:15.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.020+0000 7f0a2a14c700 1 -- 172.21.15.59:0/474496750 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0a241a9180 con 0x7f0a2409f240 2023-09-30T22:34:15.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.021+0000 7f0a0bfff700 1 -- 172.21.15.59:0/474496750 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a241a9180 con 0x7f0a2409f240 2023-09-30T22:34:15.022 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.023+0000 7f0a2a14c700 1 -- 172.21.15.59:0/474496750 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2409f240 msgr2=0x7f0a2406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.023+0000 7f0a2a14c700 1 --2- 172.21.15.59:0/474496750 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2409f240 0x7f0a2406bdf0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0a180090b0 tx=0x7f0a18004750 comp rx=0 tx=0).stop 2023-09-30T22:34:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.023+0000 7f0a2a14c700 1 -- 172.21.15.59:0/474496750 shutdown_connections 2023-09-30T22:34:15.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.023+0000 7f0a2a14c700 1 --2- 172.21.15.59:0/474496750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2409f650 0x7f0a2406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:15.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.023+0000 7f0a2a14c700 1 --2- 172.21.15.59:0/474496750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2409e930 0x7f0a2406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:15.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.023+0000 7f0a2a14c700 1 --2- 172.21.15.59:0/474496750 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2409f240 0x7f0a2406bdf0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:15.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.023+0000 7f0a2a14c700 1 -- 172.21.15.59:0/474496750 >> 172.21.15.59:0/474496750 conn(0x7f0a240a4210 msgr2=0x7f0a241b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:15.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.023+0000 7f0a2a14c700 1 -- 172.21.15.59:0/474496750 shutdown_connections 2023-09-30T22:34:15.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:15.023+0000 7f0a2a14c700 1 -- 172.21.15.59:0/474496750 wait complete. 2023-09-30T22:34:15.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:15.856 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:15.946 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.003+0000 7fa201dd4700 1 Processor -- start 2023-09-30T22:34:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.003+0000 7fa201dd4700 1 -- start start 2023-09-30T22:34:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.004+0000 7fa201dd4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1fc0a0a30 0x7fa1fc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.004+0000 7fa201dd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1fc138d80 0x7fa1fc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.004+0000 7fa201dd4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1fc0a2a70 con 0x7fa1fc09d630 2023-09-30T22:34:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.004+0000 7fa201dd4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1fc0a01d0 con 0x7fa1fc0a0a30 2023-09-30T22:34:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.004+0000 7fa201dd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc09e2b0 con 0x7fa1fc138d80 2023-09-30T22:34:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.004+0000 7fa1fb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1fc0a0a30 0x7fa1fc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.004+0000 7fa1fbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1fc138d80 0x7fa1fc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.004+0000 7fa1fb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1fc0a0a30 0x7fa1fc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56584/0 (socket says 172.21.15.59:56584) 2023-09-30T22:34:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.004+0000 7fa1fb7fe700 1 -- 172.21.15.59:0/456383402 learned_addr learned my addr 172.21.15.59:0/456383402 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.004+0000 7fa1fbfff700 1 -- 172.21.15.59:0/456383402 >> v2:172.21.15.59:3300/0 conn(0x7fa1fc0a0a30 msgr2=0x7fa1fc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.004+0000 7fa1fbfff700 1 --2- 172.21.15.59:0/456383402 >> v2:172.21.15.59:3300/0 conn(0x7fa1fc0a0a30 0x7fa1fc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.004+0000 7fa1fbfff700 1 -- 172.21.15.59:0/456383402 >> v1:172.21.15.59:6789/0 conn(0x7fa1fc09d630 legacy=0x7fa1fc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.004+0000 7fa1fbfff700 1 -- 172.21.15.59:0/456383402 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc09dc50 con 0x7fa1fc138d80 2023-09-30T22:34:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.004+0000 7fa1fb7fe700 1 --2- 172.21.15.59:0/456383402 >> v2:172.21.15.59:3300/0 conn(0x7fa1fc0a0a30 0x7fa1fc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.004+0000 7fa1fbfff700 1 --2- 172.21.15.59:0/456383402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1fc138d80 0x7fa1fc13b160 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009d90 tx=0x7fa1f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fca6f9927d472 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.005+0000 7fa1fa7fc700 1 -- 172.21.15.59:0/456383402 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f400e070 con 0x7fa1fc138d80 2023-09-30T22:34:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.005+0000 7fa1fa7fc700 1 -- 172.21.15.59:0/456383402 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f400bb20 con 0x7fa1fc138d80 2023-09-30T22:34:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.005+0000 7fa1fa7fc700 1 -- 172.21.15.59:0/456383402 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4012430 con 0x7fa1fc138d80 2023-09-30T22:34:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.005+0000 7fa201dd4700 1 -- 172.21.15.59:0/456383402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1fc138d80 msgr2=0x7fa1fc13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.005+0000 7fa201dd4700 1 --2- 172.21.15.59:0/456383402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1fc138d80 0x7fa1fc13b160 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009d90 tx=0x7fa1f400b330 comp rx=0 tx=0).stop 2023-09-30T22:34:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.005+0000 7fa201dd4700 1 -- 172.21.15.59:0/456383402 shutdown_connections 2023-09-30T22:34:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.005+0000 7fa201dd4700 1 --2- 172.21.15.59:0/456383402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1fc138d80 0x7fa1fc13b160 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.005+0000 7fa201dd4700 1 --2- 172.21.15.59:0/456383402 >> v2:172.21.15.59:3300/0 conn(0x7fa1fc0a0a30 0x7fa1fc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.005+0000 7fa201dd4700 1 -- 172.21.15.59:0/456383402 >> 172.21.15.59:0/456383402 conn(0x7fa1fc0a3050 msgr2=0x7fa1fc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.005+0000 7fa201dd4700 1 -- 172.21.15.59:0/456383402 shutdown_connections 2023-09-30T22:34:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.006+0000 7fa201dd4700 1 -- 172.21.15.59:0/456383402 wait complete. 2023-09-30T22:34:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.006+0000 7fa201dd4700 1 Processor -- start 2023-09-30T22:34:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.007+0000 7fa201dd4700 1 -- start start 2023-09-30T22:34:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.007+0000 7fa201dd4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1fc09d630 0x7fa1fc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.007+0000 7fa201dd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1fc0a0a30 0x7fa1fc133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.007+0000 7fa201dd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1fc138d80 0x7fa1fc1344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.007+0000 7fa201dd4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc136b90 con 0x7fa1fc09d630 2023-09-30T22:34:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.007+0000 7fa201dd4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc138090 con 0x7fa1fc0a0a30 2023-09-30T22:34:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.007+0000 7fa201dd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc1374b0 con 0x7fa1fc138d80 2023-09-30T22:34:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.007+0000 7fa1fbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1fc138d80 0x7fa1fc1344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.007+0000 7fa1faffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1fc0a0a30 0x7fa1fc133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.007+0000 7fa1fbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1fc138d80 0x7fa1fc1344b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40490/0 (socket says 172.21.15.59:40490) 2023-09-30T22:34:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.007+0000 7fa1fbfff700 1 -- 172.21.15.59:0/4249963432 learned_addr learned my addr 172.21.15.59:0/4249963432 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.007+0000 7fa1fb7fe700 1 --2- 172.21.15.59:0/4249963432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1fc09d630 0x7fa1fc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.008+0000 7fa1faffd700 1 -- 172.21.15.59:0/4249963432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1fc138d80 msgr2=0x7fa1fc1344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.008+0000 7fa1faffd700 1 --2- 172.21.15.59:0/4249963432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1fc138d80 0x7fa1fc1344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.008+0000 7fa1faffd700 1 -- 172.21.15.59:0/4249963432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1fc09d630 msgr2=0x7fa1fc133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.008+0000 7fa1faffd700 1 --2- 172.21.15.59:0/4249963432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1fc09d630 0x7fa1fc133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.008+0000 7fa1faffd700 1 -- 172.21.15.59:0/4249963432 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec009550 con 0x7fa1fc0a0a30 2023-09-30T22:34:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.008+0000 7fa1fbfff700 1 --2- 172.21.15.59:0/4249963432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1fc138d80 0x7fa1fc1344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.008+0000 7fa1faffd700 1 --2- 172.21.15.59:0/4249963432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1fc0a0a30 0x7fa1fc133f70 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0000f60 tx=0x7fa1f000c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.008+0000 7fa1e3fff700 1 -- 172.21.15.59:0/4249963432 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f00052d0 con 0x7fa1fc0a0a30 2023-09-30T22:34:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.008+0000 7fa1e3fff700 1 -- 172.21.15.59:0/4249963432 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f0005430 con 0x7fa1fc0a0a30 2023-09-30T22:34:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.008+0000 7fa201dd4700 1 -- 172.21.15.59:0/4249963432 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f4009a70 con 0x7fa1fc0a0a30 2023-09-30T22:34:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.008+0000 7fa1e3fff700 1 -- 172.21.15.59:0/4249963432 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f00038c0 con 0x7fa1fc0a0a30 2023-09-30T22:34:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.008+0000 7fa201dd4700 1 -- 172.21.15.59:0/4249963432 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1fc1371d0 con 0x7fa1fc0a0a30 2023-09-30T22:34:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.009+0000 7fa201dd4700 1 -- 172.21.15.59:0/4249963432 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1fc136e70 con 0x7fa1fc0a0a30 2023-09-30T22:34:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.010+0000 7fa1e3fff700 1 -- 172.21.15.59:0/4249963432 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1f0003a20 con 0x7fa1fc0a0a30 2023-09-30T22:34:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.010+0000 7fa1e3fff700 1 -- 172.21.15.59:0/4249963432 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa1f003ea30 con 0x7fa1fc0a0a30 2023-09-30T22:34:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.014+0000 7fa1e3fff700 1 -- 172.21.15.59:0/4249963432 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1f0003cd0 con 0x7fa1fc0a0a30 2023-09-30T22:34:16.016 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:16.038 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:16.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.096+0000 7fe5c669d700 1 Processor -- start 2023-09-30T22:34:16.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.096+0000 7fe5c669d700 1 -- start start 2023-09-30T22:34:16.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.096+0000 7fe5c669d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5c006e570 0x7fe5c006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.096+0000 7fe5c669d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5c009eca0 0x7fe5c006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.096+0000 7fe5c669d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5c0134610 0x7fe5c0134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.096+0000 7fe5c669d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c0070ee0 con 0x7fe5c009eca0 2023-09-30T22:34:16.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.096+0000 7fe5c669d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0071480 con 0x7fe5c006e570 2023-09-30T22:34:16.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.096+0000 7fe5c669d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c006f3c0 con 0x7fe5c0134610 2023-09-30T22:34:16.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.096+0000 7fe5bffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5c006e570 0x7fe5c006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.097+0000 7fe5bffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5c006e570 0x7fe5c006e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58076/0 (socket says 172.21.15.59:58076) 2023-09-30T22:34:16.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.097+0000 7fe5bffff700 1 -- 172.21.15.59:0/2559757083 learned_addr learned my addr 172.21.15.59:0/2559757083 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.097+0000 7fe5c4c3a700 1 --2- 172.21.15.59:0/2559757083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5c0134610 0x7fe5c0134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.097+0000 7fe5bffff700 1 -- 172.21.15.59:0/2559757083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5c0134610 msgr2=0x7fe5c0134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.097+0000 7fe5bffff700 1 --2- 172.21.15.59:0/2559757083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5c0134610 0x7fe5c0134a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.097+0000 7fe5bffff700 1 -- 172.21.15.59:0/2559757083 >> v2:172.21.15.59:3300/0 conn(0x7fe5c009eca0 msgr2=0x7fe5c006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.097+0000 7fe5bffff700 1 --2- 172.21.15.59:0/2559757083 >> v2:172.21.15.59:3300/0 conn(0x7fe5c009eca0 0x7fe5c006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.097+0000 7fe5bffff700 1 -- 172.21.15.59:0/2559757083 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c0071b90 con 0x7fe5c006e570 2023-09-30T22:34:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.097+0000 7fe5c4c3a700 1 --2- 172.21.15.59:0/2559757083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5c0134610 0x7fe5c0134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.097+0000 7fe5bffff700 1 --2- 172.21.15.59:0/2559757083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5c006e570 0x7fe5c006e940 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00098f0 tx=0x7fe5b0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c189b5af69d3a3f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.097+0000 7fe5beffd700 1 -- 172.21.15.59:0/2559757083 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b000b8a0 con 0x7fe5c006e570 2023-09-30T22:34:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.098+0000 7fe5beffd700 1 -- 172.21.15.59:0/2559757083 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b000ba00 con 0x7fe5c006e570 2023-09-30T22:34:16.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.098+0000 7fe5beffd700 1 -- 172.21.15.59:0/2559757083 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b000bd90 con 0x7fe5c006e570 2023-09-30T22:34:16.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.098+0000 7fe5c669d700 1 -- 172.21.15.59:0/2559757083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5c006e570 msgr2=0x7fe5c006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.098+0000 7fe5c669d700 1 --2- 172.21.15.59:0/2559757083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5c006e570 0x7fe5c006e940 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00098f0 tx=0x7fe5b0009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:16.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.098+0000 7fe5c669d700 1 -- 172.21.15.59:0/2559757083 shutdown_connections 2023-09-30T22:34:16.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.098+0000 7fe5c669d700 1 --2- 172.21.15.59:0/2559757083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5c0134610 0x7fe5c0134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.098+0000 7fe5c669d700 1 --2- 172.21.15.59:0/2559757083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5c006e570 0x7fe5c006e940 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.098+0000 7fe5c669d700 1 --2- 172.21.15.59:0/2559757083 >> v2:172.21.15.59:3300/0 conn(0x7fe5c009eca0 0x7fe5c006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.098+0000 7fe5c669d700 1 -- 172.21.15.59:0/2559757083 >> 172.21.15.59:0/2559757083 conn(0x7fe5c00a2aa0 msgr2=0x7fe5c00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:16.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.098+0000 7fe5c669d700 1 -- 172.21.15.59:0/2559757083 shutdown_connections 2023-09-30T22:34:16.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.098+0000 7fe5c669d700 1 -- 172.21.15.59:0/2559757083 wait complete. 2023-09-30T22:34:16.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.099+0000 7fe5c669d700 1 Processor -- start 2023-09-30T22:34:16.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.100+0000 7fe5c669d700 1 -- start start 2023-09-30T22:34:16.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.100+0000 7fe5c669d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5c006e570 0x7fe5c013af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.100+0000 7fe5c669d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5c0134610 0x7fe5c01260d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.100+0000 7fe5c669d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5c0126610 0x7fe5c0126a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.100+0000 7fe5c669d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0127c70 con 0x7fe5c0134610 2023-09-30T22:34:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.100+0000 7fe5c669d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0070680 con 0x7fe5c006e570 2023-09-30T22:34:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.100+0000 7fe5c669d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c013d050 con 0x7fe5c0126610 2023-09-30T22:34:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.100+0000 7fe5bffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5c006e570 0x7fe5c013af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.100+0000 7fe5bffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5c006e570 0x7fe5c013af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58086/0 (socket says 172.21.15.59:58086) 2023-09-30T22:34:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.100+0000 7fe5bffff700 1 -- 172.21.15.59:0/4144692341 learned_addr learned my addr 172.21.15.59:0/4144692341 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.100+0000 7fe5c4c3a700 1 --2- 172.21.15.59:0/4144692341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5c0126610 0x7fe5c0126a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.101+0000 7fe5bf7fe700 1 --2- 172.21.15.59:0/4144692341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5c0134610 0x7fe5c01260d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.101+0000 7fe5bffff700 1 -- 172.21.15.59:0/4144692341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5c0126610 msgr2=0x7fe5c0126a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.101+0000 7fe5bffff700 1 --2- 172.21.15.59:0/4144692341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5c0126610 0x7fe5c0126a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.101+0000 7fe5bffff700 1 -- 172.21.15.59:0/4144692341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5c0134610 msgr2=0x7fe5c01260d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.101+0000 7fe5bffff700 1 --2- 172.21.15.59:0/4144692341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5c0134610 0x7fe5c01260d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.101+0000 7fe5bffff700 1 -- 172.21.15.59:0/4144692341 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b0009550 con 0x7fe5c006e570 2023-09-30T22:34:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.101+0000 7fe5bf7fe700 1 --2- 172.21.15.59:0/4144692341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5c0134610 0x7fe5c01260d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.101+0000 7fe5bffff700 1 --2- 172.21.15.59:0/4144692341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5c006e570 0x7fe5c013af90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00715c0 tx=0x7fe5b0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.101+0000 7fe5bcff9700 1 -- 172.21.15.59:0/4144692341 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0004450 con 0x7fe5c006e570 2023-09-30T22:34:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.101+0000 7fe5bcff9700 1 -- 172.21.15.59:0/4144692341 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b00045b0 con 0x7fe5c006e570 2023-09-30T22:34:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.101+0000 7fe5c669d700 1 -- 172.21.15.59:0/4144692341 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c0127570 con 0x7fe5c006e570 2023-09-30T22:34:16.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.101+0000 7fe5bcff9700 1 -- 172.21.15.59:0/4144692341 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b00038e0 con 0x7fe5c006e570 2023-09-30T22:34:16.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.102+0000 7fe5c669d700 1 -- 172.21.15.59:0/4144692341 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c013d510 con 0x7fe5c006e570 2023-09-30T22:34:16.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.102+0000 7fe5bcff9700 1 -- 172.21.15.59:0/4144692341 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5b0021070 con 0x7fe5c006e570 2023-09-30T22:34:16.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.103+0000 7fe5bcff9700 1 -- 172.21.15.59:0/4144692341 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe5b0040ad0 con 0x7fe5c006e570 2023-09-30T22:34:16.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.103+0000 7fe5c669d700 1 -- 172.21.15.59:0/4144692341 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c013d700 con 0x7fe5c006e570 2023-09-30T22:34:16.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.108+0000 7fe5bcff9700 1 -- 172.21.15.59:0/4144692341 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5b0015080 con 0x7fe5c006e570 2023-09-30T22:34:16.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.162+0000 7f640ee8b700 1 Processor -- start 2023-09-30T22:34:16.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.162+0000 7f640ee8b700 1 -- start start 2023-09-30T22:34:16.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.162+0000 7f640ee8b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f640809e1d0 0x7f6408135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.162+0000 7f640ee8b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6408135e50 0x7f6408138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.162+0000 7f640ee8b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640809f130 con 0x7f640809d6f0 2023-09-30T22:34:16.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.162+0000 7f640ee8b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640809f520 con 0x7f640809e1d0 2023-09-30T22:34:16.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.162+0000 7f640ee8b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f640809e930 con 0x7f6408135e50 2023-09-30T22:34:16.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.163+0000 7f640cc27700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f640809d6f0 0x7f640809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52696/0 (socket says 172.21.15.59:52696) 2023-09-30T22:34:16.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.163+0000 7f640cc27700 1 -- 172.21.15.59:0/84245645 learned_addr learned my addr 172.21.15.59:0/84245645 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:16.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.163+0000 7f6407fff700 1 --2- 172.21.15.59:0/84245645 >> v2:172.21.15.59:3300/0 conn(0x7f640809e1d0 0x7f6408135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.163+0000 7f640d428700 1 --2- 172.21.15.59:0/84245645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6408135e50 0x7f6408138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.163+0000 7f6407fff700 1 -- 172.21.15.59:0/84245645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6408135e50 msgr2=0x7f6408138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:16.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.163+0000 7f6407fff700 1 --2- 172.21.15.59:0/84245645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6408135e50 0x7f6408138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.163+0000 7f6407fff700 1 -- 172.21.15.59:0/84245645 >> v1:172.21.15.59:6789/0 conn(0x7f640809d6f0 legacy=0x7f640809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.163+0000 7f6407fff700 1 -- 172.21.15.59:0/84245645 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640809b2d0 con 0x7f640809e1d0 2023-09-30T22:34:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.163+0000 7f6407fff700 1 --2- 172.21.15.59:0/84245645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f640809e1d0 0x7f6408135910 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009840 tx=0x7f63f4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbcd1d4a7f4b08fc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.163+0000 7f64077fe700 1 -- 172.21.15.59:0/84245645 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4011830 con 0x7f640809e1d0 2023-09-30T22:34:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.164+0000 7f64077fe700 1 -- 172.21.15.59:0/84245645 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f4011990 con 0x7f640809e1d0 2023-09-30T22:34:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.164+0000 7f64077fe700 1 -- 172.21.15.59:0/84245645 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4011d20 con 0x7f640809e1d0 2023-09-30T22:34:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.164+0000 7f640ee8b700 1 -- 172.21.15.59:0/84245645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f640809e1d0 msgr2=0x7f6408135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.164+0000 7f640ee8b700 1 --2- 172.21.15.59:0/84245645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f640809e1d0 0x7f6408135910 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009840 tx=0x7f63f4009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.164+0000 7f640ee8b700 1 -- 172.21.15.59:0/84245645 shutdown_connections 2023-09-30T22:34:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.164+0000 7f640ee8b700 1 --2- 172.21.15.59:0/84245645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6408135e50 0x7f6408138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.164+0000 7f640ee8b700 1 --2- 172.21.15.59:0/84245645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f640809e1d0 0x7f6408135910 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.164+0000 7f640ee8b700 1 -- 172.21.15.59:0/84245645 >> 172.21.15.59:0/84245645 conn(0x7f6408066f50 msgr2=0x7f640809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.164+0000 7f640ee8b700 1 -- 172.21.15.59:0/84245645 shutdown_connections 2023-09-30T22:34:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.164+0000 7f640ee8b700 1 -- 172.21.15.59:0/84245645 wait complete. 2023-09-30T22:34:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.165+0000 7f640ee8b700 1 Processor -- start 2023-09-30T22:34:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.165+0000 7f640ee8b700 1 -- start start 2023-09-30T22:34:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.166+0000 7f640ee8b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f640809d6f0 0x7f64081206e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.166+0000 7f640ee8b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f640809e1d0 0x7f6408120c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.166+0000 7f640ee8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6408135e50 0x7f6408121160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.166+0000 7f640ee8b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6408124d60 con 0x7f640809d6f0 2023-09-30T22:34:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.166+0000 7f640ee8b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64080a22a0 con 0x7f6408135e50 2023-09-30T22:34:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.166+0000 7f640ee8b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f640809c700 con 0x7f640809e1d0 2023-09-30T22:34:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.166+0000 7f640d428700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6408135e50 0x7f6408121160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.166+0000 7f640d428700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6408135e50 0x7f6408121160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58096/0 (socket says 172.21.15.59:58096) 2023-09-30T22:34:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.166+0000 7f640cc27700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f640809d6f0 0x7f64081206e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.166+0000 7f640d428700 1 -- 172.21.15.59:0/4051915407 learned_addr learned my addr 172.21.15.59:0/4051915407 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.166+0000 7f6407fff700 1 --2- 172.21.15.59:0/4051915407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f640809e1d0 0x7f6408120c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.167+0000 7f640d428700 1 -- 172.21.15.59:0/4051915407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f640809e1d0 msgr2=0x7f6408120c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.167+0000 7f640d428700 1 --2- 172.21.15.59:0/4051915407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f640809e1d0 0x7f6408120c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.167+0000 7f640d428700 1 -- 172.21.15.59:0/4051915407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f640809d6f0 msgr2=0x7f64081206e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.167+0000 7f640d428700 1 --2- 172.21.15.59:0/4051915407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f640809d6f0 0x7f64081206e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.167+0000 7f640d428700 1 -- 172.21.15.59:0/4051915407 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f40094a0 con 0x7f6408135e50 2023-09-30T22:34:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.167+0000 7f640cc27700 1 --2- 172.21.15.59:0/4051915407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f640809d6f0 0x7f64081206e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.167+0000 7f640d428700 1 --2- 172.21.15.59:0/4051915407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6408135e50 0x7f6408121160 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f640000efc0 tx=0x7f640000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.167+0000 7f64057fa700 1 -- 172.21.15.59:0/4051915407 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640000cc90 con 0x7f6408135e50 2023-09-30T22:34:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.167+0000 7f64057fa700 1 -- 172.21.15.59:0/4051915407 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640000f040 con 0x7f6408135e50 2023-09-30T22:34:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.167+0000 7f64057fa700 1 -- 172.21.15.59:0/4051915407 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64000146c0 con 0x7f6408135e50 2023-09-30T22:34:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.167+0000 7f640ee8b700 1 -- 172.21.15.59:0/4051915407 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64081222a0 con 0x7f6408135e50 2023-09-30T22:34:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.167+0000 7f640ee8b700 1 -- 172.21.15.59:0/4051915407 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6408124910 con 0x7f6408135e50 2023-09-30T22:34:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.168+0000 7f64057fa700 1 -- 172.21.15.59:0/4051915407 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6400014820 con 0x7f6408135e50 2023-09-30T22:34:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.169+0000 7f64057fa700 1 -- 172.21.15.59:0/4051915407 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6400040290 con 0x7f6408135e50 2023-09-30T22:34:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.169+0000 7f640ee8b700 1 -- 172.21.15.59:0/4051915407 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6408074ea0 con 0x7f6408135e50 2023-09-30T22:34:16.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.178+0000 7f64057fa700 1 -- 172.21.15.59:0/4051915407 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6400018020 con 0x7f6408135e50 2023-09-30T22:34:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.219+0000 7fa82be5c700 1 Processor -- start 2023-09-30T22:34:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.219+0000 7fa82be5c700 1 -- start start 2023-09-30T22:34:16.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.220+0000 7fa82be5c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa8240a0a30 0x7fa8240a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.220+0000 7fa82be5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8240a1340 0x7fa824133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.220+0000 7fa82be5c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82409edd0 con 0x7fa824133fa0 2023-09-30T22:34:16.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.220+0000 7fa82be5c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82409e1f0 con 0x7fa8240a0a30 2023-09-30T22:34:16.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.220+0000 7fa82be5c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82409dc50 con 0x7fa8240a1340 2023-09-30T22:34:16.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.221+0000 7fa8293f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8240a1340 0x7fa824133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.221+0000 7fa829bf8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa8240a0a30 0x7fa8240a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.221+0000 7fa8293f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8240a1340 0x7fa824133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58104/0 (socket says 172.21.15.59:58104) 2023-09-30T22:34:16.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.221+0000 7fa829bf8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa8240a0a30 0x7fa8240a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56660/0 (socket says 172.21.15.59:56660) 2023-09-30T22:34:16.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.221+0000 7fa8293f7700 1 -- 172.21.15.59:0/1264970710 learned_addr learned my addr 172.21.15.59:0/1264970710 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:16.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.221+0000 7fa8293f7700 1 -- 172.21.15.59:0/1264970710 >> v2:172.21.15.59:3300/0 conn(0x7fa8240a0a30 msgr2=0x7fa8240a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:16.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.221+0000 7fa8293f7700 1 --2- 172.21.15.59:0/1264970710 >> v2:172.21.15.59:3300/0 conn(0x7fa8240a0a30 0x7fa8240a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.221+0000 7fa8293f7700 1 -- 172.21.15.59:0/1264970710 >> v1:172.21.15.59:6789/0 conn(0x7fa824133fa0 legacy=0x7fa82413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.221+0000 7fa8293f7700 1 -- 172.21.15.59:0/1264970710 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8240a1fe0 con 0x7fa8240a1340 2023-09-30T22:34:16.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.221+0000 7fa829bf8700 1 --2- 172.21.15.59:0/1264970710 >> v2:172.21.15.59:3300/0 conn(0x7fa8240a0a30 0x7fa8240a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:16.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.221+0000 7fa8293f7700 1 --2- 172.21.15.59:0/1264970710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8240a1340 0x7fa824133a60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa8140098f0 tx=0x7fa814009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=affefe74dbee2e8a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:16.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.221+0000 7fa828bf6700 1 -- 172.21.15.59:0/1264970710 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814011830 con 0x7fa8240a1340 2023-09-30T22:34:16.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.222+0000 7fa828bf6700 1 -- 172.21.15.59:0/1264970710 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa814011990 con 0x7fa8240a1340 2023-09-30T22:34:16.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.222+0000 7fa828bf6700 1 -- 172.21.15.59:0/1264970710 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814011d20 con 0x7fa8240a1340 2023-09-30T22:34:16.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.222+0000 7fa82be5c700 1 -- 172.21.15.59:0/1264970710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8240a1340 msgr2=0x7fa824133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.222+0000 7fa82be5c700 1 --2- 172.21.15.59:0/1264970710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8240a1340 0x7fa824133a60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa8140098f0 tx=0x7fa814009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:16.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.222+0000 7fa82be5c700 1 -- 172.21.15.59:0/1264970710 shutdown_connections 2023-09-30T22:34:16.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.222+0000 7fa82be5c700 1 --2- 172.21.15.59:0/1264970710 >> v2:172.21.15.59:3300/0 conn(0x7fa8240a0a30 0x7fa8240a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.222+0000 7fa82be5c700 1 --2- 172.21.15.59:0/1264970710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8240a1340 0x7fa824133a60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.222+0000 7fa82be5c700 1 -- 172.21.15.59:0/1264970710 >> 172.21.15.59:0/1264970710 conn(0x7fa8240a6550 msgr2=0x7fa8240a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:16.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.222+0000 7fa82be5c700 1 -- 172.21.15.59:0/1264970710 shutdown_connections 2023-09-30T22:34:16.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.223+0000 7fa82be5c700 1 -- 172.21.15.59:0/1264970710 wait complete. 2023-09-30T22:34:16.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.224+0000 7fa82be5c700 1 Processor -- start 2023-09-30T22:34:16.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.224+0000 7fa82be5c700 1 -- start start 2023-09-30T22:34:16.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa82be5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8240a0a30 0x7fa82411e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa82be5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8240a1340 0x7fa82411ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa82be5c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa824133fa0 0x7fa82411f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:16.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa82be5c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa824120bc0 con 0x7fa824133fa0 2023-09-30T22:34:16.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa82be5c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8240a3760 con 0x7fa8240a1340 2023-09-30T22:34:16.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa82be5c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8240a0220 con 0x7fa8240a0a30 2023-09-30T22:34:16.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa829bf8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8240a0a30 0x7fa82411e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa829bf8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8240a0a30 0x7fa82411e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40550/0 (socket says 172.21.15.59:40550) 2023-09-30T22:34:16.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa8293f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8240a1340 0x7fa82411ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa829bf8700 1 -- 172.21.15.59:0/3452279004 learned_addr learned my addr 172.21.15.59:0/3452279004 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:16.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa82a3f9700 1 --2- 172.21.15.59:0/3452279004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa824133fa0 0x7fa82411f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:16.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa829bf8700 1 -- 172.21.15.59:0/3452279004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8240a1340 msgr2=0x7fa82411ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa829bf8700 1 --2- 172.21.15.59:0/3452279004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8240a1340 0x7fa82411ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa829bf8700 1 -- 172.21.15.59:0/3452279004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa824133fa0 msgr2=0x7fa82411f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa829bf8700 1 --2- 172.21.15.59:0/3452279004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa824133fa0 0x7fa82411f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.225+0000 7fa829bf8700 1 -- 172.21.15.59:0/3452279004 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8200094a0 con 0x7fa8240a0a30 2023-09-30T22:34:16.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.226+0000 7fa829bf8700 1 --2- 172.21.15.59:0/3452279004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8240a0a30 0x7fa82411e750 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa82000ebe0 tx=0x7fa82000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:16.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.226+0000 7fa81a7fc700 1 -- 172.21.15.59:0/3452279004 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82000c850 con 0x7fa8240a0a30 2023-09-30T22:34:16.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.226+0000 7fa81a7fc700 1 -- 172.21.15.59:0/3452279004 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82000c9b0 con 0x7fa8240a0a30 2023-09-30T22:34:16.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.226+0000 7fa82be5c700 1 -- 172.21.15.59:0/3452279004 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa814009550 con 0x7fa8240a0a30 2023-09-30T22:34:16.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.226+0000 7fa81a7fc700 1 -- 172.21.15.59:0/3452279004 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82000cd20 con 0x7fa8240a0a30 2023-09-30T22:34:16.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.226+0000 7fa82be5c700 1 -- 172.21.15.59:0/3452279004 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa824122a00 con 0x7fa8240a0a30 2023-09-30T22:34:16.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.227+0000 7fa81a7fc700 1 -- 172.21.15.59:0/3452279004 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa820013470 con 0x7fa8240a0a30 2023-09-30T22:34:16.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.227+0000 7fa81a7fc700 1 -- 172.21.15.59:0/3452279004 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa82003f8b0 con 0x7fa8240a0a30 2023-09-30T22:34:16.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.227+0000 7fa82be5c700 1 -- 172.21.15.59:0/3452279004 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa824074ea0 con 0x7fa8240a0a30 2023-09-30T22:34:16.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.237+0000 7fa81a7fc700 1 -- 172.21.15.59:0/3452279004 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa820017080 con 0x7fa8240a0a30 2023-09-30T22:34:16.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.241+0000 7fa201dd4700 1 -- 172.21.15.59:0/4249963432 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa1fc136e70 con 0x7fa1fc0a0a30 2023-09-30T22:34:16.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.242+0000 7fa1e3fff700 1 -- 172.21.15.59:0/4249963432 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1fc136e70 con 0x7fa1fc0a0a30 2023-09-30T22:34:16.243 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:16.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.244+0000 7fa201dd4700 1 -- 172.21.15.59:0/4249963432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1fc0a0a30 msgr2=0x7fa1fc133f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.244+0000 7fa201dd4700 1 --2- 172.21.15.59:0/4249963432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1fc0a0a30 0x7fa1fc133f70 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0000f60 tx=0x7fa1f000c730 comp rx=0 tx=0).stop 2023-09-30T22:34:16.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.244+0000 7fa201dd4700 1 -- 172.21.15.59:0/4249963432 shutdown_connections 2023-09-30T22:34:16.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.244+0000 7fa201dd4700 1 --2- 172.21.15.59:0/4249963432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1fc138d80 0x7fa1fc1344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.244+0000 7fa201dd4700 1 --2- 172.21.15.59:0/4249963432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1fc09d630 0x7fa1fc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.244+0000 7fa201dd4700 1 --2- 172.21.15.59:0/4249963432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1fc0a0a30 0x7fa1fc133f70 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.244+0000 7fa201dd4700 1 -- 172.21.15.59:0/4249963432 >> 172.21.15.59:0/4249963432 conn(0x7fa1fc0a3050 msgr2=0x7fa1fc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:16.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.245+0000 7fa201dd4700 1 -- 172.21.15.59:0/4249963432 shutdown_connections 2023-09-30T22:34:16.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.245+0000 7fa201dd4700 1 -- 172.21.15.59:0/4249963432 wait complete. 2023-09-30T22:34:16.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.316+0000 7fe5c669d700 1 -- 172.21.15.59:0/4144692341 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe5c013ce70 con 0x7fe5c006e570 2023-09-30T22:34:16.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.317+0000 7fe5bcff9700 1 -- 172.21.15.59:0/4144692341 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5b0029020 con 0x7fe5c006e570 2023-09-30T22:34:16.319 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:16.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.320+0000 7fe5c669d700 1 -- 172.21.15.59:0/4144692341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5c006e570 msgr2=0x7fe5c013af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.320+0000 7fe5c669d700 1 --2- 172.21.15.59:0/4144692341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5c006e570 0x7fe5c013af90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00715c0 tx=0x7fe5b0004750 comp rx=0 tx=0).stop 2023-09-30T22:34:16.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.320+0000 7fe5c669d700 1 -- 172.21.15.59:0/4144692341 shutdown_connections 2023-09-30T22:34:16.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.320+0000 7fe5c669d700 1 --2- 172.21.15.59:0/4144692341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5c0126610 0x7fe5c0126a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.320+0000 7fe5c669d700 1 --2- 172.21.15.59:0/4144692341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5c006e570 0x7fe5c013af90 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.320+0000 7fe5c669d700 1 --2- 172.21.15.59:0/4144692341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5c0134610 0x7fe5c01260d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.320+0000 7fe5c669d700 1 -- 172.21.15.59:0/4144692341 >> 172.21.15.59:0/4144692341 conn(0x7fe5c00a2aa0 msgr2=0x7fe5c0099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:16.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.320+0000 7fe5c669d700 1 -- 172.21.15.59:0/4144692341 shutdown_connections 2023-09-30T22:34:16.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.320+0000 7fe5c669d700 1 -- 172.21.15.59:0/4144692341 wait complete. 2023-09-30T22:34:16.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:16.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.436+0000 7f640ee8b700 1 -- 172.21.15.59:0/4051915407 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f640806c360 con 0x7f6408135e50 2023-09-30T22:34:16.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.436+0000 7f64057fa700 1 -- 172.21.15.59:0/4051915407 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f640002b090 con 0x7f6408135e50 2023-09-30T22:34:16.438 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:16.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.439+0000 7f640ee8b700 1 -- 172.21.15.59:0/4051915407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6408135e50 msgr2=0x7f6408121160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.439+0000 7f640ee8b700 1 --2- 172.21.15.59:0/4051915407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6408135e50 0x7f6408121160 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f640000efc0 tx=0x7f640000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.440+0000 7f640ee8b700 1 -- 172.21.15.59:0/4051915407 shutdown_connections 2023-09-30T22:34:16.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.440+0000 7f640ee8b700 1 --2- 172.21.15.59:0/4051915407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6408135e50 0x7f6408121160 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.440+0000 7f640ee8b700 1 --2- 172.21.15.59:0/4051915407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f640809d6f0 0x7f64081206e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.440+0000 7f640ee8b700 1 --2- 172.21.15.59:0/4051915407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f640809e1d0 0x7f6408120c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.440+0000 7f640ee8b700 1 -- 172.21.15.59:0/4051915407 >> 172.21.15.59:0/4051915407 conn(0x7f6408066f50 msgr2=0x7f64081369c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:16.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.440+0000 7f640ee8b700 1 -- 172.21.15.59:0/4051915407 shutdown_connections 2023-09-30T22:34:16.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.440+0000 7f640ee8b700 1 -- 172.21.15.59:0/4051915407 wait complete. 2023-09-30T22:34:16.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:16.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.498+0000 7fa82be5c700 1 -- 172.21.15.59:0/3452279004 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa824121e40 con 0x7fa8240a0a30 2023-09-30T22:34:16.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.498+0000 7fa81a7fc700 1 -- 172.21.15.59:0/3452279004 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa820021020 con 0x7fa8240a0a30 2023-09-30T22:34:16.499 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.500+0000 7fa82be5c700 1 -- 172.21.15.59:0/3452279004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8240a0a30 msgr2=0x7fa82411e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.500+0000 7fa82be5c700 1 --2- 172.21.15.59:0/3452279004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8240a0a30 0x7fa82411e750 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa82000ebe0 tx=0x7fa82000eef0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.500+0000 7fa82be5c700 1 -- 172.21.15.59:0/3452279004 shutdown_connections 2023-09-30T22:34:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.500+0000 7fa82be5c700 1 --2- 172.21.15.59:0/3452279004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8240a0a30 0x7fa82411e750 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.500+0000 7fa82be5c700 1 --2- 172.21.15.59:0/3452279004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa824133fa0 0x7fa82411f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.500+0000 7fa82be5c700 1 --2- 172.21.15.59:0/3452279004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8240a1340 0x7fa82411ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.500+0000 7fa82be5c700 1 -- 172.21.15.59:0/3452279004 >> 172.21.15.59:0/3452279004 conn(0x7fa8240a6550 msgr2=0x7fa8240a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.501+0000 7fa82be5c700 1 -- 172.21.15.59:0/3452279004 shutdown_connections 2023-09-30T22:34:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:16.501+0000 7fa82be5c700 1 -- 172.21.15.59:0/3452279004 wait complete. 2023-09-30T22:34:16.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:17.260 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:17.341 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.408+0000 7f1e06e00700 1 Processor -- start 2023-09-30T22:34:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.408+0000 7f1e06e00700 1 -- start start 2023-09-30T22:34:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.408+0000 7f1e06e00700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e0009d630 0x7f1e000a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.408+0000 7f1e06e00700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e00138d80 0x7f1e0013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.408+0000 7f1e06e00700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e000a2a70 con 0x7f1e000a0a30 2023-09-30T22:34:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.408+0000 7f1e06e00700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e000a01d0 con 0x7f1e00138d80 2023-09-30T22:34:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.408+0000 7f1e06e00700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0009e2b0 con 0x7f1e0009d630 2023-09-30T22:34:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.409+0000 7f1e0539d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e00138d80 0x7f1e0013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.409+0000 7f1dfffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e0009d630 0x7f1e000a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.409+0000 7f1e0539d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e00138d80 0x7f1e0013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56678/0 (socket says 172.21.15.59:56678) 2023-09-30T22:34:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.409+0000 7f1dfffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e0009d630 0x7f1e000a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40566/0 (socket says 172.21.15.59:40566) 2023-09-30T22:34:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.409+0000 7f1e0539d700 1 -- 172.21.15.59:0/1000348377 learned_addr learned my addr 172.21.15.59:0/1000348377 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.409+0000 7f1e0539d700 1 -- 172.21.15.59:0/1000348377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e0009d630 msgr2=0x7f1e000a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.409+0000 7f1e0539d700 1 --2- 172.21.15.59:0/1000348377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e0009d630 0x7f1e000a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.409+0000 7f1e0539d700 1 -- 172.21.15.59:0/1000348377 >> v1:172.21.15.59:6789/0 conn(0x7f1e000a0a30 legacy=0x7f1e000a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.409+0000 7f1e0539d700 1 -- 172.21.15.59:0/1000348377 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0009dc50 con 0x7f1e00138d80 2023-09-30T22:34:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.409+0000 7f1dfffff700 1 --2- 172.21.15.59:0/1000348377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e0009d630 0x7f1e000a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.409+0000 7f1e0539d700 1 --2- 172.21.15.59:0/1000348377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e00138d80 0x7f1e0013b160 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009e50 tx=0x7f1df800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec38a69545a22a82 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.409+0000 7f1dff7fe700 1 -- 172.21.15.59:0/1000348377 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df800e070 con 0x7f1e00138d80 2023-09-30T22:34:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.409+0000 7f1dff7fe700 1 -- 172.21.15.59:0/1000348377 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df800b910 con 0x7f1e00138d80 2023-09-30T22:34:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.409+0000 7f1dff7fe700 1 -- 172.21.15.59:0/1000348377 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df800bcc0 con 0x7f1e00138d80 2023-09-30T22:34:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.410+0000 7f1e06e00700 1 -- 172.21.15.59:0/1000348377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e00138d80 msgr2=0x7f1e0013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.410+0000 7f1e06e00700 1 --2- 172.21.15.59:0/1000348377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e00138d80 0x7f1e0013b160 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009e50 tx=0x7f1df800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.410+0000 7f1e06e00700 1 -- 172.21.15.59:0/1000348377 shutdown_connections 2023-09-30T22:34:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.410+0000 7f1e06e00700 1 --2- 172.21.15.59:0/1000348377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e00138d80 0x7f1e0013b160 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.410+0000 7f1e06e00700 1 --2- 172.21.15.59:0/1000348377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e0009d630 0x7f1e000a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.410+0000 7f1e06e00700 1 -- 172.21.15.59:0/1000348377 >> 172.21.15.59:0/1000348377 conn(0x7f1e000a3050 msgr2=0x7f1e000a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.410+0000 7f1e06e00700 1 -- 172.21.15.59:0/1000348377 shutdown_connections 2023-09-30T22:34:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.410+0000 7f1e06e00700 1 -- 172.21.15.59:0/1000348377 wait complete. 2023-09-30T22:34:17.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.411+0000 7f1e06e00700 1 Processor -- start 2023-09-30T22:34:17.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.411+0000 7f1e06e00700 1 -- start start 2023-09-30T22:34:17.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.412+0000 7f1e06e00700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e0009d630 0x7f1e00133850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.412+0000 7f1e06e00700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e000a0a30 0x7f1e00133d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.412+0000 7f1e06e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e00138d80 0x7f1e001342d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.412+0000 7f1e06e00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e00137000 con 0x7f1e00138d80 2023-09-30T22:34:17.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.412+0000 7f1e06e00700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e001359f0 con 0x7f1e000a0a30 2023-09-30T22:34:17.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.412+0000 7f1e06e00700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000a0480 con 0x7f1e0009d630 2023-09-30T22:34:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.412+0000 7f1e0539d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e00138d80 0x7f1e001342d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.412+0000 7f1dfffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e000a0a30 0x7f1e00133d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.412+0000 7f1e0539d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e00138d80 0x7f1e001342d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56690/0 (socket says 172.21.15.59:56690) 2023-09-30T22:34:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.412+0000 7f1e0539d700 1 -- 172.21.15.59:0/922783314 learned_addr learned my addr 172.21.15.59:0/922783314 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.412+0000 7f1e04b9c700 1 --2- 172.21.15.59:0/922783314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e0009d630 0x7f1e00133850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.413+0000 7f1e0539d700 1 -- 172.21.15.59:0/922783314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e0009d630 msgr2=0x7f1e00133850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.413+0000 7f1e0539d700 1 --2- 172.21.15.59:0/922783314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e0009d630 0x7f1e00133850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.413+0000 7f1e0539d700 1 -- 172.21.15.59:0/922783314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e000a0a30 msgr2=0x7f1e00133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.413+0000 7f1e0539d700 1 --2- 172.21.15.59:0/922783314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e000a0a30 0x7f1e00133d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.413+0000 7f1e0539d700 1 -- 172.21.15.59:0/922783314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de80094a0 con 0x7f1e00138d80 2023-09-30T22:34:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.413+0000 7f1dfffff700 1 --2- 172.21.15.59:0/922783314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e000a0a30 0x7f1e00133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.413+0000 7f1e04b9c700 1 --2- 172.21.15.59:0/922783314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e0009d630 0x7f1e00133850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.413+0000 7f1e0539d700 1 --2- 172.21.15.59:0/922783314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e00138d80 0x7f1e001342d0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f1e000a2c00 tx=0x7f1df8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.413+0000 7f1dfd7fa700 1 -- 172.21.15.59:0/922783314 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8004800 con 0x7f1e00138d80 2023-09-30T22:34:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.413+0000 7f1dfd7fa700 1 -- 172.21.15.59:0/922783314 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df8004960 con 0x7f1e00138d80 2023-09-30T22:34:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.413+0000 7f1dfd7fa700 1 -- 172.21.15.59:0/922783314 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df801c680 con 0x7f1e00138d80 2023-09-30T22:34:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.413+0000 7f1e06e00700 1 -- 172.21.15.59:0/922783314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df8009b30 con 0x7f1e00138d80 2023-09-30T22:34:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.413+0000 7f1e06e00700 1 -- 172.21.15.59:0/922783314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e00137ec0 con 0x7f1e00138d80 2023-09-30T22:34:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.414+0000 7f1e06e00700 1 -- 172.21.15.59:0/922783314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e000747f0 con 0x7f1e00138d80 2023-09-30T22:34:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.414+0000 7f1dfd7fa700 1 -- 172.21.15.59:0/922783314 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1df801c7e0 con 0x7f1e00138d80 2023-09-30T22:34:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.414+0000 7f1dfd7fa700 1 -- 172.21.15.59:0/922783314 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1df8041400 con 0x7f1e00138d80 2023-09-30T22:34:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.419+0000 7f1dfd7fa700 1 -- 172.21.15.59:0/922783314 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1df802d940 con 0x7f1e00138d80 2023-09-30T22:34:17.460 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:17.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.491+0000 7f691c4a3700 1 Processor -- start 2023-09-30T22:34:17.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.491+0000 7f691c4a3700 1 -- start start 2023-09-30T22:34:17.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.492+0000 7f691c4a3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f691409d6f0 0x7f691409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.492+0000 7f691c4a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f691409e000 0x7f69141339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.492+0000 7f691c4a3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f691409e410 0x7f6914133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.492+0000 7f691c4a3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691406b460 con 0x7f691409e410 2023-09-30T22:34:17.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.492+0000 7f691c4a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691409b120 con 0x7f691409e000 2023-09-30T22:34:17.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.492+0000 7f691c4a3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f691409a7e0 con 0x7f691409d6f0 2023-09-30T22:34:17.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.492+0000 7f691aa40700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f691409e410 0x7f6914133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.492+0000 7f6919a3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f691409e000 0x7f69141339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.492+0000 7f691aa40700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f691409e410 0x7f6914133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56704/0 (socket says 172.21.15.59:56704) 2023-09-30T22:34:17.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.492+0000 7f691aa40700 1 -- 172.21.15.59:0/2979808278 learned_addr learned my addr 172.21.15.59:0/2979808278 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:17.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.492+0000 7f691a23f700 1 --2- 172.21.15.59:0/2979808278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f691409d6f0 0x7f691409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.493+0000 7f691aa40700 1 -- 172.21.15.59:0/2979808278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f691409d6f0 msgr2=0x7f691409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:17.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.493+0000 7f691aa40700 1 --2- 172.21.15.59:0/2979808278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f691409d6f0 0x7f691409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.493+0000 7f691aa40700 1 -- 172.21.15.59:0/2979808278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f691409e000 msgr2=0x7f69141339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:17.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.493+0000 7f691aa40700 1 --2- 172.21.15.59:0/2979808278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f691409e000 0x7f69141339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.493+0000 7f691aa40700 1 -- 172.21.15.59:0/2979808278 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691409a500 con 0x7f691409e410 2023-09-30T22:34:17.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.493+0000 7f6919a3e700 1 --2- 172.21.15.59:0/2979808278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f691409e000 0x7f69141339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:17.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.493+0000 7f691a23f700 1 --2- 172.21.15.59:0/2979808278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f691409d6f0 0x7f691409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:17.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.493+0000 7f691aa40700 1 --2- 172.21.15.59:0/2979808278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f691409e410 0x7f6914133f30 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f690c009e50 tx=0x7f690c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a431cfeef745dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:17.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.493+0000 7f691923d700 1 -- 172.21.15.59:0/2979808278 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c00e070 con 0x7f691409e410 2023-09-30T22:34:17.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.493+0000 7f691923d700 1 -- 172.21.15.59:0/2979808278 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690c00b910 con 0x7f691409e410 2023-09-30T22:34:17.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.493+0000 7f691923d700 1 -- 172.21.15.59:0/2979808278 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c00bcc0 con 0x7f691409e410 2023-09-30T22:34:17.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.494+0000 7f691c4a3700 1 -- 172.21.15.59:0/2979808278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f691409e410 msgr2=0x7f6914133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.494+0000 7f691c4a3700 1 --2- 172.21.15.59:0/2979808278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f691409e410 0x7f6914133f30 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f690c009e50 tx=0x7f690c00b330 comp rx=0 tx=0).stop 2023-09-30T22:34:17.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.494+0000 7f691c4a3700 1 -- 172.21.15.59:0/2979808278 shutdown_connections 2023-09-30T22:34:17.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.494+0000 7f691c4a3700 1 --2- 172.21.15.59:0/2979808278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f691409e410 0x7f6914133f30 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.494+0000 7f691c4a3700 1 --2- 172.21.15.59:0/2979808278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f691409d6f0 0x7f691409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.494+0000 7f691c4a3700 1 --2- 172.21.15.59:0/2979808278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f691409e000 0x7f69141339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.494+0000 7f691c4a3700 1 -- 172.21.15.59:0/2979808278 >> 172.21.15.59:0/2979808278 conn(0x7f6914066f50 msgr2=0x7f691409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:17.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.494+0000 7f691c4a3700 1 -- 172.21.15.59:0/2979808278 shutdown_connections 2023-09-30T22:34:17.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.494+0000 7f691c4a3700 1 -- 172.21.15.59:0/2979808278 wait complete. 2023-09-30T22:34:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.496+0000 7f691c4a3700 1 Processor -- start 2023-09-30T22:34:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.496+0000 7f691c4a3700 1 -- start start 2023-09-30T22:34:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.496+0000 7f691c4a3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f691409d6f0 0x7f69141a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.496+0000 7f691c4a3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f691409e000 0x7f69141a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.496+0000 7f691c4a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f691409e410 0x7f69141c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.496+0000 7f691c4a3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69141a5c90 con 0x7f691409e000 2023-09-30T22:34:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.496+0000 7f691c4a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69141b9140 con 0x7f691409e410 2023-09-30T22:34:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.496+0000 7f691c4a3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69141a4d20 con 0x7f691409d6f0 2023-09-30T22:34:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f6919a3e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f691409e000 0x7f69141a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f6919a3e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f691409e000 0x7f69141a5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56720/0 (socket says 172.21.15.59:56720) 2023-09-30T22:34:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f6919a3e700 1 -- 172.21.15.59:0/3149083987 learned_addr learned my addr 172.21.15.59:0/3149083987 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f691a23f700 1 --2- 172.21.15.59:0/3149083987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f691409d6f0 0x7f69141a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f691aa40700 1 --2- 172.21.15.59:0/3149083987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f691409e410 0x7f69141c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f6919a3e700 1 -- 172.21.15.59:0/3149083987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f691409d6f0 msgr2=0x7f69141a5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f6919a3e700 1 --2- 172.21.15.59:0/3149083987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f691409d6f0 0x7f69141a5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f6919a3e700 1 -- 172.21.15.59:0/3149083987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f691409e410 msgr2=0x7f69141c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f6919a3e700 1 --2- 172.21.15.59:0/3149083987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f691409e410 0x7f69141c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f6919a3e700 1 -- 172.21.15.59:0/3149083987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69100094a0 con 0x7f691409e000 2023-09-30T22:34:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f691aa40700 1 --2- 172.21.15.59:0/3149083987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f691409e410 0x7f69141c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f691a23f700 1 --2- 172.21.15.59:0/3149083987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f691409d6f0 0x7f69141a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f6919a3e700 1 --2- 172.21.15.59:0/3149083987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f691409e000 0x7f69141a5750 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f690400ebb0 tx=0x7f690400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f690affd700 1 -- 172.21.15.59:0/3149083987 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690400c850 con 0x7f691409e000 2023-09-30T22:34:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f690affd700 1 -- 172.21.15.59:0/3149083987 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690400c9b0 con 0x7f691409e000 2023-09-30T22:34:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f691c4a3700 1 -- 172.21.15.59:0/3149083987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69040094a0 con 0x7f691409e000 2023-09-30T22:34:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f690affd700 1 -- 172.21.15.59:0/3149083987 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690400cd40 con 0x7f691409e000 2023-09-30T22:34:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.497+0000 7f691c4a3700 1 -- 172.21.15.59:0/3149083987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c009b30 con 0x7f691409e000 2023-09-30T22:34:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.498+0000 7f690affd700 1 -- 172.21.15.59:0/3149083987 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6904013470 con 0x7f691409e000 2023-09-30T22:34:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.499+0000 7f690affd700 1 -- 172.21.15.59:0/3149083987 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f690403fb50 con 0x7f691409e000 2023-09-30T22:34:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.498+0000 7f691c4a3700 1 -- 172.21.15.59:0/3149083987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6914074ea0 con 0x7f691409e000 2023-09-30T22:34:17.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.508+0000 7f690affd700 1 -- 172.21.15.59:0/3149083987 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6904021020 con 0x7f691409e000 2023-09-30T22:34:17.516 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:17.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.605+0000 7fe578b0d700 1 Processor -- start 2023-09-30T22:34:17.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.605+0000 7fe578b0d700 1 -- start start 2023-09-30T22:34:17.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe578b0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe57406a770 0x7fe57409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe578b0d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe57409dc30 0x7fe57409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe578b0d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe57413c1e0 0x7fe57413e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe578b0d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57406ab40 con 0x7fe57413c1e0 2023-09-30T22:34:17.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe578b0d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57409ebc0 con 0x7fe57406a770 2023-09-30T22:34:17.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe578b0d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe57409a810 con 0x7fe57409dc30 2023-09-30T22:34:17.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe572d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe57413c1e0 0x7fe57413e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe571d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe57409dc30 0x7fe57409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe572d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe57413c1e0 0x7fe57413e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56728/0 (socket says 172.21.15.59:56728) 2023-09-30T22:34:17.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe572d9d700 1 -- 172.21.15.59:0/1470740713 learned_addr learned my addr 172.21.15.59:0/1470740713 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:17.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe57259c700 1 --2- 172.21.15.59:0/1470740713 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe57406a770 0x7fe57409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe571d9b700 1 -- 172.21.15.59:0/1470740713 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe57406a770 msgr2=0x7fe57409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:17.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe571d9b700 1 --2- 172.21.15.59:0/1470740713 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe57406a770 0x7fe57409d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe571d9b700 1 -- 172.21.15.59:0/1470740713 >> v2:172.21.15.59:3300/0 conn(0x7fe57413c1e0 msgr2=0x7fe57413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:17.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe571d9b700 1 --2- 172.21.15.59:0/1470740713 >> v2:172.21.15.59:3300/0 conn(0x7fe57413c1e0 0x7fe57413e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.606+0000 7fe571d9b700 1 -- 172.21.15.59:0/1470740713 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57409e920 con 0x7fe57409dc30 2023-09-30T22:34:17.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.607+0000 7fe571d9b700 1 --2- 172.21.15.59:0/1470740713 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe57409dc30 0x7fe57409e080 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe568009870 tx=0x7fe568009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42e77f234cfaf457 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:17.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.607+0000 7fe57159a700 1 -- 172.21.15.59:0/1470740713 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568011830 con 0x7fe57409dc30 2023-09-30T22:34:17.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.607+0000 7fe57159a700 1 -- 172.21.15.59:0/1470740713 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe568011990 con 0x7fe57409dc30 2023-09-30T22:34:17.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.607+0000 7fe57159a700 1 -- 172.21.15.59:0/1470740713 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568011d20 con 0x7fe57409dc30 2023-09-30T22:34:17.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.608+0000 7fe578b0d700 1 -- 172.21.15.59:0/1470740713 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe57409dc30 msgr2=0x7fe57409e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.608+0000 7fe578b0d700 1 --2- 172.21.15.59:0/1470740713 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe57409dc30 0x7fe57409e080 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe568009870 tx=0x7fe568009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:17.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.608+0000 7fe578b0d700 1 -- 172.21.15.59:0/1470740713 shutdown_connections 2023-09-30T22:34:17.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.608+0000 7fe578b0d700 1 --2- 172.21.15.59:0/1470740713 >> v2:172.21.15.59:3300/0 conn(0x7fe57413c1e0 0x7fe57413e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.608+0000 7fe578b0d700 1 --2- 172.21.15.59:0/1470740713 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe57406a770 0x7fe57409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.608+0000 7fe578b0d700 1 --2- 172.21.15.59:0/1470740713 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe57409dc30 0x7fe57409e080 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.608+0000 7fe578b0d700 1 -- 172.21.15.59:0/1470740713 >> 172.21.15.59:0/1470740713 conn(0x7fe574066f50 msgr2=0x7fe57409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:17.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.608+0000 7fe578b0d700 1 -- 172.21.15.59:0/1470740713 shutdown_connections 2023-09-30T22:34:17.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.608+0000 7fe578b0d700 1 -- 172.21.15.59:0/1470740713 wait complete. 2023-09-30T22:34:17.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.609+0000 7fe578b0d700 1 Processor -- start 2023-09-30T22:34:17.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.609+0000 7fe578b0d700 1 -- start start 2023-09-30T22:34:17.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.610+0000 7fe578b0d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe57406a770 0x7fe574127e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.610+0000 7fe578b0d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57409dc30 0x7fe574128360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.610+0000 7fe578b0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe57413c1e0 0x7fe5741cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.610+0000 7fe578b0d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe574129b10 con 0x7fe57409dc30 2023-09-30T22:34:17.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.610+0000 7fe578b0d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57413bdc0 con 0x7fe57413c1e0 2023-09-30T22:34:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.610+0000 7fe578b0d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5741279f0 con 0x7fe57406a770 2023-09-30T22:34:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.610+0000 7fe57259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe57406a770 0x7fe574127e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.610+0000 7fe571d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57409dc30 0x7fe574128360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.610+0000 7fe57259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe57406a770 0x7fe574127e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40620/0 (socket says 172.21.15.59:40620) 2023-09-30T22:34:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.610+0000 7fe57259c700 1 -- 172.21.15.59:0/1719076241 learned_addr learned my addr 172.21.15.59:0/1719076241 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.610+0000 7fe572d9d700 1 --2- 172.21.15.59:0/1719076241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe57413c1e0 0x7fe5741cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.611+0000 7fe57259c700 1 -- 172.21.15.59:0/1719076241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe57413c1e0 msgr2=0x7fe5741cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.611+0000 7fe57259c700 1 --2- 172.21.15.59:0/1719076241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe57413c1e0 0x7fe5741cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.611+0000 7fe57259c700 1 -- 172.21.15.59:0/1719076241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57409dc30 msgr2=0x7fe574128360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.611+0000 7fe57259c700 1 --2- 172.21.15.59:0/1719076241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57409dc30 0x7fe574128360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.611+0000 7fe57259c700 1 -- 172.21.15.59:0/1719076241 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5680094a0 con 0x7fe57406a770 2023-09-30T22:34:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.611+0000 7fe57259c700 1 --2- 172.21.15.59:0/1719076241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe57406a770 0x7fe574127e20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe56400e9b0 tx=0x7fe56400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.611+0000 7fe562ffd700 1 -- 172.21.15.59:0/1719076241 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564009710 con 0x7fe57406a770 2023-09-30T22:34:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.611+0000 7fe562ffd700 1 -- 172.21.15.59:0/1719076241 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56400ee50 con 0x7fe57406a770 2023-09-30T22:34:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.611+0000 7fe578b0d700 1 -- 172.21.15.59:0/1719076241 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57409f200 con 0x7fe57406a770 2023-09-30T22:34:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.611+0000 7fe562ffd700 1 -- 172.21.15.59:0/1719076241 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56400ca50 con 0x7fe57406a770 2023-09-30T22:34:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.611+0000 7fe578b0d700 1 -- 172.21.15.59:0/1719076241 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5741288a0 con 0x7fe57406a770 2023-09-30T22:34:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.612+0000 7fe562ffd700 1 -- 172.21.15.59:0/1719076241 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe56400cbb0 con 0x7fe57406a770 2023-09-30T22:34:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.612+0000 7fe578b0d700 1 -- 172.21.15.59:0/1719076241 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe574074ea0 con 0x7fe57406a770 2023-09-30T22:34:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.612+0000 7fe562ffd700 1 -- 172.21.15.59:0/1719076241 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe56403fab0 con 0x7fe57406a770 2023-09-30T22:34:17.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.617+0000 7fe562ffd700 1 -- 172.21.15.59:0/1719076241 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe56401b3b0 con 0x7fe57406a770 2023-09-30T22:34:17.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.647+0000 7f1e06e00700 1 -- 172.21.15.59:0/922783314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e00135bc0 con 0x7f1e00138d80 2023-09-30T22:34:17.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.647+0000 7f1dfd7fa700 1 -- 172.21.15.59:0/922783314 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1df802d350 con 0x7f1e00138d80 2023-09-30T22:34:17.649 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:17.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.650+0000 7f1e06e00700 1 -- 172.21.15.59:0/922783314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e00138d80 msgr2=0x7f1e001342d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.650+0000 7f1e06e00700 1 --2- 172.21.15.59:0/922783314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e00138d80 0x7f1e001342d0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f1e000a2c00 tx=0x7f1df8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.650+0000 7f1e06e00700 1 -- 172.21.15.59:0/922783314 shutdown_connections 2023-09-30T22:34:17.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.650+0000 7f1e06e00700 1 --2- 172.21.15.59:0/922783314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e0009d630 0x7f1e00133850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.650+0000 7f1e06e00700 1 --2- 172.21.15.59:0/922783314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e00138d80 0x7f1e001342d0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.650+0000 7f1e06e00700 1 --2- 172.21.15.59:0/922783314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e000a0a30 0x7f1e00133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.650+0000 7f1e06e00700 1 -- 172.21.15.59:0/922783314 >> 172.21.15.59:0/922783314 conn(0x7f1e000a3050 msgr2=0x7f1e0009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:17.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.650+0000 7f1e06e00700 1 -- 172.21.15.59:0/922783314 shutdown_connections 2023-09-30T22:34:17.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.650+0000 7f1e06e00700 1 -- 172.21.15.59:0/922783314 wait complete. 2023-09-30T22:34:17.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.668+0000 7fb6ef7b1700 1 Processor -- start 2023-09-30T22:34:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.669+0000 7fb6ef7b1700 1 -- start start 2023-09-30T22:34:17.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.669+0000 7fb6ef7b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e806a770 0x7fb6e806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.669+0000 7fb6ef7b1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6e8131d10 0x7fb6e8139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.669+0000 7fb6ef7b1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e809ece0 con 0x7fb6e806b080 2023-09-30T22:34:17.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.669+0000 7fb6ef7b1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e809e760 con 0x7fb6e8131d10 2023-09-30T22:34:17.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.669+0000 7fb6ef7b1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e809e040 con 0x7fb6e806a770 2023-09-30T22:34:17.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.669+0000 7fb6ed54d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e806a770 0x7fb6e806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.669+0000 7fb6ecd4c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb6e806b080 0x7fb6e8131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52722/0 (socket says 172.21.15.59:52722) 2023-09-30T22:34:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.669+0000 7fb6ecd4c700 1 -- 172.21.15.59:0/736170508 learned_addr learned my addr 172.21.15.59:0/736170508 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.669+0000 7fb6ed54d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e806a770 0x7fb6e806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40634/0 (socket says 172.21.15.59:40634) 2023-09-30T22:34:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.669+0000 7fb6edd4e700 1 --2- 172.21.15.59:0/736170508 >> v2:172.21.15.59:3300/0 conn(0x7fb6e8131d10 0x7fb6e8139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.670+0000 7fb6ed54d700 1 -- 172.21.15.59:0/736170508 >> v2:172.21.15.59:3300/0 conn(0x7fb6e8131d10 msgr2=0x7fb6e8139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.670+0000 7fb6ed54d700 1 --2- 172.21.15.59:0/736170508 >> v2:172.21.15.59:3300/0 conn(0x7fb6e8131d10 0x7fb6e8139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.670+0000 7fb6ed54d700 1 -- 172.21.15.59:0/736170508 >> v1:172.21.15.59:6789/0 conn(0x7fb6e806b080 legacy=0x7fb6e8131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.670+0000 7fb6ed54d700 1 -- 172.21.15.59:0/736170508 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e809f630 con 0x7fb6e806a770 2023-09-30T22:34:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.670+0000 7fb6edd4e700 1 --2- 172.21.15.59:0/736170508 >> v2:172.21.15.59:3300/0 conn(0x7fb6e8131d10 0x7fb6e8139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.670+0000 7fb6ed54d700 1 --2- 172.21.15.59:0/736170508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e806a770 0x7fb6e806ab40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009840 tx=0x7fb6e4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=310f519c053120b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.670+0000 7fb6dffff700 1 -- 172.21.15.59:0/736170508 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4011830 con 0x7fb6e806a770 2023-09-30T22:34:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.670+0000 7fb6dffff700 1 -- 172.21.15.59:0/736170508 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e4011990 con 0x7fb6e806a770 2023-09-30T22:34:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.670+0000 7fb6dffff700 1 -- 172.21.15.59:0/736170508 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4011d20 con 0x7fb6e806a770 2023-09-30T22:34:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.671+0000 7fb6ef7b1700 1 -- 172.21.15.59:0/736170508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e806a770 msgr2=0x7fb6e806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.671+0000 7fb6ef7b1700 1 --2- 172.21.15.59:0/736170508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e806a770 0x7fb6e806ab40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009840 tx=0x7fb6e4009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.671+0000 7fb6ef7b1700 1 -- 172.21.15.59:0/736170508 shutdown_connections 2023-09-30T22:34:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.671+0000 7fb6ef7b1700 1 --2- 172.21.15.59:0/736170508 >> v2:172.21.15.59:3300/0 conn(0x7fb6e8131d10 0x7fb6e8139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.671+0000 7fb6ef7b1700 1 --2- 172.21.15.59:0/736170508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e806a770 0x7fb6e806ab40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.671+0000 7fb6ef7b1700 1 -- 172.21.15.59:0/736170508 >> 172.21.15.59:0/736170508 conn(0x7fb6e8066f50 msgr2=0x7fb6e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.671+0000 7fb6ef7b1700 1 -- 172.21.15.59:0/736170508 shutdown_connections 2023-09-30T22:34:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.671+0000 7fb6ef7b1700 1 -- 172.21.15.59:0/736170508 wait complete. 2023-09-30T22:34:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.672+0000 7fb6ef7b1700 1 Processor -- start 2023-09-30T22:34:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.672+0000 7fb6ef7b1700 1 -- start start 2023-09-30T22:34:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.672+0000 7fb6ef7b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e806a770 0x7fb6e81c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.672+0000 7fb6ef7b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e806b080 0x7fb6e81c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.672+0000 7fb6ef7b1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e8131d10 0x7fb6e81c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.672+0000 7fb6ef7b1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e81265a0 con 0x7fb6e8131d10 2023-09-30T22:34:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.672+0000 7fb6ef7b1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e81253f0 con 0x7fb6e806b080 2023-09-30T22:34:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.672+0000 7fb6ef7b1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e8125e70 con 0x7fb6e806a770 2023-09-30T22:34:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.672+0000 7fb6ed54d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e806a770 0x7fb6e81c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.673+0000 7fb6ed54d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e806a770 0x7fb6e81c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40636/0 (socket says 172.21.15.59:40636) 2023-09-30T22:34:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.673+0000 7fb6ed54d700 1 -- 172.21.15.59:0/2464531764 learned_addr learned my addr 172.21.15.59:0/2464531764 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.673+0000 7fb6ed54d700 1 -- 172.21.15.59:0/2464531764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e806b080 msgr2=0x7fb6e81c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.673+0000 7fb6ed54d700 1 --2- 172.21.15.59:0/2464531764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e806b080 0x7fb6e81c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.673+0000 7fb6ed54d700 1 -- 172.21.15.59:0/2464531764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e8131d10 msgr2=0x7fb6e81c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.673+0000 7fb6ed54d700 1 --2- 172.21.15.59:0/2464531764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e8131d10 0x7fb6e81c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.673+0000 7fb6ed54d700 1 -- 172.21.15.59:0/2464531764 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e0009a70 con 0x7fb6e806a770 2023-09-30T22:34:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.673+0000 7fb6ed54d700 1 --2- 172.21.15.59:0/2464531764 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e806a770 0x7fb6e81c8250 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009fd0 tx=0x7fb6e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.673+0000 7fb6ddffb700 1 -- 172.21.15.59:0/2464531764 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e40036a0 con 0x7fb6e806a770 2023-09-30T22:34:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.673+0000 7fb6ddffb700 1 -- 172.21.15.59:0/2464531764 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e401f070 con 0x7fb6e806a770 2023-09-30T22:34:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.673+0000 7fb6ef7b1700 1 -- 172.21.15.59:0/2464531764 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e40094a0 con 0x7fb6e806a770 2023-09-30T22:34:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.673+0000 7fb6ddffb700 1 -- 172.21.15.59:0/2464531764 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4003a60 con 0x7fb6e806a770 2023-09-30T22:34:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.674+0000 7fb6ef7b1700 1 -- 172.21.15.59:0/2464531764 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e8071eb0 con 0x7fb6e806a770 2023-09-30T22:34:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.674+0000 7fb6ddffb700 1 -- 172.21.15.59:0/2464531764 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6e4003bc0 con 0x7fb6e806a770 2023-09-30T22:34:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.675+0000 7fb6ef7b1700 1 -- 172.21.15.59:0/2464531764 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e8126210 con 0x7fb6e806a770 2023-09-30T22:34:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.675+0000 7fb6ddffb700 1 -- 172.21.15.59:0/2464531764 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb6e4021070 con 0x7fb6e806a770 2023-09-30T22:34:17.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.680+0000 7fb6ddffb700 1 -- 172.21.15.59:0/2464531764 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6e4015020 con 0x7fb6e806a770 2023-09-30T22:34:17.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.729+0000 7f691c4a3700 1 -- 172.21.15.59:0/3149083987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f69141a7030 con 0x7f691409e000 2023-09-30T22:34:17.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.730+0000 7f690affd700 1 -- 172.21.15.59:0/3149083987 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6904017070 con 0x7f691409e000 2023-09-30T22:34:17.731 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.732+0000 7f691c4a3700 1 -- 172.21.15.59:0/3149083987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f691409e000 msgr2=0x7f69141a5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.732+0000 7f691c4a3700 1 --2- 172.21.15.59:0/3149083987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f691409e000 0x7f69141a5750 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f690400ebb0 tx=0x7f690400eec0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.732+0000 7f691c4a3700 1 -- 172.21.15.59:0/3149083987 shutdown_connections 2023-09-30T22:34:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.732+0000 7f691c4a3700 1 --2- 172.21.15.59:0/3149083987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f691409d6f0 0x7f69141a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.732+0000 7f691c4a3700 1 --2- 172.21.15.59:0/3149083987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f691409e410 0x7f69141c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.732+0000 7f691c4a3700 1 --2- 172.21.15.59:0/3149083987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f691409e000 0x7f69141a5750 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.732+0000 7f691c4a3700 1 -- 172.21.15.59:0/3149083987 >> 172.21.15.59:0/3149083987 conn(0x7f6914066f50 msgr2=0x7f69141bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.732+0000 7f691c4a3700 1 -- 172.21.15.59:0/3149083987 shutdown_connections 2023-09-30T22:34:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.732+0000 7f691c4a3700 1 -- 172.21.15.59:0/3149083987 wait complete. 2023-09-30T22:34:17.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:17.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.832+0000 7fe578b0d700 1 -- 172.21.15.59:0/1719076241 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe57412a6e0 con 0x7fe57406a770 2023-09-30T22:34:17.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.833+0000 7fe562ffd700 1 -- 172.21.15.59:0/1719076241 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe564017070 con 0x7fe57406a770 2023-09-30T22:34:17.834 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:17.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.835+0000 7fe578b0d700 1 -- 172.21.15.59:0/1719076241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe57406a770 msgr2=0x7fe574127e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.835+0000 7fe578b0d700 1 --2- 172.21.15.59:0/1719076241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe57406a770 0x7fe574127e20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe56400e9b0 tx=0x7fe56400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.835+0000 7fe578b0d700 1 -- 172.21.15.59:0/1719076241 shutdown_connections 2023-09-30T22:34:17.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.835+0000 7fe578b0d700 1 --2- 172.21.15.59:0/1719076241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe57406a770 0x7fe574127e20 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.835+0000 7fe578b0d700 1 --2- 172.21.15.59:0/1719076241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe57413c1e0 0x7fe5741cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.835+0000 7fe578b0d700 1 --2- 172.21.15.59:0/1719076241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57409dc30 0x7fe574128360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.835+0000 7fe578b0d700 1 -- 172.21.15.59:0/1719076241 >> 172.21.15.59:0/1719076241 conn(0x7fe574066f50 msgr2=0x7fe5740a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:17.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.835+0000 7fe578b0d700 1 -- 172.21.15.59:0/1719076241 shutdown_connections 2023-09-30T22:34:17.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.835+0000 7fe578b0d700 1 -- 172.21.15.59:0/1719076241 wait complete. 2023-09-30T22:34:17.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:17.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.892+0000 7fb6ef7b1700 1 -- 172.21.15.59:0/2464531764 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb6e8074ea0 con 0x7fb6e806a770 2023-09-30T22:34:17.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.892+0000 7fb6ddffb700 1 -- 172.21.15.59:0/2464531764 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6e40257f0 con 0x7fb6e806a770 2023-09-30T22:34:17.893 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.894+0000 7fb6ef7b1700 1 -- 172.21.15.59:0/2464531764 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e806a770 msgr2=0x7fb6e81c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.894+0000 7fb6ef7b1700 1 --2- 172.21.15.59:0/2464531764 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e806a770 0x7fb6e81c8250 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009fd0 tx=0x7fb6e4004750 comp rx=0 tx=0).stop 2023-09-30T22:34:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.895+0000 7fb6ef7b1700 1 -- 172.21.15.59:0/2464531764 shutdown_connections 2023-09-30T22:34:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.895+0000 7fb6ef7b1700 1 --2- 172.21.15.59:0/2464531764 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e806a770 0x7fb6e81c8250 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.895+0000 7fb6ef7b1700 1 --2- 172.21.15.59:0/2464531764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e8131d10 0x7fb6e81c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.895+0000 7fb6ef7b1700 1 --2- 172.21.15.59:0/2464531764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e806b080 0x7fb6e81c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.895+0000 7fb6ef7b1700 1 -- 172.21.15.59:0/2464531764 >> 172.21.15.59:0/2464531764 conn(0x7fb6e8066f50 msgr2=0x7fb6e80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.895+0000 7fb6ef7b1700 1 -- 172.21.15.59:0/2464531764 shutdown_connections 2023-09-30T22:34:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:17.895+0000 7fb6ef7b1700 1 -- 172.21.15.59:0/2464531764 wait complete. 2023-09-30T22:34:17.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:18.669 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:18.749 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:18.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.816+0000 7f1477349700 1 Processor -- start 2023-09-30T22:34:18.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.817+0000 7f1477349700 1 -- start start 2023-09-30T22:34:18.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.817+0000 7f1477349700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f147009d630 0x7f14700a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:18.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.817+0000 7f1477349700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1470138d80 0x7f147013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:18.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.817+0000 7f1477349700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14700a2a70 con 0x7f14700a0a30 2023-09-30T22:34:18.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.817+0000 7f1477349700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14700a01d0 con 0x7f1470138d80 2023-09-30T22:34:18.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.817+0000 7f1477349700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f147009e2b0 con 0x7f147009d630 2023-09-30T22:34:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.817+0000 7f14758e6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1470138d80 0x7f147013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.817+0000 7f14748e4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f147009d630 0x7f14700a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.817+0000 7f14750e5700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f14700a0a30 0x7f14700a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52728/0 (socket says 172.21.15.59:52728) 2023-09-30T22:34:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.817+0000 7f14748e4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f147009d630 0x7f14700a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40646/0 (socket says 172.21.15.59:40646) 2023-09-30T22:34:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.817+0000 7f14750e5700 1 -- 172.21.15.59:0/1325226788 learned_addr learned my addr 172.21.15.59:0/1325226788 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.817+0000 7f14758e6700 1 --2- 172.21.15.59:0/1325226788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1470138d80 0x7f147013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58178/0 (socket says 172.21.15.59:58178) 2023-09-30T22:34:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.818+0000 7f1467fff700 1 -- 172.21.15.59:0/1325226788 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735071991 0 0) 0x7f14700a2a70 con 0x7f14700a0a30 2023-09-30T22:34:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.818+0000 7f14748e4700 1 -- 172.21.15.59:0/1325226788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1470138d80 msgr2=0x7f147013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.818+0000 7f14748e4700 1 --2- 172.21.15.59:0/1325226788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1470138d80 0x7f147013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.818+0000 7f14748e4700 1 -- 172.21.15.59:0/1325226788 >> v1:172.21.15.59:6789/0 conn(0x7f14700a0a30 legacy=0x7f14700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.818+0000 7f14748e4700 1 -- 172.21.15.59:0/1325226788 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147009dc50 con 0x7f147009d630 2023-09-30T22:34:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.818+0000 7f14758e6700 1 --2- 172.21.15.59:0/1325226788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1470138d80 0x7f147013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.818+0000 7f14748e4700 1 --2- 172.21.15.59:0/1325226788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f147009d630 0x7f14700a1510 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1460009870 tx=0x7f1460009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1726980d712457f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.818+0000 7f1467fff700 1 -- 172.21.15.59:0/1325226788 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460011830 con 0x7f147009d630 2023-09-30T22:34:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.818+0000 7f1467fff700 1 -- 172.21.15.59:0/1325226788 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1460011990 con 0x7f147009d630 2023-09-30T22:34:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.818+0000 7f1467fff700 1 -- 172.21.15.59:0/1325226788 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460011d20 con 0x7f147009d630 2023-09-30T22:34:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.819+0000 7f1477349700 1 -- 172.21.15.59:0/1325226788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f147009d630 msgr2=0x7f14700a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.819+0000 7f1477349700 1 --2- 172.21.15.59:0/1325226788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f147009d630 0x7f14700a1510 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1460009870 tx=0x7f1460009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.819+0000 7f1477349700 1 -- 172.21.15.59:0/1325226788 shutdown_connections 2023-09-30T22:34:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.819+0000 7f1477349700 1 --2- 172.21.15.59:0/1325226788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1470138d80 0x7f147013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.819+0000 7f1477349700 1 --2- 172.21.15.59:0/1325226788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f147009d630 0x7f14700a1510 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.819+0000 7f1477349700 1 -- 172.21.15.59:0/1325226788 >> 172.21.15.59:0/1325226788 conn(0x7f14700a3050 msgr2=0x7f14700a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:18.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.819+0000 7f1477349700 1 -- 172.21.15.59:0/1325226788 shutdown_connections 2023-09-30T22:34:18.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.819+0000 7f1477349700 1 -- 172.21.15.59:0/1325226788 wait complete. 2023-09-30T22:34:18.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.820+0000 7f1477349700 1 Processor -- start 2023-09-30T22:34:18.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.820+0000 7f1477349700 1 -- start start 2023-09-30T22:34:18.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.820+0000 7f1477349700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f147009d630 0x7f14701337c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:18.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.820+0000 7f1477349700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14700a0a30 0x7f1470133d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:18.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.820+0000 7f1477349700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1470138d80 0x7f1470134240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:18.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.820+0000 7f1477349700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1470134c90 con 0x7f147009d630 2023-09-30T22:34:18.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.820+0000 7f1477349700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1470137310 con 0x7f1470138d80 2023-09-30T22:34:18.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.820+0000 7f1477349700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1470136c60 con 0x7f14700a0a30 2023-09-30T22:34:18.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f14750e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f147009d630 0x7f14701337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:18.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f14748e4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14700a0a30 0x7f1470133d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f14750e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f147009d630 0x7f14701337c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56772/0 (socket says 172.21.15.59:56772) 2023-09-30T22:34:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f14750e5700 1 -- 172.21.15.59:0/705708492 learned_addr learned my addr 172.21.15.59:0/705708492 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f14758e6700 1 --2- 172.21.15.59:0/705708492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1470138d80 0x7f1470134240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f14758e6700 1 -- 172.21.15.59:0/705708492 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14700a0a30 msgr2=0x7f1470133d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f14758e6700 1 --2- 172.21.15.59:0/705708492 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14700a0a30 0x7f1470133d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f14758e6700 1 -- 172.21.15.59:0/705708492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f147009d630 msgr2=0x7f14701337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f14758e6700 1 --2- 172.21.15.59:0/705708492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f147009d630 0x7f14701337c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f14758e6700 1 -- 172.21.15.59:0/705708492 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1468009a70 con 0x7f1470138d80 2023-09-30T22:34:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f14750e5700 1 --2- 172.21.15.59:0/705708492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f147009d630 0x7f14701337c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f14758e6700 1 --2- 172.21.15.59:0/705708492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1470138d80 0x7f1470134240 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f14700a23a0 tx=0x7f146800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f1465ffb700 1 -- 172.21.15.59:0/705708492 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468003a20 con 0x7f1470138d80 2023-09-30T22:34:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f1465ffb700 1 -- 172.21.15.59:0/705708492 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146800f040 con 0x7f1470138d80 2023-09-30T22:34:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f1465ffb700 1 -- 172.21.15.59:0/705708492 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468003dc0 con 0x7f1470138d80 2023-09-30T22:34:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.821+0000 7f1477349700 1 -- 172.21.15.59:0/705708492 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14600094a0 con 0x7f1470138d80 2023-09-30T22:34:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.822+0000 7f1477349700 1 -- 172.21.15.59:0/705708492 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1470136f20 con 0x7f1470138d80 2023-09-30T22:34:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.822+0000 7f1465ffb700 1 -- 172.21.15.59:0/705708492 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f146800ca20 con 0x7f1470138d80 2023-09-30T22:34:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.822+0000 7f1465ffb700 1 -- 172.21.15.59:0/705708492 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f146803fe70 con 0x7f1470138d80 2023-09-30T22:34:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.823+0000 7f1477349700 1 -- 172.21.15.59:0/705708492 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14700747f0 con 0x7f1470138d80 2023-09-30T22:34:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.832+0000 7f1465ffb700 1 -- 172.21.15.59:0/705708492 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f146801b360 con 0x7f1470138d80 2023-09-30T22:34:18.851 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:18.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.895+0000 7f9f8cd05700 1 Processor -- start 2023-09-30T22:34:18.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.895+0000 7f9f8cd05700 1 -- start start 2023-09-30T22:34:18.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.896+0000 7f9f8cd05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8812cf60 0x7f9f8806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:18.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.896+0000 7f9f8cd05700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f8812f8b0 0x7f9f8812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:18.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.896+0000 7f9f8cd05700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8812cd90 con 0x7f9f88130260 2023-09-30T22:34:18.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.896+0000 7f9f8cd05700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8812d330 con 0x7f9f8812cf60 2023-09-30T22:34:18.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.896+0000 7f9f8cd05700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f881306d0 con 0x7f9f8812f8b0 2023-09-30T22:34:18.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.896+0000 7f9f7dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f8812f8b0 0x7f9f8812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:18.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.896+0000 7f9f7dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f8812f8b0 0x7f9f8812fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40666/0 (socket says 172.21.15.59:40666) 2023-09-30T22:34:18.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.896+0000 7f9f7dd9b700 1 -- 172.21.15.59:0/2481827672 learned_addr learned my addr 172.21.15.59:0/2481827672 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:18.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.896+0000 7f9f8659c700 1 --2- 172.21.15.59:0/2481827672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8812cf60 0x7f9f8806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:18.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.896+0000 7f9f85d9b700 1 -- 172.21.15.59:0/2481827672 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564172707 0 0) 0x7f9f8812cd90 con 0x7f9f88130260 2023-09-30T22:34:18.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.896+0000 7f9f8659c700 1 -- 172.21.15.59:0/2481827672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f8812f8b0 msgr2=0x7f9f8812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:18.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.896+0000 7f9f8659c700 1 --2- 172.21.15.59:0/2481827672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f8812f8b0 0x7f9f8812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:18.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.897+0000 7f9f8659c700 1 -- 172.21.15.59:0/2481827672 >> v1:172.21.15.59:6789/0 conn(0x7f9f88130260 legacy=0x7f9f88136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:18.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.897+0000 7f9f8659c700 1 -- 172.21.15.59:0/2481827672 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f88071780 con 0x7f9f8812cf60 2023-09-30T22:34:18.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.897+0000 7f9f7dd9b700 1 --2- 172.21.15.59:0/2481827672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f8812f8b0 0x7f9f8812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:18.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.897+0000 7f9f8659c700 1 --2- 172.21.15.59:0/2481827672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8812cf60 0x7f9f8806f5d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009870 tx=0x7f9f78009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67236469ec9ef6ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:18.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.897+0000 7f9f85d9b700 1 -- 172.21.15.59:0/2481827672 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f78011830 con 0x7f9f8812cf60 2023-09-30T22:34:18.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.897+0000 7f9f85d9b700 1 -- 172.21.15.59:0/2481827672 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f78011990 con 0x7f9f8812cf60 2023-09-30T22:34:18.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.897+0000 7f9f85d9b700 1 -- 172.21.15.59:0/2481827672 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f78011d20 con 0x7f9f8812cf60 2023-09-30T22:34:18.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.898+0000 7f9f8cd05700 1 -- 172.21.15.59:0/2481827672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8812cf60 msgr2=0x7f9f8806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:18.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.898+0000 7f9f8cd05700 1 --2- 172.21.15.59:0/2481827672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8812cf60 0x7f9f8806f5d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009870 tx=0x7f9f78009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:18.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.898+0000 7f9f8cd05700 1 -- 172.21.15.59:0/2481827672 shutdown_connections 2023-09-30T22:34:18.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.898+0000 7f9f8cd05700 1 --2- 172.21.15.59:0/2481827672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8812cf60 0x7f9f8806f5d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:18.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.898+0000 7f9f8cd05700 1 --2- 172.21.15.59:0/2481827672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f8812f8b0 0x7f9f8812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:18.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.898+0000 7f9f8cd05700 1 -- 172.21.15.59:0/2481827672 >> 172.21.15.59:0/2481827672 conn(0x7f9f880a2aa0 msgr2=0x7f9f880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:18.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.898+0000 7f9f8cd05700 1 -- 172.21.15.59:0/2481827672 shutdown_connections 2023-09-30T22:34:18.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.898+0000 7f9f8cd05700 1 -- 172.21.15.59:0/2481827672 wait complete. 2023-09-30T22:34:18.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.899+0000 7f9f8cd05700 1 Processor -- start 2023-09-30T22:34:18.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.899+0000 7f9f8cd05700 1 -- start start 2023-09-30T22:34:18.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f8cd05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8812cf60 0x7f9f8813a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:18.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f8cd05700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f8812f8b0 0x7f9f8813a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:18.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f8cd05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f88130260 0x7f9f8813aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:18.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f8cd05700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f88135170 con 0x7f9f88130260 2023-09-30T22:34:18.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f8cd05700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f88135350 con 0x7f9f8812cf60 2023-09-30T22:34:18.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f8cd05700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8809e7f0 con 0x7f9f8812f8b0 2023-09-30T22:34:18.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f8659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8812cf60 0x7f9f8813a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:18.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f8659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8812cf60 0x7f9f8813a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58210/0 (socket says 172.21.15.59:58210) 2023-09-30T22:34:18.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f8659c700 1 -- 172.21.15.59:0/478671107 learned_addr learned my addr 172.21.15.59:0/478671107 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:18.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f7dd9b700 1 --2- 172.21.15.59:0/478671107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f8812f8b0 0x7f9f8813a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:18.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f86d9d700 1 --2- 172.21.15.59:0/478671107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f88130260 0x7f9f8813aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:18.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f8659c700 1 -- 172.21.15.59:0/478671107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f8812f8b0 msgr2=0x7f9f8813a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:18.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f8659c700 1 --2- 172.21.15.59:0/478671107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f8812f8b0 0x7f9f8813a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:18.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f8659c700 1 -- 172.21.15.59:0/478671107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f88130260 msgr2=0x7f9f8813aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:18.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f8659c700 1 --2- 172.21.15.59:0/478671107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f88130260 0x7f9f8813aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:18.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f8659c700 1 -- 172.21.15.59:0/478671107 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f70009550 con 0x7f9f8812cf60 2023-09-30T22:34:18.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.900+0000 7f9f86d9d700 1 --2- 172.21.15.59:0/478671107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f88130260 0x7f9f8813aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:18.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.901+0000 7f9f8659c700 1 --2- 172.21.15.59:0/478671107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8812cf60 0x7f9f8813a460 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009bc0 tx=0x7f9f78004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:18.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.901+0000 7f9f7f7fe700 1 -- 172.21.15.59:0/478671107 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f78004550 con 0x7f9f8812cf60 2023-09-30T22:34:18.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.901+0000 7f9f7f7fe700 1 -- 172.21.15.59:0/478671107 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7801f070 con 0x7f9f8812cf60 2023-09-30T22:34:18.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.901+0000 7f9f8cd05700 1 -- 172.21.15.59:0/478671107 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f780094a0 con 0x7f9f8812cf60 2023-09-30T22:34:18.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.901+0000 7f9f7f7fe700 1 -- 172.21.15.59:0/478671107 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f780038e0 con 0x7f9f8812cf60 2023-09-30T22:34:18.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.901+0000 7f9f8cd05700 1 -- 172.21.15.59:0/478671107 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8813c300 con 0x7f9f8812cf60 2023-09-30T22:34:18.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.902+0000 7f9f8cd05700 1 -- 172.21.15.59:0/478671107 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f88074ea0 con 0x7f9f8812cf60 2023-09-30T22:34:18.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.902+0000 7f9f7f7fe700 1 -- 172.21.15.59:0/478671107 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f78003a40 con 0x7f9f8812cf60 2023-09-30T22:34:18.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.903+0000 7f9f7f7fe700 1 -- 172.21.15.59:0/478671107 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9f78021070 con 0x7f9f8812cf60 2023-09-30T22:34:18.910 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:18.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.912+0000 7f9f7f7fe700 1 -- 172.21.15.59:0/478671107 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f78010380 con 0x7f9f8812cf60 2023-09-30T22:34:18.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.996+0000 7f03e356c700 1 Processor -- start 2023-09-30T22:34:18.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.996+0000 7f03e356c700 1 -- start start 2023-09-30T22:34:18.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.996+0000 7f03e356c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03dc09e1d0 0x7f03dc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:18.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.996+0000 7f03e356c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03dc139170 0x7f03dc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:18.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.996+0000 7f03e356c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc09b120 con 0x7f03dc09d6f0 2023-09-30T22:34:18.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.996+0000 7f03e356c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc06b460 con 0x7f03dc139170 2023-09-30T22:34:18.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.996+0000 7f03e356c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc09a7e0 con 0x7f03dc09e1d0 2023-09-30T22:34:18.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.997+0000 7f03e1b09700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03dc139170 0x7f03dc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:18.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.997+0000 7f03e0b07700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03dc09e1d0 0x7f03dc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:18.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.997+0000 7f03e0b07700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03dc09e1d0 0x7f03dc138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40678/0 (socket says 172.21.15.59:40678) 2023-09-30T22:34:18.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.997+0000 7f03e1b09700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03dc139170 0x7f03dc13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58218/0 (socket says 172.21.15.59:58218) 2023-09-30T22:34:18.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.997+0000 7f03e0b07700 1 -- 172.21.15.59:0/4083978704 learned_addr learned my addr 172.21.15.59:0/4083978704 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:18.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.997+0000 7f03e1b09700 1 -- 172.21.15.59:0/4083978704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03dc09e1d0 msgr2=0x7f03dc138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:18.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.997+0000 7f03e1b09700 1 --2- 172.21.15.59:0/4083978704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03dc09e1d0 0x7f03dc138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:18.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.997+0000 7f03e1b09700 1 -- 172.21.15.59:0/4083978704 >> v1:172.21.15.59:6789/0 conn(0x7f03dc09d6f0 legacy=0x7f03dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:18.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.997+0000 7f03d3fff700 1 -- 172.21.15.59:0/4083978704 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026675345 0 0) 0x7f03dc09b120 con 0x7f03dc09d6f0 2023-09-30T22:34:19.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.997+0000 7f03e1b09700 1 -- 172.21.15.59:0/4083978704 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc09a500 con 0x7f03dc139170 2023-09-30T22:34:19.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.997+0000 7f03e1b09700 1 --2- 172.21.15.59:0/4083978704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03dc139170 0x7f03dc13b550 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009dc0 tx=0x7f03d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=290623587fdd2e76 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:19.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.998+0000 7f03d3fff700 1 -- 172.21.15.59:0/4083978704 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400e070 con 0x7f03dc139170 2023-09-30T22:34:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.998+0000 7f03d3fff700 1 -- 172.21.15.59:0/4083978704 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d400bb20 con 0x7f03dc139170 2023-09-30T22:34:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.998+0000 7f03d3fff700 1 -- 172.21.15.59:0/4083978704 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d4012430 con 0x7f03dc139170 2023-09-30T22:34:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.999+0000 7f03e356c700 1 -- 172.21.15.59:0/4083978704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03dc139170 msgr2=0x7f03dc13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.999+0000 7f03e356c700 1 --2- 172.21.15.59:0/4083978704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03dc139170 0x7f03dc13b550 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009dc0 tx=0x7f03d400b330 comp rx=0 tx=0).stop 2023-09-30T22:34:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.999+0000 7f03e356c700 1 -- 172.21.15.59:0/4083978704 shutdown_connections 2023-09-30T22:34:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.999+0000 7f03e356c700 1 --2- 172.21.15.59:0/4083978704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03dc139170 0x7f03dc13b550 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.999+0000 7f03e356c700 1 --2- 172.21.15.59:0/4083978704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03dc09e1d0 0x7f03dc138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.999+0000 7f03e356c700 1 -- 172.21.15.59:0/4083978704 >> 172.21.15.59:0/4083978704 conn(0x7f03dc066f50 msgr2=0x7f03dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.999+0000 7f03e356c700 1 -- 172.21.15.59:0/4083978704 shutdown_connections 2023-09-30T22:34:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:18.999+0000 7f03e356c700 1 -- 172.21.15.59:0/4083978704 wait complete. 2023-09-30T22:34:19.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.000+0000 7f03e356c700 1 Processor -- start 2023-09-30T22:34:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.000+0000 7f03e356c700 1 -- start start 2023-09-30T22:34:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.001+0000 7f03e356c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03dc09d6f0 0x7f03dc1c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.001+0000 7f03e356c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03dc09e1d0 0x7f03dc1c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.001+0000 7f03e356c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03dc139170 0x7f03dc1c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.001+0000 7f03e356c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc124580 con 0x7f03dc139170 2023-09-30T22:34:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.001+0000 7f03e356c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc122710 con 0x7f03dc09e1d0 2023-09-30T22:34:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.001+0000 7f03e356c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc071eb0 con 0x7f03dc09d6f0 2023-09-30T22:34:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.001+0000 7f03e1b09700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03dc139170 0x7f03dc1c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.001+0000 7f03e1b09700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03dc139170 0x7f03dc1c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56788/0 (socket says 172.21.15.59:56788) 2023-09-30T22:34:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.001+0000 7f03e1b09700 1 -- 172.21.15.59:0/444010001 learned_addr learned my addr 172.21.15.59:0/444010001 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.001+0000 7f03e1308700 1 --2- 172.21.15.59:0/444010001 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03dc09d6f0 0x7f03dc1c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.001+0000 7f03e0b07700 1 --2- 172.21.15.59:0/444010001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03dc09e1d0 0x7f03dc1c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.002+0000 7f03e1b09700 1 -- 172.21.15.59:0/444010001 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03dc09d6f0 msgr2=0x7f03dc1c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.002+0000 7f03e1b09700 1 --2- 172.21.15.59:0/444010001 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03dc09d6f0 0x7f03dc1c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.002+0000 7f03e1b09700 1 -- 172.21.15.59:0/444010001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03dc09e1d0 msgr2=0x7f03dc1c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.002+0000 7f03e1b09700 1 --2- 172.21.15.59:0/444010001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03dc09e1d0 0x7f03dc1c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.002+0000 7f03e1b09700 1 -- 172.21.15.59:0/444010001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d4009a70 con 0x7f03dc139170 2023-09-30T22:34:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.002+0000 7f03e0b07700 1 --2- 172.21.15.59:0/444010001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03dc09e1d0 0x7f03dc1c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.002+0000 7f03e1308700 1 --2- 172.21.15.59:0/444010001 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03dc09d6f0 0x7f03dc1c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.002+0000 7f03e1b09700 1 --2- 172.21.15.59:0/444010001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03dc139170 0x7f03dc1c8ee0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f03d4014040 tx=0x7f03d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.002+0000 7f03d1ffb700 1 -- 172.21.15.59:0/444010001 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d401b810 con 0x7f03dc139170 2023-09-30T22:34:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.002+0000 7f03d1ffb700 1 -- 172.21.15.59:0/444010001 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d4020070 con 0x7f03dc139170 2023-09-30T22:34:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.002+0000 7f03d1ffb700 1 -- 172.21.15.59:0/444010001 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d401bbd0 con 0x7f03dc139170 2023-09-30T22:34:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.002+0000 7f03e356c700 1 -- 172.21.15.59:0/444010001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc09c710 con 0x7f03dc139170 2023-09-30T22:34:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.003+0000 7f03e356c700 1 -- 172.21.15.59:0/444010001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc124cf0 con 0x7f03dc139170 2023-09-30T22:34:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.004+0000 7f03d1ffb700 1 -- 172.21.15.59:0/444010001 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03d401bd30 con 0x7f03dc139170 2023-09-30T22:34:19.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.004+0000 7f03e356c700 1 -- 172.21.15.59:0/444010001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc1241c0 con 0x7f03dc139170 2023-09-30T22:34:19.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.004+0000 7f03d1ffb700 1 -- 172.21.15.59:0/444010001 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f03d4022070 con 0x7f03dc139170 2023-09-30T22:34:19.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.009+0000 7f03d1ffb700 1 -- 172.21.15.59:0/444010001 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03d4024330 con 0x7f03dc139170 2023-09-30T22:34:19.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.050+0000 7f2730736700 1 Processor -- start 2023-09-30T22:34:19.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.051+0000 7f2730736700 1 -- start start 2023-09-30T22:34:19.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.051+0000 7f2730736700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272809d6f0 0x7f272809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.051+0000 7f2730736700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f272809e000 0x7f27281339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.051+0000 7f2730736700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272809b120 con 0x7f272809e410 2023-09-30T22:34:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.051+0000 7f2730736700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272806b460 con 0x7f272809e000 2023-09-30T22:34:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.051+0000 7f2730736700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f272809a7e0 con 0x7f272809d6f0 2023-09-30T22:34:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.052+0000 7f272ecd3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f272809e410 0x7f2728133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52764/0 (socket says 172.21.15.59:52764) 2023-09-30T22:34:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.052+0000 7f272ecd3700 1 -- 172.21.15.59:0/4057218681 learned_addr learned my addr 172.21.15.59:0/4057218681 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.052+0000 7f272dcd1700 1 --2- 172.21.15.59:0/4057218681 >> v2:172.21.15.59:3300/0 conn(0x7f272809e000 0x7f27281339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.052+0000 7f272e4d2700 1 --2- 172.21.15.59:0/4057218681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272809d6f0 0x7f272809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:19.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.052+0000 7f272dcd1700 1 -- 172.21.15.59:0/4057218681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272809d6f0 msgr2=0x7f272809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:19.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.052+0000 7f272dcd1700 1 --2- 172.21.15.59:0/4057218681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272809d6f0 0x7f272809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.052+0000 7f272dcd1700 1 -- 172.21.15.59:0/4057218681 >> v1:172.21.15.59:6789/0 conn(0x7f272809e410 legacy=0x7f2728133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:19.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.052+0000 7f272dcd1700 1 -- 172.21.15.59:0/4057218681 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272809a500 con 0x7f272809e000 2023-09-30T22:34:19.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.053+0000 7f272dcd1700 1 --2- 172.21.15.59:0/4057218681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272809e000 0x7f27281339f0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f2718009840 tx=0x7f2718009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae187628d78d6c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:19.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.053+0000 7f272d4d0700 1 -- 172.21.15.59:0/4057218681 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718004230 con 0x7f272809e000 2023-09-30T22:34:19.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.053+0000 7f272d4d0700 1 -- 172.21.15.59:0/4057218681 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2718004390 con 0x7f272809e000 2023-09-30T22:34:19.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.053+0000 7f272d4d0700 1 -- 172.21.15.59:0/4057218681 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27180036a0 con 0x7f272809e000 2023-09-30T22:34:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.054+0000 7f2730736700 1 -- 172.21.15.59:0/4057218681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272809e000 msgr2=0x7f27281339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.054+0000 7f2730736700 1 --2- 172.21.15.59:0/4057218681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272809e000 0x7f27281339f0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f2718009840 tx=0x7f2718009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.054+0000 7f2730736700 1 -- 172.21.15.59:0/4057218681 shutdown_connections 2023-09-30T22:34:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.054+0000 7f2730736700 1 --2- 172.21.15.59:0/4057218681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272809d6f0 0x7f272809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.054+0000 7f2730736700 1 --2- 172.21.15.59:0/4057218681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272809e000 0x7f27281339f0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.054+0000 7f2730736700 1 -- 172.21.15.59:0/4057218681 >> 172.21.15.59:0/4057218681 conn(0x7f2728066f50 msgr2=0x7f272809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.054+0000 7f2730736700 1 -- 172.21.15.59:0/4057218681 shutdown_connections 2023-09-30T22:34:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.054+0000 7f2730736700 1 -- 172.21.15.59:0/4057218681 wait complete. 2023-09-30T22:34:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.055+0000 7f2730736700 1 Processor -- start 2023-09-30T22:34:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.055+0000 7f1477349700 1 -- 172.21.15.59:0/705708492 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f14701365b0 con 0x7f1470138d80 2023-09-30T22:34:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.055+0000 7f2730736700 1 -- start start 2023-09-30T22:34:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.056+0000 7f1465ffb700 1 -- 172.21.15.59:0/705708492 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f146802b090 con 0x7f1470138d80 2023-09-30T22:34:19.058 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:19.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.056+0000 7f2730736700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272809d6f0 0x7f27281a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:19.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.056+0000 7f2730736700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272809e000 0x7f27281a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:19.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.056+0000 7f2730736700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272809e410 0x7f27281a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:19.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.056+0000 7f2730736700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27281a7a40 con 0x7f272809e000 2023-09-30T22:34:19.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.056+0000 7f2730736700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272809c710 con 0x7f272809d6f0 2023-09-30T22:34:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.056+0000 7f2730736700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27281a9670 con 0x7f272809e410 2023-09-30T22:34:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.056+0000 7f272e4d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272809d6f0 0x7f27281a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.056+0000 7f272e4d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272809d6f0 0x7f27281a5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58240/0 (socket says 172.21.15.59:58240) 2023-09-30T22:34:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.056+0000 7f272e4d2700 1 -- 172.21.15.59:0/1348340905 learned_addr learned my addr 172.21.15.59:0/1348340905 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.057+0000 7f272ecd3700 1 --2- 172.21.15.59:0/1348340905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272809e410 0x7f27281a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.057+0000 7f272dcd1700 1 --2- 172.21.15.59:0/1348340905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272809e000 0x7f27281a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.057+0000 7f272e4d2700 1 -- 172.21.15.59:0/1348340905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272809e410 msgr2=0x7f27281a69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.057+0000 7f272e4d2700 1 --2- 172.21.15.59:0/1348340905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272809e410 0x7f27281a69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.057+0000 7f272e4d2700 1 -- 172.21.15.59:0/1348340905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272809e000 msgr2=0x7f27281a6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:19.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.057+0000 7f272e4d2700 1 --2- 172.21.15.59:0/1348340905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272809e000 0x7f27281a6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.057+0000 7f272e4d2700 1 -- 172.21.15.59:0/1348340905 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27180094a0 con 0x7f272809d6f0 2023-09-30T22:34:19.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.057+0000 7f272e4d2700 1 --2- 172.21.15.59:0/1348340905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272809d6f0 0x7f27281a5f30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f272400e9b0 tx=0x7f272400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:19.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.057+0000 7f271effd700 1 -- 172.21.15.59:0/1348340905 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272400ee50 con 0x7f272809d6f0 2023-09-30T22:34:19.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.057+0000 7f271effd700 1 -- 172.21.15.59:0/1348340905 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2724017c60 con 0x7f272809d6f0 2023-09-30T22:34:19.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.057+0000 7f271effd700 1 -- 172.21.15.59:0/1348340905 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272400c640 con 0x7f272809d6f0 2023-09-30T22:34:19.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.057+0000 7f2730736700 1 -- 172.21.15.59:0/1348340905 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27280a31f0 con 0x7f272809d6f0 2023-09-30T22:34:19.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.057+0000 7f2730736700 1 -- 172.21.15.59:0/1348340905 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27281a90e0 con 0x7f272809d6f0 2023-09-30T22:34:19.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.059+0000 7f2730736700 1 -- 172.21.15.59:0/1348340905 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2728074ea0 con 0x7f272809d6f0 2023-09-30T22:34:19.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.059+0000 7f1477349700 1 -- 172.21.15.59:0/705708492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1470138d80 msgr2=0x7f1470134240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:19.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.059+0000 7f1477349700 1 --2- 172.21.15.59:0/705708492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1470138d80 0x7f1470134240 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f14700a23a0 tx=0x7f146800ef90 comp rx=0 tx=0).stop 2023-09-30T22:34:19.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.059+0000 7f271effd700 1 -- 172.21.15.59:0/1348340905 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f272400c7a0 con 0x7f272809d6f0 2023-09-30T22:34:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.060+0000 7f1477349700 1 -- 172.21.15.59:0/705708492 shutdown_connections 2023-09-30T22:34:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.060+0000 7f1477349700 1 --2- 172.21.15.59:0/705708492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1470138d80 0x7f1470134240 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.060+0000 7f1477349700 1 --2- 172.21.15.59:0/705708492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f147009d630 0x7f14701337c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.060+0000 7f1477349700 1 --2- 172.21.15.59:0/705708492 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14700a0a30 0x7f1470133d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.060+0000 7f1477349700 1 -- 172.21.15.59:0/705708492 >> 172.21.15.59:0/705708492 conn(0x7f14700a3050 msgr2=0x7f147009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:19.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.060+0000 7f271effd700 1 -- 172.21.15.59:0/1348340905 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2724047a40 con 0x7f272809d6f0 2023-09-30T22:34:19.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.060+0000 7f1477349700 1 -- 172.21.15.59:0/705708492 shutdown_connections 2023-09-30T22:34:19.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.060+0000 7f1477349700 1 -- 172.21.15.59:0/705708492 wait complete. 2023-09-30T22:34:19.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.064+0000 7f271effd700 1 -- 172.21.15.59:0/1348340905 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f272400ca50 con 0x7f272809d6f0 2023-09-30T22:34:19.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:19.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.135+0000 7f9f8cd05700 1 -- 172.21.15.59:0/478671107 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9f880713a0 con 0x7f9f8812cf60 2023-09-30T22:34:19.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.135+0000 7f9f7f7fe700 1 -- 172.21.15.59:0/478671107 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f78015020 con 0x7f9f8812cf60 2023-09-30T22:34:19.137 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:19.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.139+0000 7f9f8cd05700 1 -- 172.21.15.59:0/478671107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8812cf60 msgr2=0x7f9f8813a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:19.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.139+0000 7f9f8cd05700 1 --2- 172.21.15.59:0/478671107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8812cf60 0x7f9f8813a460 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009bc0 tx=0x7f9f78004750 comp rx=0 tx=0).stop 2023-09-30T22:34:19.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.139+0000 7f9f8cd05700 1 -- 172.21.15.59:0/478671107 shutdown_connections 2023-09-30T22:34:19.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.139+0000 7f9f8cd05700 1 --2- 172.21.15.59:0/478671107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f88130260 0x7f9f8813aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.139+0000 7f9f8cd05700 1 --2- 172.21.15.59:0/478671107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8812cf60 0x7f9f8813a460 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.139+0000 7f9f8cd05700 1 --2- 172.21.15.59:0/478671107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f8812f8b0 0x7f9f8813a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.139+0000 7f9f8cd05700 1 -- 172.21.15.59:0/478671107 >> 172.21.15.59:0/478671107 conn(0x7f9f880a2aa0 msgr2=0x7f9f8806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:19.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.139+0000 7f9f8cd05700 1 -- 172.21.15.59:0/478671107 shutdown_connections 2023-09-30T22:34:19.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.139+0000 7f9f8cd05700 1 -- 172.21.15.59:0/478671107 wait complete. 2023-09-30T22:34:19.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:19.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.230+0000 7f03e356c700 1 -- 172.21.15.59:0/444010001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f03dc074ea0 con 0x7f03dc139170 2023-09-30T22:34:19.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.230+0000 7f03d1ffb700 1 -- 172.21.15.59:0/444010001 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03d402c070 con 0x7f03dc139170 2023-09-30T22:34:19.231 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:19.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.232+0000 7f03e356c700 1 -- 172.21.15.59:0/444010001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03dc139170 msgr2=0x7f03dc1c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:19.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.232+0000 7f03e356c700 1 --2- 172.21.15.59:0/444010001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03dc139170 0x7f03dc1c8ee0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f03d4014040 tx=0x7f03d4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.232+0000 7f03e356c700 1 -- 172.21.15.59:0/444010001 shutdown_connections 2023-09-30T22:34:19.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.232+0000 7f03e356c700 1 --2- 172.21.15.59:0/444010001 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03dc09d6f0 0x7f03dc1c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.232+0000 7f03e356c700 1 --2- 172.21.15.59:0/444010001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03dc139170 0x7f03dc1c8ee0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.232+0000 7f03e356c700 1 --2- 172.21.15.59:0/444010001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03dc09e1d0 0x7f03dc1c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.232+0000 7f03e356c700 1 -- 172.21.15.59:0/444010001 >> 172.21.15.59:0/444010001 conn(0x7f03dc066f50 msgr2=0x7f03dc070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:19.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.232+0000 7f03e356c700 1 -- 172.21.15.59:0/444010001 shutdown_connections 2023-09-30T22:34:19.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.232+0000 7f03e356c700 1 -- 172.21.15.59:0/444010001 wait complete. 2023-09-30T22:34:19.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:19.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.293+0000 7f2730736700 1 -- 172.21.15.59:0/1348340905 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f272806c360 con 0x7f272809d6f0 2023-09-30T22:34:19.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.293+0000 7f271effd700 1 -- 172.21.15.59:0/1348340905 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2724024030 con 0x7f272809d6f0 2023-09-30T22:34:19.295 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:19.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.296+0000 7f2730736700 1 -- 172.21.15.59:0/1348340905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272809d6f0 msgr2=0x7f27281a5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:19.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.296+0000 7f2730736700 1 --2- 172.21.15.59:0/1348340905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272809d6f0 0x7f27281a5f30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f272400e9b0 tx=0x7f272400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.296+0000 7f2730736700 1 -- 172.21.15.59:0/1348340905 shutdown_connections 2023-09-30T22:34:19.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.296+0000 7f2730736700 1 --2- 172.21.15.59:0/1348340905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f272809e410 0x7f27281a69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.296+0000 7f2730736700 1 --2- 172.21.15.59:0/1348340905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f272809d6f0 0x7f27281a5f30 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.296+0000 7f2730736700 1 --2- 172.21.15.59:0/1348340905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272809e000 0x7f27281a6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:19.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.296+0000 7f2730736700 1 -- 172.21.15.59:0/1348340905 >> 172.21.15.59:0/1348340905 conn(0x7f2728066f50 msgr2=0x7f27281bae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:19.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.296+0000 7f2730736700 1 -- 172.21.15.59:0/1348340905 shutdown_connections 2023-09-30T22:34:19.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:19.296+0000 7f2730736700 1 -- 172.21.15.59:0/1348340905 wait complete. 2023-09-30T22:34:19.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:20.076 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:20.159 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:20.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.223+0000 7f193e475700 1 Processor -- start 2023-09-30T22:34:20.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.223+0000 7f193e475700 1 -- start start 2023-09-30T22:34:20.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.223+0000 7f193e475700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19380a0a30 0x7f19380a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.223+0000 7f193e475700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f193809d630 0x7f19380a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.223+0000 7f193e475700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1938133930 0x7f1938133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.223+0000 7f193e475700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19380a2a70 con 0x7f1938133930 2023-09-30T22:34:20.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f193e475700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19380a01d0 con 0x7f19380a0a30 2023-09-30T22:34:20.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f193e475700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f193809e2b0 con 0x7f193809d630 2023-09-30T22:34:20.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f1937fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19380a0a30 0x7f19380a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f19377fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f193809d630 0x7f19380a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f19377fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f193809d630 0x7f19380a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40722/0 (socket says 172.21.15.59:40722) 2023-09-30T22:34:20.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f1937fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19380a0a30 0x7f19380a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58250/0 (socket says 172.21.15.59:58250) 2023-09-30T22:34:20.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f19377fe700 1 -- 172.21.15.59:0/1135798314 learned_addr learned my addr 172.21.15.59:0/1135798314 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:20.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f193ca12700 1 --2- 172.21.15.59:0/1135798314 >> v2:172.21.15.59:3300/0 conn(0x7f1938133930 0x7f1938133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f19377fe700 1 -- 172.21.15.59:0/1135798314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19380a0a30 msgr2=0x7f19380a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:20.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f19377fe700 1 --2- 172.21.15.59:0/1135798314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19380a0a30 0x7f19380a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f19377fe700 1 -- 172.21.15.59:0/1135798314 >> v2:172.21.15.59:3300/0 conn(0x7f1938133930 msgr2=0x7f1938133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:20.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f19377fe700 1 --2- 172.21.15.59:0/1135798314 >> v2:172.21.15.59:3300/0 conn(0x7f1938133930 0x7f1938133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f19377fe700 1 -- 172.21.15.59:0/1135798314 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193809dc50 con 0x7f193809d630 2023-09-30T22:34:20.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f193ca12700 1 --2- 172.21.15.59:0/1135798314 >> v2:172.21.15.59:3300/0 conn(0x7f1938133930 0x7f1938133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:20.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f19377fe700 1 --2- 172.21.15.59:0/1135798314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f193809d630 0x7f19380a1340 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f192c0098f0 tx=0x7f192c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4017d432b87a7670 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:20.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f1936ffd700 1 -- 172.21.15.59:0/1135798314 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c011830 con 0x7f193809d630 2023-09-30T22:34:20.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.224+0000 7f1936ffd700 1 -- 172.21.15.59:0/1135798314 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c011990 con 0x7f193809d630 2023-09-30T22:34:20.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.225+0000 7f1936ffd700 1 -- 172.21.15.59:0/1135798314 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c011d20 con 0x7f193809d630 2023-09-30T22:34:20.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.225+0000 7f193e475700 1 -- 172.21.15.59:0/1135798314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f193809d630 msgr2=0x7f19380a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.225+0000 7f193e475700 1 --2- 172.21.15.59:0/1135798314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f193809d630 0x7f19380a1340 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f192c0098f0 tx=0x7f192c009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:20.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.225+0000 7f193e475700 1 -- 172.21.15.59:0/1135798314 shutdown_connections 2023-09-30T22:34:20.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.225+0000 7f193e475700 1 --2- 172.21.15.59:0/1135798314 >> v2:172.21.15.59:3300/0 conn(0x7f1938133930 0x7f1938133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.225+0000 7f193e475700 1 --2- 172.21.15.59:0/1135798314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19380a0a30 0x7f19380a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.225+0000 7f193e475700 1 --2- 172.21.15.59:0/1135798314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f193809d630 0x7f19380a1340 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.225+0000 7f193e475700 1 -- 172.21.15.59:0/1135798314 >> 172.21.15.59:0/1135798314 conn(0x7f19380a3050 msgr2=0x7f19380a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.225+0000 7f193e475700 1 -- 172.21.15.59:0/1135798314 shutdown_connections 2023-09-30T22:34:20.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.225+0000 7f193e475700 1 -- 172.21.15.59:0/1135798314 wait complete. 2023-09-30T22:34:20.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.226+0000 7f193e475700 1 Processor -- start 2023-09-30T22:34:20.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.226+0000 7f193e475700 1 -- start start 2023-09-30T22:34:20.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f193e475700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f193809d630 0x7f19381c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f193e475700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19380a0a30 0x7f19381c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f193e475700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1938133930 0x7f19381c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f193e475700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19381207a0 con 0x7f1938133930 2023-09-30T22:34:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f193e475700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19380a0410 con 0x7f19380a0a30 2023-09-30T22:34:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f193e475700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1938122110 con 0x7f193809d630 2023-09-30T22:34:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f19377fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19380a0a30 0x7f19381c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f193ca12700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1938133930 0x7f19381c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f19377fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19380a0a30 0x7f19381c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58252/0 (socket says 172.21.15.59:58252) 2023-09-30T22:34:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f19377fe700 1 -- 172.21.15.59:0/3097728622 learned_addr learned my addr 172.21.15.59:0/3097728622 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f1937fff700 1 --2- 172.21.15.59:0/3097728622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f193809d630 0x7f19381c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f193ca12700 1 -- 172.21.15.59:0/3097728622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f193809d630 msgr2=0x7f19381c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f193ca12700 1 --2- 172.21.15.59:0/3097728622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f193809d630 0x7f19381c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f193ca12700 1 -- 172.21.15.59:0/3097728622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19380a0a30 msgr2=0x7f19381c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f193ca12700 1 --2- 172.21.15.59:0/3097728622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19380a0a30 0x7f19381c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f193ca12700 1 -- 172.21.15.59:0/3097728622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1930009a70 con 0x7f1938133930 2023-09-30T22:34:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.227+0000 7f19377fe700 1 --2- 172.21.15.59:0/3097728622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19380a0a30 0x7f19381c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.228+0000 7f193ca12700 1 --2- 172.21.15.59:0/3097728622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1938133930 0x7f19381c8c10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f193000efc0 tx=0x7f193000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.228+0000 7f1934ff9700 1 -- 172.21.15.59:0/3097728622 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193000ca90 con 0x7f1938133930 2023-09-30T22:34:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.228+0000 7f1934ff9700 1 -- 172.21.15.59:0/3097728622 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193000f040 con 0x7f1938133930 2023-09-30T22:34:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.228+0000 7f1934ff9700 1 -- 172.21.15.59:0/3097728622 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193000ce30 con 0x7f1938133930 2023-09-30T22:34:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.228+0000 7f193e475700 1 -- 172.21.15.59:0/3097728622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192c009550 con 0x7f1938133930 2023-09-30T22:34:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.228+0000 7f193e475700 1 -- 172.21.15.59:0/3097728622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1938122740 con 0x7f1938133930 2023-09-30T22:34:20.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.229+0000 7f193e475700 1 -- 172.21.15.59:0/3097728622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19380747f0 con 0x7f1938133930 2023-09-30T22:34:20.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.229+0000 7f1934ff9700 1 -- 172.21.15.59:0/3097728622 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1930003a20 con 0x7f1938133930 2023-09-30T22:34:20.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.230+0000 7f1934ff9700 1 -- 172.21.15.59:0/3097728622 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f19300405e0 con 0x7f1938133930 2023-09-30T22:34:20.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.234+0000 7f1934ff9700 1 -- 172.21.15.59:0/3097728622 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f193001c7c0 con 0x7f1938133930 2023-09-30T22:34:20.247 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:20.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.303+0000 7f31fb0bb700 1 Processor -- start 2023-09-30T22:34:20.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.303+0000 7f31fb0bb700 1 -- start start 2023-09-30T22:34:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.304+0000 7f31fb0bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f4138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.304+0000 7f31fb0bb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 0x7f31f413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.304+0000 7f31fb0bb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f406b990 con 0x7f31f4133420 2023-09-30T22:34:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.304+0000 7f31fb0bb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f409b0e0 con 0x7f31f41337f0 2023-09-30T22:34:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.304+0000 7f31fb0bb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31f4133c20 con 0x7f31f4138dc0 2023-09-30T22:34:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.304+0000 7f31f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f4138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.304+0000 7f31f9658700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 0x7f31f413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.304+0000 7f31f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f4138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58260/0 (socket says 172.21.15.59:58260) 2023-09-30T22:34:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.304+0000 7f31f3fff700 1 -- 172.21.15.59:0/3870410143 learned_addr learned my addr 172.21.15.59:0/3870410143 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.304+0000 7f31f3fff700 1 -- 172.21.15.59:0/3870410143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 msgr2=0x7f31f413b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.304+0000 7f31f3fff700 1 --2- 172.21.15.59:0/3870410143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 0x7f31f413b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.304+0000 7f31f3fff700 1 -- 172.21.15.59:0/3870410143 >> v1:172.21.15.59:6789/0 conn(0x7f31f4133420 legacy=0x7f31f4133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.304+0000 7f31f37fe700 1 -- 172.21.15.59:0/3870410143 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966253169 0 0) 0x7f31f406b990 con 0x7f31f4133420 2023-09-30T22:34:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.304+0000 7f31f3fff700 1 -- 172.21.15.59:0/3870410143 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f40a0590 con 0x7f31f41337f0 2023-09-30T22:34:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.304+0000 7f31f9658700 1 --2- 172.21.15.59:0/3870410143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 0x7f31f413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.305+0000 7f31f3fff700 1 --2- 172.21.15.59:0/3870410143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f4138880 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009920 tx=0x7f31e0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b08332d028efe25f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.305+0000 7f31f37fe700 1 -- 172.21.15.59:0/3870410143 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0011830 con 0x7f31f41337f0 2023-09-30T22:34:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.305+0000 7f31f37fe700 1 -- 172.21.15.59:0/3870410143 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e0011990 con 0x7f31f41337f0 2023-09-30T22:34:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.305+0000 7f31f37fe700 1 -- 172.21.15.59:0/3870410143 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0011d20 con 0x7f31f41337f0 2023-09-30T22:34:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.306+0000 7f31fb0bb700 1 -- 172.21.15.59:0/3870410143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 msgr2=0x7f31f4138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.306+0000 7f31fb0bb700 1 --2- 172.21.15.59:0/3870410143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f4138880 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009920 tx=0x7f31e0009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.306+0000 7f31fb0bb700 1 -- 172.21.15.59:0/3870410143 shutdown_connections 2023-09-30T22:34:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.306+0000 7f31fb0bb700 1 --2- 172.21.15.59:0/3870410143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 0x7f31f413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.306+0000 7f31fb0bb700 1 --2- 172.21.15.59:0/3870410143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f4138880 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.306+0000 7f31fb0bb700 1 -- 172.21.15.59:0/3870410143 >> 172.21.15.59:0/3870410143 conn(0x7f31f40a4210 msgr2=0x7f31f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.306+0000 7f31fb0bb700 1 -- 172.21.15.59:0/3870410143 shutdown_connections 2023-09-30T22:34:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.306+0000 7f31fb0bb700 1 -- 172.21.15.59:0/3870410143 wait complete. 2023-09-30T22:34:20.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.307+0000 7f31fb0bb700 1 Processor -- start 2023-09-30T22:34:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.307+0000 7f31fb0bb700 1 -- start start 2023-09-30T22:34:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31fb0bb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f4133420 0x7f31f412f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31fb0bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f412f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31fb0bb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 0x7f31f412fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31fb0bb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f409b220 con 0x7f31f4133420 2023-09-30T22:34:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31fb0bb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f409dbb0 con 0x7f31f41337f0 2023-09-30T22:34:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31fb0bb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31f409ca30 con 0x7f31f4138dc0 2023-09-30T22:34:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f412f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f412f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58272/0 (socket says 172.21.15.59:58272) 2023-09-30T22:34:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31f3fff700 1 -- 172.21.15.59:0/227672653 learned_addr learned my addr 172.21.15.59:0/227672653 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:20.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31f8e57700 1 --2- 172.21.15.59:0/227672653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f4133420 0x7f31f412f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31f9658700 1 --2- 172.21.15.59:0/227672653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 0x7f31f412fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31f3fff700 1 -- 172.21.15.59:0/227672653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 msgr2=0x7f31f412fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31f3fff700 1 --2- 172.21.15.59:0/227672653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 0x7f31f412fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31f3fff700 1 -- 172.21.15.59:0/227672653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f4133420 msgr2=0x7f31f412f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31f3fff700 1 --2- 172.21.15.59:0/227672653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f4133420 0x7f31f412f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31f3fff700 1 -- 172.21.15.59:0/227672653 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec009a70 con 0x7f31f41337f0 2023-09-30T22:34:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31f9658700 1 --2- 172.21.15.59:0/227672653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 0x7f31f412fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.308+0000 7f31f8e57700 1 --2- 172.21.15.59:0/227672653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f4133420 0x7f31f412f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.309+0000 7f31f3fff700 1 --2- 172.21.15.59:0/227672653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f412f5d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f31e0000c00 tx=0x7f31e0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.309+0000 7f31f17fa700 1 -- 172.21.15.59:0/227672653 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0004510 con 0x7f31f41337f0 2023-09-30T22:34:20.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.309+0000 7f31f17fa700 1 -- 172.21.15.59:0/227672653 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e00036a0 con 0x7f31f41337f0 2023-09-30T22:34:20.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.309+0000 7f31fb0bb700 1 -- 172.21.15.59:0/227672653 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e0009550 con 0x7f31f41337f0 2023-09-30T22:34:20.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.309+0000 7f31f17fa700 1 -- 172.21.15.59:0/227672653 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0003a10 con 0x7f31f41337f0 2023-09-30T22:34:20.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.309+0000 7f31fb0bb700 1 -- 172.21.15.59:0/227672653 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f409d760 con 0x7f31f41337f0 2023-09-30T22:34:20.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.310+0000 7f31fb0bb700 1 -- 172.21.15.59:0/227672653 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f4074ea0 con 0x7f31f41337f0 2023-09-30T22:34:20.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.310+0000 7f31f17fa700 1 -- 172.21.15.59:0/227672653 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31e0021070 con 0x7f31f41337f0 2023-09-30T22:34:20.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.310+0000 7f31f17fa700 1 -- 172.21.15.59:0/227672653 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f31e0040a30 con 0x7f31f41337f0 2023-09-30T22:34:20.314 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:20.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.315+0000 7f31f17fa700 1 -- 172.21.15.59:0/227672653 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31e002d760 con 0x7f31f41337f0 2023-09-30T22:34:20.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.391+0000 7f52fb261700 1 Processor -- start 2023-09-30T22:34:20.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.391+0000 7f52fb261700 1 -- start start 2023-09-30T22:34:20.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.391+0000 7f52fb261700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52f409d6f0 0x7f52f409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.392+0000 7f52fb261700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52f409e410 0x7f52f4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.392+0000 7f52fb261700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f409b120 con 0x7f52f409e000 2023-09-30T22:34:20.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.392+0000 7f52fb261700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f406b460 con 0x7f52f409e410 2023-09-30T22:34:20.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.392+0000 7f52fb261700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52f409a7e0 con 0x7f52f409d6f0 2023-09-30T22:34:20.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.392+0000 7f52f97fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52f409e410 0x7f52f4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.392+0000 7f52f97fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52f409e410 0x7f52f4134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58286/0 (socket says 172.21.15.59:58286) 2023-09-30T22:34:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.392+0000 7f52f8ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52f409d6f0 0x7f52f409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.392+0000 7f52f97fe700 1 -- 172.21.15.59:0/2249919033 learned_addr learned my addr 172.21.15.59:0/2249919033 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.392+0000 7f52f8ffd700 1 -- 172.21.15.59:0/2249919033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52f409e410 msgr2=0x7f52f4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.392+0000 7f52f8ffd700 1 --2- 172.21.15.59:0/2249919033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52f409e410 0x7f52f4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.392+0000 7f52f8ffd700 1 -- 172.21.15.59:0/2249919033 >> v1:172.21.15.59:6789/0 conn(0x7f52f409e000 legacy=0x7f52f41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.392+0000 7f52f8ffd700 1 -- 172.21.15.59:0/2249919033 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f409a500 con 0x7f52f409d6f0 2023-09-30T22:34:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.393+0000 7f52f8ffd700 1 --2- 172.21.15.59:0/2249919033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52f409d6f0 0x7f52f409dac0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f52e80098a0 tx=0x7f52e8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3592f27fae925341 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.393+0000 7f52f37fe700 1 -- 172.21.15.59:0/2249919033 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e8011830 con 0x7f52f409d6f0 2023-09-30T22:34:20.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.393+0000 7f52f37fe700 1 -- 172.21.15.59:0/2249919033 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e8011990 con 0x7f52f409d6f0 2023-09-30T22:34:20.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.393+0000 7f52f37fe700 1 -- 172.21.15.59:0/2249919033 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e8011d20 con 0x7f52f409d6f0 2023-09-30T22:34:20.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.394+0000 7f52fb261700 1 -- 172.21.15.59:0/2249919033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52f409d6f0 msgr2=0x7f52f409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.394+0000 7f52fb261700 1 --2- 172.21.15.59:0/2249919033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52f409d6f0 0x7f52f409dac0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f52e80098a0 tx=0x7f52e8009bb0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.394+0000 7f52fb261700 1 -- 172.21.15.59:0/2249919033 shutdown_connections 2023-09-30T22:34:20.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.394+0000 7f52fb261700 1 --2- 172.21.15.59:0/2249919033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52f409d6f0 0x7f52f409dac0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.394+0000 7f52fb261700 1 --2- 172.21.15.59:0/2249919033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52f409e410 0x7f52f4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.394+0000 7f52fb261700 1 -- 172.21.15.59:0/2249919033 >> 172.21.15.59:0/2249919033 conn(0x7f52f4066f50 msgr2=0x7f52f409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:20.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.394+0000 7f52fb261700 1 -- 172.21.15.59:0/2249919033 shutdown_connections 2023-09-30T22:34:20.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.394+0000 7f52fb261700 1 -- 172.21.15.59:0/2249919033 wait complete. 2023-09-30T22:34:20.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.395+0000 7f52fb261700 1 Processor -- start 2023-09-30T22:34:20.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.396+0000 7f52fb261700 1 -- start start 2023-09-30T22:34:20.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.396+0000 7f52fb261700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52f409d6f0 0x7f52f4122560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.396+0000 7f52fb261700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52f409e000 0x7f52f4122aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.396+0000 7f52fb261700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52f409e410 0x7f52f4122fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.397+0000 7f52fb261700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f4125360 con 0x7f52f409d6f0 2023-09-30T22:34:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.397+0000 7f52fb261700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f409c710 con 0x7f52f409e410 2023-09-30T22:34:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.397+0000 7f52fb261700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52f40a1e20 con 0x7f52f409e000 2023-09-30T22:34:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.397+0000 7f52f97fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52f409e410 0x7f52f4122fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.397+0000 7f52f97fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52f409e410 0x7f52f4122fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58300/0 (socket says 172.21.15.59:58300) 2023-09-30T22:34:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.397+0000 7f52f97fe700 1 -- 172.21.15.59:0/2763058497 learned_addr learned my addr 172.21.15.59:0/2763058497 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.397+0000 7f52f3fff700 1 --2- 172.21.15.59:0/2763058497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52f409e000 0x7f52f4122aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.397+0000 7f52f8ffd700 1 --2- 172.21.15.59:0/2763058497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52f409d6f0 0x7f52f4122560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.397+0000 7f52f97fe700 1 -- 172.21.15.59:0/2763058497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52f409e000 msgr2=0x7f52f4122aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.397+0000 7f52f97fe700 1 --2- 172.21.15.59:0/2763058497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52f409e000 0x7f52f4122aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.397+0000 7f52f97fe700 1 -- 172.21.15.59:0/2763058497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52f409d6f0 msgr2=0x7f52f4122560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.397+0000 7f52f97fe700 1 --2- 172.21.15.59:0/2763058497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52f409d6f0 0x7f52f4122560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.397+0000 7f52f97fe700 1 -- 172.21.15.59:0/2763058497 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e80094a0 con 0x7f52f409e410 2023-09-30T22:34:20.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.397+0000 7f52f8ffd700 1 --2- 172.21.15.59:0/2763058497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52f409d6f0 0x7f52f4122560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:34:20.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.397+0000 7f52f97fe700 1 --2- 172.21.15.59:0/2763058497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52f409e410 0x7f52f4122fe0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00efc0 tx=0x7f52ec00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:20.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.398+0000 7f52f17fa700 1 -- 172.21.15.59:0/2763058497 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec003c20 con 0x7f52f409e410 2023-09-30T22:34:20.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.398+0000 7f52f17fa700 1 -- 172.21.15.59:0/2763058497 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec00f040 con 0x7f52f409e410 2023-09-30T22:34:20.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.398+0000 7f52fb261700 1 -- 172.21.15.59:0/2763058497 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f4124ec0 con 0x7f52f409e410 2023-09-30T22:34:20.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.398+0000 7f52f17fa700 1 -- 172.21.15.59:0/2763058497 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec009e60 con 0x7f52f409e410 2023-09-30T22:34:20.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.398+0000 7f52fb261700 1 -- 172.21.15.59:0/2763058497 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f41257a0 con 0x7f52f409e410 2023-09-30T22:34:20.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.399+0000 7f52fb261700 1 -- 172.21.15.59:0/2763058497 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f411f030 con 0x7f52f409e410 2023-09-30T22:34:20.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.399+0000 7f52f17fa700 1 -- 172.21.15.59:0/2763058497 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52ec00c930 con 0x7f52f409e410 2023-09-30T22:34:20.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.400+0000 7f52f17fa700 1 -- 172.21.15.59:0/2763058497 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f52ec03f9e0 con 0x7f52f409e410 2023-09-30T22:34:20.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.408+0000 7f52f17fa700 1 -- 172.21.15.59:0/2763058497 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52ec013bd0 con 0x7f52f409e410 2023-09-30T22:34:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.450+0000 7f193e475700 1 -- 172.21.15.59:0/3097728622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1938074390 con 0x7f1938133930 2023-09-30T22:34:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.451+0000 7f1934ff9700 1 -- 172.21.15.59:0/3097728622 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f193002b090 con 0x7f1938133930 2023-09-30T22:34:20.452 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.454+0000 7f193e475700 1 -- 172.21.15.59:0/3097728622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1938133930 msgr2=0x7f19381c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.454+0000 7f193e475700 1 --2- 172.21.15.59:0/3097728622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1938133930 0x7f19381c8c10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f193000efc0 tx=0x7f193000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.455+0000 7f193e475700 1 -- 172.21.15.59:0/3097728622 shutdown_connections 2023-09-30T22:34:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.455+0000 7f193e475700 1 --2- 172.21.15.59:0/3097728622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f193809d630 0x7f19381c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.455+0000 7f193e475700 1 --2- 172.21.15.59:0/3097728622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1938133930 0x7f19381c8c10 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.455+0000 7f193e475700 1 --2- 172.21.15.59:0/3097728622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19380a0a30 0x7f19381c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.455+0000 7f193e475700 1 -- 172.21.15.59:0/3097728622 >> 172.21.15.59:0/3097728622 conn(0x7f19380a3050 msgr2=0x7f193809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:20.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.455+0000 7f193e475700 1 -- 172.21.15.59:0/3097728622 shutdown_connections 2023-09-30T22:34:20.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.455+0000 7f193e475700 1 -- 172.21.15.59:0/3097728622 wait complete. 2023-09-30T22:34:20.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.466+0000 7f3b10366700 1 Processor -- start 2023-09-30T22:34:20.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.467+0000 7f3b10366700 1 -- start start 2023-09-30T22:34:20.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.467+0000 7f3b10366700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b08133420 0x7f3b081337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.467+0000 7f3b10366700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b08133e30 0x7f3b0812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.467+0000 7f3b10366700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b08134260 0x7f3b081304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.467+0000 7f3b10366700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0806b990 con 0x7f3b08133e30 2023-09-30T22:34:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.467+0000 7f3b10366700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080a0590 con 0x7f3b08133420 2023-09-30T22:34:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.467+0000 7f3b10366700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0809fb80 con 0x7f3b08134260 2023-09-30T22:34:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.467+0000 7f3b0e102700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b08133420 0x7f3b081337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.468+0000 7f3b0e102700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b08133420 0x7f3b081337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58302/0 (socket says 172.21.15.59:58302) 2023-09-30T22:34:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.468+0000 7f3b0e102700 1 -- 172.21.15.59:0/1730343932 learned_addr learned my addr 172.21.15.59:0/1730343932 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:20.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.468+0000 7f3b0e903700 1 --2- 172.21.15.59:0/1730343932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b08134260 0x7f3b081304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.468+0000 7f3b0d901700 1 --2- 172.21.15.59:0/1730343932 >> v2:172.21.15.59:3300/0 conn(0x7f3b08133e30 0x7f3b0812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.468+0000 7f3b0e102700 1 -- 172.21.15.59:0/1730343932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b08134260 msgr2=0x7f3b081304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.468+0000 7f3b0e102700 1 --2- 172.21.15.59:0/1730343932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b08134260 0x7f3b081304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.468+0000 7f3b0e102700 1 -- 172.21.15.59:0/1730343932 >> v2:172.21.15.59:3300/0 conn(0x7f3b08133e30 msgr2=0x7f3b0812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.468+0000 7f3b0e102700 1 --2- 172.21.15.59:0/1730343932 >> v2:172.21.15.59:3300/0 conn(0x7f3b08133e30 0x7f3b0812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.468+0000 7f3b0e102700 1 -- 172.21.15.59:0/1730343932 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080a0030 con 0x7f3b08133420 2023-09-30T22:34:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.468+0000 7f3b0d901700 1 --2- 172.21.15.59:0/1730343932 >> v2:172.21.15.59:3300/0 conn(0x7f3b08133e30 0x7f3b0812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.468+0000 7f3b0e102700 1 --2- 172.21.15.59:0/1730343932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b08133420 0x7f3b081337f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3b040098f0 tx=0x7f3b04009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67460828b06cc762 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.468+0000 7f3b0d100700 1 -- 172.21.15.59:0/1730343932 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04011830 con 0x7f3b08133420 2023-09-30T22:34:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.469+0000 7f3b0d100700 1 -- 172.21.15.59:0/1730343932 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b04011990 con 0x7f3b08133420 2023-09-30T22:34:20.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.469+0000 7f3b0d100700 1 -- 172.21.15.59:0/1730343932 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04011d20 con 0x7f3b08133420 2023-09-30T22:34:20.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.469+0000 7f3b10366700 1 -- 172.21.15.59:0/1730343932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b08133420 msgr2=0x7f3b081337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.469+0000 7f3b10366700 1 --2- 172.21.15.59:0/1730343932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b08133420 0x7f3b081337f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3b040098f0 tx=0x7f3b04009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:20.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.469+0000 7f3b10366700 1 -- 172.21.15.59:0/1730343932 shutdown_connections 2023-09-30T22:34:20.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.469+0000 7f3b10366700 1 --2- 172.21.15.59:0/1730343932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b08134260 0x7f3b081304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.469+0000 7f3b10366700 1 --2- 172.21.15.59:0/1730343932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b08133420 0x7f3b081337f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.469+0000 7f3b10366700 1 --2- 172.21.15.59:0/1730343932 >> v2:172.21.15.59:3300/0 conn(0x7f3b08133e30 0x7f3b0812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.469+0000 7f3b10366700 1 -- 172.21.15.59:0/1730343932 >> 172.21.15.59:0/1730343932 conn(0x7f3b080a4210 msgr2=0x7f3b080a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:20.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.469+0000 7f3b10366700 1 -- 172.21.15.59:0/1730343932 shutdown_connections 2023-09-30T22:34:20.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.470+0000 7f3b10366700 1 -- 172.21.15.59:0/1730343932 wait complete. 2023-09-30T22:34:20.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.471+0000 7f3b10366700 1 Processor -- start 2023-09-30T22:34:20.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.471+0000 7f3b10366700 1 -- start start 2023-09-30T22:34:20.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.471+0000 7f3b10366700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b08133420 0x7f3b0809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.471+0000 7f3b10366700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b08133e30 0x7f3b0809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.471+0000 7f3b10366700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b08134260 0x7f3b0809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:20.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.471+0000 7f3b10366700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0812d9b0 con 0x7f3b08134260 2023-09-30T22:34:20.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.471+0000 7f3b10366700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0809d850 con 0x7f3b08133e30 2023-09-30T22:34:20.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.471+0000 7f3b10366700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0811feb0 con 0x7f3b08133420 2023-09-30T22:34:20.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.471+0000 7f3b0e903700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b08134260 0x7f3b0809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.471+0000 7f3b0e903700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b08134260 0x7f3b0809cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56868/0 (socket says 172.21.15.59:56868) 2023-09-30T22:34:20.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.471+0000 7f3b0e903700 1 -- 172.21.15.59:0/1774355546 learned_addr learned my addr 172.21.15.59:0/1774355546 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:20.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.471+0000 7f3b0e102700 1 --2- 172.21.15.59:0/1774355546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b08133420 0x7f3b0809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.471+0000 7f3b0d901700 1 --2- 172.21.15.59:0/1774355546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b08133e30 0x7f3b0809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:20.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.472+0000 7f3b0e102700 1 -- 172.21.15.59:0/1774355546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b08133e30 msgr2=0x7f3b0809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.472+0000 7f3b0e102700 1 --2- 172.21.15.59:0/1774355546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b08133e30 0x7f3b0809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.472+0000 7f3b0e102700 1 -- 172.21.15.59:0/1774355546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b08134260 msgr2=0x7f3b0809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.472+0000 7f3b0e102700 1 --2- 172.21.15.59:0/1774355546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b08134260 0x7f3b0809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.472+0000 7f3b0e102700 1 -- 172.21.15.59:0/1774355546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b04009550 con 0x7f3b08133420 2023-09-30T22:34:20.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.472+0000 7f3b0e903700 1 --2- 172.21.15.59:0/1774355546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b08134260 0x7f3b0809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:20.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.472+0000 7f3b0e102700 1 --2- 172.21.15.59:0/1774355546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b08133420 0x7f3b0809c480 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3b04016000 tx=0x7f3b04004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:20.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.472+0000 7f3afeffd700 1 -- 172.21.15.59:0/1774355546 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04004510 con 0x7f3b08133420 2023-09-30T22:34:20.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.472+0000 7f3afeffd700 1 -- 172.21.15.59:0/1774355546 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b040036a0 con 0x7f3b08133420 2023-09-30T22:34:20.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.472+0000 7f3b10366700 1 -- 172.21.15.59:0/1774355546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b08131520 con 0x7f3b08133420 2023-09-30T22:34:20.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.472+0000 7f3afeffd700 1 -- 172.21.15.59:0/1774355546 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04003a30 con 0x7f3b08133420 2023-09-30T22:34:20.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.472+0000 7f3b10366700 1 -- 172.21.15.59:0/1774355546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0811fb60 con 0x7f3b08133420 2023-09-30T22:34:20.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.474+0000 7f3afeffd700 1 -- 172.21.15.59:0/1774355546 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b04021070 con 0x7f3b08133420 2023-09-30T22:34:20.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.473+0000 7f3b10366700 1 -- 172.21.15.59:0/1774355546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b08074ea0 con 0x7f3b08133420 2023-09-30T22:34:20.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.474+0000 7f3afeffd700 1 -- 172.21.15.59:0/1774355546 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3b04048350 con 0x7f3b08133420 2023-09-30T22:34:20.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:20.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.483+0000 7f3afeffd700 1 -- 172.21.15.59:0/1774355546 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b04045060 con 0x7f3b08133420 2023-09-30T22:34:20.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.537+0000 7f31fb0bb700 1 -- 172.21.15.59:0/227672653 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f31f4133200 con 0x7f31f41337f0 2023-09-30T22:34:20.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.538+0000 7f31f17fa700 1 -- 172.21.15.59:0/227672653 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31e0029070 con 0x7f31f41337f0 2023-09-30T22:34:20.539 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:20.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.540+0000 7f31fb0bb700 1 -- 172.21.15.59:0/227672653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 msgr2=0x7f31f412f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.540+0000 7f31fb0bb700 1 --2- 172.21.15.59:0/227672653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f412f5d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f31e0000c00 tx=0x7f31e0004750 comp rx=0 tx=0).stop 2023-09-30T22:34:20.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.540+0000 7f31fb0bb700 1 -- 172.21.15.59:0/227672653 shutdown_connections 2023-09-30T22:34:20.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.540+0000 7f31fb0bb700 1 --2- 172.21.15.59:0/227672653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f31f4138dc0 0x7f31f412fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.540+0000 7f31fb0bb700 1 --2- 172.21.15.59:0/227672653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f4133420 0x7f31f412f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.540+0000 7f31fb0bb700 1 --2- 172.21.15.59:0/227672653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31f41337f0 0x7f31f412f5d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.540+0000 7f31fb0bb700 1 -- 172.21.15.59:0/227672653 >> 172.21.15.59:0/227672653 conn(0x7f31f40a4210 msgr2=0x7f31f40a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:20.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.540+0000 7f31fb0bb700 1 -- 172.21.15.59:0/227672653 shutdown_connections 2023-09-30T22:34:20.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.540+0000 7f31fb0bb700 1 -- 172.21.15.59:0/227672653 wait complete. 2023-09-30T22:34:20.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:20.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.629+0000 7f52fb261700 1 -- 172.21.15.59:0/2763058497 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f52f4074ea0 con 0x7f52f409e410 2023-09-30T22:34:20.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.630+0000 7f52f17fa700 1 -- 172.21.15.59:0/2763058497 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52ec013bd0 con 0x7f52f409e410 2023-09-30T22:34:20.632 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.632+0000 7f52fb261700 1 -- 172.21.15.59:0/2763058497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52f409e410 msgr2=0x7f52f4122fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.632+0000 7f52fb261700 1 --2- 172.21.15.59:0/2763058497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52f409e410 0x7f52f4122fe0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00efc0 tx=0x7f52ec00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.632+0000 7f52fb261700 1 -- 172.21.15.59:0/2763058497 shutdown_connections 2023-09-30T22:34:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.632+0000 7f52fb261700 1 --2- 172.21.15.59:0/2763058497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52f409e410 0x7f52f4122fe0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.632+0000 7f52fb261700 1 --2- 172.21.15.59:0/2763058497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52f409d6f0 0x7f52f4122560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.632+0000 7f52fb261700 1 --2- 172.21.15.59:0/2763058497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52f409e000 0x7f52f4122aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.632+0000 7f52fb261700 1 -- 172.21.15.59:0/2763058497 >> 172.21.15.59:0/2763058497 conn(0x7f52f4066f50 msgr2=0x7f52f40a2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:20.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.632+0000 7f52fb261700 1 -- 172.21.15.59:0/2763058497 shutdown_connections 2023-09-30T22:34:20.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.632+0000 7f52fb261700 1 -- 172.21.15.59:0/2763058497 wait complete. 2023-09-30T22:34:20.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.690+0000 7f3b10366700 1 -- 172.21.15.59:0/1774355546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3b0806b250 con 0x7f3b08133420 2023-09-30T22:34:20.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.690+0000 7f3afeffd700 1 -- 172.21.15.59:0/1774355546 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b04045070 con 0x7f3b08133420 2023-09-30T22:34:20.692 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:20.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.692+0000 7f3b10366700 1 -- 172.21.15.59:0/1774355546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b08133420 msgr2=0x7f3b0809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:20.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.692+0000 7f3b10366700 1 --2- 172.21.15.59:0/1774355546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b08133420 0x7f3b0809c480 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3b04016000 tx=0x7f3b04004750 comp rx=0 tx=0).stop 2023-09-30T22:34:20.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.692+0000 7f3b10366700 1 -- 172.21.15.59:0/1774355546 shutdown_connections 2023-09-30T22:34:20.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.692+0000 7f3b10366700 1 --2- 172.21.15.59:0/1774355546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b08133420 0x7f3b0809c480 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.692+0000 7f3b10366700 1 --2- 172.21.15.59:0/1774355546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b08134260 0x7f3b0809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.692+0000 7f3b10366700 1 --2- 172.21.15.59:0/1774355546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b08133e30 0x7f3b0809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:20.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.693+0000 7f3b10366700 1 -- 172.21.15.59:0/1774355546 >> 172.21.15.59:0/1774355546 conn(0x7f3b080a4210 msgr2=0x7f3b080a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:20.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.693+0000 7f3b10366700 1 -- 172.21.15.59:0/1774355546 shutdown_connections 2023-09-30T22:34:20.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:20.693+0000 7f3b10366700 1 -- 172.21.15.59:0/1774355546 wait complete. 2023-09-30T22:34:20.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:21.481 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:21.557 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:21.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.627+0000 7f7b968f5700 1 Processor -- start 2023-09-30T22:34:21.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.627+0000 7f7b968f5700 1 -- start start 2023-09-30T22:34:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.628+0000 7f7b968f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b90133420 0x7f7b901337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.628+0000 7f7b968f5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b90133e30 0x7f7b9012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.628+0000 7f7b968f5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9006b990 con 0x7f7b90134260 2023-09-30T22:34:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.628+0000 7f7b968f5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b900a0590 con 0x7f7b90133420 2023-09-30T22:34:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.628+0000 7f7b968f5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9009fb80 con 0x7f7b90133e30 2023-09-30T22:34:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.628+0000 7f7b94e92700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7b90134260 0x7f7b901304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52776/0 (socket says 172.21.15.59:52776) 2023-09-30T22:34:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.628+0000 7f7b94e92700 1 -- 172.21.15.59:0/2303495020 learned_addr learned my addr 172.21.15.59:0/2303495020 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.628+0000 7f7b8ffff700 1 --2- 172.21.15.59:0/2303495020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b90133420 0x7f7b901337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.628+0000 7f7b8f7fe700 1 --2- 172.21.15.59:0/2303495020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b90133e30 0x7f7b9012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.628+0000 7f7b8effd700 1 -- 172.21.15.59:0/2303495020 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142242513 0 0) 0x7f7b9006b990 con 0x7f7b90134260 2023-09-30T22:34:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.628+0000 7f7b8effd700 1 -- 172.21.15.59:0/2303495020 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b780035b0 con 0x7f7b90134260 2023-09-30T22:34:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.629+0000 7f7b8ffff700 1 -- 172.21.15.59:0/2303495020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b90133e30 msgr2=0x7f7b9012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.629+0000 7f7b8ffff700 1 --2- 172.21.15.59:0/2303495020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b90133e30 0x7f7b9012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.629+0000 7f7b8ffff700 1 -- 172.21.15.59:0/2303495020 >> v1:172.21.15.59:6789/0 conn(0x7f7b90134260 legacy=0x7f7b901304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.629+0000 7f7b8ffff700 1 -- 172.21.15.59:0/2303495020 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b900a0030 con 0x7f7b90133420 2023-09-30T22:34:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.629+0000 7f7b8f7fe700 1 --2- 172.21.15.59:0/2303495020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b90133e30 0x7f7b9012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.629+0000 7f7b8ffff700 1 --2- 172.21.15.59:0/2303495020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b90133420 0x7f7b901337f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009870 tx=0x7f7b80009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f92360951eaccdf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.629+0000 7f7b8effd700 1 -- 172.21.15.59:0/2303495020 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80011830 con 0x7f7b90133420 2023-09-30T22:34:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.629+0000 7f7b8effd700 1 -- 172.21.15.59:0/2303495020 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b80011990 con 0x7f7b90133420 2023-09-30T22:34:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.629+0000 7f7b8effd700 1 -- 172.21.15.59:0/2303495020 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80011d20 con 0x7f7b90133420 2023-09-30T22:34:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.630+0000 7f7b968f5700 1 -- 172.21.15.59:0/2303495020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b90133420 msgr2=0x7f7b901337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.630+0000 7f7b968f5700 1 --2- 172.21.15.59:0/2303495020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b90133420 0x7f7b901337f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009870 tx=0x7f7b80009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.630+0000 7f7b968f5700 1 -- 172.21.15.59:0/2303495020 shutdown_connections 2023-09-30T22:34:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.630+0000 7f7b968f5700 1 --2- 172.21.15.59:0/2303495020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b90133420 0x7f7b901337f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.630+0000 7f7b968f5700 1 --2- 172.21.15.59:0/2303495020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b90133e30 0x7f7b9012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.630+0000 7f7b968f5700 1 -- 172.21.15.59:0/2303495020 >> 172.21.15.59:0/2303495020 conn(0x7f7b900a4210 msgr2=0x7f7b900a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.630+0000 7f7b968f5700 1 -- 172.21.15.59:0/2303495020 shutdown_connections 2023-09-30T22:34:21.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.630+0000 7f7b968f5700 1 -- 172.21.15.59:0/2303495020 wait complete. 2023-09-30T22:34:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.631+0000 7f7b968f5700 1 Processor -- start 2023-09-30T22:34:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.631+0000 7f7b968f5700 1 -- start start 2023-09-30T22:34:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.631+0000 7f7b968f5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b90133420 0x7f7b9009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.631+0000 7f7b968f5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b90133e30 0x7f7b9009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.631+0000 7f7b968f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b90134260 0x7f7b9009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.631+0000 7f7b968f5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9012d920 con 0x7f7b90133e30 2023-09-30T22:34:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.631+0000 7f7b968f5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9011f3e0 con 0x7f7b90134260 2023-09-30T22:34:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.631+0000 7f7b968f5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9011fbd0 con 0x7f7b90133420 2023-09-30T22:34:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b8ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b90133420 0x7f7b9009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b8f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b90133e30 0x7f7b9009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b8ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b90133420 0x7f7b9009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40798/0 (socket says 172.21.15.59:40798) 2023-09-30T22:34:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b8f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b90133e30 0x7f7b9009c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56880/0 (socket says 172.21.15.59:56880) 2023-09-30T22:34:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b8ffff700 1 -- 172.21.15.59:0/441740152 learned_addr learned my addr 172.21.15.59:0/441740152 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b94e92700 1 --2- 172.21.15.59:0/441740152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b90134260 0x7f7b9009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b8ffff700 1 -- 172.21.15.59:0/441740152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b90134260 msgr2=0x7f7b9009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b8ffff700 1 --2- 172.21.15.59:0/441740152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b90134260 0x7f7b9009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b8ffff700 1 -- 172.21.15.59:0/441740152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b90133e30 msgr2=0x7f7b9009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b8ffff700 1 --2- 172.21.15.59:0/441740152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b90133e30 0x7f7b9009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b8ffff700 1 -- 172.21.15.59:0/441740152 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b840094a0 con 0x7f7b90133420 2023-09-30T22:34:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b8ffff700 1 --2- 172.21.15.59:0/441740152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b90133420 0x7f7b9009c480 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009bc0 tx=0x7f7b80004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b8cff9700 1 -- 172.21.15.59:0/441740152 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80004300 con 0x7f7b90133420 2023-09-30T22:34:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b8cff9700 1 -- 172.21.15.59:0/441740152 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8001f070 con 0x7f7b90133420 2023-09-30T22:34:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b8cff9700 1 -- 172.21.15.59:0/441740152 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b800036a0 con 0x7f7b90133420 2023-09-30T22:34:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b968f5700 1 -- 172.21.15.59:0/441740152 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b800094a0 con 0x7f7b90133420 2023-09-30T22:34:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.632+0000 7f7b968f5700 1 -- 172.21.15.59:0/441740152 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9011eed0 con 0x7f7b90133420 2023-09-30T22:34:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.633+0000 7f7b8cff9700 1 -- 172.21.15.59:0/441740152 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b80021030 con 0x7f7b90133420 2023-09-30T22:34:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.633+0000 7f7b8cff9700 1 -- 172.21.15.59:0/441740152 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7b80040760 con 0x7f7b90133420 2023-09-30T22:34:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.634+0000 7f7b968f5700 1 -- 172.21.15.59:0/441740152 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b90074ea0 con 0x7f7b90133420 2023-09-30T22:34:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.639+0000 7f7b8cff9700 1 -- 172.21.15.59:0/441740152 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b800199a0 con 0x7f7b90133420 2023-09-30T22:34:21.648 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:21.708 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:21.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.719+0000 7f0f65d9e700 1 Processor -- start 2023-09-30T22:34:21.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.719+0000 7f0f65d9e700 1 -- start start 2023-09-30T22:34:21.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.720+0000 7f0f65d9e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f60136710 0x7f0f60138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.720+0000 7f0f65d9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f60139030 0x7f0f6013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.720+0000 7f0f65d9e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6006ef30 con 0x7f0f601338a0 2023-09-30T22:34:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.720+0000 7f0f65d9e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6006fef0 con 0x7f0f60136710 2023-09-30T22:34:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.720+0000 7f0f65d9e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f601334b0 con 0x7f0f60139030 2023-09-30T22:34:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.720+0000 7f0f5ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f60139030 0x7f0f6013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.720+0000 7f0f5ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f60139030 0x7f0f6013b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40808/0 (socket says 172.21.15.59:40808) 2023-09-30T22:34:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.720+0000 7f0f5ffff700 1 -- 172.21.15.59:0/1757175590 learned_addr learned my addr 172.21.15.59:0/1757175590 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.720+0000 7f0f5effd700 1 --2- 172.21.15.59:0/1757175590 >> v2:172.21.15.59:3300/0 conn(0x7f0f60136710 0x7f0f60138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.720+0000 7f0f5ffff700 1 -- 172.21.15.59:0/1757175590 >> v2:172.21.15.59:3300/0 conn(0x7f0f60136710 msgr2=0x7f0f60138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.720+0000 7f0f5ffff700 1 --2- 172.21.15.59:0/1757175590 >> v2:172.21.15.59:3300/0 conn(0x7f0f60136710 0x7f0f60138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.720+0000 7f0f5ffff700 1 -- 172.21.15.59:0/1757175590 >> v1:172.21.15.59:6789/0 conn(0x7f0f601338a0 legacy=0x7f0f60133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.720+0000 7f0f5ffff700 1 -- 172.21.15.59:0/1757175590 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6006fc30 con 0x7f0f60139030 2023-09-30T22:34:21.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.721+0000 7f0f5ffff700 1 --2- 172.21.15.59:0/1757175590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f60139030 0x7f0f6013b410 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009e50 tx=0x7f0f5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d833360eb37abb98 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:21.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.721+0000 7f0f5e7fc700 1 -- 172.21.15.59:0/1757175590 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800e070 con 0x7f0f60139030 2023-09-30T22:34:21.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.721+0000 7f0f5e7fc700 1 -- 172.21.15.59:0/1757175590 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5800b910 con 0x7f0f60139030 2023-09-30T22:34:21.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.721+0000 7f0f5e7fc700 1 -- 172.21.15.59:0/1757175590 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800bcc0 con 0x7f0f60139030 2023-09-30T22:34:21.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.722+0000 7f0f65d9e700 1 -- 172.21.15.59:0/1757175590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f60139030 msgr2=0x7f0f6013b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.722+0000 7f0f65d9e700 1 --2- 172.21.15.59:0/1757175590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f60139030 0x7f0f6013b410 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009e50 tx=0x7f0f5800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:21.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.722+0000 7f0f65d9e700 1 -- 172.21.15.59:0/1757175590 shutdown_connections 2023-09-30T22:34:21.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.722+0000 7f0f65d9e700 1 --2- 172.21.15.59:0/1757175590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f60139030 0x7f0f6013b410 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.722+0000 7f0f65d9e700 1 --2- 172.21.15.59:0/1757175590 >> v2:172.21.15.59:3300/0 conn(0x7f0f60136710 0x7f0f60138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.722+0000 7f0f65d9e700 1 -- 172.21.15.59:0/1757175590 >> 172.21.15.59:0/1757175590 conn(0x7f0f600a2aa0 msgr2=0x7f0f600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:21.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.722+0000 7f0f65d9e700 1 -- 172.21.15.59:0/1757175590 shutdown_connections 2023-09-30T22:34:21.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.722+0000 7f0f65d9e700 1 -- 172.21.15.59:0/1757175590 wait complete. 2023-09-30T22:34:21.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.723+0000 7f0f65d9e700 1 Processor -- start 2023-09-30T22:34:21.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.723+0000 7f0f65d9e700 1 -- start start 2023-09-30T22:34:21.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f65d9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f601338a0 0x7f0f6009e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f65d9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f60136710 0x7f0f6009e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f65d9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f60139030 0x7f0f601cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f65d9e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6009f4f0 con 0x7f0f60136710 2023-09-30T22:34:21.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f65d9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6009f300 con 0x7f0f601338a0 2023-09-30T22:34:21.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f65d9e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f60121db0 con 0x7f0f60139030 2023-09-30T22:34:21.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f5f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f601338a0 0x7f0f6009e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f5f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f601338a0 0x7f0f6009e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58334/0 (socket says 172.21.15.59:58334) 2023-09-30T22:34:21.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f5f7fe700 1 -- 172.21.15.59:0/647607364 learned_addr learned my addr 172.21.15.59:0/647607364 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:21.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f5effd700 1 --2- 172.21.15.59:0/647607364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f60136710 0x7f0f6009e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f5f7fe700 1 -- 172.21.15.59:0/647607364 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f60139030 msgr2=0x7f0f601cc4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:34:21.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f5f7fe700 1 --2- 172.21.15.59:0/647607364 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f60139030 0x7f0f601cc4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f5f7fe700 1 -- 172.21.15.59:0/647607364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f60136710 msgr2=0x7f0f6009e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f5f7fe700 1 --2- 172.21.15.59:0/647607364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f60136710 0x7f0f6009e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f5f7fe700 1 -- 172.21.15.59:0/647607364 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f58009b30 con 0x7f0f601338a0 2023-09-30T22:34:21.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.724+0000 7f0f5effd700 1 --2- 172.21.15.59:0/647607364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f60136710 0x7f0f6009e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:21.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.725+0000 7f0f5f7fe700 1 --2- 172.21.15.59:0/647607364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f601338a0 0x7f0f6009e1b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000c4e0 tx=0x7f0f5000c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:21.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.725+0000 7f0f47fff700 1 -- 172.21.15.59:0/647607364 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f500052d0 con 0x7f0f601338a0 2023-09-30T22:34:21.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.725+0000 7f0f47fff700 1 -- 172.21.15.59:0/647607364 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f50005430 con 0x7f0f601338a0 2023-09-30T22:34:21.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.725+0000 7f0f65d9e700 1 -- 172.21.15.59:0/647607364 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f60138b00 con 0x7f0f601338a0 2023-09-30T22:34:21.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.725+0000 7f0f47fff700 1 -- 172.21.15.59:0/647607364 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f500038a0 con 0x7f0f601338a0 2023-09-30T22:34:21.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.725+0000 7f0f65d9e700 1 -- 172.21.15.59:0/647607364 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6006f690 con 0x7f0f601338a0 2023-09-30T22:34:21.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.726+0000 7f0f47fff700 1 -- 172.21.15.59:0/647607364 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f50003a00 con 0x7f0f601338a0 2023-09-30T22:34:21.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.726+0000 7f0f47fff700 1 -- 172.21.15.59:0/647607364 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f5003ebc0 con 0x7f0f601338a0 2023-09-30T22:34:21.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.726+0000 7f0f65d9e700 1 -- 172.21.15.59:0/647607364 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f601217f0 con 0x7f0f601338a0 2023-09-30T22:34:21.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.731+0000 7f0f47fff700 1 -- 172.21.15.59:0/647607364 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f50017080 con 0x7f0f601338a0 2023-09-30T22:34:21.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.801+0000 7fd4d80ce700 1 Processor -- start 2023-09-30T22:34:21.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.801+0000 7fd4d80ce700 1 -- start start 2023-09-30T22:34:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.802+0000 7fd4d80ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d00983f0 0x7fd4d00987c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.802+0000 7fd4d80ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d009d6f0 0x7fd4d009dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.802+0000 7fd4d80ce700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4d009e020 0x7fd4d01385c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.802+0000 7fd4d80ce700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d0099c50 con 0x7fd4d009e020 2023-09-30T22:34:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.802+0000 7fd4d80ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d009c1a0 con 0x7fd4d00983f0 2023-09-30T22:34:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.802+0000 7fd4d80ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d009bcc0 con 0x7fd4d009d6f0 2023-09-30T22:34:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.802+0000 7fd4d5e6a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d00983f0 0x7fd4d00987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.802+0000 7fd4d5e6a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d00983f0 0x7fd4d00987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58350/0 (socket says 172.21.15.59:58350) 2023-09-30T22:34:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.802+0000 7fd4d5e6a700 1 -- 172.21.15.59:0/319558779 learned_addr learned my addr 172.21.15.59:0/319558779 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.802+0000 7fd4d5669700 1 --2- 172.21.15.59:0/319558779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d009d6f0 0x7fd4d009dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.802+0000 7fd4d666b700 1 --2- 172.21.15.59:0/319558779 >> v2:172.21.15.59:3300/0 conn(0x7fd4d009e020 0x7fd4d01385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.803+0000 7fd4d5e6a700 1 -- 172.21.15.59:0/319558779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d009d6f0 msgr2=0x7fd4d009dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:21.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.803+0000 7fd4d5e6a700 1 --2- 172.21.15.59:0/319558779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d009d6f0 0x7fd4d009dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.803+0000 7fd4d5e6a700 1 -- 172.21.15.59:0/319558779 >> v2:172.21.15.59:3300/0 conn(0x7fd4d009e020 msgr2=0x7fd4d01385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:21.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.803+0000 7fd4d5e6a700 1 --2- 172.21.15.59:0/319558779 >> v2:172.21.15.59:3300/0 conn(0x7fd4d009e020 0x7fd4d01385c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.803+0000 7fd4d5e6a700 1 -- 172.21.15.59:0/319558779 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d009a9c0 con 0x7fd4d00983f0 2023-09-30T22:34:21.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.803+0000 7fd4d5669700 1 --2- 172.21.15.59:0/319558779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d009d6f0 0x7fd4d009dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:21.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.803+0000 7fd4d666b700 1 --2- 172.21.15.59:0/319558779 >> v2:172.21.15.59:3300/0 conn(0x7fd4d009e020 0x7fd4d01385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:34:21.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.803+0000 7fd4d5e6a700 1 --2- 172.21.15.59:0/319558779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d00983f0 0x7fd4d00987c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0098f0 tx=0x7fd4cc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f74c605111611a37 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:21.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.803+0000 7fd4d4e68700 1 -- 172.21.15.59:0/319558779 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc011830 con 0x7fd4d00983f0 2023-09-30T22:34:21.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.803+0000 7fd4d4e68700 1 -- 172.21.15.59:0/319558779 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc011990 con 0x7fd4d00983f0 2023-09-30T22:34:21.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.803+0000 7fd4d4e68700 1 -- 172.21.15.59:0/319558779 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc011d20 con 0x7fd4d00983f0 2023-09-30T22:34:21.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.804+0000 7fd4d80ce700 1 -- 172.21.15.59:0/319558779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d00983f0 msgr2=0x7fd4d00987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.804+0000 7fd4d80ce700 1 --2- 172.21.15.59:0/319558779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d00983f0 0x7fd4d00987c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0098f0 tx=0x7fd4cc009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:21.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.804+0000 7fd4d80ce700 1 -- 172.21.15.59:0/319558779 shutdown_connections 2023-09-30T22:34:21.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.804+0000 7fd4d80ce700 1 --2- 172.21.15.59:0/319558779 >> v2:172.21.15.59:3300/0 conn(0x7fd4d009e020 0x7fd4d01385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.804+0000 7fd4d80ce700 1 --2- 172.21.15.59:0/319558779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d00983f0 0x7fd4d00987c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.804+0000 7fd4d80ce700 1 --2- 172.21.15.59:0/319558779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d009d6f0 0x7fd4d009dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.804+0000 7fd4d80ce700 1 -- 172.21.15.59:0/319558779 >> 172.21.15.59:0/319558779 conn(0x7fd4d009f470 msgr2=0x7fd4d00a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:21.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.804+0000 7fd4d80ce700 1 -- 172.21.15.59:0/319558779 shutdown_connections 2023-09-30T22:34:21.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.804+0000 7fd4d80ce700 1 -- 172.21.15.59:0/319558779 wait complete. 2023-09-30T22:34:21.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.806+0000 7fd4d80ce700 1 Processor -- start 2023-09-30T22:34:21.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.806+0000 7fd4d80ce700 1 -- start start 2023-09-30T22:34:21.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.806+0000 7fd4d80ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d00983f0 0x7fd4d006d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.806+0000 7fd4d80ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d009d6f0 0x7fd4d006db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.806+0000 7fd4d80ce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d009e020 0x7fd4d006e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.806+0000 7fd4d80ce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d008c0e0 con 0x7fd4d009e020 2023-09-30T22:34:21.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.806+0000 7fd4d80ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d0097c90 con 0x7fd4d00983f0 2023-09-30T22:34:21.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.806+0000 7fd4d80ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d008c960 con 0x7fd4d009d6f0 2023-09-30T22:34:21.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.807+0000 7fd4d5669700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d009d6f0 0x7fd4d006db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.807+0000 7fd4d666b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d009e020 0x7fd4d006e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.807+0000 7fd4d5e6a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d00983f0 0x7fd4d006d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.807+0000 7fd4d5669700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d009d6f0 0x7fd4d006db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40822/0 (socket says 172.21.15.59:40822) 2023-09-30T22:34:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.807+0000 7fd4d5669700 1 -- 172.21.15.59:0/2885524884 learned_addr learned my addr 172.21.15.59:0/2885524884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.807+0000 7fd4d5669700 1 -- 172.21.15.59:0/2885524884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d00983f0 msgr2=0x7fd4d006d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.807+0000 7fd4d5669700 1 --2- 172.21.15.59:0/2885524884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d00983f0 0x7fd4d006d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.807+0000 7fd4d5669700 1 -- 172.21.15.59:0/2885524884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d009e020 msgr2=0x7fd4d006e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.807+0000 7fd4d5669700 1 --2- 172.21.15.59:0/2885524884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d009e020 0x7fd4d006e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.807+0000 7fd4d5669700 1 -- 172.21.15.59:0/2885524884 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c00094a0 con 0x7fd4d009d6f0 2023-09-30T22:34:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.807+0000 7fd4d5669700 1 --2- 172.21.15.59:0/2885524884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d009d6f0 0x7fd4d006db30 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000ebb0 tx=0x7fd4c000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.807+0000 7fd4c67fc700 1 -- 172.21.15.59:0/2885524884 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c000c850 con 0x7fd4d009d6f0 2023-09-30T22:34:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.808+0000 7fd4c67fc700 1 -- 172.21.15.59:0/2885524884 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c000c9b0 con 0x7fd4d009d6f0 2023-09-30T22:34:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.808+0000 7fd4c67fc700 1 -- 172.21.15.59:0/2885524884 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c000cd40 con 0x7fd4d009d6f0 2023-09-30T22:34:21.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.808+0000 7fd4d80ce700 1 -- 172.21.15.59:0/2885524884 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4cc009550 con 0x7fd4d009d6f0 2023-09-30T22:34:21.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.808+0000 7fd4d80ce700 1 -- 172.21.15.59:0/2885524884 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d008c2e0 con 0x7fd4d009d6f0 2023-09-30T22:34:21.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.809+0000 7fd4c67fc700 1 -- 172.21.15.59:0/2885524884 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd4c0013470 con 0x7fd4d009d6f0 2023-09-30T22:34:21.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.810+0000 7fd4d80ce700 1 -- 172.21.15.59:0/2885524884 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d009e4c0 con 0x7fd4d009d6f0 2023-09-30T22:34:21.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.810+0000 7fd4c67fc700 1 -- 172.21.15.59:0/2885524884 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd4c003f790 con 0x7fd4d009d6f0 2023-09-30T22:34:21.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.815+0000 7fd4c67fc700 1 -- 172.21.15.59:0/2885524884 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4c00232f0 con 0x7fd4d009d6f0 2023-09-30T22:34:21.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.855+0000 7f5d36ebf700 1 Processor -- start 2023-09-30T22:34:21.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.855+0000 7f5d36ebf700 1 -- start start 2023-09-30T22:34:21.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.856+0000 7f5d36ebf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d3009e1d0 0x7f5d30135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.856+0000 7f5d36ebf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d30135e50 0x7f5d30138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.856+0000 7f5d36ebf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3009f130 con 0x7f5d3009d6f0 2023-09-30T22:34:21.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.856+0000 7f5d36ebf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3009f520 con 0x7f5d30135e50 2023-09-30T22:34:21.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.856+0000 7f5d36ebf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3009e930 con 0x7f5d3009e1d0 2023-09-30T22:34:21.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.856+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d3009e1d0 0x7f5d30135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.856+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d3009e1d0 0x7f5d30135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58376/0 (socket says 172.21.15.59:58376) 2023-09-30T22:34:21.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.856+0000 7f5d3545c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d30135e50 0x7f5d30138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.856+0000 7f5d2ffff700 1 -- 172.21.15.59:0/2553822899 learned_addr learned my addr 172.21.15.59:0/2553822899 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.856+0000 7f5d3545c700 1 -- 172.21.15.59:0/2553822899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d3009e1d0 msgr2=0x7f5d30135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.856+0000 7f5d3545c700 1 --2- 172.21.15.59:0/2553822899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d3009e1d0 0x7f5d30135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.856+0000 7f5d3545c700 1 -- 172.21.15.59:0/2553822899 >> v1:172.21.15.59:6789/0 conn(0x7f5d3009d6f0 legacy=0x7f5d3009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.857+0000 7f5d3545c700 1 -- 172.21.15.59:0/2553822899 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3009b2d0 con 0x7f5d30135e50 2023-09-30T22:34:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.857+0000 7f5d2ffff700 1 --2- 172.21.15.59:0/2553822899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d3009e1d0 0x7f5d30135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.857+0000 7f5d3545c700 1 --2- 172.21.15.59:0/2553822899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d30135e50 0x7f5d30138230 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009dc0 tx=0x7f5d2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375445391dc8e987 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.857+0000 7f5d2f7fe700 1 -- 172.21.15.59:0/2553822899 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800e070 con 0x7f5d30135e50 2023-09-30T22:34:21.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.857+0000 7f5d2f7fe700 1 -- 172.21.15.59:0/2553822899 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2800bae0 con 0x7f5d30135e50 2023-09-30T22:34:21.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.857+0000 7f5d2f7fe700 1 -- 172.21.15.59:0/2553822899 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800be90 con 0x7f5d30135e50 2023-09-30T22:34:21.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.858+0000 7f5d36ebf700 1 -- 172.21.15.59:0/2553822899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d30135e50 msgr2=0x7f5d30138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.858+0000 7f5d36ebf700 1 --2- 172.21.15.59:0/2553822899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d30135e50 0x7f5d30138230 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009dc0 tx=0x7f5d2800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:21.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.858+0000 7f5d36ebf700 1 -- 172.21.15.59:0/2553822899 shutdown_connections 2023-09-30T22:34:21.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.858+0000 7f5d36ebf700 1 --2- 172.21.15.59:0/2553822899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d30135e50 0x7f5d30138230 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.858+0000 7f5d36ebf700 1 --2- 172.21.15.59:0/2553822899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d3009e1d0 0x7f5d30135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.858+0000 7f5d36ebf700 1 -- 172.21.15.59:0/2553822899 >> 172.21.15.59:0/2553822899 conn(0x7f5d30066f50 msgr2=0x7f5d3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.864+0000 7f5d36ebf700 1 -- 172.21.15.59:0/2553822899 shutdown_connections 2023-09-30T22:34:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.864+0000 7f5d36ebf700 1 -- 172.21.15.59:0/2553822899 wait complete. 2023-09-30T22:34:21.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.865+0000 7f5d36ebf700 1 Processor -- start 2023-09-30T22:34:21.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.865+0000 7f5d36ebf700 1 -- start start 2023-09-30T22:34:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.866+0000 7f5d36ebf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d3009d6f0 0x7f5d30133f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.866+0000 7f5d36ebf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d3009e1d0 0x7f5d30134490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.866+0000 7f5d36ebf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d30135e50 0x7f5d301349d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.866+0000 7f5d36ebf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3011ca30 con 0x7f5d3009e1d0 2023-09-30T22:34:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.866+0000 7f5d36ebf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3013b1c0 con 0x7f5d30135e50 2023-09-30T22:34:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.866+0000 7f5d36ebf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3011afe0 con 0x7f5d3009d6f0 2023-09-30T22:34:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.867+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d3009e1d0 0x7f5d30134490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.867+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d3009e1d0 0x7f5d30134490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56924/0 (socket says 172.21.15.59:56924) 2023-09-30T22:34:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.867+0000 7f5d2ffff700 1 -- 172.21.15.59:0/2445364431 learned_addr learned my addr 172.21.15.59:0/2445364431 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.867+0000 7f5d34c5b700 1 --2- 172.21.15.59:0/2445364431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d3009d6f0 0x7f5d30133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.867+0000 7f5d3545c700 1 --2- 172.21.15.59:0/2445364431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d30135e50 0x7f5d301349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:21.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.867+0000 7f5d2ffff700 1 -- 172.21.15.59:0/2445364431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d3009d6f0 msgr2=0x7f5d30133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.867+0000 7f5d2ffff700 1 --2- 172.21.15.59:0/2445364431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d3009d6f0 0x7f5d30133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.867+0000 7f5d2ffff700 1 -- 172.21.15.59:0/2445364431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d30135e50 msgr2=0x7f5d301349d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.867+0000 7f5d2ffff700 1 --2- 172.21.15.59:0/2445364431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d30135e50 0x7f5d301349d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.867+0000 7f5d2ffff700 1 -- 172.21.15.59:0/2445364431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c009550 con 0x7f5d3009e1d0 2023-09-30T22:34:21.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.867+0000 7f5d2ffff700 1 --2- 172.21.15.59:0/2445364431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d3009e1d0 0x7f5d30134490 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00ebe0 tx=0x7f5d1c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:21.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.868+0000 7f5d2d7fa700 1 -- 172.21.15.59:0/2445364431 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c00c850 con 0x7f5d3009e1d0 2023-09-30T22:34:21.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.868+0000 7f5d2d7fa700 1 -- 172.21.15.59:0/2445364431 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c00c9b0 con 0x7f5d3009e1d0 2023-09-30T22:34:21.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.868+0000 7f5d36ebf700 1 -- 172.21.15.59:0/2445364431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d28009a70 con 0x7f5d3009e1d0 2023-09-30T22:34:21.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.868+0000 7f5d2d7fa700 1 -- 172.21.15.59:0/2445364431 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c00cd20 con 0x7f5d3009e1d0 2023-09-30T22:34:21.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.868+0000 7f5d36ebf700 1 -- 172.21.15.59:0/2445364431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3011a850 con 0x7f5d3009e1d0 2023-09-30T22:34:21.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.869+0000 7f5d36ebf700 1 -- 172.21.15.59:0/2445364431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d301379c0 con 0x7f5d3009e1d0 2023-09-30T22:34:21.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.870+0000 7f5d2d7fa700 1 -- 172.21.15.59:0/2445364431 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d1c013470 con 0x7f5d3009e1d0 2023-09-30T22:34:21.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.870+0000 7f5d2d7fa700 1 -- 172.21.15.59:0/2445364431 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5d1c03fdf0 con 0x7f5d3009e1d0 2023-09-30T22:34:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.879+0000 7f5d2d7fa700 1 -- 172.21.15.59:0/2445364431 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d1c013720 con 0x7f5d3009e1d0 2023-09-30T22:34:21.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.906+0000 7f7b968f5700 1 -- 172.21.15.59:0/441740152 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7b9006b250 con 0x7f7b90133420 2023-09-30T22:34:21.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.906+0000 7f7b8cff9700 1 -- 172.21.15.59:0/441740152 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b800193b0 con 0x7f7b90133420 2023-09-30T22:34:21.908 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:21.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.909+0000 7f7b968f5700 1 -- 172.21.15.59:0/441740152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b90133420 msgr2=0x7f7b9009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.909+0000 7f7b968f5700 1 --2- 172.21.15.59:0/441740152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b90133420 0x7f7b9009c480 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009bc0 tx=0x7f7b80004750 comp rx=0 tx=0).stop 2023-09-30T22:34:21.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.909+0000 7f7b968f5700 1 -- 172.21.15.59:0/441740152 shutdown_connections 2023-09-30T22:34:21.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.909+0000 7f7b968f5700 1 --2- 172.21.15.59:0/441740152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b90133420 0x7f7b9009c480 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.909+0000 7f7b968f5700 1 --2- 172.21.15.59:0/441740152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b90134260 0x7f7b9009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.909+0000 7f7b968f5700 1 --2- 172.21.15.59:0/441740152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b90133e30 0x7f7b9009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.909+0000 7f7b968f5700 1 -- 172.21.15.59:0/441740152 >> 172.21.15.59:0/441740152 conn(0x7f7b900a4210 msgr2=0x7f7b901303c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:21.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.909+0000 7f7b968f5700 1 -- 172.21.15.59:0/441740152 shutdown_connections 2023-09-30T22:34:21.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.909+0000 7f7b968f5700 1 -- 172.21.15.59:0/441740152 wait complete. 2023-09-30T22:34:21.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:21.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.979+0000 7f0f65d9e700 1 -- 172.21.15.59:0/647607364 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0f60122880 con 0x7f0f601338a0 2023-09-30T22:34:21.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.979+0000 7f0f47fff700 1 -- 172.21.15.59:0/647607364 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f5000e280 con 0x7f0f601338a0 2023-09-30T22:34:21.981 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:21.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.982+0000 7f0f65d9e700 1 -- 172.21.15.59:0/647607364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f601338a0 msgr2=0x7f0f6009e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:21.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.982+0000 7f0f65d9e700 1 --2- 172.21.15.59:0/647607364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f601338a0 0x7f0f6009e1b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000c4e0 tx=0x7f0f5000c8a0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.982+0000 7f0f65d9e700 1 -- 172.21.15.59:0/647607364 shutdown_connections 2023-09-30T22:34:21.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.982+0000 7f0f65d9e700 1 --2- 172.21.15.59:0/647607364 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f60139030 0x7f0f601cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.982+0000 7f0f65d9e700 1 --2- 172.21.15.59:0/647607364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f601338a0 0x7f0f6009e1b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.982+0000 7f0f65d9e700 1 --2- 172.21.15.59:0/647607364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f60136710 0x7f0f6009e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:21.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.982+0000 7f0f65d9e700 1 -- 172.21.15.59:0/647607364 >> 172.21.15.59:0/647607364 conn(0x7f0f600a2aa0 msgr2=0x7f0f601344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:21.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.982+0000 7f0f65d9e700 1 -- 172.21.15.59:0/647607364 shutdown_connections 2023-09-30T22:34:21.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:21.982+0000 7f0f65d9e700 1 -- 172.21.15.59:0/647607364 wait complete. 2023-09-30T22:34:21.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:22.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.033+0000 7fd4d80ce700 1 -- 172.21.15.59:0/2885524884 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd4d008c5e0 con 0x7fd4d009d6f0 2023-09-30T22:34:22.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.033+0000 7fd4c67fc700 1 -- 172.21.15.59:0/2885524884 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd4d008c5e0 con 0x7fd4d009d6f0 2023-09-30T22:34:22.035 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:22.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.036+0000 7fd4d80ce700 1 -- 172.21.15.59:0/2885524884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d009d6f0 msgr2=0x7fd4d006db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:22.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.036+0000 7fd4d80ce700 1 --2- 172.21.15.59:0/2885524884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d009d6f0 0x7fd4d006db30 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000ebb0 tx=0x7fd4c000eec0 comp rx=0 tx=0).stop 2023-09-30T22:34:22.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.036+0000 7fd4d80ce700 1 -- 172.21.15.59:0/2885524884 shutdown_connections 2023-09-30T22:34:22.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.036+0000 7fd4d80ce700 1 --2- 172.21.15.59:0/2885524884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d009e020 0x7fd4d006e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:22.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.036+0000 7fd4d80ce700 1 --2- 172.21.15.59:0/2885524884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d00983f0 0x7fd4d006d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:22.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.036+0000 7fd4d80ce700 1 --2- 172.21.15.59:0/2885524884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4d009d6f0 0x7fd4d006db30 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:22.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.036+0000 7fd4d80ce700 1 -- 172.21.15.59:0/2885524884 >> 172.21.15.59:0/2885524884 conn(0x7fd4d009f470 msgr2=0x7fd4d01306e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:22.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.036+0000 7fd4d80ce700 1 -- 172.21.15.59:0/2885524884 shutdown_connections 2023-09-30T22:34:22.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.036+0000 7fd4d80ce700 1 -- 172.21.15.59:0/2885524884 wait complete. 2023-09-30T22:34:22.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:22.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.087+0000 7f5d36ebf700 1 -- 172.21.15.59:0/2445364431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5d3011c230 con 0x7f5d3009e1d0 2023-09-30T22:34:22.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.087+0000 7f5d2d7fa700 1 -- 172.21.15.59:0/2445364431 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d1c021020 con 0x7f5d3009e1d0 2023-09-30T22:34:22.088 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:22.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.089+0000 7f5d36ebf700 1 -- 172.21.15.59:0/2445364431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d3009e1d0 msgr2=0x7f5d30134490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:22.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.089+0000 7f5d36ebf700 1 --2- 172.21.15.59:0/2445364431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d3009e1d0 0x7f5d30134490 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00ebe0 tx=0x7f5d1c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:34:22.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.089+0000 7f5d36ebf700 1 -- 172.21.15.59:0/2445364431 shutdown_connections 2023-09-30T22:34:22.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.089+0000 7f5d36ebf700 1 --2- 172.21.15.59:0/2445364431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d3009d6f0 0x7f5d30133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:22.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.089+0000 7f5d36ebf700 1 --2- 172.21.15.59:0/2445364431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d30135e50 0x7f5d301349d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:22.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.089+0000 7f5d36ebf700 1 --2- 172.21.15.59:0/2445364431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d3009e1d0 0x7f5d30134490 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:22.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.089+0000 7f5d36ebf700 1 -- 172.21.15.59:0/2445364431 >> 172.21.15.59:0/2445364431 conn(0x7f5d30066f50 msgr2=0x7f5d3009a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:22.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.089+0000 7f5d36ebf700 1 -- 172.21.15.59:0/2445364431 shutdown_connections 2023-09-30T22:34:22.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:22.089+0000 7f5d36ebf700 1 -- 172.21.15.59:0/2445364431 wait complete. 2023-09-30T22:34:22.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:22.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:22.998 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:23.051 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.072+0000 7f474e05e700 1 Processor -- start 2023-09-30T22:34:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.072+0000 7f474e05e700 1 -- start start 2023-09-30T22:34:23.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.073+0000 7f474e05e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47480a0a30 0x7f47480a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.073+0000 7f474e05e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4748134170 0x7f474813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.073+0000 7f474e05e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474809edd0 con 0x7f47480a1340 2023-09-30T22:34:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.073+0000 7f474e05e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f474809e1f0 con 0x7f47480a0a30 2023-09-30T22:34:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.073+0000 7f474e05e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474809dc50 con 0x7f4748134170 2023-09-30T22:34:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.073+0000 7f47477fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47480a0a30 0x7f47480a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.073+0000 7f47477fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47480a0a30 0x7f47480a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56932/0 (socket says 172.21.15.59:56932) 2023-09-30T22:34:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.073+0000 7f47477fe700 1 -- 172.21.15.59:0/991613949 learned_addr learned my addr 172.21.15.59:0/991613949 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.073+0000 7f4747fff700 1 --2- 172.21.15.59:0/991613949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4748134170 0x7f474813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.073+0000 7f47477fe700 1 -- 172.21.15.59:0/991613949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4748134170 msgr2=0x7f474813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.073+0000 7f47477fe700 1 --2- 172.21.15.59:0/991613949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4748134170 0x7f474813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.073+0000 7f47477fe700 1 -- 172.21.15.59:0/991613949 >> v1:172.21.15.59:6789/0 conn(0x7f47480a1340 legacy=0x7f4748133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.073+0000 7f47477fe700 1 -- 172.21.15.59:0/991613949 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47480a1fe0 con 0x7f47480a0a30 2023-09-30T22:34:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.073+0000 7f47477fe700 1 --2- 172.21.15.59:0/991613949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47480a0a30 0x7f47480a0e00 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f47380098f0 tx=0x7f4738009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67f09b3c2b3b903 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.074+0000 7f47467fc700 1 -- 172.21.15.59:0/991613949 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738011830 con 0x7f47480a0a30 2023-09-30T22:34:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.074+0000 7f47467fc700 1 -- 172.21.15.59:0/991613949 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4738011990 con 0x7f47480a0a30 2023-09-30T22:34:23.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.074+0000 7f47467fc700 1 -- 172.21.15.59:0/991613949 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738011d20 con 0x7f47480a0a30 2023-09-30T22:34:23.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.074+0000 7f474e05e700 1 -- 172.21.15.59:0/991613949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47480a0a30 msgr2=0x7f47480a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.074+0000 7f474e05e700 1 --2- 172.21.15.59:0/991613949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47480a0a30 0x7f47480a0e00 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f47380098f0 tx=0x7f4738009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.074+0000 7f474e05e700 1 -- 172.21.15.59:0/991613949 shutdown_connections 2023-09-30T22:34:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.074+0000 7f474e05e700 1 --2- 172.21.15.59:0/991613949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47480a0a30 0x7f47480a0e00 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.074+0000 7f474e05e700 1 --2- 172.21.15.59:0/991613949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4748134170 0x7f474813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.074+0000 7f474e05e700 1 -- 172.21.15.59:0/991613949 >> 172.21.15.59:0/991613949 conn(0x7f47480a6550 msgr2=0x7f47480a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.075+0000 7f474e05e700 1 -- 172.21.15.59:0/991613949 shutdown_connections 2023-09-30T22:34:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.075+0000 7f474e05e700 1 -- 172.21.15.59:0/991613949 wait complete. 2023-09-30T22:34:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.076+0000 7f474e05e700 1 Processor -- start 2023-09-30T22:34:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.076+0000 7f474e05e700 1 -- start start 2023-09-30T22:34:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.076+0000 7f474e05e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47480a0a30 0x7f47481228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.076+0000 7f474e05e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47480a1340 0x7f4748122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.076+0000 7f474e05e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4748134170 0x7f4748123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.076+0000 7f474e05e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4748124720 con 0x7f47480a1340 2023-09-30T22:34:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.076+0000 7f474e05e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4748126200 con 0x7f47480a0a30 2023-09-30T22:34:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.076+0000 7f474e05e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47481244f0 con 0x7f4748134170 2023-09-30T22:34:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.076+0000 7f47477fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47480a0a30 0x7f47481228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.076+0000 7f47477fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47480a0a30 0x7f47481228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58412/0 (socket says 172.21.15.59:58412) 2023-09-30T22:34:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.076+0000 7f47477fe700 1 -- 172.21.15.59:0/248196941 learned_addr learned my addr 172.21.15.59:0/248196941 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.076+0000 7f4746ffd700 1 --2- 172.21.15.59:0/248196941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47480a1340 0x7f4748122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.077+0000 7f4747fff700 1 --2- 172.21.15.59:0/248196941 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4748134170 0x7f4748123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.077+0000 7f47477fe700 1 -- 172.21.15.59:0/248196941 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4748134170 msgr2=0x7f4748123360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.077+0000 7f47477fe700 1 --2- 172.21.15.59:0/248196941 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4748134170 0x7f4748123360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.077+0000 7f47477fe700 1 -- 172.21.15.59:0/248196941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47480a1340 msgr2=0x7f4748122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.077+0000 7f47477fe700 1 --2- 172.21.15.59:0/248196941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47480a1340 0x7f4748122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.077+0000 7f47477fe700 1 -- 172.21.15.59:0/248196941 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4738009550 con 0x7f47480a0a30 2023-09-30T22:34:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.077+0000 7f4746ffd700 1 --2- 172.21.15.59:0/248196941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47480a1340 0x7f4748122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.077+0000 7f47477fe700 1 --2- 172.21.15.59:0/248196941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47480a0a30 0x7f47481228e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4738000c00 tx=0x7f4738004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.077+0000 7f472ffff700 1 -- 172.21.15.59:0/248196941 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47380036a0 con 0x7f47480a0a30 2023-09-30T22:34:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.077+0000 7f472ffff700 1 -- 172.21.15.59:0/248196941 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4738003800 con 0x7f47480a0a30 2023-09-30T22:34:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.077+0000 7f474e05e700 1 -- 172.21.15.59:0/248196941 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47480a25e0 con 0x7f47480a0a30 2023-09-30T22:34:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.077+0000 7f472ffff700 1 -- 172.21.15.59:0/248196941 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738003bb0 con 0x7f47480a0a30 2023-09-30T22:34:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.078+0000 7f474e05e700 1 -- 172.21.15.59:0/248196941 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4748124ce0 con 0x7f47480a0a30 2023-09-30T22:34:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.078+0000 7f472ffff700 1 -- 172.21.15.59:0/248196941 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4738021070 con 0x7f47480a0a30 2023-09-30T22:34:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.079+0000 7f472ffff700 1 -- 172.21.15.59:0/248196941 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4738040ae0 con 0x7f47480a0a30 2023-09-30T22:34:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.079+0000 7f474e05e700 1 -- 172.21.15.59:0/248196941 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4748074ea0 con 0x7f47480a0a30 2023-09-30T22:34:23.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.085+0000 7f472ffff700 1 -- 172.21.15.59:0/248196941 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4738015020 con 0x7f47480a0a30 2023-09-30T22:34:23.105 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.146+0000 7fd987084700 1 Processor -- start 2023-09-30T22:34:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.146+0000 7fd987084700 1 -- start start 2023-09-30T22:34:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.147+0000 7fd987084700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98009d6f0 0x7fd98009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.147+0000 7fd987084700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98009e000 0x7fd9801339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.147+0000 7fd987084700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98009b120 con 0x7fd98009e410 2023-09-30T22:34:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.147+0000 7fd987084700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98006b460 con 0x7fd98009e000 2023-09-30T22:34:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.147+0000 7fd987084700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd98009a7e0 con 0x7fd98009d6f0 2023-09-30T22:34:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.147+0000 7fd984e20700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98009d6f0 0x7fd98009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.147+0000 7fd985621700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd98009e410 0x7fd980133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52820/0 (socket says 172.21.15.59:52820) 2023-09-30T22:34:23.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.147+0000 7fd985621700 1 -- 172.21.15.59:0/136797203 learned_addr learned my addr 172.21.15.59:0/136797203 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:23.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.147+0000 7fd97ffff700 1 --2- 172.21.15.59:0/136797203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98009e000 0x7fd9801339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.148+0000 7fd984e20700 1 -- 172.21.15.59:0/136797203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98009e000 msgr2=0x7fd9801339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:23.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.148+0000 7fd984e20700 1 --2- 172.21.15.59:0/136797203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98009e000 0x7fd9801339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.148+0000 7fd984e20700 1 -- 172.21.15.59:0/136797203 >> v1:172.21.15.59:6789/0 conn(0x7fd98009e410 legacy=0x7fd980133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.148+0000 7fd984e20700 1 -- 172.21.15.59:0/136797203 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98009a500 con 0x7fd98009d6f0 2023-09-30T22:34:23.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.148+0000 7fd984e20700 1 --2- 172.21.15.59:0/136797203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98009d6f0 0x7fd98009dac0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd9740098a0 tx=0x7fd974009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4606f7e3cede60b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.148+0000 7fd97f7fe700 1 -- 172.21.15.59:0/136797203 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974011830 con 0x7fd98009d6f0 2023-09-30T22:34:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.148+0000 7fd97f7fe700 1 -- 172.21.15.59:0/136797203 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd974011990 con 0x7fd98009d6f0 2023-09-30T22:34:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.148+0000 7fd97f7fe700 1 -- 172.21.15.59:0/136797203 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974011d40 con 0x7fd98009d6f0 2023-09-30T22:34:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.149+0000 7fd987084700 1 -- 172.21.15.59:0/136797203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98009d6f0 msgr2=0x7fd98009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.149+0000 7fd987084700 1 --2- 172.21.15.59:0/136797203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98009d6f0 0x7fd98009dac0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd9740098a0 tx=0x7fd974009bb0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.149+0000 7fd987084700 1 -- 172.21.15.59:0/136797203 shutdown_connections 2023-09-30T22:34:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.149+0000 7fd987084700 1 --2- 172.21.15.59:0/136797203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98009d6f0 0x7fd98009dac0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.149+0000 7fd987084700 1 --2- 172.21.15.59:0/136797203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98009e000 0x7fd9801339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.149+0000 7fd987084700 1 -- 172.21.15.59:0/136797203 >> 172.21.15.59:0/136797203 conn(0x7fd980066f50 msgr2=0x7fd98009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.149+0000 7fd987084700 1 -- 172.21.15.59:0/136797203 shutdown_connections 2023-09-30T22:34:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.149+0000 7fd987084700 1 -- 172.21.15.59:0/136797203 wait complete. 2023-09-30T22:34:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.151+0000 7fd987084700 1 Processor -- start 2023-09-30T22:34:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.151+0000 7fd987084700 1 -- start start 2023-09-30T22:34:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.152+0000 7fd987084700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98009d6f0 0x7fd9801a6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.152+0000 7fd987084700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98009e000 0x7fd9801a6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.152+0000 7fd987084700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd98009e410 0x7fd9801a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.152+0000 7fd987084700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9801a74d0 con 0x7fd98009e410 2023-09-30T22:34:23.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.152+0000 7fd987084700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9801a7ba0 con 0x7fd98009e000 2023-09-30T22:34:23.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.152+0000 7fd987084700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9801a8df0 con 0x7fd98009d6f0 2023-09-30T22:34:23.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.152+0000 7fd97ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98009e000 0x7fd9801a6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.152+0000 7fd97ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98009e000 0x7fd9801a6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58430/0 (socket says 172.21.15.59:58430) 2023-09-30T22:34:23.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.152+0000 7fd97ffff700 1 -- 172.21.15.59:0/2441653957 learned_addr learned my addr 172.21.15.59:0/2441653957 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:23.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.152+0000 7fd984e20700 1 --2- 172.21.15.59:0/2441653957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98009d6f0 0x7fd9801a6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.152+0000 7fd985621700 1 --2- 172.21.15.59:0/2441653957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd98009e410 0x7fd9801a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.153+0000 7fd984e20700 1 -- 172.21.15.59:0/2441653957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98009e000 msgr2=0x7fd9801a6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.153+0000 7fd984e20700 1 --2- 172.21.15.59:0/2441653957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98009e000 0x7fd9801a6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.153+0000 7fd984e20700 1 -- 172.21.15.59:0/2441653957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd98009e410 msgr2=0x7fd9801a6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.153+0000 7fd984e20700 1 --2- 172.21.15.59:0/2441653957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd98009e410 0x7fd9801a6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.153+0000 7fd984e20700 1 -- 172.21.15.59:0/2441653957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9740094a0 con 0x7fd98009d6f0 2023-09-30T22:34:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.153+0000 7fd984e20700 1 --2- 172.21.15.59:0/2441653957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98009d6f0 0x7fd9801a6020 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd974016000 tx=0x7fd974004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.153+0000 7fd97d7fa700 1 -- 172.21.15.59:0/2441653957 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974004510 con 0x7fd98009d6f0 2023-09-30T22:34:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.153+0000 7fd97d7fa700 1 -- 172.21.15.59:0/2441653957 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97401f070 con 0x7fd98009d6f0 2023-09-30T22:34:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.153+0000 7fd97d7fa700 1 -- 172.21.15.59:0/2441653957 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9740038e0 con 0x7fd98009d6f0 2023-09-30T22:34:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.153+0000 7fd987084700 1 -- 172.21.15.59:0/2441653957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9801a97d0 con 0x7fd98009d6f0 2023-09-30T22:34:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.154+0000 7fd987084700 1 -- 172.21.15.59:0/2441653957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98009c710 con 0x7fd98009d6f0 2023-09-30T22:34:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.155+0000 7fd97d7fa700 1 -- 172.21.15.59:0/2441653957 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd974003a40 con 0x7fd98009d6f0 2023-09-30T22:34:23.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.155+0000 7fd97d7fa700 1 -- 172.21.15.59:0/2441653957 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd974021070 con 0x7fd98009d6f0 2023-09-30T22:34:23.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.155+0000 7fd987084700 1 -- 172.21.15.59:0/2441653957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd980074ea0 con 0x7fd98009d6f0 2023-09-30T22:34:23.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.160+0000 7fd97d7fa700 1 -- 172.21.15.59:0/2441653957 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd97402b080 con 0x7fd98009d6f0 2023-09-30T22:34:23.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.206+0000 7f04aaab4700 1 Processor -- start 2023-09-30T22:34:23.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.206+0000 7f04aaab4700 1 -- start start 2023-09-30T22:34:23.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.207+0000 7f04aaab4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a409e1d0 0x7f04a4135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.207+0000 7f04aaab4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a4135e50 0x7f04a4138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.207+0000 7f04aaab4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a409f130 con 0x7f04a409d6f0 2023-09-30T22:34:23.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.207+0000 7f04aaab4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a409f520 con 0x7f04a4135e50 2023-09-30T22:34:23.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.207+0000 7f04aaab4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04a409e930 con 0x7f04a409e1d0 2023-09-30T22:34:23.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.207+0000 7f04a3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a409e1d0 0x7f04a4135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.207+0000 7f04a8850700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f04a409d6f0 0x7f04a409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52834/0 (socket says 172.21.15.59:52834) 2023-09-30T22:34:23.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.207+0000 7f04a8850700 1 -- 172.21.15.59:0/2737965319 learned_addr learned my addr 172.21.15.59:0/2737965319 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:23.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.207+0000 7f04a9051700 1 --2- 172.21.15.59:0/2737965319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a4135e50 0x7f04a4138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.207+0000 7f04a9051700 1 -- 172.21.15.59:0/2737965319 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a409e1d0 msgr2=0x7f04a4135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:23.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.207+0000 7f04a9051700 1 --2- 172.21.15.59:0/2737965319 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a409e1d0 0x7f04a4135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.207+0000 7f04a9051700 1 -- 172.21.15.59:0/2737965319 >> v1:172.21.15.59:6789/0 conn(0x7f04a409d6f0 legacy=0x7f04a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.207+0000 7f04a9051700 1 -- 172.21.15.59:0/2737965319 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a409b2d0 con 0x7f04a4135e50 2023-09-30T22:34:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.208+0000 7f04a9051700 1 --2- 172.21.15.59:0/2737965319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a4135e50 0x7f04a4138230 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f049c00bfd0 tx=0x7f049c00d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa30c815a87f927a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.208+0000 7f04a37fe700 1 -- 172.21.15.59:0/2737965319 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c010070 con 0x7f04a4135e50 2023-09-30T22:34:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.208+0000 7f04a37fe700 1 -- 172.21.15.59:0/2737965319 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049c00b2e0 con 0x7f04a4135e50 2023-09-30T22:34:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.208+0000 7f04a37fe700 1 -- 172.21.15.59:0/2737965319 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c00dc70 con 0x7f04a4135e50 2023-09-30T22:34:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.209+0000 7f04aaab4700 1 -- 172.21.15.59:0/2737965319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a4135e50 msgr2=0x7f04a4138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.209+0000 7f04aaab4700 1 --2- 172.21.15.59:0/2737965319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a4135e50 0x7f04a4138230 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f049c00bfd0 tx=0x7f049c00d330 comp rx=0 tx=0).stop 2023-09-30T22:34:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.209+0000 7f04aaab4700 1 -- 172.21.15.59:0/2737965319 shutdown_connections 2023-09-30T22:34:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.209+0000 7f04aaab4700 1 --2- 172.21.15.59:0/2737965319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a4135e50 0x7f04a4138230 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.209+0000 7f04aaab4700 1 --2- 172.21.15.59:0/2737965319 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a409e1d0 0x7f04a4135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.209+0000 7f04aaab4700 1 -- 172.21.15.59:0/2737965319 >> 172.21.15.59:0/2737965319 conn(0x7f04a4066f50 msgr2=0x7f04a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.209+0000 7f04aaab4700 1 -- 172.21.15.59:0/2737965319 shutdown_connections 2023-09-30T22:34:23.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.209+0000 7f04aaab4700 1 -- 172.21.15.59:0/2737965319 wait complete. 2023-09-30T22:34:23.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.210+0000 7f04aaab4700 1 Processor -- start 2023-09-30T22:34:23.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.210+0000 7f04aaab4700 1 -- start start 2023-09-30T22:34:23.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.210+0000 7f04aaab4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a409d6f0 0x7f04a41c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.210+0000 7f04aaab4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a409e1d0 0x7f04a41c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04aaab4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a4135e50 0x7f04a4120b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04aaab4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a4123ff0 con 0x7f04a4135e50 2023-09-30T22:34:23.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04aaab4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a41bd270 con 0x7f04a409d6f0 2023-09-30T22:34:23.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04aaab4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04a4135550 con 0x7f04a409e1d0 2023-09-30T22:34:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04a8850700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a409d6f0 0x7f04a41c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04a8850700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a409d6f0 0x7f04a41c8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58442/0 (socket says 172.21.15.59:58442) 2023-09-30T22:34:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04a8850700 1 -- 172.21.15.59:0/3624398556 learned_addr learned my addr 172.21.15.59:0/3624398556 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04a9051700 1 --2- 172.21.15.59:0/3624398556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a4135e50 0x7f04a4120b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04a3fff700 1 --2- 172.21.15.59:0/3624398556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a409e1d0 0x7f04a41c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04a8850700 1 -- 172.21.15.59:0/3624398556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a409e1d0 msgr2=0x7f04a41c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04a8850700 1 --2- 172.21.15.59:0/3624398556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a409e1d0 0x7f04a41c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04a8850700 1 -- 172.21.15.59:0/3624398556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a4135e50 msgr2=0x7f04a4120b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04a8850700 1 --2- 172.21.15.59:0/3624398556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a4135e50 0x7f04a4120b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04a8850700 1 -- 172.21.15.59:0/3624398556 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c00bc80 con 0x7f04a409d6f0 2023-09-30T22:34:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04a3fff700 1 --2- 172.21.15.59:0/3624398556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a409e1d0 0x7f04a41c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.211+0000 7f04a8850700 1 --2- 172.21.15.59:0/3624398556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a409d6f0 0x7f04a41c8640 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f049800c480 tx=0x7f049800c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.212+0000 7f04a17fa700 1 -- 172.21.15.59:0/3624398556 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0498005d70 con 0x7f04a409d6f0 2023-09-30T22:34:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.212+0000 7f04a17fa700 1 -- 172.21.15.59:0/3624398556 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04980070d0 con 0x7f04a409d6f0 2023-09-30T22:34:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.212+0000 7f04aaab4700 1 -- 172.21.15.59:0/3624398556 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a409c700 con 0x7f04a409d6f0 2023-09-30T22:34:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.212+0000 7f04a17fa700 1 -- 172.21.15.59:0/3624398556 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0498007440 con 0x7f04a409d6f0 2023-09-30T22:34:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.212+0000 7f04aaab4700 1 -- 172.21.15.59:0/3624398556 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a41c90c0 con 0x7f04a409d6f0 2023-09-30T22:34:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.213+0000 7f04a17fa700 1 -- 172.21.15.59:0/3624398556 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04980075a0 con 0x7f04a409d6f0 2023-09-30T22:34:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.213+0000 7f04aaab4700 1 -- 172.21.15.59:0/3624398556 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a4074ea0 con 0x7f04a409d6f0 2023-09-30T22:34:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.213+0000 7f04a17fa700 1 -- 172.21.15.59:0/3624398556 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f049803eb10 con 0x7f04a409d6f0 2023-09-30T22:34:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.218+0000 7f04a17fa700 1 -- 172.21.15.59:0/3624398556 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0498011be0 con 0x7f04a409d6f0 2023-09-30T22:34:23.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.256+0000 7fba36365700 1 Processor -- start 2023-09-30T22:34:23.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.257+0000 7fba36365700 1 -- start start 2023-09-30T22:34:23.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.257+0000 7fba36365700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba301338a0 0x7fba30133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.257+0000 7fba36365700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba3009de50 0x7fba3009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.257+0000 7fba36365700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba3006ef30 con 0x7fba3009e760 2023-09-30T22:34:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.257+0000 7fba36365700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3006fef0 con 0x7fba3009de50 2023-09-30T22:34:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.257+0000 7fba36365700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba301334b0 con 0x7fba301338a0 2023-09-30T22:34:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.257+0000 7fba2ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba301338a0 0x7fba30133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.257+0000 7fba2f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba3009de50 0x7fba3009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.257+0000 7fba2f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba3009de50 0x7fba3009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58450/0 (socket says 172.21.15.59:58450) 2023-09-30T22:34:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.257+0000 7fba2ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba301338a0 0x7fba30133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40892/0 (socket says 172.21.15.59:40892) 2023-09-30T22:34:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.257+0000 7fba2f7fe700 1 -- 172.21.15.59:0/4151615156 learned_addr learned my addr 172.21.15.59:0/4151615156 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.258+0000 7fba2f7fe700 1 -- 172.21.15.59:0/4151615156 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba301338a0 msgr2=0x7fba30133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.258+0000 7fba2f7fe700 1 --2- 172.21.15.59:0/4151615156 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba301338a0 0x7fba30133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.258+0000 7fba2f7fe700 1 -- 172.21.15.59:0/4151615156 >> v1:172.21.15.59:6789/0 conn(0x7fba3009e760 legacy=0x7fba3013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.258+0000 7fba2f7fe700 1 -- 172.21.15.59:0/4151615156 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3006fc30 con 0x7fba3009de50 2023-09-30T22:34:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.258+0000 7fba2ffff700 1 --2- 172.21.15.59:0/4151615156 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba301338a0 0x7fba30133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.258+0000 7fba2f7fe700 1 --2- 172.21.15.59:0/4151615156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba3009de50 0x7fba3009e220 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fba24009920 tx=0x7fba24009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfed6da6f9c0f955 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.258+0000 7fba2effd700 1 -- 172.21.15.59:0/4151615156 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba24004230 con 0x7fba3009de50 2023-09-30T22:34:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.258+0000 7fba2effd700 1 -- 172.21.15.59:0/4151615156 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba24004390 con 0x7fba3009de50 2023-09-30T22:34:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.258+0000 7fba2effd700 1 -- 172.21.15.59:0/4151615156 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba240036a0 con 0x7fba3009de50 2023-09-30T22:34:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.259+0000 7fba36365700 1 -- 172.21.15.59:0/4151615156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba3009de50 msgr2=0x7fba3009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.259+0000 7fba36365700 1 --2- 172.21.15.59:0/4151615156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba3009de50 0x7fba3009e220 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fba24009920 tx=0x7fba24009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.259+0000 7fba36365700 1 -- 172.21.15.59:0/4151615156 shutdown_connections 2023-09-30T22:34:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.259+0000 7fba36365700 1 --2- 172.21.15.59:0/4151615156 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba301338a0 0x7fba30133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.259+0000 7fba36365700 1 --2- 172.21.15.59:0/4151615156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba3009de50 0x7fba3009e220 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.259+0000 7fba36365700 1 -- 172.21.15.59:0/4151615156 >> 172.21.15.59:0/4151615156 conn(0x7fba300a2aa0 msgr2=0x7fba300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.259+0000 7fba36365700 1 -- 172.21.15.59:0/4151615156 shutdown_connections 2023-09-30T22:34:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.259+0000 7fba36365700 1 -- 172.21.15.59:0/4151615156 wait complete. 2023-09-30T22:34:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.260+0000 7fba36365700 1 Processor -- start 2023-09-30T22:34:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.260+0000 7fba36365700 1 -- start start 2023-09-30T22:34:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba36365700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba3009de50 0x7fba3011fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba36365700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba3009e760 0x7fba301200f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba36365700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba301338a0 0x7fba30120630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba36365700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba30122dd0 con 0x7fba301338a0 2023-09-30T22:34:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba36365700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba301217c0 con 0x7fba3009de50 2023-09-30T22:34:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba36365700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba30130780 con 0x7fba3009e760 2023-09-30T22:34:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba34902700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba301338a0 0x7fba30120630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba2ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba3009de50 0x7fba3011fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba34902700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba301338a0 0x7fba30120630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56960/0 (socket says 172.21.15.59:56960) 2023-09-30T22:34:23.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba34902700 1 -- 172.21.15.59:0/358142659 learned_addr learned my addr 172.21.15.59:0/358142659 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:23.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba2ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba3009de50 0x7fba3011fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58466/0 (socket says 172.21.15.59:58466) 2023-09-30T22:34:23.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba2f7fe700 1 --2- 172.21.15.59:0/358142659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba3009e760 0x7fba301200f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba34902700 1 -- 172.21.15.59:0/358142659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba3009e760 msgr2=0x7fba301200f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba34902700 1 --2- 172.21.15.59:0/358142659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba3009e760 0x7fba301200f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba34902700 1 -- 172.21.15.59:0/358142659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba3009de50 msgr2=0x7fba3011fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba34902700 1 --2- 172.21.15.59:0/358142659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba3009de50 0x7fba3011fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.261+0000 7fba34902700 1 -- 172.21.15.59:0/358142659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba200094a0 con 0x7fba301338a0 2023-09-30T22:34:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.262+0000 7fba34902700 1 --2- 172.21.15.59:0/358142659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba301338a0 0x7fba30120630 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fba2800cc40 tx=0x7fba2800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.262+0000 7fba2cff9700 1 -- 172.21.15.59:0/358142659 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2800aa80 con 0x7fba301338a0 2023-09-30T22:34:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.262+0000 7fba2cff9700 1 -- 172.21.15.59:0/358142659 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2800abe0 con 0x7fba301338a0 2023-09-30T22:34:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.262+0000 7fba2cff9700 1 -- 172.21.15.59:0/358142659 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28012420 con 0x7fba301338a0 2023-09-30T22:34:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.262+0000 7fba36365700 1 -- 172.21.15.59:0/358142659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba24009550 con 0x7fba301338a0 2023-09-30T22:34:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.262+0000 7fba36365700 1 -- 172.21.15.59:0/358142659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3006f640 con 0x7fba301338a0 2023-09-30T22:34:23.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.263+0000 7fba36365700 1 -- 172.21.15.59:0/358142659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba30074ea0 con 0x7fba301338a0 2023-09-30T22:34:23.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.264+0000 7fba2cff9700 1 -- 172.21.15.59:0/358142659 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba28012580 con 0x7fba301338a0 2023-09-30T22:34:23.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.264+0000 7fba2cff9700 1 -- 172.21.15.59:0/358142659 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fba2803fc70 con 0x7fba301338a0 2023-09-30T22:34:23.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.269+0000 7fba2cff9700 1 -- 172.21.15.59:0/358142659 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba280224e0 con 0x7fba301338a0 2023-09-30T22:34:23.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.315+0000 7f474e05e700 1 -- 172.21.15.59:0/248196941 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f47480a28c0 con 0x7f47480a0a30 2023-09-30T22:34:23.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.315+0000 7f472ffff700 1 -- 172.21.15.59:0/248196941 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f473803ee60 con 0x7f47480a0a30 2023-09-30T22:34:23.317 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:23.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.318+0000 7f474e05e700 1 -- 172.21.15.59:0/248196941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47480a0a30 msgr2=0x7f47481228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.318+0000 7f474e05e700 1 --2- 172.21.15.59:0/248196941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47480a0a30 0x7f47481228e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4738000c00 tx=0x7f4738004750 comp rx=0 tx=0).stop 2023-09-30T22:34:23.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.318+0000 7f474e05e700 1 -- 172.21.15.59:0/248196941 shutdown_connections 2023-09-30T22:34:23.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.318+0000 7f474e05e700 1 --2- 172.21.15.59:0/248196941 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4748134170 0x7f4748123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.318+0000 7f474e05e700 1 --2- 172.21.15.59:0/248196941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47480a0a30 0x7f47481228e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.318+0000 7f474e05e700 1 --2- 172.21.15.59:0/248196941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47480a1340 0x7f4748122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.318+0000 7f474e05e700 1 -- 172.21.15.59:0/248196941 >> 172.21.15.59:0/248196941 conn(0x7f47480a6550 msgr2=0x7f474809ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:23.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.318+0000 7f474e05e700 1 -- 172.21.15.59:0/248196941 shutdown_connections 2023-09-30T22:34:23.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.318+0000 7f474e05e700 1 -- 172.21.15.59:0/248196941 wait complete. 2023-09-30T22:34:23.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:23.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.391+0000 7fd987084700 1 -- 172.21.15.59:0/2441653957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd98006c360 con 0x7fd98009d6f0 2023-09-30T22:34:23.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.392+0000 7fd97d7fa700 1 -- 172.21.15.59:0/2441653957 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd97401a430 con 0x7fd98009d6f0 2023-09-30T22:34:23.393 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:23.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.395+0000 7fd987084700 1 -- 172.21.15.59:0/2441653957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98009d6f0 msgr2=0x7fd9801a6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.395+0000 7fd987084700 1 --2- 172.21.15.59:0/2441653957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98009d6f0 0x7fd9801a6020 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd974016000 tx=0x7fd974004750 comp rx=0 tx=0).stop 2023-09-30T22:34:23.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.395+0000 7fd987084700 1 -- 172.21.15.59:0/2441653957 shutdown_connections 2023-09-30T22:34:23.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.395+0000 7fd987084700 1 --2- 172.21.15.59:0/2441653957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98009d6f0 0x7fd9801a6020 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.395+0000 7fd987084700 1 --2- 172.21.15.59:0/2441653957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd98009e410 0x7fd9801a6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.395+0000 7fd987084700 1 --2- 172.21.15.59:0/2441653957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98009e000 0x7fd9801a6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.395+0000 7fd987084700 1 -- 172.21.15.59:0/2441653957 >> 172.21.15.59:0/2441653957 conn(0x7fd980066f50 msgr2=0x7fd9801baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:23.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.395+0000 7fd987084700 1 -- 172.21.15.59:0/2441653957 shutdown_connections 2023-09-30T22:34:23.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.395+0000 7fd987084700 1 -- 172.21.15.59:0/2441653957 wait complete. 2023-09-30T22:34:23.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:23.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.443+0000 7f04aaab4700 1 -- 172.21.15.59:0/3624398556 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f04a406c360 con 0x7f04a409d6f0 2023-09-30T22:34:23.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.443+0000 7f04a17fa700 1 -- 172.21.15.59:0/3624398556 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0498017020 con 0x7f04a409d6f0 2023-09-30T22:34:23.445 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:23.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.446+0000 7f04aaab4700 1 -- 172.21.15.59:0/3624398556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a409d6f0 msgr2=0x7f04a41c8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.446+0000 7f04aaab4700 1 --2- 172.21.15.59:0/3624398556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a409d6f0 0x7f04a41c8640 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f049800c480 tx=0x7f049800c790 comp rx=0 tx=0).stop 2023-09-30T22:34:23.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.446+0000 7f04aaab4700 1 -- 172.21.15.59:0/3624398556 shutdown_connections 2023-09-30T22:34:23.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.446+0000 7f04aaab4700 1 --2- 172.21.15.59:0/3624398556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04a4135e50 0x7f04a4120b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.446+0000 7f04aaab4700 1 --2- 172.21.15.59:0/3624398556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04a409d6f0 0x7f04a41c8640 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.446+0000 7f04aaab4700 1 --2- 172.21.15.59:0/3624398556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04a409e1d0 0x7f04a41c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.446+0000 7f04aaab4700 1 -- 172.21.15.59:0/3624398556 >> 172.21.15.59:0/3624398556 conn(0x7f04a4066f50 msgr2=0x7f04a40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:23.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.446+0000 7f04aaab4700 1 -- 172.21.15.59:0/3624398556 shutdown_connections 2023-09-30T22:34:23.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.446+0000 7f04aaab4700 1 -- 172.21.15.59:0/3624398556 wait complete. 2023-09-30T22:34:23.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:23.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.485+0000 7fba36365700 1 -- 172.21.15.59:0/358142659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fba3006b9e0 con 0x7fba301338a0 2023-09-30T22:34:23.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.485+0000 7fba2cff9700 1 -- 172.21.15.59:0/358142659 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba28016020 con 0x7fba301338a0 2023-09-30T22:34:23.487 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:23.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.488+0000 7fba36365700 1 -- 172.21.15.59:0/358142659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba301338a0 msgr2=0x7fba30120630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:23.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.488+0000 7fba36365700 1 --2- 172.21.15.59:0/358142659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba301338a0 0x7fba30120630 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fba2800cc40 tx=0x7fba2800cf50 comp rx=0 tx=0).stop 2023-09-30T22:34:23.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.488+0000 7fba36365700 1 -- 172.21.15.59:0/358142659 shutdown_connections 2023-09-30T22:34:23.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.488+0000 7fba36365700 1 --2- 172.21.15.59:0/358142659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba301338a0 0x7fba30120630 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.488+0000 7fba36365700 1 --2- 172.21.15.59:0/358142659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba3009de50 0x7fba3011fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.488+0000 7fba36365700 1 --2- 172.21.15.59:0/358142659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba3009e760 0x7fba301200f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:23.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.488+0000 7fba36365700 1 -- 172.21.15.59:0/358142659 >> 172.21.15.59:0/358142659 conn(0x7fba300a2aa0 msgr2=0x7fba3009ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:23.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.488+0000 7fba36365700 1 -- 172.21.15.59:0/358142659 shutdown_connections 2023-09-30T22:34:23.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:23.488+0000 7fba36365700 1 -- 172.21.15.59:0/358142659 wait complete. 2023-09-30T22:34:23.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:24.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:24.417 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:24.462 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:24.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.497+0000 7f99d452c700 1 Processor -- start 2023-09-30T22:34:24.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.497+0000 7f99d452c700 1 -- start start 2023-09-30T22:34:24.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.498+0000 7f99d452c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc136710 0x7f99cc138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.498+0000 7f99d452c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99cc139030 0x7f99cc13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.498+0000 7f99d452c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc06ef30 con 0x7f99cc1338a0 2023-09-30T22:34:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.498+0000 7f99d452c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc06fef0 con 0x7f99cc139030 2023-09-30T22:34:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.498+0000 7f99d452c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc1334b0 con 0x7f99cc136710 2023-09-30T22:34:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.498+0000 7f99d1ac7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc136710 0x7f99cc138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.498+0000 7f99d2ac9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99cc139030 0x7f99cc13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.498+0000 7f99d1ac7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc136710 0x7f99cc138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59802/0 (socket says 172.21.15.59:59802) 2023-09-30T22:34:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.498+0000 7f99d1ac7700 1 -- 172.21.15.59:0/2622349271 learned_addr learned my addr 172.21.15.59:0/2622349271 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.498+0000 7f99d22c8700 1 --1- 172.21.15.59:0/2622349271 >> v1:172.21.15.59:6789/0 conn(0x7f99cc1338a0 0x7f99cc133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36630/0 (socket says 172.21.15.59:36630) 2023-09-30T22:34:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.499+0000 7f99d12c6700 1 -- 172.21.15.59:0/2622349271 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923230982 0 0) 0x7f99cc06ef30 con 0x7f99cc1338a0 2023-09-30T22:34:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.499+0000 7f99d1ac7700 1 -- 172.21.15.59:0/2622349271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99cc139030 msgr2=0x7f99cc13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.499+0000 7f99d1ac7700 1 --2- 172.21.15.59:0/2622349271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99cc139030 0x7f99cc13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.499+0000 7f99d1ac7700 1 -- 172.21.15.59:0/2622349271 >> v1:172.21.15.59:6789/0 conn(0x7f99cc1338a0 legacy=0x7f99cc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.499+0000 7f99d1ac7700 1 -- 172.21.15.59:0/2622349271 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc06fc30 con 0x7f99cc136710 2023-09-30T22:34:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.499+0000 7f99d2ac9700 1 --2- 172.21.15.59:0/2622349271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99cc139030 0x7f99cc13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.499+0000 7f99d1ac7700 1 --2- 172.21.15.59:0/2622349271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc136710 0x7f99cc138af0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009920 tx=0x7f99bc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b28341c7c49d201d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.499+0000 7f99d12c6700 1 -- 172.21.15.59:0/2622349271 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc011830 con 0x7f99cc136710 2023-09-30T22:34:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.499+0000 7f99d12c6700 1 -- 172.21.15.59:0/2622349271 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc011990 con 0x7f99cc136710 2023-09-30T22:34:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.499+0000 7f99d12c6700 1 -- 172.21.15.59:0/2622349271 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc011d20 con 0x7f99cc136710 2023-09-30T22:34:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.500+0000 7f99d452c700 1 -- 172.21.15.59:0/2622349271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc136710 msgr2=0x7f99cc138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.500+0000 7f99d452c700 1 --2- 172.21.15.59:0/2622349271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc136710 0x7f99cc138af0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009920 tx=0x7f99bc009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.500+0000 7f99d452c700 1 -- 172.21.15.59:0/2622349271 shutdown_connections 2023-09-30T22:34:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.500+0000 7f99d452c700 1 --2- 172.21.15.59:0/2622349271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99cc139030 0x7f99cc13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.500+0000 7f99d452c700 1 --2- 172.21.15.59:0/2622349271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc136710 0x7f99cc138af0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.500+0000 7f99d452c700 1 -- 172.21.15.59:0/2622349271 >> 172.21.15.59:0/2622349271 conn(0x7f99cc0a2aa0 msgr2=0x7f99cc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.500+0000 7f99d452c700 1 -- 172.21.15.59:0/2622349271 shutdown_connections 2023-09-30T22:34:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.500+0000 7f99d452c700 1 -- 172.21.15.59:0/2622349271 wait complete. 2023-09-30T22:34:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.502+0000 7f99d452c700 1 Processor -- start 2023-09-30T22:34:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.502+0000 7f99d452c700 1 -- start start 2023-09-30T22:34:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.502+0000 7f99d452c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99cc1338a0 0x7f99cc1c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.502+0000 7f99d452c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc136710 0x7f99cc1c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.502+0000 7f99d452c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc139030 0x7f99cc119f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.503+0000 7f99d452c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc1be110 con 0x7f99cc139030 2023-09-30T22:34:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.503+0000 7f99d452c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc06f640 con 0x7f99cc1338a0 2023-09-30T22:34:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.503+0000 7f99d452c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc11d590 con 0x7f99cc136710 2023-09-30T22:34:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.503+0000 7f99d1ac7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc136710 0x7f99cc1c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.503+0000 7f99d1ac7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc136710 0x7f99cc1c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59810/0 (socket says 172.21.15.59:59810) 2023-09-30T22:34:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.503+0000 7f99d1ac7700 1 -- 172.21.15.59:0/1143810461 learned_addr learned my addr 172.21.15.59:0/1143810461 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.503+0000 7f99d22c8700 1 --2- 172.21.15.59:0/1143810461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99cc1338a0 0x7f99cc1c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.503+0000 7f99d2ac9700 1 --2- 172.21.15.59:0/1143810461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc139030 0x7f99cc119f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.503+0000 7f99d1ac7700 1 -- 172.21.15.59:0/1143810461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99cc1338a0 msgr2=0x7f99cc1c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.503+0000 7f99d1ac7700 1 --2- 172.21.15.59:0/1143810461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99cc1338a0 0x7f99cc1c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.503+0000 7f99d1ac7700 1 -- 172.21.15.59:0/1143810461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc139030 msgr2=0x7f99cc119f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.503+0000 7f99d1ac7700 1 --2- 172.21.15.59:0/1143810461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc139030 0x7f99cc119f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.503+0000 7f99d1ac7700 1 -- 172.21.15.59:0/1143810461 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c4009a70 con 0x7f99cc136710 2023-09-30T22:34:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.503+0000 7f99d1ac7700 1 --2- 172.21.15.59:0/1143810461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc136710 0x7f99cc1c8a10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00a010 tx=0x7f99bc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.503+0000 7f99c2ffd700 1 -- 172.21.15.59:0/1143810461 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc004240 con 0x7f99cc136710 2023-09-30T22:34:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.504+0000 7f99c2ffd700 1 -- 172.21.15.59:0/1143810461 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc01f070 con 0x7f99cc136710 2023-09-30T22:34:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.504+0000 7f99d452c700 1 -- 172.21.15.59:0/1143810461 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc009550 con 0x7f99cc136710 2023-09-30T22:34:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.504+0000 7f99c2ffd700 1 -- 172.21.15.59:0/1143810461 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0045c0 con 0x7f99cc136710 2023-09-30T22:34:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.504+0000 7f99d452c700 1 -- 172.21.15.59:0/1143810461 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc11c050 con 0x7f99cc136710 2023-09-30T22:34:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.505+0000 7f99c2ffd700 1 -- 172.21.15.59:0/1143810461 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99bc021030 con 0x7f99cc136710 2023-09-30T22:34:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.505+0000 7f99c2ffd700 1 -- 172.21.15.59:0/1143810461 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f99bc0409b0 con 0x7f99cc136710 2023-09-30T22:34:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.505+0000 7f99d452c700 1 -- 172.21.15.59:0/1143810461 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc1c9010 con 0x7f99cc136710 2023-09-30T22:34:24.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.514+0000 7f99c2ffd700 1 -- 172.21.15.59:0/1143810461 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99bc01a450 con 0x7f99cc136710 2023-09-30T22:34:24.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.580+0000 7fdabd7a4700 1 Processor -- start 2023-09-30T22:34:24.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.580+0000 7fdabd7a4700 1 -- start start 2023-09-30T22:34:24.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.581+0000 7fdabd7a4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdab809e850 0x7fdab809ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.581+0000 7fdabd7a4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdab809f5b0 0x7fdab8134370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.581+0000 7fdabd7a4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab806bec0 con 0x7fdab809f160 2023-09-30T22:34:24.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.581+0000 7fdabd7a4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab80a0030 con 0x7fdab809f5b0 2023-09-30T22:34:24.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.581+0000 7fdabd7a4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab80a0830 con 0x7fdab809e850 2023-09-30T22:34:24.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.581+0000 7fdab6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdab809e850 0x7fdab809ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.581+0000 7fdab6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdab809e850 0x7fdab809ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51416/0 (socket says 172.21.15.59:51416) 2023-09-30T22:34:24.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.581+0000 7fdab6ffd700 1 -- 172.21.15.59:0/1356739569 learned_addr learned my addr 172.21.15.59:0/1356739569 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:24.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.581+0000 7fdab77fe700 1 --2- 172.21.15.59:0/1356739569 >> v2:172.21.15.59:3300/0 conn(0x7fdab809f5b0 0x7fdab8134370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.582+0000 7fdab77fe700 1 -- 172.21.15.59:0/1356739569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdab809e850 msgr2=0x7fdab809ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:24.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.582+0000 7fdab77fe700 1 --2- 172.21.15.59:0/1356739569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdab809e850 0x7fdab809ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.582+0000 7fdab77fe700 1 -- 172.21.15.59:0/1356739569 >> v1:172.21.15.59:6789/0 conn(0x7fdab809f160 legacy=0x7fdab8133c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:24.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.582+0000 7fdab77fe700 1 -- 172.21.15.59:0/1356739569 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab806caa0 con 0x7fdab809f5b0 2023-09-30T22:34:24.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.582+0000 7fdab77fe700 1 --2- 172.21.15.59:0/1356739569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab809f5b0 0x7fdab8134370 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009d90 tx=0x7fdab000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15052fcfbaf79957 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.582+0000 7fdab5ffb700 1 -- 172.21.15.59:0/1356739569 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab000e070 con 0x7fdab809f5b0 2023-09-30T22:34:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.582+0000 7fdab5ffb700 1 -- 172.21.15.59:0/1356739569 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab000bae0 con 0x7fdab809f5b0 2023-09-30T22:34:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.582+0000 7fdab5ffb700 1 -- 172.21.15.59:0/1356739569 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab000be90 con 0x7fdab809f5b0 2023-09-30T22:34:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.583+0000 7fdabd7a4700 1 -- 172.21.15.59:0/1356739569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab809f5b0 msgr2=0x7fdab8134370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.583+0000 7fdabd7a4700 1 --2- 172.21.15.59:0/1356739569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab809f5b0 0x7fdab8134370 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009d90 tx=0x7fdab000b330 comp rx=0 tx=0).stop 2023-09-30T22:34:24.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.583+0000 7fdabd7a4700 1 -- 172.21.15.59:0/1356739569 shutdown_connections 2023-09-30T22:34:24.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.583+0000 7fdabd7a4700 1 --2- 172.21.15.59:0/1356739569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab809f5b0 0x7fdab8134370 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.583+0000 7fdabd7a4700 1 --2- 172.21.15.59:0/1356739569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdab809e850 0x7fdab809ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.583+0000 7fdabd7a4700 1 -- 172.21.15.59:0/1356739569 >> 172.21.15.59:0/1356739569 conn(0x7fdab80a3f70 msgr2=0x7fdab80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:24.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.583+0000 7fdabd7a4700 1 -- 172.21.15.59:0/1356739569 shutdown_connections 2023-09-30T22:34:24.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.583+0000 7fdabd7a4700 1 -- 172.21.15.59:0/1356739569 wait complete. 2023-09-30T22:34:24.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.584+0000 7fdabd7a4700 1 Processor -- start 2023-09-30T22:34:24.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.584+0000 7fdabd7a4700 1 -- start start 2023-09-30T22:34:24.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.585+0000 7fdabd7a4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdab809e850 0x7fdab8120690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.585+0000 7fdabd7a4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdab809f160 0x7fdab8120bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.585+0000 7fdabd7a4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab809f5b0 0x7fdab8121110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.585+0000 7fdabd7a4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab80a3620 con 0x7fdab809f5b0 2023-09-30T22:34:24.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.585+0000 7fdabd7a4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab8123070 con 0x7fdab809f160 2023-09-30T22:34:24.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.585+0000 7fdabd7a4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdab806ccc0 con 0x7fdab809e850 2023-09-30T22:34:24.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.585+0000 7fdab6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdab809e850 0x7fdab8120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.585+0000 7fdab77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab809f5b0 0x7fdab8121110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.585+0000 7fdab6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdab809e850 0x7fdab8120690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59816/0 (socket says 172.21.15.59:59816) 2023-09-30T22:34:24.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.585+0000 7fdab77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab809f5b0 0x7fdab8121110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48282/0 (socket says 172.21.15.59:48282) 2023-09-30T22:34:24.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.585+0000 7fdab6ffd700 1 -- 172.21.15.59:0/839599334 learned_addr learned my addr 172.21.15.59:0/839599334 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:24.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.585+0000 7fdab67fc700 1 --2- 172.21.15.59:0/839599334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdab809f160 0x7fdab8120bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.586+0000 7fdab6ffd700 1 -- 172.21.15.59:0/839599334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdab809f160 msgr2=0x7fdab8120bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.586+0000 7fdab6ffd700 1 --2- 172.21.15.59:0/839599334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdab809f160 0x7fdab8120bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.586+0000 7fdab6ffd700 1 -- 172.21.15.59:0/839599334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab809f5b0 msgr2=0x7fdab8121110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.586+0000 7fdab6ffd700 1 --2- 172.21.15.59:0/839599334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab809f5b0 0x7fdab8121110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.586+0000 7fdab6ffd700 1 -- 172.21.15.59:0/839599334 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab0009a70 con 0x7fdab809e850 2023-09-30T22:34:24.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.586+0000 7fdab77fe700 1 --2- 172.21.15.59:0/839599334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab809f5b0 0x7fdab8121110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:24.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.586+0000 7fdab6ffd700 1 --2- 172.21.15.59:0/839599334 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdab809e850 0x7fdab8120690 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800e8b0 tx=0x7fdaa800ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:24.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.586+0000 7fda9f7fe700 1 -- 172.21.15.59:0/839599334 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8009600 con 0x7fdab809e850 2023-09-30T22:34:24.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.586+0000 7fda9f7fe700 1 -- 172.21.15.59:0/839599334 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa8013680 con 0x7fdab809e850 2023-09-30T22:34:24.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.586+0000 7fdabd7a4700 1 -- 172.21.15.59:0/839599334 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab81339d0 con 0x7fdab809e850 2023-09-30T22:34:24.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.586+0000 7fda9f7fe700 1 -- 172.21.15.59:0/839599334 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8013a30 con 0x7fdab809e850 2023-09-30T22:34:24.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.586+0000 7fdabd7a4700 1 -- 172.21.15.59:0/839599334 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab8124870 con 0x7fdab809e850 2023-09-30T22:34:24.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.587+0000 7fda9f7fe700 1 -- 172.21.15.59:0/839599334 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdaa8013b90 con 0x7fdab809e850 2023-09-30T22:34:24.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.587+0000 7fda9f7fe700 1 -- 172.21.15.59:0/839599334 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdaa803f5a0 con 0x7fdab809e850 2023-09-30T22:34:24.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.588+0000 7fdabd7a4700 1 -- 172.21.15.59:0/839599334 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab80747f0 con 0x7fdab809e850 2023-09-30T22:34:24.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.593+0000 7fda9f7fe700 1 -- 172.21.15.59:0/839599334 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdaa8017080 con 0x7fdab809e850 2023-09-30T22:34:24.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.615+0000 7f6b32a80700 1 Processor -- start 2023-09-30T22:34:24.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.615+0000 7f6b32a80700 1 -- start start 2023-09-30T22:34:24.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.616+0000 7f6b32a80700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b2c09e930 0x7f6b2c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.616+0000 7f6b32a80700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2c09f240 0x7f6b2c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.616+0000 7f6b32a80700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2c070940 con 0x7f6b2c09f650 2023-09-30T22:34:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.616+0000 7f6b32a80700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2c06fd60 con 0x7f6b2c09e930 2023-09-30T22:34:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.616+0000 7f6b32a80700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c06fa80 con 0x7f6b2c09f240 2023-09-30T22:34:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.616+0000 7f6b2bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2c09f240 0x7f6b2c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.616+0000 7f6b2bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2c09f240 0x7f6b2c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51424/0 (socket says 172.21.15.59:51424) 2023-09-30T22:34:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.616+0000 7f6b2bfff700 1 -- 172.21.15.59:0/616158221 learned_addr learned my addr 172.21.15.59:0/616158221 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.616+0000 7f6b3081c700 1 --2- 172.21.15.59:0/616158221 >> v2:172.21.15.59:3300/0 conn(0x7f6b2c09e930 0x7f6b2c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.617+0000 7f6b2bfff700 1 -- 172.21.15.59:0/616158221 >> v2:172.21.15.59:3300/0 conn(0x7f6b2c09e930 msgr2=0x7f6b2c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.617+0000 7f6b2bfff700 1 --2- 172.21.15.59:0/616158221 >> v2:172.21.15.59:3300/0 conn(0x7f6b2c09e930 0x7f6b2c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.617+0000 7f6b2bfff700 1 -- 172.21.15.59:0/616158221 >> v1:172.21.15.59:6789/0 conn(0x7f6b2c09f650 legacy=0x7f6b2c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.617+0000 7f6b2bfff700 1 -- 172.21.15.59:0/616158221 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c09fb60 con 0x7f6b2c09f240 2023-09-30T22:34:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.617+0000 7f6b2bfff700 1 --2- 172.21.15.59:0/616158221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2c09f240 0x7f6b2c1317f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6b180098f0 tx=0x7f6b18009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df12172d3d1a70f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.617+0000 7f6b2b7fe700 1 -- 172.21.15.59:0/616158221 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b18011830 con 0x7f6b2c09f240 2023-09-30T22:34:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.617+0000 7f6b2b7fe700 1 -- 172.21.15.59:0/616158221 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b18011990 con 0x7f6b2c09f240 2023-09-30T22:34:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.617+0000 7f6b2b7fe700 1 -- 172.21.15.59:0/616158221 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b18011d20 con 0x7f6b2c09f240 2023-09-30T22:34:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.618+0000 7f6b32a80700 1 -- 172.21.15.59:0/616158221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2c09f240 msgr2=0x7f6b2c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.618+0000 7f6b32a80700 1 --2- 172.21.15.59:0/616158221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2c09f240 0x7f6b2c1317f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6b180098f0 tx=0x7f6b18009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.619+0000 7f6b32a80700 1 -- 172.21.15.59:0/616158221 shutdown_connections 2023-09-30T22:34:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.619+0000 7f6b32a80700 1 --2- 172.21.15.59:0/616158221 >> v2:172.21.15.59:3300/0 conn(0x7f6b2c09e930 0x7f6b2c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.619+0000 7f6b32a80700 1 --2- 172.21.15.59:0/616158221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2c09f240 0x7f6b2c1317f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.619+0000 7f6b32a80700 1 -- 172.21.15.59:0/616158221 >> 172.21.15.59:0/616158221 conn(0x7f6b2c0a4210 msgr2=0x7f6b2c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.619+0000 7f6b32a80700 1 -- 172.21.15.59:0/616158221 shutdown_connections 2023-09-30T22:34:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.619+0000 7f6b32a80700 1 -- 172.21.15.59:0/616158221 wait complete. 2023-09-30T22:34:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.620+0000 7f6b32a80700 1 Processor -- start 2023-09-30T22:34:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.620+0000 7f6b32a80700 1 -- start start 2023-09-30T22:34:24.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.621+0000 7f6b32a80700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b2c09e930 0x7f6b2c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.621+0000 7f6b32a80700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2c09f240 0x7f6b2c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.621+0000 7f6b32a80700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2c09f650 0x7f6b2c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.621+0000 7f6b32a80700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c1a8a00 con 0x7f6b2c09e930 2023-09-30T22:34:24.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.621+0000 7f6b32a80700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c1a9a40 con 0x7f6b2c09f240 2023-09-30T22:34:24.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.621+0000 7f6b32a80700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c1a9530 con 0x7f6b2c09f650 2023-09-30T22:34:24.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.621+0000 7f6b3081c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b2c09e930 0x7f6b2c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.621+0000 7f6b2bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2c09f240 0x7f6b2c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.621+0000 7f6b3081c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b2c09e930 0x7f6b2c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48298/0 (socket says 172.21.15.59:48298) 2023-09-30T22:34:24.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.621+0000 7f6b2bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2c09f240 0x7f6b2c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51426/0 (socket says 172.21.15.59:51426) 2023-09-30T22:34:24.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.621+0000 7f6b3081c700 1 -- 172.21.15.59:0/1793165005 learned_addr learned my addr 172.21.15.59:0/1793165005 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:24.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.621+0000 7f6b3101d700 1 --2- 172.21.15.59:0/1793165005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2c09f650 0x7f6b2c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.622+0000 7f6b3081c700 1 -- 172.21.15.59:0/1793165005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2c09f650 msgr2=0x7f6b2c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.622+0000 7f6b3081c700 1 --2- 172.21.15.59:0/1793165005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2c09f650 0x7f6b2c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.622+0000 7f6b3081c700 1 -- 172.21.15.59:0/1793165005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2c09f240 msgr2=0x7f6b2c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.622+0000 7f6b3081c700 1 --2- 172.21.15.59:0/1793165005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2c09f240 0x7f6b2c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.622+0000 7f6b3081c700 1 -- 172.21.15.59:0/1793165005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b18009550 con 0x7f6b2c09e930 2023-09-30T22:34:24.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.622+0000 7f6b2bfff700 1 --2- 172.21.15.59:0/1793165005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2c09f240 0x7f6b2c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:24.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.622+0000 7f6b3081c700 1 --2- 172.21.15.59:0/1793165005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b2c09e930 0x7f6b2c06b8b0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000e9e0 tx=0x7f6b2000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:24.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.622+0000 7f6b297fa700 1 -- 172.21.15.59:0/1793165005 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20009710 con 0x7f6b2c09e930 2023-09-30T22:34:24.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.622+0000 7f6b297fa700 1 -- 172.21.15.59:0/1793165005 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2000ee80 con 0x7f6b2c09e930 2023-09-30T22:34:24.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.622+0000 7f6b32a80700 1 -- 172.21.15.59:0/1793165005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2c0a0190 con 0x7f6b2c09e930 2023-09-30T22:34:24.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.622+0000 7f6b297fa700 1 -- 172.21.15.59:0/1793165005 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000ca50 con 0x7f6b2c09e930 2023-09-30T22:34:24.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.622+0000 7f6b32a80700 1 -- 172.21.15.59:0/1793165005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2c1a9220 con 0x7f6b2c09e930 2023-09-30T22:34:24.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.623+0000 7f6b297fa700 1 -- 172.21.15.59:0/1793165005 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b2000cbb0 con 0x7f6b2c09e930 2023-09-30T22:34:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.624+0000 7f6b297fa700 1 -- 172.21.15.59:0/1793165005 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6b20011e20 con 0x7f6b2c09e930 2023-09-30T22:34:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.624+0000 7f6b32a80700 1 -- 172.21.15.59:0/1793165005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2c06cd10 con 0x7f6b2c09e930 2023-09-30T22:34:24.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.633+0000 7f6b297fa700 1 -- 172.21.15.59:0/1793165005 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b200102b0 con 0x7f6b2c09e930 2023-09-30T22:34:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.671+0000 7f09c22a9700 1 Processor -- start 2023-09-30T22:34:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.671+0000 7f09c22a9700 1 -- start start 2023-09-30T22:34:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09c22a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc09d6f0 0x7f09bc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09c22a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc09e000 0x7f09bc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09c22a9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f09bc09e410 0x7f09bc133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09c22a9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09bc06b460 con 0x7f09bc09e410 2023-09-30T22:34:24.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09c22a9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc09b120 con 0x7f09bc09d6f0 2023-09-30T22:34:24.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09c22a9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc09a7e0 con 0x7f09bc09e000 2023-09-30T22:34:24.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09bbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc09d6f0 0x7f09bc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09bbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc09d6f0 0x7f09bc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51432/0 (socket says 172.21.15.59:51432) 2023-09-30T22:34:24.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09bbfff700 1 -- 172.21.15.59:0/579863590 learned_addr learned my addr 172.21.15.59:0/579863590 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09bb7fe700 1 --2- 172.21.15.59:0/579863590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc09e000 0x7f09bc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09c0846700 1 --2- 172.21.15.59:0/579863590 >> v2:172.21.15.59:3300/0 conn(0x7f09bc09e410 0x7f09bc133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09bb7fe700 1 -- 172.21.15.59:0/579863590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc09d6f0 msgr2=0x7f09bc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09bb7fe700 1 --2- 172.21.15.59:0/579863590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc09d6f0 0x7f09bc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09bb7fe700 1 -- 172.21.15.59:0/579863590 >> v2:172.21.15.59:3300/0 conn(0x7f09bc09e410 msgr2=0x7f09bc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09bb7fe700 1 --2- 172.21.15.59:0/579863590 >> v2:172.21.15.59:3300/0 conn(0x7f09bc09e410 0x7f09bc133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09bb7fe700 1 -- 172.21.15.59:0/579863590 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc09a500 con 0x7f09bc09e000 2023-09-30T22:34:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09c0846700 1 --2- 172.21.15.59:0/579863590 >> v2:172.21.15.59:3300/0 conn(0x7f09bc09e410 0x7f09bc133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.672+0000 7f09bbfff700 1 --2- 172.21.15.59:0/579863590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc09d6f0 0x7f09bc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.673+0000 7f09bb7fe700 1 --2- 172.21.15.59:0/579863590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc09e000 0x7f09bc1339f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009870 tx=0x7f09b0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d45557ac8c8c07a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.673+0000 7f09baffd700 1 -- 172.21.15.59:0/579863590 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0011830 con 0x7f09bc09e000 2023-09-30T22:34:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.673+0000 7f09baffd700 1 -- 172.21.15.59:0/579863590 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b0011990 con 0x7f09bc09e000 2023-09-30T22:34:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.673+0000 7f09baffd700 1 -- 172.21.15.59:0/579863590 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0011d20 con 0x7f09bc09e000 2023-09-30T22:34:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.674+0000 7f09c22a9700 1 -- 172.21.15.59:0/579863590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc09e000 msgr2=0x7f09bc1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.674+0000 7f09c22a9700 1 --2- 172.21.15.59:0/579863590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc09e000 0x7f09bc1339f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009870 tx=0x7f09b0009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.674+0000 7f09c22a9700 1 -- 172.21.15.59:0/579863590 shutdown_connections 2023-09-30T22:34:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.674+0000 7f09c22a9700 1 --2- 172.21.15.59:0/579863590 >> v2:172.21.15.59:3300/0 conn(0x7f09bc09e410 0x7f09bc133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.674+0000 7f09c22a9700 1 --2- 172.21.15.59:0/579863590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc09d6f0 0x7f09bc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.674+0000 7f09c22a9700 1 --2- 172.21.15.59:0/579863590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc09e000 0x7f09bc1339f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.674+0000 7f09c22a9700 1 -- 172.21.15.59:0/579863590 >> 172.21.15.59:0/579863590 conn(0x7f09bc066f50 msgr2=0x7f09bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.674+0000 7f09c22a9700 1 -- 172.21.15.59:0/579863590 shutdown_connections 2023-09-30T22:34:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.674+0000 7f09c22a9700 1 -- 172.21.15.59:0/579863590 wait complete. 2023-09-30T22:34:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.675+0000 7f09c22a9700 1 Processor -- start 2023-09-30T22:34:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.676+0000 7f09c22a9700 1 -- start start 2023-09-30T22:34:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.676+0000 7f09c22a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc09d6f0 0x7f09bc1a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.676+0000 7f09c22a9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc09e000 0x7f09bc1a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.676+0000 7f09c22a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc09e410 0x7f09bc1a6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.676+0000 7f09c22a9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc1aa1f0 con 0x7f09bc09e000 2023-09-30T22:34:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.676+0000 7f09c22a9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc1a7920 con 0x7f09bc09e410 2023-09-30T22:34:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.677+0000 7f09c22a9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc1a7f40 con 0x7f09bc09d6f0 2023-09-30T22:34:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.677+0000 7f09bbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc09d6f0 0x7f09bc1a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.677+0000 7f09bbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc09d6f0 0x7f09bc1a5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59856/0 (socket says 172.21.15.59:59856) 2023-09-30T22:34:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.677+0000 7f09bbfff700 1 -- 172.21.15.59:0/2614532812 learned_addr learned my addr 172.21.15.59:0/2614532812 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.677+0000 7f09c0846700 1 --2- 172.21.15.59:0/2614532812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc09e410 0x7f09bc1a6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.677+0000 7f09bb7fe700 1 --2- 172.21.15.59:0/2614532812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc09e000 0x7f09bc1a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.677+0000 7f09bbfff700 1 -- 172.21.15.59:0/2614532812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc09e410 msgr2=0x7f09bc1a6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.677+0000 7f09bbfff700 1 --2- 172.21.15.59:0/2614532812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc09e410 0x7f09bc1a6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.677+0000 7f09bbfff700 1 -- 172.21.15.59:0/2614532812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc09e000 msgr2=0x7f09bc1a6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.677+0000 7f09bbfff700 1 --2- 172.21.15.59:0/2614532812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc09e000 0x7f09bc1a6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.677+0000 7f09bbfff700 1 -- 172.21.15.59:0/2614532812 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac009550 con 0x7f09bc09d6f0 2023-09-30T22:34:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.677+0000 7f09bbfff700 1 --2- 172.21.15.59:0/2614532812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc09d6f0 0x7f09bc1a5d10 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00ec40 tx=0x7f09ac00ef50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.678+0000 7f09b8ff9700 1 -- 172.21.15.59:0/2614532812 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac00c910 con 0x7f09bc09d6f0 2023-09-30T22:34:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.678+0000 7f09b8ff9700 1 -- 172.21.15.59:0/2614532812 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ac00ca70 con 0x7f09bc09d6f0 2023-09-30T22:34:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.678+0000 7f09b8ff9700 1 -- 172.21.15.59:0/2614532812 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac00cde0 con 0x7f09bc09d6f0 2023-09-30T22:34:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.678+0000 7f09c22a9700 1 -- 172.21.15.59:0/2614532812 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b00094a0 con 0x7f09bc09d6f0 2023-09-30T22:34:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.678+0000 7f09c22a9700 1 -- 172.21.15.59:0/2614532812 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09bc1a8fc0 con 0x7f09bc09d6f0 2023-09-30T22:34:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.679+0000 7f09b8ff9700 1 -- 172.21.15.59:0/2614532812 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09ac013470 con 0x7f09bc09d6f0 2023-09-30T22:34:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.679+0000 7f09b8ff9700 1 -- 172.21.15.59:0/2614532812 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f09ac03f990 con 0x7f09bc09d6f0 2023-09-30T22:34:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.679+0000 7f09c22a9700 1 -- 172.21.15.59:0/2614532812 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09bc0a2f60 con 0x7f09bc09d6f0 2023-09-30T22:34:24.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.684+0000 7f09b8ff9700 1 -- 172.21.15.59:0/2614532812 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09ac017080 con 0x7f09bc09d6f0 2023-09-30T22:34:24.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.743+0000 7f99d452c700 1 -- 172.21.15.59:0/1143810461 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f99cc074ea0 con 0x7f99cc136710 2023-09-30T22:34:24.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.743+0000 7f99c2ffd700 1 -- 172.21.15.59:0/1143810461 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99bc0193b0 con 0x7f99cc136710 2023-09-30T22:34:24.744 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:24.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.747+0000 7f99d452c700 1 -- 172.21.15.59:0/1143810461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc136710 msgr2=0x7f99cc1c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.747+0000 7f99d452c700 1 --2- 172.21.15.59:0/1143810461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc136710 0x7f99cc1c8a10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00a010 tx=0x7f99bc004750 comp rx=0 tx=0).stop 2023-09-30T22:34:24.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.747+0000 7f99d452c700 1 -- 172.21.15.59:0/1143810461 shutdown_connections 2023-09-30T22:34:24.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.747+0000 7f99d452c700 1 --2- 172.21.15.59:0/1143810461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc139030 0x7f99cc119f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.747+0000 7f99d452c700 1 --2- 172.21.15.59:0/1143810461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99cc1338a0 0x7f99cc1c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.747+0000 7f99d452c700 1 --2- 172.21.15.59:0/1143810461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc136710 0x7f99cc1c8a10 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.747+0000 7f99d452c700 1 -- 172.21.15.59:0/1143810461 >> 172.21.15.59:0/1143810461 conn(0x7f99cc0a2aa0 msgr2=0x7f99cc0a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:24.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.747+0000 7f99d452c700 1 -- 172.21.15.59:0/1143810461 shutdown_connections 2023-09-30T22:34:24.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.747+0000 7f99d452c700 1 -- 172.21.15.59:0/1143810461 wait complete. 2023-09-30T22:34:24.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:24.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.846+0000 7fdabd7a4700 1 -- 172.21.15.59:0/839599334 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdab8072490 con 0x7fdab809e850 2023-09-30T22:34:24.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.846+0000 7fda9f7fe700 1 -- 172.21.15.59:0/839599334 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdaa8021020 con 0x7fdab809e850 2023-09-30T22:34:24.847 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:24.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.847+0000 7f6b32a80700 1 -- 172.21.15.59:0/1793165005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6b2c1a0b30 con 0x7f6b2c09e930 2023-09-30T22:34:24.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.847+0000 7f6b297fa700 1 -- 172.21.15.59:0/1793165005 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b20017070 con 0x7f6b2c09e930 2023-09-30T22:34:24.848 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:24.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7fdabd7a4700 1 -- 172.21.15.59:0/839599334 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdab809e850 msgr2=0x7fdab8120690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7fdabd7a4700 1 --2- 172.21.15.59:0/839599334 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdab809e850 0x7fdab8120690 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800e8b0 tx=0x7fdaa800ebc0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7fdabd7a4700 1 -- 172.21.15.59:0/839599334 shutdown_connections 2023-09-30T22:34:24.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7fdabd7a4700 1 --2- 172.21.15.59:0/839599334 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdab809e850 0x7fdab8120690 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7fdabd7a4700 1 --2- 172.21.15.59:0/839599334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab809f5b0 0x7fdab8121110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7fdabd7a4700 1 --2- 172.21.15.59:0/839599334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdab809f160 0x7fdab8120bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7fdabd7a4700 1 -- 172.21.15.59:0/839599334 >> 172.21.15.59:0/839599334 conn(0x7fdab80a3f70 msgr2=0x7fdab81b9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:24.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7fdabd7a4700 1 -- 172.21.15.59:0/839599334 shutdown_connections 2023-09-30T22:34:24.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7fdabd7a4700 1 -- 172.21.15.59:0/839599334 wait complete. 2023-09-30T22:34:24.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7f6b32a80700 1 -- 172.21.15.59:0/1793165005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b2c09e930 msgr2=0x7f6b2c06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7f6b32a80700 1 --2- 172.21.15.59:0/1793165005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b2c09e930 0x7f6b2c06b8b0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000e9e0 tx=0x7f6b2000ecf0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7f6b32a80700 1 -- 172.21.15.59:0/1793165005 shutdown_connections 2023-09-30T22:34:24.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7f6b32a80700 1 --2- 172.21.15.59:0/1793165005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2c09f650 0x7f6b2c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7f6b32a80700 1 --2- 172.21.15.59:0/1793165005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b2c09e930 0x7f6b2c06b8b0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7f6b32a80700 1 --2- 172.21.15.59:0/1793165005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2c09f240 0x7f6b2c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.850+0000 7f6b32a80700 1 -- 172.21.15.59:0/1793165005 >> 172.21.15.59:0/1793165005 conn(0x7f6b2c0a4210 msgr2=0x7f6b2c1b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:24.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.851+0000 7f6b32a80700 1 -- 172.21.15.59:0/1793165005 shutdown_connections 2023-09-30T22:34:24.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.851+0000 7f6b32a80700 1 -- 172.21.15.59:0/1793165005 wait complete. 2023-09-30T22:34:24.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:24.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:24.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.906+0000 7f09c22a9700 1 -- 172.21.15.59:0/2614532812 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f09bc09c710 con 0x7f09bc09d6f0 2023-09-30T22:34:24.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.906+0000 7f09b8ff9700 1 -- 172.21.15.59:0/2614532812 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09ac0232f0 con 0x7f09bc09d6f0 2023-09-30T22:34:24.907 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:24.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.908+0000 7f09c22a9700 1 -- 172.21.15.59:0/2614532812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc09d6f0 msgr2=0x7f09bc1a5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:24.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.908+0000 7f09c22a9700 1 --2- 172.21.15.59:0/2614532812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc09d6f0 0x7f09bc1a5d10 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00ec40 tx=0x7f09ac00ef50 comp rx=0 tx=0).stop 2023-09-30T22:34:24.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.908+0000 7f09c22a9700 1 -- 172.21.15.59:0/2614532812 shutdown_connections 2023-09-30T22:34:24.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.908+0000 7f09c22a9700 1 --2- 172.21.15.59:0/2614532812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc09d6f0 0x7f09bc1a5d10 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.908+0000 7f09c22a9700 1 --2- 172.21.15.59:0/2614532812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc09e410 0x7f09bc1a6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.908+0000 7f09c22a9700 1 --2- 172.21.15.59:0/2614532812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc09e000 0x7f09bc1a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:24.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.908+0000 7f09c22a9700 1 -- 172.21.15.59:0/2614532812 >> 172.21.15.59:0/2614532812 conn(0x7f09bc066f50 msgr2=0x7f09bc1bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:24.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.908+0000 7f09c22a9700 1 -- 172.21.15.59:0/2614532812 shutdown_connections 2023-09-30T22:34:24.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:24.908+0000 7f09c22a9700 1 -- 172.21.15.59:0/2614532812 wait complete. 2023-09-30T22:34:24.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:25.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:25.872 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:25.872 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.918+0000 7f0156cdd700 1 Processor -- start 2023-09-30T22:34:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.918+0000 7f0156cdd700 1 -- start start 2023-09-30T22:34:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.919+0000 7f0156cdd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0150133540 0x7f0150135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.919+0000 7f0156cdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0150135e60 0x7f0150138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.919+0000 7f0156cdd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01500716a0 con 0x7f0150130540 2023-09-30T22:34:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.919+0000 7f0156cdd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0150071290 con 0x7f0150135e60 2023-09-30T22:34:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.919+0000 7f0156cdd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0150130340 con 0x7f0150133540 2023-09-30T22:34:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.919+0000 7f015527a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0150135e60 0x7f0150138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.919+0000 7f014ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0150133540 0x7f0150135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.919+0000 7f0154a79700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0150130540 0x7f0150130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36650/0 (socket says 172.21.15.59:36650) 2023-09-30T22:34:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.919+0000 7f0154a79700 1 -- 172.21.15.59:0/1521089567 learned_addr learned my addr 172.21.15.59:0/1521089567 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.920+0000 7f014ffff700 1 -- 172.21.15.59:0/1521089567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0150135e60 msgr2=0x7f0150138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.920+0000 7f014ffff700 1 --2- 172.21.15.59:0/1521089567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0150135e60 0x7f0150138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.920+0000 7f014ffff700 1 -- 172.21.15.59:0/1521089567 >> v1:172.21.15.59:6789/0 conn(0x7f0150130540 legacy=0x7f0150130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.920+0000 7f014ffff700 1 -- 172.21.15.59:0/1521089567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0150070b80 con 0x7f0150133540 2023-09-30T22:34:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.920+0000 7f014ffff700 1 --2- 172.21.15.59:0/1521089567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0150133540 0x7f0150135920 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f013c009870 tx=0x7f013c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50b57499af1f9a41 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.920+0000 7f014f7fe700 1 -- 172.21.15.59:0/1521089567 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c004230 con 0x7f0150133540 2023-09-30T22:34:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.920+0000 7f014f7fe700 1 -- 172.21.15.59:0/1521089567 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c004390 con 0x7f0150133540 2023-09-30T22:34:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.920+0000 7f014f7fe700 1 -- 172.21.15.59:0/1521089567 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c0036a0 con 0x7f0150133540 2023-09-30T22:34:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.921+0000 7f0156cdd700 1 -- 172.21.15.59:0/1521089567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0150133540 msgr2=0x7f0150135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.921+0000 7f0156cdd700 1 --2- 172.21.15.59:0/1521089567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0150133540 0x7f0150135920 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f013c009870 tx=0x7f013c009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.921+0000 7f0156cdd700 1 -- 172.21.15.59:0/1521089567 shutdown_connections 2023-09-30T22:34:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.921+0000 7f0156cdd700 1 --2- 172.21.15.59:0/1521089567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0150135e60 0x7f0150138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.921+0000 7f0156cdd700 1 --2- 172.21.15.59:0/1521089567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0150133540 0x7f0150135920 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.921+0000 7f0156cdd700 1 -- 172.21.15.59:0/1521089567 >> 172.21.15.59:0/1521089567 conn(0x7f01500a2aa0 msgr2=0x7f01500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.921+0000 7f0156cdd700 1 -- 172.21.15.59:0/1521089567 shutdown_connections 2023-09-30T22:34:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.921+0000 7f0156cdd700 1 -- 172.21.15.59:0/1521089567 wait complete. 2023-09-30T22:34:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.922+0000 7f0156cdd700 1 Processor -- start 2023-09-30T22:34:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.922+0000 7f0156cdd700 1 -- start start 2023-09-30T22:34:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f0156cdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0150130540 0x7f015009cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f0156cdd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0150133540 0x7f015009d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f0156cdd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0150135e60 0x7f01501c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f0156cdd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015009e0a0 con 0x7f0150135e60 2023-09-30T22:34:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f0156cdd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01500718e0 con 0x7f0150130540 2023-09-30T22:34:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f0156cdd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01500a2360 con 0x7f0150133540 2023-09-30T22:34:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f014ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0150133540 0x7f015009d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f014ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0150133540 0x7f015009d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59884/0 (socket says 172.21.15.59:59884) 2023-09-30T22:34:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f014ffff700 1 -- 172.21.15.59:0/3350269228 learned_addr learned my addr 172.21.15.59:0/3350269228 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f015527a700 1 --2- 172.21.15.59:0/3350269228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0150135e60 0x7f01501c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:25.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:25.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f0154a79700 1 --2- 172.21.15.59:0/3350269228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0150130540 0x7f015009cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f014ffff700 1 -- 172.21.15.59:0/3350269228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0150130540 msgr2=0x7f015009cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f014ffff700 1 --2- 172.21.15.59:0/3350269228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0150130540 0x7f015009cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f014ffff700 1 -- 172.21.15.59:0/3350269228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0150135e60 msgr2=0x7f01501c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f014ffff700 1 --2- 172.21.15.59:0/3350269228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0150135e60 0x7f01501c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f014ffff700 1 -- 172.21.15.59:0/3350269228 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c0094a0 con 0x7f0150133540 2023-09-30T22:34:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f015527a700 1 --2- 172.21.15.59:0/3350269228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0150135e60 0x7f01501c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.923+0000 7f014ffff700 1 --2- 172.21.15.59:0/3350269228 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0150133540 0x7f015009d1d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f01501304d0 tx=0x7f013c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.924+0000 7f014d7fa700 1 -- 172.21.15.59:0/3350269228 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c003c50 con 0x7f0150133540 2023-09-30T22:34:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.924+0000 7f014d7fa700 1 -- 172.21.15.59:0/3350269228 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c01f070 con 0x7f0150133540 2023-09-30T22:34:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.924+0000 7f0156cdd700 1 -- 172.21.15.59:0/3350269228 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015011e550 con 0x7f0150133540 2023-09-30T22:34:25.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.924+0000 7f014d7fa700 1 -- 172.21.15.59:0/3350269228 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c011630 con 0x7f0150133540 2023-09-30T22:34:25.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.924+0000 7f0156cdd700 1 -- 172.21.15.59:0/3350269228 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015011d850 con 0x7f0150133540 2023-09-30T22:34:25.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.925+0000 7f014d7fa700 1 -- 172.21.15.59:0/3350269228 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f013c021030 con 0x7f0150133540 2023-09-30T22:34:25.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.925+0000 7f0156cdd700 1 -- 172.21.15.59:0/3350269228 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0150074ea0 con 0x7f0150133540 2023-09-30T22:34:25.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.925+0000 7f014d7fa700 1 -- 172.21.15.59:0/3350269228 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f013c0407b0 con 0x7f0150133540 2023-09-30T22:34:25.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:25.930+0000 7f014d7fa700 1 -- 172.21.15.59:0/3350269228 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f013c011790 con 0x7f0150133540 2023-09-30T22:34:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.019+0000 7f8ac3271700 1 Processor -- start 2023-09-30T22:34:26.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.019+0000 7fe2c8ba8700 1 Processor -- start 2023-09-30T22:34:26.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.019+0000 7fe2c8ba8700 1 -- start start 2023-09-30T22:34:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.019+0000 7f8ac3271700 1 -- start start 2023-09-30T22:34:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7f8ac3271700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8abc09e930 0x7f8abc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7f8ac3271700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8abc09f240 0x7f8abc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7f8ac3271700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8abc09f650 0x7f8abc131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7f8ac3271700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8abc070940 con 0x7f8abc09f240 2023-09-30T22:34:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7f8ac3271700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc06fd60 con 0x7f8abc09e930 2023-09-30T22:34:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7f8ac3271700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc06fa80 con 0x7f8abc09f650 2023-09-30T22:34:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7f8ac180e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8abc09f650 0x7f8abc131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7f8ac080c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8abc09f240 0x7f8abc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7f8ac180e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8abc09f650 0x7f8abc131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59896/0 (socket says 172.21.15.59:59896) 2023-09-30T22:34:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7f8ac080c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8abc09f240 0x7f8abc1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48330/0 (socket says 172.21.15.59:48330) 2023-09-30T22:34:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7f8ac180e700 1 -- 172.21.15.59:0/2691008098 learned_addr learned my addr 172.21.15.59:0/2691008098 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7f8ac100d700 1 --2- 172.21.15.59:0/2691008098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8abc09e930 0x7f8abc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7fe2c8ba8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2c409c650 0x7fe2c409ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7fe2c8ba8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2c409cf60 0x7fe2c4132080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7fe2c8ba8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c409ba70 con 0x7fe2c40a0090 2023-09-30T22:34:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7fe2c8ba8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c409e8f0 con 0x7fe2c409cf60 2023-09-30T22:34:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.020+0000 7fe2c8ba8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c40a0760 con 0x7fe2c409c650 2023-09-30T22:34:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7fe2c1d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe2c40a0090 0x7fe2c4131970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36662/0 (socket says 172.21.15.59:36662) 2023-09-30T22:34:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7fe2c1d9b700 1 -- 172.21.15.59:0/474660072 learned_addr learned my addr 172.21.15.59:0/474660072 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7fe2c259c700 1 --2- 172.21.15.59:0/474660072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2c409c650 0x7fe2c409ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:26.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7f8ac180e700 1 -- 172.21.15.59:0/2691008098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8abc09e930 msgr2=0x7f8abc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:26.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7f8ac180e700 1 --2- 172.21.15.59:0/2691008098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8abc09e930 0x7f8abc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7f8ac180e700 1 -- 172.21.15.59:0/2691008098 >> v2:172.21.15.59:3300/0 conn(0x7f8abc09f240 msgr2=0x7f8abc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:26.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7f8ac180e700 1 --2- 172.21.15.59:0/2691008098 >> v2:172.21.15.59:3300/0 conn(0x7f8abc09f240 0x7f8abc1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7f8ac180e700 1 -- 172.21.15.59:0/2691008098 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc09fb60 con 0x7f8abc09f650 2023-09-30T22:34:26.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7f8ac180e700 1 --2- 172.21.15.59:0/2691008098 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8abc09f650 0x7f8abc131d30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009ed0 tx=0x7f8ab400f740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd9734a46da8d8d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:26.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7fe2c259c700 1 -- 172.21.15.59:0/474660072 >> v2:172.21.15.59:3300/0 conn(0x7fe2c409cf60 msgr2=0x7fe2c4132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7fe2c259c700 1 --2- 172.21.15.59:0/474660072 >> v2:172.21.15.59:3300/0 conn(0x7fe2c409cf60 0x7fe2c4132080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7fe2c259c700 1 -- 172.21.15.59:0/474660072 >> v1:172.21.15.59:6789/0 conn(0x7fe2c40a0090 legacy=0x7fe2c4131970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7fe2c259c700 1 -- 172.21.15.59:0/474660072 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c409a080 con 0x7fe2c409c650 2023-09-30T22:34:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7f8ab3fff700 1 -- 172.21.15.59:0/2691008098 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab40090d0 con 0x7f8abc09f650 2023-09-30T22:34:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7f8ab3fff700 1 -- 172.21.15.59:0/2691008098 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab4009230 con 0x7f8abc09f650 2023-09-30T22:34:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7f8ab3fff700 1 -- 172.21.15.59:0/2691008098 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4017650 con 0x7f8abc09f650 2023-09-30T22:34:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.021+0000 7fe2c259c700 1 --2- 172.21.15.59:0/474660072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2c409c650 0x7fe2c409ca20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009840 tx=0x7fe2b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d23adc2ee3b31ab8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.022+0000 7fe2c159a700 1 -- 172.21.15.59:0/474660072 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4011830 con 0x7fe2c409c650 2023-09-30T22:34:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.022+0000 7fe2c159a700 1 -- 172.21.15.59:0/474660072 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b4011990 con 0x7fe2c409c650 2023-09-30T22:34:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.022+0000 7fe2c159a700 1 -- 172.21.15.59:0/474660072 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4011d20 con 0x7fe2c409c650 2023-09-30T22:34:26.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.022+0000 7f8ac3271700 1 -- 172.21.15.59:0/2691008098 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8abc09f650 msgr2=0x7f8abc131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:26.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.022+0000 7f8ac3271700 1 --2- 172.21.15.59:0/2691008098 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8abc09f650 0x7f8abc131d30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009ed0 tx=0x7f8ab400f740 comp rx=0 tx=0).stop 2023-09-30T22:34:26.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.022+0000 7f8ac3271700 1 -- 172.21.15.59:0/2691008098 shutdown_connections 2023-09-30T22:34:26.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.022+0000 7f8ac3271700 1 --2- 172.21.15.59:0/2691008098 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8abc09f650 0x7f8abc131d30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.022+0000 7f8ac3271700 1 --2- 172.21.15.59:0/2691008098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8abc09e930 0x7f8abc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.022+0000 7f8ac3271700 1 --2- 172.21.15.59:0/2691008098 >> v2:172.21.15.59:3300/0 conn(0x7f8abc09f240 0x7f8abc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.022+0000 7f8ac3271700 1 -- 172.21.15.59:0/2691008098 >> 172.21.15.59:0/2691008098 conn(0x7f8abc0a4210 msgr2=0x7f8abc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:26.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.023+0000 7f8ac3271700 1 -- 172.21.15.59:0/2691008098 shutdown_connections 2023-09-30T22:34:26.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.023+0000 7f8ac3271700 1 -- 172.21.15.59:0/2691008098 wait complete. 2023-09-30T22:34:26.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.023+0000 7fe2c8ba8700 1 -- 172.21.15.59:0/474660072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2c409c650 msgr2=0x7fe2c409ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.023+0000 7fe2c8ba8700 1 --2- 172.21.15.59:0/474660072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2c409c650 0x7fe2c409ca20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009840 tx=0x7fe2b4009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.023+0000 7fe2c8ba8700 1 -- 172.21.15.59:0/474660072 shutdown_connections 2023-09-30T22:34:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.023+0000 7fe2c8ba8700 1 --2- 172.21.15.59:0/474660072 >> v2:172.21.15.59:3300/0 conn(0x7fe2c409cf60 0x7fe2c4132080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.023+0000 7fe2c8ba8700 1 --2- 172.21.15.59:0/474660072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2c409c650 0x7fe2c409ca20 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.023+0000 7fe2c8ba8700 1 -- 172.21.15.59:0/474660072 >> 172.21.15.59:0/474660072 conn(0x7fe2c40a3f70 msgr2=0x7fe2c40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.023+0000 7fe2c8ba8700 1 -- 172.21.15.59:0/474660072 shutdown_connections 2023-09-30T22:34:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.023+0000 7fe2c8ba8700 1 -- 172.21.15.59:0/474660072 wait complete. 2023-09-30T22:34:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.024+0000 7f8ac3271700 1 Processor -- start 2023-09-30T22:34:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.024+0000 7f8ac3271700 1 -- start start 2023-09-30T22:34:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.024+0000 7f8ac3271700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8abc09e930 0x7f8abc1a30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.024+0000 7f8ac3271700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8abc09f240 0x7f8abc1a3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.024+0000 7f8ac3271700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8abc09f650 0x7f8abc1c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.024+0000 7f8ac3271700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc1a5f80 con 0x7f8abc09f650 2023-09-30T22:34:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.024+0000 7f8ac3271700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc1a6160 con 0x7f8abc09e930 2023-09-30T22:34:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.024+0000 7f8ac3271700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc1b6fd0 con 0x7f8abc09f240 2023-09-30T22:34:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.024+0000 7fe2c8ba8700 1 Processor -- start 2023-09-30T22:34:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7f8ac100d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8abc09e930 0x7f8abc1a30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7f8ac180e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8abc09f650 0x7f8abc1c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7f8ac100d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8abc09e930 0x7f8abc1a30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51470/0 (socket says 172.21.15.59:51470) 2023-09-30T22:34:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7f8ac100d700 1 -- 172.21.15.59:0/4024150227 learned_addr learned my addr 172.21.15.59:0/4024150227 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7fe2c8ba8700 1 -- start start 2023-09-30T22:34:26.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7f8ac080c700 1 --2- 172.21.15.59:0/4024150227 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8abc09f240 0x7f8abc1a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:26.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7f8ac180e700 1 -- 172.21.15.59:0/4024150227 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8abc09f240 msgr2=0x7f8abc1a3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:26.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7f8ac180e700 1 --2- 172.21.15.59:0/4024150227 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8abc09f240 0x7f8abc1a3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7f8ac180e700 1 -- 172.21.15.59:0/4024150227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8abc09e930 msgr2=0x7f8abc1a30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:26.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7f8ac180e700 1 --2- 172.21.15.59:0/4024150227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8abc09e930 0x7f8abc1a30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7f8ac180e700 1 -- 172.21.15.59:0/4024150227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab4009b30 con 0x7f8abc09f650 2023-09-30T22:34:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7fe2c8ba8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c409c650 0x7fe2c41cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7fe2c8ba8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2c409cf60 0x7fe2c41cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7fe2c8ba8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2c40a0090 0x7fe2c4139c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7fe2c8ba8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c413d060 con 0x7fe2c409c650 2023-09-30T22:34:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7fe2c8ba8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c413dee0 con 0x7fe2c40a0090 2023-09-30T22:34:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7fe2c8ba8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c413bd10 con 0x7fe2c409cf60 2023-09-30T22:34:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.025+0000 7f8ac180e700 1 --2- 172.21.15.59:0/4024150227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8abc09f650 0x7f8abc1c3cb0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4019000 tx=0x7f8ab4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.026+0000 7fe2c2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2c40a0090 0x7fe2c4139c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.026+0000 7fe2c2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2c40a0090 0x7fe2c4139c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51484/0 (socket says 172.21.15.59:51484) 2023-09-30T22:34:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.026+0000 7fe2c2d9d700 1 -- 172.21.15.59:0/3010964438 learned_addr learned my addr 172.21.15.59:0/3010964438 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.026+0000 7fe2c1d9b700 1 --2- 172.21.15.59:0/3010964438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2c409cf60 0x7fe2c41cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.026+0000 7f8ab1ffb700 1 -- 172.21.15.59:0/4024150227 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab40090d0 con 0x7f8abc09f650 2023-09-30T22:34:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.026+0000 7fe2c259c700 1 --2- 172.21.15.59:0/3010964438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c409c650 0x7fe2c41cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.026+0000 7f8ab1ffb700 1 -- 172.21.15.59:0/4024150227 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab4003e30 con 0x7f8abc09f650 2023-09-30T22:34:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.026+0000 7f8ab1ffb700 1 -- 172.21.15.59:0/4024150227 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4021860 con 0x7f8abc09f650 2023-09-30T22:34:26.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.026+0000 7fe2c1d9b700 1 -- 172.21.15.59:0/3010964438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2c40a0090 msgr2=0x7fe2c4139c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:26.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.026+0000 7fe2c1d9b700 1 --2- 172.21.15.59:0/3010964438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2c40a0090 0x7fe2c4139c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.026+0000 7fe2c1d9b700 1 -- 172.21.15.59:0/3010964438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c409c650 msgr2=0x7fe2c41cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:26.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.026+0000 7fe2c1d9b700 1 --2- 172.21.15.59:0/3010964438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c409c650 0x7fe2c41cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.026+0000 7fe2c1d9b700 1 -- 172.21.15.59:0/3010964438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40094a0 con 0x7fe2c409cf60 2023-09-30T22:34:26.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.026+0000 7f8ac3271700 1 -- 172.21.15.59:0/4024150227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc0a0190 con 0x7f8abc09f650 2023-09-30T22:34:26.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.026+0000 7f8ac3271700 1 -- 172.21.15.59:0/4024150227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc0a3380 con 0x7f8abc09f650 2023-09-30T22:34:26.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.027+0000 7fe2c1d9b700 1 --2- 172.21.15.59:0/3010964438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2c409cf60 0x7fe2c41cd5b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800c500 tx=0x7fe2b800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:26.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.027+0000 7fe2b2ffd700 1 -- 172.21.15.59:0/3010964438 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8005d70 con 0x7fe2c409cf60 2023-09-30T22:34:26.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.027+0000 7fe2b2ffd700 1 -- 172.21.15.59:0/3010964438 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b800ce70 con 0x7fe2c409cf60 2023-09-30T22:34:26.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.027+0000 7fe2c8ba8700 1 -- 172.21.15.59:0/3010964438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c413b870 con 0x7fe2c409cf60 2023-09-30T22:34:26.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.027+0000 7fe2b2ffd700 1 -- 172.21.15.59:0/3010964438 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80072d0 con 0x7fe2c409cf60 2023-09-30T22:34:26.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.027+0000 7fe2c8ba8700 1 -- 172.21.15.59:0/3010964438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c413cd70 con 0x7fe2c409cf60 2023-09-30T22:34:26.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.027+0000 7f8ac3271700 1 -- 172.21.15.59:0/4024150227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc074ea0 con 0x7f8abc09f650 2023-09-30T22:34:26.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.028+0000 7f8ab1ffb700 1 -- 172.21.15.59:0/4024150227 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ab401e070 con 0x7f8abc09f650 2023-09-30T22:34:26.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.028+0000 7f8ab1ffb700 1 -- 172.21.15.59:0/4024150227 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8ab4044ce0 con 0x7f8abc09f650 2023-09-30T22:34:26.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.029+0000 7fe2c8ba8700 1 -- 172.21.15.59:0/3010964438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c413d440 con 0x7fe2c409cf60 2023-09-30T22:34:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.031+0000 7fe2b2ffd700 1 -- 172.21.15.59:0/3010964438 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2b8007430 con 0x7fe2c409cf60 2023-09-30T22:34:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.031+0000 7fe2b2ffd700 1 -- 172.21.15.59:0/3010964438 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe2b803ef90 con 0x7fe2c409cf60 2023-09-30T22:34:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.034+0000 7f8ab1ffb700 1 -- 172.21.15.59:0/4024150227 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ab4017410 con 0x7f8abc09f650 2023-09-30T22:34:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.038+0000 7fe2b2ffd700 1 -- 172.21.15.59:0/3010964438 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2b801b3b0 con 0x7fe2c409cf60 2023-09-30T22:34:26.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.080+0000 7f19a80a8700 1 Processor -- start 2023-09-30T22:34:26.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.080+0000 7f19a80a8700 1 -- start start 2023-09-30T22:34:26.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.081+0000 7f19a80a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a00a0a30 0x7f19a00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.081+0000 7f19a80a8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19a009d630 0x7f19a00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.081+0000 7f19a80a8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a00a2a70 con 0x7f19a0133930 2023-09-30T22:34:26.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.081+0000 7f19a80a8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a00a01d0 con 0x7f19a009d630 2023-09-30T22:34:26.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.081+0000 7f19a80a8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19a009e2b0 con 0x7f19a00a0a30 2023-09-30T22:34:26.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.081+0000 7f19a5e44700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a00a0a30 0x7f19a00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:26.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.081+0000 7f19a5e44700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a00a0a30 0x7f19a00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59928/0 (socket says 172.21.15.59:59928) 2023-09-30T22:34:26.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.081+0000 7f19a5e44700 1 -- 172.21.15.59:0/2753996173 learned_addr learned my addr 172.21.15.59:0/2753996173 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:26.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.081+0000 7f19a5e44700 1 -- 172.21.15.59:0/2753996173 >> v2:172.21.15.59:3300/0 conn(0x7f19a009d630 msgr2=0x7f19a00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:26.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.081+0000 7f19a5e44700 1 --2- 172.21.15.59:0/2753996173 >> v2:172.21.15.59:3300/0 conn(0x7f19a009d630 0x7f19a00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.081+0000 7f19a5e44700 1 -- 172.21.15.59:0/2753996173 >> v1:172.21.15.59:6789/0 conn(0x7f19a0133930 legacy=0x7f19a0133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:26.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.082+0000 7f19a5e44700 1 -- 172.21.15.59:0/2753996173 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a009dc50 con 0x7f19a00a0a30 2023-09-30T22:34:26.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.082+0000 7f19a4e42700 1 -- 172.21.15.59:0/2753996173 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114708274 0 0) 0x7f19a00a2a70 con 0x7f19a0133930 2023-09-30T22:34:26.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.082+0000 7f19a5e44700 1 --2- 172.21.15.59:0/2753996173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a00a0a30 0x7f19a00a0e00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f199c0098f0 tx=0x7f199c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e1e8961d5234a10 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:26.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.082+0000 7f19a4e42700 1 -- 172.21.15.59:0/2753996173 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c00b8a0 con 0x7f19a00a0a30 2023-09-30T22:34:26.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.082+0000 7f19a4e42700 1 -- 172.21.15.59:0/2753996173 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c00ba00 con 0x7f19a00a0a30 2023-09-30T22:34:26.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.082+0000 7f19a4e42700 1 -- 172.21.15.59:0/2753996173 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c00bd90 con 0x7f19a00a0a30 2023-09-30T22:34:26.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.083+0000 7f19a80a8700 1 -- 172.21.15.59:0/2753996173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a00a0a30 msgr2=0x7f19a00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:26.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.083+0000 7f19a80a8700 1 --2- 172.21.15.59:0/2753996173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a00a0a30 0x7f19a00a0e00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f199c0098f0 tx=0x7f199c009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:26.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.083+0000 7f19a80a8700 1 -- 172.21.15.59:0/2753996173 shutdown_connections 2023-09-30T22:34:26.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.083+0000 7f19a80a8700 1 --2- 172.21.15.59:0/2753996173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a00a0a30 0x7f19a00a0e00 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.083+0000 7f19a80a8700 1 --2- 172.21.15.59:0/2753996173 >> v2:172.21.15.59:3300/0 conn(0x7f19a009d630 0x7f19a00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.083+0000 7f19a80a8700 1 -- 172.21.15.59:0/2753996173 >> 172.21.15.59:0/2753996173 conn(0x7f19a00a3050 msgr2=0x7f19a00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:26.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.083+0000 7f19a80a8700 1 -- 172.21.15.59:0/2753996173 shutdown_connections 2023-09-30T22:34:26.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.083+0000 7f19a80a8700 1 -- 172.21.15.59:0/2753996173 wait complete. 2023-09-30T22:34:26.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.084+0000 7f19a80a8700 1 Processor -- start 2023-09-30T22:34:26.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.084+0000 7f19a80a8700 1 -- start start 2023-09-30T22:34:26.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.084+0000 7f19a80a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009d630 0x7f19a01c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.084+0000 7f19a80a8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a00a0a30 0x7f19a01c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.084+0000 7f19a80a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a0133930 0x7f19a01c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:26.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.084+0000 7f19a80a8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a0122430 con 0x7f19a00a0a30 2023-09-30T22:34:26.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.084+0000 7f19a80a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a0120720 con 0x7f19a0133930 2023-09-30T22:34:26.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.084+0000 7f19a80a8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00a5410 con 0x7f19a009d630 2023-09-30T22:34:26.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.085+0000 7f19a5e44700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009d630 0x7f19a01c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:26.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.085+0000 7f19a5e44700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009d630 0x7f19a01c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59938/0 (socket says 172.21.15.59:59938) 2023-09-30T22:34:26.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.085+0000 7f19a5e44700 1 -- 172.21.15.59:0/2244289980 learned_addr learned my addr 172.21.15.59:0/2244289980 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:26.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.085+0000 7f19a6645700 1 --2- 172.21.15.59:0/2244289980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a0133930 0x7f19a01c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:26.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.085+0000 7f19a6645700 1 -- 172.21.15.59:0/2244289980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009d630 msgr2=0x7f19a01c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:26.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.085+0000 7f19a6645700 1 --2- 172.21.15.59:0/2244289980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009d630 0x7f19a01c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.085+0000 7f19a6645700 1 -- 172.21.15.59:0/2244289980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a00a0a30 msgr2=0x7f19a01c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:26.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.085+0000 7f19a6645700 1 --2- 172.21.15.59:0/2244289980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a00a0a30 0x7f19a01c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.085+0000 7f19a6645700 1 -- 172.21.15.59:0/2244289980 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c009550 con 0x7f19a0133930 2023-09-30T22:34:26.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.085+0000 7f19a5e44700 1 --2- 172.21.15.59:0/2244289980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009d630 0x7f19a01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:26.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.085+0000 7f19a6645700 1 --2- 172.21.15.59:0/2244289980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a0133930 0x7f19a01c8b10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f199800c730 tx=0x7f199800ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:26.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.085+0000 7f19967fc700 1 -- 172.21.15.59:0/2244289980 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998003e30 con 0x7f19a0133930 2023-09-30T22:34:26.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.085+0000 7f19967fc700 1 -- 172.21.15.59:0/2244289980 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1998005070 con 0x7f19a0133930 2023-09-30T22:34:26.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.085+0000 7f19967fc700 1 -- 172.21.15.59:0/2244289980 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998005420 con 0x7f19a0133930 2023-09-30T22:34:26.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.085+0000 7f19a80a8700 1 -- 172.21.15.59:0/2244289980 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a00a0410 con 0x7f19a0133930 2023-09-30T22:34:26.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.086+0000 7f19a80a8700 1 -- 172.21.15.59:0/2244289980 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a01335c0 con 0x7f19a0133930 2023-09-30T22:34:26.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.087+0000 7f19a80a8700 1 -- 172.21.15.59:0/2244289980 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a0122e80 con 0x7f19a0133930 2023-09-30T22:34:26.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.087+0000 7f19967fc700 1 -- 172.21.15.59:0/2244289980 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1998005580 con 0x7f19a0133930 2023-09-30T22:34:26.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.088+0000 7f19967fc700 1 -- 172.21.15.59:0/2244289980 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f199803fe00 con 0x7f19a0133930 2023-09-30T22:34:26.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.092+0000 7f19967fc700 1 -- 172.21.15.59:0/2244289980 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f199801a770 con 0x7f19a0133930 2023-09-30T22:34:26.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.221+0000 7f0156cdd700 1 -- 172.21.15.59:0/3350269228 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f015011e6e0 con 0x7f0150133540 2023-09-30T22:34:26.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.222+0000 7f014d7fa700 1 -- 172.21.15.59:0/3350269228 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f013c0193c0 con 0x7f0150133540 2023-09-30T22:34:26.222 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:26.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.224+0000 7f0156cdd700 1 -- 172.21.15.59:0/3350269228 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0150133540 msgr2=0x7f015009d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:26.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.224+0000 7f0156cdd700 1 --2- 172.21.15.59:0/3350269228 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0150133540 0x7f015009d1d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f01501304d0 tx=0x7f013c004750 comp rx=0 tx=0).stop 2023-09-30T22:34:26.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.225+0000 7f0156cdd700 1 -- 172.21.15.59:0/3350269228 shutdown_connections 2023-09-30T22:34:26.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.225+0000 7f0156cdd700 1 --2- 172.21.15.59:0/3350269228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0150135e60 0x7f01501c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.225+0000 7f0156cdd700 1 --2- 172.21.15.59:0/3350269228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0150130540 0x7f015009cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.225+0000 7f0156cdd700 1 --2- 172.21.15.59:0/3350269228 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0150133540 0x7f015009d1d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.225+0000 7f0156cdd700 1 -- 172.21.15.59:0/3350269228 >> 172.21.15.59:0/3350269228 conn(0x7f01500a2aa0 msgr2=0x7f0150131300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:26.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.225+0000 7f0156cdd700 1 -- 172.21.15.59:0/3350269228 shutdown_connections 2023-09-30T22:34:26.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.225+0000 7f0156cdd700 1 -- 172.21.15.59:0/3350269228 wait complete. 2023-09-30T22:34:26.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:26.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.244+0000 7f8ac3271700 1 -- 172.21.15.59:0/4024150227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8abc1a4a40 con 0x7f8abc09f650 2023-09-30T22:34:26.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.245+0000 7f8ab1ffb700 1 -- 172.21.15.59:0/4024150227 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ab401c070 con 0x7f8abc09f650 2023-09-30T22:34:26.245 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.247+0000 7f8ac3271700 1 -- 172.21.15.59:0/4024150227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8abc09f650 msgr2=0x7f8abc1c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.247+0000 7f8ac3271700 1 --2- 172.21.15.59:0/4024150227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8abc09f650 0x7f8abc1c3cb0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4019000 tx=0x7f8ab4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.247+0000 7f8ac3271700 1 -- 172.21.15.59:0/4024150227 shutdown_connections 2023-09-30T22:34:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.247+0000 7f8ac3271700 1 --2- 172.21.15.59:0/4024150227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8abc09f650 0x7f8abc1c3cb0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.247+0000 7f8ac3271700 1 --2- 172.21.15.59:0/4024150227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8abc09e930 0x7f8abc1a30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.247+0000 7f8ac3271700 1 --2- 172.21.15.59:0/4024150227 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8abc09f240 0x7f8abc1a3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.247+0000 7f8ac3271700 1 -- 172.21.15.59:0/4024150227 >> 172.21.15.59:0/4024150227 conn(0x7f8abc0a4210 msgr2=0x7f8abc06c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.247+0000 7f8ac3271700 1 -- 172.21.15.59:0/4024150227 shutdown_connections 2023-09-30T22:34:26.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.247+0000 7f8ac3271700 1 -- 172.21.15.59:0/4024150227 wait complete. 2023-09-30T22:34:26.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:26.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.296+0000 7f19a80a8700 1 -- 172.21.15.59:0/2244289980 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f19a00747f0 con 0x7f19a0133930 2023-09-30T22:34:26.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.297+0000 7f19967fc700 1 -- 172.21.15.59:0/2244289980 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19980243e0 con 0x7f19a0133930 2023-09-30T22:34:26.297 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:26.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.299+0000 7f19a80a8700 1 -- 172.21.15.59:0/2244289980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a0133930 msgr2=0x7f19a01c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:26.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.299+0000 7f19a80a8700 1 --2- 172.21.15.59:0/2244289980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a0133930 0x7f19a01c8b10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f199800c730 tx=0x7f199800ca40 comp rx=0 tx=0).stop 2023-09-30T22:34:26.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.299+0000 7f19a80a8700 1 -- 172.21.15.59:0/2244289980 shutdown_connections 2023-09-30T22:34:26.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.299+0000 7f19a80a8700 1 --2- 172.21.15.59:0/2244289980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009d630 0x7f19a01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.299+0000 7f19a80a8700 1 --2- 172.21.15.59:0/2244289980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a0133930 0x7f19a01c8b10 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.299+0000 7f19a80a8700 1 --2- 172.21.15.59:0/2244289980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a00a0a30 0x7f19a01c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.299+0000 7f19a80a8700 1 -- 172.21.15.59:0/2244289980 >> 172.21.15.59:0/2244289980 conn(0x7f19a00a3050 msgr2=0x7f19a01bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:26.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.299+0000 7f19a80a8700 1 -- 172.21.15.59:0/2244289980 shutdown_connections 2023-09-30T22:34:26.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.299+0000 7f19a80a8700 1 -- 172.21.15.59:0/2244289980 wait complete. 2023-09-30T22:34:26.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:26.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.322+0000 7fe2c8ba8700 1 -- 172.21.15.59:0/3010964438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe2c4128360 con 0x7fe2c409cf60 2023-09-30T22:34:26.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.322+0000 7fe2b2ffd700 1 -- 172.21.15.59:0/3010964438 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2b8017030 con 0x7fe2c409cf60 2023-09-30T22:34:26.322 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:26.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.324+0000 7fe2c8ba8700 1 -- 172.21.15.59:0/3010964438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2c409cf60 msgr2=0x7fe2c41cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:26.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.324+0000 7fe2c8ba8700 1 --2- 172.21.15.59:0/3010964438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2c409cf60 0x7fe2c41cd5b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800c500 tx=0x7fe2b800c810 comp rx=0 tx=0).stop 2023-09-30T22:34:26.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.324+0000 7fe2c8ba8700 1 -- 172.21.15.59:0/3010964438 shutdown_connections 2023-09-30T22:34:26.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.324+0000 7fe2c8ba8700 1 --2- 172.21.15.59:0/3010964438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2c40a0090 0x7fe2c4139c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.324+0000 7fe2c8ba8700 1 --2- 172.21.15.59:0/3010964438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c409c650 0x7fe2c41cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.324+0000 7fe2c8ba8700 1 --2- 172.21.15.59:0/3010964438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2c409cf60 0x7fe2c41cd5b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:26.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.324+0000 7fe2c8ba8700 1 -- 172.21.15.59:0/3010964438 >> 172.21.15.59:0/3010964438 conn(0x7fe2c40a3f70 msgr2=0x7fe2c412ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:26.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.324+0000 7fe2c8ba8700 1 -- 172.21.15.59:0/3010964438 shutdown_connections 2023-09-30T22:34:26.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:26.325+0000 7fe2c8ba8700 1 -- 172.21.15.59:0/3010964438 wait complete. 2023-09-30T22:34:26.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:27.240 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:27.263 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:27.314 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:27.338 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.392+0000 7ff7f165f700 1 Processor -- start 2023-09-30T22:34:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.392+0000 7ff7f165f700 1 -- start start 2023-09-30T22:34:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.393+0000 7ff7f165f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7ec0a0a30 0x7ff7ec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.393+0000 7ff7f165f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff7ec0a1340 0x7ff7ec133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.393+0000 7ff7f165f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ec09edd0 con 0x7ff7ec133fa0 2023-09-30T22:34:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.393+0000 7ff7f165f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ec09e1f0 con 0x7ff7ec0a1340 2023-09-30T22:34:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.393+0000 7ff7f165f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec09dc50 con 0x7ff7ec0a0a30 2023-09-30T22:34:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.393+0000 7ff7ea7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff7ec0a1340 0x7ff7ec133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.393+0000 7ff7ea7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff7ec0a1340 0x7ff7ec133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48376/0 (socket says 172.21.15.59:48376) 2023-09-30T22:34:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.393+0000 7ff7ea7fc700 1 -- 172.21.15.59:0/2774630833 learned_addr learned my addr 172.21.15.59:0/2774630833 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.393+0000 7ff7ea7fc700 1 -- 172.21.15.59:0/2774630833 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7ec0a0a30 msgr2=0x7ff7ec0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.393+0000 7ff7ea7fc700 1 --2- 172.21.15.59:0/2774630833 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7ec0a0a30 0x7ff7ec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.393+0000 7ff7ea7fc700 1 -- 172.21.15.59:0/2774630833 >> v1:172.21.15.59:6789/0 conn(0x7ff7ec133fa0 legacy=0x7ff7ec13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.393+0000 7ff7ea7fc700 1 -- 172.21.15.59:0/2774630833 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ec0a1fe0 con 0x7ff7ec0a1340 2023-09-30T22:34:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.394+0000 7ff7ea7fc700 1 --2- 172.21.15.59:0/2774630833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ec0a1340 0x7ff7ec133a60 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7ff7e00098f0 tx=0x7ff7e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7bc21ec61c57ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:27.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.394+0000 7ff7e9ffb700 1 -- 172.21.15.59:0/2774630833 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e000b8a0 con 0x7ff7ec0a1340 2023-09-30T22:34:27.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.394+0000 7ff7e9ffb700 1 -- 172.21.15.59:0/2774630833 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e000ba00 con 0x7ff7ec0a1340 2023-09-30T22:34:27.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.394+0000 7ff7e9ffb700 1 -- 172.21.15.59:0/2774630833 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e000bd90 con 0x7ff7ec0a1340 2023-09-30T22:34:27.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.395+0000 7ff7f165f700 1 -- 172.21.15.59:0/2774630833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ec0a1340 msgr2=0x7ff7ec133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.395+0000 7ff7f165f700 1 --2- 172.21.15.59:0/2774630833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ec0a1340 0x7ff7ec133a60 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7ff7e00098f0 tx=0x7ff7e0009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:27.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.395+0000 7ff7f165f700 1 -- 172.21.15.59:0/2774630833 shutdown_connections 2023-09-30T22:34:27.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.395+0000 7ff7f165f700 1 --2- 172.21.15.59:0/2774630833 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7ec0a0a30 0x7ff7ec0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.395+0000 7ff7f165f700 1 --2- 172.21.15.59:0/2774630833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ec0a1340 0x7ff7ec133a60 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.395+0000 7ff7f165f700 1 -- 172.21.15.59:0/2774630833 >> 172.21.15.59:0/2774630833 conn(0x7ff7ec0a6550 msgr2=0x7ff7ec0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:27.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.395+0000 7ff7f165f700 1 -- 172.21.15.59:0/2774630833 shutdown_connections 2023-09-30T22:34:27.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.395+0000 7ff7f165f700 1 -- 172.21.15.59:0/2774630833 wait complete. 2023-09-30T22:34:27.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.396+0000 7ff7f165f700 1 Processor -- start 2023-09-30T22:34:27.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.396+0000 7ff7f165f700 1 -- start start 2023-09-30T22:34:27.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.397+0000 7ff7f165f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ec0a0a30 0x7ff7ec1c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.397+0000 7ff7f165f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7ec0a1340 0x7ff7ec1c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.397+0000 7ff7f165f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7ec133fa0 0x7ff7ec1c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.397+0000 7ff7f165f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec120b30 con 0x7ff7ec0a0a30 2023-09-30T22:34:27.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.397+0000 7ff7f165f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec0a0290 con 0x7ff7ec0a1340 2023-09-30T22:34:27.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.397+0000 7ff7f165f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec120690 con 0x7ff7ec133fa0 2023-09-30T22:34:27.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.397+0000 7ff7eaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ec0a0a30 0x7ff7ec1c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.397+0000 7ff7ea7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7ec0a1340 0x7ff7ec1c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.397+0000 7ff7ea7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7ec0a1340 0x7ff7ec1c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51492/0 (socket says 172.21.15.59:51492) 2023-09-30T22:34:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.397+0000 7ff7ea7fc700 1 -- 172.21.15.59:0/2736801411 learned_addr learned my addr 172.21.15.59:0/2736801411 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.397+0000 7ff7eaffd700 1 --2- 172.21.15.59:0/2736801411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ec0a0a30 0x7ff7ec1c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48386/0 (socket says 172.21.15.59:48386) 2023-09-30T22:34:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.397+0000 7ff7eb7fe700 1 --2- 172.21.15.59:0/2736801411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7ec133fa0 0x7ff7ec1c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.397+0000 7ff7ea7fc700 1 -- 172.21.15.59:0/2736801411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7ec133fa0 msgr2=0x7ff7ec1c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.397+0000 7ff7ea7fc700 1 --2- 172.21.15.59:0/2736801411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7ec133fa0 0x7ff7ec1c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.397+0000 7ff7ea7fc700 1 -- 172.21.15.59:0/2736801411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ec0a0a30 msgr2=0x7ff7ec1c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.398+0000 7ff7ea7fc700 1 --2- 172.21.15.59:0/2736801411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ec0a0a30 0x7ff7ec1c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.398+0000 7ff7ea7fc700 1 -- 172.21.15.59:0/2736801411 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e0009550 con 0x7ff7ec0a1340 2023-09-30T22:34:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.398+0000 7ff7eaffd700 1 --2- 172.21.15.59:0/2736801411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ec0a0a30 0x7ff7ec1c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.398+0000 7ff7ea7fc700 1 --2- 172.21.15.59:0/2736801411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7ec0a1340 0x7ff7ec1c8a00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec09e330 tx=0x7ff7e0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:27.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.398+0000 7ff7d37fe700 1 -- 172.21.15.59:0/2736801411 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0004590 con 0x7ff7ec0a1340 2023-09-30T22:34:27.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.398+0000 7ff7d37fe700 1 -- 172.21.15.59:0/2736801411 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e00036a0 con 0x7ff7ec0a1340 2023-09-30T22:34:27.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.398+0000 7ff7d37fe700 1 -- 172.21.15.59:0/2736801411 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0003a10 con 0x7ff7ec0a1340 2023-09-30T22:34:27.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.398+0000 7ff7f165f700 1 -- 172.21.15.59:0/2736801411 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ec122420 con 0x7ff7ec0a1340 2023-09-30T22:34:27.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.398+0000 7ff7f165f700 1 -- 172.21.15.59:0/2736801411 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ec120d00 con 0x7ff7ec0a1340 2023-09-30T22:34:27.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.399+0000 7ff7d37fe700 1 -- 172.21.15.59:0/2736801411 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7e0003b70 con 0x7ff7ec0a1340 2023-09-30T22:34:27.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.399+0000 7ff7f165f700 1 -- 172.21.15.59:0/2736801411 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7ec074ea0 con 0x7ff7ec0a1340 2023-09-30T22:34:27.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.400+0000 7ff7d37fe700 1 -- 172.21.15.59:0/2736801411 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff7e0021030 con 0x7ff7ec0a1340 2023-09-30T22:34:27.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.405+0000 7ff7d37fe700 1 -- 172.21.15.59:0/2736801411 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7e001a430 con 0x7ff7ec0a1340 2023-09-30T22:34:27.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.433+0000 7fe081dea700 1 Processor -- start 2023-09-30T22:34:27.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.433+0000 7fe081dea700 1 -- start start 2023-09-30T22:34:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.433+0000 7fe081dea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe07c136830 0x7fe07c138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.433+0000 7fe081dea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07c139150 0x7fe07c13b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.433+0000 7fe081dea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07c06f720 con 0x7fe07c1338c0 2023-09-30T22:34:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.433+0000 7fe081dea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07c070c80 con 0x7fe07c136830 2023-09-30T22:34:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.433+0000 7fe081dea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c06fce0 con 0x7fe07c139150 2023-09-30T22:34:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.434+0000 7fe07affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe07c136830 0x7fe07c138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.434+0000 7fe07affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe07c136830 0x7fe07c138c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48394/0 (socket says 172.21.15.59:48394) 2023-09-30T22:34:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.434+0000 7fe07bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07c139150 0x7fe07c13b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.434+0000 7fe07affd700 1 -- 172.21.15.59:0/2638262795 learned_addr learned my addr 172.21.15.59:0/2638262795 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:27.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.434+0000 7fe07bfff700 1 -- 172.21.15.59:0/2638262795 >> v2:172.21.15.59:3300/0 conn(0x7fe07c136830 msgr2=0x7fe07c138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:27.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.434+0000 7fe07bfff700 1 --2- 172.21.15.59:0/2638262795 >> v2:172.21.15.59:3300/0 conn(0x7fe07c136830 0x7fe07c138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.434+0000 7fe07bfff700 1 -- 172.21.15.59:0/2638262795 >> v1:172.21.15.59:6789/0 conn(0x7fe07c1338c0 legacy=0x7fe07c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.434+0000 7fe07bfff700 1 -- 172.21.15.59:0/2638262795 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c1336a0 con 0x7fe07c139150 2023-09-30T22:34:27.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.434+0000 7fe07a7fc700 1 -- 172.21.15.59:0/2638262795 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819315737 0 0) 0x7fe07c06f720 con 0x7fe07c1338c0 2023-09-30T22:34:27.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.434+0000 7fe07affd700 1 --2- 172.21.15.59:0/2638262795 >> v2:172.21.15.59:3300/0 conn(0x7fe07c136830 0x7fe07c138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:27.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.434+0000 7fe07bfff700 1 --2- 172.21.15.59:0/2638262795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07c139150 0x7fe07c13b530 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe074009d90 tx=0x7fe07400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d1cece3379750f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:27.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.435+0000 7fe07a7fc700 1 -- 172.21.15.59:0/2638262795 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07400e070 con 0x7fe07c139150 2023-09-30T22:34:27.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.435+0000 7fe07a7fc700 1 -- 172.21.15.59:0/2638262795 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07400bb20 con 0x7fe07c139150 2023-09-30T22:34:27.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.435+0000 7fe07a7fc700 1 -- 172.21.15.59:0/2638262795 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074012430 con 0x7fe07c139150 2023-09-30T22:34:27.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.436+0000 7fe081dea700 1 -- 172.21.15.59:0/2638262795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07c139150 msgr2=0x7fe07c13b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.436+0000 7fe081dea700 1 --2- 172.21.15.59:0/2638262795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07c139150 0x7fe07c13b530 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe074009d90 tx=0x7fe07400b330 comp rx=0 tx=0).stop 2023-09-30T22:34:27.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.436+0000 7fe081dea700 1 -- 172.21.15.59:0/2638262795 shutdown_connections 2023-09-30T22:34:27.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.436+0000 7fe081dea700 1 --2- 172.21.15.59:0/2638262795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07c139150 0x7fe07c13b530 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.436+0000 7fe081dea700 1 --2- 172.21.15.59:0/2638262795 >> v2:172.21.15.59:3300/0 conn(0x7fe07c136830 0x7fe07c138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.436+0000 7fe081dea700 1 -- 172.21.15.59:0/2638262795 >> 172.21.15.59:0/2638262795 conn(0x7fe07c0a2aa0 msgr2=0x7fe07c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:27.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.436+0000 7fe081dea700 1 -- 172.21.15.59:0/2638262795 shutdown_connections 2023-09-30T22:34:27.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.436+0000 7fe081dea700 1 -- 172.21.15.59:0/2638262795 wait complete. 2023-09-30T22:34:27.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.437+0000 7fe081dea700 1 Processor -- start 2023-09-30T22:34:27.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.438+0000 7fe081dea700 1 -- start start 2023-09-30T22:34:27.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.438+0000 7fe081dea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07c1338c0 0x7fe07c1c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.438+0000 7fe081dea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe07c136830 0x7fe07c1c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.438+0000 7fe081dea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07c139150 0x7fe07c118fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.438+0000 7fe081dea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c1be230 con 0x7fe07c1338c0 2023-09-30T22:34:27.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.438+0000 7fe081dea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c11a870 con 0x7fe07c136830 2023-09-30T22:34:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.438+0000 7fe081dea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c072660 con 0x7fe07c139150 2023-09-30T22:34:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.439+0000 7fe07bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07c139150 0x7fe07c118fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.439+0000 7fe07bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07c139150 0x7fe07c118fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59978/0 (socket says 172.21.15.59:59978) 2023-09-30T22:34:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.439+0000 7fe07bfff700 1 -- 172.21.15.59:0/1540845220 learned_addr learned my addr 172.21.15.59:0/1540845220 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.439+0000 7fe07bfff700 1 -- 172.21.15.59:0/1540845220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe07c136830 msgr2=0x7fe07c1c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.439+0000 7fe07bfff700 1 --2- 172.21.15.59:0/1540845220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe07c136830 0x7fe07c1c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.439+0000 7fe07bfff700 1 -- 172.21.15.59:0/1540845220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07c1338c0 msgr2=0x7fe07c1c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.439+0000 7fe07bfff700 1 --2- 172.21.15.59:0/1540845220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07c1338c0 0x7fe07c1c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.439+0000 7fe07bfff700 1 -- 172.21.15.59:0/1540845220 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe070009550 con 0x7fe07c139150 2023-09-30T22:34:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.439+0000 7fe07bfff700 1 --2- 172.21.15.59:0/1540845220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07c139150 0x7fe07c118fb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe074013000 tx=0x7fe074004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:27.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.439+0000 7fe063fff700 1 -- 172.21.15.59:0/1540845220 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074012430 con 0x7fe07c139150 2023-09-30T22:34:27.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.440+0000 7fe063fff700 1 -- 172.21.15.59:0/1540845220 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe074020070 con 0x7fe07c139150 2023-09-30T22:34:27.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.440+0000 7fe063fff700 1 -- 172.21.15.59:0/1540845220 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074004280 con 0x7fe07c139150 2023-09-30T22:34:27.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.440+0000 7fe081dea700 1 -- 172.21.15.59:0/1540845220 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe074009a70 con 0x7fe07c139150 2023-09-30T22:34:27.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.440+0000 7fe081dea700 1 -- 172.21.15.59:0/1540845220 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c11bf60 con 0x7fe07c139150 2023-09-30T22:34:27.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.441+0000 7fe081dea700 1 -- 172.21.15.59:0/1540845220 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07c074ea0 con 0x7fe07c139150 2023-09-30T22:34:27.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.442+0000 7fe063fff700 1 -- 172.21.15.59:0/1540845220 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe0740043e0 con 0x7fe07c139150 2023-09-30T22:34:27.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.442+0000 7fe063fff700 1 -- 172.21.15.59:0/1540845220 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe074022070 con 0x7fe07c139150 2023-09-30T22:34:27.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.446+0000 7fe063fff700 1 -- 172.21.15.59:0/1540845220 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe074031430 con 0x7fe07c139150 2023-09-30T22:34:27.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.477+0000 7feac46d6700 1 Processor -- start 2023-09-30T22:34:27.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.477+0000 7feac46d6700 1 -- start start 2023-09-30T22:34:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.478+0000 7feac46d6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feabc134710 0x7feabc136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.478+0000 7feac46d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feabc137030 0x7feabc139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.478+0000 7feac46d6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feabc131510 con 0x7feabc1316d0 2023-09-30T22:34:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.478+0000 7feac46d6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feabc099e70 con 0x7feabc134710 2023-09-30T22:34:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.478+0000 7feac46d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc066680 con 0x7feabc137030 2023-09-30T22:34:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.478+0000 7feac1c71700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feabc134710 0x7feabc136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.478+0000 7feac1c71700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feabc134710 0x7feabc136af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48400/0 (socket says 172.21.15.59:48400) 2023-09-30T22:34:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.478+0000 7feac1c71700 1 -- 172.21.15.59:0/1456492041 learned_addr learned my addr 172.21.15.59:0/1456492041 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.478+0000 7feac2c73700 1 --2- 172.21.15.59:0/1456492041 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feabc137030 0x7feabc139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.479+0000 7feac1c71700 1 -- 172.21.15.59:0/1456492041 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feabc137030 msgr2=0x7feabc139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.479+0000 7feac1c71700 1 --2- 172.21.15.59:0/1456492041 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feabc137030 0x7feabc139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.479+0000 7feac1c71700 1 -- 172.21.15.59:0/1456492041 >> v1:172.21.15.59:6789/0 conn(0x7feabc1316d0 legacy=0x7feabc131aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.479+0000 7feac1c71700 1 -- 172.21.15.59:0/1456492041 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc09ee00 con 0x7feabc134710 2023-09-30T22:34:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.479+0000 7feac1c71700 1 --2- 172.21.15.59:0/1456492041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feabc134710 0x7feabc136af0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7feaac0098f0 tx=0x7feaac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43682d614b570cc7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:27.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.479+0000 7feac1470700 1 -- 172.21.15.59:0/1456492041 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac011830 con 0x7feabc134710 2023-09-30T22:34:27.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.479+0000 7feac1470700 1 -- 172.21.15.59:0/1456492041 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac011990 con 0x7feabc134710 2023-09-30T22:34:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.479+0000 7feac1470700 1 -- 172.21.15.59:0/1456492041 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac011d20 con 0x7feabc134710 2023-09-30T22:34:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.480+0000 7feac46d6700 1 -- 172.21.15.59:0/1456492041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feabc134710 msgr2=0x7feabc136af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.480+0000 7feac46d6700 1 --2- 172.21.15.59:0/1456492041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feabc134710 0x7feabc136af0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7feaac0098f0 tx=0x7feaac009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.481+0000 7feac46d6700 1 -- 172.21.15.59:0/1456492041 shutdown_connections 2023-09-30T22:34:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.481+0000 7feac46d6700 1 --2- 172.21.15.59:0/1456492041 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feabc137030 0x7feabc139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.481+0000 7feac46d6700 1 --2- 172.21.15.59:0/1456492041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feabc134710 0x7feabc136af0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.481+0000 7feac46d6700 1 -- 172.21.15.59:0/1456492041 >> 172.21.15.59:0/1456492041 conn(0x7feabc0a2aa0 msgr2=0x7feabc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.481+0000 7feac46d6700 1 -- 172.21.15.59:0/1456492041 shutdown_connections 2023-09-30T22:34:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.481+0000 7feac46d6700 1 -- 172.21.15.59:0/1456492041 wait complete. 2023-09-30T22:34:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.482+0000 7feac46d6700 1 Processor -- start 2023-09-30T22:34:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.482+0000 7feac46d6700 1 -- start start 2023-09-30T22:34:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.483+0000 7feac46d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feabc1316d0 0x7feabc118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.483+0000 7feac46d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feabc134710 0x7feabc119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.483+0000 7feac46d6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feabc137030 0x7feabc119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.483+0000 7feac46d6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc12e560 con 0x7feabc137030 2023-09-30T22:34:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.483+0000 7feac46d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc11ae70 con 0x7feabc134710 2023-09-30T22:34:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.483+0000 7feac46d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feabc11a950 con 0x7feabc1316d0 2023-09-30T22:34:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.483+0000 7feac1c71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feabc134710 0x7feabc119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.483+0000 7feac1c71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feabc134710 0x7feabc119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51512/0 (socket says 172.21.15.59:51512) 2023-09-30T22:34:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.483+0000 7feac1c71700 1 -- 172.21.15.59:0/3002354364 learned_addr learned my addr 172.21.15.59:0/3002354364 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.483+0000 7feac2472700 1 --2- 172.21.15.59:0/3002354364 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feabc1316d0 0x7feabc118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.483+0000 7feac2c73700 1 --2- 172.21.15.59:0/3002354364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feabc137030 0x7feabc119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.483+0000 7feac2472700 1 -- 172.21.15.59:0/3002354364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feabc134710 msgr2=0x7feabc119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.483+0000 7feac2472700 1 --2- 172.21.15.59:0/3002354364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feabc134710 0x7feabc119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.483+0000 7feac2472700 1 -- 172.21.15.59:0/3002354364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feabc137030 msgr2=0x7feabc119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.484+0000 7feac2472700 1 --2- 172.21.15.59:0/3002354364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feabc137030 0x7feabc119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.484+0000 7feac2472700 1 -- 172.21.15.59:0/3002354364 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac009550 con 0x7feabc1316d0 2023-09-30T22:34:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.484+0000 7feac2472700 1 --2- 172.21.15.59:0/3002354364 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feabc1316d0 0x7feabc118cd0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7feab800c450 tx=0x7feab800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.484+0000 7feab2ffd700 1 -- 172.21.15.59:0/3002354364 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab80052d0 con 0x7feabc1316d0 2023-09-30T22:34:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.484+0000 7feab2ffd700 1 -- 172.21.15.59:0/3002354364 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab8005430 con 0x7feabc1316d0 2023-09-30T22:34:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.484+0000 7feac46d6700 1 -- 172.21.15.59:0/3002354364 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feabc11c470 con 0x7feabc1316d0 2023-09-30T22:34:27.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.484+0000 7feab2ffd700 1 -- 172.21.15.59:0/3002354364 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab80038c0 con 0x7feabc1316d0 2023-09-30T22:34:27.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.484+0000 7feac46d6700 1 -- 172.21.15.59:0/3002354364 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feabc11cee0 con 0x7feabc1316d0 2023-09-30T22:34:27.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.485+0000 7feac46d6700 1 -- 172.21.15.59:0/3002354364 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feabc11c110 con 0x7feabc1316d0 2023-09-30T22:34:27.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.486+0000 7feab2ffd700 1 -- 172.21.15.59:0/3002354364 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feab8003a20 con 0x7feabc1316d0 2023-09-30T22:34:27.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.486+0000 7feab2ffd700 1 -- 172.21.15.59:0/3002354364 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feab803ead0 con 0x7feabc1316d0 2023-09-30T22:34:27.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.491+0000 7feab2ffd700 1 -- 172.21.15.59:0/3002354364 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feab80192c0 con 0x7feabc1316d0 2023-09-30T22:34:27.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.521+0000 7f71d401f700 1 Processor -- start 2023-09-30T22:34:27.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.521+0000 7f71d401f700 1 -- start start 2023-09-30T22:34:27.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.522+0000 7f71d401f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc09e850 0x7f71cc09ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.522+0000 7f71d401f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09f160 0x7f71cc133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.522+0000 7f71d401f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71cc09f960 con 0x7f71cc134130 2023-09-30T22:34:27.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.522+0000 7f71d401f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc09ae60 con 0x7f71cc09f160 2023-09-30T22:34:27.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.522+0000 7f71d401f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc06cb10 con 0x7f71cc09e850 2023-09-30T22:34:27.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.522+0000 7f71d1dbb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc09e850 0x7f71cc09ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.522+0000 7f71d25bc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f71cc134130 0x7f71cc13aeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36700/0 (socket says 172.21.15.59:36700) 2023-09-30T22:34:27.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.522+0000 7f71d25bc700 1 -- 172.21.15.59:0/3965731783 learned_addr learned my addr 172.21.15.59:0/3965731783 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:27.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.522+0000 7f71d15ba700 1 --2- 172.21.15.59:0/3965731783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09f160 0x7f71cc133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.523+0000 7f71d1dbb700 1 -- 172.21.15.59:0/3965731783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09f160 msgr2=0x7f71cc133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:27.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.523+0000 7f71d1dbb700 1 --2- 172.21.15.59:0/3965731783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09f160 0x7f71cc133bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.523+0000 7f71d1dbb700 1 -- 172.21.15.59:0/3965731783 >> v1:172.21.15.59:6789/0 conn(0x7f71cc134130 legacy=0x7f71cc13aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.523+0000 7f71d1dbb700 1 -- 172.21.15.59:0/3965731783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc06b990 con 0x7f71cc09e850 2023-09-30T22:34:27.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.523+0000 7f71d0db9700 1 -- 172.21.15.59:0/3965731783 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294120507 0 0) 0x7f71cc09f960 con 0x7f71cc134130 2023-09-30T22:34:27.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.523+0000 7f71d1dbb700 1 --2- 172.21.15.59:0/3965731783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc09e850 0x7f71cc09ec20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009870 tx=0x7f71c8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11305a04b60aa615 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:27.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.523+0000 7f71d0db9700 1 -- 172.21.15.59:0/3965731783 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8011830 con 0x7f71cc09e850 2023-09-30T22:34:27.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.523+0000 7f71d0db9700 1 -- 172.21.15.59:0/3965731783 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c8011990 con 0x7f71cc09e850 2023-09-30T22:34:27.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.523+0000 7f71d0db9700 1 -- 172.21.15.59:0/3965731783 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8011d20 con 0x7f71cc09e850 2023-09-30T22:34:27.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.524+0000 7f71d401f700 1 -- 172.21.15.59:0/3965731783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc09e850 msgr2=0x7f71cc09ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.524+0000 7f71d401f700 1 --2- 172.21.15.59:0/3965731783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc09e850 0x7f71cc09ec20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009870 tx=0x7f71c8009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:27.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.524+0000 7f71d401f700 1 -- 172.21.15.59:0/3965731783 shutdown_connections 2023-09-30T22:34:27.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.524+0000 7f71d401f700 1 --2- 172.21.15.59:0/3965731783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc09e850 0x7f71cc09ec20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.524+0000 7f71d401f700 1 --2- 172.21.15.59:0/3965731783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09f160 0x7f71cc133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.524+0000 7f71d401f700 1 -- 172.21.15.59:0/3965731783 >> 172.21.15.59:0/3965731783 conn(0x7f71cc0a3f70 msgr2=0x7f71cc0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:27.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.524+0000 7f71d401f700 1 -- 172.21.15.59:0/3965731783 shutdown_connections 2023-09-30T22:34:27.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.525+0000 7f71d401f700 1 -- 172.21.15.59:0/3965731783 wait complete. 2023-09-30T22:34:27.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.526+0000 7f71d401f700 1 Processor -- start 2023-09-30T22:34:27.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.526+0000 7f71d401f700 1 -- start start 2023-09-30T22:34:27.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d401f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09e850 0x7f71cc1c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d401f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc09f160 0x7f71cc1c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d401f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc134130 0x7f71cc11ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:27.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d401f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc1222e0 con 0x7f71cc09f160 2023-09-30T22:34:27.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d401f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc1224c0 con 0x7f71cc09e850 2023-09-30T22:34:27.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d401f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc1bd610 con 0x7f71cc134130 2023-09-30T22:34:27.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d1dbb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09e850 0x7f71cc1c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d15ba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc09f160 0x7f71cc1c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d15ba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc09f160 0x7f71cc1c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48416/0 (socket says 172.21.15.59:48416) 2023-09-30T22:34:27.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d1dbb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09e850 0x7f71cc1c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51538/0 (socket says 172.21.15.59:51538) 2023-09-30T22:34:27.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d15ba700 1 -- 172.21.15.59:0/785941709 learned_addr learned my addr 172.21.15.59:0/785941709 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:27.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d25bc700 1 --2- 172.21.15.59:0/785941709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc134130 0x7f71cc11ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:27.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d1dbb700 1 -- 172.21.15.59:0/785941709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc134130 msgr2=0x7f71cc11ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d1dbb700 1 --2- 172.21.15.59:0/785941709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc134130 0x7f71cc11ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d1dbb700 1 -- 172.21.15.59:0/785941709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc09f160 msgr2=0x7f71cc1c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d1dbb700 1 --2- 172.21.15.59:0/785941709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc09f160 0x7f71cc1c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.527+0000 7f71d1dbb700 1 -- 172.21.15.59:0/785941709 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c80094a0 con 0x7f71cc09e850 2023-09-30T22:34:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.528+0000 7f71d15ba700 1 --2- 172.21.15.59:0/785941709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc09f160 0x7f71cc1c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.528+0000 7f71d25bc700 1 --2- 172.21.15.59:0/785941709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc134130 0x7f71cc11ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.528+0000 7f71d1dbb700 1 --2- 172.21.15.59:0/785941709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09e850 0x7f71cc1c8a80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f71c8016000 tx=0x7f71c8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.528+0000 7f71c27fc700 1 -- 172.21.15.59:0/785941709 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8004510 con 0x7f71cc09e850 2023-09-30T22:34:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.528+0000 7f71c27fc700 1 -- 172.21.15.59:0/785941709 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c801f070 con 0x7f71cc09e850 2023-09-30T22:34:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.528+0000 7f71d401f700 1 -- 172.21.15.59:0/785941709 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71cc133580 con 0x7f71cc09e850 2023-09-30T22:34:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.528+0000 7f71d401f700 1 -- 172.21.15.59:0/785941709 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71cc1c9500 con 0x7f71cc09e850 2023-09-30T22:34:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.528+0000 7f71c27fc700 1 -- 172.21.15.59:0/785941709 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c80038e0 con 0x7f71cc09e850 2023-09-30T22:34:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.529+0000 7f71c27fc700 1 -- 172.21.15.59:0/785941709 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71c8003a40 con 0x7f71cc09e850 2023-09-30T22:34:27.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.529+0000 7f71d401f700 1 -- 172.21.15.59:0/785941709 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b40052e0 con 0x7f71cc09e850 2023-09-30T22:34:27.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.530+0000 7f71c27fc700 1 -- 172.21.15.59:0/785941709 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f71c8021070 con 0x7f71cc09e850 2023-09-30T22:34:27.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.539+0000 7f71c27fc700 1 -- 172.21.15.59:0/785941709 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71c8010380 con 0x7f71cc09e850 2023-09-30T22:34:27.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.626+0000 7ff7f165f700 1 -- 172.21.15.59:0/2736801411 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff7ec0a28e0 con 0x7ff7ec0a1340 2023-09-30T22:34:27.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.626+0000 7ff7d37fe700 1 -- 172.21.15.59:0/2736801411 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7e002b030 con 0x7ff7ec0a1340 2023-09-30T22:34:27.627 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:27.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.630+0000 7ff7f165f700 1 -- 172.21.15.59:0/2736801411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7ec0a1340 msgr2=0x7ff7ec1c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.630+0000 7ff7f165f700 1 --2- 172.21.15.59:0/2736801411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7ec0a1340 0x7ff7ec1c8a00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec09e330 tx=0x7ff7e0004750 comp rx=0 tx=0).stop 2023-09-30T22:34:27.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.630+0000 7ff7f165f700 1 -- 172.21.15.59:0/2736801411 shutdown_connections 2023-09-30T22:34:27.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.630+0000 7ff7f165f700 1 --2- 172.21.15.59:0/2736801411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7ec133fa0 0x7ff7ec1c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.630+0000 7ff7f165f700 1 --2- 172.21.15.59:0/2736801411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ec0a0a30 0x7ff7ec1c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.630+0000 7ff7f165f700 1 --2- 172.21.15.59:0/2736801411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7ec0a1340 0x7ff7ec1c8a00 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.630+0000 7ff7f165f700 1 -- 172.21.15.59:0/2736801411 >> 172.21.15.59:0/2736801411 conn(0x7ff7ec0a6550 msgr2=0x7ff7ec1b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:27.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.630+0000 7ff7f165f700 1 -- 172.21.15.59:0/2736801411 shutdown_connections 2023-09-30T22:34:27.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.630+0000 7ff7f165f700 1 -- 172.21.15.59:0/2736801411 wait complete. 2023-09-30T22:34:27.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:27.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.661+0000 7fe081dea700 1 -- 172.21.15.59:0/1540845220 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe07c0a0050 con 0x7fe07c139150 2023-09-30T22:34:27.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.662+0000 7fe063fff700 1 -- 172.21.15.59:0/1540845220 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe074035090 con 0x7fe07c139150 2023-09-30T22:34:27.662 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:27.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.665+0000 7fe081dea700 1 -- 172.21.15.59:0/1540845220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07c139150 msgr2=0x7fe07c118fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.665+0000 7fe081dea700 1 --2- 172.21.15.59:0/1540845220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07c139150 0x7fe07c118fb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe074013000 tx=0x7fe074004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.665+0000 7fe081dea700 1 -- 172.21.15.59:0/1540845220 shutdown_connections 2023-09-30T22:34:27.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.665+0000 7fe081dea700 1 --2- 172.21.15.59:0/1540845220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe07c139150 0x7fe07c118fb0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.665+0000 7fe081dea700 1 --2- 172.21.15.59:0/1540845220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe07c1338c0 0x7fe07c1c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.665+0000 7fe081dea700 1 --2- 172.21.15.59:0/1540845220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe07c136830 0x7fe07c1c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.665+0000 7fe081dea700 1 -- 172.21.15.59:0/1540845220 >> 172.21.15.59:0/1540845220 conn(0x7fe07c0a2aa0 msgr2=0x7fe07c12f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.665+0000 7fe081dea700 1 -- 172.21.15.59:0/1540845220 shutdown_connections 2023-09-30T22:34:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.665+0000 7fe081dea700 1 -- 172.21.15.59:0/1540845220 wait complete. 2023-09-30T22:34:27.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:27.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.716+0000 7feac46d6700 1 -- 172.21.15.59:0/3002354364 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feabc11c110 con 0x7feabc1316d0 2023-09-30T22:34:27.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.716+0000 7feab2ffd700 1 -- 172.21.15.59:0/3002354364 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feabc11c110 con 0x7feabc1316d0 2023-09-30T22:34:27.717 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:27.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.720+0000 7feac46d6700 1 -- 172.21.15.59:0/3002354364 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feabc1316d0 msgr2=0x7feabc118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.720+0000 7feac46d6700 1 --2- 172.21.15.59:0/3002354364 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feabc1316d0 0x7feabc118cd0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7feab800c450 tx=0x7feab800c760 comp rx=0 tx=0).stop 2023-09-30T22:34:27.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.720+0000 7feac46d6700 1 -- 172.21.15.59:0/3002354364 shutdown_connections 2023-09-30T22:34:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.720+0000 7feac46d6700 1 --2- 172.21.15.59:0/3002354364 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feabc1316d0 0x7feabc118cd0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.720+0000 7feac46d6700 1 --2- 172.21.15.59:0/3002354364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feabc137030 0x7feabc119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.720+0000 7feac46d6700 1 --2- 172.21.15.59:0/3002354364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feabc134710 0x7feabc119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.720+0000 7feac46d6700 1 -- 172.21.15.59:0/3002354364 >> 172.21.15.59:0/3002354364 conn(0x7feabc0a2aa0 msgr2=0x7feabc134ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.720+0000 7feac46d6700 1 -- 172.21.15.59:0/3002354364 shutdown_connections 2023-09-30T22:34:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.720+0000 7feac46d6700 1 -- 172.21.15.59:0/3002354364 wait complete. 2023-09-30T22:34:27.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:27.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.765+0000 7f71d401f700 1 -- 172.21.15.59:0/785941709 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f71b4005590 con 0x7f71cc09e850 2023-09-30T22:34:27.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.765+0000 7f71c27fc700 1 -- 172.21.15.59:0/785941709 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71c8015020 con 0x7f71cc09e850 2023-09-30T22:34:27.765 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:27.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.767+0000 7f71d401f700 1 -- 172.21.15.59:0/785941709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09e850 msgr2=0x7f71cc1c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:27.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.767+0000 7f71d401f700 1 --2- 172.21.15.59:0/785941709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09e850 0x7f71cc1c8a80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f71c8016000 tx=0x7f71c8004750 comp rx=0 tx=0).stop 2023-09-30T22:34:27.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.767+0000 7f71d401f700 1 -- 172.21.15.59:0/785941709 shutdown_connections 2023-09-30T22:34:27.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.767+0000 7f71d401f700 1 --2- 172.21.15.59:0/785941709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f71cc134130 0x7f71cc11ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.767+0000 7f71d401f700 1 --2- 172.21.15.59:0/785941709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc09e850 0x7f71cc1c8a80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.767+0000 7f71d401f700 1 --2- 172.21.15.59:0/785941709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc09f160 0x7f71cc1c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:27.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.767+0000 7f71d401f700 1 -- 172.21.15.59:0/785941709 >> 172.21.15.59:0/785941709 conn(0x7f71cc0a3f70 msgr2=0x7f71cc0a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:27.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.768+0000 7f71d401f700 1 -- 172.21.15.59:0/785941709 shutdown_connections 2023-09-30T22:34:27.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:27.768+0000 7f71d401f700 1 -- 172.21.15.59:0/785941709 wait complete. 2023-09-30T22:34:27.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:28.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:28.685 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:28.735 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:28.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:28.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.801+0000 7f56c2be2700 1 Processor -- start 2023-09-30T22:34:28.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.802+0000 7f56c2be2700 1 -- start start 2023-09-30T22:34:28.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.802+0000 7f56c2be2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56bc06e570 0x7f56bc06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.802+0000 7f56c2be2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56bc09eca0 0x7f56bc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.802+0000 7f56c2be2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56bc134610 0x7f56bc134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.802+0000 7f56c2be2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56bc070ee0 con 0x7f56bc134610 2023-09-30T22:34:28.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.802+0000 7f56c2be2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc071480 con 0x7f56bc06e570 2023-09-30T22:34:28.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.802+0000 7f56c2be2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc06f3c0 con 0x7f56bc09eca0 2023-09-30T22:34:28.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.802+0000 7f56c117f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56bc134610 0x7f56bc134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.802+0000 7f56c117f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56bc134610 0x7f56bc134ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48422/0 (socket says 172.21.15.59:48422) 2023-09-30T22:34:28.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.802+0000 7f56c117f700 1 -- 172.21.15.59:0/3111372929 learned_addr learned my addr 172.21.15.59:0/3111372929 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:28.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.802+0000 7f56c097e700 1 --2- 172.21.15.59:0/3111372929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56bc06e570 0x7f56bc06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.803+0000 7f56bbfff700 1 --2- 172.21.15.59:0/3111372929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56bc09eca0 0x7f56bc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.803+0000 7f56c117f700 1 -- 172.21.15.59:0/3111372929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56bc09eca0 msgr2=0x7f56bc06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:28.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.803+0000 7f56c117f700 1 --2- 172.21.15.59:0/3111372929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56bc09eca0 0x7f56bc06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.803+0000 7f56c117f700 1 -- 172.21.15.59:0/3111372929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56bc06e570 msgr2=0x7f56bc06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:28.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.803+0000 7f56c117f700 1 --2- 172.21.15.59:0/3111372929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56bc06e570 0x7f56bc06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.803+0000 7f56c117f700 1 -- 172.21.15.59:0/3111372929 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc071b90 con 0x7f56bc134610 2023-09-30T22:34:28.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.803+0000 7f56c117f700 1 --2- 172.21.15.59:0/3111372929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56bc134610 0x7f56bc134ab0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f56b4009e50 tx=0x7f56b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad3908c24201bb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:28.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.803+0000 7f56bb7fe700 1 -- 172.21.15.59:0/3111372929 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b400e070 con 0x7f56bc134610 2023-09-30T22:34:28.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.803+0000 7f56bb7fe700 1 -- 172.21.15.59:0/3111372929 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b400b9c0 con 0x7f56bc134610 2023-09-30T22:34:28.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.803+0000 7f56bb7fe700 1 -- 172.21.15.59:0/3111372929 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b400bd70 con 0x7f56bc134610 2023-09-30T22:34:28.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.804+0000 7f56c2be2700 1 -- 172.21.15.59:0/3111372929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56bc134610 msgr2=0x7f56bc134ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:28.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.804+0000 7f56c2be2700 1 --2- 172.21.15.59:0/3111372929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56bc134610 0x7f56bc134ab0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f56b4009e50 tx=0x7f56b400b330 comp rx=0 tx=0).stop 2023-09-30T22:34:28.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.804+0000 7f56c2be2700 1 -- 172.21.15.59:0/3111372929 shutdown_connections 2023-09-30T22:34:28.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.804+0000 7f56c2be2700 1 --2- 172.21.15.59:0/3111372929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56bc134610 0x7f56bc134ab0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.804+0000 7f56c2be2700 1 --2- 172.21.15.59:0/3111372929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56bc06e570 0x7f56bc06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.804+0000 7f56c2be2700 1 --2- 172.21.15.59:0/3111372929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56bc09eca0 0x7f56bc06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.804+0000 7f56c2be2700 1 -- 172.21.15.59:0/3111372929 >> 172.21.15.59:0/3111372929 conn(0x7f56bc0a2aa0 msgr2=0x7f56bc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:28.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.804+0000 7f56c2be2700 1 -- 172.21.15.59:0/3111372929 shutdown_connections 2023-09-30T22:34:28.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.804+0000 7f56c2be2700 1 -- 172.21.15.59:0/3111372929 wait complete. 2023-09-30T22:34:28.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.806+0000 7f56c2be2700 1 Processor -- start 2023-09-30T22:34:28.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.806+0000 7f56c2be2700 1 -- start start 2023-09-30T22:34:28.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.807+0000 7f56c2be2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56bc06e570 0x7f56bc127440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.807+0000 7f56c2be2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56bc134610 0x7f56bc125ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.807+0000 7f56c2be2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56bc127980 0x7f56bc1263e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.807+0000 7f56c2be2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc13e4d0 con 0x7f56bc134610 2023-09-30T22:34:28.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.807+0000 7f56c2be2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc13d610 con 0x7f56bc06e570 2023-09-30T22:34:28.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.807+0000 7f56c2be2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc13da40 con 0x7f56bc127980 2023-09-30T22:34:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.807+0000 7f56c097e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56bc06e570 0x7f56bc127440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.807+0000 7f56c097e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56bc06e570 0x7f56bc127440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51556/0 (socket says 172.21.15.59:51556) 2023-09-30T22:34:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.807+0000 7f56c097e700 1 -- 172.21.15.59:0/4096270798 learned_addr learned my addr 172.21.15.59:0/4096270798 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.807+0000 7f56bbfff700 1 --2- 172.21.15.59:0/4096270798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56bc134610 0x7f56bc125ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.807+0000 7f56c117f700 1 --2- 172.21.15.59:0/4096270798 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56bc127980 0x7f56bc1263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.807+0000 7f56bbfff700 1 -- 172.21.15.59:0/4096270798 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56bc127980 msgr2=0x7f56bc1263e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.807+0000 7f56bbfff700 1 --2- 172.21.15.59:0/4096270798 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56bc127980 0x7f56bc1263e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.807+0000 7f56bbfff700 1 -- 172.21.15.59:0/4096270798 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56bc06e570 msgr2=0x7f56bc127440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:28.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.807+0000 7f56bbfff700 1 --2- 172.21.15.59:0/4096270798 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56bc06e570 0x7f56bc127440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.808+0000 7f56bbfff700 1 -- 172.21.15.59:0/4096270798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b4009b30 con 0x7f56bc134610 2023-09-30T22:34:28.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.808+0000 7f56bbfff700 1 --2- 172.21.15.59:0/4096270798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56bc134610 0x7f56bc125ea0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f56bc070e10 tx=0x7f56a800eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:28.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.809+0000 7f56b97fa700 1 -- 172.21.15.59:0/4096270798 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a800c070 con 0x7f56bc134610 2023-09-30T22:34:28.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.809+0000 7f56b97fa700 1 -- 172.21.15.59:0/4096270798 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a8013610 con 0x7f56bc134610 2023-09-30T22:34:28.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.809+0000 7f56c2be2700 1 -- 172.21.15.59:0/4096270798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56bc0a2250 con 0x7f56bc134610 2023-09-30T22:34:28.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.809+0000 7f56b97fa700 1 -- 172.21.15.59:0/4096270798 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8013980 con 0x7f56bc134610 2023-09-30T22:34:28.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.809+0000 7f56c2be2700 1 -- 172.21.15.59:0/4096270798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56bc13e080 con 0x7f56bc134610 2023-09-30T22:34:28.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.810+0000 7f56b97fa700 1 -- 172.21.15.59:0/4096270798 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56a8013ae0 con 0x7f56bc134610 2023-09-30T22:34:28.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.810+0000 7f56b97fa700 1 -- 172.21.15.59:0/4096270798 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f56a803f090 con 0x7f56bc134610 2023-09-30T22:34:28.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.810+0000 7f56c2be2700 1 -- 172.21.15.59:0/4096270798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56bc0a2250 con 0x7f56bc134610 2023-09-30T22:34:28.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.815+0000 7f56b97fa700 1 -- 172.21.15.59:0/4096270798 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56bc0a2250 con 0x7f56bc134610 2023-09-30T22:34:28.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.846+0000 7fc11b2f4700 1 Processor -- start 2023-09-30T22:34:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.846+0000 7fc11b2f4700 1 -- start start 2023-09-30T22:34:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.846+0000 7fc11b2f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc11406e570 0x7fc11406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.846+0000 7fc11b2f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc11409eca0 0x7fc11406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.846+0000 7fc11b2f4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc114134610 0x7fc114134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.846+0000 7fc11b2f4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc114070ee0 con 0x7fc114134610 2023-09-30T22:34:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.846+0000 7fc11b2f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc114071480 con 0x7fc11409eca0 2023-09-30T22:34:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.846+0000 7fc11b2f4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc11406f3c0 con 0x7fc11406e570 2023-09-30T22:34:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.847+0000 7fc119891700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc114134610 0x7fc114134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.847+0000 7fc119891700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc114134610 0x7fc114134ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48452/0 (socket says 172.21.15.59:48452) 2023-09-30T22:34:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.847+0000 7fc119891700 1 -- 172.21.15.59:0/2525857967 learned_addr learned my addr 172.21.15.59:0/2525857967 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.847+0000 7fc119090700 1 --2- 172.21.15.59:0/2525857967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc11406e570 0x7fc11406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.847+0000 7fc11888f700 1 --2- 172.21.15.59:0/2525857967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc11409eca0 0x7fc11406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.847+0000 7fc119891700 1 -- 172.21.15.59:0/2525857967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc11406e570 msgr2=0x7fc11406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.847+0000 7fc119891700 1 --2- 172.21.15.59:0/2525857967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc11406e570 0x7fc11406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.847+0000 7fc119891700 1 -- 172.21.15.59:0/2525857967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc11409eca0 msgr2=0x7fc11406ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.847+0000 7fc119891700 1 --2- 172.21.15.59:0/2525857967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc11409eca0 0x7fc11406ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.847+0000 7fc119891700 1 -- 172.21.15.59:0/2525857967 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc114071b90 con 0x7fc114134610 2023-09-30T22:34:28.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.847+0000 7fc11888f700 1 --2- 172.21.15.59:0/2525857967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc11409eca0 0x7fc11406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:28.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.847+0000 7fc119891700 1 --2- 172.21.15.59:0/2525857967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc114134610 0x7fc114134ab0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009e50 tx=0x7fc10c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c625347b509f784a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:28.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.848+0000 7fc10bfff700 1 -- 172.21.15.59:0/2525857967 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c00e070 con 0x7fc114134610 2023-09-30T22:34:28.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.848+0000 7fc10bfff700 1 -- 172.21.15.59:0/2525857967 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c00b910 con 0x7fc114134610 2023-09-30T22:34:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.848+0000 7fc10bfff700 1 -- 172.21.15.59:0/2525857967 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c00bcc0 con 0x7fc114134610 2023-09-30T22:34:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.848+0000 7fc11b2f4700 1 -- 172.21.15.59:0/2525857967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc114134610 msgr2=0x7fc114134ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.848+0000 7fc11b2f4700 1 --2- 172.21.15.59:0/2525857967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc114134610 0x7fc114134ab0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009e50 tx=0x7fc10c00b330 comp rx=0 tx=0).stop 2023-09-30T22:34:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.849+0000 7fc11b2f4700 1 -- 172.21.15.59:0/2525857967 shutdown_connections 2023-09-30T22:34:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.849+0000 7fc11b2f4700 1 --2- 172.21.15.59:0/2525857967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc114134610 0x7fc114134ab0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.849+0000 7fc11b2f4700 1 --2- 172.21.15.59:0/2525857967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc11406e570 0x7fc11406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.849+0000 7fc11b2f4700 1 --2- 172.21.15.59:0/2525857967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc11409eca0 0x7fc11406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.849+0000 7fc11b2f4700 1 -- 172.21.15.59:0/2525857967 >> 172.21.15.59:0/2525857967 conn(0x7fc1140a2aa0 msgr2=0x7fc1140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.849+0000 7fc11b2f4700 1 -- 172.21.15.59:0/2525857967 shutdown_connections 2023-09-30T22:34:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.849+0000 7fc11b2f4700 1 -- 172.21.15.59:0/2525857967 wait complete. 2023-09-30T22:34:28.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.850+0000 7fc11b2f4700 1 Processor -- start 2023-09-30T22:34:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.850+0000 7fc11b2f4700 1 -- start start 2023-09-30T22:34:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.850+0000 7fc11b2f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc11406e570 0x7fc114127640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.850+0000 7fc11b2f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc114134610 0x7fc114125fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.850+0000 7fc11b2f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1141264f0 0x7fc114126960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.850+0000 7fc11b2f4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc114070610 con 0x7fc114134610 2023-09-30T22:34:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.850+0000 7fc11b2f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11413e6a0 con 0x7fc11406e570 2023-09-30T22:34:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.850+0000 7fc11b2f4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc11413c990 con 0x7fc1141264f0 2023-09-30T22:34:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.850+0000 7fc119090700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc11406e570 0x7fc114127640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.851+0000 7fc119891700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1141264f0 0x7fc114126960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.851+0000 7fc119090700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc11406e570 0x7fc114127640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51566/0 (socket says 172.21.15.59:51566) 2023-09-30T22:34:28.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.851+0000 7fc119090700 1 -- 172.21.15.59:0/3569693484 learned_addr learned my addr 172.21.15.59:0/3569693484 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:28.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.851+0000 7fc119891700 1 -- 172.21.15.59:0/3569693484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc11406e570 msgr2=0x7fc114127640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:28.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.851+0000 7fc119891700 1 --2- 172.21.15.59:0/3569693484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc11406e570 0x7fc114127640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.851+0000 7fc119891700 1 -- 172.21.15.59:0/3569693484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc114134610 msgr2=0x7fc114125fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:28.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.851+0000 7fc119891700 1 --2- 172.21.15.59:0/3569693484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc114134610 0x7fc114125fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.851+0000 7fc119891700 1 -- 172.21.15.59:0/3569693484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c009b30 con 0x7fc1141264f0 2023-09-30T22:34:28.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.851+0000 7fc119891700 1 --2- 172.21.15.59:0/3569693484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1141264f0 0x7fc114126960 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc10c015000 tx=0x7fc10c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:28.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.851+0000 7fc109ffb700 1 -- 172.21.15.59:0/3569693484 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c004450 con 0x7fc1141264f0 2023-09-30T22:34:28.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.851+0000 7fc11b2f4700 1 -- 172.21.15.59:0/3569693484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1140a1fa0 con 0x7fc1141264f0 2023-09-30T22:34:28.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.851+0000 7fc109ffb700 1 -- 172.21.15.59:0/3569693484 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c0045b0 con 0x7fc1141264f0 2023-09-30T22:34:28.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.851+0000 7fc109ffb700 1 -- 172.21.15.59:0/3569693484 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c004960 con 0x7fc1141264f0 2023-09-30T22:34:28.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.852+0000 7fc11b2f4700 1 -- 172.21.15.59:0/3569693484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc114127b80 con 0x7fc1141264f0 2023-09-30T22:34:28.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.854+0000 7fc0ff7fe700 1 -- 172.21.15.59:0/3569693484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ec0052e0 con 0x7fc1141264f0 2023-09-30T22:34:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.854+0000 7fc109ffb700 1 -- 172.21.15.59:0/3569693484 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc10c01c410 con 0x7fc1141264f0 2023-09-30T22:34:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.857+0000 7fc109ffb700 1 -- 172.21.15.59:0/3569693484 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc10c01ce20 con 0x7fc1141264f0 2023-09-30T22:34:28.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.863+0000 7fc109ffb700 1 -- 172.21.15.59:0/3569693484 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc10c01b3a0 con 0x7fc1141264f0 2023-09-30T22:34:28.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.896+0000 7f51f9bcb700 1 Processor -- start 2023-09-30T22:34:28.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.896+0000 7f51f9bcb700 1 -- start start 2023-09-30T22:34:28.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.897+0000 7f51f9bcb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f409f410 0x7f51f4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.897+0000 7f51f9bcb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51f4136fe0 0x7f51f41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.897+0000 7f51f9bcb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f4070940 con 0x7f51f409e930 2023-09-30T22:34:28.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.897+0000 7f51f9bcb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f406fd60 con 0x7f51f4136fe0 2023-09-30T22:34:28.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.897+0000 7f51f9bcb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51f406fa80 con 0x7f51f409f410 2023-09-30T22:34:28.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.897+0000 7f51f2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f409f410 0x7f51f4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.897+0000 7f51f2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f409f410 0x7f51f4136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60042/0 (socket says 172.21.15.59:60042) 2023-09-30T22:34:28.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.897+0000 7f51f2ffd700 1 -- 172.21.15.59:0/1116372607 learned_addr learned my addr 172.21.15.59:0/1116372607 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:28.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.897+0000 7f51f3fff700 1 --2- 172.21.15.59:0/1116372607 >> v2:172.21.15.59:3300/0 conn(0x7f51f4136fe0 0x7f51f41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.897+0000 7f51f2ffd700 1 -- 172.21.15.59:0/1116372607 >> v2:172.21.15.59:3300/0 conn(0x7f51f4136fe0 msgr2=0x7f51f41393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:28.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.897+0000 7f51f2ffd700 1 --2- 172.21.15.59:0/1116372607 >> v2:172.21.15.59:3300/0 conn(0x7f51f4136fe0 0x7f51f41393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.897+0000 7f51f2ffd700 1 -- 172.21.15.59:0/1116372607 >> v1:172.21.15.59:6789/0 conn(0x7f51f409e930 legacy=0x7f51f409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:28.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.897+0000 7f51f2ffd700 1 -- 172.21.15.59:0/1116372607 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f409fb60 con 0x7f51f409f410 2023-09-30T22:34:28.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.897+0000 7f51f27fc700 1 -- 172.21.15.59:0/1116372607 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826290648 0 0) 0x7f51f4070940 con 0x7f51f409e930 2023-09-30T22:34:28.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.898+0000 7f51f3fff700 1 --2- 172.21.15.59:0/1116372607 >> v2:172.21.15.59:3300/0 conn(0x7f51f4136fe0 0x7f51f41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:28.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.898+0000 7f51f2ffd700 1 --2- 172.21.15.59:0/1116372607 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f409f410 0x7f51f4136aa0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f51e80098f0 tx=0x7f51e8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f880779d92751ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:28.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.898+0000 7f51f27fc700 1 -- 172.21.15.59:0/1116372607 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8011830 con 0x7f51f409f410 2023-09-30T22:34:28.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.898+0000 7f51f27fc700 1 -- 172.21.15.59:0/1116372607 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8011990 con 0x7f51f409f410 2023-09-30T22:34:28.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.898+0000 7f51f27fc700 1 -- 172.21.15.59:0/1116372607 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8011d20 con 0x7f51f409f410 2023-09-30T22:34:28.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.899+0000 7f51f9bcb700 1 -- 172.21.15.59:0/1116372607 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f409f410 msgr2=0x7f51f4136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:28.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.899+0000 7f51f9bcb700 1 --2- 172.21.15.59:0/1116372607 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f409f410 0x7f51f4136aa0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f51e80098f0 tx=0x7f51e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:28.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.899+0000 7f51f9bcb700 1 -- 172.21.15.59:0/1116372607 shutdown_connections 2023-09-30T22:34:28.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.899+0000 7f51f9bcb700 1 --2- 172.21.15.59:0/1116372607 >> v2:172.21.15.59:3300/0 conn(0x7f51f4136fe0 0x7f51f41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.899+0000 7f51f9bcb700 1 --2- 172.21.15.59:0/1116372607 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f409f410 0x7f51f4136aa0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.899+0000 7f51f9bcb700 1 -- 172.21.15.59:0/1116372607 >> 172.21.15.59:0/1116372607 conn(0x7f51f40a4210 msgr2=0x7f51f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:28.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.899+0000 7f51f9bcb700 1 -- 172.21.15.59:0/1116372607 shutdown_connections 2023-09-30T22:34:28.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.899+0000 7f51f9bcb700 1 -- 172.21.15.59:0/1116372607 wait complete. 2023-09-30T22:34:28.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.900+0000 7f51f9bcb700 1 Processor -- start 2023-09-30T22:34:28.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.900+0000 7f51f9bcb700 1 -- start start 2023-09-30T22:34:28.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.901+0000 7f51f9bcb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f409e930 0x7f51f411b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.901+0000 7f51f9bcb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f409f410 0x7f51f411b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.901+0000 7f51f9bcb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4136fe0 0x7f51f411bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.901+0000 7f51f9bcb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f411edf0 con 0x7f51f409e930 2023-09-30T22:34:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.901+0000 7f51f9bcb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f40a3260 con 0x7f51f4136fe0 2023-09-30T22:34:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.901+0000 7f51f9bcb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4071d20 con 0x7f51f409f410 2023-09-30T22:34:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.901+0000 7f51f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4136fe0 0x7f51f411bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.901+0000 7f51f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4136fe0 0x7f51f411bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51578/0 (socket says 172.21.15.59:51578) 2023-09-30T22:34:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.901+0000 7f51f3fff700 1 -- 172.21.15.59:0/3535485834 learned_addr learned my addr 172.21.15.59:0/3535485834 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.901+0000 7f51f37fe700 1 --2- 172.21.15.59:0/3535485834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f409e930 0x7f51f411b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.901+0000 7f51f2ffd700 1 --2- 172.21.15.59:0/3535485834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f409f410 0x7f51f411b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.902+0000 7f51f3fff700 1 -- 172.21.15.59:0/3535485834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f409f410 msgr2=0x7f51f411b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:28.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.902+0000 7f51f3fff700 1 --2- 172.21.15.59:0/3535485834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f409f410 0x7f51f411b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.902+0000 7f51f3fff700 1 -- 172.21.15.59:0/3535485834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f409e930 msgr2=0x7f51f411b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:28.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.902+0000 7f51f3fff700 1 --2- 172.21.15.59:0/3535485834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f409e930 0x7f51f411b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.902+0000 7f51f3fff700 1 -- 172.21.15.59:0/3535485834 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec009a70 con 0x7f51f4136fe0 2023-09-30T22:34:28.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.902+0000 7f51f3fff700 1 --2- 172.21.15.59:0/3535485834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4136fe0 0x7f51f411bd50 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00ef90 tx=0x7f51ec00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:28.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.902+0000 7f51dbfff700 1 -- 172.21.15.59:0/3535485834 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00cc90 con 0x7f51f4136fe0 2023-09-30T22:34:28.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.902+0000 7f51dbfff700 1 -- 172.21.15.59:0/3535485834 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec00f040 con 0x7f51f4136fe0 2023-09-30T22:34:28.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.902+0000 7f51f9bcb700 1 -- 172.21.15.59:0/3535485834 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e8009550 con 0x7f51f4136fe0 2023-09-30T22:34:28.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.902+0000 7f51dbfff700 1 -- 172.21.15.59:0/3535485834 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0146c0 con 0x7f51f4136fe0 2023-09-30T22:34:28.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.902+0000 7f51f9bcb700 1 -- 172.21.15.59:0/3535485834 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f411e580 con 0x7f51f4136fe0 2023-09-30T22:34:28.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.904+0000 7f51f9bcb700 1 -- 172.21.15.59:0/3535485834 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f411f640 con 0x7f51f4136fe0 2023-09-30T22:34:28.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.904+0000 7f51dbfff700 1 -- 172.21.15.59:0/3535485834 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51ec014820 con 0x7f51f4136fe0 2023-09-30T22:34:28.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.904+0000 7f51dbfff700 1 -- 172.21.15.59:0/3535485834 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f51ec040300 con 0x7f51f4136fe0 2023-09-30T22:34:28.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.909+0000 7f51dbfff700 1 -- 172.21.15.59:0/3535485834 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51ec007920 con 0x7f51f4136fe0 2023-09-30T22:34:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.935+0000 7f083559f700 1 Processor -- start 2023-09-30T22:34:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.935+0000 7f083559f700 1 -- start start 2023-09-30T22:34:28.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.935+0000 7f083559f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f083006e570 0x7f083006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.935+0000 7f083559f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f083009eca0 0x7f083006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.935+0000 7f083559f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0830070ee0 con 0x7f0830134610 2023-09-30T22:34:28.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.935+0000 7f083559f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0830071480 con 0x7f083006e570 2023-09-30T22:34:28.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.935+0000 7f083559f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083006f3c0 con 0x7f083009eca0 2023-09-30T22:34:28.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.936+0000 7f082e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f083009eca0 0x7f083006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.936+0000 7f082e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f083009eca0 0x7f083006ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51588/0 (socket says 172.21.15.59:51588) 2023-09-30T22:34:28.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.936+0000 7f082e7fc700 1 -- 172.21.15.59:0/1353836866 learned_addr learned my addr 172.21.15.59:0/1353836866 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:28.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.936+0000 7f082effd700 1 --2- 172.21.15.59:0/1353836866 >> v2:172.21.15.59:3300/0 conn(0x7f083006e570 0x7f083006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.936+0000 7f082e7fc700 1 -- 172.21.15.59:0/1353836866 >> v2:172.21.15.59:3300/0 conn(0x7f083006e570 msgr2=0x7f083006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:28.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.936+0000 7f082e7fc700 1 --2- 172.21.15.59:0/1353836866 >> v2:172.21.15.59:3300/0 conn(0x7f083006e570 0x7f083006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.936+0000 7f082e7fc700 1 -- 172.21.15.59:0/1353836866 >> v1:172.21.15.59:6789/0 conn(0x7f0830134610 legacy=0x7f0830134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:28.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.936+0000 7f082e7fc700 1 -- 172.21.15.59:0/1353836866 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0830071b90 con 0x7f083009eca0 2023-09-30T22:34:28.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.936+0000 7f082dffb700 1 -- 172.21.15.59:0/1353836866 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128119789 0 0) 0x7f0830070ee0 con 0x7f0830134610 2023-09-30T22:34:28.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.936+0000 7f082effd700 1 --2- 172.21.15.59:0/1353836866 >> v2:172.21.15.59:3300/0 conn(0x7f083006e570 0x7f083006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:28.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.936+0000 7f082e7fc700 1 --2- 172.21.15.59:0/1353836866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f083009eca0 0x7f083006ee80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f08240098f0 tx=0x7f0824009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f687be2cb991cf06 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:28.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.937+0000 7f082dffb700 1 -- 172.21.15.59:0/1353836866 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082400b8a0 con 0x7f083009eca0 2023-09-30T22:34:28.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.937+0000 7f082dffb700 1 -- 172.21.15.59:0/1353836866 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082400ba00 con 0x7f083009eca0 2023-09-30T22:34:28.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.937+0000 7f082dffb700 1 -- 172.21.15.59:0/1353836866 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082400bd90 con 0x7f083009eca0 2023-09-30T22:34:28.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.937+0000 7f083559f700 1 -- 172.21.15.59:0/1353836866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f083009eca0 msgr2=0x7f083006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:28.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.937+0000 7f083559f700 1 --2- 172.21.15.59:0/1353836866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f083009eca0 0x7f083006ee80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f08240098f0 tx=0x7f0824009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:28.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.937+0000 7f083559f700 1 -- 172.21.15.59:0/1353836866 shutdown_connections 2023-09-30T22:34:28.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.937+0000 7f083559f700 1 --2- 172.21.15.59:0/1353836866 >> v2:172.21.15.59:3300/0 conn(0x7f083006e570 0x7f083006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.937+0000 7f083559f700 1 --2- 172.21.15.59:0/1353836866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f083009eca0 0x7f083006ee80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.937+0000 7f083559f700 1 -- 172.21.15.59:0/1353836866 >> 172.21.15.59:0/1353836866 conn(0x7f08300a2aa0 msgr2=0x7f08300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:28.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.937+0000 7f083559f700 1 -- 172.21.15.59:0/1353836866 shutdown_connections 2023-09-30T22:34:28.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.937+0000 7f083559f700 1 -- 172.21.15.59:0/1353836866 wait complete. 2023-09-30T22:34:28.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.939+0000 7f083559f700 1 Processor -- start 2023-09-30T22:34:28.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.939+0000 7f083559f700 1 -- start start 2023-09-30T22:34:28.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.940+0000 7f083559f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083006e570 0x7f08301214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.940+0000 7f083559f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0830134610 0x7f0830121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.940+0000 7f083559f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08301340e0 0x7f0830121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:28.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.940+0000 7f083559f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0830122f30 con 0x7f083006e570 2023-09-30T22:34:28.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.940+0000 7f083559f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0830124810 con 0x7f08301340e0 2023-09-30T22:34:28.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.940+0000 7f083559f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08300a2150 con 0x7f0830134610 2023-09-30T22:34:28.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.940+0000 7f082f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08301340e0 0x7f0830121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.940+0000 7f082f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08301340e0 0x7f0830121f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51590/0 (socket says 172.21.15.59:51590) 2023-09-30T22:34:28.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.940+0000 7f082e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0830134610 0x7f0830121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.940+0000 7f082f7fe700 1 -- 172.21.15.59:0/3321787418 learned_addr learned my addr 172.21.15.59:0/3321787418 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:28.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.940+0000 7f082effd700 1 --2- 172.21.15.59:0/3321787418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083006e570 0x7f08301214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:28.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.941+0000 7f082f7fe700 1 -- 172.21.15.59:0/3321787418 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0830134610 msgr2=0x7f0830121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:28.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.941+0000 7f082f7fe700 1 --2- 172.21.15.59:0/3321787418 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0830134610 0x7f0830121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.941+0000 7f082f7fe700 1 -- 172.21.15.59:0/3321787418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083006e570 msgr2=0x7f08301214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:28.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.941+0000 7f082f7fe700 1 --2- 172.21.15.59:0/3321787418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083006e570 0x7f08301214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:28.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.941+0000 7f082f7fe700 1 -- 172.21.15.59:0/3321787418 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0824009550 con 0x7f08301340e0 2023-09-30T22:34:28.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.941+0000 7f082f7fe700 1 --2- 172.21.15.59:0/3321787418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08301340e0 0x7f0830121f60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f082800c840 tx=0x7f082800cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:28.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.941+0000 7f08177fe700 1 -- 172.21.15.59:0/3321787418 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828003e30 con 0x7f08301340e0 2023-09-30T22:34:28.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.941+0000 7f083559f700 1 -- 172.21.15.59:0/3321787418 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0830123fa0 con 0x7f08301340e0 2023-09-30T22:34:28.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.941+0000 7f083559f700 1 -- 172.21.15.59:0/3321787418 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0830070610 con 0x7f08301340e0 2023-09-30T22:34:28.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.941+0000 7f08177fe700 1 -- 172.21.15.59:0/3321787418 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0828005070 con 0x7f08301340e0 2023-09-30T22:34:28.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.941+0000 7f08177fe700 1 -- 172.21.15.59:0/3321787418 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08280053e0 con 0x7f08301340e0 2023-09-30T22:34:28.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.942+0000 7f08177fe700 1 -- 172.21.15.59:0/3321787418 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0828005540 con 0x7f08301340e0 2023-09-30T22:34:28.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.942+0000 7f083559f700 1 -- 172.21.15.59:0/3321787418 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08100052e0 con 0x7f08301340e0 2023-09-30T22:34:28.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.942+0000 7f08177fe700 1 -- 172.21.15.59:0/3321787418 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f082803ee40 con 0x7f08301340e0 2023-09-30T22:34:28.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:28.948+0000 7f08177fe700 1 -- 172.21.15.59:0/3321787418 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0828017020 con 0x7f08301340e0 2023-09-30T22:34:29.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.028+0000 7f56c2be2700 1 -- 172.21.15.59:0/4096270798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f56bc0a2250 con 0x7f56bc134610 2023-09-30T22:34:29.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.028+0000 7f56b97fa700 1 -- 172.21.15.59:0/4096270798 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56bc0a2250 con 0x7f56bc134610 2023-09-30T22:34:29.029 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:29.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.032+0000 7f56c2be2700 1 -- 172.21.15.59:0/4096270798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56bc134610 msgr2=0x7f56bc125ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:29.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.032+0000 7f56c2be2700 1 --2- 172.21.15.59:0/4096270798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56bc134610 0x7f56bc125ea0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f56bc070e10 tx=0x7f56a800eac0 comp rx=0 tx=0).stop 2023-09-30T22:34:29.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.033+0000 7f56c2be2700 1 -- 172.21.15.59:0/4096270798 shutdown_connections 2023-09-30T22:34:29.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.033+0000 7f56c2be2700 1 --2- 172.21.15.59:0/4096270798 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56bc127980 0x7f56bc1263e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:29.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.033+0000 7f56c2be2700 1 --2- 172.21.15.59:0/4096270798 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56bc06e570 0x7f56bc127440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:29.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.033+0000 7f56c2be2700 1 --2- 172.21.15.59:0/4096270798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56bc134610 0x7f56bc125ea0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:29.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.033+0000 7f56c2be2700 1 -- 172.21.15.59:0/4096270798 >> 172.21.15.59:0/4096270798 conn(0x7f56bc0a2aa0 msgr2=0x7f56bc137cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:29.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.033+0000 7f56c2be2700 1 -- 172.21.15.59:0/4096270798 shutdown_connections 2023-09-30T22:34:29.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.033+0000 7f56c2be2700 1 -- 172.21.15.59:0/4096270798 wait complete. 2023-09-30T22:34:29.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:29.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.118+0000 7fc0ff7fe700 1 -- 172.21.15.59:0/3569693484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc0ec005590 con 0x7fc1141264f0 2023-09-30T22:34:29.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.118+0000 7fc109ffb700 1 -- 172.21.15.59:0/3569693484 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc10c011390 con 0x7fc1141264f0 2023-09-30T22:34:29.119 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:29.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.121+0000 7fc0ff7fe700 1 -- 172.21.15.59:0/3569693484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1141264f0 msgr2=0x7fc114126960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:29.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.121+0000 7fc0ff7fe700 1 --2- 172.21.15.59:0/3569693484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1141264f0 0x7fc114126960 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc10c015000 tx=0x7fc10c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:29.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.121+0000 7fc0ff7fe700 1 -- 172.21.15.59:0/3569693484 shutdown_connections 2023-09-30T22:34:29.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.121+0000 7fc0ff7fe700 1 --2- 172.21.15.59:0/3569693484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1141264f0 0x7fc114126960 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:29.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.121+0000 7fc0ff7fe700 1 --2- 172.21.15.59:0/3569693484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc11406e570 0x7fc114127640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:29.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.121+0000 7fc0ff7fe700 1 --2- 172.21.15.59:0/3569693484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc114134610 0x7fc114125fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:29.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.121+0000 7fc0ff7fe700 1 -- 172.21.15.59:0/3569693484 >> 172.21.15.59:0/3569693484 conn(0x7fc1140a2aa0 msgr2=0x7fc114137a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:29.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.121+0000 7fc0ff7fe700 1 -- 172.21.15.59:0/3569693484 shutdown_connections 2023-09-30T22:34:29.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.121+0000 7fc0ff7fe700 1 -- 172.21.15.59:0/3569693484 wait complete. 2023-09-30T22:34:29.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:29.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.156+0000 7f083559f700 1 -- 172.21.15.59:0/3321787418 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0810005150 con 0x7f08301340e0 2023-09-30T22:34:29.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.156+0000 7f08177fe700 1 -- 172.21.15.59:0/3321787418 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08280057f0 con 0x7f08301340e0 2023-09-30T22:34:29.157 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:29.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.159+0000 7f083559f700 1 -- 172.21.15.59:0/3321787418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08301340e0 msgr2=0x7f0830121f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:29.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.159+0000 7f083559f700 1 --2- 172.21.15.59:0/3321787418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08301340e0 0x7f0830121f60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f082800c840 tx=0x7f082800cb50 comp rx=0 tx=0).stop 2023-09-30T22:34:29.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.159+0000 7f083559f700 1 -- 172.21.15.59:0/3321787418 shutdown_connections 2023-09-30T22:34:29.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.159+0000 7f083559f700 1 --2- 172.21.15.59:0/3321787418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08301340e0 0x7f0830121f60 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:29.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.159+0000 7f083559f700 1 --2- 172.21.15.59:0/3321787418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f083006e570 0x7f08301214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:29.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.159+0000 7f083559f700 1 --2- 172.21.15.59:0/3321787418 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0830134610 0x7f0830121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:29.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.159+0000 7f083559f700 1 -- 172.21.15.59:0/3321787418 >> 172.21.15.59:0/3321787418 conn(0x7f08300a2aa0 msgr2=0x7f08301bf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:29.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.159+0000 7f083559f700 1 -- 172.21.15.59:0/3321787418 shutdown_connections 2023-09-30T22:34:29.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.159+0000 7f083559f700 1 -- 172.21.15.59:0/3321787418 wait complete. 2023-09-30T22:34:29.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.163+0000 7f51f9bcb700 1 -- 172.21.15.59:0/3535485834 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f51f4074ea0 con 0x7f51f4136fe0 2023-09-30T22:34:29.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.163+0000 7f51dbfff700 1 -- 172.21.15.59:0/3535485834 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51ec018020 con 0x7f51f4136fe0 2023-09-30T22:34:29.163 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:29.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.165+0000 7f51f9bcb700 1 -- 172.21.15.59:0/3535485834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4136fe0 msgr2=0x7f51f411bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:29.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.165+0000 7f51f9bcb700 1 --2- 172.21.15.59:0/3535485834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4136fe0 0x7f51f411bd50 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00ef90 tx=0x7f51ec00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:29.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.165+0000 7f51f9bcb700 1 -- 172.21.15.59:0/3535485834 shutdown_connections 2023-09-30T22:34:29.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.165+0000 7f51f9bcb700 1 --2- 172.21.15.59:0/3535485834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4136fe0 0x7f51f411bd50 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:29.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.165+0000 7f51f9bcb700 1 --2- 172.21.15.59:0/3535485834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f409e930 0x7f51f411b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:29.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.165+0000 7f51f9bcb700 1 --2- 172.21.15.59:0/3535485834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f409f410 0x7f51f411b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:29.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.165+0000 7f51f9bcb700 1 -- 172.21.15.59:0/3535485834 >> 172.21.15.59:0/3535485834 conn(0x7f51f40a4210 msgr2=0x7f51f40a2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:29.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.165+0000 7f51f9bcb700 1 -- 172.21.15.59:0/3535485834 shutdown_connections 2023-09-30T22:34:29.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:29.165+0000 7f51f9bcb700 1 -- 172.21.15.59:0/3535485834 wait complete. 2023-09-30T22:34:29.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:29.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:30.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:30.137 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:30.175 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:30.180 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.200+0000 7f86ebfad700 1 Processor -- start 2023-09-30T22:34:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.200+0000 7f86ebfad700 1 -- start start 2023-09-30T22:34:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.201+0000 7f86ebfad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86e41338c0 0x7f86e4133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.201+0000 7f86ebfad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86e41341d0 0x7f86e409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.201+0000 7f86ebfad700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e406f720 con 0x7f86e409e390 2023-09-30T22:34:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.201+0000 7f86ebfad700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e4070c80 con 0x7f86e41341d0 2023-09-30T22:34:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.201+0000 7f86ebfad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e406fce0 con 0x7f86e41338c0 2023-09-30T22:34:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.201+0000 7f86e9d49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86e41338c0 0x7f86e4133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.201+0000 7f86e9d49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86e41338c0 0x7f86e4133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51592/0 (socket says 172.21.15.59:51592) 2023-09-30T22:34:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.201+0000 7f86e9d49700 1 -- 172.21.15.59:0/557134955 learned_addr learned my addr 172.21.15.59:0/557134955 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.201+0000 7f86e9d49700 1 -- 172.21.15.59:0/557134955 >> v2:172.21.15.59:3300/0 conn(0x7f86e41341d0 msgr2=0x7f86e409de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.201+0000 7f86e9d49700 1 --2- 172.21.15.59:0/557134955 >> v2:172.21.15.59:3300/0 conn(0x7f86e41341d0 0x7f86e409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.201+0000 7f86e9d49700 1 -- 172.21.15.59:0/557134955 >> v1:172.21.15.59:6789/0 conn(0x7f86e409e390 legacy=0x7f86e413a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.201+0000 7f86e9d49700 1 -- 172.21.15.59:0/557134955 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e41336a0 con 0x7f86e41338c0 2023-09-30T22:34:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.202+0000 7f86e9d49700 1 --2- 172.21.15.59:0/557134955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86e41338c0 0x7f86e4133c90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f86e00098f0 tx=0x7f86e0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b9fbafa38dca716 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.202+0000 7f86e8d47700 1 -- 172.21.15.59:0/557134955 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0004230 con 0x7f86e41338c0 2023-09-30T22:34:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.202+0000 7f86e8d47700 1 -- 172.21.15.59:0/557134955 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e0004390 con 0x7f86e41338c0 2023-09-30T22:34:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.202+0000 7f86e8d47700 1 -- 172.21.15.59:0/557134955 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e00036a0 con 0x7f86e41338c0 2023-09-30T22:34:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.203+0000 7f86ebfad700 1 -- 172.21.15.59:0/557134955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86e41338c0 msgr2=0x7f86e4133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.203+0000 7f86ebfad700 1 --2- 172.21.15.59:0/557134955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86e41338c0 0x7f86e4133c90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f86e00098f0 tx=0x7f86e0009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.203+0000 7f86ebfad700 1 -- 172.21.15.59:0/557134955 shutdown_connections 2023-09-30T22:34:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.203+0000 7f86ebfad700 1 --2- 172.21.15.59:0/557134955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86e41338c0 0x7f86e4133c90 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.203+0000 7f86ebfad700 1 --2- 172.21.15.59:0/557134955 >> v2:172.21.15.59:3300/0 conn(0x7f86e41341d0 0x7f86e409de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.203+0000 7f86ebfad700 1 -- 172.21.15.59:0/557134955 >> 172.21.15.59:0/557134955 conn(0x7f86e40a2aa0 msgr2=0x7f86e40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.203+0000 7f86ebfad700 1 -- 172.21.15.59:0/557134955 shutdown_connections 2023-09-30T22:34:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.203+0000 7f86ebfad700 1 -- 172.21.15.59:0/557134955 wait complete. 2023-09-30T22:34:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.204+0000 7f86ebfad700 1 Processor -- start 2023-09-30T22:34:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.204+0000 7f86ebfad700 1 -- start start 2023-09-30T22:34:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86ebfad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86e409e390 0x7f86e41234e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86ebfad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86e41338c0 0x7f86e4123a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86ebfad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86e41341d0 0x7f86e4123f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86ebfad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4127be0 con 0x7f86e41341d0 2023-09-30T22:34:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86ebfad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4130e50 con 0x7f86e41338c0 2023-09-30T22:34:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86ebfad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86e406f960 con 0x7f86e409e390 2023-09-30T22:34:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86e9d49700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86e409e390 0x7f86e41234e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86e9d49700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86e409e390 0x7f86e41234e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60058/0 (socket says 172.21.15.59:60058) 2023-09-30T22:34:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86e9d49700 1 -- 172.21.15.59:0/2960182610 learned_addr learned my addr 172.21.15.59:0/2960182610 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86e9548700 1 --2- 172.21.15.59:0/2960182610 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86e41338c0 0x7f86e4123a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86ea54a700 1 --2- 172.21.15.59:0/2960182610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86e41341d0 0x7f86e4123f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86e9d49700 1 -- 172.21.15.59:0/2960182610 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86e41338c0 msgr2=0x7f86e4123a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86e9d49700 1 --2- 172.21.15.59:0/2960182610 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86e41338c0 0x7f86e4123a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86e9d49700 1 -- 172.21.15.59:0/2960182610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86e41341d0 msgr2=0x7f86e4123f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86e9d49700 1 --2- 172.21.15.59:0/2960182610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86e41341d0 0x7f86e4123f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86e9d49700 1 -- 172.21.15.59:0/2960182610 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e0009550 con 0x7f86e409e390 2023-09-30T22:34:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.205+0000 7f86e9d49700 1 --2- 172.21.15.59:0/2960182610 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86e409e390 0x7f86e41234e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009130 tx=0x7f86e0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.206+0000 7f86da7fc700 1 -- 172.21.15.59:0/2960182610 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0003dc0 con 0x7f86e409e390 2023-09-30T22:34:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.206+0000 7f86da7fc700 1 -- 172.21.15.59:0/2960182610 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e001f070 con 0x7f86e409e390 2023-09-30T22:34:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.206+0000 7f86da7fc700 1 -- 172.21.15.59:0/2960182610 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e000b8a0 con 0x7f86e409e390 2023-09-30T22:34:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.206+0000 7f86ebfad700 1 -- 172.21.15.59:0/2960182610 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e4126a60 con 0x7f86e409e390 2023-09-30T22:34:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.206+0000 7f86ebfad700 1 -- 172.21.15.59:0/2960182610 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e412ffa0 con 0x7f86e409e390 2023-09-30T22:34:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.207+0000 7f86da7fc700 1 -- 172.21.15.59:0/2960182610 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86e0021030 con 0x7f86e409e390 2023-09-30T22:34:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.207+0000 7f86ebfad700 1 -- 172.21.15.59:0/2960182610 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e4074ea0 con 0x7f86e409e390 2023-09-30T22:34:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.207+0000 7f86da7fc700 1 -- 172.21.15.59:0/2960182610 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f86e0040de0 con 0x7f86e409e390 2023-09-30T22:34:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.217+0000 7f86da7fc700 1 -- 172.21.15.59:0/2960182610 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86e000be70 con 0x7f86e409e390 2023-09-30T22:34:30.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.288+0000 7fdf931c5700 1 Processor -- start 2023-09-30T22:34:30.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.288+0000 7fdf931c5700 1 -- start start 2023-09-30T22:34:30.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.288+0000 7fdf931c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf8c06a770 0x7fdf8c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.288+0000 7fdf931c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf8c131d10 0x7fdf8c139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.288+0000 7fdf931c5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c09ece0 con 0x7fdf8c06b080 2023-09-30T22:34:30.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.288+0000 7fdf931c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c09e760 con 0x7fdf8c06a770 2023-09-30T22:34:30.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.288+0000 7fdf931c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c09e040 con 0x7fdf8c131d10 2023-09-30T22:34:30.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.289+0000 7fdf90f61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf8c06a770 0x7fdf8c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.289+0000 7fdf91762700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf8c131d10 0x7fdf8c139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.289+0000 7fdf90f61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf8c06a770 0x7fdf8c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51612/0 (socket says 172.21.15.59:51612) 2023-09-30T22:34:30.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.289+0000 7fdf90f61700 1 -- 172.21.15.59:0/3331759817 learned_addr learned my addr 172.21.15.59:0/3331759817 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:30.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.289+0000 7fdf90f61700 1 -- 172.21.15.59:0/3331759817 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf8c131d10 msgr2=0x7fdf8c139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:30.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.289+0000 7fdf90f61700 1 --2- 172.21.15.59:0/3331759817 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf8c131d10 0x7fdf8c139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.289+0000 7fdf90f61700 1 -- 172.21.15.59:0/3331759817 >> v1:172.21.15.59:6789/0 conn(0x7fdf8c06b080 legacy=0x7fdf8c131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:30.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.289+0000 7fdf90f61700 1 -- 172.21.15.59:0/3331759817 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c09f630 con 0x7fdf8c06a770 2023-09-30T22:34:30.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.289+0000 7fdf90f61700 1 --2- 172.21.15.59:0/3331759817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf8c06a770 0x7fdf8c06ab40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009920 tx=0x7fdf80009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=152031a514b62004 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:30.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.290+0000 7fdf8b7fe700 1 -- 172.21.15.59:0/3331759817 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80004230 con 0x7fdf8c06a770 2023-09-30T22:34:30.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.290+0000 7fdf8b7fe700 1 -- 172.21.15.59:0/3331759817 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf80004390 con 0x7fdf8c06a770 2023-09-30T22:34:30.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.290+0000 7fdf8b7fe700 1 -- 172.21.15.59:0/3331759817 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800036a0 con 0x7fdf8c06a770 2023-09-30T22:34:30.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.291+0000 7fdf931c5700 1 -- 172.21.15.59:0/3331759817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf8c06a770 msgr2=0x7fdf8c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:30.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.291+0000 7fdf931c5700 1 --2- 172.21.15.59:0/3331759817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf8c06a770 0x7fdf8c06ab40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009920 tx=0x7fdf80009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:30.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.291+0000 7fdf931c5700 1 -- 172.21.15.59:0/3331759817 shutdown_connections 2023-09-30T22:34:30.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.291+0000 7fdf931c5700 1 --2- 172.21.15.59:0/3331759817 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf8c131d10 0x7fdf8c139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.291+0000 7fdf931c5700 1 --2- 172.21.15.59:0/3331759817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf8c06a770 0x7fdf8c06ab40 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.291+0000 7fdf931c5700 1 -- 172.21.15.59:0/3331759817 >> 172.21.15.59:0/3331759817 conn(0x7fdf8c066f50 msgr2=0x7fdf8c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:30.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.291+0000 7fdf931c5700 1 -- 172.21.15.59:0/3331759817 shutdown_connections 2023-09-30T22:34:30.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.291+0000 7fdf931c5700 1 -- 172.21.15.59:0/3331759817 wait complete. 2023-09-30T22:34:30.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.292+0000 7fdf931c5700 1 Processor -- start 2023-09-30T22:34:30.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.292+0000 7fdf931c5700 1 -- start start 2023-09-30T22:34:30.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.293+0000 7fdf931c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf8c06a770 0x7fdf8c1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.293+0000 7fdf931c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf8c06b080 0x7fdf8c1c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.293+0000 7fdf931c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf8c131d10 0x7fdf8c1c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.293+0000 7fdf931c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c09b830 con 0x7fdf8c06a770 2023-09-30T22:34:30.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.293+0000 7fdf931c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c124db0 con 0x7fdf8c06b080 2023-09-30T22:34:30.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.293+0000 7fdf931c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c071e60 con 0x7fdf8c131d10 2023-09-30T22:34:30.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.294+0000 7fdf90f61700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf8c06a770 0x7fdf8c1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.294+0000 7fdf8bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf8c06b080 0x7fdf8c1c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.294+0000 7fdf90f61700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf8c06a770 0x7fdf8c1c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48520/0 (socket says 172.21.15.59:48520) 2023-09-30T22:34:30.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.294+0000 7fdf8bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf8c06b080 0x7fdf8c1c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51616/0 (socket says 172.21.15.59:51616) 2023-09-30T22:34:30.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.294+0000 7fdf90f61700 1 -- 172.21.15.59:0/3054313241 learned_addr learned my addr 172.21.15.59:0/3054313241 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:30.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.294+0000 7fdf91762700 1 --2- 172.21.15.59:0/3054313241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf8c131d10 0x7fdf8c1c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.294+0000 7fdf90f61700 1 -- 172.21.15.59:0/3054313241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf8c131d10 msgr2=0x7fdf8c1c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:30.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.294+0000 7fdf90f61700 1 --2- 172.21.15.59:0/3054313241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf8c131d10 0x7fdf8c1c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.294+0000 7fdf90f61700 1 -- 172.21.15.59:0/3054313241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf8c06b080 msgr2=0x7fdf8c1c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:30.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.294+0000 7fdf90f61700 1 --2- 172.21.15.59:0/3054313241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf8c06b080 0x7fdf8c1c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.294+0000 7fdf90f61700 1 -- 172.21.15.59:0/3054313241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf80009550 con 0x7fdf8c06a770 2023-09-30T22:34:30.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.294+0000 7fdf8bfff700 1 --2- 172.21.15.59:0/3054313241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf8c06b080 0x7fdf8c1c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:30.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.294+0000 7fdf90f61700 1 --2- 172.21.15.59:0/3054313241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf8c06a770 0x7fdf8c1c8120 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fdf80000c00 tx=0x7fdf80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:30.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.295+0000 7fdf897fa700 1 -- 172.21.15.59:0/3054313241 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80003e20 con 0x7fdf8c06a770 2023-09-30T22:34:30.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.295+0000 7fdf897fa700 1 -- 172.21.15.59:0/3054313241 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf80011630 con 0x7fdf8c06a770 2023-09-30T22:34:30.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.295+0000 7fdf931c5700 1 -- 172.21.15.59:0/3054313241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c125c80 con 0x7fdf8c06a770 2023-09-30T22:34:30.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.295+0000 7fdf897fa700 1 -- 172.21.15.59:0/3054313241 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800119e0 con 0x7fdf8c06a770 2023-09-30T22:34:30.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.295+0000 7fdf931c5700 1 -- 172.21.15.59:0/3054313241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c131600 con 0x7fdf8c06a770 2023-09-30T22:34:30.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.296+0000 7fdf931c5700 1 -- 172.21.15.59:0/3054313241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c074ea0 con 0x7fdf8c06a770 2023-09-30T22:34:30.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.296+0000 7fdf897fa700 1 -- 172.21.15.59:0/3054313241 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf80021070 con 0x7fdf8c06a770 2023-09-30T22:34:30.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.297+0000 7fdf897fa700 1 -- 172.21.15.59:0/3054313241 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdf80040f50 con 0x7fdf8c06a770 2023-09-30T22:34:30.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.301+0000 7fdf897fa700 1 -- 172.21.15.59:0/3054313241 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf8002cd70 con 0x7fdf8c06a770 2023-09-30T22:34:30.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.327+0000 7f93278db700 1 Processor -- start 2023-09-30T22:34:30.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.328+0000 7f93278db700 1 -- start start 2023-09-30T22:34:30.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.328+0000 7f93278db700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f932006a770 0x7f932006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.328+0000 7f93278db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932006b080 0x7f9320131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.328+0000 7f93278db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9320131b40 0x7f9320131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.328+0000 7f93278db700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932009ece0 con 0x7f932006a770 2023-09-30T22:34:30.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.328+0000 7f93278db700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932009e760 con 0x7f932006b080 2023-09-30T22:34:30.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.328+0000 7f93278db700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f932009e040 con 0x7f9320131b40 2023-09-30T22:34:30.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.329+0000 7f9324e76700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932006b080 0x7f9320131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.329+0000 7f9324e76700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932006b080 0x7f9320131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51620/0 (socket says 172.21.15.59:51620) 2023-09-30T22:34:30.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.329+0000 7f9324e76700 1 -- 172.21.15.59:0/170483129 learned_addr learned my addr 172.21.15.59:0/170483129 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:30.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.329+0000 7f9325e78700 1 --2- 172.21.15.59:0/170483129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9320131b40 0x7f9320131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.329+0000 7f9324e76700 1 -- 172.21.15.59:0/170483129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9320131b40 msgr2=0x7f9320131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:30.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.329+0000 7f9324e76700 1 --2- 172.21.15.59:0/170483129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9320131b40 0x7f9320131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.329+0000 7f9324e76700 1 -- 172.21.15.59:0/170483129 >> v2:172.21.15.59:3300/0 conn(0x7f932006a770 msgr2=0x7f932006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:30.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.329+0000 7f9324e76700 1 --2- 172.21.15.59:0/170483129 >> v2:172.21.15.59:3300/0 conn(0x7f932006a770 0x7f932006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.329+0000 7f9324e76700 1 -- 172.21.15.59:0/170483129 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932009f630 con 0x7f932006b080 2023-09-30T22:34:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.329+0000 7f9324e76700 1 --2- 172.21.15.59:0/170483129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932006b080 0x7f9320131600 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f93100098f0 tx=0x7f9310009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78d236f67ee9621 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.329+0000 7f9317fff700 1 -- 172.21.15.59:0/170483129 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310011830 con 0x7f932006b080 2023-09-30T22:34:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.330+0000 7f9317fff700 1 -- 172.21.15.59:0/170483129 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9310011990 con 0x7f932006b080 2023-09-30T22:34:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.330+0000 7f9317fff700 1 -- 172.21.15.59:0/170483129 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310011d20 con 0x7f932006b080 2023-09-30T22:34:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.330+0000 7f93278db700 1 -- 172.21.15.59:0/170483129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932006b080 msgr2=0x7f9320131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:30.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.330+0000 7f93278db700 1 --2- 172.21.15.59:0/170483129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932006b080 0x7f9320131600 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f93100098f0 tx=0x7f9310009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:30.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.330+0000 7f93278db700 1 -- 172.21.15.59:0/170483129 shutdown_connections 2023-09-30T22:34:30.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.330+0000 7f93278db700 1 --2- 172.21.15.59:0/170483129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9320131b40 0x7f9320131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.330+0000 7f93278db700 1 --2- 172.21.15.59:0/170483129 >> v2:172.21.15.59:3300/0 conn(0x7f932006a770 0x7f932006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.330+0000 7f93278db700 1 --2- 172.21.15.59:0/170483129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932006b080 0x7f9320131600 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.330+0000 7f93278db700 1 -- 172.21.15.59:0/170483129 >> 172.21.15.59:0/170483129 conn(0x7f9320066f50 msgr2=0x7f932009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:30.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.331+0000 7f93278db700 1 -- 172.21.15.59:0/170483129 shutdown_connections 2023-09-30T22:34:30.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.331+0000 7f93278db700 1 -- 172.21.15.59:0/170483129 wait complete. 2023-09-30T22:34:30.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.332+0000 7f93278db700 1 Processor -- start 2023-09-30T22:34:30.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.332+0000 7f93278db700 1 -- start start 2023-09-30T22:34:30.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.332+0000 7f93278db700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932006a770 0x7f9320119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.332+0000 7f93278db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932006b080 0x7f93201199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.332+0000 7f93278db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9320131b40 0x7f9320119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.332+0000 7f93278db700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9320137b50 con 0x7f932006a770 2023-09-30T22:34:30.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.332+0000 7f93278db700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9320137960 con 0x7f932006b080 2023-09-30T22:34:30.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.332+0000 7f93278db700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f932011a880 con 0x7f9320131b40 2023-09-30T22:34:30.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.333+0000 7f9325e78700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9320131b40 0x7f9320119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.333+0000 7f9325e78700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9320131b40 0x7f9320119f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60102/0 (socket says 172.21.15.59:60102) 2023-09-30T22:34:30.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.333+0000 7f9325e78700 1 -- 172.21.15.59:0/226885447 learned_addr learned my addr 172.21.15.59:0/226885447 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:30.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.333+0000 7f9324e76700 1 --2- 172.21.15.59:0/226885447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932006b080 0x7f93201199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.333+0000 7fe3f6547700 1 Processor -- start 2023-09-30T22:34:30.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.333+0000 7f9325e78700 1 -- 172.21.15.59:0/226885447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932006b080 msgr2=0x7f93201199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:30.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.333+0000 7f9325e78700 1 --2- 172.21.15.59:0/226885447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932006b080 0x7f93201199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.333+0000 7f9325e78700 1 -- 172.21.15.59:0/226885447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932006a770 msgr2=0x7f9320119480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:34:30.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.333+0000 7f9325e78700 1 --2- 172.21.15.59:0/226885447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932006a770 0x7f9320119480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.333+0000 7f9325e78700 1 -- 172.21.15.59:0/226885447 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9310009550 con 0x7f9320131b40 2023-09-30T22:34:30.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.333+0000 7fe3f6547700 1 -- start start 2023-09-30T22:34:30.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.334+0000 7f9325e78700 1 --2- 172.21.15.59:0/226885447 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9320131b40 0x7f9320119f00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9318009dd0 tx=0x7f931800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:30.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.334+0000 7f9315ffb700 1 -- 172.21.15.59:0/226885447 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931800cce0 con 0x7f9320131b40 2023-09-30T22:34:30.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.334+0000 7f9315ffb700 1 -- 172.21.15.59:0/226885447 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931800f040 con 0x7f9320131b40 2023-09-30T22:34:30.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.334+0000 7f9315ffb700 1 -- 172.21.15.59:0/226885447 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318014480 con 0x7f9320131b40 2023-09-30T22:34:30.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.334+0000 7f93278db700 1 -- 172.21.15.59:0/226885447 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9320071e60 con 0x7f9320131b40 2023-09-30T22:34:30.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.334+0000 7f9324e76700 1 --2- 172.21.15.59:0/226885447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932006b080 0x7f93201199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:30.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.334+0000 7f93278db700 1 -- 172.21.15.59:0/226885447 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932011ac70 con 0x7f9320131b40 2023-09-30T22:34:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.334+0000 7fe3f6547700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3f01316c0 0x7fe3f0131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.334+0000 7fe3f6547700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe3f009d9f0 0x7fe3f006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.334+0000 7fe3f6547700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f009e130 con 0x7fe3f006acb0 2023-09-30T22:34:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.334+0000 7fe3f6547700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f01312b0 con 0x7fe3f009d9f0 2023-09-30T22:34:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.334+0000 7fe3f6547700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f009f6e0 con 0x7fe3f01316c0 2023-09-30T22:34:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.334+0000 7fe3f4ae4700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe3f006acb0 0x7fe3f0138540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36744/0 (socket says 172.21.15.59:36744) 2023-09-30T22:34:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.334+0000 7fe3f4ae4700 1 -- 172.21.15.59:0/877566095 learned_addr learned my addr 172.21.15.59:0/877566095 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.335+0000 7fe3ef7fe700 1 --2- 172.21.15.59:0/877566095 >> v2:172.21.15.59:3300/0 conn(0x7fe3f009d9f0 0x7fe3f006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.335+0000 7fe3effff700 1 --2- 172.21.15.59:0/877566095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3f01316c0 0x7fe3f0131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.335+0000 7fe3effff700 1 -- 172.21.15.59:0/877566095 >> v2:172.21.15.59:3300/0 conn(0x7fe3f009d9f0 msgr2=0x7fe3f006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:30.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.335+0000 7fe3effff700 1 --2- 172.21.15.59:0/877566095 >> v2:172.21.15.59:3300/0 conn(0x7fe3f009d9f0 0x7fe3f006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.335+0000 7fe3effff700 1 -- 172.21.15.59:0/877566095 >> v1:172.21.15.59:6789/0 conn(0x7fe3f006acb0 legacy=0x7fe3f0138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:30.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.335+0000 7fe3effff700 1 -- 172.21.15.59:0/877566095 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f009e760 con 0x7fe3f01316c0 2023-09-30T22:34:30.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.335+0000 7fe3effff700 1 --2- 172.21.15.59:0/877566095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3f01316c0 0x7fe3f0131a90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009840 tx=0x7fe3e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c9fb0e63dafd79d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:30.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.335+0000 7f93278db700 1 -- 172.21.15.59:0/226885447 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93000052e0 con 0x7f9320131b40 2023-09-30T22:34:30.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.336+0000 7fe3eeffd700 1 -- 172.21.15.59:0/877566095 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0004230 con 0x7fe3f01316c0 2023-09-30T22:34:30.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.336+0000 7fe3eeffd700 1 -- 172.21.15.59:0/877566095 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e0004390 con 0x7fe3f01316c0 2023-09-30T22:34:30.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.336+0000 7fe3eeffd700 1 -- 172.21.15.59:0/877566095 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00036a0 con 0x7fe3f01316c0 2023-09-30T22:34:30.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.336+0000 7f9315ffb700 1 -- 172.21.15.59:0/226885447 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93180145e0 con 0x7f9320131b40 2023-09-30T22:34:30.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.336+0000 7f9315ffb700 1 -- 172.21.15.59:0/226885447 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f931803ff50 con 0x7f9320131b40 2023-09-30T22:34:30.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.336+0000 7fe3f6547700 1 -- 172.21.15.59:0/877566095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3f01316c0 msgr2=0x7fe3f0131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:30.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.336+0000 7fe3f6547700 1 --2- 172.21.15.59:0/877566095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3f01316c0 0x7fe3f0131a90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009840 tx=0x7fe3e0009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:30.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.339+0000 7fe3f6547700 1 -- 172.21.15.59:0/877566095 shutdown_connections 2023-09-30T22:34:30.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.339+0000 7fe3f6547700 1 --2- 172.21.15.59:0/877566095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3f01316c0 0x7fe3f0131a90 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.339+0000 7fe3f6547700 1 --2- 172.21.15.59:0/877566095 >> v2:172.21.15.59:3300/0 conn(0x7fe3f009d9f0 0x7fe3f006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.339+0000 7fe3f6547700 1 -- 172.21.15.59:0/877566095 >> 172.21.15.59:0/877566095 conn(0x7fe3f0066f50 msgr2=0x7fe3f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:30.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.341+0000 7fe3f6547700 1 -- 172.21.15.59:0/877566095 shutdown_connections 2023-09-30T22:34:30.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.341+0000 7fe3f6547700 1 -- 172.21.15.59:0/877566095 wait complete. 2023-09-30T22:34:30.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.341+0000 7f9315ffb700 1 -- 172.21.15.59:0/226885447 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93180118b0 con 0x7f9320131b40 2023-09-30T22:34:30.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.342+0000 7fe3f6547700 1 Processor -- start 2023-09-30T22:34:30.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.343+0000 7fe3f6547700 1 -- start start 2023-09-30T22:34:30.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.343+0000 7fe3f6547700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3f006acb0 0x7fe3f01c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.343+0000 7fe3f6547700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3f009d9f0 0x7fe3f01c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.343+0000 7fe3f6547700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3f01316c0 0x7fe3f01c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:30.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.343+0000 7fe3f6547700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f011bcd0 con 0x7fe3f009d9f0 2023-09-30T22:34:30.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.343+0000 7fe3f6547700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00726b0 con 0x7fe3f006acb0 2023-09-30T22:34:30.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.343+0000 7fe3f6547700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f012b390 con 0x7fe3f01316c0 2023-09-30T22:34:30.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.343+0000 7fe3effff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3f006acb0 0x7fe3f01c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.343+0000 7fe3effff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3f006acb0 0x7fe3f01c42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51652/0 (socket says 172.21.15.59:51652) 2023-09-30T22:34:30.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.343+0000 7fe3effff700 1 -- 172.21.15.59:0/390596200 learned_addr learned my addr 172.21.15.59:0/390596200 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.343+0000 7fe3f4ae4700 1 --2- 172.21.15.59:0/390596200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3f01316c0 0x7fe3f01c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.344+0000 7fe3ef7fe700 1 --2- 172.21.15.59:0/390596200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3f009d9f0 0x7fe3f01c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.344+0000 7fe3effff700 1 -- 172.21.15.59:0/390596200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3f01316c0 msgr2=0x7fe3f01c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.344+0000 7fe3effff700 1 --2- 172.21.15.59:0/390596200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3f01316c0 0x7fe3f01c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.344+0000 7fe3effff700 1 -- 172.21.15.59:0/390596200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3f009d9f0 msgr2=0x7fe3f01c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.344+0000 7fe3effff700 1 --2- 172.21.15.59:0/390596200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3f009d9f0 0x7fe3f01c4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.344+0000 7fe3effff700 1 -- 172.21.15.59:0/390596200 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e00094a0 con 0x7fe3f006acb0 2023-09-30T22:34:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.344+0000 7fe3effff700 1 --2- 172.21.15.59:0/390596200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3f006acb0 0x7fe3f01c42f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0000c00 tx=0x7fe3e0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.344+0000 7fe3ecff9700 1 -- 172.21.15.59:0/390596200 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0003db0 con 0x7fe3f006acb0 2023-09-30T22:34:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.344+0000 7fe3ecff9700 1 -- 172.21.15.59:0/390596200 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e001e070 con 0x7fe3f006acb0 2023-09-30T22:34:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.344+0000 7fe3ecff9700 1 -- 172.21.15.59:0/390596200 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0011870 con 0x7fe3f006acb0 2023-09-30T22:34:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.345+0000 7fe3f6547700 1 -- 172.21.15.59:0/390596200 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f009ead0 con 0x7fe3f006acb0 2023-09-30T22:34:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.345+0000 7fe3f6547700 1 -- 172.21.15.59:0/390596200 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f012aed0 con 0x7fe3f006acb0 2023-09-30T22:34:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.345+0000 7fe3ecff9700 1 -- 172.21.15.59:0/390596200 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe3e00119d0 con 0x7fe3f006acb0 2023-09-30T22:34:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.346+0000 7fe3ecff9700 1 -- 172.21.15.59:0/390596200 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe3e0040780 con 0x7fe3f006acb0 2023-09-30T22:34:30.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.346+0000 7fe3f6547700 1 -- 172.21.15.59:0/390596200 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f009e130 con 0x7fe3f006acb0 2023-09-30T22:34:30.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.355+0000 7fe3ecff9700 1 -- 172.21.15.59:0/390596200 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3f009e130 con 0x7fe3f006acb0 2023-09-30T22:34:30.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.447+0000 7f86ebfad700 1 -- 172.21.15.59:0/2960182610 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f86e4074ea0 con 0x7f86e409e390 2023-09-30T22:34:30.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.448+0000 7f86da7fc700 1 -- 172.21.15.59:0/2960182610 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86e0023bc0 con 0x7f86e409e390 2023-09-30T22:34:30.448 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:30.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.450+0000 7f86ebfad700 1 -- 172.21.15.59:0/2960182610 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86e409e390 msgr2=0x7f86e41234e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:30.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.450+0000 7f86ebfad700 1 --2- 172.21.15.59:0/2960182610 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86e409e390 0x7f86e41234e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009130 tx=0x7f86e0004750 comp rx=0 tx=0).stop 2023-09-30T22:34:30.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.450+0000 7f86ebfad700 1 -- 172.21.15.59:0/2960182610 shutdown_connections 2023-09-30T22:34:30.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.450+0000 7f86ebfad700 1 --2- 172.21.15.59:0/2960182610 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86e409e390 0x7f86e41234e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.450+0000 7f86ebfad700 1 --2- 172.21.15.59:0/2960182610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86e41341d0 0x7f86e4123f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.450+0000 7f86ebfad700 1 --2- 172.21.15.59:0/2960182610 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86e41338c0 0x7f86e4123a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.450+0000 7f86ebfad700 1 -- 172.21.15.59:0/2960182610 >> 172.21.15.59:0/2960182610 conn(0x7f86e40a2aa0 msgr2=0x7f86e41318a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:30.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.451+0000 7f86ebfad700 1 -- 172.21.15.59:0/2960182610 shutdown_connections 2023-09-30T22:34:30.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.451+0000 7f86ebfad700 1 -- 172.21.15.59:0/2960182610 wait complete. 2023-09-30T22:34:30.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:30.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.525+0000 7fdf931c5700 1 -- 172.21.15.59:0/3054313241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdf8c126160 con 0x7fdf8c06a770 2023-09-30T22:34:30.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.525+0000 7fdf897fa700 1 -- 172.21.15.59:0/3054313241 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf80033090 con 0x7fdf8c06a770 2023-09-30T22:34:30.526 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:30.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.527+0000 7fdf931c5700 1 -- 172.21.15.59:0/3054313241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf8c06a770 msgr2=0x7fdf8c1c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:30.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.527+0000 7fdf931c5700 1 --2- 172.21.15.59:0/3054313241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf8c06a770 0x7fdf8c1c8120 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fdf80000c00 tx=0x7fdf80004750 comp rx=0 tx=0).stop 2023-09-30T22:34:30.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.527+0000 7fdf931c5700 1 -- 172.21.15.59:0/3054313241 shutdown_connections 2023-09-30T22:34:30.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.527+0000 7fdf931c5700 1 --2- 172.21.15.59:0/3054313241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf8c131d10 0x7fdf8c1c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.527+0000 7fdf931c5700 1 --2- 172.21.15.59:0/3054313241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf8c06a770 0x7fdf8c1c8120 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.527+0000 7fdf931c5700 1 --2- 172.21.15.59:0/3054313241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf8c06b080 0x7fdf8c1c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.527+0000 7fdf931c5700 1 -- 172.21.15.59:0/3054313241 >> 172.21.15.59:0/3054313241 conn(0x7fdf8c066f50 msgr2=0x7fdf8c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:30.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.528+0000 7fdf931c5700 1 -- 172.21.15.59:0/3054313241 shutdown_connections 2023-09-30T22:34:30.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.528+0000 7fdf931c5700 1 -- 172.21.15.59:0/3054313241 wait complete. 2023-09-30T22:34:30.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:30.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.553+0000 7f93278db700 1 -- 172.21.15.59:0/226885447 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9300005590 con 0x7f9320131b40 2023-09-30T22:34:30.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.553+0000 7f9315ffb700 1 -- 172.21.15.59:0/226885447 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9318018030 con 0x7f9320131b40 2023-09-30T22:34:30.553 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.556+0000 7f93278db700 1 -- 172.21.15.59:0/226885447 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9320131b40 msgr2=0x7f9320119f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.556+0000 7f93278db700 1 --2- 172.21.15.59:0/226885447 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9320131b40 0x7f9320119f00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9318009dd0 tx=0x7f931800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.556+0000 7f93278db700 1 -- 172.21.15.59:0/226885447 shutdown_connections 2023-09-30T22:34:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.556+0000 7f93278db700 1 --2- 172.21.15.59:0/226885447 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9320131b40 0x7f9320119f00 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.556+0000 7f93278db700 1 --2- 172.21.15.59:0/226885447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932006a770 0x7f9320119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.556+0000 7f93278db700 1 --2- 172.21.15.59:0/226885447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932006b080 0x7f93201199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.556+0000 7f93278db700 1 -- 172.21.15.59:0/226885447 >> 172.21.15.59:0/226885447 conn(0x7f9320066f50 msgr2=0x7f93200708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.556+0000 7f93278db700 1 -- 172.21.15.59:0/226885447 shutdown_connections 2023-09-30T22:34:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.556+0000 7f93278db700 1 -- 172.21.15.59:0/226885447 wait complete. 2023-09-30T22:34:30.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:30.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.578+0000 7fe3f6547700 1 -- 172.21.15.59:0/390596200 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe3f009e130 con 0x7fe3f006acb0 2023-09-30T22:34:30.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.578+0000 7fe3ecff9700 1 -- 172.21.15.59:0/390596200 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe3f009e130 con 0x7fe3f006acb0 2023-09-30T22:34:30.578 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:30.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.580+0000 7fe3f6547700 1 -- 172.21.15.59:0/390596200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3f006acb0 msgr2=0x7fe3f01c42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:30.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.580+0000 7fe3f6547700 1 --2- 172.21.15.59:0/390596200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3f006acb0 0x7fe3f01c42f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0000c00 tx=0x7fe3e0004750 comp rx=0 tx=0).stop 2023-09-30T22:34:30.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.580+0000 7fe3f6547700 1 -- 172.21.15.59:0/390596200 shutdown_connections 2023-09-30T22:34:30.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.580+0000 7fe3f6547700 1 --2- 172.21.15.59:0/390596200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3f01316c0 0x7fe3f01c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.580+0000 7fe3f6547700 1 --2- 172.21.15.59:0/390596200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3f006acb0 0x7fe3f01c42f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.580+0000 7fe3f6547700 1 --2- 172.21.15.59:0/390596200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3f009d9f0 0x7fe3f01c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:30.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.580+0000 7fe3f6547700 1 -- 172.21.15.59:0/390596200 >> 172.21.15.59:0/390596200 conn(0x7fe3f0066f50 msgr2=0x7fe3f00a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:30.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.580+0000 7fe3f6547700 1 -- 172.21.15.59:0/390596200 shutdown_connections 2023-09-30T22:34:30.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:30.580+0000 7fe3f6547700 1 -- 172.21.15.59:0/390596200 wait complete. 2023-09-30T22:34:30.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:31.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:31.543 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:31.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:31.594 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:31.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.614+0000 7f29158b4700 1 Processor -- start 2023-09-30T22:34:31.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.614+0000 7f29158b4700 1 -- start start 2023-09-30T22:34:31.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.615+0000 7f29158b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29101338a0 0x7f2910133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.615+0000 7f29158b4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f291009de50 0x7f291009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.615+0000 7f29158b4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f291009e760 0x7f291013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.615+0000 7f29158b4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291006fef0 con 0x7f291009de50 2023-09-30T22:34:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.615+0000 7f29158b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291006ef30 con 0x7f29101338a0 2023-09-30T22:34:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.615+0000 7f29158b4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29101334b0 con 0x7f291009e760 2023-09-30T22:34:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.615+0000 7f290effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29101338a0 0x7f2910133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.615+0000 7f290e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f291009de50 0x7f291009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.615+0000 7f290f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f291009e760 0x7f291013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.615+0000 7f290e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f291009de50 0x7f291009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48578/0 (socket says 172.21.15.59:48578) 2023-09-30T22:34:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.615+0000 7f290effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29101338a0 0x7f2910133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51668/0 (socket says 172.21.15.59:51668) 2023-09-30T22:34:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.615+0000 7f290e7fc700 1 -- 172.21.15.59:0/3391041021 learned_addr learned my addr 172.21.15.59:0/3391041021 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.616+0000 7f290f7fe700 1 -- 172.21.15.59:0/3391041021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29101338a0 msgr2=0x7f2910133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.616+0000 7f290f7fe700 1 --2- 172.21.15.59:0/3391041021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29101338a0 0x7f2910133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.616+0000 7f290f7fe700 1 -- 172.21.15.59:0/3391041021 >> v2:172.21.15.59:3300/0 conn(0x7f291009de50 msgr2=0x7f291009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.616+0000 7f290f7fe700 1 --2- 172.21.15.59:0/3391041021 >> v2:172.21.15.59:3300/0 conn(0x7f291009de50 0x7f291009e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.616+0000 7f290f7fe700 1 -- 172.21.15.59:0/3391041021 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291006fc30 con 0x7f291009e760 2023-09-30T22:34:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.616+0000 7f290f7fe700 1 --2- 172.21.15.59:0/3391041021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f291009e760 0x7f291013a730 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2908009d90 tx=0x7f290800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5d6e83c68f9d4e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.616+0000 7f290dffb700 1 -- 172.21.15.59:0/3391041021 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290800e070 con 0x7f291009e760 2023-09-30T22:34:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.616+0000 7f290dffb700 1 -- 172.21.15.59:0/3391041021 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290800bb20 con 0x7f291009e760 2023-09-30T22:34:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.616+0000 7f290dffb700 1 -- 172.21.15.59:0/3391041021 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2908012430 con 0x7f291009e760 2023-09-30T22:34:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.617+0000 7f29158b4700 1 -- 172.21.15.59:0/3391041021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f291009e760 msgr2=0x7f291013a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.617+0000 7f29158b4700 1 --2- 172.21.15.59:0/3391041021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f291009e760 0x7f291013a730 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2908009d90 tx=0x7f290800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.617+0000 7f29158b4700 1 -- 172.21.15.59:0/3391041021 shutdown_connections 2023-09-30T22:34:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.617+0000 7f29158b4700 1 --2- 172.21.15.59:0/3391041021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f291009e760 0x7f291013a730 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.617+0000 7f29158b4700 1 --2- 172.21.15.59:0/3391041021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29101338a0 0x7f2910133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.617+0000 7f29158b4700 1 --2- 172.21.15.59:0/3391041021 >> v2:172.21.15.59:3300/0 conn(0x7f291009de50 0x7f291009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.617+0000 7f29158b4700 1 -- 172.21.15.59:0/3391041021 >> 172.21.15.59:0/3391041021 conn(0x7f29100a2aa0 msgr2=0x7f29100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:31.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.617+0000 7f29158b4700 1 -- 172.21.15.59:0/3391041021 shutdown_connections 2023-09-30T22:34:31.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.617+0000 7f29158b4700 1 -- 172.21.15.59:0/3391041021 wait complete. 2023-09-30T22:34:31.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.618+0000 7f29158b4700 1 Processor -- start 2023-09-30T22:34:31.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.619+0000 7f29158b4700 1 -- start start 2023-09-30T22:34:31.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.619+0000 7f29158b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f291009de50 0x7f291011d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.619+0000 7f29158b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f291009e760 0x7f291011dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.619+0000 7f29158b4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29101338a0 0x7f291011e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.619+0000 7f29158b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291011f260 con 0x7f291009e760 2023-09-30T22:34:31.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.619+0000 7f29158b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291011f880 con 0x7f291009de50 2023-09-30T22:34:31.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.619+0000 7f29158b4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29101204b0 con 0x7f29101338a0 2023-09-30T22:34:31.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.620+0000 7f290effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f291009de50 0x7f291011d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.620+0000 7f290effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f291009de50 0x7f291011d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51682/0 (socket says 172.21.15.59:51682) 2023-09-30T22:34:31.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.620+0000 7f290effd700 1 -- 172.21.15.59:0/4257307884 learned_addr learned my addr 172.21.15.59:0/4257307884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:31.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.620+0000 7f290f7fe700 1 --2- 172.21.15.59:0/4257307884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29101338a0 0x7f291011e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.620+0000 7f290e7fc700 1 --2- 172.21.15.59:0/4257307884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f291009e760 0x7f291011dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.620+0000 7f290effd700 1 -- 172.21.15.59:0/4257307884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29101338a0 msgr2=0x7f291011e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.620+0000 7f290effd700 1 --2- 172.21.15.59:0/4257307884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29101338a0 0x7f291011e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.620+0000 7f290effd700 1 -- 172.21.15.59:0/4257307884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f291009e760 msgr2=0x7f291011dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.620+0000 7f290effd700 1 --2- 172.21.15.59:0/4257307884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f291009e760 0x7f291011dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.620+0000 7f290effd700 1 -- 172.21.15.59:0/4257307884 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2908009a70 con 0x7f291009de50 2023-09-30T22:34:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.620+0000 7f290effd700 1 --2- 172.21.15.59:0/4257307884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f291009de50 0x7f291011d6a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f290000e9e0 tx=0x7f290000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.621+0000 7f28f7fff700 1 -- 172.21.15.59:0/4257307884 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2900009710 con 0x7f291009de50 2023-09-30T22:34:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.621+0000 7f28f7fff700 1 -- 172.21.15.59:0/4257307884 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290000ee80 con 0x7f291009de50 2023-09-30T22:34:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.621+0000 7f28f7fff700 1 -- 172.21.15.59:0/4257307884 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290000ca50 con 0x7f291009de50 2023-09-30T22:34:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.621+0000 7f29158b4700 1 -- 172.21.15.59:0/4257307884 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2910120e90 con 0x7f291009de50 2023-09-30T22:34:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.621+0000 7f29158b4700 1 -- 172.21.15.59:0/4257307884 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29100a0f30 con 0x7f291009de50 2023-09-30T22:34:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.622+0000 7f29158b4700 1 -- 172.21.15.59:0/4257307884 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291011a470 con 0x7f291009de50 2023-09-30T22:34:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.622+0000 7f28f7fff700 1 -- 172.21.15.59:0/4257307884 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f290000cbb0 con 0x7f291009de50 2023-09-30T22:34:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.623+0000 7f28f7fff700 1 -- 172.21.15.59:0/4257307884 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f290003fa00 con 0x7f291009de50 2023-09-30T22:34:31.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.628+0000 7f28f7fff700 1 -- 172.21.15.59:0/4257307884 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f290001b3b0 con 0x7f291009de50 2023-09-30T22:34:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.701+0000 7f8f49b81700 1 Processor -- start 2023-09-30T22:34:31.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.701+0000 7f8f49b81700 1 -- start start 2023-09-30T22:34:31.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.702+0000 7f8f49b81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f4412cf60 0x7f8f4406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.702+0000 7f8f49b81700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f4412f8b0 0x7f8f4412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.702+0000 7f8f49b81700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4412cd90 con 0x7f8f44130260 2023-09-30T22:34:31.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.702+0000 7f8f49b81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4412d330 con 0x7f8f4412cf60 2023-09-30T22:34:31.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.702+0000 7f8f49b81700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f441306d0 con 0x7f8f4412f8b0 2023-09-30T22:34:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.702+0000 7f8f437fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f4412cf60 0x7f8f4406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.702+0000 7f8f437fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f4412cf60 0x7f8f4406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51698/0 (socket says 172.21.15.59:51698) 2023-09-30T22:34:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.702+0000 7f8f43fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8f44130260 0x7f8f44136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36752/0 (socket says 172.21.15.59:36752) 2023-09-30T22:34:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.702+0000 7f8f437fe700 1 -- 172.21.15.59:0/2960179158 learned_addr learned my addr 172.21.15.59:0/2960179158 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.702+0000 7f8f42ffd700 1 --2- 172.21.15.59:0/2960179158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f4412f8b0 0x7f8f4412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.703+0000 7f8f437fe700 1 -- 172.21.15.59:0/2960179158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f4412f8b0 msgr2=0x7f8f4412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.703+0000 7f8f437fe700 1 --2- 172.21.15.59:0/2960179158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f4412f8b0 0x7f8f4412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.703+0000 7f8f437fe700 1 -- 172.21.15.59:0/2960179158 >> v1:172.21.15.59:6789/0 conn(0x7f8f44130260 legacy=0x7f8f44136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.703+0000 7f8f437fe700 1 -- 172.21.15.59:0/2960179158 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f44071780 con 0x7f8f4412cf60 2023-09-30T22:34:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.703+0000 7f8f437fe700 1 --2- 172.21.15.59:0/2960179158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f4412cf60 0x7f8f4406f5d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009920 tx=0x7f8f34009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2267533451724f9e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.703+0000 7f8f427fc700 1 -- 172.21.15.59:0/2960179158 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34011830 con 0x7f8f4412cf60 2023-09-30T22:34:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.703+0000 7f8f427fc700 1 -- 172.21.15.59:0/2960179158 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f34011990 con 0x7f8f4412cf60 2023-09-30T22:34:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.703+0000 7f8f427fc700 1 -- 172.21.15.59:0/2960179158 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34011d20 con 0x7f8f4412cf60 2023-09-30T22:34:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.704+0000 7f8f49b81700 1 -- 172.21.15.59:0/2960179158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f4412cf60 msgr2=0x7f8f4406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.704+0000 7f8f49b81700 1 --2- 172.21.15.59:0/2960179158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f4412cf60 0x7f8f4406f5d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009920 tx=0x7f8f34009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.704+0000 7f8f49b81700 1 -- 172.21.15.59:0/2960179158 shutdown_connections 2023-09-30T22:34:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.704+0000 7f8f49b81700 1 --2- 172.21.15.59:0/2960179158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f4412cf60 0x7f8f4406f5d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.704+0000 7f8f49b81700 1 --2- 172.21.15.59:0/2960179158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f4412f8b0 0x7f8f4412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.704+0000 7f8f49b81700 1 -- 172.21.15.59:0/2960179158 >> 172.21.15.59:0/2960179158 conn(0x7f8f440a2aa0 msgr2=0x7f8f440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:31.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.704+0000 7f8f49b81700 1 -- 172.21.15.59:0/2960179158 shutdown_connections 2023-09-30T22:34:31.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.704+0000 7f8f49b81700 1 -- 172.21.15.59:0/2960179158 wait complete. 2023-09-30T22:34:31.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.706+0000 7f8f49b81700 1 Processor -- start 2023-09-30T22:34:31.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.706+0000 7f8f49b81700 1 -- start start 2023-09-30T22:34:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f49b81700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f4412cf60 0x7f8f44128dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f49b81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f4412f8b0 0x7f8f44129310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f49b81700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f44130260 0x7f8f44129850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f49b81700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44133df0 con 0x7f8f4412cf60 2023-09-30T22:34:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f49b81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4409ea70 con 0x7f8f4412f8b0 2023-09-30T22:34:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f49b81700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44132e90 con 0x7f8f44130260 2023-09-30T22:34:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f437fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f4412cf60 0x7f8f44128dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f437fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f4412cf60 0x7f8f44128dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48604/0 (socket says 172.21.15.59:48604) 2023-09-30T22:34:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f437fe700 1 -- 172.21.15.59:0/4084471468 learned_addr learned my addr 172.21.15.59:0/4084471468 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f42ffd700 1 --2- 172.21.15.59:0/4084471468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f4412f8b0 0x7f8f44129310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f43fff700 1 --2- 172.21.15.59:0/4084471468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f44130260 0x7f8f44129850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f437fe700 1 -- 172.21.15.59:0/4084471468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f44130260 msgr2=0x7f8f44129850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f437fe700 1 --2- 172.21.15.59:0/4084471468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f44130260 0x7f8f44129850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f437fe700 1 -- 172.21.15.59:0/4084471468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f4412f8b0 msgr2=0x7f8f44129310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f437fe700 1 --2- 172.21.15.59:0/4084471468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f4412f8b0 0x7f8f44129310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.707+0000 7f8f437fe700 1 -- 172.21.15.59:0/4084471468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f34009550 con 0x7f8f4412cf60 2023-09-30T22:34:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.708+0000 7f8f437fe700 1 --2- 172.21.15.59:0/4084471468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f4412cf60 0x7f8f44128dd0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f8f34000c00 tx=0x7f8f34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:31.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.708+0000 7f8f2bfff700 1 -- 172.21.15.59:0/4084471468 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34004450 con 0x7f8f4412cf60 2023-09-30T22:34:31.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.708+0000 7f8f2bfff700 1 -- 172.21.15.59:0/4084471468 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f340045b0 con 0x7f8f4412cf60 2023-09-30T22:34:31.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.708+0000 7f8f2bfff700 1 -- 172.21.15.59:0/4084471468 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340038a0 con 0x7f8f4412cf60 2023-09-30T22:34:31.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.708+0000 7f8f49b81700 1 -- 172.21.15.59:0/4084471468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f44129fa0 con 0x7f8f4412cf60 2023-09-30T22:34:31.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.708+0000 7f8f49b81700 1 -- 172.21.15.59:0/4084471468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4409e090 con 0x7f8f4412cf60 2023-09-30T22:34:31.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.709+0000 7f8f49b81700 1 -- 172.21.15.59:0/4084471468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f44074ea0 con 0x7f8f4412cf60 2023-09-30T22:34:31.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.710+0000 7f8f2bfff700 1 -- 172.21.15.59:0/4084471468 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f34021070 con 0x7f8f4412cf60 2023-09-30T22:34:31.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.710+0000 7f8f2bfff700 1 -- 172.21.15.59:0/4084471468 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f34040b30 con 0x7f8f4412cf60 2023-09-30T22:34:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.718+0000 7f8f2bfff700 1 -- 172.21.15.59:0/4084471468 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f34019770 con 0x7f8f4412cf60 2023-09-30T22:34:31.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.758+0000 7f92d3a9e700 1 Processor -- start 2023-09-30T22:34:31.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.758+0000 7f92d3a9e700 1 -- start start 2023-09-30T22:34:31.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.758+0000 7f92d3a9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92cc09d6f0 0x7f92cc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.758+0000 7f92d3a9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92cc09e000 0x7f92cc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.758+0000 7f92d3a9e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92cc09b120 con 0x7f92cc09e410 2023-09-30T22:34:31.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.758+0000 7f92d3a9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc06b460 con 0x7f92cc09d6f0 2023-09-30T22:34:31.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.758+0000 7f92d3a9e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc09a7e0 con 0x7f92cc09e000 2023-09-30T22:34:31.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.759+0000 7f92d183a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92cc09d6f0 0x7f92cc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.759+0000 7f92d183a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92cc09d6f0 0x7f92cc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51704/0 (socket says 172.21.15.59:51704) 2023-09-30T22:34:31.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.759+0000 7f92d183a700 1 -- 172.21.15.59:0/3501514431 learned_addr learned my addr 172.21.15.59:0/3501514431 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:31.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.759+0000 7f92d183a700 1 -- 172.21.15.59:0/3501514431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92cc09e000 msgr2=0x7f92cc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:31.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.759+0000 7f92d183a700 1 --2- 172.21.15.59:0/3501514431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92cc09e000 0x7f92cc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.759+0000 7f92d183a700 1 -- 172.21.15.59:0/3501514431 >> v1:172.21.15.59:6789/0 conn(0x7f92cc09e410 legacy=0x7f92cc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:31.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.759+0000 7f92d183a700 1 -- 172.21.15.59:0/3501514431 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc09a500 con 0x7f92cc09d6f0 2023-09-30T22:34:31.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.759+0000 7f92d183a700 1 --2- 172.21.15.59:0/3501514431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92cc09d6f0 0x7f92cc09dac0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009920 tx=0x7f92c8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f45cacf50f4f2a9c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:31.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.759+0000 7f92d0838700 1 -- 172.21.15.59:0/3501514431 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8004230 con 0x7f92cc09d6f0 2023-09-30T22:34:31.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.759+0000 7f92d0838700 1 -- 172.21.15.59:0/3501514431 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c8004390 con 0x7f92cc09d6f0 2023-09-30T22:34:31.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.759+0000 7f92d0838700 1 -- 172.21.15.59:0/3501514431 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8009e70 con 0x7f92cc09d6f0 2023-09-30T22:34:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.760+0000 7f92d3a9e700 1 -- 172.21.15.59:0/3501514431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92cc09d6f0 msgr2=0x7f92cc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.760+0000 7f92d3a9e700 1 --2- 172.21.15.59:0/3501514431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92cc09d6f0 0x7f92cc09dac0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009920 tx=0x7f92c8009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.760+0000 7f92d3a9e700 1 -- 172.21.15.59:0/3501514431 shutdown_connections 2023-09-30T22:34:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.760+0000 7f92d3a9e700 1 --2- 172.21.15.59:0/3501514431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92cc09d6f0 0x7f92cc09dac0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.760+0000 7f92d3a9e700 1 --2- 172.21.15.59:0/3501514431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92cc09e000 0x7f92cc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.760+0000 7f92d3a9e700 1 -- 172.21.15.59:0/3501514431 >> 172.21.15.59:0/3501514431 conn(0x7f92cc066f50 msgr2=0x7f92cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.760+0000 7f92d3a9e700 1 -- 172.21.15.59:0/3501514431 shutdown_connections 2023-09-30T22:34:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.760+0000 7f92d3a9e700 1 -- 172.21.15.59:0/3501514431 wait complete. 2023-09-30T22:34:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.762+0000 7f92d3a9e700 1 Processor -- start 2023-09-30T22:34:31.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.762+0000 7f92d3a9e700 1 -- start start 2023-09-30T22:34:31.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.762+0000 7f92d3a9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92cc09d6f0 0x7f92cc1226f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.762+0000 7f92d3a9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92cc09e000 0x7f92cc122c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.762+0000 7f92d3a9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92cc09e410 0x7f92cc123170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.762+0000 7f92d3a9e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc125ea0 con 0x7f92cc09d6f0 2023-09-30T22:34:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.762+0000 7f92d3a9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc124380 con 0x7f92cc09e410 2023-09-30T22:34:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.762+0000 7f92d3a9e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0a2fe0 con 0x7f92cc09e000 2023-09-30T22:34:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.762+0000 7f92d203b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92cc09e410 0x7f92cc123170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.763+0000 7f92d203b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92cc09e410 0x7f92cc123170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51708/0 (socket says 172.21.15.59:51708) 2023-09-30T22:34:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.763+0000 7f92d203b700 1 -- 172.21.15.59:0/2980065853 learned_addr learned my addr 172.21.15.59:0/2980065853 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.763+0000 7f92d183a700 1 --2- 172.21.15.59:0/2980065853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92cc09d6f0 0x7f92cc1226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.763+0000 7f92d1039700 1 --2- 172.21.15.59:0/2980065853 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92cc09e000 0x7f92cc122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.763+0000 7f92d203b700 1 -- 172.21.15.59:0/2980065853 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92cc09e000 msgr2=0x7f92cc122c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.763+0000 7f92d203b700 1 --2- 172.21.15.59:0/2980065853 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92cc09e000 0x7f92cc122c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.763+0000 7f92d203b700 1 -- 172.21.15.59:0/2980065853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92cc09d6f0 msgr2=0x7f92cc1226f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.763+0000 7f92d203b700 1 --2- 172.21.15.59:0/2980065853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92cc09d6f0 0x7f92cc1226f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.763+0000 7f92d203b700 1 -- 172.21.15.59:0/2980065853 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c8009550 con 0x7f92cc09e410 2023-09-30T22:34:31.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.763+0000 7f92d203b700 1 --2- 172.21.15.59:0/2980065853 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92cc09e410 0x7f92cc123170 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f92c400c780 tx=0x7f92c400ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:31.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.763+0000 7f92c27fc700 1 -- 172.21.15.59:0/2980065853 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4003e10 con 0x7f92cc09e410 2023-09-30T22:34:31.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.764+0000 7f92c27fc700 1 -- 172.21.15.59:0/2980065853 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c4005070 con 0x7f92cc09e410 2023-09-30T22:34:31.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.764+0000 7f92c27fc700 1 -- 172.21.15.59:0/2980065853 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4005420 con 0x7f92cc09e410 2023-09-30T22:34:31.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.764+0000 7f92d3a9e700 1 -- 172.21.15.59:0/2980065853 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92cc09c710 con 0x7f92cc09e410 2023-09-30T22:34:31.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.764+0000 7f92d3a9e700 1 -- 172.21.15.59:0/2980065853 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92cc126910 con 0x7f92cc09e410 2023-09-30T22:34:31.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.765+0000 7f92c27fc700 1 -- 172.21.15.59:0/2980065853 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92c4005580 con 0x7f92cc09e410 2023-09-30T22:34:31.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.765+0000 7f92d3a9e700 1 -- 172.21.15.59:0/2980065853 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92cc074ea0 con 0x7f92cc09e410 2023-09-30T22:34:31.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.765+0000 7f92c27fc700 1 -- 172.21.15.59:0/2980065853 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f92c403e8b0 con 0x7f92cc09e410 2023-09-30T22:34:31.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.768+0000 7f80b7e74700 1 Processor -- start 2023-09-30T22:34:31.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.768+0000 7f80b7e74700 1 -- start start 2023-09-30T22:34:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.769+0000 7f80b7e74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b0133420 0x7f80b01337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.769+0000 7f80b7e74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0133e30 0x7f80b012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.769+0000 7f80b7e74700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b006b990 con 0x7f80b0134260 2023-09-30T22:34:31.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.769+0000 7f80b7e74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b00a0590 con 0x7f80b0133e30 2023-09-30T22:34:31.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.769+0000 7f80b7e74700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80b009fb80 con 0x7f80b0133420 2023-09-30T22:34:31.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.769+0000 7f80b540f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0133e30 0x7f80b012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.769+0000 7f80b540f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0133e30 0x7f80b012ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51710/0 (socket says 172.21.15.59:51710) 2023-09-30T22:34:31.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.769+0000 7f80b540f700 1 -- 172.21.15.59:0/650179111 learned_addr learned my addr 172.21.15.59:0/650179111 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:31.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.769+0000 7f80b5c10700 1 --2- 172.21.15.59:0/650179111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b0133420 0x7f80b01337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.770+0000 7f80b4c0e700 1 -- 172.21.15.59:0/650179111 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862049286 0 0) 0x7f80b006b990 con 0x7f80b0134260 2023-09-30T22:34:31.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.770+0000 7f80b5c10700 1 -- 172.21.15.59:0/650179111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0133e30 msgr2=0x7f80b012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:31.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.770+0000 7f80b5c10700 1 --2- 172.21.15.59:0/650179111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0133e30 0x7f80b012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.770+0000 7f80b5c10700 1 -- 172.21.15.59:0/650179111 >> v1:172.21.15.59:6789/0 conn(0x7f80b0134260 legacy=0x7f80b01304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.770+0000 7f80b5c10700 1 -- 172.21.15.59:0/650179111 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b00a0030 con 0x7f80b0133420 2023-09-30T22:34:31.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.770+0000 7f80b5c10700 1 --2- 172.21.15.59:0/650179111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b0133420 0x7f80b01337f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009870 tx=0x7f80ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70fab498f2e43b5c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:31.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.770+0000 7f80b4c0e700 1 -- 172.21.15.59:0/650179111 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac011830 con 0x7f80b0133420 2023-09-30T22:34:31.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.770+0000 7f80b4c0e700 1 -- 172.21.15.59:0/650179111 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac011990 con 0x7f80b0133420 2023-09-30T22:34:31.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.770+0000 7f80b4c0e700 1 -- 172.21.15.59:0/650179111 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac011d20 con 0x7f80b0133420 2023-09-30T22:34:31.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.771+0000 7f80b7e74700 1 -- 172.21.15.59:0/650179111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b0133420 msgr2=0x7f80b01337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.771+0000 7f80b7e74700 1 --2- 172.21.15.59:0/650179111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b0133420 0x7f80b01337f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009870 tx=0x7f80ac009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:31.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.771+0000 7f80b7e74700 1 -- 172.21.15.59:0/650179111 shutdown_connections 2023-09-30T22:34:31.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.771+0000 7f80b7e74700 1 --2- 172.21.15.59:0/650179111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b0133420 0x7f80b01337f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.771+0000 7f80b7e74700 1 --2- 172.21.15.59:0/650179111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0133e30 0x7f80b012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.771+0000 7f80b7e74700 1 -- 172.21.15.59:0/650179111 >> 172.21.15.59:0/650179111 conn(0x7f80b00a4210 msgr2=0x7f80b00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:31.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.771+0000 7f80b7e74700 1 -- 172.21.15.59:0/650179111 shutdown_connections 2023-09-30T22:34:31.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.771+0000 7f80b7e74700 1 -- 172.21.15.59:0/650179111 wait complete. 2023-09-30T22:34:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.772+0000 7f80b7e74700 1 Processor -- start 2023-09-30T22:34:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.772+0000 7f80b7e74700 1 -- start start 2023-09-30T22:34:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.773+0000 7f80b7e74700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b0133420 0x7f80b009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.773+0000 7f80b7e74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b0133e30 0x7f80b009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.773+0000 7f80b7e74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0134260 0x7f80b009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.773+0000 7f80b7e74700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b0131570 con 0x7f80b0133420 2023-09-30T22:34:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.773+0000 7f80b7e74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b011f7b0 con 0x7f80b0134260 2023-09-30T22:34:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.773+0000 7f80b7e74700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80b009d870 con 0x7f80b0133e30 2023-09-30T22:34:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.773+0000 7f80b6411700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0134260 0x7f80b009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.773+0000 7f80b540f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b0133e30 0x7f80b009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.773+0000 7f80b6411700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0134260 0x7f80b009cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51726/0 (socket says 172.21.15.59:51726) 2023-09-30T22:34:31.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.773+0000 7f80b540f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b0133e30 0x7f80b009c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60202/0 (socket says 172.21.15.59:60202) 2023-09-30T22:34:31.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.773+0000 7f92c27fc700 1 -- 172.21.15.59:0/2980065853 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92c400e6f0 con 0x7f92cc09e410 2023-09-30T22:34:31.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.773+0000 7f80b6411700 1 -- 172.21.15.59:0/1275533780 learned_addr learned my addr 172.21.15.59:0/1275533780 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:31.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.773+0000 7f80b5c10700 1 --2- 172.21.15.59:0/1275533780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b0133420 0x7f80b009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:31.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.774+0000 7f80b540f700 1 -- 172.21.15.59:0/1275533780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0134260 msgr2=0x7f80b009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.774+0000 7f80b540f700 1 --2- 172.21.15.59:0/1275533780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0134260 0x7f80b009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.774+0000 7f80b540f700 1 -- 172.21.15.59:0/1275533780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b0133420 msgr2=0x7f80b009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.774+0000 7f80b540f700 1 --2- 172.21.15.59:0/1275533780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b0133420 0x7f80b009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.774+0000 7f80b540f700 1 -- 172.21.15.59:0/1275533780 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac0094a0 con 0x7f80b0133e30 2023-09-30T22:34:31.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.774+0000 7f80b540f700 1 --2- 172.21.15.59:0/1275533780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b0133e30 0x7f80b009c9c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f80a000e8e0 tx=0x7f80a000ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:31.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.774+0000 7f80a67fc700 1 -- 172.21.15.59:0/1275533780 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0013680 con 0x7f80b0133e30 2023-09-30T22:34:31.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.774+0000 7f80a67fc700 1 -- 172.21.15.59:0/1275533780 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a00137e0 con 0x7f80b0133e30 2023-09-30T22:34:31.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.774+0000 7f80a67fc700 1 -- 172.21.15.59:0/1275533780 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0013b50 con 0x7f80b0133e30 2023-09-30T22:34:31.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.775+0000 7f80b7e74700 1 -- 172.21.15.59:0/1275533780 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b0120580 con 0x7f80b0133e30 2023-09-30T22:34:31.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.775+0000 7f80b7e74700 1 -- 172.21.15.59:0/1275533780 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b009dd30 con 0x7f80b0133e30 2023-09-30T22:34:31.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.776+0000 7f80a67fc700 1 -- 172.21.15.59:0/1275533780 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80a0013cb0 con 0x7f80b0133e30 2023-09-30T22:34:31.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.776+0000 7f80a67fc700 1 -- 172.21.15.59:0/1275533780 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f80a003f7c0 con 0x7f80b0133e30 2023-09-30T22:34:31.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.777+0000 7f80b7e74700 1 -- 172.21.15.59:0/1275533780 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b011f9e0 con 0x7f80b0133e30 2023-09-30T22:34:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.786+0000 7f80a67fc700 1 -- 172.21.15.59:0/1275533780 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80a001bde0 con 0x7f80b0133e30 2023-09-30T22:34:31.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.871+0000 7f29158b4700 1 -- 172.21.15.59:0/4257307884 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2910074ea0 con 0x7f291009de50 2023-09-30T22:34:31.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.871+0000 7f28f7fff700 1 -- 172.21.15.59:0/4257307884 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2900021070 con 0x7f291009de50 2023-09-30T22:34:31.872 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:31.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.875+0000 7f29158b4700 1 -- 172.21.15.59:0/4257307884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f291009de50 msgr2=0x7f291011d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.875+0000 7f29158b4700 1 --2- 172.21.15.59:0/4257307884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f291009de50 0x7f291011d6a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f290000e9e0 tx=0x7f290000ecf0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.875+0000 7f29158b4700 1 -- 172.21.15.59:0/4257307884 shutdown_connections 2023-09-30T22:34:31.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.875+0000 7f29158b4700 1 --2- 172.21.15.59:0/4257307884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29101338a0 0x7f291011e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.875+0000 7f29158b4700 1 --2- 172.21.15.59:0/4257307884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f291009de50 0x7f291011d6a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.875+0000 7f29158b4700 1 --2- 172.21.15.59:0/4257307884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f291009e760 0x7f291011dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.875+0000 7f29158b4700 1 -- 172.21.15.59:0/4257307884 >> 172.21.15.59:0/4257307884 conn(0x7f29100a2aa0 msgr2=0x7f29101bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:31.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.876+0000 7f29158b4700 1 -- 172.21.15.59:0/4257307884 shutdown_connections 2023-09-30T22:34:31.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.876+0000 7f29158b4700 1 -- 172.21.15.59:0/4257307884 wait complete. 2023-09-30T22:34:31.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:31.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.935+0000 7f8f49b81700 1 -- 172.21.15.59:0/4084471468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8f440713a0 con 0x7f8f4412cf60 2023-09-30T22:34:31.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.935+0000 7f8f2bfff700 1 -- 172.21.15.59:0/4084471468 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f34029030 con 0x7f8f4412cf60 2023-09-30T22:34:31.936 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:31.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.938+0000 7f8f49b81700 1 -- 172.21.15.59:0/4084471468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f4412cf60 msgr2=0x7f8f44128dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.938+0000 7f8f49b81700 1 --2- 172.21.15.59:0/4084471468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f4412cf60 0x7f8f44128dd0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f8f34000c00 tx=0x7f8f34004750 comp rx=0 tx=0).stop 2023-09-30T22:34:31.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.938+0000 7f8f49b81700 1 -- 172.21.15.59:0/4084471468 shutdown_connections 2023-09-30T22:34:31.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.938+0000 7f8f49b81700 1 --2- 172.21.15.59:0/4084471468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f44130260 0x7f8f44129850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.938+0000 7f8f49b81700 1 --2- 172.21.15.59:0/4084471468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f4412cf60 0x7f8f44128dd0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.938+0000 7f8f49b81700 1 --2- 172.21.15.59:0/4084471468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f4412f8b0 0x7f8f44129310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.938+0000 7f8f49b81700 1 -- 172.21.15.59:0/4084471468 >> 172.21.15.59:0/4084471468 conn(0x7f8f440a2aa0 msgr2=0x7f8f440a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:31.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.938+0000 7f8f49b81700 1 -- 172.21.15.59:0/4084471468 shutdown_connections 2023-09-30T22:34:31.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.938+0000 7f8f49b81700 1 -- 172.21.15.59:0/4084471468 wait complete. 2023-09-30T22:34:31.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:31.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.983+0000 7f92d3a9e700 1 -- 172.21.15.59:0/2980065853 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f92cc1261e0 con 0x7f92cc09e410 2023-09-30T22:34:31.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.984+0000 7f92c27fc700 1 -- 172.21.15.59:0/2980065853 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92c4017020 con 0x7f92cc09e410 2023-09-30T22:34:31.984 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:31.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.986+0000 7f92d3a9e700 1 -- 172.21.15.59:0/2980065853 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92cc09e410 msgr2=0x7f92cc123170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.986+0000 7f92d3a9e700 1 --2- 172.21.15.59:0/2980065853 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92cc09e410 0x7f92cc123170 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f92c400c780 tx=0x7f92c400ca90 comp rx=0 tx=0).stop 2023-09-30T22:34:31.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.986+0000 7f92d3a9e700 1 -- 172.21.15.59:0/2980065853 shutdown_connections 2023-09-30T22:34:31.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.986+0000 7f92d3a9e700 1 --2- 172.21.15.59:0/2980065853 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92cc09e410 0x7f92cc123170 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.986+0000 7f92d3a9e700 1 --2- 172.21.15.59:0/2980065853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92cc09d6f0 0x7f92cc1226f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.986+0000 7f92d3a9e700 1 --2- 172.21.15.59:0/2980065853 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92cc09e000 0x7f92cc122c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.986+0000 7f92d3a9e700 1 -- 172.21.15.59:0/2980065853 >> 172.21.15.59:0/2980065853 conn(0x7f92cc066f50 msgr2=0x7f92cc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:31.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.986+0000 7f92d3a9e700 1 -- 172.21.15.59:0/2980065853 shutdown_connections 2023-09-30T22:34:31.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.986+0000 7f92d3a9e700 1 -- 172.21.15.59:0/2980065853 wait complete. 2023-09-30T22:34:31.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.992+0000 7f80b7e74700 1 -- 172.21.15.59:0/1275533780 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f80b011fc60 con 0x7f80b0133e30 2023-09-30T22:34:31.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.993+0000 7f80a67fc700 1 -- 172.21.15.59:0/1275533780 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f80a002b090 con 0x7f80b0133e30 2023-09-30T22:34:31.993 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.995+0000 7f80b7e74700 1 -- 172.21.15.59:0/1275533780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b0133e30 msgr2=0x7f80b009c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.995+0000 7f80b7e74700 1 --2- 172.21.15.59:0/1275533780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b0133e30 0x7f80b009c9c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f80a000e8e0 tx=0x7f80a000ebf0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.995+0000 7f80b7e74700 1 -- 172.21.15.59:0/1275533780 shutdown_connections 2023-09-30T22:34:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.995+0000 7f80b7e74700 1 --2- 172.21.15.59:0/1275533780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0134260 0x7f80b009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.995+0000 7f80b7e74700 1 --2- 172.21.15.59:0/1275533780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b0133420 0x7f80b009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.995+0000 7f80b7e74700 1 --2- 172.21.15.59:0/1275533780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b0133e30 0x7f80b009c9c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.995+0000 7f80b7e74700 1 -- 172.21.15.59:0/1275533780 >> 172.21.15.59:0/1275533780 conn(0x7f80b00a4210 msgr2=0x7f80b00a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.995+0000 7f80b7e74700 1 -- 172.21.15.59:0/1275533780 shutdown_connections 2023-09-30T22:34:31.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:31.995+0000 7f80b7e74700 1 -- 172.21.15.59:0/1275533780 wait complete. 2023-09-30T22:34:32.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:32.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:32.893 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:32.953 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:33.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:33.010 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:33.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.044+0000 7f9de24f3700 1 Processor -- start 2023-09-30T22:34:33.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.044+0000 7f9de24f3700 1 -- start start 2023-09-30T22:34:33.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.045+0000 7f9de24f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ddc09e1d0 0x7f9ddc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.045+0000 7f9de24f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ddc139170 0x7f9ddc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.045+0000 7f9de24f3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ddc09b120 con 0x7f9ddc09d6f0 2023-09-30T22:34:33.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.045+0000 7f9de24f3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc06b460 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.045+0000 7f9de24f3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc09a7e0 con 0x7f9ddc139170 2023-09-30T22:34:33.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.045+0000 7f9ddb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ddc09e1d0 0x7f9ddc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.045+0000 7f9ddb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ddc09e1d0 0x7f9ddc138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51730/0 (socket says 172.21.15.59:51730) 2023-09-30T22:34:33.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.045+0000 7f9ddb7fe700 1 -- 172.21.15.59:0/276388935 learned_addr learned my addr 172.21.15.59:0/276388935 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:33.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.045+0000 7f9ddbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9ddc09d6f0 0x7f9ddc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36786/0 (socket says 172.21.15.59:36786) 2023-09-30T22:34:33.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.045+0000 7f9de0a90700 1 --2- 172.21.15.59:0/276388935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ddc139170 0x7f9ddc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.045+0000 7f9ddb7fe700 1 -- 172.21.15.59:0/276388935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ddc139170 msgr2=0x7f9ddc13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:33.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.045+0000 7f9ddb7fe700 1 --2- 172.21.15.59:0/276388935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ddc139170 0x7f9ddc13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.045+0000 7f9ddb7fe700 1 -- 172.21.15.59:0/276388935 >> v1:172.21.15.59:6789/0 conn(0x7f9ddc09d6f0 legacy=0x7f9ddc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.045+0000 7f9ddb7fe700 1 -- 172.21.15.59:0/276388935 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc09a500 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.046+0000 7f9ddb7fe700 1 --2- 172.21.15.59:0/276388935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ddc09e1d0 0x7f9ddc138c30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009920 tx=0x7f9dd0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a58c4637a27d698b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:33.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.046+0000 7f9ddaffd700 1 -- 172.21.15.59:0/276388935 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0011830 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.046+0000 7f9ddaffd700 1 -- 172.21.15.59:0/276388935 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd0011990 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.046+0000 7f9ddaffd700 1 -- 172.21.15.59:0/276388935 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0011d20 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.047+0000 7f9de24f3700 1 -- 172.21.15.59:0/276388935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ddc09e1d0 msgr2=0x7f9ddc138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.047+0000 7f9de24f3700 1 --2- 172.21.15.59:0/276388935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ddc09e1d0 0x7f9ddc138c30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009920 tx=0x7f9dd0009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:33.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.047+0000 7f9de24f3700 1 -- 172.21.15.59:0/276388935 shutdown_connections 2023-09-30T22:34:33.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.047+0000 7f9de24f3700 1 --2- 172.21.15.59:0/276388935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ddc139170 0x7f9ddc13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.047+0000 7f9de24f3700 1 --2- 172.21.15.59:0/276388935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ddc09e1d0 0x7f9ddc138c30 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.047+0000 7f9de24f3700 1 -- 172.21.15.59:0/276388935 >> 172.21.15.59:0/276388935 conn(0x7f9ddc066f50 msgr2=0x7f9ddc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:33.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.047+0000 7f9de24f3700 1 -- 172.21.15.59:0/276388935 shutdown_connections 2023-09-30T22:34:33.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.047+0000 7f9de24f3700 1 -- 172.21.15.59:0/276388935 wait complete. 2023-09-30T22:34:33.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.048+0000 7f9de24f3700 1 Processor -- start 2023-09-30T22:34:33.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.048+0000 7f9de24f3700 1 -- start start 2023-09-30T22:34:33.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9de24f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ddc09d6f0 0x7f9ddc11f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9de24f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ddc09e1d0 0x7f9ddc11f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9de24f3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ddc139170 0x7f9ddc1c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9de24f3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc11f010 con 0x7f9ddc139170 2023-09-30T22:34:33.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9de24f3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc1222a0 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9de24f3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc1212e0 con 0x7f9ddc09d6f0 2023-09-30T22:34:33.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9ddbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ddc09d6f0 0x7f9ddc11f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9ddb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ddc09e1d0 0x7f9ddc11f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9de0a90700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ddc139170 0x7f9ddc1c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9ddbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ddc09d6f0 0x7f9ddc11f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60208/0 (socket says 172.21.15.59:60208) 2023-09-30T22:34:33.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9ddbfff700 1 -- 172.21.15.59:0/1033732480 learned_addr learned my addr 172.21.15.59:0/1033732480 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:33.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9ddb7fe700 1 -- 172.21.15.59:0/1033732480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ddc09d6f0 msgr2=0x7f9ddc11f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9ddb7fe700 1 --2- 172.21.15.59:0/1033732480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ddc09d6f0 0x7f9ddc11f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9ddb7fe700 1 -- 172.21.15.59:0/1033732480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ddc139170 msgr2=0x7f9ddc1c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9ddb7fe700 1 --2- 172.21.15.59:0/1033732480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ddc139170 0x7f9ddc1c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.049+0000 7f9ddb7fe700 1 -- 172.21.15.59:0/1033732480 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd0009550 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.050+0000 7f9ddb7fe700 1 --2- 172.21.15.59:0/1033732480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ddc09e1d0 0x7f9ddc11f910 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009920 tx=0x7f9dd0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:33.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.050+0000 7f9dd8ff9700 1 -- 172.21.15.59:0/1033732480 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0004450 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.050+0000 7f9dd8ff9700 1 -- 172.21.15.59:0/1033732480 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd00045b0 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.050+0000 7f9dd8ff9700 1 -- 172.21.15.59:0/1033732480 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00038a0 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.050+0000 7f9de24f3700 1 -- 172.21.15.59:0/1033732480 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ddc09c710 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.050+0000 7f9de24f3700 1 -- 172.21.15.59:0/1033732480 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ddc122040 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.051+0000 7f9de24f3700 1 -- 172.21.15.59:0/1033732480 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ddc074ea0 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.052+0000 7f9dd8ff9700 1 -- 172.21.15.59:0/1033732480 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9dd0003a00 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.052+0000 7f9dd8ff9700 1 -- 172.21.15.59:0/1033732480 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9dd0021030 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.057+0000 7f9dd8ff9700 1 -- 172.21.15.59:0/1033732480 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9dd0003cb0 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.107+0000 7f1e580f5700 1 Processor -- start 2023-09-30T22:34:33.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.107+0000 7f1e580f5700 1 -- start start 2023-09-30T22:34:33.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.108+0000 7f1e580f5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e501338a0 0x7f1e50133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.108+0000 7f1e580f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009de50 0x7f1e5009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.108+0000 7f1e580f5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5009e760 0x7f1e5013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.108+0000 7f1e580f5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e5006fef0 con 0x7f1e501338a0 2023-09-30T22:34:33.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.108+0000 7f1e580f5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5006ef30 con 0x7f1e5009de50 2023-09-30T22:34:33.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.108+0000 7f1e580f5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e501334b0 con 0x7f1e5009e760 2023-09-30T22:34:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.108+0000 7f1e55690700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009de50 0x7f1e5009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.108+0000 7f1e55690700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009de50 0x7f1e5009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51740/0 (socket says 172.21.15.59:51740) 2023-09-30T22:34:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.108+0000 7f1e55690700 1 -- 172.21.15.59:0/2000156079 learned_addr learned my addr 172.21.15.59:0/2000156079 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.108+0000 7f1e55e91700 1 --2- 172.21.15.59:0/2000156079 >> v2:172.21.15.59:3300/0 conn(0x7f1e501338a0 0x7f1e50133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.109+0000 7f1e56692700 1 --2- 172.21.15.59:0/2000156079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5009e760 0x7f1e5013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.109+0000 7f1e55690700 1 -- 172.21.15.59:0/2000156079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5009e760 msgr2=0x7f1e5013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.109+0000 7f1e55690700 1 --2- 172.21.15.59:0/2000156079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5009e760 0x7f1e5013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.109+0000 7f1e55690700 1 -- 172.21.15.59:0/2000156079 >> v2:172.21.15.59:3300/0 conn(0x7f1e501338a0 msgr2=0x7f1e50133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.109+0000 7f1e55690700 1 --2- 172.21.15.59:0/2000156079 >> v2:172.21.15.59:3300/0 conn(0x7f1e501338a0 0x7f1e50133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.109+0000 7f1e55690700 1 -- 172.21.15.59:0/2000156079 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5006fc30 con 0x7f1e5009de50 2023-09-30T22:34:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.109+0000 7f1e55e91700 1 --2- 172.21.15.59:0/2000156079 >> v2:172.21.15.59:3300/0 conn(0x7f1e501338a0 0x7f1e50133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.109+0000 7f1e55690700 1 --2- 172.21.15.59:0/2000156079 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009de50 0x7f1e5009e220 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1e400098f0 tx=0x7f1e40009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc3de76cb754ccda server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:33.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.109+0000 7f1e54e8f700 1 -- 172.21.15.59:0/2000156079 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40011830 con 0x7f1e5009de50 2023-09-30T22:34:33.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.109+0000 7f1e54e8f700 1 -- 172.21.15.59:0/2000156079 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e40011990 con 0x7f1e5009de50 2023-09-30T22:34:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.110+0000 7f1e54e8f700 1 -- 172.21.15.59:0/2000156079 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40011d20 con 0x7f1e5009de50 2023-09-30T22:34:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.110+0000 7f1e580f5700 1 -- 172.21.15.59:0/2000156079 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009de50 msgr2=0x7f1e5009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.110+0000 7f1e580f5700 1 --2- 172.21.15.59:0/2000156079 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009de50 0x7f1e5009e220 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1e400098f0 tx=0x7f1e40009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.110+0000 7f1e580f5700 1 -- 172.21.15.59:0/2000156079 shutdown_connections 2023-09-30T22:34:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.110+0000 7f1e580f5700 1 --2- 172.21.15.59:0/2000156079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5009e760 0x7f1e5013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.110+0000 7f1e580f5700 1 --2- 172.21.15.59:0/2000156079 >> v2:172.21.15.59:3300/0 conn(0x7f1e501338a0 0x7f1e50133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.110+0000 7f1e580f5700 1 --2- 172.21.15.59:0/2000156079 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009de50 0x7f1e5009e220 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.110+0000 7f1e580f5700 1 -- 172.21.15.59:0/2000156079 >> 172.21.15.59:0/2000156079 conn(0x7f1e500a2aa0 msgr2=0x7f1e500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.110+0000 7f1e580f5700 1 -- 172.21.15.59:0/2000156079 shutdown_connections 2023-09-30T22:34:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.110+0000 7f1e580f5700 1 -- 172.21.15.59:0/2000156079 wait complete. 2023-09-30T22:34:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.112+0000 7f1e580f5700 1 Processor -- start 2023-09-30T22:34:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.112+0000 7f1e580f5700 1 -- start start 2023-09-30T22:34:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.113+0000 7f1e580f5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5009de50 0x7f1e5011e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.113+0000 7f1e580f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009e760 0x7f1e5011ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.113+0000 7f1e580f5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e501338a0 0x7f1e5011f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.113+0000 7f1e580f5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e501224f0 con 0x7f1e501338a0 2023-09-30T22:34:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.113+0000 7f1e580f5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e501205e0 con 0x7f1e5009e760 2023-09-30T22:34:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.113+0000 7f1e580f5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500a1020 con 0x7f1e5009de50 2023-09-30T22:34:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.113+0000 7f1e55690700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009e760 0x7f1e5011ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.113+0000 7f1e55690700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009e760 0x7f1e5011ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51742/0 (socket says 172.21.15.59:51742) 2023-09-30T22:34:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.113+0000 7f1e55690700 1 -- 172.21.15.59:0/4154682558 learned_addr learned my addr 172.21.15.59:0/4154682558 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.113+0000 7f1e55e91700 1 --2- 172.21.15.59:0/4154682558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5009de50 0x7f1e5011e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.113+0000 7f1e56692700 1 --2- 172.21.15.59:0/4154682558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e501338a0 0x7f1e5011f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.114+0000 7f1e55e91700 1 -- 172.21.15.59:0/4154682558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009e760 msgr2=0x7f1e5011ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.114+0000 7f1e55e91700 1 --2- 172.21.15.59:0/4154682558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009e760 0x7f1e5011ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.114+0000 7f1e55e91700 1 -- 172.21.15.59:0/4154682558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e501338a0 msgr2=0x7f1e5011f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.114+0000 7f1e55e91700 1 --2- 172.21.15.59:0/4154682558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e501338a0 0x7f1e5011f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.114+0000 7f1e55e91700 1 -- 172.21.15.59:0/4154682558 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c0094a0 con 0x7f1e5009de50 2023-09-30T22:34:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.114+0000 7f1e55e91700 1 --2- 172.21.15.59:0/4154682558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5009de50 0x7f1e5011e9d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00e9b0 tx=0x7f1e4c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.114+0000 7f1e467fc700 1 -- 172.21.15.59:0/4154682558 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c00ee50 con 0x7f1e5009de50 2023-09-30T22:34:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.114+0000 7f1e467fc700 1 -- 172.21.15.59:0/4154682558 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c00c850 con 0x7f1e5009de50 2023-09-30T22:34:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.114+0000 7f1e467fc700 1 -- 172.21.15.59:0/4154682558 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c00cc00 con 0x7f1e5009de50 2023-09-30T22:34:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.114+0000 7f1e580f5700 1 -- 172.21.15.59:0/4154682558 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e40009550 con 0x7f1e5009de50 2023-09-30T22:34:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.114+0000 7f1e580f5700 1 -- 172.21.15.59:0/4154682558 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5012f4f0 con 0x7f1e5009de50 2023-09-30T22:34:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.115+0000 7f1e580f5700 1 -- 172.21.15.59:0/4154682558 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e50074ea0 con 0x7f1e5009de50 2023-09-30T22:34:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.116+0000 7f1e467fc700 1 -- 172.21.15.59:0/4154682558 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e4c013470 con 0x7f1e5009de50 2023-09-30T22:34:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.116+0000 7f1e467fc700 1 -- 172.21.15.59:0/4154682558 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e4c03fab0 con 0x7f1e5009de50 2023-09-30T22:34:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.121+0000 7f1e467fc700 1 -- 172.21.15.59:0/4154682558 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e4c013720 con 0x7f1e5009de50 2023-09-30T22:34:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.164+0000 7f0cf6494700 1 Processor -- start 2023-09-30T22:34:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.164+0000 7f0cf6494700 1 -- start start 2023-09-30T22:34:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.164+0000 7f0cf6494700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf006c0e0 0x7f0cf009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.164+0000 7f0cf6494700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cf01380f0 0x7f0cf013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.164+0000 7f0cf6494700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf0134980 con 0x7f0cf0134ec0 2023-09-30T22:34:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.164+0000 7f0cf6494700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf006c4b0 con 0x7f0cf01380f0 2023-09-30T22:34:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.164+0000 7f0cf6494700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf00a09c0 con 0x7f0cf006c0e0 2023-09-30T22:34:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.165+0000 7f0ceffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf006c0e0 0x7f0cf009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.165+0000 7f0ceffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf006c0e0 0x7f0cf009ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60230/0 (socket says 172.21.15.59:60230) 2023-09-30T22:34:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.165+0000 7f0ceffff700 1 -- 172.21.15.59:0/1021905173 learned_addr learned my addr 172.21.15.59:0/1021905173 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:33.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.165+0000 7f0cf4a31700 1 --2- 172.21.15.59:0/1021905173 >> v2:172.21.15.59:3300/0 conn(0x7f0cf01380f0 0x7f0cf013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.165+0000 7f0cf4a31700 1 -- 172.21.15.59:0/1021905173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf006c0e0 msgr2=0x7f0cf009ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:33.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.165+0000 7f0cf4a31700 1 --2- 172.21.15.59:0/1021905173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf006c0e0 0x7f0cf009ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.165+0000 7f0cf4a31700 1 -- 172.21.15.59:0/1021905173 >> v1:172.21.15.59:6789/0 conn(0x7f0cf0134ec0 legacy=0x7f0cf01379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.165+0000 7f0cf4a31700 1 -- 172.21.15.59:0/1021905173 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf00a0600 con 0x7f0cf01380f0 2023-09-30T22:34:33.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.165+0000 7f0ceffff700 1 --2- 172.21.15.59:0/1021905173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf006c0e0 0x7f0cf009ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:33.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.165+0000 7f0cf4a31700 1 --2- 172.21.15.59:0/1021905173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf01380f0 0x7f0cf013fd20 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009d90 tx=0x7f0ce800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f4aa0d99be6372 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:33.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.166+0000 7f0ceeffd700 1 -- 172.21.15.59:0/1021905173 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce800e070 con 0x7f0cf01380f0 2023-09-30T22:34:33.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.166+0000 7f0ceeffd700 1 -- 172.21.15.59:0/1021905173 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce800bb20 con 0x7f0cf01380f0 2023-09-30T22:34:33.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.166+0000 7f0ceeffd700 1 -- 172.21.15.59:0/1021905173 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8012430 con 0x7f0cf01380f0 2023-09-30T22:34:33.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.166+0000 7f0cf6494700 1 -- 172.21.15.59:0/1021905173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf01380f0 msgr2=0x7f0cf013fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.166+0000 7f0cf6494700 1 --2- 172.21.15.59:0/1021905173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf01380f0 0x7f0cf013fd20 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009d90 tx=0x7f0ce800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:33.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.166+0000 7f0cf6494700 1 -- 172.21.15.59:0/1021905173 shutdown_connections 2023-09-30T22:34:33.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.166+0000 7f0cf6494700 1 --2- 172.21.15.59:0/1021905173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf01380f0 0x7f0cf013fd20 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.166+0000 7f0cf6494700 1 --2- 172.21.15.59:0/1021905173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf006c0e0 0x7f0cf009ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.166+0000 7f0cf6494700 1 -- 172.21.15.59:0/1021905173 >> 172.21.15.59:0/1021905173 conn(0x7f0cf00a4210 msgr2=0x7f0cf00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:33.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.167+0000 7f0cf6494700 1 -- 172.21.15.59:0/1021905173 shutdown_connections 2023-09-30T22:34:33.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.167+0000 7f0cf6494700 1 -- 172.21.15.59:0/1021905173 wait complete. 2023-09-30T22:34:33.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.168+0000 7f0cf6494700 1 Processor -- start 2023-09-30T22:34:33.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.168+0000 7f0cf6494700 1 -- start start 2023-09-30T22:34:33.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.169+0000 7f0cf6494700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf006c0e0 0x7f0cf011a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.169+0000 7f0cf6494700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf0134ec0 0x7f0cf011ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.169+0000 7f0cf6494700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf01380f0 0x7f0cf011b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.169+0000 7f0cf6494700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf011dbd0 con 0x7f0cf006c0e0 2023-09-30T22:34:33.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.169+0000 7f0cf6494700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf011ddb0 con 0x7f0cf01380f0 2023-09-30T22:34:33.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.169+0000 7f0cf6494700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf011bf40 con 0x7f0cf0134ec0 2023-09-30T22:34:33.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.169+0000 7f0cf4a31700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf01380f0 0x7f0cf011b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.169+0000 7f0cf4a31700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf01380f0 0x7f0cf011b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51756/0 (socket says 172.21.15.59:51756) 2023-09-30T22:34:33.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.169+0000 7f0ceffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf006c0e0 0x7f0cf011a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.169+0000 7f0cf4a31700 1 -- 172.21.15.59:0/4120938788 learned_addr learned my addr 172.21.15.59:0/4120938788 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:33.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.169+0000 7f0cef7fe700 1 --2- 172.21.15.59:0/4120938788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf0134ec0 0x7f0cf011ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.170+0000 7f0cf4a31700 1 -- 172.21.15.59:0/4120938788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf0134ec0 msgr2=0x7f0cf011ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.170+0000 7f0cf4a31700 1 --2- 172.21.15.59:0/4120938788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf0134ec0 0x7f0cf011ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.170+0000 7f0cf4a31700 1 -- 172.21.15.59:0/4120938788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf006c0e0 msgr2=0x7f0cf011a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.170+0000 7f0cf4a31700 1 --2- 172.21.15.59:0/4120938788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf006c0e0 0x7f0cf011a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.170+0000 7f0cf4a31700 1 -- 172.21.15.59:0/4120938788 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce0009550 con 0x7f0cf01380f0 2023-09-30T22:34:33.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.170+0000 7f0cef7fe700 1 --2- 172.21.15.59:0/4120938788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf0134ec0 0x7f0cf011ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:33.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.170+0000 7f0cf4a31700 1 --2- 172.21.15.59:0/4120938788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf01380f0 0x7f0cf011b370 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8014040 tx=0x7f0ce8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:33.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.170+0000 7f0cecff9700 1 -- 172.21.15.59:0/4120938788 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8012430 con 0x7f0cf01380f0 2023-09-30T22:34:33.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.170+0000 7f0cf6494700 1 -- 172.21.15.59:0/4120938788 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce8009a70 con 0x7f0cf01380f0 2023-09-30T22:34:33.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.170+0000 7f0cecff9700 1 -- 172.21.15.59:0/4120938788 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce8020070 con 0x7f0cf01380f0 2023-09-30T22:34:33.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.170+0000 7f0cecff9700 1 -- 172.21.15.59:0/4120938788 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8004280 con 0x7f0cf01380f0 2023-09-30T22:34:33.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.171+0000 7f0cf6494700 1 -- 172.21.15.59:0/4120938788 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf011c620 con 0x7f0cf01380f0 2023-09-30T22:34:33.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.172+0000 7f0cecff9700 1 -- 172.21.15.59:0/4120938788 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ce80043e0 con 0x7f0cf01380f0 2023-09-30T22:34:33.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.172+0000 7f0cf6494700 1 -- 172.21.15.59:0/4120938788 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf0074ea0 con 0x7f0cf01380f0 2023-09-30T22:34:33.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.172+0000 7f0cecff9700 1 -- 172.21.15.59:0/4120938788 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0ce8022070 con 0x7f0cf01380f0 2023-09-30T22:34:33.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.177+0000 7f0cecff9700 1 -- 172.21.15.59:0/4120938788 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ce801b400 con 0x7f0cf01380f0 2023-09-30T22:34:33.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.208+0000 7fdba5414700 1 Processor -- start 2023-09-30T22:34:33.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.208+0000 7fdba5414700 1 -- start start 2023-09-30T22:34:33.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.209+0000 7fdba5414700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba006cc90 0x7fdba00a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.209+0000 7fdba5414700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdba00a13e0 0x7fdba013f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.209+0000 7fdba5414700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba00a1850 con 0x7fdba00a0f70 2023-09-30T22:34:33.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.209+0000 7fdba5414700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba00a2550 con 0x7fdba00a13e0 2023-09-30T22:34:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.209+0000 7fdba5414700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba00a1e00 con 0x7fdba006cc90 2023-09-30T22:34:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.209+0000 7fdb9effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba006cc90 0x7fdba00a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.209+0000 7fdb9f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdba00a13e0 0x7fdba013f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.209+0000 7fdb9effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba006cc90 0x7fdba00a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51760/0 (socket says 172.21.15.59:51760) 2023-09-30T22:34:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.209+0000 7fdb9f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdba00a13e0 0x7fdba013f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48664/0 (socket says 172.21.15.59:48664) 2023-09-30T22:34:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.209+0000 7fdb9effd700 1 -- 172.21.15.59:0/231744426 learned_addr learned my addr 172.21.15.59:0/231744426 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:33.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.210+0000 7fdb9f7fe700 1 -- 172.21.15.59:0/231744426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba006cc90 msgr2=0x7fdba00a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:33.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.210+0000 7fdb9f7fe700 1 --2- 172.21.15.59:0/231744426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba006cc90 0x7fdba00a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.210+0000 7fdb9f7fe700 1 -- 172.21.15.59:0/231744426 >> v1:172.21.15.59:6789/0 conn(0x7fdba00a0f70 legacy=0x7fdba013c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.210+0000 7fdb9f7fe700 1 -- 172.21.15.59:0/231744426 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba009cfa0 con 0x7fdba00a13e0 2023-09-30T22:34:33.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.210+0000 7fdb9f7fe700 1 --2- 172.21.15.59:0/231744426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba00a13e0 0x7fdba013f850 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009d90 tx=0x7fdb9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18353070375584c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:33.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.210+0000 7fdb9e7fc700 1 -- 172.21.15.59:0/231744426 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9800e070 con 0x7fdba00a13e0 2023-09-30T22:34:33.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.210+0000 7fdb9e7fc700 1 -- 172.21.15.59:0/231744426 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9800bb20 con 0x7fdba00a13e0 2023-09-30T22:34:33.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.210+0000 7fdb9e7fc700 1 -- 172.21.15.59:0/231744426 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98012430 con 0x7fdba00a13e0 2023-09-30T22:34:33.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.211+0000 7fdba5414700 1 -- 172.21.15.59:0/231744426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba00a13e0 msgr2=0x7fdba013f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.211+0000 7fdba5414700 1 --2- 172.21.15.59:0/231744426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba00a13e0 0x7fdba013f850 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009d90 tx=0x7fdb9800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:33.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.211+0000 7fdba5414700 1 -- 172.21.15.59:0/231744426 shutdown_connections 2023-09-30T22:34:33.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.211+0000 7fdba5414700 1 --2- 172.21.15.59:0/231744426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba00a13e0 0x7fdba013f850 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.211+0000 7fdba5414700 1 --2- 172.21.15.59:0/231744426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba006cc90 0x7fdba00a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.211+0000 7fdba5414700 1 -- 172.21.15.59:0/231744426 >> 172.21.15.59:0/231744426 conn(0x7fdba00a3050 msgr2=0x7fdba00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:33.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.211+0000 7fdba5414700 1 -- 172.21.15.59:0/231744426 shutdown_connections 2023-09-30T22:34:33.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.212+0000 7fdba5414700 1 -- 172.21.15.59:0/231744426 wait complete. 2023-09-30T22:34:33.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.213+0000 7fdba5414700 1 Processor -- start 2023-09-30T22:34:33.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.213+0000 7fdba5414700 1 -- start start 2023-09-30T22:34:33.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdba5414700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba006cc90 0x7fdba01a9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdba5414700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdba00a0f70 0x7fdba01aa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdba5414700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba00a13e0 0x7fdba01aa760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:33.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdba5414700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba0071770 con 0x7fdba006cc90 2023-09-30T22:34:33.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdba5414700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba01ac610 con 0x7fdba00a13e0 2023-09-30T22:34:33.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdba5414700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdba009b8e0 con 0x7fdba00a0f70 2023-09-30T22:34:33.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdb9effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba006cc90 0x7fdba01a9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdb9effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba006cc90 0x7fdba01a9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48674/0 (socket says 172.21.15.59:48674) 2023-09-30T22:34:33.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdb9effd700 1 -- 172.21.15.59:0/350946913 learned_addr learned my addr 172.21.15.59:0/350946913 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:33.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdb97fff700 1 --2- 172.21.15.59:0/350946913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdba00a0f70 0x7fdba01aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdb9f7fe700 1 --2- 172.21.15.59:0/350946913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba00a13e0 0x7fdba01aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:33.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdb9effd700 1 -- 172.21.15.59:0/350946913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdba00a0f70 msgr2=0x7fdba01aa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdb9effd700 1 --2- 172.21.15.59:0/350946913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdba00a0f70 0x7fdba01aa220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdb9effd700 1 -- 172.21.15.59:0/350946913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba00a13e0 msgr2=0x7fdba01aa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdb9effd700 1 --2- 172.21.15.59:0/350946913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba00a13e0 0x7fdba01aa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdb9effd700 1 -- 172.21.15.59:0/350946913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb98009a70 con 0x7fdba006cc90 2023-09-30T22:34:33.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdb9f7fe700 1 --2- 172.21.15.59:0/350946913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba00a13e0 0x7fdba01aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:34:33.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.214+0000 7fdb9effd700 1 --2- 172.21.15.59:0/350946913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba006cc90 0x7fdba01a9ce0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000e8b0 tx=0x7fdb9000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:33.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.215+0000 7fdb977fe700 1 -- 172.21.15.59:0/350946913 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90009600 con 0x7fdba006cc90 2023-09-30T22:34:33.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.215+0000 7fdb977fe700 1 -- 172.21.15.59:0/350946913 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb90013680 con 0x7fdba006cc90 2023-09-30T22:34:33.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.215+0000 7fdba5414700 1 -- 172.21.15.59:0/350946913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba00a0070 con 0x7fdba006cc90 2023-09-30T22:34:33.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.215+0000 7fdb977fe700 1 -- 172.21.15.59:0/350946913 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90013a30 con 0x7fdba006cc90 2023-09-30T22:34:33.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.215+0000 7fdba5414700 1 -- 172.21.15.59:0/350946913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba0070de0 con 0x7fdba006cc90 2023-09-30T22:34:33.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.216+0000 7fdb977fe700 1 -- 172.21.15.59:0/350946913 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb90013b90 con 0x7fdba006cc90 2023-09-30T22:34:33.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.216+0000 7fdba5414700 1 -- 172.21.15.59:0/350946913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb840052e0 con 0x7fdba006cc90 2023-09-30T22:34:33.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.216+0000 7fdb977fe700 1 -- 172.21.15.59:0/350946913 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb9003f600 con 0x7fdba006cc90 2023-09-30T22:34:33.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.221+0000 7fdb977fe700 1 -- 172.21.15.59:0/350946913 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb9000c480 con 0x7fdba006cc90 2023-09-30T22:34:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.290+0000 7f9de24f3700 1 -- 172.21.15.59:0/1033732480 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9ddc1223e0 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.291+0000 7f9dd8ff9700 1 -- 172.21.15.59:0/1033732480 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9dd0015030 con 0x7f9ddc09e1d0 2023-09-30T22:34:33.291 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.294+0000 7f9de24f3700 1 -- 172.21.15.59:0/1033732480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ddc09e1d0 msgr2=0x7f9ddc11f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.294+0000 7f9de24f3700 1 --2- 172.21.15.59:0/1033732480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ddc09e1d0 0x7f9ddc11f910 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009920 tx=0x7f9dd0004750 comp rx=0 tx=0).stop 2023-09-30T22:34:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.294+0000 7f9de24f3700 1 -- 172.21.15.59:0/1033732480 shutdown_connections 2023-09-30T22:34:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.294+0000 7f9de24f3700 1 --2- 172.21.15.59:0/1033732480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ddc09d6f0 0x7f9ddc11f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.294+0000 7f9de24f3700 1 --2- 172.21.15.59:0/1033732480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ddc139170 0x7f9ddc1c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.294+0000 7f9de24f3700 1 --2- 172.21.15.59:0/1033732480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ddc09e1d0 0x7f9ddc11f910 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.294+0000 7f9de24f3700 1 -- 172.21.15.59:0/1033732480 >> 172.21.15.59:0/1033732480 conn(0x7f9ddc066f50 msgr2=0x7f9ddc136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.294+0000 7f9de24f3700 1 -- 172.21.15.59:0/1033732480 shutdown_connections 2023-09-30T22:34:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.294+0000 7f9de24f3700 1 -- 172.21.15.59:0/1033732480 wait complete. 2023-09-30T22:34:33.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:33.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.357+0000 7f1e580f5700 1 -- 172.21.15.59:0/4154682558 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1e50122070 con 0x7f1e5009de50 2023-09-30T22:34:33.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.358+0000 7f1e467fc700 1 -- 172.21.15.59:0/4154682558 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e50122070 con 0x7f1e5009de50 2023-09-30T22:34:33.358 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:33.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.360+0000 7f1e580f5700 1 -- 172.21.15.59:0/4154682558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5009de50 msgr2=0x7f1e5011e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.360+0000 7f1e580f5700 1 --2- 172.21.15.59:0/4154682558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5009de50 0x7f1e5011e9d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00e9b0 tx=0x7f1e4c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.360+0000 7f1e580f5700 1 -- 172.21.15.59:0/4154682558 shutdown_connections 2023-09-30T22:34:33.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.360+0000 7f1e580f5700 1 --2- 172.21.15.59:0/4154682558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e5009de50 0x7f1e5011e9d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.360+0000 7f1e580f5700 1 --2- 172.21.15.59:0/4154682558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e501338a0 0x7f1e5011f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.360+0000 7f1e580f5700 1 --2- 172.21.15.59:0/4154682558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e5009e760 0x7f1e5011ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.360+0000 7f1e580f5700 1 -- 172.21.15.59:0/4154682558 >> 172.21.15.59:0/4154682558 conn(0x7f1e500a2aa0 msgr2=0x7f1e5009ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:33.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.360+0000 7f1e580f5700 1 -- 172.21.15.59:0/4154682558 shutdown_connections 2023-09-30T22:34:33.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.360+0000 7f1e580f5700 1 -- 172.21.15.59:0/4154682558 wait complete. 2023-09-30T22:34:33.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:33.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.389+0000 7f0cf6494700 1 -- 172.21.15.59:0/4120938788 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0cf006b250 con 0x7f0cf01380f0 2023-09-30T22:34:33.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.389+0000 7f0cecff9700 1 -- 172.21.15.59:0/4120938788 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ce802c070 con 0x7f0cf01380f0 2023-09-30T22:34:33.390 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.393+0000 7f0cf6494700 1 -- 172.21.15.59:0/4120938788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf01380f0 msgr2=0x7f0cf011b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.393+0000 7f0cf6494700 1 --2- 172.21.15.59:0/4120938788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf01380f0 0x7f0cf011b370 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8014040 tx=0x7f0ce8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.393+0000 7f0cf6494700 1 -- 172.21.15.59:0/4120938788 shutdown_connections 2023-09-30T22:34:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.393+0000 7f0cf6494700 1 --2- 172.21.15.59:0/4120938788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf01380f0 0x7f0cf011b370 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.393+0000 7f0cf6494700 1 --2- 172.21.15.59:0/4120938788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf006c0e0 0x7f0cf011a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.393+0000 7f0cf6494700 1 --2- 172.21.15.59:0/4120938788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf0134ec0 0x7f0cf011ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.393+0000 7f0cf6494700 1 -- 172.21.15.59:0/4120938788 >> 172.21.15.59:0/4120938788 conn(0x7f0cf00a4210 msgr2=0x7f0cf0099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:33.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.393+0000 7f0cf6494700 1 -- 172.21.15.59:0/4120938788 shutdown_connections 2023-09-30T22:34:33.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.393+0000 7f0cf6494700 1 -- 172.21.15.59:0/4120938788 wait complete. 2023-09-30T22:34:33.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:33.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.432+0000 7fdba5414700 1 -- 172.21.15.59:0/350946913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb84005590 con 0x7fdba006cc90 2023-09-30T22:34:33.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.432+0000 7fdb977fe700 1 -- 172.21.15.59:0/350946913 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb90021030 con 0x7fdba006cc90 2023-09-30T22:34:33.432 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:33.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.434+0000 7fdba5414700 1 -- 172.21.15.59:0/350946913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba006cc90 msgr2=0x7fdba01a9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:33.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.434+0000 7fdba5414700 1 --2- 172.21.15.59:0/350946913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba006cc90 0x7fdba01a9ce0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000e8b0 tx=0x7fdb9000ebc0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.434+0000 7fdba5414700 1 -- 172.21.15.59:0/350946913 shutdown_connections 2023-09-30T22:34:33.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.434+0000 7fdba5414700 1 --2- 172.21.15.59:0/350946913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba00a13e0 0x7fdba01aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.434+0000 7fdba5414700 1 --2- 172.21.15.59:0/350946913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba006cc90 0x7fdba01a9ce0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.434+0000 7fdba5414700 1 --2- 172.21.15.59:0/350946913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdba00a0f70 0x7fdba01aa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:33.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.434+0000 7fdba5414700 1 -- 172.21.15.59:0/350946913 >> 172.21.15.59:0/350946913 conn(0x7fdba00a3050 msgr2=0x7fdba01c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:33.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.434+0000 7fdba5414700 1 -- 172.21.15.59:0/350946913 shutdown_connections 2023-09-30T22:34:33.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:33.434+0000 7fdba5414700 1 -- 172.21.15.59:0/350946913 wait complete. 2023-09-30T22:34:33.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:34.314 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:34.375 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:34.408 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:34.449 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.462+0000 7f123a0f2700 1 Processor -- start 2023-09-30T22:34:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.462+0000 7f123a0f2700 1 -- start start 2023-09-30T22:34:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.463+0000 7f123a0f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12340a1510 0x7f1234138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.463+0000 7f123a0f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1234139250 0x7f123413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.463+0000 7f123a0f2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123409edd0 con 0x7f12340a0a30 2023-09-30T22:34:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.463+0000 7f123a0f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12340a18e0 con 0x7f12340a1510 2023-09-30T22:34:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.463+0000 7f123a0f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f123409e1f0 con 0x7f1234139250 2023-09-30T22:34:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.463+0000 7f12337fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f12340a0a30 0x7f12340a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34454/0 (socket says 172.21.15.59:34454) 2023-09-30T22:34:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.463+0000 7f12337fe700 1 -- 172.21.15.59:0/3458398343 learned_addr learned my addr 172.21.15.59:0/3458398343 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:34.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.463+0000 7f1232ffd700 1 --2- 172.21.15.59:0/3458398343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12340a1510 0x7f1234138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.463+0000 7f1233fff700 1 --2- 172.21.15.59:0/3458398343 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1234139250 0x7f123413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.464+0000 7f1232ffd700 1 -- 172.21.15.59:0/3458398343 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1234139250 msgr2=0x7f123413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:34.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.464+0000 7f1232ffd700 1 --2- 172.21.15.59:0/3458398343 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1234139250 0x7f123413b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.464+0000 7f1232ffd700 1 -- 172.21.15.59:0/3458398343 >> v1:172.21.15.59:6789/0 conn(0x7f12340a0a30 legacy=0x7f12340a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.464+0000 7f1232ffd700 1 -- 172.21.15.59:0/3458398343 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123409dc50 con 0x7f12340a1510 2023-09-30T22:34:34.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.464+0000 7f1232ffd700 1 --2- 172.21.15.59:0/3458398343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12340a1510 0x7f1234138d10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1228009870 tx=0x7f1228009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49823310dfc5c7ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:34.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.464+0000 7f12327fc700 1 -- 172.21.15.59:0/3458398343 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228004230 con 0x7f12340a1510 2023-09-30T22:34:34.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.464+0000 7f12327fc700 1 -- 172.21.15.59:0/3458398343 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1228004390 con 0x7f12340a1510 2023-09-30T22:34:34.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.464+0000 7f12327fc700 1 -- 172.21.15.59:0/3458398343 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12280036a0 con 0x7f12340a1510 2023-09-30T22:34:34.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.465+0000 7f123a0f2700 1 -- 172.21.15.59:0/3458398343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12340a1510 msgr2=0x7f1234138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.465+0000 7f123a0f2700 1 --2- 172.21.15.59:0/3458398343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12340a1510 0x7f1234138d10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1228009870 tx=0x7f1228009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:34.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.465+0000 7f123a0f2700 1 -- 172.21.15.59:0/3458398343 shutdown_connections 2023-09-30T22:34:34.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.465+0000 7f123a0f2700 1 --2- 172.21.15.59:0/3458398343 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1234139250 0x7f123413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.465+0000 7f123a0f2700 1 --2- 172.21.15.59:0/3458398343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12340a1510 0x7f1234138d10 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.465+0000 7f123a0f2700 1 -- 172.21.15.59:0/3458398343 >> 172.21.15.59:0/3458398343 conn(0x7f12340a6550 msgr2=0x7f12340a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:34.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.465+0000 7f123a0f2700 1 -- 172.21.15.59:0/3458398343 shutdown_connections 2023-09-30T22:34:34.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.466+0000 7f123a0f2700 1 -- 172.21.15.59:0/3458398343 wait complete. 2023-09-30T22:34:34.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.467+0000 7f123a0f2700 1 Processor -- start 2023-09-30T22:34:34.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.467+0000 7f123a0f2700 1 -- start start 2023-09-30T22:34:34.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.468+0000 7f123a0f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12340a0a30 0x7f12341c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.468+0000 7f123a0f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12340a1510 0x7f12341c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.468+0000 7f123a0f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1234139250 0x7f12341c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.468+0000 7f123a0f2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1234124860 con 0x7f1234139250 2023-09-30T22:34:34.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.468+0000 7f123a0f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1234125350 con 0x7f12340a1510 2023-09-30T22:34:34.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.468+0000 7f123a0f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12341265f0 con 0x7f12340a0a30 2023-09-30T22:34:34.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.468+0000 7f1232ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12340a1510 0x7f12341c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.468+0000 7f1232ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12340a1510 0x7f12341c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36126/0 (socket says 172.21.15.59:36126) 2023-09-30T22:34:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.468+0000 7f1232ffd700 1 -- 172.21.15.59:0/3321422437 learned_addr learned my addr 172.21.15.59:0/3321422437 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.468+0000 7f1233fff700 1 --2- 172.21.15.59:0/3321422437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1234139250 0x7f12341c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.468+0000 7f12337fe700 1 --2- 172.21.15.59:0/3321422437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12340a0a30 0x7f12341c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.469+0000 7f1233fff700 1 -- 172.21.15.59:0/3321422437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12340a0a30 msgr2=0x7f12341c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.469+0000 7f1233fff700 1 --2- 172.21.15.59:0/3321422437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12340a0a30 0x7f12341c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.469+0000 7f1233fff700 1 -- 172.21.15.59:0/3321422437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12340a1510 msgr2=0x7f12341c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.469+0000 7f1233fff700 1 --2- 172.21.15.59:0/3321422437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12340a1510 0x7f12341c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.469+0000 7f1233fff700 1 -- 172.21.15.59:0/3321422437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12280094a0 con 0x7f1234139250 2023-09-30T22:34:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.469+0000 7f1232ffd700 1 --2- 172.21.15.59:0/3321422437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12340a1510 0x7f12341c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.469+0000 7f1233fff700 1 --2- 172.21.15.59:0/3321422437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1234139250 0x7f12341c8ec0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f122c00e880 tx=0x7f122c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.469+0000 7f121bfff700 1 -- 172.21.15.59:0/3321422437 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c013680 con 0x7f1234139250 2023-09-30T22:34:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.469+0000 7f121bfff700 1 -- 172.21.15.59:0/3321422437 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c0137e0 con 0x7f1234139250 2023-09-30T22:34:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.469+0000 7f123a0f2700 1 -- 172.21.15.59:0/3321422437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1234138cd0 con 0x7f1234139250 2023-09-30T22:34:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.469+0000 7f121bfff700 1 -- 172.21.15.59:0/3321422437 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c013b90 con 0x7f1234139250 2023-09-30T22:34:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.469+0000 7f123a0f2700 1 -- 172.21.15.59:0/3321422437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12340a0280 con 0x7f1234139250 2023-09-30T22:34:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.470+0000 7f123a0f2700 1 -- 172.21.15.59:0/3321422437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1234126430 con 0x7f1234139250 2023-09-30T22:34:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.471+0000 7f121bfff700 1 -- 172.21.15.59:0/3321422437 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f122c013cf0 con 0x7f1234139250 2023-09-30T22:34:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.471+0000 7f121bfff700 1 -- 172.21.15.59:0/3321422437 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f122c03fab0 con 0x7f1234139250 2023-09-30T22:34:34.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.480+0000 7f121bfff700 1 -- 172.21.15.59:0/3321422437 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f122c011ba0 con 0x7f1234139250 2023-09-30T22:34:34.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.525+0000 7fc33f496700 1 Processor -- start 2023-09-30T22:34:34.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.525+0000 7fc33f496700 1 -- start start 2023-09-30T22:34:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.526+0000 7fc33f496700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc338133540 0x7fc338135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.526+0000 7fc33f496700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc338135e60 0x7fc338138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.526+0000 7fc33f496700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3380716a0 con 0x7fc338130540 2023-09-30T22:34:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.526+0000 7fc33f496700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc338071290 con 0x7fc338133540 2023-09-30T22:34:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.526+0000 7fc33f496700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc338130340 con 0x7fc338135e60 2023-09-30T22:34:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.526+0000 7fc33ca31700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc338133540 0x7fc338135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.526+0000 7fc33ca31700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc338133540 0x7fc338135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52930/0 (socket says 172.21.15.59:52930) 2023-09-30T22:34:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.526+0000 7fc33ca31700 1 -- 172.21.15.59:0/3721546006 learned_addr learned my addr 172.21.15.59:0/3721546006 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.526+0000 7fc33da33700 1 --2- 172.21.15.59:0/3721546006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc338135e60 0x7fc338138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.526+0000 7fc33ca31700 1 -- 172.21.15.59:0/3721546006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc338135e60 msgr2=0x7fc338138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.526+0000 7fc33ca31700 1 --2- 172.21.15.59:0/3721546006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc338135e60 0x7fc338138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.526+0000 7fc33ca31700 1 -- 172.21.15.59:0/3721546006 >> v1:172.21.15.59:6789/0 conn(0x7fc338130540 legacy=0x7fc338130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.526+0000 7fc33ca31700 1 -- 172.21.15.59:0/3721546006 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338070b80 con 0x7fc338133540 2023-09-30T22:34:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.527+0000 7fc33ca31700 1 --2- 172.21.15.59:0/3721546006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc338133540 0x7fc338135920 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fc3280098f0 tx=0x7fc328009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecfff38d7ba194a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.527+0000 7fc32ffff700 1 -- 172.21.15.59:0/3721546006 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328011830 con 0x7fc338133540 2023-09-30T22:34:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.527+0000 7fc32ffff700 1 -- 172.21.15.59:0/3721546006 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc328011990 con 0x7fc338133540 2023-09-30T22:34:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.527+0000 7fc32ffff700 1 -- 172.21.15.59:0/3721546006 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328011d20 con 0x7fc338133540 2023-09-30T22:34:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.528+0000 7fc33f496700 1 -- 172.21.15.59:0/3721546006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc338133540 msgr2=0x7fc338135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.528+0000 7fc33f496700 1 --2- 172.21.15.59:0/3721546006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc338133540 0x7fc338135920 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fc3280098f0 tx=0x7fc328009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.528+0000 7fc33f496700 1 -- 172.21.15.59:0/3721546006 shutdown_connections 2023-09-30T22:34:34.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.528+0000 7fc33f496700 1 --2- 172.21.15.59:0/3721546006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc338135e60 0x7fc338138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.528+0000 7fc33f496700 1 --2- 172.21.15.59:0/3721546006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc338133540 0x7fc338135920 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.528+0000 7fc33f496700 1 -- 172.21.15.59:0/3721546006 >> 172.21.15.59:0/3721546006 conn(0x7fc3380a2aa0 msgr2=0x7fc3380a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:34.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.528+0000 7fc33f496700 1 -- 172.21.15.59:0/3721546006 shutdown_connections 2023-09-30T22:34:34.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.528+0000 7fc33f496700 1 -- 172.21.15.59:0/3721546006 wait complete. 2023-09-30T22:34:34.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.529+0000 7fc33f496700 1 Processor -- start 2023-09-30T22:34:34.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.529+0000 7fc33f496700 1 -- start start 2023-09-30T22:34:34.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33f496700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc338130540 0x7fc33809a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33f496700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc338133540 0x7fc33809aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33f496700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc338135e60 0x7fc33809b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33f496700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc338139250 con 0x7fc338133540 2023-09-30T22:34:34.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33f496700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33809c8b0 con 0x7fc338130540 2023-09-30T22:34:34.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33f496700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380718e0 con 0x7fc338135e60 2023-09-30T22:34:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33da33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc338135e60 0x7fc33809b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33da33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc338135e60 0x7fc33809b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49158/0 (socket says 172.21.15.59:49158) 2023-09-30T22:34:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33da33700 1 -- 172.21.15.59:0/3565795868 learned_addr learned my addr 172.21.15.59:0/3565795868 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33d232700 1 --2- 172.21.15.59:0/3565795868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc338130540 0x7fc33809a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33ca31700 1 --2- 172.21.15.59:0/3565795868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc338133540 0x7fc33809aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33da33700 1 -- 172.21.15.59:0/3565795868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc338130540 msgr2=0x7fc33809a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33da33700 1 --2- 172.21.15.59:0/3565795868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc338130540 0x7fc33809a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33da33700 1 -- 172.21.15.59:0/3565795868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc338133540 msgr2=0x7fc33809aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33da33700 1 --2- 172.21.15.59:0/3565795868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc338133540 0x7fc33809aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.530+0000 7fc33da33700 1 -- 172.21.15.59:0/3565795868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328009550 con 0x7fc338135e60 2023-09-30T22:34:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.531+0000 7fc33da33700 1 --2- 172.21.15.59:0/3565795868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc338135e60 0x7fc33809b010 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc33000efc0 tx=0x7fc33000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:34.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.531+0000 7fc32dffb700 1 -- 172.21.15.59:0/3565795868 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33000cc90 con 0x7fc338135e60 2023-09-30T22:34:34.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.531+0000 7fc32dffb700 1 -- 172.21.15.59:0/3565795868 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33000f040 con 0x7fc338135e60 2023-09-30T22:34:34.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.531+0000 7fc32dffb700 1 -- 172.21.15.59:0/3565795868 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc330013800 con 0x7fc338135e60 2023-09-30T22:34:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.531+0000 7fc33f496700 1 -- 172.21.15.59:0/3565795868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc338138cb0 con 0x7fc338135e60 2023-09-30T22:34:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.532+0000 7fc33f496700 1 -- 172.21.15.59:0/3565795868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc338138210 con 0x7fc338135e60 2023-09-30T22:34:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.533+0000 7fc33f496700 1 -- 172.21.15.59:0/3565795868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc338074ea0 con 0x7fc338135e60 2023-09-30T22:34:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.533+0000 7fc32dffb700 1 -- 172.21.15.59:0/3565795868 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc330013960 con 0x7fc338135e60 2023-09-30T22:34:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.533+0000 7fc32dffb700 1 -- 172.21.15.59:0/3565795868 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc330043ca0 con 0x7fc338135e60 2023-09-30T22:34:34.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.543+0000 7fc32dffb700 1 -- 172.21.15.59:0/3565795868 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc330007920 con 0x7fc338135e60 2023-09-30T22:34:34.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.568+0000 7f5dd19e3700 1 Processor -- start 2023-09-30T22:34:34.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.568+0000 7f5dd19e3700 1 -- start start 2023-09-30T22:34:34.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.569+0000 7f5dd19e3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5dcc09d6f0 0x7f5dcc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.569+0000 7f5dd19e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dcc09e440 0x7f5dcc134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.569+0000 7f5dd19e3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dcc09b120 con 0x7f5dcc09e000 2023-09-30T22:34:34.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.569+0000 7f5dd19e3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dcc06b460 con 0x7f5dcc09d6f0 2023-09-30T22:34:34.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.569+0000 7f5dd19e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc09a7e0 con 0x7f5dcc09e440 2023-09-30T22:34:34.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.569+0000 7f5dcaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5dcc09d6f0 0x7f5dcc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.569+0000 7f5dcaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5dcc09d6f0 0x7f5dcc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52946/0 (socket says 172.21.15.59:52946) 2023-09-30T22:34:34.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.569+0000 7f5dcaffd700 1 -- 172.21.15.59:0/1652724352 learned_addr learned my addr 172.21.15.59:0/1652724352 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:34.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.569+0000 7f5dcb7fe700 1 --2- 172.21.15.59:0/1652724352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dcc09e440 0x7f5dcc134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.569+0000 7f5dca7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5dcc09e000 0x7f5dcc1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34472/0 (socket says 172.21.15.59:34472) 2023-09-30T22:34:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.570+0000 7f5dcb7fe700 1 -- 172.21.15.59:0/1652724352 >> v2:172.21.15.59:3300/0 conn(0x7f5dcc09d6f0 msgr2=0x7f5dcc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.570+0000 7f5dcb7fe700 1 --2- 172.21.15.59:0/1652724352 >> v2:172.21.15.59:3300/0 conn(0x7f5dcc09d6f0 0x7f5dcc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.570+0000 7f5dcb7fe700 1 -- 172.21.15.59:0/1652724352 >> v1:172.21.15.59:6789/0 conn(0x7f5dcc09e000 legacy=0x7f5dcc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.570+0000 7f5dcb7fe700 1 -- 172.21.15.59:0/1652724352 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc09a500 con 0x7f5dcc09e440 2023-09-30T22:34:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.570+0000 7f5dcaffd700 1 --2- 172.21.15.59:0/1652724352 >> v2:172.21.15.59:3300/0 conn(0x7f5dcc09d6f0 0x7f5dcc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.570+0000 7f5dcb7fe700 1 --2- 172.21.15.59:0/1652724352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dcc09e440 0x7f5dcc134100 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009dc0 tx=0x7f5dc400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d523b82ae394a88c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.570+0000 7f5dc9ffb700 1 -- 172.21.15.59:0/1652724352 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc400e070 con 0x7f5dcc09e440 2023-09-30T22:34:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.570+0000 7f5dc9ffb700 1 -- 172.21.15.59:0/1652724352 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc400bae0 con 0x7f5dcc09e440 2023-09-30T22:34:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.570+0000 7f5dc9ffb700 1 -- 172.21.15.59:0/1652724352 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc400be90 con 0x7f5dcc09e440 2023-09-30T22:34:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.571+0000 7f5dd19e3700 1 -- 172.21.15.59:0/1652724352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dcc09e440 msgr2=0x7f5dcc134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.571+0000 7f5dd19e3700 1 --2- 172.21.15.59:0/1652724352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dcc09e440 0x7f5dcc134100 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009dc0 tx=0x7f5dc400b330 comp rx=0 tx=0).stop 2023-09-30T22:34:34.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.571+0000 7f5dd19e3700 1 -- 172.21.15.59:0/1652724352 shutdown_connections 2023-09-30T22:34:34.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.571+0000 7f5dd19e3700 1 --2- 172.21.15.59:0/1652724352 >> v2:172.21.15.59:3300/0 conn(0x7f5dcc09d6f0 0x7f5dcc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.571+0000 7f5dd19e3700 1 --2- 172.21.15.59:0/1652724352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dcc09e440 0x7f5dcc134100 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.571+0000 7f5dd19e3700 1 -- 172.21.15.59:0/1652724352 >> 172.21.15.59:0/1652724352 conn(0x7f5dcc066f50 msgr2=0x7f5dcc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:34.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.571+0000 7f5dd19e3700 1 -- 172.21.15.59:0/1652724352 shutdown_connections 2023-09-30T22:34:34.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.572+0000 7f5dd19e3700 1 -- 172.21.15.59:0/1652724352 wait complete. 2023-09-30T22:34:34.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.573+0000 7f5dd19e3700 1 Processor -- start 2023-09-30T22:34:34.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.573+0000 7f5dd19e3700 1 -- start start 2023-09-30T22:34:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.574+0000 7f5dd19e3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dcc09d6f0 0x7f5dcc1a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.574+0000 7f5dd19e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dcc09e000 0x7f5dcc1a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.574+0000 7f5dd19e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dcc09e440 0x7f5dcc1a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.574+0000 7f5dd19e3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc1aa360 con 0x7f5dcc09e440 2023-09-30T22:34:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.574+0000 7f5dd19e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc1a99a0 con 0x7f5dcc09e000 2023-09-30T22:34:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.574+0000 7f5dd19e3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc1a8ce0 con 0x7f5dcc09d6f0 2023-09-30T22:34:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.574+0000 7f5dcaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dcc09d6f0 0x7f5dcc1a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.574+0000 7f5dcaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dcc09d6f0 0x7f5dcc1a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49162/0 (socket says 172.21.15.59:49162) 2023-09-30T22:34:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.574+0000 7f5dcaffd700 1 -- 172.21.15.59:0/2632216974 learned_addr learned my addr 172.21.15.59:0/2632216974 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.574+0000 7f5dca7fc700 1 --2- 172.21.15.59:0/2632216974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dcc09e000 0x7f5dcc1a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.574+0000 7f5dcb7fe700 1 --2- 172.21.15.59:0/2632216974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dcc09e440 0x7f5dcc1a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.575+0000 7f5dcaffd700 1 -- 172.21.15.59:0/2632216974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dcc09e000 msgr2=0x7f5dcc1a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.575+0000 7f5dcaffd700 1 --2- 172.21.15.59:0/2632216974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dcc09e000 0x7f5dcc1a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.575+0000 7f5dcaffd700 1 -- 172.21.15.59:0/2632216974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dcc09e440 msgr2=0x7f5dcc1a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.575+0000 7f5dcaffd700 1 --2- 172.21.15.59:0/2632216974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dcc09e440 0x7f5dcc1a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.575+0000 7f5dcaffd700 1 -- 172.21.15.59:0/2632216974 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc009550 con 0x7f5dcc09d6f0 2023-09-30T22:34:34.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.575+0000 7f5dcaffd700 1 --2- 172.21.15.59:0/2632216974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dcc09d6f0 0x7f5dcc1a5ed0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00ec10 tx=0x7f5dbc00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:34.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.575+0000 7f5db3fff700 1 -- 172.21.15.59:0/2632216974 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc00c850 con 0x7f5dcc09d6f0 2023-09-30T22:34:34.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.575+0000 7f5db3fff700 1 -- 172.21.15.59:0/2632216974 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc00c9b0 con 0x7f5dcc09d6f0 2023-09-30T22:34:34.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.575+0000 7f5dd19e3700 1 -- 172.21.15.59:0/2632216974 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc4009a70 con 0x7f5dcc09d6f0 2023-09-30T22:34:34.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.575+0000 7f5db3fff700 1 -- 172.21.15.59:0/2632216974 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc00cd20 con 0x7f5dcc09d6f0 2023-09-30T22:34:34.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.575+0000 7f5dd19e3700 1 -- 172.21.15.59:0/2632216974 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dcc1a7a90 con 0x7f5dcc09d6f0 2023-09-30T22:34:34.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.576+0000 7f5db3fff700 1 -- 172.21.15.59:0/2632216974 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5dbc013470 con 0x7f5dcc09d6f0 2023-09-30T22:34:34.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.576+0000 7f5db3fff700 1 -- 172.21.15.59:0/2632216974 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5dbc03fc20 con 0x7f5dcc09d6f0 2023-09-30T22:34:34.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.577+0000 7f5dd19e3700 1 -- 172.21.15.59:0/2632216974 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dcc1a9540 con 0x7f5dcc09d6f0 2023-09-30T22:34:34.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.586+0000 7f5db3fff700 1 -- 172.21.15.59:0/2632216974 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5dbc013720 con 0x7f5dcc09d6f0 2023-09-30T22:34:34.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.619+0000 7f4dd2b0e700 1 Processor -- start 2023-09-30T22:34:34.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.619+0000 7f4dd2b0e700 1 -- start start 2023-09-30T22:34:34.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.620+0000 7f4dd2b0e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dcc12cf60 0x7f4dcc06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.620+0000 7f4dd2b0e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dcc130430 0x7f4dcc137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.620+0000 7f4dd2b0e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dcc12cd90 con 0x7f4dcc12f8b0 2023-09-30T22:34:34.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.620+0000 7f4dd2b0e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc12d330 con 0x7f4dcc130430 2023-09-30T22:34:34.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.620+0000 7f4dd2b0e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc071780 con 0x7f4dcc12cf60 2023-09-30T22:34:34.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.620+0000 7f4dcbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4dcc12f8b0 0x7f4dcc12fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34474/0 (socket says 172.21.15.59:34474) 2023-09-30T22:34:34.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.620+0000 7f4dcbfff700 1 -- 172.21.15.59:0/2030113677 learned_addr learned my addr 172.21.15.59:0/2030113677 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:34.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.620+0000 7f4dd10ab700 1 --2- 172.21.15.59:0/2030113677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dcc130430 0x7f4dcc137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.620+0000 7f4dd08aa700 1 --2- 172.21.15.59:0/2030113677 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dcc12cf60 0x7f4dcc06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.621+0000 7f4dd10ab700 1 -- 172.21.15.59:0/2030113677 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dcc12cf60 msgr2=0x7f4dcc06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:34.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.621+0000 7f4dd10ab700 1 --2- 172.21.15.59:0/2030113677 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dcc12cf60 0x7f4dcc06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.621+0000 7f4dd10ab700 1 -- 172.21.15.59:0/2030113677 >> v1:172.21.15.59:6789/0 conn(0x7f4dcc12f8b0 legacy=0x7f4dcc12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.621+0000 7f4dcb7fe700 1 -- 172.21.15.59:0/2030113677 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320548829 0 0) 0x7f4dcc12cd90 con 0x7f4dcc12f8b0 2023-09-30T22:34:34.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.621+0000 7f4dd10ab700 1 -- 172.21.15.59:0/2030113677 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc071a40 con 0x7f4dcc130430 2023-09-30T22:34:34.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.621+0000 7f4dd10ab700 1 --2- 172.21.15.59:0/2030113677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dcc130430 0x7f4dcc137c30 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009dc0 tx=0x7f4dc400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c21ab6d3c74a6b3a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:34.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.621+0000 7f4dcb7fe700 1 -- 172.21.15.59:0/2030113677 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc400bd20 con 0x7f4dcc130430 2023-09-30T22:34:34.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.621+0000 7f4dcb7fe700 1 -- 172.21.15.59:0/2030113677 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc400be80 con 0x7f4dcc130430 2023-09-30T22:34:34.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.621+0000 7f4dcb7fe700 1 -- 172.21.15.59:0/2030113677 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4010710 con 0x7f4dcc130430 2023-09-30T22:34:34.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.622+0000 7f4dd2b0e700 1 -- 172.21.15.59:0/2030113677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dcc130430 msgr2=0x7f4dcc137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.622+0000 7f4dd2b0e700 1 --2- 172.21.15.59:0/2030113677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dcc130430 0x7f4dcc137c30 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009dc0 tx=0x7f4dc400b330 comp rx=0 tx=0).stop 2023-09-30T22:34:34.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.622+0000 7f4dd2b0e700 1 -- 172.21.15.59:0/2030113677 shutdown_connections 2023-09-30T22:34:34.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.622+0000 7f4dd2b0e700 1 --2- 172.21.15.59:0/2030113677 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dcc12cf60 0x7f4dcc06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.622+0000 7f4dd2b0e700 1 --2- 172.21.15.59:0/2030113677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dcc130430 0x7f4dcc137c30 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.622+0000 7f4dd2b0e700 1 -- 172.21.15.59:0/2030113677 >> 172.21.15.59:0/2030113677 conn(0x7f4dcc0a2aa0 msgr2=0x7f4dcc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:34.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.622+0000 7f4dd2b0e700 1 -- 172.21.15.59:0/2030113677 shutdown_connections 2023-09-30T22:34:34.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.622+0000 7f4dd2b0e700 1 -- 172.21.15.59:0/2030113677 wait complete. 2023-09-30T22:34:34.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.624+0000 7f4dd2b0e700 1 Processor -- start 2023-09-30T22:34:34.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.624+0000 7f4dd2b0e700 1 -- start start 2023-09-30T22:34:34.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.625+0000 7f4dd2b0e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dcc12cf60 0x7f4dcc09bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.625+0000 7f4dd2b0e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dcc12f8b0 0x7f4dcc09c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.625+0000 7f4dd2b0e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dcc130430 0x7f4dcc1c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:34.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.625+0000 7f4dd2b0e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc09eaa0 con 0x7f4dcc130430 2023-09-30T22:34:34.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.625+0000 7f4dd2b0e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc129a00 con 0x7f4dcc12f8b0 2023-09-30T22:34:34.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.625+0000 7f4dd2b0e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc09b7d0 con 0x7f4dcc12cf60 2023-09-30T22:34:34.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.625+0000 7f4dd08aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dcc12cf60 0x7f4dcc09bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.625+0000 7f4dd08aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dcc12cf60 0x7f4dcc09bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49184/0 (socket says 172.21.15.59:49184) 2023-09-30T22:34:34.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.625+0000 7f4dcbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dcc12f8b0 0x7f4dcc09c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.625+0000 7f4dd08aa700 1 -- 172.21.15.59:0/3057273912 learned_addr learned my addr 172.21.15.59:0/3057273912 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:34.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.625+0000 7f4dd10ab700 1 --2- 172.21.15.59:0/3057273912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dcc130430 0x7f4dcc1c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:34.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.626+0000 7f4dd08aa700 1 -- 172.21.15.59:0/3057273912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dcc12f8b0 msgr2=0x7f4dcc09c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.626+0000 7f4dd08aa700 1 --2- 172.21.15.59:0/3057273912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dcc12f8b0 0x7f4dcc09c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.626+0000 7f4dd08aa700 1 -- 172.21.15.59:0/3057273912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dcc130430 msgr2=0x7f4dcc1c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.626+0000 7f4dd08aa700 1 --2- 172.21.15.59:0/3057273912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dcc130430 0x7f4dcc1c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.626+0000 7f4dd08aa700 1 -- 172.21.15.59:0/3057273912 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc4009a70 con 0x7f4dcc12cf60 2023-09-30T22:34:34.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.626+0000 7f4dd08aa700 1 --2- 172.21.15.59:0/3057273912 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dcc12cf60 0x7f4dcc09bbc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000e9b0 tx=0x7f4dc000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:34.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.626+0000 7f4dc97fa700 1 -- 172.21.15.59:0/3057273912 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0009710 con 0x7f4dcc12cf60 2023-09-30T22:34:34.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.626+0000 7f4dc97fa700 1 -- 172.21.15.59:0/3057273912 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc000ee50 con 0x7f4dcc12cf60 2023-09-30T22:34:34.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.626+0000 7f4dc97fa700 1 -- 172.21.15.59:0/3057273912 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000c9f0 con 0x7f4dcc12cf60 2023-09-30T22:34:34.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.626+0000 7f4dd2b0e700 1 -- 172.21.15.59:0/3057273912 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dcc12d820 con 0x7f4dcc12cf60 2023-09-30T22:34:34.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.626+0000 7f4dd2b0e700 1 -- 172.21.15.59:0/3057273912 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dcc09ce70 con 0x7f4dcc12cf60 2023-09-30T22:34:34.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.627+0000 7f4dc97fa700 1 -- 172.21.15.59:0/3057273912 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4dc000cb50 con 0x7f4dcc12cf60 2023-09-30T22:34:34.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.627+0000 7f4dc97fa700 1 -- 172.21.15.59:0/3057273912 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4dc003f850 con 0x7f4dcc12cf60 2023-09-30T22:34:34.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.628+0000 7f4dd2b0e700 1 -- 172.21.15.59:0/3057273912 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dcc074ea0 con 0x7f4dcc12cf60 2023-09-30T22:34:34.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.633+0000 7f4dc97fa700 1 -- 172.21.15.59:0/3057273912 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4dc0021070 con 0x7f4dcc12cf60 2023-09-30T22:34:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.706+0000 7f123a0f2700 1 -- 172.21.15.59:0/3321422437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1234074ea0 con 0x7f1234139250 2023-09-30T22:34:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.706+0000 7f121bfff700 1 -- 172.21.15.59:0/3321422437 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f122c021070 con 0x7f1234139250 2023-09-30T22:34:34.706 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.710+0000 7f123a0f2700 1 -- 172.21.15.59:0/3321422437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1234139250 msgr2=0x7f12341c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.710+0000 7f123a0f2700 1 --2- 172.21.15.59:0/3321422437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1234139250 0x7f12341c8ec0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f122c00e880 tx=0x7f122c00eb90 comp rx=0 tx=0).stop 2023-09-30T22:34:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.710+0000 7f123a0f2700 1 -- 172.21.15.59:0/3321422437 shutdown_connections 2023-09-30T22:34:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.710+0000 7f123a0f2700 1 --2- 172.21.15.59:0/3321422437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12340a0a30 0x7f12341c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.710+0000 7f123a0f2700 1 --2- 172.21.15.59:0/3321422437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1234139250 0x7f12341c8ec0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.710+0000 7f123a0f2700 1 --2- 172.21.15.59:0/3321422437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12340a1510 0x7f12341c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.710+0000 7f123a0f2700 1 -- 172.21.15.59:0/3321422437 >> 172.21.15.59:0/3321422437 conn(0x7f12340a6550 msgr2=0x7f12340a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.711+0000 7f123a0f2700 1 -- 172.21.15.59:0/3321422437 shutdown_connections 2023-09-30T22:34:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.711+0000 7f123a0f2700 1 -- 172.21.15.59:0/3321422437 wait complete. 2023-09-30T22:34:34.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:34.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.759+0000 7fc33f496700 1 -- 172.21.15.59:0/3565795868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc33806b9e0 con 0x7fc338135e60 2023-09-30T22:34:34.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.760+0000 7fc32dffb700 1 -- 172.21.15.59:0/3565795868 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc330020030 con 0x7fc338135e60 2023-09-30T22:34:34.761 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:34.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.763+0000 7fc33f496700 1 -- 172.21.15.59:0/3565795868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc338135e60 msgr2=0x7fc33809b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.763+0000 7fc33f496700 1 --2- 172.21.15.59:0/3565795868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc338135e60 0x7fc33809b010 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc33000efc0 tx=0x7fc33000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.763+0000 7fc33f496700 1 -- 172.21.15.59:0/3565795868 shutdown_connections 2023-09-30T22:34:34.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.763+0000 7fc33f496700 1 --2- 172.21.15.59:0/3565795868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc338135e60 0x7fc33809b010 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.763+0000 7fc33f496700 1 --2- 172.21.15.59:0/3565795868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc338130540 0x7fc33809a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.763+0000 7fc33f496700 1 --2- 172.21.15.59:0/3565795868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc338133540 0x7fc33809aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.763+0000 7fc33f496700 1 -- 172.21.15.59:0/3565795868 >> 172.21.15.59:0/3565795868 conn(0x7fc3380a2aa0 msgr2=0x7fc338131300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:34.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.763+0000 7fc33f496700 1 -- 172.21.15.59:0/3565795868 shutdown_connections 2023-09-30T22:34:34.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.763+0000 7fc33f496700 1 -- 172.21.15.59:0/3565795868 wait complete. 2023-09-30T22:34:34.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:34.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.814+0000 7f5dd19e3700 1 -- 172.21.15.59:0/2632216974 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5dcc09f420 con 0x7f5dcc09d6f0 2023-09-30T22:34:34.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.815+0000 7f5db3fff700 1 -- 172.21.15.59:0/2632216974 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5dbc021030 con 0x7f5dcc09d6f0 2023-09-30T22:34:34.815 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:34.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.817+0000 7f5dd19e3700 1 -- 172.21.15.59:0/2632216974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dcc09d6f0 msgr2=0x7f5dcc1a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.817+0000 7f5dd19e3700 1 --2- 172.21.15.59:0/2632216974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dcc09d6f0 0x7f5dcc1a5ed0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00ec10 tx=0x7f5dbc00ef20 comp rx=0 tx=0).stop 2023-09-30T22:34:34.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.817+0000 7f5dd19e3700 1 -- 172.21.15.59:0/2632216974 shutdown_connections 2023-09-30T22:34:34.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.817+0000 7f5dd19e3700 1 --2- 172.21.15.59:0/2632216974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dcc09d6f0 0x7f5dcc1a5ed0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.817+0000 7f5dd19e3700 1 --2- 172.21.15.59:0/2632216974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dcc09e440 0x7f5dcc1a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.817+0000 7f5dd19e3700 1 --2- 172.21.15.59:0/2632216974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dcc09e000 0x7f5dcc1a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.817+0000 7f5dd19e3700 1 -- 172.21.15.59:0/2632216974 >> 172.21.15.59:0/2632216974 conn(0x7f5dcc066f50 msgr2=0x7f5dcc1baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:34.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.817+0000 7f5dd19e3700 1 -- 172.21.15.59:0/2632216974 shutdown_connections 2023-09-30T22:34:34.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.817+0000 7f5dd19e3700 1 -- 172.21.15.59:0/2632216974 wait complete. 2023-09-30T22:34:34.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:34.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.848+0000 7f4dd2b0e700 1 -- 172.21.15.59:0/3057273912 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4dcc0713a0 con 0x7f4dcc12cf60 2023-09-30T22:34:34.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.849+0000 7f4dc97fa700 1 -- 172.21.15.59:0/3057273912 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4dc002b090 con 0x7f4dcc12cf60 2023-09-30T22:34:34.849 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:34.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.851+0000 7f4dd2b0e700 1 -- 172.21.15.59:0/3057273912 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dcc12cf60 msgr2=0x7f4dcc09bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:34.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.851+0000 7f4dd2b0e700 1 --2- 172.21.15.59:0/3057273912 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dcc12cf60 0x7f4dcc09bbc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000e9b0 tx=0x7f4dc000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.851+0000 7f4dd2b0e700 1 -- 172.21.15.59:0/3057273912 shutdown_connections 2023-09-30T22:34:34.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.851+0000 7f4dd2b0e700 1 --2- 172.21.15.59:0/3057273912 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dcc12cf60 0x7f4dcc09bbc0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.851+0000 7f4dd2b0e700 1 --2- 172.21.15.59:0/3057273912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dcc130430 0x7f4dcc1c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.851+0000 7f4dd2b0e700 1 --2- 172.21.15.59:0/3057273912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dcc12f8b0 0x7f4dcc09c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:34.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.851+0000 7f4dd2b0e700 1 -- 172.21.15.59:0/3057273912 >> 172.21.15.59:0/3057273912 conn(0x7f4dcc0a2aa0 msgr2=0x7f4dcc1b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:34.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.851+0000 7f4dd2b0e700 1 -- 172.21.15.59:0/3057273912 shutdown_connections 2023-09-30T22:34:34.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:34.851+0000 7f4dd2b0e700 1 -- 172.21.15.59:0/3057273912 wait complete. 2023-09-30T22:34:34.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:35.726 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:35.778 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:35.832 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:35.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.883+0000 7fcf3fdde700 1 Processor -- start 2023-09-30T22:34:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.883+0000 7fcf3fdde700 1 -- start start 2023-09-30T22:34:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.884+0000 7fcf3fdde700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf3809e1d0 0x7fcf38135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.884+0000 7fcf3fdde700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf38135e50 0x7fcf38138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.884+0000 7fcf3fdde700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3809f130 con 0x7fcf3809d6f0 2023-09-30T22:34:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.884+0000 7fcf3fdde700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3809f520 con 0x7fcf3809e1d0 2023-09-30T22:34:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.884+0000 7fcf3fdde700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3809e930 con 0x7fcf38135e50 2023-09-30T22:34:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.884+0000 7fcf3d379700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf3809e1d0 0x7fcf38135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.884+0000 7fcf3d379700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf3809e1d0 0x7fcf38135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52964/0 (socket says 172.21.15.59:52964) 2023-09-30T22:34:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.884+0000 7fcf3d379700 1 -- 172.21.15.59:0/210560885 learned_addr learned my addr 172.21.15.59:0/210560885 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.884+0000 7fcf3e37b700 1 --2- 172.21.15.59:0/210560885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf38135e50 0x7fcf38138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.884+0000 7fcf3d379700 1 -- 172.21.15.59:0/210560885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf38135e50 msgr2=0x7fcf38138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.884+0000 7fcf3d379700 1 --2- 172.21.15.59:0/210560885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf38135e50 0x7fcf38138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.884+0000 7fcf3d379700 1 -- 172.21.15.59:0/210560885 >> v1:172.21.15.59:6789/0 conn(0x7fcf3809d6f0 legacy=0x7fcf3809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.884+0000 7fcf3d379700 1 -- 172.21.15.59:0/210560885 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3809b2d0 con 0x7fcf3809e1d0 2023-09-30T22:34:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.885+0000 7fcf3d379700 1 --2- 172.21.15.59:0/210560885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf3809e1d0 0x7fcf38135910 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fcf280098f0 tx=0x7fcf28009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83109ff964e109a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.885+0000 7fcf3cb78700 1 -- 172.21.15.59:0/210560885 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2800da00 con 0x7fcf3809e1d0 2023-09-30T22:34:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.885+0000 7fcf3cb78700 1 -- 172.21.15.59:0/210560885 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2800db60 con 0x7fcf3809e1d0 2023-09-30T22:34:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.885+0000 7fcf3cb78700 1 -- 172.21.15.59:0/210560885 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28010470 con 0x7fcf3809e1d0 2023-09-30T22:34:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.886+0000 7fcf3fdde700 1 -- 172.21.15.59:0/210560885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf3809e1d0 msgr2=0x7fcf38135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.886+0000 7fcf3fdde700 1 --2- 172.21.15.59:0/210560885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf3809e1d0 0x7fcf38135910 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fcf280098f0 tx=0x7fcf28009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.886+0000 7fcf3fdde700 1 -- 172.21.15.59:0/210560885 shutdown_connections 2023-09-30T22:34:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.886+0000 7fcf3fdde700 1 --2- 172.21.15.59:0/210560885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf38135e50 0x7fcf38138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.886+0000 7fcf3fdde700 1 --2- 172.21.15.59:0/210560885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf3809e1d0 0x7fcf38135910 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.886+0000 7fcf3fdde700 1 -- 172.21.15.59:0/210560885 >> 172.21.15.59:0/210560885 conn(0x7fcf38066f50 msgr2=0x7fcf3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.886+0000 7fcf3fdde700 1 -- 172.21.15.59:0/210560885 shutdown_connections 2023-09-30T22:34:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.886+0000 7fcf3fdde700 1 -- 172.21.15.59:0/210560885 wait complete. 2023-09-30T22:34:35.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.887+0000 7fcf3fdde700 1 Processor -- start 2023-09-30T22:34:35.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.887+0000 7fcf3fdde700 1 -- start start 2023-09-30T22:34:35.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.887+0000 7fcf3fdde700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf3809d6f0 0x7fcf381194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:35.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.887+0000 7fcf3fdde700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf3809e1d0 0x7fcf381199f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:35.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.887+0000 7fcf3fdde700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38135e50 0x7fcf38119f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:35.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.887+0000 7fcf3fdde700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3811cca0 con 0x7fcf38135e50 2023-09-30T22:34:35.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.887+0000 7fcf3fdde700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3811b900 con 0x7fcf3809e1d0 2023-09-30T22:34:35.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.887+0000 7fcf3fdde700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf380a1e90 con 0x7fcf3809d6f0 2023-09-30T22:34:35.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.888+0000 7fcf3d379700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf3809e1d0 0x7fcf381199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:35.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.888+0000 7fcf3d379700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf3809e1d0 0x7fcf381199f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36180/0 (socket says 172.21.15.59:36180) 2023-09-30T22:34:35.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.888+0000 7fcf3d379700 1 -- 172.21.15.59:0/1743559245 learned_addr learned my addr 172.21.15.59:0/1743559245 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:35.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.888+0000 7fcf3e37b700 1 --2- 172.21.15.59:0/1743559245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38135e50 0x7fcf38119f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:35.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.888+0000 7fcf3d379700 1 -- 172.21.15.59:0/1743559245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf3809d6f0 msgr2=0x7fcf381194b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:35.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.888+0000 7fcf3d379700 1 --2- 172.21.15.59:0/1743559245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf3809d6f0 0x7fcf381194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:35.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.888+0000 7fcf3d379700 1 -- 172.21.15.59:0/1743559245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38135e50 msgr2=0x7fcf38119f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:35.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.888+0000 7fcf3d379700 1 --2- 172.21.15.59:0/1743559245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38135e50 0x7fcf38119f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:35.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.888+0000 7fcf3d379700 1 -- 172.21.15.59:0/1743559245 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf28009550 con 0x7fcf3809e1d0 2023-09-30T22:34:35.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.888+0000 7fcf3e37b700 1 --2- 172.21.15.59:0/1743559245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38135e50 0x7fcf38119f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:35.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.889+0000 7fcf3d379700 1 --2- 172.21.15.59:0/1743559245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf3809e1d0 0x7fcf381199f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcf28000c00 tx=0x7fcf28004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:35.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.889+0000 7fcf2e7fc700 1 -- 172.21.15.59:0/1743559245 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf280038a0 con 0x7fcf3809e1d0 2023-09-30T22:34:35.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.889+0000 7fcf2e7fc700 1 -- 172.21.15.59:0/1743559245 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf28003a00 con 0x7fcf3809e1d0 2023-09-30T22:34:35.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.889+0000 7fcf3fdde700 1 -- 172.21.15.59:0/1743559245 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3811cf80 con 0x7fcf3809e1d0 2023-09-30T22:34:35.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.889+0000 7fcf2e7fc700 1 -- 172.21.15.59:0/1743559245 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28003d90 con 0x7fcf3809e1d0 2023-09-30T22:34:35.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.889+0000 7fcf3fdde700 1 -- 172.21.15.59:0/1743559245 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3811c710 con 0x7fcf3809e1d0 2023-09-30T22:34:35.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.890+0000 7fcf2e7fc700 1 -- 172.21.15.59:0/1743559245 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf28019400 con 0x7fcf3809e1d0 2023-09-30T22:34:35.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.890+0000 7fcf2e7fc700 1 -- 172.21.15.59:0/1743559245 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcf280406c0 con 0x7fcf3809e1d0 2023-09-30T22:34:35.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.890+0000 7fcf3fdde700 1 -- 172.21.15.59:0/1743559245 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3811c900 con 0x7fcf3809e1d0 2023-09-30T22:34:35.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.896+0000 7fcf2e7fc700 1 -- 172.21.15.59:0/1743559245 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf3811c900 con 0x7fcf3809e1d0 2023-09-30T22:34:35.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.943+0000 7ffbbc850700 1 Processor -- start 2023-09-30T22:34:35.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.943+0000 7ffbbc850700 1 -- start start 2023-09-30T22:34:35.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.943+0000 7ffbbc850700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffbb809d6f0 0x7ffbb809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:35.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.943+0000 7ffbbc850700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbb809e000 0x7ffbb8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:35.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.943+0000 7ffbbc850700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb809f130 con 0x7ffbb809e410 2023-09-30T22:34:35.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.943+0000 7ffbbc850700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb809f520 con 0x7ffbb809d6f0 2023-09-30T22:34:35.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.943+0000 7ffbbc850700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb809e930 con 0x7ffbb809e000 2023-09-30T22:34:35.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.944+0000 7ffbb659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffbb809d6f0 0x7ffbb809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:35.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.944+0000 7ffbb659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffbb809d6f0 0x7ffbb809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52988/0 (socket says 172.21.15.59:52988) 2023-09-30T22:34:35.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.944+0000 7ffbb659c700 1 -- 172.21.15.59:0/654140769 learned_addr learned my addr 172.21.15.59:0/654140769 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:35.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.944+0000 7ffbb5d9b700 1 --2- 172.21.15.59:0/654140769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbb809e000 0x7ffbb8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:35.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.944+0000 7ffbb659c700 1 -- 172.21.15.59:0/654140769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbb809e000 msgr2=0x7ffbb8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:35.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.944+0000 7ffbb659c700 1 --2- 172.21.15.59:0/654140769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbb809e000 0x7ffbb8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:35.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.944+0000 7ffbb659c700 1 -- 172.21.15.59:0/654140769 >> v1:172.21.15.59:6789/0 conn(0x7ffbb809e410 legacy=0x7ffbb8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:35.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.944+0000 7ffbb659c700 1 -- 172.21.15.59:0/654140769 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb809b2d0 con 0x7ffbb809d6f0 2023-09-30T22:34:35.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.944+0000 7ffbb659c700 1 --2- 172.21.15.59:0/654140769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbb809d6f0 0x7ffbb809dac0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7ffba800bb90 tx=0x7ffba800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a258f6fef41e54c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:35.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.945+0000 7ffbb559a700 1 -- 172.21.15.59:0/654140769 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba800dc90 con 0x7ffbb809d6f0 2023-09-30T22:34:35.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.945+0000 7ffbb559a700 1 -- 172.21.15.59:0/654140769 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba800ddf0 con 0x7ffbb809d6f0 2023-09-30T22:34:35.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.945+0000 7ffbb559a700 1 -- 172.21.15.59:0/654140769 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8012990 con 0x7ffbb809d6f0 2023-09-30T22:34:35.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.945+0000 7ffbbc850700 1 -- 172.21.15.59:0/654140769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbb809d6f0 msgr2=0x7ffbb809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:35.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.945+0000 7ffbbc850700 1 --2- 172.21.15.59:0/654140769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbb809d6f0 0x7ffbb809dac0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7ffba800bb90 tx=0x7ffba800bea0 comp rx=0 tx=0).stop 2023-09-30T22:34:35.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.945+0000 7ffbbc850700 1 -- 172.21.15.59:0/654140769 shutdown_connections 2023-09-30T22:34:35.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.945+0000 7ffbbc850700 1 --2- 172.21.15.59:0/654140769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbb809d6f0 0x7ffbb809dac0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:35.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.945+0000 7ffbbc850700 1 --2- 172.21.15.59:0/654140769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbb809e000 0x7ffbb8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:35.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.946+0000 7ffbbc850700 1 -- 172.21.15.59:0/654140769 >> 172.21.15.59:0/654140769 conn(0x7ffbb8066f50 msgr2=0x7ffbb809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:35.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.947+0000 7ffbbc850700 1 -- 172.21.15.59:0/654140769 shutdown_connections 2023-09-30T22:34:35.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.947+0000 7ffbbc850700 1 -- 172.21.15.59:0/654140769 wait complete. 2023-09-30T22:34:35.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.948+0000 7ffbbc850700 1 Processor -- start 2023-09-30T22:34:35.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.948+0000 7ffbbc850700 1 -- start start 2023-09-30T22:34:35.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.948+0000 7ffbbc850700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbb809d6f0 0x7ffbb811e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:35.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.948+0000 7ffbbc850700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbb809e000 0x7ffbb811e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:35.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.948+0000 7ffbbc850700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbb809e410 0x7ffbb811eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:35.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.948+0000 7ffbbc850700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb809c700 con 0x7ffbb809d6f0 2023-09-30T22:34:35.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.948+0000 7ffbbc850700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb81202b0 con 0x7ffbb809e410 2023-09-30T22:34:35.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.948+0000 7ffbbc850700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80a1d00 con 0x7ffbb809e000 2023-09-30T22:34:35.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.949+0000 7ffbb659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbb809d6f0 0x7ffbb811e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:35.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.949+0000 7ffbb659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbb809d6f0 0x7ffbb811e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52994/0 (socket says 172.21.15.59:52994) 2023-09-30T22:34:35.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.949+0000 7ffbb659c700 1 -- 172.21.15.59:0/716754007 learned_addr learned my addr 172.21.15.59:0/716754007 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:35.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.949+0000 7ffbb6d9d700 1 --2- 172.21.15.59:0/716754007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbb809e410 0x7ffbb811eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.949+0000 7ffbb659c700 1 -- 172.21.15.59:0/716754007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbb809e000 msgr2=0x7ffbb811e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.949+0000 7ffbb659c700 1 --2- 172.21.15.59:0/716754007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbb809e000 0x7ffbb811e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.949+0000 7ffbb659c700 1 -- 172.21.15.59:0/716754007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbb809e410 msgr2=0x7ffbb811eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.949+0000 7ffbb659c700 1 --2- 172.21.15.59:0/716754007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbb809e410 0x7ffbb811eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.949+0000 7ffbb659c700 1 -- 172.21.15.59:0/716754007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba800b7f0 con 0x7ffbb809d6f0 2023-09-30T22:34:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.949+0000 7ffbb6d9d700 1 --2- 172.21.15.59:0/716754007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbb809e410 0x7ffbb811eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.949+0000 7ffbb659c700 1 --2- 172.21.15.59:0/716754007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbb809d6f0 0x7ffbb811e0f0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7ffba8008010 tx=0x7ffba8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.949+0000 7ffba6ffd700 1 -- 172.21.15.59:0/716754007 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba801f070 con 0x7ffbb809d6f0 2023-09-30T22:34:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.950+0000 7ffba6ffd700 1 -- 172.21.15.59:0/716754007 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba8020040 con 0x7ffbb809d6f0 2023-09-30T22:34:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.950+0000 7ffba6ffd700 1 -- 172.21.15.59:0/716754007 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8012de0 con 0x7ffbb809d6f0 2023-09-30T22:34:35.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.950+0000 7ffbbc850700 1 -- 172.21.15.59:0/716754007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb81213a0 con 0x7ffbb809d6f0 2023-09-30T22:34:35.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.950+0000 7ffbbc850700 1 -- 172.21.15.59:0/716754007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb81223a0 con 0x7ffbb809d6f0 2023-09-30T22:34:35.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.951+0000 7ffba6ffd700 1 -- 172.21.15.59:0/716754007 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffba80036a0 con 0x7ffbb809d6f0 2023-09-30T22:34:35.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.951+0000 7ffbbc850700 1 -- 172.21.15.59:0/716754007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb8074ea0 con 0x7ffbb809d6f0 2023-09-30T22:34:35.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.952+0000 7ffba6ffd700 1 -- 172.21.15.59:0/716754007 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffba80452b0 con 0x7ffbb809d6f0 2023-09-30T22:34:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:35.961+0000 7ffba6ffd700 1 -- 172.21.15.59:0/716754007 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffba802ddd0 con 0x7ffbb809d6f0 2023-09-30T22:34:36.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.005+0000 7fc83d1ba700 1 Processor -- start 2023-09-30T22:34:36.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.006+0000 7fc83d1ba700 1 -- start start 2023-09-30T22:34:36.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.006+0000 7fc83d1ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc838130540 0x7fc838130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:36.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.006+0000 7fc83d1ba700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc83806fcf0 0x7fc838138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:36.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.006+0000 7fc83d1ba700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8380716a0 con 0x7fc838130e50 2023-09-30T22:34:36.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.007+0000 7fc83d1ba700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83809a390 con 0x7fc83806fcf0 2023-09-30T22:34:36.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.007+0000 7fc83d1ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc838071290 con 0x7fc838130540 2023-09-30T22:34:36.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.007+0000 7fc83659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc838130e50 0x7fc83806f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34498/0 (socket says 172.21.15.59:34498) 2023-09-30T22:34:36.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.007+0000 7fc836d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc838130540 0x7fc838130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:36.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.007+0000 7fc83659c700 1 -- 172.21.15.59:0/209326693 learned_addr learned my addr 172.21.15.59:0/209326693 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:36.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.007+0000 7fc83759e700 1 --2- 172.21.15.59:0/209326693 >> v2:172.21.15.59:3300/0 conn(0x7fc83806fcf0 0x7fc838138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:36.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.007+0000 7fc835d9b700 1 -- 172.21.15.59:0/209326693 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913051427 0 0) 0x7fc8380716a0 con 0x7fc838130e50 2023-09-30T22:34:36.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.007+0000 7fc835d9b700 1 -- 172.21.15.59:0/209326693 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8200035b0 con 0x7fc838130e50 2023-09-30T22:34:36.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.007+0000 7fc836d9d700 1 -- 172.21.15.59:0/209326693 >> v2:172.21.15.59:3300/0 conn(0x7fc83806fcf0 msgr2=0x7fc838138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:36.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.007+0000 7fc836d9d700 1 --2- 172.21.15.59:0/209326693 >> v2:172.21.15.59:3300/0 conn(0x7fc83806fcf0 0x7fc838138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.007+0000 7fc836d9d700 1 -- 172.21.15.59:0/209326693 >> v1:172.21.15.59:6789/0 conn(0x7fc838130e50 legacy=0x7fc83806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:36.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.007+0000 7fc836d9d700 1 -- 172.21.15.59:0/209326693 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc838130340 con 0x7fc838130540 2023-09-30T22:34:36.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.007+0000 7fc836d9d700 1 --2- 172.21.15.59:0/209326693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc838130540 0x7fc838130910 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc828009870 tx=0x7fc828009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d246cd9683aed92f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:36.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.008+0000 7fc835d9b700 1 -- 172.21.15.59:0/209326693 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828011830 con 0x7fc838130540 2023-09-30T22:34:36.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.008+0000 7fc835d9b700 1 -- 172.21.15.59:0/209326693 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc828011990 con 0x7fc838130540 2023-09-30T22:34:36.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.008+0000 7fc835d9b700 1 -- 172.21.15.59:0/209326693 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828011d20 con 0x7fc838130540 2023-09-30T22:34:36.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.009+0000 7fc83d1ba700 1 -- 172.21.15.59:0/209326693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc838130540 msgr2=0x7fc838130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:36.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.009+0000 7fc83d1ba700 1 --2- 172.21.15.59:0/209326693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc838130540 0x7fc838130910 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc828009870 tx=0x7fc828009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:36.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.009+0000 7fc83d1ba700 1 -- 172.21.15.59:0/209326693 shutdown_connections 2023-09-30T22:34:36.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.009+0000 7fc83d1ba700 1 --2- 172.21.15.59:0/209326693 >> v2:172.21.15.59:3300/0 conn(0x7fc83806fcf0 0x7fc838138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.009+0000 7fc83d1ba700 1 --2- 172.21.15.59:0/209326693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc838130540 0x7fc838130910 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.009+0000 7fc83d1ba700 1 -- 172.21.15.59:0/209326693 >> 172.21.15.59:0/209326693 conn(0x7fc8380a2aa0 msgr2=0x7fc8380a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:36.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.009+0000 7fc83d1ba700 1 -- 172.21.15.59:0/209326693 shutdown_connections 2023-09-30T22:34:36.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.009+0000 7fc83d1ba700 1 -- 172.21.15.59:0/209326693 wait complete. 2023-09-30T22:34:36.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.010+0000 7fc83d1ba700 1 Processor -- start 2023-09-30T22:34:36.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.010+0000 7fc83d1ba700 1 -- start start 2023-09-30T22:34:36.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc83d1ba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc83806fcf0 0x7fc838118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:36.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc83d1ba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc838130540 0x7fc838119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:36.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc83d1ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc838130e50 0x7fc838119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:36.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc83d1ba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83811ac40 con 0x7fc838130540 2023-09-30T22:34:36.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc83d1ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83811a1a0 con 0x7fc838130e50 2023-09-30T22:34:36.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc83d1ba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc83811b460 con 0x7fc83806fcf0 2023-09-30T22:34:36.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc836d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc83806fcf0 0x7fc838118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:36.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc836d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc83806fcf0 0x7fc838118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49218/0 (socket says 172.21.15.59:49218) 2023-09-30T22:34:36.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc836d9d700 1 -- 172.21.15.59:0/3714741473 learned_addr learned my addr 172.21.15.59:0/3714741473 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:36.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc83759e700 1 --2- 172.21.15.59:0/3714741473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc838130e50 0x7fc838119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:36.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc83659c700 1 --2- 172.21.15.59:0/3714741473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc838130540 0x7fc838119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:36.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc836d9d700 1 -- 172.21.15.59:0/3714741473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc838130e50 msgr2=0x7fc838119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:36.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc836d9d700 1 --2- 172.21.15.59:0/3714741473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc838130e50 0x7fc838119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc836d9d700 1 -- 172.21.15.59:0/3714741473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc838130540 msgr2=0x7fc838119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:36.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc836d9d700 1 --2- 172.21.15.59:0/3714741473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc838130540 0x7fc838119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc836d9d700 1 -- 172.21.15.59:0/3714741473 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8280094a0 con 0x7fc83806fcf0 2023-09-30T22:34:36.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc83759e700 1 --2- 172.21.15.59:0/3714741473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc838130e50 0x7fc838119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:36.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.011+0000 7fc83659c700 1 --2- 172.21.15.59:0/3714741473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc838130540 0x7fc838119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:36.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.012+0000 7fc836d9d700 1 --2- 172.21.15.59:0/3714741473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc83806fcf0 0x7fc838118cd0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc8280097c0 tx=0x7fc828004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:36.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.012+0000 7fc81f7fe700 1 -- 172.21.15.59:0/3714741473 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280036a0 con 0x7fc83806fcf0 2023-09-30T22:34:36.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.012+0000 7fc83d1ba700 1 -- 172.21.15.59:0/3714741473 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83811be50 con 0x7fc83806fcf0 2023-09-30T22:34:36.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.012+0000 7fc81f7fe700 1 -- 172.21.15.59:0/3714741473 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82801f070 con 0x7fc83806fcf0 2023-09-30T22:34:36.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.012+0000 7fc81f7fe700 1 -- 172.21.15.59:0/3714741473 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828003a20 con 0x7fc83806fcf0 2023-09-30T22:34:36.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.013+0000 7fc83d1ba700 1 -- 172.21.15.59:0/3714741473 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83811b820 con 0x7fc83806fcf0 2023-09-30T22:34:36.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.013+0000 7fc81f7fe700 1 -- 172.21.15.59:0/3714741473 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc828003b80 con 0x7fc83806fcf0 2023-09-30T22:34:36.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.013+0000 7fc81f7fe700 1 -- 172.21.15.59:0/3714741473 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc828021070 con 0x7fc83806fcf0 2023-09-30T22:34:36.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.014+0000 7fc83d1ba700 1 -- 172.21.15.59:0/3714741473 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8380a1d20 con 0x7fc83806fcf0 2023-09-30T22:34:36.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.023+0000 7fc81f7fe700 1 -- 172.21.15.59:0/3714741473 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc828015030 con 0x7fc83806fcf0 2023-09-30T22:34:36.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.028+0000 7fa763b5a700 1 Processor -- start 2023-09-30T22:34:36.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.028+0000 7fa763b5a700 1 -- start start 2023-09-30T22:34:36.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.029+0000 7fa763b5a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75c06b250 0x7fa75c136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:36.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.029+0000 7fa763b5a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa75c136d80 0x7fa75c139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:36.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.029+0000 7fa763b5a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75c09ece0 con 0x7fa75c06a770 2023-09-30T22:34:36.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.029+0000 7fa763b5a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75c06b640 con 0x7fa75c136d80 2023-09-30T22:34:36.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.029+0000 7fa763b5a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c09e760 con 0x7fa75c06b250 2023-09-30T22:34:36.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.029+0000 7fa7618f6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa75c06a770 0x7fa75c06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34508/0 (socket says 172.21.15.59:34508) 2023-09-30T22:34:36.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.029+0000 7fa7620f7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa75c136d80 0x7fa75c139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:36.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.029+0000 7fa7618f6700 1 -- 172.21.15.59:0/1522014417 learned_addr learned my addr 172.21.15.59:0/1522014417 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:36.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.029+0000 7fa7610f5700 1 --2- 172.21.15.59:0/1522014417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75c06b250 0x7fa75c136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:36.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.030+0000 7fa7610f5700 1 -- 172.21.15.59:0/1522014417 >> v2:172.21.15.59:3300/0 conn(0x7fa75c136d80 msgr2=0x7fa75c139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:36.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.030+0000 7fa7610f5700 1 --2- 172.21.15.59:0/1522014417 >> v2:172.21.15.59:3300/0 conn(0x7fa75c136d80 0x7fa75c139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.030+0000 7fa7610f5700 1 -- 172.21.15.59:0/1522014417 >> v1:172.21.15.59:6789/0 conn(0x7fa75c06a770 legacy=0x7fa75c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:36.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.030+0000 7fa7610f5700 1 -- 172.21.15.59:0/1522014417 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c09e040 con 0x7fa75c06b250 2023-09-30T22:34:36.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.030+0000 7fa7610f5700 1 --2- 172.21.15.59:0/1522014417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75c06b250 0x7fa75c136840 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa74c013150 tx=0x7fa74c013460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef5e44fa6e8fe794 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:36.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.030+0000 7fa7608f4700 1 -- 172.21.15.59:0/1522014417 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c016070 con 0x7fa75c06b250 2023-09-30T22:34:36.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.030+0000 7fa7608f4700 1 -- 172.21.15.59:0/1522014417 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c013d10 con 0x7fa75c06b250 2023-09-30T22:34:36.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.030+0000 7fa7608f4700 1 -- 172.21.15.59:0/1522014417 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c0112f0 con 0x7fa75c06b250 2023-09-30T22:34:36.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.031+0000 7fa763b5a700 1 -- 172.21.15.59:0/1522014417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75c06b250 msgr2=0x7fa75c136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:36.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.031+0000 7fa763b5a700 1 --2- 172.21.15.59:0/1522014417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75c06b250 0x7fa75c136840 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa74c013150 tx=0x7fa74c013460 comp rx=0 tx=0).stop 2023-09-30T22:34:36.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.032+0000 7fa763b5a700 1 -- 172.21.15.59:0/1522014417 shutdown_connections 2023-09-30T22:34:36.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.032+0000 7fa763b5a700 1 --2- 172.21.15.59:0/1522014417 >> v2:172.21.15.59:3300/0 conn(0x7fa75c136d80 0x7fa75c139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.032+0000 7fa763b5a700 1 --2- 172.21.15.59:0/1522014417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75c06b250 0x7fa75c136840 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.032+0000 7fa763b5a700 1 -- 172.21.15.59:0/1522014417 >> 172.21.15.59:0/1522014417 conn(0x7fa75c066f50 msgr2=0x7fa75c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:36.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.032+0000 7fa763b5a700 1 -- 172.21.15.59:0/1522014417 shutdown_connections 2023-09-30T22:34:36.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.032+0000 7fa763b5a700 1 -- 172.21.15.59:0/1522014417 wait complete. 2023-09-30T22:34:36.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.033+0000 7fa763b5a700 1 Processor -- start 2023-09-30T22:34:36.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.033+0000 7fa763b5a700 1 -- start start 2023-09-30T22:34:36.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.034+0000 7fa763b5a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75c06a770 0x7fa75c119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:36.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.034+0000 7fa763b5a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75c06b250 0x7fa75c1199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:36.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.034+0000 7fa763b5a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75c136d80 0x7fa75c119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:36.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.034+0000 7fa763b5a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c1369f0 con 0x7fa75c06b250 2023-09-30T22:34:36.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.034+0000 7fa763b5a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c11c260 con 0x7fa75c06a770 2023-09-30T22:34:36.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.034+0000 7fa763b5a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c09a3d0 con 0x7fa75c136d80 2023-09-30T22:34:36.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.034+0000 7fa7618f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75c06a770 0x7fa75c119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:36.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.034+0000 7fa7618f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75c06a770 0x7fa75c119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36244/0 (socket says 172.21.15.59:36244) 2023-09-30T22:34:36.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.034+0000 7fa7610f5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75c06b250 0x7fa75c1199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:36.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.034+0000 7fa7618f6700 1 -- 172.21.15.59:0/1110705749 learned_addr learned my addr 172.21.15.59:0/1110705749 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:36.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.034+0000 7fa7620f7700 1 --2- 172.21.15.59:0/1110705749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75c136d80 0x7fa75c119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:36.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.034+0000 7fa7618f6700 1 -- 172.21.15.59:0/1110705749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75c136d80 msgr2=0x7fa75c119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:36.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.034+0000 7fa7618f6700 1 --2- 172.21.15.59:0/1110705749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75c136d80 0x7fa75c119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.035+0000 7fa7618f6700 1 -- 172.21.15.59:0/1110705749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75c06b250 msgr2=0x7fa75c1199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:36.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.035+0000 7fa7618f6700 1 --2- 172.21.15.59:0/1110705749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75c06b250 0x7fa75c1199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.035+0000 7fa7618f6700 1 -- 172.21.15.59:0/1110705749 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c011d40 con 0x7fa75c06a770 2023-09-30T22:34:36.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.035+0000 7fa7618f6700 1 --2- 172.21.15.59:0/1110705749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75c06a770 0x7fa75c119480 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa75800c4b0 tx=0x7fa75800c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:36.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.035+0000 7fa7527fc700 1 -- 172.21.15.59:0/1110705749 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa758005d70 con 0x7fa75c06a770 2023-09-30T22:34:36.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.035+0000 7fa7527fc700 1 -- 172.21.15.59:0/1110705749 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75800ce80 con 0x7fa75c06a770 2023-09-30T22:34:36.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.035+0000 7fa763b5a700 1 -- 172.21.15.59:0/1110705749 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75c11b7b0 con 0x7fa75c06a770 2023-09-30T22:34:36.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.035+0000 7fa7527fc700 1 -- 172.21.15.59:0/1110705749 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7580072d0 con 0x7fa75c06a770 2023-09-30T22:34:36.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.035+0000 7fa763b5a700 1 -- 172.21.15.59:0/1110705749 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75c11bd40 con 0x7fa75c06a770 2023-09-30T22:34:36.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.036+0000 7fa7527fc700 1 -- 172.21.15.59:0/1110705749 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa758007430 con 0x7fa75c06a770 2023-09-30T22:34:36.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.036+0000 7fa7527fc700 1 -- 172.21.15.59:0/1110705749 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa75803ea00 con 0x7fa75c06a770 2023-09-30T22:34:36.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.036+0000 7fa763b5a700 1 -- 172.21.15.59:0/1110705749 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75c074ea0 con 0x7fa75c06a770 2023-09-30T22:34:36.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.041+0000 7fa7527fc700 1 -- 172.21.15.59:0/1110705749 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa75801b3b0 con 0x7fa75c06a770 2023-09-30T22:34:36.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.115+0000 7fcf3fdde700 1 -- 172.21.15.59:0/1743559245 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcf3811c900 con 0x7fcf3809e1d0 2023-09-30T22:34:36.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.115+0000 7fcf2e7fc700 1 -- 172.21.15.59:0/1743559245 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf3811c900 con 0x7fcf3809e1d0 2023-09-30T22:34:36.116 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:36.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.118+0000 7fcf3fdde700 1 -- 172.21.15.59:0/1743559245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf3809e1d0 msgr2=0x7fcf381199f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:36.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.118+0000 7fcf3fdde700 1 --2- 172.21.15.59:0/1743559245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf3809e1d0 0x7fcf381199f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcf28000c00 tx=0x7fcf28004750 comp rx=0 tx=0).stop 2023-09-30T22:34:36.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.118+0000 7fcf3fdde700 1 -- 172.21.15.59:0/1743559245 shutdown_connections 2023-09-30T22:34:36.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.118+0000 7fcf3fdde700 1 --2- 172.21.15.59:0/1743559245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf3809d6f0 0x7fcf381194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.118+0000 7fcf3fdde700 1 --2- 172.21.15.59:0/1743559245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38135e50 0x7fcf38119f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.118+0000 7fcf3fdde700 1 --2- 172.21.15.59:0/1743559245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf3809e1d0 0x7fcf381199f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.118+0000 7fcf3fdde700 1 -- 172.21.15.59:0/1743559245 >> 172.21.15.59:0/1743559245 conn(0x7fcf38066f50 msgr2=0x7fcf3806f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:36.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.119+0000 7fcf3fdde700 1 -- 172.21.15.59:0/1743559245 shutdown_connections 2023-09-30T22:34:36.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.119+0000 7fcf3fdde700 1 -- 172.21.15.59:0/1743559245 wait complete. 2023-09-30T22:34:36.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.202+0000 7ffbbc850700 1 -- 172.21.15.59:0/716754007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffbb8121530 con 0x7ffbb809d6f0 2023-09-30T22:34:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.202+0000 7ffba6ffd700 1 -- 172.21.15.59:0/716754007 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffba802d370 con 0x7ffbb809d6f0 2023-09-30T22:34:36.203 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:36.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.204+0000 7ffbbc850700 1 -- 172.21.15.59:0/716754007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbb809d6f0 msgr2=0x7ffbb811e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:36.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.204+0000 7ffbbc850700 1 --2- 172.21.15.59:0/716754007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbb809d6f0 0x7ffbb811e0f0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7ffba8008010 tx=0x7ffba8004750 comp rx=0 tx=0).stop 2023-09-30T22:34:36.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.204+0000 7ffbbc850700 1 -- 172.21.15.59:0/716754007 shutdown_connections 2023-09-30T22:34:36.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.204+0000 7ffbbc850700 1 --2- 172.21.15.59:0/716754007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbb809e410 0x7ffbb811eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.204+0000 7ffbbc850700 1 --2- 172.21.15.59:0/716754007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbb809d6f0 0x7ffbb811e0f0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.204+0000 7ffbbc850700 1 --2- 172.21.15.59:0/716754007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbb809e000 0x7ffbb811e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.204+0000 7ffbbc850700 1 -- 172.21.15.59:0/716754007 >> 172.21.15.59:0/716754007 conn(0x7ffbb8066f50 msgr2=0x7ffbb8071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:36.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.205+0000 7ffbbc850700 1 -- 172.21.15.59:0/716754007 shutdown_connections 2023-09-30T22:34:36.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.205+0000 7ffbbc850700 1 -- 172.21.15.59:0/716754007 wait complete. 2023-09-30T22:34:36.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:36.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.248+0000 7fa763b5a700 1 -- 172.21.15.59:0/1110705749 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa75c06c360 con 0x7fa75c06a770 2023-09-30T22:34:36.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.248+0000 7fa7527fc700 1 -- 172.21.15.59:0/1110705749 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa758017020 con 0x7fa75c06a770 2023-09-30T22:34:36.249 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.251+0000 7fa763b5a700 1 -- 172.21.15.59:0/1110705749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75c06a770 msgr2=0x7fa75c119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.251+0000 7fa763b5a700 1 --2- 172.21.15.59:0/1110705749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75c06a770 0x7fa75c119480 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa75800c4b0 tx=0x7fa75800c7c0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.251+0000 7fa763b5a700 1 -- 172.21.15.59:0/1110705749 shutdown_connections 2023-09-30T22:34:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.251+0000 7fa763b5a700 1 --2- 172.21.15.59:0/1110705749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75c136d80 0x7fa75c119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.251+0000 7fa763b5a700 1 --2- 172.21.15.59:0/1110705749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75c06a770 0x7fa75c119480 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.251+0000 7fa763b5a700 1 --2- 172.21.15.59:0/1110705749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75c06b250 0x7fa75c1199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.251+0000 7fa763b5a700 1 -- 172.21.15.59:0/1110705749 >> 172.21.15.59:0/1110705749 conn(0x7fa75c066f50 msgr2=0x7fa75c132940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:36.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.251+0000 7fa763b5a700 1 -- 172.21.15.59:0/1110705749 shutdown_connections 2023-09-30T22:34:36.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.251+0000 7fa763b5a700 1 -- 172.21.15.59:0/1110705749 wait complete. 2023-09-30T22:34:36.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:36.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.269+0000 7fc83d1ba700 1 -- 172.21.15.59:0/3714741473 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc838074ea0 con 0x7fc83806fcf0 2023-09-30T22:34:36.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.270+0000 7fc81f7fe700 1 -- 172.21.15.59:0/3714741473 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc828045060 con 0x7fc83806fcf0 2023-09-30T22:34:36.270 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:36.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.272+0000 7fc83d1ba700 1 -- 172.21.15.59:0/3714741473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc83806fcf0 msgr2=0x7fc838118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:36.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.272+0000 7fc83d1ba700 1 --2- 172.21.15.59:0/3714741473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc83806fcf0 0x7fc838118cd0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc8280097c0 tx=0x7fc828004750 comp rx=0 tx=0).stop 2023-09-30T22:34:36.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.272+0000 7fc83d1ba700 1 -- 172.21.15.59:0/3714741473 shutdown_connections 2023-09-30T22:34:36.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.272+0000 7fc83d1ba700 1 --2- 172.21.15.59:0/3714741473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc83806fcf0 0x7fc838118cd0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.272+0000 7fc83d1ba700 1 --2- 172.21.15.59:0/3714741473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc838130e50 0x7fc838119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.272+0000 7fc83d1ba700 1 --2- 172.21.15.59:0/3714741473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc838130540 0x7fc838119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:36.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.272+0000 7fc83d1ba700 1 -- 172.21.15.59:0/3714741473 >> 172.21.15.59:0/3714741473 conn(0x7fc8380a2aa0 msgr2=0x7fc83812d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:36.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.272+0000 7fc83d1ba700 1 -- 172.21.15.59:0/3714741473 shutdown_connections 2023-09-30T22:34:36.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:36.272+0000 7fc83d1ba700 1 -- 172.21.15.59:0/3714741473 wait complete. 2023-09-30T22:34:36.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:37.139 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:37.219 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:37.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:37.286 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:37.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.288+0000 7f3637715700 1 Processor -- start 2023-09-30T22:34:37.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.288+0000 7f3637715700 1 -- start start 2023-09-30T22:34:37.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.289+0000 7f3637715700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3630130540 0x7f3630130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.289+0000 7f3637715700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3630130e50 0x7f363006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.289+0000 7f3637715700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f363006fb20 0x7f363006ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.289+0000 7f3637715700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363009a390 con 0x7f363006fb20 2023-09-30T22:34:37.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.289+0000 7f3637715700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36300716a0 con 0x7f3630130540 2023-09-30T22:34:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.289+0000 7f3637715700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3630071290 con 0x7f3630130e50 2023-09-30T22:34:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.289+0000 7f36354b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3630130540 0x7f3630130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.289+0000 7f36354b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3630130540 0x7f3630130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36246/0 (socket says 172.21.15.59:36246) 2023-09-30T22:34:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.289+0000 7f36354b1700 1 -- 172.21.15.59:0/4033430413 learned_addr learned my addr 172.21.15.59:0/4033430413 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.289+0000 7f3635cb2700 1 --2- 172.21.15.59:0/4033430413 >> v2:172.21.15.59:3300/0 conn(0x7f363006fb20 0x7f363006ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.289+0000 7f3634cb0700 1 --2- 172.21.15.59:0/4033430413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3630130e50 0x7f363006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.290+0000 7f36354b1700 1 -- 172.21.15.59:0/4033430413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3630130e50 msgr2=0x7f363006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.290+0000 7f36354b1700 1 --2- 172.21.15.59:0/4033430413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3630130e50 0x7f363006f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.290+0000 7f36354b1700 1 -- 172.21.15.59:0/4033430413 >> v2:172.21.15.59:3300/0 conn(0x7f363006fb20 msgr2=0x7f363006ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.290+0000 7f36354b1700 1 --2- 172.21.15.59:0/4033430413 >> v2:172.21.15.59:3300/0 conn(0x7f363006fb20 0x7f363006ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.290+0000 7f36354b1700 1 -- 172.21.15.59:0/4033430413 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3630130340 con 0x7f3630130540 2023-09-30T22:34:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.290+0000 7f36354b1700 1 --2- 172.21.15.59:0/4033430413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3630130540 0x7f3630130910 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f362c009920 tx=0x7f362c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b49f3ab6311522b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.290+0000 7f3627fff700 1 -- 172.21.15.59:0/4033430413 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c011830 con 0x7f3630130540 2023-09-30T22:34:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.290+0000 7f3627fff700 1 -- 172.21.15.59:0/4033430413 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c011990 con 0x7f3630130540 2023-09-30T22:34:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.290+0000 7f3627fff700 1 -- 172.21.15.59:0/4033430413 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c011d20 con 0x7f3630130540 2023-09-30T22:34:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.291+0000 7f3637715700 1 -- 172.21.15.59:0/4033430413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3630130540 msgr2=0x7f3630130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.291+0000 7f3637715700 1 --2- 172.21.15.59:0/4033430413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3630130540 0x7f3630130910 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f362c009920 tx=0x7f362c009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.291+0000 7f3637715700 1 -- 172.21.15.59:0/4033430413 shutdown_connections 2023-09-30T22:34:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.291+0000 7f3637715700 1 --2- 172.21.15.59:0/4033430413 >> v2:172.21.15.59:3300/0 conn(0x7f363006fb20 0x7f363006ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.291+0000 7f3637715700 1 --2- 172.21.15.59:0/4033430413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3630130540 0x7f3630130910 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.291+0000 7f3637715700 1 --2- 172.21.15.59:0/4033430413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3630130e50 0x7f363006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.291+0000 7f3637715700 1 -- 172.21.15.59:0/4033430413 >> 172.21.15.59:0/4033430413 conn(0x7f36300a2aa0 msgr2=0x7f36300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:37.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.291+0000 7f3637715700 1 -- 172.21.15.59:0/4033430413 shutdown_connections 2023-09-30T22:34:37.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.291+0000 7f3637715700 1 -- 172.21.15.59:0/4033430413 wait complete. 2023-09-30T22:34:37.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.292+0000 7f3637715700 1 Processor -- start 2023-09-30T22:34:37.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.292+0000 7f3637715700 1 -- start start 2023-09-30T22:34:37.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.293+0000 7f3637715700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f363006fb20 0x7f36301352f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.293+0000 7f3637715700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3630130540 0x7f3630135830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.293+0000 7f3637715700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3630130e50 0x7f3630135d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.293+0000 7f3637715700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300718e0 con 0x7f363006fb20 2023-09-30T22:34:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.293+0000 7f3637715700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3630133600 con 0x7f3630130540 2023-09-30T22:34:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.293+0000 7f3637715700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36301344a0 con 0x7f3630130e50 2023-09-30T22:34:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.293+0000 7f36354b1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f363006fb20 0x7f36301352f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.293+0000 7f36354b1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f363006fb20 0x7f36301352f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53060/0 (socket says 172.21.15.59:53060) 2023-09-30T22:34:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.293+0000 7f36354b1700 1 -- 172.21.15.59:0/975929093 learned_addr learned my addr 172.21.15.59:0/975929093 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.293+0000 7f3634cb0700 1 --2- 172.21.15.59:0/975929093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3630130540 0x7f3630135830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.293+0000 7f3635cb2700 1 --2- 172.21.15.59:0/975929093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3630130e50 0x7f3630135d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.294+0000 7f36354b1700 1 -- 172.21.15.59:0/975929093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3630130e50 msgr2=0x7f3630135d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.294+0000 7f36354b1700 1 --2- 172.21.15.59:0/975929093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3630130e50 0x7f3630135d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.294+0000 7f36354b1700 1 -- 172.21.15.59:0/975929093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3630130540 msgr2=0x7f3630135830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.294+0000 7f36354b1700 1 --2- 172.21.15.59:0/975929093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3630130540 0x7f3630135830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.294+0000 7f36354b1700 1 -- 172.21.15.59:0/975929093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c009550 con 0x7f363006fb20 2023-09-30T22:34:37.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.294+0000 7f3635cb2700 1 --2- 172.21.15.59:0/975929093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3630130e50 0x7f3630135d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:37.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.294+0000 7f3634cb0700 1 --2- 172.21.15.59:0/975929093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3630130540 0x7f3630135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:37.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.294+0000 7f36354b1700 1 --2- 172.21.15.59:0/975929093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f363006fb20 0x7f36301352f0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f362c009c70 tx=0x7f362c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:37.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.294+0000 7f3625ffb700 1 -- 172.21.15.59:0/975929093 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c004380 con 0x7f363006fb20 2023-09-30T22:34:37.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.294+0000 7f3625ffb700 1 -- 172.21.15.59:0/975929093 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c01f070 con 0x7f363006fb20 2023-09-30T22:34:37.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.294+0000 7f3637715700 1 -- 172.21.15.59:0/975929093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3630134710 con 0x7f363006fb20 2023-09-30T22:34:37.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.294+0000 7f3625ffb700 1 -- 172.21.15.59:0/975929093 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c0036a0 con 0x7f363006fb20 2023-09-30T22:34:37.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.294+0000 7f3637715700 1 -- 172.21.15.59:0/975929093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36300a0ae0 con 0x7f363006fb20 2023-09-30T22:34:37.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.295+0000 7f3625ffb700 1 -- 172.21.15.59:0/975929093 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f362c021030 con 0x7f363006fb20 2023-09-30T22:34:37.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.296+0000 7f3637715700 1 -- 172.21.15.59:0/975929093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36301341a0 con 0x7f363006fb20 2023-09-30T22:34:37.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.296+0000 7f3625ffb700 1 -- 172.21.15.59:0/975929093 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f362c041310 con 0x7f363006fb20 2023-09-30T22:34:37.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.302+0000 7f3625ffb700 1 -- 172.21.15.59:0/975929093 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f362c00b9d0 con 0x7f363006fb20 2023-09-30T22:34:37.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.378+0000 7ffac462b700 1 Processor -- start 2023-09-30T22:34:37.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.378+0000 7ffac462b700 1 -- start start 2023-09-30T22:34:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.379+0000 7ffac462b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc131630 0x7ffabc131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.379+0000 7ffac462b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc131f40 0x7ffabc06e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.379+0000 7ffac462b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffabc071a00 con 0x7ffabc06e9d0 2023-09-30T22:34:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.379+0000 7ffac462b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc131430 con 0x7ffabc131630 2023-09-30T22:34:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.379+0000 7ffac462b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc09a510 con 0x7ffabc131f40 2023-09-30T22:34:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.379+0000 7ffac23c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc131630 0x7ffabc131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.379+0000 7ffac2bc8700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffabc06e9d0 0x7ffabc138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34510/0 (socket says 172.21.15.59:34510) 2023-09-30T22:34:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.379+0000 7ffac23c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc131630 0x7ffabc131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36250/0 (socket says 172.21.15.59:36250) 2023-09-30T22:34:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.379+0000 7ffac2bc8700 1 -- 172.21.15.59:0/1274871542 learned_addr learned my addr 172.21.15.59:0/1274871542 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.379+0000 7ffac1bc6700 1 --2- 172.21.15.59:0/1274871542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc131f40 0x7ffabc06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.379+0000 7ffac1bc6700 1 -- 172.21.15.59:0/1274871542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc131630 msgr2=0x7ffabc131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.379+0000 7ffac1bc6700 1 --2- 172.21.15.59:0/1274871542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc131630 0x7ffabc131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.379+0000 7ffac1bc6700 1 -- 172.21.15.59:0/1274871542 >> v1:172.21.15.59:6789/0 conn(0x7ffabc06e9d0 legacy=0x7ffabc138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.379+0000 7ffac1bc6700 1 -- 172.21.15.59:0/1274871542 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc0721c0 con 0x7ffabc131f40 2023-09-30T22:34:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.380+0000 7ffac23c7700 1 --2- 172.21.15.59:0/1274871542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc131630 0x7ffabc131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.380+0000 7ffac1bc6700 1 --2- 172.21.15.59:0/1274871542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc131f40 0x7ffabc06e490 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009870 tx=0x7ffaac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c754a382ee26a9d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.380+0000 7ffac13c5700 1 -- 172.21.15.59:0/1274871542 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac011830 con 0x7ffabc131f40 2023-09-30T22:34:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.380+0000 7ffac13c5700 1 -- 172.21.15.59:0/1274871542 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac011990 con 0x7ffabc131f40 2023-09-30T22:34:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.380+0000 7ffac13c5700 1 -- 172.21.15.59:0/1274871542 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac011d20 con 0x7ffabc131f40 2023-09-30T22:34:37.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.381+0000 7ffac462b700 1 -- 172.21.15.59:0/1274871542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc131f40 msgr2=0x7ffabc06e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.381+0000 7ffac462b700 1 --2- 172.21.15.59:0/1274871542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc131f40 0x7ffabc06e490 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009870 tx=0x7ffaac009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:37.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.381+0000 7ffac462b700 1 -- 172.21.15.59:0/1274871542 shutdown_connections 2023-09-30T22:34:37.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.381+0000 7ffac462b700 1 --2- 172.21.15.59:0/1274871542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc131630 0x7ffabc131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.381+0000 7ffac462b700 1 --2- 172.21.15.59:0/1274871542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc131f40 0x7ffabc06e490 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.381+0000 7ffac462b700 1 -- 172.21.15.59:0/1274871542 >> 172.21.15.59:0/1274871542 conn(0x7ffabc0a2aa0 msgr2=0x7ffabc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:37.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.381+0000 7ffac462b700 1 -- 172.21.15.59:0/1274871542 shutdown_connections 2023-09-30T22:34:37.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.381+0000 7ffac462b700 1 -- 172.21.15.59:0/1274871542 wait complete. 2023-09-30T22:34:37.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.383+0000 7ffac462b700 1 Processor -- start 2023-09-30T22:34:37.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.383+0000 7ffac462b700 1 -- start start 2023-09-30T22:34:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac462b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc06e9d0 0x7ffabc06f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac462b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffabc131630 0x7ffabc06fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac462b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc131f40 0x7ffabc070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac462b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc121490 con 0x7ffabc131630 2023-09-30T22:34:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac462b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc120430 con 0x7ffabc06e9d0 2023-09-30T22:34:37.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac462b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc0a31b0 con 0x7ffabc131f40 2023-09-30T22:34:37.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac2bc8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc131f40 0x7ffabc070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac2bc8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc131f40 0x7ffabc070090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49268/0 (socket says 172.21.15.59:49268) 2023-09-30T22:34:37.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac2bc8700 1 -- 172.21.15.59:0/965811309 learned_addr learned my addr 172.21.15.59:0/965811309 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:37.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac1bc6700 1 --2- 172.21.15.59:0/965811309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffabc131630 0x7ffabc06fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac23c7700 1 --2- 172.21.15.59:0/965811309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc06e9d0 0x7ffabc06f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac2bc8700 1 -- 172.21.15.59:0/965811309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc06e9d0 msgr2=0x7ffabc06f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac2bc8700 1 --2- 172.21.15.59:0/965811309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc06e9d0 0x7ffabc06f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac2bc8700 1 -- 172.21.15.59:0/965811309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffabc131630 msgr2=0x7ffabc06fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac2bc8700 1 --2- 172.21.15.59:0/965811309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffabc131630 0x7ffabc06fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac2bc8700 1 -- 172.21.15.59:0/965811309 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab80094a0 con 0x7ffabc131f40 2023-09-30T22:34:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.384+0000 7ffac1bc6700 1 --2- 172.21.15.59:0/965811309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffabc131630 0x7ffabc06fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.385+0000 7ffac2bc8700 1 --2- 172.21.15.59:0/965811309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc131f40 0x7ffabc070090 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ffab400cbc0 tx=0x7ffab400ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.385+0000 7ffab2ffd700 1 -- 172.21.15.59:0/965811309 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab400a9e0 con 0x7ffabc131f40 2023-09-30T22:34:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.385+0000 7ffab2ffd700 1 -- 172.21.15.59:0/965811309 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab400ab40 con 0x7ffabc131f40 2023-09-30T22:34:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.385+0000 7ffab2ffd700 1 -- 172.21.15.59:0/965811309 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4012400 con 0x7ffabc131f40 2023-09-30T22:34:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.385+0000 7ffac462b700 1 -- 172.21.15.59:0/965811309 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac0094a0 con 0x7ffabc131f40 2023-09-30T22:34:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.385+0000 7ffac462b700 1 -- 172.21.15.59:0/965811309 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc120ef0 con 0x7ffabc131f40 2023-09-30T22:34:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.386+0000 7ffab2ffd700 1 -- 172.21.15.59:0/965811309 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffab401b3b0 con 0x7ffabc131f40 2023-09-30T22:34:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.386+0000 7ffab2ffd700 1 -- 172.21.15.59:0/965811309 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffab4007ac0 con 0x7ffabc131f40 2023-09-30T22:34:37.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.387+0000 7ffac462b700 1 -- 172.21.15.59:0/965811309 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc074ea0 con 0x7ffabc131f40 2023-09-30T22:34:37.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.395+0000 7ffab2ffd700 1 -- 172.21.15.59:0/965811309 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffab4017020 con 0x7ffabc131f40 2023-09-30T22:34:37.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.416+0000 7f4a2373f700 1 Processor -- start 2023-09-30T22:34:37.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.416+0000 7f4a2373f700 1 -- start start 2023-09-30T22:34:37.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.416+0000 7f4a2373f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a1c09d6f0 0x7f4a1c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.416+0000 7f4a2373f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a1c09e000 0x7f4a1c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.416+0000 7f4a2373f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a1c09e410 0x7f4a1c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.416+0000 7f4a2373f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c09f520 con 0x7f4a1c09e410 2023-09-30T22:34:37.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.416+0000 7f4a2373f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c09f130 con 0x7f4a1c09e000 2023-09-30T22:34:37.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.416+0000 7f4a2373f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c09e930 con 0x7f4a1c09d6f0 2023-09-30T22:34:37.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.417+0000 7f4a214db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a1c09d6f0 0x7f4a1c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.417+0000 7f4a214db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a1c09d6f0 0x7f4a1c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49280/0 (socket says 172.21.15.59:49280) 2023-09-30T22:34:37.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.417+0000 7f4a214db700 1 -- 172.21.15.59:0/594725930 learned_addr learned my addr 172.21.15.59:0/594725930 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:37.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.417+0000 7f4a20cda700 1 --2- 172.21.15.59:0/594725930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a1c09e000 0x7f4a1c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.417+0000 7f4a21cdc700 1 --2- 172.21.15.59:0/594725930 >> v2:172.21.15.59:3300/0 conn(0x7f4a1c09e410 0x7f4a1c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.417+0000 7f4a214db700 1 -- 172.21.15.59:0/594725930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a1c09e000 msgr2=0x7f4a1c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:37.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.417+0000 7f4a214db700 1 --2- 172.21.15.59:0/594725930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a1c09e000 0x7f4a1c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.417+0000 7f4a214db700 1 -- 172.21.15.59:0/594725930 >> v2:172.21.15.59:3300/0 conn(0x7f4a1c09e410 msgr2=0x7f4a1c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:37.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.417+0000 7f4a214db700 1 --2- 172.21.15.59:0/594725930 >> v2:172.21.15.59:3300/0 conn(0x7f4a1c09e410 0x7f4a1c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.417+0000 7f4a214db700 1 -- 172.21.15.59:0/594725930 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c09b2d0 con 0x7f4a1c09d6f0 2023-09-30T22:34:37.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.417+0000 7f4a21cdc700 1 --2- 172.21.15.59:0/594725930 >> v2:172.21.15.59:3300/0 conn(0x7f4a1c09e410 0x7f4a1c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:37.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.417+0000 7f4a214db700 1 --2- 172.21.15.59:0/594725930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a1c09d6f0 0x7f4a1c09dac0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800bbc0 tx=0x7f4a1800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50e2abd55f7545c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:37.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.418+0000 7f4a13fff700 1 -- 172.21.15.59:0/594725930 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800dcf0 con 0x7f4a1c09d6f0 2023-09-30T22:34:37.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.418+0000 7f4a13fff700 1 -- 172.21.15.59:0/594725930 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1800de50 con 0x7f4a1c09d6f0 2023-09-30T22:34:37.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.418+0000 7f4a13fff700 1 -- 172.21.15.59:0/594725930 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18010690 con 0x7f4a1c09d6f0 2023-09-30T22:34:37.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.418+0000 7f4a2373f700 1 -- 172.21.15.59:0/594725930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a1c09d6f0 msgr2=0x7f4a1c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.418+0000 7f4a2373f700 1 --2- 172.21.15.59:0/594725930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a1c09d6f0 0x7f4a1c09dac0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800bbc0 tx=0x7f4a1800bed0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.418+0000 7f4a2373f700 1 -- 172.21.15.59:0/594725930 shutdown_connections 2023-09-30T22:34:37.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.418+0000 7f4a2373f700 1 --2- 172.21.15.59:0/594725930 >> v2:172.21.15.59:3300/0 conn(0x7f4a1c09e410 0x7f4a1c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.418+0000 7f4a2373f700 1 --2- 172.21.15.59:0/594725930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a1c09d6f0 0x7f4a1c09dac0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.418+0000 7f4a2373f700 1 --2- 172.21.15.59:0/594725930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a1c09e000 0x7f4a1c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.418+0000 7f4a2373f700 1 -- 172.21.15.59:0/594725930 >> 172.21.15.59:0/594725930 conn(0x7f4a1c066f50 msgr2=0x7f4a1c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:37.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.419+0000 7f4a2373f700 1 -- 172.21.15.59:0/594725930 shutdown_connections 2023-09-30T22:34:37.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.419+0000 7f4a2373f700 1 -- 172.21.15.59:0/594725930 wait complete. 2023-09-30T22:34:37.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.420+0000 7f4a2373f700 1 Processor -- start 2023-09-30T22:34:37.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.420+0000 7f4a2373f700 1 -- start start 2023-09-30T22:34:37.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.420+0000 7f4a2373f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a1c09d6f0 0x7f4a1c11e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.420+0000 7f4a2373f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a1c09e000 0x7f4a1c11e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.420+0000 7f4a2373f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a1c09e410 0x7f4a1c11ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.420+0000 7f4a2373f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c09c700 con 0x7f4a1c09d6f0 2023-09-30T22:34:37.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.420+0000 7f4a2373f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c120360 con 0x7f4a1c09e410 2023-09-30T22:34:37.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.420+0000 7f4a2373f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c072590 con 0x7f4a1c09e000 2023-09-30T22:34:37.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.420+0000 7f4a21cdc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a1c09e410 0x7f4a1c11ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.420+0000 7f4a21cdc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a1c09e410 0x7f4a1c11ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36288/0 (socket says 172.21.15.59:36288) 2023-09-30T22:34:37.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.420+0000 7f4a21cdc700 1 -- 172.21.15.59:0/2177789955 learned_addr learned my addr 172.21.15.59:0/2177789955 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:37.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.421+0000 7f4a214db700 1 --2- 172.21.15.59:0/2177789955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a1c09d6f0 0x7f4a1c11e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.421+0000 7f4a21cdc700 1 -- 172.21.15.59:0/2177789955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a1c09e000 msgr2=0x7f4a1c11e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.421+0000 7f4a21cdc700 1 --2- 172.21.15.59:0/2177789955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a1c09e000 0x7f4a1c11e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.421+0000 7f4a21cdc700 1 -- 172.21.15.59:0/2177789955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a1c09d6f0 msgr2=0x7f4a1c11e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.421+0000 7f4a21cdc700 1 --2- 172.21.15.59:0/2177789955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a1c09d6f0 0x7f4a1c11e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.421+0000 7f4a21cdc700 1 -- 172.21.15.59:0/2177789955 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1800b7f0 con 0x7f4a1c09e410 2023-09-30T22:34:37.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.421+0000 7f4a21cdc700 1 --2- 172.21.15.59:0/2177789955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a1c09e410 0x7f4a1c11ecc0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4a14007ef0 tx=0x7f4a1400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:37.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.421+0000 7f4a11ffb700 1 -- 172.21.15.59:0/2177789955 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400de30 con 0x7f4a1c09e410 2023-09-30T22:34:37.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.421+0000 7f4a11ffb700 1 -- 172.21.15.59:0/2177789955 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1400f040 con 0x7f4a1c09e410 2023-09-30T22:34:37.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.421+0000 7f4a11ffb700 1 -- 172.21.15.59:0/2177789955 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14003c60 con 0x7f4a1c09e410 2023-09-30T22:34:37.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.421+0000 7f4a2373f700 1 -- 172.21.15.59:0/2177789955 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1c121450 con 0x7f4a1c09e410 2023-09-30T22:34:37.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.422+0000 7f4a2373f700 1 -- 172.21.15.59:0/2177789955 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c122450 con 0x7f4a1c09e410 2023-09-30T22:34:37.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.423+0000 7f4a2373f700 1 -- 172.21.15.59:0/2177789955 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1c121640 con 0x7f4a1c09e410 2023-09-30T22:34:37.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.423+0000 7f4a11ffb700 1 -- 172.21.15.59:0/2177789955 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a14004030 con 0x7f4a1c09e410 2023-09-30T22:34:37.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.425+0000 7f4a11ffb700 1 -- 172.21.15.59:0/2177789955 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4a14003dc0 con 0x7f4a1c09e410 2023-09-30T22:34:37.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.428+0000 7f4a11ffb700 1 -- 172.21.15.59:0/2177789955 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a1401d360 con 0x7f4a1c09e410 2023-09-30T22:34:37.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.438+0000 7fe8e363e700 1 Processor -- start 2023-09-30T22:34:37.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.439+0000 7fe8e363e700 1 -- start start 2023-09-30T22:34:37.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.439+0000 7fe8e363e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133420 0x7fe8dc1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.439+0000 7fe8e363e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8dc134260 0x7fe8dc1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.439+0000 7fe8e363e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8dc06b990 con 0x7fe8dc133e30 2023-09-30T22:34:37.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.439+0000 7fe8e363e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8dc0a0590 con 0x7fe8dc134260 2023-09-30T22:34:37.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.439+0000 7fe8e363e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc09fb80 con 0x7fe8dc133420 2023-09-30T22:34:37.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.439+0000 7fe8e0bd9700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe8dc133e30 0x7fe8dc12ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34522/0 (socket says 172.21.15.59:34522) 2023-09-30T22:34:37.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.439+0000 7fe8e0bd9700 1 -- 172.21.15.59:0/147536249 learned_addr learned my addr 172.21.15.59:0/147536249 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:37.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.440+0000 7fe8e13da700 1 --2- 172.21.15.59:0/147536249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133420 0x7fe8dc1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.440+0000 7fe8e1bdb700 1 --2- 172.21.15.59:0/147536249 >> v2:172.21.15.59:3300/0 conn(0x7fe8dc134260 0x7fe8dc1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.440+0000 7fe8e13da700 1 -- 172.21.15.59:0/147536249 >> v2:172.21.15.59:3300/0 conn(0x7fe8dc134260 msgr2=0x7fe8dc1306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.440+0000 7fe8e13da700 1 --2- 172.21.15.59:0/147536249 >> v2:172.21.15.59:3300/0 conn(0x7fe8dc134260 0x7fe8dc1306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.440+0000 7fe8e13da700 1 -- 172.21.15.59:0/147536249 >> v1:172.21.15.59:6789/0 conn(0x7fe8dc133e30 legacy=0x7fe8dc12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.440+0000 7fe8e13da700 1 -- 172.21.15.59:0/147536249 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc0a0030 con 0x7fe8dc133420 2023-09-30T22:34:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.440+0000 7fe8e13da700 1 --2- 172.21.15.59:0/147536249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133420 0x7fe8dc1337f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009840 tx=0x7fe8d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3b5fae5f201f432 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.440+0000 7fe8d3fff700 1 -- 172.21.15.59:0/147536249 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8011830 con 0x7fe8dc133420 2023-09-30T22:34:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.441+0000 7fe8d3fff700 1 -- 172.21.15.59:0/147536249 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d8011990 con 0x7fe8dc133420 2023-09-30T22:34:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.441+0000 7fe8d3fff700 1 -- 172.21.15.59:0/147536249 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8011d20 con 0x7fe8dc133420 2023-09-30T22:34:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.441+0000 7fe8e363e700 1 -- 172.21.15.59:0/147536249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133420 msgr2=0x7fe8dc1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.441+0000 7fe8e363e700 1 --2- 172.21.15.59:0/147536249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133420 0x7fe8dc1337f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009840 tx=0x7fe8d8009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.441+0000 7fe8e363e700 1 -- 172.21.15.59:0/147536249 shutdown_connections 2023-09-30T22:34:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.441+0000 7fe8e363e700 1 --2- 172.21.15.59:0/147536249 >> v2:172.21.15.59:3300/0 conn(0x7fe8dc134260 0x7fe8dc1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.441+0000 7fe8e363e700 1 --2- 172.21.15.59:0/147536249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133420 0x7fe8dc1337f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.441+0000 7fe8e363e700 1 -- 172.21.15.59:0/147536249 >> 172.21.15.59:0/147536249 conn(0x7fe8dc0a4210 msgr2=0x7fe8dc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.441+0000 7fe8e363e700 1 -- 172.21.15.59:0/147536249 shutdown_connections 2023-09-30T22:34:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.442+0000 7fe8e363e700 1 -- 172.21.15.59:0/147536249 wait complete. 2023-09-30T22:34:37.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.443+0000 7fe8e363e700 1 Processor -- start 2023-09-30T22:34:37.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.443+0000 7fe8e363e700 1 -- start start 2023-09-30T22:34:37.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.443+0000 7fe8e363e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc133420 0x7fe8dc11de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.443+0000 7fe8e363e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133e30 0x7fe8dc11e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.443+0000 7fe8e363e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc134260 0x7fe8dc11c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:37.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.443+0000 7fe8e363e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc131990 con 0x7fe8dc134260 2023-09-30T22:34:37.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.443+0000 7fe8e363e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc11bdb0 con 0x7fe8dc133e30 2023-09-30T22:34:37.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.443+0000 7fe8e363e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc11b810 con 0x7fe8dc133420 2023-09-30T22:34:37.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.443+0000 7fe8e0bd9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133e30 0x7fe8dc11e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.443+0000 7fe8e0bd9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133e30 0x7fe8dc11e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36304/0 (socket says 172.21.15.59:36304) 2023-09-30T22:34:37.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.443+0000 7fe8e0bd9700 1 -- 172.21.15.59:0/2540612832 learned_addr learned my addr 172.21.15.59:0/2540612832 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:37.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.443+0000 7fe8e13da700 1 --2- 172.21.15.59:0/2540612832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc133420 0x7fe8dc11de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.444+0000 7fe8e1bdb700 1 --2- 172.21.15.59:0/2540612832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc134260 0x7fe8dc11c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:37.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.444+0000 7fe8e0bd9700 1 -- 172.21.15.59:0/2540612832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc133420 msgr2=0x7fe8dc11de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.444+0000 7fe8e0bd9700 1 --2- 172.21.15.59:0/2540612832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc133420 0x7fe8dc11de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.444+0000 7fe8e0bd9700 1 -- 172.21.15.59:0/2540612832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc134260 msgr2=0x7fe8dc11c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.444+0000 7fe8e0bd9700 1 --2- 172.21.15.59:0/2540612832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc134260 0x7fe8dc11c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.444+0000 7fe8e0bd9700 1 -- 172.21.15.59:0/2540612832 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d80094a0 con 0x7fe8dc133e30 2023-09-30T22:34:37.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.444+0000 7fe8e0bd9700 1 --2- 172.21.15.59:0/2540612832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133e30 0x7fe8dc11e3b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00c530 tx=0x7fe8cc00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:37.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.448+0000 7fe8d1ffb700 1 -- 172.21.15.59:0/2540612832 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc005d70 con 0x7fe8dc133e30 2023-09-30T22:34:37.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.448+0000 7fe8d1ffb700 1 -- 172.21.15.59:0/2540612832 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc0070d0 con 0x7fe8dc133e30 2023-09-30T22:34:37.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.448+0000 7fe8d1ffb700 1 -- 172.21.15.59:0/2540612832 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc007440 con 0x7fe8dc133e30 2023-09-30T22:34:37.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.448+0000 7fe8e363e700 1 -- 172.21.15.59:0/2540612832 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8dc12db50 con 0x7fe8dc133e30 2023-09-30T22:34:37.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.448+0000 7fe8e363e700 1 -- 172.21.15.59:0/2540612832 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8dc09def0 con 0x7fe8dc133e30 2023-09-30T22:34:37.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.449+0000 7fe8d1ffb700 1 -- 172.21.15.59:0/2540612832 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8cc0075a0 con 0x7fe8dc133e30 2023-09-30T22:34:37.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.449+0000 7fe8e363e700 1 -- 172.21.15.59:0/2540612832 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8dc11bbf0 con 0x7fe8dc133e30 2023-09-30T22:34:37.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.457+0000 7fe8d1ffb700 1 -- 172.21.15.59:0/2540612832 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe8cc010700 con 0x7fe8dc133e30 2023-09-30T22:34:37.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.458+0000 7fe8d1ffb700 1 -- 172.21.15.59:0/2540612832 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8cc01b3b0 con 0x7fe8dc133e30 2023-09-30T22:34:37.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.588+0000 7f3637715700 1 -- 172.21.15.59:0/975929093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3630074ea0 con 0x7f363006fb20 2023-09-30T22:34:37.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.588+0000 7f3625ffb700 1 -- 172.21.15.59:0/975929093 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f362c0233d0 con 0x7f363006fb20 2023-09-30T22:34:37.588 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.591+0000 7f3637715700 1 -- 172.21.15.59:0/975929093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f363006fb20 msgr2=0x7f36301352f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.591+0000 7f3637715700 1 --2- 172.21.15.59:0/975929093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f363006fb20 0x7f36301352f0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f362c009c70 tx=0x7f362c004750 comp rx=0 tx=0).stop 2023-09-30T22:34:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.591+0000 7f3637715700 1 -- 172.21.15.59:0/975929093 shutdown_connections 2023-09-30T22:34:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.591+0000 7f3637715700 1 --2- 172.21.15.59:0/975929093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3630130e50 0x7f3630135d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.591+0000 7f3637715700 1 --2- 172.21.15.59:0/975929093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f363006fb20 0x7f36301352f0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.591+0000 7f3637715700 1 --2- 172.21.15.59:0/975929093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3630130540 0x7f3630135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.591+0000 7f3637715700 1 -- 172.21.15.59:0/975929093 >> 172.21.15.59:0/975929093 conn(0x7f36300a2aa0 msgr2=0x7f363012e360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:37.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.591+0000 7f3637715700 1 -- 172.21.15.59:0/975929093 shutdown_connections 2023-09-30T22:34:37.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.591+0000 7f3637715700 1 -- 172.21.15.59:0/975929093 wait complete. 2023-09-30T22:34:37.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:37.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.641+0000 7f4a2373f700 1 -- 172.21.15.59:0/2177789955 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4a1c074ea0 con 0x7f4a1c09e410 2023-09-30T22:34:37.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.641+0000 7f4a11ffb700 1 -- 172.21.15.59:0/2177789955 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4a1401a020 con 0x7f4a1c09e410 2023-09-30T22:34:37.642 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:37.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.644+0000 7f4a2373f700 1 -- 172.21.15.59:0/2177789955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a1c09e410 msgr2=0x7f4a1c11ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.644+0000 7f4a2373f700 1 --2- 172.21.15.59:0/2177789955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a1c09e410 0x7f4a1c11ecc0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4a14007ef0 tx=0x7f4a1400d3b0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.644+0000 7f4a2373f700 1 -- 172.21.15.59:0/2177789955 shutdown_connections 2023-09-30T22:34:37.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.644+0000 7f4a2373f700 1 --2- 172.21.15.59:0/2177789955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a1c09e410 0x7f4a1c11ecc0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.644+0000 7f4a2373f700 1 --2- 172.21.15.59:0/2177789955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a1c09d6f0 0x7f4a1c11e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.644+0000 7f4a2373f700 1 --2- 172.21.15.59:0/2177789955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a1c09e000 0x7f4a1c11e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.644+0000 7f4a2373f700 1 -- 172.21.15.59:0/2177789955 >> 172.21.15.59:0/2177789955 conn(0x7f4a1c066f50 msgr2=0x7f4a1c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:37.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.644+0000 7f4a2373f700 1 -- 172.21.15.59:0/2177789955 shutdown_connections 2023-09-30T22:34:37.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.644+0000 7f4a2373f700 1 -- 172.21.15.59:0/2177789955 wait complete. 2023-09-30T22:34:37.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:37.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.665+0000 7ffac462b700 1 -- 172.21.15.59:0/965811309 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffabc06b9e0 con 0x7ffabc131f40 2023-09-30T22:34:37.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.666+0000 7ffab2ffd700 1 -- 172.21.15.59:0/965811309 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffab40192c0 con 0x7ffabc131f40 2023-09-30T22:34:37.666 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:37.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.667+0000 7fe8e363e700 1 -- 172.21.15.59:0/2540612832 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe8dc09def0 con 0x7fe8dc133e30 2023-09-30T22:34:37.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.668+0000 7fe8d1ffb700 1 -- 172.21.15.59:0/2540612832 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8dc09def0 con 0x7fe8dc133e30 2023-09-30T22:34:37.668 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:37.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.668+0000 7ffac462b700 1 -- 172.21.15.59:0/965811309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc131f40 msgr2=0x7ffabc070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.668+0000 7ffac462b700 1 --2- 172.21.15.59:0/965811309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc131f40 0x7ffabc070090 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ffab400cbc0 tx=0x7ffab400ced0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.668+0000 7ffac462b700 1 -- 172.21.15.59:0/965811309 shutdown_connections 2023-09-30T22:34:37.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.668+0000 7ffac462b700 1 --2- 172.21.15.59:0/965811309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc131f40 0x7ffabc070090 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.668+0000 7ffac462b700 1 --2- 172.21.15.59:0/965811309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc06e9d0 0x7ffabc06f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.668+0000 7ffac462b700 1 --2- 172.21.15.59:0/965811309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffabc131630 0x7ffabc06fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.668+0000 7ffac462b700 1 -- 172.21.15.59:0/965811309 >> 172.21.15.59:0/965811309 conn(0x7ffabc0a2aa0 msgr2=0x7ffabc1b8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:37.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.668+0000 7ffac462b700 1 -- 172.21.15.59:0/965811309 shutdown_connections 2023-09-30T22:34:37.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.668+0000 7ffac462b700 1 -- 172.21.15.59:0/965811309 wait complete. 2023-09-30T22:34:37.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.670+0000 7fe8e363e700 1 -- 172.21.15.59:0/2540612832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133e30 msgr2=0x7fe8dc11e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:37.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.670+0000 7fe8e363e700 1 --2- 172.21.15.59:0/2540612832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133e30 0x7fe8dc11e3b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00c530 tx=0x7fe8cc00c8f0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.670+0000 7fe8e363e700 1 -- 172.21.15.59:0/2540612832 shutdown_connections 2023-09-30T22:34:37.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.670+0000 7fe8e363e700 1 --2- 172.21.15.59:0/2540612832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc133420 0x7fe8dc11de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.670+0000 7fe8e363e700 1 --2- 172.21.15.59:0/2540612832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc134260 0x7fe8dc11c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.670+0000 7fe8e363e700 1 --2- 172.21.15.59:0/2540612832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133e30 0x7fe8dc11e3b0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:37.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.670+0000 7fe8e363e700 1 -- 172.21.15.59:0/2540612832 >> 172.21.15.59:0/2540612832 conn(0x7fe8dc0a4210 msgr2=0x7fe8dc0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:37.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.670+0000 7fe8e363e700 1 -- 172.21.15.59:0/2540612832 shutdown_connections 2023-09-30T22:34:37.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:37.670+0000 7fe8e363e700 1 -- 172.21.15.59:0/2540612832 wait complete. 2023-09-30T22:34:37.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:37.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:38.606 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:38.660 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:38.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:38.685 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:38.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.760+0000 7fc5b0983700 1 Processor -- start 2023-09-30T22:34:38.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.760+0000 7fc5b0983700 1 -- start start 2023-09-30T22:34:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5b0983700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5ac09d6f0 0x7fc5ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5b0983700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc5ac09e000 0x7fc5ac130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5b0983700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5ac09e410 0x7fc5ac130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5b0983700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac09f520 con 0x7fc5ac09e000 2023-09-30T22:34:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5b0983700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac09f130 con 0x7fc5ac09d6f0 2023-09-30T22:34:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5b0983700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac09e930 con 0x7fc5ac09e410 2023-09-30T22:34:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5aad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5ac09e410 0x7fc5ac130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5aa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5ac09d6f0 0x7fc5ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5aad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5ac09e410 0x7fc5ac130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49300/0 (socket says 172.21.15.59:49300) 2023-09-30T22:34:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5aad9d700 1 -- 172.21.15.59:0/3154095184 learned_addr learned my addr 172.21.15.59:0/3154095184 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5a9d9b700 1 --2- 172.21.15.59:0/3154095184 >> v2:172.21.15.59:3300/0 conn(0x7fc5ac09e000 0x7fc5ac130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5aad9d700 1 -- 172.21.15.59:0/3154095184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5ac09d6f0 msgr2=0x7fc5ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5aad9d700 1 --2- 172.21.15.59:0/3154095184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5ac09d6f0 0x7fc5ac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5aad9d700 1 -- 172.21.15.59:0/3154095184 >> v2:172.21.15.59:3300/0 conn(0x7fc5ac09e000 msgr2=0x7fc5ac130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5aad9d700 1 --2- 172.21.15.59:0/3154095184 >> v2:172.21.15.59:3300/0 conn(0x7fc5ac09e000 0x7fc5ac130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.761+0000 7fc5aad9d700 1 -- 172.21.15.59:0/3154095184 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac09b2d0 con 0x7fc5ac09e410 2023-09-30T22:34:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.762+0000 7fc5aad9d700 1 --2- 172.21.15.59:0/3154095184 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5ac09e410 0x7fc5ac130ba0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009e80 tx=0x7fc5a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed79ed8809cf070a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.762+0000 7fc5a959a700 1 -- 172.21.15.59:0/3154095184 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a400bad0 con 0x7fc5ac09e410 2023-09-30T22:34:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.762+0000 7fc5a959a700 1 -- 172.21.15.59:0/3154095184 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a400bc30 con 0x7fc5ac09e410 2023-09-30T22:34:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.762+0000 7fc5a959a700 1 -- 172.21.15.59:0/3154095184 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40104d0 con 0x7fc5ac09e410 2023-09-30T22:34:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.763+0000 7fc5b0983700 1 -- 172.21.15.59:0/3154095184 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5ac09e410 msgr2=0x7fc5ac130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.763+0000 7fc5b0983700 1 --2- 172.21.15.59:0/3154095184 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5ac09e410 0x7fc5ac130ba0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009e80 tx=0x7fc5a400b330 comp rx=0 tx=0).stop 2023-09-30T22:34:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.763+0000 7fc5b0983700 1 -- 172.21.15.59:0/3154095184 shutdown_connections 2023-09-30T22:34:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.763+0000 7fc5b0983700 1 --2- 172.21.15.59:0/3154095184 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5ac09e410 0x7fc5ac130ba0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.763+0000 7fc5b0983700 1 --2- 172.21.15.59:0/3154095184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5ac09d6f0 0x7fc5ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.763+0000 7fc5b0983700 1 --2- 172.21.15.59:0/3154095184 >> v2:172.21.15.59:3300/0 conn(0x7fc5ac09e000 0x7fc5ac130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.763+0000 7fc5b0983700 1 -- 172.21.15.59:0/3154095184 >> 172.21.15.59:0/3154095184 conn(0x7fc5ac066f50 msgr2=0x7fc5ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:38.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.763+0000 7fc5b0983700 1 -- 172.21.15.59:0/3154095184 shutdown_connections 2023-09-30T22:34:38.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.763+0000 7fc5b0983700 1 -- 172.21.15.59:0/3154095184 wait complete. 2023-09-30T22:34:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.764+0000 7fc5b0983700 1 Processor -- start 2023-09-30T22:34:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.764+0000 7fc5b0983700 1 -- start start 2023-09-30T22:34:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5b0983700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5ac09d6f0 0x7fc5ac11de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5b0983700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5ac09e000 0x7fc5ac11e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5b0983700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5ac09e410 0x7fc5ac11e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5b0983700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac11fa50 con 0x7fc5ac09e000 2023-09-30T22:34:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5b0983700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac120070 con 0x7fc5ac09d6f0 2023-09-30T22:34:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5b0983700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac120ca0 con 0x7fc5ac09e410 2023-09-30T22:34:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5a9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5ac09e000 0x7fc5ac11e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5aad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5ac09e410 0x7fc5ac11e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5a9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5ac09e000 0x7fc5ac11e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53128/0 (socket says 172.21.15.59:53128) 2023-09-30T22:34:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5a9d9b700 1 -- 172.21.15.59:0/3688735505 learned_addr learned my addr 172.21.15.59:0/3688735505 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5aa59c700 1 --2- 172.21.15.59:0/3688735505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5ac09d6f0 0x7fc5ac11de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5a9d9b700 1 -- 172.21.15.59:0/3688735505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5ac09e410 msgr2=0x7fc5ac11e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5a9d9b700 1 --2- 172.21.15.59:0/3688735505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5ac09e410 0x7fc5ac11e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5a9d9b700 1 -- 172.21.15.59:0/3688735505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5ac09d6f0 msgr2=0x7fc5ac11de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5a9d9b700 1 --2- 172.21.15.59:0/3688735505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5ac09d6f0 0x7fc5ac11de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5a9d9b700 1 -- 172.21.15.59:0/3688735505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a4009b30 con 0x7fc5ac09e000 2023-09-30T22:34:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.765+0000 7fc5aad9d700 1 --2- 172.21.15.59:0/3688735505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5ac09e410 0x7fc5ac11e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.766+0000 7fc5a9d9b700 1 --2- 172.21.15.59:0/3688735505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5ac09e000 0x7fc5ac11e380 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000e9b0 tx=0x7fc5a000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.766+0000 7fc59affd700 1 -- 172.21.15.59:0/3688735505 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0009710 con 0x7fc5ac09e000 2023-09-30T22:34:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.766+0000 7fc59affd700 1 -- 172.21.15.59:0/3688735505 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a000c850 con 0x7fc5ac09e000 2023-09-30T22:34:38.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.766+0000 7fc5b0983700 1 -- 172.21.15.59:0/3688735505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ac1210f0 con 0x7fc5ac09e000 2023-09-30T22:34:38.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.766+0000 7fc59affd700 1 -- 172.21.15.59:0/3688735505 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a000cbe0 con 0x7fc5ac09e000 2023-09-30T22:34:38.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.766+0000 7fc5b0983700 1 -- 172.21.15.59:0/3688735505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ac121680 con 0x7fc5ac09e000 2023-09-30T22:34:38.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.767+0000 7fc59affd700 1 -- 172.21.15.59:0/3688735505 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5a000cd40 con 0x7fc5ac09e000 2023-09-30T22:34:38.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.767+0000 7fc59affd700 1 -- 172.21.15.59:0/3688735505 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc5a003fae0 con 0x7fc5ac09e000 2023-09-30T22:34:38.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.767+0000 7fc5b0983700 1 -- 172.21.15.59:0/3688735505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ac074ea0 con 0x7fc5ac09e000 2023-09-30T22:34:38.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.777+0000 7fc59affd700 1 -- 172.21.15.59:0/3688735505 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5a0021020 con 0x7fc5ac09e000 2023-09-30T22:34:38.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.817+0000 7fe4ec6a1700 1 Processor -- start 2023-09-30T22:34:38.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.817+0000 7fe4ec6a1700 1 -- start start 2023-09-30T22:34:38.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.818+0000 7fe4ec6a1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4e409d6f0 0x7fe4e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.818+0000 7fe4ec6a1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4e409e410 0x7fe4e4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.818+0000 7fe4ec6a1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e409b120 con 0x7fe4e409e000 2023-09-30T22:34:38.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.818+0000 7fe4ec6a1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e406b460 con 0x7fe4e409e410 2023-09-30T22:34:38.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.818+0000 7fe4ec6a1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e409a7e0 con 0x7fe4e409d6f0 2023-09-30T22:34:38.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.818+0000 7fe4ea43d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4e409d6f0 0x7fe4e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.819+0000 7fe4ea43d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4e409d6f0 0x7fe4e409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49328/0 (socket says 172.21.15.59:49328) 2023-09-30T22:34:38.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.819+0000 7fe4ea43d700 1 -- 172.21.15.59:0/2516912637 learned_addr learned my addr 172.21.15.59:0/2516912637 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:38.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.819+0000 7fe4eac3e700 1 --2- 172.21.15.59:0/2516912637 >> v2:172.21.15.59:3300/0 conn(0x7fe4e409e410 0x7fe4e4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.819+0000 7fe4ea43d700 1 -- 172.21.15.59:0/2516912637 >> v2:172.21.15.59:3300/0 conn(0x7fe4e409e410 msgr2=0x7fe4e4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:38.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.819+0000 7fe4ea43d700 1 --2- 172.21.15.59:0/2516912637 >> v2:172.21.15.59:3300/0 conn(0x7fe4e409e410 0x7fe4e4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.819+0000 7fe4ea43d700 1 -- 172.21.15.59:0/2516912637 >> v1:172.21.15.59:6789/0 conn(0x7fe4e409e000 legacy=0x7fe4e41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:38.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.819+0000 7fe4ea43d700 1 -- 172.21.15.59:0/2516912637 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e409a500 con 0x7fe4e409d6f0 2023-09-30T22:34:38.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.819+0000 7fe4eac3e700 1 --2- 172.21.15.59:0/2516912637 >> v2:172.21.15.59:3300/0 conn(0x7fe4e409e410 0x7fe4e4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:38.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.819+0000 7fe4ea43d700 1 --2- 172.21.15.59:0/2516912637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4e409d6f0 0x7fe4e409dac0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009920 tx=0x7fe4e0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43d36f284d00e5bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:38.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.819+0000 7fe4e943b700 1 -- 172.21.15.59:0/2516912637 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0011830 con 0x7fe4e409d6f0 2023-09-30T22:34:38.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.820+0000 7fe4e943b700 1 -- 172.21.15.59:0/2516912637 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e0011990 con 0x7fe4e409d6f0 2023-09-30T22:34:38.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.820+0000 7fe4e943b700 1 -- 172.21.15.59:0/2516912637 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0011d20 con 0x7fe4e409d6f0 2023-09-30T22:34:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.821+0000 7fe4ec6a1700 1 -- 172.21.15.59:0/2516912637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4e409d6f0 msgr2=0x7fe4e409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.821+0000 7fe4ec6a1700 1 --2- 172.21.15.59:0/2516912637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4e409d6f0 0x7fe4e409dac0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009920 tx=0x7fe4e0009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.821+0000 7fe4ec6a1700 1 -- 172.21.15.59:0/2516912637 shutdown_connections 2023-09-30T22:34:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.821+0000 7fe4ec6a1700 1 --2- 172.21.15.59:0/2516912637 >> v2:172.21.15.59:3300/0 conn(0x7fe4e409e410 0x7fe4e4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.821+0000 7fe4ec6a1700 1 --2- 172.21.15.59:0/2516912637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4e409d6f0 0x7fe4e409dac0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.821+0000 7fe4ec6a1700 1 -- 172.21.15.59:0/2516912637 >> 172.21.15.59:0/2516912637 conn(0x7fe4e4066f50 msgr2=0x7fe4e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.821+0000 7fe4ec6a1700 1 -- 172.21.15.59:0/2516912637 shutdown_connections 2023-09-30T22:34:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.821+0000 7fe4ec6a1700 1 -- 172.21.15.59:0/2516912637 wait complete. 2023-09-30T22:34:38.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.822+0000 7fe4ec6a1700 1 Processor -- start 2023-09-30T22:34:38.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.822+0000 7fe4ec6a1700 1 -- start start 2023-09-30T22:34:38.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.823+0000 7fe4ec6a1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4e409d6f0 0x7fe4e41a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.823+0000 7fe4ec6a1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4e409e000 0x7fe4e41a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.823+0000 7fe4ec6a1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4e409e410 0x7fe4e41a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.823+0000 7fe4ec6a1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e40a3480 con 0x7fe4e409e000 2023-09-30T22:34:38.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.823+0000 7fe4ec6a1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e41a6b90 con 0x7fe4e409d6f0 2023-09-30T22:34:38.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.823+0000 7fe4ec6a1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e41a7d40 con 0x7fe4e409e410 2023-09-30T22:34:38.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.823+0000 7fe4e9c3c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4e409e000 0x7fe4e41a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.823+0000 7fe4e9c3c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4e409e000 0x7fe4e41a5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53148/0 (socket says 172.21.15.59:53148) 2023-09-30T22:34:38.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.823+0000 7fe4e9c3c700 1 -- 172.21.15.59:0/3635469113 learned_addr learned my addr 172.21.15.59:0/3635469113 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:38.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.823+0000 7fe4ea43d700 1 --2- 172.21.15.59:0/3635469113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4e409d6f0 0x7fe4e41a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.824+0000 7fe4eac3e700 1 --2- 172.21.15.59:0/3635469113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4e409e410 0x7fe4e41a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.824+0000 7fe4e9c3c700 1 -- 172.21.15.59:0/3635469113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4e409e410 msgr2=0x7fe4e41a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:38.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.824+0000 7fe4e9c3c700 1 --2- 172.21.15.59:0/3635469113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4e409e410 0x7fe4e41a5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.824+0000 7fe4e9c3c700 1 -- 172.21.15.59:0/3635469113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4e409d6f0 msgr2=0x7fe4e41a4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:38.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.824+0000 7fe4e9c3c700 1 --2- 172.21.15.59:0/3635469113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4e409d6f0 0x7fe4e41a4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.824+0000 7fe4e9c3c700 1 -- 172.21.15.59:0/3635469113 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc009a70 con 0x7fe4e409e000 2023-09-30T22:34:38.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.824+0000 7fe4e9c3c700 1 --2- 172.21.15.59:0/3635469113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4e409e000 0x7fe4e41a5440 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400c4b0 tx=0x7fe4d400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:38.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.824+0000 7fe4eac3e700 1 --2- 172.21.15.59:0/3635469113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4e409e410 0x7fe4e41a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:34:38.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.824+0000 7fe4daffd700 1 -- 172.21.15.59:0/3635469113 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d40052d0 con 0x7fe4e409e000 2023-09-30T22:34:38.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.824+0000 7fe4daffd700 1 -- 172.21.15.59:0/3635469113 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d4005430 con 0x7fe4e409e000 2023-09-30T22:34:38.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.824+0000 7fe4ec6a1700 1 -- 172.21.15.59:0/3635469113 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e0009550 con 0x7fe4e409e000 2023-09-30T22:34:38.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.824+0000 7fe4daffd700 1 -- 172.21.15.59:0/3635469113 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4003880 con 0x7fe4e409e000 2023-09-30T22:34:38.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.824+0000 7fe4ec6a1700 1 -- 172.21.15.59:0/3635469113 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e41a8990 con 0x7fe4e409e000 2023-09-30T22:34:38.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.825+0000 7fe4daffd700 1 -- 172.21.15.59:0/3635469113 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4d40039e0 con 0x7fe4e409e000 2023-09-30T22:34:38.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.826+0000 7fe4daffd700 1 -- 172.21.15.59:0/3635469113 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe4d403ead0 con 0x7fe4e409e000 2023-09-30T22:34:38.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.826+0000 7fe4ec6a1700 1 -- 172.21.15.59:0/3635469113 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e41a8520 con 0x7fe4e409e000 2023-09-30T22:34:38.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.836+0000 7fe4daffd700 1 -- 172.21.15.59:0/3635469113 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4d4017080 con 0x7fe4e409e000 2023-09-30T22:34:38.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.863+0000 7f9dcf59a700 1 Processor -- start 2023-09-30T22:34:38.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.864+0000 7f9dcf59a700 1 -- start start 2023-09-30T22:34:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.864+0000 7f9dcf59a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9dc81338a0 0x7f9dc8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.864+0000 7f9dcf59a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dc809e930 0x7f9dc813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.864+0000 7f9dcf59a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc806ef30 con 0x7f9dc809de50 2023-09-30T22:34:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.864+0000 7f9dcf59a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc806fef0 con 0x7f9dc809e930 2023-09-30T22:34:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.864+0000 7f9dcf59a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc81334b0 con 0x7f9dc81338a0 2023-09-30T22:34:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.864+0000 7f9dcd336700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9dc81338a0 0x7f9dc8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.864+0000 7f9dcd336700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9dc81338a0 0x7f9dc8133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49338/0 (socket says 172.21.15.59:49338) 2023-09-30T22:34:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.864+0000 7f9dccb35700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9dc809de50 0x7f9dc809e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34540/0 (socket says 172.21.15.59:34540) 2023-09-30T22:34:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.864+0000 7f9dcd336700 1 -- 172.21.15.59:0/221496742 learned_addr learned my addr 172.21.15.59:0/221496742 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.865+0000 7f9dcdb37700 1 --2- 172.21.15.59:0/221496742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dc809e930 0x7f9dc813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.865+0000 7f9dcd336700 1 -- 172.21.15.59:0/221496742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dc809e930 msgr2=0x7f9dc813b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.865+0000 7f9dcd336700 1 --2- 172.21.15.59:0/221496742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dc809e930 0x7f9dc813b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.865+0000 7f9dcd336700 1 -- 172.21.15.59:0/221496742 >> v1:172.21.15.59:6789/0 conn(0x7f9dc809de50 legacy=0x7f9dc809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.865+0000 7f9dcd336700 1 -- 172.21.15.59:0/221496742 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc806fc30 con 0x7f9dc81338a0 2023-09-30T22:34:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.865+0000 7f9dcdb37700 1 --2- 172.21.15.59:0/221496742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dc809e930 0x7f9dc813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.865+0000 7f9dcd336700 1 --2- 172.21.15.59:0/221496742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9dc81338a0 0x7f9dc8133c70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009920 tx=0x7f9dc4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c12f808b26859fd4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.865+0000 7f9dbffff700 1 -- 172.21.15.59:0/221496742 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc400ba60 con 0x7f9dc81338a0 2023-09-30T22:34:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.865+0000 7f9dbffff700 1 -- 172.21.15.59:0/221496742 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc400bbc0 con 0x7f9dc81338a0 2023-09-30T22:34:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.865+0000 7f9dbffff700 1 -- 172.21.15.59:0/221496742 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4009e70 con 0x7f9dc81338a0 2023-09-30T22:34:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.866+0000 7f9dcf59a700 1 -- 172.21.15.59:0/221496742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9dc81338a0 msgr2=0x7f9dc8133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.866+0000 7f9dcf59a700 1 --2- 172.21.15.59:0/221496742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9dc81338a0 0x7f9dc8133c70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009920 tx=0x7f9dc4009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:38.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.866+0000 7f9dcf59a700 1 -- 172.21.15.59:0/221496742 shutdown_connections 2023-09-30T22:34:38.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.866+0000 7f9dcf59a700 1 --2- 172.21.15.59:0/221496742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9dc81338a0 0x7f9dc8133c70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.866+0000 7f9dcf59a700 1 --2- 172.21.15.59:0/221496742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dc809e930 0x7f9dc813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.866+0000 7f9dcf59a700 1 -- 172.21.15.59:0/221496742 >> 172.21.15.59:0/221496742 conn(0x7f9dc80a2aa0 msgr2=0x7f9dc80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:38.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.866+0000 7f9dcf59a700 1 -- 172.21.15.59:0/221496742 shutdown_connections 2023-09-30T22:34:38.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.866+0000 7f9dcf59a700 1 -- 172.21.15.59:0/221496742 wait complete. 2023-09-30T22:34:38.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.868+0000 7f9dcf59a700 1 Processor -- start 2023-09-30T22:34:38.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.868+0000 7f9dcf59a700 1 -- start start 2023-09-30T22:34:38.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcf59a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dc809de50 0x7f9dc811d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcf59a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9dc809e930 0x7f9dc811dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcf59a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dc81338a0 0x7f9dc811e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcf59a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc811f2e0 con 0x7f9dc81338a0 2023-09-30T22:34:38.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcf59a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc8120530 con 0x7f9dc809de50 2023-09-30T22:34:38.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcf59a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc811f8c0 con 0x7f9dc809e930 2023-09-30T22:34:38.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcd336700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dc809de50 0x7f9dc811d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcd336700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dc809de50 0x7f9dc811d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36358/0 (socket says 172.21.15.59:36358) 2023-09-30T22:34:38.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcd336700 1 -- 172.21.15.59:0/4262596075 learned_addr learned my addr 172.21.15.59:0/4262596075 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:38.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcdb37700 1 --2- 172.21.15.59:0/4262596075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dc81338a0 0x7f9dc811e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dccb35700 1 --2- 172.21.15.59:0/4262596075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9dc809e930 0x7f9dc811dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcd336700 1 -- 172.21.15.59:0/4262596075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9dc809e930 msgr2=0x7f9dc811dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:38.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcd336700 1 --2- 172.21.15.59:0/4262596075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9dc809e930 0x7f9dc811dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcd336700 1 -- 172.21.15.59:0/4262596075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dc81338a0 msgr2=0x7f9dc811e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:38.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcd336700 1 --2- 172.21.15.59:0/4262596075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dc81338a0 0x7f9dc811e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcd336700 1 -- 172.21.15.59:0/4262596075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc4009550 con 0x7f9dc809de50 2023-09-30T22:34:38.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f638e4ff700 1 Processor -- start 2023-09-30T22:34:38.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f638e4ff700 1 -- start start 2023-09-30T22:34:38.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.869+0000 7f9dcd336700 1 --2- 172.21.15.59:0/4262596075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dc809de50 0x7f9dc811d720 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40098f0 tx=0x7f9dc4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:38.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.870+0000 7f9dbdffb700 1 -- 172.21.15.59:0/4262596075 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4004510 con 0x7f9dc809de50 2023-09-30T22:34:38.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.870+0000 7f9dbdffb700 1 -- 172.21.15.59:0/4262596075 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc40036a0 con 0x7f9dc809de50 2023-09-30T22:34:38.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.870+0000 7f9dcf59a700 1 -- 172.21.15.59:0/4262596075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc8120f10 con 0x7f9dc809de50 2023-09-30T22:34:38.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.870+0000 7f9dbdffb700 1 -- 172.21.15.59:0/4262596075 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4003a50 con 0x7f9dc809de50 2023-09-30T22:34:38.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.870+0000 7f638e4ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6388130670 0x7f6388130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.870+0000 7f9dcf59a700 1 -- 172.21.15.59:0/4262596075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc806f640 con 0x7f9dc809de50 2023-09-30T22:34:38.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.870+0000 7f9dccb35700 1 --2- 172.21.15.59:0/4262596075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9dc809e930 0x7f9dc811dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.870+0000 7f638e4ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63880701a0 0x7f6388138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.870+0000 7f638e4ff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6388130260 con 0x7f638806f680 2023-09-30T22:34:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.870+0000 7f638e4ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638809a350 con 0x7f6388130670 2023-09-30T22:34:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.870+0000 7f638e4ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6388071ff0 con 0x7f63880701a0 2023-09-30T22:34:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.871+0000 7f638ca9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63880701a0 0x7f6388138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.871+0000 7f638ca9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63880701a0 0x7f6388138540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49364/0 (socket says 172.21.15.59:49364) 2023-09-30T22:34:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.871+0000 7f638ca9c700 1 -- 172.21.15.59:0/783859512 learned_addr learned my addr 172.21.15.59:0/783859512 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.870+0000 7f63877fe700 1 --1- 172.21.15.59:0/783859512 >> v1:172.21.15.59:6789/0 conn(0x7f638806f680 0x7f638806fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34544/0 (socket says 172.21.15.59:34544) 2023-09-30T22:34:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.871+0000 7f6387fff700 1 --2- 172.21.15.59:0/783859512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6388130670 0x7f6388130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.871+0000 7f638ca9c700 1 -- 172.21.15.59:0/783859512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6388130670 msgr2=0x7f6388130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.871+0000 7f638ca9c700 1 --2- 172.21.15.59:0/783859512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6388130670 0x7f6388130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.871+0000 7f638ca9c700 1 -- 172.21.15.59:0/783859512 >> v1:172.21.15.59:6789/0 conn(0x7f638806f680 legacy=0x7f638806fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.871+0000 7f638ca9c700 1 -- 172.21.15.59:0/783859512 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638809ecf0 con 0x7f63880701a0 2023-09-30T22:34:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.871+0000 7f9dbdffb700 1 -- 172.21.15.59:0/4262596075 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9dc4003bb0 con 0x7f9dc809de50 2023-09-30T22:34:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.871+0000 7f9dcf59a700 1 -- 172.21.15.59:0/4262596075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc811a470 con 0x7f9dc809de50 2023-09-30T22:34:38.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.872+0000 7f638ca9c700 1 --2- 172.21.15.59:0/783859512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63880701a0 0x7f6388138540 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6380009eb0 tx=0x7f638000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb9050e911216bef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:38.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.872+0000 7f9dbdffb700 1 -- 172.21.15.59:0/4262596075 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9dc4040da0 con 0x7f9dc809de50 2023-09-30T22:34:38.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.872+0000 7f6386ffd700 1 -- 172.21.15.59:0/783859512 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638000e070 con 0x7f63880701a0 2023-09-30T22:34:38.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.872+0000 7f6386ffd700 1 -- 172.21.15.59:0/783859512 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638000b980 con 0x7f63880701a0 2023-09-30T22:34:38.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.872+0000 7f6386ffd700 1 -- 172.21.15.59:0/783859512 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638000bd30 con 0x7f63880701a0 2023-09-30T22:34:38.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.873+0000 7f638e4ff700 1 -- 172.21.15.59:0/783859512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63880701a0 msgr2=0x7f6388138540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:38.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.873+0000 7f638e4ff700 1 --2- 172.21.15.59:0/783859512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63880701a0 0x7f6388138540 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6380009eb0 tx=0x7f638000b330 comp rx=0 tx=0).stop 2023-09-30T22:34:38.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.873+0000 7f638e4ff700 1 -- 172.21.15.59:0/783859512 shutdown_connections 2023-09-30T22:34:38.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.873+0000 7f638e4ff700 1 --2- 172.21.15.59:0/783859512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63880701a0 0x7f6388138540 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.873+0000 7f638e4ff700 1 --2- 172.21.15.59:0/783859512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6388130670 0x7f6388130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.873+0000 7f638e4ff700 1 -- 172.21.15.59:0/783859512 >> 172.21.15.59:0/783859512 conn(0x7f63880a2aa0 msgr2=0x7f63880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:38.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.873+0000 7f638e4ff700 1 -- 172.21.15.59:0/783859512 shutdown_connections 2023-09-30T22:34:38.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.873+0000 7f638e4ff700 1 -- 172.21.15.59:0/783859512 wait complete. 2023-09-30T22:34:38.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.874+0000 7f638e4ff700 1 Processor -- start 2023-09-30T22:34:38.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.875+0000 7f638e4ff700 1 -- start start 2023-09-30T22:34:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.875+0000 7f638e4ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f638806f680 0x7f63881c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.875+0000 7f638e4ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63880701a0 0x7f63881c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.875+0000 7f638e4ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6388130670 0x7f63881c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.875+0000 7f638e4ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638812bc20 con 0x7f63880701a0 2023-09-30T22:34:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.875+0000 7f638e4ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63881c5d70 con 0x7f638806f680 2023-09-30T22:34:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.875+0000 7f638e4ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f638812c2c0 con 0x7f6388130670 2023-09-30T22:34:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.876+0000 7f638ca9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6388130670 0x7f63881c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.876+0000 7f63877fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63880701a0 0x7f63881c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.876+0000 7f638ca9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6388130670 0x7f63881c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49370/0 (socket says 172.21.15.59:49370) 2023-09-30T22:34:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.876+0000 7f638ca9c700 1 -- 172.21.15.59:0/3311263036 learned_addr learned my addr 172.21.15.59:0/3311263036 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.876+0000 7f638ca9c700 1 -- 172.21.15.59:0/3311263036 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f638806f680 msgr2=0x7f63881c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.876+0000 7f638ca9c700 1 --2- 172.21.15.59:0/3311263036 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f638806f680 0x7f63881c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.876+0000 7f638ca9c700 1 -- 172.21.15.59:0/3311263036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63880701a0 msgr2=0x7f63881c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.876+0000 7f638ca9c700 1 --2- 172.21.15.59:0/3311263036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63880701a0 0x7f63881c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.876+0000 7f638ca9c700 1 -- 172.21.15.59:0/3311263036 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6380009b30 con 0x7f6388130670 2023-09-30T22:34:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.876+0000 7f63877fe700 1 --2- 172.21.15.59:0/3311263036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63880701a0 0x7f63881c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.876+0000 7f638ca9c700 1 --2- 172.21.15.59:0/3311263036 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6388130670 0x7f63881c8330 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6388072130 tx=0x7f6380004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.876+0000 7f6384ff9700 1 -- 172.21.15.59:0/3311263036 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63800099b0 con 0x7f6388130670 2023-09-30T22:34:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.876+0000 7f6384ff9700 1 -- 172.21.15.59:0/3311263036 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6380004250 con 0x7f6388130670 2023-09-30T22:34:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.876+0000 7f638e4ff700 1 -- 172.21.15.59:0/3311263036 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638812a2b0 con 0x7f6388130670 2023-09-30T22:34:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.877+0000 7f6384ff9700 1 -- 172.21.15.59:0/3311263036 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63800045e0 con 0x7f6388130670 2023-09-30T22:34:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.877+0000 7f638e4ff700 1 -- 172.21.15.59:0/3311263036 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6388071870 con 0x7f6388130670 2023-09-30T22:34:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.878+0000 7f6384ff9700 1 -- 172.21.15.59:0/3311263036 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6380004740 con 0x7f6388130670 2023-09-30T22:34:38.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.878+0000 7f638e4ff700 1 -- 172.21.15.59:0/3311263036 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638812fc10 con 0x7f6388130670 2023-09-30T22:34:38.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.878+0000 7f6384ff9700 1 -- 172.21.15.59:0/3311263036 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6380040b20 con 0x7f6388130670 2023-09-30T22:34:38.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.878+0000 7f9dbdffb700 1 -- 172.21.15.59:0/4262596075 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9dc4010380 con 0x7f9dc809de50 2023-09-30T22:34:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.887+0000 7f6384ff9700 1 -- 172.21.15.59:0/3311263036 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f638001a740 con 0x7f6388130670 2023-09-30T22:34:38.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:38.999+0000 7fc5b0983700 1 -- 172.21.15.59:0/3688735505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc5ac06c360 con 0x7fc5ac09e000 2023-09-30T22:34:39.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.000+0000 7fc59affd700 1 -- 172.21.15.59:0/3688735505 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5a001b3b0 con 0x7fc5ac09e000 2023-09-30T22:34:39.000 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:39.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.002+0000 7fc5b0983700 1 -- 172.21.15.59:0/3688735505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5ac09e000 msgr2=0x7fc5ac11e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:39.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.002+0000 7fc5b0983700 1 --2- 172.21.15.59:0/3688735505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5ac09e000 0x7fc5ac11e380 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000e9b0 tx=0x7fc5a000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:34:39.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.002+0000 7fc5b0983700 1 -- 172.21.15.59:0/3688735505 shutdown_connections 2023-09-30T22:34:39.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.002+0000 7fc5b0983700 1 --2- 172.21.15.59:0/3688735505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5ac09e410 0x7fc5ac11e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:39.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.002+0000 7fc5b0983700 1 --2- 172.21.15.59:0/3688735505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5ac09d6f0 0x7fc5ac11de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:39.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.002+0000 7fc5b0983700 1 --2- 172.21.15.59:0/3688735505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5ac09e000 0x7fc5ac11e380 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:39.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.002+0000 7fc5b0983700 1 -- 172.21.15.59:0/3688735505 >> 172.21.15.59:0/3688735505 conn(0x7fc5ac066f50 msgr2=0x7fc5ac06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:39.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.002+0000 7fc5b0983700 1 -- 172.21.15.59:0/3688735505 shutdown_connections 2023-09-30T22:34:39.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.002+0000 7fc5b0983700 1 -- 172.21.15.59:0/3688735505 wait complete. 2023-09-30T22:34:39.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:39.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.085+0000 7f9dcf59a700 1 -- 172.21.15.59:0/4262596075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9dc8074ea0 con 0x7f9dc809de50 2023-09-30T22:34:39.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.086+0000 7f9dbdffb700 1 -- 172.21.15.59:0/4262596075 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9dc4015070 con 0x7f9dc809de50 2023-09-30T22:34:39.086 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:39.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.088+0000 7f9dcf59a700 1 -- 172.21.15.59:0/4262596075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dc809de50 msgr2=0x7f9dc811d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:39.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.088+0000 7f9dcf59a700 1 --2- 172.21.15.59:0/4262596075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dc809de50 0x7f9dc811d720 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40098f0 tx=0x7f9dc4004750 comp rx=0 tx=0).stop 2023-09-30T22:34:39.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.088+0000 7f9dcf59a700 1 -- 172.21.15.59:0/4262596075 shutdown_connections 2023-09-30T22:34:39.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.088+0000 7f9dcf59a700 1 --2- 172.21.15.59:0/4262596075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dc81338a0 0x7f9dc811e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:39.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.088+0000 7f9dcf59a700 1 --2- 172.21.15.59:0/4262596075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dc809de50 0x7f9dc811d720 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:39.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.088+0000 7f9dcf59a700 1 --2- 172.21.15.59:0/4262596075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9dc809e930 0x7f9dc811dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:39.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.088+0000 7f9dcf59a700 1 -- 172.21.15.59:0/4262596075 >> 172.21.15.59:0/4262596075 conn(0x7f9dc80a2aa0 msgr2=0x7f9dc809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:39.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.088+0000 7f9dcf59a700 1 -- 172.21.15.59:0/4262596075 shutdown_connections 2023-09-30T22:34:39.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.088+0000 7f9dcf59a700 1 -- 172.21.15.59:0/4262596075 wait complete. 2023-09-30T22:34:39.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.095+0000 7fe4ec6a1700 1 -- 172.21.15.59:0/3635469113 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe4e4074ea0 con 0x7fe4e409e000 2023-09-30T22:34:39.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.096+0000 7fe4daffd700 1 -- 172.21.15.59:0/3635469113 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4d4010b60 con 0x7fe4e409e000 2023-09-30T22:34:39.096 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.098+0000 7fe4ec6a1700 1 -- 172.21.15.59:0/3635469113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4e409e000 msgr2=0x7fe4e41a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.098+0000 7fe4ec6a1700 1 --2- 172.21.15.59:0/3635469113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4e409e000 0x7fe4e41a5440 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400c4b0 tx=0x7fe4d400c7c0 comp rx=0 tx=0).stop 2023-09-30T22:34:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.098+0000 7fe4ec6a1700 1 -- 172.21.15.59:0/3635469113 shutdown_connections 2023-09-30T22:34:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.098+0000 7fe4ec6a1700 1 --2- 172.21.15.59:0/3635469113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4e409e410 0x7fe4e41a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.098+0000 7fe4ec6a1700 1 --2- 172.21.15.59:0/3635469113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4e409d6f0 0x7fe4e41a4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.098+0000 7fe4ec6a1700 1 --2- 172.21.15.59:0/3635469113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4e409e000 0x7fe4e41a5440 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.098+0000 7fe4ec6a1700 1 -- 172.21.15.59:0/3635469113 >> 172.21.15.59:0/3635469113 conn(0x7fe4e4066f50 msgr2=0x7fe4e41bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.098+0000 7fe4ec6a1700 1 -- 172.21.15.59:0/3635469113 shutdown_connections 2023-09-30T22:34:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.098+0000 7fe4ec6a1700 1 -- 172.21.15.59:0/3635469113 wait complete. 2023-09-30T22:34:39.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:39.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:39.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.128+0000 7f638e4ff700 1 -- 172.21.15.59:0/3311263036 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6388074ea0 con 0x7f6388130670 2023-09-30T22:34:39.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.129+0000 7f6384ff9700 1 -- 172.21.15.59:0/3311263036 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6380011390 con 0x7f6388130670 2023-09-30T22:34:39.129 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:39.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.131+0000 7f638e4ff700 1 -- 172.21.15.59:0/3311263036 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6388130670 msgr2=0x7f63881c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:39.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.131+0000 7f638e4ff700 1 --2- 172.21.15.59:0/3311263036 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6388130670 0x7f63881c8330 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6388072130 tx=0x7f6380004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:39.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.131+0000 7f638e4ff700 1 -- 172.21.15.59:0/3311263036 shutdown_connections 2023-09-30T22:34:39.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.131+0000 7f638e4ff700 1 --2- 172.21.15.59:0/3311263036 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6388130670 0x7f63881c8330 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:39.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.131+0000 7f638e4ff700 1 --2- 172.21.15.59:0/3311263036 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f638806f680 0x7f63881c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:39.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.131+0000 7f638e4ff700 1 --2- 172.21.15.59:0/3311263036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63880701a0 0x7f63881c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:39.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.131+0000 7f638e4ff700 1 -- 172.21.15.59:0/3311263036 >> 172.21.15.59:0/3311263036 conn(0x7f63880a2aa0 msgr2=0x7f638809a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:39.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.131+0000 7f638e4ff700 1 -- 172.21.15.59:0/3311263036 shutdown_connections 2023-09-30T22:34:39.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:39.131+0000 7f638e4ff700 1 -- 172.21.15.59:0/3311263036 wait complete. 2023-09-30T22:34:39.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:40.018 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:40.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:40.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:40.146 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.166+0000 7f5d138c4700 1 Processor -- start 2023-09-30T22:34:40.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.167+0000 7f5d138c4700 1 -- start start 2023-09-30T22:34:40.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.167+0000 7f5d138c4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0c130540 0x7f5d0c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.167+0000 7f5d138c4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d0c06fcf0 0x7f5d0c138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.167+0000 7f5d138c4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0c0716a0 con 0x7f5d0c130e50 2023-09-30T22:34:40.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.167+0000 7f5d138c4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0c09a390 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.167+0000 7f5d138c4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c071290 con 0x7f5d0c130540 2023-09-30T22:34:40.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.168+0000 7f5d10e5f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5d0c130e50 0x7f5d0c06f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34548/0 (socket says 172.21.15.59:34548) 2023-09-30T22:34:40.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.168+0000 7f5d10e5f700 1 -- 172.21.15.59:0/3245769859 learned_addr learned my addr 172.21.15.59:0/3245769859 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:40.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.168+0000 7f5d11e61700 1 --2- 172.21.15.59:0/3245769859 >> v2:172.21.15.59:3300/0 conn(0x7f5d0c06fcf0 0x7f5d0c138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.168+0000 7f5d11660700 1 --2- 172.21.15.59:0/3245769859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0c130540 0x7f5d0c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.168+0000 7f5d11e61700 1 -- 172.21.15.59:0/3245769859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0c130540 msgr2=0x7f5d0c130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:40.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.168+0000 7f5d11e61700 1 --2- 172.21.15.59:0/3245769859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0c130540 0x7f5d0c130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.168+0000 7f5d11e61700 1 -- 172.21.15.59:0/3245769859 >> v1:172.21.15.59:6789/0 conn(0x7f5d0c130e50 legacy=0x7f5d0c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.168+0000 7f5d11e61700 1 -- 172.21.15.59:0/3245769859 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c130340 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.168+0000 7f5d11e61700 1 --2- 172.21.15.59:0/3245769859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0c06fcf0 0x7f5d0c138570 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009d90 tx=0x7f5d0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e6505aafb53734 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:40.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.168+0000 7f5d03fff700 1 -- 172.21.15.59:0/3245769859 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0400e070 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.169+0000 7f5d03fff700 1 -- 172.21.15.59:0/3245769859 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0400bb20 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.169+0000 7f5d03fff700 1 -- 172.21.15.59:0/3245769859 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d04012430 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.169+0000 7f5d138c4700 1 -- 172.21.15.59:0/3245769859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0c06fcf0 msgr2=0x7f5d0c138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.169+0000 7f5d138c4700 1 --2- 172.21.15.59:0/3245769859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0c06fcf0 0x7f5d0c138570 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009d90 tx=0x7f5d0400b330 comp rx=0 tx=0).stop 2023-09-30T22:34:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.169+0000 7f5d138c4700 1 -- 172.21.15.59:0/3245769859 shutdown_connections 2023-09-30T22:34:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.169+0000 7f5d138c4700 1 --2- 172.21.15.59:0/3245769859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0c06fcf0 0x7f5d0c138570 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.169+0000 7f5d138c4700 1 --2- 172.21.15.59:0/3245769859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0c130540 0x7f5d0c130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.169+0000 7f5d138c4700 1 -- 172.21.15.59:0/3245769859 >> 172.21.15.59:0/3245769859 conn(0x7f5d0c0a2aa0 msgr2=0x7f5d0c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.172+0000 7f5d138c4700 1 -- 172.21.15.59:0/3245769859 shutdown_connections 2023-09-30T22:34:40.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.172+0000 7f5d138c4700 1 -- 172.21.15.59:0/3245769859 wait complete. 2023-09-30T22:34:40.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.173+0000 7f5d138c4700 1 Processor -- start 2023-09-30T22:34:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.173+0000 7f5d138c4700 1 -- start start 2023-09-30T22:34:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d138c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0c06fcf0 0x7f5d0c1c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d138c4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0c130540 0x7f5d0c1c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d138c4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0c130e50 0x7f5d0c1c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d138c4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c1230d0 con 0x7f5d0c130e50 2023-09-30T22:34:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d138c4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c11e7f0 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d138c4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c1236e0 con 0x7f5d0c130540 2023-09-30T22:34:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d11660700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0c06fcf0 0x7f5d0c1c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d11660700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0c06fcf0 0x7f5d0c1c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36388/0 (socket says 172.21.15.59:36388) 2023-09-30T22:34:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d11660700 1 -- 172.21.15.59:0/3895120018 learned_addr learned my addr 172.21.15.59:0/3895120018 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d10e5f700 1 --2- 172.21.15.59:0/3895120018 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0c130540 0x7f5d0c1c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d11e61700 1 --2- 172.21.15.59:0/3895120018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0c130e50 0x7f5d0c1c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d11660700 1 -- 172.21.15.59:0/3895120018 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0c130540 msgr2=0x7f5d0c1c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d11660700 1 --2- 172.21.15.59:0/3895120018 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0c130540 0x7f5d0c1c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d11660700 1 -- 172.21.15.59:0/3895120018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0c130e50 msgr2=0x7f5d0c1c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d11660700 1 --2- 172.21.15.59:0/3895120018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0c130e50 0x7f5d0c1c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d11660700 1 -- 172.21.15.59:0/3895120018 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d04009a70 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.174+0000 7f5d11e61700 1 --2- 172.21.15.59:0/3895120018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0c130e50 0x7f5d0c1c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.175+0000 7f5d11660700 1 --2- 172.21.15.59:0/3895120018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0c06fcf0 0x7f5d0c1c8360 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800e9b0 tx=0x7f5d0800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.175+0000 7f5d01ffb700 1 -- 172.21.15.59:0/3895120018 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d08009710 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.175+0000 7f5d01ffb700 1 -- 172.21.15.59:0/3895120018 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0800c850 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.175+0000 7f5d138c4700 1 -- 172.21.15.59:0/3895120018 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0c0a1c10 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.175+0000 7f5d01ffb700 1 -- 172.21.15.59:0/3895120018 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0800cbc0 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.175+0000 7f5d138c4700 1 -- 172.21.15.59:0/3895120018 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0c123400 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.176+0000 7f5d138c4700 1 -- 172.21.15.59:0/3895120018 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0c074ea0 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.177+0000 7f5d01ffb700 1 -- 172.21.15.59:0/3895120018 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d0800cd20 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.177+0000 7f5d01ffb700 1 -- 172.21.15.59:0/3895120018 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5d08040070 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.183+0000 7f5d01ffb700 1 -- 172.21.15.59:0/3895120018 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d0801a360 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.274+0000 7f2e4abda700 1 Processor -- start 2023-09-30T22:34:40.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.274+0000 7f2e4abda700 1 -- start start 2023-09-30T22:34:40.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.275+0000 7f2e4abda700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e44134630 0x7f2e44136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.275+0000 7f2e4abda700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e44136f50 0x7f2e44139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.275+0000 7f2e4abda700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4409b4f0 con 0x7f2e44131810 2023-09-30T22:34:40.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.275+0000 7f2e4abda700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e441313c0 con 0x7f2e44136f50 2023-09-30T22:34:40.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.275+0000 7f2e4abda700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4406e8c0 con 0x7f2e44134630 2023-09-30T22:34:40.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.276+0000 7f2e49177700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e44136f50 0x7f2e44139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.276+0000 7f2e49177700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e44136f50 0x7f2e44139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53184/0 (socket says 172.21.15.59:53184) 2023-09-30T22:34:40.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.276+0000 7f2e49177700 1 -- 172.21.15.59:0/3726074173 learned_addr learned my addr 172.21.15.59:0/3726074173 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:40.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.276+0000 7f2e43fff700 1 --2- 172.21.15.59:0/3726074173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e44134630 0x7f2e44136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.276+0000 7f2e49177700 1 -- 172.21.15.59:0/3726074173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e44134630 msgr2=0x7f2e44136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.276+0000 7f2e49177700 1 --2- 172.21.15.59:0/3726074173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e44134630 0x7f2e44136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.276+0000 7f2e49177700 1 -- 172.21.15.59:0/3726074173 >> v1:172.21.15.59:6789/0 conn(0x7f2e44131810 legacy=0x7f2e44131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.276+0000 7f2e49177700 1 -- 172.21.15.59:0/3726074173 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e44071d20 con 0x7f2e44136f50 2023-09-30T22:34:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.276+0000 7f2e49177700 1 --2- 172.21.15.59:0/3726074173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e44136f50 0x7f2e44139330 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009e50 tx=0x7f2e3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0188990157fc928 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.276+0000 7f2e437fe700 1 -- 172.21.15.59:0/3726074173 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00e070 con 0x7f2e44136f50 2023-09-30T22:34:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.276+0000 7f2e437fe700 1 -- 172.21.15.59:0/3726074173 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c00b910 con 0x7f2e44136f50 2023-09-30T22:34:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.276+0000 7f2e437fe700 1 -- 172.21.15.59:0/3726074173 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00bcc0 con 0x7f2e44136f50 2023-09-30T22:34:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.277+0000 7f2e4abda700 1 -- 172.21.15.59:0/3726074173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e44136f50 msgr2=0x7f2e44139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.277+0000 7f2e4abda700 1 --2- 172.21.15.59:0/3726074173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e44136f50 0x7f2e44139330 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009e50 tx=0x7f2e3c00b330 comp rx=0 tx=0).stop 2023-09-30T22:34:40.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.277+0000 7f2e4abda700 1 -- 172.21.15.59:0/3726074173 shutdown_connections 2023-09-30T22:34:40.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.277+0000 7f2e4abda700 1 --2- 172.21.15.59:0/3726074173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e44136f50 0x7f2e44139330 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.277+0000 7f2e4abda700 1 --2- 172.21.15.59:0/3726074173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e44134630 0x7f2e44136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.277+0000 7f2e4abda700 1 -- 172.21.15.59:0/3726074173 >> 172.21.15.59:0/3726074173 conn(0x7f2e440a2aa0 msgr2=0x7f2e440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:40.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.277+0000 7f2e4abda700 1 -- 172.21.15.59:0/3726074173 shutdown_connections 2023-09-30T22:34:40.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.278+0000 7f2e4abda700 1 -- 172.21.15.59:0/3726074173 wait complete. 2023-09-30T22:34:40.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.279+0000 7f2e4abda700 1 Processor -- start 2023-09-30T22:34:40.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.279+0000 7f2e4abda700 1 -- start start 2023-09-30T22:34:40.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.279+0000 7f2e4abda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e44131810 0x7f2e441c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.279+0000 7f2e4abda700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e44134630 0x7f2e441c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.279+0000 7f2e4abda700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e44136f50 0x7f2e44118f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.279+0000 7f2e4abda700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4411cae0 con 0x7f2e44136f50 2023-09-30T22:34:40.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.279+0000 7f2e4abda700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e440a2060 con 0x7f2e44131810 2023-09-30T22:34:40.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.279+0000 7f2e4abda700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4411c650 con 0x7f2e44134630 2023-09-30T22:34:40.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.279+0000 7f2e48976700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e44131810 0x7f2e441c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.279+0000 7f2e48976700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e44131810 0x7f2e441c64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36392/0 (socket says 172.21.15.59:36392) 2023-09-30T22:34:40.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.279+0000 7f2e48976700 1 -- 172.21.15.59:0/3079024410 learned_addr learned my addr 172.21.15.59:0/3079024410 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:40.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.280+0000 7f2e49177700 1 --2- 172.21.15.59:0/3079024410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e44136f50 0x7f2e44118f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.280+0000 7f2e43fff700 1 --2- 172.21.15.59:0/3079024410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e44134630 0x7f2e441c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.280+0000 7f2e48976700 1 -- 172.21.15.59:0/3079024410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e44134630 msgr2=0x7f2e441c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.280+0000 7f2e48976700 1 --2- 172.21.15.59:0/3079024410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e44134630 0x7f2e441c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.280+0000 7f2e48976700 1 -- 172.21.15.59:0/3079024410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e44136f50 msgr2=0x7f2e44118f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.280+0000 7f2e48976700 1 --2- 172.21.15.59:0/3079024410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e44136f50 0x7f2e44118f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.280+0000 7f2e48976700 1 -- 172.21.15.59:0/3079024410 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c009b30 con 0x7f2e44131810 2023-09-30T22:34:40.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.280+0000 7f2e49177700 1 --2- 172.21.15.59:0/3079024410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e44136f50 0x7f2e44118f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:40.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.280+0000 7f2e48976700 1 --2- 172.21.15.59:0/3079024410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e44131810 0x7f2e441c64c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800c450 tx=0x7f2e3800c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:40.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.280+0000 7f2e417fa700 1 -- 172.21.15.59:0/3079024410 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e380052d0 con 0x7f2e44131810 2023-09-30T22:34:40.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.280+0000 7f2e417fa700 1 -- 172.21.15.59:0/3079024410 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e38005430 con 0x7f2e44131810 2023-09-30T22:34:40.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.280+0000 7f2e4abda700 1 -- 172.21.15.59:0/3079024410 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4411c320 con 0x7f2e44131810 2023-09-30T22:34:40.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.280+0000 7f2e417fa700 1 -- 172.21.15.59:0/3079024410 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e380038c0 con 0x7f2e44131810 2023-09-30T22:34:40.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.281+0000 7f2e4abda700 1 -- 172.21.15.59:0/3079024410 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e441c6f40 con 0x7f2e44131810 2023-09-30T22:34:40.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.281+0000 7f2e417fa700 1 -- 172.21.15.59:0/3079024410 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e38003a20 con 0x7f2e44131810 2023-09-30T22:34:40.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.282+0000 7f2e417fa700 1 -- 172.21.15.59:0/3079024410 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2e3803eb30 con 0x7f2e44131810 2023-09-30T22:34:40.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.282+0000 7f2e4abda700 1 -- 172.21.15.59:0/3079024410 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e44074ea0 con 0x7f2e44131810 2023-09-30T22:34:40.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.288+0000 7f2e417fa700 1 -- 172.21.15.59:0/3079024410 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e38018260 con 0x7f2e44131810 2023-09-30T22:34:40.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.294+0000 7f8b1d016700 1 Processor -- start 2023-09-30T22:34:40.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.294+0000 7f8b1d016700 1 -- start start 2023-09-30T22:34:40.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.294+0000 7f8b1d016700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b1809e930 0x7f8b1809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.294+0000 7f8b1d016700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b1809f240 0x7f8b181317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.294+0000 7f8b1d016700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b1809f650 0x7f8b18131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.294+0000 7f8b1d016700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b18070940 con 0x7f8b1809f650 2023-09-30T22:34:40.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.294+0000 7f8b1d016700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1806fd60 con 0x7f8b1809e930 2023-09-30T22:34:40.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.294+0000 7f8b1d016700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1806fa80 con 0x7f8b1809f240 2023-09-30T22:34:40.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.295+0000 7f8b1759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b1809f650 0x7f8b18131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.295+0000 7f8b1759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b1809f650 0x7f8b18131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53210/0 (socket says 172.21.15.59:53210) 2023-09-30T22:34:40.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.295+0000 7f8b1759e700 1 -- 172.21.15.59:0/3085765816 learned_addr learned my addr 172.21.15.59:0/3085765816 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:40.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.295+0000 7f8b1759e700 1 -- 172.21.15.59:0/3085765816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b1809f240 msgr2=0x7f8b181317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:40.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.295+0000 7f8b1759e700 1 --2- 172.21.15.59:0/3085765816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b1809f240 0x7f8b181317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.295+0000 7f8b1759e700 1 -- 172.21.15.59:0/3085765816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b1809e930 msgr2=0x7f8b1809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:40.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.295+0000 7f8b1759e700 1 --2- 172.21.15.59:0/3085765816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b1809e930 0x7f8b1809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.295+0000 7f8b1759e700 1 -- 172.21.15.59:0/3085765816 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1809fb60 con 0x7f8b1809f650 2023-09-30T22:34:40.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.295+0000 7f8b1759e700 1 --2- 172.21.15.59:0/3085765816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b1809f650 0x7f8b18131d30 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f8b100098f0 tx=0x7f8b10009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8a9a0500e2de7d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:40.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.295+0000 7f8b15d9b700 1 -- 172.21.15.59:0/3085765816 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000b8a0 con 0x7f8b1809f650 2023-09-30T22:34:40.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.295+0000 7f8b15d9b700 1 -- 172.21.15.59:0/3085765816 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1000ba00 con 0x7f8b1809f650 2023-09-30T22:34:40.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.295+0000 7f8b15d9b700 1 -- 172.21.15.59:0/3085765816 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000bd90 con 0x7f8b1809f650 2023-09-30T22:34:40.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.296+0000 7f8b1d016700 1 -- 172.21.15.59:0/3085765816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b1809f650 msgr2=0x7f8b18131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.296+0000 7f8b1d016700 1 --2- 172.21.15.59:0/3085765816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b1809f650 0x7f8b18131d30 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f8b100098f0 tx=0x7f8b10009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:40.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.296+0000 7f8b1d016700 1 -- 172.21.15.59:0/3085765816 shutdown_connections 2023-09-30T22:34:40.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.296+0000 7f8b1d016700 1 --2- 172.21.15.59:0/3085765816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b1809f650 0x7f8b18131d30 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.296+0000 7f8b1d016700 1 --2- 172.21.15.59:0/3085765816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b1809e930 0x7f8b1809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.296+0000 7f8b1d016700 1 --2- 172.21.15.59:0/3085765816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b1809f240 0x7f8b181317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.296+0000 7f8b1d016700 1 -- 172.21.15.59:0/3085765816 >> 172.21.15.59:0/3085765816 conn(0x7f8b180a4210 msgr2=0x7f8b180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:40.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.296+0000 7f8b1d016700 1 -- 172.21.15.59:0/3085765816 shutdown_connections 2023-09-30T22:34:40.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.296+0000 7f8b1d016700 1 -- 172.21.15.59:0/3085765816 wait complete. 2023-09-30T22:34:40.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.298+0000 7f8b1d016700 1 Processor -- start 2023-09-30T22:34:40.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.298+0000 7f8b1d016700 1 -- start start 2023-09-30T22:34:40.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.298+0000 7f8b1d016700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b1809e930 0x7f8b181a3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.298+0000 7f8b1d016700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b1809f240 0x7f8b181a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.298+0000 7f8b1d016700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b1809f650 0x7f8b181a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.298+0000 7f8b1d016700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b181a5a10 con 0x7f8b1809f240 2023-09-30T22:34:40.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.298+0000 7f8b1d016700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b181a6c60 con 0x7f8b1809e930 2023-09-30T22:34:40.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.298+0000 7f8b1d016700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b181a5ff0 con 0x7f8b1809f650 2023-09-30T22:34:40.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.298+0000 7f8b1659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b1809f240 0x7f8b181a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.298+0000 7f8b1659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b1809f240 0x7f8b181a4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53216/0 (socket says 172.21.15.59:53216) 2023-09-30T22:34:40.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.298+0000 7f8b1659c700 1 -- 172.21.15.59:0/2851562723 learned_addr learned my addr 172.21.15.59:0/2851562723 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:40.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.298+0000 7f8b16d9d700 1 --2- 172.21.15.59:0/2851562723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b1809e930 0x7f8b181a3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.299+0000 7f8b1759e700 1 --2- 172.21.15.59:0/2851562723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b1809f650 0x7f8b181a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.299+0000 7f8b1659c700 1 -- 172.21.15.59:0/2851562723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b1809f650 msgr2=0x7f8b181a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.299+0000 7f8b1659c700 1 --2- 172.21.15.59:0/2851562723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b1809f650 0x7f8b181a48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.299+0000 7f8b1659c700 1 -- 172.21.15.59:0/2851562723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b1809e930 msgr2=0x7f8b181a3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.299+0000 7f8b1659c700 1 --2- 172.21.15.59:0/2851562723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b1809e930 0x7f8b181a3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.299+0000 7f8b1659c700 1 -- 172.21.15.59:0/2851562723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b10009550 con 0x7f8b1809f240 2023-09-30T22:34:40.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.299+0000 7f8b1759e700 1 --2- 172.21.15.59:0/2851562723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b1809f650 0x7f8b181a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:40.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.299+0000 7f8b16d9d700 1 --2- 172.21.15.59:0/2851562723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b1809e930 0x7f8b181a3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:40.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.299+0000 7f8b1659c700 1 --2- 172.21.15.59:0/2851562723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b1809f240 0x7f8b181a4390 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00b530 tx=0x7f8b0c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:40.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.299+0000 7f8aff7fe700 1 -- 172.21.15.59:0/2851562723 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c011830 con 0x7f8b1809f240 2023-09-30T22:34:40.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.299+0000 7f8aff7fe700 1 -- 172.21.15.59:0/2851562723 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c0119b0 con 0x7f8b1809f240 2023-09-30T22:34:40.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.299+0000 7f8aff7fe700 1 -- 172.21.15.59:0/2851562723 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c011d60 con 0x7f8b1809f240 2023-09-30T22:34:40.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.299+0000 7f8b1d016700 1 -- 172.21.15.59:0/2851562723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b180a0190 con 0x7f8b1809f240 2023-09-30T22:34:40.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.300+0000 7f8b1d016700 1 -- 172.21.15.59:0/2851562723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b180a35c0 con 0x7f8b1809f240 2023-09-30T22:34:40.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.302+0000 7f8aff7fe700 1 -- 172.21.15.59:0/2851562723 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b0c01a400 con 0x7f8b1809f240 2023-09-30T22:34:40.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.302+0000 7f8aff7fe700 1 -- 172.21.15.59:0/2851562723 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8b0c03f7d0 con 0x7f8b1809f240 2023-09-30T22:34:40.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.302+0000 7f8b1d016700 1 -- 172.21.15.59:0/2851562723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b18071d80 con 0x7f8b1809f240 2023-09-30T22:34:40.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.307+0000 7f8aff7fe700 1 -- 172.21.15.59:0/2851562723 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b0c015020 con 0x7f8b1809f240 2023-09-30T22:34:40.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.310+0000 7ff21bafd700 1 Processor -- start 2023-09-30T22:34:40.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.310+0000 7ff21bafd700 1 -- start start 2023-09-30T22:34:40.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.311+0000 7ff21bafd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2141338a0 0x7ff214133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.311+0000 7ff21bafd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff21409de50 0x7ff21409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.311+0000 7ff21bafd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21406ef30 con 0x7ff21409e760 2023-09-30T22:34:40.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.311+0000 7ff21bafd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21406fef0 con 0x7ff2141338a0 2023-09-30T22:34:40.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.311+0000 7ff21bafd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2141334b0 con 0x7ff21409de50 2023-09-30T22:34:40.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.312+0000 7ff219098700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff21409de50 0x7ff21409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.312+0000 7ff219098700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff21409de50 0x7ff21409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49424/0 (socket says 172.21.15.59:49424) 2023-09-30T22:34:40.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.312+0000 7ff219098700 1 -- 172.21.15.59:0/1309991240 learned_addr learned my addr 172.21.15.59:0/1309991240 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:40.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.313+0000 7ff219098700 1 -- 172.21.15.59:0/1309991240 >> v2:172.21.15.59:3300/0 conn(0x7ff2141338a0 msgr2=0x7ff214133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:40.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.313+0000 7ff219098700 1 --2- 172.21.15.59:0/1309991240 >> v2:172.21.15.59:3300/0 conn(0x7ff2141338a0 0x7ff214133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.313+0000 7ff219098700 1 -- 172.21.15.59:0/1309991240 >> v1:172.21.15.59:6789/0 conn(0x7ff21409e760 legacy=0x7ff21413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:40.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.313+0000 7ff219098700 1 -- 172.21.15.59:0/1309991240 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21406fc30 con 0x7ff21409de50 2023-09-30T22:34:40.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.313+0000 7ff219098700 1 --2- 172.21.15.59:0/1309991240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff21409de50 0x7ff21409e220 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff2040098f0 tx=0x7ff204009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af7166a43e50588e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:40.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.315+0000 7ff218897700 1 -- 172.21.15.59:0/1309991240 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff204004230 con 0x7ff21409de50 2023-09-30T22:34:40.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.315+0000 7ff218897700 1 -- 172.21.15.59:0/1309991240 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff204004390 con 0x7ff21409de50 2023-09-30T22:34:40.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.315+0000 7ff218897700 1 -- 172.21.15.59:0/1309991240 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2040036a0 con 0x7ff21409de50 2023-09-30T22:34:40.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.316+0000 7ff21bafd700 1 -- 172.21.15.59:0/1309991240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff21409de50 msgr2=0x7ff21409e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.316+0000 7ff21bafd700 1 --2- 172.21.15.59:0/1309991240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff21409de50 0x7ff21409e220 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff2040098f0 tx=0x7ff204009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:40.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.316+0000 7ff21bafd700 1 -- 172.21.15.59:0/1309991240 shutdown_connections 2023-09-30T22:34:40.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.316+0000 7ff21bafd700 1 --2- 172.21.15.59:0/1309991240 >> v2:172.21.15.59:3300/0 conn(0x7ff2141338a0 0x7ff214133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.316+0000 7ff21bafd700 1 --2- 172.21.15.59:0/1309991240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff21409de50 0x7ff21409e220 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.316+0000 7ff21bafd700 1 -- 172.21.15.59:0/1309991240 >> 172.21.15.59:0/1309991240 conn(0x7ff2140a2aa0 msgr2=0x7ff2140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:40.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.316+0000 7ff21bafd700 1 -- 172.21.15.59:0/1309991240 shutdown_connections 2023-09-30T22:34:40.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.316+0000 7ff21bafd700 1 -- 172.21.15.59:0/1309991240 wait complete. 2023-09-30T22:34:40.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.317+0000 7ff21bafd700 1 Processor -- start 2023-09-30T22:34:40.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.318+0000 7ff21bafd700 1 -- start start 2023-09-30T22:34:40.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.318+0000 7ff21bafd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff21409de50 0x7ff21411ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.318+0000 7ff21bafd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff21409e760 0x7ff21411f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.318+0000 7ff21bafd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2141338a0 0x7ff21411f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:40.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.318+0000 7ff21bafd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff214122700 con 0x7ff2141338a0 2023-09-30T22:34:40.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.318+0000 7ff21bafd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21412fb30 con 0x7ff21409e760 2023-09-30T22:34:40.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.318+0000 7ff21bafd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2141207f0 con 0x7ff21409de50 2023-09-30T22:34:40.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.318+0000 7ff219899700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff21409de50 0x7ff21411ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.319+0000 7ff219899700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff21409de50 0x7ff21411ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49440/0 (socket says 172.21.15.59:49440) 2023-09-30T22:34:40.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.319+0000 7ff219899700 1 -- 172.21.15.59:0/2469610300 learned_addr learned my addr 172.21.15.59:0/2469610300 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:40.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.319+0000 7ff21a09a700 1 --2- 172.21.15.59:0/2469610300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2141338a0 0x7ff21411f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.319+0000 7ff219098700 1 --2- 172.21.15.59:0/2469610300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff21409e760 0x7ff21411f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:40.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.319+0000 7ff219899700 1 -- 172.21.15.59:0/2469610300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff21409e760 msgr2=0x7ff21411f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.319+0000 7ff219899700 1 --2- 172.21.15.59:0/2469610300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff21409e760 0x7ff21411f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.319+0000 7ff219899700 1 -- 172.21.15.59:0/2469610300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2141338a0 msgr2=0x7ff21411f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.319+0000 7ff219899700 1 --2- 172.21.15.59:0/2469610300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2141338a0 0x7ff21411f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.319+0000 7ff219899700 1 -- 172.21.15.59:0/2469610300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff204009550 con 0x7ff21409de50 2023-09-30T22:34:40.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.319+0000 7ff219899700 1 --2- 172.21.15.59:0/2469610300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff21409de50 0x7ff21411ec80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff21000b530 tx=0x7ff21000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:40.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.319+0000 7ff20a7fc700 1 -- 172.21.15.59:0/2469610300 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210011830 con 0x7ff21409de50 2023-09-30T22:34:40.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.320+0000 7ff20a7fc700 1 -- 172.21.15.59:0/2469610300 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff210011990 con 0x7ff21409de50 2023-09-30T22:34:40.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.320+0000 7ff21bafd700 1 -- 172.21.15.59:0/2469610300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2140a10f0 con 0x7ff21409de50 2023-09-30T22:34:40.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.320+0000 7ff20a7fc700 1 -- 172.21.15.59:0/2469610300 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210011d40 con 0x7ff21409de50 2023-09-30T22:34:40.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.320+0000 7ff21bafd700 1 -- 172.21.15.59:0/2469610300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff214122e90 con 0x7ff21409de50 2023-09-30T22:34:40.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.321+0000 7ff21bafd700 1 -- 172.21.15.59:0/2469610300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff214074ea0 con 0x7ff21409de50 2023-09-30T22:34:40.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.321+0000 7ff20a7fc700 1 -- 172.21.15.59:0/2469610300 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff21001a400 con 0x7ff21409de50 2023-09-30T22:34:40.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.321+0000 7ff20a7fc700 1 -- 172.21.15.59:0/2469610300 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff21003f830 con 0x7ff21409de50 2023-09-30T22:34:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.330+0000 7ff20a7fc700 1 -- 172.21.15.59:0/2469610300 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff21000f8d0 con 0x7ff21409de50 2023-09-30T22:34:40.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.422+0000 7f5d138c4700 1 -- 172.21.15.59:0/3895120018 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5d0c06b9e0 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.423+0000 7f5d01ffb700 1 -- 172.21.15.59:0/3895120018 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d08021090 con 0x7f5d0c06fcf0 2023-09-30T22:34:40.423 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:40.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.426+0000 7f5d138c4700 1 -- 172.21.15.59:0/3895120018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0c06fcf0 msgr2=0x7f5d0c1c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.426+0000 7f5d138c4700 1 --2- 172.21.15.59:0/3895120018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0c06fcf0 0x7f5d0c1c8360 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800e9b0 tx=0x7f5d0800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.426+0000 7f5d138c4700 1 -- 172.21.15.59:0/3895120018 shutdown_connections 2023-09-30T22:34:40.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.426+0000 7f5d138c4700 1 --2- 172.21.15.59:0/3895120018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d0c130e50 0x7f5d0c1c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.426+0000 7f5d138c4700 1 --2- 172.21.15.59:0/3895120018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d0c06fcf0 0x7f5d0c1c8360 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.426+0000 7f5d138c4700 1 --2- 172.21.15.59:0/3895120018 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d0c130540 0x7f5d0c1c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.426+0000 7f5d138c4700 1 -- 172.21.15.59:0/3895120018 >> 172.21.15.59:0/3895120018 conn(0x7f5d0c0a2aa0 msgr2=0x7f5d0c09c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:40.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.428+0000 7f5d138c4700 1 -- 172.21.15.59:0/3895120018 shutdown_connections 2023-09-30T22:34:40.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.428+0000 7f5d138c4700 1 -- 172.21.15.59:0/3895120018 wait complete. 2023-09-30T22:34:40.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:40.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.507+0000 7f2e4abda700 1 -- 172.21.15.59:0/3079024410 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e44136cb0 con 0x7f2e44131810 2023-09-30T22:34:40.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.507+0000 7f2e417fa700 1 -- 172.21.15.59:0/3079024410 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e38017020 con 0x7f2e44131810 2023-09-30T22:34:40.508 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:40.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.510+0000 7f2e4abda700 1 -- 172.21.15.59:0/3079024410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e44131810 msgr2=0x7f2e441c64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.510+0000 7f2e4abda700 1 --2- 172.21.15.59:0/3079024410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e44131810 0x7f2e441c64c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800c450 tx=0x7f2e3800c760 comp rx=0 tx=0).stop 2023-09-30T22:34:40.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.510+0000 7f2e4abda700 1 -- 172.21.15.59:0/3079024410 shutdown_connections 2023-09-30T22:34:40.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.510+0000 7f2e4abda700 1 --2- 172.21.15.59:0/3079024410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e44136f50 0x7f2e44118f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.510+0000 7f2e4abda700 1 --2- 172.21.15.59:0/3079024410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e44131810 0x7f2e441c64c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.510+0000 7f2e4abda700 1 --2- 172.21.15.59:0/3079024410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e44134630 0x7f2e441c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.510+0000 7f2e4abda700 1 -- 172.21.15.59:0/3079024410 >> 172.21.15.59:0/3079024410 conn(0x7f2e440a2aa0 msgr2=0x7f2e441331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:40.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.510+0000 7f2e4abda700 1 -- 172.21.15.59:0/3079024410 shutdown_connections 2023-09-30T22:34:40.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.510+0000 7f2e4abda700 1 -- 172.21.15.59:0/3079024410 wait complete. 2023-09-30T22:34:40.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.531+0000 7f8b1d016700 1 -- 172.21.15.59:0/2851562723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8b18074ea0 con 0x7f8b1809f240 2023-09-30T22:34:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.531+0000 7f8aff7fe700 1 -- 172.21.15.59:0/2851562723 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b0c029090 con 0x7f8b1809f240 2023-09-30T22:34:40.531 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.534+0000 7f8b1d016700 1 -- 172.21.15.59:0/2851562723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b1809f240 msgr2=0x7f8b181a4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.534+0000 7f8b1d016700 1 --2- 172.21.15.59:0/2851562723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b1809f240 0x7f8b181a4390 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00b530 tx=0x7f8b0c00b840 comp rx=0 tx=0).stop 2023-09-30T22:34:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.534+0000 7f8b1d016700 1 -- 172.21.15.59:0/2851562723 shutdown_connections 2023-09-30T22:34:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.534+0000 7f8b1d016700 1 --2- 172.21.15.59:0/2851562723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b1809f650 0x7f8b181a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.534+0000 7f8b1d016700 1 --2- 172.21.15.59:0/2851562723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b1809e930 0x7f8b181a3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.534+0000 7f8b1d016700 1 --2- 172.21.15.59:0/2851562723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b1809f240 0x7f8b181a4390 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.534+0000 7f8b1d016700 1 -- 172.21.15.59:0/2851562723 >> 172.21.15.59:0/2851562723 conn(0x7f8b180a4210 msgr2=0x7f8b181b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.534+0000 7f8b1d016700 1 -- 172.21.15.59:0/2851562723 shutdown_connections 2023-09-30T22:34:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.534+0000 7f8b1d016700 1 -- 172.21.15.59:0/2851562723 wait complete. 2023-09-30T22:34:40.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.540+0000 7ff21bafd700 1 -- 172.21.15.59:0/2469610300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff21406b9e0 con 0x7ff21409de50 2023-09-30T22:34:40.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.540+0000 7ff20a7fc700 1 -- 172.21.15.59:0/2469610300 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff210015030 con 0x7ff21409de50 2023-09-30T22:34:40.541 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:40.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.543+0000 7ff21bafd700 1 -- 172.21.15.59:0/2469610300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff21409de50 msgr2=0x7ff21411ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:40.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.543+0000 7ff21bafd700 1 --2- 172.21.15.59:0/2469610300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff21409de50 0x7ff21411ec80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff21000b530 tx=0x7ff21000b840 comp rx=0 tx=0).stop 2023-09-30T22:34:40.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.543+0000 7ff21bafd700 1 -- 172.21.15.59:0/2469610300 shutdown_connections 2023-09-30T22:34:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.543+0000 7ff21bafd700 1 --2- 172.21.15.59:0/2469610300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff21409de50 0x7ff21411ec80 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.543+0000 7ff21bafd700 1 --2- 172.21.15.59:0/2469610300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2141338a0 0x7ff21411f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.543+0000 7ff21bafd700 1 --2- 172.21.15.59:0/2469610300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff21409e760 0x7ff21411f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.543+0000 7ff21bafd700 1 -- 172.21.15.59:0/2469610300 >> 172.21.15.59:0/2469610300 conn(0x7ff2140a2aa0 msgr2=0x7ff21409ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.543+0000 7ff21bafd700 1 -- 172.21.15.59:0/2469610300 shutdown_connections 2023-09-30T22:34:40.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:40.543+0000 7ff21bafd700 1 -- 172.21.15.59:0/2469610300 wait complete. 2023-09-30T22:34:40.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:40.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:41.448 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:41.525 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:41.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:41.557 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:41.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.602+0000 7fa6da3b0700 1 Processor -- start 2023-09-30T22:34:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.603+0000 7fa6da3b0700 1 -- start start 2023-09-30T22:34:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.603+0000 7fa6da3b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa6d409e930 0x7fa6d409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.603+0000 7fa6da3b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6d409f650 0x7fa6d4131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.603+0000 7fa6da3b0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d4070940 con 0x7fa6d409f240 2023-09-30T22:34:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.603+0000 7fa6da3b0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d406fd60 con 0x7fa6d409e930 2023-09-30T22:34:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.603+0000 7fa6da3b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d406fa80 con 0x7fa6d409f650 2023-09-30T22:34:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.603+0000 7fa6d37fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa6d409f240 0x7fa6d41317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34576/0 (socket says 172.21.15.59:34576) 2023-09-30T22:34:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.603+0000 7fa6d37fe700 1 -- 172.21.15.59:0/4204283813 learned_addr learned my addr 172.21.15.59:0/4204283813 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.603+0000 7fa6d3fff700 1 --2- 172.21.15.59:0/4204283813 >> v2:172.21.15.59:3300/0 conn(0x7fa6d409e930 0x7fa6d409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.604+0000 7fa6d3fff700 1 -- 172.21.15.59:0/4204283813 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6d409f650 msgr2=0x7fa6d4131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.604+0000 7fa6d3fff700 1 --2- 172.21.15.59:0/4204283813 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6d409f650 0x7fa6d4131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.604+0000 7fa6d3fff700 1 -- 172.21.15.59:0/4204283813 >> v1:172.21.15.59:6789/0 conn(0x7fa6d409f240 legacy=0x7fa6d41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.604+0000 7fa6d3fff700 1 -- 172.21.15.59:0/4204283813 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d409fb60 con 0x7fa6d409e930 2023-09-30T22:34:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.604+0000 7fa6d3fff700 1 --2- 172.21.15.59:0/4204283813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d409e930 0x7fa6d409ed00 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009840 tx=0x7fa6c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1cff10e2e8d0f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.604+0000 7fa6d2ffd700 1 -- 172.21.15.59:0/4204283813 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4011830 con 0x7fa6d409e930 2023-09-30T22:34:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.604+0000 7fa6d2ffd700 1 -- 172.21.15.59:0/4204283813 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c4011990 con 0x7fa6d409e930 2023-09-30T22:34:41.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.604+0000 7fa6d2ffd700 1 -- 172.21.15.59:0/4204283813 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4011d20 con 0x7fa6d409e930 2023-09-30T22:34:41.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.605+0000 7fa6da3b0700 1 -- 172.21.15.59:0/4204283813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d409e930 msgr2=0x7fa6d409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.605+0000 7fa6da3b0700 1 --2- 172.21.15.59:0/4204283813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d409e930 0x7fa6d409ed00 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009840 tx=0x7fa6c4009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:41.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.605+0000 7fa6da3b0700 1 -- 172.21.15.59:0/4204283813 shutdown_connections 2023-09-30T22:34:41.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.605+0000 7fa6da3b0700 1 --2- 172.21.15.59:0/4204283813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d409e930 0x7fa6d409ed00 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.605+0000 7fa6da3b0700 1 --2- 172.21.15.59:0/4204283813 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6d409f650 0x7fa6d4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.605+0000 7fa6da3b0700 1 -- 172.21.15.59:0/4204283813 >> 172.21.15.59:0/4204283813 conn(0x7fa6d40a4210 msgr2=0x7fa6d40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:41.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.606+0000 7fa6da3b0700 1 -- 172.21.15.59:0/4204283813 shutdown_connections 2023-09-30T22:34:41.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.606+0000 7fa6da3b0700 1 -- 172.21.15.59:0/4204283813 wait complete. 2023-09-30T22:34:41.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.607+0000 7fa6da3b0700 1 Processor -- start 2023-09-30T22:34:41.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.607+0000 7fa6da3b0700 1 -- start start 2023-09-30T22:34:41.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.608+0000 7fa6da3b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6d409e930 0x7fa6d41a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.608+0000 7fa6da3b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d409f240 0x7fa6d41a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.608+0000 7fa6da3b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6d409f650 0x7fa6d41a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.608+0000 7fa6da3b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d41a5180 con 0x7fa6d409f240 2023-09-30T22:34:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.608+0000 7fa6da3b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d41a2950 con 0x7fa6d409e930 2023-09-30T22:34:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.608+0000 7fa6da3b0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40a3670 con 0x7fa6d409f650 2023-09-30T22:34:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.608+0000 7fa6d3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6d409e930 0x7fa6d41a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.608+0000 7fa6d3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6d409e930 0x7fa6d41a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36428/0 (socket says 172.21.15.59:36428) 2023-09-30T22:34:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.608+0000 7fa6d3fff700 1 -- 172.21.15.59:0/2215221032 learned_addr learned my addr 172.21.15.59:0/2215221032 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:41.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.609+0000 7fa6d894d700 1 --2- 172.21.15.59:0/2215221032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6d409f650 0x7fa6d41a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.609+0000 7fa6d37fe700 1 --2- 172.21.15.59:0/2215221032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d409f240 0x7fa6d41a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.609+0000 7fa6d3fff700 1 -- 172.21.15.59:0/2215221032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6d409f650 msgr2=0x7fa6d41a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.609+0000 7fa6d3fff700 1 --2- 172.21.15.59:0/2215221032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6d409f650 0x7fa6d41a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.609+0000 7fa6d3fff700 1 -- 172.21.15.59:0/2215221032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d409f240 msgr2=0x7fa6d41a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.609+0000 7fa6d3fff700 1 --2- 172.21.15.59:0/2215221032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d409f240 0x7fa6d41a1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.609+0000 7fa6d3fff700 1 -- 172.21.15.59:0/2215221032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c40094a0 con 0x7fa6d409e930 2023-09-30T22:34:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.609+0000 7fa6d37fe700 1 --2- 172.21.15.59:0/2215221032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d409f240 0x7fa6d41a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:34:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.610+0000 7fa6d3fff700 1 --2- 172.21.15.59:0/2215221032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6d409e930 0x7fa6d41a0cf0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40a0b00 tx=0x7fa6c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.610+0000 7fa6d0ff9700 1 -- 172.21.15.59:0/2215221032 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c401f840 con 0x7fa6d409e930 2023-09-30T22:34:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.610+0000 7fa6d0ff9700 1 -- 172.21.15.59:0/2215221032 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c4023070 con 0x7fa6d409e930 2023-09-30T22:34:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.610+0000 7fa6da3b0700 1 -- 172.21.15.59:0/2215221032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d40a0190 con 0x7fa6d409e930 2023-09-30T22:34:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.610+0000 7fa6d0ff9700 1 -- 172.21.15.59:0/2215221032 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c401fc00 con 0x7fa6d409e930 2023-09-30T22:34:41.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.610+0000 7fa6da3b0700 1 -- 172.21.15.59:0/2215221032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d41a44e0 con 0x7fa6d409e930 2023-09-30T22:34:41.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.611+0000 7fa6d0ff9700 1 -- 172.21.15.59:0/2215221032 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6c40036a0 con 0x7fa6d409e930 2023-09-30T22:34:41.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.611+0000 7fa6da3b0700 1 -- 172.21.15.59:0/2215221032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d41a4300 con 0x7fa6d409e930 2023-09-30T22:34:41.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.611+0000 7fa6d0ff9700 1 -- 172.21.15.59:0/2215221032 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa6c4025070 con 0x7fa6d409e930 2023-09-30T22:34:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.616+0000 7fa6d0ff9700 1 -- 172.21.15.59:0/2215221032 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6c4028740 con 0x7fa6d409e930 2023-09-30T22:34:41.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.685+0000 7f0dae8ab700 1 Processor -- start 2023-09-30T22:34:41.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.685+0000 7f0dae8ab700 1 -- start start 2023-09-30T22:34:41.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.686+0000 7f0dae8ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da809e930 0x7f0da809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.686+0000 7f0dae8ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da809f240 0x7f0da81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.686+0000 7f0dae8ab700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da8070940 con 0x7f0da809f650 2023-09-30T22:34:41.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.686+0000 7f0dae8ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da806fd60 con 0x7f0da809f240 2023-09-30T22:34:41.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.686+0000 7f0dae8ab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0da806fa80 con 0x7f0da809e930 2023-09-30T22:34:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.686+0000 7f0da7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da809e930 0x7f0da809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.686+0000 7f0dace48700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0da809f650 0x7f0da8131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34590/0 (socket says 172.21.15.59:34590) 2023-09-30T22:34:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.686+0000 7f0dace48700 1 -- 172.21.15.59:0/3903186348 learned_addr learned my addr 172.21.15.59:0/3903186348 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.686+0000 7f0da77fe700 1 --2- 172.21.15.59:0/3903186348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da809f240 0x7f0da81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.686+0000 7f0da6ffd700 1 -- 172.21.15.59:0/3903186348 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689863616 0 0) 0x7f0da8070940 con 0x7f0da809f650 2023-09-30T22:34:41.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.686+0000 7f0da7fff700 1 -- 172.21.15.59:0/3903186348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da809f240 msgr2=0x7f0da81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:41.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.686+0000 7f0da7fff700 1 --2- 172.21.15.59:0/3903186348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da809f240 0x7f0da81317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.686+0000 7f0da7fff700 1 -- 172.21.15.59:0/3903186348 >> v1:172.21.15.59:6789/0 conn(0x7f0da809f650 legacy=0x7f0da8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.686+0000 7f0da7fff700 1 -- 172.21.15.59:0/3903186348 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da809fb60 con 0x7f0da809e930 2023-09-30T22:34:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.687+0000 7f0da7fff700 1 --2- 172.21.15.59:0/3903186348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da809e930 0x7f0da809ed00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009870 tx=0x7f0d98009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=396c6df8159e6fe3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.687+0000 7f0da6ffd700 1 -- 172.21.15.59:0/3903186348 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98011830 con 0x7f0da809e930 2023-09-30T22:34:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.687+0000 7f0da6ffd700 1 -- 172.21.15.59:0/3903186348 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d98011990 con 0x7f0da809e930 2023-09-30T22:34:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.687+0000 7f0da6ffd700 1 -- 172.21.15.59:0/3903186348 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98011d20 con 0x7f0da809e930 2023-09-30T22:34:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.688+0000 7f0dae8ab700 1 -- 172.21.15.59:0/3903186348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da809e930 msgr2=0x7f0da809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.688+0000 7f0dae8ab700 1 --2- 172.21.15.59:0/3903186348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da809e930 0x7f0da809ed00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009870 tx=0x7f0d98009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.688+0000 7f0dae8ab700 1 -- 172.21.15.59:0/3903186348 shutdown_connections 2023-09-30T22:34:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.688+0000 7f0dae8ab700 1 --2- 172.21.15.59:0/3903186348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da809e930 0x7f0da809ed00 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.688+0000 7f0dae8ab700 1 --2- 172.21.15.59:0/3903186348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da809f240 0x7f0da81317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.688+0000 7f0dae8ab700 1 -- 172.21.15.59:0/3903186348 >> 172.21.15.59:0/3903186348 conn(0x7f0da80a4210 msgr2=0x7f0da80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.688+0000 7f0dae8ab700 1 -- 172.21.15.59:0/3903186348 shutdown_connections 2023-09-30T22:34:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.688+0000 7f0dae8ab700 1 -- 172.21.15.59:0/3903186348 wait complete. 2023-09-30T22:34:41.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.689+0000 7f0dae8ab700 1 Processor -- start 2023-09-30T22:34:41.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.690+0000 7f0dae8ab700 1 -- start start 2023-09-30T22:34:41.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.690+0000 7f0dae8ab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da809e930 0x7f0da81a3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.690+0000 7f0dae8ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da809f240 0x7f0da81a4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.690+0000 7f0dae8ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da809f650 0x7f0da81a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.690+0000 7f0dae8ab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da81a8060 con 0x7f0da809e930 2023-09-30T22:34:41.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.690+0000 7f0dae8ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da81a5790 con 0x7f0da809f240 2023-09-30T22:34:41.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.690+0000 7f0dae8ab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0da81a5db0 con 0x7f0da809f650 2023-09-30T22:34:41.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.691+0000 7f0da7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da809e930 0x7f0da81a3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.691+0000 7f0da7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da809e930 0x7f0da81a3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53258/0 (socket says 172.21.15.59:53258) 2023-09-30T22:34:41.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.691+0000 7f0da7fff700 1 -- 172.21.15.59:0/1575641513 learned_addr learned my addr 172.21.15.59:0/1575641513 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:41.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.691+0000 7f0dace48700 1 --2- 172.21.15.59:0/1575641513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da809f650 0x7f0da81a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.691+0000 7f0da77fe700 1 --2- 172.21.15.59:0/1575641513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da809f240 0x7f0da81a4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.691+0000 7f0da7fff700 1 -- 172.21.15.59:0/1575641513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da809f650 msgr2=0x7f0da81a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.691+0000 7f0da7fff700 1 --2- 172.21.15.59:0/1575641513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da809f650 0x7f0da81a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.691+0000 7f0da7fff700 1 -- 172.21.15.59:0/1575641513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da809f240 msgr2=0x7f0da81a4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.691+0000 7f0da7fff700 1 --2- 172.21.15.59:0/1575641513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da809f240 0x7f0da81a4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.691+0000 7f0da7fff700 1 -- 172.21.15.59:0/1575641513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d980094a0 con 0x7f0da809e930 2023-09-30T22:34:41.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.691+0000 7f0da7fff700 1 --2- 172.21.15.59:0/1575641513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da809e930 0x7f0da81a3c10 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f0da806fbc0 tx=0x7f0d98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:41.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.692+0000 7f0da4ff9700 1 -- 172.21.15.59:0/1575641513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98004450 con 0x7f0da809e930 2023-09-30T22:34:41.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.692+0000 7f0da4ff9700 1 -- 172.21.15.59:0/1575641513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d98023070 con 0x7f0da809e930 2023-09-30T22:34:41.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.692+0000 7f0da4ff9700 1 -- 172.21.15.59:0/1575641513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9801fa60 con 0x7f0da809e930 2023-09-30T22:34:41.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.692+0000 7f0dae8ab700 1 -- 172.21.15.59:0/1575641513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da80a0190 con 0x7f0da809e930 2023-09-30T22:34:41.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.692+0000 7f0dae8ab700 1 -- 172.21.15.59:0/1575641513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da80a33f0 con 0x7f0da809e930 2023-09-30T22:34:41.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.693+0000 7f0da4ff9700 1 -- 172.21.15.59:0/1575641513 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d9801fbc0 con 0x7f0da809e930 2023-09-30T22:34:41.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.693+0000 7f0dae8ab700 1 -- 172.21.15.59:0/1575641513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da8074ea0 con 0x7f0da809e930 2023-09-30T22:34:41.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.693+0000 7f0da4ff9700 1 -- 172.21.15.59:0/1575641513 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0d98025070 con 0x7f0da809e930 2023-09-30T22:34:41.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.703+0000 7f0da4ff9700 1 -- 172.21.15.59:0/1575641513 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d98076750 con 0x7f0da809e930 2023-09-30T22:34:41.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.726+0000 7f4440370700 1 Processor -- start 2023-09-30T22:34:41.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.726+0000 7f4440370700 1 -- start start 2023-09-30T22:34:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f4440370700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443809d6f0 0x7f443809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f4440370700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f443809e000 0x7f4438130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f4440370700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f443809e410 0x7f4438130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f4440370700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443809f520 con 0x7f443809e410 2023-09-30T22:34:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f4440370700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443809f130 con 0x7f443809d6f0 2023-09-30T22:34:41.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f4440370700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f443809e930 con 0x7f443809e000 2023-09-30T22:34:41.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f443d90b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f443809e000 0x7f4438130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f443d90b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f443809e000 0x7f4438130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49492/0 (socket says 172.21.15.59:49492) 2023-09-30T22:34:41.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f443d90b700 1 -- 172.21.15.59:0/2988888224 learned_addr learned my addr 172.21.15.59:0/2988888224 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:41.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f443e10c700 1 --2- 172.21.15.59:0/2988888224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443809d6f0 0x7f443809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f443e90d700 1 --2- 172.21.15.59:0/2988888224 >> v2:172.21.15.59:3300/0 conn(0x7f443809e410 0x7f4438130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f443d90b700 1 -- 172.21.15.59:0/2988888224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443809d6f0 msgr2=0x7f443809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f443d90b700 1 --2- 172.21.15.59:0/2988888224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443809d6f0 0x7f443809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f443d90b700 1 -- 172.21.15.59:0/2988888224 >> v2:172.21.15.59:3300/0 conn(0x7f443809e410 msgr2=0x7f4438130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f443d90b700 1 --2- 172.21.15.59:0/2988888224 >> v2:172.21.15.59:3300/0 conn(0x7f443809e410 0x7f4438130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.727+0000 7f443d90b700 1 -- 172.21.15.59:0/2988888224 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443809b2d0 con 0x7f443809e000 2023-09-30T22:34:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.728+0000 7f443e90d700 1 --2- 172.21.15.59:0/2988888224 >> v2:172.21.15.59:3300/0 conn(0x7f443809e410 0x7f4438130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.728+0000 7f443d90b700 1 --2- 172.21.15.59:0/2988888224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f443809e000 0x7f4438130660 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f442800bc20 tx=0x7f442800bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74f3d544149f31dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.728+0000 7f443d10a700 1 -- 172.21.15.59:0/2988888224 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442800dbf0 con 0x7f443809e000 2023-09-30T22:34:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.728+0000 7f443d10a700 1 -- 172.21.15.59:0/2988888224 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442800dd50 con 0x7f443809e000 2023-09-30T22:34:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.728+0000 7f443d10a700 1 -- 172.21.15.59:0/2988888224 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4428012970 con 0x7f443809e000 2023-09-30T22:34:41.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.729+0000 7f4440370700 1 -- 172.21.15.59:0/2988888224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f443809e000 msgr2=0x7f4438130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.729+0000 7f4440370700 1 --2- 172.21.15.59:0/2988888224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f443809e000 0x7f4438130660 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f442800bc20 tx=0x7f442800bf30 comp rx=0 tx=0).stop 2023-09-30T22:34:41.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.729+0000 7f4440370700 1 -- 172.21.15.59:0/2988888224 shutdown_connections 2023-09-30T22:34:41.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.729+0000 7f4440370700 1 --2- 172.21.15.59:0/2988888224 >> v2:172.21.15.59:3300/0 conn(0x7f443809e410 0x7f4438130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.729+0000 7f4440370700 1 --2- 172.21.15.59:0/2988888224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443809d6f0 0x7f443809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.729+0000 7f4440370700 1 --2- 172.21.15.59:0/2988888224 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f443809e000 0x7f4438130660 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.729+0000 7f4440370700 1 -- 172.21.15.59:0/2988888224 >> 172.21.15.59:0/2988888224 conn(0x7f4438066f50 msgr2=0x7f443809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:41.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.729+0000 7f4440370700 1 -- 172.21.15.59:0/2988888224 shutdown_connections 2023-09-30T22:34:41.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.729+0000 7f4440370700 1 -- 172.21.15.59:0/2988888224 wait complete. 2023-09-30T22:34:41.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.731+0000 7f4440370700 1 Processor -- start 2023-09-30T22:34:41.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.731+0000 7f4440370700 1 -- start start 2023-09-30T22:34:41.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.731+0000 7f4440370700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f443809d6f0 0x7f443811e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.731+0000 7f4440370700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443809e000 0x7f443811e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.731+0000 7f4440370700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443809e410 0x7f443811eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.731+0000 7f4440370700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443811f4f0 con 0x7f443809e000 2023-09-30T22:34:41.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.731+0000 7f4440370700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4438121bb0 con 0x7f443809e410 2023-09-30T22:34:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.731+0000 7f4440370700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4438120250 con 0x7f443809d6f0 2023-09-30T22:34:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.732+0000 7f443e10c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f443809d6f0 0x7f443811e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.732+0000 7f443e10c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f443809d6f0 0x7f443811e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49498/0 (socket says 172.21.15.59:49498) 2023-09-30T22:34:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.732+0000 7f443d90b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443809e000 0x7f443811e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.732+0000 7f443e10c700 1 -- 172.21.15.59:0/1979950146 learned_addr learned my addr 172.21.15.59:0/1979950146 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.732+0000 7f443e90d700 1 --2- 172.21.15.59:0/1979950146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443809e410 0x7f443811eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.732+0000 7f443e10c700 1 -- 172.21.15.59:0/1979950146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443809e410 msgr2=0x7f443811eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.732+0000 7f443e10c700 1 --2- 172.21.15.59:0/1979950146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443809e410 0x7f443811eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.732+0000 7f443e10c700 1 -- 172.21.15.59:0/1979950146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443809e000 msgr2=0x7f443811e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.732+0000 7f443e10c700 1 --2- 172.21.15.59:0/1979950146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443809e000 0x7f443811e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.732+0000 7f443e10c700 1 -- 172.21.15.59:0/1979950146 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442800b7f0 con 0x7f443809d6f0 2023-09-30T22:34:41.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.732+0000 7f443d90b700 1 --2- 172.21.15.59:0/1979950146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443809e000 0x7f443811e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:41.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.732+0000 7f443e10c700 1 --2- 172.21.15.59:0/1979950146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f443809d6f0 0x7f443811e090 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f443400e930 tx=0x7f443400ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:41.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.733+0000 7f442effd700 1 -- 172.21.15.59:0/1979950146 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443400ee80 con 0x7f443809d6f0 2023-09-30T22:34:41.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.733+0000 7f442effd700 1 -- 172.21.15.59:0/1979950146 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443400c850 con 0x7f443809d6f0 2023-09-30T22:34:41.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.733+0000 7f442effd700 1 -- 172.21.15.59:0/1979950146 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443400cbe0 con 0x7f443809d6f0 2023-09-30T22:34:41.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.733+0000 7f4440370700 1 -- 172.21.15.59:0/1979950146 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44380a3b20 con 0x7f443809d6f0 2023-09-30T22:34:41.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.733+0000 7f4440370700 1 -- 172.21.15.59:0/1979950146 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4438121610 con 0x7f443809d6f0 2023-09-30T22:34:41.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.734+0000 7f442effd700 1 -- 172.21.15.59:0/1979950146 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f443400cd40 con 0x7f443809d6f0 2023-09-30T22:34:41.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.734+0000 7f4440370700 1 -- 172.21.15.59:0/1979950146 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4438120f80 con 0x7f443809d6f0 2023-09-30T22:34:41.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.734+0000 7f442effd700 1 -- 172.21.15.59:0/1979950146 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f443403fb10 con 0x7f443809d6f0 2023-09-30T22:34:41.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.742+0000 7f143602d700 1 Processor -- start 2023-09-30T22:34:41.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.742+0000 7f143602d700 1 -- start start 2023-09-30T22:34:41.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.742+0000 7f143602d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f143009e1d0 0x7f1430138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.742+0000 7f143602d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1430139170 0x7f143013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.742+0000 7f143602d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143009d2f0 con 0x7f143009d6f0 2023-09-30T22:34:41.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.742+0000 7f143602d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143009b0f0 con 0x7f1430139170 2023-09-30T22:34:41.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.742+0000 7f143602d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f143009a810 con 0x7f143009e1d0 2023-09-30T22:34:41.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.743+0000 7f142effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f143009e1d0 0x7f1430138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.743+0000 7f142effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f143009e1d0 0x7f1430138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49512/0 (socket says 172.21.15.59:49512) 2023-09-30T22:34:41.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.743+0000 7f142ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1430139170 0x7f143013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.743+0000 7f142effd700 1 -- 172.21.15.59:0/4082254930 learned_addr learned my addr 172.21.15.59:0/4082254930 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:41.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.743+0000 7f142effd700 1 -- 172.21.15.59:0/4082254930 >> v2:172.21.15.59:3300/0 conn(0x7f1430139170 msgr2=0x7f143013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:41.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.743+0000 7f142effd700 1 --2- 172.21.15.59:0/4082254930 >> v2:172.21.15.59:3300/0 conn(0x7f1430139170 0x7f143013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.743+0000 7f142effd700 1 -- 172.21.15.59:0/4082254930 >> v1:172.21.15.59:6789/0 conn(0x7f143009d6f0 legacy=0x7f143009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:41.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.743+0000 7f142effd700 1 -- 172.21.15.59:0/4082254930 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143009a470 con 0x7f143009e1d0 2023-09-30T22:34:41.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.743+0000 7f142ffff700 1 --2- 172.21.15.59:0/4082254930 >> v2:172.21.15.59:3300/0 conn(0x7f1430139170 0x7f143013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:41.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.743+0000 7f142effd700 1 --2- 172.21.15.59:0/4082254930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f143009e1d0 0x7f1430138c30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f14240098f0 tx=0x7f1424009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f10315e83f2a673 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:41.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.743+0000 7f442effd700 1 -- 172.21.15.59:0/1979950146 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f443401b3b0 con 0x7f443809d6f0 2023-09-30T22:34:41.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.744+0000 7f142e7fc700 1 -- 172.21.15.59:0/4082254930 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424004230 con 0x7f143009e1d0 2023-09-30T22:34:41.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.744+0000 7f142e7fc700 1 -- 172.21.15.59:0/4082254930 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1424004390 con 0x7f143009e1d0 2023-09-30T22:34:41.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.744+0000 7f142e7fc700 1 -- 172.21.15.59:0/4082254930 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14240036a0 con 0x7f143009e1d0 2023-09-30T22:34:41.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.745+0000 7f143602d700 1 -- 172.21.15.59:0/4082254930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f143009e1d0 msgr2=0x7f1430138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.745+0000 7f143602d700 1 --2- 172.21.15.59:0/4082254930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f143009e1d0 0x7f1430138c30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f14240098f0 tx=0x7f1424009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:41.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.747+0000 7f143602d700 1 -- 172.21.15.59:0/4082254930 shutdown_connections 2023-09-30T22:34:41.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.747+0000 7f143602d700 1 --2- 172.21.15.59:0/4082254930 >> v2:172.21.15.59:3300/0 conn(0x7f1430139170 0x7f143013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.747+0000 7f143602d700 1 --2- 172.21.15.59:0/4082254930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f143009e1d0 0x7f1430138c30 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.747+0000 7f143602d700 1 -- 172.21.15.59:0/4082254930 >> 172.21.15.59:0/4082254930 conn(0x7f1430066f50 msgr2=0x7f143009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:41.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.747+0000 7f143602d700 1 -- 172.21.15.59:0/4082254930 shutdown_connections 2023-09-30T22:34:41.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.747+0000 7f143602d700 1 -- 172.21.15.59:0/4082254930 wait complete. 2023-09-30T22:34:41.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.748+0000 7f143602d700 1 Processor -- start 2023-09-30T22:34:41.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.748+0000 7f143602d700 1 -- start start 2023-09-30T22:34:41.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.749+0000 7f143602d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f143009d6f0 0x7f1430119720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.749+0000 7f143602d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143009e1d0 0x7f1430119c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.749+0000 7f143602d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1430139170 0x7f14301cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:41.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.749+0000 7f143602d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143011cf60 con 0x7f143009e1d0 2023-09-30T22:34:41.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.749+0000 7f143602d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1430136690 con 0x7f1430139170 2023-09-30T22:34:41.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.749+0000 7f143602d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f143011c9c0 con 0x7f143009d6f0 2023-09-30T22:34:41.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.749+0000 7f142effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143009e1d0 0x7f1430119c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.749+0000 7f142ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1430139170 0x7f14301cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.749+0000 7f142effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143009e1d0 0x7f1430119c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53300/0 (socket says 172.21.15.59:53300) 2023-09-30T22:34:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.749+0000 7f142effd700 1 -- 172.21.15.59:0/758607769 learned_addr learned my addr 172.21.15.59:0/758607769 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.750+0000 7f142f7fe700 1 --2- 172.21.15.59:0/758607769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f143009d6f0 0x7f1430119720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.750+0000 7f142effd700 1 -- 172.21.15.59:0/758607769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f143009d6f0 msgr2=0x7f1430119720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.750+0000 7f142effd700 1 --2- 172.21.15.59:0/758607769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f143009d6f0 0x7f1430119720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.750+0000 7f142effd700 1 -- 172.21.15.59:0/758607769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1430139170 msgr2=0x7f14301cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.750+0000 7f142effd700 1 --2- 172.21.15.59:0/758607769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1430139170 0x7f14301cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.750+0000 7f142effd700 1 -- 172.21.15.59:0/758607769 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1428009a70 con 0x7f143009e1d0 2023-09-30T22:34:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.750+0000 7f142ffff700 1 --2- 172.21.15.59:0/758607769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1430139170 0x7f14301cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.750+0000 7f142effd700 1 --2- 172.21.15.59:0/758607769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143009e1d0 0x7f1430119c60 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f1424009130 tx=0x7f1424004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.750+0000 7f1417fff700 1 -- 172.21.15.59:0/758607769 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424003c00 con 0x7f143009e1d0 2023-09-30T22:34:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.751+0000 7f1417fff700 1 -- 172.21.15.59:0/758607769 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142401f070 con 0x7f143009e1d0 2023-09-30T22:34:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.751+0000 7f1417fff700 1 -- 172.21.15.59:0/758607769 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424011630 con 0x7f143009e1d0 2023-09-30T22:34:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.751+0000 7f143602d700 1 -- 172.21.15.59:0/758607769 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1424009550 con 0x7f143009e1d0 2023-09-30T22:34:41.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.751+0000 7f143602d700 1 -- 172.21.15.59:0/758607769 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143011b150 con 0x7f143009e1d0 2023-09-30T22:34:41.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.752+0000 7f143602d700 1 -- 172.21.15.59:0/758607769 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143011a970 con 0x7f143009e1d0 2023-09-30T22:34:41.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.752+0000 7f1417fff700 1 -- 172.21.15.59:0/758607769 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1424021030 con 0x7f143009e1d0 2023-09-30T22:34:41.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.753+0000 7f1417fff700 1 -- 172.21.15.59:0/758607769 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1424040dc0 con 0x7f143009e1d0 2023-09-30T22:34:41.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.758+0000 7f1417fff700 1 -- 172.21.15.59:0/758607769 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1424019780 con 0x7f143009e1d0 2023-09-30T22:34:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.844+0000 7fa6da3b0700 1 -- 172.21.15.59:0/2215221032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa6d4074ea0 con 0x7fa6d409e930 2023-09-30T22:34:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.844+0000 7fa6d0ff9700 1 -- 172.21.15.59:0/2215221032 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6c4015070 con 0x7fa6d409e930 2023-09-30T22:34:41.845 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.847+0000 7fa6da3b0700 1 -- 172.21.15.59:0/2215221032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6d409e930 msgr2=0x7fa6d41a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.847+0000 7fa6da3b0700 1 --2- 172.21.15.59:0/2215221032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6d409e930 0x7fa6d41a0cf0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40a0b00 tx=0x7fa6c4004750 comp rx=0 tx=0).stop 2023-09-30T22:34:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.847+0000 7fa6da3b0700 1 -- 172.21.15.59:0/2215221032 shutdown_connections 2023-09-30T22:34:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.847+0000 7fa6da3b0700 1 --2- 172.21.15.59:0/2215221032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6d409f650 0x7fa6d41a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.847+0000 7fa6da3b0700 1 --2- 172.21.15.59:0/2215221032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6d409e930 0x7fa6d41a0cf0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.847+0000 7fa6da3b0700 1 --2- 172.21.15.59:0/2215221032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d409f240 0x7fa6d41a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.847+0000 7fa6da3b0700 1 -- 172.21.15.59:0/2215221032 >> 172.21.15.59:0/2215221032 conn(0x7fa6d40a4210 msgr2=0x7fa6d409c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.847+0000 7fa6da3b0700 1 -- 172.21.15.59:0/2215221032 shutdown_connections 2023-09-30T22:34:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.847+0000 7fa6da3b0700 1 -- 172.21.15.59:0/2215221032 wait complete. 2023-09-30T22:34:41.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:41.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.921+0000 7f0dae8ab700 1 -- 172.21.15.59:0/1575641513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0da806b250 con 0x7f0da809e930 2023-09-30T22:34:41.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.922+0000 7f0da4ff9700 1 -- 172.21.15.59:0/1575641513 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d98015020 con 0x7f0da809e930 2023-09-30T22:34:41.922 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:41.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.924+0000 7f0dae8ab700 1 -- 172.21.15.59:0/1575641513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da809e930 msgr2=0x7f0da81a3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:41.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.924+0000 7f0dae8ab700 1 --2- 172.21.15.59:0/1575641513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da809e930 0x7f0da81a3c10 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f0da806fbc0 tx=0x7f0d98004750 comp rx=0 tx=0).stop 2023-09-30T22:34:41.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.924+0000 7f0dae8ab700 1 -- 172.21.15.59:0/1575641513 shutdown_connections 2023-09-30T22:34:41.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.924+0000 7f0dae8ab700 1 --2- 172.21.15.59:0/1575641513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0da809f650 0x7f0da81a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.924+0000 7f0dae8ab700 1 --2- 172.21.15.59:0/1575641513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da809e930 0x7f0da81a3c10 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.924+0000 7f0dae8ab700 1 --2- 172.21.15.59:0/1575641513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da809f240 0x7f0da81a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:41.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.924+0000 7f0dae8ab700 1 -- 172.21.15.59:0/1575641513 >> 172.21.15.59:0/1575641513 conn(0x7f0da80a4210 msgr2=0x7f0da81b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:41.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.924+0000 7f0dae8ab700 1 -- 172.21.15.59:0/1575641513 shutdown_connections 2023-09-30T22:34:41.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.924+0000 7f0dae8ab700 1 -- 172.21.15.59:0/1575641513 wait complete. 2023-09-30T22:34:41.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:42.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:41.999+0000 7f4440370700 1 -- 172.21.15.59:0/1979950146 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4438074ea0 con 0x7f443809d6f0 2023-09-30T22:34:42.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.000+0000 7f442effd700 1 -- 172.21.15.59:0/1979950146 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4434021070 con 0x7f443809d6f0 2023-09-30T22:34:42.000 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:42.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.002+0000 7f4440370700 1 -- 172.21.15.59:0/1979950146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f443809d6f0 msgr2=0x7f443811e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:42.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.002+0000 7f4440370700 1 --2- 172.21.15.59:0/1979950146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f443809d6f0 0x7f443811e090 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f443400e930 tx=0x7f443400ec40 comp rx=0 tx=0).stop 2023-09-30T22:34:42.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.002+0000 7f4440370700 1 -- 172.21.15.59:0/1979950146 shutdown_connections 2023-09-30T22:34:42.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.002+0000 7f4440370700 1 --2- 172.21.15.59:0/1979950146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f443809d6f0 0x7f443811e090 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:42.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.002+0000 7f4440370700 1 --2- 172.21.15.59:0/1979950146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443809e410 0x7f443811eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:42.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.002+0000 7f4440370700 1 --2- 172.21.15.59:0/1979950146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443809e000 0x7f443811e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:42.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.002+0000 7f4440370700 1 -- 172.21.15.59:0/1979950146 >> 172.21.15.59:0/1979950146 conn(0x7f4438066f50 msgr2=0x7f4438130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:42.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.002+0000 7f4440370700 1 -- 172.21.15.59:0/1979950146 shutdown_connections 2023-09-30T22:34:42.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.002+0000 7f4440370700 1 -- 172.21.15.59:0/1979950146 wait complete. 2023-09-30T22:34:42.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.012+0000 7f143602d700 1 -- 172.21.15.59:0/758607769 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f143011a970 con 0x7f143009e1d0 2023-09-30T22:34:42.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.013+0000 7f1417fff700 1 -- 172.21.15.59:0/758607769 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f142402d430 con 0x7f143009e1d0 2023-09-30T22:34:42.013 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:42.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.016+0000 7f143602d700 1 -- 172.21.15.59:0/758607769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143009e1d0 msgr2=0x7f1430119c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:42.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.016+0000 7f143602d700 1 --2- 172.21.15.59:0/758607769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143009e1d0 0x7f1430119c60 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f1424009130 tx=0x7f1424004750 comp rx=0 tx=0).stop 2023-09-30T22:34:42.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.016+0000 7f143602d700 1 -- 172.21.15.59:0/758607769 shutdown_connections 2023-09-30T22:34:42.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.016+0000 7f143602d700 1 --2- 172.21.15.59:0/758607769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f143009d6f0 0x7f1430119720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:42.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.016+0000 7f143602d700 1 --2- 172.21.15.59:0/758607769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1430139170 0x7f14301cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:42.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.016+0000 7f143602d700 1 --2- 172.21.15.59:0/758607769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143009e1d0 0x7f1430119c60 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:42.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.016+0000 7f143602d700 1 -- 172.21.15.59:0/758607769 >> 172.21.15.59:0/758607769 conn(0x7f1430066f50 msgr2=0x7f14300a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:42.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.016+0000 7f143602d700 1 -- 172.21.15.59:0/758607769 shutdown_connections 2023-09-30T22:34:42.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:42.016+0000 7f143602d700 1 -- 172.21.15.59:0/758607769 wait complete. 2023-09-30T22:34:42.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:42.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:42.863 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:42.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:43.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.009+0000 7efedb66c700 1 Processor -- start 2023-09-30T22:34:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.010+0000 7efedb66c700 1 -- start start 2023-09-30T22:34:43.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:43.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.010+0000 7efedb66c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed40a1510 0x7efed4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.010+0000 7efedb66c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efed4139250 0x7efed413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.010+0000 7efedb66c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed409edd0 con 0x7efed40a0a30 2023-09-30T22:34:43.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.010+0000 7efedb66c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed40a18e0 con 0x7efed4139250 2023-09-30T22:34:43.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.010+0000 7efedb66c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed409e1f0 con 0x7efed40a1510 2023-09-30T22:34:43.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.011+0000 7efed8c07700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed40a1510 0x7efed4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.011+0000 7efed9c09700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efed4139250 0x7efed413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.011+0000 7efed8c07700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed40a1510 0x7efed4138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36474/0 (socket says 172.21.15.59:36474) 2023-09-30T22:34:43.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.011+0000 7efed9c09700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efed4139250 0x7efed413b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53314/0 (socket says 172.21.15.59:53314) 2023-09-30T22:34:43.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.011+0000 7efed8c07700 1 -- 172.21.15.59:0/759993938 learned_addr learned my addr 172.21.15.59:0/759993938 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:43.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.011+0000 7efed8c07700 1 -- 172.21.15.59:0/759993938 >> v2:172.21.15.59:3300/0 conn(0x7efed4139250 msgr2=0x7efed413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:43.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.011+0000 7efed8c07700 1 --2- 172.21.15.59:0/759993938 >> v2:172.21.15.59:3300/0 conn(0x7efed4139250 0x7efed413b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.011+0000 7efed8c07700 1 -- 172.21.15.59:0/759993938 >> v1:172.21.15.59:6789/0 conn(0x7efed40a0a30 legacy=0x7efed40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.011+0000 7efed8c07700 1 -- 172.21.15.59:0/759993938 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed409dc50 con 0x7efed40a1510 2023-09-30T22:34:43.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.011+0000 7efed9c09700 1 --2- 172.21.15.59:0/759993938 >> v2:172.21.15.59:3300/0 conn(0x7efed4139250 0x7efed413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:43.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.011+0000 7efed8c07700 1 --2- 172.21.15.59:0/759993938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed40a1510 0x7efed4138d10 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7efec8009920 tx=0x7efec8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96a1eea067ed81f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:43.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.011+0000 7efed3fff700 1 -- 172.21.15.59:0/759993938 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8011830 con 0x7efed40a1510 2023-09-30T22:34:43.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.011+0000 7efed3fff700 1 -- 172.21.15.59:0/759993938 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec8011990 con 0x7efed40a1510 2023-09-30T22:34:43.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.011+0000 7efed3fff700 1 -- 172.21.15.59:0/759993938 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8011d20 con 0x7efed40a1510 2023-09-30T22:34:43.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.012+0000 7efedb66c700 1 -- 172.21.15.59:0/759993938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed40a1510 msgr2=0x7efed4138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.012+0000 7efedb66c700 1 --2- 172.21.15.59:0/759993938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed40a1510 0x7efed4138d10 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7efec8009920 tx=0x7efec8009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:43.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.012+0000 7efedb66c700 1 -- 172.21.15.59:0/759993938 shutdown_connections 2023-09-30T22:34:43.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.012+0000 7efedb66c700 1 --2- 172.21.15.59:0/759993938 >> v2:172.21.15.59:3300/0 conn(0x7efed4139250 0x7efed413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.012+0000 7efedb66c700 1 --2- 172.21.15.59:0/759993938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed40a1510 0x7efed4138d10 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.012+0000 7efedb66c700 1 -- 172.21.15.59:0/759993938 >> 172.21.15.59:0/759993938 conn(0x7efed40a6550 msgr2=0x7efed40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:43.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.012+0000 7efedb66c700 1 -- 172.21.15.59:0/759993938 shutdown_connections 2023-09-30T22:34:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.012+0000 7efedb66c700 1 -- 172.21.15.59:0/759993938 wait complete. 2023-09-30T22:34:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.013+0000 7efedb66c700 1 Processor -- start 2023-09-30T22:34:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.013+0000 7efedb66c700 1 -- start start 2023-09-30T22:34:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efedb66c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efed40a0a30 0x7efed41c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efedb66c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efed40a1510 0x7efed41c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efedb66c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed4139250 0x7efed41c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efedb66c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed4126900 con 0x7efed40a1510 2023-09-30T22:34:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efedb66c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed4126570 con 0x7efed4139250 2023-09-30T22:34:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efedb66c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efed41249e0 con 0x7efed40a0a30 2023-09-30T22:34:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efed8c07700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efed40a1510 0x7efed41c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efed8c07700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efed40a1510 0x7efed41c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53320/0 (socket says 172.21.15.59:53320) 2023-09-30T22:34:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efed8c07700 1 -- 172.21.15.59:0/1740079371 learned_addr learned my addr 172.21.15.59:0/1740079371 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efed9408700 1 --2- 172.21.15.59:0/1740079371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efed40a0a30 0x7efed41c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efed9c09700 1 --2- 172.21.15.59:0/1740079371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed4139250 0x7efed41c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efed8c07700 1 -- 172.21.15.59:0/1740079371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efed40a0a30 msgr2=0x7efed41c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efed8c07700 1 --2- 172.21.15.59:0/1740079371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efed40a0a30 0x7efed41c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efed8c07700 1 -- 172.21.15.59:0/1740079371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed4139250 msgr2=0x7efed41c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efed8c07700 1 --2- 172.21.15.59:0/1740079371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed4139250 0x7efed41c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efed8c07700 1 -- 172.21.15.59:0/1740079371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc0094a0 con 0x7efed40a1510 2023-09-30T22:34:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efed9c09700 1 --2- 172.21.15.59:0/1740079371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed4139250 0x7efed41c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.014+0000 7efed8c07700 1 --2- 172.21.15.59:0/1740079371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efed40a1510 0x7efed41c8a80 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7efec8009c70 tx=0x7efec8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.015+0000 7efed1ffb700 1 -- 172.21.15.59:0/1740079371 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec80045d0 con 0x7efed40a1510 2023-09-30T22:34:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.015+0000 7efed1ffb700 1 -- 172.21.15.59:0/1740079371 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec801f070 con 0x7efed40a1510 2023-09-30T22:34:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.015+0000 7efed1ffb700 1 -- 172.21.15.59:0/1740079371 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec80038e0 con 0x7efed40a1510 2023-09-30T22:34:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.015+0000 7efedb66c700 1 -- 172.21.15.59:0/1740079371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec8009550 con 0x7efed40a1510 2023-09-30T22:34:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.015+0000 7efedb66c700 1 -- 172.21.15.59:0/1740079371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed4126f00 con 0x7efed40a1510 2023-09-30T22:34:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.016+0000 7efed1ffb700 1 -- 172.21.15.59:0/1740079371 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efec8003a40 con 0x7efed40a1510 2023-09-30T22:34:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.016+0000 7efedb66c700 1 -- 172.21.15.59:0/1740079371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed4074ea0 con 0x7efed40a1510 2023-09-30T22:34:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.016+0000 7efed1ffb700 1 -- 172.21.15.59:0/1740079371 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efec8021070 con 0x7efed40a1510 2023-09-30T22:34:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.021+0000 7efed1ffb700 1 -- 172.21.15.59:0/1740079371 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efec8046020 con 0x7efed40a1510 2023-09-30T22:34:43.130 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.079+0000 7f80b5490700 1 Processor -- start 2023-09-30T22:34:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.080+0000 7f80b5490700 1 -- start start 2023-09-30T22:34:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.080+0000 7f80b5490700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b00a0a30 0x7f80b00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.080+0000 7f80b5490700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0138d80 0x7f80b013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.080+0000 7f80b5490700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b00a2a70 con 0x7f80b009d630 2023-09-30T22:34:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.080+0000 7f80b5490700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b00a01d0 con 0x7f80b0138d80 2023-09-30T22:34:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.080+0000 7f80b5490700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80b009e2b0 con 0x7f80b00a0a30 2023-09-30T22:34:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.080+0000 7f80aeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b00a0a30 0x7f80b00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.080+0000 7f80af7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0138d80 0x7f80b013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.080+0000 7f80ae7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f80b009d630 0x7f80b00a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34624/0 (socket says 172.21.15.59:34624) 2023-09-30T22:34:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.080+0000 7f80ae7fc700 1 -- 172.21.15.59:0/2299346786 learned_addr learned my addr 172.21.15.59:0/2299346786 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.081+0000 7f80aeffd700 1 -- 172.21.15.59:0/2299346786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0138d80 msgr2=0x7f80b013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.081+0000 7f80aeffd700 1 --2- 172.21.15.59:0/2299346786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0138d80 0x7f80b013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.081+0000 7f80aeffd700 1 -- 172.21.15.59:0/2299346786 >> v1:172.21.15.59:6789/0 conn(0x7f80b009d630 legacy=0x7f80b00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.081+0000 7f80adffb700 1 -- 172.21.15.59:0/2299346786 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686207707 0 0) 0x7f80b00a2a70 con 0x7f80b009d630 2023-09-30T22:34:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.081+0000 7f80aeffd700 1 -- 172.21.15.59:0/2299346786 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b009dc50 con 0x7f80b00a0a30 2023-09-30T22:34:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.081+0000 7f80af7fe700 1 --2- 172.21.15.59:0/2299346786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0138d80 0x7f80b013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.081+0000 7f80aeffd700 1 --2- 172.21.15.59:0/2299346786 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b00a0a30 0x7f80b00a0e00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009870 tx=0x7f80a0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66ed6b95beb04b89 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.081+0000 7f80adffb700 1 -- 172.21.15.59:0/2299346786 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0011830 con 0x7f80b00a0a30 2023-09-30T22:34:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.081+0000 7f80adffb700 1 -- 172.21.15.59:0/2299346786 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a0011990 con 0x7f80b00a0a30 2023-09-30T22:34:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.081+0000 7f80adffb700 1 -- 172.21.15.59:0/2299346786 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0011d20 con 0x7f80b00a0a30 2023-09-30T22:34:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.082+0000 7f80b5490700 1 -- 172.21.15.59:0/2299346786 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b00a0a30 msgr2=0x7f80b00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.082+0000 7f80b5490700 1 --2- 172.21.15.59:0/2299346786 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b00a0a30 0x7f80b00a0e00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009870 tx=0x7f80a0009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.082+0000 7f80b5490700 1 -- 172.21.15.59:0/2299346786 shutdown_connections 2023-09-30T22:34:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.082+0000 7f80b5490700 1 --2- 172.21.15.59:0/2299346786 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b00a0a30 0x7f80b00a0e00 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.082+0000 7f80b5490700 1 --2- 172.21.15.59:0/2299346786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0138d80 0x7f80b013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.082+0000 7f80b5490700 1 -- 172.21.15.59:0/2299346786 >> 172.21.15.59:0/2299346786 conn(0x7f80b00a3050 msgr2=0x7f80b00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.082+0000 7f80b5490700 1 -- 172.21.15.59:0/2299346786 shutdown_connections 2023-09-30T22:34:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.082+0000 7f80b5490700 1 -- 172.21.15.59:0/2299346786 wait complete. 2023-09-30T22:34:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.083+0000 7f80b5490700 1 Processor -- start 2023-09-30T22:34:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.083+0000 7f80b5490700 1 -- start start 2023-09-30T22:34:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80b5490700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b009d630 0x7f80b0133790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80b5490700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b00a0a30 0x7f80b0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80b5490700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0138d80 0x7f80b0134210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80b5490700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b00a0410 con 0x7f80b009d630 2023-09-30T22:34:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80b5490700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b0136ec0 con 0x7f80b0138d80 2023-09-30T22:34:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80b5490700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80b013ac70 con 0x7f80b00a0a30 2023-09-30T22:34:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80ae7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b00a0a30 0x7f80b0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80af7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0138d80 0x7f80b0134210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80ae7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b00a0a30 0x7f80b0133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49546/0 (socket says 172.21.15.59:49546) 2023-09-30T22:34:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80ae7fc700 1 -- 172.21.15.59:0/1159667335 learned_addr learned my addr 172.21.15.59:0/1159667335 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80aeffd700 1 --2- 172.21.15.59:0/1159667335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b009d630 0x7f80b0133790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80ae7fc700 1 -- 172.21.15.59:0/1159667335 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0138d80 msgr2=0x7f80b0134210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80ae7fc700 1 --2- 172.21.15.59:0/1159667335 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0138d80 0x7f80b0134210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80ae7fc700 1 -- 172.21.15.59:0/1159667335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b009d630 msgr2=0x7f80b0133790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80ae7fc700 1 --2- 172.21.15.59:0/1159667335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b009d630 0x7f80b0133790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80ae7fc700 1 -- 172.21.15.59:0/1159667335 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a8009a70 con 0x7f80b00a0a30 2023-09-30T22:34:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80aeffd700 1 --2- 172.21.15.59:0/1159667335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b009d630 0x7f80b0133790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80ae7fc700 1 --2- 172.21.15.59:0/1159667335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b00a0a30 0x7f80b0133cd0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f80a400c520 tx=0x7f80a400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.084+0000 7f80977fe700 1 -- 172.21.15.59:0/1159667335 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4004c80 con 0x7f80b00a0a30 2023-09-30T22:34:43.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.085+0000 7f80977fe700 1 -- 172.21.15.59:0/1159667335 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a4004de0 con 0x7f80b00a0a30 2023-09-30T22:34:43.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.085+0000 7f80977fe700 1 -- 172.21.15.59:0/1159667335 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4007310 con 0x7f80b00a0a30 2023-09-30T22:34:43.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.085+0000 7f80b5490700 1 -- 172.21.15.59:0/1159667335 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a00094a0 con 0x7f80b00a0a30 2023-09-30T22:34:43.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.085+0000 7f80b5490700 1 -- 172.21.15.59:0/1159667335 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b01371a0 con 0x7f80b00a0a30 2023-09-30T22:34:43.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.085+0000 7f80977fe700 1 -- 172.21.15.59:0/1159667335 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80a4007470 con 0x7f80b00a0a30 2023-09-30T22:34:43.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.086+0000 7f80977fe700 1 -- 172.21.15.59:0/1159667335 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f80a403f2d0 con 0x7f80b00a0a30 2023-09-30T22:34:43.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.086+0000 7f80b5490700 1 -- 172.21.15.59:0/1159667335 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b00747f0 con 0x7f80b00a0a30 2023-09-30T22:34:43.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.091+0000 7f80977fe700 1 -- 172.21.15.59:0/1159667335 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80a40123b0 con 0x7f80b00a0a30 2023-09-30T22:34:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.239+0000 7efedb66c700 1 -- 172.21.15.59:0/1740079371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efed40a1d10 con 0x7efed40a1510 2023-09-30T22:34:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.239+0000 7efed1ffb700 1 -- 172.21.15.59:0/1740079371 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efec8015070 con 0x7efed40a1510 2023-09-30T22:34:43.239 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.242+0000 7efedb66c700 1 -- 172.21.15.59:0/1740079371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efed40a1510 msgr2=0x7efed41c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.242+0000 7efedb66c700 1 --2- 172.21.15.59:0/1740079371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efed40a1510 0x7efed41c8a80 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7efec8009c70 tx=0x7efec8004750 comp rx=0 tx=0).stop 2023-09-30T22:34:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.242+0000 7efedb66c700 1 -- 172.21.15.59:0/1740079371 shutdown_connections 2023-09-30T22:34:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.242+0000 7efedb66c700 1 --2- 172.21.15.59:0/1740079371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efed40a0a30 0x7efed41c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.242+0000 7efedb66c700 1 --2- 172.21.15.59:0/1740079371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed4139250 0x7efed41c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.242+0000 7efedb66c700 1 --2- 172.21.15.59:0/1740079371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efed40a1510 0x7efed41c8a80 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.242+0000 7efedb66c700 1 -- 172.21.15.59:0/1740079371 >> 172.21.15.59:0/1740079371 conn(0x7efed40a6550 msgr2=0x7efed40a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:43.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.242+0000 7efedb66c700 1 -- 172.21.15.59:0/1740079371 shutdown_connections 2023-09-30T22:34:43.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.242+0000 7efedb66c700 1 -- 172.21.15.59:0/1740079371 wait complete. 2023-09-30T22:34:43.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:43.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.280+0000 7f00ae9c1700 1 Processor -- start 2023-09-30T22:34:43.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.280+0000 7f00ae9c1700 1 -- start start 2023-09-30T22:34:43.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.280+0000 7f00ae9c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8130750 0x7f00a8130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.280+0000 7f00ae9c1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f00a809e250 0x7f00a81384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.280+0000 7f00ae9c1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a809c190 con 0x7f00a809d6f0 2023-09-30T22:34:43.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.280+0000 7f00ae9c1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a809b090 con 0x7f00a809e250 2023-09-30T22:34:43.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.280+0000 7f00ae9c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a809a6c0 con 0x7f00a8130750 2023-09-30T22:34:43.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.281+0000 7f00acf5e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f00a809e250 0x7f00a81384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.281+0000 7f00a7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8130750 0x7f00a8130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.281+0000 7f00a7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8130750 0x7f00a8130b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36508/0 (socket says 172.21.15.59:36508) 2023-09-30T22:34:43.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.281+0000 7f00acf5e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f00a809e250 0x7f00a81384c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53332/0 (socket says 172.21.15.59:53332) 2023-09-30T22:34:43.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.281+0000 7f00a7fff700 1 -- 172.21.15.59:0/2361446172 learned_addr learned my addr 172.21.15.59:0/2361446172 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:43.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.281+0000 7f00a7fff700 1 -- 172.21.15.59:0/2361446172 >> v2:172.21.15.59:3300/0 conn(0x7f00a809e250 msgr2=0x7f00a81384c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:43.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.281+0000 7f00a7fff700 1 --2- 172.21.15.59:0/2361446172 >> v2:172.21.15.59:3300/0 conn(0x7f00a809e250 0x7f00a81384c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.281+0000 7f00a7fff700 1 -- 172.21.15.59:0/2361446172 >> v1:172.21.15.59:6789/0 conn(0x7f00a809d6f0 legacy=0x7f00a809db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.281+0000 7f00a7fff700 1 -- 172.21.15.59:0/2361446172 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a8131060 con 0x7f00a8130750 2023-09-30T22:34:43.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.281+0000 7f00a6ffd700 1 -- 172.21.15.59:0/2361446172 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777880494 0 0) 0x7f00a809c190 con 0x7f00a809d6f0 2023-09-30T22:34:43.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.281+0000 7f00acf5e700 1 --2- 172.21.15.59:0/2361446172 >> v2:172.21.15.59:3300/0 conn(0x7f00a809e250 0x7f00a81384c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:43.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.281+0000 7f00a7fff700 1 --2- 172.21.15.59:0/2361446172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8130750 0x7f00a8130b20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f00980098f0 tx=0x7f0098009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b74f9d48ba829b53 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:43.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.282+0000 7f00a6ffd700 1 -- 172.21.15.59:0/2361446172 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098011830 con 0x7f00a8130750 2023-09-30T22:34:43.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.282+0000 7f00a6ffd700 1 -- 172.21.15.59:0/2361446172 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0098011990 con 0x7f00a8130750 2023-09-30T22:34:43.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.282+0000 7f00a6ffd700 1 -- 172.21.15.59:0/2361446172 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098011d20 con 0x7f00a8130750 2023-09-30T22:34:43.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.282+0000 7f506edaf700 1 Processor -- start 2023-09-30T22:34:43.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.282+0000 7f506edaf700 1 -- start start 2023-09-30T22:34:43.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f00ae9c1700 1 -- 172.21.15.59:0/2361446172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8130750 msgr2=0x7f00a8130b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f00ae9c1700 1 --2- 172.21.15.59:0/2361446172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8130750 0x7f00a8130b20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f00980098f0 tx=0x7f0098009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:43.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506edaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50680954c0 0x7f5068095890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506edaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f506809a1c0 0x7f50681385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506edaf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506809c280 con 0x7f5068099680 2023-09-30T22:34:43.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506edaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506809aaf0 con 0x7f506809a1c0 2023-09-30T22:34:43.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506edaf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f506809b960 con 0x7f50680954c0 2023-09-30T22:34:43.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f00ae9c1700 1 -- 172.21.15.59:0/2361446172 shutdown_connections 2023-09-30T22:34:43.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f00ae9c1700 1 --2- 172.21.15.59:0/2361446172 >> v2:172.21.15.59:3300/0 conn(0x7f00a809e250 0x7f00a81384c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f00ae9c1700 1 --2- 172.21.15.59:0/2361446172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8130750 0x7f00a8130b20 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f00ae9c1700 1 -- 172.21.15.59:0/2361446172 >> 172.21.15.59:0/2361446172 conn(0x7f00a809f470 msgr2=0x7f00a80a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:43.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506d34c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f506809a1c0 0x7f50681385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506cb4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50680954c0 0x7f5068095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506cb4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50680954c0 0x7f5068095890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49556/0 (socket says 172.21.15.59:49556) 2023-09-30T22:34:43.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506d34c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f506809a1c0 0x7f50681385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36518/0 (socket says 172.21.15.59:36518) 2023-09-30T22:34:43.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506cb4b700 1 -- 172.21.15.59:0/1138531498 learned_addr learned my addr 172.21.15.59:0/1138531498 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:43.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f00ae9c1700 1 -- 172.21.15.59:0/2361446172 shutdown_connections 2023-09-30T22:34:43.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f00ae9c1700 1 -- 172.21.15.59:0/2361446172 wait complete. 2023-09-30T22:34:43.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506d34c700 1 -- 172.21.15.59:0/1138531498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50680954c0 msgr2=0x7f5068095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:43.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506d34c700 1 --2- 172.21.15.59:0/1138531498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50680954c0 0x7f5068095890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506d34c700 1 -- 172.21.15.59:0/1138531498 >> v1:172.21.15.59:6789/0 conn(0x7f5068099680 legacy=0x7f5068099ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506d34c700 1 -- 172.21.15.59:0/1138531498 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506809a7b0 con 0x7f506809a1c0 2023-09-30T22:34:43.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506cb4b700 1 --2- 172.21.15.59:0/1138531498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50680954c0 0x7f5068095890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:43.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.283+0000 7f506d34c700 1 --2- 172.21.15.59:0/1138531498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f506809a1c0 0x7f50681385a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5060009dc0 tx=0x7f506000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fc6acbfb9d64ce0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:43.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.284+0000 7f50677fe700 1 -- 172.21.15.59:0/1138531498 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506000e070 con 0x7f506809a1c0 2023-09-30T22:34:43.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.284+0000 7f50677fe700 1 -- 172.21.15.59:0/1138531498 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506000bb20 con 0x7f506809a1c0 2023-09-30T22:34:43.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.284+0000 7f50677fe700 1 -- 172.21.15.59:0/1138531498 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060012430 con 0x7f506809a1c0 2023-09-30T22:34:43.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.284+0000 7f00ae9c1700 1 Processor -- start 2023-09-30T22:34:43.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.284+0000 7f00ae9c1700 1 -- start start 2023-09-30T22:34:43.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.284+0000 7f506edaf700 1 -- 172.21.15.59:0/1138531498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f506809a1c0 msgr2=0x7f50681385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.284+0000 7f506edaf700 1 --2- 172.21.15.59:0/1138531498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f506809a1c0 0x7f50681385a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5060009dc0 tx=0x7f506000b330 comp rx=0 tx=0).stop 2023-09-30T22:34:43.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f506edaf700 1 -- 172.21.15.59:0/1138531498 shutdown_connections 2023-09-30T22:34:43.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f506edaf700 1 --2- 172.21.15.59:0/1138531498 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50680954c0 0x7f5068095890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f506edaf700 1 --2- 172.21.15.59:0/1138531498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f506809a1c0 0x7f50681385a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f506edaf700 1 -- 172.21.15.59:0/1138531498 >> 172.21.15.59:0/1138531498 conn(0x7f50680a2360 msgr2=0x7f50680a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:43.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f506edaf700 1 -- 172.21.15.59:0/1138531498 shutdown_connections 2023-09-30T22:34:43.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f506edaf700 1 -- 172.21.15.59:0/1138531498 wait complete. 2023-09-30T22:34:43.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f00ae9c1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00a809d6f0 0x7f00a812c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f00ae9c1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00a809e250 0x7f00a812c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f00ae9c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8130750 0x7f00a812cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f00ae9c1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a812e580 con 0x7f00a809e250 2023-09-30T22:34:43.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f00ae9c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a812f3e0 con 0x7f00a8130750 2023-09-30T22:34:43.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f00ae9c1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00a812e0b0 con 0x7f00a809d6f0 2023-09-30T22:34:43.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f00a77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00a809e250 0x7f00a812c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f00a77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00a809e250 0x7f00a812c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53342/0 (socket says 172.21.15.59:53342) 2023-09-30T22:34:43.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f00a77fe700 1 -- 172.21.15.59:0/802024777 learned_addr learned my addr 172.21.15.59:0/802024777 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:43.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f00acf5e700 1 --2- 172.21.15.59:0/802024777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8130750 0x7f00a812cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f00a7fff700 1 --2- 172.21.15.59:0/802024777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00a809d6f0 0x7f00a812c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f00a77fe700 1 -- 172.21.15.59:0/802024777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00a809d6f0 msgr2=0x7f00a812c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f00a77fe700 1 --2- 172.21.15.59:0/802024777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00a809d6f0 0x7f00a812c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f00a77fe700 1 -- 172.21.15.59:0/802024777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8130750 msgr2=0x7f00a812cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.285+0000 7f00a77fe700 1 --2- 172.21.15.59:0/802024777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8130750 0x7f00a812cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.286+0000 7f00a77fe700 1 -- 172.21.15.59:0/802024777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a0009a70 con 0x7f00a809e250 2023-09-30T22:34:43.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.286+0000 7f00acf5e700 1 --2- 172.21.15.59:0/802024777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8130750 0x7f00a812cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:43.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.286+0000 7f00a77fe700 1 --2- 172.21.15.59:0/802024777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00a809e250 0x7f00a812c7a0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f009c001eb0 tx=0x7f009c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:43.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.286+0000 7f506edaf700 1 Processor -- start 2023-09-30T22:34:43.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.286+0000 7f506edaf700 1 -- start start 2023-09-30T22:34:43.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.286+0000 7f00a4ff9700 1 -- 172.21.15.59:0/802024777 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c0054e0 con 0x7f00a809e250 2023-09-30T22:34:43.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.286+0000 7f00a4ff9700 1 -- 172.21.15.59:0/802024777 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009c003680 con 0x7f00a809e250 2023-09-30T22:34:43.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.286+0000 7f00ae9c1700 1 -- 172.21.15.59:0/802024777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0098009550 con 0x7f00a809e250 2023-09-30T22:34:43.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.286+0000 7f00a4ff9700 1 -- 172.21.15.59:0/802024777 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c003a10 con 0x7f00a809e250 2023-09-30T22:34:43.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.286+0000 7f00ae9c1700 1 -- 172.21.15.59:0/802024777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a812f6c0 con 0x7f00a809e250 2023-09-30T22:34:43.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f506edaf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50680954c0 0x7f506808c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f506edaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5068099680 0x7f506808c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f506edaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f506809a1c0 0x7f50681cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:43.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f506edaf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506808d1c0 con 0x7f50680954c0 2023-09-30T22:34:43.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f506edaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506808f320 con 0x7f506809a1c0 2023-09-30T22:34:43.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f506edaf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f506809f8b0 con 0x7f5068099680 2023-09-30T22:34:43.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f506cb4b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50680954c0 0x7f506808c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f506cb4b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50680954c0 0x7f506808c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53350/0 (socket says 172.21.15.59:53350) 2023-09-30T22:34:43.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f506cb4b700 1 -- 172.21.15.59:0/2332696762 learned_addr learned my addr 172.21.15.59:0/2332696762 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:43.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f5067fff700 1 --2- 172.21.15.59:0/2332696762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5068099680 0x7f506808c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f506d34c700 1 --2- 172.21.15.59:0/2332696762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f506809a1c0 0x7f50681cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:43.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f00a4ff9700 1 -- 172.21.15.59:0/802024777 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f009c003b70 con 0x7f00a809e250 2023-09-30T22:34:43.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.288+0000 7f00a4ff9700 1 -- 172.21.15.59:0/802024777 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f009c03ebc0 con 0x7f00a809e250 2023-09-30T22:34:43.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f5067fff700 1 -- 172.21.15.59:0/2332696762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f506809a1c0 msgr2=0x7f50681cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f5067fff700 1 --2- 172.21.15.59:0/2332696762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f506809a1c0 0x7f50681cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f5067fff700 1 -- 172.21.15.59:0/2332696762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50680954c0 msgr2=0x7f506808c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f5067fff700 1 --2- 172.21.15.59:0/2332696762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50680954c0 0x7f506808c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.287+0000 7f5067fff700 1 -- 172.21.15.59:0/2332696762 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c009550 con 0x7f5068099680 2023-09-30T22:34:43.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.288+0000 7f5067fff700 1 --2- 172.21.15.59:0/2332696762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5068099680 0x7f506808c620 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5054000f60 tx=0x7f505400c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:43.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.288+0000 7f50657fa700 1 -- 172.21.15.59:0/2332696762 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50540050d0 con 0x7f5068099680 2023-09-30T22:34:43.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.288+0000 7f50657fa700 1 -- 172.21.15.59:0/2332696762 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5054005230 con 0x7f5068099680 2023-09-30T22:34:43.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.288+0000 7f506edaf700 1 -- 172.21.15.59:0/2332696762 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5060009a70 con 0x7f5068099680 2023-09-30T22:34:43.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.288+0000 7f50657fa700 1 -- 172.21.15.59:0/2332696762 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5054003680 con 0x7f5068099680 2023-09-30T22:34:43.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.288+0000 7f506edaf700 1 -- 172.21.15.59:0/2332696762 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506808ee60 con 0x7f5068099680 2023-09-30T22:34:43.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.288+0000 7f00ae9c1700 1 -- 172.21.15.59:0/802024777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a80747f0 con 0x7f00a809e250 2023-09-30T22:34:43.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.289+0000 7f50657fa700 1 -- 172.21.15.59:0/2332696762 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50540037e0 con 0x7f5068099680 2023-09-30T22:34:43.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.289+0000 7f50657fa700 1 -- 172.21.15.59:0/2332696762 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f505403e9c0 con 0x7f5068099680 2023-09-30T22:34:43.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.289+0000 7f506edaf700 1 -- 172.21.15.59:0/2332696762 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5068074ea0 con 0x7f5068099680 2023-09-30T22:34:43.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.294+0000 7f00a4ff9700 1 -- 172.21.15.59:0/802024777 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f009c017020 con 0x7f00a809e250 2023-09-30T22:34:43.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.295+0000 7f50657fa700 1 -- 172.21.15.59:0/2332696762 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5054011590 con 0x7f5068099680 2023-09-30T22:34:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.324+0000 7f80b5490700 1 -- 172.21.15.59:0/1159667335 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f80b0072980 con 0x7f80b00a0a30 2023-09-30T22:34:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.324+0000 7f80977fe700 1 -- 172.21.15.59:0/1159667335 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f80a403f0d0 con 0x7f80b00a0a30 2023-09-30T22:34:43.325 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.327+0000 7f80b5490700 1 -- 172.21.15.59:0/1159667335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b00a0a30 msgr2=0x7f80b0133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.327+0000 7f80b5490700 1 --2- 172.21.15.59:0/1159667335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b00a0a30 0x7f80b0133cd0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f80a400c520 tx=0x7f80a400c830 comp rx=0 tx=0).stop 2023-09-30T22:34:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.327+0000 7f80b5490700 1 -- 172.21.15.59:0/1159667335 shutdown_connections 2023-09-30T22:34:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.327+0000 7f80b5490700 1 --2- 172.21.15.59:0/1159667335 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b0138d80 0x7f80b0134210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.327+0000 7f80b5490700 1 --2- 172.21.15.59:0/1159667335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b009d630 0x7f80b0133790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.327+0000 7f80b5490700 1 --2- 172.21.15.59:0/1159667335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b00a0a30 0x7f80b0133cd0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.327+0000 7f80b5490700 1 -- 172.21.15.59:0/1159667335 >> 172.21.15.59:0/1159667335 conn(0x7f80b00a3050 msgr2=0x7f80b009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.327+0000 7f80b5490700 1 -- 172.21.15.59:0/1159667335 shutdown_connections 2023-09-30T22:34:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.327+0000 7f80b5490700 1 -- 172.21.15.59:0/1159667335 wait complete. 2023-09-30T22:34:43.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:43.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.502+0000 7f506edaf700 1 -- 172.21.15.59:0/2332696762 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f506808bc40 con 0x7f5068099680 2023-09-30T22:34:43.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.503+0000 7f50657fa700 1 -- 172.21.15.59:0/2332696762 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50540192c0 con 0x7f5068099680 2023-09-30T22:34:43.503 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:43.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.505+0000 7f506edaf700 1 -- 172.21.15.59:0/2332696762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5068099680 msgr2=0x7f506808c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.505+0000 7f506edaf700 1 --2- 172.21.15.59:0/2332696762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5068099680 0x7f506808c620 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5054000f60 tx=0x7f505400c730 comp rx=0 tx=0).stop 2023-09-30T22:34:43.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.505+0000 7f506edaf700 1 -- 172.21.15.59:0/2332696762 shutdown_connections 2023-09-30T22:34:43.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.505+0000 7f506edaf700 1 --2- 172.21.15.59:0/2332696762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f506809a1c0 0x7f50681cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.505+0000 7f506edaf700 1 --2- 172.21.15.59:0/2332696762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50680954c0 0x7f506808c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.505+0000 7f506edaf700 1 --2- 172.21.15.59:0/2332696762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5068099680 0x7f506808c620 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.505+0000 7f506edaf700 1 -- 172.21.15.59:0/2332696762 >> 172.21.15.59:0/2332696762 conn(0x7f50680a2360 msgr2=0x7f50680a0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:43.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.505+0000 7f506edaf700 1 -- 172.21.15.59:0/2332696762 shutdown_connections 2023-09-30T22:34:43.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.505+0000 7f506edaf700 1 -- 172.21.15.59:0/2332696762 wait complete. 2023-09-30T22:34:43.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.505+0000 7f00ae9c1700 1 -- 172.21.15.59:0/802024777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f00a806b250 con 0x7f00a809e250 2023-09-30T22:34:43.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.505+0000 7f00a4ff9700 1 -- 172.21.15.59:0/802024777 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f009c01ae60 con 0x7f00a809e250 2023-09-30T22:34:43.507 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:43.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.508+0000 7f00ae9c1700 1 -- 172.21.15.59:0/802024777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00a809e250 msgr2=0x7f00a812c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:43.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.508+0000 7f00ae9c1700 1 --2- 172.21.15.59:0/802024777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00a809e250 0x7f00a812c7a0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f009c001eb0 tx=0x7f009c00c7e0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.508+0000 7f00ae9c1700 1 -- 172.21.15.59:0/802024777 shutdown_connections 2023-09-30T22:34:43.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.508+0000 7f00ae9c1700 1 --2- 172.21.15.59:0/802024777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00a809d6f0 0x7f00a812c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.508+0000 7f00ae9c1700 1 --2- 172.21.15.59:0/802024777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00a8130750 0x7f00a812cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.508+0000 7f00ae9c1700 1 --2- 172.21.15.59:0/802024777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00a809e250 0x7f00a812c7a0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:43.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.508+0000 7f00ae9c1700 1 -- 172.21.15.59:0/802024777 >> 172.21.15.59:0/802024777 conn(0x7f00a809f470 msgr2=0x7f00a81b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:43.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.508+0000 7f00ae9c1700 1 -- 172.21.15.59:0/802024777 shutdown_connections 2023-09-30T22:34:43.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:43.508+0000 7f00ae9c1700 1 -- 172.21.15.59:0/802024777 wait complete. 2023-09-30T22:34:43.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:43.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:44.258 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:44.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:44.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.405+0000 7f626e513700 1 Processor -- start 2023-09-30T22:34:44.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.405+0000 7f626e513700 1 -- start start 2023-09-30T22:34:44.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.405+0000 7f626e513700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62680a0a30 0x7f62680a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.405+0000 7f626e513700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6268138d80 0x7f626813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.405+0000 7f626e513700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62680a2a70 con 0x7f626809d630 2023-09-30T22:34:44.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.405+0000 7f626e513700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62680a01d0 con 0x7f62680a0a30 2023-09-30T22:34:44.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.405+0000 7f626e513700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626809e2b0 con 0x7f6268138d80 2023-09-30T22:34:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.406+0000 7f6267fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62680a0a30 0x7f62680a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.406+0000 7f626cab0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6268138d80 0x7f626813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.406+0000 7f6267fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62680a0a30 0x7f62680a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38696/0 (socket says 172.21.15.59:38696) 2023-09-30T22:34:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.406+0000 7f6267fff700 1 -- 172.21.15.59:0/2036545105 learned_addr learned my addr 172.21.15.59:0/2036545105 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.406+0000 7f626cab0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6268138d80 0x7f626813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39222/0 (socket says 172.21.15.59:39222) 2023-09-30T22:34:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.406+0000 7f626cab0700 1 -- 172.21.15.59:0/2036545105 >> v2:172.21.15.59:3300/0 conn(0x7f62680a0a30 msgr2=0x7f62680a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.406+0000 7f626cab0700 1 --2- 172.21.15.59:0/2036545105 >> v2:172.21.15.59:3300/0 conn(0x7f62680a0a30 0x7f62680a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.406+0000 7f626cab0700 1 -- 172.21.15.59:0/2036545105 >> v1:172.21.15.59:6789/0 conn(0x7f626809d630 legacy=0x7f62680a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.406+0000 7f626cab0700 1 -- 172.21.15.59:0/2036545105 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626809dc50 con 0x7f6268138d80 2023-09-30T22:34:44.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.406+0000 7f626cab0700 1 --2- 172.21.15.59:0/2036545105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6268138d80 0x7f626813b160 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6260009d90 tx=0x7f626000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c018406eeffe80f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:44.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.406+0000 7f6266ffd700 1 -- 172.21.15.59:0/2036545105 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626000e070 con 0x7f6268138d80 2023-09-30T22:34:44.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.406+0000 7f6266ffd700 1 -- 172.21.15.59:0/2036545105 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626000bb20 con 0x7f6268138d80 2023-09-30T22:34:44.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.406+0000 7f6266ffd700 1 -- 172.21.15.59:0/2036545105 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260012430 con 0x7f6268138d80 2023-09-30T22:34:44.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.407+0000 7f626e513700 1 -- 172.21.15.59:0/2036545105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6268138d80 msgr2=0x7f626813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.407+0000 7f626e513700 1 --2- 172.21.15.59:0/2036545105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6268138d80 0x7f626813b160 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6260009d90 tx=0x7f626000b330 comp rx=0 tx=0).stop 2023-09-30T22:34:44.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.407+0000 7f626e513700 1 -- 172.21.15.59:0/2036545105 shutdown_connections 2023-09-30T22:34:44.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.407+0000 7f626e513700 1 --2- 172.21.15.59:0/2036545105 >> v2:172.21.15.59:3300/0 conn(0x7f62680a0a30 0x7f62680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.407+0000 7f626e513700 1 --2- 172.21.15.59:0/2036545105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6268138d80 0x7f626813b160 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.407+0000 7f626e513700 1 -- 172.21.15.59:0/2036545105 >> 172.21.15.59:0/2036545105 conn(0x7f62680a3050 msgr2=0x7f62680a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:44.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.407+0000 7f626e513700 1 -- 172.21.15.59:0/2036545105 shutdown_connections 2023-09-30T22:34:44.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.407+0000 7f626e513700 1 -- 172.21.15.59:0/2036545105 wait complete. 2023-09-30T22:34:44.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.409+0000 7f626e513700 1 Processor -- start 2023-09-30T22:34:44.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.409+0000 7f626e513700 1 -- start start 2023-09-30T22:34:44.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f626e513700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626809d630 0x7f6268120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f626e513700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62680a0a30 0x7f6268120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f626e513700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6268138d80 0x7f62681210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f626e513700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6268123e60 con 0x7f62680a0a30 2023-09-30T22:34:44.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f626e513700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6268122ff0 con 0x7f626809d630 2023-09-30T22:34:44.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f626e513700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6268124060 con 0x7f6268138d80 2023-09-30T22:34:44.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f62677fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62680a0a30 0x7f6268120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f6267fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626809d630 0x7f6268120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f62677fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62680a0a30 0x7f6268120b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38698/0 (socket says 172.21.15.59:38698) 2023-09-30T22:34:44.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f62677fe700 1 -- 172.21.15.59:0/2016499002 learned_addr learned my addr 172.21.15.59:0/2016499002 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:44.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f6267fff700 1 -- 172.21.15.59:0/2016499002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6268138d80 msgr2=0x7f62681210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f6267fff700 1 --2- 172.21.15.59:0/2016499002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6268138d80 0x7f62681210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f6267fff700 1 -- 172.21.15.59:0/2016499002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62680a0a30 msgr2=0x7f6268120b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f6267fff700 1 --2- 172.21.15.59:0/2016499002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62680a0a30 0x7f6268120b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f6267fff700 1 -- 172.21.15.59:0/2016499002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6260009a70 con 0x7f626809d630 2023-09-30T22:34:44.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f62677fe700 1 --2- 172.21.15.59:0/2016499002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62680a0a30 0x7f6268120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:44.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f6267fff700 1 --2- 172.21.15.59:0/2016499002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626809d630 0x7f6268120620 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f625800e8e0 tx=0x7f625800ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:44.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.410+0000 7f6264ff9700 1 -- 172.21.15.59:0/2016499002 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625800c690 con 0x7f626809d630 2023-09-30T22:34:44.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.411+0000 7f6264ff9700 1 -- 172.21.15.59:0/2016499002 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625800c7f0 con 0x7f626809d630 2023-09-30T22:34:44.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.411+0000 7f626e513700 1 -- 172.21.15.59:0/2016499002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6268123410 con 0x7f626809d630 2023-09-30T22:34:44.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.411+0000 7f6264ff9700 1 -- 172.21.15.59:0/2016499002 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625800cb80 con 0x7f626809d630 2023-09-30T22:34:44.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.411+0000 7f626e513700 1 -- 172.21.15.59:0/2016499002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62681389a0 con 0x7f626809d630 2023-09-30T22:34:44.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.411+0000 7f6264ff9700 1 -- 172.21.15.59:0/2016499002 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f625800cce0 con 0x7f626809d630 2023-09-30T22:34:44.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.412+0000 7f6264ff9700 1 -- 172.21.15.59:0/2016499002 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f625803fba0 con 0x7f626809d630 2023-09-30T22:34:44.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.412+0000 7f626e513700 1 -- 172.21.15.59:0/2016499002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6268123cb0 con 0x7f626809d630 2023-09-30T22:34:44.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.417+0000 7f6264ff9700 1 -- 172.21.15.59:0/2016499002 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f625801b3b0 con 0x7f626809d630 2023-09-30T22:34:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.485+0000 7f1b6b20c700 1 Processor -- start 2023-09-30T22:34:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.485+0000 7f1b6b20c700 1 -- start start 2023-09-30T22:34:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.485+0000 7f1b6b20c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b6409e930 0x7f1b6409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.485+0000 7f1b6b20c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6409f240 0x7f1b641317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.485+0000 7f1b6b20c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6409f650 0x7f1b64131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.485+0000 7f1b6b20c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b64070940 con 0x7f1b6409e930 2023-09-30T22:34:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.485+0000 7f1b6b20c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6406fd60 con 0x7f1b6409f240 2023-09-30T22:34:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.485+0000 7f1b6b20c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6406fa80 con 0x7f1b6409f650 2023-09-30T22:34:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.486+0000 7f1b697a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6409f650 0x7f1b64131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.486+0000 7f1b697a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6409f650 0x7f1b64131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54512/0 (socket says 172.21.15.59:54512) 2023-09-30T22:34:44.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.486+0000 7f1b697a9700 1 -- 172.21.15.59:0/1975831066 learned_addr learned my addr 172.21.15.59:0/1975831066 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:44.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.486+0000 7f1b697a9700 1 -- 172.21.15.59:0/1975831066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6409f240 msgr2=0x7f1b641317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:44.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.486+0000 7f1b697a9700 1 --2- 172.21.15.59:0/1975831066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6409f240 0x7f1b641317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.486+0000 7f1b697a9700 1 -- 172.21.15.59:0/1975831066 >> v2:172.21.15.59:3300/0 conn(0x7f1b6409e930 msgr2=0x7f1b6409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:44.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.486+0000 7f1b697a9700 1 --2- 172.21.15.59:0/1975831066 >> v2:172.21.15.59:3300/0 conn(0x7f1b6409e930 0x7f1b6409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.486+0000 7f1b697a9700 1 -- 172.21.15.59:0/1975831066 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6409fb60 con 0x7f1b6409f650 2023-09-30T22:34:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.486+0000 7f1b697a9700 1 --2- 172.21.15.59:0/1975831066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6409f650 0x7f1b64131d30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009e50 tx=0x7f1b5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38fe79bdb1dc28af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.486+0000 7f1b637fe700 1 -- 172.21.15.59:0/1975831066 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00e070 con 0x7f1b6409f650 2023-09-30T22:34:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.486+0000 7f1b637fe700 1 -- 172.21.15.59:0/1975831066 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c00b9c0 con 0x7f1b6409f650 2023-09-30T22:34:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.486+0000 7f1b637fe700 1 -- 172.21.15.59:0/1975831066 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00bd70 con 0x7f1b6409f650 2023-09-30T22:34:44.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.487+0000 7f1b6b20c700 1 -- 172.21.15.59:0/1975831066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6409f650 msgr2=0x7f1b64131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.487+0000 7f1b6b20c700 1 --2- 172.21.15.59:0/1975831066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6409f650 0x7f1b64131d30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009e50 tx=0x7f1b5c00b330 comp rx=0 tx=0).stop 2023-09-30T22:34:44.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.487+0000 7f1b6b20c700 1 -- 172.21.15.59:0/1975831066 shutdown_connections 2023-09-30T22:34:44.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.487+0000 7f1b6b20c700 1 --2- 172.21.15.59:0/1975831066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6409f650 0x7f1b64131d30 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.487+0000 7f1b6b20c700 1 --2- 172.21.15.59:0/1975831066 >> v2:172.21.15.59:3300/0 conn(0x7f1b6409e930 0x7f1b6409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.487+0000 7f1b6b20c700 1 --2- 172.21.15.59:0/1975831066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6409f240 0x7f1b641317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.487+0000 7f1b6b20c700 1 -- 172.21.15.59:0/1975831066 >> 172.21.15.59:0/1975831066 conn(0x7f1b640a4210 msgr2=0x7f1b640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:44.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.487+0000 7f1b6b20c700 1 -- 172.21.15.59:0/1975831066 shutdown_connections 2023-09-30T22:34:44.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.487+0000 7f1b6b20c700 1 -- 172.21.15.59:0/1975831066 wait complete. 2023-09-30T22:34:44.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.488+0000 7f1b6b20c700 1 Processor -- start 2023-09-30T22:34:44.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.488+0000 7f1b6b20c700 1 -- start start 2023-09-30T22:34:44.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b6b20c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6409e930 0x7f1b6406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b6b20c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6409f240 0x7f1b6406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b6b20c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6409f650 0x7f1b6406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b6b20c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b641b7250 con 0x7f1b6409f240 2023-09-30T22:34:44.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b6b20c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b641a9400 con 0x7f1b6409e930 2023-09-30T22:34:44.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b6b20c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b641a8920 con 0x7f1b6409f650 2023-09-30T22:34:44.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b68fa8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6409e930 0x7f1b6406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b63fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6409f240 0x7f1b6406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b68fa8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6409e930 0x7f1b6406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39264/0 (socket says 172.21.15.59:39264) 2023-09-30T22:34:44.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b697a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6409f650 0x7f1b6406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b68fa8700 1 -- 172.21.15.59:0/2015732761 learned_addr learned my addr 172.21.15.59:0/2015732761 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b63fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6409f240 0x7f1b6406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38722/0 (socket says 172.21.15.59:38722) 2023-09-30T22:34:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b68fa8700 1 -- 172.21.15.59:0/2015732761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6409f650 msgr2=0x7f1b6406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b68fa8700 1 --2- 172.21.15.59:0/2015732761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6409f650 0x7f1b6406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b68fa8700 1 -- 172.21.15.59:0/2015732761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6409f240 msgr2=0x7f1b6406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b68fa8700 1 --2- 172.21.15.59:0/2015732761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6409f240 0x7f1b6406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b68fa8700 1 -- 172.21.15.59:0/2015732761 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c009b30 con 0x7f1b6409e930 2023-09-30T22:34:44.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b63fff700 1 --2- 172.21.15.59:0/2015732761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6409f240 0x7f1b6406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:44.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.489+0000 7f1b697a9700 1 --2- 172.21.15.59:0/2015732761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6409f650 0x7f1b6406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:44.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.490+0000 7f1b68fa8700 1 --2- 172.21.15.59:0/2015732761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6409e930 0x7f1b6406b8b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800b560 tx=0x7f1b5800b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:44.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.490+0000 7f1b617fa700 1 -- 172.21.15.59:0/2015732761 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58011830 con 0x7f1b6409e930 2023-09-30T22:34:44.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.490+0000 7f1b6b20c700 1 -- 172.21.15.59:0/2015732761 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b640a0190 con 0x7f1b6409e930 2023-09-30T22:34:44.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.490+0000 7f1b617fa700 1 -- 172.21.15.59:0/2015732761 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b58011990 con 0x7f1b6409e930 2023-09-30T22:34:44.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.490+0000 7f1b617fa700 1 -- 172.21.15.59:0/2015732761 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58011d40 con 0x7f1b6409e930 2023-09-30T22:34:44.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.490+0000 7f1b6b20c700 1 -- 172.21.15.59:0/2015732761 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b641a9130 con 0x7f1b6409e930 2023-09-30T22:34:44.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.491+0000 7f1b617fa700 1 -- 172.21.15.59:0/2015732761 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b5801a400 con 0x7f1b6409e930 2023-09-30T22:34:44.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.491+0000 7f1b617fa700 1 -- 172.21.15.59:0/2015732761 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1b5803f680 con 0x7f1b6409e930 2023-09-30T22:34:44.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.491+0000 7f1b6b20c700 1 -- 172.21.15.59:0/2015732761 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b641a0b30 con 0x7f1b6409e930 2023-09-30T22:34:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.496+0000 7f1b617fa700 1 -- 172.21.15.59:0/2015732761 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b58015080 con 0x7f1b6409e930 2023-09-30T22:34:44.520 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:44.523 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.667+0000 7f626e513700 1 -- 172.21.15.59:0/2016499002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f626813b620 con 0x7f626809d630 2023-09-30T22:34:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.667+0000 7f6264ff9700 1 -- 172.21.15.59:0/2016499002 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f625802b090 con 0x7f626809d630 2023-09-30T22:34:44.668 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.670+0000 7f626e513700 1 -- 172.21.15.59:0/2016499002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626809d630 msgr2=0x7f6268120620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.670+0000 7f626e513700 1 --2- 172.21.15.59:0/2016499002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626809d630 0x7f6268120620 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f625800e8e0 tx=0x7f625800ebf0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.670+0000 7f626e513700 1 -- 172.21.15.59:0/2016499002 shutdown_connections 2023-09-30T22:34:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.670+0000 7f626e513700 1 --2- 172.21.15.59:0/2016499002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6268138d80 0x7f62681210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.670+0000 7f626e513700 1 --2- 172.21.15.59:0/2016499002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f626809d630 0x7f6268120620 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.670+0000 7f626e513700 1 --2- 172.21.15.59:0/2016499002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62680a0a30 0x7f6268120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.670+0000 7f626e513700 1 -- 172.21.15.59:0/2016499002 >> 172.21.15.59:0/2016499002 conn(0x7f62680a3050 msgr2=0x7f626809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.670+0000 7f626e513700 1 -- 172.21.15.59:0/2016499002 shutdown_connections 2023-09-30T22:34:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.670+0000 7f626e513700 1 -- 172.21.15.59:0/2016499002 wait complete. 2023-09-30T22:34:44.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.674+0000 7f3b7b2b2700 1 Processor -- start 2023-09-30T22:34:44.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.674+0000 7f3b7b2b2700 1 -- start start 2023-09-30T22:34:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.675+0000 7f3b7b2b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b74134630 0x7f3b74136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.675+0000 7f3b7b2b2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b74136f50 0x7f3b74139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.675+0000 7f3b7b2b2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7409b4f0 con 0x7f3b74131810 2023-09-30T22:34:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.675+0000 7f3b7b2b2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b741313c0 con 0x7f3b74136f50 2023-09-30T22:34:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.675+0000 7f3b7b2b2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7406e8c0 con 0x7f3b74134630 2023-09-30T22:34:44.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.675+0000 7f3b7904e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3b74131810 0x7f3b74131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33112/0 (socket says 172.21.15.59:33112) 2023-09-30T22:34:44.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.675+0000 7f3b7904e700 1 -- 172.21.15.59:0/1987619779 learned_addr learned my addr 172.21.15.59:0/1987619779 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:44.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.675+0000 7f3b7884d700 1 --2- 172.21.15.59:0/1987619779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b74134630 0x7f3b74136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.675+0000 7f3b7984f700 1 --2- 172.21.15.59:0/1987619779 >> v2:172.21.15.59:3300/0 conn(0x7f3b74136f50 0x7f3b74139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.675+0000 7f3b7884d700 1 -- 172.21.15.59:0/1987619779 >> v2:172.21.15.59:3300/0 conn(0x7f3b74136f50 msgr2=0x7f3b74139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:44.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.675+0000 7f3b7884d700 1 --2- 172.21.15.59:0/1987619779 >> v2:172.21.15.59:3300/0 conn(0x7f3b74136f50 0x7f3b74139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.675+0000 7f3b7884d700 1 -- 172.21.15.59:0/1987619779 >> v1:172.21.15.59:6789/0 conn(0x7f3b74131810 legacy=0x7f3b74131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.675+0000 7f3b7884d700 1 -- 172.21.15.59:0/1987619779 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b74071d20 con 0x7f3b74134630 2023-09-30T22:34:44.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.675+0000 7f3b6bfff700 1 -- 172.21.15.59:0/1987619779 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976634569 0 0) 0x7f3b7409b4f0 con 0x7f3b74131810 2023-09-30T22:34:44.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.676+0000 7f3b7884d700 1 --2- 172.21.15.59:0/1987619779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b74134630 0x7f3b74136a10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009840 tx=0x7f3b64009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1157ce98f255103 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:44.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.676+0000 7f3b6bfff700 1 -- 172.21.15.59:0/1987619779 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64011830 con 0x7f3b74134630 2023-09-30T22:34:44.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.676+0000 7f3b6bfff700 1 -- 172.21.15.59:0/1987619779 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b64011990 con 0x7f3b74134630 2023-09-30T22:34:44.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.676+0000 7f3b6bfff700 1 -- 172.21.15.59:0/1987619779 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64011d20 con 0x7f3b74134630 2023-09-30T22:34:44.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.677+0000 7f3b7b2b2700 1 -- 172.21.15.59:0/1987619779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b74134630 msgr2=0x7f3b74136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.677+0000 7f3b7b2b2700 1 --2- 172.21.15.59:0/1987619779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b74134630 0x7f3b74136a10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009840 tx=0x7f3b64009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:44.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.677+0000 7f3b7b2b2700 1 -- 172.21.15.59:0/1987619779 shutdown_connections 2023-09-30T22:34:44.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.677+0000 7f3b7b2b2700 1 --2- 172.21.15.59:0/1987619779 >> v2:172.21.15.59:3300/0 conn(0x7f3b74136f50 0x7f3b74139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.677+0000 7f3b7b2b2700 1 --2- 172.21.15.59:0/1987619779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b74134630 0x7f3b74136a10 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.677+0000 7f3b7b2b2700 1 -- 172.21.15.59:0/1987619779 >> 172.21.15.59:0/1987619779 conn(0x7f3b740a2aa0 msgr2=0x7f3b740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:44.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.677+0000 7f3b7b2b2700 1 -- 172.21.15.59:0/1987619779 shutdown_connections 2023-09-30T22:34:44.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.677+0000 7f3b7b2b2700 1 -- 172.21.15.59:0/1987619779 wait complete. 2023-09-30T22:34:44.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.678+0000 7f3b7b2b2700 1 Processor -- start 2023-09-30T22:34:44.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.678+0000 7f3b7b2b2700 1 -- start start 2023-09-30T22:34:44.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.678+0000 7f3b7b2b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b74131810 0x7f3b74134a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.678+0000 7f3b7b2b2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b74134630 0x7f3b74134f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.678+0000 7f3b7b2b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b74136f50 0x7f3b74135480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.678+0000 7f3b7b2b2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7409c420 con 0x7f3b74131810 2023-09-30T22:34:44.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.678+0000 7f3b7b2b2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b74135cc0 con 0x7f3b74134630 2023-09-30T22:34:44.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.678+0000 7f3b7b2b2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7409c180 con 0x7f3b74136f50 2023-09-30T22:34:44.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.679+0000 7f3b7984f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b74136f50 0x7f3b74135480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.679+0000 7f3b7984f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b74136f50 0x7f3b74135480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54554/0 (socket says 172.21.15.59:54554) 2023-09-30T22:34:44.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.679+0000 7f3b7984f700 1 -- 172.21.15.59:0/2802676 learned_addr learned my addr 172.21.15.59:0/2802676 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:44.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.679+0000 7f3b7984f700 1 -- 172.21.15.59:0/2802676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b74134630 msgr2=0x7f3b74134f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.679+0000 7f3b7984f700 1 --2- 172.21.15.59:0/2802676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b74134630 0x7f3b74134f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.679+0000 7f3b7984f700 1 -- 172.21.15.59:0/2802676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b74131810 msgr2=0x7f3b74134a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.679+0000 7f3b7984f700 1 --2- 172.21.15.59:0/2802676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b74131810 0x7f3b74134a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.679+0000 7f3b7984f700 1 -- 172.21.15.59:0/2802676 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b640094a0 con 0x7f3b74136f50 2023-09-30T22:34:44.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.679+0000 7f3b7984f700 1 --2- 172.21.15.59:0/2802676 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b74136f50 0x7f3b74135480 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00ef90 tx=0x7f3b6c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:44.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.679+0000 7f3b69ffb700 1 -- 172.21.15.59:0/2802676 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c009ca0 con 0x7f3b74136f50 2023-09-30T22:34:44.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.679+0000 7f3b69ffb700 1 -- 172.21.15.59:0/2802676 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c00f040 con 0x7f3b74136f50 2023-09-30T22:34:44.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.679+0000 7f3b7b2b2700 1 -- 172.21.15.59:0/2802676 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b74136160 con 0x7f3b74136f50 2023-09-30T22:34:44.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.679+0000 7f3b69ffb700 1 -- 172.21.15.59:0/2802676 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c014480 con 0x7f3b74136f50 2023-09-30T22:34:44.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.680+0000 7f3b7b2b2700 1 -- 172.21.15.59:0/2802676 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7409c700 con 0x7f3b74136f50 2023-09-30T22:34:44.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.681+0000 7f3b69ffb700 1 -- 172.21.15.59:0/2802676 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b6c0145e0 con 0x7f3b74136f50 2023-09-30T22:34:44.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.681+0000 7f3b69ffb700 1 -- 172.21.15.59:0/2802676 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3b6c040030 con 0x7f3b74136f50 2023-09-30T22:34:44.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.681+0000 7f3b7b2b2700 1 -- 172.21.15.59:0/2802676 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b74074ea0 con 0x7f3b74136f50 2023-09-30T22:34:44.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.686+0000 7f3b69ffb700 1 -- 172.21.15.59:0/2802676 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b6c0118b0 con 0x7f3b74136f50 2023-09-30T22:34:44.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:44.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.713+0000 7f51bfe24700 1 Processor -- start 2023-09-30T22:34:44.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.713+0000 7f51bfe24700 1 -- start start 2023-09-30T22:34:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.714+0000 7f51bfe24700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51b809d6f0 0x7f51b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.714+0000 7f51bfe24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b809e000 0x7f51b8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.714+0000 7f51bfe24700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b809f130 con 0x7f51b809e410 2023-09-30T22:34:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.714+0000 7f51bfe24700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b809f520 con 0x7f51b809d6f0 2023-09-30T22:34:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.714+0000 7f51bfe24700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b809e930 con 0x7f51b809e000 2023-09-30T22:34:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.714+0000 7f51bdbc0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51b809d6f0 0x7f51b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.714+0000 7f51bd3bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b809e000 0x7f51b8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.714+0000 7f51bdbc0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51b809d6f0 0x7f51b809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38752/0 (socket says 172.21.15.59:38752) 2023-09-30T22:34:44.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.714+0000 7f51bd3bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b809e000 0x7f51b8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39282/0 (socket says 172.21.15.59:39282) 2023-09-30T22:34:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.714+0000 7f51bdbc0700 1 -- 172.21.15.59:0/528498155 learned_addr learned my addr 172.21.15.59:0/528498155 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.714+0000 7f51bdbc0700 1 -- 172.21.15.59:0/528498155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b809e000 msgr2=0x7f51b8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.714+0000 7f51bdbc0700 1 --2- 172.21.15.59:0/528498155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b809e000 0x7f51b8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.714+0000 7f51bdbc0700 1 -- 172.21.15.59:0/528498155 >> v1:172.21.15.59:6789/0 conn(0x7f51b809e410 legacy=0x7f51b8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.715+0000 7f51bdbc0700 1 -- 172.21.15.59:0/528498155 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b809b2d0 con 0x7f51b809d6f0 2023-09-30T22:34:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.715+0000 7f51bd3bf700 1 --2- 172.21.15.59:0/528498155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b809e000 0x7f51b8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.715+0000 7f51bdbc0700 1 --2- 172.21.15.59:0/528498155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b809d6f0 0x7f51b809dac0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f51b400bb90 tx=0x7f51b400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b08a6023d73a19b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.715+0000 7f51bcbbe700 1 -- 172.21.15.59:0/528498155 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b400dd30 con 0x7f51b809d6f0 2023-09-30T22:34:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.715+0000 7f51bcbbe700 1 -- 172.21.15.59:0/528498155 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b400de90 con 0x7f51b809d6f0 2023-09-30T22:34:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.715+0000 7f51bcbbe700 1 -- 172.21.15.59:0/528498155 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4010690 con 0x7f51b809d6f0 2023-09-30T22:34:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.716+0000 7f51bfe24700 1 -- 172.21.15.59:0/528498155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b809d6f0 msgr2=0x7f51b809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.716+0000 7f51bfe24700 1 --2- 172.21.15.59:0/528498155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b809d6f0 0x7f51b809dac0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f51b400bb90 tx=0x7f51b400bea0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.716+0000 7f51bfe24700 1 -- 172.21.15.59:0/528498155 shutdown_connections 2023-09-30T22:34:44.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.716+0000 7f51bfe24700 1 --2- 172.21.15.59:0/528498155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b809d6f0 0x7f51b809dac0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.716+0000 7f51bfe24700 1 --2- 172.21.15.59:0/528498155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b809e000 0x7f51b8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.716+0000 7f51bfe24700 1 -- 172.21.15.59:0/528498155 >> 172.21.15.59:0/528498155 conn(0x7f51b8066f50 msgr2=0x7f51b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:44.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.716+0000 7f51bfe24700 1 -- 172.21.15.59:0/528498155 shutdown_connections 2023-09-30T22:34:44.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.716+0000 7f51bfe24700 1 -- 172.21.15.59:0/528498155 wait complete. 2023-09-30T22:34:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.717+0000 7f51bfe24700 1 Processor -- start 2023-09-30T22:34:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.717+0000 7f51bfe24700 1 -- start start 2023-09-30T22:34:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.718+0000 7f51bfe24700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b809d6f0 0x7f51b811e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.718+0000 7f51bfe24700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b809e000 0x7f51b811e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.718+0000 7f51bfe24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b809e410 0x7f51b811eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.718+0000 7f51bfe24700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b81217f0 con 0x7f51b809d6f0 2023-09-30T22:34:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.718+0000 7f51bfe24700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80a1d00 con 0x7f51b809e410 2023-09-30T22:34:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.718+0000 7f51bfe24700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51b809c700 con 0x7f51b809e000 2023-09-30T22:34:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.718+0000 7f51bdbc0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b809d6f0 0x7f51b811e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.718+0000 7f51bdbc0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b809d6f0 0x7f51b811e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38766/0 (socket says 172.21.15.59:38766) 2023-09-30T22:34:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.718+0000 7f51bdbc0700 1 -- 172.21.15.59:0/2908070353 learned_addr learned my addr 172.21.15.59:0/2908070353 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.718+0000 7f51bd3bf700 1 --2- 172.21.15.59:0/2908070353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b809e000 0x7f51b811e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.718+0000 7f51be3c1700 1 --2- 172.21.15.59:0/2908070353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b809e410 0x7f51b811eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.718+0000 7f51bdbc0700 1 -- 172.21.15.59:0/2908070353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b809e000 msgr2=0x7f51b811e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.718+0000 7f51bdbc0700 1 --2- 172.21.15.59:0/2908070353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b809e000 0x7f51b811e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.719+0000 7f51bdbc0700 1 -- 172.21.15.59:0/2908070353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b809e410 msgr2=0x7f51b811eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.719+0000 7f51bdbc0700 1 --2- 172.21.15.59:0/2908070353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b809e410 0x7f51b811eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.719+0000 7f51bdbc0700 1 -- 172.21.15.59:0/2908070353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a80094a0 con 0x7f51b809d6f0 2023-09-30T22:34:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.719+0000 7f51bdbc0700 1 --2- 172.21.15.59:0/2908070353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b809d6f0 0x7f51b811e0d0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f51b4000c00 tx=0x7f51b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.719+0000 7f51ae7fc700 1 -- 172.21.15.59:0/2908070353 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4003b70 con 0x7f51b809d6f0 2023-09-30T22:34:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.719+0000 7f51ae7fc700 1 -- 172.21.15.59:0/2908070353 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b4003cf0 con 0x7f51b809d6f0 2023-09-30T22:34:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.719+0000 7f51bfe24700 1 -- 172.21.15.59:0/2908070353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b400b7f0 con 0x7f51b809d6f0 2023-09-30T22:34:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.719+0000 7f51ae7fc700 1 -- 172.21.15.59:0/2908070353 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40106b0 con 0x7f51b809d6f0 2023-09-30T22:34:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.719+0000 7f51bfe24700 1 -- 172.21.15.59:0/2908070353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b8121ad0 con 0x7f51b809d6f0 2023-09-30T22:34:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.720+0000 7f51ae7fc700 1 -- 172.21.15.59:0/2908070353 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51b4019400 con 0x7f51b809d6f0 2023-09-30T22:34:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.720+0000 7f51bfe24700 1 -- 172.21.15.59:0/2908070353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b8074ea0 con 0x7f51b809d6f0 2023-09-30T22:34:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.720+0000 7f51ae7fc700 1 -- 172.21.15.59:0/2908070353 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f51b4041300 con 0x7f51b809d6f0 2023-09-30T22:34:44.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.725+0000 7f51ae7fc700 1 -- 172.21.15.59:0/2908070353 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51b4021980 con 0x7f51b809d6f0 2023-09-30T22:34:44.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.734+0000 7f1b6b20c700 1 -- 172.21.15.59:0/2015732761 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1b641a8ce0 con 0x7f1b6409e930 2023-09-30T22:34:44.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.734+0000 7f1b617fa700 1 -- 172.21.15.59:0/2015732761 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b5800f8d0 con 0x7f1b6409e930 2023-09-30T22:34:44.734 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:44.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.736+0000 7f1b6b20c700 1 -- 172.21.15.59:0/2015732761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6409e930 msgr2=0x7f1b6406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.736+0000 7f1b6b20c700 1 --2- 172.21.15.59:0/2015732761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6409e930 0x7f1b6406b8b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800b560 tx=0x7f1b5800b870 comp rx=0 tx=0).stop 2023-09-30T22:34:44.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.736+0000 7f1b6b20c700 1 -- 172.21.15.59:0/2015732761 shutdown_connections 2023-09-30T22:34:44.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.737+0000 7f1b6b20c700 1 --2- 172.21.15.59:0/2015732761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6409f650 0x7f1b6406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.737+0000 7f1b6b20c700 1 --2- 172.21.15.59:0/2015732761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6409e930 0x7f1b6406b8b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.737+0000 7f1b6b20c700 1 --2- 172.21.15.59:0/2015732761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6409f240 0x7f1b6406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.737+0000 7f1b6b20c700 1 -- 172.21.15.59:0/2015732761 >> 172.21.15.59:0/2015732761 conn(0x7f1b640a4210 msgr2=0x7f1b641b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:44.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.737+0000 7f1b6b20c700 1 -- 172.21.15.59:0/2015732761 shutdown_connections 2023-09-30T22:34:44.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.737+0000 7f1b6b20c700 1 -- 172.21.15.59:0/2015732761 wait complete. 2023-09-30T22:34:44.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:44.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.895+0000 7f3b7b2b2700 1 -- 172.21.15.59:0/2802676 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3b7406b9e0 con 0x7f3b74136f50 2023-09-30T22:34:44.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.895+0000 7f3b69ffb700 1 -- 172.21.15.59:0/2802676 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b6c02b090 con 0x7f3b74136f50 2023-09-30T22:34:44.895 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.898+0000 7f3b7b2b2700 1 -- 172.21.15.59:0/2802676 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b74136f50 msgr2=0x7f3b74135480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.898+0000 7f3b7b2b2700 1 --2- 172.21.15.59:0/2802676 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b74136f50 0x7f3b74135480 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00ef90 tx=0x7f3b6c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.898+0000 7f3b7b2b2700 1 -- 172.21.15.59:0/2802676 shutdown_connections 2023-09-30T22:34:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.898+0000 7f3b7b2b2700 1 --2- 172.21.15.59:0/2802676 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b74136f50 0x7f3b74135480 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.898+0000 7f3b7b2b2700 1 --2- 172.21.15.59:0/2802676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b74131810 0x7f3b74134a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.898+0000 7f3b7b2b2700 1 --2- 172.21.15.59:0/2802676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b74134630 0x7f3b74134f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.898+0000 7f3b7b2b2700 1 -- 172.21.15.59:0/2802676 >> 172.21.15.59:0/2802676 conn(0x7f3b740a2aa0 msgr2=0x7f3b74133220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:44.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.898+0000 7f3b7b2b2700 1 -- 172.21.15.59:0/2802676 shutdown_connections 2023-09-30T22:34:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.898+0000 7f3b7b2b2700 1 -- 172.21.15.59:0/2802676 wait complete. 2023-09-30T22:34:44.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:44.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.930+0000 7f51bfe24700 1 -- 172.21.15.59:0/2908070353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f51b806c360 con 0x7f51b809d6f0 2023-09-30T22:34:44.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.930+0000 7f51ae7fc700 1 -- 172.21.15.59:0/2908070353 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51b4021390 con 0x7f51b809d6f0 2023-09-30T22:34:44.930 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:44.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.932+0000 7f51bfe24700 1 -- 172.21.15.59:0/2908070353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b809d6f0 msgr2=0x7f51b811e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:44.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.932+0000 7f51bfe24700 1 --2- 172.21.15.59:0/2908070353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b809d6f0 0x7f51b811e0d0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f51b4000c00 tx=0x7f51b4004750 comp rx=0 tx=0).stop 2023-09-30T22:34:44.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.933+0000 7f51bfe24700 1 -- 172.21.15.59:0/2908070353 shutdown_connections 2023-09-30T22:34:44.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.933+0000 7f51bfe24700 1 --2- 172.21.15.59:0/2908070353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51b809e410 0x7f51b811eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.933+0000 7f51bfe24700 1 --2- 172.21.15.59:0/2908070353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51b809d6f0 0x7f51b811e0d0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.933+0000 7f51bfe24700 1 --2- 172.21.15.59:0/2908070353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51b809e000 0x7f51b811e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:44.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.933+0000 7f51bfe24700 1 -- 172.21.15.59:0/2908070353 >> 172.21.15.59:0/2908070353 conn(0x7f51b8066f50 msgr2=0x7f51b80710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:44.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.933+0000 7f51bfe24700 1 -- 172.21.15.59:0/2908070353 shutdown_connections 2023-09-30T22:34:44.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:44.933+0000 7f51bfe24700 1 -- 172.21.15.59:0/2908070353 wait complete. 2023-09-30T22:34:44.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:45.694 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:45.752 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:45.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.841+0000 7f56a7dd1700 1 Processor -- start 2023-09-30T22:34:45.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.842+0000 7f56a7dd1700 1 -- start start 2023-09-30T22:34:45.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.842+0000 7f56a7dd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a00a1510 0x7f56a0138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:45.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.842+0000 7f56a7dd1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a0139250 0x7f56a013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:45.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.842+0000 7f56a7dd1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a009edd0 con 0x7f56a00a0a30 2023-09-30T22:34:45.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.842+0000 7f56a7dd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00a18e0 con 0x7f56a00a1510 2023-09-30T22:34:45.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.842+0000 7f56a7dd1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56a009e1f0 con 0x7f56a0139250 2023-09-30T22:34:45.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.842+0000 7f56a536c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a00a1510 0x7f56a0138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:45.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.842+0000 7f56a636e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a0139250 0x7f56a013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:45.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.842+0000 7f56a5b6d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f56a00a0a30 0x7f56a00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33136/0 (socket says 172.21.15.59:33136) 2023-09-30T22:34:45.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.842+0000 7f56a5b6d700 1 -- 172.21.15.59:0/4202623356 learned_addr learned my addr 172.21.15.59:0/4202623356 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:45.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.843+0000 7f56a636e700 1 -- 172.21.15.59:0/4202623356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a00a1510 msgr2=0x7f56a0138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:45.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.843+0000 7f56a636e700 1 --2- 172.21.15.59:0/4202623356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a00a1510 0x7f56a0138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:45.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.843+0000 7f56a4b6b700 1 -- 172.21.15.59:0/4202623356 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207212202 0 0) 0x7f56a009edd0 con 0x7f56a00a0a30 2023-09-30T22:34:45.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.843+0000 7f56a636e700 1 -- 172.21.15.59:0/4202623356 >> v1:172.21.15.59:6789/0 conn(0x7f56a00a0a30 legacy=0x7f56a00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:45.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.843+0000 7f56a636e700 1 -- 172.21.15.59:0/4202623356 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a009dc50 con 0x7f56a0139250 2023-09-30T22:34:45.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.843+0000 7f56a536c700 1 --2- 172.21.15.59:0/4202623356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a00a1510 0x7f56a0138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:45.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.843+0000 7f56a636e700 1 --2- 172.21.15.59:0/4202623356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a0139250 0x7f56a013b630 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5698009dc0 tx=0x7f569800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3fc6f5793f4ab31 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:45.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.843+0000 7f56a4b6b700 1 -- 172.21.15.59:0/4202623356 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569800e070 con 0x7f56a0139250 2023-09-30T22:34:45.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.843+0000 7f56a4b6b700 1 -- 172.21.15.59:0/4202623356 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569800bb20 con 0x7f56a0139250 2023-09-30T22:34:45.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.843+0000 7f56a4b6b700 1 -- 172.21.15.59:0/4202623356 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698012430 con 0x7f56a0139250 2023-09-30T22:34:45.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.844+0000 7f56a7dd1700 1 -- 172.21.15.59:0/4202623356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a0139250 msgr2=0x7f56a013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.844+0000 7f56a7dd1700 1 --2- 172.21.15.59:0/4202623356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a0139250 0x7f56a013b630 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5698009dc0 tx=0x7f569800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.844+0000 7f56a7dd1700 1 -- 172.21.15.59:0/4202623356 shutdown_connections 2023-09-30T22:34:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.844+0000 7f56a7dd1700 1 --2- 172.21.15.59:0/4202623356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a0139250 0x7f56a013b630 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.844+0000 7f56a7dd1700 1 --2- 172.21.15.59:0/4202623356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a00a1510 0x7f56a0138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.844+0000 7f56a7dd1700 1 -- 172.21.15.59:0/4202623356 >> 172.21.15.59:0/4202623356 conn(0x7f56a00a6550 msgr2=0x7f56a00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.844+0000 7f56a7dd1700 1 -- 172.21.15.59:0/4202623356 shutdown_connections 2023-09-30T22:34:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.844+0000 7f56a7dd1700 1 -- 172.21.15.59:0/4202623356 wait complete. 2023-09-30T22:34:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.845+0000 7f56a7dd1700 1 Processor -- start 2023-09-30T22:34:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.845+0000 7f56a7dd1700 1 -- start start 2023-09-30T22:34:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.845+0000 7f56a7dd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a00a0a30 0x7f56a0133680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.845+0000 7f56a7dd1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a00a1510 0x7f56a0133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.845+0000 7f56a7dd1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a0139250 0x7f56a011e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.845+0000 7f56a7dd1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a011fd50 con 0x7f56a00a1510 2023-09-30T22:34:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.845+0000 7f56a7dd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a009c4f0 con 0x7f56a00a0a30 2023-09-30T22:34:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.845+0000 7f56a7dd1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00a0220 con 0x7f56a0139250 2023-09-30T22:34:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f56a5b6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a00a0a30 0x7f56a0133680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f56a636e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a0139250 0x7f56a011e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f56a636e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a0139250 0x7f56a011e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54592/0 (socket says 172.21.15.59:54592) 2023-09-30T22:34:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f56a5b6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a00a0a30 0x7f56a0133680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39322/0 (socket says 172.21.15.59:39322) 2023-09-30T22:34:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f56a636e700 1 -- 172.21.15.59:0/1996964914 learned_addr learned my addr 172.21.15.59:0/1996964914 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f56a536c700 1 --2- 172.21.15.59:0/1996964914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a00a1510 0x7f56a0133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f56a636e700 1 -- 172.21.15.59:0/1996964914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a00a0a30 msgr2=0x7f56a0133680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f56a636e700 1 --2- 172.21.15.59:0/1996964914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a00a0a30 0x7f56a0133680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:45.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f56a636e700 1 -- 172.21.15.59:0/1996964914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a00a1510 msgr2=0x7f56a0133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:45.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f56a636e700 1 --2- 172.21.15.59:0/1996964914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a00a1510 0x7f56a0133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:45.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f56a636e700 1 -- 172.21.15.59:0/1996964914 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56940094a0 con 0x7f56a0139250 2023-09-30T22:34:45.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f56a636e700 1 --2- 172.21.15.59:0/1996964914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a0139250 0x7f56a011e890 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5698014040 tx=0x7f5698004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:45.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f569e7fc700 1 -- 172.21.15.59:0/1996964914 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698004880 con 0x7f56a0139250 2023-09-30T22:34:45.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f569e7fc700 1 -- 172.21.15.59:0/1996964914 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5698020070 con 0x7f56a0139250 2023-09-30T22:34:45.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f56a7dd1700 1 -- 172.21.15.59:0/1996964914 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5698009a70 con 0x7f56a0139250 2023-09-30T22:34:45.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f569e7fc700 1 -- 172.21.15.59:0/1996964914 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56980276c0 con 0x7f56a0139250 2023-09-30T22:34:45.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.846+0000 7f56a7dd1700 1 -- 172.21.15.59:0/1996964914 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a01220d0 con 0x7f56a0139250 2023-09-30T22:34:45.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.847+0000 7f569e7fc700 1 -- 172.21.15.59:0/1996964914 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5698012430 con 0x7f56a0139250 2023-09-30T22:34:45.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.847+0000 7f569e7fc700 1 -- 172.21.15.59:0/1996964914 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5698022070 con 0x7f56a0139250 2023-09-30T22:34:45.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.848+0000 7f56a7dd1700 1 -- 172.21.15.59:0/1996964914 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a0121f30 con 0x7f56a0139250 2023-09-30T22:34:45.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.853+0000 7f569e7fc700 1 -- 172.21.15.59:0/1996964914 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56a0121f30 con 0x7f56a0139250 2023-09-30T22:34:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.893+0000 7f91fedae700 1 Processor -- start 2023-09-30T22:34:45.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.893+0000 7f91fedae700 1 -- start start 2023-09-30T22:34:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.894+0000 7f91fedae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91f809e930 0x7f91f809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.894+0000 7f91fedae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f809f650 0x7f91f8131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.894+0000 7f91fedae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f8070940 con 0x7f91f809f240 2023-09-30T22:34:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.894+0000 7f91fedae700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f806fd60 con 0x7f91f809e930 2023-09-30T22:34:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.894+0000 7f91fedae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91f806fa80 con 0x7f91f809f650 2023-09-30T22:34:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.894+0000 7f91fd34b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f809f650 0x7f91f8131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.894+0000 7f91fcb4a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91f809e930 0x7f91f809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.894+0000 7f91fd34b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f809f650 0x7f91f8131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54608/0 (socket says 172.21.15.59:54608) 2023-09-30T22:34:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.894+0000 7f91fcb4a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91f809e930 0x7f91f809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38770/0 (socket says 172.21.15.59:38770) 2023-09-30T22:34:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.894+0000 7f91fd34b700 1 -- 172.21.15.59:0/2845331363 learned_addr learned my addr 172.21.15.59:0/2845331363 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.894+0000 7f91fd34b700 1 -- 172.21.15.59:0/2845331363 >> v2:172.21.15.59:3300/0 conn(0x7f91f809e930 msgr2=0x7f91f809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.894+0000 7f91fd34b700 1 --2- 172.21.15.59:0/2845331363 >> v2:172.21.15.59:3300/0 conn(0x7f91f809e930 0x7f91f809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.894+0000 7f91fd34b700 1 -- 172.21.15.59:0/2845331363 >> v1:172.21.15.59:6789/0 conn(0x7f91f809f240 legacy=0x7f91f81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.894+0000 7f91fd34b700 1 -- 172.21.15.59:0/2845331363 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f809fb60 con 0x7f91f809f650 2023-09-30T22:34:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.895+0000 7f91fd34b700 1 --2- 172.21.15.59:0/2845331363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f809f650 0x7f91f8131f00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f91e80098f0 tx=0x7f91e8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9a803732457e584 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.895+0000 7f91f77fe700 1 -- 172.21.15.59:0/2845331363 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e8011830 con 0x7f91f809f650 2023-09-30T22:34:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.895+0000 7f91f77fe700 1 -- 172.21.15.59:0/2845331363 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e8011990 con 0x7f91f809f650 2023-09-30T22:34:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.895+0000 7f91f77fe700 1 -- 172.21.15.59:0/2845331363 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e8011d20 con 0x7f91f809f650 2023-09-30T22:34:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.895+0000 7f91fedae700 1 -- 172.21.15.59:0/2845331363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f809f650 msgr2=0x7f91f8131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.895+0000 7f91fedae700 1 --2- 172.21.15.59:0/2845331363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f809f650 0x7f91f8131f00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f91e80098f0 tx=0x7f91e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.895+0000 7f91fedae700 1 -- 172.21.15.59:0/2845331363 shutdown_connections 2023-09-30T22:34:45.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.895+0000 7f91fedae700 1 --2- 172.21.15.59:0/2845331363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f809f650 0x7f91f8131f00 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:45.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.895+0000 7f91fedae700 1 --2- 172.21.15.59:0/2845331363 >> v2:172.21.15.59:3300/0 conn(0x7f91f809e930 0x7f91f809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:45.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.895+0000 7f91fedae700 1 -- 172.21.15.59:0/2845331363 >> 172.21.15.59:0/2845331363 conn(0x7f91f80a4210 msgr2=0x7f91f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:45.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.896+0000 7f91fedae700 1 -- 172.21.15.59:0/2845331363 shutdown_connections 2023-09-30T22:34:45.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.896+0000 7f91fedae700 1 -- 172.21.15.59:0/2845331363 wait complete. 2023-09-30T22:34:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.896+0000 7f91fedae700 1 Processor -- start 2023-09-30T22:34:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.897+0000 7f91fedae700 1 -- start start 2023-09-30T22:34:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.897+0000 7f91fedae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91f809e930 0x7f91f81a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.897+0000 7f91fedae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f809f240 0x7f91f81a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.897+0000 7f91fedae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f809f650 0x7f91f81a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.897+0000 7f91fedae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f81a51f0 con 0x7f91f809e930 2023-09-30T22:34:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.897+0000 7f91fedae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f81a58b0 con 0x7f91f809f240 2023-09-30T22:34:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.897+0000 7f91fedae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91f81a6b00 con 0x7f91f809f650 2023-09-30T22:34:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.897+0000 7f91fcb4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91f809e930 0x7f91f81a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.897+0000 7f91fd34b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f809f650 0x7f91f81a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.897+0000 7f91fcb4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91f809e930 0x7f91f81a3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38774/0 (socket says 172.21.15.59:38774) 2023-09-30T22:34:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.897+0000 7f91fcb4a700 1 -- 172.21.15.59:0/3822601211 learned_addr learned my addr 172.21.15.59:0/3822601211 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.897+0000 7f91f7fff700 1 --2- 172.21.15.59:0/3822601211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f809f240 0x7f91f81a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.898+0000 7f91fd34b700 1 -- 172.21.15.59:0/3822601211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f809f240 msgr2=0x7f91f81a4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.898+0000 7f91fd34b700 1 --2- 172.21.15.59:0/3822601211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f809f240 0x7f91f81a4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.898+0000 7f91fd34b700 1 -- 172.21.15.59:0/3822601211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91f809e930 msgr2=0x7f91f81a3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.898+0000 7f91fd34b700 1 --2- 172.21.15.59:0/3822601211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91f809e930 0x7f91f81a3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:45.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.898+0000 7f91fd34b700 1 -- 172.21.15.59:0/3822601211 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e8009550 con 0x7f91f809f650 2023-09-30T22:34:45.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.898+0000 7f91fcb4a700 1 --2- 172.21.15.59:0/3822601211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91f809e930 0x7f91f81a3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:45.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.898+0000 7f91fd34b700 1 --2- 172.21.15.59:0/3822601211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f809f650 0x7f91f81a47c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f91f8072a80 tx=0x7f91e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:45.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.898+0000 7f91f57fa700 1 -- 172.21.15.59:0/3822601211 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e8004380 con 0x7f91f809f650 2023-09-30T22:34:45.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.898+0000 7f91f57fa700 1 -- 172.21.15.59:0/3822601211 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e801f070 con 0x7f91f809f650 2023-09-30T22:34:45.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.898+0000 7f91fedae700 1 -- 172.21.15.59:0/3822601211 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f80a0190 con 0x7f91f809f650 2023-09-30T22:34:45.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.898+0000 7f91f57fa700 1 -- 172.21.15.59:0/3822601211 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e80036a0 con 0x7f91f809f650 2023-09-30T22:34:45.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.898+0000 7f91fedae700 1 -- 172.21.15.59:0/3822601211 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f81a6f50 con 0x7f91f809f650 2023-09-30T22:34:45.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.899+0000 7f91f57fa700 1 -- 172.21.15.59:0/3822601211 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91e8021030 con 0x7f91f809f650 2023-09-30T22:34:45.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.899+0000 7f91f57fa700 1 -- 172.21.15.59:0/3822601211 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f91e8040a10 con 0x7f91f809f650 2023-09-30T22:34:45.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.899+0000 7f91fedae700 1 -- 172.21.15.59:0/3822601211 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f81a0b30 con 0x7f91f809f650 2023-09-30T22:34:45.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:45.904+0000 7f91f57fa700 1 -- 172.21.15.59:0/3822601211 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91e8015080 con 0x7f91f809f650 2023-09-30T22:34:45.912 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:45.947 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:46.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.055+0000 7fa669274700 1 Processor -- start 2023-09-30T22:34:46.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.055+0000 7fa669274700 1 -- start start 2023-09-30T22:34:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.055+0000 7fa669274700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa66409eca0 0x7fa66413cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.055+0000 7fa669274700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66406f050 0x7fa66413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.055+0000 7fa669274700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa664070ee0 con 0x7fa66406e570 2023-09-30T22:34:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.055+0000 7fa669274700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa664071980 con 0x7fa66406f050 2023-09-30T22:34:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.055+0000 7fa669274700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa664071480 con 0x7fa66409eca0 2023-09-30T22:34:46.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.056+0000 7fa6637fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66406f050 0x7fa66413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:46.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.056+0000 7fa6627fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa66409eca0 0x7fa66413cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:46.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.056+0000 7fa662ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa66406e570 0x7fa66406e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33162/0 (socket says 172.21.15.59:33162) 2023-09-30T22:34:46.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.056+0000 7fa662ffd700 1 -- 172.21.15.59:0/271669859 learned_addr learned my addr 172.21.15.59:0/271669859 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:46.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.056+0000 7fa6627fc700 1 -- 172.21.15.59:0/271669859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66406f050 msgr2=0x7fa66413f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:46.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.056+0000 7fa6627fc700 1 --2- 172.21.15.59:0/271669859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66406f050 0x7fa66413f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.056+0000 7fa6627fc700 1 -- 172.21.15.59:0/271669859 >> v1:172.21.15.59:6789/0 conn(0x7fa66406e570 legacy=0x7fa66406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:46.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.056+0000 7fa661ffb700 1 -- 172.21.15.59:0/271669859 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210348647 0 0) 0x7fa664070ee0 con 0x7fa66406e570 2023-09-30T22:34:46.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.056+0000 7fa6627fc700 1 -- 172.21.15.59:0/271669859 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa664071b90 con 0x7fa66409eca0 2023-09-30T22:34:46.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.056+0000 7fa6637fe700 1 --2- 172.21.15.59:0/271669859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66406f050 0x7fa66413f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:46.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.057+0000 7fa6627fc700 1 --2- 172.21.15.59:0/271669859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa66409eca0 0x7fa66413cea0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa658009870 tx=0x7fa658009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ae35405d9b61b70 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:46.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.057+0000 7fa661ffb700 1 -- 172.21.15.59:0/271669859 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa658011830 con 0x7fa66409eca0 2023-09-30T22:34:46.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.057+0000 7fa661ffb700 1 -- 172.21.15.59:0/271669859 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa658011990 con 0x7fa66409eca0 2023-09-30T22:34:46.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.057+0000 7fa661ffb700 1 -- 172.21.15.59:0/271669859 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa658011d20 con 0x7fa66409eca0 2023-09-30T22:34:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.058+0000 7fa669274700 1 -- 172.21.15.59:0/271669859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa66409eca0 msgr2=0x7fa66413cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.058+0000 7fa669274700 1 --2- 172.21.15.59:0/271669859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa66409eca0 0x7fa66413cea0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa658009870 tx=0x7fa658009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.058+0000 7fa669274700 1 -- 172.21.15.59:0/271669859 shutdown_connections 2023-09-30T22:34:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.058+0000 7fa669274700 1 --2- 172.21.15.59:0/271669859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66406f050 0x7fa66413f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.058+0000 7fa669274700 1 --2- 172.21.15.59:0/271669859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa66409eca0 0x7fa66413cea0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.058+0000 7fa669274700 1 -- 172.21.15.59:0/271669859 >> 172.21.15.59:0/271669859 conn(0x7fa6640a2aa0 msgr2=0x7fa6640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.058+0000 7fa669274700 1 -- 172.21.15.59:0/271669859 shutdown_connections 2023-09-30T22:34:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.058+0000 7fa669274700 1 -- 172.21.15.59:0/271669859 wait complete. 2023-09-30T22:34:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.059+0000 7fa669274700 1 Processor -- start 2023-09-30T22:34:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.059+0000 7fa669274700 1 -- start start 2023-09-30T22:34:46.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.059+0000 7fa669274700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66406e570 0x7fa664137150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:46.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.059+0000 7fa669274700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66406f050 0x7fa664137690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:46.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.059+0000 7fa669274700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa664137bd0 0x7fa6641307f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:46.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.059+0000 7fa669274700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa664131890 con 0x7fa66406f050 2023-09-30T22:34:46.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.059+0000 7fa669274700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa664070680 con 0x7fa66406e570 2023-09-30T22:34:46.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.059+0000 7fa669274700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa66413e380 con 0x7fa664137bd0 2023-09-30T22:34:46.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.060+0000 7fa6627fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66406f050 0x7fa664137690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:46.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.060+0000 7fa6627fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66406f050 0x7fa664137690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38782/0 (socket says 172.21.15.59:38782) 2023-09-30T22:34:46.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.060+0000 7fa6627fc700 1 -- 172.21.15.59:0/3884459081 learned_addr learned my addr 172.21.15.59:0/3884459081 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:46.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.060+0000 7fa662ffd700 1 --2- 172.21.15.59:0/3884459081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66406e570 0x7fa664137150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:46.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.060+0000 7fa6637fe700 1 --2- 172.21.15.59:0/3884459081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa664137bd0 0x7fa6641307f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:46.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.060+0000 7fa6627fc700 1 -- 172.21.15.59:0/3884459081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa664137bd0 msgr2=0x7fa6641307f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:46.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.060+0000 7fa6627fc700 1 --2- 172.21.15.59:0/3884459081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa664137bd0 0x7fa6641307f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.060+0000 7fa6627fc700 1 -- 172.21.15.59:0/3884459081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66406e570 msgr2=0x7fa664137150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:46.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.060+0000 7fa6627fc700 1 --2- 172.21.15.59:0/3884459081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66406e570 0x7fa664137150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.060+0000 7fa6627fc700 1 -- 172.21.15.59:0/3884459081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c009a70 con 0x7fa66406f050 2023-09-30T22:34:46.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.060+0000 7fa662ffd700 1 --2- 172.21.15.59:0/3884459081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66406e570 0x7fa664137150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:46.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.060+0000 7fa6627fc700 1 --2- 172.21.15.59:0/3884459081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66406f050 0x7fa664137690 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fa6580090b0 tx=0x7fa658004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:46.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.061+0000 7fa64b7fe700 1 -- 172.21.15.59:0/3884459081 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6580036a0 con 0x7fa66406f050 2023-09-30T22:34:46.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.061+0000 7fa64b7fe700 1 -- 172.21.15.59:0/3884459081 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa658003800 con 0x7fa66406f050 2023-09-30T22:34:46.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.061+0000 7fa64b7fe700 1 -- 172.21.15.59:0/3884459081 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa658003b90 con 0x7fa66406f050 2023-09-30T22:34:46.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.061+0000 7fa669274700 1 -- 172.21.15.59:0/3884459081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6580094a0 con 0x7fa66406f050 2023-09-30T22:34:46.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.061+0000 7fa669274700 1 -- 172.21.15.59:0/3884459081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66411a7e0 con 0x7fa66406f050 2023-09-30T22:34:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.062+0000 7fa64b7fe700 1 -- 172.21.15.59:0/3884459081 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa658003cf0 con 0x7fa66406f050 2023-09-30T22:34:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.062+0000 7fa64b7fe700 1 -- 172.21.15.59:0/3884459081 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa658040ac0 con 0x7fa66406f050 2023-09-30T22:34:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.062+0000 7fa669274700 1 -- 172.21.15.59:0/3884459081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa664074ea0 con 0x7fa66406f050 2023-09-30T22:34:46.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.068+0000 7fa64b7fe700 1 -- 172.21.15.59:0/3884459081 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa658015080 con 0x7fa66406f050 2023-09-30T22:34:46.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.071+0000 7f56a7dd1700 1 -- 172.21.15.59:0/1996964914 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f56a0121f30 con 0x7f56a0139250 2023-09-30T22:34:46.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.072+0000 7f569e7fc700 1 -- 172.21.15.59:0/1996964914 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56a0121f30 con 0x7f56a0139250 2023-09-30T22:34:46.072 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.075+0000 7f56a7dd1700 1 -- 172.21.15.59:0/1996964914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a0139250 msgr2=0x7f56a011e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.075+0000 7f56a7dd1700 1 --2- 172.21.15.59:0/1996964914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a0139250 0x7f56a011e890 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5698014040 tx=0x7f5698004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.075+0000 7f56a7dd1700 1 -- 172.21.15.59:0/1996964914 shutdown_connections 2023-09-30T22:34:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.075+0000 7f56a7dd1700 1 --2- 172.21.15.59:0/1996964914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a0139250 0x7f56a011e890 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.075+0000 7f56a7dd1700 1 --2- 172.21.15.59:0/1996964914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a00a0a30 0x7f56a0133680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.075+0000 7f56a7dd1700 1 --2- 172.21.15.59:0/1996964914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a00a1510 0x7f56a0133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.075+0000 7f56a7dd1700 1 -- 172.21.15.59:0/1996964914 >> 172.21.15.59:0/1996964914 conn(0x7f56a00a6550 msgr2=0x7f56a00a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.075+0000 7f56a7dd1700 1 -- 172.21.15.59:0/1996964914 shutdown_connections 2023-09-30T22:34:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.075+0000 7f56a7dd1700 1 -- 172.21.15.59:0/1996964914 wait complete. 2023-09-30T22:34:46.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:46.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.099+0000 7f2196ed7700 1 Processor -- start 2023-09-30T22:34:46.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.099+0000 7f2196ed7700 1 -- start start 2023-09-30T22:34:46.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.099+0000 7f2196ed7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f219009e1d0 0x7f2190135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:46.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.099+0000 7f2196ed7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2190135e50 0x7f2190138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:46.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.099+0000 7f2196ed7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219009f130 con 0x7f219009d6f0 2023-09-30T22:34:46.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.099+0000 7f2196ed7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f219009f520 con 0x7f2190135e50 2023-09-30T22:34:46.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.099+0000 7f2196ed7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219009e930 con 0x7f219009e1d0 2023-09-30T22:34:46.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.099+0000 7f218ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f219009e1d0 0x7f2190135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:46.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.099+0000 7f2195474700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2190135e50 0x7f2190138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:46.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.099+0000 7f218ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f219009e1d0 0x7f2190135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39356/0 (socket says 172.21.15.59:39356) 2023-09-30T22:34:46.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.099+0000 7f218ffff700 1 -- 172.21.15.59:0/593953653 learned_addr learned my addr 172.21.15.59:0/593953653 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:46.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.100+0000 7f218ffff700 1 -- 172.21.15.59:0/593953653 >> v2:172.21.15.59:3300/0 conn(0x7f2190135e50 msgr2=0x7f2190138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:46.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.100+0000 7f218ffff700 1 --2- 172.21.15.59:0/593953653 >> v2:172.21.15.59:3300/0 conn(0x7f2190135e50 0x7f2190138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.100+0000 7f218ffff700 1 -- 172.21.15.59:0/593953653 >> v1:172.21.15.59:6789/0 conn(0x7f219009d6f0 legacy=0x7f219009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:46.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.100+0000 7f218ffff700 1 -- 172.21.15.59:0/593953653 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219009b2d0 con 0x7f219009e1d0 2023-09-30T22:34:46.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.100+0000 7f2195474700 1 --2- 172.21.15.59:0/593953653 >> v2:172.21.15.59:3300/0 conn(0x7f2190135e50 0x7f2190138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:46.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.100+0000 7f218ffff700 1 --2- 172.21.15.59:0/593953653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f219009e1d0 0x7f2190135910 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f217c009920 tx=0x7f217c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f190b2b3df498df4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:46.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.100+0000 7f218f7fe700 1 -- 172.21.15.59:0/593953653 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c011830 con 0x7f219009e1d0 2023-09-30T22:34:46.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.100+0000 7f218f7fe700 1 -- 172.21.15.59:0/593953653 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c011990 con 0x7f219009e1d0 2023-09-30T22:34:46.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.100+0000 7f218f7fe700 1 -- 172.21.15.59:0/593953653 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c011d20 con 0x7f219009e1d0 2023-09-30T22:34:46.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.101+0000 7f2196ed7700 1 -- 172.21.15.59:0/593953653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f219009e1d0 msgr2=0x7f2190135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:46.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.101+0000 7f2196ed7700 1 --2- 172.21.15.59:0/593953653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f219009e1d0 0x7f2190135910 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f217c009920 tx=0x7f217c009c30 comp rx=0 tx=0).stop 2023-09-30T22:34:46.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.101+0000 7f2196ed7700 1 -- 172.21.15.59:0/593953653 shutdown_connections 2023-09-30T22:34:46.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.101+0000 7f2196ed7700 1 --2- 172.21.15.59:0/593953653 >> v2:172.21.15.59:3300/0 conn(0x7f2190135e50 0x7f2190138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.101+0000 7f2196ed7700 1 --2- 172.21.15.59:0/593953653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f219009e1d0 0x7f2190135910 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.101+0000 7f2196ed7700 1 -- 172.21.15.59:0/593953653 >> 172.21.15.59:0/593953653 conn(0x7f2190066f50 msgr2=0x7f219009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:46.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.101+0000 7f2196ed7700 1 -- 172.21.15.59:0/593953653 shutdown_connections 2023-09-30T22:34:46.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.101+0000 7f2196ed7700 1 -- 172.21.15.59:0/593953653 wait complete. 2023-09-30T22:34:46.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.102+0000 7f2196ed7700 1 Processor -- start 2023-09-30T22:34:46.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.102+0000 7f2196ed7700 1 -- start start 2023-09-30T22:34:46.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.103+0000 7f2196ed7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f219009d6f0 0x7f219006efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:46.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.103+0000 7f2196ed7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f219009e1d0 0x7f219006f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:46.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.103+0000 7f2196ed7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2190135e50 0x7f21901c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:46.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.103+0000 7f2196ed7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190124bb0 con 0x7f219009e1d0 2023-09-30T22:34:46.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.103+0000 7f2196ed7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219006ed30 con 0x7f2190135e50 2023-09-30T22:34:46.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.103+0000 7f2196ed7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21900a1f10 con 0x7f219009d6f0 2023-09-30T22:34:46.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.103+0000 7f218ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f219009e1d0 0x7f219006f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:46.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.104+0000 7f218ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f219009e1d0 0x7f219006f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38806/0 (socket says 172.21.15.59:38806) 2023-09-30T22:34:46.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.104+0000 7f218ffff700 1 -- 172.21.15.59:0/3266564812 learned_addr learned my addr 172.21.15.59:0/3266564812 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:46.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.104+0000 7f2195474700 1 --2- 172.21.15.59:0/3266564812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2190135e50 0x7f21901c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:46.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.104+0000 7f2194c73700 1 --2- 172.21.15.59:0/3266564812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f219009d6f0 0x7f219006efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.104+0000 7f218ffff700 1 -- 172.21.15.59:0/3266564812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f219009d6f0 msgr2=0x7f219006efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.104+0000 7f218ffff700 1 --2- 172.21.15.59:0/3266564812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f219009d6f0 0x7f219006efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.104+0000 7f218ffff700 1 -- 172.21.15.59:0/3266564812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2190135e50 msgr2=0x7f21901c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.104+0000 7f218ffff700 1 --2- 172.21.15.59:0/3266564812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2190135e50 0x7f21901c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.104+0000 7f218ffff700 1 -- 172.21.15.59:0/3266564812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2188009a70 con 0x7f219009e1d0 2023-09-30T22:34:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.104+0000 7f218ffff700 1 --2- 172.21.15.59:0/3266564812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f219009e1d0 0x7f219006f510 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f217c0098f0 tx=0x7f217c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.104+0000 7f218d7fa700 1 -- 172.21.15.59:0/3266564812 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c004300 con 0x7f219009e1d0 2023-09-30T22:34:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.104+0000 7f218d7fa700 1 -- 172.21.15.59:0/3266564812 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c01f070 con 0x7f219009e1d0 2023-09-30T22:34:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.104+0000 7f218d7fa700 1 -- 172.21.15.59:0/3266564812 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c0036a0 con 0x7f219009e1d0 2023-09-30T22:34:46.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.104+0000 7f2196ed7700 1 -- 172.21.15.59:0/3266564812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217c009550 con 0x7f219009e1d0 2023-09-30T22:34:46.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.104+0000 7f2196ed7700 1 -- 172.21.15.59:0/3266564812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219009c750 con 0x7f219009e1d0 2023-09-30T22:34:46.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.105+0000 7f218d7fa700 1 -- 172.21.15.59:0/3266564812 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f217c021030 con 0x7f219009e1d0 2023-09-30T22:34:46.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.105+0000 7f2196ed7700 1 -- 172.21.15.59:0/3266564812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2190074ea0 con 0x7f219009e1d0 2023-09-30T22:34:46.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.106+0000 7f218d7fa700 1 -- 172.21.15.59:0/3266564812 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f217c040840 con 0x7f219009e1d0 2023-09-30T22:34:46.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.110+0000 7f218d7fa700 1 -- 172.21.15.59:0/3266564812 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f217c0239c0 con 0x7f219009e1d0 2023-09-30T22:34:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.126+0000 7f91fedae700 1 -- 172.21.15.59:0/3822601211 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f91f80a34f0 con 0x7f91f809f650 2023-09-30T22:34:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.126+0000 7f91f57fa700 1 -- 172.21.15.59:0/3822601211 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91e8019770 con 0x7f91f809f650 2023-09-30T22:34:46.126 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.130+0000 7f91fedae700 1 -- 172.21.15.59:0/3822601211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f809f650 msgr2=0x7f91f81a47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.130+0000 7f91fedae700 1 --2- 172.21.15.59:0/3822601211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f809f650 0x7f91f81a47c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f91f8072a80 tx=0x7f91e8004750 comp rx=0 tx=0).stop 2023-09-30T22:34:46.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.131+0000 7f91fedae700 1 -- 172.21.15.59:0/3822601211 shutdown_connections 2023-09-30T22:34:46.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.131+0000 7f91fedae700 1 --2- 172.21.15.59:0/3822601211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91f809f650 0x7f91f81a47c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.131+0000 7f91fedae700 1 --2- 172.21.15.59:0/3822601211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91f809e930 0x7f91f81a3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.131+0000 7f91fedae700 1 --2- 172.21.15.59:0/3822601211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f809f240 0x7f91f81a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.131+0000 7f91fedae700 1 -- 172.21.15.59:0/3822601211 >> 172.21.15.59:0/3822601211 conn(0x7f91f80a4210 msgr2=0x7f91f81b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:46.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.131+0000 7f91fedae700 1 -- 172.21.15.59:0/3822601211 shutdown_connections 2023-09-30T22:34:46.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.131+0000 7f91fedae700 1 -- 172.21.15.59:0/3822601211 wait complete. 2023-09-30T22:34:46.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:46.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.287+0000 7fa669274700 1 -- 172.21.15.59:0/3884459081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa66409e9a0 con 0x7fa66406f050 2023-09-30T22:34:46.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.288+0000 7fa64b7fe700 1 -- 172.21.15.59:0/3884459081 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa658010d50 con 0x7fa66406f050 2023-09-30T22:34:46.288 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:46.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.290+0000 7fa669274700 1 -- 172.21.15.59:0/3884459081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66406f050 msgr2=0x7fa664137690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:46.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.290+0000 7fa669274700 1 --2- 172.21.15.59:0/3884459081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66406f050 0x7fa664137690 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fa6580090b0 tx=0x7fa658004750 comp rx=0 tx=0).stop 2023-09-30T22:34:46.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.290+0000 7fa669274700 1 -- 172.21.15.59:0/3884459081 shutdown_connections 2023-09-30T22:34:46.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.290+0000 7fa669274700 1 --2- 172.21.15.59:0/3884459081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa664137bd0 0x7fa6641307f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.290+0000 7fa669274700 1 --2- 172.21.15.59:0/3884459081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66406e570 0x7fa664137150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.290+0000 7fa669274700 1 --2- 172.21.15.59:0/3884459081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66406f050 0x7fa664137690 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.290+0000 7fa669274700 1 -- 172.21.15.59:0/3884459081 >> 172.21.15.59:0/3884459081 conn(0x7fa6640a2aa0 msgr2=0x7fa66409c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:46.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.290+0000 7fa669274700 1 -- 172.21.15.59:0/3884459081 shutdown_connections 2023-09-30T22:34:46.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.290+0000 7fa669274700 1 -- 172.21.15.59:0/3884459081 wait complete. 2023-09-30T22:34:46.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:46.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.317+0000 7f2196ed7700 1 -- 172.21.15.59:0/3266564812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2190125940 con 0x7f219009e1d0 2023-09-30T22:34:46.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.317+0000 7f218d7fa700 1 -- 172.21.15.59:0/3266564812 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f217c015030 con 0x7f219009e1d0 2023-09-30T22:34:46.317 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:46.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.320+0000 7f2196ed7700 1 -- 172.21.15.59:0/3266564812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f219009e1d0 msgr2=0x7f219006f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:46.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.320+0000 7f2196ed7700 1 --2- 172.21.15.59:0/3266564812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f219009e1d0 0x7f219006f510 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f217c0098f0 tx=0x7f217c004750 comp rx=0 tx=0).stop 2023-09-30T22:34:46.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.320+0000 7f2196ed7700 1 -- 172.21.15.59:0/3266564812 shutdown_connections 2023-09-30T22:34:46.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.320+0000 7f2196ed7700 1 --2- 172.21.15.59:0/3266564812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f219009d6f0 0x7f219006efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.320+0000 7f2196ed7700 1 --2- 172.21.15.59:0/3266564812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2190135e50 0x7f21901c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.320+0000 7f2196ed7700 1 --2- 172.21.15.59:0/3266564812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f219009e1d0 0x7f219006f510 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:46.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.320+0000 7f2196ed7700 1 -- 172.21.15.59:0/3266564812 >> 172.21.15.59:0/3266564812 conn(0x7f2190066f50 msgr2=0x7f2190134840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:46.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.320+0000 7f2196ed7700 1 -- 172.21.15.59:0/3266564812 shutdown_connections 2023-09-30T22:34:46.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:46.320+0000 7f2196ed7700 1 -- 172.21.15.59:0/3266564812 wait complete. 2023-09-30T22:34:46.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:47.096 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:47.151 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:47.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.244+0000 7f70c4b6c700 1 Processor -- start 2023-09-30T22:34:47.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.244+0000 7f70c4b6c700 1 -- start start 2023-09-30T22:34:47.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70c4b6c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70c00a0a30 0x7f70c00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70c4b6c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c00a1340 0x7f70c0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70c4b6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c0133fa0 0x7f70c0134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70c4b6c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c009edd0 con 0x7f70c00a0a30 2023-09-30T22:34:47.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70c4b6c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c009e1f0 con 0x7f70c0133fa0 2023-09-30T22:34:47.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70c4b6c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70c009dc50 con 0x7f70c00a1340 2023-09-30T22:34:47.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70be59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70c00a0a30 0x7f70c00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70bdd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c00a1340 0x7f70c0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70bed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c0133fa0 0x7f70c0134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70be59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70c00a0a30 0x7f70c00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38820/0 (socket says 172.21.15.59:38820) 2023-09-30T22:34:47.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70bdd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c00a1340 0x7f70c0133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54656/0 (socket says 172.21.15.59:54656) 2023-09-30T22:34:47.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70bed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c0133fa0 0x7f70c0134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39372/0 (socket says 172.21.15.59:39372) 2023-09-30T22:34:47.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70be59c700 1 -- 172.21.15.59:0/1350474575 learned_addr learned my addr 172.21.15.59:0/1350474575 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:47.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70bed9d700 1 -- 172.21.15.59:0/1350474575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c00a1340 msgr2=0x7f70c0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:47.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70bed9d700 1 --2- 172.21.15.59:0/1350474575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c00a1340 0x7f70c0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70bed9d700 1 -- 172.21.15.59:0/1350474575 >> v2:172.21.15.59:3300/0 conn(0x7f70c00a0a30 msgr2=0x7f70c00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:47.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70bed9d700 1 --2- 172.21.15.59:0/1350474575 >> v2:172.21.15.59:3300/0 conn(0x7f70c00a0a30 0x7f70c00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70bed9d700 1 -- 172.21.15.59:0/1350474575 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c00a1fe0 con 0x7f70c0133fa0 2023-09-30T22:34:47.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70bdd9b700 1 --2- 172.21.15.59:0/1350474575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c00a1340 0x7f70c0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:47.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.245+0000 7f70bed9d700 1 --2- 172.21.15.59:0/1350474575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c0133fa0 0x7f70c0134410 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009870 tx=0x7f70b8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83563b32973a465c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:47.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.246+0000 7f70bd59a700 1 -- 172.21.15.59:0/1350474575 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b8011830 con 0x7f70c0133fa0 2023-09-30T22:34:47.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.246+0000 7f70bd59a700 1 -- 172.21.15.59:0/1350474575 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b8011990 con 0x7f70c0133fa0 2023-09-30T22:34:47.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.246+0000 7f70bd59a700 1 -- 172.21.15.59:0/1350474575 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b8011d20 con 0x7f70c0133fa0 2023-09-30T22:34:47.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.246+0000 7f70c4b6c700 1 -- 172.21.15.59:0/1350474575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c0133fa0 msgr2=0x7f70c0134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.246+0000 7f70c4b6c700 1 --2- 172.21.15.59:0/1350474575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c0133fa0 0x7f70c0134410 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009870 tx=0x7f70b8009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:47.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.246+0000 7f70c4b6c700 1 -- 172.21.15.59:0/1350474575 shutdown_connections 2023-09-30T22:34:47.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.246+0000 7f70c4b6c700 1 --2- 172.21.15.59:0/1350474575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c0133fa0 0x7f70c0134410 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.246+0000 7f70c4b6c700 1 --2- 172.21.15.59:0/1350474575 >> v2:172.21.15.59:3300/0 conn(0x7f70c00a0a30 0x7f70c00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.246+0000 7f70c4b6c700 1 --2- 172.21.15.59:0/1350474575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c00a1340 0x7f70c0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.246+0000 7f70c4b6c700 1 -- 172.21.15.59:0/1350474575 >> 172.21.15.59:0/1350474575 conn(0x7f70c00a6550 msgr2=0x7f70c00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:47.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.246+0000 7f70c4b6c700 1 -- 172.21.15.59:0/1350474575 shutdown_connections 2023-09-30T22:34:47.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.246+0000 7f70c4b6c700 1 -- 172.21.15.59:0/1350474575 wait complete. 2023-09-30T22:34:47.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.248+0000 7f70c4b6c700 1 Processor -- start 2023-09-30T22:34:47.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.248+0000 7f70c4b6c700 1 -- start start 2023-09-30T22:34:47.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.248+0000 7f70c4b6c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c00a0a30 0x7f70c0120120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.248+0000 7f70c4b6c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c00a1340 0x7f70c0120660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.248+0000 7f70c4b6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c0133fa0 0x7f70c0120ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.248+0000 7f70c4b6c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c01245b0 con 0x7f70c00a1340 2023-09-30T22:34:47.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.248+0000 7f70c4b6c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c0123910 con 0x7f70c0133fa0 2023-09-30T22:34:47.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.248+0000 7f70c4b6c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70c00a0220 con 0x7f70c00a0a30 2023-09-30T22:34:47.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.248+0000 7f70bdd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c00a1340 0x7f70c0120660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.248+0000 7f70bdd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c00a1340 0x7f70c0120660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38836/0 (socket says 172.21.15.59:38836) 2023-09-30T22:34:47.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.248+0000 7f70be59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c00a0a30 0x7f70c0120120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.248+0000 7f70bdd9b700 1 -- 172.21.15.59:0/2249310934 learned_addr learned my addr 172.21.15.59:0/2249310934 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:47.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.248+0000 7f70bed9d700 1 --2- 172.21.15.59:0/2249310934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c0133fa0 0x7f70c0120ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.249+0000 7f70bdd9b700 1 -- 172.21.15.59:0/2249310934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c00a0a30 msgr2=0x7f70c0120120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.249+0000 7f70bdd9b700 1 --2- 172.21.15.59:0/2249310934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c00a0a30 0x7f70c0120120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.249+0000 7f70bdd9b700 1 -- 172.21.15.59:0/2249310934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c0133fa0 msgr2=0x7f70c0120ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.249+0000 7f70bdd9b700 1 --2- 172.21.15.59:0/2249310934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c0133fa0 0x7f70c0120ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.249+0000 7f70bdd9b700 1 -- 172.21.15.59:0/2249310934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a80094a0 con 0x7f70c00a1340 2023-09-30T22:34:47.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.249+0000 7f70be59c700 1 --2- 172.21.15.59:0/2249310934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c00a0a30 0x7f70c0120120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:47.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.249+0000 7f70bdd9b700 1 --2- 172.21.15.59:0/2249310934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c00a1340 0x7f70c0120660 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f70a800ec10 tx=0x7f70a800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:47.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.249+0000 7f70b6ffd700 1 -- 172.21.15.59:0/2249310934 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8009760 con 0x7f70c00a1340 2023-09-30T22:34:47.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.249+0000 7f70b6ffd700 1 -- 172.21.15.59:0/2249310934 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a800c850 con 0x7f70c00a1340 2023-09-30T22:34:47.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.249+0000 7f70c4b6c700 1 -- 172.21.15.59:0/2249310934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b80094a0 con 0x7f70c00a1340 2023-09-30T22:34:47.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.249+0000 7f70b6ffd700 1 -- 172.21.15.59:0/2249310934 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a800cbe0 con 0x7f70c00a1340 2023-09-30T22:34:47.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.249+0000 7f70c4b6c700 1 -- 172.21.15.59:0/2249310934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c0122f30 con 0x7f70c00a1340 2023-09-30T22:34:47.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.250+0000 7f70b6ffd700 1 -- 172.21.15.59:0/2249310934 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70a800cd40 con 0x7f70c00a1340 2023-09-30T22:34:47.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.250+0000 7f70c4b6c700 1 -- 172.21.15.59:0/2249310934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c0074ea0 con 0x7f70c00a1340 2023-09-30T22:34:47.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.250+0000 7f70b6ffd700 1 -- 172.21.15.59:0/2249310934 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f70a803fab0 con 0x7f70c00a1340 2023-09-30T22:34:47.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.255+0000 7f70b6ffd700 1 -- 172.21.15.59:0/2249310934 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70a801b3b0 con 0x7f70c00a1340 2023-09-30T22:34:47.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.293+0000 7f59a89ff700 1 Processor -- start 2023-09-30T22:34:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.293+0000 7f59a89ff700 1 -- start start 2023-09-30T22:34:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.293+0000 7f59a89ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59a40a12e0 0x7f59a4138bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.293+0000 7f59a89ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59a4139110 0x7f59a413b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.293+0000 7f59a89ff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a409e770 con 0x7f59a40a0800 2023-09-30T22:34:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.293+0000 7f59a89ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a40a1aa0 con 0x7f59a4139110 2023-09-30T22:34:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.293+0000 7f59a89ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59a409cc80 con 0x7f59a40a12e0 2023-09-30T22:34:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.293+0000 7f59a259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59a40a12e0 0x7f59a4138bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.294+0000 7f59a2d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f59a40a0800 0x7f59a40a0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33184/0 (socket says 172.21.15.59:33184) 2023-09-30T22:34:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.294+0000 7f59a2d9d700 1 -- 172.21.15.59:0/4053568455 learned_addr learned my addr 172.21.15.59:0/4053568455 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.294+0000 7f59a359e700 1 --2- 172.21.15.59:0/4053568455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59a4139110 0x7f59a413b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.294+0000 7f59a259c700 1 -- 172.21.15.59:0/4053568455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59a4139110 msgr2=0x7f59a413b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.294+0000 7f59a1d9b700 1 -- 172.21.15.59:0/4053568455 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319699563 0 0) 0x7f59a409e770 con 0x7f59a40a0800 2023-09-30T22:34:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.294+0000 7f59a259c700 1 --2- 172.21.15.59:0/4053568455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59a4139110 0x7f59a413b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.294+0000 7f59a259c700 1 -- 172.21.15.59:0/4053568455 >> v1:172.21.15.59:6789/0 conn(0x7f59a40a0800 legacy=0x7f59a40a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.294+0000 7f59a259c700 1 -- 172.21.15.59:0/4053568455 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a40a1c70 con 0x7f59a40a12e0 2023-09-30T22:34:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.294+0000 7f59a359e700 1 --2- 172.21.15.59:0/4053568455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59a4139110 0x7f59a413b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.294+0000 7f59a259c700 1 --2- 172.21.15.59:0/4053568455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59a40a12e0 0x7f59a4138bd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f59980098a0 tx=0x7f5998009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae5ee960f8ded917 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.294+0000 7f59a1d9b700 1 -- 172.21.15.59:0/4053568455 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998011830 con 0x7f59a40a12e0 2023-09-30T22:34:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.294+0000 7f59a1d9b700 1 -- 172.21.15.59:0/4053568455 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5998011990 con 0x7f59a40a12e0 2023-09-30T22:34:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.294+0000 7f59a1d9b700 1 -- 172.21.15.59:0/4053568455 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998011d20 con 0x7f59a40a12e0 2023-09-30T22:34:47.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.295+0000 7f59a89ff700 1 -- 172.21.15.59:0/4053568455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59a40a12e0 msgr2=0x7f59a4138bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.295+0000 7f59a89ff700 1 --2- 172.21.15.59:0/4053568455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59a40a12e0 0x7f59a4138bd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f59980098a0 tx=0x7f5998009bb0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.295+0000 7f59a89ff700 1 -- 172.21.15.59:0/4053568455 shutdown_connections 2023-09-30T22:34:47.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.295+0000 7f59a89ff700 1 --2- 172.21.15.59:0/4053568455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59a4139110 0x7f59a413b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.295+0000 7f59a89ff700 1 --2- 172.21.15.59:0/4053568455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59a40a12e0 0x7f59a4138bd0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.295+0000 7f59a89ff700 1 -- 172.21.15.59:0/4053568455 >> 172.21.15.59:0/4053568455 conn(0x7f59a40a6140 msgr2=0x7f59a40a6540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.295+0000 7f59a89ff700 1 -- 172.21.15.59:0/4053568455 shutdown_connections 2023-09-30T22:34:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.295+0000 7f59a89ff700 1 -- 172.21.15.59:0/4053568455 wait complete. 2023-09-30T22:34:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.296+0000 7f59a89ff700 1 Processor -- start 2023-09-30T22:34:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.296+0000 7f59a89ff700 1 -- start start 2023-09-30T22:34:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a89ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59a40a0800 0x7f59a4122500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a89ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59a40a12e0 0x7f59a4122a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a89ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59a4139110 0x7f59a4122f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a89ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a4125a80 con 0x7f59a4139110 2023-09-30T22:34:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a89ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a4124970 con 0x7f59a40a0800 2023-09-30T22:34:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a89ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59a4126020 con 0x7f59a40a12e0 2023-09-30T22:34:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59a40a0800 0x7f59a4122500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59a4139110 0x7f59a4122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59a40a0800 0x7f59a4122500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39392/0 (socket says 172.21.15.59:39392) 2023-09-30T22:34:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a2d9d700 1 -- 172.21.15.59:0/2460625892 learned_addr learned my addr 172.21.15.59:0/2460625892 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a259c700 1 --2- 172.21.15.59:0/2460625892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59a40a12e0 0x7f59a4122a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a359e700 1 -- 172.21.15.59:0/2460625892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59a40a12e0 msgr2=0x7f59a4122a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a359e700 1 --2- 172.21.15.59:0/2460625892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59a40a12e0 0x7f59a4122a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a359e700 1 -- 172.21.15.59:0/2460625892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59a40a0800 msgr2=0x7f59a4122500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a359e700 1 --2- 172.21.15.59:0/2460625892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59a40a0800 0x7f59a4122500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a359e700 1 -- 172.21.15.59:0/2460625892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c009a70 con 0x7f59a4139110 2023-09-30T22:34:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.297+0000 7f59a2d9d700 1 --2- 172.21.15.59:0/2460625892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59a40a0800 0x7f59a4122500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.298+0000 7f59a359e700 1 --2- 172.21.15.59:0/2460625892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59a4139110 0x7f59a4122f80 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f599c009e50 tx=0x7f599c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.298+0000 7f598b7fe700 1 -- 172.21.15.59:0/2460625892 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c00ca90 con 0x7f59a4139110 2023-09-30T22:34:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.298+0000 7f598b7fe700 1 -- 172.21.15.59:0/2460625892 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c00f040 con 0x7f59a4139110 2023-09-30T22:34:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.298+0000 7f59a89ff700 1 -- 172.21.15.59:0/2460625892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59980094a0 con 0x7f59a4139110 2023-09-30T22:34:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.298+0000 7f598b7fe700 1 -- 172.21.15.59:0/2460625892 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c00ce50 con 0x7f59a4139110 2023-09-30T22:34:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.298+0000 7f59a89ff700 1 -- 172.21.15.59:0/2460625892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a409cf10 con 0x7f59a4139110 2023-09-30T22:34:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.299+0000 7f598b7fe700 1 -- 172.21.15.59:0/2460625892 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f599c014480 con 0x7f59a4139110 2023-09-30T22:34:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.299+0000 7f598b7fe700 1 -- 172.21.15.59:0/2460625892 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f599c03fc30 con 0x7f59a4139110 2023-09-30T22:34:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.299+0000 7f59a89ff700 1 -- 172.21.15.59:0/2460625892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a411edc0 con 0x7f59a4139110 2023-09-30T22:34:47.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.304+0000 7f598b7fe700 1 -- 172.21.15.59:0/2460625892 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f599c012930 con 0x7f59a4139110 2023-09-30T22:34:47.305 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:47.335 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:47.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.450+0000 7f24083ea700 1 Processor -- start 2023-09-30T22:34:47.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.450+0000 7f24083ea700 1 -- start start 2023-09-30T22:34:47.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.451+0000 7f24083ea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2400130670 0x7f2400130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.451+0000 7f24083ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f240006f680 0x7f240006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.451+0000 7f24083ea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2400130260 con 0x7f240006ffd0 2023-09-30T22:34:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.451+0000 7f24083ea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2400071ff0 con 0x7f2400130670 2023-09-30T22:34:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.451+0000 7f24083ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240009ecf0 con 0x7f240006f680 2023-09-30T22:34:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.452+0000 7f2406186700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2400130670 0x7f2400130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.452+0000 7f2405985700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f240006f680 0x7f240006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.452+0000 7f2405985700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f240006f680 0x7f240006fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39394/0 (socket says 172.21.15.59:39394) 2023-09-30T22:34:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.452+0000 7f2406186700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2400130670 0x7f2400130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38846/0 (socket says 172.21.15.59:38846) 2023-09-30T22:34:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.452+0000 7f2405985700 1 -- 172.21.15.59:0/2473881994 learned_addr learned my addr 172.21.15.59:0/2473881994 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.452+0000 7f2406987700 1 --1- 172.21.15.59:0/2473881994 >> v1:172.21.15.59:6789/0 conn(0x7f240006ffd0 0x7f2400137530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33200/0 (socket says 172.21.15.59:33200) 2023-09-30T22:34:47.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.452+0000 7f2405985700 1 -- 172.21.15.59:0/2473881994 >> v2:172.21.15.59:3300/0 conn(0x7f2400130670 msgr2=0x7f2400130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:47.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.452+0000 7f2405985700 1 --2- 172.21.15.59:0/2473881994 >> v2:172.21.15.59:3300/0 conn(0x7f2400130670 0x7f2400130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.452+0000 7f2405985700 1 -- 172.21.15.59:0/2473881994 >> v1:172.21.15.59:6789/0 conn(0x7f240006ffd0 legacy=0x7f2400137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.452+0000 7f2405985700 1 -- 172.21.15.59:0/2473881994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2400070e70 con 0x7f240006f680 2023-09-30T22:34:47.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.452+0000 7f2406186700 1 --2- 172.21.15.59:0/2473881994 >> v2:172.21.15.59:3300/0 conn(0x7f2400130670 0x7f2400130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:47.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.452+0000 7f2405985700 1 --2- 172.21.15.59:0/2473881994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f240006f680 0x7f240006fa90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f23f00098f0 tx=0x7f23f0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=462490a7fc99171c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:47.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.452+0000 7f2405184700 1 -- 172.21.15.59:0/2473881994 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0011830 con 0x7f240006f680 2023-09-30T22:34:47.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.452+0000 7f2405184700 1 -- 172.21.15.59:0/2473881994 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f0011990 con 0x7f240006f680 2023-09-30T22:34:47.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.452+0000 7f2405184700 1 -- 172.21.15.59:0/2473881994 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0011d20 con 0x7f240006f680 2023-09-30T22:34:47.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.453+0000 7f24083ea700 1 -- 172.21.15.59:0/2473881994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f240006f680 msgr2=0x7f240006fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.453+0000 7f24083ea700 1 --2- 172.21.15.59:0/2473881994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f240006f680 0x7f240006fa90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f23f00098f0 tx=0x7f23f0009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:47.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.453+0000 7f24083ea700 1 -- 172.21.15.59:0/2473881994 shutdown_connections 2023-09-30T22:34:47.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.453+0000 7f24083ea700 1 --2- 172.21.15.59:0/2473881994 >> v2:172.21.15.59:3300/0 conn(0x7f2400130670 0x7f2400130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.453+0000 7f24083ea700 1 --2- 172.21.15.59:0/2473881994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f240006f680 0x7f240006fa90 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.453+0000 7f24083ea700 1 -- 172.21.15.59:0/2473881994 >> 172.21.15.59:0/2473881994 conn(0x7f24000a2aa0 msgr2=0x7f24000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:47.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.453+0000 7f24083ea700 1 -- 172.21.15.59:0/2473881994 shutdown_connections 2023-09-30T22:34:47.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.453+0000 7f24083ea700 1 -- 172.21.15.59:0/2473881994 wait complete. 2023-09-30T22:34:47.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.454+0000 7f24083ea700 1 Processor -- start 2023-09-30T22:34:47.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.454+0000 7f24083ea700 1 -- start start 2023-09-30T22:34:47.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f24083ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f240006f680 0x7f2400139c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f24083ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f240006ffd0 0x7f240013a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f24083ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2400130670 0x7f240013a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f24083ea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240012e500 con 0x7f2400130670 2023-09-30T22:34:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f24083ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240013bc60 con 0x7f240006ffd0 2023-09-30T22:34:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f24083ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2400118d70 con 0x7f240006f680 2023-09-30T22:34:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f2406987700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2400130670 0x7f240013a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f2406987700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2400130670 0x7f240013a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38860/0 (socket says 172.21.15.59:38860) 2023-09-30T22:34:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f2406987700 1 -- 172.21.15.59:0/3512381383 learned_addr learned my addr 172.21.15.59:0/3512381383 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f2406186700 1 --2- 172.21.15.59:0/3512381383 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f240006f680 0x7f2400139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f2406987700 1 -- 172.21.15.59:0/3512381383 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f240006f680 msgr2=0x7f2400139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f2405985700 1 --2- 172.21.15.59:0/3512381383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f240006ffd0 0x7f240013a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f2406987700 1 --2- 172.21.15.59:0/3512381383 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f240006f680 0x7f2400139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f2406987700 1 -- 172.21.15.59:0/3512381383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f240006ffd0 msgr2=0x7f240013a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f2406987700 1 --2- 172.21.15.59:0/3512381383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f240006ffd0 0x7f240013a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f2406987700 1 -- 172.21.15.59:0/3512381383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc0094a0 con 0x7f2400130670 2023-09-30T22:34:47.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.455+0000 7f2405985700 1 --2- 172.21.15.59:0/3512381383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f240006ffd0 0x7f240013a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:34:47.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.456+0000 7f2406987700 1 --2- 172.21.15.59:0/3512381383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2400130670 0x7f240013a6e0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f23f800cbd0 tx=0x7f23f800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:47.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.456+0000 7f23f6ffd700 1 -- 172.21.15.59:0/3512381383 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f800abb0 con 0x7f2400130670 2023-09-30T22:34:47.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.456+0000 7f23f6ffd700 1 -- 172.21.15.59:0/3512381383 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f800ad10 con 0x7f2400130670 2023-09-30T22:34:47.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.456+0000 7f24083ea700 1 -- 172.21.15.59:0/3512381383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f0009550 con 0x7f2400130670 2023-09-30T22:34:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.456+0000 7f23f6ffd700 1 -- 172.21.15.59:0/3512381383 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f8007270 con 0x7f2400130670 2023-09-30T22:34:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.456+0000 7f24083ea700 1 -- 172.21.15.59:0/3512381383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24001389c0 con 0x7f2400130670 2023-09-30T22:34:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.457+0000 7f24083ea700 1 -- 172.21.15.59:0/3512381383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2400138bb0 con 0x7f2400130670 2023-09-30T22:34:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.458+0000 7f23f6ffd700 1 -- 172.21.15.59:0/3512381383 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23f80073d0 con 0x7f2400130670 2023-09-30T22:34:47.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.458+0000 7f23f6ffd700 1 -- 172.21.15.59:0/3512381383 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f23f803fa40 con 0x7f2400130670 2023-09-30T22:34:47.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.467+0000 7f23f6ffd700 1 -- 172.21.15.59:0/3512381383 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23f80198b0 con 0x7f2400130670 2023-09-30T22:34:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.481+0000 7f70c4b6c700 1 -- 172.21.15.59:0/2249310934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f70c0123a50 con 0x7f70c00a1340 2023-09-30T22:34:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.481+0000 7f70b6ffd700 1 -- 172.21.15.59:0/2249310934 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70c0123a50 con 0x7f70c00a1340 2023-09-30T22:34:47.481 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.484+0000 7f70c4b6c700 1 -- 172.21.15.59:0/2249310934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c00a1340 msgr2=0x7f70c0120660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.484+0000 7f70c4b6c700 1 --2- 172.21.15.59:0/2249310934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c00a1340 0x7f70c0120660 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f70a800ec10 tx=0x7f70a800ef20 comp rx=0 tx=0).stop 2023-09-30T22:34:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.484+0000 7f70c4b6c700 1 -- 172.21.15.59:0/2249310934 shutdown_connections 2023-09-30T22:34:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.484+0000 7f70c4b6c700 1 --2- 172.21.15.59:0/2249310934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c00a0a30 0x7f70c0120120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.484+0000 7f70c4b6c700 1 --2- 172.21.15.59:0/2249310934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c0133fa0 0x7f70c0120ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.484+0000 7f70c4b6c700 1 --2- 172.21.15.59:0/2249310934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c00a1340 0x7f70c0120660 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.484+0000 7f70c4b6c700 1 -- 172.21.15.59:0/2249310934 >> 172.21.15.59:0/2249310934 conn(0x7f70c00a6550 msgr2=0x7f70c00a4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.484+0000 7f70c4b6c700 1 -- 172.21.15.59:0/2249310934 shutdown_connections 2023-09-30T22:34:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.484+0000 7f70c4b6c700 1 -- 172.21.15.59:0/2249310934 wait complete. 2023-09-30T22:34:47.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.495+0000 7ffa7c8be700 1 Processor -- start 2023-09-30T22:34:47.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.496+0000 7ffa7c8be700 1 -- start start 2023-09-30T22:34:47.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.496+0000 7ffa7c8be700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa7812cf60 0x7ffa7806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.496+0000 7ffa7c8be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7812f8b0 0x7ffa7812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.496+0000 7ffa7c8be700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7812cd90 con 0x7ffa78130260 2023-09-30T22:34:47.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.496+0000 7ffa7c8be700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7812d330 con 0x7ffa7812cf60 2023-09-30T22:34:47.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.496+0000 7ffa7c8be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa781306d0 con 0x7ffa7812f8b0 2023-09-30T22:34:47.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.497+0000 7ffa7659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa7812cf60 0x7ffa7806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.497+0000 7ffa7659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa7812cf60 0x7ffa7806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38864/0 (socket says 172.21.15.59:38864) 2023-09-30T22:34:47.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.497+0000 7ffa7659c700 1 -- 172.21.15.59:0/2502751276 learned_addr learned my addr 172.21.15.59:0/2502751276 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:47.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.497+0000 7ffa75d9b700 1 --2- 172.21.15.59:0/2502751276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7812f8b0 0x7ffa7812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.497+0000 7ffa7659c700 1 -- 172.21.15.59:0/2502751276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7812f8b0 msgr2=0x7ffa7812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:47.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.497+0000 7ffa7659c700 1 --2- 172.21.15.59:0/2502751276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7812f8b0 0x7ffa7812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.497+0000 7ffa7659c700 1 -- 172.21.15.59:0/2502751276 >> v1:172.21.15.59:6789/0 conn(0x7ffa78130260 legacy=0x7ffa78136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.497+0000 7ffa7659c700 1 -- 172.21.15.59:0/2502751276 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa78071780 con 0x7ffa7812cf60 2023-09-30T22:34:47.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.497+0000 7ffa7659c700 1 --2- 172.21.15.59:0/2502751276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa7812cf60 0x7ffa7806f5d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7ffa680098f0 tx=0x7ffa68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968cdc3d196d469a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:47.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.497+0000 7ffa7559a700 1 -- 172.21.15.59:0/2502751276 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa68011830 con 0x7ffa7812cf60 2023-09-30T22:34:47.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.498+0000 7ffa7559a700 1 -- 172.21.15.59:0/2502751276 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa68011990 con 0x7ffa7812cf60 2023-09-30T22:34:47.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.498+0000 7ffa7559a700 1 -- 172.21.15.59:0/2502751276 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa68011d20 con 0x7ffa7812cf60 2023-09-30T22:34:47.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:47.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.499+0000 7ffa7c8be700 1 -- 172.21.15.59:0/2502751276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa7812cf60 msgr2=0x7ffa7806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.499+0000 7ffa7c8be700 1 --2- 172.21.15.59:0/2502751276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa7812cf60 0x7ffa7806f5d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7ffa680098f0 tx=0x7ffa68009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:47.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.499+0000 7ffa7c8be700 1 -- 172.21.15.59:0/2502751276 shutdown_connections 2023-09-30T22:34:47.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.499+0000 7ffa7c8be700 1 --2- 172.21.15.59:0/2502751276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa7812cf60 0x7ffa7806f5d0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.499+0000 7ffa7c8be700 1 --2- 172.21.15.59:0/2502751276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7812f8b0 0x7ffa7812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.499+0000 7ffa7c8be700 1 -- 172.21.15.59:0/2502751276 >> 172.21.15.59:0/2502751276 conn(0x7ffa780a2aa0 msgr2=0x7ffa780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:47.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.499+0000 7ffa7c8be700 1 -- 172.21.15.59:0/2502751276 shutdown_connections 2023-09-30T22:34:47.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.499+0000 7ffa7c8be700 1 -- 172.21.15.59:0/2502751276 wait complete. 2023-09-30T22:34:47.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.500+0000 7ffa7c8be700 1 Processor -- start 2023-09-30T22:34:47.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.501+0000 7ffa7c8be700 1 -- start start 2023-09-30T22:34:47.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.501+0000 7ffa7c8be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa7812cf60 0x7ffa78129220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.501+0000 7ffa7c8be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7812f8b0 0x7ffa78129760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.501+0000 7ffa7c8be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa78130260 0x7ffa781309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.501+0000 7ffa7c8be700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78134080 con 0x7ffa78130260 2023-09-30T22:34:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.501+0000 7ffa7c8be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78129ca0 con 0x7ffa7812f8b0 2023-09-30T22:34:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.501+0000 7ffa7c8be700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7809eab0 con 0x7ffa7812cf60 2023-09-30T22:34:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.501+0000 7ffa7659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa7812cf60 0x7ffa78129220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.501+0000 7ffa7659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa7812cf60 0x7ffa78129220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54684/0 (socket says 172.21.15.59:54684) 2023-09-30T22:34:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.501+0000 7ffa7659c700 1 -- 172.21.15.59:0/4218413774 learned_addr learned my addr 172.21.15.59:0/4218413774 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.501+0000 7ffa75d9b700 1 --2- 172.21.15.59:0/4218413774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7812f8b0 0x7ffa78129760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.501+0000 7ffa76d9d700 1 --2- 172.21.15.59:0/4218413774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa78130260 0x7ffa781309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.502+0000 7ffa75d9b700 1 -- 172.21.15.59:0/4218413774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa7812cf60 msgr2=0x7ffa78129220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.502+0000 7ffa75d9b700 1 --2- 172.21.15.59:0/4218413774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa7812cf60 0x7ffa78129220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.502+0000 7ffa75d9b700 1 -- 172.21.15.59:0/4218413774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa78130260 msgr2=0x7ffa781309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.502+0000 7ffa75d9b700 1 --2- 172.21.15.59:0/4218413774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa78130260 0x7ffa781309e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.502+0000 7ffa75d9b700 1 -- 172.21.15.59:0/4218413774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa68009550 con 0x7ffa7812f8b0 2023-09-30T22:34:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.502+0000 7ffa7659c700 1 --2- 172.21.15.59:0/4218413774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa7812cf60 0x7ffa78129220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.502+0000 7ffa76d9d700 1 --2- 172.21.15.59:0/4218413774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa78130260 0x7ffa781309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.502+0000 7ffa75d9b700 1 --2- 172.21.15.59:0/4218413774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7812f8b0 0x7ffa78129760 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00e930 tx=0x7ffa6c00ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.502+0000 7ffa66ffd700 1 -- 172.21.15.59:0/4218413774 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c00ee80 con 0x7ffa7812f8b0 2023-09-30T22:34:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.502+0000 7ffa66ffd700 1 -- 172.21.15.59:0/4218413774 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c00c850 con 0x7ffa7812f8b0 2023-09-30T22:34:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.502+0000 7ffa7c8be700 1 -- 172.21.15.59:0/4218413774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa78133580 con 0x7ffa7812f8b0 2023-09-30T22:34:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.502+0000 7ffa66ffd700 1 -- 172.21.15.59:0/4218413774 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c00cbc0 con 0x7ffa7812f8b0 2023-09-30T22:34:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.502+0000 7ffa7c8be700 1 -- 172.21.15.59:0/4218413774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa781331c0 con 0x7ffa7812f8b0 2023-09-30T22:34:47.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.503+0000 7ffa66ffd700 1 -- 172.21.15.59:0/4218413774 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa6c00cd20 con 0x7ffa7812f8b0 2023-09-30T22:34:47.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.503+0000 7ffa66ffd700 1 -- 172.21.15.59:0/4218413774 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffa6c03fb30 con 0x7ffa7812f8b0 2023-09-30T22:34:47.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.503+0000 7ffa7c8be700 1 -- 172.21.15.59:0/4218413774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa781333e0 con 0x7ffa7812f8b0 2023-09-30T22:34:47.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.508+0000 7ffa66ffd700 1 -- 172.21.15.59:0/4218413774 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa781333e0 con 0x7ffa7812f8b0 2023-09-30T22:34:47.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.528+0000 7f59a89ff700 1 -- 172.21.15.59:0/2460625892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f59a4125e60 con 0x7f59a4139110 2023-09-30T22:34:47.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.529+0000 7f598b7fe700 1 -- 172.21.15.59:0/2460625892 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f599c012340 con 0x7f59a4139110 2023-09-30T22:34:47.529 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:47.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.532+0000 7f59a89ff700 1 -- 172.21.15.59:0/2460625892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59a4139110 msgr2=0x7f59a4122f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.532+0000 7f59a89ff700 1 --2- 172.21.15.59:0/2460625892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59a4139110 0x7f59a4122f80 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f599c009e50 tx=0x7f599c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.532+0000 7f59a89ff700 1 -- 172.21.15.59:0/2460625892 shutdown_connections 2023-09-30T22:34:47.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.532+0000 7f59a89ff700 1 --2- 172.21.15.59:0/2460625892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59a4139110 0x7f59a4122f80 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.532+0000 7f59a89ff700 1 --2- 172.21.15.59:0/2460625892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59a40a0800 0x7f59a4122500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.532+0000 7f59a89ff700 1 --2- 172.21.15.59:0/2460625892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59a40a12e0 0x7f59a4122a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.532+0000 7f59a89ff700 1 -- 172.21.15.59:0/2460625892 >> 172.21.15.59:0/2460625892 conn(0x7f59a40a6140 msgr2=0x7f59a40a5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:47.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.532+0000 7f59a89ff700 1 -- 172.21.15.59:0/2460625892 shutdown_connections 2023-09-30T22:34:47.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.532+0000 7f59a89ff700 1 -- 172.21.15.59:0/2460625892 wait complete. 2023-09-30T22:34:47.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:47.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.681+0000 7f24083ea700 1 -- 172.21.15.59:0/3512381383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2400074ea0 con 0x7f2400130670 2023-09-30T22:34:47.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.681+0000 7f23f6ffd700 1 -- 172.21.15.59:0/3512381383 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23f8017020 con 0x7f2400130670 2023-09-30T22:34:47.682 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:47.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.683+0000 7f24083ea700 1 -- 172.21.15.59:0/3512381383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2400130670 msgr2=0x7f240013a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.683+0000 7f24083ea700 1 --2- 172.21.15.59:0/3512381383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2400130670 0x7f240013a6e0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f23f800cbd0 tx=0x7f23f800cf90 comp rx=0 tx=0).stop 2023-09-30T22:34:47.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.683+0000 7f24083ea700 1 -- 172.21.15.59:0/3512381383 shutdown_connections 2023-09-30T22:34:47.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.683+0000 7f24083ea700 1 --2- 172.21.15.59:0/3512381383 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f240006f680 0x7f2400139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.683+0000 7f24083ea700 1 --2- 172.21.15.59:0/3512381383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2400130670 0x7f240013a6e0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.683+0000 7f24083ea700 1 --2- 172.21.15.59:0/3512381383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f240006ffd0 0x7f240013a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.683+0000 7f24083ea700 1 -- 172.21.15.59:0/3512381383 >> 172.21.15.59:0/3512381383 conn(0x7f24000a2aa0 msgr2=0x7f24000a1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:47.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.683+0000 7f24083ea700 1 -- 172.21.15.59:0/3512381383 shutdown_connections 2023-09-30T22:34:47.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.683+0000 7f24083ea700 1 -- 172.21.15.59:0/3512381383 wait complete. 2023-09-30T22:34:47.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:47.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.717+0000 7ffa7c8be700 1 -- 172.21.15.59:0/4218413774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffa781333e0 con 0x7ffa7812f8b0 2023-09-30T22:34:47.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.717+0000 7ffa66ffd700 1 -- 172.21.15.59:0/4218413774 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa781333e0 con 0x7ffa7812f8b0 2023-09-30T22:34:47.717 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:47.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.719+0000 7ffa7c8be700 1 -- 172.21.15.59:0/4218413774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7812f8b0 msgr2=0x7ffa78129760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:47.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.719+0000 7ffa7c8be700 1 --2- 172.21.15.59:0/4218413774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7812f8b0 0x7ffa78129760 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00e930 tx=0x7ffa6c00ec40 comp rx=0 tx=0).stop 2023-09-30T22:34:47.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.719+0000 7ffa7c8be700 1 -- 172.21.15.59:0/4218413774 shutdown_connections 2023-09-30T22:34:47.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.719+0000 7ffa7c8be700 1 --2- 172.21.15.59:0/4218413774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa7812cf60 0x7ffa78129220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.719+0000 7ffa7c8be700 1 --2- 172.21.15.59:0/4218413774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa78130260 0x7ffa781309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.719+0000 7ffa7c8be700 1 --2- 172.21.15.59:0/4218413774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7812f8b0 0x7ffa78129760 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:47.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.719+0000 7ffa7c8be700 1 -- 172.21.15.59:0/4218413774 >> 172.21.15.59:0/4218413774 conn(0x7ffa780a2aa0 msgr2=0x7ffa7806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:47.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.719+0000 7ffa7c8be700 1 -- 172.21.15.59:0/4218413774 shutdown_connections 2023-09-30T22:34:47.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:47.719+0000 7ffa7c8be700 1 -- 172.21.15.59:0/4218413774 wait complete. 2023-09-30T22:34:47.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:48.501 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:48.549 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:48.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.653+0000 7fdc4886f700 1 Processor -- start 2023-09-30T22:34:48.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.653+0000 7fdc4886f700 1 -- start start 2023-09-30T22:34:48.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.654+0000 7fdc4886f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc4409d6f0 0x7fdc4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.654+0000 7fdc4886f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc4409e000 0x7fdc441339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.654+0000 7fdc4886f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4409b120 con 0x7fdc4409e410 2023-09-30T22:34:48.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.654+0000 7fdc4886f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4406b460 con 0x7fdc4409d6f0 2023-09-30T22:34:48.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.654+0000 7fdc4886f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4409a7e0 con 0x7fdc4409e000 2023-09-30T22:34:48.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.654+0000 7fdc4259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc4409d6f0 0x7fdc4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.654+0000 7fdc41d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc4409e000 0x7fdc441339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.654+0000 7fdc4259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc4409d6f0 0x7fdc4409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38890/0 (socket says 172.21.15.59:38890) 2023-09-30T22:34:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.654+0000 7fdc4259c700 1 -- 172.21.15.59:0/4207630618 learned_addr learned my addr 172.21.15.59:0/4207630618 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.655+0000 7fdc41d9b700 1 -- 172.21.15.59:0/4207630618 >> v2:172.21.15.59:3300/0 conn(0x7fdc4409d6f0 msgr2=0x7fdc4409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.655+0000 7fdc41d9b700 1 --2- 172.21.15.59:0/4207630618 >> v2:172.21.15.59:3300/0 conn(0x7fdc4409d6f0 0x7fdc4409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.655+0000 7fdc41d9b700 1 -- 172.21.15.59:0/4207630618 >> v1:172.21.15.59:6789/0 conn(0x7fdc4409e410 legacy=0x7fdc44133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.655+0000 7fdc41d9b700 1 -- 172.21.15.59:0/4207630618 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4409a500 con 0x7fdc4409e000 2023-09-30T22:34:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.655+0000 7fdc41d9b700 1 --2- 172.21.15.59:0/4207630618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc4409e000 0x7fdc441339f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009870 tx=0x7fdc2c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d8fbfeb9ac39e32 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.655+0000 7fdc4159a700 1 -- 172.21.15.59:0/4207630618 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c011830 con 0x7fdc4409e000 2023-09-30T22:34:48.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.655+0000 7fdc4159a700 1 -- 172.21.15.59:0/4207630618 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c011990 con 0x7fdc4409e000 2023-09-30T22:34:48.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.655+0000 7fdc4159a700 1 -- 172.21.15.59:0/4207630618 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c011d20 con 0x7fdc4409e000 2023-09-30T22:34:48.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.656+0000 7fdc4886f700 1 -- 172.21.15.59:0/4207630618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc4409e000 msgr2=0x7fdc441339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.656+0000 7fdc4886f700 1 --2- 172.21.15.59:0/4207630618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc4409e000 0x7fdc441339f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009870 tx=0x7fdc2c009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:48.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.656+0000 7fdc4886f700 1 -- 172.21.15.59:0/4207630618 shutdown_connections 2023-09-30T22:34:48.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.656+0000 7fdc4886f700 1 --2- 172.21.15.59:0/4207630618 >> v2:172.21.15.59:3300/0 conn(0x7fdc4409d6f0 0x7fdc4409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.656+0000 7fdc4886f700 1 --2- 172.21.15.59:0/4207630618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc4409e000 0x7fdc441339f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.656+0000 7fdc4886f700 1 -- 172.21.15.59:0/4207630618 >> 172.21.15.59:0/4207630618 conn(0x7fdc44066f50 msgr2=0x7fdc4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:48.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.656+0000 7fdc4886f700 1 -- 172.21.15.59:0/4207630618 shutdown_connections 2023-09-30T22:34:48.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.656+0000 7fdc4886f700 1 -- 172.21.15.59:0/4207630618 wait complete. 2023-09-30T22:34:48.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.657+0000 7fdc4886f700 1 Processor -- start 2023-09-30T22:34:48.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.657+0000 7fdc4886f700 1 -- start start 2023-09-30T22:34:48.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc4886f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc4409d6f0 0x7fdc441a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc4886f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc4409e000 0x7fdc441a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc4886f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc4409e410 0x7fdc441a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc4886f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc441a7340 con 0x7fdc4409d6f0 2023-09-30T22:34:48.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc4886f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc441a9920 con 0x7fdc4409e000 2023-09-30T22:34:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc4886f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc441a8cd0 con 0x7fdc4409e410 2023-09-30T22:34:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc41d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc4409e000 0x7fdc441a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc4259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc4409d6f0 0x7fdc441a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc41d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc4409e000 0x7fdc441a63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39436/0 (socket says 172.21.15.59:39436) 2023-09-30T22:34:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc4259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc4409d6f0 0x7fdc441a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38892/0 (socket says 172.21.15.59:38892) 2023-09-30T22:34:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc41d9b700 1 -- 172.21.15.59:0/3226249563 learned_addr learned my addr 172.21.15.59:0/3226249563 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc42d9d700 1 --2- 172.21.15.59:0/3226249563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc4409e410 0x7fdc441a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc4259c700 1 -- 172.21.15.59:0/3226249563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc4409e410 msgr2=0x7fdc441a6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc4259c700 1 --2- 172.21.15.59:0/3226249563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc4409e410 0x7fdc441a6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc4259c700 1 -- 172.21.15.59:0/3226249563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc4409e000 msgr2=0x7fdc441a63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc4259c700 1 --2- 172.21.15.59:0/3226249563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc4409e000 0x7fdc441a63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc4259c700 1 -- 172.21.15.59:0/3226249563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c0094a0 con 0x7fdc4409d6f0 2023-09-30T22:34:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc4259c700 1 --2- 172.21.15.59:0/3226249563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc4409d6f0 0x7fdc441a5e90 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400e910 tx=0x7fdc3400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.658+0000 7fdc3affd700 1 -- 172.21.15.59:0/3226249563 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc34013680 con 0x7fdc4409d6f0 2023-09-30T22:34:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.659+0000 7fdc3affd700 1 -- 172.21.15.59:0/3226249563 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc340137e0 con 0x7fdc4409d6f0 2023-09-30T22:34:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.659+0000 7fdc3affd700 1 -- 172.21.15.59:0/3226249563 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc34013b70 con 0x7fdc4409d6f0 2023-09-30T22:34:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.659+0000 7fdc4886f700 1 -- 172.21.15.59:0/3226249563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc441a7b10 con 0x7fdc4409d6f0 2023-09-30T22:34:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.659+0000 7fdc4886f700 1 -- 172.21.15.59:0/3226249563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc441a8810 con 0x7fdc4409d6f0 2023-09-30T22:34:48.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.660+0000 7fdc3affd700 1 -- 172.21.15.59:0/3226249563 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc34013cd0 con 0x7fdc4409d6f0 2023-09-30T22:34:48.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.660+0000 7fdc3affd700 1 -- 172.21.15.59:0/3226249563 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc3403f490 con 0x7fdc4409d6f0 2023-09-30T22:34:48.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.660+0000 7fdc4886f700 1 -- 172.21.15.59:0/3226249563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc441a7ab0 con 0x7fdc4409d6f0 2023-09-30T22:34:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.669+0000 7fdc3affd700 1 -- 172.21.15.59:0/3226249563 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc34017070 con 0x7fdc4409d6f0 2023-09-30T22:34:48.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.695+0000 7fdc5743f700 1 Processor -- start 2023-09-30T22:34:48.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.695+0000 7fdc5743f700 1 -- start start 2023-09-30T22:34:48.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.695+0000 7fdc5743f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc5009d630 0x7fdc500a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc5743f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc50138d80 0x7fdc5013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc5743f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc500a2a70 con 0x7fdc500a0a30 2023-09-30T22:34:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc5743f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc500a01d0 con 0x7fdc50138d80 2023-09-30T22:34:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc5743f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5009e2b0 con 0x7fdc5009d630 2023-09-30T22:34:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc549da700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc5009d630 0x7fdc500a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc549da700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc5009d630 0x7fdc500a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54720/0 (socket says 172.21.15.59:54720) 2023-09-30T22:34:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc559dc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc50138d80 0x7fdc5013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc549da700 1 -- 172.21.15.59:0/3031702739 learned_addr learned my addr 172.21.15.59:0/3031702739 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc47fff700 1 -- 172.21.15.59:0/3031702739 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504295230 0 0) 0x7fdc500a2a70 con 0x7fdc500a0a30 2023-09-30T22:34:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc47fff700 1 -- 172.21.15.59:0/3031702739 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc3c0035b0 con 0x7fdc500a0a30 2023-09-30T22:34:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc549da700 1 -- 172.21.15.59:0/3031702739 >> v2:172.21.15.59:3300/0 conn(0x7fdc50138d80 msgr2=0x7fdc5013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc549da700 1 --2- 172.21.15.59:0/3031702739 >> v2:172.21.15.59:3300/0 conn(0x7fdc50138d80 0x7fdc5013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc549da700 1 -- 172.21.15.59:0/3031702739 >> v1:172.21.15.59:6789/0 conn(0x7fdc500a0a30 legacy=0x7fdc500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc549da700 1 -- 172.21.15.59:0/3031702739 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5009dc50 con 0x7fdc5009d630 2023-09-30T22:34:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc559dc700 1 --2- 172.21.15.59:0/3031702739 >> v2:172.21.15.59:3300/0 conn(0x7fdc50138d80 0x7fdc5013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.696+0000 7fdc549da700 1 --2- 172.21.15.59:0/3031702739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc5009d630 0x7fdc500a1510 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdc400098f0 tx=0x7fdc40009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a2bde3a23679fea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.697+0000 7fdc47fff700 1 -- 172.21.15.59:0/3031702739 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40011830 con 0x7fdc5009d630 2023-09-30T22:34:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.697+0000 7fdc47fff700 1 -- 172.21.15.59:0/3031702739 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc40011990 con 0x7fdc5009d630 2023-09-30T22:34:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.697+0000 7fdc47fff700 1 -- 172.21.15.59:0/3031702739 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40011d20 con 0x7fdc5009d630 2023-09-30T22:34:48.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.697+0000 7fdc5743f700 1 -- 172.21.15.59:0/3031702739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc5009d630 msgr2=0x7fdc500a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.697+0000 7fdc5743f700 1 --2- 172.21.15.59:0/3031702739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc5009d630 0x7fdc500a1510 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdc400098f0 tx=0x7fdc40009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.697+0000 7fdc5743f700 1 -- 172.21.15.59:0/3031702739 shutdown_connections 2023-09-30T22:34:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.697+0000 7fdc5743f700 1 --2- 172.21.15.59:0/3031702739 >> v2:172.21.15.59:3300/0 conn(0x7fdc50138d80 0x7fdc5013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.697+0000 7fdc5743f700 1 --2- 172.21.15.59:0/3031702739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc5009d630 0x7fdc500a1510 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.697+0000 7fdc5743f700 1 -- 172.21.15.59:0/3031702739 >> 172.21.15.59:0/3031702739 conn(0x7fdc500a3050 msgr2=0x7fdc500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.697+0000 7fdc5743f700 1 -- 172.21.15.59:0/3031702739 shutdown_connections 2023-09-30T22:34:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.697+0000 7fdc5743f700 1 -- 172.21.15.59:0/3031702739 wait complete. 2023-09-30T22:34:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.698+0000 7fdc5743f700 1 Processor -- start 2023-09-30T22:34:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.699+0000 7fdc5743f700 1 -- start start 2023-09-30T22:34:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.699+0000 7fdc5743f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc5009d630 0x7fdc5012c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.699+0000 7fdc5743f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc500a0a30 0x7fdc5012cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.699+0000 7fdc5743f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc50138d80 0x7fdc5012d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.699+0000 7fdc5743f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5012e190 con 0x7fdc5009d630 2023-09-30T22:34:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.699+0000 7fdc5743f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5013abb0 con 0x7fdc500a0a30 2023-09-30T22:34:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.699+0000 7fdc5743f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500a0410 con 0x7fdc50138d80 2023-09-30T22:34:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.699+0000 7fdc551db700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc5009d630 0x7fdc5012c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.699+0000 7fdc559dc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc50138d80 0x7fdc5012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.699+0000 7fdc549da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc500a0a30 0x7fdc5012cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.699+0000 7fdc559dc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc50138d80 0x7fdc5012d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54734/0 (socket says 172.21.15.59:54734) 2023-09-30T22:34:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.699+0000 7fdc551db700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc5009d630 0x7fdc5012c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38908/0 (socket says 172.21.15.59:38908) 2023-09-30T22:34:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.699+0000 7fdc559dc700 1 -- 172.21.15.59:0/3414501542 learned_addr learned my addr 172.21.15.59:0/3414501542 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.700+0000 7fdc559dc700 1 -- 172.21.15.59:0/3414501542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc500a0a30 msgr2=0x7fdc5012cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.700+0000 7fdc559dc700 1 --2- 172.21.15.59:0/3414501542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc500a0a30 0x7fdc5012cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.700+0000 7fdc559dc700 1 -- 172.21.15.59:0/3414501542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc5009d630 msgr2=0x7fdc5012c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.700+0000 7fdc559dc700 1 --2- 172.21.15.59:0/3414501542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc5009d630 0x7fdc5012c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.700+0000 7fdc559dc700 1 -- 172.21.15.59:0/3414501542 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc48009a70 con 0x7fdc50138d80 2023-09-30T22:34:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.700+0000 7fdc551db700 1 --2- 172.21.15.59:0/3414501542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc5009d630 0x7fdc5012c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.700+0000 7fdc559dc700 1 --2- 172.21.15.59:0/3414501542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc50138d80 0x7fdc5012d190 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800efb0 tx=0x7fdc4800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.700+0000 7fdc45ffb700 1 -- 172.21.15.59:0/3414501542 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4800cc90 con 0x7fdc50138d80 2023-09-30T22:34:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.700+0000 7fdc45ffb700 1 -- 172.21.15.59:0/3414501542 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4800f040 con 0x7fdc50138d80 2023-09-30T22:34:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.700+0000 7fdc5743f700 1 -- 172.21.15.59:0/3414501542 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc40009550 con 0x7fdc50138d80 2023-09-30T22:34:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.700+0000 7fdc45ffb700 1 -- 172.21.15.59:0/3414501542 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48014480 con 0x7fdc50138d80 2023-09-30T22:34:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.700+0000 7fdc5743f700 1 -- 172.21.15.59:0/3414501542 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5012fcc0 con 0x7fdc50138d80 2023-09-30T22:34:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.701+0000 7fdc45ffb700 1 -- 172.21.15.59:0/3414501542 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc480145e0 con 0x7fdc50138d80 2023-09-30T22:34:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.701+0000 7fdc45ffb700 1 -- 172.21.15.59:0/3414501542 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc480404b0 con 0x7fdc50138d80 2023-09-30T22:34:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.701+0000 7fdc5743f700 1 -- 172.21.15.59:0/3414501542 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc50138a10 con 0x7fdc50138d80 2023-09-30T22:34:48.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.706+0000 7fdc45ffb700 1 -- 172.21.15.59:0/3414501542 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc50138a10 con 0x7fdc50138d80 2023-09-30T22:34:48.734 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.848+0000 7ff8d2ae9700 1 Processor -- start 2023-09-30T22:34:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.848+0000 7ff8d2ae9700 1 -- start start 2023-09-30T22:34:48.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.849+0000 7ff8d2ae9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8cc09d630 0x7ff8cc0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.849+0000 7ff8d2ae9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc138d80 0x7ff8cc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.849+0000 7ff8d2ae9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8cc0a2a70 con 0x7ff8cc0a0a30 2023-09-30T22:34:48.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.849+0000 7ff8d2ae9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8cc0a01d0 con 0x7ff8cc09d630 2023-09-30T22:34:48.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.849+0000 7ff8d2ae9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc09e2b0 con 0x7ff8cc138d80 2023-09-30T22:34:48.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.849+0000 7ff8cbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8cc09d630 0x7ff8cc0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.849+0000 7ff8d0885700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff8cc0a0a30 0x7ff8cc0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33224/0 (socket says 172.21.15.59:33224) 2023-09-30T22:34:48.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.849+0000 7ff8d0885700 1 -- 172.21.15.59:0/1335677990 learned_addr learned my addr 172.21.15.59:0/1335677990 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:48.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.849+0000 7ff8d1086700 1 --2- 172.21.15.59:0/1335677990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc138d80 0x7ff8cc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.850+0000 7ff8cbfff700 1 -- 172.21.15.59:0/1335677990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc138d80 msgr2=0x7ff8cc13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.850+0000 7ff8cbfff700 1 --2- 172.21.15.59:0/1335677990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc138d80 0x7ff8cc13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.850+0000 7ff8cb7fe700 1 -- 172.21.15.59:0/1335677990 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944179571 0 0) 0x7ff8cc0a2a70 con 0x7ff8cc0a0a30 2023-09-30T22:34:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.850+0000 7ff8cbfff700 1 -- 172.21.15.59:0/1335677990 >> v1:172.21.15.59:6789/0 conn(0x7ff8cc0a0a30 legacy=0x7ff8cc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.850+0000 7ff8cbfff700 1 -- 172.21.15.59:0/1335677990 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc09dc50 con 0x7ff8cc09d630 2023-09-30T22:34:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.850+0000 7ff8cbfff700 1 --2- 172.21.15.59:0/1335677990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc09d630 0x7ff8cc0a1510 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009840 tx=0x7ff8b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e400cdedd19fcb29 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.850+0000 7ff8cb7fe700 1 -- 172.21.15.59:0/1335677990 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8011830 con 0x7ff8cc09d630 2023-09-30T22:34:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.850+0000 7ff8cb7fe700 1 -- 172.21.15.59:0/1335677990 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b8011990 con 0x7ff8cc09d630 2023-09-30T22:34:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.850+0000 7ff8cb7fe700 1 -- 172.21.15.59:0/1335677990 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8011d20 con 0x7ff8cc09d630 2023-09-30T22:34:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.851+0000 7ff8d2ae9700 1 -- 172.21.15.59:0/1335677990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc09d630 msgr2=0x7ff8cc0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.851+0000 7ff8d2ae9700 1 --2- 172.21.15.59:0/1335677990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc09d630 0x7ff8cc0a1510 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009840 tx=0x7ff8b8009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.851+0000 7ff8d2ae9700 1 -- 172.21.15.59:0/1335677990 shutdown_connections 2023-09-30T22:34:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.851+0000 7ff8d2ae9700 1 --2- 172.21.15.59:0/1335677990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc138d80 0x7ff8cc13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.851+0000 7ff8d2ae9700 1 --2- 172.21.15.59:0/1335677990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc09d630 0x7ff8cc0a1510 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.851+0000 7ff8d2ae9700 1 -- 172.21.15.59:0/1335677990 >> 172.21.15.59:0/1335677990 conn(0x7ff8cc0a3050 msgr2=0x7ff8cc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.851+0000 7ff8d2ae9700 1 -- 172.21.15.59:0/1335677990 shutdown_connections 2023-09-30T22:34:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.851+0000 7ff8d2ae9700 1 -- 172.21.15.59:0/1335677990 wait complete. 2023-09-30T22:34:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.852+0000 7ff8d2ae9700 1 Processor -- start 2023-09-30T22:34:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.853+0000 7ff8d2ae9700 1 -- start start 2023-09-30T22:34:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.853+0000 7ff8d2ae9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc09d630 0x7ff8cc1337a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.853+0000 7ff8d2ae9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc0a0a30 0x7ff8cc133ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.853+0000 7ff8d2ae9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc138d80 0x7ff8cc134220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.853+0000 7ff8d2ae9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc136270 con 0x7ff8cc0a0a30 2023-09-30T22:34:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.853+0000 7ff8d2ae9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc136f90 con 0x7ff8cc09d630 2023-09-30T22:34:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.853+0000 7ff8d2ae9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc0a4b10 con 0x7ff8cc138d80 2023-09-30T22:34:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.853+0000 7ff8d0885700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc09d630 0x7ff8cc1337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.853+0000 7ff8cbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc0a0a30 0x7ff8cc133ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.854+0000 7ff8d0885700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc09d630 0x7ff8cc1337a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39468/0 (socket says 172.21.15.59:39468) 2023-09-30T22:34:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.854+0000 7ff8cbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc0a0a30 0x7ff8cc133ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38932/0 (socket says 172.21.15.59:38932) 2023-09-30T22:34:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.854+0000 7ff8d0885700 1 -- 172.21.15.59:0/3540523096 learned_addr learned my addr 172.21.15.59:0/3540523096 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.854+0000 7ff8d1086700 1 --2- 172.21.15.59:0/3540523096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc138d80 0x7ff8cc134220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.854+0000 7ff8cbfff700 1 -- 172.21.15.59:0/3540523096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc138d80 msgr2=0x7ff8cc134220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.854+0000 7ff8cbfff700 1 --2- 172.21.15.59:0/3540523096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc138d80 0x7ff8cc134220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.854+0000 7ff8cbfff700 1 -- 172.21.15.59:0/3540523096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc09d630 msgr2=0x7ff8cc1337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.854+0000 7ff8cbfff700 1 --2- 172.21.15.59:0/3540523096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc09d630 0x7ff8cc1337a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.854+0000 7ff8cbfff700 1 -- 172.21.15.59:0/3540523096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b80094a0 con 0x7ff8cc0a0a30 2023-09-30T22:34:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.854+0000 7ff8cbfff700 1 --2- 172.21.15.59:0/3540523096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc0a0a30 0x7ff8cc133ce0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8016000 tx=0x7ff8b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:48.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.854+0000 7ff8c97fa700 1 -- 172.21.15.59:0/3540523096 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8004480 con 0x7ff8cc0a0a30 2023-09-30T22:34:48.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.854+0000 7ff8c97fa700 1 -- 172.21.15.59:0/3540523096 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b801f070 con 0x7ff8cc0a0a30 2023-09-30T22:34:48.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.854+0000 7ff8d2ae9700 1 -- 172.21.15.59:0/3540523096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc0a0410 con 0x7ff8cc0a0a30 2023-09-30T22:34:48.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.855+0000 7ff8c97fa700 1 -- 172.21.15.59:0/3540523096 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80038c0 con 0x7ff8cc0a0a30 2023-09-30T22:34:48.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.855+0000 7ff8d2ae9700 1 -- 172.21.15.59:0/3540523096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc137270 con 0x7ff8cc0a0a30 2023-09-30T22:34:48.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.855+0000 7ff8c97fa700 1 -- 172.21.15.59:0/3540523096 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff8b8021030 con 0x7ff8cc0a0a30 2023-09-30T22:34:48.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.856+0000 7ff8c97fa700 1 -- 172.21.15.59:0/3540523096 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff8b8040af0 con 0x7ff8cc0a0a30 2023-09-30T22:34:48.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.856+0000 7ff8d2ae9700 1 -- 172.21.15.59:0/3540523096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc0747f0 con 0x7ff8cc0a0a30 2023-09-30T22:34:48.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.861+0000 7ff8c97fa700 1 -- 172.21.15.59:0/3540523096 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff8b801a450 con 0x7ff8cc0a0a30 2023-09-30T22:34:48.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.876+0000 7f21897cf700 1 Processor -- start 2023-09-30T22:34:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.876+0000 7f21897cf700 1 -- start start 2023-09-30T22:34:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.877+0000 7f21897cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f218406e570 0x7f218406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.877+0000 7f21897cf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f218409eca0 0x7f218406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.877+0000 7f21897cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2184134610 0x7f2184134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.877+0000 7f21897cf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2184070ee0 con 0x7f218409eca0 2023-09-30T22:34:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.877+0000 7f21897cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2184071480 con 0x7f218406e570 2023-09-30T22:34:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.877+0000 7f21897cf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f218406f3c0 con 0x7f2184134610 2023-09-30T22:34:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.877+0000 7f21827fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f218409eca0 0x7f218406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.877+0000 7f2182ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f218406e570 0x7f218406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.877+0000 7f2182ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f218406e570 0x7f218406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39480/0 (socket says 172.21.15.59:39480) 2023-09-30T22:34:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.877+0000 7f21827fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f218409eca0 0x7f218406ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38948/0 (socket says 172.21.15.59:38948) 2023-09-30T22:34:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.877+0000 7f2182ffd700 1 -- 172.21.15.59:0/2080353136 learned_addr learned my addr 172.21.15.59:0/2080353136 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.877+0000 7f21837fe700 1 --2- 172.21.15.59:0/2080353136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2184134610 0x7f2184134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.878+0000 7f2182ffd700 1 -- 172.21.15.59:0/2080353136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2184134610 msgr2=0x7f2184134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.878+0000 7f2182ffd700 1 --2- 172.21.15.59:0/2080353136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2184134610 0x7f2184134a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.878+0000 7f2182ffd700 1 -- 172.21.15.59:0/2080353136 >> v2:172.21.15.59:3300/0 conn(0x7f218409eca0 msgr2=0x7f218406ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.878+0000 7f2182ffd700 1 --2- 172.21.15.59:0/2080353136 >> v2:172.21.15.59:3300/0 conn(0x7f218409eca0 0x7f218406ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.878+0000 7f2182ffd700 1 -- 172.21.15.59:0/2080353136 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2184071b90 con 0x7f218406e570 2023-09-30T22:34:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.878+0000 7f2182ffd700 1 --2- 172.21.15.59:0/2080353136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f218406e570 0x7f218406e940 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f21740098f0 tx=0x7f2174009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=906822ad07daecad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.878+0000 7f2181ffb700 1 -- 172.21.15.59:0/2080353136 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174011830 con 0x7f218406e570 2023-09-30T22:34:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.878+0000 7f2181ffb700 1 -- 172.21.15.59:0/2080353136 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2174011990 con 0x7f218406e570 2023-09-30T22:34:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.878+0000 7f2181ffb700 1 -- 172.21.15.59:0/2080353136 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174011d20 con 0x7f218406e570 2023-09-30T22:34:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.879+0000 7f21897cf700 1 -- 172.21.15.59:0/2080353136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f218406e570 msgr2=0x7f218406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.879+0000 7f21897cf700 1 --2- 172.21.15.59:0/2080353136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f218406e570 0x7f218406e940 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f21740098f0 tx=0x7f2174009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.879+0000 7f21897cf700 1 -- 172.21.15.59:0/2080353136 shutdown_connections 2023-09-30T22:34:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.879+0000 7f21897cf700 1 --2- 172.21.15.59:0/2080353136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2184134610 0x7f2184134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.879+0000 7f21897cf700 1 --2- 172.21.15.59:0/2080353136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f218406e570 0x7f218406e940 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.879+0000 7f21897cf700 1 --2- 172.21.15.59:0/2080353136 >> v2:172.21.15.59:3300/0 conn(0x7f218409eca0 0x7f218406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.879+0000 7f21897cf700 1 -- 172.21.15.59:0/2080353136 >> 172.21.15.59:0/2080353136 conn(0x7f21840a2aa0 msgr2=0x7f21840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.879+0000 7f21897cf700 1 -- 172.21.15.59:0/2080353136 shutdown_connections 2023-09-30T22:34:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.879+0000 7f21897cf700 1 -- 172.21.15.59:0/2080353136 wait complete. 2023-09-30T22:34:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.880+0000 7f21897cf700 1 Processor -- start 2023-09-30T22:34:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.880+0000 7f21897cf700 1 -- start start 2023-09-30T22:34:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21897cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f218406e570 0x7f21841276a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21897cf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2184134610 0x7f2184139920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21897cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2184139e60 0x7f218413a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21897cf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218413e3d0 con 0x7f2184134610 2023-09-30T22:34:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21897cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218413b620 con 0x7f218406e570 2023-09-30T22:34:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21897cf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2184127be0 con 0x7f2184139e60 2023-09-30T22:34:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21837fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2184139e60 0x7f218413a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21837fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2184139e60 0x7f218413a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54752/0 (socket says 172.21.15.59:54752) 2023-09-30T22:34:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21837fe700 1 -- 172.21.15.59:0/2256306438 learned_addr learned my addr 172.21.15.59:0/2256306438 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21827fc700 1 --2- 172.21.15.59:0/2256306438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2184134610 0x7f2184139920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f2182ffd700 1 --2- 172.21.15.59:0/2256306438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f218406e570 0x7f21841276a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21837fe700 1 -- 172.21.15.59:0/2256306438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f218406e570 msgr2=0x7f21841276a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21837fe700 1 --2- 172.21.15.59:0/2256306438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f218406e570 0x7f21841276a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21837fe700 1 -- 172.21.15.59:0/2256306438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2184134610 msgr2=0x7f2184139920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21837fe700 1 --2- 172.21.15.59:0/2256306438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2184134610 0x7f2184139920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21837fe700 1 -- 172.21.15.59:0/2256306438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2174009550 con 0x7f2184139e60 2023-09-30T22:34:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21827fc700 1 --2- 172.21.15.59:0/2256306438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2184134610 0x7f2184139920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:34:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.881+0000 7f21837fe700 1 --2- 172.21.15.59:0/2256306438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2184139e60 0x7f218413a2e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f217c009dd0 tx=0x7f217c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.882+0000 7f216b7fe700 1 -- 172.21.15.59:0/2256306438 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c00cd40 con 0x7f2184139e60 2023-09-30T22:34:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.882+0000 7f216b7fe700 1 -- 172.21.15.59:0/2256306438 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c00f040 con 0x7f2184139e60 2023-09-30T22:34:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.882+0000 7f216b7fe700 1 -- 172.21.15.59:0/2256306438 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c0146c0 con 0x7f2184139e60 2023-09-30T22:34:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.882+0000 7f21897cf700 1 -- 172.21.15.59:0/2256306438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218413ce10 con 0x7f2184139e60 2023-09-30T22:34:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.882+0000 7f21897cf700 1 -- 172.21.15.59:0/2256306438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218413db40 con 0x7f2184139e60 2023-09-30T22:34:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.883+0000 7f21897cf700 1 -- 172.21.15.59:0/2256306438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2184074ea0 con 0x7f2184139e60 2023-09-30T22:34:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.883+0000 7f216b7fe700 1 -- 172.21.15.59:0/2256306438 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f217c014820 con 0x7f2184139e60 2023-09-30T22:34:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.884+0000 7f216b7fe700 1 -- 172.21.15.59:0/2256306438 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f217c040860 con 0x7f2184139e60 2023-09-30T22:34:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.892+0000 7f216b7fe700 1 -- 172.21.15.59:0/2256306438 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f217c012930 con 0x7f2184139e60 2023-09-30T22:34:48.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.926+0000 7fdc5743f700 1 -- 172.21.15.59:0/3414501542 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdc50138a10 con 0x7fdc50138d80 2023-09-30T22:34:48.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.927+0000 7fdc45ffb700 1 -- 172.21.15.59:0/3414501542 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc50138a10 con 0x7fdc50138d80 2023-09-30T22:34:48.929 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:48.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.929+0000 7fdc5743f700 1 -- 172.21.15.59:0/3414501542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc50138d80 msgr2=0x7fdc5012d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.929+0000 7fdc5743f700 1 --2- 172.21.15.59:0/3414501542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc50138d80 0x7fdc5012d190 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800efb0 tx=0x7fdc4800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.929+0000 7fdc5743f700 1 -- 172.21.15.59:0/3414501542 shutdown_connections 2023-09-30T22:34:48.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.929+0000 7fdc5743f700 1 --2- 172.21.15.59:0/3414501542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc50138d80 0x7fdc5012d190 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.929+0000 7fdc5743f700 1 --2- 172.21.15.59:0/3414501542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc5009d630 0x7fdc5012c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.929+0000 7fdc5743f700 1 --2- 172.21.15.59:0/3414501542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc500a0a30 0x7fdc5012cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.929+0000 7fdc5743f700 1 -- 172.21.15.59:0/3414501542 >> 172.21.15.59:0/3414501542 conn(0x7fdc500a3050 msgr2=0x7fdc500a4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:48.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.930+0000 7fdc5743f700 1 -- 172.21.15.59:0/3414501542 shutdown_connections 2023-09-30T22:34:48.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.933+0000 7fdc5743f700 1 -- 172.21.15.59:0/3414501542 wait complete. 2023-09-30T22:34:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.936+0000 7fdc4886f700 1 -- 172.21.15.59:0/3226249563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdc44074ea0 con 0x7fdc4409d6f0 2023-09-30T22:34:48.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.937+0000 7fdc3affd700 1 -- 172.21.15.59:0/3226249563 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc3401b9a0 con 0x7fdc4409d6f0 2023-09-30T22:34:48.937 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:48.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.940+0000 7fdc4886f700 1 -- 172.21.15.59:0/3226249563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc4409d6f0 msgr2=0x7fdc441a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:48.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.940+0000 7fdc4886f700 1 --2- 172.21.15.59:0/3226249563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc4409d6f0 0x7fdc441a5e90 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400e910 tx=0x7fdc3400ec20 comp rx=0 tx=0).stop 2023-09-30T22:34:48.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.940+0000 7fdc4886f700 1 -- 172.21.15.59:0/3226249563 shutdown_connections 2023-09-30T22:34:48.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.940+0000 7fdc4886f700 1 --2- 172.21.15.59:0/3226249563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc4409e410 0x7fdc441a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.940+0000 7fdc4886f700 1 --2- 172.21.15.59:0/3226249563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc4409d6f0 0x7fdc441a5e90 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.940+0000 7fdc4886f700 1 --2- 172.21.15.59:0/3226249563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc4409e000 0x7fdc441a63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:48.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.940+0000 7fdc4886f700 1 -- 172.21.15.59:0/3226249563 >> 172.21.15.59:0/3226249563 conn(0x7fdc44066f50 msgr2=0x7fdc441badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:48.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.940+0000 7fdc4886f700 1 -- 172.21.15.59:0/3226249563 shutdown_connections 2023-09-30T22:34:48.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:48.940+0000 7fdc4886f700 1 -- 172.21.15.59:0/3226249563 wait complete. 2023-09-30T22:34:48.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:48.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:49.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.108+0000 7f21897cf700 1 -- 172.21.15.59:0/2256306438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2184071100 con 0x7f2184139e60 2023-09-30T22:34:49.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.108+0000 7f216b7fe700 1 -- 172.21.15.59:0/2256306438 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f217c02a030 con 0x7f2184139e60 2023-09-30T22:34:49.458 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:49.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.108+0000 7ff8d2ae9700 1 -- 172.21.15.59:0/3540523096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff8cc072980 con 0x7ff8cc0a0a30 2023-09-30T22:34:49.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.108+0000 7ff8c97fa700 1 -- 172.21.15.59:0/3540523096 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff8b8015020 con 0x7ff8cc0a0a30 2023-09-30T22:34:49.459 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:49.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.110+0000 7f21897cf700 1 -- 172.21.15.59:0/2256306438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2184139e60 msgr2=0x7f218413a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:49.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.110+0000 7f21897cf700 1 --2- 172.21.15.59:0/2256306438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2184139e60 0x7f218413a2e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f217c009dd0 tx=0x7f217c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:49.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.110+0000 7f21897cf700 1 -- 172.21.15.59:0/2256306438 shutdown_connections 2023-09-30T22:34:49.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.110+0000 7f21897cf700 1 --2- 172.21.15.59:0/2256306438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2184139e60 0x7f218413a2e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:49.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.110+0000 7f21897cf700 1 --2- 172.21.15.59:0/2256306438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f218406e570 0x7f21841276a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:49.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.110+0000 7f21897cf700 1 --2- 172.21.15.59:0/2256306438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2184134610 0x7f2184139920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:49.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.110+0000 7f21897cf700 1 -- 172.21.15.59:0/2256306438 >> 172.21.15.59:0/2256306438 conn(0x7f21840a2aa0 msgr2=0x7f2184099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:49.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.110+0000 7f21897cf700 1 -- 172.21.15.59:0/2256306438 shutdown_connections 2023-09-30T22:34:49.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.110+0000 7f21897cf700 1 -- 172.21.15.59:0/2256306438 wait complete. 2023-09-30T22:34:49.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.111+0000 7ff8d2ae9700 1 -- 172.21.15.59:0/3540523096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc0a0a30 msgr2=0x7ff8cc133ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:49.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.111+0000 7ff8d2ae9700 1 --2- 172.21.15.59:0/3540523096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc0a0a30 0x7ff8cc133ce0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8016000 tx=0x7ff8b8004750 comp rx=0 tx=0).stop 2023-09-30T22:34:49.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.111+0000 7ff8d2ae9700 1 -- 172.21.15.59:0/3540523096 shutdown_connections 2023-09-30T22:34:49.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.111+0000 7ff8d2ae9700 1 --2- 172.21.15.59:0/3540523096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8cc138d80 0x7ff8cc134220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:49.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.111+0000 7ff8d2ae9700 1 --2- 172.21.15.59:0/3540523096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8cc09d630 0x7ff8cc1337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:49.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.111+0000 7ff8d2ae9700 1 --2- 172.21.15.59:0/3540523096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8cc0a0a30 0x7ff8cc133ce0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:49.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.111+0000 7ff8d2ae9700 1 -- 172.21.15.59:0/3540523096 >> 172.21.15.59:0/3540523096 conn(0x7ff8cc0a3050 msgr2=0x7ff8cc09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:49.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.111+0000 7ff8d2ae9700 1 -- 172.21.15.59:0/3540523096 shutdown_connections 2023-09-30T22:34:49.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:49.111+0000 7ff8d2ae9700 1 -- 172.21.15.59:0/3540523096 wait complete. 2023-09-30T22:34:49.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:49.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:49.949 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:49.962 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:50.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.097+0000 7f153f8f9700 1 Processor -- start 2023-09-30T22:34:50.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.097+0000 7f153f8f9700 1 -- start start 2023-09-30T22:34:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f153f8f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15380a09c0 0x7f153806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f153f8f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1538138cf0 0x7f153813b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f153f8f9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15380a2a20 con 0x7f15380a0d90 2023-09-30T22:34:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f153f8f9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153809e690 con 0x7f1538138cf0 2023-09-30T22:34:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f153f8f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15380a1cc0 con 0x7f15380a09c0 2023-09-30T22:34:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f153de96700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1538138cf0 0x7f153813b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f153d695700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15380a09c0 0x7f153806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f153de96700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1538138cf0 0x7f153813b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38972/0 (socket says 172.21.15.59:38972) 2023-09-30T22:34:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f153de96700 1 -- 172.21.15.59:0/569366206 learned_addr learned my addr 172.21.15.59:0/569366206 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f153de96700 1 -- 172.21.15.59:0/569366206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15380a09c0 msgr2=0x7f153806c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f153de96700 1 --2- 172.21.15.59:0/569366206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15380a09c0 0x7f153806c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f153de96700 1 -- 172.21.15.59:0/569366206 >> v1:172.21.15.59:6789/0 conn(0x7f15380a0d90 legacy=0x7f15380a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f153de96700 1 -- 172.21.15.59:0/569366206 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15380a1f40 con 0x7f1538138cf0 2023-09-30T22:34:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f1537fff700 1 -- 172.21.15.59:0/569366206 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64642309 0 0) 0x7f152c001110 con 0x7f15380a0d90 2023-09-30T22:34:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f153d695700 1 --2- 172.21.15.59:0/569366206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15380a09c0 0x7f153806c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.098+0000 7f153de96700 1 --2- 172.21.15.59:0/569366206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1538138cf0 0x7f153813b0d0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f15300098f0 tx=0x7f1530009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c63d2f169cd3f24 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.099+0000 7f1537fff700 1 -- 172.21.15.59:0/569366206 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1530011830 con 0x7f1538138cf0 2023-09-30T22:34:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.099+0000 7f1537fff700 1 -- 172.21.15.59:0/569366206 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1530011990 con 0x7f1538138cf0 2023-09-30T22:34:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.099+0000 7f1537fff700 1 -- 172.21.15.59:0/569366206 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1530011d20 con 0x7f1538138cf0 2023-09-30T22:34:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.099+0000 7f153f8f9700 1 -- 172.21.15.59:0/569366206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1538138cf0 msgr2=0x7f153813b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.099+0000 7f153f8f9700 1 --2- 172.21.15.59:0/569366206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1538138cf0 0x7f153813b0d0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f15300098f0 tx=0x7f1530009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.099+0000 7f153f8f9700 1 -- 172.21.15.59:0/569366206 shutdown_connections 2023-09-30T22:34:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.099+0000 7f153f8f9700 1 --2- 172.21.15.59:0/569366206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1538138cf0 0x7f153813b0d0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.099+0000 7f153f8f9700 1 --2- 172.21.15.59:0/569366206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15380a09c0 0x7f153806c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.099+0000 7f153f8f9700 1 -- 172.21.15.59:0/569366206 >> 172.21.15.59:0/569366206 conn(0x7f15380a60c0 msgr2=0x7f15380a64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.100+0000 7f153f8f9700 1 -- 172.21.15.59:0/569366206 shutdown_connections 2023-09-30T22:34:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.100+0000 7f153f8f9700 1 -- 172.21.15.59:0/569366206 wait complete. 2023-09-30T22:34:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.100+0000 7f153f8f9700 1 Processor -- start 2023-09-30T22:34:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153f8f9700 1 -- start start 2023-09-30T22:34:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153f8f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15380a09c0 0x7f15381337a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153f8f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15380a0d90 0x7f1538133ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153f8f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1538138cf0 0x7f1538134220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153f8f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15381373d0 con 0x7f15380a0d90 2023-09-30T22:34:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153f8f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15380a3630 con 0x7f15380a09c0 2023-09-30T22:34:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153f8f9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f153809cea0 con 0x7f1538138cf0 2023-09-30T22:34:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153ce94700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15380a0d90 0x7f1538133ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153ce94700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15380a0d90 0x7f1538133ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38974/0 (socket says 172.21.15.59:38974) 2023-09-30T22:34:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153ce94700 1 -- 172.21.15.59:0/3334352379 learned_addr learned my addr 172.21.15.59:0/3334352379 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153de96700 1 --2- 172.21.15.59:0/3334352379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1538138cf0 0x7f1538134220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153d695700 1 --2- 172.21.15.59:0/3334352379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15380a09c0 0x7f15381337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153ce94700 1 -- 172.21.15.59:0/3334352379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1538138cf0 msgr2=0x7f1538134220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153ce94700 1 --2- 172.21.15.59:0/3334352379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1538138cf0 0x7f1538134220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153ce94700 1 -- 172.21.15.59:0/3334352379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15380a09c0 msgr2=0x7f15381337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153ce94700 1 --2- 172.21.15.59:0/3334352379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15380a09c0 0x7f15381337a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.101+0000 7f153ce94700 1 -- 172.21.15.59:0/3334352379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1528009a70 con 0x7f15380a0d90 2023-09-30T22:34:50.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.102+0000 7f153ce94700 1 --2- 172.21.15.59:0/3334352379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15380a0d90 0x7f1538133ce0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f152c00c780 tx=0x7f152c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:50.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.102+0000 7f1535ffb700 1 -- 172.21.15.59:0/3334352379 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c0054e0 con 0x7f15380a0d90 2023-09-30T22:34:50.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.102+0000 7f1535ffb700 1 -- 172.21.15.59:0/3334352379 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c003680 con 0x7f15380a0d90 2023-09-30T22:34:50.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.102+0000 7f153f8f9700 1 -- 172.21.15.59:0/3334352379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1530009550 con 0x7f15380a0d90 2023-09-30T22:34:50.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.102+0000 7f1535ffb700 1 -- 172.21.15.59:0/3334352379 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c003a30 con 0x7f15380a0d90 2023-09-30T22:34:50.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.102+0000 7f153f8f9700 1 -- 172.21.15.59:0/3334352379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1538136d70 con 0x7f15380a0d90 2023-09-30T22:34:50.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.103+0000 7f1535ffb700 1 -- 172.21.15.59:0/3334352379 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f152c003b90 con 0x7f15380a0d90 2023-09-30T22:34:50.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.103+0000 7f1535ffb700 1 -- 172.21.15.59:0/3334352379 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f152c03ea10 con 0x7f15380a0d90 2023-09-30T22:34:50.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.103+0000 7f153f8f9700 1 -- 172.21.15.59:0/3334352379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15380a2a20 con 0x7f15380a0d90 2023-09-30T22:34:50.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.108+0000 7f1535ffb700 1 -- 172.21.15.59:0/3334352379 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15380a2a20 con 0x7f15380a0d90 2023-09-30T22:34:50.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.135+0000 7fa3f5eb4700 1 Processor -- start 2023-09-30T22:34:50.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.135+0000 7fa3f5eb4700 1 -- start start 2023-09-30T22:34:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3f5eb4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3f009d630 0x7fa3f00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3f5eb4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f0138d80 0x7fa3f013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3f5eb4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f00a2a70 con 0x7fa3f00a0a30 2023-09-30T22:34:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3f5eb4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f00a01d0 con 0x7fa3f009d630 2023-09-30T22:34:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3f5eb4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f009e2b0 con 0x7fa3f0138d80 2023-09-30T22:34:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3eeffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3f009d630 0x7fa3f00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3effff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f0138d80 0x7fa3f013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3eeffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3f009d630 0x7fa3f00a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38984/0 (socket says 172.21.15.59:38984) 2023-09-30T22:34:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3ef7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa3f00a0a30 0x7fa3f00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33236/0 (socket says 172.21.15.59:33236) 2023-09-30T22:34:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3effff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f0138d80 0x7fa3f013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39516/0 (socket says 172.21.15.59:39516) 2023-09-30T22:34:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3eeffd700 1 -- 172.21.15.59:0/466322208 learned_addr learned my addr 172.21.15.59:0/466322208 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3effff700 1 -- 172.21.15.59:0/466322208 >> v2:172.21.15.59:3300/0 conn(0x7fa3f009d630 msgr2=0x7fa3f00a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3effff700 1 --2- 172.21.15.59:0/466322208 >> v2:172.21.15.59:3300/0 conn(0x7fa3f009d630 0x7fa3f00a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3effff700 1 -- 172.21.15.59:0/466322208 >> v1:172.21.15.59:6789/0 conn(0x7fa3f00a0a30 legacy=0x7fa3f00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3effff700 1 -- 172.21.15.59:0/466322208 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f009dc50 con 0x7fa3f0138d80 2023-09-30T22:34:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.136+0000 7fa3effff700 1 --2- 172.21.15.59:0/466322208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f0138d80 0x7fa3f013b160 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8009d90 tx=0x7fa3e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13d036c4c636f9ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.137+0000 7fa3ee7fc700 1 -- 172.21.15.59:0/466322208 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e800e070 con 0x7fa3f0138d80 2023-09-30T22:34:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.137+0000 7fa3ee7fc700 1 -- 172.21.15.59:0/466322208 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e800bb20 con 0x7fa3f0138d80 2023-09-30T22:34:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.137+0000 7fa3ee7fc700 1 -- 172.21.15.59:0/466322208 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8012430 con 0x7fa3f0138d80 2023-09-30T22:34:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.137+0000 7fa3f5eb4700 1 -- 172.21.15.59:0/466322208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f0138d80 msgr2=0x7fa3f013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.137+0000 7fa3f5eb4700 1 --2- 172.21.15.59:0/466322208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f0138d80 0x7fa3f013b160 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8009d90 tx=0x7fa3e800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.137+0000 7fa3f5eb4700 1 -- 172.21.15.59:0/466322208 shutdown_connections 2023-09-30T22:34:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.137+0000 7fa3f5eb4700 1 --2- 172.21.15.59:0/466322208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f0138d80 0x7fa3f013b160 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.137+0000 7fa3f5eb4700 1 --2- 172.21.15.59:0/466322208 >> v2:172.21.15.59:3300/0 conn(0x7fa3f009d630 0x7fa3f00a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.137+0000 7fa3f5eb4700 1 -- 172.21.15.59:0/466322208 >> 172.21.15.59:0/466322208 conn(0x7fa3f00a3050 msgr2=0x7fa3f00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.137+0000 7fa3f5eb4700 1 -- 172.21.15.59:0/466322208 shutdown_connections 2023-09-30T22:34:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.137+0000 7fa3f5eb4700 1 -- 172.21.15.59:0/466322208 wait complete. 2023-09-30T22:34:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.138+0000 7fa3f5eb4700 1 Processor -- start 2023-09-30T22:34:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.139+0000 7fa3f5eb4700 1 -- start start 2023-09-30T22:34:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.139+0000 7fa3f5eb4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f009d630 0x7fa3f0133820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.139+0000 7fa3f5eb4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3f00a0a30 0x7fa3f0133d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.139+0000 7fa3f5eb4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3f0138d80 0x7fa3f01342a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.139+0000 7fa3f5eb4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0137140 con 0x7fa3f00a0a30 2023-09-30T22:34:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.139+0000 7fa3f5eb4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0137f20 con 0x7fa3f009d630 2023-09-30T22:34:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.139+0000 7fa3f5eb4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0137340 con 0x7fa3f0138d80 2023-09-30T22:34:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.139+0000 7fa3eeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3f00a0a30 0x7fa3f0133d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.139+0000 7fa3ef7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f009d630 0x7fa3f0133820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.139+0000 7fa3eeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3f00a0a30 0x7fa3f0133d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38998/0 (socket says 172.21.15.59:38998) 2023-09-30T22:34:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.139+0000 7fa3eeffd700 1 -- 172.21.15.59:0/858285032 learned_addr learned my addr 172.21.15.59:0/858285032 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.139+0000 7fa3effff700 1 --2- 172.21.15.59:0/858285032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3f0138d80 0x7fa3f01342a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.139+0000 7fa3eeffd700 1 -- 172.21.15.59:0/858285032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3f0138d80 msgr2=0x7fa3f01342a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.140+0000 7fa3eeffd700 1 --2- 172.21.15.59:0/858285032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3f0138d80 0x7fa3f01342a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.140+0000 7fa3eeffd700 1 -- 172.21.15.59:0/858285032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f009d630 msgr2=0x7fa3f0133820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.140+0000 7fa3eeffd700 1 --2- 172.21.15.59:0/858285032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f009d630 0x7fa3f0133820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.140+0000 7fa3eeffd700 1 -- 172.21.15.59:0/858285032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e8009a70 con 0x7fa3f00a0a30 2023-09-30T22:34:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.140+0000 7fa3eeffd700 1 --2- 172.21.15.59:0/858285032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3f00a0a30 0x7fa3f0133d60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800e910 tx=0x7fa3d800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.140+0000 7fa3e7fff700 1 -- 172.21.15.59:0/858285032 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80096a0 con 0x7fa3f00a0a30 2023-09-30T22:34:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.140+0000 7fa3e7fff700 1 -- 172.21.15.59:0/858285032 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d8013680 con 0x7fa3f00a0a30 2023-09-30T22:34:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.140+0000 7fa3f5eb4700 1 -- 172.21.15.59:0/858285032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f0136a20 con 0x7fa3f00a0a30 2023-09-30T22:34:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.140+0000 7fa3e7fff700 1 -- 172.21.15.59:0/858285032 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8013a30 con 0x7fa3f00a0a30 2023-09-30T22:34:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.140+0000 7fa3f5eb4700 1 -- 172.21.15.59:0/858285032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f00a0410 con 0x7fa3f00a0a30 2023-09-30T22:34:50.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.141+0000 7fa3e7fff700 1 -- 172.21.15.59:0/858285032 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3d8013b90 con 0x7fa3f00a0a30 2023-09-30T22:34:50.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.141+0000 7fa3f5eb4700 1 -- 172.21.15.59:0/858285032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f00747f0 con 0x7fa3f00a0a30 2023-09-30T22:34:50.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.141+0000 7fa3e7fff700 1 -- 172.21.15.59:0/858285032 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa3d803f950 con 0x7fa3f00a0a30 2023-09-30T22:34:50.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.150+0000 7fa3e7fff700 1 -- 172.21.15.59:0/858285032 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3d8011bd0 con 0x7fa3f00a0a30 2023-09-30T22:34:50.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.316+0000 7f153f8f9700 1 -- 172.21.15.59:0/3334352379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f15380a2a20 con 0x7f15380a0d90 2023-09-30T22:34:50.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.317+0000 7f1535ffb700 1 -- 172.21.15.59:0/3334352379 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15380a2a20 con 0x7f15380a0d90 2023-09-30T22:34:50.317 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:50.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.319+0000 7f153f8f9700 1 -- 172.21.15.59:0/3334352379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15380a0d90 msgr2=0x7f1538133ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.319+0000 7f153f8f9700 1 --2- 172.21.15.59:0/3334352379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15380a0d90 0x7f1538133ce0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f152c00c780 tx=0x7f152c00ca90 comp rx=0 tx=0).stop 2023-09-30T22:34:50.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.319+0000 7f153f8f9700 1 -- 172.21.15.59:0/3334352379 shutdown_connections 2023-09-30T22:34:50.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.319+0000 7f153f8f9700 1 --2- 172.21.15.59:0/3334352379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1538138cf0 0x7f1538134220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.319+0000 7f153f8f9700 1 --2- 172.21.15.59:0/3334352379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15380a09c0 0x7f15381337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.319+0000 7f153f8f9700 1 --2- 172.21.15.59:0/3334352379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15380a0d90 0x7f1538133ce0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.319+0000 7f153f8f9700 1 -- 172.21.15.59:0/3334352379 >> 172.21.15.59:0/3334352379 conn(0x7f15380a60c0 msgr2=0x7f153809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:50.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.319+0000 7f153f8f9700 1 -- 172.21.15.59:0/3334352379 shutdown_connections 2023-09-30T22:34:50.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.319+0000 7f153f8f9700 1 -- 172.21.15.59:0/3334352379 wait complete. 2023-09-30T22:34:50.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:50.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.355+0000 7fa3f5eb4700 1 -- 172.21.15.59:0/858285032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa3f0072980 con 0x7fa3f00a0a30 2023-09-30T22:34:50.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.355+0000 7fa3e7fff700 1 -- 172.21.15.59:0/858285032 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3d8021070 con 0x7fa3f00a0a30 2023-09-30T22:34:50.357 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:50.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.358+0000 7fa3f5eb4700 1 -- 172.21.15.59:0/858285032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3f00a0a30 msgr2=0x7fa3f0133d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.358+0000 7fa3f5eb4700 1 --2- 172.21.15.59:0/858285032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3f00a0a30 0x7fa3f0133d60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800e910 tx=0x7fa3d800ec20 comp rx=0 tx=0).stop 2023-09-30T22:34:50.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.358+0000 7fa3f5eb4700 1 -- 172.21.15.59:0/858285032 shutdown_connections 2023-09-30T22:34:50.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.358+0000 7fa3f5eb4700 1 --2- 172.21.15.59:0/858285032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3f0138d80 0x7fa3f01342a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.358+0000 7fa3f5eb4700 1 --2- 172.21.15.59:0/858285032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f009d630 0x7fa3f0133820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.358+0000 7fa3f5eb4700 1 --2- 172.21.15.59:0/858285032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3f00a0a30 0x7fa3f0133d60 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.358+0000 7fa3f5eb4700 1 -- 172.21.15.59:0/858285032 >> 172.21.15.59:0/858285032 conn(0x7fa3f00a3050 msgr2=0x7fa3f00a4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.358+0000 7fa3f5eb4700 1 -- 172.21.15.59:0/858285032 shutdown_connections 2023-09-30T22:34:50.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.358+0000 7fa3f5eb4700 1 -- 172.21.15.59:0/858285032 wait complete. 2023-09-30T22:34:50.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:50.466 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:50.467 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:50.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.610+0000 7fa29bec6700 1 Processor -- start 2023-09-30T22:34:50.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.610+0000 7fee0c1f6700 1 Processor -- start 2023-09-30T22:34:50.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.610+0000 7fa29bec6700 1 -- start start 2023-09-30T22:34:50.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.610+0000 7fee0c1f6700 1 -- start start 2023-09-30T22:34:50.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fa29bec6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2940a0a30 0x7fa2940a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fa29bec6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa29409d630 0x7fa2940a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fa29bec6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa294133930 0x7fa294133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fa29bec6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2940a2a70 con 0x7fa29409d630 2023-09-30T22:34:50.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fa29bec6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940a01d0 con 0x7fa2940a0a30 2023-09-30T22:34:50.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fa29bec6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa29409e2b0 con 0x7fa294133930 2023-09-30T22:34:50.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fee0c1f6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee041317f0 0x7fee04131bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fee0c1f6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fee0406b2d0 0x7fee04139510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fee0c1f6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0409d760 con 0x7fee0406a770 2023-09-30T22:34:50.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fee0c1f6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee04132100 con 0x7fee0406b2d0 2023-09-30T22:34:50.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fee0c1f6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee041313a0 con 0x7fee041317f0 2023-09-30T22:34:50.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fee09f92700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee041317f0 0x7fee04131bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fee09f92700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee041317f0 0x7fee04131bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54796/0 (socket says 172.21.15.59:54796) 2023-09-30T22:34:50.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fee09f92700 1 -- 172.21.15.59:0/985673567 learned_addr learned my addr 172.21.15.59:0/985673567 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fa299461700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa29409d630 0x7fa2940a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fa299461700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa29409d630 0x7fa2940a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39004/0 (socket says 172.21.15.59:39004) 2023-09-30T22:34:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fa29a463700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa294133930 0x7fa294133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fa299461700 1 -- 172.21.15.59:0/1591563669 learned_addr learned my addr 172.21.15.59:0/1591563669 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fa299c62700 1 --2- 172.21.15.59:0/1591563669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2940a0a30 0x7fa2940a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fee0a793700 1 --2- 172.21.15.59:0/985673567 >> v2:172.21.15.59:3300/0 conn(0x7fee0406b2d0 0x7fee04139510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fa29a463700 1 -- 172.21.15.59:0/1591563669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2940a0a30 msgr2=0x7fa2940a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:50.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fa29a463700 1 --2- 172.21.15.59:0/1591563669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2940a0a30 0x7fa2940a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fa29a463700 1 -- 172.21.15.59:0/1591563669 >> v2:172.21.15.59:3300/0 conn(0x7fa29409d630 msgr2=0x7fa2940a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:50.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.611+0000 7fa29a463700 1 --2- 172.21.15.59:0/1591563669 >> v2:172.21.15.59:3300/0 conn(0x7fa29409d630 0x7fa2940a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.612+0000 7fa29a463700 1 -- 172.21.15.59:0/1591563669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29409dc50 con 0x7fa294133930 2023-09-30T22:34:50.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.612+0000 7fa299c62700 1 --2- 172.21.15.59:0/1591563669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2940a0a30 0x7fa2940a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:50.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.612+0000 7fee0a793700 1 -- 172.21.15.59:0/985673567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee041317f0 msgr2=0x7fee04131bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:50.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.612+0000 7fee0a793700 1 --2- 172.21.15.59:0/985673567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee041317f0 0x7fee04131bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.612+0000 7fee0a793700 1 -- 172.21.15.59:0/985673567 >> v1:172.21.15.59:6789/0 conn(0x7fee0406a770 legacy=0x7fee0406abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.612+0000 7fee0a793700 1 -- 172.21.15.59:0/985673567 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0409e880 con 0x7fee0406b2d0 2023-09-30T22:34:50.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.612+0000 7fa29a463700 1 --2- 172.21.15.59:0/1591563669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa294133930 0x7fa294133dd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009d90 tx=0x7fa28c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a297aefa9e6577e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:50.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.612+0000 7fee0a793700 1 --2- 172.21.15.59:0/985673567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee0406b2d0 0x7fee04139510 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fedfc009d90 tx=0x7fedfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6731a10039f7725 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:50.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.612+0000 7fa298c60700 1 -- 172.21.15.59:0/1591563669 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00e070 con 0x7fa294133930 2023-09-30T22:34:50.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.612+0000 7fa298c60700 1 -- 172.21.15.59:0/1591563669 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c00bb20 con 0x7fa294133930 2023-09-30T22:34:50.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.612+0000 7fee08f90700 1 -- 172.21.15.59:0/985673567 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc00e070 con 0x7fee0406b2d0 2023-09-30T22:34:50.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.612+0000 7fa298c60700 1 -- 172.21.15.59:0/1591563669 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c012430 con 0x7fa294133930 2023-09-30T22:34:50.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.612+0000 7fee08f90700 1 -- 172.21.15.59:0/985673567 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc00bb20 con 0x7fee0406b2d0 2023-09-30T22:34:50.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.612+0000 7fee08f90700 1 -- 172.21.15.59:0/985673567 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc012430 con 0x7fee0406b2d0 2023-09-30T22:34:50.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fa29bec6700 1 -- 172.21.15.59:0/1591563669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa294133930 msgr2=0x7fa294133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fa29bec6700 1 --2- 172.21.15.59:0/1591563669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa294133930 0x7fa294133dd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009d90 tx=0x7fa28c00b330 comp rx=0 tx=0).stop 2023-09-30T22:34:50.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fee0c1f6700 1 -- 172.21.15.59:0/985673567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee0406b2d0 msgr2=0x7fee04139510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fee0c1f6700 1 --2- 172.21.15.59:0/985673567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee0406b2d0 0x7fee04139510 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fedfc009d90 tx=0x7fedfc00b330 comp rx=0 tx=0).stop 2023-09-30T22:34:50.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fa29bec6700 1 -- 172.21.15.59:0/1591563669 shutdown_connections 2023-09-30T22:34:50.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fa29bec6700 1 --2- 172.21.15.59:0/1591563669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa294133930 0x7fa294133dd0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fa29bec6700 1 --2- 172.21.15.59:0/1591563669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2940a0a30 0x7fa2940a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fa29bec6700 1 --2- 172.21.15.59:0/1591563669 >> v2:172.21.15.59:3300/0 conn(0x7fa29409d630 0x7fa2940a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fa29bec6700 1 -- 172.21.15.59:0/1591563669 >> 172.21.15.59:0/1591563669 conn(0x7fa2940a3050 msgr2=0x7fa2940a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:50.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fee0c1f6700 1 -- 172.21.15.59:0/985673567 shutdown_connections 2023-09-30T22:34:50.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fee0c1f6700 1 --2- 172.21.15.59:0/985673567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee0406b2d0 0x7fee04139510 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fee0c1f6700 1 --2- 172.21.15.59:0/985673567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee041317f0 0x7fee04131bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fee0c1f6700 1 -- 172.21.15.59:0/985673567 >> 172.21.15.59:0/985673567 conn(0x7fee04099c20 msgr2=0x7fee040a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:50.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fa29bec6700 1 -- 172.21.15.59:0/1591563669 shutdown_connections 2023-09-30T22:34:50.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fa29bec6700 1 -- 172.21.15.59:0/1591563669 wait complete. 2023-09-30T22:34:50.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fee0c1f6700 1 -- 172.21.15.59:0/985673567 shutdown_connections 2023-09-30T22:34:50.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.613+0000 7fee0c1f6700 1 -- 172.21.15.59:0/985673567 wait complete. 2023-09-30T22:34:50.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.614+0000 7fee0c1f6700 1 Processor -- start 2023-09-30T22:34:50.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.614+0000 7fa29bec6700 1 Processor -- start 2023-09-30T22:34:50.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.614+0000 7fa29bec6700 1 -- start start 2023-09-30T22:34:50.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.614+0000 7fee0c1f6700 1 -- start start 2023-09-30T22:34:50.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa29bec6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa29409d630 0x7fa294126020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa29bec6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2940a0a30 0x7fa294126560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fee0c1f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0406a770 0x7fee04070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa29bec6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa294133930 0x7fa294126aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa29bec6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa294127480 con 0x7fa29409d630 2023-09-30T22:34:50.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fee0c1f6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee0406b2d0 0x7fee04071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fee0c1f6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee041317f0 0x7fee040715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa29bec6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa294132c50 con 0x7fa294133930 2023-09-30T22:34:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa29bec6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2941297d0 con 0x7fa2940a0a30 2023-09-30T22:34:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fee0c1f6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee04072740 con 0x7fee041317f0 2023-09-30T22:34:50.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fee0c1f6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee04072550 con 0x7fee0406a770 2023-09-30T22:34:50.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fee0c1f6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee04071f00 con 0x7fee0406b2d0 2023-09-30T22:34:50.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa299c62700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa29409d630 0x7fa294126020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa299c62700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa29409d630 0x7fa294126020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39018/0 (socket says 172.21.15.59:39018) 2023-09-30T22:34:50.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa299c62700 1 -- 172.21.15.59:0/3381372751 learned_addr learned my addr 172.21.15.59:0/3381372751 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:50.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fee09f92700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0406a770 0x7fee04070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fee09f92700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0406a770 0x7fee04070b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39558/0 (socket says 172.21.15.59:39558) 2023-09-30T22:34:50.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fee09f92700 1 -- 172.21.15.59:0/1371234324 learned_addr learned my addr 172.21.15.59:0/1371234324 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:50.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa299461700 1 --2- 172.21.15.59:0/3381372751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2940a0a30 0x7fa294126560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa29a463700 1 --2- 172.21.15.59:0/3381372751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa294133930 0x7fa294126aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa299c62700 1 -- 172.21.15.59:0/3381372751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2940a0a30 msgr2=0x7fa294126560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa299c62700 1 --2- 172.21.15.59:0/3381372751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2940a0a30 0x7fa294126560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa299c62700 1 -- 172.21.15.59:0/3381372751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa294133930 msgr2=0x7fa294126aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa299c62700 1 --2- 172.21.15.59:0/3381372751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa294133930 0x7fa294126aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fa299c62700 1 -- 172.21.15.59:0/3381372751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900094a0 con 0x7fa29409d630 2023-09-30T22:34:50.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fee0a793700 1 --2- 172.21.15.59:0/1371234324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee041317f0 0x7fee040715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:50.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fee09f92700 1 -- 172.21.15.59:0/1371234324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee0406b2d0 msgr2=0x7fee04071070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:34:50.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fee09f92700 1 --2- 172.21.15.59:0/1371234324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee0406b2d0 0x7fee04071070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fee09f92700 1 -- 172.21.15.59:0/1371234324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee041317f0 msgr2=0x7fee040715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fee09f92700 1 --2- 172.21.15.59:0/1371234324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee041317f0 0x7fee040715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.615+0000 7fee09f92700 1 -- 172.21.15.59:0/1371234324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc009a70 con 0x7fee0406a770 2023-09-30T22:34:50.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.616+0000 7fee0a793700 1 --2- 172.21.15.59:0/1371234324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee041317f0 0x7fee040715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:34:50.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.616+0000 7fa299c62700 1 --2- 172.21.15.59:0/3381372751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa29409d630 0x7fa294126020 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fa29000ebe0 tx=0x7fa29000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:50.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.616+0000 7fee09f92700 1 --2- 172.21.15.59:0/1371234324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0406a770 0x7fee04070b30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fee0000e910 tx=0x7fee0000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:50.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.616+0000 7fa28a7fc700 1 -- 172.21.15.59:0/3381372751 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29000c850 con 0x7fa29409d630 2023-09-30T22:34:50.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.616+0000 7fa28a7fc700 1 -- 172.21.15.59:0/3381372751 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29000c9b0 con 0x7fa29409d630 2023-09-30T22:34:50.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.616+0000 7fa29bec6700 1 -- 172.21.15.59:0/3381372751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28c009a70 con 0x7fa29409d630 2023-09-30T22:34:50.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.616+0000 7fedfa7fc700 1 -- 172.21.15.59:0/1371234324 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee000096a0 con 0x7fee0406a770 2023-09-30T22:34:50.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.616+0000 7fa28a7fc700 1 -- 172.21.15.59:0/3381372751 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29000cd40 con 0x7fa29409d630 2023-09-30T22:34:50.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.616+0000 7fa29bec6700 1 -- 172.21.15.59:0/3381372751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa294127980 con 0x7fa29409d630 2023-09-30T22:34:50.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.616+0000 7fedfa7fc700 1 -- 172.21.15.59:0/1371234324 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0000c850 con 0x7fee0406a770 2023-09-30T22:34:50.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.616+0000 7fedfa7fc700 1 -- 172.21.15.59:0/1371234324 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0000cc00 con 0x7fee0406a770 2023-09-30T22:34:50.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.616+0000 7fee0c1f6700 1 -- 172.21.15.59:0/1371234324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0411af00 con 0x7fee0406a770 2023-09-30T22:34:50.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.616+0000 7fee0c1f6700 1 -- 172.21.15.59:0/1371234324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0412b8a0 con 0x7fee0406a770 2023-09-30T22:34:50.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.617+0000 7fa28a7fc700 1 -- 172.21.15.59:0/3381372751 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa290013470 con 0x7fa29409d630 2023-09-30T22:34:50.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.617+0000 7fa28a7fc700 1 -- 172.21.15.59:0/3381372751 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa29003f750 con 0x7fa29409d630 2023-09-30T22:34:50.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.617+0000 7fa29bec6700 1 -- 172.21.15.59:0/3381372751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2940747f0 con 0x7fa29409d630 2023-09-30T22:34:50.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.617+0000 7fedfa7fc700 1 -- 172.21.15.59:0/1371234324 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee0000cd60 con 0x7fee0406a770 2023-09-30T22:34:50.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.617+0000 7fee0c1f6700 1 -- 172.21.15.59:0/1371234324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedec0052e0 con 0x7fee0406a770 2023-09-30T22:34:50.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.618+0000 7fedfa7fc700 1 -- 172.21.15.59:0/1371234324 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fee0003f740 con 0x7fee0406a770 2023-09-30T22:34:50.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.626+0000 7fa28a7fc700 1 -- 172.21.15.59:0/3381372751 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa290013720 con 0x7fa29409d630 2023-09-30T22:34:50.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.627+0000 7fedfa7fc700 1 -- 172.21.15.59:0/1371234324 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee000232f0 con 0x7fee0406a770 2023-09-30T22:34:50.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.829+0000 7fa29bec6700 1 -- 172.21.15.59:0/3381372751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa294071d90 con 0x7fa29409d630 2023-09-30T22:34:50.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.830+0000 7fa28a7fc700 1 -- 172.21.15.59:0/3381372751 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa29001bba0 con 0x7fa29409d630 2023-09-30T22:34:50.830 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:50.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.831+0000 7fee0c1f6700 1 -- 172.21.15.59:0/1371234324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fedec005590 con 0x7fee0406a770 2023-09-30T22:34:50.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.832+0000 7fedfa7fc700 1 -- 172.21.15.59:0/1371234324 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee00021070 con 0x7fee0406a770 2023-09-30T22:34:50.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.832+0000 7fa29bec6700 1 -- 172.21.15.59:0/3381372751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa29409d630 msgr2=0x7fa294126020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.832+0000 7fa29bec6700 1 --2- 172.21.15.59:0/3381372751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa29409d630 0x7fa294126020 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fa29000ebe0 tx=0x7fa29000eef0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.833 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:50.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.832+0000 7fa29bec6700 1 -- 172.21.15.59:0/3381372751 shutdown_connections 2023-09-30T22:34:50.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.832+0000 7fa29bec6700 1 --2- 172.21.15.59:0/3381372751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa294133930 0x7fa294126aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.832+0000 7fa29bec6700 1 --2- 172.21.15.59:0/3381372751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa29409d630 0x7fa294126020 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.832+0000 7fa29bec6700 1 --2- 172.21.15.59:0/3381372751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2940a0a30 0x7fa294126560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.832+0000 7fa29bec6700 1 -- 172.21.15.59:0/3381372751 >> 172.21.15.59:0/3381372751 conn(0x7fa2940a3050 msgr2=0x7fa29409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:50.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.832+0000 7fa29bec6700 1 -- 172.21.15.59:0/3381372751 shutdown_connections 2023-09-30T22:34:50.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.832+0000 7fa29bec6700 1 -- 172.21.15.59:0/3381372751 wait complete. 2023-09-30T22:34:50.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.835+0000 7fee0c1f6700 1 -- 172.21.15.59:0/1371234324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0406a770 msgr2=0x7fee04070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:50.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.835+0000 7fee0c1f6700 1 --2- 172.21.15.59:0/1371234324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0406a770 0x7fee04070b30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fee0000e910 tx=0x7fee0000ecd0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.835+0000 7fee0c1f6700 1 -- 172.21.15.59:0/1371234324 shutdown_connections 2023-09-30T22:34:50.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.835+0000 7fee0c1f6700 1 --2- 172.21.15.59:0/1371234324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee041317f0 0x7fee040715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.835+0000 7fee0c1f6700 1 --2- 172.21.15.59:0/1371234324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0406a770 0x7fee04070b30 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.835+0000 7fee0c1f6700 1 --2- 172.21.15.59:0/1371234324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee0406b2d0 0x7fee04071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:50.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.835+0000 7fee0c1f6700 1 -- 172.21.15.59:0/1371234324 >> 172.21.15.59:0/1371234324 conn(0x7fee04099c20 msgr2=0x7fee040a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:50.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.835+0000 7fee0c1f6700 1 -- 172.21.15.59:0/1371234324 shutdown_connections 2023-09-30T22:34:50.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:50.835+0000 7fee0c1f6700 1 -- 172.21.15.59:0/1371234324 wait complete. 2023-09-30T22:34:50.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:50.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:51.335 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:51.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:51.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.485+0000 7fd12cd3a700 1 Processor -- start 2023-09-30T22:34:51.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.485+0000 7fd12cd3a700 1 -- start start 2023-09-30T22:34:51.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.486+0000 7fd12cd3a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd1280a0a30 0x7fd1280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.486+0000 7fd12cd3a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1280a1340 0x7fd128133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.486+0000 7fd12cd3a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd128133fa0 0x7fd128134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.486+0000 7fd12cd3a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12809edd0 con 0x7fd1280a0a30 2023-09-30T22:34:51.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.486+0000 7fd12cd3a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12809e1f0 con 0x7fd128133fa0 2023-09-30T22:34:51.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.486+0000 7fd12cd3a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd12809dc50 con 0x7fd1280a1340 2023-09-30T22:34:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.486+0000 7fd12659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd1280a0a30 0x7fd1280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.486+0000 7fd125d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1280a1340 0x7fd128133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.486+0000 7fd12659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd1280a0a30 0x7fd1280a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39042/0 (socket says 172.21.15.59:39042) 2023-09-30T22:34:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.486+0000 7fd12659c700 1 -- 172.21.15.59:0/1693223822 learned_addr learned my addr 172.21.15.59:0/1693223822 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.486+0000 7fd126d9d700 1 --2- 172.21.15.59:0/1693223822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd128133fa0 0x7fd128134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:51.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.487+0000 7fd12659c700 1 -- 172.21.15.59:0/1693223822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1280a1340 msgr2=0x7fd128133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:51.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.487+0000 7fd12659c700 1 --2- 172.21.15.59:0/1693223822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1280a1340 0x7fd128133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.487+0000 7fd12659c700 1 -- 172.21.15.59:0/1693223822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd128133fa0 msgr2=0x7fd128134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:51.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.487+0000 7fd12659c700 1 --2- 172.21.15.59:0/1693223822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd128133fa0 0x7fd128134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.487+0000 7fd12659c700 1 -- 172.21.15.59:0/1693223822 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1280a1fe0 con 0x7fd1280a0a30 2023-09-30T22:34:51.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.487+0000 7fd125d9b700 1 --2- 172.21.15.59:0/1693223822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1280a1340 0x7fd128133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:51.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.487+0000 7fd126d9d700 1 --2- 172.21.15.59:0/1693223822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd128133fa0 0x7fd128134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:51.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.487+0000 7fd12659c700 1 --2- 172.21.15.59:0/1693223822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1280a0a30 0x7fd1280a0e00 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fd118009e50 tx=0x7fd11800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f89caf4a0b06bd3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:51.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.487+0000 7fd12559a700 1 -- 172.21.15.59:0/1693223822 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11800e070 con 0x7fd1280a0a30 2023-09-30T22:34:51.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.487+0000 7fd12559a700 1 -- 172.21.15.59:0/1693223822 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11800b910 con 0x7fd1280a0a30 2023-09-30T22:34:51.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.487+0000 7fd12559a700 1 -- 172.21.15.59:0/1693223822 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11800bcc0 con 0x7fd1280a0a30 2023-09-30T22:34:51.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.488+0000 7fd12cd3a700 1 -- 172.21.15.59:0/1693223822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1280a0a30 msgr2=0x7fd1280a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:51.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.488+0000 7fd12cd3a700 1 --2- 172.21.15.59:0/1693223822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1280a0a30 0x7fd1280a0e00 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fd118009e50 tx=0x7fd11800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:51.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.488+0000 7fd12cd3a700 1 -- 172.21.15.59:0/1693223822 shutdown_connections 2023-09-30T22:34:51.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.488+0000 7fd12cd3a700 1 --2- 172.21.15.59:0/1693223822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd128133fa0 0x7fd128134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.488+0000 7fd12cd3a700 1 --2- 172.21.15.59:0/1693223822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1280a0a30 0x7fd1280a0e00 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.488+0000 7fd12cd3a700 1 --2- 172.21.15.59:0/1693223822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1280a1340 0x7fd128133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.488+0000 7fd12cd3a700 1 -- 172.21.15.59:0/1693223822 >> 172.21.15.59:0/1693223822 conn(0x7fd1280a6550 msgr2=0x7fd1280a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:51.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.488+0000 7fd12cd3a700 1 -- 172.21.15.59:0/1693223822 shutdown_connections 2023-09-30T22:34:51.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.488+0000 7fd12cd3a700 1 -- 172.21.15.59:0/1693223822 wait complete. 2023-09-30T22:34:51.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.489+0000 7fd12cd3a700 1 Processor -- start 2023-09-30T22:34:51.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.489+0000 7fd12cd3a700 1 -- start start 2023-09-30T22:34:51.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd12cd3a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1280a0a30 0x7fd128120400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd12cd3a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1280a1340 0x7fd128120940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd12cd3a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd128133fa0 0x7fd128120e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd12cd3a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1281337a0 con 0x7fd128133fa0 2023-09-30T22:34:51.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd12cd3a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd128123210 con 0x7fd1280a0a30 2023-09-30T22:34:51.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd12cd3a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd128123bf0 con 0x7fd1280a1340 2023-09-30T22:34:51.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd125d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1280a1340 0x7fd128120940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:51.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd125d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1280a1340 0x7fd128120940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54838/0 (socket says 172.21.15.59:54838) 2023-09-30T22:34:51.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd125d9b700 1 -- 172.21.15.59:0/1653922530 learned_addr learned my addr 172.21.15.59:0/1653922530 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:51.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd126d9d700 1 --2- 172.21.15.59:0/1653922530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd128133fa0 0x7fd128120e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:51.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd12659c700 1 --2- 172.21.15.59:0/1653922530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1280a0a30 0x7fd128120400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:51.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd125d9b700 1 -- 172.21.15.59:0/1653922530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1280a0a30 msgr2=0x7fd128120400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:51.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd125d9b700 1 --2- 172.21.15.59:0/1653922530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1280a0a30 0x7fd128120400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd125d9b700 1 -- 172.21.15.59:0/1653922530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd128133fa0 msgr2=0x7fd128120e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd125d9b700 1 --2- 172.21.15.59:0/1653922530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd128133fa0 0x7fd128120e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd125d9b700 1 -- 172.21.15.59:0/1653922530 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1100094a0 con 0x7fd1280a1340 2023-09-30T22:34:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd126d9d700 1 --2- 172.21.15.59:0/1653922530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd128133fa0 0x7fd128120e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.490+0000 7fd125d9b700 1 --2- 172.21.15.59:0/1653922530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1280a1340 0x7fd128120940 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd11000ebe0 tx=0x7fd11000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.491+0000 7fd11effd700 1 -- 172.21.15.59:0/1653922530 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd110009800 con 0x7fd1280a1340 2023-09-30T22:34:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.491+0000 7fd11effd700 1 -- 172.21.15.59:0/1653922530 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11000c850 con 0x7fd1280a1340 2023-09-30T22:34:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.491+0000 7fd12cd3a700 1 -- 172.21.15.59:0/1653922530 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1200094a0 con 0x7fd1280a1340 2023-09-30T22:34:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.491+0000 7fd11effd700 1 -- 172.21.15.59:0/1653922530 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11000cbc0 con 0x7fd1280a1340 2023-09-30T22:34:51.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.491+0000 7fd12cd3a700 1 -- 172.21.15.59:0/1653922530 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd118009b30 con 0x7fd1280a1340 2023-09-30T22:34:51.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.491+0000 7fd11effd700 1 -- 172.21.15.59:0/1653922530 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd11000cd20 con 0x7fd1280a1340 2023-09-30T22:34:51.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.492+0000 7fd11effd700 1 -- 172.21.15.59:0/1653922530 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd11003fb50 con 0x7fd1280a1340 2023-09-30T22:34:51.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.492+0000 7fd12cd3a700 1 -- 172.21.15.59:0/1653922530 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1280a3470 con 0x7fd1280a1340 2023-09-30T22:34:51.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.497+0000 7fd11effd700 1 -- 172.21.15.59:0/1653922530 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd11001a9b0 con 0x7fd1280a1340 2023-09-30T22:34:51.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.535+0000 7f2e1175e700 1 Processor -- start 2023-09-30T22:34:51.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.535+0000 7f2e1175e700 1 -- start start 2023-09-30T22:34:51.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.535+0000 7f2e1175e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0c0a09c0 0x7f2e0c0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e1175e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0c09d5c0 0x7f2e0c0a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e1175e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e0c133920 0x7f2e0c133d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e1175e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0c0a1810 con 0x7f2e0c133920 2023-09-30T22:34:51.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e1175e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c09ea10 con 0x7f2e0c09d5c0 2023-09-30T22:34:51.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e1175e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c09e210 con 0x7f2e0c0a09c0 2023-09-30T22:34:51.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e0affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0c0a09c0 0x7f2e0c0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:51.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e0a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0c09d5c0 0x7f2e0c0a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:51.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e0a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0c09d5c0 0x7f2e0c0a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39580/0 (socket says 172.21.15.59:39580) 2023-09-30T22:34:51.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e0affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0c0a09c0 0x7f2e0c0a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54854/0 (socket says 172.21.15.59:54854) 2023-09-30T22:34:51.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e0a7fc700 1 -- 172.21.15.59:0/1477913993 learned_addr learned my addr 172.21.15.59:0/1477913993 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:51.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e0b7fe700 1 --2- 172.21.15.59:0/1477913993 >> v2:172.21.15.59:3300/0 conn(0x7f2e0c133920 0x7f2e0c133d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:51.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e0affd700 1 -- 172.21.15.59:0/1477913993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0c09d5c0 msgr2=0x7f2e0c0a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:51.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e0affd700 1 --2- 172.21.15.59:0/1477913993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0c09d5c0 0x7f2e0c0a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e0affd700 1 -- 172.21.15.59:0/1477913993 >> v2:172.21.15.59:3300/0 conn(0x7f2e0c133920 msgr2=0x7f2e0c133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:51.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e0affd700 1 --2- 172.21.15.59:0/1477913993 >> v2:172.21.15.59:3300/0 conn(0x7f2e0c133920 0x7f2e0c133d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e0affd700 1 -- 172.21.15.59:0/1477913993 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c0a26f0 con 0x7f2e0c0a09c0 2023-09-30T22:34:51.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e0b7fe700 1 --2- 172.21.15.59:0/1477913993 >> v2:172.21.15.59:3300/0 conn(0x7f2e0c133920 0x7f2e0c133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:51.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e0a7fc700 1 --2- 172.21.15.59:0/1477913993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0c09d5c0 0x7f2e0c0a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:51.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.536+0000 7f2e0affd700 1 --2- 172.21.15.59:0/1477913993 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0c0a09c0 0x7f2e0c0a0d90 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009d90 tx=0x7f2dfc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e90ee1d9fbea017 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:51.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.537+0000 7f2e09ffb700 1 -- 172.21.15.59:0/1477913993 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc00e070 con 0x7f2e0c0a09c0 2023-09-30T22:34:51.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.537+0000 7f2e09ffb700 1 -- 172.21.15.59:0/1477913993 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc00bb20 con 0x7f2e0c0a09c0 2023-09-30T22:34:51.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.537+0000 7f2e09ffb700 1 -- 172.21.15.59:0/1477913993 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc012430 con 0x7f2e0c0a09c0 2023-09-30T22:34:51.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.537+0000 7f2e1175e700 1 -- 172.21.15.59:0/1477913993 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0c0a09c0 msgr2=0x7f2e0c0a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:51.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.537+0000 7f2e1175e700 1 --2- 172.21.15.59:0/1477913993 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0c0a09c0 0x7f2e0c0a0d90 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009d90 tx=0x7f2dfc00b330 comp rx=0 tx=0).stop 2023-09-30T22:34:51.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.537+0000 7f2e1175e700 1 -- 172.21.15.59:0/1477913993 shutdown_connections 2023-09-30T22:34:51.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.537+0000 7f2e1175e700 1 --2- 172.21.15.59:0/1477913993 >> v2:172.21.15.59:3300/0 conn(0x7f2e0c133920 0x7f2e0c133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.537+0000 7f2e1175e700 1 --2- 172.21.15.59:0/1477913993 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0c0a09c0 0x7f2e0c0a0d90 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.537+0000 7f2e1175e700 1 --2- 172.21.15.59:0/1477913993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0c09d5c0 0x7f2e0c0a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.537+0000 7f2e1175e700 1 -- 172.21.15.59:0/1477913993 >> 172.21.15.59:0/1477913993 conn(0x7f2e0c0a2fe0 msgr2=0x7f2e0c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:51.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.538+0000 7f2e1175e700 1 -- 172.21.15.59:0/1477913993 shutdown_connections 2023-09-30T22:34:51.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.538+0000 7f2e1175e700 1 -- 172.21.15.59:0/1477913993 wait complete. 2023-09-30T22:34:51.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.539+0000 7f2e1175e700 1 Processor -- start 2023-09-30T22:34:51.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.539+0000 7f2e1175e700 1 -- start start 2023-09-30T22:34:51.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.540+0000 7f2e1175e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0c09d5c0 0x7f2e0c121190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.540+0000 7f2e1175e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0c0a09c0 0x7f2e0c1216d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.540+0000 7f2e1175e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e0c133920 0x7f2e0c121c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.540+0000 7f2e1175e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c124ab0 con 0x7f2e0c133920 2023-09-30T22:34:51.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.540+0000 7f2e1175e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c124710 con 0x7f2e0c0a09c0 2023-09-30T22:34:51.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.540+0000 7f2e1175e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c124cb0 con 0x7f2e0c09d5c0 2023-09-30T22:34:51.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.540+0000 7f2e0affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0c09d5c0 0x7f2e0c121190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:51.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.540+0000 7f2e0affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0c09d5c0 0x7f2e0c121190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54862/0 (socket says 172.21.15.59:54862) 2023-09-30T22:34:51.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.540+0000 7f2e0affd700 1 -- 172.21.15.59:0/3403968360 learned_addr learned my addr 172.21.15.59:0/3403968360 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:51.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.540+0000 7f2e0affd700 1 -- 172.21.15.59:0/3403968360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0c0a09c0 msgr2=0x7f2e0c1216d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:51.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.540+0000 7f2e0affd700 1 --2- 172.21.15.59:0/3403968360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0c0a09c0 0x7f2e0c1216d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.540+0000 7f2e0affd700 1 -- 172.21.15.59:0/3403968360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e0c133920 msgr2=0x7f2e0c121c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:51.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.540+0000 7f2e0affd700 1 --2- 172.21.15.59:0/3403968360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e0c133920 0x7f2e0c121c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.540+0000 7f2e0affd700 1 -- 172.21.15.59:0/3403968360 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df4009550 con 0x7f2e0c09d5c0 2023-09-30T22:34:51.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.541+0000 7f2e0affd700 1 --2- 172.21.15.59:0/3403968360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0c09d5c0 0x7f2e0c121190 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c09e350 tx=0x7f2dfc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:51.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.541+0000 7f2e037fe700 1 -- 172.21.15.59:0/3403968360 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc012430 con 0x7f2e0c09d5c0 2023-09-30T22:34:51.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.541+0000 7f2e037fe700 1 -- 172.21.15.59:0/3403968360 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc020070 con 0x7f2e0c09d5c0 2023-09-30T22:34:51.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.541+0000 7f2e1175e700 1 -- 172.21.15.59:0/3403968360 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e040094a0 con 0x7f2e0c09d5c0 2023-09-30T22:34:51.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.541+0000 7f2e037fe700 1 -- 172.21.15.59:0/3403968360 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0042a0 con 0x7f2e0c09d5c0 2023-09-30T22:34:51.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.541+0000 7f2e1175e700 1 -- 172.21.15.59:0/3403968360 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dfc009a70 con 0x7f2e0c09d5c0 2023-09-30T22:34:51.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.542+0000 7f2e037fe700 1 -- 172.21.15.59:0/3403968360 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2dfc004400 con 0x7f2e0c09d5c0 2023-09-30T22:34:51.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.542+0000 7f2e037fe700 1 -- 172.21.15.59:0/3403968360 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2dfc022070 con 0x7f2e0c09d5c0 2023-09-30T22:34:51.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.542+0000 7f2e1175e700 1 -- 172.21.15.59:0/3403968360 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0c11df50 con 0x7f2e0c09d5c0 2023-09-30T22:34:51.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.547+0000 7f2e037fe700 1 -- 172.21.15.59:0/3403968360 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2dfc01c400 con 0x7f2e0c09d5c0 2023-09-30T22:34:51.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.717+0000 7fd12cd3a700 1 -- 172.21.15.59:0/1653922530 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd1280a5360 con 0x7fd1280a1340 2023-09-30T22:34:51.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.717+0000 7fd11effd700 1 -- 172.21.15.59:0/1653922530 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd110021030 con 0x7fd1280a1340 2023-09-30T22:34:51.718 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.721+0000 7fd12cd3a700 1 -- 172.21.15.59:0/1653922530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1280a1340 msgr2=0x7fd128120940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.721+0000 7fd12cd3a700 1 --2- 172.21.15.59:0/1653922530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1280a1340 0x7fd128120940 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd11000ebe0 tx=0x7fd11000eef0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.721+0000 7fd12cd3a700 1 -- 172.21.15.59:0/1653922530 shutdown_connections 2023-09-30T22:34:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.721+0000 7fd12cd3a700 1 --2- 172.21.15.59:0/1653922530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd128133fa0 0x7fd128120e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.721+0000 7fd12cd3a700 1 --2- 172.21.15.59:0/1653922530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1280a0a30 0x7fd128120400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.721+0000 7fd12cd3a700 1 --2- 172.21.15.59:0/1653922530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1280a1340 0x7fd128120940 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.721+0000 7fd12cd3a700 1 -- 172.21.15.59:0/1653922530 >> 172.21.15.59:0/1653922530 conn(0x7fd1280a6550 msgr2=0x7fd1281bafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.721+0000 7fd12cd3a700 1 -- 172.21.15.59:0/1653922530 shutdown_connections 2023-09-30T22:34:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.721+0000 7fd12cd3a700 1 -- 172.21.15.59:0/1653922530 wait complete. 2023-09-30T22:34:51.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:51.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.761+0000 7f2e1175e700 1 -- 172.21.15.59:0/3403968360 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2e0c0a4000 con 0x7f2e0c09d5c0 2023-09-30T22:34:51.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.761+0000 7f2e037fe700 1 -- 172.21.15.59:0/3403968360 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2dfc035090 con 0x7f2e0c09d5c0 2023-09-30T22:34:51.762 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:51.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.763+0000 7f2e1175e700 1 -- 172.21.15.59:0/3403968360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0c09d5c0 msgr2=0x7f2e0c121190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:51.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.763+0000 7f2e1175e700 1 --2- 172.21.15.59:0/3403968360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0c09d5c0 0x7f2e0c121190 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c09e350 tx=0x7f2dfc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.764+0000 7f2e1175e700 1 -- 172.21.15.59:0/3403968360 shutdown_connections 2023-09-30T22:34:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.764+0000 7f2e1175e700 1 --2- 172.21.15.59:0/3403968360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0c09d5c0 0x7f2e0c121190 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.764+0000 7f2e1175e700 1 --2- 172.21.15.59:0/3403968360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e0c133920 0x7f2e0c121c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.764+0000 7f2e1175e700 1 --2- 172.21.15.59:0/3403968360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0c0a09c0 0x7f2e0c1216d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.764+0000 7f2e1175e700 1 -- 172.21.15.59:0/3403968360 >> 172.21.15.59:0/3403968360 conn(0x7f2e0c0a2fe0 msgr2=0x7f2e0c133130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.764+0000 7f2e1175e700 1 -- 172.21.15.59:0/3403968360 shutdown_connections 2023-09-30T22:34:51.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.764+0000 7f2e1175e700 1 -- 172.21.15.59:0/3403968360 wait complete. 2023-09-30T22:34:51.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:51.855 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:51.855 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:51.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.997+0000 7fe64f67f700 1 Processor -- start 2023-09-30T22:34:51.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.997+0000 7fb6e97d7700 1 Processor -- start 2023-09-30T22:34:51.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.997+0000 7fb6e97d7700 1 -- start start 2023-09-30T22:34:51.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.997+0000 7fe64f67f700 1 -- start start 2023-09-30T22:34:51.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.997+0000 7fb6e97d7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6e41338a0 0x7fb6e4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.997+0000 7fb6e97d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e409de50 0x7fb6e409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.997+0000 7fb6e97d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e409e760 0x7fb6e413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.997+0000 7fe64f67f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64809d6f0 0x7fe64809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:51.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fb6e97d7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e406fef0 con 0x7fb6e41338a0 2023-09-30T22:34:51.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fb6e97d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e406ef30 con 0x7fb6e409de50 2023-09-30T22:34:51.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fb6e97d7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e41334b0 con 0x7fb6e409e760 2023-09-30T22:34:52.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fe64f67f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe64809e410 0x7fe648130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fe64f67f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64809f130 con 0x7fe64809e000 2023-09-30T22:34:52.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fe64f67f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64809f520 con 0x7fe64809e410 2023-09-30T22:34:52.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fe64f67f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64809e930 con 0x7fe64809d6f0 2023-09-30T22:34:52.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fb6e2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6e41338a0 0x7fb6e4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fb6e2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6e41338a0 0x7fb6e4133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39088/0 (socket says 172.21.15.59:39088) 2023-09-30T22:34:52.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fe64dc1c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe64809e410 0x7fe648130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fe64dc1c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe64809e410 0x7fe648130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39102/0 (socket says 172.21.15.59:39102) 2023-09-30T22:34:52.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fe64dc1c700 1 -- 172.21.15.59:0/1542635152 learned_addr learned my addr 172.21.15.59:0/1542635152 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:52.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fb6e2ffd700 1 -- 172.21.15.59:0/2225102321 learned_addr learned my addr 172.21.15.59:0/2225102321 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:52.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fe64d41b700 1 --2- 172.21.15.59:0/1542635152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64809d6f0 0x7fe64809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fb6e27fc700 1 --2- 172.21.15.59:0/2225102321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e409de50 0x7fb6e409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fb6e37fe700 1 --2- 172.21.15.59:0/2225102321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e409e760 0x7fb6e413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fe64dc1c700 1 -- 172.21.15.59:0/1542635152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64809d6f0 msgr2=0x7fe64809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:52.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fe64dc1c700 1 --2- 172.21.15.59:0/1542635152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64809d6f0 0x7fe64809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fe64dc1c700 1 -- 172.21.15.59:0/1542635152 >> v1:172.21.15.59:6789/0 conn(0x7fe64809e000 legacy=0x7fe648130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fe64dc1c700 1 -- 172.21.15.59:0/1542635152 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64809b2d0 con 0x7fe64809e410 2023-09-30T22:34:52.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fb6e27fc700 1 -- 172.21.15.59:0/2225102321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e409e760 msgr2=0x7fb6e413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:52.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fb6e27fc700 1 --2- 172.21.15.59:0/2225102321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e409e760 0x7fb6e413a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fb6e27fc700 1 -- 172.21.15.59:0/2225102321 >> v2:172.21.15.59:3300/0 conn(0x7fb6e41338a0 msgr2=0x7fb6e4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:52.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fb6e27fc700 1 --2- 172.21.15.59:0/2225102321 >> v2:172.21.15.59:3300/0 conn(0x7fb6e41338a0 0x7fb6e4133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fb6e27fc700 1 -- 172.21.15.59:0/2225102321 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e406fc30 con 0x7fb6e409de50 2023-09-30T22:34:52.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fb6e2ffd700 1 --2- 172.21.15.59:0/2225102321 >> v2:172.21.15.59:3300/0 conn(0x7fb6e41338a0 0x7fb6e4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:52.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.998+0000 7fb6e37fe700 1 --2- 172.21.15.59:0/2225102321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e409e760 0x7fb6e413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:52.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.999+0000 7fe64dc1c700 1 --2- 172.21.15.59:0/1542635152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64809e410 0x7fe648130d70 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fe640009e50 tx=0x7fe64000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6abc307d27692f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:52.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.999+0000 7fb6e27fc700 1 --2- 172.21.15.59:0/2225102321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e409de50 0x7fb6e409e220 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009840 tx=0x7fb6d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ba2a877593b8fb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:52.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.999+0000 7fe63ffff700 1 -- 172.21.15.59:0/1542635152 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64000bb10 con 0x7fe64809e410 2023-09-30T22:34:52.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.999+0000 7fe63ffff700 1 -- 172.21.15.59:0/1542635152 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64000bc70 con 0x7fe64809e410 2023-09-30T22:34:52.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.999+0000 7fe63ffff700 1 -- 172.21.15.59:0/1542635152 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640011460 con 0x7fe64809e410 2023-09-30T22:34:52.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.999+0000 7fb6e1ffb700 1 -- 172.21.15.59:0/2225102321 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8011830 con 0x7fb6e409de50 2023-09-30T22:34:52.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.999+0000 7fb6e1ffb700 1 -- 172.21.15.59:0/2225102321 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d8011990 con 0x7fb6e409de50 2023-09-30T22:34:52.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:51.999+0000 7fb6e1ffb700 1 -- 172.21.15.59:0/2225102321 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8011d20 con 0x7fb6e409de50 2023-09-30T22:34:52.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fe64f67f700 1 -- 172.21.15.59:0/1542635152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64809e410 msgr2=0x7fe648130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fe64f67f700 1 --2- 172.21.15.59:0/1542635152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64809e410 0x7fe648130d70 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fe640009e50 tx=0x7fe64000b330 comp rx=0 tx=0).stop 2023-09-30T22:34:52.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fb6e97d7700 1 -- 172.21.15.59:0/2225102321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e409de50 msgr2=0x7fb6e409e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fb6e97d7700 1 --2- 172.21.15.59:0/2225102321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e409de50 0x7fb6e409e220 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009840 tx=0x7fb6d8009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fe64f67f700 1 -- 172.21.15.59:0/1542635152 shutdown_connections 2023-09-30T22:34:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fe64f67f700 1 --2- 172.21.15.59:0/1542635152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64809e410 0x7fe648130d70 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fe64f67f700 1 --2- 172.21.15.59:0/1542635152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64809d6f0 0x7fe64809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fe64f67f700 1 -- 172.21.15.59:0/1542635152 >> 172.21.15.59:0/1542635152 conn(0x7fe648066f50 msgr2=0x7fe64809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fb6e97d7700 1 -- 172.21.15.59:0/2225102321 shutdown_connections 2023-09-30T22:34:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fb6e97d7700 1 --2- 172.21.15.59:0/2225102321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e409e760 0x7fb6e413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fb6e97d7700 1 --2- 172.21.15.59:0/2225102321 >> v2:172.21.15.59:3300/0 conn(0x7fb6e41338a0 0x7fb6e4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fb6e97d7700 1 --2- 172.21.15.59:0/2225102321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e409de50 0x7fb6e409e220 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fb6e97d7700 1 -- 172.21.15.59:0/2225102321 >> 172.21.15.59:0/2225102321 conn(0x7fb6e40a2aa0 msgr2=0x7fb6e40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:52.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fe64f67f700 1 -- 172.21.15.59:0/1542635152 shutdown_connections 2023-09-30T22:34:52.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fb6e97d7700 1 -- 172.21.15.59:0/2225102321 shutdown_connections 2023-09-30T22:34:52.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fe64f67f700 1 -- 172.21.15.59:0/1542635152 wait complete. 2023-09-30T22:34:52.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.000+0000 7fb6e97d7700 1 -- 172.21.15.59:0/2225102321 wait complete. 2023-09-30T22:34:52.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.001+0000 7fe64f67f700 1 Processor -- start 2023-09-30T22:34:52.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.001+0000 7fe64f67f700 1 -- start start 2023-09-30T22:34:52.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fb6e97d7700 1 Processor -- start 2023-09-30T22:34:52.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fb6e97d7700 1 -- start start 2023-09-30T22:34:52.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fe64f67f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64809d6f0 0x7fe64811df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fe64f67f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64809e000 0x7fe64811e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fe64f67f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64809e410 0x7fe64811e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fe64f67f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe648121a80 con 0x7fe64809e410 2023-09-30T22:34:52.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fe64f67f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe648120e50 con 0x7fe64809d6f0 2023-09-30T22:34:52.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fe64f67f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe64809c700 con 0x7fe64809e000 2023-09-30T22:34:52.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fb6e97d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e409de50 0x7fb6e411b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fb6e97d7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e409e760 0x7fb6e411bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fb6e97d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e41338a0 0x7fb6e411c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fb6e97d7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e411ef60 con 0x7fb6e409e760 2023-09-30T22:34:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fb6e97d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e406f640 con 0x7fb6e409de50 2023-09-30T22:34:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fb6e97d7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e411d280 con 0x7fb6e41338a0 2023-09-30T22:34:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fe64d41b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64809d6f0 0x7fe64811df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fe64cc1a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64809e000 0x7fe64811e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fe64d41b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64809d6f0 0x7fe64811df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39606/0 (socket says 172.21.15.59:39606) 2023-09-30T22:34:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fe64d41b700 1 -- 172.21.15.59:0/1647349316 learned_addr learned my addr 172.21.15.59:0/1647349316 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:52.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.002+0000 7fe64dc1c700 1 --2- 172.21.15.59:0/1647349316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64809e410 0x7fe64811e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fb6e2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e409de50 0x7fb6e411b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fb6e2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e409de50 0x7fb6e411b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39614/0 (socket says 172.21.15.59:39614) 2023-09-30T22:34:52.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fb6e2ffd700 1 -- 172.21.15.59:0/3842288718 learned_addr learned my addr 172.21.15.59:0/3842288718 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:52.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fb6e37fe700 1 --2- 172.21.15.59:0/3842288718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e41338a0 0x7fb6e411c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fb6e27fc700 1 --2- 172.21.15.59:0/3842288718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e409e760 0x7fb6e411bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fe64d41b700 1 -- 172.21.15.59:0/1647349316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64809e000 msgr2=0x7fe64811e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fe64d41b700 1 --2- 172.21.15.59:0/1647349316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64809e000 0x7fe64811e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fe64d41b700 1 -- 172.21.15.59:0/1647349316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64809e410 msgr2=0x7fe64811e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fe64d41b700 1 --2- 172.21.15.59:0/1647349316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64809e410 0x7fe64811e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fe64d41b700 1 -- 172.21.15.59:0/1647349316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe640009b30 con 0x7fe64809d6f0 2023-09-30T22:34:52.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fb6e2ffd700 1 -- 172.21.15.59:0/3842288718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e41338a0 msgr2=0x7fb6e411c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fb6e2ffd700 1 --2- 172.21.15.59:0/3842288718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e41338a0 0x7fb6e411c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fb6e2ffd700 1 -- 172.21.15.59:0/3842288718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e409e760 msgr2=0x7fb6e411bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fb6e2ffd700 1 --2- 172.21.15.59:0/3842288718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e409e760 0x7fb6e411bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fb6e2ffd700 1 -- 172.21.15.59:0/3842288718 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6dc009a70 con 0x7fb6e409de50 2023-09-30T22:34:52.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fb6e27fc700 1 --2- 172.21.15.59:0/3842288718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e409e760 0x7fb6e411bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:52.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fe64d41b700 1 --2- 172.21.15.59:0/1647349316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64809d6f0 0x7fe64811df60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe64400e870 tx=0x7fe64400eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:52.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fb6e2ffd700 1 --2- 172.21.15.59:0/3842288718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e409de50 0x7fb6e411b6c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400ec10 tx=0x7fb6d400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:52.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fe63dffb700 1 -- 172.21.15.59:0/1647349316 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe644009590 con 0x7fe64809d6f0 2023-09-30T22:34:52.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fe63dffb700 1 -- 172.21.15.59:0/1647349316 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe644013680 con 0x7fe64809d6f0 2023-09-30T22:34:52.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fe64f67f700 1 -- 172.21.15.59:0/1647349316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe648120150 con 0x7fe64809d6f0 2023-09-30T22:34:52.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fe63dffb700 1 -- 172.21.15.59:0/1647349316 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440139f0 con 0x7fe64809d6f0 2023-09-30T22:34:52.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.003+0000 7fb6cb7fe700 1 -- 172.21.15.59:0/3842288718 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d400c850 con 0x7fb6e409de50 2023-09-30T22:34:52.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.004+0000 7fb6cb7fe700 1 -- 172.21.15.59:0/3842288718 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d400c9b0 con 0x7fb6e409de50 2023-09-30T22:34:52.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.004+0000 7fb6e97d7700 1 -- 172.21.15.59:0/3842288718 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d4009550 con 0x7fb6e409de50 2023-09-30T22:34:52.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.004+0000 7fb6cb7fe700 1 -- 172.21.15.59:0/3842288718 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d400cd20 con 0x7fb6e409de50 2023-09-30T22:34:52.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.004+0000 7fb6e97d7700 1 -- 172.21.15.59:0/3842288718 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d80094a0 con 0x7fb6e409de50 2023-09-30T22:34:52.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.005+0000 7fb6cb7fe700 1 -- 172.21.15.59:0/3842288718 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6d4013470 con 0x7fb6e409de50 2023-09-30T22:34:52.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.004+0000 7fe64f67f700 1 -- 172.21.15.59:0/1647349316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe648130340 con 0x7fe64809d6f0 2023-09-30T22:34:52.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.005+0000 7fb6cb7fe700 1 -- 172.21.15.59:0/3842288718 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb6d401ac60 con 0x7fb6e409de50 2023-09-30T22:34:52.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.005+0000 7fe64f67f700 1 -- 172.21.15.59:0/1647349316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe64811ac20 con 0x7fe64809d6f0 2023-09-30T22:34:52.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.005+0000 7fe63dffb700 1 -- 172.21.15.59:0/1647349316 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe644013b50 con 0x7fe64809d6f0 2023-09-30T22:34:52.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.005+0000 7fe63dffb700 1 -- 172.21.15.59:0/1647349316 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe64403fa00 con 0x7fe64809d6f0 2023-09-30T22:34:52.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.006+0000 7fb6e97d7700 1 -- 172.21.15.59:0/3842288718 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e4074ea0 con 0x7fb6e409de50 2023-09-30T22:34:52.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.010+0000 7fe63dffb700 1 -- 172.21.15.59:0/1647349316 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe64400c7d0 con 0x7fe64809d6f0 2023-09-30T22:34:52.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.015+0000 7fb6cb7fe700 1 -- 172.21.15.59:0/3842288718 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6d4017070 con 0x7fb6e409de50 2023-09-30T22:34:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.217+0000 7fe64f67f700 1 -- 172.21.15.59:0/1647349316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe648121600 con 0x7fe64809d6f0 2023-09-30T22:34:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.217+0000 7fe63dffb700 1 -- 172.21.15.59:0/1647349316 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe648121600 con 0x7fe64809d6f0 2023-09-30T22:34:52.217 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.219+0000 7fe64f67f700 1 -- 172.21.15.59:0/1647349316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64809d6f0 msgr2=0x7fe64811df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.219+0000 7fe64f67f700 1 --2- 172.21.15.59:0/1647349316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64809d6f0 0x7fe64811df60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe64400e870 tx=0x7fe64400eb80 comp rx=0 tx=0).stop 2023-09-30T22:34:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.220+0000 7fe64f67f700 1 -- 172.21.15.59:0/1647349316 shutdown_connections 2023-09-30T22:34:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.220+0000 7fe64f67f700 1 --2- 172.21.15.59:0/1647349316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64809e410 0x7fe64811e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.220+0000 7fe64f67f700 1 --2- 172.21.15.59:0/1647349316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe64809d6f0 0x7fe64811df60 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.220+0000 7fe64f67f700 1 --2- 172.21.15.59:0/1647349316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe64809e000 0x7fe64811e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.220+0000 7fe64f67f700 1 -- 172.21.15.59:0/1647349316 >> 172.21.15.59:0/1647349316 conn(0x7fe648066f50 msgr2=0x7fe648130a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.220+0000 7fe64f67f700 1 -- 172.21.15.59:0/1647349316 shutdown_connections 2023-09-30T22:34:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.220+0000 7fe64f67f700 1 -- 172.21.15.59:0/1647349316 wait complete. 2023-09-30T22:34:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.221+0000 7fb6e97d7700 1 -- 172.21.15.59:0/3842288718 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb6e406b9e0 con 0x7fb6e409de50 2023-09-30T22:34:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.221+0000 7fb6cb7fe700 1 -- 172.21.15.59:0/3842288718 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6d4017020 con 0x7fb6e409de50 2023-09-30T22:34:52.221 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.223+0000 7fb6e97d7700 1 -- 172.21.15.59:0/3842288718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e409de50 msgr2=0x7fb6e411b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.223+0000 7fb6e97d7700 1 --2- 172.21.15.59:0/3842288718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e409de50 0x7fb6e411b6c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400ec10 tx=0x7fb6d400ef20 comp rx=0 tx=0).stop 2023-09-30T22:34:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.224+0000 7fb6e97d7700 1 -- 172.21.15.59:0/3842288718 shutdown_connections 2023-09-30T22:34:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.224+0000 7fb6e97d7700 1 --2- 172.21.15.59:0/3842288718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e41338a0 0x7fb6e411c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.224+0000 7fb6e97d7700 1 --2- 172.21.15.59:0/3842288718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e409de50 0x7fb6e411b6c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.224+0000 7fb6e97d7700 1 --2- 172.21.15.59:0/3842288718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e409e760 0x7fb6e411bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.224+0000 7fb6e97d7700 1 -- 172.21.15.59:0/3842288718 >> 172.21.15.59:0/3842288718 conn(0x7fb6e40a2aa0 msgr2=0x7fb6e41305a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.224+0000 7fb6e97d7700 1 -- 172.21.15.59:0/3842288718 shutdown_connections 2023-09-30T22:34:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.224+0000 7fb6e97d7700 1 -- 172.21.15.59:0/3842288718 wait complete. 2023-09-30T22:34:52.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:52.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:52.741 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:52.779 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:52.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.889+0000 7f8473ee9700 1 Processor -- start 2023-09-30T22:34:52.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.889+0000 7f8473ee9700 1 -- start start 2023-09-30T22:34:52.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.890+0000 7f8473ee9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c0a0a30 0x7f846c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.890+0000 7f8473ee9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c09d630 0x7f846c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.890+0000 7f8473ee9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f846c133930 0x7f846c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.890+0000 7f8473ee9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846c0a2a70 con 0x7f846c133930 2023-09-30T22:34:52.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.890+0000 7f8473ee9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0a01d0 con 0x7f846c0a0a30 2023-09-30T22:34:52.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.890+0000 7f8473ee9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f846c09e2b0 con 0x7f846c09d630 2023-09-30T22:34:52.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.890+0000 7f8471c85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c0a0a30 0x7f846c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.890+0000 7f8471484700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c09d630 0x7f846c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.891+0000 7f8471484700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c09d630 0x7f846c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54894/0 (socket says 172.21.15.59:54894) 2023-09-30T22:34:52.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.891+0000 7f8471c85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c0a0a30 0x7f846c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39622/0 (socket says 172.21.15.59:39622) 2023-09-30T22:34:52.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.891+0000 7f8471484700 1 -- 172.21.15.59:0/68241235 learned_addr learned my addr 172.21.15.59:0/68241235 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:52.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.891+0000 7f8472486700 1 --2- 172.21.15.59:0/68241235 >> v2:172.21.15.59:3300/0 conn(0x7f846c133930 0x7f846c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.891+0000 7f8471484700 1 -- 172.21.15.59:0/68241235 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c0a0a30 msgr2=0x7f846c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:52.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.891+0000 7f8471484700 1 --2- 172.21.15.59:0/68241235 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c0a0a30 0x7f846c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.891+0000 7f8471484700 1 -- 172.21.15.59:0/68241235 >> v2:172.21.15.59:3300/0 conn(0x7f846c133930 msgr2=0x7f846c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:52.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.891+0000 7f8471484700 1 --2- 172.21.15.59:0/68241235 >> v2:172.21.15.59:3300/0 conn(0x7f846c133930 0x7f846c133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.891+0000 7f8471484700 1 -- 172.21.15.59:0/68241235 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c09dc50 con 0x7f846c09d630 2023-09-30T22:34:52.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.891+0000 7f8471c85700 1 --2- 172.21.15.59:0/68241235 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c0a0a30 0x7f846c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:52.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.891+0000 7f8472486700 1 --2- 172.21.15.59:0/68241235 >> v2:172.21.15.59:3300/0 conn(0x7f846c133930 0x7f846c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:52.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.891+0000 7f8471484700 1 --2- 172.21.15.59:0/68241235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c09d630 0x7f846c0a1340 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f84600098f0 tx=0x7f8460009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec90a77ee78a2c81 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:52.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.891+0000 7f8470c83700 1 -- 172.21.15.59:0/68241235 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460011830 con 0x7f846c09d630 2023-09-30T22:34:52.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.891+0000 7f8470c83700 1 -- 172.21.15.59:0/68241235 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8460011990 con 0x7f846c09d630 2023-09-30T22:34:52.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.891+0000 7f8470c83700 1 -- 172.21.15.59:0/68241235 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460011d20 con 0x7f846c09d630 2023-09-30T22:34:52.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.892+0000 7f8473ee9700 1 -- 172.21.15.59:0/68241235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c09d630 msgr2=0x7f846c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.892+0000 7f8473ee9700 1 --2- 172.21.15.59:0/68241235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c09d630 0x7f846c0a1340 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f84600098f0 tx=0x7f8460009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:52.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.892+0000 7f8473ee9700 1 -- 172.21.15.59:0/68241235 shutdown_connections 2023-09-30T22:34:52.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.892+0000 7f8473ee9700 1 --2- 172.21.15.59:0/68241235 >> v2:172.21.15.59:3300/0 conn(0x7f846c133930 0x7f846c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.892+0000 7f8473ee9700 1 --2- 172.21.15.59:0/68241235 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c0a0a30 0x7f846c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.892+0000 7f8473ee9700 1 --2- 172.21.15.59:0/68241235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c09d630 0x7f846c0a1340 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.892+0000 7f8473ee9700 1 -- 172.21.15.59:0/68241235 >> 172.21.15.59:0/68241235 conn(0x7f846c0a3050 msgr2=0x7f846c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.892+0000 7f8473ee9700 1 -- 172.21.15.59:0/68241235 shutdown_connections 2023-09-30T22:34:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.892+0000 7f8473ee9700 1 -- 172.21.15.59:0/68241235 wait complete. 2023-09-30T22:34:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.893+0000 7f8473ee9700 1 Processor -- start 2023-09-30T22:34:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.894+0000 7f8473ee9700 1 -- start start 2023-09-30T22:34:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.894+0000 7f8473ee9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f846c09d630 0x7f846c1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.894+0000 7f8473ee9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c0a0a30 0x7f846c1c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.894+0000 7f8473ee9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133930 0x7f846c1c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.894+0000 7f8473ee9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c1220b0 con 0x7f846c09d630 2023-09-30T22:34:52.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.894+0000 7f8473ee9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0a4130 con 0x7f846c0a0a30 2023-09-30T22:34:52.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.894+0000 7f8473ee9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f846c122300 con 0x7f846c133930 2023-09-30T22:34:52.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.894+0000 7f8472486700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133930 0x7f846c1c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.894+0000 7f8471c85700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f846c09d630 0x7f846c1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.894+0000 7f8472486700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133930 0x7f846c1c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54908/0 (socket says 172.21.15.59:54908) 2023-09-30T22:34:52.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.894+0000 7f8472486700 1 -- 172.21.15.59:0/111542898 learned_addr learned my addr 172.21.15.59:0/111542898 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:52.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.895+0000 7f8471484700 1 --2- 172.21.15.59:0/111542898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c0a0a30 0x7f846c1c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.895+0000 7f8472486700 1 -- 172.21.15.59:0/111542898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c0a0a30 msgr2=0x7f846c1c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.895+0000 7f8472486700 1 --2- 172.21.15.59:0/111542898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c0a0a30 0x7f846c1c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.895+0000 7f8472486700 1 -- 172.21.15.59:0/111542898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f846c09d630 msgr2=0x7f846c1c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.895+0000 7f8472486700 1 --2- 172.21.15.59:0/111542898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f846c09d630 0x7f846c1c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.895+0000 7f8472486700 1 -- 172.21.15.59:0/111542898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c009a70 con 0x7f846c133930 2023-09-30T22:34:52.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.895+0000 7f8471c85700 1 --2- 172.21.15.59:0/111542898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f846c09d630 0x7f846c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:52.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.895+0000 7f8472486700 1 --2- 172.21.15.59:0/111542898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133930 0x7f846c1c8b10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f846400eb90 tx=0x7f846400eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.895+0000 7f846a7fc700 1 -- 172.21.15.59:0/111542898 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84640097a0 con 0x7f846c133930 2023-09-30T22:34:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.895+0000 7f846a7fc700 1 -- 172.21.15.59:0/111542898 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8464004020 con 0x7f846c133930 2023-09-30T22:34:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.895+0000 7f8473ee9700 1 -- 172.21.15.59:0/111542898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84640094a0 con 0x7f846c133930 2023-09-30T22:34:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.895+0000 7f846a7fc700 1 -- 172.21.15.59:0/111542898 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84640043b0 con 0x7f846c133930 2023-09-30T22:34:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.895+0000 7f8473ee9700 1 -- 172.21.15.59:0/111542898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8460009550 con 0x7f846c133930 2023-09-30T22:34:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.896+0000 7f846a7fc700 1 -- 172.21.15.59:0/111542898 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f846400c850 con 0x7f846c133930 2023-09-30T22:34:52.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.896+0000 7f846a7fc700 1 -- 172.21.15.59:0/111542898 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f846403f370 con 0x7f846c133930 2023-09-30T22:34:52.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.896+0000 7f8473ee9700 1 -- 172.21.15.59:0/111542898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846c0747f0 con 0x7f846c133930 2023-09-30T22:34:52.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.901+0000 7f846a7fc700 1 -- 172.21.15.59:0/111542898 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8464020070 con 0x7f846c133930 2023-09-30T22:34:52.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.926+0000 7f58aa5be700 1 Processor -- start 2023-09-30T22:34:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.926+0000 7f58aa5be700 1 -- start start 2023-09-30T22:34:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58aa5be700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58a40a0a30 0x7f58a40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58aa5be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a4138d80 0x7f58a413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58aa5be700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a40a2a70 con 0x7f58a409d630 2023-09-30T22:34:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58aa5be700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a40a01d0 con 0x7f58a40a0a30 2023-09-30T22:34:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58aa5be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a409e2b0 con 0x7f58a4138d80 2023-09-30T22:34:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58a3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58a40a0a30 0x7f58a40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58a8b5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a4138d80 0x7f58a413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58a3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58a40a0a30 0x7f58a40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39152/0 (socket says 172.21.15.59:39152) 2023-09-30T22:34:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58a8b5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a4138d80 0x7f58a413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39642/0 (socket says 172.21.15.59:39642) 2023-09-30T22:34:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58a3fff700 1 -- 172.21.15.59:0/3825155582 learned_addr learned my addr 172.21.15.59:0/3825155582 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58a3fff700 1 -- 172.21.15.59:0/3825155582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a4138d80 msgr2=0x7f58a413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58a3fff700 1 --2- 172.21.15.59:0/3825155582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a4138d80 0x7f58a413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58a3fff700 1 -- 172.21.15.59:0/3825155582 >> v1:172.21.15.59:6789/0 conn(0x7f58a409d630 legacy=0x7f58a40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58a3fff700 1 -- 172.21.15.59:0/3825155582 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a409dc50 con 0x7f58a40a0a30 2023-09-30T22:34:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58a8b5b700 1 --2- 172.21.15.59:0/3825155582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a4138d80 0x7f58a413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.927+0000 7f58a3fff700 1 --2- 172.21.15.59:0/3825155582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a40a0a30 0x7f58a40a0e00 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f58940098f0 tx=0x7f5894009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfdaf3d7c049479 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.928+0000 7f58a2ffd700 1 -- 172.21.15.59:0/3825155582 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894011830 con 0x7f58a40a0a30 2023-09-30T22:34:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.928+0000 7f58a2ffd700 1 -- 172.21.15.59:0/3825155582 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5894011990 con 0x7f58a40a0a30 2023-09-30T22:34:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.928+0000 7f58a2ffd700 1 -- 172.21.15.59:0/3825155582 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894011d20 con 0x7f58a40a0a30 2023-09-30T22:34:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.928+0000 7f58aa5be700 1 -- 172.21.15.59:0/3825155582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a40a0a30 msgr2=0x7f58a40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.928+0000 7f58aa5be700 1 --2- 172.21.15.59:0/3825155582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a40a0a30 0x7f58a40a0e00 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f58940098f0 tx=0x7f5894009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.928+0000 7f58aa5be700 1 -- 172.21.15.59:0/3825155582 shutdown_connections 2023-09-30T22:34:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.928+0000 7f58aa5be700 1 --2- 172.21.15.59:0/3825155582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a40a0a30 0x7f58a40a0e00 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.928+0000 7f58aa5be700 1 --2- 172.21.15.59:0/3825155582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a4138d80 0x7f58a413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.928+0000 7f58aa5be700 1 -- 172.21.15.59:0/3825155582 >> 172.21.15.59:0/3825155582 conn(0x7f58a40a3050 msgr2=0x7f58a40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.928+0000 7f58aa5be700 1 -- 172.21.15.59:0/3825155582 shutdown_connections 2023-09-30T22:34:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.928+0000 7f58aa5be700 1 -- 172.21.15.59:0/3825155582 wait complete. 2023-09-30T22:34:52.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.930+0000 7f58aa5be700 1 Processor -- start 2023-09-30T22:34:52.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.930+0000 7f58aa5be700 1 -- start start 2023-09-30T22:34:52.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58aa5be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a409d630 0x7f58a41339a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58aa5be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a40a0a30 0x7f58a4133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58aa5be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a4138d80 0x7f58a4134420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:52.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58aa5be700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a41371e0 con 0x7f58a4138d80 2023-09-30T22:34:52.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58aa5be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a41381b0 con 0x7f58a409d630 2023-09-30T22:34:52.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58aa5be700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40a0410 con 0x7f58a40a0a30 2023-09-30T22:34:52.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58a8b5b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a4138d80 0x7f58a4134420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58a37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a40a0a30 0x7f58a4133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58a8b5b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a4138d80 0x7f58a4134420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39168/0 (socket says 172.21.15.59:39168) 2023-09-30T22:34:52.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58a8b5b700 1 -- 172.21.15.59:0/3589693509 learned_addr learned my addr 172.21.15.59:0/3589693509 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:52.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58a3fff700 1 --2- 172.21.15.59:0/3589693509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a409d630 0x7f58a41339a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:52.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58a8b5b700 1 -- 172.21.15.59:0/3589693509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a40a0a30 msgr2=0x7f58a4133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58a8b5b700 1 --2- 172.21.15.59:0/3589693509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a40a0a30 0x7f58a4133ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58a8b5b700 1 -- 172.21.15.59:0/3589693509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a409d630 msgr2=0x7f58a41339a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:52.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58a8b5b700 1 --2- 172.21.15.59:0/3589693509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a409d630 0x7f58a41339a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:52.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58a8b5b700 1 -- 172.21.15.59:0/3589693509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c009a70 con 0x7f58a4138d80 2023-09-30T22:34:52.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.931+0000 7f58a8b5b700 1 --2- 172.21.15.59:0/3589693509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a4138d80 0x7f58a4134420 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f589c00ef90 tx=0x7f589c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:52.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.932+0000 7f58a0ff9700 1 -- 172.21.15.59:0/3589693509 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c00cc90 con 0x7f58a4138d80 2023-09-30T22:34:52.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.932+0000 7f58a0ff9700 1 -- 172.21.15.59:0/3589693509 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c00f040 con 0x7f58a4138d80 2023-09-30T22:34:52.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.932+0000 7f58aa5be700 1 -- 172.21.15.59:0/3589693509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5894009550 con 0x7f58a4138d80 2023-09-30T22:34:52.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.932+0000 7f58a0ff9700 1 -- 172.21.15.59:0/3589693509 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c0146c0 con 0x7f58a4138d80 2023-09-30T22:34:52.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.932+0000 7f58aa5be700 1 -- 172.21.15.59:0/3589693509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a40a4e10 con 0x7f58a4138d80 2023-09-30T22:34:52.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.933+0000 7f58a0ff9700 1 -- 172.21.15.59:0/3589693509 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f589c014820 con 0x7f58a4138d80 2023-09-30T22:34:52.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.933+0000 7f58a0ff9700 1 -- 172.21.15.59:0/3589693509 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f589c040300 con 0x7f58a4138d80 2023-09-30T22:34:52.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.933+0000 7f58aa5be700 1 -- 172.21.15.59:0/3589693509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a4135de0 con 0x7f58a4138d80 2023-09-30T22:34:52.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:52.938+0000 7f58a0ff9700 1 -- 172.21.15.59:0/3589693509 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f589c018020 con 0x7f58a4138d80 2023-09-30T22:34:53.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.129+0000 7f8473ee9700 1 -- 172.21.15.59:0/111542898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f846c072980 con 0x7f846c133930 2023-09-30T22:34:53.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.129+0000 7f846a7fc700 1 -- 172.21.15.59:0/111542898 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8464017030 con 0x7f846c133930 2023-09-30T22:34:53.130 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:53.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.132+0000 7f8473ee9700 1 -- 172.21.15.59:0/111542898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133930 msgr2=0x7f846c1c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:53.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.132+0000 7f8473ee9700 1 --2- 172.21.15.59:0/111542898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133930 0x7f846c1c8b10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f846400eb90 tx=0x7f846400eea0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.132+0000 7f8473ee9700 1 -- 172.21.15.59:0/111542898 shutdown_connections 2023-09-30T22:34:53.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.132+0000 7f8473ee9700 1 --2- 172.21.15.59:0/111542898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133930 0x7f846c1c8b10 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.132+0000 7f8473ee9700 1 --2- 172.21.15.59:0/111542898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f846c09d630 0x7f846c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.132+0000 7f8473ee9700 1 --2- 172.21.15.59:0/111542898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c0a0a30 0x7f846c1c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.132+0000 7f8473ee9700 1 -- 172.21.15.59:0/111542898 >> 172.21.15.59:0/111542898 conn(0x7f846c0a3050 msgr2=0x7f846c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:53.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.132+0000 7f8473ee9700 1 -- 172.21.15.59:0/111542898 shutdown_connections 2023-09-30T22:34:53.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.132+0000 7f8473ee9700 1 -- 172.21.15.59:0/111542898 wait complete. 2023-09-30T22:34:53.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:53.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.162+0000 7f58aa5be700 1 -- 172.21.15.59:0/3589693509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f58a40747f0 con 0x7f58a4138d80 2023-09-30T22:34:53.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.162+0000 7f58a0ff9700 1 -- 172.21.15.59:0/3589693509 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f589c02b090 con 0x7f58a4138d80 2023-09-30T22:34:53.162 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:53.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.164+0000 7f58aa5be700 1 -- 172.21.15.59:0/3589693509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a4138d80 msgr2=0x7f58a4134420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:53.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.164+0000 7f58aa5be700 1 --2- 172.21.15.59:0/3589693509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a4138d80 0x7f58a4134420 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f589c00ef90 tx=0x7f589c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.164+0000 7f58aa5be700 1 -- 172.21.15.59:0/3589693509 shutdown_connections 2023-09-30T22:34:53.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.164+0000 7f58aa5be700 1 --2- 172.21.15.59:0/3589693509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a4138d80 0x7f58a4134420 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.164+0000 7f58aa5be700 1 --2- 172.21.15.59:0/3589693509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a409d630 0x7f58a41339a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.164+0000 7f58aa5be700 1 --2- 172.21.15.59:0/3589693509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f58a40a0a30 0x7f58a4133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.164+0000 7f58aa5be700 1 -- 172.21.15.59:0/3589693509 >> 172.21.15.59:0/3589693509 conn(0x7f58a40a3050 msgr2=0x7f58a409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:53.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.164+0000 7f58aa5be700 1 -- 172.21.15.59:0/3589693509 shutdown_connections 2023-09-30T22:34:53.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.164+0000 7f58aa5be700 1 -- 172.21.15.59:0/3589693509 wait complete. 2023-09-30T22:34:53.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:53.236 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:53.240 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:53.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.379+0000 7fd36e8c9700 1 Processor -- start 2023-09-30T22:34:53.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.379+0000 7fd36e8c9700 1 -- start start 2023-09-30T22:34:53.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd36e8c9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3680a0a30 0x7fd3680a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:53.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd36e8c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd36809d630 0x7fd3680a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:53.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd36e8c9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd368133930 0x7fd368133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:53.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd36e8c9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3680a2a70 con 0x7fd368133930 2023-09-30T22:34:53.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd36e8c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3680a01d0 con 0x7fd36809d630 2023-09-30T22:34:53.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd36e8c9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd36809e2b0 con 0x7fd3680a0a30 2023-09-30T22:34:53.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd3677fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd36809d630 0x7fd3680a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:53.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd367fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3680a0a30 0x7fd3680a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:53.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd36ce66700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd368133930 0x7fd368133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:53.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd367fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3680a0a30 0x7fd3680a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54930/0 (socket says 172.21.15.59:54930) 2023-09-30T22:34:53.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd3677fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd36809d630 0x7fd3680a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39658/0 (socket says 172.21.15.59:39658) 2023-09-30T22:34:53.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd367fff700 1 -- 172.21.15.59:0/2805917373 learned_addr learned my addr 172.21.15.59:0/2805917373 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:53.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd367fff700 1 -- 172.21.15.59:0/2805917373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd36809d630 msgr2=0x7fd3680a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:53.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd367fff700 1 --2- 172.21.15.59:0/2805917373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd36809d630 0x7fd3680a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd367fff700 1 -- 172.21.15.59:0/2805917373 >> v2:172.21.15.59:3300/0 conn(0x7fd368133930 msgr2=0x7fd368133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:53.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd367fff700 1 --2- 172.21.15.59:0/2805917373 >> v2:172.21.15.59:3300/0 conn(0x7fd368133930 0x7fd368133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd367fff700 1 -- 172.21.15.59:0/2805917373 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36809dc50 con 0x7fd3680a0a30 2023-09-30T22:34:53.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd36ce66700 1 --2- 172.21.15.59:0/2805917373 >> v2:172.21.15.59:3300/0 conn(0x7fd368133930 0x7fd368133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:53.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.380+0000 7fd3677fe700 1 --2- 172.21.15.59:0/2805917373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd36809d630 0x7fd3680a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:53.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.381+0000 7fd367fff700 1 --2- 172.21.15.59:0/2805917373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3680a0a30 0x7fd3680a0e00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd3580098f0 tx=0x7fd358009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b59cb9dbb27c7ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:53.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.381+0000 7fd366ffd700 1 -- 172.21.15.59:0/2805917373 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358011830 con 0x7fd3680a0a30 2023-09-30T22:34:53.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.381+0000 7fd366ffd700 1 -- 172.21.15.59:0/2805917373 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd358011990 con 0x7fd3680a0a30 2023-09-30T22:34:53.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.381+0000 7fd366ffd700 1 -- 172.21.15.59:0/2805917373 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358011d20 con 0x7fd3680a0a30 2023-09-30T22:34:53.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.382+0000 7fd36e8c9700 1 -- 172.21.15.59:0/2805917373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3680a0a30 msgr2=0x7fd3680a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:53.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.382+0000 7fd36e8c9700 1 --2- 172.21.15.59:0/2805917373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3680a0a30 0x7fd3680a0e00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd3580098f0 tx=0x7fd358009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:53.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.382+0000 7fd36e8c9700 1 -- 172.21.15.59:0/2805917373 shutdown_connections 2023-09-30T22:34:53.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.382+0000 7fd36e8c9700 1 --2- 172.21.15.59:0/2805917373 >> v2:172.21.15.59:3300/0 conn(0x7fd368133930 0x7fd368133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.382+0000 7fd36e8c9700 1 --2- 172.21.15.59:0/2805917373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3680a0a30 0x7fd3680a0e00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.382+0000 7fd36e8c9700 1 --2- 172.21.15.59:0/2805917373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd36809d630 0x7fd3680a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.382+0000 7fd36e8c9700 1 -- 172.21.15.59:0/2805917373 >> 172.21.15.59:0/2805917373 conn(0x7fd3680a3050 msgr2=0x7fd3680a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:53.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.382+0000 7fd36e8c9700 1 -- 172.21.15.59:0/2805917373 shutdown_connections 2023-09-30T22:34:53.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.382+0000 7fd36e8c9700 1 -- 172.21.15.59:0/2805917373 wait complete. 2023-09-30T22:34:53.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.383+0000 7fd36e8c9700 1 Processor -- start 2023-09-30T22:34:53.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.383+0000 7fd36e8c9700 1 -- start start 2023-09-30T22:34:53.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.383+0000 7fd36e8c9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd36809d630 0x7fd36811d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:53.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.383+0000 7fd36e8c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3680a0a30 0x7fd36811dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:53.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.383+0000 7fd36e8c9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd368133930 0x7fd3681c3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:53.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.383+0000 7fd36e8c9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd368120490 con 0x7fd36809d630 2023-09-30T22:34:53.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.383+0000 7fd36e8c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36811e100 con 0x7fd3680a0a30 2023-09-30T22:34:53.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.383+0000 7fd36e8c9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3680a04a0 con 0x7fd368133930 2023-09-30T22:34:53.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd36ce66700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd368133930 0x7fd3681c3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:53.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd367fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd36809d630 0x7fd36811d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:53.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd36ce66700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd368133930 0x7fd3681c3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54938/0 (socket says 172.21.15.59:54938) 2023-09-30T22:34:53.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd367fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd36809d630 0x7fd36811d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39180/0 (socket says 172.21.15.59:39180) 2023-09-30T22:34:53.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd36ce66700 1 -- 172.21.15.59:0/1264054135 learned_addr learned my addr 172.21.15.59:0/1264054135 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:53.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd3677fe700 1 --2- 172.21.15.59:0/1264054135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3680a0a30 0x7fd36811dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:53.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd36ce66700 1 -- 172.21.15.59:0/1264054135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3680a0a30 msgr2=0x7fd36811dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:53.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd36ce66700 1 --2- 172.21.15.59:0/1264054135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3680a0a30 0x7fd36811dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd36ce66700 1 -- 172.21.15.59:0/1264054135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd36809d630 msgr2=0x7fd36811d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:53.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd36ce66700 1 --2- 172.21.15.59:0/1264054135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd36809d630 0x7fd36811d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd36ce66700 1 -- 172.21.15.59:0/1264054135 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c011d40 con 0x7fd368133930 2023-09-30T22:34:53.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd367fff700 1 --2- 172.21.15.59:0/1264054135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd36809d630 0x7fd36811d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:53.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd36ce66700 1 --2- 172.21.15.59:0/1264054135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd368133930 0x7fd3681c3c80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd36000efc0 tx=0x7fd36000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:53.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd364ff9700 1 -- 172.21.15.59:0/1264054135 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36000ca30 con 0x7fd368133930 2023-09-30T22:34:53.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd364ff9700 1 -- 172.21.15.59:0/1264054135 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36000f040 con 0x7fd368133930 2023-09-30T22:34:53.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd364ff9700 1 -- 172.21.15.59:0/1264054135 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36000cdb0 con 0x7fd368133930 2023-09-30T22:34:53.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd36e8c9700 1 -- 172.21.15.59:0/1264054135 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd360009a70 con 0x7fd368133930 2023-09-30T22:34:53.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.384+0000 7fd36e8c9700 1 -- 172.21.15.59:0/1264054135 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd358009550 con 0x7fd368133930 2023-09-30T22:34:53.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.385+0000 7fd364ff9700 1 -- 172.21.15.59:0/1264054135 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd360014480 con 0x7fd368133930 2023-09-30T22:34:53.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.386+0000 7fd364ff9700 1 -- 172.21.15.59:0/1264054135 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd36003fc40 con 0x7fd368133930 2023-09-30T22:34:53.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.386+0000 7fd36e8c9700 1 -- 172.21.15.59:0/1264054135 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3680747f0 con 0x7fd368133930 2023-09-30T22:34:53.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.391+0000 7fd364ff9700 1 -- 172.21.15.59:0/1264054135 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd360012930 con 0x7fd368133930 2023-09-30T22:34:53.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.421+0000 7fd28cadd700 1 Processor -- start 2023-09-30T22:34:53.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.421+0000 7fd28cadd700 1 -- start start 2023-09-30T22:34:53.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd28cadd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd288133a80 0x7fd288133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:53.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd28cadd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28812ff20 0x7fd288130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:53.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd28cadd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd288130870 0x7fd28813a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:53.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd28cadd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28806c570 con 0x7fd288133a80 2023-09-30T22:34:53.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd28cadd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28806bc00 con 0x7fd288130870 2023-09-30T22:34:53.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd28cadd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880a0040 con 0x7fd28812ff20 2023-09-30T22:34:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd285d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28812ff20 0x7fd288130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd28659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd288133a80 0x7fd288133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd286d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd288130870 0x7fd28813a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd285d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28812ff20 0x7fd288130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54942/0 (socket says 172.21.15.59:54942) 2023-09-30T22:34:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd28659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd288133a80 0x7fd288133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39186/0 (socket says 172.21.15.59:39186) 2023-09-30T22:34:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd285d9b700 1 -- 172.21.15.59:0/1351229286 learned_addr learned my addr 172.21.15.59:0/1351229286 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd286d9d700 1 -- 172.21.15.59:0/1351229286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28812ff20 msgr2=0x7fd288130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd286d9d700 1 --2- 172.21.15.59:0/1351229286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28812ff20 0x7fd288130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd286d9d700 1 -- 172.21.15.59:0/1351229286 >> v2:172.21.15.59:3300/0 conn(0x7fd288133a80 msgr2=0x7fd288133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:53.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd286d9d700 1 --2- 172.21.15.59:0/1351229286 >> v2:172.21.15.59:3300/0 conn(0x7fd288133a80 0x7fd288133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd286d9d700 1 -- 172.21.15.59:0/1351229286 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd288133860 con 0x7fd288130870 2023-09-30T22:34:53.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd285d9b700 1 --2- 172.21.15.59:0/1351229286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28812ff20 0x7fd288130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:53.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.422+0000 7fd286d9d700 1 --2- 172.21.15.59:0/1351229286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd288130870 0x7fd28813a840 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd280009d90 tx=0x7fd28000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aea755261d21f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:53.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.423+0000 7fd28559a700 1 -- 172.21.15.59:0/1351229286 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28000e070 con 0x7fd288130870 2023-09-30T22:34:53.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.423+0000 7fd28559a700 1 -- 172.21.15.59:0/1351229286 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28000bb20 con 0x7fd288130870 2023-09-30T22:34:53.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.423+0000 7fd28559a700 1 -- 172.21.15.59:0/1351229286 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd280012430 con 0x7fd288130870 2023-09-30T22:34:53.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.423+0000 7fd28cadd700 1 -- 172.21.15.59:0/1351229286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd288130870 msgr2=0x7fd28813a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:53.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.423+0000 7fd28cadd700 1 --2- 172.21.15.59:0/1351229286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd288130870 0x7fd28813a840 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd280009d90 tx=0x7fd28000b330 comp rx=0 tx=0).stop 2023-09-30T22:34:53.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.423+0000 7fd28cadd700 1 -- 172.21.15.59:0/1351229286 shutdown_connections 2023-09-30T22:34:53.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.423+0000 7fd28cadd700 1 --2- 172.21.15.59:0/1351229286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd288130870 0x7fd28813a840 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.423+0000 7fd28cadd700 1 --2- 172.21.15.59:0/1351229286 >> v2:172.21.15.59:3300/0 conn(0x7fd288133a80 0x7fd288133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.423+0000 7fd28cadd700 1 --2- 172.21.15.59:0/1351229286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28812ff20 0x7fd288130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.423+0000 7fd28cadd700 1 -- 172.21.15.59:0/1351229286 >> 172.21.15.59:0/1351229286 conn(0x7fd2880a4210 msgr2=0x7fd2880a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:53.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.423+0000 7fd28cadd700 1 -- 172.21.15.59:0/1351229286 shutdown_connections 2023-09-30T22:34:53.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.423+0000 7fd28cadd700 1 -- 172.21.15.59:0/1351229286 wait complete. 2023-09-30T22:34:53.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.425+0000 7fd28cadd700 1 Processor -- start 2023-09-30T22:34:53.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.425+0000 7fd28cadd700 1 -- start start 2023-09-30T22:34:53.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.425+0000 7fd28cadd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd28812ff20 0x7fd28809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:53.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.425+0000 7fd28cadd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd288130870 0x7fd28809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:53.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.425+0000 7fd28cadd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd288133a80 0x7fd28809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:53.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.425+0000 7fd28cadd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28812d770 con 0x7fd288133a80 2023-09-30T22:34:53.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.425+0000 7fd28cadd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28809df20 con 0x7fd28812ff20 2023-09-30T22:34:53.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.425+0000 7fd28cadd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd288120440 con 0x7fd288130870 2023-09-30T22:34:53.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.425+0000 7fd285d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd288130870 0x7fd28809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:53.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.425+0000 7fd28659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd28812ff20 0x7fd28809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:53.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.425+0000 7fd286d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd288133a80 0x7fd28809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:53.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.425+0000 7fd285d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd288130870 0x7fd28809c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54948/0 (socket says 172.21.15.59:54948) 2023-09-30T22:34:53.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.425+0000 7fd285d9b700 1 -- 172.21.15.59:0/1590380722 learned_addr learned my addr 172.21.15.59:0/1590380722 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:53.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.426+0000 7fd285d9b700 1 -- 172.21.15.59:0/1590380722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd28812ff20 msgr2=0x7fd28809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:53.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.426+0000 7fd285d9b700 1 --2- 172.21.15.59:0/1590380722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd28812ff20 0x7fd28809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.426+0000 7fd285d9b700 1 -- 172.21.15.59:0/1590380722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd288133a80 msgr2=0x7fd28809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:53.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.426+0000 7fd285d9b700 1 --2- 172.21.15.59:0/1590380722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd288133a80 0x7fd28809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.426+0000 7fd285d9b700 1 -- 172.21.15.59:0/1590380722 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c009550 con 0x7fd288130870 2023-09-30T22:34:53.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.426+0000 7fd286d9d700 1 --2- 172.21.15.59:0/1590380722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd288133a80 0x7fd28809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:53.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.426+0000 7fd28659c700 1 --2- 172.21.15.59:0/1590380722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd28812ff20 0x7fd28809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.426+0000 7fd285d9b700 1 --2- 172.21.15.59:0/1590380722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd288130870 0x7fd28809c9c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00ec10 tx=0x7fd27c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.426+0000 7fd276ffd700 1 -- 172.21.15.59:0/1590380722 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c00c850 con 0x7fd288130870 2023-09-30T22:34:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.426+0000 7fd276ffd700 1 -- 172.21.15.59:0/1590380722 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c00c9b0 con 0x7fd288130870 2023-09-30T22:34:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.426+0000 7fd28cadd700 1 -- 172.21.15.59:0/1590380722 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd280009a70 con 0x7fd288130870 2023-09-30T22:34:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.426+0000 7fd276ffd700 1 -- 172.21.15.59:0/1590380722 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c00cd40 con 0x7fd288130870 2023-09-30T22:34:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.426+0000 7fd28cadd700 1 -- 172.21.15.59:0/1590380722 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28811fda0 con 0x7fd288130870 2023-09-30T22:34:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.427+0000 7fd276ffd700 1 -- 172.21.15.59:0/1590380722 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd27c013470 con 0x7fd288130870 2023-09-30T22:34:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.427+0000 7fd28cadd700 1 -- 172.21.15.59:0/1590380722 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd288120b90 con 0x7fd288130870 2023-09-30T22:34:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.427+0000 7fd276ffd700 1 -- 172.21.15.59:0/1590380722 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd27c03f9c0 con 0x7fd288130870 2023-09-30T22:34:53.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.432+0000 7fd276ffd700 1 -- 172.21.15.59:0/1590380722 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd27c013720 con 0x7fd288130870 2023-09-30T22:34:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.599+0000 7fd36e8c9700 1 -- 172.21.15.59:0/1264054135 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd3681202f0 con 0x7fd368133930 2023-09-30T22:34:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.599+0000 7fd364ff9700 1 -- 172.21.15.59:0/1264054135 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3681202f0 con 0x7fd368133930 2023-09-30T22:34:53.600 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:53.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.602+0000 7fd36e8c9700 1 -- 172.21.15.59:0/1264054135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd368133930 msgr2=0x7fd3681c3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:53.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.602+0000 7fd36e8c9700 1 --2- 172.21.15.59:0/1264054135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd368133930 0x7fd3681c3c80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd36000efc0 tx=0x7fd36000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.602+0000 7fd36e8c9700 1 -- 172.21.15.59:0/1264054135 shutdown_connections 2023-09-30T22:34:53.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.602+0000 7fd36e8c9700 1 --2- 172.21.15.59:0/1264054135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd368133930 0x7fd3681c3c80 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.602+0000 7fd36e8c9700 1 --2- 172.21.15.59:0/1264054135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd36809d630 0x7fd36811d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.602+0000 7fd36e8c9700 1 --2- 172.21.15.59:0/1264054135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3680a0a30 0x7fd36811dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.602+0000 7fd36e8c9700 1 -- 172.21.15.59:0/1264054135 >> 172.21.15.59:0/1264054135 conn(0x7fd3680a3050 msgr2=0x7fd368132b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:53.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.602+0000 7fd36e8c9700 1 -- 172.21.15.59:0/1264054135 shutdown_connections 2023-09-30T22:34:53.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.602+0000 7fd36e8c9700 1 -- 172.21.15.59:0/1264054135 wait complete. 2023-09-30T22:34:53.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.637+0000 7fd28cadd700 1 -- 172.21.15.59:0/1590380722 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd288074ea0 con 0x7fd288130870 2023-09-30T22:34:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.637+0000 7fd276ffd700 1 -- 172.21.15.59:0/1590380722 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd27c01bb60 con 0x7fd288130870 2023-09-30T22:34:53.638 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:53.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.640+0000 7fd28cadd700 1 -- 172.21.15.59:0/1590380722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd288130870 msgr2=0x7fd28809c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:53.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.640+0000 7fd28cadd700 1 --2- 172.21.15.59:0/1590380722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd288130870 0x7fd28809c9c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00ec10 tx=0x7fd27c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:34:53.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.640+0000 7fd28cadd700 1 -- 172.21.15.59:0/1590380722 shutdown_connections 2023-09-30T22:34:53.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.640+0000 7fd28cadd700 1 --2- 172.21.15.59:0/1590380722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd288133a80 0x7fd28809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.640+0000 7fd28cadd700 1 --2- 172.21.15.59:0/1590380722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd28812ff20 0x7fd28809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.640+0000 7fd28cadd700 1 --2- 172.21.15.59:0/1590380722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd288130870 0x7fd28809c9c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:53.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.640+0000 7fd28cadd700 1 -- 172.21.15.59:0/1590380722 >> 172.21.15.59:0/1590380722 conn(0x7fd2880a4210 msgr2=0x7fd28809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:53.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.640+0000 7fd28cadd700 1 -- 172.21.15.59:0/1590380722 shutdown_connections 2023-09-30T22:34:53.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:53.640+0000 7fd28cadd700 1 -- 172.21.15.59:0/1590380722 wait complete. 2023-09-30T22:34:53.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:54.147 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:54.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:54.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.296+0000 7f19ef176700 1 Processor -- start 2023-09-30T22:34:54.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.296+0000 7f19ef176700 1 -- start start 2023-09-30T22:34:54.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.297+0000 7f19ef176700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19e80a0a30 0x7f19e80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.297+0000 7f19ef176700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e80a1340 0x7f19e8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.297+0000 7f19ef176700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e809edd0 con 0x7f19e8133fa0 2023-09-30T22:34:54.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.297+0000 7f19ef176700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e809e1f0 con 0x7f19e80a0a30 2023-09-30T22:34:54.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.297+0000 7f19ef176700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e809dc50 con 0x7f19e80a1340 2023-09-30T22:34:54.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.297+0000 7f19ecf12700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19e80a0a30 0x7f19e80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.297+0000 7f19e7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e80a1340 0x7f19e8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.297+0000 7f19ecf12700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19e80a0a30 0x7f19e80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39208/0 (socket says 172.21.15.59:39208) 2023-09-30T22:34:54.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.297+0000 7f19e7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e80a1340 0x7f19e8133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39686/0 (socket says 172.21.15.59:39686) 2023-09-30T22:34:54.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.297+0000 7f19ecf12700 1 -- 172.21.15.59:0/1717016112 learned_addr learned my addr 172.21.15.59:0/1717016112 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:54.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.298+0000 7f19ecf12700 1 -- 172.21.15.59:0/1717016112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e80a1340 msgr2=0x7f19e8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:54.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.298+0000 7f19ecf12700 1 --2- 172.21.15.59:0/1717016112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e80a1340 0x7f19e8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.298+0000 7f19ecf12700 1 -- 172.21.15.59:0/1717016112 >> v1:172.21.15.59:6789/0 conn(0x7f19e8133fa0 legacy=0x7f19e813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.298+0000 7f19ecf12700 1 -- 172.21.15.59:0/1717016112 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e80a1fe0 con 0x7f19e80a0a30 2023-09-30T22:34:54.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.298+0000 7f19e7fff700 1 --2- 172.21.15.59:0/1717016112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e80a1340 0x7f19e8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:54.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.298+0000 7f19ecf12700 1 --2- 172.21.15.59:0/1717016112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e80a0a30 0x7f19e80a0e00 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f19d80098f0 tx=0x7f19d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e87139c521d461 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:54.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.298+0000 7f19e77fe700 1 -- 172.21.15.59:0/1717016112 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8011830 con 0x7f19e80a0a30 2023-09-30T22:34:54.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.298+0000 7f19e77fe700 1 -- 172.21.15.59:0/1717016112 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d8011990 con 0x7f19e80a0a30 2023-09-30T22:34:54.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.298+0000 7f19e77fe700 1 -- 172.21.15.59:0/1717016112 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8011d20 con 0x7f19e80a0a30 2023-09-30T22:34:54.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.299+0000 7f19ef176700 1 -- 172.21.15.59:0/1717016112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e80a0a30 msgr2=0x7f19e80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.299+0000 7f19ef176700 1 --2- 172.21.15.59:0/1717016112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e80a0a30 0x7f19e80a0e00 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f19d80098f0 tx=0x7f19d8009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:54.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.299+0000 7f19ef176700 1 -- 172.21.15.59:0/1717016112 shutdown_connections 2023-09-30T22:34:54.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.299+0000 7f19ef176700 1 --2- 172.21.15.59:0/1717016112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e80a0a30 0x7f19e80a0e00 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.299+0000 7f19ef176700 1 --2- 172.21.15.59:0/1717016112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e80a1340 0x7f19e8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.299+0000 7f19ef176700 1 -- 172.21.15.59:0/1717016112 >> 172.21.15.59:0/1717016112 conn(0x7f19e80a6550 msgr2=0x7f19e80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:54.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.299+0000 7f19ef176700 1 -- 172.21.15.59:0/1717016112 shutdown_connections 2023-09-30T22:34:54.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.299+0000 7f19ef176700 1 -- 172.21.15.59:0/1717016112 wait complete. 2023-09-30T22:34:54.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.300+0000 7f19ef176700 1 Processor -- start 2023-09-30T22:34:54.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.300+0000 7f19ef176700 1 -- start start 2023-09-30T22:34:54.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ef176700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e80a0a30 0x7f19e811e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ef176700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e80a1340 0x7f19e811ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ef176700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e8133fa0 0x7f19e811f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ef176700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8121f50 con 0x7f19e80a1340 2023-09-30T22:34:54.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ef176700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8120430 con 0x7f19e8133fa0 2023-09-30T22:34:54.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ef176700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80a37e0 con 0x7f19e80a0a30 2023-09-30T22:34:54.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ecf12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e80a0a30 0x7f19e811e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19e7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e80a1340 0x7f19e811ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ecf12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e80a0a30 0x7f19e811e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54950/0 (socket says 172.21.15.59:54950) 2023-09-30T22:34:54.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ed713700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e8133fa0 0x7f19e811f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ecf12700 1 -- 172.21.15.59:0/2550659595 learned_addr learned my addr 172.21.15.59:0/2550659595 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:54.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19e7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e80a1340 0x7f19e811ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39212/0 (socket says 172.21.15.59:39212) 2023-09-30T22:34:54.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ecf12700 1 -- 172.21.15.59:0/2550659595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e8133fa0 msgr2=0x7f19e811f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ecf12700 1 --2- 172.21.15.59:0/2550659595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e8133fa0 0x7f19e811f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ecf12700 1 -- 172.21.15.59:0/2550659595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e80a1340 msgr2=0x7f19e811ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ecf12700 1 --2- 172.21.15.59:0/2550659595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e80a1340 0x7f19e811ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ecf12700 1 -- 172.21.15.59:0/2550659595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc0094a0 con 0x7f19e80a0a30 2023-09-30T22:34:54.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19e7fff700 1 --2- 172.21.15.59:0/2550659595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e80a1340 0x7f19e811ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:54.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19ecf12700 1 --2- 172.21.15.59:0/2550659595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e80a0a30 0x7f19e811e7a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009c40 tx=0x7f19d8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:54.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.301+0000 7f19e57fa700 1 -- 172.21.15.59:0/2550659595 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8004400 con 0x7f19e80a0a30 2023-09-30T22:34:54.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.302+0000 7f19e57fa700 1 -- 172.21.15.59:0/2550659595 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d801f070 con 0x7f19e80a0a30 2023-09-30T22:34:54.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.302+0000 7f19ef176700 1 -- 172.21.15.59:0/2550659595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d8009550 con 0x7f19e80a0a30 2023-09-30T22:34:54.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.302+0000 7f19e57fa700 1 -- 172.21.15.59:0/2550659595 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d80038e0 con 0x7f19e80a0a30 2023-09-30T22:34:54.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.302+0000 7f19ef176700 1 -- 172.21.15.59:0/2550659595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e80a0270 con 0x7f19e80a0a30 2023-09-30T22:34:54.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.303+0000 7f19ef176700 1 -- 172.21.15.59:0/2550659595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e8122a80 con 0x7f19e80a0a30 2023-09-30T22:34:54.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.303+0000 7f19e57fa700 1 -- 172.21.15.59:0/2550659595 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19d8021030 con 0x7f19e80a0a30 2023-09-30T22:34:54.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.303+0000 7f19e57fa700 1 -- 172.21.15.59:0/2550659595 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f19d8041140 con 0x7f19e80a0a30 2023-09-30T22:34:54.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.308+0000 7f19e57fa700 1 -- 172.21.15.59:0/2550659595 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19d80199a0 con 0x7f19e80a0a30 2023-09-30T22:34:54.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.334+0000 7f74c3480700 1 Processor -- start 2023-09-30T22:34:54.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.334+0000 7f74c3480700 1 -- start start 2023-09-30T22:34:54.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74c3480700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74bc0a0a30 0x7f74bc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74c3480700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74bc09d630 0x7f74bc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74c3480700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74bc0a2a70 con 0x7f74bc133930 2023-09-30T22:34:54.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74c3480700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74bc0a01d0 con 0x7f74bc09d630 2023-09-30T22:34:54.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74c3480700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc09e2b0 con 0x7f74bc0a0a30 2023-09-30T22:34:54.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74c121c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74bc0a0a30 0x7f74bc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74c0a1b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74bc09d630 0x7f74bc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74c121c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74bc0a0a30 0x7f74bc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54964/0 (socket says 172.21.15.59:54964) 2023-09-30T22:34:54.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74c121c700 1 -- 172.21.15.59:0/178587432 learned_addr learned my addr 172.21.15.59:0/178587432 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:54.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74c121c700 1 -- 172.21.15.59:0/178587432 >> v2:172.21.15.59:3300/0 conn(0x7f74bc09d630 msgr2=0x7f74bc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:54.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74c121c700 1 --2- 172.21.15.59:0/178587432 >> v2:172.21.15.59:3300/0 conn(0x7f74bc09d630 0x7f74bc0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74c121c700 1 -- 172.21.15.59:0/178587432 >> v1:172.21.15.59:6789/0 conn(0x7f74bc133930 legacy=0x7f74bc133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74c121c700 1 -- 172.21.15.59:0/178587432 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc09dc50 con 0x7f74bc0a0a30 2023-09-30T22:34:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74c0a1b700 1 --2- 172.21.15.59:0/178587432 >> v2:172.21.15.59:3300/0 conn(0x7f74bc09d630 0x7f74bc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74c121c700 1 --2- 172.21.15.59:0/178587432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74bc0a0a30 0x7f74bc0a0e00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009e50 tx=0x7f74b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a6310b2122ea8a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.335+0000 7f74b3fff700 1 -- 172.21.15.59:0/178587432 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b800e070 con 0x7f74bc0a0a30 2023-09-30T22:34:54.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.336+0000 7f74b3fff700 1 -- 172.21.15.59:0/178587432 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b800b910 con 0x7f74bc0a0a30 2023-09-30T22:34:54.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.336+0000 7f74b3fff700 1 -- 172.21.15.59:0/178587432 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b800bcc0 con 0x7f74bc0a0a30 2023-09-30T22:34:54.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.336+0000 7f74c3480700 1 -- 172.21.15.59:0/178587432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74bc0a0a30 msgr2=0x7f74bc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.336+0000 7f74c3480700 1 --2- 172.21.15.59:0/178587432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74bc0a0a30 0x7f74bc0a0e00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009e50 tx=0x7f74b800b330 comp rx=0 tx=0).stop 2023-09-30T22:34:54.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.336+0000 7f74c3480700 1 -- 172.21.15.59:0/178587432 shutdown_connections 2023-09-30T22:34:54.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.336+0000 7f74c3480700 1 --2- 172.21.15.59:0/178587432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74bc0a0a30 0x7f74bc0a0e00 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.336+0000 7f74c3480700 1 --2- 172.21.15.59:0/178587432 >> v2:172.21.15.59:3300/0 conn(0x7f74bc09d630 0x7f74bc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.336+0000 7f74c3480700 1 -- 172.21.15.59:0/178587432 >> 172.21.15.59:0/178587432 conn(0x7f74bc0a3050 msgr2=0x7f74bc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:54.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.336+0000 7f74c3480700 1 -- 172.21.15.59:0/178587432 shutdown_connections 2023-09-30T22:34:54.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.336+0000 7f74c3480700 1 -- 172.21.15.59:0/178587432 wait complete. 2023-09-30T22:34:54.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.337+0000 7f74c3480700 1 Processor -- start 2023-09-30T22:34:54.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.337+0000 7f74c3480700 1 -- start start 2023-09-30T22:34:54.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c3480700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74bc09d630 0x7f74bc1c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c3480700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74bc0a0a30 0x7f74bc1c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c3480700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74bc133930 0x7f74bc1c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c3480700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc120670 con 0x7f74bc133930 2023-09-30T22:34:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c3480700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc121e60 con 0x7f74bc0a0a30 2023-09-30T22:34:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c3480700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc0a0410 con 0x7f74bc09d630 2023-09-30T22:34:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c121c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74bc09d630 0x7f74bc1c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c121c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74bc09d630 0x7f74bc1c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54976/0 (socket says 172.21.15.59:54976) 2023-09-30T22:34:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c121c700 1 -- 172.21.15.59:0/1208414082 learned_addr learned my addr 172.21.15.59:0/1208414082 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c0a1b700 1 --2- 172.21.15.59:0/1208414082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74bc0a0a30 0x7f74bc1c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c1a1d700 1 --2- 172.21.15.59:0/1208414082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74bc133930 0x7f74bc1c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c121c700 1 -- 172.21.15.59:0/1208414082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74bc0a0a30 msgr2=0x7f74bc1c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c121c700 1 --2- 172.21.15.59:0/1208414082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74bc0a0a30 0x7f74bc1c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c121c700 1 -- 172.21.15.59:0/1208414082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74bc133930 msgr2=0x7f74bc1c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c121c700 1 --2- 172.21.15.59:0/1208414082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74bc133930 0x7f74bc1c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c121c700 1 -- 172.21.15.59:0/1208414082 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac0094a0 con 0x7f74bc09d630 2023-09-30T22:34:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.338+0000 7f74c121c700 1 --2- 172.21.15.59:0/1208414082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74bc09d630 0x7f74bc1c8170 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f74b800b370 tx=0x7f74b8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.339+0000 7f74b1ffb700 1 -- 172.21.15.59:0/1208414082 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8004800 con 0x7f74bc09d630 2023-09-30T22:34:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.339+0000 7f74b1ffb700 1 -- 172.21.15.59:0/1208414082 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b80092e0 con 0x7f74bc09d630 2023-09-30T22:34:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.339+0000 7f74c3480700 1 -- 172.21.15.59:0/1208414082 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b8009b30 con 0x7f74bc09d630 2023-09-30T22:34:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.339+0000 7f74b1ffb700 1 -- 172.21.15.59:0/1208414082 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b801c680 con 0x7f74bc09d630 2023-09-30T22:34:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.339+0000 7f74c3480700 1 -- 172.21.15.59:0/1208414082 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74bc121160 con 0x7f74bc09d630 2023-09-30T22:34:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.340+0000 7f74c3480700 1 -- 172.21.15.59:0/1208414082 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74bc0747f0 con 0x7f74bc09d630 2023-09-30T22:34:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.340+0000 7f74b1ffb700 1 -- 172.21.15.59:0/1208414082 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f74b801c7e0 con 0x7f74bc09d630 2023-09-30T22:34:54.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.341+0000 7f74b1ffb700 1 -- 172.21.15.59:0/1208414082 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f74b8041180 con 0x7f74bc09d630 2023-09-30T22:34:54.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.346+0000 7f74b1ffb700 1 -- 172.21.15.59:0/1208414082 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74b802d940 con 0x7f74bc09d630 2023-09-30T22:34:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.514+0000 7f19ef176700 1 -- 172.21.15.59:0/2550659595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f19e8074ea0 con 0x7f19e80a0a30 2023-09-30T22:34:54.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.515+0000 7f19e57fa700 1 -- 172.21.15.59:0/2550659595 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19d8015030 con 0x7f19e80a0a30 2023-09-30T22:34:54.515 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.517+0000 7f19ef176700 1 -- 172.21.15.59:0/2550659595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e80a0a30 msgr2=0x7f19e811e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.517+0000 7f19ef176700 1 --2- 172.21.15.59:0/2550659595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e80a0a30 0x7f19e811e7a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009c40 tx=0x7f19d8004750 comp rx=0 tx=0).stop 2023-09-30T22:34:54.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.517+0000 7f19ef176700 1 -- 172.21.15.59:0/2550659595 shutdown_connections 2023-09-30T22:34:54.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.517+0000 7f19ef176700 1 --2- 172.21.15.59:0/2550659595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e80a0a30 0x7f19e811e7a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.517+0000 7f19ef176700 1 --2- 172.21.15.59:0/2550659595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e8133fa0 0x7f19e811f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.517+0000 7f19ef176700 1 --2- 172.21.15.59:0/2550659595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e80a1340 0x7f19e811ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.517+0000 7f19ef176700 1 -- 172.21.15.59:0/2550659595 >> 172.21.15.59:0/2550659595 conn(0x7f19e80a6550 msgr2=0x7f19e81b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:54.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.517+0000 7f19ef176700 1 -- 172.21.15.59:0/2550659595 shutdown_connections 2023-09-30T22:34:54.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.517+0000 7f19ef176700 1 -- 172.21.15.59:0/2550659595 wait complete. 2023-09-30T22:34:54.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:54.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.553+0000 7f74c3480700 1 -- 172.21.15.59:0/1208414082 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f74bc072980 con 0x7f74bc09d630 2023-09-30T22:34:54.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.554+0000 7f74b1ffb700 1 -- 172.21.15.59:0/1208414082 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f74b802d350 con 0x7f74bc09d630 2023-09-30T22:34:54.554 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.556+0000 7f74c3480700 1 -- 172.21.15.59:0/1208414082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74bc09d630 msgr2=0x7f74bc1c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.556+0000 7f74c3480700 1 --2- 172.21.15.59:0/1208414082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74bc09d630 0x7f74bc1c8170 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f74b800b370 tx=0x7f74b8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.556+0000 7f74c3480700 1 -- 172.21.15.59:0/1208414082 shutdown_connections 2023-09-30T22:34:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.556+0000 7f74c3480700 1 --2- 172.21.15.59:0/1208414082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74bc09d630 0x7f74bc1c8170 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.556+0000 7f74c3480700 1 --2- 172.21.15.59:0/1208414082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74bc133930 0x7f74bc1c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.556+0000 7f74c3480700 1 --2- 172.21.15.59:0/1208414082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74bc0a0a30 0x7f74bc1c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.556+0000 7f74c3480700 1 -- 172.21.15.59:0/1208414082 >> 172.21.15.59:0/1208414082 conn(0x7f74bc0a3050 msgr2=0x7f74bc0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.556+0000 7f74c3480700 1 -- 172.21.15.59:0/1208414082 shutdown_connections 2023-09-30T22:34:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.556+0000 7f74c3480700 1 -- 172.21.15.59:0/1208414082 wait complete. 2023-09-30T22:34:54.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:54.620 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:54.655 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:54.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.764+0000 7f8deb288700 1 Processor -- start 2023-09-30T22:34:54.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.764+0000 7f8deb288700 1 -- start start 2023-09-30T22:34:54.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8deb288700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8de409e930 0x7f8de409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8deb288700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8de409f240 0x7f8de41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8deb288700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de4070940 con 0x7f8de409f650 2023-09-30T22:34:54.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8deb288700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de406fd60 con 0x7f8de409f240 2023-09-30T22:34:54.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8deb288700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8de406fa80 con 0x7f8de409e930 2023-09-30T22:34:54.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8de8823700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8de409f240 0x7f8de41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8de9024700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8de409e930 0x7f8de409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8de9825700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8de409f650 0x7f8de4131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34782/0 (socket says 172.21.15.59:34782) 2023-09-30T22:34:54.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8de8823700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8de409f240 0x7f8de41317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52308/0 (socket says 172.21.15.59:52308) 2023-09-30T22:34:54.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8de9825700 1 -- 172.21.15.59:0/754570266 learned_addr learned my addr 172.21.15.59:0/754570266 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8de3fff700 1 -- 172.21.15.59:0/754570266 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581710491 0 0) 0x7f8de4070940 con 0x7f8de409f650 2023-09-30T22:34:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8de3fff700 1 -- 172.21.15.59:0/754570266 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dcc0035b0 con 0x7f8de409f650 2023-09-30T22:34:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8de9024700 1 -- 172.21.15.59:0/754570266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8de409f240 msgr2=0x7f8de41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8de9024700 1 --2- 172.21.15.59:0/754570266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8de409f240 0x7f8de41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8de9024700 1 -- 172.21.15.59:0/754570266 >> v1:172.21.15.59:6789/0 conn(0x7f8de409f650 legacy=0x7f8de4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.765+0000 7f8de9024700 1 -- 172.21.15.59:0/754570266 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de409fb60 con 0x7f8de409e930 2023-09-30T22:34:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.766+0000 7f8de9024700 1 --2- 172.21.15.59:0/754570266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8de409e930 0x7f8de409ed00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009870 tx=0x7f8ddc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56077a4ab1bf1986 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.766+0000 7f8de3fff700 1 -- 172.21.15.59:0/754570266 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc011830 con 0x7f8de409e930 2023-09-30T22:34:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.766+0000 7f8de3fff700 1 -- 172.21.15.59:0/754570266 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc011990 con 0x7f8de409e930 2023-09-30T22:34:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.766+0000 7f8de3fff700 1 -- 172.21.15.59:0/754570266 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc011d00 con 0x7f8de409e930 2023-09-30T22:34:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.766+0000 7f8deb288700 1 -- 172.21.15.59:0/754570266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8de409e930 msgr2=0x7f8de409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.766+0000 7f8deb288700 1 --2- 172.21.15.59:0/754570266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8de409e930 0x7f8de409ed00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009870 tx=0x7f8ddc009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.767+0000 7f8deb288700 1 -- 172.21.15.59:0/754570266 shutdown_connections 2023-09-30T22:34:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.767+0000 7f8deb288700 1 --2- 172.21.15.59:0/754570266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8de409e930 0x7f8de409ed00 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.767+0000 7f8deb288700 1 --2- 172.21.15.59:0/754570266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8de409f240 0x7f8de41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.767+0000 7f8deb288700 1 -- 172.21.15.59:0/754570266 >> 172.21.15.59:0/754570266 conn(0x7f8de40a4210 msgr2=0x7f8de40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.767+0000 7f8deb288700 1 -- 172.21.15.59:0/754570266 shutdown_connections 2023-09-30T22:34:54.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.767+0000 7f8deb288700 1 -- 172.21.15.59:0/754570266 wait complete. 2023-09-30T22:34:54.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.768+0000 7f8deb288700 1 Processor -- start 2023-09-30T22:34:54.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.768+0000 7f8deb288700 1 -- start start 2023-09-30T22:34:54.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.768+0000 7f8deb288700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8de409e930 0x7f8de41a7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.768+0000 7f8deb288700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8de409f240 0x7f8de41a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.768+0000 7f8deb288700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8de409f650 0x7f8de41a7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.768+0000 7f8deb288700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de41a8ca0 con 0x7f8de409f240 2023-09-30T22:34:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.768+0000 7f8deb288700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de41a9b30 con 0x7f8de409e930 2023-09-30T22:34:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.768+0000 7f8deb288700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8de41aa610 con 0x7f8de409f650 2023-09-30T22:34:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.768+0000 7f8de8823700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8de409f240 0x7f8de41a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.768+0000 7f8de9825700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8de409f650 0x7f8de41a7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.768+0000 7f8de8823700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8de409f240 0x7f8de41a75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36734/0 (socket says 172.21.15.59:36734) 2023-09-30T22:34:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.768+0000 7f8de8823700 1 -- 172.21.15.59:0/438337070 learned_addr learned my addr 172.21.15.59:0/438337070 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:54.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.768+0000 7f8de9024700 1 --2- 172.21.15.59:0/438337070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8de409e930 0x7f8de41a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.769+0000 7f8de9825700 1 -- 172.21.15.59:0/438337070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8de409e930 msgr2=0x7f8de41a7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.769+0000 7f8de9825700 1 --2- 172.21.15.59:0/438337070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8de409e930 0x7f8de41a7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.769+0000 7f8de9825700 1 -- 172.21.15.59:0/438337070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8de409f240 msgr2=0x7f8de41a75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.769+0000 7f8de9825700 1 --2- 172.21.15.59:0/438337070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8de409f240 0x7f8de41a75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.769+0000 7f8de9825700 1 -- 172.21.15.59:0/438337070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc0094a0 con 0x7f8de409f650 2023-09-30T22:34:54.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.769+0000 7f8de9825700 1 --2- 172.21.15.59:0/438337070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8de409f650 0x7f8de41a7b10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400ca50 tx=0x7f8dd400cd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:54.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.769+0000 7f8de1ffb700 1 -- 172.21.15.59:0/438337070 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd400a9e0 con 0x7f8de409f650 2023-09-30T22:34:54.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.769+0000 7f8de1ffb700 1 -- 172.21.15.59:0/438337070 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd400ab40 con 0x7f8de409f650 2023-09-30T22:34:54.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.769+0000 7f8deb288700 1 -- 172.21.15.59:0/438337070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de40a0190 con 0x7f8de409f650 2023-09-30T22:34:54.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.769+0000 7f8de1ffb700 1 -- 172.21.15.59:0/438337070 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4012400 con 0x7f8de409f650 2023-09-30T22:34:54.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.769+0000 7f8deb288700 1 -- 172.21.15.59:0/438337070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de4071d20 con 0x7f8de409f650 2023-09-30T22:34:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.770+0000 7f8de1ffb700 1 -- 172.21.15.59:0/438337070 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8dd401b3b0 con 0x7f8de409f650 2023-09-30T22:34:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.770+0000 7f8de1ffb700 1 -- 172.21.15.59:0/438337070 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8dd403f270 con 0x7f8de409f650 2023-09-30T22:34:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.770+0000 7f8deb288700 1 -- 172.21.15.59:0/438337070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de4074ea0 con 0x7f8de409f650 2023-09-30T22:34:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.775+0000 7f8de1ffb700 1 -- 172.21.15.59:0/438337070 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8dd4017080 con 0x7f8de409f650 2023-09-30T22:34:54.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.804+0000 7f4920ad3700 1 Processor -- start 2023-09-30T22:34:54.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.804+0000 7f4920ad3700 1 -- start start 2023-09-30T22:34:54.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.804+0000 7f4920ad3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f491c0a0a30 0x7f491c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.804+0000 7f4920ad3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f491c09d630 0x7f491c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.804+0000 7f4920ad3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491c0a2a70 con 0x7f491c133930 2023-09-30T22:34:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.804+0000 7f4920ad3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c0a01d0 con 0x7f491c09d630 2023-09-30T22:34:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.805+0000 7f4920ad3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c09e2b0 con 0x7f491c0a0a30 2023-09-30T22:34:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.805+0000 7f491a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f491c0a0a30 0x7f491c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.805+0000 7f4919d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f491c09d630 0x7f491c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.805+0000 7f4919d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f491c09d630 0x7f491c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36740/0 (socket says 172.21.15.59:36740) 2023-09-30T22:34:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.805+0000 7f491a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f491c0a0a30 0x7f491c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52330/0 (socket says 172.21.15.59:52330) 2023-09-30T22:34:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.805+0000 7f4919d9b700 1 -- 172.21.15.59:0/4007086458 learned_addr learned my addr 172.21.15.59:0/4007086458 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.805+0000 7f491a59c700 1 -- 172.21.15.59:0/4007086458 >> v2:172.21.15.59:3300/0 conn(0x7f491c09d630 msgr2=0x7f491c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.805+0000 7f491a59c700 1 --2- 172.21.15.59:0/4007086458 >> v2:172.21.15.59:3300/0 conn(0x7f491c09d630 0x7f491c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.805+0000 7f491a59c700 1 -- 172.21.15.59:0/4007086458 >> v1:172.21.15.59:6789/0 conn(0x7f491c133930 legacy=0x7f491c133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.805+0000 7f491a59c700 1 -- 172.21.15.59:0/4007086458 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c09dc50 con 0x7f491c0a0a30 2023-09-30T22:34:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.805+0000 7f4919d9b700 1 --2- 172.21.15.59:0/4007086458 >> v2:172.21.15.59:3300/0 conn(0x7f491c09d630 0x7f491c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.805+0000 7f491a59c700 1 --2- 172.21.15.59:0/4007086458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f491c0a0a30 0x7f491c0a0e00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f490c009840 tx=0x7f490c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cbf11d9d55f7f38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.805+0000 7f491959a700 1 -- 172.21.15.59:0/4007086458 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c011830 con 0x7f491c0a0a30 2023-09-30T22:34:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.805+0000 7f491959a700 1 -- 172.21.15.59:0/4007086458 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490c011990 con 0x7f491c0a0a30 2023-09-30T22:34:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.805+0000 7f491959a700 1 -- 172.21.15.59:0/4007086458 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c011d20 con 0x7f491c0a0a30 2023-09-30T22:34:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.806+0000 7f4920ad3700 1 -- 172.21.15.59:0/4007086458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f491c0a0a30 msgr2=0x7f491c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.806+0000 7f4920ad3700 1 --2- 172.21.15.59:0/4007086458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f491c0a0a30 0x7f491c0a0e00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f490c009840 tx=0x7f490c009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.806+0000 7f4920ad3700 1 -- 172.21.15.59:0/4007086458 shutdown_connections 2023-09-30T22:34:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.806+0000 7f4920ad3700 1 --2- 172.21.15.59:0/4007086458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f491c0a0a30 0x7f491c0a0e00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.806+0000 7f4920ad3700 1 --2- 172.21.15.59:0/4007086458 >> v2:172.21.15.59:3300/0 conn(0x7f491c09d630 0x7f491c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.806+0000 7f4920ad3700 1 -- 172.21.15.59:0/4007086458 >> 172.21.15.59:0/4007086458 conn(0x7f491c0a3050 msgr2=0x7f491c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.806+0000 7f4920ad3700 1 -- 172.21.15.59:0/4007086458 shutdown_connections 2023-09-30T22:34:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.806+0000 7f4920ad3700 1 -- 172.21.15.59:0/4007086458 wait complete. 2023-09-30T22:34:54.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.807+0000 7f4920ad3700 1 Processor -- start 2023-09-30T22:34:54.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.808+0000 7f4920ad3700 1 -- start start 2023-09-30T22:34:54.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.808+0000 7f4920ad3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f491c09d630 0x7f491c1c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.808+0000 7f4920ad3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f491c0a0a30 0x7f491c1c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.808+0000 7f4920ad3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f491c133930 0x7f491c1c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.808+0000 7f4920ad3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c120670 con 0x7f491c09d630 2023-09-30T22:34:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.808+0000 7f4920ad3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c121e60 con 0x7f491c0a0a30 2023-09-30T22:34:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.808+0000 7f4920ad3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0a0410 con 0x7f491c133930 2023-09-30T22:34:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.808+0000 7f4919d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f491c0a0a30 0x7f491c1c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.808+0000 7f491a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f491c09d630 0x7f491c1c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.808+0000 7f4919d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f491c0a0a30 0x7f491c1c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52340/0 (socket says 172.21.15.59:52340) 2023-09-30T22:34:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.808+0000 7f4919d9b700 1 -- 172.21.15.59:0/1919052620 learned_addr learned my addr 172.21.15.59:0/1919052620 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.808+0000 7f491ad9d700 1 --2- 172.21.15.59:0/1919052620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f491c133930 0x7f491c1c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.808+0000 7f4919d9b700 1 -- 172.21.15.59:0/1919052620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f491c133930 msgr2=0x7f491c1c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.808+0000 7f4919d9b700 1 --2- 172.21.15.59:0/1919052620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f491c133930 0x7f491c1c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.808+0000 7f4919d9b700 1 -- 172.21.15.59:0/1919052620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f491c09d630 msgr2=0x7f491c1c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.809+0000 7f4919d9b700 1 --2- 172.21.15.59:0/1919052620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f491c09d630 0x7f491c1c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.809+0000 7f4919d9b700 1 -- 172.21.15.59:0/1919052620 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4910009550 con 0x7f491c0a0a30 2023-09-30T22:34:54.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.809+0000 7f491a59c700 1 --2- 172.21.15.59:0/1919052620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f491c09d630 0x7f491c1c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:54.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.809+0000 7f4919d9b700 1 --2- 172.21.15.59:0/1919052620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f491c0a0a30 0x7f491c1c86b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f491000ebe0 tx=0x7f491000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:54.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.809+0000 7f490affd700 1 -- 172.21.15.59:0/1919052620 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491000c850 con 0x7f491c0a0a30 2023-09-30T22:34:54.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.809+0000 7f490affd700 1 -- 172.21.15.59:0/1919052620 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491000c9b0 con 0x7f491c0a0a30 2023-09-30T22:34:54.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.809+0000 7f4920ad3700 1 -- 172.21.15.59:0/1919052620 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490c0094a0 con 0x7f491c0a0a30 2023-09-30T22:34:54.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.809+0000 7f490affd700 1 -- 172.21.15.59:0/1919052620 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491000cd60 con 0x7f491c0a0a30 2023-09-30T22:34:54.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.809+0000 7f4920ad3700 1 -- 172.21.15.59:0/1919052620 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c121160 con 0x7f491c0a0a30 2023-09-30T22:34:54.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.810+0000 7f490affd700 1 -- 172.21.15.59:0/1919052620 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4910013470 con 0x7f491c0a0a30 2023-09-30T22:34:54.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.810+0000 7f4920ad3700 1 -- 172.21.15.59:0/1919052620 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c0747f0 con 0x7f491c0a0a30 2023-09-30T22:34:54.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.810+0000 7f490affd700 1 -- 172.21.15.59:0/1919052620 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f491003faf0 con 0x7f491c0a0a30 2023-09-30T22:34:54.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.815+0000 7f490affd700 1 -- 172.21.15.59:0/1919052620 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f491001b3b0 con 0x7f491c0a0a30 2023-09-30T22:34:54.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.981+0000 7f8deb288700 1 -- 172.21.15.59:0/438337070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8de406b250 con 0x7f8de409f650 2023-09-30T22:34:54.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.981+0000 7f8de1ffb700 1 -- 172.21.15.59:0/438337070 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8dd40192c0 con 0x7f8de409f650 2023-09-30T22:34:54.981 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.983+0000 7f8deb288700 1 -- 172.21.15.59:0/438337070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8de409f650 msgr2=0x7f8de41a7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.983+0000 7f8deb288700 1 --2- 172.21.15.59:0/438337070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8de409f650 0x7f8de41a7b10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400ca50 tx=0x7f8dd400cd60 comp rx=0 tx=0).stop 2023-09-30T22:34:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.983+0000 7f8deb288700 1 -- 172.21.15.59:0/438337070 shutdown_connections 2023-09-30T22:34:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.983+0000 7f8deb288700 1 --2- 172.21.15.59:0/438337070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8de409f650 0x7f8de41a7b10 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.983+0000 7f8deb288700 1 --2- 172.21.15.59:0/438337070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8de409e930 0x7f8de41a7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.983+0000 7f8deb288700 1 --2- 172.21.15.59:0/438337070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8de409f240 0x7f8de41a75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.983+0000 7f8deb288700 1 -- 172.21.15.59:0/438337070 >> 172.21.15.59:0/438337070 conn(0x7f8de40a4210 msgr2=0x7f8de41b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.983+0000 7f8deb288700 1 -- 172.21.15.59:0/438337070 shutdown_connections 2023-09-30T22:34:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:54.983+0000 7f8deb288700 1 -- 172.21.15.59:0/438337070 wait complete. 2023-09-30T22:34:54.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.021+0000 7f4920ad3700 1 -- 172.21.15.59:0/1919052620 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f491c072980 con 0x7f491c0a0a30 2023-09-30T22:34:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.021+0000 7f490affd700 1 -- 172.21.15.59:0/1919052620 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f491002a090 con 0x7f491c0a0a30 2023-09-30T22:34:55.021 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.023+0000 7f4920ad3700 1 -- 172.21.15.59:0/1919052620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f491c0a0a30 msgr2=0x7f491c1c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.023+0000 7f4920ad3700 1 --2- 172.21.15.59:0/1919052620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f491c0a0a30 0x7f491c1c86b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f491000ebe0 tx=0x7f491000eef0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.023+0000 7f4920ad3700 1 -- 172.21.15.59:0/1919052620 shutdown_connections 2023-09-30T22:34:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.023+0000 7f4920ad3700 1 --2- 172.21.15.59:0/1919052620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f491c133930 0x7f491c1c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.023+0000 7f4920ad3700 1 --2- 172.21.15.59:0/1919052620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f491c09d630 0x7f491c1c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.023+0000 7f4920ad3700 1 --2- 172.21.15.59:0/1919052620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f491c0a0a30 0x7f491c1c86b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.023+0000 7f4920ad3700 1 -- 172.21.15.59:0/1919052620 >> 172.21.15.59:0/1919052620 conn(0x7f491c0a3050 msgr2=0x7f491c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.024+0000 7f4920ad3700 1 -- 172.21.15.59:0/1919052620 shutdown_connections 2023-09-30T22:34:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.024+0000 7f4920ad3700 1 -- 172.21.15.59:0/1919052620 wait complete. 2023-09-30T22:34:55.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:55.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:55.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:55.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.682+0000 7fea0c98d700 1 Processor -- start 2023-09-30T22:34:55.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.682+0000 7fea0c98d700 1 -- start start 2023-09-30T22:34:55.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.682+0000 7fea0c98d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea080a0a30 0x7fea080a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:55.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.682+0000 7fea0c98d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea080a1340 0x7fea08133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:55.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.682+0000 7fea0c98d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea0809edd0 con 0x7fea08133fa0 2023-09-30T22:34:55.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.682+0000 7fea0c98d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea0809e1f0 con 0x7fea080a1340 2023-09-30T22:34:55.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.682+0000 7fea0c98d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0809dc50 con 0x7fea080a0a30 2023-09-30T22:34:55.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.683+0000 7fea0659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea080a0a30 0x7fea080a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:55.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.683+0000 7fea05d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea080a1340 0x7fea08133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:55.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.683+0000 7fea0659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea080a0a30 0x7fea080a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52348/0 (socket says 172.21.15.59:52348) 2023-09-30T22:34:55.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.683+0000 7fea0659c700 1 -- 172.21.15.59:0/2111616004 learned_addr learned my addr 172.21.15.59:0/2111616004 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:55.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.683+0000 7fea0659c700 1 -- 172.21.15.59:0/2111616004 >> v2:172.21.15.59:3300/0 conn(0x7fea080a1340 msgr2=0x7fea08133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:55.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.683+0000 7fea0659c700 1 --2- 172.21.15.59:0/2111616004 >> v2:172.21.15.59:3300/0 conn(0x7fea080a1340 0x7fea08133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.683+0000 7fea0659c700 1 -- 172.21.15.59:0/2111616004 >> v1:172.21.15.59:6789/0 conn(0x7fea08133fa0 legacy=0x7fea0813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:55.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.683+0000 7fea0659c700 1 -- 172.21.15.59:0/2111616004 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea080a1fe0 con 0x7fea080a0a30 2023-09-30T22:34:55.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.683+0000 7fea0659c700 1 --2- 172.21.15.59:0/2111616004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea080a0a30 0x7fea080a0e00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80098f0 tx=0x7fe9f8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d772af97f70787f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:55.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.683+0000 7fea0559a700 1 -- 172.21.15.59:0/2111616004 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8011830 con 0x7fea080a0a30 2023-09-30T22:34:55.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.683+0000 7fea0559a700 1 -- 172.21.15.59:0/2111616004 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f8011990 con 0x7fea080a0a30 2023-09-30T22:34:55.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.683+0000 7fea0559a700 1 -- 172.21.15.59:0/2111616004 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8011d20 con 0x7fea080a0a30 2023-09-30T22:34:55.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.684+0000 7fea0c98d700 1 -- 172.21.15.59:0/2111616004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea080a0a30 msgr2=0x7fea080a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:55.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.684+0000 7fea0c98d700 1 --2- 172.21.15.59:0/2111616004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea080a0a30 0x7fea080a0e00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80098f0 tx=0x7fe9f8009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:55.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.684+0000 7fea0c98d700 1 -- 172.21.15.59:0/2111616004 shutdown_connections 2023-09-30T22:34:55.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.684+0000 7fea0c98d700 1 --2- 172.21.15.59:0/2111616004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea080a0a30 0x7fea080a0e00 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.684+0000 7fea0c98d700 1 --2- 172.21.15.59:0/2111616004 >> v2:172.21.15.59:3300/0 conn(0x7fea080a1340 0x7fea08133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.684+0000 7fea0c98d700 1 -- 172.21.15.59:0/2111616004 >> 172.21.15.59:0/2111616004 conn(0x7fea080a6550 msgr2=0x7fea080a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:55.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.684+0000 7fea0c98d700 1 -- 172.21.15.59:0/2111616004 shutdown_connections 2023-09-30T22:34:55.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.684+0000 7fea0c98d700 1 -- 172.21.15.59:0/2111616004 wait complete. 2023-09-30T22:34:55.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.685+0000 7fea0c98d700 1 Processor -- start 2023-09-30T22:34:55.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.685+0000 7fea0c98d700 1 -- start start 2023-09-30T22:34:55.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.686+0000 7fea0c98d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea080a0a30 0x7fea0811e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:55.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.686+0000 7fea0c98d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea080a1340 0x7fea0811eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.686+0000 7fea0c98d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea08133fa0 0x7fea0811f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.686+0000 7fea0c98d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea080a0290 con 0x7fea08133fa0 2023-09-30T22:34:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.686+0000 7fea0c98d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea081209e0 con 0x7fea080a1340 2023-09-30T22:34:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.686+0000 7fea0c98d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea08122010 con 0x7fea080a0a30 2023-09-30T22:34:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.686+0000 7fea05d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea080a1340 0x7fea0811eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.686+0000 7fea0659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea080a0a30 0x7fea0811e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.686+0000 7fea06d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea08133fa0 0x7fea0811f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.686+0000 7fea05d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea080a1340 0x7fea0811eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52352/0 (socket says 172.21.15.59:52352) 2023-09-30T22:34:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.686+0000 7fea0659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea080a0a30 0x7fea0811e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37148/0 (socket says 172.21.15.59:37148) 2023-09-30T22:34:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.686+0000 7fea05d9b700 1 -- 172.21.15.59:0/3839255400 learned_addr learned my addr 172.21.15.59:0/3839255400 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.686+0000 7fea05d9b700 1 -- 172.21.15.59:0/3839255400 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea080a0a30 msgr2=0x7fea0811e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.687+0000 7fea05d9b700 1 --2- 172.21.15.59:0/3839255400 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea080a0a30 0x7fea0811e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.687+0000 7fea05d9b700 1 -- 172.21.15.59:0/3839255400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea08133fa0 msgr2=0x7fea0811f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.687+0000 7fea05d9b700 1 --2- 172.21.15.59:0/3839255400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea08133fa0 0x7fea0811f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.687+0000 7fea05d9b700 1 -- 172.21.15.59:0/3839255400 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8009550 con 0x7fea080a1340 2023-09-30T22:34:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.687+0000 7fea0659c700 1 --2- 172.21.15.59:0/3839255400 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea080a0a30 0x7fea0811e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.687+0000 7fea05d9b700 1 --2- 172.21.15.59:0/3839255400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea080a1340 0x7fea0811eda0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc00e9b0 tx=0x7fe9fc00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.687+0000 7fe9f6ffd700 1 -- 172.21.15.59:0/3839255400 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc009710 con 0x7fea080a1340 2023-09-30T22:34:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.687+0000 7fe9f6ffd700 1 -- 172.21.15.59:0/3839255400 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9fc00ee50 con 0x7fea080a1340 2023-09-30T22:34:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.687+0000 7fe9f6ffd700 1 -- 172.21.15.59:0/3839255400 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc00ca50 con 0x7fea080a1340 2023-09-30T22:34:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.687+0000 7fea0c98d700 1 -- 172.21.15.59:0/3839255400 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea08120560 con 0x7fea080a1340 2023-09-30T22:34:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.687+0000 7fea0c98d700 1 -- 172.21.15.59:0/3839255400 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea08121d50 con 0x7fea080a1340 2023-09-30T22:34:55.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.688+0000 7fe9f6ffd700 1 -- 172.21.15.59:0/3839255400 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe9fc00cbb0 con 0x7fea080a1340 2023-09-30T22:34:55.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.688+0000 7fea0c98d700 1 -- 172.21.15.59:0/3839255400 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea08133760 con 0x7fea080a1340 2023-09-30T22:34:55.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.688+0000 7fe9f6ffd700 1 -- 172.21.15.59:0/3839255400 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe9fc03fab0 con 0x7fea080a1340 2023-09-30T22:34:55.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.693+0000 7fe9f6ffd700 1 -- 172.21.15.59:0/3839255400 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9fc01b3b0 con 0x7fea080a1340 2023-09-30T22:34:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.718+0000 7ffbc8e91700 1 Processor -- start 2023-09-30T22:34:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.718+0000 7ffbc8e91700 1 -- start start 2023-09-30T22:34:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.719+0000 7ffbc8e91700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffbc40a1510 0x7ffbc4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.719+0000 7ffbc8e91700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbc4139250 0x7ffbc413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.719+0000 7ffbc8e91700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc409edd0 con 0x7ffbc40a0a30 2023-09-30T22:34:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.719+0000 7ffbc8e91700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc40a18e0 con 0x7ffbc40a1510 2023-09-30T22:34:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.719+0000 7ffbc8e91700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc409e1f0 con 0x7ffbc4139250 2023-09-30T22:34:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.719+0000 7ffbc1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffbc40a1510 0x7ffbc4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.719+0000 7ffbc2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbc4139250 0x7ffbc413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.719+0000 7ffbc1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffbc40a1510 0x7ffbc4138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36798/0 (socket says 172.21.15.59:36798) 2023-09-30T22:34:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.719+0000 7ffbc2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbc4139250 0x7ffbc413b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52354/0 (socket says 172.21.15.59:52354) 2023-09-30T22:34:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.719+0000 7ffbc1d9b700 1 -- 172.21.15.59:0/2958988237 learned_addr learned my addr 172.21.15.59:0/2958988237 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.719+0000 7ffbc1d9b700 1 -- 172.21.15.59:0/2958988237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbc4139250 msgr2=0x7ffbc413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.719+0000 7ffbc1d9b700 1 --2- 172.21.15.59:0/2958988237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbc4139250 0x7ffbc413b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.719+0000 7ffbc1d9b700 1 -- 172.21.15.59:0/2958988237 >> v1:172.21.15.59:6789/0 conn(0x7ffbc40a0a30 legacy=0x7ffbc40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.719+0000 7ffbc1d9b700 1 -- 172.21.15.59:0/2958988237 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc409dc50 con 0x7ffbc40a1510 2023-09-30T22:34:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.720+0000 7ffbc1d9b700 1 --2- 172.21.15.59:0/2958988237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc40a1510 0x7ffbc4138d10 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80098f0 tx=0x7ffbb8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3464a094a370854 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.720+0000 7ffbc159a700 1 -- 172.21.15.59:0/2958988237 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8011830 con 0x7ffbc40a1510 2023-09-30T22:34:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.720+0000 7ffbc159a700 1 -- 172.21.15.59:0/2958988237 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb8011990 con 0x7ffbc40a1510 2023-09-30T22:34:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.720+0000 7ffbc159a700 1 -- 172.21.15.59:0/2958988237 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8011d20 con 0x7ffbc40a1510 2023-09-30T22:34:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.720+0000 7ffbc8e91700 1 -- 172.21.15.59:0/2958988237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc40a1510 msgr2=0x7ffbc4138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.720+0000 7ffbc8e91700 1 --2- 172.21.15.59:0/2958988237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc40a1510 0x7ffbc4138d10 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80098f0 tx=0x7ffbb8009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.721+0000 7ffbc8e91700 1 -- 172.21.15.59:0/2958988237 shutdown_connections 2023-09-30T22:34:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.721+0000 7ffbc8e91700 1 --2- 172.21.15.59:0/2958988237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbc4139250 0x7ffbc413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.721+0000 7ffbc8e91700 1 --2- 172.21.15.59:0/2958988237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc40a1510 0x7ffbc4138d10 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.721+0000 7ffbc8e91700 1 -- 172.21.15.59:0/2958988237 >> 172.21.15.59:0/2958988237 conn(0x7ffbc40a6550 msgr2=0x7ffbc40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.721+0000 7ffbc8e91700 1 -- 172.21.15.59:0/2958988237 shutdown_connections 2023-09-30T22:34:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.721+0000 7ffbc8e91700 1 -- 172.21.15.59:0/2958988237 wait complete. 2023-09-30T22:34:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.722+0000 7ffbc8e91700 1 Processor -- start 2023-09-30T22:34:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.722+0000 7ffbc8e91700 1 -- start start 2023-09-30T22:34:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc8e91700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbc40a0a30 0x7ffbc4137880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc8e91700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbc40a1510 0x7ffbc4137dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc8e91700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc4139250 0x7ffbc4122a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc8e91700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc4124800 con 0x7ffbc4139250 2023-09-30T22:34:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc8e91700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc41267b0 con 0x7ffbc40a0a30 2023-09-30T22:34:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc8e91700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc4138cb0 con 0x7ffbc40a1510 2023-09-30T22:34:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbc40a0a30 0x7ffbc4137880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbc40a1510 0x7ffbc4137dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbc40a0a30 0x7ffbc4137880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52364/0 (socket says 172.21.15.59:52364) 2023-09-30T22:34:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc259c700 1 -- 172.21.15.59:0/3984910412 learned_addr learned my addr 172.21.15.59:0/3984910412 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc2d9d700 1 --2- 172.21.15.59:0/3984910412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc4139250 0x7ffbc4122a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc1d9b700 1 -- 172.21.15.59:0/3984910412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbc40a0a30 msgr2=0x7ffbc4137880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc1d9b700 1 --2- 172.21.15.59:0/3984910412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbc40a0a30 0x7ffbc4137880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc1d9b700 1 -- 172.21.15.59:0/3984910412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc4139250 msgr2=0x7ffbc4122a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc1d9b700 1 --2- 172.21.15.59:0/3984910412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc4139250 0x7ffbc4122a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc1d9b700 1 -- 172.21.15.59:0/3984910412 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb8009550 con 0x7ffbc40a1510 2023-09-30T22:34:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc259c700 1 --2- 172.21.15.59:0/3984910412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbc40a0a30 0x7ffbc4137880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.723+0000 7ffbc2d9d700 1 --2- 172.21.15.59:0/3984910412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc4139250 0x7ffbc4122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.724+0000 7ffbc1d9b700 1 --2- 172.21.15.59:0/3984910412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbc40a1510 0x7ffbc4137dc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8016000 tx=0x7ffbb8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.724+0000 7ffbb2ffd700 1 -- 172.21.15.59:0/3984910412 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8004400 con 0x7ffbc40a1510 2023-09-30T22:34:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.724+0000 7ffbb2ffd700 1 -- 172.21.15.59:0/3984910412 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb801f070 con 0x7ffbc40a1510 2023-09-30T22:34:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.724+0000 7ffbc8e91700 1 -- 172.21.15.59:0/3984910412 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc4124c40 con 0x7ffbc40a1510 2023-09-30T22:34:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.724+0000 7ffbb2ffd700 1 -- 172.21.15.59:0/3984910412 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80038e0 con 0x7ffbc40a1510 2023-09-30T22:34:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.724+0000 7ffbc8e91700 1 -- 172.21.15.59:0/3984910412 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc4138300 con 0x7ffbc40a1510 2023-09-30T22:34:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.725+0000 7ffbb2ffd700 1 -- 172.21.15.59:0/3984910412 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffbb8021030 con 0x7ffbc40a1510 2023-09-30T22:34:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.725+0000 7ffbc8e91700 1 -- 172.21.15.59:0/3984910412 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc4074ea0 con 0x7ffbc40a1510 2023-09-30T22:34:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.725+0000 7ffbb2ffd700 1 -- 172.21.15.59:0/3984910412 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffbb8040a60 con 0x7ffbc40a1510 2023-09-30T22:34:55.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.730+0000 7ffbb2ffd700 1 -- 172.21.15.59:0/3984910412 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffbb800b9d0 con 0x7ffbc40a1510 2023-09-30T22:34:55.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.898+0000 7fea0c98d700 1 -- 172.21.15.59:0/3839255400 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fea08074ea0 con 0x7fea080a1340 2023-09-30T22:34:55.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.899+0000 7fe9f6ffd700 1 -- 172.21.15.59:0/3839255400 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9fc017070 con 0x7fea080a1340 2023-09-30T22:34:55.899 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:55.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.901+0000 7fea0c98d700 1 -- 172.21.15.59:0/3839255400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea080a1340 msgr2=0x7fea0811eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:55.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.901+0000 7fea0c98d700 1 --2- 172.21.15.59:0/3839255400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea080a1340 0x7fea0811eda0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc00e9b0 tx=0x7fe9fc00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.901+0000 7fea0c98d700 1 -- 172.21.15.59:0/3839255400 shutdown_connections 2023-09-30T22:34:55.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.901+0000 7fea0c98d700 1 --2- 172.21.15.59:0/3839255400 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea080a0a30 0x7fea0811e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.901+0000 7fea0c98d700 1 --2- 172.21.15.59:0/3839255400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea08133fa0 0x7fea0811f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.901+0000 7fea0c98d700 1 --2- 172.21.15.59:0/3839255400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea080a1340 0x7fea0811eda0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.901+0000 7fea0c98d700 1 -- 172.21.15.59:0/3839255400 >> 172.21.15.59:0/3839255400 conn(0x7fea080a6550 msgr2=0x7fea0809a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:55.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.901+0000 7fea0c98d700 1 -- 172.21.15.59:0/3839255400 shutdown_connections 2023-09-30T22:34:55.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.901+0000 7fea0c98d700 1 -- 172.21.15.59:0/3839255400 wait complete. 2023-09-30T22:34:55.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:55.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.932+0000 7ffbc8e91700 1 -- 172.21.15.59:0/3984910412 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffbc40a28e0 con 0x7ffbc40a1510 2023-09-30T22:34:55.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.933+0000 7ffbb2ffd700 1 -- 172.21.15.59:0/3984910412 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffbb8015020 con 0x7ffbc40a1510 2023-09-30T22:34:55.933 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.935+0000 7ffbc8e91700 1 -- 172.21.15.59:0/3984910412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbc40a1510 msgr2=0x7ffbc4137dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.935+0000 7ffbc8e91700 1 --2- 172.21.15.59:0/3984910412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbc40a1510 0x7ffbc4137dc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8016000 tx=0x7ffbb8004750 comp rx=0 tx=0).stop 2023-09-30T22:34:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.935+0000 7ffbc8e91700 1 -- 172.21.15.59:0/3984910412 shutdown_connections 2023-09-30T22:34:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.935+0000 7ffbc8e91700 1 --2- 172.21.15.59:0/3984910412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc4139250 0x7ffbc4122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.935+0000 7ffbc8e91700 1 --2- 172.21.15.59:0/3984910412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbc40a0a30 0x7ffbc4137880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.935+0000 7ffbc8e91700 1 --2- 172.21.15.59:0/3984910412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbc40a1510 0x7ffbc4137dc0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.935+0000 7ffbc8e91700 1 -- 172.21.15.59:0/3984910412 >> 172.21.15.59:0/3984910412 conn(0x7ffbc40a6550 msgr2=0x7ffbc40a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.935+0000 7ffbc8e91700 1 -- 172.21.15.59:0/3984910412 shutdown_connections 2023-09-30T22:34:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:55.935+0000 7ffbc8e91700 1 -- 172.21.15.59:0/3984910412 wait complete. 2023-09-30T22:34:55.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:55.998 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:56.038 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:56.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.140+0000 7f0fb2a28700 1 Processor -- start 2023-09-30T22:34:56.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.140+0000 7f0fb2a28700 1 -- start start 2023-09-30T22:34:56.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.140+0000 7f0fb2a28700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0fac09e930 0x7f0fac09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:56.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fb2a28700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09f240 0x7f0fac1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:56.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fb2a28700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 0x7f0fac131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:56.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fb2a28700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac070940 con 0x7f0fac09e930 2023-09-30T22:34:56.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fb2a28700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac06fd60 con 0x7f0fac09f240 2023-09-30T22:34:56.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fb2a28700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac06fa80 con 0x7f0fac09f650 2023-09-30T22:34:56.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fabfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0fac09e930 0x7f0fac09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:56.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09f240 0x7f0fac1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:56.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fb0fc5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 0x7f0fac131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:56.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fabfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0fac09e930 0x7f0fac09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36820/0 (socket says 172.21.15.59:36820) 2023-09-30T22:34:56.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09f240 0x7f0fac1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52366/0 (socket says 172.21.15.59:52366) 2023-09-30T22:34:56.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fabfff700 1 -- 172.21.15.59:0/230219662 learned_addr learned my addr 172.21.15.59:0/230219662 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:56.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fab7fe700 1 -- 172.21.15.59:0/230219662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 msgr2=0x7f0fac131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fab7fe700 1 --2- 172.21.15.59:0/230219662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 0x7f0fac131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fab7fe700 1 -- 172.21.15.59:0/230219662 >> v2:172.21.15.59:3300/0 conn(0x7f0fac09e930 msgr2=0x7f0fac09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fab7fe700 1 --2- 172.21.15.59:0/230219662 >> v2:172.21.15.59:3300/0 conn(0x7f0fac09e930 0x7f0fac09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fab7fe700 1 -- 172.21.15.59:0/230219662 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac09fb60 con 0x7f0fac09f240 2023-09-30T22:34:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fabfff700 1 --2- 172.21.15.59:0/230219662 >> v2:172.21.15.59:3300/0 conn(0x7f0fac09e930 0x7f0fac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fb0fc5700 1 --2- 172.21.15.59:0/230219662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 0x7f0fac131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.141+0000 7f0fab7fe700 1 --2- 172.21.15.59:0/230219662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09f240 0x7f0fac1317f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0009840 tx=0x7f0fa0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=829dc179fb9dacca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.142+0000 7f0faaffd700 1 -- 172.21.15.59:0/230219662 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0011830 con 0x7f0fac09f240 2023-09-30T22:34:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.142+0000 7f0faaffd700 1 -- 172.21.15.59:0/230219662 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa0011990 con 0x7f0fac09f240 2023-09-30T22:34:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.142+0000 7f0faaffd700 1 -- 172.21.15.59:0/230219662 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0011d20 con 0x7f0fac09f240 2023-09-30T22:34:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.142+0000 7f0fb2a28700 1 -- 172.21.15.59:0/230219662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09f240 msgr2=0x7f0fac1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:56.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.142+0000 7f0fb2a28700 1 --2- 172.21.15.59:0/230219662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09f240 0x7f0fac1317f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0009840 tx=0x7f0fa0009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:56.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.142+0000 7f0fb2a28700 1 -- 172.21.15.59:0/230219662 shutdown_connections 2023-09-30T22:34:56.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.142+0000 7f0fb2a28700 1 --2- 172.21.15.59:0/230219662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 0x7f0fac131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.142+0000 7f0fb2a28700 1 --2- 172.21.15.59:0/230219662 >> v2:172.21.15.59:3300/0 conn(0x7f0fac09e930 0x7f0fac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.142+0000 7f0fb2a28700 1 --2- 172.21.15.59:0/230219662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09f240 0x7f0fac1317f0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.142+0000 7f0fb2a28700 1 -- 172.21.15.59:0/230219662 >> 172.21.15.59:0/230219662 conn(0x7f0fac0a4210 msgr2=0x7f0fac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:56.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.142+0000 7f0fb2a28700 1 -- 172.21.15.59:0/230219662 shutdown_connections 2023-09-30T22:34:56.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.142+0000 7f0fb2a28700 1 -- 172.21.15.59:0/230219662 wait complete. 2023-09-30T22:34:56.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.144+0000 7f0fb2a28700 1 Processor -- start 2023-09-30T22:34:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.144+0000 7f0fb2a28700 1 -- start start 2023-09-30T22:34:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fb2a28700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fac09e930 0x7f0fac1a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fb2a28700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09f240 0x7f0fac1a32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fb2a28700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 0x7f0fac1a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fb2a28700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac1a6500 con 0x7f0fac09e930 2023-09-30T22:34:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fb2a28700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac1a49e0 con 0x7f0fac09f240 2023-09-30T22:34:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fb2a28700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0a3530 con 0x7f0fac09f650 2023-09-30T22:34:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fabfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fac09e930 0x7f0fac1a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fb0fc5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 0x7f0fac1a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fabfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fac09e930 0x7f0fac1a2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36830/0 (socket says 172.21.15.59:36830) 2023-09-30T22:34:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fabfff700 1 -- 172.21.15.59:0/698122084 learned_addr learned my addr 172.21.15.59:0/698122084 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fab7fe700 1 --2- 172.21.15.59:0/698122084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09f240 0x7f0fac1a32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fb0fc5700 1 -- 172.21.15.59:0/698122084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09f240 msgr2=0x7f0fac1a32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fb0fc5700 1 --2- 172.21.15.59:0/698122084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09f240 0x7f0fac1a32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fb0fc5700 1 -- 172.21.15.59:0/698122084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fac09e930 msgr2=0x7f0fac1a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fb0fc5700 1 --2- 172.21.15.59:0/698122084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fac09e930 0x7f0fac1a2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fb0fc5700 1 -- 172.21.15.59:0/698122084 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c009550 con 0x7f0fac09f650 2023-09-30T22:34:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fabfff700 1 --2- 172.21.15.59:0/698122084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fac09e930 0x7f0fac1a2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.145+0000 7f0fab7fe700 1 --2- 172.21.15.59:0/698122084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09f240 0x7f0fac1a32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.146+0000 7f0fb0fc5700 1 --2- 172.21.15.59:0/698122084 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 0x7f0fac1a3820 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400efc0 tx=0x7f0fa400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.146+0000 7f0fa8ff9700 1 -- 172.21.15.59:0/698122084 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa400ca90 con 0x7f0fac09f650 2023-09-30T22:34:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.146+0000 7f0fa8ff9700 1 -- 172.21.15.59:0/698122084 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa400f040 con 0x7f0fac09f650 2023-09-30T22:34:56.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.146+0000 7f0fa8ff9700 1 -- 172.21.15.59:0/698122084 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa400ce30 con 0x7f0fac09f650 2023-09-30T22:34:56.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.146+0000 7f0fb2a28700 1 -- 172.21.15.59:0/698122084 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa4009a70 con 0x7f0fac09f650 2023-09-30T22:34:56.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.146+0000 7f0fb2a28700 1 -- 172.21.15.59:0/698122084 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa00094a0 con 0x7f0fac09f650 2023-09-30T22:34:56.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.147+0000 7f0fa8ff9700 1 -- 172.21.15.59:0/698122084 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0fa4014480 con 0x7f0fac09f650 2023-09-30T22:34:56.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.147+0000 7f0fa8ff9700 1 -- 172.21.15.59:0/698122084 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0fa403fcd0 con 0x7f0fac09f650 2023-09-30T22:34:56.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.147+0000 7f0fb2a28700 1 -- 172.21.15.59:0/698122084 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac074ea0 con 0x7f0fac09f650 2023-09-30T22:34:56.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.152+0000 7f0fa8ff9700 1 -- 172.21.15.59:0/698122084 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0fa4012910 con 0x7f0fac09f650 2023-09-30T22:34:56.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.194+0000 7fa946ad0700 1 Processor -- start 2023-09-30T22:34:56.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.194+0000 7fa946ad0700 1 -- start start 2023-09-30T22:34:56.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.195+0000 7fa946ad0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9401316c0 0x7fa940131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:56.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.195+0000 7fa946ad0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94006ae80 0x7fa940139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:56.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.195+0000 7fa946ad0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94009e130 con 0x7fa94009d9f0 2023-09-30T22:34:56.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.195+0000 7fa946ad0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9401312b0 con 0x7fa9401316c0 2023-09-30T22:34:56.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.195+0000 7fa946ad0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa94009f6e0 con 0x7fa94006ae80 2023-09-30T22:34:56.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.195+0000 7fa94486c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9401316c0 0x7fa940131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:56.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.195+0000 7fa94506d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94006ae80 0x7fa940139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:56.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.195+0000 7fa94486c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9401316c0 0x7fa940131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36836/0 (socket says 172.21.15.59:36836) 2023-09-30T22:34:56.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.195+0000 7fa94486c700 1 -- 172.21.15.59:0/53781512 learned_addr learned my addr 172.21.15.59:0/53781512 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:56.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.195+0000 7fa94506d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94006ae80 0x7fa940139550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37186/0 (socket says 172.21.15.59:37186) 2023-09-30T22:34:56.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.196+0000 7fa94486c700 1 -- 172.21.15.59:0/53781512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94006ae80 msgr2=0x7fa940139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:56.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.196+0000 7fa94486c700 1 --2- 172.21.15.59:0/53781512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94006ae80 0x7fa940139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.196+0000 7fa94486c700 1 -- 172.21.15.59:0/53781512 >> v1:172.21.15.59:6789/0 conn(0x7fa94009d9f0 legacy=0x7fa94006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:56.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.196+0000 7fa94486c700 1 -- 172.21.15.59:0/53781512 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94009e760 con 0x7fa9401316c0 2023-09-30T22:34:56.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.196+0000 7fa94506d700 1 --2- 172.21.15.59:0/53781512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94006ae80 0x7fa940139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:56.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.196+0000 7fa94486c700 1 --2- 172.21.15.59:0/53781512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9401316c0 0x7fa940131a90 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fa9300098f0 tx=0x7fa930009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0587c00c139047 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:56.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.196+0000 7fa93f7fe700 1 -- 172.21.15.59:0/53781512 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930004230 con 0x7fa9401316c0 2023-09-30T22:34:56.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.196+0000 7fa93f7fe700 1 -- 172.21.15.59:0/53781512 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa930004390 con 0x7fa9401316c0 2023-09-30T22:34:56.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.196+0000 7fa93f7fe700 1 -- 172.21.15.59:0/53781512 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9300036a0 con 0x7fa9401316c0 2023-09-30T22:34:56.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.197+0000 7fa946ad0700 1 -- 172.21.15.59:0/53781512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9401316c0 msgr2=0x7fa940131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:56.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.197+0000 7fa946ad0700 1 --2- 172.21.15.59:0/53781512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9401316c0 0x7fa940131a90 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fa9300098f0 tx=0x7fa930009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:56.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.197+0000 7fa946ad0700 1 -- 172.21.15.59:0/53781512 shutdown_connections 2023-09-30T22:34:56.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.197+0000 7fa946ad0700 1 --2- 172.21.15.59:0/53781512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94006ae80 0x7fa940139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.197+0000 7fa946ad0700 1 --2- 172.21.15.59:0/53781512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9401316c0 0x7fa940131a90 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.197+0000 7fa946ad0700 1 -- 172.21.15.59:0/53781512 >> 172.21.15.59:0/53781512 conn(0x7fa940066f50 msgr2=0x7fa94009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:56.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.197+0000 7fa946ad0700 1 -- 172.21.15.59:0/53781512 shutdown_connections 2023-09-30T22:34:56.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.197+0000 7fa946ad0700 1 -- 172.21.15.59:0/53781512 wait complete. 2023-09-30T22:34:56.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.198+0000 7fa946ad0700 1 Processor -- start 2023-09-30T22:34:56.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.198+0000 7fa946ad0700 1 -- start start 2023-09-30T22:34:56.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa946ad0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94006ae80 0x7fa940070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:56.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa946ad0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa94009d9f0 0x7fa940071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:56.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa946ad0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9401316c0 0x7fa940071640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:56.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa946ad0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa940072690 con 0x7fa9401316c0 2023-09-30T22:34:56.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa946ad0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9401198b0 con 0x7fa94009d9f0 2023-09-30T22:34:56.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa946ad0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa94011afe0 con 0x7fa94006ae80 2023-09-30T22:34:56.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa94486c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94006ae80 0x7fa940070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:56.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa94506d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9401316c0 0x7fa940071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:56.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa94486c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94006ae80 0x7fa940070bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37194/0 (socket says 172.21.15.59:37194) 2023-09-30T22:34:56.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa94486c700 1 -- 172.21.15.59:0/2559124926 learned_addr learned my addr 172.21.15.59:0/2559124926 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:56.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa93ffff700 1 --2- 172.21.15.59:0/2559124926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa94009d9f0 0x7fa940071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:56.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa94486c700 1 -- 172.21.15.59:0/2559124926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa94009d9f0 msgr2=0x7fa940071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:56.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa94486c700 1 --2- 172.21.15.59:0/2559124926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa94009d9f0 0x7fa940071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa94486c700 1 -- 172.21.15.59:0/2559124926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9401316c0 msgr2=0x7fa940071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:56.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa94486c700 1 --2- 172.21.15.59:0/2559124926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9401316c0 0x7fa940071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa94486c700 1 -- 172.21.15.59:0/2559124926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa938009a70 con 0x7fa94006ae80 2023-09-30T22:34:56.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa94506d700 1 --2- 172.21.15.59:0/2559124926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9401316c0 0x7fa940071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:56.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.199+0000 7fa94486c700 1 --2- 172.21.15.59:0/2559124926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94006ae80 0x7fa940070bc0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa930009130 tx=0x7fa930004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:56.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.200+0000 7fa93d7fa700 1 -- 172.21.15.59:0/2559124926 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930003b50 con 0x7fa94006ae80 2023-09-30T22:34:56.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.200+0000 7fa93d7fa700 1 -- 172.21.15.59:0/2559124926 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93001f070 con 0x7fa94006ae80 2023-09-30T22:34:56.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.200+0000 7fa946ad0700 1 -- 172.21.15.59:0/2559124926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa930009550 con 0x7fa94006ae80 2023-09-30T22:34:56.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.200+0000 7fa93d7fa700 1 -- 172.21.15.59:0/2559124926 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930011630 con 0x7fa94006ae80 2023-09-30T22:34:56.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.200+0000 7fa946ad0700 1 -- 172.21.15.59:0/2559124926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94011aa40 con 0x7fa94006ae80 2023-09-30T22:34:56.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.200+0000 7fa93d7fa700 1 -- 172.21.15.59:0/2559124926 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa930021030 con 0x7fa94006ae80 2023-09-30T22:34:56.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.201+0000 7fa93d7fa700 1 -- 172.21.15.59:0/2559124926 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa9300409e0 con 0x7fa94006ae80 2023-09-30T22:34:56.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.201+0000 7fa946ad0700 1 -- 172.21.15.59:0/2559124926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94009e130 con 0x7fa94006ae80 2023-09-30T22:34:56.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.206+0000 7fa93d7fa700 1 -- 172.21.15.59:0/2559124926 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa94009e130 con 0x7fa94006ae80 2023-09-30T22:34:56.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.371+0000 7f0fb2a28700 1 -- 172.21.15.59:0/698122084 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0fac06b250 con 0x7f0fac09f650 2023-09-30T22:34:56.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.371+0000 7f0fa8ff9700 1 -- 172.21.15.59:0/698122084 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0fa4009cc0 con 0x7f0fac09f650 2023-09-30T22:34:56.372 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:56.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.374+0000 7f0fb2a28700 1 -- 172.21.15.59:0/698122084 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 msgr2=0x7f0fac1a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:56.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.374+0000 7f0fb2a28700 1 --2- 172.21.15.59:0/698122084 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 0x7f0fac1a3820 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400efc0 tx=0x7f0fa400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.374+0000 7f0fb2a28700 1 -- 172.21.15.59:0/698122084 shutdown_connections 2023-09-30T22:34:56.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.374+0000 7f0fb2a28700 1 --2- 172.21.15.59:0/698122084 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0fac09f650 0x7f0fac1a3820 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.374+0000 7f0fb2a28700 1 --2- 172.21.15.59:0/698122084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fac09e930 0x7f0fac1a2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.374+0000 7f0fb2a28700 1 --2- 172.21.15.59:0/698122084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fac09f240 0x7f0fac1a32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.374+0000 7f0fb2a28700 1 -- 172.21.15.59:0/698122084 >> 172.21.15.59:0/698122084 conn(0x7f0fac0a4210 msgr2=0x7f0fac09c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:56.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.374+0000 7f0fb2a28700 1 -- 172.21.15.59:0/698122084 shutdown_connections 2023-09-30T22:34:56.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.374+0000 7f0fb2a28700 1 -- 172.21.15.59:0/698122084 wait complete. 2023-09-30T22:34:56.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:56.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.411+0000 7fa946ad0700 1 -- 172.21.15.59:0/2559124926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa94009e130 con 0x7fa94006ae80 2023-09-30T22:34:56.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.411+0000 7fa93d7fa700 1 -- 172.21.15.59:0/2559124926 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa94009e130 con 0x7fa94006ae80 2023-09-30T22:34:56.413 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:56.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.413+0000 7fa946ad0700 1 -- 172.21.15.59:0/2559124926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94006ae80 msgr2=0x7fa940070bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:56.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.413+0000 7fa946ad0700 1 --2- 172.21.15.59:0/2559124926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94006ae80 0x7fa940070bc0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa930009130 tx=0x7fa930004750 comp rx=0 tx=0).stop 2023-09-30T22:34:56.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.413+0000 7fa946ad0700 1 -- 172.21.15.59:0/2559124926 shutdown_connections 2023-09-30T22:34:56.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.413+0000 7fa946ad0700 1 --2- 172.21.15.59:0/2559124926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94006ae80 0x7fa940070bc0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.413+0000 7fa946ad0700 1 --2- 172.21.15.59:0/2559124926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9401316c0 0x7fa940071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.413+0000 7fa946ad0700 1 --2- 172.21.15.59:0/2559124926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa94009d9f0 0x7fa940071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:56.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.413+0000 7fa946ad0700 1 -- 172.21.15.59:0/2559124926 >> 172.21.15.59:0/2559124926 conn(0x7fa940066f50 msgr2=0x7fa9400a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:56.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.413+0000 7fa946ad0700 1 -- 172.21.15.59:0/2559124926 shutdown_connections 2023-09-30T22:34:56.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:56.413+0000 7fa946ad0700 1 -- 172.21.15.59:0/2559124926 wait complete. 2023-09-30T22:34:56.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:56.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:56.950 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:57.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.064+0000 7fadec119700 1 Processor -- start 2023-09-30T22:34:57.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.064+0000 7fadec119700 1 -- start start 2023-09-30T22:34:57.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.064+0000 7fadec119700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fade409d630 0x7fade40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.064+0000 7fadec119700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fade4138d80 0x7fade413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.064+0000 7fadec119700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade40a2a70 con 0x7fade40a0a30 2023-09-30T22:34:57.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.064+0000 7fadec119700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade40a01d0 con 0x7fade409d630 2023-09-30T22:34:57.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.064+0000 7fadec119700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fade409e2b0 con 0x7fade4138d80 2023-09-30T22:34:57.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.065+0000 7fadea6b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fade4138d80 0x7fade413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.065+0000 7fade96b4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fade409d630 0x7fade40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.065+0000 7fadea6b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fade4138d80 0x7fade413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37206/0 (socket says 172.21.15.59:37206) 2023-09-30T22:34:57.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.065+0000 7fade96b4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fade409d630 0x7fade40a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36866/0 (socket says 172.21.15.59:36866) 2023-09-30T22:34:57.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.065+0000 7fadea6b6700 1 -- 172.21.15.59:0/555181108 learned_addr learned my addr 172.21.15.59:0/555181108 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:57.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.065+0000 7fadea6b6700 1 -- 172.21.15.59:0/555181108 >> v2:172.21.15.59:3300/0 conn(0x7fade409d630 msgr2=0x7fade40a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:57.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.065+0000 7fadea6b6700 1 --2- 172.21.15.59:0/555181108 >> v2:172.21.15.59:3300/0 conn(0x7fade409d630 0x7fade40a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.065+0000 7fadea6b6700 1 -- 172.21.15.59:0/555181108 >> v1:172.21.15.59:6789/0 conn(0x7fade40a0a30 legacy=0x7fade40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.065+0000 7fade8eb3700 1 -- 172.21.15.59:0/555181108 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589134774 0 0) 0x7fade40a2a70 con 0x7fade40a0a30 2023-09-30T22:34:57.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.065+0000 7fadea6b6700 1 -- 172.21.15.59:0/555181108 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade409dc50 con 0x7fade4138d80 2023-09-30T22:34:57.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.065+0000 7fade96b4700 1 --2- 172.21.15.59:0/555181108 >> v2:172.21.15.59:3300/0 conn(0x7fade409d630 0x7fade40a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:57.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.065+0000 7fadea6b6700 1 --2- 172.21.15.59:0/555181108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fade4138d80 0x7fade413b160 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7faddc0098f0 tx=0x7faddc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86d7881bc4f5c04e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:57.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.065+0000 7fade8eb3700 1 -- 172.21.15.59:0/555181108 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc011830 con 0x7fade4138d80 2023-09-30T22:34:57.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.065+0000 7fade8eb3700 1 -- 172.21.15.59:0/555181108 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faddc011990 con 0x7fade4138d80 2023-09-30T22:34:57.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.065+0000 7fade8eb3700 1 -- 172.21.15.59:0/555181108 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc011d20 con 0x7fade4138d80 2023-09-30T22:34:57.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.066+0000 7fadec119700 1 -- 172.21.15.59:0/555181108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fade4138d80 msgr2=0x7fade413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.066+0000 7fadec119700 1 --2- 172.21.15.59:0/555181108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fade4138d80 0x7fade413b160 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7faddc0098f0 tx=0x7faddc009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:57.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.066+0000 7fadec119700 1 -- 172.21.15.59:0/555181108 shutdown_connections 2023-09-30T22:34:57.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.066+0000 7fadec119700 1 --2- 172.21.15.59:0/555181108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fade4138d80 0x7fade413b160 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.066+0000 7fadec119700 1 --2- 172.21.15.59:0/555181108 >> v2:172.21.15.59:3300/0 conn(0x7fade409d630 0x7fade40a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.066+0000 7fadec119700 1 -- 172.21.15.59:0/555181108 >> 172.21.15.59:0/555181108 conn(0x7fade40a3050 msgr2=0x7fade40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:57.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.066+0000 7fadec119700 1 -- 172.21.15.59:0/555181108 shutdown_connections 2023-09-30T22:34:57.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.066+0000 7fadec119700 1 -- 172.21.15.59:0/555181108 wait complete. 2023-09-30T22:34:57.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.067+0000 7fadec119700 1 Processor -- start 2023-09-30T22:34:57.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.067+0000 7fadec119700 1 -- start start 2023-09-30T22:34:57.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fadec119700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fade409d630 0x7fade4133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fadec119700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fade40a0a30 0x7fade4133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fadec119700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fade4138d80 0x7fade4134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fadec119700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade4137180 con 0x7fade4138d80 2023-09-30T22:34:57.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fadec119700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade4136070 con 0x7fade40a0a30 2023-09-30T22:34:57.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fadec119700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fade4136530 con 0x7fade409d630 2023-09-30T22:34:57.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fadea6b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fade4138d80 0x7fade4134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fade96b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fade40a0a30 0x7fade4133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fade9eb5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fade409d630 0x7fade4133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fadea6b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fade4138d80 0x7fade4134180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36882/0 (socket says 172.21.15.59:36882) 2023-09-30T22:34:57.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fade96b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fade40a0a30 0x7fade4133c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52406/0 (socket says 172.21.15.59:52406) 2023-09-30T22:34:57.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fadea6b6700 1 -- 172.21.15.59:0/2499813454 learned_addr learned my addr 172.21.15.59:0/2499813454 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:57.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fade9eb5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fade409d630 0x7fade4133700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37210/0 (socket says 172.21.15.59:37210) 2023-09-30T22:34:57.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fadea6b6700 1 -- 172.21.15.59:0/2499813454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fade409d630 msgr2=0x7fade4133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fadea6b6700 1 --2- 172.21.15.59:0/2499813454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fade409d630 0x7fade4133700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fadea6b6700 1 -- 172.21.15.59:0/2499813454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fade40a0a30 msgr2=0x7fade4133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fadea6b6700 1 --2- 172.21.15.59:0/2499813454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fade40a0a30 0x7fade4133c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fadea6b6700 1 -- 172.21.15.59:0/2499813454 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd80094a0 con 0x7fade4138d80 2023-09-30T22:34:57.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fade96b4700 1 --2- 172.21.15.59:0/2499813454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fade40a0a30 0x7fade4133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:57.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.068+0000 7fadea6b6700 1 --2- 172.21.15.59:0/2499813454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fade4138d80 0x7fade4134180 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7faddc013000 tx=0x7faddc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:57.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.069+0000 7fade27fc700 1 -- 172.21.15.59:0/2499813454 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc004510 con 0x7fade4138d80 2023-09-30T22:34:57.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.069+0000 7fade27fc700 1 -- 172.21.15.59:0/2499813454 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faddc0036a0 con 0x7fade4138d80 2023-09-30T22:34:57.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.069+0000 7fade27fc700 1 -- 172.21.15.59:0/2499813454 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc003a50 con 0x7fade4138d80 2023-09-30T22:34:57.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.069+0000 7fadec119700 1 -- 172.21.15.59:0/2499813454 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc009550 con 0x7fade4138d80 2023-09-30T22:34:57.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.069+0000 7fadec119700 1 -- 172.21.15.59:0/2499813454 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade4136be0 con 0x7fade4138d80 2023-09-30T22:34:57.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.070+0000 7fade27fc700 1 -- 172.21.15.59:0/2499813454 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faddc003bb0 con 0x7fade4138d80 2023-09-30T22:34:57.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.070+0000 7fade27fc700 1 -- 172.21.15.59:0/2499813454 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faddc040780 con 0x7fade4138d80 2023-09-30T22:34:57.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.070+0000 7fadec119700 1 -- 172.21.15.59:0/2499813454 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade40747f0 con 0x7fade4138d80 2023-09-30T22:34:57.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.079+0000 7fade27fc700 1 -- 172.21.15.59:0/2499813454 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faddc015080 con 0x7fade4138d80 2023-09-30T22:34:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.105+0000 7fa79885c700 1 Processor -- start 2023-09-30T22:34:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.105+0000 7fa79885c700 1 -- start start 2023-09-30T22:34:57.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.105+0000 7fa79885c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7940a0a30 0x7fa7940a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.105+0000 7fa79885c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa79409d630 0x7fa7940a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.105+0000 7fa79885c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7940a2a70 con 0x7fa794133930 2023-09-30T22:34:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.105+0000 7fa79885c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7940a01d0 con 0x7fa7940a0a30 2023-09-30T22:34:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.105+0000 7fa79885c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa79409e2b0 con 0x7fa79409d630 2023-09-30T22:34:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.106+0000 7fa79259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7940a0a30 0x7fa7940a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.106+0000 7fa791d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa79409d630 0x7fa7940a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.106+0000 7fa792d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa794133930 0x7fa794133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34844/0 (socket says 172.21.15.59:34844) 2023-09-30T22:34:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.106+0000 7fa792d9d700 1 -- 172.21.15.59:0/4171448389 learned_addr learned my addr 172.21.15.59:0/4171448389 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.106+0000 7fa79259c700 1 -- 172.21.15.59:0/4171448389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa79409d630 msgr2=0x7fa7940a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.106+0000 7fa79259c700 1 --2- 172.21.15.59:0/4171448389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa79409d630 0x7fa7940a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.106+0000 7fa79259c700 1 -- 172.21.15.59:0/4171448389 >> v1:172.21.15.59:6789/0 conn(0x7fa794133930 legacy=0x7fa794133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.106+0000 7fa79259c700 1 -- 172.21.15.59:0/4171448389 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79409dc50 con 0x7fa7940a0a30 2023-09-30T22:34:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.106+0000 7fa79159a700 1 -- 172.21.15.59:0/4171448389 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816235482 0 0) 0x7fa7940a2a70 con 0x7fa794133930 2023-09-30T22:34:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.106+0000 7fa791d9b700 1 --2- 172.21.15.59:0/4171448389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa79409d630 0x7fa7940a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.106+0000 7fa79259c700 1 --2- 172.21.15.59:0/4171448389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7940a0a30 0x7fa7940a0e00 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fa784009840 tx=0x7fa784009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1087cf034630f41f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.106+0000 7fa79159a700 1 -- 172.21.15.59:0/4171448389 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784011830 con 0x7fa7940a0a30 2023-09-30T22:34:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.106+0000 7fa79159a700 1 -- 172.21.15.59:0/4171448389 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa784011990 con 0x7fa7940a0a30 2023-09-30T22:34:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.106+0000 7fa79159a700 1 -- 172.21.15.59:0/4171448389 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784011d20 con 0x7fa7940a0a30 2023-09-30T22:34:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.107+0000 7fa79885c700 1 -- 172.21.15.59:0/4171448389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7940a0a30 msgr2=0x7fa7940a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.107+0000 7fa79885c700 1 --2- 172.21.15.59:0/4171448389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7940a0a30 0x7fa7940a0e00 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fa784009840 tx=0x7fa784009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:57.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.107+0000 7fa79885c700 1 -- 172.21.15.59:0/4171448389 shutdown_connections 2023-09-30T22:34:57.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.107+0000 7fa79885c700 1 --2- 172.21.15.59:0/4171448389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7940a0a30 0x7fa7940a0e00 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.107+0000 7fa79885c700 1 --2- 172.21.15.59:0/4171448389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa79409d630 0x7fa7940a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.107+0000 7fa79885c700 1 -- 172.21.15.59:0/4171448389 >> 172.21.15.59:0/4171448389 conn(0x7fa7940a3050 msgr2=0x7fa7940a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:57.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.107+0000 7fa79885c700 1 -- 172.21.15.59:0/4171448389 shutdown_connections 2023-09-30T22:34:57.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.107+0000 7fa79885c700 1 -- 172.21.15.59:0/4171448389 wait complete. 2023-09-30T22:34:57.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.108+0000 7fa79885c700 1 Processor -- start 2023-09-30T22:34:57.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.108+0000 7fa79885c700 1 -- start start 2023-09-30T22:34:57.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa79885c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79409d630 0x7fa7941c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa79885c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7940a0a30 0x7fa7941c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa79885c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa794133930 0x7fa7941c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa79885c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa794120620 con 0x7fa79409d630 2023-09-30T22:34:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa79885c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940a42c0 con 0x7fa7940a0a30 2023-09-30T22:34:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa79885c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940a0410 con 0x7fa794133930 2023-09-30T22:34:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa79259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79409d630 0x7fa7941c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa79259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79409d630 0x7fa7941c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36890/0 (socket says 172.21.15.59:36890) 2023-09-30T22:34:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa79259c700 1 -- 172.21.15.59:0/1042824861 learned_addr learned my addr 172.21.15.59:0/1042824861 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa792d9d700 1 --2- 172.21.15.59:0/1042824861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa794133930 0x7fa7941c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa791d9b700 1 --2- 172.21.15.59:0/1042824861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7940a0a30 0x7fa7941c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa79259c700 1 -- 172.21.15.59:0/1042824861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa794133930 msgr2=0x7fa7941c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa79259c700 1 --2- 172.21.15.59:0/1042824861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa794133930 0x7fa7941c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa79259c700 1 -- 172.21.15.59:0/1042824861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7940a0a30 msgr2=0x7fa7941c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa79259c700 1 --2- 172.21.15.59:0/1042824861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7940a0a30 0x7fa7941c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa79259c700 1 -- 172.21.15.59:0/1042824861 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7880094a0 con 0x7fa79409d630 2023-09-30T22:34:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.109+0000 7fa791d9b700 1 --2- 172.21.15.59:0/1042824861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7940a0a30 0x7fa7941c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.110+0000 7fa79259c700 1 --2- 172.21.15.59:0/1042824861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79409d630 0x7fa7941c7e80 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fa784009fd0 tx=0x7fa784004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.110+0000 7fa782ffd700 1 -- 172.21.15.59:0/1042824861 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784004480 con 0x7fa79409d630 2023-09-30T22:34:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.110+0000 7fa782ffd700 1 -- 172.21.15.59:0/1042824861 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78401f070 con 0x7fa79409d630 2023-09-30T22:34:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.110+0000 7fa79885c700 1 -- 172.21.15.59:0/1042824861 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7840094a0 con 0x7fa79409d630 2023-09-30T22:34:57.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.110+0000 7fa782ffd700 1 -- 172.21.15.59:0/1042824861 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7840038e0 con 0x7fa79409d630 2023-09-30T22:34:57.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.110+0000 7fa79885c700 1 -- 172.21.15.59:0/1042824861 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7941334c0 con 0x7fa79409d630 2023-09-30T22:34:57.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.111+0000 7fa782ffd700 1 -- 172.21.15.59:0/1042824861 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa784021030 con 0x7fa79409d630 2023-09-30T22:34:57.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.111+0000 7fa782ffd700 1 -- 172.21.15.59:0/1042824861 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa784040840 con 0x7fa79409d630 2023-09-30T22:34:57.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.111+0000 7fa79885c700 1 -- 172.21.15.59:0/1042824861 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7940747f0 con 0x7fa79409d630 2023-09-30T22:34:57.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.116+0000 7fa782ffd700 1 -- 172.21.15.59:0/1042824861 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa784003a40 con 0x7fa79409d630 2023-09-30T22:34:57.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.285+0000 7fadec119700 1 -- 172.21.15.59:0/2499813454 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fade4137970 con 0x7fade4138d80 2023-09-30T22:34:57.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.286+0000 7fade27fc700 1 -- 172.21.15.59:0/2499813454 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faddc028020 con 0x7fade4138d80 2023-09-30T22:34:57.286 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:57.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.288+0000 7fadec119700 1 -- 172.21.15.59:0/2499813454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fade4138d80 msgr2=0x7fade4134180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.288+0000 7fadec119700 1 --2- 172.21.15.59:0/2499813454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fade4138d80 0x7fade4134180 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7faddc013000 tx=0x7faddc004750 comp rx=0 tx=0).stop 2023-09-30T22:34:57.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.288+0000 7fadec119700 1 -- 172.21.15.59:0/2499813454 shutdown_connections 2023-09-30T22:34:57.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.288+0000 7fadec119700 1 --2- 172.21.15.59:0/2499813454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fade409d630 0x7fade4133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.288+0000 7fadec119700 1 --2- 172.21.15.59:0/2499813454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fade4138d80 0x7fade4134180 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.288+0000 7fadec119700 1 --2- 172.21.15.59:0/2499813454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fade40a0a30 0x7fade4133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.288+0000 7fadec119700 1 -- 172.21.15.59:0/2499813454 >> 172.21.15.59:0/2499813454 conn(0x7fade40a3050 msgr2=0x7fade409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:57.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.288+0000 7fadec119700 1 -- 172.21.15.59:0/2499813454 shutdown_connections 2023-09-30T22:34:57.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.288+0000 7fadec119700 1 -- 172.21.15.59:0/2499813454 wait complete. 2023-09-30T22:34:57.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:57.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.321+0000 7fa79885c700 1 -- 172.21.15.59:0/1042824861 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa794072980 con 0x7fa79409d630 2023-09-30T22:34:57.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.321+0000 7fa782ffd700 1 -- 172.21.15.59:0/1042824861 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa784015030 con 0x7fa79409d630 2023-09-30T22:34:57.321 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:57.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.323+0000 7fa79885c700 1 -- 172.21.15.59:0/1042824861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79409d630 msgr2=0x7fa7941c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.323+0000 7fa79885c700 1 --2- 172.21.15.59:0/1042824861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79409d630 0x7fa7941c7e80 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fa784009fd0 tx=0x7fa784004750 comp rx=0 tx=0).stop 2023-09-30T22:34:57.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.323+0000 7fa79885c700 1 -- 172.21.15.59:0/1042824861 shutdown_connections 2023-09-30T22:34:57.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.323+0000 7fa79885c700 1 --2- 172.21.15.59:0/1042824861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa794133930 0x7fa7941c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.323+0000 7fa79885c700 1 --2- 172.21.15.59:0/1042824861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79409d630 0x7fa7941c7e80 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.323+0000 7fa79885c700 1 --2- 172.21.15.59:0/1042824861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7940a0a30 0x7fa7941c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.323+0000 7fa79885c700 1 -- 172.21.15.59:0/1042824861 >> 172.21.15.59:0/1042824861 conn(0x7fa7940a3050 msgr2=0x7fa7941bb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:57.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.324+0000 7fa79885c700 1 -- 172.21.15.59:0/1042824861 shutdown_connections 2023-09-30T22:34:57.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.324+0000 7fa79885c700 1 -- 172.21.15.59:0/1042824861 wait complete. 2023-09-30T22:34:57.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:57.389 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:57.429 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:57.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.532+0000 7f9b6ede4700 1 Processor -- start 2023-09-30T22:34:57.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.532+0000 7f9b6ede4700 1 -- start start 2023-09-30T22:34:57.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.533+0000 7f9b6ede4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b68134630 0x7f9b68136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.533+0000 7f9b6ede4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b68136f50 0x7f9b68139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.533+0000 7f9b6ede4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6809b4f0 con 0x7f9b68131810 2023-09-30T22:34:57.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.533+0000 7f9b6ede4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b681313c0 con 0x7f9b68134630 2023-09-30T22:34:57.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.533+0000 7f9b6ede4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6806e8c0 con 0x7f9b68136f50 2023-09-30T22:34:57.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.533+0000 7f9b67fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b68134630 0x7f9b68136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.533+0000 7f9b6d381700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b68136f50 0x7f9b68139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.533+0000 7f9b6d381700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b68136f50 0x7f9b68139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52422/0 (socket says 172.21.15.59:52422) 2023-09-30T22:34:57.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.533+0000 7f9b67fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b68134630 0x7f9b68136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36900/0 (socket says 172.21.15.59:36900) 2023-09-30T22:34:57.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.533+0000 7f9b6d381700 1 -- 172.21.15.59:0/49906636 learned_addr learned my addr 172.21.15.59:0/49906636 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:57.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.533+0000 7f9b67fff700 1 -- 172.21.15.59:0/49906636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b68136f50 msgr2=0x7f9b68139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:57.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.533+0000 7f9b67fff700 1 --2- 172.21.15.59:0/49906636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b68136f50 0x7f9b68139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.533+0000 7f9b67fff700 1 -- 172.21.15.59:0/49906636 >> v1:172.21.15.59:6789/0 conn(0x7f9b68131810 legacy=0x7f9b68131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.533+0000 7f9b67fff700 1 -- 172.21.15.59:0/49906636 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b68071d20 con 0x7f9b68134630 2023-09-30T22:34:57.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.534+0000 7f9b67fff700 1 --2- 172.21.15.59:0/49906636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b68134630 0x7f9b68136a10 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009840 tx=0x7f9b5c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b289cb851efca7c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:57.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.534+0000 7f9b677fe700 1 -- 172.21.15.59:0/49906636 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c011830 con 0x7f9b68134630 2023-09-30T22:34:57.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.534+0000 7f9b677fe700 1 -- 172.21.15.59:0/49906636 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c011990 con 0x7f9b68134630 2023-09-30T22:34:57.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.534+0000 7f9b677fe700 1 -- 172.21.15.59:0/49906636 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c011d20 con 0x7f9b68134630 2023-09-30T22:34:57.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.534+0000 7f9b6ede4700 1 -- 172.21.15.59:0/49906636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b68134630 msgr2=0x7f9b68136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.534+0000 7f9b6ede4700 1 --2- 172.21.15.59:0/49906636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b68134630 0x7f9b68136a10 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009840 tx=0x7f9b5c009b50 comp rx=0 tx=0).stop 2023-09-30T22:34:57.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.535+0000 7f9b6ede4700 1 -- 172.21.15.59:0/49906636 shutdown_connections 2023-09-30T22:34:57.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.535+0000 7f9b6ede4700 1 --2- 172.21.15.59:0/49906636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b68136f50 0x7f9b68139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.535+0000 7f9b6ede4700 1 --2- 172.21.15.59:0/49906636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b68134630 0x7f9b68136a10 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.535+0000 7f9b6ede4700 1 -- 172.21.15.59:0/49906636 >> 172.21.15.59:0/49906636 conn(0x7f9b680a2aa0 msgr2=0x7f9b680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:57.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.535+0000 7f9b6ede4700 1 -- 172.21.15.59:0/49906636 shutdown_connections 2023-09-30T22:34:57.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.535+0000 7f9b6ede4700 1 -- 172.21.15.59:0/49906636 wait complete. 2023-09-30T22:34:57.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.536+0000 7f9b6ede4700 1 Processor -- start 2023-09-30T22:34:57.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.536+0000 7f9b6ede4700 1 -- start start 2023-09-30T22:34:57.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.537+0000 7f9b6ede4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b68131810 0x7f9b681c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.537+0000 7f9b6ede4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b68134630 0x7f9b681c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.537+0000 7f9b6ede4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b68136f50 0x7f9b681c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.537+0000 7f9b6ede4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6811a940 con 0x7f9b68131810 2023-09-30T22:34:57.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.537+0000 7f9b6ede4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6812eba0 con 0x7f9b68136f50 2023-09-30T22:34:57.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.537+0000 7f9b6ede4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b68119730 con 0x7f9b68134630 2023-09-30T22:34:57.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.537+0000 7f9b6d381700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b68136f50 0x7f9b681c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.537+0000 7f9b67fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b68134630 0x7f9b681c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.537+0000 7f9b6d381700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b68136f50 0x7f9b681c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52438/0 (socket says 172.21.15.59:52438) 2023-09-30T22:34:57.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.537+0000 7f9b6d381700 1 -- 172.21.15.59:0/565302745 learned_addr learned my addr 172.21.15.59:0/565302745 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:57.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.537+0000 7f9b6cb80700 1 --2- 172.21.15.59:0/565302745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b68131810 0x7f9b681c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.538+0000 7f9b67fff700 1 -- 172.21.15.59:0/565302745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b68136f50 msgr2=0x7f9b681c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.538+0000 7f9b67fff700 1 --2- 172.21.15.59:0/565302745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b68136f50 0x7f9b681c4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.538+0000 7f9b67fff700 1 -- 172.21.15.59:0/565302745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b68131810 msgr2=0x7f9b681c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.538+0000 7f9b67fff700 1 --2- 172.21.15.59:0/565302745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b68131810 0x7f9b681c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.538+0000 7f9b67fff700 1 -- 172.21.15.59:0/565302745 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c0094a0 con 0x7f9b68134630 2023-09-30T22:34:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.538+0000 7f9b6d381700 1 --2- 172.21.15.59:0/565302745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b68136f50 0x7f9b681c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.538+0000 7f9b67fff700 1 --2- 172.21.15.59:0/565302745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b68134630 0x7f9b681c4760 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c016000 tx=0x7f9b5c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.538+0000 7f9b657fa700 1 -- 172.21.15.59:0/565302745 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c0036a0 con 0x7f9b68134630 2023-09-30T22:34:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.538+0000 7f9b657fa700 1 -- 172.21.15.59:0/565302745 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c01f070 con 0x7f9b68134630 2023-09-30T22:34:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.538+0000 7f9b6ede4700 1 -- 172.21.15.59:0/565302745 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6806eb00 con 0x7f9b68134630 2023-09-30T22:34:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.538+0000 7f9b657fa700 1 -- 172.21.15.59:0/565302745 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c003a40 con 0x7f9b68134630 2023-09-30T22:34:57.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.538+0000 7f9b6ede4700 1 -- 172.21.15.59:0/565302745 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6811a0d0 con 0x7f9b68134630 2023-09-30T22:34:57.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.539+0000 7f9b657fa700 1 -- 172.21.15.59:0/565302745 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b5c003ba0 con 0x7f9b68134630 2023-09-30T22:34:57.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.539+0000 7f9b6ede4700 1 -- 172.21.15.59:0/565302745 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6811a4e0 con 0x7f9b68134630 2023-09-30T22:34:57.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.539+0000 7f9b657fa700 1 -- 172.21.15.59:0/565302745 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9b5c021070 con 0x7f9b68134630 2023-09-30T22:34:57.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.544+0000 7f9b657fa700 1 -- 172.21.15.59:0/565302745 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b5c026480 con 0x7f9b68134630 2023-09-30T22:34:57.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.573+0000 7f795c6d3700 1 Processor -- start 2023-09-30T22:34:57.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.573+0000 7f795c6d3700 1 -- start start 2023-09-30T22:34:57.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.573+0000 7f795c6d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79540a0a30 0x7f79540a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.573+0000 7f795c6d3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f795409d630 0x7f79540a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.573+0000 7f795c6d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7954133930 0x7f7954133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.573+0000 7f795c6d3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79540a2a70 con 0x7f795409d630 2023-09-30T22:34:57.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.573+0000 7f795c6d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79540a01d0 con 0x7f79540a0a30 2023-09-30T22:34:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.573+0000 7f795c6d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f795409e2b0 con 0x7f7954133930 2023-09-30T22:34:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f7959c6e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f795409d630 0x7f79540a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f795ac70700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7954133930 0x7f7954133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f795a46f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79540a0a30 0x7f79540a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f7959c6e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f795409d630 0x7f79540a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36912/0 (socket says 172.21.15.59:36912) 2023-09-30T22:34:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f7959c6e700 1 -- 172.21.15.59:0/663530306 learned_addr learned my addr 172.21.15.59:0/663530306 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f7959c6e700 1 -- 172.21.15.59:0/663530306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7954133930 msgr2=0x7f7954133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f7959c6e700 1 --2- 172.21.15.59:0/663530306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7954133930 0x7f7954133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f7959c6e700 1 -- 172.21.15.59:0/663530306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79540a0a30 msgr2=0x7f79540a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f7959c6e700 1 --2- 172.21.15.59:0/663530306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79540a0a30 0x7f79540a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f7959c6e700 1 -- 172.21.15.59:0/663530306 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795409dc50 con 0x7f795409d630 2023-09-30T22:34:57.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f795ac70700 1 --2- 172.21.15.59:0/663530306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7954133930 0x7f7954133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:57.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f795a46f700 1 --2- 172.21.15.59:0/663530306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79540a0a30 0x7f79540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:57.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f7959c6e700 1 --2- 172.21.15.59:0/663530306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795409d630 0x7f79540a1340 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f79440098f0 tx=0x7f7944009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17674f40a1a0177 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:57.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f795946d700 1 -- 172.21.15.59:0/663530306 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944011830 con 0x7f795409d630 2023-09-30T22:34:57.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f795946d700 1 -- 172.21.15.59:0/663530306 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7944011990 con 0x7f795409d630 2023-09-30T22:34:57.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.574+0000 7f795946d700 1 -- 172.21.15.59:0/663530306 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944011d20 con 0x7f795409d630 2023-09-30T22:34:57.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.575+0000 7f795c6d3700 1 -- 172.21.15.59:0/663530306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795409d630 msgr2=0x7f79540a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.575+0000 7f795c6d3700 1 --2- 172.21.15.59:0/663530306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795409d630 0x7f79540a1340 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f79440098f0 tx=0x7f7944009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:57.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.575+0000 7f795c6d3700 1 -- 172.21.15.59:0/663530306 shutdown_connections 2023-09-30T22:34:57.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.575+0000 7f795c6d3700 1 --2- 172.21.15.59:0/663530306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7954133930 0x7f7954133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.575+0000 7f795c6d3700 1 --2- 172.21.15.59:0/663530306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79540a0a30 0x7f79540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.575+0000 7f795c6d3700 1 --2- 172.21.15.59:0/663530306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795409d630 0x7f79540a1340 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.575+0000 7f795c6d3700 1 -- 172.21.15.59:0/663530306 >> 172.21.15.59:0/663530306 conn(0x7f79540a3050 msgr2=0x7f79540a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:57.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.575+0000 7f795c6d3700 1 -- 172.21.15.59:0/663530306 shutdown_connections 2023-09-30T22:34:57.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.575+0000 7f795c6d3700 1 -- 172.21.15.59:0/663530306 wait complete. 2023-09-30T22:34:57.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.576+0000 7f795c6d3700 1 Processor -- start 2023-09-30T22:34:57.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.576+0000 7f795c6d3700 1 -- start start 2023-09-30T22:34:57.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f795c6d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f795409d630 0x7f795411f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f795c6d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79540a0a30 0x7f795411f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f795c6d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7954133930 0x7f79541c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:57.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f795c6d3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795411ee60 con 0x7f79540a0a30 2023-09-30T22:34:57.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f795c6d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795411fdd0 con 0x7f7954133930 2023-09-30T22:34:57.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f795c6d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7954121e70 con 0x7f795409d630 2023-09-30T22:34:57.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f7959c6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79540a0a30 0x7f795411f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f795ac70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7954133930 0x7f79541c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f795a46f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f795409d630 0x7f795411f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:57.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f7959c6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79540a0a30 0x7f795411f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36914/0 (socket says 172.21.15.59:36914) 2023-09-30T22:34:57.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f7959c6e700 1 -- 172.21.15.59:0/300837434 learned_addr learned my addr 172.21.15.59:0/300837434 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:57.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f7959c6e700 1 -- 172.21.15.59:0/300837434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f795409d630 msgr2=0x7f795411f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f7959c6e700 1 --2- 172.21.15.59:0/300837434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f795409d630 0x7f795411f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f7959c6e700 1 -- 172.21.15.59:0/300837434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7954133930 msgr2=0x7f79541c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f7959c6e700 1 --2- 172.21.15.59:0/300837434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7954133930 0x7f79541c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f7959c6e700 1 -- 172.21.15.59:0/300837434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79500094a0 con 0x7f79540a0a30 2023-09-30T22:34:57.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f795ac70700 1 --2- 172.21.15.59:0/300837434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7954133930 0x7f79541c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:57.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f7959c6e700 1 --2- 172.21.15.59:0/300837434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79540a0a30 0x7f795411f890 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f7944000c00 tx=0x7f7944004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:57.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.577+0000 7f794affd700 1 -- 172.21.15.59:0/300837434 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944004240 con 0x7f79540a0a30 2023-09-30T22:34:57.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.578+0000 7f794affd700 1 -- 172.21.15.59:0/300837434 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794401f070 con 0x7f79540a0a30 2023-09-30T22:34:57.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.578+0000 7f795c6d3700 1 -- 172.21.15.59:0/300837434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c009a70 con 0x7f79540a0a30 2023-09-30T22:34:57.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.578+0000 7f794affd700 1 -- 172.21.15.59:0/300837434 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79440045c0 con 0x7f79540a0a30 2023-09-30T22:34:57.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.578+0000 7f795c6d3700 1 -- 172.21.15.59:0/300837434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7944009550 con 0x7f79540a0a30 2023-09-30T22:34:57.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.578+0000 7f794affd700 1 -- 172.21.15.59:0/300837434 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7944021030 con 0x7f79540a0a30 2023-09-30T22:34:57.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.579+0000 7f794affd700 1 -- 172.21.15.59:0/300837434 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f79440405f0 con 0x7f79540a0a30 2023-09-30T22:34:57.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.579+0000 7f795c6d3700 1 -- 172.21.15.59:0/300837434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79540747f0 con 0x7f79540a0a30 2023-09-30T22:34:57.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.584+0000 7f794affd700 1 -- 172.21.15.59:0/300837434 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7944015070 con 0x7f79540a0a30 2023-09-30T22:34:57.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.756+0000 7f9b6ede4700 1 -- 172.21.15.59:0/565302745 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9b6811a2c0 con 0x7f9b68134630 2023-09-30T22:34:57.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.756+0000 7f9b657fa700 1 -- 172.21.15.59:0/565302745 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b5c019ba0 con 0x7f9b68134630 2023-09-30T22:34:57.756 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:57.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.759+0000 7f9b6ede4700 1 -- 172.21.15.59:0/565302745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b68134630 msgr2=0x7f9b681c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.759+0000 7f9b6ede4700 1 --2- 172.21.15.59:0/565302745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b68134630 0x7f9b681c4760 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c016000 tx=0x7f9b5c004750 comp rx=0 tx=0).stop 2023-09-30T22:34:57.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.759+0000 7f9b6ede4700 1 -- 172.21.15.59:0/565302745 shutdown_connections 2023-09-30T22:34:57.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.759+0000 7f9b6ede4700 1 --2- 172.21.15.59:0/565302745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b68136f50 0x7f9b681c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.759+0000 7f9b6ede4700 1 --2- 172.21.15.59:0/565302745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b68131810 0x7f9b681c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.759+0000 7f9b6ede4700 1 --2- 172.21.15.59:0/565302745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b68134630 0x7f9b681c4760 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.759+0000 7f9b6ede4700 1 -- 172.21.15.59:0/565302745 >> 172.21.15.59:0/565302745 conn(0x7f9b680a2aa0 msgr2=0x7f9b68134a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:57.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.759+0000 7f9b6ede4700 1 -- 172.21.15.59:0/565302745 shutdown_connections 2023-09-30T22:34:57.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.759+0000 7f9b6ede4700 1 -- 172.21.15.59:0/565302745 wait complete. 2023-09-30T22:34:57.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:57.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.801+0000 7f795c6d3700 1 -- 172.21.15.59:0/300837434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7954072980 con 0x7f79540a0a30 2023-09-30T22:34:57.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.801+0000 7f794affd700 1 -- 172.21.15.59:0/300837434 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f794401a450 con 0x7f79540a0a30 2023-09-30T22:34:57.801 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.804+0000 7f795c6d3700 1 -- 172.21.15.59:0/300837434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79540a0a30 msgr2=0x7f795411f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.804+0000 7f795c6d3700 1 --2- 172.21.15.59:0/300837434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79540a0a30 0x7f795411f890 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f7944000c00 tx=0x7f7944004750 comp rx=0 tx=0).stop 2023-09-30T22:34:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.804+0000 7f795c6d3700 1 -- 172.21.15.59:0/300837434 shutdown_connections 2023-09-30T22:34:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.804+0000 7f795c6d3700 1 --2- 172.21.15.59:0/300837434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f795409d630 0x7f795411f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.804+0000 7f795c6d3700 1 --2- 172.21.15.59:0/300837434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7954133930 0x7f79541c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.804+0000 7f795c6d3700 1 --2- 172.21.15.59:0/300837434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79540a0a30 0x7f795411f890 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.804+0000 7f795c6d3700 1 -- 172.21.15.59:0/300837434 >> 172.21.15.59:0/300837434 conn(0x7f79540a3050 msgr2=0x7f795409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:57.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.804+0000 7f795c6d3700 1 -- 172.21.15.59:0/300837434 shutdown_connections 2023-09-30T22:34:57.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:57.804+0000 7f795c6d3700 1 -- 172.21.15.59:0/300837434 wait complete. 2023-09-30T22:34:57.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:58.303 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:58.338 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:58.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.450+0000 7f0553395700 1 Processor -- start 2023-09-30T22:34:58.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.451+0000 7f0553395700 1 -- start start 2023-09-30T22:34:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0553395700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f054c0a0a30 0x7f054c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0553395700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f054c134170 0x7f054c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0553395700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054c09edd0 con 0x7f054c0a1340 2023-09-30T22:34:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0553395700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054c09e1f0 con 0x7f054c134170 2023-09-30T22:34:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0553395700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054c09dc50 con 0x7f054c0a0a30 2023-09-30T22:34:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0551131700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f054c0a0a30 0x7f054c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0551932700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f054c134170 0x7f054c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0551131700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f054c0a0a30 0x7f054c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52474/0 (socket says 172.21.15.59:52474) 2023-09-30T22:34:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0551932700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f054c134170 0x7f054c13bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36920/0 (socket says 172.21.15.59:36920) 2023-09-30T22:34:58.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0551131700 1 -- 172.21.15.59:0/1363817057 learned_addr learned my addr 172.21.15.59:0/1363817057 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0551131700 1 -- 172.21.15.59:0/1363817057 >> v2:172.21.15.59:3300/0 conn(0x7f054c134170 msgr2=0x7f054c13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0551131700 1 --2- 172.21.15.59:0/1363817057 >> v2:172.21.15.59:3300/0 conn(0x7f054c134170 0x7f054c13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0551131700 1 -- 172.21.15.59:0/1363817057 >> v1:172.21.15.59:6789/0 conn(0x7f054c0a1340 legacy=0x7f054c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0551131700 1 -- 172.21.15.59:0/1363817057 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c0a1fe0 con 0x7f054c0a0a30 2023-09-30T22:34:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0551932700 1 --2- 172.21.15.59:0/1363817057 >> v2:172.21.15.59:3300/0 conn(0x7f054c134170 0x7f054c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:58.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.452+0000 7f0551131700 1 --2- 172.21.15.59:0/1363817057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f054c0a0a30 0x7f054c0a0e00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f053c009e50 tx=0x7f053c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55805e7a67755d36 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:58.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.453+0000 7f054bfff700 1 -- 172.21.15.59:0/1363817057 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c00e070 con 0x7f054c0a0a30 2023-09-30T22:34:58.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.453+0000 7f054bfff700 1 -- 172.21.15.59:0/1363817057 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c00b910 con 0x7f054c0a0a30 2023-09-30T22:34:58.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.453+0000 7f054bfff700 1 -- 172.21.15.59:0/1363817057 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c00bcc0 con 0x7f054c0a0a30 2023-09-30T22:34:58.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.453+0000 7f0553395700 1 -- 172.21.15.59:0/1363817057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f054c0a0a30 msgr2=0x7f054c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.453+0000 7f0553395700 1 --2- 172.21.15.59:0/1363817057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f054c0a0a30 0x7f054c0a0e00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f053c009e50 tx=0x7f053c00b330 comp rx=0 tx=0).stop 2023-09-30T22:34:58.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.453+0000 7f0553395700 1 -- 172.21.15.59:0/1363817057 shutdown_connections 2023-09-30T22:34:58.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.453+0000 7f0553395700 1 --2- 172.21.15.59:0/1363817057 >> v2:172.21.15.59:3300/0 conn(0x7f054c134170 0x7f054c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.453+0000 7f0553395700 1 --2- 172.21.15.59:0/1363817057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f054c0a0a30 0x7f054c0a0e00 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.453+0000 7f0553395700 1 -- 172.21.15.59:0/1363817057 >> 172.21.15.59:0/1363817057 conn(0x7f054c0a6550 msgr2=0x7f054c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.453+0000 7f0553395700 1 -- 172.21.15.59:0/1363817057 shutdown_connections 2023-09-30T22:34:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.453+0000 7f0553395700 1 -- 172.21.15.59:0/1363817057 wait complete. 2023-09-30T22:34:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.454+0000 7f0553395700 1 Processor -- start 2023-09-30T22:34:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.454+0000 7f0553395700 1 -- start start 2023-09-30T22:34:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0553395700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f054c0a0a30 0x7f054c122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0553395700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f054c0a1340 0x7f054c122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0553395700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f054c134170 0x7f054c123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0553395700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054c124690 con 0x7f054c0a1340 2023-09-30T22:34:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0553395700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054c0a4f40 con 0x7f054c0a0a30 2023-09-30T22:34:58.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0553395700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f054c126420 con 0x7f054c134170 2023-09-30T22:34:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0551131700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f054c0a0a30 0x7f054c122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0551932700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f054c134170 0x7f054c123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0551131700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f054c0a0a30 0x7f054c122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52486/0 (socket says 172.21.15.59:52486) 2023-09-30T22:34:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0551131700 1 -- 172.21.15.59:0/983350915 learned_addr learned my addr 172.21.15.59:0/983350915 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0551131700 1 -- 172.21.15.59:0/983350915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f054c134170 msgr2=0x7f054c123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0551131700 1 --2- 172.21.15.59:0/983350915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f054c134170 0x7f054c123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0551131700 1 -- 172.21.15.59:0/983350915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f054c0a1340 msgr2=0x7f054c122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0551131700 1 --2- 172.21.15.59:0/983350915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f054c0a1340 0x7f054c122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0551131700 1 -- 172.21.15.59:0/983350915 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05440094a0 con 0x7f054c0a0a30 2023-09-30T22:34:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.455+0000 7f0551932700 1 --2- 172.21.15.59:0/983350915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f054c134170 0x7f054c123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.456+0000 7f0551131700 1 --2- 172.21.15.59:0/983350915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f054c0a0a30 0x7f054c122900 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f053c00b370 tx=0x7f053c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.456+0000 7f0549ffb700 1 -- 172.21.15.59:0/983350915 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c0092e0 con 0x7f054c0a0a30 2023-09-30T22:34:58.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.456+0000 7f0549ffb700 1 -- 172.21.15.59:0/983350915 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c004960 con 0x7f054c0a0a30 2023-09-30T22:34:58.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.456+0000 7f0553395700 1 -- 172.21.15.59:0/983350915 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c009b30 con 0x7f054c0a0a30 2023-09-30T22:34:58.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.456+0000 7f0549ffb700 1 -- 172.21.15.59:0/983350915 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c01c680 con 0x7f054c0a0a30 2023-09-30T22:34:58.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.456+0000 7f0553395700 1 -- 172.21.15.59:0/983350915 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054c133420 con 0x7f054c0a0a30 2023-09-30T22:34:58.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.457+0000 7f0549ffb700 1 -- 172.21.15.59:0/983350915 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f053c01c7e0 con 0x7f054c0a0a30 2023-09-30T22:34:58.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.457+0000 7f0553395700 1 -- 172.21.15.59:0/983350915 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054c0a1d40 con 0x7f054c0a0a30 2023-09-30T22:34:58.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.457+0000 7f0549ffb700 1 -- 172.21.15.59:0/983350915 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f053c0412a0 con 0x7f054c0a0a30 2023-09-30T22:34:58.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.466+0000 7f0549ffb700 1 -- 172.21.15.59:0/983350915 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f053c0257d0 con 0x7f054c0a0a30 2023-09-30T22:34:58.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.493+0000 7f864a09f700 1 Processor -- start 2023-09-30T22:34:58.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.493+0000 7f864a09f700 1 -- start start 2023-09-30T22:34:58.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.493+0000 7f864a09f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f864409e930 0x7f864409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.493+0000 7f864a09f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f864409f240 0x7f86441317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.493+0000 7f864a09f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f864409f650 0x7f8644131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.493+0000 7f864a09f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8644070940 con 0x7f864409f650 2023-09-30T22:34:58.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.493+0000 7f864a09f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864406fd60 con 0x7f864409e930 2023-09-30T22:34:58.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.493+0000 7f864a09f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f864406fa80 con 0x7f864409f240 2023-09-30T22:34:58.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.493+0000 7f86437fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f864409e930 0x7f864409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.493+0000 7f863affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f864409f240 0x7f86441317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.493+0000 7f86437fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f864409e930 0x7f864409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52500/0 (socket says 172.21.15.59:52500) 2023-09-30T22:34:58.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.493+0000 7f86437fe700 1 -- 172.21.15.59:0/289629935 learned_addr learned my addr 172.21.15.59:0/289629935 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:58.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.493+0000 7f8643fff700 1 --2- 172.21.15.59:0/289629935 >> v2:172.21.15.59:3300/0 conn(0x7f864409f650 0x7f8644131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.494+0000 7f86437fe700 1 -- 172.21.15.59:0/289629935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f864409f240 msgr2=0x7f86441317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:58.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.494+0000 7f86437fe700 1 --2- 172.21.15.59:0/289629935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f864409f240 0x7f86441317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.494+0000 7f86437fe700 1 -- 172.21.15.59:0/289629935 >> v2:172.21.15.59:3300/0 conn(0x7f864409f650 msgr2=0x7f8644131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:58.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.494+0000 7f86437fe700 1 --2- 172.21.15.59:0/289629935 >> v2:172.21.15.59:3300/0 conn(0x7f864409f650 0x7f8644131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.494+0000 7f86437fe700 1 -- 172.21.15.59:0/289629935 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864409fb60 con 0x7f864409e930 2023-09-30T22:34:58.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.494+0000 7f8643fff700 1 --2- 172.21.15.59:0/289629935 >> v2:172.21.15.59:3300/0 conn(0x7f864409f650 0x7f8644131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:58.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.494+0000 7f863affd700 1 --2- 172.21.15.59:0/289629935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f864409f240 0x7f86441317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:58.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.494+0000 7f86437fe700 1 --2- 172.21.15.59:0/289629935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f864409e930 0x7f864409ed00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f86340098f0 tx=0x7f8634009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de67f06f7a18035a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:58.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.494+0000 7f8642ffd700 1 -- 172.21.15.59:0/289629935 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634011830 con 0x7f864409e930 2023-09-30T22:34:58.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.494+0000 7f8642ffd700 1 -- 172.21.15.59:0/289629935 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8634011990 con 0x7f864409e930 2023-09-30T22:34:58.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.494+0000 7f8642ffd700 1 -- 172.21.15.59:0/289629935 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634011d20 con 0x7f864409e930 2023-09-30T22:34:58.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.495+0000 7f864a09f700 1 -- 172.21.15.59:0/289629935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f864409e930 msgr2=0x7f864409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.495+0000 7f864a09f700 1 --2- 172.21.15.59:0/289629935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f864409e930 0x7f864409ed00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f86340098f0 tx=0x7f8634009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:58.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.495+0000 7f864a09f700 1 -- 172.21.15.59:0/289629935 shutdown_connections 2023-09-30T22:34:58.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.495+0000 7f864a09f700 1 --2- 172.21.15.59:0/289629935 >> v2:172.21.15.59:3300/0 conn(0x7f864409f650 0x7f8644131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.495+0000 7f864a09f700 1 --2- 172.21.15.59:0/289629935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f864409e930 0x7f864409ed00 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.495+0000 7f864a09f700 1 --2- 172.21.15.59:0/289629935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f864409f240 0x7f86441317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.495+0000 7f864a09f700 1 -- 172.21.15.59:0/289629935 >> 172.21.15.59:0/289629935 conn(0x7f86440a4210 msgr2=0x7f86440a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:58.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.495+0000 7f864a09f700 1 -- 172.21.15.59:0/289629935 shutdown_connections 2023-09-30T22:34:58.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.495+0000 7f864a09f700 1 -- 172.21.15.59:0/289629935 wait complete. 2023-09-30T22:34:58.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.496+0000 7f864a09f700 1 Processor -- start 2023-09-30T22:34:58.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.497+0000 7f864a09f700 1 -- start start 2023-09-30T22:34:58.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.497+0000 7f864a09f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f864409e930 0x7f86441a3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.497+0000 7f864a09f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f864409f240 0x7f86441a42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.497+0000 7f864a09f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f864409f650 0x7f86441a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.497+0000 7f864a09f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441a5f50 con 0x7f864409f240 2023-09-30T22:34:58.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.497+0000 7f864a09f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86441a7010 con 0x7f864409f650 2023-09-30T22:34:58.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.497+0000 7f864a09f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8644071d20 con 0x7f864409e930 2023-09-30T22:34:58.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.497+0000 7f86437fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f864409e930 0x7f86441a3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.497+0000 7f8643fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f864409f650 0x7f86441a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.497+0000 7f86437fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f864409e930 0x7f86441a3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37272/0 (socket says 172.21.15.59:37272) 2023-09-30T22:34:58.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.497+0000 7f8643fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f864409f650 0x7f86441a47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52504/0 (socket says 172.21.15.59:52504) 2023-09-30T22:34:58.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.497+0000 7f86437fe700 1 -- 172.21.15.59:0/1711433476 learned_addr learned my addr 172.21.15.59:0/1711433476 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:58.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.497+0000 7f863affd700 1 --2- 172.21.15.59:0/1711433476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f864409f240 0x7f86441a42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.498+0000 7f86437fe700 1 -- 172.21.15.59:0/1711433476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f864409f650 msgr2=0x7f86441a47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.498+0000 7f86437fe700 1 --2- 172.21.15.59:0/1711433476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f864409f650 0x7f86441a47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.498+0000 7f86437fe700 1 -- 172.21.15.59:0/1711433476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f864409f240 msgr2=0x7f86441a42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.498+0000 7f86437fe700 1 --2- 172.21.15.59:0/1711433476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f864409f240 0x7f86441a42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.498+0000 7f86437fe700 1 -- 172.21.15.59:0/1711433476 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c0094a0 con 0x7f864409e930 2023-09-30T22:34:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.498+0000 7f8643fff700 1 --2- 172.21.15.59:0/1711433476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f864409f650 0x7f86441a47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.498+0000 7f863affd700 1 --2- 172.21.15.59:0/1711433476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f864409f240 0x7f86441a42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.498+0000 7f86437fe700 1 --2- 172.21.15.59:0/1711433476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f864409e930 0x7f86441a3d60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8634000c00 tx=0x7f8634004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.498+0000 7f8640ff9700 1 -- 172.21.15.59:0/1711433476 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634004450 con 0x7f864409e930 2023-09-30T22:34:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.498+0000 7f8640ff9700 1 -- 172.21.15.59:0/1711433476 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86340045b0 con 0x7f864409e930 2023-09-30T22:34:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.498+0000 7f864a09f700 1 -- 172.21.15.59:0/1711433476 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863c009a70 con 0x7f864409e930 2023-09-30T22:34:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.498+0000 7f8640ff9700 1 -- 172.21.15.59:0/1711433476 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86340038e0 con 0x7f864409e930 2023-09-30T22:34:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.498+0000 7f864a09f700 1 -- 172.21.15.59:0/1711433476 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8634009550 con 0x7f864409e930 2023-09-30T22:34:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.499+0000 7f8640ff9700 1 -- 172.21.15.59:0/1711433476 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8634021070 con 0x7f864409e930 2023-09-30T22:34:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.499+0000 7f864a09f700 1 -- 172.21.15.59:0/1711433476 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86441a59d0 con 0x7f864409e930 2023-09-30T22:34:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.499+0000 7f8640ff9700 1 -- 172.21.15.59:0/1711433476 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8634040bc0 con 0x7f864409e930 2023-09-30T22:34:58.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.505+0000 7f8640ff9700 1 -- 172.21.15.59:0/1711433476 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8634019770 con 0x7f864409e930 2023-09-30T22:34:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.676+0000 7f0553395700 1 -- 172.21.15.59:0/983350915 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f054c074ea0 con 0x7f054c0a0a30 2023-09-30T22:34:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.676+0000 7f0549ffb700 1 -- 172.21.15.59:0/983350915 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f053c034090 con 0x7f054c0a0a30 2023-09-30T22:34:58.677 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:34:58.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.680+0000 7f0553395700 1 -- 172.21.15.59:0/983350915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f054c0a0a30 msgr2=0x7f054c122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.680+0000 7f0553395700 1 --2- 172.21.15.59:0/983350915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f054c0a0a30 0x7f054c122900 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f053c00b370 tx=0x7f053c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.680+0000 7f0553395700 1 -- 172.21.15.59:0/983350915 shutdown_connections 2023-09-30T22:34:58.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.680+0000 7f0553395700 1 --2- 172.21.15.59:0/983350915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f054c134170 0x7f054c123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.680+0000 7f0553395700 1 --2- 172.21.15.59:0/983350915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f054c0a0a30 0x7f054c122900 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.680+0000 7f0553395700 1 --2- 172.21.15.59:0/983350915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f054c0a1340 0x7f054c122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.680+0000 7f0553395700 1 -- 172.21.15.59:0/983350915 >> 172.21.15.59:0/983350915 conn(0x7f054c0a6550 msgr2=0x7f054c09ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:58.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.680+0000 7f0553395700 1 -- 172.21.15.59:0/983350915 shutdown_connections 2023-09-30T22:34:58.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.680+0000 7f0553395700 1 -- 172.21.15.59:0/983350915 wait complete. 2023-09-30T22:34:58.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:34:58.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.720+0000 7f864a09f700 1 -- 172.21.15.59:0/1711433476 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8644074ea0 con 0x7f864409e930 2023-09-30T22:34:58.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.720+0000 7f8640ff9700 1 -- 172.21.15.59:0/1711433476 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8634029030 con 0x7f864409e930 2023-09-30T22:34:58.721 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:58.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.723+0000 7f864a09f700 1 -- 172.21.15.59:0/1711433476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f864409e930 msgr2=0x7f86441a3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.723+0000 7f864a09f700 1 --2- 172.21.15.59:0/1711433476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f864409e930 0x7f86441a3d60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8634000c00 tx=0x7f8634004750 comp rx=0 tx=0).stop 2023-09-30T22:34:58.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.723+0000 7f864a09f700 1 -- 172.21.15.59:0/1711433476 shutdown_connections 2023-09-30T22:34:58.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.723+0000 7f864a09f700 1 --2- 172.21.15.59:0/1711433476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f864409e930 0x7f86441a3d60 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.723+0000 7f864a09f700 1 --2- 172.21.15.59:0/1711433476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f864409f650 0x7f86441a47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.723+0000 7f864a09f700 1 --2- 172.21.15.59:0/1711433476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f864409f240 0x7f86441a42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.723+0000 7f864a09f700 1 -- 172.21.15.59:0/1711433476 >> 172.21.15.59:0/1711433476 conn(0x7f86440a4210 msgr2=0x7f86441b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:58.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.723+0000 7f864a09f700 1 -- 172.21.15.59:0/1711433476 shutdown_connections 2023-09-30T22:34:58.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.723+0000 7f864a09f700 1 -- 172.21.15.59:0/1711433476 wait complete. 2023-09-30T22:34:58.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:34:58.778 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:34:58.818 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:34:58.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.920+0000 7f60fd15e700 1 Processor -- start 2023-09-30T22:34:58.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.920+0000 7f60fd15e700 1 -- start start 2023-09-30T22:34:58.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.920+0000 7f60fd15e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60f80984f0 0x7f60f80988c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.920+0000 7f60fd15e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60f809d6f0 0x7f60f809db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.920+0000 7f60fd15e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f8099620 con 0x7f60f809e040 2023-09-30T22:34:58.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.920+0000 7f60fd15e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f809a9e0 con 0x7f60f809d6f0 2023-09-30T22:34:58.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.920+0000 7f60fd15e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60f809bce0 con 0x7f60f80984f0 2023-09-30T22:34:58.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.920+0000 7f60f759e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f60f809e040 0x7f60f81385c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34880/0 (socket says 172.21.15.59:34880) 2023-09-30T22:34:58.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.920+0000 7f60f6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60f80984f0 0x7f60f80988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.920+0000 7f60f659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60f809d6f0 0x7f60f809db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.920+0000 7f60f759e700 1 -- 172.21.15.59:0/3420155517 learned_addr learned my addr 172.21.15.59:0/3420155517 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:58.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.921+0000 7f60f5d9b700 1 -- 172.21.15.59:0/3420155517 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041271640 0 0) 0x7f60f8099620 con 0x7f60f809e040 2023-09-30T22:34:58.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.921+0000 7f60f5d9b700 1 -- 172.21.15.59:0/3420155517 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60e40035b0 con 0x7f60f809e040 2023-09-30T22:34:58.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.921+0000 7f60f659c700 1 -- 172.21.15.59:0/3420155517 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60f80984f0 msgr2=0x7f60f80988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:58.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.921+0000 7f60f659c700 1 --2- 172.21.15.59:0/3420155517 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60f80984f0 0x7f60f80988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.921+0000 7f60f659c700 1 -- 172.21.15.59:0/3420155517 >> v1:172.21.15.59:6789/0 conn(0x7f60f809e040 legacy=0x7f60f81385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.921+0000 7f60f659c700 1 -- 172.21.15.59:0/3420155517 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f809aca0 con 0x7f60f809d6f0 2023-09-30T22:34:58.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.921+0000 7f60f659c700 1 --2- 172.21.15.59:0/3420155517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60f809d6f0 0x7f60f809db00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009870 tx=0x7f60e0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0b8dc188e13e13a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:58.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.921+0000 7f60f5d9b700 1 -- 172.21.15.59:0/3420155517 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0004230 con 0x7f60f809d6f0 2023-09-30T22:34:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.921+0000 7f60f5d9b700 1 -- 172.21.15.59:0/3420155517 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e0004390 con 0x7f60f809d6f0 2023-09-30T22:34:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.921+0000 7f60f5d9b700 1 -- 172.21.15.59:0/3420155517 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e00036a0 con 0x7f60f809d6f0 2023-09-30T22:34:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.922+0000 7f60fd15e700 1 -- 172.21.15.59:0/3420155517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60f809d6f0 msgr2=0x7f60f809db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.922+0000 7f60fd15e700 1 --2- 172.21.15.59:0/3420155517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60f809d6f0 0x7f60f809db00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009870 tx=0x7f60e0009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.922+0000 7f60fd15e700 1 -- 172.21.15.59:0/3420155517 shutdown_connections 2023-09-30T22:34:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.922+0000 7f60fd15e700 1 --2- 172.21.15.59:0/3420155517 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60f80984f0 0x7f60f80988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.922+0000 7f60fd15e700 1 --2- 172.21.15.59:0/3420155517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60f809d6f0 0x7f60f809db00 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.922+0000 7f60fd15e700 1 -- 172.21.15.59:0/3420155517 >> 172.21.15.59:0/3420155517 conn(0x7f60f809f470 msgr2=0x7f60f80a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.922+0000 7f60fd15e700 1 -- 172.21.15.59:0/3420155517 shutdown_connections 2023-09-30T22:34:58.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.922+0000 7f60fd15e700 1 -- 172.21.15.59:0/3420155517 wait complete. 2023-09-30T22:34:58.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.924+0000 7f60fd15e700 1 Processor -- start 2023-09-30T22:34:58.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.924+0000 7f60fd15e700 1 -- start start 2023-09-30T22:34:58.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.924+0000 7f60fd15e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60f80984f0 0x7f60f812cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.924+0000 7f60fd15e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60f809d6f0 0x7f60f812d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60fd15e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60f809e040 0x7f60f812d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60fd15e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f812bec0 con 0x7f60f80984f0 2023-09-30T22:34:58.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60fd15e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f812cb40 con 0x7f60f809d6f0 2023-09-30T22:34:58.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60fd15e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60f812a330 con 0x7f60f809e040 2023-09-30T22:34:58.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60f6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60f80984f0 0x7f60f812cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60f759e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60f809e040 0x7f60f812d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60f6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60f80984f0 0x7f60f812cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36942/0 (socket says 172.21.15.59:36942) 2023-09-30T22:34:58.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60f6d9d700 1 -- 172.21.15.59:0/2342192102 learned_addr learned my addr 172.21.15.59:0/2342192102 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:58.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60f659c700 1 --2- 172.21.15.59:0/2342192102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60f809d6f0 0x7f60f812d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60f6d9d700 1 -- 172.21.15.59:0/2342192102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60f809e040 msgr2=0x7f60f812d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60f6d9d700 1 --2- 172.21.15.59:0/2342192102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60f809e040 0x7f60f812d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60f6d9d700 1 -- 172.21.15.59:0/2342192102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60f809d6f0 msgr2=0x7f60f812d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60f6d9d700 1 --2- 172.21.15.59:0/2342192102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60f809d6f0 0x7f60f812d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60f6d9d700 1 -- 172.21.15.59:0/2342192102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e00094a0 con 0x7f60f80984f0 2023-09-30T22:34:58.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60f759e700 1 --2- 172.21.15.59:0/2342192102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60f809e040 0x7f60f812d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:58.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60f6d9d700 1 --2- 172.21.15.59:0/2342192102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60f80984f0 0x7f60f812cd80 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f60e800efc0 tx=0x7f60e800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:58.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.925+0000 7f60ef7fe700 1 -- 172.21.15.59:0/2342192102 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e800cd10 con 0x7f60f80984f0 2023-09-30T22:34:58.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.926+0000 7f60ef7fe700 1 -- 172.21.15.59:0/2342192102 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e800f040 con 0x7f60f80984f0 2023-09-30T22:34:58.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.926+0000 7f60fd15e700 1 -- 172.21.15.59:0/2342192102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f812bc60 con 0x7f60f80984f0 2023-09-30T22:34:58.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.926+0000 7f60ef7fe700 1 -- 172.21.15.59:0/2342192102 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e80146a0 con 0x7f60f80984f0 2023-09-30T22:34:58.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.926+0000 7f60fd15e700 1 -- 172.21.15.59:0/2342192102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f812b000 con 0x7f60f80984f0 2023-09-30T22:34:58.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.927+0000 7f60ef7fe700 1 -- 172.21.15.59:0/2342192102 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f60e8014800 con 0x7f60f80984f0 2023-09-30T22:34:58.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.927+0000 7f60ef7fe700 1 -- 172.21.15.59:0/2342192102 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f60e8040090 con 0x7f60f80984f0 2023-09-30T22:34:58.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.927+0000 7f60fd15e700 1 -- 172.21.15.59:0/2342192102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f8130930 con 0x7f60f80984f0 2023-09-30T22:34:58.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.932+0000 7f60ef7fe700 1 -- 172.21.15.59:0/2342192102 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f60e8007920 con 0x7f60f80984f0 2023-09-30T22:34:58.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.961+0000 7f6ccafaa700 1 Processor -- start 2023-09-30T22:34:58.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.961+0000 7f6ccafaa700 1 -- start start 2023-09-30T22:34:58.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6ccafaa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cc40a0a30 0x7f6cc40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6ccafaa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cc4134170 0x7f6cc413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6ccafaa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc409edd0 con 0x7f6cc40a1340 2023-09-30T22:34:58.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6ccafaa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc409e1f0 con 0x7f6cc4134170 2023-09-30T22:34:58.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6ccafaa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc409dc50 con 0x7f6cc40a0a30 2023-09-30T22:34:58.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6cc9547700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cc4134170 0x7f6cc413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6cc8d46700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cc40a0a30 0x7f6cc40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6cc3fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6cc40a1340 0x7f6cc4133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34890/0 (socket says 172.21.15.59:34890) 2023-09-30T22:34:58.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6cc9547700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cc4134170 0x7f6cc413bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52522/0 (socket says 172.21.15.59:52522) 2023-09-30T22:34:58.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6cc3fff700 1 -- 172.21.15.59:0/1267547443 learned_addr learned my addr 172.21.15.59:0/1267547443 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:58.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6cc8d46700 1 -- 172.21.15.59:0/1267547443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cc4134170 msgr2=0x7f6cc413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:58.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6cc8d46700 1 --2- 172.21.15.59:0/1267547443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cc4134170 0x7f6cc413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6cc8d46700 1 -- 172.21.15.59:0/1267547443 >> v1:172.21.15.59:6789/0 conn(0x7f6cc40a1340 legacy=0x7f6cc4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6cc37fe700 1 -- 172.21.15.59:0/1267547443 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221396250 0 0) 0x7f6cc409edd0 con 0x7f6cc40a1340 2023-09-30T22:34:58.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6cc8d46700 1 -- 172.21.15.59:0/1267547443 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc40a1fe0 con 0x7f6cc40a0a30 2023-09-30T22:34:58.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.962+0000 7f6cc9547700 1 --2- 172.21.15.59:0/1267547443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cc4134170 0x7f6cc413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:58.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.963+0000 7f6cc8d46700 1 --2- 172.21.15.59:0/1267547443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cc40a0a30 0x7f6cc40a0e00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009870 tx=0x7f6cb8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4cee2bd81da8f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:58.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.963+0000 7f6cc37fe700 1 -- 172.21.15.59:0/1267547443 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8011830 con 0x7f6cc40a0a30 2023-09-30T22:34:58.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.963+0000 7f6cc37fe700 1 -- 172.21.15.59:0/1267547443 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb8011990 con 0x7f6cc40a0a30 2023-09-30T22:34:58.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.963+0000 7f6cc37fe700 1 -- 172.21.15.59:0/1267547443 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8011d20 con 0x7f6cc40a0a30 2023-09-30T22:34:58.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.963+0000 7f6ccafaa700 1 -- 172.21.15.59:0/1267547443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cc40a0a30 msgr2=0x7f6cc40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.963+0000 7f6ccafaa700 1 --2- 172.21.15.59:0/1267547443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cc40a0a30 0x7f6cc40a0e00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009870 tx=0x7f6cb8009b80 comp rx=0 tx=0).stop 2023-09-30T22:34:58.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.963+0000 7f6ccafaa700 1 -- 172.21.15.59:0/1267547443 shutdown_connections 2023-09-30T22:34:58.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.963+0000 7f6ccafaa700 1 --2- 172.21.15.59:0/1267547443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cc40a0a30 0x7f6cc40a0e00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.963+0000 7f6ccafaa700 1 --2- 172.21.15.59:0/1267547443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cc4134170 0x7f6cc413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.963+0000 7f6ccafaa700 1 -- 172.21.15.59:0/1267547443 >> 172.21.15.59:0/1267547443 conn(0x7f6cc40a6550 msgr2=0x7f6cc40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.964+0000 7f6ccafaa700 1 -- 172.21.15.59:0/1267547443 shutdown_connections 2023-09-30T22:34:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.964+0000 7f6ccafaa700 1 -- 172.21.15.59:0/1267547443 wait complete. 2023-09-30T22:34:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.965+0000 7f6ccafaa700 1 Processor -- start 2023-09-30T22:34:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.965+0000 7f6ccafaa700 1 -- start start 2023-09-30T22:34:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6ccafaa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cc40a0a30 0x7f6cc41227f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6ccafaa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cc40a1340 0x7f6cc4122d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6ccafaa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cc4134170 0x7f6cc4123270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6ccafaa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc41245f0 con 0x7f6cc4134170 2023-09-30T22:34:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6ccafaa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc4124400 con 0x7f6cc40a1340 2023-09-30T22:34:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6ccafaa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40a0220 con 0x7f6cc40a0a30 2023-09-30T22:34:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6cc8d46700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cc40a0a30 0x7f6cc41227f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6cc9547700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cc4134170 0x7f6cc4123270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6cc3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cc40a1340 0x7f6cc4122d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6cc8d46700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cc40a0a30 0x7f6cc41227f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37322/0 (socket says 172.21.15.59:37322) 2023-09-30T22:34:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6cc9547700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cc4134170 0x7f6cc4123270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36954/0 (socket says 172.21.15.59:36954) 2023-09-30T22:34:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6cc8d46700 1 -- 172.21.15.59:0/2668541199 learned_addr learned my addr 172.21.15.59:0/2668541199 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6cc8d46700 1 -- 172.21.15.59:0/2668541199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cc40a1340 msgr2=0x7f6cc4122d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6cc8d46700 1 --2- 172.21.15.59:0/2668541199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cc40a1340 0x7f6cc4122d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6cc8d46700 1 -- 172.21.15.59:0/2668541199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cc4134170 msgr2=0x7f6cc4123270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6cc8d46700 1 --2- 172.21.15.59:0/2668541199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cc4134170 0x7f6cc4123270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6cc8d46700 1 -- 172.21.15.59:0/2668541199 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc009a70 con 0x7f6cc40a0a30 2023-09-30T22:34:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6cc3fff700 1 --2- 172.21.15.59:0/2668541199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cc40a1340 0x7f6cc4122d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:58.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.966+0000 7f6cc9547700 1 --2- 172.21.15.59:0/2668541199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cc4134170 0x7f6cc4123270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:58.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.967+0000 7f6cc8d46700 1 --2- 172.21.15.59:0/2668541199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cc40a0a30 0x7f6cc41227f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6cb80090b0 tx=0x7f6cb8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:58.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.967+0000 7f6cc17fa700 1 -- 172.21.15.59:0/2668541199 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80044d0 con 0x7f6cc40a0a30 2023-09-30T22:34:58.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.967+0000 7f6cc17fa700 1 -- 172.21.15.59:0/2668541199 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb801f070 con 0x7f6cc40a0a30 2023-09-30T22:34:58.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.967+0000 7f6ccafaa700 1 -- 172.21.15.59:0/2668541199 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb80094a0 con 0x7f6cc40a0a30 2023-09-30T22:34:58.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.967+0000 7f6cc17fa700 1 -- 172.21.15.59:0/2668541199 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80038e0 con 0x7f6cc40a0a30 2023-09-30T22:34:58.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.967+0000 7f6ccafaa700 1 -- 172.21.15.59:0/2668541199 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc40a25e0 con 0x7f6cc40a0a30 2023-09-30T22:34:58.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.968+0000 7f6ccafaa700 1 -- 172.21.15.59:0/2668541199 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc4074ea0 con 0x7f6cc40a0a30 2023-09-30T22:34:58.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.969+0000 7f6cc17fa700 1 -- 172.21.15.59:0/2668541199 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6cb8003a40 con 0x7f6cc40a0a30 2023-09-30T22:34:58.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.969+0000 7f6cc17fa700 1 -- 172.21.15.59:0/2668541199 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6cb8021070 con 0x7f6cc40a0a30 2023-09-30T22:34:58.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:58.973+0000 7f6cc17fa700 1 -- 172.21.15.59:0/2668541199 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6cb80253e0 con 0x7f6cc40a0a30 2023-09-30T22:34:59.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.138+0000 7f60fd15e700 1 -- 172.21.15.59:0/2342192102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f60f80747f0 con 0x7f60f80984f0 2023-09-30T22:34:59.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.139+0000 7f60ef7fe700 1 -- 172.21.15.59:0/2342192102 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f60e8007330 con 0x7f60f80984f0 2023-09-30T22:34:59.139 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:34:59.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.141+0000 7f60fd15e700 1 -- 172.21.15.59:0/2342192102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60f80984f0 msgr2=0x7f60f812cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:59.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.141+0000 7f60fd15e700 1 --2- 172.21.15.59:0/2342192102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60f80984f0 0x7f60f812cd80 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f60e800efc0 tx=0x7f60e800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.141+0000 7f60fd15e700 1 -- 172.21.15.59:0/2342192102 shutdown_connections 2023-09-30T22:34:59.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.141+0000 7f60fd15e700 1 --2- 172.21.15.59:0/2342192102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f60f809e040 0x7f60f812d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.141+0000 7f60fd15e700 1 --2- 172.21.15.59:0/2342192102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60f80984f0 0x7f60f812cd80 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.141+0000 7f60fd15e700 1 --2- 172.21.15.59:0/2342192102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60f809d6f0 0x7f60f812d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.141+0000 7f60fd15e700 1 -- 172.21.15.59:0/2342192102 >> 172.21.15.59:0/2342192102 conn(0x7f60f809f470 msgr2=0x7f60f81b8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:59.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.141+0000 7f60fd15e700 1 -- 172.21.15.59:0/2342192102 shutdown_connections 2023-09-30T22:34:59.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.141+0000 7f60fd15e700 1 -- 172.21.15.59:0/2342192102 wait complete. 2023-09-30T22:34:59.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:34:59.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.179+0000 7f6ccafaa700 1 -- 172.21.15.59:0/2668541199 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6cc4133310 con 0x7f6cc40a0a30 2023-09-30T22:34:59.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.180+0000 7f6cc17fa700 1 -- 172.21.15.59:0/2668541199 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6cb8015030 con 0x7f6cc40a0a30 2023-09-30T22:34:59.180 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:34:59.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.182+0000 7f6ccafaa700 1 -- 172.21.15.59:0/2668541199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cc40a0a30 msgr2=0x7f6cc41227f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:59.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.182+0000 7f6ccafaa700 1 --2- 172.21.15.59:0/2668541199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cc40a0a30 0x7f6cc41227f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6cb80090b0 tx=0x7f6cb8004750 comp rx=0 tx=0).stop 2023-09-30T22:34:59.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.182+0000 7f6ccafaa700 1 -- 172.21.15.59:0/2668541199 shutdown_connections 2023-09-30T22:34:59.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.182+0000 7f6ccafaa700 1 --2- 172.21.15.59:0/2668541199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cc40a0a30 0x7f6cc41227f0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.182+0000 7f6ccafaa700 1 --2- 172.21.15.59:0/2668541199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cc4134170 0x7f6cc4123270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.182+0000 7f6ccafaa700 1 --2- 172.21.15.59:0/2668541199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cc40a1340 0x7f6cc4122d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.182+0000 7f6ccafaa700 1 -- 172.21.15.59:0/2668541199 >> 172.21.15.59:0/2668541199 conn(0x7f6cc40a6550 msgr2=0x7f6cc409edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:59.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.182+0000 7f6ccafaa700 1 -- 172.21.15.59:0/2668541199 shutdown_connections 2023-09-30T22:34:59.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.182+0000 7f6ccafaa700 1 -- 172.21.15.59:0/2668541199 wait complete. 2023-09-30T22:34:59.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:34:59.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:34:59.737 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:34:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.849+0000 7fe2a920f700 1 Processor -- start 2023-09-30T22:34:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.849+0000 7fe2a920f700 1 -- start start 2023-09-30T22:34:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.849+0000 7fe2a920f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2a40a0a30 0x7fe2a40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.849+0000 7fe2a920f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2a4138d80 0x7fe2a413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.849+0000 7fe2a920f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a40a2a70 con 0x7fe2a409d630 2023-09-30T22:34:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.849+0000 7fe2a920f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a40a01d0 con 0x7fe2a4138d80 2023-09-30T22:34:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.849+0000 7fe2a920f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a409e2b0 con 0x7fe2a40a0a30 2023-09-30T22:34:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.850+0000 7fe2a359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2a4138d80 0x7fe2a413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.850+0000 7fe2a2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2a40a0a30 0x7fe2a40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.850+0000 7fe2a359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2a4138d80 0x7fe2a413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36960/0 (socket says 172.21.15.59:36960) 2023-09-30T22:34:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.850+0000 7fe2a359e700 1 -- 172.21.15.59:0/3963078718 learned_addr learned my addr 172.21.15.59:0/3963078718 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.850+0000 7fe2a2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2a40a0a30 0x7fe2a40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52540/0 (socket says 172.21.15.59:52540) 2023-09-30T22:34:59.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.850+0000 7fe2a359e700 1 -- 172.21.15.59:0/3963078718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2a40a0a30 msgr2=0x7fe2a40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.850+0000 7fe2a359e700 1 --2- 172.21.15.59:0/3963078718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2a40a0a30 0x7fe2a40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.850+0000 7fe2a359e700 1 -- 172.21.15.59:0/3963078718 >> v1:172.21.15.59:6789/0 conn(0x7fe2a409d630 legacy=0x7fe2a40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.850+0000 7fe2a359e700 1 -- 172.21.15.59:0/3963078718 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a409dc50 con 0x7fe2a4138d80 2023-09-30T22:34:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.850+0000 7fe2a2d9d700 1 --2- 172.21.15.59:0/3963078718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2a40a0a30 0x7fe2a40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.850+0000 7fe2a359e700 1 --2- 172.21.15.59:0/3963078718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a4138d80 0x7fe2a413b160 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0098f0 tx=0x7fe29c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6de52c320a1432 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.850+0000 7fe2a1d9b700 1 -- 172.21.15.59:0/3963078718 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c011830 con 0x7fe2a4138d80 2023-09-30T22:34:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.851+0000 7fe2a1d9b700 1 -- 172.21.15.59:0/3963078718 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c011990 con 0x7fe2a4138d80 2023-09-30T22:34:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.851+0000 7fe2a1d9b700 1 -- 172.21.15.59:0/3963078718 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c011d20 con 0x7fe2a4138d80 2023-09-30T22:34:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.851+0000 7fe2a920f700 1 -- 172.21.15.59:0/3963078718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a4138d80 msgr2=0x7fe2a413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.851+0000 7fe2a920f700 1 --2- 172.21.15.59:0/3963078718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a4138d80 0x7fe2a413b160 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0098f0 tx=0x7fe29c009c00 comp rx=0 tx=0).stop 2023-09-30T22:34:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.851+0000 7fe2a920f700 1 -- 172.21.15.59:0/3963078718 shutdown_connections 2023-09-30T22:34:59.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.851+0000 7fe2a920f700 1 --2- 172.21.15.59:0/3963078718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a4138d80 0x7fe2a413b160 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.851+0000 7fe2a920f700 1 --2- 172.21.15.59:0/3963078718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2a40a0a30 0x7fe2a40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.851+0000 7fe2a920f700 1 -- 172.21.15.59:0/3963078718 >> 172.21.15.59:0/3963078718 conn(0x7fe2a40a3050 msgr2=0x7fe2a40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:59.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.851+0000 7fe2a920f700 1 -- 172.21.15.59:0/3963078718 shutdown_connections 2023-09-30T22:34:59.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.851+0000 7fe2a920f700 1 -- 172.21.15.59:0/3963078718 wait complete. 2023-09-30T22:34:59.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.853+0000 7fe2a920f700 1 Processor -- start 2023-09-30T22:34:59.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.853+0000 7fe2a920f700 1 -- start start 2023-09-30T22:34:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.853+0000 7fe2a920f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2a409d630 0x7fe2a4133890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.853+0000 7fe2a920f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2a40a0a30 0x7fe2a4133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.853+0000 7fe2a920f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a4138d80 0x7fe2a4134310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.853+0000 7fe2a920f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a41371b0 con 0x7fe2a4138d80 2023-09-30T22:34:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.853+0000 7fe2a920f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a4138030 con 0x7fe2a40a0a30 2023-09-30T22:34:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.853+0000 7fe2a920f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a41373b0 con 0x7fe2a409d630 2023-09-30T22:34:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.853+0000 7fe2a359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a4138d80 0x7fe2a4134310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.853+0000 7fe2a259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2a40a0a30 0x7fe2a4133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.853+0000 7fe2a2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2a409d630 0x7fe2a4133890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.853+0000 7fe2a359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a4138d80 0x7fe2a4134310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36966/0 (socket says 172.21.15.59:36966) 2023-09-30T22:34:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.853+0000 7fe2a359e700 1 -- 172.21.15.59:0/1189333681 learned_addr learned my addr 172.21.15.59:0/1189333681 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.854+0000 7fe2a359e700 1 -- 172.21.15.59:0/1189333681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2a409d630 msgr2=0x7fe2a4133890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.854+0000 7fe2a359e700 1 --2- 172.21.15.59:0/1189333681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2a409d630 0x7fe2a4133890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.854+0000 7fe2a359e700 1 -- 172.21.15.59:0/1189333681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2a40a0a30 msgr2=0x7fe2a4133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.854+0000 7fe2a359e700 1 --2- 172.21.15.59:0/1189333681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2a40a0a30 0x7fe2a4133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.854+0000 7fe2a359e700 1 -- 172.21.15.59:0/1189333681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe294009a70 con 0x7fe2a4138d80 2023-09-30T22:34:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.854+0000 7fe2a2d9d700 1 --2- 172.21.15.59:0/1189333681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2a409d630 0x7fe2a4133890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.854+0000 7fe2a359e700 1 --2- 172.21.15.59:0/1189333681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a4138d80 0x7fe2a4134310 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40a2c00 tx=0x7fe29c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.854+0000 7fe29b7fe700 1 -- 172.21.15.59:0/1189333681 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c004590 con 0x7fe2a4138d80 2023-09-30T22:34:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.854+0000 7fe29b7fe700 1 -- 172.21.15.59:0/1189333681 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c0036a0 con 0x7fe2a4138d80 2023-09-30T22:34:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.854+0000 7fe2a920f700 1 -- 172.21.15.59:0/1189333681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29c009550 con 0x7fe2a4138d80 2023-09-30T22:34:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.854+0000 7fe29b7fe700 1 -- 172.21.15.59:0/1189333681 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c003a50 con 0x7fe2a4138d80 2023-09-30T22:34:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.854+0000 7fe2a920f700 1 -- 172.21.15.59:0/1189333681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a40a4eb0 con 0x7fe2a4138d80 2023-09-30T22:34:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.855+0000 7fe29b7fe700 1 -- 172.21.15.59:0/1189333681 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe29c021070 con 0x7fe2a4138d80 2023-09-30T22:34:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.855+0000 7fe29b7fe700 1 -- 172.21.15.59:0/1189333681 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe29c040a80 con 0x7fe2a4138d80 2023-09-30T22:34:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.855+0000 7fe2a920f700 1 -- 172.21.15.59:0/1189333681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a40747f0 con 0x7fe2a4138d80 2023-09-30T22:34:59.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.864+0000 7fe29b7fe700 1 -- 172.21.15.59:0/1189333681 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe29c015080 con 0x7fe2a4138d80 2023-09-30T22:34:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.890+0000 7eff5247c700 1 Processor -- start 2023-09-30T22:34:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.891+0000 7eff5247c700 1 -- start start 2023-09-30T22:34:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.891+0000 7eff5247c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff4c09d9f0 0x7eff4c136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.891+0000 7eff5247c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c136a70 0x7eff4c138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.891+0000 7eff5247c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4c09e130 con 0x7eff4c1316c0 2023-09-30T22:34:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.891+0000 7eff5247c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c1321a0 con 0x7eff4c136a70 2023-09-30T22:34:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.891+0000 7eff5247c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c1312b0 con 0x7eff4c09d9f0 2023-09-30T22:34:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.892+0000 7eff4bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7eff4c1316c0 0x7eff4c131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34908/0 (socket says 172.21.15.59:34908) 2023-09-30T22:34:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.892+0000 7eff4b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff4c09d9f0 0x7eff4c136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.892+0000 7eff4bfff700 1 -- 172.21.15.59:0/1529749912 learned_addr learned my addr 172.21.15.59:0/1529749912 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:34:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.892+0000 7eff50a19700 1 --2- 172.21.15.59:0/1529749912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c136a70 0x7eff4c138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.892+0000 7eff4b7fe700 1 -- 172.21.15.59:0/1529749912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c136a70 msgr2=0x7eff4c138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:34:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.892+0000 7eff4b7fe700 1 --2- 172.21.15.59:0/1529749912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c136a70 0x7eff4c138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.892+0000 7eff4affd700 1 -- 172.21.15.59:0/1529749912 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285289701 0 0) 0x7eff3c001110 con 0x7eff4c1316c0 2023-09-30T22:34:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.892+0000 7eff4b7fe700 1 -- 172.21.15.59:0/1529749912 >> v1:172.21.15.59:6789/0 conn(0x7eff4c1316c0 legacy=0x7eff4c131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:59.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.892+0000 7eff4b7fe700 1 -- 172.21.15.59:0/1529749912 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c09f6e0 con 0x7eff4c09d9f0 2023-09-30T22:34:59.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.892+0000 7eff50a19700 1 --2- 172.21.15.59:0/1529749912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c136a70 0x7eff4c138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:59.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.892+0000 7eff4b7fe700 1 --2- 172.21.15.59:0/1529749912 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff4c09d9f0 0x7eff4c136530 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7eff400098a0 tx=0x7eff40009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d0b726a80dc5433 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:59.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.892+0000 7eff4affd700 1 -- 172.21.15.59:0/1529749912 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40011830 con 0x7eff4c09d9f0 2023-09-30T22:34:59.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.892+0000 7eff4affd700 1 -- 172.21.15.59:0/1529749912 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff40011990 con 0x7eff4c09d9f0 2023-09-30T22:34:59.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.892+0000 7eff4affd700 1 -- 172.21.15.59:0/1529749912 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40011d20 con 0x7eff4c09d9f0 2023-09-30T22:34:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.893+0000 7eff5247c700 1 -- 172.21.15.59:0/1529749912 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff4c09d9f0 msgr2=0x7eff4c136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.893+0000 7eff5247c700 1 --2- 172.21.15.59:0/1529749912 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff4c09d9f0 0x7eff4c136530 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7eff400098a0 tx=0x7eff40009bb0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.893+0000 7eff5247c700 1 -- 172.21.15.59:0/1529749912 shutdown_connections 2023-09-30T22:34:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.893+0000 7eff5247c700 1 --2- 172.21.15.59:0/1529749912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c136a70 0x7eff4c138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.893+0000 7eff5247c700 1 --2- 172.21.15.59:0/1529749912 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff4c09d9f0 0x7eff4c136530 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.893+0000 7eff5247c700 1 -- 172.21.15.59:0/1529749912 >> 172.21.15.59:0/1529749912 conn(0x7eff4c066f50 msgr2=0x7eff4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:34:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.893+0000 7eff5247c700 1 -- 172.21.15.59:0/1529749912 shutdown_connections 2023-09-30T22:34:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.893+0000 7eff5247c700 1 -- 172.21.15.59:0/1529749912 wait complete. 2023-09-30T22:34:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.894+0000 7eff5247c700 1 Processor -- start 2023-09-30T22:34:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.894+0000 7eff5247c700 1 -- start start 2023-09-30T22:34:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff5247c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c09d9f0 0x7eff4c1c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff5247c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c1316c0 0x7eff4c1c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff5247c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff4c136a70 0x7eff4c1c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:34:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff5247c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c0721c0 con 0x7eff4c1316c0 2023-09-30T22:34:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff5247c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c12b900 con 0x7eff4c09d9f0 2023-09-30T22:34:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff5247c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c138ef0 con 0x7eff4c136a70 2023-09-30T22:34:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff4b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c1316c0 0x7eff4c1c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff50a19700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff4c136a70 0x7eff4c1c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff50a19700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff4c136a70 0x7eff4c1c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37350/0 (socket says 172.21.15.59:37350) 2023-09-30T22:34:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff4b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c1316c0 0x7eff4c1c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36970/0 (socket says 172.21.15.59:36970) 2023-09-30T22:34:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff50a19700 1 -- 172.21.15.59:0/1767218377 learned_addr learned my addr 172.21.15.59:0/1767218377 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:34:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff4bfff700 1 --2- 172.21.15.59:0/1767218377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c09d9f0 0x7eff4c1c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:34:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff50a19700 1 -- 172.21.15.59:0/1767218377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c09d9f0 msgr2=0x7eff4c1c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff50a19700 1 --2- 172.21.15.59:0/1767218377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c09d9f0 0x7eff4c1c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff50a19700 1 -- 172.21.15.59:0/1767218377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c1316c0 msgr2=0x7eff4c1c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:34:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff50a19700 1 --2- 172.21.15.59:0/1767218377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c1316c0 0x7eff4c1c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:34:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff50a19700 1 -- 172.21.15.59:0/1767218377 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff44009a70 con 0x7eff4c136a70 2023-09-30T22:34:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.895+0000 7eff4b7fe700 1 --2- 172.21.15.59:0/1767218377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c1316c0 0x7eff4c1c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:34:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.896+0000 7eff50a19700 1 --2- 172.21.15.59:0/1767218377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff4c136a70 0x7eff4c1c6cc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7eff4400efc0 tx=0x7eff4400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:34:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.896+0000 7eff48ff9700 1 -- 172.21.15.59:0/1767218377 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4400ca90 con 0x7eff4c136a70 2023-09-30T22:34:59.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.896+0000 7eff48ff9700 1 -- 172.21.15.59:0/1767218377 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4400f040 con 0x7eff4c136a70 2023-09-30T22:34:59.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.896+0000 7eff5247c700 1 -- 172.21.15.59:0/1767218377 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff400094a0 con 0x7eff4c136a70 2023-09-30T22:34:59.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.896+0000 7eff48ff9700 1 -- 172.21.15.59:0/1767218377 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4400ce50 con 0x7eff4c136a70 2023-09-30T22:34:59.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.896+0000 7eff5247c700 1 -- 172.21.15.59:0/1767218377 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4c0704c0 con 0x7eff4c136a70 2023-09-30T22:34:59.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.897+0000 7eff48ff9700 1 -- 172.21.15.59:0/1767218377 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff44014480 con 0x7eff4c136a70 2023-09-30T22:34:59.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.897+0000 7eff48ff9700 1 -- 172.21.15.59:0/1767218377 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7eff4403fd50 con 0x7eff4c136a70 2023-09-30T22:34:59.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.897+0000 7eff5247c700 1 -- 172.21.15.59:0/1767218377 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4c070090 con 0x7eff4c136a70 2023-09-30T22:34:59.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:34:59.902+0000 7eff48ff9700 1 -- 172.21.15.59:0/1767218377 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff44012930 con 0x7eff4c136a70 2023-09-30T22:35:00.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.073+0000 7fe2a920f700 1 -- 172.21.15.59:0/1189333681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe2a4072980 con 0x7fe2a4138d80 2023-09-30T22:35:00.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.073+0000 7fe29b7fe700 1 -- 172.21.15.59:0/1189333681 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe29c029020 con 0x7fe2a4138d80 2023-09-30T22:35:00.074 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.075+0000 7fe2a920f700 1 -- 172.21.15.59:0/1189333681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a4138d80 msgr2=0x7fe2a4134310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.075+0000 7fe2a920f700 1 --2- 172.21.15.59:0/1189333681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a4138d80 0x7fe2a4134310 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40a2c00 tx=0x7fe29c004750 comp rx=0 tx=0).stop 2023-09-30T22:35:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.076+0000 7fe2a920f700 1 -- 172.21.15.59:0/1189333681 shutdown_connections 2023-09-30T22:35:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.076+0000 7fe2a920f700 1 --2- 172.21.15.59:0/1189333681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2a409d630 0x7fe2a4133890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.076+0000 7fe2a920f700 1 --2- 172.21.15.59:0/1189333681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a4138d80 0x7fe2a4134310 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.076+0000 7fe2a920f700 1 --2- 172.21.15.59:0/1189333681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2a40a0a30 0x7fe2a4133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.076+0000 7fe2a920f700 1 -- 172.21.15.59:0/1189333681 >> 172.21.15.59:0/1189333681 conn(0x7fe2a40a3050 msgr2=0x7fe2a409f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:00.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.076+0000 7fe2a920f700 1 -- 172.21.15.59:0/1189333681 shutdown_connections 2023-09-30T22:35:00.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.076+0000 7fe2a920f700 1 -- 172.21.15.59:0/1189333681 wait complete. 2023-09-30T22:35:00.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:00.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.107+0000 7eff5247c700 1 -- 172.21.15.59:0/1767218377 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7eff4c074ea0 con 0x7eff4c136a70 2023-09-30T22:35:00.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.107+0000 7eff48ff9700 1 -- 172.21.15.59:0/1767218377 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff44012340 con 0x7eff4c136a70 2023-09-30T22:35:00.107 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:00.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.109+0000 7eff5247c700 1 -- 172.21.15.59:0/1767218377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff4c136a70 msgr2=0x7eff4c1c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:00.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.109+0000 7eff5247c700 1 --2- 172.21.15.59:0/1767218377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff4c136a70 0x7eff4c1c6cc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7eff4400efc0 tx=0x7eff4400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.109+0000 7eff5247c700 1 -- 172.21.15.59:0/1767218377 shutdown_connections 2023-09-30T22:35:00.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.109+0000 7eff5247c700 1 --2- 172.21.15.59:0/1767218377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff4c136a70 0x7eff4c1c6cc0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.109+0000 7eff5247c700 1 --2- 172.21.15.59:0/1767218377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c09d9f0 0x7eff4c1c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.109+0000 7eff5247c700 1 --2- 172.21.15.59:0/1767218377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c1316c0 0x7eff4c1c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.109+0000 7eff5247c700 1 -- 172.21.15.59:0/1767218377 >> 172.21.15.59:0/1767218377 conn(0x7eff4c066f50 msgr2=0x7eff4c0a2400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:00.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.110+0000 7eff5247c700 1 -- 172.21.15.59:0/1767218377 shutdown_connections 2023-09-30T22:35:00.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.110+0000 7eff5247c700 1 -- 172.21.15.59:0/1767218377 wait complete. 2023-09-30T22:35:00.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:00.156 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:00.196 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.305+0000 7facbfacb700 1 Processor -- start 2023-09-30T22:35:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.305+0000 7facbfacb700 1 -- start start 2023-09-30T22:35:00.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.306+0000 7facbfacb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb80a0a30 0x7facb80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:00.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.306+0000 7facbfacb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7facb80a1340 0x7facb8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:00.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.306+0000 7facbfacb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb809edd0 con 0x7facb8133fa0 2023-09-30T22:35:00.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.306+0000 7facbfacb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb809e1f0 con 0x7facb80a1340 2023-09-30T22:35:00.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.306+0000 7facbfacb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb809dc50 con 0x7facb80a0a30 2023-09-30T22:35:00.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.306+0000 7facbd867700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb80a0a30 0x7facb80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:00.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.306+0000 7facbd066700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7facb80a1340 0x7facb8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:00.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.306+0000 7facbd867700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb80a0a30 0x7facb80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52574/0 (socket says 172.21.15.59:52574) 2023-09-30T22:35:00.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.306+0000 7facbd066700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7facb80a1340 0x7facb8133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36984/0 (socket says 172.21.15.59:36984) 2023-09-30T22:35:00.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.306+0000 7facbd867700 1 -- 172.21.15.59:0/3160167236 learned_addr learned my addr 172.21.15.59:0/3160167236 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:00.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.306+0000 7facbd066700 1 -- 172.21.15.59:0/3160167236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb80a0a30 msgr2=0x7facb80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:00.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.306+0000 7facbd066700 1 --2- 172.21.15.59:0/3160167236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb80a0a30 0x7facb80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.306+0000 7facbd066700 1 -- 172.21.15.59:0/3160167236 >> v1:172.21.15.59:6789/0 conn(0x7facb8133fa0 legacy=0x7facb813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:00.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.306+0000 7facbd066700 1 -- 172.21.15.59:0/3160167236 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb80a1fe0 con 0x7facb80a1340 2023-09-30T22:35:00.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.306+0000 7facbd867700 1 --2- 172.21.15.59:0/3160167236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb80a0a30 0x7facb80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:00.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.307+0000 7facbd066700 1 --2- 172.21.15.59:0/3160167236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb80a1340 0x7facb8133a60 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7faca8009840 tx=0x7faca8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a93e6afdde7c74 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:00.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.307+0000 7facbc865700 1 -- 172.21.15.59:0/3160167236 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8011830 con 0x7facb80a1340 2023-09-30T22:35:00.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.307+0000 7facbc865700 1 -- 172.21.15.59:0/3160167236 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca8011990 con 0x7facb80a1340 2023-09-30T22:35:00.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.307+0000 7facbc865700 1 -- 172.21.15.59:0/3160167236 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8011d20 con 0x7facb80a1340 2023-09-30T22:35:00.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.307+0000 7facbfacb700 1 -- 172.21.15.59:0/3160167236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb80a1340 msgr2=0x7facb8133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:00.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.307+0000 7facbfacb700 1 --2- 172.21.15.59:0/3160167236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb80a1340 0x7facb8133a60 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7faca8009840 tx=0x7faca8009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:00.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.307+0000 7facbfacb700 1 -- 172.21.15.59:0/3160167236 shutdown_connections 2023-09-30T22:35:00.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.307+0000 7facbfacb700 1 --2- 172.21.15.59:0/3160167236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb80a0a30 0x7facb80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.307+0000 7facbfacb700 1 --2- 172.21.15.59:0/3160167236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb80a1340 0x7facb8133a60 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.307+0000 7facbfacb700 1 -- 172.21.15.59:0/3160167236 >> 172.21.15.59:0/3160167236 conn(0x7facb80a6550 msgr2=0x7facb80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:00.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.308+0000 7facbfacb700 1 -- 172.21.15.59:0/3160167236 shutdown_connections 2023-09-30T22:35:00.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.308+0000 7facbfacb700 1 -- 172.21.15.59:0/3160167236 wait complete. 2023-09-30T22:35:00.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.309+0000 7facbfacb700 1 Processor -- start 2023-09-30T22:35:00.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.309+0000 7facbfacb700 1 -- start start 2023-09-30T22:35:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.309+0000 7facbfacb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb80a0a30 0x7facb811f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.309+0000 7facbfacb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb80a1340 0x7facb811f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.309+0000 7facbfacb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb8133fa0 0x7facb81c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.309+0000 7facbfacb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb809c030 con 0x7facb80a1340 2023-09-30T22:35:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.309+0000 7facbfacb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb80a0220 con 0x7facb8133fa0 2023-09-30T22:35:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.309+0000 7facbfacb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facb81206b0 con 0x7facb80a0a30 2023-09-30T22:35:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.309+0000 7facbd867700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb80a0a30 0x7facb811f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.309+0000 7facbd066700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb80a1340 0x7facb811f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.309+0000 7facbd867700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb80a0a30 0x7facb811f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37358/0 (socket says 172.21.15.59:37358) 2023-09-30T22:35:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.309+0000 7facbd867700 1 -- 172.21.15.59:0/555619203 learned_addr learned my addr 172.21.15.59:0/555619203 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.309+0000 7facbe068700 1 --2- 172.21.15.59:0/555619203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb8133fa0 0x7facb81c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.310+0000 7facbd867700 1 -- 172.21.15.59:0/555619203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb8133fa0 msgr2=0x7facb81c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.310+0000 7facbd867700 1 --2- 172.21.15.59:0/555619203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb8133fa0 0x7facb81c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.310+0000 7facbd867700 1 -- 172.21.15.59:0/555619203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb80a1340 msgr2=0x7facb811f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.310+0000 7facbd867700 1 --2- 172.21.15.59:0/555619203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb80a1340 0x7facb811f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.310+0000 7facbd867700 1 -- 172.21.15.59:0/555619203 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb4009550 con 0x7facb80a0a30 2023-09-30T22:35:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.310+0000 7facbd066700 1 --2- 172.21.15.59:0/555619203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb80a1340 0x7facb811f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.310+0000 7facbd867700 1 --2- 172.21.15.59:0/555619203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb80a0a30 0x7facb811f460 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7facb400ebe0 tx=0x7facb400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.310+0000 7facae7fc700 1 -- 172.21.15.59:0/555619203 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb400c850 con 0x7facb80a0a30 2023-09-30T22:35:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.310+0000 7facae7fc700 1 -- 172.21.15.59:0/555619203 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb400c9b0 con 0x7facb80a0a30 2023-09-30T22:35:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.310+0000 7facbfacb700 1 -- 172.21.15.59:0/555619203 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca80094a0 con 0x7facb80a0a30 2023-09-30T22:35:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.310+0000 7facae7fc700 1 -- 172.21.15.59:0/555619203 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb400cd40 con 0x7facb80a0a30 2023-09-30T22:35:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.310+0000 7facbfacb700 1 -- 172.21.15.59:0/555619203 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb8120e70 con 0x7facb80a0a30 2023-09-30T22:35:00.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.311+0000 7facae7fc700 1 -- 172.21.15.59:0/555619203 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7facb4013470 con 0x7facb80a0a30 2023-09-30T22:35:00.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.311+0000 7facae7fc700 1 -- 172.21.15.59:0/555619203 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7facb403f880 con 0x7facb80a0a30 2023-09-30T22:35:00.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.311+0000 7facbfacb700 1 -- 172.21.15.59:0/555619203 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb804ea50 con 0x7facb80a0a30 2023-09-30T22:35:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.316+0000 7facae7fc700 1 -- 172.21.15.59:0/555619203 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7facb4017080 con 0x7facb80a0a30 2023-09-30T22:35:00.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.346+0000 7f984bfa1700 1 Processor -- start 2023-09-30T22:35:00.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.347+0000 7f984bfa1700 1 -- start start 2023-09-30T22:35:00.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.347+0000 7f984bfa1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98440a0a30 0x7f98440a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:00.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.347+0000 7f984bfa1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98440a1340 0x7f9844133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:00.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.347+0000 7f984bfa1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984409edd0 con 0x7f9844133fa0 2023-09-30T22:35:00.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.347+0000 7f984bfa1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984409e1f0 con 0x7f98440a1340 2023-09-30T22:35:00.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.347+0000 7f984bfa1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984409dc50 con 0x7f98440a0a30 2023-09-30T22:35:00.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.348+0000 7f984953c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98440a1340 0x7f9844133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:00.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.348+0000 7f9849d3d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98440a0a30 0x7f98440a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:00.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.348+0000 7f984953c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98440a1340 0x7f9844133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36996/0 (socket says 172.21.15.59:36996) 2023-09-30T22:35:00.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.348+0000 7f984953c700 1 -- 172.21.15.59:0/1696534116 learned_addr learned my addr 172.21.15.59:0/1696534116 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:00.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.348+0000 7f984a53e700 1 --1- 172.21.15.59:0/1696534116 >> v1:172.21.15.59:6789/0 conn(0x7f9844133fa0 0x7f984413ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34930/0 (socket says 172.21.15.59:34930) 2023-09-30T22:35:00.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.348+0000 7f984953c700 1 -- 172.21.15.59:0/1696534116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98440a0a30 msgr2=0x7f98440a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:00.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.348+0000 7f984953c700 1 --2- 172.21.15.59:0/1696534116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98440a0a30 0x7f98440a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.348+0000 7f984953c700 1 -- 172.21.15.59:0/1696534116 >> v1:172.21.15.59:6789/0 conn(0x7f9844133fa0 legacy=0x7f984413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:00.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.348+0000 7f984953c700 1 -- 172.21.15.59:0/1696534116 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98440a1fe0 con 0x7f98440a1340 2023-09-30T22:35:00.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.348+0000 7f984953c700 1 --2- 172.21.15.59:0/1696534116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98440a1340 0x7f9844133a60 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f98380098f0 tx=0x7f9838009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5909354172ed9a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:00.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.348+0000 7f9848d3b700 1 -- 172.21.15.59:0/1696534116 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838011830 con 0x7f98440a1340 2023-09-30T22:35:00.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.348+0000 7f9848d3b700 1 -- 172.21.15.59:0/1696534116 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9838011990 con 0x7f98440a1340 2023-09-30T22:35:00.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.348+0000 7f9848d3b700 1 -- 172.21.15.59:0/1696534116 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838011d20 con 0x7f98440a1340 2023-09-30T22:35:00.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.349+0000 7f984bfa1700 1 -- 172.21.15.59:0/1696534116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98440a1340 msgr2=0x7f9844133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:00.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.349+0000 7f984bfa1700 1 --2- 172.21.15.59:0/1696534116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98440a1340 0x7f9844133a60 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f98380098f0 tx=0x7f9838009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:00.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.349+0000 7f984bfa1700 1 -- 172.21.15.59:0/1696534116 shutdown_connections 2023-09-30T22:35:00.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.349+0000 7f984bfa1700 1 --2- 172.21.15.59:0/1696534116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98440a0a30 0x7f98440a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.349+0000 7f984bfa1700 1 --2- 172.21.15.59:0/1696534116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98440a1340 0x7f9844133a60 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.349+0000 7f984bfa1700 1 -- 172.21.15.59:0/1696534116 >> 172.21.15.59:0/1696534116 conn(0x7f98440a6550 msgr2=0x7f98440a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:00.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.349+0000 7f984bfa1700 1 -- 172.21.15.59:0/1696534116 shutdown_connections 2023-09-30T22:35:00.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.349+0000 7f984bfa1700 1 -- 172.21.15.59:0/1696534116 wait complete. 2023-09-30T22:35:00.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.351+0000 7f984bfa1700 1 Processor -- start 2023-09-30T22:35:00.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.351+0000 7f984bfa1700 1 -- start start 2023-09-30T22:35:00.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.351+0000 7f984bfa1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98440a0a30 0x7f984411e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:00.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.351+0000 7f984bfa1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98440a1340 0x7f984411ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:00.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.351+0000 7f984bfa1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9844133fa0 0x7f984411f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:00.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.351+0000 7f984bfa1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98441208f0 con 0x7f98440a1340 2023-09-30T22:35:00.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.351+0000 7f984bfa1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98440a0220 con 0x7f9844133fa0 2023-09-30T22:35:00.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.351+0000 7f984bfa1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98441203b0 con 0x7f98440a0a30 2023-09-30T22:35:00.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f984a53e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9844133fa0 0x7f984411f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:00.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f984953c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98440a1340 0x7f984411ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:00.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f984a53e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9844133fa0 0x7f984411f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52598/0 (socket says 172.21.15.59:52598) 2023-09-30T22:35:00.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f9849d3d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98440a0a30 0x7f984411e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:00.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f984a53e700 1 -- 172.21.15.59:0/1672873987 learned_addr learned my addr 172.21.15.59:0/1672873987 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:00.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f984953c700 1 -- 172.21.15.59:0/1672873987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98440a0a30 msgr2=0x7f984411e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:00.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f984953c700 1 --2- 172.21.15.59:0/1672873987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98440a0a30 0x7f984411e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f984953c700 1 -- 172.21.15.59:0/1672873987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9844133fa0 msgr2=0x7f984411f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:00.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f984953c700 1 --2- 172.21.15.59:0/1672873987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9844133fa0 0x7f984411f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f984953c700 1 -- 172.21.15.59:0/1672873987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9838009550 con 0x7f98440a1340 2023-09-30T22:35:00.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f984a53e700 1 --2- 172.21.15.59:0/1672873987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9844133fa0 0x7f984411f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:00.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f984953c700 1 --2- 172.21.15.59:0/1672873987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98440a1340 0x7f984411ec60 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f9838016000 tx=0x7f9838004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:00.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f98427fc700 1 -- 172.21.15.59:0/1672873987 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838004400 con 0x7f98440a1340 2023-09-30T22:35:00.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f98427fc700 1 -- 172.21.15.59:0/1672873987 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983801f070 con 0x7f98440a1340 2023-09-30T22:35:00.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f98427fc700 1 -- 172.21.15.59:0/1672873987 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98380038e0 con 0x7f98440a1340 2023-09-30T22:35:00.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f984bfa1700 1 -- 172.21.15.59:0/1672873987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9844121ed0 con 0x7f98440a1340 2023-09-30T22:35:00.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.352+0000 7f984bfa1700 1 -- 172.21.15.59:0/1672873987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98441221b0 con 0x7f98440a1340 2023-09-30T22:35:00.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.353+0000 7f98427fc700 1 -- 172.21.15.59:0/1672873987 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9838021030 con 0x7f98440a1340 2023-09-30T22:35:00.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.353+0000 7f98427fc700 1 -- 172.21.15.59:0/1672873987 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9838040830 con 0x7f98440a1340 2023-09-30T22:35:00.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.354+0000 7f984bfa1700 1 -- 172.21.15.59:0/1672873987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98440a1d40 con 0x7f98440a1340 2023-09-30T22:35:00.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.363+0000 7f98427fc700 1 -- 172.21.15.59:0/1672873987 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9838004560 con 0x7f98440a1340 2023-09-30T22:35:00.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.528+0000 7facbfacb700 1 -- 172.21.15.59:0/555619203 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7facb811efb0 con 0x7facb80a0a30 2023-09-30T22:35:00.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.529+0000 7facae7fc700 1 -- 172.21.15.59:0/555619203 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7facb4021020 con 0x7facb80a0a30 2023-09-30T22:35:00.529 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:00.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.531+0000 7facbfacb700 1 -- 172.21.15.59:0/555619203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb80a0a30 msgr2=0x7facb811f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:00.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.531+0000 7facbfacb700 1 --2- 172.21.15.59:0/555619203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb80a0a30 0x7facb811f460 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7facb400ebe0 tx=0x7facb400eef0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.531+0000 7facbfacb700 1 -- 172.21.15.59:0/555619203 shutdown_connections 2023-09-30T22:35:00.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.531+0000 7facbfacb700 1 --2- 172.21.15.59:0/555619203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb80a0a30 0x7facb811f460 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.531+0000 7facbfacb700 1 --2- 172.21.15.59:0/555619203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb8133fa0 0x7facb81c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.531+0000 7facbfacb700 1 --2- 172.21.15.59:0/555619203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb80a1340 0x7facb811f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.531+0000 7facbfacb700 1 -- 172.21.15.59:0/555619203 >> 172.21.15.59:0/555619203 conn(0x7facb80a6550 msgr2=0x7facb81b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:00.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.531+0000 7facbfacb700 1 -- 172.21.15.59:0/555619203 shutdown_connections 2023-09-30T22:35:00.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.531+0000 7facbfacb700 1 -- 172.21.15.59:0/555619203 wait complete. 2023-09-30T22:35:00.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.570+0000 7f984bfa1700 1 -- 172.21.15.59:0/1672873987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9844074ea0 con 0x7f98440a1340 2023-09-30T22:35:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.570+0000 7f98427fc700 1 -- 172.21.15.59:0/1672873987 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9838015020 con 0x7f98440a1340 2023-09-30T22:35:00.570 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.572+0000 7f984bfa1700 1 -- 172.21.15.59:0/1672873987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98440a1340 msgr2=0x7f984411ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.572+0000 7f984bfa1700 1 --2- 172.21.15.59:0/1672873987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98440a1340 0x7f984411ec60 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f9838016000 tx=0x7f9838004750 comp rx=0 tx=0).stop 2023-09-30T22:35:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.572+0000 7f984bfa1700 1 -- 172.21.15.59:0/1672873987 shutdown_connections 2023-09-30T22:35:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.572+0000 7f984bfa1700 1 --2- 172.21.15.59:0/1672873987 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98440a0a30 0x7f984411e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.572+0000 7f984bfa1700 1 --2- 172.21.15.59:0/1672873987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9844133fa0 0x7f984411f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.572+0000 7f984bfa1700 1 --2- 172.21.15.59:0/1672873987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98440a1340 0x7f984411ec60 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.572+0000 7f984bfa1700 1 -- 172.21.15.59:0/1672873987 >> 172.21.15.59:0/1672873987 conn(0x7f98440a6550 msgr2=0x7f98441bc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.572+0000 7f984bfa1700 1 -- 172.21.15.59:0/1672873987 shutdown_connections 2023-09-30T22:35:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:00.572+0000 7f984bfa1700 1 -- 172.21.15.59:0/1672873987 wait complete. 2023-09-30T22:35:00.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:01.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:01.124 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:01.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.242+0000 7fef43d39700 1 Processor -- start 2023-09-30T22:35:01.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.243+0000 7fef43d39700 1 -- start start 2023-09-30T22:35:01.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.243+0000 7fef43d39700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef3c0a0a30 0x7fef3c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.243+0000 7fef43d39700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef3c138d80 0x7fef3c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.243+0000 7fef43d39700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c0a2a70 con 0x7fef3c09d630 2023-09-30T22:35:01.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.243+0000 7fef43d39700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3c0a01d0 con 0x7fef3c0a0a30 2023-09-30T22:35:01.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.243+0000 7fef43d39700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c09e2b0 con 0x7fef3c138d80 2023-09-30T22:35:01.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.243+0000 7fef41ad5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef3c0a0a30 0x7fef3c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.243+0000 7fef422d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef3c138d80 0x7fef3c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.243+0000 7fef41ad5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef3c0a0a30 0x7fef3c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37010/0 (socket says 172.21.15.59:37010) 2023-09-30T22:35:01.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.243+0000 7fef41ad5700 1 -- 172.21.15.59:0/2364164335 learned_addr learned my addr 172.21.15.59:0/2364164335 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:01.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.244+0000 7fef41ad5700 1 -- 172.21.15.59:0/2364164335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef3c138d80 msgr2=0x7fef3c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:01.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.244+0000 7fef41ad5700 1 --2- 172.21.15.59:0/2364164335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef3c138d80 0x7fef3c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.244+0000 7fef41ad5700 1 -- 172.21.15.59:0/2364164335 >> v1:172.21.15.59:6789/0 conn(0x7fef3c09d630 legacy=0x7fef3c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.244+0000 7fef41ad5700 1 -- 172.21.15.59:0/2364164335 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c09dc50 con 0x7fef3c0a0a30 2023-09-30T22:35:01.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.244+0000 7fef422d6700 1 --2- 172.21.15.59:0/2364164335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef3c138d80 0x7fef3c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:01.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.244+0000 7fef41ad5700 1 --2- 172.21.15.59:0/2364164335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef3c0a0a30 0x7fef3c0a0e00 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fef2c009e50 tx=0x7fef2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa742d1dd8e8eaa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:01.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.244+0000 7fef40ad3700 1 -- 172.21.15.59:0/2364164335 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00e070 con 0x7fef3c0a0a30 2023-09-30T22:35:01.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.244+0000 7fef40ad3700 1 -- 172.21.15.59:0/2364164335 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c00b910 con 0x7fef3c0a0a30 2023-09-30T22:35:01.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.244+0000 7fef40ad3700 1 -- 172.21.15.59:0/2364164335 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00bcc0 con 0x7fef3c0a0a30 2023-09-30T22:35:01.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.245+0000 7fef43d39700 1 -- 172.21.15.59:0/2364164335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef3c0a0a30 msgr2=0x7fef3c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.245+0000 7fef43d39700 1 --2- 172.21.15.59:0/2364164335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef3c0a0a30 0x7fef3c0a0e00 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fef2c009e50 tx=0x7fef2c00b330 comp rx=0 tx=0).stop 2023-09-30T22:35:01.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.245+0000 7fef43d39700 1 -- 172.21.15.59:0/2364164335 shutdown_connections 2023-09-30T22:35:01.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.245+0000 7fef43d39700 1 --2- 172.21.15.59:0/2364164335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef3c138d80 0x7fef3c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.245+0000 7fef43d39700 1 --2- 172.21.15.59:0/2364164335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef3c0a0a30 0x7fef3c0a0e00 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.245+0000 7fef43d39700 1 -- 172.21.15.59:0/2364164335 >> 172.21.15.59:0/2364164335 conn(0x7fef3c0a3050 msgr2=0x7fef3c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:01.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.245+0000 7fef43d39700 1 -- 172.21.15.59:0/2364164335 shutdown_connections 2023-09-30T22:35:01.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.245+0000 7fef43d39700 1 -- 172.21.15.59:0/2364164335 wait complete. 2023-09-30T22:35:01.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.246+0000 7fef43d39700 1 Processor -- start 2023-09-30T22:35:01.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.246+0000 7fef43d39700 1 -- start start 2023-09-30T22:35:01.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef43d39700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef3c09d630 0x7fef3c120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef43d39700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef3c0a0a30 0x7fef3c120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef43d39700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef3c138d80 0x7fef3c121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef43d39700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c123110 con 0x7fef3c0a0a30 2023-09-30T22:35:01.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef43d39700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c122be0 con 0x7fef3c09d630 2023-09-30T22:35:01.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef43d39700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c122310 con 0x7fef3c138d80 2023-09-30T22:35:01.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef412d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef3c0a0a30 0x7fef3c120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef412d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef3c0a0a30 0x7fef3c120c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37018/0 (socket says 172.21.15.59:37018) 2023-09-30T22:35:01.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef412d4700 1 -- 172.21.15.59:0/3346790620 learned_addr learned my addr 172.21.15.59:0/3346790620 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:01.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef41ad5700 1 --2- 172.21.15.59:0/3346790620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef3c09d630 0x7fef3c120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef422d6700 1 --2- 172.21.15.59:0/3346790620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef3c138d80 0x7fef3c121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef412d4700 1 -- 172.21.15.59:0/3346790620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef3c138d80 msgr2=0x7fef3c121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef412d4700 1 --2- 172.21.15.59:0/3346790620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef3c138d80 0x7fef3c121180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef412d4700 1 -- 172.21.15.59:0/3346790620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef3c09d630 msgr2=0x7fef3c120700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef412d4700 1 --2- 172.21.15.59:0/3346790620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef3c09d630 0x7fef3c120700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef412d4700 1 -- 172.21.15.59:0/3346790620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef340094a0 con 0x7fef3c0a0a30 2023-09-30T22:35:01.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef412d4700 1 --2- 172.21.15.59:0/3346790620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef3c0a0a30 0x7fef3c120c40 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fef3000c510 tx=0x7fef3000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:01.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef3a7fc700 1 -- 172.21.15.59:0/3346790620 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef300052d0 con 0x7fef3c0a0a30 2023-09-30T22:35:01.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef3a7fc700 1 -- 172.21.15.59:0/3346790620 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef30005430 con 0x7fef3c0a0a30 2023-09-30T22:35:01.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef43d39700 1 -- 172.21.15.59:0/3346790620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c009b30 con 0x7fef3c0a0a30 2023-09-30T22:35:01.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.247+0000 7fef3a7fc700 1 -- 172.21.15.59:0/3346790620 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef300038c0 con 0x7fef3c0a0a30 2023-09-30T22:35:01.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.248+0000 7fef43d39700 1 -- 172.21.15.59:0/3346790620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3c0a4ec0 con 0x7fef3c0a0a30 2023-09-30T22:35:01.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.248+0000 7fef3a7fc700 1 -- 172.21.15.59:0/3346790620 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef30003a20 con 0x7fef3c0a0a30 2023-09-30T22:35:01.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.249+0000 7fef3a7fc700 1 -- 172.21.15.59:0/3346790620 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fef3003ea80 con 0x7fef3c0a0a30 2023-09-30T22:35:01.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.249+0000 7fef43d39700 1 -- 172.21.15.59:0/3346790620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3c0a0470 con 0x7fef3c0a0a30 2023-09-30T22:35:01.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.254+0000 7fef3a7fc700 1 -- 172.21.15.59:0/3346790620 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef30018260 con 0x7fef3c0a0a30 2023-09-30T22:35:01.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.281+0000 7fc0f7577700 1 Processor -- start 2023-09-30T22:35:01.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.281+0000 7fc0f7577700 1 -- start start 2023-09-30T22:35:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0f7577700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc0f009e1d0 0x7fc0f0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0f7577700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f0139170 0x7fc0f013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0f7577700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f009b120 con 0x7fc0f009d6f0 2023-09-30T22:35:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0f7577700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f006b460 con 0x7fc0f009e1d0 2023-09-30T22:35:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0f7577700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f009a7e0 con 0x7fc0f0139170 2023-09-30T22:35:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0f5b14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f0139170 0x7fc0f013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0f5b14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f0139170 0x7fc0f013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52618/0 (socket says 172.21.15.59:52618) 2023-09-30T22:35:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0f5b14700 1 -- 172.21.15.59:0/1914098627 learned_addr learned my addr 172.21.15.59:0/1914098627 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0f4b12700 1 --2- 172.21.15.59:0/1914098627 >> v2:172.21.15.59:3300/0 conn(0x7fc0f009e1d0 0x7fc0f0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0e7fff700 1 -- 172.21.15.59:0/1914098627 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333351122 0 0) 0x7fc0f009b120 con 0x7fc0f009d6f0 2023-09-30T22:35:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0f4b12700 1 -- 172.21.15.59:0/1914098627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f0139170 msgr2=0x7fc0f013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0f4b12700 1 --2- 172.21.15.59:0/1914098627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f0139170 0x7fc0f013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0f4b12700 1 -- 172.21.15.59:0/1914098627 >> v1:172.21.15.59:6789/0 conn(0x7fc0f009d6f0 legacy=0x7fc0f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0f4b12700 1 -- 172.21.15.59:0/1914098627 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f009a500 con 0x7fc0f009e1d0 2023-09-30T22:35:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0f5b14700 1 --2- 172.21.15.59:0/1914098627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f0139170 0x7fc0f013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0f4b12700 1 --2- 172.21.15.59:0/1914098627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f009e1d0 0x7fc0f0138c30 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009870 tx=0x7fc0e0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d97f46f300c89f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.282+0000 7fc0e7fff700 1 -- 172.21.15.59:0/1914098627 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0011830 con 0x7fc0f009e1d0 2023-09-30T22:35:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.283+0000 7fc0e7fff700 1 -- 172.21.15.59:0/1914098627 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e0011990 con 0x7fc0f009e1d0 2023-09-30T22:35:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.283+0000 7fc0e7fff700 1 -- 172.21.15.59:0/1914098627 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0011d20 con 0x7fc0f009e1d0 2023-09-30T22:35:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.283+0000 7fc0f7577700 1 -- 172.21.15.59:0/1914098627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f009e1d0 msgr2=0x7fc0f0138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.283+0000 7fc0f7577700 1 --2- 172.21.15.59:0/1914098627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f009e1d0 0x7fc0f0138c30 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009870 tx=0x7fc0e0009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.283+0000 7fc0f7577700 1 -- 172.21.15.59:0/1914098627 shutdown_connections 2023-09-30T22:35:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.283+0000 7fc0f7577700 1 --2- 172.21.15.59:0/1914098627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f0139170 0x7fc0f013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.283+0000 7fc0f7577700 1 --2- 172.21.15.59:0/1914098627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f009e1d0 0x7fc0f0138c30 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.283+0000 7fc0f7577700 1 -- 172.21.15.59:0/1914098627 >> 172.21.15.59:0/1914098627 conn(0x7fc0f0066f50 msgr2=0x7fc0f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.283+0000 7fc0f7577700 1 -- 172.21.15.59:0/1914098627 shutdown_connections 2023-09-30T22:35:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.283+0000 7fc0f7577700 1 -- 172.21.15.59:0/1914098627 wait complete. 2023-09-30T22:35:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.284+0000 7fc0f7577700 1 Processor -- start 2023-09-30T22:35:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.284+0000 7fc0f7577700 1 -- start start 2023-09-30T22:35:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f7577700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f009d6f0 0x7fc0f01c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f7577700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f009e1d0 0x7fc0f01c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f7577700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0f0139170 0x7fc0f011e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f7577700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f0122650 con 0x7fc0f009e1d0 2023-09-30T22:35:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f7577700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f01be2f0 con 0x7fc0f009d6f0 2023-09-30T22:35:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f7577700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f01347e0 con 0x7fc0f0139170 2023-09-30T22:35:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f5313700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f009d6f0 0x7fc0f01c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f4b12700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f009e1d0 0x7fc0f01c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f4b12700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f009e1d0 0x7fc0f01c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37046/0 (socket says 172.21.15.59:37046) 2023-09-30T22:35:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f5313700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f009d6f0 0x7fc0f01c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52630/0 (socket says 172.21.15.59:52630) 2023-09-30T22:35:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f4b12700 1 -- 172.21.15.59:0/502025408 learned_addr learned my addr 172.21.15.59:0/502025408 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f5b14700 1 --2- 172.21.15.59:0/502025408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0f0139170 0x7fc0f011e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f5313700 1 -- 172.21.15.59:0/502025408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0f0139170 msgr2=0x7fc0f011e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f5313700 1 --2- 172.21.15.59:0/502025408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0f0139170 0x7fc0f011e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f5313700 1 -- 172.21.15.59:0/502025408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f009e1d0 msgr2=0x7fc0f01c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f5313700 1 --2- 172.21.15.59:0/502025408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f009e1d0 0x7fc0f01c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f5313700 1 -- 172.21.15.59:0/502025408 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e8009b30 con 0x7fc0f009d6f0 2023-09-30T22:35:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f4b12700 1 --2- 172.21.15.59:0/502025408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f009e1d0 0x7fc0f01c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.285+0000 7fc0f5313700 1 --2- 172.21.15.59:0/502025408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f009d6f0 0x7fc0f01c8700 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec00c430 tx=0x7fc0ec00c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.286+0000 7fc0e5ffb700 1 -- 172.21.15.59:0/502025408 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec0054e0 con 0x7fc0f009d6f0 2023-09-30T22:35:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.286+0000 7fc0e5ffb700 1 -- 172.21.15.59:0/502025408 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ec00ce40 con 0x7fc0f009d6f0 2023-09-30T22:35:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.286+0000 7fc0f7577700 1 -- 172.21.15.59:0/502025408 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e00094a0 con 0x7fc0f009d6f0 2023-09-30T22:35:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.286+0000 7fc0e5ffb700 1 -- 172.21.15.59:0/502025408 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec0038c0 con 0x7fc0f009d6f0 2023-09-30T22:35:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.286+0000 7fc0f7577700 1 -- 172.21.15.59:0/502025408 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f009c760 con 0x7fc0f009d6f0 2023-09-30T22:35:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.287+0000 7fc0e5ffb700 1 -- 172.21.15.59:0/502025408 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0ec003a20 con 0x7fc0f009d6f0 2023-09-30T22:35:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.287+0000 7fc0e5ffb700 1 -- 172.21.15.59:0/502025408 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc0ec03e9c0 con 0x7fc0f009d6f0 2023-09-30T22:35:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.287+0000 7fc0f7577700 1 -- 172.21.15.59:0/502025408 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f01c91e0 con 0x7fc0f009d6f0 2023-09-30T22:35:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.292+0000 7fc0e5ffb700 1 -- 172.21.15.59:0/502025408 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0ec017080 con 0x7fc0f009d6f0 2023-09-30T22:35:01.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.461+0000 7fef43d39700 1 -- 172.21.15.59:0/3346790620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fef3c0747f0 con 0x7fef3c0a0a30 2023-09-30T22:35:01.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.462+0000 7fef3a7fc700 1 -- 172.21.15.59:0/3346790620 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef30017020 con 0x7fef3c0a0a30 2023-09-30T22:35:01.462 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:01.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.464+0000 7fef43d39700 1 -- 172.21.15.59:0/3346790620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef3c0a0a30 msgr2=0x7fef3c120c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.464+0000 7fef43d39700 1 --2- 172.21.15.59:0/3346790620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef3c0a0a30 0x7fef3c120c40 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fef3000c510 tx=0x7fef3000c820 comp rx=0 tx=0).stop 2023-09-30T22:35:01.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.464+0000 7fef43d39700 1 -- 172.21.15.59:0/3346790620 shutdown_connections 2023-09-30T22:35:01.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.464+0000 7fef43d39700 1 --2- 172.21.15.59:0/3346790620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef3c138d80 0x7fef3c121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.464+0000 7fef43d39700 1 --2- 172.21.15.59:0/3346790620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef3c09d630 0x7fef3c120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.464+0000 7fef43d39700 1 --2- 172.21.15.59:0/3346790620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef3c0a0a30 0x7fef3c120c40 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.464+0000 7fef43d39700 1 -- 172.21.15.59:0/3346790620 >> 172.21.15.59:0/3346790620 conn(0x7fef3c0a3050 msgr2=0x7fef3c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:01.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.464+0000 7fef43d39700 1 -- 172.21.15.59:0/3346790620 shutdown_connections 2023-09-30T22:35:01.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.464+0000 7fef43d39700 1 -- 172.21.15.59:0/3346790620 wait complete. 2023-09-30T22:35:01.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:01.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.496+0000 7fc0f7577700 1 -- 172.21.15.59:0/502025408 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc0f009f420 con 0x7fc0f009d6f0 2023-09-30T22:35:01.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.496+0000 7fc0e5ffb700 1 -- 172.21.15.59:0/502025408 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0ec003cd0 con 0x7fc0f009d6f0 2023-09-30T22:35:01.497 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:01.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.499+0000 7fc0f7577700 1 -- 172.21.15.59:0/502025408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f009d6f0 msgr2=0x7fc0f01c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.499+0000 7fc0f7577700 1 --2- 172.21.15.59:0/502025408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f009d6f0 0x7fc0f01c8700 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec00c430 tx=0x7fc0ec00c740 comp rx=0 tx=0).stop 2023-09-30T22:35:01.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.499+0000 7fc0f7577700 1 -- 172.21.15.59:0/502025408 shutdown_connections 2023-09-30T22:35:01.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.499+0000 7fc0f7577700 1 --2- 172.21.15.59:0/502025408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0f0139170 0x7fc0f011e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.499+0000 7fc0f7577700 1 --2- 172.21.15.59:0/502025408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f009d6f0 0x7fc0f01c8700 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.499+0000 7fc0f7577700 1 --2- 172.21.15.59:0/502025408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f009e1d0 0x7fc0f01c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.499+0000 7fc0f7577700 1 -- 172.21.15.59:0/502025408 >> 172.21.15.59:0/502025408 conn(0x7fc0f0066f50 msgr2=0x7fc0f0136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:01.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.499+0000 7fc0f7577700 1 -- 172.21.15.59:0/502025408 shutdown_connections 2023-09-30T22:35:01.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.499+0000 7fc0f7577700 1 -- 172.21.15.59:0/502025408 wait complete. 2023-09-30T22:35:01.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:01.546 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:01.588 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:01.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.695+0000 7f1515f48700 1 Processor -- start 2023-09-30T22:35:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.695+0000 7f1515f48700 1 -- start start 2023-09-30T22:35:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.696+0000 7f1515f48700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1510133420 0x7f15101337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.696+0000 7f1515f48700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1510134260 0x7f15101306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.696+0000 7f1515f48700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151006b990 con 0x7f1510133e30 2023-09-30T22:35:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.696+0000 7f1515f48700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15100a0590 con 0x7f1510133420 2023-09-30T22:35:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.696+0000 7f1515f48700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f151009fb80 con 0x7f1510134260 2023-09-30T22:35:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.696+0000 7f150ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1510134260 0x7f15101306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.696+0000 7f150effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1510133e30 0x7f151012ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34960/0 (socket says 172.21.15.59:34960) 2023-09-30T22:35:01.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.696+0000 7f150effd700 1 -- 172.21.15.59:0/3340514264 learned_addr learned my addr 172.21.15.59:0/3340514264 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:01.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.696+0000 7f150f7fe700 1 --2- 172.21.15.59:0/3340514264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1510133420 0x7f15101337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.696+0000 7f150e7fc700 1 -- 172.21.15.59:0/3340514264 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212741484 0 0) 0x7f151006b990 con 0x7f1510133e30 2023-09-30T22:35:01.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.696+0000 7f150ffff700 1 -- 172.21.15.59:0/3340514264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1510133420 msgr2=0x7f15101337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:01.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.696+0000 7f150ffff700 1 --2- 172.21.15.59:0/3340514264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1510133420 0x7f15101337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.696+0000 7f150ffff700 1 -- 172.21.15.59:0/3340514264 >> v1:172.21.15.59:6789/0 conn(0x7f1510133e30 legacy=0x7f151012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.696+0000 7f150ffff700 1 -- 172.21.15.59:0/3340514264 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15100a0030 con 0x7f1510134260 2023-09-30T22:35:01.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.697+0000 7f150ffff700 1 --2- 172.21.15.59:0/3340514264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1510134260 0x7f15101306a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1508009870 tx=0x7f1508009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7f178005c380d94 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.697+0000 7f150e7fc700 1 -- 172.21.15.59:0/3340514264 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508011830 con 0x7f1510134260 2023-09-30T22:35:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.697+0000 7f150e7fc700 1 -- 172.21.15.59:0/3340514264 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1508011990 con 0x7f1510134260 2023-09-30T22:35:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.697+0000 7f150e7fc700 1 -- 172.21.15.59:0/3340514264 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508011d20 con 0x7f1510134260 2023-09-30T22:35:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.697+0000 7f1515f48700 1 -- 172.21.15.59:0/3340514264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1510134260 msgr2=0x7f15101306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.697+0000 7f1515f48700 1 --2- 172.21.15.59:0/3340514264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1510134260 0x7f15101306a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1508009870 tx=0x7f1508009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.698+0000 7f1515f48700 1 -- 172.21.15.59:0/3340514264 shutdown_connections 2023-09-30T22:35:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.698+0000 7f1515f48700 1 --2- 172.21.15.59:0/3340514264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1510134260 0x7f15101306a0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.698+0000 7f1515f48700 1 --2- 172.21.15.59:0/3340514264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1510133420 0x7f15101337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.698+0000 7f1515f48700 1 -- 172.21.15.59:0/3340514264 >> 172.21.15.59:0/3340514264 conn(0x7f15100a4210 msgr2=0x7f15100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.698+0000 7f1515f48700 1 -- 172.21.15.59:0/3340514264 shutdown_connections 2023-09-30T22:35:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.698+0000 7f1515f48700 1 -- 172.21.15.59:0/3340514264 wait complete. 2023-09-30T22:35:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.699+0000 7f1515f48700 1 Processor -- start 2023-09-30T22:35:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.699+0000 7f1515f48700 1 -- start start 2023-09-30T22:35:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.699+0000 7f1515f48700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1510133420 0x7f151009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.699+0000 7f1515f48700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1510133e30 0x7f151009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.699+0000 7f1515f48700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1510134260 0x7f151009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.699+0000 7f1515f48700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151012d650 con 0x7f1510134260 2023-09-30T22:35:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.699+0000 7f1515f48700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151012d290 con 0x7f1510133420 2023-09-30T22:35:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.699+0000 7f1515f48700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15101316b0 con 0x7f1510133e30 2023-09-30T22:35:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f150effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1510133e30 0x7f151009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f150ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1510134260 0x7f151009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f150ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1510134260 0x7f151009cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37058/0 (socket says 172.21.15.59:37058) 2023-09-30T22:35:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f150effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1510133e30 0x7f151009c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37386/0 (socket says 172.21.15.59:37386) 2023-09-30T22:35:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f150ffff700 1 -- 172.21.15.59:0/3606828549 learned_addr learned my addr 172.21.15.59:0/3606828549 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f150f7fe700 1 --2- 172.21.15.59:0/3606828549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1510133420 0x7f151009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f150effd700 1 -- 172.21.15.59:0/3606828549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1510133420 msgr2=0x7f151009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f150effd700 1 --2- 172.21.15.59:0/3606828549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1510133420 0x7f151009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f150effd700 1 -- 172.21.15.59:0/3606828549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1510134260 msgr2=0x7f151009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f150effd700 1 --2- 172.21.15.59:0/3606828549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1510134260 0x7f151009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f150effd700 1 -- 172.21.15.59:0/3606828549 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15080094a0 con 0x7f1510133e30 2023-09-30T22:35:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f150f7fe700 1 --2- 172.21.15.59:0/3606828549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1510133420 0x7f151009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f150ffff700 1 --2- 172.21.15.59:0/3606828549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1510134260 0x7f151009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f150effd700 1 --2- 172.21.15.59:0/3606828549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1510133e30 0x7f151009c9c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f151009f2c0 tx=0x7f150400c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f14f7fff700 1 -- 172.21.15.59:0/3606828549 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504004c80 con 0x7f1510133e30 2023-09-30T22:35:01.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f14f7fff700 1 -- 172.21.15.59:0/3606828549 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1504004de0 con 0x7f1510133e30 2023-09-30T22:35:01.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f1515f48700 1 -- 172.21.15.59:0/3606828549 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151009df30 con 0x7f1510133e30 2023-09-30T22:35:01.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.700+0000 7f14f7fff700 1 -- 172.21.15.59:0/3606828549 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504007310 con 0x7f1510133e30 2023-09-30T22:35:01.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.701+0000 7f1515f48700 1 -- 172.21.15.59:0/3606828549 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1510120a40 con 0x7f1510133e30 2023-09-30T22:35:01.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.701+0000 7f14f7fff700 1 -- 172.21.15.59:0/3606828549 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1504007470 con 0x7f1510133e30 2023-09-30T22:35:01.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.701+0000 7f14f7fff700 1 -- 172.21.15.59:0/3606828549 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f150403f240 con 0x7f1510133e30 2023-09-30T22:35:01.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.702+0000 7f1515f48700 1 -- 172.21.15.59:0/3606828549 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151012eec0 con 0x7f1510133e30 2023-09-30T22:35:01.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.707+0000 7f14f7fff700 1 -- 172.21.15.59:0/3606828549 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1504007720 con 0x7f1510133e30 2023-09-30T22:35:01.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.737+0000 7f2e3acdc700 1 Processor -- start 2023-09-30T22:35:01.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.737+0000 7f2e3acdc700 1 -- start start 2023-09-30T22:35:01.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.737+0000 7f2e3acdc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e340a0a30 0x7f2e340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.737+0000 7f2e3acdc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a1340 0x7f2e34133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.737+0000 7f2e3acdc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3409edd0 con 0x7f2e34133fa0 2023-09-30T22:35:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.737+0000 7f2e3acdc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3409e1f0 con 0x7f2e340a0a30 2023-09-30T22:35:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.737+0000 7f2e3acdc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3409dc50 con 0x7f2e340a1340 2023-09-30T22:35:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.737+0000 7f2e33fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a1340 0x7f2e34133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.737+0000 7f2e38a78700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e340a0a30 0x7f2e340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.737+0000 7f2e38a78700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e340a0a30 0x7f2e340a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37070/0 (socket says 172.21.15.59:37070) 2023-09-30T22:35:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.737+0000 7f2e33fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a1340 0x7f2e34133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52650/0 (socket says 172.21.15.59:52650) 2023-09-30T22:35:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.737+0000 7f2e38a78700 1 -- 172.21.15.59:0/3156489046 learned_addr learned my addr 172.21.15.59:0/3156489046 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.738+0000 7f2e38a78700 1 -- 172.21.15.59:0/3156489046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a1340 msgr2=0x7f2e34133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.738+0000 7f2e38a78700 1 --2- 172.21.15.59:0/3156489046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a1340 0x7f2e34133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.738+0000 7f2e38a78700 1 -- 172.21.15.59:0/3156489046 >> v1:172.21.15.59:6789/0 conn(0x7f2e34133fa0 legacy=0x7f2e3413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.738+0000 7f2e38a78700 1 -- 172.21.15.59:0/3156489046 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e340a1fe0 con 0x7f2e340a0a30 2023-09-30T22:35:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.738+0000 7f2e33fff700 1 --2- 172.21.15.59:0/3156489046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a1340 0x7f2e34133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.738+0000 7f2e38a78700 1 --2- 172.21.15.59:0/3156489046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340a0a30 0x7f2e340a0e00 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2e240098f0 tx=0x7f2e24009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7fea049dbb97e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.738+0000 7f2e337fe700 1 -- 172.21.15.59:0/3156489046 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24011830 con 0x7f2e340a0a30 2023-09-30T22:35:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.738+0000 7f2e337fe700 1 -- 172.21.15.59:0/3156489046 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e24011990 con 0x7f2e340a0a30 2023-09-30T22:35:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.738+0000 7f2e337fe700 1 -- 172.21.15.59:0/3156489046 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24011d20 con 0x7f2e340a0a30 2023-09-30T22:35:01.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.739+0000 7f2e3acdc700 1 -- 172.21.15.59:0/3156489046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340a0a30 msgr2=0x7f2e340a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.739+0000 7f2e3acdc700 1 --2- 172.21.15.59:0/3156489046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340a0a30 0x7f2e340a0e00 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2e240098f0 tx=0x7f2e24009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:01.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.739+0000 7f2e3acdc700 1 -- 172.21.15.59:0/3156489046 shutdown_connections 2023-09-30T22:35:01.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.739+0000 7f2e3acdc700 1 --2- 172.21.15.59:0/3156489046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340a0a30 0x7f2e340a0e00 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.739+0000 7f2e3acdc700 1 --2- 172.21.15.59:0/3156489046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a1340 0x7f2e34133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.739+0000 7f2e3acdc700 1 -- 172.21.15.59:0/3156489046 >> 172.21.15.59:0/3156489046 conn(0x7f2e340a6550 msgr2=0x7f2e340a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:01.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.739+0000 7f2e3acdc700 1 -- 172.21.15.59:0/3156489046 shutdown_connections 2023-09-30T22:35:01.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.739+0000 7f2e3acdc700 1 -- 172.21.15.59:0/3156489046 wait complete. 2023-09-30T22:35:01.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.740+0000 7f2e3acdc700 1 Processor -- start 2023-09-30T22:35:01.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.740+0000 7f2e3acdc700 1 -- start start 2023-09-30T22:35:01.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.740+0000 7f2e3acdc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a0a30 0x7f2e341c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.740+0000 7f2e3acdc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340a1340 0x7f2e341cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.740+0000 7f2e3acdc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e34133fa0 0x7f2e341ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:01.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e3acdc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e341263d0 con 0x7f2e340a1340 2023-09-30T22:35:01.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e3acdc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e341246c0 con 0x7f2e340a0a30 2023-09-30T22:35:01.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e3acdc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34124c70 con 0x7f2e34133fa0 2023-09-30T22:35:01.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e33fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340a1340 0x7f2e341cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e33fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340a1340 0x7f2e341cbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37072/0 (socket says 172.21.15.59:37072) 2023-09-30T22:35:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e33fff700 1 -- 172.21.15.59:0/2359556091 learned_addr learned my addr 172.21.15.59:0/2359556091 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e39279700 1 --2- 172.21.15.59:0/2359556091 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e34133fa0 0x7f2e341ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e38a78700 1 --2- 172.21.15.59:0/2359556091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a0a30 0x7f2e341c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e33fff700 1 -- 172.21.15.59:0/2359556091 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e34133fa0 msgr2=0x7f2e341ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e33fff700 1 --2- 172.21.15.59:0/2359556091 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e34133fa0 0x7f2e341ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e33fff700 1 -- 172.21.15.59:0/2359556091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a0a30 msgr2=0x7f2e341c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e33fff700 1 --2- 172.21.15.59:0/2359556091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a0a30 0x7f2e341c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e33fff700 1 -- 172.21.15.59:0/2359556091 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e280094a0 con 0x7f2e340a1340 2023-09-30T22:35:01.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e33fff700 1 --2- 172.21.15.59:0/2359556091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340a1340 0x7f2e341cbd60 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800ebe0 tx=0x7f2e2800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:01.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e317fa700 1 -- 172.21.15.59:0/2359556091 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800c850 con 0x7f2e340a1340 2023-09-30T22:35:01.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e317fa700 1 -- 172.21.15.59:0/2359556091 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2800c9b0 con 0x7f2e340a1340 2023-09-30T22:35:01.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e3acdc700 1 -- 172.21.15.59:0/2359556091 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e24009550 con 0x7f2e340a1340 2023-09-30T22:35:01.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.741+0000 7f2e317fa700 1 -- 172.21.15.59:0/2359556091 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800cd40 con 0x7f2e340a1340 2023-09-30T22:35:01.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.742+0000 7f2e3acdc700 1 -- 172.21.15.59:0/2359556091 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e340a0220 con 0x7f2e340a1340 2023-09-30T22:35:01.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.743+0000 7f2e3acdc700 1 -- 172.21.15.59:0/2359556091 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e34074ea0 con 0x7f2e340a1340 2023-09-30T22:35:01.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.743+0000 7f2e317fa700 1 -- 172.21.15.59:0/2359556091 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e28013470 con 0x7f2e340a1340 2023-09-30T22:35:01.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.743+0000 7f2e317fa700 1 -- 172.21.15.59:0/2359556091 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2e2803f710 con 0x7f2e340a1340 2023-09-30T22:35:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.748+0000 7f2e317fa700 1 -- 172.21.15.59:0/2359556091 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e28013720 con 0x7f2e340a1340 2023-09-30T22:35:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.914+0000 7f1515f48700 1 -- 172.21.15.59:0/3606828549 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1510074ea0 con 0x7f1510133e30 2023-09-30T22:35:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.915+0000 7f14f7fff700 1 -- 172.21.15.59:0/3606828549 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f150401b340 con 0x7f1510133e30 2023-09-30T22:35:01.915 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.918+0000 7f1515f48700 1 -- 172.21.15.59:0/3606828549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1510133e30 msgr2=0x7f151009c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.918+0000 7f1515f48700 1 --2- 172.21.15.59:0/3606828549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1510133e30 0x7f151009c9c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f151009f2c0 tx=0x7f150400c750 comp rx=0 tx=0).stop 2023-09-30T22:35:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.918+0000 7f1515f48700 1 -- 172.21.15.59:0/3606828549 shutdown_connections 2023-09-30T22:35:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.918+0000 7f1515f48700 1 --2- 172.21.15.59:0/3606828549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1510134260 0x7f151009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.918+0000 7f1515f48700 1 --2- 172.21.15.59:0/3606828549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1510133420 0x7f151009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.918+0000 7f1515f48700 1 --2- 172.21.15.59:0/3606828549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1510133e30 0x7f151009c9c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.918+0000 7f1515f48700 1 -- 172.21.15.59:0/3606828549 >> 172.21.15.59:0/3606828549 conn(0x7f15100a4210 msgr2=0x7f15100a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.919+0000 7f1515f48700 1 -- 172.21.15.59:0/3606828549 shutdown_connections 2023-09-30T22:35:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.919+0000 7f1515f48700 1 -- 172.21.15.59:0/3606828549 wait complete. 2023-09-30T22:35:01.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:01.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.962+0000 7f2e3acdc700 1 -- 172.21.15.59:0/2359556091 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2e340a28e0 con 0x7f2e340a1340 2023-09-30T22:35:01.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.963+0000 7f2e317fa700 1 -- 172.21.15.59:0/2359556091 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e28021030 con 0x7f2e340a1340 2023-09-30T22:35:01.963 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:01.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.965+0000 7f2e3acdc700 1 -- 172.21.15.59:0/2359556091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340a1340 msgr2=0x7f2e341cbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:01.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.965+0000 7f2e3acdc700 1 --2- 172.21.15.59:0/2359556091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340a1340 0x7f2e341cbd60 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800ebe0 tx=0x7f2e2800eef0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.965+0000 7f2e3acdc700 1 -- 172.21.15.59:0/2359556091 shutdown_connections 2023-09-30T22:35:01.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.965+0000 7f2e3acdc700 1 --2- 172.21.15.59:0/2359556091 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e34133fa0 0x7f2e341ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.965+0000 7f2e3acdc700 1 --2- 172.21.15.59:0/2359556091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a0a30 0x7f2e341c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.965+0000 7f2e3acdc700 1 --2- 172.21.15.59:0/2359556091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340a1340 0x7f2e341cbd60 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:01.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.965+0000 7f2e3acdc700 1 -- 172.21.15.59:0/2359556091 >> 172.21.15.59:0/2359556091 conn(0x7f2e340a6550 msgr2=0x7f2e340a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:01.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.965+0000 7f2e3acdc700 1 -- 172.21.15.59:0/2359556091 shutdown_connections 2023-09-30T22:35:01.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:01.965+0000 7f2e3acdc700 1 -- 172.21.15.59:0/2359556091 wait complete. 2023-09-30T22:35:01.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:02.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:02.514 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.629+0000 7fa090038700 1 Processor -- start 2023-09-30T22:35:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.630+0000 7fa090038700 1 -- start start 2023-09-30T22:35:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.630+0000 7fa090038700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa088133420 0x7fa0881337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.630+0000 7fa090038700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa088133e30 0x7fa08812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.630+0000 7fa090038700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa088134260 0x7fa0881304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.630+0000 7fa090038700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08806b990 con 0x7fa088133e30 2023-09-30T22:35:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.630+0000 7fa090038700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0880a0590 con 0x7fa088134260 2023-09-30T22:35:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.630+0000 7fa090038700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa08809fb80 con 0x7fa088133420 2023-09-30T22:35:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.630+0000 7fa08ddd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa088133420 0x7fa0881337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.630+0000 7fa08e5d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa088134260 0x7fa0881304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.631+0000 7fa08ddd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa088133420 0x7fa0881337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37398/0 (socket says 172.21.15.59:37398) 2023-09-30T22:35:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.631+0000 7fa08e5d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa088134260 0x7fa0881304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52662/0 (socket says 172.21.15.59:52662) 2023-09-30T22:35:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.631+0000 7fa08ddd4700 1 -- 172.21.15.59:0/2204658403 learned_addr learned my addr 172.21.15.59:0/2204658403 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.631+0000 7fa08d5d3700 1 --2- 172.21.15.59:0/2204658403 >> v2:172.21.15.59:3300/0 conn(0x7fa088133e30 0x7fa08812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.631+0000 7fa08ddd4700 1 -- 172.21.15.59:0/2204658403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa088134260 msgr2=0x7fa0881304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.631+0000 7fa08ddd4700 1 --2- 172.21.15.59:0/2204658403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa088134260 0x7fa0881304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.631+0000 7fa08ddd4700 1 -- 172.21.15.59:0/2204658403 >> v2:172.21.15.59:3300/0 conn(0x7fa088133e30 msgr2=0x7fa08812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.631+0000 7fa08ddd4700 1 --2- 172.21.15.59:0/2204658403 >> v2:172.21.15.59:3300/0 conn(0x7fa088133e30 0x7fa08812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.631+0000 7fa08ddd4700 1 -- 172.21.15.59:0/2204658403 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0880a0030 con 0x7fa088133420 2023-09-30T22:35:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.631+0000 7fa08d5d3700 1 --2- 172.21.15.59:0/2204658403 >> v2:172.21.15.59:3300/0 conn(0x7fa088133e30 0x7fa08812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.631+0000 7fa08ddd4700 1 --2- 172.21.15.59:0/2204658403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa088133420 0x7fa0881337f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa0840098f0 tx=0x7fa084009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f6cc2953d052eca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.631+0000 7fa08cdd2700 1 -- 172.21.15.59:0/2204658403 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa084011830 con 0x7fa088133420 2023-09-30T22:35:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.631+0000 7fa08cdd2700 1 -- 172.21.15.59:0/2204658403 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa084011990 con 0x7fa088133420 2023-09-30T22:35:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.631+0000 7fa08cdd2700 1 -- 172.21.15.59:0/2204658403 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa084011d20 con 0x7fa088133420 2023-09-30T22:35:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.632+0000 7fa090038700 1 -- 172.21.15.59:0/2204658403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa088133420 msgr2=0x7fa0881337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.632+0000 7fa090038700 1 --2- 172.21.15.59:0/2204658403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa088133420 0x7fa0881337f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa0840098f0 tx=0x7fa084009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.632+0000 7fa090038700 1 -- 172.21.15.59:0/2204658403 shutdown_connections 2023-09-30T22:35:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.632+0000 7fa090038700 1 --2- 172.21.15.59:0/2204658403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa088134260 0x7fa0881304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.632+0000 7fa090038700 1 --2- 172.21.15.59:0/2204658403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa088133420 0x7fa0881337f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.632+0000 7fa090038700 1 --2- 172.21.15.59:0/2204658403 >> v2:172.21.15.59:3300/0 conn(0x7fa088133e30 0x7fa08812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.632+0000 7fa090038700 1 -- 172.21.15.59:0/2204658403 >> 172.21.15.59:0/2204658403 conn(0x7fa0880a4210 msgr2=0x7fa0880a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:02.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.632+0000 7fa090038700 1 -- 172.21.15.59:0/2204658403 shutdown_connections 2023-09-30T22:35:02.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.632+0000 7fa090038700 1 -- 172.21.15.59:0/2204658403 wait complete. 2023-09-30T22:35:02.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.633+0000 7fa090038700 1 Processor -- start 2023-09-30T22:35:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.633+0000 7fa090038700 1 -- start start 2023-09-30T22:35:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa090038700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa088133420 0x7fa08809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa090038700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa088133e30 0x7fa08809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa090038700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa088134260 0x7fa08809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa090038700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08809dde0 con 0x7fa088133420 2023-09-30T22:35:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa090038700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa088120400 con 0x7fa088133e30 2023-09-30T22:35:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa090038700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa08811f500 con 0x7fa088134260 2023-09-30T22:35:02.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa08d5d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa088133e30 0x7fa08809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:02.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa08ddd4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa088133420 0x7fa08809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:02.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa08e5d5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa088134260 0x7fa08809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:02.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa08d5d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa088133e30 0x7fa08809c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52664/0 (socket says 172.21.15.59:52664) 2023-09-30T22:35:02.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa08d5d3700 1 -- 172.21.15.59:0/848622137 learned_addr learned my addr 172.21.15.59:0/848622137 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:02.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa08d5d3700 1 -- 172.21.15.59:0/848622137 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa088134260 msgr2=0x7fa08809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:02.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa08d5d3700 1 --2- 172.21.15.59:0/848622137 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa088134260 0x7fa08809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa08d5d3700 1 -- 172.21.15.59:0/848622137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa088133420 msgr2=0x7fa08809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:02.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa08d5d3700 1 --2- 172.21.15.59:0/848622137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa088133420 0x7fa08809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa08d5d3700 1 -- 172.21.15.59:0/848622137 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780094a0 con 0x7fa088133e30 2023-09-30T22:35:02.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa08ddd4700 1 --2- 172.21.15.59:0/848622137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa088133420 0x7fa08809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:02.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.634+0000 7fa08e5d5700 1 --2- 172.21.15.59:0/848622137 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa088134260 0x7fa08809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:02.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.635+0000 7fa08d5d3700 1 --2- 172.21.15.59:0/848622137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa088133e30 0x7fa08809c9c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa07800ebb0 tx=0x7fa07800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:02.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.635+0000 7fa07e7fc700 1 -- 172.21.15.59:0/848622137 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07800c850 con 0x7fa088133e30 2023-09-30T22:35:02.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.635+0000 7fa07e7fc700 1 -- 172.21.15.59:0/848622137 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07800c9b0 con 0x7fa088133e30 2023-09-30T22:35:02.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.635+0000 7fa090038700 1 -- 172.21.15.59:0/848622137 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa084009550 con 0x7fa088133e30 2023-09-30T22:35:02.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.635+0000 7fa07e7fc700 1 -- 172.21.15.59:0/848622137 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07800cd40 con 0x7fa088133e30 2023-09-30T22:35:02.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.635+0000 7fa090038700 1 -- 172.21.15.59:0/848622137 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08811f0d0 con 0x7fa088133e30 2023-09-30T22:35:02.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.636+0000 7fa07e7fc700 1 -- 172.21.15.59:0/848622137 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa078013470 con 0x7fa088133e30 2023-09-30T22:35:02.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.636+0000 7fa090038700 1 -- 172.21.15.59:0/848622137 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa088074ea0 con 0x7fa088133e30 2023-09-30T22:35:02.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.636+0000 7fa07e7fc700 1 -- 172.21.15.59:0/848622137 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa07803fb70 con 0x7fa088133e30 2023-09-30T22:35:02.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.641+0000 7fa07e7fc700 1 -- 172.21.15.59:0/848622137 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa078021080 con 0x7fa088133e30 2023-09-30T22:35:02.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.666+0000 7f4db8dc4700 1 Processor -- start 2023-09-30T22:35:02.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.666+0000 7f4db8dc4700 1 -- start start 2023-09-30T22:35:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.667+0000 7f4db8dc4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4db40a0a30 0x7f4db40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.667+0000 7f4db8dc4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4db409d630 0x7f4db40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.667+0000 7f4db8dc4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db40a2a70 con 0x7f4db4133930 2023-09-30T22:35:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.667+0000 7f4db8dc4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db40a01d0 con 0x7f4db40a0a30 2023-09-30T22:35:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.667+0000 7f4db8dc4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4db409e2b0 con 0x7f4db409d630 2023-09-30T22:35:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.667+0000 7f4db259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4db40a0a30 0x7f4db40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.667+0000 7f4db1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4db409d630 0x7f4db40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.667+0000 7f4db1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4db409d630 0x7f4db40a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37420/0 (socket says 172.21.15.59:37420) 2023-09-30T22:35:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.667+0000 7f4db259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4db40a0a30 0x7f4db40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37102/0 (socket says 172.21.15.59:37102) 2023-09-30T22:35:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.667+0000 7f4db1d9b700 1 -- 172.21.15.59:0/462307832 learned_addr learned my addr 172.21.15.59:0/462307832 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.667+0000 7f4db2d9d700 1 --1- 172.21.15.59:0/462307832 >> v1:172.21.15.59:6789/0 conn(0x7f4db4133930 0x7f4db4133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34988/0 (socket says 172.21.15.59:34988) 2023-09-30T22:35:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.668+0000 7f4db1d9b700 1 -- 172.21.15.59:0/462307832 >> v2:172.21.15.59:3300/0 conn(0x7f4db40a0a30 msgr2=0x7f4db40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.668+0000 7f4db1d9b700 1 --2- 172.21.15.59:0/462307832 >> v2:172.21.15.59:3300/0 conn(0x7f4db40a0a30 0x7f4db40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.668+0000 7f4db1d9b700 1 -- 172.21.15.59:0/462307832 >> v1:172.21.15.59:6789/0 conn(0x7f4db4133930 legacy=0x7f4db4133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.668+0000 7f4db1d9b700 1 -- 172.21.15.59:0/462307832 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db409dc50 con 0x7f4db409d630 2023-09-30T22:35:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.668+0000 7f4db259c700 1 --2- 172.21.15.59:0/462307832 >> v2:172.21.15.59:3300/0 conn(0x7f4db40a0a30 0x7f4db40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.668+0000 7f4db1d9b700 1 --2- 172.21.15.59:0/462307832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4db409d630 0x7f4db40a1340 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0098f0 tx=0x7f4d9c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88474a325f95a16e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.668+0000 7f4db159a700 1 -- 172.21.15.59:0/462307832 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c011830 con 0x7f4db409d630 2023-09-30T22:35:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.668+0000 7f4db159a700 1 -- 172.21.15.59:0/462307832 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c011990 con 0x7f4db409d630 2023-09-30T22:35:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.668+0000 7f4db159a700 1 -- 172.21.15.59:0/462307832 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c011d20 con 0x7f4db409d630 2023-09-30T22:35:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.669+0000 7f4db8dc4700 1 -- 172.21.15.59:0/462307832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4db409d630 msgr2=0x7f4db40a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.669+0000 7f4db8dc4700 1 --2- 172.21.15.59:0/462307832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4db409d630 0x7f4db40a1340 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0098f0 tx=0x7f4d9c009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.669+0000 7f4db8dc4700 1 -- 172.21.15.59:0/462307832 shutdown_connections 2023-09-30T22:35:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.669+0000 7f4db8dc4700 1 --2- 172.21.15.59:0/462307832 >> v2:172.21.15.59:3300/0 conn(0x7f4db40a0a30 0x7f4db40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.669+0000 7f4db8dc4700 1 --2- 172.21.15.59:0/462307832 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4db409d630 0x7f4db40a1340 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.669+0000 7f4db8dc4700 1 -- 172.21.15.59:0/462307832 >> 172.21.15.59:0/462307832 conn(0x7f4db40a3050 msgr2=0x7f4db40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.669+0000 7f4db8dc4700 1 -- 172.21.15.59:0/462307832 shutdown_connections 2023-09-30T22:35:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.669+0000 7f4db8dc4700 1 -- 172.21.15.59:0/462307832 wait complete. 2023-09-30T22:35:02.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.670+0000 7f4db8dc4700 1 Processor -- start 2023-09-30T22:35:02.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.670+0000 7f4db8dc4700 1 -- start start 2023-09-30T22:35:02.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.670+0000 7f4db8dc4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4db409d630 0x7f4db4121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:02.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.670+0000 7f4db8dc4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4db40a0a30 0x7f4db4121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:02.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db8dc4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db4133930 0x7f4db4121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db8dc4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db41225b0 con 0x7f4db4133930 2023-09-30T22:35:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db8dc4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db4124bd0 con 0x7f4db409d630 2023-09-30T22:35:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db8dc4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4db4124630 con 0x7f4db40a0a30 2023-09-30T22:35:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4db40a0a30 0x7f4db4121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db4133930 0x7f4db4121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4db40a0a30 0x7f4db4121640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37432/0 (socket says 172.21.15.59:37432) 2023-09-30T22:35:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db1d9b700 1 -- 172.21.15.59:0/1756674621 learned_addr learned my addr 172.21.15.59:0/1756674621 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db259c700 1 --2- 172.21.15.59:0/1756674621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4db409d630 0x7f4db4121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db1d9b700 1 -- 172.21.15.59:0/1756674621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4db409d630 msgr2=0x7f4db4121100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db1d9b700 1 --2- 172.21.15.59:0/1756674621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4db409d630 0x7f4db4121100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db1d9b700 1 -- 172.21.15.59:0/1756674621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db4133930 msgr2=0x7f4db4121b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db1d9b700 1 --2- 172.21.15.59:0/1756674621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db4133930 0x7f4db4121b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db1d9b700 1 -- 172.21.15.59:0/1756674621 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac009a70 con 0x7f4db40a0a30 2023-09-30T22:35:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db259c700 1 --2- 172.21.15.59:0/1756674621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4db409d630 0x7f4db4121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db2d9d700 1 --2- 172.21.15.59:0/1756674621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db4133930 0x7f4db4121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db1d9b700 1 --2- 172.21.15.59:0/1756674621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4db40a0a30 0x7f4db4121640 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c000c00 tx=0x7f4d9c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4daaffd700 1 -- 172.21.15.59:0/1756674621 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c0036a0 con 0x7f4db40a0a30 2023-09-30T22:35:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4daaffd700 1 -- 172.21.15.59:0/1756674621 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c003800 con 0x7f4db40a0a30 2023-09-30T22:35:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4db8dc4700 1 -- 172.21.15.59:0/1756674621 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9c009550 con 0x7f4db40a0a30 2023-09-30T22:35:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.671+0000 7f4daaffd700 1 -- 172.21.15.59:0/1756674621 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c003bb0 con 0x7f4db40a0a30 2023-09-30T22:35:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.672+0000 7f4db8dc4700 1 -- 172.21.15.59:0/1756674621 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db40a0410 con 0x7f4db40a0a30 2023-09-30T22:35:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.672+0000 7f4daaffd700 1 -- 172.21.15.59:0/1756674621 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d9c021070 con 0x7f4db40a0a30 2023-09-30T22:35:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.672+0000 7f4daaffd700 1 -- 172.21.15.59:0/1756674621 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4d9c040bf0 con 0x7f4db40a0a30 2023-09-30T22:35:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.673+0000 7f4db8dc4700 1 -- 172.21.15.59:0/1756674621 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db411df60 con 0x7f4db40a0a30 2023-09-30T22:35:02.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.678+0000 7f4daaffd700 1 -- 172.21.15.59:0/1756674621 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d9c029080 con 0x7f4db40a0a30 2023-09-30T22:35:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.847+0000 7fa090038700 1 -- 172.21.15.59:0/848622137 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa08806b250 con 0x7fa088133e30 2023-09-30T22:35:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.847+0000 7fa07e7fc700 1 -- 172.21.15.59:0/848622137 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa078017020 con 0x7fa088133e30 2023-09-30T22:35:02.847 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.849+0000 7fa090038700 1 -- 172.21.15.59:0/848622137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa088133e30 msgr2=0x7fa08809c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.849+0000 7fa090038700 1 --2- 172.21.15.59:0/848622137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa088133e30 0x7fa08809c9c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa07800ebb0 tx=0x7fa07800eec0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.849+0000 7fa090038700 1 -- 172.21.15.59:0/848622137 shutdown_connections 2023-09-30T22:35:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.849+0000 7fa090038700 1 --2- 172.21.15.59:0/848622137 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa088134260 0x7fa08809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.849+0000 7fa090038700 1 --2- 172.21.15.59:0/848622137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa088133420 0x7fa08809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.849+0000 7fa090038700 1 --2- 172.21.15.59:0/848622137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa088133e30 0x7fa08809c9c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.849+0000 7fa090038700 1 -- 172.21.15.59:0/848622137 >> 172.21.15.59:0/848622137 conn(0x7fa0880a4210 msgr2=0x7fa0880a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.849+0000 7fa090038700 1 -- 172.21.15.59:0/848622137 shutdown_connections 2023-09-30T22:35:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.849+0000 7fa090038700 1 -- 172.21.15.59:0/848622137 wait complete. 2023-09-30T22:35:02.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:02.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.883+0000 7f4db8dc4700 1 -- 172.21.15.59:0/1756674621 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4db40747f0 con 0x7f4db40a0a30 2023-09-30T22:35:02.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.884+0000 7f4daaffd700 1 -- 172.21.15.59:0/1756674621 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d9c015020 con 0x7f4db40a0a30 2023-09-30T22:35:02.885 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:02.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.886+0000 7f4db8dc4700 1 -- 172.21.15.59:0/1756674621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4db40a0a30 msgr2=0x7f4db4121640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:02.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.886+0000 7f4db8dc4700 1 --2- 172.21.15.59:0/1756674621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4db40a0a30 0x7f4db4121640 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c000c00 tx=0x7f4d9c004750 comp rx=0 tx=0).stop 2023-09-30T22:35:02.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.886+0000 7f4db8dc4700 1 -- 172.21.15.59:0/1756674621 shutdown_connections 2023-09-30T22:35:02.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.886+0000 7f4db8dc4700 1 --2- 172.21.15.59:0/1756674621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db4133930 0x7f4db4121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.886+0000 7f4db8dc4700 1 --2- 172.21.15.59:0/1756674621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4db409d630 0x7f4db4121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.886+0000 7f4db8dc4700 1 --2- 172.21.15.59:0/1756674621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4db40a0a30 0x7f4db4121640 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:02.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.886+0000 7f4db8dc4700 1 -- 172.21.15.59:0/1756674621 >> 172.21.15.59:0/1756674621 conn(0x7f4db40a3050 msgr2=0x7f4db4133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:02.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.886+0000 7f4db8dc4700 1 -- 172.21.15.59:0/1756674621 shutdown_connections 2023-09-30T22:35:02.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:02.886+0000 7f4db8dc4700 1 -- 172.21.15.59:0/1756674621 wait complete. 2023-09-30T22:35:02.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:02.938 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:02.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:03.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.082+0000 7fdc92dca700 1 Processor -- start 2023-09-30T22:35:03.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.082+0000 7fdc92dca700 1 -- start start 2023-09-30T22:35:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.083+0000 7fdc92dca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c0a0a30 0x7fdc8c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.083+0000 7fdc92dca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c0a1340 0x7fdc8c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.083+0000 7fdc92dca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc8c133fa0 0x7fdc8c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.083+0000 7fdc92dca700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8c09edd0 con 0x7fdc8c133fa0 2023-09-30T22:35:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.083+0000 7fdc92dca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c09e1f0 con 0x7fdc8c0a1340 2023-09-30T22:35:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.083+0000 7fdc92dca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c09dc50 con 0x7fdc8c0a0a30 2023-09-30T22:35:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.083+0000 7fdc90b66700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c0a0a30 0x7fdc8c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.083+0000 7fdc90b66700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c0a0a30 0x7fdc8c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37444/0 (socket says 172.21.15.59:37444) 2023-09-30T22:35:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.083+0000 7fdc90b66700 1 -- 172.21.15.59:0/2031399759 learned_addr learned my addr 172.21.15.59:0/2031399759 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.083+0000 7fdc91367700 1 --2- 172.21.15.59:0/2031399759 >> v2:172.21.15.59:3300/0 conn(0x7fdc8c133fa0 0x7fdc8c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.083+0000 7fdc8bfff700 1 --2- 172.21.15.59:0/2031399759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c0a1340 0x7fdc8c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.083+0000 7fdc90b66700 1 -- 172.21.15.59:0/2031399759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c0a1340 msgr2=0x7fdc8c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.083+0000 7fdc90b66700 1 --2- 172.21.15.59:0/2031399759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c0a1340 0x7fdc8c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.083+0000 7fdc90b66700 1 -- 172.21.15.59:0/2031399759 >> v2:172.21.15.59:3300/0 conn(0x7fdc8c133fa0 msgr2=0x7fdc8c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.083+0000 7fdc90b66700 1 --2- 172.21.15.59:0/2031399759 >> v2:172.21.15.59:3300/0 conn(0x7fdc8c133fa0 0x7fdc8c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.084+0000 7fdc90b66700 1 -- 172.21.15.59:0/2031399759 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c0a1fe0 con 0x7fdc8c0a0a30 2023-09-30T22:35:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.084+0000 7fdc91367700 1 --2- 172.21.15.59:0/2031399759 >> v2:172.21.15.59:3300/0 conn(0x7fdc8c133fa0 0x7fdc8c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.084+0000 7fdc90b66700 1 --2- 172.21.15.59:0/2031399759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c0a0a30 0x7fdc8c0a0e00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdc800098f0 tx=0x7fdc80009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97677ec3b9cb5781 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.084+0000 7fdc8b7fe700 1 -- 172.21.15.59:0/2031399759 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80011830 con 0x7fdc8c0a0a30 2023-09-30T22:35:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.084+0000 7fdc8b7fe700 1 -- 172.21.15.59:0/2031399759 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc80011990 con 0x7fdc8c0a0a30 2023-09-30T22:35:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.084+0000 7fdc8b7fe700 1 -- 172.21.15.59:0/2031399759 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80011d20 con 0x7fdc8c0a0a30 2023-09-30T22:35:03.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.085+0000 7fdc92dca700 1 -- 172.21.15.59:0/2031399759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c0a0a30 msgr2=0x7fdc8c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:03.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.085+0000 7fdc92dca700 1 --2- 172.21.15.59:0/2031399759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c0a0a30 0x7fdc8c0a0e00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdc800098f0 tx=0x7fdc80009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:03.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.085+0000 7fdc92dca700 1 -- 172.21.15.59:0/2031399759 shutdown_connections 2023-09-30T22:35:03.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.085+0000 7fdc92dca700 1 --2- 172.21.15.59:0/2031399759 >> v2:172.21.15.59:3300/0 conn(0x7fdc8c133fa0 0x7fdc8c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.085+0000 7fdc92dca700 1 --2- 172.21.15.59:0/2031399759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c0a0a30 0x7fdc8c0a0e00 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.085+0000 7fdc92dca700 1 --2- 172.21.15.59:0/2031399759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c0a1340 0x7fdc8c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.085+0000 7fdc92dca700 1 -- 172.21.15.59:0/2031399759 >> 172.21.15.59:0/2031399759 conn(0x7fdc8c0a6550 msgr2=0x7fdc8c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.085+0000 7fdc92dca700 1 -- 172.21.15.59:0/2031399759 shutdown_connections 2023-09-30T22:35:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.085+0000 7fdc92dca700 1 -- 172.21.15.59:0/2031399759 wait complete. 2023-09-30T22:35:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.086+0000 7fdc92dca700 1 Processor -- start 2023-09-30T22:35:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.086+0000 7fdc92dca700 1 -- start start 2023-09-30T22:35:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc92dca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c0a0a30 0x7fdc8c11df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc92dca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c0a1340 0x7fdc8c11e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc92dca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c133fa0 0x7fdc8c11e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc92dca700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c122430 con 0x7fdc8c0a0a30 2023-09-30T22:35:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc92dca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c11fb60 con 0x7fdc8c133fa0 2023-09-30T22:35:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc92dca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c120db0 con 0x7fdc8c0a1340 2023-09-30T22:35:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc91367700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c133fa0 0x7fdc8c11e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc90b66700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c0a0a30 0x7fdc8c11df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc91367700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c133fa0 0x7fdc8c11e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52682/0 (socket says 172.21.15.59:52682) 2023-09-30T22:35:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc91367700 1 -- 172.21.15.59:0/761291467 learned_addr learned my addr 172.21.15.59:0/761291467 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc8bfff700 1 --2- 172.21.15.59:0/761291467 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c0a1340 0x7fdc8c11e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc91367700 1 -- 172.21.15.59:0/761291467 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c0a1340 msgr2=0x7fdc8c11e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc91367700 1 --2- 172.21.15.59:0/761291467 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c0a1340 0x7fdc8c11e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc91367700 1 -- 172.21.15.59:0/761291467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c0a0a30 msgr2=0x7fdc8c11df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc91367700 1 --2- 172.21.15.59:0/761291467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c0a0a30 0x7fdc8c11df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc91367700 1 -- 172.21.15.59:0/761291467 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84009a70 con 0x7fdc8c133fa0 2023-09-30T22:35:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.087+0000 7fdc90b66700 1 --2- 172.21.15.59:0/761291467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c0a0a30 0x7fdc8c11df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.088+0000 7fdc91367700 1 --2- 172.21.15.59:0/761291467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c133fa0 0x7fdc8c11e9d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009f00 tx=0x7fdc8400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.088+0000 7fdc897fa700 1 -- 172.21.15.59:0/761291467 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84009d70 con 0x7fdc8c133fa0 2023-09-30T22:35:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.088+0000 7fdc897fa700 1 -- 172.21.15.59:0/761291467 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8400f040 con 0x7fdc8c133fa0 2023-09-30T22:35:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.088+0000 7fdc92dca700 1 -- 172.21.15.59:0/761291467 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc80009550 con 0x7fdc8c133fa0 2023-09-30T22:35:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.088+0000 7fdc897fa700 1 -- 172.21.15.59:0/761291467 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8400cd70 con 0x7fdc8c133fa0 2023-09-30T22:35:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.088+0000 7fdc92dca700 1 -- 172.21.15.59:0/761291467 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8c0a3630 con 0x7fdc8c133fa0 2023-09-30T22:35:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.089+0000 7fdc897fa700 1 -- 172.21.15.59:0/761291467 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc84014480 con 0x7fdc8c133fa0 2023-09-30T22:35:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.089+0000 7fdc897fa700 1 -- 172.21.15.59:0/761291467 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc8403fcb0 con 0x7fdc8c133fa0 2023-09-30T22:35:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.089+0000 7fdc92dca700 1 -- 172.21.15.59:0/761291467 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8c074ea0 con 0x7fdc8c133fa0 2023-09-30T22:35:03.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.098+0000 7fdc897fa700 1 -- 172.21.15.59:0/761291467 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc84012930 con 0x7fdc8c133fa0 2023-09-30T22:35:03.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.127+0000 7f2706c96700 1 Processor -- start 2023-09-30T22:35:03.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.127+0000 7f2706c96700 1 -- start start 2023-09-30T22:35:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2706c96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27000a0a30 0x7f27000a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2706c96700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f270009d630 0x7f27000a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2706c96700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2700133930 0x7f2700133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2706c96700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27000a2a70 con 0x7f2700133930 2023-09-30T22:35:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2706c96700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27000a01d0 con 0x7f27000a0a30 2023-09-30T22:35:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2706c96700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f270009e2b0 con 0x7f270009d630 2023-09-30T22:35:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2704a32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27000a0a30 0x7f27000a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2705233700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2700133930 0x7f2700133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2704a32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27000a0a30 0x7f27000a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52690/0 (socket says 172.21.15.59:52690) 2023-09-30T22:35:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2704a32700 1 -- 172.21.15.59:0/796095458 learned_addr learned my addr 172.21.15.59:0/796095458 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f26fffff700 1 --2- 172.21.15.59:0/796095458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f270009d630 0x7f27000a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2705233700 1 -- 172.21.15.59:0/796095458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f270009d630 msgr2=0x7f27000a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2705233700 1 --2- 172.21.15.59:0/796095458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f270009d630 0x7f27000a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2705233700 1 -- 172.21.15.59:0/796095458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27000a0a30 msgr2=0x7f27000a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2705233700 1 --2- 172.21.15.59:0/796095458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27000a0a30 0x7f27000a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2705233700 1 -- 172.21.15.59:0/796095458 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270009dc50 con 0x7f2700133930 2023-09-30T22:35:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.128+0000 7f2704a32700 1 --2- 172.21.15.59:0/796095458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27000a0a30 0x7f27000a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.129+0000 7f2705233700 1 --2- 172.21.15.59:0/796095458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2700133930 0x7f2700133dd0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009d90 tx=0x7f26f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e8e2c5095dae5b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.129+0000 7f26ff7fe700 1 -- 172.21.15.59:0/796095458 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f800e070 con 0x7f2700133930 2023-09-30T22:35:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.129+0000 7f26ff7fe700 1 -- 172.21.15.59:0/796095458 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f800bb20 con 0x7f2700133930 2023-09-30T22:35:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.129+0000 7f26ff7fe700 1 -- 172.21.15.59:0/796095458 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8012430 con 0x7f2700133930 2023-09-30T22:35:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.129+0000 7f2706c96700 1 -- 172.21.15.59:0/796095458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2700133930 msgr2=0x7f2700133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.129+0000 7f2706c96700 1 --2- 172.21.15.59:0/796095458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2700133930 0x7f2700133dd0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009d90 tx=0x7f26f800b330 comp rx=0 tx=0).stop 2023-09-30T22:35:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.129+0000 7f2706c96700 1 -- 172.21.15.59:0/796095458 shutdown_connections 2023-09-30T22:35:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.129+0000 7f2706c96700 1 --2- 172.21.15.59:0/796095458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2700133930 0x7f2700133dd0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.129+0000 7f2706c96700 1 --2- 172.21.15.59:0/796095458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27000a0a30 0x7f27000a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.129+0000 7f2706c96700 1 --2- 172.21.15.59:0/796095458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f270009d630 0x7f27000a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.129+0000 7f2706c96700 1 -- 172.21.15.59:0/796095458 >> 172.21.15.59:0/796095458 conn(0x7f27000a3050 msgr2=0x7f27000a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.129+0000 7f2706c96700 1 -- 172.21.15.59:0/796095458 shutdown_connections 2023-09-30T22:35:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.129+0000 7f2706c96700 1 -- 172.21.15.59:0/796095458 wait complete. 2023-09-30T22:35:03.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.130+0000 7f2706c96700 1 Processor -- start 2023-09-30T22:35:03.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.130+0000 7f2706c96700 1 -- start start 2023-09-30T22:35:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.131+0000 7f2706c96700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f270009d630 0x7f27001c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.131+0000 7f2706c96700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27000a0a30 0x7f27001c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.131+0000 7f2706c96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2700133930 0x7f27001c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.131+0000 7f2706c96700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2700122100 con 0x7f270009d630 2023-09-30T22:35:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.131+0000 7f2706c96700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27001205e0 con 0x7f2700133930 2023-09-30T22:35:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.131+0000 7f2706c96700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2700133420 con 0x7f27000a0a30 2023-09-30T22:35:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.131+0000 7f26fffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27000a0a30 0x7f27001c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.131+0000 7f26fffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27000a0a30 0x7f27001c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37470/0 (socket says 172.21.15.59:37470) 2023-09-30T22:35:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.131+0000 7f2704a32700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f270009d630 0x7f27001c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.131+0000 7f26fffff700 1 -- 172.21.15.59:0/1660598816 learned_addr learned my addr 172.21.15.59:0/1660598816 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.131+0000 7f2705233700 1 --2- 172.21.15.59:0/1660598816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2700133930 0x7f27001c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.132+0000 7f26fffff700 1 -- 172.21.15.59:0/1660598816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2700133930 msgr2=0x7f27001c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.132+0000 7f26fffff700 1 --2- 172.21.15.59:0/1660598816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2700133930 0x7f27001c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.132+0000 7f26fffff700 1 -- 172.21.15.59:0/1660598816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f270009d630 msgr2=0x7f27001c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.132+0000 7f26fffff700 1 --2- 172.21.15.59:0/1660598816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f270009d630 0x7f27001c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.132+0000 7f26fffff700 1 -- 172.21.15.59:0/1660598816 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f0009550 con 0x7f27000a0a30 2023-09-30T22:35:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.132+0000 7f2704a32700 1 --2- 172.21.15.59:0/1660598816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f270009d630 0x7f27001c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.132+0000 7f26fffff700 1 --2- 172.21.15.59:0/1660598816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27000a0a30 0x7f27001c84f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f26e800e980 tx=0x7f26e800ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.132+0000 7f26fd7fa700 1 -- 172.21.15.59:0/1660598816 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8009710 con 0x7f27000a0a30 2023-09-30T22:35:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.132+0000 7f26fd7fa700 1 -- 172.21.15.59:0/1660598816 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e800c690 con 0x7f27000a0a30 2023-09-30T22:35:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.132+0000 7f2706c96700 1 -- 172.21.15.59:0/1660598816 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f8009a70 con 0x7f27000a0a30 2023-09-30T22:35:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.132+0000 7f26fd7fa700 1 -- 172.21.15.59:0/1660598816 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e800ca20 con 0x7f27000a0a30 2023-09-30T22:35:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.132+0000 7f2706c96700 1 -- 172.21.15.59:0/1660598816 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2700120a40 con 0x7f27000a0a30 2023-09-30T22:35:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.133+0000 7f26fd7fa700 1 -- 172.21.15.59:0/1660598816 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26e800cb80 con 0x7f27000a0a30 2023-09-30T22:35:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.133+0000 7f2706c96700 1 -- 172.21.15.59:0/1660598816 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2700120d20 con 0x7f27000a0a30 2023-09-30T22:35:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.133+0000 7f26fd7fa700 1 -- 172.21.15.59:0/1660598816 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f26e803fa90 con 0x7f27000a0a30 2023-09-30T22:35:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.138+0000 7f26fd7fa700 1 -- 172.21.15.59:0/1660598816 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26e8017020 con 0x7f27000a0a30 2023-09-30T22:35:03.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.306+0000 7fdc92dca700 1 -- 172.21.15.59:0/761291467 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdc8c0a28e0 con 0x7fdc8c133fa0 2023-09-30T22:35:03.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.306+0000 7fdc897fa700 1 -- 172.21.15.59:0/761291467 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc84012340 con 0x7fdc8c133fa0 2023-09-30T22:35:03.307 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:03.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.309+0000 7fdc92dca700 1 -- 172.21.15.59:0/761291467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c133fa0 msgr2=0x7fdc8c11e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:03.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.309+0000 7fdc92dca700 1 --2- 172.21.15.59:0/761291467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c133fa0 0x7fdc8c11e9d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009f00 tx=0x7fdc8400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.309+0000 7fdc92dca700 1 -- 172.21.15.59:0/761291467 shutdown_connections 2023-09-30T22:35:03.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.309+0000 7fdc92dca700 1 --2- 172.21.15.59:0/761291467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c133fa0 0x7fdc8c11e9d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.309+0000 7fdc92dca700 1 --2- 172.21.15.59:0/761291467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c0a0a30 0x7fdc8c11df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.309+0000 7fdc92dca700 1 --2- 172.21.15.59:0/761291467 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c0a1340 0x7fdc8c11e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.309+0000 7fdc92dca700 1 -- 172.21.15.59:0/761291467 >> 172.21.15.59:0/761291467 conn(0x7fdc8c0a6550 msgr2=0x7fdc8c133060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:03.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.309+0000 7fdc92dca700 1 -- 172.21.15.59:0/761291467 shutdown_connections 2023-09-30T22:35:03.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.309+0000 7fdc92dca700 1 -- 172.21.15.59:0/761291467 wait complete. 2023-09-30T22:35:03.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:03.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.345+0000 7f2706c96700 1 -- 172.21.15.59:0/1660598816 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f27000747f0 con 0x7f27000a0a30 2023-09-30T22:35:03.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.345+0000 7f26fd7fa700 1 -- 172.21.15.59:0/1660598816 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26e801b3b0 con 0x7f27000a0a30 2023-09-30T22:35:03.345 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:03.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.347+0000 7f2706c96700 1 -- 172.21.15.59:0/1660598816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27000a0a30 msgr2=0x7f27001c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:03.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.347+0000 7f2706c96700 1 --2- 172.21.15.59:0/1660598816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27000a0a30 0x7f27001c84f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f26e800e980 tx=0x7f26e800ec90 comp rx=0 tx=0).stop 2023-09-30T22:35:03.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.347+0000 7f2706c96700 1 -- 172.21.15.59:0/1660598816 shutdown_connections 2023-09-30T22:35:03.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.347+0000 7f2706c96700 1 --2- 172.21.15.59:0/1660598816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2700133930 0x7f27001c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.347+0000 7f2706c96700 1 --2- 172.21.15.59:0/1660598816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f270009d630 0x7f27001c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.347+0000 7f2706c96700 1 --2- 172.21.15.59:0/1660598816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27000a0a30 0x7f27001c84f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:03.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.347+0000 7f2706c96700 1 -- 172.21.15.59:0/1660598816 >> 172.21.15.59:0/1660598816 conn(0x7f27000a3050 msgr2=0x7f270009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:03.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.348+0000 7f2706c96700 1 -- 172.21.15.59:0/1660598816 shutdown_connections 2023-09-30T22:35:03.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:03.348+0000 7f2706c96700 1 -- 172.21.15.59:0/1660598816 wait complete. 2023-09-30T22:35:03.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:03.865 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:03.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:04.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.015+0000 7fe98e535700 1 Processor -- start 2023-09-30T22:35:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.015+0000 7fe98e535700 1 -- start start 2023-09-30T22:35:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.015+0000 7fe98e535700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880a0a30 0x7fe9880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.015+0000 7fe98e535700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe988134170 0x7fe98813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.015+0000 7fe98e535700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98809edd0 con 0x7fe9880a1340 2023-09-30T22:35:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.015+0000 7fe98e535700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98809e1f0 con 0x7fe9880a0a30 2023-09-30T22:35:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.015+0000 7fe98e535700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe98809dc50 con 0x7fe988134170 2023-09-30T22:35:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.015+0000 7fe987fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880a0a30 0x7fe9880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.015+0000 7fe98cad2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe988134170 0x7fe98813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.015+0000 7fe9877fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe9880a1340 0x7fe988133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35004/0 (socket says 172.21.15.59:35004) 2023-09-30T22:35:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.015+0000 7fe987fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880a0a30 0x7fe9880a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52712/0 (socket says 172.21.15.59:52712) 2023-09-30T22:35:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.015+0000 7fe9877fe700 1 -- 172.21.15.59:0/3833378423 learned_addr learned my addr 172.21.15.59:0/3833378423 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.016+0000 7fe986ffd700 1 -- 172.21.15.59:0/3833378423 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440230517 0 0) 0x7fe98809edd0 con 0x7fe9880a1340 2023-09-30T22:35:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.016+0000 7fe98cad2700 1 -- 172.21.15.59:0/3833378423 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880a0a30 msgr2=0x7fe9880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.016+0000 7fe98cad2700 1 --2- 172.21.15.59:0/3833378423 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880a0a30 0x7fe9880a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.016+0000 7fe98cad2700 1 -- 172.21.15.59:0/3833378423 >> v1:172.21.15.59:6789/0 conn(0x7fe9880a1340 legacy=0x7fe988133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.016+0000 7fe98cad2700 1 -- 172.21.15.59:0/3833378423 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9880a1fe0 con 0x7fe988134170 2023-09-30T22:35:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.016+0000 7fe987fff700 1 --2- 172.21.15.59:0/3833378423 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880a0a30 0x7fe9880a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.016+0000 7fe98cad2700 1 --2- 172.21.15.59:0/3833378423 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe988134170 0x7fe98813bd30 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe980009dc0 tx=0x7fe98000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53b692cf1fe7b94d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.016+0000 7fe986ffd700 1 -- 172.21.15.59:0/3833378423 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98000e070 con 0x7fe988134170 2023-09-30T22:35:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.016+0000 7fe986ffd700 1 -- 172.21.15.59:0/3833378423 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98000bb20 con 0x7fe988134170 2023-09-30T22:35:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.016+0000 7fe986ffd700 1 -- 172.21.15.59:0/3833378423 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe980012430 con 0x7fe988134170 2023-09-30T22:35:04.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.017+0000 7fe98e535700 1 -- 172.21.15.59:0/3833378423 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe988134170 msgr2=0x7fe98813bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.017+0000 7fe98e535700 1 --2- 172.21.15.59:0/3833378423 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe988134170 0x7fe98813bd30 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe980009dc0 tx=0x7fe98000b330 comp rx=0 tx=0).stop 2023-09-30T22:35:04.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.017+0000 7fe98e535700 1 -- 172.21.15.59:0/3833378423 shutdown_connections 2023-09-30T22:35:04.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.017+0000 7fe98e535700 1 --2- 172.21.15.59:0/3833378423 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe988134170 0x7fe98813bd30 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.017+0000 7fe98e535700 1 --2- 172.21.15.59:0/3833378423 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880a0a30 0x7fe9880a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.017+0000 7fe98e535700 1 -- 172.21.15.59:0/3833378423 >> 172.21.15.59:0/3833378423 conn(0x7fe9880a6550 msgr2=0x7fe9880a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:04.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.017+0000 7fe98e535700 1 -- 172.21.15.59:0/3833378423 shutdown_connections 2023-09-30T22:35:04.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.017+0000 7fe98e535700 1 -- 172.21.15.59:0/3833378423 wait complete. 2023-09-30T22:35:04.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.018+0000 7fe98e535700 1 Processor -- start 2023-09-30T22:35:04.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.019+0000 7fe98e535700 1 -- start start 2023-09-30T22:35:04.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.019+0000 7fe98e535700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9880a0a30 0x7fe9881227d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.019+0000 7fe98e535700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9880a1340 0x7fe988122d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.019+0000 7fe98e535700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe988134170 0x7fe988123250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.019+0000 7fe98e535700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9881244d0 con 0x7fe9880a0a30 2023-09-30T22:35:04.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.019+0000 7fe98e535700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe988133790 con 0x7fe988134170 2023-09-30T22:35:04.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.019+0000 7fe98e535700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe988125cc0 con 0x7fe9880a1340 2023-09-30T22:35:04.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.019+0000 7fe9877fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9880a1340 0x7fe988122d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.019+0000 7fe987fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9880a0a30 0x7fe9881227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.019+0000 7fe9877fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9880a1340 0x7fe988122d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37492/0 (socket says 172.21.15.59:37492) 2023-09-30T22:35:04.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.019+0000 7fe987fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9880a0a30 0x7fe9881227d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37152/0 (socket says 172.21.15.59:37152) 2023-09-30T22:35:04.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.020+0000 7fe9877fe700 1 -- 172.21.15.59:0/824595252 learned_addr learned my addr 172.21.15.59:0/824595252 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:04.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.020+0000 7fe98cad2700 1 --2- 172.21.15.59:0/824595252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe988134170 0x7fe988123250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.020+0000 7fe9877fe700 1 -- 172.21.15.59:0/824595252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe988134170 msgr2=0x7fe988123250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.020+0000 7fe9877fe700 1 --2- 172.21.15.59:0/824595252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe988134170 0x7fe988123250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.020+0000 7fe9877fe700 1 -- 172.21.15.59:0/824595252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9880a0a30 msgr2=0x7fe9881227d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.020+0000 7fe9877fe700 1 --2- 172.21.15.59:0/824595252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9880a0a30 0x7fe9881227d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.020+0000 7fe9877fe700 1 -- 172.21.15.59:0/824595252 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9780094a0 con 0x7fe9880a1340 2023-09-30T22:35:04.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.020+0000 7fe98cad2700 1 --2- 172.21.15.59:0/824595252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe988134170 0x7fe988123250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:04.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.020+0000 7fe9877fe700 1 --2- 172.21.15.59:0/824595252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9880a1340 0x7fe988122d10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00c520 tx=0x7fe97c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:04.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.020+0000 7fe984ff9700 1 -- 172.21.15.59:0/824595252 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c004c80 con 0x7fe9880a1340 2023-09-30T22:35:04.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.020+0000 7fe984ff9700 1 -- 172.21.15.59:0/824595252 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c004e00 con 0x7fe9880a1340 2023-09-30T22:35:04.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.020+0000 7fe984ff9700 1 -- 172.21.15.59:0/824595252 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c007310 con 0x7fe9880a1340 2023-09-30T22:35:04.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.020+0000 7fe98e535700 1 -- 172.21.15.59:0/824595252 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe980009a70 con 0x7fe9880a1340 2023-09-30T22:35:04.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.020+0000 7fe98e535700 1 -- 172.21.15.59:0/824595252 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9880a25e0 con 0x7fe9880a1340 2023-09-30T22:35:04.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.021+0000 7fe984ff9700 1 -- 172.21.15.59:0/824595252 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe97c007470 con 0x7fe9880a1340 2023-09-30T22:35:04.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.021+0000 7fe984ff9700 1 -- 172.21.15.59:0/824595252 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe97c03f340 con 0x7fe9880a1340 2023-09-30T22:35:04.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.022+0000 7fe98e535700 1 -- 172.21.15.59:0/824595252 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9880a0220 con 0x7fe9880a1340 2023-09-30T22:35:04.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.027+0000 7fe984ff9700 1 -- 172.21.15.59:0/824595252 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe97c0123b0 con 0x7fe9880a1340 2023-09-30T22:35:04.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.067+0000 7fc905bb4700 1 Processor -- start 2023-09-30T22:35:04.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.067+0000 7fc905bb4700 1 -- start start 2023-09-30T22:35:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.068+0000 7fc905bb4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc90006a770 0x7fc90006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.068+0000 7fc905bb4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc900131d40 0x7fc900139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.068+0000 7fc905bb4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90009ee60 con 0x7fc90006b080 2023-09-30T22:35:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.068+0000 7fc905bb4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90009ec80 con 0x7fc90006a770 2023-09-30T22:35:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.068+0000 7fc905bb4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc90009e210 con 0x7fc900131d40 2023-09-30T22:35:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.068+0000 7fc8fffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc900131d40 0x7fc900139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.068+0000 7fc8ff7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc90006a770 0x7fc90006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.068+0000 7fc8feffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc90006b080 0x7fc900131630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35014/0 (socket says 172.21.15.59:35014) 2023-09-30T22:35:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.068+0000 7fc8feffd700 1 -- 172.21.15.59:0/985808246 learned_addr learned my addr 172.21.15.59:0/985808246 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.068+0000 7fc8fffff700 1 --2- 172.21.15.59:0/985808246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc900131d40 0x7fc900139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37504/0 (socket says 172.21.15.59:37504) 2023-09-30T22:35:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.068+0000 7fc8ff7fe700 1 --2- 172.21.15.59:0/985808246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc90006a770 0x7fc90006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52734/0 (socket says 172.21.15.59:52734) 2023-09-30T22:35:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.069+0000 7fc8fffff700 1 -- 172.21.15.59:0/985808246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc90006a770 msgr2=0x7fc90006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.069+0000 7fc8fffff700 1 --2- 172.21.15.59:0/985808246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc90006a770 0x7fc90006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.069+0000 7fc8fffff700 1 -- 172.21.15.59:0/985808246 >> v1:172.21.15.59:6789/0 conn(0x7fc90006b080 legacy=0x7fc900131630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.069+0000 7fc8fe7fc700 1 -- 172.21.15.59:0/985808246 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227770122 0 0) 0x7fc90009ee60 con 0x7fc90006b080 2023-09-30T22:35:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.069+0000 7fc8fffff700 1 -- 172.21.15.59:0/985808246 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90009d760 con 0x7fc900131d40 2023-09-30T22:35:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.069+0000 7fc8fffff700 1 --2- 172.21.15.59:0/985808246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc900131d40 0x7fc900139aa0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80098a0 tx=0x7fc8f8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2c4e8954ff22e38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.069+0000 7fc8fe7fc700 1 -- 172.21.15.59:0/985808246 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8011830 con 0x7fc900131d40 2023-09-30T22:35:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.069+0000 7fc8fe7fc700 1 -- 172.21.15.59:0/985808246 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f8011990 con 0x7fc900131d40 2023-09-30T22:35:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.069+0000 7fc8fe7fc700 1 -- 172.21.15.59:0/985808246 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8011d20 con 0x7fc900131d40 2023-09-30T22:35:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.070+0000 7fc905bb4700 1 -- 172.21.15.59:0/985808246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc900131d40 msgr2=0x7fc900139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.070+0000 7fc905bb4700 1 --2- 172.21.15.59:0/985808246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc900131d40 0x7fc900139aa0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80098a0 tx=0x7fc8f8009bb0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.070+0000 7fc905bb4700 1 -- 172.21.15.59:0/985808246 shutdown_connections 2023-09-30T22:35:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.070+0000 7fc905bb4700 1 --2- 172.21.15.59:0/985808246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc900131d40 0x7fc900139aa0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.070+0000 7fc905bb4700 1 --2- 172.21.15.59:0/985808246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc90006a770 0x7fc90006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.070+0000 7fc905bb4700 1 -- 172.21.15.59:0/985808246 >> 172.21.15.59:0/985808246 conn(0x7fc900066f50 msgr2=0x7fc9000a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.070+0000 7fc905bb4700 1 -- 172.21.15.59:0/985808246 shutdown_connections 2023-09-30T22:35:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.070+0000 7fc905bb4700 1 -- 172.21.15.59:0/985808246 wait complete. 2023-09-30T22:35:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.071+0000 7fc905bb4700 1 Processor -- start 2023-09-30T22:35:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.071+0000 7fc905bb4700 1 -- start start 2023-09-30T22:35:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.071+0000 7fc905bb4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc90006a770 0x7fc90011cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.071+0000 7fc905bb4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc90006b080 0x7fc90011d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.071+0000 7fc905bb4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc900131d40 0x7fc9001c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.071+0000 7fc905bb4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90011fc10 con 0x7fc900131d40 2023-09-30T22:35:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.071+0000 7fc905bb4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90011ee60 con 0x7fc90006b080 2023-09-30T22:35:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.071+0000 7fc905bb4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc90011cac0 con 0x7fc90006a770 2023-09-30T22:35:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc8ff7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc90006a770 0x7fc90011cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc8ff7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc90006a770 0x7fc90011cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37518/0 (socket says 172.21.15.59:37518) 2023-09-30T22:35:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc8ff7fe700 1 -- 172.21.15.59:0/111912512 learned_addr learned my addr 172.21.15.59:0/111912512 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc8fffff700 1 --2- 172.21.15.59:0/111912512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc900131d40 0x7fc9001c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc8feffd700 1 --2- 172.21.15.59:0/111912512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc90006b080 0x7fc90011d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc8ff7fe700 1 -- 172.21.15.59:0/111912512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc90006b080 msgr2=0x7fc90011d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc8ff7fe700 1 --2- 172.21.15.59:0/111912512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc90006b080 0x7fc90011d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc8ff7fe700 1 -- 172.21.15.59:0/111912512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc900131d40 msgr2=0x7fc9001c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc8ff7fe700 1 --2- 172.21.15.59:0/111912512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc900131d40 0x7fc9001c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc8ff7fe700 1 -- 172.21.15.59:0/111912512 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f80094a0 con 0x7fc90006a770 2023-09-30T22:35:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc8fffff700 1 --2- 172.21.15.59:0/111912512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc900131d40 0x7fc9001c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc8ff7fe700 1 --2- 172.21.15.59:0/111912512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc90006a770 0x7fc90011cf40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009db0 tx=0x7fc8f000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc8f7fff700 1 -- 172.21.15.59:0/111912512 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0009c20 con 0x7fc90006a770 2023-09-30T22:35:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc8f7fff700 1 -- 172.21.15.59:0/111912512 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f000f040 con 0x7fc90006a770 2023-09-30T22:35:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc905bb4700 1 -- 172.21.15.59:0/111912512 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc900120100 con 0x7fc90006a770 2023-09-30T22:35:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc8f7fff700 1 -- 172.21.15.59:0/111912512 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0014480 con 0x7fc90006a770 2023-09-30T22:35:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.072+0000 7fc905bb4700 1 -- 172.21.15.59:0/111912512 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90011fe20 con 0x7fc90006a770 2023-09-30T22:35:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.073+0000 7fc905bb4700 1 -- 172.21.15.59:0/111912512 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9000747f0 con 0x7fc90006a770 2023-09-30T22:35:04.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.074+0000 7fc8f7fff700 1 -- 172.21.15.59:0/111912512 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8f00145e0 con 0x7fc90006a770 2023-09-30T22:35:04.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.074+0000 7fc8f7fff700 1 -- 172.21.15.59:0/111912512 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc8f00406a0 con 0x7fc90006a770 2023-09-30T22:35:04.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.079+0000 7fc8f7fff700 1 -- 172.21.15.59:0/111912512 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8f0012930 con 0x7fc90006a770 2023-09-30T22:35:04.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.253+0000 7fe98e535700 1 -- 172.21.15.59:0/824595252 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe988074ea0 con 0x7fe9880a1340 2023-09-30T22:35:04.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.254+0000 7fe984ff9700 1 -- 172.21.15.59:0/824595252 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe97c011360 con 0x7fe9880a1340 2023-09-30T22:35:04.254 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:04.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.256+0000 7fe98e535700 1 -- 172.21.15.59:0/824595252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9880a1340 msgr2=0x7fe988122d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.256+0000 7fe98e535700 1 --2- 172.21.15.59:0/824595252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9880a1340 0x7fe988122d10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00c520 tx=0x7fe97c00c830 comp rx=0 tx=0).stop 2023-09-30T22:35:04.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.256+0000 7fe98e535700 1 -- 172.21.15.59:0/824595252 shutdown_connections 2023-09-30T22:35:04.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.256+0000 7fe98e535700 1 --2- 172.21.15.59:0/824595252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe988134170 0x7fe988123250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.256+0000 7fe98e535700 1 --2- 172.21.15.59:0/824595252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9880a0a30 0x7fe9881227d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.256+0000 7fe98e535700 1 --2- 172.21.15.59:0/824595252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9880a1340 0x7fe988122d10 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.256+0000 7fe98e535700 1 -- 172.21.15.59:0/824595252 >> 172.21.15.59:0/824595252 conn(0x7fe9880a6550 msgr2=0x7fe98809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:04.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.256+0000 7fe98e535700 1 -- 172.21.15.59:0/824595252 shutdown_connections 2023-09-30T22:35:04.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.256+0000 7fe98e535700 1 -- 172.21.15.59:0/824595252 wait complete. 2023-09-30T22:35:04.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:04.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.284+0000 7fc905bb4700 1 -- 172.21.15.59:0/111912512 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc90006b560 con 0x7fc90006a770 2023-09-30T22:35:04.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.285+0000 7fc8f7fff700 1 -- 172.21.15.59:0/111912512 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8f0012340 con 0x7fc90006a770 2023-09-30T22:35:04.285 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:04.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.287+0000 7fc905bb4700 1 -- 172.21.15.59:0/111912512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc90006a770 msgr2=0x7fc90011cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.287+0000 7fc905bb4700 1 --2- 172.21.15.59:0/111912512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc90006a770 0x7fc90011cf40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009db0 tx=0x7fc8f000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.287+0000 7fc905bb4700 1 -- 172.21.15.59:0/111912512 shutdown_connections 2023-09-30T22:35:04.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.287+0000 7fc905bb4700 1 --2- 172.21.15.59:0/111912512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc90006a770 0x7fc90011cf40 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.287+0000 7fc905bb4700 1 --2- 172.21.15.59:0/111912512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc900131d40 0x7fc9001c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.287+0000 7fc905bb4700 1 --2- 172.21.15.59:0/111912512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc90006b080 0x7fc90011d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.287+0000 7fc905bb4700 1 -- 172.21.15.59:0/111912512 >> 172.21.15.59:0/111912512 conn(0x7fc900066f50 msgr2=0x7fc9001b9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:04.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.287+0000 7fc905bb4700 1 -- 172.21.15.59:0/111912512 shutdown_connections 2023-09-30T22:35:04.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.287+0000 7fc905bb4700 1 -- 172.21.15.59:0/111912512 wait complete. 2023-09-30T22:35:04.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:04.323 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:04.364 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.483+0000 7fdce3b28700 1 Processor -- start 2023-09-30T22:35:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.483+0000 7fdce3b28700 1 -- start start 2023-09-30T22:35:04.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce3b28700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdcdc09d6f0 0x7fdcdc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce3b28700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcdc134100 0x7fdcdc13bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce3b28700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc09d2f0 con 0x7fdcdc09e000 2023-09-30T22:35:04.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce3b28700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc09a810 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce3b28700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc09a470 con 0x7fdcdc134100 2023-09-30T22:35:04.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce18c4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdcdc09d6f0 0x7fdcdc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce20c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcdc134100 0x7fdcdc13bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce18c4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdcdc09d6f0 0x7fdcdc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45074/0 (socket says 172.21.15.59:45074) 2023-09-30T22:35:04.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce20c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcdc134100 0x7fdcdc13bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40792/0 (socket says 172.21.15.59:40792) 2023-09-30T22:35:04.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce18c4700 1 -- 172.21.15.59:0/1259935460 learned_addr learned my addr 172.21.15.59:0/1259935460 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:04.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce18c4700 1 -- 172.21.15.59:0/1259935460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcdc134100 msgr2=0x7fdcdc13bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:04.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce18c4700 1 --2- 172.21.15.59:0/1259935460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcdc134100 0x7fdcdc13bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce18c4700 1 -- 172.21.15.59:0/1259935460 >> v1:172.21.15.59:6789/0 conn(0x7fdcdc09e000 legacy=0x7fdcdc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce18c4700 1 -- 172.21.15.59:0/1259935460 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc09ec40 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce08c2700 1 -- 172.21.15.59:0/1259935460 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387470487 0 0) 0x7fdcdc09d2f0 con 0x7fdcdc09e000 2023-09-30T22:35:04.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.484+0000 7fdce20c5700 1 --2- 172.21.15.59:0/1259935460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcdc134100 0x7fdcdc13bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:04.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.485+0000 7fdce18c4700 1 --2- 172.21.15.59:0/1259935460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcdc09d6f0 0x7fdcdc09dac0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80098f0 tx=0x7fdcd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e370706648086aea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:04.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.485+0000 7fdce08c2700 1 -- 172.21.15.59:0/1259935460 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8011830 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.485+0000 7fdce08c2700 1 -- 172.21.15.59:0/1259935460 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8011990 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.485+0000 7fdce08c2700 1 -- 172.21.15.59:0/1259935460 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8011d20 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.485+0000 7fdce3b28700 1 -- 172.21.15.59:0/1259935460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcdc09d6f0 msgr2=0x7fdcdc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.485+0000 7fdce3b28700 1 --2- 172.21.15.59:0/1259935460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcdc09d6f0 0x7fdcdc09dac0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80098f0 tx=0x7fdcd8009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:04.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.486+0000 7fdce3b28700 1 -- 172.21.15.59:0/1259935460 shutdown_connections 2023-09-30T22:35:04.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.486+0000 7fdce3b28700 1 --2- 172.21.15.59:0/1259935460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcdc09d6f0 0x7fdcdc09dac0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.486+0000 7fdce3b28700 1 --2- 172.21.15.59:0/1259935460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcdc134100 0x7fdcdc13bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.486+0000 7fdce3b28700 1 -- 172.21.15.59:0/1259935460 >> 172.21.15.59:0/1259935460 conn(0x7fdcdc066f50 msgr2=0x7fdcdc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:04.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.486+0000 7fdce3b28700 1 -- 172.21.15.59:0/1259935460 shutdown_connections 2023-09-30T22:35:04.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.486+0000 7fdce3b28700 1 -- 172.21.15.59:0/1259935460 wait complete. 2023-09-30T22:35:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.487+0000 7fdce3b28700 1 Processor -- start 2023-09-30T22:35:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.487+0000 7fdce3b28700 1 -- start start 2023-09-30T22:35:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.487+0000 7fdce3b28700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcdc09d6f0 0x7fdcdc122690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.487+0000 7fdce3b28700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcdc09e000 0x7fdcdc122bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.487+0000 7fdce3b28700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcdc134100 0x7fdcdc123110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.487+0000 7fdce3b28700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc125c10 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.487+0000 7fdce3b28700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc125920 con 0x7fdcdc134100 2023-09-30T22:35:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.487+0000 7fdce3b28700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc133190 con 0x7fdcdc09e000 2023-09-30T22:35:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.487+0000 7fdce20c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcdc134100 0x7fdcdc123110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.487+0000 7fdce20c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcdc134100 0x7fdcdc123110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40806/0 (socket says 172.21.15.59:40806) 2023-09-30T22:35:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.487+0000 7fdce20c5700 1 -- 172.21.15.59:0/4099568080 learned_addr learned my addr 172.21.15.59:0/4099568080 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.487+0000 7fdce18c4700 1 --2- 172.21.15.59:0/4099568080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcdc09d6f0 0x7fdcdc122690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.487+0000 7fdce10c3700 1 --2- 172.21.15.59:0/4099568080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcdc09e000 0x7fdcdc122bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.488+0000 7fdce18c4700 1 -- 172.21.15.59:0/4099568080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcdc09e000 msgr2=0x7fdcdc122bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.488+0000 7fdce18c4700 1 --2- 172.21.15.59:0/4099568080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcdc09e000 0x7fdcdc122bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.488+0000 7fdce18c4700 1 -- 172.21.15.59:0/4099568080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcdc134100 msgr2=0x7fdcdc123110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.488+0000 7fdce18c4700 1 --2- 172.21.15.59:0/4099568080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcdc134100 0x7fdcdc123110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.488+0000 7fdce18c4700 1 -- 172.21.15.59:0/4099568080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd4009a70 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.488+0000 7fdce20c5700 1 --2- 172.21.15.59:0/4099568080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcdc134100 0x7fdcdc123110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:04.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.488+0000 7fdce18c4700 1 --2- 172.21.15.59:0/4099568080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcdc09d6f0 0x7fdcdc122690 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8016000 tx=0x7fdcd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:04.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.488+0000 7fdcd27fc700 1 -- 172.21.15.59:0/4099568080 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8004510 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.488+0000 7fdcd27fc700 1 -- 172.21.15.59:0/4099568080 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd80036a0 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.488+0000 7fdce3b28700 1 -- 172.21.15.59:0/4099568080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd8009550 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.488+0000 7fdcd27fc700 1 -- 172.21.15.59:0/4099568080 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8003a30 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.488+0000 7fdce3b28700 1 -- 172.21.15.59:0/4099568080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc124390 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.489+0000 7fdcd27fc700 1 -- 172.21.15.59:0/4099568080 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdcd8021070 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.489+0000 7fdcd27fc700 1 -- 172.21.15.59:0/4099568080 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdcd8040a00 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.489+0000 7fdce3b28700 1 -- 172.21.15.59:0/4099568080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc09c820 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.494+0000 7fdcd27fc700 1 -- 172.21.15.59:0/4099568080 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdcd8015080 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.523+0000 7f5184592700 1 Processor -- start 2023-09-30T22:35:04.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.523+0000 7f5184592700 1 -- start start 2023-09-30T22:35:04.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.524+0000 7f5184592700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f517c0a0a30 0x7f517c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.524+0000 7f5184592700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09d630 0x7f517c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.524+0000 7f5184592700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c133930 0x7f517c133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.524+0000 7f5184592700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517c0a2a70 con 0x7f517c0a0a30 2023-09-30T22:35:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.524+0000 7f5184592700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c0a01d0 con 0x7f517c133930 2023-09-30T22:35:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.524+0000 7f5184592700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f517c09e2b0 con 0x7f517c09d630 2023-09-30T22:35:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.524+0000 7f5181b2d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09d630 0x7f517c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.524+0000 7f5182b2f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c133930 0x7f517c133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.525+0000 7f518232e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f517c0a0a30 0x7f517c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.525+0000 7f5181b2d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09d630 0x7f517c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52726/0 (socket says 172.21.15.59:52726) 2023-09-30T22:35:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.525+0000 7f5181b2d700 1 -- 172.21.15.59:0/2706372653 learned_addr learned my addr 172.21.15.59:0/2706372653 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.525+0000 7f518232e700 1 -- 172.21.15.59:0/2706372653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09d630 msgr2=0x7f517c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:04.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.525+0000 7f518232e700 1 --2- 172.21.15.59:0/2706372653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09d630 0x7f517c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.525+0000 7f518232e700 1 -- 172.21.15.59:0/2706372653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c133930 msgr2=0x7f517c133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:04.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.525+0000 7f518232e700 1 --2- 172.21.15.59:0/2706372653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c133930 0x7f517c133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.525+0000 7f518232e700 1 -- 172.21.15.59:0/2706372653 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c09dc50 con 0x7f517c0a0a30 2023-09-30T22:35:04.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.525+0000 7f5181b2d700 1 --2- 172.21.15.59:0/2706372653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09d630 0x7f517c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:04.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.525+0000 7f5182b2f700 1 --2- 172.21.15.59:0/2706372653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c133930 0x7f517c133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:04.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.525+0000 7f518232e700 1 --2- 172.21.15.59:0/2706372653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c0a0a30 0x7f517c0a0e00 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f516c009d90 tx=0x7f516c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbf6a3600b1bb32 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:04.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.525+0000 7f518132c700 1 -- 172.21.15.59:0/2706372653 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c00e070 con 0x7f517c0a0a30 2023-09-30T22:35:04.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.525+0000 7f518132c700 1 -- 172.21.15.59:0/2706372653 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c00bb20 con 0x7f517c0a0a30 2023-09-30T22:35:04.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.525+0000 7f518132c700 1 -- 172.21.15.59:0/2706372653 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c012430 con 0x7f517c0a0a30 2023-09-30T22:35:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.526+0000 7f5184592700 1 -- 172.21.15.59:0/2706372653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c0a0a30 msgr2=0x7f517c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.526+0000 7f5184592700 1 --2- 172.21.15.59:0/2706372653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c0a0a30 0x7f517c0a0e00 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f516c009d90 tx=0x7f516c00b330 comp rx=0 tx=0).stop 2023-09-30T22:35:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.526+0000 7f5184592700 1 -- 172.21.15.59:0/2706372653 shutdown_connections 2023-09-30T22:35:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.526+0000 7f5184592700 1 --2- 172.21.15.59:0/2706372653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c133930 0x7f517c133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.526+0000 7f5184592700 1 --2- 172.21.15.59:0/2706372653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c0a0a30 0x7f517c0a0e00 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.526+0000 7f5184592700 1 --2- 172.21.15.59:0/2706372653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09d630 0x7f517c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.526+0000 7f5184592700 1 -- 172.21.15.59:0/2706372653 >> 172.21.15.59:0/2706372653 conn(0x7f517c0a3050 msgr2=0x7f517c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.526+0000 7f5184592700 1 -- 172.21.15.59:0/2706372653 shutdown_connections 2023-09-30T22:35:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.526+0000 7f5184592700 1 -- 172.21.15.59:0/2706372653 wait complete. 2023-09-30T22:35:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.527+0000 7f5184592700 1 Processor -- start 2023-09-30T22:35:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.527+0000 7f5184592700 1 -- start start 2023-09-30T22:35:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5184592700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c09d630 0x7f517c11f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5184592700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c0a0a30 0x7f517c11f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5184592700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c133930 0x7f517c1c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5184592700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c1223a0 con 0x7f517c09d630 2023-09-30T22:35:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5184592700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c122580 con 0x7f517c133930 2023-09-30T22:35:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5184592700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f517c1333f0 con 0x7f517c0a0a30 2023-09-30T22:35:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5181b2d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c0a0a30 0x7f517c11f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5182b2f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c133930 0x7f517c1c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5181b2d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c0a0a30 0x7f517c11f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52734/0 (socket says 172.21.15.59:52734) 2023-09-30T22:35:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5182b2f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c133930 0x7f517c1c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40816/0 (socket says 172.21.15.59:40816) 2023-09-30T22:35:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5181b2d700 1 -- 172.21.15.59:0/1181223050 learned_addr learned my addr 172.21.15.59:0/1181223050 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f518232e700 1 --2- 172.21.15.59:0/1181223050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c09d630 0x7f517c11f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5182b2f700 1 -- 172.21.15.59:0/1181223050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c0a0a30 msgr2=0x7f517c11f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5182b2f700 1 --2- 172.21.15.59:0/1181223050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c0a0a30 0x7f517c11f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5182b2f700 1 -- 172.21.15.59:0/1181223050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c09d630 msgr2=0x7f517c11f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5182b2f700 1 --2- 172.21.15.59:0/1181223050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c09d630 0x7f517c11f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5182b2f700 1 -- 172.21.15.59:0/1181223050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5170009550 con 0x7f517c133930 2023-09-30T22:35:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5181b2d700 1 --2- 172.21.15.59:0/1181223050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c0a0a30 0x7f517c11f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f5182b2f700 1 --2- 172.21.15.59:0/1181223050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c133930 0x7f517c1c8100 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f517400e910 tx=0x7f517400ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.528+0000 7f517affd700 1 -- 172.21.15.59:0/1181223050 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5174004020 con 0x7f517c133930 2023-09-30T22:35:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.529+0000 7f517affd700 1 -- 172.21.15.59:0/1181223050 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51740041a0 con 0x7f517c133930 2023-09-30T22:35:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.529+0000 7f5184592700 1 -- 172.21.15.59:0/1181223050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51740094a0 con 0x7f517c133930 2023-09-30T22:35:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.529+0000 7f517affd700 1 -- 172.21.15.59:0/1181223050 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5174004550 con 0x7f517c133930 2023-09-30T22:35:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.529+0000 7f5184592700 1 -- 172.21.15.59:0/1181223050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516c009a70 con 0x7f517c133930 2023-09-30T22:35:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.530+0000 7f5184592700 1 -- 172.21.15.59:0/1181223050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517c0a0410 con 0x7f517c133930 2023-09-30T22:35:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.530+0000 7f517affd700 1 -- 172.21.15.59:0/1181223050 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51740036a0 con 0x7f517c133930 2023-09-30T22:35:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.530+0000 7f517affd700 1 -- 172.21.15.59:0/1181223050 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f517403fae0 con 0x7f517c133930 2023-09-30T22:35:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.535+0000 7f517affd700 1 -- 172.21.15.59:0/1181223050 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5174013680 con 0x7f517c133930 2023-09-30T22:35:04.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.719+0000 7fdce3b28700 1 -- 172.21.15.59:0/4099568080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdcdc074ea0 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.719+0000 7fdcd27fc700 1 -- 172.21.15.59:0/4099568080 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdcd8029020 con 0x7fdcdc09d6f0 2023-09-30T22:35:04.720 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:04.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.722+0000 7fdce3b28700 1 -- 172.21.15.59:0/4099568080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcdc09d6f0 msgr2=0x7fdcdc122690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.722+0000 7fdce3b28700 1 --2- 172.21.15.59:0/4099568080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcdc09d6f0 0x7fdcdc122690 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8016000 tx=0x7fdcd8004750 comp rx=0 tx=0).stop 2023-09-30T22:35:04.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.722+0000 7fdce3b28700 1 -- 172.21.15.59:0/4099568080 shutdown_connections 2023-09-30T22:35:04.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.722+0000 7fdce3b28700 1 --2- 172.21.15.59:0/4099568080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcdc134100 0x7fdcdc123110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.722+0000 7fdce3b28700 1 --2- 172.21.15.59:0/4099568080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcdc09d6f0 0x7fdcdc122690 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.722+0000 7fdce3b28700 1 --2- 172.21.15.59:0/4099568080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcdc09e000 0x7fdcdc122bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.722+0000 7fdce3b28700 1 -- 172.21.15.59:0/4099568080 >> 172.21.15.59:0/4099568080 conn(0x7fdcdc066f50 msgr2=0x7fdcdc0721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:04.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.722+0000 7fdce3b28700 1 -- 172.21.15.59:0/4099568080 shutdown_connections 2023-09-30T22:35:04.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.722+0000 7fdce3b28700 1 -- 172.21.15.59:0/4099568080 wait complete. 2023-09-30T22:35:04.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:04.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.755+0000 7f5184592700 1 -- 172.21.15.59:0/1181223050 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f517c120e60 con 0x7f517c133930 2023-09-30T22:35:04.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.756+0000 7f517affd700 1 -- 172.21.15.59:0/1181223050 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5174020030 con 0x7f517c133930 2023-09-30T22:35:04.756 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:04.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.758+0000 7f5184592700 1 -- 172.21.15.59:0/1181223050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c133930 msgr2=0x7f517c1c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.758+0000 7f5184592700 1 --2- 172.21.15.59:0/1181223050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c133930 0x7f517c1c8100 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f517400e910 tx=0x7f517400ec20 comp rx=0 tx=0).stop 2023-09-30T22:35:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.758+0000 7f5184592700 1 -- 172.21.15.59:0/1181223050 shutdown_connections 2023-09-30T22:35:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.758+0000 7f5184592700 1 --2- 172.21.15.59:0/1181223050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c133930 0x7f517c1c8100 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.758+0000 7f5184592700 1 --2- 172.21.15.59:0/1181223050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c09d630 0x7f517c11f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.758+0000 7f5184592700 1 --2- 172.21.15.59:0/1181223050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c0a0a30 0x7f517c11f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.758+0000 7f5184592700 1 -- 172.21.15.59:0/1181223050 >> 172.21.15.59:0/1181223050 conn(0x7f517c0a3050 msgr2=0x7f517c1bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.758+0000 7f5184592700 1 -- 172.21.15.59:0/1181223050 shutdown_connections 2023-09-30T22:35:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:04.758+0000 7f5184592700 1 -- 172.21.15.59:0/1181223050 wait complete. 2023-09-30T22:35:04.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:05.271 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:05.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:05.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.417+0000 7f3a4adc9700 1 Processor -- start 2023-09-30T22:35:05.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.417+0000 7f3a4adc9700 1 -- start start 2023-09-30T22:35:05.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.418+0000 7f3a4adc9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a4412cf60 0x7f3a4406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.418+0000 7f3a4adc9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a44130430 0x7f3a44137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.418+0000 7f3a4adc9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4412cd90 con 0x7f3a4412f8b0 2023-09-30T22:35:05.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.418+0000 7f3a4adc9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4412d330 con 0x7f3a4412cf60 2023-09-30T22:35:05.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.418+0000 7f3a4adc9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a44071780 con 0x7f3a44130430 2023-09-30T22:35:05.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.419+0000 7f3a49366700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a44130430 0x7f3a44137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.419+0000 7f3a49366700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a44130430 0x7f3a44137c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52740/0 (socket says 172.21.15.59:52740) 2023-09-30T22:35:05.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.419+0000 7f3a49366700 1 -- 172.21.15.59:0/2345171769 learned_addr learned my addr 172.21.15.59:0/2345171769 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:05.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.419+0000 7f3a48b65700 1 --2- 172.21.15.59:0/2345171769 >> v2:172.21.15.59:3300/0 conn(0x7f3a4412cf60 0x7f3a4406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.419+0000 7f3a49366700 1 -- 172.21.15.59:0/2345171769 >> v2:172.21.15.59:3300/0 conn(0x7f3a4412cf60 msgr2=0x7f3a4406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.419+0000 7f3a49366700 1 --2- 172.21.15.59:0/2345171769 >> v2:172.21.15.59:3300/0 conn(0x7f3a4412cf60 0x7f3a4406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.419+0000 7f3a49366700 1 -- 172.21.15.59:0/2345171769 >> v1:172.21.15.59:6789/0 conn(0x7f3a4412f8b0 legacy=0x7f3a4412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.419+0000 7f3a49366700 1 -- 172.21.15.59:0/2345171769 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a44071a40 con 0x7f3a44130430 2023-09-30T22:35:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.419+0000 7f3a49366700 1 --2- 172.21.15.59:0/2345171769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a44130430 0x7f3a44137c30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009e50 tx=0x7f3a3c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4a21a010a2dc3f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.419+0000 7f3a437fe700 1 -- 172.21.15.59:0/2345171769 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00e070 con 0x7f3a44130430 2023-09-30T22:35:05.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.419+0000 7f3a437fe700 1 -- 172.21.15.59:0/2345171769 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c00b910 con 0x7f3a44130430 2023-09-30T22:35:05.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.419+0000 7f3a437fe700 1 -- 172.21.15.59:0/2345171769 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00bcc0 con 0x7f3a44130430 2023-09-30T22:35:05.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.420+0000 7f3a4adc9700 1 -- 172.21.15.59:0/2345171769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a44130430 msgr2=0x7f3a44137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.420+0000 7f3a4adc9700 1 --2- 172.21.15.59:0/2345171769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a44130430 0x7f3a44137c30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009e50 tx=0x7f3a3c00b330 comp rx=0 tx=0).stop 2023-09-30T22:35:05.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.420+0000 7f3a4adc9700 1 -- 172.21.15.59:0/2345171769 shutdown_connections 2023-09-30T22:35:05.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.420+0000 7f3a4adc9700 1 --2- 172.21.15.59:0/2345171769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a44130430 0x7f3a44137c30 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.420+0000 7f3a4adc9700 1 --2- 172.21.15.59:0/2345171769 >> v2:172.21.15.59:3300/0 conn(0x7f3a4412cf60 0x7f3a4406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.420+0000 7f3a4adc9700 1 -- 172.21.15.59:0/2345171769 >> 172.21.15.59:0/2345171769 conn(0x7f3a440a2aa0 msgr2=0x7f3a440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:05.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.420+0000 7f3a4adc9700 1 -- 172.21.15.59:0/2345171769 shutdown_connections 2023-09-30T22:35:05.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.420+0000 7f3a4adc9700 1 -- 172.21.15.59:0/2345171769 wait complete. 2023-09-30T22:35:05.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.422+0000 7f3a4adc9700 1 Processor -- start 2023-09-30T22:35:05.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.422+0000 7f3a4adc9700 1 -- start start 2023-09-30T22:35:05.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a4adc9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4412cf60 0x7f3a4409be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a4adc9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4412f8b0 0x7f3a4409c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a4adc9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a44130430 0x7f3a441c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a4adc9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a44129fa0 con 0x7f3a4412f8b0 2023-09-30T22:35:05.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a4adc9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4409e8c0 con 0x7f3a4412cf60 2023-09-30T22:35:05.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a4adc9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4409eb10 con 0x7f3a44130430 2023-09-30T22:35:05.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a49366700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a44130430 0x7f3a441c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a48b65700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4412cf60 0x7f3a4409be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a48b65700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4412cf60 0x7f3a4409be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40822/0 (socket says 172.21.15.59:40822) 2023-09-30T22:35:05.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a48b65700 1 -- 172.21.15.59:0/3450427257 learned_addr learned my addr 172.21.15.59:0/3450427257 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:05.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a49366700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a44130430 0x7f3a441c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52754/0 (socket says 172.21.15.59:52754) 2023-09-30T22:35:05.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a43fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4412f8b0 0x7f3a4409c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a48b65700 1 -- 172.21.15.59:0/3450427257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a44130430 msgr2=0x7f3a441c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a48b65700 1 --2- 172.21.15.59:0/3450427257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a44130430 0x7f3a441c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a48b65700 1 -- 172.21.15.59:0/3450427257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4412f8b0 msgr2=0x7f3a4409c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a48b65700 1 --2- 172.21.15.59:0/3450427257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4412f8b0 0x7f3a4409c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a48b65700 1 -- 172.21.15.59:0/3450427257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c009b30 con 0x7f3a4412cf60 2023-09-30T22:35:05.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a49366700 1 --2- 172.21.15.59:0/3450427257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a44130430 0x7f3a441c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:05.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a43fff700 1 --2- 172.21.15.59:0/3450427257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4412f8b0 0x7f3a4409c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:05.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.423+0000 7f3a48b65700 1 --2- 172.21.15.59:0/3450427257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4412cf60 0x7f3a4409be70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3a34010bc0 tx=0x7f3a34010ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:05.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.424+0000 7f3a417fa700 1 -- 172.21.15.59:0/3450427257 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34009710 con 0x7f3a4412cf60 2023-09-30T22:35:05.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.424+0000 7f3a417fa700 1 -- 172.21.15.59:0/3450427257 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3400ed20 con 0x7f3a4412cf60 2023-09-30T22:35:05.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.424+0000 7f3a4adc9700 1 -- 172.21.15.59:0/3450427257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4409b820 con 0x7f3a4412cf60 2023-09-30T22:35:05.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.424+0000 7f3a417fa700 1 -- 172.21.15.59:0/3450427257 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34011650 con 0x7f3a4412cf60 2023-09-30T22:35:05.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.424+0000 7f3a4adc9700 1 -- 172.21.15.59:0/3450427257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a44129b40 con 0x7f3a4412cf60 2023-09-30T22:35:05.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.425+0000 7f3a4adc9700 1 -- 172.21.15.59:0/3450427257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4412ec60 con 0x7f3a4412cf60 2023-09-30T22:35:05.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.425+0000 7f3a417fa700 1 -- 172.21.15.59:0/3450427257 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a340117b0 con 0x7f3a4412cf60 2023-09-30T22:35:05.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.425+0000 7f3a417fa700 1 -- 172.21.15.59:0/3450427257 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3a34041d80 con 0x7f3a4412cf60 2023-09-30T22:35:05.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.430+0000 7f3a417fa700 1 -- 172.21.15.59:0/3450427257 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a34018970 con 0x7f3a4412cf60 2023-09-30T22:35:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.466+0000 7f585e7ad700 1 Processor -- start 2023-09-30T22:35:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.466+0000 7f585e7ad700 1 -- start start 2023-09-30T22:35:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f585e7ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585806a770 0x7f585806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f585e7ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f585806b080 0x7f5858131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f585e7ad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5858131b40 0x7f5858131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f585e7ad700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585809ece0 con 0x7f5858131b40 2023-09-30T22:35:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f585e7ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585809e760 con 0x7f585806a770 2023-09-30T22:35:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f585e7ad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f585809e040 con 0x7f585806b080 2023-09-30T22:35:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f5857fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585806a770 0x7f585806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f58577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f585806b080 0x7f5858131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f58577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f585806b080 0x7f5858131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52770/0 (socket says 172.21.15.59:52770) 2023-09-30T22:35:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f5857fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585806a770 0x7f585806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40838/0 (socket says 172.21.15.59:40838) 2023-09-30T22:35:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f58577fe700 1 -- 172.21.15.59:0/3641983877 learned_addr learned my addr 172.21.15.59:0/3641983877 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f585cd4a700 1 --2- 172.21.15.59:0/3641983877 >> v2:172.21.15.59:3300/0 conn(0x7f5858131b40 0x7f5858131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f5857fff700 1 -- 172.21.15.59:0/3641983877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f585806b080 msgr2=0x7f5858131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f5857fff700 1 --2- 172.21.15.59:0/3641983877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f585806b080 0x7f5858131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f5857fff700 1 -- 172.21.15.59:0/3641983877 >> v2:172.21.15.59:3300/0 conn(0x7f5858131b40 msgr2=0x7f5858131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f5857fff700 1 --2- 172.21.15.59:0/3641983877 >> v2:172.21.15.59:3300/0 conn(0x7f5858131b40 0x7f5858131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f5857fff700 1 -- 172.21.15.59:0/3641983877 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585809f630 con 0x7f585806a770 2023-09-30T22:35:05.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f58577fe700 1 --2- 172.21.15.59:0/3641983877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f585806b080 0x7f5858131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:05.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.467+0000 7f585cd4a700 1 --2- 172.21.15.59:0/3641983877 >> v2:172.21.15.59:3300/0 conn(0x7f5858131b40 0x7f5858131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:05.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.468+0000 7f5857fff700 1 --2- 172.21.15.59:0/3641983877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585806a770 0x7f585806ab40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5848009840 tx=0x7f5848009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14e8afde9d4208ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:05.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.468+0000 7f5856ffd700 1 -- 172.21.15.59:0/3641983877 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848011830 con 0x7f585806a770 2023-09-30T22:35:05.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.468+0000 7f5856ffd700 1 -- 172.21.15.59:0/3641983877 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5848011990 con 0x7f585806a770 2023-09-30T22:35:05.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.468+0000 7f5856ffd700 1 -- 172.21.15.59:0/3641983877 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848011d20 con 0x7f585806a770 2023-09-30T22:35:05.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.468+0000 7f585e7ad700 1 -- 172.21.15.59:0/3641983877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585806a770 msgr2=0x7f585806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.468+0000 7f585e7ad700 1 --2- 172.21.15.59:0/3641983877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585806a770 0x7f585806ab40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5848009840 tx=0x7f5848009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:05.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.469+0000 7f585e7ad700 1 -- 172.21.15.59:0/3641983877 shutdown_connections 2023-09-30T22:35:05.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.469+0000 7f585e7ad700 1 --2- 172.21.15.59:0/3641983877 >> v2:172.21.15.59:3300/0 conn(0x7f5858131b40 0x7f5858131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.469+0000 7f585e7ad700 1 --2- 172.21.15.59:0/3641983877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585806a770 0x7f585806ab40 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.469+0000 7f585e7ad700 1 --2- 172.21.15.59:0/3641983877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f585806b080 0x7f5858131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.469+0000 7f585e7ad700 1 -- 172.21.15.59:0/3641983877 >> 172.21.15.59:0/3641983877 conn(0x7f5858066f50 msgr2=0x7f585809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:05.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.469+0000 7f585e7ad700 1 -- 172.21.15.59:0/3641983877 shutdown_connections 2023-09-30T22:35:05.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.469+0000 7f585e7ad700 1 -- 172.21.15.59:0/3641983877 wait complete. 2023-09-30T22:35:05.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.470+0000 7f585e7ad700 1 Processor -- start 2023-09-30T22:35:05.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.470+0000 7f585e7ad700 1 -- start start 2023-09-30T22:35:05.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.471+0000 7f585e7ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585806a770 0x7f5858120070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.471+0000 7f585e7ad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585806b080 0x7f58581205b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.471+0000 7f585e7ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5858131b40 0x7f5858120af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.471+0000 7f585e7ad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5858122b90 con 0x7f585806b080 2023-09-30T22:35:05.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.471+0000 7f585e7ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58581214d0 con 0x7f585806a770 2023-09-30T22:35:05.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.471+0000 7f585e7ad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58580a3960 con 0x7f5858131b40 2023-09-30T22:35:05.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.471+0000 7f5857fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585806a770 0x7f5858120070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.471+0000 7f58577fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585806b080 0x7f58581205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.471+0000 7f5857fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585806a770 0x7f5858120070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40842/0 (socket says 172.21.15.59:40842) 2023-09-30T22:35:05.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.471+0000 7f5857fff700 1 -- 172.21.15.59:0/3407656284 learned_addr learned my addr 172.21.15.59:0/3407656284 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:05.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.471+0000 7f58577fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585806b080 0x7f58581205b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45124/0 (socket says 172.21.15.59:45124) 2023-09-30T22:35:05.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.471+0000 7f585cd4a700 1 --2- 172.21.15.59:0/3407656284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5858131b40 0x7f5858120af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.472+0000 7f5857fff700 1 -- 172.21.15.59:0/3407656284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5858131b40 msgr2=0x7f5858120af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.472+0000 7f5857fff700 1 --2- 172.21.15.59:0/3407656284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5858131b40 0x7f5858120af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.472+0000 7f5857fff700 1 -- 172.21.15.59:0/3407656284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585806b080 msgr2=0x7f58581205b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.472+0000 7f5857fff700 1 --2- 172.21.15.59:0/3407656284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585806b080 0x7f58581205b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.472+0000 7f5857fff700 1 -- 172.21.15.59:0/3407656284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c009550 con 0x7f585806a770 2023-09-30T22:35:05.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.472+0000 7f58577fe700 1 --2- 172.21.15.59:0/3407656284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585806b080 0x7f58581205b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:05.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.472+0000 7f5857fff700 1 --2- 172.21.15.59:0/3407656284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585806a770 0x7f5858120070 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f58480090b0 tx=0x7f5848004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:05.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.472+0000 7f5854ff9700 1 -- 172.21.15.59:0/3407656284 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848004450 con 0x7f585806a770 2023-09-30T22:35:05.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.472+0000 7f5854ff9700 1 -- 172.21.15.59:0/3407656284 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584801f070 con 0x7f585806a770 2023-09-30T22:35:05.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.472+0000 7f5854ff9700 1 -- 172.21.15.59:0/3407656284 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58480038e0 con 0x7f585806a770 2023-09-30T22:35:05.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.472+0000 7f585e7ad700 1 -- 172.21.15.59:0/3407656284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5850009a70 con 0x7f585806a770 2023-09-30T22:35:05.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.472+0000 7f585e7ad700 1 -- 172.21.15.59:0/3407656284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58480094a0 con 0x7f585806a770 2023-09-30T22:35:05.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.473+0000 7f5854ff9700 1 -- 172.21.15.59:0/3407656284 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5848003a40 con 0x7f585806a770 2023-09-30T22:35:05.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.473+0000 7f5854ff9700 1 -- 172.21.15.59:0/3407656284 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5848021070 con 0x7f585806a770 2023-09-30T22:35:05.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.473+0000 7f585e7ad700 1 -- 172.21.15.59:0/3407656284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5858074ea0 con 0x7f585806a770 2023-09-30T22:35:05.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.478+0000 7f5854ff9700 1 -- 172.21.15.59:0/3407656284 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f584801a430 con 0x7f585806a770 2023-09-30T22:35:05.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.666+0000 7f3a4adc9700 1 -- 172.21.15.59:0/3450427257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3a44074ea0 con 0x7f3a4412cf60 2023-09-30T22:35:05.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.666+0000 7f3a417fa700 1 -- 172.21.15.59:0/3450427257 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a3401e070 con 0x7f3a4412cf60 2023-09-30T22:35:05.667 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:05.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.669+0000 7f3a4adc9700 1 -- 172.21.15.59:0/3450427257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4412cf60 msgr2=0x7f3a4409be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.669+0000 7f3a4adc9700 1 --2- 172.21.15.59:0/3450427257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4412cf60 0x7f3a4409be70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3a34010bc0 tx=0x7f3a34010ed0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.669+0000 7f3a4adc9700 1 -- 172.21.15.59:0/3450427257 shutdown_connections 2023-09-30T22:35:05.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.669+0000 7f3a4adc9700 1 --2- 172.21.15.59:0/3450427257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a44130430 0x7f3a441c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.669+0000 7f3a4adc9700 1 --2- 172.21.15.59:0/3450427257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4412cf60 0x7f3a4409be70 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.669+0000 7f3a4adc9700 1 --2- 172.21.15.59:0/3450427257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4412f8b0 0x7f3a4409c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.669+0000 7f3a4adc9700 1 -- 172.21.15.59:0/3450427257 >> 172.21.15.59:0/3450427257 conn(0x7f3a440a2aa0 msgr2=0x7f3a441b89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:05.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.669+0000 7f3a4adc9700 1 -- 172.21.15.59:0/3450427257 shutdown_connections 2023-09-30T22:35:05.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.669+0000 7f3a4adc9700 1 -- 172.21.15.59:0/3450427257 wait complete. 2023-09-30T22:35:05.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:05.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.698+0000 7f585e7ad700 1 -- 172.21.15.59:0/3407656284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5858122470 con 0x7f585806a770 2023-09-30T22:35:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.699+0000 7f5854ff9700 1 -- 172.21.15.59:0/3407656284 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5848015030 con 0x7f585806a770 2023-09-30T22:35:05.699 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:05.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.701+0000 7f585e7ad700 1 -- 172.21.15.59:0/3407656284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585806a770 msgr2=0x7f5858120070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.701+0000 7f585e7ad700 1 --2- 172.21.15.59:0/3407656284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585806a770 0x7f5858120070 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f58480090b0 tx=0x7f5848004750 comp rx=0 tx=0).stop 2023-09-30T22:35:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.701+0000 7f585e7ad700 1 -- 172.21.15.59:0/3407656284 shutdown_connections 2023-09-30T22:35:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.701+0000 7f585e7ad700 1 --2- 172.21.15.59:0/3407656284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5858131b40 0x7f5858120af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.701+0000 7f585e7ad700 1 --2- 172.21.15.59:0/3407656284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585806a770 0x7f5858120070 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.701+0000 7f585e7ad700 1 --2- 172.21.15.59:0/3407656284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585806b080 0x7f58581205b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.701+0000 7f585e7ad700 1 -- 172.21.15.59:0/3407656284 >> 172.21.15.59:0/3407656284 conn(0x7f5858066f50 msgr2=0x7f5858071480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.701+0000 7f585e7ad700 1 -- 172.21.15.59:0/3407656284 shutdown_connections 2023-09-30T22:35:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.701+0000 7f585e7ad700 1 -- 172.21.15.59:0/3407656284 wait complete. 2023-09-30T22:35:05.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:05.736 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:05.773 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:05.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.901+0000 7f6902a21700 1 Processor -- start 2023-09-30T22:35:05.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.901+0000 7f6902a21700 1 -- start start 2023-09-30T22:35:05.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.902+0000 7f6902a21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68fc0a0a30 0x7f68fc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.902+0000 7f6902a21700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68fc138d80 0x7f68fc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.902+0000 7f6902a21700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68fc0a2a70 con 0x7f68fc09d630 2023-09-30T22:35:05.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.902+0000 7f6902a21700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0a01d0 con 0x7f68fc0a0a30 2023-09-30T22:35:05.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.902+0000 7f6902a21700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc09e2b0 con 0x7f68fc138d80 2023-09-30T22:35:05.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.902+0000 7f68f3fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f68fc09d630 0x7f68fc0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39860/0 (socket says 172.21.15.59:39860) 2023-09-30T22:35:05.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.902+0000 7f68fbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68fc0a0a30 0x7f68fc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.902+0000 7f68f3fff700 1 -- 172.21.15.59:0/3583196094 learned_addr learned my addr 172.21.15.59:0/3583196094 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:05.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.902+0000 7f6900fbe700 1 --2- 172.21.15.59:0/3583196094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68fc138d80 0x7f68fc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.902+0000 7f68fb7fe700 1 -- 172.21.15.59:0/3583196094 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153444095 0 0) 0x7f68fc0a2a70 con 0x7f68fc09d630 2023-09-30T22:35:05.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.902+0000 7f6900fbe700 1 -- 172.21.15.59:0/3583196094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68fc0a0a30 msgr2=0x7f68fc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:05.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.902+0000 7f6900fbe700 1 --2- 172.21.15.59:0/3583196094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68fc0a0a30 0x7f68fc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.902+0000 7f6900fbe700 1 -- 172.21.15.59:0/3583196094 >> v1:172.21.15.59:6789/0 conn(0x7f68fc09d630 legacy=0x7f68fc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.902+0000 7f6900fbe700 1 -- 172.21.15.59:0/3583196094 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc09dc50 con 0x7f68fc138d80 2023-09-30T22:35:05.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.902+0000 7f68fbfff700 1 --2- 172.21.15.59:0/3583196094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68fc0a0a30 0x7f68fc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:05.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.903+0000 7f6900fbe700 1 --2- 172.21.15.59:0/3583196094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68fc138d80 0x7f68fc13b160 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009dc0 tx=0x7f68f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c0111f98483332e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:05.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.903+0000 7f68fb7fe700 1 -- 172.21.15.59:0/3583196094 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f400e070 con 0x7f68fc138d80 2023-09-30T22:35:05.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.903+0000 7f68fb7fe700 1 -- 172.21.15.59:0/3583196094 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f400bb20 con 0x7f68fc138d80 2023-09-30T22:35:05.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.903+0000 7f68fb7fe700 1 -- 172.21.15.59:0/3583196094 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4012430 con 0x7f68fc138d80 2023-09-30T22:35:05.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.904+0000 7f6902a21700 1 -- 172.21.15.59:0/3583196094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68fc138d80 msgr2=0x7f68fc13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.904+0000 7f6902a21700 1 --2- 172.21.15.59:0/3583196094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68fc138d80 0x7f68fc13b160 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009dc0 tx=0x7f68f400b330 comp rx=0 tx=0).stop 2023-09-30T22:35:05.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.904+0000 7f6902a21700 1 -- 172.21.15.59:0/3583196094 shutdown_connections 2023-09-30T22:35:05.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.904+0000 7f6902a21700 1 --2- 172.21.15.59:0/3583196094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68fc138d80 0x7f68fc13b160 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.904+0000 7f6902a21700 1 --2- 172.21.15.59:0/3583196094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68fc0a0a30 0x7f68fc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.904+0000 7f6902a21700 1 -- 172.21.15.59:0/3583196094 >> 172.21.15.59:0/3583196094 conn(0x7f68fc0a3050 msgr2=0x7f68fc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:05.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.904+0000 7f6902a21700 1 -- 172.21.15.59:0/3583196094 shutdown_connections 2023-09-30T22:35:05.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.904+0000 7f6902a21700 1 -- 172.21.15.59:0/3583196094 wait complete. 2023-09-30T22:35:05.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.905+0000 7f6902a21700 1 Processor -- start 2023-09-30T22:35:05.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.905+0000 7f6902a21700 1 -- start start 2023-09-30T22:35:05.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.905+0000 7f6902a21700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68fc09d630 0x7f68fc12c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.905+0000 7f6902a21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68fc0a0a30 0x7f68fc12ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.905+0000 7f6902a21700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68fc138d80 0x7f68fc12cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.905+0000 7f6902a21700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0a49e0 con 0x7f68fc138d80 2023-09-30T22:35:05.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.905+0000 7f6902a21700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc12fb00 con 0x7f68fc0a0a30 2023-09-30T22:35:05.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.905+0000 7f6902a21700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc12e090 con 0x7f68fc09d630 2023-09-30T22:35:05.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.905+0000 7f6900fbe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68fc138d80 0x7f68fc12cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.905+0000 7f68f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68fc0a0a30 0x7f68fc12ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.905+0000 7f68fbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68fc09d630 0x7f68fc12c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.905+0000 7f6900fbe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68fc138d80 0x7f68fc12cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45130/0 (socket says 172.21.15.59:45130) 2023-09-30T22:35:05.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.905+0000 7f6900fbe700 1 -- 172.21.15.59:0/4101375931 learned_addr learned my addr 172.21.15.59:0/4101375931 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:05.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.906+0000 7f68fbfff700 1 -- 172.21.15.59:0/4101375931 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68fc0a0a30 msgr2=0x7f68fc12ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.906+0000 7f68fbfff700 1 --2- 172.21.15.59:0/4101375931 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68fc0a0a30 0x7f68fc12ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.906+0000 7f68fbfff700 1 -- 172.21.15.59:0/4101375931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68fc138d80 msgr2=0x7f68fc12cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.906+0000 7f68fbfff700 1 --2- 172.21.15.59:0/4101375931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68fc138d80 0x7f68fc12cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.906+0000 7f68fbfff700 1 -- 172.21.15.59:0/4101375931 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec0094a0 con 0x7f68fc09d630 2023-09-30T22:35:05.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.906+0000 7f68fbfff700 1 --2- 172.21.15.59:0/4101375931 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68fc09d630 0x7f68fc12c4c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00e9e0 tx=0x7f68ec00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:05.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.906+0000 7f68f97fa700 1 -- 172.21.15.59:0/4101375931 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00ee80 con 0x7f68fc09d630 2023-09-30T22:35:05.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.906+0000 7f68f97fa700 1 -- 172.21.15.59:0/4101375931 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec00c850 con 0x7f68fc09d630 2023-09-30T22:35:05.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.906+0000 7f6902a21700 1 -- 172.21.15.59:0/4101375931 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f4009a70 con 0x7f68fc09d630 2023-09-30T22:35:05.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.906+0000 7f68f97fa700 1 -- 172.21.15.59:0/4101375931 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00cc00 con 0x7f68fc09d630 2023-09-30T22:35:05.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.906+0000 7f6902a21700 1 -- 172.21.15.59:0/4101375931 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68fc12ed80 con 0x7f68fc09d630 2023-09-30T22:35:05.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.907+0000 7f6902a21700 1 -- 172.21.15.59:0/4101375931 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68fc0747f0 con 0x7f68fc09d630 2023-09-30T22:35:05.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.908+0000 7f68f97fa700 1 -- 172.21.15.59:0/4101375931 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68ec00cd60 con 0x7f68fc09d630 2023-09-30T22:35:05.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.908+0000 7f68f97fa700 1 -- 172.21.15.59:0/4101375931 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f68ec03fec0 con 0x7f68fc09d630 2023-09-30T22:35:05.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.912+0000 7f68f97fa700 1 -- 172.21.15.59:0/4101375931 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68ec011350 con 0x7f68fc09d630 2023-09-30T22:35:05.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.942+0000 7fb542c73700 1 Processor -- start 2023-09-30T22:35:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.942+0000 7fb542c73700 1 -- start start 2023-09-30T22:35:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.942+0000 7fb542c73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb53c0a0a30 0x7fb53c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.942+0000 7fb542c73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb53c138d80 0x7fb53c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.942+0000 7fb542c73700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53c0a2a70 con 0x7fb53c09d630 2023-09-30T22:35:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.942+0000 7fb542c73700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb53c0a01d0 con 0x7fb53c138d80 2023-09-30T22:35:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.942+0000 7fb542c73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c09e2b0 con 0x7fb53c0a0a30 2023-09-30T22:35:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.942+0000 7fb540a0f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb53c0a0a30 0x7fb53c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.942+0000 7fb541210700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb53c138d80 0x7fb53c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.942+0000 7fb541210700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb53c138d80 0x7fb53c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45136/0 (socket says 172.21.15.59:45136) 2023-09-30T22:35:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.942+0000 7fb541210700 1 -- 172.21.15.59:0/3668276865 learned_addr learned my addr 172.21.15.59:0/3668276865 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.942+0000 7fb540a0f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb53c0a0a30 0x7fb53c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40860/0 (socket says 172.21.15.59:40860) 2023-09-30T22:35:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.943+0000 7fb541210700 1 -- 172.21.15.59:0/3668276865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb53c0a0a30 msgr2=0x7fb53c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.943+0000 7fb541210700 1 --2- 172.21.15.59:0/3668276865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb53c0a0a30 0x7fb53c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.943+0000 7fb541210700 1 -- 172.21.15.59:0/3668276865 >> v1:172.21.15.59:6789/0 conn(0x7fb53c09d630 legacy=0x7fb53c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.943+0000 7fb541210700 1 -- 172.21.15.59:0/3668276865 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c09dc50 con 0x7fb53c138d80 2023-09-30T22:35:05.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.943+0000 7fb540a0f700 1 --2- 172.21.15.59:0/3668276865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb53c0a0a30 0x7fb53c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:05.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.943+0000 7fb541210700 1 --2- 172.21.15.59:0/3668276865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb53c138d80 0x7fb53c13b160 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fb52c0098f0 tx=0x7fb52c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2de66c182fe776 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:05.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.943+0000 7fb53b7fe700 1 -- 172.21.15.59:0/3668276865 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c011830 con 0x7fb53c138d80 2023-09-30T22:35:05.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.943+0000 7fb53b7fe700 1 -- 172.21.15.59:0/3668276865 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c011990 con 0x7fb53c138d80 2023-09-30T22:35:05.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.943+0000 7fb53b7fe700 1 -- 172.21.15.59:0/3668276865 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c011d20 con 0x7fb53c138d80 2023-09-30T22:35:05.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.944+0000 7fb542c73700 1 -- 172.21.15.59:0/3668276865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb53c138d80 msgr2=0x7fb53c13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.944+0000 7fb542c73700 1 --2- 172.21.15.59:0/3668276865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb53c138d80 0x7fb53c13b160 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fb52c0098f0 tx=0x7fb52c009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:05.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.944+0000 7fb542c73700 1 -- 172.21.15.59:0/3668276865 shutdown_connections 2023-09-30T22:35:05.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.944+0000 7fb542c73700 1 --2- 172.21.15.59:0/3668276865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb53c138d80 0x7fb53c13b160 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.944+0000 7fb542c73700 1 --2- 172.21.15.59:0/3668276865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb53c0a0a30 0x7fb53c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.944+0000 7fb542c73700 1 -- 172.21.15.59:0/3668276865 >> 172.21.15.59:0/3668276865 conn(0x7fb53c0a3050 msgr2=0x7fb53c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:05.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.944+0000 7fb542c73700 1 -- 172.21.15.59:0/3668276865 shutdown_connections 2023-09-30T22:35:05.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.944+0000 7fb542c73700 1 -- 172.21.15.59:0/3668276865 wait complete. 2023-09-30T22:35:05.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.945+0000 7fb542c73700 1 Processor -- start 2023-09-30T22:35:05.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.945+0000 7fb542c73700 1 -- start start 2023-09-30T22:35:05.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.945+0000 7fb542c73700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb53c09d630 0x7fb53c133890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.945+0000 7fb542c73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb53c0a0a30 0x7fb53c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.945+0000 7fb542c73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb53c138d80 0x7fb53c134310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:05.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.945+0000 7fb542c73700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c1371b0 con 0x7fb53c09d630 2023-09-30T22:35:05.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.945+0000 7fb542c73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c138030 con 0x7fb53c138d80 2023-09-30T22:35:05.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb542c73700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c1373b0 con 0x7fb53c0a0a30 2023-09-30T22:35:05.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb541210700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb53c138d80 0x7fb53c134310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb541210700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb53c138d80 0x7fb53c134310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40862/0 (socket says 172.21.15.59:40862) 2023-09-30T22:35:05.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb541210700 1 -- 172.21.15.59:0/980305070 learned_addr learned my addr 172.21.15.59:0/980305070 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:05.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb53bfff700 1 --2- 172.21.15.59:0/980305070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb53c0a0a30 0x7fb53c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb540a0f700 1 --2- 172.21.15.59:0/980305070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb53c09d630 0x7fb53c133890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:05.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb53bfff700 1 -- 172.21.15.59:0/980305070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb53c138d80 msgr2=0x7fb53c134310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb53bfff700 1 --2- 172.21.15.59:0/980305070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb53c138d80 0x7fb53c134310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb53bfff700 1 -- 172.21.15.59:0/980305070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb53c09d630 msgr2=0x7fb53c133890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb53bfff700 1 --2- 172.21.15.59:0/980305070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb53c09d630 0x7fb53c133890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:05.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb53bfff700 1 -- 172.21.15.59:0/980305070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb534009a70 con 0x7fb53c0a0a30 2023-09-30T22:35:05.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb53bfff700 1 --2- 172.21.15.59:0/980305070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb53c0a0a30 0x7fb53c133dd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb53c06d980 tx=0x7fb52400c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:05.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb5397fa700 1 -- 172.21.15.59:0/980305070 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5240052d0 con 0x7fb53c0a0a30 2023-09-30T22:35:05.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb5397fa700 1 -- 172.21.15.59:0/980305070 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb524005430 con 0x7fb53c0a0a30 2023-09-30T22:35:05.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb542c73700 1 -- 172.21.15.59:0/980305070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb52c009550 con 0x7fb53c0a0a30 2023-09-30T22:35:05.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb5397fa700 1 -- 172.21.15.59:0/980305070 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5240038c0 con 0x7fb53c0a0a30 2023-09-30T22:35:05.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.946+0000 7fb542c73700 1 -- 172.21.15.59:0/980305070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c0a4eb0 con 0x7fb53c0a0a30 2023-09-30T22:35:05.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.947+0000 7fb5397fa700 1 -- 172.21.15.59:0/980305070 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb524003a20 con 0x7fb53c0a0a30 2023-09-30T22:35:05.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.947+0000 7fb542c73700 1 -- 172.21.15.59:0/980305070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c0747f0 con 0x7fb53c0a0a30 2023-09-30T22:35:05.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.948+0000 7fb5397fa700 1 -- 172.21.15.59:0/980305070 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb52403e980 con 0x7fb53c0a0a30 2023-09-30T22:35:05.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:05.952+0000 7fb5397fa700 1 -- 172.21.15.59:0/980305070 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb524019b40 con 0x7fb53c0a0a30 2023-09-30T22:35:06.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.121+0000 7f6902a21700 1 -- 172.21.15.59:0/4101375931 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f68fc072980 con 0x7f68fc09d630 2023-09-30T22:35:06.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.121+0000 7f68f97fa700 1 -- 172.21.15.59:0/4101375931 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68ec021020 con 0x7f68fc09d630 2023-09-30T22:35:06.122 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:06.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.124+0000 7f6902a21700 1 -- 172.21.15.59:0/4101375931 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68fc09d630 msgr2=0x7f68fc12c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:06.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.124+0000 7f6902a21700 1 --2- 172.21.15.59:0/4101375931 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68fc09d630 0x7f68fc12c4c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00e9e0 tx=0x7f68ec00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.124+0000 7f6902a21700 1 -- 172.21.15.59:0/4101375931 shutdown_connections 2023-09-30T22:35:06.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.124+0000 7f6902a21700 1 --2- 172.21.15.59:0/4101375931 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68fc09d630 0x7f68fc12c4c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.124+0000 7f6902a21700 1 --2- 172.21.15.59:0/4101375931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68fc138d80 0x7f68fc12cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.124+0000 7f6902a21700 1 --2- 172.21.15.59:0/4101375931 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68fc0a0a30 0x7f68fc12ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.124+0000 7f6902a21700 1 -- 172.21.15.59:0/4101375931 >> 172.21.15.59:0/4101375931 conn(0x7f68fc0a3050 msgr2=0x7f68fc09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:06.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.124+0000 7f6902a21700 1 -- 172.21.15.59:0/4101375931 shutdown_connections 2023-09-30T22:35:06.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.124+0000 7f6902a21700 1 -- 172.21.15.59:0/4101375931 wait complete. 2023-09-30T22:35:06.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:06.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.158+0000 7fb542c73700 1 -- 172.21.15.59:0/980305070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb53c072980 con 0x7fb53c0a0a30 2023-09-30T22:35:06.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.158+0000 7fb5397fa700 1 -- 172.21.15.59:0/980305070 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb524017070 con 0x7fb53c0a0a30 2023-09-30T22:35:06.158 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.160+0000 7fb542c73700 1 -- 172.21.15.59:0/980305070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb53c0a0a30 msgr2=0x7fb53c133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.160+0000 7fb542c73700 1 --2- 172.21.15.59:0/980305070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb53c0a0a30 0x7fb53c133dd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb53c06d980 tx=0x7fb52400c730 comp rx=0 tx=0).stop 2023-09-30T22:35:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.160+0000 7fb542c73700 1 -- 172.21.15.59:0/980305070 shutdown_connections 2023-09-30T22:35:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.160+0000 7fb542c73700 1 --2- 172.21.15.59:0/980305070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb53c138d80 0x7fb53c134310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.160+0000 7fb542c73700 1 --2- 172.21.15.59:0/980305070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb53c09d630 0x7fb53c133890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.160+0000 7fb542c73700 1 --2- 172.21.15.59:0/980305070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb53c0a0a30 0x7fb53c133dd0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.160+0000 7fb542c73700 1 -- 172.21.15.59:0/980305070 >> 172.21.15.59:0/980305070 conn(0x7fb53c0a3050 msgr2=0x7fb53c09f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.160+0000 7fb542c73700 1 -- 172.21.15.59:0/980305070 shutdown_connections 2023-09-30T22:35:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.160+0000 7fb542c73700 1 -- 172.21.15.59:0/980305070 wait complete. 2023-09-30T22:35:06.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:06.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:06.716 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:06.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.833+0000 7f5228499700 1 Processor -- start 2023-09-30T22:35:06.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.833+0000 7f5228499700 1 -- start start 2023-09-30T22:35:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.833+0000 7f5228499700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f52200a0a30 0x7f52200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.833+0000 7f5228499700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52200a1340 0x7f5220133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.833+0000 7f5228499700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5220133fa0 0x7f5220134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.833+0000 7f5228499700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522009edd0 con 0x7f52200a0a30 2023-09-30T22:35:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.833+0000 7f5228499700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522009e1f0 con 0x7f5220133fa0 2023-09-30T22:35:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.833+0000 7f5228499700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f522009dc50 con 0x7f52200a1340 2023-09-30T22:35:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5226235700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f52200a0a30 0x7f52200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5225a34700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52200a1340 0x7f5220133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5226a36700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5220133fa0 0x7f5220134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5226235700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f52200a0a30 0x7f52200a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45162/0 (socket says 172.21.15.59:45162) 2023-09-30T22:35:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5225a34700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52200a1340 0x7f5220133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52806/0 (socket says 172.21.15.59:52806) 2023-09-30T22:35:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5226235700 1 -- 172.21.15.59:0/147906158 learned_addr learned my addr 172.21.15.59:0/147906158 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5226a36700 1 -- 172.21.15.59:0/147906158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52200a1340 msgr2=0x7f5220133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5226a36700 1 --2- 172.21.15.59:0/147906158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52200a1340 0x7f5220133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5226a36700 1 -- 172.21.15.59:0/147906158 >> v2:172.21.15.59:3300/0 conn(0x7f52200a0a30 msgr2=0x7f52200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5226a36700 1 --2- 172.21.15.59:0/147906158 >> v2:172.21.15.59:3300/0 conn(0x7f52200a0a30 0x7f52200a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5226a36700 1 -- 172.21.15.59:0/147906158 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52200a1fe0 con 0x7f5220133fa0 2023-09-30T22:35:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5225a34700 1 --2- 172.21.15.59:0/147906158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52200a1340 0x7f5220133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5226235700 1 --2- 172.21.15.59:0/147906158 >> v2:172.21.15.59:3300/0 conn(0x7f52200a0a30 0x7f52200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5226a36700 1 --2- 172.21.15.59:0/147906158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5220133fa0 0x7f5220134410 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5218009dc0 tx=0x7f521800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23bb40bd26421595 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:06.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5225233700 1 -- 172.21.15.59:0/147906158 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521800e070 con 0x7f5220133fa0 2023-09-30T22:35:06.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5225233700 1 -- 172.21.15.59:0/147906158 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521800bae0 con 0x7f5220133fa0 2023-09-30T22:35:06.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.834+0000 7f5225233700 1 -- 172.21.15.59:0/147906158 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521800be90 con 0x7f5220133fa0 2023-09-30T22:35:06.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.835+0000 7f5228499700 1 -- 172.21.15.59:0/147906158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5220133fa0 msgr2=0x7f5220134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:06.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.835+0000 7f5228499700 1 --2- 172.21.15.59:0/147906158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5220133fa0 0x7f5220134410 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5218009dc0 tx=0x7f521800b330 comp rx=0 tx=0).stop 2023-09-30T22:35:06.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.835+0000 7f5228499700 1 -- 172.21.15.59:0/147906158 shutdown_connections 2023-09-30T22:35:06.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.835+0000 7f5228499700 1 --2- 172.21.15.59:0/147906158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5220133fa0 0x7f5220134410 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.835+0000 7f5228499700 1 --2- 172.21.15.59:0/147906158 >> v2:172.21.15.59:3300/0 conn(0x7f52200a0a30 0x7f52200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.835+0000 7f5228499700 1 --2- 172.21.15.59:0/147906158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52200a1340 0x7f5220133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.835+0000 7f5228499700 1 -- 172.21.15.59:0/147906158 >> 172.21.15.59:0/147906158 conn(0x7f52200a6550 msgr2=0x7f52200a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:06.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.835+0000 7f5228499700 1 -- 172.21.15.59:0/147906158 shutdown_connections 2023-09-30T22:35:06.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.835+0000 7f5228499700 1 -- 172.21.15.59:0/147906158 wait complete. 2023-09-30T22:35:06.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.836+0000 7f5228499700 1 Processor -- start 2023-09-30T22:35:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.836+0000 7f5228499700 1 -- start start 2023-09-30T22:35:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5228499700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52200a0a30 0x7f52201200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5228499700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52200a1340 0x7f52201205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5228499700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5220133fa0 0x7f5220120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5228499700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5220121d70 con 0x7f52200a0a30 2023-09-30T22:35:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5228499700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52200a6b20 con 0x7f52200a1340 2023-09-30T22:35:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5228499700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52200a0220 con 0x7f5220133fa0 2023-09-30T22:35:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5225a34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52200a1340 0x7f52201205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5226235700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52200a0a30 0x7f52201200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:06.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5226235700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52200a0a30 0x7f52201200a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45166/0 (socket says 172.21.15.59:45166) 2023-09-30T22:35:06.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5226a36700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5220133fa0 0x7f5220120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5225a34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52200a1340 0x7f52201205e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40884/0 (socket says 172.21.15.59:40884) 2023-09-30T22:35:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5226235700 1 -- 172.21.15.59:0/3514545033 learned_addr learned my addr 172.21.15.59:0/3514545033 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5226235700 1 -- 172.21.15.59:0/3514545033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5220133fa0 msgr2=0x7f5220120b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5226235700 1 --2- 172.21.15.59:0/3514545033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5220133fa0 0x7f5220120b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5226235700 1 -- 172.21.15.59:0/3514545033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52200a1340 msgr2=0x7f52201205e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5226235700 1 --2- 172.21.15.59:0/3514545033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52200a1340 0x7f52201205e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5226235700 1 -- 172.21.15.59:0/3514545033 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c009550 con 0x7f52200a0a30 2023-09-30T22:35:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.837+0000 7f5226235700 1 --2- 172.21.15.59:0/3514545033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52200a0a30 0x7f52201200a0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f521c00ebe0 tx=0x7f521c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.838+0000 7f5216ffd700 1 -- 172.21.15.59:0/3514545033 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c00c850 con 0x7f52200a0a30 2023-09-30T22:35:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.838+0000 7f5216ffd700 1 -- 172.21.15.59:0/3514545033 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c00c9b0 con 0x7f52200a0a30 2023-09-30T22:35:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.838+0000 7f5228499700 1 -- 172.21.15.59:0/3514545033 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52100094a0 con 0x7f52200a0a30 2023-09-30T22:35:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.838+0000 7f5216ffd700 1 -- 172.21.15.59:0/3514545033 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c00cd40 con 0x7f52200a0a30 2023-09-30T22:35:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.838+0000 7f5228499700 1 -- 172.21.15.59:0/3514545033 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5218009a70 con 0x7f52200a0a30 2023-09-30T22:35:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.839+0000 7f5216ffd700 1 -- 172.21.15.59:0/3514545033 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f521c013470 con 0x7f52200a0a30 2023-09-30T22:35:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.839+0000 7f5228499700 1 -- 172.21.15.59:0/3514545033 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5220074ea0 con 0x7f52200a0a30 2023-09-30T22:35:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.839+0000 7f5216ffd700 1 -- 172.21.15.59:0/3514545033 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f521c03f8d0 con 0x7f52200a0a30 2023-09-30T22:35:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.848+0000 7f5216ffd700 1 -- 172.21.15.59:0/3514545033 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f521c021070 con 0x7f52200a0a30 2023-09-30T22:35:06.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.879+0000 7f57dee02700 1 Processor -- start 2023-09-30T22:35:06.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.879+0000 7f57dee02700 1 -- start start 2023-09-30T22:35:06.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.879+0000 7f57dee02700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d80a0a30 0x7f57d80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:06.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57dee02700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57d809d630 0x7f57d80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57dee02700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133930 0x7f57d8133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57dee02700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d80a2a70 con 0x7f57d809d630 2023-09-30T22:35:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57dee02700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80a01d0 con 0x7f57d8133930 2023-09-30T22:35:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57dee02700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57d809e2b0 con 0x7f57d80a0a30 2023-09-30T22:35:06.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57d7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57d809d630 0x7f57d80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:06.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57d7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57d809d630 0x7f57d80a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45174/0 (socket says 172.21.15.59:45174) 2023-09-30T22:35:06.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57dd39f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133930 0x7f57d8133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:06.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57d7fff700 1 -- 172.21.15.59:0/742919932 learned_addr learned my addr 172.21.15.59:0/742919932 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:06.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57dcb9e700 1 --2- 172.21.15.59:0/742919932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d80a0a30 0x7f57d80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:06.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57dcb9e700 1 -- 172.21.15.59:0/742919932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133930 msgr2=0x7f57d8133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:06.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57dcb9e700 1 --2- 172.21.15.59:0/742919932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133930 0x7f57d8133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57dcb9e700 1 -- 172.21.15.59:0/742919932 >> v2:172.21.15.59:3300/0 conn(0x7f57d809d630 msgr2=0x7f57d80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:06.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57dcb9e700 1 --2- 172.21.15.59:0/742919932 >> v2:172.21.15.59:3300/0 conn(0x7f57d809d630 0x7f57d80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57dcb9e700 1 -- 172.21.15.59:0/742919932 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d809dc50 con 0x7f57d80a0a30 2023-09-30T22:35:06.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57d7fff700 1 --2- 172.21.15.59:0/742919932 >> v2:172.21.15.59:3300/0 conn(0x7f57d809d630 0x7f57d80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:06.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57dd39f700 1 --2- 172.21.15.59:0/742919932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133930 0x7f57d8133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:06.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.880+0000 7f57dcb9e700 1 --2- 172.21.15.59:0/742919932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d80a0a30 0x7f57d80a0e00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009840 tx=0x7f57cc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38d96fd4b315102f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.881+0000 7f57d77fe700 1 -- 172.21.15.59:0/742919932 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc011830 con 0x7f57d80a0a30 2023-09-30T22:35:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.881+0000 7f57d77fe700 1 -- 172.21.15.59:0/742919932 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc011990 con 0x7f57d80a0a30 2023-09-30T22:35:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.881+0000 7f57d77fe700 1 -- 172.21.15.59:0/742919932 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc011d20 con 0x7f57d80a0a30 2023-09-30T22:35:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.881+0000 7f57dee02700 1 -- 172.21.15.59:0/742919932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d80a0a30 msgr2=0x7f57d80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.881+0000 7f57dee02700 1 --2- 172.21.15.59:0/742919932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d80a0a30 0x7f57d80a0e00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009840 tx=0x7f57cc009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:06.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.881+0000 7f57dee02700 1 -- 172.21.15.59:0/742919932 shutdown_connections 2023-09-30T22:35:06.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.881+0000 7f57dee02700 1 --2- 172.21.15.59:0/742919932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133930 0x7f57d8133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.881+0000 7f57dee02700 1 --2- 172.21.15.59:0/742919932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d80a0a30 0x7f57d80a0e00 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.881+0000 7f57dee02700 1 --2- 172.21.15.59:0/742919932 >> v2:172.21.15.59:3300/0 conn(0x7f57d809d630 0x7f57d80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.881+0000 7f57dee02700 1 -- 172.21.15.59:0/742919932 >> 172.21.15.59:0/742919932 conn(0x7f57d80a3050 msgr2=0x7f57d80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:06.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.881+0000 7f57dee02700 1 -- 172.21.15.59:0/742919932 shutdown_connections 2023-09-30T22:35:06.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.881+0000 7f57dee02700 1 -- 172.21.15.59:0/742919932 wait complete. 2023-09-30T22:35:06.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.882+0000 7f57dee02700 1 Processor -- start 2023-09-30T22:35:06.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.882+0000 7f57dee02700 1 -- start start 2023-09-30T22:35:06.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.883+0000 7f57dee02700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d809d630 0x7f57d811f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:06.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.883+0000 7f57dee02700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d80a0a30 0x7f57d811f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:06.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.883+0000 7f57dee02700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133930 0x7f57d81c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:06.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.883+0000 7f57dee02700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d8120940 con 0x7f57d809d630 2023-09-30T22:35:06.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.883+0000 7f57dee02700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d8120750 con 0x7f57d8133930 2023-09-30T22:35:06.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.883+0000 7f57dee02700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57d81334d0 con 0x7f57d80a0a30 2023-09-30T22:35:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.883+0000 7f57d7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d80a0a30 0x7f57d811f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.883+0000 7f57dcb9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d809d630 0x7f57d811f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.883+0000 7f57d7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d80a0a30 0x7f57d811f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52842/0 (socket says 172.21.15.59:52842) 2023-09-30T22:35:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.883+0000 7f57dcb9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d809d630 0x7f57d811f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45190/0 (socket says 172.21.15.59:45190) 2023-09-30T22:35:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.883+0000 7f57d7fff700 1 -- 172.21.15.59:0/2780422083 learned_addr learned my addr 172.21.15.59:0/2780422083 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.883+0000 7f57dd39f700 1 --2- 172.21.15.59:0/2780422083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133930 0x7f57d81c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.884+0000 7f57dcb9e700 1 -- 172.21.15.59:0/2780422083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d80a0a30 msgr2=0x7f57d811f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.884+0000 7f57dcb9e700 1 --2- 172.21.15.59:0/2780422083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d80a0a30 0x7f57d811f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.884+0000 7f57dcb9e700 1 -- 172.21.15.59:0/2780422083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133930 msgr2=0x7f57d81c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:06.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.884+0000 7f57dcb9e700 1 --2- 172.21.15.59:0/2780422083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133930 0x7f57d81c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:06.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.884+0000 7f57dcb9e700 1 -- 172.21.15.59:0/2780422083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4009550 con 0x7f57d809d630 2023-09-30T22:35:06.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.884+0000 7f57d7fff700 1 --2- 172.21.15.59:0/2780422083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d80a0a30 0x7f57d811f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:06.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.884+0000 7f57dcb9e700 1 --2- 172.21.15.59:0/2780422083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d809d630 0x7f57d811f480 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f57cc016000 tx=0x7f57cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:06.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.884+0000 7f57d57fa700 1 -- 172.21.15.59:0/2780422083 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc004450 con 0x7f57d809d630 2023-09-30T22:35:06.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.884+0000 7f57d57fa700 1 -- 172.21.15.59:0/2780422083 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc01f070 con 0x7f57d809d630 2023-09-30T22:35:06.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.884+0000 7f57d57fa700 1 -- 172.21.15.59:0/2780422083 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc0038e0 con 0x7f57d809d630 2023-09-30T22:35:06.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.884+0000 7f57dee02700 1 -- 172.21.15.59:0/2780422083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d0009a70 con 0x7f57d809d630 2023-09-30T22:35:06.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.884+0000 7f57dee02700 1 -- 172.21.15.59:0/2780422083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57cc0094a0 con 0x7f57d809d630 2023-09-30T22:35:06.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.885+0000 7f57d57fa700 1 -- 172.21.15.59:0/2780422083 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57cc003a40 con 0x7f57d809d630 2023-09-30T22:35:06.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.885+0000 7f57dee02700 1 -- 172.21.15.59:0/2780422083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d80747f0 con 0x7f57d809d630 2023-09-30T22:35:06.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.885+0000 7f57d57fa700 1 -- 172.21.15.59:0/2780422083 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f57cc021070 con 0x7f57d809d630 2023-09-30T22:35:06.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:06.890+0000 7f57d57fa700 1 -- 172.21.15.59:0/2780422083 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57cc02f3a0 con 0x7f57d809d630 2023-09-30T22:35:07.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.062+0000 7f5228499700 1 -- 172.21.15.59:0/3514545033 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f52200a28e0 con 0x7f52200a0a30 2023-09-30T22:35:07.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.062+0000 7f5216ffd700 1 -- 172.21.15.59:0/3514545033 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f521c0232f0 con 0x7f52200a0a30 2023-09-30T22:35:07.063 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.064+0000 7f5228499700 1 -- 172.21.15.59:0/3514545033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52200a0a30 msgr2=0x7f52201200a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.064+0000 7f5228499700 1 --2- 172.21.15.59:0/3514545033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52200a0a30 0x7f52201200a0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f521c00ebe0 tx=0x7f521c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.065+0000 7f5228499700 1 -- 172.21.15.59:0/3514545033 shutdown_connections 2023-09-30T22:35:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.065+0000 7f5228499700 1 --2- 172.21.15.59:0/3514545033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5220133fa0 0x7f5220120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.065+0000 7f5228499700 1 --2- 172.21.15.59:0/3514545033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52200a0a30 0x7f52201200a0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.065+0000 7f5228499700 1 --2- 172.21.15.59:0/3514545033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52200a1340 0x7f52201205e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.065+0000 7f5228499700 1 -- 172.21.15.59:0/3514545033 >> 172.21.15.59:0/3514545033 conn(0x7f52200a6550 msgr2=0x7f522009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.065+0000 7f5228499700 1 -- 172.21.15.59:0/3514545033 shutdown_connections 2023-09-30T22:35:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.065+0000 7f5228499700 1 -- 172.21.15.59:0/3514545033 wait complete. 2023-09-30T22:35:07.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.096+0000 7f57dee02700 1 -- 172.21.15.59:0/2780422083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f57d8120f40 con 0x7f57d809d630 2023-09-30T22:35:07.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.096+0000 7f57d57fa700 1 -- 172.21.15.59:0/2780422083 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57cc015020 con 0x7f57d809d630 2023-09-30T22:35:07.096 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:07.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.098+0000 7f57dee02700 1 -- 172.21.15.59:0/2780422083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d809d630 msgr2=0x7f57d811f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:07.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.098+0000 7f57dee02700 1 --2- 172.21.15.59:0/2780422083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d809d630 0x7f57d811f480 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f57cc016000 tx=0x7f57cc004750 comp rx=0 tx=0).stop 2023-09-30T22:35:07.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.098+0000 7f57dee02700 1 -- 172.21.15.59:0/2780422083 shutdown_connections 2023-09-30T22:35:07.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.098+0000 7f57dee02700 1 --2- 172.21.15.59:0/2780422083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133930 0x7f57d81c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.098+0000 7f57dee02700 1 --2- 172.21.15.59:0/2780422083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d809d630 0x7f57d811f480 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.098+0000 7f57dee02700 1 --2- 172.21.15.59:0/2780422083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d80a0a30 0x7f57d811f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.098+0000 7f57dee02700 1 -- 172.21.15.59:0/2780422083 >> 172.21.15.59:0/2780422083 conn(0x7f57d80a3050 msgr2=0x7f57d809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:07.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.099+0000 7f57dee02700 1 -- 172.21.15.59:0/2780422083 shutdown_connections 2023-09-30T22:35:07.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.099+0000 7f57dee02700 1 -- 172.21.15.59:0/2780422083 wait complete. 2023-09-30T22:35:07.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:07.138 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:07.175 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:07.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.292+0000 7efd3434e700 1 Processor -- start 2023-09-30T22:35:07.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.292+0000 7efd3434e700 1 -- start start 2023-09-30T22:35:07.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.293+0000 7efd3434e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd2c09d630 0x7efd2c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:07.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.293+0000 7efd3434e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd2c138d80 0x7efd2c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.293+0000 7efd3434e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2c0a2a70 con 0x7efd2c0a0a30 2023-09-30T22:35:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.293+0000 7efd3434e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c0a01d0 con 0x7efd2c09d630 2023-09-30T22:35:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.293+0000 7efd3434e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c09e2b0 con 0x7efd2c138d80 2023-09-30T22:35:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.293+0000 7efd328eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd2c138d80 0x7efd2c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.293+0000 7efd320ea700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efd2c0a0a30 0x7efd2c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39878/0 (socket says 172.21.15.59:39878) 2023-09-30T22:35:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.293+0000 7efd320ea700 1 -- 172.21.15.59:0/1091042526 learned_addr learned my addr 172.21.15.59:0/1091042526 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.293+0000 7efd318e9700 1 --2- 172.21.15.59:0/1091042526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd2c09d630 0x7efd2c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.294+0000 7efd318e9700 1 -- 172.21.15.59:0/1091042526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd2c138d80 msgr2=0x7efd2c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.294+0000 7efd318e9700 1 --2- 172.21.15.59:0/1091042526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd2c138d80 0x7efd2c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.294+0000 7efd318e9700 1 -- 172.21.15.59:0/1091042526 >> v1:172.21.15.59:6789/0 conn(0x7efd2c0a0a30 legacy=0x7efd2c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:07.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.294+0000 7efd310e8700 1 -- 172.21.15.59:0/1091042526 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677365170 0 0) 0x7efd2c0a2a70 con 0x7efd2c0a0a30 2023-09-30T22:35:07.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.294+0000 7efd318e9700 1 -- 172.21.15.59:0/1091042526 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c09dc50 con 0x7efd2c09d630 2023-09-30T22:35:07.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.294+0000 7efd328eb700 1 --2- 172.21.15.59:0/1091042526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd2c138d80 0x7efd2c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:07.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.294+0000 7efd318e9700 1 --2- 172.21.15.59:0/1091042526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd2c09d630 0x7efd2c0a1510 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7efd20009870 tx=0x7efd20009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfa6720e927d771d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:07.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.294+0000 7efd310e8700 1 -- 172.21.15.59:0/1091042526 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20011830 con 0x7efd2c09d630 2023-09-30T22:35:07.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.294+0000 7efd310e8700 1 -- 172.21.15.59:0/1091042526 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd20011990 con 0x7efd2c09d630 2023-09-30T22:35:07.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.294+0000 7efd310e8700 1 -- 172.21.15.59:0/1091042526 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20011d20 con 0x7efd2c09d630 2023-09-30T22:35:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.295+0000 7efd3434e700 1 -- 172.21.15.59:0/1091042526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd2c09d630 msgr2=0x7efd2c0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.295+0000 7efd3434e700 1 --2- 172.21.15.59:0/1091042526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd2c09d630 0x7efd2c0a1510 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7efd20009870 tx=0x7efd20009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.295+0000 7efd3434e700 1 -- 172.21.15.59:0/1091042526 shutdown_connections 2023-09-30T22:35:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.295+0000 7efd3434e700 1 --2- 172.21.15.59:0/1091042526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd2c138d80 0x7efd2c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.295+0000 7efd3434e700 1 --2- 172.21.15.59:0/1091042526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd2c09d630 0x7efd2c0a1510 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.295+0000 7efd3434e700 1 -- 172.21.15.59:0/1091042526 >> 172.21.15.59:0/1091042526 conn(0x7efd2c0a3050 msgr2=0x7efd2c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.295+0000 7efd3434e700 1 -- 172.21.15.59:0/1091042526 shutdown_connections 2023-09-30T22:35:07.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.295+0000 7efd3434e700 1 -- 172.21.15.59:0/1091042526 wait complete. 2023-09-30T22:35:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.297+0000 7efd3434e700 1 Processor -- start 2023-09-30T22:35:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.297+0000 7efd3434e700 1 -- start start 2023-09-30T22:35:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.297+0000 7efd3434e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c09d630 0x7efd2c133910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.297+0000 7efd3434e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd2c0a0a30 0x7efd2c133e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.297+0000 7efd3434e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd2c138d80 0x7efd2c134390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.297+0000 7efd3434e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c134de0 con 0x7efd2c09d630 2023-09-30T22:35:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.297+0000 7efd3434e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c1374b0 con 0x7efd2c0a0a30 2023-09-30T22:35:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.297+0000 7efd3434e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c136e00 con 0x7efd2c138d80 2023-09-30T22:35:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd320ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c09d630 0x7efd2c133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd318e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd2c0a0a30 0x7efd2c133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd320ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c09d630 0x7efd2c133910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45206/0 (socket says 172.21.15.59:45206) 2023-09-30T22:35:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd318e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd2c0a0a30 0x7efd2c133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40914/0 (socket says 172.21.15.59:40914) 2023-09-30T22:35:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd320ea700 1 -- 172.21.15.59:0/1783828121 learned_addr learned my addr 172.21.15.59:0/1783828121 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd328eb700 1 --2- 172.21.15.59:0/1783828121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd2c138d80 0x7efd2c134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd320ea700 1 -- 172.21.15.59:0/1783828121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd2c138d80 msgr2=0x7efd2c134390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd320ea700 1 --2- 172.21.15.59:0/1783828121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd2c138d80 0x7efd2c134390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd320ea700 1 -- 172.21.15.59:0/1783828121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd2c0a0a30 msgr2=0x7efd2c133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd320ea700 1 --2- 172.21.15.59:0/1783828121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd2c0a0a30 0x7efd2c133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd320ea700 1 -- 172.21.15.59:0/1783828121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd240094a0 con 0x7efd2c09d630 2023-09-30T22:35:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd328eb700 1 --2- 172.21.15.59:0/1783828121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd2c138d80 0x7efd2c134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd318e9700 1 --2- 172.21.15.59:0/1783828121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd2c0a0a30 0x7efd2c133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd320ea700 1 --2- 172.21.15.59:0/1783828121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c09d630 0x7efd2c133910 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00ccb0 tx=0x7efd1c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd2affd700 1 -- 172.21.15.59:0/1783828121 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c00aae0 con 0x7efd2c09d630 2023-09-30T22:35:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd2affd700 1 -- 172.21.15.59:0/1783828121 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c00ac40 con 0x7efd2c09d630 2023-09-30T22:35:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd2affd700 1 -- 172.21.15.59:0/1783828121 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0070d0 con 0x7efd2c09d630 2023-09-30T22:35:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.298+0000 7efd3434e700 1 -- 172.21.15.59:0/1783828121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd200094a0 con 0x7efd2c09d630 2023-09-30T22:35:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.299+0000 7efd3434e700 1 -- 172.21.15.59:0/1783828121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2c0a0460 con 0x7efd2c09d630 2023-09-30T22:35:07.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.299+0000 7efd2affd700 1 -- 172.21.15.59:0/1783828121 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd1c007250 con 0x7efd2c09d630 2023-09-30T22:35:07.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.300+0000 7efd3434e700 1 -- 172.21.15.59:0/1783828121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2c135ce0 con 0x7efd2c09d630 2023-09-30T22:35:07.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.300+0000 7efd2affd700 1 -- 172.21.15.59:0/1783828121 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efd1c03f250 con 0x7efd2c09d630 2023-09-30T22:35:07.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.305+0000 7efd2affd700 1 -- 172.21.15.59:0/1783828121 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd1c01b360 con 0x7efd2c09d630 2023-09-30T22:35:07.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.336+0000 7f9fa1e46700 1 Processor -- start 2023-09-30T22:35:07.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.336+0000 7f9fa1e46700 1 -- start start 2023-09-30T22:35:07.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.336+0000 7f9fa1e46700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f9c09e930 0x7f9f9c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.336+0000 7f9fa1e46700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f9c09f650 0x7f9f9c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.337+0000 7f9fa1e46700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c070940 con 0x7f9f9c09f240 2023-09-30T22:35:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.337+0000 7f9fa1e46700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9c06fd60 con 0x7f9f9c09f650 2023-09-30T22:35:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.337+0000 7f9fa1e46700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c06fa80 con 0x7f9f9c09e930 2023-09-30T22:35:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.337+0000 7f9f9bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f9c09f650 0x7f9f9c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.337+0000 7f9f9bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f9c09f650 0x7f9f9c131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45220/0 (socket says 172.21.15.59:45220) 2023-09-30T22:35:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.337+0000 7f9f9b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f9c09e930 0x7f9f9c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.337+0000 7f9f9affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9f9c09f240 0x7f9f9c1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39894/0 (socket says 172.21.15.59:39894) 2023-09-30T22:35:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.337+0000 7f9f9bfff700 1 -- 172.21.15.59:0/1911560568 learned_addr learned my addr 172.21.15.59:0/1911560568 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.337+0000 7f9f9b7fe700 1 -- 172.21.15.59:0/1911560568 >> v2:172.21.15.59:3300/0 conn(0x7f9f9c09f650 msgr2=0x7f9f9c131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.337+0000 7f9f9b7fe700 1 --2- 172.21.15.59:0/1911560568 >> v2:172.21.15.59:3300/0 conn(0x7f9f9c09f650 0x7f9f9c131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.337+0000 7f9f9a7fc700 1 -- 172.21.15.59:0/1911560568 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823480479 0 0) 0x7f9f9c070940 con 0x7f9f9c09f240 2023-09-30T22:35:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.337+0000 7f9f9b7fe700 1 -- 172.21.15.59:0/1911560568 >> v1:172.21.15.59:6789/0 conn(0x7f9f9c09f240 legacy=0x7f9f9c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.337+0000 7f9f9b7fe700 1 -- 172.21.15.59:0/1911560568 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c09fb60 con 0x7f9f9c09e930 2023-09-30T22:35:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.337+0000 7f9f9b7fe700 1 --2- 172.21.15.59:0/1911560568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f9c09e930 0x7f9f9c09ed00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00f370 tx=0x7f9f8c00f680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec83b707c4bf8368 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.337+0000 7f9f9a7fc700 1 -- 172.21.15.59:0/1911560568 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c012070 con 0x7f9f9c09e930 2023-09-30T22:35:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.338+0000 7f9f9a7fc700 1 -- 172.21.15.59:0/1911560568 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c00fe70 con 0x7f9f9c09e930 2023-09-30T22:35:07.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.338+0000 7f9f9a7fc700 1 -- 172.21.15.59:0/1911560568 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c00d2f0 con 0x7f9f9c09e930 2023-09-30T22:35:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.338+0000 7f9fa1e46700 1 -- 172.21.15.59:0/1911560568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f9c09e930 msgr2=0x7f9f9c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.338+0000 7f9fa1e46700 1 --2- 172.21.15.59:0/1911560568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f9c09e930 0x7f9f9c09ed00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00f370 tx=0x7f9f8c00f680 comp rx=0 tx=0).stop 2023-09-30T22:35:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.338+0000 7f9fa1e46700 1 -- 172.21.15.59:0/1911560568 shutdown_connections 2023-09-30T22:35:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.338+0000 7f9fa1e46700 1 --2- 172.21.15.59:0/1911560568 >> v2:172.21.15.59:3300/0 conn(0x7f9f9c09f650 0x7f9f9c131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.338+0000 7f9fa1e46700 1 --2- 172.21.15.59:0/1911560568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f9c09e930 0x7f9f9c09ed00 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.338+0000 7f9fa1e46700 1 -- 172.21.15.59:0/1911560568 >> 172.21.15.59:0/1911560568 conn(0x7f9f9c0a4210 msgr2=0x7f9f9c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.338+0000 7f9fa1e46700 1 -- 172.21.15.59:0/1911560568 shutdown_connections 2023-09-30T22:35:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.338+0000 7f9fa1e46700 1 -- 172.21.15.59:0/1911560568 wait complete. 2023-09-30T22:35:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.339+0000 7f9fa1e46700 1 Processor -- start 2023-09-30T22:35:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.339+0000 7f9fa1e46700 1 -- start start 2023-09-30T22:35:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9fa1e46700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f9c09e930 0x7f9f9c1a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9fa1e46700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f9c09f240 0x7f9f9c1a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9fa1e46700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f9c09f650 0x7f9f9c1c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9fa1e46700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c1a1b70 con 0x7f9f9c09f240 2023-09-30T22:35:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9fa1e46700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c1a0bc0 con 0x7f9f9c09f650 2023-09-30T22:35:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9fa1e46700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0a3100 con 0x7f9f9c09e930 2023-09-30T22:35:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9f9affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f9c09f240 0x7f9f9c1a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9f9affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f9c09f240 0x7f9f9c1a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45226/0 (socket says 172.21.15.59:45226) 2023-09-30T22:35:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9f9bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f9c09f650 0x7f9f9c1c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9f9affd700 1 -- 172.21.15.59:0/645289240 learned_addr learned my addr 172.21.15.59:0/645289240 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9f9b7fe700 1 --2- 172.21.15.59:0/645289240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f9c09e930 0x7f9f9c1a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9f9affd700 1 -- 172.21.15.59:0/645289240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f9c09e930 msgr2=0x7f9f9c1a10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9f9affd700 1 --2- 172.21.15.59:0/645289240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f9c09e930 0x7f9f9c1a10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9f9affd700 1 -- 172.21.15.59:0/645289240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f9c09f650 msgr2=0x7f9f9c1c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9f9affd700 1 --2- 172.21.15.59:0/645289240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f9c09f650 0x7f9f9c1c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.340+0000 7f9f9affd700 1 -- 172.21.15.59:0/645289240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c00f050 con 0x7f9f9c09f240 2023-09-30T22:35:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.341+0000 7f9f9affd700 1 --2- 172.21.15.59:0/645289240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f9c09f240 0x7f9f9c1a1630 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f9f84001eb0 tx=0x7f9f8400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.341+0000 7f9f93fff700 1 -- 172.21.15.59:0/645289240 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84004c80 con 0x7f9f9c09f240 2023-09-30T22:35:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.341+0000 7f9f93fff700 1 -- 172.21.15.59:0/645289240 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84004de0 con 0x7f9f9c09f240 2023-09-30T22:35:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.341+0000 7f9fa1e46700 1 -- 172.21.15.59:0/645289240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c0a0190 con 0x7f9f9c09f240 2023-09-30T22:35:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.341+0000 7f9f93fff700 1 -- 172.21.15.59:0/645289240 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84007310 con 0x7f9f9c09f240 2023-09-30T22:35:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.341+0000 7f9fa1e46700 1 -- 172.21.15.59:0/645289240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c1a3bb0 con 0x7f9f9c09f240 2023-09-30T22:35:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.342+0000 7f9fa1e46700 1 -- 172.21.15.59:0/645289240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c074ea0 con 0x7f9f9c09f240 2023-09-30T22:35:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.343+0000 7f9f93fff700 1 -- 172.21.15.59:0/645289240 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f84007470 con 0x7f9f9c09f240 2023-09-30T22:35:07.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.343+0000 7f9f93fff700 1 -- 172.21.15.59:0/645289240 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9f8403f8a0 con 0x7f9f9c09f240 2023-09-30T22:35:07.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.347+0000 7f9f93fff700 1 -- 172.21.15.59:0/645289240 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f840133c0 con 0x7f9f9c09f240 2023-09-30T22:35:07.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.514+0000 7efd3434e700 1 -- 172.21.15.59:0/1783828121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efd2c0747f0 con 0x7efd2c09d630 2023-09-30T22:35:07.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.515+0000 7efd2affd700 1 -- 172.21.15.59:0/1783828121 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd1c018020 con 0x7efd2c09d630 2023-09-30T22:35:07.515 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:07.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.517+0000 7efd3434e700 1 -- 172.21.15.59:0/1783828121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c09d630 msgr2=0x7efd2c133910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.517+0000 7efd3434e700 1 --2- 172.21.15.59:0/1783828121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c09d630 0x7efd2c133910 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00ccb0 tx=0x7efd1c00a060 comp rx=0 tx=0).stop 2023-09-30T22:35:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.517+0000 7efd3434e700 1 -- 172.21.15.59:0/1783828121 shutdown_connections 2023-09-30T22:35:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.517+0000 7efd3434e700 1 --2- 172.21.15.59:0/1783828121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd2c138d80 0x7efd2c134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.517+0000 7efd3434e700 1 --2- 172.21.15.59:0/1783828121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c09d630 0x7efd2c133910 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.517+0000 7efd3434e700 1 --2- 172.21.15.59:0/1783828121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd2c0a0a30 0x7efd2c133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.517+0000 7efd3434e700 1 -- 172.21.15.59:0/1783828121 >> 172.21.15.59:0/1783828121 conn(0x7efd2c0a3050 msgr2=0x7efd2c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.517+0000 7efd3434e700 1 -- 172.21.15.59:0/1783828121 shutdown_connections 2023-09-30T22:35:07.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.517+0000 7efd3434e700 1 -- 172.21.15.59:0/1783828121 wait complete. 2023-09-30T22:35:07.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:07.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.552+0000 7f9fa1e46700 1 -- 172.21.15.59:0/645289240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9f9c06b250 con 0x7f9f9c09f240 2023-09-30T22:35:07.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.552+0000 7f9f93fff700 1 -- 172.21.15.59:0/645289240 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f84011360 con 0x7f9f9c09f240 2023-09-30T22:35:07.552 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:07.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.554+0000 7f9fa1e46700 1 -- 172.21.15.59:0/645289240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f9c09f240 msgr2=0x7f9f9c1a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:07.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.554+0000 7f9fa1e46700 1 --2- 172.21.15.59:0/645289240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f9c09f240 0x7f9f9c1a1630 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f9f84001eb0 tx=0x7f9f8400c800 comp rx=0 tx=0).stop 2023-09-30T22:35:07.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.554+0000 7f9fa1e46700 1 -- 172.21.15.59:0/645289240 shutdown_connections 2023-09-30T22:35:07.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.554+0000 7f9fa1e46700 1 --2- 172.21.15.59:0/645289240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f9c09e930 0x7f9f9c1a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.554+0000 7f9fa1e46700 1 --2- 172.21.15.59:0/645289240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f9c09f650 0x7f9f9c1c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.554+0000 7f9fa1e46700 1 --2- 172.21.15.59:0/645289240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f9c09f240 0x7f9f9c1a1630 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:07.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.554+0000 7f9fa1e46700 1 -- 172.21.15.59:0/645289240 >> 172.21.15.59:0/645289240 conn(0x7f9f9c0a4210 msgr2=0x7f9f9c06c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:07.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.555+0000 7f9fa1e46700 1 -- 172.21.15.59:0/645289240 shutdown_connections 2023-09-30T22:35:07.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:07.555+0000 7f9fa1e46700 1 -- 172.21.15.59:0/645289240 wait complete. 2023-09-30T22:35:07.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:08.079 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:08.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:08.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.229+0000 7f02ef9b3700 1 Processor -- start 2023-09-30T22:35:08.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.229+0000 7f02ef9b3700 1 -- start start 2023-09-30T22:35:08.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.230+0000 7f02ef9b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e809f410 0x7f02e8136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.230+0000 7f02ef9b3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02e8136fe0 0x7f02e81393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.230+0000 7f02ef9b3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e8070940 con 0x7f02e809e930 2023-09-30T22:35:08.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.230+0000 7f02ef9b3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e806fd60 con 0x7f02e809f410 2023-09-30T22:35:08.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.230+0000 7f02ef9b3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02e806fa80 con 0x7f02e8136fe0 2023-09-30T22:35:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.230+0000 7f02ecf4e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e809f410 0x7f02e8136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.230+0000 7f02ed74f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f02e809e930 0x7f02e809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39898/0 (socket says 172.21.15.59:39898) 2023-09-30T22:35:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.230+0000 7f02ed74f700 1 -- 172.21.15.59:0/2353287310 learned_addr learned my addr 172.21.15.59:0/2353287310 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.230+0000 7f02edf50700 1 --2- 172.21.15.59:0/2353287310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02e8136fe0 0x7f02e81393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.230+0000 7f02dffff700 1 -- 172.21.15.59:0/2353287310 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286046793 0 0) 0x7f02e8070940 con 0x7f02e809e930 2023-09-30T22:35:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.231+0000 7f02ecf4e700 1 -- 172.21.15.59:0/2353287310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02e8136fe0 msgr2=0x7f02e81393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.231+0000 7f02ecf4e700 1 --2- 172.21.15.59:0/2353287310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02e8136fe0 0x7f02e81393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.231+0000 7f02ecf4e700 1 -- 172.21.15.59:0/2353287310 >> v1:172.21.15.59:6789/0 conn(0x7f02e809e930 legacy=0x7f02e809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.231+0000 7f02ecf4e700 1 -- 172.21.15.59:0/2353287310 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e809fb60 con 0x7f02e809f410 2023-09-30T22:35:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.231+0000 7f02edf50700 1 --2- 172.21.15.59:0/2353287310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02e8136fe0 0x7f02e81393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.231+0000 7f02ecf4e700 1 --2- 172.21.15.59:0/2353287310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e809f410 0x7f02e8136aa0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009870 tx=0x7f02d8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44496d85d04645bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:08.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.231+0000 7f02dffff700 1 -- 172.21.15.59:0/2353287310 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8011830 con 0x7f02e809f410 2023-09-30T22:35:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.231+0000 7f02dffff700 1 -- 172.21.15.59:0/2353287310 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d8011990 con 0x7f02e809f410 2023-09-30T22:35:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.231+0000 7f02dffff700 1 -- 172.21.15.59:0/2353287310 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8011d20 con 0x7f02e809f410 2023-09-30T22:35:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.232+0000 7f02ef9b3700 1 -- 172.21.15.59:0/2353287310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e809f410 msgr2=0x7f02e8136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.232+0000 7f02ef9b3700 1 --2- 172.21.15.59:0/2353287310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e809f410 0x7f02e8136aa0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009870 tx=0x7f02d8009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.232+0000 7f02ef9b3700 1 -- 172.21.15.59:0/2353287310 shutdown_connections 2023-09-30T22:35:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.232+0000 7f02ef9b3700 1 --2- 172.21.15.59:0/2353287310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02e8136fe0 0x7f02e81393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.232+0000 7f02ef9b3700 1 --2- 172.21.15.59:0/2353287310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e809f410 0x7f02e8136aa0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.232+0000 7f02ef9b3700 1 -- 172.21.15.59:0/2353287310 >> 172.21.15.59:0/2353287310 conn(0x7f02e80a4210 msgr2=0x7f02e80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:08.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.232+0000 7f02ef9b3700 1 -- 172.21.15.59:0/2353287310 shutdown_connections 2023-09-30T22:35:08.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.232+0000 7f02ef9b3700 1 -- 172.21.15.59:0/2353287310 wait complete. 2023-09-30T22:35:08.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.233+0000 7f02ef9b3700 1 Processor -- start 2023-09-30T22:35:08.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.233+0000 7f02ef9b3700 1 -- start start 2023-09-30T22:35:08.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ef9b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e809e930 0x7f02e806c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ef9b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e809f410 0x7f02e806c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ef9b3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02e8136fe0 0x7f02e81c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ef9b3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e8121160 con 0x7f02e809e930 2023-09-30T22:35:08.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ef9b3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e806d5c0 con 0x7f02e809f410 2023-09-30T22:35:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ef9b3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02e806cc40 con 0x7f02e8136fe0 2023-09-30T22:35:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ecf4e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e809f410 0x7f02e806c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ed74f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e809e930 0x7f02e806c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ecf4e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e809f410 0x7f02e806c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40942/0 (socket says 172.21.15.59:40942) 2023-09-30T22:35:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ecf4e700 1 -- 172.21.15.59:0/1719695855 learned_addr learned my addr 172.21.15.59:0/1719695855 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02edf50700 1 --2- 172.21.15.59:0/1719695855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02e8136fe0 0x7f02e81c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ecf4e700 1 -- 172.21.15.59:0/1719695855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02e8136fe0 msgr2=0x7f02e81c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ecf4e700 1 --2- 172.21.15.59:0/1719695855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02e8136fe0 0x7f02e81c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ecf4e700 1 -- 172.21.15.59:0/1719695855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e809e930 msgr2=0x7f02e806c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ecf4e700 1 --2- 172.21.15.59:0/1719695855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e809e930 0x7f02e806c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ecf4e700 1 -- 172.21.15.59:0/1719695855 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e0009a70 con 0x7f02e809f410 2023-09-30T22:35:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.234+0000 7f02ed74f700 1 --2- 172.21.15.59:0/1719695855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e809e930 0x7f02e806c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.235+0000 7f02ecf4e700 1 --2- 172.21.15.59:0/1719695855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e809f410 0x7f02e806c700 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009840 tx=0x7f02d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.235+0000 7f02ddffb700 1 -- 172.21.15.59:0/1719695855 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8004510 con 0x7f02e809f410 2023-09-30T22:35:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.235+0000 7f02ddffb700 1 -- 172.21.15.59:0/1719695855 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d801f070 con 0x7f02e809f410 2023-09-30T22:35:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.235+0000 7f02ef9b3700 1 -- 172.21.15.59:0/1719695855 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d80094a0 con 0x7f02e809f410 2023-09-30T22:35:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.235+0000 7f02ddffb700 1 -- 172.21.15.59:0/1719695855 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80038e0 con 0x7f02e809f410 2023-09-30T22:35:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.235+0000 7f02ef9b3700 1 -- 172.21.15.59:0/1719695855 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e8121590 con 0x7f02e809f410 2023-09-30T22:35:08.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.236+0000 7f02ddffb700 1 -- 172.21.15.59:0/1719695855 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f02d8003a40 con 0x7f02e809f410 2023-09-30T22:35:08.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.236+0000 7f02ddffb700 1 -- 172.21.15.59:0/1719695855 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f02d8021070 con 0x7f02e809f410 2023-09-30T22:35:08.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.236+0000 7f02ef9b3700 1 -- 172.21.15.59:0/1719695855 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e809dfd0 con 0x7f02e809f410 2023-09-30T22:35:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.241+0000 7f02ddffb700 1 -- 172.21.15.59:0/1719695855 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02d8010380 con 0x7f02e809f410 2023-09-30T22:35:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.277+0000 7f3d3ea5b700 1 Processor -- start 2023-09-30T22:35:08.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.277+0000 7f3d3ea5b700 1 -- start start 2023-09-30T22:35:08.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.277+0000 7f3d3ea5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d380a0a30 0x7f3d380a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.277+0000 7f3d3ea5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d380a1340 0x7f3d38133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.277+0000 7f3d3ea5b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3809edd0 con 0x7f3d38133fa0 2023-09-30T22:35:08.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.277+0000 7f3d3ea5b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3809e1f0 con 0x7f3d380a1340 2023-09-30T22:35:08.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.277+0000 7f3d3ea5b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3809dc50 con 0x7f3d380a0a30 2023-09-30T22:35:08.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.278+0000 7f3d377fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d380a1340 0x7f3d38133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.278+0000 7f3d37fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d380a0a30 0x7f3d380a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.278+0000 7f3d377fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d380a1340 0x7f3d38133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40948/0 (socket says 172.21.15.59:40948) 2023-09-30T22:35:08.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.278+0000 7f3d37fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d380a0a30 0x7f3d380a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52894/0 (socket says 172.21.15.59:52894) 2023-09-30T22:35:08.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.278+0000 7f3d377fe700 1 -- 172.21.15.59:0/1608898802 learned_addr learned my addr 172.21.15.59:0/1608898802 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.278+0000 7f3d36ffd700 1 -- 172.21.15.59:0/1608898802 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634680854 0 0) 0x7f3d3809edd0 con 0x7f3d38133fa0 2023-09-30T22:35:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.278+0000 7f3d377fe700 1 -- 172.21.15.59:0/1608898802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d380a0a30 msgr2=0x7f3d380a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.278+0000 7f3d377fe700 1 --2- 172.21.15.59:0/1608898802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d380a0a30 0x7f3d380a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.278+0000 7f3d377fe700 1 -- 172.21.15.59:0/1608898802 >> v1:172.21.15.59:6789/0 conn(0x7f3d38133fa0 legacy=0x7f3d3813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.278+0000 7f3d377fe700 1 -- 172.21.15.59:0/1608898802 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d380a1fe0 con 0x7f3d380a1340 2023-09-30T22:35:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.278+0000 7f3d37fff700 1 --2- 172.21.15.59:0/1608898802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d380a0a30 0x7f3d380a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.278+0000 7f3d377fe700 1 --2- 172.21.15.59:0/1608898802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d380a1340 0x7f3d38133a60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009920 tx=0x7f3d2c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf94368fb8c64754 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.278+0000 7f3d36ffd700 1 -- 172.21.15.59:0/1608898802 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c011830 con 0x7f3d380a1340 2023-09-30T22:35:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.278+0000 7f3d36ffd700 1 -- 172.21.15.59:0/1608898802 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c011990 con 0x7f3d380a1340 2023-09-30T22:35:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.278+0000 7f3d36ffd700 1 -- 172.21.15.59:0/1608898802 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c011d20 con 0x7f3d380a1340 2023-09-30T22:35:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.279+0000 7f3d3ea5b700 1 -- 172.21.15.59:0/1608898802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d380a1340 msgr2=0x7f3d38133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.279+0000 7f3d3ea5b700 1 --2- 172.21.15.59:0/1608898802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d380a1340 0x7f3d38133a60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009920 tx=0x7f3d2c009c30 comp rx=0 tx=0).stop 2023-09-30T22:35:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.279+0000 7f3d3ea5b700 1 -- 172.21.15.59:0/1608898802 shutdown_connections 2023-09-30T22:35:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.279+0000 7f3d3ea5b700 1 --2- 172.21.15.59:0/1608898802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d380a0a30 0x7f3d380a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.279+0000 7f3d3ea5b700 1 --2- 172.21.15.59:0/1608898802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d380a1340 0x7f3d38133a60 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.279+0000 7f3d3ea5b700 1 -- 172.21.15.59:0/1608898802 >> 172.21.15.59:0/1608898802 conn(0x7f3d380a6550 msgr2=0x7f3d380a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.279+0000 7f3d3ea5b700 1 -- 172.21.15.59:0/1608898802 shutdown_connections 2023-09-30T22:35:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.279+0000 7f3d3ea5b700 1 -- 172.21.15.59:0/1608898802 wait complete. 2023-09-30T22:35:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.280+0000 7f3d3ea5b700 1 Processor -- start 2023-09-30T22:35:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.280+0000 7f3d3ea5b700 1 -- start start 2023-09-30T22:35:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d3ea5b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d380a0a30 0x7f3d3811e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d3ea5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d380a1340 0x7f3d3811ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d3ea5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d38133fa0 0x7f3d3811f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d3ea5b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d38121f20 con 0x7f3d380a0a30 2023-09-30T22:35:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d3ea5b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d38120400 con 0x7f3d38133fa0 2023-09-30T22:35:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d3ea5b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d380a0220 con 0x7f3d380a1340 2023-09-30T22:35:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d3cff8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d38133fa0 0x7f3d3811f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d37fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d380a0a30 0x7f3d3811e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d37fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d380a0a30 0x7f3d3811e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45248/0 (socket says 172.21.15.59:45248) 2023-09-30T22:35:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d3cff8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d38133fa0 0x7f3d3811f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40958/0 (socket says 172.21.15.59:40958) 2023-09-30T22:35:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d37fff700 1 -- 172.21.15.59:0/853833068 learned_addr learned my addr 172.21.15.59:0/853833068 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d377fe700 1 --2- 172.21.15.59:0/853833068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d380a1340 0x7f3d3811ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d37fff700 1 -- 172.21.15.59:0/853833068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d380a1340 msgr2=0x7f3d3811ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d37fff700 1 --2- 172.21.15.59:0/853833068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d380a1340 0x7f3d3811ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d37fff700 1 -- 172.21.15.59:0/853833068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d38133fa0 msgr2=0x7f3d3811f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d37fff700 1 --2- 172.21.15.59:0/853833068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d38133fa0 0x7f3d3811f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d37fff700 1 -- 172.21.15.59:0/853833068 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d280094a0 con 0x7f3d380a0a30 2023-09-30T22:35:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d377fe700 1 --2- 172.21.15.59:0/853833068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d380a1340 0x7f3d3811ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.281+0000 7f3d3cff8700 1 --2- 172.21.15.59:0/853833068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d38133fa0 0x7f3d3811f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.282+0000 7f3d37fff700 1 --2- 172.21.15.59:0/853833068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d380a0a30 0x7f3d3811e6e0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800ebe0 tx=0x7f3d2800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.282+0000 7f3d34ff9700 1 -- 172.21.15.59:0/853833068 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2800c850 con 0x7f3d380a0a30 2023-09-30T22:35:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.282+0000 7f3d34ff9700 1 -- 172.21.15.59:0/853833068 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2800c9b0 con 0x7f3d380a0a30 2023-09-30T22:35:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.282+0000 7f3d3ea5b700 1 -- 172.21.15.59:0/853833068 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2c009550 con 0x7f3d380a0a30 2023-09-30T22:35:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.282+0000 7f3d34ff9700 1 -- 172.21.15.59:0/853833068 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2800cd40 con 0x7f3d380a0a30 2023-09-30T22:35:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.282+0000 7f3d3ea5b700 1 -- 172.21.15.59:0/853833068 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d380a25e0 con 0x7f3d380a0a30 2023-09-30T22:35:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.283+0000 7f3d34ff9700 1 -- 172.21.15.59:0/853833068 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d28013470 con 0x7f3d380a0a30 2023-09-30T22:35:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.283+0000 7f3d3ea5b700 1 -- 172.21.15.59:0/853833068 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d38074ea0 con 0x7f3d380a0a30 2023-09-30T22:35:08.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.283+0000 7f3d34ff9700 1 -- 172.21.15.59:0/853833068 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3d2803f750 con 0x7f3d380a0a30 2023-09-30T22:35:08.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.288+0000 7f3d34ff9700 1 -- 172.21.15.59:0/853833068 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d28021020 con 0x7f3d380a0a30 2023-09-30T22:35:08.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.463+0000 7f02ef9b3700 1 -- 172.21.15.59:0/1719695855 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f02e809fdb0 con 0x7f02e809f410 2023-09-30T22:35:08.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.464+0000 7f02ddffb700 1 -- 172.21.15.59:0/1719695855 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02d8024b70 con 0x7f02e809f410 2023-09-30T22:35:08.464 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:08.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.466+0000 7f02ef9b3700 1 -- 172.21.15.59:0/1719695855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e809f410 msgr2=0x7f02e806c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.466+0000 7f02ef9b3700 1 --2- 172.21.15.59:0/1719695855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e809f410 0x7f02e806c700 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009840 tx=0x7f02d8004750 comp rx=0 tx=0).stop 2023-09-30T22:35:08.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.466+0000 7f02ef9b3700 1 -- 172.21.15.59:0/1719695855 shutdown_connections 2023-09-30T22:35:08.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.466+0000 7f02ef9b3700 1 --2- 172.21.15.59:0/1719695855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02e8136fe0 0x7f02e81c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.466+0000 7f02ef9b3700 1 --2- 172.21.15.59:0/1719695855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e809e930 0x7f02e806c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.466+0000 7f02ef9b3700 1 --2- 172.21.15.59:0/1719695855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e809f410 0x7f02e806c700 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.466+0000 7f02ef9b3700 1 -- 172.21.15.59:0/1719695855 >> 172.21.15.59:0/1719695855 conn(0x7f02e80a4210 msgr2=0x7f02e8135c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:08.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.466+0000 7f02ef9b3700 1 -- 172.21.15.59:0/1719695855 shutdown_connections 2023-09-30T22:35:08.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.466+0000 7f02ef9b3700 1 -- 172.21.15.59:0/1719695855 wait complete. 2023-09-30T22:35:08.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:08.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.496+0000 7f3d3ea5b700 1 -- 172.21.15.59:0/853833068 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3d380a28e0 con 0x7f3d380a0a30 2023-09-30T22:35:08.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.496+0000 7f3d34ff9700 1 -- 172.21.15.59:0/853833068 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d28021020 con 0x7f3d380a0a30 2023-09-30T22:35:08.497 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.498+0000 7f3d3ea5b700 1 -- 172.21.15.59:0/853833068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d380a0a30 msgr2=0x7f3d3811e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.498+0000 7f3d3ea5b700 1 --2- 172.21.15.59:0/853833068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d380a0a30 0x7f3d3811e6e0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800ebe0 tx=0x7f3d2800eef0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.498+0000 7f3d3ea5b700 1 -- 172.21.15.59:0/853833068 shutdown_connections 2023-09-30T22:35:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.499+0000 7f3d3ea5b700 1 --2- 172.21.15.59:0/853833068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d38133fa0 0x7f3d3811f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.499+0000 7f3d3ea5b700 1 --2- 172.21.15.59:0/853833068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d380a0a30 0x7f3d3811e6e0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.499+0000 7f3d3ea5b700 1 --2- 172.21.15.59:0/853833068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d380a1340 0x7f3d3811ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.499+0000 7f3d3ea5b700 1 -- 172.21.15.59:0/853833068 >> 172.21.15.59:0/853833068 conn(0x7f3d380a6550 msgr2=0x7f3d3809a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.499+0000 7f3d3ea5b700 1 -- 172.21.15.59:0/853833068 shutdown_connections 2023-09-30T22:35:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.499+0000 7f3d3ea5b700 1 -- 172.21.15.59:0/853833068 wait complete. 2023-09-30T22:35:08.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:08.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:08.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:08.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.697+0000 7fa93c71d700 1 Processor -- start 2023-09-30T22:35:08.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.697+0000 7fa93c71d700 1 -- start start 2023-09-30T22:35:08.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.698+0000 7fa93c71d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93409f410 0x7fa934136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.698+0000 7fa93c71d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa934136fe0 0x7fa9341393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.699+0000 7fa93c71d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa934070940 con 0x7fa93409e930 2023-09-30T22:35:08.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.699+0000 7fa93c71d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93406fd60 con 0x7fa934136fe0 2023-09-30T22:35:08.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.699+0000 7fa93c71d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa93406fa80 con 0x7fa93409f410 2023-09-30T22:35:08.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.699+0000 7fa939cb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93409f410 0x7fa934136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.699+0000 7fa939cb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93409f410 0x7fa934136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52920/0 (socket says 172.21.15.59:52920) 2023-09-30T22:35:08.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.699+0000 7fa939cb8700 1 -- 172.21.15.59:0/2893497382 learned_addr learned my addr 172.21.15.59:0/2893497382 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:08.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.699+0000 7fa93acba700 1 --2- 172.21.15.59:0/2893497382 >> v2:172.21.15.59:3300/0 conn(0x7fa934136fe0 0x7fa9341393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.699+0000 7fa939cb8700 1 -- 172.21.15.59:0/2893497382 >> v2:172.21.15.59:3300/0 conn(0x7fa934136fe0 msgr2=0x7fa9341393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:08.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.699+0000 7fa939cb8700 1 --2- 172.21.15.59:0/2893497382 >> v2:172.21.15.59:3300/0 conn(0x7fa934136fe0 0x7fa9341393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.699+0000 7fa939cb8700 1 -- 172.21.15.59:0/2893497382 >> v1:172.21.15.59:6789/0 conn(0x7fa93409e930 legacy=0x7fa93409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.699+0000 7fa939cb8700 1 -- 172.21.15.59:0/2893497382 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93409fb60 con 0x7fa93409f410 2023-09-30T22:35:08.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.699+0000 7fa939cb8700 1 --2- 172.21.15.59:0/2893497382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93409f410 0x7fa934136aa0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa9240098f0 tx=0x7fa924009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f940aa1623c193a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:08.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.699+0000 7fa9394b7700 1 -- 172.21.15.59:0/2893497382 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa924011830 con 0x7fa93409f410 2023-09-30T22:35:08.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.699+0000 7fa9394b7700 1 -- 172.21.15.59:0/2893497382 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa924011990 con 0x7fa93409f410 2023-09-30T22:35:08.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.699+0000 7fa9394b7700 1 -- 172.21.15.59:0/2893497382 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa924011d20 con 0x7fa93409f410 2023-09-30T22:35:08.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.700+0000 7fa93c71d700 1 -- 172.21.15.59:0/2893497382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93409f410 msgr2=0x7fa934136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.700+0000 7fa93c71d700 1 --2- 172.21.15.59:0/2893497382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93409f410 0x7fa934136aa0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa9240098f0 tx=0x7fa924009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:08.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.700+0000 7fa93c71d700 1 -- 172.21.15.59:0/2893497382 shutdown_connections 2023-09-30T22:35:08.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.700+0000 7fa93c71d700 1 --2- 172.21.15.59:0/2893497382 >> v2:172.21.15.59:3300/0 conn(0x7fa934136fe0 0x7fa9341393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.700+0000 7fa93c71d700 1 --2- 172.21.15.59:0/2893497382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93409f410 0x7fa934136aa0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.700+0000 7fa93c71d700 1 -- 172.21.15.59:0/2893497382 >> 172.21.15.59:0/2893497382 conn(0x7fa9340a4210 msgr2=0x7fa9340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:08.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.700+0000 7fa93c71d700 1 -- 172.21.15.59:0/2893497382 shutdown_connections 2023-09-30T22:35:08.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.700+0000 7fa93c71d700 1 -- 172.21.15.59:0/2893497382 wait complete. 2023-09-30T22:35:08.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.702+0000 7fa93c71d700 1 Processor -- start 2023-09-30T22:35:08.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.702+0000 7fa93c71d700 1 -- start start 2023-09-30T22:35:08.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.702+0000 7fa93c71d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93409e930 0x7fa93411c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.702+0000 7fa93c71d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa93409f410 0x7fa93411cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.702+0000 7fa93c71d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa934136fe0 0x7fa93411d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.702+0000 7fa93c71d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93411f880 con 0x7fa93409f410 2023-09-30T22:35:08.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.702+0000 7fa93c71d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93411e200 con 0x7fa934136fe0 2023-09-30T22:35:08.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.702+0000 7fa93c71d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9340a3040 con 0x7fa93409e930 2023-09-30T22:35:08.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa93a4b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93409e930 0x7fa93411c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa93acba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa934136fe0 0x7fa93411d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa93a4b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93409e930 0x7fa93411c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52932/0 (socket says 172.21.15.59:52932) 2023-09-30T22:35:08.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa93a4b9700 1 -- 172.21.15.59:0/38913760 learned_addr learned my addr 172.21.15.59:0/38913760 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:08.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa939cb8700 1 --2- 172.21.15.59:0/38913760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa93409f410 0x7fa93411cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa93acba700 1 -- 172.21.15.59:0/38913760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93409e930 msgr2=0x7fa93411c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa93acba700 1 --2- 172.21.15.59:0/38913760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93409e930 0x7fa93411c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa93acba700 1 -- 172.21.15.59:0/38913760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa93409f410 msgr2=0x7fa93411cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa93acba700 1 --2- 172.21.15.59:0/38913760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa93409f410 0x7fa93411cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa93acba700 1 -- 172.21.15.59:0/38913760 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa924009550 con 0x7fa934136fe0 2023-09-30T22:35:08.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa93a4b9700 1 --2- 172.21.15.59:0/38913760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93409e930 0x7fa93411c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:08.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa939cb8700 1 --2- 172.21.15.59:0/38913760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa93409f410 0x7fa93411cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:08.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa93acba700 1 --2- 172.21.15.59:0/38913760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa934136fe0 0x7fa93411d070 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa92c00ef90 tx=0x7fa92c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:08.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa92affd700 1 -- 172.21.15.59:0/38913760 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c00cc90 con 0x7fa934136fe0 2023-09-30T22:35:08.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa92affd700 1 -- 172.21.15.59:0/38913760 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92c00f040 con 0x7fa934136fe0 2023-09-30T22:35:08.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa93c71d700 1 -- 172.21.15.59:0/38913760 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa934071d20 con 0x7fa934136fe0 2023-09-30T22:35:08.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa92affd700 1 -- 172.21.15.59:0/38913760 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0146c0 con 0x7fa934136fe0 2023-09-30T22:35:08.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.703+0000 7fa93c71d700 1 -- 172.21.15.59:0/38913760 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa934120610 con 0x7fa934136fe0 2023-09-30T22:35:08.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.704+0000 7fa92affd700 1 -- 172.21.15.59:0/38913760 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa92c014820 con 0x7fa934136fe0 2023-09-30T22:35:08.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.704+0000 7fa93c71d700 1 -- 172.21.15.59:0/38913760 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa934074ea0 con 0x7fa934136fe0 2023-09-30T22:35:08.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.705+0000 7fa92affd700 1 -- 172.21.15.59:0/38913760 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa92c040220 con 0x7fa934136fe0 2023-09-30T22:35:08.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.710+0000 7fa92affd700 1 -- 172.21.15.59:0/38913760 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa92c007920 con 0x7fa934136fe0 2023-09-30T22:35:08.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.737+0000 7fd899ef8700 1 Processor -- start 2023-09-30T22:35:08.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.737+0000 7fd899ef8700 1 -- start start 2023-09-30T22:35:08.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.737+0000 7fd899ef8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8940a0a30 0x7fd8940a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.737+0000 7fd899ef8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd894138d80 0x7fd89413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.737+0000 7fd899ef8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8940a2a70 con 0x7fd89409d630 2023-09-30T22:35:08.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.737+0000 7fd899ef8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8940a01d0 con 0x7fd894138d80 2023-09-30T22:35:08.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.737+0000 7fd899ef8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd89409e2b0 con 0x7fd8940a0a30 2023-09-30T22:35:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.737+0000 7fd8937fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8940a0a30 0x7fd8940a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.737+0000 7fd893fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd894138d80 0x7fd89413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.737+0000 7fd8937fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8940a0a30 0x7fd8940a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52948/0 (socket says 172.21.15.59:52948) 2023-09-30T22:35:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.737+0000 7fd8937fe700 1 -- 172.21.15.59:0/3577686339 learned_addr learned my addr 172.21.15.59:0/3577686339 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.737+0000 7fd893fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd894138d80 0x7fd89413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45272/0 (socket says 172.21.15.59:45272) 2023-09-30T22:35:08.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.738+0000 7fd893fff700 1 -- 172.21.15.59:0/3577686339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8940a0a30 msgr2=0x7fd8940a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.738+0000 7fd893fff700 1 --2- 172.21.15.59:0/3577686339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8940a0a30 0x7fd8940a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.738+0000 7fd893fff700 1 -- 172.21.15.59:0/3577686339 >> v1:172.21.15.59:6789/0 conn(0x7fd89409d630 legacy=0x7fd8940a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.738+0000 7fd893fff700 1 -- 172.21.15.59:0/3577686339 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89409dc50 con 0x7fd894138d80 2023-09-30T22:35:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.738+0000 7fd8927fc700 1 -- 172.21.15.59:0/3577686339 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046854746 0 0) 0x7fd8940a2a70 con 0x7fd89409d630 2023-09-30T22:35:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.738+0000 7fd8937fe700 1 --2- 172.21.15.59:0/3577686339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8940a0a30 0x7fd8940a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:08.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.738+0000 7fd893fff700 1 --2- 172.21.15.59:0/3577686339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd894138d80 0x7fd89413b160 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009d90 tx=0x7fd88c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eccd4c81819313d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.738+0000 7fd8927fc700 1 -- 172.21.15.59:0/3577686339 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c00e070 con 0x7fd894138d80 2023-09-30T22:35:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.738+0000 7fd8927fc700 1 -- 172.21.15.59:0/3577686339 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c00bb20 con 0x7fd894138d80 2023-09-30T22:35:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.738+0000 7fd8927fc700 1 -- 172.21.15.59:0/3577686339 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c012430 con 0x7fd894138d80 2023-09-30T22:35:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.739+0000 7fd899ef8700 1 -- 172.21.15.59:0/3577686339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd894138d80 msgr2=0x7fd89413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.739+0000 7fd899ef8700 1 --2- 172.21.15.59:0/3577686339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd894138d80 0x7fd89413b160 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009d90 tx=0x7fd88c00b330 comp rx=0 tx=0).stop 2023-09-30T22:35:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.739+0000 7fd899ef8700 1 -- 172.21.15.59:0/3577686339 shutdown_connections 2023-09-30T22:35:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.739+0000 7fd899ef8700 1 --2- 172.21.15.59:0/3577686339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd894138d80 0x7fd89413b160 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.739+0000 7fd899ef8700 1 --2- 172.21.15.59:0/3577686339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8940a0a30 0x7fd8940a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.739+0000 7fd899ef8700 1 -- 172.21.15.59:0/3577686339 >> 172.21.15.59:0/3577686339 conn(0x7fd8940a3050 msgr2=0x7fd8940a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.739+0000 7fd899ef8700 1 -- 172.21.15.59:0/3577686339 shutdown_connections 2023-09-30T22:35:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.739+0000 7fd899ef8700 1 -- 172.21.15.59:0/3577686339 wait complete. 2023-09-30T22:35:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.740+0000 7fd899ef8700 1 Processor -- start 2023-09-30T22:35:08.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.740+0000 7fd899ef8700 1 -- start start 2023-09-30T22:35:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd899ef8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd89409d630 0x7fd894133750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd899ef8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8940a0a30 0x7fd894133c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd899ef8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd894138d80 0x7fd8941341d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd899ef8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd894136270 con 0x7fd894138d80 2023-09-30T22:35:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd899ef8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd894136f90 con 0x7fd8940a0a30 2023-09-30T22:35:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd899ef8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8940a4ad0 con 0x7fd89409d630 2023-09-30T22:35:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd8937fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd89409d630 0x7fd894133750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd8937fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd89409d630 0x7fd894133750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52950/0 (socket says 172.21.15.59:52950) 2023-09-30T22:35:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd8937fe700 1 -- 172.21.15.59:0/3968595518 learned_addr learned my addr 172.21.15.59:0/3968595518 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd892ffd700 1 --2- 172.21.15.59:0/3968595518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8940a0a30 0x7fd894133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd893fff700 1 --2- 172.21.15.59:0/3968595518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd894138d80 0x7fd8941341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:08.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd8937fe700 1 -- 172.21.15.59:0/3968595518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8940a0a30 msgr2=0x7fd894133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd8937fe700 1 --2- 172.21.15.59:0/3968595518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8940a0a30 0x7fd894133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd8937fe700 1 -- 172.21.15.59:0/3968595518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd894138d80 msgr2=0x7fd8941341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd8937fe700 1 --2- 172.21.15.59:0/3968595518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd894138d80 0x7fd8941341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd8937fe700 1 -- 172.21.15.59:0/3968595518 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd884009550 con 0x7fd89409d630 2023-09-30T22:35:08.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd8937fe700 1 --2- 172.21.15.59:0/3968595518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd89409d630 0x7fd894133750 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd88400ebe0 tx=0x7fd88400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:08.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.741+0000 7fd87bfff700 1 -- 172.21.15.59:0/3968595518 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88400c850 con 0x7fd89409d630 2023-09-30T22:35:08.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.742+0000 7fd899ef8700 1 -- 172.21.15.59:0/3968595518 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88c009a70 con 0x7fd89409d630 2023-09-30T22:35:08.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.742+0000 7fd87bfff700 1 -- 172.21.15.59:0/3968595518 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88400c9b0 con 0x7fd89409d630 2023-09-30T22:35:08.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.742+0000 7fd87bfff700 1 -- 172.21.15.59:0/3968595518 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88400cd40 con 0x7fd89409d630 2023-09-30T22:35:08.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.742+0000 7fd899ef8700 1 -- 172.21.15.59:0/3968595518 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd894136620 con 0x7fd89409d630 2023-09-30T22:35:08.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.742+0000 7fd87bfff700 1 -- 172.21.15.59:0/3968595518 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd884013470 con 0x7fd89409d630 2023-09-30T22:35:08.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.743+0000 7fd899ef8700 1 -- 172.21.15.59:0/3968595518 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd894137ac0 con 0x7fd89409d630 2023-09-30T22:35:08.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.743+0000 7fd87bfff700 1 -- 172.21.15.59:0/3968595518 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd88403fc40 con 0x7fd89409d630 2023-09-30T22:35:08.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.748+0000 7fd87bfff700 1 -- 172.21.15.59:0/3968595518 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd884013720 con 0x7fd89409d630 2023-09-30T22:35:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.916+0000 7fa93c71d700 1 -- 172.21.15.59:0/38913760 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa9341208c0 con 0x7fa934136fe0 2023-09-30T22:35:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.916+0000 7fa92affd700 1 -- 172.21.15.59:0/38913760 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa92c018020 con 0x7fa934136fe0 2023-09-30T22:35:08.917 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:08.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.919+0000 7fa93c71d700 1 -- 172.21.15.59:0/38913760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa934136fe0 msgr2=0x7fa93411d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.919+0000 7fa93c71d700 1 --2- 172.21.15.59:0/38913760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa934136fe0 0x7fa93411d070 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa92c00ef90 tx=0x7fa92c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.919+0000 7fa93c71d700 1 -- 172.21.15.59:0/38913760 shutdown_connections 2023-09-30T22:35:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.919+0000 7fa93c71d700 1 --2- 172.21.15.59:0/38913760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93409e930 0x7fa93411c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.919+0000 7fa93c71d700 1 --2- 172.21.15.59:0/38913760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa934136fe0 0x7fa93411d070 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.919+0000 7fa93c71d700 1 --2- 172.21.15.59:0/38913760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa93409f410 0x7fa93411cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.919+0000 7fa93c71d700 1 -- 172.21.15.59:0/38913760 >> 172.21.15.59:0/38913760 conn(0x7fa9340a4210 msgr2=0x7fa93409bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.919+0000 7fa93c71d700 1 -- 172.21.15.59:0/38913760 shutdown_connections 2023-09-30T22:35:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.919+0000 7fa93c71d700 1 -- 172.21.15.59:0/38913760 wait complete. 2023-09-30T22:35:08.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:08.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.952+0000 7fd899ef8700 1 -- 172.21.15.59:0/3968595518 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd8940747f0 con 0x7fd89409d630 2023-09-30T22:35:08.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.952+0000 7fd87bfff700 1 -- 172.21.15.59:0/3968595518 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd884024350 con 0x7fd89409d630 2023-09-30T22:35:08.953 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:08.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.954+0000 7fd899ef8700 1 -- 172.21.15.59:0/3968595518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd89409d630 msgr2=0x7fd894133750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:08.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.954+0000 7fd899ef8700 1 --2- 172.21.15.59:0/3968595518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd89409d630 0x7fd894133750 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd88400ebe0 tx=0x7fd88400eef0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.954+0000 7fd899ef8700 1 -- 172.21.15.59:0/3968595518 shutdown_connections 2023-09-30T22:35:08.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.954+0000 7fd899ef8700 1 --2- 172.21.15.59:0/3968595518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd89409d630 0x7fd894133750 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.954+0000 7fd899ef8700 1 --2- 172.21.15.59:0/3968595518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd894138d80 0x7fd8941341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.954+0000 7fd899ef8700 1 --2- 172.21.15.59:0/3968595518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8940a0a30 0x7fd894133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:08.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.954+0000 7fd899ef8700 1 -- 172.21.15.59:0/3968595518 >> 172.21.15.59:0/3968595518 conn(0x7fd8940a3050 msgr2=0x7fd89413af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:08.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.954+0000 7fd899ef8700 1 -- 172.21.15.59:0/3968595518 shutdown_connections 2023-09-30T22:35:08.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:08.955+0000 7fd899ef8700 1 -- 172.21.15.59:0/3968595518 wait complete. 2023-09-30T22:35:08.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:09.482 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:09.513 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:09.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.629+0000 7f367aa81700 1 Processor -- start 2023-09-30T22:35:09.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.629+0000 7f367aa81700 1 -- start start 2023-09-30T22:35:09.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.630+0000 7f367aa81700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f367409d630 0x7f36740a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:09.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.630+0000 7f367aa81700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3674138d80 0x7f367413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:09.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.630+0000 7f367aa81700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36740a2a70 con 0x7f36740a0a30 2023-09-30T22:35:09.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.630+0000 7f367aa81700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36740a01d0 con 0x7f3674138d80 2023-09-30T22:35:09.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.630+0000 7f367aa81700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f367409e2b0 con 0x7f367409d630 2023-09-30T22:35:09.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.630+0000 7f3673fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f367409d630 0x7f36740a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:09.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.630+0000 7f367901e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3674138d80 0x7f367413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:09.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.630+0000 7f367901e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3674138d80 0x7f367413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45286/0 (socket says 172.21.15.59:45286) 2023-09-30T22:35:09.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.630+0000 7f3673fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f367409d630 0x7f36740a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52956/0 (socket says 172.21.15.59:52956) 2023-09-30T22:35:09.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.630+0000 7f367901e700 1 -- 172.21.15.59:0/2763603092 learned_addr learned my addr 172.21.15.59:0/2763603092 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:09.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.630+0000 7f367901e700 1 -- 172.21.15.59:0/2763603092 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f367409d630 msgr2=0x7f36740a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:09.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.630+0000 7f367901e700 1 --2- 172.21.15.59:0/2763603092 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f367409d630 0x7f36740a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.630+0000 7f367901e700 1 -- 172.21.15.59:0/2763603092 >> v1:172.21.15.59:6789/0 conn(0x7f36740a0a30 legacy=0x7f36740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:09.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.630+0000 7f367901e700 1 -- 172.21.15.59:0/2763603092 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367409dc50 con 0x7f3674138d80 2023-09-30T22:35:09.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.631+0000 7f367901e700 1 --2- 172.21.15.59:0/2763603092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3674138d80 0x7f367413b160 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f36640098f0 tx=0x7f3664009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e00d6c3ba25d817 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:09.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.631+0000 7f36737fe700 1 -- 172.21.15.59:0/2763603092 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664011830 con 0x7f3674138d80 2023-09-30T22:35:09.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.631+0000 7f36737fe700 1 -- 172.21.15.59:0/2763603092 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3664011990 con 0x7f3674138d80 2023-09-30T22:35:09.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.631+0000 7f36737fe700 1 -- 172.21.15.59:0/2763603092 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664011d20 con 0x7f3674138d80 2023-09-30T22:35:09.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.631+0000 7f367aa81700 1 -- 172.21.15.59:0/2763603092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3674138d80 msgr2=0x7f367413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:09.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.631+0000 7f367aa81700 1 --2- 172.21.15.59:0/2763603092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3674138d80 0x7f367413b160 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f36640098f0 tx=0x7f3664009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:09.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.631+0000 7f367aa81700 1 -- 172.21.15.59:0/2763603092 shutdown_connections 2023-09-30T22:35:09.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.631+0000 7f367aa81700 1 --2- 172.21.15.59:0/2763603092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3674138d80 0x7f367413b160 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.631+0000 7f367aa81700 1 --2- 172.21.15.59:0/2763603092 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f367409d630 0x7f36740a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.631+0000 7f367aa81700 1 -- 172.21.15.59:0/2763603092 >> 172.21.15.59:0/2763603092 conn(0x7f36740a3050 msgr2=0x7f36740a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:09.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.632+0000 7f367aa81700 1 -- 172.21.15.59:0/2763603092 shutdown_connections 2023-09-30T22:35:09.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.632+0000 7f367aa81700 1 -- 172.21.15.59:0/2763603092 wait complete. 2023-09-30T22:35:09.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.632+0000 7f367aa81700 1 Processor -- start 2023-09-30T22:35:09.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.633+0000 7f367aa81700 1 -- start start 2023-09-30T22:35:09.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.633+0000 7f367aa81700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f367409d630 0x7f36741339e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:09.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.633+0000 7f367aa81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36740a0a30 0x7f3674133f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:09.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.633+0000 7f367aa81700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3674138d80 0x7f3674134460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:09.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.633+0000 7f367aa81700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3674137270 con 0x7f3674138d80 2023-09-30T22:35:09.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.633+0000 7f367aa81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36741380f0 con 0x7f36740a0a30 2023-09-30T22:35:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.633+0000 7f367aa81700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3674134e40 con 0x7f367409d630 2023-09-30T22:35:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.633+0000 7f367881d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f367409d630 0x7f36741339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.633+0000 7f367901e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3674138d80 0x7f3674134460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.633+0000 7f367881d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f367409d630 0x7f36741339e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52958/0 (socket says 172.21.15.59:52958) 2023-09-30T22:35:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.633+0000 7f367881d700 1 -- 172.21.15.59:0/2611808535 learned_addr learned my addr 172.21.15.59:0/2611808535 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.633+0000 7f367901e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3674138d80 0x7f3674134460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45302/0 (socket says 172.21.15.59:45302) 2023-09-30T22:35:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.633+0000 7f3673fff700 1 --2- 172.21.15.59:0/2611808535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36740a0a30 0x7f3674133f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.634+0000 7f367901e700 1 -- 172.21.15.59:0/2611808535 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f367409d630 msgr2=0x7f36741339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.634+0000 7f367901e700 1 --2- 172.21.15.59:0/2611808535 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f367409d630 0x7f36741339e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.634+0000 7f367901e700 1 -- 172.21.15.59:0/2611808535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36740a0a30 msgr2=0x7f3674133f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.634+0000 7f367901e700 1 --2- 172.21.15.59:0/2611808535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36740a0a30 0x7f3674133f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.634+0000 7f367901e700 1 -- 172.21.15.59:0/2611808535 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3664009550 con 0x7f3674138d80 2023-09-30T22:35:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.634+0000 7f367881d700 1 --2- 172.21.15.59:0/2611808535 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f367409d630 0x7f36741339e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.634+0000 7f367901e700 1 --2- 172.21.15.59:0/2611808535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3674138d80 0x7f3674134460 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f36740a1fb0 tx=0x7f3664004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.634+0000 7f36717fa700 1 -- 172.21.15.59:0/2611808535 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664004380 con 0x7f3674138d80 2023-09-30T22:35:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.634+0000 7f36717fa700 1 -- 172.21.15.59:0/2611808535 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366401f070 con 0x7f3674138d80 2023-09-30T22:35:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.634+0000 7f367aa81700 1 -- 172.21.15.59:0/2611808535 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36740a4d40 con 0x7f3674138d80 2023-09-30T22:35:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.634+0000 7f36717fa700 1 -- 172.21.15.59:0/2611808535 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640036a0 con 0x7f3674138d80 2023-09-30T22:35:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.634+0000 7f367aa81700 1 -- 172.21.15.59:0/2611808535 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3674138750 con 0x7f3674138d80 2023-09-30T22:35:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.635+0000 7f36717fa700 1 -- 172.21.15.59:0/2611808535 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3664021030 con 0x7f3674138d80 2023-09-30T22:35:09.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.635+0000 7f36717fa700 1 -- 172.21.15.59:0/2611808535 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3664040960 con 0x7f3674138d80 2023-09-30T22:35:09.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.635+0000 7f367aa81700 1 -- 172.21.15.59:0/2611808535 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36740747f0 con 0x7f3674138d80 2023-09-30T22:35:09.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.640+0000 7f36717fa700 1 -- 172.21.15.59:0/2611808535 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3664015070 con 0x7f3674138d80 2023-09-30T22:35:09.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.668+0000 7f3a89747700 1 Processor -- start 2023-09-30T22:35:09.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.668+0000 7f3a89747700 1 -- start start 2023-09-30T22:35:09.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.668+0000 7f3a89747700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a8409d6f0 0x7f3a8409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:09.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.668+0000 7f3a89747700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8409ace0 0x7f3a8409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:09.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.668+0000 7f3a89747700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a841339f0 0x7f3a84133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:09.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.668+0000 7f3a89747700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8409b150 con 0x7f3a8409d6f0 2023-09-30T22:35:09.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.668+0000 7f3a89747700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8409a500 con 0x7f3a841339f0 2023-09-30T22:35:09.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.668+0000 7f3a89747700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8409e540 con 0x7f3a8409ace0 2023-09-30T22:35:09.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a82ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a8409d6f0 0x7f3a8409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:09.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a837fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a841339f0 0x7f3a84133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:09.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a827fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8409ace0 0x7f3a8409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:09.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a82ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a8409d6f0 0x7f3a8409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45306/0 (socket says 172.21.15.59:45306) 2023-09-30T22:35:09.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a82ffd700 1 -- 172.21.15.59:0/1106550365 learned_addr learned my addr 172.21.15.59:0/1106550365 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:09.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a827fc700 1 -- 172.21.15.59:0/1106550365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a841339f0 msgr2=0x7f3a84133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:09.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a827fc700 1 --2- 172.21.15.59:0/1106550365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a841339f0 0x7f3a84133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a827fc700 1 -- 172.21.15.59:0/1106550365 >> v2:172.21.15.59:3300/0 conn(0x7f3a8409d6f0 msgr2=0x7f3a8409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:09.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a827fc700 1 --2- 172.21.15.59:0/1106550365 >> v2:172.21.15.59:3300/0 conn(0x7f3a8409d6f0 0x7f3a8409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a827fc700 1 -- 172.21.15.59:0/1106550365 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8409f720 con 0x7f3a8409ace0 2023-09-30T22:35:09.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a82ffd700 1 --2- 172.21.15.59:0/1106550365 >> v2:172.21.15.59:3300/0 conn(0x7f3a8409d6f0 0x7f3a8409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:09.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a837fe700 1 --2- 172.21.15.59:0/1106550365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a841339f0 0x7f3a84133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:09.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a827fc700 1 --2- 172.21.15.59:0/1106550365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8409ace0 0x7f3a8409e000 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009840 tx=0x7f3a78009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c64d7c1978ea47c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:09.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a81ffb700 1 -- 172.21.15.59:0/1106550365 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78011830 con 0x7f3a8409ace0 2023-09-30T22:35:09.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a81ffb700 1 -- 172.21.15.59:0/1106550365 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a78011990 con 0x7f3a8409ace0 2023-09-30T22:35:09.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.669+0000 7f3a81ffb700 1 -- 172.21.15.59:0/1106550365 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78011d20 con 0x7f3a8409ace0 2023-09-30T22:35:09.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.670+0000 7f3a89747700 1 -- 172.21.15.59:0/1106550365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8409ace0 msgr2=0x7f3a8409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:09.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.670+0000 7f3a89747700 1 --2- 172.21.15.59:0/1106550365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8409ace0 0x7f3a8409e000 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009840 tx=0x7f3a78009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:09.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.670+0000 7f3a89747700 1 -- 172.21.15.59:0/1106550365 shutdown_connections 2023-09-30T22:35:09.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.670+0000 7f3a89747700 1 --2- 172.21.15.59:0/1106550365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a841339f0 0x7f3a84133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.670+0000 7f3a89747700 1 --2- 172.21.15.59:0/1106550365 >> v2:172.21.15.59:3300/0 conn(0x7f3a8409d6f0 0x7f3a8409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.670+0000 7f3a89747700 1 --2- 172.21.15.59:0/1106550365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8409ace0 0x7f3a8409e000 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.670+0000 7f3a89747700 1 -- 172.21.15.59:0/1106550365 >> 172.21.15.59:0/1106550365 conn(0x7f3a84066f50 msgr2=0x7f3a8409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:09.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.670+0000 7f3a89747700 1 -- 172.21.15.59:0/1106550365 shutdown_connections 2023-09-30T22:35:09.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.670+0000 7f3a89747700 1 -- 172.21.15.59:0/1106550365 wait complete. 2023-09-30T22:35:09.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.671+0000 7f3a89747700 1 Processor -- start 2023-09-30T22:35:09.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.671+0000 7f3a89747700 1 -- start start 2023-09-30T22:35:09.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a89747700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8409ace0 0x7f3a8411f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:09.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a89747700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8409d6f0 0x7f3a8411fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:09.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a89747700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a841339f0 0x7f3a841c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:09.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a89747700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84122290 con 0x7f3a8409ace0 2023-09-30T22:35:09.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a89747700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84121360 con 0x7f3a841339f0 2023-09-30T22:35:09.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a89747700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a841333e0 con 0x7f3a8409d6f0 2023-09-30T22:35:09.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a827fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8409d6f0 0x7f3a8411fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:09.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a82ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8409ace0 0x7f3a8411f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:09.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a827fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8409d6f0 0x7f3a8411fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52982/0 (socket says 172.21.15.59:52982) 2023-09-30T22:35:09.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a827fc700 1 -- 172.21.15.59:0/676997014 learned_addr learned my addr 172.21.15.59:0/676997014 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:09.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a82ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8409ace0 0x7f3a8411f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45310/0 (socket says 172.21.15.59:45310) 2023-09-30T22:35:09.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a837fe700 1 --2- 172.21.15.59:0/676997014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a841339f0 0x7f3a841c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:09.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a827fc700 1 -- 172.21.15.59:0/676997014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a841339f0 msgr2=0x7f3a841c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:09.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a827fc700 1 --2- 172.21.15.59:0/676997014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a841339f0 0x7f3a841c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a827fc700 1 -- 172.21.15.59:0/676997014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8409ace0 msgr2=0x7f3a8411f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:09.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a827fc700 1 --2- 172.21.15.59:0/676997014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8409ace0 0x7f3a8411f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a827fc700 1 -- 172.21.15.59:0/676997014 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a74009550 con 0x7f3a8409d6f0 2023-09-30T22:35:09.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a837fe700 1 --2- 172.21.15.59:0/676997014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a841339f0 0x7f3a841c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:09.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.672+0000 7f3a82ffd700 1 --2- 172.21.15.59:0/676997014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8409ace0 0x7f3a8411f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:09.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.673+0000 7f3a827fc700 1 --2- 172.21.15.59:0/676997014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8409d6f0 0x7f3a8411fb20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3a78000c00 tx=0x7f3a78004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:09.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.673+0000 7f3a6b7fe700 1 -- 172.21.15.59:0/676997014 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78004240 con 0x7f3a8409d6f0 2023-09-30T22:35:09.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.673+0000 7f3a6b7fe700 1 -- 172.21.15.59:0/676997014 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7801f070 con 0x7f3a8409d6f0 2023-09-30T22:35:09.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.673+0000 7f3a89747700 1 -- 172.21.15.59:0/676997014 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7c009a70 con 0x7f3a8409d6f0 2023-09-30T22:35:09.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.673+0000 7f3a6b7fe700 1 -- 172.21.15.59:0/676997014 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a780045e0 con 0x7f3a8409d6f0 2023-09-30T22:35:09.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.673+0000 7f3a89747700 1 -- 172.21.15.59:0/676997014 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a780094a0 con 0x7f3a8409d6f0 2023-09-30T22:35:09.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.674+0000 7f3a6b7fe700 1 -- 172.21.15.59:0/676997014 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a78021030 con 0x7f3a8409d6f0 2023-09-30T22:35:09.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.674+0000 7f3a6b7fe700 1 -- 172.21.15.59:0/676997014 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3a780404e0 con 0x7f3a8409d6f0 2023-09-30T22:35:09.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.674+0000 7f3a89747700 1 -- 172.21.15.59:0/676997014 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a840747f0 con 0x7f3a8409d6f0 2023-09-30T22:35:09.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.679+0000 7f3a6b7fe700 1 -- 172.21.15.59:0/676997014 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a7801a450 con 0x7f3a8409d6f0 2023-09-30T22:35:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.845+0000 7f367aa81700 1 -- 172.21.15.59:0/2611808535 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3674072980 con 0x7f3674138d80 2023-09-30T22:35:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.846+0000 7f36717fa700 1 -- 172.21.15.59:0/2611808535 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f36640199a0 con 0x7f3674138d80 2023-09-30T22:35:09.846 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.848+0000 7f367aa81700 1 -- 172.21.15.59:0/2611808535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3674138d80 msgr2=0x7f3674134460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.848+0000 7f367aa81700 1 --2- 172.21.15.59:0/2611808535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3674138d80 0x7f3674134460 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f36740a1fb0 tx=0x7f3664004750 comp rx=0 tx=0).stop 2023-09-30T22:35:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.848+0000 7f367aa81700 1 -- 172.21.15.59:0/2611808535 shutdown_connections 2023-09-30T22:35:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.848+0000 7f367aa81700 1 --2- 172.21.15.59:0/2611808535 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f367409d630 0x7f36741339e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.848+0000 7f367aa81700 1 --2- 172.21.15.59:0/2611808535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3674138d80 0x7f3674134460 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.848+0000 7f367aa81700 1 --2- 172.21.15.59:0/2611808535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36740a0a30 0x7f3674133f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.848+0000 7f367aa81700 1 -- 172.21.15.59:0/2611808535 >> 172.21.15.59:0/2611808535 conn(0x7f36740a3050 msgr2=0x7f367409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.848+0000 7f367aa81700 1 -- 172.21.15.59:0/2611808535 shutdown_connections 2023-09-30T22:35:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.848+0000 7f367aa81700 1 -- 172.21.15.59:0/2611808535 wait complete. 2023-09-30T22:35:09.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:09.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.886+0000 7f3a89747700 1 -- 172.21.15.59:0/676997014 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3a841337d0 con 0x7f3a8409d6f0 2023-09-30T22:35:09.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.886+0000 7f3a6b7fe700 1 -- 172.21.15.59:0/676997014 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a78015020 con 0x7f3a8409d6f0 2023-09-30T22:35:09.887 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:09.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.888+0000 7f3a89747700 1 -- 172.21.15.59:0/676997014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8409d6f0 msgr2=0x7f3a8411fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:09.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.888+0000 7f3a89747700 1 --2- 172.21.15.59:0/676997014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8409d6f0 0x7f3a8411fb20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3a78000c00 tx=0x7f3a78004750 comp rx=0 tx=0).stop 2023-09-30T22:35:09.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.889+0000 7f3a89747700 1 -- 172.21.15.59:0/676997014 shutdown_connections 2023-09-30T22:35:09.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.889+0000 7f3a89747700 1 --2- 172.21.15.59:0/676997014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a841339f0 0x7f3a841c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.889+0000 7f3a89747700 1 --2- 172.21.15.59:0/676997014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8409ace0 0x7f3a8411f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.889+0000 7f3a89747700 1 --2- 172.21.15.59:0/676997014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8409d6f0 0x7f3a8411fb20 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:09.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.889+0000 7f3a89747700 1 -- 172.21.15.59:0/676997014 >> 172.21.15.59:0/676997014 conn(0x7f3a84066f50 msgr2=0x7f3a840a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:09.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.889+0000 7f3a89747700 1 -- 172.21.15.59:0/676997014 shutdown_connections 2023-09-30T22:35:09.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:09.889+0000 7f3a89747700 1 -- 172.21.15.59:0/676997014 wait complete. 2023-09-30T22:35:09.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:09.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:09.970 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:10.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.087+0000 7f7af7756700 1 Processor -- start 2023-09-30T22:35:10.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.087+0000 7f7af7756700 1 -- start start 2023-09-30T22:35:10.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7af7756700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7af009d630 0x7f7af00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:10.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7af7756700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af0138d80 0x7f7af013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:10.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7af7756700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af00a2a70 con 0x7f7af00a0a30 2023-09-30T22:35:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7af7756700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af00a01d0 con 0x7f7af009d630 2023-09-30T22:35:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7af7756700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af009e2b0 con 0x7f7af0138d80 2023-09-30T22:35:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7af4cf1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7af009d630 0x7f7af00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7af5cf3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af0138d80 0x7f7af013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7af4cf1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7af009d630 0x7f7af00a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45326/0 (socket says 172.21.15.59:45326) 2023-09-30T22:35:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7af4cf1700 1 -- 172.21.15.59:0/1744672846 learned_addr learned my addr 172.21.15.59:0/1744672846 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7af5cf3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af0138d80 0x7f7af013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41006/0 (socket says 172.21.15.59:41006) 2023-09-30T22:35:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7af5cf3700 1 -- 172.21.15.59:0/1744672846 >> v2:172.21.15.59:3300/0 conn(0x7f7af009d630 msgr2=0x7f7af00a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:10.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7af5cf3700 1 --2- 172.21.15.59:0/1744672846 >> v2:172.21.15.59:3300/0 conn(0x7f7af009d630 0x7f7af00a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7af5cf3700 1 -- 172.21.15.59:0/1744672846 >> v1:172.21.15.59:6789/0 conn(0x7f7af00a0a30 legacy=0x7f7af00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7aeffff700 1 -- 172.21.15.59:0/1744672846 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325695113 0 0) 0x7f7af00a2a70 con 0x7f7af00a0a30 2023-09-30T22:35:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7af5cf3700 1 -- 172.21.15.59:0/1744672846 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af009dc50 con 0x7f7af0138d80 2023-09-30T22:35:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.088+0000 7f7af4cf1700 1 --2- 172.21.15.59:0/1744672846 >> v2:172.21.15.59:3300/0 conn(0x7f7af009d630 0x7f7af00a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.089+0000 7f7af5cf3700 1 --2- 172.21.15.59:0/1744672846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af0138d80 0x7f7af013b160 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8009840 tx=0x7f7ae8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae419630eed33d19 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.089+0000 7f7aeffff700 1 -- 172.21.15.59:0/1744672846 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8011830 con 0x7f7af0138d80 2023-09-30T22:35:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.089+0000 7f7aeffff700 1 -- 172.21.15.59:0/1744672846 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae8011990 con 0x7f7af0138d80 2023-09-30T22:35:10.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.089+0000 7f7aeffff700 1 -- 172.21.15.59:0/1744672846 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8011d20 con 0x7f7af0138d80 2023-09-30T22:35:10.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.090+0000 7f7af7756700 1 -- 172.21.15.59:0/1744672846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af0138d80 msgr2=0x7f7af013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:10.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.090+0000 7f7af7756700 1 --2- 172.21.15.59:0/1744672846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af0138d80 0x7f7af013b160 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8009840 tx=0x7f7ae8009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:10.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.090+0000 7f7af7756700 1 -- 172.21.15.59:0/1744672846 shutdown_connections 2023-09-30T22:35:10.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.090+0000 7f7af7756700 1 --2- 172.21.15.59:0/1744672846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af0138d80 0x7f7af013b160 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.090+0000 7f7af7756700 1 --2- 172.21.15.59:0/1744672846 >> v2:172.21.15.59:3300/0 conn(0x7f7af009d630 0x7f7af00a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.090+0000 7f7af7756700 1 -- 172.21.15.59:0/1744672846 >> 172.21.15.59:0/1744672846 conn(0x7f7af00a3050 msgr2=0x7f7af00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:10.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.090+0000 7f7af7756700 1 -- 172.21.15.59:0/1744672846 shutdown_connections 2023-09-30T22:35:10.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.090+0000 7f7af7756700 1 -- 172.21.15.59:0/1744672846 wait complete. 2023-09-30T22:35:10.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.091+0000 7f7af7756700 1 Processor -- start 2023-09-30T22:35:10.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.091+0000 7f7af7756700 1 -- start start 2023-09-30T22:35:10.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.091+0000 7f7af7756700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af009d630 0x7f7af0133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:10.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.091+0000 7f7af7756700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af00a0a30 0x7f7af0133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:10.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.091+0000 7f7af7756700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af0138d80 0x7f7af0134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:10.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.091+0000 7f7af7756700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af0137180 con 0x7f7af009d630 2023-09-30T22:35:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.091+0000 7f7af7756700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af0136070 con 0x7f7af00a0a30 2023-09-30T22:35:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.091+0000 7f7af7756700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7af0136530 con 0x7f7af0138d80 2023-09-30T22:35:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.091+0000 7f7af54f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af009d630 0x7f7af0133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.091+0000 7f7af54f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af009d630 0x7f7af0133700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45330/0 (socket says 172.21.15.59:45330) 2023-09-30T22:35:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.091+0000 7f7af54f2700 1 -- 172.21.15.59:0/223094345 learned_addr learned my addr 172.21.15.59:0/223094345 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.091+0000 7f7af4cf1700 1 --2- 172.21.15.59:0/223094345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af00a0a30 0x7f7af0133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.092+0000 7f7af5cf3700 1 --2- 172.21.15.59:0/223094345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af0138d80 0x7f7af0134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.092+0000 7f7af4cf1700 1 -- 172.21.15.59:0/223094345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af0138d80 msgr2=0x7f7af0134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.092+0000 7f7af4cf1700 1 --2- 172.21.15.59:0/223094345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af0138d80 0x7f7af0134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.092+0000 7f7af4cf1700 1 -- 172.21.15.59:0/223094345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af009d630 msgr2=0x7f7af0133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.092+0000 7f7af4cf1700 1 --2- 172.21.15.59:0/223094345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af009d630 0x7f7af0133700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.092+0000 7f7af4cf1700 1 -- 172.21.15.59:0/223094345 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4009550 con 0x7f7af00a0a30 2023-09-30T22:35:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.092+0000 7f7af54f2700 1 --2- 172.21.15.59:0/223094345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af009d630 0x7f7af0133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.092+0000 7f7af4cf1700 1 --2- 172.21.15.59:0/223094345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af00a0a30 0x7f7af0133c40 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400e9a0 tx=0x7f7ae400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.092+0000 7f7aedffb700 1 -- 172.21.15.59:0/223094345 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4004030 con 0x7f7af00a0a30 2023-09-30T22:35:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.092+0000 7f7aedffb700 1 -- 172.21.15.59:0/223094345 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae4004190 con 0x7f7af00a0a30 2023-09-30T22:35:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.092+0000 7f7af7756700 1 -- 172.21.15.59:0/223094345 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae80094a0 con 0x7f7af00a0a30 2023-09-30T22:35:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.092+0000 7f7aedffb700 1 -- 172.21.15.59:0/223094345 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4004520 con 0x7f7af00a0a30 2023-09-30T22:35:10.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.093+0000 7f7af7756700 1 -- 172.21.15.59:0/223094345 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af0136be0 con 0x7f7af00a0a30 2023-09-30T22:35:10.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.093+0000 7f7aedffb700 1 -- 172.21.15.59:0/223094345 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ae40036a0 con 0x7f7af00a0a30 2023-09-30T22:35:10.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.093+0000 7f7aedffb700 1 -- 172.21.15.59:0/223094345 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7ae403f8e0 con 0x7f7af00a0a30 2023-09-30T22:35:10.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.093+0000 7f7af7756700 1 -- 172.21.15.59:0/223094345 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af0137d60 con 0x7f7af00a0a30 2023-09-30T22:35:10.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.098+0000 7f7aedffb700 1 -- 172.21.15.59:0/223094345 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ae4011db0 con 0x7f7af00a0a30 2023-09-30T22:35:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.128+0000 7f7641c78700 1 Processor -- start 2023-09-30T22:35:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.129+0000 7f7641c78700 1 -- start start 2023-09-30T22:35:10.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.129+0000 7f7641c78700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f763c0a0a30 0x7f763c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:10.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.129+0000 7f7641c78700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f763c09d630 0x7f763c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:10.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.129+0000 7f7641c78700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763c0a2a70 con 0x7f763c133930 2023-09-30T22:35:10.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.129+0000 7f7641c78700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c0a01d0 con 0x7f763c09d630 2023-09-30T22:35:10.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.129+0000 7f7641c78700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f763c09e2b0 con 0x7f763c0a0a30 2023-09-30T22:35:10.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.130+0000 7f763b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f763c0a0a30 0x7f763c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:10.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.130+0000 7f763affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f763c09d630 0x7f763c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:10.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.130+0000 7f763bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f763c133930 0x7f763c133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39920/0 (socket says 172.21.15.59:39920) 2023-09-30T22:35:10.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.130+0000 7f763bfff700 1 -- 172.21.15.59:0/1478677333 learned_addr learned my addr 172.21.15.59:0/1478677333 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:10.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.130+0000 7f763b7fe700 1 -- 172.21.15.59:0/1478677333 >> v2:172.21.15.59:3300/0 conn(0x7f763c09d630 msgr2=0x7f763c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:10.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.130+0000 7f763b7fe700 1 --2- 172.21.15.59:0/1478677333 >> v2:172.21.15.59:3300/0 conn(0x7f763c09d630 0x7f763c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.130+0000 7f763b7fe700 1 -- 172.21.15.59:0/1478677333 >> v1:172.21.15.59:6789/0 conn(0x7f763c133930 legacy=0x7f763c133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:10.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.130+0000 7f763b7fe700 1 -- 172.21.15.59:0/1478677333 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c09dc50 con 0x7f763c0a0a30 2023-09-30T22:35:10.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.130+0000 7f763affd700 1 --2- 172.21.15.59:0/1478677333 >> v2:172.21.15.59:3300/0 conn(0x7f763c09d630 0x7f763c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:10.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.130+0000 7f763b7fe700 1 --2- 172.21.15.59:0/1478677333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f763c0a0a30 0x7f763c0a0e00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7634009d90 tx=0x7f763400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a652b189e4c3660a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:10.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.130+0000 7f763a7fc700 1 -- 172.21.15.59:0/1478677333 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763400e070 con 0x7f763c0a0a30 2023-09-30T22:35:10.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.130+0000 7f763a7fc700 1 -- 172.21.15.59:0/1478677333 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763400bb20 con 0x7f763c0a0a30 2023-09-30T22:35:10.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.130+0000 7f763a7fc700 1 -- 172.21.15.59:0/1478677333 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634012430 con 0x7f763c0a0a30 2023-09-30T22:35:10.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.131+0000 7f7641c78700 1 -- 172.21.15.59:0/1478677333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f763c0a0a30 msgr2=0x7f763c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:10.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.131+0000 7f7641c78700 1 --2- 172.21.15.59:0/1478677333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f763c0a0a30 0x7f763c0a0e00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7634009d90 tx=0x7f763400b330 comp rx=0 tx=0).stop 2023-09-30T22:35:10.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.131+0000 7f7641c78700 1 -- 172.21.15.59:0/1478677333 shutdown_connections 2023-09-30T22:35:10.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.131+0000 7f7641c78700 1 --2- 172.21.15.59:0/1478677333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f763c0a0a30 0x7f763c0a0e00 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.131+0000 7f7641c78700 1 --2- 172.21.15.59:0/1478677333 >> v2:172.21.15.59:3300/0 conn(0x7f763c09d630 0x7f763c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.131+0000 7f7641c78700 1 -- 172.21.15.59:0/1478677333 >> 172.21.15.59:0/1478677333 conn(0x7f763c0a3050 msgr2=0x7f763c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:10.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.131+0000 7f7641c78700 1 -- 172.21.15.59:0/1478677333 shutdown_connections 2023-09-30T22:35:10.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.131+0000 7f7641c78700 1 -- 172.21.15.59:0/1478677333 wait complete. 2023-09-30T22:35:10.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.132+0000 7f7641c78700 1 Processor -- start 2023-09-30T22:35:10.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.132+0000 7f7641c78700 1 -- start start 2023-09-30T22:35:10.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f7641c78700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f763c09d630 0x7f763c1c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:10.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f7641c78700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f763c0a0a30 0x7f763c1c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:10.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f7641c78700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f763c133930 0x7f763c1c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:10.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f7641c78700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c120670 con 0x7f763c133930 2023-09-30T22:35:10.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f7641c78700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c121e60 con 0x7f763c09d630 2023-09-30T22:35:10.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f7641c78700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0a0410 con 0x7f763c0a0a30 2023-09-30T22:35:10.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f763affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f763c0a0a30 0x7f763c1c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:10.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f763b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f763c09d630 0x7f763c1c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:10.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f763b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f763c09d630 0x7f763c1c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41020/0 (socket says 172.21.15.59:41020) 2023-09-30T22:35:10.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f763affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f763c0a0a30 0x7f763c1c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53004/0 (socket says 172.21.15.59:53004) 2023-09-30T22:35:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f763b7fe700 1 -- 172.21.15.59:0/2866289770 learned_addr learned my addr 172.21.15.59:0/2866289770 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f763bfff700 1 --2- 172.21.15.59:0/2866289770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f763c133930 0x7f763c1c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f763b7fe700 1 -- 172.21.15.59:0/2866289770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f763c0a0a30 msgr2=0x7f763c1c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f763b7fe700 1 --2- 172.21.15.59:0/2866289770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f763c0a0a30 0x7f763c1c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f763b7fe700 1 -- 172.21.15.59:0/2866289770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f763c133930 msgr2=0x7f763c1c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f763b7fe700 1 --2- 172.21.15.59:0/2866289770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f763c133930 0x7f763c1c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f763b7fe700 1 -- 172.21.15.59:0/2866289770 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76240094a0 con 0x7f763c09d630 2023-09-30T22:35:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.133+0000 7f763affd700 1 --2- 172.21.15.59:0/2866289770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f763c0a0a30 0x7f763c1c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:10.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.134+0000 7f763b7fe700 1 --2- 172.21.15.59:0/2866289770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f763c09d630 0x7f763c1c8170 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7634014040 tx=0x7f7634004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:10.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.134+0000 7f7633fff700 1 -- 172.21.15.59:0/2866289770 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634012430 con 0x7f763c09d630 2023-09-30T22:35:10.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.134+0000 7f7633fff700 1 -- 172.21.15.59:0/2866289770 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7634020070 con 0x7f763c09d630 2023-09-30T22:35:10.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.134+0000 7f7641c78700 1 -- 172.21.15.59:0/2866289770 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7634009a70 con 0x7f763c09d630 2023-09-30T22:35:10.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.134+0000 7f7633fff700 1 -- 172.21.15.59:0/2866289770 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634004280 con 0x7f763c09d630 2023-09-30T22:35:10.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.134+0000 7f7641c78700 1 -- 172.21.15.59:0/2866289770 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763c121160 con 0x7f763c09d630 2023-09-30T22:35:10.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.135+0000 7f7641c78700 1 -- 172.21.15.59:0/2866289770 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763c0747f0 con 0x7f763c09d630 2023-09-30T22:35:10.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.135+0000 7f7633fff700 1 -- 172.21.15.59:0/2866289770 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f76340043e0 con 0x7f763c09d630 2023-09-30T22:35:10.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.135+0000 7f7633fff700 1 -- 172.21.15.59:0/2866289770 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7634022070 con 0x7f763c09d630 2023-09-30T22:35:10.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.140+0000 7f7633fff700 1 -- 172.21.15.59:0/2866289770 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76340317b0 con 0x7f763c09d630 2023-09-30T22:35:10.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.330+0000 7f7af7756700 1 -- 172.21.15.59:0/223094345 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7af00747f0 con 0x7f7af00a0a30 2023-09-30T22:35:10.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.330+0000 7f7aedffb700 1 -- 172.21.15.59:0/223094345 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ae4020020 con 0x7f7af00a0a30 2023-09-30T22:35:10.331 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.333+0000 7f7af7756700 1 -- 172.21.15.59:0/223094345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af00a0a30 msgr2=0x7f7af0133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.333+0000 7f7af7756700 1 --2- 172.21.15.59:0/223094345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af00a0a30 0x7f7af0133c40 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400e9a0 tx=0x7f7ae400ecb0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.333+0000 7f7af7756700 1 -- 172.21.15.59:0/223094345 shutdown_connections 2023-09-30T22:35:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.333+0000 7f7af7756700 1 --2- 172.21.15.59:0/223094345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af0138d80 0x7f7af0134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.333+0000 7f7af7756700 1 --2- 172.21.15.59:0/223094345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af009d630 0x7f7af0133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.333+0000 7f7af7756700 1 --2- 172.21.15.59:0/223094345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af00a0a30 0x7f7af0133c40 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.333+0000 7f7af7756700 1 -- 172.21.15.59:0/223094345 >> 172.21.15.59:0/223094345 conn(0x7f7af00a3050 msgr2=0x7f7af009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.333+0000 7f7af7756700 1 -- 172.21.15.59:0/223094345 shutdown_connections 2023-09-30T22:35:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.333+0000 7f7af7756700 1 -- 172.21.15.59:0/223094345 wait complete. 2023-09-30T22:35:10.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.372+0000 7f7641c78700 1 -- 172.21.15.59:0/2866289770 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f763c072980 con 0x7f763c09d630 2023-09-30T22:35:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.372+0000 7f7633fff700 1 -- 172.21.15.59:0/2866289770 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f763402c020 con 0x7f763c09d630 2023-09-30T22:35:10.373 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.375+0000 7f7641c78700 1 -- 172.21.15.59:0/2866289770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f763c09d630 msgr2=0x7f763c1c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.375+0000 7f7641c78700 1 --2- 172.21.15.59:0/2866289770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f763c09d630 0x7f763c1c8170 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7634014040 tx=0x7f7634004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.375+0000 7f7641c78700 1 -- 172.21.15.59:0/2866289770 shutdown_connections 2023-09-30T22:35:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.375+0000 7f7641c78700 1 --2- 172.21.15.59:0/2866289770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f763c133930 0x7f763c1c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.375+0000 7f7641c78700 1 --2- 172.21.15.59:0/2866289770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f763c09d630 0x7f763c1c8170 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.375+0000 7f7641c78700 1 --2- 172.21.15.59:0/2866289770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f763c0a0a30 0x7f763c1c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.375+0000 7f7641c78700 1 -- 172.21.15.59:0/2866289770 >> 172.21.15.59:0/2866289770 conn(0x7f763c0a3050 msgr2=0x7f763c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.375+0000 7f7641c78700 1 -- 172.21.15.59:0/2866289770 shutdown_connections 2023-09-30T22:35:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:10.375+0000 7f7641c78700 1 -- 172.21.15.59:0/2866289770 wait complete. 2023-09-30T22:35:10.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:10.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:10.904 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:11.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.011+0000 7f797ddfd700 1 Processor -- start 2023-09-30T22:35:11.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.011+0000 7f797ddfd700 1 -- start start 2023-09-30T22:35:11.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.012+0000 7f797ddfd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79780a0a30 0x7f79780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.012+0000 7f797ddfd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79780a1340 0x7f7978133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.012+0000 7f797ddfd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797809edd0 con 0x7f7978133fa0 2023-09-30T22:35:11.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.012+0000 7f797ddfd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797809e1f0 con 0x7f79780a1340 2023-09-30T22:35:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.012+0000 7f797ddfd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f797809dc50 con 0x7f79780a0a30 2023-09-30T22:35:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.012+0000 7f796effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79780a1340 0x7f7978133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.012+0000 7f79777fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79780a0a30 0x7f79780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.012+0000 7f796effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79780a1340 0x7f7978133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45352/0 (socket says 172.21.15.59:45352) 2023-09-30T22:35:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.012+0000 7f796effd700 1 -- 172.21.15.59:0/422054800 learned_addr learned my addr 172.21.15.59:0/422054800 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.013+0000 7f796effd700 1 -- 172.21.15.59:0/422054800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79780a0a30 msgr2=0x7f79780a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.013+0000 7f796effd700 1 --2- 172.21.15.59:0/422054800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79780a0a30 0x7f79780a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.013+0000 7f796effd700 1 -- 172.21.15.59:0/422054800 >> v1:172.21.15.59:6789/0 conn(0x7f7978133fa0 legacy=0x7f797813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.013+0000 7f796effd700 1 -- 172.21.15.59:0/422054800 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79780a1fe0 con 0x7f79780a1340 2023-09-30T22:35:11.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.013+0000 7f79777fe700 1 --2- 172.21.15.59:0/422054800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79780a0a30 0x7f79780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:11.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.013+0000 7f796effd700 1 --2- 172.21.15.59:0/422054800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79780a1340 0x7f7978133a60 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f79600098f0 tx=0x7f7960009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f461b92fa606a30a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:11.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.013+0000 7f7976ffd700 1 -- 172.21.15.59:0/422054800 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960011830 con 0x7f79780a1340 2023-09-30T22:35:11.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.013+0000 7f7976ffd700 1 -- 172.21.15.59:0/422054800 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7960011990 con 0x7f79780a1340 2023-09-30T22:35:11.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.013+0000 7f7976ffd700 1 -- 172.21.15.59:0/422054800 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960011d20 con 0x7f79780a1340 2023-09-30T22:35:11.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.014+0000 7f797ddfd700 1 -- 172.21.15.59:0/422054800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79780a1340 msgr2=0x7f7978133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.014+0000 7f797ddfd700 1 --2- 172.21.15.59:0/422054800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79780a1340 0x7f7978133a60 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f79600098f0 tx=0x7f7960009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:11.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.014+0000 7f797ddfd700 1 -- 172.21.15.59:0/422054800 shutdown_connections 2023-09-30T22:35:11.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.014+0000 7f797ddfd700 1 --2- 172.21.15.59:0/422054800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79780a0a30 0x7f79780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.014+0000 7f797ddfd700 1 --2- 172.21.15.59:0/422054800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79780a1340 0x7f7978133a60 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.014+0000 7f797ddfd700 1 -- 172.21.15.59:0/422054800 >> 172.21.15.59:0/422054800 conn(0x7f79780a6550 msgr2=0x7f79780a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:11.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.014+0000 7f797ddfd700 1 -- 172.21.15.59:0/422054800 shutdown_connections 2023-09-30T22:35:11.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.014+0000 7f797ddfd700 1 -- 172.21.15.59:0/422054800 wait complete. 2023-09-30T22:35:11.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.015+0000 7f797ddfd700 1 Processor -- start 2023-09-30T22:35:11.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.015+0000 7f797ddfd700 1 -- start start 2023-09-30T22:35:11.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.015+0000 7f797ddfd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79780a0a30 0x7f79781c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.015+0000 7f797ddfd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79780a1340 0x7f79781c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.015+0000 7f797ddfd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7978133fa0 0x7f79781c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.015+0000 7f797ddfd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79781206b0 con 0x7f79780a0a30 2023-09-30T22:35:11.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.015+0000 7f797ddfd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7978121ea0 con 0x7f7978133fa0 2023-09-30T22:35:11.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.015+0000 7f797ddfd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79780a0220 con 0x7f79780a1340 2023-09-30T22:35:11.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f79777fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79780a0a30 0x7f79781c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f79777fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79780a0a30 0x7f79781c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45360/0 (socket says 172.21.15.59:45360) 2023-09-30T22:35:11.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f79777fe700 1 -- 172.21.15.59:0/1201486615 learned_addr learned my addr 172.21.15.59:0/1201486615 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:11.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f7977fff700 1 --2- 172.21.15.59:0/1201486615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7978133fa0 0x7f79781c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f796effd700 1 --2- 172.21.15.59:0/1201486615 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79780a1340 0x7f79781c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f79777fe700 1 -- 172.21.15.59:0/1201486615 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79780a1340 msgr2=0x7f79781c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f79777fe700 1 --2- 172.21.15.59:0/1201486615 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79780a1340 0x7f79781c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f79777fe700 1 -- 172.21.15.59:0/1201486615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7978133fa0 msgr2=0x7f79781c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f79777fe700 1 --2- 172.21.15.59:0/1201486615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7978133fa0 0x7f79781c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f79777fe700 1 -- 172.21.15.59:0/1201486615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680094a0 con 0x7f79780a0a30 2023-09-30T22:35:11.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f79777fe700 1 --2- 172.21.15.59:0/1201486615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79780a0a30 0x7f79781c8530 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f796800ebe0 tx=0x7f796800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:11.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f7974ff9700 1 -- 172.21.15.59:0/1201486615 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796800c850 con 0x7f79780a0a30 2023-09-30T22:35:11.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f7974ff9700 1 -- 172.21.15.59:0/1201486615 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796800c9b0 con 0x7f79780a0a30 2023-09-30T22:35:11.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f797ddfd700 1 -- 172.21.15.59:0/1201486615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7960009550 con 0x7f79780a0a30 2023-09-30T22:35:11.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f7974ff9700 1 -- 172.21.15.59:0/1201486615 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796800cd40 con 0x7f79780a0a30 2023-09-30T22:35:11.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.016+0000 7f797ddfd700 1 -- 172.21.15.59:0/1201486615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79781211a0 con 0x7f79780a0a30 2023-09-30T22:35:11.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.017+0000 7f7974ff9700 1 -- 172.21.15.59:0/1201486615 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7968013470 con 0x7f79780a0a30 2023-09-30T22:35:11.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.017+0000 7f7974ff9700 1 -- 172.21.15.59:0/1201486615 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f796803f910 con 0x7f79780a0a30 2023-09-30T22:35:11.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.017+0000 7f797ddfd700 1 -- 172.21.15.59:0/1201486615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7978074ea0 con 0x7f79780a0a30 2023-09-30T22:35:11.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.022+0000 7f7974ff9700 1 -- 172.21.15.59:0/1201486615 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7968013720 con 0x7f79780a0a30 2023-09-30T22:35:11.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.050+0000 7f282c88a700 1 Processor -- start 2023-09-30T22:35:11.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.050+0000 7f282c88a700 1 -- start start 2023-09-30T22:35:11.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.050+0000 7f282c88a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28280a0a30 0x7f28280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.050+0000 7f282c88a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f282809d630 0x7f28280a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.050+0000 7f282c88a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28280a2a70 con 0x7f2828133930 2023-09-30T22:35:11.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.050+0000 7f282c88a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28280a01d0 con 0x7f282809d630 2023-09-30T22:35:11.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.050+0000 7f282c88a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f282809e2b0 con 0x7f28280a0a30 2023-09-30T22:35:11.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f282659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28280a0a30 0x7f28280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f2825d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f282809d630 0x7f28280a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f2826d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2828133930 0x7f2828133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39928/0 (socket says 172.21.15.59:39928) 2023-09-30T22:35:11.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f282659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28280a0a30 0x7f28280a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53020/0 (socket says 172.21.15.59:53020) 2023-09-30T22:35:11.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f2825d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f282809d630 0x7f28280a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45364/0 (socket says 172.21.15.59:45364) 2023-09-30T22:35:11.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f2826d9d700 1 -- 172.21.15.59:0/1771102605 learned_addr learned my addr 172.21.15.59:0/1771102605 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:11.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f2825d9b700 1 -- 172.21.15.59:0/1771102605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28280a0a30 msgr2=0x7f28280a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:11.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f2825d9b700 1 --2- 172.21.15.59:0/1771102605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28280a0a30 0x7f28280a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f2825d9b700 1 -- 172.21.15.59:0/1771102605 >> v1:172.21.15.59:6789/0 conn(0x7f2828133930 legacy=0x7f2828133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f2825d9b700 1 -- 172.21.15.59:0/1771102605 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282809dc50 con 0x7f282809d630 2023-09-30T22:35:11.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f282559a700 1 -- 172.21.15.59:0/1771102605 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669325342 0 0) 0x7f28280a2a70 con 0x7f2828133930 2023-09-30T22:35:11.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f282659c700 1 --2- 172.21.15.59:0/1771102605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28280a0a30 0x7f28280a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:11.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f2825d9b700 1 --2- 172.21.15.59:0/1771102605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282809d630 0x7f28280a1340 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f281c009840 tx=0x7f281c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ac00b696164d7a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:11.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f282559a700 1 -- 172.21.15.59:0/1771102605 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c011830 con 0x7f282809d630 2023-09-30T22:35:11.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f282559a700 1 -- 172.21.15.59:0/1771102605 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c011990 con 0x7f282809d630 2023-09-30T22:35:11.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.051+0000 7f282559a700 1 -- 172.21.15.59:0/1771102605 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c011d20 con 0x7f282809d630 2023-09-30T22:35:11.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.052+0000 7f282c88a700 1 -- 172.21.15.59:0/1771102605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282809d630 msgr2=0x7f28280a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.052+0000 7f282c88a700 1 --2- 172.21.15.59:0/1771102605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282809d630 0x7f28280a1340 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f281c009840 tx=0x7f281c009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:11.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.052+0000 7f282c88a700 1 -- 172.21.15.59:0/1771102605 shutdown_connections 2023-09-30T22:35:11.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.052+0000 7f282c88a700 1 --2- 172.21.15.59:0/1771102605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28280a0a30 0x7f28280a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.052+0000 7f282c88a700 1 --2- 172.21.15.59:0/1771102605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282809d630 0x7f28280a1340 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.052+0000 7f282c88a700 1 -- 172.21.15.59:0/1771102605 >> 172.21.15.59:0/1771102605 conn(0x7f28280a3050 msgr2=0x7f28280a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:11.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.052+0000 7f282c88a700 1 -- 172.21.15.59:0/1771102605 shutdown_connections 2023-09-30T22:35:11.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.052+0000 7f282c88a700 1 -- 172.21.15.59:0/1771102605 wait complete. 2023-09-30T22:35:11.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.053+0000 7f282c88a700 1 Processor -- start 2023-09-30T22:35:11.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.054+0000 7f282c88a700 1 -- start start 2023-09-30T22:35:11.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.054+0000 7f282c88a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282809d630 0x7f28281c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.054+0000 7f282c88a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28280a0a30 0x7f28281c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.054+0000 7f282c88a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2828133930 0x7f28281c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.054+0000 7f282c88a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28281210e0 con 0x7f282809d630 2023-09-30T22:35:11.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.054+0000 7f282c88a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28281207f0 con 0x7f2828133930 2023-09-30T22:35:11.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.054+0000 7f282c88a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28281209e0 con 0x7f28280a0a30 2023-09-30T22:35:11.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.054+0000 7f2826d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2828133930 0x7f28281c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.054+0000 7f2825d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28280a0a30 0x7f28281c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.054+0000 7f2826d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2828133930 0x7f28281c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41030/0 (socket says 172.21.15.59:41030) 2023-09-30T22:35:11.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.054+0000 7f2825d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28280a0a30 0x7f28281c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53030/0 (socket says 172.21.15.59:53030) 2023-09-30T22:35:11.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.054+0000 7f2826d9d700 1 -- 172.21.15.59:0/4238728768 learned_addr learned my addr 172.21.15.59:0/4238728768 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:11.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.054+0000 7f282659c700 1 --2- 172.21.15.59:0/4238728768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282809d630 0x7f28281c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.055+0000 7f282659c700 1 -- 172.21.15.59:0/4238728768 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28280a0a30 msgr2=0x7f28281c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.055+0000 7f282659c700 1 --2- 172.21.15.59:0/4238728768 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28280a0a30 0x7f28281c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.055+0000 7f282659c700 1 -- 172.21.15.59:0/4238728768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2828133930 msgr2=0x7f28281c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.055+0000 7f282659c700 1 --2- 172.21.15.59:0/4238728768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2828133930 0x7f28281c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.055+0000 7f282659c700 1 -- 172.21.15.59:0/4238728768 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28180094a0 con 0x7f282809d630 2023-09-30T22:35:11.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.055+0000 7f2825d9b700 1 --2- 172.21.15.59:0/4238728768 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28280a0a30 0x7f28281c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:11.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.055+0000 7f2826d9d700 1 --2- 172.21.15.59:0/4238728768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2828133930 0x7f28281c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:11.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.055+0000 7f282659c700 1 --2- 172.21.15.59:0/4238728768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282809d630 0x7f28281c80b0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f281800e9e0 tx=0x7f281800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:11.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.055+0000 7f2816ffd700 1 -- 172.21.15.59:0/4238728768 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281800ee80 con 0x7f282809d630 2023-09-30T22:35:11.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.055+0000 7f2816ffd700 1 -- 172.21.15.59:0/4238728768 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281800c850 con 0x7f282809d630 2023-09-30T22:35:11.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.055+0000 7f282c88a700 1 -- 172.21.15.59:0/4238728768 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c0094a0 con 0x7f282809d630 2023-09-30T22:35:11.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.055+0000 7f2816ffd700 1 -- 172.21.15.59:0/4238728768 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281800cc00 con 0x7f282809d630 2023-09-30T22:35:11.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.055+0000 7f282c88a700 1 -- 172.21.15.59:0/4238728768 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28280a0410 con 0x7f282809d630 2023-09-30T22:35:11.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.056+0000 7f2816ffd700 1 -- 172.21.15.59:0/4238728768 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f281800cd60 con 0x7f282809d630 2023-09-30T22:35:11.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.056+0000 7f2816ffd700 1 -- 172.21.15.59:0/4238728768 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f281803f750 con 0x7f282809d630 2023-09-30T22:35:11.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.056+0000 7f282c88a700 1 -- 172.21.15.59:0/4238728768 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2828122380 con 0x7f282809d630 2023-09-30T22:35:11.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.061+0000 7f2816ffd700 1 -- 172.21.15.59:0/4238728768 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2818017020 con 0x7f282809d630 2023-09-30T22:35:11.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.240+0000 7f797ddfd700 1 -- 172.21.15.59:0/1201486615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f797809be80 con 0x7f79780a0a30 2023-09-30T22:35:11.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.240+0000 7f7974ff9700 1 -- 172.21.15.59:0/1201486615 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f796801b9c0 con 0x7f79780a0a30 2023-09-30T22:35:11.240 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:11.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.242+0000 7f797ddfd700 1 -- 172.21.15.59:0/1201486615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79780a0a30 msgr2=0x7f79781c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.242+0000 7f797ddfd700 1 --2- 172.21.15.59:0/1201486615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79780a0a30 0x7f79781c8530 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f796800ebe0 tx=0x7f796800eef0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.242+0000 7f797ddfd700 1 -- 172.21.15.59:0/1201486615 shutdown_connections 2023-09-30T22:35:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.242+0000 7f797ddfd700 1 --2- 172.21.15.59:0/1201486615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7978133fa0 0x7f79781c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.242+0000 7f797ddfd700 1 --2- 172.21.15.59:0/1201486615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79780a0a30 0x7f79781c8530 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.242+0000 7f797ddfd700 1 --2- 172.21.15.59:0/1201486615 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79780a1340 0x7f79781c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.242+0000 7f797ddfd700 1 -- 172.21.15.59:0/1201486615 >> 172.21.15.59:0/1201486615 conn(0x7f79780a6550 msgr2=0x7f79781b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.242+0000 7f797ddfd700 1 -- 172.21.15.59:0/1201486615 shutdown_connections 2023-09-30T22:35:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.242+0000 7f797ddfd700 1 -- 172.21.15.59:0/1201486615 wait complete. 2023-09-30T22:35:11.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:11.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.280+0000 7f282c88a700 1 -- 172.21.15.59:0/4238728768 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f282804f2a0 con 0x7f282809d630 2023-09-30T22:35:11.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.280+0000 7f2816ffd700 1 -- 172.21.15.59:0/4238728768 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f281801bde0 con 0x7f282809d630 2023-09-30T22:35:11.281 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:11.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.282+0000 7f282c88a700 1 -- 172.21.15.59:0/4238728768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282809d630 msgr2=0x7f28281c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.282+0000 7f282c88a700 1 --2- 172.21.15.59:0/4238728768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282809d630 0x7f28281c80b0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f281800e9e0 tx=0x7f281800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.282+0000 7f282c88a700 1 -- 172.21.15.59:0/4238728768 shutdown_connections 2023-09-30T22:35:11.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.283+0000 7f282c88a700 1 --2- 172.21.15.59:0/4238728768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2828133930 0x7f28281c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.283+0000 7f282c88a700 1 --2- 172.21.15.59:0/4238728768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282809d630 0x7f28281c80b0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.283+0000 7f282c88a700 1 --2- 172.21.15.59:0/4238728768 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28280a0a30 0x7f28281c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.283+0000 7f282c88a700 1 -- 172.21.15.59:0/4238728768 >> 172.21.15.59:0/4238728768 conn(0x7f28280a3050 msgr2=0x7f282809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:11.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.283+0000 7f282c88a700 1 -- 172.21.15.59:0/4238728768 shutdown_connections 2023-09-30T22:35:11.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.283+0000 7f282c88a700 1 -- 172.21.15.59:0/4238728768 wait complete. 2023-09-30T22:35:11.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:11.348 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:11.390 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:11.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.491+0000 7f9771ea0700 1 Processor -- start 2023-09-30T22:35:11.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.491+0000 7f9771ea0700 1 -- start start 2023-09-30T22:35:11.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.491+0000 7f9771ea0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f976c09d630 0x7f976c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.491+0000 7f9771ea0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f976c138d80 0x7f976c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.491+0000 7f9771ea0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976c0a2a70 con 0x7f976c0a0a30 2023-09-30T22:35:11.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.491+0000 7f9771ea0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976c0a01d0 con 0x7f976c138d80 2023-09-30T22:35:11.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.491+0000 7f9771ea0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976c09e2b0 con 0x7f976c09d630 2023-09-30T22:35:11.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.491+0000 7f976bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f976c138d80 0x7f976c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.492+0000 7f976affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f976c09d630 0x7f976c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.492+0000 7f976bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f976c138d80 0x7f976c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45386/0 (socket says 172.21.15.59:45386) 2023-09-30T22:35:11.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.492+0000 7f976bfff700 1 -- 172.21.15.59:0/2345429302 learned_addr learned my addr 172.21.15.59:0/2345429302 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:11.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.492+0000 7f976affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f976c09d630 0x7f976c0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41046/0 (socket says 172.21.15.59:41046) 2023-09-30T22:35:11.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.492+0000 7f976bfff700 1 -- 172.21.15.59:0/2345429302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f976c09d630 msgr2=0x7f976c0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:11.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.492+0000 7f976bfff700 1 --2- 172.21.15.59:0/2345429302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f976c09d630 0x7f976c0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.492+0000 7f976bfff700 1 -- 172.21.15.59:0/2345429302 >> v1:172.21.15.59:6789/0 conn(0x7f976c0a0a30 legacy=0x7f976c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.492+0000 7f976bfff700 1 -- 172.21.15.59:0/2345429302 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c09dc50 con 0x7f976c138d80 2023-09-30T22:35:11.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.492+0000 7f976affd700 1 --2- 172.21.15.59:0/2345429302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f976c09d630 0x7f976c0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:11.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.492+0000 7f976bfff700 1 --2- 172.21.15.59:0/2345429302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f976c138d80 0x7f976c13b160 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f97640098f0 tx=0x7f9764009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f1b79708d2b567 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:11.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.492+0000 7f976a7fc700 1 -- 172.21.15.59:0/2345429302 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764011830 con 0x7f976c138d80 2023-09-30T22:35:11.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.492+0000 7f976a7fc700 1 -- 172.21.15.59:0/2345429302 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764011990 con 0x7f976c138d80 2023-09-30T22:35:11.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.492+0000 7f976a7fc700 1 -- 172.21.15.59:0/2345429302 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764011d20 con 0x7f976c138d80 2023-09-30T22:35:11.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.493+0000 7f9771ea0700 1 -- 172.21.15.59:0/2345429302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f976c138d80 msgr2=0x7f976c13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.493+0000 7f9771ea0700 1 --2- 172.21.15.59:0/2345429302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f976c138d80 0x7f976c13b160 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f97640098f0 tx=0x7f9764009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:11.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.493+0000 7f9771ea0700 1 -- 172.21.15.59:0/2345429302 shutdown_connections 2023-09-30T22:35:11.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.493+0000 7f9771ea0700 1 --2- 172.21.15.59:0/2345429302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f976c138d80 0x7f976c13b160 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.493+0000 7f9771ea0700 1 --2- 172.21.15.59:0/2345429302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f976c09d630 0x7f976c0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.493+0000 7f9771ea0700 1 -- 172.21.15.59:0/2345429302 >> 172.21.15.59:0/2345429302 conn(0x7f976c0a3050 msgr2=0x7f976c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:11.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.493+0000 7f9771ea0700 1 -- 172.21.15.59:0/2345429302 shutdown_connections 2023-09-30T22:35:11.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.493+0000 7f9771ea0700 1 -- 172.21.15.59:0/2345429302 wait complete. 2023-09-30T22:35:11.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.494+0000 7f9771ea0700 1 Processor -- start 2023-09-30T22:35:11.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.494+0000 7f9771ea0700 1 -- start start 2023-09-30T22:35:11.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f9771ea0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f976c09d630 0x7f976c133850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f9771ea0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f976c0a0a30 0x7f976c133d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f9771ea0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f976c138d80 0x7f976c1342d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f9771ea0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c137000 con 0x7f976c09d630 2023-09-30T22:35:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f9771ea0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976c1359f0 con 0x7f976c138d80 2023-09-30T22:35:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f9771ea0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f976c0a0480 con 0x7f976c0a0a30 2023-09-30T22:35:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f976affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f976c0a0a30 0x7f976c133d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f976bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f976c138d80 0x7f976c1342d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f976affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f976c0a0a30 0x7f976c133d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53032/0 (socket says 172.21.15.59:53032) 2023-09-30T22:35:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f976affd700 1 -- 172.21.15.59:0/1814424794 learned_addr learned my addr 172.21.15.59:0/1814424794 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f976bfff700 1 --2- 172.21.15.59:0/1814424794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f976c138d80 0x7f976c1342d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41052/0 (socket says 172.21.15.59:41052) 2023-09-30T22:35:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f976b7fe700 1 --2- 172.21.15.59:0/1814424794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f976c09d630 0x7f976c133850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f976affd700 1 -- 172.21.15.59:0/1814424794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f976c138d80 msgr2=0x7f976c1342d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f976affd700 1 --2- 172.21.15.59:0/1814424794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f976c138d80 0x7f976c1342d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f976affd700 1 -- 172.21.15.59:0/1814424794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f976c09d630 msgr2=0x7f976c133850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f976affd700 1 --2- 172.21.15.59:0/1814424794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f976c09d630 0x7f976c133850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f976affd700 1 -- 172.21.15.59:0/1814424794 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97600094a0 con 0x7f976c0a0a30 2023-09-30T22:35:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.495+0000 7f976bfff700 1 --2- 172.21.15.59:0/1814424794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f976c138d80 0x7f976c1342d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.496+0000 7f976affd700 1 --2- 172.21.15.59:0/1814424794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f976c0a0a30 0x7f976c133d90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f976000ec10 tx=0x7f976000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.496+0000 7f9753fff700 1 -- 172.21.15.59:0/1814424794 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976000c850 con 0x7f976c0a0a30 2023-09-30T22:35:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.496+0000 7f9753fff700 1 -- 172.21.15.59:0/1814424794 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976000c9b0 con 0x7f976c0a0a30 2023-09-30T22:35:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.496+0000 7f9771ea0700 1 -- 172.21.15.59:0/1814424794 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9764009550 con 0x7f976c0a0a30 2023-09-30T22:35:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.496+0000 7f9753fff700 1 -- 172.21.15.59:0/1814424794 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976000cd40 con 0x7f976c0a0a30 2023-09-30T22:35:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.496+0000 7f9771ea0700 1 -- 172.21.15.59:0/1814424794 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976c137ec0 con 0x7f976c0a0a30 2023-09-30T22:35:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.497+0000 7f9771ea0700 1 -- 172.21.15.59:0/1814424794 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976c0747f0 con 0x7f976c0a0a30 2023-09-30T22:35:11.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.497+0000 7f9753fff700 1 -- 172.21.15.59:0/1814424794 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9760026480 con 0x7f976c0a0a30 2023-09-30T22:35:11.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.498+0000 7f9753fff700 1 -- 172.21.15.59:0/1814424794 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f976003ffc0 con 0x7f976c0a0a30 2023-09-30T22:35:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.502+0000 7f9753fff700 1 -- 172.21.15.59:0/1814424794 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9760026730 con 0x7f976c0a0a30 2023-09-30T22:35:11.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.532+0000 7f172b50a700 1 Processor -- start 2023-09-30T22:35:11.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.533+0000 7f172b50a700 1 -- start start 2023-09-30T22:35:11.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.533+0000 7f172b50a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17240a0a30 0x7f17240a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.533+0000 7f172b50a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f172409d630 0x7f17240a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.533+0000 7f172b50a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17240a2a70 con 0x7f1724133930 2023-09-30T22:35:11.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.533+0000 7f172b50a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17240a01d0 con 0x7f172409d630 2023-09-30T22:35:11.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.533+0000 7f172b50a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172409e2b0 con 0x7f17240a0a30 2023-09-30T22:35:11.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.534+0000 7f17292a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17240a0a30 0x7f17240a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.534+0000 7f17292a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17240a0a30 0x7f17240a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41054/0 (socket says 172.21.15.59:41054) 2023-09-30T22:35:11.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.534+0000 7f17292a6700 1 -- 172.21.15.59:0/3074594129 learned_addr learned my addr 172.21.15.59:0/3074594129 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:11.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.534+0000 7f1728aa5700 1 --2- 172.21.15.59:0/3074594129 >> v2:172.21.15.59:3300/0 conn(0x7f172409d630 0x7f17240a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.534+0000 7f1728aa5700 1 -- 172.21.15.59:0/3074594129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17240a0a30 msgr2=0x7f17240a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:11.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.534+0000 7f1728aa5700 1 --2- 172.21.15.59:0/3074594129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17240a0a30 0x7f17240a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.534+0000 7f1728aa5700 1 -- 172.21.15.59:0/3074594129 >> v1:172.21.15.59:6789/0 conn(0x7f1724133930 legacy=0x7f1724133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.534+0000 7f1728aa5700 1 -- 172.21.15.59:0/3074594129 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172409dc50 con 0x7f172409d630 2023-09-30T22:35:11.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.534+0000 7f17292a6700 1 --2- 172.21.15.59:0/3074594129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17240a0a30 0x7f17240a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:11.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.534+0000 7f1728aa5700 1 --2- 172.21.15.59:0/3074594129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f172409d630 0x7f17240a1340 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f1718009840 tx=0x7f1718009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e455763fbdb882 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:11.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.534+0000 7f1723fff700 1 -- 172.21.15.59:0/3074594129 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718011830 con 0x7f172409d630 2023-09-30T22:35:11.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.534+0000 7f1723fff700 1 -- 172.21.15.59:0/3074594129 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718011990 con 0x7f172409d630 2023-09-30T22:35:11.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.534+0000 7f1723fff700 1 -- 172.21.15.59:0/3074594129 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718011d20 con 0x7f172409d630 2023-09-30T22:35:11.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.535+0000 7f172b50a700 1 -- 172.21.15.59:0/3074594129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f172409d630 msgr2=0x7f17240a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.535+0000 7f172b50a700 1 --2- 172.21.15.59:0/3074594129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f172409d630 0x7f17240a1340 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f1718009840 tx=0x7f1718009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:11.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.535+0000 7f172b50a700 1 -- 172.21.15.59:0/3074594129 shutdown_connections 2023-09-30T22:35:11.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.535+0000 7f172b50a700 1 --2- 172.21.15.59:0/3074594129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17240a0a30 0x7f17240a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.535+0000 7f172b50a700 1 --2- 172.21.15.59:0/3074594129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f172409d630 0x7f17240a1340 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.535+0000 7f172b50a700 1 -- 172.21.15.59:0/3074594129 >> 172.21.15.59:0/3074594129 conn(0x7f17240a3050 msgr2=0x7f17240a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:11.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.535+0000 7f172b50a700 1 -- 172.21.15.59:0/3074594129 shutdown_connections 2023-09-30T22:35:11.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.535+0000 7f172b50a700 1 -- 172.21.15.59:0/3074594129 wait complete. 2023-09-30T22:35:11.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.536+0000 7f172b50a700 1 Processor -- start 2023-09-30T22:35:11.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.536+0000 7f172b50a700 1 -- start start 2023-09-30T22:35:11.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f172b50a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f172409d630 0x7f17241c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f172b50a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17240a0a30 0x7f17241c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f172b50a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1724133930 0x7f17241c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:11.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f172b50a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1724120a70 con 0x7f17240a0a30 2023-09-30T22:35:11.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f172b50a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1724120880 con 0x7f1724133930 2023-09-30T22:35:11.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f172b50a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1724121920 con 0x7f172409d630 2023-09-30T22:35:11.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f1729aa7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1724133930 0x7f17241c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f17292a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f172409d630 0x7f17241c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f17292a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f172409d630 0x7f17241c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53048/0 (socket says 172.21.15.59:53048) 2023-09-30T22:35:11.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f1729aa7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1724133930 0x7f17241c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41064/0 (socket says 172.21.15.59:41064) 2023-09-30T22:35:11.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f17292a6700 1 -- 172.21.15.59:0/4189293734 learned_addr learned my addr 172.21.15.59:0/4189293734 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:11.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f1728aa5700 1 --2- 172.21.15.59:0/4189293734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17240a0a30 0x7f17241c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f1729aa7700 1 -- 172.21.15.59:0/4189293734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f172409d630 msgr2=0x7f17241c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f1729aa7700 1 --2- 172.21.15.59:0/4189293734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f172409d630 0x7f17241c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f1729aa7700 1 -- 172.21.15.59:0/4189293734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17240a0a30 msgr2=0x7f17241c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f1729aa7700 1 --2- 172.21.15.59:0/4189293734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17240a0a30 0x7f17241c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f1729aa7700 1 -- 172.21.15.59:0/4189293734 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c009550 con 0x7f1724133930 2023-09-30T22:35:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f1728aa5700 1 --2- 172.21.15.59:0/4189293734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17240a0a30 0x7f17241c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:35:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.537+0000 7f1729aa7700 1 --2- 172.21.15.59:0/4189293734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1724133930 0x7f17241c8d90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f171400cb90 tx=0x7f171400cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.538+0000 7f1721ffb700 1 -- 172.21.15.59:0/4189293734 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714003c00 con 0x7f1724133930 2023-09-30T22:35:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.538+0000 7f1721ffb700 1 -- 172.21.15.59:0/4189293734 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1714003d60 con 0x7f1724133930 2023-09-30T22:35:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.538+0000 7f172b50a700 1 -- 172.21.15.59:0/4189293734 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17180094a0 con 0x7f1724133930 2023-09-30T22:35:11.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.538+0000 7f1721ffb700 1 -- 172.21.15.59:0/4189293734 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171400aaa0 con 0x7f1724133930 2023-09-30T22:35:11.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.538+0000 7f172b50a700 1 -- 172.21.15.59:0/4189293734 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17241224b0 con 0x7f1724133930 2023-09-30T22:35:11.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.538+0000 7f1721ffb700 1 -- 172.21.15.59:0/4189293734 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f171400ac00 con 0x7f1724133930 2023-09-30T22:35:11.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.539+0000 7f1721ffb700 1 -- 172.21.15.59:0/4189293734 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f171403f610 con 0x7f1724133930 2023-09-30T22:35:11.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.539+0000 7f172b50a700 1 -- 172.21.15.59:0/4189293734 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1724121e90 con 0x7f1724133930 2023-09-30T22:35:11.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.544+0000 7f1721ffb700 1 -- 172.21.15.59:0/4189293734 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17140198f0 con 0x7f1724133930 2023-09-30T22:35:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.709+0000 7f9771ea0700 1 -- 172.21.15.59:0/1814424794 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f976c136c80 con 0x7f976c0a0a30 2023-09-30T22:35:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.709+0000 7f9753fff700 1 -- 172.21.15.59:0/1814424794 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9760017030 con 0x7f976c0a0a30 2023-09-30T22:35:11.711 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.712+0000 7f9771ea0700 1 -- 172.21.15.59:0/1814424794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f976c0a0a30 msgr2=0x7f976c133d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.712+0000 7f9771ea0700 1 --2- 172.21.15.59:0/1814424794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f976c0a0a30 0x7f976c133d90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f976000ec10 tx=0x7f976000ef20 comp rx=0 tx=0).stop 2023-09-30T22:35:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.712+0000 7f9771ea0700 1 -- 172.21.15.59:0/1814424794 shutdown_connections 2023-09-30T22:35:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.712+0000 7f9771ea0700 1 --2- 172.21.15.59:0/1814424794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f976c138d80 0x7f976c1342d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.712+0000 7f9771ea0700 1 --2- 172.21.15.59:0/1814424794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f976c09d630 0x7f976c133850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.712+0000 7f9771ea0700 1 --2- 172.21.15.59:0/1814424794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f976c0a0a30 0x7f976c133d90 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.712+0000 7f9771ea0700 1 -- 172.21.15.59:0/1814424794 >> 172.21.15.59:0/1814424794 conn(0x7f976c0a3050 msgr2=0x7f976c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.712+0000 7f9771ea0700 1 -- 172.21.15.59:0/1814424794 shutdown_connections 2023-09-30T22:35:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.712+0000 7f9771ea0700 1 -- 172.21.15.59:0/1814424794 wait complete. 2023-09-30T22:35:11.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.748+0000 7f172b50a700 1 -- 172.21.15.59:0/4189293734 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1724074770 con 0x7f1724133930 2023-09-30T22:35:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.749+0000 7f1721ffb700 1 -- 172.21.15.59:0/4189293734 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1714019300 con 0x7f1724133930 2023-09-30T22:35:11.750 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:11.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.751+0000 7f172b50a700 1 -- 172.21.15.59:0/4189293734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1724133930 msgr2=0x7f17241c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:11.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.751+0000 7f172b50a700 1 --2- 172.21.15.59:0/4189293734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1724133930 0x7f17241c8d90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f171400cb90 tx=0x7f171400cea0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.751+0000 7f172b50a700 1 -- 172.21.15.59:0/4189293734 shutdown_connections 2023-09-30T22:35:11.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.751+0000 7f172b50a700 1 --2- 172.21.15.59:0/4189293734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f172409d630 0x7f17241c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.751+0000 7f172b50a700 1 --2- 172.21.15.59:0/4189293734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1724133930 0x7f17241c8d90 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.751+0000 7f172b50a700 1 --2- 172.21.15.59:0/4189293734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17240a0a30 0x7f17241c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:11.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.751+0000 7f172b50a700 1 -- 172.21.15.59:0/4189293734 >> 172.21.15.59:0/4189293734 conn(0x7f17240a3050 msgr2=0x7f17241bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:11.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.751+0000 7f172b50a700 1 -- 172.21.15.59:0/4189293734 shutdown_connections 2023-09-30T22:35:11.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:11.751+0000 7f172b50a700 1 -- 172.21.15.59:0/4189293734 wait complete. 2023-09-30T22:35:11.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:12.258 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:12.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:12.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.406+0000 7fbdcfc98700 1 Processor -- start 2023-09-30T22:35:12.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.406+0000 7fbdcfc98700 1 -- start start 2023-09-30T22:35:12.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcfc98700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbdc80a0a30 0x7fbdc80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcfc98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdc80a1340 0x7fbdc8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcfc98700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdc8133fa0 0x7fbdc8134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcfc98700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc809edd0 con 0x7fbdc80a0a30 2023-09-30T22:35:12.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcfc98700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc809e1f0 con 0x7fbdc80a1340 2023-09-30T22:35:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcfc98700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc809dc50 con 0x7fbdc8133fa0 2023-09-30T22:35:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcd233700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdc80a1340 0x7fbdc8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcda34700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbdc80a0a30 0x7fbdc80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdce235700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdc8133fa0 0x7fbdc8134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcd233700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdc80a1340 0x7fbdc8133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41080/0 (socket says 172.21.15.59:41080) 2023-09-30T22:35:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcd233700 1 -- 172.21.15.59:0/2856791675 learned_addr learned my addr 172.21.15.59:0/2856791675 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcda34700 1 -- 172.21.15.59:0/2856791675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdc8133fa0 msgr2=0x7fbdc8134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcda34700 1 --2- 172.21.15.59:0/2856791675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdc8133fa0 0x7fbdc8134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcda34700 1 -- 172.21.15.59:0/2856791675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdc80a1340 msgr2=0x7fbdc8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:12.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcda34700 1 --2- 172.21.15.59:0/2856791675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdc80a1340 0x7fbdc8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcda34700 1 -- 172.21.15.59:0/2856791675 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc80a1fe0 con 0x7fbdc80a0a30 2023-09-30T22:35:12.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.407+0000 7fbdcd233700 1 --2- 172.21.15.59:0/2856791675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdc80a1340 0x7fbdc8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:12.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.408+0000 7fbdcda34700 1 --2- 172.21.15.59:0/2856791675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdc80a0a30 0x7fbdc80a0e00 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009d90 tx=0x7fbdc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524614b524dbf64f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:12.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.408+0000 7fbdcca32700 1 -- 172.21.15.59:0/2856791675 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc000e070 con 0x7fbdc80a0a30 2023-09-30T22:35:12.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.408+0000 7fbdcca32700 1 -- 172.21.15.59:0/2856791675 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc000bb20 con 0x7fbdc80a0a30 2023-09-30T22:35:12.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.408+0000 7fbdcca32700 1 -- 172.21.15.59:0/2856791675 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0012430 con 0x7fbdc80a0a30 2023-09-30T22:35:12.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.408+0000 7fbdcfc98700 1 -- 172.21.15.59:0/2856791675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdc80a0a30 msgr2=0x7fbdc80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.408+0000 7fbdcfc98700 1 --2- 172.21.15.59:0/2856791675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdc80a0a30 0x7fbdc80a0e00 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009d90 tx=0x7fbdc000b330 comp rx=0 tx=0).stop 2023-09-30T22:35:12.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.409+0000 7fbdcfc98700 1 -- 172.21.15.59:0/2856791675 shutdown_connections 2023-09-30T22:35:12.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.409+0000 7fbdcfc98700 1 --2- 172.21.15.59:0/2856791675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdc8133fa0 0x7fbdc8134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.409+0000 7fbdcfc98700 1 --2- 172.21.15.59:0/2856791675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdc80a0a30 0x7fbdc80a0e00 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.409+0000 7fbdcfc98700 1 --2- 172.21.15.59:0/2856791675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdc80a1340 0x7fbdc8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.409+0000 7fbdcfc98700 1 -- 172.21.15.59:0/2856791675 >> 172.21.15.59:0/2856791675 conn(0x7fbdc80a6550 msgr2=0x7fbdc80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.409+0000 7fbdcfc98700 1 -- 172.21.15.59:0/2856791675 shutdown_connections 2023-09-30T22:35:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.409+0000 7fbdcfc98700 1 -- 172.21.15.59:0/2856791675 wait complete. 2023-09-30T22:35:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.410+0000 7fbdcfc98700 1 Processor -- start 2023-09-30T22:35:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.410+0000 7fbdcfc98700 1 -- start start 2023-09-30T22:35:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.410+0000 7fbdcfc98700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdc80a0a30 0x7fbdc8120380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.410+0000 7fbdcfc98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdc80a1340 0x7fbdc81208c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.410+0000 7fbdcfc98700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdc8133fa0 0x7fbdc8120e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.410+0000 7fbdcfc98700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8133770 con 0x7fbdc80a0a30 2023-09-30T22:35:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.410+0000 7fbdcfc98700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc81231e0 con 0x7fbdc80a1340 2023-09-30T22:35:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.410+0000 7fbdcfc98700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8122570 con 0x7fbdc8133fa0 2023-09-30T22:35:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.410+0000 7fbdce235700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdc8133fa0 0x7fbdc8120e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.410+0000 7fbdcd233700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdc80a1340 0x7fbdc81208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.410+0000 7fbdce235700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdc8133fa0 0x7fbdc8120e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53056/0 (socket says 172.21.15.59:53056) 2023-09-30T22:35:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.410+0000 7fbdce235700 1 -- 172.21.15.59:0/3695400831 learned_addr learned my addr 172.21.15.59:0/3695400831 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.410+0000 7fbdcda34700 1 --2- 172.21.15.59:0/3695400831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdc80a0a30 0x7fbdc8120380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.411+0000 7fbdce235700 1 -- 172.21.15.59:0/3695400831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdc80a1340 msgr2=0x7fbdc81208c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.411+0000 7fbdce235700 1 --2- 172.21.15.59:0/3695400831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdc80a1340 0x7fbdc81208c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.411+0000 7fbdce235700 1 -- 172.21.15.59:0/3695400831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdc80a0a30 msgr2=0x7fbdc8120380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.411+0000 7fbdce235700 1 --2- 172.21.15.59:0/3695400831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdc80a0a30 0x7fbdc8120380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.411+0000 7fbdce235700 1 -- 172.21.15.59:0/3695400831 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc009550 con 0x7fbdc8133fa0 2023-09-30T22:35:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.411+0000 7fbdcd233700 1 --2- 172.21.15.59:0/3695400831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdc80a1340 0x7fbdc81208c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.411+0000 7fbdce235700 1 --2- 172.21.15.59:0/3695400831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdc8133fa0 0x7fbdc8120e00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800e950 tx=0x7fbdb800ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.411+0000 7fbdc67fc700 1 -- 172.21.15.59:0/3695400831 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8009730 con 0x7fbdc8133fa0 2023-09-30T22:35:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.411+0000 7fbdc67fc700 1 -- 172.21.15.59:0/3695400831 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb8013680 con 0x7fbdc8133fa0 2023-09-30T22:35:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.411+0000 7fbdcfc98700 1 -- 172.21.15.59:0/3695400831 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc0009a70 con 0x7fbdc8133fa0 2023-09-30T22:35:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.411+0000 7fbdc67fc700 1 -- 172.21.15.59:0/3695400831 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8013a10 con 0x7fbdc8133fa0 2023-09-30T22:35:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.411+0000 7fbdcfc98700 1 -- 172.21.15.59:0/3695400831 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc80a3410 con 0x7fbdc8133fa0 2023-09-30T22:35:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.412+0000 7fbdc67fc700 1 -- 172.21.15.59:0/3695400831 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbdb8013b70 con 0x7fbdc8133fa0 2023-09-30T22:35:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.412+0000 7fbdcfc98700 1 -- 172.21.15.59:0/3695400831 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc80a0220 con 0x7fbdc8133fa0 2023-09-30T22:35:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.412+0000 7fbdc67fc700 1 -- 172.21.15.59:0/3695400831 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbdb803f670 con 0x7fbdc8133fa0 2023-09-30T22:35:12.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.417+0000 7fbdc67fc700 1 -- 172.21.15.59:0/3695400831 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdb801bbe0 con 0x7fbdc8133fa0 2023-09-30T22:35:12.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.444+0000 7f14d1234700 1 Processor -- start 2023-09-30T22:35:12.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.444+0000 7f14d1234700 1 -- start start 2023-09-30T22:35:12.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.444+0000 7f14d1234700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14cc0a0a30 0x7f14cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.444+0000 7f14d1234700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09d630 0x7f14cc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.444+0000 7f14d1234700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc133930 0x7f14cc133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.444+0000 7f14d1234700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14cc0a2a70 con 0x7f14cc0a0a30 2023-09-30T22:35:12.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.444+0000 7f14d1234700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc0a01d0 con 0x7f14cc09d630 2023-09-30T22:35:12.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.444+0000 7f14d1234700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc09e2b0 con 0x7f14cc133930 2023-09-30T22:35:12.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.444+0000 7f14cad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14cc0a0a30 0x7f14cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.444+0000 7f14cb59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc133930 0x7f14cc133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.445+0000 7f14ca59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09d630 0x7f14cc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.445+0000 7f14cad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14cc0a0a30 0x7f14cc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45428/0 (socket says 172.21.15.59:45428) 2023-09-30T22:35:12.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.445+0000 7f14cad9d700 1 -- 172.21.15.59:0/2113278385 learned_addr learned my addr 172.21.15.59:0/2113278385 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:12.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.445+0000 7f14ca59c700 1 -- 172.21.15.59:0/2113278385 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc133930 msgr2=0x7f14cc133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:12.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.445+0000 7f14ca59c700 1 --2- 172.21.15.59:0/2113278385 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc133930 0x7f14cc133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.445+0000 7f14ca59c700 1 -- 172.21.15.59:0/2113278385 >> v2:172.21.15.59:3300/0 conn(0x7f14cc0a0a30 msgr2=0x7f14cc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:12.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.445+0000 7f14ca59c700 1 --2- 172.21.15.59:0/2113278385 >> v2:172.21.15.59:3300/0 conn(0x7f14cc0a0a30 0x7f14cc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.445+0000 7f14ca59c700 1 -- 172.21.15.59:0/2113278385 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc09dc50 con 0x7f14cc09d630 2023-09-30T22:35:12.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.445+0000 7f14cad9d700 1 --2- 172.21.15.59:0/2113278385 >> v2:172.21.15.59:3300/0 conn(0x7f14cc0a0a30 0x7f14cc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:12.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.445+0000 7f14ca59c700 1 --2- 172.21.15.59:0/2113278385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09d630 0x7f14cc0a1340 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009840 tx=0x7f14c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=482716dedc01c86c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:12.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.445+0000 7f14c9d9b700 1 -- 172.21.15.59:0/2113278385 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0011830 con 0x7f14cc09d630 2023-09-30T22:35:12.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.445+0000 7f14c9d9b700 1 -- 172.21.15.59:0/2113278385 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c0011990 con 0x7f14cc09d630 2023-09-30T22:35:12.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.445+0000 7f14c9d9b700 1 -- 172.21.15.59:0/2113278385 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0011d20 con 0x7f14cc09d630 2023-09-30T22:35:12.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.446+0000 7f14d1234700 1 -- 172.21.15.59:0/2113278385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09d630 msgr2=0x7f14cc0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.446+0000 7f14d1234700 1 --2- 172.21.15.59:0/2113278385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09d630 0x7f14cc0a1340 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009840 tx=0x7f14c0009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:12.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.446+0000 7f14d1234700 1 -- 172.21.15.59:0/2113278385 shutdown_connections 2023-09-30T22:35:12.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.446+0000 7f14d1234700 1 --2- 172.21.15.59:0/2113278385 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc133930 0x7f14cc133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.446+0000 7f14d1234700 1 --2- 172.21.15.59:0/2113278385 >> v2:172.21.15.59:3300/0 conn(0x7f14cc0a0a30 0x7f14cc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.446+0000 7f14d1234700 1 --2- 172.21.15.59:0/2113278385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09d630 0x7f14cc0a1340 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.446+0000 7f14d1234700 1 -- 172.21.15.59:0/2113278385 >> 172.21.15.59:0/2113278385 conn(0x7f14cc0a3050 msgr2=0x7f14cc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:12.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.446+0000 7f14d1234700 1 -- 172.21.15.59:0/2113278385 shutdown_connections 2023-09-30T22:35:12.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.446+0000 7f14d1234700 1 -- 172.21.15.59:0/2113278385 wait complete. 2023-09-30T22:35:12.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.447+0000 7f14d1234700 1 Processor -- start 2023-09-30T22:35:12.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.447+0000 7f14d1234700 1 -- start start 2023-09-30T22:35:12.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14d1234700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09d630 0x7f14cc1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14d1234700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc0a0a30 0x7f14cc1c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14d1234700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14cc133930 0x7f14cc1c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14d1234700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc122100 con 0x7f14cc133930 2023-09-30T22:35:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14d1234700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc1204d0 con 0x7f14cc0a0a30 2023-09-30T22:35:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14d1234700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc120a50 con 0x7f14cc09d630 2023-09-30T22:35:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14cad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09d630 0x7f14cc1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14ca59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc0a0a30 0x7f14cc1c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14cad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09d630 0x7f14cc1c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53082/0 (socket says 172.21.15.59:53082) 2023-09-30T22:35:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14cad9d700 1 -- 172.21.15.59:0/970861348 learned_addr learned my addr 172.21.15.59:0/970861348 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14ca59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc0a0a30 0x7f14cc1c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41106/0 (socket says 172.21.15.59:41106) 2023-09-30T22:35:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14cb59e700 1 --2- 172.21.15.59:0/970861348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14cc133930 0x7f14cc1c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14cad9d700 1 -- 172.21.15.59:0/970861348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc0a0a30 msgr2=0x7f14cc1c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14cad9d700 1 --2- 172.21.15.59:0/970861348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc0a0a30 0x7f14cc1c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14cad9d700 1 -- 172.21.15.59:0/970861348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14cc133930 msgr2=0x7f14cc1c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14cad9d700 1 --2- 172.21.15.59:0/970861348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14cc133930 0x7f14cc1c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14cad9d700 1 -- 172.21.15.59:0/970861348 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc009550 con 0x7f14cc09d630 2023-09-30T22:35:12.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.448+0000 7f14ca59c700 1 --2- 172.21.15.59:0/970861348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc0a0a30 0x7f14cc1c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:12.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.449+0000 7f14cad9d700 1 --2- 172.21.15.59:0/970861348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09d630 0x7f14cc1c8020 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00ebe0 tx=0x7f14bc00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:12.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.449+0000 7f14b37fe700 1 -- 172.21.15.59:0/970861348 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc00c850 con 0x7f14cc09d630 2023-09-30T22:35:12.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.449+0000 7f14b37fe700 1 -- 172.21.15.59:0/970861348 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc00c9b0 con 0x7f14cc09d630 2023-09-30T22:35:12.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.449+0000 7f14d1234700 1 -- 172.21.15.59:0/970861348 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c00094a0 con 0x7f14cc09d630 2023-09-30T22:35:12.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.449+0000 7f14b37fe700 1 -- 172.21.15.59:0/970861348 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc00cd40 con 0x7f14cc09d630 2023-09-30T22:35:12.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.449+0000 7f14d1234700 1 -- 172.21.15.59:0/970861348 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14cc122b70 con 0x7f14cc09d630 2023-09-30T22:35:12.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.450+0000 7f14b37fe700 1 -- 172.21.15.59:0/970861348 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14bc013470 con 0x7f14cc09d630 2023-09-30T22:35:12.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.450+0000 7f14b37fe700 1 -- 172.21.15.59:0/970861348 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f14bc03fd30 con 0x7f14cc09d630 2023-09-30T22:35:12.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.450+0000 7f14d1234700 1 -- 172.21.15.59:0/970861348 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14cc121f40 con 0x7f14cc09d630 2023-09-30T22:35:12.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.455+0000 7f14b37fe700 1 -- 172.21.15.59:0/970861348 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14bc01b3b0 con 0x7f14cc09d630 2023-09-30T22:35:12.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.624+0000 7fbdcfc98700 1 -- 172.21.15.59:0/3695400831 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbdc8074ea0 con 0x7fbdc8133fa0 2023-09-30T22:35:12.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.624+0000 7fbdc67fc700 1 -- 172.21.15.59:0/3695400831 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdb8017030 con 0x7fbdc8133fa0 2023-09-30T22:35:12.625 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:12.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.626+0000 7fbdcfc98700 1 -- 172.21.15.59:0/3695400831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdc8133fa0 msgr2=0x7fbdc8120e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.626+0000 7fbdcfc98700 1 --2- 172.21.15.59:0/3695400831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdc8133fa0 0x7fbdc8120e00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800e950 tx=0x7fbdb800ec60 comp rx=0 tx=0).stop 2023-09-30T22:35:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.626+0000 7fbdcfc98700 1 -- 172.21.15.59:0/3695400831 shutdown_connections 2023-09-30T22:35:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.626+0000 7fbdcfc98700 1 --2- 172.21.15.59:0/3695400831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdc8133fa0 0x7fbdc8120e00 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.626+0000 7fbdcfc98700 1 --2- 172.21.15.59:0/3695400831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdc80a0a30 0x7fbdc8120380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.626+0000 7fbdcfc98700 1 --2- 172.21.15.59:0/3695400831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdc80a1340 0x7fbdc81208c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.626+0000 7fbdcfc98700 1 -- 172.21.15.59:0/3695400831 >> 172.21.15.59:0/3695400831 conn(0x7fbdc80a6550 msgr2=0x7fbdc81baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.626+0000 7fbdcfc98700 1 -- 172.21.15.59:0/3695400831 shutdown_connections 2023-09-30T22:35:12.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.626+0000 7fbdcfc98700 1 -- 172.21.15.59:0/3695400831 wait complete. 2023-09-30T22:35:12.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:12.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.661+0000 7f14d1234700 1 -- 172.21.15.59:0/970861348 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f14cc0747f0 con 0x7f14cc09d630 2023-09-30T22:35:12.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.662+0000 7f14b37fe700 1 -- 172.21.15.59:0/970861348 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f14bc024350 con 0x7f14cc09d630 2023-09-30T22:35:12.663 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:12.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.664+0000 7f14d1234700 1 -- 172.21.15.59:0/970861348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09d630 msgr2=0x7f14cc1c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.664+0000 7f14d1234700 1 --2- 172.21.15.59:0/970861348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09d630 0x7f14cc1c8020 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00ebe0 tx=0x7f14bc00eef0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.664+0000 7f14d1234700 1 -- 172.21.15.59:0/970861348 shutdown_connections 2023-09-30T22:35:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.664+0000 7f14d1234700 1 --2- 172.21.15.59:0/970861348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09d630 0x7f14cc1c8020 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.664+0000 7f14d1234700 1 --2- 172.21.15.59:0/970861348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14cc133930 0x7f14cc1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.664+0000 7f14d1234700 1 --2- 172.21.15.59:0/970861348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc0a0a30 0x7f14cc1c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.664+0000 7f14d1234700 1 -- 172.21.15.59:0/970861348 >> 172.21.15.59:0/970861348 conn(0x7f14cc0a3050 msgr2=0x7f14cc09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.664+0000 7f14d1234700 1 -- 172.21.15.59:0/970861348 shutdown_connections 2023-09-30T22:35:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.664+0000 7f14d1234700 1 -- 172.21.15.59:0/970861348 wait complete. 2023-09-30T22:35:12.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:12.727 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:12.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.868+0000 7f94e74fa700 1 Processor -- start 2023-09-30T22:35:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.868+0000 7f94e74fa700 1 -- start start 2023-09-30T22:35:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e74fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e00a09c0 0x7f94e006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e74fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e00a0d90 0x7f94e00a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e74fa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e00a2a20 con 0x7f94e01338a0 2023-09-30T22:35:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e74fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e009e690 con 0x7f94e00a0d90 2023-09-30T22:35:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e74fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00a1cc0 con 0x7f94e00a09c0 2023-09-30T22:35:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e4a95700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e00a0d90 0x7f94e00a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e5296700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e00a09c0 0x7f94e006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e5296700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e00a09c0 0x7f94e006c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53086/0 (socket says 172.21.15.59:53086) 2023-09-30T22:35:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e4a95700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e00a0d90 0x7f94e00a11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41120/0 (socket says 172.21.15.59:41120) 2023-09-30T22:35:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e5296700 1 -- 172.21.15.59:0/2114481918 learned_addr learned my addr 172.21.15.59:0/2114481918 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e5a97700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f94e01338a0 0x7f94e0133d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39954/0 (socket says 172.21.15.59:39954) 2023-09-30T22:35:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94dffff700 1 -- 172.21.15.59:0/2114481918 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969110441 0 0) 0x7f94d8001110 con 0x7f94e01338a0 2023-09-30T22:35:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94dffff700 1 -- 172.21.15.59:0/2114481918 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c80035b0 con 0x7f94e01338a0 2023-09-30T22:35:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e4a95700 1 -- 172.21.15.59:0/2114481918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e00a09c0 msgr2=0x7f94e006c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e4a95700 1 --2- 172.21.15.59:0/2114481918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e00a09c0 0x7f94e006c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e4a95700 1 -- 172.21.15.59:0/2114481918 >> v1:172.21.15.59:6789/0 conn(0x7f94e01338a0 legacy=0x7f94e0133d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e4a95700 1 -- 172.21.15.59:0/2114481918 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e00a1f40 con 0x7f94e00a0d90 2023-09-30T22:35:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.869+0000 7f94e5296700 1 --2- 172.21.15.59:0/2114481918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e00a09c0 0x7f94e006c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.870+0000 7f94e4a95700 1 --2- 172.21.15.59:0/2114481918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e00a0d90 0x7f94e00a11c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009870 tx=0x7f94d4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f23580e0646decfa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.870+0000 7f94dffff700 1 -- 172.21.15.59:0/2114481918 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4004230 con 0x7f94e00a0d90 2023-09-30T22:35:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.870+0000 7f94dffff700 1 -- 172.21.15.59:0/2114481918 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d4004390 con 0x7f94e00a0d90 2023-09-30T22:35:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.870+0000 7f94dffff700 1 -- 172.21.15.59:0/2114481918 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40036a0 con 0x7f94e00a0d90 2023-09-30T22:35:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.870+0000 7f94e74fa700 1 -- 172.21.15.59:0/2114481918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e00a0d90 msgr2=0x7f94e00a11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.870+0000 7f94e74fa700 1 --2- 172.21.15.59:0/2114481918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e00a0d90 0x7f94e00a11c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009870 tx=0x7f94d4009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.870+0000 7f94e74fa700 1 -- 172.21.15.59:0/2114481918 shutdown_connections 2023-09-30T22:35:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.870+0000 7f94e74fa700 1 --2- 172.21.15.59:0/2114481918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e00a09c0 0x7f94e006c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.870+0000 7f94e74fa700 1 --2- 172.21.15.59:0/2114481918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e00a0d90 0x7f94e00a11c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.871+0000 7f94e74fa700 1 -- 172.21.15.59:0/2114481918 >> 172.21.15.59:0/2114481918 conn(0x7f94e00a60c0 msgr2=0x7f94e00a64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.871+0000 7f94e74fa700 1 -- 172.21.15.59:0/2114481918 shutdown_connections 2023-09-30T22:35:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.871+0000 7f94e74fa700 1 -- 172.21.15.59:0/2114481918 wait complete. 2023-09-30T22:35:12.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.872+0000 7f94e74fa700 1 Processor -- start 2023-09-30T22:35:12.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.872+0000 7f94e74fa700 1 -- start start 2023-09-30T22:35:12.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e74fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e00a09c0 0x7f94e0132710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e74fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e00a0d90 0x7f94e0132c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e74fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e01338a0 0x7f94e01c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e74fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01334e0 con 0x7f94e01338a0 2023-09-30T22:35:12.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e74fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01206c0 con 0x7f94e00a09c0 2023-09-30T22:35:12.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e74fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94e009cea0 con 0x7f94e00a0d90 2023-09-30T22:35:12.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e5296700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e00a09c0 0x7f94e0132710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e5296700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e00a09c0 0x7f94e0132710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41128/0 (socket says 172.21.15.59:41128) 2023-09-30T22:35:12.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e5296700 1 -- 172.21.15.59:0/1319206266 learned_addr learned my addr 172.21.15.59:0/1319206266 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:12.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e5a97700 1 --2- 172.21.15.59:0/1319206266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e01338a0 0x7f94e01c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e4a95700 1 --2- 172.21.15.59:0/1319206266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e00a0d90 0x7f94e0132c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e5296700 1 -- 172.21.15.59:0/1319206266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e00a0d90 msgr2=0x7f94e0132c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e5296700 1 --2- 172.21.15.59:0/1319206266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e00a0d90 0x7f94e0132c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e5296700 1 -- 172.21.15.59:0/1319206266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e01338a0 msgr2=0x7f94e01c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e5296700 1 --2- 172.21.15.59:0/1319206266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e01338a0 0x7f94e01c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e5296700 1 -- 172.21.15.59:0/1319206266 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0009b30 con 0x7f94e00a09c0 2023-09-30T22:35:12.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.873+0000 7f94e5a97700 1 --2- 172.21.15.59:0/1319206266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e01338a0 0x7f94e01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.874+0000 7f94e5296700 1 --2- 172.21.15.59:0/1319206266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e00a09c0 0x7f94e0132710 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f94d000efc0 tx=0x7f94d000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.874+0000 7f94ddffb700 1 -- 172.21.15.59:0/1319206266 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d000cb00 con 0x7f94e00a09c0 2023-09-30T22:35:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.874+0000 7f94ddffb700 1 -- 172.21.15.59:0/1319206266 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d000f040 con 0x7f94e00a09c0 2023-09-30T22:35:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.874+0000 7f94e74fa700 1 -- 172.21.15.59:0/1319206266 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d40094a0 con 0x7f94e00a09c0 2023-09-30T22:35:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.874+0000 7f94ddffb700 1 -- 172.21.15.59:0/1319206266 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d000ce80 con 0x7f94e00a09c0 2023-09-30T22:35:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.874+0000 7f94e74fa700 1 -- 172.21.15.59:0/1319206266 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e0122170 con 0x7f94e00a09c0 2023-09-30T22:35:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.875+0000 7f94ddffb700 1 -- 172.21.15.59:0/1319206266 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f94d0014480 con 0x7f94e00a09c0 2023-09-30T22:35:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.875+0000 7f94ddffb700 1 -- 172.21.15.59:0/1319206266 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f94d003fcf0 con 0x7f94e00a09c0 2023-09-30T22:35:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.875+0000 7f94e74fa700 1 -- 172.21.15.59:0/1319206266 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e00a1680 con 0x7f94e00a09c0 2023-09-30T22:35:12.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.884+0000 7f94ddffb700 1 -- 172.21.15.59:0/1319206266 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94d0012910 con 0x7f94e00a09c0 2023-09-30T22:35:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.913+0000 7fe4bc87d700 1 Processor -- start 2023-09-30T22:35:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.913+0000 7fe4bc87d700 1 -- start start 2023-09-30T22:35:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.913+0000 7fe4bc87d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4b809e930 0x7fe4b809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.914+0000 7fe4bc87d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4b809f240 0x7fe4b81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.914+0000 7fe4bc87d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b8070940 con 0x7fe4b809f650 2023-09-30T22:35:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.914+0000 7fe4bc87d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b806fd60 con 0x7fe4b809e930 2023-09-30T22:35:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.914+0000 7fe4bc87d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b806fa80 con 0x7fe4b809f240 2023-09-30T22:35:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.914+0000 7fe4b659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4b809e930 0x7fe4b809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.914+0000 7fe4b5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4b809f240 0x7fe4b81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.914+0000 7fe4b659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4b809e930 0x7fe4b809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45450/0 (socket says 172.21.15.59:45450) 2023-09-30T22:35:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.914+0000 7fe4b659c700 1 -- 172.21.15.59:0/142130179 learned_addr learned my addr 172.21.15.59:0/142130179 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.914+0000 7fe4b5d9b700 1 -- 172.21.15.59:0/142130179 >> v2:172.21.15.59:3300/0 conn(0x7fe4b809e930 msgr2=0x7fe4b809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.914+0000 7fe4b5d9b700 1 --2- 172.21.15.59:0/142130179 >> v2:172.21.15.59:3300/0 conn(0x7fe4b809e930 0x7fe4b809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.914+0000 7fe4b5d9b700 1 -- 172.21.15.59:0/142130179 >> v1:172.21.15.59:6789/0 conn(0x7fe4b809f650 legacy=0x7fe4b8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.914+0000 7fe4b5d9b700 1 -- 172.21.15.59:0/142130179 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b809fb60 con 0x7fe4b809f240 2023-09-30T22:35:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.914+0000 7fe4b659c700 1 --2- 172.21.15.59:0/142130179 >> v2:172.21.15.59:3300/0 conn(0x7fe4b809e930 0x7fe4b809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.914+0000 7fe4b5d9b700 1 --2- 172.21.15.59:0/142130179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4b809f240 0x7fe4b81317f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009840 tx=0x7fe4a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8e313e2c4d40585 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.914+0000 7fe4b559a700 1 -- 172.21.15.59:0/142130179 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0011830 con 0x7fe4b809f240 2023-09-30T22:35:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.915+0000 7fe4b559a700 1 -- 172.21.15.59:0/142130179 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a0011990 con 0x7fe4b809f240 2023-09-30T22:35:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.915+0000 7fe4b559a700 1 -- 172.21.15.59:0/142130179 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0011d20 con 0x7fe4b809f240 2023-09-30T22:35:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.915+0000 7fe4bc87d700 1 -- 172.21.15.59:0/142130179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4b809f240 msgr2=0x7fe4b81317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.915+0000 7fe4bc87d700 1 --2- 172.21.15.59:0/142130179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4b809f240 0x7fe4b81317f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009840 tx=0x7fe4a0009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.915+0000 7fe4bc87d700 1 -- 172.21.15.59:0/142130179 shutdown_connections 2023-09-30T22:35:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.915+0000 7fe4bc87d700 1 --2- 172.21.15.59:0/142130179 >> v2:172.21.15.59:3300/0 conn(0x7fe4b809e930 0x7fe4b809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.915+0000 7fe4bc87d700 1 --2- 172.21.15.59:0/142130179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4b809f240 0x7fe4b81317f0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.915+0000 7fe4bc87d700 1 -- 172.21.15.59:0/142130179 >> 172.21.15.59:0/142130179 conn(0x7fe4b80a4210 msgr2=0x7fe4b80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.915+0000 7fe4bc87d700 1 -- 172.21.15.59:0/142130179 shutdown_connections 2023-09-30T22:35:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.915+0000 7fe4bc87d700 1 -- 172.21.15.59:0/142130179 wait complete. 2023-09-30T22:35:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.916+0000 7fe4bc87d700 1 Processor -- start 2023-09-30T22:35:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.916+0000 7fe4bc87d700 1 -- start start 2023-09-30T22:35:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4bc87d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4b809e930 0x7fe4b81a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4bc87d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4b809f240 0x7fe4b81a6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4bc87d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4b809f650 0x7fe4b81a6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4bc87d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b81a71a0 con 0x7fe4b809f240 2023-09-30T22:35:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4bc87d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b81a78b0 con 0x7fe4b809e930 2023-09-30T22:35:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4bc87d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b81a7ed0 con 0x7fe4b809f650 2023-09-30T22:35:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4b659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4b809e930 0x7fe4b81a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4b6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4b809f650 0x7fe4b81a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4b659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4b809e930 0x7fe4b81a5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41134/0 (socket says 172.21.15.59:41134) 2023-09-30T22:35:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4b5d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4b809f240 0x7fe4b81a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4b659c700 1 -- 172.21.15.59:0/2021485258 learned_addr learned my addr 172.21.15.59:0/2021485258 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4b659c700 1 -- 172.21.15.59:0/2021485258 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4b809f650 msgr2=0x7fe4b81a6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4b659c700 1 --2- 172.21.15.59:0/2021485258 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4b809f650 0x7fe4b81a6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4b659c700 1 -- 172.21.15.59:0/2021485258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4b809f240 msgr2=0x7fe4b81a6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4b659c700 1 --2- 172.21.15.59:0/2021485258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4b809f240 0x7fe4b81a6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4b659c700 1 -- 172.21.15.59:0/2021485258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a8009b30 con 0x7fe4b809e930 2023-09-30T22:35:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4b5d9b700 1 --2- 172.21.15.59:0/2021485258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4b809f240 0x7fe4b81a6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.917+0000 7fe4b6d9d700 1 --2- 172.21.15.59:0/2021485258 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4b809f650 0x7fe4b81a6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.918+0000 7fe4b659c700 1 --2- 172.21.15.59:0/2021485258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4b809e930 0x7fe4b81a5cf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800efc0 tx=0x7fe4a800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.918+0000 7fe4aeffd700 1 -- 172.21.15.59:0/2021485258 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a800cb00 con 0x7fe4b809e930 2023-09-30T22:35:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.918+0000 7fe4aeffd700 1 -- 172.21.15.59:0/2021485258 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a800f040 con 0x7fe4b809e930 2023-09-30T22:35:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.918+0000 7fe4bc87d700 1 -- 172.21.15.59:0/2021485258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a00094a0 con 0x7fe4b809e930 2023-09-30T22:35:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.918+0000 7fe4aeffd700 1 -- 172.21.15.59:0/2021485258 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a800ce80 con 0x7fe4b809e930 2023-09-30T22:35:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.918+0000 7fe4bc87d700 1 -- 172.21.15.59:0/2021485258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b80a0190 con 0x7fe4b809e930 2023-09-30T22:35:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.919+0000 7fe4aeffd700 1 -- 172.21.15.59:0/2021485258 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4a8014480 con 0x7fe4b809e930 2023-09-30T22:35:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.919+0000 7fe4aeffd700 1 -- 172.21.15.59:0/2021485258 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe4a803fcb0 con 0x7fe4b809e930 2023-09-30T22:35:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.919+0000 7fe4bc87d700 1 -- 172.21.15.59:0/2021485258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b81a2b40 con 0x7fe4b809e930 2023-09-30T22:35:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:12.924+0000 7fe4aeffd700 1 -- 172.21.15.59:0/2021485258 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4a8012910 con 0x7fe4b809e930 2023-09-30T22:35:13.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.092+0000 7f94e74fa700 1 -- 172.21.15.59:0/1319206266 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f94e004f2a0 con 0x7f94e00a09c0 2023-09-30T22:35:13.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.092+0000 7f94ddffb700 1 -- 172.21.15.59:0/1319206266 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94d002c090 con 0x7f94e00a09c0 2023-09-30T22:35:13.094 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.095+0000 7f94e74fa700 1 -- 172.21.15.59:0/1319206266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e00a09c0 msgr2=0x7f94e0132710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.095+0000 7f94e74fa700 1 --2- 172.21.15.59:0/1319206266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e00a09c0 0x7f94e0132710 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f94d000efc0 tx=0x7f94d000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.095+0000 7f94e74fa700 1 -- 172.21.15.59:0/1319206266 shutdown_connections 2023-09-30T22:35:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.095+0000 7f94e74fa700 1 --2- 172.21.15.59:0/1319206266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e01338a0 0x7f94e01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.095+0000 7f94e74fa700 1 --2- 172.21.15.59:0/1319206266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e00a09c0 0x7f94e0132710 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.095+0000 7f94e74fa700 1 --2- 172.21.15.59:0/1319206266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e00a0d90 0x7f94e0132c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.095+0000 7f94e74fa700 1 -- 172.21.15.59:0/1319206266 >> 172.21.15.59:0/1319206266 conn(0x7f94e00a60c0 msgr2=0x7f94e009ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.095+0000 7f94e74fa700 1 -- 172.21.15.59:0/1319206266 shutdown_connections 2023-09-30T22:35:13.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.095+0000 7f94e74fa700 1 -- 172.21.15.59:0/1319206266 wait complete. 2023-09-30T22:35:13.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:13.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.128+0000 7fe4bc87d700 1 -- 172.21.15.59:0/2021485258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe4b80a34f0 con 0x7fe4b809e930 2023-09-30T22:35:13.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.128+0000 7fe4aeffd700 1 -- 172.21.15.59:0/2021485258 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4a802c090 con 0x7fe4b809e930 2023-09-30T22:35:13.130 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:13.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.131+0000 7fe4bc87d700 1 -- 172.21.15.59:0/2021485258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4b809e930 msgr2=0x7fe4b81a5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:13.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.131+0000 7fe4bc87d700 1 --2- 172.21.15.59:0/2021485258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4b809e930 0x7fe4b81a5cf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800efc0 tx=0x7fe4a800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.131+0000 7fe4bc87d700 1 -- 172.21.15.59:0/2021485258 shutdown_connections 2023-09-30T22:35:13.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.131+0000 7fe4bc87d700 1 --2- 172.21.15.59:0/2021485258 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4b809f650 0x7fe4b81a6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.131+0000 7fe4bc87d700 1 --2- 172.21.15.59:0/2021485258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4b809e930 0x7fe4b81a5cf0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.131+0000 7fe4bc87d700 1 --2- 172.21.15.59:0/2021485258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4b809f240 0x7fe4b81a6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.131+0000 7fe4bc87d700 1 -- 172.21.15.59:0/2021485258 >> 172.21.15.59:0/2021485258 conn(0x7fe4b80a4210 msgr2=0x7fe4b809dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:13.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.131+0000 7fe4bc87d700 1 -- 172.21.15.59:0/2021485258 shutdown_connections 2023-09-30T22:35:13.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.131+0000 7fe4bc87d700 1 -- 172.21.15.59:0/2021485258 wait complete. 2023-09-30T22:35:13.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:13.642 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:13.680 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.789+0000 7fb6db6d3700 1 Processor -- start 2023-09-30T22:35:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.789+0000 7fb6db6d3700 1 -- start start 2023-09-30T22:35:13.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.789+0000 7fb6db6d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6d40a0a30 0x7fb6d40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:13.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.789+0000 7fb6db6d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6d409d630 0x7fb6d40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.789+0000 7fb6db6d3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6d4133930 0x7fb6d4133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.790+0000 7fb6db6d3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d40a2a70 con 0x7fb6d4133930 2023-09-30T22:35:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.790+0000 7fb6db6d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40a01d0 con 0x7fb6d40a0a30 2023-09-30T22:35:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.790+0000 7fb6db6d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d409e2b0 con 0x7fb6d409d630 2023-09-30T22:35:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.790+0000 7fb6d8c6e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6d409d630 0x7fb6d40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.790+0000 7fb6d9c70700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6d4133930 0x7fb6d4133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.790+0000 7fb6d9c70700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6d4133930 0x7fb6d4133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45462/0 (socket says 172.21.15.59:45462) 2023-09-30T22:35:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.790+0000 7fb6d8c6e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6d409d630 0x7fb6d40a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53110/0 (socket says 172.21.15.59:53110) 2023-09-30T22:35:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.790+0000 7fb6d9c70700 1 -- 172.21.15.59:0/213229096 learned_addr learned my addr 172.21.15.59:0/213229096 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.790+0000 7fb6d946f700 1 --2- 172.21.15.59:0/213229096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6d40a0a30 0x7fb6d40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.790+0000 7fb6d8c6e700 1 -- 172.21.15.59:0/213229096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6d40a0a30 msgr2=0x7fb6d40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.790+0000 7fb6d8c6e700 1 --2- 172.21.15.59:0/213229096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6d40a0a30 0x7fb6d40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.790+0000 7fb6d8c6e700 1 -- 172.21.15.59:0/213229096 >> v2:172.21.15.59:3300/0 conn(0x7fb6d4133930 msgr2=0x7fb6d4133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.790+0000 7fb6d8c6e700 1 --2- 172.21.15.59:0/213229096 >> v2:172.21.15.59:3300/0 conn(0x7fb6d4133930 0x7fb6d4133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.790+0000 7fb6d8c6e700 1 -- 172.21.15.59:0/213229096 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d409dc50 con 0x7fb6d409d630 2023-09-30T22:35:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.791+0000 7fb6d8c6e700 1 --2- 172.21.15.59:0/213229096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6d409d630 0x7fb6d40a1340 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009840 tx=0x7fb6c4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65f086f80c999c7f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.791+0000 7fb6cbfff700 1 -- 172.21.15.59:0/213229096 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4011830 con 0x7fb6d409d630 2023-09-30T22:35:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.792+0000 7fb6cbfff700 1 -- 172.21.15.59:0/213229096 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c4011990 con 0x7fb6d409d630 2023-09-30T22:35:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.792+0000 7fb6cbfff700 1 -- 172.21.15.59:0/213229096 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4011d20 con 0x7fb6d409d630 2023-09-30T22:35:13.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.793+0000 7fb6db6d3700 1 -- 172.21.15.59:0/213229096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6d409d630 msgr2=0x7fb6d40a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:13.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.793+0000 7fb6db6d3700 1 --2- 172.21.15.59:0/213229096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6d409d630 0x7fb6d40a1340 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009840 tx=0x7fb6c4009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.793+0000 7fb6db6d3700 1 -- 172.21.15.59:0/213229096 shutdown_connections 2023-09-30T22:35:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.793+0000 7fb6db6d3700 1 --2- 172.21.15.59:0/213229096 >> v2:172.21.15.59:3300/0 conn(0x7fb6d4133930 0x7fb6d4133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.793+0000 7fb6db6d3700 1 --2- 172.21.15.59:0/213229096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6d40a0a30 0x7fb6d40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.793+0000 7fb6db6d3700 1 --2- 172.21.15.59:0/213229096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6d409d630 0x7fb6d40a1340 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.793+0000 7fb6db6d3700 1 -- 172.21.15.59:0/213229096 >> 172.21.15.59:0/213229096 conn(0x7fb6d40a3050 msgr2=0x7fb6d40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.794+0000 7fb6db6d3700 1 -- 172.21.15.59:0/213229096 shutdown_connections 2023-09-30T22:35:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.794+0000 7fb6db6d3700 1 -- 172.21.15.59:0/213229096 wait complete. 2023-09-30T22:35:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.795+0000 7fb6db6d3700 1 Processor -- start 2023-09-30T22:35:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.795+0000 7fb6db6d3700 1 -- start start 2023-09-30T22:35:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.795+0000 7fb6db6d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d409d630 0x7fb6d411e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.795+0000 7fb6db6d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6d40a0a30 0x7fb6d411ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.795+0000 7fb6db6d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6d4133930 0x7fb6d411f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.795+0000 7fb6db6d3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d41204d0 con 0x7fb6d409d630 2023-09-30T22:35:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.795+0000 7fb6db6d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40a5e50 con 0x7fb6d40a0a30 2023-09-30T22:35:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.795+0000 7fb6db6d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40a0410 con 0x7fb6d4133930 2023-09-30T22:35:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.796+0000 7fb6d8c6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6d40a0a30 0x7fb6d411ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.796+0000 7fb6d8c6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6d40a0a30 0x7fb6d411ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41152/0 (socket says 172.21.15.59:41152) 2023-09-30T22:35:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.796+0000 7fb6d8c6e700 1 -- 172.21.15.59:0/2589781873 learned_addr learned my addr 172.21.15.59:0/2589781873 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.796+0000 7fb6d9c70700 1 --2- 172.21.15.59:0/2589781873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6d4133930 0x7fb6d411f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.796+0000 7fb6d946f700 1 --2- 172.21.15.59:0/2589781873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d409d630 0x7fb6d411e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.796+0000 7fb6d8c6e700 1 -- 172.21.15.59:0/2589781873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6d4133930 msgr2=0x7fb6d411f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.796+0000 7fb6d8c6e700 1 --2- 172.21.15.59:0/2589781873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6d4133930 0x7fb6d411f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.796+0000 7fb6d8c6e700 1 -- 172.21.15.59:0/2589781873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d409d630 msgr2=0x7fb6d411e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.796+0000 7fb6d8c6e700 1 --2- 172.21.15.59:0/2589781873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d409d630 0x7fb6d411e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.796+0000 7fb6d8c6e700 1 -- 172.21.15.59:0/2589781873 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c40094a0 con 0x7fb6d40a0a30 2023-09-30T22:35:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.796+0000 7fb6d9c70700 1 --2- 172.21.15.59:0/2589781873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6d4133930 0x7fb6d411f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.796+0000 7fb6d8c6e700 1 --2- 172.21.15.59:0/2589781873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6d40a0a30 0x7fb6d411ee20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40090b0 tx=0x7fb6c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.796+0000 7fb6c9ffb700 1 -- 172.21.15.59:0/2589781873 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4004240 con 0x7fb6d40a0a30 2023-09-30T22:35:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.797+0000 7fb6c9ffb700 1 -- 172.21.15.59:0/2589781873 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c401f070 con 0x7fb6d40a0a30 2023-09-30T22:35:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.797+0000 7fb6c9ffb700 1 -- 172.21.15.59:0/2589781873 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40036a0 con 0x7fb6d40a0a30 2023-09-30T22:35:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.797+0000 7fb6db6d3700 1 -- 172.21.15.59:0/2589781873 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d4133260 con 0x7fb6d40a0a30 2023-09-30T22:35:13.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.797+0000 7fb6db6d3700 1 -- 172.21.15.59:0/2589781873 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d41222d0 con 0x7fb6d40a0a30 2023-09-30T22:35:13.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.798+0000 7fb6c9ffb700 1 -- 172.21.15.59:0/2589781873 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6c4021030 con 0x7fb6d40a0a30 2023-09-30T22:35:13.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.798+0000 7fb6c9ffb700 1 -- 172.21.15.59:0/2589781873 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb6c40407e0 con 0x7fb6d40a0a30 2023-09-30T22:35:13.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.798+0000 7fb6db6d3700 1 -- 172.21.15.59:0/2589781873 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d40747f0 con 0x7fb6d40a0a30 2023-09-30T22:35:13.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.803+0000 7fb6c9ffb700 1 -- 172.21.15.59:0/2589781873 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6c40239c0 con 0x7fb6d40a0a30 2023-09-30T22:35:13.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.832+0000 7f7e5e91e700 1 Processor -- start 2023-09-30T22:35:13.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.832+0000 7f7e5e91e700 1 -- start start 2023-09-30T22:35:13.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.832+0000 7f7e5e91e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e580a0a30 0x7f7e580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:13.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.832+0000 7f7e5e91e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e58138d80 0x7f7e5813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:13.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.832+0000 7f7e5e91e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e580a2a70 con 0x7f7e5809d630 2023-09-30T22:35:13.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.832+0000 7f7e5e91e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e580a01d0 con 0x7f7e580a0a30 2023-09-30T22:35:13.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.832+0000 7f7e5e91e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5809e2b0 con 0x7f7e58138d80 2023-09-30T22:35:13.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.832+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e580a0a30 0x7f7e580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:13.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.832+0000 7f7e5cebb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e58138d80 0x7f7e5813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:13.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.832+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e580a0a30 0x7f7e580a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41154/0 (socket says 172.21.15.59:41154) 2023-09-30T22:35:13.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.832+0000 7f7e577fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7e5809d630 0x7f7e580a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39968/0 (socket says 172.21.15.59:39968) 2023-09-30T22:35:13.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.832+0000 7f7e57fff700 1 -- 172.21.15.59:0/4221885128 learned_addr learned my addr 172.21.15.59:0/4221885128 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:13.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.833+0000 7f7e57fff700 1 -- 172.21.15.59:0/4221885128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e58138d80 msgr2=0x7f7e5813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:13.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.833+0000 7f7e57fff700 1 --2- 172.21.15.59:0/4221885128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e58138d80 0x7f7e5813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.833+0000 7f7e57fff700 1 -- 172.21.15.59:0/4221885128 >> v1:172.21.15.59:6789/0 conn(0x7f7e5809d630 legacy=0x7f7e580a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:13.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.833+0000 7f7e57fff700 1 -- 172.21.15.59:0/4221885128 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5809dc50 con 0x7f7e580a0a30 2023-09-30T22:35:13.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.833+0000 7f7e56ffd700 1 -- 172.21.15.59:0/4221885128 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75907361 0 0) 0x7f7e580a2a70 con 0x7f7e5809d630 2023-09-30T22:35:13.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.833+0000 7f7e5cebb700 1 --2- 172.21.15.59:0/4221885128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e58138d80 0x7f7e5813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:13.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.833+0000 7f7e57fff700 1 --2- 172.21.15.59:0/4221885128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e580a0a30 0x7f7e580a0e00 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009920 tx=0x7f7e48009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=535d3d72cf66f85a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:13.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.833+0000 7f7e56ffd700 1 -- 172.21.15.59:0/4221885128 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48011830 con 0x7f7e580a0a30 2023-09-30T22:35:13.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.833+0000 7f7e56ffd700 1 -- 172.21.15.59:0/4221885128 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e48011990 con 0x7f7e580a0a30 2023-09-30T22:35:13.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.833+0000 7f7e56ffd700 1 -- 172.21.15.59:0/4221885128 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48011d20 con 0x7f7e580a0a30 2023-09-30T22:35:13.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.834+0000 7f7e5e91e700 1 -- 172.21.15.59:0/4221885128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e580a0a30 msgr2=0x7f7e580a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:13.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.834+0000 7f7e5e91e700 1 --2- 172.21.15.59:0/4221885128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e580a0a30 0x7f7e580a0e00 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009920 tx=0x7f7e48009c30 comp rx=0 tx=0).stop 2023-09-30T22:35:13.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.834+0000 7f7e5e91e700 1 -- 172.21.15.59:0/4221885128 shutdown_connections 2023-09-30T22:35:13.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.834+0000 7f7e5e91e700 1 --2- 172.21.15.59:0/4221885128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e58138d80 0x7f7e5813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.834+0000 7f7e5e91e700 1 --2- 172.21.15.59:0/4221885128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e580a0a30 0x7f7e580a0e00 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.834+0000 7f7e5e91e700 1 -- 172.21.15.59:0/4221885128 >> 172.21.15.59:0/4221885128 conn(0x7f7e580a3050 msgr2=0x7f7e580a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:13.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.834+0000 7f7e5e91e700 1 -- 172.21.15.59:0/4221885128 shutdown_connections 2023-09-30T22:35:13.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.834+0000 7f7e5e91e700 1 -- 172.21.15.59:0/4221885128 wait complete. 2023-09-30T22:35:13.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.835+0000 7f7e5e91e700 1 Processor -- start 2023-09-30T22:35:13.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.835+0000 7f7e5e91e700 1 -- start start 2023-09-30T22:35:13.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e5e91e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e5809d630 0x7f7e58133780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:13.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e5e91e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e580a0a30 0x7f7e58133cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:13.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e5e91e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e58138d80 0x7f7e58134200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:13.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e5e91e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e580a0410 con 0x7f7e580a0a30 2023-09-30T22:35:13.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e5e91e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e58137ed0 con 0x7f7e5809d630 2023-09-30T22:35:13.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e5e91e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e58137320 con 0x7f7e58138d80 2023-09-30T22:35:13.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e5809d630 0x7f7e58133780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:13.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e577fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e580a0a30 0x7f7e58133cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:13.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e5809d630 0x7f7e58133780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41170/0 (socket says 172.21.15.59:41170) 2023-09-30T22:35:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e577fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e580a0a30 0x7f7e58133cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45486/0 (socket says 172.21.15.59:45486) 2023-09-30T22:35:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e57fff700 1 -- 172.21.15.59:0/2841494419 learned_addr learned my addr 172.21.15.59:0/2841494419 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e5cebb700 1 --2- 172.21.15.59:0/2841494419 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e58138d80 0x7f7e58134200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e57fff700 1 -- 172.21.15.59:0/2841494419 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e58138d80 msgr2=0x7f7e58134200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e57fff700 1 --2- 172.21.15.59:0/2841494419 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e58138d80 0x7f7e58134200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e57fff700 1 -- 172.21.15.59:0/2841494419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e580a0a30 msgr2=0x7f7e58133cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e57fff700 1 --2- 172.21.15.59:0/2841494419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e580a0a30 0x7f7e58133cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e57fff700 1 -- 172.21.15.59:0/2841494419 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e50009a70 con 0x7f7e5809d630 2023-09-30T22:35:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e577fe700 1 --2- 172.21.15.59:0/2841494419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e580a0a30 0x7f7e58133cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.836+0000 7f7e57fff700 1 --2- 172.21.15.59:0/2841494419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e5809d630 0x7f7e58133780 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7e480098f0 tx=0x7f7e48004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.837+0000 7f7e54ff9700 1 -- 172.21.15.59:0/2841494419 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48004240 con 0x7f7e5809d630 2023-09-30T22:35:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.837+0000 7f7e54ff9700 1 -- 172.21.15.59:0/2841494419 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4801f070 con 0x7f7e5809d630 2023-09-30T22:35:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.837+0000 7f7e5e91e700 1 -- 172.21.15.59:0/2841494419 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e48009550 con 0x7f7e5809d630 2023-09-30T22:35:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.837+0000 7f7e54ff9700 1 -- 172.21.15.59:0/2841494419 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e480045e0 con 0x7f7e5809d630 2023-09-30T22:35:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.837+0000 7f7e5e91e700 1 -- 172.21.15.59:0/2841494419 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e58136f30 con 0x7f7e5809d630 2023-09-30T22:35:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.837+0000 7f7e54ff9700 1 -- 172.21.15.59:0/2841494419 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e48021030 con 0x7f7e5809d630 2023-09-30T22:35:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.838+0000 7f7e54ff9700 1 -- 172.21.15.59:0/2841494419 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7e480408b0 con 0x7f7e5809d630 2023-09-30T22:35:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.838+0000 7f7e5e91e700 1 -- 172.21.15.59:0/2841494419 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e580747f0 con 0x7f7e5809d630 2023-09-30T22:35:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:13.843+0000 7f7e54ff9700 1 -- 172.21.15.59:0/2841494419 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e48015020 con 0x7f7e5809d630 2023-09-30T22:35:14.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.013+0000 7fb6db6d3700 1 -- 172.21.15.59:0/2589781873 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb6d4072980 con 0x7fb6d40a0a30 2023-09-30T22:35:14.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.013+0000 7fb6c9ffb700 1 -- 172.21.15.59:0/2589781873 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6c40233d0 con 0x7fb6d40a0a30 2023-09-30T22:35:14.014 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:14.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.015+0000 7fb6db6d3700 1 -- 172.21.15.59:0/2589781873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6d40a0a30 msgr2=0x7fb6d411ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:14.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.015+0000 7fb6db6d3700 1 --2- 172.21.15.59:0/2589781873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6d40a0a30 0x7fb6d411ee20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40090b0 tx=0x7fb6c4004750 comp rx=0 tx=0).stop 2023-09-30T22:35:14.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.015+0000 7fb6db6d3700 1 -- 172.21.15.59:0/2589781873 shutdown_connections 2023-09-30T22:35:14.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.015+0000 7fb6db6d3700 1 --2- 172.21.15.59:0/2589781873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6d4133930 0x7fb6d411f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.015+0000 7fb6db6d3700 1 --2- 172.21.15.59:0/2589781873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6d409d630 0x7fb6d411e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.015+0000 7fb6db6d3700 1 --2- 172.21.15.59:0/2589781873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6d40a0a30 0x7fb6d411ee20 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.015+0000 7fb6db6d3700 1 -- 172.21.15.59:0/2589781873 >> 172.21.15.59:0/2589781873 conn(0x7fb6d40a3050 msgr2=0x7fb6d409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:14.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.015+0000 7fb6db6d3700 1 -- 172.21.15.59:0/2589781873 shutdown_connections 2023-09-30T22:35:14.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.015+0000 7fb6db6d3700 1 -- 172.21.15.59:0/2589781873 wait complete. 2023-09-30T22:35:14.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:14.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.047+0000 7f7e5e91e700 1 -- 172.21.15.59:0/2841494419 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7e58135af0 con 0x7f7e5809d630 2023-09-30T22:35:14.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.048+0000 7f7e54ff9700 1 -- 172.21.15.59:0/2841494419 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e48003e00 con 0x7f7e5809d630 2023-09-30T22:35:14.049 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:14.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.050+0000 7f7e5e91e700 1 -- 172.21.15.59:0/2841494419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e5809d630 msgr2=0x7f7e58133780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:14.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.050+0000 7f7e5e91e700 1 --2- 172.21.15.59:0/2841494419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e5809d630 0x7f7e58133780 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7e480098f0 tx=0x7f7e48004750 comp rx=0 tx=0).stop 2023-09-30T22:35:14.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.050+0000 7f7e5e91e700 1 -- 172.21.15.59:0/2841494419 shutdown_connections 2023-09-30T22:35:14.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.050+0000 7f7e5e91e700 1 --2- 172.21.15.59:0/2841494419 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e58138d80 0x7f7e58134200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.050+0000 7f7e5e91e700 1 --2- 172.21.15.59:0/2841494419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e5809d630 0x7f7e58133780 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.050+0000 7f7e5e91e700 1 --2- 172.21.15.59:0/2841494419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e580a0a30 0x7f7e58133cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.050+0000 7f7e5e91e700 1 -- 172.21.15.59:0/2841494419 >> 172.21.15.59:0/2841494419 conn(0x7f7e580a3050 msgr2=0x7f7e5809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:14.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.050+0000 7f7e5e91e700 1 -- 172.21.15.59:0/2841494419 shutdown_connections 2023-09-30T22:35:14.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.050+0000 7f7e5e91e700 1 -- 172.21.15.59:0/2841494419 wait complete. 2023-09-30T22:35:14.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:14.111 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:14.146 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:14.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.252+0000 7f8d9250d700 1 Processor -- start 2023-09-30T22:35:14.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.252+0000 7f8d9250d700 1 -- start start 2023-09-30T22:35:14.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.253+0000 7f8d9250d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d8c0a0a30 0x7f8d8c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:14.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.253+0000 7f8d9250d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d8c134170 0x7f8d8c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:14.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.253+0000 7f8d9250d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8c09edd0 con 0x7f8d8c0a1340 2023-09-30T22:35:14.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.253+0000 7f8d9250d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c09e1f0 con 0x7f8d8c134170 2023-09-30T22:35:14.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.253+0000 7f8d9250d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c09dc50 con 0x7f8d8c0a0a30 2023-09-30T22:35:14.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.253+0000 7f8d8bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d8c0a0a30 0x7f8d8c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:14.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.253+0000 7f8d8b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8d8c0a1340 0x7f8d8c133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39976/0 (socket says 172.21.15.59:39976) 2023-09-30T22:35:14.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.253+0000 7f8d8b7fe700 1 -- 172.21.15.59:0/964803805 learned_addr learned my addr 172.21.15.59:0/964803805 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:14.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.253+0000 7f8d90aaa700 1 --2- 172.21.15.59:0/964803805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d8c134170 0x7f8d8c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:14.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.253+0000 7f8d8bfff700 1 -- 172.21.15.59:0/964803805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d8c134170 msgr2=0x7f8d8c13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:14.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.253+0000 7f8d8bfff700 1 --2- 172.21.15.59:0/964803805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d8c134170 0x7f8d8c13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.253+0000 7f8d8bfff700 1 -- 172.21.15.59:0/964803805 >> v1:172.21.15.59:6789/0 conn(0x7f8d8c0a1340 legacy=0x7f8d8c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:14.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.253+0000 7f8d8bfff700 1 -- 172.21.15.59:0/964803805 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c0a1fe0 con 0x7f8d8c0a0a30 2023-09-30T22:35:14.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.253+0000 7f8d8affd700 1 -- 172.21.15.59:0/964803805 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010533880 0 0) 0x7f8d8c09edd0 con 0x7f8d8c0a1340 2023-09-30T22:35:14.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.253+0000 7f8d90aaa700 1 --2- 172.21.15.59:0/964803805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d8c134170 0x7f8d8c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:14.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.254+0000 7f8d8bfff700 1 --2- 172.21.15.59:0/964803805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d8c0a0a30 0x7f8d8c0a0e00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009870 tx=0x7f8d7c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4e70ad585582f8f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:14.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.254+0000 7f8d8affd700 1 -- 172.21.15.59:0/964803805 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c011830 con 0x7f8d8c0a0a30 2023-09-30T22:35:14.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.254+0000 7f8d8affd700 1 -- 172.21.15.59:0/964803805 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c011990 con 0x7f8d8c0a0a30 2023-09-30T22:35:14.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.254+0000 7f8d8affd700 1 -- 172.21.15.59:0/964803805 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c011d20 con 0x7f8d8c0a0a30 2023-09-30T22:35:14.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.254+0000 7f8d9250d700 1 -- 172.21.15.59:0/964803805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d8c0a0a30 msgr2=0x7f8d8c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:14.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.254+0000 7f8d9250d700 1 --2- 172.21.15.59:0/964803805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d8c0a0a30 0x7f8d8c0a0e00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009870 tx=0x7f8d7c009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:14.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.254+0000 7f8d9250d700 1 -- 172.21.15.59:0/964803805 shutdown_connections 2023-09-30T22:35:14.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.254+0000 7f8d9250d700 1 --2- 172.21.15.59:0/964803805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d8c0a0a30 0x7f8d8c0a0e00 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.254+0000 7f8d9250d700 1 --2- 172.21.15.59:0/964803805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d8c134170 0x7f8d8c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.254+0000 7f8d9250d700 1 -- 172.21.15.59:0/964803805 >> 172.21.15.59:0/964803805 conn(0x7f8d8c0a6550 msgr2=0x7f8d8c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:14.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.255+0000 7f8d9250d700 1 -- 172.21.15.59:0/964803805 shutdown_connections 2023-09-30T22:35:14.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.255+0000 7f8d9250d700 1 -- 172.21.15.59:0/964803805 wait complete. 2023-09-30T22:35:14.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.256+0000 7f8d9250d700 1 Processor -- start 2023-09-30T22:35:14.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.256+0000 7f8d9250d700 1 -- start start 2023-09-30T22:35:14.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.256+0000 7f8d9250d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d8c0a0a30 0x7f8d8c1c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:14.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.256+0000 7f8d9250d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8c0a1340 0x7f8d8c1c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:14.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.256+0000 7f8d9250d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d8c134170 0x7f8d8c1229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:14.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.256+0000 7f8d9250d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c127030 con 0x7f8d8c0a1340 2023-09-30T22:35:14.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.256+0000 7f8d9250d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c126200 con 0x7f8d8c134170 2023-09-30T22:35:14.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.256+0000 7f8d9250d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c126450 con 0x7f8d8c0a0a30 2023-09-30T22:35:14.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.256+0000 7f8d8b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8c0a1340 0x7f8d8c1c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:14.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.256+0000 7f8d90aaa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d8c134170 0x7f8d8c1229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:14.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.256+0000 7f8d8b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8c0a1340 0x7f8d8c1c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45490/0 (socket says 172.21.15.59:45490) 2023-09-30T22:35:14.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.256+0000 7f8d8b7fe700 1 -- 172.21.15.59:0/759231040 learned_addr learned my addr 172.21.15.59:0/759231040 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:14.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.256+0000 7f8d8bfff700 1 --2- 172.21.15.59:0/759231040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d8c0a0a30 0x7f8d8c1c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:14.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.257+0000 7f8d8b7fe700 1 -- 172.21.15.59:0/759231040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d8c0a0a30 msgr2=0x7f8d8c1c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:14.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.257+0000 7f8d8b7fe700 1 --2- 172.21.15.59:0/759231040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d8c0a0a30 0x7f8d8c1c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.257+0000 7f8d8b7fe700 1 -- 172.21.15.59:0/759231040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d8c134170 msgr2=0x7f8d8c1229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:14.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.257+0000 7f8d8b7fe700 1 --2- 172.21.15.59:0/759231040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d8c134170 0x7f8d8c1229c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.257+0000 7f8d8b7fe700 1 -- 172.21.15.59:0/759231040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d84009a70 con 0x7f8d8c0a1340 2023-09-30T22:35:14.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.257+0000 7f8d90aaa700 1 --2- 172.21.15.59:0/759231040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d8c134170 0x7f8d8c1229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:14.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.257+0000 7f8d8b7fe700 1 --2- 172.21.15.59:0/759231040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8c0a1340 0x7f8d8c1c8d70 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000c520 tx=0x7f8d8000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:14.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.257+0000 7f8d88ff9700 1 -- 172.21.15.59:0/759231040 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d80004c80 con 0x7f8d8c0a1340 2023-09-30T22:35:14.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.257+0000 7f8d88ff9700 1 -- 172.21.15.59:0/759231040 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d80004e00 con 0x7f8d8c0a1340 2023-09-30T22:35:14.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.257+0000 7f8d9250d700 1 -- 172.21.15.59:0/759231040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c0094a0 con 0x7f8d8c0a1340 2023-09-30T22:35:14.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.257+0000 7f8d88ff9700 1 -- 172.21.15.59:0/759231040 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d80007310 con 0x7f8d8c0a1340 2023-09-30T22:35:14.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.257+0000 7f8d9250d700 1 -- 172.21.15.59:0/759231040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c0a25e0 con 0x7f8d8c0a1340 2023-09-30T22:35:14.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.258+0000 7f8d88ff9700 1 -- 172.21.15.59:0/759231040 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d80007470 con 0x7f8d8c0a1340 2023-09-30T22:35:14.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.258+0000 7f8d88ff9700 1 -- 172.21.15.59:0/759231040 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d8003f2d0 con 0x7f8d8c0a1340 2023-09-30T22:35:14.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.258+0000 7f8d9250d700 1 -- 172.21.15.59:0/759231040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8c0a0220 con 0x7f8d8c0a1340 2023-09-30T22:35:14.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.263+0000 7f8d88ff9700 1 -- 172.21.15.59:0/759231040 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d800123b0 con 0x7f8d8c0a1340 2023-09-30T22:35:14.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.293+0000 7f7d03fda700 1 Processor -- start 2023-09-30T22:35:14.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.293+0000 7f7d03fda700 1 -- start start 2023-09-30T22:35:14.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.293+0000 7f7d03fda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0a1510 0x7f7cfc138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:14.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.293+0000 7f7d03fda700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc139250 0x7f7cfc13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:14.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.293+0000 7f7d03fda700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cfc09edd0 con 0x7f7cfc0a0a30 2023-09-30T22:35:14.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.293+0000 7f7d03fda700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc0a18e0 con 0x7f7cfc0a1510 2023-09-30T22:35:14.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.293+0000 7f7d03fda700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc09e1f0 con 0x7f7cfc139250 2023-09-30T22:35:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.294+0000 7f7d02577700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc139250 0x7f7cfc13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.294+0000 7f7d01d76700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7cfc0a0a30 0x7f7cfc0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39984/0 (socket says 172.21.15.59:39984) 2023-09-30T22:35:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.294+0000 7f7d01d76700 1 -- 172.21.15.59:0/3053514524 learned_addr learned my addr 172.21.15.59:0/3053514524 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.294+0000 7f7d01575700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0a1510 0x7f7cfc138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.294+0000 7f7d00d74700 1 -- 172.21.15.59:0/3053514524 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760890414 0 0) 0x7f7cfc09edd0 con 0x7f7cfc0a0a30 2023-09-30T22:35:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.294+0000 7f7d00d74700 1 -- 172.21.15.59:0/3053514524 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce40035b0 con 0x7f7cfc0a0a30 2023-09-30T22:35:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.294+0000 7f7d02577700 1 -- 172.21.15.59:0/3053514524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0a1510 msgr2=0x7f7cfc138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.294+0000 7f7d02577700 1 --2- 172.21.15.59:0/3053514524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0a1510 0x7f7cfc138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.294+0000 7f7d02577700 1 -- 172.21.15.59:0/3053514524 >> v1:172.21.15.59:6789/0 conn(0x7f7cfc0a0a30 legacy=0x7f7cfc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.294+0000 7f7d02577700 1 -- 172.21.15.59:0/3053514524 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc09dc50 con 0x7f7cfc139250 2023-09-30T22:35:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.294+0000 7f7d01575700 1 --2- 172.21.15.59:0/3053514524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0a1510 0x7f7cfc138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.294+0000 7f7d02577700 1 --2- 172.21.15.59:0/3053514524 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc139250 0x7f7cfc13b630 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009dc0 tx=0x7f7cec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d9eb441261eb401 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:14.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.294+0000 7f7d00d74700 1 -- 172.21.15.59:0/3053514524 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec00e070 con 0x7f7cfc139250 2023-09-30T22:35:14.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.294+0000 7f7d00d74700 1 -- 172.21.15.59:0/3053514524 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec00bb20 con 0x7f7cfc139250 2023-09-30T22:35:14.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.294+0000 7f7d00d74700 1 -- 172.21.15.59:0/3053514524 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec012430 con 0x7f7cfc139250 2023-09-30T22:35:14.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.295+0000 7f7d03fda700 1 -- 172.21.15.59:0/3053514524 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc139250 msgr2=0x7f7cfc13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:14.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.295+0000 7f7d03fda700 1 --2- 172.21.15.59:0/3053514524 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc139250 0x7f7cfc13b630 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009dc0 tx=0x7f7cec00b330 comp rx=0 tx=0).stop 2023-09-30T22:35:14.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.295+0000 7f7d03fda700 1 -- 172.21.15.59:0/3053514524 shutdown_connections 2023-09-30T22:35:14.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.295+0000 7f7d03fda700 1 --2- 172.21.15.59:0/3053514524 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc139250 0x7f7cfc13b630 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.295+0000 7f7d03fda700 1 --2- 172.21.15.59:0/3053514524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0a1510 0x7f7cfc138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.295+0000 7f7d03fda700 1 -- 172.21.15.59:0/3053514524 >> 172.21.15.59:0/3053514524 conn(0x7f7cfc0a6550 msgr2=0x7f7cfc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:14.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.295+0000 7f7d03fda700 1 -- 172.21.15.59:0/3053514524 shutdown_connections 2023-09-30T22:35:14.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.295+0000 7f7d03fda700 1 -- 172.21.15.59:0/3053514524 wait complete. 2023-09-30T22:35:14.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.296+0000 7f7d03fda700 1 Processor -- start 2023-09-30T22:35:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.296+0000 7f7d03fda700 1 -- start start 2023-09-30T22:35:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d03fda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0a0a30 0x7f7cfc1226e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d03fda700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc0a1510 0x7f7cfc122c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d03fda700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc139250 0x7f7cfc123160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d03fda700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc137ff0 con 0x7f7cfc0a1510 2023-09-30T22:35:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d03fda700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc125c60 con 0x7f7cfc0a0a30 2023-09-30T22:35:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d03fda700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc124b50 con 0x7f7cfc139250 2023-09-30T22:35:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d02577700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc139250 0x7f7cfc123160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d02577700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc139250 0x7f7cfc123160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53188/0 (socket says 172.21.15.59:53188) 2023-09-30T22:35:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d02577700 1 -- 172.21.15.59:0/2530122933 learned_addr learned my addr 172.21.15.59:0/2530122933 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d01d76700 1 --2- 172.21.15.59:0/2530122933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0a0a30 0x7f7cfc1226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d01575700 1 --2- 172.21.15.59:0/2530122933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc0a1510 0x7f7cfc122c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d02577700 1 -- 172.21.15.59:0/2530122933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0a0a30 msgr2=0x7f7cfc1226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d02577700 1 --2- 172.21.15.59:0/2530122933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0a0a30 0x7f7cfc1226e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d02577700 1 -- 172.21.15.59:0/2530122933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc0a1510 msgr2=0x7f7cfc122c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d02577700 1 --2- 172.21.15.59:0/2530122933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc0a1510 0x7f7cfc122c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d02577700 1 -- 172.21.15.59:0/2530122933 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf00094a0 con 0x7f7cfc139250 2023-09-30T22:35:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d01575700 1 --2- 172.21.15.59:0/2530122933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc0a1510 0x7f7cfc122c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:35:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.297+0000 7f7d02577700 1 --2- 172.21.15.59:0/2530122933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc139250 0x7f7cfc123160 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7cec014040 tx=0x7f7cec004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.298+0000 7f7cfa7fc700 1 -- 172.21.15.59:0/2530122933 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0048b0 con 0x7f7cfc139250 2023-09-30T22:35:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.298+0000 7f7cfa7fc700 1 -- 172.21.15.59:0/2530122933 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec020070 con 0x7f7cfc139250 2023-09-30T22:35:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.298+0000 7f7d03fda700 1 -- 172.21.15.59:0/2530122933 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cec009a70 con 0x7f7cfc139250 2023-09-30T22:35:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.298+0000 7f7cfa7fc700 1 -- 172.21.15.59:0/2530122933 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0276c0 con 0x7f7cfc139250 2023-09-30T22:35:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.298+0000 7f7d03fda700 1 -- 172.21.15.59:0/2530122933 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cfc1385d0 con 0x7f7cfc139250 2023-09-30T22:35:14.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.298+0000 7f7cfa7fc700 1 -- 172.21.15.59:0/2530122933 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7cec012430 con 0x7f7cfc139250 2023-09-30T22:35:14.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.299+0000 7f7cfa7fc700 1 -- 172.21.15.59:0/2530122933 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7cec022070 con 0x7f7cfc139250 2023-09-30T22:35:14.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.299+0000 7f7d03fda700 1 -- 172.21.15.59:0/2530122933 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cfc074ea0 con 0x7f7cfc139250 2023-09-30T22:35:14.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.304+0000 7f7cfa7fc700 1 -- 172.21.15.59:0/2530122933 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7cec003e30 con 0x7f7cfc139250 2023-09-30T22:35:14.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.473+0000 7f8d9250d700 1 -- 172.21.15.59:0/759231040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8d8c074ea0 con 0x7f8d8c0a1340 2023-09-30T22:35:14.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.473+0000 7f8d88ff9700 1 -- 172.21.15.59:0/759231040 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d8000ce60 con 0x7f8d8c0a1340 2023-09-30T22:35:14.495 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:14.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.475+0000 7f8d9250d700 1 -- 172.21.15.59:0/759231040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8c0a1340 msgr2=0x7f8d8c1c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:14.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.475+0000 7f8d9250d700 1 --2- 172.21.15.59:0/759231040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8c0a1340 0x7f8d8c1c8d70 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000c520 tx=0x7f8d8000c830 comp rx=0 tx=0).stop 2023-09-30T22:35:14.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.475+0000 7f8d9250d700 1 -- 172.21.15.59:0/759231040 shutdown_connections 2023-09-30T22:35:14.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.475+0000 7f8d9250d700 1 --2- 172.21.15.59:0/759231040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d8c0a0a30 0x7f8d8c1c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.475+0000 7f8d9250d700 1 --2- 172.21.15.59:0/759231040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d8c134170 0x7f8d8c1229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.475+0000 7f8d9250d700 1 --2- 172.21.15.59:0/759231040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8c0a1340 0x7f8d8c1c8d70 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.475+0000 7f8d9250d700 1 -- 172.21.15.59:0/759231040 >> 172.21.15.59:0/759231040 conn(0x7f8d8c0a6550 msgr2=0x7f8d8c09edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:14.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.476+0000 7f8d9250d700 1 -- 172.21.15.59:0/759231040 shutdown_connections 2023-09-30T22:35:14.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.476+0000 7f8d9250d700 1 -- 172.21.15.59:0/759231040 wait complete. 2023-09-30T22:35:14.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:14.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.512+0000 7f7d03fda700 1 -- 172.21.15.59:0/2530122933 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7cfc0a1d10 con 0x7f7cfc139250 2023-09-30T22:35:14.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.512+0000 7f7cfa7fc700 1 -- 172.21.15.59:0/2530122933 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7cec025b70 con 0x7f7cfc139250 2023-09-30T22:35:14.513 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:14.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.514+0000 7f7d03fda700 1 -- 172.21.15.59:0/2530122933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc139250 msgr2=0x7f7cfc123160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:14.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.514+0000 7f7d03fda700 1 --2- 172.21.15.59:0/2530122933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc139250 0x7f7cfc123160 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7cec014040 tx=0x7f7cec004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.514+0000 7f7d03fda700 1 -- 172.21.15.59:0/2530122933 shutdown_connections 2023-09-30T22:35:14.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.514+0000 7f7d03fda700 1 --2- 172.21.15.59:0/2530122933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc139250 0x7f7cfc123160 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.514+0000 7f7d03fda700 1 --2- 172.21.15.59:0/2530122933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0a0a30 0x7f7cfc1226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.514+0000 7f7d03fda700 1 --2- 172.21.15.59:0/2530122933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc0a1510 0x7f7cfc122c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:14.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.515+0000 7f7d03fda700 1 -- 172.21.15.59:0/2530122933 >> 172.21.15.59:0/2530122933 conn(0x7f7cfc0a6550 msgr2=0x7f7cfc11c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:14.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.515+0000 7f7d03fda700 1 -- 172.21.15.59:0/2530122933 shutdown_connections 2023-09-30T22:35:14.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:14.515+0000 7f7d03fda700 1 -- 172.21.15.59:0/2530122933 wait complete. 2023-09-30T22:35:14.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:15.031 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:15.066 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:15.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.180+0000 7f48b8679700 1 Processor -- start 2023-09-30T22:35:15.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.180+0000 7f48b8679700 1 -- start start 2023-09-30T22:35:15.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.181+0000 7f48b8679700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48b009d630 0x7f48b00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.181+0000 7f48b8679700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48b0138d80 0x7f48b013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.181+0000 7f48b8679700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b00a2a70 con 0x7f48b00a0a30 2023-09-30T22:35:15.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.181+0000 7f48b8679700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b00a01d0 con 0x7f48b009d630 2023-09-30T22:35:15.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.181+0000 7f48b8679700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b009e2b0 con 0x7f48b0138d80 2023-09-30T22:35:15.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.181+0000 7f48b6c16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48b0138d80 0x7f48b013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.181+0000 7f48b5c14700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48b009d630 0x7f48b00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.181+0000 7f48b5c14700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48b009d630 0x7f48b00a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53160/0 (socket says 172.21.15.59:53160) 2023-09-30T22:35:15.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.181+0000 7f48b6c16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48b0138d80 0x7f48b013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37566/0 (socket says 172.21.15.59:37566) 2023-09-30T22:35:15.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.181+0000 7f48b5c14700 1 -- 172.21.15.59:0/575303836 learned_addr learned my addr 172.21.15.59:0/575303836 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:15.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.182+0000 7f48b6c16700 1 -- 172.21.15.59:0/575303836 >> v2:172.21.15.59:3300/0 conn(0x7f48b009d630 msgr2=0x7f48b00a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:15.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.182+0000 7f48b6c16700 1 --2- 172.21.15.59:0/575303836 >> v2:172.21.15.59:3300/0 conn(0x7f48b009d630 0x7f48b00a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.182+0000 7f48b6c16700 1 -- 172.21.15.59:0/575303836 >> v1:172.21.15.59:6789/0 conn(0x7f48b00a0a30 legacy=0x7f48b00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:15.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.182+0000 7f48b6c16700 1 -- 172.21.15.59:0/575303836 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b009dc50 con 0x7f48b0138d80 2023-09-30T22:35:15.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.182+0000 7f48b5c14700 1 --2- 172.21.15.59:0/575303836 >> v2:172.21.15.59:3300/0 conn(0x7f48b009d630 0x7f48b00a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:15.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.182+0000 7f48b6c16700 1 --2- 172.21.15.59:0/575303836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48b0138d80 0x7f48b013b160 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009d90 tx=0x7f48a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c76bb2a3c199b1b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:15.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.182+0000 7f48b5413700 1 -- 172.21.15.59:0/575303836 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a800e070 con 0x7f48b0138d80 2023-09-30T22:35:15.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.182+0000 7f48b5413700 1 -- 172.21.15.59:0/575303836 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a800bb20 con 0x7f48b0138d80 2023-09-30T22:35:15.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.182+0000 7f48b5413700 1 -- 172.21.15.59:0/575303836 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a8012430 con 0x7f48b0138d80 2023-09-30T22:35:15.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.183+0000 7f48b8679700 1 -- 172.21.15.59:0/575303836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48b0138d80 msgr2=0x7f48b013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:15.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.183+0000 7f48b8679700 1 --2- 172.21.15.59:0/575303836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48b0138d80 0x7f48b013b160 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009d90 tx=0x7f48a800b330 comp rx=0 tx=0).stop 2023-09-30T22:35:15.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.183+0000 7f48b8679700 1 -- 172.21.15.59:0/575303836 shutdown_connections 2023-09-30T22:35:15.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.183+0000 7f48b8679700 1 --2- 172.21.15.59:0/575303836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48b0138d80 0x7f48b013b160 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.183+0000 7f48b8679700 1 --2- 172.21.15.59:0/575303836 >> v2:172.21.15.59:3300/0 conn(0x7f48b009d630 0x7f48b00a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.183+0000 7f48b8679700 1 -- 172.21.15.59:0/575303836 >> 172.21.15.59:0/575303836 conn(0x7f48b00a3050 msgr2=0x7f48b00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:15.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.183+0000 7f48b8679700 1 -- 172.21.15.59:0/575303836 shutdown_connections 2023-09-30T22:35:15.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.183+0000 7f48b8679700 1 -- 172.21.15.59:0/575303836 wait complete. 2023-09-30T22:35:15.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.184+0000 7f48b8679700 1 Processor -- start 2023-09-30T22:35:15.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.184+0000 7f48b8679700 1 -- start start 2023-09-30T22:35:15.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.184+0000 7f48b8679700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48b009d630 0x7f48b0120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.184+0000 7f48b8679700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48b00a0a30 0x7f48b0120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.184+0000 7f48b8679700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48b0138d80 0x7f48b01210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.184+0000 7f48b8679700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0124140 con 0x7f48b00a0a30 2023-09-30T22:35:15.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.184+0000 7f48b8679700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b01234f0 con 0x7f48b0138d80 2023-09-30T22:35:15.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.184+0000 7f48b8679700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0138b20 con 0x7f48b009d630 2023-09-30T22:35:15.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.184+0000 7f48b5c14700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48b00a0a30 0x7f48b0120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.184+0000 7f48b6415700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48b009d630 0x7f48b0120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.184+0000 7f48b5c14700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48b00a0a30 0x7f48b0120b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53164/0 (socket says 172.21.15.59:53164) 2023-09-30T22:35:15.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.184+0000 7f48b5c14700 1 -- 172.21.15.59:0/1728220395 learned_addr learned my addr 172.21.15.59:0/1728220395 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:15.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.185+0000 7f48b6c16700 1 --2- 172.21.15.59:0/1728220395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48b0138d80 0x7f48b01210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.185+0000 7f48b6415700 1 -- 172.21.15.59:0/1728220395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48b0138d80 msgr2=0x7f48b01210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:15.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.185+0000 7f48b6415700 1 --2- 172.21.15.59:0/1728220395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48b0138d80 0x7f48b01210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.185+0000 7f48b6415700 1 -- 172.21.15.59:0/1728220395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48b00a0a30 msgr2=0x7f48b0120b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:15.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.185+0000 7f48b6415700 1 --2- 172.21.15.59:0/1728220395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48b00a0a30 0x7f48b0120b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.185+0000 7f48b6415700 1 -- 172.21.15.59:0/1728220395 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a4009550 con 0x7f48b009d630 2023-09-30T22:35:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.185+0000 7f48b6415700 1 --2- 172.21.15.59:0/1728220395 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48b009d630 0x7f48b0120620 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f48a0000f60 tx=0x7f48a000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.185+0000 7f48aeffd700 1 -- 172.21.15.59:0/1728220395 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a00052d0 con 0x7f48b009d630 2023-09-30T22:35:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.185+0000 7f48aeffd700 1 -- 172.21.15.59:0/1728220395 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a0005430 con 0x7f48b009d630 2023-09-30T22:35:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.185+0000 7f48aeffd700 1 -- 172.21.15.59:0/1728220395 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a00038c0 con 0x7f48b009d630 2023-09-30T22:35:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.185+0000 7f48b8679700 1 -- 172.21.15.59:0/1728220395 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a8009a70 con 0x7f48b009d630 2023-09-30T22:35:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.185+0000 7f48b8679700 1 -- 172.21.15.59:0/1728220395 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b00a0460 con 0x7f48b009d630 2023-09-30T22:35:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.186+0000 7f48aeffd700 1 -- 172.21.15.59:0/1728220395 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f48a0003a20 con 0x7f48b009d630 2023-09-30T22:35:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.186+0000 7f48aeffd700 1 -- 172.21.15.59:0/1728220395 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f48a003e9c0 con 0x7f48b009d630 2023-09-30T22:35:15.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.187+0000 7f48b8679700 1 -- 172.21.15.59:0/1728220395 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b0124990 con 0x7f48b009d630 2023-09-30T22:35:15.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.192+0000 7f48aeffd700 1 -- 172.21.15.59:0/1728220395 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48a0011590 con 0x7f48b009d630 2023-09-30T22:35:15.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.221+0000 7f4433c7e700 1 Processor -- start 2023-09-30T22:35:15.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.221+0000 7f4433c7e700 1 -- start start 2023-09-30T22:35:15.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.222+0000 7f4433c7e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442c09d6f0 0x7f442c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.222+0000 7f4433c7e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f442c09e000 0x7f442c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.222+0000 7f4433c7e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442c09b120 con 0x7f442c09e410 2023-09-30T22:35:15.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.222+0000 7f4433c7e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442c06b460 con 0x7f442c09e000 2023-09-30T22:35:15.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.222+0000 7f4433c7e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f442c09a7e0 con 0x7f442c09d6f0 2023-09-30T22:35:15.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.222+0000 7f4431a1a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442c09d6f0 0x7f442c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.222+0000 7f4431219700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f442c09e000 0x7f442c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.222+0000 7f4431a1a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442c09d6f0 0x7f442c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44186/0 (socket says 172.21.15.59:44186) 2023-09-30T22:35:15.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.222+0000 7f4431a1a700 1 -- 172.21.15.59:0/1458444488 learned_addr learned my addr 172.21.15.59:0/1458444488 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:15.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.222+0000 7f4431219700 1 -- 172.21.15.59:0/1458444488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442c09d6f0 msgr2=0x7f442c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:15.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.222+0000 7f4431219700 1 --2- 172.21.15.59:0/1458444488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442c09d6f0 0x7f442c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.222+0000 7f4431219700 1 -- 172.21.15.59:0/1458444488 >> v1:172.21.15.59:6789/0 conn(0x7f442c09e410 legacy=0x7f442c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:15.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.222+0000 7f4431219700 1 -- 172.21.15.59:0/1458444488 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c09a500 con 0x7f442c09e000 2023-09-30T22:35:15.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.222+0000 7f4431a1a700 1 --2- 172.21.15.59:0/1458444488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442c09d6f0 0x7f442c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:15.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.222+0000 7f4431219700 1 --2- 172.21.15.59:0/1458444488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c09e000 0x7f442c1339f0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f441c009840 tx=0x7f441c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda8048b4ce88926 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:15.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.223+0000 7f4430a18700 1 -- 172.21.15.59:0/1458444488 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c011830 con 0x7f442c09e000 2023-09-30T22:35:15.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.223+0000 7f4430a18700 1 -- 172.21.15.59:0/1458444488 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c011990 con 0x7f442c09e000 2023-09-30T22:35:15.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.223+0000 7f4430a18700 1 -- 172.21.15.59:0/1458444488 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c011d20 con 0x7f442c09e000 2023-09-30T22:35:15.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.223+0000 7f4433c7e700 1 -- 172.21.15.59:0/1458444488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c09e000 msgr2=0x7f442c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:15.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.223+0000 7f4433c7e700 1 --2- 172.21.15.59:0/1458444488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c09e000 0x7f442c1339f0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f441c009840 tx=0x7f441c009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:15.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.223+0000 7f4433c7e700 1 -- 172.21.15.59:0/1458444488 shutdown_connections 2023-09-30T22:35:15.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.223+0000 7f4433c7e700 1 --2- 172.21.15.59:0/1458444488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442c09d6f0 0x7f442c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.223+0000 7f4433c7e700 1 --2- 172.21.15.59:0/1458444488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c09e000 0x7f442c1339f0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.223+0000 7f4433c7e700 1 -- 172.21.15.59:0/1458444488 >> 172.21.15.59:0/1458444488 conn(0x7f442c066f50 msgr2=0x7f442c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:15.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.223+0000 7f4433c7e700 1 -- 172.21.15.59:0/1458444488 shutdown_connections 2023-09-30T22:35:15.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.223+0000 7f4433c7e700 1 -- 172.21.15.59:0/1458444488 wait complete. 2023-09-30T22:35:15.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.224+0000 7f4433c7e700 1 Processor -- start 2023-09-30T22:35:15.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.224+0000 7f4433c7e700 1 -- start start 2023-09-30T22:35:15.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4433c7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c09d6f0 0x7f442c1a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4433c7e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442c09e000 0x7f442c1a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4433c7e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442c09e410 0x7f442c1a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4433c7e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c1a91f0 con 0x7f442c09d6f0 2023-09-30T22:35:15.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4433c7e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442c09c710 con 0x7f442c09e000 2023-09-30T22:35:15.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4433c7e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f442c0a3160 con 0x7f442c09e410 2023-09-30T22:35:15.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4431219700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442c09e000 0x7f442c1a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f443221b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442c09e410 0x7f442c1a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4431a1a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c09d6f0 0x7f442c1a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4431219700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442c09e000 0x7f442c1a6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37580/0 (socket says 172.21.15.59:37580) 2023-09-30T22:35:15.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4431219700 1 -- 172.21.15.59:0/3656642925 learned_addr learned my addr 172.21.15.59:0/3656642925 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:15.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4431219700 1 -- 172.21.15.59:0/3656642925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442c09e410 msgr2=0x7f442c1a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4431219700 1 --2- 172.21.15.59:0/3656642925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442c09e410 0x7f442c1a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4431219700 1 -- 172.21.15.59:0/3656642925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c09d6f0 msgr2=0x7f442c1a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4431219700 1 --2- 172.21.15.59:0/3656642925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c09d6f0 0x7f442c1a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4431219700 1 -- 172.21.15.59:0/3656642925 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4428009b30 con 0x7f442c09e000 2023-09-30T22:35:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f4431a1a700 1 --2- 172.21.15.59:0/3656642925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c09d6f0 0x7f442c1a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.225+0000 7f443221b700 1 --2- 172.21.15.59:0/3656642925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442c09e410 0x7f442c1a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:15.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.226+0000 7f4431219700 1 --2- 172.21.15.59:0/3656642925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442c09e000 0x7f442c1a6510 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f441c009fd0 tx=0x7f441c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:15.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.226+0000 7f44227fc700 1 -- 172.21.15.59:0/3656642925 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c0036a0 con 0x7f442c09e000 2023-09-30T22:35:15.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.226+0000 7f44227fc700 1 -- 172.21.15.59:0/3656642925 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c01f070 con 0x7f442c09e000 2023-09-30T22:35:15.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.226+0000 7f4433c7e700 1 -- 172.21.15.59:0/3656642925 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c0094a0 con 0x7f442c09e000 2023-09-30T22:35:15.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.226+0000 7f44227fc700 1 -- 172.21.15.59:0/3656642925 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c003a60 con 0x7f442c09e000 2023-09-30T22:35:15.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.226+0000 7f4433c7e700 1 -- 172.21.15.59:0/3656642925 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442c1a8da0 con 0x7f442c09e000 2023-09-30T22:35:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.227+0000 7f4433c7e700 1 -- 172.21.15.59:0/3656642925 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442c1a9600 con 0x7f442c09e000 2023-09-30T22:35:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.227+0000 7f44227fc700 1 -- 172.21.15.59:0/3656642925 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f441c003bc0 con 0x7f442c09e000 2023-09-30T22:35:15.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.227+0000 7f44227fc700 1 -- 172.21.15.59:0/3656642925 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f441c021070 con 0x7f442c09e000 2023-09-30T22:35:15.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.236+0000 7f44227fc700 1 -- 172.21.15.59:0/3656642925 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f441c010d50 con 0x7f442c09e000 2023-09-30T22:35:15.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.405+0000 7f48b8679700 1 -- 172.21.15.59:0/1728220395 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f48b00747f0 con 0x7f48b009d630 2023-09-30T22:35:15.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.406+0000 7f48aeffd700 1 -- 172.21.15.59:0/1728220395 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f48a0017030 con 0x7f48b009d630 2023-09-30T22:35:15.407 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.408+0000 7f48b8679700 1 -- 172.21.15.59:0/1728220395 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48b009d630 msgr2=0x7f48b0120620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.408+0000 7f48b8679700 1 --2- 172.21.15.59:0/1728220395 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48b009d630 0x7f48b0120620 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f48a0000f60 tx=0x7f48a000c730 comp rx=0 tx=0).stop 2023-09-30T22:35:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.408+0000 7f48b8679700 1 -- 172.21.15.59:0/1728220395 shutdown_connections 2023-09-30T22:35:15.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.408+0000 7f48b8679700 1 --2- 172.21.15.59:0/1728220395 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48b009d630 0x7f48b0120620 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.408+0000 7f48b8679700 1 --2- 172.21.15.59:0/1728220395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48b0138d80 0x7f48b01210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.408+0000 7f48b8679700 1 --2- 172.21.15.59:0/1728220395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48b00a0a30 0x7f48b0120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.408+0000 7f48b8679700 1 -- 172.21.15.59:0/1728220395 >> 172.21.15.59:0/1728220395 conn(0x7f48b00a3050 msgr2=0x7f48b0139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.408+0000 7f48b8679700 1 -- 172.21.15.59:0/1728220395 shutdown_connections 2023-09-30T22:35:15.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.408+0000 7f48b8679700 1 -- 172.21.15.59:0/1728220395 wait complete. 2023-09-30T22:35:15.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:15.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.443+0000 7f4433c7e700 1 -- 172.21.15.59:0/3656642925 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f442c074ea0 con 0x7f442c09e000 2023-09-30T22:35:15.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.444+0000 7f44227fc700 1 -- 172.21.15.59:0/3656642925 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f441c010b70 con 0x7f442c09e000 2023-09-30T22:35:15.446 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:15.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.446+0000 7f4433c7e700 1 -- 172.21.15.59:0/3656642925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442c09e000 msgr2=0x7f442c1a6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:15.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.446+0000 7f4433c7e700 1 --2- 172.21.15.59:0/3656642925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442c09e000 0x7f442c1a6510 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f441c009fd0 tx=0x7f441c004750 comp rx=0 tx=0).stop 2023-09-30T22:35:15.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.446+0000 7f4433c7e700 1 -- 172.21.15.59:0/3656642925 shutdown_connections 2023-09-30T22:35:15.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.446+0000 7f4433c7e700 1 --2- 172.21.15.59:0/3656642925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442c09e410 0x7f442c1a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.446+0000 7f4433c7e700 1 --2- 172.21.15.59:0/3656642925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c09d6f0 0x7f442c1a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.446+0000 7f4433c7e700 1 --2- 172.21.15.59:0/3656642925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442c09e000 0x7f442c1a6510 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.446+0000 7f4433c7e700 1 -- 172.21.15.59:0/3656642925 >> 172.21.15.59:0/3656642925 conn(0x7f442c066f50 msgr2=0x7f442c1baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:15.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.446+0000 7f4433c7e700 1 -- 172.21.15.59:0/3656642925 shutdown_connections 2023-09-30T22:35:15.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.446+0000 7f4433c7e700 1 -- 172.21.15.59:0/3656642925 wait complete. 2023-09-30T22:35:15.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:15.500 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:15.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.640+0000 7f1ccf1e6700 1 Processor -- start 2023-09-30T22:35:15.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.640+0000 7f1ccf1e6700 1 -- start start 2023-09-30T22:35:15.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.641+0000 7f1ccf1e6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cc809d6f0 0x7f1cc809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.641+0000 7f1ccf1e6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cc809e000 0x7f1cc8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.641+0000 7f1ccf1e6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cc809e410 0x7f1cc8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.641+0000 7f1ccf1e6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc809f520 con 0x7f1cc809d6f0 2023-09-30T22:35:15.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.641+0000 7f1ccf1e6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc809f130 con 0x7f1cc809e410 2023-09-30T22:35:15.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.641+0000 7f1ccf1e6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc809e930 con 0x7f1cc809e000 2023-09-30T22:35:15.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.641+0000 7f1ccd783700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cc809e410 0x7f1cc8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.641+0000 7f1cc7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cc809e000 0x7f1cc8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.641+0000 7f1cc7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cc809e000 0x7f1cc8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44210/0 (socket says 172.21.15.59:44210) 2023-09-30T22:35:15.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.641+0000 7f1ccd783700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cc809e410 0x7f1cc8130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37590/0 (socket says 172.21.15.59:37590) 2023-09-30T22:35:15.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.641+0000 7f1cc7fff700 1 -- 172.21.15.59:0/3107650756 learned_addr learned my addr 172.21.15.59:0/3107650756 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:15.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.641+0000 7f1cccf82700 1 --2- 172.21.15.59:0/3107650756 >> v2:172.21.15.59:3300/0 conn(0x7f1cc809d6f0 0x7f1cc809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.642+0000 7f1cc7fff700 1 -- 172.21.15.59:0/3107650756 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cc809e410 msgr2=0x7f1cc8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:15.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.642+0000 7f1cc7fff700 1 --2- 172.21.15.59:0/3107650756 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cc809e410 0x7f1cc8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.642+0000 7f1cc7fff700 1 -- 172.21.15.59:0/3107650756 >> v2:172.21.15.59:3300/0 conn(0x7f1cc809d6f0 msgr2=0x7f1cc809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:15.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.642+0000 7f1cc7fff700 1 --2- 172.21.15.59:0/3107650756 >> v2:172.21.15.59:3300/0 conn(0x7f1cc809d6f0 0x7f1cc809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.642+0000 7f1cc7fff700 1 -- 172.21.15.59:0/3107650756 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc809b2d0 con 0x7f1cc809e000 2023-09-30T22:35:15.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.642+0000 7f1ccd783700 1 --2- 172.21.15.59:0/3107650756 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cc809e410 0x7f1cc8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:15.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.642+0000 7f1cc7fff700 1 --2- 172.21.15.59:0/3107650756 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cc809e000 0x7f1cc8130660 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000bbc0 tx=0x7f1cb000bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1eefbf4fa069ba6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:15.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.642+0000 7f1cc77fe700 1 -- 172.21.15.59:0/3107650756 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb000dcf0 con 0x7f1cc809e000 2023-09-30T22:35:15.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.642+0000 7f1cc77fe700 1 -- 172.21.15.59:0/3107650756 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb000de50 con 0x7f1cc809e000 2023-09-30T22:35:15.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.642+0000 7f1cc77fe700 1 -- 172.21.15.59:0/3107650756 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0010690 con 0x7f1cc809e000 2023-09-30T22:35:15.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.643+0000 7f1ccf1e6700 1 -- 172.21.15.59:0/3107650756 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cc809e000 msgr2=0x7f1cc8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:15.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.643+0000 7f1ccf1e6700 1 --2- 172.21.15.59:0/3107650756 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cc809e000 0x7f1cc8130660 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000bbc0 tx=0x7f1cb000bed0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.643+0000 7f1ccf1e6700 1 -- 172.21.15.59:0/3107650756 shutdown_connections 2023-09-30T22:35:15.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.643+0000 7f1ccf1e6700 1 --2- 172.21.15.59:0/3107650756 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cc809e410 0x7f1cc8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.643+0000 7f1ccf1e6700 1 --2- 172.21.15.59:0/3107650756 >> v2:172.21.15.59:3300/0 conn(0x7f1cc809d6f0 0x7f1cc809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.643+0000 7f1ccf1e6700 1 --2- 172.21.15.59:0/3107650756 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cc809e000 0x7f1cc8130660 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.643+0000 7f1ccf1e6700 1 -- 172.21.15.59:0/3107650756 >> 172.21.15.59:0/3107650756 conn(0x7f1cc8066f50 msgr2=0x7f1cc809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:15.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.643+0000 7f1ccf1e6700 1 -- 172.21.15.59:0/3107650756 shutdown_connections 2023-09-30T22:35:15.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.643+0000 7f1ccf1e6700 1 -- 172.21.15.59:0/3107650756 wait complete. 2023-09-30T22:35:15.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.644+0000 7f1ccf1e6700 1 Processor -- start 2023-09-30T22:35:15.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.644+0000 7f1ccf1e6700 1 -- start start 2023-09-30T22:35:15.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.644+0000 7f1ccf1e6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cc809d6f0 0x7f1cc8122430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.644+0000 7f1ccf1e6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc809e000 0x7f1cc8122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.644+0000 7f1ccf1e6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cc809e410 0x7f1cc8122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:15.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.644+0000 7f1ccf1e6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc8125f40 con 0x7f1cc809e000 2023-09-30T22:35:15.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.644+0000 7f1ccf1e6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80a1a40 con 0x7f1cc809d6f0 2023-09-30T22:35:15.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.644+0000 7f1ccf1e6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc8124030 con 0x7f1cc809e410 2023-09-30T22:35:15.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.644+0000 7f1cccf82700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cc809d6f0 0x7f1cc8122430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1cccf82700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cc809d6f0 0x7f1cc8122430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37604/0 (socket says 172.21.15.59:37604) 2023-09-30T22:35:15.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1cccf82700 1 -- 172.21.15.59:0/3200185776 learned_addr learned my addr 172.21.15.59:0/3200185776 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:15.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1cc7fff700 1 --2- 172.21.15.59:0/3200185776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc809e000 0x7f1cc8122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1ccd783700 1 --2- 172.21.15.59:0/3200185776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cc809e410 0x7f1cc8122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:15.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1cccf82700 1 -- 172.21.15.59:0/3200185776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cc809e410 msgr2=0x7f1cc8122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:15.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1cccf82700 1 --2- 172.21.15.59:0/3200185776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cc809e410 0x7f1cc8122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1cccf82700 1 -- 172.21.15.59:0/3200185776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc809e000 msgr2=0x7f1cc8122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1cccf82700 1 --2- 172.21.15.59:0/3200185776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc809e000 0x7f1cc8122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1cccf82700 1 -- 172.21.15.59:0/3200185776 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc0009a70 con 0x7f1cc809d6f0 2023-09-30T22:35:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1cc7fff700 1 --2- 172.21.15.59:0/3200185776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc809e000 0x7f1cc8122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1cccf82700 1 --2- 172.21.15.59:0/3200185776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cc809d6f0 0x7f1cc8122430 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800e930 tx=0x7f1cb800ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1cc57fa700 1 -- 172.21.15.59:0/3200185776 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb800c640 con 0x7f1cc809d6f0 2023-09-30T22:35:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1cc57fa700 1 -- 172.21.15.59:0/3200185776 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb800c7a0 con 0x7f1cc809d6f0 2023-09-30T22:35:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1cc57fa700 1 -- 172.21.15.59:0/3200185776 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb800cb30 con 0x7f1cc809d6f0 2023-09-30T22:35:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1ccf1e6700 1 -- 172.21.15.59:0/3200185776 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb000b7f0 con 0x7f1cc809d6f0 2023-09-30T22:35:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.645+0000 7f1ccf1e6700 1 -- 172.21.15.59:0/3200185776 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc8130340 con 0x7f1cc809d6f0 2023-09-30T22:35:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.646+0000 7f1cc57fa700 1 -- 172.21.15.59:0/3200185776 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1cb800cc90 con 0x7f1cc809d6f0 2023-09-30T22:35:15.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.646+0000 7f1cc57fa700 1 -- 172.21.15.59:0/3200185776 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1cb803f800 con 0x7f1cc809d6f0 2023-09-30T22:35:15.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.646+0000 7f1ccf1e6700 1 -- 172.21.15.59:0/3200185776 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc8074ea0 con 0x7f1cc809d6f0 2023-09-30T22:35:15.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.651+0000 7f1cc57fa700 1 -- 172.21.15.59:0/3200185776 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1cb80232f0 con 0x7f1cc809d6f0 2023-09-30T22:35:15.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.853+0000 7f1ccf1e6700 1 -- 172.21.15.59:0/3200185776 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1cc8125ae0 con 0x7f1cc809d6f0 2023-09-30T22:35:15.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.854+0000 7f1cc57fa700 1 -- 172.21.15.59:0/3200185776 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1cc8125ae0 con 0x7f1cc809d6f0 2023-09-30T22:35:15.855 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.856+0000 7f1ccf1e6700 1 -- 172.21.15.59:0/3200185776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cc809d6f0 msgr2=0x7f1cc8122430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.856+0000 7f1ccf1e6700 1 --2- 172.21.15.59:0/3200185776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cc809d6f0 0x7f1cc8122430 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800e930 tx=0x7f1cb800ec40 comp rx=0 tx=0).stop 2023-09-30T22:35:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.856+0000 7f1ccf1e6700 1 -- 172.21.15.59:0/3200185776 shutdown_connections 2023-09-30T22:35:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.856+0000 7f1ccf1e6700 1 --2- 172.21.15.59:0/3200185776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cc809e410 0x7f1cc8122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.856+0000 7f1ccf1e6700 1 --2- 172.21.15.59:0/3200185776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cc809d6f0 0x7f1cc8122430 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.856+0000 7f1ccf1e6700 1 --2- 172.21.15.59:0/3200185776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc809e000 0x7f1cc8122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.856+0000 7f1ccf1e6700 1 -- 172.21.15.59:0/3200185776 >> 172.21.15.59:0/3200185776 conn(0x7f1cc8066f50 msgr2=0x7f1cc806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.856+0000 7f1ccf1e6700 1 -- 172.21.15.59:0/3200185776 shutdown_connections 2023-09-30T22:35:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:15.856+0000 7f1ccf1e6700 1 -- 172.21.15.59:0/3200185776 wait complete. 2023-09-30T22:35:15.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:15.882 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:16.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.019+0000 7f56754bc700 1 Processor -- start 2023-09-30T22:35:16.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.019+0000 7f56754bc700 1 -- start start 2023-09-30T22:35:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.020+0000 7f56754bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009d6f0 0x7f567009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.020+0000 7f56754bc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f567009e410 0x7f5670130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.020+0000 7f56754bc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567009f130 con 0x7f567009e000 2023-09-30T22:35:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.020+0000 7f56754bc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567009f520 con 0x7f567009e410 2023-09-30T22:35:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.020+0000 7f56754bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567009e930 con 0x7f567009d6f0 2023-09-30T22:35:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.020+0000 7f566f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f567009e410 0x7f5670130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.020+0000 7f566effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009d6f0 0x7f567009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.020+0000 7f566f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f567009e410 0x7f5670130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53212/0 (socket says 172.21.15.59:53212) 2023-09-30T22:35:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.020+0000 7f566effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009d6f0 0x7f567009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37610/0 (socket says 172.21.15.59:37610) 2023-09-30T22:35:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.020+0000 7f566f7fe700 1 -- 172.21.15.59:0/2448679379 learned_addr learned my addr 172.21.15.59:0/2448679379 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.020+0000 7f566f7fe700 1 -- 172.21.15.59:0/2448679379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009d6f0 msgr2=0x7f567009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.020+0000 7f566f7fe700 1 --2- 172.21.15.59:0/2448679379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009d6f0 0x7f567009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.020+0000 7f566f7fe700 1 -- 172.21.15.59:0/2448679379 >> v1:172.21.15.59:6789/0 conn(0x7f567009e000 legacy=0x7f5670130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.020+0000 7f566f7fe700 1 -- 172.21.15.59:0/2448679379 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567009b2d0 con 0x7f567009e410 2023-09-30T22:35:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.020+0000 7f566effd700 1 --2- 172.21.15.59:0/2448679379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009d6f0 0x7f567009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.021+0000 7f566f7fe700 1 --2- 172.21.15.59:0/2448679379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009e410 0x7f5670130d70 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f5668009e50 tx=0x7f566800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30f1f9e9f9097e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.021+0000 7f566dffb700 1 -- 172.21.15.59:0/2448679379 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566800bb10 con 0x7f567009e410 2023-09-30T22:35:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.021+0000 7f566dffb700 1 -- 172.21.15.59:0/2448679379 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566800bc70 con 0x7f567009e410 2023-09-30T22:35:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.021+0000 7f566dffb700 1 -- 172.21.15.59:0/2448679379 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668011460 con 0x7f567009e410 2023-09-30T22:35:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.021+0000 7f56754bc700 1 -- 172.21.15.59:0/2448679379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009e410 msgr2=0x7f5670130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.021+0000 7f56754bc700 1 --2- 172.21.15.59:0/2448679379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009e410 0x7f5670130d70 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f5668009e50 tx=0x7f566800b330 comp rx=0 tx=0).stop 2023-09-30T22:35:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.021+0000 7f56754bc700 1 -- 172.21.15.59:0/2448679379 shutdown_connections 2023-09-30T22:35:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.021+0000 7f56754bc700 1 --2- 172.21.15.59:0/2448679379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009e410 0x7f5670130d70 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.021+0000 7f56754bc700 1 --2- 172.21.15.59:0/2448679379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009d6f0 0x7f567009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.021+0000 7f56754bc700 1 -- 172.21.15.59:0/2448679379 >> 172.21.15.59:0/2448679379 conn(0x7f5670066f50 msgr2=0x7f567009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.021+0000 7f56754bc700 1 -- 172.21.15.59:0/2448679379 shutdown_connections 2023-09-30T22:35:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.022+0000 7f56754bc700 1 -- 172.21.15.59:0/2448679379 wait complete. 2023-09-30T22:35:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.023+0000 7f56754bc700 1 Processor -- start 2023-09-30T22:35:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.023+0000 7f56754bc700 1 -- start start 2023-09-30T22:35:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.023+0000 7f56754bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f567009d6f0 0x7f567011dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.023+0000 7f56754bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e000 0x7f567011e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.023+0000 7f56754bc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009e410 0x7f567011ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.023+0000 7f56754bc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5670121aa0 con 0x7f567009e410 2023-09-30T22:35:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.023+0000 7f56754bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56701201b0 con 0x7f567009e000 2023-09-30T22:35:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.023+0000 7f56754bc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f567009c700 con 0x7f567009d6f0 2023-09-30T22:35:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.023+0000 7f566f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009e410 0x7f567011ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.023+0000 7f566e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e000 0x7f567011e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.023+0000 7f566effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f567009d6f0 0x7f567011dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.023+0000 7f566f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009e410 0x7f567011ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53224/0 (socket says 172.21.15.59:53224) 2023-09-30T22:35:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.023+0000 7f566f7fe700 1 -- 172.21.15.59:0/2290221590 learned_addr learned my addr 172.21.15.59:0/2290221590 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.024+0000 7f566effd700 1 -- 172.21.15.59:0/2290221590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e000 msgr2=0x7f567011e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.024+0000 7f566effd700 1 --2- 172.21.15.59:0/2290221590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e000 0x7f567011e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.024+0000 7f566effd700 1 -- 172.21.15.59:0/2290221590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009e410 msgr2=0x7f567011ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.024+0000 7f566effd700 1 --2- 172.21.15.59:0/2290221590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009e410 0x7f567011ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.024+0000 7f566effd700 1 -- 172.21.15.59:0/2290221590 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56600094a0 con 0x7f567009d6f0 2023-09-30T22:35:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.024+0000 7f566f7fe700 1 --2- 172.21.15.59:0/2290221590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009e410 0x7f567011ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.024+0000 7f566e7fc700 1 --2- 172.21.15.59:0/2290221590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e000 0x7f567011e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.024+0000 7f566effd700 1 --2- 172.21.15.59:0/2290221590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f567009d6f0 0x7f567011dfd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5660010c10 tx=0x7f5660010f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.024+0000 7f56677fe700 1 -- 172.21.15.59:0/2290221590 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660015070 con 0x7f567009d6f0 2023-09-30T22:35:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.024+0000 7f56677fe700 1 -- 172.21.15.59:0/2290221590 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566000b900 con 0x7f567009d6f0 2023-09-30T22:35:16.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.024+0000 7f56754bc700 1 -- 172.21.15.59:0/2290221590 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5668009b30 con 0x7f567009d6f0 2023-09-30T22:35:16.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.024+0000 7f56677fe700 1 -- 172.21.15.59:0/2290221590 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566000bc70 con 0x7f567009d6f0 2023-09-30T22:35:16.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.024+0000 7f56754bc700 1 -- 172.21.15.59:0/2290221590 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5670130360 con 0x7f567009d6f0 2023-09-30T22:35:16.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.025+0000 7f56677fe700 1 -- 172.21.15.59:0/2290221590 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5660019410 con 0x7f567009d6f0 2023-09-30T22:35:16.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.025+0000 7f56754bc700 1 -- 172.21.15.59:0/2290221590 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5670074ea0 con 0x7f567009d6f0 2023-09-30T22:35:16.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.025+0000 7f56677fe700 1 -- 172.21.15.59:0/2290221590 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5660042eb0 con 0x7f567009d6f0 2023-09-30T22:35:16.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.030+0000 7f56677fe700 1 -- 172.21.15.59:0/2290221590 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56600196c0 con 0x7f567009d6f0 2023-09-30T22:35:16.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.232+0000 7f56754bc700 1 -- 172.21.15.59:0/2290221590 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5670120de0 con 0x7f567009d6f0 2023-09-30T22:35:16.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.233+0000 7f56677fe700 1 -- 172.21.15.59:0/2290221590 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f566001e020 con 0x7f567009d6f0 2023-09-30T22:35:16.234 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:16.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.235+0000 7f56754bc700 1 -- 172.21.15.59:0/2290221590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f567009d6f0 msgr2=0x7f567011dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:16.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.235+0000 7f56754bc700 1 --2- 172.21.15.59:0/2290221590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f567009d6f0 0x7f567011dfd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5660010c10 tx=0x7f5660010f20 comp rx=0 tx=0).stop 2023-09-30T22:35:16.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.235+0000 7f56754bc700 1 -- 172.21.15.59:0/2290221590 shutdown_connections 2023-09-30T22:35:16.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.235+0000 7f56754bc700 1 --2- 172.21.15.59:0/2290221590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f567009d6f0 0x7f567011dfd0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.235+0000 7f56754bc700 1 --2- 172.21.15.59:0/2290221590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f567009e410 0x7f567011ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.235+0000 7f56754bc700 1 --2- 172.21.15.59:0/2290221590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f567009e000 0x7f567011e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.235+0000 7f56754bc700 1 -- 172.21.15.59:0/2290221590 >> 172.21.15.59:0/2290221590 conn(0x7f5670066f50 msgr2=0x7f56700710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:16.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.235+0000 7f56754bc700 1 -- 172.21.15.59:0/2290221590 shutdown_connections 2023-09-30T22:35:16.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.235+0000 7f56754bc700 1 -- 172.21.15.59:0/2290221590 wait complete. 2023-09-30T22:35:16.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:16.424 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:16.462 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.572+0000 7f6349bff700 1 Processor -- start 2023-09-30T22:35:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.572+0000 7f6349bff700 1 -- start start 2023-09-30T22:35:16.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.572+0000 7f6349bff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f634409d6f0 0x7f634409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.573+0000 7f6349bff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634409e440 0x7f6344134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.573+0000 7f6349bff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634409b120 con 0x7f634409e000 2023-09-30T22:35:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.573+0000 7f6349bff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634406b460 con 0x7f634409d6f0 2023-09-30T22:35:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.573+0000 7f6349bff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634409a7e0 con 0x7f634409e440 2023-09-30T22:35:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.573+0000 7f63437fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f634409d6f0 0x7f634409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.573+0000 7f63437fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f634409d6f0 0x7f634409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53232/0 (socket says 172.21.15.59:53232) 2023-09-30T22:35:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.573+0000 7f63437fe700 1 -- 172.21.15.59:0/2516858095 learned_addr learned my addr 172.21.15.59:0/2516858095 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.573+0000 7f6342ffd700 1 --1- 172.21.15.59:0/2516858095 >> v1:172.21.15.59:6789/0 conn(0x7f634409e000 0x7f63441339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58490/0 (socket says 172.21.15.59:58490) 2023-09-30T22:35:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.573+0000 7f6343fff700 1 --2- 172.21.15.59:0/2516858095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634409e440 0x7f6344134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.573+0000 7f6343fff700 1 -- 172.21.15.59:0/2516858095 >> v2:172.21.15.59:3300/0 conn(0x7f634409d6f0 msgr2=0x7f634409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.573+0000 7f6343fff700 1 --2- 172.21.15.59:0/2516858095 >> v2:172.21.15.59:3300/0 conn(0x7f634409d6f0 0x7f634409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.573+0000 7f6343fff700 1 -- 172.21.15.59:0/2516858095 >> v1:172.21.15.59:6789/0 conn(0x7f634409e000 legacy=0x7f63441339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.573+0000 7f6343fff700 1 -- 172.21.15.59:0/2516858095 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634409a500 con 0x7f634409e440 2023-09-30T22:35:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.573+0000 7f63437fe700 1 --2- 172.21.15.59:0/2516858095 >> v2:172.21.15.59:3300/0 conn(0x7f634409d6f0 0x7f634409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.573+0000 7f6343fff700 1 --2- 172.21.15.59:0/2516858095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634409e440 0x7f6344134100 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6334009870 tx=0x7f6334009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ac948a2fe5b27b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.574+0000 7f63427fc700 1 -- 172.21.15.59:0/2516858095 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334011830 con 0x7f634409e440 2023-09-30T22:35:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.574+0000 7f63427fc700 1 -- 172.21.15.59:0/2516858095 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6334011990 con 0x7f634409e440 2023-09-30T22:35:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.574+0000 7f63427fc700 1 -- 172.21.15.59:0/2516858095 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334011d20 con 0x7f634409e440 2023-09-30T22:35:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.574+0000 7f6349bff700 1 -- 172.21.15.59:0/2516858095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634409e440 msgr2=0x7f6344134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.574+0000 7f6349bff700 1 --2- 172.21.15.59:0/2516858095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634409e440 0x7f6344134100 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6334009870 tx=0x7f6334009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.574+0000 7f6349bff700 1 -- 172.21.15.59:0/2516858095 shutdown_connections 2023-09-30T22:35:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.574+0000 7f6349bff700 1 --2- 172.21.15.59:0/2516858095 >> v2:172.21.15.59:3300/0 conn(0x7f634409d6f0 0x7f634409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.574+0000 7f6349bff700 1 --2- 172.21.15.59:0/2516858095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634409e440 0x7f6344134100 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.574+0000 7f6349bff700 1 -- 172.21.15.59:0/2516858095 >> 172.21.15.59:0/2516858095 conn(0x7f6344066f50 msgr2=0x7f634409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.574+0000 7f6349bff700 1 -- 172.21.15.59:0/2516858095 shutdown_connections 2023-09-30T22:35:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.574+0000 7f6349bff700 1 -- 172.21.15.59:0/2516858095 wait complete. 2023-09-30T22:35:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.575+0000 7f6349bff700 1 Processor -- start 2023-09-30T22:35:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.576+0000 7f6349bff700 1 -- start start 2023-09-30T22:35:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.576+0000 7f6349bff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634409d6f0 0x7f63441a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.576+0000 7f6349bff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634409e000 0x7f63441a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.576+0000 7f6349bff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f634409e440 0x7f63441a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.576+0000 7f6349bff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63441aa360 con 0x7f634409d6f0 2023-09-30T22:35:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.576+0000 7f6349bff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63441a99a0 con 0x7f634409e000 2023-09-30T22:35:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.576+0000 7f6349bff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63441a8ce0 con 0x7f634409e440 2023-09-30T22:35:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.576+0000 7f63437fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634409d6f0 0x7f63441a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.576+0000 7f6342ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634409e000 0x7f63441a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.576+0000 7f63437fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634409d6f0 0x7f63441a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53242/0 (socket says 172.21.15.59:53242) 2023-09-30T22:35:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.576+0000 7f63437fe700 1 -- 172.21.15.59:0/1651931895 learned_addr learned my addr 172.21.15.59:0/1651931895 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.577+0000 7f63437fe700 1 -- 172.21.15.59:0/1651931895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f634409e440 msgr2=0x7f63441a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.577+0000 7f63437fe700 1 --2- 172.21.15.59:0/1651931895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f634409e440 0x7f63441a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.577+0000 7f63437fe700 1 -- 172.21.15.59:0/1651931895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634409e000 msgr2=0x7f63441a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.577+0000 7f63437fe700 1 --2- 172.21.15.59:0/1651931895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634409e000 0x7f63441a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.577+0000 7f63437fe700 1 -- 172.21.15.59:0/1651931895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c009b30 con 0x7f634409d6f0 2023-09-30T22:35:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.577+0000 7f6342ffd700 1 --2- 172.21.15.59:0/1651931895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634409e000 0x7f63441a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.577+0000 7f63437fe700 1 --2- 172.21.15.59:0/1651931895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634409d6f0 0x7f63441a5ed0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f633c00efc0 tx=0x7f633c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.577+0000 7f633bfff700 1 -- 172.21.15.59:0/1651931895 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c00cbb0 con 0x7f634409d6f0 2023-09-30T22:35:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.577+0000 7f633bfff700 1 -- 172.21.15.59:0/1651931895 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c00f040 con 0x7f634409d6f0 2023-09-30T22:35:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.577+0000 7f6349bff700 1 -- 172.21.15.59:0/1651931895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63340094a0 con 0x7f634409d6f0 2023-09-30T22:35:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.577+0000 7f633bfff700 1 -- 172.21.15.59:0/1651931895 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c014480 con 0x7f634409d6f0 2023-09-30T22:35:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.577+0000 7f6349bff700 1 -- 172.21.15.59:0/1651931895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63441a7a90 con 0x7f634409d6f0 2023-09-30T22:35:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.578+0000 7f633bfff700 1 -- 172.21.15.59:0/1651931895 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f633c0145e0 con 0x7f634409d6f0 2023-09-30T22:35:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.578+0000 7f633bfff700 1 -- 172.21.15.59:0/1651931895 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f633c03ff70 con 0x7f634409d6f0 2023-09-30T22:35:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.578+0000 7f6349bff700 1 -- 172.21.15.59:0/1651931895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6344074ea0 con 0x7f634409d6f0 2023-09-30T22:35:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.587+0000 7f633bfff700 1 -- 172.21.15.59:0/1651931895 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f633c01c720 con 0x7f634409d6f0 2023-09-30T22:35:16.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.613+0000 7f820ff8e700 1 Processor -- start 2023-09-30T22:35:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.614+0000 7f820ff8e700 1 -- start start 2023-09-30T22:35:16.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.614+0000 7f820ff8e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f820809d630 0x7f82080a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.614+0000 7f820ff8e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8208138d80 0x7f820813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.614+0000 7f820ff8e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82080a2a70 con 0x7f82080a0a30 2023-09-30T22:35:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.614+0000 7f820ff8e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82080a01d0 con 0x7f820809d630 2023-09-30T22:35:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.614+0000 7f820ff8e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820809e2b0 con 0x7f8208138d80 2023-09-30T22:35:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.614+0000 7f820e52b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8208138d80 0x7f820813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.614+0000 7f820d529700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f820809d630 0x7f82080a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.614+0000 7f820dd2a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f82080a0a30 0x7f82080a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58506/0 (socket says 172.21.15.59:58506) 2023-09-30T22:35:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.614+0000 7f820dd2a700 1 -- 172.21.15.59:0/360391331 learned_addr learned my addr 172.21.15.59:0/360391331 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.615+0000 7f820d529700 1 -- 172.21.15.59:0/360391331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8208138d80 msgr2=0x7f820813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.615+0000 7f820d529700 1 --2- 172.21.15.59:0/360391331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8208138d80 0x7f820813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.615+0000 7f820d529700 1 -- 172.21.15.59:0/360391331 >> v1:172.21.15.59:6789/0 conn(0x7f82080a0a30 legacy=0x7f82080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.615+0000 7f820d529700 1 -- 172.21.15.59:0/360391331 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820809dc50 con 0x7f820809d630 2023-09-30T22:35:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.615+0000 7f820cd28700 1 -- 172.21.15.59:0/360391331 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917968847 0 0) 0x7f82080a2a70 con 0x7f82080a0a30 2023-09-30T22:35:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.615+0000 7f820e52b700 1 --2- 172.21.15.59:0/360391331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8208138d80 0x7f820813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.615+0000 7f820d529700 1 --2- 172.21.15.59:0/360391331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820809d630 0x7f82080a1510 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009840 tx=0x7f81fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c743bceb436a2dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.615+0000 7f820cd28700 1 -- 172.21.15.59:0/360391331 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc011830 con 0x7f820809d630 2023-09-30T22:35:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.615+0000 7f820cd28700 1 -- 172.21.15.59:0/360391331 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81fc011990 con 0x7f820809d630 2023-09-30T22:35:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.615+0000 7f820cd28700 1 -- 172.21.15.59:0/360391331 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc011d20 con 0x7f820809d630 2023-09-30T22:35:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.616+0000 7f820ff8e700 1 -- 172.21.15.59:0/360391331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820809d630 msgr2=0x7f82080a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.616+0000 7f820ff8e700 1 --2- 172.21.15.59:0/360391331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820809d630 0x7f82080a1510 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009840 tx=0x7f81fc009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.616+0000 7f820ff8e700 1 -- 172.21.15.59:0/360391331 shutdown_connections 2023-09-30T22:35:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.616+0000 7f820ff8e700 1 --2- 172.21.15.59:0/360391331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8208138d80 0x7f820813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.616+0000 7f820ff8e700 1 --2- 172.21.15.59:0/360391331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820809d630 0x7f82080a1510 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.616+0000 7f820ff8e700 1 -- 172.21.15.59:0/360391331 >> 172.21.15.59:0/360391331 conn(0x7f82080a3050 msgr2=0x7f82080a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:16.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.616+0000 7f820ff8e700 1 -- 172.21.15.59:0/360391331 shutdown_connections 2023-09-30T22:35:16.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.616+0000 7f820ff8e700 1 -- 172.21.15.59:0/360391331 wait complete. 2023-09-30T22:35:16.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.617+0000 7f820ff8e700 1 Processor -- start 2023-09-30T22:35:16.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.617+0000 7f820ff8e700 1 -- start start 2023-09-30T22:35:16.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.617+0000 7f820ff8e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820809d630 0x7f8208133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:16.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.617+0000 7f820ff8e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82080a0a30 0x7f8208133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:16.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.617+0000 7f820ff8e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8208138d80 0x7f8208134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:16.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.617+0000 7f820ff8e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8208136190 con 0x7f820809d630 2023-09-30T22:35:16.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.617+0000 7f820ff8e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8208136eb0 con 0x7f8208138d80 2023-09-30T22:35:16.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.617+0000 7f820ff8e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82080a4ba0 con 0x7f82080a0a30 2023-09-30T22:35:16.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f820dd2a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820809d630 0x7f8208133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:16.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f820d529700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82080a0a30 0x7f8208133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:16.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f820d529700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82080a0a30 0x7f8208133c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44228/0 (socket says 172.21.15.59:44228) 2023-09-30T22:35:16.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f820dd2a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820809d630 0x7f8208133700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53260/0 (socket says 172.21.15.59:53260) 2023-09-30T22:35:16.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f820d529700 1 -- 172.21.15.59:0/521666585 learned_addr learned my addr 172.21.15.59:0/521666585 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:16.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f820e52b700 1 --2- 172.21.15.59:0/521666585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8208138d80 0x7f8208134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:16.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f820dd2a700 1 -- 172.21.15.59:0/521666585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82080a0a30 msgr2=0x7f8208133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:16.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f820dd2a700 1 --2- 172.21.15.59:0/521666585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82080a0a30 0x7f8208133c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f820dd2a700 1 -- 172.21.15.59:0/521666585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8208138d80 msgr2=0x7f8208134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:16.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f820dd2a700 1 --2- 172.21.15.59:0/521666585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8208138d80 0x7f8208134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f820dd2a700 1 -- 172.21.15.59:0/521666585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f8009a70 con 0x7f820809d630 2023-09-30T22:35:16.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f820d529700 1 --2- 172.21.15.59:0/521666585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82080a0a30 0x7f8208133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:16.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f820dd2a700 1 --2- 172.21.15.59:0/521666585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820809d630 0x7f8208133700 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f820000c4a0 tx=0x7f820000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:16.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f82067fc700 1 -- 172.21.15.59:0/521666585 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8200004c80 con 0x7f820809d630 2023-09-30T22:35:16.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f82067fc700 1 -- 172.21.15.59:0/521666585 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8200004de0 con 0x7f820809d630 2023-09-30T22:35:16.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f82067fc700 1 -- 172.21.15.59:0/521666585 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8200007310 con 0x7f820809d630 2023-09-30T22:35:16.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f820ff8e700 1 -- 172.21.15.59:0/521666585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81fc0094a0 con 0x7f820809d630 2023-09-30T22:35:16.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.618+0000 7f820ff8e700 1 -- 172.21.15.59:0/521666585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8208136540 con 0x7f820809d630 2023-09-30T22:35:16.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.619+0000 7f82067fc700 1 -- 172.21.15.59:0/521666585 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8200007470 con 0x7f820809d630 2023-09-30T22:35:16.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.619+0000 7f820ff8e700 1 -- 172.21.15.59:0/521666585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82080747f0 con 0x7f820809d630 2023-09-30T22:35:16.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.620+0000 7f82067fc700 1 -- 172.21.15.59:0/521666585 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f820003f240 con 0x7f820809d630 2023-09-30T22:35:16.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.624+0000 7f82067fc700 1 -- 172.21.15.59:0/521666585 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8200007720 con 0x7f820809d630 2023-09-30T22:35:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.796+0000 7f6349bff700 1 -- 172.21.15.59:0/1651931895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f634409f420 con 0x7f634409d6f0 2023-09-30T22:35:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.796+0000 7f633bfff700 1 -- 172.21.15.59:0/1651931895 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f633c01c360 con 0x7f634409d6f0 2023-09-30T22:35:16.797 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.798+0000 7f6349bff700 1 -- 172.21.15.59:0/1651931895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634409d6f0 msgr2=0x7f63441a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.798+0000 7f6349bff700 1 --2- 172.21.15.59:0/1651931895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634409d6f0 0x7f63441a5ed0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f633c00efc0 tx=0x7f633c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.798+0000 7f6349bff700 1 -- 172.21.15.59:0/1651931895 shutdown_connections 2023-09-30T22:35:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.798+0000 7f6349bff700 1 --2- 172.21.15.59:0/1651931895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f634409e440 0x7f63441a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.798+0000 7f6349bff700 1 --2- 172.21.15.59:0/1651931895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634409d6f0 0x7f63441a5ed0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.798+0000 7f6349bff700 1 --2- 172.21.15.59:0/1651931895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634409e000 0x7f63441a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.798+0000 7f6349bff700 1 -- 172.21.15.59:0/1651931895 >> 172.21.15.59:0/1651931895 conn(0x7f6344066f50 msgr2=0x7f63441baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:16.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.798+0000 7f6349bff700 1 -- 172.21.15.59:0/1651931895 shutdown_connections 2023-09-30T22:35:16.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.799+0000 7f6349bff700 1 -- 172.21.15.59:0/1651931895 wait complete. 2023-09-30T22:35:16.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:16.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.829+0000 7f820ff8e700 1 -- 172.21.15.59:0/521666585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8208137980 con 0x7f820809d630 2023-09-30T22:35:16.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.829+0000 7f82067fc700 1 -- 172.21.15.59:0/521666585 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8200011e80 con 0x7f820809d630 2023-09-30T22:35:16.830 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.831+0000 7f820ff8e700 1 -- 172.21.15.59:0/521666585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820809d630 msgr2=0x7f8208133700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.831+0000 7f820ff8e700 1 --2- 172.21.15.59:0/521666585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820809d630 0x7f8208133700 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f820000c4a0 tx=0x7f820000c7b0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.831+0000 7f820ff8e700 1 -- 172.21.15.59:0/521666585 shutdown_connections 2023-09-30T22:35:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.831+0000 7f820ff8e700 1 --2- 172.21.15.59:0/521666585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8208138d80 0x7f8208134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.831+0000 7f820ff8e700 1 --2- 172.21.15.59:0/521666585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820809d630 0x7f8208133700 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.831+0000 7f820ff8e700 1 --2- 172.21.15.59:0/521666585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82080a0a30 0x7f8208133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.831+0000 7f820ff8e700 1 -- 172.21.15.59:0/521666585 >> 172.21.15.59:0/521666585 conn(0x7f82080a3050 msgr2=0x7f820809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.831+0000 7f820ff8e700 1 -- 172.21.15.59:0/521666585 shutdown_connections 2023-09-30T22:35:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:16.831+0000 7f820ff8e700 1 -- 172.21.15.59:0/521666585 wait complete. 2023-09-30T22:35:16.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:16.872 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:17.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.025+0000 7ff0e33a8700 1 Processor -- start 2023-09-30T22:35:17.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.025+0000 7ff0e33a8700 1 -- start start 2023-09-30T22:35:17.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.026+0000 7ff0e33a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0dc09e930 0x7ff0dc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.026+0000 7ff0e33a8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0dc09f240 0x7ff0dc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.026+0000 7ff0e33a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0dc09f650 0x7ff0dc131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.026+0000 7ff0e33a8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc070940 con 0x7ff0dc09f240 2023-09-30T22:35:17.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.026+0000 7ff0e33a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc06fd60 con 0x7ff0dc09f650 2023-09-30T22:35:17.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.026+0000 7ff0e33a8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc06fa80 con 0x7ff0dc09e930 2023-09-30T22:35:17.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.026+0000 7ff0e0943700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0dc09f240 0x7ff0dc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.026+0000 7ff0e1144700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0dc09e930 0x7ff0dc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.026+0000 7ff0e1945700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0dc09f650 0x7ff0dc131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.026+0000 7ff0e0943700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0dc09f240 0x7ff0dc1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53264/0 (socket says 172.21.15.59:53264) 2023-09-30T22:35:17.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.026+0000 7ff0e0943700 1 -- 172.21.15.59:0/1053034315 learned_addr learned my addr 172.21.15.59:0/1053034315 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:17.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.027+0000 7ff0e1144700 1 -- 172.21.15.59:0/1053034315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0dc09f650 msgr2=0x7ff0dc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:17.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.027+0000 7ff0e1144700 1 --2- 172.21.15.59:0/1053034315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0dc09f650 0x7ff0dc131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.027+0000 7ff0e1144700 1 -- 172.21.15.59:0/1053034315 >> v2:172.21.15.59:3300/0 conn(0x7ff0dc09f240 msgr2=0x7ff0dc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:17.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.027+0000 7ff0e1144700 1 --2- 172.21.15.59:0/1053034315 >> v2:172.21.15.59:3300/0 conn(0x7ff0dc09f240 0x7ff0dc1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.027+0000 7ff0e1144700 1 -- 172.21.15.59:0/1053034315 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc09fb60 con 0x7ff0dc09e930 2023-09-30T22:35:17.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.027+0000 7ff0e1945700 1 --2- 172.21.15.59:0/1053034315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0dc09f650 0x7ff0dc131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:17.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.027+0000 7ff0e1144700 1 --2- 172.21.15.59:0/1053034315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0dc09e930 0x7ff0dc09ed00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009840 tx=0x7ff0d8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa00c4212899a8c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.027+0000 7ff0cffff700 1 -- 172.21.15.59:0/1053034315 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8011830 con 0x7ff0dc09e930 2023-09-30T22:35:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.027+0000 7ff0cffff700 1 -- 172.21.15.59:0/1053034315 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d8011990 con 0x7ff0dc09e930 2023-09-30T22:35:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.027+0000 7ff0cffff700 1 -- 172.21.15.59:0/1053034315 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8011d20 con 0x7ff0dc09e930 2023-09-30T22:35:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.028+0000 7ff0e33a8700 1 -- 172.21.15.59:0/1053034315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0dc09e930 msgr2=0x7ff0dc09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.028+0000 7ff0e33a8700 1 --2- 172.21.15.59:0/1053034315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0dc09e930 0x7ff0dc09ed00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009840 tx=0x7ff0d8009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.028+0000 7ff0e33a8700 1 -- 172.21.15.59:0/1053034315 shutdown_connections 2023-09-30T22:35:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.028+0000 7ff0e33a8700 1 --2- 172.21.15.59:0/1053034315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0dc09f650 0x7ff0dc131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.028+0000 7ff0e33a8700 1 --2- 172.21.15.59:0/1053034315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0dc09e930 0x7ff0dc09ed00 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.028+0000 7ff0e33a8700 1 --2- 172.21.15.59:0/1053034315 >> v2:172.21.15.59:3300/0 conn(0x7ff0dc09f240 0x7ff0dc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.028+0000 7ff0e33a8700 1 -- 172.21.15.59:0/1053034315 >> 172.21.15.59:0/1053034315 conn(0x7ff0dc0a4210 msgr2=0x7ff0dc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.028+0000 7ff0e33a8700 1 -- 172.21.15.59:0/1053034315 shutdown_connections 2023-09-30T22:35:17.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.028+0000 7ff0e33a8700 1 -- 172.21.15.59:0/1053034315 wait complete. 2023-09-30T22:35:17.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.029+0000 7ff0e33a8700 1 Processor -- start 2023-09-30T22:35:17.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.029+0000 7ff0e33a8700 1 -- start start 2023-09-30T22:35:17.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.030+0000 7ff0e33a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0dc09e930 0x7ff0dc1a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.030+0000 7ff0e33a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0dc09f240 0x7ff0dc1a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.030+0000 7ff0e33a8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0dc09f650 0x7ff0dc1a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.030+0000 7ff0e33a8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc1a7270 con 0x7ff0dc09f650 2023-09-30T22:35:17.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.030+0000 7ff0e33a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0a3550 con 0x7ff0dc09e930 2023-09-30T22:35:17.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.030+0000 7ff0e33a8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc1a6690 con 0x7ff0dc09f240 2023-09-30T22:35:17.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.030+0000 7ff0e1144700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0dc09e930 0x7ff0dc1a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.030+0000 7ff0e1945700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0dc09f650 0x7ff0dc1a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.030+0000 7ff0e0943700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0dc09f240 0x7ff0dc1a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.030+0000 7ff0e1144700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0dc09e930 0x7ff0dc1a3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37684/0 (socket says 172.21.15.59:37684) 2023-09-30T22:35:17.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.030+0000 7ff0e1144700 1 -- 172.21.15.59:0/1235004142 learned_addr learned my addr 172.21.15.59:0/1235004142 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:17.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.030+0000 7ff0e1945700 1 -- 172.21.15.59:0/1235004142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0dc09f240 msgr2=0x7ff0dc1a42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:17.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.030+0000 7ff0e1945700 1 --2- 172.21.15.59:0/1235004142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0dc09f240 0x7ff0dc1a42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.030+0000 7ff0e1945700 1 -- 172.21.15.59:0/1235004142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0dc09e930 msgr2=0x7ff0dc1a3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:17.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.031+0000 7ff0e1945700 1 --2- 172.21.15.59:0/1235004142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0dc09e930 0x7ff0dc1a3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.031+0000 7ff0e1945700 1 -- 172.21.15.59:0/1235004142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d4009a70 con 0x7ff0dc09f650 2023-09-30T22:35:17.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.031+0000 7ff0e1144700 1 --2- 172.21.15.59:0/1235004142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0dc09e930 0x7ff0dc1a3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:17.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.031+0000 7ff0e1945700 1 --2- 172.21.15.59:0/1235004142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0dc09f650 0x7ff0dc1a47f0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400ef90 tx=0x7ff0d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:17.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.031+0000 7ff0cdffb700 1 -- 172.21.15.59:0/1235004142 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400cd40 con 0x7ff0dc09f650 2023-09-30T22:35:17.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.031+0000 7ff0cdffb700 1 -- 172.21.15.59:0/1235004142 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d400f040 con 0x7ff0dc09f650 2023-09-30T22:35:17.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.031+0000 7ff0cdffb700 1 -- 172.21.15.59:0/1235004142 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40146c0 con 0x7ff0dc09f650 2023-09-30T22:35:17.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.031+0000 7ff0e33a8700 1 -- 172.21.15.59:0/1235004142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d80094a0 con 0x7ff0dc09f650 2023-09-30T22:35:17.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.031+0000 7ff0e33a8700 1 -- 172.21.15.59:0/1235004142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc0a0190 con 0x7ff0dc09f650 2023-09-30T22:35:17.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.032+0000 7ff0cdffb700 1 -- 172.21.15.59:0/1235004142 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0d4014820 con 0x7ff0dc09f650 2023-09-30T22:35:17.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.032+0000 7ff0cdffb700 1 -- 172.21.15.59:0/1235004142 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff0d40405e0 con 0x7ff0dc09f650 2023-09-30T22:35:17.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.032+0000 7ff0e33a8700 1 -- 172.21.15.59:0/1235004142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0dc1a0b30 con 0x7ff0dc09f650 2023-09-30T22:35:17.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.037+0000 7ff0cdffb700 1 -- 172.21.15.59:0/1235004142 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0d4012930 con 0x7ff0dc09f650 2023-09-30T22:35:17.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.243+0000 7ff0e33a8700 1 -- 172.21.15.59:0/1235004142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff0dc1a73b0 con 0x7ff0dc09f650 2023-09-30T22:35:17.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.244+0000 7ff0cdffb700 1 -- 172.21.15.59:0/1235004142 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0d402c090 con 0x7ff0dc09f650 2023-09-30T22:35:17.245 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.246+0000 7ff0e33a8700 1 -- 172.21.15.59:0/1235004142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0dc09f650 msgr2=0x7ff0dc1a47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.246+0000 7ff0e33a8700 1 --2- 172.21.15.59:0/1235004142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0dc09f650 0x7ff0dc1a47f0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400ef90 tx=0x7ff0d400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.246+0000 7ff0e33a8700 1 -- 172.21.15.59:0/1235004142 shutdown_connections 2023-09-30T22:35:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.246+0000 7ff0e33a8700 1 --2- 172.21.15.59:0/1235004142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0dc09f650 0x7ff0dc1a47f0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.246+0000 7ff0e33a8700 1 --2- 172.21.15.59:0/1235004142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0dc09e930 0x7ff0dc1a3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.246+0000 7ff0e33a8700 1 --2- 172.21.15.59:0/1235004142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0dc09f240 0x7ff0dc1a42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.246+0000 7ff0e33a8700 1 -- 172.21.15.59:0/1235004142 >> 172.21.15.59:0/1235004142 conn(0x7ff0dc0a4210 msgr2=0x7ff0dc1b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.246+0000 7ff0e33a8700 1 -- 172.21.15.59:0/1235004142 shutdown_connections 2023-09-30T22:35:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.246+0000 7ff0e33a8700 1 -- 172.21.15.59:0/1235004142 wait complete. 2023-09-30T22:35:17.251 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:17.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.387+0000 7f8e5fcf9700 1 Processor -- start 2023-09-30T22:35:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.387+0000 7f8e5fcf9700 1 -- start start 2023-09-30T22:35:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.388+0000 7f8e5fcf9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a1510 0x7f8e58138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.388+0000 7f8e5fcf9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e58139250 0x7f8e5813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.388+0000 7f8e5fcf9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5809edd0 con 0x7f8e580a0a30 2023-09-30T22:35:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.388+0000 7f8e5fcf9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e580a18e0 con 0x7f8e58139250 2023-09-30T22:35:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.388+0000 7f8e5fcf9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5809e1f0 con 0x7f8e580a1510 2023-09-30T22:35:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.388+0000 7f8e5da95700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8e580a0a30 0x7f8e580a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58518/0 (socket says 172.21.15.59:58518) 2023-09-30T22:35:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.388+0000 7f8e5da95700 1 -- 172.21.15.59:0/4165032105 learned_addr learned my addr 172.21.15.59:0/4165032105 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.388+0000 7f8e5d294700 1 --2- 172.21.15.59:0/4165032105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a1510 0x7f8e58138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.388+0000 7f8e5e296700 1 --2- 172.21.15.59:0/4165032105 >> v2:172.21.15.59:3300/0 conn(0x7f8e58139250 0x7f8e5813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.388+0000 7f8e5d294700 1 -- 172.21.15.59:0/4165032105 >> v2:172.21.15.59:3300/0 conn(0x7f8e58139250 msgr2=0x7f8e5813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.388+0000 7f8e5d294700 1 --2- 172.21.15.59:0/4165032105 >> v2:172.21.15.59:3300/0 conn(0x7f8e58139250 0x7f8e5813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.388+0000 7f8e5d294700 1 -- 172.21.15.59:0/4165032105 >> v1:172.21.15.59:6789/0 conn(0x7f8e580a0a30 legacy=0x7f8e580a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.388+0000 7f8e5d294700 1 -- 172.21.15.59:0/4165032105 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5809dc50 con 0x7f8e580a1510 2023-09-30T22:35:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.388+0000 7f8e5e296700 1 --2- 172.21.15.59:0/4165032105 >> v2:172.21.15.59:3300/0 conn(0x7f8e58139250 0x7f8e5813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.389+0000 7f8e5d294700 1 --2- 172.21.15.59:0/4165032105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a1510 0x7f8e58138d10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009870 tx=0x7f8e4c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbb9a4a362eca339 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.389+0000 7f8e5ca93700 1 -- 172.21.15.59:0/4165032105 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c011830 con 0x7f8e580a1510 2023-09-30T22:35:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.389+0000 7f8e5ca93700 1 -- 172.21.15.59:0/4165032105 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c011990 con 0x7f8e580a1510 2023-09-30T22:35:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.389+0000 7f8e5ca93700 1 -- 172.21.15.59:0/4165032105 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c011d20 con 0x7f8e580a1510 2023-09-30T22:35:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.389+0000 7f8e5fcf9700 1 -- 172.21.15.59:0/4165032105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a1510 msgr2=0x7f8e58138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.389+0000 7f8e5fcf9700 1 --2- 172.21.15.59:0/4165032105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a1510 0x7f8e58138d10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009870 tx=0x7f8e4c009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:17.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.389+0000 7f8e5fcf9700 1 -- 172.21.15.59:0/4165032105 shutdown_connections 2023-09-30T22:35:17.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.389+0000 7f8e5fcf9700 1 --2- 172.21.15.59:0/4165032105 >> v2:172.21.15.59:3300/0 conn(0x7f8e58139250 0x7f8e5813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.389+0000 7f8e5fcf9700 1 --2- 172.21.15.59:0/4165032105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e580a1510 0x7f8e58138d10 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.389+0000 7f8e5fcf9700 1 -- 172.21.15.59:0/4165032105 >> 172.21.15.59:0/4165032105 conn(0x7f8e580a6550 msgr2=0x7f8e580a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:17.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.390+0000 7f8e5fcf9700 1 -- 172.21.15.59:0/4165032105 shutdown_connections 2023-09-30T22:35:17.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.390+0000 7f8e5fcf9700 1 -- 172.21.15.59:0/4165032105 wait complete. 2023-09-30T22:35:17.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.390+0000 7f8e5fcf9700 1 Processor -- start 2023-09-30T22:35:17.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5fcf9700 1 -- start start 2023-09-30T22:35:17.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5fcf9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e580a0a30 0x7f8e581c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5fcf9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e580a1510 0x7f8e581c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5fcf9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e58139250 0x7f8e58122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5fcf9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e581389b0 con 0x7f8e580a0a30 2023-09-30T22:35:17.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5fcf9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58125cd0 con 0x7f8e58139250 2023-09-30T22:35:17.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5fcf9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58126710 con 0x7f8e580a1510 2023-09-30T22:35:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5da95700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e580a0a30 0x7f8e581c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5e296700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e58139250 0x7f8e58122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5e296700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e58139250 0x7f8e58122a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37698/0 (socket says 172.21.15.59:37698) 2023-09-30T22:35:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5da95700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e580a0a30 0x7f8e581c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53298/0 (socket says 172.21.15.59:53298) 2023-09-30T22:35:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5e296700 1 -- 172.21.15.59:0/825420770 learned_addr learned my addr 172.21.15.59:0/825420770 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5d294700 1 --2- 172.21.15.59:0/825420770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e580a1510 0x7f8e581c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5e296700 1 -- 172.21.15.59:0/825420770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e580a1510 msgr2=0x7f8e581c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5e296700 1 --2- 172.21.15.59:0/825420770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e580a1510 0x7f8e581c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5e296700 1 -- 172.21.15.59:0/825420770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e580a0a30 msgr2=0x7f8e581c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5e296700 1 --2- 172.21.15.59:0/825420770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e580a0a30 0x7f8e581c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.391+0000 7f8e5e296700 1 -- 172.21.15.59:0/825420770 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e50009a70 con 0x7f8e58139250 2023-09-30T22:35:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.392+0000 7f8e5da95700 1 --2- 172.21.15.59:0/825420770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e580a0a30 0x7f8e581c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.392+0000 7f8e5e296700 1 --2- 172.21.15.59:0/825420770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e58139250 0x7f8e58122a20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000efb0 tx=0x7f8e5000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.392+0000 7f8e4a7fc700 1 -- 172.21.15.59:0/825420770 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5000cc90 con 0x7f8e58139250 2023-09-30T22:35:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.392+0000 7f8e4a7fc700 1 -- 172.21.15.59:0/825420770 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5000f040 con 0x7f8e58139250 2023-09-30T22:35:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.392+0000 7f8e5fcf9700 1 -- 172.21.15.59:0/825420770 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c0094a0 con 0x7f8e58139250 2023-09-30T22:35:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.392+0000 7f8e4a7fc700 1 -- 172.21.15.59:0/825420770 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e50014480 con 0x7f8e58139250 2023-09-30T22:35:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.392+0000 7f8e5fcf9700 1 -- 172.21.15.59:0/825420770 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e58125fa0 con 0x7f8e58139250 2023-09-30T22:35:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.393+0000 7f8e4a7fc700 1 -- 172.21.15.59:0/825420770 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e500145e0 con 0x7f8e58139250 2023-09-30T22:35:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.393+0000 7f8e4a7fc700 1 -- 172.21.15.59:0/825420770 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e50040330 con 0x7f8e58139250 2023-09-30T22:35:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.393+0000 7f8e5fcf9700 1 -- 172.21.15.59:0/825420770 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e58074ea0 con 0x7f8e58139250 2023-09-30T22:35:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.398+0000 7f8e4a7fc700 1 -- 172.21.15.59:0/825420770 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e500076f0 con 0x7f8e58139250 2023-09-30T22:35:17.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.602+0000 7f8e5fcf9700 1 -- 172.21.15.59:0/825420770 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8e58126190 con 0x7f8e58139250 2023-09-30T22:35:17.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.602+0000 7f8e4a7fc700 1 -- 172.21.15.59:0/825420770 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e5002c090 con 0x7f8e58139250 2023-09-30T22:35:17.604 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:17.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.605+0000 7f8e5fcf9700 1 -- 172.21.15.59:0/825420770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e58139250 msgr2=0x7f8e58122a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:17.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.605+0000 7f8e5fcf9700 1 --2- 172.21.15.59:0/825420770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e58139250 0x7f8e58122a20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000efb0 tx=0x7f8e5000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.605+0000 7f8e5fcf9700 1 -- 172.21.15.59:0/825420770 shutdown_connections 2023-09-30T22:35:17.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.605+0000 7f8e5fcf9700 1 --2- 172.21.15.59:0/825420770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e58139250 0x7f8e58122a20 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.605+0000 7f8e5fcf9700 1 --2- 172.21.15.59:0/825420770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e580a0a30 0x7f8e581c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.605+0000 7f8e5fcf9700 1 --2- 172.21.15.59:0/825420770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e580a1510 0x7f8e581c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.605+0000 7f8e5fcf9700 1 -- 172.21.15.59:0/825420770 >> 172.21.15.59:0/825420770 conn(0x7f8e580a6550 msgr2=0x7f8e580a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:17.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.605+0000 7f8e5fcf9700 1 -- 172.21.15.59:0/825420770 shutdown_connections 2023-09-30T22:35:17.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.605+0000 7f8e5fcf9700 1 -- 172.21.15.59:0/825420770 wait complete. 2023-09-30T22:35:17.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:17.815 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:17.847 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:17.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.960+0000 7f2007468700 1 Processor -- start 2023-09-30T22:35:17.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.961+0000 7f2007468700 1 -- start start 2023-09-30T22:35:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.961+0000 7f2007468700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20000a0a30 0x7f20000a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.961+0000 7f2007468700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20000a1340 0x7f2000133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.961+0000 7f2007468700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200009edd0 con 0x7f2000133fa0 2023-09-30T22:35:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.961+0000 7f2007468700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200009e1f0 con 0x7f20000a0a30 2023-09-30T22:35:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.961+0000 7f2007468700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f200009dc50 con 0x7f20000a1340 2023-09-30T22:35:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.961+0000 7f2005a05700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2000133fa0 0x7f200013ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58524/0 (socket says 172.21.15.59:58524) 2023-09-30T22:35:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.961+0000 7f2005a05700 1 -- 172.21.15.59:0/1925781461 learned_addr learned my addr 172.21.15.59:0/1925781461 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.962+0000 7f2004a03700 1 --2- 172.21.15.59:0/1925781461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20000a1340 0x7f2000133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.962+0000 7f2005204700 1 --2- 172.21.15.59:0/1925781461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20000a0a30 0x7f20000a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.962+0000 7f1ffffff700 1 -- 172.21.15.59:0/1925781461 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610633586 0 0) 0x7f200009edd0 con 0x7f2000133fa0 2023-09-30T22:35:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.962+0000 7f1ffffff700 1 -- 172.21.15.59:0/1925781461 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fe80035b0 con 0x7f2000133fa0 2023-09-30T22:35:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.962+0000 7f2005204700 1 -- 172.21.15.59:0/1925781461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20000a1340 msgr2=0x7f2000133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.962+0000 7f2005204700 1 --2- 172.21.15.59:0/1925781461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20000a1340 0x7f2000133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.962+0000 7f2005204700 1 -- 172.21.15.59:0/1925781461 >> v1:172.21.15.59:6789/0 conn(0x7f2000133fa0 legacy=0x7f200013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.962+0000 7f2005204700 1 -- 172.21.15.59:0/1925781461 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000a1fe0 con 0x7f20000a0a30 2023-09-30T22:35:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.962+0000 7f2004a03700 1 --2- 172.21.15.59:0/1925781461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20000a1340 0x7f2000133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.962+0000 7f2005204700 1 --2- 172.21.15.59:0/1925781461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20000a0a30 0x7f20000a0e00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009dc0 tx=0x7f1ff000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d2ddff268de405e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.962+0000 7f1ffffff700 1 -- 172.21.15.59:0/1925781461 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000e070 con 0x7f20000a0a30 2023-09-30T22:35:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.962+0000 7f1ffffff700 1 -- 172.21.15.59:0/1925781461 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff000bb20 con 0x7f20000a0a30 2023-09-30T22:35:17.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.962+0000 7f1ffffff700 1 -- 172.21.15.59:0/1925781461 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0012430 con 0x7f20000a0a30 2023-09-30T22:35:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.963+0000 7f2007468700 1 -- 172.21.15.59:0/1925781461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20000a0a30 msgr2=0x7f20000a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.963+0000 7f2007468700 1 --2- 172.21.15.59:0/1925781461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20000a0a30 0x7f20000a0e00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009dc0 tx=0x7f1ff000b330 comp rx=0 tx=0).stop 2023-09-30T22:35:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.963+0000 7f2007468700 1 -- 172.21.15.59:0/1925781461 shutdown_connections 2023-09-30T22:35:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.963+0000 7f2007468700 1 --2- 172.21.15.59:0/1925781461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20000a0a30 0x7f20000a0e00 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.963+0000 7f2007468700 1 --2- 172.21.15.59:0/1925781461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20000a1340 0x7f2000133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.963+0000 7f2007468700 1 -- 172.21.15.59:0/1925781461 >> 172.21.15.59:0/1925781461 conn(0x7f20000a6550 msgr2=0x7f20000a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.963+0000 7f2007468700 1 -- 172.21.15.59:0/1925781461 shutdown_connections 2023-09-30T22:35:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.963+0000 7f2007468700 1 -- 172.21.15.59:0/1925781461 wait complete. 2023-09-30T22:35:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.964+0000 7f2007468700 1 Processor -- start 2023-09-30T22:35:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.964+0000 7f2007468700 1 -- start start 2023-09-30T22:35:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2007468700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20000a0a30 0x7f20001c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2007468700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20000a1340 0x7f20001c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2007468700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2000133fa0 0x7f20001c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:17.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2007468700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2000125de0 con 0x7f2000133fa0 2023-09-30T22:35:17.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2007468700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2000124470 con 0x7f20000a1340 2023-09-30T22:35:17.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2007468700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2000126460 con 0x7f20000a0a30 2023-09-30T22:35:17.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2005204700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20000a0a30 0x7f20001c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2004a03700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20000a1340 0x7f20001c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2005204700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20000a0a30 0x7f20001c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44280/0 (socket says 172.21.15.59:44280) 2023-09-30T22:35:17.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2005204700 1 -- 172.21.15.59:0/1399360803 learned_addr learned my addr 172.21.15.59:0/1399360803 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:17.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2005a05700 1 --2- 172.21.15.59:0/1399360803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2000133fa0 0x7f20001c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:17.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2004a03700 1 -- 172.21.15.59:0/1399360803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20000a0a30 msgr2=0x7f20001c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:17.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2004a03700 1 --2- 172.21.15.59:0/1399360803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20000a0a30 0x7f20001c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2004a03700 1 -- 172.21.15.59:0/1399360803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2000133fa0 msgr2=0x7f20001c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:17.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2004a03700 1 --2- 172.21.15.59:0/1399360803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2000133fa0 0x7f20001c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:17.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2004a03700 1 -- 172.21.15.59:0/1399360803 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff40094a0 con 0x7f20000a1340 2023-09-30T22:35:17.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.965+0000 7f2005204700 1 --2- 172.21.15.59:0/1399360803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20000a0a30 0x7f20001c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:17.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.966+0000 7f2004a03700 1 --2- 172.21.15.59:0/1399360803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20000a1340 0x7f20001c87c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400e9b0 tx=0x7f1ff400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:17.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.966+0000 7f1ffdffb700 1 -- 172.21.15.59:0/1399360803 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff400ee50 con 0x7f20000a1340 2023-09-30T22:35:17.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.966+0000 7f1ffdffb700 1 -- 172.21.15.59:0/1399360803 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff400c850 con 0x7f20000a1340 2023-09-30T22:35:17.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.966+0000 7f2007468700 1 -- 172.21.15.59:0/1399360803 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff0009a70 con 0x7f20000a1340 2023-09-30T22:35:17.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.966+0000 7f1ffdffb700 1 -- 172.21.15.59:0/1399360803 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff400cc00 con 0x7f20000a1340 2023-09-30T22:35:17.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.966+0000 7f2007468700 1 -- 172.21.15.59:0/1399360803 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20000a25e0 con 0x7f20000a1340 2023-09-30T22:35:17.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.967+0000 7f1ffdffb700 1 -- 172.21.15.59:0/1399360803 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ff4013470 con 0x7f20000a1340 2023-09-30T22:35:17.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.967+0000 7f1ffdffb700 1 -- 172.21.15.59:0/1399360803 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1ff403f890 con 0x7f20000a1340 2023-09-30T22:35:17.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.967+0000 7f2007468700 1 -- 172.21.15.59:0/1399360803 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20000a0220 con 0x7f20000a1340 2023-09-30T22:35:17.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.972+0000 7f1ffdffb700 1 -- 172.21.15.59:0/1399360803 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ff4017080 con 0x7f20000a1340 2023-09-30T22:35:18.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.999+0000 7f1f60d8b700 1 Processor -- start 2023-09-30T22:35:18.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:17.999+0000 7f1f60d8b700 1 -- start start 2023-09-30T22:35:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.000+0000 7f1f60d8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c0a0a30 0x7f1f5c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.000+0000 7f1f60d8b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5c0a1340 0x7f1f5c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.000+0000 7f1f60d8b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c09edd0 con 0x7f1f5c133fa0 2023-09-30T22:35:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.000+0000 7f1f60d8b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c09e1f0 con 0x7f1f5c0a0a30 2023-09-30T22:35:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.000+0000 7f1f60d8b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c09dc50 con 0x7f1f5c0a1340 2023-09-30T22:35:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.000+0000 7f1f59d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5c0a1340 0x7f1f5c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.000+0000 7f1f5a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c0a0a30 0x7f1f5c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.000+0000 7f1f59d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5c0a1340 0x7f1f5c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44284/0 (socket says 172.21.15.59:44284) 2023-09-30T22:35:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.000+0000 7f1f59d9b700 1 -- 172.21.15.59:0/1066400092 learned_addr learned my addr 172.21.15.59:0/1066400092 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.000+0000 7f1f5ad9d700 1 --1- 172.21.15.59:0/1066400092 >> v1:172.21.15.59:6789/0 conn(0x7f1f5c133fa0 0x7f1f5c13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58530/0 (socket says 172.21.15.59:58530) 2023-09-30T22:35:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.001+0000 7f1f59d9b700 1 -- 172.21.15.59:0/1066400092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c0a0a30 msgr2=0x7f1f5c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.001+0000 7f1f59d9b700 1 --2- 172.21.15.59:0/1066400092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c0a0a30 0x7f1f5c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.001+0000 7f1f59d9b700 1 -- 172.21.15.59:0/1066400092 >> v1:172.21.15.59:6789/0 conn(0x7f1f5c133fa0 legacy=0x7f1f5c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.001+0000 7f1f5959a700 1 -- 172.21.15.59:0/1066400092 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336257462 0 0) 0x7f1f5c09edd0 con 0x7f1f5c133fa0 2023-09-30T22:35:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.001+0000 7f1f59d9b700 1 -- 172.21.15.59:0/1066400092 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c0a1fe0 con 0x7f1f5c0a1340 2023-09-30T22:35:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.001+0000 7f1f5a59c700 1 --2- 172.21.15.59:0/1066400092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c0a0a30 0x7f1f5c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.001+0000 7f1f59d9b700 1 --2- 172.21.15.59:0/1066400092 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5c0a1340 0x7f1f5c133a60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009920 tx=0x7f1f50009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d791b963e2013084 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.001+0000 7f1f5959a700 1 -- 172.21.15.59:0/1066400092 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50011830 con 0x7f1f5c0a1340 2023-09-30T22:35:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.001+0000 7f1f5959a700 1 -- 172.21.15.59:0/1066400092 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f50011990 con 0x7f1f5c0a1340 2023-09-30T22:35:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.001+0000 7f1f5959a700 1 -- 172.21.15.59:0/1066400092 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50011d20 con 0x7f1f5c0a1340 2023-09-30T22:35:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.001+0000 7f1f60d8b700 1 -- 172.21.15.59:0/1066400092 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5c0a1340 msgr2=0x7f1f5c133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.001+0000 7f1f60d8b700 1 --2- 172.21.15.59:0/1066400092 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5c0a1340 0x7f1f5c133a60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009920 tx=0x7f1f50009c30 comp rx=0 tx=0).stop 2023-09-30T22:35:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.002+0000 7f1f60d8b700 1 -- 172.21.15.59:0/1066400092 shutdown_connections 2023-09-30T22:35:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.002+0000 7f1f60d8b700 1 --2- 172.21.15.59:0/1066400092 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c0a0a30 0x7f1f5c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.002+0000 7f1f60d8b700 1 --2- 172.21.15.59:0/1066400092 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5c0a1340 0x7f1f5c133a60 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.002+0000 7f1f60d8b700 1 -- 172.21.15.59:0/1066400092 >> 172.21.15.59:0/1066400092 conn(0x7f1f5c0a6550 msgr2=0x7f1f5c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.002+0000 7f1f60d8b700 1 -- 172.21.15.59:0/1066400092 shutdown_connections 2023-09-30T22:35:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.002+0000 7f1f60d8b700 1 -- 172.21.15.59:0/1066400092 wait complete. 2023-09-30T22:35:18.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.003+0000 7f1f60d8b700 1 Processor -- start 2023-09-30T22:35:18.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.003+0000 7f1f60d8b700 1 -- start start 2023-09-30T22:35:18.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.003+0000 7f1f60d8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c0a0a30 0x7f1f5c1c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.003+0000 7f1f60d8b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5c0a1340 0x7f1f5c1c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.003+0000 7f1f60d8b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5c133fa0 0x7f1f5c1c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.003+0000 7f1f60d8b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c1246b0 con 0x7f1f5c133fa0 2023-09-30T22:35:18.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.003+0000 7f1f60d8b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c0a0220 con 0x7f1f5c0a0a30 2023-09-30T22:35:18.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.003+0000 7f1f60d8b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c124480 con 0x7f1f5c0a1340 2023-09-30T22:35:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.003+0000 7f1f59d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5c0a1340 0x7f1f5c1c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.003+0000 7f1f5a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c0a0a30 0x7f1f5c1c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.003+0000 7f1f59d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5c0a1340 0x7f1f5c1c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44290/0 (socket says 172.21.15.59:44290) 2023-09-30T22:35:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.003+0000 7f1f59d9b700 1 -- 172.21.15.59:0/3373355672 learned_addr learned my addr 172.21.15.59:0/3373355672 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.004+0000 7f1f5ad9d700 1 --2- 172.21.15.59:0/3373355672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5c133fa0 0x7f1f5c1c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.004+0000 7f1f59d9b700 1 -- 172.21.15.59:0/3373355672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c0a0a30 msgr2=0x7f1f5c1c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.004+0000 7f1f59d9b700 1 --2- 172.21.15.59:0/3373355672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c0a0a30 0x7f1f5c1c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.004+0000 7f1f59d9b700 1 -- 172.21.15.59:0/3373355672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5c133fa0 msgr2=0x7f1f5c1c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.004+0000 7f1f59d9b700 1 --2- 172.21.15.59:0/3373355672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5c133fa0 0x7f1f5c1c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.004+0000 7f1f59d9b700 1 -- 172.21.15.59:0/3373355672 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c0094a0 con 0x7f1f5c0a1340 2023-09-30T22:35:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.004+0000 7f1f5a59c700 1 --2- 172.21.15.59:0/3373355672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c0a0a30 0x7f1f5c1c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.004+0000 7f1f5ad9d700 1 --2- 172.21.15.59:0/3373355672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5c133fa0 0x7f1f5c1c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:18.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.004+0000 7f1f59d9b700 1 --2- 172.21.15.59:0/3373355672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5c0a1340 0x7f1f5c1c87c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009130 tx=0x7f1f50004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.004+0000 7f1f4affd700 1 -- 172.21.15.59:0/3373355672 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50004450 con 0x7f1f5c0a1340 2023-09-30T22:35:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.004+0000 7f1f4affd700 1 -- 172.21.15.59:0/3373355672 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5001f070 con 0x7f1f5c0a1340 2023-09-30T22:35:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.004+0000 7f1f4affd700 1 -- 172.21.15.59:0/3373355672 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f500038c0 con 0x7f1f5c0a1340 2023-09-30T22:35:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.004+0000 7f1f60d8b700 1 -- 172.21.15.59:0/3373355672 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f50009550 con 0x7f1f5c0a1340 2023-09-30T22:35:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.004+0000 7f1f60d8b700 1 -- 172.21.15.59:0/3373355672 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5c0a25e0 con 0x7f1f5c0a1340 2023-09-30T22:35:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.005+0000 7f1f4affd700 1 -- 172.21.15.59:0/3373355672 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f50003a20 con 0x7f1f5c0a1340 2023-09-30T22:35:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.005+0000 7f1f4affd700 1 -- 172.21.15.59:0/3373355672 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f50021070 con 0x7f1f5c0a1340 2023-09-30T22:35:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.005+0000 7f1f60d8b700 1 -- 172.21.15.59:0/3373355672 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5c124cd0 con 0x7f1f5c0a1340 2023-09-30T22:35:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.010+0000 7f1f4affd700 1 -- 172.21.15.59:0/3373355672 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f50015080 con 0x7f1f5c0a1340 2023-09-30T22:35:18.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.181+0000 7f2007468700 1 -- 172.21.15.59:0/1399360803 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2000074ea0 con 0x7f20000a1340 2023-09-30T22:35:18.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.181+0000 7f1ffdffb700 1 -- 172.21.15.59:0/1399360803 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ff4021020 con 0x7f20000a1340 2023-09-30T22:35:18.182 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:18.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.183+0000 7f2007468700 1 -- 172.21.15.59:0/1399360803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20000a1340 msgr2=0x7f20001c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:18.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.183+0000 7f2007468700 1 --2- 172.21.15.59:0/1399360803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20000a1340 0x7f20001c87c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400e9b0 tx=0x7f1ff400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.184+0000 7f2007468700 1 -- 172.21.15.59:0/1399360803 shutdown_connections 2023-09-30T22:35:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.184+0000 7f2007468700 1 --2- 172.21.15.59:0/1399360803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20000a0a30 0x7f20001c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.184+0000 7f2007468700 1 --2- 172.21.15.59:0/1399360803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2000133fa0 0x7f20001c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.184+0000 7f2007468700 1 --2- 172.21.15.59:0/1399360803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20000a1340 0x7f20001c87c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.184+0000 7f2007468700 1 -- 172.21.15.59:0/1399360803 >> 172.21.15.59:0/1399360803 conn(0x7f20000a6550 msgr2=0x7f20000a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.184+0000 7f2007468700 1 -- 172.21.15.59:0/1399360803 shutdown_connections 2023-09-30T22:35:18.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.184+0000 7f2007468700 1 -- 172.21.15.59:0/1399360803 wait complete. 2023-09-30T22:35:18.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:18.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.217+0000 7f1f60d8b700 1 -- 172.21.15.59:0/3373355672 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f5c125e40 con 0x7f1f5c0a1340 2023-09-30T22:35:18.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.217+0000 7f1f4affd700 1 -- 172.21.15.59:0/3373355672 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f5002b020 con 0x7f1f5c0a1340 2023-09-30T22:35:18.219 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:18.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.219+0000 7f1f60d8b700 1 -- 172.21.15.59:0/3373355672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5c0a1340 msgr2=0x7f1f5c1c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:18.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.219+0000 7f1f60d8b700 1 --2- 172.21.15.59:0/3373355672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5c0a1340 0x7f1f5c1c87c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009130 tx=0x7f1f50004750 comp rx=0 tx=0).stop 2023-09-30T22:35:18.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.220+0000 7f1f60d8b700 1 -- 172.21.15.59:0/3373355672 shutdown_connections 2023-09-30T22:35:18.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.220+0000 7f1f60d8b700 1 --2- 172.21.15.59:0/3373355672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5c133fa0 0x7f1f5c1c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.220+0000 7f1f60d8b700 1 --2- 172.21.15.59:0/3373355672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c0a0a30 0x7f1f5c1c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.220+0000 7f1f60d8b700 1 --2- 172.21.15.59:0/3373355672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f5c0a1340 0x7f1f5c1c87c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.220+0000 7f1f60d8b700 1 -- 172.21.15.59:0/3373355672 >> 172.21.15.59:0/3373355672 conn(0x7f1f5c0a6550 msgr2=0x7f1f5c09c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:18.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.220+0000 7f1f60d8b700 1 -- 172.21.15.59:0/3373355672 shutdown_connections 2023-09-30T22:35:18.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.220+0000 7f1f60d8b700 1 -- 172.21.15.59:0/3373355672 wait complete. 2023-09-30T22:35:18.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:18.263 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:18.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.415+0000 7f3f2f2d0700 1 Processor -- start 2023-09-30T22:35:18.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.416+0000 7f3f2f2d0700 1 -- start start 2023-09-30T22:35:18.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.416+0000 7f3f2f2d0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f2809d6f0 0x7f3f2809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.416+0000 7f3f2f2d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2809e000 0x7f3f281339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.416+0000 7f3f2f2d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2809e410 0x7f3f28133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.416+0000 7f3f2f2d0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2806b460 con 0x7f3f2809d6f0 2023-09-30T22:35:18.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.416+0000 7f3f2f2d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2809b120 con 0x7f3f2809e410 2023-09-30T22:35:18.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.416+0000 7f3f2f2d0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2809a7e0 con 0x7f3f2809e000 2023-09-30T22:35:18.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.416+0000 7f3f2c86b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2809e000 0x7f3f281339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.416+0000 7f3f2d86d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2809e410 0x7f3f28133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.416+0000 7f3f2d06c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f2809d6f0 0x7f3f2809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.416+0000 7f3f2c86b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2809e000 0x7f3f281339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44296/0 (socket says 172.21.15.59:44296) 2023-09-30T22:35:18.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.416+0000 7f3f2d86d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2809e410 0x7f3f28133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37750/0 (socket says 172.21.15.59:37750) 2023-09-30T22:35:18.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.416+0000 7f3f2c86b700 1 -- 172.21.15.59:0/3000258354 learned_addr learned my addr 172.21.15.59:0/3000258354 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:18.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.416+0000 7f3f2d06c700 1 --2- 172.21.15.59:0/3000258354 >> v2:172.21.15.59:3300/0 conn(0x7f3f2809d6f0 0x7f3f2809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53328/0 (socket says 172.21.15.59:53328) 2023-09-30T22:35:18.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.417+0000 7f3f2d06c700 1 -- 172.21.15.59:0/3000258354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2809e000 msgr2=0x7f3f281339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:18.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.417+0000 7f3f2d06c700 1 --2- 172.21.15.59:0/3000258354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2809e000 0x7f3f281339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.417+0000 7f3f2d06c700 1 -- 172.21.15.59:0/3000258354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2809e410 msgr2=0x7f3f28133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:18.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.417+0000 7f3f2d06c700 1 --2- 172.21.15.59:0/3000258354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2809e410 0x7f3f28133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.417+0000 7f3f2d06c700 1 -- 172.21.15.59:0/3000258354 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2809a500 con 0x7f3f2809d6f0 2023-09-30T22:35:18.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.417+0000 7f3f2c86b700 1 --2- 172.21.15.59:0/3000258354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2809e000 0x7f3f281339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:18.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.417+0000 7f3f2d86d700 1 --2- 172.21.15.59:0/3000258354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2809e410 0x7f3f28133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:18.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.417+0000 7f3f2d06c700 1 --2- 172.21.15.59:0/3000258354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2809d6f0 0x7f3f2809dac0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009840 tx=0x7f3f24009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb4dbc796bff686 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:18.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.417+0000 7f3f1bfff700 1 -- 172.21.15.59:0/3000258354 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24011830 con 0x7f3f2809d6f0 2023-09-30T22:35:18.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.417+0000 7f3f1bfff700 1 -- 172.21.15.59:0/3000258354 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f24011990 con 0x7f3f2809d6f0 2023-09-30T22:35:18.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.417+0000 7f3f1bfff700 1 -- 172.21.15.59:0/3000258354 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24011d20 con 0x7f3f2809d6f0 2023-09-30T22:35:18.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.418+0000 7f3f2f2d0700 1 -- 172.21.15.59:0/3000258354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2809d6f0 msgr2=0x7f3f2809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:18.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.418+0000 7f3f2f2d0700 1 --2- 172.21.15.59:0/3000258354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2809d6f0 0x7f3f2809dac0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009840 tx=0x7f3f24009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:18.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.418+0000 7f3f2f2d0700 1 -- 172.21.15.59:0/3000258354 shutdown_connections 2023-09-30T22:35:18.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.418+0000 7f3f2f2d0700 1 --2- 172.21.15.59:0/3000258354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2809e410 0x7f3f28133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.418+0000 7f3f2f2d0700 1 --2- 172.21.15.59:0/3000258354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2809d6f0 0x7f3f2809dac0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.418+0000 7f3f2f2d0700 1 --2- 172.21.15.59:0/3000258354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2809e000 0x7f3f281339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.418+0000 7f3f2f2d0700 1 -- 172.21.15.59:0/3000258354 >> 172.21.15.59:0/3000258354 conn(0x7f3f28066f50 msgr2=0x7f3f2809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:18.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.418+0000 7f3f2f2d0700 1 -- 172.21.15.59:0/3000258354 shutdown_connections 2023-09-30T22:35:18.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.418+0000 7f3f2f2d0700 1 -- 172.21.15.59:0/3000258354 wait complete. 2023-09-30T22:35:18.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.419+0000 7f3f2f2d0700 1 Processor -- start 2023-09-30T22:35:18.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.419+0000 7f3f2f2d0700 1 -- start start 2023-09-30T22:35:18.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.420+0000 7f3f2f2d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2809d6f0 0x7f3f281a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.420+0000 7f3f2f2d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2809e000 0x7f3f281a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.420+0000 7f3f2f2d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2809e410 0x7f3f281c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.420+0000 7f3f2f2d0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f281b9240 con 0x7f3f2809e410 2023-09-30T22:35:18.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.420+0000 7f3f2f2d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f281a6cb0 con 0x7f3f2809e000 2023-09-30T22:35:18.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.420+0000 7f3f2f2d0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f281a4de0 con 0x7f3f2809d6f0 2023-09-30T22:35:18.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.420+0000 7f3f2c86b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2809e000 0x7f3f281a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.420+0000 7f3f2d86d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2809e410 0x7f3f281c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.420+0000 7f3f2d06c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2809d6f0 0x7f3f281a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.420+0000 7f3f2c86b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2809e000 0x7f3f281a57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37766/0 (socket says 172.21.15.59:37766) 2023-09-30T22:35:18.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.420+0000 7f3f2c86b700 1 -- 172.21.15.59:0/837851906 learned_addr learned my addr 172.21.15.59:0/837851906 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:18.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.421+0000 7f3f2c86b700 1 -- 172.21.15.59:0/837851906 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2809d6f0 msgr2=0x7f3f281a5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:18.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.421+0000 7f3f2c86b700 1 --2- 172.21.15.59:0/837851906 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2809d6f0 0x7f3f281a5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.421+0000 7f3f2c86b700 1 -- 172.21.15.59:0/837851906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2809e410 msgr2=0x7f3f281c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:18.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.421+0000 7f3f2c86b700 1 --2- 172.21.15.59:0/837851906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2809e410 0x7f3f281c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.421+0000 7f3f2c86b700 1 -- 172.21.15.59:0/837851906 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c009550 con 0x7f3f2809e000 2023-09-30T22:35:18.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.421+0000 7f3f2d86d700 1 --2- 172.21.15.59:0/837851906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2809e410 0x7f3f281c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:18.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.421+0000 7f3f2c86b700 1 --2- 172.21.15.59:0/837851906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2809e000 0x7f3f281a57a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00ebe0 tx=0x7f3f1c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:18.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.421+0000 7f3f19ffb700 1 -- 172.21.15.59:0/837851906 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c00c850 con 0x7f3f2809e000 2023-09-30T22:35:18.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.421+0000 7f3f19ffb700 1 -- 172.21.15.59:0/837851906 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1c00c9b0 con 0x7f3f2809e000 2023-09-30T22:35:18.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.421+0000 7f3f2f2d0700 1 -- 172.21.15.59:0/837851906 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f20009a70 con 0x7f3f2809e000 2023-09-30T22:35:18.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.421+0000 7f3f19ffb700 1 -- 172.21.15.59:0/837851906 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c00cd20 con 0x7f3f2809e000 2023-09-30T22:35:18.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.421+0000 7f3f2f2d0700 1 -- 172.21.15.59:0/837851906 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f240094a0 con 0x7f3f2809e000 2023-09-30T22:35:18.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.422+0000 7f3f19ffb700 1 -- 172.21.15.59:0/837851906 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f1c013470 con 0x7f3f2809e000 2023-09-30T22:35:18.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.422+0000 7f3f2f2d0700 1 -- 172.21.15.59:0/837851906 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f281a6a70 con 0x7f3f2809e000 2023-09-30T22:35:18.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.423+0000 7f3f19ffb700 1 -- 172.21.15.59:0/837851906 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f1c03fc20 con 0x7f3f2809e000 2023-09-30T22:35:18.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.427+0000 7f3f19ffb700 1 -- 172.21.15.59:0/837851906 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f1c013720 con 0x7f3f2809e000 2023-09-30T22:35:18.620 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:18.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.630+0000 7f3f2f2d0700 1 -- 172.21.15.59:0/837851906 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3f281a7d90 con 0x7f3f2809e000 2023-09-30T22:35:18.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.631+0000 7f3f19ffb700 1 -- 172.21.15.59:0/837851906 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f281a7d90 con 0x7f3f2809e000 2023-09-30T22:35:18.632 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:18.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.633+0000 7f3f2f2d0700 1 -- 172.21.15.59:0/837851906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2809e000 msgr2=0x7f3f281a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:18.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.633+0000 7f3f2f2d0700 1 --2- 172.21.15.59:0/837851906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2809e000 0x7f3f281a57a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00ebe0 tx=0x7f3f1c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.633+0000 7f3f2f2d0700 1 -- 172.21.15.59:0/837851906 shutdown_connections 2023-09-30T22:35:18.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.633+0000 7f3f2f2d0700 1 --2- 172.21.15.59:0/837851906 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f2809d6f0 0x7f3f281a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.633+0000 7f3f2f2d0700 1 --2- 172.21.15.59:0/837851906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f2809e410 0x7f3f281c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.633+0000 7f3f2f2d0700 1 --2- 172.21.15.59:0/837851906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f2809e000 0x7f3f281a57a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.633+0000 7f3f2f2d0700 1 -- 172.21.15.59:0/837851906 >> 172.21.15.59:0/837851906 conn(0x7f3f28066f50 msgr2=0x7f3f2806f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:18.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.633+0000 7f3f2f2d0700 1 -- 172.21.15.59:0/837851906 shutdown_connections 2023-09-30T22:35:18.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.633+0000 7f3f2f2d0700 1 -- 172.21.15.59:0/837851906 wait complete. 2023-09-30T22:35:18.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.756+0000 7f915570f700 1 Processor -- start 2023-09-30T22:35:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.757+0000 7f915570f700 1 -- start start 2023-09-30T22:35:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.757+0000 7f915570f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f915009e850 0x7f915009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.757+0000 7f915570f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f915009ffb0 0x7f915009f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.757+0000 7f915570f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9150133b80 0x7f9150133fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.757+0000 7f915570f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f915006b920 con 0x7f9150133b80 2023-09-30T22:35:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.757+0000 7f915570f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91500a06b0 con 0x7f915009ffb0 2023-09-30T22:35:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.757+0000 7f915570f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f915009aa30 con 0x7f915009e850 2023-09-30T22:35:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9150133b80 0x7f9150133fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f915009e850 0x7f915009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f915009ffb0 0x7f915009f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f915009e850 0x7f915009ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44322/0 (socket says 172.21.15.59:44322) 2023-09-30T22:35:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9150133b80 0x7f9150133fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53346/0 (socket says 172.21.15.59:53346) 2023-09-30T22:35:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914effd700 1 -- 172.21.15.59:0/1085042083 learned_addr learned my addr 172.21.15.59:0/1085042083 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914e7fc700 1 --2- 172.21.15.59:0/1085042083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f915009ffb0 0x7f915009f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37772/0 (socket says 172.21.15.59:37772) 2023-09-30T22:35:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914f7fe700 1 -- 172.21.15.59:0/1085042083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f915009e850 msgr2=0x7f915009ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914f7fe700 1 --2- 172.21.15.59:0/1085042083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f915009e850 0x7f915009ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914f7fe700 1 -- 172.21.15.59:0/1085042083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f915009ffb0 msgr2=0x7f915009f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914f7fe700 1 --2- 172.21.15.59:0/1085042083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f915009ffb0 0x7f915009f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914f7fe700 1 -- 172.21.15.59:0/1085042083 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915006caa0 con 0x7f9150133b80 2023-09-30T22:35:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914effd700 1 --2- 172.21.15.59:0/1085042083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f915009e850 0x7f915009ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914e7fc700 1 --2- 172.21.15.59:0/1085042083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f915009ffb0 0x7f915009f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914f7fe700 1 --2- 172.21.15.59:0/1085042083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9150133b80 0x7f9150133fe0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f9148009d90 tx=0x7f914800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80095201c7aac7cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914dffb700 1 -- 172.21.15.59:0/1085042083 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914800e070 con 0x7f9150133b80 2023-09-30T22:35:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914dffb700 1 -- 172.21.15.59:0/1085042083 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914800bb20 con 0x7f9150133b80 2023-09-30T22:35:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.758+0000 7f914dffb700 1 -- 172.21.15.59:0/1085042083 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148012430 con 0x7f9150133b80 2023-09-30T22:35:18.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.759+0000 7f915570f700 1 -- 172.21.15.59:0/1085042083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9150133b80 msgr2=0x7f9150133fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.759+0000 7f915570f700 1 --2- 172.21.15.59:0/1085042083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9150133b80 0x7f9150133fe0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f9148009d90 tx=0x7f914800b330 comp rx=0 tx=0).stop 2023-09-30T22:35:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.759+0000 7f915570f700 1 -- 172.21.15.59:0/1085042083 shutdown_connections 2023-09-30T22:35:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.759+0000 7f915570f700 1 --2- 172.21.15.59:0/1085042083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9150133b80 0x7f9150133fe0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.759+0000 7f915570f700 1 --2- 172.21.15.59:0/1085042083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f915009e850 0x7f915009ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.759+0000 7f915570f700 1 --2- 172.21.15.59:0/1085042083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f915009ffb0 0x7f915009f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.759+0000 7f915570f700 1 -- 172.21.15.59:0/1085042083 >> 172.21.15.59:0/1085042083 conn(0x7f91500a3f70 msgr2=0x7f91500a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.759+0000 7f915570f700 1 -- 172.21.15.59:0/1085042083 shutdown_connections 2023-09-30T22:35:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.759+0000 7f915570f700 1 -- 172.21.15.59:0/1085042083 wait complete. 2023-09-30T22:35:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.761+0000 7f915570f700 1 Processor -- start 2023-09-30T22:35:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.761+0000 7f915570f700 1 -- start start 2023-09-30T22:35:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.761+0000 7f915570f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f915009e850 0x7f9150120400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.761+0000 7f915570f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f915009ffb0 0x7f9150120940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.761+0000 7f915570f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9150133b80 0x7f9150120e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.761+0000 7f915570f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9150122010 con 0x7f9150133b80 2023-09-30T22:35:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.761+0000 7f915570f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9150123260 con 0x7f915009ffb0 2023-09-30T22:35:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.761+0000 7f915570f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91501225f0 con 0x7f915009e850 2023-09-30T22:35:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.761+0000 7f914e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f915009ffb0 0x7f9150120940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.761+0000 7f914e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f915009ffb0 0x7f9150120940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37778/0 (socket says 172.21.15.59:37778) 2023-09-30T22:35:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.762+0000 7f914e7fc700 1 -- 172.21.15.59:0/449198485 learned_addr learned my addr 172.21.15.59:0/449198485 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.762+0000 7f914effd700 1 --2- 172.21.15.59:0/449198485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f915009e850 0x7f9150120400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.762+0000 7f914f7fe700 1 --2- 172.21.15.59:0/449198485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9150133b80 0x7f9150120e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.762+0000 7f914effd700 1 -- 172.21.15.59:0/449198485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f915009ffb0 msgr2=0x7f9150120940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.762+0000 7f914effd700 1 --2- 172.21.15.59:0/449198485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f915009ffb0 0x7f9150120940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.762+0000 7f914effd700 1 -- 172.21.15.59:0/449198485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9150133b80 msgr2=0x7f9150120e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.762+0000 7f914effd700 1 --2- 172.21.15.59:0/449198485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9150133b80 0x7f9150120e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.762+0000 7f914effd700 1 -- 172.21.15.59:0/449198485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9140009550 con 0x7f915009e850 2023-09-30T22:35:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.762+0000 7f914effd700 1 --2- 172.21.15.59:0/449198485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f915009e850 0x7f9150120400 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f914000e9a0 tx=0x7f914000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.762+0000 7f91477fe700 1 -- 172.21.15.59:0/449198485 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140004030 con 0x7f915009e850 2023-09-30T22:35:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.762+0000 7f91477fe700 1 -- 172.21.15.59:0/449198485 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9140004190 con 0x7f915009e850 2023-09-30T22:35:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.762+0000 7f915570f700 1 -- 172.21.15.59:0/449198485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91380094a0 con 0x7f915009e850 2023-09-30T22:35:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.762+0000 7f91477fe700 1 -- 172.21.15.59:0/449198485 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140004520 con 0x7f915009e850 2023-09-30T22:35:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.762+0000 7f915570f700 1 -- 172.21.15.59:0/449198485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9148009a70 con 0x7f915009e850 2023-09-30T22:35:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.763+0000 7f91477fe700 1 -- 172.21.15.59:0/449198485 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91400036a0 con 0x7f915009e850 2023-09-30T22:35:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.763+0000 7f915570f700 1 -- 172.21.15.59:0/449198485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915009cbf0 con 0x7f915009e850 2023-09-30T22:35:18.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.763+0000 7f91477fe700 1 -- 172.21.15.59:0/449198485 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f914003f560 con 0x7f915009e850 2023-09-30T22:35:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.768+0000 7f91477fe700 1 -- 172.21.15.59:0/449198485 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9140019d60 con 0x7f915009e850 2023-09-30T22:35:18.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.971+0000 7f915570f700 1 -- 172.21.15.59:0/449198485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9150123b80 con 0x7f915009e850 2023-09-30T22:35:18.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.971+0000 7f91477fe700 1 -- 172.21.15.59:0/449198485 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9140019300 con 0x7f915009e850 2023-09-30T22:35:18.972 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:18.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.973+0000 7f915570f700 1 -- 172.21.15.59:0/449198485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f915009e850 msgr2=0x7f9150120400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:18.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.973+0000 7f915570f700 1 --2- 172.21.15.59:0/449198485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f915009e850 0x7f9150120400 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f914000e9a0 tx=0x7f914000ecb0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.973+0000 7f915570f700 1 -- 172.21.15.59:0/449198485 shutdown_connections 2023-09-30T22:35:18.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.973+0000 7f915570f700 1 --2- 172.21.15.59:0/449198485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f915009e850 0x7f9150120400 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.973+0000 7f915570f700 1 --2- 172.21.15.59:0/449198485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9150133b80 0x7f9150120e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.973+0000 7f915570f700 1 --2- 172.21.15.59:0/449198485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f915009ffb0 0x7f9150120940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:18.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.973+0000 7f915570f700 1 -- 172.21.15.59:0/449198485 >> 172.21.15.59:0/449198485 conn(0x7f91500a3f70 msgr2=0x7f91501baed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:18.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.973+0000 7f915570f700 1 -- 172.21.15.59:0/449198485 shutdown_connections 2023-09-30T22:35:18.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:18.973+0000 7f915570f700 1 -- 172.21.15.59:0/449198485 wait complete. 2023-09-30T22:35:18.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:19.201 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:19.235 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:19.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.347+0000 7f7b1b9f4700 1 Processor -- start 2023-09-30T22:35:19.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.348+0000 7f7b1b9f4700 1 -- start start 2023-09-30T22:35:19.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.348+0000 7f7b1b9f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b140a0a30 0x7f7b140a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.348+0000 7f7b1b9f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b1409d630 0x7f7b140a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.348+0000 7f7b1b9f4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b140a2a70 con 0x7f7b14133930 2023-09-30T22:35:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.348+0000 7f7b1b9f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b140a01d0 con 0x7f7b1409d630 2023-09-30T22:35:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.348+0000 7f7b1b9f4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1409e2b0 con 0x7f7b140a0a30 2023-09-30T22:35:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.348+0000 7f7b19790700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b140a0a30 0x7f7b140a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.348+0000 7f7b19790700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b140a0a30 0x7f7b140a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44336/0 (socket says 172.21.15.59:44336) 2023-09-30T22:35:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.348+0000 7f7b19790700 1 -- 172.21.15.59:0/3030661047 learned_addr learned my addr 172.21.15.59:0/3030661047 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.348+0000 7f7b18f8f700 1 --2- 172.21.15.59:0/3030661047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b1409d630 0x7f7b140a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.349+0000 7f7b19790700 1 -- 172.21.15.59:0/3030661047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b1409d630 msgr2=0x7f7b140a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.349+0000 7f7b19790700 1 --2- 172.21.15.59:0/3030661047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b1409d630 0x7f7b140a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.349+0000 7f7b19790700 1 -- 172.21.15.59:0/3030661047 >> v1:172.21.15.59:6789/0 conn(0x7f7b14133930 legacy=0x7f7b14133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.349+0000 7f7b19790700 1 -- 172.21.15.59:0/3030661047 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1409dc50 con 0x7f7b140a0a30 2023-09-30T22:35:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.349+0000 7f7b0bfff700 1 -- 172.21.15.59:0/3030661047 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574957724 0 0) 0x7f7b140a2a70 con 0x7f7b14133930 2023-09-30T22:35:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.349+0000 7f7b18f8f700 1 --2- 172.21.15.59:0/3030661047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b1409d630 0x7f7b140a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.349+0000 7f7b19790700 1 --2- 172.21.15.59:0/3030661047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b140a0a30 0x7f7b140a0e00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009e80 tx=0x7f7b1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52f6cbc7c59f9b83 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.349+0000 7f7b0bfff700 1 -- 172.21.15.59:0/3030661047 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1000e070 con 0x7f7b140a0a30 2023-09-30T22:35:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.349+0000 7f7b0bfff700 1 -- 172.21.15.59:0/3030661047 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1000b910 con 0x7f7b140a0a30 2023-09-30T22:35:19.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.349+0000 7f7b0bfff700 1 -- 172.21.15.59:0/3030661047 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1000bcc0 con 0x7f7b140a0a30 2023-09-30T22:35:19.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.350+0000 7f7b1b9f4700 1 -- 172.21.15.59:0/3030661047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b140a0a30 msgr2=0x7f7b140a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:19.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.350+0000 7f7b1b9f4700 1 --2- 172.21.15.59:0/3030661047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b140a0a30 0x7f7b140a0e00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009e80 tx=0x7f7b1000b330 comp rx=0 tx=0).stop 2023-09-30T22:35:19.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.350+0000 7f7b1b9f4700 1 -- 172.21.15.59:0/3030661047 shutdown_connections 2023-09-30T22:35:19.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.350+0000 7f7b1b9f4700 1 --2- 172.21.15.59:0/3030661047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b140a0a30 0x7f7b140a0e00 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.350+0000 7f7b1b9f4700 1 --2- 172.21.15.59:0/3030661047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b1409d630 0x7f7b140a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.350+0000 7f7b1b9f4700 1 -- 172.21.15.59:0/3030661047 >> 172.21.15.59:0/3030661047 conn(0x7f7b140a3050 msgr2=0x7f7b140a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:19.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.350+0000 7f7b1b9f4700 1 -- 172.21.15.59:0/3030661047 shutdown_connections 2023-09-30T22:35:19.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.350+0000 7f7b1b9f4700 1 -- 172.21.15.59:0/3030661047 wait complete. 2023-09-30T22:35:19.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.351+0000 7f7b1b9f4700 1 Processor -- start 2023-09-30T22:35:19.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.352+0000 7f7b1b9f4700 1 -- start start 2023-09-30T22:35:19.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.352+0000 7f7b1b9f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b1409d630 0x7f7b14121150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.352+0000 7f7b1b9f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b140a0a30 0x7f7b14121690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.352+0000 7f7b1b9f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b14133930 0x7f7b14121bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.352+0000 7f7b1b9f4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b14122d60 con 0x7f7b1409d630 2023-09-30T22:35:19.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.352+0000 7f7b1b9f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b14123bf0 con 0x7f7b140a0a30 2023-09-30T22:35:19.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.352+0000 7f7b1b9f4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b141246d0 con 0x7f7b14133930 2023-09-30T22:35:19.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.352+0000 7f7b19f91700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b14133930 0x7f7b14121bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.352+0000 7f7b19790700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b1409d630 0x7f7b14121150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.352+0000 7f7b18f8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b140a0a30 0x7f7b14121690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.352+0000 7f7b19f91700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b14133930 0x7f7b14121bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44340/0 (socket says 172.21.15.59:44340) 2023-09-30T22:35:19.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.352+0000 7f7b19790700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b1409d630 0x7f7b14121150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53356/0 (socket says 172.21.15.59:53356) 2023-09-30T22:35:19.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.352+0000 7f7b19f91700 1 -- 172.21.15.59:0/3324931552 learned_addr learned my addr 172.21.15.59:0/3324931552 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.353+0000 7f7b18f8f700 1 -- 172.21.15.59:0/3324931552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b14133930 msgr2=0x7f7b14121bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.353+0000 7f7b18f8f700 1 --2- 172.21.15.59:0/3324931552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b14133930 0x7f7b14121bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.353+0000 7f7b18f8f700 1 -- 172.21.15.59:0/3324931552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b1409d630 msgr2=0x7f7b14121150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.353+0000 7f7b18f8f700 1 --2- 172.21.15.59:0/3324931552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b1409d630 0x7f7b14121150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.353+0000 7f7b18f8f700 1 -- 172.21.15.59:0/3324931552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b040094a0 con 0x7f7b140a0a30 2023-09-30T22:35:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.353+0000 7f7b18f8f700 1 --2- 172.21.15.59:0/3324931552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b140a0a30 0x7f7b14121690 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400e9b0 tx=0x7f7b0400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.353+0000 7f7b09ffb700 1 -- 172.21.15.59:0/3324931552 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0400ee50 con 0x7f7b140a0a30 2023-09-30T22:35:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.353+0000 7f7b09ffb700 1 -- 172.21.15.59:0/3324931552 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0400c850 con 0x7f7b140a0a30 2023-09-30T22:35:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.353+0000 7f7b09ffb700 1 -- 172.21.15.59:0/3324931552 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0400cbe0 con 0x7f7b140a0a30 2023-09-30T22:35:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.353+0000 7f7b1b9f4700 1 -- 172.21.15.59:0/3324931552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b10009b30 con 0x7f7b140a0a30 2023-09-30T22:35:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.353+0000 7f7b1b9f4700 1 -- 172.21.15.59:0/3324931552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b141249f0 con 0x7f7b140a0a30 2023-09-30T22:35:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.354+0000 7f7b09ffb700 1 -- 172.21.15.59:0/3324931552 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b0400cd40 con 0x7f7b140a0a30 2023-09-30T22:35:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.354+0000 7f7b09ffb700 1 -- 172.21.15.59:0/3324931552 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7b0403fa40 con 0x7f7b140a0a30 2023-09-30T22:35:19.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.355+0000 7f7b1b9f4700 1 -- 172.21.15.59:0/3324931552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b14123fb0 con 0x7f7b140a0a30 2023-09-30T22:35:19.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.360+0000 7f7b09ffb700 1 -- 172.21.15.59:0/3324931552 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b04021080 con 0x7f7b140a0a30 2023-09-30T22:35:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.386+0000 7fa3e47a5700 1 Processor -- start 2023-09-30T22:35:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.386+0000 7fa3e47a5700 1 -- start start 2023-09-30T22:35:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e47a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3dc0a0a30 0x7fa3dc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e47a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3dc09d630 0x7fa3dc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e47a5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3dc133930 0x7fa3dc133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e47a5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3dc0a2a70 con 0x7fa3dc133930 2023-09-30T22:35:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e47a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc0a01d0 con 0x7fa3dc09d630 2023-09-30T22:35:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e47a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc09e2b0 con 0x7fa3dc0a0a30 2023-09-30T22:35:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e1d40700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3dc09d630 0x7fa3dc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e2541700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3dc0a0a30 0x7fa3dc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e2541700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3dc0a0a30 0x7fa3dc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44346/0 (socket says 172.21.15.59:44346) 2023-09-30T22:35:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e1d40700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3dc09d630 0x7fa3dc0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37792/0 (socket says 172.21.15.59:37792) 2023-09-30T22:35:19.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e2541700 1 -- 172.21.15.59:0/1592496195 learned_addr learned my addr 172.21.15.59:0/1592496195 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:19.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e2d42700 1 --2- 172.21.15.59:0/1592496195 >> v2:172.21.15.59:3300/0 conn(0x7fa3dc133930 0x7fa3dc133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e1d40700 1 -- 172.21.15.59:0/1592496195 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3dc0a0a30 msgr2=0x7fa3dc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:19.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e1d40700 1 --2- 172.21.15.59:0/1592496195 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3dc0a0a30 0x7fa3dc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e1d40700 1 -- 172.21.15.59:0/1592496195 >> v2:172.21.15.59:3300/0 conn(0x7fa3dc133930 msgr2=0x7fa3dc133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:19.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e1d40700 1 --2- 172.21.15.59:0/1592496195 >> v2:172.21.15.59:3300/0 conn(0x7fa3dc133930 0x7fa3dc133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e1d40700 1 -- 172.21.15.59:0/1592496195 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc09dc50 con 0x7fa3dc09d630 2023-09-30T22:35:19.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.387+0000 7fa3e2d42700 1 --2- 172.21.15.59:0/1592496195 >> v2:172.21.15.59:3300/0 conn(0x7fa3dc133930 0x7fa3dc133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:19.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.388+0000 7fa3e1d40700 1 --2- 172.21.15.59:0/1592496195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3dc09d630 0x7fa3dc0a1340 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009840 tx=0x7fa3cc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3404ebcb8e1603fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:19.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.388+0000 7fa3e153f700 1 -- 172.21.15.59:0/1592496195 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc011830 con 0x7fa3dc09d630 2023-09-30T22:35:19.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.388+0000 7fa3e153f700 1 -- 172.21.15.59:0/1592496195 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc011990 con 0x7fa3dc09d630 2023-09-30T22:35:19.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.388+0000 7fa3e153f700 1 -- 172.21.15.59:0/1592496195 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc011d20 con 0x7fa3dc09d630 2023-09-30T22:35:19.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.388+0000 7fa3e47a5700 1 -- 172.21.15.59:0/1592496195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3dc09d630 msgr2=0x7fa3dc0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:19.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.388+0000 7fa3e47a5700 1 --2- 172.21.15.59:0/1592496195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3dc09d630 0x7fa3dc0a1340 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009840 tx=0x7fa3cc009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:19.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.388+0000 7fa3e47a5700 1 -- 172.21.15.59:0/1592496195 shutdown_connections 2023-09-30T22:35:19.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.388+0000 7fa3e47a5700 1 --2- 172.21.15.59:0/1592496195 >> v2:172.21.15.59:3300/0 conn(0x7fa3dc133930 0x7fa3dc133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.388+0000 7fa3e47a5700 1 --2- 172.21.15.59:0/1592496195 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3dc0a0a30 0x7fa3dc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.388+0000 7fa3e47a5700 1 --2- 172.21.15.59:0/1592496195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3dc09d630 0x7fa3dc0a1340 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.388+0000 7fa3e47a5700 1 -- 172.21.15.59:0/1592496195 >> 172.21.15.59:0/1592496195 conn(0x7fa3dc0a3050 msgr2=0x7fa3dc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:19.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.389+0000 7fa3e47a5700 1 -- 172.21.15.59:0/1592496195 shutdown_connections 2023-09-30T22:35:19.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.389+0000 7fa3e47a5700 1 -- 172.21.15.59:0/1592496195 wait complete. 2023-09-30T22:35:19.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.389+0000 7fa3e47a5700 1 Processor -- start 2023-09-30T22:35:19.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e47a5700 1 -- start start 2023-09-30T22:35:19.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e47a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3dc09d630 0x7fa3dc11f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e47a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3dc0a0a30 0x7fa3dc11fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e47a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3dc133930 0x7fa3dc1c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e47a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc0a0410 con 0x7fa3dc133930 2023-09-30T22:35:19.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e47a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc122640 con 0x7fa3dc09d630 2023-09-30T22:35:19.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e47a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc11ef20 con 0x7fa3dc0a0a30 2023-09-30T22:35:19.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e2541700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3dc09d630 0x7fa3dc11f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e1d40700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3dc0a0a30 0x7fa3dc11fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e2d42700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3dc133930 0x7fa3dc1c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e2541700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3dc09d630 0x7fa3dc11f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37796/0 (socket says 172.21.15.59:37796) 2023-09-30T22:35:19.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e1d40700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3dc0a0a30 0x7fa3dc11fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44354/0 (socket says 172.21.15.59:44354) 2023-09-30T22:35:19.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e2541700 1 -- 172.21.15.59:0/4259979482 learned_addr learned my addr 172.21.15.59:0/4259979482 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:19.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e2541700 1 -- 172.21.15.59:0/4259979482 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3dc0a0a30 msgr2=0x7fa3dc11fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:19.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e2541700 1 --2- 172.21.15.59:0/4259979482 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3dc0a0a30 0x7fa3dc11fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e2541700 1 -- 172.21.15.59:0/4259979482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3dc133930 msgr2=0x7fa3dc1c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:19.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e2541700 1 --2- 172.21.15.59:0/4259979482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3dc133930 0x7fa3dc1c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.390+0000 7fa3e2541700 1 -- 172.21.15.59:0/4259979482 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d4009a70 con 0x7fa3dc09d630 2023-09-30T22:35:19.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.391+0000 7fa3e1d40700 1 --2- 172.21.15.59:0/4259979482 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3dc0a0a30 0x7fa3dc11fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:19.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.391+0000 7fa3e2541700 1 --2- 172.21.15.59:0/4259979482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3dc09d630 0x7fa3dc11f4c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800e910 tx=0x7fa3d800ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:19.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.391+0000 7fa3d2ffd700 1 -- 172.21.15.59:0/4259979482 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80096a0 con 0x7fa3dc09d630 2023-09-30T22:35:19.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.391+0000 7fa3d2ffd700 1 -- 172.21.15.59:0/4259979482 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d800c640 con 0x7fa3dc09d630 2023-09-30T22:35:19.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.391+0000 7fa3e47a5700 1 -- 172.21.15.59:0/4259979482 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3cc0094a0 con 0x7fa3dc09d630 2023-09-30T22:35:19.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.391+0000 7fa3d2ffd700 1 -- 172.21.15.59:0/4259979482 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800c9f0 con 0x7fa3dc09d630 2023-09-30T22:35:19.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.391+0000 7fa3e47a5700 1 -- 172.21.15.59:0/4259979482 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3dc121fa0 con 0x7fa3dc09d630 2023-09-30T22:35:19.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.392+0000 7fa3d2ffd700 1 -- 172.21.15.59:0/4259979482 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3d800cb50 con 0x7fa3dc09d630 2023-09-30T22:35:19.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.392+0000 7fa3d2ffd700 1 -- 172.21.15.59:0/4259979482 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa3d80137f0 con 0x7fa3dc09d630 2023-09-30T22:35:19.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.392+0000 7fa3e47a5700 1 -- 172.21.15.59:0/4259979482 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3dc1206f0 con 0x7fa3dc09d630 2023-09-30T22:35:19.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.397+0000 7fa3d2ffd700 1 -- 172.21.15.59:0/4259979482 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3d8044060 con 0x7fa3dc09d630 2023-09-30T22:35:19.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.621+0000 7f7b1b9f4700 1 -- 172.21.15.59:0/3324931552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7b1411df60 con 0x7f7b140a0a30 2023-09-30T22:35:19.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.621+0000 7f7b09ffb700 1 -- 172.21.15.59:0/3324931552 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b04011d90 con 0x7f7b140a0a30 2023-09-30T22:35:19.623 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:19.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.624+0000 7f7b1b9f4700 1 -- 172.21.15.59:0/3324931552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b140a0a30 msgr2=0x7f7b14121690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:19.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.624+0000 7f7b1b9f4700 1 --2- 172.21.15.59:0/3324931552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b140a0a30 0x7f7b14121690 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400e9b0 tx=0x7f7b0400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.624+0000 7f7b1b9f4700 1 -- 172.21.15.59:0/3324931552 shutdown_connections 2023-09-30T22:35:19.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.624+0000 7f7b1b9f4700 1 --2- 172.21.15.59:0/3324931552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b14133930 0x7f7b14121bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.624+0000 7f7b1b9f4700 1 --2- 172.21.15.59:0/3324931552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b1409d630 0x7f7b14121150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.624+0000 7f7b1b9f4700 1 --2- 172.21.15.59:0/3324931552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b140a0a30 0x7f7b14121690 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.624+0000 7f7b1b9f4700 1 -- 172.21.15.59:0/3324931552 >> 172.21.15.59:0/3324931552 conn(0x7f7b140a3050 msgr2=0x7f7b141331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:19.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.624+0000 7f7b1b9f4700 1 -- 172.21.15.59:0/3324931552 shutdown_connections 2023-09-30T22:35:19.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.624+0000 7f7b1b9f4700 1 -- 172.21.15.59:0/3324931552 wait complete. 2023-09-30T22:35:19.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:19.649 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:19.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.654+0000 7fa3e47a5700 1 -- 172.21.15.59:0/4259979482 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa3dc0747f0 con 0x7fa3dc09d630 2023-09-30T22:35:19.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.655+0000 7fa3d2ffd700 1 -- 172.21.15.59:0/4259979482 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3d8013470 con 0x7fa3dc09d630 2023-09-30T22:35:19.656 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:19.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.658+0000 7fa3e47a5700 1 -- 172.21.15.59:0/4259979482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3dc09d630 msgr2=0x7fa3dc11f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:19.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.658+0000 7fa3e47a5700 1 --2- 172.21.15.59:0/4259979482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3dc09d630 0x7fa3dc11f4c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800e910 tx=0x7fa3d800ec20 comp rx=0 tx=0).stop 2023-09-30T22:35:19.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.658+0000 7fa3e47a5700 1 -- 172.21.15.59:0/4259979482 shutdown_connections 2023-09-30T22:35:19.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.658+0000 7fa3e47a5700 1 --2- 172.21.15.59:0/4259979482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3dc133930 0x7fa3dc1c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.658+0000 7fa3e47a5700 1 --2- 172.21.15.59:0/4259979482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3dc09d630 0x7fa3dc11f4c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.658+0000 7fa3e47a5700 1 --2- 172.21.15.59:0/4259979482 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3dc0a0a30 0x7fa3dc11fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.658+0000 7fa3e47a5700 1 -- 172.21.15.59:0/4259979482 >> 172.21.15.59:0/4259979482 conn(0x7fa3dc0a3050 msgr2=0x7fa3dc09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:19.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.658+0000 7fa3e47a5700 1 -- 172.21.15.59:0/4259979482 shutdown_connections 2023-09-30T22:35:19.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.658+0000 7fa3e47a5700 1 -- 172.21.15.59:0/4259979482 wait complete. 2023-09-30T22:35:19.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:19.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.785+0000 7f66d42cd700 1 Processor -- start 2023-09-30T22:35:19.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.785+0000 7f66d42cd700 1 -- start start 2023-09-30T22:35:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.786+0000 7f66d42cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66cc09e930 0x7f66cc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.786+0000 7f66d42cd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66cc09f240 0x7f66cc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.786+0000 7f66d42cd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66cc070940 con 0x7f66cc09f650 2023-09-30T22:35:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.786+0000 7f66d42cd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66cc06fd60 con 0x7f66cc09f240 2023-09-30T22:35:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.786+0000 7f66d42cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc06fa80 con 0x7f66cc09e930 2023-09-30T22:35:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.786+0000 7f66d2069700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66cc09e930 0x7f66cc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.786+0000 7f66d1868700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66cc09f240 0x7f66cc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.786+0000 7f66d2069700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66cc09e930 0x7f66cc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44368/0 (socket says 172.21.15.59:44368) 2023-09-30T22:35:19.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.786+0000 7f66d2069700 1 -- 172.21.15.59:0/182560173 learned_addr learned my addr 172.21.15.59:0/182560173 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:19.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.786+0000 7f66d1868700 1 -- 172.21.15.59:0/182560173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66cc09e930 msgr2=0x7f66cc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:19.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.786+0000 7f66d1868700 1 --2- 172.21.15.59:0/182560173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66cc09e930 0x7f66cc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.786+0000 7f66d1868700 1 -- 172.21.15.59:0/182560173 >> v1:172.21.15.59:6789/0 conn(0x7f66cc09f650 legacy=0x7f66cc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:19.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.786+0000 7f66d1868700 1 -- 172.21.15.59:0/182560173 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc09fb60 con 0x7f66cc09f240 2023-09-30T22:35:19.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.786+0000 7f66d2069700 1 --2- 172.21.15.59:0/182560173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66cc09e930 0x7f66cc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:19.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.786+0000 7f66d1868700 1 --2- 172.21.15.59:0/182560173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66cc09f240 0x7f66cc1317f0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009840 tx=0x7f66bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33f8b6514b6635f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:19.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.787+0000 7f66d1067700 1 -- 172.21.15.59:0/182560173 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc011830 con 0x7f66cc09f240 2023-09-30T22:35:19.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.787+0000 7f66d1067700 1 -- 172.21.15.59:0/182560173 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66bc011990 con 0x7f66cc09f240 2023-09-30T22:35:19.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.787+0000 7f66d1067700 1 -- 172.21.15.59:0/182560173 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc011d20 con 0x7f66cc09f240 2023-09-30T22:35:19.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.787+0000 7f66d42cd700 1 -- 172.21.15.59:0/182560173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66cc09f240 msgr2=0x7f66cc1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.787+0000 7f66d42cd700 1 --2- 172.21.15.59:0/182560173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66cc09f240 0x7f66cc1317f0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009840 tx=0x7f66bc009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.787+0000 7f66d42cd700 1 -- 172.21.15.59:0/182560173 shutdown_connections 2023-09-30T22:35:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.787+0000 7f66d42cd700 1 --2- 172.21.15.59:0/182560173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66cc09e930 0x7f66cc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.787+0000 7f66d42cd700 1 --2- 172.21.15.59:0/182560173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66cc09f240 0x7f66cc1317f0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.787+0000 7f66d42cd700 1 -- 172.21.15.59:0/182560173 >> 172.21.15.59:0/182560173 conn(0x7f66cc0a4210 msgr2=0x7f66cc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.787+0000 7f66d42cd700 1 -- 172.21.15.59:0/182560173 shutdown_connections 2023-09-30T22:35:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.787+0000 7f66d42cd700 1 -- 172.21.15.59:0/182560173 wait complete. 2023-09-30T22:35:19.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.788+0000 7f66d42cd700 1 Processor -- start 2023-09-30T22:35:19.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.788+0000 7f66d42cd700 1 -- start start 2023-09-30T22:35:19.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d42cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66cc09e930 0x7f66cc1a4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d42cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66cc09f240 0x7f66cc1a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d42cd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66cc09f650 0x7f66cc1a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d42cd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc1b7340 con 0x7f66cc09f650 2023-09-30T22:35:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d42cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc0a3560 con 0x7f66cc09f240 2023-09-30T22:35:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d42cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc071d20 con 0x7f66cc09e930 2023-09-30T22:35:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d286a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66cc09f650 0x7f66cc1a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d2069700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66cc09e930 0x7f66cc1a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d1868700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66cc09f240 0x7f66cc1a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d2069700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66cc09e930 0x7f66cc1a4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44376/0 (socket says 172.21.15.59:44376) 2023-09-30T22:35:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d2069700 1 -- 172.21.15.59:0/1109769774 learned_addr learned my addr 172.21.15.59:0/1109769774 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d286a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66cc09f650 0x7f66cc1a4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53380/0 (socket says 172.21.15.59:53380) 2023-09-30T22:35:19.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d286a700 1 -- 172.21.15.59:0/1109769774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66cc09e930 msgr2=0x7f66cc1a4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:19.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d286a700 1 --2- 172.21.15.59:0/1109769774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66cc09e930 0x7f66cc1a4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d286a700 1 -- 172.21.15.59:0/1109769774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66cc09f240 msgr2=0x7f66cc1a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:19.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d286a700 1 --2- 172.21.15.59:0/1109769774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66cc09f240 0x7f66cc1a4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:19.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d286a700 1 -- 172.21.15.59:0/1109769774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c8009550 con 0x7f66cc09f650 2023-09-30T22:35:19.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d1868700 1 --2- 172.21.15.59:0/1109769774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66cc09f240 0x7f66cc1a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:19.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.789+0000 7f66d286a700 1 --2- 172.21.15.59:0/1109769774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66cc09f650 0x7f66cc1a4ab0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f66c400cb90 tx=0x7f66c400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:19.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.790+0000 7f66c2ffd700 1 -- 172.21.15.59:0/1109769774 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4003c00 con 0x7f66cc09f650 2023-09-30T22:35:19.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.790+0000 7f66c2ffd700 1 -- 172.21.15.59:0/1109769774 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c4003d60 con 0x7f66cc09f650 2023-09-30T22:35:19.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.790+0000 7f66d42cd700 1 -- 172.21.15.59:0/1109769774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66bc0094a0 con 0x7f66cc09f650 2023-09-30T22:35:19.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.790+0000 7f66c2ffd700 1 -- 172.21.15.59:0/1109769774 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c400aa80 con 0x7f66cc09f650 2023-09-30T22:35:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.790+0000 7f66d42cd700 1 -- 172.21.15.59:0/1109769774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66cc0a0190 con 0x7f66cc09f650 2023-09-30T22:35:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.790+0000 7f66c2ffd700 1 -- 172.21.15.59:0/1109769774 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66c400abe0 con 0x7f66cc09f650 2023-09-30T22:35:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.791+0000 7f66c2ffd700 1 -- 172.21.15.59:0/1109769774 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f66c403f550 con 0x7f66cc09f650 2023-09-30T22:35:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.791+0000 7f66d42cd700 1 -- 172.21.15.59:0/1109769774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66cc0a3180 con 0x7f66cc09f650 2023-09-30T22:35:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.796+0000 7f66c2ffd700 1 -- 172.21.15.59:0/1109769774 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66c40198f0 con 0x7f66cc09f650 2023-09-30T22:35:19.990 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:20.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.999+0000 7f66d42cd700 1 -- 172.21.15.59:0/1109769774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f66cc074ea0 con 0x7f66cc09f650 2023-09-30T22:35:20.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:19.999+0000 7f66c2ffd700 1 -- 172.21.15.59:0/1109769774 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66c4019300 con 0x7f66cc09f650 2023-09-30T22:35:20.006 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:20.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.001+0000 7f66d42cd700 1 -- 172.21.15.59:0/1109769774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66cc09f650 msgr2=0x7f66cc1a4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:20.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.001+0000 7f66d42cd700 1 --2- 172.21.15.59:0/1109769774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66cc09f650 0x7f66cc1a4ab0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f66c400cb90 tx=0x7f66c400cea0 comp rx=0 tx=0).stop 2023-09-30T22:35:20.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.001+0000 7f66d42cd700 1 -- 172.21.15.59:0/1109769774 shutdown_connections 2023-09-30T22:35:20.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.001+0000 7f66d42cd700 1 --2- 172.21.15.59:0/1109769774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66cc09e930 0x7f66cc1a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:20.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.001+0000 7f66d42cd700 1 --2- 172.21.15.59:0/1109769774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66cc09f650 0x7f66cc1a4ab0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:20.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.001+0000 7f66d42cd700 1 --2- 172.21.15.59:0/1109769774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66cc09f240 0x7f66cc1a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:20.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.001+0000 7f66d42cd700 1 -- 172.21.15.59:0/1109769774 >> 172.21.15.59:0/1109769774 conn(0x7f66cc0a4210 msgr2=0x7f66cc1b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:20.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.001+0000 7f66d42cd700 1 -- 172.21.15.59:0/1109769774 shutdown_connections 2023-09-30T22:35:20.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.001+0000 7f66d42cd700 1 -- 172.21.15.59:0/1109769774 wait complete. 2023-09-30T22:35:20.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:20.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.126+0000 7f6bc8514700 1 Processor -- start 2023-09-30T22:35:20.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.126+0000 7f6bc8514700 1 -- start start 2023-09-30T22:35:20.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.127+0000 7f6bc8514700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bc009e930 0x7f6bc009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:20.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.127+0000 7f6bc8514700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc009f650 0x7f6bc0131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:20.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.127+0000 7f6bc8514700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc0070940 con 0x7f6bc009f240 2023-09-30T22:35:20.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.127+0000 7f6bc8514700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc006fd60 con 0x7f6bc009f650 2023-09-30T22:35:20.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.127+0000 7f6bc8514700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc006fa80 con 0x7f6bc009e930 2023-09-30T22:35:20.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.127+0000 7f6bc6ab1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc009f650 0x7f6bc0131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:20.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.127+0000 7f6bc62b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bc009e930 0x7f6bc009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:20.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.127+0000 7f6bc5aaf700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6bc009f240 0x7f6bc01317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58560/0 (socket says 172.21.15.59:58560) 2023-09-30T22:35:20.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.127+0000 7f6bc5aaf700 1 -- 172.21.15.59:0/693211609 learned_addr learned my addr 172.21.15.59:0/693211609 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:20.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.127+0000 7f6bc62b0700 1 -- 172.21.15.59:0/693211609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc009f650 msgr2=0x7f6bc0131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:20.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.127+0000 7f6bc62b0700 1 --2- 172.21.15.59:0/693211609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc009f650 0x7f6bc0131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:20.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.127+0000 7f6bc52ae700 1 -- 172.21.15.59:0/693211609 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964660426 0 0) 0x7f6bc0070940 con 0x7f6bc009f240 2023-09-30T22:35:20.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.127+0000 7f6bc62b0700 1 -- 172.21.15.59:0/693211609 >> v1:172.21.15.59:6789/0 conn(0x7f6bc009f240 legacy=0x7f6bc01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:20.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.127+0000 7f6bc62b0700 1 -- 172.21.15.59:0/693211609 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc009fb60 con 0x7f6bc009e930 2023-09-30T22:35:20.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.127+0000 7f6bc6ab1700 1 --2- 172.21.15.59:0/693211609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc009f650 0x7f6bc0131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.128+0000 7f6bc62b0700 1 --2- 172.21.15.59:0/693211609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bc009e930 0x7f6bc009ed00 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009870 tx=0x7f6bb4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de45d06779d6a8e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.128+0000 7f6bc52ae700 1 -- 172.21.15.59:0/693211609 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4011830 con 0x7f6bc009e930 2023-09-30T22:35:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.128+0000 7f6bc52ae700 1 -- 172.21.15.59:0/693211609 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb4011990 con 0x7f6bc009e930 2023-09-30T22:35:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.128+0000 7f6bc52ae700 1 -- 172.21.15.59:0/693211609 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4011d20 con 0x7f6bc009e930 2023-09-30T22:35:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.128+0000 7f6bc8514700 1 -- 172.21.15.59:0/693211609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bc009e930 msgr2=0x7f6bc009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.128+0000 7f6bc8514700 1 --2- 172.21.15.59:0/693211609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bc009e930 0x7f6bc009ed00 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009870 tx=0x7f6bb4009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.128+0000 7f6bc8514700 1 -- 172.21.15.59:0/693211609 shutdown_connections 2023-09-30T22:35:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.128+0000 7f6bc8514700 1 --2- 172.21.15.59:0/693211609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bc009e930 0x7f6bc009ed00 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.128+0000 7f6bc8514700 1 --2- 172.21.15.59:0/693211609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc009f650 0x7f6bc0131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.129+0000 7f6bc8514700 1 -- 172.21.15.59:0/693211609 >> 172.21.15.59:0/693211609 conn(0x7f6bc00a4210 msgr2=0x7f6bc00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:20.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.129+0000 7f6bc8514700 1 -- 172.21.15.59:0/693211609 shutdown_connections 2023-09-30T22:35:20.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.129+0000 7f6bc8514700 1 -- 172.21.15.59:0/693211609 wait complete. 2023-09-30T22:35:20.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.129+0000 7f6bc8514700 1 Processor -- start 2023-09-30T22:35:20.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc8514700 1 -- start start 2023-09-30T22:35:20.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc8514700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bc009e930 0x7f6bc01a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:20.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc8514700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc009f240 0x7f6bc01a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:20.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc8514700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc009f650 0x7f6bc01c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:20.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc8514700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc01a4e60 con 0x7f6bc009f650 2023-09-30T22:35:20.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc8514700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc01b92a0 con 0x7f6bc009f240 2023-09-30T22:35:20.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc8514700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc01a7e90 con 0x7f6bc009e930 2023-09-30T22:35:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc62b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bc009e930 0x7f6bc01a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc6ab1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc009f650 0x7f6bc01c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc62b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bc009e930 0x7f6bc01a5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44386/0 (socket says 172.21.15.59:44386) 2023-09-30T22:35:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc62b0700 1 -- 172.21.15.59:0/2936328484 learned_addr learned my addr 172.21.15.59:0/2936328484 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc5aaf700 1 --2- 172.21.15.59:0/2936328484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc009f240 0x7f6bc01a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc62b0700 1 -- 172.21.15.59:0/2936328484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc009f240 msgr2=0x7f6bc01a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc62b0700 1 --2- 172.21.15.59:0/2936328484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc009f240 0x7f6bc01a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc62b0700 1 -- 172.21.15.59:0/2936328484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc009f650 msgr2=0x7f6bc01c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.130+0000 7f6bc62b0700 1 --2- 172.21.15.59:0/2936328484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc009f650 0x7f6bc01c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.131+0000 7f6bc62b0700 1 -- 172.21.15.59:0/2936328484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb8009a70 con 0x7f6bc009e930 2023-09-30T22:35:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.131+0000 7f6bc62b0700 1 --2- 172.21.15.59:0/2936328484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bc009e930 0x7f6bc01a5330 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009840 tx=0x7f6bb4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.131+0000 7f6bb2ffd700 1 -- 172.21.15.59:0/2936328484 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4004510 con 0x7f6bc009e930 2023-09-30T22:35:20.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.131+0000 7f6bb2ffd700 1 -- 172.21.15.59:0/2936328484 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb401f070 con 0x7f6bc009e930 2023-09-30T22:35:20.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.131+0000 7f6bc8514700 1 -- 172.21.15.59:0/2936328484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb40094a0 con 0x7f6bc009e930 2023-09-30T22:35:20.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.131+0000 7f6bb2ffd700 1 -- 172.21.15.59:0/2936328484 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb40038e0 con 0x7f6bc009e930 2023-09-30T22:35:20.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.131+0000 7f6bc8514700 1 -- 172.21.15.59:0/2936328484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc00a0190 con 0x7f6bc009e930 2023-09-30T22:35:20.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.132+0000 7f6bb2ffd700 1 -- 172.21.15.59:0/2936328484 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bb4003a40 con 0x7f6bc009e930 2023-09-30T22:35:20.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.132+0000 7f6bc8514700 1 -- 172.21.15.59:0/2936328484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc0071d20 con 0x7f6bc009e930 2023-09-30T22:35:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.132+0000 7f6bb2ffd700 1 -- 172.21.15.59:0/2936328484 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6bb4021070 con 0x7f6bc009e930 2023-09-30T22:35:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.137+0000 7f6bb2ffd700 1 -- 172.21.15.59:0/2936328484 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bb4024970 con 0x7f6bc009e930 2023-09-30T22:35:20.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.342+0000 7f6bc8514700 1 -- 172.21.15.59:0/2936328484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6bc0074ea0 con 0x7f6bc009e930 2023-09-30T22:35:20.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.342+0000 7f6bb2ffd700 1 -- 172.21.15.59:0/2936328484 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bb4040e60 con 0x7f6bc009e930 2023-09-30T22:35:20.362 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.344+0000 7f6bc8514700 1 -- 172.21.15.59:0/2936328484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bc009e930 msgr2=0x7f6bc01a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.344+0000 7f6bc8514700 1 --2- 172.21.15.59:0/2936328484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bc009e930 0x7f6bc01a5330 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009840 tx=0x7f6bb4004750 comp rx=0 tx=0).stop 2023-09-30T22:35:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.345+0000 7f6bc8514700 1 -- 172.21.15.59:0/2936328484 shutdown_connections 2023-09-30T22:35:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.345+0000 7f6bc8514700 1 --2- 172.21.15.59:0/2936328484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bc009e930 0x7f6bc01a5330 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.345+0000 7f6bc8514700 1 --2- 172.21.15.59:0/2936328484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc009f650 0x7f6bc01c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.345+0000 7f6bc8514700 1 --2- 172.21.15.59:0/2936328484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc009f240 0x7f6bc01a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.345+0000 7f6bc8514700 1 -- 172.21.15.59:0/2936328484 >> 172.21.15.59:0/2936328484 conn(0x7f6bc00a4210 msgr2=0x7f6bc01bbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.345+0000 7f6bc8514700 1 -- 172.21.15.59:0/2936328484 shutdown_connections 2023-09-30T22:35:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.345+0000 7f6bc8514700 1 -- 172.21.15.59:0/2936328484 wait complete. 2023-09-30T22:35:20.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:20.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:20.674 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:20.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.789+0000 7f97c7671700 1 Processor -- start 2023-09-30T22:35:21.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.789+0000 7f97c7671700 1 -- start start 2023-09-30T22:35:21.150 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:21.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.790+0000 7f97c7671700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97c00a0a30 0x7f97c00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.790+0000 7f97c7671700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97c00a1340 0x7f97c0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.790+0000 7f97c7671700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c009edd0 con 0x7f97c0133fa0 2023-09-30T22:35:21.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.790+0000 7f97c7671700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c009e1f0 con 0x7f97c00a1340 2023-09-30T22:35:21.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.790+0000 7f97c7671700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c009dc50 con 0x7f97c00a0a30 2023-09-30T22:35:21.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.790+0000 7f97c4c0c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97c00a1340 0x7f97c0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.790+0000 7f97c540d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97c00a0a30 0x7f97c00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.790+0000 7f97c4c0c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97c00a1340 0x7f97c0133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53398/0 (socket says 172.21.15.59:53398) 2023-09-30T22:35:21.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.790+0000 7f97c540d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97c00a0a30 0x7f97c00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37828/0 (socket says 172.21.15.59:37828) 2023-09-30T22:35:21.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.790+0000 7f97c4c0c700 1 -- 172.21.15.59:0/879507967 learned_addr learned my addr 172.21.15.59:0/879507967 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:21.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.790+0000 7f97c4c0c700 1 -- 172.21.15.59:0/879507967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97c00a0a30 msgr2=0x7f97c00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:21.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.790+0000 7f97c4c0c700 1 --2- 172.21.15.59:0/879507967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97c00a0a30 0x7f97c00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.790+0000 7f97c4c0c700 1 -- 172.21.15.59:0/879507967 >> v1:172.21.15.59:6789/0 conn(0x7f97c0133fa0 legacy=0x7f97c013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.790+0000 7f97c4c0c700 1 -- 172.21.15.59:0/879507967 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c00a1fe0 con 0x7f97c00a1340 2023-09-30T22:35:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.791+0000 7f97c4c0c700 1 --2- 172.21.15.59:0/879507967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97c00a1340 0x7f97c0133a60 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f97b00098f0 tx=0x7f97b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1190b56420df17a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.791+0000 7f97b7fff700 1 -- 172.21.15.59:0/879507967 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0011830 con 0x7f97c00a1340 2023-09-30T22:35:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.791+0000 7f97b7fff700 1 -- 172.21.15.59:0/879507967 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b0011990 con 0x7f97c00a1340 2023-09-30T22:35:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.791+0000 7f97b7fff700 1 -- 172.21.15.59:0/879507967 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0011d20 con 0x7f97c00a1340 2023-09-30T22:35:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.792+0000 7f97c7671700 1 -- 172.21.15.59:0/879507967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97c00a1340 msgr2=0x7f97c0133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.792+0000 7f97c7671700 1 --2- 172.21.15.59:0/879507967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97c00a1340 0x7f97c0133a60 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f97b00098f0 tx=0x7f97b0009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.792+0000 7f97c7671700 1 -- 172.21.15.59:0/879507967 shutdown_connections 2023-09-30T22:35:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.792+0000 7f97c7671700 1 --2- 172.21.15.59:0/879507967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97c00a0a30 0x7f97c00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.792+0000 7f97c7671700 1 --2- 172.21.15.59:0/879507967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97c00a1340 0x7f97c0133a60 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.792+0000 7f97c7671700 1 -- 172.21.15.59:0/879507967 >> 172.21.15.59:0/879507967 conn(0x7f97c00a6550 msgr2=0x7f97c00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.792+0000 7f97c7671700 1 -- 172.21.15.59:0/879507967 shutdown_connections 2023-09-30T22:35:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.792+0000 7f97c7671700 1 -- 172.21.15.59:0/879507967 wait complete. 2023-09-30T22:35:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.793+0000 7f97c7671700 1 Processor -- start 2023-09-30T22:35:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.793+0000 7f97c7671700 1 -- start start 2023-09-30T22:35:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.793+0000 7f97c7671700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97c00a0a30 0x7f97c011e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.793+0000 7f97c7671700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f97c00a1340 0x7f97c011ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.793+0000 7f97c7671700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97c0133fa0 0x7f97c011f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.793+0000 7f97c7671700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c01208f0 con 0x7f97c00a0a30 2023-09-30T22:35:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.793+0000 7f97c7671700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00a0220 con 0x7f97c0133fa0 2023-09-30T22:35:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.793+0000 7f97c7671700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97c01203b0 con 0x7f97c00a1340 2023-09-30T22:35:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.793+0000 7f97c540d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97c00a0a30 0x7f97c011e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.793+0000 7f97c540d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97c00a0a30 0x7f97c011e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53408/0 (socket says 172.21.15.59:53408) 2023-09-30T22:35:21.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.793+0000 7f97c540d700 1 -- 172.21.15.59:0/3149231314 learned_addr learned my addr 172.21.15.59:0/3149231314 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:21.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.793+0000 7f97c5c0e700 1 --2- 172.21.15.59:0/3149231314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97c0133fa0 0x7f97c011f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.793+0000 7f97c4c0c700 1 --2- 172.21.15.59:0/3149231314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f97c00a1340 0x7f97c011ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.794+0000 7f97c540d700 1 -- 172.21.15.59:0/3149231314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f97c00a1340 msgr2=0x7f97c011ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.794+0000 7f97c540d700 1 --2- 172.21.15.59:0/3149231314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f97c00a1340 0x7f97c011ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.794+0000 7f97c540d700 1 -- 172.21.15.59:0/3149231314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97c0133fa0 msgr2=0x7f97c011f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.794+0000 7f97c540d700 1 --2- 172.21.15.59:0/3149231314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97c0133fa0 0x7f97c011f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.794+0000 7f97c540d700 1 -- 172.21.15.59:0/3149231314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b0009550 con 0x7f97c00a0a30 2023-09-30T22:35:21.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.794+0000 7f97c540d700 1 --2- 172.21.15.59:0/3149231314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97c00a0a30 0x7f97c011e720 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f97b800e9e0 tx=0x7f97b800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:21.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.794+0000 7f97b5ffb700 1 -- 172.21.15.59:0/3149231314 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8009710 con 0x7f97c00a0a30 2023-09-30T22:35:21.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.794+0000 7f97b5ffb700 1 -- 172.21.15.59:0/3149231314 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b800ee80 con 0x7f97c00a0a30 2023-09-30T22:35:21.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.794+0000 7f97c7671700 1 -- 172.21.15.59:0/3149231314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c0121ed0 con 0x7f97c00a0a30 2023-09-30T22:35:21.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.794+0000 7f97b5ffb700 1 -- 172.21.15.59:0/3149231314 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b800ca50 con 0x7f97c00a0a30 2023-09-30T22:35:21.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.794+0000 7f97c7671700 1 -- 172.21.15.59:0/3149231314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c01221b0 con 0x7f97c00a0a30 2023-09-30T22:35:21.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.795+0000 7f97b5ffb700 1 -- 172.21.15.59:0/3149231314 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97b800cbb0 con 0x7f97c00a0a30 2023-09-30T22:35:21.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.795+0000 7f97b5ffb700 1 -- 172.21.15.59:0/3149231314 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f97b803f6a0 con 0x7f97c00a0a30 2023-09-30T22:35:21.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.795+0000 7f97c7671700 1 -- 172.21.15.59:0/3149231314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c00a1d40 con 0x7f97c00a0a30 2023-09-30T22:35:21.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.805+0000 7f97b5ffb700 1 -- 172.21.15.59:0/3149231314 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97b8021020 con 0x7f97c00a0a30 2023-09-30T22:35:21.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.830+0000 7f6a29561700 1 Processor -- start 2023-09-30T22:35:21.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.830+0000 7f6a29561700 1 -- start start 2023-09-30T22:35:21.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.831+0000 7f6a29561700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133420 0x7f6a241337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.831+0000 7f6a29561700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24133e30 0x7f6a2412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.831+0000 7f6a29561700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2406b990 con 0x7f6a24134260 2023-09-30T22:35:21.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.831+0000 7f6a29561700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240a0590 con 0x7f6a24133e30 2023-09-30T22:35:21.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.831+0000 7f6a29561700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2409fb80 con 0x7f6a24133420 2023-09-30T22:35:21.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.831+0000 7f6a227fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24133e30 0x7f6a2412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.831+0000 7f6a237fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6a24134260 0x7f6a241304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58578/0 (socket says 172.21.15.59:58578) 2023-09-30T22:35:21.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.831+0000 7f6a237fe700 1 -- 172.21.15.59:0/978934530 learned_addr learned my addr 172.21.15.59:0/978934530 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:21.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.831+0000 7f6a22ffd700 1 --2- 172.21.15.59:0/978934530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133420 0x7f6a241337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.831+0000 7f6a227fc700 1 -- 172.21.15.59:0/978934530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133420 msgr2=0x7f6a241337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:21.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.831+0000 7f6a227fc700 1 --2- 172.21.15.59:0/978934530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133420 0x7f6a241337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.831+0000 7f6a227fc700 1 -- 172.21.15.59:0/978934530 >> v1:172.21.15.59:6789/0 conn(0x7f6a24134260 legacy=0x7f6a241304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.831+0000 7f6a227fc700 1 -- 172.21.15.59:0/978934530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a240a0030 con 0x7f6a24133e30 2023-09-30T22:35:21.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.832+0000 7f6a227fc700 1 --2- 172.21.15.59:0/978934530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24133e30 0x7f6a2412ff90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009870 tx=0x7f6a18009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aeb618b9af6eedd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:21.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.832+0000 7f6a21ffb700 1 -- 172.21.15.59:0/978934530 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18011830 con 0x7f6a24133e30 2023-09-30T22:35:21.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.832+0000 7f6a21ffb700 1 -- 172.21.15.59:0/978934530 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a18011990 con 0x7f6a24133e30 2023-09-30T22:35:21.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.832+0000 7f6a21ffb700 1 -- 172.21.15.59:0/978934530 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18011d20 con 0x7f6a24133e30 2023-09-30T22:35:21.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.832+0000 7f6a29561700 1 -- 172.21.15.59:0/978934530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24133e30 msgr2=0x7f6a2412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.832+0000 7f6a29561700 1 --2- 172.21.15.59:0/978934530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24133e30 0x7f6a2412ff90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009870 tx=0x7f6a18009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:21.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.833+0000 7f6a29561700 1 -- 172.21.15.59:0/978934530 shutdown_connections 2023-09-30T22:35:21.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.833+0000 7f6a29561700 1 --2- 172.21.15.59:0/978934530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133420 0x7f6a241337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.833+0000 7f6a29561700 1 --2- 172.21.15.59:0/978934530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24133e30 0x7f6a2412ff90 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.833+0000 7f6a29561700 1 -- 172.21.15.59:0/978934530 >> 172.21.15.59:0/978934530 conn(0x7f6a240a4210 msgr2=0x7f6a240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:21.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.833+0000 7f6a29561700 1 -- 172.21.15.59:0/978934530 shutdown_connections 2023-09-30T22:35:21.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.833+0000 7f6a29561700 1 -- 172.21.15.59:0/978934530 wait complete. 2023-09-30T22:35:21.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.834+0000 7f6a29561700 1 Processor -- start 2023-09-30T22:35:21.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.834+0000 7f6a29561700 1 -- start start 2023-09-30T22:35:21.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.834+0000 7f6a29561700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24133420 0x7f6a2409c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.834+0000 7f6a29561700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133e30 0x7f6a2409ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.834+0000 7f6a29561700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24134260 0x7f6a2409cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.834+0000 7f6a29561700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2411eed0 con 0x7f6a24133420 2023-09-30T22:35:21.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.834+0000 7f6a29561700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a241318b0 con 0x7f6a24134260 2023-09-30T22:35:21.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.834+0000 7f6a29561700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2409e180 con 0x7f6a24133e30 2023-09-30T22:35:21.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.834+0000 7f6a227fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133e30 0x7f6a2409ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.834+0000 7f6a237fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24134260 0x7f6a2409cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.834+0000 7f6a227fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133e30 0x7f6a2409ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44418/0 (socket says 172.21.15.59:44418) 2023-09-30T22:35:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.834+0000 7f6a227fc700 1 -- 172.21.15.59:0/269775990 learned_addr learned my addr 172.21.15.59:0/269775990 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.834+0000 7f6a22ffd700 1 --2- 172.21.15.59:0/269775990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24133420 0x7f6a2409c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.835+0000 7f6a237fe700 1 -- 172.21.15.59:0/269775990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133e30 msgr2=0x7f6a2409ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.835+0000 7f6a237fe700 1 --2- 172.21.15.59:0/269775990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133e30 0x7f6a2409ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.835+0000 7f6a237fe700 1 -- 172.21.15.59:0/269775990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24133420 msgr2=0x7f6a2409c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.835+0000 7f6a237fe700 1 --2- 172.21.15.59:0/269775990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24133420 0x7f6a2409c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.835+0000 7f6a237fe700 1 -- 172.21.15.59:0/269775990 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a180094a0 con 0x7f6a24134260 2023-09-30T22:35:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.835+0000 7f6a237fe700 1 --2- 172.21.15.59:0/269775990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24134260 0x7f6a2409cf70 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c00caa0 tx=0x7f6a1c00cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.835+0000 7f6a0b7fe700 1 -- 172.21.15.59:0/269775990 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c00a9a0 con 0x7f6a24134260 2023-09-30T22:35:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.835+0000 7f6a0b7fe700 1 -- 172.21.15.59:0/269775990 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c00ab00 con 0x7f6a24134260 2023-09-30T22:35:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.835+0000 7f6a29561700 1 -- 172.21.15.59:0/269775990 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2411ffd0 con 0x7f6a24134260 2023-09-30T22:35:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.835+0000 7f6a0b7fe700 1 -- 172.21.15.59:0/269775990 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c00ae70 con 0x7f6a24134260 2023-09-30T22:35:21.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.835+0000 7f6a29561700 1 -- 172.21.15.59:0/269775990 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2412d4f0 con 0x7f6a24134260 2023-09-30T22:35:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.836+0000 7f6a29561700 1 -- 172.21.15.59:0/269775990 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2406d590 con 0x7f6a24134260 2023-09-30T22:35:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.836+0000 7f6a0b7fe700 1 -- 172.21.15.59:0/269775990 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a1c01b3b0 con 0x7f6a24134260 2023-09-30T22:35:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.837+0000 7f6a0b7fe700 1 -- 172.21.15.59:0/269775990 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6a1c03f280 con 0x7f6a24134260 2023-09-30T22:35:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:20.841+0000 7f6a0b7fe700 1 -- 172.21.15.59:0/269775990 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a1c0192c0 con 0x7f6a24134260 2023-09-30T22:35:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.013+0000 7f97c7671700 1 -- 172.21.15.59:0/3149231314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f97c0074ea0 con 0x7f97c00a0a30 2023-09-30T22:35:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.013+0000 7f97b5ffb700 1 -- 172.21.15.59:0/3149231314 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97b80232f0 con 0x7f97c00a0a30 2023-09-30T22:35:21.456 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.015+0000 7f97c7671700 1 -- 172.21.15.59:0/3149231314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97c00a0a30 msgr2=0x7f97c011e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.015+0000 7f97c7671700 1 --2- 172.21.15.59:0/3149231314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97c00a0a30 0x7f97c011e720 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f97b800e9e0 tx=0x7f97b800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.016+0000 7f97c7671700 1 -- 172.21.15.59:0/3149231314 shutdown_connections 2023-09-30T22:35:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.016+0000 7f97c7671700 1 --2- 172.21.15.59:0/3149231314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97c0133fa0 0x7f97c011f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.016+0000 7f97c7671700 1 --2- 172.21.15.59:0/3149231314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97c00a0a30 0x7f97c011e720 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.016+0000 7f97c7671700 1 --2- 172.21.15.59:0/3149231314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f97c00a1340 0x7f97c011ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.016+0000 7f97c7671700 1 -- 172.21.15.59:0/3149231314 >> 172.21.15.59:0/3149231314 conn(0x7f97c00a6550 msgr2=0x7f97c01bc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.016+0000 7f97c7671700 1 -- 172.21.15.59:0/3149231314 shutdown_connections 2023-09-30T22:35:21.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.016+0000 7f97c7671700 1 -- 172.21.15.59:0/3149231314 wait complete. 2023-09-30T22:35:21.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:21.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.044+0000 7f6a29561700 1 -- 172.21.15.59:0/269775990 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6a24074ea0 con 0x7f6a24134260 2023-09-30T22:35:21.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.045+0000 7f6a0b7fe700 1 -- 172.21.15.59:0/269775990 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a1c017030 con 0x7f6a24134260 2023-09-30T22:35:21.459 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:21.459 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.047+0000 7f6a29561700 1 -- 172.21.15.59:0/269775990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24134260 msgr2=0x7f6a2409cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.047+0000 7f6a29561700 1 --2- 172.21.15.59:0/269775990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24134260 0x7f6a2409cf70 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c00caa0 tx=0x7f6a1c00cdb0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.047+0000 7f6a29561700 1 -- 172.21.15.59:0/269775990 shutdown_connections 2023-09-30T22:35:21.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.047+0000 7f6a29561700 1 --2- 172.21.15.59:0/269775990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24134260 0x7f6a2409cf70 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.047+0000 7f6a29561700 1 --2- 172.21.15.59:0/269775990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24133420 0x7f6a2409c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.047+0000 7f6a29561700 1 --2- 172.21.15.59:0/269775990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133e30 0x7f6a2409ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.047+0000 7f6a29561700 1 -- 172.21.15.59:0/269775990 >> 172.21.15.59:0/269775990 conn(0x7f6a240a4210 msgr2=0x7f6a240a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:21.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.047+0000 7f6a29561700 1 -- 172.21.15.59:0/269775990 shutdown_connections 2023-09-30T22:35:21.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.047+0000 7f6a29561700 1 -- 172.21.15.59:0/269775990 wait complete. 2023-09-30T22:35:21.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.642+0000 7f28f0ecc700 1 Processor -- start 2023-09-30T22:35:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.642+0000 7f084db43700 1 Processor -- start 2023-09-30T22:35:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.642+0000 7f28f0ecc700 1 -- start start 2023-09-30T22:35:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.642+0000 7f084db43700 1 -- start start 2023-09-30T22:35:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f084db43700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08480a0a30 0x7f08480a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f084db43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0848138d80 0x7f084813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f084db43700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08480a2a70 con 0x7f084809d630 2023-09-30T22:35:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f084db43700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08480a01d0 con 0x7f0848138d80 2023-09-30T22:35:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f084db43700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f084809e2b0 con 0x7f08480a0a30 2023-09-30T22:35:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f0847fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0848138d80 0x7f084813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f08477fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08480a0a30 0x7f08480a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f0846ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f084809d630 0x7f08480a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58590/0 (socket says 172.21.15.59:58590) 2023-09-30T22:35:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f0847fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0848138d80 0x7f084813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37884/0 (socket says 172.21.15.59:37884) 2023-09-30T22:35:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f0846ffd700 1 -- 172.21.15.59:0/3650980636 learned_addr learned my addr 172.21.15.59:0/3650980636 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f08477fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08480a0a30 0x7f08480a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44428/0 (socket says 172.21.15.59:44428) 2023-09-30T22:35:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f28f0ecc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ec1338a0 0x7f28ec133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f28f0ecc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ec09de50 0x7f28ec09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f28f0ecc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28ec09e760 0x7f28ec13a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f28f0ecc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ec06fef0 con 0x7f28ec09e760 2023-09-30T22:35:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f28f0ecc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec06ef30 con 0x7f28ec09de50 2023-09-30T22:35:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f28f0ecc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec1334b0 con 0x7f28ec1338a0 2023-09-30T22:35:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f28ea59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ec1338a0 0x7f28ec133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f28ea59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ec1338a0 0x7f28ec133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44438/0 (socket says 172.21.15.59:44438) 2023-09-30T22:35:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f28ea59c700 1 -- 172.21.15.59:0/123229662 learned_addr learned my addr 172.21.15.59:0/123229662 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f08467fc700 1 -- 172.21.15.59:0/3650980636 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186785073 0 0) 0x7f08480a2a70 con 0x7f084809d630 2023-09-30T22:35:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f08467fc700 1 -- 172.21.15.59:0/3650980636 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08300035b0 con 0x7f084809d630 2023-09-30T22:35:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f28ead9d700 1 --2- 172.21.15.59:0/123229662 >> v2:172.21.15.59:3300/0 conn(0x7f28ec09e760 0x7f28ec13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f28e9d9b700 1 --2- 172.21.15.59:0/123229662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ec09de50 0x7f28ec09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f28ea59c700 1 -- 172.21.15.59:0/123229662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ec09de50 msgr2=0x7f28ec09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f28ea59c700 1 --2- 172.21.15.59:0/123229662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ec09de50 0x7f28ec09e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f28ea59c700 1 -- 172.21.15.59:0/123229662 >> v2:172.21.15.59:3300/0 conn(0x7f28ec09e760 msgr2=0x7f28ec13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f28ea59c700 1 --2- 172.21.15.59:0/123229662 >> v2:172.21.15.59:3300/0 conn(0x7f28ec09e760 0x7f28ec13a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f28ea59c700 1 -- 172.21.15.59:0/123229662 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec06fc30 con 0x7f28ec1338a0 2023-09-30T22:35:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f28e9d9b700 1 --2- 172.21.15.59:0/123229662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ec09de50 0x7f28ec09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:35:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f0847fff700 1 -- 172.21.15.59:0/3650980636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08480a0a30 msgr2=0x7f08480a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.643+0000 7f0847fff700 1 --2- 172.21.15.59:0/3650980636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08480a0a30 0x7f08480a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f28ea59c700 1 --2- 172.21.15.59:0/123229662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ec1338a0 0x7f28ec133c70 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009e80 tx=0x7f28e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cef3fe392da20c3f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:21.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f0847fff700 1 -- 172.21.15.59:0/3650980636 >> v1:172.21.15.59:6789/0 conn(0x7f084809d630 legacy=0x7f08480a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f0847fff700 1 -- 172.21.15.59:0/3650980636 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084809dc50 con 0x7f0848138d80 2023-09-30T22:35:21.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f0847fff700 1 --2- 172.21.15.59:0/3650980636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0848138d80 0x7f084813b160 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0840009dc0 tx=0x7f084000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66521dc418f997db server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f28e959a700 1 -- 172.21.15.59:0/123229662 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400e070 con 0x7f28ec1338a0 2023-09-30T22:35:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f28e959a700 1 -- 172.21.15.59:0/123229662 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e400b980 con 0x7f28ec1338a0 2023-09-30T22:35:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f28e959a700 1 -- 172.21.15.59:0/123229662 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400bd30 con 0x7f28ec1338a0 2023-09-30T22:35:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f08467fc700 1 -- 172.21.15.59:0/3650980636 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084000e070 con 0x7f0848138d80 2023-09-30T22:35:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f08467fc700 1 -- 172.21.15.59:0/3650980636 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084000bb20 con 0x7f0848138d80 2023-09-30T22:35:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.644+0000 7f08467fc700 1 -- 172.21.15.59:0/3650980636 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840012430 con 0x7f0848138d80 2023-09-30T22:35:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f28f0ecc700 1 -- 172.21.15.59:0/123229662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ec1338a0 msgr2=0x7f28ec133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f28f0ecc700 1 --2- 172.21.15.59:0/123229662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ec1338a0 0x7f28ec133c70 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009e80 tx=0x7f28e400b330 comp rx=0 tx=0).stop 2023-09-30T22:35:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f084db43700 1 -- 172.21.15.59:0/3650980636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0848138d80 msgr2=0x7f084813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f084db43700 1 --2- 172.21.15.59:0/3650980636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0848138d80 0x7f084813b160 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0840009dc0 tx=0x7f084000b330 comp rx=0 tx=0).stop 2023-09-30T22:35:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f084db43700 1 -- 172.21.15.59:0/3650980636 shutdown_connections 2023-09-30T22:35:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f084db43700 1 --2- 172.21.15.59:0/3650980636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08480a0a30 0x7f08480a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f28f0ecc700 1 -- 172.21.15.59:0/123229662 shutdown_connections 2023-09-30T22:35:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f084db43700 1 --2- 172.21.15.59:0/3650980636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0848138d80 0x7f084813b160 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f084db43700 1 -- 172.21.15.59:0/3650980636 >> 172.21.15.59:0/3650980636 conn(0x7f08480a3050 msgr2=0x7f08480a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f28f0ecc700 1 --2- 172.21.15.59:0/123229662 >> v2:172.21.15.59:3300/0 conn(0x7f28ec09e760 0x7f28ec13a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f28f0ecc700 1 --2- 172.21.15.59:0/123229662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ec1338a0 0x7f28ec133c70 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f28f0ecc700 1 --2- 172.21.15.59:0/123229662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ec09de50 0x7f28ec09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f28f0ecc700 1 -- 172.21.15.59:0/123229662 >> 172.21.15.59:0/123229662 conn(0x7f28ec0a2aa0 msgr2=0x7f28ec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:21.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f28f0ecc700 1 -- 172.21.15.59:0/123229662 shutdown_connections 2023-09-30T22:35:21.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f28f0ecc700 1 -- 172.21.15.59:0/123229662 wait complete. 2023-09-30T22:35:21.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f084db43700 1 -- 172.21.15.59:0/3650980636 shutdown_connections 2023-09-30T22:35:21.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.645+0000 7f084db43700 1 -- 172.21.15.59:0/3650980636 wait complete. 2023-09-30T22:35:21.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.646+0000 7f28f0ecc700 1 Processor -- start 2023-09-30T22:35:21.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.646+0000 7f28f0ecc700 1 -- start start 2023-09-30T22:35:21.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.646+0000 7f084db43700 1 Processor -- start 2023-09-30T22:35:21.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f28f0ecc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ec09de50 0x7f28ec11eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f084db43700 1 -- start start 2023-09-30T22:35:21.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f28f0ecc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ec09e760 0x7f28ec11f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f28f0ecc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28ec1338a0 0x7f28ec11f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f28f0ecc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec122160 con 0x7f28ec1338a0 2023-09-30T22:35:21.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f28f0ecc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec120000 con 0x7f28ec09de50 2023-09-30T22:35:21.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f28f0ecc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec12f6e0 con 0x7f28ec09e760 2023-09-30T22:35:21.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f28e9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ec09e760 0x7f28ec11f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f28e9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ec09e760 0x7f28ec11f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44452/0 (socket says 172.21.15.59:44452) 2023-09-30T22:35:21.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f28e9d9b700 1 -- 172.21.15.59:0/3275859384 learned_addr learned my addr 172.21.15.59:0/3275859384 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:21.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f28ead9d700 1 --2- 172.21.15.59:0/3275859384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28ec1338a0 0x7f28ec11f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f28e9d9b700 1 -- 172.21.15.59:0/3275859384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ec09de50 msgr2=0x7f28ec11eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f28e9d9b700 1 --2- 172.21.15.59:0/3275859384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ec09de50 0x7f28ec11eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f28e9d9b700 1 -- 172.21.15.59:0/3275859384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28ec1338a0 msgr2=0x7f28ec11f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f28e9d9b700 1 --2- 172.21.15.59:0/3275859384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28ec1338a0 0x7f28ec11f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f28e9d9b700 1 -- 172.21.15.59:0/3275859384 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e4009b30 con 0x7f28ec09e760 2023-09-30T22:35:21.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f084db43700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f084809d630 0x7f084811c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.647+0000 7f084db43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08480a0a30 0x7f084811cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f084db43700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0848138d80 0x7f084811d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:21.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f084db43700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084811f1f0 con 0x7f0848138d80 2023-09-30T22:35:21.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f084db43700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084811e790 con 0x7f08480a0a30 2023-09-30T22:35:21.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f084db43700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f084809d320 con 0x7f084809d630 2023-09-30T22:35:21.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f28e9d9b700 1 --2- 172.21.15.59:0/3275859384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ec09e760 0x7f28ec11f0e0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f28d400c7f0 tx=0x7f28d400cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f08477fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f084809d630 0x7f084811c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f08477fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f084809d630 0x7f084811c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44468/0 (socket says 172.21.15.59:44468) 2023-09-30T22:35:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f08477fe700 1 -- 172.21.15.59:0/2751778433 learned_addr learned my addr 172.21.15.59:0/2751778433 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f0847fff700 1 --2- 172.21.15.59:0/2751778433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0848138d80 0x7f084811d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f0846ffd700 1 --2- 172.21.15.59:0/2751778433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08480a0a30 0x7f084811cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:21.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f28e2ffd700 1 -- 172.21.15.59:0/3275859384 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4011800 con 0x7f28ec09e760 2023-09-30T22:35:21.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f28e2ffd700 1 -- 172.21.15.59:0/3275859384 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d4011960 con 0x7f28ec09e760 2023-09-30T22:35:21.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f28f0ecc700 1 -- 172.21.15.59:0/3275859384 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ec06f640 con 0x7f28ec09e760 2023-09-30T22:35:21.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f0847fff700 1 -- 172.21.15.59:0/2751778433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f084809d630 msgr2=0x7f084811c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f0847fff700 1 --2- 172.21.15.59:0/2751778433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f084809d630 0x7f084811c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f0847fff700 1 -- 172.21.15.59:0/2751778433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08480a0a30 msgr2=0x7f084811cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f0847fff700 1 --2- 172.21.15.59:0/2751778433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08480a0a30 0x7f084811cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f0847fff700 1 -- 172.21.15.59:0/2751778433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0840009a70 con 0x7f0848138d80 2023-09-30T22:35:21.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f28e2ffd700 1 -- 172.21.15.59:0/3275859384 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4011d10 con 0x7f28ec09e760 2023-09-30T22:35:21.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f08477fe700 1 --2- 172.21.15.59:0/2751778433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f084809d630 0x7f084811c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:21.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.648+0000 7f28f0ecc700 1 -- 172.21.15.59:0/3275859384 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ec120760 con 0x7f28ec09e760 2023-09-30T22:35:21.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.649+0000 7f28e2ffd700 1 -- 172.21.15.59:0/3275859384 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28d4018360 con 0x7f28ec09e760 2023-09-30T22:35:21.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.649+0000 7f0847fff700 1 --2- 172.21.15.59:0/2751778433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0848138d80 0x7f084811d240 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f08480672b0 tx=0x7f0840004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:21.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.649+0000 7f28e2ffd700 1 -- 172.21.15.59:0/3275859384 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f28d403f310 con 0x7f28ec09e760 2023-09-30T22:35:21.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.649+0000 7f082ffff700 1 -- 172.21.15.59:0/2751778433 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840012430 con 0x7f0848138d80 2023-09-30T22:35:21.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.649+0000 7f082ffff700 1 -- 172.21.15.59:0/2751778433 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0840020070 con 0x7f0848138d80 2023-09-30T22:35:21.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.649+0000 7f084db43700 1 -- 172.21.15.59:0/2751778433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08480a0410 con 0x7f0848138d80 2023-09-30T22:35:21.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.650+0000 7f084db43700 1 -- 172.21.15.59:0/2751778433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084811fee0 con 0x7f0848138d80 2023-09-30T22:35:21.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.650+0000 7f082ffff700 1 -- 172.21.15.59:0/2751778433 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840004280 con 0x7f0848138d80 2023-09-30T22:35:21.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.650+0000 7f28f0ecc700 1 -- 172.21.15.59:0/3275859384 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ec06f950 con 0x7f28ec09e760 2023-09-30T22:35:21.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.651+0000 7f084db43700 1 -- 172.21.15.59:0/2751778433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08280052e0 con 0x7f0848138d80 2023-09-30T22:35:21.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.651+0000 7f082ffff700 1 -- 172.21.15.59:0/2751778433 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08400043e0 con 0x7f0848138d80 2023-09-30T22:35:21.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.652+0000 7f082ffff700 1 -- 172.21.15.59:0/2751778433 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0840022070 con 0x7f0848138d80 2023-09-30T22:35:21.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.655+0000 7f28e2ffd700 1 -- 172.21.15.59:0/3275859384 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28d400f2d0 con 0x7f28ec09e760 2023-09-30T22:35:21.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.656+0000 7f082ffff700 1 -- 172.21.15.59:0/2751778433 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0840011bf0 con 0x7f0848138d80 2023-09-30T22:35:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.886+0000 7f28f0ecc700 1 -- 172.21.15.59:0/3275859384 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f28ec074ea0 con 0x7f28ec09e760 2023-09-30T22:35:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.886+0000 7f084db43700 1 -- 172.21.15.59:0/2751778433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0828005150 con 0x7f0848138d80 2023-09-30T22:35:21.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.886+0000 7f082ffff700 1 -- 172.21.15.59:0/2751778433 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0840011800 con 0x7f0848138d80 2023-09-30T22:35:21.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.886+0000 7f28e2ffd700 1 -- 172.21.15.59:0/3275859384 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28d401f030 con 0x7f28ec09e760 2023-09-30T22:35:21.888 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:21.889 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:21.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.888+0000 7f28f0ecc700 1 -- 172.21.15.59:0/3275859384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ec09e760 msgr2=0x7f28ec11f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.888+0000 7f28f0ecc700 1 --2- 172.21.15.59:0/3275859384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ec09e760 0x7f28ec11f0e0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f28d400c7f0 tx=0x7f28d400cb00 comp rx=0 tx=0).stop 2023-09-30T22:35:21.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.888+0000 7f28f0ecc700 1 -- 172.21.15.59:0/3275859384 shutdown_connections 2023-09-30T22:35:21.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.888+0000 7f28f0ecc700 1 --2- 172.21.15.59:0/3275859384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28ec1338a0 0x7f28ec11f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.888+0000 7f28f0ecc700 1 --2- 172.21.15.59:0/3275859384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28ec09de50 0x7f28ec11eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.888+0000 7f28f0ecc700 1 --2- 172.21.15.59:0/3275859384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28ec09e760 0x7f28ec11f0e0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.888+0000 7f28f0ecc700 1 -- 172.21.15.59:0/3275859384 >> 172.21.15.59:0/3275859384 conn(0x7f28ec0a2aa0 msgr2=0x7f28ec09ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:21.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.888+0000 7f28f0ecc700 1 -- 172.21.15.59:0/3275859384 shutdown_connections 2023-09-30T22:35:21.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.889+0000 7f28f0ecc700 1 -- 172.21.15.59:0/3275859384 wait complete. 2023-09-30T22:35:21.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.889+0000 7f084db43700 1 -- 172.21.15.59:0/2751778433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0848138d80 msgr2=0x7f084811d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:21.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.889+0000 7f084db43700 1 --2- 172.21.15.59:0/2751778433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0848138d80 0x7f084811d240 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f08480672b0 tx=0x7f0840004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.889+0000 7f084db43700 1 -- 172.21.15.59:0/2751778433 shutdown_connections 2023-09-30T22:35:21.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.889+0000 7f084db43700 1 --2- 172.21.15.59:0/2751778433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f084809d630 0x7f084811c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.889+0000 7f084db43700 1 --2- 172.21.15.59:0/2751778433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0848138d80 0x7f084811d240 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.889+0000 7f084db43700 1 --2- 172.21.15.59:0/2751778433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08480a0a30 0x7f084811cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:21.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.889+0000 7f084db43700 1 -- 172.21.15.59:0/2751778433 >> 172.21.15.59:0/2751778433 conn(0x7f08480a3050 msgr2=0x7f084809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:21.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.889+0000 7f084db43700 1 -- 172.21.15.59:0/2751778433 shutdown_connections 2023-09-30T22:35:21.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:21.889+0000 7f084db43700 1 -- 172.21.15.59:0/2751778433 wait complete. 2023-09-30T22:35:21.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:21.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:22.459 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:22.462 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:22.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.605+0000 7fa728bf8700 1 Processor -- start 2023-09-30T22:35:22.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.605+0000 7fa728bf8700 1 -- start start 2023-09-30T22:35:22.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.605+0000 7fa728bf8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa724133a80 0x7fa724133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:22.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.606+0000 7fa728bf8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa724130a40 0x7fa72413b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:22.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.606+0000 7fa728bf8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72406bc00 con 0x7fa72412ff20 2023-09-30T22:35:22.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.606+0000 7fa728bf8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72406c570 con 0x7fa724130a40 2023-09-30T22:35:22.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.606+0000 7fa728bf8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7240a0040 con 0x7fa724133a80 2023-09-30T22:35:22.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.606+0000 7fa72259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa724133a80 0x7fa724133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:22.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.606+0000 7fa72259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa724133a80 0x7fa724133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37926/0 (socket says 172.21.15.59:37926) 2023-09-30T22:35:22.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.606+0000 7fa72259c700 1 -- 172.21.15.59:0/2156270650 learned_addr learned my addr 172.21.15.59:0/2156270650 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:22.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.606+0000 7fa722d9d700 1 --2- 172.21.15.59:0/2156270650 >> v2:172.21.15.59:3300/0 conn(0x7fa724130a40 0x7fa72413b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:22.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.606+0000 7fa72259c700 1 -- 172.21.15.59:0/2156270650 >> v2:172.21.15.59:3300/0 conn(0x7fa724130a40 msgr2=0x7fa72413b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:22.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.606+0000 7fa72259c700 1 --2- 172.21.15.59:0/2156270650 >> v2:172.21.15.59:3300/0 conn(0x7fa724130a40 0x7fa72413b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.606+0000 7fa72259c700 1 -- 172.21.15.59:0/2156270650 >> v1:172.21.15.59:6789/0 conn(0x7fa72412ff20 legacy=0x7fa724130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:22.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.606+0000 7fa72259c700 1 -- 172.21.15.59:0/2156270650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa724133860 con 0x7fa724133a80 2023-09-30T22:35:22.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.606+0000 7fa722d9d700 1 --2- 172.21.15.59:0/2156270650 >> v2:172.21.15.59:3300/0 conn(0x7fa724130a40 0x7fa72413b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:22.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.606+0000 7fa72259c700 1 --2- 172.21.15.59:0/2156270650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa724133a80 0x7fa724133e50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa7140098f0 tx=0x7fa714009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aca7120be68a19c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:22.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.606+0000 7fa72159a700 1 -- 172.21.15.59:0/2156270650 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa714011830 con 0x7fa724133a80 2023-09-30T22:35:22.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.607+0000 7fa72159a700 1 -- 172.21.15.59:0/2156270650 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa714011990 con 0x7fa724133a80 2023-09-30T22:35:22.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.607+0000 7fa72159a700 1 -- 172.21.15.59:0/2156270650 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa714011d20 con 0x7fa724133a80 2023-09-30T22:35:22.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.607+0000 7fa728bf8700 1 -- 172.21.15.59:0/2156270650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa724133a80 msgr2=0x7fa724133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:22.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.607+0000 7fa728bf8700 1 --2- 172.21.15.59:0/2156270650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa724133a80 0x7fa724133e50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa7140098f0 tx=0x7fa714009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:22.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.607+0000 7fa728bf8700 1 -- 172.21.15.59:0/2156270650 shutdown_connections 2023-09-30T22:35:22.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.607+0000 7fa728bf8700 1 --2- 172.21.15.59:0/2156270650 >> v2:172.21.15.59:3300/0 conn(0x7fa724130a40 0x7fa72413b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.607+0000 7fa728bf8700 1 --2- 172.21.15.59:0/2156270650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa724133a80 0x7fa724133e50 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.607+0000 7fa728bf8700 1 -- 172.21.15.59:0/2156270650 >> 172.21.15.59:0/2156270650 conn(0x7fa7240a4210 msgr2=0x7fa7240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:22.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.607+0000 7fa728bf8700 1 -- 172.21.15.59:0/2156270650 shutdown_connections 2023-09-30T22:35:22.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.607+0000 7fa728bf8700 1 -- 172.21.15.59:0/2156270650 wait complete. 2023-09-30T22:35:22.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.609+0000 7fa728bf8700 1 Processor -- start 2023-09-30T22:35:22.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.609+0000 7fa728bf8700 1 -- start start 2023-09-30T22:35:22.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa728bf8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa72412ff20 0x7fa7240709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:22.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa728bf8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa724130a40 0x7fa724070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:22.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa728bf8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa724133a80 0x7fa724071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:22.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa728bf8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa724071d70 con 0x7fa724133a80 2023-09-30T22:35:22.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa728bf8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7241203d0 con 0x7fa724130a40 2023-09-30T22:35:22.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa728bf8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa72412d770 con 0x7fa72412ff20 2023-09-30T22:35:22.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa72259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa72412ff20 0x7fa7240709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:22.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa72259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa72412ff20 0x7fa7240709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44484/0 (socket says 172.21.15.59:44484) 2023-09-30T22:35:22.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa72259c700 1 -- 172.21.15.59:0/1930295517 learned_addr learned my addr 172.21.15.59:0/1930295517 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:22.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa722d9d700 1 --2- 172.21.15.59:0/1930295517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa724133a80 0x7fa724071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:22.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa721d9b700 1 --2- 172.21.15.59:0/1930295517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa724130a40 0x7fa724070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:22.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa722d9d700 1 -- 172.21.15.59:0/1930295517 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa72412ff20 msgr2=0x7fa7240709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:22.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa722d9d700 1 --2- 172.21.15.59:0/1930295517 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa72412ff20 0x7fa7240709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa722d9d700 1 -- 172.21.15.59:0/1930295517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa724130a40 msgr2=0x7fa724070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:22.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa722d9d700 1 --2- 172.21.15.59:0/1930295517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa724130a40 0x7fa724070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa722d9d700 1 -- 172.21.15.59:0/1930295517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c009a70 con 0x7fa724133a80 2023-09-30T22:35:22.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.610+0000 7fa72259c700 1 --2- 172.21.15.59:0/1930295517 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa72412ff20 0x7fa7240709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:22.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.611+0000 7fa722d9d700 1 --2- 172.21.15.59:0/1930295517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa724133a80 0x7fa724071420 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fa71c009e50 tx=0x7fa71c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:22.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.611+0000 7fa712ffd700 1 -- 172.21.15.59:0/1930295517 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c00ca90 con 0x7fa724133a80 2023-09-30T22:35:22.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.611+0000 7fa712ffd700 1 -- 172.21.15.59:0/1930295517 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71c00f040 con 0x7fa724133a80 2023-09-30T22:35:22.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.611+0000 7fa728bf8700 1 -- 172.21.15.59:0/1930295517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa714009550 con 0x7fa724133a80 2023-09-30T22:35:22.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.611+0000 7fa712ffd700 1 -- 172.21.15.59:0/1930295517 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c00ce50 con 0x7fa724133a80 2023-09-30T22:35:22.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.611+0000 7fa728bf8700 1 -- 172.21.15.59:0/1930295517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72411fda0 con 0x7fa724133a80 2023-09-30T22:35:22.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.612+0000 7fa712ffd700 1 -- 172.21.15.59:0/1930295517 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa71c014480 con 0x7fa724133a80 2023-09-30T22:35:22.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.612+0000 7fa728bf8700 1 -- 172.21.15.59:0/1930295517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa724074ea0 con 0x7fa724133a80 2023-09-30T22:35:22.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.612+0000 7fa712ffd700 1 -- 172.21.15.59:0/1930295517 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa71c03fc90 con 0x7fa724133a80 2023-09-30T22:35:22.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.617+0000 7fa712ffd700 1 -- 172.21.15.59:0/1930295517 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa71c012700 con 0x7fa724133a80 2023-09-30T22:35:22.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.644+0000 7f6f1bb38700 1 Processor -- start 2023-09-30T22:35:22.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.645+0000 7f6f1bb38700 1 -- start start 2023-09-30T22:35:22.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.645+0000 7f6f1bb38700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f1409d630 0x7f6f140a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:22.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.645+0000 7f6f1bb38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f14138d80 0x7f6f1413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:22.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.645+0000 7f6f1bb38700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f140a2a70 con 0x7f6f140a0a30 2023-09-30T22:35:22.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.645+0000 7f6f1bb38700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f140a01d0 con 0x7f6f1409d630 2023-09-30T22:35:22.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.645+0000 7f6f1bb38700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1409e2b0 con 0x7f6f14138d80 2023-09-30T22:35:22.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.645+0000 7f6f190d3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f1409d630 0x7f6f140a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:22.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.645+0000 7f6f1a0d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f14138d80 0x7f6f1413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:22.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.645+0000 7f6f198d4700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6f140a0a30 0x7f6f140a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58600/0 (socket says 172.21.15.59:58600) 2023-09-30T22:35:22.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.645+0000 7f6f198d4700 1 -- 172.21.15.59:0/3761037638 learned_addr learned my addr 172.21.15.59:0/3761037638 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:22.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.646+0000 7f6f190d3700 1 -- 172.21.15.59:0/3761037638 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f14138d80 msgr2=0x7f6f1413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:22.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.646+0000 7f6f190d3700 1 --2- 172.21.15.59:0/3761037638 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f14138d80 0x7f6f1413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.646+0000 7f6f190d3700 1 -- 172.21.15.59:0/3761037638 >> v1:172.21.15.59:6789/0 conn(0x7f6f140a0a30 legacy=0x7f6f140a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:22.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.646+0000 7f6f188d2700 1 -- 172.21.15.59:0/3761037638 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447633604 0 0) 0x7f6f140a2a70 con 0x7f6f140a0a30 2023-09-30T22:35:22.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.646+0000 7f6f190d3700 1 -- 172.21.15.59:0/3761037638 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1409dc50 con 0x7f6f1409d630 2023-09-30T22:35:22.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.646+0000 7f6f1a0d5700 1 --2- 172.21.15.59:0/3761037638 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f14138d80 0x7f6f1413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:22.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.646+0000 7f6f190d3700 1 --2- 172.21.15.59:0/3761037638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f1409d630 0x7f6f140a1510 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009840 tx=0x7f6f08009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b3f955169ee228 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:22.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.646+0000 7f6f188d2700 1 -- 172.21.15.59:0/3761037638 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08011830 con 0x7f6f1409d630 2023-09-30T22:35:22.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.646+0000 7f6f188d2700 1 -- 172.21.15.59:0/3761037638 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f08011990 con 0x7f6f1409d630 2023-09-30T22:35:22.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.646+0000 7f6f188d2700 1 -- 172.21.15.59:0/3761037638 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08011d20 con 0x7f6f1409d630 2023-09-30T22:35:22.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.647+0000 7f6f1bb38700 1 -- 172.21.15.59:0/3761037638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f1409d630 msgr2=0x7f6f140a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:22.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.647+0000 7f6f1bb38700 1 --2- 172.21.15.59:0/3761037638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f1409d630 0x7f6f140a1510 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009840 tx=0x7f6f08009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:22.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.647+0000 7f6f1bb38700 1 -- 172.21.15.59:0/3761037638 shutdown_connections 2023-09-30T22:35:22.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.647+0000 7f6f1bb38700 1 --2- 172.21.15.59:0/3761037638 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f14138d80 0x7f6f1413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.647+0000 7f6f1bb38700 1 --2- 172.21.15.59:0/3761037638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f1409d630 0x7f6f140a1510 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.647+0000 7f6f1bb38700 1 -- 172.21.15.59:0/3761037638 >> 172.21.15.59:0/3761037638 conn(0x7f6f140a3050 msgr2=0x7f6f140a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:22.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.647+0000 7f6f1bb38700 1 -- 172.21.15.59:0/3761037638 shutdown_connections 2023-09-30T22:35:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.647+0000 7f6f1bb38700 1 -- 172.21.15.59:0/3761037638 wait complete. 2023-09-30T22:35:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.648+0000 7f6f1bb38700 1 Processor -- start 2023-09-30T22:35:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.648+0000 7f6f1bb38700 1 -- start start 2023-09-30T22:35:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.648+0000 7f6f1bb38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f1409d630 0x7f6f1412c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.648+0000 7f6f1bb38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f140a0a30 0x7f6f1412c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.648+0000 7f6f1bb38700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f14138d80 0x7f6f1412ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.648+0000 7f6f1bb38700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f140a0410 con 0x7f6f14138d80 2023-09-30T22:35:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.648+0000 7f6f1bb38700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1412de70 con 0x7f6f1409d630 2023-09-30T22:35:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.648+0000 7f6f1bb38700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f140a4aa0 con 0x7f6f140a0a30 2023-09-30T22:35:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f198d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f1409d630 0x7f6f1412c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f1a0d5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f14138d80 0x7f6f1412ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f198d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f1409d630 0x7f6f1412c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37948/0 (socket says 172.21.15.59:37948) 2023-09-30T22:35:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f198d4700 1 -- 172.21.15.59:0/4255927718 learned_addr learned my addr 172.21.15.59:0/4255927718 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f190d3700 1 --2- 172.21.15.59:0/4255927718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f140a0a30 0x7f6f1412c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f198d4700 1 -- 172.21.15.59:0/4255927718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f140a0a30 msgr2=0x7f6f1412c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f198d4700 1 --2- 172.21.15.59:0/4255927718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f140a0a30 0x7f6f1412c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f198d4700 1 -- 172.21.15.59:0/4255927718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f14138d80 msgr2=0x7f6f1412ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f198d4700 1 --2- 172.21.15.59:0/4255927718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f14138d80 0x7f6f1412ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f198d4700 1 -- 172.21.15.59:0/4255927718 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f04009a70 con 0x7f6f1409d630 2023-09-30T22:35:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f190d3700 1 --2- 172.21.15.59:0/4255927718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f140a0a30 0x7f6f1412c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f198d4700 1 --2- 172.21.15.59:0/4255927718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f1409d630 0x7f6f1412c3b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00c550 tx=0x7f6f0c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f127fc700 1 -- 172.21.15.59:0/4255927718 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c004c80 con 0x7f6f1409d630 2023-09-30T22:35:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f127fc700 1 -- 172.21.15.59:0/4255927718 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c004e00 con 0x7f6f1409d630 2023-09-30T22:35:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f1bb38700 1 -- 172.21.15.59:0/4255927718 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f080094a0 con 0x7f6f1409d630 2023-09-30T22:35:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.649+0000 7f6f127fc700 1 -- 172.21.15.59:0/4255927718 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c007310 con 0x7f6f1409d630 2023-09-30T22:35:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.650+0000 7f6f1bb38700 1 -- 172.21.15.59:0/4255927718 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f1412eae0 con 0x7f6f1409d630 2023-09-30T22:35:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.650+0000 7f6f127fc700 1 -- 172.21.15.59:0/4255927718 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f0c007470 con 0x7f6f1409d630 2023-09-30T22:35:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.650+0000 7f6f127fc700 1 -- 172.21.15.59:0/4255927718 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f0c03f320 con 0x7f6f1409d630 2023-09-30T22:35:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.650+0000 7f6f1bb38700 1 -- 172.21.15.59:0/4255927718 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f140747f0 con 0x7f6f1409d630 2023-09-30T22:35:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.655+0000 7f6f127fc700 1 -- 172.21.15.59:0/4255927718 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f0c0123b0 con 0x7f6f1409d630 2023-09-30T22:35:22.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.823+0000 7fa728bf8700 1 -- 172.21.15.59:0/1930295517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa72411ff90 con 0x7fa724133a80 2023-09-30T22:35:22.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.824+0000 7fa712ffd700 1 -- 172.21.15.59:0/1930295517 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa71c012340 con 0x7fa724133a80 2023-09-30T22:35:22.825 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:22.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.826+0000 7fa728bf8700 1 -- 172.21.15.59:0/1930295517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa724133a80 msgr2=0x7fa724071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.826+0000 7fa728bf8700 1 --2- 172.21.15.59:0/1930295517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa724133a80 0x7fa724071420 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fa71c009e50 tx=0x7fa71c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.826+0000 7fa728bf8700 1 -- 172.21.15.59:0/1930295517 shutdown_connections 2023-09-30T22:35:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.826+0000 7fa728bf8700 1 --2- 172.21.15.59:0/1930295517 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa72412ff20 0x7fa7240709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.826+0000 7fa728bf8700 1 --2- 172.21.15.59:0/1930295517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa724133a80 0x7fa724071420 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.826+0000 7fa728bf8700 1 --2- 172.21.15.59:0/1930295517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa724130a40 0x7fa724070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.826+0000 7fa728bf8700 1 -- 172.21.15.59:0/1930295517 >> 172.21.15.59:0/1930295517 conn(0x7fa7240a4210 msgr2=0x7fa72409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.826+0000 7fa728bf8700 1 -- 172.21.15.59:0/1930295517 shutdown_connections 2023-09-30T22:35:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.826+0000 7fa728bf8700 1 -- 172.21.15.59:0/1930295517 wait complete. 2023-09-30T22:35:22.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:22.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.860+0000 7f6f1bb38700 1 -- 172.21.15.59:0/4255927718 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6f1412ed20 con 0x7f6f1409d630 2023-09-30T22:35:22.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.860+0000 7f6f127fc700 1 -- 172.21.15.59:0/4255927718 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f0c011360 con 0x7f6f1409d630 2023-09-30T22:35:22.862 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:22.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.863+0000 7f6f1bb38700 1 -- 172.21.15.59:0/4255927718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f1409d630 msgr2=0x7f6f1412c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:22.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.863+0000 7f6f1bb38700 1 --2- 172.21.15.59:0/4255927718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f1409d630 0x7f6f1412c3b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00c550 tx=0x7f6f0c00c860 comp rx=0 tx=0).stop 2023-09-30T22:35:22.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.863+0000 7f6f1bb38700 1 -- 172.21.15.59:0/4255927718 shutdown_connections 2023-09-30T22:35:22.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.863+0000 7f6f1bb38700 1 --2- 172.21.15.59:0/4255927718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f14138d80 0x7f6f1412ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.863+0000 7f6f1bb38700 1 --2- 172.21.15.59:0/4255927718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f1409d630 0x7f6f1412c3b0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.863+0000 7f6f1bb38700 1 --2- 172.21.15.59:0/4255927718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f140a0a30 0x7f6f1412c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:22.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.863+0000 7f6f1bb38700 1 -- 172.21.15.59:0/4255927718 >> 172.21.15.59:0/4255927718 conn(0x7f6f140a3050 msgr2=0x7f6f1409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:22.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.863+0000 7f6f1bb38700 1 -- 172.21.15.59:0/4255927718 shutdown_connections 2023-09-30T22:35:22.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:22.863+0000 7f6f1bb38700 1 -- 172.21.15.59:0/4255927718 wait complete. 2023-09-30T22:35:22.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:22.906 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:22.906 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:23.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.057+0000 7f837f848700 1 Processor -- start 2023-09-30T22:35:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.057+0000 7fd1b3551700 1 Processor -- start 2023-09-30T22:35:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.058+0000 7f837f848700 1 -- start start 2023-09-30T22:35:23.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.058+0000 7fd1b3551700 1 -- start start 2023-09-30T22:35:23.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837f848700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83780a0a30 0x7f83780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837f848700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837809d630 0x7f83780a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837f848700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8378133930 0x7f8378133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837f848700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83780a2a70 con 0x7f8378133930 2023-09-30T22:35:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837f848700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83780a01d0 con 0x7f83780a0a30 2023-09-30T22:35:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7fd1b3551700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1ac09d9f0 0x7fd1ac136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7fd1b3551700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd1ac136a70 0x7fd1ac138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7fd1b3551700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ac09e130 con 0x7fd1ac1316c0 2023-09-30T22:35:23.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7fd1b3551700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac1321a0 con 0x7fd1ac136a70 2023-09-30T22:35:23.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7fd1b3551700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac1312b0 con 0x7fd1ac09d9f0 2023-09-30T22:35:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837f848700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f837809e2b0 con 0x7f837809d630 2023-09-30T22:35:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7fd1b12ed700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd1ac1316c0 0x7fd1ac131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58608/0 (socket says 172.21.15.59:58608) 2023-09-30T22:35:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7fd1b12ed700 1 -- 172.21.15.59:0/3558501892 learned_addr learned my addr 172.21.15.59:0/3558501892 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837dde5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8378133930 0x7f8378133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837cde3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837809d630 0x7f83780a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837cde3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837809d630 0x7f83780a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44500/0 (socket says 172.21.15.59:44500) 2023-09-30T22:35:23.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837dde5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8378133930 0x7f8378133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53492/0 (socket says 172.21.15.59:53492) 2023-09-30T22:35:23.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837cde3700 1 -- 172.21.15.59:0/2257339306 learned_addr learned my addr 172.21.15.59:0/2257339306 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:23.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837d5e4700 1 --2- 172.21.15.59:0/2257339306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83780a0a30 0x7f83780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7fd1b0aec700 1 --2- 172.21.15.59:0/3558501892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1ac09d9f0 0x7fd1ac136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7fd1b1aee700 1 --2- 172.21.15.59:0/3558501892 >> v2:172.21.15.59:3300/0 conn(0x7fd1ac136a70 0x7fd1ac138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7fd1a3fff700 1 -- 172.21.15.59:0/3558501892 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370710185 0 0) 0x7fd1a8001110 con 0x7fd1ac1316c0 2023-09-30T22:35:23.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7fd1a3fff700 1 -- 172.21.15.59:0/3558501892 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1980035b0 con 0x7fd1ac1316c0 2023-09-30T22:35:23.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.060+0000 7fd1b0aec700 1 -- 172.21.15.59:0/3558501892 >> v2:172.21.15.59:3300/0 conn(0x7fd1ac136a70 msgr2=0x7fd1ac138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:23.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.060+0000 7fd1b0aec700 1 --2- 172.21.15.59:0/3558501892 >> v2:172.21.15.59:3300/0 conn(0x7fd1ac136a70 0x7fd1ac138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.060+0000 7fd1b0aec700 1 -- 172.21.15.59:0/3558501892 >> v1:172.21.15.59:6789/0 conn(0x7fd1ac1316c0 legacy=0x7fd1ac131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:23.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.060+0000 7fd1b0aec700 1 -- 172.21.15.59:0/3558501892 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac09f6e0 con 0x7fd1ac09d9f0 2023-09-30T22:35:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837d5e4700 1 -- 172.21.15.59:0/2257339306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837809d630 msgr2=0x7f83780a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837d5e4700 1 --2- 172.21.15.59:0/2257339306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837809d630 0x7f83780a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837d5e4700 1 -- 172.21.15.59:0/2257339306 >> v2:172.21.15.59:3300/0 conn(0x7f8378133930 msgr2=0x7f8378133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.059+0000 7f837d5e4700 1 --2- 172.21.15.59:0/2257339306 >> v2:172.21.15.59:3300/0 conn(0x7f8378133930 0x7f8378133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.060+0000 7f837d5e4700 1 -- 172.21.15.59:0/2257339306 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837809dc50 con 0x7f83780a0a30 2023-09-30T22:35:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.060+0000 7fd1b0aec700 1 --2- 172.21.15.59:0/3558501892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1ac09d9f0 0x7fd1ac136530 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009840 tx=0x7fd19c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f588f9bc118f76 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.060+0000 7f837d5e4700 1 --2- 172.21.15.59:0/2257339306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83780a0a30 0x7f83780a0e00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8368009d90 tx=0x7f836800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7daa46ea75b70ee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.060+0000 7fd1a3fff700 1 -- 172.21.15.59:0/3558501892 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c004230 con 0x7fd1ac09d9f0 2023-09-30T22:35:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.060+0000 7f8377fff700 1 -- 172.21.15.59:0/2257339306 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836800e070 con 0x7f83780a0a30 2023-09-30T22:35:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.060+0000 7f8377fff700 1 -- 172.21.15.59:0/2257339306 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836800bb20 con 0x7f83780a0a30 2023-09-30T22:35:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.060+0000 7f8377fff700 1 -- 172.21.15.59:0/2257339306 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368012430 con 0x7f83780a0a30 2023-09-30T22:35:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.060+0000 7fd1a3fff700 1 -- 172.21.15.59:0/3558501892 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c004390 con 0x7fd1ac09d9f0 2023-09-30T22:35:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.060+0000 7fd1a3fff700 1 -- 172.21.15.59:0/3558501892 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c010830 con 0x7fd1ac09d9f0 2023-09-30T22:35:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7fd1b3551700 1 -- 172.21.15.59:0/3558501892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1ac09d9f0 msgr2=0x7fd1ac136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7fd1b3551700 1 --2- 172.21.15.59:0/3558501892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1ac09d9f0 0x7fd1ac136530 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009840 tx=0x7fd19c009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:23.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7f837f848700 1 -- 172.21.15.59:0/2257339306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83780a0a30 msgr2=0x7f83780a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:23.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7f837f848700 1 --2- 172.21.15.59:0/2257339306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83780a0a30 0x7f83780a0e00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8368009d90 tx=0x7f836800b330 comp rx=0 tx=0).stop 2023-09-30T22:35:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7fd1b3551700 1 -- 172.21.15.59:0/3558501892 shutdown_connections 2023-09-30T22:35:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7fd1b3551700 1 --2- 172.21.15.59:0/3558501892 >> v2:172.21.15.59:3300/0 conn(0x7fd1ac136a70 0x7fd1ac138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7fd1b3551700 1 --2- 172.21.15.59:0/3558501892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1ac09d9f0 0x7fd1ac136530 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7fd1b3551700 1 -- 172.21.15.59:0/3558501892 >> 172.21.15.59:0/3558501892 conn(0x7fd1ac066f50 msgr2=0x7fd1ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7f837f848700 1 -- 172.21.15.59:0/2257339306 shutdown_connections 2023-09-30T22:35:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7f837f848700 1 --2- 172.21.15.59:0/2257339306 >> v2:172.21.15.59:3300/0 conn(0x7f8378133930 0x7f8378133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7f837f848700 1 --2- 172.21.15.59:0/2257339306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83780a0a30 0x7f83780a0e00 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7f837f848700 1 --2- 172.21.15.59:0/2257339306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837809d630 0x7f83780a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7f837f848700 1 -- 172.21.15.59:0/2257339306 >> 172.21.15.59:0/2257339306 conn(0x7f83780a3050 msgr2=0x7f83780a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7fd1b3551700 1 -- 172.21.15.59:0/3558501892 shutdown_connections 2023-09-30T22:35:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7fd1b3551700 1 -- 172.21.15.59:0/3558501892 wait complete. 2023-09-30T22:35:23.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7f837f848700 1 -- 172.21.15.59:0/2257339306 shutdown_connections 2023-09-30T22:35:23.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.061+0000 7f837f848700 1 -- 172.21.15.59:0/2257339306 wait complete. 2023-09-30T22:35:23.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.062+0000 7fd1b3551700 1 Processor -- start 2023-09-30T22:35:23.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.062+0000 7fd1b3551700 1 -- start start 2023-09-30T22:35:23.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.062+0000 7f837f848700 1 Processor -- start 2023-09-30T22:35:23.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.062+0000 7f837f848700 1 -- start start 2023-09-30T22:35:23.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.062+0000 7fd1b3551700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1ac09d9f0 0x7fd1ac071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:23.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.062+0000 7fd1b3551700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1ac1316c0 0x7fd1ac071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7fd1b3551700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ac136a70 0x7fd1ac1c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7fd1b3551700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac12b900 con 0x7fd1ac136a70 2023-09-30T22:35:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7fd1b3551700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac135c40 con 0x7fd1ac09d9f0 2023-09-30T22:35:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7fd1b3551700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac06eaf0 con 0x7fd1ac1316c0 2023-09-30T22:35:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7fd1b0aec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1ac1316c0 0x7fd1ac071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7fd1b0aec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1ac1316c0 0x7fd1ac071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44514/0 (socket says 172.21.15.59:44514) 2023-09-30T22:35:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7fd1b0aec700 1 -- 172.21.15.59:0/745301546 learned_addr learned my addr 172.21.15.59:0/745301546 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7fd1b12ed700 1 --2- 172.21.15.59:0/745301546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1ac09d9f0 0x7fd1ac071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:23.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7fd1b1aee700 1 --2- 172.21.15.59:0/745301546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ac136a70 0x7fd1ac1c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837f848700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837809d630 0x7f83781c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837f848700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83780a0a30 0x7f83781c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837f848700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8378133930 0x7f83781c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837f848700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8378120670 con 0x7f8378133930 2023-09-30T22:35:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837f848700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8378121e60 con 0x7f837809d630 2023-09-30T22:35:23.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837f848700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83780a0410 con 0x7f83780a0a30 2023-09-30T22:35:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837d5e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837809d630 0x7f83781c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837d5e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837809d630 0x7f83781c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37956/0 (socket says 172.21.15.59:37956) 2023-09-30T22:35:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837d5e4700 1 -- 172.21.15.59:0/696655398 learned_addr learned my addr 172.21.15.59:0/696655398 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837cde3700 1 --2- 172.21.15.59:0/696655398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83780a0a30 0x7f83781c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837dde5700 1 --2- 172.21.15.59:0/696655398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8378133930 0x7f83781c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7fd1b0aec700 1 -- 172.21.15.59:0/745301546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1ac09d9f0 msgr2=0x7fd1ac071940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:23.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7fd1b0aec700 1 --2- 172.21.15.59:0/745301546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1ac09d9f0 0x7fd1ac071940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7fd1b0aec700 1 -- 172.21.15.59:0/745301546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ac136a70 msgr2=0x7fd1ac1c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7fd1b0aec700 1 --2- 172.21.15.59:0/745301546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ac136a70 0x7fd1ac1c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7fd1b0aec700 1 -- 172.21.15.59:0/745301546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c0094a0 con 0x7fd1ac1316c0 2023-09-30T22:35:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837cde3700 1 -- 172.21.15.59:0/696655398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837809d630 msgr2=0x7f83781c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:23.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837cde3700 1 --2- 172.21.15.59:0/696655398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837809d630 0x7f83781c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837cde3700 1 -- 172.21.15.59:0/696655398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8378133930 msgr2=0x7f83781c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:23.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837cde3700 1 --2- 172.21.15.59:0/696655398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8378133930 0x7f83781c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837cde3700 1 -- 172.21.15.59:0/696655398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8368009a70 con 0x7f83780a0a30 2023-09-30T22:35:23.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837dde5700 1 --2- 172.21.15.59:0/696655398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8378133930 0x7f83781c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:35:23.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7fd1b0aec700 1 --2- 172.21.15.59:0/745301546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1ac1316c0 0x7fd1ac071e80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac1313f0 tx=0x7fd19c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:23.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.063+0000 7f837cde3700 1 --2- 172.21.15.59:0/696655398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83780a0a30 0x7f83781c85d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f836c00e8b0 tx=0x7f836c00ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:23.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.064+0000 7fd1a1ffb700 1 -- 172.21.15.59:0/745301546 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c0036a0 con 0x7fd1ac1316c0 2023-09-30T22:35:23.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.064+0000 7fd1a1ffb700 1 -- 172.21.15.59:0/745301546 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c003800 con 0x7fd1ac1316c0 2023-09-30T22:35:23.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.064+0000 7fd1a1ffb700 1 -- 172.21.15.59:0/745301546 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c003bb0 con 0x7fd1ac1316c0 2023-09-30T22:35:23.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.064+0000 7f8375ffb700 1 -- 172.21.15.59:0/696655398 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c013680 con 0x7f83780a0a30 2023-09-30T22:35:23.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.064+0000 7fd1b3551700 1 -- 172.21.15.59:0/745301546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ac0702e0 con 0x7fd1ac1316c0 2023-09-30T22:35:23.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.064+0000 7f8375ffb700 1 -- 172.21.15.59:0/696655398 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c0137e0 con 0x7f83780a0a30 2023-09-30T22:35:23.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.064+0000 7f8375ffb700 1 -- 172.21.15.59:0/696655398 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c013b50 con 0x7f83780a0a30 2023-09-30T22:35:23.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.064+0000 7f837f848700 1 -- 172.21.15.59:0/696655398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8378133390 con 0x7f83780a0a30 2023-09-30T22:35:23.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.064+0000 7fd1b3551700 1 -- 172.21.15.59:0/745301546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac071010 con 0x7fd1ac1316c0 2023-09-30T22:35:23.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.064+0000 7f837f848700 1 -- 172.21.15.59:0/696655398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8378122b90 con 0x7f83780a0a30 2023-09-30T22:35:23.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.065+0000 7fd1b3551700 1 -- 172.21.15.59:0/745301546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ac070500 con 0x7fd1ac1316c0 2023-09-30T22:35:23.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.065+0000 7f837f848700 1 -- 172.21.15.59:0/696655398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83780747f0 con 0x7f83780a0a30 2023-09-30T22:35:23.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.066+0000 7fd1a1ffb700 1 -- 172.21.15.59:0/745301546 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd19c003d10 con 0x7fd1ac1316c0 2023-09-30T22:35:23.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.066+0000 7fd1a1ffb700 1 -- 172.21.15.59:0/745301546 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd19c045300 con 0x7fd1ac1316c0 2023-09-30T22:35:23.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.066+0000 7f8375ffb700 1 -- 172.21.15.59:0/696655398 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f836c013cb0 con 0x7f83780a0a30 2023-09-30T22:35:23.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.066+0000 7f8375ffb700 1 -- 172.21.15.59:0/696655398 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f836c03fe90 con 0x7f83780a0a30 2023-09-30T22:35:23.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.070+0000 7fd1a1ffb700 1 -- 172.21.15.59:0/745301546 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd19c034d30 con 0x7fd1ac1316c0 2023-09-30T22:35:23.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.075+0000 7f8375ffb700 1 -- 172.21.15.59:0/696655398 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f836c011350 con 0x7f83780a0a30 2023-09-30T22:35:23.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.276+0000 7fd1b3551700 1 -- 172.21.15.59:0/745301546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd1ac0704d0 con 0x7fd1ac1316c0 2023-09-30T22:35:23.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.276+0000 7fd1a1ffb700 1 -- 172.21.15.59:0/745301546 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd19c02a3c0 con 0x7fd1ac1316c0 2023-09-30T22:35:23.278 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:23.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.278+0000 7f837f848700 1 -- 172.21.15.59:0/696655398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8378072980 con 0x7f83780a0a30 2023-09-30T22:35:23.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.278+0000 7f8375ffb700 1 -- 172.21.15.59:0/696655398 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f836c02a090 con 0x7f83780a0a30 2023-09-30T22:35:23.280 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:23.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.279+0000 7fd1b3551700 1 -- 172.21.15.59:0/745301546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1ac1316c0 msgr2=0x7fd1ac071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:23.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.279+0000 7fd1b3551700 1 --2- 172.21.15.59:0/745301546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1ac1316c0 0x7fd1ac071e80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac1313f0 tx=0x7fd19c004750 comp rx=0 tx=0).stop 2023-09-30T22:35:23.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.279+0000 7fd1b3551700 1 -- 172.21.15.59:0/745301546 shutdown_connections 2023-09-30T22:35:23.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.279+0000 7fd1b3551700 1 --2- 172.21.15.59:0/745301546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ac136a70 0x7fd1ac1c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.279+0000 7fd1b3551700 1 --2- 172.21.15.59:0/745301546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1ac09d9f0 0x7fd1ac071940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.279+0000 7fd1b3551700 1 --2- 172.21.15.59:0/745301546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1ac1316c0 0x7fd1ac071e80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.279+0000 7fd1b3551700 1 -- 172.21.15.59:0/745301546 >> 172.21.15.59:0/745301546 conn(0x7fd1ac066f50 msgr2=0x7fd1ac09a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:23.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.279+0000 7fd1b3551700 1 -- 172.21.15.59:0/745301546 shutdown_connections 2023-09-30T22:35:23.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.279+0000 7fd1b3551700 1 -- 172.21.15.59:0/745301546 wait complete. 2023-09-30T22:35:23.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.281+0000 7f837f848700 1 -- 172.21.15.59:0/696655398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83780a0a30 msgr2=0x7f83781c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:23.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.281+0000 7f837f848700 1 --2- 172.21.15.59:0/696655398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83780a0a30 0x7f83781c85d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f836c00e8b0 tx=0x7f836c00ebc0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.281+0000 7f837f848700 1 -- 172.21.15.59:0/696655398 shutdown_connections 2023-09-30T22:35:23.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.281+0000 7f837f848700 1 --2- 172.21.15.59:0/696655398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8378133930 0x7f83781c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.281+0000 7f837f848700 1 --2- 172.21.15.59:0/696655398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837809d630 0x7f83781c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.281+0000 7f837f848700 1 --2- 172.21.15.59:0/696655398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83780a0a30 0x7f83781c85d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.281+0000 7f837f848700 1 -- 172.21.15.59:0/696655398 >> 172.21.15.59:0/696655398 conn(0x7f83780a3050 msgr2=0x7f83781bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:23.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.281+0000 7f837f848700 1 -- 172.21.15.59:0/696655398 shutdown_connections 2023-09-30T22:35:23.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.281+0000 7f837f848700 1 -- 172.21.15.59:0/696655398 wait complete. 2023-09-30T22:35:23.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:23.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:23.843 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:23.878 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:23.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.990+0000 7f43add72700 1 Processor -- start 2023-09-30T22:35:23.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.990+0000 7f43add72700 1 -- start start 2023-09-30T22:35:23.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.991+0000 7f43add72700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43a80a1510 0x7f43a8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:23.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.991+0000 7f43add72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a8139250 0x7f43a813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.991+0000 7f43add72700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a809edd0 con 0x7f43a80a0a30 2023-09-30T22:35:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.991+0000 7f43add72700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80a18e0 con 0x7f43a8139250 2023-09-30T22:35:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.991+0000 7f43add72700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43a809e1f0 con 0x7f43a80a1510 2023-09-30T22:35:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.991+0000 7f43a7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a8139250 0x7f43a813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.991+0000 7f43a6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43a80a1510 0x7f43a8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.991+0000 7f43a7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a8139250 0x7f43a813b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37960/0 (socket says 172.21.15.59:37960) 2023-09-30T22:35:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.991+0000 7f43a7fff700 1 -- 172.21.15.59:0/3772221572 learned_addr learned my addr 172.21.15.59:0/3772221572 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:23.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.992+0000 7f43a7fff700 1 -- 172.21.15.59:0/3772221572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43a80a1510 msgr2=0x7f43a8138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:23.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.992+0000 7f43a7fff700 1 --2- 172.21.15.59:0/3772221572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43a80a1510 0x7f43a8138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.992+0000 7f43a7fff700 1 -- 172.21.15.59:0/3772221572 >> v1:172.21.15.59:6789/0 conn(0x7f43a80a0a30 legacy=0x7f43a80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:23.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.992+0000 7f43a7fff700 1 -- 172.21.15.59:0/3772221572 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a809dc50 con 0x7f43a8139250 2023-09-30T22:35:23.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.992+0000 7f43a6ffd700 1 --2- 172.21.15.59:0/3772221572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43a80a1510 0x7f43a8138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:23.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.992+0000 7f43a7fff700 1 --2- 172.21.15.59:0/3772221572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a8139250 0x7f43a813b630 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009e80 tx=0x7f43a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5cdb1c68f7162ad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:23.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.992+0000 7f43a67fc700 1 -- 172.21.15.59:0/3772221572 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a000e070 con 0x7f43a8139250 2023-09-30T22:35:23.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.992+0000 7f43a67fc700 1 -- 172.21.15.59:0/3772221572 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a000b910 con 0x7f43a8139250 2023-09-30T22:35:23.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.992+0000 7f43a67fc700 1 -- 172.21.15.59:0/3772221572 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a000bcc0 con 0x7f43a8139250 2023-09-30T22:35:23.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.993+0000 7f43add72700 1 -- 172.21.15.59:0/3772221572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a8139250 msgr2=0x7f43a813b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:23.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.993+0000 7f43add72700 1 --2- 172.21.15.59:0/3772221572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a8139250 0x7f43a813b630 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009e80 tx=0x7f43a000b330 comp rx=0 tx=0).stop 2023-09-30T22:35:23.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.993+0000 7f43add72700 1 -- 172.21.15.59:0/3772221572 shutdown_connections 2023-09-30T22:35:23.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.993+0000 7f43add72700 1 --2- 172.21.15.59:0/3772221572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a8139250 0x7f43a813b630 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.993+0000 7f43add72700 1 --2- 172.21.15.59:0/3772221572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43a80a1510 0x7f43a8138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.993+0000 7f43add72700 1 -- 172.21.15.59:0/3772221572 >> 172.21.15.59:0/3772221572 conn(0x7f43a80a6550 msgr2=0x7f43a80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.993+0000 7f43add72700 1 -- 172.21.15.59:0/3772221572 shutdown_connections 2023-09-30T22:35:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.993+0000 7f43add72700 1 -- 172.21.15.59:0/3772221572 wait complete. 2023-09-30T22:35:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.994+0000 7f43add72700 1 Processor -- start 2023-09-30T22:35:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.994+0000 7f43add72700 1 -- start start 2023-09-30T22:35:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.994+0000 7f43add72700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a80a0a30 0x7f43a8122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.994+0000 7f43add72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a80a1510 0x7f43a8122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.994+0000 7f43add72700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43a8139250 0x7f43a81233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.994+0000 7f43add72700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a81261b0 con 0x7f43a80a0a30 2023-09-30T22:35:24.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.994+0000 7f43add72700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8124620 con 0x7f43a80a1510 2023-09-30T22:35:24.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.994+0000 7f43add72700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80a0220 con 0x7f43a8139250 2023-09-30T22:35:24.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f43a6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a80a1510 0x7f43a8122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f43a77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a80a0a30 0x7f43a8122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f43a7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43a8139250 0x7f43a81233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f43a7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43a8139250 0x7f43a81233f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44542/0 (socket says 172.21.15.59:44542) 2023-09-30T22:35:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f43a77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a80a0a30 0x7f43a8122970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53542/0 (socket says 172.21.15.59:53542) 2023-09-30T22:35:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f43a6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a80a1510 0x7f43a8122eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37976/0 (socket says 172.21.15.59:37976) 2023-09-30T22:35:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f43a7fff700 1 -- 172.21.15.59:0/27654174 learned_addr learned my addr 172.21.15.59:0/27654174 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f43a7fff700 1 -- 172.21.15.59:0/27654174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a80a1510 msgr2=0x7f43a8122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f43a7fff700 1 --2- 172.21.15.59:0/27654174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a80a1510 0x7f43a8122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f43a7fff700 1 -- 172.21.15.59:0/27654174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a80a0a30 msgr2=0x7f43a8122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f43a7fff700 1 --2- 172.21.15.59:0/27654174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a80a0a30 0x7f43a8122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f43a7fff700 1 -- 172.21.15.59:0/27654174 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43900094a0 con 0x7f43a8139250 2023-09-30T22:35:24.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f43a7fff700 1 --2- 172.21.15.59:0/27654174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43a8139250 0x7f43a81233f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f43a809e610 tx=0x7f43a0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:24.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f439ffff700 1 -- 172.21.15.59:0/27654174 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0004450 con 0x7f43a8139250 2023-09-30T22:35:24.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f439ffff700 1 -- 172.21.15.59:0/27654174 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a00092e0 con 0x7f43a8139250 2023-09-30T22:35:24.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f43add72700 1 -- 172.21.15.59:0/27654174 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a0009b30 con 0x7f43a8139250 2023-09-30T22:35:24.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f439ffff700 1 -- 172.21.15.59:0/27654174 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0004830 con 0x7f43a8139250 2023-09-30T22:35:24.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.995+0000 7f43add72700 1 -- 172.21.15.59:0/27654174 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a8126c20 con 0x7f43a8139250 2023-09-30T22:35:24.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.996+0000 7f439ffff700 1 -- 172.21.15.59:0/27654174 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43a001c410 con 0x7f43a8139250 2023-09-30T22:35:24.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.996+0000 7f43add72700 1 -- 172.21.15.59:0/27654174 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a8074ea0 con 0x7f43a8139250 2023-09-30T22:35:24.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:23.997+0000 7f439ffff700 1 -- 172.21.15.59:0/27654174 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f43a00415f0 con 0x7f43a8139250 2023-09-30T22:35:24.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.002+0000 7f439ffff700 1 -- 172.21.15.59:0/27654174 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43a002d7a0 con 0x7f43a8139250 2023-09-30T22:35:24.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.027+0000 7f8bc41d5700 1 Processor -- start 2023-09-30T22:35:24.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.027+0000 7f8bc41d5700 1 -- start start 2023-09-30T22:35:24.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.028+0000 7f8bc41d5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bbc09e930 0x7f8bbc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.028+0000 7f8bc41d5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bbc09f650 0x7f8bbc131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.028+0000 7f8bc41d5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bbc070940 con 0x7f8bbc09f240 2023-09-30T22:35:24.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.028+0000 7f8bc41d5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bbc06fd60 con 0x7f8bbc09f650 2023-09-30T22:35:24.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.028+0000 7f8bc41d5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc06fa80 con 0x7f8bbc09e930 2023-09-30T22:35:24.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.028+0000 7f8bc2772700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bbc09f650 0x7f8bbc131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.028+0000 7f8bc1f71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bbc09e930 0x7f8bbc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.028+0000 7f8bc1f71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bbc09e930 0x7f8bbc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44552/0 (socket says 172.21.15.59:44552) 2023-09-30T22:35:24.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.028+0000 7f8bc2772700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bbc09f650 0x7f8bbc131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53550/0 (socket says 172.21.15.59:53550) 2023-09-30T22:35:24.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.028+0000 7f8bc1f71700 1 -- 172.21.15.59:0/3322534935 learned_addr learned my addr 172.21.15.59:0/3322534935 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:24.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.028+0000 7f8bc2772700 1 -- 172.21.15.59:0/3322534935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bbc09e930 msgr2=0x7f8bbc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:24.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.028+0000 7f8bc2772700 1 --2- 172.21.15.59:0/3322534935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bbc09e930 0x7f8bbc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.028+0000 7f8bc2772700 1 -- 172.21.15.59:0/3322534935 >> v1:172.21.15.59:6789/0 conn(0x7f8bbc09f240 legacy=0x7f8bbc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.028+0000 7f8bc2772700 1 -- 172.21.15.59:0/3322534935 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc09fb60 con 0x7f8bbc09f650 2023-09-30T22:35:24.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.028+0000 7f8bc1f71700 1 --2- 172.21.15.59:0/3322534935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bbc09e930 0x7f8bbc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:24.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.029+0000 7f8bc2772700 1 --2- 172.21.15.59:0/3322534935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc09f650 0x7f8bbc131f00 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009d90 tx=0x7f8bac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c0c9ed391160d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:24.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.029+0000 7f8bc0f6f700 1 -- 172.21.15.59:0/3322534935 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac00e070 con 0x7f8bbc09f650 2023-09-30T22:35:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.029+0000 7f8bc0f6f700 1 -- 172.21.15.59:0/3322534935 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac00bb20 con 0x7f8bbc09f650 2023-09-30T22:35:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.029+0000 7f8bc0f6f700 1 -- 172.21.15.59:0/3322534935 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac012430 con 0x7f8bbc09f650 2023-09-30T22:35:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.029+0000 7f8bc41d5700 1 -- 172.21.15.59:0/3322534935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc09f650 msgr2=0x7f8bbc131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.029+0000 7f8bc41d5700 1 --2- 172.21.15.59:0/3322534935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc09f650 0x7f8bbc131f00 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009d90 tx=0x7f8bac00b330 comp rx=0 tx=0).stop 2023-09-30T22:35:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.030+0000 7f8bc41d5700 1 -- 172.21.15.59:0/3322534935 shutdown_connections 2023-09-30T22:35:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.030+0000 7f8bc41d5700 1 --2- 172.21.15.59:0/3322534935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc09f650 0x7f8bbc131f00 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.030+0000 7f8bc41d5700 1 --2- 172.21.15.59:0/3322534935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bbc09e930 0x7f8bbc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.030+0000 7f8bc41d5700 1 -- 172.21.15.59:0/3322534935 >> 172.21.15.59:0/3322534935 conn(0x7f8bbc0a4210 msgr2=0x7f8bbc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.030+0000 7f8bc41d5700 1 -- 172.21.15.59:0/3322534935 shutdown_connections 2023-09-30T22:35:24.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.030+0000 7f8bc41d5700 1 -- 172.21.15.59:0/3322534935 wait complete. 2023-09-30T22:35:24.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.031+0000 7f8bc41d5700 1 Processor -- start 2023-09-30T22:35:24.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.031+0000 7f8bc41d5700 1 -- start start 2023-09-30T22:35:24.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.031+0000 7f8bc41d5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc09e930 0x7f8bbc1c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.031+0000 7f8bc41d5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bbc09f240 0x7f8bbc1c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.031+0000 7f8bc41d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bbc09f650 0x7f8bbc1c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.031+0000 7f8bc41d5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc1a71a0 con 0x7f8bbc09e930 2023-09-30T22:35:24.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.031+0000 7f8bc41d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc1a8570 con 0x7f8bbc09f650 2023-09-30T22:35:24.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.031+0000 7f8bc41d5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc1a68b0 con 0x7f8bbc09f240 2023-09-30T22:35:24.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.031+0000 7f8bc1f71700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc09e930 0x7f8bbc1c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.031+0000 7f8bc1770700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bbc09f240 0x7f8bbc1c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.031+0000 7f8bc1f71700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc09e930 0x7f8bbc1c8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53562/0 (socket says 172.21.15.59:53562) 2023-09-30T22:35:24.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.031+0000 7f8bc1f71700 1 -- 172.21.15.59:0/3813268516 learned_addr learned my addr 172.21.15.59:0/3813268516 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:24.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.031+0000 7f8bc2772700 1 --2- 172.21.15.59:0/3813268516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bbc09f650 0x7f8bbc1c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.032+0000 7f8bc1f71700 1 -- 172.21.15.59:0/3813268516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bbc09f240 msgr2=0x7f8bbc1c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.032+0000 7f8bc1f71700 1 --2- 172.21.15.59:0/3813268516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bbc09f240 0x7f8bbc1c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.032+0000 7f8bc1f71700 1 -- 172.21.15.59:0/3813268516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bbc09f650 msgr2=0x7f8bbc1c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.032+0000 7f8bc1f71700 1 --2- 172.21.15.59:0/3813268516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bbc09f650 0x7f8bbc1c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.032+0000 7f8bc1f71700 1 -- 172.21.15.59:0/3813268516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb4009550 con 0x7f8bbc09e930 2023-09-30T22:35:24.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.032+0000 7f8bc1f71700 1 --2- 172.21.15.59:0/3813268516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc09e930 0x7f8bbc1c8340 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400ec10 tx=0x7f8bb400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:24.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.032+0000 7f8bba7fc700 1 -- 172.21.15.59:0/3813268516 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb400c850 con 0x7f8bbc09e930 2023-09-30T22:35:24.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.032+0000 7f8bba7fc700 1 -- 172.21.15.59:0/3813268516 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb400c9b0 con 0x7f8bbc09e930 2023-09-30T22:35:24.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.032+0000 7f8bc41d5700 1 -- 172.21.15.59:0/3813268516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bac009a70 con 0x7f8bbc09e930 2023-09-30T22:35:24.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.032+0000 7f8bba7fc700 1 -- 172.21.15.59:0/3813268516 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb400cd40 con 0x7f8bbc09e930 2023-09-30T22:35:24.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.032+0000 7f8bc41d5700 1 -- 172.21.15.59:0/3813268516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bbc0a0190 con 0x7f8bbc09e930 2023-09-30T22:35:24.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.033+0000 7f8bba7fc700 1 -- 172.21.15.59:0/3813268516 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bb4013470 con 0x7f8bbc09e930 2023-09-30T22:35:24.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.033+0000 7f8bba7fc700 1 -- 172.21.15.59:0/3813268516 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8bb403f860 con 0x7f8bbc09e930 2023-09-30T22:35:24.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.033+0000 7f8bc41d5700 1 -- 172.21.15.59:0/3813268516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bbc09ef10 con 0x7f8bbc09e930 2023-09-30T22:35:24.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.038+0000 7f8bba7fc700 1 -- 172.21.15.59:0/3813268516 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bb4013720 con 0x7f8bbc09e930 2023-09-30T22:35:24.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.209+0000 7f43add72700 1 -- 172.21.15.59:0/27654174 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f43a80a1d10 con 0x7f43a8139250 2023-09-30T22:35:24.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.209+0000 7f439ffff700 1 -- 172.21.15.59:0/27654174 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43a001a3c0 con 0x7f43a8139250 2023-09-30T22:35:24.211 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.211+0000 7f43add72700 1 -- 172.21.15.59:0/27654174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43a8139250 msgr2=0x7f43a81233f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.211+0000 7f43add72700 1 --2- 172.21.15.59:0/27654174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43a8139250 0x7f43a81233f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f43a809e610 tx=0x7f43a0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.211+0000 7f43add72700 1 -- 172.21.15.59:0/27654174 shutdown_connections 2023-09-30T22:35:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.211+0000 7f43add72700 1 --2- 172.21.15.59:0/27654174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43a8139250 0x7f43a81233f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.211+0000 7f43add72700 1 --2- 172.21.15.59:0/27654174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a80a0a30 0x7f43a8122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.211+0000 7f43add72700 1 --2- 172.21.15.59:0/27654174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a80a1510 0x7f43a8122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.211+0000 7f43add72700 1 -- 172.21.15.59:0/27654174 >> 172.21.15.59:0/27654174 conn(0x7f43a80a6550 msgr2=0x7f43a80a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.212+0000 7f43add72700 1 -- 172.21.15.59:0/27654174 shutdown_connections 2023-09-30T22:35:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.212+0000 7f43add72700 1 -- 172.21.15.59:0/27654174 wait complete. 2023-09-30T22:35:24.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.246+0000 7f8bc41d5700 1 -- 172.21.15.59:0/3813268516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8bbc1a83d0 con 0x7f8bbc09e930 2023-09-30T22:35:24.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.246+0000 7f8bba7fc700 1 -- 172.21.15.59:0/3813268516 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bbc1a83d0 con 0x7f8bbc09e930 2023-09-30T22:35:24.248 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:24.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.249+0000 7f8bc41d5700 1 -- 172.21.15.59:0/3813268516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc09e930 msgr2=0x7f8bbc1c8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.249+0000 7f8bc41d5700 1 --2- 172.21.15.59:0/3813268516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc09e930 0x7f8bbc1c8340 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400ec10 tx=0x7f8bb400ef20 comp rx=0 tx=0).stop 2023-09-30T22:35:24.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.249+0000 7f8bc41d5700 1 -- 172.21.15.59:0/3813268516 shutdown_connections 2023-09-30T22:35:24.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.249+0000 7f8bc41d5700 1 --2- 172.21.15.59:0/3813268516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bbc09f650 0x7f8bbc1c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.249+0000 7f8bc41d5700 1 --2- 172.21.15.59:0/3813268516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc09e930 0x7f8bbc1c8340 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.249+0000 7f8bc41d5700 1 --2- 172.21.15.59:0/3813268516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bbc09f240 0x7f8bbc1c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.249+0000 7f8bc41d5700 1 -- 172.21.15.59:0/3813268516 >> 172.21.15.59:0/3813268516 conn(0x7f8bbc0a4210 msgr2=0x7f8bbc06c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.249+0000 7f8bc41d5700 1 -- 172.21.15.59:0/3813268516 shutdown_connections 2023-09-30T22:35:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.249+0000 7f8bc41d5700 1 -- 172.21.15.59:0/3813268516 wait complete. 2023-09-30T22:35:24.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:24.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:24.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:24.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.444+0000 7fb308ee7700 1 Processor -- start 2023-09-30T22:35:24.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.444+0000 7fb308ee7700 1 -- start start 2023-09-30T22:35:24.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.444+0000 7f310ef2a700 1 Processor -- start 2023-09-30T22:35:24.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7f310ef2a700 1 -- start start 2023-09-30T22:35:24.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7f310ef2a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f310809d6f0 0x7f310809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7fb308ee7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3041337f0 0x7fb304138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7fb308ee7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb304138dc0 0x7fb30413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7f310ef2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809e440 0x7f3108134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7f310ef2a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310809b120 con 0x7f310809e000 2023-09-30T22:35:24.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7f310ef2a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310806b460 con 0x7f310809d6f0 2023-09-30T22:35:24.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7f310ef2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310809a7e0 con 0x7f310809e440 2023-09-30T22:35:24.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7fb308ee7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30406b990 con 0x7fb304133420 2023-09-30T22:35:24.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7fb308ee7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30409b0e0 con 0x7fb304138dc0 2023-09-30T22:35:24.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7fb308ee7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb304133c20 con 0x7fb3041337f0 2023-09-30T22:35:24.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7fb302d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb304138dc0 0x7fb30413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7fb30259c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb304133420 0x7fb304133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40066/0 (socket says 172.21.15.59:40066) 2023-09-30T22:35:24.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7fb30259c700 1 -- 172.21.15.59:0/2180017303 learned_addr learned my addr 172.21.15.59:0/2180017303 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:24.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7f310d4c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809e440 0x7f3108134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7f310d4c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809e440 0x7f3108134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46608/0 (socket says 172.21.15.59:46608) 2023-09-30T22:35:24.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7f310d4c7700 1 -- 172.21.15.59:0/56072836 learned_addr learned my addr 172.21.15.59:0/56072836 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:24.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.445+0000 7fb301d9b700 1 --2- 172.21.15.59:0/2180017303 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3041337f0 0x7fb304138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7f310ccc6700 1 --2- 172.21.15.59:0/56072836 >> v2:172.21.15.59:3300/0 conn(0x7f310809d6f0 0x7f310809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7fb302d9d700 1 -- 172.21.15.59:0/2180017303 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3041337f0 msgr2=0x7fb304138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:24.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7fb302d9d700 1 --2- 172.21.15.59:0/2180017303 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3041337f0 0x7fb304138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7fb302d9d700 1 -- 172.21.15.59:0/2180017303 >> v1:172.21.15.59:6789/0 conn(0x7fb304133420 legacy=0x7fb304133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7fb30159a700 1 -- 172.21.15.59:0/2180017303 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562764584 0 0) 0x7fb30406b990 con 0x7fb304133420 2023-09-30T22:35:24.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7fb302d9d700 1 -- 172.21.15.59:0/2180017303 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3040a0590 con 0x7fb304138dc0 2023-09-30T22:35:24.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7f30ff7fe700 1 -- 172.21.15.59:0/56072836 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377195228 0 0) 0x7f310809b120 con 0x7f310809e000 2023-09-30T22:35:24.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7f310d4c7700 1 -- 172.21.15.59:0/56072836 >> v2:172.21.15.59:3300/0 conn(0x7f310809d6f0 msgr2=0x7f310809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:24.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7f310d4c7700 1 --2- 172.21.15.59:0/56072836 >> v2:172.21.15.59:3300/0 conn(0x7f310809d6f0 0x7f310809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7f310d4c7700 1 -- 172.21.15.59:0/56072836 >> v1:172.21.15.59:6789/0 conn(0x7f310809e000 legacy=0x7f31081339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7f310d4c7700 1 -- 172.21.15.59:0/56072836 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310809a500 con 0x7f310809e440 2023-09-30T22:35:24.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7fb302d9d700 1 --2- 172.21.15.59:0/2180017303 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb304138dc0 0x7fb30413b1a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009dc0 tx=0x7fb2fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=910a7c584aab9b67 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:24.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7f310d4c7700 1 --2- 172.21.15.59:0/56072836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809e440 0x7f3108134100 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3100009e80 tx=0x7f310000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea564acfe53dd2a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:24.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7fb30159a700 1 -- 172.21.15.59:0/2180017303 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00e070 con 0x7fb304138dc0 2023-09-30T22:35:24.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7fb30159a700 1 -- 172.21.15.59:0/2180017303 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc00bb20 con 0x7fb304138dc0 2023-09-30T22:35:24.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7fb30159a700 1 -- 172.21.15.59:0/2180017303 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc012430 con 0x7fb304138dc0 2023-09-30T22:35:24.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7f30ff7fe700 1 -- 172.21.15.59:0/56072836 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310000e070 con 0x7f310809e440 2023-09-30T22:35:24.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.446+0000 7f30ff7fe700 1 -- 172.21.15.59:0/56072836 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310000b8d0 con 0x7f310809e440 2023-09-30T22:35:24.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7f30ff7fe700 1 -- 172.21.15.59:0/56072836 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310000bc80 con 0x7f310809e440 2023-09-30T22:35:24.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7f310ef2a700 1 -- 172.21.15.59:0/56072836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809e440 msgr2=0x7f3108134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7fb308ee7700 1 -- 172.21.15.59:0/2180017303 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb304138dc0 msgr2=0x7fb30413b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7f310ef2a700 1 --2- 172.21.15.59:0/56072836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809e440 0x7f3108134100 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3100009e80 tx=0x7f310000b330 comp rx=0 tx=0).stop 2023-09-30T22:35:24.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7fb308ee7700 1 --2- 172.21.15.59:0/2180017303 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb304138dc0 0x7fb30413b1a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009dc0 tx=0x7fb2fc00b330 comp rx=0 tx=0).stop 2023-09-30T22:35:24.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7f310ef2a700 1 -- 172.21.15.59:0/56072836 shutdown_connections 2023-09-30T22:35:24.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7f310ef2a700 1 --2- 172.21.15.59:0/56072836 >> v2:172.21.15.59:3300/0 conn(0x7f310809d6f0 0x7f310809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7f310ef2a700 1 --2- 172.21.15.59:0/56072836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809e440 0x7f3108134100 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7f310ef2a700 1 -- 172.21.15.59:0/56072836 >> 172.21.15.59:0/56072836 conn(0x7f3108066f50 msgr2=0x7f310809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:24.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7f310ef2a700 1 -- 172.21.15.59:0/56072836 shutdown_connections 2023-09-30T22:35:24.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7fb308ee7700 1 -- 172.21.15.59:0/2180017303 shutdown_connections 2023-09-30T22:35:24.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7fb308ee7700 1 --2- 172.21.15.59:0/2180017303 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb304138dc0 0x7fb30413b1a0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7fb308ee7700 1 --2- 172.21.15.59:0/2180017303 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3041337f0 0x7fb304138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7fb308ee7700 1 -- 172.21.15.59:0/2180017303 >> 172.21.15.59:0/2180017303 conn(0x7fb3040a4210 msgr2=0x7fb3040a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7f310ef2a700 1 -- 172.21.15.59:0/56072836 wait complete. 2023-09-30T22:35:24.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7fb308ee7700 1 -- 172.21.15.59:0/2180017303 shutdown_connections 2023-09-30T22:35:24.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.447+0000 7fb308ee7700 1 -- 172.21.15.59:0/2180017303 wait complete. 2023-09-30T22:35:24.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.448+0000 7f310ef2a700 1 Processor -- start 2023-09-30T22:35:24.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.448+0000 7f310ef2a700 1 -- start start 2023-09-30T22:35:24.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.448+0000 7fb308ee7700 1 Processor -- start 2023-09-30T22:35:24.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7fb308ee7700 1 -- start start 2023-09-30T22:35:24.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7fb308ee7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb304133420 0x7fb30412ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7fb308ee7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3041337f0 0x7fb30412f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7fb308ee7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb304138dc0 0x7fb30412f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7fb308ee7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30409b4a0 con 0x7fb3041337f0 2023-09-30T22:35:24.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7fb308ee7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30409d950 con 0x7fb304138dc0 2023-09-30T22:35:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7fb308ee7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3041389a0 con 0x7fb304133420 2023-09-30T22:35:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7f310ef2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809d6f0 0x7f31081c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7f310ef2a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809e000 0x7f31081c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7f310ef2a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310809e440 0x7f31081c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7f310ef2a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31081b94f0 con 0x7f310809e000 2023-09-30T22:35:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7f310ef2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31081a84f0 con 0x7f310809d6f0 2023-09-30T22:35:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7f310ef2a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31081a7900 con 0x7f310809e440 2023-09-30T22:35:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7fb30259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb304133420 0x7fb30412ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7fb30259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb304133420 0x7fb30412ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56690/0 (socket says 172.21.15.59:56690) 2023-09-30T22:35:24.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7fb30259c700 1 -- 172.21.15.59:0/2293532199 learned_addr learned my addr 172.21.15.59:0/2293532199 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:24.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7fb302d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb304138dc0 0x7fb30412f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7f310d4c7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310809e440 0x7f31081c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7f30fffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809e000 0x7f31081c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7f310ccc6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809d6f0 0x7f31081c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7f310d4c7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310809e440 0x7f31081c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56696/0 (socket says 172.21.15.59:56696) 2023-09-30T22:35:24.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7f310d4c7700 1 -- 172.21.15.59:0/3771230486 learned_addr learned my addr 172.21.15.59:0/3771230486 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:24.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.449+0000 7fb301d9b700 1 --2- 172.21.15.59:0/2293532199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3041337f0 0x7fb30412f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:24.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7fb30259c700 1 -- 172.21.15.59:0/2293532199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb304138dc0 msgr2=0x7fb30412f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7fb30259c700 1 --2- 172.21.15.59:0/2293532199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb304138dc0 0x7fb30412f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7fb30259c700 1 -- 172.21.15.59:0/2293532199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3041337f0 msgr2=0x7fb30412f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7fb30259c700 1 --2- 172.21.15.59:0/2293532199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3041337f0 0x7fb30412f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7fb30259c700 1 -- 172.21.15.59:0/2293532199 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc009a70 con 0x7fb304133420 2023-09-30T22:35:24.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7fb301d9b700 1 --2- 172.21.15.59:0/2293532199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3041337f0 0x7fb30412f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:35:24.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7f30fffff700 1 -- 172.21.15.59:0/3771230486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310809e440 msgr2=0x7f31081c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7f30fffff700 1 --2- 172.21.15.59:0/3771230486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310809e440 0x7f31081c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7f30fffff700 1 -- 172.21.15.59:0/3771230486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809d6f0 msgr2=0x7f31081c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7f30fffff700 1 --2- 172.21.15.59:0/3771230486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809d6f0 0x7f31081c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7f30fffff700 1 -- 172.21.15.59:0/3771230486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3100009b30 con 0x7f310809e000 2023-09-30T22:35:24.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7fb30259c700 1 --2- 172.21.15.59:0/2293532199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb304133420 0x7fb30412ee50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400c550 tx=0x7fb2f400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:24.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7f30fffff700 1 --2- 172.21.15.59:0/3771230486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809e000 0x7f31081c55a0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f30f800c430 tx=0x7f30f800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:24.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7fb2f2ffd700 1 -- 172.21.15.59:0/2293532199 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4004c80 con 0x7fb304133420 2023-09-30T22:35:24.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7fb308ee7700 1 -- 172.21.15.59:0/2293532199 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30409e480 con 0x7fb304133420 2023-09-30T22:35:24.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7fb308ee7700 1 -- 172.21.15.59:0/2293532199 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30409c020 con 0x7fb304133420 2023-09-30T22:35:24.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7f30fd7fa700 1 -- 172.21.15.59:0/3771230486 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f80054e0 con 0x7f310809e000 2023-09-30T22:35:24.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7f310ef2a700 1 -- 172.21.15.59:0/3771230486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31081a8900 con 0x7f310809e000 2023-09-30T22:35:24.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7fb2f2ffd700 1 -- 172.21.15.59:0/2293532199 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f4004de0 con 0x7fb304133420 2023-09-30T22:35:24.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.450+0000 7fb2f2ffd700 1 -- 172.21.15.59:0/2293532199 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40072d0 con 0x7fb304133420 2023-09-30T22:35:24.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.451+0000 7f310ef2a700 1 -- 172.21.15.59:0/3771230486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31081a93b0 con 0x7f310809e000 2023-09-30T22:35:24.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.451+0000 7fb2f2ffd700 1 -- 172.21.15.59:0/2293532199 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2f4007430 con 0x7fb304133420 2023-09-30T22:35:24.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.451+0000 7fb2f2ffd700 1 -- 172.21.15.59:0/2293532199 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb2f403f1b0 con 0x7fb304133420 2023-09-30T22:35:24.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.451+0000 7f30fd7fa700 1 -- 172.21.15.59:0/3771230486 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f800ce40 con 0x7f310809e000 2023-09-30T22:35:24.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.451+0000 7f30fd7fa700 1 -- 172.21.15.59:0/3771230486 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f8003880 con 0x7f310809e000 2023-09-30T22:35:24.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.452+0000 7f30fd7fa700 1 -- 172.21.15.59:0/3771230486 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30f80039e0 con 0x7f310809e000 2023-09-30T22:35:24.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.452+0000 7fb308ee7700 1 -- 172.21.15.59:0/2293532199 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e80052e0 con 0x7fb304133420 2023-09-30T22:35:24.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.452+0000 7f30fd7fa700 1 -- 172.21.15.59:0/3771230486 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f30f803e960 con 0x7f310809e000 2023-09-30T22:35:24.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.452+0000 7f310ef2a700 1 -- 172.21.15.59:0/3771230486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e80052e0 con 0x7f310809e000 2023-09-30T22:35:24.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.457+0000 7f30fd7fa700 1 -- 172.21.15.59:0/3771230486 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30f8017030 con 0x7f310809e000 2023-09-30T22:35:24.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.457+0000 7fb2f2ffd700 1 -- 172.21.15.59:0/2293532199 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2f40076e0 con 0x7fb304133420 2023-09-30T22:35:24.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.663+0000 7f310ef2a700 1 -- 172.21.15.59:0/3771230486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f30e8005150 con 0x7f310809e000 2023-09-30T22:35:24.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.663+0000 7fb308ee7700 1 -- 172.21.15.59:0/2293532199 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb2e8005590 con 0x7fb304133420 2023-09-30T22:35:24.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.663+0000 7f30fd7fa700 1 -- 172.21.15.59:0/3771230486 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30f8011be0 con 0x7f310809e000 2023-09-30T22:35:24.665 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:24.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.664+0000 7fb2f2ffd700 1 -- 172.21.15.59:0/2293532199 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2f401c3a0 con 0x7fb304133420 2023-09-30T22:35:24.666 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:24.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7f310ef2a700 1 -- 172.21.15.59:0/3771230486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809e000 msgr2=0x7f31081c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7f310ef2a700 1 --2- 172.21.15.59:0/3771230486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809e000 0x7f31081c55a0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f30f800c430 tx=0x7f30f800c740 comp rx=0 tx=0).stop 2023-09-30T22:35:24.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7f310ef2a700 1 -- 172.21.15.59:0/3771230486 shutdown_connections 2023-09-30T22:35:24.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7f310ef2a700 1 --2- 172.21.15.59:0/3771230486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f310809e440 0x7f31081c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7f310ef2a700 1 --2- 172.21.15.59:0/3771230486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809d6f0 0x7f31081c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7f310ef2a700 1 --2- 172.21.15.59:0/3771230486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809e000 0x7f31081c55a0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7f310ef2a700 1 -- 172.21.15.59:0/3771230486 >> 172.21.15.59:0/3771230486 conn(0x7f3108066f50 msgr2=0x7f31081bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:24.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7fb308ee7700 1 -- 172.21.15.59:0/2293532199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb304133420 msgr2=0x7fb30412ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:24.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7fb308ee7700 1 --2- 172.21.15.59:0/2293532199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb304133420 0x7fb30412ee50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400c550 tx=0x7fb2f400c860 comp rx=0 tx=0).stop 2023-09-30T22:35:24.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7f310ef2a700 1 -- 172.21.15.59:0/3771230486 shutdown_connections 2023-09-30T22:35:24.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7f310ef2a700 1 -- 172.21.15.59:0/3771230486 wait complete. 2023-09-30T22:35:24.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7fb308ee7700 1 -- 172.21.15.59:0/2293532199 shutdown_connections 2023-09-30T22:35:24.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7fb308ee7700 1 --2- 172.21.15.59:0/2293532199 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb304133420 0x7fb30412ee50 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7fb308ee7700 1 --2- 172.21.15.59:0/2293532199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb304138dc0 0x7fb30412f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7fb308ee7700 1 --2- 172.21.15.59:0/2293532199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3041337f0 0x7fb30412f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7fb308ee7700 1 -- 172.21.15.59:0/2293532199 >> 172.21.15.59:0/2293532199 conn(0x7fb3040a4210 msgr2=0x7fb3040a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7fb308ee7700 1 -- 172.21.15.59:0/2293532199 shutdown_connections 2023-09-30T22:35:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:24.666+0000 7fb308ee7700 1 -- 172.21.15.59:0/2293532199 wait complete. 2023-09-30T22:35:24.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:24.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:25.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:25.264 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:25.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.379+0000 7f49c49a7700 1 Processor -- start 2023-09-30T22:35:25.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.379+0000 7f49c49a7700 1 -- start start 2023-09-30T22:35:25.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.380+0000 7f49c49a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c009e930 0x7f49c009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.380+0000 7f49c49a7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c009f650 0x7f49c0131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.380+0000 7f49c49a7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c0070940 con 0x7f49c009f240 2023-09-30T22:35:25.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.380+0000 7f49c49a7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c006fd60 con 0x7f49c009e930 2023-09-30T22:35:25.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.380+0000 7f49c49a7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49c006fa80 con 0x7f49c009f650 2023-09-30T22:35:25.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.381+0000 7f49bed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c009f650 0x7f49c0131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.381+0000 7f49bdd9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f49c009f240 0x7f49c01317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40078/0 (socket says 172.21.15.59:40078) 2023-09-30T22:35:25.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.381+0000 7f49be59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c009e930 0x7f49c009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.381+0000 7f49bdd9b700 1 -- 172.21.15.59:0/3630118111 learned_addr learned my addr 172.21.15.59:0/3630118111 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:25.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.381+0000 7f49be59c700 1 -- 172.21.15.59:0/3630118111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c009f650 msgr2=0x7f49c0131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:25.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.381+0000 7f49be59c700 1 --2- 172.21.15.59:0/3630118111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c009f650 0x7f49c0131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.381+0000 7f49be59c700 1 -- 172.21.15.59:0/3630118111 >> v1:172.21.15.59:6789/0 conn(0x7f49c009f240 legacy=0x7f49c01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.381+0000 7f49be59c700 1 -- 172.21.15.59:0/3630118111 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c009fb60 con 0x7f49c009e930 2023-09-30T22:35:25.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.381+0000 7f49bd59a700 1 -- 172.21.15.59:0/3630118111 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673393998 0 0) 0x7f49c0070940 con 0x7f49c009f240 2023-09-30T22:35:25.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.381+0000 7f49be59c700 1 --2- 172.21.15.59:0/3630118111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c009e930 0x7f49c009ed00 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009870 tx=0x7f49b8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76352460dcfbe889 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:25.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.381+0000 7f49bd59a700 1 -- 172.21.15.59:0/3630118111 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8011830 con 0x7f49c009e930 2023-09-30T22:35:25.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.381+0000 7f49bd59a700 1 -- 172.21.15.59:0/3630118111 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b8011990 con 0x7f49c009e930 2023-09-30T22:35:25.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.381+0000 7f49bd59a700 1 -- 172.21.15.59:0/3630118111 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8011d20 con 0x7f49c009e930 2023-09-30T22:35:25.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.382+0000 7f49c49a7700 1 -- 172.21.15.59:0/3630118111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c009e930 msgr2=0x7f49c009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.382+0000 7f49c49a7700 1 --2- 172.21.15.59:0/3630118111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c009e930 0x7f49c009ed00 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009870 tx=0x7f49b8009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:25.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.382+0000 7f49c49a7700 1 -- 172.21.15.59:0/3630118111 shutdown_connections 2023-09-30T22:35:25.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.382+0000 7f49c49a7700 1 --2- 172.21.15.59:0/3630118111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c009f650 0x7f49c0131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.382+0000 7f49c49a7700 1 --2- 172.21.15.59:0/3630118111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c009e930 0x7f49c009ed00 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.382+0000 7f49c49a7700 1 -- 172.21.15.59:0/3630118111 >> 172.21.15.59:0/3630118111 conn(0x7f49c00a4210 msgr2=0x7f49c00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:25.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.382+0000 7f49c49a7700 1 -- 172.21.15.59:0/3630118111 shutdown_connections 2023-09-30T22:35:25.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.382+0000 7f49c49a7700 1 -- 172.21.15.59:0/3630118111 wait complete. 2023-09-30T22:35:25.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.383+0000 7f49c49a7700 1 Processor -- start 2023-09-30T22:35:25.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.383+0000 7f49c49a7700 1 -- start start 2023-09-30T22:35:25.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49c49a7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c009e930 0x7f49c01a5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49c49a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c009f240 0x7f49c01a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49c49a7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c009f650 0x7f49c01c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49c49a7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c01a81a0 con 0x7f49c009e930 2023-09-30T22:35:25.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49c49a7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c01a7270 con 0x7f49c009f240 2023-09-30T22:35:25.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49c49a7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49c01b92f0 con 0x7f49c009f650 2023-09-30T22:35:25.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49bdd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c009f240 0x7f49c01a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49be59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c009e930 0x7f49c01a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49bdd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c009f240 0x7f49c01a59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46632/0 (socket says 172.21.15.59:46632) 2023-09-30T22:35:25.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49bed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c009f650 0x7f49c01c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49bdd9b700 1 -- 172.21.15.59:0/1195121571 learned_addr learned my addr 172.21.15.59:0/1195121571 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:25.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49bdd9b700 1 -- 172.21.15.59:0/1195121571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c009f650 msgr2=0x7f49c01c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49bdd9b700 1 --2- 172.21.15.59:0/1195121571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c009f650 0x7f49c01c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49bdd9b700 1 -- 172.21.15.59:0/1195121571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c009e930 msgr2=0x7f49c01a5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49bdd9b700 1 --2- 172.21.15.59:0/1195121571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c009e930 0x7f49c01a5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.384+0000 7f49bdd9b700 1 -- 172.21.15.59:0/1195121571 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b80094a0 con 0x7f49c009f240 2023-09-30T22:35:25.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.385+0000 7f49bdd9b700 1 --2- 172.21.15.59:0/1195121571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c009f240 0x7f49c01a59a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f49a800c520 tx=0x7f49a800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:25.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.385+0000 7f49b6ffd700 1 -- 172.21.15.59:0/1195121571 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a8004c80 con 0x7f49c009f240 2023-09-30T22:35:25.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.385+0000 7f49b6ffd700 1 -- 172.21.15.59:0/1195121571 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a8004de0 con 0x7f49c009f240 2023-09-30T22:35:25.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.385+0000 7f49c49a7700 1 -- 172.21.15.59:0/1195121571 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c00a0190 con 0x7f49c009f240 2023-09-30T22:35:25.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.385+0000 7f49b6ffd700 1 -- 172.21.15.59:0/1195121571 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a8007310 con 0x7f49c009f240 2023-09-30T22:35:25.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.385+0000 7f49c49a7700 1 -- 172.21.15.59:0/1195121571 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c01a4f80 con 0x7f49c009f240 2023-09-30T22:35:25.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.386+0000 7f49b6ffd700 1 -- 172.21.15.59:0/1195121571 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49a8007470 con 0x7f49c009f240 2023-09-30T22:35:25.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.386+0000 7f49b6ffd700 1 -- 172.21.15.59:0/1195121571 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f49a803f380 con 0x7f49c009f240 2023-09-30T22:35:25.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.386+0000 7f49c49a7700 1 -- 172.21.15.59:0/1195121571 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c0074ea0 con 0x7f49c009f240 2023-09-30T22:35:25.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.391+0000 7f49b6ffd700 1 -- 172.21.15.59:0/1195121571 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49a80123b0 con 0x7f49c009f240 2023-09-30T22:35:25.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.417+0000 7fbdf787b700 1 Processor -- start 2023-09-30T22:35:25.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.418+0000 7fbdf787b700 1 -- start start 2023-09-30T22:35:25.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.418+0000 7fbdf787b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf00a0a30 0x7fbdf00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.419+0000 7fbdf787b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbdf009d630 0x7fbdf00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.419+0000 7fbdf787b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf00a2a70 con 0x7fbdf0133930 2023-09-30T22:35:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.419+0000 7fbdf787b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf00a01d0 con 0x7fbdf009d630 2023-09-30T22:35:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.419+0000 7fbdf787b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf009e2b0 con 0x7fbdf00a0a30 2023-09-30T22:35:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.419+0000 7fbdf5617700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf00a0a30 0x7fbdf00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.419+0000 7fbdf4e16700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbdf009d630 0x7fbdf00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.419+0000 7fbdf5617700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf00a0a30 0x7fbdf00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56728/0 (socket says 172.21.15.59:56728) 2023-09-30T22:35:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.419+0000 7fbdf5617700 1 -- 172.21.15.59:0/519710457 learned_addr learned my addr 172.21.15.59:0/519710457 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.419+0000 7fbdf4e16700 1 -- 172.21.15.59:0/519710457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf00a0a30 msgr2=0x7fbdf00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.419+0000 7fbdf4e16700 1 --2- 172.21.15.59:0/519710457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf00a0a30 0x7fbdf00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.419+0000 7fbdf4e16700 1 -- 172.21.15.59:0/519710457 >> v1:172.21.15.59:6789/0 conn(0x7fbdf0133930 legacy=0x7fbdf0133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.419+0000 7fbdf4e16700 1 -- 172.21.15.59:0/519710457 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf009dc50 con 0x7fbdf009d630 2023-09-30T22:35:25.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.419+0000 7fbdf5617700 1 --2- 172.21.15.59:0/519710457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf00a0a30 0x7fbdf00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:25.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.419+0000 7fbdf4e16700 1 --2- 172.21.15.59:0/519710457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf009d630 0x7fbdf00a1340 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fbde4009840 tx=0x7fbde4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234df6a899c22db8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:25.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.419+0000 7fbdeffff700 1 -- 172.21.15.59:0/519710457 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4011830 con 0x7fbdf009d630 2023-09-30T22:35:25.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.420+0000 7fbdeffff700 1 -- 172.21.15.59:0/519710457 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde4011990 con 0x7fbdf009d630 2023-09-30T22:35:25.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.420+0000 7fbdeffff700 1 -- 172.21.15.59:0/519710457 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4011d20 con 0x7fbdf009d630 2023-09-30T22:35:25.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.420+0000 7fbdf787b700 1 -- 172.21.15.59:0/519710457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf009d630 msgr2=0x7fbdf00a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.420+0000 7fbdf787b700 1 --2- 172.21.15.59:0/519710457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf009d630 0x7fbdf00a1340 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fbde4009840 tx=0x7fbde4009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:25.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.420+0000 7fbdf787b700 1 -- 172.21.15.59:0/519710457 shutdown_connections 2023-09-30T22:35:25.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.420+0000 7fbdf787b700 1 --2- 172.21.15.59:0/519710457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf00a0a30 0x7fbdf00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.420+0000 7fbdf787b700 1 --2- 172.21.15.59:0/519710457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf009d630 0x7fbdf00a1340 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.420+0000 7fbdf787b700 1 -- 172.21.15.59:0/519710457 >> 172.21.15.59:0/519710457 conn(0x7fbdf00a3050 msgr2=0x7fbdf00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:25.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.420+0000 7fbdf787b700 1 -- 172.21.15.59:0/519710457 shutdown_connections 2023-09-30T22:35:25.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.420+0000 7fbdf787b700 1 -- 172.21.15.59:0/519710457 wait complete. 2023-09-30T22:35:25.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.421+0000 7fbdf787b700 1 Processor -- start 2023-09-30T22:35:25.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.421+0000 7fbdf787b700 1 -- start start 2023-09-30T22:35:25.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf787b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf009d630 0x7fbdf01c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf787b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf00a0a30 0x7fbdf01c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf787b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf0133930 0x7fbdf01c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf787b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf0120a70 con 0x7fbdf009d630 2023-09-30T22:35:25.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf787b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf0120880 con 0x7fbdf00a0a30 2023-09-30T22:35:25.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf787b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf0121920 con 0x7fbdf0133930 2023-09-30T22:35:25.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf4e16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf00a0a30 0x7fbdf01c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf5617700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf009d630 0x7fbdf01c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf4e16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf00a0a30 0x7fbdf01c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46644/0 (socket says 172.21.15.59:46644) 2023-09-30T22:35:25.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf5617700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf009d630 0x7fbdf01c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37592/0 (socket says 172.21.15.59:37592) 2023-09-30T22:35:25.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf4e16700 1 -- 172.21.15.59:0/3765740871 learned_addr learned my addr 172.21.15.59:0/3765740871 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:25.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf5e18700 1 --2- 172.21.15.59:0/3765740871 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf0133930 0x7fbdf01c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf4e16700 1 -- 172.21.15.59:0/3765740871 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf0133930 msgr2=0x7fbdf01c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf4e16700 1 --2- 172.21.15.59:0/3765740871 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf0133930 0x7fbdf01c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf4e16700 1 -- 172.21.15.59:0/3765740871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf009d630 msgr2=0x7fbdf01c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf4e16700 1 --2- 172.21.15.59:0/3765740871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf009d630 0x7fbdf01c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf4e16700 1 -- 172.21.15.59:0/3765740871 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde8009550 con 0x7fbdf00a0a30 2023-09-30T22:35:25.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf5617700 1 --2- 172.21.15.59:0/3765740871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf009d630 0x7fbdf01c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:25.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.422+0000 7fbdf4e16700 1 --2- 172.21.15.59:0/3765740871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf00a0a30 0x7fbdf01c8850 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fbde40090b0 tx=0x7fbde4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:25.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.423+0000 7fbdedffb700 1 -- 172.21.15.59:0/3765740871 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4004400 con 0x7fbdf00a0a30 2023-09-30T22:35:25.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.423+0000 7fbdedffb700 1 -- 172.21.15.59:0/3765740871 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde401f070 con 0x7fbdf00a0a30 2023-09-30T22:35:25.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.423+0000 7fbdf787b700 1 -- 172.21.15.59:0/3765740871 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde40094a0 con 0x7fbdf00a0a30 2023-09-30T22:35:25.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.423+0000 7fbdedffb700 1 -- 172.21.15.59:0/3765740871 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde40038e0 con 0x7fbdf00a0a30 2023-09-30T22:35:25.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.423+0000 7fbdf787b700 1 -- 172.21.15.59:0/3765740871 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf01224b0 con 0x7fbdf00a0a30 2023-09-30T22:35:25.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.424+0000 7fbdedffb700 1 -- 172.21.15.59:0/3765740871 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbde4021030 con 0x7fbdf00a0a30 2023-09-30T22:35:25.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.424+0000 7fbdf787b700 1 -- 172.21.15.59:0/3765740871 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf0121ef0 con 0x7fbdf00a0a30 2023-09-30T22:35:25.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.424+0000 7fbdedffb700 1 -- 172.21.15.59:0/3765740871 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbde40407a0 con 0x7fbdf00a0a30 2023-09-30T22:35:25.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.434+0000 7fbdedffb700 1 -- 172.21.15.59:0/3765740871 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbde40239c0 con 0x7fbdf00a0a30 2023-09-30T22:35:25.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.606+0000 7f49c49a7700 1 -- 172.21.15.59:0/1195121571 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f49c01b96e0 con 0x7f49c009f240 2023-09-30T22:35:25.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.606+0000 7f49b6ffd700 1 -- 172.21.15.59:0/1195121571 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49a8011360 con 0x7f49c009f240 2023-09-30T22:35:25.608 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:25.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.609+0000 7f49c49a7700 1 -- 172.21.15.59:0/1195121571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c009f240 msgr2=0x7f49c01a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.609+0000 7f49c49a7700 1 --2- 172.21.15.59:0/1195121571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c009f240 0x7f49c01a59a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f49a800c520 tx=0x7f49a800c830 comp rx=0 tx=0).stop 2023-09-30T22:35:25.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.609+0000 7f49c49a7700 1 -- 172.21.15.59:0/1195121571 shutdown_connections 2023-09-30T22:35:25.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.609+0000 7f49c49a7700 1 --2- 172.21.15.59:0/1195121571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c009f650 0x7f49c01c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.609+0000 7f49c49a7700 1 --2- 172.21.15.59:0/1195121571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c009e930 0x7f49c01a5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.609+0000 7f49c49a7700 1 --2- 172.21.15.59:0/1195121571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c009f240 0x7f49c01a59a0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.609+0000 7f49c49a7700 1 -- 172.21.15.59:0/1195121571 >> 172.21.15.59:0/1195121571 conn(0x7f49c00a4210 msgr2=0x7f49c01bbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:25.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.609+0000 7f49c49a7700 1 -- 172.21.15.59:0/1195121571 shutdown_connections 2023-09-30T22:35:25.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.609+0000 7f49c49a7700 1 -- 172.21.15.59:0/1195121571 wait complete. 2023-09-30T22:35:25.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:25.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.643+0000 7fbdf787b700 1 -- 172.21.15.59:0/3765740871 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbdf0121100 con 0x7fbdf00a0a30 2023-09-30T22:35:25.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.643+0000 7fbdedffb700 1 -- 172.21.15.59:0/3765740871 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbde4015070 con 0x7fbdf00a0a30 2023-09-30T22:35:25.645 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:25.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.646+0000 7fbdf787b700 1 -- 172.21.15.59:0/3765740871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf00a0a30 msgr2=0x7fbdf01c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.646+0000 7fbdf787b700 1 --2- 172.21.15.59:0/3765740871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf00a0a30 0x7fbdf01c8850 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fbde40090b0 tx=0x7fbde4004750 comp rx=0 tx=0).stop 2023-09-30T22:35:25.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.646+0000 7fbdf787b700 1 -- 172.21.15.59:0/3765740871 shutdown_connections 2023-09-30T22:35:25.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.646+0000 7fbdf787b700 1 --2- 172.21.15.59:0/3765740871 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbdf0133930 0x7fbdf01c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.646+0000 7fbdf787b700 1 --2- 172.21.15.59:0/3765740871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf009d630 0x7fbdf01c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.646+0000 7fbdf787b700 1 --2- 172.21.15.59:0/3765740871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbdf00a0a30 0x7fbdf01c8850 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.646+0000 7fbdf787b700 1 -- 172.21.15.59:0/3765740871 >> 172.21.15.59:0/3765740871 conn(0x7fbdf00a3050 msgr2=0x7fbdf01bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.646+0000 7fbdf787b700 1 -- 172.21.15.59:0/3765740871 shutdown_connections 2023-09-30T22:35:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.646+0000 7fbdf787b700 1 -- 172.21.15.59:0/3765740871 wait complete. 2023-09-30T22:35:25.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:25.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:25.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:25.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.840+0000 7f61e7a29700 1 Processor -- start 2023-09-30T22:35:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f6945d77700 1 Processor -- start 2023-09-30T22:35:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f6945d77700 1 -- start start 2023-09-30T22:35:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f61e7a29700 1 -- start start 2023-09-30T22:35:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f6945d77700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69400a0a30 0x7f69400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f6945d77700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6940134170 0x7f694013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f6945d77700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f694009edd0 con 0x7f69400a1340 2023-09-30T22:35:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f6945d77700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f694009e1f0 con 0x7f69400a0a30 2023-09-30T22:35:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f6945d77700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694009dc50 con 0x7f6940134170 2023-09-30T22:35:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f61e7a29700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61e00a0a30 0x7f61e00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f61e7a29700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61e009d630 0x7f61e00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f61e7a29700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e00a2a70 con 0x7f61e0133930 2023-09-30T22:35:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f61e7a29700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e00a01d0 con 0x7f61e00a0a30 2023-09-30T22:35:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f61e7a29700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61e009e2b0 con 0x7f61e009d630 2023-09-30T22:35:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f693ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6940134170 0x7f694013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f693effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f69400a1340 0x7f6940133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40094/0 (socket says 172.21.15.59:40094) 2023-09-30T22:35:25.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f693effd700 1 -- 172.21.15.59:0/3067825182 learned_addr learned my addr 172.21.15.59:0/3067825182 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:25.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f693f7fe700 1 --2- 172.21.15.59:0/3067825182 >> v2:172.21.15.59:3300/0 conn(0x7f69400a0a30 0x7f69400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f61e57c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61e00a0a30 0x7f61e00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f61e57c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61e00a0a30 0x7f61e00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37600/0 (socket says 172.21.15.59:37600) 2023-09-30T22:35:25.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f61e4fc4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61e009d630 0x7f61e00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.841+0000 7f61e57c5700 1 -- 172.21.15.59:0/979111288 learned_addr learned my addr 172.21.15.59:0/979111288 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:25.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f693e7fc700 1 -- 172.21.15.59:0/3067825182 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728929929 0 0) 0x7f694009edd0 con 0x7f69400a1340 2023-09-30T22:35:25.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f693ffff700 1 -- 172.21.15.59:0/3067825182 >> v2:172.21.15.59:3300/0 conn(0x7f69400a0a30 msgr2=0x7f69400a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:25.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f693ffff700 1 --2- 172.21.15.59:0/3067825182 >> v2:172.21.15.59:3300/0 conn(0x7f69400a0a30 0x7f69400a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f693ffff700 1 -- 172.21.15.59:0/3067825182 >> v1:172.21.15.59:6789/0 conn(0x7f69400a1340 legacy=0x7f6940133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f61e4fc4700 1 -- 172.21.15.59:0/979111288 >> v2:172.21.15.59:3300/0 conn(0x7f61e00a0a30 msgr2=0x7f61e00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:25.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f61e4fc4700 1 --2- 172.21.15.59:0/979111288 >> v2:172.21.15.59:3300/0 conn(0x7f61e00a0a30 0x7f61e00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f61e4fc4700 1 -- 172.21.15.59:0/979111288 >> v1:172.21.15.59:6789/0 conn(0x7f61e0133930 legacy=0x7f61e0133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f61e4fc4700 1 -- 172.21.15.59:0/979111288 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e009dc50 con 0x7f61e009d630 2023-09-30T22:35:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f693ffff700 1 -- 172.21.15.59:0/3067825182 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69400a1fe0 con 0x7f6940134170 2023-09-30T22:35:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f61e57c5700 1 --2- 172.21.15.59:0/979111288 >> v2:172.21.15.59:3300/0 conn(0x7f61e00a0a30 0x7f61e00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f693ffff700 1 --2- 172.21.15.59:0/3067825182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6940134170 0x7f694013bd30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6938009d90 tx=0x7f693800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4697a7fa02f6d9a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f61e4fc4700 1 --2- 172.21.15.59:0/979111288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61e009d630 0x7f61e00a1340 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009840 tx=0x7f61d4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de65b27253b9a136 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f693e7fc700 1 -- 172.21.15.59:0/3067825182 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693800e070 con 0x7f6940134170 2023-09-30T22:35:25.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f61dffff700 1 -- 172.21.15.59:0/979111288 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4011830 con 0x7f61e009d630 2023-09-30T22:35:25.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f693e7fc700 1 -- 172.21.15.59:0/3067825182 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693800bbd0 con 0x7f6940134170 2023-09-30T22:35:25.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f693e7fc700 1 -- 172.21.15.59:0/3067825182 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6938012430 con 0x7f6940134170 2023-09-30T22:35:25.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f61dffff700 1 -- 172.21.15.59:0/979111288 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d4011990 con 0x7f61e009d630 2023-09-30T22:35:25.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.842+0000 7f61dffff700 1 -- 172.21.15.59:0/979111288 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4011d20 con 0x7f61e009d630 2023-09-30T22:35:25.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f6945d77700 1 -- 172.21.15.59:0/3067825182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6940134170 msgr2=0x7f694013bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f6945d77700 1 --2- 172.21.15.59:0/3067825182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6940134170 0x7f694013bd30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6938009d90 tx=0x7f693800b330 comp rx=0 tx=0).stop 2023-09-30T22:35:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f61e7a29700 1 -- 172.21.15.59:0/979111288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61e009d630 msgr2=0x7f61e00a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f61e7a29700 1 --2- 172.21.15.59:0/979111288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61e009d630 0x7f61e00a1340 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009840 tx=0x7f61d4009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f6945d77700 1 -- 172.21.15.59:0/3067825182 shutdown_connections 2023-09-30T22:35:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f6945d77700 1 --2- 172.21.15.59:0/3067825182 >> v2:172.21.15.59:3300/0 conn(0x7f69400a0a30 0x7f69400a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f6945d77700 1 --2- 172.21.15.59:0/3067825182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6940134170 0x7f694013bd30 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f6945d77700 1 -- 172.21.15.59:0/3067825182 >> 172.21.15.59:0/3067825182 conn(0x7f69400a6550 msgr2=0x7f69400a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f6945d77700 1 -- 172.21.15.59:0/3067825182 shutdown_connections 2023-09-30T22:35:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f61e7a29700 1 -- 172.21.15.59:0/979111288 shutdown_connections 2023-09-30T22:35:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f61e7a29700 1 --2- 172.21.15.59:0/979111288 >> v2:172.21.15.59:3300/0 conn(0x7f61e00a0a30 0x7f61e00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f61e7a29700 1 --2- 172.21.15.59:0/979111288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61e009d630 0x7f61e00a1340 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f61e7a29700 1 -- 172.21.15.59:0/979111288 >> 172.21.15.59:0/979111288 conn(0x7f61e00a3050 msgr2=0x7f61e00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:25.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f6945d77700 1 -- 172.21.15.59:0/3067825182 wait complete. 2023-09-30T22:35:25.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f61e7a29700 1 -- 172.21.15.59:0/979111288 shutdown_connections 2023-09-30T22:35:25.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.843+0000 7f61e7a29700 1 -- 172.21.15.59:0/979111288 wait complete. 2023-09-30T22:35:25.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.845+0000 7f6945d77700 1 Processor -- start 2023-09-30T22:35:25.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.845+0000 7f61e7a29700 1 Processor -- start 2023-09-30T22:35:25.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.845+0000 7f61e7a29700 1 -- start start 2023-09-30T22:35:25.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.845+0000 7f6945d77700 1 -- start start 2023-09-30T22:35:25.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.845+0000 7f61e7a29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61e009d630 0x7f61e01c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.845+0000 7f61e7a29700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61e00a0a30 0x7f61e01c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.845+0000 7f61e7a29700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e0133930 0x7f61e01c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.845+0000 7f61e7a29700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e01207c0 con 0x7f61e0133930 2023-09-30T22:35:25.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.845+0000 7f61e7a29700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e01205d0 con 0x7f61e009d630 2023-09-30T22:35:25.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.845+0000 7f61e7a29700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00a5040 con 0x7f61e00a0a30 2023-09-30T22:35:25.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f61e4fc4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61e00a0a30 0x7f61e01c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f61e57c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61e009d630 0x7f61e01c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f61e5fc6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e0133930 0x7f61e01c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f61e4fc4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61e00a0a30 0x7f61e01c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56748/0 (socket says 172.21.15.59:56748) 2023-09-30T22:35:25.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f61e57c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61e009d630 0x7f61e01c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46668/0 (socket says 172.21.15.59:46668) 2023-09-30T22:35:25.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f61e5fc6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e0133930 0x7f61e01c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37608/0 (socket says 172.21.15.59:37608) 2023-09-30T22:35:25.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f61e4fc4700 1 -- 172.21.15.59:0/4211851773 learned_addr learned my addr 172.21.15.59:0/4211851773 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f6945d77700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69400a0a30 0x7f69401226e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f6945d77700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69400a1340 0x7f6940122c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f6945d77700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6940134170 0x7f6940123160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f6945d77700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6940124b80 con 0x7f69400a0a30 2023-09-30T22:35:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f6945d77700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6940123b40 con 0x7f69400a1340 2023-09-30T22:35:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f6945d77700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6940124400 con 0x7f6940134170 2023-09-30T22:35:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f693effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69400a1340 0x7f6940122c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f693effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69400a1340 0x7f6940122c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46676/0 (socket says 172.21.15.59:46676) 2023-09-30T22:35:25.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f693effd700 1 -- 172.21.15.59:0/3756091959 learned_addr learned my addr 172.21.15.59:0/3756091959 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:25.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f693ffff700 1 --2- 172.21.15.59:0/3756091959 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6940134170 0x7f6940123160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f693f7fe700 1 --2- 172.21.15.59:0/3756091959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69400a0a30 0x7f69401226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:25.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f61e4fc4700 1 -- 172.21.15.59:0/4211851773 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61e009d630 msgr2=0x7f61e01c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f61e4fc4700 1 --2- 172.21.15.59:0/4211851773 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61e009d630 0x7f61e01c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f61e4fc4700 1 -- 172.21.15.59:0/4211851773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e0133930 msgr2=0x7f61e01c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f61e4fc4700 1 --2- 172.21.15.59:0/4211851773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e0133930 0x7f61e01c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f61e4fc4700 1 -- 172.21.15.59:0/4211851773 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d0009b30 con 0x7f61e00a0a30 2023-09-30T22:35:25.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f61e5fc6700 1 --2- 172.21.15.59:0/4211851773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e0133930 0x7f61e01c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:25.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f61e4fc4700 1 --2- 172.21.15.59:0/4211851773 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61e00a0a30 0x7f61e01c86d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009fd0 tx=0x7f61d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:25.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f693effd700 1 -- 172.21.15.59:0/3756091959 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6940134170 msgr2=0x7f6940123160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f693effd700 1 --2- 172.21.15.59:0/3756091959 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6940134170 0x7f6940123160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f693effd700 1 -- 172.21.15.59:0/3756091959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69400a0a30 msgr2=0x7f69401226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:25.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f693effd700 1 --2- 172.21.15.59:0/3756091959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69400a0a30 0x7f69401226e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:25.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.846+0000 7f693effd700 1 -- 172.21.15.59:0/3756091959 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6938009a70 con 0x7f69400a1340 2023-09-30T22:35:25.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.847+0000 7f61ddffb700 1 -- 172.21.15.59:0/4211851773 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4004400 con 0x7f61e00a0a30 2023-09-30T22:35:25.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.847+0000 7f61ddffb700 1 -- 172.21.15.59:0/4211851773 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d401f070 con 0x7f61e00a0a30 2023-09-30T22:35:25.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.847+0000 7f693effd700 1 --2- 172.21.15.59:0/3756091959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69400a1340 0x7f6940122c20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f693400c520 tx=0x7f693400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:25.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.847+0000 7f61e7a29700 1 -- 172.21.15.59:0/4211851773 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d40094a0 con 0x7f61e00a0a30 2023-09-30T22:35:25.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.847+0000 7f61ddffb700 1 -- 172.21.15.59:0/4211851773 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d40038e0 con 0x7f61e00a0a30 2023-09-30T22:35:25.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.847+0000 7f6927fff700 1 -- 172.21.15.59:0/3756091959 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6934004c80 con 0x7f69400a1340 2023-09-30T22:35:25.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.847+0000 7f6927fff700 1 -- 172.21.15.59:0/3756091959 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6934004e00 con 0x7f69400a1340 2023-09-30T22:35:25.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.847+0000 7f6945d77700 1 -- 172.21.15.59:0/3756091959 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69400a25e0 con 0x7f69400a1340 2023-09-30T22:35:25.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.847+0000 7f6927fff700 1 -- 172.21.15.59:0/3756091959 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6934007310 con 0x7f69400a1340 2023-09-30T22:35:25.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.847+0000 7f61e7a29700 1 -- 172.21.15.59:0/4211851773 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e0120dc0 con 0x7f61e00a0a30 2023-09-30T22:35:25.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.847+0000 7f6945d77700 1 -- 172.21.15.59:0/3756091959 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6940133200 con 0x7f69400a1340 2023-09-30T22:35:25.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.848+0000 7f6945d77700 1 -- 172.21.15.59:0/3756091959 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6940074ea0 con 0x7f69400a1340 2023-09-30T22:35:25.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.848+0000 7f61e7a29700 1 -- 172.21.15.59:0/4211851773 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e0122cd0 con 0x7f61e00a0a30 2023-09-30T22:35:25.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.849+0000 7f6927fff700 1 -- 172.21.15.59:0/3756091959 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6934007470 con 0x7f69400a1340 2023-09-30T22:35:25.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.849+0000 7f61ddffb700 1 -- 172.21.15.59:0/4211851773 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61d4021030 con 0x7f61e00a0a30 2023-09-30T22:35:25.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.849+0000 7f6927fff700 1 -- 172.21.15.59:0/3756091959 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f693403f970 con 0x7f69400a1340 2023-09-30T22:35:25.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.849+0000 7f61ddffb700 1 -- 172.21.15.59:0/4211851773 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f61d40407a0 con 0x7f61e00a0a30 2023-09-30T22:35:25.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.853+0000 7f6927fff700 1 -- 172.21.15.59:0/3756091959 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f69340133c0 con 0x7f69400a1340 2023-09-30T22:35:25.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:25.854+0000 7f61ddffb700 1 -- 172.21.15.59:0/4211851773 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61d40239c0 con 0x7f61e00a0a30 2023-09-30T22:35:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.058+0000 7f6945d77700 1 -- 172.21.15.59:0/3756091959 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f69400a28e0 con 0x7f69400a1340 2023-09-30T22:35:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.058+0000 7f61e7a29700 1 -- 172.21.15.59:0/4211851773 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f61e0074770 con 0x7f61e00a0a30 2023-09-30T22:35:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.059+0000 7f61ddffb700 1 -- 172.21.15.59:0/4211851773 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61d4015070 con 0x7f61e00a0a30 2023-09-30T22:35:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.059+0000 7f6927fff700 1 -- 172.21.15.59:0/3756091959 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6934011360 con 0x7f69400a1340 2023-09-30T22:35:26.061 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:26.061 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f6945d77700 1 -- 172.21.15.59:0/3756091959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69400a1340 msgr2=0x7f6940122c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f6945d77700 1 --2- 172.21.15.59:0/3756091959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69400a1340 0x7f6940122c20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f693400c520 tx=0x7f693400c830 comp rx=0 tx=0).stop 2023-09-30T22:35:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f6945d77700 1 -- 172.21.15.59:0/3756091959 shutdown_connections 2023-09-30T22:35:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f6945d77700 1 --2- 172.21.15.59:0/3756091959 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6940134170 0x7f6940123160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f6945d77700 1 --2- 172.21.15.59:0/3756091959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69400a0a30 0x7f69401226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f6945d77700 1 --2- 172.21.15.59:0/3756091959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69400a1340 0x7f6940122c20 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f6945d77700 1 -- 172.21.15.59:0/3756091959 >> 172.21.15.59:0/3756091959 conn(0x7f69400a6550 msgr2=0x7f694009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f61e7a29700 1 -- 172.21.15.59:0/4211851773 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61e00a0a30 msgr2=0x7f61e01c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f61e7a29700 1 --2- 172.21.15.59:0/4211851773 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61e00a0a30 0x7f61e01c86d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009fd0 tx=0x7f61d4004750 comp rx=0 tx=0).stop 2023-09-30T22:35:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f61e7a29700 1 -- 172.21.15.59:0/4211851773 shutdown_connections 2023-09-30T22:35:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f61e7a29700 1 --2- 172.21.15.59:0/4211851773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e0133930 0x7f61e01c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f61e7a29700 1 --2- 172.21.15.59:0/4211851773 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61e009d630 0x7f61e01c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f61e7a29700 1 --2- 172.21.15.59:0/4211851773 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61e00a0a30 0x7f61e01c86d0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f61e7a29700 1 -- 172.21.15.59:0/4211851773 >> 172.21.15.59:0/4211851773 conn(0x7f61e00a3050 msgr2=0x7f61e01bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f6945d77700 1 -- 172.21.15.59:0/3756091959 shutdown_connections 2023-09-30T22:35:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f61e7a29700 1 -- 172.21.15.59:0/4211851773 shutdown_connections 2023-09-30T22:35:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f61e7a29700 1 -- 172.21.15.59:0/4211851773 wait complete. 2023-09-30T22:35:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.061+0000 7f6945d77700 1 -- 172.21.15.59:0/3756091959 wait complete. 2023-09-30T22:35:26.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:26.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:26.626 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:26.662 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:26.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.773+0000 7ff3553d8700 1 Processor -- start 2023-09-30T22:35:26.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.773+0000 7ff3553d8700 1 -- start start 2023-09-30T22:35:26.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.774+0000 7ff3553d8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff350133a80 0x7ff350133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:26.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.774+0000 7ff3553d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff35012ff20 0x7ff350130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:26.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.774+0000 7ff3553d8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35006bc00 con 0x7ff350130870 2023-09-30T22:35:26.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.774+0000 7ff3553d8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35006c570 con 0x7ff350133a80 2023-09-30T22:35:26.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.774+0000 7ff3553d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500a0040 con 0x7ff35012ff20 2023-09-30T22:35:26.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.774+0000 7ff34effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff350133a80 0x7ff350133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:26.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.774+0000 7ff34e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff35012ff20 0x7ff350130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:26.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.774+0000 7ff34effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff350133a80 0x7ff350133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37638/0 (socket says 172.21.15.59:37638) 2023-09-30T22:35:26.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.774+0000 7ff34e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff35012ff20 0x7ff350130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46688/0 (socket says 172.21.15.59:46688) 2023-09-30T22:35:26.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.774+0000 7ff34effd700 1 -- 172.21.15.59:0/396690723 learned_addr learned my addr 172.21.15.59:0/396690723 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:26.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.774+0000 7ff34e7fc700 1 -- 172.21.15.59:0/396690723 >> v2:172.21.15.59:3300/0 conn(0x7ff350133a80 msgr2=0x7ff350133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:26.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.774+0000 7ff34e7fc700 1 --2- 172.21.15.59:0/396690723 >> v2:172.21.15.59:3300/0 conn(0x7ff350133a80 0x7ff350133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.774+0000 7ff34e7fc700 1 -- 172.21.15.59:0/396690723 >> v1:172.21.15.59:6789/0 conn(0x7ff350130870 legacy=0x7ff35013a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:26.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.774+0000 7ff34e7fc700 1 -- 172.21.15.59:0/396690723 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff350133860 con 0x7ff35012ff20 2023-09-30T22:35:26.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.774+0000 7ff34effd700 1 --2- 172.21.15.59:0/396690723 >> v2:172.21.15.59:3300/0 conn(0x7ff350133a80 0x7ff350133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:26.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.775+0000 7ff34e7fc700 1 --2- 172.21.15.59:0/396690723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff35012ff20 0x7ff350130330 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff338009840 tx=0x7ff338009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3529db3ac94949e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:26.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.775+0000 7ff34dffb700 1 -- 172.21.15.59:0/396690723 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338011830 con 0x7ff35012ff20 2023-09-30T22:35:26.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.775+0000 7ff34dffb700 1 -- 172.21.15.59:0/396690723 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff338011990 con 0x7ff35012ff20 2023-09-30T22:35:26.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.775+0000 7ff34dffb700 1 -- 172.21.15.59:0/396690723 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338011d20 con 0x7ff35012ff20 2023-09-30T22:35:26.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.775+0000 7ff3553d8700 1 -- 172.21.15.59:0/396690723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff35012ff20 msgr2=0x7ff350130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:26.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.775+0000 7ff3553d8700 1 --2- 172.21.15.59:0/396690723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff35012ff20 0x7ff350130330 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff338009840 tx=0x7ff338009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:26.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.775+0000 7ff3553d8700 1 -- 172.21.15.59:0/396690723 shutdown_connections 2023-09-30T22:35:26.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.776+0000 7ff3553d8700 1 --2- 172.21.15.59:0/396690723 >> v2:172.21.15.59:3300/0 conn(0x7ff350133a80 0x7ff350133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.776+0000 7ff3553d8700 1 --2- 172.21.15.59:0/396690723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff35012ff20 0x7ff350130330 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.776+0000 7ff3553d8700 1 -- 172.21.15.59:0/396690723 >> 172.21.15.59:0/396690723 conn(0x7ff3500a4210 msgr2=0x7ff3500a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:26.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.776+0000 7ff3553d8700 1 -- 172.21.15.59:0/396690723 shutdown_connections 2023-09-30T22:35:26.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.776+0000 7ff3553d8700 1 -- 172.21.15.59:0/396690723 wait complete. 2023-09-30T22:35:26.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.777+0000 7ff3553d8700 1 Processor -- start 2023-09-30T22:35:26.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.777+0000 7ff3553d8700 1 -- start start 2023-09-30T22:35:26.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.777+0000 7ff3553d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff35012ff20 0x7ff35009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:26.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.777+0000 7ff3553d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff350130870 0x7ff35009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:26.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.777+0000 7ff3553d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff350133a80 0x7ff35009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:26.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.777+0000 7ff3553d8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35009e4a0 con 0x7ff350133a80 2023-09-30T22:35:26.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.777+0000 7ff3553d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff350120060 con 0x7ff35012ff20 2023-09-30T22:35:26.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.777+0000 7ff3553d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff35012db00 con 0x7ff350130870 2023-09-30T22:35:26.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.777+0000 7ff34effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff35012ff20 0x7ff35009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:26.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.777+0000 7ff34e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff350130870 0x7ff35009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:26.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.777+0000 7ff34effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff35012ff20 0x7ff35009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46696/0 (socket says 172.21.15.59:46696) 2023-09-30T22:35:26.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.777+0000 7ff34effd700 1 -- 172.21.15.59:0/17485804 learned_addr learned my addr 172.21.15.59:0/17485804 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.778+0000 7ff34f7fe700 1 --2- 172.21.15.59:0/17485804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff350133a80 0x7ff35009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.778+0000 7ff34e7fc700 1 -- 172.21.15.59:0/17485804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff35012ff20 msgr2=0x7ff35009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.778+0000 7ff34e7fc700 1 --2- 172.21.15.59:0/17485804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff35012ff20 0x7ff35009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.778+0000 7ff34e7fc700 1 -- 172.21.15.59:0/17485804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff350133a80 msgr2=0x7ff35009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.778+0000 7ff34e7fc700 1 --2- 172.21.15.59:0/17485804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff350133a80 0x7ff35009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.778+0000 7ff34e7fc700 1 -- 172.21.15.59:0/17485804 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff340009550 con 0x7ff350130870 2023-09-30T22:35:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.778+0000 7ff34effd700 1 --2- 172.21.15.59:0/17485804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff35012ff20 0x7ff35009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.778+0000 7ff34e7fc700 1 --2- 172.21.15.59:0/17485804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff350130870 0x7ff35009c9c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff338016000 tx=0x7ff338004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.778+0000 7ff3477fe700 1 -- 172.21.15.59:0/17485804 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3380036a0 con 0x7ff350130870 2023-09-30T22:35:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.778+0000 7ff3477fe700 1 -- 172.21.15.59:0/17485804 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33801f070 con 0x7ff350130870 2023-09-30T22:35:26.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.778+0000 7ff3477fe700 1 -- 172.21.15.59:0/17485804 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338003a60 con 0x7ff350130870 2023-09-30T22:35:26.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.778+0000 7ff3553d8700 1 -- 172.21.15.59:0/17485804 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3380094a0 con 0x7ff350130870 2023-09-30T22:35:26.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.778+0000 7ff3553d8700 1 -- 172.21.15.59:0/17485804 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff350120340 con 0x7ff350130870 2023-09-30T22:35:26.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.779+0000 7ff3477fe700 1 -- 172.21.15.59:0/17485804 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff338003bc0 con 0x7ff350130870 2023-09-30T22:35:26.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.779+0000 7ff3477fe700 1 -- 172.21.15.59:0/17485804 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff338021070 con 0x7ff350130870 2023-09-30T22:35:26.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.779+0000 7ff3553d8700 1 -- 172.21.15.59:0/17485804 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3501201a0 con 0x7ff350130870 2023-09-30T22:35:26.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.784+0000 7ff3477fe700 1 -- 172.21.15.59:0/17485804 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3501201a0 con 0x7ff350130870 2023-09-30T22:35:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.812+0000 7f8b9e833700 1 Processor -- start 2023-09-30T22:35:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.812+0000 7f8b9e833700 1 -- start start 2023-09-30T22:35:26.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b9e833700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b9812c830 0x7f8b9812cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:26.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b9e833700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b9809a880 0x7f8b980992c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:26.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b9e833700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b98099800 0x7f8b98099c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:26.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b9e833700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9809e670 con 0x7f8b9812c830 2023-09-30T22:35:26.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b9e833700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9809a1c0 con 0x7f8b9809a880 2023-09-30T22:35:26.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b9e833700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9812c3b0 con 0x7f8b98099800 2023-09-30T22:35:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b977fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b9809a880 0x7f8b980992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b97fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b9812c830 0x7f8b9812cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b9cdd0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b98099800 0x7f8b98099c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b977fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b9809a880 0x7f8b980992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46698/0 (socket says 172.21.15.59:46698) 2023-09-30T22:35:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b977fe700 1 -- 172.21.15.59:0/3920129188 learned_addr learned my addr 172.21.15.59:0/3920129188 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b977fe700 1 -- 172.21.15.59:0/3920129188 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b98099800 msgr2=0x7f8b98099c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b977fe700 1 --2- 172.21.15.59:0/3920129188 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b98099800 0x7f8b98099c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b977fe700 1 -- 172.21.15.59:0/3920129188 >> v2:172.21.15.59:3300/0 conn(0x7f8b9812c830 msgr2=0x7f8b9812cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b977fe700 1 --2- 172.21.15.59:0/3920129188 >> v2:172.21.15.59:3300/0 conn(0x7f8b9812c830 0x7f8b9812cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b977fe700 1 -- 172.21.15.59:0/3920129188 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9809b860 con 0x7f8b9809a880 2023-09-30T22:35:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.813+0000 7f8b977fe700 1 --2- 172.21.15.59:0/3920129188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b9809a880 0x7f8b980992c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0098f0 tx=0x7f8b8c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18291d4285dbd728 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.814+0000 7f8b96ffd700 1 -- 172.21.15.59:0/3920129188 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c011830 con 0x7f8b9809a880 2023-09-30T22:35:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.814+0000 7f8b96ffd700 1 -- 172.21.15.59:0/3920129188 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c011990 con 0x7f8b9809a880 2023-09-30T22:35:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.814+0000 7f8b96ffd700 1 -- 172.21.15.59:0/3920129188 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c011d20 con 0x7f8b9809a880 2023-09-30T22:35:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.814+0000 7f8b9e833700 1 -- 172.21.15.59:0/3920129188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b9809a880 msgr2=0x7f8b980992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.814+0000 7f8b9e833700 1 --2- 172.21.15.59:0/3920129188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b9809a880 0x7f8b980992c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0098f0 tx=0x7f8b8c009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.814+0000 7f8b9e833700 1 -- 172.21.15.59:0/3920129188 shutdown_connections 2023-09-30T22:35:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.814+0000 7f8b9e833700 1 --2- 172.21.15.59:0/3920129188 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b98099800 0x7f8b98099c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.814+0000 7f8b9e833700 1 --2- 172.21.15.59:0/3920129188 >> v2:172.21.15.59:3300/0 conn(0x7f8b9812c830 0x7f8b9812cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.814+0000 7f8b9e833700 1 --2- 172.21.15.59:0/3920129188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b9809a880 0x7f8b980992c0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.814+0000 7f8b9e833700 1 -- 172.21.15.59:0/3920129188 >> 172.21.15.59:0/3920129188 conn(0x7f8b9809f470 msgr2=0x7f8b980a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.814+0000 7f8b9e833700 1 -- 172.21.15.59:0/3920129188 shutdown_connections 2023-09-30T22:35:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.814+0000 7f8b9e833700 1 -- 172.21.15.59:0/3920129188 wait complete. 2023-09-30T22:35:26.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.815+0000 7f8b9e833700 1 Processor -- start 2023-09-30T22:35:26.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.816+0000 7f8b9e833700 1 -- start start 2023-09-30T22:35:26.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.816+0000 7f8b9e833700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b98099800 0x7f8b981c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:26.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.816+0000 7f8b9e833700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b9809a880 0x7f8b981c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:26.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.816+0000 7f8b9e833700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b9812c830 0x7f8b981c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.816+0000 7f8b9e833700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b981c4e50 con 0x7f8b98099800 2023-09-30T22:35:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.816+0000 7f8b9e833700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98129f70 con 0x7f8b9809a880 2023-09-30T22:35:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.816+0000 7f8b9e833700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9812bde0 con 0x7f8b9812c830 2023-09-30T22:35:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.816+0000 7f8b9cdd0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b9812c830 0x7f8b981c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.816+0000 7f8b977fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b9809a880 0x7f8b981c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.816+0000 7f8b9cdd0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b9812c830 0x7f8b981c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56776/0 (socket says 172.21.15.59:56776) 2023-09-30T22:35:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.816+0000 7f8b9cdd0700 1 -- 172.21.15.59:0/1360824608 learned_addr learned my addr 172.21.15.59:0/1360824608 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.816+0000 7f8b977fe700 1 --2- 172.21.15.59:0/1360824608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b9809a880 0x7f8b981c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46710/0 (socket says 172.21.15.59:46710) 2023-09-30T22:35:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.816+0000 7f8b97fff700 1 --2- 172.21.15.59:0/1360824608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b98099800 0x7f8b981c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.817+0000 7f8b9cdd0700 1 -- 172.21.15.59:0/1360824608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b9809a880 msgr2=0x7f8b981c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.817+0000 7f8b9cdd0700 1 --2- 172.21.15.59:0/1360824608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b9809a880 0x7f8b981c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.817+0000 7f8b9cdd0700 1 -- 172.21.15.59:0/1360824608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b98099800 msgr2=0x7f8b981c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.817+0000 7f8b9cdd0700 1 --2- 172.21.15.59:0/1360824608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b98099800 0x7f8b981c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.817+0000 7f8b9cdd0700 1 -- 172.21.15.59:0/1360824608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c009550 con 0x7f8b9812c830 2023-09-30T22:35:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.817+0000 7f8b977fe700 1 --2- 172.21.15.59:0/1360824608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b9809a880 0x7f8b981c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.817+0000 7f8b9cdd0700 1 --2- 172.21.15.59:0/1360824608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b9812c830 0x7f8b981c8e40 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009e30 tx=0x7f8b900074f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.817+0000 7f8b94ff9700 1 -- 172.21.15.59:0/1360824608 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9000add0 con 0x7f8b9812c830 2023-09-30T22:35:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.817+0000 7f8b94ff9700 1 -- 172.21.15.59:0/1360824608 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b90010040 con 0x7f8b9812c830 2023-09-30T22:35:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.817+0000 7f8b9e833700 1 -- 172.21.15.59:0/1360824608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b98127c20 con 0x7f8b9812c830 2023-09-30T22:35:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.817+0000 7f8b94ff9700 1 -- 172.21.15.59:0/1360824608 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b90007c10 con 0x7f8b9812c830 2023-09-30T22:35:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.817+0000 7f8b9e833700 1 -- 172.21.15.59:0/1360824608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b981b9590 con 0x7f8b9812c830 2023-09-30T22:35:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.818+0000 7f8b94ff9700 1 -- 172.21.15.59:0/1360824608 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b90004030 con 0x7f8b9812c830 2023-09-30T22:35:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.818+0000 7f8b94ff9700 1 -- 172.21.15.59:0/1360824608 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8b9003f5d0 con 0x7f8b9812c830 2023-09-30T22:35:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.818+0000 7f8b9e833700 1 -- 172.21.15.59:0/1360824608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b980747f0 con 0x7f8b9812c830 2023-09-30T22:35:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.823+0000 7f8b94ff9700 1 -- 172.21.15.59:0/1360824608 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b9001d3b0 con 0x7f8b9812c830 2023-09-30T22:35:26.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.990+0000 7ff3553d8700 1 -- 172.21.15.59:0/17485804 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff3501201a0 con 0x7ff350130870 2023-09-30T22:35:26.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.990+0000 7ff3477fe700 1 -- 172.21.15.59:0/17485804 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff3501201a0 con 0x7ff350130870 2023-09-30T22:35:26.991 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.992+0000 7ff3553d8700 1 -- 172.21.15.59:0/17485804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff350130870 msgr2=0x7ff35009c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.992+0000 7ff3553d8700 1 --2- 172.21.15.59:0/17485804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff350130870 0x7ff35009c9c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff338016000 tx=0x7ff338004750 comp rx=0 tx=0).stop 2023-09-30T22:35:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.992+0000 7ff3553d8700 1 -- 172.21.15.59:0/17485804 shutdown_connections 2023-09-30T22:35:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.992+0000 7ff3553d8700 1 --2- 172.21.15.59:0/17485804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff350133a80 0x7ff35009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.992+0000 7ff3553d8700 1 --2- 172.21.15.59:0/17485804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff35012ff20 0x7ff35009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.992+0000 7ff3553d8700 1 --2- 172.21.15.59:0/17485804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff350130870 0x7ff35009c9c0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.992+0000 7ff3553d8700 1 -- 172.21.15.59:0/17485804 >> 172.21.15.59:0/17485804 conn(0x7ff3500a4210 msgr2=0x7ff35009e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.992+0000 7ff3553d8700 1 -- 172.21.15.59:0/17485804 shutdown_connections 2023-09-30T22:35:26.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:26.992+0000 7ff3553d8700 1 -- 172.21.15.59:0/17485804 wait complete. 2023-09-30T22:35:27.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:27.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.027+0000 7f8b9e833700 1 -- 172.21.15.59:0/1360824608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8b9809b4e0 con 0x7f8b9812c830 2023-09-30T22:35:27.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.028+0000 7f8b94ff9700 1 -- 172.21.15.59:0/1360824608 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b90019020 con 0x7f8b9812c830 2023-09-30T22:35:27.029 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:27.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.030+0000 7f8b9e833700 1 -- 172.21.15.59:0/1360824608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b9812c830 msgr2=0x7f8b981c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:27.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.030+0000 7f8b9e833700 1 --2- 172.21.15.59:0/1360824608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b9812c830 0x7f8b981c8e40 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009e30 tx=0x7f8b900074f0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.030+0000 7f8b9e833700 1 -- 172.21.15.59:0/1360824608 shutdown_connections 2023-09-30T22:35:27.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.030+0000 7f8b9e833700 1 --2- 172.21.15.59:0/1360824608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b9812c830 0x7f8b981c8e40 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.030+0000 7f8b9e833700 1 --2- 172.21.15.59:0/1360824608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b98099800 0x7f8b981c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.030+0000 7f8b9e833700 1 --2- 172.21.15.59:0/1360824608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b9809a880 0x7f8b981c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.030+0000 7f8b9e833700 1 -- 172.21.15.59:0/1360824608 >> 172.21.15.59:0/1360824608 conn(0x7f8b9809f470 msgr2=0x7f8b9809fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:27.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.030+0000 7f8b9e833700 1 -- 172.21.15.59:0/1360824608 shutdown_connections 2023-09-30T22:35:27.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.030+0000 7f8b9e833700 1 -- 172.21.15.59:0/1360824608 wait complete. 2023-09-30T22:35:27.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:27.078 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:27.079 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:27.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.244+0000 7f8fc07a1700 1 Processor -- start 2023-09-30T22:35:27.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.244+0000 7f8fc07a1700 1 -- start start 2023-09-30T22:35:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.244+0000 7f328a411700 1 Processor -- start 2023-09-30T22:35:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f328a411700 1 -- start start 2023-09-30T22:35:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f328a411700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32840a0a30 0x7f32840a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f8fc07a1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fb8133420 0x7f8fb81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f328a411700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3284138d80 0x7f328413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f8fc07a1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb8134260 0x7f8fb81306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f8fc07a1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb806b990 con 0x7f8fb8133e30 2023-09-30T22:35:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f8fc07a1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb80a0590 con 0x7f8fb8134260 2023-09-30T22:35:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f8fc07a1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb809fb80 con 0x7f8fb8133420 2023-09-30T22:35:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f328a411700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32840a2a70 con 0x7f328409d630 2023-09-30T22:35:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f328a411700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32840a01d0 con 0x7f3284138d80 2023-09-30T22:35:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f328a411700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f328409e2b0 con 0x7f32840a0a30 2023-09-30T22:35:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f32837fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f328409d630 0x7f32840a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40116/0 (socket says 172.21.15.59:40116) 2023-09-30T22:35:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f32837fe700 1 -- 172.21.15.59:0/1714736275 learned_addr learned my addr 172.21.15.59:0/1714736275 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:27.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f8fbdd3c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8fb8133e30 0x7f8fb812ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40122/0 (socket says 172.21.15.59:40122) 2023-09-30T22:35:27.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f8fbdd3c700 1 -- 172.21.15.59:0/3282501464 learned_addr learned my addr 172.21.15.59:0/3282501464 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:27.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f8fbed3e700 1 --2- 172.21.15.59:0/3282501464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb8134260 0x7f8fb81306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:27.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f8fbe53d700 1 --2- 172.21.15.59:0/3282501464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fb8133420 0x7f8fb81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:27.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f3283fff700 1 --2- 172.21.15.59:0/1714736275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32840a0a30 0x7f32840a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:27.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.245+0000 7f32889ae700 1 --2- 172.21.15.59:0/1714736275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3284138d80 0x7f328413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f8fbed3e700 1 -- 172.21.15.59:0/3282501464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fb8133420 msgr2=0x7f8fb81337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f8fbed3e700 1 --2- 172.21.15.59:0/3282501464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fb8133420 0x7f8fb81337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f3282ffd700 1 -- 172.21.15.59:0/1714736275 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882832661 0 0) 0x7f32840a2a70 con 0x7f328409d630 2023-09-30T22:35:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f3282ffd700 1 -- 172.21.15.59:0/1714736275 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f326c0035b0 con 0x7f328409d630 2023-09-30T22:35:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f32889ae700 1 -- 172.21.15.59:0/1714736275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32840a0a30 msgr2=0x7f32840a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f8fbed3e700 1 -- 172.21.15.59:0/3282501464 >> v1:172.21.15.59:6789/0 conn(0x7f8fb8133e30 legacy=0x7f8fb812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f8fbed3e700 1 -- 172.21.15.59:0/3282501464 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb80a0030 con 0x7f8fb8134260 2023-09-30T22:35:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f32889ae700 1 --2- 172.21.15.59:0/1714736275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32840a0a30 0x7f32840a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f32889ae700 1 -- 172.21.15.59:0/1714736275 >> v1:172.21.15.59:6789/0 conn(0x7f328409d630 legacy=0x7f32840a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f32889ae700 1 -- 172.21.15.59:0/1714736275 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328409dc50 con 0x7f3284138d80 2023-09-30T22:35:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f3283fff700 1 --2- 172.21.15.59:0/1714736275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32840a0a30 0x7f32840a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f32889ae700 1 --2- 172.21.15.59:0/1714736275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3284138d80 0x7f328413b160 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f327c009dc0 tx=0x7f327c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aa1c16f98bfae5a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f8fbed3e700 1 --2- 172.21.15.59:0/3282501464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb8134260 0x7f8fb81306a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009dc0 tx=0x7f8fb000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edcaa2346d9786ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f3282ffd700 1 -- 172.21.15.59:0/1714736275 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c00e070 con 0x7f3284138d80 2023-09-30T22:35:27.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f3282ffd700 1 -- 172.21.15.59:0/1714736275 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c00bb20 con 0x7f3284138d80 2023-09-30T22:35:27.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f3282ffd700 1 -- 172.21.15.59:0/1714736275 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c012430 con 0x7f3284138d80 2023-09-30T22:35:27.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f8fbd53b700 1 -- 172.21.15.59:0/3282501464 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb000e070 con 0x7f8fb8134260 2023-09-30T22:35:27.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f8fbd53b700 1 -- 172.21.15.59:0/3282501464 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb000bbd0 con 0x7f8fb8134260 2023-09-30T22:35:27.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.246+0000 7f8fbd53b700 1 -- 172.21.15.59:0/3282501464 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0012430 con 0x7f8fb8134260 2023-09-30T22:35:27.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f328a411700 1 -- 172.21.15.59:0/1714736275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3284138d80 msgr2=0x7f328413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:27.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f8fc07a1700 1 -- 172.21.15.59:0/3282501464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb8134260 msgr2=0x7f8fb81306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:27.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f328a411700 1 --2- 172.21.15.59:0/1714736275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3284138d80 0x7f328413b160 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f327c009dc0 tx=0x7f327c00b330 comp rx=0 tx=0).stop 2023-09-30T22:35:27.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f8fc07a1700 1 --2- 172.21.15.59:0/3282501464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb8134260 0x7f8fb81306a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009dc0 tx=0x7f8fb000b330 comp rx=0 tx=0).stop 2023-09-30T22:35:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f328a411700 1 -- 172.21.15.59:0/1714736275 shutdown_connections 2023-09-30T22:35:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f328a411700 1 --2- 172.21.15.59:0/1714736275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32840a0a30 0x7f32840a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f328a411700 1 --2- 172.21.15.59:0/1714736275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3284138d80 0x7f328413b160 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f8fc07a1700 1 -- 172.21.15.59:0/3282501464 shutdown_connections 2023-09-30T22:35:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f8fc07a1700 1 --2- 172.21.15.59:0/3282501464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fb8133420 0x7f8fb81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f328a411700 1 -- 172.21.15.59:0/1714736275 >> 172.21.15.59:0/1714736275 conn(0x7f32840a3050 msgr2=0x7f32840a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:27.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f8fc07a1700 1 --2- 172.21.15.59:0/3282501464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb8134260 0x7f8fb81306a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f8fc07a1700 1 -- 172.21.15.59:0/3282501464 >> 172.21.15.59:0/3282501464 conn(0x7f8fb80a4210 msgr2=0x7f8fb80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:27.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f328a411700 1 -- 172.21.15.59:0/1714736275 shutdown_connections 2023-09-30T22:35:27.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f328a411700 1 -- 172.21.15.59:0/1714736275 wait complete. 2023-09-30T22:35:27.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f8fc07a1700 1 -- 172.21.15.59:0/3282501464 shutdown_connections 2023-09-30T22:35:27.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.247+0000 7f8fc07a1700 1 -- 172.21.15.59:0/3282501464 wait complete. 2023-09-30T22:35:27.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.248+0000 7f8fc07a1700 1 Processor -- start 2023-09-30T22:35:27.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.248+0000 7f328a411700 1 Processor -- start 2023-09-30T22:35:27.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.248+0000 7f8fc07a1700 1 -- start start 2023-09-30T22:35:27.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f328a411700 1 -- start start 2023-09-30T22:35:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fc07a1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fb8133420 0x7f8fb811e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fc07a1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb8133e30 0x7f8fb811e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fc07a1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb8134260 0x7f8fb811cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fc07a1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb812dc50 con 0x7f8fb8133e30 2023-09-30T22:35:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fc07a1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb81317b0 con 0x7f8fb8134260 2023-09-30T22:35:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fc07a1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb811bd70 con 0x7f8fb8133420 2023-09-30T22:35:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fbed3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb8134260 0x7f8fb811cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fbed3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb8134260 0x7f8fb811cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46740/0 (socket says 172.21.15.59:46740) 2023-09-30T22:35:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fbe53d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fb8133420 0x7f8fb811e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fbed3e700 1 -- 172.21.15.59:0/2719886155 learned_addr learned my addr 172.21.15.59:0/2719886155 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f328a411700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328409d630 0x7f328412c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f328a411700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32840a0a30 0x7f328412cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f328a411700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3284138d80 0x7f328412d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f328a411700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32840a0480 con 0x7f32840a0a30 2023-09-30T22:35:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f328a411700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328412fb30 con 0x7f328409d630 2023-09-30T22:35:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f328a411700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32841306d0 con 0x7f3284138d80 2023-09-30T22:35:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f32889ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3284138d80 0x7f328412d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f3283fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328409d630 0x7f328412c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f32889ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3284138d80 0x7f328412d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56812/0 (socket says 172.21.15.59:56812) 2023-09-30T22:35:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f32889ae700 1 -- 172.21.15.59:0/37053045 learned_addr learned my addr 172.21.15.59:0/37053045 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f3283fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328409d630 0x7f328412c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46742/0 (socket says 172.21.15.59:46742) 2023-09-30T22:35:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fbed3e700 1 -- 172.21.15.59:0/2719886155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fb8133420 msgr2=0x7f8fb811e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fbed3e700 1 --2- 172.21.15.59:0/2719886155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fb8133420 0x7f8fb811e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fbed3e700 1 -- 172.21.15.59:0/2719886155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb8133e30 msgr2=0x7f8fb811e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fbed3e700 1 --2- 172.21.15.59:0/2719886155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb8133e30 0x7f8fb811e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fbed3e700 1 -- 172.21.15.59:0/2719886155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb0009a70 con 0x7f8fb8134260 2023-09-30T22:35:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.249+0000 7f8fbe53d700 1 --2- 172.21.15.59:0/2719886155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fb8133420 0x7f8fb811e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f32889ae700 1 -- 172.21.15.59:0/37053045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328409d630 msgr2=0x7f328412c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f32889ae700 1 --2- 172.21.15.59:0/37053045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328409d630 0x7f328412c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f32889ae700 1 -- 172.21.15.59:0/37053045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32840a0a30 msgr2=0x7f328412cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f32889ae700 1 --2- 172.21.15.59:0/37053045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32840a0a30 0x7f328412cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f32889ae700 1 -- 172.21.15.59:0/37053045 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32740094a0 con 0x7f3284138d80 2023-09-30T22:35:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f8fbed3e700 1 --2- 172.21.15.59:0/2719886155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb8134260 0x7f8fb811cbc0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000b370 tx=0x7f8fb0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f8faeffd700 1 -- 172.21.15.59:0/2719886155 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0012430 con 0x7f8fb8134260 2023-09-30T22:35:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f8faeffd700 1 -- 172.21.15.59:0/2719886155 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb0020070 con 0x7f8fb8134260 2023-09-30T22:35:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f8fc07a1700 1 -- 172.21.15.59:0/2719886155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb811c040 con 0x7f8fb8134260 2023-09-30T22:35:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f8faeffd700 1 -- 172.21.15.59:0/2719886155 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0004280 con 0x7f8fb8134260 2023-09-30T22:35:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f32889ae700 1 --2- 172.21.15.59:0/37053045 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3284138d80 0x7f328412d1b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f327c014040 tx=0x7f327c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f8fc07a1700 1 -- 172.21.15.59:0/2719886155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb811b750 con 0x7f8fb8134260 2023-09-30T22:35:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f3280ff9700 1 -- 172.21.15.59:0/37053045 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c012430 con 0x7f3284138d80 2023-09-30T22:35:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f3280ff9700 1 -- 172.21.15.59:0/37053045 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c020070 con 0x7f3284138d80 2023-09-30T22:35:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f328a411700 1 -- 172.21.15.59:0/37053045 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f327c009a70 con 0x7f3284138d80 2023-09-30T22:35:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f328a411700 1 -- 172.21.15.59:0/37053045 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3284130970 con 0x7f3284138d80 2023-09-30T22:35:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.250+0000 7f3280ff9700 1 -- 172.21.15.59:0/37053045 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c004280 con 0x7f3284138d80 2023-09-30T22:35:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.251+0000 7f8faeffd700 1 -- 172.21.15.59:0/2719886155 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8fb00043e0 con 0x7f8fb8134260 2023-09-30T22:35:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.251+0000 7f8faeffd700 1 -- 172.21.15.59:0/2719886155 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8fb0022070 con 0x7f8fb8134260 2023-09-30T22:35:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.251+0000 7f8fc07a1700 1 -- 172.21.15.59:0/2719886155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb811beb0 con 0x7f8fb8134260 2023-09-30T22:35:27.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.251+0000 7f3280ff9700 1 -- 172.21.15.59:0/37053045 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f327c0043e0 con 0x7f3284138d80 2023-09-30T22:35:27.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.252+0000 7f3280ff9700 1 -- 172.21.15.59:0/37053045 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f327c022070 con 0x7f3284138d80 2023-09-30T22:35:27.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.252+0000 7f328a411700 1 -- 172.21.15.59:0/37053045 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328413b660 con 0x7f3284138d80 2023-09-30T22:35:27.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.256+0000 7f8faeffd700 1 -- 172.21.15.59:0/2719886155 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8fb001c400 con 0x7f8fb8134260 2023-09-30T22:35:27.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.257+0000 7f3280ff9700 1 -- 172.21.15.59:0/37053045 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f327c01c400 con 0x7f3284138d80 2023-09-30T22:35:27.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.480+0000 7f328a411700 1 -- 172.21.15.59:0/37053045 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f32840747f0 con 0x7f3284138d80 2023-09-30T22:35:27.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.480+0000 7f3280ff9700 1 -- 172.21.15.59:0/37053045 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f327c0117b0 con 0x7f3284138d80 2023-09-30T22:35:27.481 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.480+0000 7f8fc07a1700 1 -- 172.21.15.59:0/2719886155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8fb806d080 con 0x7f8fb8134260 2023-09-30T22:35:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.481+0000 7f8faeffd700 1 -- 172.21.15.59:0/2719886155 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8fb002c020 con 0x7f8fb8134260 2023-09-30T22:35:27.482 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.482+0000 7f328a411700 1 -- 172.21.15.59:0/37053045 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3284138d80 msgr2=0x7f328412d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.482+0000 7f328a411700 1 --2- 172.21.15.59:0/37053045 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3284138d80 0x7f328412d1b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f327c014040 tx=0x7f327c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.483+0000 7f328a411700 1 -- 172.21.15.59:0/37053045 shutdown_connections 2023-09-30T22:35:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.483+0000 7f328a411700 1 --2- 172.21.15.59:0/37053045 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3284138d80 0x7f328412d1b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.483+0000 7f328a411700 1 --2- 172.21.15.59:0/37053045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328409d630 0x7f328412c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.483+0000 7f328a411700 1 --2- 172.21.15.59:0/37053045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32840a0a30 0x7f328412cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.483+0000 7f328a411700 1 -- 172.21.15.59:0/37053045 >> 172.21.15.59:0/37053045 conn(0x7f32840a3050 msgr2=0x7f32840a4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.483+0000 7f328a411700 1 -- 172.21.15.59:0/37053045 shutdown_connections 2023-09-30T22:35:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.483+0000 7f328a411700 1 -- 172.21.15.59:0/37053045 wait complete. 2023-09-30T22:35:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.483+0000 7f8fc07a1700 1 -- 172.21.15.59:0/2719886155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb8134260 msgr2=0x7f8fb811cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.483+0000 7f8fc07a1700 1 --2- 172.21.15.59:0/2719886155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb8134260 0x7f8fb811cbc0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000b370 tx=0x7f8fb0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.483+0000 7f8fc07a1700 1 -- 172.21.15.59:0/2719886155 shutdown_connections 2023-09-30T22:35:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.483+0000 7f8fc07a1700 1 --2- 172.21.15.59:0/2719886155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8fb8133420 0x7f8fb811e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.483+0000 7f8fc07a1700 1 --2- 172.21.15.59:0/2719886155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb8134260 0x7f8fb811cbc0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.483+0000 7f8fc07a1700 1 --2- 172.21.15.59:0/2719886155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb8133e30 0x7f8fb811e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.483+0000 7f8fc07a1700 1 -- 172.21.15.59:0/2719886155 >> 172.21.15.59:0/2719886155 conn(0x7f8fb80a4210 msgr2=0x7f8fb80a3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.484+0000 7f8fc07a1700 1 -- 172.21.15.59:0/2719886155 shutdown_connections 2023-09-30T22:35:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:27.484+0000 7f8fc07a1700 1 -- 172.21.15.59:0/2719886155 wait complete. 2023-09-30T22:35:27.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:27.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:28.008 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:28.046 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:28.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.155+0000 7fb2c7d1e700 1 Processor -- start 2023-09-30T22:35:28.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.155+0000 7fb2c7d1e700 1 -- start start 2023-09-30T22:35:28.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.155+0000 7fb2c7d1e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2c00a0a30 0x7fb2c00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.155+0000 7fb2c7d1e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2c009d630 0x7fb2c00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.155+0000 7fb2c7d1e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2c0133930 0x7fb2c0133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.155+0000 7fb2c7d1e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c00a2a70 con 0x7fb2c00a0a30 2023-09-30T22:35:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.155+0000 7fb2c7d1e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00a01d0 con 0x7fb2c009d630 2023-09-30T22:35:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.155+0000 7fb2c7d1e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c009e2b0 con 0x7fb2c0133930 2023-09-30T22:35:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.155+0000 7fb2c5aba700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2c00a0a30 0x7fb2c00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.155+0000 7fb2c52b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2c009d630 0x7fb2c00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.156+0000 7fb2c5aba700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2c00a0a30 0x7fb2c00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37706/0 (socket says 172.21.15.59:37706) 2023-09-30T22:35:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.156+0000 7fb2c5aba700 1 -- 172.21.15.59:0/1712072932 learned_addr learned my addr 172.21.15.59:0/1712072932 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.156+0000 7fb2c52b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2c009d630 0x7fb2c00a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46754/0 (socket says 172.21.15.59:46754) 2023-09-30T22:35:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.156+0000 7fb2c62bb700 1 --2- 172.21.15.59:0/1712072932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2c0133930 0x7fb2c0133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.156+0000 7fb2c5aba700 1 -- 172.21.15.59:0/1712072932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2c0133930 msgr2=0x7fb2c0133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.156+0000 7fb2c5aba700 1 --2- 172.21.15.59:0/1712072932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2c0133930 0x7fb2c0133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.156+0000 7fb2c5aba700 1 -- 172.21.15.59:0/1712072932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2c009d630 msgr2=0x7fb2c00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.156+0000 7fb2c5aba700 1 --2- 172.21.15.59:0/1712072932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2c009d630 0x7fb2c00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.156+0000 7fb2c5aba700 1 -- 172.21.15.59:0/1712072932 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c009dc50 con 0x7fb2c00a0a30 2023-09-30T22:35:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.156+0000 7fb2c52b9700 1 --2- 172.21.15.59:0/1712072932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2c009d630 0x7fb2c00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.156+0000 7fb2c5aba700 1 --2- 172.21.15.59:0/1712072932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2c00a0a30 0x7fb2c00a0e00 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80098f0 tx=0x7fb2b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f3380b99feec1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.156+0000 7fb2c4ab8700 1 -- 172.21.15.59:0/1712072932 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8011830 con 0x7fb2c00a0a30 2023-09-30T22:35:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.156+0000 7fb2c4ab8700 1 -- 172.21.15.59:0/1712072932 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b8011990 con 0x7fb2c00a0a30 2023-09-30T22:35:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.156+0000 7fb2c4ab8700 1 -- 172.21.15.59:0/1712072932 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8011d20 con 0x7fb2c00a0a30 2023-09-30T22:35:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.157+0000 7fb2c7d1e700 1 -- 172.21.15.59:0/1712072932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2c00a0a30 msgr2=0x7fb2c00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.157+0000 7fb2c7d1e700 1 --2- 172.21.15.59:0/1712072932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2c00a0a30 0x7fb2c00a0e00 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80098f0 tx=0x7fb2b8009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:28.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.157+0000 7fb2c7d1e700 1 -- 172.21.15.59:0/1712072932 shutdown_connections 2023-09-30T22:35:28.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.157+0000 7fb2c7d1e700 1 --2- 172.21.15.59:0/1712072932 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2c0133930 0x7fb2c0133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.157+0000 7fb2c7d1e700 1 --2- 172.21.15.59:0/1712072932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2c00a0a30 0x7fb2c00a0e00 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.157+0000 7fb2c7d1e700 1 --2- 172.21.15.59:0/1712072932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2c009d630 0x7fb2c00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.157+0000 7fb2c7d1e700 1 -- 172.21.15.59:0/1712072932 >> 172.21.15.59:0/1712072932 conn(0x7fb2c00a3050 msgr2=0x7fb2c00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:28.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.157+0000 7fb2c7d1e700 1 -- 172.21.15.59:0/1712072932 shutdown_connections 2023-09-30T22:35:28.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.157+0000 7fb2c7d1e700 1 -- 172.21.15.59:0/1712072932 wait complete. 2023-09-30T22:35:28.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.159+0000 7fb2c7d1e700 1 Processor -- start 2023-09-30T22:35:28.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.159+0000 7fb2c7d1e700 1 -- start start 2023-09-30T22:35:28.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.159+0000 7fb2c7d1e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2c009d630 0x7fb2c011f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.159+0000 7fb2c7d1e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2c00a0a30 0x7fb2c011f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.159+0000 7fb2c7d1e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2c0133930 0x7fb2c01c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.159+0000 7fb2c7d1e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c011edd0 con 0x7fb2c0133930 2023-09-30T22:35:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.159+0000 7fb2c7d1e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c011fd40 con 0x7fb2c00a0a30 2023-09-30T22:35:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.159+0000 7fb2c7d1e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c0121de0 con 0x7fb2c009d630 2023-09-30T22:35:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.159+0000 7fb2c52b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2c00a0a30 0x7fb2c011f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.159+0000 7fb2c5aba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2c009d630 0x7fb2c011f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.159+0000 7fb2c52b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2c00a0a30 0x7fb2c011f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46758/0 (socket says 172.21.15.59:46758) 2023-09-30T22:35:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.159+0000 7fb2c52b9700 1 -- 172.21.15.59:0/2300331615 learned_addr learned my addr 172.21.15.59:0/2300331615 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.160+0000 7fb2c62bb700 1 --2- 172.21.15.59:0/2300331615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2c0133930 0x7fb2c01c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.160+0000 7fb2c52b9700 1 -- 172.21.15.59:0/2300331615 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2c009d630 msgr2=0x7fb2c011f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.160+0000 7fb2c52b9700 1 --2- 172.21.15.59:0/2300331615 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2c009d630 0x7fb2c011f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.160+0000 7fb2c52b9700 1 -- 172.21.15.59:0/2300331615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2c0133930 msgr2=0x7fb2c01c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.160+0000 7fb2c52b9700 1 --2- 172.21.15.59:0/2300331615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2c0133930 0x7fb2c01c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.160+0000 7fb2c52b9700 1 -- 172.21.15.59:0/2300331615 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b40094a0 con 0x7fb2c00a0a30 2023-09-30T22:35:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.160+0000 7fb2c5aba700 1 --2- 172.21.15.59:0/2300331615 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2c009d630 0x7fb2c011f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.160+0000 7fb2c52b9700 1 --2- 172.21.15.59:0/2300331615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2c00a0a30 0x7fb2c011f800 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400ebe0 tx=0x7fb2b400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.160+0000 7fb2be7fc700 1 -- 172.21.15.59:0/2300331615 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b400c850 con 0x7fb2c00a0a30 2023-09-30T22:35:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.160+0000 7fb2be7fc700 1 -- 172.21.15.59:0/2300331615 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b400c9b0 con 0x7fb2c00a0a30 2023-09-30T22:35:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.160+0000 7fb2c7d1e700 1 -- 172.21.15.59:0/2300331615 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b8009550 con 0x7fb2c00a0a30 2023-09-30T22:35:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.160+0000 7fb2be7fc700 1 -- 172.21.15.59:0/2300331615 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b400cd40 con 0x7fb2c00a0a30 2023-09-30T22:35:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.160+0000 7fb2c7d1e700 1 -- 172.21.15.59:0/2300331615 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c00a0410 con 0x7fb2c00a0a30 2023-09-30T22:35:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.161+0000 7fb2be7fc700 1 -- 172.21.15.59:0/2300331615 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2b4013470 con 0x7fb2c00a0a30 2023-09-30T22:35:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.161+0000 7fb2be7fc700 1 -- 172.21.15.59:0/2300331615 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb2b403f800 con 0x7fb2c00a0a30 2023-09-30T22:35:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.162+0000 7fb2c7d1e700 1 -- 172.21.15.59:0/2300331615 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c01222c0 con 0x7fb2c00a0a30 2023-09-30T22:35:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.166+0000 7fb2be7fc700 1 -- 172.21.15.59:0/2300331615 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2c01222c0 con 0x7fb2c00a0a30 2023-09-30T22:35:28.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.192+0000 7f40c66d7700 1 Processor -- start 2023-09-30T22:35:28.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.193+0000 7f40c66d7700 1 -- start start 2023-09-30T22:35:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.193+0000 7f40c66d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c009d630 0x7f40c00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.193+0000 7f40c66d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c0138d80 0x7f40c013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.193+0000 7f40c66d7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c00a2a70 con 0x7f40c00a0a30 2023-09-30T22:35:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.193+0000 7f40c66d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c00a01d0 con 0x7f40c0138d80 2023-09-30T22:35:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.193+0000 7f40c66d7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40c009e2b0 con 0x7f40c009d630 2023-09-30T22:35:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.193+0000 7f40c4c74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c0138d80 0x7f40c013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.193+0000 7f40bffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f40c00a0a30 0x7f40c00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40136/0 (socket says 172.21.15.59:40136) 2023-09-30T22:35:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.193+0000 7f40bffff700 1 -- 172.21.15.59:0/1365575673 learned_addr learned my addr 172.21.15.59:0/1365575673 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.193+0000 7f40bf7fe700 1 --2- 172.21.15.59:0/1365575673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c009d630 0x7f40c00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.194+0000 7f40c4c74700 1 -- 172.21.15.59:0/1365575673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c009d630 msgr2=0x7f40c00a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.194+0000 7f40c4c74700 1 --2- 172.21.15.59:0/1365575673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c009d630 0x7f40c00a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.194+0000 7f40c4c74700 1 -- 172.21.15.59:0/1365575673 >> v1:172.21.15.59:6789/0 conn(0x7f40c00a0a30 legacy=0x7f40c00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.194+0000 7f40beffd700 1 -- 172.21.15.59:0/1365575673 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830051217 0 0) 0x7f40c00a2a70 con 0x7f40c00a0a30 2023-09-30T22:35:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.194+0000 7f40c4c74700 1 -- 172.21.15.59:0/1365575673 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c009dc50 con 0x7f40c0138d80 2023-09-30T22:35:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.194+0000 7f40c4c74700 1 --2- 172.21.15.59:0/1365575673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c0138d80 0x7f40c013b160 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009dc0 tx=0x7f40b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59e786a8f6d6caab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.194+0000 7f40beffd700 1 -- 172.21.15.59:0/1365575673 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b800e070 con 0x7f40c0138d80 2023-09-30T22:35:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.194+0000 7f40beffd700 1 -- 172.21.15.59:0/1365575673 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b800bb20 con 0x7f40c0138d80 2023-09-30T22:35:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.194+0000 7f40beffd700 1 -- 172.21.15.59:0/1365575673 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8012430 con 0x7f40c0138d80 2023-09-30T22:35:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.195+0000 7f40c66d7700 1 -- 172.21.15.59:0/1365575673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c0138d80 msgr2=0x7f40c013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.195+0000 7f40c66d7700 1 --2- 172.21.15.59:0/1365575673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c0138d80 0x7f40c013b160 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009dc0 tx=0x7f40b800b330 comp rx=0 tx=0).stop 2023-09-30T22:35:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.195+0000 7f40c66d7700 1 -- 172.21.15.59:0/1365575673 shutdown_connections 2023-09-30T22:35:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.195+0000 7f40c66d7700 1 --2- 172.21.15.59:0/1365575673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c0138d80 0x7f40c013b160 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.195+0000 7f40c66d7700 1 --2- 172.21.15.59:0/1365575673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c009d630 0x7f40c00a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.195+0000 7f40c66d7700 1 -- 172.21.15.59:0/1365575673 >> 172.21.15.59:0/1365575673 conn(0x7f40c00a3050 msgr2=0x7f40c00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.195+0000 7f40c66d7700 1 -- 172.21.15.59:0/1365575673 shutdown_connections 2023-09-30T22:35:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.195+0000 7f40c66d7700 1 -- 172.21.15.59:0/1365575673 wait complete. 2023-09-30T22:35:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.196+0000 7f40c66d7700 1 Processor -- start 2023-09-30T22:35:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.196+0000 7f40c66d7700 1 -- start start 2023-09-30T22:35:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.196+0000 7f40c66d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c009d630 0x7f40c0133860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.196+0000 7f40c66d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c00a0a30 0x7f40c0133da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.196+0000 7f40c66d7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40c0138d80 0x7f40c01342e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.196+0000 7f40c66d7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c0135c40 con 0x7f40c0138d80 2023-09-30T22:35:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.196+0000 7f40c66d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c0137300 con 0x7f40c009d630 2023-09-30T22:35:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.196+0000 7f40c66d7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40c0137ed0 con 0x7f40c00a0a30 2023-09-30T22:35:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.196+0000 7f40bf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c00a0a30 0x7f40c0133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40c4c74700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40c0138d80 0x7f40c01342e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40bf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c00a0a30 0x7f40c0133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56838/0 (socket says 172.21.15.59:56838) 2023-09-30T22:35:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40bf7fe700 1 -- 172.21.15.59:0/1242139844 learned_addr learned my addr 172.21.15.59:0/1242139844 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40bffff700 1 --2- 172.21.15.59:0/1242139844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c009d630 0x7f40c0133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40c4c74700 1 -- 172.21.15.59:0/1242139844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c00a0a30 msgr2=0x7f40c0133da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40c4c74700 1 --2- 172.21.15.59:0/1242139844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c00a0a30 0x7f40c0133da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40c4c74700 1 -- 172.21.15.59:0/1242139844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c009d630 msgr2=0x7f40c0133860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40c4c74700 1 --2- 172.21.15.59:0/1242139844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c009d630 0x7f40c0133860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40c4c74700 1 -- 172.21.15.59:0/1242139844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b8009a70 con 0x7f40c0138d80 2023-09-30T22:35:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40bf7fe700 1 --2- 172.21.15.59:0/1242139844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c00a0a30 0x7f40c0133da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40bffff700 1 --2- 172.21.15.59:0/1242139844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c009d630 0x7f40c0133860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40c4c74700 1 --2- 172.21.15.59:0/1242139844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40c0138d80 0x7f40c01342e0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f40b8016000 tx=0x7f40b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40bcff9700 1 -- 172.21.15.59:0/1242139844 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8012430 con 0x7f40c0138d80 2023-09-30T22:35:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40bcff9700 1 -- 172.21.15.59:0/1242139844 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b8020070 con 0x7f40c0138d80 2023-09-30T22:35:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40bcff9700 1 -- 172.21.15.59:0/1242139844 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8004280 con 0x7f40c0138d80 2023-09-30T22:35:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40c66d7700 1 -- 172.21.15.59:0/1242139844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c0136d20 con 0x7f40c0138d80 2023-09-30T22:35:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.197+0000 7f40c66d7700 1 -- 172.21.15.59:0/1242139844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c0138a70 con 0x7f40c0138d80 2023-09-30T22:35:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.198+0000 7f40bcff9700 1 -- 172.21.15.59:0/1242139844 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40b80043e0 con 0x7f40c0138d80 2023-09-30T22:35:28.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.198+0000 7f40bcff9700 1 -- 172.21.15.59:0/1242139844 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f40b8022070 con 0x7f40c0138d80 2023-09-30T22:35:28.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.199+0000 7f40c66d7700 1 -- 172.21.15.59:0/1242139844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c00747f0 con 0x7f40c0138d80 2023-09-30T22:35:28.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.203+0000 7f40bcff9700 1 -- 172.21.15.59:0/1242139844 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40b801b400 con 0x7f40c0138d80 2023-09-30T22:35:28.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.375+0000 7fb2c7d1e700 1 -- 172.21.15.59:0/2300331615 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb2c01222c0 con 0x7fb2c00a0a30 2023-09-30T22:35:28.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.377+0000 7fb2be7fc700 1 -- 172.21.15.59:0/2300331615 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2c01222c0 con 0x7fb2c00a0a30 2023-09-30T22:35:28.379 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:28.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.380+0000 7fb2c7d1e700 1 -- 172.21.15.59:0/2300331615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2c00a0a30 msgr2=0x7fb2c011f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.380+0000 7fb2c7d1e700 1 --2- 172.21.15.59:0/2300331615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2c00a0a30 0x7fb2c011f800 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400ebe0 tx=0x7fb2b400eef0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.380+0000 7fb2c7d1e700 1 -- 172.21.15.59:0/2300331615 shutdown_connections 2023-09-30T22:35:28.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.380+0000 7fb2c7d1e700 1 --2- 172.21.15.59:0/2300331615 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2c009d630 0x7fb2c011f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.380+0000 7fb2c7d1e700 1 --2- 172.21.15.59:0/2300331615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2c0133930 0x7fb2c01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.380+0000 7fb2c7d1e700 1 --2- 172.21.15.59:0/2300331615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2c00a0a30 0x7fb2c011f800 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.380+0000 7fb2c7d1e700 1 -- 172.21.15.59:0/2300331615 >> 172.21.15.59:0/2300331615 conn(0x7fb2c00a3050 msgr2=0x7fb2c01bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.380+0000 7fb2c7d1e700 1 -- 172.21.15.59:0/2300331615 shutdown_connections 2023-09-30T22:35:28.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.380+0000 7fb2c7d1e700 1 -- 172.21.15.59:0/2300331615 wait complete. 2023-09-30T22:35:28.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:28.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.415+0000 7f40c66d7700 1 -- 172.21.15.59:0/1242139844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f40c0072980 con 0x7f40c0138d80 2023-09-30T22:35:28.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.415+0000 7f40bcff9700 1 -- 172.21.15.59:0/1242139844 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40b801a700 con 0x7f40c0138d80 2023-09-30T22:35:28.417 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.418+0000 7f40c66d7700 1 -- 172.21.15.59:0/1242139844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40c0138d80 msgr2=0x7f40c01342e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.418+0000 7f40c66d7700 1 --2- 172.21.15.59:0/1242139844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40c0138d80 0x7f40c01342e0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f40b8016000 tx=0x7f40b8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.418+0000 7f40c66d7700 1 -- 172.21.15.59:0/1242139844 shutdown_connections 2023-09-30T22:35:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.418+0000 7f40c66d7700 1 --2- 172.21.15.59:0/1242139844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40c0138d80 0x7f40c01342e0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.418+0000 7f40c66d7700 1 --2- 172.21.15.59:0/1242139844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40c009d630 0x7f40c0133860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.418+0000 7f40c66d7700 1 --2- 172.21.15.59:0/1242139844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40c00a0a30 0x7f40c0133da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.418+0000 7f40c66d7700 1 -- 172.21.15.59:0/1242139844 >> 172.21.15.59:0/1242139844 conn(0x7f40c00a3050 msgr2=0x7f40c009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:28.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.418+0000 7f40c66d7700 1 -- 172.21.15.59:0/1242139844 shutdown_connections 2023-09-30T22:35:28.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.418+0000 7f40c66d7700 1 -- 172.21.15.59:0/1242139844 wait complete. 2023-09-30T22:35:28.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:28.501 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:28.502 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:28.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.651+0000 7f8f74df4700 1 Processor -- start 2023-09-30T22:35:28.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.651+0000 7f8f74df4700 1 -- start start 2023-09-30T22:35:28.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.651+0000 7f0de5b47700 1 Processor -- start 2023-09-30T22:35:28.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.651+0000 7f0de5b47700 1 -- start start 2023-09-30T22:35:28.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f0de5b47700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de00a0a30 0x7f0de00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f0de5b47700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de0138d80 0x7f0de013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f0de5b47700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de00a2a70 con 0x7f0de009d630 2023-09-30T22:35:28.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f0de5b47700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de00a01d0 con 0x7f0de00a0a30 2023-09-30T22:35:28.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f0de5b47700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0de009e2b0 con 0x7f0de0138d80 2023-09-30T22:35:28.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f8f74df4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f701338a0 0x7f8f70133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f8f74df4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f7009e930 0x7f8f7013b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f8f74df4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7006ef30 con 0x7f8f7009de50 2023-09-30T22:35:28.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f8f74df4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7006fef0 con 0x7f8f701338a0 2023-09-30T22:35:28.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f8f74df4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f701334b0 con 0x7f8f7009e930 2023-09-30T22:35:28.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f8f6ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f7009e930 0x7f8f7013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f8f6dd9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8f7009de50 0x7f8f7009e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40166/0 (socket says 172.21.15.59:40166) 2023-09-30T22:35:28.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f8f6dd9b700 1 -- 172.21.15.59:0/4220930448 learned_addr learned my addr 172.21.15.59:0/4220930448 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:28.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f0ddffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de0138d80 0x7f0de013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f8f6e59c700 1 --2- 172.21.15.59:0/4220930448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f701338a0 0x7f8f70133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f0ddeffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0de009d630 0x7f0de00a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40152/0 (socket says 172.21.15.59:40152) 2023-09-30T22:35:28.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f0ddffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de0138d80 0x7f0de013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56854/0 (socket says 172.21.15.59:56854) 2023-09-30T22:35:28.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f0ddeffd700 1 -- 172.21.15.59:0/309882093 learned_addr learned my addr 172.21.15.59:0/309882093 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:28.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.652+0000 7f0ddf7fe700 1 --2- 172.21.15.59:0/309882093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de00a0a30 0x7f0de00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f8f6d59a700 1 -- 172.21.15.59:0/4220930448 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124827137 0 0) 0x7f8f7006ef30 con 0x7f8f7009de50 2023-09-30T22:35:28.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f8f6d59a700 1 -- 172.21.15.59:0/4220930448 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f580035b0 con 0x7f8f7009de50 2023-09-30T22:35:28.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f0dde7fc700 1 -- 172.21.15.59:0/309882093 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928736781 0 0) 0x7f0de00a2a70 con 0x7f0de009d630 2023-09-30T22:35:28.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f0dde7fc700 1 -- 172.21.15.59:0/309882093 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dc80035b0 con 0x7f0de009d630 2023-09-30T22:35:28.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f0ddffff700 1 -- 172.21.15.59:0/309882093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de00a0a30 msgr2=0x7f0de00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:28.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f0ddffff700 1 --2- 172.21.15.59:0/309882093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de00a0a30 0x7f0de00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f0ddffff700 1 -- 172.21.15.59:0/309882093 >> v1:172.21.15.59:6789/0 conn(0x7f0de009d630 legacy=0x7f0de00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f0ddffff700 1 -- 172.21.15.59:0/309882093 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de009dc50 con 0x7f0de0138d80 2023-09-30T22:35:28.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f0ddf7fe700 1 --2- 172.21.15.59:0/309882093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de00a0a30 0x7f0de00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:28.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f8f6e59c700 1 -- 172.21.15.59:0/4220930448 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f7009e930 msgr2=0x7f8f7013b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:28.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f8f6e59c700 1 --2- 172.21.15.59:0/4220930448 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f7009e930 0x7f8f7013b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f8f6e59c700 1 -- 172.21.15.59:0/4220930448 >> v1:172.21.15.59:6789/0 conn(0x7f8f7009de50 legacy=0x7f8f7009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f8f6e59c700 1 -- 172.21.15.59:0/4220930448 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7006fc30 con 0x7f8f701338a0 2023-09-30T22:35:28.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f0ddffff700 1 --2- 172.21.15.59:0/309882093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de0138d80 0x7f0de013b160 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009dc0 tx=0x7f0dd800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3332eeb6dce15db7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:28.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f8f6e59c700 1 --2- 172.21.15.59:0/4220930448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f701338a0 0x7f8f70133c70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009870 tx=0x7f8f60009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d7910d5f89cbfbe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:28.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f0dde7fc700 1 -- 172.21.15.59:0/309882093 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd800e070 con 0x7f0de0138d80 2023-09-30T22:35:28.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f0dde7fc700 1 -- 172.21.15.59:0/309882093 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd800bae0 con 0x7f0de0138d80 2023-09-30T22:35:28.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f0dde7fc700 1 -- 172.21.15.59:0/309882093 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd800be50 con 0x7f0de0138d80 2023-09-30T22:35:28.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f8f6d59a700 1 -- 172.21.15.59:0/4220930448 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60004230 con 0x7f8f701338a0 2023-09-30T22:35:28.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f8f6d59a700 1 -- 172.21.15.59:0/4220930448 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f60004390 con 0x7f8f701338a0 2023-09-30T22:35:28.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.653+0000 7f8f6d59a700 1 -- 172.21.15.59:0/4220930448 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f600036a0 con 0x7f8f701338a0 2023-09-30T22:35:28.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f0de5b47700 1 -- 172.21.15.59:0/309882093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de0138d80 msgr2=0x7f0de013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f0de5b47700 1 --2- 172.21.15.59:0/309882093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de0138d80 0x7f0de013b160 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009dc0 tx=0x7f0dd800b330 comp rx=0 tx=0).stop 2023-09-30T22:35:28.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f0de5b47700 1 -- 172.21.15.59:0/309882093 shutdown_connections 2023-09-30T22:35:28.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f0de5b47700 1 --2- 172.21.15.59:0/309882093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de0138d80 0x7f0de013b160 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f8f74df4700 1 -- 172.21.15.59:0/4220930448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f701338a0 msgr2=0x7f8f70133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f8f74df4700 1 --2- 172.21.15.59:0/4220930448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f701338a0 0x7f8f70133c70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009870 tx=0x7f8f60009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:28.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f0de5b47700 1 --2- 172.21.15.59:0/309882093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de00a0a30 0x7f0de00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f0de5b47700 1 -- 172.21.15.59:0/309882093 >> 172.21.15.59:0/309882093 conn(0x7f0de00a3050 msgr2=0x7f0de00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:28.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f0de5b47700 1 -- 172.21.15.59:0/309882093 shutdown_connections 2023-09-30T22:35:28.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f0de5b47700 1 -- 172.21.15.59:0/309882093 wait complete. 2023-09-30T22:35:28.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f8f74df4700 1 -- 172.21.15.59:0/4220930448 shutdown_connections 2023-09-30T22:35:28.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f8f74df4700 1 --2- 172.21.15.59:0/4220930448 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f7009e930 0x7f8f7013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f8f74df4700 1 --2- 172.21.15.59:0/4220930448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f701338a0 0x7f8f70133c70 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f8f74df4700 1 -- 172.21.15.59:0/4220930448 >> 172.21.15.59:0/4220930448 conn(0x7f8f700a2aa0 msgr2=0x7f8f700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:28.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f8f74df4700 1 -- 172.21.15.59:0/4220930448 shutdown_connections 2023-09-30T22:35:28.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.654+0000 7f8f74df4700 1 -- 172.21.15.59:0/4220930448 wait complete. 2023-09-30T22:35:28.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.655+0000 7f0de5b47700 1 Processor -- start 2023-09-30T22:35:28.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f8f74df4700 1 Processor -- start 2023-09-30T22:35:28.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f0de5b47700 1 -- start start 2023-09-30T22:35:28.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f8f74df4700 1 -- start start 2023-09-30T22:35:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f0de5b47700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de009d630 0x7f0de012c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f0de5b47700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de00a0a30 0x7f0de012c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f8f74df4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f7009de50 0x7f8f7011d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f8f74df4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f7009e930 0x7f8f7011daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f0de5b47700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0de0138d80 0x7f0de012ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f0de5b47700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de012d3c0 con 0x7f0de0138d80 2023-09-30T22:35:28.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f8f74df4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f701338a0 0x7f8f7011dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:28.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f8f74df4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f70121a40 con 0x7f8f7009de50 2023-09-30T22:35:28.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f0de5b47700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de012e9b0 con 0x7f0de009d630 2023-09-30T22:35:28.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f0de5b47700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0de012fb70 con 0x7f0de00a0a30 2023-09-30T22:35:28.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f8f74df4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f70120da0 con 0x7f8f701338a0 2023-09-30T22:35:28.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f8f74df4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7011f280 con 0x7f8f7009e930 2023-09-30T22:35:28.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f0ddeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de00a0a30 0x7f0de012c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f0ddeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de00a0a30 0x7f0de012c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56882/0 (socket says 172.21.15.59:56882) 2023-09-30T22:35:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f0ddeffd700 1 -- 172.21.15.59:0/2603878917 learned_addr learned my addr 172.21.15.59:0/2603878917 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f0ddf7fe700 1 --2- 172.21.15.59:0/2603878917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de009d630 0x7f0de012c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f8f6ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f701338a0 0x7f8f7011dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f8f6dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f7009e930 0x7f8f7011daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f8f6ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f701338a0 0x7f8f7011dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46812/0 (socket says 172.21.15.59:46812) 2023-09-30T22:35:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.656+0000 7f8f6ed9d700 1 -- 172.21.15.59:0/3203118056 learned_addr learned my addr 172.21.15.59:0/3203118056 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f8f6ed9d700 1 -- 172.21.15.59:0/3203118056 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f7009e930 msgr2=0x7f8f7011daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f8f6ed9d700 1 --2- 172.21.15.59:0/3203118056 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f7009e930 0x7f8f7011daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f8f6ed9d700 1 -- 172.21.15.59:0/3203118056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f7009de50 msgr2=0x7f8f7011d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f8f6ed9d700 1 --2- 172.21.15.59:0/3203118056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f7009de50 0x7f8f7011d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f8f6ed9d700 1 -- 172.21.15.59:0/3203118056 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f600094a0 con 0x7f8f701338a0 2023-09-30T22:35:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f0ddf7fe700 1 -- 172.21.15.59:0/2603878917 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de00a0a30 msgr2=0x7f0de012c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f0ddf7fe700 1 --2- 172.21.15.59:0/2603878917 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de00a0a30 0x7f0de012c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f0ddf7fe700 1 -- 172.21.15.59:0/2603878917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0de0138d80 msgr2=0x7f0de012ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f0ddf7fe700 1 --2- 172.21.15.59:0/2603878917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0de0138d80 0x7f0de012ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f0ddf7fe700 1 -- 172.21.15.59:0/2603878917 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd00094a0 con 0x7f0de009d630 2023-09-30T22:35:28.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f8f6ed9d700 1 --2- 172.21.15.59:0/3203118056 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f701338a0 0x7f8f7011dfe0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009dd0 tx=0x7f8f6800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:28.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f0ddf7fe700 1 --2- 172.21.15.59:0/2603878917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de009d630 0x7f0de012c230 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000ea10 tx=0x7f0dd000ed20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:28.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f8f5effd700 1 -- 172.21.15.59:0/3203118056 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68009c40 con 0x7f8f701338a0 2023-09-30T22:35:28.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f8f5effd700 1 -- 172.21.15.59:0/3203118056 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6800f040 con 0x7f8f701338a0 2023-09-30T22:35:28.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f8f74df4700 1 -- 172.21.15.59:0/3203118056 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f700a0eb0 con 0x7f8f701338a0 2023-09-30T22:35:28.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f0dc7fff700 1 -- 172.21.15.59:0/2603878917 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000c850 con 0x7f0de009d630 2023-09-30T22:35:28.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f8f5effd700 1 -- 172.21.15.59:0/3203118056 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68014480 con 0x7f8f701338a0 2023-09-30T22:35:28.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f0dc7fff700 1 -- 172.21.15.59:0/2603878917 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd000c9b0 con 0x7f0de009d630 2023-09-30T22:35:28.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f0de5b47700 1 -- 172.21.15.59:0/2603878917 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd8009a70 con 0x7f0de009d630 2023-09-30T22:35:28.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f0dc7fff700 1 -- 172.21.15.59:0/2603878917 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000cd60 con 0x7f0de009d630 2023-09-30T22:35:28.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f8f74df4700 1 -- 172.21.15.59:0/3203118056 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f70121080 con 0x7f8f701338a0 2023-09-30T22:35:28.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.657+0000 7f0de5b47700 1 -- 172.21.15.59:0/2603878917 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de00a0410 con 0x7f0de009d630 2023-09-30T22:35:28.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.658+0000 7f8f5effd700 1 -- 172.21.15.59:0/3203118056 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f680145e0 con 0x7f8f701338a0 2023-09-30T22:35:28.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.658+0000 7f0de5b47700 1 -- 172.21.15.59:0/2603878917 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de009c8e0 con 0x7f0de009d630 2023-09-30T22:35:28.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.659+0000 7f0dc7fff700 1 -- 172.21.15.59:0/2603878917 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0dd0013470 con 0x7f0de009d630 2023-09-30T22:35:28.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.659+0000 7f8f5effd700 1 -- 172.21.15.59:0/3203118056 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f6803ff00 con 0x7f8f701338a0 2023-09-30T22:35:28.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.659+0000 7f8f74df4700 1 -- 172.21.15.59:0/3203118056 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f70120ee0 con 0x7f8f701338a0 2023-09-30T22:35:28.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.659+0000 7f0dc7fff700 1 -- 172.21.15.59:0/2603878917 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0dd003f7c0 con 0x7f0de009d630 2023-09-30T22:35:28.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.664+0000 7f0dc7fff700 1 -- 172.21.15.59:0/2603878917 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0dd00232f0 con 0x7f0de009d630 2023-09-30T22:35:28.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.672+0000 7f8f5effd700 1 -- 172.21.15.59:0/3203118056 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f70120ee0 con 0x7f8f701338a0 2023-09-30T22:35:28.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.874+0000 7f0de5b47700 1 -- 172.21.15.59:0/2603878917 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0de00a4920 con 0x7f0de009d630 2023-09-30T22:35:28.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.875+0000 7f0dc7fff700 1 -- 172.21.15.59:0/2603878917 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0dd0021070 con 0x7f0de009d630 2023-09-30T22:35:28.876 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:28.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.877+0000 7f0de5b47700 1 -- 172.21.15.59:0/2603878917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de009d630 msgr2=0x7f0de012c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.877+0000 7f0de5b47700 1 --2- 172.21.15.59:0/2603878917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de009d630 0x7f0de012c230 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000ea10 tx=0x7f0dd000ed20 comp rx=0 tx=0).stop 2023-09-30T22:35:28.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.877+0000 7f0de5b47700 1 -- 172.21.15.59:0/2603878917 shutdown_connections 2023-09-30T22:35:28.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.877+0000 7f0de5b47700 1 --2- 172.21.15.59:0/2603878917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0de0138d80 0x7f0de012ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.877+0000 7f0de5b47700 1 --2- 172.21.15.59:0/2603878917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de009d630 0x7f0de012c230 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.877+0000 7f0de5b47700 1 --2- 172.21.15.59:0/2603878917 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de00a0a30 0x7f0de012c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.877+0000 7f0de5b47700 1 -- 172.21.15.59:0/2603878917 >> 172.21.15.59:0/2603878917 conn(0x7f0de00a3050 msgr2=0x7f0de009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:28.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.877+0000 7f0de5b47700 1 -- 172.21.15.59:0/2603878917 shutdown_connections 2023-09-30T22:35:28.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.877+0000 7f0de5b47700 1 -- 172.21.15.59:0/2603878917 wait complete. 2023-09-30T22:35:28.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.879+0000 7f8f74df4700 1 -- 172.21.15.59:0/3203118056 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8f70120ee0 con 0x7f8f701338a0 2023-09-30T22:35:28.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.879+0000 7f8f5effd700 1 -- 172.21.15.59:0/3203118056 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f70120ee0 con 0x7f8f701338a0 2023-09-30T22:35:28.881 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:28.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.882+0000 7f8f74df4700 1 -- 172.21.15.59:0/3203118056 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f701338a0 msgr2=0x7f8f7011dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:28.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.882+0000 7f8f74df4700 1 --2- 172.21.15.59:0/3203118056 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f701338a0 0x7f8f7011dfe0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009dd0 tx=0x7f8f6800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.882+0000 7f8f74df4700 1 -- 172.21.15.59:0/3203118056 shutdown_connections 2023-09-30T22:35:28.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.882+0000 7f8f74df4700 1 --2- 172.21.15.59:0/3203118056 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f701338a0 0x7f8f7011dfe0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.882+0000 7f8f74df4700 1 --2- 172.21.15.59:0/3203118056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f7009de50 0x7f8f7011d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.882+0000 7f8f74df4700 1 --2- 172.21.15.59:0/3203118056 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f7009e930 0x7f8f7011daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:28.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.882+0000 7f8f74df4700 1 -- 172.21.15.59:0/3203118056 >> 172.21.15.59:0/3203118056 conn(0x7f8f700a2aa0 msgr2=0x7f8f701bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:28.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.882+0000 7f8f74df4700 1 -- 172.21.15.59:0/3203118056 shutdown_connections 2023-09-30T22:35:28.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:28.882+0000 7f8f74df4700 1 -- 172.21.15.59:0/3203118056 wait complete. 2023-09-30T22:35:28.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:28.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:29.396 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:29.433 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.543+0000 7f7937141700 1 Processor -- start 2023-09-30T22:35:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.543+0000 7f7937141700 1 -- start start 2023-09-30T22:35:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.543+0000 7f7937141700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79300a0a30 0x7f79300a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.543+0000 7f7937141700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7930138d80 0x7f793013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.543+0000 7f7937141700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79300a2a70 con 0x7f793009d630 2023-09-30T22:35:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.543+0000 7f7937141700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79300a01d0 con 0x7f79300a0a30 2023-09-30T22:35:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.543+0000 7f7937141700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f793009e2b0 con 0x7f7930138d80 2023-09-30T22:35:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.543+0000 7f79356de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7930138d80 0x7f793013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.543+0000 7f7934edd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79300a0a30 0x7f79300a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.543+0000 7f79356de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7930138d80 0x7f793013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56896/0 (socket says 172.21.15.59:56896) 2023-09-30T22:35:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.543+0000 7f79356de700 1 -- 172.21.15.59:0/2525144274 learned_addr learned my addr 172.21.15.59:0/2525144274 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.544+0000 7f7934edd700 1 -- 172.21.15.59:0/2525144274 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7930138d80 msgr2=0x7f793013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.544+0000 7f7934edd700 1 --2- 172.21.15.59:0/2525144274 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7930138d80 0x7f793013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.544+0000 7f7934edd700 1 -- 172.21.15.59:0/2525144274 >> v1:172.21.15.59:6789/0 conn(0x7f793009d630 legacy=0x7f79300a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.544+0000 7f792f7fe700 1 -- 172.21.15.59:0/2525144274 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144028851 0 0) 0x7f79300a2a70 con 0x7f793009d630 2023-09-30T22:35:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.544+0000 7f7934edd700 1 -- 172.21.15.59:0/2525144274 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793009dc50 con 0x7f79300a0a30 2023-09-30T22:35:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.544+0000 7f79356de700 1 --2- 172.21.15.59:0/2525144274 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7930138d80 0x7f793013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.544+0000 7f7934edd700 1 --2- 172.21.15.59:0/2525144274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79300a0a30 0x7f79300a0e00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7924009870 tx=0x7f7924009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce70901046457a84 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.544+0000 7f792f7fe700 1 -- 172.21.15.59:0/2525144274 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924011830 con 0x7f79300a0a30 2023-09-30T22:35:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.544+0000 7f792f7fe700 1 -- 172.21.15.59:0/2525144274 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7924011990 con 0x7f79300a0a30 2023-09-30T22:35:29.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.544+0000 7f792f7fe700 1 -- 172.21.15.59:0/2525144274 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924011d20 con 0x7f79300a0a30 2023-09-30T22:35:29.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.545+0000 7f7937141700 1 -- 172.21.15.59:0/2525144274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79300a0a30 msgr2=0x7f79300a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:29.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.545+0000 7f7937141700 1 --2- 172.21.15.59:0/2525144274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79300a0a30 0x7f79300a0e00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7924009870 tx=0x7f7924009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:29.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.545+0000 7f7937141700 1 -- 172.21.15.59:0/2525144274 shutdown_connections 2023-09-30T22:35:29.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.545+0000 7f7937141700 1 --2- 172.21.15.59:0/2525144274 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7930138d80 0x7f793013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.545+0000 7f7937141700 1 --2- 172.21.15.59:0/2525144274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79300a0a30 0x7f79300a0e00 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.545+0000 7f7937141700 1 -- 172.21.15.59:0/2525144274 >> 172.21.15.59:0/2525144274 conn(0x7f79300a3050 msgr2=0x7f79300a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:29.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.545+0000 7f7937141700 1 -- 172.21.15.59:0/2525144274 shutdown_connections 2023-09-30T22:35:29.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.545+0000 7f7937141700 1 -- 172.21.15.59:0/2525144274 wait complete. 2023-09-30T22:35:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.546+0000 7f7937141700 1 Processor -- start 2023-09-30T22:35:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.546+0000 7f7937141700 1 -- start start 2023-09-30T22:35:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f7937141700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793009d630 0x7f7930133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f7937141700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79300a0a30 0x7f7930133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f7937141700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7930138d80 0x7f7930134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f7937141700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7930137d30 con 0x7f793009d630 2023-09-30T22:35:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f7937141700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79300a4bf0 con 0x7f79300a0a30 2023-09-30T22:35:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f7937141700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79300a0410 con 0x7f7930138d80 2023-09-30T22:35:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f7934edd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793009d630 0x7f7930133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f7934edd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793009d630 0x7f7930133700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37758/0 (socket says 172.21.15.59:37758) 2023-09-30T22:35:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f7934edd700 1 -- 172.21.15.59:0/1026276640 learned_addr learned my addr 172.21.15.59:0/1026276640 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f792ffff700 1 --2- 172.21.15.59:0/1026276640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79300a0a30 0x7f7930133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f79356de700 1 --2- 172.21.15.59:0/1026276640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7930138d80 0x7f7930134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f7934edd700 1 -- 172.21.15.59:0/1026276640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7930138d80 msgr2=0x7f7930134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f7934edd700 1 --2- 172.21.15.59:0/1026276640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7930138d80 0x7f7930134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f7934edd700 1 -- 172.21.15.59:0/1026276640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79300a0a30 msgr2=0x7f7930133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f7934edd700 1 --2- 172.21.15.59:0/1026276640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79300a0a30 0x7f7930133c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f7934edd700 1 -- 172.21.15.59:0/1026276640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7928009b30 con 0x7f793009d630 2023-09-30T22:35:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f7934edd700 1 --2- 172.21.15.59:0/1026276640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793009d630 0x7f7930133700 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f79240090b0 tx=0x7f7924004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.547+0000 7f792d7fa700 1 -- 172.21.15.59:0/1026276640 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924004510 con 0x7f793009d630 2023-09-30T22:35:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.548+0000 7f792d7fa700 1 -- 172.21.15.59:0/1026276640 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792401f070 con 0x7f793009d630 2023-09-30T22:35:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.548+0000 7f792d7fa700 1 -- 172.21.15.59:0/1026276640 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79240038e0 con 0x7f793009d630 2023-09-30T22:35:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.548+0000 7f7937141700 1 -- 172.21.15.59:0/1026276640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79240094a0 con 0x7f793009d630 2023-09-30T22:35:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.548+0000 7f7937141700 1 -- 172.21.15.59:0/1026276640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7930136500 con 0x7f793009d630 2023-09-30T22:35:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.548+0000 7f792d7fa700 1 -- 172.21.15.59:0/1026276640 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7924003a40 con 0x7f793009d630 2023-09-30T22:35:29.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.548+0000 7f7937141700 1 -- 172.21.15.59:0/1026276640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79300747f0 con 0x7f793009d630 2023-09-30T22:35:29.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.549+0000 7f792d7fa700 1 -- 172.21.15.59:0/1026276640 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7924021070 con 0x7f793009d630 2023-09-30T22:35:29.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.554+0000 7f792d7fa700 1 -- 172.21.15.59:0/1026276640 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7924024380 con 0x7f793009d630 2023-09-30T22:35:29.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.580+0000 7fc55362a700 1 Processor -- start 2023-09-30T22:35:29.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.580+0000 7fc55362a700 1 -- start start 2023-09-30T22:35:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc55362a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c0a0a30 0x7fc54c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc55362a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc54c138d80 0x7fc54c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc55362a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54c0a2a70 con 0x7fc54c09d630 2023-09-30T22:35:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc55362a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54c0a01d0 con 0x7fc54c138d80 2023-09-30T22:35:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc55362a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c09e2b0 con 0x7fc54c0a0a30 2023-09-30T22:35:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc5513c6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c0a0a30 0x7fc54c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc551bc7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc54c138d80 0x7fc54c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc550bc5700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc54c09d630 0x7fc54c0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40186/0 (socket says 172.21.15.59:40186) 2023-09-30T22:35:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc550bc5700 1 -- 172.21.15.59:0/1624224983 learned_addr learned my addr 172.21.15.59:0/1624224983 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc54bfff700 1 -- 172.21.15.59:0/1624224983 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443312621 0 0) 0x7fc54c0a2a70 con 0x7fc54c09d630 2023-09-30T22:35:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc54bfff700 1 -- 172.21.15.59:0/1624224983 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5340035b0 con 0x7fc54c09d630 2023-09-30T22:35:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc551bc7700 1 -- 172.21.15.59:0/1624224983 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c0a0a30 msgr2=0x7fc54c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc551bc7700 1 --2- 172.21.15.59:0/1624224983 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c0a0a30 0x7fc54c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc551bc7700 1 -- 172.21.15.59:0/1624224983 >> v1:172.21.15.59:6789/0 conn(0x7fc54c09d630 legacy=0x7fc54c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc551bc7700 1 -- 172.21.15.59:0/1624224983 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c09dc50 con 0x7fc54c138d80 2023-09-30T22:35:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.581+0000 7fc5513c6700 1 --2- 172.21.15.59:0/1624224983 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c0a0a30 0x7fc54c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.582+0000 7fc551bc7700 1 --2- 172.21.15.59:0/1624224983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c138d80 0x7fc54c13b160 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009840 tx=0x7fc53c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e89b0e769544c74 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.582+0000 7fc54bfff700 1 -- 172.21.15.59:0/1624224983 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c011830 con 0x7fc54c138d80 2023-09-30T22:35:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.582+0000 7fc54bfff700 1 -- 172.21.15.59:0/1624224983 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c011990 con 0x7fc54c138d80 2023-09-30T22:35:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.582+0000 7fc54bfff700 1 -- 172.21.15.59:0/1624224983 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c011d20 con 0x7fc54c138d80 2023-09-30T22:35:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.582+0000 7fc55362a700 1 -- 172.21.15.59:0/1624224983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c138d80 msgr2=0x7fc54c13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.582+0000 7fc55362a700 1 --2- 172.21.15.59:0/1624224983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c138d80 0x7fc54c13b160 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009840 tx=0x7fc53c009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.582+0000 7fc55362a700 1 -- 172.21.15.59:0/1624224983 shutdown_connections 2023-09-30T22:35:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.582+0000 7fc55362a700 1 --2- 172.21.15.59:0/1624224983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c138d80 0x7fc54c13b160 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.582+0000 7fc55362a700 1 --2- 172.21.15.59:0/1624224983 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c0a0a30 0x7fc54c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.582+0000 7fc55362a700 1 -- 172.21.15.59:0/1624224983 >> 172.21.15.59:0/1624224983 conn(0x7fc54c0a3050 msgr2=0x7fc54c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.583+0000 7fc55362a700 1 -- 172.21.15.59:0/1624224983 shutdown_connections 2023-09-30T22:35:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.583+0000 7fc55362a700 1 -- 172.21.15.59:0/1624224983 wait complete. 2023-09-30T22:35:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.584+0000 7fc55362a700 1 Processor -- start 2023-09-30T22:35:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.584+0000 7fc55362a700 1 -- start start 2023-09-30T22:35:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.584+0000 7fc55362a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09d630 0x7fc54c133740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.584+0000 7fc55362a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c0a0a30 0x7fc54c133c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.584+0000 7fc55362a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c138d80 0x7fc54c1341c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.584+0000 7fc55362a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c134c10 con 0x7fc54c09d630 2023-09-30T22:35:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.584+0000 7fc55362a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c1365c0 con 0x7fc54c0a0a30 2023-09-30T22:35:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.584+0000 7fc55362a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c137210 con 0x7fc54c138d80 2023-09-30T22:35:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.584+0000 7fc551bc7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c138d80 0x7fc54c1341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.584+0000 7fc5513c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09d630 0x7fc54c133740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.584+0000 7fc551bc7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c138d80 0x7fc54c1341c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56932/0 (socket says 172.21.15.59:56932) 2023-09-30T22:35:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.584+0000 7fc551bc7700 1 -- 172.21.15.59:0/708930314 learned_addr learned my addr 172.21.15.59:0/708930314 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:29.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.584+0000 7fc550bc5700 1 --2- 172.21.15.59:0/708930314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c0a0a30 0x7fc54c133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:29.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.585+0000 7fc5513c6700 1 -- 172.21.15.59:0/708930314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c138d80 msgr2=0x7fc54c1341c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:29.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.585+0000 7fc5513c6700 1 --2- 172.21.15.59:0/708930314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c138d80 0x7fc54c1341c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.585+0000 7fc5513c6700 1 -- 172.21.15.59:0/708930314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c0a0a30 msgr2=0x7fc54c133c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:29.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.585+0000 7fc5513c6700 1 --2- 172.21.15.59:0/708930314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c0a0a30 0x7fc54c133c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.585+0000 7fc5513c6700 1 -- 172.21.15.59:0/708930314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc544009a70 con 0x7fc54c09d630 2023-09-30T22:35:29.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.585+0000 7fc551bc7700 1 --2- 172.21.15.59:0/708930314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c138d80 0x7fc54c1341c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:29.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.585+0000 7fc5513c6700 1 --2- 172.21.15.59:0/708930314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09d630 0x7fc54c133740 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fc544009e60 tx=0x7fc54400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:29.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.585+0000 7fc549ffb700 1 -- 172.21.15.59:0/708930314 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54400cd10 con 0x7fc54c09d630 2023-09-30T22:35:29.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.585+0000 7fc549ffb700 1 -- 172.21.15.59:0/708930314 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54400f040 con 0x7fc54c09d630 2023-09-30T22:35:29.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.585+0000 7fc549ffb700 1 -- 172.21.15.59:0/708930314 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440146c0 con 0x7fc54c09d630 2023-09-30T22:35:29.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.585+0000 7fc55362a700 1 -- 172.21.15.59:0/708930314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c0094a0 con 0x7fc54c09d630 2023-09-30T22:35:29.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.585+0000 7fc55362a700 1 -- 172.21.15.59:0/708930314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54c0a0460 con 0x7fc54c09d630 2023-09-30T22:35:29.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.586+0000 7fc549ffb700 1 -- 172.21.15.59:0/708930314 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc544014820 con 0x7fc54c09d630 2023-09-30T22:35:29.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.586+0000 7fc549ffb700 1 -- 172.21.15.59:0/708930314 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc544040300 con 0x7fc54c09d630 2023-09-30T22:35:29.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.586+0000 7fc55362a700 1 -- 172.21.15.59:0/708930314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54c136ac0 con 0x7fc54c09d630 2023-09-30T22:35:29.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.596+0000 7fc549ffb700 1 -- 172.21.15.59:0/708930314 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc544007920 con 0x7fc54c09d630 2023-09-30T22:35:29.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.765+0000 7f7937141700 1 -- 172.21.15.59:0/1026276640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7930072980 con 0x7f793009d630 2023-09-30T22:35:29.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.765+0000 7f792d7fa700 1 -- 172.21.15.59:0/1026276640 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f792402b070 con 0x7f793009d630 2023-09-30T22:35:29.769 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:29.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.767+0000 7f7937141700 1 -- 172.21.15.59:0/1026276640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793009d630 msgr2=0x7f7930133700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:29.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.767+0000 7f7937141700 1 --2- 172.21.15.59:0/1026276640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793009d630 0x7f7930133700 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f79240090b0 tx=0x7f7924004750 comp rx=0 tx=0).stop 2023-09-30T22:35:29.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.768+0000 7f7937141700 1 -- 172.21.15.59:0/1026276640 shutdown_connections 2023-09-30T22:35:29.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.768+0000 7f7937141700 1 --2- 172.21.15.59:0/1026276640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7930138d80 0x7f7930134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.768+0000 7f7937141700 1 --2- 172.21.15.59:0/1026276640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793009d630 0x7f7930133700 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.768+0000 7f7937141700 1 --2- 172.21.15.59:0/1026276640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79300a0a30 0x7f7930133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.768+0000 7f7937141700 1 -- 172.21.15.59:0/1026276640 >> 172.21.15.59:0/1026276640 conn(0x7f79300a3050 msgr2=0x7f793013add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:29.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.768+0000 7f7937141700 1 -- 172.21.15.59:0/1026276640 shutdown_connections 2023-09-30T22:35:29.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.768+0000 7f7937141700 1 -- 172.21.15.59:0/1026276640 wait complete. 2023-09-30T22:35:29.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:29.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.806+0000 7fc55362a700 1 -- 172.21.15.59:0/708930314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc54c0a4b90 con 0x7fc54c09d630 2023-09-30T22:35:29.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.807+0000 7fc549ffb700 1 -- 172.21.15.59:0/708930314 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc544007330 con 0x7fc54c09d630 2023-09-30T22:35:29.808 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.809+0000 7fc55362a700 1 -- 172.21.15.59:0/708930314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09d630 msgr2=0x7fc54c133740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:29.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.809+0000 7fc55362a700 1 --2- 172.21.15.59:0/708930314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09d630 0x7fc54c133740 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fc544009e60 tx=0x7fc54400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.809+0000 7fc55362a700 1 -- 172.21.15.59:0/708930314 shutdown_connections 2023-09-30T22:35:29.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.809+0000 7fc55362a700 1 --2- 172.21.15.59:0/708930314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c138d80 0x7fc54c1341c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.809+0000 7fc55362a700 1 --2- 172.21.15.59:0/708930314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09d630 0x7fc54c133740 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.809+0000 7fc55362a700 1 --2- 172.21.15.59:0/708930314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c0a0a30 0x7fc54c133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:29.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.809+0000 7fc55362a700 1 -- 172.21.15.59:0/708930314 >> 172.21.15.59:0/708930314 conn(0x7fc54c0a3050 msgr2=0x7fc54c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:29.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.809+0000 7fc55362a700 1 -- 172.21.15.59:0/708930314 shutdown_connections 2023-09-30T22:35:29.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:29.809+0000 7fc55362a700 1 -- 172.21.15.59:0/708930314 wait complete. 2023-09-30T22:35:29.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:29.894 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:29.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:30.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.037+0000 7fb4b2fa0700 1 Processor -- start 2023-09-30T22:35:30.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.037+0000 7fb4b2fa0700 1 -- start start 2023-09-30T22:35:30.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.037+0000 7fb4b2fa0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4ac0a0a30 0x7fb4ac0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.037+0000 7fb4b2fa0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4ac0a1340 0x7fb4ac133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.037+0000 7fb4b2fa0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4ac133fa0 0x7fb4ac134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4b2fa0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac09edd0 con 0x7fb4ac133fa0 2023-09-30T22:35:30.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4b2fa0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac09e1f0 con 0x7fb4ac0a0a30 2023-09-30T22:35:30.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4b2fa0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac09dc50 con 0x7fb4ac0a1340 2023-09-30T22:35:30.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4b0d3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4ac0a0a30 0x7fb4ac0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4abfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4ac0a1340 0x7fb4ac133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4b0d3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4ac0a0a30 0x7fb4ac0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46850/0 (socket says 172.21.15.59:46850) 2023-09-30T22:35:30.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4abfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4ac0a1340 0x7fb4ac133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56944/0 (socket says 172.21.15.59:56944) 2023-09-30T22:35:30.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4b0d3c700 1 -- 172.21.15.59:0/1627211503 learned_addr learned my addr 172.21.15.59:0/1627211503 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:30.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4b153d700 1 --2- 172.21.15.59:0/1627211503 >> v2:172.21.15.59:3300/0 conn(0x7fb4ac133fa0 0x7fb4ac134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4b0d3c700 1 -- 172.21.15.59:0/1627211503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4ac0a1340 msgr2=0x7fb4ac133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:30.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4b0d3c700 1 --2- 172.21.15.59:0/1627211503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4ac0a1340 0x7fb4ac133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4b0d3c700 1 -- 172.21.15.59:0/1627211503 >> v2:172.21.15.59:3300/0 conn(0x7fb4ac133fa0 msgr2=0x7fb4ac134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:30.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4b0d3c700 1 --2- 172.21.15.59:0/1627211503 >> v2:172.21.15.59:3300/0 conn(0x7fb4ac133fa0 0x7fb4ac134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4b0d3c700 1 -- 172.21.15.59:0/1627211503 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac0a1fe0 con 0x7fb4ac0a0a30 2023-09-30T22:35:30.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4b153d700 1 --2- 172.21.15.59:0/1627211503 >> v2:172.21.15.59:3300/0 conn(0x7fb4ac133fa0 0x7fb4ac134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:30.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4abfff700 1 --2- 172.21.15.59:0/1627211503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4ac0a1340 0x7fb4ac133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:30.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4b0d3c700 1 --2- 172.21.15.59:0/1627211503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4ac0a0a30 0x7fb4ac0a0e00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00098f0 tx=0x7fb4a0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6210fd4b0a884584 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:30.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.038+0000 7fb4ab7fe700 1 -- 172.21.15.59:0/1627211503 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0011830 con 0x7fb4ac0a0a30 2023-09-30T22:35:30.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.039+0000 7fb4ab7fe700 1 -- 172.21.15.59:0/1627211503 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a0011990 con 0x7fb4ac0a0a30 2023-09-30T22:35:30.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.039+0000 7fb4ab7fe700 1 -- 172.21.15.59:0/1627211503 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0011d20 con 0x7fb4ac0a0a30 2023-09-30T22:35:30.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.039+0000 7fb4b2fa0700 1 -- 172.21.15.59:0/1627211503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4ac0a0a30 msgr2=0x7fb4ac0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.039+0000 7fb4b2fa0700 1 --2- 172.21.15.59:0/1627211503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4ac0a0a30 0x7fb4ac0a0e00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00098f0 tx=0x7fb4a0009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:30.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.039+0000 7fb4b2fa0700 1 -- 172.21.15.59:0/1627211503 shutdown_connections 2023-09-30T22:35:30.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.039+0000 7fb4b2fa0700 1 --2- 172.21.15.59:0/1627211503 >> v2:172.21.15.59:3300/0 conn(0x7fb4ac133fa0 0x7fb4ac134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.039+0000 7fb4b2fa0700 1 --2- 172.21.15.59:0/1627211503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4ac0a0a30 0x7fb4ac0a0e00 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.039+0000 7fb4b2fa0700 1 --2- 172.21.15.59:0/1627211503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4ac0a1340 0x7fb4ac133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.039+0000 7fb4b2fa0700 1 -- 172.21.15.59:0/1627211503 >> 172.21.15.59:0/1627211503 conn(0x7fb4ac0a6550 msgr2=0x7fb4ac0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:30.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.039+0000 7fb4b2fa0700 1 -- 172.21.15.59:0/1627211503 shutdown_connections 2023-09-30T22:35:30.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.039+0000 7fb4b2fa0700 1 -- 172.21.15.59:0/1627211503 wait complete. 2023-09-30T22:35:30.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.040+0000 7fb4b2fa0700 1 Processor -- start 2023-09-30T22:35:30.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.040+0000 7fb4b2fa0700 1 -- start start 2023-09-30T22:35:30.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.041+0000 7fb4b2fa0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4ac0a0a30 0x7fb4ac1200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.041+0000 7fb4b2fa0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4ac0a1340 0x7fb4ac1205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.041+0000 7fb4b2fa0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4ac133fa0 0x7fb4ac120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.041+0000 7fb4b2fa0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac123bc0 con 0x7fb4ac0a0a30 2023-09-30T22:35:30.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.041+0000 7fb4b2fa0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac122f90 con 0x7fb4ac0a1340 2023-09-30T22:35:30.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.041+0000 7fb4b2fa0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0a34f0 con 0x7fb4ac133fa0 2023-09-30T22:35:30.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.041+0000 7fb4b153d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4ac133fa0 0x7fb4ac120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.041+0000 7fb4b0d3c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4ac0a0a30 0x7fb4ac1200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.041+0000 7fb4abfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4ac0a1340 0x7fb4ac1205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.041+0000 7fb4b153d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4ac133fa0 0x7fb4ac120b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56946/0 (socket says 172.21.15.59:56946) 2023-09-30T22:35:30.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.041+0000 7fb4b0d3c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4ac0a0a30 0x7fb4ac1200a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37788/0 (socket says 172.21.15.59:37788) 2023-09-30T22:35:30.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.041+0000 7fb4abfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4ac0a1340 0x7fb4ac1205e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46854/0 (socket says 172.21.15.59:46854) 2023-09-30T22:35:30.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.041+0000 7fb4b153d700 1 -- 172.21.15.59:0/3205266744 learned_addr learned my addr 172.21.15.59:0/3205266744 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:30.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.042+0000 7fb4b153d700 1 -- 172.21.15.59:0/3205266744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4ac0a1340 msgr2=0x7fb4ac1205e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.042+0000 7fb4b153d700 1 --2- 172.21.15.59:0/3205266744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4ac0a1340 0x7fb4ac1205e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.042+0000 7fb4b153d700 1 -- 172.21.15.59:0/3205266744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4ac0a0a30 msgr2=0x7fb4ac1200a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.042+0000 7fb4b153d700 1 --2- 172.21.15.59:0/3205266744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4ac0a0a30 0x7fb4ac1200a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.042+0000 7fb4b153d700 1 -- 172.21.15.59:0/3205266744 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4980094a0 con 0x7fb4ac133fa0 2023-09-30T22:35:30.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.042+0000 7fb4b153d700 1 --2- 172.21.15.59:0/3205266744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4ac133fa0 0x7fb4ac120b20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400efc0 tx=0x7fb4a400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:30.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.042+0000 7fb4a97fa700 1 -- 172.21.15.59:0/3205266744 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a400ca90 con 0x7fb4ac133fa0 2023-09-30T22:35:30.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.042+0000 7fb4a97fa700 1 -- 172.21.15.59:0/3205266744 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a400f040 con 0x7fb4ac133fa0 2023-09-30T22:35:30.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.042+0000 7fb4a97fa700 1 -- 172.21.15.59:0/3205266744 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a400ce10 con 0x7fb4ac133fa0 2023-09-30T22:35:30.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.042+0000 7fb4b2fa0700 1 -- 172.21.15.59:0/3205266744 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a4009a70 con 0x7fb4ac133fa0 2023-09-30T22:35:30.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.042+0000 7fb4b2fa0700 1 -- 172.21.15.59:0/3205266744 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a0009550 con 0x7fb4ac133fa0 2023-09-30T22:35:30.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.043+0000 7fb4a97fa700 1 -- 172.21.15.59:0/3205266744 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4a4014480 con 0x7fb4ac133fa0 2023-09-30T22:35:30.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.043+0000 7fb4a97fa700 1 -- 172.21.15.59:0/3205266744 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb4a403fd00 con 0x7fb4ac133fa0 2023-09-30T22:35:30.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.043+0000 7fb4b2fa0700 1 -- 172.21.15.59:0/3205266744 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ac121d10 con 0x7fb4ac133fa0 2023-09-30T22:35:30.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.049+0000 7fb4a97fa700 1 -- 172.21.15.59:0/3205266744 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4a4012930 con 0x7fb4ac133fa0 2023-09-30T22:35:30.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.079+0000 7f9574d02700 1 Processor -- start 2023-09-30T22:35:30.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.079+0000 7f9574d02700 1 -- start start 2023-09-30T22:35:30.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.079+0000 7f9574d02700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95700a0a30 0x7f95700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.079+0000 7f9574d02700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f957009d630 0x7f95700a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.079+0000 7f9574d02700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95700a2a70 con 0x7f9570133930 2023-09-30T22:35:30.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.079+0000 7f9574d02700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95700a01d0 con 0x7f957009d630 2023-09-30T22:35:30.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.079+0000 7f9574d02700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f957009e2b0 con 0x7f95700a0a30 2023-09-30T22:35:30.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.080+0000 7f956dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f957009d630 0x7f95700a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.080+0000 7f956e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95700a0a30 0x7f95700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.080+0000 7f956e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95700a0a30 0x7f95700a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56960/0 (socket says 172.21.15.59:56960) 2023-09-30T22:35:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.080+0000 7f956e59c700 1 -- 172.21.15.59:0/2144133118 learned_addr learned my addr 172.21.15.59:0/2144133118 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.080+0000 7f956dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f957009d630 0x7f95700a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37794/0 (socket says 172.21.15.59:37794) 2023-09-30T22:35:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.080+0000 7f956e59c700 1 -- 172.21.15.59:0/2144133118 >> v2:172.21.15.59:3300/0 conn(0x7f957009d630 msgr2=0x7f95700a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.080+0000 7f956e59c700 1 --2- 172.21.15.59:0/2144133118 >> v2:172.21.15.59:3300/0 conn(0x7f957009d630 0x7f95700a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.080+0000 7f956e59c700 1 -- 172.21.15.59:0/2144133118 >> v1:172.21.15.59:6789/0 conn(0x7f9570133930 legacy=0x7f9570133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.080+0000 7f956e59c700 1 -- 172.21.15.59:0/2144133118 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957009dc50 con 0x7f95700a0a30 2023-09-30T22:35:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.080+0000 7f956dd9b700 1 --2- 172.21.15.59:0/2144133118 >> v2:172.21.15.59:3300/0 conn(0x7f957009d630 0x7f95700a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.080+0000 7f956e59c700 1 --2- 172.21.15.59:0/2144133118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95700a0a30 0x7f95700a0e00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f95680098f0 tx=0x7f9568009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4569e674418b4754 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.080+0000 7f956d59a700 1 -- 172.21.15.59:0/2144133118 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568011830 con 0x7f95700a0a30 2023-09-30T22:35:30.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.080+0000 7f956d59a700 1 -- 172.21.15.59:0/2144133118 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9568011990 con 0x7f95700a0a30 2023-09-30T22:35:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.080+0000 7f956d59a700 1 -- 172.21.15.59:0/2144133118 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568011d20 con 0x7f95700a0a30 2023-09-30T22:35:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.081+0000 7f9574d02700 1 -- 172.21.15.59:0/2144133118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95700a0a30 msgr2=0x7f95700a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.081+0000 7f9574d02700 1 --2- 172.21.15.59:0/2144133118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95700a0a30 0x7f95700a0e00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f95680098f0 tx=0x7f9568009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:30.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.081+0000 7f9574d02700 1 -- 172.21.15.59:0/2144133118 shutdown_connections 2023-09-30T22:35:30.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.081+0000 7f9574d02700 1 --2- 172.21.15.59:0/2144133118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95700a0a30 0x7f95700a0e00 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.081+0000 7f9574d02700 1 --2- 172.21.15.59:0/2144133118 >> v2:172.21.15.59:3300/0 conn(0x7f957009d630 0x7f95700a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.081+0000 7f9574d02700 1 -- 172.21.15.59:0/2144133118 >> 172.21.15.59:0/2144133118 conn(0x7f95700a3050 msgr2=0x7f95700a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:30.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.081+0000 7f9574d02700 1 -- 172.21.15.59:0/2144133118 shutdown_connections 2023-09-30T22:35:30.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.081+0000 7f9574d02700 1 -- 172.21.15.59:0/2144133118 wait complete. 2023-09-30T22:35:30.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.082+0000 7f9574d02700 1 Processor -- start 2023-09-30T22:35:30.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.082+0000 7f9574d02700 1 -- start start 2023-09-30T22:35:30.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f9574d02700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f957009d630 0x7f95701c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f9574d02700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95700a0a30 0x7f95701c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f9574d02700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9570133930 0x7f95701c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f9574d02700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9570120670 con 0x7f9570133930 2023-09-30T22:35:30.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f9574d02700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9570121e60 con 0x7f957009d630 2023-09-30T22:35:30.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f9574d02700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95700a0410 con 0x7f95700a0a30 2023-09-30T22:35:30.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f956ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9570133930 0x7f95701c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f956e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f957009d630 0x7f95701c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f956ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9570133930 0x7f95701c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37796/0 (socket says 172.21.15.59:37796) 2023-09-30T22:35:30.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f956e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f957009d630 0x7f95701c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46862/0 (socket says 172.21.15.59:46862) 2023-09-30T22:35:30.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f956ed9d700 1 -- 172.21.15.59:0/356898783 learned_addr learned my addr 172.21.15.59:0/356898783 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:30.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f956dd9b700 1 --2- 172.21.15.59:0/356898783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95700a0a30 0x7f95701c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f956ed9d700 1 -- 172.21.15.59:0/356898783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95700a0a30 msgr2=0x7f95701c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f956ed9d700 1 --2- 172.21.15.59:0/356898783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95700a0a30 0x7f95701c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f956ed9d700 1 -- 172.21.15.59:0/356898783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f957009d630 msgr2=0x7f95701c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f956ed9d700 1 --2- 172.21.15.59:0/356898783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f957009d630 0x7f95701c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f956ed9d700 1 -- 172.21.15.59:0/356898783 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95580094a0 con 0x7f9570133930 2023-09-30T22:35:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.083+0000 7f956e59c700 1 --2- 172.21.15.59:0/356898783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f957009d630 0x7f95701c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.084+0000 7f956ed9d700 1 --2- 172.21.15.59:0/356898783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9570133930 0x7f95701c8bf0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f956000cc50 tx=0x7f956000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.084+0000 7f9566ffd700 1 -- 172.21.15.59:0/356898783 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560003c00 con 0x7f9570133930 2023-09-30T22:35:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.084+0000 7f9566ffd700 1 -- 172.21.15.59:0/356898783 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9560003d60 con 0x7f9570133930 2023-09-30T22:35:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.084+0000 7f9574d02700 1 -- 172.21.15.59:0/356898783 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9568009550 con 0x7f9570133930 2023-09-30T22:35:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.084+0000 7f9566ffd700 1 -- 172.21.15.59:0/356898783 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956000aab0 con 0x7f9570133930 2023-09-30T22:35:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.084+0000 7f9574d02700 1 -- 172.21.15.59:0/356898783 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9570121160 con 0x7f9570133930 2023-09-30T22:35:30.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.085+0000 7f9566ffd700 1 -- 172.21.15.59:0/356898783 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f956000ac10 con 0x7f9570133930 2023-09-30T22:35:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.085+0000 7f9574d02700 1 -- 172.21.15.59:0/356898783 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95700747f0 con 0x7f9570133930 2023-09-30T22:35:30.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.085+0000 7f9566ffd700 1 -- 172.21.15.59:0/356898783 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f956003f620 con 0x7f9570133930 2023-09-30T22:35:30.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.090+0000 7f9566ffd700 1 -- 172.21.15.59:0/356898783 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95600196c0 con 0x7f9570133930 2023-09-30T22:35:30.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.257+0000 7fb4b2fa0700 1 -- 172.21.15.59:0/3205266744 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb4ac074ea0 con 0x7fb4ac133fa0 2023-09-30T22:35:30.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.257+0000 7fb4a97fa700 1 -- 172.21.15.59:0/3205266744 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4a4012340 con 0x7fb4ac133fa0 2023-09-30T22:35:30.259 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.261+0000 7fb4b2fa0700 1 -- 172.21.15.59:0/3205266744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4ac133fa0 msgr2=0x7fb4ac120b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.261+0000 7fb4b2fa0700 1 --2- 172.21.15.59:0/3205266744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4ac133fa0 0x7fb4ac120b20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400efc0 tx=0x7fb4a400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.261+0000 7fb4b2fa0700 1 -- 172.21.15.59:0/3205266744 shutdown_connections 2023-09-30T22:35:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.261+0000 7fb4b2fa0700 1 --2- 172.21.15.59:0/3205266744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4ac133fa0 0x7fb4ac120b20 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.261+0000 7fb4b2fa0700 1 --2- 172.21.15.59:0/3205266744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4ac0a0a30 0x7fb4ac1200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.261+0000 7fb4b2fa0700 1 --2- 172.21.15.59:0/3205266744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4ac0a1340 0x7fb4ac1205e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.261+0000 7fb4b2fa0700 1 -- 172.21.15.59:0/3205266744 >> 172.21.15.59:0/3205266744 conn(0x7fb4ac0a6550 msgr2=0x7fb4ac1bae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:30.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.261+0000 7fb4b2fa0700 1 -- 172.21.15.59:0/3205266744 shutdown_connections 2023-09-30T22:35:30.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.261+0000 7fb4b2fa0700 1 -- 172.21.15.59:0/3205266744 wait complete. 2023-09-30T22:35:30.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.308+0000 7f9574d02700 1 -- 172.21.15.59:0/356898783 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9570072980 con 0x7f9570133930 2023-09-30T22:35:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.308+0000 7f9566ffd700 1 -- 172.21.15.59:0/356898783 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9560019300 con 0x7f9570133930 2023-09-30T22:35:30.310 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.310+0000 7f9574d02700 1 -- 172.21.15.59:0/356898783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9570133930 msgr2=0x7f95701c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.310+0000 7f9574d02700 1 --2- 172.21.15.59:0/356898783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9570133930 0x7f95701c8bf0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f956000cc50 tx=0x7f956000cf60 comp rx=0 tx=0).stop 2023-09-30T22:35:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.311+0000 7f9574d02700 1 -- 172.21.15.59:0/356898783 shutdown_connections 2023-09-30T22:35:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.311+0000 7f9574d02700 1 --2- 172.21.15.59:0/356898783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9570133930 0x7f95701c8bf0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.311+0000 7f9574d02700 1 --2- 172.21.15.59:0/356898783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f957009d630 0x7f95701c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.311+0000 7f9574d02700 1 --2- 172.21.15.59:0/356898783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95700a0a30 0x7f95701c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.311+0000 7f9574d02700 1 -- 172.21.15.59:0/356898783 >> 172.21.15.59:0/356898783 conn(0x7f95700a3050 msgr2=0x7f95700a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.311+0000 7f9574d02700 1 -- 172.21.15.59:0/356898783 shutdown_connections 2023-09-30T22:35:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.311+0000 7f9574d02700 1 -- 172.21.15.59:0/356898783 wait complete. 2023-09-30T22:35:30.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:30.784 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:30.825 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:30.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.931+0000 7fc7e768b700 1 Processor -- start 2023-09-30T22:35:30.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.931+0000 7fc7e768b700 1 -- start start 2023-09-30T22:35:30.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e768b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e006a770 0x7fc7e006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e768b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc7e006b080 0x7fc7e0131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e768b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e0131b40 0x7fc7e0131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e768b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e009ece0 con 0x7fc7e006b080 2023-09-30T22:35:30.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e768b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e009e760 con 0x7fc7e0131b40 2023-09-30T22:35:30.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e768b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e009e040 con 0x7fc7e006a770 2023-09-30T22:35:30.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e5427700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e006a770 0x7fc7e006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e5c28700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e0131b40 0x7fc7e0131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e5427700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e006a770 0x7fc7e006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56992/0 (socket says 172.21.15.59:56992) 2023-09-30T22:35:30.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e5427700 1 -- 172.21.15.59:0/3626665358 learned_addr learned my addr 172.21.15.59:0/3626665358 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:30.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e4c26700 1 --2- 172.21.15.59:0/3626665358 >> v2:172.21.15.59:3300/0 conn(0x7fc7e006b080 0x7fc7e0131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e5c28700 1 -- 172.21.15.59:0/3626665358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e006a770 msgr2=0x7fc7e006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:30.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e5c28700 1 --2- 172.21.15.59:0/3626665358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e006a770 0x7fc7e006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e5c28700 1 -- 172.21.15.59:0/3626665358 >> v2:172.21.15.59:3300/0 conn(0x7fc7e006b080 msgr2=0x7fc7e0131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:30.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e5c28700 1 --2- 172.21.15.59:0/3626665358 >> v2:172.21.15.59:3300/0 conn(0x7fc7e006b080 0x7fc7e0131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e5c28700 1 -- 172.21.15.59:0/3626665358 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e009f630 con 0x7fc7e0131b40 2023-09-30T22:35:30.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e5427700 1 --2- 172.21.15.59:0/3626665358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e006a770 0x7fc7e006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:30.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.932+0000 7fc7e4c26700 1 --2- 172.21.15.59:0/3626665358 >> v2:172.21.15.59:3300/0 conn(0x7fc7e006b080 0x7fc7e0131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:30.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.933+0000 7fc7e5c28700 1 --2- 172.21.15.59:0/3626665358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e0131b40 0x7fc7e0131fc0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009d90 tx=0x7fc7dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80d1b15c8a61e9eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:30.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.933+0000 7fc7d7fff700 1 -- 172.21.15.59:0/3626665358 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00e070 con 0x7fc7e0131b40 2023-09-30T22:35:30.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.933+0000 7fc7d7fff700 1 -- 172.21.15.59:0/3626665358 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc00bb20 con 0x7fc7e0131b40 2023-09-30T22:35:30.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.933+0000 7fc7d7fff700 1 -- 172.21.15.59:0/3626665358 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc012430 con 0x7fc7e0131b40 2023-09-30T22:35:30.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.933+0000 7fc7e768b700 1 -- 172.21.15.59:0/3626665358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e0131b40 msgr2=0x7fc7e0131fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.933+0000 7fc7e768b700 1 --2- 172.21.15.59:0/3626665358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e0131b40 0x7fc7e0131fc0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009d90 tx=0x7fc7dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:35:30.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.934+0000 7fc7e768b700 1 -- 172.21.15.59:0/3626665358 shutdown_connections 2023-09-30T22:35:30.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.934+0000 7fc7e768b700 1 --2- 172.21.15.59:0/3626665358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e0131b40 0x7fc7e0131fc0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.934+0000 7fc7e768b700 1 --2- 172.21.15.59:0/3626665358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e006a770 0x7fc7e006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.934+0000 7fc7e768b700 1 --2- 172.21.15.59:0/3626665358 >> v2:172.21.15.59:3300/0 conn(0x7fc7e006b080 0x7fc7e0131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.934+0000 7fc7e768b700 1 -- 172.21.15.59:0/3626665358 >> 172.21.15.59:0/3626665358 conn(0x7fc7e0066f50 msgr2=0x7fc7e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:30.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.934+0000 7fc7e768b700 1 -- 172.21.15.59:0/3626665358 shutdown_connections 2023-09-30T22:35:30.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.934+0000 7fc7e768b700 1 -- 172.21.15.59:0/3626665358 wait complete. 2023-09-30T22:35:30.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.935+0000 7fc7e768b700 1 Processor -- start 2023-09-30T22:35:30.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.935+0000 7fc7e768b700 1 -- start start 2023-09-30T22:35:30.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.935+0000 7fc7e768b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e006a770 0x7fc7e011d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.935+0000 7fc7e768b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e006b080 0x7fc7e011d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.935+0000 7fc7e768b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e0131b40 0x7fc7e011db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.935+0000 7fc7e768b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e01208f0 con 0x7fc7e006b080 2023-09-30T22:35:30.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.935+0000 7fc7e768b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0071e60 con 0x7fc7e0131b40 2023-09-30T22:35:30.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.935+0000 7fc7e768b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e011fae0 con 0x7fc7e006a770 2023-09-30T22:35:30.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.935+0000 7fc7e5427700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e006a770 0x7fc7e011d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.935+0000 7fc7e5c28700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e0131b40 0x7fc7e011db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.935+0000 7fc7e5427700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e006a770 0x7fc7e011d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57004/0 (socket says 172.21.15.59:57004) 2023-09-30T22:35:30.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.935+0000 7fc7e5427700 1 -- 172.21.15.59:0/77133906 learned_addr learned my addr 172.21.15.59:0/77133906 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:30.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.935+0000 7fc7e4c26700 1 --2- 172.21.15.59:0/77133906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e006b080 0x7fc7e011d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.936+0000 7fc7e5c28700 1 -- 172.21.15.59:0/77133906 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e006a770 msgr2=0x7fc7e011d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.936+0000 7fc7e5c28700 1 --2- 172.21.15.59:0/77133906 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e006a770 0x7fc7e011d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.936+0000 7fc7e5c28700 1 -- 172.21.15.59:0/77133906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e006b080 msgr2=0x7fc7e011d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.936+0000 7fc7e5c28700 1 --2- 172.21.15.59:0/77133906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e006b080 0x7fc7e011d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.936+0000 7fc7e5c28700 1 -- 172.21.15.59:0/77133906 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d8009550 con 0x7fc7e0131b40 2023-09-30T22:35:30.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.936+0000 7fc7e5427700 1 --2- 172.21.15.59:0/77133906 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e006a770 0x7fc7e011d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:30.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.936+0000 7fc7e5c28700 1 --2- 172.21.15.59:0/77133906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e0131b40 0x7fc7e011db30 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc016000 tx=0x7fc7dc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:30.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.936+0000 7fc7d5ffb700 1 -- 172.21.15.59:0/77133906 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc020c20 con 0x7fc7e0131b40 2023-09-30T22:35:30.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.936+0000 7fc7d5ffb700 1 -- 172.21.15.59:0/77133906 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc024070 con 0x7fc7e0131b40 2023-09-30T22:35:30.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.936+0000 7fc7e768b700 1 -- 172.21.15.59:0/77133906 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d00094a0 con 0x7fc7e0131b40 2023-09-30T22:35:30.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.936+0000 7fc7d5ffb700 1 -- 172.21.15.59:0/77133906 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc003e30 con 0x7fc7e0131b40 2023-09-30T22:35:30.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.937+0000 7fc7e768b700 1 -- 172.21.15.59:0/77133906 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7dc009a70 con 0x7fc7e0131b40 2023-09-30T22:35:30.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.937+0000 7fc7d5ffb700 1 -- 172.21.15.59:0/77133906 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7dc004270 con 0x7fc7e0131b40 2023-09-30T22:35:30.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.937+0000 7fc7d5ffb700 1 -- 172.21.15.59:0/77133906 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc7dc026070 con 0x7fc7e0131b40 2023-09-30T22:35:30.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.938+0000 7fc7e768b700 1 -- 172.21.15.59:0/77133906 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e0074ea0 con 0x7fc7e0131b40 2023-09-30T22:35:30.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.943+0000 7fc7d5ffb700 1 -- 172.21.15.59:0/77133906 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7dc004520 con 0x7fc7e0131b40 2023-09-30T22:35:30.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.968+0000 7ff667858700 1 Processor -- start 2023-09-30T22:35:30.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.969+0000 7ff667858700 1 -- start start 2023-09-30T22:35:30.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff667858700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6600a1510 0x7ff660138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff667858700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff660139250 0x7ff66013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff667858700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66009edd0 con 0x7ff6600a0a30 2023-09-30T22:35:30.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff667858700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6600a18e0 con 0x7ff6600a1510 2023-09-30T22:35:30.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff667858700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66009e1f0 con 0x7ff660139250 2023-09-30T22:35:30.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff665df5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff660139250 0x7ff66013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff664df3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6600a1510 0x7ff660138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff664df3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6600a1510 0x7ff660138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37820/0 (socket says 172.21.15.59:37820) 2023-09-30T22:35:30.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff665df5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff660139250 0x7ff66013b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46888/0 (socket says 172.21.15.59:46888) 2023-09-30T22:35:30.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff664df3700 1 -- 172.21.15.59:0/535096399 learned_addr learned my addr 172.21.15.59:0/535096399 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:30.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff664df3700 1 -- 172.21.15.59:0/535096399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff660139250 msgr2=0x7ff66013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:30.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff664df3700 1 --2- 172.21.15.59:0/535096399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff660139250 0x7ff66013b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff664df3700 1 -- 172.21.15.59:0/535096399 >> v1:172.21.15.59:6789/0 conn(0x7ff6600a0a30 legacy=0x7ff6600a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff664df3700 1 -- 172.21.15.59:0/535096399 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66009dc50 con 0x7ff6600a1510 2023-09-30T22:35:30.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff665df5700 1 --2- 172.21.15.59:0/535096399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff660139250 0x7ff66013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:30.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.970+0000 7ff664df3700 1 --2- 172.21.15.59:0/535096399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6600a1510 0x7ff660138d10 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7ff6540098f0 tx=0x7ff654009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7154bc161ebf5cda server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:30.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.971+0000 7ff65ffff700 1 -- 172.21.15.59:0/535096399 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654011830 con 0x7ff6600a1510 2023-09-30T22:35:30.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.971+0000 7ff65ffff700 1 -- 172.21.15.59:0/535096399 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff654011990 con 0x7ff6600a1510 2023-09-30T22:35:30.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.971+0000 7ff65ffff700 1 -- 172.21.15.59:0/535096399 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654011d20 con 0x7ff6600a1510 2023-09-30T22:35:30.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.971+0000 7ff667858700 1 -- 172.21.15.59:0/535096399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6600a1510 msgr2=0x7ff660138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.971+0000 7ff667858700 1 --2- 172.21.15.59:0/535096399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6600a1510 0x7ff660138d10 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7ff6540098f0 tx=0x7ff654009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:30.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.971+0000 7ff667858700 1 -- 172.21.15.59:0/535096399 shutdown_connections 2023-09-30T22:35:30.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.971+0000 7ff667858700 1 --2- 172.21.15.59:0/535096399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff660139250 0x7ff66013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.971+0000 7ff667858700 1 --2- 172.21.15.59:0/535096399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6600a1510 0x7ff660138d10 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.971+0000 7ff667858700 1 -- 172.21.15.59:0/535096399 >> 172.21.15.59:0/535096399 conn(0x7ff6600a6550 msgr2=0x7ff6600a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:30.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.971+0000 7ff667858700 1 -- 172.21.15.59:0/535096399 shutdown_connections 2023-09-30T22:35:30.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.971+0000 7ff667858700 1 -- 172.21.15.59:0/535096399 wait complete. 2023-09-30T22:35:30.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.973+0000 7ff667858700 1 Processor -- start 2023-09-30T22:35:30.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.973+0000 7ff667858700 1 -- start start 2023-09-30T22:35:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff667858700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6600a0a30 0x7ff6601218c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff667858700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6600a1510 0x7ff660121e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff667858700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff660139250 0x7ff660122340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff667858700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6601236c0 con 0x7ff660139250 2023-09-30T22:35:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff667858700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6601234d0 con 0x7ff6600a0a30 2023-09-30T22:35:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff667858700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6601253e0 con 0x7ff6600a1510 2023-09-30T22:35:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff665df5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff660139250 0x7ff660122340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff6655f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6600a0a30 0x7ff6601218c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff665df5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff660139250 0x7ff660122340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37830/0 (socket says 172.21.15.59:37830) 2023-09-30T22:35:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff665df5700 1 -- 172.21.15.59:0/464268214 learned_addr learned my addr 172.21.15.59:0/464268214 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff6655f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6600a0a30 0x7ff6601218c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46902/0 (socket says 172.21.15.59:46902) 2023-09-30T22:35:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff664df3700 1 --2- 172.21.15.59:0/464268214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6600a1510 0x7ff660121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff6655f4700 1 -- 172.21.15.59:0/464268214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6600a1510 msgr2=0x7ff660121e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff6655f4700 1 --2- 172.21.15.59:0/464268214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6600a1510 0x7ff660121e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff6655f4700 1 -- 172.21.15.59:0/464268214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff660139250 msgr2=0x7ff660122340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff6655f4700 1 --2- 172.21.15.59:0/464268214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff660139250 0x7ff660122340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff6655f4700 1 -- 172.21.15.59:0/464268214 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6500094a0 con 0x7ff6600a0a30 2023-09-30T22:35:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff665df5700 1 --2- 172.21.15.59:0/464268214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff660139250 0x7ff660122340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.974+0000 7ff6655f4700 1 --2- 172.21.15.59:0/464268214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6600a0a30 0x7ff6601218c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff65800cbb0 tx=0x7ff65800cec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.975+0000 7ff65dffb700 1 -- 172.21.15.59:0/464268214 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658003c00 con 0x7ff6600a0a30 2023-09-30T22:35:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.975+0000 7ff65dffb700 1 -- 172.21.15.59:0/464268214 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff658003d60 con 0x7ff6600a0a30 2023-09-30T22:35:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.975+0000 7ff667858700 1 -- 172.21.15.59:0/464268214 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff654009550 con 0x7ff6600a0a30 2023-09-30T22:35:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.975+0000 7ff65dffb700 1 -- 172.21.15.59:0/464268214 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65800aae0 con 0x7ff6600a0a30 2023-09-30T22:35:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.975+0000 7ff667858700 1 -- 172.21.15.59:0/464268214 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff660125100 con 0x7ff6600a0a30 2023-09-30T22:35:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.976+0000 7ff65dffb700 1 -- 172.21.15.59:0/464268214 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff65800ac40 con 0x7ff6600a0a30 2023-09-30T22:35:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.976+0000 7ff65dffb700 1 -- 172.21.15.59:0/464268214 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff65803f610 con 0x7ff6600a0a30 2023-09-30T22:35:30.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.976+0000 7ff667858700 1 -- 172.21.15.59:0/464268214 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff660123d20 con 0x7ff6600a0a30 2023-09-30T22:35:30.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:30.981+0000 7ff65dffb700 1 -- 172.21.15.59:0/464268214 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6580198f0 con 0x7ff6600a0a30 2023-09-30T22:35:31.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.152+0000 7fc7e768b700 1 -- 172.21.15.59:0/77133906 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc7e006c360 con 0x7fc7e0131b40 2023-09-30T22:35:31.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.152+0000 7fc7d5ffb700 1 -- 172.21.15.59:0/77133906 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7dc030020 con 0x7fc7e0131b40 2023-09-30T22:35:31.153 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.154+0000 7fc7e768b700 1 -- 172.21.15.59:0/77133906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e0131b40 msgr2=0x7fc7e011db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.154+0000 7fc7e768b700 1 --2- 172.21.15.59:0/77133906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e0131b40 0x7fc7e011db30 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc016000 tx=0x7fc7dc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.154+0000 7fc7e768b700 1 -- 172.21.15.59:0/77133906 shutdown_connections 2023-09-30T22:35:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.154+0000 7fc7e768b700 1 --2- 172.21.15.59:0/77133906 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7e006a770 0x7fc7e011d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.154+0000 7fc7e768b700 1 --2- 172.21.15.59:0/77133906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7e0131b40 0x7fc7e011db30 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.154+0000 7fc7e768b700 1 --2- 172.21.15.59:0/77133906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e006b080 0x7fc7e011d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.154+0000 7fc7e768b700 1 -- 172.21.15.59:0/77133906 >> 172.21.15.59:0/77133906 conn(0x7fc7e0066f50 msgr2=0x7fc7e00a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.155+0000 7fc7e768b700 1 -- 172.21.15.59:0/77133906 shutdown_connections 2023-09-30T22:35:31.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.155+0000 7fc7e768b700 1 -- 172.21.15.59:0/77133906 wait complete. 2023-09-30T22:35:31.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.185+0000 7ff667858700 1 -- 172.21.15.59:0/464268214 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff660074ea0 con 0x7ff6600a0a30 2023-09-30T22:35:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.185+0000 7ff65dffb700 1 -- 172.21.15.59:0/464268214 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff658019300 con 0x7ff6600a0a30 2023-09-30T22:35:31.187 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.188+0000 7ff667858700 1 -- 172.21.15.59:0/464268214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6600a0a30 msgr2=0x7ff6601218c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.188+0000 7ff667858700 1 --2- 172.21.15.59:0/464268214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6600a0a30 0x7ff6601218c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff65800cbb0 tx=0x7ff65800cec0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.188+0000 7ff667858700 1 -- 172.21.15.59:0/464268214 shutdown_connections 2023-09-30T22:35:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.188+0000 7ff667858700 1 --2- 172.21.15.59:0/464268214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff660139250 0x7ff660122340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.188+0000 7ff667858700 1 --2- 172.21.15.59:0/464268214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6600a0a30 0x7ff6601218c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.188+0000 7ff667858700 1 --2- 172.21.15.59:0/464268214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff6600a1510 0x7ff660121e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.188+0000 7ff667858700 1 -- 172.21.15.59:0/464268214 >> 172.21.15.59:0/464268214 conn(0x7ff6600a6550 msgr2=0x7ff660137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.188+0000 7ff667858700 1 -- 172.21.15.59:0/464268214 shutdown_connections 2023-09-30T22:35:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.188+0000 7ff667858700 1 -- 172.21.15.59:0/464268214 wait complete. 2023-09-30T22:35:31.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:31.281 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:31.326 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:31.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.426+0000 7f64439c5700 1 Processor -- start 2023-09-30T22:35:31.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.426+0000 7f64439c5700 1 -- start start 2023-09-30T22:35:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.427+0000 7f64439c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f643c09e1d0 0x7f643c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.427+0000 7f64439c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f643c139170 0x7f643c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.427+0000 7f64439c5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643c09b120 con 0x7f643c09d6f0 2023-09-30T22:35:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.427+0000 7f64439c5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643c06b460 con 0x7f643c09e1d0 2023-09-30T22:35:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.427+0000 7f64439c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643c09a7e0 con 0x7f643c139170 2023-09-30T22:35:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.427+0000 7f6441f62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f643c139170 0x7f643c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.427+0000 7f6440f60700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f643c09e1d0 0x7f643c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:31.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.427+0000 7f6441f62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f643c139170 0x7f643c13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46910/0 (socket says 172.21.15.59:46910) 2023-09-30T22:35:31.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.427+0000 7f6441f62700 1 -- 172.21.15.59:0/3096752343 learned_addr learned my addr 172.21.15.59:0/3096752343 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:31.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.427+0000 7f6441f62700 1 -- 172.21.15.59:0/3096752343 >> v2:172.21.15.59:3300/0 conn(0x7f643c09e1d0 msgr2=0x7f643c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:31.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.428+0000 7f6441f62700 1 --2- 172.21.15.59:0/3096752343 >> v2:172.21.15.59:3300/0 conn(0x7f643c09e1d0 0x7f643c138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.428+0000 7f6441f62700 1 -- 172.21.15.59:0/3096752343 >> v1:172.21.15.59:6789/0 conn(0x7f643c09d6f0 legacy=0x7f643c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:31.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.428+0000 7f6441f62700 1 -- 172.21.15.59:0/3096752343 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c09a500 con 0x7f643c139170 2023-09-30T22:35:31.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.428+0000 7f6440f60700 1 --2- 172.21.15.59:0/3096752343 >> v2:172.21.15.59:3300/0 conn(0x7f643c09e1d0 0x7f643c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:31.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.428+0000 7f6441f62700 1 --2- 172.21.15.59:0/3096752343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f643c139170 0x7f643c13b550 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6434009e80 tx=0x7f643400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9af4ddac1860be7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:31.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.428+0000 7f6433fff700 1 -- 172.21.15.59:0/3096752343 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643400e070 con 0x7f643c139170 2023-09-30T22:35:31.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.428+0000 7f6433fff700 1 -- 172.21.15.59:0/3096752343 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643400b8d0 con 0x7f643c139170 2023-09-30T22:35:31.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.428+0000 7f6433fff700 1 -- 172.21.15.59:0/3096752343 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643400bc80 con 0x7f643c139170 2023-09-30T22:35:31.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.429+0000 7f64439c5700 1 -- 172.21.15.59:0/3096752343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f643c139170 msgr2=0x7f643c13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:31.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.429+0000 7f64439c5700 1 --2- 172.21.15.59:0/3096752343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f643c139170 0x7f643c13b550 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6434009e80 tx=0x7f643400b330 comp rx=0 tx=0).stop 2023-09-30T22:35:31.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.429+0000 7f64439c5700 1 -- 172.21.15.59:0/3096752343 shutdown_connections 2023-09-30T22:35:31.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.429+0000 7f64439c5700 1 --2- 172.21.15.59:0/3096752343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f643c139170 0x7f643c13b550 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.429+0000 7f64439c5700 1 --2- 172.21.15.59:0/3096752343 >> v2:172.21.15.59:3300/0 conn(0x7f643c09e1d0 0x7f643c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.429+0000 7f64439c5700 1 -- 172.21.15.59:0/3096752343 >> 172.21.15.59:0/3096752343 conn(0x7f643c066f50 msgr2=0x7f643c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:31.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.429+0000 7f64439c5700 1 -- 172.21.15.59:0/3096752343 shutdown_connections 2023-09-30T22:35:31.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.429+0000 7f64439c5700 1 -- 172.21.15.59:0/3096752343 wait complete. 2023-09-30T22:35:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.430+0000 7f64439c5700 1 Processor -- start 2023-09-30T22:35:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.430+0000 7f64439c5700 1 -- start start 2023-09-30T22:35:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.430+0000 7f64439c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f643c09d6f0 0x7f643c1c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.430+0000 7f64439c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f643c09e1d0 0x7f643c1c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.430+0000 7f64439c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f643c139170 0x7f643c11e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.430+0000 7f64439c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c122110 con 0x7f643c09e1d0 2023-09-30T22:35:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.430+0000 7f64439c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643c120400 con 0x7f643c09d6f0 2023-09-30T22:35:31.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.430+0000 7f64439c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f643c121d70 con 0x7f643c139170 2023-09-30T22:35:31.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.430+0000 7f6441761700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f643c09d6f0 0x7f643c1c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:31.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.430+0000 7f6440f60700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f643c09e1d0 0x7f643c1c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:31.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.430+0000 7f6440f60700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f643c09e1d0 0x7f643c1c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37850/0 (socket says 172.21.15.59:37850) 2023-09-30T22:35:31.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.430+0000 7f6440f60700 1 -- 172.21.15.59:0/2870252439 learned_addr learned my addr 172.21.15.59:0/2870252439 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:31.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.430+0000 7f6441761700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f643c09d6f0 0x7f643c1c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46912/0 (socket says 172.21.15.59:46912) 2023-09-30T22:35:31.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.431+0000 7f6441761700 1 -- 172.21.15.59:0/2870252439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f643c139170 msgr2=0x7f643c11e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:31.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.431+0000 7f6441761700 1 --2- 172.21.15.59:0/2870252439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f643c139170 0x7f643c11e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.431+0000 7f6441761700 1 -- 172.21.15.59:0/2870252439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f643c09e1d0 msgr2=0x7f643c1c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:31.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.431+0000 7f6441761700 1 --2- 172.21.15.59:0/2870252439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f643c09e1d0 0x7f643c1c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.431+0000 7f6441761700 1 -- 172.21.15.59:0/2870252439 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c0094a0 con 0x7f643c09d6f0 2023-09-30T22:35:31.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.431+0000 7f6440f60700 1 --2- 172.21.15.59:0/2870252439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f643c09e1d0 0x7f643c1c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:31.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.431+0000 7f6441761700 1 --2- 172.21.15.59:0/2870252439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f643c09d6f0 0x7f643c1c84d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6438000f60 tx=0x7f643800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.431+0000 7f6431ffb700 1 -- 172.21.15.59:0/2870252439 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64380052d0 con 0x7f643c09d6f0 2023-09-30T22:35:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.431+0000 7f6431ffb700 1 -- 172.21.15.59:0/2870252439 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6438005430 con 0x7f643c09d6f0 2023-09-30T22:35:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.431+0000 7f64439c5700 1 -- 172.21.15.59:0/2870252439 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6434009b30 con 0x7f643c09d6f0 2023-09-30T22:35:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.431+0000 7f6431ffb700 1 -- 172.21.15.59:0/2870252439 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64380038c0 con 0x7f643c09d6f0 2023-09-30T22:35:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.431+0000 7f64439c5700 1 -- 172.21.15.59:0/2870252439 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643c122aa0 con 0x7f643c09d6f0 2023-09-30T22:35:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.432+0000 7f6431ffb700 1 -- 172.21.15.59:0/2870252439 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6438003a20 con 0x7f643c09d6f0 2023-09-30T22:35:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.432+0000 7f6431ffb700 1 -- 172.21.15.59:0/2870252439 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f643803eb90 con 0x7f643c09d6f0 2023-09-30T22:35:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.432+0000 7f64439c5700 1 -- 172.21.15.59:0/2870252439 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643c074ea0 con 0x7f643c09d6f0 2023-09-30T22:35:31.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.437+0000 7f6431ffb700 1 -- 172.21.15.59:0/2870252439 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6438017020 con 0x7f643c09d6f0 2023-09-30T22:35:31.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.468+0000 7f167e476700 1 Processor -- start 2023-09-30T22:35:31.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.468+0000 7f167e476700 1 -- start start 2023-09-30T22:35:31.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.468+0000 7f167e476700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167809d630 0x7f16780a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:31.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.468+0000 7f167e476700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1678138d80 0x7f167813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:31.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f167e476700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16780a2a70 con 0x7f16780a0a30 2023-09-30T22:35:31.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f167e476700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16780a01d0 con 0x7f1678138d80 2023-09-30T22:35:31.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f167e476700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167809e2b0 con 0x7f167809d630 2023-09-30T22:35:31.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f16777fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167809d630 0x7f16780a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:31.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f167ca13700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1678138d80 0x7f167813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:31.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f16777fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167809d630 0x7f16780a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46928/0 (socket says 172.21.15.59:46928) 2023-09-30T22:35:31.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f16777fe700 1 -- 172.21.15.59:0/849412346 learned_addr learned my addr 172.21.15.59:0/849412346 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:31.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f16777fe700 1 -- 172.21.15.59:0/849412346 >> v2:172.21.15.59:3300/0 conn(0x7f1678138d80 msgr2=0x7f167813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:31.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f16777fe700 1 --2- 172.21.15.59:0/849412346 >> v2:172.21.15.59:3300/0 conn(0x7f1678138d80 0x7f167813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f16777fe700 1 -- 172.21.15.59:0/849412346 >> v1:172.21.15.59:6789/0 conn(0x7f16780a0a30 legacy=0x7f16780a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:31.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f16777fe700 1 -- 172.21.15.59:0/849412346 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167809dc50 con 0x7f167809d630 2023-09-30T22:35:31.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f167ca13700 1 --2- 172.21.15.59:0/849412346 >> v2:172.21.15.59:3300/0 conn(0x7f1678138d80 0x7f167813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:31.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f16777fe700 1 --2- 172.21.15.59:0/849412346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167809d630 0x7f16780a1510 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f166c0098f0 tx=0x7f166c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1e57809d8c59b27 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:31.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f1676ffd700 1 -- 172.21.15.59:0/849412346 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c011830 con 0x7f167809d630 2023-09-30T22:35:31.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f1676ffd700 1 -- 172.21.15.59:0/849412346 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166c011990 con 0x7f167809d630 2023-09-30T22:35:31.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.469+0000 7f1676ffd700 1 -- 172.21.15.59:0/849412346 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c011d20 con 0x7f167809d630 2023-09-30T22:35:31.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.470+0000 7f167e476700 1 -- 172.21.15.59:0/849412346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167809d630 msgr2=0x7f16780a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:31.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.470+0000 7f167e476700 1 --2- 172.21.15.59:0/849412346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167809d630 0x7f16780a1510 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f166c0098f0 tx=0x7f166c009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:31.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.470+0000 7f167e476700 1 -- 172.21.15.59:0/849412346 shutdown_connections 2023-09-30T22:35:31.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.470+0000 7f167e476700 1 --2- 172.21.15.59:0/849412346 >> v2:172.21.15.59:3300/0 conn(0x7f1678138d80 0x7f167813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.470+0000 7f167e476700 1 --2- 172.21.15.59:0/849412346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167809d630 0x7f16780a1510 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.470+0000 7f167e476700 1 -- 172.21.15.59:0/849412346 >> 172.21.15.59:0/849412346 conn(0x7f16780a3050 msgr2=0x7f16780a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:31.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.470+0000 7f167e476700 1 -- 172.21.15.59:0/849412346 shutdown_connections 2023-09-30T22:35:31.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.470+0000 7f167e476700 1 -- 172.21.15.59:0/849412346 wait complete. 2023-09-30T22:35:31.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.471+0000 7f167e476700 1 Processor -- start 2023-09-30T22:35:31.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.471+0000 7f167e476700 1 -- start start 2023-09-30T22:35:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f167e476700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f167809d630 0x7f1678133b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f167e476700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16780a0a30 0x7f1678134090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f167e476700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1678138d80 0x7f16781345d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f167e476700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1678135010 con 0x7f16780a0a30 2023-09-30T22:35:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f167e476700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167813afc0 con 0x7f1678138d80 2023-09-30T22:35:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f167e476700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1678135c30 con 0x7f167809d630 2023-09-30T22:35:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f16777fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16780a0a30 0x7f1678134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f16777fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16780a0a30 0x7f1678134090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37870/0 (socket says 172.21.15.59:37870) 2023-09-30T22:35:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f16777fe700 1 -- 172.21.15.59:0/1235492758 learned_addr learned my addr 172.21.15.59:0/1235492758 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f167ca13700 1 --2- 172.21.15.59:0/1235492758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1678138d80 0x7f16781345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f1677fff700 1 --2- 172.21.15.59:0/1235492758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f167809d630 0x7f1678133b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f16777fe700 1 -- 172.21.15.59:0/1235492758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f167809d630 msgr2=0x7f1678133b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f16777fe700 1 --2- 172.21.15.59:0/1235492758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f167809d630 0x7f1678133b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f16777fe700 1 -- 172.21.15.59:0/1235492758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1678138d80 msgr2=0x7f16781345d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f16777fe700 1 --2- 172.21.15.59:0/1235492758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1678138d80 0x7f16781345d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f16777fe700 1 -- 172.21.15.59:0/1235492758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1670009a70 con 0x7f16780a0a30 2023-09-30T22:35:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.472+0000 7f167ca13700 1 --2- 172.21.15.59:0/1235492758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1678138d80 0x7f16781345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.473+0000 7f16777fe700 1 --2- 172.21.15.59:0/1235492758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16780a0a30 0x7f1678134090 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f166c009c40 tx=0x7f166c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.473+0000 7f1674ff9700 1 -- 172.21.15.59:0/1235492758 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c0045d0 con 0x7f16780a0a30 2023-09-30T22:35:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.473+0000 7f1674ff9700 1 -- 172.21.15.59:0/1235492758 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166c0036a0 con 0x7f16780a0a30 2023-09-30T22:35:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.473+0000 7f167e476700 1 -- 172.21.15.59:0/1235492758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166c009550 con 0x7f16780a0a30 2023-09-30T22:35:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.473+0000 7f1674ff9700 1 -- 172.21.15.59:0/1235492758 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c003a10 con 0x7f16780a0a30 2023-09-30T22:35:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.473+0000 7f167e476700 1 -- 172.21.15.59:0/1235492758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1678137590 con 0x7f16780a0a30 2023-09-30T22:35:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.474+0000 7f1674ff9700 1 -- 172.21.15.59:0/1235492758 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f166c021070 con 0x7f16780a0a30 2023-09-30T22:35:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.474+0000 7f1674ff9700 1 -- 172.21.15.59:0/1235492758 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f166c040a40 con 0x7f16780a0a30 2023-09-30T22:35:31.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.474+0000 7f167e476700 1 -- 172.21.15.59:0/1235492758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16780747f0 con 0x7f16780a0a30 2023-09-30T22:35:31.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.479+0000 7f1674ff9700 1 -- 172.21.15.59:0/1235492758 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f166c015080 con 0x7f16780a0a30 2023-09-30T22:35:31.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.643+0000 7f64439c5700 1 -- 172.21.15.59:0/2870252439 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f643c09f420 con 0x7f643c09d6f0 2023-09-30T22:35:31.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.644+0000 7f6431ffb700 1 -- 172.21.15.59:0/2870252439 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6438019e60 con 0x7f643c09d6f0 2023-09-30T22:35:31.645 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.646+0000 7f64439c5700 1 -- 172.21.15.59:0/2870252439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f643c09d6f0 msgr2=0x7f643c1c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.646+0000 7f64439c5700 1 --2- 172.21.15.59:0/2870252439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f643c09d6f0 0x7f643c1c84d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6438000f60 tx=0x7f643800c730 comp rx=0 tx=0).stop 2023-09-30T22:35:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.646+0000 7f64439c5700 1 -- 172.21.15.59:0/2870252439 shutdown_connections 2023-09-30T22:35:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.646+0000 7f64439c5700 1 --2- 172.21.15.59:0/2870252439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f643c139170 0x7f643c11e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.646+0000 7f64439c5700 1 --2- 172.21.15.59:0/2870252439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f643c09d6f0 0x7f643c1c84d0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.646+0000 7f64439c5700 1 --2- 172.21.15.59:0/2870252439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f643c09e1d0 0x7f643c1c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.646+0000 7f64439c5700 1 -- 172.21.15.59:0/2870252439 >> 172.21.15.59:0/2870252439 conn(0x7f643c066f50 msgr2=0x7f643c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.646+0000 7f64439c5700 1 -- 172.21.15.59:0/2870252439 shutdown_connections 2023-09-30T22:35:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.646+0000 7f64439c5700 1 -- 172.21.15.59:0/2870252439 wait complete. 2023-09-30T22:35:31.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:31.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.686+0000 7f167e476700 1 -- 172.21.15.59:0/1235492758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1678072980 con 0x7f16780a0a30 2023-09-30T22:35:31.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.686+0000 7f1674ff9700 1 -- 172.21.15.59:0/1235492758 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f166c029020 con 0x7f16780a0a30 2023-09-30T22:35:31.688 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.689+0000 7f167e476700 1 -- 172.21.15.59:0/1235492758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16780a0a30 msgr2=0x7f1678134090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.689+0000 7f167e476700 1 --2- 172.21.15.59:0/1235492758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16780a0a30 0x7f1678134090 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f166c009c40 tx=0x7f166c004750 comp rx=0 tx=0).stop 2023-09-30T22:35:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.689+0000 7f167e476700 1 -- 172.21.15.59:0/1235492758 shutdown_connections 2023-09-30T22:35:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.689+0000 7f167e476700 1 --2- 172.21.15.59:0/1235492758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f167809d630 0x7f1678133b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.689+0000 7f167e476700 1 --2- 172.21.15.59:0/1235492758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1678138d80 0x7f16781345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.689+0000 7f167e476700 1 --2- 172.21.15.59:0/1235492758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16780a0a30 0x7f1678134090 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.689+0000 7f167e476700 1 -- 172.21.15.59:0/1235492758 >> 172.21.15.59:0/1235492758 conn(0x7f16780a3050 msgr2=0x7f167809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.689+0000 7f167e476700 1 -- 172.21.15.59:0/1235492758 shutdown_connections 2023-09-30T22:35:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:31.689+0000 7f167e476700 1 -- 172.21.15.59:0/1235492758 wait complete. 2023-09-30T22:35:31.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:32.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:32.203 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:32.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.317+0000 7fcf218fc700 1 Processor -- start 2023-09-30T22:35:32.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.317+0000 7fcf218fc700 1 -- start start 2023-09-30T22:35:32.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.317+0000 7fcf218fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf1c130670 0x7fcf1c130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.318+0000 7fcf218fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf1c06f680 0x7fcf1c06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.318+0000 7fcf218fc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c130260 con 0x7fcf1c06ffd0 2023-09-30T22:35:32.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.318+0000 7fcf218fc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c071ff0 con 0x7fcf1c06f680 2023-09-30T22:35:32.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.318+0000 7fcf218fc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c09ecf0 con 0x7fcf1c130670 2023-09-30T22:35:32.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.318+0000 7fcf1affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf1c130670 0x7fcf1c130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.318+0000 7fcf1a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf1c06f680 0x7fcf1c06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.318+0000 7fcf1a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf1c06f680 0x7fcf1c06fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37882/0 (socket says 172.21.15.59:37882) 2023-09-30T22:35:32.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.318+0000 7fcf1affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf1c130670 0x7fcf1c130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46954/0 (socket says 172.21.15.59:46954) 2023-09-30T22:35:32.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.318+0000 7fcf1a7fc700 1 -- 172.21.15.59:0/2420179289 learned_addr learned my addr 172.21.15.59:0/2420179289 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:32.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.318+0000 7fcf1affd700 1 -- 172.21.15.59:0/2420179289 >> v2:172.21.15.59:3300/0 conn(0x7fcf1c06f680 msgr2=0x7fcf1c06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.318+0000 7fcf1affd700 1 --2- 172.21.15.59:0/2420179289 >> v2:172.21.15.59:3300/0 conn(0x7fcf1c06f680 0x7fcf1c06fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.318+0000 7fcf1affd700 1 -- 172.21.15.59:0/2420179289 >> v1:172.21.15.59:6789/0 conn(0x7fcf1c06ffd0 legacy=0x7fcf1c137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.318+0000 7fcf1affd700 1 -- 172.21.15.59:0/2420179289 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c070e70 con 0x7fcf1c130670 2023-09-30T22:35:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.318+0000 7fcf1a7fc700 1 --2- 172.21.15.59:0/2420179289 >> v2:172.21.15.59:3300/0 conn(0x7fcf1c06f680 0x7fcf1c06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.318+0000 7fcf1affd700 1 --2- 172.21.15.59:0/2420179289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf1c130670 0x7fcf1c130a40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009d90 tx=0x7fcf0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42eed19b8e4c74b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.319+0000 7fcf19ffb700 1 -- 172.21.15.59:0/2420179289 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c00e070 con 0x7fcf1c130670 2023-09-30T22:35:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.319+0000 7fcf19ffb700 1 -- 172.21.15.59:0/2420179289 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c00bb20 con 0x7fcf1c130670 2023-09-30T22:35:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.319+0000 7fcf19ffb700 1 -- 172.21.15.59:0/2420179289 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c012430 con 0x7fcf1c130670 2023-09-30T22:35:32.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.319+0000 7fcf218fc700 1 -- 172.21.15.59:0/2420179289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf1c130670 msgr2=0x7fcf1c130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.319+0000 7fcf218fc700 1 --2- 172.21.15.59:0/2420179289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf1c130670 0x7fcf1c130a40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009d90 tx=0x7fcf0c00b330 comp rx=0 tx=0).stop 2023-09-30T22:35:32.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.320+0000 7fcf218fc700 1 -- 172.21.15.59:0/2420179289 shutdown_connections 2023-09-30T22:35:32.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.320+0000 7fcf218fc700 1 --2- 172.21.15.59:0/2420179289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf1c130670 0x7fcf1c130a40 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.320+0000 7fcf218fc700 1 --2- 172.21.15.59:0/2420179289 >> v2:172.21.15.59:3300/0 conn(0x7fcf1c06f680 0x7fcf1c06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.320+0000 7fcf218fc700 1 -- 172.21.15.59:0/2420179289 >> 172.21.15.59:0/2420179289 conn(0x7fcf1c0a2aa0 msgr2=0x7fcf1c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:32.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.320+0000 7fcf218fc700 1 -- 172.21.15.59:0/2420179289 shutdown_connections 2023-09-30T22:35:32.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.320+0000 7fcf218fc700 1 -- 172.21.15.59:0/2420179289 wait complete. 2023-09-30T22:35:32.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.321+0000 7fcf218fc700 1 Processor -- start 2023-09-30T22:35:32.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.321+0000 7fcf218fc700 1 -- start start 2023-09-30T22:35:32.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.321+0000 7fcf218fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf1c06f680 0x7fcf1c11b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.321+0000 7fcf218fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf1c06ffd0 0x7fcf1c11be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.321+0000 7fcf218fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf1c130670 0x7fcf1c11c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.321+0000 7fcf218fc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c12ec10 con 0x7fcf1c130670 2023-09-30T22:35:32.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.321+0000 7fcf218fc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c11cce0 con 0x7fcf1c06ffd0 2023-09-30T22:35:32.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.321+0000 7fcf218fc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c11eb50 con 0x7fcf1c06f680 2023-09-30T22:35:32.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf1a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf1c06ffd0 0x7fcf1c11be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf1affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf1c06f680 0x7fcf1c11b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf1a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf1c06ffd0 0x7fcf1c11be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46956/0 (socket says 172.21.15.59:46956) 2023-09-30T22:35:32.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf1a7fc700 1 -- 172.21.15.59:0/4082279447 learned_addr learned my addr 172.21.15.59:0/4082279447 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:32.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf1b7fe700 1 --2- 172.21.15.59:0/4082279447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf1c130670 0x7fcf1c11c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf1a7fc700 1 -- 172.21.15.59:0/4082279447 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf1c06f680 msgr2=0x7fcf1c11b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf1a7fc700 1 --2- 172.21.15.59:0/4082279447 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf1c06f680 0x7fcf1c11b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf1a7fc700 1 -- 172.21.15.59:0/4082279447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf1c130670 msgr2=0x7fcf1c11c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf1a7fc700 1 --2- 172.21.15.59:0/4082279447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf1c130670 0x7fcf1c11c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf1a7fc700 1 -- 172.21.15.59:0/4082279447 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0400b7f0 con 0x7fcf1c06ffd0 2023-09-30T22:35:32.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf1affd700 1 --2- 172.21.15.59:0/4082279447 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf1c06f680 0x7fcf1c11b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:32.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf1b7fe700 1 --2- 172.21.15.59:0/4082279447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf1c130670 0x7fcf1c11c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:32.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf1a7fc700 1 --2- 172.21.15.59:0/4082279447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf1c06ffd0 0x7fcf1c11be30 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcf04010ee0 tx=0x7fcf0400e640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:32.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf13fff700 1 -- 172.21.15.59:0/4082279447 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04011650 con 0x7fcf1c06ffd0 2023-09-30T22:35:32.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf13fff700 1 -- 172.21.15.59:0/4082279447 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf040117b0 con 0x7fcf1c06ffd0 2023-09-30T22:35:32.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf218fc700 1 -- 172.21.15.59:0/4082279447 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c009a70 con 0x7fcf1c06ffd0 2023-09-30T22:35:32.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf13fff700 1 -- 172.21.15.59:0/4082279447 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04011b60 con 0x7fcf1c06ffd0 2023-09-30T22:35:32.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.322+0000 7fcf218fc700 1 -- 172.21.15.59:0/4082279447 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c11f460 con 0x7fcf1c06ffd0 2023-09-30T22:35:32.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.323+0000 7fcf13fff700 1 -- 172.21.15.59:0/4082279447 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf04011cc0 con 0x7fcf1c06ffd0 2023-09-30T22:35:32.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.324+0000 7fcf13fff700 1 -- 172.21.15.59:0/4082279447 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcf04042390 con 0x7fcf1c06ffd0 2023-09-30T22:35:32.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.324+0000 7fcf218fc700 1 -- 172.21.15.59:0/4082279447 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c11ed10 con 0x7fcf1c06ffd0 2023-09-30T22:35:32.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.328+0000 7fcf13fff700 1 -- 172.21.15.59:0/4082279447 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf040183a0 con 0x7fcf1c06ffd0 2023-09-30T22:35:32.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.354+0000 7f7afa871700 1 Processor -- start 2023-09-30T22:35:32.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.354+0000 7f7afa871700 1 -- start start 2023-09-30T22:35:32.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.355+0000 7f7afa871700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af40a0a30 0x7f7af40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.355+0000 7f7afa871700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af409d630 0x7f7af40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.355+0000 7f7afa871700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af40a2a70 con 0x7f7af4133930 2023-09-30T22:35:32.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.355+0000 7f7afa871700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af40a01d0 con 0x7f7af409d630 2023-09-30T22:35:32.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.355+0000 7f7afa871700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7af409e2b0 con 0x7f7af40a0a30 2023-09-30T22:35:32.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.355+0000 7f7af37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af409d630 0x7f7af40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.355+0000 7f7af8e0e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7af4133930 0x7f7af4133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40228/0 (socket says 172.21.15.59:40228) 2023-09-30T22:35:32.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.355+0000 7f7af8e0e700 1 -- 172.21.15.59:0/3259331218 learned_addr learned my addr 172.21.15.59:0/3259331218 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:32.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.355+0000 7f7af37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af409d630 0x7f7af40a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46958/0 (socket says 172.21.15.59:46958) 2023-09-30T22:35:32.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.355+0000 7f7af3fff700 1 --2- 172.21.15.59:0/3259331218 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af40a0a30 0x7f7af40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.356+0000 7f7af3fff700 1 -- 172.21.15.59:0/3259331218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af409d630 msgr2=0x7f7af40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:32.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.356+0000 7f7af3fff700 1 --2- 172.21.15.59:0/3259331218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af409d630 0x7f7af40a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.356+0000 7f7af3fff700 1 -- 172.21.15.59:0/3259331218 >> v1:172.21.15.59:6789/0 conn(0x7f7af4133930 legacy=0x7f7af4133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.356+0000 7f7af2ffd700 1 -- 172.21.15.59:0/3259331218 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475447769 0 0) 0x7f7af40a2a70 con 0x7f7af4133930 2023-09-30T22:35:32.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.356+0000 7f7af3fff700 1 -- 172.21.15.59:0/3259331218 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af409dc50 con 0x7f7af40a0a30 2023-09-30T22:35:32.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.356+0000 7f7af37fe700 1 --2- 172.21.15.59:0/3259331218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af409d630 0x7f7af40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:32.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.356+0000 7f7af3fff700 1 --2- 172.21.15.59:0/3259331218 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af40a0a30 0x7f7af40a0e00 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009870 tx=0x7f7ae4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=975d578e84cba17f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:32.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.356+0000 7f7af2ffd700 1 -- 172.21.15.59:0/3259331218 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4011830 con 0x7f7af40a0a30 2023-09-30T22:35:32.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.356+0000 7f7af2ffd700 1 -- 172.21.15.59:0/3259331218 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae4011990 con 0x7f7af40a0a30 2023-09-30T22:35:32.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.356+0000 7f7af2ffd700 1 -- 172.21.15.59:0/3259331218 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4011d20 con 0x7f7af40a0a30 2023-09-30T22:35:32.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.357+0000 7f7afa871700 1 -- 172.21.15.59:0/3259331218 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af40a0a30 msgr2=0x7f7af40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.357+0000 7f7afa871700 1 --2- 172.21.15.59:0/3259331218 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af40a0a30 0x7f7af40a0e00 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009870 tx=0x7f7ae4009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:32.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.357+0000 7f7afa871700 1 -- 172.21.15.59:0/3259331218 shutdown_connections 2023-09-30T22:35:32.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.357+0000 7f7afa871700 1 --2- 172.21.15.59:0/3259331218 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af40a0a30 0x7f7af40a0e00 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.357+0000 7f7afa871700 1 --2- 172.21.15.59:0/3259331218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af409d630 0x7f7af40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.357+0000 7f7afa871700 1 -- 172.21.15.59:0/3259331218 >> 172.21.15.59:0/3259331218 conn(0x7f7af40a3050 msgr2=0x7f7af40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:32.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.357+0000 7f7afa871700 1 -- 172.21.15.59:0/3259331218 shutdown_connections 2023-09-30T22:35:32.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.357+0000 7f7afa871700 1 -- 172.21.15.59:0/3259331218 wait complete. 2023-09-30T22:35:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.358+0000 7f7afa871700 1 Processor -- start 2023-09-30T22:35:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.358+0000 7f7afa871700 1 -- start start 2023-09-30T22:35:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7afa871700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af409d630 0x7f7af41c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7afa871700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af40a0a30 0x7f7af41c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7afa871700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af4133930 0x7f7af41c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7afa871700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af41207a0 con 0x7f7af40a0a30 2023-09-30T22:35:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7afa871700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af40a0410 con 0x7f7af409d630 2023-09-30T22:35:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7afa871700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7af4122110 con 0x7f7af4133930 2023-09-30T22:35:32.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7af3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af409d630 0x7f7af41c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7af37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af40a0a30 0x7f7af41c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7af3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af409d630 0x7f7af41c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46972/0 (socket says 172.21.15.59:46972) 2023-09-30T22:35:32.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7af8e0e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af4133930 0x7f7af41c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7af3fff700 1 -- 172.21.15.59:0/3877413880 learned_addr learned my addr 172.21.15.59:0/3877413880 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:32.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7af37fe700 1 -- 172.21.15.59:0/3877413880 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af4133930 msgr2=0x7f7af41c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7af37fe700 1 --2- 172.21.15.59:0/3877413880 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af4133930 0x7f7af41c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7af37fe700 1 -- 172.21.15.59:0/3877413880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af409d630 msgr2=0x7f7af41c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7af37fe700 1 --2- 172.21.15.59:0/3877413880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af409d630 0x7f7af41c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.359+0000 7f7af37fe700 1 -- 172.21.15.59:0/3877413880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae80094a0 con 0x7f7af40a0a30 2023-09-30T22:35:32.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.360+0000 7f7af8e0e700 1 --2- 172.21.15.59:0/3877413880 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af4133930 0x7f7af41c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:32.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.360+0000 7f7af3fff700 1 --2- 172.21.15.59:0/3877413880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af409d630 0x7f7af41c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.360+0000 7f7af37fe700 1 --2- 172.21.15.59:0/3877413880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af40a0a30 0x7f7af41c85d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800e980 tx=0x7f7ae800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.360+0000 7f7af0ff9700 1 -- 172.21.15.59:0/3877413880 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae800c690 con 0x7f7af40a0a30 2023-09-30T22:35:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.360+0000 7f7af0ff9700 1 -- 172.21.15.59:0/3877413880 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae800c7f0 con 0x7f7af40a0a30 2023-09-30T22:35:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.360+0000 7f7af0ff9700 1 -- 172.21.15.59:0/3877413880 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae800cb80 con 0x7f7af40a0a30 2023-09-30T22:35:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.360+0000 7f7afa871700 1 -- 172.21.15.59:0/3877413880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae40094a0 con 0x7f7af40a0a30 2023-09-30T22:35:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.360+0000 7f7afa871700 1 -- 172.21.15.59:0/3877413880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af4121770 con 0x7f7af40a0a30 2023-09-30T22:35:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.361+0000 7f7af0ff9700 1 -- 172.21.15.59:0/3877413880 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ae800cce0 con 0x7f7af40a0a30 2023-09-30T22:35:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.361+0000 7f7afa871700 1 -- 172.21.15.59:0/3877413880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af4133700 con 0x7f7af40a0a30 2023-09-30T22:35:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.361+0000 7f7af0ff9700 1 -- 172.21.15.59:0/3877413880 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7ae803fa40 con 0x7f7af40a0a30 2023-09-30T22:35:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.366+0000 7f7af0ff9700 1 -- 172.21.15.59:0/3877413880 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7af4133700 con 0x7f7af40a0a30 2023-09-30T22:35:32.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.537+0000 7fcf218fc700 1 -- 172.21.15.59:0/4082279447 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcf1c074ea0 con 0x7fcf1c06ffd0 2023-09-30T22:35:32.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.537+0000 7fcf13fff700 1 -- 172.21.15.59:0/4082279447 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf04017b30 con 0x7fcf1c06ffd0 2023-09-30T22:35:32.539 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:32.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.540+0000 7fcf218fc700 1 -- 172.21.15.59:0/4082279447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf1c06ffd0 msgr2=0x7fcf1c11be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.540+0000 7fcf218fc700 1 --2- 172.21.15.59:0/4082279447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf1c06ffd0 0x7fcf1c11be30 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcf04010ee0 tx=0x7fcf0400e640 comp rx=0 tx=0).stop 2023-09-30T22:35:32.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.540+0000 7fcf218fc700 1 -- 172.21.15.59:0/4082279447 shutdown_connections 2023-09-30T22:35:32.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.540+0000 7fcf218fc700 1 --2- 172.21.15.59:0/4082279447 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf1c06f680 0x7fcf1c11b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.540+0000 7fcf218fc700 1 --2- 172.21.15.59:0/4082279447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf1c130670 0x7fcf1c11c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.540+0000 7fcf218fc700 1 --2- 172.21.15.59:0/4082279447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf1c06ffd0 0x7fcf1c11be30 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.540+0000 7fcf218fc700 1 -- 172.21.15.59:0/4082279447 >> 172.21.15.59:0/4082279447 conn(0x7fcf1c0a2aa0 msgr2=0x7fcf1c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:32.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.540+0000 7fcf218fc700 1 -- 172.21.15.59:0/4082279447 shutdown_connections 2023-09-30T22:35:32.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.540+0000 7fcf218fc700 1 -- 172.21.15.59:0/4082279447 wait complete. 2023-09-30T22:35:32.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:32.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.575+0000 7f7afa871700 1 -- 172.21.15.59:0/3877413880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7af4133700 con 0x7f7af40a0a30 2023-09-30T22:35:32.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.576+0000 7f7af0ff9700 1 -- 172.21.15.59:0/3877413880 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7af4133700 con 0x7f7af40a0a30 2023-09-30T22:35:32.577 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:32.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.578+0000 7f7afa871700 1 -- 172.21.15.59:0/3877413880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af40a0a30 msgr2=0x7f7af41c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.578+0000 7f7afa871700 1 --2- 172.21.15.59:0/3877413880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af40a0a30 0x7f7af41c85d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800e980 tx=0x7f7ae800ec90 comp rx=0 tx=0).stop 2023-09-30T22:35:32.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.578+0000 7f7afa871700 1 -- 172.21.15.59:0/3877413880 shutdown_connections 2023-09-30T22:35:32.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.578+0000 7f7afa871700 1 --2- 172.21.15.59:0/3877413880 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7af4133930 0x7f7af41c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.578+0000 7f7afa871700 1 --2- 172.21.15.59:0/3877413880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af409d630 0x7f7af41c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.578+0000 7f7afa871700 1 --2- 172.21.15.59:0/3877413880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af40a0a30 0x7f7af41c85d0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.578+0000 7f7afa871700 1 -- 172.21.15.59:0/3877413880 >> 172.21.15.59:0/3877413880 conn(0x7f7af40a3050 msgr2=0x7f7af41bb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:32.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.578+0000 7f7afa871700 1 -- 172.21.15.59:0/3877413880 shutdown_connections 2023-09-30T22:35:32.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.578+0000 7f7afa871700 1 -- 172.21.15.59:0/3877413880 wait complete. 2023-09-30T22:35:32.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:32.662 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:32.705 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.806+0000 7f625dc61700 1 Processor -- start 2023-09-30T22:35:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.806+0000 7f625dc61700 1 -- start start 2023-09-30T22:35:32.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.806+0000 7f625dc61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f625809d6f0 0x7f625809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.806+0000 7f625dc61700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625809e000 0x7f6258134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.806+0000 7f625dc61700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625809b150 con 0x7f625809ace0 2023-09-30T22:35:32.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.806+0000 7f625dc61700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625809a500 con 0x7f625809d6f0 2023-09-30T22:35:32.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.806+0000 7f625dc61700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f625809f720 con 0x7f625809e000 2023-09-30T22:35:32.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.807+0000 7f6257fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625809e000 0x7f6258134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.807+0000 7f6256ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f625809ace0 0x7f62581339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40234/0 (socket says 172.21.15.59:40234) 2023-09-30T22:35:32.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.807+0000 7f6256ffd700 1 -- 172.21.15.59:0/1503937368 learned_addr learned my addr 172.21.15.59:0/1503937368 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:32.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.807+0000 7f62577fe700 1 --2- 172.21.15.59:0/1503937368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f625809d6f0 0x7f625809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.807+0000 7f6257fff700 1 -- 172.21.15.59:0/1503937368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f625809d6f0 msgr2=0x7f625809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:32.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.807+0000 7f6257fff700 1 --2- 172.21.15.59:0/1503937368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f625809d6f0 0x7f625809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.807+0000 7f6257fff700 1 -- 172.21.15.59:0/1503937368 >> v1:172.21.15.59:6789/0 conn(0x7f625809ace0 legacy=0x7f62581339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.807+0000 7f62567fc700 1 -- 172.21.15.59:0/1503937368 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728286443 0 0) 0x7f625809b150 con 0x7f625809ace0 2023-09-30T22:35:32.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.807+0000 7f6257fff700 1 -- 172.21.15.59:0/1503937368 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625806b490 con 0x7f625809e000 2023-09-30T22:35:32.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.807+0000 7f6257fff700 1 --2- 172.21.15.59:0/1503937368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625809e000 0x7f6258134100 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6250009dc0 tx=0x7f625000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb65932c45af6fd7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:32.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.807+0000 7f62567fc700 1 -- 172.21.15.59:0/1503937368 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625000e070 con 0x7f625809e000 2023-09-30T22:35:32.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.807+0000 7f62567fc700 1 -- 172.21.15.59:0/1503937368 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625000bb20 con 0x7f625809e000 2023-09-30T22:35:32.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.807+0000 7f62567fc700 1 -- 172.21.15.59:0/1503937368 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250012430 con 0x7f625809e000 2023-09-30T22:35:32.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.808+0000 7f625dc61700 1 -- 172.21.15.59:0/1503937368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625809e000 msgr2=0x7f6258134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.808+0000 7f625dc61700 1 --2- 172.21.15.59:0/1503937368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625809e000 0x7f6258134100 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6250009dc0 tx=0x7f625000b330 comp rx=0 tx=0).stop 2023-09-30T22:35:32.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.808+0000 7f625dc61700 1 -- 172.21.15.59:0/1503937368 shutdown_connections 2023-09-30T22:35:32.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.808+0000 7f625dc61700 1 --2- 172.21.15.59:0/1503937368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625809e000 0x7f6258134100 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.808+0000 7f625dc61700 1 --2- 172.21.15.59:0/1503937368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f625809d6f0 0x7f625809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.808+0000 7f625dc61700 1 -- 172.21.15.59:0/1503937368 >> 172.21.15.59:0/1503937368 conn(0x7f6258066f50 msgr2=0x7f625809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:32.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.808+0000 7f625dc61700 1 -- 172.21.15.59:0/1503937368 shutdown_connections 2023-09-30T22:35:32.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.808+0000 7f625dc61700 1 -- 172.21.15.59:0/1503937368 wait complete. 2023-09-30T22:35:32.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.810+0000 7f625dc61700 1 Processor -- start 2023-09-30T22:35:32.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.810+0000 7f625dc61700 1 -- start start 2023-09-30T22:35:32.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f625dc61700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625809ace0 0x7f62581c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f625dc61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f625809d6f0 0x7f62581c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f625dc61700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625809e000 0x7f62581c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f625dc61700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62581a65f0 con 0x7f625809e000 2023-09-30T22:35:32.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f625dc61700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62581a63c0 con 0x7f625809d6f0 2023-09-30T22:35:32.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f625dc61700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62581a7030 con 0x7f625809ace0 2023-09-30T22:35:32.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f62577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625809ace0 0x7f62581c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f6257fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625809e000 0x7f62581c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f62577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625809ace0 0x7f62581c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57092/0 (socket says 172.21.15.59:57092) 2023-09-30T22:35:32.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f62577fe700 1 -- 172.21.15.59:0/423337139 learned_addr learned my addr 172.21.15.59:0/423337139 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:32.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f6256ffd700 1 --2- 172.21.15.59:0/423337139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f625809d6f0 0x7f62581c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f62577fe700 1 -- 172.21.15.59:0/423337139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f625809d6f0 msgr2=0x7f62581c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f62577fe700 1 --2- 172.21.15.59:0/423337139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f625809d6f0 0x7f62581c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f62577fe700 1 -- 172.21.15.59:0/423337139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625809e000 msgr2=0x7f62581c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f62577fe700 1 --2- 172.21.15.59:0/423337139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625809e000 0x7f62581c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f62577fe700 1 -- 172.21.15.59:0/423337139 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6250009a70 con 0x7f625809ace0 2023-09-30T22:35:32.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f6257fff700 1 --2- 172.21.15.59:0/423337139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625809e000 0x7f62581c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:32.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.811+0000 7f62577fe700 1 --2- 172.21.15.59:0/423337139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625809ace0 0x7f62581c8020 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f624800e9e0 tx=0x7f624800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:32.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.812+0000 7f623ffff700 1 -- 172.21.15.59:0/423337139 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248009710 con 0x7f625809ace0 2023-09-30T22:35:32.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.812+0000 7f623ffff700 1 -- 172.21.15.59:0/423337139 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624800ee80 con 0x7f625809ace0 2023-09-30T22:35:32.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.812+0000 7f625dc61700 1 -- 172.21.15.59:0/423337139 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62581a7d30 con 0x7f625809ace0 2023-09-30T22:35:32.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.812+0000 7f623ffff700 1 -- 172.21.15.59:0/423337139 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624800ca50 con 0x7f625809ace0 2023-09-30T22:35:32.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.812+0000 7f625dc61700 1 -- 172.21.15.59:0/423337139 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62581a8340 con 0x7f625809ace0 2023-09-30T22:35:32.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.812+0000 7f623ffff700 1 -- 172.21.15.59:0/423337139 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f624800cbb0 con 0x7f625809ace0 2023-09-30T22:35:32.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.813+0000 7f623ffff700 1 -- 172.21.15.59:0/423337139 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f624803fab0 con 0x7f625809ace0 2023-09-30T22:35:32.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.813+0000 7f625dc61700 1 -- 172.21.15.59:0/423337139 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62581a7f50 con 0x7f625809ace0 2023-09-30T22:35:32.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.818+0000 7f623ffff700 1 -- 172.21.15.59:0/423337139 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6248021080 con 0x7f625809ace0 2023-09-30T22:35:32.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.847+0000 7f061b0bb700 1 Processor -- start 2023-09-30T22:35:32.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.847+0000 7f061b0bb700 1 -- start start 2023-09-30T22:35:32.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f061b0bb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0614130750 0x7f0614130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f061b0bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f061409d6f0 0x7f061409db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f061b0bb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f061409e080 0x7f06141374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f061b0bb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061409c190 con 0x7f0614130750 2023-09-30T22:35:32.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f061b0bb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061409b090 con 0x7f061409d6f0 2023-09-30T22:35:32.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f061b0bb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f061409a6c0 con 0x7f061409e080 2023-09-30T22:35:32.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f0619658700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f061409e080 0x7f06141374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f0613fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f061409d6f0 0x7f061409db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f0618e57700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0614130750 0x7f0614130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f0619658700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f061409e080 0x7f06141374b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57094/0 (socket says 172.21.15.59:57094) 2023-09-30T22:35:32.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f0619658700 1 -- 172.21.15.59:0/1692168656 learned_addr learned my addr 172.21.15.59:0/1692168656 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:32.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f0613fff700 1 -- 172.21.15.59:0/1692168656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f061409e080 msgr2=0x7f06141374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:32.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f0613fff700 1 --2- 172.21.15.59:0/1692168656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f061409e080 0x7f06141374b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f0613fff700 1 -- 172.21.15.59:0/1692168656 >> v2:172.21.15.59:3300/0 conn(0x7f0614130750 msgr2=0x7f0614130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:32.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f0613fff700 1 --2- 172.21.15.59:0/1692168656 >> v2:172.21.15.59:3300/0 conn(0x7f0614130750 0x7f0614130b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f0613fff700 1 -- 172.21.15.59:0/1692168656 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0614131060 con 0x7f061409d6f0 2023-09-30T22:35:32.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f0619658700 1 --2- 172.21.15.59:0/1692168656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f061409e080 0x7f06141374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:32.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.848+0000 7f0618e57700 1 --2- 172.21.15.59:0/1692168656 >> v2:172.21.15.59:3300/0 conn(0x7f0614130750 0x7f0614130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:32.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.849+0000 7f0613fff700 1 --2- 172.21.15.59:0/1692168656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f061409d6f0 0x7f061409db40 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009840 tx=0x7f05fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74331c2b3e322683 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:32.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.849+0000 7f06137fe700 1 -- 172.21.15.59:0/1692168656 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc011830 con 0x7f061409d6f0 2023-09-30T22:35:32.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.849+0000 7f06137fe700 1 -- 172.21.15.59:0/1692168656 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc011990 con 0x7f061409d6f0 2023-09-30T22:35:32.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.849+0000 7f06137fe700 1 -- 172.21.15.59:0/1692168656 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc011d20 con 0x7f061409d6f0 2023-09-30T22:35:32.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.849+0000 7f061b0bb700 1 -- 172.21.15.59:0/1692168656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f061409d6f0 msgr2=0x7f061409db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.849+0000 7f061b0bb700 1 --2- 172.21.15.59:0/1692168656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f061409d6f0 0x7f061409db40 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009840 tx=0x7f05fc009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:32.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.849+0000 7f061b0bb700 1 -- 172.21.15.59:0/1692168656 shutdown_connections 2023-09-30T22:35:32.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.849+0000 7f061b0bb700 1 --2- 172.21.15.59:0/1692168656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f061409e080 0x7f06141374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.849+0000 7f061b0bb700 1 --2- 172.21.15.59:0/1692168656 >> v2:172.21.15.59:3300/0 conn(0x7f0614130750 0x7f0614130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.849+0000 7f061b0bb700 1 --2- 172.21.15.59:0/1692168656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f061409d6f0 0x7f061409db40 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.849+0000 7f061b0bb700 1 -- 172.21.15.59:0/1692168656 >> 172.21.15.59:0/1692168656 conn(0x7f061409f470 msgr2=0x7f06140a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:32.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.850+0000 7f061b0bb700 1 -- 172.21.15.59:0/1692168656 shutdown_connections 2023-09-30T22:35:32.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.850+0000 7f061b0bb700 1 -- 172.21.15.59:0/1692168656 wait complete. 2023-09-30T22:35:32.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.850+0000 7f061b0bb700 1 Processor -- start 2023-09-30T22:35:32.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.851+0000 7f061b0bb700 1 -- start start 2023-09-30T22:35:32.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.851+0000 7f061b0bb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f061409d6f0 0x7f06141289d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.851+0000 7f061b0bb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f061409e080 0x7f0614128f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.851+0000 7f061b0bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0614130750 0x7f0614129450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:32.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.851+0000 7f061b0bb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061412a6a0 con 0x7f061409d6f0 2023-09-30T22:35:32.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.851+0000 7f061b0bb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06140a0d10 con 0x7f0614130750 2023-09-30T22:35:32.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.851+0000 7f061b0bb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f061409b2b0 con 0x7f061409e080 2023-09-30T22:35:32.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.851+0000 7f0618e57700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f061409d6f0 0x7f06141289d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.851+0000 7f0619658700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0614130750 0x7f0614129450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.851+0000 7f0618e57700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f061409d6f0 0x7f06141289d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37934/0 (socket says 172.21.15.59:37934) 2023-09-30T22:35:32.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.851+0000 7f0619658700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0614130750 0x7f0614129450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47012/0 (socket says 172.21.15.59:47012) 2023-09-30T22:35:32.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.851+0000 7f0618e57700 1 -- 172.21.15.59:0/2129411317 learned_addr learned my addr 172.21.15.59:0/2129411317 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:32.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.851+0000 7f0613fff700 1 --2- 172.21.15.59:0/2129411317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f061409e080 0x7f0614128f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:32.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.852+0000 7f0618e57700 1 -- 172.21.15.59:0/2129411317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f061409e080 msgr2=0x7f0614128f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.852+0000 7f0618e57700 1 --2- 172.21.15.59:0/2129411317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f061409e080 0x7f0614128f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.852+0000 7f0618e57700 1 -- 172.21.15.59:0/2129411317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0614130750 msgr2=0x7f0614129450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:32.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.852+0000 7f0618e57700 1 --2- 172.21.15.59:0/2129411317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0614130750 0x7f0614129450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:32.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.852+0000 7f0618e57700 1 -- 172.21.15.59:0/2129411317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060400b7f0 con 0x7f061409d6f0 2023-09-30T22:35:32.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.852+0000 7f0619658700 1 --2- 172.21.15.59:0/2129411317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0614130750 0x7f0614129450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:32.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.852+0000 7f0618e57700 1 --2- 172.21.15.59:0/2129411317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f061409d6f0 0x7f06141289d0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f060c00efc0 tx=0x7f060c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:32.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.852+0000 7f06117fa700 1 -- 172.21.15.59:0/2129411317 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c00cdd0 con 0x7f061409d6f0 2023-09-30T22:35:32.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.852+0000 7f06117fa700 1 -- 172.21.15.59:0/2129411317 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060c00f040 con 0x7f061409d6f0 2023-09-30T22:35:32.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.852+0000 7f061b0bb700 1 -- 172.21.15.59:0/2129411317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060c009a70 con 0x7f061409d6f0 2023-09-30T22:35:32.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.852+0000 7f06117fa700 1 -- 172.21.15.59:0/2129411317 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c0146a0 con 0x7f061409d6f0 2023-09-30T22:35:32.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.852+0000 7f061b0bb700 1 -- 172.21.15.59:0/2129411317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05fc0094a0 con 0x7f061409d6f0 2023-09-30T22:35:32.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.853+0000 7f06117fa700 1 -- 172.21.15.59:0/2129411317 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f060c014800 con 0x7f061409d6f0 2023-09-30T22:35:32.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.853+0000 7f061b0bb700 1 -- 172.21.15.59:0/2129411317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06140747f0 con 0x7f061409d6f0 2023-09-30T22:35:32.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.853+0000 7f06117fa700 1 -- 172.21.15.59:0/2129411317 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f060c0402e0 con 0x7f061409d6f0 2023-09-30T22:35:32.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:32.863+0000 7f06117fa700 1 -- 172.21.15.59:0/2129411317 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f060c007d90 con 0x7f061409d6f0 2023-09-30T22:35:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.031+0000 7f625dc61700 1 -- 172.21.15.59:0/423337139 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f62580747f0 con 0x7f625809ace0 2023-09-30T22:35:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.032+0000 7f623ffff700 1 -- 172.21.15.59:0/423337139 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6248017020 con 0x7f625809ace0 2023-09-30T22:35:33.033 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.034+0000 7f625dc61700 1 -- 172.21.15.59:0/423337139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625809ace0 msgr2=0x7f62581c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.034+0000 7f625dc61700 1 --2- 172.21.15.59:0/423337139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625809ace0 0x7f62581c8020 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f624800e9e0 tx=0x7f624800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.034+0000 7f625dc61700 1 -- 172.21.15.59:0/423337139 shutdown_connections 2023-09-30T22:35:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.034+0000 7f625dc61700 1 --2- 172.21.15.59:0/423337139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625809ace0 0x7f62581c8020 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.034+0000 7f625dc61700 1 --2- 172.21.15.59:0/423337139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625809e000 0x7f62581c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.034+0000 7f625dc61700 1 --2- 172.21.15.59:0/423337139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f625809d6f0 0x7f62581c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.034+0000 7f625dc61700 1 -- 172.21.15.59:0/423337139 >> 172.21.15.59:0/423337139 conn(0x7f6258066f50 msgr2=0x7f625806f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:33.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.034+0000 7f625dc61700 1 -- 172.21.15.59:0/423337139 shutdown_connections 2023-09-30T22:35:33.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.034+0000 7f625dc61700 1 -- 172.21.15.59:0/423337139 wait complete. 2023-09-30T22:35:33.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.066+0000 7f061b0bb700 1 -- 172.21.15.59:0/2129411317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f061412c4c0 con 0x7f061409d6f0 2023-09-30T22:35:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.067+0000 7f06117fa700 1 -- 172.21.15.59:0/2129411317 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f060c007330 con 0x7f061409d6f0 2023-09-30T22:35:33.068 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.069+0000 7f061b0bb700 1 -- 172.21.15.59:0/2129411317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f061409d6f0 msgr2=0x7f06141289d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.069+0000 7f061b0bb700 1 --2- 172.21.15.59:0/2129411317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f061409d6f0 0x7f06141289d0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f060c00efc0 tx=0x7f060c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.069+0000 7f061b0bb700 1 -- 172.21.15.59:0/2129411317 shutdown_connections 2023-09-30T22:35:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.069+0000 7f061b0bb700 1 --2- 172.21.15.59:0/2129411317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0614130750 0x7f0614129450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.069+0000 7f061b0bb700 1 --2- 172.21.15.59:0/2129411317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f061409d6f0 0x7f06141289d0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.069+0000 7f061b0bb700 1 --2- 172.21.15.59:0/2129411317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f061409e080 0x7f0614128f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.069+0000 7f061b0bb700 1 -- 172.21.15.59:0/2129411317 >> 172.21.15.59:0/2129411317 conn(0x7f061409f470 msgr2=0x7f0614098900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:33.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.069+0000 7f061b0bb700 1 -- 172.21.15.59:0/2129411317 shutdown_connections 2023-09-30T22:35:33.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.069+0000 7f061b0bb700 1 -- 172.21.15.59:0/2129411317 wait complete. 2023-09-30T22:35:33.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:33.555 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:33.594 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:33.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.705+0000 7f17bcd68700 1 Processor -- start 2023-09-30T22:35:33.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.705+0000 7f17bcd68700 1 -- start start 2023-09-30T22:35:33.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.706+0000 7f17bcd68700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b80a0a30 0x7f17b80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:33.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.706+0000 7f17bcd68700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b809d630 0x7f17b80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:33.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.706+0000 7f17bcd68700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17b8133930 0x7f17b8133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:33.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.706+0000 7f17bcd68700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b80a2a70 con 0x7f17b8133930 2023-09-30T22:35:33.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.706+0000 7f17bcd68700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80a01d0 con 0x7f17b80a0a30 2023-09-30T22:35:33.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.706+0000 7f17bcd68700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17b809e2b0 con 0x7f17b809d630 2023-09-30T22:35:33.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.706+0000 7f17b659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b80a0a30 0x7f17b80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:33.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.706+0000 7f17b5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b809d630 0x7f17b80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:33.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.706+0000 7f17b6d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17b8133930 0x7f17b8133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:33.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.706+0000 7f17b5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b809d630 0x7f17b80a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57100/0 (socket says 172.21.15.59:57100) 2023-09-30T22:35:33.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.706+0000 7f17b659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b80a0a30 0x7f17b80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47016/0 (socket says 172.21.15.59:47016) 2023-09-30T22:35:33.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.706+0000 7f17b6d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17b8133930 0x7f17b8133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37942/0 (socket says 172.21.15.59:37942) 2023-09-30T22:35:33.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.706+0000 7f17b5d9b700 1 -- 172.21.15.59:0/2913828411 learned_addr learned my addr 172.21.15.59:0/2913828411 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:33.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.707+0000 7f17b5d9b700 1 -- 172.21.15.59:0/2913828411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b80a0a30 msgr2=0x7f17b80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:33.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.707+0000 7f17b5d9b700 1 --2- 172.21.15.59:0/2913828411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b80a0a30 0x7f17b80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.707+0000 7f17b5d9b700 1 -- 172.21.15.59:0/2913828411 >> v2:172.21.15.59:3300/0 conn(0x7f17b8133930 msgr2=0x7f17b8133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:33.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.707+0000 7f17b5d9b700 1 --2- 172.21.15.59:0/2913828411 >> v2:172.21.15.59:3300/0 conn(0x7f17b8133930 0x7f17b8133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.707+0000 7f17b5d9b700 1 -- 172.21.15.59:0/2913828411 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b809dc50 con 0x7f17b809d630 2023-09-30T22:35:33.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.707+0000 7f17b6d9d700 1 --2- 172.21.15.59:0/2913828411 >> v2:172.21.15.59:3300/0 conn(0x7f17b8133930 0x7f17b8133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:33.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.707+0000 7f17b5d9b700 1 --2- 172.21.15.59:0/2913828411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b809d630 0x7f17b80a1340 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f17a00098f0 tx=0x7f17a0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb137c208c294ffa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:33.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.707+0000 7f17b559a700 1 -- 172.21.15.59:0/2913828411 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0011830 con 0x7f17b809d630 2023-09-30T22:35:33.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.707+0000 7f17b559a700 1 -- 172.21.15.59:0/2913828411 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a0011990 con 0x7f17b809d630 2023-09-30T22:35:33.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.707+0000 7f17b559a700 1 -- 172.21.15.59:0/2913828411 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0011d20 con 0x7f17b809d630 2023-09-30T22:35:33.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.708+0000 7f17bcd68700 1 -- 172.21.15.59:0/2913828411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b809d630 msgr2=0x7f17b80a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:33.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.708+0000 7f17bcd68700 1 --2- 172.21.15.59:0/2913828411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b809d630 0x7f17b80a1340 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f17a00098f0 tx=0x7f17a0009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:33.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.708+0000 7f17bcd68700 1 -- 172.21.15.59:0/2913828411 shutdown_connections 2023-09-30T22:35:33.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.708+0000 7f17bcd68700 1 --2- 172.21.15.59:0/2913828411 >> v2:172.21.15.59:3300/0 conn(0x7f17b8133930 0x7f17b8133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.708+0000 7f17bcd68700 1 --2- 172.21.15.59:0/2913828411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b80a0a30 0x7f17b80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.708+0000 7f17bcd68700 1 --2- 172.21.15.59:0/2913828411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b809d630 0x7f17b80a1340 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.708+0000 7f17bcd68700 1 -- 172.21.15.59:0/2913828411 >> 172.21.15.59:0/2913828411 conn(0x7f17b80a3050 msgr2=0x7f17b80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:33.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.708+0000 7f17bcd68700 1 -- 172.21.15.59:0/2913828411 shutdown_connections 2023-09-30T22:35:33.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.708+0000 7f17bcd68700 1 -- 172.21.15.59:0/2913828411 wait complete. 2023-09-30T22:35:33.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.709+0000 7f17bcd68700 1 Processor -- start 2023-09-30T22:35:33.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.710+0000 7f17bcd68700 1 -- start start 2023-09-30T22:35:33.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.710+0000 7f17bcd68700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809d630 0x7f17b81c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:33.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.710+0000 7f17bcd68700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b80a0a30 0x7f17b81c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:33.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.710+0000 7f17bcd68700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b8133930 0x7f17b81c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:33.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.710+0000 7f17bcd68700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b81207a0 con 0x7f17b8133930 2023-09-30T22:35:33.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.710+0000 7f17bcd68700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80a0410 con 0x7f17b809d630 2023-09-30T22:35:33.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.710+0000 7f17bcd68700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8122110 con 0x7f17b80a0a30 2023-09-30T22:35:33.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.710+0000 7f17b659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809d630 0x7f17b81c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:33.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.710+0000 7f17b5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b80a0a30 0x7f17b81c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:33.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.710+0000 7f17b659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809d630 0x7f17b81c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47018/0 (socket says 172.21.15.59:47018) 2023-09-30T22:35:33.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.710+0000 7f17b5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b80a0a30 0x7f17b81c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57112/0 (socket says 172.21.15.59:57112) 2023-09-30T22:35:33.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.710+0000 7f17b659c700 1 -- 172.21.15.59:0/1725473167 learned_addr learned my addr 172.21.15.59:0/1725473167 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:33.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.710+0000 7f17b6d9d700 1 --2- 172.21.15.59:0/1725473167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b8133930 0x7f17b81c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:33.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.711+0000 7f17b5d9b700 1 -- 172.21.15.59:0/1725473167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809d630 msgr2=0x7f17b81c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:33.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.711+0000 7f17b5d9b700 1 --2- 172.21.15.59:0/1725473167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809d630 0x7f17b81c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.711+0000 7f17b5d9b700 1 -- 172.21.15.59:0/1725473167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b8133930 msgr2=0x7f17b81c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:33.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.711+0000 7f17b5d9b700 1 --2- 172.21.15.59:0/1725473167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b8133930 0x7f17b81c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.711+0000 7f17b5d9b700 1 -- 172.21.15.59:0/1725473167 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a8009a70 con 0x7f17b80a0a30 2023-09-30T22:35:33.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.711+0000 7f17b659c700 1 --2- 172.21.15.59:0/1725473167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809d630 0x7f17b81c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:33.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.711+0000 7f17b6d9d700 1 --2- 172.21.15.59:0/1725473167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b8133930 0x7f17b81c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:33.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.711+0000 7f17b5d9b700 1 --2- 172.21.15.59:0/1725473167 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b80a0a30 0x7f17b81c86d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f17b80a1f80 tx=0x7f17a0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:33.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.711+0000 7f17aeffd700 1 -- 172.21.15.59:0/1725473167 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0004450 con 0x7f17b80a0a30 2023-09-30T22:35:33.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.711+0000 7f17aeffd700 1 -- 172.21.15.59:0/1725473167 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a00045b0 con 0x7f17b80a0a30 2023-09-30T22:35:33.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.711+0000 7f17bcd68700 1 -- 172.21.15.59:0/1725473167 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a0009550 con 0x7f17b80a0a30 2023-09-30T22:35:33.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.711+0000 7f17aeffd700 1 -- 172.21.15.59:0/1725473167 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a00038c0 con 0x7f17b80a0a30 2023-09-30T22:35:33.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.711+0000 7f17bcd68700 1 -- 172.21.15.59:0/1725473167 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b8122740 con 0x7f17b80a0a30 2023-09-30T22:35:33.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.712+0000 7f17aeffd700 1 -- 172.21.15.59:0/1725473167 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17a0021070 con 0x7f17b80a0a30 2023-09-30T22:35:33.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.712+0000 7f17bcd68700 1 -- 172.21.15.59:0/1725473167 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b81336a0 con 0x7f17b80a0a30 2023-09-30T22:35:33.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.712+0000 7f17aeffd700 1 -- 172.21.15.59:0/1725473167 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f17a00407b0 con 0x7f17b80a0a30 2023-09-30T22:35:33.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.718+0000 7f17aeffd700 1 -- 172.21.15.59:0/1725473167 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17a0029070 con 0x7f17b80a0a30 2023-09-30T22:35:33.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.743+0000 7f0ca21df700 1 Processor -- start 2023-09-30T22:35:33.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.743+0000 7f0ca21df700 1 -- start start 2023-09-30T22:35:33.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.743+0000 7f0ca21df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9c0a0a30 0x7f0c9c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:33.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.743+0000 7f0ca21df700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c9c09d630 0x7f0c9c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:33.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.743+0000 7f0ca21df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c9c133930 0x7f0c9c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:33.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.743+0000 7f0ca21df700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c0a2a70 con 0x7f0c9c09d630 2023-09-30T22:35:33.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.744+0000 7f0ca21df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c0a01d0 con 0x7f0c9c0a0a30 2023-09-30T22:35:33.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.744+0000 7f0ca21df700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c09e2b0 con 0x7f0c9c133930 2023-09-30T22:35:33.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.744+0000 7f0c9affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c9c09d630 0x7f0c9c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:33.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.744+0000 7f0c9b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9c0a0a30 0x7f0c9c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:33.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.744+0000 7f0c9affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c9c09d630 0x7f0c9c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37954/0 (socket says 172.21.15.59:37954) 2023-09-30T22:35:33.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.744+0000 7f0c9affd700 1 -- 172.21.15.59:0/2718066694 learned_addr learned my addr 172.21.15.59:0/2718066694 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:33.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.744+0000 7f0c9bfff700 1 --2- 172.21.15.59:0/2718066694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c9c133930 0x7f0c9c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:33.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.744+0000 7f0c9affd700 1 -- 172.21.15.59:0/2718066694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c9c133930 msgr2=0x7f0c9c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:33.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.744+0000 7f0c9affd700 1 --2- 172.21.15.59:0/2718066694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c9c133930 0x7f0c9c133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.744+0000 7f0c9affd700 1 -- 172.21.15.59:0/2718066694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9c0a0a30 msgr2=0x7f0c9c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:33.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.744+0000 7f0c9affd700 1 --2- 172.21.15.59:0/2718066694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9c0a0a30 0x7f0c9c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.744+0000 7f0c9affd700 1 -- 172.21.15.59:0/2718066694 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c09dc50 con 0x7f0c9c09d630 2023-09-30T22:35:33.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.744+0000 7f0c9b7fe700 1 --2- 172.21.15.59:0/2718066694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9c0a0a30 0x7f0c9c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:33.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.744+0000 7f0c9affd700 1 --2- 172.21.15.59:0/2718066694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9c09d630 0x7f0c9c0a1340 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f0c840098f0 tx=0x7f0c84009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f799466d01809e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:33.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.744+0000 7f0c9a7fc700 1 -- 172.21.15.59:0/2718066694 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84011830 con 0x7f0c9c09d630 2023-09-30T22:35:33.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.745+0000 7f0c9a7fc700 1 -- 172.21.15.59:0/2718066694 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c84011990 con 0x7f0c9c09d630 2023-09-30T22:35:33.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.745+0000 7f0c9a7fc700 1 -- 172.21.15.59:0/2718066694 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84011d20 con 0x7f0c9c09d630 2023-09-30T22:35:33.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.745+0000 7f0ca21df700 1 -- 172.21.15.59:0/2718066694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9c09d630 msgr2=0x7f0c9c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:33.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.745+0000 7f0ca21df700 1 --2- 172.21.15.59:0/2718066694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9c09d630 0x7f0c9c0a1340 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f0c840098f0 tx=0x7f0c84009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:33.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.745+0000 7f0ca21df700 1 -- 172.21.15.59:0/2718066694 shutdown_connections 2023-09-30T22:35:33.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.745+0000 7f0ca21df700 1 --2- 172.21.15.59:0/2718066694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c9c133930 0x7f0c9c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.745+0000 7f0ca21df700 1 --2- 172.21.15.59:0/2718066694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9c0a0a30 0x7f0c9c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.745+0000 7f0ca21df700 1 --2- 172.21.15.59:0/2718066694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9c09d630 0x7f0c9c0a1340 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.745+0000 7f0ca21df700 1 -- 172.21.15.59:0/2718066694 >> 172.21.15.59:0/2718066694 conn(0x7f0c9c0a3050 msgr2=0x7f0c9c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:33.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.745+0000 7f0ca21df700 1 -- 172.21.15.59:0/2718066694 shutdown_connections 2023-09-30T22:35:33.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.745+0000 7f0ca21df700 1 -- 172.21.15.59:0/2718066694 wait complete. 2023-09-30T22:35:33.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.746+0000 7f0ca21df700 1 Processor -- start 2023-09-30T22:35:33.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.746+0000 7f0ca21df700 1 -- start start 2023-09-30T22:35:33.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0ca21df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9c09d630 0x7f0c9c1210d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:33.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0ca21df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c9c0a0a30 0x7f0c9c121610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:33.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0ca21df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9c133930 0x7f0c9c121b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:33.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0ca21df700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c124410 con 0x7f0c9c09d630 2023-09-30T22:35:33.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0ca21df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c125560 con 0x7f0c9c133930 2023-09-30T22:35:33.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0ca21df700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c122d30 con 0x7f0c9c0a0a30 2023-09-30T22:35:33.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0c9b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9c09d630 0x7f0c9c1210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:33.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0c9b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9c09d630 0x7f0c9c1210d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37962/0 (socket says 172.21.15.59:37962) 2023-09-30T22:35:33.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0c9b7fe700 1 -- 172.21.15.59:0/1146384448 learned_addr learned my addr 172.21.15.59:0/1146384448 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:33.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0c9affd700 1 --2- 172.21.15.59:0/1146384448 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c9c0a0a30 0x7f0c9c121610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:33.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0c9bfff700 1 --2- 172.21.15.59:0/1146384448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9c133930 0x7f0c9c121b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:33.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0c9b7fe700 1 -- 172.21.15.59:0/1146384448 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c9c0a0a30 msgr2=0x7f0c9c121610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:33.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0c9b7fe700 1 --2- 172.21.15.59:0/1146384448 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c9c0a0a30 0x7f0c9c121610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0c9b7fe700 1 -- 172.21.15.59:0/1146384448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9c133930 msgr2=0x7f0c9c121b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:33.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0c9b7fe700 1 --2- 172.21.15.59:0/1146384448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9c133930 0x7f0c9c121b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.747+0000 7f0c9b7fe700 1 -- 172.21.15.59:0/1146384448 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c009a70 con 0x7f0c9c09d630 2023-09-30T22:35:33.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.748+0000 7f0c9b7fe700 1 --2- 172.21.15.59:0/1146384448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9c09d630 0x7f0c9c1210d0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009f60 tx=0x7f0c8c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:33.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.748+0000 7f0c93fff700 1 -- 172.21.15.59:0/1146384448 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c00cdc0 con 0x7f0c9c09d630 2023-09-30T22:35:33.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.748+0000 7f0c93fff700 1 -- 172.21.15.59:0/1146384448 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c00f040 con 0x7f0c9c09d630 2023-09-30T22:35:33.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.748+0000 7f0c93fff700 1 -- 172.21.15.59:0/1146384448 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c0146a0 con 0x7f0c9c09d630 2023-09-30T22:35:33.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.748+0000 7f0ca21df700 1 -- 172.21.15.59:0/1146384448 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c84009550 con 0x7f0c9c09d630 2023-09-30T22:35:33.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.748+0000 7f0ca21df700 1 -- 172.21.15.59:0/1146384448 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c0a4250 con 0x7f0c9c09d630 2023-09-30T22:35:33.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.749+0000 7f0c93fff700 1 -- 172.21.15.59:0/1146384448 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c8c014800 con 0x7f0c9c09d630 2023-09-30T22:35:33.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.749+0000 7f0c93fff700 1 -- 172.21.15.59:0/1146384448 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0c8c040330 con 0x7f0c9c09d630 2023-09-30T22:35:33.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.749+0000 7f0ca21df700 1 -- 172.21.15.59:0/1146384448 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c0a0470 con 0x7f0c9c09d630 2023-09-30T22:35:33.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.754+0000 7f0c93fff700 1 -- 172.21.15.59:0/1146384448 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c8c01d400 con 0x7f0c9c09d630 2023-09-30T22:35:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.942+0000 7f17bcd68700 1 -- 172.21.15.59:0/1725473167 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f17b80747f0 con 0x7f17b80a0a30 2023-09-30T22:35:33.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.942+0000 7f17aeffd700 1 -- 172.21.15.59:0/1725473167 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17a0015030 con 0x7f17b80a0a30 2023-09-30T22:35:33.944 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:33.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.944+0000 7f17bcd68700 1 -- 172.21.15.59:0/1725473167 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b80a0a30 msgr2=0x7f17b81c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:33.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.944+0000 7f17bcd68700 1 --2- 172.21.15.59:0/1725473167 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b80a0a30 0x7f17b81c86d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f17b80a1f80 tx=0x7f17a0004750 comp rx=0 tx=0).stop 2023-09-30T22:35:33.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.944+0000 7f17bcd68700 1 -- 172.21.15.59:0/1725473167 shutdown_connections 2023-09-30T22:35:33.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.944+0000 7f17bcd68700 1 --2- 172.21.15.59:0/1725473167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b8133930 0x7f17b81c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.944+0000 7f17bcd68700 1 --2- 172.21.15.59:0/1725473167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809d630 0x7f17b81c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.944+0000 7f17bcd68700 1 --2- 172.21.15.59:0/1725473167 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b80a0a30 0x7f17b81c86d0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.944+0000 7f17bcd68700 1 -- 172.21.15.59:0/1725473167 >> 172.21.15.59:0/1725473167 conn(0x7f17b80a3050 msgr2=0x7f17b809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:33.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.944+0000 7f17bcd68700 1 -- 172.21.15.59:0/1725473167 shutdown_connections 2023-09-30T22:35:33.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.944+0000 7f17bcd68700 1 -- 172.21.15.59:0/1725473167 wait complete. 2023-09-30T22:35:33.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.975+0000 7f0ca21df700 1 -- 172.21.15.59:0/1146384448 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0c9c0747f0 con 0x7f0c9c09d630 2023-09-30T22:35:33.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.975+0000 7f0c93fff700 1 -- 172.21.15.59:0/1146384448 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c8c02b090 con 0x7f0c9c09d630 2023-09-30T22:35:33.976 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:33.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.977+0000 7f0ca21df700 1 -- 172.21.15.59:0/1146384448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9c09d630 msgr2=0x7f0c9c1210d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:33.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.977+0000 7f0ca21df700 1 --2- 172.21.15.59:0/1146384448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9c09d630 0x7f0c9c1210d0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009f60 tx=0x7f0c8c009f90 comp rx=0 tx=0).stop 2023-09-30T22:35:33.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.977+0000 7f0ca21df700 1 -- 172.21.15.59:0/1146384448 shutdown_connections 2023-09-30T22:35:33.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.977+0000 7f0ca21df700 1 --2- 172.21.15.59:0/1146384448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c9c133930 0x7f0c9c121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.977+0000 7f0ca21df700 1 --2- 172.21.15.59:0/1146384448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c9c09d630 0x7f0c9c1210d0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.977+0000 7f0ca21df700 1 --2- 172.21.15.59:0/1146384448 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c9c0a0a30 0x7f0c9c121610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:33.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.977+0000 7f0ca21df700 1 -- 172.21.15.59:0/1146384448 >> 172.21.15.59:0/1146384448 conn(0x7f0c9c0a3050 msgr2=0x7f0c9c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:33.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.977+0000 7f0ca21df700 1 -- 172.21.15.59:0/1146384448 shutdown_connections 2023-09-30T22:35:33.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:33.977+0000 7f0ca21df700 1 -- 172.21.15.59:0/1146384448 wait complete. 2023-09-30T22:35:33.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:34.050 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:34.085 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:34.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.191+0000 7f3a90c35700 1 Processor -- start 2023-09-30T22:35:34.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.191+0000 7f3a90c35700 1 -- start start 2023-09-30T22:35:34.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.192+0000 7f3a90c35700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a8c09d6f0 0x7f3a8c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:34.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.192+0000 7f3a90c35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8c09e000 0x7f3a8c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:34.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.192+0000 7f3a90c35700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8c09f130 con 0x7f3a8c09e410 2023-09-30T22:35:34.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.192+0000 7f3a90c35700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8c09f520 con 0x7f3a8c09d6f0 2023-09-30T22:35:34.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.192+0000 7f3a90c35700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c09e930 con 0x7f3a8c09e000 2023-09-30T22:35:34.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.192+0000 7f3a8a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a8c09d6f0 0x7f3a8c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:34.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.192+0000 7f3a89d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8c09e000 0x7f3a8c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:34.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.192+0000 7f3a89d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8c09e000 0x7f3a8c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57140/0 (socket says 172.21.15.59:57140) 2023-09-30T22:35:34.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.192+0000 7f3a8a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a8c09d6f0 0x7f3a8c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37978/0 (socket says 172.21.15.59:37978) 2023-09-30T22:35:34.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.192+0000 7f3a89d9b700 1 -- 172.21.15.59:0/3876664096 learned_addr learned my addr 172.21.15.59:0/3876664096 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:34.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.192+0000 7f3a8ad9d700 1 --1- 172.21.15.59:0/3876664096 >> v1:172.21.15.59:6789/0 conn(0x7f3a8c09e410 0x7f3a8c130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40240/0 (socket says 172.21.15.59:40240) 2023-09-30T22:35:34.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.193+0000 7f3a8a59c700 1 -- 172.21.15.59:0/3876664096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8c09e000 msgr2=0x7f3a8c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:34.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.193+0000 7f3a8a59c700 1 --2- 172.21.15.59:0/3876664096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8c09e000 0x7f3a8c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.193+0000 7f3a8a59c700 1 -- 172.21.15.59:0/3876664096 >> v1:172.21.15.59:6789/0 conn(0x7f3a8c09e410 legacy=0x7f3a8c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:34.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.193+0000 7f3a8a59c700 1 -- 172.21.15.59:0/3876664096 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c09b2d0 con 0x7f3a8c09d6f0 2023-09-30T22:35:34.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.193+0000 7f3a8a59c700 1 --2- 172.21.15.59:0/3876664096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8c09d6f0 0x7f3a8c09dac0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009840 tx=0x7f3a7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f9dca56a26386d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:34.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.193+0000 7f3a8959a700 1 -- 172.21.15.59:0/3876664096 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c011830 con 0x7f3a8c09d6f0 2023-09-30T22:35:34.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.193+0000 7f3a8959a700 1 -- 172.21.15.59:0/3876664096 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c011990 con 0x7f3a8c09d6f0 2023-09-30T22:35:34.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.193+0000 7f3a8959a700 1 -- 172.21.15.59:0/3876664096 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c011d20 con 0x7f3a8c09d6f0 2023-09-30T22:35:34.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.194+0000 7f3a90c35700 1 -- 172.21.15.59:0/3876664096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8c09d6f0 msgr2=0x7f3a8c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.194+0000 7f3a90c35700 1 --2- 172.21.15.59:0/3876664096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8c09d6f0 0x7f3a8c09dac0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009840 tx=0x7f3a7c009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.194+0000 7f3a90c35700 1 -- 172.21.15.59:0/3876664096 shutdown_connections 2023-09-30T22:35:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.194+0000 7f3a90c35700 1 --2- 172.21.15.59:0/3876664096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8c09d6f0 0x7f3a8c09dac0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.194+0000 7f3a90c35700 1 --2- 172.21.15.59:0/3876664096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8c09e000 0x7f3a8c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.194+0000 7f3a90c35700 1 -- 172.21.15.59:0/3876664096 >> 172.21.15.59:0/3876664096 conn(0x7f3a8c066f50 msgr2=0x7f3a8c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.194+0000 7f3a90c35700 1 -- 172.21.15.59:0/3876664096 shutdown_connections 2023-09-30T22:35:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.194+0000 7f3a90c35700 1 -- 172.21.15.59:0/3876664096 wait complete. 2023-09-30T22:35:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.195+0000 7f3a90c35700 1 Processor -- start 2023-09-30T22:35:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.195+0000 7f3a90c35700 1 -- start start 2023-09-30T22:35:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a90c35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a8c09d6f0 0x7f3a8c12fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a90c35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8c09e000 0x7f3a8c1301d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a90c35700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8c09e410 0x7f3a8c130710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a90c35700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c136040 con 0x7f3a8c09e410 2023-09-30T22:35:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a90c35700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c137290 con 0x7f3a8c09d6f0 2023-09-30T22:35:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a90c35700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c137c70 con 0x7f3a8c09e000 2023-09-30T22:35:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a8a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a8c09d6f0 0x7f3a8c12fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a8ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8c09e410 0x7f3a8c130710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a8a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a8c09d6f0 0x7f3a8c12fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47052/0 (socket says 172.21.15.59:47052) 2023-09-30T22:35:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a8a59c700 1 -- 172.21.15.59:0/2170590509 learned_addr learned my addr 172.21.15.59:0/2170590509 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a89d9b700 1 --2- 172.21.15.59:0/2170590509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8c09e000 0x7f3a8c1301d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a8ad9d700 1 -- 172.21.15.59:0/2170590509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8c09e000 msgr2=0x7f3a8c1301d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a8ad9d700 1 --2- 172.21.15.59:0/2170590509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8c09e000 0x7f3a8c1301d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a8ad9d700 1 -- 172.21.15.59:0/2170590509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a8c09d6f0 msgr2=0x7f3a8c12fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a8ad9d700 1 --2- 172.21.15.59:0/2170590509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a8c09d6f0 0x7f3a8c12fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a8ad9d700 1 -- 172.21.15.59:0/2170590509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c0094a0 con 0x7f3a8c09e410 2023-09-30T22:35:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a89d9b700 1 --2- 172.21.15.59:0/2170590509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8c09e000 0x7f3a8c1301d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.196+0000 7f3a8ad9d700 1 --2- 172.21.15.59:0/2170590509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8c09e410 0x7f3a8c130710 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400cb10 tx=0x7f3a8400ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.197+0000 7f3a7affd700 1 -- 172.21.15.59:0/2170590509 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8400a9e0 con 0x7f3a8c09e410 2023-09-30T22:35:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.197+0000 7f3a7affd700 1 -- 172.21.15.59:0/2170590509 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8400ab40 con 0x7f3a8c09e410 2023-09-30T22:35:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.197+0000 7f3a7affd700 1 -- 172.21.15.59:0/2170590509 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84007070 con 0x7f3a8c09e410 2023-09-30T22:35:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.197+0000 7f3a90c35700 1 -- 172.21.15.59:0/2170590509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8c1376e0 con 0x7f3a8c09e410 2023-09-30T22:35:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.197+0000 7f3a90c35700 1 -- 172.21.15.59:0/2170590509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8c09c700 con 0x7f3a8c09e410 2023-09-30T22:35:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.197+0000 7f3a7affd700 1 -- 172.21.15.59:0/2170590509 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a840071d0 con 0x7f3a8c09e410 2023-09-30T22:35:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.198+0000 7f3a7affd700 1 -- 172.21.15.59:0/2170590509 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3a8403f2d0 con 0x7f3a8c09e410 2023-09-30T22:35:34.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.198+0000 7f3a90c35700 1 -- 172.21.15.59:0/2170590509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8c131230 con 0x7f3a8c09e410 2023-09-30T22:35:34.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.203+0000 7f3a7affd700 1 -- 172.21.15.59:0/2170590509 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a8401b3b0 con 0x7f3a8c09e410 2023-09-30T22:35:34.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.232+0000 7fdb24048700 1 Processor -- start 2023-09-30T22:35:34.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.232+0000 7fdb24048700 1 -- start start 2023-09-30T22:35:34.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.233+0000 7fdb24048700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb1c09d630 0x7fdb1c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:34.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.233+0000 7fdb24048700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb1c138d80 0x7fdb1c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.233+0000 7fdb24048700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1c0a2a70 con 0x7fdb1c0a0a30 2023-09-30T22:35:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.233+0000 7fdb24048700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1c0a01d0 con 0x7fdb1c09d630 2023-09-30T22:35:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.233+0000 7fdb24048700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c09e2b0 con 0x7fdb1c138d80 2023-09-30T22:35:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.233+0000 7fdb215e3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb1c09d630 0x7fdb1c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.233+0000 7fdb21de4700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdb1c0a0a30 0x7fdb1c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40250/0 (socket says 172.21.15.59:40250) 2023-09-30T22:35:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.234+0000 7fdb21de4700 1 -- 172.21.15.59:0/575846948 learned_addr learned my addr 172.21.15.59:0/575846948 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.234+0000 7fdb225e5700 1 --2- 172.21.15.59:0/575846948 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb1c138d80 0x7fdb1c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.234+0000 7fdb215e3700 1 -- 172.21.15.59:0/575846948 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb1c138d80 msgr2=0x7fdb1c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.234+0000 7fdb215e3700 1 --2- 172.21.15.59:0/575846948 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb1c138d80 0x7fdb1c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.234+0000 7fdb215e3700 1 -- 172.21.15.59:0/575846948 >> v1:172.21.15.59:6789/0 conn(0x7fdb1c0a0a30 legacy=0x7fdb1c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:34.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.234+0000 7fdb215e3700 1 -- 172.21.15.59:0/575846948 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c09dc50 con 0x7fdb1c09d630 2023-09-30T22:35:34.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.234+0000 7fdb225e5700 1 --2- 172.21.15.59:0/575846948 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb1c138d80 0x7fdb1c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:34.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.234+0000 7fdb215e3700 1 --2- 172.21.15.59:0/575846948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c09d630 0x7fdb1c0a1510 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009840 tx=0x7fdb10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35953048d5011f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:34.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.234+0000 7fdb20de2700 1 -- 172.21.15.59:0/575846948 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10011830 con 0x7fdb1c09d630 2023-09-30T22:35:34.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.234+0000 7fdb20de2700 1 -- 172.21.15.59:0/575846948 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb10011990 con 0x7fdb1c09d630 2023-09-30T22:35:34.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.234+0000 7fdb20de2700 1 -- 172.21.15.59:0/575846948 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10011d20 con 0x7fdb1c09d630 2023-09-30T22:35:34.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.235+0000 7fdb24048700 1 -- 172.21.15.59:0/575846948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c09d630 msgr2=0x7fdb1c0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:34.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.235+0000 7fdb24048700 1 --2- 172.21.15.59:0/575846948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c09d630 0x7fdb1c0a1510 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009840 tx=0x7fdb10009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:34.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.235+0000 7fdb24048700 1 -- 172.21.15.59:0/575846948 shutdown_connections 2023-09-30T22:35:34.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.235+0000 7fdb24048700 1 --2- 172.21.15.59:0/575846948 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb1c138d80 0x7fdb1c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.235+0000 7fdb24048700 1 --2- 172.21.15.59:0/575846948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c09d630 0x7fdb1c0a1510 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.235+0000 7fdb24048700 1 -- 172.21.15.59:0/575846948 >> 172.21.15.59:0/575846948 conn(0x7fdb1c0a3050 msgr2=0x7fdb1c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.235+0000 7fdb24048700 1 -- 172.21.15.59:0/575846948 shutdown_connections 2023-09-30T22:35:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.235+0000 7fdb24048700 1 -- 172.21.15.59:0/575846948 wait complete. 2023-09-30T22:35:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.237+0000 7fdb24048700 1 Processor -- start 2023-09-30T22:35:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.237+0000 7fdb24048700 1 -- start start 2023-09-30T22:35:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.237+0000 7fdb24048700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb1c09d630 0x7fdb1c133800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb24048700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0a0a30 0x7fdb1c133d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:34.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb24048700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c138d80 0x7fdb1c134280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:34.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb24048700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c1366b0 con 0x7fdb1c138d80 2023-09-30T22:35:34.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb24048700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c0a4d20 con 0x7fdb1c0a0a30 2023-09-30T22:35:34.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb24048700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c134c60 con 0x7fdb1c09d630 2023-09-30T22:35:34.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb225e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c138d80 0x7fdb1c134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:34.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb225e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c138d80 0x7fdb1c134280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38002/0 (socket says 172.21.15.59:38002) 2023-09-30T22:35:34.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb21de4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb1c09d630 0x7fdb1c133800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:34.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb225e5700 1 -- 172.21.15.59:0/214946015 learned_addr learned my addr 172.21.15.59:0/214946015 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:34.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb215e3700 1 --2- 172.21.15.59:0/214946015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0a0a30 0x7fdb1c133d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:34.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb225e5700 1 -- 172.21.15.59:0/214946015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb1c09d630 msgr2=0x7fdb1c133800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:34.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb225e5700 1 --2- 172.21.15.59:0/214946015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb1c09d630 0x7fdb1c133800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb225e5700 1 -- 172.21.15.59:0/214946015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0a0a30 msgr2=0x7fdb1c133d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:34.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb225e5700 1 --2- 172.21.15.59:0/214946015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0a0a30 0x7fdb1c133d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb225e5700 1 -- 172.21.15.59:0/214946015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb140094a0 con 0x7fdb1c138d80 2023-09-30T22:35:34.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb21de4700 1 --2- 172.21.15.59:0/214946015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb1c09d630 0x7fdb1c133800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:34.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb225e5700 1 --2- 172.21.15.59:0/214946015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c138d80 0x7fdb1c134280 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400eb60 tx=0x7fdb1400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:34.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb1a7fc700 1 -- 172.21.15.59:0/214946015 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14009e60 con 0x7fdb1c138d80 2023-09-30T22:35:34.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.238+0000 7fdb1a7fc700 1 -- 172.21.15.59:0/214946015 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1400c850 con 0x7fdb1c138d80 2023-09-30T22:35:34.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.239+0000 7fdb24048700 1 -- 172.21.15.59:0/214946015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb100094a0 con 0x7fdb1c138d80 2023-09-30T22:35:34.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.239+0000 7fdb1a7fc700 1 -- 172.21.15.59:0/214946015 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400cbc0 con 0x7fdb1c138d80 2023-09-30T22:35:34.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.239+0000 7fdb24048700 1 -- 172.21.15.59:0/214946015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1c137f00 con 0x7fdb1c138d80 2023-09-30T22:35:34.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.240+0000 7fdb1a7fc700 1 -- 172.21.15.59:0/214946015 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb1400cd20 con 0x7fdb1c138d80 2023-09-30T22:35:34.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.240+0000 7fdb1a7fc700 1 -- 172.21.15.59:0/214946015 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb1403f710 con 0x7fdb1c138d80 2023-09-30T22:35:34.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.240+0000 7fdb24048700 1 -- 172.21.15.59:0/214946015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c1359c0 con 0x7fdb1c138d80 2023-09-30T22:35:34.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.245+0000 7fdb1a7fc700 1 -- 172.21.15.59:0/214946015 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb14017080 con 0x7fdb1c138d80 2023-09-30T22:35:34.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.413+0000 7f3a90c35700 1 -- 172.21.15.59:0/2170590509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3a8c074ea0 con 0x7f3a8c09e410 2023-09-30T22:35:34.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.413+0000 7f3a7affd700 1 -- 172.21.15.59:0/2170590509 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a84017020 con 0x7f3a8c09e410 2023-09-30T22:35:34.415 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:34.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.416+0000 7f3a90c35700 1 -- 172.21.15.59:0/2170590509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8c09e410 msgr2=0x7f3a8c130710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:34.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.416+0000 7f3a90c35700 1 --2- 172.21.15.59:0/2170590509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8c09e410 0x7f3a8c130710 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400cb10 tx=0x7f3a8400ce20 comp rx=0 tx=0).stop 2023-09-30T22:35:34.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.416+0000 7f3a90c35700 1 -- 172.21.15.59:0/2170590509 shutdown_connections 2023-09-30T22:35:34.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.416+0000 7f3a90c35700 1 --2- 172.21.15.59:0/2170590509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a8c09e410 0x7f3a8c130710 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.416+0000 7f3a90c35700 1 --2- 172.21.15.59:0/2170590509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a8c09d6f0 0x7f3a8c12fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.416+0000 7f3a90c35700 1 --2- 172.21.15.59:0/2170590509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a8c09e000 0x7f3a8c1301d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.416+0000 7f3a90c35700 1 -- 172.21.15.59:0/2170590509 >> 172.21.15.59:0/2170590509 conn(0x7f3a8c066f50 msgr2=0x7f3a8c12c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:34.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.416+0000 7f3a90c35700 1 -- 172.21.15.59:0/2170590509 shutdown_connections 2023-09-30T22:35:34.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.416+0000 7f3a90c35700 1 -- 172.21.15.59:0/2170590509 wait complete. 2023-09-30T22:35:34.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:34.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.452+0000 7fdb24048700 1 -- 172.21.15.59:0/214946015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdb1c0747f0 con 0x7fdb1c138d80 2023-09-30T22:35:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.452+0000 7fdb1a7fc700 1 -- 172.21.15.59:0/214946015 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb14021020 con 0x7fdb1c138d80 2023-09-30T22:35:34.454 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.455+0000 7fdb24048700 1 -- 172.21.15.59:0/214946015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c138d80 msgr2=0x7fdb1c134280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.455+0000 7fdb24048700 1 --2- 172.21.15.59:0/214946015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c138d80 0x7fdb1c134280 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400eb60 tx=0x7fdb1400ee70 comp rx=0 tx=0).stop 2023-09-30T22:35:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.455+0000 7fdb24048700 1 -- 172.21.15.59:0/214946015 shutdown_connections 2023-09-30T22:35:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.455+0000 7fdb24048700 1 --2- 172.21.15.59:0/214946015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb1c09d630 0x7fdb1c133800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.455+0000 7fdb24048700 1 --2- 172.21.15.59:0/214946015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c138d80 0x7fdb1c134280 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.455+0000 7fdb24048700 1 --2- 172.21.15.59:0/214946015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0a0a30 0x7fdb1c133d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:34.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.455+0000 7fdb24048700 1 -- 172.21.15.59:0/214946015 >> 172.21.15.59:0/214946015 conn(0x7fdb1c0a3050 msgr2=0x7fdb1c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:34.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.455+0000 7fdb24048700 1 -- 172.21.15.59:0/214946015 shutdown_connections 2023-09-30T22:35:34.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:34.455+0000 7fdb24048700 1 -- 172.21.15.59:0/214946015 wait complete. 2023-09-30T22:35:34.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:34.960 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:34.993 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:35.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.109+0000 7f07793fa700 1 Processor -- start 2023-09-30T22:35:35.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.109+0000 7f07793fa700 1 -- start start 2023-09-30T22:35:35.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07793fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0774133490 0x7f0774135870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07793fa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0774135db0 0x7f0774138190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07793fa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077409c190 con 0x7f0774130750 2023-09-30T22:35:35.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07793fa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077409b090 con 0x7f0774135db0 2023-09-30T22:35:35.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07793fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f077409a6c0 con 0x7f0774133490 2023-09-30T22:35:35.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07727fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0774133490 0x7f0774135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07737fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0774135db0 0x7f0774138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07727fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0774133490 0x7f0774135870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44714/0 (socket says 172.21.15.59:44714) 2023-09-30T22:35:35.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07737fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0774135db0 0x7f0774138190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55298/0 (socket says 172.21.15.59:55298) 2023-09-30T22:35:35.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07727fc700 1 -- 172.21.15.59:0/2296630213 learned_addr learned my addr 172.21.15.59:0/2296630213 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:35.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07727fc700 1 -- 172.21.15.59:0/2296630213 >> v2:172.21.15.59:3300/0 conn(0x7f0774135db0 msgr2=0x7f0774138190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:35.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07727fc700 1 --2- 172.21.15.59:0/2296630213 >> v2:172.21.15.59:3300/0 conn(0x7f0774135db0 0x7f0774138190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07727fc700 1 -- 172.21.15.59:0/2296630213 >> v1:172.21.15.59:6789/0 conn(0x7f0774130750 legacy=0x7f0774130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07727fc700 1 -- 172.21.15.59:0/2296630213 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0774130300 con 0x7f0774133490 2023-09-30T22:35:35.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07737fe700 1 --2- 172.21.15.59:0/2296630213 >> v2:172.21.15.59:3300/0 conn(0x7f0774135db0 0x7f0774138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:35.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.110+0000 7f07727fc700 1 --2- 172.21.15.59:0/2296630213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0774133490 0x7f0774135870 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f07680098f0 tx=0x7f0768009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1d51ba734c3daff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:35.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.111+0000 7f0771ffb700 1 -- 172.21.15.59:0/2296630213 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768011830 con 0x7f0774133490 2023-09-30T22:35:35.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.111+0000 7f0771ffb700 1 -- 172.21.15.59:0/2296630213 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0768011990 con 0x7f0774133490 2023-09-30T22:35:35.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.111+0000 7f0771ffb700 1 -- 172.21.15.59:0/2296630213 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768011d20 con 0x7f0774133490 2023-09-30T22:35:35.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.111+0000 7f07793fa700 1 -- 172.21.15.59:0/2296630213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0774133490 msgr2=0x7f0774135870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.111+0000 7f07793fa700 1 --2- 172.21.15.59:0/2296630213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0774133490 0x7f0774135870 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f07680098f0 tx=0x7f0768009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:35.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.111+0000 7f07793fa700 1 -- 172.21.15.59:0/2296630213 shutdown_connections 2023-09-30T22:35:35.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.111+0000 7f07793fa700 1 --2- 172.21.15.59:0/2296630213 >> v2:172.21.15.59:3300/0 conn(0x7f0774135db0 0x7f0774138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.111+0000 7f07793fa700 1 --2- 172.21.15.59:0/2296630213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0774133490 0x7f0774135870 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.111+0000 7f07793fa700 1 -- 172.21.15.59:0/2296630213 >> 172.21.15.59:0/2296630213 conn(0x7f077409f470 msgr2=0x7f07740a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.111+0000 7f07793fa700 1 -- 172.21.15.59:0/2296630213 shutdown_connections 2023-09-30T22:35:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.111+0000 7f07793fa700 1 -- 172.21.15.59:0/2296630213 wait complete. 2023-09-30T22:35:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.113+0000 7f07793fa700 1 Processor -- start 2023-09-30T22:35:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.113+0000 7f07793fa700 1 -- start start 2023-09-30T22:35:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.113+0000 7f07793fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0774130750 0x7f077412c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.113+0000 7f07793fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0774133490 0x7f077412c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.113+0000 7f07793fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0774135db0 0x7f077412cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.113+0000 7f07793fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0774071ce0 con 0x7f0774135db0 2023-09-30T22:35:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.113+0000 7f07793fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077412eb70 con 0x7f0774130750 2023-09-30T22:35:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.113+0000 7f07793fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f077412d4f0 con 0x7f0774133490 2023-09-30T22:35:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.113+0000 7f07727fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0774133490 0x7f077412c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.113+0000 7f07737fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0774135db0 0x7f077412cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.113+0000 7f07727fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0774133490 0x7f077412c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44716/0 (socket says 172.21.15.59:44716) 2023-09-30T22:35:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.113+0000 7f07727fc700 1 -- 172.21.15.59:0/1551842456 learned_addr learned my addr 172.21.15.59:0/1551842456 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.113+0000 7f0772ffd700 1 --2- 172.21.15.59:0/1551842456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0774130750 0x7f077412c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.114+0000 7f07737fe700 1 -- 172.21.15.59:0/1551842456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0774133490 msgr2=0x7f077412c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.114+0000 7f07737fe700 1 --2- 172.21.15.59:0/1551842456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0774133490 0x7f077412c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.114+0000 7f07737fe700 1 -- 172.21.15.59:0/1551842456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0774130750 msgr2=0x7f077412c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.114+0000 7f07737fe700 1 --2- 172.21.15.59:0/1551842456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0774130750 0x7f077412c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.114+0000 7f07737fe700 1 -- 172.21.15.59:0/1551842456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c0094a0 con 0x7f0774135db0 2023-09-30T22:35:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.114+0000 7f0772ffd700 1 --2- 172.21.15.59:0/1551842456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0774130750 0x7f077412c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.114+0000 7f07737fe700 1 --2- 172.21.15.59:0/1551842456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0774135db0 0x7f077412cce0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f077406cd10 tx=0x7f076c00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.114+0000 7f075b7fe700 1 -- 172.21.15.59:0/1551842456 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c004020 con 0x7f0774135db0 2023-09-30T22:35:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.114+0000 7f075b7fe700 1 -- 172.21.15.59:0/1551842456 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c0041a0 con 0x7f0774135db0 2023-09-30T22:35:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.114+0000 7f07793fa700 1 -- 172.21.15.59:0/1551842456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0768009550 con 0x7f0774135db0 2023-09-30T22:35:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.114+0000 7f075b7fe700 1 -- 172.21.15.59:0/1551842456 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c004550 con 0x7f0774135db0 2023-09-30T22:35:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.114+0000 7f07793fa700 1 -- 172.21.15.59:0/1551842456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077412e8b0 con 0x7f0774135db0 2023-09-30T22:35:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.115+0000 7f075b7fe700 1 -- 172.21.15.59:0/1551842456 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f076c0036a0 con 0x7f0774135db0 2023-09-30T22:35:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.115+0000 7f07793fa700 1 -- 172.21.15.59:0/1551842456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07740747f0 con 0x7f0774135db0 2023-09-30T22:35:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.115+0000 7f075b7fe700 1 -- 172.21.15.59:0/1551842456 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f076c03f6e0 con 0x7f0774135db0 2023-09-30T22:35:35.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.120+0000 7f075b7fe700 1 -- 172.21.15.59:0/1551842456 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f076c013680 con 0x7f0774135db0 2023-09-30T22:35:35.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.146+0000 7fbe395e8700 1 Processor -- start 2023-09-30T22:35:35.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.146+0000 7fbe395e8700 1 -- start start 2023-09-30T22:35:35.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.146+0000 7fbe395e8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe3409e850 0x7fbe3409ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe395e8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409f160 0x7fbe34133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe395e8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409f550 0x7fbe341340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe395e8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe3406bce0 con 0x7fbe3409e850 2023-09-30T22:35:35.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe395e8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3406bec0 con 0x7fbe3409f160 2023-09-30T22:35:35.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe395e8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3406caa0 con 0x7fbe3409f550 2023-09-30T22:35:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe337fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409f550 0x7fbe341340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe32ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe3409e850 0x7fbe3409ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe32ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe3409e850 0x7fbe3409ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55318/0 (socket says 172.21.15.59:55318) 2023-09-30T22:35:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe337fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409f550 0x7fbe341340c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44730/0 (socket says 172.21.15.59:44730) 2023-09-30T22:35:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe32ffd700 1 -- 172.21.15.59:0/1234498198 learned_addr learned my addr 172.21.15.59:0/1234498198 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe327fc700 1 --2- 172.21.15.59:0/1234498198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409f160 0x7fbe34133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe32ffd700 1 -- 172.21.15.59:0/1234498198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409f550 msgr2=0x7fbe341340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe32ffd700 1 --2- 172.21.15.59:0/1234498198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409f550 0x7fbe341340c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe32ffd700 1 -- 172.21.15.59:0/1234498198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409f160 msgr2=0x7fbe34133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe32ffd700 1 --2- 172.21.15.59:0/1234498198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409f160 0x7fbe34133b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe32ffd700 1 -- 172.21.15.59:0/1234498198 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe340a00a0 con 0x7fbe3409e850 2023-09-30T22:35:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe327fc700 1 --2- 172.21.15.59:0/1234498198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409f160 0x7fbe34133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe337fe700 1 --2- 172.21.15.59:0/1234498198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409f550 0x7fbe341340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.147+0000 7fbe32ffd700 1 --2- 172.21.15.59:0/1234498198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409e850 0x7fbe3409ec20 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c0098f0 tx=0x7fbe2c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa532753692ceb8b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.148+0000 7fbe31ffb700 1 -- 172.21.15.59:0/1234498198 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c011830 con 0x7fbe3409e850 2023-09-30T22:35:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.148+0000 7fbe31ffb700 1 -- 172.21.15.59:0/1234498198 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c011990 con 0x7fbe3409e850 2023-09-30T22:35:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.148+0000 7fbe31ffb700 1 -- 172.21.15.59:0/1234498198 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c011d20 con 0x7fbe3409e850 2023-09-30T22:35:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.148+0000 7fbe395e8700 1 -- 172.21.15.59:0/1234498198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409e850 msgr2=0x7fbe3409ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.148+0000 7fbe395e8700 1 --2- 172.21.15.59:0/1234498198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409e850 0x7fbe3409ec20 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c0098f0 tx=0x7fbe2c009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.149+0000 7fbe395e8700 1 -- 172.21.15.59:0/1234498198 shutdown_connections 2023-09-30T22:35:35.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.149+0000 7fbe395e8700 1 --2- 172.21.15.59:0/1234498198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409f550 0x7fbe341340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.149+0000 7fbe395e8700 1 --2- 172.21.15.59:0/1234498198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409e850 0x7fbe3409ec20 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.149+0000 7fbe395e8700 1 --2- 172.21.15.59:0/1234498198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409f160 0x7fbe34133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.149+0000 7fbe395e8700 1 -- 172.21.15.59:0/1234498198 >> 172.21.15.59:0/1234498198 conn(0x7fbe340a3f70 msgr2=0x7fbe340a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:35.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.149+0000 7fbe395e8700 1 -- 172.21.15.59:0/1234498198 shutdown_connections 2023-09-30T22:35:35.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.149+0000 7fbe395e8700 1 -- 172.21.15.59:0/1234498198 wait complete. 2023-09-30T22:35:35.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.150+0000 7fbe395e8700 1 Processor -- start 2023-09-30T22:35:35.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.150+0000 7fbe395e8700 1 -- start start 2023-09-30T22:35:35.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.151+0000 7fbe395e8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409e850 0x7fbe34122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.151+0000 7fbe395e8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409f160 0x7fbe34122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.151+0000 7fbe395e8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409f550 0x7fbe34123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.151+0000 7fbe395e8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe34125c70 con 0x7fbe3409e850 2023-09-30T22:35:35.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.151+0000 7fbe395e8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe34126010 con 0x7fbe3409f160 2023-09-30T22:35:35.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.151+0000 7fbe395e8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe34126210 con 0x7fbe3409f550 2023-09-30T22:35:35.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.151+0000 7fbe32ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409e850 0x7fbe34122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.151+0000 7fbe337fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409f550 0x7fbe34123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.151+0000 7fbe32ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409e850 0x7fbe34122790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55328/0 (socket says 172.21.15.59:55328) 2023-09-30T22:35:35.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.151+0000 7fbe32ffd700 1 -- 172.21.15.59:0/3163730067 learned_addr learned my addr 172.21.15.59:0/3163730067 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:35.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.151+0000 7fbe327fc700 1 --2- 172.21.15.59:0/3163730067 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409f160 0x7fbe34122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.152+0000 7fbe32ffd700 1 -- 172.21.15.59:0/3163730067 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409f550 msgr2=0x7fbe34123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.152+0000 7fbe32ffd700 1 --2- 172.21.15.59:0/3163730067 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409f550 0x7fbe34123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.152+0000 7fbe32ffd700 1 -- 172.21.15.59:0/3163730067 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409f160 msgr2=0x7fbe34122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.152+0000 7fbe32ffd700 1 --2- 172.21.15.59:0/3163730067 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409f160 0x7fbe34122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.152+0000 7fbe32ffd700 1 -- 172.21.15.59:0/3163730067 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe280094a0 con 0x7fbe3409e850 2023-09-30T22:35:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.152+0000 7fbe337fe700 1 --2- 172.21.15.59:0/3163730067 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409f550 0x7fbe34123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.152+0000 7fbe32ffd700 1 --2- 172.21.15.59:0/3163730067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409e850 0x7fbe34122790 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009130 tx=0x7fbe2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.152+0000 7fbe1b7fe700 1 -- 172.21.15.59:0/3163730067 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c004450 con 0x7fbe3409e850 2023-09-30T22:35:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.152+0000 7fbe1b7fe700 1 -- 172.21.15.59:0/3163730067 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c01e070 con 0x7fbe3409e850 2023-09-30T22:35:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.152+0000 7fbe1b7fe700 1 -- 172.21.15.59:0/3163730067 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c0038e0 con 0x7fbe3409e850 2023-09-30T22:35:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.152+0000 7fbe395e8700 1 -- 172.21.15.59:0/3163730067 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe24009a70 con 0x7fbe3409e850 2023-09-30T22:35:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.152+0000 7fbe395e8700 1 -- 172.21.15.59:0/3163730067 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2c009550 con 0x7fbe3409e850 2023-09-30T22:35:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.153+0000 7fbe1b7fe700 1 -- 172.21.15.59:0/3163730067 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe2c003a40 con 0x7fbe3409e850 2023-09-30T22:35:35.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.153+0000 7fbe395e8700 1 -- 172.21.15.59:0/3163730067 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe34125e70 con 0x7fbe3409e850 2023-09-30T22:35:35.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.153+0000 7fbe1b7fe700 1 -- 172.21.15.59:0/3163730067 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbe2c040510 con 0x7fbe3409e850 2023-09-30T22:35:35.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.158+0000 7fbe1b7fe700 1 -- 172.21.15.59:0/3163730067 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe34125e70 con 0x7fbe3409e850 2023-09-30T22:35:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.329+0000 7f07793fa700 1 -- 172.21.15.59:0/1551842456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f077412d730 con 0x7f0774135db0 2023-09-30T22:35:35.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.330+0000 7f075b7fe700 1 -- 172.21.15.59:0/1551842456 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f076c020020 con 0x7f0774135db0 2023-09-30T22:35:35.331 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:35.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.332+0000 7f07793fa700 1 -- 172.21.15.59:0/1551842456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0774135db0 msgr2=0x7f077412cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.332+0000 7f07793fa700 1 --2- 172.21.15.59:0/1551842456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0774135db0 0x7f077412cce0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f077406cd10 tx=0x7f076c00ebc0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.332+0000 7f07793fa700 1 -- 172.21.15.59:0/1551842456 shutdown_connections 2023-09-30T22:35:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.332+0000 7f07793fa700 1 --2- 172.21.15.59:0/1551842456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0774135db0 0x7f077412cce0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.332+0000 7f07793fa700 1 --2- 172.21.15.59:0/1551842456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0774130750 0x7f077412c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.332+0000 7f07793fa700 1 --2- 172.21.15.59:0/1551842456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0774133490 0x7f077412c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.332+0000 7f07793fa700 1 -- 172.21.15.59:0/1551842456 >> 172.21.15.59:0/1551842456 conn(0x7f077409f470 msgr2=0x7f077409c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.332+0000 7f07793fa700 1 -- 172.21.15.59:0/1551842456 shutdown_connections 2023-09-30T22:35:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.332+0000 7f07793fa700 1 -- 172.21.15.59:0/1551842456 wait complete. 2023-09-30T22:35:35.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:35.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.362+0000 7fbe395e8700 1 -- 172.21.15.59:0/3163730067 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbe34125e70 con 0x7fbe3409e850 2023-09-30T22:35:35.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.362+0000 7fbe1b7fe700 1 -- 172.21.15.59:0/3163730067 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe34125e70 con 0x7fbe3409e850 2023-09-30T22:35:35.364 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.364+0000 7fbe395e8700 1 -- 172.21.15.59:0/3163730067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409e850 msgr2=0x7fbe34122790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.364+0000 7fbe395e8700 1 --2- 172.21.15.59:0/3163730067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409e850 0x7fbe34122790 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009130 tx=0x7fbe2c004750 comp rx=0 tx=0).stop 2023-09-30T22:35:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.364+0000 7fbe395e8700 1 -- 172.21.15.59:0/3163730067 shutdown_connections 2023-09-30T22:35:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.364+0000 7fbe395e8700 1 --2- 172.21.15.59:0/3163730067 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409f550 0x7fbe34123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.364+0000 7fbe395e8700 1 --2- 172.21.15.59:0/3163730067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409e850 0x7fbe34122790 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.364+0000 7fbe395e8700 1 --2- 172.21.15.59:0/3163730067 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409f160 0x7fbe34122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.364+0000 7fbe395e8700 1 -- 172.21.15.59:0/3163730067 >> 172.21.15.59:0/3163730067 conn(0x7fbe340a3f70 msgr2=0x7fbe340a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.365+0000 7fbe395e8700 1 -- 172.21.15.59:0/3163730067 shutdown_connections 2023-09-30T22:35:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.365+0000 7fbe395e8700 1 -- 172.21.15.59:0/3163730067 wait complete. 2023-09-30T22:35:35.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:35.431 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:35.471 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:35.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.574+0000 7ffb6cda7700 1 Processor -- start 2023-09-30T22:35:35.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.574+0000 7ffb6cda7700 1 -- start start 2023-09-30T22:35:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.574+0000 7ffb6cda7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680a0a30 0x7ffb680a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.574+0000 7ffb6cda7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb68134170 0x7ffb6813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb6cda7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6809edd0 con 0x7ffb680a1340 2023-09-30T22:35:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb6cda7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6809e1f0 con 0x7ffb68134170 2023-09-30T22:35:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb6cda7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6809dc50 con 0x7ffb680a0a30 2023-09-30T22:35:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb6659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680a0a30 0x7ffb680a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb66d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb68134170 0x7ffb6813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb6659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680a0a30 0x7ffb680a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58440/0 (socket says 172.21.15.59:58440) 2023-09-30T22:35:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb66d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb68134170 0x7ffb6813bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55334/0 (socket says 172.21.15.59:55334) 2023-09-30T22:35:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb6659c700 1 -- 172.21.15.59:0/3963558364 learned_addr learned my addr 172.21.15.59:0/3963558364 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb66d9d700 1 -- 172.21.15.59:0/3963558364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680a0a30 msgr2=0x7ffb680a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb66d9d700 1 --2- 172.21.15.59:0/3963558364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680a0a30 0x7ffb680a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb66d9d700 1 -- 172.21.15.59:0/3963558364 >> v1:172.21.15.59:6789/0 conn(0x7ffb680a1340 legacy=0x7ffb68133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb66d9d700 1 -- 172.21.15.59:0/3963558364 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb680a1fe0 con 0x7ffb68134170 2023-09-30T22:35:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb6659c700 1 --2- 172.21.15.59:0/3963558364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680a0a30 0x7ffb680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb66d9d700 1 --2- 172.21.15.59:0/3963558364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb68134170 0x7ffb6813bd30 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009d90 tx=0x7ffb6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71096f5980b6b890 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb6559a700 1 -- 172.21.15.59:0/3963558364 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6000e070 con 0x7ffb68134170 2023-09-30T22:35:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.575+0000 7ffb6559a700 1 -- 172.21.15.59:0/3963558364 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6000bb20 con 0x7ffb68134170 2023-09-30T22:35:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.576+0000 7ffb6559a700 1 -- 172.21.15.59:0/3963558364 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60012430 con 0x7ffb68134170 2023-09-30T22:35:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.576+0000 7ffb6cda7700 1 -- 172.21.15.59:0/3963558364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb68134170 msgr2=0x7ffb6813bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.576+0000 7ffb6cda7700 1 --2- 172.21.15.59:0/3963558364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb68134170 0x7ffb6813bd30 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009d90 tx=0x7ffb6000b330 comp rx=0 tx=0).stop 2023-09-30T22:35:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.576+0000 7ffb6cda7700 1 -- 172.21.15.59:0/3963558364 shutdown_connections 2023-09-30T22:35:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.576+0000 7ffb6cda7700 1 --2- 172.21.15.59:0/3963558364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb68134170 0x7ffb6813bd30 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.576+0000 7ffb6cda7700 1 --2- 172.21.15.59:0/3963558364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680a0a30 0x7ffb680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.576+0000 7ffb6cda7700 1 -- 172.21.15.59:0/3963558364 >> 172.21.15.59:0/3963558364 conn(0x7ffb680a6550 msgr2=0x7ffb680a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.576+0000 7ffb6cda7700 1 -- 172.21.15.59:0/3963558364 shutdown_connections 2023-09-30T22:35:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.576+0000 7ffb6cda7700 1 -- 172.21.15.59:0/3963558364 wait complete. 2023-09-30T22:35:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.577+0000 7ffb6cda7700 1 Processor -- start 2023-09-30T22:35:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.578+0000 7ffb6cda7700 1 -- start start 2023-09-30T22:35:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.578+0000 7ffb6cda7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb680a0a30 0x7ffb6811e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.578+0000 7ffb6cda7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb680a1340 0x7ffb6811ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.578+0000 7ffb6cda7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb68134170 0x7ffb6811f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.578+0000 7ffb6cda7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb68122190 con 0x7ffb680a0a30 2023-09-30T22:35:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.578+0000 7ffb6cda7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb68121bf0 con 0x7ffb68134170 2023-09-30T22:35:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.578+0000 7ffb6cda7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb68120280 con 0x7ffb680a1340 2023-09-30T22:35:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.578+0000 7ffb66d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb68134170 0x7ffb6811f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.578+0000 7ffb6659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb680a0a30 0x7ffb6811e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.578+0000 7ffb66d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb68134170 0x7ffb6811f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58452/0 (socket says 172.21.15.59:58452) 2023-09-30T22:35:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.578+0000 7ffb66d9d700 1 -- 172.21.15.59:0/106810302 learned_addr learned my addr 172.21.15.59:0/106810302 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.578+0000 7ffb65d9b700 1 --2- 172.21.15.59:0/106810302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb680a1340 0x7ffb6811ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.579+0000 7ffb6659c700 1 -- 172.21.15.59:0/106810302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb680a1340 msgr2=0x7ffb6811ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.579+0000 7ffb6659c700 1 --2- 172.21.15.59:0/106810302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb680a1340 0x7ffb6811ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.579+0000 7ffb6659c700 1 -- 172.21.15.59:0/106810302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb68134170 msgr2=0x7ffb6811f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.579+0000 7ffb6659c700 1 --2- 172.21.15.59:0/106810302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb68134170 0x7ffb6811f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.579+0000 7ffb6659c700 1 -- 172.21.15.59:0/106810302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb58009550 con 0x7ffb680a0a30 2023-09-30T22:35:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.579+0000 7ffb66d9d700 1 --2- 172.21.15.59:0/106810302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb68134170 0x7ffb6811f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.579+0000 7ffb6659c700 1 --2- 172.21.15.59:0/106810302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb680a0a30 0x7ffb6811e700 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800e9a0 tx=0x7ffb5800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.579+0000 7ffb56ffd700 1 -- 172.21.15.59:0/106810302 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58004030 con 0x7ffb680a0a30 2023-09-30T22:35:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.579+0000 7ffb56ffd700 1 -- 172.21.15.59:0/106810302 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb58004190 con 0x7ffb680a0a30 2023-09-30T22:35:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.579+0000 7ffb6cda7700 1 -- 172.21.15.59:0/106810302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb60009a70 con 0x7ffb680a0a30 2023-09-30T22:35:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.579+0000 7ffb56ffd700 1 -- 172.21.15.59:0/106810302 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58004520 con 0x7ffb680a0a30 2023-09-30T22:35:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.579+0000 7ffb6cda7700 1 -- 172.21.15.59:0/106810302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb68120a30 con 0x7ffb680a0a30 2023-09-30T22:35:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.580+0000 7ffb6cda7700 1 -- 172.21.15.59:0/106810302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb68074ea0 con 0x7ffb680a0a30 2023-09-30T22:35:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.580+0000 7ffb56ffd700 1 -- 172.21.15.59:0/106810302 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb580036a0 con 0x7ffb680a0a30 2023-09-30T22:35:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.580+0000 7ffb56ffd700 1 -- 172.21.15.59:0/106810302 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffb5803f8e0 con 0x7ffb680a0a30 2023-09-30T22:35:35.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.585+0000 7ffb56ffd700 1 -- 172.21.15.59:0/106810302 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb58011db0 con 0x7ffb680a0a30 2023-09-30T22:35:35.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.615+0000 7f895728c700 1 Processor -- start 2023-09-30T22:35:35.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.615+0000 7f895728c700 1 -- start start 2023-09-30T22:35:35.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f895728c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f89500a0a30 0x7f89500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f895728c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8950138d80 0x7f895013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f895728c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89500a2a70 con 0x7f895009d630 2023-09-30T22:35:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f895728c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89500a01d0 con 0x7f89500a0a30 2023-09-30T22:35:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f895728c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f895009e2b0 con 0x7f8950138d80 2023-09-30T22:35:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f8955028700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f89500a0a30 0x7f89500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f8955829700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8950138d80 0x7f895013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f8954827700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f895009d630 0x7f89500a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50094/0 (socket says 172.21.15.59:50094) 2023-09-30T22:35:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f8955028700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f89500a0a30 0x7f89500a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55352/0 (socket says 172.21.15.59:55352) 2023-09-30T22:35:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f8955829700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8950138d80 0x7f895013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44760/0 (socket says 172.21.15.59:44760) 2023-09-30T22:35:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f8954827700 1 -- 172.21.15.59:0/2259949195 learned_addr learned my addr 172.21.15.59:0/2259949195 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f8955028700 1 -- 172.21.15.59:0/2259949195 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8950138d80 msgr2=0x7f895013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f8955028700 1 --2- 172.21.15.59:0/2259949195 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8950138d80 0x7f895013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f8955028700 1 -- 172.21.15.59:0/2259949195 >> v1:172.21.15.59:6789/0 conn(0x7f895009d630 legacy=0x7f89500a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f8955028700 1 -- 172.21.15.59:0/2259949195 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895009dc50 con 0x7f89500a0a30 2023-09-30T22:35:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f8947fff700 1 -- 172.21.15.59:0/2259949195 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10416327 0 0) 0x7f89500a2a70 con 0x7f895009d630 2023-09-30T22:35:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f8955829700 1 --2- 172.21.15.59:0/2259949195 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8950138d80 0x7f895013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f8955028700 1 --2- 172.21.15.59:0/2259949195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89500a0a30 0x7f89500a0e00 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f894c009840 tx=0x7f894c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defbb0abc02c8aef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.616+0000 7f8947fff700 1 -- 172.21.15.59:0/2259949195 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c011830 con 0x7f89500a0a30 2023-09-30T22:35:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.617+0000 7f8947fff700 1 -- 172.21.15.59:0/2259949195 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c011990 con 0x7f89500a0a30 2023-09-30T22:35:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.617+0000 7f8947fff700 1 -- 172.21.15.59:0/2259949195 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c011d20 con 0x7f89500a0a30 2023-09-30T22:35:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.617+0000 7f895728c700 1 -- 172.21.15.59:0/2259949195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89500a0a30 msgr2=0x7f89500a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.617+0000 7f895728c700 1 --2- 172.21.15.59:0/2259949195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89500a0a30 0x7f89500a0e00 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f894c009840 tx=0x7f894c009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.617+0000 7f895728c700 1 -- 172.21.15.59:0/2259949195 shutdown_connections 2023-09-30T22:35:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.617+0000 7f895728c700 1 --2- 172.21.15.59:0/2259949195 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8950138d80 0x7f895013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.617+0000 7f895728c700 1 --2- 172.21.15.59:0/2259949195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89500a0a30 0x7f89500a0e00 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.617+0000 7f895728c700 1 -- 172.21.15.59:0/2259949195 >> 172.21.15.59:0/2259949195 conn(0x7f89500a3050 msgr2=0x7f89500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.617+0000 7f895728c700 1 -- 172.21.15.59:0/2259949195 shutdown_connections 2023-09-30T22:35:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.617+0000 7f895728c700 1 -- 172.21.15.59:0/2259949195 wait complete. 2023-09-30T22:35:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.619+0000 7f895728c700 1 Processor -- start 2023-09-30T22:35:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.619+0000 7f895728c700 1 -- start start 2023-09-30T22:35:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.619+0000 7f895728c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f895009d630 0x7f8950133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.619+0000 7f895728c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89500a0a30 0x7f8950133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.619+0000 7f895728c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8950138d80 0x7f89501341e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.619+0000 7f895728c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8950136fa0 con 0x7f8950138d80 2023-09-30T22:35:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.619+0000 7f895728c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8950136630 con 0x7f895009d630 2023-09-30T22:35:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.619+0000 7f895728c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89500a4b50 con 0x7f89500a0a30 2023-09-30T22:35:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8955829700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8950138d80 0x7f89501341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8954827700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89500a0a30 0x7f8950133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8955829700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8950138d80 0x7f89501341e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55358/0 (socket says 172.21.15.59:55358) 2023-09-30T22:35:35.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8954827700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89500a0a30 0x7f8950133ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44766/0 (socket says 172.21.15.59:44766) 2023-09-30T22:35:35.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8955829700 1 -- 172.21.15.59:0/2395308181 learned_addr learned my addr 172.21.15.59:0/2395308181 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:35.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8955028700 1 --2- 172.21.15.59:0/2395308181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f895009d630 0x7f8950133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:35.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8955829700 1 -- 172.21.15.59:0/2395308181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89500a0a30 msgr2=0x7f8950133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8955829700 1 --2- 172.21.15.59:0/2395308181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89500a0a30 0x7f8950133ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8955829700 1 -- 172.21.15.59:0/2395308181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f895009d630 msgr2=0x7f8950133760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8955829700 1 --2- 172.21.15.59:0/2395308181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f895009d630 0x7f8950133760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8955829700 1 -- 172.21.15.59:0/2395308181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8948009a70 con 0x7f8950138d80 2023-09-30T22:35:35.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8954827700 1 --2- 172.21.15.59:0/2395308181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89500a0a30 0x7f8950133ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:35.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8955829700 1 --2- 172.21.15.59:0/2395308181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8950138d80 0x7f89501341e0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f894800ef90 tx=0x7f894800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:35.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8945ffb700 1 -- 172.21.15.59:0/2395308181 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894800cc90 con 0x7f8950138d80 2023-09-30T22:35:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8945ffb700 1 -- 172.21.15.59:0/2395308181 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894800f040 con 0x7f8950138d80 2023-09-30T22:35:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f895728c700 1 -- 172.21.15.59:0/2395308181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894c0094a0 con 0x7f8950138d80 2023-09-30T22:35:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.620+0000 7f8945ffb700 1 -- 172.21.15.59:0/2395308181 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89480146c0 con 0x7f8950138d80 2023-09-30T22:35:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.621+0000 7f895728c700 1 -- 172.21.15.59:0/2395308181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8950137a10 con 0x7f8950138d80 2023-09-30T22:35:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.621+0000 7f8945ffb700 1 -- 172.21.15.59:0/2395308181 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8948014820 con 0x7f8950138d80 2023-09-30T22:35:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.622+0000 7f8945ffb700 1 -- 172.21.15.59:0/2395308181 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f89480402c0 con 0x7f8950138d80 2023-09-30T22:35:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.622+0000 7f895728c700 1 -- 172.21.15.59:0/2395308181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8950137e60 con 0x7f8950138d80 2023-09-30T22:35:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.627+0000 7f8945ffb700 1 -- 172.21.15.59:0/2395308181 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8948007920 con 0x7f8950138d80 2023-09-30T22:35:35.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.796+0000 7ffb6cda7700 1 -- 172.21.15.59:0/106810302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb680a28e0 con 0x7ffb680a0a30 2023-09-30T22:35:35.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.797+0000 7ffb56ffd700 1 -- 172.21.15.59:0/106810302 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb58011350 con 0x7ffb680a0a30 2023-09-30T22:35:35.798 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:35.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.799+0000 7ffb6cda7700 1 -- 172.21.15.59:0/106810302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb680a0a30 msgr2=0x7ffb6811e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.799+0000 7ffb6cda7700 1 --2- 172.21.15.59:0/106810302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb680a0a30 0x7ffb6811e700 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800e9a0 tx=0x7ffb5800ecb0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.799+0000 7ffb6cda7700 1 -- 172.21.15.59:0/106810302 shutdown_connections 2023-09-30T22:35:35.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.799+0000 7ffb6cda7700 1 --2- 172.21.15.59:0/106810302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb68134170 0x7ffb6811f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.799+0000 7ffb6cda7700 1 --2- 172.21.15.59:0/106810302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb680a0a30 0x7ffb6811e700 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.799+0000 7ffb6cda7700 1 --2- 172.21.15.59:0/106810302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb680a1340 0x7ffb6811ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.799+0000 7ffb6cda7700 1 -- 172.21.15.59:0/106810302 >> 172.21.15.59:0/106810302 conn(0x7ffb680a6550 msgr2=0x7ffb6809c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:35.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.799+0000 7ffb6cda7700 1 -- 172.21.15.59:0/106810302 shutdown_connections 2023-09-30T22:35:35.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.799+0000 7ffb6cda7700 1 -- 172.21.15.59:0/106810302 wait complete. 2023-09-30T22:35:35.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:35.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.834+0000 7f895728c700 1 -- 172.21.15.59:0/2395308181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8950136c40 con 0x7f8950138d80 2023-09-30T22:35:35.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.835+0000 7f8945ffb700 1 -- 172.21.15.59:0/2395308181 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f894802b090 con 0x7f8950138d80 2023-09-30T22:35:35.836 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:35.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.837+0000 7f895728c700 1 -- 172.21.15.59:0/2395308181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8950138d80 msgr2=0x7f89501341e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:35.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.837+0000 7f895728c700 1 --2- 172.21.15.59:0/2395308181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8950138d80 0x7f89501341e0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f894800ef90 tx=0x7f894800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.837+0000 7f895728c700 1 -- 172.21.15.59:0/2395308181 shutdown_connections 2023-09-30T22:35:35.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.837+0000 7f895728c700 1 --2- 172.21.15.59:0/2395308181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8950138d80 0x7f89501341e0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.837+0000 7f895728c700 1 --2- 172.21.15.59:0/2395308181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f895009d630 0x7f8950133760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.837+0000 7f895728c700 1 --2- 172.21.15.59:0/2395308181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89500a0a30 0x7f8950133ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:35.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.837+0000 7f895728c700 1 -- 172.21.15.59:0/2395308181 >> 172.21.15.59:0/2395308181 conn(0x7f89500a3050 msgr2=0x7f895013ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:35.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.837+0000 7f895728c700 1 -- 172.21.15.59:0/2395308181 shutdown_connections 2023-09-30T22:35:35.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:35.837+0000 7f895728c700 1 -- 172.21.15.59:0/2395308181 wait complete. 2023-09-30T22:35:35.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:36.349 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:36.380 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:36.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.496+0000 7f27848db700 1 Processor -- start 2023-09-30T22:35:36.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.496+0000 7f27848db700 1 -- start start 2023-09-30T22:35:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.497+0000 7f27848db700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f278009d630 0x7f27800a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.497+0000 7f27848db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2780138d80 0x7f278013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.497+0000 7f27848db700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27800a2a70 con 0x7f27800a0a30 2023-09-30T22:35:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.497+0000 7f27848db700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27800a01d0 con 0x7f278009d630 2023-09-30T22:35:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.497+0000 7f27848db700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f278009e2b0 con 0x7f2780138d80 2023-09-30T22:35:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.497+0000 7f277ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2780138d80 0x7f278013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:36.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.497+0000 7f277ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2780138d80 0x7f278013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44770/0 (socket says 172.21.15.59:44770) 2023-09-30T22:35:36.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.497+0000 7f277dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f278009d630 0x7f27800a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:36.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.497+0000 7f277ed9d700 1 -- 172.21.15.59:0/4182632829 learned_addr learned my addr 172.21.15.59:0/4182632829 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:36.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.497+0000 7f277ed9d700 1 -- 172.21.15.59:0/4182632829 >> v2:172.21.15.59:3300/0 conn(0x7f278009d630 msgr2=0x7f27800a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:36.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.497+0000 7f277ed9d700 1 --2- 172.21.15.59:0/4182632829 >> v2:172.21.15.59:3300/0 conn(0x7f278009d630 0x7f27800a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.497+0000 7f277ed9d700 1 -- 172.21.15.59:0/4182632829 >> v1:172.21.15.59:6789/0 conn(0x7f27800a0a30 legacy=0x7f27800a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:36.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.497+0000 7f277ed9d700 1 -- 172.21.15.59:0/4182632829 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278009dc50 con 0x7f2780138d80 2023-09-30T22:35:36.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.497+0000 7f277dd9b700 1 --2- 172.21.15.59:0/4182632829 >> v2:172.21.15.59:3300/0 conn(0x7f278009d630 0x7f27800a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:36.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.497+0000 7f277ed9d700 1 --2- 172.21.15.59:0/4182632829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2780138d80 0x7f278013b160 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2770009e50 tx=0x7f277000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bc4ff3cb58f114e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:36.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.498+0000 7f277d59a700 1 -- 172.21.15.59:0/4182632829 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000e070 con 0x7f2780138d80 2023-09-30T22:35:36.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.498+0000 7f277d59a700 1 -- 172.21.15.59:0/4182632829 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277000b910 con 0x7f2780138d80 2023-09-30T22:35:36.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.498+0000 7f277d59a700 1 -- 172.21.15.59:0/4182632829 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000bcc0 con 0x7f2780138d80 2023-09-30T22:35:36.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.498+0000 7f27848db700 1 -- 172.21.15.59:0/4182632829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2780138d80 msgr2=0x7f278013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:36.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.498+0000 7f27848db700 1 --2- 172.21.15.59:0/4182632829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2780138d80 0x7f278013b160 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2770009e50 tx=0x7f277000b330 comp rx=0 tx=0).stop 2023-09-30T22:35:36.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.498+0000 7f27848db700 1 -- 172.21.15.59:0/4182632829 shutdown_connections 2023-09-30T22:35:36.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.498+0000 7f27848db700 1 --2- 172.21.15.59:0/4182632829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2780138d80 0x7f278013b160 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.498+0000 7f27848db700 1 --2- 172.21.15.59:0/4182632829 >> v2:172.21.15.59:3300/0 conn(0x7f278009d630 0x7f27800a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.498+0000 7f27848db700 1 -- 172.21.15.59:0/4182632829 >> 172.21.15.59:0/4182632829 conn(0x7f27800a3050 msgr2=0x7f27800a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:36.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.498+0000 7f27848db700 1 -- 172.21.15.59:0/4182632829 shutdown_connections 2023-09-30T22:35:36.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.499+0000 7f27848db700 1 -- 172.21.15.59:0/4182632829 wait complete. 2023-09-30T22:35:36.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.500+0000 7f27848db700 1 Processor -- start 2023-09-30T22:35:36.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.500+0000 7f27848db700 1 -- start start 2023-09-30T22:35:36.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.500+0000 7f27848db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f278009d630 0x7f2780120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:36.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.500+0000 7f27848db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27800a0a30 0x7f2780120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:36.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.500+0000 7f27848db700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2780138d80 0x7f27801210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:36.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.500+0000 7f27848db700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2780124140 con 0x7f2780138d80 2023-09-30T22:35:36.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.500+0000 7f27848db700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27801234f0 con 0x7f27800a0a30 2023-09-30T22:35:36.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.500+0000 7f27848db700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2780138b20 con 0x7f278009d630 2023-09-30T22:35:36.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.500+0000 7f277e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f278009d630 0x7f2780120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:36.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.500+0000 7f277ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2780138d80 0x7f27801210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:36.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.500+0000 7f277dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27800a0a30 0x7f2780120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:36.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.500+0000 7f277ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2780138d80 0x7f27801210a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55376/0 (socket says 172.21.15.59:55376) 2023-09-30T22:35:36.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.500+0000 7f277e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f278009d630 0x7f2780120620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44778/0 (socket says 172.21.15.59:44778) 2023-09-30T22:35:36.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.500+0000 7f277ed9d700 1 -- 172.21.15.59:0/2867375444 learned_addr learned my addr 172.21.15.59:0/2867375444 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:36.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.500+0000 7f277dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27800a0a30 0x7f2780120b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58484/0 (socket says 172.21.15.59:58484) 2023-09-30T22:35:36.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.501+0000 7f277dd9b700 1 -- 172.21.15.59:0/2867375444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f278009d630 msgr2=0x7f2780120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:36.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.501+0000 7f277dd9b700 1 --2- 172.21.15.59:0/2867375444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f278009d630 0x7f2780120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.501+0000 7f277dd9b700 1 -- 172.21.15.59:0/2867375444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2780138d80 msgr2=0x7f27801210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.501+0000 7f277dd9b700 1 --2- 172.21.15.59:0/2867375444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2780138d80 0x7f27801210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.501+0000 7f277dd9b700 1 -- 172.21.15.59:0/2867375444 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27680094a0 con 0x7f27800a0a30 2023-09-30T22:35:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.501+0000 7f277e59c700 1 --2- 172.21.15.59:0/2867375444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f278009d630 0x7f2780120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.501+0000 7f277ed9d700 1 --2- 172.21.15.59:0/2867375444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2780138d80 0x7f27801210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.501+0000 7f277dd9b700 1 --2- 172.21.15.59:0/2867375444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27800a0a30 0x7f2780120b60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f276800e9b0 tx=0x7f276800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.501+0000 7f2776ffd700 1 -- 172.21.15.59:0/2867375444 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276800ee50 con 0x7f27800a0a30 2023-09-30T22:35:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.501+0000 7f2776ffd700 1 -- 172.21.15.59:0/2867375444 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276800c850 con 0x7f27800a0a30 2023-09-30T22:35:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.501+0000 7f27848db700 1 -- 172.21.15.59:0/2867375444 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2770009b30 con 0x7f27800a0a30 2023-09-30T22:35:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.501+0000 7f2776ffd700 1 -- 172.21.15.59:0/2867375444 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276800cc00 con 0x7f27800a0a30 2023-09-30T22:35:36.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.501+0000 7f27848db700 1 -- 172.21.15.59:0/2867375444 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27800a0460 con 0x7f27800a0a30 2023-09-30T22:35:36.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.502+0000 7f2776ffd700 1 -- 172.21.15.59:0/2867375444 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2768013470 con 0x7f27800a0a30 2023-09-30T22:35:36.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.502+0000 7f27848db700 1 -- 172.21.15.59:0/2867375444 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2780124990 con 0x7f27800a0a30 2023-09-30T22:35:36.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.502+0000 7f2776ffd700 1 -- 172.21.15.59:0/2867375444 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f276803fa90 con 0x7f27800a0a30 2023-09-30T22:35:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.507+0000 7f2776ffd700 1 -- 172.21.15.59:0/2867375444 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2768013720 con 0x7f27800a0a30 2023-09-30T22:35:36.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.534+0000 7f29a29c0700 1 Processor -- start 2023-09-30T22:35:36.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.534+0000 7f29a29c0700 1 -- start start 2023-09-30T22:35:36.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.534+0000 7f29a29c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c0a0a30 0x7f299c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:36.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f29a29c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09d630 0x7f299c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:36.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f29a29c0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299c0a2a70 con 0x7f299c133930 2023-09-30T22:35:36.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f29a29c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0a01d0 con 0x7f299c09d630 2023-09-30T22:35:36.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f29a29c0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f299c09e2b0 con 0x7f299c0a0a30 2023-09-30T22:35:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f299b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09d630 0x7f299c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f29a0f5d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f299c133930 0x7f299c133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50122/0 (socket says 172.21.15.59:50122) 2023-09-30T22:35:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f29a0f5d700 1 -- 172.21.15.59:0/4233210317 learned_addr learned my addr 172.21.15.59:0/4233210317 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f299bfff700 1 --2- 172.21.15.59:0/4233210317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c0a0a30 0x7f299c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f299bfff700 1 -- 172.21.15.59:0/4233210317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09d630 msgr2=0x7f299c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f299bfff700 1 --2- 172.21.15.59:0/4233210317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09d630 0x7f299c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f299bfff700 1 -- 172.21.15.59:0/4233210317 >> v1:172.21.15.59:6789/0 conn(0x7f299c133930 legacy=0x7f299c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f299affd700 1 -- 172.21.15.59:0/4233210317 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014780552 0 0) 0x7f299c0a2a70 con 0x7f299c133930 2023-09-30T22:35:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f299bfff700 1 -- 172.21.15.59:0/4233210317 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c09dc50 con 0x7f299c0a0a30 2023-09-30T22:35:36.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f299b7fe700 1 --2- 172.21.15.59:0/4233210317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09d630 0x7f299c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:36.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f299bfff700 1 --2- 172.21.15.59:0/4233210317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c0a0a30 0x7f299c0a0e00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f298c009870 tx=0x7f298c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf3ebcd562c6a793 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:36.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.535+0000 7f299affd700 1 -- 172.21.15.59:0/4233210317 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c011830 con 0x7f299c0a0a30 2023-09-30T22:35:36.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.536+0000 7f299affd700 1 -- 172.21.15.59:0/4233210317 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c011990 con 0x7f299c0a0a30 2023-09-30T22:35:36.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.536+0000 7f299affd700 1 -- 172.21.15.59:0/4233210317 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c011d20 con 0x7f299c0a0a30 2023-09-30T22:35:36.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.536+0000 7f29a29c0700 1 -- 172.21.15.59:0/4233210317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c0a0a30 msgr2=0x7f299c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:36.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.536+0000 7f29a29c0700 1 --2- 172.21.15.59:0/4233210317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c0a0a30 0x7f299c0a0e00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f298c009870 tx=0x7f298c009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:36.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.536+0000 7f29a29c0700 1 -- 172.21.15.59:0/4233210317 shutdown_connections 2023-09-30T22:35:36.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.536+0000 7f29a29c0700 1 --2- 172.21.15.59:0/4233210317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c0a0a30 0x7f299c0a0e00 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.536+0000 7f29a29c0700 1 --2- 172.21.15.59:0/4233210317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09d630 0x7f299c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.536+0000 7f29a29c0700 1 -- 172.21.15.59:0/4233210317 >> 172.21.15.59:0/4233210317 conn(0x7f299c0a3050 msgr2=0x7f299c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:36.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.536+0000 7f29a29c0700 1 -- 172.21.15.59:0/4233210317 shutdown_connections 2023-09-30T22:35:36.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.536+0000 7f29a29c0700 1 -- 172.21.15.59:0/4233210317 wait complete. 2023-09-30T22:35:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.538+0000 7f29a29c0700 1 Processor -- start 2023-09-30T22:35:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.538+0000 7f29a29c0700 1 -- start start 2023-09-30T22:35:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.538+0000 7f29a29c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09d630 0x7f299c11f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.538+0000 7f29a29c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f299c0a0a30 0x7f299c11f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f29a29c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c133930 0x7f299c1c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f29a29c0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c11ee60 con 0x7f299c0a0a30 2023-09-30T22:35:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f29a29c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c133330 con 0x7f299c09d630 2023-09-30T22:35:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f29a29c0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f299c121f20 con 0x7f299c133930 2023-09-30T22:35:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f299bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09d630 0x7f299c11f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:36.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f299bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09d630 0x7f299c11f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58506/0 (socket says 172.21.15.59:58506) 2023-09-30T22:35:36.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f299bfff700 1 -- 172.21.15.59:0/3164751933 learned_addr learned my addr 172.21.15.59:0/3164751933 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:36.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f299b7fe700 1 --2- 172.21.15.59:0/3164751933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f299c0a0a30 0x7f299c11f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:36.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f29a0f5d700 1 --2- 172.21.15.59:0/3164751933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c133930 0x7f299c1c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:36.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f299bfff700 1 -- 172.21.15.59:0/3164751933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c133930 msgr2=0x7f299c1c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:36.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f299bfff700 1 --2- 172.21.15.59:0/3164751933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c133930 0x7f299c1c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f299bfff700 1 -- 172.21.15.59:0/3164751933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f299c0a0a30 msgr2=0x7f299c11f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:36.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f299bfff700 1 --2- 172.21.15.59:0/3164751933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f299c0a0a30 0x7f299c11f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f299bfff700 1 -- 172.21.15.59:0/3164751933 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29900094a0 con 0x7f299c09d630 2023-09-30T22:35:36.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f299bfff700 1 --2- 172.21.15.59:0/3164751933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09d630 0x7f299c11f2c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f298c009bc0 tx=0x7f298c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:36.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f2998ff9700 1 -- 172.21.15.59:0/3164751933 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c004550 con 0x7f299c09d630 2023-09-30T22:35:36.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f2998ff9700 1 -- 172.21.15.59:0/3164751933 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c01f070 con 0x7f299c09d630 2023-09-30T22:35:36.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.539+0000 7f29a29c0700 1 -- 172.21.15.59:0/3164751933 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c0094a0 con 0x7f299c09d630 2023-09-30T22:35:36.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.540+0000 7f29a29c0700 1 -- 172.21.15.59:0/3164751933 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c1205b0 con 0x7f299c09d630 2023-09-30T22:35:36.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.540+0000 7f2998ff9700 1 -- 172.21.15.59:0/3164751933 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c0038e0 con 0x7f299c09d630 2023-09-30T22:35:36.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.540+0000 7f2998ff9700 1 -- 172.21.15.59:0/3164751933 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f298c003a40 con 0x7f299c09d630 2023-09-30T22:35:36.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.541+0000 7f2998ff9700 1 -- 172.21.15.59:0/3164751933 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f298c021070 con 0x7f299c09d630 2023-09-30T22:35:36.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.541+0000 7f29a29c0700 1 -- 172.21.15.59:0/3164751933 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c0747f0 con 0x7f299c09d630 2023-09-30T22:35:36.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.546+0000 7f2998ff9700 1 -- 172.21.15.59:0/3164751933 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f298c01a950 con 0x7f299c09d630 2023-09-30T22:35:36.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.719+0000 7f27848db700 1 -- 172.21.15.59:0/2867375444 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2780123dc0 con 0x7f27800a0a30 2023-09-30T22:35:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.720+0000 7f2776ffd700 1 -- 172.21.15.59:0/2867375444 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2780123dc0 con 0x7f27800a0a30 2023-09-30T22:35:36.721 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:36.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.722+0000 7f27848db700 1 -- 172.21.15.59:0/2867375444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27800a0a30 msgr2=0x7f2780120b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:36.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.722+0000 7f27848db700 1 --2- 172.21.15.59:0/2867375444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27800a0a30 0x7f2780120b60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f276800e9b0 tx=0x7f276800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.722+0000 7f27848db700 1 -- 172.21.15.59:0/2867375444 shutdown_connections 2023-09-30T22:35:36.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.722+0000 7f27848db700 1 --2- 172.21.15.59:0/2867375444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f278009d630 0x7f2780120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.722+0000 7f27848db700 1 --2- 172.21.15.59:0/2867375444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2780138d80 0x7f27801210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.722+0000 7f27848db700 1 --2- 172.21.15.59:0/2867375444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27800a0a30 0x7f2780120b60 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.722+0000 7f27848db700 1 -- 172.21.15.59:0/2867375444 >> 172.21.15.59:0/2867375444 conn(0x7f27800a3050 msgr2=0x7f2780139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:36.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.722+0000 7f27848db700 1 -- 172.21.15.59:0/2867375444 shutdown_connections 2023-09-30T22:35:36.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.722+0000 7f27848db700 1 -- 172.21.15.59:0/2867375444 wait complete. 2023-09-30T22:35:36.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:36.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.752+0000 7f29a29c0700 1 -- 172.21.15.59:0/3164751933 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f299c122370 con 0x7f299c09d630 2023-09-30T22:35:36.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.753+0000 7f2998ff9700 1 -- 172.21.15.59:0/3164751933 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f298c024b70 con 0x7f299c09d630 2023-09-30T22:35:36.754 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.755+0000 7f29a29c0700 1 -- 172.21.15.59:0/3164751933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09d630 msgr2=0x7f299c11f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.755+0000 7f29a29c0700 1 --2- 172.21.15.59:0/3164751933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09d630 0x7f299c11f2c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f298c009bc0 tx=0x7f298c004750 comp rx=0 tx=0).stop 2023-09-30T22:35:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.755+0000 7f29a29c0700 1 -- 172.21.15.59:0/3164751933 shutdown_connections 2023-09-30T22:35:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.755+0000 7f29a29c0700 1 --2- 172.21.15.59:0/3164751933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c133930 0x7f299c1c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.755+0000 7f29a29c0700 1 --2- 172.21.15.59:0/3164751933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09d630 0x7f299c11f2c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.755+0000 7f29a29c0700 1 --2- 172.21.15.59:0/3164751933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f299c0a0a30 0x7f299c11f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.755+0000 7f29a29c0700 1 -- 172.21.15.59:0/3164751933 >> 172.21.15.59:0/3164751933 conn(0x7f299c0a3050 msgr2=0x7f299c1bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:36.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.755+0000 7f29a29c0700 1 -- 172.21.15.59:0/3164751933 shutdown_connections 2023-09-30T22:35:36.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.755+0000 7f29a29c0700 1 -- 172.21.15.59:0/3164751933 wait complete. 2023-09-30T22:35:36.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:36.815 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:36.853 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.956+0000 7f8ca73cc700 1 Processor -- start 2023-09-30T22:35:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.956+0000 7f8ca73cc700 1 -- start start 2023-09-30T22:35:36.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.957+0000 7f8ca73cc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ca00a0a30 0x7f8ca00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:36.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.957+0000 7f8ca73cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ca00a1340 0x7f8ca0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:36.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.957+0000 7f8ca73cc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca009edd0 con 0x7f8ca0133fa0 2023-09-30T22:35:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.957+0000 7f8ca73cc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca009e1f0 con 0x7f8ca00a0a30 2023-09-30T22:35:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.957+0000 7f8ca73cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca009dc50 con 0x7f8ca00a1340 2023-09-30T22:35:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.957+0000 7f8ca5168700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ca00a0a30 0x7f8ca00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.957+0000 7f8ca5168700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ca00a0a30 0x7f8ca00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55394/0 (socket says 172.21.15.59:55394) 2023-09-30T22:35:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.957+0000 7f8ca4967700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ca00a1340 0x7f8ca0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.957+0000 7f8ca5168700 1 -- 172.21.15.59:0/2478838190 learned_addr learned my addr 172.21.15.59:0/2478838190 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.958+0000 7f8ca4967700 1 -- 172.21.15.59:0/2478838190 >> v2:172.21.15.59:3300/0 conn(0x7f8ca00a0a30 msgr2=0x7f8ca00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.958+0000 7f8ca4967700 1 --2- 172.21.15.59:0/2478838190 >> v2:172.21.15.59:3300/0 conn(0x7f8ca00a0a30 0x7f8ca00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.958+0000 7f8ca4967700 1 -- 172.21.15.59:0/2478838190 >> v1:172.21.15.59:6789/0 conn(0x7f8ca0133fa0 legacy=0x7f8ca013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.958+0000 7f8ca4967700 1 -- 172.21.15.59:0/2478838190 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca00a1fe0 con 0x7f8ca00a1340 2023-09-30T22:35:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.958+0000 7f8ca5168700 1 --2- 172.21.15.59:0/2478838190 >> v2:172.21.15.59:3300/0 conn(0x7f8ca00a0a30 0x7f8ca00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.958+0000 7f8ca4967700 1 --2- 172.21.15.59:0/2478838190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ca00a1340 0x7f8ca0133a60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009840 tx=0x7f8c94009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a0d5d381e92a146 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.958+0000 7f8c9ffff700 1 -- 172.21.15.59:0/2478838190 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94011830 con 0x7f8ca00a1340 2023-09-30T22:35:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.958+0000 7f8c9ffff700 1 -- 172.21.15.59:0/2478838190 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c94011990 con 0x7f8ca00a1340 2023-09-30T22:35:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.958+0000 7f8c9ffff700 1 -- 172.21.15.59:0/2478838190 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94011d20 con 0x7f8ca00a1340 2023-09-30T22:35:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.959+0000 7f8ca73cc700 1 -- 172.21.15.59:0/2478838190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ca00a1340 msgr2=0x7f8ca0133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.959+0000 7f8ca73cc700 1 --2- 172.21.15.59:0/2478838190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ca00a1340 0x7f8ca0133a60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009840 tx=0x7f8c94009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.959+0000 7f8ca73cc700 1 -- 172.21.15.59:0/2478838190 shutdown_connections 2023-09-30T22:35:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.959+0000 7f8ca73cc700 1 --2- 172.21.15.59:0/2478838190 >> v2:172.21.15.59:3300/0 conn(0x7f8ca00a0a30 0x7f8ca00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.959+0000 7f8ca73cc700 1 --2- 172.21.15.59:0/2478838190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ca00a1340 0x7f8ca0133a60 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.959+0000 7f8ca73cc700 1 -- 172.21.15.59:0/2478838190 >> 172.21.15.59:0/2478838190 conn(0x7f8ca00a6550 msgr2=0x7f8ca00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.959+0000 7f8ca73cc700 1 -- 172.21.15.59:0/2478838190 shutdown_connections 2023-09-30T22:35:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.959+0000 7f8ca73cc700 1 -- 172.21.15.59:0/2478838190 wait complete. 2023-09-30T22:35:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.961+0000 7f8ca73cc700 1 Processor -- start 2023-09-30T22:35:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.961+0000 7f8ca73cc700 1 -- start start 2023-09-30T22:35:36.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.961+0000 7f8ca73cc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca00a0a30 0x7f8ca011e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:36.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.961+0000 7f8ca73cc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ca00a1340 0x7f8ca011ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:36.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.961+0000 7f8ca73cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ca0133fa0 0x7f8ca011f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:36.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.961+0000 7f8ca73cc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca0120bc0 con 0x7f8ca00a0a30 2023-09-30T22:35:36.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.961+0000 7f8ca73cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00a3760 con 0x7f8ca0133fa0 2023-09-30T22:35:36.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.961+0000 7f8ca73cc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00a0220 con 0x7f8ca00a1340 2023-09-30T22:35:36.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8ca5168700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca00a0a30 0x7f8ca011e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:36.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8ca5168700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca00a0a30 0x7f8ca011e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55400/0 (socket says 172.21.15.59:55400) 2023-09-30T22:35:36.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8ca5168700 1 -- 172.21.15.59:0/2008038392 learned_addr learned my addr 172.21.15.59:0/2008038392 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:36.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8ca4967700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ca00a1340 0x7f8ca011ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:36.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8ca5969700 1 --2- 172.21.15.59:0/2008038392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ca0133fa0 0x7f8ca011f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8ca5168700 1 -- 172.21.15.59:0/2008038392 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ca00a1340 msgr2=0x7f8ca011ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8ca5168700 1 --2- 172.21.15.59:0/2008038392 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ca00a1340 0x7f8ca011ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8ca5168700 1 -- 172.21.15.59:0/2008038392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ca0133fa0 msgr2=0x7f8ca011f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8ca5168700 1 --2- 172.21.15.59:0/2008038392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ca0133fa0 0x7f8ca011f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8ca5168700 1 -- 172.21.15.59:0/2008038392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c90009550 con 0x7f8ca00a0a30 2023-09-30T22:35:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8ca4967700 1 --2- 172.21.15.59:0/2008038392 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ca00a1340 0x7f8ca011ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8ca5168700 1 --2- 172.21.15.59:0/2008038392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca00a0a30 0x7f8ca011e750 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000ebe0 tx=0x7f8c9000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8c9dffb700 1 -- 172.21.15.59:0/2008038392 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9000c850 con 0x7f8ca00a0a30 2023-09-30T22:35:36.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8c9dffb700 1 -- 172.21.15.59:0/2008038392 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9000c9b0 con 0x7f8ca00a0a30 2023-09-30T22:35:36.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8ca73cc700 1 -- 172.21.15.59:0/2008038392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c940094a0 con 0x7f8ca00a0a30 2023-09-30T22:35:36.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.962+0000 7f8c9dffb700 1 -- 172.21.15.59:0/2008038392 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9000cd40 con 0x7f8ca00a0a30 2023-09-30T22:35:36.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.963+0000 7f8ca73cc700 1 -- 172.21.15.59:0/2008038392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca0122a00 con 0x7f8ca00a0a30 2023-09-30T22:35:36.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.964+0000 7f8c9dffb700 1 -- 172.21.15.59:0/2008038392 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c90013470 con 0x7f8ca00a0a30 2023-09-30T22:35:36.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.964+0000 7f8ca73cc700 1 -- 172.21.15.59:0/2008038392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca0074ea0 con 0x7f8ca00a0a30 2023-09-30T22:35:36.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.964+0000 7f8c9dffb700 1 -- 172.21.15.59:0/2008038392 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8c9003f9d0 con 0x7f8ca00a0a30 2023-09-30T22:35:36.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.969+0000 7f8c9dffb700 1 -- 172.21.15.59:0/2008038392 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c90021020 con 0x7f8ca00a0a30 2023-09-30T22:35:37.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.999+0000 7f1525261700 1 Processor -- start 2023-09-30T22:35:37.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:36.999+0000 7f1525261700 1 -- start start 2023-09-30T22:35:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.000+0000 7f1525261700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f152009e1d0 0x7f1520135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.000+0000 7f1525261700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1520135e50 0x7f1520138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.000+0000 7f1525261700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152009f130 con 0x7f152009d6f0 2023-09-30T22:35:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.000+0000 7f1525261700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152009f520 con 0x7f152009e1d0 2023-09-30T22:35:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.000+0000 7f1525261700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152009e930 con 0x7f1520135e50 2023-09-30T22:35:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.000+0000 7f151f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1520135e50 0x7f1520138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.000+0000 7f151e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f152009e1d0 0x7f1520135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:37.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.000+0000 7f151effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f152009d6f0 0x7f152009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50140/0 (socket says 172.21.15.59:50140) 2023-09-30T22:35:37.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.000+0000 7f151effd700 1 -- 172.21.15.59:0/1861918527 learned_addr learned my addr 172.21.15.59:0/1861918527 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:37.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.000+0000 7f151f7fe700 1 -- 172.21.15.59:0/1861918527 >> v2:172.21.15.59:3300/0 conn(0x7f152009e1d0 msgr2=0x7f1520135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:37.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.000+0000 7f151f7fe700 1 --2- 172.21.15.59:0/1861918527 >> v2:172.21.15.59:3300/0 conn(0x7f152009e1d0 0x7f1520135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.000+0000 7f151f7fe700 1 -- 172.21.15.59:0/1861918527 >> v1:172.21.15.59:6789/0 conn(0x7f152009d6f0 legacy=0x7f152009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:37.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.000+0000 7f151f7fe700 1 -- 172.21.15.59:0/1861918527 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152009b2d0 con 0x7f1520135e50 2023-09-30T22:35:37.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.000+0000 7f151e7fc700 1 --2- 172.21.15.59:0/1861918527 >> v2:172.21.15.59:3300/0 conn(0x7f152009e1d0 0x7f1520135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:37.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.001+0000 7f151f7fe700 1 --2- 172.21.15.59:0/1861918527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1520135e50 0x7f1520138230 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1518009d90 tx=0x7f151800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cac49b68385e848a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:37.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.001+0000 7f151dffb700 1 -- 172.21.15.59:0/1861918527 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151800e070 con 0x7f1520135e50 2023-09-30T22:35:37.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.001+0000 7f151dffb700 1 -- 172.21.15.59:0/1861918527 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151800bb20 con 0x7f1520135e50 2023-09-30T22:35:37.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.001+0000 7f151dffb700 1 -- 172.21.15.59:0/1861918527 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518012430 con 0x7f1520135e50 2023-09-30T22:35:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.001+0000 7f1525261700 1 -- 172.21.15.59:0/1861918527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1520135e50 msgr2=0x7f1520138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.001+0000 7f1525261700 1 --2- 172.21.15.59:0/1861918527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1520135e50 0x7f1520138230 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1518009d90 tx=0x7f151800b330 comp rx=0 tx=0).stop 2023-09-30T22:35:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.002+0000 7f1525261700 1 -- 172.21.15.59:0/1861918527 shutdown_connections 2023-09-30T22:35:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.002+0000 7f1525261700 1 --2- 172.21.15.59:0/1861918527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1520135e50 0x7f1520138230 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.002+0000 7f1525261700 1 --2- 172.21.15.59:0/1861918527 >> v2:172.21.15.59:3300/0 conn(0x7f152009e1d0 0x7f1520135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.002+0000 7f1525261700 1 -- 172.21.15.59:0/1861918527 >> 172.21.15.59:0/1861918527 conn(0x7f1520066f50 msgr2=0x7f152009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.002+0000 7f1525261700 1 -- 172.21.15.59:0/1861918527 shutdown_connections 2023-09-30T22:35:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.002+0000 7f1525261700 1 -- 172.21.15.59:0/1861918527 wait complete. 2023-09-30T22:35:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.003+0000 7f1525261700 1 Processor -- start 2023-09-30T22:35:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.003+0000 7f1525261700 1 -- start start 2023-09-30T22:35:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.003+0000 7f1525261700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f152009d6f0 0x7f152011bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.003+0000 7f1525261700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f152009e1d0 0x7f152011c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.003+0000 7f1525261700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1520135e50 0x7f152011ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.003+0000 7f1525261700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15201333b0 con 0x7f1520135e50 2023-09-30T22:35:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.003+0000 7f1525261700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152011ede0 con 0x7f152009e1d0 2023-09-30T22:35:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.003+0000 7f1525261700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f152011f7c0 con 0x7f152009d6f0 2023-09-30T22:35:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.003+0000 7f151f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1520135e50 0x7f152011ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.003+0000 7f151f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1520135e50 0x7f152011ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55416/0 (socket says 172.21.15.59:55416) 2023-09-30T22:35:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.003+0000 7f151f7fe700 1 -- 172.21.15.59:0/3130137986 learned_addr learned my addr 172.21.15.59:0/3130137986 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.003+0000 7f151e7fc700 1 --2- 172.21.15.59:0/3130137986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f152009e1d0 0x7f152011c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:37.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.003+0000 7f151effd700 1 --2- 172.21.15.59:0/3130137986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f152009d6f0 0x7f152011bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:37.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.004+0000 7f151f7fe700 1 -- 172.21.15.59:0/3130137986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f152009d6f0 msgr2=0x7f152011bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:37.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.004+0000 7f151f7fe700 1 --2- 172.21.15.59:0/3130137986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f152009d6f0 0x7f152011bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.004+0000 7f151f7fe700 1 -- 172.21.15.59:0/3130137986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f152009e1d0 msgr2=0x7f152011c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:37.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.004+0000 7f151f7fe700 1 --2- 172.21.15.59:0/3130137986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f152009e1d0 0x7f152011c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.004+0000 7f151f7fe700 1 -- 172.21.15.59:0/3130137986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15140094a0 con 0x7f1520135e50 2023-09-30T22:35:37.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.004+0000 7f151f7fe700 1 --2- 172.21.15.59:0/3130137986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1520135e50 0x7f152011ca00 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f1518014040 tx=0x7f1518004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:37.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.004+0000 7f15077fe700 1 -- 172.21.15.59:0/3130137986 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518012430 con 0x7f1520135e50 2023-09-30T22:35:37.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.004+0000 7f15077fe700 1 -- 172.21.15.59:0/3130137986 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1518020070 con 0x7f1520135e50 2023-09-30T22:35:37.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.004+0000 7f1525261700 1 -- 172.21.15.59:0/3130137986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1518009a70 con 0x7f1520135e50 2023-09-30T22:35:37.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.004+0000 7f15077fe700 1 -- 172.21.15.59:0/3130137986 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518003ea0 con 0x7f1520135e50 2023-09-30T22:35:37.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.004+0000 7f1525261700 1 -- 172.21.15.59:0/3130137986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152011f230 con 0x7f1520135e50 2023-09-30T22:35:37.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.005+0000 7f15077fe700 1 -- 172.21.15.59:0/3130137986 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1518004040 con 0x7f1520135e50 2023-09-30T22:35:37.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.005+0000 7f1525261700 1 -- 172.21.15.59:0/3130137986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1520071b20 con 0x7f1520135e50 2023-09-30T22:35:37.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.005+0000 7f15077fe700 1 -- 172.21.15.59:0/3130137986 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1518022070 con 0x7f1520135e50 2023-09-30T22:35:37.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.010+0000 7f15077fe700 1 -- 172.21.15.59:0/3130137986 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f151801a740 con 0x7f1520135e50 2023-09-30T22:35:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.174+0000 7f8ca73cc700 1 -- 172.21.15.59:0/2008038392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8ca00a28e0 con 0x7f8ca00a0a30 2023-09-30T22:35:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.174+0000 7f8c9dffb700 1 -- 172.21.15.59:0/2008038392 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c90017070 con 0x7f8ca00a0a30 2023-09-30T22:35:37.175 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:37.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.177+0000 7f8ca73cc700 1 -- 172.21.15.59:0/2008038392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca00a0a30 msgr2=0x7f8ca011e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:37.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.177+0000 7f8ca73cc700 1 --2- 172.21.15.59:0/2008038392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca00a0a30 0x7f8ca011e750 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000ebe0 tx=0x7f8c9000eef0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.177+0000 7f8ca73cc700 1 -- 172.21.15.59:0/2008038392 shutdown_connections 2023-09-30T22:35:37.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.177+0000 7f8ca73cc700 1 --2- 172.21.15.59:0/2008038392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ca0133fa0 0x7f8ca011f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.177+0000 7f8ca73cc700 1 --2- 172.21.15.59:0/2008038392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ca00a0a30 0x7f8ca011e750 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.177+0000 7f8ca73cc700 1 --2- 172.21.15.59:0/2008038392 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ca00a1340 0x7f8ca011ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.177+0000 7f8ca73cc700 1 -- 172.21.15.59:0/2008038392 >> 172.21.15.59:0/2008038392 conn(0x7f8ca00a6550 msgr2=0x7f8ca00a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:37.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.177+0000 7f8ca73cc700 1 -- 172.21.15.59:0/2008038392 shutdown_connections 2023-09-30T22:35:37.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.177+0000 7f8ca73cc700 1 -- 172.21.15.59:0/2008038392 wait complete. 2023-09-30T22:35:37.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.216+0000 7f1525261700 1 -- 172.21.15.59:0/3130137986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1520074ea0 con 0x7f1520135e50 2023-09-30T22:35:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.216+0000 7f15077fe700 1 -- 172.21.15.59:0/3130137986 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f151802c030 con 0x7f1520135e50 2023-09-30T22:35:37.217 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:37.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.218+0000 7f1525261700 1 -- 172.21.15.59:0/3130137986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1520135e50 msgr2=0x7f152011ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:37.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.218+0000 7f1525261700 1 --2- 172.21.15.59:0/3130137986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1520135e50 0x7f152011ca00 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f1518014040 tx=0x7f1518004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.218+0000 7f1525261700 1 -- 172.21.15.59:0/3130137986 shutdown_connections 2023-09-30T22:35:37.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.218+0000 7f1525261700 1 --2- 172.21.15.59:0/3130137986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f152009d6f0 0x7f152011bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.218+0000 7f1525261700 1 --2- 172.21.15.59:0/3130137986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1520135e50 0x7f152011ca00 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.218+0000 7f1525261700 1 --2- 172.21.15.59:0/3130137986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f152009e1d0 0x7f152011c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.218+0000 7f1525261700 1 -- 172.21.15.59:0/3130137986 >> 172.21.15.59:0/3130137986 conn(0x7f1520066f50 msgr2=0x7f152006ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:37.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.219+0000 7f1525261700 1 -- 172.21.15.59:0/3130137986 shutdown_connections 2023-09-30T22:35:37.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.219+0000 7f1525261700 1 -- 172.21.15.59:0/3130137986 wait complete. 2023-09-30T22:35:37.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:37.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:37.770 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:37.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.889+0000 7f2079919700 1 Processor -- start 2023-09-30T22:35:37.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.889+0000 7f2079919700 1 -- start start 2023-09-30T22:35:37.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.890+0000 7f2079919700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f207412c830 0x7f207412cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:37.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.890+0000 7f2079919700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207409a880 0x7f20740992c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:37.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.890+0000 7f2079919700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207412c3b0 con 0x7f2074099800 2023-09-30T22:35:37.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.890+0000 7f2079919700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f207409e670 con 0x7f207412c830 2023-09-30T22:35:37.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.890+0000 7f2079919700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f207409b860 con 0x7f207409a880 2023-09-30T22:35:37.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.890+0000 7f20727fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207409a880 0x7f20740992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:37.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.890+0000 7f2072ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f207412c830 0x7f207412cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:37.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.890+0000 7f20727fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207409a880 0x7f20740992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44844/0 (socket says 172.21.15.59:44844) 2023-09-30T22:35:37.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.890+0000 7f2072ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f207412c830 0x7f207412cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55430/0 (socket says 172.21.15.59:55430) 2023-09-30T22:35:37.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.890+0000 7f20727fc700 1 -- 172.21.15.59:0/2099270086 learned_addr learned my addr 172.21.15.59:0/2099270086 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:37.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.891+0000 7f20727fc700 1 -- 172.21.15.59:0/2099270086 >> v2:172.21.15.59:3300/0 conn(0x7f207412c830 msgr2=0x7f207412cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:37.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.891+0000 7f20727fc700 1 --2- 172.21.15.59:0/2099270086 >> v2:172.21.15.59:3300/0 conn(0x7f207412c830 0x7f207412cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.891+0000 7f20727fc700 1 -- 172.21.15.59:0/2099270086 >> v1:172.21.15.59:6789/0 conn(0x7f2074099800 legacy=0x7f2074136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:37.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.891+0000 7f20727fc700 1 -- 172.21.15.59:0/2099270086 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207409af70 con 0x7f207409a880 2023-09-30T22:35:37.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.891+0000 7f2072ffd700 1 --2- 172.21.15.59:0/2099270086 >> v2:172.21.15.59:3300/0 conn(0x7f207412c830 0x7f207412cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:37.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.891+0000 7f20727fc700 1 --2- 172.21.15.59:0/2099270086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207409a880 0x7f20740992c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f205c00bb90 tx=0x7f205c00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33a553f507c15c18 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:37.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.891+0000 7f2071ffb700 1 -- 172.21.15.59:0/2099270086 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c00dc20 con 0x7f207409a880 2023-09-30T22:35:37.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.891+0000 7f2071ffb700 1 -- 172.21.15.59:0/2099270086 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205c00dd80 con 0x7f207409a880 2023-09-30T22:35:37.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.891+0000 7f2071ffb700 1 -- 172.21.15.59:0/2099270086 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c017630 con 0x7f207409a880 2023-09-30T22:35:37.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.892+0000 7f2079919700 1 -- 172.21.15.59:0/2099270086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207409a880 msgr2=0x7f20740992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:37.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.892+0000 7f2079919700 1 --2- 172.21.15.59:0/2099270086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207409a880 0x7f20740992c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f205c00bb90 tx=0x7f205c00bea0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.892+0000 7f2079919700 1 -- 172.21.15.59:0/2099270086 shutdown_connections 2023-09-30T22:35:37.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.892+0000 7f2079919700 1 --2- 172.21.15.59:0/2099270086 >> v2:172.21.15.59:3300/0 conn(0x7f207412c830 0x7f207412cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.892+0000 7f2079919700 1 --2- 172.21.15.59:0/2099270086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207409a880 0x7f20740992c0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.892+0000 7f2079919700 1 -- 172.21.15.59:0/2099270086 >> 172.21.15.59:0/2099270086 conn(0x7f207409f470 msgr2=0x7f20740a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:37.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.892+0000 7f2079919700 1 -- 172.21.15.59:0/2099270086 shutdown_connections 2023-09-30T22:35:37.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.892+0000 7f2079919700 1 -- 172.21.15.59:0/2099270086 wait complete. 2023-09-30T22:35:37.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.893+0000 7f2079919700 1 Processor -- start 2023-09-30T22:35:37.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.893+0000 7f2079919700 1 -- start start 2023-09-30T22:35:37.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.893+0000 7f2079919700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2074099800 0x7f207412ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:37.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.893+0000 7f2079919700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f207409a880 0x7f207412f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:37.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.893+0000 7f2079919700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207412c830 0x7f207412f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:37.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f2079919700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207408bfd0 con 0x7f2074099800 2023-09-30T22:35:37.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f2079919700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207408bc40 con 0x7f207409a880 2023-09-30T22:35:37.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f2079919700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2074072490 con 0x7f207412c830 2023-09-30T22:35:37.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f2072ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2074099800 0x7f207412ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:37.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f20727fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f207409a880 0x7f207412f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:37.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f2072ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2074099800 0x7f207412ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55438/0 (socket says 172.21.15.59:55438) 2023-09-30T22:35:37.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f2072ffd700 1 -- 172.21.15.59:0/322921179 learned_addr learned my addr 172.21.15.59:0/322921179 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:37.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f20737fe700 1 --2- 172.21.15.59:0/322921179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207412c830 0x7f207412f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:37.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f2072ffd700 1 -- 172.21.15.59:0/322921179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207412c830 msgr2=0x7f207412f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:37.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f2072ffd700 1 --2- 172.21.15.59:0/322921179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207412c830 0x7f207412f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f2072ffd700 1 -- 172.21.15.59:0/322921179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f207409a880 msgr2=0x7f207412f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:37.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f2072ffd700 1 --2- 172.21.15.59:0/322921179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f207409a880 0x7f207412f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f2072ffd700 1 -- 172.21.15.59:0/322921179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2064009a70 con 0x7f2074099800 2023-09-30T22:35:37.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f20727fc700 1 --2- 172.21.15.59:0/322921179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f207409a880 0x7f207412f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:37.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f20737fe700 1 --2- 172.21.15.59:0/322921179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207412c830 0x7f207412f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:37.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f2072ffd700 1 --2- 172.21.15.59:0/322921179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2074099800 0x7f207412ec00 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f206400efc0 tx=0x7f206400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:37.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f206bfff700 1 -- 172.21.15.59:0/322921179 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206400cdd0 con 0x7f2074099800 2023-09-30T22:35:37.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f206bfff700 1 -- 172.21.15.59:0/322921179 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206400f040 con 0x7f2074099800 2023-09-30T22:35:37.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f2079919700 1 -- 172.21.15.59:0/322921179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205c00b7f0 con 0x7f2074099800 2023-09-30T22:35:37.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.894+0000 7f206bfff700 1 -- 172.21.15.59:0/322921179 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20640146a0 con 0x7f2074099800 2023-09-30T22:35:37.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.895+0000 7f2079919700 1 -- 172.21.15.59:0/322921179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2074130740 con 0x7f2074099800 2023-09-30T22:35:37.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.895+0000 7f2079919700 1 -- 172.21.15.59:0/322921179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20740747f0 con 0x7f2074099800 2023-09-30T22:35:37.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.896+0000 7f206bfff700 1 -- 172.21.15.59:0/322921179 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2064014800 con 0x7f2074099800 2023-09-30T22:35:37.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.896+0000 7f206bfff700 1 -- 172.21.15.59:0/322921179 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f20640408d0 con 0x7f2074099800 2023-09-30T22:35:37.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.900+0000 7f206bfff700 1 -- 172.21.15.59:0/322921179 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2064012da0 con 0x7f2074099800 2023-09-30T22:35:37.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.927+0000 7f45cc1b3700 1 Processor -- start 2023-09-30T22:35:37.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.927+0000 7f45cc1b3700 1 -- start start 2023-09-30T22:35:37.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.927+0000 7f45cc1b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409d630 0x7f45c40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:37.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.927+0000 7f45cc1b3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c4138d80 0x7f45c413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:37.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.927+0000 7f45cc1b3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c40a2a70 con 0x7f45c40a0a30 2023-09-30T22:35:37.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.927+0000 7f45cc1b3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40a01d0 con 0x7f45c409d630 2023-09-30T22:35:37.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.927+0000 7f45cc1b3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45c409e2b0 con 0x7f45c4138d80 2023-09-30T22:35:37.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.927+0000 7f45c974e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409d630 0x7f45c40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:37.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.928+0000 7f45ca750700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c4138d80 0x7f45c413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:37.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.928+0000 7f45ca750700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c4138d80 0x7f45c413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44866/0 (socket says 172.21.15.59:44866) 2023-09-30T22:35:37.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.928+0000 7f45c974e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409d630 0x7f45c40a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58570/0 (socket says 172.21.15.59:58570) 2023-09-30T22:35:37.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.928+0000 7f45ca750700 1 -- 172.21.15.59:0/1243652551 learned_addr learned my addr 172.21.15.59:0/1243652551 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:37.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.928+0000 7f45c9f4f700 1 --1- 172.21.15.59:0/1243652551 >> v1:172.21.15.59:6789/0 conn(0x7f45c40a0a30 0x7f45c40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50146/0 (socket says 172.21.15.59:50146) 2023-09-30T22:35:37.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.928+0000 7f45c974e700 1 -- 172.21.15.59:0/1243652551 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c4138d80 msgr2=0x7f45c413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:37.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.928+0000 7f45c974e700 1 --2- 172.21.15.59:0/1243652551 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c4138d80 0x7f45c413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.928+0000 7f45c974e700 1 -- 172.21.15.59:0/1243652551 >> v1:172.21.15.59:6789/0 conn(0x7f45c40a0a30 legacy=0x7f45c40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:37.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.928+0000 7f45c974e700 1 -- 172.21.15.59:0/1243652551 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c409dc50 con 0x7f45c409d630 2023-09-30T22:35:37.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.928+0000 7f45c8f4d700 1 -- 172.21.15.59:0/1243652551 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332371244 0 0) 0x7f45c40a2a70 con 0x7f45c40a0a30 2023-09-30T22:35:37.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.928+0000 7f45ca750700 1 --2- 172.21.15.59:0/1243652551 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c4138d80 0x7f45c413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:37.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.928+0000 7f45c974e700 1 --2- 172.21.15.59:0/1243652551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409d630 0x7f45c40a1510 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009870 tx=0x7f45b8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eafa4f4a030237c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:37.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.928+0000 7f45c8f4d700 1 -- 172.21.15.59:0/1243652551 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8011830 con 0x7f45c409d630 2023-09-30T22:35:37.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.928+0000 7f45c8f4d700 1 -- 172.21.15.59:0/1243652551 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b8011990 con 0x7f45c409d630 2023-09-30T22:35:37.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.928+0000 7f45c8f4d700 1 -- 172.21.15.59:0/1243652551 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8011d20 con 0x7f45c409d630 2023-09-30T22:35:37.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.929+0000 7f45cc1b3700 1 -- 172.21.15.59:0/1243652551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409d630 msgr2=0x7f45c40a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:37.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.929+0000 7f45cc1b3700 1 --2- 172.21.15.59:0/1243652551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409d630 0x7f45c40a1510 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009870 tx=0x7f45b8009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:37.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.929+0000 7f45cc1b3700 1 -- 172.21.15.59:0/1243652551 shutdown_connections 2023-09-30T22:35:37.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.929+0000 7f45cc1b3700 1 --2- 172.21.15.59:0/1243652551 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c4138d80 0x7f45c413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.929+0000 7f45cc1b3700 1 --2- 172.21.15.59:0/1243652551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409d630 0x7f45c40a1510 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.929+0000 7f45cc1b3700 1 -- 172.21.15.59:0/1243652551 >> 172.21.15.59:0/1243652551 conn(0x7f45c40a3050 msgr2=0x7f45c40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:37.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.929+0000 7f45cc1b3700 1 -- 172.21.15.59:0/1243652551 shutdown_connections 2023-09-30T22:35:37.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.929+0000 7f45cc1b3700 1 -- 172.21.15.59:0/1243652551 wait complete. 2023-09-30T22:35:37.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.930+0000 7f45cc1b3700 1 Processor -- start 2023-09-30T22:35:37.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.930+0000 7f45cc1b3700 1 -- start start 2023-09-30T22:35:37.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45cc1b3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409d630 0x7f45c41338d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:37.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45cc1b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40a0a30 0x7f45c4133e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:37.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45cc1b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c4138d80 0x7f45c4134350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:37.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45cc1b3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4136dc0 con 0x7f45c40a0a30 2023-09-30T22:35:37.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45cc1b3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4137080 con 0x7f45c4138d80 2023-09-30T22:35:37.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45cc1b3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45c413ad70 con 0x7f45c409d630 2023-09-30T22:35:37.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45ca750700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c4138d80 0x7f45c4134350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:37.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45ca750700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c4138d80 0x7f45c4134350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58574/0 (socket says 172.21.15.59:58574) 2023-09-30T22:35:37.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45ca750700 1 -- 172.21.15.59:0/349932809 learned_addr learned my addr 172.21.15.59:0/349932809 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:37.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45c974e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40a0a30 0x7f45c4133e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:37.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45c9f4f700 1 --2- 172.21.15.59:0/349932809 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409d630 0x7f45c41338d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:37.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45ca750700 1 -- 172.21.15.59:0/349932809 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409d630 msgr2=0x7f45c41338d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:37.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45ca750700 1 --2- 172.21.15.59:0/349932809 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409d630 0x7f45c41338d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45ca750700 1 -- 172.21.15.59:0/349932809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40a0a30 msgr2=0x7f45c4133e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:37.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45ca750700 1 --2- 172.21.15.59:0/349932809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40a0a30 0x7f45c4133e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:37.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45ca750700 1 -- 172.21.15.59:0/349932809 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc009b30 con 0x7f45c4138d80 2023-09-30T22:35:37.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45c974e700 1 --2- 172.21.15.59:0/349932809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40a0a30 0x7f45c4133e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:37.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45ca750700 1 --2- 172.21.15.59:0/349932809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c4138d80 0x7f45c4134350 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00ef90 tx=0x7f45bc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:37.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45c27fc700 1 -- 172.21.15.59:0/349932809 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc018070 con 0x7f45c4138d80 2023-09-30T22:35:37.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.931+0000 7f45c27fc700 1 -- 172.21.15.59:0/349932809 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc00f040 con 0x7f45c4138d80 2023-09-30T22:35:37.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.932+0000 7f45cc1b3700 1 -- 172.21.15.59:0/349932809 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b80094a0 con 0x7f45c4138d80 2023-09-30T22:35:37.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.932+0000 7f45c27fc700 1 -- 172.21.15.59:0/349932809 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc003c40 con 0x7f45c4138d80 2023-09-30T22:35:37.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.932+0000 7f45cc1b3700 1 -- 172.21.15.59:0/349932809 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c40a0470 con 0x7f45c4138d80 2023-09-30T22:35:37.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.932+0000 7f45c27fc700 1 -- 172.21.15.59:0/349932809 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45bc00c880 con 0x7f45c4138d80 2023-09-30T22:35:37.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.932+0000 7f45cc1b3700 1 -- 172.21.15.59:0/349932809 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c40747f0 con 0x7f45c4138d80 2023-09-30T22:35:37.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.933+0000 7f45c27fc700 1 -- 172.21.15.59:0/349932809 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f45bc03f7f0 con 0x7f45c4138d80 2023-09-30T22:35:37.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:37.942+0000 7f45c27fc700 1 -- 172.21.15.59:0/349932809 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45bc00cb30 con 0x7f45c4138d80 2023-09-30T22:35:38.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.114+0000 7f2079919700 1 -- 172.21.15.59:0/322921179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f207408b830 con 0x7f2074099800 2023-09-30T22:35:38.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.115+0000 7f206bfff700 1 -- 172.21.15.59:0/322921179 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f206402a020 con 0x7f2074099800 2023-09-30T22:35:38.116 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:38.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.117+0000 7f2079919700 1 -- 172.21.15.59:0/322921179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2074099800 msgr2=0x7f207412ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:38.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.117+0000 7f2079919700 1 --2- 172.21.15.59:0/322921179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2074099800 0x7f207412ec00 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f206400efc0 tx=0x7f206400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.117+0000 7f2079919700 1 -- 172.21.15.59:0/322921179 shutdown_connections 2023-09-30T22:35:38.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.117+0000 7f2079919700 1 --2- 172.21.15.59:0/322921179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f207412c830 0x7f207412f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.117+0000 7f2079919700 1 --2- 172.21.15.59:0/322921179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2074099800 0x7f207412ec00 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.117+0000 7f2079919700 1 --2- 172.21.15.59:0/322921179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f207409a880 0x7f207412f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.117+0000 7f2079919700 1 -- 172.21.15.59:0/322921179 >> 172.21.15.59:0/322921179 conn(0x7f207409f470 msgr2=0x7f207409fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:38.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.117+0000 7f2079919700 1 -- 172.21.15.59:0/322921179 shutdown_connections 2023-09-30T22:35:38.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.117+0000 7f2079919700 1 -- 172.21.15.59:0/322921179 wait complete. 2023-09-30T22:35:38.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:38.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.148+0000 7f45cc1b3700 1 -- 172.21.15.59:0/349932809 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f45c4137b50 con 0x7f45c4138d80 2023-09-30T22:35:38.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.149+0000 7f45c27fc700 1 -- 172.21.15.59:0/349932809 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45bc01de00 con 0x7f45c4138d80 2023-09-30T22:35:38.150 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:38.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.151+0000 7f45cc1b3700 1 -- 172.21.15.59:0/349932809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c4138d80 msgr2=0x7f45c4134350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:38.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.151+0000 7f45cc1b3700 1 --2- 172.21.15.59:0/349932809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c4138d80 0x7f45c4134350 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00ef90 tx=0x7f45bc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.151+0000 7f45cc1b3700 1 -- 172.21.15.59:0/349932809 shutdown_connections 2023-09-30T22:35:38.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.151+0000 7f45cc1b3700 1 --2- 172.21.15.59:0/349932809 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409d630 0x7f45c41338d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.151+0000 7f45cc1b3700 1 --2- 172.21.15.59:0/349932809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c4138d80 0x7f45c4134350 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.151+0000 7f45cc1b3700 1 --2- 172.21.15.59:0/349932809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c40a0a30 0x7f45c4133e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.151+0000 7f45cc1b3700 1 -- 172.21.15.59:0/349932809 >> 172.21.15.59:0/349932809 conn(0x7f45c40a3050 msgr2=0x7f45c409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:38.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.151+0000 7f45cc1b3700 1 -- 172.21.15.59:0/349932809 shutdown_connections 2023-09-30T22:35:38.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.151+0000 7f45cc1b3700 1 -- 172.21.15.59:0/349932809 wait complete. 2023-09-30T22:35:38.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:38.193 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:38.235 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:38.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.348+0000 7f72fe085700 1 Processor -- start 2023-09-30T22:35:38.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.348+0000 7f72fe085700 1 -- start start 2023-09-30T22:35:38.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.349+0000 7f72fe085700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72f80a0a30 0x7f72f80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:38.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.349+0000 7f72fe085700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72f8138d80 0x7f72f813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:38.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.349+0000 7f72fe085700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f80a2a70 con 0x7f72f809d630 2023-09-30T22:35:38.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.349+0000 7f72fe085700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f80a01d0 con 0x7f72f8138d80 2023-09-30T22:35:38.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.349+0000 7f72fe085700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72f809e2b0 con 0x7f72f80a0a30 2023-09-30T22:35:38.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.349+0000 7f72f77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72f80a0a30 0x7f72f80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:38.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.349+0000 7f72f77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72f80a0a30 0x7f72f80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44892/0 (socket says 172.21.15.59:44892) 2023-09-30T22:35:38.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.349+0000 7f72f77fe700 1 -- 172.21.15.59:0/891939520 learned_addr learned my addr 172.21.15.59:0/891939520 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:38.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.349+0000 7f72f7fff700 1 --2- 172.21.15.59:0/891939520 >> v2:172.21.15.59:3300/0 conn(0x7f72f8138d80 0x7f72f813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:38.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.350+0000 7f72f77fe700 1 -- 172.21.15.59:0/891939520 >> v2:172.21.15.59:3300/0 conn(0x7f72f8138d80 msgr2=0x7f72f813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:38.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.350+0000 7f72f77fe700 1 --2- 172.21.15.59:0/891939520 >> v2:172.21.15.59:3300/0 conn(0x7f72f8138d80 0x7f72f813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.350+0000 7f72f77fe700 1 -- 172.21.15.59:0/891939520 >> v1:172.21.15.59:6789/0 conn(0x7f72f809d630 legacy=0x7f72f80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:38.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.350+0000 7f72f77fe700 1 -- 172.21.15.59:0/891939520 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f809dc50 con 0x7f72f80a0a30 2023-09-30T22:35:38.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.350+0000 7f72f77fe700 1 --2- 172.21.15.59:0/891939520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72f80a0a30 0x7f72f80a0e00 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f72e00098f0 tx=0x7f72e0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=897624083098dadb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:38.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.352+0000 7f72f67fc700 1 -- 172.21.15.59:0/891939520 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e0011830 con 0x7f72f80a0a30 2023-09-30T22:35:38.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.352+0000 7f72f67fc700 1 -- 172.21.15.59:0/891939520 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e0011990 con 0x7f72f80a0a30 2023-09-30T22:35:38.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.352+0000 7f72f67fc700 1 -- 172.21.15.59:0/891939520 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e0011d00 con 0x7f72f80a0a30 2023-09-30T22:35:38.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.353+0000 7f72fe085700 1 -- 172.21.15.59:0/891939520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72f80a0a30 msgr2=0x7f72f80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:38.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.353+0000 7f72fe085700 1 --2- 172.21.15.59:0/891939520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72f80a0a30 0x7f72f80a0e00 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f72e00098f0 tx=0x7f72e0009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:38.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.353+0000 7f72fe085700 1 -- 172.21.15.59:0/891939520 shutdown_connections 2023-09-30T22:35:38.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.353+0000 7f72fe085700 1 --2- 172.21.15.59:0/891939520 >> v2:172.21.15.59:3300/0 conn(0x7f72f8138d80 0x7f72f813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.353+0000 7f72fe085700 1 --2- 172.21.15.59:0/891939520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72f80a0a30 0x7f72f80a0e00 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.353+0000 7f72fe085700 1 -- 172.21.15.59:0/891939520 >> 172.21.15.59:0/891939520 conn(0x7f72f80a3050 msgr2=0x7f72f80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:38.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.353+0000 7f72fe085700 1 -- 172.21.15.59:0/891939520 shutdown_connections 2023-09-30T22:35:38.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.353+0000 7f72fe085700 1 -- 172.21.15.59:0/891939520 wait complete. 2023-09-30T22:35:38.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.355+0000 7f72fe085700 1 Processor -- start 2023-09-30T22:35:38.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.355+0000 7f72fe085700 1 -- start start 2023-09-30T22:35:38.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72fe085700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f809d630 0x7f72f8120870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:38.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72fe085700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72f80a0a30 0x7f72f8120db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:38.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72fe085700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72f8138d80 0x7f72f81212f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:38.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72fe085700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f8122c80 con 0x7f72f80a0a30 2023-09-30T22:35:38.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72fe085700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f81223b0 con 0x7f72f809d630 2023-09-30T22:35:38.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72fe085700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72f813b070 con 0x7f72f8138d80 2023-09-30T22:35:38.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72f7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72f8138d80 0x7f72f81212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:38.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72f7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72f8138d80 0x7f72f81212f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44900/0 (socket says 172.21.15.59:44900) 2023-09-30T22:35:38.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72f6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72f80a0a30 0x7f72f8120db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:38.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72f7fff700 1 -- 172.21.15.59:0/4030553305 learned_addr learned my addr 172.21.15.59:0/4030553305 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:38.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72f77fe700 1 --2- 172.21.15.59:0/4030553305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f809d630 0x7f72f8120870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:38.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72f7fff700 1 -- 172.21.15.59:0/4030553305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f809d630 msgr2=0x7f72f8120870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:38.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72f7fff700 1 --2- 172.21.15.59:0/4030553305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f809d630 0x7f72f8120870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72f7fff700 1 -- 172.21.15.59:0/4030553305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72f80a0a30 msgr2=0x7f72f8120db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:38.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72f7fff700 1 --2- 172.21.15.59:0/4030553305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72f80a0a30 0x7f72f8120db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72f7fff700 1 -- 172.21.15.59:0/4030553305 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e0009550 con 0x7f72f8138d80 2023-09-30T22:35:38.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72f6ffd700 1 --2- 172.21.15.59:0/4030553305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72f80a0a30 0x7f72f8120db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:38.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.356+0000 7f72f77fe700 1 --2- 172.21.15.59:0/4030553305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f809d630 0x7f72f8120870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:38.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.357+0000 7f72f7fff700 1 --2- 172.21.15.59:0/4030553305 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72f8138d80 0x7f72f81212f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f72f000efc0 tx=0x7f72f000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:38.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.357+0000 7f72effff700 1 -- 172.21.15.59:0/4030553305 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000cc90 con 0x7f72f8138d80 2023-09-30T22:35:38.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.357+0000 7f72effff700 1 -- 172.21.15.59:0/4030553305 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f000f040 con 0x7f72f8138d80 2023-09-30T22:35:38.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.357+0000 7f72effff700 1 -- 172.21.15.59:0/4030553305 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0014480 con 0x7f72f8138d80 2023-09-30T22:35:38.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.357+0000 7f72fe085700 1 -- 172.21.15.59:0/4030553305 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f8124320 con 0x7f72f8138d80 2023-09-30T22:35:38.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.357+0000 7f72fe085700 1 -- 172.21.15.59:0/4030553305 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f8123fe0 con 0x7f72f8138d80 2023-09-30T22:35:38.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.358+0000 7f72fe085700 1 -- 172.21.15.59:0/4030553305 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f80747f0 con 0x7f72f8138d80 2023-09-30T22:35:38.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.358+0000 7f72effff700 1 -- 172.21.15.59:0/4030553305 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72f0014600 con 0x7f72f8138d80 2023-09-30T22:35:38.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.358+0000 7f72effff700 1 -- 172.21.15.59:0/4030553305 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f72f003feb0 con 0x7f72f8138d80 2023-09-30T22:35:38.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.363+0000 7f72effff700 1 -- 172.21.15.59:0/4030553305 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72f00118b0 con 0x7f72f8138d80 2023-09-30T22:35:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.391+0000 7f440d715700 1 Processor -- start 2023-09-30T22:35:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.392+0000 7f440d715700 1 -- start start 2023-09-30T22:35:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.392+0000 7f440d715700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4408136820 0x7f4408138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.392+0000 7f440d715700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4408139140 0x7f440813b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.392+0000 7f440d715700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440806bc00 con 0x7f4408133a80 2023-09-30T22:35:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.392+0000 7f440d715700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f440806c570 con 0x7f4408136820 2023-09-30T22:35:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.392+0000 7f440d715700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44080a0040 con 0x7f4408139140 2023-09-30T22:35:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.393+0000 7f44067fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4408136820 0x7f4408138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.393+0000 7f44077fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4408139140 0x7f440813b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.393+0000 7f4406ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4408133a80 0x7f4408133e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50154/0 (socket says 172.21.15.59:50154) 2023-09-30T22:35:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.393+0000 7f44067fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4408136820 0x7f4408138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55476/0 (socket says 172.21.15.59:55476) 2023-09-30T22:35:38.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.393+0000 7f4406ffd700 1 -- 172.21.15.59:0/3883691421 learned_addr learned my addr 172.21.15.59:0/3883691421 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:38.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.393+0000 7f44067fc700 1 -- 172.21.15.59:0/3883691421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4408139140 msgr2=0x7f440813b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:38.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.393+0000 7f44067fc700 1 --2- 172.21.15.59:0/3883691421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4408139140 0x7f440813b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.393+0000 7f44067fc700 1 -- 172.21.15.59:0/3883691421 >> v1:172.21.15.59:6789/0 conn(0x7f4408133a80 legacy=0x7f4408133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:38.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.393+0000 7f44067fc700 1 -- 172.21.15.59:0/3883691421 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4408133860 con 0x7f4408136820 2023-09-30T22:35:38.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.393+0000 7f4405ffb700 1 -- 172.21.15.59:0/3883691421 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110776917 0 0) 0x7f440806bc00 con 0x7f4408133a80 2023-09-30T22:35:38.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.393+0000 7f44067fc700 1 --2- 172.21.15.59:0/3883691421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4408136820 0x7f4408138c00 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009840 tx=0x7f43fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9447e82fab3d39 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:38.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.393+0000 7f4405ffb700 1 -- 172.21.15.59:0/3883691421 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc011830 con 0x7f4408136820 2023-09-30T22:35:38.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.393+0000 7f4405ffb700 1 -- 172.21.15.59:0/3883691421 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43fc011990 con 0x7f4408136820 2023-09-30T22:35:38.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.393+0000 7f4405ffb700 1 -- 172.21.15.59:0/3883691421 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc011d20 con 0x7f4408136820 2023-09-30T22:35:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.394+0000 7f440d715700 1 -- 172.21.15.59:0/3883691421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4408136820 msgr2=0x7f4408138c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.394+0000 7f440d715700 1 --2- 172.21.15.59:0/3883691421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4408136820 0x7f4408138c00 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009840 tx=0x7f43fc009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.394+0000 7f440d715700 1 -- 172.21.15.59:0/3883691421 shutdown_connections 2023-09-30T22:35:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.394+0000 7f440d715700 1 --2- 172.21.15.59:0/3883691421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4408139140 0x7f440813b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.394+0000 7f440d715700 1 --2- 172.21.15.59:0/3883691421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4408136820 0x7f4408138c00 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.394+0000 7f440d715700 1 -- 172.21.15.59:0/3883691421 >> 172.21.15.59:0/3883691421 conn(0x7f44080a4210 msgr2=0x7f44080a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.394+0000 7f440d715700 1 -- 172.21.15.59:0/3883691421 shutdown_connections 2023-09-30T22:35:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.394+0000 7f440d715700 1 -- 172.21.15.59:0/3883691421 wait complete. 2023-09-30T22:35:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.395+0000 7f440d715700 1 Processor -- start 2023-09-30T22:35:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.396+0000 7f440d715700 1 -- start start 2023-09-30T22:35:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.396+0000 7f440d715700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4408133a80 0x7f440809d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.396+0000 7f440d715700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4408136820 0x7f440809d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.396+0000 7f440d715700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4408139140 0x7f44081c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.396+0000 7f440d715700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44081309b0 con 0x7f4408133a80 2023-09-30T22:35:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.396+0000 7f440d715700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4408138ca0 con 0x7f4408139140 2023-09-30T22:35:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.396+0000 7f440d715700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f440809df20 con 0x7f4408136820 2023-09-30T22:35:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.396+0000 7f4406ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4408133a80 0x7f440809d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.396+0000 7f44067fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4408136820 0x7f440809d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.396+0000 7f44067fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4408136820 0x7f440809d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44910/0 (socket says 172.21.15.59:44910) 2023-09-30T22:35:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.396+0000 7f44067fc700 1 -- 172.21.15.59:0/2869045206 learned_addr learned my addr 172.21.15.59:0/2869045206 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.396+0000 7f4406ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4408133a80 0x7f440809d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55478/0 (socket says 172.21.15.59:55478) 2023-09-30T22:35:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.396+0000 7f44077fe700 1 --2- 172.21.15.59:0/2869045206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4408139140 0x7f44081c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.397+0000 7f44067fc700 1 -- 172.21.15.59:0/2869045206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4408139140 msgr2=0x7f44081c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.397+0000 7f44067fc700 1 --2- 172.21.15.59:0/2869045206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4408139140 0x7f44081c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.397+0000 7f44067fc700 1 -- 172.21.15.59:0/2869045206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4408133a80 msgr2=0x7f440809d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.397+0000 7f44067fc700 1 --2- 172.21.15.59:0/2869045206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4408133a80 0x7f440809d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.397+0000 7f44067fc700 1 -- 172.21.15.59:0/2869045206 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc0094a0 con 0x7f4408136820 2023-09-30T22:35:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.397+0000 7f44077fe700 1 --2- 172.21.15.59:0/2869045206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4408139140 0x7f44081c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.397+0000 7f4406ffd700 1 --2- 172.21.15.59:0/2869045206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4408133a80 0x7f440809d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.397+0000 7f44067fc700 1 --2- 172.21.15.59:0/2869045206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4408136820 0x7f440809d9e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009fd0 tx=0x7f43fc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.397+0000 7f43ef7fe700 1 -- 172.21.15.59:0/2869045206 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc0036a0 con 0x7f4408136820 2023-09-30T22:35:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.397+0000 7f43ef7fe700 1 -- 172.21.15.59:0/2869045206 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43fc01f070 con 0x7f4408136820 2023-09-30T22:35:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.397+0000 7f440d715700 1 -- 172.21.15.59:0/2869045206 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440809c040 con 0x7f4408136820 2023-09-30T22:35:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.397+0000 7f43ef7fe700 1 -- 172.21.15.59:0/2869045206 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc003a60 con 0x7f4408136820 2023-09-30T22:35:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.397+0000 7f440d715700 1 -- 172.21.15.59:0/2869045206 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440809bd30 con 0x7f4408136820 2023-09-30T22:35:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.398+0000 7f43ef7fe700 1 -- 172.21.15.59:0/2869045206 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43fc003bc0 con 0x7f4408136820 2023-09-30T22:35:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.398+0000 7f43ef7fe700 1 -- 172.21.15.59:0/2869045206 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f43fc021070 con 0x7f4408136820 2023-09-30T22:35:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.398+0000 7f440d715700 1 -- 172.21.15.59:0/2869045206 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44080a12d0 con 0x7f4408136820 2023-09-30T22:35:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.408+0000 7f43ef7fe700 1 -- 172.21.15.59:0/2869045206 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43fc015080 con 0x7f4408136820 2023-09-30T22:35:38.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.576+0000 7f72fe085700 1 -- 172.21.15.59:0/4030553305 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f72f8072980 con 0x7f72f8138d80 2023-09-30T22:35:38.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.577+0000 7f72effff700 1 -- 172.21.15.59:0/4030553305 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72f0018030 con 0x7f72f8138d80 2023-09-30T22:35:38.580 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:38.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.579+0000 7f72fe085700 1 -- 172.21.15.59:0/4030553305 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72f8138d80 msgr2=0x7f72f81212f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:38.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.579+0000 7f72fe085700 1 --2- 172.21.15.59:0/4030553305 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72f8138d80 0x7f72f81212f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f72f000efc0 tx=0x7f72f000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.579+0000 7f72fe085700 1 -- 172.21.15.59:0/4030553305 shutdown_connections 2023-09-30T22:35:38.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.579+0000 7f72fe085700 1 --2- 172.21.15.59:0/4030553305 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72f8138d80 0x7f72f81212f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.579+0000 7f72fe085700 1 --2- 172.21.15.59:0/4030553305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f809d630 0x7f72f8120870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.579+0000 7f72fe085700 1 --2- 172.21.15.59:0/4030553305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72f80a0a30 0x7f72f8120db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.579+0000 7f72fe085700 1 -- 172.21.15.59:0/4030553305 >> 172.21.15.59:0/4030553305 conn(0x7f72f80a3050 msgr2=0x7f72f809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:38.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.579+0000 7f72fe085700 1 -- 172.21.15.59:0/4030553305 shutdown_connections 2023-09-30T22:35:38.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.579+0000 7f72fe085700 1 -- 172.21.15.59:0/4030553305 wait complete. 2023-09-30T22:35:38.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:38.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.613+0000 7f440d715700 1 -- 172.21.15.59:0/2869045206 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4408074ea0 con 0x7f4408136820 2023-09-30T22:35:38.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.613+0000 7f43ef7fe700 1 -- 172.21.15.59:0/2869045206 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43fc0253e0 con 0x7f4408136820 2023-09-30T22:35:38.615 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:38.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.615+0000 7f440d715700 1 -- 172.21.15.59:0/2869045206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4408136820 msgr2=0x7f440809d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:38.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.616+0000 7f440d715700 1 --2- 172.21.15.59:0/2869045206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4408136820 0x7f440809d9e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009fd0 tx=0x7f43fc004750 comp rx=0 tx=0).stop 2023-09-30T22:35:38.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.616+0000 7f440d715700 1 -- 172.21.15.59:0/2869045206 shutdown_connections 2023-09-30T22:35:38.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.616+0000 7f440d715700 1 --2- 172.21.15.59:0/2869045206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4408139140 0x7f44081c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.616+0000 7f440d715700 1 --2- 172.21.15.59:0/2869045206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4408133a80 0x7f440809d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.616+0000 7f440d715700 1 --2- 172.21.15.59:0/2869045206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4408136820 0x7f440809d9e0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:38.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.616+0000 7f440d715700 1 -- 172.21.15.59:0/2869045206 >> 172.21.15.59:0/2869045206 conn(0x7f44080a4210 msgr2=0x7f4408134600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:38.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.616+0000 7f440d715700 1 -- 172.21.15.59:0/2869045206 shutdown_connections 2023-09-30T22:35:38.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:38.616+0000 7f440d715700 1 -- 172.21.15.59:0/2869045206 wait complete. 2023-09-30T22:35:38.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:39.133 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:39.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:39.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.279+0000 7f4f72dda700 1 Processor -- start 2023-09-30T22:35:39.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.280+0000 7f4f72dda700 1 -- start start 2023-09-30T22:35:39.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.280+0000 7f4f72dda700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f6c0a0a30 0x7f4f6c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.280+0000 7f4f72dda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6c138d80 0x7f4f6c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.280+0000 7f4f72dda700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c0a2a70 con 0x7f4f6c09d630 2023-09-30T22:35:39.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.280+0000 7f4f72dda700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6c0a01d0 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.280+0000 7f4f72dda700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c09e2b0 con 0x7f4f6c138d80 2023-09-30T22:35:39.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.280+0000 7f4f70b76700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f6c0a0a30 0x7f4f6c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.280+0000 7f4f71377700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6c138d80 0x7f4f6c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.280+0000 7f4f70b76700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f6c0a0a30 0x7f4f6c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55488/0 (socket says 172.21.15.59:55488) 2023-09-30T22:35:39.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.280+0000 7f4f71377700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6c138d80 0x7f4f6c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58608/0 (socket says 172.21.15.59:58608) 2023-09-30T22:35:39.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.280+0000 7f4f70b76700 1 -- 172.21.15.59:0/1384689862 learned_addr learned my addr 172.21.15.59:0/1384689862 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:39.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.281+0000 7f4f70b76700 1 -- 172.21.15.59:0/1384689862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6c138d80 msgr2=0x7f4f6c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:39.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.281+0000 7f4f70b76700 1 --2- 172.21.15.59:0/1384689862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6c138d80 0x7f4f6c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.281+0000 7f4f70b76700 1 -- 172.21.15.59:0/1384689862 >> v1:172.21.15.59:6789/0 conn(0x7f4f6c09d630 legacy=0x7f4f6c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.281+0000 7f4f70b76700 1 -- 172.21.15.59:0/1384689862 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c09dc50 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.281+0000 7f4f71377700 1 --2- 172.21.15.59:0/1384689862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6c138d80 0x7f4f6c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:39.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.281+0000 7f4f70b76700 1 --2- 172.21.15.59:0/1384689862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c0a0a30 0x7f4f6c0a0e00 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009e50 tx=0x7f4f6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee770577d6706fc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:39.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.281+0000 7f4f6b7fe700 1 -- 172.21.15.59:0/1384689862 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6400e070 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.281+0000 7f4f6b7fe700 1 -- 172.21.15.59:0/1384689862 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6400b910 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.281+0000 7f4f6b7fe700 1 -- 172.21.15.59:0/1384689862 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6400bcc0 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.282+0000 7f4f72dda700 1 -- 172.21.15.59:0/1384689862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c0a0a30 msgr2=0x7f4f6c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.282+0000 7f4f72dda700 1 --2- 172.21.15.59:0/1384689862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c0a0a30 0x7f4f6c0a0e00 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009e50 tx=0x7f4f6400b330 comp rx=0 tx=0).stop 2023-09-30T22:35:39.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.282+0000 7f4f72dda700 1 -- 172.21.15.59:0/1384689862 shutdown_connections 2023-09-30T22:35:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.282+0000 7f4f72dda700 1 --2- 172.21.15.59:0/1384689862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c0a0a30 0x7f4f6c0a0e00 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.282+0000 7f4f72dda700 1 --2- 172.21.15.59:0/1384689862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6c138d80 0x7f4f6c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.282+0000 7f4f72dda700 1 -- 172.21.15.59:0/1384689862 >> 172.21.15.59:0/1384689862 conn(0x7f4f6c0a3050 msgr2=0x7f4f6c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.282+0000 7f4f72dda700 1 -- 172.21.15.59:0/1384689862 shutdown_connections 2023-09-30T22:35:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.282+0000 7f4f72dda700 1 -- 172.21.15.59:0/1384689862 wait complete. 2023-09-30T22:35:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.283+0000 7f4f72dda700 1 Processor -- start 2023-09-30T22:35:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.283+0000 7f4f72dda700 1 -- start start 2023-09-30T22:35:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f72dda700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6c09d630 0x7f4f6c120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f72dda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6c0a0a30 0x7f4f6c120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f72dda700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c138d80 0x7f4f6c121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f72dda700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c123110 con 0x7f4f6c138d80 2023-09-30T22:35:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f72dda700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c122be0 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f72dda700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c122310 con 0x7f4f6c09d630 2023-09-30T22:35:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f6bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6c0a0a30 0x7f4f6c120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f70b76700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6c09d630 0x7f4f6c120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f71377700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c138d80 0x7f4f6c121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f6bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6c0a0a30 0x7f4f6c120c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58616/0 (socket says 172.21.15.59:58616) 2023-09-30T22:35:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f70b76700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6c09d630 0x7f4f6c120700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44912/0 (socket says 172.21.15.59:44912) 2023-09-30T22:35:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f6bfff700 1 -- 172.21.15.59:0/4257657483 learned_addr learned my addr 172.21.15.59:0/4257657483 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f6bfff700 1 -- 172.21.15.59:0/4257657483 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6c09d630 msgr2=0x7f4f6c120700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f6bfff700 1 --2- 172.21.15.59:0/4257657483 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6c09d630 0x7f4f6c120700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f6bfff700 1 -- 172.21.15.59:0/4257657483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c138d80 msgr2=0x7f4f6c121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f6bfff700 1 --2- 172.21.15.59:0/4257657483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c138d80 0x7f4f6c121180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f6bfff700 1 -- 172.21.15.59:0/4257657483 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0094a0 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f71377700 1 --2- 172.21.15.59:0/4257657483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c138d80 0x7f4f6c121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:39.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.284+0000 7f4f6bfff700 1 --2- 172.21.15.59:0/4257657483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6c0a0a30 0x7f4f6c120c40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000c510 tx=0x7f4f6000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:39.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.285+0000 7f4f697fa700 1 -- 172.21.15.59:0/4257657483 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f600052d0 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.285+0000 7f4f697fa700 1 -- 172.21.15.59:0/4257657483 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f60005430 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.285+0000 7f4f72dda700 1 -- 172.21.15.59:0/4257657483 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f64009b30 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.285+0000 7f4f697fa700 1 -- 172.21.15.59:0/4257657483 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f600038c0 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.285+0000 7f4f72dda700 1 -- 172.21.15.59:0/4257657483 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c0a4ec0 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.286+0000 7f4f697fa700 1 -- 172.21.15.59:0/4257657483 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f60003a20 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.286+0000 7f4f697fa700 1 -- 172.21.15.59:0/4257657483 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4f6003ea80 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.286+0000 7f4f72dda700 1 -- 172.21.15.59:0/4257657483 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6c123be0 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.291+0000 7f4f697fa700 1 -- 172.21.15.59:0/4257657483 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f6c123be0 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.318+0000 7f418d1ff700 1 Processor -- start 2023-09-30T22:35:39.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.318+0000 7f418d1ff700 1 -- start start 2023-09-30T22:35:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f418d1ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41880a0a30 0x7f41880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f418d1ff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4188138d80 0x7f418813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f418d1ff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41880a2a70 con 0x7f418809d630 2023-09-30T22:35:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f418d1ff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41880a01d0 con 0x7f4188138d80 2023-09-30T22:35:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f418d1ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418809e2b0 con 0x7f41880a0a30 2023-09-30T22:35:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f4186d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41880a0a30 0x7f41880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f418759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4188138d80 0x7f418813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f4186d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41880a0a30 0x7f41880a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58630/0 (socket says 172.21.15.59:58630) 2023-09-30T22:35:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f4186d9d700 1 -- 172.21.15.59:0/3058709441 learned_addr learned my addr 172.21.15.59:0/3058709441 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f418759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4188138d80 0x7f418813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55508/0 (socket says 172.21.15.59:55508) 2023-09-30T22:35:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f418759e700 1 -- 172.21.15.59:0/3058709441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41880a0a30 msgr2=0x7f41880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f418759e700 1 --2- 172.21.15.59:0/3058709441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41880a0a30 0x7f41880a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f418759e700 1 -- 172.21.15.59:0/3058709441 >> v1:172.21.15.59:6789/0 conn(0x7f418809d630 legacy=0x7f41880a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f418759e700 1 -- 172.21.15.59:0/3058709441 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418809dc50 con 0x7f4188138d80 2023-09-30T22:35:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f4185d9b700 1 -- 172.21.15.59:0/3058709441 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744266687 0 0) 0x7f41880a2a70 con 0x7f418809d630 2023-09-30T22:35:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f4186d9d700 1 --2- 172.21.15.59:0/3058709441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41880a0a30 0x7f41880a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.319+0000 7f418759e700 1 --2- 172.21.15.59:0/3058709441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4188138d80 0x7f418813b160 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f4178009840 tx=0x7f4178009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e6ffcd07ae92b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.320+0000 7f4185d9b700 1 -- 172.21.15.59:0/3058709441 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178011830 con 0x7f4188138d80 2023-09-30T22:35:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.320+0000 7f4185d9b700 1 -- 172.21.15.59:0/3058709441 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4178011990 con 0x7f4188138d80 2023-09-30T22:35:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.320+0000 7f4185d9b700 1 -- 172.21.15.59:0/3058709441 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178011d20 con 0x7f4188138d80 2023-09-30T22:35:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.320+0000 7f418d1ff700 1 -- 172.21.15.59:0/3058709441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4188138d80 msgr2=0x7f418813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.320+0000 7f418d1ff700 1 --2- 172.21.15.59:0/3058709441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4188138d80 0x7f418813b160 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f4178009840 tx=0x7f4178009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.320+0000 7f418d1ff700 1 -- 172.21.15.59:0/3058709441 shutdown_connections 2023-09-30T22:35:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.320+0000 7f418d1ff700 1 --2- 172.21.15.59:0/3058709441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4188138d80 0x7f418813b160 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.320+0000 7f418d1ff700 1 --2- 172.21.15.59:0/3058709441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41880a0a30 0x7f41880a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.320+0000 7f418d1ff700 1 -- 172.21.15.59:0/3058709441 >> 172.21.15.59:0/3058709441 conn(0x7f41880a3050 msgr2=0x7f41880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.320+0000 7f418d1ff700 1 -- 172.21.15.59:0/3058709441 shutdown_connections 2023-09-30T22:35:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.320+0000 7f418d1ff700 1 -- 172.21.15.59:0/3058709441 wait complete. 2023-09-30T22:35:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.322+0000 7f418d1ff700 1 Processor -- start 2023-09-30T22:35:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.322+0000 7f418d1ff700 1 -- start start 2023-09-30T22:35:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.322+0000 7f418d1ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f418809d630 0x7f4188133690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.322+0000 7f418d1ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41880a0a30 0x7f4188133bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.322+0000 7f418d1ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4188138d80 0x7f4188134110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.322+0000 7f418d1ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41881361b0 con 0x7f418809d630 2023-09-30T22:35:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.322+0000 7f418d1ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4188136ed0 con 0x7f4188138d80 2023-09-30T22:35:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.322+0000 7f418d1ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41880a4b60 con 0x7f41880a0a30 2023-09-30T22:35:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.322+0000 7f418759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4188138d80 0x7f4188134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.322+0000 7f4186d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f418809d630 0x7f4188133690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.322+0000 7f418759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4188138d80 0x7f4188134110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58636/0 (socket says 172.21.15.59:58636) 2023-09-30T22:35:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.322+0000 7f4186d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f418809d630 0x7f4188133690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55516/0 (socket says 172.21.15.59:55516) 2023-09-30T22:35:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.322+0000 7f418759e700 1 -- 172.21.15.59:0/861095873 learned_addr learned my addr 172.21.15.59:0/861095873 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.323+0000 7f418659c700 1 --2- 172.21.15.59:0/861095873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41880a0a30 0x7f4188133bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.323+0000 7f4186d9d700 1 -- 172.21.15.59:0/861095873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41880a0a30 msgr2=0x7f4188133bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.323+0000 7f4186d9d700 1 --2- 172.21.15.59:0/861095873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41880a0a30 0x7f4188133bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.323+0000 7f4186d9d700 1 -- 172.21.15.59:0/861095873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4188138d80 msgr2=0x7f4188134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.323+0000 7f4186d9d700 1 --2- 172.21.15.59:0/861095873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4188138d80 0x7f4188134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.323+0000 7f4186d9d700 1 -- 172.21.15.59:0/861095873 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4180009b30 con 0x7f418809d630 2023-09-30T22:35:39.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.323+0000 7f418759e700 1 --2- 172.21.15.59:0/861095873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4188138d80 0x7f4188134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:39.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.323+0000 7f4186d9d700 1 --2- 172.21.15.59:0/861095873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f418809d630 0x7f4188133690 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f4180009e40 tx=0x7f418000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:39.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.323+0000 7f417f7fe700 1 -- 172.21.15.59:0/861095873 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180003c20 con 0x7f418809d630 2023-09-30T22:35:39.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.323+0000 7f417f7fe700 1 -- 172.21.15.59:0/861095873 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418000f040 con 0x7f418809d630 2023-09-30T22:35:39.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.323+0000 7f418d1ff700 1 -- 172.21.15.59:0/861095873 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41780094a0 con 0x7f418809d630 2023-09-30T22:35:39.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.323+0000 7f417f7fe700 1 -- 172.21.15.59:0/861095873 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418000c9b0 con 0x7f418809d630 2023-09-30T22:35:39.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.323+0000 7f418d1ff700 1 -- 172.21.15.59:0/861095873 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41880a0460 con 0x7f418809d630 2023-09-30T22:35:39.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.324+0000 7f417f7fe700 1 -- 172.21.15.59:0/861095873 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f418000cb10 con 0x7f418809d630 2023-09-30T22:35:39.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.324+0000 7f418d1ff700 1 -- 172.21.15.59:0/861095873 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41880747f0 con 0x7f418809d630 2023-09-30T22:35:39.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.324+0000 7f417f7fe700 1 -- 172.21.15.59:0/861095873 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f418003fba0 con 0x7f418809d630 2023-09-30T22:35:39.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.329+0000 7f417f7fe700 1 -- 172.21.15.59:0/861095873 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4180004030 con 0x7f418809d630 2023-09-30T22:35:39.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.500+0000 7f4f72dda700 1 -- 172.21.15.59:0/4257657483 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4f6c123be0 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.500+0000 7f4f697fa700 1 -- 172.21.15.59:0/4257657483 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f6c123be0 con 0x7f4f6c0a0a30 2023-09-30T22:35:39.502 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:39.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.503+0000 7f4f72dda700 1 -- 172.21.15.59:0/4257657483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6c0a0a30 msgr2=0x7f4f6c120c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.503+0000 7f4f72dda700 1 --2- 172.21.15.59:0/4257657483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6c0a0a30 0x7f4f6c120c40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000c510 tx=0x7f4f6000c820 comp rx=0 tx=0).stop 2023-09-30T22:35:39.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.503+0000 7f4f72dda700 1 -- 172.21.15.59:0/4257657483 shutdown_connections 2023-09-30T22:35:39.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.503+0000 7f4f72dda700 1 --2- 172.21.15.59:0/4257657483 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f6c09d630 0x7f4f6c120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.503+0000 7f4f72dda700 1 --2- 172.21.15.59:0/4257657483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c138d80 0x7f4f6c121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.503+0000 7f4f72dda700 1 --2- 172.21.15.59:0/4257657483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6c0a0a30 0x7f4f6c120c40 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.503+0000 7f4f72dda700 1 -- 172.21.15.59:0/4257657483 >> 172.21.15.59:0/4257657483 conn(0x7f4f6c0a3050 msgr2=0x7f4f6c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:39.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.503+0000 7f4f72dda700 1 -- 172.21.15.59:0/4257657483 shutdown_connections 2023-09-30T22:35:39.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.503+0000 7f4f72dda700 1 -- 172.21.15.59:0/4257657483 wait complete. 2023-09-30T22:35:39.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.538+0000 7f418d1ff700 1 -- 172.21.15.59:0/861095873 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4188072980 con 0x7f418809d630 2023-09-30T22:35:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.539+0000 7f417f7fe700 1 -- 172.21.15.59:0/861095873 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41800133e0 con 0x7f418809d630 2023-09-30T22:35:39.540 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:39.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.541+0000 7f418d1ff700 1 -- 172.21.15.59:0/861095873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f418809d630 msgr2=0x7f4188133690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.541+0000 7f418d1ff700 1 --2- 172.21.15.59:0/861095873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f418809d630 0x7f4188133690 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f4180009e40 tx=0x7f418000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.541+0000 7f418d1ff700 1 -- 172.21.15.59:0/861095873 shutdown_connections 2023-09-30T22:35:39.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.541+0000 7f418d1ff700 1 --2- 172.21.15.59:0/861095873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4188138d80 0x7f4188134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.541+0000 7f418d1ff700 1 --2- 172.21.15.59:0/861095873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f418809d630 0x7f4188133690 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.541+0000 7f418d1ff700 1 --2- 172.21.15.59:0/861095873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41880a0a30 0x7f4188133bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.541+0000 7f418d1ff700 1 -- 172.21.15.59:0/861095873 >> 172.21.15.59:0/861095873 conn(0x7f41880a3050 msgr2=0x7f418813af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:39.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.541+0000 7f418d1ff700 1 -- 172.21.15.59:0/861095873 shutdown_connections 2023-09-30T22:35:39.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.541+0000 7f418d1ff700 1 -- 172.21.15.59:0/861095873 wait complete. 2023-09-30T22:35:39.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:39.595 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:39.631 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:39.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.738+0000 7f3ac1618700 1 Processor -- start 2023-09-30T22:35:39.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.738+0000 7f3ac1618700 1 -- start start 2023-09-30T22:35:39.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3ac1618700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3abc130750 0x7f3abc130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3ac1618700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3abc09e250 0x7f3abc1384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3ac1618700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3abc09c190 con 0x7f3abc09d6f0 2023-09-30T22:35:39.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3ac1618700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc09b090 con 0x7f3abc130750 2023-09-30T22:35:39.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3ac1618700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc09a6c0 con 0x7f3abc09e250 2023-09-30T22:35:39.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3abaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3abc130750 0x7f3abc130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3abb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3abc09e250 0x7f3abc1384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3abaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3abc130750 0x7f3abc130b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55520/0 (socket says 172.21.15.59:55520) 2023-09-30T22:35:39.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3abb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3abc09e250 0x7f3abc1384c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44920/0 (socket says 172.21.15.59:44920) 2023-09-30T22:35:39.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3abaffd700 1 -- 172.21.15.59:0/2248443541 learned_addr learned my addr 172.21.15.59:0/2248443541 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:39.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3abb7fe700 1 -- 172.21.15.59:0/2248443541 >> v2:172.21.15.59:3300/0 conn(0x7f3abc130750 msgr2=0x7f3abc130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:39.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3abb7fe700 1 --2- 172.21.15.59:0/2248443541 >> v2:172.21.15.59:3300/0 conn(0x7f3abc130750 0x7f3abc130b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3abb7fe700 1 -- 172.21.15.59:0/2248443541 >> v1:172.21.15.59:6789/0 conn(0x7f3abc09d6f0 legacy=0x7f3abc09db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3abb7fe700 1 -- 172.21.15.59:0/2248443541 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc131060 con 0x7f3abc09e250 2023-09-30T22:35:39.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3abaffd700 1 --2- 172.21.15.59:0/2248443541 >> v2:172.21.15.59:3300/0 conn(0x7f3abc130750 0x7f3abc130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:39.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.739+0000 7f3abb7fe700 1 --2- 172.21.15.59:0/2248443541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3abc09e250 0x7f3abc1384c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009840 tx=0x7f3ab4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc011d956a7c72e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:39.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.740+0000 7f3ab9ffb700 1 -- 172.21.15.59:0/2248443541 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4011830 con 0x7f3abc09e250 2023-09-30T22:35:39.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.740+0000 7f3ab9ffb700 1 -- 172.21.15.59:0/2248443541 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab4011990 con 0x7f3abc09e250 2023-09-30T22:35:39.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.740+0000 7f3ab9ffb700 1 -- 172.21.15.59:0/2248443541 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4011d20 con 0x7f3abc09e250 2023-09-30T22:35:39.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.740+0000 7f3ac1618700 1 -- 172.21.15.59:0/2248443541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3abc09e250 msgr2=0x7f3abc1384c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.741+0000 7f3ac1618700 1 --2- 172.21.15.59:0/2248443541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3abc09e250 0x7f3abc1384c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009840 tx=0x7f3ab4009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:39.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.741+0000 7f3ac1618700 1 -- 172.21.15.59:0/2248443541 shutdown_connections 2023-09-30T22:35:39.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.741+0000 7f3ac1618700 1 --2- 172.21.15.59:0/2248443541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3abc09e250 0x7f3abc1384c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.741+0000 7f3ac1618700 1 --2- 172.21.15.59:0/2248443541 >> v2:172.21.15.59:3300/0 conn(0x7f3abc130750 0x7f3abc130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.741+0000 7f3ac1618700 1 -- 172.21.15.59:0/2248443541 >> 172.21.15.59:0/2248443541 conn(0x7f3abc09f470 msgr2=0x7f3abc0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:39.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.741+0000 7f3ac1618700 1 -- 172.21.15.59:0/2248443541 shutdown_connections 2023-09-30T22:35:39.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.741+0000 7f3ac1618700 1 -- 172.21.15.59:0/2248443541 wait complete. 2023-09-30T22:35:39.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.742+0000 7f3ac1618700 1 Processor -- start 2023-09-30T22:35:39.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.742+0000 7f3ac1618700 1 -- start start 2023-09-30T22:35:39.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.742+0000 7f3ac1618700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3abc09d6f0 0x7f3abc12e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.742+0000 7f3ac1618700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3abc09e250 0x7f3abc12e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.742+0000 7f3ac1618700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3abc130750 0x7f3abc12eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.742+0000 7f3ac1618700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc08f3e0 con 0x7f3abc130750 2023-09-30T22:35:39.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.742+0000 7f3ac1618700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc12f4f0 con 0x7f3abc09e250 2023-09-30T22:35:39.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.742+0000 7f3ac1618700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc06fe00 con 0x7f3abc09d6f0 2023-09-30T22:35:39.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3abaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3abc09d6f0 0x7f3abc12e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3aba7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3abc09e250 0x7f3abc12e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3abb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3abc130750 0x7f3abc12eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3aba7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3abc09e250 0x7f3abc12e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58642/0 (socket says 172.21.15.59:58642) 2023-09-30T22:35:39.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3abaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3abc09d6f0 0x7f3abc12e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44930/0 (socket says 172.21.15.59:44930) 2023-09-30T22:35:39.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3aba7fc700 1 -- 172.21.15.59:0/1409118413 learned_addr learned my addr 172.21.15.59:0/1409118413 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:39.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3abb7fe700 1 -- 172.21.15.59:0/1409118413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3abc09d6f0 msgr2=0x7f3abc12e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3abb7fe700 1 --2- 172.21.15.59:0/1409118413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3abc09d6f0 0x7f3abc12e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3abb7fe700 1 -- 172.21.15.59:0/1409118413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3abc09e250 msgr2=0x7f3abc12e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3abb7fe700 1 --2- 172.21.15.59:0/1409118413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3abc09e250 0x7f3abc12e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3abb7fe700 1 -- 172.21.15.59:0/1409118413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac009b30 con 0x7f3abc130750 2023-09-30T22:35:39.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3aba7fc700 1 --2- 172.21.15.59:0/1409118413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3abc09e250 0x7f3abc12e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:39.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3abb7fe700 1 --2- 172.21.15.59:0/1409118413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3abc130750 0x7f3abc12eac0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f3abc072a00 tx=0x7f3ab4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:39.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3aa37fe700 1 -- 172.21.15.59:0/1409118413 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4004510 con 0x7f3abc130750 2023-09-30T22:35:39.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3aa37fe700 1 -- 172.21.15.59:0/1409118413 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab401f070 con 0x7f3abc130750 2023-09-30T22:35:39.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3ac1618700 1 -- 172.21.15.59:0/1409118413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab40094a0 con 0x7f3abc130750 2023-09-30T22:35:39.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3aa37fe700 1 -- 172.21.15.59:0/1409118413 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab40038e0 con 0x7f3abc130750 2023-09-30T22:35:39.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.743+0000 7f3ac1618700 1 -- 172.21.15.59:0/1409118413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3abc09b2b0 con 0x7f3abc130750 2023-09-30T22:35:39.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.744+0000 7f3aa37fe700 1 -- 172.21.15.59:0/1409118413 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ab4003a40 con 0x7f3abc130750 2023-09-30T22:35:39.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.744+0000 7f3ac1618700 1 -- 172.21.15.59:0/1409118413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3abc06f580 con 0x7f3abc130750 2023-09-30T22:35:39.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.745+0000 7f3aa37fe700 1 -- 172.21.15.59:0/1409118413 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3ab4021070 con 0x7f3abc130750 2023-09-30T22:35:39.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.750+0000 7f3aa37fe700 1 -- 172.21.15.59:0/1409118413 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ab4010380 con 0x7f3abc130750 2023-09-30T22:35:39.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.782+0000 7f54d73e8700 1 Processor -- start 2023-09-30T22:35:39.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.782+0000 7f54d73e8700 1 -- start start 2023-09-30T22:35:39.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.782+0000 7f54d73e8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d009d630 0x7f54d00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.782+0000 7f54d73e8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54d0138d80 0x7f54d013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.782+0000 7f54d73e8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d00a2a70 con 0x7f54d00a0a30 2023-09-30T22:35:39.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.782+0000 7f54d73e8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d00a01d0 con 0x7f54d009d630 2023-09-30T22:35:39.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.782+0000 7f54d73e8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54d009e2b0 con 0x7f54d0138d80 2023-09-30T22:35:39.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.783+0000 7f54d4983700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d009d630 0x7f54d00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.783+0000 7f54d5184700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f54d00a0a30 0x7f54d00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50188/0 (socket says 172.21.15.59:50188) 2023-09-30T22:35:39.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.783+0000 7f54d5184700 1 -- 172.21.15.59:0/517734650 learned_addr learned my addr 172.21.15.59:0/517734650 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:39.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.783+0000 7f54d5985700 1 --2- 172.21.15.59:0/517734650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54d0138d80 0x7f54d013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.783+0000 7f54d4983700 1 -- 172.21.15.59:0/517734650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54d0138d80 msgr2=0x7f54d013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:39.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.783+0000 7f54d4983700 1 --2- 172.21.15.59:0/517734650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54d0138d80 0x7f54d013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.783+0000 7f54d4983700 1 -- 172.21.15.59:0/517734650 >> v1:172.21.15.59:6789/0 conn(0x7f54d00a0a30 legacy=0x7f54d00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.783+0000 7f54cffff700 1 -- 172.21.15.59:0/517734650 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890734816 0 0) 0x7f54d00a2a70 con 0x7f54d00a0a30 2023-09-30T22:35:39.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.783+0000 7f54d4983700 1 -- 172.21.15.59:0/517734650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d009dc50 con 0x7f54d009d630 2023-09-30T22:35:39.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.783+0000 7f54d5985700 1 --2- 172.21.15.59:0/517734650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54d0138d80 0x7f54d013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:39.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.783+0000 7f54d4983700 1 --2- 172.21.15.59:0/517734650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d009d630 0x7f54d00a1510 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009870 tx=0x7f54c4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e3317dd5ffdac58 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:39.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.783+0000 7f54cffff700 1 -- 172.21.15.59:0/517734650 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4011830 con 0x7f54d009d630 2023-09-30T22:35:39.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.783+0000 7f54cffff700 1 -- 172.21.15.59:0/517734650 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c4011990 con 0x7f54d009d630 2023-09-30T22:35:39.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.783+0000 7f54cffff700 1 -- 172.21.15.59:0/517734650 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4011d20 con 0x7f54d009d630 2023-09-30T22:35:39.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.784+0000 7f54d73e8700 1 -- 172.21.15.59:0/517734650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d009d630 msgr2=0x7f54d00a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.784+0000 7f54d73e8700 1 --2- 172.21.15.59:0/517734650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d009d630 0x7f54d00a1510 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009870 tx=0x7f54c4009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:39.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.784+0000 7f54d73e8700 1 -- 172.21.15.59:0/517734650 shutdown_connections 2023-09-30T22:35:39.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.784+0000 7f54d73e8700 1 --2- 172.21.15.59:0/517734650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54d0138d80 0x7f54d013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.784+0000 7f54d73e8700 1 --2- 172.21.15.59:0/517734650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d009d630 0x7f54d00a1510 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.784+0000 7f54d73e8700 1 -- 172.21.15.59:0/517734650 >> 172.21.15.59:0/517734650 conn(0x7f54d00a3050 msgr2=0x7f54d00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:39.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.784+0000 7f54d73e8700 1 -- 172.21.15.59:0/517734650 shutdown_connections 2023-09-30T22:35:39.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.784+0000 7f54d73e8700 1 -- 172.21.15.59:0/517734650 wait complete. 2023-09-30T22:35:39.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.785+0000 7f54d73e8700 1 Processor -- start 2023-09-30T22:35:39.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.786+0000 7f54d73e8700 1 -- start start 2023-09-30T22:35:39.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.786+0000 7f54d73e8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54d009d630 0x7f54d0133910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.786+0000 7f54d73e8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d00a0a30 0x7f54d0133e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.786+0000 7f54d73e8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54d0138d80 0x7f54d0134390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:39.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.786+0000 7f54d73e8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0134de0 con 0x7f54d009d630 2023-09-30T22:35:39.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.786+0000 7f54d73e8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d01374b0 con 0x7f54d00a0a30 2023-09-30T22:35:39.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.786+0000 7f54d73e8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0136e00 con 0x7f54d0138d80 2023-09-30T22:35:39.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.786+0000 7f54d4983700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d00a0a30 0x7f54d0133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.786+0000 7f54d5184700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54d009d630 0x7f54d0133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.786+0000 7f54d4983700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d00a0a30 0x7f54d0133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58660/0 (socket says 172.21.15.59:58660) 2023-09-30T22:35:39.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.786+0000 7f54d4983700 1 -- 172.21.15.59:0/578054155 learned_addr learned my addr 172.21.15.59:0/578054155 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:39.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.786+0000 7f54d5985700 1 --2- 172.21.15.59:0/578054155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54d0138d80 0x7f54d0134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:39.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.787+0000 7f54d4983700 1 -- 172.21.15.59:0/578054155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54d0138d80 msgr2=0x7f54d0134390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.787+0000 7f54d4983700 1 --2- 172.21.15.59:0/578054155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54d0138d80 0x7f54d0134390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.787+0000 7f54d4983700 1 -- 172.21.15.59:0/578054155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54d009d630 msgr2=0x7f54d0133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.787+0000 7f54d4983700 1 --2- 172.21.15.59:0/578054155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54d009d630 0x7f54d0133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.787+0000 7f54d4983700 1 -- 172.21.15.59:0/578054155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c80094a0 con 0x7f54d00a0a30 2023-09-30T22:35:39.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.787+0000 7f54d5184700 1 --2- 172.21.15.59:0/578054155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54d009d630 0x7f54d0133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:39.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.787+0000 7f54d4983700 1 --2- 172.21.15.59:0/578054155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d00a0a30 0x7f54d0133e50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f54c40090b0 tx=0x7f54c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:39.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.787+0000 7f54cdffb700 1 -- 172.21.15.59:0/578054155 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c40042c0 con 0x7f54d00a0a30 2023-09-30T22:35:39.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.787+0000 7f54cdffb700 1 -- 172.21.15.59:0/578054155 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c401f070 con 0x7f54d00a0a30 2023-09-30T22:35:39.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.787+0000 7f54cdffb700 1 -- 172.21.15.59:0/578054155 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c40036a0 con 0x7f54d00a0a30 2023-09-30T22:35:39.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.787+0000 7f54d73e8700 1 -- 172.21.15.59:0/578054155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c40094a0 con 0x7f54d00a0a30 2023-09-30T22:35:39.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.787+0000 7f54d73e8700 1 -- 172.21.15.59:0/578054155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d01370c0 con 0x7f54d00a0a30 2023-09-30T22:35:39.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.788+0000 7f54cdffb700 1 -- 172.21.15.59:0/578054155 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f54c4021030 con 0x7f54d00a0a30 2023-09-30T22:35:39.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.788+0000 7f54cdffb700 1 -- 172.21.15.59:0/578054155 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f54c4040620 con 0x7f54d00a0a30 2023-09-30T22:35:39.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.789+0000 7f54d73e8700 1 -- 172.21.15.59:0/578054155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d00747f0 con 0x7f54d00a0a30 2023-09-30T22:35:39.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.798+0000 7f54cdffb700 1 -- 172.21.15.59:0/578054155 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54c401a450 con 0x7f54d00a0a30 2023-09-30T22:35:39.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.960+0000 7f3ac1618700 1 -- 172.21.15.59:0/1409118413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3abc0747f0 con 0x7f3abc130750 2023-09-30T22:35:39.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.960+0000 7f3aa37fe700 1 -- 172.21.15.59:0/1409118413 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ab4015020 con 0x7f3abc130750 2023-09-30T22:35:39.962 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:39.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.963+0000 7f3ac1618700 1 -- 172.21.15.59:0/1409118413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3abc130750 msgr2=0x7f3abc12eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:39.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.963+0000 7f3ac1618700 1 --2- 172.21.15.59:0/1409118413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3abc130750 0x7f3abc12eac0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f3abc072a00 tx=0x7f3ab4004750 comp rx=0 tx=0).stop 2023-09-30T22:35:39.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.963+0000 7f3ac1618700 1 -- 172.21.15.59:0/1409118413 shutdown_connections 2023-09-30T22:35:39.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.963+0000 7f3ac1618700 1 --2- 172.21.15.59:0/1409118413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3abc09d6f0 0x7f3abc12e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.963+0000 7f3ac1618700 1 --2- 172.21.15.59:0/1409118413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3abc130750 0x7f3abc12eac0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.963+0000 7f3ac1618700 1 --2- 172.21.15.59:0/1409118413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3abc09e250 0x7f3abc12e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:39.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.963+0000 7f3ac1618700 1 -- 172.21.15.59:0/1409118413 >> 172.21.15.59:0/1409118413 conn(0x7f3abc09f470 msgr2=0x7f3abc0992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:39.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.963+0000 7f3ac1618700 1 -- 172.21.15.59:0/1409118413 shutdown_connections 2023-09-30T22:35:39.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:39.963+0000 7f3ac1618700 1 -- 172.21.15.59:0/1409118413 wait complete. 2023-09-30T22:35:39.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:40.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.004+0000 7f54d73e8700 1 -- 172.21.15.59:0/578054155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f54d0135c80 con 0x7f54d00a0a30 2023-09-30T22:35:40.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.005+0000 7f54cdffb700 1 -- 172.21.15.59:0/578054155 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54c4015020 con 0x7f54d00a0a30 2023-09-30T22:35:40.006 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:40.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.007+0000 7f54d73e8700 1 -- 172.21.15.59:0/578054155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d00a0a30 msgr2=0x7f54d0133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:40.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.007+0000 7f54d73e8700 1 --2- 172.21.15.59:0/578054155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d00a0a30 0x7f54d0133e50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f54c40090b0 tx=0x7f54c4004750 comp rx=0 tx=0).stop 2023-09-30T22:35:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.007+0000 7f54d73e8700 1 -- 172.21.15.59:0/578054155 shutdown_connections 2023-09-30T22:35:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.007+0000 7f54d73e8700 1 --2- 172.21.15.59:0/578054155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f54d0138d80 0x7f54d0134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.007+0000 7f54d73e8700 1 --2- 172.21.15.59:0/578054155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54d009d630 0x7f54d0133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.007+0000 7f54d73e8700 1 --2- 172.21.15.59:0/578054155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d00a0a30 0x7f54d0133e50 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.007+0000 7f54d73e8700 1 -- 172.21.15.59:0/578054155 >> 172.21.15.59:0/578054155 conn(0x7f54d00a3050 msgr2=0x7f54d009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.007+0000 7f54d73e8700 1 -- 172.21.15.59:0/578054155 shutdown_connections 2023-09-30T22:35:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.007+0000 7f54d73e8700 1 -- 172.21.15.59:0/578054155 wait complete. 2023-09-30T22:35:40.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:40.519 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:40.557 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:40.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.668+0000 7ff49e4c5700 1 Processor -- start 2023-09-30T22:35:40.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.668+0000 7ff49e4c5700 1 -- start start 2023-09-30T22:35:40.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.668+0000 7ff49e4c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4980a0a30 0x7ff4980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:40.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.668+0000 7ff49e4c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff498134170 0x7ff49813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:40.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.668+0000 7ff49e4c5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49809edd0 con 0x7ff4980a1340 2023-09-30T22:35:40.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.668+0000 7ff49e4c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49809e1f0 con 0x7ff498134170 2023-09-30T22:35:40.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.668+0000 7ff49e4c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff49809dc50 con 0x7ff4980a0a30 2023-09-30T22:35:40.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.669+0000 7ff497fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4980a0a30 0x7ff4980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:40.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.669+0000 7ff497fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4980a0a30 0x7ff4980a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44948/0 (socket says 172.21.15.59:44948) 2023-09-30T22:35:40.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.669+0000 7ff49ca62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff498134170 0x7ff49813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:40.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.669+0000 7ff497fff700 1 -- 172.21.15.59:0/770103410 learned_addr learned my addr 172.21.15.59:0/770103410 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:40.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.669+0000 7ff4977fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff4980a1340 0x7ff498133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50192/0 (socket says 172.21.15.59:50192) 2023-09-30T22:35:40.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.669+0000 7ff496ffd700 1 -- 172.21.15.59:0/770103410 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144172656 0 0) 0x7ff49809edd0 con 0x7ff4980a1340 2023-09-30T22:35:40.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.669+0000 7ff497fff700 1 -- 172.21.15.59:0/770103410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff498134170 msgr2=0x7ff49813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:40.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.669+0000 7ff497fff700 1 --2- 172.21.15.59:0/770103410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff498134170 0x7ff49813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.669+0000 7ff497fff700 1 -- 172.21.15.59:0/770103410 >> v1:172.21.15.59:6789/0 conn(0x7ff4980a1340 legacy=0x7ff498133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:40.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.669+0000 7ff497fff700 1 -- 172.21.15.59:0/770103410 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4980a1fe0 con 0x7ff4980a0a30 2023-09-30T22:35:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.669+0000 7ff49ca62700 1 --2- 172.21.15.59:0/770103410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff498134170 0x7ff49813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.669+0000 7ff497fff700 1 --2- 172.21.15.59:0/770103410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4980a0a30 0x7ff4980a0e00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff488009920 tx=0x7ff488009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=209177d3da604df server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.669+0000 7ff496ffd700 1 -- 172.21.15.59:0/770103410 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488011830 con 0x7ff4980a0a30 2023-09-30T22:35:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.669+0000 7ff496ffd700 1 -- 172.21.15.59:0/770103410 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff488011990 con 0x7ff4980a0a30 2023-09-30T22:35:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.669+0000 7ff496ffd700 1 -- 172.21.15.59:0/770103410 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488011d20 con 0x7ff4980a0a30 2023-09-30T22:35:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.670+0000 7ff49e4c5700 1 -- 172.21.15.59:0/770103410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4980a0a30 msgr2=0x7ff4980a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.670+0000 7ff49e4c5700 1 --2- 172.21.15.59:0/770103410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4980a0a30 0x7ff4980a0e00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff488009920 tx=0x7ff488009c30 comp rx=0 tx=0).stop 2023-09-30T22:35:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.670+0000 7ff49e4c5700 1 -- 172.21.15.59:0/770103410 shutdown_connections 2023-09-30T22:35:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.670+0000 7ff49e4c5700 1 --2- 172.21.15.59:0/770103410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4980a0a30 0x7ff4980a0e00 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.670+0000 7ff49e4c5700 1 --2- 172.21.15.59:0/770103410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff498134170 0x7ff49813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.670+0000 7ff49e4c5700 1 -- 172.21.15.59:0/770103410 >> 172.21.15.59:0/770103410 conn(0x7ff4980a6550 msgr2=0x7ff4980a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.670+0000 7ff49e4c5700 1 -- 172.21.15.59:0/770103410 shutdown_connections 2023-09-30T22:35:40.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.670+0000 7ff49e4c5700 1 -- 172.21.15.59:0/770103410 wait complete. 2023-09-30T22:35:40.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.671+0000 7ff49e4c5700 1 Processor -- start 2023-09-30T22:35:40.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.671+0000 7ff49e4c5700 1 -- start start 2023-09-30T22:35:40.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff49e4c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4980a0a30 0x7ff4981233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:40.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff49e4c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4980a1340 0x7ff498123930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:40.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff49e4c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff498134170 0x7ff4981c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:40.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff49e4c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff498123060 con 0x7ff4980a1340 2023-09-30T22:35:40.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff49e4c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff498125ee0 con 0x7ff498134170 2023-09-30T22:35:40.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff49e4c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4981261a0 con 0x7ff4980a0a30 2023-09-30T22:35:40.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff4977fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4980a1340 0x7ff498123930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:40.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff497fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4980a0a30 0x7ff4981233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:40.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff49ca62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff498134170 0x7ff4981c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:40.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff4977fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4980a1340 0x7ff498123930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55532/0 (socket says 172.21.15.59:55532) 2023-09-30T22:35:40.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff497fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4980a0a30 0x7ff4981233f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44964/0 (socket says 172.21.15.59:44964) 2023-09-30T22:35:40.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff497fff700 1 -- 172.21.15.59:0/4076935216 learned_addr learned my addr 172.21.15.59:0/4076935216 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:40.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff49ca62700 1 -- 172.21.15.59:0/4076935216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4980a0a30 msgr2=0x7ff4981233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:40.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff49ca62700 1 --2- 172.21.15.59:0/4076935216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4980a0a30 0x7ff4981233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff49ca62700 1 -- 172.21.15.59:0/4076935216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4980a1340 msgr2=0x7ff498123930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:40.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.672+0000 7ff49ca62700 1 --2- 172.21.15.59:0/4076935216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4980a1340 0x7ff498123930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.673+0000 7ff49ca62700 1 -- 172.21.15.59:0/4076935216 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff490009a70 con 0x7ff498134170 2023-09-30T22:35:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.673+0000 7ff497fff700 1 --2- 172.21.15.59:0/4076935216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4980a0a30 0x7ff4981233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.673+0000 7ff4977fe700 1 --2- 172.21.15.59:0/4076935216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4980a1340 0x7ff498123930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.673+0000 7ff49ca62700 1 --2- 172.21.15.59:0/4076935216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff498134170 0x7ff4981c84c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff490009e50 tx=0x7ff49000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.673+0000 7ff494ff9700 1 -- 172.21.15.59:0/4076935216 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49000ca90 con 0x7ff498134170 2023-09-30T22:35:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.673+0000 7ff494ff9700 1 -- 172.21.15.59:0/4076935216 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49000f040 con 0x7ff498134170 2023-09-30T22:35:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.673+0000 7ff49e4c5700 1 -- 172.21.15.59:0/4076935216 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff488009550 con 0x7ff498134170 2023-09-30T22:35:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.673+0000 7ff494ff9700 1 -- 172.21.15.59:0/4076935216 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49000ce50 con 0x7ff498134170 2023-09-30T22:35:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.673+0000 7ff49e4c5700 1 -- 172.21.15.59:0/4076935216 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4980a25e0 con 0x7ff498134170 2023-09-30T22:35:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.674+0000 7ff494ff9700 1 -- 172.21.15.59:0/4076935216 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff490014480 con 0x7ff498134170 2023-09-30T22:35:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.674+0000 7ff49e4c5700 1 -- 172.21.15.59:0/4076935216 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49809e7e0 con 0x7ff498134170 2023-09-30T22:35:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.674+0000 7ff494ff9700 1 -- 172.21.15.59:0/4076935216 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff49003fbf0 con 0x7ff498134170 2023-09-30T22:35:40.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.683+0000 7ff494ff9700 1 -- 172.21.15.59:0/4076935216 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff490012700 con 0x7ff498134170 2023-09-30T22:35:40.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.711+0000 7f0cfcaed700 1 Processor -- start 2023-09-30T22:35:40.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.711+0000 7f0cfcaed700 1 -- start start 2023-09-30T22:35:40.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cfcaed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a0a30 0x7f0cf80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:40.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cfcaed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cf8138d80 0x7f0cf813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:40.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cfcaed700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf80a2a70 con 0x7f0cf809d630 2023-09-30T22:35:40.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cfcaed700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf80a01d0 con 0x7f0cf8138d80 2023-09-30T22:35:40.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cfcaed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf809e2b0 con 0x7f0cf80a0a30 2023-09-30T22:35:40.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cf659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a0a30 0x7f0cf80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:40.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cf6d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cf8138d80 0x7f0cf813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:40.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cf659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a0a30 0x7f0cf80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58686/0 (socket says 172.21.15.59:58686) 2023-09-30T22:35:40.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cf6d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cf8138d80 0x7f0cf813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55540/0 (socket says 172.21.15.59:55540) 2023-09-30T22:35:40.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cf659c700 1 -- 172.21.15.59:0/1035433213 learned_addr learned my addr 172.21.15.59:0/1035433213 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:40.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cf6d9d700 1 -- 172.21.15.59:0/1035433213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a0a30 msgr2=0x7f0cf80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:40.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cf6d9d700 1 --2- 172.21.15.59:0/1035433213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a0a30 0x7f0cf80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cf6d9d700 1 -- 172.21.15.59:0/1035433213 >> v1:172.21.15.59:6789/0 conn(0x7f0cf809d630 legacy=0x7f0cf80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:40.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cf6d9d700 1 -- 172.21.15.59:0/1035433213 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf809dc50 con 0x7f0cf8138d80 2023-09-30T22:35:40.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cf659c700 1 --2- 172.21.15.59:0/1035433213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a0a30 0x7f0cf80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:40.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.712+0000 7f0cf6d9d700 1 --2- 172.21.15.59:0/1035433213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf8138d80 0x7f0cf813b160 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009d90 tx=0x7f0ce800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aeb821a4ba88f05 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:40.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.713+0000 7f0cf559a700 1 -- 172.21.15.59:0/1035433213 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce800e070 con 0x7f0cf8138d80 2023-09-30T22:35:40.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.713+0000 7f0cf559a700 1 -- 172.21.15.59:0/1035433213 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce800bb20 con 0x7f0cf8138d80 2023-09-30T22:35:40.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.713+0000 7f0cf559a700 1 -- 172.21.15.59:0/1035433213 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8012430 con 0x7f0cf8138d80 2023-09-30T22:35:40.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.713+0000 7f0cfcaed700 1 -- 172.21.15.59:0/1035433213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf8138d80 msgr2=0x7f0cf813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:40.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.713+0000 7f0cfcaed700 1 --2- 172.21.15.59:0/1035433213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf8138d80 0x7f0cf813b160 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009d90 tx=0x7f0ce800b330 comp rx=0 tx=0).stop 2023-09-30T22:35:40.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.713+0000 7f0cfcaed700 1 -- 172.21.15.59:0/1035433213 shutdown_connections 2023-09-30T22:35:40.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.713+0000 7f0cfcaed700 1 --2- 172.21.15.59:0/1035433213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf8138d80 0x7f0cf813b160 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.713+0000 7f0cfcaed700 1 --2- 172.21.15.59:0/1035433213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a0a30 0x7f0cf80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.713+0000 7f0cfcaed700 1 -- 172.21.15.59:0/1035433213 >> 172.21.15.59:0/1035433213 conn(0x7f0cf80a3050 msgr2=0x7f0cf80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:40.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.713+0000 7f0cfcaed700 1 -- 172.21.15.59:0/1035433213 shutdown_connections 2023-09-30T22:35:40.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.714+0000 7f0cfcaed700 1 -- 172.21.15.59:0/1035433213 wait complete. 2023-09-30T22:35:40.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.715+0000 7f0cfcaed700 1 Processor -- start 2023-09-30T22:35:40.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.715+0000 7f0cfcaed700 1 -- start start 2023-09-30T22:35:40.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.715+0000 7f0cfcaed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf809d630 0x7f0cf8133890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:40.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.715+0000 7f0cfcaed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a0a30 0x7f0cf8133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:40.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.715+0000 7f0cfcaed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf8138d80 0x7f0cf8134310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:40.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.715+0000 7f0cfcaed700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf81371b0 con 0x7f0cf8138d80 2023-09-30T22:35:40.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.715+0000 7f0cfcaed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf8138030 con 0x7f0cf80a0a30 2023-09-30T22:35:40.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.715+0000 7f0cfcaed700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf81373b0 con 0x7f0cf809d630 2023-09-30T22:35:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.715+0000 7f0cf5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a0a30 0x7f0cf8133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.715+0000 7f0cf6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf8138d80 0x7f0cf8134310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.715+0000 7f0cf5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a0a30 0x7f0cf8133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58696/0 (socket says 172.21.15.59:58696) 2023-09-30T22:35:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.715+0000 7f0cf5d9b700 1 -- 172.21.15.59:0/1642176763 learned_addr learned my addr 172.21.15.59:0/1642176763 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.715+0000 7f0cf659c700 1 --2- 172.21.15.59:0/1642176763 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf809d630 0x7f0cf8133890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.716+0000 7f0cf6d9d700 1 -- 172.21.15.59:0/1642176763 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf809d630 msgr2=0x7f0cf8133890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.716+0000 7f0cf6d9d700 1 --2- 172.21.15.59:0/1642176763 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf809d630 0x7f0cf8133890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.716+0000 7f0cf6d9d700 1 -- 172.21.15.59:0/1642176763 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a0a30 msgr2=0x7f0cf8133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.716+0000 7f0cf6d9d700 1 --2- 172.21.15.59:0/1642176763 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a0a30 0x7f0cf8133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.716+0000 7f0cf6d9d700 1 -- 172.21.15.59:0/1642176763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf0009550 con 0x7f0cf8138d80 2023-09-30T22:35:40.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.716+0000 7f0cf5d9b700 1 --2- 172.21.15.59:0/1642176763 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a0a30 0x7f0cf8133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:40.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.716+0000 7f0cf6d9d700 1 --2- 172.21.15.59:0/1642176763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf8138d80 0x7f0cf8134310 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80672b0 tx=0x7f0ce8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:40.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.716+0000 7f0ceeffd700 1 -- 172.21.15.59:0/1642176763 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8012430 con 0x7f0cf8138d80 2023-09-30T22:35:40.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.716+0000 7f0ceeffd700 1 -- 172.21.15.59:0/1642176763 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce8020070 con 0x7f0cf8138d80 2023-09-30T22:35:40.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.716+0000 7f0ceeffd700 1 -- 172.21.15.59:0/1642176763 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8004280 con 0x7f0cf8138d80 2023-09-30T22:35:40.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.716+0000 7f0cfcaed700 1 -- 172.21.15.59:0/1642176763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce8009a70 con 0x7f0cf8138d80 2023-09-30T22:35:40.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.716+0000 7f0cfcaed700 1 -- 172.21.15.59:0/1642176763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf80a0410 con 0x7f0cf8138d80 2023-09-30T22:35:40.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.717+0000 7f0ceeffd700 1 -- 172.21.15.59:0/1642176763 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ce80043e0 con 0x7f0cf8138d80 2023-09-30T22:35:40.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.717+0000 7f0ceeffd700 1 -- 172.21.15.59:0/1642176763 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0ce8022070 con 0x7f0cf8138d80 2023-09-30T22:35:40.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.717+0000 7f0cfcaed700 1 -- 172.21.15.59:0/1642176763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf80747f0 con 0x7f0cf8138d80 2023-09-30T22:35:40.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.722+0000 7f0ceeffd700 1 -- 172.21.15.59:0/1642176763 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ce8012e60 con 0x7f0cf8138d80 2023-09-30T22:35:40.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.888+0000 7ff49e4c5700 1 -- 172.21.15.59:0/4076935216 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff498074ea0 con 0x7ff498134170 2023-09-30T22:35:40.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.889+0000 7ff494ff9700 1 -- 172.21.15.59:0/4076935216 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff490012340 con 0x7ff498134170 2023-09-30T22:35:40.890 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.891+0000 7ff49e4c5700 1 -- 172.21.15.59:0/4076935216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff498134170 msgr2=0x7ff4981c84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.891+0000 7ff49e4c5700 1 --2- 172.21.15.59:0/4076935216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff498134170 0x7ff4981c84c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff490009e50 tx=0x7ff49000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.891+0000 7ff49e4c5700 1 -- 172.21.15.59:0/4076935216 shutdown_connections 2023-09-30T22:35:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.891+0000 7ff49e4c5700 1 --2- 172.21.15.59:0/4076935216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4980a0a30 0x7ff4981233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.891+0000 7ff49e4c5700 1 --2- 172.21.15.59:0/4076935216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff498134170 0x7ff4981c84c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.891+0000 7ff49e4c5700 1 --2- 172.21.15.59:0/4076935216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4980a1340 0x7ff498123930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.891+0000 7ff49e4c5700 1 -- 172.21.15.59:0/4076935216 >> 172.21.15.59:0/4076935216 conn(0x7ff4980a6550 msgr2=0x7ff49809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.891+0000 7ff49e4c5700 1 -- 172.21.15.59:0/4076935216 shutdown_connections 2023-09-30T22:35:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.891+0000 7ff49e4c5700 1 -- 172.21.15.59:0/4076935216 wait complete. 2023-09-30T22:35:40.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.931+0000 7f0cfcaed700 1 -- 172.21.15.59:0/1642176763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0cf8072980 con 0x7f0cf8138d80 2023-09-30T22:35:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.931+0000 7f0ceeffd700 1 -- 172.21.15.59:0/1642176763 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ce801a380 con 0x7f0cf8138d80 2023-09-30T22:35:40.933 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:40.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.933+0000 7f0cfcaed700 1 -- 172.21.15.59:0/1642176763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf8138d80 msgr2=0x7f0cf8134310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:40.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.934+0000 7f0cfcaed700 1 --2- 172.21.15.59:0/1642176763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf8138d80 0x7f0cf8134310 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80672b0 tx=0x7f0ce8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.934+0000 7f0cfcaed700 1 -- 172.21.15.59:0/1642176763 shutdown_connections 2023-09-30T22:35:40.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.934+0000 7f0cfcaed700 1 --2- 172.21.15.59:0/1642176763 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cf809d630 0x7f0cf8133890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.934+0000 7f0cfcaed700 1 --2- 172.21.15.59:0/1642176763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf8138d80 0x7f0cf8134310 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.934+0000 7f0cfcaed700 1 --2- 172.21.15.59:0/1642176763 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf80a0a30 0x7f0cf8133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:40.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.934+0000 7f0cfcaed700 1 -- 172.21.15.59:0/1642176763 >> 172.21.15.59:0/1642176763 conn(0x7f0cf80a3050 msgr2=0x7f0cf809f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:40.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.934+0000 7f0cfcaed700 1 -- 172.21.15.59:0/1642176763 shutdown_connections 2023-09-30T22:35:40.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:40.934+0000 7f0cfcaed700 1 -- 172.21.15.59:0/1642176763 wait complete. 2023-09-30T22:35:40.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:40.979 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:41.023 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:41.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.129+0000 7f979fda5700 1 Processor -- start 2023-09-30T22:35:41.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.129+0000 7f979fda5700 1 -- start start 2023-09-30T22:35:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.130+0000 7f979fda5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97980a0a30 0x7f97980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.130+0000 7f979fda5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f979809d630 0x7f97980a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.130+0000 7f979fda5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97980a2a70 con 0x7f9798133930 2023-09-30T22:35:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.130+0000 7f979fda5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97980a01d0 con 0x7f979809d630 2023-09-30T22:35:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.130+0000 7f979fda5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979809e2b0 con 0x7f97980a0a30 2023-09-30T22:35:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.130+0000 7f979d340700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f979809d630 0x7f97980a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.130+0000 7f979db41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97980a0a30 0x7f97980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.130+0000 7f979d340700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f979809d630 0x7f97980a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55562/0 (socket says 172.21.15.59:55562) 2023-09-30T22:35:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.130+0000 7f979d340700 1 -- 172.21.15.59:0/3405622043 learned_addr learned my addr 172.21.15.59:0/3405622043 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.130+0000 7f979d340700 1 -- 172.21.15.59:0/3405622043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97980a0a30 msgr2=0x7f97980a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.130+0000 7f979d340700 1 --2- 172.21.15.59:0/3405622043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97980a0a30 0x7f97980a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.130+0000 7f979d340700 1 -- 172.21.15.59:0/3405622043 >> v1:172.21.15.59:6789/0 conn(0x7f9798133930 legacy=0x7f9798133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:41.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.130+0000 7f979d340700 1 -- 172.21.15.59:0/3405622043 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979809dc50 con 0x7f979809d630 2023-09-30T22:35:41.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.130+0000 7f979db41700 1 --2- 172.21.15.59:0/3405622043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97980a0a30 0x7f97980a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:41.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.130+0000 7f979d340700 1 --2- 172.21.15.59:0/3405622043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f979809d630 0x7f97980a1340 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f978c0098f0 tx=0x7f978c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534af5a36f5f07cc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:41.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.131+0000 7f979cb3f700 1 -- 172.21.15.59:0/3405622043 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c011830 con 0x7f979809d630 2023-09-30T22:35:41.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.131+0000 7f979cb3f700 1 -- 172.21.15.59:0/3405622043 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c011990 con 0x7f979809d630 2023-09-30T22:35:41.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.131+0000 7f979cb3f700 1 -- 172.21.15.59:0/3405622043 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c011d20 con 0x7f979809d630 2023-09-30T22:35:41.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.131+0000 7f979fda5700 1 -- 172.21.15.59:0/3405622043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f979809d630 msgr2=0x7f97980a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:41.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.131+0000 7f979fda5700 1 --2- 172.21.15.59:0/3405622043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f979809d630 0x7f97980a1340 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f978c0098f0 tx=0x7f978c009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:41.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.131+0000 7f979fda5700 1 -- 172.21.15.59:0/3405622043 shutdown_connections 2023-09-30T22:35:41.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.131+0000 7f979fda5700 1 --2- 172.21.15.59:0/3405622043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97980a0a30 0x7f97980a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.131+0000 7f979fda5700 1 --2- 172.21.15.59:0/3405622043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f979809d630 0x7f97980a1340 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.131+0000 7f979fda5700 1 -- 172.21.15.59:0/3405622043 >> 172.21.15.59:0/3405622043 conn(0x7f97980a3050 msgr2=0x7f97980a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.131+0000 7f979fda5700 1 -- 172.21.15.59:0/3405622043 shutdown_connections 2023-09-30T22:35:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.131+0000 7f979fda5700 1 -- 172.21.15.59:0/3405622043 wait complete. 2023-09-30T22:35:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.132+0000 7f979fda5700 1 Processor -- start 2023-09-30T22:35:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.132+0000 7f979fda5700 1 -- start start 2023-09-30T22:35:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979fda5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f979809d630 0x7f97981c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979fda5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97980a0a30 0x7f97981c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979fda5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9798133930 0x7f97981c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979fda5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9798120a70 con 0x7f9798133930 2023-09-30T22:35:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979fda5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9798120880 con 0x7f97980a0a30 2023-09-30T22:35:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979fda5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9798121920 con 0x7f979809d630 2023-09-30T22:35:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979d340700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97980a0a30 0x7f97981c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979e342700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9798133930 0x7f97981c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979d340700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97980a0a30 0x7f97981c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58710/0 (socket says 172.21.15.59:58710) 2023-09-30T22:35:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979d340700 1 -- 172.21.15.59:0/1115551360 learned_addr learned my addr 172.21.15.59:0/1115551360 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979e342700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9798133930 0x7f97981c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55570/0 (socket says 172.21.15.59:55570) 2023-09-30T22:35:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979d340700 1 -- 172.21.15.59:0/1115551360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f979809d630 msgr2=0x7f97981c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979d340700 1 --2- 172.21.15.59:0/1115551360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f979809d630 0x7f97981c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979d340700 1 -- 172.21.15.59:0/1115551360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9798133930 msgr2=0x7f97981c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979d340700 1 --2- 172.21.15.59:0/1115551360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9798133930 0x7f97981c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979d340700 1 -- 172.21.15.59:0/1115551360 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97880094a0 con 0x7f97980a0a30 2023-09-30T22:35:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.133+0000 7f979e342700 1 --2- 172.21.15.59:0/1115551360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9798133930 0x7f97981c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:41.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.134+0000 7f979d340700 1 --2- 172.21.15.59:0/1115551360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97980a0a30 0x7f97981c8850 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f978c000c00 tx=0x7f978c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:41.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.134+0000 7f97967fc700 1 -- 172.21.15.59:0/1115551360 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c0036a0 con 0x7f97980a0a30 2023-09-30T22:35:41.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.134+0000 7f97967fc700 1 -- 172.21.15.59:0/1115551360 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c003800 con 0x7f97980a0a30 2023-09-30T22:35:41.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.134+0000 7f979fda5700 1 -- 172.21.15.59:0/1115551360 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978c009550 con 0x7f97980a0a30 2023-09-30T22:35:41.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.134+0000 7f97967fc700 1 -- 172.21.15.59:0/1115551360 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c003bd0 con 0x7f97980a0a30 2023-09-30T22:35:41.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.134+0000 7f979fda5700 1 -- 172.21.15.59:0/1115551360 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97981224b0 con 0x7f97980a0a30 2023-09-30T22:35:41.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.135+0000 7f97967fc700 1 -- 172.21.15.59:0/1115551360 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f978c021070 con 0x7f97980a0a30 2023-09-30T22:35:41.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.135+0000 7f97967fc700 1 -- 172.21.15.59:0/1115551360 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f978c040be0 con 0x7f97980a0a30 2023-09-30T22:35:41.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.135+0000 7f979fda5700 1 -- 172.21.15.59:0/1115551360 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9798121e90 con 0x7f97980a0a30 2023-09-30T22:35:41.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.140+0000 7f97967fc700 1 -- 172.21.15.59:0/1115551360 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f978c015080 con 0x7f97980a0a30 2023-09-30T22:35:41.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.172+0000 7feae909b700 1 Processor -- start 2023-09-30T22:35:41.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.172+0000 7feae909b700 1 -- start start 2023-09-30T22:35:41.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.172+0000 7feae909b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae40a0a30 0x7feae40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:41.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.172+0000 7feae909b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feae4134170 0x7feae413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:41.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.172+0000 7feae909b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae409edd0 con 0x7feae40a1340 2023-09-30T22:35:41.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.172+0000 7feae909b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae409e1f0 con 0x7feae4134170 2023-09-30T22:35:41.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.172+0000 7feae909b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feae409dc50 con 0x7feae40a0a30 2023-09-30T22:35:41.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.173+0000 7feae359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feae4134170 0x7feae413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:41.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.173+0000 7feae2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae40a0a30 0x7feae40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.173+0000 7feae2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae40a0a30 0x7feae40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45000/0 (socket says 172.21.15.59:45000) 2023-09-30T22:35:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.173+0000 7feae359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feae4134170 0x7feae413bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55576/0 (socket says 172.21.15.59:55576) 2023-09-30T22:35:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.173+0000 7feae2d9d700 1 -- 172.21.15.59:0/2891992486 learned_addr learned my addr 172.21.15.59:0/2891992486 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.173+0000 7feae359e700 1 -- 172.21.15.59:0/2891992486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae40a0a30 msgr2=0x7feae40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.173+0000 7feae359e700 1 --2- 172.21.15.59:0/2891992486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae40a0a30 0x7feae40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.173+0000 7feae359e700 1 -- 172.21.15.59:0/2891992486 >> v1:172.21.15.59:6789/0 conn(0x7feae40a1340 legacy=0x7feae4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.173+0000 7feae359e700 1 -- 172.21.15.59:0/2891992486 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40a1fe0 con 0x7feae4134170 2023-09-30T22:35:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.173+0000 7feae359e700 1 --2- 172.21.15.59:0/2891992486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feae4134170 0x7feae413bd30 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7feadc009840 tx=0x7feadc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9cd4597fff655d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.173+0000 7feae1d9b700 1 -- 172.21.15.59:0/2891992486 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc011830 con 0x7feae4134170 2023-09-30T22:35:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.173+0000 7feae1d9b700 1 -- 172.21.15.59:0/2891992486 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc011990 con 0x7feae4134170 2023-09-30T22:35:41.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.173+0000 7feae1d9b700 1 -- 172.21.15.59:0/2891992486 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc011d20 con 0x7feae4134170 2023-09-30T22:35:41.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.174+0000 7feae909b700 1 -- 172.21.15.59:0/2891992486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feae4134170 msgr2=0x7feae413bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:41.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.174+0000 7feae909b700 1 --2- 172.21.15.59:0/2891992486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feae4134170 0x7feae413bd30 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7feadc009840 tx=0x7feadc009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:41.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.174+0000 7feae909b700 1 -- 172.21.15.59:0/2891992486 shutdown_connections 2023-09-30T22:35:41.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.174+0000 7feae909b700 1 --2- 172.21.15.59:0/2891992486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feae4134170 0x7feae413bd30 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.174+0000 7feae909b700 1 --2- 172.21.15.59:0/2891992486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae40a0a30 0x7feae40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.174+0000 7feae909b700 1 -- 172.21.15.59:0/2891992486 >> 172.21.15.59:0/2891992486 conn(0x7feae40a6550 msgr2=0x7feae40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:41.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.174+0000 7feae909b700 1 -- 172.21.15.59:0/2891992486 shutdown_connections 2023-09-30T22:35:41.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.174+0000 7feae909b700 1 -- 172.21.15.59:0/2891992486 wait complete. 2023-09-30T22:35:41.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.176+0000 7feae909b700 1 Processor -- start 2023-09-30T22:35:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.176+0000 7feae909b700 1 -- start start 2023-09-30T22:35:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.176+0000 7feae909b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae40a0a30 0x7feae411e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.176+0000 7feae909b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feae40a1340 0x7feae411ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.176+0000 7feae909b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae4134170 0x7feae411f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feae909b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae4122190 con 0x7feae40a1340 2023-09-30T22:35:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feae909b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae4121bf0 con 0x7feae4134170 2023-09-30T22:35:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feae909b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feae4120280 con 0x7feae40a0a30 2023-09-30T22:35:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feae2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae40a0a30 0x7feae411e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feae359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae4134170 0x7feae411f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feae2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae40a0a30 0x7feae411e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45012/0 (socket says 172.21.15.59:45012) 2023-09-30T22:35:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feae359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae4134170 0x7feae411f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58718/0 (socket says 172.21.15.59:58718) 2023-09-30T22:35:41.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feae2d9d700 1 -- 172.21.15.59:0/2547705994 learned_addr learned my addr 172.21.15.59:0/2547705994 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:41.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feae259c700 1 --2- 172.21.15.59:0/2547705994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feae40a1340 0x7feae411ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:41.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feae359e700 1 -- 172.21.15.59:0/2547705994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae40a0a30 msgr2=0x7feae411e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:41.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feae359e700 1 --2- 172.21.15.59:0/2547705994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae40a0a30 0x7feae411e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feae359e700 1 -- 172.21.15.59:0/2547705994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feae40a1340 msgr2=0x7feae411ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:41.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feae359e700 1 --2- 172.21.15.59:0/2547705994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feae40a1340 0x7feae411ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feae359e700 1 -- 172.21.15.59:0/2547705994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc0094a0 con 0x7feae4134170 2023-09-30T22:35:41.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feae359e700 1 --2- 172.21.15.59:0/2547705994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae4134170 0x7feae411f180 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7feadc016000 tx=0x7feadc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:41.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.177+0000 7feadb7fe700 1 -- 172.21.15.59:0/2547705994 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc0036a0 con 0x7feae4134170 2023-09-30T22:35:41.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.178+0000 7feadb7fe700 1 -- 172.21.15.59:0/2547705994 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc01f070 con 0x7feae4134170 2023-09-30T22:35:41.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.178+0000 7feae909b700 1 -- 172.21.15.59:0/2547705994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae40a4f10 con 0x7feae4134170 2023-09-30T22:35:41.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.178+0000 7feadb7fe700 1 -- 172.21.15.59:0/2547705994 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc003a40 con 0x7feae4134170 2023-09-30T22:35:41.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.178+0000 7feae909b700 1 -- 172.21.15.59:0/2547705994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae4122920 con 0x7feae4134170 2023-09-30T22:35:41.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.178+0000 7feadb7fe700 1 -- 172.21.15.59:0/2547705994 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feadc003ba0 con 0x7feae4134170 2023-09-30T22:35:41.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.179+0000 7feadb7fe700 1 -- 172.21.15.59:0/2547705994 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feadc021070 con 0x7feae4134170 2023-09-30T22:35:41.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.179+0000 7feae909b700 1 -- 172.21.15.59:0/2547705994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae4074ea0 con 0x7feae4134170 2023-09-30T22:35:41.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.184+0000 7feadb7fe700 1 -- 172.21.15.59:0/2547705994 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feadc02b020 con 0x7feae4134170 2023-09-30T22:35:41.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.344+0000 7f979fda5700 1 -- 172.21.15.59:0/1115551360 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9798074770 con 0x7f97980a0a30 2023-09-30T22:35:41.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.345+0000 7f97967fc700 1 -- 172.21.15.59:0/1115551360 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f978c00b3e0 con 0x7f97980a0a30 2023-09-30T22:35:41.346 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:41.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.347+0000 7f979fda5700 1 -- 172.21.15.59:0/1115551360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97980a0a30 msgr2=0x7f97981c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:41.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.347+0000 7f979fda5700 1 --2- 172.21.15.59:0/1115551360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97980a0a30 0x7f97981c8850 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f978c000c00 tx=0x7f978c004750 comp rx=0 tx=0).stop 2023-09-30T22:35:41.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.347+0000 7f979fda5700 1 -- 172.21.15.59:0/1115551360 shutdown_connections 2023-09-30T22:35:41.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.347+0000 7f979fda5700 1 --2- 172.21.15.59:0/1115551360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f979809d630 0x7f97981c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.347+0000 7f979fda5700 1 --2- 172.21.15.59:0/1115551360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9798133930 0x7f97981c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.347+0000 7f979fda5700 1 --2- 172.21.15.59:0/1115551360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97980a0a30 0x7f97981c8850 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.347+0000 7f979fda5700 1 -- 172.21.15.59:0/1115551360 >> 172.21.15.59:0/1115551360 conn(0x7f97980a3050 msgr2=0x7f97981bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:41.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.347+0000 7f979fda5700 1 -- 172.21.15.59:0/1115551360 shutdown_connections 2023-09-30T22:35:41.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.347+0000 7f979fda5700 1 -- 172.21.15.59:0/1115551360 wait complete. 2023-09-30T22:35:41.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.387+0000 7feae909b700 1 -- 172.21.15.59:0/2547705994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feae40a28e0 con 0x7feae4134170 2023-09-30T22:35:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.387+0000 7feadb7fe700 1 -- 172.21.15.59:0/2547705994 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feadc015070 con 0x7feae4134170 2023-09-30T22:35:41.388 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:41.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.389+0000 7feae909b700 1 -- 172.21.15.59:0/2547705994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae4134170 msgr2=0x7feae411f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:41.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.389+0000 7feae909b700 1 --2- 172.21.15.59:0/2547705994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae4134170 0x7feae411f180 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7feadc016000 tx=0x7feadc004750 comp rx=0 tx=0).stop 2023-09-30T22:35:41.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.389+0000 7feae909b700 1 -- 172.21.15.59:0/2547705994 shutdown_connections 2023-09-30T22:35:41.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.389+0000 7feae909b700 1 --2- 172.21.15.59:0/2547705994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae40a0a30 0x7feae411e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.389+0000 7feae909b700 1 --2- 172.21.15.59:0/2547705994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae4134170 0x7feae411f180 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.389+0000 7feae909b700 1 --2- 172.21.15.59:0/2547705994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feae40a1340 0x7feae411ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:41.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.389+0000 7feae909b700 1 -- 172.21.15.59:0/2547705994 >> 172.21.15.59:0/2547705994 conn(0x7feae40a6550 msgr2=0x7feae409c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:41.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.389+0000 7feae909b700 1 -- 172.21.15.59:0/2547705994 shutdown_connections 2023-09-30T22:35:41.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:41.389+0000 7feae909b700 1 -- 172.21.15.59:0/2547705994 wait complete. 2023-09-30T22:35:41.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:41.907 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:41.949 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:42.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.055+0000 7f89e428d700 1 Processor -- start 2023-09-30T22:35:42.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.055+0000 7f89e428d700 1 -- start start 2023-09-30T22:35:42.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.056+0000 7f89e428d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89dc0a0a30 0x7f89dc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.056+0000 7f89e428d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f89dc0a1340 0x7f89dc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.056+0000 7f89e428d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89dc133fa0 0x7f89dc134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.056+0000 7f89e428d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89dc09edd0 con 0x7f89dc0a1340 2023-09-30T22:35:42.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.056+0000 7f89e428d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc09e1f0 con 0x7f89dc133fa0 2023-09-30T22:35:42.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.056+0000 7f89e428d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc09dc50 con 0x7f89dc0a0a30 2023-09-30T22:35:42.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.056+0000 7f89e2029700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89dc0a0a30 0x7f89dc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.056+0000 7f89e1828700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f89dc0a1340 0x7f89dc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.056+0000 7f89e2029700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89dc0a0a30 0x7f89dc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45018/0 (socket says 172.21.15.59:45018) 2023-09-30T22:35:42.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.056+0000 7f89e1828700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f89dc0a1340 0x7f89dc133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55582/0 (socket says 172.21.15.59:55582) 2023-09-30T22:35:42.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.056+0000 7f89e2029700 1 -- 172.21.15.59:0/3573828681 learned_addr learned my addr 172.21.15.59:0/3573828681 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:42.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.056+0000 7f89e282a700 1 --2- 172.21.15.59:0/3573828681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89dc133fa0 0x7f89dc134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.057+0000 7f89e2029700 1 -- 172.21.15.59:0/3573828681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89dc133fa0 msgr2=0x7f89dc134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:42.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.057+0000 7f89e2029700 1 --2- 172.21.15.59:0/3573828681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89dc133fa0 0x7f89dc134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.057+0000 7f89e2029700 1 -- 172.21.15.59:0/3573828681 >> v2:172.21.15.59:3300/0 conn(0x7f89dc0a1340 msgr2=0x7f89dc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:42.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.057+0000 7f89e2029700 1 --2- 172.21.15.59:0/3573828681 >> v2:172.21.15.59:3300/0 conn(0x7f89dc0a1340 0x7f89dc133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.057+0000 7f89e2029700 1 -- 172.21.15.59:0/3573828681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc0a1fe0 con 0x7f89dc0a0a30 2023-09-30T22:35:42.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.057+0000 7f89e1828700 1 --2- 172.21.15.59:0/3573828681 >> v2:172.21.15.59:3300/0 conn(0x7f89dc0a1340 0x7f89dc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:42.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.057+0000 7f89e2029700 1 --2- 172.21.15.59:0/3573828681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89dc0a0a30 0x7f89dc0a0e00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009e80 tx=0x7f89cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35da46be434cead server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:42.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.057+0000 7f89e1027700 1 -- 172.21.15.59:0/3573828681 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc00e070 con 0x7f89dc0a0a30 2023-09-30T22:35:42.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.057+0000 7f89e1027700 1 -- 172.21.15.59:0/3573828681 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc00b8d0 con 0x7f89dc0a0a30 2023-09-30T22:35:42.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.057+0000 7f89e1027700 1 -- 172.21.15.59:0/3573828681 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc00bc80 con 0x7f89dc0a0a30 2023-09-30T22:35:42.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.058+0000 7f89e428d700 1 -- 172.21.15.59:0/3573828681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89dc0a0a30 msgr2=0x7f89dc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.058+0000 7f89e428d700 1 --2- 172.21.15.59:0/3573828681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89dc0a0a30 0x7f89dc0a0e00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009e80 tx=0x7f89cc00b330 comp rx=0 tx=0).stop 2023-09-30T22:35:42.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.058+0000 7f89e428d700 1 -- 172.21.15.59:0/3573828681 shutdown_connections 2023-09-30T22:35:42.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.058+0000 7f89e428d700 1 --2- 172.21.15.59:0/3573828681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89dc133fa0 0x7f89dc134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.058+0000 7f89e428d700 1 --2- 172.21.15.59:0/3573828681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89dc0a0a30 0x7f89dc0a0e00 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.058+0000 7f89e428d700 1 --2- 172.21.15.59:0/3573828681 >> v2:172.21.15.59:3300/0 conn(0x7f89dc0a1340 0x7f89dc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.058+0000 7f89e428d700 1 -- 172.21.15.59:0/3573828681 >> 172.21.15.59:0/3573828681 conn(0x7f89dc0a6550 msgr2=0x7f89dc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:42.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.058+0000 7f89e428d700 1 -- 172.21.15.59:0/3573828681 shutdown_connections 2023-09-30T22:35:42.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.058+0000 7f89e428d700 1 -- 172.21.15.59:0/3573828681 wait complete. 2023-09-30T22:35:42.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.059+0000 7f89e428d700 1 Processor -- start 2023-09-30T22:35:42.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.059+0000 7f89e428d700 1 -- start start 2023-09-30T22:35:42.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e428d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89dc0a0a30 0x7f89dc1200e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e428d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89dc0a1340 0x7f89dc120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e428d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89dc133fa0 0x7f89dc120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e428d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc1245c0 con 0x7f89dc133fa0 2023-09-30T22:35:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e428d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc121d90 con 0x7f89dc0a0a30 2023-09-30T22:35:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e428d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc123920 con 0x7f89dc0a1340 2023-09-30T22:35:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e1828700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89dc0a1340 0x7f89dc120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e1828700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89dc0a1340 0x7f89dc120620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45024/0 (socket says 172.21.15.59:45024) 2023-09-30T22:35:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e1828700 1 -- 172.21.15.59:0/2266332999 learned_addr learned my addr 172.21.15.59:0/2266332999 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e2029700 1 --2- 172.21.15.59:0/2266332999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89dc0a0a30 0x7f89dc1200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e282a700 1 --2- 172.21.15.59:0/2266332999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89dc133fa0 0x7f89dc120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e1828700 1 -- 172.21.15.59:0/2266332999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89dc0a0a30 msgr2=0x7f89dc1200e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e1828700 1 --2- 172.21.15.59:0/2266332999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89dc0a0a30 0x7f89dc1200e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e1828700 1 -- 172.21.15.59:0/2266332999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89dc133fa0 msgr2=0x7f89dc120b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e1828700 1 --2- 172.21.15.59:0/2266332999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89dc133fa0 0x7f89dc120b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e1828700 1 -- 172.21.15.59:0/2266332999 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d00094a0 con 0x7f89dc0a1340 2023-09-30T22:35:42.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e2029700 1 --2- 172.21.15.59:0/2266332999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89dc0a0a30 0x7f89dc1200e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.060+0000 7f89e1828700 1 --2- 172.21.15.59:0/2266332999 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89dc0a1340 0x7f89dc120620 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f89d000ec10 tx=0x7f89d000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.061+0000 7f89daffd700 1 -- 172.21.15.59:0/2266332999 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d000c850 con 0x7f89dc0a1340 2023-09-30T22:35:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.061+0000 7f89daffd700 1 -- 172.21.15.59:0/2266332999 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d000c9b0 con 0x7f89dc0a1340 2023-09-30T22:35:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.061+0000 7f89e428d700 1 -- 172.21.15.59:0/2266332999 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc009b30 con 0x7f89dc0a1340 2023-09-30T22:35:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.061+0000 7f89daffd700 1 -- 172.21.15.59:0/2266332999 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d000cd20 con 0x7f89dc0a1340 2023-09-30T22:35:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.061+0000 7f89e428d700 1 -- 172.21.15.59:0/2266332999 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc122f40 con 0x7f89dc0a1340 2023-09-30T22:35:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.062+0000 7f89e428d700 1 -- 172.21.15.59:0/2266332999 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc123760 con 0x7f89dc0a1340 2023-09-30T22:35:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.062+0000 7f89daffd700 1 -- 172.21.15.59:0/2266332999 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89d0013470 con 0x7f89dc0a1340 2023-09-30T22:35:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.062+0000 7f89daffd700 1 -- 172.21.15.59:0/2266332999 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f89d003ffe0 con 0x7f89dc0a1340 2023-09-30T22:35:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.067+0000 7f89daffd700 1 -- 172.21.15.59:0/2266332999 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89d0013720 con 0x7f89dc0a1340 2023-09-30T22:35:42.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.092+0000 7ff0b2185700 1 Processor -- start 2023-09-30T22:35:42.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.093+0000 7ff0b2185700 1 -- start start 2023-09-30T22:35:42.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.093+0000 7ff0b2185700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0ac0a0a30 0x7ff0ac0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.093+0000 7ff0b2185700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0ac09d630 0x7ff0ac0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.093+0000 7ff0b2185700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0ac133930 0x7ff0ac133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.093+0000 7ff0b2185700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ac0a2a70 con 0x7ff0ac0a0a30 2023-09-30T22:35:42.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.093+0000 7ff0b2185700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac0a01d0 con 0x7ff0ac133930 2023-09-30T22:35:42.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.093+0000 7ff0b2185700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac09e2b0 con 0x7ff0ac09d630 2023-09-30T22:35:42.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.093+0000 7ff0aaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0ac09d630 0x7ff0ac0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.093+0000 7ff0ab7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0ac0a0a30 0x7ff0ac0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.093+0000 7ff0aaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0ac09d630 0x7ff0ac0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45036/0 (socket says 172.21.15.59:45036) 2023-09-30T22:35:42.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.093+0000 7ff0ab7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0ac0a0a30 0x7ff0ac0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55594/0 (socket says 172.21.15.59:55594) 2023-09-30T22:35:42.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.093+0000 7ff0aaffd700 1 -- 172.21.15.59:0/22914847 learned_addr learned my addr 172.21.15.59:0/22914847 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:42.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.093+0000 7ff0abfff700 1 --2- 172.21.15.59:0/22914847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0ac133930 0x7ff0ac133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.094+0000 7ff0aaffd700 1 -- 172.21.15.59:0/22914847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0ac133930 msgr2=0x7ff0ac133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:42.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.094+0000 7ff0aaffd700 1 --2- 172.21.15.59:0/22914847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0ac133930 0x7ff0ac133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.094+0000 7ff0aaffd700 1 -- 172.21.15.59:0/22914847 >> v2:172.21.15.59:3300/0 conn(0x7ff0ac0a0a30 msgr2=0x7ff0ac0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:42.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.094+0000 7ff0aaffd700 1 --2- 172.21.15.59:0/22914847 >> v2:172.21.15.59:3300/0 conn(0x7ff0ac0a0a30 0x7ff0ac0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.094+0000 7ff0aaffd700 1 -- 172.21.15.59:0/22914847 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac09dc50 con 0x7ff0ac09d630 2023-09-30T22:35:42.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.094+0000 7ff0ab7fe700 1 --2- 172.21.15.59:0/22914847 >> v2:172.21.15.59:3300/0 conn(0x7ff0ac0a0a30 0x7ff0ac0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:42.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.094+0000 7ff0aaffd700 1 --2- 172.21.15.59:0/22914847 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0ac09d630 0x7ff0ac0a1340 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ff0940098f0 tx=0x7ff094009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a93f18e9b5ff6aca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:42.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.094+0000 7ff0aa7fc700 1 -- 172.21.15.59:0/22914847 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff094011830 con 0x7ff0ac09d630 2023-09-30T22:35:42.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.094+0000 7ff0aa7fc700 1 -- 172.21.15.59:0/22914847 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff094011990 con 0x7ff0ac09d630 2023-09-30T22:35:42.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.094+0000 7ff0aa7fc700 1 -- 172.21.15.59:0/22914847 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff094011d20 con 0x7ff0ac09d630 2023-09-30T22:35:42.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.095+0000 7ff0b2185700 1 -- 172.21.15.59:0/22914847 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0ac09d630 msgr2=0x7ff0ac0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.095+0000 7ff0b2185700 1 --2- 172.21.15.59:0/22914847 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0ac09d630 0x7ff0ac0a1340 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ff0940098f0 tx=0x7ff094009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:42.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.095+0000 7ff0b2185700 1 -- 172.21.15.59:0/22914847 shutdown_connections 2023-09-30T22:35:42.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.095+0000 7ff0b2185700 1 --2- 172.21.15.59:0/22914847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0ac133930 0x7ff0ac133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.095+0000 7ff0b2185700 1 --2- 172.21.15.59:0/22914847 >> v2:172.21.15.59:3300/0 conn(0x7ff0ac0a0a30 0x7ff0ac0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.095+0000 7ff0b2185700 1 --2- 172.21.15.59:0/22914847 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0ac09d630 0x7ff0ac0a1340 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.095+0000 7ff0b2185700 1 -- 172.21.15.59:0/22914847 >> 172.21.15.59:0/22914847 conn(0x7ff0ac0a3050 msgr2=0x7ff0ac0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:42.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.095+0000 7ff0b2185700 1 -- 172.21.15.59:0/22914847 shutdown_connections 2023-09-30T22:35:42.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.095+0000 7ff0b2185700 1 -- 172.21.15.59:0/22914847 wait complete. 2023-09-30T22:35:42.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.096+0000 7ff0b2185700 1 Processor -- start 2023-09-30T22:35:42.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.096+0000 7ff0b2185700 1 -- start start 2023-09-30T22:35:42.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.096+0000 7ff0b2185700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0ac09d630 0x7ff0ac11f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0b2185700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0ac0a0a30 0x7ff0ac11f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0b2185700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0ac133930 0x7ff0ac1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0b2185700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac121200 con 0x7ff0ac0a0a30 2023-09-30T22:35:42.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0b2185700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac1334d0 con 0x7ff0ac09d630 2023-09-30T22:35:42.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0b2185700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac0a4130 con 0x7ff0ac133930 2023-09-30T22:35:42.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0abfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0ac133930 0x7ff0ac1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0aaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0ac0a0a30 0x7ff0ac11f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0abfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0ac133930 0x7ff0ac1c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45048/0 (socket says 172.21.15.59:45048) 2023-09-30T22:35:42.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0abfff700 1 -- 172.21.15.59:0/146192855 learned_addr learned my addr 172.21.15.59:0/146192855 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:42.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0ab7fe700 1 --2- 172.21.15.59:0/146192855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0ac09d630 0x7ff0ac11f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0abfff700 1 -- 172.21.15.59:0/146192855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0ac09d630 msgr2=0x7ff0ac11f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0abfff700 1 --2- 172.21.15.59:0/146192855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0ac09d630 0x7ff0ac11f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0abfff700 1 -- 172.21.15.59:0/146192855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0ac0a0a30 msgr2=0x7ff0ac11f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0abfff700 1 --2- 172.21.15.59:0/146192855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0ac0a0a30 0x7ff0ac11f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0abfff700 1 -- 172.21.15.59:0/146192855 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c009a70 con 0x7ff0ac133930 2023-09-30T22:35:42.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0aaffd700 1 --2- 172.21.15.59:0/146192855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0ac0a0a30 0x7ff0ac11f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:42.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0ab7fe700 1 --2- 172.21.15.59:0/146192855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0ac09d630 0x7ff0ac11f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:42.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0abfff700 1 --2- 172.21.15.59:0/146192855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0ac133930 0x7ff0ac1c8020 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400e950 tx=0x7ff0a400ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:42.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0a3fff700 1 -- 172.21.15.59:0/146192855 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4009730 con 0x7ff0ac133930 2023-09-30T22:35:42.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0a3fff700 1 -- 172.21.15.59:0/146192855 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a4013680 con 0x7ff0ac133930 2023-09-30T22:35:42.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.097+0000 7ff0b2185700 1 -- 172.21.15.59:0/146192855 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff094009550 con 0x7ff0ac133930 2023-09-30T22:35:42.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.098+0000 7ff0a3fff700 1 -- 172.21.15.59:0/146192855 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4013a10 con 0x7ff0ac133930 2023-09-30T22:35:42.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.098+0000 7ff0b2185700 1 -- 172.21.15.59:0/146192855 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ac11fdc0 con 0x7ff0ac133930 2023-09-30T22:35:42.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.098+0000 7ff0a3fff700 1 -- 172.21.15.59:0/146192855 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0a4013b70 con 0x7ff0ac133930 2023-09-30T22:35:42.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.099+0000 7ff0b2185700 1 -- 172.21.15.59:0/146192855 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ac0747f0 con 0x7ff0ac133930 2023-09-30T22:35:42.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.099+0000 7ff0a3fff700 1 -- 172.21.15.59:0/146192855 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff0a403fb30 con 0x7ff0ac133930 2023-09-30T22:35:42.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.104+0000 7ff0a3fff700 1 -- 172.21.15.59:0/146192855 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0a401ab90 con 0x7ff0ac133930 2023-09-30T22:35:42.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.276+0000 7f89e428d700 1 -- 172.21.15.59:0/2266332999 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f89dc1235c0 con 0x7f89dc0a1340 2023-09-30T22:35:42.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.276+0000 7f89daffd700 1 -- 172.21.15.59:0/2266332999 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89dc1235c0 con 0x7f89dc0a1340 2023-09-30T22:35:42.277 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:42.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.278+0000 7f89e428d700 1 -- 172.21.15.59:0/2266332999 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89dc0a1340 msgr2=0x7f89dc120620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.278+0000 7f89e428d700 1 --2- 172.21.15.59:0/2266332999 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89dc0a1340 0x7f89dc120620 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f89d000ec10 tx=0x7f89d000ef20 comp rx=0 tx=0).stop 2023-09-30T22:35:42.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.278+0000 7f89e428d700 1 -- 172.21.15.59:0/2266332999 shutdown_connections 2023-09-30T22:35:42.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.278+0000 7f89e428d700 1 --2- 172.21.15.59:0/2266332999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89dc133fa0 0x7f89dc120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.278+0000 7f89e428d700 1 --2- 172.21.15.59:0/2266332999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89dc0a0a30 0x7f89dc1200e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.278+0000 7f89e428d700 1 --2- 172.21.15.59:0/2266332999 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f89dc0a1340 0x7f89dc120620 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.278+0000 7f89e428d700 1 -- 172.21.15.59:0/2266332999 >> 172.21.15.59:0/2266332999 conn(0x7f89dc0a6550 msgr2=0x7f89dc1bb060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:42.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.278+0000 7f89e428d700 1 -- 172.21.15.59:0/2266332999 shutdown_connections 2023-09-30T22:35:42.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.278+0000 7f89e428d700 1 -- 172.21.15.59:0/2266332999 wait complete. 2023-09-30T22:35:42.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.308+0000 7ff0b2185700 1 -- 172.21.15.59:0/146192855 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff0ac120a90 con 0x7ff0ac133930 2023-09-30T22:35:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.308+0000 7ff0a3fff700 1 -- 172.21.15.59:0/146192855 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0a4017070 con 0x7ff0ac133930 2023-09-30T22:35:42.309 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.311+0000 7ff0b2185700 1 -- 172.21.15.59:0/146192855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0ac133930 msgr2=0x7ff0ac1c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.311+0000 7ff0b2185700 1 --2- 172.21.15.59:0/146192855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0ac133930 0x7ff0ac1c8020 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400e950 tx=0x7ff0a400ec60 comp rx=0 tx=0).stop 2023-09-30T22:35:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.311+0000 7ff0b2185700 1 -- 172.21.15.59:0/146192855 shutdown_connections 2023-09-30T22:35:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.311+0000 7ff0b2185700 1 --2- 172.21.15.59:0/146192855 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0ac133930 0x7ff0ac1c8020 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.311+0000 7ff0b2185700 1 --2- 172.21.15.59:0/146192855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0ac09d630 0x7ff0ac11f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.311+0000 7ff0b2185700 1 --2- 172.21.15.59:0/146192855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0ac0a0a30 0x7ff0ac11f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.311+0000 7ff0b2185700 1 -- 172.21.15.59:0/146192855 >> 172.21.15.59:0/146192855 conn(0x7ff0ac0a3050 msgr2=0x7ff0ac09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:42.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.311+0000 7ff0b2185700 1 -- 172.21.15.59:0/146192855 shutdown_connections 2023-09-30T22:35:42.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.311+0000 7ff0b2185700 1 -- 172.21.15.59:0/146192855 wait complete. 2023-09-30T22:35:42.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:42.363 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:42.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:42.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.507+0000 7f11edab1700 1 Processor -- start 2023-09-30T22:35:42.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.507+0000 7f11edab1700 1 -- start start 2023-09-30T22:35:42.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11edab1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11e809d630 0x7f11e80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11edab1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11e8138d80 0x7f11e813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11edab1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e80a2a70 con 0x7f11e80a0a30 2023-09-30T22:35:42.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11edab1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80a01d0 con 0x7f11e8138d80 2023-09-30T22:35:42.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11edab1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11e809e2b0 con 0x7f11e809d630 2023-09-30T22:35:42.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11e6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11e809d630 0x7f11e80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11e77fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f11e80a0a30 0x7f11e80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50228/0 (socket says 172.21.15.59:50228) 2023-09-30T22:35:42.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11e77fe700 1 -- 172.21.15.59:0/864748598 learned_addr learned my addr 172.21.15.59:0/864748598 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:42.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11e7fff700 1 --2- 172.21.15.59:0/864748598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11e8138d80 0x7f11e813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11e6ffd700 1 -- 172.21.15.59:0/864748598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11e8138d80 msgr2=0x7f11e813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11e6ffd700 1 --2- 172.21.15.59:0/864748598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11e8138d80 0x7f11e813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11e67fc700 1 -- 172.21.15.59:0/864748598 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725623146 0 0) 0x7f11e80a2a70 con 0x7f11e80a0a30 2023-09-30T22:35:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11e6ffd700 1 -- 172.21.15.59:0/864748598 >> v1:172.21.15.59:6789/0 conn(0x7f11e80a0a30 legacy=0x7f11e80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11e6ffd700 1 -- 172.21.15.59:0/864748598 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e809dc50 con 0x7f11e809d630 2023-09-30T22:35:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11e7fff700 1 --2- 172.21.15.59:0/864748598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11e8138d80 0x7f11e813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.508+0000 7f11e6ffd700 1 --2- 172.21.15.59:0/864748598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11e809d630 0x7f11e80a1510 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009870 tx=0x7f11d0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4161de9ffb3783ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.509+0000 7f11e67fc700 1 -- 172.21.15.59:0/864748598 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0011830 con 0x7f11e809d630 2023-09-30T22:35:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.509+0000 7f11e67fc700 1 -- 172.21.15.59:0/864748598 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d0011990 con 0x7f11e809d630 2023-09-30T22:35:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.509+0000 7f11e67fc700 1 -- 172.21.15.59:0/864748598 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0011d20 con 0x7f11e809d630 2023-09-30T22:35:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.509+0000 7f11edab1700 1 -- 172.21.15.59:0/864748598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11e809d630 msgr2=0x7f11e80a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.509+0000 7f11edab1700 1 --2- 172.21.15.59:0/864748598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11e809d630 0x7f11e80a1510 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009870 tx=0x7f11d0009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.509+0000 7f11edab1700 1 -- 172.21.15.59:0/864748598 shutdown_connections 2023-09-30T22:35:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.509+0000 7f11edab1700 1 --2- 172.21.15.59:0/864748598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11e8138d80 0x7f11e813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.509+0000 7f11edab1700 1 --2- 172.21.15.59:0/864748598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11e809d630 0x7f11e80a1510 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.509+0000 7f11edab1700 1 -- 172.21.15.59:0/864748598 >> 172.21.15.59:0/864748598 conn(0x7f11e80a3050 msgr2=0x7f11e80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.509+0000 7f11edab1700 1 -- 172.21.15.59:0/864748598 shutdown_connections 2023-09-30T22:35:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.510+0000 7f11edab1700 1 -- 172.21.15.59:0/864748598 wait complete. 2023-09-30T22:35:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.510+0000 7f11edab1700 1 Processor -- start 2023-09-30T22:35:42.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.511+0000 7f11edab1700 1 -- start start 2023-09-30T22:35:42.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.511+0000 7f11edab1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11e809d630 0x7f11e81337c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.511+0000 7f11edab1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11e80a0a30 0x7f11e8133d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.511+0000 7f11edab1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11e8138d80 0x7f11e8134240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.511+0000 7f11edab1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e8134c90 con 0x7f11e809d630 2023-09-30T22:35:42.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.511+0000 7f11edab1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e8137310 con 0x7f11e8138d80 2023-09-30T22:35:42.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.511+0000 7f11edab1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11e8136c60 con 0x7f11e80a0a30 2023-09-30T22:35:42.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.511+0000 7f11e77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11e809d630 0x7f11e81337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.511+0000 7f11e77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11e809d630 0x7f11e81337c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55624/0 (socket says 172.21.15.59:55624) 2023-09-30T22:35:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.511+0000 7f11e6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11e80a0a30 0x7f11e8133d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.511+0000 7f11e77fe700 1 -- 172.21.15.59:0/2177988164 learned_addr learned my addr 172.21.15.59:0/2177988164 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.511+0000 7f11e7fff700 1 --2- 172.21.15.59:0/2177988164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11e8138d80 0x7f11e8134240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.512+0000 7f11e77fe700 1 -- 172.21.15.59:0/2177988164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11e80a0a30 msgr2=0x7f11e8133d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.512+0000 7f11e77fe700 1 --2- 172.21.15.59:0/2177988164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11e80a0a30 0x7f11e8133d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.512+0000 7f11e77fe700 1 -- 172.21.15.59:0/2177988164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11e8138d80 msgr2=0x7f11e8134240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.512+0000 7f11e77fe700 1 --2- 172.21.15.59:0/2177988164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11e8138d80 0x7f11e8134240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.512+0000 7f11e77fe700 1 -- 172.21.15.59:0/2177988164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e00094a0 con 0x7f11e809d630 2023-09-30T22:35:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.512+0000 7f11e6ffd700 1 --2- 172.21.15.59:0/2177988164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11e80a0a30 0x7f11e8133d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.512+0000 7f11e77fe700 1 --2- 172.21.15.59:0/2177988164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11e809d630 0x7f11e81337c0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f11d800ccb0 tx=0x7f11d800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:42.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.512+0000 7f11dffff700 1 -- 172.21.15.59:0/2177988164 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d800aae0 con 0x7f11e809d630 2023-09-30T22:35:42.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.512+0000 7f11dffff700 1 -- 172.21.15.59:0/2177988164 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d800ac40 con 0x7f11e809d630 2023-09-30T22:35:42.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.512+0000 7f11edab1700 1 -- 172.21.15.59:0/2177988164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d00094a0 con 0x7f11e809d630 2023-09-30T22:35:42.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.512+0000 7f11dffff700 1 -- 172.21.15.59:0/2177988164 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d80070d0 con 0x7f11e809d630 2023-09-30T22:35:42.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.512+0000 7f11edab1700 1 -- 172.21.15.59:0/2177988164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e8136f20 con 0x7f11e809d630 2023-09-30T22:35:42.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.513+0000 7f11edab1700 1 -- 172.21.15.59:0/2177988164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e8136610 con 0x7f11e809d630 2023-09-30T22:35:42.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.513+0000 7f11dffff700 1 -- 172.21.15.59:0/2177988164 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11d8007230 con 0x7f11e809d630 2023-09-30T22:35:42.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.514+0000 7f11dffff700 1 -- 172.21.15.59:0/2177988164 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f11d803f220 con 0x7f11e809d630 2023-09-30T22:35:42.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.518+0000 7f11dffff700 1 -- 172.21.15.59:0/2177988164 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11e8136610 con 0x7f11e809d630 2023-09-30T22:35:42.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.547+0000 7f3005810700 1 Processor -- start 2023-09-30T22:35:42.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.547+0000 7f3005810700 1 -- start start 2023-09-30T22:35:42.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.548+0000 7f3005810700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f300012c2f0 0x7f3000130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.548+0000 7f3005810700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f300012cff0 0x7f3000137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.548+0000 7f3005810700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300009a510 con 0x7f300012cc20 2023-09-30T22:35:42.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.548+0000 7f3005810700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300012c7d0 con 0x7f300012c2f0 2023-09-30T22:35:42.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.548+0000 7f3005810700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f300009c190 con 0x7f300012cff0 2023-09-30T22:35:42.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.548+0000 7f2ffe7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f300012c2f0 0x7f3000130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.548+0000 7f2ffeffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f300012cc20 0x7f300012f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50232/0 (socket says 172.21.15.59:50232) 2023-09-30T22:35:42.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.548+0000 7f2ffeffd700 1 -- 172.21.15.59:0/3668729365 learned_addr learned my addr 172.21.15.59:0/3668729365 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.548+0000 7f2fff7fe700 1 --2- 172.21.15.59:0/3668729365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f300012cff0 0x7f3000137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.549+0000 7f2ffdffb700 1 -- 172.21.15.59:0/3668729365 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367168397 0 0) 0x7f300009a510 con 0x7f300012cc20 2023-09-30T22:35:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.549+0000 7f2ffe7fc700 1 -- 172.21.15.59:0/3668729365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f300012cff0 msgr2=0x7f3000137cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.549+0000 7f2ffe7fc700 1 --2- 172.21.15.59:0/3668729365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f300012cff0 0x7f3000137cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.549+0000 7f2ffe7fc700 1 -- 172.21.15.59:0/3668729365 >> v1:172.21.15.59:6789/0 conn(0x7f300012cc20 legacy=0x7f300012f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.549+0000 7f2ffe7fc700 1 -- 172.21.15.59:0/3668729365 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300009b540 con 0x7f300012c2f0 2023-09-30T22:35:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.549+0000 7f2fff7fe700 1 --2- 172.21.15.59:0/3668729365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f300012cff0 0x7f3000137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.549+0000 7f2ffe7fc700 1 --2- 172.21.15.59:0/3668729365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f300012c2f0 0x7f3000130040 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8009870 tx=0x7f2fe8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=705a54e9339181d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.549+0000 7f2ffdffb700 1 -- 172.21.15.59:0/3668729365 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8011830 con 0x7f300012c2f0 2023-09-30T22:35:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.549+0000 7f2ffdffb700 1 -- 172.21.15.59:0/3668729365 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe8011990 con 0x7f300012c2f0 2023-09-30T22:35:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.549+0000 7f2ffdffb700 1 -- 172.21.15.59:0/3668729365 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8011d20 con 0x7f300012c2f0 2023-09-30T22:35:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.550+0000 7f3005810700 1 -- 172.21.15.59:0/3668729365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f300012c2f0 msgr2=0x7f3000130040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.550+0000 7f3005810700 1 --2- 172.21.15.59:0/3668729365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f300012c2f0 0x7f3000130040 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8009870 tx=0x7f2fe8009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.550+0000 7f3005810700 1 -- 172.21.15.59:0/3668729365 shutdown_connections 2023-09-30T22:35:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.550+0000 7f3005810700 1 --2- 172.21.15.59:0/3668729365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f300012cff0 0x7f3000137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.550+0000 7f3005810700 1 --2- 172.21.15.59:0/3668729365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f300012c2f0 0x7f3000130040 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.550+0000 7f3005810700 1 -- 172.21.15.59:0/3668729365 >> 172.21.15.59:0/3668729365 conn(0x7f300009f470 msgr2=0x7f30000a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.550+0000 7f3005810700 1 -- 172.21.15.59:0/3668729365 shutdown_connections 2023-09-30T22:35:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.550+0000 7f3005810700 1 -- 172.21.15.59:0/3668729365 wait complete. 2023-09-30T22:35:42.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.551+0000 7f3005810700 1 Processor -- start 2023-09-30T22:35:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.551+0000 7f3005810700 1 -- start start 2023-09-30T22:35:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f3005810700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f300012c2f0 0x7f3000071be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f3005810700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f300012cc20 0x7f3000072120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f3005810700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f300012cff0 0x7f3000138210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f3005810700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30001361a0 con 0x7f300012cc20 2023-09-30T22:35:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f3005810700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30001392c0 con 0x7f300012c2f0 2023-09-30T22:35:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f3005810700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f300012b1a0 con 0x7f300012cff0 2023-09-30T22:35:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f2ffeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f300012c2f0 0x7f3000071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f2fff7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f300012cff0 0x7f3000138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f2ffeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f300012c2f0 0x7f3000071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58804/0 (socket says 172.21.15.59:58804) 2023-09-30T22:35:42.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f2ffeffd700 1 -- 172.21.15.59:0/3431608868 learned_addr learned my addr 172.21.15.59:0/3431608868 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:42.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f2ffe7fc700 1 --2- 172.21.15.59:0/3431608868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f300012cc20 0x7f3000072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:42.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f2fff7fe700 1 -- 172.21.15.59:0/3431608868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f300012c2f0 msgr2=0x7f3000071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f2fff7fe700 1 --2- 172.21.15.59:0/3431608868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f300012c2f0 0x7f3000071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f2fff7fe700 1 -- 172.21.15.59:0/3431608868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f300012cc20 msgr2=0x7f3000072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f2fff7fe700 1 --2- 172.21.15.59:0/3431608868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f300012cc20 0x7f3000072120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.552+0000 7f2fff7fe700 1 -- 172.21.15.59:0/3431608868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff000ab80 con 0x7f300012cff0 2023-09-30T22:35:42.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.553+0000 7f2fff7fe700 1 --2- 172.21.15.59:0/3431608868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f300012cff0 0x7f3000138210 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009e20 tx=0x7f2ff00074d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:42.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.553+0000 7f2ff7fff700 1 -- 172.21.15.59:0/3431608868 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0018070 con 0x7f300012cff0 2023-09-30T22:35:42.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.553+0000 7f2ff7fff700 1 -- 172.21.15.59:0/3431608868 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff0010040 con 0x7f300012cff0 2023-09-30T22:35:42.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.553+0000 7f3005810700 1 -- 172.21.15.59:0/3431608868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe80094a0 con 0x7f300012cff0 2023-09-30T22:35:42.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.553+0000 7f2ff7fff700 1 -- 172.21.15.59:0/3431608868 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0007de0 con 0x7f300012cff0 2023-09-30T22:35:42.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.553+0000 7f3005810700 1 -- 172.21.15.59:0/3431608868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3000129f70 con 0x7f300012cff0 2023-09-30T22:35:42.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.554+0000 7f2ff7fff700 1 -- 172.21.15.59:0/3431608868 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ff001d410 con 0x7f300012cff0 2023-09-30T22:35:42.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.554+0000 7f2ff7fff700 1 -- 172.21.15.59:0/3431608868 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2ff003f370 con 0x7f300012cff0 2023-09-30T22:35:42.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.554+0000 7f3005810700 1 -- 172.21.15.59:0/3431608868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3000135fd0 con 0x7f300012cff0 2023-09-30T22:35:42.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.559+0000 7f2ff7fff700 1 -- 172.21.15.59:0/3431608868 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ff001d6c0 con 0x7f300012cff0 2023-09-30T22:35:42.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.728+0000 7f11edab1700 1 -- 172.21.15.59:0/2177988164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f11e81365b0 con 0x7f11e809d630 2023-09-30T22:35:42.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.728+0000 7f11dffff700 1 -- 172.21.15.59:0/2177988164 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11d8018020 con 0x7f11e809d630 2023-09-30T22:35:42.730 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:42.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.731+0000 7f11edab1700 1 -- 172.21.15.59:0/2177988164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11e809d630 msgr2=0x7f11e81337c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.731+0000 7f11edab1700 1 --2- 172.21.15.59:0/2177988164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11e809d630 0x7f11e81337c0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f11d800ccb0 tx=0x7f11d800a060 comp rx=0 tx=0).stop 2023-09-30T22:35:42.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.731+0000 7f11edab1700 1 -- 172.21.15.59:0/2177988164 shutdown_connections 2023-09-30T22:35:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.731+0000 7f11edab1700 1 --2- 172.21.15.59:0/2177988164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11e8138d80 0x7f11e8134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.731+0000 7f11edab1700 1 --2- 172.21.15.59:0/2177988164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11e809d630 0x7f11e81337c0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.731+0000 7f11edab1700 1 --2- 172.21.15.59:0/2177988164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11e80a0a30 0x7f11e8133d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.731+0000 7f11edab1700 1 -- 172.21.15.59:0/2177988164 >> 172.21.15.59:0/2177988164 conn(0x7f11e80a3050 msgr2=0x7f11e809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.731+0000 7f11edab1700 1 -- 172.21.15.59:0/2177988164 shutdown_connections 2023-09-30T22:35:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.731+0000 7f11edab1700 1 -- 172.21.15.59:0/2177988164 wait complete. 2023-09-30T22:35:42.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.768+0000 7f3005810700 1 -- 172.21.15.59:0/3431608868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f30000747f0 con 0x7f300012cff0 2023-09-30T22:35:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.768+0000 7f2ff7fff700 1 -- 172.21.15.59:0/3431608868 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ff00122b0 con 0x7f300012cff0 2023-09-30T22:35:42.770 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.770+0000 7f3005810700 1 -- 172.21.15.59:0/3431608868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f300012cff0 msgr2=0x7f3000138210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.771+0000 7f3005810700 1 --2- 172.21.15.59:0/3431608868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f300012cff0 0x7f3000138210 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009e20 tx=0x7f2ff00074d0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.771+0000 7f3005810700 1 -- 172.21.15.59:0/3431608868 shutdown_connections 2023-09-30T22:35:42.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.771+0000 7f3005810700 1 --2- 172.21.15.59:0/3431608868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f300012cff0 0x7f3000138210 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.771+0000 7f3005810700 1 --2- 172.21.15.59:0/3431608868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f300012c2f0 0x7f3000071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.771+0000 7f3005810700 1 --2- 172.21.15.59:0/3431608868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f300012cc20 0x7f3000072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:42.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.771+0000 7f3005810700 1 -- 172.21.15.59:0/3431608868 >> 172.21.15.59:0/3431608868 conn(0x7f300009f470 msgr2=0x7f300012f840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:42.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.771+0000 7f3005810700 1 -- 172.21.15.59:0/3431608868 shutdown_connections 2023-09-30T22:35:42.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:42.771+0000 7f3005810700 1 -- 172.21.15.59:0/3431608868 wait complete. 2023-09-30T22:35:42.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:43.295 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:43.326 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:43.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.446+0000 7f6466d10700 1 Processor -- start 2023-09-30T22:35:43.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.446+0000 7f6466d10700 1 -- start start 2023-09-30T22:35:43.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f6466d10700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f64600a0a30 0x7f64600a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f6466d10700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6460138d80 0x7f646013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f6466d10700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64600a2a70 con 0x7f646009d630 2023-09-30T22:35:43.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f6466d10700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64600a01d0 con 0x7f64600a0a30 2023-09-30T22:35:43.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f6466d10700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646009e2b0 con 0x7f6460138d80 2023-09-30T22:35:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f6464aac700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f64600a0a30 0x7f64600a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f64652ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6460138d80 0x7f646013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f6464aac700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f64600a0a30 0x7f64600a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55634/0 (socket says 172.21.15.59:55634) 2023-09-30T22:35:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f6464aac700 1 -- 172.21.15.59:0/4238692294 learned_addr learned my addr 172.21.15.59:0/4238692294 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f64652ad700 1 --2- 172.21.15.59:0/4238692294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6460138d80 0x7f646013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58806/0 (socket says 172.21.15.59:58806) 2023-09-30T22:35:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f6464aac700 1 -- 172.21.15.59:0/4238692294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6460138d80 msgr2=0x7f646013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f6464aac700 1 --2- 172.21.15.59:0/4238692294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6460138d80 0x7f646013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f6464aac700 1 -- 172.21.15.59:0/4238692294 >> v1:172.21.15.59:6789/0 conn(0x7f646009d630 legacy=0x7f64600a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f6464aac700 1 -- 172.21.15.59:0/4238692294 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646009dc50 con 0x7f64600a0a30 2023-09-30T22:35:43.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f64652ad700 1 --2- 172.21.15.59:0/4238692294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6460138d80 0x7f646013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:43.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.447+0000 7f6464aac700 1 --2- 172.21.15.59:0/4238692294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64600a0a30 0x7f64600a0e00 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f64540098f0 tx=0x7f6454009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442c088a3d1a626a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:43.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.448+0000 7f645f7fe700 1 -- 172.21.15.59:0/4238692294 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454011830 con 0x7f64600a0a30 2023-09-30T22:35:43.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.448+0000 7f645f7fe700 1 -- 172.21.15.59:0/4238692294 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6454011990 con 0x7f64600a0a30 2023-09-30T22:35:43.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.448+0000 7f645f7fe700 1 -- 172.21.15.59:0/4238692294 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454011d20 con 0x7f64600a0a30 2023-09-30T22:35:43.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.448+0000 7f6466d10700 1 -- 172.21.15.59:0/4238692294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64600a0a30 msgr2=0x7f64600a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.448+0000 7f6466d10700 1 --2- 172.21.15.59:0/4238692294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64600a0a30 0x7f64600a0e00 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f64540098f0 tx=0x7f6454009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:43.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.448+0000 7f6466d10700 1 -- 172.21.15.59:0/4238692294 shutdown_connections 2023-09-30T22:35:43.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.448+0000 7f6466d10700 1 --2- 172.21.15.59:0/4238692294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64600a0a30 0x7f64600a0e00 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.448+0000 7f6466d10700 1 --2- 172.21.15.59:0/4238692294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6460138d80 0x7f646013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.448+0000 7f6466d10700 1 -- 172.21.15.59:0/4238692294 >> 172.21.15.59:0/4238692294 conn(0x7f64600a3050 msgr2=0x7f64600a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:43.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.448+0000 7f6466d10700 1 -- 172.21.15.59:0/4238692294 shutdown_connections 2023-09-30T22:35:43.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.448+0000 7f6466d10700 1 -- 172.21.15.59:0/4238692294 wait complete. 2023-09-30T22:35:43.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.449+0000 7f6466d10700 1 Processor -- start 2023-09-30T22:35:43.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.449+0000 7f6466d10700 1 -- start start 2023-09-30T22:35:43.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.450+0000 7f6466d10700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f646009d630 0x7f6460133980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.450+0000 7f6466d10700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64600a0a30 0x7f6460133ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.450+0000 7f6466d10700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6460138d80 0x7f6460134400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.450+0000 7f6466d10700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6460134e50 con 0x7f6460138d80 2023-09-30T22:35:43.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.450+0000 7f6466d10700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6460137170 con 0x7f646009d630 2023-09-30T22:35:43.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.450+0000 7f6466d10700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64601380d0 con 0x7f64600a0a30 2023-09-30T22:35:43.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.450+0000 7f6464aac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f646009d630 0x7f6460133980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.450+0000 7f6464aac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f646009d630 0x7f6460133980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58822/0 (socket says 172.21.15.59:58822) 2023-09-30T22:35:43.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.450+0000 7f6464aac700 1 -- 172.21.15.59:0/3159062737 learned_addr learned my addr 172.21.15.59:0/3159062737 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:43.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.450+0000 7f64652ad700 1 --2- 172.21.15.59:0/3159062737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6460138d80 0x7f6460134400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.450+0000 7f645ffff700 1 --2- 172.21.15.59:0/3159062737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64600a0a30 0x7f6460133ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.450+0000 7f6464aac700 1 -- 172.21.15.59:0/3159062737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64600a0a30 msgr2=0x7f6460133ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.451+0000 7f6464aac700 1 --2- 172.21.15.59:0/3159062737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64600a0a30 0x7f6460133ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.451+0000 7f6464aac700 1 -- 172.21.15.59:0/3159062737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6460138d80 msgr2=0x7f6460134400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.451+0000 7f6464aac700 1 --2- 172.21.15.59:0/3159062737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6460138d80 0x7f6460134400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.451+0000 7f6464aac700 1 -- 172.21.15.59:0/3159062737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6458009a70 con 0x7f646009d630 2023-09-30T22:35:43.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.451+0000 7f64652ad700 1 --2- 172.21.15.59:0/3159062737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6460138d80 0x7f6460134400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:43.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.451+0000 7f6464aac700 1 --2- 172.21.15.59:0/3159062737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f646009d630 0x7f6460133980 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f6454009c40 tx=0x7f6454004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:43.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.451+0000 7f645d7fa700 1 -- 172.21.15.59:0/3159062737 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454004550 con 0x7f646009d630 2023-09-30T22:35:43.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.451+0000 7f645d7fa700 1 -- 172.21.15.59:0/3159062737 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64540036a0 con 0x7f646009d630 2023-09-30T22:35:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.451+0000 7f6466d10700 1 -- 172.21.15.59:0/3159062737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6454009550 con 0x7f646009d630 2023-09-30T22:35:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.451+0000 7f645d7fa700 1 -- 172.21.15.59:0/3159062737 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454003a30 con 0x7f646009d630 2023-09-30T22:35:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.451+0000 7f6466d10700 1 -- 172.21.15.59:0/3159062737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6460135a90 con 0x7f646009d630 2023-09-30T22:35:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.452+0000 7f645d7fa700 1 -- 172.21.15.59:0/3159062737 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6454021070 con 0x7f646009d630 2023-09-30T22:35:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.452+0000 7f6466d10700 1 -- 172.21.15.59:0/3159062737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64600747f0 con 0x7f646009d630 2023-09-30T22:35:43.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.452+0000 7f645d7fa700 1 -- 172.21.15.59:0/3159062737 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6454040aa0 con 0x7f646009d630 2023-09-30T22:35:43.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.457+0000 7f645d7fa700 1 -- 172.21.15.59:0/3159062737 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f645402d760 con 0x7f646009d630 2023-09-30T22:35:43.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.485+0000 7f4a189ea700 1 Processor -- start 2023-09-30T22:35:43.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.485+0000 7f4a189ea700 1 -- start start 2023-09-30T22:35:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a189ea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a14133420 0x7f4a141337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a189ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a14133e30 0x7f4a1412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a189ea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1406b990 con 0x7f4a14134260 2023-09-30T22:35:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a189ea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a140a0590 con 0x7f4a14133420 2023-09-30T22:35:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a189ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1409fb80 con 0x7f4a14133e30 2023-09-30T22:35:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a09d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a14133e30 0x7f4a1412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a1259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a14133420 0x7f4a141337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a09d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a14133e30 0x7f4a1412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45096/0 (socket says 172.21.15.59:45096) 2023-09-30T22:35:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a09d9b700 1 -- 172.21.15.59:0/384171370 learned_addr learned my addr 172.21.15.59:0/384171370 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a1259c700 1 -- 172.21.15.59:0/384171370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a14133e30 msgr2=0x7f4a1412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a1259c700 1 --2- 172.21.15.59:0/384171370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a14133e30 0x7f4a1412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a1259c700 1 -- 172.21.15.59:0/384171370 >> v1:172.21.15.59:6789/0 conn(0x7f4a14134260 legacy=0x7f4a141304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a1259c700 1 -- 172.21.15.59:0/384171370 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140a0030 con 0x7f4a14133420 2023-09-30T22:35:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a11d9b700 1 -- 172.21.15.59:0/384171370 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142961011 0 0) 0x7f4a1406b990 con 0x7f4a14134260 2023-09-30T22:35:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a09d9b700 1 --2- 172.21.15.59:0/384171370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a14133e30 0x7f4a1412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.486+0000 7f4a1259c700 1 --2- 172.21.15.59:0/384171370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a14133420 0x7f4a141337f0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009840 tx=0x7f4a04009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7821c05402013f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.487+0000 7f4a11d9b700 1 -- 172.21.15.59:0/384171370 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a04011830 con 0x7f4a14133420 2023-09-30T22:35:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.487+0000 7f4a11d9b700 1 -- 172.21.15.59:0/384171370 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a04011990 con 0x7f4a14133420 2023-09-30T22:35:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.487+0000 7f4a11d9b700 1 -- 172.21.15.59:0/384171370 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a04011d20 con 0x7f4a14133420 2023-09-30T22:35:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.487+0000 7f4a189ea700 1 -- 172.21.15.59:0/384171370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a14133420 msgr2=0x7f4a141337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.487+0000 7f4a189ea700 1 --2- 172.21.15.59:0/384171370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a14133420 0x7f4a141337f0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009840 tx=0x7f4a04009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.487+0000 7f4a189ea700 1 -- 172.21.15.59:0/384171370 shutdown_connections 2023-09-30T22:35:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.487+0000 7f4a189ea700 1 --2- 172.21.15.59:0/384171370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a14133420 0x7f4a141337f0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.487+0000 7f4a189ea700 1 --2- 172.21.15.59:0/384171370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a14133e30 0x7f4a1412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.487+0000 7f4a189ea700 1 -- 172.21.15.59:0/384171370 >> 172.21.15.59:0/384171370 conn(0x7f4a140a4210 msgr2=0x7f4a140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.487+0000 7f4a189ea700 1 -- 172.21.15.59:0/384171370 shutdown_connections 2023-09-30T22:35:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.487+0000 7f4a189ea700 1 -- 172.21.15.59:0/384171370 wait complete. 2023-09-30T22:35:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.489+0000 7f4a189ea700 1 Processor -- start 2023-09-30T22:35:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.489+0000 7f4a189ea700 1 -- start start 2023-09-30T22:35:43.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.489+0000 7f4a189ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a14133420 0x7f4a1409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.489+0000 7f4a189ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a14133e30 0x7f4a1409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.489+0000 7f4a189ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a14134260 0x7f4a1409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.489+0000 7f4a189ea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14120110 con 0x7f4a14133420 2023-09-30T22:35:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.489+0000 7f4a189ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1411f080 con 0x7f4a14134260 2023-09-30T22:35:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.489+0000 7f4a189ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1409deb0 con 0x7f4a14133e30 2023-09-30T22:35:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.489+0000 7f4a09d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a14133e30 0x7f4a1409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.489+0000 7f4a09d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a14133e30 0x7f4a1409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45106/0 (socket says 172.21.15.59:45106) 2023-09-30T22:35:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.489+0000 7f4a09d9b700 1 -- 172.21.15.59:0/635111160 learned_addr learned my addr 172.21.15.59:0/635111160 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.489+0000 7f4a12d9d700 1 --2- 172.21.15.59:0/635111160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a14134260 0x7f4a1409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.489+0000 7f4a1259c700 1 --2- 172.21.15.59:0/635111160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a14133420 0x7f4a1409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.490+0000 7f4a09d9b700 1 -- 172.21.15.59:0/635111160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a14134260 msgr2=0x7f4a1409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.490+0000 7f4a09d9b700 1 --2- 172.21.15.59:0/635111160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a14134260 0x7f4a1409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.490+0000 7f4a09d9b700 1 -- 172.21.15.59:0/635111160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a14133420 msgr2=0x7f4a1409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.490+0000 7f4a09d9b700 1 --2- 172.21.15.59:0/635111160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a14133420 0x7f4a1409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.490+0000 7f4a09d9b700 1 -- 172.21.15.59:0/635111160 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc009550 con 0x7f4a14133e30 2023-09-30T22:35:43.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.490+0000 7f4a12d9d700 1 --2- 172.21.15.59:0/635111160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a14134260 0x7f4a1409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:43.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.490+0000 7f4a1259c700 1 --2- 172.21.15.59:0/635111160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a14133420 0x7f4a1409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:43.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.490+0000 7f4a09d9b700 1 --2- 172.21.15.59:0/635111160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a14133e30 0x7f4a1409c9c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00ec10 tx=0x7f49fc00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:43.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.490+0000 7f4a0b7fe700 1 -- 172.21.15.59:0/635111160 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00c850 con 0x7f4a14133e30 2023-09-30T22:35:43.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.490+0000 7f4a0b7fe700 1 -- 172.21.15.59:0/635111160 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc00c9b0 con 0x7f4a14133e30 2023-09-30T22:35:43.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.490+0000 7f4a189ea700 1 -- 172.21.15.59:0/635111160 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a040094a0 con 0x7f4a14133e30 2023-09-30T22:35:43.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.490+0000 7f4a0b7fe700 1 -- 172.21.15.59:0/635111160 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00cd40 con 0x7f4a14133e30 2023-09-30T22:35:43.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.490+0000 7f4a189ea700 1 -- 172.21.15.59:0/635111160 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1411fd90 con 0x7f4a14133e30 2023-09-30T22:35:43.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.491+0000 7f4a0b7fe700 1 -- 172.21.15.59:0/635111160 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49fc013470 con 0x7f4a14133e30 2023-09-30T22:35:43.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.491+0000 7f4a0b7fe700 1 -- 172.21.15.59:0/635111160 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f49fc03f8b0 con 0x7f4a14133e30 2023-09-30T22:35:43.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.491+0000 7f4a189ea700 1 -- 172.21.15.59:0/635111160 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1411fa30 con 0x7f4a14133e30 2023-09-30T22:35:43.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.496+0000 7f4a0b7fe700 1 -- 172.21.15.59:0/635111160 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49fc013720 con 0x7f4a14133e30 2023-09-30T22:35:43.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.665+0000 7f6466d10700 1 -- 172.21.15.59:0/3159062737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6460072980 con 0x7f646009d630 2023-09-30T22:35:43.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.666+0000 7f645d7fa700 1 -- 172.21.15.59:0/3159062737 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6454029020 con 0x7f646009d630 2023-09-30T22:35:43.667 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:43.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.668+0000 7f6466d10700 1 -- 172.21.15.59:0/3159062737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f646009d630 msgr2=0x7f6460133980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.668+0000 7f6466d10700 1 --2- 172.21.15.59:0/3159062737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f646009d630 0x7f6460133980 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f6454009c40 tx=0x7f6454004750 comp rx=0 tx=0).stop 2023-09-30T22:35:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.668+0000 7f6466d10700 1 -- 172.21.15.59:0/3159062737 shutdown_connections 2023-09-30T22:35:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.668+0000 7f6466d10700 1 --2- 172.21.15.59:0/3159062737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6460138d80 0x7f6460134400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.668+0000 7f6466d10700 1 --2- 172.21.15.59:0/3159062737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f646009d630 0x7f6460133980 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.668+0000 7f6466d10700 1 --2- 172.21.15.59:0/3159062737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64600a0a30 0x7f6460133ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.668+0000 7f6466d10700 1 -- 172.21.15.59:0/3159062737 >> 172.21.15.59:0/3159062737 conn(0x7f64600a3050 msgr2=0x7f646009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.668+0000 7f6466d10700 1 -- 172.21.15.59:0/3159062737 shutdown_connections 2023-09-30T22:35:43.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.668+0000 7f6466d10700 1 -- 172.21.15.59:0/3159062737 wait complete. 2023-09-30T22:35:43.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:43.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.703+0000 7f4a189ea700 1 -- 172.21.15.59:0/635111160 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4a14074ea0 con 0x7f4a14133e30 2023-09-30T22:35:43.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.703+0000 7f4a0b7fe700 1 -- 172.21.15.59:0/635111160 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49fc01bd00 con 0x7f4a14133e30 2023-09-30T22:35:43.705 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:43.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.705+0000 7f4a189ea700 1 -- 172.21.15.59:0/635111160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a14133e30 msgr2=0x7f4a1409c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.705+0000 7f4a189ea700 1 --2- 172.21.15.59:0/635111160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a14133e30 0x7f4a1409c9c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00ec10 tx=0x7f49fc00ef20 comp rx=0 tx=0).stop 2023-09-30T22:35:43.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.705+0000 7f4a189ea700 1 -- 172.21.15.59:0/635111160 shutdown_connections 2023-09-30T22:35:43.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.705+0000 7f4a189ea700 1 --2- 172.21.15.59:0/635111160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a14134260 0x7f4a1409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.705+0000 7f4a189ea700 1 --2- 172.21.15.59:0/635111160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a14133420 0x7f4a1409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.705+0000 7f4a189ea700 1 --2- 172.21.15.59:0/635111160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a14133e30 0x7f4a1409c9c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.705+0000 7f4a189ea700 1 -- 172.21.15.59:0/635111160 >> 172.21.15.59:0/635111160 conn(0x7f4a140a4210 msgr2=0x7f4a1412de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:43.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.705+0000 7f4a189ea700 1 -- 172.21.15.59:0/635111160 shutdown_connections 2023-09-30T22:35:43.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.705+0000 7f4a189ea700 1 -- 172.21.15.59:0/635111160 wait complete. 2023-09-30T22:35:43.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:43.746 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:43.787 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:43.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.900+0000 7fb0522f2700 1 Processor -- start 2023-09-30T22:35:43.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.900+0000 7fb0522f2700 1 -- start start 2023-09-30T22:35:43.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.900+0000 7fb0522f2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb04c0a0a30 0x7fb04c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.900+0000 7fb0522f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04c0a1340 0x7fb04c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.900+0000 7fb0522f2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c09edd0 con 0x7fb04c133fa0 2023-09-30T22:35:43.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.900+0000 7fb0522f2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c09e1f0 con 0x7fb04c0a0a30 2023-09-30T22:35:43.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.900+0000 7fb0522f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c09dc50 con 0x7fb04c0a1340 2023-09-30T22:35:43.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.901+0000 7fb04b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04c0a1340 0x7fb04c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.901+0000 7fb04bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb04c0a0a30 0x7fb04c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.901+0000 7fb04b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04c0a1340 0x7fb04c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45112/0 (socket says 172.21.15.59:45112) 2023-09-30T22:35:43.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.901+0000 7fb04b7fe700 1 -- 172.21.15.59:0/1268352275 learned_addr learned my addr 172.21.15.59:0/1268352275 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:43.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.901+0000 7fb04bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb04c0a0a30 0x7fb04c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55666/0 (socket says 172.21.15.59:55666) 2023-09-30T22:35:43.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.901+0000 7fb04bfff700 1 -- 172.21.15.59:0/1268352275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04c0a1340 msgr2=0x7fb04c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:43.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.901+0000 7fb04bfff700 1 --2- 172.21.15.59:0/1268352275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04c0a1340 0x7fb04c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.901+0000 7fb04bfff700 1 -- 172.21.15.59:0/1268352275 >> v1:172.21.15.59:6789/0 conn(0x7fb04c133fa0 legacy=0x7fb04c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.901+0000 7fb04bfff700 1 -- 172.21.15.59:0/1268352275 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c0a1fe0 con 0x7fb04c0a0a30 2023-09-30T22:35:43.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.901+0000 7fb04b7fe700 1 --2- 172.21.15.59:0/1268352275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04c0a1340 0x7fb04c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:43.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.901+0000 7fb04bfff700 1 --2- 172.21.15.59:0/1268352275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04c0a0a30 0x7fb04c0a0e00 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009840 tx=0x7fb03c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8671903df9a5c15f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:43.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.901+0000 7fb04affd700 1 -- 172.21.15.59:0/1268352275 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c011830 con 0x7fb04c0a0a30 2023-09-30T22:35:43.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.901+0000 7fb04affd700 1 -- 172.21.15.59:0/1268352275 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c011990 con 0x7fb04c0a0a30 2023-09-30T22:35:43.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.901+0000 7fb04affd700 1 -- 172.21.15.59:0/1268352275 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c011d20 con 0x7fb04c0a0a30 2023-09-30T22:35:43.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.902+0000 7fb0522f2700 1 -- 172.21.15.59:0/1268352275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04c0a0a30 msgr2=0x7fb04c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.902+0000 7fb0522f2700 1 --2- 172.21.15.59:0/1268352275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04c0a0a30 0x7fb04c0a0e00 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009840 tx=0x7fb03c009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:43.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.902+0000 7fb0522f2700 1 -- 172.21.15.59:0/1268352275 shutdown_connections 2023-09-30T22:35:43.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.902+0000 7fb0522f2700 1 --2- 172.21.15.59:0/1268352275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04c0a0a30 0x7fb04c0a0e00 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.902+0000 7fb0522f2700 1 --2- 172.21.15.59:0/1268352275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04c0a1340 0x7fb04c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.902+0000 7fb0522f2700 1 -- 172.21.15.59:0/1268352275 >> 172.21.15.59:0/1268352275 conn(0x7fb04c0a6550 msgr2=0x7fb04c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:43.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.902+0000 7fb0522f2700 1 -- 172.21.15.59:0/1268352275 shutdown_connections 2023-09-30T22:35:43.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.902+0000 7fb0522f2700 1 -- 172.21.15.59:0/1268352275 wait complete. 2023-09-30T22:35:43.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.903+0000 7fb0522f2700 1 Processor -- start 2023-09-30T22:35:43.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.903+0000 7fb0522f2700 1 -- start start 2023-09-30T22:35:43.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb0522f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb04c0a0a30 0x7fb04c11e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb0522f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04c0a1340 0x7fb04c11ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb0522f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04c133fa0 0x7fb04c11f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb0522f2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c121f50 con 0x7fb04c0a1340 2023-09-30T22:35:43.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb0522f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c120430 con 0x7fb04c0a0a30 2023-09-30T22:35:43.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb0522f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c0a37e0 con 0x7fb04c133fa0 2023-09-30T22:35:43.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb04b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04c0a1340 0x7fb04c11ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb05088f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04c133fa0 0x7fb04c11f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb04b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04c0a1340 0x7fb04c11ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55682/0 (socket says 172.21.15.59:55682) 2023-09-30T22:35:43.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb04b7fe700 1 -- 172.21.15.59:0/1829924873 learned_addr learned my addr 172.21.15.59:0/1829924873 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:43.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb04bfff700 1 --2- 172.21.15.59:0/1829924873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb04c0a0a30 0x7fb04c11e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb05088f700 1 -- 172.21.15.59:0/1829924873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb04c0a0a30 msgr2=0x7fb04c11e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb05088f700 1 --2- 172.21.15.59:0/1829924873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb04c0a0a30 0x7fb04c11e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb05088f700 1 -- 172.21.15.59:0/1829924873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04c0a1340 msgr2=0x7fb04c11ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb05088f700 1 --2- 172.21.15.59:0/1829924873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04c0a1340 0x7fb04c11ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb05088f700 1 -- 172.21.15.59:0/1829924873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb040009550 con 0x7fb04c133fa0 2023-09-30T22:35:43.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.904+0000 7fb04b7fe700 1 --2- 172.21.15.59:0/1829924873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04c0a1340 0x7fb04c11ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:43.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.905+0000 7fb05088f700 1 --2- 172.21.15.59:0/1829924873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04c133fa0 0x7fb04c11f220 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb04400cbc0 tx=0x7fb04400ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:43.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.905+0000 7fb048ff9700 1 -- 172.21.15.59:0/1829924873 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044003c00 con 0x7fb04c133fa0 2023-09-30T22:35:43.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.905+0000 7fb048ff9700 1 -- 172.21.15.59:0/1829924873 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb044003d60 con 0x7fb04c133fa0 2023-09-30T22:35:43.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.905+0000 7fb0522f2700 1 -- 172.21.15.59:0/1829924873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03c0094a0 con 0x7fb04c133fa0 2023-09-30T22:35:43.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.905+0000 7fb048ff9700 1 -- 172.21.15.59:0/1829924873 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04400aa40 con 0x7fb04c133fa0 2023-09-30T22:35:43.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.905+0000 7fb0522f2700 1 -- 172.21.15.59:0/1829924873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c0a0270 con 0x7fb04c133fa0 2023-09-30T22:35:43.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.906+0000 7fb048ff9700 1 -- 172.21.15.59:0/1829924873 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb04400aba0 con 0x7fb04c133fa0 2023-09-30T22:35:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.906+0000 7fb048ff9700 1 -- 172.21.15.59:0/1829924873 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb04403f570 con 0x7fb04c133fa0 2023-09-30T22:35:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.906+0000 7fb0522f2700 1 -- 172.21.15.59:0/1829924873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04c122a80 con 0x7fb04c133fa0 2023-09-30T22:35:43.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.911+0000 7fb048ff9700 1 -- 172.21.15.59:0/1829924873 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb044012420 con 0x7fb04c133fa0 2023-09-30T22:35:43.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.942+0000 7f80b4556700 1 Processor -- start 2023-09-30T22:35:43.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.942+0000 7f80b4556700 1 -- start start 2023-09-30T22:35:43.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.943+0000 7f80b4556700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80ac09e930 0x7f80ac09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.943+0000 7f80b4556700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80ac09f240 0x7f80ac1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.943+0000 7f80b4556700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ac070940 con 0x7f80ac09f650 2023-09-30T22:35:43.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.943+0000 7f80b4556700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ac06fd60 con 0x7f80ac09f240 2023-09-30T22:35:43.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.943+0000 7f80b4556700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac06fa80 con 0x7f80ac09e930 2023-09-30T22:35:43.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.943+0000 7f80b22f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80ac09e930 0x7f80ac09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.943+0000 7f80b1af1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80ac09f240 0x7f80ac1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.943+0000 7f80b22f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80ac09e930 0x7f80ac09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58848/0 (socket says 172.21.15.59:58848) 2023-09-30T22:35:43.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.943+0000 7f80b1af1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80ac09f240 0x7f80ac1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55698/0 (socket says 172.21.15.59:55698) 2023-09-30T22:35:43.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.943+0000 7f80b22f2700 1 -- 172.21.15.59:0/3370727273 learned_addr learned my addr 172.21.15.59:0/3370727273 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:43.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.943+0000 7f80b1af1700 1 -- 172.21.15.59:0/3370727273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80ac09e930 msgr2=0x7f80ac09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:43.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.943+0000 7f80b1af1700 1 --2- 172.21.15.59:0/3370727273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80ac09e930 0x7f80ac09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.943+0000 7f80b1af1700 1 -- 172.21.15.59:0/3370727273 >> v1:172.21.15.59:6789/0 conn(0x7f80ac09f650 legacy=0x7f80ac131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.943+0000 7f80b1af1700 1 -- 172.21.15.59:0/3370727273 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac09fb60 con 0x7f80ac09f240 2023-09-30T22:35:43.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.943+0000 7f80b22f2700 1 --2- 172.21.15.59:0/3370727273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80ac09e930 0x7f80ac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:43.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.944+0000 7f80b1af1700 1 --2- 172.21.15.59:0/3370727273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80ac09f240 0x7f80ac1317f0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f809c009840 tx=0x7f809c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21155590faf45280 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:43.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.944+0000 7f80b12f0700 1 -- 172.21.15.59:0/3370727273 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c011830 con 0x7f80ac09f240 2023-09-30T22:35:43.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.944+0000 7f80b12f0700 1 -- 172.21.15.59:0/3370727273 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c011990 con 0x7f80ac09f240 2023-09-30T22:35:43.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.944+0000 7f80b12f0700 1 -- 172.21.15.59:0/3370727273 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c011d20 con 0x7f80ac09f240 2023-09-30T22:35:43.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.944+0000 7f80b4556700 1 -- 172.21.15.59:0/3370727273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80ac09f240 msgr2=0x7f80ac1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.944+0000 7f80b4556700 1 --2- 172.21.15.59:0/3370727273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80ac09f240 0x7f80ac1317f0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f809c009840 tx=0x7f809c009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:43.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.944+0000 7f80b4556700 1 -- 172.21.15.59:0/3370727273 shutdown_connections 2023-09-30T22:35:43.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.944+0000 7f80b4556700 1 --2- 172.21.15.59:0/3370727273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80ac09e930 0x7f80ac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.944+0000 7f80b4556700 1 --2- 172.21.15.59:0/3370727273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80ac09f240 0x7f80ac1317f0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.944+0000 7f80b4556700 1 -- 172.21.15.59:0/3370727273 >> 172.21.15.59:0/3370727273 conn(0x7f80ac0a4210 msgr2=0x7f80ac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:43.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.945+0000 7f80b4556700 1 -- 172.21.15.59:0/3370727273 shutdown_connections 2023-09-30T22:35:43.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.945+0000 7f80b4556700 1 -- 172.21.15.59:0/3370727273 wait complete. 2023-09-30T22:35:43.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.946+0000 7f80b4556700 1 Processor -- start 2023-09-30T22:35:43.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.946+0000 7f80b4556700 1 -- start start 2023-09-30T22:35:43.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.946+0000 7f80b4556700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80ac09e930 0x7f80ac06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.946+0000 7f80b4556700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80ac09f240 0x7f80ac06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.946+0000 7f80b4556700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80ac09f650 0x7f80ac06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.946+0000 7f80b4556700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac1a99e0 con 0x7f80ac09f650 2023-09-30T22:35:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.946+0000 7f80b4556700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0a3560 con 0x7f80ac09e930 2023-09-30T22:35:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.946+0000 7f80b4556700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac071d20 con 0x7f80ac09f240 2023-09-30T22:35:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.946+0000 7f80b22f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80ac09e930 0x7f80ac06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.946+0000 7f80b22f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80ac09e930 0x7f80ac06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58854/0 (socket says 172.21.15.59:58854) 2023-09-30T22:35:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.946+0000 7f80b22f2700 1 -- 172.21.15.59:0/2822987890 learned_addr learned my addr 172.21.15.59:0/2822987890 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.946+0000 7f80b1af1700 1 --2- 172.21.15.59:0/2822987890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80ac09f240 0x7f80ac06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.946+0000 7f80b2af3700 1 --2- 172.21.15.59:0/2822987890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80ac09f650 0x7f80ac06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.947+0000 7f80b22f2700 1 -- 172.21.15.59:0/2822987890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80ac09f240 msgr2=0x7f80ac06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.947+0000 7f80b22f2700 1 --2- 172.21.15.59:0/2822987890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80ac09f240 0x7f80ac06bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.947+0000 7f80b22f2700 1 -- 172.21.15.59:0/2822987890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80ac09f650 msgr2=0x7f80ac06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.947+0000 7f80b22f2700 1 --2- 172.21.15.59:0/2822987890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80ac09f650 0x7f80ac06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.947+0000 7f80b22f2700 1 -- 172.21.15.59:0/2822987890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a8009b30 con 0x7f80ac09e930 2023-09-30T22:35:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.947+0000 7f80b22f2700 1 --2- 172.21.15.59:0/2822987890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80ac09e930 0x7f80ac06b880 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f80a800efc0 tx=0x7f80a800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.947+0000 7f80a2ffd700 1 -- 172.21.15.59:0/2822987890 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a800cb00 con 0x7f80ac09e930 2023-09-30T22:35:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.947+0000 7f80a2ffd700 1 -- 172.21.15.59:0/2822987890 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a800f040 con 0x7f80ac09e930 2023-09-30T22:35:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.947+0000 7f80b4556700 1 -- 172.21.15.59:0/2822987890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809c0094a0 con 0x7f80ac09e930 2023-09-30T22:35:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.947+0000 7f80a2ffd700 1 -- 172.21.15.59:0/2822987890 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a800ce80 con 0x7f80ac09e930 2023-09-30T22:35:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.947+0000 7f80b4556700 1 -- 172.21.15.59:0/2822987890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ac0a0190 con 0x7f80ac09e930 2023-09-30T22:35:43.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.948+0000 7f80a2ffd700 1 -- 172.21.15.59:0/2822987890 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80a8014480 con 0x7f80ac09e930 2023-09-30T22:35:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.948+0000 7f80a2ffd700 1 -- 172.21.15.59:0/2822987890 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f80a803fdc0 con 0x7f80ac09e930 2023-09-30T22:35:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.948+0000 7f80b4556700 1 -- 172.21.15.59:0/2822987890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ac0a3180 con 0x7f80ac09e930 2023-09-30T22:35:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:43.953+0000 7f80a2ffd700 1 -- 172.21.15.59:0/2822987890 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80a8012910 con 0x7f80ac09e930 2023-09-30T22:35:44.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.119+0000 7fb0522f2700 1 -- 172.21.15.59:0/1829924873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb04c074ea0 con 0x7fb04c133fa0 2023-09-30T22:35:44.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.119+0000 7fb048ff9700 1 -- 172.21.15.59:0/1829924873 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb04401a360 con 0x7fb04c133fa0 2023-09-30T22:35:44.121 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:44.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.122+0000 7fb0522f2700 1 -- 172.21.15.59:0/1829924873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04c133fa0 msgr2=0x7fb04c11f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:44.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.122+0000 7fb0522f2700 1 --2- 172.21.15.59:0/1829924873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04c133fa0 0x7fb04c11f220 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb04400cbc0 tx=0x7fb04400ced0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.122+0000 7fb0522f2700 1 -- 172.21.15.59:0/1829924873 shutdown_connections 2023-09-30T22:35:44.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.122+0000 7fb0522f2700 1 --2- 172.21.15.59:0/1829924873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04c133fa0 0x7fb04c11f220 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.122+0000 7fb0522f2700 1 --2- 172.21.15.59:0/1829924873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb04c0a0a30 0x7fb04c11e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.122+0000 7fb0522f2700 1 --2- 172.21.15.59:0/1829924873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04c0a1340 0x7fb04c11ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.122+0000 7fb0522f2700 1 -- 172.21.15.59:0/1829924873 >> 172.21.15.59:0/1829924873 conn(0x7fb04c0a6550 msgr2=0x7fb04c1b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:44.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.122+0000 7fb0522f2700 1 -- 172.21.15.59:0/1829924873 shutdown_connections 2023-09-30T22:35:44.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.122+0000 7fb0522f2700 1 -- 172.21.15.59:0/1829924873 wait complete. 2023-09-30T22:35:44.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.158+0000 7f80b4556700 1 -- 172.21.15.59:0/2822987890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f80ac074ea0 con 0x7f80ac09e930 2023-09-30T22:35:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.158+0000 7f80a2ffd700 1 -- 172.21.15.59:0/2822987890 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f80a802c090 con 0x7f80ac09e930 2023-09-30T22:35:44.159 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.160+0000 7f80b4556700 1 -- 172.21.15.59:0/2822987890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80ac09e930 msgr2=0x7f80ac06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.160+0000 7f80b4556700 1 --2- 172.21.15.59:0/2822987890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80ac09e930 0x7f80ac06b880 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f80a800efc0 tx=0x7f80a800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.160+0000 7f80b4556700 1 -- 172.21.15.59:0/2822987890 shutdown_connections 2023-09-30T22:35:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.160+0000 7f80b4556700 1 --2- 172.21.15.59:0/2822987890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80ac09f650 0x7f80ac06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.160+0000 7f80b4556700 1 --2- 172.21.15.59:0/2822987890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80ac09e930 0x7f80ac06b880 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.160+0000 7f80b4556700 1 --2- 172.21.15.59:0/2822987890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80ac09f240 0x7f80ac06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.160+0000 7f80b4556700 1 -- 172.21.15.59:0/2822987890 >> 172.21.15.59:0/2822987890 conn(0x7f80ac0a4210 msgr2=0x7f80ac1b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.160+0000 7f80b4556700 1 -- 172.21.15.59:0/2822987890 shutdown_connections 2023-09-30T22:35:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.161+0000 7f80b4556700 1 -- 172.21.15.59:0/2822987890 wait complete. 2023-09-30T22:35:44.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:44.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:44.721 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:44.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.831+0000 7f158da83700 1 Processor -- start 2023-09-30T22:35:44.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.831+0000 7f158da83700 1 -- start start 2023-09-30T22:35:44.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.831+0000 7f158da83700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f158809d630 0x7f15880a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:44.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.831+0000 7f158da83700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1588138d80 0x7f158813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.831+0000 7f158da83700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15880a2a70 con 0x7f15880a0a30 2023-09-30T22:35:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.831+0000 7f158da83700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15880a01d0 con 0x7f158809d630 2023-09-30T22:35:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.831+0000 7f158da83700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f158809e2b0 con 0x7f1588138d80 2023-09-30T22:35:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.831+0000 7f1586ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f158809d630 0x7f15880a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.831+0000 7f1587fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1588138d80 0x7f158813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.831+0000 7f1586ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f158809d630 0x7f15880a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51932/0 (socket says 172.21.15.59:51932) 2023-09-30T22:35:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.831+0000 7f1587fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1588138d80 0x7f158813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45022/0 (socket says 172.21.15.59:45022) 2023-09-30T22:35:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.831+0000 7f1586ffd700 1 -- 172.21.15.59:0/3921853157 learned_addr learned my addr 172.21.15.59:0/3921853157 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.832+0000 7f1587fff700 1 -- 172.21.15.59:0/3921853157 >> v2:172.21.15.59:3300/0 conn(0x7f158809d630 msgr2=0x7f15880a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.832+0000 7f1587fff700 1 --2- 172.21.15.59:0/3921853157 >> v2:172.21.15.59:3300/0 conn(0x7f158809d630 0x7f15880a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.832+0000 7f1587fff700 1 -- 172.21.15.59:0/3921853157 >> v1:172.21.15.59:6789/0 conn(0x7f15880a0a30 legacy=0x7f15880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.832+0000 7f1587fff700 1 -- 172.21.15.59:0/3921853157 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158809dc50 con 0x7f1588138d80 2023-09-30T22:35:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.832+0000 7f1586ffd700 1 --2- 172.21.15.59:0/3921853157 >> v2:172.21.15.59:3300/0 conn(0x7f158809d630 0x7f15880a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.832+0000 7f1587fff700 1 --2- 172.21.15.59:0/3921853157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1588138d80 0x7f158813b160 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1580009d90 tx=0x7f158000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20ea32dd5bba6ff1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.832+0000 7f15867fc700 1 -- 172.21.15.59:0/3921853157 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158000e070 con 0x7f1588138d80 2023-09-30T22:35:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.832+0000 7f15867fc700 1 -- 172.21.15.59:0/3921853157 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158000bb20 con 0x7f1588138d80 2023-09-30T22:35:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.832+0000 7f15867fc700 1 -- 172.21.15.59:0/3921853157 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580012430 con 0x7f1588138d80 2023-09-30T22:35:44.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.833+0000 7f158da83700 1 -- 172.21.15.59:0/3921853157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1588138d80 msgr2=0x7f158813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:44.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.833+0000 7f158da83700 1 --2- 172.21.15.59:0/3921853157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1588138d80 0x7f158813b160 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1580009d90 tx=0x7f158000b330 comp rx=0 tx=0).stop 2023-09-30T22:35:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.833+0000 7f158da83700 1 -- 172.21.15.59:0/3921853157 shutdown_connections 2023-09-30T22:35:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.833+0000 7f158da83700 1 --2- 172.21.15.59:0/3921853157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1588138d80 0x7f158813b160 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.833+0000 7f158da83700 1 --2- 172.21.15.59:0/3921853157 >> v2:172.21.15.59:3300/0 conn(0x7f158809d630 0x7f15880a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.833+0000 7f158da83700 1 -- 172.21.15.59:0/3921853157 >> 172.21.15.59:0/3921853157 conn(0x7f15880a3050 msgr2=0x7f15880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.833+0000 7f158da83700 1 -- 172.21.15.59:0/3921853157 shutdown_connections 2023-09-30T22:35:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.833+0000 7f158da83700 1 -- 172.21.15.59:0/3921853157 wait complete. 2023-09-30T22:35:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.834+0000 7f158da83700 1 Processor -- start 2023-09-30T22:35:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.834+0000 7f158da83700 1 -- start start 2023-09-30T22:35:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f158da83700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f158809d630 0x7f1588120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f158da83700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15880a0a30 0x7f1588120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f158da83700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1588138d80 0x7f15881210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:44.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f158da83700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1588124140 con 0x7f1588138d80 2023-09-30T22:35:44.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f158da83700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15881234f0 con 0x7f158809d630 2023-09-30T22:35:44.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f158da83700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1588138b20 con 0x7f15880a0a30 2023-09-30T22:35:44.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f1587fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1588138d80 0x7f15881210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:44.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f1586ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15880a0a30 0x7f1588120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:44.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f15877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f158809d630 0x7f1588120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:44.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f1587fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1588138d80 0x7f15881210a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51936/0 (socket says 172.21.15.59:51936) 2023-09-30T22:35:44.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f1587fff700 1 -- 172.21.15.59:0/2639964716 learned_addr learned my addr 172.21.15.59:0/2639964716 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:44.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f1586ffd700 1 --2- 172.21.15.59:0/2639964716 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15880a0a30 0x7f1588120b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45038/0 (socket says 172.21.15.59:45038) 2023-09-30T22:35:44.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f1587fff700 1 -- 172.21.15.59:0/2639964716 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15880a0a30 msgr2=0x7f1588120b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:44.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f1587fff700 1 --2- 172.21.15.59:0/2639964716 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15880a0a30 0x7f1588120b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f1587fff700 1 -- 172.21.15.59:0/2639964716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f158809d630 msgr2=0x7f1588120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f1587fff700 1 --2- 172.21.15.59:0/2639964716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f158809d630 0x7f1588120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f1587fff700 1 -- 172.21.15.59:0/2639964716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c009550 con 0x7f1588138d80 2023-09-30T22:35:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f1586ffd700 1 --2- 172.21.15.59:0/2639964716 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15880a0a30 0x7f1588120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.835+0000 7f1587fff700 1 --2- 172.21.15.59:0/2639964716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1588138d80 0x7f15881210a0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f1580014040 tx=0x7f1580004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.836+0000 7f156ffff700 1 -- 172.21.15.59:0/2639964716 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580012430 con 0x7f1588138d80 2023-09-30T22:35:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.836+0000 7f156ffff700 1 -- 172.21.15.59:0/2639964716 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1580020070 con 0x7f1588138d80 2023-09-30T22:35:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.836+0000 7f158da83700 1 -- 172.21.15.59:0/2639964716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1580009a70 con 0x7f1588138d80 2023-09-30T22:35:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.836+0000 7f156ffff700 1 -- 172.21.15.59:0/2639964716 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580003ea0 con 0x7f1588138d80 2023-09-30T22:35:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.836+0000 7f158da83700 1 -- 172.21.15.59:0/2639964716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15880a0460 con 0x7f1588138d80 2023-09-30T22:35:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.837+0000 7f156ffff700 1 -- 172.21.15.59:0/2639964716 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1580004280 con 0x7f1588138d80 2023-09-30T22:35:44.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.837+0000 7f156ffff700 1 -- 172.21.15.59:0/2639964716 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1580022070 con 0x7f1588138d80 2023-09-30T22:35:44.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.837+0000 7f158da83700 1 -- 172.21.15.59:0/2639964716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15880747f0 con 0x7f1588138d80 2023-09-30T22:35:44.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.842+0000 7f156ffff700 1 -- 172.21.15.59:0/2639964716 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1580012e60 con 0x7f1588138d80 2023-09-30T22:35:44.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.870+0000 7feda2c1a700 1 Processor -- start 2023-09-30T22:35:44.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.870+0000 7feda2c1a700 1 -- start start 2023-09-30T22:35:44.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.871+0000 7feda2c1a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09e930 0x7fed9c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:44.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.871+0000 7feda2c1a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed9c09f650 0x7fed9c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:44.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.871+0000 7feda2c1a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9c070940 con 0x7fed9c09f240 2023-09-30T22:35:44.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.871+0000 7feda2c1a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c06fd60 con 0x7fed9c09f650 2023-09-30T22:35:44.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.871+0000 7feda2c1a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c06fa80 con 0x7fed9c09e930 2023-09-30T22:35:44.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.871+0000 7feda11b7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed9c09f650 0x7fed9c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:44.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.871+0000 7fed9bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fed9c09f240 0x7fed9c1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54092/0 (socket says 172.21.15.59:54092) 2023-09-30T22:35:44.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.871+0000 7fed9bfff700 1 -- 172.21.15.59:0/425625521 learned_addr learned my addr 172.21.15.59:0/425625521 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:44.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.871+0000 7feda09b6700 1 --2- 172.21.15.59:0/425625521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09e930 0x7fed9c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:44.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.871+0000 7feda11b7700 1 -- 172.21.15.59:0/425625521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09e930 msgr2=0x7fed9c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:44.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.871+0000 7feda11b7700 1 --2- 172.21.15.59:0/425625521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09e930 0x7fed9c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.871+0000 7feda11b7700 1 -- 172.21.15.59:0/425625521 >> v1:172.21.15.59:6789/0 conn(0x7fed9c09f240 legacy=0x7fed9c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:44.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.871+0000 7feda11b7700 1 -- 172.21.15.59:0/425625521 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c09fb60 con 0x7fed9c09f650 2023-09-30T22:35:44.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.871+0000 7feda09b6700 1 --2- 172.21.15.59:0/425625521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09e930 0x7fed9c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:44.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.871+0000 7fed9b7fe700 1 -- 172.21.15.59:0/425625521 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192490915 0 0) 0x7fed9c070940 con 0x7fed9c09f240 2023-09-30T22:35:44.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.872+0000 7feda11b7700 1 --2- 172.21.15.59:0/425625521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c09f650 0x7fed9c131f00 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fed94009d90 tx=0x7fed9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2c2441af53e6c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:44.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.872+0000 7fed9b7fe700 1 -- 172.21.15.59:0/425625521 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400e070 con 0x7fed9c09f650 2023-09-30T22:35:44.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.872+0000 7fed9b7fe700 1 -- 172.21.15.59:0/425625521 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400bb20 con 0x7fed9c09f650 2023-09-30T22:35:44.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.872+0000 7fed9b7fe700 1 -- 172.21.15.59:0/425625521 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94012430 con 0x7fed9c09f650 2023-09-30T22:35:44.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.872+0000 7feda2c1a700 1 -- 172.21.15.59:0/425625521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c09f650 msgr2=0x7fed9c131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:44.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.872+0000 7feda2c1a700 1 --2- 172.21.15.59:0/425625521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c09f650 0x7fed9c131f00 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fed94009d90 tx=0x7fed9400b330 comp rx=0 tx=0).stop 2023-09-30T22:35:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.873+0000 7feda2c1a700 1 -- 172.21.15.59:0/425625521 shutdown_connections 2023-09-30T22:35:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.873+0000 7feda2c1a700 1 --2- 172.21.15.59:0/425625521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c09f650 0x7fed9c131f00 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.873+0000 7feda2c1a700 1 --2- 172.21.15.59:0/425625521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09e930 0x7fed9c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.873+0000 7feda2c1a700 1 -- 172.21.15.59:0/425625521 >> 172.21.15.59:0/425625521 conn(0x7fed9c0a4210 msgr2=0x7fed9c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.873+0000 7feda2c1a700 1 -- 172.21.15.59:0/425625521 shutdown_connections 2023-09-30T22:35:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.873+0000 7feda2c1a700 1 -- 172.21.15.59:0/425625521 wait complete. 2023-09-30T22:35:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.874+0000 7feda2c1a700 1 Processor -- start 2023-09-30T22:35:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.874+0000 7feda2c1a700 1 -- start start 2023-09-30T22:35:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda2c1a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c09e930 0x7fed9c1a3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda2c1a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c09f240 0x7fed9c1a3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:44.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda2c1a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09f650 0x7fed9c1c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:44.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda2c1a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c1a5f30 con 0x7fed9c09e930 2023-09-30T22:35:44.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda2c1a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c1a6110 con 0x7fed9c09f240 2023-09-30T22:35:44.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda2c1a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c1b6f80 con 0x7fed9c09f650 2023-09-30T22:35:44.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda11b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09f650 0x7fed9c1c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:44.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda09b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c09e930 0x7fed9c1a3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:44.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda09b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c09e930 0x7fed9c1a3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51958/0 (socket says 172.21.15.59:51958) 2023-09-30T22:35:44.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda11b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09f650 0x7fed9c1c5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45054/0 (socket says 172.21.15.59:45054) 2023-09-30T22:35:44.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda09b6700 1 -- 172.21.15.59:0/277424787 learned_addr learned my addr 172.21.15.59:0/277424787 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:44.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda09b6700 1 -- 172.21.15.59:0/277424787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09f650 msgr2=0x7fed9c1c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:44.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda09b6700 1 --2- 172.21.15.59:0/277424787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09f650 0x7fed9c1c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda09b6700 1 -- 172.21.15.59:0/277424787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c09f240 msgr2=0x7fed9c1a3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:44.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda09b6700 1 --2- 172.21.15.59:0/277424787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c09f240 0x7fed9c1a3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:44.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda09b6700 1 -- 172.21.15.59:0/277424787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed900094a0 con 0x7fed9c09e930 2023-09-30T22:35:44.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.875+0000 7feda11b7700 1 --2- 172.21.15.59:0/277424787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09f650 0x7fed9c1c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:44.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.876+0000 7feda09b6700 1 --2- 172.21.15.59:0/277424787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c09e930 0x7fed9c1a3050 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fed9000ec10 tx=0x7fed9000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:44.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.876+0000 7fed997fa700 1 -- 172.21.15.59:0/277424787 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9000c910 con 0x7fed9c09e930 2023-09-30T22:35:44.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.876+0000 7fed997fa700 1 -- 172.21.15.59:0/277424787 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9000ca70 con 0x7fed9c09e930 2023-09-30T22:35:44.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.876+0000 7feda2c1a700 1 -- 172.21.15.59:0/277424787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed94009a70 con 0x7fed9c09e930 2023-09-30T22:35:44.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.876+0000 7fed997fa700 1 -- 172.21.15.59:0/277424787 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9000cde0 con 0x7fed9c09e930 2023-09-30T22:35:44.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.876+0000 7feda2c1a700 1 -- 172.21.15.59:0/277424787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c0a0190 con 0x7fed9c09e930 2023-09-30T22:35:44.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.877+0000 7fed997fa700 1 -- 172.21.15.59:0/277424787 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed90013470 con 0x7fed9c09e930 2023-09-30T22:35:44.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.877+0000 7feda2c1a700 1 -- 172.21.15.59:0/277424787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c074ea0 con 0x7fed9c09e930 2023-09-30T22:35:44.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.877+0000 7fed997fa700 1 -- 172.21.15.59:0/277424787 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fed9003fd10 con 0x7fed9c09e930 2023-09-30T22:35:44.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:44.883+0000 7fed997fa700 1 -- 172.21.15.59:0/277424787 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed9001b3b0 con 0x7fed9c09e930 2023-09-30T22:35:45.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.050+0000 7f158da83700 1 -- 172.21.15.59:0/2639964716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1588124930 con 0x7f1588138d80 2023-09-30T22:35:45.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.051+0000 7f156ffff700 1 -- 172.21.15.59:0/2639964716 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f158002c020 con 0x7f1588138d80 2023-09-30T22:35:45.052 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:45.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.053+0000 7f158da83700 1 -- 172.21.15.59:0/2639964716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1588138d80 msgr2=0x7f15881210a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:45.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.053+0000 7f158da83700 1 --2- 172.21.15.59:0/2639964716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1588138d80 0x7f15881210a0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f1580014040 tx=0x7f1580004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.053+0000 7f158da83700 1 -- 172.21.15.59:0/2639964716 shutdown_connections 2023-09-30T22:35:45.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.053+0000 7f158da83700 1 --2- 172.21.15.59:0/2639964716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1588138d80 0x7f15881210a0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.053+0000 7f158da83700 1 --2- 172.21.15.59:0/2639964716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f158809d630 0x7f1588120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.053+0000 7f158da83700 1 --2- 172.21.15.59:0/2639964716 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15880a0a30 0x7f1588120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.053+0000 7f158da83700 1 -- 172.21.15.59:0/2639964716 >> 172.21.15.59:0/2639964716 conn(0x7f15880a3050 msgr2=0x7f1588139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:45.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.053+0000 7f158da83700 1 -- 172.21.15.59:0/2639964716 shutdown_connections 2023-09-30T22:35:45.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.053+0000 7f158da83700 1 -- 172.21.15.59:0/2639964716 wait complete. 2023-09-30T22:35:45.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:45.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.088+0000 7feda2c1a700 1 -- 172.21.15.59:0/277424787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fed9c1a49f0 con 0x7fed9c09e930 2023-09-30T22:35:45.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.089+0000 7fed997fa700 1 -- 172.21.15.59:0/277424787 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed90021070 con 0x7fed9c09e930 2023-09-30T22:35:45.090 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:45.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.092+0000 7feda2c1a700 1 -- 172.21.15.59:0/277424787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c09e930 msgr2=0x7fed9c1a3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:45.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.092+0000 7feda2c1a700 1 --2- 172.21.15.59:0/277424787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c09e930 0x7fed9c1a3050 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fed9000ec10 tx=0x7fed9000ef20 comp rx=0 tx=0).stop 2023-09-30T22:35:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.092+0000 7feda2c1a700 1 -- 172.21.15.59:0/277424787 shutdown_connections 2023-09-30T22:35:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.092+0000 7feda2c1a700 1 --2- 172.21.15.59:0/277424787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09f650 0x7fed9c1c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.092+0000 7feda2c1a700 1 --2- 172.21.15.59:0/277424787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c09e930 0x7fed9c1a3050 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.092+0000 7feda2c1a700 1 --2- 172.21.15.59:0/277424787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c09f240 0x7fed9c1a3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.092+0000 7feda2c1a700 1 -- 172.21.15.59:0/277424787 >> 172.21.15.59:0/277424787 conn(0x7fed9c0a4210 msgr2=0x7fed9c0a2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.092+0000 7feda2c1a700 1 -- 172.21.15.59:0/277424787 shutdown_connections 2023-09-30T22:35:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.092+0000 7feda2c1a700 1 -- 172.21.15.59:0/277424787 wait complete. 2023-09-30T22:35:45.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:45.138 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:45.176 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:45.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.289+0000 7f1e7f6d4700 1 Processor -- start 2023-09-30T22:35:45.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.289+0000 7f1e7f6d4700 1 -- start start 2023-09-30T22:35:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.290+0000 7f1e7f6d4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e780a0a30 0x7f1e780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.290+0000 7f1e7f6d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e7809d630 0x7f1e780a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.290+0000 7f1e7f6d4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e780a2a70 con 0x7f1e78133930 2023-09-30T22:35:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.290+0000 7f1e7f6d4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e780a01d0 con 0x7f1e780a0a30 2023-09-30T22:35:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.290+0000 7f1e7f6d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7809e2b0 con 0x7f1e7809d630 2023-09-30T22:35:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.290+0000 7f1e7cc6f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e7809d630 0x7f1e780a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.290+0000 7f1e7d470700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e780a0a30 0x7f1e780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.290+0000 7f1e7cc6f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e7809d630 0x7f1e780a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40288/0 (socket says 172.21.15.59:40288) 2023-09-30T22:35:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.290+0000 7f1e7cc6f700 1 -- 172.21.15.59:0/3999935964 learned_addr learned my addr 172.21.15.59:0/3999935964 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.290+0000 7f1e7d470700 1 --2- 172.21.15.59:0/3999935964 >> v2:172.21.15.59:3300/0 conn(0x7f1e780a0a30 0x7f1e780a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51960/0 (socket says 172.21.15.59:51960) 2023-09-30T22:35:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.291+0000 7f1e7cc6f700 1 -- 172.21.15.59:0/3999935964 >> v2:172.21.15.59:3300/0 conn(0x7f1e780a0a30 msgr2=0x7f1e780a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.291+0000 7f1e7cc6f700 1 --2- 172.21.15.59:0/3999935964 >> v2:172.21.15.59:3300/0 conn(0x7f1e780a0a30 0x7f1e780a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.291+0000 7f1e7cc6f700 1 -- 172.21.15.59:0/3999935964 >> v1:172.21.15.59:6789/0 conn(0x7f1e78133930 legacy=0x7f1e78133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.291+0000 7f1e7cc6f700 1 -- 172.21.15.59:0/3999935964 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7809dc50 con 0x7f1e7809d630 2023-09-30T22:35:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.291+0000 7f1e7d470700 1 --2- 172.21.15.59:0/3999935964 >> v2:172.21.15.59:3300/0 conn(0x7f1e780a0a30 0x7f1e780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.291+0000 7f1e7cc6f700 1 --2- 172.21.15.59:0/3999935964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e7809d630 0x7f1e780a1340 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0098f0 tx=0x7f1e6c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45e2157be459b67a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.291+0000 7f1e77fff700 1 -- 172.21.15.59:0/3999935964 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c011830 con 0x7f1e7809d630 2023-09-30T22:35:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.291+0000 7f1e77fff700 1 -- 172.21.15.59:0/3999935964 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c011990 con 0x7f1e7809d630 2023-09-30T22:35:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.291+0000 7f1e77fff700 1 -- 172.21.15.59:0/3999935964 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c011d20 con 0x7f1e7809d630 2023-09-30T22:35:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.292+0000 7f1e7f6d4700 1 -- 172.21.15.59:0/3999935964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e7809d630 msgr2=0x7f1e780a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.292+0000 7f1e7f6d4700 1 --2- 172.21.15.59:0/3999935964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e7809d630 0x7f1e780a1340 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0098f0 tx=0x7f1e6c009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.292+0000 7f1e7f6d4700 1 -- 172.21.15.59:0/3999935964 shutdown_connections 2023-09-30T22:35:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.292+0000 7f1e7f6d4700 1 --2- 172.21.15.59:0/3999935964 >> v2:172.21.15.59:3300/0 conn(0x7f1e780a0a30 0x7f1e780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.292+0000 7f1e7f6d4700 1 --2- 172.21.15.59:0/3999935964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e7809d630 0x7f1e780a1340 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.292+0000 7f1e7f6d4700 1 -- 172.21.15.59:0/3999935964 >> 172.21.15.59:0/3999935964 conn(0x7f1e780a3050 msgr2=0x7f1e780a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.292+0000 7f1e7f6d4700 1 -- 172.21.15.59:0/3999935964 shutdown_connections 2023-09-30T22:35:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.292+0000 7f1e7f6d4700 1 -- 172.21.15.59:0/3999935964 wait complete. 2023-09-30T22:35:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.293+0000 7f1e7f6d4700 1 Processor -- start 2023-09-30T22:35:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.293+0000 7f1e7f6d4700 1 -- start start 2023-09-30T22:35:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7f6d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e7809d630 0x7f1e78121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7f6d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e780a0a30 0x7f1e78121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7f6d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e78133930 0x7f1e78121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7f6d4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e781225b0 con 0x7f1e780a0a30 2023-09-30T22:35:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7f6d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e78124bd0 con 0x7f1e78133930 2023-09-30T22:35:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7f6d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e78124630 con 0x7f1e7809d630 2023-09-30T22:35:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7cc6f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e780a0a30 0x7f1e78121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7dc71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e78133930 0x7f1e78121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7cc6f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e780a0a30 0x7f1e78121640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51966/0 (socket says 172.21.15.59:51966) 2023-09-30T22:35:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7dc71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e78133930 0x7f1e78121b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40298/0 (socket says 172.21.15.59:40298) 2023-09-30T22:35:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7cc6f700 1 -- 172.21.15.59:0/1177859508 learned_addr learned my addr 172.21.15.59:0/1177859508 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7d470700 1 --2- 172.21.15.59:0/1177859508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e7809d630 0x7f1e78121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7cc6f700 1 -- 172.21.15.59:0/1177859508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e7809d630 msgr2=0x7f1e78121100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7cc6f700 1 --2- 172.21.15.59:0/1177859508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e7809d630 0x7f1e78121100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7cc6f700 1 -- 172.21.15.59:0/1177859508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e78133930 msgr2=0x7f1e78121b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7cc6f700 1 --2- 172.21.15.59:0/1177859508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e78133930 0x7f1e78121b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7cc6f700 1 -- 172.21.15.59:0/1177859508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e68009a70 con 0x7f1e780a0a30 2023-09-30T22:35:45.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7dc71700 1 --2- 172.21.15.59:0/1177859508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e78133930 0x7f1e78121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:45.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e7cc6f700 1 --2- 172.21.15.59:0/1177859508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e780a0a30 0x7f1e78121640 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c000c00 tx=0x7f1e6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:45.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e75ffb700 1 -- 172.21.15.59:0/1177859508 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0036a0 con 0x7f1e780a0a30 2023-09-30T22:35:45.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.294+0000 7f1e75ffb700 1 -- 172.21.15.59:0/1177859508 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c003800 con 0x7f1e780a0a30 2023-09-30T22:35:45.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.295+0000 7f1e7f6d4700 1 -- 172.21.15.59:0/1177859508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c009550 con 0x7f1e780a0a30 2023-09-30T22:35:45.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.295+0000 7f1e75ffb700 1 -- 172.21.15.59:0/1177859508 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c003bb0 con 0x7f1e780a0a30 2023-09-30T22:35:45.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.295+0000 7f1e7f6d4700 1 -- 172.21.15.59:0/1177859508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e780a0410 con 0x7f1e780a0a30 2023-09-30T22:35:45.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.296+0000 7f1e75ffb700 1 -- 172.21.15.59:0/1177859508 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e6c021070 con 0x7f1e780a0a30 2023-09-30T22:35:45.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.296+0000 7f1e75ffb700 1 -- 172.21.15.59:0/1177859508 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e6c040be0 con 0x7f1e780a0a30 2023-09-30T22:35:45.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.296+0000 7f1e7f6d4700 1 -- 172.21.15.59:0/1177859508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7811df60 con 0x7f1e780a0a30 2023-09-30T22:35:45.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.301+0000 7f1e75ffb700 1 -- 172.21.15.59:0/1177859508 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e6c024470 con 0x7f1e780a0a30 2023-09-30T22:35:45.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.331+0000 7f04bb4c3700 1 Processor -- start 2023-09-30T22:35:45.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.331+0000 7f04bb4c3700 1 -- start start 2023-09-30T22:35:45.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04bb4c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04b40a0a30 0x7f04b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:45.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04bb4c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b4134170 0x7f04b413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:45.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04bb4c3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b409edd0 con 0x7f04b40a1340 2023-09-30T22:35:45.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04bb4c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b409e1f0 con 0x7f04b4134170 2023-09-30T22:35:45.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04bb4c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04b409dc50 con 0x7f04b40a0a30 2023-09-30T22:35:45.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04b925f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04b40a0a30 0x7f04b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:45.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04b9a60700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b4134170 0x7f04b413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:45.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04b925f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04b40a0a30 0x7f04b40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45070/0 (socket says 172.21.15.59:45070) 2023-09-30T22:35:45.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04b925f700 1 -- 172.21.15.59:0/28262444 learned_addr learned my addr 172.21.15.59:0/28262444 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:45.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04b8a5e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f04b40a1340 0x7f04b4133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54104/0 (socket says 172.21.15.59:54104) 2023-09-30T22:35:45.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04b9a60700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b4134170 0x7f04b413bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40312/0 (socket says 172.21.15.59:40312) 2023-09-30T22:35:45.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04abfff700 1 -- 172.21.15.59:0/28262444 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696056203 0 0) 0x7f04b409edd0 con 0x7f04b40a1340 2023-09-30T22:35:45.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04b925f700 1 -- 172.21.15.59:0/28262444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b4134170 msgr2=0x7f04b413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:45.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04b925f700 1 --2- 172.21.15.59:0/28262444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b4134170 0x7f04b413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04b925f700 1 -- 172.21.15.59:0/28262444 >> v1:172.21.15.59:6789/0 conn(0x7f04b40a1340 legacy=0x7f04b4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:45.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04b925f700 1 -- 172.21.15.59:0/28262444 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b40a1fe0 con 0x7f04b40a0a30 2023-09-30T22:35:45.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04b9a60700 1 --2- 172.21.15.59:0/28262444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b4134170 0x7f04b413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:45.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.332+0000 7f04b925f700 1 --2- 172.21.15.59:0/28262444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04b40a0a30 0x7f04b40a0e00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009920 tx=0x7f04b0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c36bff12c0c6ee7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:45.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.333+0000 7f04abfff700 1 -- 172.21.15.59:0/28262444 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0011830 con 0x7f04b40a0a30 2023-09-30T22:35:45.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.333+0000 7f04abfff700 1 -- 172.21.15.59:0/28262444 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b0011990 con 0x7f04b40a0a30 2023-09-30T22:35:45.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.333+0000 7f04abfff700 1 -- 172.21.15.59:0/28262444 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0011d20 con 0x7f04b40a0a30 2023-09-30T22:35:45.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.333+0000 7f04bb4c3700 1 -- 172.21.15.59:0/28262444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04b40a0a30 msgr2=0x7f04b40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:45.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.333+0000 7f04bb4c3700 1 --2- 172.21.15.59:0/28262444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04b40a0a30 0x7f04b40a0e00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009920 tx=0x7f04b0009c30 comp rx=0 tx=0).stop 2023-09-30T22:35:45.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.333+0000 7f04bb4c3700 1 -- 172.21.15.59:0/28262444 shutdown_connections 2023-09-30T22:35:45.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.333+0000 7f04bb4c3700 1 --2- 172.21.15.59:0/28262444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04b40a0a30 0x7f04b40a0e00 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.333+0000 7f04bb4c3700 1 --2- 172.21.15.59:0/28262444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b4134170 0x7f04b413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.333+0000 7f04bb4c3700 1 -- 172.21.15.59:0/28262444 >> 172.21.15.59:0/28262444 conn(0x7f04b40a6550 msgr2=0x7f04b40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.333+0000 7f04bb4c3700 1 -- 172.21.15.59:0/28262444 shutdown_connections 2023-09-30T22:35:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.333+0000 7f04bb4c3700 1 -- 172.21.15.59:0/28262444 wait complete. 2023-09-30T22:35:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.334+0000 7f04bb4c3700 1 Processor -- start 2023-09-30T22:35:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.334+0000 7f04bb4c3700 1 -- start start 2023-09-30T22:35:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04bb4c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b40a0a30 0x7f04b41233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04bb4c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04b40a1340 0x7f04b4123930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04bb4c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b4134170 0x7f04b41c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04bb4c3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b4123060 con 0x7f04b40a0a30 2023-09-30T22:35:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04bb4c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b4125ee0 con 0x7f04b4134170 2023-09-30T22:35:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04bb4c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04b41261a0 con 0x7f04b40a1340 2023-09-30T22:35:45.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04b925f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b40a0a30 0x7f04b41233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:45.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04b9a60700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b4134170 0x7f04b41c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:45.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04b8a5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04b40a1340 0x7f04b4123930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:45.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04b925f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b40a0a30 0x7f04b41233f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51978/0 (socket says 172.21.15.59:51978) 2023-09-30T22:35:45.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04b925f700 1 -- 172.21.15.59:0/749544300 learned_addr learned my addr 172.21.15.59:0/749544300 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:45.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04b8a5e700 1 -- 172.21.15.59:0/749544300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b4134170 msgr2=0x7f04b41c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:45.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04b8a5e700 1 --2- 172.21.15.59:0/749544300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b4134170 0x7f04b41c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04b8a5e700 1 -- 172.21.15.59:0/749544300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b40a0a30 msgr2=0x7f04b41233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:45.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04b8a5e700 1 --2- 172.21.15.59:0/749544300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b40a0a30 0x7f04b41233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04b8a5e700 1 -- 172.21.15.59:0/749544300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac009a70 con 0x7f04b40a1340 2023-09-30T22:35:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04b925f700 1 --2- 172.21.15.59:0/749544300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b40a0a30 0x7f04b41233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.335+0000 7f04b9a60700 1 --2- 172.21.15.59:0/749544300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b4134170 0x7f04b41c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.336+0000 7f04b8a5e700 1 --2- 172.21.15.59:0/749544300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04b40a1340 0x7f04b4123930 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f04a400c4a0 tx=0x7f04a400c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.336+0000 7f04a9ffb700 1 -- 172.21.15.59:0/749544300 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a4004c80 con 0x7f04b40a1340 2023-09-30T22:35:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.336+0000 7f04a9ffb700 1 -- 172.21.15.59:0/749544300 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a4004de0 con 0x7f04b40a1340 2023-09-30T22:35:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.336+0000 7f04a9ffb700 1 -- 172.21.15.59:0/749544300 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a4007310 con 0x7f04b40a1340 2023-09-30T22:35:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.336+0000 7f04bb4c3700 1 -- 172.21.15.59:0/749544300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b0009550 con 0x7f04b40a1340 2023-09-30T22:35:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.336+0000 7f04bb4c3700 1 -- 172.21.15.59:0/749544300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b40a25e0 con 0x7f04b40a1340 2023-09-30T22:35:45.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.337+0000 7f04a9ffb700 1 -- 172.21.15.59:0/749544300 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04a4007470 con 0x7f04b40a1340 2023-09-30T22:35:45.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.337+0000 7f04a9ffb700 1 -- 172.21.15.59:0/749544300 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f04a403f1c0 con 0x7f04b40a1340 2023-09-30T22:35:45.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.337+0000 7f04bb4c3700 1 -- 172.21.15.59:0/749544300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b409e7e0 con 0x7f04b40a1340 2023-09-30T22:35:45.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.342+0000 7f04a9ffb700 1 -- 172.21.15.59:0/749544300 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04a4007720 con 0x7f04b40a1340 2023-09-30T22:35:45.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.510+0000 7f1e7f6d4700 1 -- 172.21.15.59:0/1177859508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1e78123f80 con 0x7f1e780a0a30 2023-09-30T22:35:45.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.510+0000 7f1e75ffb700 1 -- 172.21.15.59:0/1177859508 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e6c019ba0 con 0x7f1e780a0a30 2023-09-30T22:35:45.512 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:45.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.513+0000 7f1e7f6d4700 1 -- 172.21.15.59:0/1177859508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e780a0a30 msgr2=0x7f1e78121640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:45.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.513+0000 7f1e7f6d4700 1 --2- 172.21.15.59:0/1177859508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e780a0a30 0x7f1e78121640 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c000c00 tx=0x7f1e6c004750 comp rx=0 tx=0).stop 2023-09-30T22:35:45.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.513+0000 7f1e7f6d4700 1 -- 172.21.15.59:0/1177859508 shutdown_connections 2023-09-30T22:35:45.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.513+0000 7f1e7f6d4700 1 --2- 172.21.15.59:0/1177859508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e7809d630 0x7f1e78121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.513+0000 7f1e7f6d4700 1 --2- 172.21.15.59:0/1177859508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e78133930 0x7f1e78121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.513+0000 7f1e7f6d4700 1 --2- 172.21.15.59:0/1177859508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e780a0a30 0x7f1e78121640 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.513+0000 7f1e7f6d4700 1 -- 172.21.15.59:0/1177859508 >> 172.21.15.59:0/1177859508 conn(0x7f1e780a3050 msgr2=0x7f1e78133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:45.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.513+0000 7f1e7f6d4700 1 -- 172.21.15.59:0/1177859508 shutdown_connections 2023-09-30T22:35:45.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.513+0000 7f1e7f6d4700 1 -- 172.21.15.59:0/1177859508 wait complete. 2023-09-30T22:35:45.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:45.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.551+0000 7f04bb4c3700 1 -- 172.21.15.59:0/749544300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f04b4074ea0 con 0x7f04b40a1340 2023-09-30T22:35:45.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.552+0000 7f04a9ffb700 1 -- 172.21.15.59:0/749544300 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04a401ce50 con 0x7f04b40a1340 2023-09-30T22:35:45.555 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.554+0000 7f04bb4c3700 1 -- 172.21.15.59:0/749544300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04b40a1340 msgr2=0x7f04b4123930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.554+0000 7f04bb4c3700 1 --2- 172.21.15.59:0/749544300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04b40a1340 0x7f04b4123930 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f04a400c4a0 tx=0x7f04a400c7b0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.554+0000 7f04bb4c3700 1 -- 172.21.15.59:0/749544300 shutdown_connections 2023-09-30T22:35:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.554+0000 7f04bb4c3700 1 --2- 172.21.15.59:0/749544300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b4134170 0x7f04b41c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.554+0000 7f04bb4c3700 1 --2- 172.21.15.59:0/749544300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b40a0a30 0x7f04b41233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.554+0000 7f04bb4c3700 1 --2- 172.21.15.59:0/749544300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04b40a1340 0x7f04b4123930 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.554+0000 7f04bb4c3700 1 -- 172.21.15.59:0/749544300 >> 172.21.15.59:0/749544300 conn(0x7f04b40a6550 msgr2=0x7f04b409edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.554+0000 7f04bb4c3700 1 -- 172.21.15.59:0/749544300 shutdown_connections 2023-09-30T22:35:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:45.554+0000 7f04bb4c3700 1 -- 172.21.15.59:0/749544300 wait complete. 2023-09-30T22:35:45.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:46.070 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:46.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.220+0000 7ff8c2108700 1 Processor -- start 2023-09-30T22:35:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.220+0000 7ff8c2108700 1 -- start start 2023-09-30T22:35:46.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.220+0000 7ff8c2108700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8bc0a0a30 0x7ff8bc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.220+0000 7ff8c2108700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8bc09d630 0x7ff8bc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.221+0000 7ff8c2108700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8bc0a2a70 con 0x7ff8bc133930 2023-09-30T22:35:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.221+0000 7ff8c2108700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8bc0a01d0 con 0x7ff8bc0a0a30 2023-09-30T22:35:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.221+0000 7ff8c2108700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc09e2b0 con 0x7ff8bc09d630 2023-09-30T22:35:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.221+0000 7ff8bb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8bc0a0a30 0x7ff8bc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.221+0000 7ff8baffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8bc09d630 0x7ff8bc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.221+0000 7ff8baffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8bc09d630 0x7ff8bc0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40330/0 (socket says 172.21.15.59:40330) 2023-09-30T22:35:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.221+0000 7ff8bb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8bc0a0a30 0x7ff8bc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51986/0 (socket says 172.21.15.59:51986) 2023-09-30T22:35:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.221+0000 7ff8baffd700 1 -- 172.21.15.59:0/2329531261 learned_addr learned my addr 172.21.15.59:0/2329531261 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.221+0000 7ff8bb7fe700 1 -- 172.21.15.59:0/2329531261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8bc09d630 msgr2=0x7ff8bc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.221+0000 7ff8bb7fe700 1 --2- 172.21.15.59:0/2329531261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8bc09d630 0x7ff8bc0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.221+0000 7ff8bb7fe700 1 -- 172.21.15.59:0/2329531261 >> v1:172.21.15.59:6789/0 conn(0x7ff8bc133930 legacy=0x7ff8bc133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.221+0000 7ff8bb7fe700 1 -- 172.21.15.59:0/2329531261 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc09dc50 con 0x7ff8bc0a0a30 2023-09-30T22:35:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.221+0000 7ff8baffd700 1 --2- 172.21.15.59:0/2329531261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8bc09d630 0x7ff8bc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.221+0000 7ff8bb7fe700 1 --2- 172.21.15.59:0/2329531261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc0a0a30 0x7ff8bc0a0e00 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009840 tx=0x7ff8b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f252cc85ea9b7b6f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.221+0000 7ff8ba7fc700 1 -- 172.21.15.59:0/2329531261 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4011830 con 0x7ff8bc0a0a30 2023-09-30T22:35:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.222+0000 7ff8ba7fc700 1 -- 172.21.15.59:0/2329531261 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b4011990 con 0x7ff8bc0a0a30 2023-09-30T22:35:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.222+0000 7ff8ba7fc700 1 -- 172.21.15.59:0/2329531261 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4011d20 con 0x7ff8bc0a0a30 2023-09-30T22:35:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.222+0000 7ff8c2108700 1 -- 172.21.15.59:0/2329531261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc0a0a30 msgr2=0x7ff8bc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.222+0000 7ff8c2108700 1 --2- 172.21.15.59:0/2329531261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc0a0a30 0x7ff8bc0a0e00 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009840 tx=0x7ff8b4009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.222+0000 7ff8c2108700 1 -- 172.21.15.59:0/2329531261 shutdown_connections 2023-09-30T22:35:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.222+0000 7ff8c2108700 1 --2- 172.21.15.59:0/2329531261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc0a0a30 0x7ff8bc0a0e00 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.222+0000 7ff8c2108700 1 --2- 172.21.15.59:0/2329531261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8bc09d630 0x7ff8bc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.222+0000 7ff8c2108700 1 -- 172.21.15.59:0/2329531261 >> 172.21.15.59:0/2329531261 conn(0x7ff8bc0a3050 msgr2=0x7ff8bc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:46.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.222+0000 7ff8c2108700 1 -- 172.21.15.59:0/2329531261 shutdown_connections 2023-09-30T22:35:46.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.222+0000 7ff8c2108700 1 -- 172.21.15.59:0/2329531261 wait complete. 2023-09-30T22:35:46.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.223+0000 7ff8c2108700 1 Processor -- start 2023-09-30T22:35:46.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.224+0000 7ff8c2108700 1 -- start start 2023-09-30T22:35:46.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.224+0000 7ff8c2108700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8bc09d630 0x7ff8bc1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.224+0000 7ff8c2108700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8bc0a0a30 0x7ff8bc1c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.224+0000 7ff8c2108700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc133930 0x7ff8bc1c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.224+0000 7ff8c2108700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc11eea0 con 0x7ff8bc133930 2023-09-30T22:35:46.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.224+0000 7ff8c2108700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc1207f0 con 0x7ff8bc09d630 2023-09-30T22:35:46.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.224+0000 7ff8c2108700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc120600 con 0x7ff8bc0a0a30 2023-09-30T22:35:46.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.224+0000 7ff8bb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8bc09d630 0x7ff8bc1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.224+0000 7ff8bb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8bc09d630 0x7ff8bc1c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40344/0 (socket says 172.21.15.59:40344) 2023-09-30T22:35:46.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.224+0000 7ff8bb7fe700 1 -- 172.21.15.59:0/1641732089 learned_addr learned my addr 172.21.15.59:0/1641732089 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:46.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.224+0000 7ff8bbfff700 1 --2- 172.21.15.59:0/1641732089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc133930 0x7ff8bc1c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.224+0000 7ff8bb7fe700 1 -- 172.21.15.59:0/1641732089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8bc0a0a30 msgr2=0x7ff8bc1c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.225+0000 7ff8bb7fe700 1 --2- 172.21.15.59:0/1641732089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8bc0a0a30 0x7ff8bc1c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.225+0000 7ff8bb7fe700 1 -- 172.21.15.59:0/1641732089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc133930 msgr2=0x7ff8bc1c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.225+0000 7ff8bb7fe700 1 --2- 172.21.15.59:0/1641732089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc133930 0x7ff8bc1c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.225+0000 7ff8bb7fe700 1 -- 172.21.15.59:0/1641732089 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a4009550 con 0x7ff8bc09d630 2023-09-30T22:35:46.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.225+0000 7ff8bbfff700 1 --2- 172.21.15.59:0/1641732089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc133930 0x7ff8bc1c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:46.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.225+0000 7ff8bb7fe700 1 --2- 172.21.15.59:0/1641732089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8bc09d630 0x7ff8bc1c8120 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009fd0 tx=0x7ff8b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:46.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.225+0000 7ff8b3fff700 1 -- 172.21.15.59:0/1641732089 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b40036a0 con 0x7ff8bc09d630 2023-09-30T22:35:46.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.225+0000 7ff8b3fff700 1 -- 172.21.15.59:0/1641732089 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b401f070 con 0x7ff8bc09d630 2023-09-30T22:35:46.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.225+0000 7ff8b3fff700 1 -- 172.21.15.59:0/1641732089 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4003a60 con 0x7ff8bc09d630 2023-09-30T22:35:46.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.225+0000 7ff8c2108700 1 -- 172.21.15.59:0/1641732089 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b40094a0 con 0x7ff8bc09d630 2023-09-30T22:35:46.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.225+0000 7ff8c2108700 1 -- 172.21.15.59:0/1641732089 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8bc122230 con 0x7ff8bc09d630 2023-09-30T22:35:46.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.226+0000 7ff8c2108700 1 -- 172.21.15.59:0/1641732089 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8bc122420 con 0x7ff8bc09d630 2023-09-30T22:35:46.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.226+0000 7ff8b3fff700 1 -- 172.21.15.59:0/1641732089 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff8b4003bc0 con 0x7ff8bc09d630 2023-09-30T22:35:46.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.226+0000 7ff8b3fff700 1 -- 172.21.15.59:0/1641732089 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff8b4021070 con 0x7ff8bc09d630 2023-09-30T22:35:46.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.231+0000 7ff8b3fff700 1 -- 172.21.15.59:0/1641732089 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff8b402fd70 con 0x7ff8bc09d630 2023-09-30T22:35:46.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.262+0000 7f5ef907f700 1 Processor -- start 2023-09-30T22:35:46.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.262+0000 7f5ef907f700 1 -- start start 2023-09-30T22:35:46.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.263+0000 7f5ef907f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ef40a1510 0x7f5ef4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.263+0000 7f5ef907f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ef4139250 0x7f5ef413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.263+0000 7f5ef907f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef409edd0 con 0x7f5ef40a0a30 2023-09-30T22:35:46.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.263+0000 7f5ef907f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef40a18e0 con 0x7f5ef40a1510 2023-09-30T22:35:46.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.263+0000 7f5ef907f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef409e1f0 con 0x7f5ef4139250 2023-09-30T22:35:46.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.263+0000 7f5ef359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ef4139250 0x7f5ef413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.263+0000 7f5ef259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ef40a1510 0x7f5ef4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.263+0000 7f5ef359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ef4139250 0x7f5ef413b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40358/0 (socket says 172.21.15.59:40358) 2023-09-30T22:35:46.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.263+0000 7f5ef359e700 1 -- 172.21.15.59:0/2687354977 learned_addr learned my addr 172.21.15.59:0/2687354977 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:46.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.264+0000 7f5ef259c700 1 -- 172.21.15.59:0/2687354977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ef4139250 msgr2=0x7f5ef413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:46.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.264+0000 7f5ef259c700 1 --2- 172.21.15.59:0/2687354977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ef4139250 0x7f5ef413b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.264+0000 7f5ef259c700 1 -- 172.21.15.59:0/2687354977 >> v1:172.21.15.59:6789/0 conn(0x7f5ef40a0a30 legacy=0x7f5ef40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.264+0000 7f5ef1d9b700 1 -- 172.21.15.59:0/2687354977 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433400712 0 0) 0x7f5ef409edd0 con 0x7f5ef40a0a30 2023-09-30T22:35:46.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.264+0000 7f5ef259c700 1 -- 172.21.15.59:0/2687354977 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef409dc50 con 0x7f5ef40a1510 2023-09-30T22:35:46.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.264+0000 7f5ef359e700 1 --2- 172.21.15.59:0/2687354977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ef4139250 0x7f5ef413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:46.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.264+0000 7f5ef259c700 1 --2- 172.21.15.59:0/2687354977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ef40a1510 0x7f5ef4138d10 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009840 tx=0x7f5ee8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573e20aa82ae10df server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:46.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.264+0000 7f5ef1d9b700 1 -- 172.21.15.59:0/2687354977 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8011830 con 0x7f5ef40a1510 2023-09-30T22:35:46.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.264+0000 7f5ef1d9b700 1 -- 172.21.15.59:0/2687354977 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee8011990 con 0x7f5ef40a1510 2023-09-30T22:35:46.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.264+0000 7f5ef1d9b700 1 -- 172.21.15.59:0/2687354977 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8011d20 con 0x7f5ef40a1510 2023-09-30T22:35:46.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.265+0000 7f5ef907f700 1 -- 172.21.15.59:0/2687354977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ef40a1510 msgr2=0x7f5ef4138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.265+0000 7f5ef907f700 1 --2- 172.21.15.59:0/2687354977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ef40a1510 0x7f5ef4138d10 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009840 tx=0x7f5ee8009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:46.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.265+0000 7f5ef907f700 1 -- 172.21.15.59:0/2687354977 shutdown_connections 2023-09-30T22:35:46.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.265+0000 7f5ef907f700 1 --2- 172.21.15.59:0/2687354977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ef4139250 0x7f5ef413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.265+0000 7f5ef907f700 1 --2- 172.21.15.59:0/2687354977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ef40a1510 0x7f5ef4138d10 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.265+0000 7f5ef907f700 1 -- 172.21.15.59:0/2687354977 >> 172.21.15.59:0/2687354977 conn(0x7f5ef40a6550 msgr2=0x7f5ef40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:46.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.265+0000 7f5ef907f700 1 -- 172.21.15.59:0/2687354977 shutdown_connections 2023-09-30T22:35:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.265+0000 7f5ef907f700 1 -- 172.21.15.59:0/2687354977 wait complete. 2023-09-30T22:35:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.266+0000 7f5ef907f700 1 Processor -- start 2023-09-30T22:35:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.266+0000 7f5ef907f700 1 -- start start 2023-09-30T22:35:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef907f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ef40a0a30 0x7f5ef41227a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef907f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ef40a1510 0x7f5ef4122ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef907f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ef4139250 0x7f5ef4123220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef907f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef41389d0 con 0x7f5ef40a1510 2023-09-30T22:35:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef907f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef4124c80 con 0x7f5ef40a0a30 2023-09-30T22:35:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef907f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef41243b0 con 0x7f5ef4139250 2023-09-30T22:35:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ef40a1510 0x7f5ef4122ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef359e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ef4139250 0x7f5ef4123220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ef40a1510 0x7f5ef4122ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52018/0 (socket says 172.21.15.59:52018) 2023-09-30T22:35:46.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef259c700 1 -- 172.21.15.59:0/4111209868 learned_addr learned my addr 172.21.15.59:0/4111209868 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:46.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef2d9d700 1 --2- 172.21.15.59:0/4111209868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ef40a0a30 0x7f5ef41227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef259c700 1 -- 172.21.15.59:0/4111209868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ef4139250 msgr2=0x7f5ef4123220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef259c700 1 --2- 172.21.15.59:0/4111209868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ef4139250 0x7f5ef4123220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef259c700 1 -- 172.21.15.59:0/4111209868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ef40a0a30 msgr2=0x7f5ef41227a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef259c700 1 --2- 172.21.15.59:0/4111209868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ef40a0a30 0x7f5ef41227a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef259c700 1 -- 172.21.15.59:0/4111209868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec009550 con 0x7f5ef40a1510 2023-09-30T22:35:46.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef359e700 1 --2- 172.21.15.59:0/4111209868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ef4139250 0x7f5ef4123220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:46.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef2d9d700 1 --2- 172.21.15.59:0/4111209868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ef40a0a30 0x7f5ef41227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:46.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.267+0000 7f5ef259c700 1 --2- 172.21.15.59:0/4111209868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ef40a1510 0x7f5ef4122ce0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80090b0 tx=0x7f5ee8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:46.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.268+0000 7f5edb7fe700 1 -- 172.21.15.59:0/4111209868 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8004550 con 0x7f5ef40a1510 2023-09-30T22:35:46.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.268+0000 7f5edb7fe700 1 -- 172.21.15.59:0/4111209868 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee801f070 con 0x7f5ef40a1510 2023-09-30T22:35:46.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.268+0000 7f5ef907f700 1 -- 172.21.15.59:0/4111209868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee80094a0 con 0x7f5ef40a1510 2023-09-30T22:35:46.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.268+0000 7f5edb7fe700 1 -- 172.21.15.59:0/4111209868 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80038e0 con 0x7f5ef40a1510 2023-09-30T22:35:46.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.268+0000 7f5ef907f700 1 -- 172.21.15.59:0/4111209868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef40a0220 con 0x7f5ef40a1510 2023-09-30T22:35:46.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.268+0000 7f5edb7fe700 1 -- 172.21.15.59:0/4111209868 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ee8003a40 con 0x7f5ef40a1510 2023-09-30T22:35:46.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.269+0000 7f5edb7fe700 1 -- 172.21.15.59:0/4111209868 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5ee8021070 con 0x7f5ef40a1510 2023-09-30T22:35:46.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.269+0000 7f5ef907f700 1 -- 172.21.15.59:0/4111209868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef4074ea0 con 0x7f5ef40a1510 2023-09-30T22:35:46.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.274+0000 7f5edb7fe700 1 -- 172.21.15.59:0/4111209868 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ee8015080 con 0x7f5ef40a1510 2023-09-30T22:35:46.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.447+0000 7ff8c2108700 1 -- 172.21.15.59:0/1641732089 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff8bc0747f0 con 0x7ff8bc09d630 2023-09-30T22:35:46.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.447+0000 7ff8b3fff700 1 -- 172.21.15.59:0/1641732089 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff8b402b070 con 0x7ff8bc09d630 2023-09-30T22:35:46.448 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:46.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.450+0000 7ff8c2108700 1 -- 172.21.15.59:0/1641732089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8bc09d630 msgr2=0x7ff8bc1c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.450+0000 7ff8c2108700 1 --2- 172.21.15.59:0/1641732089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8bc09d630 0x7ff8bc1c8120 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009fd0 tx=0x7ff8b4004750 comp rx=0 tx=0).stop 2023-09-30T22:35:46.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.450+0000 7ff8c2108700 1 -- 172.21.15.59:0/1641732089 shutdown_connections 2023-09-30T22:35:46.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.450+0000 7ff8c2108700 1 --2- 172.21.15.59:0/1641732089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc133930 0x7ff8bc1c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.450+0000 7ff8c2108700 1 --2- 172.21.15.59:0/1641732089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8bc09d630 0x7ff8bc1c8120 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.450+0000 7ff8c2108700 1 --2- 172.21.15.59:0/1641732089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8bc0a0a30 0x7ff8bc1c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.450+0000 7ff8c2108700 1 -- 172.21.15.59:0/1641732089 >> 172.21.15.59:0/1641732089 conn(0x7ff8bc0a3050 msgr2=0x7ff8bc09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:46.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.450+0000 7ff8c2108700 1 -- 172.21.15.59:0/1641732089 shutdown_connections 2023-09-30T22:35:46.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.450+0000 7ff8c2108700 1 -- 172.21.15.59:0/1641732089 wait complete. 2023-09-30T22:35:46.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.493+0000 7f5ef907f700 1 -- 172.21.15.59:0/4111209868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5ef40a28e0 con 0x7f5ef40a1510 2023-09-30T22:35:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.493+0000 7f5edb7fe700 1 -- 172.21.15.59:0/4111209868 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ee8035090 con 0x7f5ef40a1510 2023-09-30T22:35:46.494 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.496+0000 7f5ef907f700 1 -- 172.21.15.59:0/4111209868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ef40a1510 msgr2=0x7f5ef4122ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.496+0000 7f5ef907f700 1 --2- 172.21.15.59:0/4111209868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ef40a1510 0x7f5ef4122ce0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80090b0 tx=0x7f5ee8004750 comp rx=0 tx=0).stop 2023-09-30T22:35:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.496+0000 7f5ef907f700 1 -- 172.21.15.59:0/4111209868 shutdown_connections 2023-09-30T22:35:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.496+0000 7f5ef907f700 1 --2- 172.21.15.59:0/4111209868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ef4139250 0x7f5ef4123220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.496+0000 7f5ef907f700 1 --2- 172.21.15.59:0/4111209868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ef40a0a30 0x7f5ef41227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.496+0000 7f5ef907f700 1 --2- 172.21.15.59:0/4111209868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ef40a1510 0x7f5ef4122ce0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.496+0000 7f5ef907f700 1 -- 172.21.15.59:0/4111209868 >> 172.21.15.59:0/4111209868 conn(0x7f5ef40a6550 msgr2=0x7f5ef40a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.496+0000 7f5ef907f700 1 -- 172.21.15.59:0/4111209868 shutdown_connections 2023-09-30T22:35:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.496+0000 7f5ef907f700 1 -- 172.21.15.59:0/4111209868 wait complete. 2023-09-30T22:35:46.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:46.530 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:46.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:46.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.692+0000 7f4b01dee700 1 Processor -- start 2023-09-30T22:35:46.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.693+0000 7f4b01dee700 1 -- start start 2023-09-30T22:35:46.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.693+0000 7f4b01dee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4afc09d630 0x7f4afc0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.693+0000 7f4b01dee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4afc138d80 0x7f4afc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.693+0000 7f4b01dee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4afc0a2a70 con 0x7f4afc0a0a30 2023-09-30T22:35:46.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.693+0000 7f4b01dee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc0a01d0 con 0x7f4afc09d630 2023-09-30T22:35:46.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.693+0000 7f4b01dee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc09e2b0 con 0x7f4afc138d80 2023-09-30T22:35:46.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.693+0000 7f4afbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4afc138d80 0x7f4afc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.693+0000 7f4afaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4afc09d630 0x7f4afc0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.693+0000 7f4afbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4afc138d80 0x7f4afc13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45102/0 (socket says 172.21.15.59:45102) 2023-09-30T22:35:46.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.693+0000 7f4afaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4afc09d630 0x7f4afc0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40388/0 (socket says 172.21.15.59:40388) 2023-09-30T22:35:46.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.693+0000 7f4afbfff700 1 -- 172.21.15.59:0/357806747 learned_addr learned my addr 172.21.15.59:0/357806747 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:46.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.694+0000 7f4afa7fc700 1 -- 172.21.15.59:0/357806747 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104054041 0 0) 0x7f4afc0a2a70 con 0x7f4afc0a0a30 2023-09-30T22:35:46.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.694+0000 7f4afa7fc700 1 -- 172.21.15.59:0/357806747 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ae40035b0 con 0x7f4afc0a0a30 2023-09-30T22:35:46.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.694+0000 7f4afaffd700 1 -- 172.21.15.59:0/357806747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4afc138d80 msgr2=0x7f4afc13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:46.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.694+0000 7f4afaffd700 1 --2- 172.21.15.59:0/357806747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4afc138d80 0x7f4afc13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.694+0000 7f4afaffd700 1 -- 172.21.15.59:0/357806747 >> v1:172.21.15.59:6789/0 conn(0x7f4afc0a0a30 legacy=0x7f4afc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.694+0000 7f4afaffd700 1 -- 172.21.15.59:0/357806747 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc09dc50 con 0x7f4afc09d630 2023-09-30T22:35:46.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.694+0000 7f4afbfff700 1 --2- 172.21.15.59:0/357806747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4afc138d80 0x7f4afc13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:46.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.694+0000 7f4afaffd700 1 --2- 172.21.15.59:0/357806747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4afc09d630 0x7f4afc0a1510 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009870 tx=0x7f4af0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c86b5dc4e011836 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:46.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.694+0000 7f4afa7fc700 1 -- 172.21.15.59:0/357806747 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0011830 con 0x7f4afc09d630 2023-09-30T22:35:46.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.694+0000 7f4afa7fc700 1 -- 172.21.15.59:0/357806747 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af0011990 con 0x7f4afc09d630 2023-09-30T22:35:46.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.694+0000 7f4afa7fc700 1 -- 172.21.15.59:0/357806747 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0011d20 con 0x7f4afc09d630 2023-09-30T22:35:46.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.695+0000 7f4b01dee700 1 -- 172.21.15.59:0/357806747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4afc09d630 msgr2=0x7f4afc0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.695+0000 7f4b01dee700 1 --2- 172.21.15.59:0/357806747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4afc09d630 0x7f4afc0a1510 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009870 tx=0x7f4af0009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:46.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.695+0000 7f4b01dee700 1 -- 172.21.15.59:0/357806747 shutdown_connections 2023-09-30T22:35:46.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.695+0000 7f4b01dee700 1 --2- 172.21.15.59:0/357806747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4afc138d80 0x7f4afc13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.695+0000 7f4b01dee700 1 --2- 172.21.15.59:0/357806747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4afc09d630 0x7f4afc0a1510 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.695+0000 7f4b01dee700 1 -- 172.21.15.59:0/357806747 >> 172.21.15.59:0/357806747 conn(0x7f4afc0a3050 msgr2=0x7f4afc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:46.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.695+0000 7f4b01dee700 1 -- 172.21.15.59:0/357806747 shutdown_connections 2023-09-30T22:35:46.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.695+0000 7f4b01dee700 1 -- 172.21.15.59:0/357806747 wait complete. 2023-09-30T22:35:46.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.696+0000 7f4b01dee700 1 Processor -- start 2023-09-30T22:35:46.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.697+0000 7f4b01dee700 1 -- start start 2023-09-30T22:35:46.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.697+0000 7f4b01dee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4afc09d630 0x7f4afc133930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.697+0000 7f4b01dee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4afc0a0a30 0x7f4afc133e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.697+0000 7f4b01dee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4afc138d80 0x7f4afc1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.697+0000 7f4b01dee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc0a4bb0 con 0x7f4afc09d630 2023-09-30T22:35:46.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.697+0000 7f4b01dee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc0a0410 con 0x7f4afc0a0a30 2023-09-30T22:35:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.697+0000 7f4b01dee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc1366b0 con 0x7f4afc138d80 2023-09-30T22:35:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.697+0000 7f4afbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4afc138d80 0x7f4afc1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.697+0000 7f4afaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4afc0a0a30 0x7f4afc133e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.697+0000 7f4afbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4afc138d80 0x7f4afc1343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45120/0 (socket says 172.21.15.59:45120) 2023-09-30T22:35:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.698+0000 7f4afbfff700 1 -- 172.21.15.59:0/3422783426 learned_addr learned my addr 172.21.15.59:0/3422783426 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.697+0000 7f4afb7fe700 1 --2- 172.21.15.59:0/3422783426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4afc09d630 0x7f4afc133930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.698+0000 7f4afb7fe700 1 -- 172.21.15.59:0/3422783426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4afc138d80 msgr2=0x7f4afc1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.698+0000 7f4afb7fe700 1 --2- 172.21.15.59:0/3422783426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4afc138d80 0x7f4afc1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.698+0000 7f4afb7fe700 1 -- 172.21.15.59:0/3422783426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4afc0a0a30 msgr2=0x7f4afc133e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.698+0000 7f4afb7fe700 1 --2- 172.21.15.59:0/3422783426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4afc0a0a30 0x7f4afc133e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.698+0000 7f4afb7fe700 1 -- 172.21.15.59:0/3422783426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af4009550 con 0x7f4afc09d630 2023-09-30T22:35:46.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.698+0000 7f4afbfff700 1 --2- 172.21.15.59:0/3422783426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4afc138d80 0x7f4afc1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:46.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.698+0000 7f4afaffd700 1 --2- 172.21.15.59:0/3422783426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4afc0a0a30 0x7f4afc133e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:46.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.698+0000 7f4afb7fe700 1 --2- 172.21.15.59:0/3422783426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4afc09d630 0x7f4afc133930 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00cbe0 tx=0x7f4aec00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:46.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.698+0000 7f4ae3fff700 1 -- 172.21.15.59:0/3422783426 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec003c00 con 0x7f4afc09d630 2023-09-30T22:35:46.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.698+0000 7f4ae3fff700 1 -- 172.21.15.59:0/3422783426 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec003d60 con 0x7f4afc09d630 2023-09-30T22:35:46.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.698+0000 7f4b01dee700 1 -- 172.21.15.59:0/3422783426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af00094a0 con 0x7f4afc09d630 2023-09-30T22:35:46.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.698+0000 7f4ae3fff700 1 -- 172.21.15.59:0/3422783426 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec00aae0 con 0x7f4afc09d630 2023-09-30T22:35:46.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.698+0000 7f4b01dee700 1 -- 172.21.15.59:0/3422783426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4afc1373a0 con 0x7f4afc09d630 2023-09-30T22:35:46.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.699+0000 7f4ae3fff700 1 -- 172.21.15.59:0/3422783426 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4aec00ac40 con 0x7f4afc09d630 2023-09-30T22:35:46.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.699+0000 7f4ae3fff700 1 -- 172.21.15.59:0/3422783426 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4aec03f660 con 0x7f4afc09d630 2023-09-30T22:35:46.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.699+0000 7f4b01dee700 1 -- 172.21.15.59:0/3422783426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4afc0747f0 con 0x7f4afc09d630 2023-09-30T22:35:46.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.704+0000 7f4ae3fff700 1 -- 172.21.15.59:0/3422783426 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4aec0108d0 con 0x7f4afc09d630 2023-09-30T22:35:46.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.734+0000 7f2baca1c700 1 Processor -- start 2023-09-30T22:35:46.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.734+0000 7f2baca1c700 1 -- start start 2023-09-30T22:35:46.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.734+0000 7f2baca1c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba80a0a30 0x7f2ba80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2baca1c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ba8134170 0x7f2ba813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2baca1c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba809edd0 con 0x7f2ba80a1340 2023-09-30T22:35:46.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2baca1c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba809e1f0 con 0x7f2ba8134170 2023-09-30T22:35:46.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2baca1c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba809dc50 con 0x7f2ba80a0a30 2023-09-30T22:35:46.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2ba659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba80a0a30 0x7f2ba80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2ba6d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ba8134170 0x7f2ba813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2ba659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba80a0a30 0x7f2ba80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40402/0 (socket says 172.21.15.59:40402) 2023-09-30T22:35:46.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2ba5d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2ba80a1340 0x7f2ba8133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54136/0 (socket says 172.21.15.59:54136) 2023-09-30T22:35:46.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2ba6d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ba8134170 0x7f2ba813bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52042/0 (socket says 172.21.15.59:52042) 2023-09-30T22:35:46.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2ba659c700 1 -- 172.21.15.59:0/3789361395 learned_addr learned my addr 172.21.15.59:0/3789361395 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:46.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2ba659c700 1 -- 172.21.15.59:0/3789361395 >> v2:172.21.15.59:3300/0 conn(0x7f2ba8134170 msgr2=0x7f2ba813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:46.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2ba659c700 1 --2- 172.21.15.59:0/3789361395 >> v2:172.21.15.59:3300/0 conn(0x7f2ba8134170 0x7f2ba813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2ba659c700 1 -- 172.21.15.59:0/3789361395 >> v1:172.21.15.59:6789/0 conn(0x7f2ba80a1340 legacy=0x7f2ba8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2ba659c700 1 -- 172.21.15.59:0/3789361395 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba80a1fe0 con 0x7f2ba80a0a30 2023-09-30T22:35:46.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2ba6d9d700 1 --2- 172.21.15.59:0/3789361395 >> v2:172.21.15.59:3300/0 conn(0x7f2ba8134170 0x7f2ba813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:46.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2ba659c700 1 --2- 172.21.15.59:0/3789361395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba80a0a30 0x7f2ba80a0e00 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2b980098f0 tx=0x7f2b98009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77a439219eb66b26 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:46.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.735+0000 7f2ba559a700 1 -- 172.21.15.59:0/3789361395 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98011830 con 0x7f2ba80a0a30 2023-09-30T22:35:46.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.736+0000 7f2ba559a700 1 -- 172.21.15.59:0/3789361395 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b98011990 con 0x7f2ba80a0a30 2023-09-30T22:35:46.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.736+0000 7f2ba559a700 1 -- 172.21.15.59:0/3789361395 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98011d20 con 0x7f2ba80a0a30 2023-09-30T22:35:46.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.736+0000 7f2baca1c700 1 -- 172.21.15.59:0/3789361395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba80a0a30 msgr2=0x7f2ba80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.736+0000 7f2baca1c700 1 --2- 172.21.15.59:0/3789361395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba80a0a30 0x7f2ba80a0e00 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2b980098f0 tx=0x7f2b98009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:46.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.736+0000 7f2baca1c700 1 -- 172.21.15.59:0/3789361395 shutdown_connections 2023-09-30T22:35:46.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.736+0000 7f2baca1c700 1 --2- 172.21.15.59:0/3789361395 >> v2:172.21.15.59:3300/0 conn(0x7f2ba8134170 0x7f2ba813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.736+0000 7f2baca1c700 1 --2- 172.21.15.59:0/3789361395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba80a0a30 0x7f2ba80a0e00 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.736+0000 7f2baca1c700 1 -- 172.21.15.59:0/3789361395 >> 172.21.15.59:0/3789361395 conn(0x7f2ba80a6550 msgr2=0x7f2ba80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:46.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.736+0000 7f2baca1c700 1 -- 172.21.15.59:0/3789361395 shutdown_connections 2023-09-30T22:35:46.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.736+0000 7f2baca1c700 1 -- 172.21.15.59:0/3789361395 wait complete. 2023-09-30T22:35:46.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.737+0000 7f2baca1c700 1 Processor -- start 2023-09-30T22:35:46.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.737+0000 7f2baca1c700 1 -- start start 2023-09-30T22:35:46.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.738+0000 7f2baca1c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba80a0a30 0x7f2ba8122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.738+0000 7f2baca1c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba80a1340 0x7f2ba8122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.738+0000 7f2baca1c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba8134170 0x7f2ba8123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:46.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.738+0000 7f2baca1c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba8124690 con 0x7f2ba8134170 2023-09-30T22:35:46.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.738+0000 7f2baca1c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba80a4f40 con 0x7f2ba80a1340 2023-09-30T22:35:46.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.738+0000 7f2baca1c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba8126420 con 0x7f2ba80a0a30 2023-09-30T22:35:46.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.738+0000 7f2ba6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba8134170 0x7f2ba8123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.738+0000 7f2ba5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba80a1340 0x7f2ba8122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:46.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.738+0000 7f2ba6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba8134170 0x7f2ba8123380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52054/0 (socket says 172.21.15.59:52054) 2023-09-30T22:35:46.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.738+0000 7f2ba6d9d700 1 -- 172.21.15.59:0/1632032359 learned_addr learned my addr 172.21.15.59:0/1632032359 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:46.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.738+0000 7f2ba6d9d700 1 -- 172.21.15.59:0/1632032359 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba80a0a30 msgr2=0x7f2ba8122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.738+0000 7f2ba6d9d700 1 --2- 172.21.15.59:0/1632032359 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba80a0a30 0x7f2ba8122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.738+0000 7f2ba6d9d700 1 -- 172.21.15.59:0/1632032359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba80a1340 msgr2=0x7f2ba8122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.738+0000 7f2ba6d9d700 1 --2- 172.21.15.59:0/1632032359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba80a1340 0x7f2ba8122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.738+0000 7f2ba6d9d700 1 -- 172.21.15.59:0/1632032359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba0009a70 con 0x7f2ba8134170 2023-09-30T22:35:46.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.739+0000 7f2ba6d9d700 1 --2- 172.21.15.59:0/1632032359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba8134170 0x7f2ba8123380 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000efc0 tx=0x7f2ba000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:46.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.739+0000 7f2b96ffd700 1 -- 172.21.15.59:0/1632032359 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba000cb40 con 0x7f2ba8134170 2023-09-30T22:35:46.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.739+0000 7f2b96ffd700 1 -- 172.21.15.59:0/1632032359 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba000f040 con 0x7f2ba8134170 2023-09-30T22:35:46.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.739+0000 7f2baca1c700 1 -- 172.21.15.59:0/1632032359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b98009550 con 0x7f2ba8134170 2023-09-30T22:35:46.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.739+0000 7f2b96ffd700 1 -- 172.21.15.59:0/1632032359 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0003a20 con 0x7f2ba8134170 2023-09-30T22:35:46.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.739+0000 7f2baca1c700 1 -- 172.21.15.59:0/1632032359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba8133420 con 0x7f2ba8134170 2023-09-30T22:35:46.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.740+0000 7f2b96ffd700 1 -- 172.21.15.59:0/1632032359 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ba0014480 con 0x7f2ba8134170 2023-09-30T22:35:46.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.740+0000 7f2b96ffd700 1 -- 172.21.15.59:0/1632032359 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2ba0040110 con 0x7f2ba8134170 2023-09-30T22:35:46.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.740+0000 7f2baca1c700 1 -- 172.21.15.59:0/1632032359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba80a1d40 con 0x7f2ba8134170 2023-09-30T22:35:46.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.745+0000 7f2b96ffd700 1 -- 172.21.15.59:0/1632032359 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ba0012930 con 0x7f2ba8134170 2023-09-30T22:35:46.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.912+0000 7f4b01dee700 1 -- 172.21.15.59:0/3422783426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4afc072980 con 0x7f4afc09d630 2023-09-30T22:35:46.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.912+0000 7f4ae3fff700 1 -- 172.21.15.59:0/3422783426 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4aec0102e0 con 0x7f4afc09d630 2023-09-30T22:35:46.912 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:46.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.914+0000 7f4b01dee700 1 -- 172.21.15.59:0/3422783426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4afc09d630 msgr2=0x7f4afc133930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.914+0000 7f4b01dee700 1 --2- 172.21.15.59:0/3422783426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4afc09d630 0x7f4afc133930 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00cbe0 tx=0x7f4aec00cef0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.914+0000 7f4b01dee700 1 -- 172.21.15.59:0/3422783426 shutdown_connections 2023-09-30T22:35:46.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.914+0000 7f4b01dee700 1 --2- 172.21.15.59:0/3422783426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4afc138d80 0x7f4afc1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.914+0000 7f4b01dee700 1 --2- 172.21.15.59:0/3422783426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4afc09d630 0x7f4afc133930 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.914+0000 7f4b01dee700 1 --2- 172.21.15.59:0/3422783426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4afc0a0a30 0x7f4afc133e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.914+0000 7f4b01dee700 1 -- 172.21.15.59:0/3422783426 >> 172.21.15.59:0/3422783426 conn(0x7f4afc0a3050 msgr2=0x7f4afc1397d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:46.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.915+0000 7f4b01dee700 1 -- 172.21.15.59:0/3422783426 shutdown_connections 2023-09-30T22:35:46.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.915+0000 7f4b01dee700 1 -- 172.21.15.59:0/3422783426 wait complete. 2023-09-30T22:35:46.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:46.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.951+0000 7f2baca1c700 1 -- 172.21.15.59:0/1632032359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2ba8074ea0 con 0x7f2ba8134170 2023-09-30T22:35:46.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.951+0000 7f2b96ffd700 1 -- 172.21.15.59:0/1632032359 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ba0012340 con 0x7f2ba8134170 2023-09-30T22:35:46.952 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:46.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.954+0000 7f2baca1c700 1 -- 172.21.15.59:0/1632032359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba8134170 msgr2=0x7f2ba8123380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:46.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.954+0000 7f2baca1c700 1 --2- 172.21.15.59:0/1632032359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba8134170 0x7f2ba8123380 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000efc0 tx=0x7f2ba000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.954+0000 7f2baca1c700 1 -- 172.21.15.59:0/1632032359 shutdown_connections 2023-09-30T22:35:46.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.954+0000 7f2baca1c700 1 --2- 172.21.15.59:0/1632032359 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba80a0a30 0x7f2ba8122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.954+0000 7f2baca1c700 1 --2- 172.21.15.59:0/1632032359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba8134170 0x7f2ba8123380 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.954+0000 7f2baca1c700 1 --2- 172.21.15.59:0/1632032359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba80a1340 0x7f2ba8122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:46.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.954+0000 7f2baca1c700 1 -- 172.21.15.59:0/1632032359 >> 172.21.15.59:0/1632032359 conn(0x7f2ba80a6550 msgr2=0x7f2ba809ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:46.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.954+0000 7f2baca1c700 1 -- 172.21.15.59:0/1632032359 shutdown_connections 2023-09-30T22:35:46.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:46.954+0000 7f2baca1c700 1 -- 172.21.15.59:0/1632032359 wait complete. 2023-09-30T22:35:46.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:47.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:47.511 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:47.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.613+0000 7ff0977e9700 1 Processor -- start 2023-09-30T22:35:47.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.614+0000 7ff0977e9700 1 -- start start 2023-09-30T22:35:47.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.614+0000 7ff0977e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0900a0a30 0x7ff0900a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:47.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.614+0000 7ff0977e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0900a1340 0x7ff090133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:47.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.614+0000 7ff0977e9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09009edd0 con 0x7ff090133fa0 2023-09-30T22:35:47.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.614+0000 7ff0977e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09009e1f0 con 0x7ff0900a1340 2023-09-30T22:35:47.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.614+0000 7ff0977e9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff09009dc50 con 0x7ff0900a0a30 2023-09-30T22:35:47.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff095585700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0900a0a30 0x7ff0900a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:47.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff094d84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0900a1340 0x7ff090133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:47.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff095585700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0900a0a30 0x7ff0900a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45130/0 (socket says 172.21.15.59:45130) 2023-09-30T22:35:47.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff095d86700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff090133fa0 0x7ff09013ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54142/0 (socket says 172.21.15.59:54142) 2023-09-30T22:35:47.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff095585700 1 -- 172.21.15.59:0/4083929369 learned_addr learned my addr 172.21.15.59:0/4083929369 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:47.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff094d84700 1 --2- 172.21.15.59:0/4083929369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0900a1340 0x7ff090133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40416/0 (socket says 172.21.15.59:40416) 2023-09-30T22:35:47.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff087fff700 1 -- 172.21.15.59:0/4083929369 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921024592 0 0) 0x7ff09009edd0 con 0x7ff090133fa0 2023-09-30T22:35:47.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff094d84700 1 -- 172.21.15.59:0/4083929369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0900a0a30 msgr2=0x7ff0900a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:47.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff094d84700 1 --2- 172.21.15.59:0/4083929369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0900a0a30 0x7ff0900a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff094d84700 1 -- 172.21.15.59:0/4083929369 >> v1:172.21.15.59:6789/0 conn(0x7ff090133fa0 legacy=0x7ff09013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:47.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff094d84700 1 -- 172.21.15.59:0/4083929369 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0900a1fe0 con 0x7ff0900a1340 2023-09-30T22:35:47.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff095585700 1 --2- 172.21.15.59:0/4083929369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0900a0a30 0x7ff0900a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:47.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff094d84700 1 --2- 172.21.15.59:0/4083929369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0900a1340 0x7ff090133a60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff080009870 tx=0x7ff080009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54c2c1a2a9637e03 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:47.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff087fff700 1 -- 172.21.15.59:0/4083929369 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080011830 con 0x7ff0900a1340 2023-09-30T22:35:47.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff087fff700 1 -- 172.21.15.59:0/4083929369 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff080011990 con 0x7ff0900a1340 2023-09-30T22:35:47.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.615+0000 7ff087fff700 1 -- 172.21.15.59:0/4083929369 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080011d20 con 0x7ff0900a1340 2023-09-30T22:35:47.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.616+0000 7ff0977e9700 1 -- 172.21.15.59:0/4083929369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0900a1340 msgr2=0x7ff090133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:47.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.616+0000 7ff0977e9700 1 --2- 172.21.15.59:0/4083929369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0900a1340 0x7ff090133a60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff080009870 tx=0x7ff080009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:47.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.616+0000 7ff0977e9700 1 -- 172.21.15.59:0/4083929369 shutdown_connections 2023-09-30T22:35:47.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.616+0000 7ff0977e9700 1 --2- 172.21.15.59:0/4083929369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0900a0a30 0x7ff0900a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.616+0000 7ff0977e9700 1 --2- 172.21.15.59:0/4083929369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0900a1340 0x7ff090133a60 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.616+0000 7ff0977e9700 1 -- 172.21.15.59:0/4083929369 >> 172.21.15.59:0/4083929369 conn(0x7ff0900a6550 msgr2=0x7ff0900a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:47.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.617+0000 7ff0977e9700 1 -- 172.21.15.59:0/4083929369 shutdown_connections 2023-09-30T22:35:47.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.617+0000 7ff0977e9700 1 -- 172.21.15.59:0/4083929369 wait complete. 2023-09-30T22:35:47.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.618+0000 7ff0977e9700 1 Processor -- start 2023-09-30T22:35:47.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.618+0000 7ff0977e9700 1 -- start start 2023-09-30T22:35:47.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.618+0000 7ff0977e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0900a0a30 0x7ff0901c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:47.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.618+0000 7ff0977e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0900a1340 0x7ff0901c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:47.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.618+0000 7ff0977e9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff090133fa0 0x7ff0901227b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.618+0000 7ff0977e9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff090126eb0 con 0x7ff090133fa0 2023-09-30T22:35:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.618+0000 7ff0977e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff090125d30 con 0x7ff0900a0a30 2023-09-30T22:35:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.618+0000 7ff0977e9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0901c90c0 con 0x7ff0900a1340 2023-09-30T22:35:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.618+0000 7ff094d84700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0900a1340 0x7ff0901c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.618+0000 7ff094d84700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0900a1340 0x7ff0901c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45142/0 (socket says 172.21.15.59:45142) 2023-09-30T22:35:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.618+0000 7ff095585700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0900a0a30 0x7ff0901c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.618+0000 7ff094d84700 1 -- 172.21.15.59:0/801752713 learned_addr learned my addr 172.21.15.59:0/801752713 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.618+0000 7ff095d86700 1 --2- 172.21.15.59:0/801752713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff090133fa0 0x7ff0901227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.619+0000 7ff094d84700 1 -- 172.21.15.59:0/801752713 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0900a0a30 msgr2=0x7ff0901c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.619+0000 7ff094d84700 1 --2- 172.21.15.59:0/801752713 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0900a0a30 0x7ff0901c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.619+0000 7ff094d84700 1 -- 172.21.15.59:0/801752713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff090133fa0 msgr2=0x7ff0901227b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.619+0000 7ff094d84700 1 --2- 172.21.15.59:0/801752713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff090133fa0 0x7ff0901227b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.619+0000 7ff094d84700 1 -- 172.21.15.59:0/801752713 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c009550 con 0x7ff0900a1340 2023-09-30T22:35:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.619+0000 7ff095585700 1 --2- 172.21.15.59:0/801752713 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0900a0a30 0x7ff0901c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.619+0000 7ff094d84700 1 --2- 172.21.15.59:0/801752713 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0900a1340 0x7ff0901c8b80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff0800090b0 tx=0x7ff080004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.619+0000 7ff085ffb700 1 -- 172.21.15.59:0/801752713 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080004510 con 0x7ff0900a1340 2023-09-30T22:35:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.619+0000 7ff085ffb700 1 -- 172.21.15.59:0/801752713 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08001f070 con 0x7ff0900a1340 2023-09-30T22:35:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.619+0000 7ff0977e9700 1 -- 172.21.15.59:0/801752713 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0800094a0 con 0x7ff0900a1340 2023-09-30T22:35:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.619+0000 7ff085ffb700 1 -- 172.21.15.59:0/801752713 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0800038c0 con 0x7ff0900a1340 2023-09-30T22:35:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.619+0000 7ff0977e9700 1 -- 172.21.15.59:0/801752713 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0900a25e0 con 0x7ff0900a1340 2023-09-30T22:35:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.620+0000 7ff085ffb700 1 -- 172.21.15.59:0/801752713 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff080003a20 con 0x7ff0900a1340 2023-09-30T22:35:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.620+0000 7ff0977e9700 1 -- 172.21.15.59:0/801752713 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0900a3610 con 0x7ff0900a1340 2023-09-30T22:35:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.620+0000 7ff085ffb700 1 -- 172.21.15.59:0/801752713 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff080021070 con 0x7ff0900a1340 2023-09-30T22:35:47.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.625+0000 7ff085ffb700 1 -- 172.21.15.59:0/801752713 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff080024b70 con 0x7ff0900a1340 2023-09-30T22:35:47.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.653+0000 7f778f7b6700 1 Processor -- start 2023-09-30T22:35:47.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.654+0000 7f778f7b6700 1 -- start start 2023-09-30T22:35:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.654+0000 7f778f7b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f778809d630 0x7f77880a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.654+0000 7f778f7b6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7788138d80 0x7f778813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.654+0000 7f778f7b6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77880a2a70 con 0x7f77880a0a30 2023-09-30T22:35:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.654+0000 7f778f7b6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77880a01d0 con 0x7f7788138d80 2023-09-30T22:35:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.654+0000 7f778f7b6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f778809e2b0 con 0x7f778809d630 2023-09-30T22:35:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.654+0000 7f778cd51700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f778809d630 0x7f77880a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.654+0000 7f778dd53700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7788138d80 0x7f778813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.655+0000 7f778cd51700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f778809d630 0x7f77880a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45154/0 (socket says 172.21.15.59:45154) 2023-09-30T22:35:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.655+0000 7f778dd53700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7788138d80 0x7f778813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52072/0 (socket says 172.21.15.59:52072) 2023-09-30T22:35:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.655+0000 7f778cd51700 1 -- 172.21.15.59:0/320673755 learned_addr learned my addr 172.21.15.59:0/320673755 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.655+0000 7f778d552700 1 --1- 172.21.15.59:0/320673755 >> v1:172.21.15.59:6789/0 conn(0x7f77880a0a30 0x7f77880a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54144/0 (socket says 172.21.15.59:54144) 2023-09-30T22:35:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.655+0000 7f778dd53700 1 -- 172.21.15.59:0/320673755 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f778809d630 msgr2=0x7f77880a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.655+0000 7f778dd53700 1 --2- 172.21.15.59:0/320673755 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f778809d630 0x7f77880a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.655+0000 7f778dd53700 1 -- 172.21.15.59:0/320673755 >> v1:172.21.15.59:6789/0 conn(0x7f77880a0a30 legacy=0x7f77880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.655+0000 7f7787fff700 1 -- 172.21.15.59:0/320673755 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037171922 0 0) 0x7f77880a2a70 con 0x7f77880a0a30 2023-09-30T22:35:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.655+0000 7f778dd53700 1 -- 172.21.15.59:0/320673755 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778809dc50 con 0x7f7788138d80 2023-09-30T22:35:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.655+0000 7f778cd51700 1 --2- 172.21.15.59:0/320673755 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f778809d630 0x7f77880a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.655+0000 7f778dd53700 1 --2- 172.21.15.59:0/320673755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7788138d80 0x7f778813b160 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f7778009840 tx=0x7f7778009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3985b9320e6cdcc1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.655+0000 7f7787fff700 1 -- 172.21.15.59:0/320673755 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778011830 con 0x7f7788138d80 2023-09-30T22:35:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.655+0000 7f7787fff700 1 -- 172.21.15.59:0/320673755 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7778011990 con 0x7f7788138d80 2023-09-30T22:35:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.655+0000 7f7787fff700 1 -- 172.21.15.59:0/320673755 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778011d20 con 0x7f7788138d80 2023-09-30T22:35:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.656+0000 7f778f7b6700 1 -- 172.21.15.59:0/320673755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7788138d80 msgr2=0x7f778813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.656+0000 7f778f7b6700 1 --2- 172.21.15.59:0/320673755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7788138d80 0x7f778813b160 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f7778009840 tx=0x7f7778009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.656+0000 7f778f7b6700 1 -- 172.21.15.59:0/320673755 shutdown_connections 2023-09-30T22:35:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.656+0000 7f778f7b6700 1 --2- 172.21.15.59:0/320673755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7788138d80 0x7f778813b160 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.656+0000 7f778f7b6700 1 --2- 172.21.15.59:0/320673755 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f778809d630 0x7f77880a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.656+0000 7f778f7b6700 1 -- 172.21.15.59:0/320673755 >> 172.21.15.59:0/320673755 conn(0x7f77880a3050 msgr2=0x7f77880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.656+0000 7f778f7b6700 1 -- 172.21.15.59:0/320673755 shutdown_connections 2023-09-30T22:35:47.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.656+0000 7f778f7b6700 1 -- 172.21.15.59:0/320673755 wait complete. 2023-09-30T22:35:47.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.657+0000 7f778f7b6700 1 Processor -- start 2023-09-30T22:35:47.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.657+0000 7f778f7b6700 1 -- start start 2023-09-30T22:35:47.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778f7b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f778809d630 0x7f778812c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:47.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778f7b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77880a0a30 0x7f778812cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:47.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778f7b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7788138d80 0x7f778812cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:47.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778f7b6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7788130190 con 0x7f778809d630 2023-09-30T22:35:47.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778f7b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778812fc10 con 0x7f77880a0a30 2023-09-30T22:35:47.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778f7b6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77880a0410 con 0x7f7788138d80 2023-09-30T22:35:47.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778d552700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f778809d630 0x7f778812c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:47.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778dd53700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7788138d80 0x7f778812cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:47.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778d552700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f778809d630 0x7f778812c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52084/0 (socket says 172.21.15.59:52084) 2023-09-30T22:35:47.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778d552700 1 -- 172.21.15.59:0/1787922152 learned_addr learned my addr 172.21.15.59:0/1787922152 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:47.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778cd51700 1 --2- 172.21.15.59:0/1787922152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77880a0a30 0x7f778812cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:47.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778dd53700 1 -- 172.21.15.59:0/1787922152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77880a0a30 msgr2=0x7f778812cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:47.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778dd53700 1 --2- 172.21.15.59:0/1787922152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77880a0a30 0x7f778812cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778dd53700 1 -- 172.21.15.59:0/1787922152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f778809d630 msgr2=0x7f778812c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:47.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778dd53700 1 --2- 172.21.15.59:0/1787922152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f778809d630 0x7f778812c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778dd53700 1 -- 172.21.15.59:0/1787922152 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777c009550 con 0x7f7788138d80 2023-09-30T22:35:47.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f778dd53700 1 --2- 172.21.15.59:0/1787922152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7788138d80 0x7f778812cff0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7778016000 tx=0x7f7778004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:47.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f7785ffb700 1 -- 172.21.15.59:0/1787922152 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778004380 con 0x7f7788138d80 2023-09-30T22:35:47.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.658+0000 7f7785ffb700 1 -- 172.21.15.59:0/1787922152 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777801f070 con 0x7f7788138d80 2023-09-30T22:35:47.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.659+0000 7f778f7b6700 1 -- 172.21.15.59:0/1787922152 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77780094a0 con 0x7f7788138d80 2023-09-30T22:35:47.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.659+0000 7f7785ffb700 1 -- 172.21.15.59:0/1787922152 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77780036a0 con 0x7f7788138d80 2023-09-30T22:35:47.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.659+0000 7f778f7b6700 1 -- 172.21.15.59:0/1787922152 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778812e5a0 con 0x7f7788138d80 2023-09-30T22:35:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.659+0000 7f7785ffb700 1 -- 172.21.15.59:0/1787922152 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7778021030 con 0x7f7788138d80 2023-09-30T22:35:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.660+0000 7f7785ffb700 1 -- 172.21.15.59:0/1787922152 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f77780407f0 con 0x7f7788138d80 2023-09-30T22:35:47.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.660+0000 7f778f7b6700 1 -- 172.21.15.59:0/1787922152 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77880a4a70 con 0x7f7788138d80 2023-09-30T22:35:47.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.665+0000 7f7785ffb700 1 -- 172.21.15.59:0/1787922152 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77780239c0 con 0x7f7788138d80 2023-09-30T22:35:47.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.831+0000 7ff0977e9700 1 -- 172.21.15.59:0/801752713 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff0900a0220 con 0x7ff0900a1340 2023-09-30T22:35:47.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.831+0000 7ff085ffb700 1 -- 172.21.15.59:0/801752713 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff080015020 con 0x7ff0900a1340 2023-09-30T22:35:47.832 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:47.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.834+0000 7ff0977e9700 1 -- 172.21.15.59:0/801752713 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0900a1340 msgr2=0x7ff0901c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:47.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.834+0000 7ff0977e9700 1 --2- 172.21.15.59:0/801752713 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0900a1340 0x7ff0901c8b80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff0800090b0 tx=0x7ff080004750 comp rx=0 tx=0).stop 2023-09-30T22:35:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.834+0000 7ff0977e9700 1 -- 172.21.15.59:0/801752713 shutdown_connections 2023-09-30T22:35:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.834+0000 7ff0977e9700 1 --2- 172.21.15.59:0/801752713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff090133fa0 0x7ff0901227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.834+0000 7ff0977e9700 1 --2- 172.21.15.59:0/801752713 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0900a0a30 0x7ff0901c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.834+0000 7ff0977e9700 1 --2- 172.21.15.59:0/801752713 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0900a1340 0x7ff0901c8b80 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.834+0000 7ff0977e9700 1 -- 172.21.15.59:0/801752713 >> 172.21.15.59:0/801752713 conn(0x7ff0900a6550 msgr2=0x7ff0900a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.834+0000 7ff0977e9700 1 -- 172.21.15.59:0/801752713 shutdown_connections 2023-09-30T22:35:47.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.834+0000 7ff0977e9700 1 -- 172.21.15.59:0/801752713 wait complete. 2023-09-30T22:35:47.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:47.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.873+0000 7f778f7b6700 1 -- 172.21.15.59:0/1787922152 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f77880747f0 con 0x7f7788138d80 2023-09-30T22:35:47.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.874+0000 7f7785ffb700 1 -- 172.21.15.59:0/1787922152 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7778015070 con 0x7f7788138d80 2023-09-30T22:35:47.874 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:47.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.876+0000 7f778f7b6700 1 -- 172.21.15.59:0/1787922152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7788138d80 msgr2=0x7f778812cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:47.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.876+0000 7f778f7b6700 1 --2- 172.21.15.59:0/1787922152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7788138d80 0x7f778812cff0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7778016000 tx=0x7f7778004750 comp rx=0 tx=0).stop 2023-09-30T22:35:47.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.876+0000 7f778f7b6700 1 -- 172.21.15.59:0/1787922152 shutdown_connections 2023-09-30T22:35:47.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.876+0000 7f778f7b6700 1 --2- 172.21.15.59:0/1787922152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7788138d80 0x7f778812cff0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.876+0000 7f778f7b6700 1 --2- 172.21.15.59:0/1787922152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f778809d630 0x7f778812c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.876+0000 7f778f7b6700 1 --2- 172.21.15.59:0/1787922152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77880a0a30 0x7f778812cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:47.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.876+0000 7f778f7b6700 1 -- 172.21.15.59:0/1787922152 >> 172.21.15.59:0/1787922152 conn(0x7f77880a3050 msgr2=0x7f778809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:47.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.876+0000 7f778f7b6700 1 -- 172.21.15.59:0/1787922152 shutdown_connections 2023-09-30T22:35:47.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:47.876+0000 7f778f7b6700 1 -- 172.21.15.59:0/1787922152 wait complete. 2023-09-30T22:35:47.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:47.929 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:47.968 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:48.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.075+0000 7f00ee9dc700 1 Processor -- start 2023-09-30T22:35:48.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.075+0000 7f00ee9dc700 1 -- start start 2023-09-30T22:35:48.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.076+0000 7f00ee9dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00e80a1510 0x7f00e8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:48.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.076+0000 7f00ee9dc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00e8139250 0x7f00e813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:48.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.076+0000 7f00ee9dc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e809edd0 con 0x7f00e80a0a30 2023-09-30T22:35:48.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.076+0000 7f00ee9dc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80a18e0 con 0x7f00e80a1510 2023-09-30T22:35:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.076+0000 7f00ee9dc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00e809e1f0 con 0x7f00e8139250 2023-09-30T22:35:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.076+0000 7f00e7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f00e80a0a30 0x7f00e80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54152/0 (socket says 172.21.15.59:54152) 2023-09-30T22:35:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.076+0000 7f00e7fff700 1 -- 172.21.15.59:0/1492334869 learned_addr learned my addr 172.21.15.59:0/1492334869 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.076+0000 7f00e77fe700 1 --2- 172.21.15.59:0/1492334869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00e80a1510 0x7f00e8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.076+0000 7f00ecf79700 1 --2- 172.21.15.59:0/1492334869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00e8139250 0x7f00e813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.076+0000 7f00e6ffd700 1 -- 172.21.15.59:0/1492334869 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565269564 0 0) 0x7f00e809edd0 con 0x7f00e80a0a30 2023-09-30T22:35:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.076+0000 7f00e6ffd700 1 -- 172.21.15.59:0/1492334869 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d00035b0 con 0x7f00e80a0a30 2023-09-30T22:35:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.077+0000 7f00ecf79700 1 -- 172.21.15.59:0/1492334869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00e80a1510 msgr2=0x7f00e8138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.077+0000 7f00ecf79700 1 --2- 172.21.15.59:0/1492334869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00e80a1510 0x7f00e8138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.077+0000 7f00ecf79700 1 -- 172.21.15.59:0/1492334869 >> v1:172.21.15.59:6789/0 conn(0x7f00e80a0a30 legacy=0x7f00e80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:48.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.077+0000 7f00ecf79700 1 -- 172.21.15.59:0/1492334869 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e809dc50 con 0x7f00e8139250 2023-09-30T22:35:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.077+0000 7f00e77fe700 1 --2- 172.21.15.59:0/1492334869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00e80a1510 0x7f00e8138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.077+0000 7f00ecf79700 1 --2- 172.21.15.59:0/1492334869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00e8139250 0x7f00e813b630 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009dc0 tx=0x7f00e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0c48b0e2bfc2526 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.077+0000 7f00e6ffd700 1 -- 172.21.15.59:0/1492334869 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e000e070 con 0x7f00e8139250 2023-09-30T22:35:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.077+0000 7f00e6ffd700 1 -- 172.21.15.59:0/1492334869 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e000bb20 con 0x7f00e8139250 2023-09-30T22:35:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.077+0000 7f00e6ffd700 1 -- 172.21.15.59:0/1492334869 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0012430 con 0x7f00e8139250 2023-09-30T22:35:48.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.078+0000 7f00ee9dc700 1 -- 172.21.15.59:0/1492334869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00e8139250 msgr2=0x7f00e813b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.078+0000 7f00ee9dc700 1 --2- 172.21.15.59:0/1492334869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00e8139250 0x7f00e813b630 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009dc0 tx=0x7f00e000b330 comp rx=0 tx=0).stop 2023-09-30T22:35:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.078+0000 7f00ee9dc700 1 -- 172.21.15.59:0/1492334869 shutdown_connections 2023-09-30T22:35:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.078+0000 7f00ee9dc700 1 --2- 172.21.15.59:0/1492334869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00e8139250 0x7f00e813b630 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.078+0000 7f00ee9dc700 1 --2- 172.21.15.59:0/1492334869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00e80a1510 0x7f00e8138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.078+0000 7f00ee9dc700 1 -- 172.21.15.59:0/1492334869 >> 172.21.15.59:0/1492334869 conn(0x7f00e80a6550 msgr2=0x7f00e80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.078+0000 7f00ee9dc700 1 -- 172.21.15.59:0/1492334869 shutdown_connections 2023-09-30T22:35:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.078+0000 7f00ee9dc700 1 -- 172.21.15.59:0/1492334869 wait complete. 2023-09-30T22:35:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.079+0000 7f00ee9dc700 1 Processor -- start 2023-09-30T22:35:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.079+0000 7f00ee9dc700 1 -- start start 2023-09-30T22:35:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00ee9dc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00e80a0a30 0x7f00e81226e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00ee9dc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00e80a1510 0x7f00e8122c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00ee9dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00e8139250 0x7f00e8123160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00ee9dc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e8137ff0 con 0x7f00e80a0a30 2023-09-30T22:35:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00ee9dc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e8125c60 con 0x7f00e8139250 2023-09-30T22:35:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00ee9dc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00e8124b50 con 0x7f00e80a1510 2023-09-30T22:35:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00e77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00e80a1510 0x7f00e8122c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00e77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00e80a1510 0x7f00e8122c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45176/0 (socket says 172.21.15.59:45176) 2023-09-30T22:35:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00e77fe700 1 -- 172.21.15.59:0/74016430 learned_addr learned my addr 172.21.15.59:0/74016430 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00ecf79700 1 --2- 172.21.15.59:0/74016430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00e8139250 0x7f00e8123160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:48.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00e7fff700 1 --2- 172.21.15.59:0/74016430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00e80a0a30 0x7f00e81226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00e77fe700 1 -- 172.21.15.59:0/74016430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00e8139250 msgr2=0x7f00e8123160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00e77fe700 1 --2- 172.21.15.59:0/74016430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00e8139250 0x7f00e8123160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00e77fe700 1 -- 172.21.15.59:0/74016430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00e80a0a30 msgr2=0x7f00e81226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00e77fe700 1 --2- 172.21.15.59:0/74016430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00e80a0a30 0x7f00e81226e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00e77fe700 1 -- 172.21.15.59:0/74016430 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc0094a0 con 0x7f00e80a1510 2023-09-30T22:35:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00ecf79700 1 --2- 172.21.15.59:0/74016430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00e8139250 0x7f00e8123160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.080+0000 7f00e77fe700 1 --2- 172.21.15.59:0/74016430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00e80a1510 0x7f00e8122c20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00ebe0 tx=0x7f00dc00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.081+0000 7f00e4ff9700 1 -- 172.21.15.59:0/74016430 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc00c850 con 0x7f00e80a1510 2023-09-30T22:35:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.081+0000 7f00e4ff9700 1 -- 172.21.15.59:0/74016430 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc00c9b0 con 0x7f00e80a1510 2023-09-30T22:35:48.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.081+0000 7f00ee9dc700 1 -- 172.21.15.59:0/74016430 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e0009a70 con 0x7f00e80a1510 2023-09-30T22:35:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.081+0000 7f00e4ff9700 1 -- 172.21.15.59:0/74016430 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc00cd40 con 0x7f00e80a1510 2023-09-30T22:35:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.081+0000 7f00ee9dc700 1 -- 172.21.15.59:0/74016430 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e81385d0 con 0x7f00e80a1510 2023-09-30T22:35:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.081+0000 7f00e4ff9700 1 -- 172.21.15.59:0/74016430 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00dc013470 con 0x7f00e80a1510 2023-09-30T22:35:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.082+0000 7f00e4ff9700 1 -- 172.21.15.59:0/74016430 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f00dc03fb80 con 0x7f00e80a1510 2023-09-30T22:35:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.082+0000 7f00ee9dc700 1 -- 172.21.15.59:0/74016430 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e8074ea0 con 0x7f00e80a1510 2023-09-30T22:35:48.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.087+0000 7f00e4ff9700 1 -- 172.21.15.59:0/74016430 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00dc013720 con 0x7f00e80a1510 2023-09-30T22:35:48.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.117+0000 7fc3c237f700 1 Processor -- start 2023-09-30T22:35:48.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.117+0000 7fc3c237f700 1 -- start start 2023-09-30T22:35:48.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.118+0000 7fc3c237f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3bc0a0a30 0x7fc3bc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:48.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.118+0000 7fc3c237f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc3bc134170 0x7fc3bc13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:48.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.118+0000 7fc3c237f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3bc09edd0 con 0x7fc3bc0a1340 2023-09-30T22:35:48.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.118+0000 7fc3c237f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3bc09e1f0 con 0x7fc3bc134170 2023-09-30T22:35:48.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.118+0000 7fc3c237f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc09dc50 con 0x7fc3bc0a0a30 2023-09-30T22:35:48.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.118+0000 7fc3bbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3bc0a0a30 0x7fc3bc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:48.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.118+0000 7fc3c091c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc3bc134170 0x7fc3bc13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:48.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.118+0000 7fc3bbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3bc0a0a30 0x7fc3bc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45188/0 (socket says 172.21.15.59:45188) 2023-09-30T22:35:48.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.118+0000 7fc3bbfff700 1 -- 172.21.15.59:0/3223114591 learned_addr learned my addr 172.21.15.59:0/3223114591 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:48.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.118+0000 7fc3c091c700 1 -- 172.21.15.59:0/3223114591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3bc0a0a30 msgr2=0x7fc3bc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:48.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.118+0000 7fc3c091c700 1 --2- 172.21.15.59:0/3223114591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3bc0a0a30 0x7fc3bc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.118+0000 7fc3c091c700 1 -- 172.21.15.59:0/3223114591 >> v1:172.21.15.59:6789/0 conn(0x7fc3bc0a1340 legacy=0x7fc3bc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:48.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.118+0000 7fc3c091c700 1 -- 172.21.15.59:0/3223114591 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc0a1fe0 con 0x7fc3bc134170 2023-09-30T22:35:48.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.118+0000 7fc3bbfff700 1 --2- 172.21.15.59:0/3223114591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3bc0a0a30 0x7fc3bc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:48.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.119+0000 7fc3c091c700 1 --2- 172.21.15.59:0/3223114591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3bc134170 0x7fc3bc13bd30 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009d90 tx=0x7fc3b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46bf2b2c468f9f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:48.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.119+0000 7fc3baffd700 1 -- 172.21.15.59:0/3223114591 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b400e070 con 0x7fc3bc134170 2023-09-30T22:35:48.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.119+0000 7fc3baffd700 1 -- 172.21.15.59:0/3223114591 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b400bb20 con 0x7fc3bc134170 2023-09-30T22:35:48.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.119+0000 7fc3baffd700 1 -- 172.21.15.59:0/3223114591 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4012430 con 0x7fc3bc134170 2023-09-30T22:35:48.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.119+0000 7fc3c237f700 1 -- 172.21.15.59:0/3223114591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3bc134170 msgr2=0x7fc3bc13bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:48.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.119+0000 7fc3c237f700 1 --2- 172.21.15.59:0/3223114591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3bc134170 0x7fc3bc13bd30 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009d90 tx=0x7fc3b400b330 comp rx=0 tx=0).stop 2023-09-30T22:35:48.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.119+0000 7fc3c237f700 1 -- 172.21.15.59:0/3223114591 shutdown_connections 2023-09-30T22:35:48.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.119+0000 7fc3c237f700 1 --2- 172.21.15.59:0/3223114591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3bc134170 0x7fc3bc13bd30 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.119+0000 7fc3c237f700 1 --2- 172.21.15.59:0/3223114591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3bc0a0a30 0x7fc3bc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.119+0000 7fc3c237f700 1 -- 172.21.15.59:0/3223114591 >> 172.21.15.59:0/3223114591 conn(0x7fc3bc0a6550 msgr2=0x7fc3bc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:48.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.119+0000 7fc3c237f700 1 -- 172.21.15.59:0/3223114591 shutdown_connections 2023-09-30T22:35:48.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.119+0000 7fc3c237f700 1 -- 172.21.15.59:0/3223114591 wait complete. 2023-09-30T22:35:48.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.120+0000 7fc3c237f700 1 Processor -- start 2023-09-30T22:35:48.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.121+0000 7fc3c237f700 1 -- start start 2023-09-30T22:35:48.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.121+0000 7fc3c237f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3bc0a0a30 0x7fc3bc11e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:48.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.121+0000 7fc3c237f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3bc0a1340 0x7fc3bc11ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:48.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.121+0000 7fc3c237f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3bc134170 0x7fc3bc11f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:48.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.121+0000 7fc3c237f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc122190 con 0x7fc3bc134170 2023-09-30T22:35:48.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.121+0000 7fc3c237f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc121bf0 con 0x7fc3bc0a0a30 2023-09-30T22:35:48.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.121+0000 7fc3c237f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc120280 con 0x7fc3bc0a1340 2023-09-30T22:35:48.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.121+0000 7fc3bbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3bc0a0a30 0x7fc3bc11e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:48.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.121+0000 7fc3c091c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3bc134170 0x7fc3bc11f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:48.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.121+0000 7fc3bbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3bc0a0a30 0x7fc3bc11e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40466/0 (socket says 172.21.15.59:40466) 2023-09-30T22:35:48.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.121+0000 7fc3bbfff700 1 -- 172.21.15.59:0/3542240100 learned_addr learned my addr 172.21.15.59:0/3542240100 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:48.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.121+0000 7fc3bb7fe700 1 --2- 172.21.15.59:0/3542240100 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3bc0a1340 0x7fc3bc11ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:48.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.122+0000 7fc3c091c700 1 -- 172.21.15.59:0/3542240100 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3bc0a1340 msgr2=0x7fc3bc11ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:48.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.122+0000 7fc3c091c700 1 --2- 172.21.15.59:0/3542240100 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3bc0a1340 0x7fc3bc11ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.122+0000 7fc3c091c700 1 -- 172.21.15.59:0/3542240100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3bc0a0a30 msgr2=0x7fc3bc11e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:48.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.122+0000 7fc3c091c700 1 --2- 172.21.15.59:0/3542240100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3bc0a0a30 0x7fc3bc11e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.122+0000 7fc3c091c700 1 -- 172.21.15.59:0/3542240100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac009550 con 0x7fc3bc134170 2023-09-30T22:35:48.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.122+0000 7fc3bbfff700 1 --2- 172.21.15.59:0/3542240100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3bc0a0a30 0x7fc3bc11e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:48.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.122+0000 7fc3c091c700 1 --2- 172.21.15.59:0/3542240100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3bc134170 0x7fc3bc11f180 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4016000 tx=0x7fc3b4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:48.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.122+0000 7fc3b8ff9700 1 -- 172.21.15.59:0/3542240100 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4012430 con 0x7fc3bc134170 2023-09-30T22:35:48.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.122+0000 7fc3b8ff9700 1 -- 172.21.15.59:0/3542240100 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b4020070 con 0x7fc3bc134170 2023-09-30T22:35:48.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.122+0000 7fc3b8ff9700 1 -- 172.21.15.59:0/3542240100 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4004040 con 0x7fc3bc134170 2023-09-30T22:35:48.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.122+0000 7fc3c237f700 1 -- 172.21.15.59:0/3542240100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b4009a70 con 0x7fc3bc134170 2023-09-30T22:35:48.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.122+0000 7fc3c237f700 1 -- 172.21.15.59:0/3542240100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc120a30 con 0x7fc3bc134170 2023-09-30T22:35:48.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.123+0000 7fc3b8ff9700 1 -- 172.21.15.59:0/3542240100 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3b40041a0 con 0x7fc3bc134170 2023-09-30T22:35:48.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.123+0000 7fc3b8ff9700 1 -- 172.21.15.59:0/3542240100 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc3b4022070 con 0x7fc3bc134170 2023-09-30T22:35:48.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.123+0000 7fc3c237f700 1 -- 172.21.15.59:0/3542240100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc074ea0 con 0x7fc3bc134170 2023-09-30T22:35:48.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.128+0000 7fc3b8ff9700 1 -- 172.21.15.59:0/3542240100 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3b4004450 con 0x7fc3bc134170 2023-09-30T22:35:48.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.295+0000 7f00ee9dc700 1 -- 172.21.15.59:0/74016430 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f00e80a1d10 con 0x7f00e80a1510 2023-09-30T22:35:48.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.295+0000 7f00e4ff9700 1 -- 172.21.15.59:0/74016430 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00dc021030 con 0x7f00e80a1510 2023-09-30T22:35:48.296 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:48.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.298+0000 7f00ee9dc700 1 -- 172.21.15.59:0/74016430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00e80a1510 msgr2=0x7f00e8122c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:48.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.298+0000 7f00ee9dc700 1 --2- 172.21.15.59:0/74016430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00e80a1510 0x7f00e8122c20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00ebe0 tx=0x7f00dc00eef0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.298+0000 7f00ee9dc700 1 -- 172.21.15.59:0/74016430 shutdown_connections 2023-09-30T22:35:48.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.298+0000 7f00ee9dc700 1 --2- 172.21.15.59:0/74016430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00e8139250 0x7f00e8123160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.298+0000 7f00ee9dc700 1 --2- 172.21.15.59:0/74016430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00e80a0a30 0x7f00e81226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.298+0000 7f00ee9dc700 1 --2- 172.21.15.59:0/74016430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f00e80a1510 0x7f00e8122c20 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.298+0000 7f00ee9dc700 1 -- 172.21.15.59:0/74016430 >> 172.21.15.59:0/74016430 conn(0x7f00e80a6550 msgr2=0x7f00e811c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.298+0000 7f00ee9dc700 1 -- 172.21.15.59:0/74016430 shutdown_connections 2023-09-30T22:35:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.298+0000 7f00ee9dc700 1 -- 172.21.15.59:0/74016430 wait complete. 2023-09-30T22:35:48.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:48.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.337+0000 7fc3c237f700 1 -- 172.21.15.59:0/3542240100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc3bc0a28e0 con 0x7fc3bc134170 2023-09-30T22:35:48.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.337+0000 7fc3b8ff9700 1 -- 172.21.15.59:0/3542240100 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3b402c020 con 0x7fc3bc134170 2023-09-30T22:35:48.338 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:48.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.340+0000 7fc3c237f700 1 -- 172.21.15.59:0/3542240100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3bc134170 msgr2=0x7fc3bc11f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:48.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.340+0000 7fc3c237f700 1 --2- 172.21.15.59:0/3542240100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3bc134170 0x7fc3bc11f180 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4016000 tx=0x7fc3b4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.340+0000 7fc3c237f700 1 -- 172.21.15.59:0/3542240100 shutdown_connections 2023-09-30T22:35:48.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.340+0000 7fc3c237f700 1 --2- 172.21.15.59:0/3542240100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3bc134170 0x7fc3bc11f180 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.340+0000 7fc3c237f700 1 --2- 172.21.15.59:0/3542240100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3bc0a0a30 0x7fc3bc11e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.340+0000 7fc3c237f700 1 --2- 172.21.15.59:0/3542240100 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3bc0a1340 0x7fc3bc11ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:48.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.340+0000 7fc3c237f700 1 -- 172.21.15.59:0/3542240100 >> 172.21.15.59:0/3542240100 conn(0x7fc3bc0a6550 msgr2=0x7fc3bc09c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:48.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.340+0000 7fc3c237f700 1 -- 172.21.15.59:0/3542240100 shutdown_connections 2023-09-30T22:35:48.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.340+0000 7fc3c237f700 1 -- 172.21.15.59:0/3542240100 wait complete. 2023-09-30T22:35:48.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:48.849 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:48.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:48.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.996+0000 7f5180a17700 1 Processor -- start 2023-09-30T22:35:48.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.996+0000 7f5180a17700 1 -- start start 2023-09-30T22:35:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.997+0000 7f5180a17700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09f410 0x7f517c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.997+0000 7f5180a17700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c136fe0 0x7f517c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.997+0000 7f5180a17700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f517c070940 con 0x7f517c09e930 2023-09-30T22:35:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.997+0000 7f5180a17700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c06fd60 con 0x7f517c136fe0 2023-09-30T22:35:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.997+0000 7f5180a17700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f517c06fa80 con 0x7f517c09f410 2023-09-30T22:35:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.998+0000 7f5179d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09f410 0x7f517c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.998+0000 7f517a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f517c09e930 0x7f517c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54180/0 (socket says 172.21.15.59:54180) 2023-09-30T22:35:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.998+0000 7f517a59c700 1 -- 172.21.15.59:0/2338819697 learned_addr learned my addr 172.21.15.59:0/2338819697 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.998+0000 7f517ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c136fe0 0x7f517c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.998+0000 7f517959a700 1 -- 172.21.15.59:0/2338819697 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324744747 0 0) 0x7f517c070940 con 0x7f517c09e930 2023-09-30T22:35:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.998+0000 7f517ad9d700 1 -- 172.21.15.59:0/2338819697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09f410 msgr2=0x7f517c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.998+0000 7f517ad9d700 1 --2- 172.21.15.59:0/2338819697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09f410 0x7f517c136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.998+0000 7f517ad9d700 1 -- 172.21.15.59:0/2338819697 >> v1:172.21.15.59:6789/0 conn(0x7f517c09e930 legacy=0x7f517c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.998+0000 7f517ad9d700 1 -- 172.21.15.59:0/2338819697 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c09fb60 con 0x7f517c136fe0 2023-09-30T22:35:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.998+0000 7f5179d9b700 1 --2- 172.21.15.59:0/2338819697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09f410 0x7f517c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.998+0000 7f517ad9d700 1 --2- 172.21.15.59:0/2338819697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c136fe0 0x7f517c1393c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f5174009870 tx=0x7f5174009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35716e53fe3f9a66 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.998+0000 7f517959a700 1 -- 172.21.15.59:0/2338819697 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5174011830 con 0x7f517c136fe0 2023-09-30T22:35:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.998+0000 7f517959a700 1 -- 172.21.15.59:0/2338819697 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5174011990 con 0x7f517c136fe0 2023-09-30T22:35:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.998+0000 7f517959a700 1 -- 172.21.15.59:0/2338819697 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5174011d20 con 0x7f517c136fe0 2023-09-30T22:35:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.999+0000 7f5180a17700 1 -- 172.21.15.59:0/2338819697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c136fe0 msgr2=0x7f517c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.999+0000 7f5180a17700 1 --2- 172.21.15.59:0/2338819697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c136fe0 0x7f517c1393c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f5174009870 tx=0x7f5174009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.999+0000 7f5180a17700 1 -- 172.21.15.59:0/2338819697 shutdown_connections 2023-09-30T22:35:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.999+0000 7f5180a17700 1 --2- 172.21.15.59:0/2338819697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c136fe0 0x7f517c1393c0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.999+0000 7f5180a17700 1 --2- 172.21.15.59:0/2338819697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09f410 0x7f517c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:48.999+0000 7f5180a17700 1 -- 172.21.15.59:0/2338819697 >> 172.21.15.59:0/2338819697 conn(0x7f517c0a4210 msgr2=0x7f517c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.000+0000 7f5180a17700 1 -- 172.21.15.59:0/2338819697 shutdown_connections 2023-09-30T22:35:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.000+0000 7f5180a17700 1 -- 172.21.15.59:0/2338819697 wait complete. 2023-09-30T22:35:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.001+0000 7f5180a17700 1 Processor -- start 2023-09-30T22:35:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.001+0000 7f5180a17700 1 -- start start 2023-09-30T22:35:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f5180a17700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c09e930 0x7f517c11f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f5180a17700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09f410 0x7f517c11f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f5180a17700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c136fe0 0x7f517c11ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f5180a17700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c121290 con 0x7f517c136fe0 2023-09-30T22:35:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f5180a17700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c1210a0 con 0x7f517c09e930 2023-09-30T22:35:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f5180a17700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f517c135410 con 0x7f517c09f410 2023-09-30T22:35:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f517ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c136fe0 0x7f517c11ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f517a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c09e930 0x7f517c11f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f5179d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09f410 0x7f517c11f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f517ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c136fe0 0x7f517c11ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52118/0 (socket says 172.21.15.59:52118) 2023-09-30T22:35:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f517ad9d700 1 -- 172.21.15.59:0/2247311622 learned_addr learned my addr 172.21.15.59:0/2247311622 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f5179d9b700 1 -- 172.21.15.59:0/2247311622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c09e930 msgr2=0x7f517c11f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f5179d9b700 1 --2- 172.21.15.59:0/2247311622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c09e930 0x7f517c11f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f5179d9b700 1 -- 172.21.15.59:0/2247311622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c136fe0 msgr2=0x7f517c11ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f5179d9b700 1 --2- 172.21.15.59:0/2247311622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c136fe0 0x7f517c11ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f5179d9b700 1 -- 172.21.15.59:0/2247311622 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51700094a0 con 0x7f517c09f410 2023-09-30T22:35:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.002+0000 7f517ad9d700 1 --2- 172.21.15.59:0/2247311622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c136fe0 0x7f517c11ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.003+0000 7f5179d9b700 1 --2- 172.21.15.59:0/2247311622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09f410 0x7f517c11f9d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f517000e9e0 tx=0x7f517000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.003+0000 7f516affd700 1 -- 172.21.15.59:0/2247311622 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517000ee80 con 0x7f517c09f410 2023-09-30T22:35:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.003+0000 7f516affd700 1 -- 172.21.15.59:0/2247311622 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517000c850 con 0x7f517c09f410 2023-09-30T22:35:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.003+0000 7f5180a17700 1 -- 172.21.15.59:0/2247311622 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51740094a0 con 0x7f517c09f410 2023-09-30T22:35:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.003+0000 7f516affd700 1 -- 172.21.15.59:0/2247311622 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517000cc00 con 0x7f517c09f410 2023-09-30T22:35:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.003+0000 7f5180a17700 1 -- 172.21.15.59:0/2247311622 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517c123010 con 0x7f517c09f410 2023-09-30T22:35:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.004+0000 7f516affd700 1 -- 172.21.15.59:0/2247311622 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f517000cd60 con 0x7f517c09f410 2023-09-30T22:35:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.004+0000 7f516affd700 1 -- 172.21.15.59:0/2247311622 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f517003f730 con 0x7f517c09f410 2023-09-30T22:35:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.004+0000 7f5180a17700 1 -- 172.21.15.59:0/2247311622 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517c122970 con 0x7f517c09f410 2023-09-30T22:35:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.009+0000 7f516affd700 1 -- 172.21.15.59:0/2247311622 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f517c122970 con 0x7f517c09f410 2023-09-30T22:35:49.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.034+0000 7effed36b700 1 Processor -- start 2023-09-30T22:35:49.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.034+0000 7effed36b700 1 -- start start 2023-09-30T22:35:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.035+0000 7effed36b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effe81317f0 0x7effe8131bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.035+0000 7effed36b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effe806a770 0x7effe806abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.035+0000 7effed36b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe809d760 con 0x7effe806b100 2023-09-30T22:35:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.035+0000 7effed36b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe8132100 con 0x7effe81317f0 2023-09-30T22:35:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.035+0000 7effed36b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe81313a0 con 0x7effe806a770 2023-09-30T22:35:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.035+0000 7effe67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effe806a770 0x7effe806abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.035+0000 7effe6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effe81317f0 0x7effe8131bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.035+0000 7effe67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effe806a770 0x7effe806abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40472/0 (socket says 172.21.15.59:40472) 2023-09-30T22:35:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.035+0000 7effe67fc700 1 -- 172.21.15.59:0/661927288 learned_addr learned my addr 172.21.15.59:0/661927288 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.035+0000 7effe67fc700 1 -- 172.21.15.59:0/661927288 >> v2:172.21.15.59:3300/0 conn(0x7effe81317f0 msgr2=0x7effe8131bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.035+0000 7effe67fc700 1 --2- 172.21.15.59:0/661927288 >> v2:172.21.15.59:3300/0 conn(0x7effe81317f0 0x7effe8131bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.035+0000 7effe67fc700 1 -- 172.21.15.59:0/661927288 >> v1:172.21.15.59:6789/0 conn(0x7effe806b100 legacy=0x7effe8138500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.035+0000 7effe67fc700 1 -- 172.21.15.59:0/661927288 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe809e880 con 0x7effe806a770 2023-09-30T22:35:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.035+0000 7effe6ffd700 1 --2- 172.21.15.59:0/661927288 >> v2:172.21.15.59:3300/0 conn(0x7effe81317f0 0x7effe8131bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.036+0000 7effe67fc700 1 --2- 172.21.15.59:0/661927288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effe806a770 0x7effe806abc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7effd00098f0 tx=0x7effd0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51c9d156ea7762a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.036+0000 7effe5ffb700 1 -- 172.21.15.59:0/661927288 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0011830 con 0x7effe806a770 2023-09-30T22:35:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.036+0000 7effe5ffb700 1 -- 172.21.15.59:0/661927288 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd0011990 con 0x7effe806a770 2023-09-30T22:35:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.036+0000 7effe5ffb700 1 -- 172.21.15.59:0/661927288 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0011d20 con 0x7effe806a770 2023-09-30T22:35:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.036+0000 7effed36b700 1 -- 172.21.15.59:0/661927288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effe806a770 msgr2=0x7effe806abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.036+0000 7effed36b700 1 --2- 172.21.15.59:0/661927288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effe806a770 0x7effe806abc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7effd00098f0 tx=0x7effd0009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.036+0000 7effed36b700 1 -- 172.21.15.59:0/661927288 shutdown_connections 2023-09-30T22:35:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.036+0000 7effed36b700 1 --2- 172.21.15.59:0/661927288 >> v2:172.21.15.59:3300/0 conn(0x7effe81317f0 0x7effe8131bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.036+0000 7effed36b700 1 --2- 172.21.15.59:0/661927288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effe806a770 0x7effe806abc0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.036+0000 7effed36b700 1 -- 172.21.15.59:0/661927288 >> 172.21.15.59:0/661927288 conn(0x7effe8099c20 msgr2=0x7effe80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.037+0000 7effed36b700 1 -- 172.21.15.59:0/661927288 shutdown_connections 2023-09-30T22:35:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.037+0000 7effed36b700 1 -- 172.21.15.59:0/661927288 wait complete. 2023-09-30T22:35:49.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.038+0000 7effed36b700 1 Processor -- start 2023-09-30T22:35:49.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.038+0000 7effed36b700 1 -- start start 2023-09-30T22:35:49.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.038+0000 7effed36b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effe806a770 0x7effe8070d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.038+0000 7effed36b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effe806b100 0x7effe80712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.038+0000 7effed36b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effe81317f0 0x7effe8071800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.038+0000 7effed36b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe809a450 con 0x7effe81317f0 2023-09-30T22:35:49.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.038+0000 7effed36b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe809b9d0 con 0x7effe806a770 2023-09-30T22:35:49.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.038+0000 7effed36b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effe80a0d60 con 0x7effe806b100 2023-09-30T22:35:49.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.038+0000 7effe6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effe806a770 0x7effe8070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.038+0000 7effe77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effe81317f0 0x7effe8071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.038+0000 7effe6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effe806a770 0x7effe8070d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40482/0 (socket says 172.21.15.59:40482) 2023-09-30T22:35:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.038+0000 7effe6ffd700 1 -- 172.21.15.59:0/349763522 learned_addr learned my addr 172.21.15.59:0/349763522 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.038+0000 7effe67fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effe806b100 0x7effe80712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.039+0000 7effe67fc700 1 -- 172.21.15.59:0/349763522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effe806a770 msgr2=0x7effe8070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.039+0000 7effe67fc700 1 --2- 172.21.15.59:0/349763522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effe806a770 0x7effe8070d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.039+0000 7effe67fc700 1 -- 172.21.15.59:0/349763522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effe81317f0 msgr2=0x7effe8071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.039+0000 7effe67fc700 1 --2- 172.21.15.59:0/349763522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effe81317f0 0x7effe8071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.039+0000 7effe67fc700 1 -- 172.21.15.59:0/349763522 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe00094a0 con 0x7effe806b100 2023-09-30T22:35:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.039+0000 7effe6ffd700 1 --2- 172.21.15.59:0/349763522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effe806a770 0x7effe8070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.039+0000 7effe67fc700 1 --2- 172.21.15.59:0/349763522 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effe806b100 0x7effe80712c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7effe806d660 tx=0x7effd0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.039+0000 7effdf7fe700 1 -- 172.21.15.59:0/349763522 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd00036a0 con 0x7effe806b100 2023-09-30T22:35:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.039+0000 7effdf7fe700 1 -- 172.21.15.59:0/349763522 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd0003800 con 0x7effe806b100 2023-09-30T22:35:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.039+0000 7effed36b700 1 -- 172.21.15.59:0/349763522 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd0009550 con 0x7effe806b100 2023-09-30T22:35:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.039+0000 7effdf7fe700 1 -- 172.21.15.59:0/349763522 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0003b90 con 0x7effe806b100 2023-09-30T22:35:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.039+0000 7effed36b700 1 -- 172.21.15.59:0/349763522 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe809a8c0 con 0x7effe806b100 2023-09-30T22:35:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.040+0000 7effdf7fe700 1 -- 172.21.15.59:0/349763522 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effd0021070 con 0x7effe806b100 2023-09-30T22:35:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.040+0000 7effdf7fe700 1 -- 172.21.15.59:0/349763522 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7effd0040ae0 con 0x7effe806b100 2023-09-30T22:35:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.041+0000 7effed36b700 1 -- 172.21.15.59:0/349763522 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe8072850 con 0x7effe806b100 2023-09-30T22:35:49.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.046+0000 7effdf7fe700 1 -- 172.21.15.59:0/349763522 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effd0015080 con 0x7effe806b100 2023-09-30T22:35:49.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.242+0000 7f5180a17700 1 -- 172.21.15.59:0/2247311622 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f517c122970 con 0x7f517c09f410 2023-09-30T22:35:49.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.242+0000 7f516affd700 1 -- 172.21.15.59:0/2247311622 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f517c122970 con 0x7f517c09f410 2023-09-30T22:35:49.243 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:49.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.245+0000 7f5180a17700 1 -- 172.21.15.59:0/2247311622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09f410 msgr2=0x7f517c11f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.246+0000 7f5180a17700 1 --2- 172.21.15.59:0/2247311622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09f410 0x7f517c11f9d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f517000e9e0 tx=0x7f517000ecf0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.246+0000 7f5180a17700 1 -- 172.21.15.59:0/2247311622 shutdown_connections 2023-09-30T22:35:49.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.246+0000 7f5180a17700 1 --2- 172.21.15.59:0/2247311622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f517c136fe0 0x7f517c11ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.246+0000 7f5180a17700 1 --2- 172.21.15.59:0/2247311622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f517c09e930 0x7f517c11f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.246+0000 7f5180a17700 1 --2- 172.21.15.59:0/2247311622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f517c09f410 0x7f517c11f9d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.246+0000 7f5180a17700 1 -- 172.21.15.59:0/2247311622 >> 172.21.15.59:0/2247311622 conn(0x7f517c0a4210 msgr2=0x7f517c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:49.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.246+0000 7f5180a17700 1 -- 172.21.15.59:0/2247311622 shutdown_connections 2023-09-30T22:35:49.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.246+0000 7f5180a17700 1 -- 172.21.15.59:0/2247311622 wait complete. 2023-09-30T22:35:49.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:49.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.289+0000 7effed36b700 1 -- 172.21.15.59:0/349763522 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7effe804f2a0 con 0x7effe806b100 2023-09-30T22:35:49.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.289+0000 7effdf7fe700 1 -- 172.21.15.59:0/349763522 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effd003ee60 con 0x7effe806b100 2023-09-30T22:35:49.290 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:49.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.292+0000 7effed36b700 1 -- 172.21.15.59:0/349763522 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effe806b100 msgr2=0x7effe80712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.292+0000 7effed36b700 1 --2- 172.21.15.59:0/349763522 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effe806b100 0x7effe80712c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7effe806d660 tx=0x7effd0004750 comp rx=0 tx=0).stop 2023-09-30T22:35:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.292+0000 7effed36b700 1 -- 172.21.15.59:0/349763522 shutdown_connections 2023-09-30T22:35:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.292+0000 7effed36b700 1 --2- 172.21.15.59:0/349763522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effe81317f0 0x7effe8071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.292+0000 7effed36b700 1 --2- 172.21.15.59:0/349763522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effe806a770 0x7effe8070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.292+0000 7effed36b700 1 --2- 172.21.15.59:0/349763522 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effe806b100 0x7effe80712c0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.292+0000 7effed36b700 1 -- 172.21.15.59:0/349763522 >> 172.21.15.59:0/349763522 conn(0x7effe8099c20 msgr2=0x7effe812f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.292+0000 7effed36b700 1 -- 172.21.15.59:0/349763522 shutdown_connections 2023-09-30T22:35:49.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.292+0000 7effed36b700 1 -- 172.21.15.59:0/349763522 wait complete. 2023-09-30T22:35:49.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:49.313 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:49.356 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:49.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.490+0000 7f66ea20d700 1 Processor -- start 2023-09-30T22:35:49.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.490+0000 7f66ea20d700 1 -- start start 2023-09-30T22:35:49.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.491+0000 7f66ea20d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66e40a0a30 0x7f66e40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.491+0000 7f66ea20d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e4134170 0x7f66e413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.491+0000 7f66ea20d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e409edd0 con 0x7f66e40a1340 2023-09-30T22:35:49.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.491+0000 7f66ea20d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e409e1f0 con 0x7f66e40a0a30 2023-09-30T22:35:49.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.491+0000 7f66ea20d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e409dc50 con 0x7f66e4134170 2023-09-30T22:35:49.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.491+0000 7f66e3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e4134170 0x7f66e413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.491+0000 7f66e3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e4134170 0x7f66e413bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40492/0 (socket says 172.21.15.59:40492) 2023-09-30T22:35:49.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.491+0000 7f66e3fff700 1 -- 172.21.15.59:0/1442619141 learned_addr learned my addr 172.21.15.59:0/1442619141 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:49.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.491+0000 7f66e37fe700 1 --2- 172.21.15.59:0/1442619141 >> v2:172.21.15.59:3300/0 conn(0x7f66e40a0a30 0x7f66e40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.491+0000 7f66e37fe700 1 -- 172.21.15.59:0/1442619141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e4134170 msgr2=0x7f66e413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.491+0000 7f66e37fe700 1 --2- 172.21.15.59:0/1442619141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e4134170 0x7f66e413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.491+0000 7f66e37fe700 1 -- 172.21.15.59:0/1442619141 >> v1:172.21.15.59:6789/0 conn(0x7f66e40a1340 legacy=0x7f66e4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.491+0000 7f66e37fe700 1 -- 172.21.15.59:0/1442619141 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e40a1fe0 con 0x7f66e40a0a30 2023-09-30T22:35:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.491+0000 7f66e3fff700 1 --2- 172.21.15.59:0/1442619141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e4134170 0x7f66e413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.491+0000 7f66e37fe700 1 --2- 172.21.15.59:0/1442619141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e40a0a30 0x7f66e40a0e00 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009d90 tx=0x7f66d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5ff70099265cdb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.492+0000 7f66e27fc700 1 -- 172.21.15.59:0/1442619141 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d400e070 con 0x7f66e40a0a30 2023-09-30T22:35:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.492+0000 7f66e27fc700 1 -- 172.21.15.59:0/1442619141 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d400bb20 con 0x7f66e40a0a30 2023-09-30T22:35:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.492+0000 7f66e27fc700 1 -- 172.21.15.59:0/1442619141 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4012430 con 0x7f66e40a0a30 2023-09-30T22:35:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.492+0000 7f66ea20d700 1 -- 172.21.15.59:0/1442619141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e40a0a30 msgr2=0x7f66e40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.492+0000 7f66ea20d700 1 --2- 172.21.15.59:0/1442619141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e40a0a30 0x7f66e40a0e00 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009d90 tx=0x7f66d400b330 comp rx=0 tx=0).stop 2023-09-30T22:35:49.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.492+0000 7f66ea20d700 1 -- 172.21.15.59:0/1442619141 shutdown_connections 2023-09-30T22:35:49.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.492+0000 7f66ea20d700 1 --2- 172.21.15.59:0/1442619141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e40a0a30 0x7f66e40a0e00 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.492+0000 7f66ea20d700 1 --2- 172.21.15.59:0/1442619141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e4134170 0x7f66e413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.492+0000 7f66ea20d700 1 -- 172.21.15.59:0/1442619141 >> 172.21.15.59:0/1442619141 conn(0x7f66e40a6550 msgr2=0x7f66e40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:49.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.492+0000 7f66ea20d700 1 -- 172.21.15.59:0/1442619141 shutdown_connections 2023-09-30T22:35:49.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.492+0000 7f66ea20d700 1 -- 172.21.15.59:0/1442619141 wait complete. 2023-09-30T22:35:49.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.493+0000 7f66ea20d700 1 Processor -- start 2023-09-30T22:35:49.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.494+0000 7f66ea20d700 1 -- start start 2023-09-30T22:35:49.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.494+0000 7f66ea20d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e40a0a30 0x7f66e41c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.494+0000 7f66ea20d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66e40a1340 0x7f66e41c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.494+0000 7f66ea20d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e4134170 0x7f66e41c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.494+0000 7f66ea20d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e41246b0 con 0x7f66e4134170 2023-09-30T22:35:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.494+0000 7f66ea20d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40a0220 con 0x7f66e40a0a30 2023-09-30T22:35:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.494+0000 7f66ea20d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66e4126190 con 0x7f66e40a1340 2023-09-30T22:35:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.494+0000 7f66e37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e40a0a30 0x7f66e41c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.494+0000 7f66e37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e40a0a30 0x7f66e41c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40508/0 (socket says 172.21.15.59:40508) 2023-09-30T22:35:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.494+0000 7f66e37fe700 1 -- 172.21.15.59:0/1274706547 learned_addr learned my addr 172.21.15.59:0/1274706547 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.494+0000 7f66e3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e4134170 0x7f66e41c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.494+0000 7f66e2ffd700 1 --2- 172.21.15.59:0/1274706547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66e40a1340 0x7f66e41c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.495+0000 7f66e37fe700 1 -- 172.21.15.59:0/1274706547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66e40a1340 msgr2=0x7f66e41c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.495+0000 7f66e37fe700 1 --2- 172.21.15.59:0/1274706547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66e40a1340 0x7f66e41c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.495+0000 7f66e37fe700 1 -- 172.21.15.59:0/1274706547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e4134170 msgr2=0x7f66e41c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.495+0000 7f66e37fe700 1 --2- 172.21.15.59:0/1274706547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e4134170 0x7f66e41c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.495+0000 7f66e37fe700 1 -- 172.21.15.59:0/1274706547 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc009550 con 0x7f66e40a0a30 2023-09-30T22:35:49.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.495+0000 7f66e3fff700 1 --2- 172.21.15.59:0/1274706547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e4134170 0x7f66e41c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:49.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.495+0000 7f66e37fe700 1 --2- 172.21.15.59:0/1274706547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e40a0a30 0x7f66e41c8480 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f66d400b680 tx=0x7f66d4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:49.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.495+0000 7f66dbfff700 1 -- 172.21.15.59:0/1274706547 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4012430 con 0x7f66e40a0a30 2023-09-30T22:35:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.495+0000 7f66dbfff700 1 -- 172.21.15.59:0/1274706547 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d4020070 con 0x7f66e40a0a30 2023-09-30T22:35:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.495+0000 7f66ea20d700 1 -- 172.21.15.59:0/1274706547 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d4009a70 con 0x7f66e40a0a30 2023-09-30T22:35:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.495+0000 7f66dbfff700 1 -- 172.21.15.59:0/1274706547 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d40276c0 con 0x7f66e40a0a30 2023-09-30T22:35:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.495+0000 7f66ea20d700 1 -- 172.21.15.59:0/1274706547 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e40a25e0 con 0x7f66e40a0a30 2023-09-30T22:35:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.496+0000 7f66dbfff700 1 -- 172.21.15.59:0/1274706547 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66d401c400 con 0x7f66e40a0a30 2023-09-30T22:35:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.496+0000 7f66dbfff700 1 -- 172.21.15.59:0/1274706547 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f66d4022070 con 0x7f66e40a0a30 2023-09-30T22:35:49.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.496+0000 7f66ea20d700 1 -- 172.21.15.59:0/1274706547 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e4074ea0 con 0x7f66e40a0a30 2023-09-30T22:35:49.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.501+0000 7f66dbfff700 1 -- 172.21.15.59:0/1274706547 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66d401c890 con 0x7f66e40a0a30 2023-09-30T22:35:49.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.532+0000 7fb6e60c1700 1 Processor -- start 2023-09-30T22:35:49.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.532+0000 7fb6e60c1700 1 -- start start 2023-09-30T22:35:49.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.532+0000 7fb6e60c1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6e00a0a30 0x7fb6e00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.532+0000 7fb6e60c1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e0138d80 0x7fb6e013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.532+0000 7fb6e60c1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e00a2a70 con 0x7fb6e009d630 2023-09-30T22:35:49.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.532+0000 7fb6e60c1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e00a01d0 con 0x7fb6e00a0a30 2023-09-30T22:35:49.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.532+0000 7fb6e60c1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e009e2b0 con 0x7fb6e0138d80 2023-09-30T22:35:49.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.532+0000 7fb6dffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e0138d80 0x7fb6e013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.533+0000 7fb6dffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e0138d80 0x7fb6e013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45242/0 (socket says 172.21.15.59:45242) 2023-09-30T22:35:49.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.533+0000 7fb6dffff700 1 -- 172.21.15.59:0/125040303 learned_addr learned my addr 172.21.15.59:0/125040303 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:49.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.533+0000 7fb6df7fe700 1 --2- 172.21.15.59:0/125040303 >> v2:172.21.15.59:3300/0 conn(0x7fb6e00a0a30 0x7fb6e00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.533+0000 7fb6dffff700 1 -- 172.21.15.59:0/125040303 >> v2:172.21.15.59:3300/0 conn(0x7fb6e00a0a30 msgr2=0x7fb6e00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:49.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.533+0000 7fb6dffff700 1 --2- 172.21.15.59:0/125040303 >> v2:172.21.15.59:3300/0 conn(0x7fb6e00a0a30 0x7fb6e00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.533+0000 7fb6dffff700 1 -- 172.21.15.59:0/125040303 >> v1:172.21.15.59:6789/0 conn(0x7fb6e009d630 legacy=0x7fb6e00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.533+0000 7fb6dffff700 1 -- 172.21.15.59:0/125040303 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e009dc50 con 0x7fb6e0138d80 2023-09-30T22:35:49.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.533+0000 7fb6df7fe700 1 --2- 172.21.15.59:0/125040303 >> v2:172.21.15.59:3300/0 conn(0x7fb6e00a0a30 0x7fb6e00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:49.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.533+0000 7fb6dffff700 1 --2- 172.21.15.59:0/125040303 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e0138d80 0x7fb6e013b160 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009e50 tx=0x7fb6d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2664728cffa7ee70 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:49.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.533+0000 7fb6de7fc700 1 -- 172.21.15.59:0/125040303 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d800e070 con 0x7fb6e0138d80 2023-09-30T22:35:49.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.533+0000 7fb6de7fc700 1 -- 172.21.15.59:0/125040303 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d800b910 con 0x7fb6e0138d80 2023-09-30T22:35:49.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.533+0000 7fb6de7fc700 1 -- 172.21.15.59:0/125040303 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d800bcc0 con 0x7fb6e0138d80 2023-09-30T22:35:49.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.534+0000 7fb6e60c1700 1 -- 172.21.15.59:0/125040303 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e0138d80 msgr2=0x7fb6e013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.534+0000 7fb6e60c1700 1 --2- 172.21.15.59:0/125040303 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e0138d80 0x7fb6e013b160 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009e50 tx=0x7fb6d800b330 comp rx=0 tx=0).stop 2023-09-30T22:35:49.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.534+0000 7fb6e60c1700 1 -- 172.21.15.59:0/125040303 shutdown_connections 2023-09-30T22:35:49.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.534+0000 7fb6e60c1700 1 --2- 172.21.15.59:0/125040303 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e0138d80 0x7fb6e013b160 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.534+0000 7fb6e60c1700 1 --2- 172.21.15.59:0/125040303 >> v2:172.21.15.59:3300/0 conn(0x7fb6e00a0a30 0x7fb6e00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.534+0000 7fb6e60c1700 1 -- 172.21.15.59:0/125040303 >> 172.21.15.59:0/125040303 conn(0x7fb6e00a3050 msgr2=0x7fb6e00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:49.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.534+0000 7fb6e60c1700 1 -- 172.21.15.59:0/125040303 shutdown_connections 2023-09-30T22:35:49.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.534+0000 7fb6e60c1700 1 -- 172.21.15.59:0/125040303 wait complete. 2023-09-30T22:35:49.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.535+0000 7fb6e60c1700 1 Processor -- start 2023-09-30T22:35:49.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.535+0000 7fb6e60c1700 1 -- start start 2023-09-30T22:35:49.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6e60c1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e009d630 0x7fb6e0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6e60c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e00a0a30 0x7fb6e0133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6e60c1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e0138d80 0x7fb6e01344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:49.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6e60c1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e0136b90 con 0x7fb6e0138d80 2023-09-30T22:35:49.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6e60c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e0138090 con 0x7fb6e00a0a30 2023-09-30T22:35:49.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6e60c1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e01374b0 con 0x7fb6e009d630 2023-09-30T22:35:49.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6df7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e009d630 0x7fb6e0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6df7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e009d630 0x7fb6e0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45258/0 (socket says 172.21.15.59:45258) 2023-09-30T22:35:49.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6df7fe700 1 -- 172.21.15.59:0/2868499681 learned_addr learned my addr 172.21.15.59:0/2868499681 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:49.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6deffd700 1 --2- 172.21.15.59:0/2868499681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e00a0a30 0x7fb6e0133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6dffff700 1 --2- 172.21.15.59:0/2868499681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e0138d80 0x7fb6e01344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:49.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6df7fe700 1 -- 172.21.15.59:0/2868499681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e00a0a30 msgr2=0x7fb6e0133f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6df7fe700 1 --2- 172.21.15.59:0/2868499681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e00a0a30 0x7fb6e0133f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6df7fe700 1 -- 172.21.15.59:0/2868499681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e0138d80 msgr2=0x7fb6e01344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6df7fe700 1 --2- 172.21.15.59:0/2868499681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e0138d80 0x7fb6e01344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6df7fe700 1 -- 172.21.15.59:0/2868499681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d00094a0 con 0x7fb6e009d630 2023-09-30T22:35:49.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.536+0000 7fb6df7fe700 1 --2- 172.21.15.59:0/2868499681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e009d630 0x7fb6e0133a30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000ec10 tx=0x7fb6d000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:49.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.537+0000 7fb6c7fff700 1 -- 172.21.15.59:0/2868499681 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d000c850 con 0x7fb6e009d630 2023-09-30T22:35:49.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.537+0000 7fb6c7fff700 1 -- 172.21.15.59:0/2868499681 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d000c9b0 con 0x7fb6e009d630 2023-09-30T22:35:49.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.537+0000 7fb6e60c1700 1 -- 172.21.15.59:0/2868499681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d8009b30 con 0x7fb6e009d630 2023-09-30T22:35:49.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.537+0000 7fb6c7fff700 1 -- 172.21.15.59:0/2868499681 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d000cd20 con 0x7fb6e009d630 2023-09-30T22:35:49.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.537+0000 7fb6e60c1700 1 -- 172.21.15.59:0/2868499681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e01371d0 con 0x7fb6e009d630 2023-09-30T22:35:49.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.537+0000 7fb6c7fff700 1 -- 172.21.15.59:0/2868499681 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6d0013470 con 0x7fb6e009d630 2023-09-30T22:35:49.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.538+0000 7fb6c7fff700 1 -- 172.21.15.59:0/2868499681 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb6d003fb80 con 0x7fb6e009d630 2023-09-30T22:35:49.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.538+0000 7fb6e60c1700 1 -- 172.21.15.59:0/2868499681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e00747f0 con 0x7fb6e009d630 2023-09-30T22:35:49.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.543+0000 7fb6c7fff700 1 -- 172.21.15.59:0/2868499681 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6d003fe60 con 0x7fb6e009d630 2023-09-30T22:35:49.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.712+0000 7f66ea20d700 1 -- 172.21.15.59:0/1274706547 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f66e40a28e0 con 0x7f66e40a0a30 2023-09-30T22:35:49.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.712+0000 7f66dbfff700 1 -- 172.21.15.59:0/1274706547 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66d4025380 con 0x7f66e40a0a30 2023-09-30T22:35:49.712 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:49.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.714+0000 7f66ea20d700 1 -- 172.21.15.59:0/1274706547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e40a0a30 msgr2=0x7f66e41c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.714+0000 7f66ea20d700 1 --2- 172.21.15.59:0/1274706547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e40a0a30 0x7f66e41c8480 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f66d400b680 tx=0x7f66d4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.714+0000 7f66ea20d700 1 -- 172.21.15.59:0/1274706547 shutdown_connections 2023-09-30T22:35:49.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.714+0000 7f66ea20d700 1 --2- 172.21.15.59:0/1274706547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e4134170 0x7f66e41c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.714+0000 7f66ea20d700 1 --2- 172.21.15.59:0/1274706547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e40a0a30 0x7f66e41c8480 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.714+0000 7f66ea20d700 1 --2- 172.21.15.59:0/1274706547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66e40a1340 0x7f66e41c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.714+0000 7f66ea20d700 1 -- 172.21.15.59:0/1274706547 >> 172.21.15.59:0/1274706547 conn(0x7f66e40a6550 msgr2=0x7f66e411c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.715+0000 7f66ea20d700 1 -- 172.21.15.59:0/1274706547 shutdown_connections 2023-09-30T22:35:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.715+0000 7f66ea20d700 1 -- 172.21.15.59:0/1274706547 wait complete. 2023-09-30T22:35:49.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:49.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.748+0000 7fb6e60c1700 1 -- 172.21.15.59:0/2868499681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb6e0137030 con 0x7fb6e009d630 2023-09-30T22:35:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.749+0000 7fb6c7fff700 1 -- 172.21.15.59:0/2868499681 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6e0137030 con 0x7fb6e009d630 2023-09-30T22:35:49.749 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.751+0000 7fb6e60c1700 1 -- 172.21.15.59:0/2868499681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e009d630 msgr2=0x7fb6e0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.751+0000 7fb6e60c1700 1 --2- 172.21.15.59:0/2868499681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e009d630 0x7fb6e0133a30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000ec10 tx=0x7fb6d000ef20 comp rx=0 tx=0).stop 2023-09-30T22:35:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.751+0000 7fb6e60c1700 1 -- 172.21.15.59:0/2868499681 shutdown_connections 2023-09-30T22:35:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.751+0000 7fb6e60c1700 1 --2- 172.21.15.59:0/2868499681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6e009d630 0x7fb6e0133a30 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.751+0000 7fb6e60c1700 1 --2- 172.21.15.59:0/2868499681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6e0138d80 0x7fb6e01344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.751+0000 7fb6e60c1700 1 --2- 172.21.15.59:0/2868499681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6e00a0a30 0x7fb6e0133f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:49.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.751+0000 7fb6e60c1700 1 -- 172.21.15.59:0/2868499681 >> 172.21.15.59:0/2868499681 conn(0x7fb6e00a3050 msgr2=0x7fb6e009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:49.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.751+0000 7fb6e60c1700 1 -- 172.21.15.59:0/2868499681 shutdown_connections 2023-09-30T22:35:49.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:49.751+0000 7fb6e60c1700 1 -- 172.21.15.59:0/2868499681 wait complete. 2023-09-30T22:35:49.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:50.266 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:50.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.416+0000 7fdf551e4700 1 Processor -- start 2023-09-30T22:35:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.416+0000 7fdf551e4700 1 -- start start 2023-09-30T22:35:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf551e4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf50133a80 0x7fdf50133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf551e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5012ff20 0x7fdf50130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf551e4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf50130870 0x7fdf5013a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf551e4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5006c570 con 0x7fdf50133a80 2023-09-30T22:35:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf551e4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5006bc00 con 0x7fdf5012ff20 2023-09-30T22:35:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf551e4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf500a0040 con 0x7fdf50130870 2023-09-30T22:35:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf4ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf50133a80 0x7fdf50133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf4f59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf50130870 0x7fdf5013a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf4ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf50133a80 0x7fdf50133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52192/0 (socket says 172.21.15.59:52192) 2023-09-30T22:35:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf4ed9d700 1 -- 172.21.15.59:0/648650878 learned_addr learned my addr 172.21.15.59:0/648650878 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf4e59c700 1 --2- 172.21.15.59:0/648650878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5012ff20 0x7fdf50130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf4ed9d700 1 -- 172.21.15.59:0/648650878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf50130870 msgr2=0x7fdf5013a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf4ed9d700 1 --2- 172.21.15.59:0/648650878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf50130870 0x7fdf5013a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf4ed9d700 1 -- 172.21.15.59:0/648650878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5012ff20 msgr2=0x7fdf50130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf4ed9d700 1 --2- 172.21.15.59:0/648650878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5012ff20 0x7fdf50130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf4ed9d700 1 -- 172.21.15.59:0/648650878 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf50133860 con 0x7fdf50133a80 2023-09-30T22:35:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.417+0000 7fdf4f59e700 1 --2- 172.21.15.59:0/648650878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf50130870 0x7fdf5013a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.418+0000 7fdf4ed9d700 1 --2- 172.21.15.59:0/648650878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf50133a80 0x7fdf50133e50 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fdf400098f0 tx=0x7fdf40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e17557743b2b01 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.418+0000 7fdf4dd9b700 1 -- 172.21.15.59:0/648650878 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40011830 con 0x7fdf50133a80 2023-09-30T22:35:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.418+0000 7fdf4dd9b700 1 -- 172.21.15.59:0/648650878 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf40011990 con 0x7fdf50133a80 2023-09-30T22:35:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.418+0000 7fdf4dd9b700 1 -- 172.21.15.59:0/648650878 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40011d20 con 0x7fdf50133a80 2023-09-30T22:35:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.418+0000 7fdf551e4700 1 -- 172.21.15.59:0/648650878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf50133a80 msgr2=0x7fdf50133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.418+0000 7fdf551e4700 1 --2- 172.21.15.59:0/648650878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf50133a80 0x7fdf50133e50 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fdf400098f0 tx=0x7fdf40009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.418+0000 7fdf551e4700 1 -- 172.21.15.59:0/648650878 shutdown_connections 2023-09-30T22:35:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.418+0000 7fdf551e4700 1 --2- 172.21.15.59:0/648650878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf50130870 0x7fdf5013a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.418+0000 7fdf551e4700 1 --2- 172.21.15.59:0/648650878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf50133a80 0x7fdf50133e50 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.418+0000 7fdf551e4700 1 --2- 172.21.15.59:0/648650878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf5012ff20 0x7fdf50130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.418+0000 7fdf551e4700 1 -- 172.21.15.59:0/648650878 >> 172.21.15.59:0/648650878 conn(0x7fdf500a4210 msgr2=0x7fdf500a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.418+0000 7fdf551e4700 1 -- 172.21.15.59:0/648650878 shutdown_connections 2023-09-30T22:35:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.418+0000 7fdf551e4700 1 -- 172.21.15.59:0/648650878 wait complete. 2023-09-30T22:35:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.420+0000 7fdf551e4700 1 Processor -- start 2023-09-30T22:35:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.420+0000 7fdf551e4700 1 -- start start 2023-09-30T22:35:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.420+0000 7fdf551e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf5012ff20 0x7fdf5009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.420+0000 7fdf551e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf50130870 0x7fdf5009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.420+0000 7fdf551e4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf50133a80 0x7fdf5009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.420+0000 7fdf551e4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5012d8a0 con 0x7fdf5012ff20 2023-09-30T22:35:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.420+0000 7fdf551e4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5009e050 con 0x7fdf50130870 2023-09-30T22:35:50.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.420+0000 7fdf551e4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5011fe10 con 0x7fdf50133a80 2023-09-30T22:35:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.420+0000 7fdf4ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf5012ff20 0x7fdf5009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf4e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf50130870 0x7fdf5009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf4ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf5012ff20 0x7fdf5009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52198/0 (socket says 172.21.15.59:52198) 2023-09-30T22:35:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf4ed9d700 1 -- 172.21.15.59:0/230270310 learned_addr learned my addr 172.21.15.59:0/230270310 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf4f59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf50133a80 0x7fdf5009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf4e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf50130870 0x7fdf5009c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40518/0 (socket says 172.21.15.59:40518) 2023-09-30T22:35:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf4ed9d700 1 -- 172.21.15.59:0/230270310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf50133a80 msgr2=0x7fdf5009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf4ed9d700 1 --2- 172.21.15.59:0/230270310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf50133a80 0x7fdf5009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf4ed9d700 1 -- 172.21.15.59:0/230270310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf50130870 msgr2=0x7fdf5009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf4ed9d700 1 --2- 172.21.15.59:0/230270310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf50130870 0x7fdf5009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf4ed9d700 1 -- 172.21.15.59:0/230270310 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf48009a70 con 0x7fdf5012ff20 2023-09-30T22:35:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf4e59c700 1 --2- 172.21.15.59:0/230270310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf50130870 0x7fdf5009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf4f59e700 1 --2- 172.21.15.59:0/230270310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf50133a80 0x7fdf5009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf4ed9d700 1 --2- 172.21.15.59:0/230270310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf5012ff20 0x7fdf5009c480 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fdf40000c00 tx=0x7fdf40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf377fe700 1 -- 172.21.15.59:0/230270310 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40004240 con 0x7fdf5012ff20 2023-09-30T22:35:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf377fe700 1 -- 172.21.15.59:0/230270310 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4001f070 con 0x7fdf5012ff20 2023-09-30T22:35:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf551e4700 1 -- 172.21.15.59:0/230270310 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf40009550 con 0x7fdf5012ff20 2023-09-30T22:35:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf377fe700 1 -- 172.21.15.59:0/230270310 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf400045c0 con 0x7fdf5012ff20 2023-09-30T22:35:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.421+0000 7fdf551e4700 1 -- 172.21.15.59:0/230270310 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5012db20 con 0x7fdf5012ff20 2023-09-30T22:35:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.422+0000 7fdf377fe700 1 -- 172.21.15.59:0/230270310 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf40021030 con 0x7fdf5012ff20 2023-09-30T22:35:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.423+0000 7fdf377fe700 1 -- 172.21.15.59:0/230270310 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdf40040810 con 0x7fdf5012ff20 2023-09-30T22:35:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.423+0000 7fdf551e4700 1 -- 172.21.15.59:0/230270310 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf50074ea0 con 0x7fdf5012ff20 2023-09-30T22:35:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.428+0000 7fdf377fe700 1 -- 172.21.15.59:0/230270310 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf40015070 con 0x7fdf5012ff20 2023-09-30T22:35:50.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.453+0000 7f1853bf7700 1 Processor -- start 2023-09-30T22:35:50.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.454+0000 7f1853bf7700 1 -- start start 2023-09-30T22:35:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.454+0000 7f1853bf7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184c0a0a30 0x7f184c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.454+0000 7f1853bf7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184c138d80 0x7f184c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.454+0000 7f1853bf7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f184c0a2a70 con 0x7f184c09d630 2023-09-30T22:35:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.454+0000 7f1853bf7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184c0a01d0 con 0x7f184c138d80 2023-09-30T22:35:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.454+0000 7f1853bf7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f184c09e2b0 con 0x7f184c0a0a30 2023-09-30T22:35:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.454+0000 7f1852194700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184c138d80 0x7f184c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.454+0000 7f1851993700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184c0a0a30 0x7f184c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.454+0000 7f1851993700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184c0a0a30 0x7f184c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45280/0 (socket says 172.21.15.59:45280) 2023-09-30T22:35:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.454+0000 7f1852194700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184c138d80 0x7f184c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40526/0 (socket says 172.21.15.59:40526) 2023-09-30T22:35:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.454+0000 7f1851192700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f184c09d630 0x7f184c0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54220/0 (socket says 172.21.15.59:54220) 2023-09-30T22:35:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.454+0000 7f1851993700 1 -- 172.21.15.59:0/3890471435 learned_addr learned my addr 172.21.15.59:0/3890471435 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.455+0000 7f1852194700 1 -- 172.21.15.59:0/3890471435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184c0a0a30 msgr2=0x7f184c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.455+0000 7f1852194700 1 --2- 172.21.15.59:0/3890471435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184c0a0a30 0x7f184c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.455+0000 7f1852194700 1 -- 172.21.15.59:0/3890471435 >> v1:172.21.15.59:6789/0 conn(0x7f184c09d630 legacy=0x7f184c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.455+0000 7f1852194700 1 -- 172.21.15.59:0/3890471435 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c09dc50 con 0x7f184c138d80 2023-09-30T22:35:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.455+0000 7f1850991700 1 -- 172.21.15.59:0/3890471435 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597484575 0 0) 0x7f184c0a2a70 con 0x7f184c09d630 2023-09-30T22:35:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.455+0000 7f1851993700 1 --2- 172.21.15.59:0/3890471435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184c0a0a30 0x7f184c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.455+0000 7f1852194700 1 --2- 172.21.15.59:0/3890471435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184c138d80 0x7f184c13b160 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1844009870 tx=0x7f1844009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=870d16ffbc8fba6d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:50.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.455+0000 7f1850991700 1 -- 172.21.15.59:0/3890471435 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844011830 con 0x7f184c138d80 2023-09-30T22:35:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.455+0000 7f1850991700 1 -- 172.21.15.59:0/3890471435 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1844011990 con 0x7f184c138d80 2023-09-30T22:35:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.455+0000 7f1850991700 1 -- 172.21.15.59:0/3890471435 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844011d20 con 0x7f184c138d80 2023-09-30T22:35:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.456+0000 7f1853bf7700 1 -- 172.21.15.59:0/3890471435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184c138d80 msgr2=0x7f184c13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.456+0000 7f1853bf7700 1 --2- 172.21.15.59:0/3890471435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184c138d80 0x7f184c13b160 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1844009870 tx=0x7f1844009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.456+0000 7f1853bf7700 1 -- 172.21.15.59:0/3890471435 shutdown_connections 2023-09-30T22:35:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.456+0000 7f1853bf7700 1 --2- 172.21.15.59:0/3890471435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184c0a0a30 0x7f184c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.456+0000 7f1853bf7700 1 --2- 172.21.15.59:0/3890471435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184c138d80 0x7f184c13b160 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.456+0000 7f1853bf7700 1 -- 172.21.15.59:0/3890471435 >> 172.21.15.59:0/3890471435 conn(0x7f184c0a3050 msgr2=0x7f184c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.456+0000 7f1853bf7700 1 -- 172.21.15.59:0/3890471435 shutdown_connections 2023-09-30T22:35:50.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.456+0000 7f1853bf7700 1 -- 172.21.15.59:0/3890471435 wait complete. 2023-09-30T22:35:50.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.457+0000 7f1853bf7700 1 Processor -- start 2023-09-30T22:35:50.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.457+0000 7f1853bf7700 1 -- start start 2023-09-30T22:35:50.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.457+0000 7f1853bf7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184c09d630 0x7f184c133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.457+0000 7f1853bf7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f184c0a0a30 0x7f184c133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.457+0000 7f1853bf7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184c138d80 0x7f184c134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.457+0000 7f1853bf7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c134bd0 con 0x7f184c0a0a30 2023-09-30T22:35:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.457+0000 7f1853bf7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184c136140 con 0x7f184c09d630 2023-09-30T22:35:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.457+0000 7f1853bf7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f184c136e60 con 0x7f184c138d80 2023-09-30T22:35:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f1851993700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184c09d630 0x7f184c133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f1852194700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184c138d80 0x7f184c134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f1851192700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f184c0a0a30 0x7f184c133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f1851993700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184c09d630 0x7f184c133700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40528/0 (socket says 172.21.15.59:40528) 2023-09-30T22:35:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f1851993700 1 -- 172.21.15.59:0/2290257829 learned_addr learned my addr 172.21.15.59:0/2290257829 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:50.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f1852194700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184c138d80 0x7f184c134180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45296/0 (socket says 172.21.15.59:45296) 2023-09-30T22:35:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f1851993700 1 -- 172.21.15.59:0/2290257829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184c138d80 msgr2=0x7f184c134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f1851993700 1 --2- 172.21.15.59:0/2290257829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184c138d80 0x7f184c134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f1851993700 1 -- 172.21.15.59:0/2290257829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f184c0a0a30 msgr2=0x7f184c133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f1851993700 1 --2- 172.21.15.59:0/2290257829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f184c0a0a30 0x7f184c133c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f1851993700 1 -- 172.21.15.59:0/2290257829 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c009b30 con 0x7f184c09d630 2023-09-30T22:35:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f1852194700 1 --2- 172.21.15.59:0/2290257829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184c138d80 0x7f184c134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f1851192700 1 --2- 172.21.15.59:0/2290257829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f184c0a0a30 0x7f184c133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f1851993700 1 --2- 172.21.15.59:0/2290257829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184c09d630 0x7f184c133700 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f183c009f20 tx=0x7f183c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f184a7fc700 1 -- 172.21.15.59:0/2290257829 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c00cbc0 con 0x7f184c09d630 2023-09-30T22:35:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f184a7fc700 1 -- 172.21.15.59:0/2290257829 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c00f040 con 0x7f184c09d630 2023-09-30T22:35:50.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f184a7fc700 1 -- 172.21.15.59:0/2290257829 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c014480 con 0x7f184c09d630 2023-09-30T22:35:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.458+0000 7f1853bf7700 1 -- 172.21.15.59:0/2290257829 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18440094a0 con 0x7f184c09d630 2023-09-30T22:35:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.459+0000 7f1853bf7700 1 -- 172.21.15.59:0/2290257829 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184c1364f0 con 0x7f184c09d630 2023-09-30T22:35:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.459+0000 7f184a7fc700 1 -- 172.21.15.59:0/2290257829 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f183c0145e0 con 0x7f184c09d630 2023-09-30T22:35:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.460+0000 7f1853bf7700 1 -- 172.21.15.59:0/2290257829 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184c0747f0 con 0x7f184c09d630 2023-09-30T22:35:50.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.460+0000 7f184a7fc700 1 -- 172.21.15.59:0/2290257829 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f183c03fbe0 con 0x7f184c09d630 2023-09-30T22:35:50.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.465+0000 7f184a7fc700 1 -- 172.21.15.59:0/2290257829 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f183c0128f0 con 0x7f184c09d630 2023-09-30T22:35:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.635+0000 7fdf551e4700 1 -- 172.21.15.59:0/230270310 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdf5009a6d0 con 0x7fdf5012ff20 2023-09-30T22:35:50.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.636+0000 7fdf377fe700 1 -- 172.21.15.59:0/230270310 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf4001a450 con 0x7fdf5012ff20 2023-09-30T22:35:50.636 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:50.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.638+0000 7fdf551e4700 1 -- 172.21.15.59:0/230270310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf5012ff20 msgr2=0x7fdf5009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.638+0000 7fdf551e4700 1 --2- 172.21.15.59:0/230270310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf5012ff20 0x7fdf5009c480 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fdf40000c00 tx=0x7fdf40004750 comp rx=0 tx=0).stop 2023-09-30T22:35:50.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.638+0000 7fdf551e4700 1 -- 172.21.15.59:0/230270310 shutdown_connections 2023-09-30T22:35:50.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.638+0000 7fdf551e4700 1 --2- 172.21.15.59:0/230270310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf50133a80 0x7fdf5009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.638+0000 7fdf551e4700 1 --2- 172.21.15.59:0/230270310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf5012ff20 0x7fdf5009c480 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.638+0000 7fdf551e4700 1 --2- 172.21.15.59:0/230270310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf50130870 0x7fdf5009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.638+0000 7fdf551e4700 1 -- 172.21.15.59:0/230270310 >> 172.21.15.59:0/230270310 conn(0x7fdf500a4210 msgr2=0x7fdf5009e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:50.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.638+0000 7fdf551e4700 1 -- 172.21.15.59:0/230270310 shutdown_connections 2023-09-30T22:35:50.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.638+0000 7fdf551e4700 1 -- 172.21.15.59:0/230270310 wait complete. 2023-09-30T22:35:50.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:50.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.670+0000 7f1853bf7700 1 -- 172.21.15.59:0/2290257829 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f184c072980 con 0x7f184c09d630 2023-09-30T22:35:50.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.670+0000 7f184a7fc700 1 -- 172.21.15.59:0/2290257829 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f183c0126c0 con 0x7f184c09d630 2023-09-30T22:35:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:50.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.672+0000 7f1853bf7700 1 -- 172.21.15.59:0/2290257829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184c09d630 msgr2=0x7f184c133700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.672+0000 7f1853bf7700 1 --2- 172.21.15.59:0/2290257829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184c09d630 0x7f184c133700 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f183c009f20 tx=0x7f183c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.672+0000 7f1853bf7700 1 -- 172.21.15.59:0/2290257829 shutdown_connections 2023-09-30T22:35:50.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.672+0000 7f1853bf7700 1 --2- 172.21.15.59:0/2290257829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184c138d80 0x7f184c134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.672+0000 7f1853bf7700 1 --2- 172.21.15.59:0/2290257829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184c09d630 0x7f184c133700 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.672+0000 7f1853bf7700 1 --2- 172.21.15.59:0/2290257829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f184c0a0a30 0x7f184c133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.672+0000 7f1853bf7700 1 -- 172.21.15.59:0/2290257829 >> 172.21.15.59:0/2290257829 conn(0x7f184c0a3050 msgr2=0x7f184c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:50.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.672+0000 7f1853bf7700 1 -- 172.21.15.59:0/2290257829 shutdown_connections 2023-09-30T22:35:50.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.672+0000 7f1853bf7700 1 -- 172.21.15.59:0/2290257829 wait complete. 2023-09-30T22:35:50.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:50.730 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:50.765 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:50.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.872+0000 7f0078bb8700 1 Processor -- start 2023-09-30T22:35:50.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.872+0000 7f0078bb8700 1 -- start start 2023-09-30T22:35:50.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.873+0000 7f0078bb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f007409d6f0 0x7f007409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.873+0000 7f0078bb8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f007409e000 0x7f0074130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.873+0000 7f0078bb8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007409f130 con 0x7f007409e410 2023-09-30T22:35:50.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.873+0000 7f0078bb8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007409f520 con 0x7f007409e000 2023-09-30T22:35:50.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.873+0000 7f0078bb8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f007409e930 con 0x7f007409d6f0 2023-09-30T22:35:50.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.873+0000 7f0071d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f007409e000 0x7f0074130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.873+0000 7f007259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f007409d6f0 0x7f007409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.873+0000 7f0071d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f007409e000 0x7f0074130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52216/0 (socket says 172.21.15.59:52216) 2023-09-30T22:35:50.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.873+0000 7f007259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f007409d6f0 0x7f007409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45300/0 (socket says 172.21.15.59:45300) 2023-09-30T22:35:50.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.873+0000 7f0071d9b700 1 -- 172.21.15.59:0/3352523950 learned_addr learned my addr 172.21.15.59:0/3352523950 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:50.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.874+0000 7f0071d9b700 1 -- 172.21.15.59:0/3352523950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f007409d6f0 msgr2=0x7f007409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:50.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.874+0000 7f0071d9b700 1 --2- 172.21.15.59:0/3352523950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f007409d6f0 0x7f007409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.874+0000 7f0071d9b700 1 -- 172.21.15.59:0/3352523950 >> v1:172.21.15.59:6789/0 conn(0x7f007409e410 legacy=0x7f0074130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.874+0000 7f0071d9b700 1 -- 172.21.15.59:0/3352523950 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007409b2d0 con 0x7f007409e000 2023-09-30T22:35:50.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.874+0000 7f007159a700 1 -- 172.21.15.59:0/3352523950 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604075909 0 0) 0x7f007409f130 con 0x7f007409e410 2023-09-30T22:35:50.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.874+0000 7f007259c700 1 --2- 172.21.15.59:0/3352523950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f007409d6f0 0x7f007409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:50.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.874+0000 7f0071d9b700 1 --2- 172.21.15.59:0/3352523950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007409e000 0x7f0074130660 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f005c0098f0 tx=0x7f005c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea45ef5681b434f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:50.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.874+0000 7f007159a700 1 -- 172.21.15.59:0/3352523950 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c011830 con 0x7f007409e000 2023-09-30T22:35:50.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.874+0000 7f007159a700 1 -- 172.21.15.59:0/3352523950 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c011990 con 0x7f007409e000 2023-09-30T22:35:50.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.874+0000 7f007159a700 1 -- 172.21.15.59:0/3352523950 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c011d20 con 0x7f007409e000 2023-09-30T22:35:50.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.875+0000 7f0078bb8700 1 -- 172.21.15.59:0/3352523950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007409e000 msgr2=0x7f0074130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.875+0000 7f0078bb8700 1 --2- 172.21.15.59:0/3352523950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007409e000 0x7f0074130660 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f005c0098f0 tx=0x7f005c009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:50.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.875+0000 7f0078bb8700 1 -- 172.21.15.59:0/3352523950 shutdown_connections 2023-09-30T22:35:50.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.875+0000 7f0078bb8700 1 --2- 172.21.15.59:0/3352523950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f007409d6f0 0x7f007409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.875+0000 7f0078bb8700 1 --2- 172.21.15.59:0/3352523950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007409e000 0x7f0074130660 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.875+0000 7f0078bb8700 1 -- 172.21.15.59:0/3352523950 >> 172.21.15.59:0/3352523950 conn(0x7f0074066f50 msgr2=0x7f007409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:50.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.875+0000 7f0078bb8700 1 -- 172.21.15.59:0/3352523950 shutdown_connections 2023-09-30T22:35:50.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.875+0000 7f0078bb8700 1 -- 172.21.15.59:0/3352523950 wait complete. 2023-09-30T22:35:50.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.876+0000 7f0078bb8700 1 Processor -- start 2023-09-30T22:35:50.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.877+0000 7f0078bb8700 1 -- start start 2023-09-30T22:35:50.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.877+0000 7f0078bb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f007409d6f0 0x7f007406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.877+0000 7f0078bb8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007409e000 0x7f007406ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.877+0000 7f0078bb8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f007409e410 0x7f007406f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.877+0000 7f0078bb8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007409c700 con 0x7f007409e000 2023-09-30T22:35:50.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.877+0000 7f0078bb8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0074070540 con 0x7f007409e410 2023-09-30T22:35:50.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.877+0000 7f0078bb8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0074125a70 con 0x7f007409d6f0 2023-09-30T22:35:50.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.877+0000 7f0071d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007409e000 0x7f007406ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.877+0000 7f0072d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f007409e410 0x7f007406f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.877+0000 7f0071d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007409e000 0x7f007406ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52230/0 (socket says 172.21.15.59:52230) 2023-09-30T22:35:50.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.877+0000 7f0071d9b700 1 -- 172.21.15.59:0/1291349825 learned_addr learned my addr 172.21.15.59:0/1291349825 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:50.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.878+0000 7f007259c700 1 --2- 172.21.15.59:0/1291349825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f007409d6f0 0x7f007406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.878+0000 7f0072d9d700 1 -- 172.21.15.59:0/1291349825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f007409d6f0 msgr2=0x7f007406e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.878+0000 7f0072d9d700 1 --2- 172.21.15.59:0/1291349825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f007409d6f0 0x7f007406e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.878+0000 7f0072d9d700 1 -- 172.21.15.59:0/1291349825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007409e000 msgr2=0x7f007406ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.878+0000 7f0072d9d700 1 --2- 172.21.15.59:0/1291349825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007409e000 0x7f007406ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.878+0000 7f0072d9d700 1 -- 172.21.15.59:0/1291349825 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c009a70 con 0x7f007409e410 2023-09-30T22:35:50.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.878+0000 7f0071d9b700 1 --2- 172.21.15.59:0/1291349825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007409e000 0x7f007406ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:50.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.878+0000 7f0072d9d700 1 --2- 172.21.15.59:0/1291349825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f007409e410 0x7f007406f2c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f00640011e0 tx=0x7f006400c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:50.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.878+0000 7f006affd700 1 -- 172.21.15.59:0/1291349825 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00640052d0 con 0x7f007409e410 2023-09-30T22:35:50.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.878+0000 7f006affd700 1 -- 172.21.15.59:0/1291349825 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0064005430 con 0x7f007409e410 2023-09-30T22:35:50.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.878+0000 7f0078bb8700 1 -- 172.21.15.59:0/1291349825 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005c009550 con 0x7f007409e410 2023-09-30T22:35:50.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.878+0000 7f006affd700 1 -- 172.21.15.59:0/1291349825 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00640038c0 con 0x7f007409e410 2023-09-30T22:35:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.878+0000 7f0078bb8700 1 -- 172.21.15.59:0/1291349825 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00740a1d60 con 0x7f007409e410 2023-09-30T22:35:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.879+0000 7f006affd700 1 -- 172.21.15.59:0/1291349825 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0064003c30 con 0x7f007409e410 2023-09-30T22:35:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.879+0000 7f006affd700 1 -- 172.21.15.59:0/1291349825 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f006403eba0 con 0x7f007409e410 2023-09-30T22:35:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.880+0000 7f0078bb8700 1 -- 172.21.15.59:0/1291349825 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0074125890 con 0x7f007409e410 2023-09-30T22:35:50.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.885+0000 7f006affd700 1 -- 172.21.15.59:0/1291349825 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0064017080 con 0x7f007409e410 2023-09-30T22:35:50.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.915+0000 7f3c42ab6700 1 Processor -- start 2023-09-30T22:35:50.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.916+0000 7f3c42ab6700 1 -- start start 2023-09-30T22:35:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.916+0000 7f3c42ab6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c3c09f410 0x7f3c3c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.916+0000 7f3c42ab6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c3c136fe0 0x7f3c3c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.916+0000 7f3c42ab6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3c070940 con 0x7f3c3c09e930 2023-09-30T22:35:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.916+0000 7f3c42ab6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3c06fd60 con 0x7f3c3c136fe0 2023-09-30T22:35:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.916+0000 7f3c42ab6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c06fa80 con 0x7f3c3c09f410 2023-09-30T22:35:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.916+0000 7f3c3bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c3c09f410 0x7f3c3c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.916+0000 7f3c3bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c3c09f410 0x7f3c3c136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45312/0 (socket says 172.21.15.59:45312) 2023-09-30T22:35:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.916+0000 7f3c3bfff700 1 -- 172.21.15.59:0/2864807276 learned_addr learned my addr 172.21.15.59:0/2864807276 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.916+0000 7f3c41053700 1 --2- 172.21.15.59:0/2864807276 >> v2:172.21.15.59:3300/0 conn(0x7f3c3c136fe0 0x7f3c3c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.917+0000 7f3c3bfff700 1 -- 172.21.15.59:0/2864807276 >> v2:172.21.15.59:3300/0 conn(0x7f3c3c136fe0 msgr2=0x7f3c3c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.917+0000 7f3c3bfff700 1 --2- 172.21.15.59:0/2864807276 >> v2:172.21.15.59:3300/0 conn(0x7f3c3c136fe0 0x7f3c3c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.917+0000 7f3c3bfff700 1 -- 172.21.15.59:0/2864807276 >> v1:172.21.15.59:6789/0 conn(0x7f3c3c09e930 legacy=0x7f3c3c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.917+0000 7f3c3bfff700 1 -- 172.21.15.59:0/2864807276 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c09fb60 con 0x7f3c3c09f410 2023-09-30T22:35:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.917+0000 7f3c41053700 1 --2- 172.21.15.59:0/2864807276 >> v2:172.21.15.59:3300/0 conn(0x7f3c3c136fe0 0x7f3c3c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.917+0000 7f3c3bfff700 1 --2- 172.21.15.59:0/2864807276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c3c09f410 0x7f3c3c136aa0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3c300098f0 tx=0x7f3c30009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=699a6ea70d4525d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.917+0000 7f3c3b7fe700 1 -- 172.21.15.59:0/2864807276 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30011830 con 0x7f3c3c09f410 2023-09-30T22:35:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.917+0000 7f3c3b7fe700 1 -- 172.21.15.59:0/2864807276 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c30011990 con 0x7f3c3c09f410 2023-09-30T22:35:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.917+0000 7f3c3b7fe700 1 -- 172.21.15.59:0/2864807276 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30011d20 con 0x7f3c3c09f410 2023-09-30T22:35:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.918+0000 7f3c42ab6700 1 -- 172.21.15.59:0/2864807276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c3c09f410 msgr2=0x7f3c3c136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.918+0000 7f3c42ab6700 1 --2- 172.21.15.59:0/2864807276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c3c09f410 0x7f3c3c136aa0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3c300098f0 tx=0x7f3c30009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:50.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.918+0000 7f3c42ab6700 1 -- 172.21.15.59:0/2864807276 shutdown_connections 2023-09-30T22:35:50.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.918+0000 7f3c42ab6700 1 --2- 172.21.15.59:0/2864807276 >> v2:172.21.15.59:3300/0 conn(0x7f3c3c136fe0 0x7f3c3c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.918+0000 7f3c42ab6700 1 --2- 172.21.15.59:0/2864807276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c3c09f410 0x7f3c3c136aa0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.918+0000 7f3c42ab6700 1 -- 172.21.15.59:0/2864807276 >> 172.21.15.59:0/2864807276 conn(0x7f3c3c0a4210 msgr2=0x7f3c3c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:50.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.918+0000 7f3c42ab6700 1 -- 172.21.15.59:0/2864807276 shutdown_connections 2023-09-30T22:35:50.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.918+0000 7f3c42ab6700 1 -- 172.21.15.59:0/2864807276 wait complete. 2023-09-30T22:35:50.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.919+0000 7f3c42ab6700 1 Processor -- start 2023-09-30T22:35:50.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.919+0000 7f3c42ab6700 1 -- start start 2023-09-30T22:35:50.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c42ab6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c3c09e930 0x7f3c3c1c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c42ab6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c3c09f410 0x7f3c3c1c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c42ab6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c3c136fe0 0x7f3c3c1c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:50.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c42ab6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c1223e0 con 0x7f3c3c09e930 2023-09-30T22:35:50.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c42ab6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c06d4c0 con 0x7f3c3c136fe0 2023-09-30T22:35:50.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c42ab6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c121db0 con 0x7f3c3c09f410 2023-09-30T22:35:50.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c3bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c3c09f410 0x7f3c3c1c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c41053700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c3c136fe0 0x7f3c3c1c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c3bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c3c09f410 0x7f3c3c1c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45314/0 (socket says 172.21.15.59:45314) 2023-09-30T22:35:50.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c3bfff700 1 -- 172.21.15.59:0/1640275725 learned_addr learned my addr 172.21.15.59:0/1640275725 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:50.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c40852700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c3c09e930 0x7f3c3c1c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:50.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c41053700 1 -- 172.21.15.59:0/1640275725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c3c09f410 msgr2=0x7f3c3c1c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c41053700 1 --2- 172.21.15.59:0/1640275725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c3c09f410 0x7f3c3c1c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c41053700 1 -- 172.21.15.59:0/1640275725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c3c09e930 msgr2=0x7f3c3c1c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:50.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c41053700 1 --2- 172.21.15.59:0/1640275725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c3c09e930 0x7f3c3c1c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:50.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c41053700 1 -- 172.21.15.59:0/1640275725 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c34009a70 con 0x7f3c3c136fe0 2023-09-30T22:35:50.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.920+0000 7f3c3bfff700 1 --2- 172.21.15.59:0/1640275725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c3c09f410 0x7f3c3c1c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:50.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.921+0000 7f3c41053700 1 --2- 172.21.15.59:0/1640275725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c3c136fe0 0x7f3c3c1c8d70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400efc0 tx=0x7f3c3400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:50.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.921+0000 7f3c397fa700 1 -- 172.21.15.59:0/1640275725 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3400cc90 con 0x7f3c3c136fe0 2023-09-30T22:35:50.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.921+0000 7f3c397fa700 1 -- 172.21.15.59:0/1640275725 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3400f040 con 0x7f3c3c136fe0 2023-09-30T22:35:50.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.921+0000 7f3c397fa700 1 -- 172.21.15.59:0/1640275725 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34014480 con 0x7f3c3c136fe0 2023-09-30T22:35:50.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.921+0000 7f3c42ab6700 1 -- 172.21.15.59:0/1640275725 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c30009550 con 0x7f3c3c136fe0 2023-09-30T22:35:50.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.921+0000 7f3c42ab6700 1 -- 172.21.15.59:0/1640275725 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3c071d20 con 0x7f3c3c136fe0 2023-09-30T22:35:50.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.922+0000 7f3c397fa700 1 -- 172.21.15.59:0/1640275725 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c34014600 con 0x7f3c3c136fe0 2023-09-30T22:35:50.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.922+0000 7f3c397fa700 1 -- 172.21.15.59:0/1640275725 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3c34040080 con 0x7f3c3c136fe0 2023-09-30T22:35:50.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.922+0000 7f3c42ab6700 1 -- 172.21.15.59:0/1640275725 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3c121fd0 con 0x7f3c3c136fe0 2023-09-30T22:35:50.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:50.927+0000 7f3c397fa700 1 -- 172.21.15.59:0/1640275725 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c340248f0 con 0x7f3c3c136fe0 2023-09-30T22:35:51.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.091+0000 7f0078bb8700 1 -- 172.21.15.59:0/1291349825 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0074074ea0 con 0x7f007409e410 2023-09-30T22:35:51.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.091+0000 7f006affd700 1 -- 172.21.15.59:0/1291349825 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f006400f260 con 0x7f007409e410 2023-09-30T22:35:51.091 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:51.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.093+0000 7f0078bb8700 1 -- 172.21.15.59:0/1291349825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f007409e410 msgr2=0x7f007406f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:51.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.093+0000 7f0078bb8700 1 --2- 172.21.15.59:0/1291349825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f007409e410 0x7f007406f2c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f00640011e0 tx=0x7f006400c710 comp rx=0 tx=0).stop 2023-09-30T22:35:51.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.093+0000 7f0078bb8700 1 -- 172.21.15.59:0/1291349825 shutdown_connections 2023-09-30T22:35:51.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.093+0000 7f0078bb8700 1 --2- 172.21.15.59:0/1291349825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f007409d6f0 0x7f007406e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.093+0000 7f0078bb8700 1 --2- 172.21.15.59:0/1291349825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f007409e410 0x7f007406f2c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.093+0000 7f0078bb8700 1 --2- 172.21.15.59:0/1291349825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f007409e000 0x7f007406ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.093+0000 7f0078bb8700 1 -- 172.21.15.59:0/1291349825 >> 172.21.15.59:0/1291349825 conn(0x7f0074066f50 msgr2=0x7f007406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:51.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.093+0000 7f0078bb8700 1 -- 172.21.15.59:0/1291349825 shutdown_connections 2023-09-30T22:35:51.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.093+0000 7f0078bb8700 1 -- 172.21.15.59:0/1291349825 wait complete. 2023-09-30T22:35:51.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:51.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.128+0000 7f3c42ab6700 1 -- 172.21.15.59:0/1640275725 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3c3c074ea0 con 0x7f3c3c136fe0 2023-09-30T22:35:51.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.128+0000 7f3c397fa700 1 -- 172.21.15.59:0/1640275725 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c3402b090 con 0x7f3c3c136fe0 2023-09-30T22:35:51.129 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:51.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.131+0000 7f3c42ab6700 1 -- 172.21.15.59:0/1640275725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c3c136fe0 msgr2=0x7f3c3c1c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:51.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.131+0000 7f3c42ab6700 1 --2- 172.21.15.59:0/1640275725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c3c136fe0 0x7f3c3c1c8d70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400efc0 tx=0x7f3c3400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.131+0000 7f3c42ab6700 1 -- 172.21.15.59:0/1640275725 shutdown_connections 2023-09-30T22:35:51.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.131+0000 7f3c42ab6700 1 --2- 172.21.15.59:0/1640275725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c3c136fe0 0x7f3c3c1c8d70 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.131+0000 7f3c42ab6700 1 --2- 172.21.15.59:0/1640275725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c3c09e930 0x7f3c3c1c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.131+0000 7f3c42ab6700 1 --2- 172.21.15.59:0/1640275725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c3c09f410 0x7f3c3c1c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.131+0000 7f3c42ab6700 1 -- 172.21.15.59:0/1640275725 >> 172.21.15.59:0/1640275725 conn(0x7f3c3c0a4210 msgr2=0x7f3c3c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:51.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.131+0000 7f3c42ab6700 1 -- 172.21.15.59:0/1640275725 shutdown_connections 2023-09-30T22:35:51.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.131+0000 7f3c42ab6700 1 -- 172.21.15.59:0/1640275725 wait complete. 2023-09-30T22:35:51.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:51.654 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:51.687 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:51.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.802+0000 7f689c9cc700 1 Processor -- start 2023-09-30T22:35:51.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.802+0000 7f689c9cc700 1 -- start start 2023-09-30T22:35:51.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.803+0000 7f689c9cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f689809f410 0x7f6898136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:51.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.803+0000 7f689c9cc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6898136fe0 0x7f68981393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:51.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.803+0000 7f689c9cc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6898070940 con 0x7f689809e930 2023-09-30T22:35:51.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.803+0000 7f689c9cc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689806fd60 con 0x7f6898136fe0 2023-09-30T22:35:51.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.803+0000 7f689c9cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689806fa80 con 0x7f689809f410 2023-09-30T22:35:51.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.803+0000 7f6896d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6898136fe0 0x7f68981393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:51.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.803+0000 7f6896d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6898136fe0 0x7f68981393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52264/0 (socket says 172.21.15.59:52264) 2023-09-30T22:35:51.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.803+0000 7f6896d9d700 1 -- 172.21.15.59:0/2709438721 learned_addr learned my addr 172.21.15.59:0/2709438721 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:51.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.803+0000 7f6895d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f689809f410 0x7f6898136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.803+0000 7f6896d9d700 1 -- 172.21.15.59:0/2709438721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f689809f410 msgr2=0x7f6898136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.803+0000 7f6896d9d700 1 --2- 172.21.15.59:0/2709438721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f689809f410 0x7f6898136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.803+0000 7f6896d9d700 1 -- 172.21.15.59:0/2709438721 >> v1:172.21.15.59:6789/0 conn(0x7f689809e930 legacy=0x7f689809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.803+0000 7f6896d9d700 1 -- 172.21.15.59:0/2709438721 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689809fb60 con 0x7f6898136fe0 2023-09-30T22:35:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.804+0000 7f6896d9d700 1 --2- 172.21.15.59:0/2709438721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6898136fe0 0x7f68981393c0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f68900098f0 tx=0x7f6890009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751fb852167efe16 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:51.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.804+0000 7f689559a700 1 -- 172.21.15.59:0/2709438721 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890011830 con 0x7f6898136fe0 2023-09-30T22:35:51.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.804+0000 7f689559a700 1 -- 172.21.15.59:0/2709438721 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6890011990 con 0x7f6898136fe0 2023-09-30T22:35:51.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.804+0000 7f689559a700 1 -- 172.21.15.59:0/2709438721 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890011d20 con 0x7f6898136fe0 2023-09-30T22:35:51.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.805+0000 7f689c9cc700 1 -- 172.21.15.59:0/2709438721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6898136fe0 msgr2=0x7f68981393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:51.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.805+0000 7f689c9cc700 1 --2- 172.21.15.59:0/2709438721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6898136fe0 0x7f68981393c0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f68900098f0 tx=0x7f6890009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:51.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.805+0000 7f689c9cc700 1 -- 172.21.15.59:0/2709438721 shutdown_connections 2023-09-30T22:35:51.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.805+0000 7f689c9cc700 1 --2- 172.21.15.59:0/2709438721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6898136fe0 0x7f68981393c0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.805+0000 7f689c9cc700 1 --2- 172.21.15.59:0/2709438721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f689809f410 0x7f6898136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.805+0000 7f689c9cc700 1 -- 172.21.15.59:0/2709438721 >> 172.21.15.59:0/2709438721 conn(0x7f68980a4210 msgr2=0x7f68980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:51.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.805+0000 7f689c9cc700 1 -- 172.21.15.59:0/2709438721 shutdown_connections 2023-09-30T22:35:51.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.805+0000 7f689c9cc700 1 -- 172.21.15.59:0/2709438721 wait complete. 2023-09-30T22:35:51.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.806+0000 7f689c9cc700 1 Processor -- start 2023-09-30T22:35:51.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.806+0000 7f689c9cc700 1 -- start start 2023-09-30T22:35:51.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.806+0000 7f689c9cc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f689809e930 0x7f689806c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:51.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.806+0000 7f689c9cc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f689809f410 0x7f689806c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:51.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.806+0000 7f689c9cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6898136fe0 0x7f68981c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:51.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f689c9cc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6898071d20 con 0x7f689809e930 2023-09-30T22:35:51.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f689c9cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6898122400 con 0x7f6898136fe0 2023-09-30T22:35:51.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f689c9cc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6898132540 con 0x7f689809f410 2023-09-30T22:35:51.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f6895d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f689809f410 0x7f689806c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:51.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f689659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f689809e930 0x7f689806c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:51.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f6896d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6898136fe0 0x7f68981c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:51.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f6895d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f689809f410 0x7f689806c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45316/0 (socket says 172.21.15.59:45316) 2023-09-30T22:35:51.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f689659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f689809e930 0x7f689806c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52274/0 (socket says 172.21.15.59:52274) 2023-09-30T22:35:51.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f6895d9b700 1 -- 172.21.15.59:0/3659443490 learned_addr learned my addr 172.21.15.59:0/3659443490 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:51.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f6896d9d700 1 -- 172.21.15.59:0/3659443490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f689809f410 msgr2=0x7f689806c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:51.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f6896d9d700 1 --2- 172.21.15.59:0/3659443490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f689809f410 0x7f689806c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f6896d9d700 1 -- 172.21.15.59:0/3659443490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f689809e930 msgr2=0x7f689806c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:51.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f6896d9d700 1 --2- 172.21.15.59:0/3659443490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f689809e930 0x7f689806c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f6896d9d700 1 -- 172.21.15.59:0/3659443490 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6890009550 con 0x7f6898136fe0 2023-09-30T22:35:51.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f689659c700 1 --2- 172.21.15.59:0/3659443490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f689809e930 0x7f689806c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:51.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f6896d9d700 1 --2- 172.21.15.59:0/3659443490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6898136fe0 0x7f68981c85e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6890016000 tx=0x7f6890004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:51.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f6886ffd700 1 -- 172.21.15.59:0/3659443490 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890004380 con 0x7f6898136fe0 2023-09-30T22:35:51.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.807+0000 7f6886ffd700 1 -- 172.21.15.59:0/3659443490 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689001f070 con 0x7f6898136fe0 2023-09-30T22:35:51.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.808+0000 7f689c9cc700 1 -- 172.21.15.59:0/3659443490 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689806bd90 con 0x7f6898136fe0 2023-09-30T22:35:51.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.808+0000 7f6886ffd700 1 -- 172.21.15.59:0/3659443490 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68900036a0 con 0x7f6898136fe0 2023-09-30T22:35:51.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.808+0000 7f689c9cc700 1 -- 172.21.15.59:0/3659443490 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6898120fc0 con 0x7f6898136fe0 2023-09-30T22:35:51.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.809+0000 7f689c9cc700 1 -- 172.21.15.59:0/3659443490 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6898121850 con 0x7f6898136fe0 2023-09-30T22:35:51.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.809+0000 7f6886ffd700 1 -- 172.21.15.59:0/3659443490 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6890021030 con 0x7f6898136fe0 2023-09-30T22:35:51.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.809+0000 7f6886ffd700 1 -- 172.21.15.59:0/3659443490 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6890040d80 con 0x7f6898136fe0 2023-09-30T22:35:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.818+0000 7f6886ffd700 1 -- 172.21.15.59:0/3659443490 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68900239c0 con 0x7f6898136fe0 2023-09-30T22:35:51.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.846+0000 7f141779e700 1 Processor -- start 2023-09-30T22:35:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.846+0000 7f141779e700 1 -- start start 2023-09-30T22:35:51.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.846+0000 7f141779e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f141009de00 0x7f141009e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:51.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.846+0000 7f141779e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f141013d1f0 0x7f141013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:51.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.846+0000 7f141779e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141009a810 con 0x7f141006a770 2023-09-30T22:35:51.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.846+0000 7f141779e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141006ab40 con 0x7f141009de00 2023-09-30T22:35:51.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.846+0000 7f141779e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f141009ebc0 con 0x7f141013d1f0 2023-09-30T22:35:51.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.847+0000 7f1414d39700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f141009de00 0x7f141009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:51.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.847+0000 7f141553a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f141006a770 0x7f141009d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54274/0 (socket says 172.21.15.59:54274) 2023-09-30T22:35:51.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.847+0000 7f141553a700 1 -- 172.21.15.59:0/2707558732 learned_addr learned my addr 172.21.15.59:0/2707558732 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.847+0000 7f1415d3b700 1 --2- 172.21.15.59:0/2707558732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f141013d1f0 0x7f141013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.847+0000 7f1407fff700 1 -- 172.21.15.59:0/2707558732 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678750793 0 0) 0x7f141009a810 con 0x7f141006a770 2023-09-30T22:35:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.847+0000 7f1414d39700 1 -- 172.21.15.59:0/2707558732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f141013d1f0 msgr2=0x7f141013f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.847+0000 7f1414d39700 1 --2- 172.21.15.59:0/2707558732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f141013d1f0 0x7f141013f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.847+0000 7f1414d39700 1 -- 172.21.15.59:0/2707558732 >> v1:172.21.15.59:6789/0 conn(0x7f141006a770 legacy=0x7f141009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.847+0000 7f1414d39700 1 -- 172.21.15.59:0/2707558732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141009e920 con 0x7f141009de00 2023-09-30T22:35:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.847+0000 7f1415d3b700 1 --2- 172.21.15.59:0/2707558732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f141013d1f0 0x7f141013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.847+0000 7f1414d39700 1 --2- 172.21.15.59:0/2707558732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f141009de00 0x7f141009e250 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f1400009870 tx=0x7f1400009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=352b73589a965aeb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.847+0000 7f1407fff700 1 -- 172.21.15.59:0/2707558732 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400011830 con 0x7f141009de00 2023-09-30T22:35:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.847+0000 7f1407fff700 1 -- 172.21.15.59:0/2707558732 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1400011990 con 0x7f141009de00 2023-09-30T22:35:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.847+0000 7f1407fff700 1 -- 172.21.15.59:0/2707558732 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400011d20 con 0x7f141009de00 2023-09-30T22:35:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.848+0000 7f141779e700 1 -- 172.21.15.59:0/2707558732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f141009de00 msgr2=0x7f141009e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.848+0000 7f141779e700 1 --2- 172.21.15.59:0/2707558732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f141009de00 0x7f141009e250 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f1400009870 tx=0x7f1400009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.848+0000 7f141779e700 1 -- 172.21.15.59:0/2707558732 shutdown_connections 2023-09-30T22:35:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.848+0000 7f141779e700 1 --2- 172.21.15.59:0/2707558732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f141013d1f0 0x7f141013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.848+0000 7f141779e700 1 --2- 172.21.15.59:0/2707558732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f141009de00 0x7f141009e250 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.848+0000 7f141779e700 1 -- 172.21.15.59:0/2707558732 >> 172.21.15.59:0/2707558732 conn(0x7f1410066f50 msgr2=0x7f141009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.848+0000 7f141779e700 1 -- 172.21.15.59:0/2707558732 shutdown_connections 2023-09-30T22:35:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.848+0000 7f141779e700 1 -- 172.21.15.59:0/2707558732 wait complete. 2023-09-30T22:35:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.849+0000 7f141779e700 1 Processor -- start 2023-09-30T22:35:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.849+0000 7f141779e700 1 -- start start 2023-09-30T22:35:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f141779e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f141006a770 0x7f141011b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f141779e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f141009de00 0x7f141011bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f141779e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f141013d1f0 0x7f141011c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f141779e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141011a700 con 0x7f141013d1f0 2023-09-30T22:35:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f141779e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141011d3c0 con 0x7f141009de00 2023-09-30T22:35:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f141779e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14100a1810 con 0x7f141006a770 2023-09-30T22:35:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f1415d3b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f141013d1f0 0x7f141011c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f1414d39700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f141009de00 0x7f141011bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f1415d3b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f141013d1f0 0x7f141011c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52288/0 (socket says 172.21.15.59:52288) 2023-09-30T22:35:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f1415d3b700 1 -- 172.21.15.59:0/1692259332 learned_addr learned my addr 172.21.15.59:0/1692259332 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f141553a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f141006a770 0x7f141011b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f1414d39700 1 -- 172.21.15.59:0/1692259332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f141006a770 msgr2=0x7f141011b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f1414d39700 1 --2- 172.21.15.59:0/1692259332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f141006a770 0x7f141011b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f1414d39700 1 -- 172.21.15.59:0/1692259332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f141013d1f0 msgr2=0x7f141011c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f1414d39700 1 --2- 172.21.15.59:0/1692259332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f141013d1f0 0x7f141011c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f1414d39700 1 -- 172.21.15.59:0/1692259332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1408009a70 con 0x7f141009de00 2023-09-30T22:35:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f141553a700 1 --2- 172.21.15.59:0/1692259332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f141006a770 0x7f141011b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f1415d3b700 1 --2- 172.21.15.59:0/1692259332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f141013d1f0 0x7f141011c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.850+0000 7f1414d39700 1 --2- 172.21.15.59:0/1692259332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f141009de00 0x7f141011bce0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f141006b400 tx=0x7f1400004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.851+0000 7f1405ffb700 1 -- 172.21.15.59:0/1692259332 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400004510 con 0x7f141009de00 2023-09-30T22:35:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.851+0000 7f1405ffb700 1 -- 172.21.15.59:0/1692259332 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140001f070 con 0x7f141009de00 2023-09-30T22:35:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.851+0000 7f141779e700 1 -- 172.21.15.59:0/1692259332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14000094a0 con 0x7f141009de00 2023-09-30T22:35:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.851+0000 7f1405ffb700 1 -- 172.21.15.59:0/1692259332 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14000038c0 con 0x7f141009de00 2023-09-30T22:35:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.851+0000 7f141779e700 1 -- 172.21.15.59:0/1692259332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141011a350 con 0x7f141009de00 2023-09-30T22:35:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.852+0000 7f141779e700 1 -- 172.21.15.59:0/1692259332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141011a540 con 0x7f141009de00 2023-09-30T22:35:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.852+0000 7f1405ffb700 1 -- 172.21.15.59:0/1692259332 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1400003a20 con 0x7f141009de00 2023-09-30T22:35:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.853+0000 7f1405ffb700 1 -- 172.21.15.59:0/1692259332 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1400021070 con 0x7f141009de00 2023-09-30T22:35:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:51.857+0000 7f1405ffb700 1 -- 172.21.15.59:0/1692259332 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1400010380 con 0x7f141009de00 2023-09-30T22:35:52.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.025+0000 7f689c9cc700 1 -- 172.21.15.59:0/3659443490 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6898122540 con 0x7f6898136fe0 2023-09-30T22:35:52.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.025+0000 7f6886ffd700 1 -- 172.21.15.59:0/3659443490 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6898122540 con 0x7f6898136fe0 2023-09-30T22:35:52.026 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:52.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.027+0000 7f689c9cc700 1 -- 172.21.15.59:0/3659443490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6898136fe0 msgr2=0x7f68981c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:52.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.027+0000 7f689c9cc700 1 --2- 172.21.15.59:0/3659443490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6898136fe0 0x7f68981c85e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6890016000 tx=0x7f6890004750 comp rx=0 tx=0).stop 2023-09-30T22:35:52.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.027+0000 7f689c9cc700 1 -- 172.21.15.59:0/3659443490 shutdown_connections 2023-09-30T22:35:52.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.027+0000 7f689c9cc700 1 --2- 172.21.15.59:0/3659443490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6898136fe0 0x7f68981c85e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.027+0000 7f689c9cc700 1 --2- 172.21.15.59:0/3659443490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f689809e930 0x7f689806c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.027+0000 7f689c9cc700 1 --2- 172.21.15.59:0/3659443490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f689809f410 0x7f689806c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.028+0000 7f689c9cc700 1 -- 172.21.15.59:0/3659443490 >> 172.21.15.59:0/3659443490 conn(0x7f68980a4210 msgr2=0x7f68980a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:52.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.028+0000 7f689c9cc700 1 -- 172.21.15.59:0/3659443490 shutdown_connections 2023-09-30T22:35:52.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.028+0000 7f689c9cc700 1 -- 172.21.15.59:0/3659443490 wait complete. 2023-09-30T22:35:52.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:52.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.065+0000 7f141779e700 1 -- 172.21.15.59:0/1692259332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f141011aab0 con 0x7f141009de00 2023-09-30T22:35:52.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.065+0000 7f1405ffb700 1 -- 172.21.15.59:0/1692259332 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f140002b020 con 0x7f141009de00 2023-09-30T22:35:52.065 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:52.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.068+0000 7f141779e700 1 -- 172.21.15.59:0/1692259332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f141009de00 msgr2=0x7f141011bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:52.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.068+0000 7f141779e700 1 --2- 172.21.15.59:0/1692259332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f141009de00 0x7f141011bce0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f141006b400 tx=0x7f1400004750 comp rx=0 tx=0).stop 2023-09-30T22:35:52.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.068+0000 7f141779e700 1 -- 172.21.15.59:0/1692259332 shutdown_connections 2023-09-30T22:35:52.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.068+0000 7f141779e700 1 --2- 172.21.15.59:0/1692259332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f141006a770 0x7f141011b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.068+0000 7f141779e700 1 --2- 172.21.15.59:0/1692259332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f141013d1f0 0x7f141011c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.068+0000 7f141779e700 1 --2- 172.21.15.59:0/1692259332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f141009de00 0x7f141011bce0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.068+0000 7f141779e700 1 -- 172.21.15.59:0/1692259332 >> 172.21.15.59:0/1692259332 conn(0x7f1410066f50 msgr2=0x7f141013c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:52.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.068+0000 7f141779e700 1 -- 172.21.15.59:0/1692259332 shutdown_connections 2023-09-30T22:35:52.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.068+0000 7f141779e700 1 -- 172.21.15.59:0/1692259332 wait complete. 2023-09-30T22:35:52.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:52.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:52.145 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:52.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.265+0000 7efed0b73700 1 Processor -- start 2023-09-30T22:35:52.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.265+0000 7efed0b73700 1 -- start start 2023-09-30T22:35:52.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.266+0000 7efed0b73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efecc0a0a30 0x7efecc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:52.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.266+0000 7efed0b73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efecc0a1340 0x7efecc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:52.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.266+0000 7efed0b73700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efecc09edd0 con 0x7efecc133fa0 2023-09-30T22:35:52.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.266+0000 7efed0b73700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc09e1f0 con 0x7efecc0a1340 2023-09-30T22:35:52.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.266+0000 7efed0b73700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efecc09dc50 con 0x7efecc0a0a30 2023-09-30T22:35:52.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.266+0000 7efeca59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efecc0a0a30 0x7efecc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:52.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.266+0000 7efec9d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efecc0a1340 0x7efecc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:52.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.266+0000 7efeca59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efecc0a0a30 0x7efecc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45340/0 (socket says 172.21.15.59:45340) 2023-09-30T22:35:52.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.266+0000 7efec9d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efecc0a1340 0x7efecc133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52294/0 (socket says 172.21.15.59:52294) 2023-09-30T22:35:52.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.266+0000 7efeca59c700 1 -- 172.21.15.59:0/105704381 learned_addr learned my addr 172.21.15.59:0/105704381 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:52.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.267+0000 7efeca59c700 1 -- 172.21.15.59:0/105704381 >> v2:172.21.15.59:3300/0 conn(0x7efecc0a1340 msgr2=0x7efecc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:52.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.267+0000 7efeca59c700 1 --2- 172.21.15.59:0/105704381 >> v2:172.21.15.59:3300/0 conn(0x7efecc0a1340 0x7efecc133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.267+0000 7efeca59c700 1 -- 172.21.15.59:0/105704381 >> v1:172.21.15.59:6789/0 conn(0x7efecc133fa0 legacy=0x7efecc13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:52.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.267+0000 7efeca59c700 1 -- 172.21.15.59:0/105704381 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc0a1fe0 con 0x7efecc0a0a30 2023-09-30T22:35:52.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.267+0000 7efec9d9b700 1 --2- 172.21.15.59:0/105704381 >> v2:172.21.15.59:3300/0 conn(0x7efecc0a1340 0x7efecc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:52.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.267+0000 7efeca59c700 1 --2- 172.21.15.59:0/105704381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efecc0a0a30 0x7efecc0a0e00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7efebc009e50 tx=0x7efebc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d3c1290d0df4935 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:52.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.267+0000 7efec959a700 1 -- 172.21.15.59:0/105704381 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc00e070 con 0x7efecc0a0a30 2023-09-30T22:35:52.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.267+0000 7efec959a700 1 -- 172.21.15.59:0/105704381 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc00b910 con 0x7efecc0a0a30 2023-09-30T22:35:52.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.267+0000 7efec959a700 1 -- 172.21.15.59:0/105704381 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc00bcc0 con 0x7efecc0a0a30 2023-09-30T22:35:52.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.268+0000 7efed0b73700 1 -- 172.21.15.59:0/105704381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efecc0a0a30 msgr2=0x7efecc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:52.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.268+0000 7efed0b73700 1 --2- 172.21.15.59:0/105704381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efecc0a0a30 0x7efecc0a0e00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7efebc009e50 tx=0x7efebc00b330 comp rx=0 tx=0).stop 2023-09-30T22:35:52.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.268+0000 7efed0b73700 1 -- 172.21.15.59:0/105704381 shutdown_connections 2023-09-30T22:35:52.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.268+0000 7efed0b73700 1 --2- 172.21.15.59:0/105704381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efecc0a0a30 0x7efecc0a0e00 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.268+0000 7efed0b73700 1 --2- 172.21.15.59:0/105704381 >> v2:172.21.15.59:3300/0 conn(0x7efecc0a1340 0x7efecc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.268+0000 7efed0b73700 1 -- 172.21.15.59:0/105704381 >> 172.21.15.59:0/105704381 conn(0x7efecc0a6550 msgr2=0x7efecc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:52.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.268+0000 7efed0b73700 1 -- 172.21.15.59:0/105704381 shutdown_connections 2023-09-30T22:35:52.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.268+0000 7efed0b73700 1 -- 172.21.15.59:0/105704381 wait complete. 2023-09-30T22:35:52.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.269+0000 7efed0b73700 1 Processor -- start 2023-09-30T22:35:52.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.269+0000 7efed0b73700 1 -- start start 2023-09-30T22:35:52.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efed0b73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efecc0a0a30 0x7efecc11e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:52.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efed0b73700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efecc0a1340 0x7efecc11ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:52.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efed0b73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efecc133fa0 0x7efecc11f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:52.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efed0b73700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc121f50 con 0x7efecc0a1340 2023-09-30T22:35:52.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efed0b73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc120430 con 0x7efecc133fa0 2023-09-30T22:35:52.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efed0b73700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0a37e0 con 0x7efecc0a0a30 2023-09-30T22:35:52.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efeca59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efecc0a0a30 0x7efecc11e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:52.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efeca59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efecc0a0a30 0x7efecc11e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45344/0 (socket says 172.21.15.59:45344) 2023-09-30T22:35:52.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efeca59c700 1 -- 172.21.15.59:0/2329815614 learned_addr learned my addr 172.21.15.59:0/2329815614 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:52.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efec9d9b700 1 --2- 172.21.15.59:0/2329815614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efecc0a1340 0x7efecc11ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:52.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efecad9d700 1 --2- 172.21.15.59:0/2329815614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efecc133fa0 0x7efecc11f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:52.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efeca59c700 1 -- 172.21.15.59:0/2329815614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efecc133fa0 msgr2=0x7efecc11f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:52.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efeca59c700 1 --2- 172.21.15.59:0/2329815614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efecc133fa0 0x7efecc11f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efeca59c700 1 -- 172.21.15.59:0/2329815614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efecc0a1340 msgr2=0x7efecc11ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:52.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efeca59c700 1 --2- 172.21.15.59:0/2329815614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efecc0a1340 0x7efecc11ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efeca59c700 1 -- 172.21.15.59:0/2329815614 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec00094a0 con 0x7efecc0a0a30 2023-09-30T22:35:52.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efec9d9b700 1 --2- 172.21.15.59:0/2329815614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efecc0a1340 0x7efecc11ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:52.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efecad9d700 1 --2- 172.21.15.59:0/2329815614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efecc133fa0 0x7efecc11f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:52.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.270+0000 7efeca59c700 1 --2- 172.21.15.59:0/2329815614 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efecc0a0a30 0x7efecc11e7a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7efecc09dd90 tx=0x7efebc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:52.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.271+0000 7efebaffd700 1 -- 172.21.15.59:0/2329815614 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc004800 con 0x7efecc0a0a30 2023-09-30T22:35:52.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.271+0000 7efebaffd700 1 -- 172.21.15.59:0/2329815614 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc0092e0 con 0x7efecc0a0a30 2023-09-30T22:35:52.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.271+0000 7efed0b73700 1 -- 172.21.15.59:0/2329815614 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc009b30 con 0x7efecc0a0a30 2023-09-30T22:35:52.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.271+0000 7efebaffd700 1 -- 172.21.15.59:0/2329815614 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc01c680 con 0x7efecc0a0a30 2023-09-30T22:35:52.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.271+0000 7efed0b73700 1 -- 172.21.15.59:0/2329815614 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc0a0270 con 0x7efecc0a0a30 2023-09-30T22:35:52.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.272+0000 7efebaffd700 1 -- 172.21.15.59:0/2329815614 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efebc01c7e0 con 0x7efecc0a0a30 2023-09-30T22:35:52.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.272+0000 7efed0b73700 1 -- 172.21.15.59:0/2329815614 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efecc074ea0 con 0x7efecc0a0a30 2023-09-30T22:35:52.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.272+0000 7efebaffd700 1 -- 172.21.15.59:0/2329815614 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efebc0411c0 con 0x7efecc0a0a30 2023-09-30T22:35:52.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.277+0000 7efebaffd700 1 -- 172.21.15.59:0/2329815614 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efebc0257d0 con 0x7efecc0a0a30 2023-09-30T22:35:52.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.306+0000 7f9f5b40e700 1 Processor -- start 2023-09-30T22:35:52.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.307+0000 7f9f5b40e700 1 -- start start 2023-09-30T22:35:52.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.307+0000 7f9f5b40e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f540a0a30 0x7f9f540a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:52.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.307+0000 7f9f5b40e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f54138d80 0x7f9f5413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:52.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.307+0000 7f9f5b40e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f540a2a70 con 0x7f9f5409d630 2023-09-30T22:35:52.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.307+0000 7f9f5b40e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f540a01d0 con 0x7f9f540a0a30 2023-09-30T22:35:52.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.307+0000 7f9f5b40e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5409e2b0 con 0x7f9f54138d80 2023-09-30T22:35:52.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.307+0000 7f9f591aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f540a0a30 0x7f9f540a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:52.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.307+0000 7f9f599ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f54138d80 0x7f9f5413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:52.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.307+0000 7f9f599ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f54138d80 0x7f9f5413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45358/0 (socket says 172.21.15.59:45358) 2023-09-30T22:35:52.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.307+0000 7f9f591aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f540a0a30 0x7f9f540a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40614/0 (socket says 172.21.15.59:40614) 2023-09-30T22:35:52.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.307+0000 7f9f599ab700 1 -- 172.21.15.59:0/3823482178 learned_addr learned my addr 172.21.15.59:0/3823482178 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:52.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.308+0000 7f9f599ab700 1 -- 172.21.15.59:0/3823482178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f540a0a30 msgr2=0x7f9f540a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:52.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.308+0000 7f9f53fff700 1 -- 172.21.15.59:0/3823482178 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869483731 0 0) 0x7f9f540a2a70 con 0x7f9f5409d630 2023-09-30T22:35:52.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.308+0000 7f9f599ab700 1 --2- 172.21.15.59:0/3823482178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f540a0a30 0x7f9f540a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.308+0000 7f9f599ab700 1 -- 172.21.15.59:0/3823482178 >> v1:172.21.15.59:6789/0 conn(0x7f9f5409d630 legacy=0x7f9f540a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:52.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.308+0000 7f9f599ab700 1 -- 172.21.15.59:0/3823482178 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5409dc50 con 0x7f9f54138d80 2023-09-30T22:35:52.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.308+0000 7f9f591aa700 1 --2- 172.21.15.59:0/3823482178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f540a0a30 0x7f9f540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:52.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.308+0000 7f9f599ab700 1 --2- 172.21.15.59:0/3823482178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f54138d80 0x7f9f5413b160 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009920 tx=0x7f9f4c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1696fd55cb4895af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:52.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.308+0000 7f9f53fff700 1 -- 172.21.15.59:0/3823482178 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c011830 con 0x7f9f54138d80 2023-09-30T22:35:52.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.308+0000 7f9f53fff700 1 -- 172.21.15.59:0/3823482178 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c011990 con 0x7f9f54138d80 2023-09-30T22:35:52.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.308+0000 7f9f53fff700 1 -- 172.21.15.59:0/3823482178 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c011d20 con 0x7f9f54138d80 2023-09-30T22:35:52.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.309+0000 7f9f5b40e700 1 -- 172.21.15.59:0/3823482178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f54138d80 msgr2=0x7f9f5413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:52.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.309+0000 7f9f5b40e700 1 --2- 172.21.15.59:0/3823482178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f54138d80 0x7f9f5413b160 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009920 tx=0x7f9f4c009c30 comp rx=0 tx=0).stop 2023-09-30T22:35:52.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.309+0000 7f9f5b40e700 1 -- 172.21.15.59:0/3823482178 shutdown_connections 2023-09-30T22:35:52.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.309+0000 7f9f5b40e700 1 --2- 172.21.15.59:0/3823482178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f54138d80 0x7f9f5413b160 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.309+0000 7f9f5b40e700 1 --2- 172.21.15.59:0/3823482178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f540a0a30 0x7f9f540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.309+0000 7f9f5b40e700 1 -- 172.21.15.59:0/3823482178 >> 172.21.15.59:0/3823482178 conn(0x7f9f540a3050 msgr2=0x7f9f540a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:52.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.309+0000 7f9f5b40e700 1 -- 172.21.15.59:0/3823482178 shutdown_connections 2023-09-30T22:35:52.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.309+0000 7f9f5b40e700 1 -- 172.21.15.59:0/3823482178 wait complete. 2023-09-30T22:35:52.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.310+0000 7f9f5b40e700 1 Processor -- start 2023-09-30T22:35:52.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.310+0000 7f9f5b40e700 1 -- start start 2023-09-30T22:35:52.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.310+0000 7f9f5b40e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f5409d630 0x7f9f541336e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:52.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.310+0000 7f9f5b40e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f540a0a30 0x7f9f54133c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:52.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f5b40e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f54138d80 0x7f9f54134160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:52.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f5b40e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f54136520 con 0x7f9f540a0a30 2023-09-30T22:35:52.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f5b40e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f54136e90 con 0x7f9f5409d630 2023-09-30T22:35:52.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f5b40e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f54136170 con 0x7f9f54138d80 2023-09-30T22:35:52.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f599ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f54138d80 0x7f9f54134160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:52.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f599ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f54138d80 0x7f9f54134160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45364/0 (socket says 172.21.15.59:45364) 2023-09-30T22:35:52.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f599ab700 1 -- 172.21.15.59:0/1461529175 learned_addr learned my addr 172.21.15.59:0/1461529175 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:52.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f591aa700 1 --2- 172.21.15.59:0/1461529175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f5409d630 0x7f9f541336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:52.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f589a9700 1 --2- 172.21.15.59:0/1461529175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f540a0a30 0x7f9f54133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:52.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f599ab700 1 -- 172.21.15.59:0/1461529175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f5409d630 msgr2=0x7f9f541336e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:52.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f599ab700 1 --2- 172.21.15.59:0/1461529175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f5409d630 0x7f9f541336e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f599ab700 1 -- 172.21.15.59:0/1461529175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f540a0a30 msgr2=0x7f9f54133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:52.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f599ab700 1 --2- 172.21.15.59:0/1461529175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f540a0a30 0x7f9f54133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f599ab700 1 -- 172.21.15.59:0/1461529175 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f44009a70 con 0x7f9f54138d80 2023-09-30T22:35:52.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f591aa700 1 --2- 172.21.15.59:0/1461529175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f5409d630 0x7f9f541336e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:52.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f599ab700 1 --2- 172.21.15.59:0/1461529175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f54138d80 0x7f9f54134160 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0098f0 tx=0x7f9f4c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:52.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f51ffb700 1 -- 172.21.15.59:0/1461529175 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c004450 con 0x7f9f54138d80 2023-09-30T22:35:52.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f51ffb700 1 -- 172.21.15.59:0/1461529175 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c0045b0 con 0x7f9f54138d80 2023-09-30T22:35:52.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f5b40e700 1 -- 172.21.15.59:0/1461529175 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4c009550 con 0x7f9f54138d80 2023-09-30T22:35:52.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.311+0000 7f9f51ffb700 1 -- 172.21.15.59:0/1461529175 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c0038e0 con 0x7f9f54138d80 2023-09-30T22:35:52.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.312+0000 7f9f5b40e700 1 -- 172.21.15.59:0/1461529175 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f54137170 con 0x7f9f54138d80 2023-09-30T22:35:52.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.312+0000 7f9f51ffb700 1 -- 172.21.15.59:0/1461529175 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f4c003a40 con 0x7f9f54138d80 2023-09-30T22:35:52.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.313+0000 7f9f51ffb700 1 -- 172.21.15.59:0/1461529175 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9f4c0409c0 con 0x7f9f54138d80 2023-09-30T22:35:52.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.313+0000 7f9f5b40e700 1 -- 172.21.15.59:0/1461529175 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f540747f0 con 0x7f9f54138d80 2023-09-30T22:35:52.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.322+0000 7f9f51ffb700 1 -- 172.21.15.59:0/1461529175 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f4c010380 con 0x7f9f54138d80 2023-09-30T22:35:52.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.487+0000 7efed0b73700 1 -- 172.21.15.59:0/2329815614 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efecc0a28e0 con 0x7efecc0a0a30 2023-09-30T22:35:52.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.487+0000 7efebaffd700 1 -- 172.21.15.59:0/2329815614 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efebc034090 con 0x7efecc0a0a30 2023-09-30T22:35:52.488 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.489+0000 7efed0b73700 1 -- 172.21.15.59:0/2329815614 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efecc0a0a30 msgr2=0x7efecc11e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.489+0000 7efed0b73700 1 --2- 172.21.15.59:0/2329815614 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efecc0a0a30 0x7efecc11e7a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7efecc09dd90 tx=0x7efebc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.490+0000 7efed0b73700 1 -- 172.21.15.59:0/2329815614 shutdown_connections 2023-09-30T22:35:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.490+0000 7efed0b73700 1 --2- 172.21.15.59:0/2329815614 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efecc0a0a30 0x7efecc11e7a0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.490+0000 7efed0b73700 1 --2- 172.21.15.59:0/2329815614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efecc133fa0 0x7efecc11f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.490+0000 7efed0b73700 1 --2- 172.21.15.59:0/2329815614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efecc0a1340 0x7efecc11ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.490+0000 7efed0b73700 1 -- 172.21.15.59:0/2329815614 >> 172.21.15.59:0/2329815614 conn(0x7efecc0a6550 msgr2=0x7efecc1b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.490+0000 7efed0b73700 1 -- 172.21.15.59:0/2329815614 shutdown_connections 2023-09-30T22:35:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.490+0000 7efed0b73700 1 -- 172.21.15.59:0/2329815614 wait complete. 2023-09-30T22:35:52.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.528+0000 7f9f5b40e700 1 -- 172.21.15.59:0/1461529175 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9f54136fd0 con 0x7f9f54138d80 2023-09-30T22:35:52.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.529+0000 7f9f51ffb700 1 -- 172.21.15.59:0/1461529175 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f54136fd0 con 0x7f9f54138d80 2023-09-30T22:35:52.529 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.531+0000 7f9f5b40e700 1 -- 172.21.15.59:0/1461529175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f54138d80 msgr2=0x7f9f54134160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.531+0000 7f9f5b40e700 1 --2- 172.21.15.59:0/1461529175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f54138d80 0x7f9f54134160 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0098f0 tx=0x7f9f4c004750 comp rx=0 tx=0).stop 2023-09-30T22:35:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.531+0000 7f9f5b40e700 1 -- 172.21.15.59:0/1461529175 shutdown_connections 2023-09-30T22:35:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.531+0000 7f9f5b40e700 1 --2- 172.21.15.59:0/1461529175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f54138d80 0x7f9f54134160 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.531+0000 7f9f5b40e700 1 --2- 172.21.15.59:0/1461529175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f5409d630 0x7f9f541336e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.531+0000 7f9f5b40e700 1 --2- 172.21.15.59:0/1461529175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f540a0a30 0x7f9f54133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.531+0000 7f9f5b40e700 1 -- 172.21.15.59:0/1461529175 >> 172.21.15.59:0/1461529175 conn(0x7f9f540a3050 msgr2=0x7f9f5409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.531+0000 7f9f5b40e700 1 -- 172.21.15.59:0/1461529175 shutdown_connections 2023-09-30T22:35:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:52.531+0000 7f9f5b40e700 1 -- 172.21.15.59:0/1461529175 wait complete. 2023-09-30T22:35:52.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:53.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:53.082 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:53.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.191+0000 7f5e535c1700 1 Processor -- start 2023-09-30T22:35:53.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.192+0000 7f5e535c1700 1 -- start start 2023-09-30T22:35:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.192+0000 7f5e535c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e4c09e930 0x7f5e4c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.192+0000 7f5e535c1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5e4c09f240 0x7f5e4c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.192+0000 7f5e535c1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e4c09f650 0x7f5e4c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.192+0000 7f5e535c1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4c070940 con 0x7f5e4c09f240 2023-09-30T22:35:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.192+0000 7f5e535c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c06fd60 con 0x7f5e4c09e930 2023-09-30T22:35:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.192+0000 7f5e535c1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c06fa80 con 0x7f5e4c09f650 2023-09-30T22:35:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.192+0000 7f5e50b5c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5e4c09f240 0x7f5e4c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.192+0000 7f5e50b5c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5e4c09f240 0x7f5e4c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52318/0 (socket says 172.21.15.59:52318) 2023-09-30T22:35:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.192+0000 7f5e50b5c700 1 -- 172.21.15.59:0/3045764835 learned_addr learned my addr 172.21.15.59:0/3045764835 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.192+0000 7f5e5135d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e4c09e930 0x7f5e4c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.192+0000 7f5e51b5e700 1 --2- 172.21.15.59:0/3045764835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e4c09f650 0x7f5e4c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.193+0000 7f5e5135d700 1 -- 172.21.15.59:0/3045764835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e4c09f650 msgr2=0x7f5e4c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.193+0000 7f5e5135d700 1 --2- 172.21.15.59:0/3045764835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e4c09f650 0x7f5e4c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.193+0000 7f5e5135d700 1 -- 172.21.15.59:0/3045764835 >> v2:172.21.15.59:3300/0 conn(0x7f5e4c09f240 msgr2=0x7f5e4c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.193+0000 7f5e5135d700 1 --2- 172.21.15.59:0/3045764835 >> v2:172.21.15.59:3300/0 conn(0x7f5e4c09f240 0x7f5e4c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.193+0000 7f5e5135d700 1 -- 172.21.15.59:0/3045764835 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c09fb60 con 0x7f5e4c09e930 2023-09-30T22:35:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.193+0000 7f5e51b5e700 1 --2- 172.21.15.59:0/3045764835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e4c09f650 0x7f5e4c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.193+0000 7f5e5135d700 1 --2- 172.21.15.59:0/3045764835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e4c09e930 0x7f5e4c09ed00 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009d90 tx=0x7f5e4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c82296788d02861c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.193+0000 7f5e4bfff700 1 -- 172.21.15.59:0/3045764835 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400e070 con 0x7f5e4c09e930 2023-09-30T22:35:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.193+0000 7f5e4bfff700 1 -- 172.21.15.59:0/3045764835 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4400bb20 con 0x7f5e4c09e930 2023-09-30T22:35:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.193+0000 7f5e4bfff700 1 -- 172.21.15.59:0/3045764835 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44012430 con 0x7f5e4c09e930 2023-09-30T22:35:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.194+0000 7f5e535c1700 1 -- 172.21.15.59:0/3045764835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e4c09e930 msgr2=0x7f5e4c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.194+0000 7f5e535c1700 1 --2- 172.21.15.59:0/3045764835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e4c09e930 0x7f5e4c09ed00 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009d90 tx=0x7f5e4400b330 comp rx=0 tx=0).stop 2023-09-30T22:35:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.194+0000 7f5e535c1700 1 -- 172.21.15.59:0/3045764835 shutdown_connections 2023-09-30T22:35:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.194+0000 7f5e535c1700 1 --2- 172.21.15.59:0/3045764835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e4c09f650 0x7f5e4c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.194+0000 7f5e535c1700 1 --2- 172.21.15.59:0/3045764835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e4c09e930 0x7f5e4c09ed00 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.194+0000 7f5e535c1700 1 --2- 172.21.15.59:0/3045764835 >> v2:172.21.15.59:3300/0 conn(0x7f5e4c09f240 0x7f5e4c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.194+0000 7f5e535c1700 1 -- 172.21.15.59:0/3045764835 >> 172.21.15.59:0/3045764835 conn(0x7f5e4c0a4210 msgr2=0x7f5e4c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.194+0000 7f5e535c1700 1 -- 172.21.15.59:0/3045764835 shutdown_connections 2023-09-30T22:35:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.194+0000 7f5e535c1700 1 -- 172.21.15.59:0/3045764835 wait complete. 2023-09-30T22:35:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.195+0000 7f5e535c1700 1 Processor -- start 2023-09-30T22:35:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.195+0000 7f5e535c1700 1 -- start start 2023-09-30T22:35:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.195+0000 7f5e535c1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e4c09e930 0x7f5e4c1a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.195+0000 7f5e535c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e4c09f240 0x7f5e4c1a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.195+0000 7f5e535c1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e4c09f650 0x7f5e4c1a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.195+0000 7f5e535c1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c1a7760 con 0x7f5e4c09f650 2023-09-30T22:35:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.195+0000 7f5e535c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c1a5e70 con 0x7f5e4c09f240 2023-09-30T22:35:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.195+0000 7f5e535c1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c1a6b30 con 0x7f5e4c09e930 2023-09-30T22:35:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e51b5e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e4c09f650 0x7f5e4c1a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e50b5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e4c09f240 0x7f5e4c1a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e5135d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e4c09e930 0x7f5e4c1a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e51b5e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e4c09f650 0x7f5e4c1a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52320/0 (socket says 172.21.15.59:52320) 2023-09-30T22:35:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e51b5e700 1 -- 172.21.15.59:0/2081484125 learned_addr learned my addr 172.21.15.59:0/2081484125 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e50b5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e4c09f240 0x7f5e4c1a4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40636/0 (socket says 172.21.15.59:40636) 2023-09-30T22:35:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e51b5e700 1 -- 172.21.15.59:0/2081484125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e4c09e930 msgr2=0x7f5e4c1a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e51b5e700 1 --2- 172.21.15.59:0/2081484125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e4c09e930 0x7f5e4c1a3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e51b5e700 1 -- 172.21.15.59:0/2081484125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e4c09f240 msgr2=0x7f5e4c1a4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e51b5e700 1 --2- 172.21.15.59:0/2081484125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e4c09f240 0x7f5e4c1a4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e51b5e700 1 -- 172.21.15.59:0/2081484125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c0094a0 con 0x7f5e4c09f650 2023-09-30T22:35:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e5135d700 1 --2- 172.21.15.59:0/2081484125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e4c09e930 0x7f5e4c1a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e50b5c700 1 --2- 172.21.15.59:0/2081484125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e4c09f240 0x7f5e4c1a4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e51b5e700 1 --2- 172.21.15.59:0/2081484125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e4c09f650 0x7f5e4c1a46c0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c010ef0 tx=0x7f5e3c00b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e49ffb700 1 -- 172.21.15.59:0/2081484125 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c015070 con 0x7f5e4c09f650 2023-09-30T22:35:53.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e49ffb700 1 -- 172.21.15.59:0/2081484125 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c009e60 con 0x7f5e4c09f650 2023-09-30T22:35:53.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e535c1700 1 -- 172.21.15.59:0/2081484125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e44009a70 con 0x7f5e4c09f650 2023-09-30T22:35:53.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.196+0000 7f5e49ffb700 1 -- 172.21.15.59:0/2081484125 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c00be00 con 0x7f5e4c09f650 2023-09-30T22:35:53.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.197+0000 7f5e535c1700 1 -- 172.21.15.59:0/2081484125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4c0a0190 con 0x7f5e4c09f650 2023-09-30T22:35:53.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.198+0000 7f5e49ffb700 1 -- 172.21.15.59:0/2081484125 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e3c0223b0 con 0x7f5e4c09f650 2023-09-30T22:35:53.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.198+0000 7f5e49ffb700 1 -- 172.21.15.59:0/2081484125 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5e3c042ee0 con 0x7f5e4c09f650 2023-09-30T22:35:53.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.198+0000 7f5e535c1700 1 -- 172.21.15.59:0/2081484125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4c071d80 con 0x7f5e4c09f650 2023-09-30T22:35:53.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.203+0000 7f5e49ffb700 1 -- 172.21.15.59:0/2081484125 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e3c021360 con 0x7f5e4c09f650 2023-09-30T22:35:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.230+0000 7f691c9ba700 1 Processor -- start 2023-09-30T22:35:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.230+0000 7f691c9ba700 1 -- start start 2023-09-30T22:35:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.230+0000 7f691c9ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69180a0a30 0x7f69180a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.230+0000 7f691c9ba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6918134170 0x7f691813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.230+0000 7f691c9ba700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f691809edd0 con 0x7f69180a1340 2023-09-30T22:35:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.230+0000 7f691c9ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691809e1f0 con 0x7f69180a0a30 2023-09-30T22:35:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.230+0000 7f691c9ba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f691809dc50 con 0x7f6918134170 2023-09-30T22:35:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.231+0000 7f690ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f69180a1340 0x7f6918133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54284/0 (socket says 172.21.15.59:54284) 2023-09-30T22:35:53.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.231+0000 7f691659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69180a0a30 0x7f69180a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.231+0000 7f690ffff700 1 -- 172.21.15.59:0/3801857263 learned_addr learned my addr 172.21.15.59:0/3801857263 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:53.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.231+0000 7f6916d9d700 1 --2- 172.21.15.59:0/3801857263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6918134170 0x7f691813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.231+0000 7f691659c700 1 -- 172.21.15.59:0/3801857263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6918134170 msgr2=0x7f691813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:53.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.231+0000 7f691659c700 1 --2- 172.21.15.59:0/3801857263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6918134170 0x7f691813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.231+0000 7f6915d9b700 1 -- 172.21.15.59:0/3801857263 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051483247 0 0) 0x7f691809edd0 con 0x7f69180a1340 2023-09-30T22:35:53.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.231+0000 7f691659c700 1 -- 172.21.15.59:0/3801857263 >> v1:172.21.15.59:6789/0 conn(0x7f69180a1340 legacy=0x7f6918133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.231+0000 7f691659c700 1 -- 172.21.15.59:0/3801857263 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69180a1fe0 con 0x7f69180a0a30 2023-09-30T22:35:53.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.231+0000 7f6916d9d700 1 --2- 172.21.15.59:0/3801857263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6918134170 0x7f691813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:53.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.231+0000 7f691659c700 1 --2- 172.21.15.59:0/3801857263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69180a0a30 0x7f69180a0e00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f6908009870 tx=0x7f6908009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bac25f13f2d9848a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:53.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.231+0000 7f6915d9b700 1 -- 172.21.15.59:0/3801857263 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908011830 con 0x7f69180a0a30 2023-09-30T22:35:53.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.231+0000 7f6915d9b700 1 -- 172.21.15.59:0/3801857263 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6908011990 con 0x7f69180a0a30 2023-09-30T22:35:53.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.231+0000 7f6915d9b700 1 -- 172.21.15.59:0/3801857263 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908011d20 con 0x7f69180a0a30 2023-09-30T22:35:53.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.232+0000 7f691c9ba700 1 -- 172.21.15.59:0/3801857263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69180a0a30 msgr2=0x7f69180a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.232+0000 7f691c9ba700 1 --2- 172.21.15.59:0/3801857263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69180a0a30 0x7f69180a0e00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f6908009870 tx=0x7f6908009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:53.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.232+0000 7f691c9ba700 1 -- 172.21.15.59:0/3801857263 shutdown_connections 2023-09-30T22:35:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.232+0000 7f691c9ba700 1 --2- 172.21.15.59:0/3801857263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6918134170 0x7f691813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.232+0000 7f691c9ba700 1 --2- 172.21.15.59:0/3801857263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69180a0a30 0x7f69180a0e00 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.232+0000 7f691c9ba700 1 -- 172.21.15.59:0/3801857263 >> 172.21.15.59:0/3801857263 conn(0x7f69180a6550 msgr2=0x7f69180a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.232+0000 7f691c9ba700 1 -- 172.21.15.59:0/3801857263 shutdown_connections 2023-09-30T22:35:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.232+0000 7f691c9ba700 1 -- 172.21.15.59:0/3801857263 wait complete. 2023-09-30T22:35:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.233+0000 7f691c9ba700 1 Processor -- start 2023-09-30T22:35:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.233+0000 7f691c9ba700 1 -- start start 2023-09-30T22:35:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f691c9ba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69180a0a30 0x7f6918122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f691c9ba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69180a1340 0x7f6918122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f691c9ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6918134170 0x7f6918123280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f691c9ba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6918125fb0 con 0x7f69180a1340 2023-09-30T22:35:53.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f691c9ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6918133290 con 0x7f6918134170 2023-09-30T22:35:53.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f691c9ba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f691809be00 con 0x7f69180a0a30 2023-09-30T22:35:53.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f691659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69180a0a30 0x7f6918122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f690ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69180a1340 0x7f6918122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f691659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69180a0a30 0x7f6918122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45418/0 (socket says 172.21.15.59:45418) 2023-09-30T22:35:53.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f691659c700 1 -- 172.21.15.59:0/4041191017 learned_addr learned my addr 172.21.15.59:0/4041191017 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:53.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f690ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69180a1340 0x7f6918122d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52336/0 (socket says 172.21.15.59:52336) 2023-09-30T22:35:53.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f6916d9d700 1 --2- 172.21.15.59:0/4041191017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6918134170 0x7f6918123280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f691659c700 1 -- 172.21.15.59:0/4041191017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6918134170 msgr2=0x7f6918123280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f691659c700 1 --2- 172.21.15.59:0/4041191017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6918134170 0x7f6918123280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f691659c700 1 -- 172.21.15.59:0/4041191017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69180a1340 msgr2=0x7f6918122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f691659c700 1 --2- 172.21.15.59:0/4041191017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69180a1340 0x7f6918122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f691659c700 1 -- 172.21.15.59:0/4041191017 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6910009a70 con 0x7f69180a0a30 2023-09-30T22:35:53.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f690ffff700 1 --2- 172.21.15.59:0/4041191017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69180a1340 0x7f6918122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:53.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.234+0000 7f691659c700 1 --2- 172.21.15.59:0/4041191017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69180a0a30 0x7f6918122800 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f6908009840 tx=0x7f6908004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:53.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.235+0000 7f690effd700 1 -- 172.21.15.59:0/4041191017 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69080045d0 con 0x7f69180a0a30 2023-09-30T22:35:53.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.235+0000 7f690effd700 1 -- 172.21.15.59:0/4041191017 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690801f070 con 0x7f69180a0a30 2023-09-30T22:35:53.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.235+0000 7f690effd700 1 -- 172.21.15.59:0/4041191017 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69080038e0 con 0x7f69180a0a30 2023-09-30T22:35:53.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.235+0000 7f691c9ba700 1 -- 172.21.15.59:0/4041191017 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69080094a0 con 0x7f69180a0a30 2023-09-30T22:35:53.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.235+0000 7f691c9ba700 1 -- 172.21.15.59:0/4041191017 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69180a25e0 con 0x7f69180a0a30 2023-09-30T22:35:53.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.236+0000 7f690effd700 1 -- 172.21.15.59:0/4041191017 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6908003a40 con 0x7f69180a0a30 2023-09-30T22:35:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.236+0000 7f690effd700 1 -- 172.21.15.59:0/4041191017 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6908021070 con 0x7f69180a0a30 2023-09-30T22:35:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.236+0000 7f691c9ba700 1 -- 172.21.15.59:0/4041191017 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6918074ea0 con 0x7f69180a0a30 2023-09-30T22:35:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.245+0000 7f690effd700 1 -- 172.21.15.59:0/4041191017 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f690801a430 con 0x7f69180a0a30 2023-09-30T22:35:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.414+0000 7f5e535c1700 1 -- 172.21.15.59:0/2081484125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5e4c074ea0 con 0x7f5e4c09f650 2023-09-30T22:35:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.414+0000 7f5e49ffb700 1 -- 172.21.15.59:0/2081484125 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e3c018370 con 0x7f5e4c09f650 2023-09-30T22:35:53.414 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.416+0000 7f5e535c1700 1 -- 172.21.15.59:0/2081484125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e4c09f650 msgr2=0x7f5e4c1a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.416+0000 7f5e535c1700 1 --2- 172.21.15.59:0/2081484125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e4c09f650 0x7f5e4c1a46c0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c010ef0 tx=0x7f5e3c00b420 comp rx=0 tx=0).stop 2023-09-30T22:35:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.416+0000 7f5e535c1700 1 -- 172.21.15.59:0/2081484125 shutdown_connections 2023-09-30T22:35:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.416+0000 7f5e535c1700 1 --2- 172.21.15.59:0/2081484125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e4c09e930 0x7f5e4c1a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.416+0000 7f5e535c1700 1 --2- 172.21.15.59:0/2081484125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e4c09f650 0x7f5e4c1a46c0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.416+0000 7f5e535c1700 1 --2- 172.21.15.59:0/2081484125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e4c09f240 0x7f5e4c1a4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.416+0000 7f5e535c1700 1 -- 172.21.15.59:0/2081484125 >> 172.21.15.59:0/2081484125 conn(0x7f5e4c0a4210 msgr2=0x7f5e4c1b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.417+0000 7f5e535c1700 1 -- 172.21.15.59:0/2081484125 shutdown_connections 2023-09-30T22:35:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.417+0000 7f5e535c1700 1 -- 172.21.15.59:0/2081484125 wait complete. 2023-09-30T22:35:53.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.453+0000 7f691c9ba700 1 -- 172.21.15.59:0/4041191017 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f69180a28e0 con 0x7f69180a0a30 2023-09-30T22:35:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.453+0000 7f690effd700 1 -- 172.21.15.59:0/4041191017 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6908015020 con 0x7f69180a0a30 2023-09-30T22:35:53.453 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.455+0000 7f691c9ba700 1 -- 172.21.15.59:0/4041191017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69180a0a30 msgr2=0x7f6918122800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.455+0000 7f691c9ba700 1 --2- 172.21.15.59:0/4041191017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69180a0a30 0x7f6918122800 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f6908009840 tx=0x7f6908004750 comp rx=0 tx=0).stop 2023-09-30T22:35:53.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.455+0000 7f691c9ba700 1 -- 172.21.15.59:0/4041191017 shutdown_connections 2023-09-30T22:35:53.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.455+0000 7f691c9ba700 1 --2- 172.21.15.59:0/4041191017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69180a0a30 0x7f6918122800 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.455+0000 7f691c9ba700 1 --2- 172.21.15.59:0/4041191017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6918134170 0x7f6918123280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.455+0000 7f691c9ba700 1 --2- 172.21.15.59:0/4041191017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69180a1340 0x7f6918122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.455+0000 7f691c9ba700 1 -- 172.21.15.59:0/4041191017 >> 172.21.15.59:0/4041191017 conn(0x7f69180a6550 msgr2=0x7f691809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:53.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.455+0000 7f691c9ba700 1 -- 172.21.15.59:0/4041191017 shutdown_connections 2023-09-30T22:35:53.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.455+0000 7f691c9ba700 1 -- 172.21.15.59:0/4041191017 wait complete. 2023-09-30T22:35:53.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:53.505 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:53.546 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:53.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.650+0000 7f198b1e0700 1 Processor -- start 2023-09-30T22:35:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.650+0000 7f198b1e0700 1 -- start start 2023-09-30T22:35:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.650+0000 7f198b1e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19840a0a30 0x7f19840a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.650+0000 7f198b1e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198409d630 0x7f19840a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f198b1e0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19840a2a70 con 0x7f1984133930 2023-09-30T22:35:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f198b1e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19840a01d0 con 0x7f19840a0a30 2023-09-30T22:35:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f198b1e0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f198409e2b0 con 0x7f198409d630 2023-09-30T22:35:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f1988f7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19840a0a30 0x7f19840a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f1988f7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19840a0a30 0x7f19840a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40662/0 (socket says 172.21.15.59:40662) 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f1988f7c700 1 -- 172.21.15.59:0/1590557690 learned_addr learned my addr 172.21.15.59:0/1590557690 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f198977d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1984133930 0x7f1984133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54298/0 (socket says 172.21.15.59:54298) 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f1983fff700 1 --2- 172.21.15.59:0/1590557690 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198409d630 0x7f19840a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f1988f7c700 1 -- 172.21.15.59:0/1590557690 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198409d630 msgr2=0x7f19840a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f1988f7c700 1 --2- 172.21.15.59:0/1590557690 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198409d630 0x7f19840a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f19837fe700 1 -- 172.21.15.59:0/1590557690 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232029227 0 0) 0x7f19840a2a70 con 0x7f1984133930 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f1988f7c700 1 -- 172.21.15.59:0/1590557690 >> v1:172.21.15.59:6789/0 conn(0x7f1984133930 legacy=0x7f1984133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f1988f7c700 1 -- 172.21.15.59:0/1590557690 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198409dc50 con 0x7f19840a0a30 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f1983fff700 1 --2- 172.21.15.59:0/1590557690 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198409d630 0x7f19840a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f1988f7c700 1 --2- 172.21.15.59:0/1590557690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19840a0a30 0x7f19840a0e00 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1978009920 tx=0x7f1978009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44bb405fb012c734 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f19837fe700 1 -- 172.21.15.59:0/1590557690 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978011830 con 0x7f19840a0a30 2023-09-30T22:35:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.651+0000 7f19837fe700 1 -- 172.21.15.59:0/1590557690 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1978011990 con 0x7f19840a0a30 2023-09-30T22:35:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.652+0000 7f19837fe700 1 -- 172.21.15.59:0/1590557690 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978011d20 con 0x7f19840a0a30 2023-09-30T22:35:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.652+0000 7f198b1e0700 1 -- 172.21.15.59:0/1590557690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19840a0a30 msgr2=0x7f19840a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.652+0000 7f198b1e0700 1 --2- 172.21.15.59:0/1590557690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19840a0a30 0x7f19840a0e00 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1978009920 tx=0x7f1978009c30 comp rx=0 tx=0).stop 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.652+0000 7f198b1e0700 1 -- 172.21.15.59:0/1590557690 shutdown_connections 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.652+0000 7f198b1e0700 1 --2- 172.21.15.59:0/1590557690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19840a0a30 0x7f19840a0e00 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.652+0000 7f198b1e0700 1 --2- 172.21.15.59:0/1590557690 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198409d630 0x7f19840a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.652+0000 7f198b1e0700 1 -- 172.21.15.59:0/1590557690 >> 172.21.15.59:0/1590557690 conn(0x7f19840a3050 msgr2=0x7f19840a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.652+0000 7f198b1e0700 1 -- 172.21.15.59:0/1590557690 shutdown_connections 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.652+0000 7f198b1e0700 1 -- 172.21.15.59:0/1590557690 wait complete. 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.654+0000 7f198b1e0700 1 Processor -- start 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.654+0000 7f198b1e0700 1 -- start start 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f198b1e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f198409d630 0x7f19841c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f198b1e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19840a0a30 0x7f19841c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f198b1e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1984133930 0x7f19841c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f198b1e0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19841208e0 con 0x7f198409d630 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f198b1e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19841223c0 con 0x7f19840a0a30 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f198b1e0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19841206b0 con 0x7f1984133930 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f1983fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19840a0a30 0x7f19841c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f1983fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19840a0a30 0x7f19841c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40668/0 (socket says 172.21.15.59:40668) 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f1983fff700 1 -- 172.21.15.59:0/1048311217 learned_addr learned my addr 172.21.15.59:0/1048311217 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f1988f7c700 1 --2- 172.21.15.59:0/1048311217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f198409d630 0x7f19841c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f198977d700 1 --2- 172.21.15.59:0/1048311217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1984133930 0x7f19841c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f1988f7c700 1 -- 172.21.15.59:0/1048311217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1984133930 msgr2=0x7f19841c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f1988f7c700 1 --2- 172.21.15.59:0/1048311217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1984133930 0x7f19841c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f1988f7c700 1 -- 172.21.15.59:0/1048311217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19840a0a30 msgr2=0x7f19841c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f1988f7c700 1 --2- 172.21.15.59:0/1048311217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19840a0a30 0x7f19841c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f1988f7c700 1 -- 172.21.15.59:0/1048311217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19700094a0 con 0x7f198409d630 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f1983fff700 1 --2- 172.21.15.59:0/1048311217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19840a0a30 0x7f19841c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.655+0000 7f1988f7c700 1 --2- 172.21.15.59:0/1048311217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f198409d630 0x7f19841c8020 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f1978016000 tx=0x7f1978004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.656+0000 7f19817fa700 1 -- 172.21.15.59:0/1048311217 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978004450 con 0x7f198409d630 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.656+0000 7f19817fa700 1 -- 172.21.15.59:0/1048311217 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19780045b0 con 0x7f198409d630 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.656+0000 7f198b1e0700 1 -- 172.21.15.59:0/1048311217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1978009550 con 0x7f198409d630 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.656+0000 7f19817fa700 1 -- 172.21.15.59:0/1048311217 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19780038c0 con 0x7f198409d630 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.656+0000 7f198b1e0700 1 -- 172.21.15.59:0/1048311217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1984120ea0 con 0x7f198409d630 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.657+0000 7f19817fa700 1 -- 172.21.15.59:0/1048311217 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1978003a20 con 0x7f198409d630 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.657+0000 7f198b1e0700 1 -- 172.21.15.59:0/1048311217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19841335b0 con 0x7f198409d630 2023-09-30T22:35:53.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.657+0000 7f19817fa700 1 -- 172.21.15.59:0/1048311217 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1978021030 con 0x7f198409d630 2023-09-30T22:35:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.666+0000 7f19817fa700 1 -- 172.21.15.59:0/1048311217 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1978010380 con 0x7f198409d630 2023-09-30T22:35:53.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.699+0000 7fc0c4955700 1 Processor -- start 2023-09-30T22:35:53.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.699+0000 7fc0c4955700 1 -- start start 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.700+0000 7fc0c4955700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0c006a770 0x7fc0c006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.700+0000 7fc0c4955700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0c006b080 0x7fc0c0131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.700+0000 7fc0c4955700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c009e810 con 0x7fc0c0131b40 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.700+0000 7fc0c4955700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c009e070 con 0x7fc0c006a770 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.700+0000 7fc0c4955700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c009ead0 con 0x7fc0c006b080 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.700+0000 7fc0bed9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc0c0131b40 0x7fc0c0138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54308/0 (socket says 172.21.15.59:54308) 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.700+0000 7fc0bed9d700 1 -- 172.21.15.59:0/1036583666 learned_addr learned my addr 172.21.15.59:0/1036583666 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.700+0000 7fc0bdd9b700 1 --2- 172.21.15.59:0/1036583666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0c006b080 0x7fc0c0131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.700+0000 7fc0be59c700 1 --2- 172.21.15.59:0/1036583666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0c006a770 0x7fc0c006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.701+0000 7fc0bd59a700 1 -- 172.21.15.59:0/1036583666 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905056983 0 0) 0x7fc0c009e810 con 0x7fc0c0131b40 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.701+0000 7fc0bd59a700 1 -- 172.21.15.59:0/1036583666 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a80035b0 con 0x7fc0c0131b40 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.701+0000 7fc0be59c700 1 -- 172.21.15.59:0/1036583666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0c006b080 msgr2=0x7fc0c0131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.701+0000 7fc0be59c700 1 --2- 172.21.15.59:0/1036583666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0c006b080 0x7fc0c0131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.701+0000 7fc0be59c700 1 -- 172.21.15.59:0/1036583666 >> v1:172.21.15.59:6789/0 conn(0x7fc0c0131b40 legacy=0x7fc0c0138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.701+0000 7fc0be59c700 1 -- 172.21.15.59:0/1036583666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c009daa0 con 0x7fc0c006a770 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.701+0000 7fc0be59c700 1 --2- 172.21.15.59:0/1036583666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0c006a770 0x7fc0c006ab40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009870 tx=0x7fc0b0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44fd8fb4b1d6350a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.701+0000 7fc0bd59a700 1 -- 172.21.15.59:0/1036583666 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0011830 con 0x7fc0c006a770 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.701+0000 7fc0bd59a700 1 -- 172.21.15.59:0/1036583666 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b0011990 con 0x7fc0c006a770 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.701+0000 7fc0bd59a700 1 -- 172.21.15.59:0/1036583666 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0011d00 con 0x7fc0c006a770 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.702+0000 7fc0c4955700 1 -- 172.21.15.59:0/1036583666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0c006a770 msgr2=0x7fc0c006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.702+0000 7fc0c4955700 1 --2- 172.21.15.59:0/1036583666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0c006a770 0x7fc0c006ab40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009870 tx=0x7fc0b0009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.702+0000 7fc0c4955700 1 -- 172.21.15.59:0/1036583666 shutdown_connections 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.702+0000 7fc0c4955700 1 --2- 172.21.15.59:0/1036583666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0c006a770 0x7fc0c006ab40 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.702+0000 7fc0c4955700 1 --2- 172.21.15.59:0/1036583666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0c006b080 0x7fc0c0131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.702+0000 7fc0c4955700 1 -- 172.21.15.59:0/1036583666 >> 172.21.15.59:0/1036583666 conn(0x7fc0c0066f50 msgr2=0x7fc0c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.702+0000 7fc0c4955700 1 -- 172.21.15.59:0/1036583666 shutdown_connections 2023-09-30T22:35:53.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.702+0000 7fc0c4955700 1 -- 172.21.15.59:0/1036583666 wait complete. 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.703+0000 7fc0c4955700 1 Processor -- start 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.704+0000 7fc0c4955700 1 -- start start 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.704+0000 7fc0c4955700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0c006a770 0x7fc0c011d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.704+0000 7fc0c4955700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0c006b080 0x7fc0c01c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.704+0000 7fc0c4955700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0c0131b40 0x7fc0c01c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.704+0000 7fc0c4955700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c011fd00 con 0x7fc0c006a770 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.704+0000 7fc0c4955700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c011ff30 con 0x7fc0c006b080 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.704+0000 7fc0c4955700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c011ef70 con 0x7fc0c0131b40 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.704+0000 7fc0bed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0c0131b40 0x7fc0c01c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.704+0000 7fc0bed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0c0131b40 0x7fc0c01c6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45478/0 (socket says 172.21.15.59:45478) 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.704+0000 7fc0bed9d700 1 -- 172.21.15.59:0/3427295601 learned_addr learned my addr 172.21.15.59:0/3427295601 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.704+0000 7fc0be59c700 1 --2- 172.21.15.59:0/3427295601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0c006a770 0x7fc0c011d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.704+0000 7fc0bdd9b700 1 --2- 172.21.15.59:0/3427295601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0c006b080 0x7fc0c01c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.705+0000 7fc0bed9d700 1 -- 172.21.15.59:0/3427295601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0c006b080 msgr2=0x7fc0c01c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.705+0000 7fc0bed9d700 1 --2- 172.21.15.59:0/3427295601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0c006b080 0x7fc0c01c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.705+0000 7fc0bed9d700 1 -- 172.21.15.59:0/3427295601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0c006a770 msgr2=0x7fc0c011d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.705+0000 7fc0bed9d700 1 --2- 172.21.15.59:0/3427295601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0c006a770 0x7fc0c011d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.705+0000 7fc0bed9d700 1 -- 172.21.15.59:0/3427295601 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00094a0 con 0x7fc0c0131b40 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.705+0000 7fc0bed9d700 1 --2- 172.21.15.59:0/3427295601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0c0131b40 0x7fc0c01c6230 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800cb40 tx=0x7fc0b800ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.705+0000 7fc0aeffd700 1 -- 172.21.15.59:0/3427295601 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b800a9e0 con 0x7fc0c0131b40 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.705+0000 7fc0aeffd700 1 -- 172.21.15.59:0/3427295601 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b800ab40 con 0x7fc0c0131b40 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.705+0000 7fc0aeffd700 1 -- 172.21.15.59:0/3427295601 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8012400 con 0x7fc0c0131b40 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.705+0000 7fc0c4955700 1 -- 172.21.15.59:0/3427295601 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c01209a0 con 0x7fc0c0131b40 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.705+0000 7fc0c4955700 1 -- 172.21.15.59:0/3427295601 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c011e300 con 0x7fc0c0131b40 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.706+0000 7fc0aeffd700 1 -- 172.21.15.59:0/3427295601 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0b801b3b0 con 0x7fc0c0131b40 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.707+0000 7fc0aeffd700 1 -- 172.21.15.59:0/3427295601 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc0b803f2d0 con 0x7fc0c0131b40 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.707+0000 7fc0c4955700 1 -- 172.21.15.59:0/3427295601 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c0131180 con 0x7fc0c0131b40 2023-09-30T22:35:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.712+0000 7fc0aeffd700 1 -- 172.21.15.59:0/3427295601 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0b8017080 con 0x7fc0c0131b40 2023-09-30T22:35:53.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.882+0000 7f198b1e0700 1 -- 172.21.15.59:0/1048311217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f19840747f0 con 0x7f198409d630 2023-09-30T22:35:53.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.882+0000 7f19817fa700 1 -- 172.21.15.59:0/1048311217 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1978015070 con 0x7f198409d630 2023-09-30T22:35:53.883 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.884+0000 7f198b1e0700 1 -- 172.21.15.59:0/1048311217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f198409d630 msgr2=0x7f19841c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.884+0000 7f198b1e0700 1 --2- 172.21.15.59:0/1048311217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f198409d630 0x7f19841c8020 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f1978016000 tx=0x7f1978004750 comp rx=0 tx=0).stop 2023-09-30T22:35:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.885+0000 7f198b1e0700 1 -- 172.21.15.59:0/1048311217 shutdown_connections 2023-09-30T22:35:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.885+0000 7f198b1e0700 1 --2- 172.21.15.59:0/1048311217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1984133930 0x7f19841c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.885+0000 7f198b1e0700 1 --2- 172.21.15.59:0/1048311217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f198409d630 0x7f19841c8020 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.885+0000 7f198b1e0700 1 --2- 172.21.15.59:0/1048311217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19840a0a30 0x7f19841c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.885+0000 7f198b1e0700 1 -- 172.21.15.59:0/1048311217 >> 172.21.15.59:0/1048311217 conn(0x7f19840a3050 msgr2=0x7f19841bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.885+0000 7f198b1e0700 1 -- 172.21.15.59:0/1048311217 shutdown_connections 2023-09-30T22:35:53.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.885+0000 7f198b1e0700 1 -- 172.21.15.59:0/1048311217 wait complete. 2023-09-30T22:35:53.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:53.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.921+0000 7fc0c4955700 1 -- 172.21.15.59:0/3427295601 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc0c00747f0 con 0x7fc0c0131b40 2023-09-30T22:35:53.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.921+0000 7fc0aeffd700 1 -- 172.21.15.59:0/3427295601 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0b80192c0 con 0x7fc0c0131b40 2023-09-30T22:35:53.922 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:53.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.924+0000 7fc0c4955700 1 -- 172.21.15.59:0/3427295601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0c0131b40 msgr2=0x7fc0c01c6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:53.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.924+0000 7fc0c4955700 1 --2- 172.21.15.59:0/3427295601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0c0131b40 0x7fc0c01c6230 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800cb40 tx=0x7fc0b800ce50 comp rx=0 tx=0).stop 2023-09-30T22:35:53.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.924+0000 7fc0c4955700 1 -- 172.21.15.59:0/3427295601 shutdown_connections 2023-09-30T22:35:53.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.924+0000 7fc0c4955700 1 --2- 172.21.15.59:0/3427295601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0c0131b40 0x7fc0c01c6230 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.924+0000 7fc0c4955700 1 --2- 172.21.15.59:0/3427295601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0c006a770 0x7fc0c011d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.924+0000 7fc0c4955700 1 --2- 172.21.15.59:0/3427295601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0c006b080 0x7fc0c01c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:53.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.924+0000 7fc0c4955700 1 -- 172.21.15.59:0/3427295601 >> 172.21.15.59:0/3427295601 conn(0x7fc0c0066f50 msgr2=0x7fc0c01b97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:53.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.924+0000 7fc0c4955700 1 -- 172.21.15.59:0/3427295601 shutdown_connections 2023-09-30T22:35:53.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:53.924+0000 7fc0c4955700 1 -- 172.21.15.59:0/3427295601 wait complete. 2023-09-30T22:35:53.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:54.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:54.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:54.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.580+0000 7f5026c16700 1 Processor -- start 2023-09-30T22:35:54.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.580+0000 7f5026c16700 1 -- start start 2023-09-30T22:35:54.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f5026c16700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f50200a0a30 0x7f50200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:54.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f5026c16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5020138d80 0x7f502013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:54.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f5026c16700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50200a2a70 con 0x7f502009d630 2023-09-30T22:35:54.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f5026c16700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50200a01d0 con 0x7f50200a0a30 2023-09-30T22:35:54.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f5026c16700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502009e2b0 con 0x7f5020138d80 2023-09-30T22:35:54.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f50251b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5020138d80 0x7f502013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:54.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f50249b2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f50200a0a30 0x7f50200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:54.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f50251b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5020138d80 0x7f502013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39226/0 (socket says 172.21.15.59:39226) 2023-09-30T22:35:54.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f50249b2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f50200a0a30 0x7f50200a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52164/0 (socket says 172.21.15.59:52164) 2023-09-30T22:35:54.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f50251b3700 1 -- 172.21.15.59:0/2651680612 learned_addr learned my addr 172.21.15.59:0/2651680612 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:54.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f50251b3700 1 -- 172.21.15.59:0/2651680612 >> v2:172.21.15.59:3300/0 conn(0x7f50200a0a30 msgr2=0x7f50200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:54.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f50251b3700 1 --2- 172.21.15.59:0/2651680612 >> v2:172.21.15.59:3300/0 conn(0x7f50200a0a30 0x7f50200a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f50251b3700 1 -- 172.21.15.59:0/2651680612 >> v1:172.21.15.59:6789/0 conn(0x7f502009d630 legacy=0x7f50200a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:54.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f50251b3700 1 -- 172.21.15.59:0/2651680612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502009dc50 con 0x7f5020138d80 2023-09-30T22:35:54.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f50249b2700 1 --2- 172.21.15.59:0/2651680612 >> v2:172.21.15.59:3300/0 conn(0x7f50200a0a30 0x7f50200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:54.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.581+0000 7f50251b3700 1 --2- 172.21.15.59:0/2651680612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5020138d80 0x7f502013b160 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f5018009e50 tx=0x7f501800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58f79e406d92f43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:54.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.582+0000 7f501f7fe700 1 -- 172.21.15.59:0/2651680612 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501800e070 con 0x7f5020138d80 2023-09-30T22:35:54.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.582+0000 7f501f7fe700 1 -- 172.21.15.59:0/2651680612 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501800b910 con 0x7f5020138d80 2023-09-30T22:35:54.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.582+0000 7f501f7fe700 1 -- 172.21.15.59:0/2651680612 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501800bcc0 con 0x7f5020138d80 2023-09-30T22:35:54.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.582+0000 7f5026c16700 1 -- 172.21.15.59:0/2651680612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5020138d80 msgr2=0x7f502013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:54.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.582+0000 7f5026c16700 1 --2- 172.21.15.59:0/2651680612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5020138d80 0x7f502013b160 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f5018009e50 tx=0x7f501800b330 comp rx=0 tx=0).stop 2023-09-30T22:35:54.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.582+0000 7f5026c16700 1 -- 172.21.15.59:0/2651680612 shutdown_connections 2023-09-30T22:35:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.582+0000 7f5026c16700 1 --2- 172.21.15.59:0/2651680612 >> v2:172.21.15.59:3300/0 conn(0x7f50200a0a30 0x7f50200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.582+0000 7f5026c16700 1 --2- 172.21.15.59:0/2651680612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5020138d80 0x7f502013b160 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.582+0000 7f5026c16700 1 -- 172.21.15.59:0/2651680612 >> 172.21.15.59:0/2651680612 conn(0x7f50200a3050 msgr2=0x7f50200a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.582+0000 7f5026c16700 1 -- 172.21.15.59:0/2651680612 shutdown_connections 2023-09-30T22:35:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.582+0000 7f5026c16700 1 -- 172.21.15.59:0/2651680612 wait complete. 2023-09-30T22:35:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.583+0000 7f5026c16700 1 Processor -- start 2023-09-30T22:35:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.583+0000 7f5026c16700 1 -- start start 2023-09-30T22:35:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.584+0000 7f5026c16700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f502009d630 0x7f5020133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:54.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.584+0000 7f5026c16700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50200a0a30 0x7f5020133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:54.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.584+0000 7f5026c16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5020138d80 0x7f50201344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:54.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.584+0000 7f5026c16700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5020136b90 con 0x7f50200a0a30 2023-09-30T22:35:54.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.584+0000 7f5026c16700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5020138090 con 0x7f5020138d80 2023-09-30T22:35:54.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.584+0000 7f5026c16700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50201374b0 con 0x7f502009d630 2023-09-30T22:35:54.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.584+0000 7f501ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50200a0a30 0x7f5020133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:54.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.584+0000 7f50251b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5020138d80 0x7f50201344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:54.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.584+0000 7f50249b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f502009d630 0x7f5020133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:54.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.584+0000 7f501ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50200a0a30 0x7f5020133f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52172/0 (socket says 172.21.15.59:52172) 2023-09-30T22:35:54.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.584+0000 7f501ffff700 1 -- 172.21.15.59:0/3553980134 learned_addr learned my addr 172.21.15.59:0/3553980134 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:54.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.585+0000 7f501ffff700 1 -- 172.21.15.59:0/3553980134 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f502009d630 msgr2=0x7f5020133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:54.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.585+0000 7f501ffff700 1 --2- 172.21.15.59:0/3553980134 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f502009d630 0x7f5020133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.585+0000 7f501ffff700 1 -- 172.21.15.59:0/3553980134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5020138d80 msgr2=0x7f50201344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:54.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.585+0000 7f501ffff700 1 --2- 172.21.15.59:0/3553980134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5020138d80 0x7f50201344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.585+0000 7f501ffff700 1 -- 172.21.15.59:0/3553980134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50140094a0 con 0x7f50200a0a30 2023-09-30T22:35:54.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.585+0000 7f50251b3700 1 --2- 172.21.15.59:0/3553980134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5020138d80 0x7f50201344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:54.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.585+0000 7f501ffff700 1 --2- 172.21.15.59:0/3553980134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50200a0a30 0x7f5020133f70 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f500c00c510 tx=0x7f500c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:54.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.585+0000 7f501d7fa700 1 -- 172.21.15.59:0/3553980134 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c0052d0 con 0x7f50200a0a30 2023-09-30T22:35:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.585+0000 7f501d7fa700 1 -- 172.21.15.59:0/3553980134 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500c005430 con 0x7f50200a0a30 2023-09-30T22:35:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.585+0000 7f5026c16700 1 -- 172.21.15.59:0/3553980134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5018009b30 con 0x7f50200a0a30 2023-09-30T22:35:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.585+0000 7f501d7fa700 1 -- 172.21.15.59:0/3553980134 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c0038c0 con 0x7f50200a0a30 2023-09-30T22:35:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.585+0000 7f5026c16700 1 -- 172.21.15.59:0/3553980134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50201371d0 con 0x7f50200a0a30 2023-09-30T22:35:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.586+0000 7f5026c16700 1 -- 172.21.15.59:0/3553980134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5020136e70 con 0x7f50200a0a30 2023-09-30T22:35:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.586+0000 7f501d7fa700 1 -- 172.21.15.59:0/3553980134 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f500c003a20 con 0x7f50200a0a30 2023-09-30T22:35:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.587+0000 7f501d7fa700 1 -- 172.21.15.59:0/3553980134 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f500c03eb70 con 0x7f50200a0a30 2023-09-30T22:35:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.595+0000 7f501d7fa700 1 -- 172.21.15.59:0/3553980134 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f500c011590 con 0x7f50200a0a30 2023-09-30T22:35:54.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.622+0000 7f1cd5009700 1 Processor -- start 2023-09-30T22:35:54.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.622+0000 7f1cd5009700 1 -- start start 2023-09-30T22:35:54.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.623+0000 7f1cd5009700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cd00a0a30 0x7f1cd00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:54.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.623+0000 7f1cd5009700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd009d630 0x7f1cd00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:54.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.623+0000 7f1cd5009700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd0133930 0x7f1cd0133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:54.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.623+0000 7f1cd5009700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd00a2a70 con 0x7f1cd00a0a30 2023-09-30T22:35:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.623+0000 7f1cd5009700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd00a01d0 con 0x7f1cd009d630 2023-09-30T22:35:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.623+0000 7f1cd5009700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd009e2b0 con 0x7f1cd0133930 2023-09-30T22:35:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.623+0000 7f1cced9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cd00a0a30 0x7f1cd00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.623+0000 7f1ccf59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd0133930 0x7f1cd0133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.623+0000 7f1cced9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cd00a0a30 0x7f1cd00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52176/0 (socket says 172.21.15.59:52176) 2023-09-30T22:35:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.623+0000 7f1cced9d700 1 -- 172.21.15.59:0/1829939829 learned_addr learned my addr 172.21.15.59:0/1829939829 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.623+0000 7f1cce59c700 1 --2- 172.21.15.59:0/1829939829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd009d630 0x7f1cd00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.624+0000 7f1cced9d700 1 -- 172.21.15.59:0/1829939829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd0133930 msgr2=0x7f1cd0133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.624+0000 7f1cced9d700 1 --2- 172.21.15.59:0/1829939829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd0133930 0x7f1cd0133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.624+0000 7f1cced9d700 1 -- 172.21.15.59:0/1829939829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd009d630 msgr2=0x7f1cd00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.624+0000 7f1cced9d700 1 --2- 172.21.15.59:0/1829939829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd009d630 0x7f1cd00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.624+0000 7f1cced9d700 1 -- 172.21.15.59:0/1829939829 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd009dc50 con 0x7f1cd00a0a30 2023-09-30T22:35:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.624+0000 7f1ccf59e700 1 --2- 172.21.15.59:0/1829939829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd0133930 0x7f1cd0133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.624+0000 7f1cce59c700 1 --2- 172.21.15.59:0/1829939829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd009d630 0x7f1cd00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.624+0000 7f1cced9d700 1 --2- 172.21.15.59:0/1829939829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd00a0a30 0x7f1cd00a0e00 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009e50 tx=0x7f1cc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177b49646031fe4a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.624+0000 7f1ccdd9b700 1 -- 172.21.15.59:0/1829939829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc000e070 con 0x7f1cd00a0a30 2023-09-30T22:35:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.624+0000 7f1ccdd9b700 1 -- 172.21.15.59:0/1829939829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc000b910 con 0x7f1cd00a0a30 2023-09-30T22:35:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.624+0000 7f1ccdd9b700 1 -- 172.21.15.59:0/1829939829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc000bcc0 con 0x7f1cd00a0a30 2023-09-30T22:35:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.625+0000 7f1cd5009700 1 -- 172.21.15.59:0/1829939829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd00a0a30 msgr2=0x7f1cd00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.625+0000 7f1cd5009700 1 --2- 172.21.15.59:0/1829939829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd00a0a30 0x7f1cd00a0e00 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009e50 tx=0x7f1cc000b330 comp rx=0 tx=0).stop 2023-09-30T22:35:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.625+0000 7f1cd5009700 1 -- 172.21.15.59:0/1829939829 shutdown_connections 2023-09-30T22:35:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.625+0000 7f1cd5009700 1 --2- 172.21.15.59:0/1829939829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd0133930 0x7f1cd0133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.625+0000 7f1cd5009700 1 --2- 172.21.15.59:0/1829939829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd00a0a30 0x7f1cd00a0e00 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.625+0000 7f1cd5009700 1 --2- 172.21.15.59:0/1829939829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd009d630 0x7f1cd00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.625+0000 7f1cd5009700 1 -- 172.21.15.59:0/1829939829 >> 172.21.15.59:0/1829939829 conn(0x7f1cd00a3050 msgr2=0x7f1cd00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:54.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.625+0000 7f1cd5009700 1 -- 172.21.15.59:0/1829939829 shutdown_connections 2023-09-30T22:35:54.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.625+0000 7f1cd5009700 1 -- 172.21.15.59:0/1829939829 wait complete. 2023-09-30T22:35:54.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.626+0000 7f1cd5009700 1 Processor -- start 2023-09-30T22:35:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.626+0000 7f1cd5009700 1 -- start start 2023-09-30T22:35:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cd5009700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd009d630 0x7f1cd011f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cd5009700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd00a0a30 0x7f1cd011f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cd5009700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd0133930 0x7f1cd01c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cd5009700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd0122390 con 0x7f1cd009d630 2023-09-30T22:35:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cd5009700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd0122570 con 0x7f1cd0133930 2023-09-30T22:35:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cd5009700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd01333e0 con 0x7f1cd00a0a30 2023-09-30T22:35:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cced9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd009d630 0x7f1cd011f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cce59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd00a0a30 0x7f1cd011f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cced9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd009d630 0x7f1cd011f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52186/0 (socket says 172.21.15.59:52186) 2023-09-30T22:35:54.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cced9d700 1 -- 172.21.15.59:0/1669476261 learned_addr learned my addr 172.21.15.59:0/1669476261 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:54.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1ccf59e700 1 --2- 172.21.15.59:0/1669476261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd0133930 0x7f1cd01c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:54.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cced9d700 1 -- 172.21.15.59:0/1669476261 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd00a0a30 msgr2=0x7f1cd011f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:54.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cced9d700 1 --2- 172.21.15.59:0/1669476261 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd00a0a30 0x7f1cd011f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cced9d700 1 -- 172.21.15.59:0/1669476261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd0133930 msgr2=0x7f1cd01c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:54.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cced9d700 1 --2- 172.21.15.59:0/1669476261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd0133930 0x7f1cd01c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cced9d700 1 -- 172.21.15.59:0/1669476261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb80094a0 con 0x7f1cd009d630 2023-09-30T22:35:54.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cce59c700 1 --2- 172.21.15.59:0/1669476261 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd00a0a30 0x7f1cd011f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:54.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1ccf59e700 1 --2- 172.21.15.59:0/1669476261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd0133930 0x7f1cd01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:54.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cced9d700 1 --2- 172.21.15.59:0/1669476261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd009d630 0x7f1cd011f420 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00a2bb0 tx=0x7f1cc0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:54.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.627+0000 7f1cc77fe700 1 -- 172.21.15.59:0/1669476261 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc000ce80 con 0x7f1cd009d630 2023-09-30T22:35:54.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.628+0000 7f1cc77fe700 1 -- 172.21.15.59:0/1669476261 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc0004250 con 0x7f1cd009d630 2023-09-30T22:35:54.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.628+0000 7f1cd5009700 1 -- 172.21.15.59:0/1669476261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc80094a0 con 0x7f1cd009d630 2023-09-30T22:35:54.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.628+0000 7f1cc77fe700 1 -- 172.21.15.59:0/1669476261 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0004600 con 0x7f1cd009d630 2023-09-30T22:35:54.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.628+0000 7f1cd5009700 1 -- 172.21.15.59:0/1669476261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc0009b30 con 0x7f1cd009d630 2023-09-30T22:35:54.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.629+0000 7f1cc77fe700 1 -- 172.21.15.59:0/1669476261 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1cc0004760 con 0x7f1cd009d630 2023-09-30T22:35:54.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.629+0000 7f1cc77fe700 1 -- 172.21.15.59:0/1669476261 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1cc0040d20 con 0x7f1cd009d630 2023-09-30T22:35:54.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.629+0000 7f1cc57fa700 1 -- 172.21.15.59:0/1669476261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca80052e0 con 0x7f1cd009d630 2023-09-30T22:35:54.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.634+0000 7f1cc77fe700 1 -- 172.21.15.59:0/1669476261 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1cc001b7b0 con 0x7f1cd009d630 2023-09-30T22:35:54.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.804+0000 7f5026c16700 1 -- 172.21.15.59:0/3553980134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5020136e70 con 0x7f50200a0a30 2023-09-30T22:35:54.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.804+0000 7f501d7fa700 1 -- 172.21.15.59:0/3553980134 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5020136e70 con 0x7f50200a0a30 2023-09-30T22:35:54.804 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.806+0000 7f5026c16700 1 -- 172.21.15.59:0/3553980134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50200a0a30 msgr2=0x7f5020133f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.806+0000 7f5026c16700 1 --2- 172.21.15.59:0/3553980134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50200a0a30 0x7f5020133f70 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f500c00c510 tx=0x7f500c00c820 comp rx=0 tx=0).stop 2023-09-30T22:35:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.806+0000 7f5026c16700 1 -- 172.21.15.59:0/3553980134 shutdown_connections 2023-09-30T22:35:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.807+0000 7f5026c16700 1 --2- 172.21.15.59:0/3553980134 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f502009d630 0x7f5020133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.807+0000 7f5026c16700 1 --2- 172.21.15.59:0/3553980134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5020138d80 0x7f50201344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.807+0000 7f5026c16700 1 --2- 172.21.15.59:0/3553980134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50200a0a30 0x7f5020133f70 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.807+0000 7f5026c16700 1 -- 172.21.15.59:0/3553980134 >> 172.21.15.59:0/3553980134 conn(0x7f50200a3050 msgr2=0x7f502009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:54.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.807+0000 7f5026c16700 1 -- 172.21.15.59:0/3553980134 shutdown_connections 2023-09-30T22:35:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.807+0000 7f5026c16700 1 -- 172.21.15.59:0/3553980134 wait complete. 2023-09-30T22:35:54.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:54.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.839+0000 7f1cc57fa700 1 -- 172.21.15.59:0/1669476261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1ca8005590 con 0x7f1cd009d630 2023-09-30T22:35:54.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.839+0000 7f1cc77fe700 1 -- 172.21.15.59:0/1669476261 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1cc001b3a0 con 0x7f1cd009d630 2023-09-30T22:35:54.840 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:54.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.842+0000 7f1cc57fa700 1 -- 172.21.15.59:0/1669476261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd009d630 msgr2=0x7f1cd011f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:54.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.842+0000 7f1cc57fa700 1 --2- 172.21.15.59:0/1669476261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd009d630 0x7f1cd011f420 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00a2bb0 tx=0x7f1cc0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.842+0000 7f1cc57fa700 1 -- 172.21.15.59:0/1669476261 shutdown_connections 2023-09-30T22:35:54.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.842+0000 7f1cc57fa700 1 --2- 172.21.15.59:0/1669476261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd0133930 0x7f1cd01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.842+0000 7f1cc57fa700 1 --2- 172.21.15.59:0/1669476261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd009d630 0x7f1cd011f420 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.842+0000 7f1cc57fa700 1 --2- 172.21.15.59:0/1669476261 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1cd00a0a30 0x7f1cd011f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:54.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.842+0000 7f1cc57fa700 1 -- 172.21.15.59:0/1669476261 >> 172.21.15.59:0/1669476261 conn(0x7f1cd00a3050 msgr2=0x7f1cd01bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:54.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.842+0000 7f1cc57fa700 1 -- 172.21.15.59:0/1669476261 shutdown_connections 2023-09-30T22:35:54.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:54.842+0000 7f1cc57fa700 1 -- 172.21.15.59:0/1669476261 wait complete. 2023-09-30T22:35:54.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:54.899 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:54.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.041+0000 7f6f250b2700 1 Processor -- start 2023-09-30T22:35:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.042+0000 7f6f250b2700 1 -- start start 2023-09-30T22:35:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.042+0000 7f6f250b2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f200a0a30 0x7f6f200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.042+0000 7f6f250b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f200a1340 0x7f6f20133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.042+0000 7f6f250b2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f20133fa0 0x7f6f20134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.042+0000 7f6f250b2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2009edd0 con 0x7f6f20133fa0 2023-09-30T22:35:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.042+0000 7f6f250b2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2009e1f0 con 0x7f6f200a0a30 2023-09-30T22:35:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.042+0000 7f6f250b2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2009dc50 con 0x7f6f200a1340 2023-09-30T22:35:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.043+0000 7f6f1ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f200a0a30 0x7f6f200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.043+0000 7f6f1f59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f20133fa0 0x7f6f20134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.043+0000 7f6f1ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f200a0a30 0x7f6f200a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39268/0 (socket says 172.21.15.59:39268) 2023-09-30T22:35:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.043+0000 7f6f1ed9d700 1 -- 172.21.15.59:0/730139643 learned_addr learned my addr 172.21.15.59:0/730139643 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.043+0000 7f6f1e59c700 1 --2- 172.21.15.59:0/730139643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f200a1340 0x7f6f20133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.043+0000 7f6f1e59c700 1 -- 172.21.15.59:0/730139643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f200a0a30 msgr2=0x7f6f200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.043+0000 7f6f1e59c700 1 --2- 172.21.15.59:0/730139643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f200a0a30 0x7f6f200a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.043+0000 7f6f1e59c700 1 -- 172.21.15.59:0/730139643 >> v2:172.21.15.59:3300/0 conn(0x7f6f20133fa0 msgr2=0x7f6f20134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.043+0000 7f6f1e59c700 1 --2- 172.21.15.59:0/730139643 >> v2:172.21.15.59:3300/0 conn(0x7f6f20133fa0 0x7f6f20134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.043+0000 7f6f1e59c700 1 -- 172.21.15.59:0/730139643 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f200a1fe0 con 0x7f6f200a1340 2023-09-30T22:35:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.043+0000 7f6f1f59e700 1 --2- 172.21.15.59:0/730139643 >> v2:172.21.15.59:3300/0 conn(0x7f6f20133fa0 0x7f6f20134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.043+0000 7f6f1e59c700 1 --2- 172.21.15.59:0/730139643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f200a1340 0x7f6f20133a60 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009840 tx=0x7f6f14009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7d8354e27c90be7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.043+0000 7f6f1dd9b700 1 -- 172.21.15.59:0/730139643 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14011830 con 0x7f6f200a1340 2023-09-30T22:35:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.043+0000 7f6f1dd9b700 1 -- 172.21.15.59:0/730139643 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f14011990 con 0x7f6f200a1340 2023-09-30T22:35:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.043+0000 7f6f1dd9b700 1 -- 172.21.15.59:0/730139643 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14011d20 con 0x7f6f200a1340 2023-09-30T22:35:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.044+0000 7f6f250b2700 1 -- 172.21.15.59:0/730139643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f200a1340 msgr2=0x7f6f20133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.044+0000 7f6f250b2700 1 --2- 172.21.15.59:0/730139643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f200a1340 0x7f6f20133a60 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009840 tx=0x7f6f14009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.044+0000 7f6f250b2700 1 -- 172.21.15.59:0/730139643 shutdown_connections 2023-09-30T22:35:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.044+0000 7f6f250b2700 1 --2- 172.21.15.59:0/730139643 >> v2:172.21.15.59:3300/0 conn(0x7f6f20133fa0 0x7f6f20134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.044+0000 7f6f250b2700 1 --2- 172.21.15.59:0/730139643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f200a0a30 0x7f6f200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.044+0000 7f6f250b2700 1 --2- 172.21.15.59:0/730139643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f200a1340 0x7f6f20133a60 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.044+0000 7f6f250b2700 1 -- 172.21.15.59:0/730139643 >> 172.21.15.59:0/730139643 conn(0x7f6f200a6550 msgr2=0x7f6f200a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.044+0000 7f6f250b2700 1 -- 172.21.15.59:0/730139643 shutdown_connections 2023-09-30T22:35:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.044+0000 7f6f250b2700 1 -- 172.21.15.59:0/730139643 wait complete. 2023-09-30T22:35:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.046+0000 7f6f250b2700 1 Processor -- start 2023-09-30T22:35:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.046+0000 7f6f250b2700 1 -- start start 2023-09-30T22:35:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.046+0000 7f6f250b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f200a0a30 0x7f6f20120130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.046+0000 7f6f250b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f200a1340 0x7f6f20120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.046+0000 7f6f250b2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f20133fa0 0x7f6f20120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.046+0000 7f6f250b2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20123c50 con 0x7f6f200a1340 2023-09-30T22:35:55.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.046+0000 7f6f250b2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f200a3530 con 0x7f6f20133fa0 2023-09-30T22:35:55.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.046+0000 7f6f250b2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f201233e0 con 0x7f6f200a0a30 2023-09-30T22:35:55.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.046+0000 7f6f1ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f200a0a30 0x7f6f20120130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.046+0000 7f6f1e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f200a1340 0x7f6f20120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.046+0000 7f6f1ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f200a0a30 0x7f6f20120130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35888/0 (socket says 172.21.15.59:35888) 2023-09-30T22:35:55.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.046+0000 7f6f1ed9d700 1 -- 172.21.15.59:0/3094043363 learned_addr learned my addr 172.21.15.59:0/3094043363 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:55.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.046+0000 7f6f1f59e700 1 --2- 172.21.15.59:0/3094043363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f20133fa0 0x7f6f20120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.047+0000 7f6f1e59c700 1 -- 172.21.15.59:0/3094043363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f200a0a30 msgr2=0x7f6f20120130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:55.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.047+0000 7f6f1e59c700 1 --2- 172.21.15.59:0/3094043363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f200a0a30 0x7f6f20120130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.047+0000 7f6f1e59c700 1 -- 172.21.15.59:0/3094043363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f20133fa0 msgr2=0x7f6f20120bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:55.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.047+0000 7f6f1e59c700 1 --2- 172.21.15.59:0/3094043363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f20133fa0 0x7f6f20120bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.047+0000 7f6f1e59c700 1 -- 172.21.15.59:0/3094043363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18009a70 con 0x7f6f200a1340 2023-09-30T22:35:55.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.047+0000 7f6f1ed9d700 1 --2- 172.21.15.59:0/3094043363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f200a0a30 0x7f6f20120130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:55.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.047+0000 7f6f1f59e700 1 --2- 172.21.15.59:0/3094043363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f20133fa0 0x7f6f20120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:55.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.047+0000 7f6f1e59c700 1 --2- 172.21.15.59:0/3094043363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f200a1340 0x7f6f20120670 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f6f14016000 tx=0x7f6f14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:55.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.047+0000 7f6f077fe700 1 -- 172.21.15.59:0/3094043363 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14004450 con 0x7f6f200a1340 2023-09-30T22:35:55.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.047+0000 7f6f077fe700 1 -- 172.21.15.59:0/3094043363 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1401f070 con 0x7f6f200a1340 2023-09-30T22:35:55.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.047+0000 7f6f250b2700 1 -- 172.21.15.59:0/3094043363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f140094a0 con 0x7f6f200a1340 2023-09-30T22:35:55.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.047+0000 7f6f077fe700 1 -- 172.21.15.59:0/3094043363 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f140038e0 con 0x7f6f200a1340 2023-09-30T22:35:55.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.047+0000 7f6f250b2700 1 -- 172.21.15.59:0/3094043363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f20121d40 con 0x7f6f200a1340 2023-09-30T22:35:55.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.048+0000 7f6f077fe700 1 -- 172.21.15.59:0/3094043363 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f14003a40 con 0x7f6f200a1340 2023-09-30T22:35:55.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.048+0000 7f6f077fe700 1 -- 172.21.15.59:0/3094043363 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f14021070 con 0x7f6f200a1340 2023-09-30T22:35:55.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.048+0000 7f6f250b2700 1 -- 172.21.15.59:0/3094043363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f201237d0 con 0x7f6f200a1340 2023-09-30T22:35:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.053+0000 7f6f077fe700 1 -- 172.21.15.59:0/3094043363 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f201237d0 con 0x7f6f200a1340 2023-09-30T22:35:55.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.083+0000 7f03f8945700 1 Processor -- start 2023-09-30T22:35:55.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.083+0000 7f03f8945700 1 -- start start 2023-09-30T22:35:55.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.084+0000 7f03f8945700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03f40a0a30 0x7f03f40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.084+0000 7f03f8945700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03f4138d80 0x7f03f413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.084+0000 7f03f8945700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f40a2a70 con 0x7f03f409d630 2023-09-30T22:35:55.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.084+0000 7f03f8945700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40a01d0 con 0x7f03f4138d80 2023-09-30T22:35:55.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.084+0000 7f03f8945700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03f409e2b0 con 0x7f03f40a0a30 2023-09-30T22:35:55.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.084+0000 7f03f259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03f40a0a30 0x7f03f40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.084+0000 7f03f1d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f03f409d630 0x7f03f40a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56988/0 (socket says 172.21.15.59:56988) 2023-09-30T22:35:55.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.084+0000 7f03f1d9b700 1 -- 172.21.15.59:0/2061755550 learned_addr learned my addr 172.21.15.59:0/2061755550 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:35:55.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.084+0000 7f03f2d9d700 1 --2- 172.21.15.59:0/2061755550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03f4138d80 0x7f03f413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.085+0000 7f03f159a700 1 -- 172.21.15.59:0/2061755550 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704822246 0 0) 0x7f03f40a2a70 con 0x7f03f409d630 2023-09-30T22:35:55.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.085+0000 7f03f159a700 1 -- 172.21.15.59:0/2061755550 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03e00035b0 con 0x7f03f409d630 2023-09-30T22:35:55.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.085+0000 7f03f259c700 1 -- 172.21.15.59:0/2061755550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03f4138d80 msgr2=0x7f03f413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:55.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.085+0000 7f03f259c700 1 --2- 172.21.15.59:0/2061755550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03f4138d80 0x7f03f413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.085+0000 7f03f259c700 1 -- 172.21.15.59:0/2061755550 >> v1:172.21.15.59:6789/0 conn(0x7f03f409d630 legacy=0x7f03f40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:55.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.085+0000 7f03f259c700 1 -- 172.21.15.59:0/2061755550 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f409dc50 con 0x7f03f40a0a30 2023-09-30T22:35:55.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.085+0000 7f03f2d9d700 1 --2- 172.21.15.59:0/2061755550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03f4138d80 0x7f03f413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:55.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.085+0000 7f03f259c700 1 --2- 172.21.15.59:0/2061755550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03f40a0a30 0x7f03f40a0e00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009dc0 tx=0x7f03ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=935c422b4e89c5c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:55.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.085+0000 7f03f159a700 1 -- 172.21.15.59:0/2061755550 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec00e070 con 0x7f03f40a0a30 2023-09-30T22:35:55.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.085+0000 7f03f159a700 1 -- 172.21.15.59:0/2061755550 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec00bb20 con 0x7f03f40a0a30 2023-09-30T22:35:55.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.085+0000 7f03f159a700 1 -- 172.21.15.59:0/2061755550 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec012430 con 0x7f03f40a0a30 2023-09-30T22:35:55.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.086+0000 7f03f8945700 1 -- 172.21.15.59:0/2061755550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03f40a0a30 msgr2=0x7f03f40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:55.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.086+0000 7f03f8945700 1 --2- 172.21.15.59:0/2061755550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03f40a0a30 0x7f03f40a0e00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009dc0 tx=0x7f03ec00b330 comp rx=0 tx=0).stop 2023-09-30T22:35:55.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.086+0000 7f03f8945700 1 -- 172.21.15.59:0/2061755550 shutdown_connections 2023-09-30T22:35:55.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.086+0000 7f03f8945700 1 --2- 172.21.15.59:0/2061755550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03f40a0a30 0x7f03f40a0e00 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.086+0000 7f03f8945700 1 --2- 172.21.15.59:0/2061755550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03f4138d80 0x7f03f413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.086+0000 7f03f8945700 1 -- 172.21.15.59:0/2061755550 >> 172.21.15.59:0/2061755550 conn(0x7f03f40a3050 msgr2=0x7f03f40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:55.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.086+0000 7f03f8945700 1 -- 172.21.15.59:0/2061755550 shutdown_connections 2023-09-30T22:35:55.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.086+0000 7f03f8945700 1 -- 172.21.15.59:0/2061755550 wait complete. 2023-09-30T22:35:55.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.087+0000 7f03f8945700 1 Processor -- start 2023-09-30T22:35:55.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f8945700 1 -- start start 2023-09-30T22:35:55.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f8945700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03f409d630 0x7f03f41337b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f8945700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03f40a0a30 0x7f03f4133cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f8945700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03f4138d80 0x7f03f4134230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f8945700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4134c80 con 0x7f03f4138d80 2023-09-30T22:35:55.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f8945700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4136680 con 0x7f03f40a0a30 2023-09-30T22:35:55.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f8945700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4136ff0 con 0x7f03f409d630 2023-09-30T22:35:55.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03f40a0a30 0x7f03f4133cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03f4138d80 0x7f03f4134230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03f40a0a30 0x7f03f4133cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39290/0 (socket says 172.21.15.59:39290) 2023-09-30T22:35:55.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f1d9b700 1 -- 172.21.15.59:0/3720017035 learned_addr learned my addr 172.21.15.59:0/3720017035 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:55.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f259c700 1 --2- 172.21.15.59:0/3720017035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03f409d630 0x7f03f41337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f1d9b700 1 -- 172.21.15.59:0/3720017035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03f409d630 msgr2=0x7f03f41337b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:55.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f1d9b700 1 --2- 172.21.15.59:0/3720017035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03f409d630 0x7f03f41337b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f1d9b700 1 -- 172.21.15.59:0/3720017035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03f4138d80 msgr2=0x7f03f4134230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:55.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f1d9b700 1 --2- 172.21.15.59:0/3720017035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03f4138d80 0x7f03f4134230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f1d9b700 1 -- 172.21.15.59:0/3720017035 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e40094a0 con 0x7f03f40a0a30 2023-09-30T22:35:55.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.088+0000 7f03f2d9d700 1 --2- 172.21.15.59:0/3720017035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03f4138d80 0x7f03f4134230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:55.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.089+0000 7f03f1d9b700 1 --2- 172.21.15.59:0/3720017035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03f40a0a30 0x7f03f4133cf0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f03dc005910 tx=0x7f03dc00c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:55.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.089+0000 7f03eaffd700 1 -- 172.21.15.59:0/3720017035 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc005d70 con 0x7f03f40a0a30 2023-09-30T22:35:55.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.089+0000 7f03eaffd700 1 -- 172.21.15.59:0/3720017035 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc0070d0 con 0x7f03f40a0a30 2023-09-30T22:35:55.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.089+0000 7f03f8945700 1 -- 172.21.15.59:0/3720017035 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ec009a70 con 0x7f03f40a0a30 2023-09-30T22:35:55.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.089+0000 7f03eaffd700 1 -- 172.21.15.59:0/3720017035 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc007460 con 0x7f03f40a0a30 2023-09-30T22:35:55.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.089+0000 7f03f8945700 1 -- 172.21.15.59:0/3720017035 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f4136a60 con 0x7f03f40a0a30 2023-09-30T22:35:55.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.090+0000 7f03f8945700 1 -- 172.21.15.59:0/3720017035 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f40747f0 con 0x7f03f40a0a30 2023-09-30T22:35:55.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.091+0000 7f03eaffd700 1 -- 172.21.15.59:0/3720017035 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03dc0075c0 con 0x7f03f40a0a30 2023-09-30T22:35:55.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.091+0000 7f03eaffd700 1 -- 172.21.15.59:0/3720017035 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f03dc03efa0 con 0x7f03f40a0a30 2023-09-30T22:35:55.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.095+0000 7f03eaffd700 1 -- 172.21.15.59:0/3720017035 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03dc00f260 con 0x7f03f40a0a30 2023-09-30T22:35:55.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.263+0000 7f6f250b2700 1 -- 172.21.15.59:0/3094043363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6f201237d0 con 0x7f6f200a1340 2023-09-30T22:35:55.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.263+0000 7f6f077fe700 1 -- 172.21.15.59:0/3094043363 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f201237d0 con 0x7f6f200a1340 2023-09-30T22:35:55.264 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:55.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.265+0000 7f6f250b2700 1 -- 172.21.15.59:0/3094043363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f200a1340 msgr2=0x7f6f20120670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:55.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.265+0000 7f6f250b2700 1 --2- 172.21.15.59:0/3094043363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f200a1340 0x7f6f20120670 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f6f14016000 tx=0x7f6f14004750 comp rx=0 tx=0).stop 2023-09-30T22:35:55.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.265+0000 7f6f250b2700 1 -- 172.21.15.59:0/3094043363 shutdown_connections 2023-09-30T22:35:55.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.265+0000 7f6f250b2700 1 --2- 172.21.15.59:0/3094043363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f200a0a30 0x7f6f20120130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.265+0000 7f6f250b2700 1 --2- 172.21.15.59:0/3094043363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f20133fa0 0x7f6f20120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.265+0000 7f6f250b2700 1 --2- 172.21.15.59:0/3094043363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f200a1340 0x7f6f20120670 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.265+0000 7f6f250b2700 1 -- 172.21.15.59:0/3094043363 >> 172.21.15.59:0/3094043363 conn(0x7f6f200a6550 msgr2=0x7f6f201bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:55.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.265+0000 7f6f250b2700 1 -- 172.21.15.59:0/3094043363 shutdown_connections 2023-09-30T22:35:55.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.265+0000 7f6f250b2700 1 -- 172.21.15.59:0/3094043363 wait complete. 2023-09-30T22:35:55.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:55.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.300+0000 7f03f8945700 1 -- 172.21.15.59:0/3720017035 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f03f4137eb0 con 0x7f03f40a0a30 2023-09-30T22:35:55.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.300+0000 7f03eaffd700 1 -- 172.21.15.59:0/3720017035 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03dc017020 con 0x7f03f40a0a30 2023-09-30T22:35:55.300 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:55.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.302+0000 7f03f8945700 1 -- 172.21.15.59:0/3720017035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03f40a0a30 msgr2=0x7f03f4133cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.302+0000 7f03f8945700 1 --2- 172.21.15.59:0/3720017035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03f40a0a30 0x7f03f4133cf0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f03dc005910 tx=0x7f03dc00c9e0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.302+0000 7f03f8945700 1 -- 172.21.15.59:0/3720017035 shutdown_connections 2023-09-30T22:35:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.302+0000 7f03f8945700 1 --2- 172.21.15.59:0/3720017035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03f409d630 0x7f03f41337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.302+0000 7f03f8945700 1 --2- 172.21.15.59:0/3720017035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03f4138d80 0x7f03f4134230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.302+0000 7f03f8945700 1 --2- 172.21.15.59:0/3720017035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03f40a0a30 0x7f03f4133cf0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.302+0000 7f03f8945700 1 -- 172.21.15.59:0/3720017035 >> 172.21.15.59:0/3720017035 conn(0x7f03f40a3050 msgr2=0x7f03f409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.302+0000 7f03f8945700 1 -- 172.21.15.59:0/3720017035 shutdown_connections 2023-09-30T22:35:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.302+0000 7f03f8945700 1 -- 172.21.15.59:0/3720017035 wait complete. 2023-09-30T22:35:55.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:55.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:55.857 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.969+0000 7fcd98bad700 1 Processor -- start 2023-09-30T22:35:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.969+0000 7fcd98bad700 1 -- start start 2023-09-30T22:35:55.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.969+0000 7fcd98bad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd940a0a30 0x7fcd940a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.969+0000 7fcd98bad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd940a1340 0x7fcd94133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.969+0000 7fcd98bad700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9409edd0 con 0x7fcd94133fa0 2023-09-30T22:35:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.969+0000 7fcd98bad700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9409e1f0 con 0x7fcd940a0a30 2023-09-30T22:35:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.969+0000 7fcd98bad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9409dc50 con 0x7fcd940a1340 2023-09-30T22:35:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.970+0000 7fcd9259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd940a0a30 0x7fcd940a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.970+0000 7fcd91d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd940a1340 0x7fcd94133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.970+0000 7fcd9259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd940a0a30 0x7fcd940a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52224/0 (socket says 172.21.15.59:52224) 2023-09-30T22:35:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.970+0000 7fcd9259c700 1 -- 172.21.15.59:0/3658597471 learned_addr learned my addr 172.21.15.59:0/3658597471 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.970+0000 7fcd9259c700 1 -- 172.21.15.59:0/3658597471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd940a1340 msgr2=0x7fcd94133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.970+0000 7fcd9259c700 1 --2- 172.21.15.59:0/3658597471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd940a1340 0x7fcd94133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.970+0000 7fcd9259c700 1 -- 172.21.15.59:0/3658597471 >> v1:172.21.15.59:6789/0 conn(0x7fcd94133fa0 legacy=0x7fcd9413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.970+0000 7fcd9259c700 1 -- 172.21.15.59:0/3658597471 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd940a1fe0 con 0x7fcd940a0a30 2023-09-30T22:35:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.970+0000 7fcd91d9b700 1 --2- 172.21.15.59:0/3658597471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd940a1340 0x7fcd94133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.970+0000 7fcd9259c700 1 --2- 172.21.15.59:0/3658597471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd940a0a30 0x7fcd940a0e00 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fcd840098f0 tx=0x7fcd84009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdcae3cdaf5efa4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.970+0000 7fcd9159a700 1 -- 172.21.15.59:0/3658597471 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84011830 con 0x7fcd940a0a30 2023-09-30T22:35:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.970+0000 7fcd9159a700 1 -- 172.21.15.59:0/3658597471 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd84011990 con 0x7fcd940a0a30 2023-09-30T22:35:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.970+0000 7fcd9159a700 1 -- 172.21.15.59:0/3658597471 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84011d20 con 0x7fcd940a0a30 2023-09-30T22:35:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.971+0000 7fcd98bad700 1 -- 172.21.15.59:0/3658597471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd940a0a30 msgr2=0x7fcd940a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.971+0000 7fcd98bad700 1 --2- 172.21.15.59:0/3658597471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd940a0a30 0x7fcd940a0e00 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fcd840098f0 tx=0x7fcd84009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.971+0000 7fcd98bad700 1 -- 172.21.15.59:0/3658597471 shutdown_connections 2023-09-30T22:35:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.971+0000 7fcd98bad700 1 --2- 172.21.15.59:0/3658597471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd940a0a30 0x7fcd940a0e00 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.971+0000 7fcd98bad700 1 --2- 172.21.15.59:0/3658597471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd940a1340 0x7fcd94133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.971+0000 7fcd98bad700 1 -- 172.21.15.59:0/3658597471 >> 172.21.15.59:0/3658597471 conn(0x7fcd940a6550 msgr2=0x7fcd940a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.971+0000 7fcd98bad700 1 -- 172.21.15.59:0/3658597471 shutdown_connections 2023-09-30T22:35:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.971+0000 7fcd98bad700 1 -- 172.21.15.59:0/3658597471 wait complete. 2023-09-30T22:35:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.972+0000 7fcd98bad700 1 Processor -- start 2023-09-30T22:35:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.973+0000 7fcd98bad700 1 -- start start 2023-09-30T22:35:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.973+0000 7fcd98bad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd940a0a30 0x7fcd9411e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.973+0000 7fcd98bad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd940a1340 0x7fcd9411ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.973+0000 7fcd98bad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd94133fa0 0x7fcd9411f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.973+0000 7fcd98bad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd94121f50 con 0x7fcd940a1340 2023-09-30T22:35:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.973+0000 7fcd98bad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd94120430 con 0x7fcd94133fa0 2023-09-30T22:35:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.973+0000 7fcd98bad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940a37e0 con 0x7fcd940a0a30 2023-09-30T22:35:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.973+0000 7fcd91d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd940a1340 0x7fcd9411ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.973+0000 7fcd9259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd940a0a30 0x7fcd9411e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.973+0000 7fcd91d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd940a1340 0x7fcd9411ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52230/0 (socket says 172.21.15.59:52230) 2023-09-30T22:35:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.973+0000 7fcd91d9b700 1 -- 172.21.15.59:0/1743855852 learned_addr learned my addr 172.21.15.59:0/1743855852 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.973+0000 7fcd92d9d700 1 --2- 172.21.15.59:0/1743855852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd94133fa0 0x7fcd9411f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.974+0000 7fcd9259c700 1 -- 172.21.15.59:0/1743855852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd94133fa0 msgr2=0x7fcd9411f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.974+0000 7fcd9259c700 1 --2- 172.21.15.59:0/1743855852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd94133fa0 0x7fcd9411f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.974+0000 7fcd9259c700 1 -- 172.21.15.59:0/1743855852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd940a1340 msgr2=0x7fcd9411ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.974+0000 7fcd9259c700 1 --2- 172.21.15.59:0/1743855852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd940a1340 0x7fcd9411ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.974+0000 7fcd9259c700 1 -- 172.21.15.59:0/1743855852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd880094a0 con 0x7fcd940a0a30 2023-09-30T22:35:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.974+0000 7fcd91d9b700 1 --2- 172.21.15.59:0/1743855852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd940a1340 0x7fcd9411ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.974+0000 7fcd9259c700 1 --2- 172.21.15.59:0/1743855852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd940a0a30 0x7fcd9411e7a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fcd940673c0 tx=0x7fcd84004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.974+0000 7fcd82ffd700 1 -- 172.21.15.59:0/1743855852 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84004400 con 0x7fcd940a0a30 2023-09-30T22:35:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.974+0000 7fcd82ffd700 1 -- 172.21.15.59:0/1743855852 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8401f070 con 0x7fcd940a0a30 2023-09-30T22:35:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.974+0000 7fcd98bad700 1 -- 172.21.15.59:0/1743855852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd84009550 con 0x7fcd940a0a30 2023-09-30T22:35:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.974+0000 7fcd82ffd700 1 -- 172.21.15.59:0/1743855852 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd840038e0 con 0x7fcd940a0a30 2023-09-30T22:35:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.974+0000 7fcd98bad700 1 -- 172.21.15.59:0/1743855852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd940a0270 con 0x7fcd940a0a30 2023-09-30T22:35:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.975+0000 7fcd82ffd700 1 -- 172.21.15.59:0/1743855852 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd84021030 con 0x7fcd940a0a30 2023-09-30T22:35:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.975+0000 7fcd82ffd700 1 -- 172.21.15.59:0/1743855852 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcd84040a10 con 0x7fcd940a0a30 2023-09-30T22:35:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.975+0000 7fcd98bad700 1 -- 172.21.15.59:0/1743855852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd94122a80 con 0x7fcd940a0a30 2023-09-30T22:35:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:55.980+0000 7fcd82ffd700 1 -- 172.21.15.59:0/1743855852 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd84004560 con 0x7fcd940a0a30 2023-09-30T22:35:56.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.006+0000 7f1c3bfa8700 1 Processor -- start 2023-09-30T22:35:56.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.007+0000 7f1c3bfa8700 1 -- start start 2023-09-30T22:35:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.007+0000 7f1c3bfa8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c3409d630 0x7f1c340a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.007+0000 7f1c3bfa8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c34138d80 0x7f1c3413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.007+0000 7f1c3bfa8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c340a2a70 con 0x7f1c340a0a30 2023-09-30T22:35:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.007+0000 7f1c3bfa8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c340a01d0 con 0x7f1c34138d80 2023-09-30T22:35:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.007+0000 7f1c3bfa8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3409e2b0 con 0x7f1c3409d630 2023-09-30T22:35:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.007+0000 7f1c3a545700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c34138d80 0x7f1c3413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.007+0000 7f1c39543700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c3409d630 0x7f1c340a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.007+0000 7f1c3a545700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c34138d80 0x7f1c3413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52240/0 (socket says 172.21.15.59:52240) 2023-09-30T22:35:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.007+0000 7f1c3a545700 1 -- 172.21.15.59:0/293227987 learned_addr learned my addr 172.21.15.59:0/293227987 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.007+0000 7f1c39d44700 1 --1- 172.21.15.59:0/293227987 >> v1:172.21.15.59:6789/0 conn(0x7f1c340a0a30 0x7f1c340a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57010/0 (socket says 172.21.15.59:57010) 2023-09-30T22:35:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.008+0000 7f1c3a545700 1 -- 172.21.15.59:0/293227987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c3409d630 msgr2=0x7f1c340a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.008+0000 7f1c3a545700 1 --2- 172.21.15.59:0/293227987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c3409d630 0x7f1c340a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.008+0000 7f1c3a545700 1 -- 172.21.15.59:0/293227987 >> v1:172.21.15.59:6789/0 conn(0x7f1c340a0a30 legacy=0x7f1c340a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.008+0000 7f1c3a545700 1 -- 172.21.15.59:0/293227987 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3409dc50 con 0x7f1c34138d80 2023-09-30T22:35:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.008+0000 7f1c38d42700 1 -- 172.21.15.59:0/293227987 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990141298 0 0) 0x7f1c340a2a70 con 0x7f1c340a0a30 2023-09-30T22:35:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.008+0000 7f1c39543700 1 --2- 172.21.15.59:0/293227987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c3409d630 0x7f1c340a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:56.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.008+0000 7f1c3a545700 1 --2- 172.21.15.59:0/293227987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c34138d80 0x7f1c3413b160 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0098f0 tx=0x7f1c2c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d60d0fa48efaa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.008+0000 7f1c38d42700 1 -- 172.21.15.59:0/293227987 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c011830 con 0x7f1c34138d80 2023-09-30T22:35:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.008+0000 7f1c38d42700 1 -- 172.21.15.59:0/293227987 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c011990 con 0x7f1c34138d80 2023-09-30T22:35:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.008+0000 7f1c38d42700 1 -- 172.21.15.59:0/293227987 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c011d20 con 0x7f1c34138d80 2023-09-30T22:35:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.009+0000 7f1c3bfa8700 1 -- 172.21.15.59:0/293227987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c34138d80 msgr2=0x7f1c3413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.009+0000 7f1c3bfa8700 1 --2- 172.21.15.59:0/293227987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c34138d80 0x7f1c3413b160 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0098f0 tx=0x7f1c2c009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.009+0000 7f1c3bfa8700 1 -- 172.21.15.59:0/293227987 shutdown_connections 2023-09-30T22:35:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.009+0000 7f1c3bfa8700 1 --2- 172.21.15.59:0/293227987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c34138d80 0x7f1c3413b160 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.009+0000 7f1c3bfa8700 1 --2- 172.21.15.59:0/293227987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c3409d630 0x7f1c340a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.009+0000 7f1c3bfa8700 1 -- 172.21.15.59:0/293227987 >> 172.21.15.59:0/293227987 conn(0x7f1c340a3050 msgr2=0x7f1c340a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.009+0000 7f1c3bfa8700 1 -- 172.21.15.59:0/293227987 shutdown_connections 2023-09-30T22:35:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.009+0000 7f1c3bfa8700 1 -- 172.21.15.59:0/293227987 wait complete. 2023-09-30T22:35:56.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.010+0000 7f1c3bfa8700 1 Processor -- start 2023-09-30T22:35:56.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.010+0000 7f1c3bfa8700 1 -- start start 2023-09-30T22:35:56.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.011+0000 7f1c3bfa8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c3409d630 0x7f1c3412c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.011+0000 7f1c3bfa8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c340a0a30 0x7f1c3412cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.011+0000 7f1c3bfa8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c34138d80 0x7f1c3412cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.011+0000 7f1c3bfa8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c34130190 con 0x7f1c340a0a30 2023-09-30T22:35:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.011+0000 7f1c3bfa8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3412fc10 con 0x7f1c34138d80 2023-09-30T22:35:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.011+0000 7f1c3bfa8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c340a0410 con 0x7f1c3409d630 2023-09-30T22:35:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.011+0000 7f1c39d44700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c3409d630 0x7f1c3412c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.011+0000 7f1c39543700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c340a0a30 0x7f1c3412cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.011+0000 7f1c39d44700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c3409d630 0x7f1c3412c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35946/0 (socket says 172.21.15.59:35946) 2023-09-30T22:35:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.011+0000 7f1c39543700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c340a0a30 0x7f1c3412cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52254/0 (socket says 172.21.15.59:52254) 2023-09-30T22:35:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.011+0000 7f1c39d44700 1 -- 172.21.15.59:0/2753240405 learned_addr learned my addr 172.21.15.59:0/2753240405 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.011+0000 7f1c3a545700 1 --2- 172.21.15.59:0/2753240405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c34138d80 0x7f1c3412cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.011+0000 7f1c39d44700 1 -- 172.21.15.59:0/2753240405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c34138d80 msgr2=0x7f1c3412cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.011+0000 7f1c39d44700 1 --2- 172.21.15.59:0/2753240405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c34138d80 0x7f1c3412cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.012+0000 7f1c39d44700 1 -- 172.21.15.59:0/2753240405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c340a0a30 msgr2=0x7f1c3412cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.012+0000 7f1c39d44700 1 --2- 172.21.15.59:0/2753240405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c340a0a30 0x7f1c3412cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.012+0000 7f1c39d44700 1 -- 172.21.15.59:0/2753240405 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c280094a0 con 0x7f1c3409d630 2023-09-30T22:35:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.012+0000 7f1c39543700 1 --2- 172.21.15.59:0/2753240405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c340a0a30 0x7f1c3412cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.012+0000 7f1c3a545700 1 --2- 172.21.15.59:0/2753240405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c34138d80 0x7f1c3412cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.012+0000 7f1c39d44700 1 --2- 172.21.15.59:0/2753240405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c3409d630 0x7f1c3412c570 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400cc80 tx=0x7f1c2400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:56.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.012+0000 7f1c327fc700 1 -- 172.21.15.59:0/2753240405 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2400ab00 con 0x7f1c3409d630 2023-09-30T22:35:56.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.012+0000 7f1c327fc700 1 -- 172.21.15.59:0/2753240405 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2400ac60 con 0x7f1c3409d630 2023-09-30T22:35:56.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.012+0000 7f1c3bfa8700 1 -- 172.21.15.59:0/2753240405 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2c009550 con 0x7f1c3409d630 2023-09-30T22:35:56.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.012+0000 7f1c327fc700 1 -- 172.21.15.59:0/2753240405 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240070d0 con 0x7f1c3409d630 2023-09-30T22:35:56.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.012+0000 7f1c3bfa8700 1 -- 172.21.15.59:0/2753240405 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3412e5a0 con 0x7f1c3409d630 2023-09-30T22:35:56.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.013+0000 7f1c3bfa8700 1 -- 172.21.15.59:0/2753240405 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c340747f0 con 0x7f1c3409d630 2023-09-30T22:35:56.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.013+0000 7f1c327fc700 1 -- 172.21.15.59:0/2753240405 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c24007230 con 0x7f1c3409d630 2023-09-30T22:35:56.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.014+0000 7f1c327fc700 1 -- 172.21.15.59:0/2753240405 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1c2403fa30 con 0x7f1c3409d630 2023-09-30T22:35:56.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.018+0000 7f1c327fc700 1 -- 172.21.15.59:0/2753240405 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c240074e0 con 0x7f1c3409d630 2023-09-30T22:35:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.185+0000 7fcd98bad700 1 -- 172.21.15.59:0/1743855852 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcd94074ea0 con 0x7fcd940a0a30 2023-09-30T22:35:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.185+0000 7fcd82ffd700 1 -- 172.21.15.59:0/1743855852 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd84015030 con 0x7fcd940a0a30 2023-09-30T22:35:56.185 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:56.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.187+0000 7fcd98bad700 1 -- 172.21.15.59:0/1743855852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd940a0a30 msgr2=0x7fcd9411e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:56.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.187+0000 7fcd98bad700 1 --2- 172.21.15.59:0/1743855852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd940a0a30 0x7fcd9411e7a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fcd940673c0 tx=0x7fcd84004750 comp rx=0 tx=0).stop 2023-09-30T22:35:56.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.187+0000 7fcd98bad700 1 -- 172.21.15.59:0/1743855852 shutdown_connections 2023-09-30T22:35:56.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.187+0000 7fcd98bad700 1 --2- 172.21.15.59:0/1743855852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd940a0a30 0x7fcd9411e7a0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.187+0000 7fcd98bad700 1 --2- 172.21.15.59:0/1743855852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd94133fa0 0x7fcd9411f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.187+0000 7fcd98bad700 1 --2- 172.21.15.59:0/1743855852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd940a1340 0x7fcd9411ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.187+0000 7fcd98bad700 1 -- 172.21.15.59:0/1743855852 >> 172.21.15.59:0/1743855852 conn(0x7fcd940a6550 msgr2=0x7fcd941b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:56.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.187+0000 7fcd98bad700 1 -- 172.21.15.59:0/1743855852 shutdown_connections 2023-09-30T22:35:56.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.187+0000 7fcd98bad700 1 -- 172.21.15.59:0/1743855852 wait complete. 2023-09-30T22:35:56.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:56.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.222+0000 7f1c3bfa8700 1 -- 172.21.15.59:0/2753240405 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1c34072980 con 0x7f1c3409d630 2023-09-30T22:35:56.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.223+0000 7f1c327fc700 1 -- 172.21.15.59:0/2753240405 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c24011360 con 0x7f1c3409d630 2023-09-30T22:35:56.223 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:56.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.225+0000 7f1c3bfa8700 1 -- 172.21.15.59:0/2753240405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c3409d630 msgr2=0x7f1c3412c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:56.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.225+0000 7f1c3bfa8700 1 --2- 172.21.15.59:0/2753240405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c3409d630 0x7f1c3412c570 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400cc80 tx=0x7f1c2400cf90 comp rx=0 tx=0).stop 2023-09-30T22:35:56.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.225+0000 7f1c3bfa8700 1 -- 172.21.15.59:0/2753240405 shutdown_connections 2023-09-30T22:35:56.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.225+0000 7f1c3bfa8700 1 --2- 172.21.15.59:0/2753240405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c3409d630 0x7f1c3412c570 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.225+0000 7f1c3bfa8700 1 --2- 172.21.15.59:0/2753240405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c34138d80 0x7f1c3412cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.225+0000 7f1c3bfa8700 1 --2- 172.21.15.59:0/2753240405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c340a0a30 0x7f1c3412cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.225+0000 7f1c3bfa8700 1 -- 172.21.15.59:0/2753240405 >> 172.21.15.59:0/2753240405 conn(0x7f1c340a3050 msgr2=0x7f1c3409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:56.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.225+0000 7f1c3bfa8700 1 -- 172.21.15.59:0/2753240405 shutdown_connections 2023-09-30T22:35:56.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.225+0000 7f1c3bfa8700 1 -- 172.21.15.59:0/2753240405 wait complete. 2023-09-30T22:35:56.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:56.280 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:56.317 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:56.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.424+0000 7f70acc0b700 1 Processor -- start 2023-09-30T22:35:56.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.424+0000 7f70acc0b700 1 -- start start 2023-09-30T22:35:56.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.425+0000 7f70acc0b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a812cf60 0x7f70a806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.425+0000 7f70acc0b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70a812f8b0 0x7f70a812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.425+0000 7f70acc0b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70a8130260 0x7f70a8136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.425+0000 7f70acc0b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a812d330 con 0x7f70a812f8b0 2023-09-30T22:35:56.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.425+0000 7f70acc0b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a812cd90 con 0x7f70a812cf60 2023-09-30T22:35:56.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.425+0000 7f70acc0b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70a81306d0 con 0x7f70a8130260 2023-09-30T22:35:56.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.425+0000 7f70a659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a812cf60 0x7f70a806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.425+0000 7f70a6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70a8130260 0x7f70a8136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.425+0000 7f70a659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a812cf60 0x7f70a806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39334/0 (socket says 172.21.15.59:39334) 2023-09-30T22:35:56.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.425+0000 7f70a659c700 1 -- 172.21.15.59:0/2195331209 learned_addr learned my addr 172.21.15.59:0/2195331209 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:56.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.425+0000 7f70a5d9b700 1 --2- 172.21.15.59:0/2195331209 >> v2:172.21.15.59:3300/0 conn(0x7f70a812f8b0 0x7f70a812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.426+0000 7f70a659c700 1 -- 172.21.15.59:0/2195331209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70a8130260 msgr2=0x7f70a8136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:56.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.426+0000 7f70a659c700 1 --2- 172.21.15.59:0/2195331209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70a8130260 0x7f70a8136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.426+0000 7f70a659c700 1 -- 172.21.15.59:0/2195331209 >> v2:172.21.15.59:3300/0 conn(0x7f70a812f8b0 msgr2=0x7f70a812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:56.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.426+0000 7f70a659c700 1 --2- 172.21.15.59:0/2195331209 >> v2:172.21.15.59:3300/0 conn(0x7f70a812f8b0 0x7f70a812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.426+0000 7f70a659c700 1 -- 172.21.15.59:0/2195331209 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a8071780 con 0x7f70a812cf60 2023-09-30T22:35:56.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.426+0000 7f70a5d9b700 1 --2- 172.21.15.59:0/2195331209 >> v2:172.21.15.59:3300/0 conn(0x7f70a812f8b0 0x7f70a812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:56.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.426+0000 7f70a659c700 1 --2- 172.21.15.59:0/2195331209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a812cf60 0x7f70a806f5d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f709800aa90 tx=0x7f709800ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0a021b65f8c928f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:56.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.426+0000 7f70a559a700 1 -- 172.21.15.59:0/2195331209 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709800cb70 con 0x7f70a812cf60 2023-09-30T22:35:56.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.426+0000 7f70a559a700 1 -- 172.21.15.59:0/2195331209 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709800ccd0 con 0x7f70a812cf60 2023-09-30T22:35:56.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.426+0000 7f70a559a700 1 -- 172.21.15.59:0/2195331209 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7098018620 con 0x7f70a812cf60 2023-09-30T22:35:56.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.427+0000 7f70acc0b700 1 -- 172.21.15.59:0/2195331209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a812cf60 msgr2=0x7f70a806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:56.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.427+0000 7f70acc0b700 1 --2- 172.21.15.59:0/2195331209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a812cf60 0x7f70a806f5d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f709800aa90 tx=0x7f709800ada0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.427+0000 7f70acc0b700 1 -- 172.21.15.59:0/2195331209 shutdown_connections 2023-09-30T22:35:56.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.427+0000 7f70acc0b700 1 --2- 172.21.15.59:0/2195331209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70a8130260 0x7f70a8136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.427+0000 7f70acc0b700 1 --2- 172.21.15.59:0/2195331209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a812cf60 0x7f70a806f5d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.427+0000 7f70acc0b700 1 --2- 172.21.15.59:0/2195331209 >> v2:172.21.15.59:3300/0 conn(0x7f70a812f8b0 0x7f70a812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.427+0000 7f70acc0b700 1 -- 172.21.15.59:0/2195331209 >> 172.21.15.59:0/2195331209 conn(0x7f70a80a2aa0 msgr2=0x7f70a80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:56.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.427+0000 7f70acc0b700 1 -- 172.21.15.59:0/2195331209 shutdown_connections 2023-09-30T22:35:56.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.427+0000 7f70acc0b700 1 -- 172.21.15.59:0/2195331209 wait complete. 2023-09-30T22:35:56.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.428+0000 7f70acc0b700 1 Processor -- start 2023-09-30T22:35:56.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.428+0000 7f70acc0b700 1 -- start start 2023-09-30T22:35:56.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70acc0b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a812cf60 0x7f70a809b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70acc0b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70a812f8b0 0x7f70a809be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70acc0b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a8130260 0x7f70a81c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70acc0b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a8129fa0 con 0x7f70a8130260 2023-09-30T22:35:56.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70acc0b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a812da40 con 0x7f70a812cf60 2023-09-30T22:35:56.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70acc0b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70a809dc30 con 0x7f70a812f8b0 2023-09-30T22:35:56.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70a659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a812cf60 0x7f70a809b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70a5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70a812f8b0 0x7f70a809be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70a659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a812cf60 0x7f70a809b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39350/0 (socket says 172.21.15.59:39350) 2023-09-30T22:35:56.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70a659c700 1 -- 172.21.15.59:0/407159228 learned_addr learned my addr 172.21.15.59:0/407159228 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:56.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70a6d9d700 1 --2- 172.21.15.59:0/407159228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a8130260 0x7f70a81c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70a659c700 1 -- 172.21.15.59:0/407159228 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70a812f8b0 msgr2=0x7f70a809be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:56.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70a659c700 1 --2- 172.21.15.59:0/407159228 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70a812f8b0 0x7f70a809be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70a659c700 1 -- 172.21.15.59:0/407159228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a8130260 msgr2=0x7f70a81c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:56.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70a659c700 1 --2- 172.21.15.59:0/407159228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a8130260 0x7f70a81c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70a659c700 1 -- 172.21.15.59:0/407159228 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c0094a0 con 0x7f70a812cf60 2023-09-30T22:35:56.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.429+0000 7f70a6d9d700 1 --2- 172.21.15.59:0/407159228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a8130260 0x7f70a81c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:56.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.430+0000 7f70a659c700 1 --2- 172.21.15.59:0/407159228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a812cf60 0x7f70a809b930 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f709800c4d0 tx=0x7f70980047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:56.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.430+0000 7f7096ffd700 1 -- 172.21.15.59:0/407159228 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7098003ab0 con 0x7f70a812cf60 2023-09-30T22:35:56.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.430+0000 7f7096ffd700 1 -- 172.21.15.59:0/407159228 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7098003c30 con 0x7f70a812cf60 2023-09-30T22:35:56.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.430+0000 7f70acc0b700 1 -- 172.21.15.59:0/407159228 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709800a6f0 con 0x7f70a812cf60 2023-09-30T22:35:56.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.430+0000 7f7096ffd700 1 -- 172.21.15.59:0/407159228 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7098020400 con 0x7f70a812cf60 2023-09-30T22:35:56.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.430+0000 7f70acc0b700 1 -- 172.21.15.59:0/407159228 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a809cc20 con 0x7f70a812cf60 2023-09-30T22:35:56.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.431+0000 7f7096ffd700 1 -- 172.21.15.59:0/407159228 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7098018400 con 0x7f70a812cf60 2023-09-30T22:35:56.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.431+0000 7f7096ffd700 1 -- 172.21.15.59:0/407159228 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f70980409c0 con 0x7f70a812cf60 2023-09-30T22:35:56.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.431+0000 7f70acc0b700 1 -- 172.21.15.59:0/407159228 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a8074ea0 con 0x7f70a812cf60 2023-09-30T22:35:56.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.436+0000 7f7096ffd700 1 -- 172.21.15.59:0/407159228 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f709801e710 con 0x7f70a812cf60 2023-09-30T22:35:56.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.466+0000 7ff40b8cc700 1 Processor -- start 2023-09-30T22:35:56.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.466+0000 7ff40b8cc700 1 -- start start 2023-09-30T22:35:56.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff40b8cc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4040a0a30 0x7ff4040a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff40b8cc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff404138d80 0x7ff40413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff40b8cc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4040a2a70 con 0x7ff40409d630 2023-09-30T22:35:56.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff40b8cc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4040a01d0 con 0x7ff404138d80 2023-09-30T22:35:56.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff40b8cc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff40409e2b0 con 0x7ff4040a0a30 2023-09-30T22:35:56.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff409668700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4040a0a30 0x7ff4040a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff409e69700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff404138d80 0x7ff40413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff409668700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4040a0a30 0x7ff4040a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35962/0 (socket says 172.21.15.59:35962) 2023-09-30T22:35:56.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff409e69700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff404138d80 0x7ff40413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52276/0 (socket says 172.21.15.59:52276) 2023-09-30T22:35:56.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff409668700 1 -- 172.21.15.59:0/2471723445 learned_addr learned my addr 172.21.15.59:0/2471723445 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:56.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff409668700 1 -- 172.21.15.59:0/2471723445 >> v2:172.21.15.59:3300/0 conn(0x7ff404138d80 msgr2=0x7ff40413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:56.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff409668700 1 --2- 172.21.15.59:0/2471723445 >> v2:172.21.15.59:3300/0 conn(0x7ff404138d80 0x7ff40413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff409668700 1 -- 172.21.15.59:0/2471723445 >> v1:172.21.15.59:6789/0 conn(0x7ff40409d630 legacy=0x7ff4040a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:56.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff409668700 1 -- 172.21.15.59:0/2471723445 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40409dc50 con 0x7ff4040a0a30 2023-09-30T22:35:56.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff409e69700 1 --2- 172.21.15.59:0/2471723445 >> v2:172.21.15.59:3300/0 conn(0x7ff404138d80 0x7ff40413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:56.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.467+0000 7ff409668700 1 --2- 172.21.15.59:0/2471723445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4040a0a30 0x7ff4040a0e00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0098f0 tx=0x7ff3fc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cd3307d66dea92f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:56.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.468+0000 7ff403fff700 1 -- 172.21.15.59:0/2471723445 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc011830 con 0x7ff4040a0a30 2023-09-30T22:35:56.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.468+0000 7ff403fff700 1 -- 172.21.15.59:0/2471723445 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc011990 con 0x7ff4040a0a30 2023-09-30T22:35:56.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.468+0000 7ff403fff700 1 -- 172.21.15.59:0/2471723445 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc011d20 con 0x7ff4040a0a30 2023-09-30T22:35:56.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.468+0000 7ff40b8cc700 1 -- 172.21.15.59:0/2471723445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4040a0a30 msgr2=0x7ff4040a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:56.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.468+0000 7ff40b8cc700 1 --2- 172.21.15.59:0/2471723445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4040a0a30 0x7ff4040a0e00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0098f0 tx=0x7ff3fc009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:56.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.468+0000 7ff40b8cc700 1 -- 172.21.15.59:0/2471723445 shutdown_connections 2023-09-30T22:35:56.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.468+0000 7ff40b8cc700 1 --2- 172.21.15.59:0/2471723445 >> v2:172.21.15.59:3300/0 conn(0x7ff404138d80 0x7ff40413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.468+0000 7ff40b8cc700 1 --2- 172.21.15.59:0/2471723445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4040a0a30 0x7ff4040a0e00 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.468+0000 7ff40b8cc700 1 -- 172.21.15.59:0/2471723445 >> 172.21.15.59:0/2471723445 conn(0x7ff4040a3050 msgr2=0x7ff4040a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:56.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.468+0000 7ff40b8cc700 1 -- 172.21.15.59:0/2471723445 shutdown_connections 2023-09-30T22:35:56.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.468+0000 7ff40b8cc700 1 -- 172.21.15.59:0/2471723445 wait complete. 2023-09-30T22:35:56.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.469+0000 7ff40b8cc700 1 Processor -- start 2023-09-30T22:35:56.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.469+0000 7ff40b8cc700 1 -- start start 2023-09-30T22:35:56.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff40b8cc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff40409d630 0x7ff4041208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff40b8cc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4040a0a30 0x7ff404120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff40b8cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff404138d80 0x7ff404121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:56.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff40b8cc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff404122470 con 0x7ff40409d630 2023-09-30T22:35:56.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff40b8cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4041237c0 con 0x7ff404138d80 2023-09-30T22:35:56.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff40b8cc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff404121d50 con 0x7ff4040a0a30 2023-09-30T22:35:56.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff408e67700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4040a0a30 0x7ff404120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff409e69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff404138d80 0x7ff404121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff409e69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff404138d80 0x7ff404121370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39354/0 (socket says 172.21.15.59:39354) 2023-09-30T22:35:56.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff409e69700 1 -- 172.21.15.59:0/3178682252 learned_addr learned my addr 172.21.15.59:0/3178682252 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:56.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff408e67700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4040a0a30 0x7ff404120e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35976/0 (socket says 172.21.15.59:35976) 2023-09-30T22:35:56.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff409668700 1 --2- 172.21.15.59:0/3178682252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff40409d630 0x7ff4041208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:56.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff409668700 1 -- 172.21.15.59:0/3178682252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4040a0a30 msgr2=0x7ff404120e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:56.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff409668700 1 --2- 172.21.15.59:0/3178682252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4040a0a30 0x7ff404120e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff409668700 1 -- 172.21.15.59:0/3178682252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff404138d80 msgr2=0x7ff404121370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:56.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff409668700 1 --2- 172.21.15.59:0/3178682252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff404138d80 0x7ff404121370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.470+0000 7ff409668700 1 -- 172.21.15.59:0/3178682252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f4009a70 con 0x7ff40409d630 2023-09-30T22:35:56.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.471+0000 7ff409668700 1 --2- 172.21.15.59:0/3178682252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff40409d630 0x7ff4041208f0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc016000 tx=0x7ff3fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:56.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.471+0000 7ff401ffb700 1 -- 172.21.15.59:0/3178682252 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0036a0 con 0x7ff40409d630 2023-09-30T22:35:56.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.471+0000 7ff401ffb700 1 -- 172.21.15.59:0/3178682252 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc003800 con 0x7ff40409d630 2023-09-30T22:35:56.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.471+0000 7ff40b8cc700 1 -- 172.21.15.59:0/3178682252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3fc009550 con 0x7ff40409d630 2023-09-30T22:35:56.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.471+0000 7ff401ffb700 1 -- 172.21.15.59:0/3178682252 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc003b90 con 0x7ff40409d630 2023-09-30T22:35:56.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.471+0000 7ff40b8cc700 1 -- 172.21.15.59:0/3178682252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4040a0410 con 0x7ff40409d630 2023-09-30T22:35:56.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.472+0000 7ff401ffb700 1 -- 172.21.15.59:0/3178682252 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff3fc021070 con 0x7ff40409d630 2023-09-30T22:35:56.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.472+0000 7ff401ffb700 1 -- 172.21.15.59:0/3178682252 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff3fc040a70 con 0x7ff40409d630 2023-09-30T22:35:56.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.472+0000 7ff40b8cc700 1 -- 172.21.15.59:0/3178682252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff404123cc0 con 0x7ff40409d630 2023-09-30T22:35:56.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.477+0000 7ff401ffb700 1 -- 172.21.15.59:0/3178682252 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3fc015080 con 0x7ff40409d630 2023-09-30T22:35:56.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.643+0000 7f70acc0b700 1 -- 172.21.15.59:0/407159228 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f70a80713a0 con 0x7f70a812cf60 2023-09-30T22:35:56.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.644+0000 7f7096ffd700 1 -- 172.21.15.59:0/407159228 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7098025030 con 0x7f70a812cf60 2023-09-30T22:35:56.644 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:56.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.647+0000 7f70acc0b700 1 -- 172.21.15.59:0/407159228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a812cf60 msgr2=0x7f70a809b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.647+0000 7f70acc0b700 1 --2- 172.21.15.59:0/407159228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a812cf60 0x7f70a809b930 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f709800c4d0 tx=0x7f70980047c0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.647+0000 7f70acc0b700 1 -- 172.21.15.59:0/407159228 shutdown_connections 2023-09-30T22:35:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.647+0000 7f70acc0b700 1 --2- 172.21.15.59:0/407159228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a8130260 0x7f70a81c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.647+0000 7f70acc0b700 1 --2- 172.21.15.59:0/407159228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a812cf60 0x7f70a809b930 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.647+0000 7f70acc0b700 1 --2- 172.21.15.59:0/407159228 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70a812f8b0 0x7f70a809be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.647+0000 7f70acc0b700 1 -- 172.21.15.59:0/407159228 >> 172.21.15.59:0/407159228 conn(0x7f70a80a2aa0 msgr2=0x7f70a81b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.647+0000 7f70acc0b700 1 -- 172.21.15.59:0/407159228 shutdown_connections 2023-09-30T22:35:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.647+0000 7f70acc0b700 1 -- 172.21.15.59:0/407159228 wait complete. 2023-09-30T22:35:56.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.695+0000 7ff40b8cc700 1 -- 172.21.15.59:0/3178682252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff4040747f0 con 0x7ff40409d630 2023-09-30T22:35:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.695+0000 7ff401ffb700 1 -- 172.21.15.59:0/3178682252 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff3fc00b3e0 con 0x7ff40409d630 2023-09-30T22:35:56.696 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:56.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.698+0000 7ff40b8cc700 1 -- 172.21.15.59:0/3178682252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff40409d630 msgr2=0x7ff4041208f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:56.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.698+0000 7ff40b8cc700 1 --2- 172.21.15.59:0/3178682252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff40409d630 0x7ff4041208f0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc016000 tx=0x7ff3fc004750 comp rx=0 tx=0).stop 2023-09-30T22:35:56.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.698+0000 7ff40b8cc700 1 -- 172.21.15.59:0/3178682252 shutdown_connections 2023-09-30T22:35:56.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.698+0000 7ff40b8cc700 1 --2- 172.21.15.59:0/3178682252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff404138d80 0x7ff404121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.698+0000 7ff40b8cc700 1 --2- 172.21.15.59:0/3178682252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff40409d630 0x7ff4041208f0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.698+0000 7ff40b8cc700 1 --2- 172.21.15.59:0/3178682252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4040a0a30 0x7ff404120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.698+0000 7ff40b8cc700 1 -- 172.21.15.59:0/3178682252 >> 172.21.15.59:0/3178682252 conn(0x7ff4040a3050 msgr2=0x7ff404139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.698+0000 7ff40b8cc700 1 -- 172.21.15.59:0/3178682252 shutdown_connections 2023-09-30T22:35:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:56.698+0000 7ff40b8cc700 1 -- 172.21.15.59:0/3178682252 wait complete. 2023-09-30T22:35:56.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:57.202 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:57.240 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:57.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.352+0000 7fa2085a8700 1 Processor -- start 2023-09-30T22:35:57.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.352+0000 7fa2085a8700 1 -- start start 2023-09-30T22:35:57.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa2085a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2000a1510 0x7fa200138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa2085a8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa200139250 0x7fa20013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa2085a8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20009edd0 con 0x7fa2000a0a30 2023-09-30T22:35:57.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa2085a8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2000a18e0 con 0x7fa200139250 2023-09-30T22:35:57.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa2085a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20009e1f0 con 0x7fa2000a1510 2023-09-30T22:35:57.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa206b45700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa200139250 0x7fa20013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa205b43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2000a1510 0x7fa200138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa206b45700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa200139250 0x7fa20013b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52302/0 (socket says 172.21.15.59:52302) 2023-09-30T22:35:57.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa205b43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2000a1510 0x7fa200138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39360/0 (socket says 172.21.15.59:39360) 2023-09-30T22:35:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa206b45700 1 -- 172.21.15.59:0/985690449 learned_addr learned my addr 172.21.15.59:0/985690449 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa205b43700 1 -- 172.21.15.59:0/985690449 >> v2:172.21.15.59:3300/0 conn(0x7fa200139250 msgr2=0x7fa20013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa205b43700 1 --2- 172.21.15.59:0/985690449 >> v2:172.21.15.59:3300/0 conn(0x7fa200139250 0x7fa20013b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa205b43700 1 -- 172.21.15.59:0/985690449 >> v1:172.21.15.59:6789/0 conn(0x7fa2000a0a30 legacy=0x7fa2000a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa205b43700 1 -- 172.21.15.59:0/985690449 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20009dc50 con 0x7fa2000a1510 2023-09-30T22:35:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa206b45700 1 --2- 172.21.15.59:0/985690449 >> v2:172.21.15.59:3300/0 conn(0x7fa200139250 0x7fa20013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.353+0000 7fa205b43700 1 --2- 172.21.15.59:0/985690449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2000a1510 0x7fa200138d10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009870 tx=0x7fa1f0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea4e6ffaddfd9208 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.354+0000 7fa205342700 1 -- 172.21.15.59:0/985690449 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0011830 con 0x7fa2000a1510 2023-09-30T22:35:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.354+0000 7fa205342700 1 -- 172.21.15.59:0/985690449 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f0011990 con 0x7fa2000a1510 2023-09-30T22:35:57.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.354+0000 7fa205342700 1 -- 172.21.15.59:0/985690449 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0011d20 con 0x7fa2000a1510 2023-09-30T22:35:57.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.354+0000 7fa2085a8700 1 -- 172.21.15.59:0/985690449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2000a1510 msgr2=0x7fa200138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.354+0000 7fa2085a8700 1 --2- 172.21.15.59:0/985690449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2000a1510 0x7fa200138d10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009870 tx=0x7fa1f0009b80 comp rx=0 tx=0).stop 2023-09-30T22:35:57.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.354+0000 7fa2085a8700 1 -- 172.21.15.59:0/985690449 shutdown_connections 2023-09-30T22:35:57.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.354+0000 7fa2085a8700 1 --2- 172.21.15.59:0/985690449 >> v2:172.21.15.59:3300/0 conn(0x7fa200139250 0x7fa20013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.354+0000 7fa2085a8700 1 --2- 172.21.15.59:0/985690449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2000a1510 0x7fa200138d10 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.354+0000 7fa2085a8700 1 -- 172.21.15.59:0/985690449 >> 172.21.15.59:0/985690449 conn(0x7fa2000a6550 msgr2=0x7fa2000a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:57.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.355+0000 7fa2085a8700 1 -- 172.21.15.59:0/985690449 shutdown_connections 2023-09-30T22:35:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.355+0000 7fa2085a8700 1 -- 172.21.15.59:0/985690449 wait complete. 2023-09-30T22:35:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.355+0000 7fa2085a8700 1 Processor -- start 2023-09-30T22:35:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa2085a8700 1 -- start start 2023-09-30T22:35:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa2085a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2000a0a30 0x7fa2001c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa2085a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2000a1510 0x7fa2001c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa2085a8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa200139250 0x7fa200122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa2085a8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2001389b0 con 0x7fa200139250 2023-09-30T22:35:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa2085a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa200125cd0 con 0x7fa2000a1510 2023-09-30T22:35:57.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa2085a8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa200126710 con 0x7fa2000a0a30 2023-09-30T22:35:57.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa205b43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2000a1510 0x7fa2001c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa205b43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2000a1510 0x7fa2001c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39372/0 (socket says 172.21.15.59:39372) 2023-09-30T22:35:57.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa205b43700 1 -- 172.21.15.59:0/1648365577 learned_addr learned my addr 172.21.15.59:0/1648365577 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:57.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa206b45700 1 --2- 172.21.15.59:0/1648365577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa200139250 0x7fa200122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa206344700 1 --2- 172.21.15.59:0/1648365577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2000a0a30 0x7fa2001c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa205b43700 1 -- 172.21.15.59:0/1648365577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2000a0a30 msgr2=0x7fa2001c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa205b43700 1 --2- 172.21.15.59:0/1648365577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2000a0a30 0x7fa2001c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa205b43700 1 -- 172.21.15.59:0/1648365577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa200139250 msgr2=0x7fa200122a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa205b43700 1 --2- 172.21.15.59:0/1648365577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa200139250 0x7fa200122a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.356+0000 7fa205b43700 1 -- 172.21.15.59:0/1648365577 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8009b30 con 0x7fa2000a1510 2023-09-30T22:35:57.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.357+0000 7fa206b45700 1 --2- 172.21.15.59:0/1648365577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa200139250 0x7fa200122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:57.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.357+0000 7fa205b43700 1 --2- 172.21.15.59:0/1648365577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2000a1510 0x7fa2001c8d40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0000c00 tx=0x7fa1f0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:57.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.357+0000 7fa1f6ffd700 1 -- 172.21.15.59:0/1648365577 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f00036a0 con 0x7fa2000a1510 2023-09-30T22:35:57.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.357+0000 7fa1f6ffd700 1 -- 172.21.15.59:0/1648365577 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f001f070 con 0x7fa2000a1510 2023-09-30T22:35:57.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.357+0000 7fa2085a8700 1 -- 172.21.15.59:0/1648365577 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f00094a0 con 0x7fa2000a1510 2023-09-30T22:35:57.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.357+0000 7fa1f6ffd700 1 -- 172.21.15.59:0/1648365577 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0003a60 con 0x7fa2000a1510 2023-09-30T22:35:57.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.357+0000 7fa2085a8700 1 -- 172.21.15.59:0/1648365577 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa200125fa0 con 0x7fa2000a1510 2023-09-30T22:35:57.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.358+0000 7fa1f6ffd700 1 -- 172.21.15.59:0/1648365577 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1f0003bc0 con 0x7fa2000a1510 2023-09-30T22:35:57.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.358+0000 7fa1f6ffd700 1 -- 172.21.15.59:0/1648365577 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa1f0021070 con 0x7fa2000a1510 2023-09-30T22:35:57.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.358+0000 7fa2085a8700 1 -- 172.21.15.59:0/1648365577 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa200074ea0 con 0x7fa2000a1510 2023-09-30T22:35:57.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.363+0000 7fa1f6ffd700 1 -- 172.21.15.59:0/1648365577 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1f002b080 con 0x7fa2000a1510 2023-09-30T22:35:57.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.390+0000 7fd50dd84700 1 Processor -- start 2023-09-30T22:35:57.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.390+0000 7fd50dd84700 1 -- start start 2023-09-30T22:35:57.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.390+0000 7fd50dd84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5080a0a30 0x7fd5080a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.390+0000 7fd50dd84700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd50809d630 0x7fd5080a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.390+0000 7fd50dd84700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd508133930 0x7fd508133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.390+0000 7fd50dd84700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5080a2a70 con 0x7fd508133930 2023-09-30T22:35:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.390+0000 7fd50dd84700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080a01d0 con 0x7fd5080a0a30 2023-09-30T22:35:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.390+0000 7fd50dd84700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd50809e2b0 con 0x7fd50809d630 2023-09-30T22:35:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.390+0000 7fd507fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd508133930 0x7fd508133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.390+0000 7fd506ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd50809d630 0x7fd5080a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.390+0000 7fd507fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd508133930 0x7fd508133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52318/0 (socket says 172.21.15.59:52318) 2023-09-30T22:35:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.391+0000 7fd507fff700 1 -- 172.21.15.59:0/1187288356 learned_addr learned my addr 172.21.15.59:0/1187288356 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:57.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.391+0000 7fd5077fe700 1 --2- 172.21.15.59:0/1187288356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5080a0a30 0x7fd5080a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.391+0000 7fd507fff700 1 -- 172.21.15.59:0/1187288356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd50809d630 msgr2=0x7fd5080a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.391+0000 7fd507fff700 1 --2- 172.21.15.59:0/1187288356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd50809d630 0x7fd5080a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.391+0000 7fd507fff700 1 -- 172.21.15.59:0/1187288356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5080a0a30 msgr2=0x7fd5080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.391+0000 7fd507fff700 1 --2- 172.21.15.59:0/1187288356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5080a0a30 0x7fd5080a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.391+0000 7fd507fff700 1 -- 172.21.15.59:0/1187288356 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50809dc50 con 0x7fd508133930 2023-09-30T22:35:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.391+0000 7fd506ffd700 1 --2- 172.21.15.59:0/1187288356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd50809d630 0x7fd5080a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.391+0000 7fd5077fe700 1 --2- 172.21.15.59:0/1187288356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5080a0a30 0x7fd5080a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.391+0000 7fd507fff700 1 --2- 172.21.15.59:0/1187288356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd508133930 0x7fd508133dd0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fd500009e50 tx=0x7fd50000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f004207f818fdd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.391+0000 7fd5067fc700 1 -- 172.21.15.59:0/1187288356 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000e070 con 0x7fd508133930 2023-09-30T22:35:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.391+0000 7fd5067fc700 1 -- 172.21.15.59:0/1187288356 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50000b910 con 0x7fd508133930 2023-09-30T22:35:57.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.391+0000 7fd5067fc700 1 -- 172.21.15.59:0/1187288356 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000bcc0 con 0x7fd508133930 2023-09-30T22:35:57.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.392+0000 7fd50dd84700 1 -- 172.21.15.59:0/1187288356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd508133930 msgr2=0x7fd508133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.392+0000 7fd50dd84700 1 --2- 172.21.15.59:0/1187288356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd508133930 0x7fd508133dd0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fd500009e50 tx=0x7fd50000b330 comp rx=0 tx=0).stop 2023-09-30T22:35:57.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.392+0000 7fd50dd84700 1 -- 172.21.15.59:0/1187288356 shutdown_connections 2023-09-30T22:35:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.392+0000 7fd50dd84700 1 --2- 172.21.15.59:0/1187288356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd508133930 0x7fd508133dd0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.392+0000 7fd50dd84700 1 --2- 172.21.15.59:0/1187288356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5080a0a30 0x7fd5080a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.392+0000 7fd50dd84700 1 --2- 172.21.15.59:0/1187288356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd50809d630 0x7fd5080a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.392+0000 7fd50dd84700 1 -- 172.21.15.59:0/1187288356 >> 172.21.15.59:0/1187288356 conn(0x7fd5080a3050 msgr2=0x7fd5080a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.392+0000 7fd50dd84700 1 -- 172.21.15.59:0/1187288356 shutdown_connections 2023-09-30T22:35:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.392+0000 7fd50dd84700 1 -- 172.21.15.59:0/1187288356 wait complete. 2023-09-30T22:35:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.393+0000 7fd50dd84700 1 Processor -- start 2023-09-30T22:35:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.393+0000 7fd50dd84700 1 -- start start 2023-09-30T22:35:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd50dd84700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd50809d630 0x7fd5081c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd50dd84700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5080a0a30 0x7fd5081c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd50dd84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd508133930 0x7fd5081c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd50dd84700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd508122100 con 0x7fd50809d630 2023-09-30T22:35:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd50dd84700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5081205e0 con 0x7fd508133930 2023-09-30T22:35:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd50dd84700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd508133420 con 0x7fd5080a0a30 2023-09-30T22:35:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd5077fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd50809d630 0x7fd5081c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd507fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd508133930 0x7fd5081c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd5077fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd50809d630 0x7fd5081c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52324/0 (socket says 172.21.15.59:52324) 2023-09-30T22:35:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd507fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd508133930 0x7fd5081c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39384/0 (socket says 172.21.15.59:39384) 2023-09-30T22:35:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd5077fe700 1 -- 172.21.15.59:0/515738348 learned_addr learned my addr 172.21.15.59:0/515738348 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd506ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5080a0a30 0x7fd5081c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd507fff700 1 -- 172.21.15.59:0/515738348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5080a0a30 msgr2=0x7fd5081c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd507fff700 1 --2- 172.21.15.59:0/515738348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5080a0a30 0x7fd5081c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd507fff700 1 -- 172.21.15.59:0/515738348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd50809d630 msgr2=0x7fd5081c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd507fff700 1 --2- 172.21.15.59:0/515738348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd50809d630 0x7fd5081c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd507fff700 1 -- 172.21.15.59:0/515738348 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc0094a0 con 0x7fd508133930 2023-09-30T22:35:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd5077fe700 1 --2- 172.21.15.59:0/515738348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd50809d630 0x7fd5081c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd507fff700 1 --2- 172.21.15.59:0/515738348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd508133930 0x7fd5081c8a30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fd500015000 tx=0x7fd500004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.394+0000 7fd4effff700 1 -- 172.21.15.59:0/515738348 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500004450 con 0x7fd508133930 2023-09-30T22:35:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.395+0000 7fd4effff700 1 -- 172.21.15.59:0/515738348 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5000045d0 con 0x7fd508133930 2023-09-30T22:35:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.395+0000 7fd50dd84700 1 -- 172.21.15.59:0/515738348 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f80094a0 con 0x7fd508133930 2023-09-30T22:35:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.395+0000 7fd4effff700 1 -- 172.21.15.59:0/515738348 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5000092e0 con 0x7fd508133930 2023-09-30T22:35:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.395+0000 7fd50dd84700 1 -- 172.21.15.59:0/515738348 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd500009b30 con 0x7fd508133930 2023-09-30T22:35:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.395+0000 7fd4effff700 1 -- 172.21.15.59:0/515738348 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd500025460 con 0x7fd508133930 2023-09-30T22:35:57.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.396+0000 7fd4effff700 1 -- 172.21.15.59:0/515738348 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd500041070 con 0x7fd508133930 2023-09-30T22:35:57.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.396+0000 7fd50dd84700 1 -- 172.21.15.59:0/515738348 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5080747f0 con 0x7fd508133930 2023-09-30T22:35:57.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.405+0000 7fd4effff700 1 -- 172.21.15.59:0/515738348 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd50002a070 con 0x7fd508133930 2023-09-30T22:35:57.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.575+0000 7fa2085a8700 1 -- 172.21.15.59:0/1648365577 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa2000a28e0 con 0x7fa2000a1510 2023-09-30T22:35:57.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.575+0000 7fa1f6ffd700 1 -- 172.21.15.59:0/1648365577 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1f0015020 con 0x7fa2000a1510 2023-09-30T22:35:57.575 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:57.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.577+0000 7fa2085a8700 1 -- 172.21.15.59:0/1648365577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2000a1510 msgr2=0x7fa2001c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.577+0000 7fa2085a8700 1 --2- 172.21.15.59:0/1648365577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2000a1510 0x7fa2001c8d40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0000c00 tx=0x7fa1f0004750 comp rx=0 tx=0).stop 2023-09-30T22:35:57.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.577+0000 7fa2085a8700 1 -- 172.21.15.59:0/1648365577 shutdown_connections 2023-09-30T22:35:57.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.577+0000 7fa2085a8700 1 --2- 172.21.15.59:0/1648365577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2000a0a30 0x7fa2001c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.577+0000 7fa2085a8700 1 --2- 172.21.15.59:0/1648365577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa200139250 0x7fa200122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.577+0000 7fa2085a8700 1 --2- 172.21.15.59:0/1648365577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2000a1510 0x7fa2001c8d40 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.577+0000 7fa2085a8700 1 -- 172.21.15.59:0/1648365577 >> 172.21.15.59:0/1648365577 conn(0x7fa2000a6550 msgr2=0x7fa2000a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:57.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.578+0000 7fa2085a8700 1 -- 172.21.15.59:0/1648365577 shutdown_connections 2023-09-30T22:35:57.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.578+0000 7fa2085a8700 1 -- 172.21.15.59:0/1648365577 wait complete. 2023-09-30T22:35:57.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:57.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.609+0000 7fd50dd84700 1 -- 172.21.15.59:0/515738348 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd508120cc0 con 0x7fd508133930 2023-09-30T22:35:57.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.609+0000 7fd4effff700 1 -- 172.21.15.59:0/515738348 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd500034090 con 0x7fd508133930 2023-09-30T22:35:57.610 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:57.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.612+0000 7fd50dd84700 1 -- 172.21.15.59:0/515738348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd508133930 msgr2=0x7fd5081c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.612+0000 7fd50dd84700 1 --2- 172.21.15.59:0/515738348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd508133930 0x7fd5081c8a30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fd500015000 tx=0x7fd500004ad0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.612+0000 7fd50dd84700 1 -- 172.21.15.59:0/515738348 shutdown_connections 2023-09-30T22:35:57.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.612+0000 7fd50dd84700 1 --2- 172.21.15.59:0/515738348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd508133930 0x7fd5081c8a30 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.612+0000 7fd50dd84700 1 --2- 172.21.15.59:0/515738348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd50809d630 0x7fd5081c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.612+0000 7fd50dd84700 1 --2- 172.21.15.59:0/515738348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5080a0a30 0x7fd5081c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.612+0000 7fd50dd84700 1 -- 172.21.15.59:0/515738348 >> 172.21.15.59:0/515738348 conn(0x7fd5080a3050 msgr2=0x7fd50809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:57.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.612+0000 7fd50dd84700 1 -- 172.21.15.59:0/515738348 shutdown_connections 2023-09-30T22:35:57.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.612+0000 7fd50dd84700 1 -- 172.21.15.59:0/515738348 wait complete. 2023-09-30T22:35:57.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:57.667 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:57.713 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:57.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.810+0000 7f246281d700 1 Processor -- start 2023-09-30T22:35:57.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.810+0000 7f246281d700 1 -- start start 2023-09-30T22:35:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.810+0000 7f246281d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f245c0a0a30 0x7f245c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.810+0000 7f246281d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f245c0a1340 0x7f245c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.810+0000 7f246281d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f245c133fa0 0x7f245c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f246281d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245c09edd0 con 0x7f245c133fa0 2023-09-30T22:35:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f246281d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c09e1f0 con 0x7f245c0a0a30 2023-09-30T22:35:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f246281d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f245c09dc50 con 0x7f245c0a1340 2023-09-30T22:35:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f245b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f245c0a1340 0x7f245c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f245bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f245c0a0a30 0x7f245c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f245b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f245c0a1340 0x7f245c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36008/0 (socket says 172.21.15.59:36008) 2023-09-30T22:35:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f245bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f245c0a0a30 0x7f245c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39392/0 (socket says 172.21.15.59:39392) 2023-09-30T22:35:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f245b7fe700 1 -- 172.21.15.59:0/2349967054 learned_addr learned my addr 172.21.15.59:0/2349967054 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f2460dba700 1 --2- 172.21.15.59:0/2349967054 >> v2:172.21.15.59:3300/0 conn(0x7f245c133fa0 0x7f245c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f245b7fe700 1 -- 172.21.15.59:0/2349967054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f245c0a0a30 msgr2=0x7f245c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:57.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f245b7fe700 1 --2- 172.21.15.59:0/2349967054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f245c0a0a30 0x7f245c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f245b7fe700 1 -- 172.21.15.59:0/2349967054 >> v2:172.21.15.59:3300/0 conn(0x7f245c133fa0 msgr2=0x7f245c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:57.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f245b7fe700 1 --2- 172.21.15.59:0/2349967054 >> v2:172.21.15.59:3300/0 conn(0x7f245c133fa0 0x7f245c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f245b7fe700 1 -- 172.21.15.59:0/2349967054 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c0a1fe0 con 0x7f245c0a1340 2023-09-30T22:35:57.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f245bfff700 1 --2- 172.21.15.59:0/2349967054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f245c0a0a30 0x7f245c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:57.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f2460dba700 1 --2- 172.21.15.59:0/2349967054 >> v2:172.21.15.59:3300/0 conn(0x7f245c133fa0 0x7f245c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:57.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f245b7fe700 1 --2- 172.21.15.59:0/2349967054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f245c0a1340 0x7f245c133a60 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f24500098f0 tx=0x7f2450009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3885c513ca84f10f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:57.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.811+0000 7f245affd700 1 -- 172.21.15.59:0/2349967054 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450011830 con 0x7f245c0a1340 2023-09-30T22:35:57.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.812+0000 7f245affd700 1 -- 172.21.15.59:0/2349967054 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2450011990 con 0x7f245c0a1340 2023-09-30T22:35:57.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.812+0000 7f245affd700 1 -- 172.21.15.59:0/2349967054 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450011d20 con 0x7f245c0a1340 2023-09-30T22:35:57.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.812+0000 7f246281d700 1 -- 172.21.15.59:0/2349967054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f245c0a1340 msgr2=0x7f245c133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.812+0000 7f246281d700 1 --2- 172.21.15.59:0/2349967054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f245c0a1340 0x7f245c133a60 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f24500098f0 tx=0x7f2450009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:57.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.812+0000 7f246281d700 1 -- 172.21.15.59:0/2349967054 shutdown_connections 2023-09-30T22:35:57.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.812+0000 7f246281d700 1 --2- 172.21.15.59:0/2349967054 >> v2:172.21.15.59:3300/0 conn(0x7f245c133fa0 0x7f245c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.812+0000 7f246281d700 1 --2- 172.21.15.59:0/2349967054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f245c0a0a30 0x7f245c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.812+0000 7f246281d700 1 --2- 172.21.15.59:0/2349967054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f245c0a1340 0x7f245c133a60 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.812+0000 7f246281d700 1 -- 172.21.15.59:0/2349967054 >> 172.21.15.59:0/2349967054 conn(0x7f245c0a6550 msgr2=0x7f245c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:57.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.812+0000 7f246281d700 1 -- 172.21.15.59:0/2349967054 shutdown_connections 2023-09-30T22:35:57.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.812+0000 7f246281d700 1 -- 172.21.15.59:0/2349967054 wait complete. 2023-09-30T22:35:57.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.813+0000 7f246281d700 1 Processor -- start 2023-09-30T22:35:57.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.814+0000 7f246281d700 1 -- start start 2023-09-30T22:35:57.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.814+0000 7f246281d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f245c0a0a30 0x7f245c120130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.814+0000 7f246281d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f245c0a1340 0x7f245c120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.814+0000 7f246281d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f245c133fa0 0x7f245c120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.814+0000 7f246281d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c123c50 con 0x7f245c133fa0 2023-09-30T22:35:57.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.814+0000 7f246281d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0a3530 con 0x7f245c0a1340 2023-09-30T22:35:57.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.814+0000 7f246281d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f245c1233e0 con 0x7f245c0a0a30 2023-09-30T22:35:57.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.814+0000 7f245b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f245c0a1340 0x7f245c120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.814+0000 7f245bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f245c0a0a30 0x7f245c120130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.814+0000 7f245b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f245c0a1340 0x7f245c120670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39404/0 (socket says 172.21.15.59:39404) 2023-09-30T22:35:57.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.814+0000 7f245bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f245c0a0a30 0x7f245c120130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36016/0 (socket says 172.21.15.59:36016) 2023-09-30T22:35:57.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.814+0000 7f245b7fe700 1 -- 172.21.15.59:0/3521493571 learned_addr learned my addr 172.21.15.59:0/3521493571 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:57.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.814+0000 7f2460dba700 1 --2- 172.21.15.59:0/3521493571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f245c133fa0 0x7f245c120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.815+0000 7f245bfff700 1 -- 172.21.15.59:0/3521493571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f245c0a1340 msgr2=0x7f245c120670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.815+0000 7f245bfff700 1 --2- 172.21.15.59:0/3521493571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f245c0a1340 0x7f245c120670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.815+0000 7f245bfff700 1 -- 172.21.15.59:0/3521493571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f245c133fa0 msgr2=0x7f245c120bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.815+0000 7f245bfff700 1 --2- 172.21.15.59:0/3521493571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f245c133fa0 0x7f245c120bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.815+0000 7f245bfff700 1 -- 172.21.15.59:0/3521493571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c0094a0 con 0x7f245c0a0a30 2023-09-30T22:35:57.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.815+0000 7f245bfff700 1 --2- 172.21.15.59:0/3521493571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f245c0a0a30 0x7f245c120130 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f244c00e9b0 tx=0x7f244c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:57.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.815+0000 7f2458ff9700 1 -- 172.21.15.59:0/3521493571 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c00ee40 con 0x7f245c0a0a30 2023-09-30T22:35:57.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.815+0000 7f2458ff9700 1 -- 172.21.15.59:0/3521493571 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c00c850 con 0x7f245c0a0a30 2023-09-30T22:35:57.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.815+0000 7f2458ff9700 1 -- 172.21.15.59:0/3521493571 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c00cc00 con 0x7f245c0a0a30 2023-09-30T22:35:57.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.815+0000 7f246281d700 1 -- 172.21.15.59:0/3521493571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2454009a70 con 0x7f245c0a0a30 2023-09-30T22:35:57.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.815+0000 7f246281d700 1 -- 172.21.15.59:0/3521493571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2450009550 con 0x7f245c0a0a30 2023-09-30T22:35:57.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.816+0000 7f246281d700 1 -- 172.21.15.59:0/3521493571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245c074ea0 con 0x7f245c0a0a30 2023-09-30T22:35:57.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.817+0000 7f2458ff9700 1 -- 172.21.15.59:0/3521493571 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f244c013470 con 0x7f245c0a0a30 2023-09-30T22:35:57.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.817+0000 7f2458ff9700 1 -- 172.21.15.59:0/3521493571 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f244c03feb0 con 0x7f245c0a0a30 2023-09-30T22:35:57.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.822+0000 7f2458ff9700 1 -- 172.21.15.59:0/3521493571 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f244c013720 con 0x7f245c0a0a30 2023-09-30T22:35:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.853+0000 7f9c97b3e700 1 Processor -- start 2023-09-30T22:35:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.854+0000 7f9c97b3e700 1 -- start start 2023-09-30T22:35:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.854+0000 7f9c97b3e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c9009d630 0x7f9c900a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.854+0000 7f9c97b3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c90138d80 0x7f9c9013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.854+0000 7f9c97b3e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c900a2a70 con 0x7f9c900a0a30 2023-09-30T22:35:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.854+0000 7f9c97b3e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c900a01d0 con 0x7f9c9009d630 2023-09-30T22:35:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.854+0000 7f9c97b3e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9009e2b0 con 0x7f9c90138d80 2023-09-30T22:35:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.854+0000 7f9c960db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c90138d80 0x7f9c9013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.854+0000 7f9c950d9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c9009d630 0x7f9c900a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.854+0000 7f9c960db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c90138d80 0x7f9c9013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39418/0 (socket says 172.21.15.59:39418) 2023-09-30T22:35:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.854+0000 7f9c960db700 1 -- 172.21.15.59:0/2049111569 learned_addr learned my addr 172.21.15.59:0/2049111569 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:57.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.855+0000 7f9c950d9700 1 -- 172.21.15.59:0/2049111569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c90138d80 msgr2=0x7f9c9013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.855+0000 7f9c950d9700 1 --2- 172.21.15.59:0/2049111569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c90138d80 0x7f9c9013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.855+0000 7f9c950d9700 1 -- 172.21.15.59:0/2049111569 >> v1:172.21.15.59:6789/0 conn(0x7f9c900a0a30 legacy=0x7f9c900a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.855+0000 7f9c950d9700 1 -- 172.21.15.59:0/2049111569 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9009dc50 con 0x7f9c9009d630 2023-09-30T22:35:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.855+0000 7f9c960db700 1 --2- 172.21.15.59:0/2049111569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c90138d80 0x7f9c9013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.855+0000 7f9c950d9700 1 --2- 172.21.15.59:0/2049111569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c9009d630 0x7f9c900a1510 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f9c84009840 tx=0x7f9c84009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db6752934b2dd19 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:57.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.855+0000 7f9c948d8700 1 -- 172.21.15.59:0/2049111569 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84011830 con 0x7f9c9009d630 2023-09-30T22:35:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.855+0000 7f9c948d8700 1 -- 172.21.15.59:0/2049111569 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c84011990 con 0x7f9c9009d630 2023-09-30T22:35:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.855+0000 7f9c948d8700 1 -- 172.21.15.59:0/2049111569 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84011d20 con 0x7f9c9009d630 2023-09-30T22:35:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.856+0000 7f9c97b3e700 1 -- 172.21.15.59:0/2049111569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c9009d630 msgr2=0x7f9c900a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.856+0000 7f9c97b3e700 1 --2- 172.21.15.59:0/2049111569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c9009d630 0x7f9c900a1510 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f9c84009840 tx=0x7f9c84009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.856+0000 7f9c97b3e700 1 -- 172.21.15.59:0/2049111569 shutdown_connections 2023-09-30T22:35:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.856+0000 7f9c97b3e700 1 --2- 172.21.15.59:0/2049111569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c90138d80 0x7f9c9013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.856+0000 7f9c97b3e700 1 --2- 172.21.15.59:0/2049111569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c9009d630 0x7f9c900a1510 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.856+0000 7f9c97b3e700 1 -- 172.21.15.59:0/2049111569 >> 172.21.15.59:0/2049111569 conn(0x7f9c900a3050 msgr2=0x7f9c900a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:57.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.856+0000 7f9c97b3e700 1 -- 172.21.15.59:0/2049111569 shutdown_connections 2023-09-30T22:35:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.856+0000 7f9c97b3e700 1 -- 172.21.15.59:0/2049111569 wait complete. 2023-09-30T22:35:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.857+0000 7f9c97b3e700 1 Processor -- start 2023-09-30T22:35:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.857+0000 7f9c97b3e700 1 -- start start 2023-09-30T22:35:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.857+0000 7f9c97b3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c9009d630 0x7f9c90120800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.857+0000 7f9c97b3e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c900a0a30 0x7f9c90120d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.857+0000 7f9c97b3e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90138d80 0x7f9c90121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.857+0000 7f9c97b3e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90123fb0 con 0x7f9c90138d80 2023-09-30T22:35:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.857+0000 7f9c97b3e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c900a4e00 con 0x7f9c9009d630 2023-09-30T22:35:57.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.857+0000 7f9c97b3e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c900a0410 con 0x7f9c900a0a30 2023-09-30T22:35:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c950d9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c900a0a30 0x7f9c90120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c958da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c9009d630 0x7f9c90120800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c950d9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c900a0a30 0x7f9c90120d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36032/0 (socket says 172.21.15.59:36032) 2023-09-30T22:35:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c950d9700 1 -- 172.21.15.59:0/3810029264 learned_addr learned my addr 172.21.15.59:0/3810029264 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c960db700 1 --2- 172.21.15.59:0/3810029264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90138d80 0x7f9c90121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c958da700 1 -- 172.21.15.59:0/3810029264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c900a0a30 msgr2=0x7f9c90120d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c958da700 1 --2- 172.21.15.59:0/3810029264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c900a0a30 0x7f9c90120d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c958da700 1 -- 172.21.15.59:0/3810029264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90138d80 msgr2=0x7f9c90121280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c958da700 1 --2- 172.21.15.59:0/3810029264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90138d80 0x7f9c90121280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c958da700 1 -- 172.21.15.59:0/3810029264 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c88009550 con 0x7f9c9009d630 2023-09-30T22:35:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c960db700 1 --2- 172.21.15.59:0/3810029264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90138d80 0x7f9c90121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:57.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c958da700 1 --2- 172.21.15.59:0/3810029264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c9009d630 0x7f9c90120800 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000cbb0 tx=0x7f9c8000cec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c8e7fc700 1 -- 172.21.15.59:0/3810029264 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80003c00 con 0x7f9c9009d630 2023-09-30T22:35:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c8e7fc700 1 -- 172.21.15.59:0/3810029264 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c80003d60 con 0x7f9c9009d630 2023-09-30T22:35:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c8e7fc700 1 -- 172.21.15.59:0/3810029264 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8000aae0 con 0x7f9c9009d630 2023-09-30T22:35:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c97b3e700 1 -- 172.21.15.59:0/3810029264 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c840094a0 con 0x7f9c9009d630 2023-09-30T22:35:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.858+0000 7f9c97b3e700 1 -- 172.21.15.59:0/3810029264 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c90124a20 con 0x7f9c9009d630 2023-09-30T22:35:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.859+0000 7f9c8e7fc700 1 -- 172.21.15.59:0/3810029264 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c8000ac40 con 0x7f9c9009d630 2023-09-30T22:35:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.859+0000 7f9c97b3e700 1 -- 172.21.15.59:0/3810029264 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c900747f0 con 0x7f9c9009d630 2023-09-30T22:35:57.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.860+0000 7f9c8e7fc700 1 -- 172.21.15.59:0/3810029264 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9c8003f5a0 con 0x7f9c9009d630 2023-09-30T22:35:57.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:57.864+0000 7f9c8e7fc700 1 -- 172.21.15.59:0/3810029264 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c800194e0 con 0x7f9c9009d630 2023-09-30T22:35:58.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.028+0000 7f246281d700 1 -- 172.21.15.59:0/3521493571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f245c122f90 con 0x7f245c0a0a30 2023-09-30T22:35:58.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.028+0000 7f2458ff9700 1 -- 172.21.15.59:0/3521493571 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f244c017070 con 0x7f245c0a0a30 2023-09-30T22:35:58.028 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:58.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.030+0000 7f246281d700 1 -- 172.21.15.59:0/3521493571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f245c0a0a30 msgr2=0x7f245c120130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:58.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.030+0000 7f246281d700 1 --2- 172.21.15.59:0/3521493571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f245c0a0a30 0x7f245c120130 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f244c00e9b0 tx=0x7f244c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.030+0000 7f246281d700 1 -- 172.21.15.59:0/3521493571 shutdown_connections 2023-09-30T22:35:58.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.030+0000 7f246281d700 1 --2- 172.21.15.59:0/3521493571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f245c0a0a30 0x7f245c120130 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.030+0000 7f246281d700 1 --2- 172.21.15.59:0/3521493571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f245c133fa0 0x7f245c120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.030+0000 7f246281d700 1 --2- 172.21.15.59:0/3521493571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f245c0a1340 0x7f245c120670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.030+0000 7f246281d700 1 -- 172.21.15.59:0/3521493571 >> 172.21.15.59:0/3521493571 conn(0x7f245c0a6550 msgr2=0x7f245c1bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:58.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.031+0000 7f246281d700 1 -- 172.21.15.59:0/3521493571 shutdown_connections 2023-09-30T22:35:58.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.031+0000 7f246281d700 1 -- 172.21.15.59:0/3521493571 wait complete. 2023-09-30T22:35:58.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.071+0000 7f9c97b3e700 1 -- 172.21.15.59:0/3810029264 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9c90072980 con 0x7f9c9009d630 2023-09-30T22:35:58.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.071+0000 7f9c8e7fc700 1 -- 172.21.15.59:0/3810029264 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c80019300 con 0x7f9c9009d630 2023-09-30T22:35:58.071 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.073+0000 7f9c97b3e700 1 -- 172.21.15.59:0/3810029264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c9009d630 msgr2=0x7f9c90120800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.073+0000 7f9c97b3e700 1 --2- 172.21.15.59:0/3810029264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c9009d630 0x7f9c90120800 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000cbb0 tx=0x7f9c8000cec0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.074+0000 7f9c97b3e700 1 -- 172.21.15.59:0/3810029264 shutdown_connections 2023-09-30T22:35:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.074+0000 7f9c97b3e700 1 --2- 172.21.15.59:0/3810029264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90138d80 0x7f9c90121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.074+0000 7f9c97b3e700 1 --2- 172.21.15.59:0/3810029264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c9009d630 0x7f9c90120800 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.074+0000 7f9c97b3e700 1 --2- 172.21.15.59:0/3810029264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c900a0a30 0x7f9c90120d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.074+0000 7f9c97b3e700 1 -- 172.21.15.59:0/3810029264 >> 172.21.15.59:0/3810029264 conn(0x7f9c900a3050 msgr2=0x7f9c9009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.074+0000 7f9c97b3e700 1 -- 172.21.15.59:0/3810029264 shutdown_connections 2023-09-30T22:35:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.074+0000 7f9c97b3e700 1 -- 172.21.15.59:0/3810029264 wait complete. 2023-09-30T22:35:58.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:58.592 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:35:58.627 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:35:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.740+0000 7f7518d85700 1 Processor -- start 2023-09-30T22:35:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.741+0000 7f7518d85700 1 -- start start 2023-09-30T22:35:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f7518d85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75140a0a30 0x7f75140a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f7518d85700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7514134170 0x7f751413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f7518d85700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751409edd0 con 0x7f75140a1340 2023-09-30T22:35:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f7518d85700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751409e1f0 con 0x7f7514134170 2023-09-30T22:35:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f7518d85700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751409dc50 con 0x7f75140a0a30 2023-09-30T22:35:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f751259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75140a0a30 0x7f75140a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f7512d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7514134170 0x7f751413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f751259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75140a0a30 0x7f75140a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39434/0 (socket says 172.21.15.59:39434) 2023-09-30T22:35:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f7512d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7514134170 0x7f751413bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52370/0 (socket says 172.21.15.59:52370) 2023-09-30T22:35:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f751259c700 1 -- 172.21.15.59:0/2324275798 learned_addr learned my addr 172.21.15.59:0/2324275798 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f751259c700 1 -- 172.21.15.59:0/2324275798 >> v2:172.21.15.59:3300/0 conn(0x7f7514134170 msgr2=0x7f751413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f751259c700 1 --2- 172.21.15.59:0/2324275798 >> v2:172.21.15.59:3300/0 conn(0x7f7514134170 0x7f751413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f751259c700 1 -- 172.21.15.59:0/2324275798 >> v1:172.21.15.59:6789/0 conn(0x7f75140a1340 legacy=0x7f7514133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:58.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f751259c700 1 -- 172.21.15.59:0/2324275798 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75140a1fe0 con 0x7f75140a0a30 2023-09-30T22:35:58.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f7512d9d700 1 --2- 172.21.15.59:0/2324275798 >> v2:172.21.15.59:3300/0 conn(0x7f7514134170 0x7f751413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:58.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.742+0000 7f751259c700 1 --2- 172.21.15.59:0/2324275798 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75140a0a30 0x7f75140a0e00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f750c0098f0 tx=0x7f750c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a1b6bdd54214c06 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:58.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.743+0000 7f751159a700 1 -- 172.21.15.59:0/2324275798 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c011830 con 0x7f75140a0a30 2023-09-30T22:35:58.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.743+0000 7f751159a700 1 -- 172.21.15.59:0/2324275798 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c011990 con 0x7f75140a0a30 2023-09-30T22:35:58.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.743+0000 7f751159a700 1 -- 172.21.15.59:0/2324275798 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c011d20 con 0x7f75140a0a30 2023-09-30T22:35:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.743+0000 7f7518d85700 1 -- 172.21.15.59:0/2324275798 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75140a0a30 msgr2=0x7f75140a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.743+0000 7f7518d85700 1 --2- 172.21.15.59:0/2324275798 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75140a0a30 0x7f75140a0e00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f750c0098f0 tx=0x7f750c009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.743+0000 7f7518d85700 1 -- 172.21.15.59:0/2324275798 shutdown_connections 2023-09-30T22:35:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.743+0000 7f7518d85700 1 --2- 172.21.15.59:0/2324275798 >> v2:172.21.15.59:3300/0 conn(0x7f7514134170 0x7f751413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.743+0000 7f7518d85700 1 --2- 172.21.15.59:0/2324275798 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75140a0a30 0x7f75140a0e00 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.743+0000 7f7518d85700 1 -- 172.21.15.59:0/2324275798 >> 172.21.15.59:0/2324275798 conn(0x7f75140a6550 msgr2=0x7f75140a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.743+0000 7f7518d85700 1 -- 172.21.15.59:0/2324275798 shutdown_connections 2023-09-30T22:35:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.743+0000 7f7518d85700 1 -- 172.21.15.59:0/2324275798 wait complete. 2023-09-30T22:35:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.745+0000 7f7518d85700 1 Processor -- start 2023-09-30T22:35:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.745+0000 7f7518d85700 1 -- start start 2023-09-30T22:35:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.745+0000 7f7518d85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75140a0a30 0x7f7514122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.745+0000 7f7518d85700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75140a1340 0x7f7514122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.745+0000 7f7518d85700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7514134170 0x7f7514123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.745+0000 7f7518d85700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7514124690 con 0x7f7514134170 2023-09-30T22:35:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.745+0000 7f7518d85700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75140a4f40 con 0x7f75140a0a30 2023-09-30T22:35:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.745+0000 7f7518d85700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7514126420 con 0x7f75140a1340 2023-09-30T22:35:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.745+0000 7f7512d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7514134170 0x7f7514123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.745+0000 7f7512d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7514134170 0x7f7514123380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52374/0 (socket says 172.21.15.59:52374) 2023-09-30T22:35:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.745+0000 7f7511d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75140a1340 0x7f7514122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.745+0000 7f7512d9d700 1 -- 172.21.15.59:0/4045490113 learned_addr learned my addr 172.21.15.59:0/4045490113 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.745+0000 7f751259c700 1 --2- 172.21.15.59:0/4045490113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75140a0a30 0x7f7514122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.746+0000 7f751259c700 1 -- 172.21.15.59:0/4045490113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75140a1340 msgr2=0x7f7514122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.746+0000 7f751259c700 1 --2- 172.21.15.59:0/4045490113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75140a1340 0x7f7514122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.746+0000 7f751259c700 1 -- 172.21.15.59:0/4045490113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7514134170 msgr2=0x7f7514123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.746+0000 7f751259c700 1 --2- 172.21.15.59:0/4045490113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7514134170 0x7f7514123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.746+0000 7f751259c700 1 -- 172.21.15.59:0/4045490113 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7504009a70 con 0x7f75140a0a30 2023-09-30T22:35:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.746+0000 7f7512d9d700 1 --2- 172.21.15.59:0/4045490113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7514134170 0x7f7514123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.746+0000 7f751259c700 1 --2- 172.21.15.59:0/4045490113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75140a0a30 0x7f7514122900 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f750c016000 tx=0x7f750c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.746+0000 7f750affd700 1 -- 172.21.15.59:0/4045490113 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c0036a0 con 0x7f75140a0a30 2023-09-30T22:35:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.746+0000 7f750affd700 1 -- 172.21.15.59:0/4045490113 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c003800 con 0x7f75140a0a30 2023-09-30T22:35:58.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.746+0000 7f7518d85700 1 -- 172.21.15.59:0/4045490113 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750c009550 con 0x7f75140a0a30 2023-09-30T22:35:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.746+0000 7f750affd700 1 -- 172.21.15.59:0/4045490113 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c003b90 con 0x7f75140a0a30 2023-09-30T22:35:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.746+0000 7f7518d85700 1 -- 172.21.15.59:0/4045490113 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7514133420 con 0x7f75140a0a30 2023-09-30T22:35:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.747+0000 7f750affd700 1 -- 172.21.15.59:0/4045490113 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f750c021070 con 0x7f75140a0a30 2023-09-30T22:35:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.747+0000 7f750affd700 1 -- 172.21.15.59:0/4045490113 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f750c040a90 con 0x7f75140a0a30 2023-09-30T22:35:58.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.747+0000 7f7518d85700 1 -- 172.21.15.59:0/4045490113 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75140a1d40 con 0x7f75140a0a30 2023-09-30T22:35:58.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.752+0000 7f750affd700 1 -- 172.21.15.59:0/4045490113 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f750c015080 con 0x7f75140a0a30 2023-09-30T22:35:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.779+0000 7f5515b70700 1 Processor -- start 2023-09-30T22:35:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.779+0000 7f5515b70700 1 -- start start 2023-09-30T22:35:58.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.780+0000 7f5515b70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55100a0a30 0x7f55100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.780+0000 7f5515b70700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5510138d80 0x7f551013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.780+0000 7f5515b70700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55100a2a70 con 0x7f551009d630 2023-09-30T22:35:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.780+0000 7f5515b70700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55100a01d0 con 0x7f5510138d80 2023-09-30T22:35:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.780+0000 7f5515b70700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551009e2b0 con 0x7f55100a0a30 2023-09-30T22:35:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.780+0000 7f550f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55100a0a30 0x7f55100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.780+0000 7f550f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55100a0a30 0x7f55100a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39444/0 (socket says 172.21.15.59:39444) 2023-09-30T22:35:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.780+0000 7f550f7fe700 1 -- 172.21.15.59:0/3854732525 learned_addr learned my addr 172.21.15.59:0/3854732525 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.780+0000 7f550ffff700 1 --2- 172.21.15.59:0/3854732525 >> v2:172.21.15.59:3300/0 conn(0x7f5510138d80 0x7f551013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.780+0000 7f550f7fe700 1 -- 172.21.15.59:0/3854732525 >> v2:172.21.15.59:3300/0 conn(0x7f5510138d80 msgr2=0x7f551013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.780+0000 7f550f7fe700 1 --2- 172.21.15.59:0/3854732525 >> v2:172.21.15.59:3300/0 conn(0x7f5510138d80 0x7f551013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.780+0000 7f550f7fe700 1 -- 172.21.15.59:0/3854732525 >> v1:172.21.15.59:6789/0 conn(0x7f551009d630 legacy=0x7f55100a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.780+0000 7f550f7fe700 1 -- 172.21.15.59:0/3854732525 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551009dc50 con 0x7f55100a0a30 2023-09-30T22:35:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.780+0000 7f550f7fe700 1 --2- 172.21.15.59:0/3854732525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55100a0a30 0x7f55100a0e00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f55080098f0 tx=0x7f5508009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aae37523cab404f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.781+0000 7f550e7fc700 1 -- 172.21.15.59:0/3854732525 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508011830 con 0x7f55100a0a30 2023-09-30T22:35:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.781+0000 7f550e7fc700 1 -- 172.21.15.59:0/3854732525 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5508011990 con 0x7f55100a0a30 2023-09-30T22:35:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.781+0000 7f550e7fc700 1 -- 172.21.15.59:0/3854732525 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508011d20 con 0x7f55100a0a30 2023-09-30T22:35:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.781+0000 7f5515b70700 1 -- 172.21.15.59:0/3854732525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55100a0a30 msgr2=0x7f55100a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.781+0000 7f5515b70700 1 --2- 172.21.15.59:0/3854732525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55100a0a30 0x7f55100a0e00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f55080098f0 tx=0x7f5508009c00 comp rx=0 tx=0).stop 2023-09-30T22:35:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.781+0000 7f5515b70700 1 -- 172.21.15.59:0/3854732525 shutdown_connections 2023-09-30T22:35:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.781+0000 7f5515b70700 1 --2- 172.21.15.59:0/3854732525 >> v2:172.21.15.59:3300/0 conn(0x7f5510138d80 0x7f551013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.781+0000 7f5515b70700 1 --2- 172.21.15.59:0/3854732525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55100a0a30 0x7f55100a0e00 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.781+0000 7f5515b70700 1 -- 172.21.15.59:0/3854732525 >> 172.21.15.59:0/3854732525 conn(0x7f55100a3050 msgr2=0x7f55100a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.781+0000 7f5515b70700 1 -- 172.21.15.59:0/3854732525 shutdown_connections 2023-09-30T22:35:58.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.781+0000 7f5515b70700 1 -- 172.21.15.59:0/3854732525 wait complete. 2023-09-30T22:35:58.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.783+0000 7f5515b70700 1 Processor -- start 2023-09-30T22:35:58.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.783+0000 7f5515b70700 1 -- start start 2023-09-30T22:35:58.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f5515b70700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f551009d630 0x7f551011d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:58.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f5515b70700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55100a0a30 0x7f551011d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:58.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f5515b70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5510138d80 0x7f551011def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:58.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f5515b70700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5510120a90 con 0x7f55100a0a30 2023-09-30T22:35:58.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f5515b70700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55100a0410 con 0x7f5510138d80 2023-09-30T22:35:58.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f5515b70700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f551011f5e0 con 0x7f551009d630 2023-09-30T22:35:58.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f550ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5510138d80 0x7f551011def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:58.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f550f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f551009d630 0x7f551011d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:58.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f550ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5510138d80 0x7f551011def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39454/0 (socket says 172.21.15.59:39454) 2023-09-30T22:35:58.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f550ffff700 1 -- 172.21.15.59:0/990065365 learned_addr learned my addr 172.21.15.59:0/990065365 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:58.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f550effd700 1 --2- 172.21.15.59:0/990065365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55100a0a30 0x7f551011d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:58.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f550f7fe700 1 -- 172.21.15.59:0/990065365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5510138d80 msgr2=0x7f551011def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:58.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f550f7fe700 1 --2- 172.21.15.59:0/990065365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5510138d80 0x7f551011def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f550f7fe700 1 -- 172.21.15.59:0/990065365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55100a0a30 msgr2=0x7f551011d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:58.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f550f7fe700 1 --2- 172.21.15.59:0/990065365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55100a0a30 0x7f551011d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f550f7fe700 1 -- 172.21.15.59:0/990065365 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5508009550 con 0x7f551009d630 2023-09-30T22:35:58.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.784+0000 7f550effd700 1 --2- 172.21.15.59:0/990065365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55100a0a30 0x7f551011d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:58.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.785+0000 7f550f7fe700 1 --2- 172.21.15.59:0/990065365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f551009d630 0x7f551011d470 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5508016000 tx=0x7f5508004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:58.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.785+0000 7f5507fff700 1 -- 172.21.15.59:0/990065365 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508004400 con 0x7f551009d630 2023-09-30T22:35:58.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.785+0000 7f5507fff700 1 -- 172.21.15.59:0/990065365 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550801f070 con 0x7f551009d630 2023-09-30T22:35:58.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.785+0000 7f5515b70700 1 -- 172.21.15.59:0/990065365 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551013b010 con 0x7f551009d630 2023-09-30T22:35:58.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.785+0000 7f5507fff700 1 -- 172.21.15.59:0/990065365 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55080038e0 con 0x7f551009d630 2023-09-30T22:35:58.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.785+0000 7f5515b70700 1 -- 172.21.15.59:0/990065365 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5510120c70 con 0x7f551009d630 2023-09-30T22:35:58.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.786+0000 7f5507fff700 1 -- 172.21.15.59:0/990065365 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5508021030 con 0x7f551009d630 2023-09-30T22:35:58.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.786+0000 7f5515b70700 1 -- 172.21.15.59:0/990065365 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55100747f0 con 0x7f551009d630 2023-09-30T22:35:58.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.786+0000 7f5507fff700 1 -- 172.21.15.59:0/990065365 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5508040b50 con 0x7f551009d630 2023-09-30T22:35:58.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.791+0000 7f5507fff700 1 -- 172.21.15.59:0/990065365 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5508004560 con 0x7f551009d630 2023-09-30T22:35:58.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.964+0000 7f7518d85700 1 -- 172.21.15.59:0/4045490113 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7514074ea0 con 0x7f75140a0a30 2023-09-30T22:35:58.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.964+0000 7f750affd700 1 -- 172.21.15.59:0/4045490113 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f750c00b3e0 con 0x7f75140a0a30 2023-09-30T22:35:58.965 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:35:58.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.967+0000 7f7518d85700 1 -- 172.21.15.59:0/4045490113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75140a0a30 msgr2=0x7f7514122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.967+0000 7f7518d85700 1 --2- 172.21.15.59:0/4045490113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75140a0a30 0x7f7514122900 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f750c016000 tx=0x7f750c004750 comp rx=0 tx=0).stop 2023-09-30T22:35:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.967+0000 7f7518d85700 1 -- 172.21.15.59:0/4045490113 shutdown_connections 2023-09-30T22:35:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.967+0000 7f7518d85700 1 --2- 172.21.15.59:0/4045490113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7514134170 0x7f7514123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.967+0000 7f7518d85700 1 --2- 172.21.15.59:0/4045490113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75140a0a30 0x7f7514122900 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.967+0000 7f7518d85700 1 --2- 172.21.15.59:0/4045490113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75140a1340 0x7f7514122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.967+0000 7f7518d85700 1 -- 172.21.15.59:0/4045490113 >> 172.21.15.59:0/4045490113 conn(0x7f75140a6550 msgr2=0x7f751409ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.967+0000 7f7518d85700 1 -- 172.21.15.59:0/4045490113 shutdown_connections 2023-09-30T22:35:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.967+0000 7f7518d85700 1 -- 172.21.15.59:0/4045490113 wait complete. 2023-09-30T22:35:58.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:35:58.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.997+0000 7f5515b70700 1 -- 172.21.15.59:0/990065365 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f551011f830 con 0x7f551009d630 2023-09-30T22:35:58.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:58.998+0000 7f5507fff700 1 -- 172.21.15.59:0/990065365 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5508015090 con 0x7f551009d630 2023-09-30T22:35:58.998 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:59.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.000+0000 7f5515b70700 1 -- 172.21.15.59:0/990065365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f551009d630 msgr2=0x7f551011d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:59.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.000+0000 7f5515b70700 1 --2- 172.21.15.59:0/990065365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f551009d630 0x7f551011d470 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5508016000 tx=0x7f5508004750 comp rx=0 tx=0).stop 2023-09-30T22:35:59.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.000+0000 7f5515b70700 1 -- 172.21.15.59:0/990065365 shutdown_connections 2023-09-30T22:35:59.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.000+0000 7f5515b70700 1 --2- 172.21.15.59:0/990065365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f551009d630 0x7f551011d470 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.000+0000 7f5515b70700 1 --2- 172.21.15.59:0/990065365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5510138d80 0x7f551011def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.000+0000 7f5515b70700 1 --2- 172.21.15.59:0/990065365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55100a0a30 0x7f551011d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.000+0000 7f5515b70700 1 -- 172.21.15.59:0/990065365 >> 172.21.15.59:0/990065365 conn(0x7f55100a3050 msgr2=0x7f551009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:59.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.000+0000 7f5515b70700 1 -- 172.21.15.59:0/990065365 shutdown_connections 2023-09-30T22:35:59.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.000+0000 7f5515b70700 1 -- 172.21.15.59:0/990065365 wait complete. 2023-09-30T22:35:59.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:35:59.045 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:35:59.089 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:35:59.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.196+0000 7f7c0cc28700 1 Processor -- start 2023-09-30T22:35:59.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.196+0000 7f7c0cc28700 1 -- start start 2023-09-30T22:35:59.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.197+0000 7f7c0cc28700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c080a0a30 0x7f7c080a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:59.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.197+0000 7f7c0cc28700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c08134170 0x7f7c0813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:59.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.197+0000 7f7c0cc28700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0809edd0 con 0x7f7c080a1340 2023-09-30T22:35:59.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.197+0000 7f7c0cc28700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0809e1f0 con 0x7f7c08134170 2023-09-30T22:35:59.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.197+0000 7f7c0cc28700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0809dc50 con 0x7f7c080a0a30 2023-09-30T22:35:59.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.197+0000 7f7c0659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c080a0a30 0x7f7c080a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:59.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.197+0000 7f7c06d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c08134170 0x7f7c0813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:59.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.197+0000 7f7c06d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c08134170 0x7f7c0813bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52410/0 (socket says 172.21.15.59:52410) 2023-09-30T22:35:59.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.197+0000 7f7c0659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c080a0a30 0x7f7c080a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39458/0 (socket says 172.21.15.59:39458) 2023-09-30T22:35:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.197+0000 7f7c06d9d700 1 -- 172.21.15.59:0/1755471299 learned_addr learned my addr 172.21.15.59:0/1755471299 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.197+0000 7f7c0659c700 1 -- 172.21.15.59:0/1755471299 >> v2:172.21.15.59:3300/0 conn(0x7f7c08134170 msgr2=0x7f7c0813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.197+0000 7f7c0659c700 1 --2- 172.21.15.59:0/1755471299 >> v2:172.21.15.59:3300/0 conn(0x7f7c08134170 0x7f7c0813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.197+0000 7f7c0659c700 1 -- 172.21.15.59:0/1755471299 >> v1:172.21.15.59:6789/0 conn(0x7f7c080a1340 legacy=0x7f7c08133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.197+0000 7f7c0659c700 1 -- 172.21.15.59:0/1755471299 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c080a1fe0 con 0x7f7c080a0a30 2023-09-30T22:35:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.197+0000 7f7c06d9d700 1 --2- 172.21.15.59:0/1755471299 >> v2:172.21.15.59:3300/0 conn(0x7f7c08134170 0x7f7c0813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.198+0000 7f7c0659c700 1 --2- 172.21.15.59:0/1755471299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c080a0a30 0x7f7c080a0e00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009d90 tx=0x7f7bf800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97d3692191eaef76 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.198+0000 7f7c0559a700 1 -- 172.21.15.59:0/1755471299 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf800e070 con 0x7f7c080a0a30 2023-09-30T22:35:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.198+0000 7f7c0559a700 1 -- 172.21.15.59:0/1755471299 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf800bb20 con 0x7f7c080a0a30 2023-09-30T22:35:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.198+0000 7f7c0559a700 1 -- 172.21.15.59:0/1755471299 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8012430 con 0x7f7c080a0a30 2023-09-30T22:35:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.198+0000 7f7c0cc28700 1 -- 172.21.15.59:0/1755471299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c080a0a30 msgr2=0x7f7c080a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:59.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.198+0000 7f7c0cc28700 1 --2- 172.21.15.59:0/1755471299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c080a0a30 0x7f7c080a0e00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009d90 tx=0x7f7bf800b330 comp rx=0 tx=0).stop 2023-09-30T22:35:59.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.199+0000 7f7c0cc28700 1 -- 172.21.15.59:0/1755471299 shutdown_connections 2023-09-30T22:35:59.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.199+0000 7f7c0cc28700 1 --2- 172.21.15.59:0/1755471299 >> v2:172.21.15.59:3300/0 conn(0x7f7c08134170 0x7f7c0813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.199+0000 7f7c0cc28700 1 --2- 172.21.15.59:0/1755471299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c080a0a30 0x7f7c080a0e00 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.199+0000 7f7c0cc28700 1 -- 172.21.15.59:0/1755471299 >> 172.21.15.59:0/1755471299 conn(0x7f7c080a6550 msgr2=0x7f7c080a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:59.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.199+0000 7f7c0cc28700 1 -- 172.21.15.59:0/1755471299 shutdown_connections 2023-09-30T22:35:59.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.199+0000 7f7c0cc28700 1 -- 172.21.15.59:0/1755471299 wait complete. 2023-09-30T22:35:59.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.200+0000 7f7c0cc28700 1 Processor -- start 2023-09-30T22:35:59.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.200+0000 7f7c0cc28700 1 -- start start 2023-09-30T22:35:59.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.200+0000 7f7c0cc28700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c080a0a30 0x7f7c08122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:59.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.200+0000 7f7c0cc28700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c080a1340 0x7f7c08122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.200+0000 7f7c0cc28700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c08134170 0x7f7c08123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.200+0000 7f7c0cc28700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c08124690 con 0x7f7c08134170 2023-09-30T22:35:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.200+0000 7f7c0cc28700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c080a4f40 con 0x7f7c080a0a30 2023-09-30T22:35:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.200+0000 7f7c0cc28700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c08126420 con 0x7f7c080a1340 2023-09-30T22:35:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7c06d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c08134170 0x7f7c08123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7c0659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c080a0a30 0x7f7c08122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7c06d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c08134170 0x7f7c08123380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52422/0 (socket says 172.21.15.59:52422) 2023-09-30T22:35:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7c06d9d700 1 -- 172.21.15.59:0/2703784198 learned_addr learned my addr 172.21.15.59:0/2703784198 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7c05d9b700 1 --2- 172.21.15.59:0/2703784198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c080a1340 0x7f7c08122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7c06d9d700 1 -- 172.21.15.59:0/2703784198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c080a1340 msgr2=0x7f7c08122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:59.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7c06d9d700 1 --2- 172.21.15.59:0/2703784198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c080a1340 0x7f7c08122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7c06d9d700 1 -- 172.21.15.59:0/2703784198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c080a0a30 msgr2=0x7f7c08122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:59.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7c06d9d700 1 --2- 172.21.15.59:0/2703784198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c080a0a30 0x7f7c08122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7c06d9d700 1 -- 172.21.15.59:0/2703784198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c00009550 con 0x7f7c08134170 2023-09-30T22:35:59.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7c0659c700 1 --2- 172.21.15.59:0/2703784198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c080a0a30 0x7f7c08122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:59.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7c06d9d700 1 --2- 172.21.15.59:0/2703784198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c08134170 0x7f7c08123380 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000eb60 tx=0x7f7c0000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:59.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7bfeffd700 1 -- 172.21.15.59:0/2703784198 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00009e60 con 0x7f7c08134170 2023-09-30T22:35:59.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7bfeffd700 1 -- 172.21.15.59:0/2703784198 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c00004020 con 0x7f7c08134170 2023-09-30T22:35:59.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7c0cc28700 1 -- 172.21.15.59:0/2703784198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf8009a70 con 0x7f7c08134170 2023-09-30T22:35:59.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7bfeffd700 1 -- 172.21.15.59:0/2703784198 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c000043b0 con 0x7f7c08134170 2023-09-30T22:35:59.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.201+0000 7f7c0cc28700 1 -- 172.21.15.59:0/2703784198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c08133420 con 0x7f7c08134170 2023-09-30T22:35:59.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.202+0000 7f7bfeffd700 1 -- 172.21.15.59:0/2703784198 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c0000c850 con 0x7f7c08134170 2023-09-30T22:35:59.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.202+0000 7f7bfeffd700 1 -- 172.21.15.59:0/2703784198 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7c0003f790 con 0x7f7c08134170 2023-09-30T22:35:59.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.203+0000 7f7c0cc28700 1 -- 172.21.15.59:0/2703784198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c080a1d40 con 0x7f7c08134170 2023-09-30T22:35:59.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.208+0000 7f7bfeffd700 1 -- 172.21.15.59:0/2703784198 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c00017020 con 0x7f7c08134170 2023-09-30T22:35:59.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.241+0000 7f66fa05d700 1 Processor -- start 2023-09-30T22:35:59.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.241+0000 7f66fa05d700 1 -- start start 2023-09-30T22:35:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.241+0000 7f66fa05d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66f40a0a30 0x7f66f40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.241+0000 7f66fa05d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66f40a1340 0x7f66f4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.241+0000 7f66fa05d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66f4133fa0 0x7f66f4134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.241+0000 7f66fa05d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f409edd0 con 0x7f66f4133fa0 2023-09-30T22:35:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.241+0000 7f66fa05d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f409e1f0 con 0x7f66f40a1340 2023-09-30T22:35:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.241+0000 7f66fa05d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66f409dc50 con 0x7f66f40a0a30 2023-09-30T22:35:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.241+0000 7f66f3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66f4133fa0 0x7f66f4134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.241+0000 7f66f2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66f40a1340 0x7f66f4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.241+0000 7f66f2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66f40a1340 0x7f66f4133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39470/0 (socket says 172.21.15.59:39470) 2023-09-30T22:35:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.241+0000 7f66f3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66f4133fa0 0x7f66f4134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52436/0 (socket says 172.21.15.59:52436) 2023-09-30T22:35:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.241+0000 7f66f2ffd700 1 -- 172.21.15.59:0/3413322252 learned_addr learned my addr 172.21.15.59:0/3413322252 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:59.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.241+0000 7f66f37fe700 1 --2- 172.21.15.59:0/3413322252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66f40a0a30 0x7f66f40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:59.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.242+0000 7f66f37fe700 1 -- 172.21.15.59:0/3413322252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66f40a1340 msgr2=0x7f66f4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:59.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.242+0000 7f66f37fe700 1 --2- 172.21.15.59:0/3413322252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66f40a1340 0x7f66f4133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.242+0000 7f66f37fe700 1 -- 172.21.15.59:0/3413322252 >> v2:172.21.15.59:3300/0 conn(0x7f66f4133fa0 msgr2=0x7f66f4134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:35:59.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.242+0000 7f66f37fe700 1 --2- 172.21.15.59:0/3413322252 >> v2:172.21.15.59:3300/0 conn(0x7f66f4133fa0 0x7f66f4134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.242+0000 7f66f37fe700 1 -- 172.21.15.59:0/3413322252 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f40a1fe0 con 0x7f66f40a0a30 2023-09-30T22:35:59.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.242+0000 7f66f3fff700 1 --2- 172.21.15.59:0/3413322252 >> v2:172.21.15.59:3300/0 conn(0x7f66f4133fa0 0x7f66f4134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:59.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.242+0000 7f66f2ffd700 1 --2- 172.21.15.59:0/3413322252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66f40a1340 0x7f66f4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:59.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.242+0000 7f66f37fe700 1 --2- 172.21.15.59:0/3413322252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66f40a0a30 0x7f66f40a0e00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009840 tx=0x7f66e4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=140ce12d62f3b5df server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:59.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.242+0000 7f66f27fc700 1 -- 172.21.15.59:0/3413322252 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4011830 con 0x7f66f40a0a30 2023-09-30T22:35:59.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.242+0000 7f66f27fc700 1 -- 172.21.15.59:0/3413322252 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e4011990 con 0x7f66f40a0a30 2023-09-30T22:35:59.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.242+0000 7f66f27fc700 1 -- 172.21.15.59:0/3413322252 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4011d20 con 0x7f66f40a0a30 2023-09-30T22:35:59.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.243+0000 7f66fa05d700 1 -- 172.21.15.59:0/3413322252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66f40a0a30 msgr2=0x7f66f40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:59.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.243+0000 7f66fa05d700 1 --2- 172.21.15.59:0/3413322252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66f40a0a30 0x7f66f40a0e00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009840 tx=0x7f66e4009b50 comp rx=0 tx=0).stop 2023-09-30T22:35:59.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.243+0000 7f66fa05d700 1 -- 172.21.15.59:0/3413322252 shutdown_connections 2023-09-30T22:35:59.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.243+0000 7f66fa05d700 1 --2- 172.21.15.59:0/3413322252 >> v2:172.21.15.59:3300/0 conn(0x7f66f4133fa0 0x7f66f4134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.243+0000 7f66fa05d700 1 --2- 172.21.15.59:0/3413322252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66f40a0a30 0x7f66f40a0e00 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.243+0000 7f66fa05d700 1 --2- 172.21.15.59:0/3413322252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66f40a1340 0x7f66f4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.243+0000 7f66fa05d700 1 -- 172.21.15.59:0/3413322252 >> 172.21.15.59:0/3413322252 conn(0x7f66f40a6550 msgr2=0x7f66f40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:59.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.243+0000 7f66fa05d700 1 -- 172.21.15.59:0/3413322252 shutdown_connections 2023-09-30T22:35:59.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.243+0000 7f66fa05d700 1 -- 172.21.15.59:0/3413322252 wait complete. 2023-09-30T22:35:59.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.244+0000 7f66fa05d700 1 Processor -- start 2023-09-30T22:35:59.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.244+0000 7f66fa05d700 1 -- start start 2023-09-30T22:35:59.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66fa05d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66f40a0a30 0x7f66f41200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66fa05d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66f40a1340 0x7f66f41205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66fa05d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66f4133fa0 0x7f66f4120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:35:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66fa05d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4123bc0 con 0x7f66f40a1340 2023-09-30T22:35:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66fa05d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4122f90 con 0x7f66f40a0a30 2023-09-30T22:35:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66fa05d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66f40a34f0 con 0x7f66f4133fa0 2023-09-30T22:35:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66f3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66f4133fa0 0x7f66f4120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66f2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66f40a1340 0x7f66f41205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66f3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66f4133fa0 0x7f66f4120b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36080/0 (socket says 172.21.15.59:36080) 2023-09-30T22:35:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66f3fff700 1 -- 172.21.15.59:0/1955654373 learned_addr learned my addr 172.21.15.59:0/1955654373 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:35:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66f37fe700 1 --2- 172.21.15.59:0/1955654373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66f40a0a30 0x7f66f41200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:35:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66f2ffd700 1 -- 172.21.15.59:0/1955654373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66f4133fa0 msgr2=0x7f66f4120b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66f2ffd700 1 --2- 172.21.15.59:0/1955654373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66f4133fa0 0x7f66f4120b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66f2ffd700 1 -- 172.21.15.59:0/1955654373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66f40a0a30 msgr2=0x7f66f41200a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66f2ffd700 1 --2- 172.21.15.59:0/1955654373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66f40a0a30 0x7f66f41200a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66f2ffd700 1 -- 172.21.15.59:0/1955654373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e8009550 con 0x7f66f40a1340 2023-09-30T22:35:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66f3fff700 1 --2- 172.21.15.59:0/1955654373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66f4133fa0 0x7f66f4120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66f37fe700 1 --2- 172.21.15.59:0/1955654373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66f40a0a30 0x7f66f41200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:35:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.245+0000 7f66f2ffd700 1 --2- 172.21.15.59:0/1955654373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66f40a1340 0x7f66f41205e0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f66e800e9a0 tx=0x7f66e800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:35:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.246+0000 7f66dbfff700 1 -- 172.21.15.59:0/1955654373 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8004030 con 0x7f66f40a1340 2023-09-30T22:35:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.246+0000 7f66dbfff700 1 -- 172.21.15.59:0/1955654373 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e8004190 con 0x7f66f40a1340 2023-09-30T22:35:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.246+0000 7f66fa05d700 1 -- 172.21.15.59:0/1955654373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ec009a70 con 0x7f66f40a1340 2023-09-30T22:35:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.246+0000 7f66dbfff700 1 -- 172.21.15.59:0/1955654373 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8004520 con 0x7f66f40a1340 2023-09-30T22:35:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.246+0000 7f66fa05d700 1 -- 172.21.15.59:0/1955654373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e40094a0 con 0x7f66f40a1340 2023-09-30T22:35:59.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.246+0000 7f66dbfff700 1 -- 172.21.15.59:0/1955654373 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66e80036a0 con 0x7f66f40a1340 2023-09-30T22:35:59.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.247+0000 7f66dbfff700 1 -- 172.21.15.59:0/1955654373 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f66e803f8e0 con 0x7f66f40a1340 2023-09-30T22:35:59.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.247+0000 7f66fa05d700 1 -- 172.21.15.59:0/1955654373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f4121d10 con 0x7f66f40a1340 2023-09-30T22:35:59.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.252+0000 7f66dbfff700 1 -- 172.21.15.59:0/1955654373 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66e8011db0 con 0x7f66f40a1340 2023-09-30T22:35:59.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.415+0000 7f7c0cc28700 1 -- 172.21.15.59:0/2703784198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c08074ea0 con 0x7f7c08134170 2023-09-30T22:35:59.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.415+0000 7f7bfeffd700 1 -- 172.21.15.59:0/2703784198 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c0000cb00 con 0x7f7c08134170 2023-09-30T22:35:59.415 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:35:59.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.418+0000 7f7c0cc28700 1 -- 172.21.15.59:0/2703784198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c08134170 msgr2=0x7f7c08123380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:59.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.418+0000 7f7c0cc28700 1 --2- 172.21.15.59:0/2703784198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c08134170 0x7f7c08123380 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000eb60 tx=0x7f7c0000ee70 comp rx=0 tx=0).stop 2023-09-30T22:35:59.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.418+0000 7f7c0cc28700 1 -- 172.21.15.59:0/2703784198 shutdown_connections 2023-09-30T22:35:59.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.418+0000 7f7c0cc28700 1 --2- 172.21.15.59:0/2703784198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c08134170 0x7f7c08123380 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.418+0000 7f7c0cc28700 1 --2- 172.21.15.59:0/2703784198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c080a0a30 0x7f7c08122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.418+0000 7f7c0cc28700 1 --2- 172.21.15.59:0/2703784198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c080a1340 0x7f7c08122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.418+0000 7f7c0cc28700 1 -- 172.21.15.59:0/2703784198 >> 172.21.15.59:0/2703784198 conn(0x7f7c080a6550 msgr2=0x7f7c0809ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:59.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.418+0000 7f7c0cc28700 1 -- 172.21.15.59:0/2703784198 shutdown_connections 2023-09-30T22:35:59.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.418+0000 7f7c0cc28700 1 -- 172.21.15.59:0/2703784198 wait complete. 2023-09-30T22:35:59.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:35:59.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.463+0000 7f66fa05d700 1 -- 172.21.15.59:0/1955654373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f66f4074ea0 con 0x7f66f40a1340 2023-09-30T22:35:59.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.464+0000 7f66dbfff700 1 -- 172.21.15.59:0/1955654373 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66e8011350 con 0x7f66f40a1340 2023-09-30T22:35:59.464 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:35:59.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.466+0000 7f66fa05d700 1 -- 172.21.15.59:0/1955654373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66f40a1340 msgr2=0x7f66f41205e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:35:59.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.466+0000 7f66fa05d700 1 --2- 172.21.15.59:0/1955654373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66f40a1340 0x7f66f41205e0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f66e800e9a0 tx=0x7f66e800ecb0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.466+0000 7f66fa05d700 1 -- 172.21.15.59:0/1955654373 shutdown_connections 2023-09-30T22:35:59.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.466+0000 7f66fa05d700 1 --2- 172.21.15.59:0/1955654373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66f4133fa0 0x7f66f4120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.466+0000 7f66fa05d700 1 --2- 172.21.15.59:0/1955654373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66f40a0a30 0x7f66f41200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.466+0000 7f66fa05d700 1 --2- 172.21.15.59:0/1955654373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66f40a1340 0x7f66f41205e0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:35:59.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.466+0000 7f66fa05d700 1 -- 172.21.15.59:0/1955654373 >> 172.21.15.59:0/1955654373 conn(0x7f66f40a6550 msgr2=0x7f66f41bae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:35:59.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.466+0000 7f66fa05d700 1 -- 172.21.15.59:0/1955654373 shutdown_connections 2023-09-30T22:35:59.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:35:59.466+0000 7f66fa05d700 1 -- 172.21.15.59:0/1955654373 wait complete. 2023-09-30T22:35:59.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:35:59.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:00.014 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:00.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.133+0000 7f06f89ba700 1 Processor -- start 2023-09-30T22:36:00.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.133+0000 7f06f89ba700 1 -- start start 2023-09-30T22:36:00.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f89ba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f40a0a30 0x7f06f40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f89ba700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06f40a1340 0x7f06f4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f89ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f4133fa0 0x7f06f4134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f89ba700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f409edd0 con 0x7f06f40a1340 2023-09-30T22:36:00.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f89ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f409e1f0 con 0x7f06f4133fa0 2023-09-30T22:36:00.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f89ba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06f409dc50 con 0x7f06f40a0a30 2023-09-30T22:36:00.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06f40a1340 0x7f06f4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f4133fa0 0x7f06f4134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f40a0a30 0x7f06f40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f4133fa0 0x7f06f4134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39484/0 (socket says 172.21.15.59:39484) 2023-09-30T22:36:00.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06f40a1340 0x7f06f4133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52450/0 (socket says 172.21.15.59:52450) 2023-09-30T22:36:00.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f2d9d700 1 -- 172.21.15.59:0/4019586452 learned_addr learned my addr 172.21.15.59:0/4019586452 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:00.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f2d9d700 1 -- 172.21.15.59:0/4019586452 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f40a0a30 msgr2=0x7f06f40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:00.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f2d9d700 1 --2- 172.21.15.59:0/4019586452 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f40a0a30 0x7f06f40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f2d9d700 1 -- 172.21.15.59:0/4019586452 >> v2:172.21.15.59:3300/0 conn(0x7f06f40a1340 msgr2=0x7f06f4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:00.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f2d9d700 1 --2- 172.21.15.59:0/4019586452 >> v2:172.21.15.59:3300/0 conn(0x7f06f40a1340 0x7f06f4133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f2d9d700 1 -- 172.21.15.59:0/4019586452 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f40a1fe0 con 0x7f06f4133fa0 2023-09-30T22:36:00.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.134+0000 7f06f1d9b700 1 --2- 172.21.15.59:0/4019586452 >> v2:172.21.15.59:3300/0 conn(0x7f06f40a1340 0x7f06f4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:00.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.135+0000 7f06f2d9d700 1 --2- 172.21.15.59:0/4019586452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f4133fa0 0x7f06f4134410 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009920 tx=0x7f06ec009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29e4e66b3e140a33 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:00.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.135+0000 7f06f159a700 1 -- 172.21.15.59:0/4019586452 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec011830 con 0x7f06f4133fa0 2023-09-30T22:36:00.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.135+0000 7f06f159a700 1 -- 172.21.15.59:0/4019586452 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec011990 con 0x7f06f4133fa0 2023-09-30T22:36:00.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.135+0000 7f06f159a700 1 -- 172.21.15.59:0/4019586452 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec011d20 con 0x7f06f4133fa0 2023-09-30T22:36:00.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.136+0000 7f06f89ba700 1 -- 172.21.15.59:0/4019586452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f4133fa0 msgr2=0x7f06f4134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.136+0000 7f06f89ba700 1 --2- 172.21.15.59:0/4019586452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f4133fa0 0x7f06f4134410 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009920 tx=0x7f06ec009c30 comp rx=0 tx=0).stop 2023-09-30T22:36:00.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.136+0000 7f06f89ba700 1 -- 172.21.15.59:0/4019586452 shutdown_connections 2023-09-30T22:36:00.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.136+0000 7f06f89ba700 1 --2- 172.21.15.59:0/4019586452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f4133fa0 0x7f06f4134410 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.136+0000 7f06f89ba700 1 --2- 172.21.15.59:0/4019586452 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f40a0a30 0x7f06f40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.136+0000 7f06f89ba700 1 --2- 172.21.15.59:0/4019586452 >> v2:172.21.15.59:3300/0 conn(0x7f06f40a1340 0x7f06f4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.136+0000 7f06f89ba700 1 -- 172.21.15.59:0/4019586452 >> 172.21.15.59:0/4019586452 conn(0x7f06f40a6550 msgr2=0x7f06f40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:00.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.136+0000 7f06f89ba700 1 -- 172.21.15.59:0/4019586452 shutdown_connections 2023-09-30T22:36:00.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.136+0000 7f06f89ba700 1 -- 172.21.15.59:0/4019586452 wait complete. 2023-09-30T22:36:00.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.137+0000 7f06f89ba700 1 Processor -- start 2023-09-30T22:36:00.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.137+0000 7f06f89ba700 1 -- start start 2023-09-30T22:36:00.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.137+0000 7f06f89ba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f40a0a30 0x7f06f4120000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.137+0000 7f06f89ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f40a1340 0x7f06f4120540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.137+0000 7f06f89ba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f4133fa0 0x7f06f4120a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.137+0000 7f06f89ba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f4122260 con 0x7f06f40a0a30 2023-09-30T22:36:00.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.137+0000 7f06f89ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f4123b20 con 0x7f06f40a1340 2023-09-30T22:36:00.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.137+0000 7f06f89ba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06f4122ef0 con 0x7f06f4133fa0 2023-09-30T22:36:00.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06f1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f40a1340 0x7f06f4120540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06f2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f4133fa0 0x7f06f4120a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06f1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f40a1340 0x7f06f4120540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39498/0 (socket says 172.21.15.59:39498) 2023-09-30T22:36:00.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06f259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f40a0a30 0x7f06f4120000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06f1d9b700 1 -- 172.21.15.59:0/3908786671 learned_addr learned my addr 172.21.15.59:0/3908786671 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:00.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06f1d9b700 1 -- 172.21.15.59:0/3908786671 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f4133fa0 msgr2=0x7f06f4120a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06f1d9b700 1 --2- 172.21.15.59:0/3908786671 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f4133fa0 0x7f06f4120a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06f1d9b700 1 -- 172.21.15.59:0/3908786671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f40a0a30 msgr2=0x7f06f4120000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06f1d9b700 1 --2- 172.21.15.59:0/3908786671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f40a0a30 0x7f06f4120000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06f1d9b700 1 -- 172.21.15.59:0/3908786671 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0094a0 con 0x7f06f40a1340 2023-09-30T22:36:00.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06f259c700 1 --2- 172.21.15.59:0/3908786671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f40a0a30 0x7f06f4120000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:00.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06f1d9b700 1 --2- 172.21.15.59:0/3908786671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f40a1340 0x7f06f4120540 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00ebe0 tx=0x7f06dc00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:00.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06eaffd700 1 -- 172.21.15.59:0/3908786671 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00c850 con 0x7f06f40a1340 2023-09-30T22:36:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06eaffd700 1 -- 172.21.15.59:0/3908786671 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc00c9b0 con 0x7f06f40a1340 2023-09-30T22:36:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06f89ba700 1 -- 172.21.15.59:0/3908786671 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ec009550 con 0x7f06f40a1340 2023-09-30T22:36:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06eaffd700 1 -- 172.21.15.59:0/3908786671 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00cd40 con 0x7f06f40a1340 2023-09-30T22:36:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.138+0000 7f06f89ba700 1 -- 172.21.15.59:0/3908786671 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f4121c10 con 0x7f06f40a1340 2023-09-30T22:36:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.139+0000 7f06eaffd700 1 -- 172.21.15.59:0/3908786671 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06dc013470 con 0x7f06f40a1340 2023-09-30T22:36:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.139+0000 7f06eaffd700 1 -- 172.21.15.59:0/3908786671 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f06dc03f730 con 0x7f06f40a1340 2023-09-30T22:36:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.140+0000 7f06f89ba700 1 -- 172.21.15.59:0/3908786671 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f4074ea0 con 0x7f06f40a1340 2023-09-30T22:36:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.144+0000 7f06eaffd700 1 -- 172.21.15.59:0/3908786671 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06dc013720 con 0x7f06f40a1340 2023-09-30T22:36:00.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.184+0000 7fc553a66700 1 Processor -- start 2023-09-30T22:36:00.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.185+0000 7fc553a66700 1 -- start start 2023-09-30T22:36:00.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.185+0000 7fc553a66700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc54c09e930 0x7fc54c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.185+0000 7fc553a66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c09f650 0x7fc54c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.185+0000 7fc553a66700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54c070940 con 0x7fc54c09f240 2023-09-30T22:36:00.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.185+0000 7fc553a66700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54c06fd60 con 0x7fc54c09e930 2023-09-30T22:36:00.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.185+0000 7fc553a66700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c06fa80 con 0x7fc54c09f650 2023-09-30T22:36:00.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.186+0000 7fc551802700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc54c09e930 0x7fc54c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.186+0000 7fc551001700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc54c09f240 0x7fc54c1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57104/0 (socket says 172.21.15.59:57104) 2023-09-30T22:36:00.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.186+0000 7fc551001700 1 -- 172.21.15.59:0/2429054129 learned_addr learned my addr 172.21.15.59:0/2429054129 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:00.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.186+0000 7fc552003700 1 --2- 172.21.15.59:0/2429054129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c09f650 0x7fc54c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.186+0000 7fc551802700 1 -- 172.21.15.59:0/2429054129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c09f650 msgr2=0x7fc54c131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:00.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.186+0000 7fc551802700 1 --2- 172.21.15.59:0/2429054129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c09f650 0x7fc54c131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.186+0000 7fc551802700 1 -- 172.21.15.59:0/2429054129 >> v1:172.21.15.59:6789/0 conn(0x7fc54c09f240 legacy=0x7fc54c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.186+0000 7fc551802700 1 -- 172.21.15.59:0/2429054129 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c09fb60 con 0x7fc54c09e930 2023-09-30T22:36:00.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.186+0000 7fc550800700 1 -- 172.21.15.59:0/2429054129 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465886315 0 0) 0x7fc54c070940 con 0x7fc54c09f240 2023-09-30T22:36:00.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.187+0000 7fc551802700 1 --2- 172.21.15.59:0/2429054129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09e930 0x7fc54c09ed00 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009d90 tx=0x7fc53c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b22a8b7545b6b80 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:00.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.187+0000 7fc550800700 1 -- 172.21.15.59:0/2429054129 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c00e070 con 0x7fc54c09e930 2023-09-30T22:36:00.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.187+0000 7fc550800700 1 -- 172.21.15.59:0/2429054129 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c00bb20 con 0x7fc54c09e930 2023-09-30T22:36:00.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.187+0000 7fc550800700 1 -- 172.21.15.59:0/2429054129 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c012430 con 0x7fc54c09e930 2023-09-30T22:36:00.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.187+0000 7fc553a66700 1 -- 172.21.15.59:0/2429054129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09e930 msgr2=0x7fc54c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.187+0000 7fc553a66700 1 --2- 172.21.15.59:0/2429054129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09e930 0x7fc54c09ed00 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009d90 tx=0x7fc53c00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:00.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.187+0000 7fc553a66700 1 -- 172.21.15.59:0/2429054129 shutdown_connections 2023-09-30T22:36:00.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.187+0000 7fc553a66700 1 --2- 172.21.15.59:0/2429054129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09e930 0x7fc54c09ed00 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.187+0000 7fc553a66700 1 --2- 172.21.15.59:0/2429054129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c09f650 0x7fc54c131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.187+0000 7fc553a66700 1 -- 172.21.15.59:0/2429054129 >> 172.21.15.59:0/2429054129 conn(0x7fc54c0a4210 msgr2=0x7fc54c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:00.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.188+0000 7fc553a66700 1 -- 172.21.15.59:0/2429054129 shutdown_connections 2023-09-30T22:36:00.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.188+0000 7fc553a66700 1 -- 172.21.15.59:0/2429054129 wait complete. 2023-09-30T22:36:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.189+0000 7fc553a66700 1 Processor -- start 2023-09-30T22:36:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.189+0000 7fc553a66700 1 -- start start 2023-09-30T22:36:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.189+0000 7fc553a66700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c09e930 0x7fc54c1a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.189+0000 7fc553a66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c09f240 0x7fc54c1a7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.189+0000 7fc553a66700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09f650 0x7fc54c1a7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.189+0000 7fc553a66700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c1aabe0 con 0x7fc54c09f650 2023-09-30T22:36:00.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.189+0000 7fc553a66700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c1a9b60 con 0x7fc54c09f240 2023-09-30T22:36:00.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.189+0000 7fc553a66700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c071d20 con 0x7fc54c09e930 2023-09-30T22:36:00.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.189+0000 7fc551802700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c09e930 0x7fc54c1a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.189+0000 7fc551001700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c09f240 0x7fc54c1a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.189+0000 7fc552003700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09f650 0x7fc54c1a7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.189+0000 7fc552003700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09f650 0x7fc54c1a7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52472/0 (socket says 172.21.15.59:52472) 2023-09-30T22:36:00.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.189+0000 7fc551802700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c09e930 0x7fc54c1a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36092/0 (socket says 172.21.15.59:36092) 2023-09-30T22:36:00.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.189+0000 7fc551001700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c09f240 0x7fc54c1a7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39518/0 (socket says 172.21.15.59:39518) 2023-09-30T22:36:00.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.189+0000 7fc552003700 1 -- 172.21.15.59:0/3232832277 learned_addr learned my addr 172.21.15.59:0/3232832277 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.190+0000 7fc552003700 1 -- 172.21.15.59:0/3232832277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c09e930 msgr2=0x7fc54c1a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.190+0000 7fc552003700 1 --2- 172.21.15.59:0/3232832277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c09e930 0x7fc54c1a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.190+0000 7fc552003700 1 -- 172.21.15.59:0/3232832277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c09f240 msgr2=0x7fc54c1a7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.190+0000 7fc552003700 1 --2- 172.21.15.59:0/3232832277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c09f240 0x7fc54c1a7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.190+0000 7fc552003700 1 -- 172.21.15.59:0/3232832277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c009a70 con 0x7fc54c09f650 2023-09-30T22:36:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.190+0000 7fc552003700 1 --2- 172.21.15.59:0/3232832277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09f650 0x7fc54c1a7b40 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fc54400e980 tx=0x7fc54400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.190+0000 7fc54a7fc700 1 -- 172.21.15.59:0/3232832277 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544013680 con 0x7fc54c09f650 2023-09-30T22:36:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.190+0000 7fc54a7fc700 1 -- 172.21.15.59:0/3232832277 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5440137e0 con 0x7fc54c09f650 2023-09-30T22:36:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.190+0000 7fc54a7fc700 1 -- 172.21.15.59:0/3232832277 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544013b70 con 0x7fc54c09f650 2023-09-30T22:36:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.190+0000 7fc553a66700 1 -- 172.21.15.59:0/3232832277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54c0a0190 con 0x7fc54c09f650 2023-09-30T22:36:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.190+0000 7fc553a66700 1 -- 172.21.15.59:0/3232832277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54c1a8cd0 con 0x7fc54c09f650 2023-09-30T22:36:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.191+0000 7fc54a7fc700 1 -- 172.21.15.59:0/3232832277 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc544013cd0 con 0x7fc54c09f650 2023-09-30T22:36:00.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.191+0000 7fc54a7fc700 1 -- 172.21.15.59:0/3232832277 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc54403f740 con 0x7fc54c09f650 2023-09-30T22:36:00.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.191+0000 7fc553a66700 1 -- 172.21.15.59:0/3232832277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54c074ea0 con 0x7fc54c09f650 2023-09-30T22:36:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.196+0000 7fc54a7fc700 1 -- 172.21.15.59:0/3232832277 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc544017080 con 0x7fc54c09f650 2023-09-30T22:36:00.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.384+0000 7f06f89ba700 1 -- 172.21.15.59:0/3908786671 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f06f40a28e0 con 0x7f06f40a1340 2023-09-30T22:36:00.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.384+0000 7f06eaffd700 1 -- 172.21.15.59:0/3908786671 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06dc02a090 con 0x7f06f40a1340 2023-09-30T22:36:00.385 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:00.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.387+0000 7f06f89ba700 1 -- 172.21.15.59:0/3908786671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f40a1340 msgr2=0x7f06f4120540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.387+0000 7f06f89ba700 1 --2- 172.21.15.59:0/3908786671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f40a1340 0x7f06f4120540 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00ebe0 tx=0x7f06dc00eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.387+0000 7f06f89ba700 1 -- 172.21.15.59:0/3908786671 shutdown_connections 2023-09-30T22:36:00.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.387+0000 7f06f89ba700 1 --2- 172.21.15.59:0/3908786671 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f4133fa0 0x7f06f4120a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.387+0000 7f06f89ba700 1 --2- 172.21.15.59:0/3908786671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f40a0a30 0x7f06f4120000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.387+0000 7f06f89ba700 1 --2- 172.21.15.59:0/3908786671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f40a1340 0x7f06f4120540 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.387+0000 7f06f89ba700 1 -- 172.21.15.59:0/3908786671 >> 172.21.15.59:0/3908786671 conn(0x7f06f40a6550 msgr2=0x7f06f409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:00.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.387+0000 7f06f89ba700 1 -- 172.21.15.59:0/3908786671 shutdown_connections 2023-09-30T22:36:00.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.387+0000 7f06f89ba700 1 -- 172.21.15.59:0/3908786671 wait complete. 2023-09-30T22:36:00.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:00.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.414+0000 7fc553a66700 1 -- 172.21.15.59:0/3232832277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc54c06b250 con 0x7fc54c09f650 2023-09-30T22:36:00.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.414+0000 7fc54a7fc700 1 -- 172.21.15.59:0/3232832277 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc54401be10 con 0x7fc54c09f650 2023-09-30T22:36:00.415 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:00.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.417+0000 7fc553a66700 1 -- 172.21.15.59:0/3232832277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09f650 msgr2=0x7fc54c1a7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.417+0000 7fc553a66700 1 --2- 172.21.15.59:0/3232832277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09f650 0x7fc54c1a7b40 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fc54400e980 tx=0x7fc54400ec90 comp rx=0 tx=0).stop 2023-09-30T22:36:00.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.417+0000 7fc553a66700 1 -- 172.21.15.59:0/3232832277 shutdown_connections 2023-09-30T22:36:00.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.417+0000 7fc553a66700 1 --2- 172.21.15.59:0/3232832277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc54c09e930 0x7fc54c1a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.417+0000 7fc553a66700 1 --2- 172.21.15.59:0/3232832277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc54c09f650 0x7fc54c1a7b40 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.417+0000 7fc553a66700 1 --2- 172.21.15.59:0/3232832277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54c09f240 0x7fc54c1a7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.417+0000 7fc553a66700 1 -- 172.21.15.59:0/3232832277 >> 172.21.15.59:0/3232832277 conn(0x7fc54c0a4210 msgr2=0x7fc54c1b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:00.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.417+0000 7fc553a66700 1 -- 172.21.15.59:0/3232832277 shutdown_connections 2023-09-30T22:36:00.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.417+0000 7fc553a66700 1 -- 172.21.15.59:0/3232832277 wait complete. 2023-09-30T22:36:00.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:00.436 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:00.481 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.616+0000 7ff5cbaf4700 1 Processor -- start 2023-09-30T22:36:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.616+0000 7ff5cbaf4700 1 -- start start 2023-09-30T22:36:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5cbaf4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5c409d630 0x7ff5c40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5cbaf4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5c4138d80 0x7ff5c413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5cbaf4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c40a2a70 con 0x7ff5c40a0a30 2023-09-30T22:36:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5cbaf4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c40a01d0 con 0x7ff5c409d630 2023-09-30T22:36:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5cbaf4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c409e2b0 con 0x7ff5c4138d80 2023-09-30T22:36:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5ca091700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5c4138d80 0x7ff5c413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5c908f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5c409d630 0x7ff5c40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5c9890700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff5c40a0a30 0x7ff5c40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57110/0 (socket says 172.21.15.59:57110) 2023-09-30T22:36:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5c9890700 1 -- 172.21.15.59:0/2143117131 learned_addr learned my addr 172.21.15.59:0/2143117131 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5ca091700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5c4138d80 0x7ff5c413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36106/0 (socket says 172.21.15.59:36106) 2023-09-30T22:36:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5c888e700 1 -- 172.21.15.59:0/2143117131 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083900208 0 0) 0x7ff5c40a2a70 con 0x7ff5c40a0a30 2023-09-30T22:36:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5ca091700 1 -- 172.21.15.59:0/2143117131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5c409d630 msgr2=0x7ff5c40a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5ca091700 1 --2- 172.21.15.59:0/2143117131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5c409d630 0x7ff5c40a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5ca091700 1 -- 172.21.15.59:0/2143117131 >> v1:172.21.15.59:6789/0 conn(0x7ff5c40a0a30 legacy=0x7ff5c40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5ca091700 1 -- 172.21.15.59:0/2143117131 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c409dc50 con 0x7ff5c4138d80 2023-09-30T22:36:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.617+0000 7ff5c908f700 1 --2- 172.21.15.59:0/2143117131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5c409d630 0x7ff5c40a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.618+0000 7ff5ca091700 1 --2- 172.21.15.59:0/2143117131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5c4138d80 0x7ff5c413b160 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009dc0 tx=0x7ff5bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=105f7c9c985e6d2f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.618+0000 7ff5c888e700 1 -- 172.21.15.59:0/2143117131 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00e070 con 0x7ff5c4138d80 2023-09-30T22:36:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.618+0000 7ff5c888e700 1 -- 172.21.15.59:0/2143117131 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc00bb20 con 0x7ff5c4138d80 2023-09-30T22:36:00.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.618+0000 7ff5c888e700 1 -- 172.21.15.59:0/2143117131 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc012430 con 0x7ff5c4138d80 2023-09-30T22:36:00.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.619+0000 7ff5cbaf4700 1 -- 172.21.15.59:0/2143117131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5c4138d80 msgr2=0x7ff5c413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.619+0000 7ff5cbaf4700 1 --2- 172.21.15.59:0/2143117131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5c4138d80 0x7ff5c413b160 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009dc0 tx=0x7ff5bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:00.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.619+0000 7ff5cbaf4700 1 -- 172.21.15.59:0/2143117131 shutdown_connections 2023-09-30T22:36:00.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.619+0000 7ff5cbaf4700 1 --2- 172.21.15.59:0/2143117131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5c4138d80 0x7ff5c413b160 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.619+0000 7ff5cbaf4700 1 --2- 172.21.15.59:0/2143117131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5c409d630 0x7ff5c40a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.619+0000 7ff5cbaf4700 1 -- 172.21.15.59:0/2143117131 >> 172.21.15.59:0/2143117131 conn(0x7ff5c40a3050 msgr2=0x7ff5c40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.619+0000 7ff5cbaf4700 1 -- 172.21.15.59:0/2143117131 shutdown_connections 2023-09-30T22:36:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.619+0000 7ff5cbaf4700 1 -- 172.21.15.59:0/2143117131 wait complete. 2023-09-30T22:36:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.620+0000 7ff5cbaf4700 1 Processor -- start 2023-09-30T22:36:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.620+0000 7ff5cbaf4700 1 -- start start 2023-09-30T22:36:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.620+0000 7ff5cbaf4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5c409d630 0x7ff5c4133770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.620+0000 7ff5cbaf4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5c40a0a30 0x7ff5c4133cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.620+0000 7ff5cbaf4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5c4138d80 0x7ff5c41341f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.620+0000 7ff5cbaf4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4134c40 con 0x7ff5c40a0a30 2023-09-30T22:36:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.620+0000 7ff5cbaf4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c41361b0 con 0x7ff5c409d630 2023-09-30T22:36:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.620+0000 7ff5cbaf4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4136ed0 con 0x7ff5c4138d80 2023-09-30T22:36:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.620+0000 7ff5ca091700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5c4138d80 0x7ff5c41341f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.620+0000 7ff5c9890700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5c409d630 0x7ff5c4133770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.620+0000 7ff5ca091700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5c4138d80 0x7ff5c41341f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36118/0 (socket says 172.21.15.59:36118) 2023-09-30T22:36:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.620+0000 7ff5ca091700 1 -- 172.21.15.59:0/2108212566 learned_addr learned my addr 172.21.15.59:0/2108212566 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.621+0000 7ff5c908f700 1 --2- 172.21.15.59:0/2108212566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5c40a0a30 0x7ff5c4133cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.621+0000 7ff5ca091700 1 -- 172.21.15.59:0/2108212566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5c409d630 msgr2=0x7ff5c4133770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.621+0000 7ff5ca091700 1 --2- 172.21.15.59:0/2108212566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5c409d630 0x7ff5c4133770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.621+0000 7ff5ca091700 1 -- 172.21.15.59:0/2108212566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5c40a0a30 msgr2=0x7ff5c4133cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.621+0000 7ff5ca091700 1 --2- 172.21.15.59:0/2108212566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5c40a0a30 0x7ff5c4133cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.621+0000 7ff5ca091700 1 -- 172.21.15.59:0/2108212566 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b40094a0 con 0x7ff5c4138d80 2023-09-30T22:36:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.621+0000 7ff5c908f700 1 --2- 172.21.15.59:0/2108212566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5c40a0a30 0x7ff5c4133cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:36:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.621+0000 7ff5ca091700 1 --2- 172.21.15.59:0/2108212566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5c4138d80 0x7ff5c41341f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc014040 tx=0x7ff5bc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.621+0000 7ff5ba7fc700 1 -- 172.21.15.59:0/2108212566 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc012430 con 0x7ff5c4138d80 2023-09-30T22:36:00.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.621+0000 7ff5ba7fc700 1 -- 172.21.15.59:0/2108212566 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc020070 con 0x7ff5c4138d80 2023-09-30T22:36:00.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.621+0000 7ff5cbaf4700 1 -- 172.21.15.59:0/2108212566 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5bc009a70 con 0x7ff5c4138d80 2023-09-30T22:36:00.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.621+0000 7ff5ba7fc700 1 -- 172.21.15.59:0/2108212566 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc004040 con 0x7ff5c4138d80 2023-09-30T22:36:00.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.621+0000 7ff5cbaf4700 1 -- 172.21.15.59:0/2108212566 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c40a0410 con 0x7ff5c4138d80 2023-09-30T22:36:00.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.622+0000 7ff5ba7fc700 1 -- 172.21.15.59:0/2108212566 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5bc0041a0 con 0x7ff5c4138d80 2023-09-30T22:36:00.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.622+0000 7ff5ba7fc700 1 -- 172.21.15.59:0/2108212566 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff5bc022070 con 0x7ff5c4138d80 2023-09-30T22:36:00.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.622+0000 7ff5cbaf4700 1 -- 172.21.15.59:0/2108212566 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c40747f0 con 0x7ff5c4138d80 2023-09-30T22:36:00.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.627+0000 7ff5ba7fc700 1 -- 172.21.15.59:0/2108212566 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5bc004450 con 0x7ff5c4138d80 2023-09-30T22:36:00.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.658+0000 7f92fa1ee700 1 Processor -- start 2023-09-30T22:36:00.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.658+0000 7f92fa1ee700 1 -- start start 2023-09-30T22:36:00.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92fa1ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92f4136820 0x7f92f4138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92fa1ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92f4139140 0x7f92f413b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92fa1ee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f406bc00 con 0x7f92f4133a80 2023-09-30T22:36:00.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92fa1ee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f406c570 con 0x7f92f4136820 2023-09-30T22:36:00.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92fa1ee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40a0040 con 0x7f92f4139140 2023-09-30T22:36:00.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92f3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92f4139140 0x7f92f413b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92f37fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f92f4133a80 0x7f92f4133e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57126/0 (socket says 172.21.15.59:57126) 2023-09-30T22:36:00.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92f37fe700 1 -- 172.21.15.59:0/2029293231 learned_addr learned my addr 172.21.15.59:0/2029293231 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92f2ffd700 1 --2- 172.21.15.59:0/2029293231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92f4136820 0x7f92f4138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92f27fc700 1 -- 172.21.15.59:0/2029293231 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588309234 0 0) 0x7f92f406bc00 con 0x7f92f4133a80 2023-09-30T22:36:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92f2ffd700 1 -- 172.21.15.59:0/2029293231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92f4139140 msgr2=0x7f92f413b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92f2ffd700 1 --2- 172.21.15.59:0/2029293231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92f4139140 0x7f92f413b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92f2ffd700 1 -- 172.21.15.59:0/2029293231 >> v1:172.21.15.59:6789/0 conn(0x7f92f4133a80 legacy=0x7f92f4133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92f2ffd700 1 -- 172.21.15.59:0/2029293231 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f4133860 con 0x7f92f4136820 2023-09-30T22:36:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92f3fff700 1 --2- 172.21.15.59:0/2029293231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92f4139140 0x7f92f413b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.659+0000 7f92f2ffd700 1 --2- 172.21.15.59:0/2029293231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92f4136820 0x7f92f4138c00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f92e8009870 tx=0x7f92e8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83fa018b1510e619 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.660+0000 7f92f27fc700 1 -- 172.21.15.59:0/2029293231 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e8011830 con 0x7f92f4136820 2023-09-30T22:36:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.660+0000 7f92f27fc700 1 -- 172.21.15.59:0/2029293231 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e8011990 con 0x7f92f4136820 2023-09-30T22:36:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.660+0000 7f92f27fc700 1 -- 172.21.15.59:0/2029293231 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e8011d20 con 0x7f92f4136820 2023-09-30T22:36:00.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.660+0000 7f92fa1ee700 1 -- 172.21.15.59:0/2029293231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92f4136820 msgr2=0x7f92f4138c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.660+0000 7f92fa1ee700 1 --2- 172.21.15.59:0/2029293231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92f4136820 0x7f92f4138c00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f92e8009870 tx=0x7f92e8009b80 comp rx=0 tx=0).stop 2023-09-30T22:36:00.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.660+0000 7f92fa1ee700 1 -- 172.21.15.59:0/2029293231 shutdown_connections 2023-09-30T22:36:00.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.660+0000 7f92fa1ee700 1 --2- 172.21.15.59:0/2029293231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92f4139140 0x7f92f413b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.660+0000 7f92fa1ee700 1 --2- 172.21.15.59:0/2029293231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92f4136820 0x7f92f4138c00 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.660+0000 7f92fa1ee700 1 -- 172.21.15.59:0/2029293231 >> 172.21.15.59:0/2029293231 conn(0x7f92f40a4210 msgr2=0x7f92f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:00.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.660+0000 7f92fa1ee700 1 -- 172.21.15.59:0/2029293231 shutdown_connections 2023-09-30T22:36:00.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.660+0000 7f92fa1ee700 1 -- 172.21.15.59:0/2029293231 wait complete. 2023-09-30T22:36:00.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.662+0000 7f92fa1ee700 1 Processor -- start 2023-09-30T22:36:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.662+0000 7f92fa1ee700 1 -- start start 2023-09-30T22:36:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92fa1ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92f4133a80 0x7f92f412cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92fa1ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92f4136820 0x7f92f412d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92fa1ee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92f4139140 0x7f92f412d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92fa1ee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f409d9c0 con 0x7f92f4139140 2023-09-30T22:36:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92fa1ee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f409c8a0 con 0x7f92f4133a80 2023-09-30T22:36:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92fa1ee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92f412e6a0 con 0x7f92f4136820 2023-09-30T22:36:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92f3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92f4139140 0x7f92f412d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92f2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92f4136820 0x7f92f412d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92f2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92f4136820 0x7f92f412d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36146/0 (socket says 172.21.15.59:36146) 2023-09-30T22:36:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92f2ffd700 1 -- 172.21.15.59:0/2968856488 learned_addr learned my addr 172.21.15.59:0/2968856488 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92f37fe700 1 --2- 172.21.15.59:0/2968856488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92f4133a80 0x7f92f412cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92f3fff700 1 -- 172.21.15.59:0/2968856488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92f4136820 msgr2=0x7f92f412d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92f3fff700 1 --2- 172.21.15.59:0/2968856488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92f4136820 0x7f92f412d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92f3fff700 1 -- 172.21.15.59:0/2968856488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92f4133a80 msgr2=0x7f92f412cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92f3fff700 1 --2- 172.21.15.59:0/2968856488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92f4133a80 0x7f92f412cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92f3fff700 1 -- 172.21.15.59:0/2968856488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec009a70 con 0x7f92f4139140 2023-09-30T22:36:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92f2ffd700 1 --2- 172.21.15.59:0/2968856488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92f4136820 0x7f92f412d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92f37fe700 1 --2- 172.21.15.59:0/2968856488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92f4133a80 0x7f92f412cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:00.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.663+0000 7f92f3fff700 1 --2- 172.21.15.59:0/2968856488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92f4139140 0x7f92f412d7f0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f92f409aa90 tx=0x7f92ec00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:00.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.664+0000 7f92dbfff700 1 -- 172.21.15.59:0/2968856488 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec003a20 con 0x7f92f4139140 2023-09-30T22:36:00.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.664+0000 7f92dbfff700 1 -- 172.21.15.59:0/2968856488 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec00f040 con 0x7f92f4139140 2023-09-30T22:36:00.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.664+0000 7f92fa1ee700 1 -- 172.21.15.59:0/2968856488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e80094a0 con 0x7f92f4139140 2023-09-30T22:36:00.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.664+0000 7f92dbfff700 1 -- 172.21.15.59:0/2968856488 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec003dc0 con 0x7f92f4139140 2023-09-30T22:36:00.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.664+0000 7f92fa1ee700 1 -- 172.21.15.59:0/2968856488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f409df20 con 0x7f92f4139140 2023-09-30T22:36:00.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.665+0000 7f92dbfff700 1 -- 172.21.15.59:0/2968856488 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92ec00ca20 con 0x7f92f4139140 2023-09-30T22:36:00.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.665+0000 7f92fa1ee700 1 -- 172.21.15.59:0/2968856488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f409db90 con 0x7f92f4139140 2023-09-30T22:36:00.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.665+0000 7f92dbfff700 1 -- 172.21.15.59:0/2968856488 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f92ec03fee0 con 0x7f92f4139140 2023-09-30T22:36:00.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.670+0000 7f92dbfff700 1 -- 172.21.15.59:0/2968856488 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92ec01b360 con 0x7f92f4139140 2023-09-30T22:36:00.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.837+0000 7ff5cbaf4700 1 -- 172.21.15.59:0/2108212566 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff5c4072980 con 0x7ff5c4138d80 2023-09-30T22:36:00.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.838+0000 7ff5ba7fc700 1 -- 172.21.15.59:0/2108212566 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5bc036090 con 0x7ff5c4138d80 2023-09-30T22:36:00.838 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.840+0000 7ff5cbaf4700 1 -- 172.21.15.59:0/2108212566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5c4138d80 msgr2=0x7ff5c41341f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.840+0000 7ff5cbaf4700 1 --2- 172.21.15.59:0/2108212566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5c4138d80 0x7ff5c41341f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc014040 tx=0x7ff5bc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.840+0000 7ff5cbaf4700 1 -- 172.21.15.59:0/2108212566 shutdown_connections 2023-09-30T22:36:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.840+0000 7ff5cbaf4700 1 --2- 172.21.15.59:0/2108212566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5c4138d80 0x7ff5c41341f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.840+0000 7ff5cbaf4700 1 --2- 172.21.15.59:0/2108212566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5c409d630 0x7ff5c4133770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.840+0000 7ff5cbaf4700 1 --2- 172.21.15.59:0/2108212566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5c40a0a30 0x7ff5c4133cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.840+0000 7ff5cbaf4700 1 -- 172.21.15.59:0/2108212566 >> 172.21.15.59:0/2108212566 conn(0x7ff5c40a3050 msgr2=0x7ff5c40a4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.840+0000 7ff5cbaf4700 1 -- 172.21.15.59:0/2108212566 shutdown_connections 2023-09-30T22:36:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.840+0000 7ff5cbaf4700 1 -- 172.21.15.59:0/2108212566 wait complete. 2023-09-30T22:36:00.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:00.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.875+0000 7f92fa1ee700 1 -- 172.21.15.59:0/2968856488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f92f4074ea0 con 0x7f92f4139140 2023-09-30T22:36:00.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.876+0000 7f92dbfff700 1 -- 172.21.15.59:0/2968856488 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92ec01cba0 con 0x7f92f4139140 2023-09-30T22:36:00.876 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:00.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.878+0000 7f92fa1ee700 1 -- 172.21.15.59:0/2968856488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92f4139140 msgr2=0x7f92f412d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:00.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.878+0000 7f92fa1ee700 1 --2- 172.21.15.59:0/2968856488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92f4139140 0x7f92f412d7f0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f92f409aa90 tx=0x7f92ec00ef90 comp rx=0 tx=0).stop 2023-09-30T22:36:00.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.878+0000 7f92fa1ee700 1 -- 172.21.15.59:0/2968856488 shutdown_connections 2023-09-30T22:36:00.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.878+0000 7f92fa1ee700 1 --2- 172.21.15.59:0/2968856488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92f4139140 0x7f92f412d7f0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.878+0000 7f92fa1ee700 1 --2- 172.21.15.59:0/2968856488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92f4133a80 0x7f92f412cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.878+0000 7f92fa1ee700 1 --2- 172.21.15.59:0/2968856488 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92f4136820 0x7f92f412d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:00.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.878+0000 7f92fa1ee700 1 -- 172.21.15.59:0/2968856488 >> 172.21.15.59:0/2968856488 conn(0x7f92f40a4210 msgr2=0x7f92f4137450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:00.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.878+0000 7f92fa1ee700 1 -- 172.21.15.59:0/2968856488 shutdown_connections 2023-09-30T22:36:00.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:00.879+0000 7f92fa1ee700 1 -- 172.21.15.59:0/2968856488 wait complete. 2023-09-30T22:36:00.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:01.402 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:01.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:01.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.553+0000 7fa0de368700 1 Processor -- start 2023-09-30T22:36:01.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.553+0000 7fa0de368700 1 -- start start 2023-09-30T22:36:01.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.553+0000 7fa0de368700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d80a0a30 0x7fa0d80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:01.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.553+0000 7fa0de368700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa0d80a1340 0x7fa0d8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.553+0000 7fa0de368700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d809edd0 con 0x7fa0d8133fa0 2023-09-30T22:36:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.553+0000 7fa0de368700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d809e1f0 con 0x7fa0d80a1340 2023-09-30T22:36:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.553+0000 7fa0de368700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d809dc50 con 0x7fa0d80a0a30 2023-09-30T22:36:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.554+0000 7fa0d7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d80a0a30 0x7fa0d80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.554+0000 7fa0d77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa0d80a1340 0x7fa0d8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.554+0000 7fa0d7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d80a0a30 0x7fa0d80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39566/0 (socket says 172.21.15.59:39566) 2023-09-30T22:36:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.554+0000 7fa0d7fff700 1 -- 172.21.15.59:0/499548843 learned_addr learned my addr 172.21.15.59:0/499548843 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.554+0000 7fa0d7fff700 1 -- 172.21.15.59:0/499548843 >> v2:172.21.15.59:3300/0 conn(0x7fa0d80a1340 msgr2=0x7fa0d8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.554+0000 7fa0d7fff700 1 --2- 172.21.15.59:0/499548843 >> v2:172.21.15.59:3300/0 conn(0x7fa0d80a1340 0x7fa0d8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.554+0000 7fa0d7fff700 1 -- 172.21.15.59:0/499548843 >> v1:172.21.15.59:6789/0 conn(0x7fa0d8133fa0 legacy=0x7fa0d813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.554+0000 7fa0d7fff700 1 -- 172.21.15.59:0/499548843 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d80a1fe0 con 0x7fa0d80a0a30 2023-09-30T22:36:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.554+0000 7fa0d77fe700 1 --2- 172.21.15.59:0/499548843 >> v2:172.21.15.59:3300/0 conn(0x7fa0d80a1340 0x7fa0d8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.554+0000 7fa0d7fff700 1 --2- 172.21.15.59:0/499548843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d80a0a30 0x7fa0d80a0e00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80098f0 tx=0x7fa0c8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dffce5b328ae9c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.554+0000 7fa0d6ffd700 1 -- 172.21.15.59:0/499548843 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8011830 con 0x7fa0d80a0a30 2023-09-30T22:36:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.554+0000 7fa0d6ffd700 1 -- 172.21.15.59:0/499548843 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c8011990 con 0x7fa0d80a0a30 2023-09-30T22:36:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.554+0000 7fa0d6ffd700 1 -- 172.21.15.59:0/499548843 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8011d20 con 0x7fa0d80a0a30 2023-09-30T22:36:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.555+0000 7fa0de368700 1 -- 172.21.15.59:0/499548843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d80a0a30 msgr2=0x7fa0d80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.555+0000 7fa0de368700 1 --2- 172.21.15.59:0/499548843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d80a0a30 0x7fa0d80a0e00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80098f0 tx=0x7fa0c8009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.555+0000 7fa0de368700 1 -- 172.21.15.59:0/499548843 shutdown_connections 2023-09-30T22:36:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.555+0000 7fa0de368700 1 --2- 172.21.15.59:0/499548843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d80a0a30 0x7fa0d80a0e00 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.555+0000 7fa0de368700 1 --2- 172.21.15.59:0/499548843 >> v2:172.21.15.59:3300/0 conn(0x7fa0d80a1340 0x7fa0d8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.555+0000 7fa0de368700 1 -- 172.21.15.59:0/499548843 >> 172.21.15.59:0/499548843 conn(0x7fa0d80a6550 msgr2=0x7fa0d80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.555+0000 7fa0de368700 1 -- 172.21.15.59:0/499548843 shutdown_connections 2023-09-30T22:36:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.555+0000 7fa0de368700 1 -- 172.21.15.59:0/499548843 wait complete. 2023-09-30T22:36:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.556+0000 7fa0de368700 1 Processor -- start 2023-09-30T22:36:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.556+0000 7fa0de368700 1 -- start start 2023-09-30T22:36:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0de368700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d80a0a30 0x7fa0d811e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0de368700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d80a1340 0x7fa0d811ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0de368700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0d8133fa0 0x7fa0d811f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0de368700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d8121f50 con 0x7fa0d80a1340 2023-09-30T22:36:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0de368700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d8120430 con 0x7fa0d80a0a30 2023-09-30T22:36:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0de368700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d80a37e0 con 0x7fa0d8133fa0 2023-09-30T22:36:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0d77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d80a1340 0x7fa0d811ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0d77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d80a1340 0x7fa0d811ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52516/0 (socket says 172.21.15.59:52516) 2023-09-30T22:36:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0d77fe700 1 -- 172.21.15.59:0/170914748 learned_addr learned my addr 172.21.15.59:0/170914748 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0d7fff700 1 --2- 172.21.15.59:0/170914748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d80a0a30 0x7fa0d811e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0dc905700 1 --2- 172.21.15.59:0/170914748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0d8133fa0 0x7fa0d811f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0d77fe700 1 -- 172.21.15.59:0/170914748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0d8133fa0 msgr2=0x7fa0d811f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0d77fe700 1 --2- 172.21.15.59:0/170914748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0d8133fa0 0x7fa0d811f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0d77fe700 1 -- 172.21.15.59:0/170914748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d80a0a30 msgr2=0x7fa0d811e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0d77fe700 1 --2- 172.21.15.59:0/170914748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d80a0a30 0x7fa0d811e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0d77fe700 1 -- 172.21.15.59:0/170914748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc0094a0 con 0x7fa0d80a1340 2023-09-30T22:36:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.557+0000 7fa0d7fff700 1 --2- 172.21.15.59:0/170914748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d80a0a30 0x7fa0d811e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.558+0000 7fa0d77fe700 1 --2- 172.21.15.59:0/170914748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d80a1340 0x7fa0d811ece0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00ebe0 tx=0x7fa0cc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.558+0000 7fa0d4ff9700 1 -- 172.21.15.59:0/170914748 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc00c850 con 0x7fa0d80a1340 2023-09-30T22:36:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.558+0000 7fa0d4ff9700 1 -- 172.21.15.59:0/170914748 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc00c9b0 con 0x7fa0d80a1340 2023-09-30T22:36:01.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.558+0000 7fa0de368700 1 -- 172.21.15.59:0/170914748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c8009550 con 0x7fa0d80a1340 2023-09-30T22:36:01.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.558+0000 7fa0d4ff9700 1 -- 172.21.15.59:0/170914748 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc00cd40 con 0x7fa0d80a1340 2023-09-30T22:36:01.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.558+0000 7fa0de368700 1 -- 172.21.15.59:0/170914748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d80a0270 con 0x7fa0d80a1340 2023-09-30T22:36:01.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.559+0000 7fa0d4ff9700 1 -- 172.21.15.59:0/170914748 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa0cc013470 con 0x7fa0d80a1340 2023-09-30T22:36:01.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.559+0000 7fa0d4ff9700 1 -- 172.21.15.59:0/170914748 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa0cc03fb30 con 0x7fa0d80a1340 2023-09-30T22:36:01.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.559+0000 7fa0de368700 1 -- 172.21.15.59:0/170914748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d8122a80 con 0x7fa0d80a1340 2023-09-30T22:36:01.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.564+0000 7fa0d4ff9700 1 -- 172.21.15.59:0/170914748 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0cc013720 con 0x7fa0d80a1340 2023-09-30T22:36:01.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.588+0000 7fb423994700 1 Processor -- start 2023-09-30T22:36:01.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.588+0000 7fb423994700 1 -- start start 2023-09-30T22:36:01.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.589+0000 7fb423994700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41c0a0a30 0x7fb41c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:01.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.589+0000 7fb423994700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb41c138d80 0x7fb41c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.589+0000 7fb423994700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41c0a2a70 con 0x7fb41c09d630 2023-09-30T22:36:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.589+0000 7fb423994700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c0a01d0 con 0x7fb41c0a0a30 2023-09-30T22:36:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.589+0000 7fb423994700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c09e2b0 con 0x7fb41c138d80 2023-09-30T22:36:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.589+0000 7fb420f2f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb41c09d630 0x7fb41c0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57152/0 (socket says 172.21.15.59:57152) 2023-09-30T22:36:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.589+0000 7fb420f2f700 1 -- 172.21.15.59:0/1140596112 learned_addr learned my addr 172.21.15.59:0/1140596112 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.589+0000 7fb421f31700 1 --2- 172.21.15.59:0/1140596112 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb41c138d80 0x7fb41c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.589+0000 7fb421730700 1 --2- 172.21.15.59:0/1140596112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41c0a0a30 0x7fb41c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.590+0000 7fb413fff700 1 -- 172.21.15.59:0/1140596112 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233670729 0 0) 0x7fb41c0a2a70 con 0x7fb41c09d630 2023-09-30T22:36:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.590+0000 7fb413fff700 1 -- 172.21.15.59:0/1140596112 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4080035b0 con 0x7fb41c09d630 2023-09-30T22:36:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.590+0000 7fb421730700 1 -- 172.21.15.59:0/1140596112 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb41c138d80 msgr2=0x7fb41c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.590+0000 7fb421730700 1 --2- 172.21.15.59:0/1140596112 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb41c138d80 0x7fb41c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.590+0000 7fb421730700 1 -- 172.21.15.59:0/1140596112 >> v1:172.21.15.59:6789/0 conn(0x7fb41c09d630 legacy=0x7fb41c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.590+0000 7fb421730700 1 -- 172.21.15.59:0/1140596112 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c09dc50 con 0x7fb41c0a0a30 2023-09-30T22:36:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.590+0000 7fb421f31700 1 --2- 172.21.15.59:0/1140596112 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb41c138d80 0x7fb41c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.590+0000 7fb421730700 1 --2- 172.21.15.59:0/1140596112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41c0a0a30 0x7fb41c0a0e00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb418009870 tx=0x7fb418009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26527fb74b343a81 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.590+0000 7fb413fff700 1 -- 172.21.15.59:0/1140596112 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418011830 con 0x7fb41c0a0a30 2023-09-30T22:36:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.590+0000 7fb413fff700 1 -- 172.21.15.59:0/1140596112 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb418011990 con 0x7fb41c0a0a30 2023-09-30T22:36:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.590+0000 7fb413fff700 1 -- 172.21.15.59:0/1140596112 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418011d20 con 0x7fb41c0a0a30 2023-09-30T22:36:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.591+0000 7fb423994700 1 -- 172.21.15.59:0/1140596112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41c0a0a30 msgr2=0x7fb41c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.591+0000 7fb423994700 1 --2- 172.21.15.59:0/1140596112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41c0a0a30 0x7fb41c0a0e00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb418009870 tx=0x7fb418009b80 comp rx=0 tx=0).stop 2023-09-30T22:36:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.591+0000 7fb423994700 1 -- 172.21.15.59:0/1140596112 shutdown_connections 2023-09-30T22:36:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.591+0000 7fb423994700 1 --2- 172.21.15.59:0/1140596112 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb41c138d80 0x7fb41c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.591+0000 7fb423994700 1 --2- 172.21.15.59:0/1140596112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41c0a0a30 0x7fb41c0a0e00 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.591+0000 7fb423994700 1 -- 172.21.15.59:0/1140596112 >> 172.21.15.59:0/1140596112 conn(0x7fb41c0a3050 msgr2=0x7fb41c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.591+0000 7fb423994700 1 -- 172.21.15.59:0/1140596112 shutdown_connections 2023-09-30T22:36:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.591+0000 7fb423994700 1 -- 172.21.15.59:0/1140596112 wait complete. 2023-09-30T22:36:01.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.592+0000 7fb423994700 1 Processor -- start 2023-09-30T22:36:01.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.592+0000 7fb423994700 1 -- start start 2023-09-30T22:36:01.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb423994700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb41c09d630 0x7fb41c133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb423994700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41c0a0a30 0x7fb41c133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb423994700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41c138d80 0x7fb41c1341e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb423994700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c1365a0 con 0x7fb41c0a0a30 2023-09-30T22:36:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb423994700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c138b10 con 0x7fb41c138d80 2023-09-30T22:36:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb423994700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c136f10 con 0x7fb41c09d630 2023-09-30T22:36:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb421730700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb41c09d630 0x7fb41c133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb420f2f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41c0a0a30 0x7fb41c133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb421730700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb41c09d630 0x7fb41c133760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36168/0 (socket says 172.21.15.59:36168) 2023-09-30T22:36:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb420f2f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41c0a0a30 0x7fb41c133ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52524/0 (socket says 172.21.15.59:52524) 2023-09-30T22:36:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb421730700 1 -- 172.21.15.59:0/4132049737 learned_addr learned my addr 172.21.15.59:0/4132049737 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb421f31700 1 --2- 172.21.15.59:0/4132049737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41c138d80 0x7fb41c1341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb421730700 1 -- 172.21.15.59:0/4132049737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41c138d80 msgr2=0x7fb41c1341e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb421730700 1 --2- 172.21.15.59:0/4132049737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41c138d80 0x7fb41c1341e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb421730700 1 -- 172.21.15.59:0/4132049737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41c0a0a30 msgr2=0x7fb41c133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb421730700 1 --2- 172.21.15.59:0/4132049737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41c0a0a30 0x7fb41c133ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb421730700 1 -- 172.21.15.59:0/4132049737 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb414009a70 con 0x7fb41c09d630 2023-09-30T22:36:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.593+0000 7fb420f2f700 1 --2- 172.21.15.59:0/4132049737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41c0a0a30 0x7fb41c133ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.594+0000 7fb421730700 1 --2- 172.21.15.59:0/4132049737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb41c09d630 0x7fb41c133760 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb418000c00 tx=0x7fb418004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.594+0000 7fb411ffb700 1 -- 172.21.15.59:0/4132049737 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418004240 con 0x7fb41c09d630 2023-09-30T22:36:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.594+0000 7fb411ffb700 1 -- 172.21.15.59:0/4132049737 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41801f070 con 0x7fb41c09d630 2023-09-30T22:36:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.594+0000 7fb423994700 1 -- 172.21.15.59:0/4132049737 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4180094a0 con 0x7fb41c09d630 2023-09-30T22:36:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.594+0000 7fb411ffb700 1 -- 172.21.15.59:0/4132049737 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4180036a0 con 0x7fb41c09d630 2023-09-30T22:36:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.594+0000 7fb423994700 1 -- 172.21.15.59:0/4132049737 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41c1371f0 con 0x7fb41c09d630 2023-09-30T22:36:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.595+0000 7fb411ffb700 1 -- 172.21.15.59:0/4132049737 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb418021030 con 0x7fb41c09d630 2023-09-30T22:36:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.595+0000 7fb411ffb700 1 -- 172.21.15.59:0/4132049737 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb418040550 con 0x7fb41c09d630 2023-09-30T22:36:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.595+0000 7fb423994700 1 -- 172.21.15.59:0/4132049737 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41c137050 con 0x7fb41c09d630 2023-09-30T22:36:01.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.600+0000 7fb411ffb700 1 -- 172.21.15.59:0/4132049737 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb41c137050 con 0x7fb41c09d630 2023-09-30T22:36:01.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.774+0000 7fa0de368700 1 -- 172.21.15.59:0/170914748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa0d8074ea0 con 0x7fa0d80a1340 2023-09-30T22:36:01.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.774+0000 7fa0d4ff9700 1 -- 172.21.15.59:0/170914748 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa0cc017020 con 0x7fa0d80a1340 2023-09-30T22:36:01.775 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.776+0000 7fa0de368700 1 -- 172.21.15.59:0/170914748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d80a1340 msgr2=0x7fa0d811ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:01.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.776+0000 7fa0de368700 1 --2- 172.21.15.59:0/170914748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d80a1340 0x7fa0d811ece0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00ebe0 tx=0x7fa0cc00eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.776+0000 7fa0de368700 1 -- 172.21.15.59:0/170914748 shutdown_connections 2023-09-30T22:36:01.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.776+0000 7fa0de368700 1 --2- 172.21.15.59:0/170914748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0d8133fa0 0x7fa0d811f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.776+0000 7fa0de368700 1 --2- 172.21.15.59:0/170914748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d80a0a30 0x7fa0d811e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.776+0000 7fa0de368700 1 --2- 172.21.15.59:0/170914748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d80a1340 0x7fa0d811ece0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.776+0000 7fa0de368700 1 -- 172.21.15.59:0/170914748 >> 172.21.15.59:0/170914748 conn(0x7fa0d80a6550 msgr2=0x7fa0d81b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:01.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.776+0000 7fa0de368700 1 -- 172.21.15.59:0/170914748 shutdown_connections 2023-09-30T22:36:01.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.776+0000 7fa0de368700 1 -- 172.21.15.59:0/170914748 wait complete. 2023-09-30T22:36:01.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:01.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.808+0000 7fb423994700 1 -- 172.21.15.59:0/4132049737 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb41c137050 con 0x7fb41c09d630 2023-09-30T22:36:01.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.809+0000 7fb411ffb700 1 -- 172.21.15.59:0/4132049737 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb41c137050 con 0x7fb41c09d630 2023-09-30T22:36:01.809 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:01.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.811+0000 7fb423994700 1 -- 172.21.15.59:0/4132049737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb41c09d630 msgr2=0x7fb41c133760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:01.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.811+0000 7fb423994700 1 --2- 172.21.15.59:0/4132049737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb41c09d630 0x7fb41c133760 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb418000c00 tx=0x7fb418004750 comp rx=0 tx=0).stop 2023-09-30T22:36:01.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.811+0000 7fb423994700 1 -- 172.21.15.59:0/4132049737 shutdown_connections 2023-09-30T22:36:01.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.811+0000 7fb423994700 1 --2- 172.21.15.59:0/4132049737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb41c09d630 0x7fb41c133760 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.811+0000 7fb423994700 1 --2- 172.21.15.59:0/4132049737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb41c138d80 0x7fb41c1341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.811+0000 7fb423994700 1 --2- 172.21.15.59:0/4132049737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41c0a0a30 0x7fb41c133ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:01.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.811+0000 7fb423994700 1 -- 172.21.15.59:0/4132049737 >> 172.21.15.59:0/4132049737 conn(0x7fb41c0a3050 msgr2=0x7fb41c13ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:01.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.811+0000 7fb423994700 1 -- 172.21.15.59:0/4132049737 shutdown_connections 2023-09-30T22:36:01.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:01.811+0000 7fb423994700 1 -- 172.21.15.59:0/4132049737 wait complete. 2023-09-30T22:36:01.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:01.856 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:01.894 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.006+0000 7f208d5be700 1 Processor -- start 2023-09-30T22:36:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.006+0000 7f208d5be700 1 -- start start 2023-09-30T22:36:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.006+0000 7f208d5be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20880a09c0 0x7f20880a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.007+0000 7f208d5be700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f208809d5c0 0x7f20880a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.007+0000 7f208d5be700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20880a1810 con 0x7f2088133920 2023-09-30T22:36:02.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.007+0000 7f208d5be700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f208809ea10 con 0x7f208809d5c0 2023-09-30T22:36:02.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.007+0000 7f208d5be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208809e210 con 0x7f20880a09c0 2023-09-30T22:36:02.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.007+0000 7f20867fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f208809d5c0 0x7f20880a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.007+0000 7f2086ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20880a09c0 0x7f20880a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.007+0000 7f20867fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f208809d5c0 0x7f20880a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52536/0 (socket says 172.21.15.59:52536) 2023-09-30T22:36:02.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.007+0000 7f20867fc700 1 -- 172.21.15.59:0/540277795 learned_addr learned my addr 172.21.15.59:0/540277795 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:02.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.007+0000 7f2086ffd700 1 -- 172.21.15.59:0/540277795 >> v2:172.21.15.59:3300/0 conn(0x7f208809d5c0 msgr2=0x7f20880a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:02.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.007+0000 7f2086ffd700 1 --2- 172.21.15.59:0/540277795 >> v2:172.21.15.59:3300/0 conn(0x7f208809d5c0 0x7f20880a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.007+0000 7f2086ffd700 1 -- 172.21.15.59:0/540277795 >> v1:172.21.15.59:6789/0 conn(0x7f2088133920 legacy=0x7f2088133da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.007+0000 7f2086ffd700 1 -- 172.21.15.59:0/540277795 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880a26f0 con 0x7f20880a09c0 2023-09-30T22:36:02.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.007+0000 7f20867fc700 1 --2- 172.21.15.59:0/540277795 >> v2:172.21.15.59:3300/0 conn(0x7f208809d5c0 0x7f20880a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:02.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.007+0000 7f2086ffd700 1 --2- 172.21.15.59:0/540277795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20880a09c0 0x7f20880a0d90 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2078009d90 tx=0x7f207800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3772acc3b5c7e6d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:02.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.008+0000 7f2085ffb700 1 -- 172.21.15.59:0/540277795 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207800e070 con 0x7f20880a09c0 2023-09-30T22:36:02.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.008+0000 7f2085ffb700 1 -- 172.21.15.59:0/540277795 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207800bb20 con 0x7f20880a09c0 2023-09-30T22:36:02.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.008+0000 7f2085ffb700 1 -- 172.21.15.59:0/540277795 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2078012430 con 0x7f20880a09c0 2023-09-30T22:36:02.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.008+0000 7f208d5be700 1 -- 172.21.15.59:0/540277795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20880a09c0 msgr2=0x7f20880a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.008+0000 7f208d5be700 1 --2- 172.21.15.59:0/540277795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20880a09c0 0x7f20880a0d90 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2078009d90 tx=0x7f207800b330 comp rx=0 tx=0).stop 2023-09-30T22:36:02.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.008+0000 7f208d5be700 1 -- 172.21.15.59:0/540277795 shutdown_connections 2023-09-30T22:36:02.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.008+0000 7f208d5be700 1 --2- 172.21.15.59:0/540277795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20880a09c0 0x7f20880a0d90 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.008+0000 7f208d5be700 1 --2- 172.21.15.59:0/540277795 >> v2:172.21.15.59:3300/0 conn(0x7f208809d5c0 0x7f20880a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.008+0000 7f208d5be700 1 -- 172.21.15.59:0/540277795 >> 172.21.15.59:0/540277795 conn(0x7f20880a2fe0 msgr2=0x7f20880a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:02.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.008+0000 7f208d5be700 1 -- 172.21.15.59:0/540277795 shutdown_connections 2023-09-30T22:36:02.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.008+0000 7f208d5be700 1 -- 172.21.15.59:0/540277795 wait complete. 2023-09-30T22:36:02.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.010+0000 7f208d5be700 1 Processor -- start 2023-09-30T22:36:02.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.010+0000 7f208d5be700 1 -- start start 2023-09-30T22:36:02.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.010+0000 7f208d5be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f208809d5c0 0x7f208811f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.010+0000 7f208d5be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20880a09c0 0x7f208811fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.010+0000 7f208d5be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2088133920 0x7f20881c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.010+0000 7f208d5be700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20881225e0 con 0x7f2088133920 2023-09-30T22:36:02.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.010+0000 7f208d5be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208811eec0 con 0x7f20880a09c0 2023-09-30T22:36:02.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.010+0000 7f208d5be700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20881205d0 con 0x7f208809d5c0 2023-09-30T22:36:02.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.010+0000 7f20867fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20880a09c0 0x7f208811fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.010+0000 7f2086ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f208809d5c0 0x7f208811f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.010+0000 7f20867fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20880a09c0 0x7f208811fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39632/0 (socket says 172.21.15.59:39632) 2023-09-30T22:36:02.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.010+0000 7f20867fc700 1 -- 172.21.15.59:0/95643886 learned_addr learned my addr 172.21.15.59:0/95643886 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:02.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.010+0000 7f20877fe700 1 --2- 172.21.15.59:0/95643886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2088133920 0x7f20881c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.011+0000 7f20867fc700 1 -- 172.21.15.59:0/95643886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f208809d5c0 msgr2=0x7f208811f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.011+0000 7f20867fc700 1 --2- 172.21.15.59:0/95643886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f208809d5c0 0x7f208811f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.011+0000 7f20867fc700 1 -- 172.21.15.59:0/95643886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2088133920 msgr2=0x7f20881c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.011+0000 7f20867fc700 1 --2- 172.21.15.59:0/95643886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2088133920 0x7f20881c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.011+0000 7f20867fc700 1 -- 172.21.15.59:0/95643886 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2070009550 con 0x7f20880a09c0 2023-09-30T22:36:02.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.011+0000 7f20877fe700 1 --2- 172.21.15.59:0/95643886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2088133920 0x7f20881c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:02.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.011+0000 7f2086ffd700 1 --2- 172.21.15.59:0/95643886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f208809d5c0 0x7f208811f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:02.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.011+0000 7f20867fc700 1 --2- 172.21.15.59:0/95643886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20880a09c0 0x7f208811fa50 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f207000ebe0 tx=0x7f207000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:02.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.011+0000 7f207f7fe700 1 -- 172.21.15.59:0/95643886 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207000c850 con 0x7f20880a09c0 2023-09-30T22:36:02.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.011+0000 7f207f7fe700 1 -- 172.21.15.59:0/95643886 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207000c9b0 con 0x7f20880a09c0 2023-09-30T22:36:02.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.011+0000 7f208d5be700 1 -- 172.21.15.59:0/95643886 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2078009a70 con 0x7f20880a09c0 2023-09-30T22:36:02.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.011+0000 7f207f7fe700 1 -- 172.21.15.59:0/95643886 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207000cd60 con 0x7f20880a09c0 2023-09-30T22:36:02.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.011+0000 7f208d5be700 1 -- 172.21.15.59:0/95643886 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208809cec0 con 0x7f20880a09c0 2023-09-30T22:36:02.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.012+0000 7f208d5be700 1 -- 172.21.15.59:0/95643886 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20880747f0 con 0x7f20880a09c0 2023-09-30T22:36:02.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.013+0000 7f207f7fe700 1 -- 172.21.15.59:0/95643886 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2070013470 con 0x7f20880a09c0 2023-09-30T22:36:02.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.013+0000 7f207f7fe700 1 -- 172.21.15.59:0/95643886 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f20700401a0 con 0x7f20880a09c0 2023-09-30T22:36:02.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.017+0000 7f207f7fe700 1 -- 172.21.15.59:0/95643886 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2070024760 con 0x7f20880a09c0 2023-09-30T22:36:02.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.049+0000 7fb8ba69c700 1 Processor -- start 2023-09-30T22:36:02.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.049+0000 7fb8ba69c700 1 -- start start 2023-09-30T22:36:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.049+0000 7fb8ba69c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b40a0a30 0x7fb8b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.049+0000 7fb8ba69c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b409d630 0x7fb8b40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.049+0000 7fb8ba69c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b40a2a70 con 0x7fb8b4133930 2023-09-30T22:36:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.049+0000 7fb8ba69c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40a01d0 con 0x7fb8b409d630 2023-09-30T22:36:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.049+0000 7fb8ba69c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b409e2b0 con 0x7fb8b40a0a30 2023-09-30T22:36:02.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.050+0000 7fb8b37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b409d630 0x7fb8b40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.050+0000 7fb8b8c39700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb8b4133930 0x7fb8b4133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57172/0 (socket says 172.21.15.59:57172) 2023-09-30T22:36:02.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.050+0000 7fb8b8c39700 1 -- 172.21.15.59:0/339459075 learned_addr learned my addr 172.21.15.59:0/339459075 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:02.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.050+0000 7fb8b3fff700 1 --2- 172.21.15.59:0/339459075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b40a0a30 0x7fb8b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.050+0000 7fb8b2ffd700 1 -- 172.21.15.59:0/339459075 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652554795 0 0) 0x7fb8b40a2a70 con 0x7fb8b4133930 2023-09-30T22:36:02.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.050+0000 7fb8b37fe700 1 -- 172.21.15.59:0/339459075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b40a0a30 msgr2=0x7fb8b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:02.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.050+0000 7fb8b37fe700 1 --2- 172.21.15.59:0/339459075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b40a0a30 0x7fb8b40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.050+0000 7fb8b37fe700 1 -- 172.21.15.59:0/339459075 >> v1:172.21.15.59:6789/0 conn(0x7fb8b4133930 legacy=0x7fb8b4133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.050+0000 7fb8b37fe700 1 -- 172.21.15.59:0/339459075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b409dc50 con 0x7fb8b409d630 2023-09-30T22:36:02.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.050+0000 7fb8b37fe700 1 --2- 172.21.15.59:0/339459075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b409d630 0x7fb8b40a1340 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009870 tx=0x7fb8a8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724b0771ee813a6f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.050+0000 7fb8b2ffd700 1 -- 172.21.15.59:0/339459075 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8011830 con 0x7fb8b409d630 2023-09-30T22:36:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.050+0000 7fb8b2ffd700 1 -- 172.21.15.59:0/339459075 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a8011990 con 0x7fb8b409d630 2023-09-30T22:36:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.050+0000 7fb8b2ffd700 1 -- 172.21.15.59:0/339459075 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8011d20 con 0x7fb8b409d630 2023-09-30T22:36:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.051+0000 7fb8ba69c700 1 -- 172.21.15.59:0/339459075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b409d630 msgr2=0x7fb8b40a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.051+0000 7fb8ba69c700 1 --2- 172.21.15.59:0/339459075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b409d630 0x7fb8b40a1340 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009870 tx=0x7fb8a8009b80 comp rx=0 tx=0).stop 2023-09-30T22:36:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.051+0000 7fb8ba69c700 1 -- 172.21.15.59:0/339459075 shutdown_connections 2023-09-30T22:36:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.051+0000 7fb8ba69c700 1 --2- 172.21.15.59:0/339459075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b40a0a30 0x7fb8b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.051+0000 7fb8ba69c700 1 --2- 172.21.15.59:0/339459075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b409d630 0x7fb8b40a1340 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.051+0000 7fb8ba69c700 1 -- 172.21.15.59:0/339459075 >> 172.21.15.59:0/339459075 conn(0x7fb8b40a3050 msgr2=0x7fb8b40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.051+0000 7fb8ba69c700 1 -- 172.21.15.59:0/339459075 shutdown_connections 2023-09-30T22:36:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.051+0000 7fb8ba69c700 1 -- 172.21.15.59:0/339459075 wait complete. 2023-09-30T22:36:02.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.052+0000 7fb8ba69c700 1 Processor -- start 2023-09-30T22:36:02.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.052+0000 7fb8ba69c700 1 -- start start 2023-09-30T22:36:02.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8ba69c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b409d630 0x7fb8b41c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8ba69c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b40a0a30 0x7fb8b41c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8ba69c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b4133930 0x7fb8b41c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8ba69c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b4120630 con 0x7fb8b4133930 2023-09-30T22:36:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8ba69c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40a5410 con 0x7fb8b40a0a30 2023-09-30T22:36:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8ba69c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40a0410 con 0x7fb8b409d630 2023-09-30T22:36:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8b37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b40a0a30 0x7fb8b41c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8b8c39700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b4133930 0x7fb8b41c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8b37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b40a0a30 0x7fb8b41c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39642/0 (socket says 172.21.15.59:39642) 2023-09-30T22:36:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8b37fe700 1 -- 172.21.15.59:0/2060245007 learned_addr learned my addr 172.21.15.59:0/2060245007 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8b3fff700 1 --2- 172.21.15.59:0/2060245007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b409d630 0x7fb8b41c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8b37fe700 1 -- 172.21.15.59:0/2060245007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b409d630 msgr2=0x7fb8b41c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8b37fe700 1 --2- 172.21.15.59:0/2060245007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b409d630 0x7fb8b41c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8b37fe700 1 -- 172.21.15.59:0/2060245007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b4133930 msgr2=0x7fb8b41c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8b37fe700 1 --2- 172.21.15.59:0/2060245007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b4133930 0x7fb8b41c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8b37fe700 1 -- 172.21.15.59:0/2060245007 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a80094a0 con 0x7fb8b40a0a30 2023-09-30T22:36:02.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8b8c39700 1 --2- 172.21.15.59:0/2060245007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b4133930 0x7fb8b41c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:02.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.053+0000 7fb8b37fe700 1 --2- 172.21.15.59:0/2060245007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b40a0a30 0x7fb8b41c8530 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8013000 tx=0x7fb8a8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:02.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.054+0000 7fb8b0ff9700 1 -- 172.21.15.59:0/2060245007 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8004510 con 0x7fb8b40a0a30 2023-09-30T22:36:02.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.054+0000 7fb8b0ff9700 1 -- 172.21.15.59:0/2060245007 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a801f070 con 0x7fb8b40a0a30 2023-09-30T22:36:02.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.054+0000 7fb8ba69c700 1 -- 172.21.15.59:0/2060245007 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b4121fa0 con 0x7fb8b40a0a30 2023-09-30T22:36:02.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.054+0000 7fb8b0ff9700 1 -- 172.21.15.59:0/2060245007 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80038c0 con 0x7fb8b40a0a30 2023-09-30T22:36:02.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.054+0000 7fb8ba69c700 1 -- 172.21.15.59:0/2060245007 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b4122cb0 con 0x7fb8b40a0a30 2023-09-30T22:36:02.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.055+0000 7fb8b0ff9700 1 -- 172.21.15.59:0/2060245007 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8a8003a20 con 0x7fb8b40a0a30 2023-09-30T22:36:02.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.055+0000 7fb8b0ff9700 1 -- 172.21.15.59:0/2060245007 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb8a8021070 con 0x7fb8b40a0a30 2023-09-30T22:36:02.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.055+0000 7fb8ba69c700 1 -- 172.21.15.59:0/2060245007 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b41224a0 con 0x7fb8b40a0a30 2023-09-30T22:36:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.060+0000 7fb8b0ff9700 1 -- 172.21.15.59:0/2060245007 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8a8015020 con 0x7fb8b40a0a30 2023-09-30T22:36:02.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.223+0000 7f208d5be700 1 -- 172.21.15.59:0/95643886 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f20881223c0 con 0x7f20880a09c0 2023-09-30T22:36:02.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.224+0000 7f207f7fe700 1 -- 172.21.15.59:0/95643886 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2070017090 con 0x7f20880a09c0 2023-09-30T22:36:02.225 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:02.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.226+0000 7f208d5be700 1 -- 172.21.15.59:0/95643886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20880a09c0 msgr2=0x7f208811fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.226+0000 7f208d5be700 1 --2- 172.21.15.59:0/95643886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20880a09c0 0x7f208811fa50 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f207000ebe0 tx=0x7f207000eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.226+0000 7f208d5be700 1 -- 172.21.15.59:0/95643886 shutdown_connections 2023-09-30T22:36:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.226+0000 7f208d5be700 1 --2- 172.21.15.59:0/95643886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f208809d5c0 0x7f208811f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.226+0000 7f208d5be700 1 --2- 172.21.15.59:0/95643886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2088133920 0x7f20881c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.226+0000 7f208d5be700 1 --2- 172.21.15.59:0/95643886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20880a09c0 0x7f208811fa50 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.226+0000 7f208d5be700 1 -- 172.21.15.59:0/95643886 >> 172.21.15.59:0/95643886 conn(0x7f20880a2fe0 msgr2=0x7f20881bbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.226+0000 7f208d5be700 1 -- 172.21.15.59:0/95643886 shutdown_connections 2023-09-30T22:36:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.226+0000 7f208d5be700 1 -- 172.21.15.59:0/95643886 wait complete. 2023-09-30T22:36:02.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:02.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.265+0000 7fb8ba69c700 1 -- 172.21.15.59:0/2060245007 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb8b40a1800 con 0x7fb8b40a0a30 2023-09-30T22:36:02.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.265+0000 7fb8b0ff9700 1 -- 172.21.15.59:0/2060245007 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8a801a430 con 0x7fb8b40a0a30 2023-09-30T22:36:02.266 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:02.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.267+0000 7fb8ba69c700 1 -- 172.21.15.59:0/2060245007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b40a0a30 msgr2=0x7fb8b41c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.267+0000 7fb8ba69c700 1 --2- 172.21.15.59:0/2060245007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b40a0a30 0x7fb8b41c8530 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8013000 tx=0x7fb8a8004750 comp rx=0 tx=0).stop 2023-09-30T22:36:02.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.267+0000 7fb8ba69c700 1 -- 172.21.15.59:0/2060245007 shutdown_connections 2023-09-30T22:36:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.267+0000 7fb8ba69c700 1 --2- 172.21.15.59:0/2060245007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b409d630 0x7fb8b41c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.267+0000 7fb8ba69c700 1 --2- 172.21.15.59:0/2060245007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b4133930 0x7fb8b41c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.267+0000 7fb8ba69c700 1 --2- 172.21.15.59:0/2060245007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b40a0a30 0x7fb8b41c8530 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.267+0000 7fb8ba69c700 1 -- 172.21.15.59:0/2060245007 >> 172.21.15.59:0/2060245007 conn(0x7fb8b40a3050 msgr2=0x7fb8b41bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.267+0000 7fb8ba69c700 1 -- 172.21.15.59:0/2060245007 shutdown_connections 2023-09-30T22:36:02.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.267+0000 7fb8ba69c700 1 -- 172.21.15.59:0/2060245007 wait complete. 2023-09-30T22:36:02.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:02.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:02.826 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:02.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.940+0000 7fc26e987700 1 Processor -- start 2023-09-30T22:36:02.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.940+0000 7fc26e987700 1 -- start start 2023-09-30T22:36:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc26e987700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2680a0a30 0x7fc2680a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc26e987700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2680a1340 0x7fc268133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc26e987700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268133fa0 0x7fc268134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc26e987700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26809edd0 con 0x7fc2680a1340 2023-09-30T22:36:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc26e987700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26809e1f0 con 0x7fc268133fa0 2023-09-30T22:36:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc26e987700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc26809dc50 con 0x7fc2680a0a30 2023-09-30T22:36:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc2677fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2680a1340 0x7fc268133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc26cf24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268133fa0 0x7fc268134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc267fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2680a0a30 0x7fc2680a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc267fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2680a0a30 0x7fc2680a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36208/0 (socket says 172.21.15.59:36208) 2023-09-30T22:36:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc2677fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2680a1340 0x7fc268133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52574/0 (socket says 172.21.15.59:52574) 2023-09-30T22:36:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc26cf24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268133fa0 0x7fc268134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39654/0 (socket says 172.21.15.59:39654) 2023-09-30T22:36:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc267fff700 1 -- 172.21.15.59:0/3976579659 learned_addr learned my addr 172.21.15.59:0/3976579659 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc26cf24700 1 -- 172.21.15.59:0/3976579659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2680a0a30 msgr2=0x7fc2680a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc26cf24700 1 --2- 172.21.15.59:0/3976579659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2680a0a30 0x7fc2680a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc26cf24700 1 -- 172.21.15.59:0/3976579659 >> v2:172.21.15.59:3300/0 conn(0x7fc2680a1340 msgr2=0x7fc268133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc26cf24700 1 --2- 172.21.15.59:0/3976579659 >> v2:172.21.15.59:3300/0 conn(0x7fc2680a1340 0x7fc268133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.941+0000 7fc26cf24700 1 -- 172.21.15.59:0/3976579659 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2680a1fe0 con 0x7fc268133fa0 2023-09-30T22:36:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.942+0000 7fc267fff700 1 --2- 172.21.15.59:0/3976579659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2680a0a30 0x7fc2680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.942+0000 7fc2677fe700 1 --2- 172.21.15.59:0/3976579659 >> v2:172.21.15.59:3300/0 conn(0x7fc2680a1340 0x7fc268133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.942+0000 7fc26cf24700 1 --2- 172.21.15.59:0/3976579659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268133fa0 0x7fc268134410 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc260009dc0 tx=0x7fc26000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97fa2ca2732a75e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.942+0000 7fc266ffd700 1 -- 172.21.15.59:0/3976579659 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26000e070 con 0x7fc268133fa0 2023-09-30T22:36:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.942+0000 7fc266ffd700 1 -- 172.21.15.59:0/3976579659 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26000bae0 con 0x7fc268133fa0 2023-09-30T22:36:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.942+0000 7fc266ffd700 1 -- 172.21.15.59:0/3976579659 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26000be90 con 0x7fc268133fa0 2023-09-30T22:36:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.943+0000 7fc26e987700 1 -- 172.21.15.59:0/3976579659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268133fa0 msgr2=0x7fc268134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.943+0000 7fc26e987700 1 --2- 172.21.15.59:0/3976579659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268133fa0 0x7fc268134410 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc260009dc0 tx=0x7fc26000b330 comp rx=0 tx=0).stop 2023-09-30T22:36:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.943+0000 7fc26e987700 1 -- 172.21.15.59:0/3976579659 shutdown_connections 2023-09-30T22:36:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.943+0000 7fc26e987700 1 --2- 172.21.15.59:0/3976579659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268133fa0 0x7fc268134410 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.943+0000 7fc26e987700 1 --2- 172.21.15.59:0/3976579659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2680a0a30 0x7fc2680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.943+0000 7fc26e987700 1 --2- 172.21.15.59:0/3976579659 >> v2:172.21.15.59:3300/0 conn(0x7fc2680a1340 0x7fc268133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.943+0000 7fc26e987700 1 -- 172.21.15.59:0/3976579659 >> 172.21.15.59:0/3976579659 conn(0x7fc2680a6550 msgr2=0x7fc2680a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.943+0000 7fc26e987700 1 -- 172.21.15.59:0/3976579659 shutdown_connections 2023-09-30T22:36:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.943+0000 7fc26e987700 1 -- 172.21.15.59:0/3976579659 wait complete. 2023-09-30T22:36:02.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.944+0000 7fc26e987700 1 Processor -- start 2023-09-30T22:36:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.944+0000 7fc26e987700 1 -- start start 2023-09-30T22:36:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.944+0000 7fc26e987700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2680a0a30 0x7fc2681200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.944+0000 7fc26e987700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2680a1340 0x7fc2681205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.944+0000 7fc26e987700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc268133fa0 0x7fc268120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.944+0000 7fc26e987700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2681233e0 con 0x7fc268133fa0 2023-09-30T22:36:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.944+0000 7fc26e987700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc268122eb0 con 0x7fc2680a0a30 2023-09-30T22:36:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.944+0000 7fc26e987700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc268121d00 con 0x7fc2680a1340 2023-09-30T22:36:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.944+0000 7fc26cf24700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc268133fa0 0x7fc268120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc2677fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2680a1340 0x7fc2681205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc267fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2680a0a30 0x7fc2681200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc26cf24700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc268133fa0 0x7fc268120b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52588/0 (socket says 172.21.15.59:52588) 2023-09-30T22:36:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc26cf24700 1 -- 172.21.15.59:0/967417925 learned_addr learned my addr 172.21.15.59:0/967417925 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc2677fe700 1 -- 172.21.15.59:0/967417925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2680a0a30 msgr2=0x7fc2681200a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc2677fe700 1 --2- 172.21.15.59:0/967417925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2680a0a30 0x7fc2681200a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc2677fe700 1 -- 172.21.15.59:0/967417925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc268133fa0 msgr2=0x7fc268120b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc2677fe700 1 --2- 172.21.15.59:0/967417925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc268133fa0 0x7fc268120b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc2677fe700 1 -- 172.21.15.59:0/967417925 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc258009550 con 0x7fc2680a1340 2023-09-30T22:36:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc267fff700 1 --2- 172.21.15.59:0/967417925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2680a0a30 0x7fc2681200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc26cf24700 1 --2- 172.21.15.59:0/967417925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc268133fa0 0x7fc268120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc2677fe700 1 --2- 172.21.15.59:0/967417925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2680a1340 0x7fc2681205e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00e9e0 tx=0x7fc25c00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:02.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc264ff9700 1 -- 172.21.15.59:0/967417925 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c00ee80 con 0x7fc2680a1340 2023-09-30T22:36:02.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc264ff9700 1 -- 172.21.15.59:0/967417925 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25c00c850 con 0x7fc2680a1340 2023-09-30T22:36:02.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc26e987700 1 -- 172.21.15.59:0/967417925 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc25c0094a0 con 0x7fc2680a1340 2023-09-30T22:36:02.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc264ff9700 1 -- 172.21.15.59:0/967417925 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c00cc00 con 0x7fc2680a1340 2023-09-30T22:36:02.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.945+0000 7fc26e987700 1 -- 172.21.15.59:0/967417925 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc260009a70 con 0x7fc2680a1340 2023-09-30T22:36:02.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.946+0000 7fc264ff9700 1 -- 172.21.15.59:0/967417925 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc25c00cd60 con 0x7fc2680a1340 2023-09-30T22:36:02.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.946+0000 7fc26e987700 1 -- 172.21.15.59:0/967417925 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2680a0220 con 0x7fc2680a1340 2023-09-30T22:36:02.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.947+0000 7fc264ff9700 1 -- 172.21.15.59:0/967417925 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc25c03fa30 con 0x7fc2680a1340 2023-09-30T22:36:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.955+0000 7fc264ff9700 1 -- 172.21.15.59:0/967417925 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc25c01b3b0 con 0x7fc2680a1340 2023-09-30T22:36:02.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.981+0000 7f1544627700 1 Processor -- start 2023-09-30T22:36:02.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.981+0000 7f1544627700 1 -- start start 2023-09-30T22:36:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.982+0000 7f1544627700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f153c0a0a30 0x7f153c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.982+0000 7f1544627700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f153c0a1340 0x7f153c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.982+0000 7f1544627700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153c09edd0 con 0x7f153c133fa0 2023-09-30T22:36:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.982+0000 7f1544627700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153c09e1f0 con 0x7f153c0a1340 2023-09-30T22:36:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.982+0000 7f1544627700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f153c09dc50 con 0x7f153c0a0a30 2023-09-30T22:36:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.982+0000 7f1541bc2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f153c0a1340 0x7f153c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.982+0000 7f1542bc4700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f153c133fa0 0x7f153c13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57176/0 (socket says 172.21.15.59:57176) 2023-09-30T22:36:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.982+0000 7f1542bc4700 1 -- 172.21.15.59:0/2383260901 learned_addr learned my addr 172.21.15.59:0/2383260901 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.982+0000 7f15423c3700 1 --2- 172.21.15.59:0/2383260901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f153c0a0a30 0x7f153c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.982+0000 7f15423c3700 1 -- 172.21.15.59:0/2383260901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f153c0a1340 msgr2=0x7f153c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.982+0000 7f15423c3700 1 --2- 172.21.15.59:0/2383260901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f153c0a1340 0x7f153c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.982+0000 7f15413c1700 1 -- 172.21.15.59:0/2383260901 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015738710 0 0) 0x7f153c09edd0 con 0x7f153c133fa0 2023-09-30T22:36:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.982+0000 7f15423c3700 1 -- 172.21.15.59:0/2383260901 >> v1:172.21.15.59:6789/0 conn(0x7f153c133fa0 legacy=0x7f153c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.982+0000 7f15423c3700 1 -- 172.21.15.59:0/2383260901 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c0a1fe0 con 0x7f153c0a0a30 2023-09-30T22:36:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.982+0000 7f1541bc2700 1 --2- 172.21.15.59:0/2383260901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f153c0a1340 0x7f153c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.983+0000 7f15423c3700 1 --2- 172.21.15.59:0/2383260901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f153c0a0a30 0x7f153c0a0e00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f152c009dc0 tx=0x7f152c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdbf1b3b24302186 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.983+0000 7f15413c1700 1 -- 172.21.15.59:0/2383260901 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c00e070 con 0x7f153c0a0a30 2023-09-30T22:36:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.983+0000 7f15413c1700 1 -- 172.21.15.59:0/2383260901 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c00bb20 con 0x7f153c0a0a30 2023-09-30T22:36:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.983+0000 7f15413c1700 1 -- 172.21.15.59:0/2383260901 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c012430 con 0x7f153c0a0a30 2023-09-30T22:36:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.983+0000 7f1544627700 1 -- 172.21.15.59:0/2383260901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f153c0a0a30 msgr2=0x7f153c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.983+0000 7f1544627700 1 --2- 172.21.15.59:0/2383260901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f153c0a0a30 0x7f153c0a0e00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f152c009dc0 tx=0x7f152c00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.984+0000 7f1544627700 1 -- 172.21.15.59:0/2383260901 shutdown_connections 2023-09-30T22:36:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.984+0000 7f1544627700 1 --2- 172.21.15.59:0/2383260901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f153c0a0a30 0x7f153c0a0e00 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.984+0000 7f1544627700 1 --2- 172.21.15.59:0/2383260901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f153c0a1340 0x7f153c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.984+0000 7f1544627700 1 -- 172.21.15.59:0/2383260901 >> 172.21.15.59:0/2383260901 conn(0x7f153c0a6550 msgr2=0x7f153c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.984+0000 7f1544627700 1 -- 172.21.15.59:0/2383260901 shutdown_connections 2023-09-30T22:36:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.984+0000 7f1544627700 1 -- 172.21.15.59:0/2383260901 wait complete. 2023-09-30T22:36:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.985+0000 7f1544627700 1 Processor -- start 2023-09-30T22:36:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.985+0000 7f1544627700 1 -- start start 2023-09-30T22:36:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.985+0000 7f1544627700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f153c0a0a30 0x7f153c11e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.985+0000 7f1544627700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f153c0a1340 0x7f153c11ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.985+0000 7f1544627700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f153c133fa0 0x7f153c11f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.985+0000 7f1544627700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c121e00 con 0x7f153c0a0a30 2023-09-30T22:36:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.985+0000 7f1544627700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153c121fe0 con 0x7f153c133fa0 2023-09-30T22:36:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.985+0000 7f1544627700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f153c0a0220 con 0x7f153c0a1340 2023-09-30T22:36:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.985+0000 7f1541bc2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f153c0a1340 0x7f153c11ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.985+0000 7f1542bc4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f153c133fa0 0x7f153c11f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.985+0000 7f1541bc2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f153c0a1340 0x7f153c11ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36240/0 (socket says 172.21.15.59:36240) 2023-09-30T22:36:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.985+0000 7f1541bc2700 1 -- 172.21.15.59:0/413761808 learned_addr learned my addr 172.21.15.59:0/413761808 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.985+0000 7f15423c3700 1 --2- 172.21.15.59:0/413761808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f153c0a0a30 0x7f153c11e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.986+0000 7f1542bc4700 1 -- 172.21.15.59:0/413761808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f153c0a1340 msgr2=0x7f153c11ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.986+0000 7f1542bc4700 1 --2- 172.21.15.59:0/413761808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f153c0a1340 0x7f153c11ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.986+0000 7f1542bc4700 1 -- 172.21.15.59:0/413761808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f153c0a0a30 msgr2=0x7f153c11e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.986+0000 7f1542bc4700 1 --2- 172.21.15.59:0/413761808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f153c0a0a30 0x7f153c11e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.986+0000 7f1542bc4700 1 -- 172.21.15.59:0/413761808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15300094a0 con 0x7f153c133fa0 2023-09-30T22:36:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.986+0000 7f1542bc4700 1 --2- 172.21.15.59:0/413761808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f153c133fa0 0x7f153c11f340 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f153400c460 tx=0x7f153400c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.986+0000 7f153affd700 1 -- 172.21.15.59:0/413761808 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1534004c80 con 0x7f153c133fa0 2023-09-30T22:36:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.986+0000 7f153affd700 1 -- 172.21.15.59:0/413761808 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1534004e00 con 0x7f153c133fa0 2023-09-30T22:36:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.986+0000 7f1544627700 1 -- 172.21.15.59:0/413761808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152c009a70 con 0x7f153c133fa0 2023-09-30T22:36:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.986+0000 7f153affd700 1 -- 172.21.15.59:0/413761808 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1534007310 con 0x7f153c133fa0 2023-09-30T22:36:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.986+0000 7f1544627700 1 -- 172.21.15.59:0/413761808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153c0a25e0 con 0x7f153c133fa0 2023-09-30T22:36:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.987+0000 7f1544627700 1 -- 172.21.15.59:0/413761808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153c121c40 con 0x7f153c133fa0 2023-09-30T22:36:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.987+0000 7f153affd700 1 -- 172.21.15.59:0/413761808 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1534007470 con 0x7f153c133fa0 2023-09-30T22:36:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.988+0000 7f153affd700 1 -- 172.21.15.59:0/413761808 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f153403f870 con 0x7f153c133fa0 2023-09-30T22:36:02.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:02.996+0000 7f153affd700 1 -- 172.21.15.59:0/413761808 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f153400ce30 con 0x7f153c133fa0 2023-09-30T22:36:03.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.168+0000 7fc26e987700 1 -- 172.21.15.59:0/967417925 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc268074ea0 con 0x7fc2680a1340 2023-09-30T22:36:03.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.169+0000 7fc264ff9700 1 -- 172.21.15.59:0/967417925 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc25c017020 con 0x7fc2680a1340 2023-09-30T22:36:03.169 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.171+0000 7fc26e987700 1 -- 172.21.15.59:0/967417925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2680a1340 msgr2=0x7fc2681205e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:03.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.171+0000 7fc26e987700 1 --2- 172.21.15.59:0/967417925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2680a1340 0x7fc2681205e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00e9e0 tx=0x7fc25c00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.171+0000 7fc26e987700 1 -- 172.21.15.59:0/967417925 shutdown_connections 2023-09-30T22:36:03.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.171+0000 7fc26e987700 1 --2- 172.21.15.59:0/967417925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc268133fa0 0x7fc268120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.171+0000 7fc26e987700 1 --2- 172.21.15.59:0/967417925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2680a0a30 0x7fc2681200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.171+0000 7fc26e987700 1 --2- 172.21.15.59:0/967417925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2680a1340 0x7fc2681205e0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.171+0000 7fc26e987700 1 -- 172.21.15.59:0/967417925 >> 172.21.15.59:0/967417925 conn(0x7fc2680a6550 msgr2=0x7fc2681baff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:03.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.171+0000 7fc26e987700 1 -- 172.21.15.59:0/967417925 shutdown_connections 2023-09-30T22:36:03.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.171+0000 7fc26e987700 1 -- 172.21.15.59:0/967417925 wait complete. 2023-09-30T22:36:03.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.203+0000 7f1544627700 1 -- 172.21.15.59:0/413761808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f153c074ea0 con 0x7f153c133fa0 2023-09-30T22:36:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.203+0000 7f153affd700 1 -- 172.21.15.59:0/413761808 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1534011e80 con 0x7f153c133fa0 2023-09-30T22:36:03.203 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.205+0000 7f1544627700 1 -- 172.21.15.59:0/413761808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f153c133fa0 msgr2=0x7f153c11f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.205+0000 7f1544627700 1 --2- 172.21.15.59:0/413761808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f153c133fa0 0x7f153c11f340 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f153400c460 tx=0x7f153400c770 comp rx=0 tx=0).stop 2023-09-30T22:36:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.205+0000 7f1544627700 1 -- 172.21.15.59:0/413761808 shutdown_connections 2023-09-30T22:36:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.205+0000 7f1544627700 1 --2- 172.21.15.59:0/413761808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f153c133fa0 0x7f153c11f340 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.205+0000 7f1544627700 1 --2- 172.21.15.59:0/413761808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f153c0a0a30 0x7f153c11e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.205+0000 7f1544627700 1 --2- 172.21.15.59:0/413761808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f153c0a1340 0x7f153c11ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.205+0000 7f1544627700 1 -- 172.21.15.59:0/413761808 >> 172.21.15.59:0/413761808 conn(0x7f153c0a6550 msgr2=0x7f153c1b9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.205+0000 7f1544627700 1 -- 172.21.15.59:0/413761808 shutdown_connections 2023-09-30T22:36:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.205+0000 7f1544627700 1 -- 172.21.15.59:0/413761808 wait complete. 2023-09-30T22:36:03.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:03.241 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:03.283 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:03.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.406+0000 7ffb3ba2f700 1 Processor -- start 2023-09-30T22:36:03.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.406+0000 7ffb3ba2f700 1 -- start start 2023-09-30T22:36:03.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.407+0000 7ffb3ba2f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb340a0a30 0x7ffb340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:03.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.407+0000 7ffb3ba2f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb3409d630 0x7ffb340a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:03.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.407+0000 7ffb3ba2f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb340a2a70 con 0x7ffb34133930 2023-09-30T22:36:03.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.407+0000 7ffb3ba2f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb340a01d0 con 0x7ffb340a0a30 2023-09-30T22:36:03.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.407+0000 7ffb3ba2f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3409e2b0 con 0x7ffb3409d630 2023-09-30T22:36:03.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.407+0000 7ffb397cb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb340a0a30 0x7ffb340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:03.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.407+0000 7ffb38fca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb3409d630 0x7ffb340a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:03.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.407+0000 7ffb397cb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb340a0a30 0x7ffb340a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52618/0 (socket says 172.21.15.59:52618) 2023-09-30T22:36:03.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.407+0000 7ffb397cb700 1 -- 172.21.15.59:0/2468535183 learned_addr learned my addr 172.21.15.59:0/2468535183 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:03.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.407+0000 7ffb397cb700 1 -- 172.21.15.59:0/2468535183 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb3409d630 msgr2=0x7ffb340a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:03.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.407+0000 7ffb397cb700 1 --2- 172.21.15.59:0/2468535183 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb3409d630 0x7ffb340a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.407+0000 7ffb397cb700 1 -- 172.21.15.59:0/2468535183 >> v1:172.21.15.59:6789/0 conn(0x7ffb34133930 legacy=0x7ffb34133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:03.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.407+0000 7ffb397cb700 1 -- 172.21.15.59:0/2468535183 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3409dc50 con 0x7ffb340a0a30 2023-09-30T22:36:03.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.407+0000 7ffb38fca700 1 --2- 172.21.15.59:0/2468535183 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb3409d630 0x7ffb340a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:03.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.407+0000 7ffb397cb700 1 --2- 172.21.15.59:0/2468535183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb340a0a30 0x7ffb340a0e00 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0098f0 tx=0x7ffb2c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e4109d1c6e8522 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:03.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.408+0000 7ffb33fff700 1 -- 172.21.15.59:0/2468535183 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c011830 con 0x7ffb340a0a30 2023-09-30T22:36:03.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.408+0000 7ffb33fff700 1 -- 172.21.15.59:0/2468535183 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c011990 con 0x7ffb340a0a30 2023-09-30T22:36:03.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.408+0000 7ffb33fff700 1 -- 172.21.15.59:0/2468535183 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c011d20 con 0x7ffb340a0a30 2023-09-30T22:36:03.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.408+0000 7ffb3ba2f700 1 -- 172.21.15.59:0/2468535183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb340a0a30 msgr2=0x7ffb340a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:03.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.408+0000 7ffb3ba2f700 1 --2- 172.21.15.59:0/2468535183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb340a0a30 0x7ffb340a0e00 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0098f0 tx=0x7ffb2c009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:03.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.408+0000 7ffb3ba2f700 1 -- 172.21.15.59:0/2468535183 shutdown_connections 2023-09-30T22:36:03.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.408+0000 7ffb3ba2f700 1 --2- 172.21.15.59:0/2468535183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb340a0a30 0x7ffb340a0e00 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.408+0000 7ffb3ba2f700 1 --2- 172.21.15.59:0/2468535183 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb3409d630 0x7ffb340a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.408+0000 7ffb3ba2f700 1 -- 172.21.15.59:0/2468535183 >> 172.21.15.59:0/2468535183 conn(0x7ffb340a3050 msgr2=0x7ffb340a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:03.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.408+0000 7ffb3ba2f700 1 -- 172.21.15.59:0/2468535183 shutdown_connections 2023-09-30T22:36:03.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.408+0000 7ffb3ba2f700 1 -- 172.21.15.59:0/2468535183 wait complete. 2023-09-30T22:36:03.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.410+0000 7ffb3ba2f700 1 Processor -- start 2023-09-30T22:36:03.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.410+0000 7ffb3ba2f700 1 -- start start 2023-09-30T22:36:03.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb3ba2f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb3409d630 0x7ffb341c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:03.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb3ba2f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb340a0a30 0x7ffb341c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:03.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb3ba2f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb34133930 0x7ffb341c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:03.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb3ba2f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3411eea0 con 0x7ffb340a0a30 2023-09-30T22:36:03.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb3ba2f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb341207f0 con 0x7ffb34133930 2023-09-30T22:36:03.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb3ba2f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb34120600 con 0x7ffb3409d630 2023-09-30T22:36:03.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb397cb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb3409d630 0x7ffb341c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:03.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb39fcc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb34133930 0x7ffb341c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:03.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb397cb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb3409d630 0x7ffb341c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36250/0 (socket says 172.21.15.59:36250) 2023-09-30T22:36:03.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb397cb700 1 -- 172.21.15.59:0/1373349505 learned_addr learned my addr 172.21.15.59:0/1373349505 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:03.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb38fca700 1 --2- 172.21.15.59:0/1373349505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb340a0a30 0x7ffb341c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:03.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb397cb700 1 -- 172.21.15.59:0/1373349505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb34133930 msgr2=0x7ffb341c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:03.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb397cb700 1 --2- 172.21.15.59:0/1373349505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb34133930 0x7ffb341c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb397cb700 1 -- 172.21.15.59:0/1373349505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb340a0a30 msgr2=0x7ffb341c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:03.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb397cb700 1 --2- 172.21.15.59:0/1373349505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb340a0a30 0x7ffb341c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb397cb700 1 -- 172.21.15.59:0/1373349505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb280094a0 con 0x7ffb3409d630 2023-09-30T22:36:03.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb38fca700 1 --2- 172.21.15.59:0/1373349505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb340a0a30 0x7ffb341c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:03.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.411+0000 7ffb397cb700 1 --2- 172.21.15.59:0/1373349505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb3409d630 0x7ffb341c8120 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c000c00 tx=0x7ffb2c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:03.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.412+0000 7ffb31ffb700 1 -- 172.21.15.59:0/1373349505 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0036a0 con 0x7ffb3409d630 2023-09-30T22:36:03.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.412+0000 7ffb31ffb700 1 -- 172.21.15.59:0/1373349505 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c003800 con 0x7ffb3409d630 2023-09-30T22:36:03.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.412+0000 7ffb3ba2f700 1 -- 172.21.15.59:0/1373349505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2c009550 con 0x7ffb3409d630 2023-09-30T22:36:03.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.412+0000 7ffb31ffb700 1 -- 172.21.15.59:0/1373349505 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c003bb0 con 0x7ffb3409d630 2023-09-30T22:36:03.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.412+0000 7ffb3ba2f700 1 -- 172.21.15.59:0/1373349505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb34122230 con 0x7ffb3409d630 2023-09-30T22:36:03.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.413+0000 7ffb31ffb700 1 -- 172.21.15.59:0/1373349505 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb2c021070 con 0x7ffb3409d630 2023-09-30T22:36:03.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.413+0000 7ffb31ffb700 1 -- 172.21.15.59:0/1373349505 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffb2c040be0 con 0x7ffb3409d630 2023-09-30T22:36:03.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.413+0000 7ffb3ba2f700 1 -- 172.21.15.59:0/1373349505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb34122420 con 0x7ffb3409d630 2023-09-30T22:36:03.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.418+0000 7ffb31ffb700 1 -- 172.21.15.59:0/1373349505 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb2c024470 con 0x7ffb3409d630 2023-09-30T22:36:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.448+0000 7ff7ca6eb700 1 Processor -- start 2023-09-30T22:36:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.448+0000 7ff7ca6eb700 1 -- start start 2023-09-30T22:36:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.449+0000 7ff7ca6eb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff7c40a1510 0x7ff7c4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.449+0000 7ff7ca6eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7c4139250 0x7ff7c413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.449+0000 7ff7ca6eb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c409edd0 con 0x7ff7c40a0a30 2023-09-30T22:36:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.449+0000 7ff7ca6eb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c40a18e0 con 0x7ff7c40a1510 2023-09-30T22:36:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.449+0000 7ff7ca6eb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c409e1f0 con 0x7ff7c4139250 2023-09-30T22:36:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.449+0000 7ff7c8c88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7c4139250 0x7ff7c413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.449+0000 7ff7c8c88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7c4139250 0x7ff7c413b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:39696/0 (socket says 172.21.15.59:39696) 2023-09-30T22:36:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.449+0000 7ff7c8c88700 1 -- 172.21.15.59:0/1028793251 learned_addr learned my addr 172.21.15.59:0/1028793251 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.449+0000 7ff7c37fe700 1 --2- 172.21.15.59:0/1028793251 >> v2:172.21.15.59:3300/0 conn(0x7ff7c40a1510 0x7ff7c4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.449+0000 7ff7c8c88700 1 -- 172.21.15.59:0/1028793251 >> v2:172.21.15.59:3300/0 conn(0x7ff7c40a1510 msgr2=0x7ff7c4138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.449+0000 7ff7c8c88700 1 --2- 172.21.15.59:0/1028793251 >> v2:172.21.15.59:3300/0 conn(0x7ff7c40a1510 0x7ff7c4138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.449+0000 7ff7c8c88700 1 -- 172.21.15.59:0/1028793251 >> v1:172.21.15.59:6789/0 conn(0x7ff7c40a0a30 legacy=0x7ff7c40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.449+0000 7ff7c8c88700 1 -- 172.21.15.59:0/1028793251 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c409dc50 con 0x7ff7c4139250 2023-09-30T22:36:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.449+0000 7ff7c8c88700 1 --2- 172.21.15.59:0/1028793251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7c4139250 0x7ff7c413b630 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009e50 tx=0x7ff7bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10c2cafd862eb89f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.450+0000 7ff7c2ffd700 1 -- 172.21.15.59:0/1028793251 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00e070 con 0x7ff7c4139250 2023-09-30T22:36:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.450+0000 7ff7c2ffd700 1 -- 172.21.15.59:0/1028793251 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc00b910 con 0x7ff7c4139250 2023-09-30T22:36:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.450+0000 7ff7c2ffd700 1 -- 172.21.15.59:0/1028793251 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00bcc0 con 0x7ff7c4139250 2023-09-30T22:36:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.450+0000 7ff7ca6eb700 1 -- 172.21.15.59:0/1028793251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7c4139250 msgr2=0x7ff7c413b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.450+0000 7ff7ca6eb700 1 --2- 172.21.15.59:0/1028793251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7c4139250 0x7ff7c413b630 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009e50 tx=0x7ff7bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.450+0000 7ff7ca6eb700 1 -- 172.21.15.59:0/1028793251 shutdown_connections 2023-09-30T22:36:03.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.450+0000 7ff7ca6eb700 1 --2- 172.21.15.59:0/1028793251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7c4139250 0x7ff7c413b630 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.450+0000 7ff7ca6eb700 1 --2- 172.21.15.59:0/1028793251 >> v2:172.21.15.59:3300/0 conn(0x7ff7c40a1510 0x7ff7c4138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.450+0000 7ff7ca6eb700 1 -- 172.21.15.59:0/1028793251 >> 172.21.15.59:0/1028793251 conn(0x7ff7c40a6550 msgr2=0x7ff7c40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:03.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.450+0000 7ff7ca6eb700 1 -- 172.21.15.59:0/1028793251 shutdown_connections 2023-09-30T22:36:03.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.450+0000 7ff7ca6eb700 1 -- 172.21.15.59:0/1028793251 wait complete. 2023-09-30T22:36:03.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.451+0000 7ff7ca6eb700 1 Processor -- start 2023-09-30T22:36:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.452+0000 7ff7ca6eb700 1 -- start start 2023-09-30T22:36:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.452+0000 7ff7ca6eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7c40a0a30 0x7ff7c41c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.452+0000 7ff7ca6eb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7c40a1510 0x7ff7c41c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:03.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.452+0000 7ff7ca6eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7c4139250 0x7ff7c41c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:03.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.452+0000 7ff7ca6eb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4124820 con 0x7ff7c40a1510 2023-09-30T22:36:03.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.452+0000 7ff7ca6eb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4125d40 con 0x7ff7c4139250 2023-09-30T22:36:03.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.452+0000 7ff7ca6eb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c41253a0 con 0x7ff7c40a0a30 2023-09-30T22:36:03.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.452+0000 7ff7c37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7c40a1510 0x7ff7c41c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:03.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.452+0000 7ff7c3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7c40a0a30 0x7ff7c41c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:03.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.452+0000 7ff7c8c88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7c4139250 0x7ff7c41c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:03.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.452+0000 7ff7c3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7c40a0a30 0x7ff7c41c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36266/0 (socket says 172.21.15.59:36266) 2023-09-30T22:36:03.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.452+0000 7ff7c3fff700 1 -- 172.21.15.59:0/248902123 learned_addr learned my addr 172.21.15.59:0/248902123 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:03.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.453+0000 7ff7c3fff700 1 -- 172.21.15.59:0/248902123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7c4139250 msgr2=0x7ff7c41c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:03.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.453+0000 7ff7c3fff700 1 --2- 172.21.15.59:0/248902123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7c4139250 0x7ff7c41c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.453+0000 7ff7c3fff700 1 -- 172.21.15.59:0/248902123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7c40a1510 msgr2=0x7ff7c41c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:03.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.453+0000 7ff7c3fff700 1 --2- 172.21.15.59:0/248902123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7c40a1510 0x7ff7c41c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.453+0000 7ff7c3fff700 1 -- 172.21.15.59:0/248902123 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc009b30 con 0x7ff7c40a0a30 2023-09-30T22:36:03.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.453+0000 7ff7c8c88700 1 --2- 172.21.15.59:0/248902123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7c4139250 0x7ff7c41c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:03.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.453+0000 7ff7c37fe700 1 --2- 172.21.15.59:0/248902123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7c40a1510 0x7ff7c41c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:03.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.453+0000 7ff7c3fff700 1 --2- 172.21.15.59:0/248902123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7c40a0a30 0x7ff7c41c8540 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400c4e0 tx=0x7ff7b400c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:03.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.453+0000 7ff7c0ff9700 1 -- 172.21.15.59:0/248902123 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40052d0 con 0x7ff7c40a0a30 2023-09-30T22:36:03.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.453+0000 7ff7c0ff9700 1 -- 172.21.15.59:0/248902123 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b4005430 con 0x7ff7c40a0a30 2023-09-30T22:36:03.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.453+0000 7ff7ca6eb700 1 -- 172.21.15.59:0/248902123 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c4126010 con 0x7ff7c40a0a30 2023-09-30T22:36:03.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.453+0000 7ff7c0ff9700 1 -- 172.21.15.59:0/248902123 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40038c0 con 0x7ff7c40a0a30 2023-09-30T22:36:03.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.453+0000 7ff7ca6eb700 1 -- 172.21.15.59:0/248902123 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c4126d40 con 0x7ff7c40a0a30 2023-09-30T22:36:03.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.454+0000 7ff7c0ff9700 1 -- 172.21.15.59:0/248902123 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7b4003a20 con 0x7ff7c40a0a30 2023-09-30T22:36:03.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.454+0000 7ff7c0ff9700 1 -- 172.21.15.59:0/248902123 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff7b403eba0 con 0x7ff7c40a0a30 2023-09-30T22:36:03.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.454+0000 7ff7ca6eb700 1 -- 172.21.15.59:0/248902123 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c4074ea0 con 0x7ff7c40a0a30 2023-09-30T22:36:03.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.459+0000 7ff7c0ff9700 1 -- 172.21.15.59:0/248902123 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7b4017020 con 0x7ff7c40a0a30 2023-09-30T22:36:03.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.628+0000 7ffb3ba2f700 1 -- 172.21.15.59:0/1373349505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb340a4030 con 0x7ffb3409d630 2023-09-30T22:36:03.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.628+0000 7ffb31ffb700 1 -- 172.21.15.59:0/1373349505 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb2c019ba0 con 0x7ffb3409d630 2023-09-30T22:36:03.628 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:03.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.630+0000 7ffb3ba2f700 1 -- 172.21.15.59:0/1373349505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb3409d630 msgr2=0x7ffb341c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:03.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.630+0000 7ffb3ba2f700 1 --2- 172.21.15.59:0/1373349505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb3409d630 0x7ffb341c8120 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c000c00 tx=0x7ffb2c004750 comp rx=0 tx=0).stop 2023-09-30T22:36:03.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.630+0000 7ffb3ba2f700 1 -- 172.21.15.59:0/1373349505 shutdown_connections 2023-09-30T22:36:03.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.630+0000 7ffb3ba2f700 1 --2- 172.21.15.59:0/1373349505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb3409d630 0x7ffb341c8120 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.630+0000 7ffb3ba2f700 1 --2- 172.21.15.59:0/1373349505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb34133930 0x7ffb341c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.630+0000 7ffb3ba2f700 1 --2- 172.21.15.59:0/1373349505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb340a0a30 0x7ffb341c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.630+0000 7ffb3ba2f700 1 -- 172.21.15.59:0/1373349505 >> 172.21.15.59:0/1373349505 conn(0x7ffb340a3050 msgr2=0x7ffb3409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:03.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.630+0000 7ffb3ba2f700 1 -- 172.21.15.59:0/1373349505 shutdown_connections 2023-09-30T22:36:03.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.630+0000 7ffb3ba2f700 1 -- 172.21.15.59:0/1373349505 wait complete. 2023-09-30T22:36:03.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:03.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.666+0000 7ff7ca6eb700 1 -- 172.21.15.59:0/248902123 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7c40a1d10 con 0x7ff7c40a0a30 2023-09-30T22:36:03.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.667+0000 7ff7c0ff9700 1 -- 172.21.15.59:0/248902123 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7b4018260 con 0x7ff7c40a0a30 2023-09-30T22:36:03.667 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:03.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.669+0000 7ff7ca6eb700 1 -- 172.21.15.59:0/248902123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7c40a0a30 msgr2=0x7ff7c41c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:03.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.669+0000 7ff7ca6eb700 1 --2- 172.21.15.59:0/248902123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7c40a0a30 0x7ff7c41c8540 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400c4e0 tx=0x7ff7b400c7f0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.669+0000 7ff7ca6eb700 1 -- 172.21.15.59:0/248902123 shutdown_connections 2023-09-30T22:36:03.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.669+0000 7ff7ca6eb700 1 --2- 172.21.15.59:0/248902123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff7c40a0a30 0x7ff7c41c8540 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.669+0000 7ff7ca6eb700 1 --2- 172.21.15.59:0/248902123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7c4139250 0x7ff7c41c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.669+0000 7ff7ca6eb700 1 --2- 172.21.15.59:0/248902123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7c40a1510 0x7ff7c41c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:03.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.669+0000 7ff7ca6eb700 1 -- 172.21.15.59:0/248902123 >> 172.21.15.59:0/248902123 conn(0x7ff7c40a6550 msgr2=0x7ff7c40a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:03.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.669+0000 7ff7ca6eb700 1 -- 172.21.15.59:0/248902123 shutdown_connections 2023-09-30T22:36:03.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:03.669+0000 7ff7ca6eb700 1 -- 172.21.15.59:0/248902123 wait complete. 2023-09-30T22:36:03.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:04.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:04.220 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:04.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.336+0000 7f1466c58700 1 Processor -- start 2023-09-30T22:36:04.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.336+0000 7f1466c58700 1 -- start start 2023-09-30T22:36:04.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.336+0000 7f1466c58700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14600a0a30 0x7f14600a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.336+0000 7f1466c58700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14600a1340 0x7f1460133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.336+0000 7f1466c58700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146009edd0 con 0x7f1460133fa0 2023-09-30T22:36:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.336+0000 7f1466c58700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146009e1f0 con 0x7f14600a1340 2023-09-30T22:36:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.336+0000 7f1466c58700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f146009dc50 con 0x7f14600a0a30 2023-09-30T22:36:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.336+0000 7f145ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14600a1340 0x7f1460133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.336+0000 7f14649f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14600a0a30 0x7f14600a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.337+0000 7f145ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14600a1340 0x7f1460133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52640/0 (socket says 172.21.15.59:52640) 2023-09-30T22:36:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.337+0000 7f14649f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14600a0a30 0x7f14600a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36272/0 (socket says 172.21.15.59:36272) 2023-09-30T22:36:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.337+0000 7f145ffff700 1 -- 172.21.15.59:0/2689842836 learned_addr learned my addr 172.21.15.59:0/2689842836 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.337+0000 7f14651f5700 1 --1- 172.21.15.59:0/2689842836 >> v1:172.21.15.59:6789/0 conn(0x7f1460133fa0 0x7f146013ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57202/0 (socket says 172.21.15.59:57202) 2023-09-30T22:36:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.337+0000 7f14649f4700 1 -- 172.21.15.59:0/2689842836 >> v2:172.21.15.59:3300/0 conn(0x7f14600a1340 msgr2=0x7f1460133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.337+0000 7f14649f4700 1 --2- 172.21.15.59:0/2689842836 >> v2:172.21.15.59:3300/0 conn(0x7f14600a1340 0x7f1460133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.337+0000 7f14649f4700 1 -- 172.21.15.59:0/2689842836 >> v1:172.21.15.59:6789/0 conn(0x7f1460133fa0 legacy=0x7f146013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.337+0000 7f14649f4700 1 -- 172.21.15.59:0/2689842836 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14600a1fe0 con 0x7f14600a0a30 2023-09-30T22:36:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.337+0000 7f145ffff700 1 --2- 172.21.15.59:0/2689842836 >> v2:172.21.15.59:3300/0 conn(0x7f14600a1340 0x7f1460133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.337+0000 7f14649f4700 1 --2- 172.21.15.59:0/2689842836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14600a0a30 0x7f14600a0e00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1454009840 tx=0x7f1454009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d04bea148ebd8d93 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.337+0000 7f145f7fe700 1 -- 172.21.15.59:0/2689842836 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1454011830 con 0x7f14600a0a30 2023-09-30T22:36:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.337+0000 7f145f7fe700 1 -- 172.21.15.59:0/2689842836 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1454011990 con 0x7f14600a0a30 2023-09-30T22:36:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.337+0000 7f145f7fe700 1 -- 172.21.15.59:0/2689842836 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1454011d20 con 0x7f14600a0a30 2023-09-30T22:36:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.338+0000 7f1466c58700 1 -- 172.21.15.59:0/2689842836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14600a0a30 msgr2=0x7f14600a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.338+0000 7f1466c58700 1 --2- 172.21.15.59:0/2689842836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14600a0a30 0x7f14600a0e00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1454009840 tx=0x7f1454009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.338+0000 7f1466c58700 1 -- 172.21.15.59:0/2689842836 shutdown_connections 2023-09-30T22:36:04.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.338+0000 7f1466c58700 1 --2- 172.21.15.59:0/2689842836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14600a0a30 0x7f14600a0e00 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.338+0000 7f1466c58700 1 --2- 172.21.15.59:0/2689842836 >> v2:172.21.15.59:3300/0 conn(0x7f14600a1340 0x7f1460133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.338+0000 7f1466c58700 1 -- 172.21.15.59:0/2689842836 >> 172.21.15.59:0/2689842836 conn(0x7f14600a6550 msgr2=0x7f14600a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.338+0000 7f1466c58700 1 -- 172.21.15.59:0/2689842836 shutdown_connections 2023-09-30T22:36:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.338+0000 7f1466c58700 1 -- 172.21.15.59:0/2689842836 wait complete. 2023-09-30T22:36:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.339+0000 7f1466c58700 1 Processor -- start 2023-09-30T22:36:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.339+0000 7f1466c58700 1 -- start start 2023-09-30T22:36:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f1466c58700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14600a0a30 0x7f146011e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f1466c58700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14600a1340 0x7f146011ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f1466c58700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1460133fa0 0x7f146011f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f1466c58700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1460121f50 con 0x7f14600a1340 2023-09-30T22:36:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f1466c58700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1460120430 con 0x7f14600a0a30 2023-09-30T22:36:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f1466c58700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14600a37e0 con 0x7f1460133fa0 2023-09-30T22:36:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f145ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14600a1340 0x7f146011ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f14651f5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1460133fa0 0x7f146011f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f145ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14600a1340 0x7f146011ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52656/0 (socket says 172.21.15.59:52656) 2023-09-30T22:36:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f145ffff700 1 -- 172.21.15.59:0/512327926 learned_addr learned my addr 172.21.15.59:0/512327926 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f14649f4700 1 --2- 172.21.15.59:0/512327926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14600a0a30 0x7f146011e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f145ffff700 1 -- 172.21.15.59:0/512327926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1460133fa0 msgr2=0x7f146011f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f145ffff700 1 --2- 172.21.15.59:0/512327926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1460133fa0 0x7f146011f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f145ffff700 1 -- 172.21.15.59:0/512327926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14600a0a30 msgr2=0x7f146011e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f145ffff700 1 --2- 172.21.15.59:0/512327926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14600a0a30 0x7f146011e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f145ffff700 1 -- 172.21.15.59:0/512327926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c009550 con 0x7f14600a1340 2023-09-30T22:36:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.340+0000 7f14651f5700 1 --2- 172.21.15.59:0/512327926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1460133fa0 0x7f146011f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.341+0000 7f145ffff700 1 --2- 172.21.15.59:0/512327926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14600a1340 0x7f146011ece0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f144c00ebe0 tx=0x7f144c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.341+0000 7f145d7fa700 1 -- 172.21.15.59:0/512327926 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c00c850 con 0x7f14600a1340 2023-09-30T22:36:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.341+0000 7f145d7fa700 1 -- 172.21.15.59:0/512327926 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c00c9b0 con 0x7f14600a1340 2023-09-30T22:36:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.341+0000 7f1466c58700 1 -- 172.21.15.59:0/512327926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14540094a0 con 0x7f14600a1340 2023-09-30T22:36:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.341+0000 7f145d7fa700 1 -- 172.21.15.59:0/512327926 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c00cd40 con 0x7f14600a1340 2023-09-30T22:36:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.341+0000 7f1466c58700 1 -- 172.21.15.59:0/512327926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14600a0270 con 0x7f14600a1340 2023-09-30T22:36:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.342+0000 7f145d7fa700 1 -- 172.21.15.59:0/512327926 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f144c013470 con 0x7f14600a1340 2023-09-30T22:36:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.342+0000 7f145d7fa700 1 -- 172.21.15.59:0/512327926 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f144c03fbb0 con 0x7f14600a1340 2023-09-30T22:36:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.342+0000 7f1466c58700 1 -- 172.21.15.59:0/512327926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1460122a80 con 0x7f14600a1340 2023-09-30T22:36:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.347+0000 7f145d7fa700 1 -- 172.21.15.59:0/512327926 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f144c01b3b0 con 0x7f14600a1340 2023-09-30T22:36:04.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.373+0000 7f86a4a58700 1 Processor -- start 2023-09-30T22:36:04.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.373+0000 7f86a4a58700 1 -- start start 2023-09-30T22:36:04.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.373+0000 7f86a4a58700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a00a0a30 0x7f86a00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.373+0000 7f86a4a58700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a009d630 0x7f86a00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.373+0000 7f86a4a58700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86a0133930 0x7f86a0133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.373+0000 7f86a4a58700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a00a2a70 con 0x7f86a0133930 2023-09-30T22:36:04.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.373+0000 7f86a4a58700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00a01d0 con 0x7f86a00a0a30 2023-09-30T22:36:04.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.373+0000 7f86a4a58700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86a009e2b0 con 0x7f86a009d630 2023-09-30T22:36:04.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a009d630 0x7f86a00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86a0133930 0x7f86a0133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a009d630 0x7f86a00a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36292/0 (socket says 172.21.15.59:36292) 2023-09-30T22:36:04.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86a0133930 0x7f86a0133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52662/0 (socket says 172.21.15.59:52662) 2023-09-30T22:36:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a00a0a30 0x7f86a00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869ed9d700 1 -- 172.21.15.59:0/2696156429 learned_addr learned my addr 172.21.15.59:0/2696156429 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869ed9d700 1 -- 172.21.15.59:0/2696156429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a009d630 msgr2=0x7f86a00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869ed9d700 1 --2- 172.21.15.59:0/2696156429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a009d630 0x7f86a00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869ed9d700 1 -- 172.21.15.59:0/2696156429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a00a0a30 msgr2=0x7f86a00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869ed9d700 1 --2- 172.21.15.59:0/2696156429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a00a0a30 0x7f86a00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869ed9d700 1 -- 172.21.15.59:0/2696156429 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a009dc50 con 0x7f86a0133930 2023-09-30T22:36:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869e59c700 1 --2- 172.21.15.59:0/2696156429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a00a0a30 0x7f86a00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869dd9b700 1 --2- 172.21.15.59:0/2696156429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a009d630 0x7f86a00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869ed9d700 1 --2- 172.21.15.59:0/2696156429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a0133930 0x7f86a0133dd0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f86980098f0 tx=0x7f8698009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfd2bca2497a666 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:04.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869d59a700 1 -- 172.21.15.59:0/2696156429 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8698011830 con 0x7f86a0133930 2023-09-30T22:36:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869d59a700 1 -- 172.21.15.59:0/2696156429 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8698011990 con 0x7f86a0133930 2023-09-30T22:36:04.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.374+0000 7f869d59a700 1 -- 172.21.15.59:0/2696156429 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8698011d20 con 0x7f86a0133930 2023-09-30T22:36:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.375+0000 7f86a4a58700 1 -- 172.21.15.59:0/2696156429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a0133930 msgr2=0x7f86a0133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.375+0000 7f86a4a58700 1 --2- 172.21.15.59:0/2696156429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a0133930 0x7f86a0133dd0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f86980098f0 tx=0x7f8698009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.375+0000 7f86a4a58700 1 -- 172.21.15.59:0/2696156429 shutdown_connections 2023-09-30T22:36:04.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.375+0000 7f86a4a58700 1 --2- 172.21.15.59:0/2696156429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a0133930 0x7f86a0133dd0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.375+0000 7f86a4a58700 1 --2- 172.21.15.59:0/2696156429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a00a0a30 0x7f86a00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.375+0000 7f86a4a58700 1 --2- 172.21.15.59:0/2696156429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a009d630 0x7f86a00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.375+0000 7f86a4a58700 1 -- 172.21.15.59:0/2696156429 >> 172.21.15.59:0/2696156429 conn(0x7f86a00a3050 msgr2=0x7f86a00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.375+0000 7f86a4a58700 1 -- 172.21.15.59:0/2696156429 shutdown_connections 2023-09-30T22:36:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.375+0000 7f86a4a58700 1 -- 172.21.15.59:0/2696156429 wait complete. 2023-09-30T22:36:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.376+0000 7f86a4a58700 1 Processor -- start 2023-09-30T22:36:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.376+0000 7f86a4a58700 1 -- start start 2023-09-30T22:36:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f86a4a58700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a009d630 0x7f86a011f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f86a4a58700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a00a0a30 0x7f86a011fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f86a4a58700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a0133930 0x7f86a01c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f86a4a58700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a01225f0 con 0x7f86a0133930 2023-09-30T22:36:04.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f86a4a58700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a011eed0 con 0x7f86a009d630 2023-09-30T22:36:04.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f86a4a58700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86a01205e0 con 0x7f86a00a0a30 2023-09-30T22:36:04.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f869dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a00a0a30 0x7f86a011fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f869dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a00a0a30 0x7f86a011fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36298/0 (socket says 172.21.15.59:36298) 2023-09-30T22:36:04.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f869dd9b700 1 -- 172.21.15.59:0/1908415884 learned_addr learned my addr 172.21.15.59:0/1908415884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:04.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f869ed9d700 1 --2- 172.21.15.59:0/1908415884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a0133930 0x7f86a01c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f869e59c700 1 --2- 172.21.15.59:0/1908415884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a009d630 0x7f86a011f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f869dd9b700 1 -- 172.21.15.59:0/1908415884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a009d630 msgr2=0x7f86a011f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f869dd9b700 1 --2- 172.21.15.59:0/1908415884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a009d630 0x7f86a011f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f869dd9b700 1 -- 172.21.15.59:0/1908415884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a0133930 msgr2=0x7f86a01c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f869dd9b700 1 --2- 172.21.15.59:0/1908415884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a0133930 0x7f86a01c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f869dd9b700 1 -- 172.21.15.59:0/1908415884 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86940094a0 con 0x7f86a00a0a30 2023-09-30T22:36:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.377+0000 7f869ed9d700 1 --2- 172.21.15.59:0/1908415884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a0133930 0x7f86a01c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.378+0000 7f869dd9b700 1 --2- 172.21.15.59:0/1908415884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a00a0a30 0x7f86a011fa60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f869400ebb0 tx=0x7f869400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.378+0000 7f868effd700 1 -- 172.21.15.59:0/1908415884 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869400c850 con 0x7f86a00a0a30 2023-09-30T22:36:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.378+0000 7f868effd700 1 -- 172.21.15.59:0/1908415884 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869400c9b0 con 0x7f86a00a0a30 2023-09-30T22:36:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.378+0000 7f86a4a58700 1 -- 172.21.15.59:0/1908415884 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8690009a70 con 0x7f86a00a0a30 2023-09-30T22:36:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.378+0000 7f868effd700 1 -- 172.21.15.59:0/1908415884 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869400cd40 con 0x7f86a00a0a30 2023-09-30T22:36:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.378+0000 7f86a4a58700 1 -- 172.21.15.59:0/1908415884 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8698009550 con 0x7f86a00a0a30 2023-09-30T22:36:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.379+0000 7f86a4a58700 1 -- 172.21.15.59:0/1908415884 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a0099a40 con 0x7f86a00a0a30 2023-09-30T22:36:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.379+0000 7f868effd700 1 -- 172.21.15.59:0/1908415884 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8694013470 con 0x7f86a00a0a30 2023-09-30T22:36:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.379+0000 7f868effd700 1 -- 172.21.15.59:0/1908415884 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f869403fb60 con 0x7f86a00a0a30 2023-09-30T22:36:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.384+0000 7f868effd700 1 -- 172.21.15.59:0/1908415884 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f869401b3b0 con 0x7f86a00a0a30 2023-09-30T22:36:04.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.553+0000 7f1466c58700 1 -- 172.21.15.59:0/512327926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1460074ea0 con 0x7f14600a1340 2023-09-30T22:36:04.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.553+0000 7f145d7fa700 1 -- 172.21.15.59:0/512327926 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f144c011ca0 con 0x7f14600a1340 2023-09-30T22:36:04.553 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:04.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.555+0000 7f1466c58700 1 -- 172.21.15.59:0/512327926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14600a1340 msgr2=0x7f146011ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.555+0000 7f1466c58700 1 --2- 172.21.15.59:0/512327926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14600a1340 0x7f146011ece0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f144c00ebe0 tx=0x7f144c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.555+0000 7f1466c58700 1 -- 172.21.15.59:0/512327926 shutdown_connections 2023-09-30T22:36:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.555+0000 7f1466c58700 1 --2- 172.21.15.59:0/512327926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1460133fa0 0x7f146011f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.555+0000 7f1466c58700 1 --2- 172.21.15.59:0/512327926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14600a0a30 0x7f146011e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.555+0000 7f1466c58700 1 --2- 172.21.15.59:0/512327926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14600a1340 0x7f146011ece0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.555+0000 7f1466c58700 1 -- 172.21.15.59:0/512327926 >> 172.21.15.59:0/512327926 conn(0x7f14600a6550 msgr2=0x7f14601b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.555+0000 7f1466c58700 1 -- 172.21.15.59:0/512327926 shutdown_connections 2023-09-30T22:36:04.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.555+0000 7f1466c58700 1 -- 172.21.15.59:0/512327926 wait complete. 2023-09-30T22:36:04.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:04.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.588+0000 7f86a4a58700 1 -- 172.21.15.59:0/1908415884 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f86a00a0410 con 0x7f86a00a0a30 2023-09-30T22:36:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.589+0000 7f868effd700 1 -- 172.21.15.59:0/1908415884 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8694017070 con 0x7f86a00a0a30 2023-09-30T22:36:04.589 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:04.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.591+0000 7f86a4a58700 1 -- 172.21.15.59:0/1908415884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a00a0a30 msgr2=0x7f86a011fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.591+0000 7f86a4a58700 1 --2- 172.21.15.59:0/1908415884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a00a0a30 0x7f86a011fa60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f869400ebb0 tx=0x7f869400eec0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.591+0000 7f86a4a58700 1 -- 172.21.15.59:0/1908415884 shutdown_connections 2023-09-30T22:36:04.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.591+0000 7f86a4a58700 1 --2- 172.21.15.59:0/1908415884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a0133930 0x7f86a01c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.591+0000 7f86a4a58700 1 --2- 172.21.15.59:0/1908415884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a009d630 0x7f86a011f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.591+0000 7f86a4a58700 1 --2- 172.21.15.59:0/1908415884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86a00a0a30 0x7f86a011fa60 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.591+0000 7f86a4a58700 1 -- 172.21.15.59:0/1908415884 >> 172.21.15.59:0/1908415884 conn(0x7f86a00a3050 msgr2=0x7f86a009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.591+0000 7f86a4a58700 1 -- 172.21.15.59:0/1908415884 shutdown_connections 2023-09-30T22:36:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.591+0000 7f86a4a58700 1 -- 172.21.15.59:0/1908415884 wait complete. 2023-09-30T22:36:04.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:04.645 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:04.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:04.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.788+0000 7f0733414700 1 Processor -- start 2023-09-30T22:36:04.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.788+0000 7f0733414700 1 -- start start 2023-09-30T22:36:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.788+0000 7f0733414700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f072c0a0a30 0x7f072c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.789+0000 7f0733414700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f072c09d630 0x7f072c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.789+0000 7f0733414700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072c0a2a70 con 0x7f072c133930 2023-09-30T22:36:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.789+0000 7f0733414700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072c0a01d0 con 0x7f072c0a0a30 2023-09-30T22:36:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.789+0000 7f0733414700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f072c09e2b0 con 0x7f072c09d630 2023-09-30T22:36:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.789+0000 7f07309af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f072c09d630 0x7f072c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.789+0000 7f07311b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f072c0a0a30 0x7f072c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.789+0000 7f07309af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f072c09d630 0x7f072c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59918/0 (socket says 172.21.15.59:59918) 2023-09-30T22:36:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.789+0000 7f07311b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f072c0a0a30 0x7f072c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47218/0 (socket says 172.21.15.59:47218) 2023-09-30T22:36:04.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.789+0000 7f07309af700 1 -- 172.21.15.59:0/3775131213 learned_addr learned my addr 172.21.15.59:0/3775131213 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:04.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.789+0000 7f07309af700 1 -- 172.21.15.59:0/3775131213 >> v2:172.21.15.59:3300/0 conn(0x7f072c0a0a30 msgr2=0x7f072c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:04.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.789+0000 7f07309af700 1 --2- 172.21.15.59:0/3775131213 >> v2:172.21.15.59:3300/0 conn(0x7f072c0a0a30 0x7f072c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.789+0000 7f07309af700 1 -- 172.21.15.59:0/3775131213 >> v1:172.21.15.59:6789/0 conn(0x7f072c133930 legacy=0x7f072c133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.789+0000 7f07309af700 1 -- 172.21.15.59:0/3775131213 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c09dc50 con 0x7f072c09d630 2023-09-30T22:36:04.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.789+0000 7f07309af700 1 --2- 172.21.15.59:0/3775131213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f072c09d630 0x7f072c0a1340 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f071c0098f0 tx=0x7f071c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d61cf4c4b5bda78 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:04.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.789+0000 7f0723fff700 1 -- 172.21.15.59:0/3775131213 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c011830 con 0x7f072c09d630 2023-09-30T22:36:04.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.790+0000 7f0723fff700 1 -- 172.21.15.59:0/3775131213 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c011990 con 0x7f072c09d630 2023-09-30T22:36:04.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.790+0000 7f0723fff700 1 -- 172.21.15.59:0/3775131213 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c011d20 con 0x7f072c09d630 2023-09-30T22:36:04.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.790+0000 7f0733414700 1 -- 172.21.15.59:0/3775131213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f072c09d630 msgr2=0x7f072c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.790+0000 7f0733414700 1 --2- 172.21.15.59:0/3775131213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f072c09d630 0x7f072c0a1340 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f071c0098f0 tx=0x7f071c009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:04.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.790+0000 7f0733414700 1 -- 172.21.15.59:0/3775131213 shutdown_connections 2023-09-30T22:36:04.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.790+0000 7f0733414700 1 --2- 172.21.15.59:0/3775131213 >> v2:172.21.15.59:3300/0 conn(0x7f072c0a0a30 0x7f072c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.790+0000 7f0733414700 1 --2- 172.21.15.59:0/3775131213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f072c09d630 0x7f072c0a1340 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.790+0000 7f0733414700 1 -- 172.21.15.59:0/3775131213 >> 172.21.15.59:0/3775131213 conn(0x7f072c0a3050 msgr2=0x7f072c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:04.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.790+0000 7f0733414700 1 -- 172.21.15.59:0/3775131213 shutdown_connections 2023-09-30T22:36:04.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.790+0000 7f0733414700 1 -- 172.21.15.59:0/3775131213 wait complete. 2023-09-30T22:36:04.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.792+0000 7f0733414700 1 Processor -- start 2023-09-30T22:36:04.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.792+0000 7f0733414700 1 -- start start 2023-09-30T22:36:04.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f0733414700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f072c09d630 0x7f072c11f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f0733414700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f072c0a0a30 0x7f072c11fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f0733414700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f072c133930 0x7f072c1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f0733414700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c122320 con 0x7f072c09d630 2023-09-30T22:36:04.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f0733414700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c120c40 con 0x7f072c133930 2023-09-30T22:36:04.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f0733414700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f072c122500 con 0x7f072c0a0a30 2023-09-30T22:36:04.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f07309af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f072c0a0a30 0x7f072c11fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f07309af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f072c0a0a30 0x7f072c11fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59924/0 (socket says 172.21.15.59:59924) 2023-09-30T22:36:04.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f07309af700 1 -- 172.21.15.59:0/2707065589 learned_addr learned my addr 172.21.15.59:0/2707065589 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:04.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f07311b0700 1 --2- 172.21.15.59:0/2707065589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f072c09d630 0x7f072c11f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f07319b1700 1 --2- 172.21.15.59:0/2707065589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f072c133930 0x7f072c1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f07309af700 1 -- 172.21.15.59:0/2707065589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f072c133930 msgr2=0x7f072c1c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f07309af700 1 --2- 172.21.15.59:0/2707065589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f072c133930 0x7f072c1c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f07309af700 1 -- 172.21.15.59:0/2707065589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f072c09d630 msgr2=0x7f072c11f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f07309af700 1 --2- 172.21.15.59:0/2707065589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f072c09d630 0x7f072c11f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f07309af700 1 -- 172.21.15.59:0/2707065589 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c009550 con 0x7f072c0a0a30 2023-09-30T22:36:04.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.793+0000 7f07309af700 1 --2- 172.21.15.59:0/2707065589 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f072c0a0a30 0x7f072c11fa20 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f071c009c40 tx=0x7f071c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:04.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.794+0000 7f0721ffb700 1 -- 172.21.15.59:0/2707065589 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0036a0 con 0x7f072c0a0a30 2023-09-30T22:36:04.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.794+0000 7f0721ffb700 1 -- 172.21.15.59:0/2707065589 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c003800 con 0x7f072c0a0a30 2023-09-30T22:36:04.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.794+0000 7f0721ffb700 1 -- 172.21.15.59:0/2707065589 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c003bb0 con 0x7f072c0a0a30 2023-09-30T22:36:04.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.794+0000 7f0733414700 1 -- 172.21.15.59:0/2707065589 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072c133370 con 0x7f072c0a0a30 2023-09-30T22:36:04.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.794+0000 7f0733414700 1 -- 172.21.15.59:0/2707065589 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072c120de0 con 0x7f072c0a0a30 2023-09-30T22:36:04.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.795+0000 7f0721ffb700 1 -- 172.21.15.59:0/2707065589 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f071c021070 con 0x7f072c0a0a30 2023-09-30T22:36:04.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.795+0000 7f0733414700 1 -- 172.21.15.59:0/2707065589 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072c0747f0 con 0x7f072c0a0a30 2023-09-30T22:36:04.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.795+0000 7f0721ffb700 1 -- 172.21.15.59:0/2707065589 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f071c040be0 con 0x7f072c0a0a30 2023-09-30T22:36:04.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.800+0000 7f0721ffb700 1 -- 172.21.15.59:0/2707065589 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f071c02d3a0 con 0x7f072c0a0a30 2023-09-30T22:36:04.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.830+0000 7f597eecf700 1 Processor -- start 2023-09-30T22:36:04.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.830+0000 7f597eecf700 1 -- start start 2023-09-30T22:36:04.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.830+0000 7f597eecf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59780a0a30 0x7f59780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.830+0000 7f597eecf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978138d80 0x7f597813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.830+0000 7f597eecf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59780a2a70 con 0x7f597809d630 2023-09-30T22:36:04.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.830+0000 7f597eecf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59780a01d0 con 0x7f5978138d80 2023-09-30T22:36:04.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.830+0000 7f597eecf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f597809e2b0 con 0x7f59780a0a30 2023-09-30T22:36:04.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.831+0000 7f597cc6b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59780a0a30 0x7f59780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.831+0000 7f5977fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f597809d630 0x7f59780a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57478/0 (socket says 172.21.15.59:57478) 2023-09-30T22:36:04.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.831+0000 7f597d46c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978138d80 0x7f597813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.831+0000 7f5977fff700 1 -- 172.21.15.59:0/2999854424 learned_addr learned my addr 172.21.15.59:0/2999854424 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:04.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.831+0000 7f597d46c700 1 -- 172.21.15.59:0/2999854424 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59780a0a30 msgr2=0x7f59780a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:04.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.831+0000 7f59777fe700 1 -- 172.21.15.59:0/2999854424 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780239220 0 0) 0x7f59780a2a70 con 0x7f597809d630 2023-09-30T22:36:04.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.831+0000 7f597d46c700 1 --2- 172.21.15.59:0/2999854424 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59780a0a30 0x7f59780a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.831+0000 7f597d46c700 1 -- 172.21.15.59:0/2999854424 >> v1:172.21.15.59:6789/0 conn(0x7f597809d630 legacy=0x7f59780a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.831+0000 7f597d46c700 1 -- 172.21.15.59:0/2999854424 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597809dc50 con 0x7f5978138d80 2023-09-30T22:36:04.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.831+0000 7f597cc6b700 1 --2- 172.21.15.59:0/2999854424 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59780a0a30 0x7f59780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:04.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.831+0000 7f597d46c700 1 --2- 172.21.15.59:0/2999854424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978138d80 0x7f597813b160 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5970009dc0 tx=0x7f597000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55658129a070f0b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:04.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.831+0000 7f59777fe700 1 -- 172.21.15.59:0/2999854424 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597000e070 con 0x7f5978138d80 2023-09-30T22:36:04.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.831+0000 7f59777fe700 1 -- 172.21.15.59:0/2999854424 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597000bb20 con 0x7f5978138d80 2023-09-30T22:36:04.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.831+0000 7f59777fe700 1 -- 172.21.15.59:0/2999854424 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5970012430 con 0x7f5978138d80 2023-09-30T22:36:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.832+0000 7f597eecf700 1 -- 172.21.15.59:0/2999854424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978138d80 msgr2=0x7f597813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.832+0000 7f597eecf700 1 --2- 172.21.15.59:0/2999854424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978138d80 0x7f597813b160 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5970009dc0 tx=0x7f597000b330 comp rx=0 tx=0).stop 2023-09-30T22:36:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.832+0000 7f597eecf700 1 -- 172.21.15.59:0/2999854424 shutdown_connections 2023-09-30T22:36:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.832+0000 7f597eecf700 1 --2- 172.21.15.59:0/2999854424 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59780a0a30 0x7f59780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.832+0000 7f597eecf700 1 --2- 172.21.15.59:0/2999854424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978138d80 0x7f597813b160 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.832+0000 7f597eecf700 1 -- 172.21.15.59:0/2999854424 >> 172.21.15.59:0/2999854424 conn(0x7f59780a3050 msgr2=0x7f59780a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.832+0000 7f597eecf700 1 -- 172.21.15.59:0/2999854424 shutdown_connections 2023-09-30T22:36:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.832+0000 7f597eecf700 1 -- 172.21.15.59:0/2999854424 wait complete. 2023-09-30T22:36:04.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.833+0000 7f597eecf700 1 Processor -- start 2023-09-30T22:36:04.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.833+0000 7f597eecf700 1 -- start start 2023-09-30T22:36:04.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.834+0000 7f597eecf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597809d630 0x7f5978133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.834+0000 7f597eecf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59780a0a30 0x7f5978133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.834+0000 7f597eecf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978138d80 0x7f5978134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:04.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.834+0000 7f597eecf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5978134bd0 con 0x7f597809d630 2023-09-30T22:36:04.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.834+0000 7f597eecf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5978136140 con 0x7f5978138d80 2023-09-30T22:36:04.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.834+0000 7f597eecf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5978136e60 con 0x7f59780a0a30 2023-09-30T22:36:04.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f5977fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59780a0a30 0x7f5978133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f597cc6b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597809d630 0x7f5978133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f597cc6b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597809d630 0x7f5978133700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47230/0 (socket says 172.21.15.59:47230) 2023-09-30T22:36:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f597cc6b700 1 -- 172.21.15.59:0/2733869683 learned_addr learned my addr 172.21.15.59:0/2733869683 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f5977fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59780a0a30 0x7f5978133c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59946/0 (socket says 172.21.15.59:59946) 2023-09-30T22:36:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f597d46c700 1 --2- 172.21.15.59:0/2733869683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978138d80 0x7f5978134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f5977fff700 1 -- 172.21.15.59:0/2733869683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978138d80 msgr2=0x7f5978134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f5977fff700 1 --2- 172.21.15.59:0/2733869683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978138d80 0x7f5978134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f5977fff700 1 -- 172.21.15.59:0/2733869683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597809d630 msgr2=0x7f5978133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f5977fff700 1 --2- 172.21.15.59:0/2733869683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597809d630 0x7f5978133700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f5977fff700 1 -- 172.21.15.59:0/2733869683 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c0094a0 con 0x7f59780a0a30 2023-09-30T22:36:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f5977fff700 1 --2- 172.21.15.59:0/2733869683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59780a0a30 0x7f5978133c40 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f596400c470 tx=0x7f596400c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f59757fa700 1 -- 172.21.15.59:0/2733869683 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964004c80 con 0x7f59780a0a30 2023-09-30T22:36:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f59757fa700 1 -- 172.21.15.59:0/2733869683 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5964004de0 con 0x7f59780a0a30 2023-09-30T22:36:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f59757fa700 1 -- 172.21.15.59:0/2733869683 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964007310 con 0x7f59780a0a30 2023-09-30T22:36:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f597eecf700 1 -- 172.21.15.59:0/2733869683 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5970009a70 con 0x7f59780a0a30 2023-09-30T22:36:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.835+0000 7f597eecf700 1 -- 172.21.15.59:0/2733869683 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59781364f0 con 0x7f59780a0a30 2023-09-30T22:36:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.836+0000 7f59757fa700 1 -- 172.21.15.59:0/2733869683 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5964007470 con 0x7f59780a0a30 2023-09-30T22:36:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.836+0000 7f597eecf700 1 -- 172.21.15.59:0/2733869683 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59780747f0 con 0x7f59780a0a30 2023-09-30T22:36:04.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.837+0000 7f59757fa700 1 -- 172.21.15.59:0/2733869683 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f596403f1e0 con 0x7f59780a0a30 2023-09-30T22:36:04.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:04.841+0000 7f59757fa700 1 -- 172.21.15.59:0/2733869683 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5964007720 con 0x7f59780a0a30 2023-09-30T22:36:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.007+0000 7f0733414700 1 -- 172.21.15.59:0/2707065589 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f072c122180 con 0x7f072c0a0a30 2023-09-30T22:36:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.008+0000 7f0721ffb700 1 -- 172.21.15.59:0/2707065589 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f072c122180 con 0x7f072c0a0a30 2023-09-30T22:36:05.009 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.010+0000 7f0733414700 1 -- 172.21.15.59:0/2707065589 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f072c0a0a30 msgr2=0x7f072c11fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.010+0000 7f0733414700 1 --2- 172.21.15.59:0/2707065589 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f072c0a0a30 0x7f072c11fa20 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f071c009c40 tx=0x7f071c004750 comp rx=0 tx=0).stop 2023-09-30T22:36:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.010+0000 7f0733414700 1 -- 172.21.15.59:0/2707065589 shutdown_connections 2023-09-30T22:36:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.010+0000 7f0733414700 1 --2- 172.21.15.59:0/2707065589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f072c133930 0x7f072c1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.010+0000 7f0733414700 1 --2- 172.21.15.59:0/2707065589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f072c09d630 0x7f072c11f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.010+0000 7f0733414700 1 --2- 172.21.15.59:0/2707065589 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f072c0a0a30 0x7f072c11fa20 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.010+0000 7f0733414700 1 -- 172.21.15.59:0/2707065589 >> 172.21.15.59:0/2707065589 conn(0x7f072c0a3050 msgr2=0x7f072c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.010+0000 7f0733414700 1 -- 172.21.15.59:0/2707065589 shutdown_connections 2023-09-30T22:36:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.010+0000 7f0733414700 1 -- 172.21.15.59:0/2707065589 wait complete. 2023-09-30T22:36:05.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.045+0000 7f597eecf700 1 -- 172.21.15.59:0/2733869683 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5978072980 con 0x7f59780a0a30 2023-09-30T22:36:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.045+0000 7f59757fa700 1 -- 172.21.15.59:0/2733869683 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f596401b7b0 con 0x7f59780a0a30 2023-09-30T22:36:05.045 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.047+0000 7f597eecf700 1 -- 172.21.15.59:0/2733869683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59780a0a30 msgr2=0x7f5978133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.047+0000 7f597eecf700 1 --2- 172.21.15.59:0/2733869683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59780a0a30 0x7f5978133c40 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f596400c470 tx=0x7f596400c780 comp rx=0 tx=0).stop 2023-09-30T22:36:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.047+0000 7f597eecf700 1 -- 172.21.15.59:0/2733869683 shutdown_connections 2023-09-30T22:36:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.047+0000 7f597eecf700 1 --2- 172.21.15.59:0/2733869683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978138d80 0x7f5978134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.047+0000 7f597eecf700 1 --2- 172.21.15.59:0/2733869683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597809d630 0x7f5978133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.047+0000 7f597eecf700 1 --2- 172.21.15.59:0/2733869683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59780a0a30 0x7f5978133c40 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.047+0000 7f597eecf700 1 -- 172.21.15.59:0/2733869683 >> 172.21.15.59:0/2733869683 conn(0x7f59780a3050 msgr2=0x7f597809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.048+0000 7f597eecf700 1 -- 172.21.15.59:0/2733869683 shutdown_connections 2023-09-30T22:36:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.048+0000 7f597eecf700 1 -- 172.21.15.59:0/2733869683 wait complete. 2023-09-30T22:36:05.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:05.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:05.605 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:05.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.721+0000 7fb34d1d2700 1 Processor -- start 2023-09-30T22:36:05.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.721+0000 7fb34d1d2700 1 -- start start 2023-09-30T22:36:05.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.721+0000 7fb34d1d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3480a0a30 0x7fb3480a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:05.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.721+0000 7fb34d1d2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb3480a1340 0x7fb348133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:05.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.722+0000 7fb34d1d2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34809edd0 con 0x7fb348133fa0 2023-09-30T22:36:05.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.722+0000 7fb34d1d2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34809e1f0 con 0x7fb3480a1340 2023-09-30T22:36:05.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.722+0000 7fb34d1d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34809dc50 con 0x7fb3480a0a30 2023-09-30T22:36:05.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.722+0000 7fb34659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb3480a1340 0x7fb348133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.722+0000 7fb346d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3480a0a30 0x7fb3480a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.722+0000 7fb346d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3480a0a30 0x7fb3480a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38042/0 (socket says 172.21.15.59:38042) 2023-09-30T22:36:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.722+0000 7fb34659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb3480a1340 0x7fb348133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47244/0 (socket says 172.21.15.59:47244) 2023-09-30T22:36:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.722+0000 7fb346d9d700 1 -- 172.21.15.59:0/732796877 learned_addr learned my addr 172.21.15.59:0/732796877 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.722+0000 7fb346d9d700 1 -- 172.21.15.59:0/732796877 >> v2:172.21.15.59:3300/0 conn(0x7fb3480a1340 msgr2=0x7fb348133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.722+0000 7fb346d9d700 1 --2- 172.21.15.59:0/732796877 >> v2:172.21.15.59:3300/0 conn(0x7fb3480a1340 0x7fb348133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.722+0000 7fb346d9d700 1 -- 172.21.15.59:0/732796877 >> v1:172.21.15.59:6789/0 conn(0x7fb348133fa0 legacy=0x7fb34813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.722+0000 7fb346d9d700 1 -- 172.21.15.59:0/732796877 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3480a1fe0 con 0x7fb3480a0a30 2023-09-30T22:36:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.722+0000 7fb34659c700 1 --2- 172.21.15.59:0/732796877 >> v2:172.21.15.59:3300/0 conn(0x7fb3480a1340 0x7fb348133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.722+0000 7fb346d9d700 1 --2- 172.21.15.59:0/732796877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3480a0a30 0x7fb3480a0e00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb338009e50 tx=0x7fb33800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55f32d6bc88ac3fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.722+0000 7fb345d9b700 1 -- 172.21.15.59:0/732796877 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33800e070 con 0x7fb3480a0a30 2023-09-30T22:36:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.723+0000 7fb345d9b700 1 -- 172.21.15.59:0/732796877 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33800b910 con 0x7fb3480a0a30 2023-09-30T22:36:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.723+0000 7fb345d9b700 1 -- 172.21.15.59:0/732796877 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33800bcc0 con 0x7fb3480a0a30 2023-09-30T22:36:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.723+0000 7fb34d1d2700 1 -- 172.21.15.59:0/732796877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3480a0a30 msgr2=0x7fb3480a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.723+0000 7fb34d1d2700 1 --2- 172.21.15.59:0/732796877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3480a0a30 0x7fb3480a0e00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb338009e50 tx=0x7fb33800b330 comp rx=0 tx=0).stop 2023-09-30T22:36:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.723+0000 7fb34d1d2700 1 -- 172.21.15.59:0/732796877 shutdown_connections 2023-09-30T22:36:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.723+0000 7fb34d1d2700 1 --2- 172.21.15.59:0/732796877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3480a0a30 0x7fb3480a0e00 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.723+0000 7fb34d1d2700 1 --2- 172.21.15.59:0/732796877 >> v2:172.21.15.59:3300/0 conn(0x7fb3480a1340 0x7fb348133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.723+0000 7fb34d1d2700 1 -- 172.21.15.59:0/732796877 >> 172.21.15.59:0/732796877 conn(0x7fb3480a6550 msgr2=0x7fb3480a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.723+0000 7fb34d1d2700 1 -- 172.21.15.59:0/732796877 shutdown_connections 2023-09-30T22:36:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.723+0000 7fb34d1d2700 1 -- 172.21.15.59:0/732796877 wait complete. 2023-09-30T22:36:05.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.725+0000 7fb34d1d2700 1 Processor -- start 2023-09-30T22:36:05.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.725+0000 7fb34d1d2700 1 -- start start 2023-09-30T22:36:05.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.725+0000 7fb34d1d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3480a0a30 0x7fb34811e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.725+0000 7fb34d1d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3480a1340 0x7fb34811ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.725+0000 7fb34d1d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb348133fa0 0x7fb34811f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.725+0000 7fb34d1d2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb348121f50 con 0x7fb3480a1340 2023-09-30T22:36:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.725+0000 7fb34d1d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb348120430 con 0x7fb3480a0a30 2023-09-30T22:36:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.725+0000 7fb34d1d2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3480a37e0 con 0x7fb348133fa0 2023-09-30T22:36:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.725+0000 7fb346d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3480a0a30 0x7fb34811e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.725+0000 7fb34759e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb348133fa0 0x7fb34811f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.725+0000 7fb346d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3480a0a30 0x7fb34811e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38046/0 (socket says 172.21.15.59:38046) 2023-09-30T22:36:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.725+0000 7fb346d9d700 1 -- 172.21.15.59:0/1703053129 learned_addr learned my addr 172.21.15.59:0/1703053129 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.725+0000 7fb34659c700 1 --2- 172.21.15.59:0/1703053129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3480a1340 0x7fb34811ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.726+0000 7fb34759e700 1 -- 172.21.15.59:0/1703053129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3480a0a30 msgr2=0x7fb34811e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.726+0000 7fb34759e700 1 --2- 172.21.15.59:0/1703053129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3480a0a30 0x7fb34811e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.726+0000 7fb34759e700 1 -- 172.21.15.59:0/1703053129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3480a1340 msgr2=0x7fb34811ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.726+0000 7fb34759e700 1 --2- 172.21.15.59:0/1703053129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3480a1340 0x7fb34811ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.726+0000 7fb34759e700 1 -- 172.21.15.59:0/1703053129 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c0094a0 con 0x7fb348133fa0 2023-09-30T22:36:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.726+0000 7fb34759e700 1 --2- 172.21.15.59:0/1703053129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb348133fa0 0x7fb34811f220 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fb340001eb0 tx=0x7fb34000c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.726+0000 7fb32f7fe700 1 -- 172.21.15.59:0/1703053129 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400052d0 con 0x7fb348133fa0 2023-09-30T22:36:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.726+0000 7fb32f7fe700 1 -- 172.21.15.59:0/1703053129 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb340005430 con 0x7fb348133fa0 2023-09-30T22:36:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.726+0000 7fb34d1d2700 1 -- 172.21.15.59:0/1703053129 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb338009b30 con 0x7fb348133fa0 2023-09-30T22:36:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.726+0000 7fb32f7fe700 1 -- 172.21.15.59:0/1703053129 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400038c0 con 0x7fb348133fa0 2023-09-30T22:36:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.726+0000 7fb34d1d2700 1 -- 172.21.15.59:0/1703053129 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3480a0270 con 0x7fb348133fa0 2023-09-30T22:36:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.727+0000 7fb32f7fe700 1 -- 172.21.15.59:0/1703053129 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb340003a20 con 0x7fb348133fa0 2023-09-30T22:36:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.727+0000 7fb32f7fe700 1 -- 172.21.15.59:0/1703053129 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb34003e9a0 con 0x7fb348133fa0 2023-09-30T22:36:05.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.727+0000 7fb34d1d2700 1 -- 172.21.15.59:0/1703053129 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb348122a80 con 0x7fb348133fa0 2023-09-30T22:36:05.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.732+0000 7fb32f7fe700 1 -- 172.21.15.59:0/1703053129 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb340017070 con 0x7fb348133fa0 2023-09-30T22:36:05.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.758+0000 7f37a7e75700 1 Processor -- start 2023-09-30T22:36:05.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.759+0000 7f37a7e75700 1 -- start start 2023-09-30T22:36:05.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.759+0000 7f37a7e75700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a00a0a30 0x7f37a00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:05.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.759+0000 7f37a7e75700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a00a1340 0x7f37a0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:05.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.760+0000 7f37a7e75700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a009edd0 con 0x7f37a0133fa0 2023-09-30T22:36:05.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.760+0000 7f37a7e75700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a009e1f0 con 0x7f37a00a1340 2023-09-30T22:36:05.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.760+0000 7f37a7e75700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37a009dc50 con 0x7f37a00a0a30 2023-09-30T22:36:05.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.760+0000 7f37a5410700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a00a1340 0x7f37a0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:05.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.760+0000 7f37a5c11700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a00a0a30 0x7f37a00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:05.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.760+0000 7f37a5410700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a00a1340 0x7f37a0133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38058/0 (socket says 172.21.15.59:38058) 2023-09-30T22:36:05.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.760+0000 7f37a5410700 1 -- 172.21.15.59:0/701645776 learned_addr learned my addr 172.21.15.59:0/701645776 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:05.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.760+0000 7f37a5410700 1 -- 172.21.15.59:0/701645776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a00a0a30 msgr2=0x7f37a00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:05.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.760+0000 7f37a5410700 1 --2- 172.21.15.59:0/701645776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a00a0a30 0x7f37a00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.760+0000 7f37a4c0f700 1 -- 172.21.15.59:0/701645776 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477184852 0 0) 0x7f37a009edd0 con 0x7f37a0133fa0 2023-09-30T22:36:05.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.760+0000 7f37a5410700 1 -- 172.21.15.59:0/701645776 >> v1:172.21.15.59:6789/0 conn(0x7f37a0133fa0 legacy=0x7f37a013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:05.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.760+0000 7f37a5410700 1 -- 172.21.15.59:0/701645776 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a00a1fe0 con 0x7f37a00a1340 2023-09-30T22:36:05.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.760+0000 7f37a5c11700 1 --2- 172.21.15.59:0/701645776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a00a0a30 0x7f37a00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:05.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.760+0000 7f37a5410700 1 --2- 172.21.15.59:0/701645776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a00a1340 0x7f37a0133a60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3794009920 tx=0x7f3794009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af93fbdbfaab22e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:05.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.760+0000 7f37a4c0f700 1 -- 172.21.15.59:0/701645776 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794011830 con 0x7f37a00a1340 2023-09-30T22:36:05.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.761+0000 7f37a4c0f700 1 -- 172.21.15.59:0/701645776 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3794011990 con 0x7f37a00a1340 2023-09-30T22:36:05.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.761+0000 7f37a4c0f700 1 -- 172.21.15.59:0/701645776 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794011d20 con 0x7f37a00a1340 2023-09-30T22:36:05.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.761+0000 7f37a7e75700 1 -- 172.21.15.59:0/701645776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a00a1340 msgr2=0x7f37a0133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:05.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.761+0000 7f37a7e75700 1 --2- 172.21.15.59:0/701645776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a00a1340 0x7f37a0133a60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3794009920 tx=0x7f3794009c30 comp rx=0 tx=0).stop 2023-09-30T22:36:05.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.761+0000 7f37a7e75700 1 -- 172.21.15.59:0/701645776 shutdown_connections 2023-09-30T22:36:05.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.761+0000 7f37a7e75700 1 --2- 172.21.15.59:0/701645776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a00a0a30 0x7f37a00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.761+0000 7f37a7e75700 1 --2- 172.21.15.59:0/701645776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a00a1340 0x7f37a0133a60 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.761+0000 7f37a7e75700 1 -- 172.21.15.59:0/701645776 >> 172.21.15.59:0/701645776 conn(0x7f37a00a6550 msgr2=0x7f37a00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:05.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.762+0000 7f37a7e75700 1 -- 172.21.15.59:0/701645776 shutdown_connections 2023-09-30T22:36:05.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.762+0000 7f37a7e75700 1 -- 172.21.15.59:0/701645776 wait complete. 2023-09-30T22:36:05.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.762+0000 7f37a7e75700 1 Processor -- start 2023-09-30T22:36:05.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.763+0000 7f37a7e75700 1 -- start start 2023-09-30T22:36:05.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.763+0000 7f37a7e75700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a00a0a30 0x7f37a01c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:05.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.763+0000 7f37a7e75700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37a00a1340 0x7f37a01c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:05.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.763+0000 7f37a7e75700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a0133fa0 0x7f37a01c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:05.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.763+0000 7f37a7e75700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a0120640 con 0x7f37a00a1340 2023-09-30T22:36:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.763+0000 7f37a7e75700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a0120aa0 con 0x7f37a0133fa0 2023-09-30T22:36:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.763+0000 7f37a7e75700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37a009bf90 con 0x7f37a00a0a30 2023-09-30T22:36:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.763+0000 7f37a5c11700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a00a0a30 0x7f37a01c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.763+0000 7f37a6412700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a0133fa0 0x7f37a01c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.763+0000 7f37a5c11700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a00a0a30 0x7f37a01c8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59980/0 (socket says 172.21.15.59:59980) 2023-09-30T22:36:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.763+0000 7f37a5c11700 1 -- 172.21.15.59:0/182989002 learned_addr learned my addr 172.21.15.59:0/182989002 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.763+0000 7f37a5410700 1 --2- 172.21.15.59:0/182989002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37a00a1340 0x7f37a01c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.764+0000 7f37a6412700 1 -- 172.21.15.59:0/182989002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a00a0a30 msgr2=0x7f37a01c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.764+0000 7f37a6412700 1 --2- 172.21.15.59:0/182989002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a00a0a30 0x7f37a01c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.764+0000 7f37a6412700 1 -- 172.21.15.59:0/182989002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37a00a1340 msgr2=0x7f37a01c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.764+0000 7f37a6412700 1 --2- 172.21.15.59:0/182989002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37a00a1340 0x7f37a01c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.764+0000 7f37a6412700 1 -- 172.21.15.59:0/182989002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37980094a0 con 0x7f37a0133fa0 2023-09-30T22:36:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.764+0000 7f37a5c11700 1 --2- 172.21.15.59:0/182989002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a00a0a30 0x7f37a01c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.764+0000 7f37a6412700 1 --2- 172.21.15.59:0/182989002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a0133fa0 0x7f37a01c8f10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f379000c7c0 tx=0x7f379000cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.764+0000 7f379e7fc700 1 -- 172.21.15.59:0/182989002 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790003e30 con 0x7f37a0133fa0 2023-09-30T22:36:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.764+0000 7f379e7fc700 1 -- 172.21.15.59:0/182989002 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3790005070 con 0x7f37a0133fa0 2023-09-30T22:36:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.764+0000 7f37a7e75700 1 -- 172.21.15.59:0/182989002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3794009550 con 0x7f37a0133fa0 2023-09-30T22:36:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.764+0000 7f379e7fc700 1 -- 172.21.15.59:0/182989002 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790005420 con 0x7f37a0133fa0 2023-09-30T22:36:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.764+0000 7f37a7e75700 1 -- 172.21.15.59:0/182989002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a00a25e0 con 0x7f37a0133fa0 2023-09-30T22:36:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.765+0000 7f379e7fc700 1 -- 172.21.15.59:0/182989002 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3790005580 con 0x7f37a0133fa0 2023-09-30T22:36:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.765+0000 7f379e7fc700 1 -- 172.21.15.59:0/182989002 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f379003ecf0 con 0x7f37a0133fa0 2023-09-30T22:36:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.765+0000 7f37a7e75700 1 -- 172.21.15.59:0/182989002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a0074ea0 con 0x7f37a0133fa0 2023-09-30T22:36:05.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.770+0000 7f379e7fc700 1 -- 172.21.15.59:0/182989002 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3790005830 con 0x7f37a0133fa0 2023-09-30T22:36:05.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.938+0000 7fb34d1d2700 1 -- 172.21.15.59:0/1703053129 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb348074ea0 con 0x7fb348133fa0 2023-09-30T22:36:05.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.939+0000 7fb32f7fe700 1 -- 172.21.15.59:0/1703053129 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb340019d20 con 0x7fb348133fa0 2023-09-30T22:36:05.939 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:05.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.941+0000 7fb34d1d2700 1 -- 172.21.15.59:0/1703053129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb348133fa0 msgr2=0x7fb34811f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:05.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.941+0000 7fb34d1d2700 1 --2- 172.21.15.59:0/1703053129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb348133fa0 0x7fb34811f220 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fb340001eb0 tx=0x7fb34000c6e0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.941+0000 7fb34d1d2700 1 -- 172.21.15.59:0/1703053129 shutdown_connections 2023-09-30T22:36:05.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.941+0000 7fb34d1d2700 1 --2- 172.21.15.59:0/1703053129 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb348133fa0 0x7fb34811f220 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.941+0000 7fb34d1d2700 1 --2- 172.21.15.59:0/1703053129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3480a0a30 0x7fb34811e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.941+0000 7fb34d1d2700 1 --2- 172.21.15.59:0/1703053129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3480a1340 0x7fb34811ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.941+0000 7fb34d1d2700 1 -- 172.21.15.59:0/1703053129 >> 172.21.15.59:0/1703053129 conn(0x7fb3480a6550 msgr2=0x7fb3481b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:05.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.941+0000 7fb34d1d2700 1 -- 172.21.15.59:0/1703053129 shutdown_connections 2023-09-30T22:36:05.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.941+0000 7fb34d1d2700 1 -- 172.21.15.59:0/1703053129 wait complete. 2023-09-30T22:36:05.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:05.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.976+0000 7f37a7e75700 1 -- 172.21.15.59:0/182989002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37a0121ee0 con 0x7f37a0133fa0 2023-09-30T22:36:05.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.977+0000 7f379e7fc700 1 -- 172.21.15.59:0/182989002 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3790010300 con 0x7f37a0133fa0 2023-09-30T22:36:05.977 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.979+0000 7f37a7e75700 1 -- 172.21.15.59:0/182989002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a0133fa0 msgr2=0x7f37a01c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.979+0000 7f37a7e75700 1 --2- 172.21.15.59:0/182989002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a0133fa0 0x7f37a01c8f10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f379000c7c0 tx=0x7f379000cad0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.979+0000 7f37a7e75700 1 -- 172.21.15.59:0/182989002 shutdown_connections 2023-09-30T22:36:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.979+0000 7f37a7e75700 1 --2- 172.21.15.59:0/182989002 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a00a0a30 0x7f37a01c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.979+0000 7f37a7e75700 1 --2- 172.21.15.59:0/182989002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a0133fa0 0x7f37a01c8f10 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.979+0000 7f37a7e75700 1 --2- 172.21.15.59:0/182989002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37a00a1340 0x7f37a01c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:05.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.979+0000 7f37a7e75700 1 -- 172.21.15.59:0/182989002 >> 172.21.15.59:0/182989002 conn(0x7f37a00a6550 msgr2=0x7f37a01b9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:05.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.979+0000 7f37a7e75700 1 -- 172.21.15.59:0/182989002 shutdown_connections 2023-09-30T22:36:05.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:05.979+0000 7f37a7e75700 1 -- 172.21.15.59:0/182989002 wait complete. 2023-09-30T22:36:05.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:06.025 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:06.062 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:06.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.174+0000 7f4730719700 1 Processor -- start 2023-09-30T22:36:06.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.174+0000 7f4730719700 1 -- start start 2023-09-30T22:36:06.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f4730719700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47280a0a30 0x7f47280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:06.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f4730719700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47280a1340 0x7f4728133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:06.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f4730719700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4728133fa0 0x7f4728134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:06.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f4730719700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472809edd0 con 0x7f47280a0a30 2023-09-30T22:36:06.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f4730719700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472809e1f0 con 0x7f47280a1340 2023-09-30T22:36:06.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f4730719700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f472809dc50 con 0x7f4728133fa0 2023-09-30T22:36:06.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f472e4b5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47280a0a30 0x7f47280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f472dcb4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47280a1340 0x7f4728133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f472e4b5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47280a0a30 0x7f47280a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47264/0 (socket says 172.21.15.59:47264) 2023-09-30T22:36:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f472ecb6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4728133fa0 0x7f4728134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f472e4b5700 1 -- 172.21.15.59:0/1960690890 learned_addr learned my addr 172.21.15.59:0/1960690890 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f472e4b5700 1 -- 172.21.15.59:0/1960690890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4728133fa0 msgr2=0x7f4728134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f472e4b5700 1 --2- 172.21.15.59:0/1960690890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4728133fa0 0x7f4728134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f472e4b5700 1 -- 172.21.15.59:0/1960690890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47280a1340 msgr2=0x7f4728133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f472e4b5700 1 --2- 172.21.15.59:0/1960690890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47280a1340 0x7f4728133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f472e4b5700 1 -- 172.21.15.59:0/1960690890 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280a1fe0 con 0x7f47280a0a30 2023-09-30T22:36:06.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.175+0000 7f472dcb4700 1 --2- 172.21.15.59:0/1960690890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47280a1340 0x7f4728133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.176+0000 7f472e4b5700 1 --2- 172.21.15.59:0/1960690890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47280a0a30 0x7f47280a0e00 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f47200098f0 tx=0x7f4720009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eed094afc47db1e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.176+0000 7f472d4b3700 1 -- 172.21.15.59:0/1960690890 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720011830 con 0x7f47280a0a30 2023-09-30T22:36:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.176+0000 7f472d4b3700 1 -- 172.21.15.59:0/1960690890 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4720011990 con 0x7f47280a0a30 2023-09-30T22:36:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.176+0000 7f472d4b3700 1 -- 172.21.15.59:0/1960690890 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720011d20 con 0x7f47280a0a30 2023-09-30T22:36:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.176+0000 7f4730719700 1 -- 172.21.15.59:0/1960690890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47280a0a30 msgr2=0x7f47280a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.176+0000 7f4730719700 1 --2- 172.21.15.59:0/1960690890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47280a0a30 0x7f47280a0e00 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f47200098f0 tx=0x7f4720009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.177+0000 7f4730719700 1 -- 172.21.15.59:0/1960690890 shutdown_connections 2023-09-30T22:36:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.177+0000 7f4730719700 1 --2- 172.21.15.59:0/1960690890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4728133fa0 0x7f4728134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.177+0000 7f4730719700 1 --2- 172.21.15.59:0/1960690890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47280a0a30 0x7f47280a0e00 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.177+0000 7f4730719700 1 --2- 172.21.15.59:0/1960690890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47280a1340 0x7f4728133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.177+0000 7f4730719700 1 -- 172.21.15.59:0/1960690890 >> 172.21.15.59:0/1960690890 conn(0x7f47280a6550 msgr2=0x7f47280a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:06.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.177+0000 7f4730719700 1 -- 172.21.15.59:0/1960690890 shutdown_connections 2023-09-30T22:36:06.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.177+0000 7f4730719700 1 -- 172.21.15.59:0/1960690890 wait complete. 2023-09-30T22:36:06.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.178+0000 7f4730719700 1 Processor -- start 2023-09-30T22:36:06.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.178+0000 7f4730719700 1 -- start start 2023-09-30T22:36:06.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.178+0000 7f4730719700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47280a0a30 0x7f4728120150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:06.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.178+0000 7f4730719700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47280a1340 0x7f4728120690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:06.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.178+0000 7f4730719700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4728133fa0 0x7f4728120bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:06.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.178+0000 7f4730719700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4728123a70 con 0x7f4728133fa0 2023-09-30T22:36:06.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.178+0000 7f4730719700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4728123c70 con 0x7f47280a1340 2023-09-30T22:36:06.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.178+0000 7f4730719700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4728122b60 con 0x7f47280a0a30 2023-09-30T22:36:06.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.178+0000 7f472dcb4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47280a1340 0x7f4728120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:06.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.178+0000 7f472ecb6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4728133fa0 0x7f4728120bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:06.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.178+0000 7f472dcb4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47280a1340 0x7f4728120690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38102/0 (socket says 172.21.15.59:38102) 2023-09-30T22:36:06.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.178+0000 7f472dcb4700 1 -- 172.21.15.59:0/3061809270 learned_addr learned my addr 172.21.15.59:0/3061809270 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:06.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.178+0000 7f472e4b5700 1 --2- 172.21.15.59:0/3061809270 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47280a0a30 0x7f4728120150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:06.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.179+0000 7f472dcb4700 1 -- 172.21.15.59:0/3061809270 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47280a0a30 msgr2=0x7f4728120150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:06.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.179+0000 7f472dcb4700 1 --2- 172.21.15.59:0/3061809270 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47280a0a30 0x7f4728120150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.179+0000 7f472dcb4700 1 -- 172.21.15.59:0/3061809270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4728133fa0 msgr2=0x7f4728120bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.179+0000 7f472dcb4700 1 --2- 172.21.15.59:0/3061809270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4728133fa0 0x7f4728120bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.179+0000 7f472dcb4700 1 -- 172.21.15.59:0/3061809270 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c0094a0 con 0x7f47280a1340 2023-09-30T22:36:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.179+0000 7f472dcb4700 1 --2- 172.21.15.59:0/3061809270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47280a1340 0x7f4728120690 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f471c00ec10 tx=0x7f471c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.179+0000 7f4726ffd700 1 -- 172.21.15.59:0/3061809270 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c009760 con 0x7f47280a1340 2023-09-30T22:36:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.179+0000 7f4726ffd700 1 -- 172.21.15.59:0/3061809270 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c00c850 con 0x7f47280a1340 2023-09-30T22:36:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.179+0000 7f4730719700 1 -- 172.21.15.59:0/3061809270 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4720009550 con 0x7f47280a1340 2023-09-30T22:36:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.179+0000 7f4726ffd700 1 -- 172.21.15.59:0/3061809270 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c00cbe0 con 0x7f47280a1340 2023-09-30T22:36:06.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.179+0000 7f4730719700 1 -- 172.21.15.59:0/3061809270 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47280a3610 con 0x7f47280a1340 2023-09-30T22:36:06.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.180+0000 7f4726ffd700 1 -- 172.21.15.59:0/3061809270 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f471c00cd40 con 0x7f47280a1340 2023-09-30T22:36:06.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.180+0000 7f4726ffd700 1 -- 172.21.15.59:0/3061809270 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f471c03fb10 con 0x7f47280a1340 2023-09-30T22:36:06.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.181+0000 7f4730719700 1 -- 172.21.15.59:0/3061809270 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47280a0280 con 0x7f47280a1340 2023-09-30T22:36:06.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.185+0000 7f4726ffd700 1 -- 172.21.15.59:0/3061809270 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f471c01b3b0 con 0x7f47280a1340 2023-09-30T22:36:06.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.215+0000 7ff27106b700 1 Processor -- start 2023-09-30T22:36:06.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.216+0000 7ff27106b700 1 -- start start 2023-09-30T22:36:06.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.216+0000 7ff27106b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff26c09d6f0 0x7ff26c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:06.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.216+0000 7ff27106b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09e440 0x7ff26c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:06.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.216+0000 7ff27106b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c09b120 con 0x7ff26c09e000 2023-09-30T22:36:06.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.216+0000 7ff27106b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26c06b460 con 0x7ff26c09d6f0 2023-09-30T22:36:06.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.216+0000 7ff27106b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c09a7e0 con 0x7ff26c09e440 2023-09-30T22:36:06.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.216+0000 7ff26ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff26c09d6f0 0x7ff26c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:06.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.216+0000 7ff26b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09e440 0x7ff26c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:06.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.216+0000 7ff26ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff26c09d6f0 0x7ff26c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47282/0 (socket says 172.21.15.59:47282) 2023-09-30T22:36:06.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.216+0000 7ff26ad9d700 1 -- 172.21.15.59:0/1465615760 learned_addr learned my addr 172.21.15.59:0/1465615760 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:06.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.217+0000 7ff26ad9d700 1 -- 172.21.15.59:0/1465615760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09e440 msgr2=0x7ff26c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:06.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.217+0000 7ff26ad9d700 1 --2- 172.21.15.59:0/1465615760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09e440 0x7ff26c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.217+0000 7ff26ad9d700 1 -- 172.21.15.59:0/1465615760 >> v1:172.21.15.59:6789/0 conn(0x7ff26c09e000 legacy=0x7ff26c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:06.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.217+0000 7ff26ad9d700 1 -- 172.21.15.59:0/1465615760 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c09a500 con 0x7ff26c09d6f0 2023-09-30T22:36:06.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.217+0000 7ff26b59e700 1 --2- 172.21.15.59:0/1465615760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09e440 0x7ff26c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:06.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.217+0000 7ff26ad9d700 1 --2- 172.21.15.59:0/1465615760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c09d6f0 0x7ff26c09dac0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009920 tx=0x7ff25c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfc70fa78cc5c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:06.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.217+0000 7ff269d9b700 1 -- 172.21.15.59:0/1465615760 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c011830 con 0x7ff26c09d6f0 2023-09-30T22:36:06.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.217+0000 7ff269d9b700 1 -- 172.21.15.59:0/1465615760 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c011990 con 0x7ff26c09d6f0 2023-09-30T22:36:06.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.217+0000 7ff269d9b700 1 -- 172.21.15.59:0/1465615760 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c011d20 con 0x7ff26c09d6f0 2023-09-30T22:36:06.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.218+0000 7ff27106b700 1 -- 172.21.15.59:0/1465615760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c09d6f0 msgr2=0x7ff26c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:06.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.218+0000 7ff27106b700 1 --2- 172.21.15.59:0/1465615760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c09d6f0 0x7ff26c09dac0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009920 tx=0x7ff25c009c30 comp rx=0 tx=0).stop 2023-09-30T22:36:06.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.218+0000 7ff27106b700 1 -- 172.21.15.59:0/1465615760 shutdown_connections 2023-09-30T22:36:06.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.218+0000 7ff27106b700 1 --2- 172.21.15.59:0/1465615760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c09d6f0 0x7ff26c09dac0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.218+0000 7ff27106b700 1 --2- 172.21.15.59:0/1465615760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09e440 0x7ff26c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.218+0000 7ff27106b700 1 -- 172.21.15.59:0/1465615760 >> 172.21.15.59:0/1465615760 conn(0x7ff26c066f50 msgr2=0x7ff26c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:06.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.218+0000 7ff27106b700 1 -- 172.21.15.59:0/1465615760 shutdown_connections 2023-09-30T22:36:06.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.218+0000 7ff27106b700 1 -- 172.21.15.59:0/1465615760 wait complete. 2023-09-30T22:36:06.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.219+0000 7ff27106b700 1 Processor -- start 2023-09-30T22:36:06.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.220+0000 7ff27106b700 1 -- start start 2023-09-30T22:36:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.220+0000 7ff27106b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09d6f0 0x7ff26c1c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.220+0000 7ff27106b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c09e000 0x7ff26c1c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.220+0000 7ff27106b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26c09e440 0x7ff26c1c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.220+0000 7ff27106b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c1a7170 con 0x7ff26c09e000 2023-09-30T22:36:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.220+0000 7ff27106b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c1a8bd0 con 0x7ff26c09d6f0 2023-09-30T22:36:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.220+0000 7ff27106b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c1a9280 con 0x7ff26c09e440 2023-09-30T22:36:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.220+0000 7ff26ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09d6f0 0x7ff26c1c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.220+0000 7ff26a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c09e000 0x7ff26c1c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.220+0000 7ff26ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09d6f0 0x7ff26c1c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38122/0 (socket says 172.21.15.59:38122) 2023-09-30T22:36:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.220+0000 7ff26ad9d700 1 -- 172.21.15.59:0/2071538146 learned_addr learned my addr 172.21.15.59:0/2071538146 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:06.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.220+0000 7ff26b59e700 1 --2- 172.21.15.59:0/2071538146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26c09e440 0x7ff26c1c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:06.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.221+0000 7ff26ad9d700 1 -- 172.21.15.59:0/2071538146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26c09e440 msgr2=0x7ff26c1c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:06.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.221+0000 7ff26ad9d700 1 --2- 172.21.15.59:0/2071538146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26c09e440 0x7ff26c1c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.221+0000 7ff26ad9d700 1 -- 172.21.15.59:0/2071538146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c09e000 msgr2=0x7ff26c1c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:06.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.221+0000 7ff26ad9d700 1 --2- 172.21.15.59:0/2071538146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c09e000 0x7ff26c1c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.221+0000 7ff26ad9d700 1 -- 172.21.15.59:0/2071538146 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff264009a70 con 0x7ff26c09d6f0 2023-09-30T22:36:06.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.221+0000 7ff26a59c700 1 --2- 172.21.15.59:0/2071538146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c09e000 0x7ff26c1c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:06.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.221+0000 7ff26ad9d700 1 --2- 172.21.15.59:0/2071538146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09d6f0 0x7ff26c1c85f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff25c000c00 tx=0x7ff25c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:06.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.221+0000 7ff2537fe700 1 -- 172.21.15.59:0/2071538146 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0042c0 con 0x7ff26c09d6f0 2023-09-30T22:36:06.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.221+0000 7ff2537fe700 1 -- 172.21.15.59:0/2071538146 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c01f070 con 0x7ff26c09d6f0 2023-09-30T22:36:06.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.221+0000 7ff27106b700 1 -- 172.21.15.59:0/2071538146 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25c009550 con 0x7ff26c09d6f0 2023-09-30T22:36:06.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.221+0000 7ff2537fe700 1 -- 172.21.15.59:0/2071538146 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0036a0 con 0x7ff26c09d6f0 2023-09-30T22:36:06.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.221+0000 7ff27106b700 1 -- 172.21.15.59:0/2071538146 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26c1a95f0 con 0x7ff26c09d6f0 2023-09-30T22:36:06.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.222+0000 7ff27106b700 1 -- 172.21.15.59:0/2071538146 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26c074ea0 con 0x7ff26c09d6f0 2023-09-30T22:36:06.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.223+0000 7ff2537fe700 1 -- 172.21.15.59:0/2071538146 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff25c021030 con 0x7ff26c09d6f0 2023-09-30T22:36:06.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.223+0000 7ff2537fe700 1 -- 172.21.15.59:0/2071538146 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff25c040c60 con 0x7ff26c09d6f0 2023-09-30T22:36:06.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.232+0000 7ff2537fe700 1 -- 172.21.15.59:0/2071538146 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff25c0239c0 con 0x7ff26c09d6f0 2023-09-30T22:36:06.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.395+0000 7f4730719700 1 -- 172.21.15.59:0/3061809270 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4728074ea0 con 0x7f47280a1340 2023-09-30T22:36:06.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.395+0000 7f4726ffd700 1 -- 172.21.15.59:0/3061809270 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f471c021020 con 0x7f47280a1340 2023-09-30T22:36:06.395 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:06.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.397+0000 7f4730719700 1 -- 172.21.15.59:0/3061809270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47280a1340 msgr2=0x7f4728120690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:06.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.397+0000 7f4730719700 1 --2- 172.21.15.59:0/3061809270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47280a1340 0x7f4728120690 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f471c00ec10 tx=0x7f471c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:36:06.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.398+0000 7f4730719700 1 -- 172.21.15.59:0/3061809270 shutdown_connections 2023-09-30T22:36:06.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.398+0000 7f4730719700 1 --2- 172.21.15.59:0/3061809270 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47280a0a30 0x7f4728120150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.398+0000 7f4730719700 1 --2- 172.21.15.59:0/3061809270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4728133fa0 0x7f4728120bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.398+0000 7f4730719700 1 --2- 172.21.15.59:0/3061809270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47280a1340 0x7f4728120690 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.398+0000 7f4730719700 1 -- 172.21.15.59:0/3061809270 >> 172.21.15.59:0/3061809270 conn(0x7f47280a6550 msgr2=0x7f472809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:06.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.398+0000 7f4730719700 1 -- 172.21.15.59:0/3061809270 shutdown_connections 2023-09-30T22:36:06.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.398+0000 7f4730719700 1 -- 172.21.15.59:0/3061809270 wait complete. 2023-09-30T22:36:06.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:06.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.437+0000 7ff27106b700 1 -- 172.21.15.59:0/2071538146 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff26c06c360 con 0x7ff26c09d6f0 2023-09-30T22:36:06.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.437+0000 7ff2537fe700 1 -- 172.21.15.59:0/2071538146 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff25c015070 con 0x7ff26c09d6f0 2023-09-30T22:36:06.438 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:06.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.440+0000 7ff27106b700 1 -- 172.21.15.59:0/2071538146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09d6f0 msgr2=0x7ff26c1c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:06.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.440+0000 7ff27106b700 1 --2- 172.21.15.59:0/2071538146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09d6f0 0x7ff26c1c85f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff25c000c00 tx=0x7ff25c004750 comp rx=0 tx=0).stop 2023-09-30T22:36:06.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.440+0000 7ff27106b700 1 -- 172.21.15.59:0/2071538146 shutdown_connections 2023-09-30T22:36:06.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.440+0000 7ff27106b700 1 --2- 172.21.15.59:0/2071538146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff26c09e440 0x7ff26c1c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.440+0000 7ff27106b700 1 --2- 172.21.15.59:0/2071538146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c09d6f0 0x7ff26c1c85f0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.440+0000 7ff27106b700 1 --2- 172.21.15.59:0/2071538146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c09e000 0x7ff26c1c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:06.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.440+0000 7ff27106b700 1 -- 172.21.15.59:0/2071538146 >> 172.21.15.59:0/2071538146 conn(0x7ff26c066f50 msgr2=0x7ff26c1bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:06.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.440+0000 7ff27106b700 1 -- 172.21.15.59:0/2071538146 shutdown_connections 2023-09-30T22:36:06.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:06.440+0000 7ff27106b700 1 -- 172.21.15.59:0/2071538146 wait complete. 2023-09-30T22:36:06.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:06.956 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:06.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:07.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.104+0000 7fd381b27700 1 Processor -- start 2023-09-30T22:36:07.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.104+0000 7fd381b27700 1 -- start start 2023-09-30T22:36:07.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.105+0000 7fd381b27700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd37c09e930 0x7fd37c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.105+0000 7fd381b27700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd37c09f240 0x7fd37c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.105+0000 7fd381b27700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37c070940 con 0x7fd37c09f650 2023-09-30T22:36:07.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.105+0000 7fd381b27700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c06fd60 con 0x7fd37c09f240 2023-09-30T22:36:07.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.105+0000 7fd381b27700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c06fa80 con 0x7fd37c09e930 2023-09-30T22:36:07.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.105+0000 7fd37b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd37c09e930 0x7fd37c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.105+0000 7fd37affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd37c09f240 0x7fd37c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.105+0000 7fd37b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd37c09e930 0x7fd37c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38138/0 (socket says 172.21.15.59:38138) 2023-09-30T22:36:07.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.105+0000 7fd37b7fe700 1 -- 172.21.15.59:0/1527621042 learned_addr learned my addr 172.21.15.59:0/1527621042 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:07.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.105+0000 7fd37affd700 1 -- 172.21.15.59:0/1527621042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd37c09e930 msgr2=0x7fd37c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:07.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.105+0000 7fd37affd700 1 --2- 172.21.15.59:0/1527621042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd37c09e930 0x7fd37c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.105+0000 7fd37affd700 1 -- 172.21.15.59:0/1527621042 >> v1:172.21.15.59:6789/0 conn(0x7fd37c09f650 legacy=0x7fd37c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.105+0000 7fd37affd700 1 -- 172.21.15.59:0/1527621042 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c09fb60 con 0x7fd37c09f240 2023-09-30T22:36:07.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.105+0000 7fd37b7fe700 1 --2- 172.21.15.59:0/1527621042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd37c09e930 0x7fd37c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:07.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.106+0000 7fd37affd700 1 --2- 172.21.15.59:0/1527621042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd37c09f240 0x7fd37c1317f0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fd364009840 tx=0x7fd364009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddd0cd69f78cff8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:07.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.106+0000 7fd37a7fc700 1 -- 172.21.15.59:0/1527621042 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364011830 con 0x7fd37c09f240 2023-09-30T22:36:07.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.106+0000 7fd37a7fc700 1 -- 172.21.15.59:0/1527621042 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd364011990 con 0x7fd37c09f240 2023-09-30T22:36:07.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.106+0000 7fd37a7fc700 1 -- 172.21.15.59:0/1527621042 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364011d20 con 0x7fd37c09f240 2023-09-30T22:36:07.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.106+0000 7fd381b27700 1 -- 172.21.15.59:0/1527621042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd37c09f240 msgr2=0x7fd37c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.106+0000 7fd381b27700 1 --2- 172.21.15.59:0/1527621042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd37c09f240 0x7fd37c1317f0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fd364009840 tx=0x7fd364009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:07.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.106+0000 7fd381b27700 1 -- 172.21.15.59:0/1527621042 shutdown_connections 2023-09-30T22:36:07.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.106+0000 7fd381b27700 1 --2- 172.21.15.59:0/1527621042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd37c09e930 0x7fd37c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.106+0000 7fd381b27700 1 --2- 172.21.15.59:0/1527621042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd37c09f240 0x7fd37c1317f0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.106+0000 7fd381b27700 1 -- 172.21.15.59:0/1527621042 >> 172.21.15.59:0/1527621042 conn(0x7fd37c0a4210 msgr2=0x7fd37c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:07.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.107+0000 7fd381b27700 1 -- 172.21.15.59:0/1527621042 shutdown_connections 2023-09-30T22:36:07.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.107+0000 7fd381b27700 1 -- 172.21.15.59:0/1527621042 wait complete. 2023-09-30T22:36:07.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.107+0000 7fd381b27700 1 Processor -- start 2023-09-30T22:36:07.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.108+0000 7fd381b27700 1 -- start start 2023-09-30T22:36:07.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.108+0000 7fd381b27700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd37c09e930 0x7fd37c1a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.108+0000 7fd381b27700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd37c09f240 0x7fd37c1a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.108+0000 7fd381b27700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd37c09f650 0x7fd37c1c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.108+0000 7fd381b27700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c1a82c0 con 0x7fd37c09f650 2023-09-30T22:36:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.108+0000 7fd381b27700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c1a84a0 con 0x7fd37c09e930 2023-09-30T22:36:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.108+0000 7fd381b27700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c1b9310 con 0x7fd37c09f240 2023-09-30T22:36:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.108+0000 7fd37b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd37c09e930 0x7fd37c1a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.108+0000 7fd37bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd37c09f650 0x7fd37c1c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.108+0000 7fd37affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd37c09f240 0x7fd37c1a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.108+0000 7fd37b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd37c09e930 0x7fd37c1a53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38148/0 (socket says 172.21.15.59:38148) 2023-09-30T22:36:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.108+0000 7fd37b7fe700 1 -- 172.21.15.59:0/3885771162 learned_addr learned my addr 172.21.15.59:0/3885771162 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.109+0000 7fd37b7fe700 1 -- 172.21.15.59:0/3885771162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd37c09f240 msgr2=0x7fd37c1a5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.109+0000 7fd37b7fe700 1 --2- 172.21.15.59:0/3885771162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd37c09f240 0x7fd37c1a5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.109+0000 7fd37b7fe700 1 -- 172.21.15.59:0/3885771162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd37c09f650 msgr2=0x7fd37c1c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.109+0000 7fd37b7fe700 1 --2- 172.21.15.59:0/3885771162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd37c09f650 0x7fd37c1c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.109+0000 7fd37b7fe700 1 -- 172.21.15.59:0/3885771162 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c009b30 con 0x7fd37c09e930 2023-09-30T22:36:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.109+0000 7fd37b7fe700 1 --2- 172.21.15.59:0/3885771162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd37c09e930 0x7fd37c1a53e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009f20 tx=0x7fd36c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.109+0000 7fd373fff700 1 -- 172.21.15.59:0/3885771162 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00cbc0 con 0x7fd37c09e930 2023-09-30T22:36:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.109+0000 7fd373fff700 1 -- 172.21.15.59:0/3885771162 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c00f040 con 0x7fd37c09e930 2023-09-30T22:36:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.109+0000 7fd373fff700 1 -- 172.21.15.59:0/3885771162 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c014480 con 0x7fd37c09e930 2023-09-30T22:36:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.109+0000 7fd381b27700 1 -- 172.21.15.59:0/3885771162 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3640094a0 con 0x7fd37c09e930 2023-09-30T22:36:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.109+0000 7fd381b27700 1 -- 172.21.15.59:0/3885771162 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c0a0190 con 0x7fd37c09e930 2023-09-30T22:36:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.110+0000 7fd373fff700 1 -- 172.21.15.59:0/3885771162 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd36c0145e0 con 0x7fd37c09e930 2023-09-30T22:36:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.110+0000 7fd381b27700 1 -- 172.21.15.59:0/3885771162 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c1a6b80 con 0x7fd37c09e930 2023-09-30T22:36:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.110+0000 7fd373fff700 1 -- 172.21.15.59:0/3885771162 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd36c03fbe0 con 0x7fd37c09e930 2023-09-30T22:36:07.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.115+0000 7fd373fff700 1 -- 172.21.15.59:0/3885771162 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd36c0137e0 con 0x7fd37c09e930 2023-09-30T22:36:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.143+0000 7f8611d77700 1 Processor -- start 2023-09-30T22:36:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.143+0000 7f8611d77700 1 -- start start 2023-09-30T22:36:07.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f8611d77700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f860c0a1510 0x7f860c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f8611d77700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f860c139250 0x7f860c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f8611d77700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c09edd0 con 0x7f860c0a0a30 2023-09-30T22:36:07.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f8611d77700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860c0a18e0 con 0x7f860c0a1510 2023-09-30T22:36:07.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f8611d77700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f860c09e1f0 con 0x7f860c139250 2023-09-30T22:36:07.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f860affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f860c0a1510 0x7f860c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f860bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f860c139250 0x7f860c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f860bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f860c139250 0x7f860c13b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60008/0 (socket says 172.21.15.59:60008) 2023-09-30T22:36:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f860affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f860c0a1510 0x7f860c138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47326/0 (socket says 172.21.15.59:47326) 2023-09-30T22:36:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f860bfff700 1 -- 172.21.15.59:0/1198326572 learned_addr learned my addr 172.21.15.59:0/1198326572 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f860affd700 1 -- 172.21.15.59:0/1198326572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f860c139250 msgr2=0x7f860c13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f860affd700 1 --2- 172.21.15.59:0/1198326572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f860c139250 0x7f860c13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f860affd700 1 -- 172.21.15.59:0/1198326572 >> v1:172.21.15.59:6789/0 conn(0x7f860c0a0a30 legacy=0x7f860c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f860affd700 1 -- 172.21.15.59:0/1198326572 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c09dc50 con 0x7f860c0a1510 2023-09-30T22:36:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f860bfff700 1 --2- 172.21.15.59:0/1198326572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f860c139250 0x7f860c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.144+0000 7f860affd700 1 --2- 172.21.15.59:0/1198326572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f860c0a1510 0x7f860c138d10 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f8600009840 tx=0x7f8600009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fef12b091d0851 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.145+0000 7f860a7fc700 1 -- 172.21.15.59:0/1198326572 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600011830 con 0x7f860c0a1510 2023-09-30T22:36:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.145+0000 7f860a7fc700 1 -- 172.21.15.59:0/1198326572 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8600011990 con 0x7f860c0a1510 2023-09-30T22:36:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.145+0000 7f860a7fc700 1 -- 172.21.15.59:0/1198326572 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600011d20 con 0x7f860c0a1510 2023-09-30T22:36:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.145+0000 7f8611d77700 1 -- 172.21.15.59:0/1198326572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f860c0a1510 msgr2=0x7f860c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.145+0000 7f8611d77700 1 --2- 172.21.15.59:0/1198326572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f860c0a1510 0x7f860c138d10 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f8600009840 tx=0x7f8600009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.145+0000 7f8611d77700 1 -- 172.21.15.59:0/1198326572 shutdown_connections 2023-09-30T22:36:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.145+0000 7f8611d77700 1 --2- 172.21.15.59:0/1198326572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f860c139250 0x7f860c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.145+0000 7f8611d77700 1 --2- 172.21.15.59:0/1198326572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f860c0a1510 0x7f860c138d10 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.145+0000 7f8611d77700 1 -- 172.21.15.59:0/1198326572 >> 172.21.15.59:0/1198326572 conn(0x7f860c0a6550 msgr2=0x7f860c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.145+0000 7f8611d77700 1 -- 172.21.15.59:0/1198326572 shutdown_connections 2023-09-30T22:36:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.145+0000 7f8611d77700 1 -- 172.21.15.59:0/1198326572 wait complete. 2023-09-30T22:36:07.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.147+0000 7f8611d77700 1 Processor -- start 2023-09-30T22:36:07.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.147+0000 7f8611d77700 1 -- start start 2023-09-30T22:36:07.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.147+0000 7f8611d77700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f860c0a0a30 0x7f860c1218c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.147+0000 7f8611d77700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f860c0a1510 0x7f860c121e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f8611d77700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f860c139250 0x7f860c122340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f8611d77700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c1236c0 con 0x7f860c139250 2023-09-30T22:36:07.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f8611d77700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c1234d0 con 0x7f860c0a1510 2023-09-30T22:36:07.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f8611d77700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f860c1253e0 con 0x7f860c0a0a30 2023-09-30T22:36:07.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f860affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f860c0a1510 0x7f860c121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f860bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f860c139250 0x7f860c122340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f860affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f860c0a1510 0x7f860c121e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38162/0 (socket says 172.21.15.59:38162) 2023-09-30T22:36:07.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f860affd700 1 -- 172.21.15.59:0/519030549 learned_addr learned my addr 172.21.15.59:0/519030549 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:07.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f860b7fe700 1 --2- 172.21.15.59:0/519030549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f860c0a0a30 0x7f860c1218c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f860affd700 1 -- 172.21.15.59:0/519030549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f860c0a0a30 msgr2=0x7f860c1218c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f860affd700 1 --2- 172.21.15.59:0/519030549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f860c0a0a30 0x7f860c1218c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f860affd700 1 -- 172.21.15.59:0/519030549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f860c139250 msgr2=0x7f860c122340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f860affd700 1 --2- 172.21.15.59:0/519030549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f860c139250 0x7f860c122340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f860affd700 1 -- 172.21.15.59:0/519030549 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8604009b30 con 0x7f860c0a1510 2023-09-30T22:36:07.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f860bfff700 1 --2- 172.21.15.59:0/519030549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f860c139250 0x7f860c122340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:07.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f860affd700 1 --2- 172.21.15.59:0/519030549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f860c0a1510 0x7f860c121e00 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8600009fd0 tx=0x7f8600004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:07.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.148+0000 7f85f3fff700 1 -- 172.21.15.59:0/519030549 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000036a0 con 0x7f860c0a1510 2023-09-30T22:36:07.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.149+0000 7f85f3fff700 1 -- 172.21.15.59:0/519030549 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860001f070 con 0x7f860c0a1510 2023-09-30T22:36:07.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.149+0000 7f8611d77700 1 -- 172.21.15.59:0/519030549 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86000094a0 con 0x7f860c0a1510 2023-09-30T22:36:07.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.149+0000 7f85f3fff700 1 -- 172.21.15.59:0/519030549 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600003a60 con 0x7f860c0a1510 2023-09-30T22:36:07.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.149+0000 7f8611d77700 1 -- 172.21.15.59:0/519030549 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c125100 con 0x7f860c0a1510 2023-09-30T22:36:07.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.149+0000 7f85f3fff700 1 -- 172.21.15.59:0/519030549 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8600003bc0 con 0x7f860c0a1510 2023-09-30T22:36:07.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.150+0000 7f85f3fff700 1 -- 172.21.15.59:0/519030549 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8600021070 con 0x7f860c0a1510 2023-09-30T22:36:07.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.150+0000 7f8611d77700 1 -- 172.21.15.59:0/519030549 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860c124f60 con 0x7f860c0a1510 2023-09-30T22:36:07.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.155+0000 7f85f3fff700 1 -- 172.21.15.59:0/519030549 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f860c124f60 con 0x7f860c0a1510 2023-09-30T22:36:07.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.321+0000 7fd381b27700 1 -- 172.21.15.59:0/3885771162 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd37c1a8120 con 0x7fd37c09e930 2023-09-30T22:36:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.322+0000 7fd373fff700 1 -- 172.21.15.59:0/3885771162 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd37c1a8120 con 0x7fd37c09e930 2023-09-30T22:36:07.322 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:07.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.324+0000 7fd381b27700 1 -- 172.21.15.59:0/3885771162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd37c09e930 msgr2=0x7fd37c1a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.324+0000 7fd381b27700 1 --2- 172.21.15.59:0/3885771162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd37c09e930 0x7fd37c1a53e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009f20 tx=0x7fd36c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.324+0000 7fd381b27700 1 -- 172.21.15.59:0/3885771162 shutdown_connections 2023-09-30T22:36:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.324+0000 7fd381b27700 1 --2- 172.21.15.59:0/3885771162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd37c09f650 0x7fd37c1c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.324+0000 7fd381b27700 1 --2- 172.21.15.59:0/3885771162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd37c09e930 0x7fd37c1a53e0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.324+0000 7fd381b27700 1 --2- 172.21.15.59:0/3885771162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd37c09f240 0x7fd37c1a5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.324+0000 7fd381b27700 1 -- 172.21.15.59:0/3885771162 >> 172.21.15.59:0/3885771162 conn(0x7fd37c0a4210 msgr2=0x7fd37c06c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.324+0000 7fd381b27700 1 -- 172.21.15.59:0/3885771162 shutdown_connections 2023-09-30T22:36:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.324+0000 7fd381b27700 1 -- 172.21.15.59:0/3885771162 wait complete. 2023-09-30T22:36:07.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.362+0000 7f8611d77700 1 -- 172.21.15.59:0/519030549 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f860c0a1d10 con 0x7f860c0a1510 2023-09-30T22:36:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.362+0000 7f85f3fff700 1 -- 172.21.15.59:0/519030549 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8600015020 con 0x7f860c0a1510 2023-09-30T22:36:07.362 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.364+0000 7f8611d77700 1 -- 172.21.15.59:0/519030549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f860c0a1510 msgr2=0x7f860c121e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.364+0000 7f8611d77700 1 --2- 172.21.15.59:0/519030549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f860c0a1510 0x7f860c121e00 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8600009fd0 tx=0x7f8600004750 comp rx=0 tx=0).stop 2023-09-30T22:36:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.364+0000 7f8611d77700 1 -- 172.21.15.59:0/519030549 shutdown_connections 2023-09-30T22:36:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.364+0000 7f8611d77700 1 --2- 172.21.15.59:0/519030549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f860c0a0a30 0x7f860c1218c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.364+0000 7f8611d77700 1 --2- 172.21.15.59:0/519030549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f860c139250 0x7f860c122340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.364+0000 7f8611d77700 1 --2- 172.21.15.59:0/519030549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f860c0a1510 0x7f860c121e00 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.364+0000 7f8611d77700 1 -- 172.21.15.59:0/519030549 >> 172.21.15.59:0/519030549 conn(0x7f860c0a6550 msgr2=0x7f860c137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.365+0000 7f8611d77700 1 -- 172.21.15.59:0/519030549 shutdown_connections 2023-09-30T22:36:07.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.365+0000 7f8611d77700 1 -- 172.21.15.59:0/519030549 wait complete. 2023-09-30T22:36:07.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:07.413 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:07.455 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:07.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.561+0000 7f9153722700 1 Processor -- start 2023-09-30T22:36:07.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.561+0000 7f9153722700 1 -- start start 2023-09-30T22:36:07.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.561+0000 7f9153722700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f914c1337f0 0x7f914c138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.561+0000 7f9153722700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f914c138dc0 0x7f914c13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.561+0000 7f9153722700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914c06b990 con 0x7f914c133420 2023-09-30T22:36:07.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.561+0000 7f9153722700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c09b0e0 con 0x7f914c1337f0 2023-09-30T22:36:07.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.561+0000 7f9153722700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f914c133c20 con 0x7f914c138dc0 2023-09-30T22:36:07.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.562+0000 7f9150cbd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f914c1337f0 0x7f914c138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.562+0000 7f91514be700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f914c133420 0x7f914c133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57528/0 (socket says 172.21.15.59:57528) 2023-09-30T22:36:07.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.562+0000 7f91514be700 1 -- 172.21.15.59:0/1325226260 learned_addr learned my addr 172.21.15.59:0/1325226260 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.562+0000 7f9151cbf700 1 --2- 172.21.15.59:0/1325226260 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f914c138dc0 0x7f914c13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.562+0000 7f9143fff700 1 -- 172.21.15.59:0/1325226260 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839060698 0 0) 0x7f914c06b990 con 0x7f914c133420 2023-09-30T22:36:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.562+0000 7f9143fff700 1 -- 172.21.15.59:0/1325226260 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91380035b0 con 0x7f914c133420 2023-09-30T22:36:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.562+0000 7f9151cbf700 1 -- 172.21.15.59:0/1325226260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f914c1337f0 msgr2=0x7f914c138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.562+0000 7f9151cbf700 1 --2- 172.21.15.59:0/1325226260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f914c1337f0 0x7f914c138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.562+0000 7f9151cbf700 1 -- 172.21.15.59:0/1325226260 >> v1:172.21.15.59:6789/0 conn(0x7f914c133420 legacy=0x7f914c133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.562+0000 7f9151cbf700 1 -- 172.21.15.59:0/1325226260 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c0a0590 con 0x7f914c138dc0 2023-09-30T22:36:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.562+0000 7f9150cbd700 1 --2- 172.21.15.59:0/1325226260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f914c1337f0 0x7f914c138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.562+0000 7f9151cbf700 1 --2- 172.21.15.59:0/1325226260 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f914c138dc0 0x7f914c13b1a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9144009dc0 tx=0x7f914400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce6f3366137571b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.562+0000 7f9143fff700 1 -- 172.21.15.59:0/1325226260 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914400e070 con 0x7f914c138dc0 2023-09-30T22:36:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.563+0000 7f9143fff700 1 -- 172.21.15.59:0/1325226260 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914400bb20 con 0x7f914c138dc0 2023-09-30T22:36:07.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.563+0000 7f9143fff700 1 -- 172.21.15.59:0/1325226260 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144012430 con 0x7f914c138dc0 2023-09-30T22:36:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.563+0000 7f9153722700 1 -- 172.21.15.59:0/1325226260 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f914c138dc0 msgr2=0x7f914c13b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.563+0000 7f9153722700 1 --2- 172.21.15.59:0/1325226260 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f914c138dc0 0x7f914c13b1a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9144009dc0 tx=0x7f914400b330 comp rx=0 tx=0).stop 2023-09-30T22:36:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.563+0000 7f9153722700 1 -- 172.21.15.59:0/1325226260 shutdown_connections 2023-09-30T22:36:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.563+0000 7f9153722700 1 --2- 172.21.15.59:0/1325226260 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f914c138dc0 0x7f914c13b1a0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.563+0000 7f9153722700 1 --2- 172.21.15.59:0/1325226260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f914c1337f0 0x7f914c138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.563+0000 7f9153722700 1 -- 172.21.15.59:0/1325226260 >> 172.21.15.59:0/1325226260 conn(0x7f914c0a4210 msgr2=0x7f914c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.563+0000 7f9153722700 1 -- 172.21.15.59:0/1325226260 shutdown_connections 2023-09-30T22:36:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.563+0000 7f9153722700 1 -- 172.21.15.59:0/1325226260 wait complete. 2023-09-30T22:36:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.565+0000 7f9153722700 1 Processor -- start 2023-09-30T22:36:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.565+0000 7f9153722700 1 -- start start 2023-09-30T22:36:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9153722700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f914c133420 0x7f914c12ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9153722700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f914c1337f0 0x7f914c12f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9153722700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f914c138dc0 0x7f914c12f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9153722700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c09c980 con 0x7f914c133420 2023-09-30T22:36:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9153722700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c09d800 con 0x7f914c138dc0 2023-09-30T22:36:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9153722700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f914c130760 con 0x7f914c1337f0 2023-09-30T22:36:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9150cbd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f914c1337f0 0x7f914c12f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f91514be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f914c133420 0x7f914c12ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9150cbd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f914c1337f0 0x7f914c12f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60038/0 (socket says 172.21.15.59:60038) 2023-09-30T22:36:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9150cbd700 1 -- 172.21.15.59:0/1343941407 learned_addr learned my addr 172.21.15.59:0/1343941407 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9151cbf700 1 --2- 172.21.15.59:0/1343941407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f914c138dc0 0x7f914c12f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9150cbd700 1 -- 172.21.15.59:0/1343941407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f914c138dc0 msgr2=0x7f914c12f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9150cbd700 1 --2- 172.21.15.59:0/1343941407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f914c138dc0 0x7f914c12f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9150cbd700 1 -- 172.21.15.59:0/1343941407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f914c133420 msgr2=0x7f914c12ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9150cbd700 1 --2- 172.21.15.59:0/1343941407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f914c133420 0x7f914c12ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9150cbd700 1 -- 172.21.15.59:0/1343941407 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c0094a0 con 0x7f914c1337f0 2023-09-30T22:36:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.566+0000 7f9150cbd700 1 --2- 172.21.15.59:0/1343941407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f914c1337f0 0x7f914c12f390 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f913c00ebe0 tx=0x7f913c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.567+0000 7f9141ffb700 1 -- 172.21.15.59:0/1343941407 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c00c850 con 0x7f914c1337f0 2023-09-30T22:36:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.567+0000 7f9141ffb700 1 -- 172.21.15.59:0/1343941407 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c00c9b0 con 0x7f914c1337f0 2023-09-30T22:36:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.567+0000 7f9141ffb700 1 -- 172.21.15.59:0/1343941407 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c00cd40 con 0x7f914c1337f0 2023-09-30T22:36:07.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.567+0000 7f9153722700 1 -- 172.21.15.59:0/1343941407 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9144009a70 con 0x7f914c1337f0 2023-09-30T22:36:07.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.567+0000 7f9153722700 1 -- 172.21.15.59:0/1343941407 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c09b870 con 0x7f914c1337f0 2023-09-30T22:36:07.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.568+0000 7f9141ffb700 1 -- 172.21.15.59:0/1343941407 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f913c013470 con 0x7f914c1337f0 2023-09-30T22:36:07.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.568+0000 7f9141ffb700 1 -- 172.21.15.59:0/1343941407 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f913c03fb50 con 0x7f914c1337f0 2023-09-30T22:36:07.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.568+0000 7f9153722700 1 -- 172.21.15.59:0/1343941407 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c074ea0 con 0x7f914c1337f0 2023-09-30T22:36:07.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.573+0000 7f9141ffb700 1 -- 172.21.15.59:0/1343941407 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f913c021080 con 0x7f914c1337f0 2023-09-30T22:36:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.603+0000 7f1e95ecd700 1 Processor -- start 2023-09-30T22:36:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.603+0000 7f1e95ecd700 1 -- start start 2023-09-30T22:36:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.603+0000 7f1e95ecd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e9009c650 0x7f1e9009ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.603+0000 7f1e95ecd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e900a0090 0x7f1e9009cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.603+0000 7f1e95ecd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9009ba70 con 0x7f1e90131970 2023-09-30T22:36:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.603+0000 7f1e95ecd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9009d4a0 con 0x7f1e900a0090 2023-09-30T22:36:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.603+0000 7f1e95ecd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9009e8f0 con 0x7f1e9009c650 2023-09-30T22:36:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.603+0000 7f1e8effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e900a0090 0x7f1e9009cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.603+0000 7f1e8ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1e90131970 0x7f1e90131e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57544/0 (socket says 172.21.15.59:57544) 2023-09-30T22:36:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.603+0000 7f1e8ffff700 1 -- 172.21.15.59:0/238014415 learned_addr learned my addr 172.21.15.59:0/238014415 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.604+0000 7f1e8f7fe700 1 --2- 172.21.15.59:0/238014415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e9009c650 0x7f1e9009ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.604+0000 7f1e8f7fe700 1 -- 172.21.15.59:0/238014415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e900a0090 msgr2=0x7f1e9009cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.604+0000 7f1e8f7fe700 1 --2- 172.21.15.59:0/238014415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e900a0090 0x7f1e9009cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.604+0000 7f1e8f7fe700 1 -- 172.21.15.59:0/238014415 >> v1:172.21.15.59:6789/0 conn(0x7f1e90131970 legacy=0x7f1e90131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.604+0000 7f1e8f7fe700 1 -- 172.21.15.59:0/238014415 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e900a0760 con 0x7f1e9009c650 2023-09-30T22:36:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.604+0000 7f1e8effd700 1 --2- 172.21.15.59:0/238014415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e900a0090 0x7f1e9009cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.604+0000 7f1e8e7fc700 1 -- 172.21.15.59:0/238014415 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560101755 0 0) 0x7f1e9009ba70 con 0x7f1e90131970 2023-09-30T22:36:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.604+0000 7f1e8f7fe700 1 --2- 172.21.15.59:0/238014415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e9009c650 0x7f1e9009ca20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f1e800098a0 tx=0x7f1e80009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecb68415d25f843 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.604+0000 7f1e8e7fc700 1 -- 172.21.15.59:0/238014415 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80011830 con 0x7f1e9009c650 2023-09-30T22:36:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.604+0000 7f1e8e7fc700 1 -- 172.21.15.59:0/238014415 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e80011990 con 0x7f1e9009c650 2023-09-30T22:36:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.604+0000 7f1e8e7fc700 1 -- 172.21.15.59:0/238014415 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80011d20 con 0x7f1e9009c650 2023-09-30T22:36:07.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.605+0000 7f1e95ecd700 1 -- 172.21.15.59:0/238014415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e9009c650 msgr2=0x7f1e9009ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.605+0000 7f1e95ecd700 1 --2- 172.21.15.59:0/238014415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e9009c650 0x7f1e9009ca20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f1e800098a0 tx=0x7f1e80009bb0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.605+0000 7f1e95ecd700 1 -- 172.21.15.59:0/238014415 shutdown_connections 2023-09-30T22:36:07.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.605+0000 7f1e95ecd700 1 --2- 172.21.15.59:0/238014415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e9009c650 0x7f1e9009ca20 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.605+0000 7f1e95ecd700 1 --2- 172.21.15.59:0/238014415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e900a0090 0x7f1e9009cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.605+0000 7f1e95ecd700 1 -- 172.21.15.59:0/238014415 >> 172.21.15.59:0/238014415 conn(0x7f1e900a3f70 msgr2=0x7f1e900a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.605+0000 7f1e95ecd700 1 -- 172.21.15.59:0/238014415 shutdown_connections 2023-09-30T22:36:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.605+0000 7f1e95ecd700 1 -- 172.21.15.59:0/238014415 wait complete. 2023-09-30T22:36:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.606+0000 7f1e95ecd700 1 Processor -- start 2023-09-30T22:36:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.606+0000 7f1e95ecd700 1 -- start start 2023-09-30T22:36:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e95ecd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e9009c650 0x7f1e9006b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e95ecd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e900a0090 0x7f1e9006bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e95ecd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e90131970 0x7f1e9006c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e95ecd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9011efd0 con 0x7f1e90131970 2023-09-30T22:36:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e95ecd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9011f910 con 0x7f1e9009c650 2023-09-30T22:36:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e95ecd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9012d540 con 0x7f1e900a0090 2023-09-30T22:36:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e8f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e9009c650 0x7f1e9006b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e8effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e900a0090 0x7f1e9006bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e8f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e9009c650 0x7f1e9006b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38196/0 (socket says 172.21.15.59:38196) 2023-09-30T22:36:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e8f7fe700 1 -- 172.21.15.59:0/428434628 learned_addr learned my addr 172.21.15.59:0/428434628 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e8ffff700 1 --2- 172.21.15.59:0/428434628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e90131970 0x7f1e9006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e8effd700 1 -- 172.21.15.59:0/428434628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e9009c650 msgr2=0x7f1e9006b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e8effd700 1 --2- 172.21.15.59:0/428434628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e9009c650 0x7f1e9006b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e8effd700 1 -- 172.21.15.59:0/428434628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e90131970 msgr2=0x7f1e9006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e8effd700 1 --2- 172.21.15.59:0/428434628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e90131970 0x7f1e9006c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e8effd700 1 -- 172.21.15.59:0/428434628 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e840094a0 con 0x7f1e900a0090 2023-09-30T22:36:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.607+0000 7f1e8effd700 1 --2- 172.21.15.59:0/428434628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e900a0090 0x7f1e9006bdc0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400e980 tx=0x7f1e8400ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.608+0000 7f1e77fff700 1 -- 172.21.15.59:0/428434628 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8400c690 con 0x7f1e900a0090 2023-09-30T22:36:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.608+0000 7f1e77fff700 1 -- 172.21.15.59:0/428434628 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8400c7f0 con 0x7f1e900a0090 2023-09-30T22:36:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.608+0000 7f1e95ecd700 1 -- 172.21.15.59:0/428434628 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e800094a0 con 0x7f1e900a0090 2023-09-30T22:36:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.608+0000 7f1e77fff700 1 -- 172.21.15.59:0/428434628 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8400cb80 con 0x7f1e900a0090 2023-09-30T22:36:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.608+0000 7f1e95ecd700 1 -- 172.21.15.59:0/428434628 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9011eac0 con 0x7f1e900a0090 2023-09-30T22:36:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.609+0000 7f1e77fff700 1 -- 172.21.15.59:0/428434628 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e8400cce0 con 0x7f1e900a0090 2023-09-30T22:36:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.609+0000 7f1e77fff700 1 -- 172.21.15.59:0/428434628 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e8403f6e0 con 0x7f1e900a0090 2023-09-30T22:36:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.609+0000 7f1e95ecd700 1 -- 172.21.15.59:0/428434628 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e900a3610 con 0x7f1e900a0090 2023-09-30T22:36:07.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.614+0000 7f1e77fff700 1 -- 172.21.15.59:0/428434628 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e84021020 con 0x7f1e900a0090 2023-09-30T22:36:07.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.780+0000 7f9153722700 1 -- 172.21.15.59:0/1343941407 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f914c06b250 con 0x7f914c1337f0 2023-09-30T22:36:07.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.781+0000 7f9141ffb700 1 -- 172.21.15.59:0/1343941407 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f913c017020 con 0x7f914c1337f0 2023-09-30T22:36:07.781 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:07.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.783+0000 7f9153722700 1 -- 172.21.15.59:0/1343941407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f914c1337f0 msgr2=0x7f914c12f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.783+0000 7f9153722700 1 --2- 172.21.15.59:0/1343941407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f914c1337f0 0x7f914c12f390 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f913c00ebe0 tx=0x7f913c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.783+0000 7f9153722700 1 -- 172.21.15.59:0/1343941407 shutdown_connections 2023-09-30T22:36:07.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.783+0000 7f9153722700 1 --2- 172.21.15.59:0/1343941407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f914c138dc0 0x7f914c12f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.783+0000 7f9153722700 1 --2- 172.21.15.59:0/1343941407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f914c133420 0x7f914c12ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.783+0000 7f9153722700 1 --2- 172.21.15.59:0/1343941407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f914c1337f0 0x7f914c12f390 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.783+0000 7f9153722700 1 -- 172.21.15.59:0/1343941407 >> 172.21.15.59:0/1343941407 conn(0x7f914c0a4210 msgr2=0x7f914c099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:07.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.783+0000 7f9153722700 1 -- 172.21.15.59:0/1343941407 shutdown_connections 2023-09-30T22:36:07.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.783+0000 7f9153722700 1 -- 172.21.15.59:0/1343941407 wait complete. 2023-09-30T22:36:07.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:07.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.818+0000 7f1e95ecd700 1 -- 172.21.15.59:0/428434628 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1e900747f0 con 0x7f1e900a0090 2023-09-30T22:36:07.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.818+0000 7f1e77fff700 1 -- 172.21.15.59:0/428434628 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e8401bba0 con 0x7f1e900a0090 2023-09-30T22:36:07.819 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:07.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.820+0000 7f1e95ecd700 1 -- 172.21.15.59:0/428434628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e900a0090 msgr2=0x7f1e9006bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:07.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.820+0000 7f1e95ecd700 1 --2- 172.21.15.59:0/428434628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e900a0090 0x7f1e9006bdc0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400e980 tx=0x7f1e8400ec90 comp rx=0 tx=0).stop 2023-09-30T22:36:07.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.820+0000 7f1e95ecd700 1 -- 172.21.15.59:0/428434628 shutdown_connections 2023-09-30T22:36:07.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.820+0000 7f1e95ecd700 1 --2- 172.21.15.59:0/428434628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e90131970 0x7f1e9006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.820+0000 7f1e95ecd700 1 --2- 172.21.15.59:0/428434628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e9009c650 0x7f1e9006b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.820+0000 7f1e95ecd700 1 --2- 172.21.15.59:0/428434628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e900a0090 0x7f1e9006bdc0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:07.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.820+0000 7f1e95ecd700 1 -- 172.21.15.59:0/428434628 >> 172.21.15.59:0/428434628 conn(0x7f1e900a3f70 msgr2=0x7f1e9012ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:07.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.821+0000 7f1e95ecd700 1 -- 172.21.15.59:0/428434628 shutdown_connections 2023-09-30T22:36:07.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:07.821+0000 7f1e95ecd700 1 -- 172.21.15.59:0/428434628 wait complete. 2023-09-30T22:36:07.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:08.340 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:08.380 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:08.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.490+0000 7f03bdbc8700 1 Processor -- start 2023-09-30T22:36:08.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.490+0000 7f03bdbc8700 1 -- start start 2023-09-30T22:36:08.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03bdbc8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03b80a09c0 0x7f03b806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03bdbc8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b8138cf0 0x7f03b813b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03bdbc8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b80a2a20 con 0x7f03b80a0d90 2023-09-30T22:36:08.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03bdbc8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b809e690 con 0x7f03b8138cf0 2023-09-30T22:36:08.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03bdbc8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80a1cc0 con 0x7f03b80a09c0 2023-09-30T22:36:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03b77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03b80a09c0 0x7f03b806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03b7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b8138cf0 0x7f03b813b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03b77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03b80a09c0 0x7f03b806c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60066/0 (socket says 172.21.15.59:60066) 2023-09-30T22:36:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03b6ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f03b80a0d90 0x7f03b80a11c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57556/0 (socket says 172.21.15.59:57556) 2023-09-30T22:36:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03b77fe700 1 -- 172.21.15.59:0/1602686040 learned_addr learned my addr 172.21.15.59:0/1602686040 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03b7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b8138cf0 0x7f03b813b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38208/0 (socket says 172.21.15.59:38208) 2023-09-30T22:36:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03b77fe700 1 -- 172.21.15.59:0/1602686040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b8138cf0 msgr2=0x7f03b813b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03b77fe700 1 --2- 172.21.15.59:0/1602686040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b8138cf0 0x7f03b813b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03b77fe700 1 -- 172.21.15.59:0/1602686040 >> v1:172.21.15.59:6789/0 conn(0x7f03b80a0d90 legacy=0x7f03b80a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03b77fe700 1 -- 172.21.15.59:0/1602686040 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b80a1f40 con 0x7f03b80a09c0 2023-09-30T22:36:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03b67fc700 1 -- 172.21.15.59:0/1602686040 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273436497 0 0) 0x7f03a0001110 con 0x7f03b80a0d90 2023-09-30T22:36:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03b7fff700 1 --2- 172.21.15.59:0/1602686040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b8138cf0 0x7f03b813b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.491+0000 7f03b77fe700 1 --2- 172.21.15.59:0/1602686040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03b80a09c0 0x7f03b806c5d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009e80 tx=0x7f03a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=893649f3f18b94d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.492+0000 7f03b67fc700 1 -- 172.21.15.59:0/1602686040 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a800e070 con 0x7f03b80a09c0 2023-09-30T22:36:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.492+0000 7f03b67fc700 1 -- 172.21.15.59:0/1602686040 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a800b910 con 0x7f03b80a09c0 2023-09-30T22:36:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.492+0000 7f03b67fc700 1 -- 172.21.15.59:0/1602686040 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a800bcc0 con 0x7f03b80a09c0 2023-09-30T22:36:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.492+0000 7f03bdbc8700 1 -- 172.21.15.59:0/1602686040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03b80a09c0 msgr2=0x7f03b806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.492+0000 7f03bdbc8700 1 --2- 172.21.15.59:0/1602686040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03b80a09c0 0x7f03b806c5d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009e80 tx=0x7f03a800b330 comp rx=0 tx=0).stop 2023-09-30T22:36:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.492+0000 7f03bdbc8700 1 -- 172.21.15.59:0/1602686040 shutdown_connections 2023-09-30T22:36:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.492+0000 7f03bdbc8700 1 --2- 172.21.15.59:0/1602686040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03b80a09c0 0x7f03b806c5d0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.492+0000 7f03bdbc8700 1 --2- 172.21.15.59:0/1602686040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b8138cf0 0x7f03b813b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.492+0000 7f03bdbc8700 1 -- 172.21.15.59:0/1602686040 >> 172.21.15.59:0/1602686040 conn(0x7f03b80a60c0 msgr2=0x7f03b80a64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:08.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.492+0000 7f03bdbc8700 1 -- 172.21.15.59:0/1602686040 shutdown_connections 2023-09-30T22:36:08.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.492+0000 7f03bdbc8700 1 -- 172.21.15.59:0/1602686040 wait complete. 2023-09-30T22:36:08.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.493+0000 7f03bdbc8700 1 Processor -- start 2023-09-30T22:36:08.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.494+0000 7f03bdbc8700 1 -- start start 2023-09-30T22:36:08.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.494+0000 7f03bdbc8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b80a09c0 0x7f03b81337b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.494+0000 7f03bdbc8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b80a0d90 0x7f03b8133cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.494+0000 7f03bdbc8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03b8138cf0 0x7f03b8134230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.494+0000 7f03bdbc8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b81360f0 con 0x7f03b80a0d90 2023-09-30T22:36:08.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.494+0000 7f03bdbc8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b81358a0 con 0x7f03b80a09c0 2023-09-30T22:36:08.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.494+0000 7f03bdbc8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03b809cea0 con 0x7f03b8138cf0 2023-09-30T22:36:08.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.494+0000 7f03b7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03b8138cf0 0x7f03b8134230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.494+0000 7f03b6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b80a0d90 0x7f03b8133cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.494+0000 7f03b7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03b8138cf0 0x7f03b8134230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60072/0 (socket says 172.21.15.59:60072) 2023-09-30T22:36:08.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.494+0000 7f03b7fff700 1 -- 172.21.15.59:0/210560732 learned_addr learned my addr 172.21.15.59:0/210560732 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:08.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.494+0000 7f03b77fe700 1 --2- 172.21.15.59:0/210560732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b80a09c0 0x7f03b81337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.495+0000 7f03b6ffd700 1 -- 172.21.15.59:0/210560732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03b8138cf0 msgr2=0x7f03b8134230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.495+0000 7f03b6ffd700 1 --2- 172.21.15.59:0/210560732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03b8138cf0 0x7f03b8134230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.495+0000 7f03b6ffd700 1 -- 172.21.15.59:0/210560732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b80a09c0 msgr2=0x7f03b81337b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.495+0000 7f03b6ffd700 1 --2- 172.21.15.59:0/210560732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b80a09c0 0x7f03b81337b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.495+0000 7f03b6ffd700 1 -- 172.21.15.59:0/210560732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b00094a0 con 0x7f03b80a0d90 2023-09-30T22:36:08.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.495+0000 7f03b6ffd700 1 --2- 172.21.15.59:0/210560732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b80a0d90 0x7f03b8133cf0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f03a0000c00 tx=0x7f03a000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:08.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.495+0000 7f03affff700 1 -- 172.21.15.59:0/210560732 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0004c80 con 0x7f03b80a0d90 2023-09-30T22:36:08.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.495+0000 7f03affff700 1 -- 172.21.15.59:0/210560732 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a0004de0 con 0x7f03b80a0d90 2023-09-30T22:36:08.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.495+0000 7f03bdbc8700 1 -- 172.21.15.59:0/210560732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a8009b30 con 0x7f03b80a0d90 2023-09-30T22:36:08.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.495+0000 7f03affff700 1 -- 172.21.15.59:0/210560732 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0007310 con 0x7f03b80a0d90 2023-09-30T22:36:08.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.495+0000 7f03bdbc8700 1 -- 172.21.15.59:0/210560732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b81372d0 con 0x7f03b80a0d90 2023-09-30T22:36:08.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.496+0000 7f03affff700 1 -- 172.21.15.59:0/210560732 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03a0007470 con 0x7f03b80a0d90 2023-09-30T22:36:08.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.496+0000 7f03affff700 1 -- 172.21.15.59:0/210560732 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f03a003f110 con 0x7f03b80a0d90 2023-09-30T22:36:08.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.496+0000 7f03bdbc8700 1 -- 172.21.15.59:0/210560732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b80a2a20 con 0x7f03b80a0d90 2023-09-30T22:36:08.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.501+0000 7f03affff700 1 -- 172.21.15.59:0/210560732 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03b80a2a20 con 0x7f03b80a0d90 2023-09-30T22:36:08.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.529+0000 7f7c485d6700 1 Processor -- start 2023-09-30T22:36:08.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.529+0000 7f7c485d6700 1 -- start start 2023-09-30T22:36:08.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.530+0000 7f7c485d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c400a09c0 0x7f7c400a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.530+0000 7f7c485d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c4009d5c0 0x7f7c400a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.530+0000 7f7c485d6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c40133920 0x7f7c40133d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.530+0000 7f7c485d6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c400a1810 con 0x7f7c40133920 2023-09-30T22:36:08.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.530+0000 7f7c485d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4009ea10 con 0x7f7c4009d5c0 2023-09-30T22:36:08.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.530+0000 7f7c485d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4009e210 con 0x7f7c400a09c0 2023-09-30T22:36:08.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.530+0000 7f7c46b73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c40133920 0x7f7c40133d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.530+0000 7f7c46b73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c40133920 0x7f7c40133d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47386/0 (socket says 172.21.15.59:47386) 2023-09-30T22:36:08.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.530+0000 7f7c46b73700 1 -- 172.21.15.59:0/3880010054 learned_addr learned my addr 172.21.15.59:0/3880010054 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:08.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.530+0000 7f7c46372700 1 --2- 172.21.15.59:0/3880010054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c400a09c0 0x7f7c400a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.530+0000 7f7c45b71700 1 --2- 172.21.15.59:0/3880010054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c4009d5c0 0x7f7c400a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.531+0000 7f7c46b73700 1 -- 172.21.15.59:0/3880010054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c400a09c0 msgr2=0x7f7c400a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:08.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.531+0000 7f7c46b73700 1 --2- 172.21.15.59:0/3880010054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c400a09c0 0x7f7c400a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.531+0000 7f7c46b73700 1 -- 172.21.15.59:0/3880010054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c4009d5c0 msgr2=0x7f7c400a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:08.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.531+0000 7f7c46b73700 1 --2- 172.21.15.59:0/3880010054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c4009d5c0 0x7f7c400a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.531+0000 7f7c46b73700 1 -- 172.21.15.59:0/3880010054 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c400a26f0 con 0x7f7c40133920 2023-09-30T22:36:08.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.531+0000 7f7c45b71700 1 --2- 172.21.15.59:0/3880010054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c4009d5c0 0x7f7c400a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:08.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.531+0000 7f7c46b73700 1 --2- 172.21.15.59:0/3880010054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c40133920 0x7f7c40133d90 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009e50 tx=0x7f7c3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00ffab3b1eba7e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:08.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.531+0000 7f7c45370700 1 -- 172.21.15.59:0/3880010054 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800e070 con 0x7f7c40133920 2023-09-30T22:36:08.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.531+0000 7f7c45370700 1 -- 172.21.15.59:0/3880010054 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3800b910 con 0x7f7c40133920 2023-09-30T22:36:08.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.531+0000 7f7c45370700 1 -- 172.21.15.59:0/3880010054 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800bcc0 con 0x7f7c40133920 2023-09-30T22:36:08.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.532+0000 7f7c485d6700 1 -- 172.21.15.59:0/3880010054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c40133920 msgr2=0x7f7c40133d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.532+0000 7f7c485d6700 1 --2- 172.21.15.59:0/3880010054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c40133920 0x7f7c40133d90 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009e50 tx=0x7f7c3800b330 comp rx=0 tx=0).stop 2023-09-30T22:36:08.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.532+0000 7f7c485d6700 1 -- 172.21.15.59:0/3880010054 shutdown_connections 2023-09-30T22:36:08.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.532+0000 7f7c485d6700 1 --2- 172.21.15.59:0/3880010054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c40133920 0x7f7c40133d90 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.532+0000 7f7c485d6700 1 --2- 172.21.15.59:0/3880010054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c400a09c0 0x7f7c400a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.532+0000 7f7c485d6700 1 --2- 172.21.15.59:0/3880010054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c4009d5c0 0x7f7c400a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.532+0000 7f7c485d6700 1 -- 172.21.15.59:0/3880010054 >> 172.21.15.59:0/3880010054 conn(0x7f7c400a2fe0 msgr2=0x7f7c400a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:08.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.532+0000 7f7c485d6700 1 -- 172.21.15.59:0/3880010054 shutdown_connections 2023-09-30T22:36:08.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.532+0000 7f7c485d6700 1 -- 172.21.15.59:0/3880010054 wait complete. 2023-09-30T22:36:08.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.533+0000 7f7c485d6700 1 Processor -- start 2023-09-30T22:36:08.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.533+0000 7f7c485d6700 1 -- start start 2023-09-30T22:36:08.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c485d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c4009d5c0 0x7f7c4011f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c485d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c400a09c0 0x7f7c4011fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c485d6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c40133920 0x7f7c401c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c485d6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c401221c0 con 0x7f7c40133920 2023-09-30T22:36:08.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c485d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c40121290 con 0x7f7c4009d5c0 2023-09-30T22:36:08.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c485d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c40133310 con 0x7f7c400a09c0 2023-09-30T22:36:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c45b71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c400a09c0 0x7f7c4011fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c46372700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c4009d5c0 0x7f7c4011f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c45b71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c400a09c0 0x7f7c4011fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60088/0 (socket says 172.21.15.59:60088) 2023-09-30T22:36:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c45b71700 1 -- 172.21.15.59:0/1467592515 learned_addr learned my addr 172.21.15.59:0/1467592515 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c46b73700 1 --2- 172.21.15.59:0/1467592515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c40133920 0x7f7c401c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c45b71700 1 -- 172.21.15.59:0/1467592515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c4009d5c0 msgr2=0x7f7c4011f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c45b71700 1 --2- 172.21.15.59:0/1467592515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c4009d5c0 0x7f7c4011f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c45b71700 1 -- 172.21.15.59:0/1467592515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c40133920 msgr2=0x7f7c401c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c45b71700 1 --2- 172.21.15.59:0/1467592515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c40133920 0x7f7c401c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c45b71700 1 -- 172.21.15.59:0/1467592515 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c340094a0 con 0x7f7c400a09c0 2023-09-30T22:36:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.534+0000 7f7c45b71700 1 --2- 172.21.15.59:0/1467592515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c400a09c0 0x7f7c4011fa10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400ebe0 tx=0x7f7c3400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.535+0000 7f7c32ffd700 1 -- 172.21.15.59:0/1467592515 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3400c850 con 0x7f7c400a09c0 2023-09-30T22:36:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.535+0000 7f7c32ffd700 1 -- 172.21.15.59:0/1467592515 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3400c9b0 con 0x7f7c400a09c0 2023-09-30T22:36:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.535+0000 7f7c32ffd700 1 -- 172.21.15.59:0/1467592515 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3400cd40 con 0x7f7c400a09c0 2023-09-30T22:36:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.535+0000 7f7c485d6700 1 -- 172.21.15.59:0/1467592515 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c38009b30 con 0x7f7c400a09c0 2023-09-30T22:36:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.535+0000 7f7c485d6700 1 -- 172.21.15.59:0/1467592515 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4011eff0 con 0x7f7c400a09c0 2023-09-30T22:36:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.536+0000 7f7c32ffd700 1 -- 172.21.15.59:0/1467592515 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c34013470 con 0x7f7c400a09c0 2023-09-30T22:36:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.536+0000 7f7c32ffd700 1 -- 172.21.15.59:0/1467592515 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7c3403f6e0 con 0x7f7c400a09c0 2023-09-30T22:36:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.536+0000 7f7c485d6700 1 -- 172.21.15.59:0/1467592515 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c40122020 con 0x7f7c400a09c0 2023-09-30T22:36:08.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.541+0000 7f7c32ffd700 1 -- 172.21.15.59:0/1467592515 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c40122020 con 0x7f7c400a09c0 2023-09-30T22:36:08.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.709+0000 7f03bdbc8700 1 -- 172.21.15.59:0/210560732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f03b80a2a20 con 0x7f03b80a0d90 2023-09-30T22:36:08.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.710+0000 7f03affff700 1 -- 172.21.15.59:0/210560732 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03b80a2a20 con 0x7f03b80a0d90 2023-09-30T22:36:08.710 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:08.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.712+0000 7f03bdbc8700 1 -- 172.21.15.59:0/210560732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b80a0d90 msgr2=0x7f03b8133cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.712+0000 7f03bdbc8700 1 --2- 172.21.15.59:0/210560732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b80a0d90 0x7f03b8133cf0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f03a0000c00 tx=0x7f03a000ca30 comp rx=0 tx=0).stop 2023-09-30T22:36:08.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.712+0000 7f03bdbc8700 1 -- 172.21.15.59:0/210560732 shutdown_connections 2023-09-30T22:36:08.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.712+0000 7f03bdbc8700 1 --2- 172.21.15.59:0/210560732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03b8138cf0 0x7f03b8134230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.712+0000 7f03bdbc8700 1 --2- 172.21.15.59:0/210560732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b80a09c0 0x7f03b81337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.712+0000 7f03bdbc8700 1 --2- 172.21.15.59:0/210560732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b80a0d90 0x7f03b8133cf0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.712+0000 7f03bdbc8700 1 -- 172.21.15.59:0/210560732 >> 172.21.15.59:0/210560732 conn(0x7f03b80a60c0 msgr2=0x7f03b81392f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:08.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.712+0000 7f03bdbc8700 1 -- 172.21.15.59:0/210560732 shutdown_connections 2023-09-30T22:36:08.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.713+0000 7f03bdbc8700 1 -- 172.21.15.59:0/210560732 wait complete. 2023-09-30T22:36:08.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.747+0000 7f7c485d6700 1 -- 172.21.15.59:0/1467592515 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7c40122020 con 0x7f7c400a09c0 2023-09-30T22:36:08.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.748+0000 7f7c32ffd700 1 -- 172.21.15.59:0/1467592515 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c40122020 con 0x7f7c400a09c0 2023-09-30T22:36:08.748 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:08.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.750+0000 7f7c485d6700 1 -- 172.21.15.59:0/1467592515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c400a09c0 msgr2=0x7f7c4011fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.750+0000 7f7c485d6700 1 --2- 172.21.15.59:0/1467592515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c400a09c0 0x7f7c4011fa10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400ebe0 tx=0x7f7c3400eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.750+0000 7f7c485d6700 1 -- 172.21.15.59:0/1467592515 shutdown_connections 2023-09-30T22:36:08.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.750+0000 7f7c485d6700 1 --2- 172.21.15.59:0/1467592515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c40133920 0x7f7c401c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.750+0000 7f7c485d6700 1 --2- 172.21.15.59:0/1467592515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c4009d5c0 0x7f7c4011f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.750+0000 7f7c485d6700 1 --2- 172.21.15.59:0/1467592515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c400a09c0 0x7f7c4011fa10 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.750+0000 7f7c485d6700 1 -- 172.21.15.59:0/1467592515 >> 172.21.15.59:0/1467592515 conn(0x7f7c400a2fe0 msgr2=0x7f7c401bbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:08.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.750+0000 7f7c485d6700 1 -- 172.21.15.59:0/1467592515 shutdown_connections 2023-09-30T22:36:08.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.750+0000 7f7c485d6700 1 -- 172.21.15.59:0/1467592515 wait complete. 2023-09-30T22:36:08.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:08.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:08.836 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.945+0000 7efd19cff700 1 Processor -- start 2023-09-30T22:36:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.945+0000 7efd19cff700 1 -- start start 2023-09-30T22:36:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.946+0000 7efd19cff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd1409e930 0x7efd1409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.946+0000 7efd19cff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd141342f0 0x7efd1413be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.946+0000 7efd19cff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1406c9f0 con 0x7efd1409f240 2023-09-30T22:36:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.946+0000 7efd19cff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd1406c670 con 0x7efd141342f0 2023-09-30T22:36:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.946+0000 7efd19cff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1406bc90 con 0x7efd1409e930 2023-09-30T22:36:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.946+0000 7efd137fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd1409e930 0x7efd1409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.946+0000 7efd137fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd1409e930 0x7efd1409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38246/0 (socket says 172.21.15.59:38246) 2023-09-30T22:36:08.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.946+0000 7efd137fe700 1 -- 172.21.15.59:0/2197465853 learned_addr learned my addr 172.21.15.59:0/2197465853 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:08.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.946+0000 7efd13fff700 1 --2- 172.21.15.59:0/2197465853 >> v2:172.21.15.59:3300/0 conn(0x7efd141342f0 0x7efd1413be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.946+0000 7efd137fe700 1 -- 172.21.15.59:0/2197465853 >> v2:172.21.15.59:3300/0 conn(0x7efd141342f0 msgr2=0x7efd1413be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:08.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.946+0000 7efd137fe700 1 --2- 172.21.15.59:0/2197465853 >> v2:172.21.15.59:3300/0 conn(0x7efd141342f0 0x7efd1413be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.946+0000 7efd137fe700 1 -- 172.21.15.59:0/2197465853 >> v1:172.21.15.59:6789/0 conn(0x7efd1409f240 legacy=0x7efd14133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.946+0000 7efd137fe700 1 -- 172.21.15.59:0/2197465853 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1406d860 con 0x7efd1409e930 2023-09-30T22:36:08.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.946+0000 7efd13fff700 1 --2- 172.21.15.59:0/2197465853 >> v2:172.21.15.59:3300/0 conn(0x7efd141342f0 0x7efd1413be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:08.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.947+0000 7efd137fe700 1 --2- 172.21.15.59:0/2197465853 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd1409e930 0x7efd1409ed00 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7efd04009e50 tx=0x7efd0400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30d81d73358b11a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:08.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.947+0000 7efd127fc700 1 -- 172.21.15.59:0/2197465853 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0400e070 con 0x7efd1409e930 2023-09-30T22:36:08.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.947+0000 7efd127fc700 1 -- 172.21.15.59:0/2197465853 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0400b910 con 0x7efd1409e930 2023-09-30T22:36:08.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.947+0000 7efd127fc700 1 -- 172.21.15.59:0/2197465853 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0400bcc0 con 0x7efd1409e930 2023-09-30T22:36:08.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.948+0000 7efd19cff700 1 -- 172.21.15.59:0/2197465853 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd1409e930 msgr2=0x7efd1409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.948+0000 7efd19cff700 1 --2- 172.21.15.59:0/2197465853 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd1409e930 0x7efd1409ed00 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7efd04009e50 tx=0x7efd0400b330 comp rx=0 tx=0).stop 2023-09-30T22:36:08.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.948+0000 7efd19cff700 1 -- 172.21.15.59:0/2197465853 shutdown_connections 2023-09-30T22:36:08.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.948+0000 7efd19cff700 1 --2- 172.21.15.59:0/2197465853 >> v2:172.21.15.59:3300/0 conn(0x7efd141342f0 0x7efd1413be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.948+0000 7efd19cff700 1 --2- 172.21.15.59:0/2197465853 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd1409e930 0x7efd1409ed00 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.948+0000 7efd19cff700 1 -- 172.21.15.59:0/2197465853 >> 172.21.15.59:0/2197465853 conn(0x7efd140a4210 msgr2=0x7efd140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:08.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.948+0000 7efd19cff700 1 -- 172.21.15.59:0/2197465853 shutdown_connections 2023-09-30T22:36:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.948+0000 7efd19cff700 1 -- 172.21.15.59:0/2197465853 wait complete. 2023-09-30T22:36:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.949+0000 7efd19cff700 1 Processor -- start 2023-09-30T22:36:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.949+0000 7efd19cff700 1 -- start start 2023-09-30T22:36:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.949+0000 7efd19cff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd1409e930 0x7efd14122ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.949+0000 7efd19cff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd1409f240 0x7efd14123020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.949+0000 7efd19cff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd141342f0 0x7efd14123560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.949+0000 7efd19cff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd14126290 con 0x7efd141342f0 2023-09-30T22:36:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.949+0000 7efd19cff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd14124770 con 0x7efd1409e930 2023-09-30T22:36:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.949+0000 7efd19cff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd140a1810 con 0x7efd1409f240 2023-09-30T22:36:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.949+0000 7efd137fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd1409e930 0x7efd14122ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd13fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd141342f0 0x7efd14123560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd137fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd1409e930 0x7efd14122ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38254/0 (socket says 172.21.15.59:38254) 2023-09-30T22:36:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd137fe700 1 -- 172.21.15.59:0/2770627604 learned_addr learned my addr 172.21.15.59:0/2770627604 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd12ffd700 1 --2- 172.21.15.59:0/2770627604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd1409f240 0x7efd14123020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd137fe700 1 -- 172.21.15.59:0/2770627604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd1409f240 msgr2=0x7efd14123020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd137fe700 1 --2- 172.21.15.59:0/2770627604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd1409f240 0x7efd14123020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd137fe700 1 -- 172.21.15.59:0/2770627604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd141342f0 msgr2=0x7efd14123560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd137fe700 1 --2- 172.21.15.59:0/2770627604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd141342f0 0x7efd14123560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd137fe700 1 -- 172.21.15.59:0/2770627604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0094a0 con 0x7efd1409e930 2023-09-30T22:36:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd13fff700 1 --2- 172.21.15.59:0/2770627604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd141342f0 0x7efd14123560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd137fe700 1 --2- 172.21.15.59:0/2770627604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd1409e930 0x7efd14122ae0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7efd1406bdd0 tx=0x7efd04004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd0bfff700 1 -- 172.21.15.59:0/2770627604 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd040048b0 con 0x7efd1409e930 2023-09-30T22:36:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd0bfff700 1 -- 172.21.15.59:0/2770627604 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd040092e0 con 0x7efd1409e930 2023-09-30T22:36:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd19cff700 1 -- 172.21.15.59:0/2770627604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd04009b30 con 0x7efd1409e930 2023-09-30T22:36:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd0bfff700 1 -- 172.21.15.59:0/2770627604 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0401c680 con 0x7efd1409e930 2023-09-30T22:36:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.950+0000 7efd19cff700 1 -- 172.21.15.59:0/2770627604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd14133570 con 0x7efd1409e930 2023-09-30T22:36:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.951+0000 7efd0bfff700 1 -- 172.21.15.59:0/2770627604 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd0401c7e0 con 0x7efd1409e930 2023-09-30T22:36:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.951+0000 7efd0bfff700 1 -- 172.21.15.59:0/2770627604 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efd040412d0 con 0x7efd1409e930 2023-09-30T22:36:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.951+0000 7efd19cff700 1 -- 172.21.15.59:0/2770627604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd140a3c10 con 0x7efd1409e930 2023-09-30T22:36:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.956+0000 7efd0bfff700 1 -- 172.21.15.59:0/2770627604 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd040257d0 con 0x7efd1409e930 2023-09-30T22:36:08.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.986+0000 7f7e4b2aa700 1 Processor -- start 2023-09-30T22:36:08.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.987+0000 7f7e4b2aa700 1 -- start start 2023-09-30T22:36:08.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.987+0000 7f7e4b2aa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e440a0a30 0x7f7e440a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.987+0000 7f7e4b2aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e4409d630 0x7f7e440a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.987+0000 7f7e4b2aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e44133930 0x7f7e44133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.987+0000 7f7e4b2aa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e440a2a70 con 0x7f7e440a0a30 2023-09-30T22:36:08.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.987+0000 7f7e4b2aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440a01d0 con 0x7f7e44133930 2023-09-30T22:36:08.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.987+0000 7f7e4b2aa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4409e2b0 con 0x7f7e4409d630 2023-09-30T22:36:08.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.987+0000 7f7e49046700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e440a0a30 0x7f7e440a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.987+0000 7f7e49847700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e44133930 0x7f7e44133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.987+0000 7f7e49046700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e440a0a30 0x7f7e440a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47422/0 (socket says 172.21.15.59:47422) 2023-09-30T22:36:08.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.987+0000 7f7e49046700 1 -- 172.21.15.59:0/2345334650 learned_addr learned my addr 172.21.15.59:0/2345334650 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:08.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.987+0000 7f7e48845700 1 --2- 172.21.15.59:0/2345334650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e4409d630 0x7f7e440a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.988+0000 7f7e49847700 1 -- 172.21.15.59:0/2345334650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e4409d630 msgr2=0x7f7e440a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:08.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.988+0000 7f7e49847700 1 --2- 172.21.15.59:0/2345334650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e4409d630 0x7f7e440a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.988+0000 7f7e49847700 1 -- 172.21.15.59:0/2345334650 >> v2:172.21.15.59:3300/0 conn(0x7f7e440a0a30 msgr2=0x7f7e440a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:08.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.988+0000 7f7e49847700 1 --2- 172.21.15.59:0/2345334650 >> v2:172.21.15.59:3300/0 conn(0x7f7e440a0a30 0x7f7e440a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.988+0000 7f7e49847700 1 -- 172.21.15.59:0/2345334650 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4409dc50 con 0x7f7e44133930 2023-09-30T22:36:08.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.988+0000 7f7e49046700 1 --2- 172.21.15.59:0/2345334650 >> v2:172.21.15.59:3300/0 conn(0x7f7e440a0a30 0x7f7e440a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:08.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.988+0000 7f7e48845700 1 --2- 172.21.15.59:0/2345334650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e4409d630 0x7f7e440a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:08.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.988+0000 7f7e49847700 1 --2- 172.21.15.59:0/2345334650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e44133930 0x7f7e44133db0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009d90 tx=0x7f7e3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=226cccf1a05378eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:08.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.988+0000 7f7e3bfff700 1 -- 172.21.15.59:0/2345334650 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00e070 con 0x7f7e44133930 2023-09-30T22:36:08.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.988+0000 7f7e3bfff700 1 -- 172.21.15.59:0/2345334650 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c00bb20 con 0x7f7e44133930 2023-09-30T22:36:08.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.988+0000 7f7e3bfff700 1 -- 172.21.15.59:0/2345334650 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c012430 con 0x7f7e44133930 2023-09-30T22:36:08.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.989+0000 7f7e4b2aa700 1 -- 172.21.15.59:0/2345334650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e44133930 msgr2=0x7f7e44133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.989+0000 7f7e4b2aa700 1 --2- 172.21.15.59:0/2345334650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e44133930 0x7f7e44133db0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009d90 tx=0x7f7e3c00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:08.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.989+0000 7f7e4b2aa700 1 -- 172.21.15.59:0/2345334650 shutdown_connections 2023-09-30T22:36:08.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.989+0000 7f7e4b2aa700 1 --2- 172.21.15.59:0/2345334650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e44133930 0x7f7e44133db0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.989+0000 7f7e4b2aa700 1 --2- 172.21.15.59:0/2345334650 >> v2:172.21.15.59:3300/0 conn(0x7f7e440a0a30 0x7f7e440a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.989+0000 7f7e4b2aa700 1 --2- 172.21.15.59:0/2345334650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e4409d630 0x7f7e440a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.989+0000 7f7e4b2aa700 1 -- 172.21.15.59:0/2345334650 >> 172.21.15.59:0/2345334650 conn(0x7f7e440a3050 msgr2=0x7f7e440a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:08.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.989+0000 7f7e4b2aa700 1 -- 172.21.15.59:0/2345334650 shutdown_connections 2023-09-30T22:36:08.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.989+0000 7f7e4b2aa700 1 -- 172.21.15.59:0/2345334650 wait complete. 2023-09-30T22:36:08.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.990+0000 7f7e4b2aa700 1 Processor -- start 2023-09-30T22:36:08.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.990+0000 7f7e4b2aa700 1 -- start start 2023-09-30T22:36:08.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.991+0000 7f7e4b2aa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e4409d630 0x7f7e441c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.991+0000 7f7e4b2aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e440a0a30 0x7f7e441c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.991+0000 7f7e4b2aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e44133930 0x7f7e441c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:08.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.991+0000 7f7e4b2aa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440a0410 con 0x7f7e4409d630 2023-09-30T22:36:08.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.991+0000 7f7e49046700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e4409d630 0x7f7e441c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.991+0000 7f7e49847700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e44133930 0x7f7e441c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.991+0000 7f7e4b2aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e44120630 con 0x7f7e44133930 2023-09-30T22:36:08.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.991+0000 7f7e49046700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e4409d630 0x7f7e441c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47434/0 (socket says 172.21.15.59:47434) 2023-09-30T22:36:08.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.991+0000 7f7e4b2aa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440a4030 con 0x7f7e440a0a30 2023-09-30T22:36:08.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.991+0000 7f7e49046700 1 -- 172.21.15.59:0/718963689 learned_addr learned my addr 172.21.15.59:0/718963689 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:08.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.991+0000 7f7e48845700 1 --2- 172.21.15.59:0/718963689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e440a0a30 0x7f7e441c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:08.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.991+0000 7f7e49046700 1 -- 172.21.15.59:0/718963689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e440a0a30 msgr2=0x7f7e441c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.992+0000 7f7e49046700 1 --2- 172.21.15.59:0/718963689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e440a0a30 0x7f7e441c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.992+0000 7f7e49046700 1 -- 172.21.15.59:0/718963689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e44133930 msgr2=0x7f7e441c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:08.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.992+0000 7f7e49046700 1 --2- 172.21.15.59:0/718963689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e44133930 0x7f7e441c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:08.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.992+0000 7f7e49046700 1 -- 172.21.15.59:0/718963689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e340094a0 con 0x7f7e4409d630 2023-09-30T22:36:08.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.992+0000 7f7e48845700 1 --2- 172.21.15.59:0/718963689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e440a0a30 0x7f7e441c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:08.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.992+0000 7f7e49847700 1 --2- 172.21.15.59:0/718963689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e44133930 0x7f7e441c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:08.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.992+0000 7f7e49046700 1 --2- 172.21.15.59:0/718963689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e4409d630 0x7f7e441c7e80 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000ebe0 tx=0x7f7e4000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:08.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.992+0000 7f7e39ffb700 1 -- 172.21.15.59:0/718963689 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4000c850 con 0x7f7e4409d630 2023-09-30T22:36:08.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.992+0000 7f7e39ffb700 1 -- 172.21.15.59:0/718963689 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4000c9b0 con 0x7f7e4409d630 2023-09-30T22:36:08.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.992+0000 7f7e4b2aa700 1 -- 172.21.15.59:0/718963689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e40009550 con 0x7f7e4409d630 2023-09-30T22:36:08.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.992+0000 7f7e39ffb700 1 -- 172.21.15.59:0/718963689 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4000cd40 con 0x7f7e4409d630 2023-09-30T22:36:08.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.992+0000 7f7e4b2aa700 1 -- 172.21.15.59:0/718963689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3c009a70 con 0x7f7e4409d630 2023-09-30T22:36:08.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.993+0000 7f7e39ffb700 1 -- 172.21.15.59:0/718963689 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e40013470 con 0x7f7e4409d630 2023-09-30T22:36:08.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.993+0000 7f7e4b2aa700 1 -- 172.21.15.59:0/718963689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e440747f0 con 0x7f7e4409d630 2023-09-30T22:36:08.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:08.993+0000 7f7e39ffb700 1 -- 172.21.15.59:0/718963689 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7e4003f830 con 0x7f7e4409d630 2023-09-30T22:36:09.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.003+0000 7f7e39ffb700 1 -- 172.21.15.59:0/718963689 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e400232f0 con 0x7f7e4409d630 2023-09-30T22:36:09.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.170+0000 7efd19cff700 1 -- 172.21.15.59:0/2770627604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efd14074ea0 con 0x7efd1409e930 2023-09-30T22:36:09.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.171+0000 7efd0bfff700 1 -- 172.21.15.59:0/2770627604 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd0402db40 con 0x7efd1409e930 2023-09-30T22:36:09.171 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:09.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.173+0000 7efd19cff700 1 -- 172.21.15.59:0/2770627604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd1409e930 msgr2=0x7efd14122ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:09.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.173+0000 7efd19cff700 1 --2- 172.21.15.59:0/2770627604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd1409e930 0x7efd14122ae0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7efd1406bdd0 tx=0x7efd04004ad0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.173+0000 7efd19cff700 1 -- 172.21.15.59:0/2770627604 shutdown_connections 2023-09-30T22:36:09.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.173+0000 7efd19cff700 1 --2- 172.21.15.59:0/2770627604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd141342f0 0x7efd14123560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.173+0000 7efd19cff700 1 --2- 172.21.15.59:0/2770627604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd1409e930 0x7efd14122ae0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.173+0000 7efd19cff700 1 --2- 172.21.15.59:0/2770627604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd1409f240 0x7efd14123020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.173+0000 7efd19cff700 1 -- 172.21.15.59:0/2770627604 >> 172.21.15.59:0/2770627604 conn(0x7efd140a4210 msgr2=0x7efd14071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:09.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.173+0000 7efd19cff700 1 -- 172.21.15.59:0/2770627604 shutdown_connections 2023-09-30T22:36:09.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.173+0000 7efd19cff700 1 -- 172.21.15.59:0/2770627604 wait complete. 2023-09-30T22:36:09.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:09.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.211+0000 7f7e4b2aa700 1 -- 172.21.15.59:0/718963689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7e44121f40 con 0x7f7e4409d630 2023-09-30T22:36:09.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.211+0000 7f7e39ffb700 1 -- 172.21.15.59:0/718963689 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e44121f40 con 0x7f7e4409d630 2023-09-30T22:36:09.211 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:09.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.213+0000 7f7e4b2aa700 1 -- 172.21.15.59:0/718963689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e4409d630 msgr2=0x7f7e441c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:09.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.213+0000 7f7e4b2aa700 1 --2- 172.21.15.59:0/718963689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e4409d630 0x7f7e441c7e80 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000ebe0 tx=0x7f7e4000eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.213+0000 7f7e4b2aa700 1 -- 172.21.15.59:0/718963689 shutdown_connections 2023-09-30T22:36:09.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.213+0000 7f7e4b2aa700 1 --2- 172.21.15.59:0/718963689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e44133930 0x7f7e441c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.213+0000 7f7e4b2aa700 1 --2- 172.21.15.59:0/718963689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e4409d630 0x7f7e441c7e80 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.213+0000 7f7e4b2aa700 1 --2- 172.21.15.59:0/718963689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e440a0a30 0x7f7e441c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.213+0000 7f7e4b2aa700 1 -- 172.21.15.59:0/718963689 >> 172.21.15.59:0/718963689 conn(0x7f7e440a3050 msgr2=0x7f7e4409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:09.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.213+0000 7f7e4b2aa700 1 -- 172.21.15.59:0/718963689 shutdown_connections 2023-09-30T22:36:09.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.214+0000 7f7e4b2aa700 1 -- 172.21.15.59:0/718963689 wait complete. 2023-09-30T22:36:09.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:09.728 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:09.765 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.878+0000 7f10b1789700 1 Processor -- start 2023-09-30T22:36:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.878+0000 7f10b1789700 1 -- start start 2023-09-30T22:36:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10b1789700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10ac09d760 0x7f10ac09db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10b1789700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10ac09e070 0x7f10ac133a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10b1789700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ac06b0a0 con 0x7f10ac133f60 2023-09-30T22:36:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10b1789700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ac06b6d0 con 0x7f10ac09d760 2023-09-30T22:36:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10b1789700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac09b1c0 con 0x7f10ac09e070 2023-09-30T22:36:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10aaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10ac09d760 0x7f10ac09db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10aa7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10ac09e070 0x7f10ac133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:09.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10aaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10ac09d760 0x7f10ac09db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47446/0 (socket says 172.21.15.59:47446) 2023-09-30T22:36:09.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10aa7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10ac09e070 0x7f10ac133a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38276/0 (socket says 172.21.15.59:38276) 2023-09-30T22:36:09.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10aaffd700 1 -- 172.21.15.59:0/3843639370 learned_addr learned my addr 172.21.15.59:0/3843639370 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:09.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10aaffd700 1 -- 172.21.15.59:0/3843639370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10ac09e070 msgr2=0x7f10ac133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:09.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10aaffd700 1 --2- 172.21.15.59:0/3843639370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10ac09e070 0x7f10ac133a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10aaffd700 1 -- 172.21.15.59:0/3843639370 >> v1:172.21.15.59:6789/0 conn(0x7f10ac133f60 legacy=0x7f10ac13ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:09.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10aaffd700 1 -- 172.21.15.59:0/3843639370 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac06b490 con 0x7f10ac09d760 2023-09-30T22:36:09.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10aa7fc700 1 --2- 172.21.15.59:0/3843639370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10ac09e070 0x7f10ac133a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:09.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.879+0000 7f10aaffd700 1 --2- 172.21.15.59:0/3843639370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10ac09d760 0x7f10ac09db30 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f109c009e50 tx=0x7f109c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf2614ecfdf540c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:09.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.880+0000 7f10a9ffb700 1 -- 172.21.15.59:0/3843639370 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c00e070 con 0x7f10ac09d760 2023-09-30T22:36:09.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.880+0000 7f10a9ffb700 1 -- 172.21.15.59:0/3843639370 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c00b910 con 0x7f10ac09d760 2023-09-30T22:36:09.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.880+0000 7f10a9ffb700 1 -- 172.21.15.59:0/3843639370 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c00bcc0 con 0x7f10ac09d760 2023-09-30T22:36:09.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.880+0000 7f10b1789700 1 -- 172.21.15.59:0/3843639370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10ac09d760 msgr2=0x7f10ac09db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:09.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.880+0000 7f10b1789700 1 --2- 172.21.15.59:0/3843639370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10ac09d760 0x7f10ac09db30 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f109c009e50 tx=0x7f109c00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:09.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.880+0000 7f10b1789700 1 -- 172.21.15.59:0/3843639370 shutdown_connections 2023-09-30T22:36:09.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.880+0000 7f10b1789700 1 --2- 172.21.15.59:0/3843639370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10ac09d760 0x7f10ac09db30 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.880+0000 7f10b1789700 1 --2- 172.21.15.59:0/3843639370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10ac09e070 0x7f10ac133a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.880+0000 7f10b1789700 1 -- 172.21.15.59:0/3843639370 >> 172.21.15.59:0/3843639370 conn(0x7f10ac066f50 msgr2=0x7f10ac0a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:09.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.880+0000 7f10b1789700 1 -- 172.21.15.59:0/3843639370 shutdown_connections 2023-09-30T22:36:09.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.880+0000 7f10b1789700 1 -- 172.21.15.59:0/3843639370 wait complete. 2023-09-30T22:36:09.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.881+0000 7f10b1789700 1 Processor -- start 2023-09-30T22:36:09.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.882+0000 7f10b1789700 1 -- start start 2023-09-30T22:36:09.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.882+0000 7f10b1789700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10ac09d760 0x7f10ac1c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:09.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.882+0000 7f10b1789700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10ac09e070 0x7f10ac1c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:09.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.882+0000 7f10b1789700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10ac133f60 0x7f10ac1c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:09.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.882+0000 7f10b1789700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac1207b0 con 0x7f10ac133f60 2023-09-30T22:36:09.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.882+0000 7f10b1789700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac133ad0 con 0x7f10ac09d760 2023-09-30T22:36:09.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.882+0000 7f10b1789700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac09c6f0 con 0x7f10ac09e070 2023-09-30T22:36:09.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.882+0000 7f10aaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10ac09d760 0x7f10ac1c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:09.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.882+0000 7f10aaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10ac09d760 0x7f10ac1c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38278/0 (socket says 172.21.15.59:38278) 2023-09-30T22:36:09.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.882+0000 7f10aaffd700 1 -- 172.21.15.59:0/651865587 learned_addr learned my addr 172.21.15.59:0/651865587 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:09.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.882+0000 7f10ab7fe700 1 --2- 172.21.15.59:0/651865587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10ac133f60 0x7f10ac1c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:09.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.882+0000 7f10aa7fc700 1 --2- 172.21.15.59:0/651865587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10ac09e070 0x7f10ac1c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:09.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.883+0000 7f10aaffd700 1 -- 172.21.15.59:0/651865587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10ac09e070 msgr2=0x7f10ac1c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:09.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.883+0000 7f10aaffd700 1 --2- 172.21.15.59:0/651865587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10ac09e070 0x7f10ac1c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.883+0000 7f10aaffd700 1 -- 172.21.15.59:0/651865587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10ac133f60 msgr2=0x7f10ac1c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:09.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.883+0000 7f10aaffd700 1 --2- 172.21.15.59:0/651865587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10ac133f60 0x7f10ac1c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.883+0000 7f10aaffd700 1 -- 172.21.15.59:0/651865587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1094009430 con 0x7f10ac09d760 2023-09-30T22:36:09.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.883+0000 7f10ab7fe700 1 --2- 172.21.15.59:0/651865587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10ac133f60 0x7f10ac1c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:09.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.883+0000 7f10aaffd700 1 --2- 172.21.15.59:0/651865587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10ac09d760 0x7f10ac1c8540 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f109c00b370 tx=0x7f109c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:09.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.883+0000 7f10a37fe700 1 -- 172.21.15.59:0/651865587 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c004800 con 0x7f10ac09d760 2023-09-30T22:36:09.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.883+0000 7f10a37fe700 1 -- 172.21.15.59:0/651865587 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c0092e0 con 0x7f10ac09d760 2023-09-30T22:36:09.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.883+0000 7f10b1789700 1 -- 172.21.15.59:0/651865587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109c009b30 con 0x7f10ac09d760 2023-09-30T22:36:09.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.883+0000 7f10a37fe700 1 -- 172.21.15.59:0/651865587 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c01c680 con 0x7f10ac09d760 2023-09-30T22:36:09.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.883+0000 7f10b1789700 1 -- 172.21.15.59:0/651865587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ac09a620 con 0x7f10ac09d760 2023-09-30T22:36:09.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.884+0000 7f10a37fe700 1 -- 172.21.15.59:0/651865587 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f109c01c7e0 con 0x7f10ac09d760 2023-09-30T22:36:09.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.884+0000 7f10b1789700 1 -- 172.21.15.59:0/651865587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ac0729a0 con 0x7f10ac09d760 2023-09-30T22:36:09.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.884+0000 7f10a37fe700 1 -- 172.21.15.59:0/651865587 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f109c041200 con 0x7f10ac09d760 2023-09-30T22:36:09.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.889+0000 7f10a37fe700 1 -- 172.21.15.59:0/651865587 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f109c025450 con 0x7f10ac09d760 2023-09-30T22:36:09.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.916+0000 7faf405e5700 1 Processor -- start 2023-09-30T22:36:09.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.916+0000 7faf405e5700 1 -- start start 2023-09-30T22:36:09.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.917+0000 7faf405e5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf380a0a30 0x7faf380a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:09.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.917+0000 7faf405e5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf380a1340 0x7faf38133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:09.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.917+0000 7faf405e5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3809edd0 con 0x7faf38133fa0 2023-09-30T22:36:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.917+0000 7faf405e5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3809e1f0 con 0x7faf380a0a30 2023-09-30T22:36:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.917+0000 7faf405e5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf3809dc50 con 0x7faf380a1340 2023-09-30T22:36:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.917+0000 7faf3e381700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf380a0a30 0x7faf380a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.917+0000 7faf3db80700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf380a1340 0x7faf38133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.917+0000 7faf3e381700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf380a0a30 0x7faf380a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47452/0 (socket says 172.21.15.59:47452) 2023-09-30T22:36:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.917+0000 7faf3e381700 1 -- 172.21.15.59:0/78993840 learned_addr learned my addr 172.21.15.59:0/78993840 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.917+0000 7faf3e381700 1 -- 172.21.15.59:0/78993840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf380a1340 msgr2=0x7faf38133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.917+0000 7faf3e381700 1 --2- 172.21.15.59:0/78993840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf380a1340 0x7faf38133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.917+0000 7faf3e381700 1 -- 172.21.15.59:0/78993840 >> v1:172.21.15.59:6789/0 conn(0x7faf38133fa0 legacy=0x7faf3813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.917+0000 7faf3e381700 1 -- 172.21.15.59:0/78993840 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf380a1fe0 con 0x7faf380a0a30 2023-09-30T22:36:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.917+0000 7faf3db80700 1 --2- 172.21.15.59:0/78993840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf380a1340 0x7faf38133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.917+0000 7faf3e381700 1 --2- 172.21.15.59:0/78993840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf380a0a30 0x7faf380a0e00 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7faf300098f0 tx=0x7faf30009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90591bcb532508d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:09.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.918+0000 7faf3d37f700 1 -- 172.21.15.59:0/78993840 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011830 con 0x7faf380a0a30 2023-09-30T22:36:09.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.918+0000 7faf3d37f700 1 -- 172.21.15.59:0/78993840 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf30011990 con 0x7faf380a0a30 2023-09-30T22:36:09.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.918+0000 7faf3d37f700 1 -- 172.21.15.59:0/78993840 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011d20 con 0x7faf380a0a30 2023-09-30T22:36:09.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.918+0000 7faf405e5700 1 -- 172.21.15.59:0/78993840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf380a0a30 msgr2=0x7faf380a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:09.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.918+0000 7faf405e5700 1 --2- 172.21.15.59:0/78993840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf380a0a30 0x7faf380a0e00 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7faf300098f0 tx=0x7faf30009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:09.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.918+0000 7faf405e5700 1 -- 172.21.15.59:0/78993840 shutdown_connections 2023-09-30T22:36:09.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.918+0000 7faf405e5700 1 --2- 172.21.15.59:0/78993840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf380a0a30 0x7faf380a0e00 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.918+0000 7faf405e5700 1 --2- 172.21.15.59:0/78993840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf380a1340 0x7faf38133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.918+0000 7faf405e5700 1 -- 172.21.15.59:0/78993840 >> 172.21.15.59:0/78993840 conn(0x7faf380a6550 msgr2=0x7faf380a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:09.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.918+0000 7faf405e5700 1 -- 172.21.15.59:0/78993840 shutdown_connections 2023-09-30T22:36:09.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.918+0000 7faf405e5700 1 -- 172.21.15.59:0/78993840 wait complete. 2023-09-30T22:36:09.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.919+0000 7faf405e5700 1 Processor -- start 2023-09-30T22:36:09.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.920+0000 7faf405e5700 1 -- start start 2023-09-30T22:36:09.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.920+0000 7faf405e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf380a0a30 0x7faf3811e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.920+0000 7faf405e5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf380a1340 0x7faf3811ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.920+0000 7faf405e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf38133fa0 0x7faf3811f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.920+0000 7faf405e5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf38121f50 con 0x7faf38133fa0 2023-09-30T22:36:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.920+0000 7faf405e5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf38120430 con 0x7faf380a0a30 2023-09-30T22:36:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.920+0000 7faf405e5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf380a37e0 con 0x7faf380a1340 2023-09-30T22:36:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.920+0000 7faf3e381700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf380a0a30 0x7faf3811e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.920+0000 7faf3eb82700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf38133fa0 0x7faf3811f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.920+0000 7faf3db80700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf380a1340 0x7faf3811ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.920+0000 7faf3e381700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf380a0a30 0x7faf3811e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38288/0 (socket says 172.21.15.59:38288) 2023-09-30T22:36:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.920+0000 7faf3e381700 1 -- 172.21.15.59:0/2365998101 learned_addr learned my addr 172.21.15.59:0/2365998101 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.921+0000 7faf3e381700 1 -- 172.21.15.59:0/2365998101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf380a1340 msgr2=0x7faf3811ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.921+0000 7faf3e381700 1 --2- 172.21.15.59:0/2365998101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf380a1340 0x7faf3811ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.921+0000 7faf3e381700 1 -- 172.21.15.59:0/2365998101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf38133fa0 msgr2=0x7faf3811f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.921+0000 7faf3e381700 1 --2- 172.21.15.59:0/2365998101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf38133fa0 0x7faf3811f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.921+0000 7faf3e381700 1 -- 172.21.15.59:0/2365998101 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0094a0 con 0x7faf380a0a30 2023-09-30T22:36:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.921+0000 7faf3db80700 1 --2- 172.21.15.59:0/2365998101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf380a1340 0x7faf3811ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.921+0000 7faf3e381700 1 --2- 172.21.15.59:0/2365998101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf380a0a30 0x7faf3811e7a0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7faf30009c40 tx=0x7faf30004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.921+0000 7faf36ffd700 1 -- 172.21.15.59:0/2365998101 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30004400 con 0x7faf380a0a30 2023-09-30T22:36:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.921+0000 7faf36ffd700 1 -- 172.21.15.59:0/2365998101 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3001f070 con 0x7faf380a0a30 2023-09-30T22:36:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.921+0000 7faf405e5700 1 -- 172.21.15.59:0/2365998101 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf30009550 con 0x7faf380a0a30 2023-09-30T22:36:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.921+0000 7faf36ffd700 1 -- 172.21.15.59:0/2365998101 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf300038e0 con 0x7faf380a0a30 2023-09-30T22:36:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.921+0000 7faf405e5700 1 -- 172.21.15.59:0/2365998101 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf380a0270 con 0x7faf380a0a30 2023-09-30T22:36:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.922+0000 7faf36ffd700 1 -- 172.21.15.59:0/2365998101 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf30021030 con 0x7faf380a0a30 2023-09-30T22:36:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.922+0000 7faf36ffd700 1 -- 172.21.15.59:0/2365998101 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faf30040ac0 con 0x7faf380a0a30 2023-09-30T22:36:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.922+0000 7faf405e5700 1 -- 172.21.15.59:0/2365998101 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf38122a80 con 0x7faf380a0a30 2023-09-30T22:36:09.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:09.932+0000 7faf36ffd700 1 -- 172.21.15.59:0/2365998101 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf30015080 con 0x7faf380a0a30 2023-09-30T22:36:10.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.099+0000 7f10b1789700 1 -- 172.21.15.59:0/651865587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f10ac1220c0 con 0x7f10ac09d760 2023-09-30T22:36:10.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.099+0000 7f10a37fe700 1 -- 172.21.15.59:0/651865587 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10ac1220c0 con 0x7f10ac09d760 2023-09-30T22:36:10.099 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.101+0000 7f10b1789700 1 -- 172.21.15.59:0/651865587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10ac09d760 msgr2=0x7f10ac1c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.101+0000 7f10b1789700 1 --2- 172.21.15.59:0/651865587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10ac09d760 0x7f10ac1c8540 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f109c00b370 tx=0x7f109c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.101+0000 7f10b1789700 1 -- 172.21.15.59:0/651865587 shutdown_connections 2023-09-30T22:36:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.101+0000 7f10b1789700 1 --2- 172.21.15.59:0/651865587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10ac133f60 0x7f10ac1c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.101+0000 7f10b1789700 1 --2- 172.21.15.59:0/651865587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10ac09d760 0x7f10ac1c8540 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.101+0000 7f10b1789700 1 --2- 172.21.15.59:0/651865587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10ac09e070 0x7f10ac1c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.101+0000 7f10b1789700 1 -- 172.21.15.59:0/651865587 >> 172.21.15.59:0/651865587 conn(0x7f10ac066f50 msgr2=0x7f10ac0a0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.101+0000 7f10b1789700 1 -- 172.21.15.59:0/651865587 shutdown_connections 2023-09-30T22:36:10.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.102+0000 7f10b1789700 1 -- 172.21.15.59:0/651865587 wait complete. 2023-09-30T22:36:10.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:10.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.138+0000 7faf405e5700 1 -- 172.21.15.59:0/2365998101 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faf38074ea0 con 0x7faf380a0a30 2023-09-30T22:36:10.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.139+0000 7faf36ffd700 1 -- 172.21.15.59:0/2365998101 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf300199a0 con 0x7faf380a0a30 2023-09-30T22:36:10.139 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:10.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.141+0000 7faf405e5700 1 -- 172.21.15.59:0/2365998101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf380a0a30 msgr2=0x7faf3811e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:10.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.141+0000 7faf405e5700 1 --2- 172.21.15.59:0/2365998101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf380a0a30 0x7faf3811e7a0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7faf30009c40 tx=0x7faf30004750 comp rx=0 tx=0).stop 2023-09-30T22:36:10.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.141+0000 7faf405e5700 1 -- 172.21.15.59:0/2365998101 shutdown_connections 2023-09-30T22:36:10.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.141+0000 7faf405e5700 1 --2- 172.21.15.59:0/2365998101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf38133fa0 0x7faf3811f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.141+0000 7faf405e5700 1 --2- 172.21.15.59:0/2365998101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf380a0a30 0x7faf3811e7a0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.141+0000 7faf405e5700 1 --2- 172.21.15.59:0/2365998101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf380a1340 0x7faf3811ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.141+0000 7faf405e5700 1 -- 172.21.15.59:0/2365998101 >> 172.21.15.59:0/2365998101 conn(0x7faf380a6550 msgr2=0x7faf381b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:10.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.141+0000 7faf405e5700 1 -- 172.21.15.59:0/2365998101 shutdown_connections 2023-09-30T22:36:10.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.141+0000 7faf405e5700 1 -- 172.21.15.59:0/2365998101 wait complete. 2023-09-30T22:36:10.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:10.188 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:10.228 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.335+0000 7f81e4f8c700 1 Processor -- start 2023-09-30T22:36:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.336+0000 7f81e4f8c700 1 -- start start 2023-09-30T22:36:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.336+0000 7f81e4f8c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e00a0a30 0x7f81e00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.336+0000 7f81e4f8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e00a1340 0x7f81e0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.336+0000 7f81e4f8c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81e0133fa0 0x7f81e0134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.336+0000 7f81e4f8c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e009edd0 con 0x7f81e0133fa0 2023-09-30T22:36:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.336+0000 7f81e4f8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e009e1f0 con 0x7f81e00a1340 2023-09-30T22:36:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.336+0000 7f81e4f8c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81e009dc50 con 0x7f81e00a0a30 2023-09-30T22:36:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.336+0000 7f81de59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e00a0a30 0x7f81e00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.336+0000 7f81ded9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81e0133fa0 0x7f81e0134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.336+0000 7f81ddd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e00a1340 0x7f81e0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.337+0000 7f81de59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e00a0a30 0x7f81e00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60142/0 (socket says 172.21.15.59:60142) 2023-09-30T22:36:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.337+0000 7f81ded9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81e0133fa0 0x7f81e0134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47474/0 (socket says 172.21.15.59:47474) 2023-09-30T22:36:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.337+0000 7f81de59c700 1 -- 172.21.15.59:0/2519904448 learned_addr learned my addr 172.21.15.59:0/2519904448 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.337+0000 7f81de59c700 1 -- 172.21.15.59:0/2519904448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e00a1340 msgr2=0x7f81e0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.337+0000 7f81de59c700 1 --2- 172.21.15.59:0/2519904448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e00a1340 0x7f81e0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.337+0000 7f81de59c700 1 -- 172.21.15.59:0/2519904448 >> v2:172.21.15.59:3300/0 conn(0x7f81e0133fa0 msgr2=0x7f81e0134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.337+0000 7f81de59c700 1 --2- 172.21.15.59:0/2519904448 >> v2:172.21.15.59:3300/0 conn(0x7f81e0133fa0 0x7f81e0134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.337+0000 7f81de59c700 1 -- 172.21.15.59:0/2519904448 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e00a1fe0 con 0x7f81e00a0a30 2023-09-30T22:36:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.337+0000 7f81ded9d700 1 --2- 172.21.15.59:0/2519904448 >> v2:172.21.15.59:3300/0 conn(0x7f81e0133fa0 0x7f81e0134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.337+0000 7f81ddd9b700 1 --2- 172.21.15.59:0/2519904448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e00a1340 0x7f81e0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.337+0000 7f81de59c700 1 --2- 172.21.15.59:0/2519904448 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e00a0a30 0x7f81e00a0e00 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009e50 tx=0x7f81d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a897a5cb55af87cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.337+0000 7f81dd59a700 1 -- 172.21.15.59:0/2519904448 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d000e070 con 0x7f81e00a0a30 2023-09-30T22:36:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.337+0000 7f81dd59a700 1 -- 172.21.15.59:0/2519904448 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d000b910 con 0x7f81e00a0a30 2023-09-30T22:36:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.337+0000 7f81dd59a700 1 -- 172.21.15.59:0/2519904448 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d000bcc0 con 0x7f81e00a0a30 2023-09-30T22:36:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.338+0000 7f81e4f8c700 1 -- 172.21.15.59:0/2519904448 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e00a0a30 msgr2=0x7f81e00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.338+0000 7f81e4f8c700 1 --2- 172.21.15.59:0/2519904448 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e00a0a30 0x7f81e00a0e00 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009e50 tx=0x7f81d000b330 comp rx=0 tx=0).stop 2023-09-30T22:36:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.338+0000 7f81e4f8c700 1 -- 172.21.15.59:0/2519904448 shutdown_connections 2023-09-30T22:36:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.338+0000 7f81e4f8c700 1 --2- 172.21.15.59:0/2519904448 >> v2:172.21.15.59:3300/0 conn(0x7f81e0133fa0 0x7f81e0134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.338+0000 7f81e4f8c700 1 --2- 172.21.15.59:0/2519904448 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e00a0a30 0x7f81e00a0e00 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.338+0000 7f81e4f8c700 1 --2- 172.21.15.59:0/2519904448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e00a1340 0x7f81e0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.338+0000 7f81e4f8c700 1 -- 172.21.15.59:0/2519904448 >> 172.21.15.59:0/2519904448 conn(0x7f81e00a6550 msgr2=0x7f81e00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.338+0000 7f81e4f8c700 1 -- 172.21.15.59:0/2519904448 shutdown_connections 2023-09-30T22:36:10.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.338+0000 7f81e4f8c700 1 -- 172.21.15.59:0/2519904448 wait complete. 2023-09-30T22:36:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.339+0000 7f81e4f8c700 1 Processor -- start 2023-09-30T22:36:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.339+0000 7f81e4f8c700 1 -- start start 2023-09-30T22:36:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81e4f8c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e00a0a30 0x7f81e01200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81e4f8c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e00a1340 0x7f81e01205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81e4f8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e0133fa0 0x7f81e0120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81e4f8c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e0123bc0 con 0x7f81e00a0a30 2023-09-30T22:36:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81e4f8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e0122f90 con 0x7f81e0133fa0 2023-09-30T22:36:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81e4f8c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00a34f0 con 0x7f81e00a1340 2023-09-30T22:36:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81ded9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e0133fa0 0x7f81e0120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81ddd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e00a1340 0x7f81e01205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81de59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e00a0a30 0x7f81e01200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81ddd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e00a1340 0x7f81e01205e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60148/0 (socket says 172.21.15.59:60148) 2023-09-30T22:36:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81de59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e00a0a30 0x7f81e01200a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47488/0 (socket says 172.21.15.59:47488) 2023-09-30T22:36:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81ded9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e0133fa0 0x7f81e0120b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38310/0 (socket says 172.21.15.59:38310) 2023-09-30T22:36:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81ddd9b700 1 -- 172.21.15.59:0/1713918352 learned_addr learned my addr 172.21.15.59:0/1713918352 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81ddd9b700 1 -- 172.21.15.59:0/1713918352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e0133fa0 msgr2=0x7f81e0120b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81ddd9b700 1 --2- 172.21.15.59:0/1713918352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e0133fa0 0x7f81e0120b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81ddd9b700 1 -- 172.21.15.59:0/1713918352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e00a0a30 msgr2=0x7f81e01200a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81ddd9b700 1 --2- 172.21.15.59:0/1713918352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e00a0a30 0x7f81e01200a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81ddd9b700 1 -- 172.21.15.59:0/1713918352 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d40094a0 con 0x7f81e00a1340 2023-09-30T22:36:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81de59c700 1 --2- 172.21.15.59:0/1713918352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e00a0a30 0x7f81e01200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.340+0000 7f81ded9d700 1 --2- 172.21.15.59:0/1713918352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e0133fa0 0x7f81e0120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.341+0000 7f81ddd9b700 1 --2- 172.21.15.59:0/1713918352 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e00a1340 0x7f81e01205e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f81d400ebe0 tx=0x7f81d400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.341+0000 7f81ceffd700 1 -- 172.21.15.59:0/1713918352 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4009800 con 0x7f81e00a1340 2023-09-30T22:36:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.341+0000 7f81ceffd700 1 -- 172.21.15.59:0/1713918352 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d400c850 con 0x7f81e00a1340 2023-09-30T22:36:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.341+0000 7f81e4f8c700 1 -- 172.21.15.59:0/1713918352 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d80094a0 con 0x7f81e00a1340 2023-09-30T22:36:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.341+0000 7f81ceffd700 1 -- 172.21.15.59:0/1713918352 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400cbc0 con 0x7f81e00a1340 2023-09-30T22:36:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.341+0000 7f81e4f8c700 1 -- 172.21.15.59:0/1713918352 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d0009b30 con 0x7f81e00a1340 2023-09-30T22:36:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.342+0000 7f81ceffd700 1 -- 172.21.15.59:0/1713918352 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81d400cd20 con 0x7f81e00a1340 2023-09-30T22:36:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.342+0000 7f81ceffd700 1 -- 172.21.15.59:0/1713918352 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f81d403feb0 con 0x7f81e00a1340 2023-09-30T22:36:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.342+0000 7f81e4f8c700 1 -- 172.21.15.59:0/1713918352 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e0074ea0 con 0x7f81e00a1340 2023-09-30T22:36:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.347+0000 7f81ceffd700 1 -- 172.21.15.59:0/1713918352 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81d4017080 con 0x7f81e00a1340 2023-09-30T22:36:10.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.378+0000 7faafd78e700 1 Processor -- start 2023-09-30T22:36:10.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.378+0000 7faafd78e700 1 -- start start 2023-09-30T22:36:10.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.379+0000 7faafd78e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf80a0a30 0x7faaf80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:10.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.379+0000 7faafd78e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf809d630 0x7faaf80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:10.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.379+0000 7faafd78e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf80a2a70 con 0x7faaf8133930 2023-09-30T22:36:10.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.379+0000 7faafd78e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf80a01d0 con 0x7faaf809d630 2023-09-30T22:36:10.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.379+0000 7faafd78e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaf809e2b0 con 0x7faaf80a0a30 2023-09-30T22:36:10.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.379+0000 7faaf6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf80a0a30 0x7faaf80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:10.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.379+0000 7faaf67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf809d630 0x7faaf80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:10.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.379+0000 7faaf6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf80a0a30 0x7faaf80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60152/0 (socket says 172.21.15.59:60152) 2023-09-30T22:36:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.379+0000 7faaf6ffd700 1 -- 172.21.15.59:0/1763490556 learned_addr learned my addr 172.21.15.59:0/1763490556 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.379+0000 7faaf6ffd700 1 -- 172.21.15.59:0/1763490556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf809d630 msgr2=0x7faaf80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.379+0000 7faaf6ffd700 1 --2- 172.21.15.59:0/1763490556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf809d630 0x7faaf80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.379+0000 7faaf6ffd700 1 -- 172.21.15.59:0/1763490556 >> v1:172.21.15.59:6789/0 conn(0x7faaf8133930 legacy=0x7faaf8133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.379+0000 7faaf5ffb700 1 -- 172.21.15.59:0/1763490556 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520032596 0 0) 0x7faaf80a2a70 con 0x7faaf8133930 2023-09-30T22:36:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.379+0000 7faaf6ffd700 1 -- 172.21.15.59:0/1763490556 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf809dc50 con 0x7faaf80a0a30 2023-09-30T22:36:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.379+0000 7faaf67fc700 1 --2- 172.21.15.59:0/1763490556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf809d630 0x7faaf80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.380+0000 7faaf6ffd700 1 --2- 172.21.15.59:0/1763490556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf80a0a30 0x7faaf80a0e00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009920 tx=0x7faaf0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2f63260f6f6a29 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.380+0000 7faaf5ffb700 1 -- 172.21.15.59:0/1763490556 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0011830 con 0x7faaf80a0a30 2023-09-30T22:36:10.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.380+0000 7faaf5ffb700 1 -- 172.21.15.59:0/1763490556 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf0011990 con 0x7faaf80a0a30 2023-09-30T22:36:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.380+0000 7faaf5ffb700 1 -- 172.21.15.59:0/1763490556 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0011d20 con 0x7faaf80a0a30 2023-09-30T22:36:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.380+0000 7faafd78e700 1 -- 172.21.15.59:0/1763490556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf80a0a30 msgr2=0x7faaf80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.380+0000 7faafd78e700 1 --2- 172.21.15.59:0/1763490556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf80a0a30 0x7faaf80a0e00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009920 tx=0x7faaf0009c30 comp rx=0 tx=0).stop 2023-09-30T22:36:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.380+0000 7faafd78e700 1 -- 172.21.15.59:0/1763490556 shutdown_connections 2023-09-30T22:36:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.380+0000 7faafd78e700 1 --2- 172.21.15.59:0/1763490556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf80a0a30 0x7faaf80a0e00 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.381+0000 7faafd78e700 1 --2- 172.21.15.59:0/1763490556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf809d630 0x7faaf80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.381+0000 7faafd78e700 1 -- 172.21.15.59:0/1763490556 >> 172.21.15.59:0/1763490556 conn(0x7faaf80a3050 msgr2=0x7faaf80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.381+0000 7faafd78e700 1 -- 172.21.15.59:0/1763490556 shutdown_connections 2023-09-30T22:36:10.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.381+0000 7faafd78e700 1 -- 172.21.15.59:0/1763490556 wait complete. 2023-09-30T22:36:10.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.382+0000 7faafd78e700 1 Processor -- start 2023-09-30T22:36:10.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.382+0000 7faafd78e700 1 -- start start 2023-09-30T22:36:10.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faafd78e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaf809d630 0x7faaf811f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:10.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faafd78e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf80a0a30 0x7faaf811fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:10.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faafd78e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf8133930 0x7faaf81c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:10.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faafd78e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf811f190 con 0x7faaf809d630 2023-09-30T22:36:10.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faafd78e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf80a42e0 con 0x7faaf8133930 2023-09-30T22:36:10.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faafd78e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaf80a0410 con 0x7faaf80a0a30 2023-09-30T22:36:10.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faaf67fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf80a0a30 0x7faaf811fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faaf6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaf809d630 0x7faaf811f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faaf67fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf80a0a30 0x7faaf811fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60168/0 (socket says 172.21.15.59:60168) 2023-09-30T22:36:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faaf67fc700 1 -- 172.21.15.59:0/2573168743 learned_addr learned my addr 172.21.15.59:0/2573168743 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faaf77fe700 1 --2- 172.21.15.59:0/2573168743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf8133930 0x7faaf81c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faaf67fc700 1 -- 172.21.15.59:0/2573168743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf8133930 msgr2=0x7faaf81c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faaf67fc700 1 --2- 172.21.15.59:0/2573168743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf8133930 0x7faaf81c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faaf67fc700 1 -- 172.21.15.59:0/2573168743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaf809d630 msgr2=0x7faaf811f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faaf67fc700 1 --2- 172.21.15.59:0/2573168743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaf809d630 0x7faaf811f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faaf67fc700 1 -- 172.21.15.59:0/2573168743 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae00094a0 con 0x7faaf80a0a30 2023-09-30T22:36:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.383+0000 7faaf6ffd700 1 --2- 172.21.15.59:0/2573168743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaf809d630 0x7faaf811f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:10.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.384+0000 7faaf67fc700 1 --2- 172.21.15.59:0/2573168743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf80a0a30 0x7faaf811fc70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7faae000ebb0 tx=0x7faae000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.384+0000 7faaef7fe700 1 -- 172.21.15.59:0/2573168743 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae000c850 con 0x7faaf80a0a30 2023-09-30T22:36:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.384+0000 7faaef7fe700 1 -- 172.21.15.59:0/2573168743 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae000c9b0 con 0x7faaf80a0a30 2023-09-30T22:36:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.384+0000 7faafd78e700 1 -- 172.21.15.59:0/2573168743 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf0009550 con 0x7faaf80a0a30 2023-09-30T22:36:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.384+0000 7faaef7fe700 1 -- 172.21.15.59:0/2573168743 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae000cd40 con 0x7faaf80a0a30 2023-09-30T22:36:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.384+0000 7faafd78e700 1 -- 172.21.15.59:0/2573168743 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf81210d0 con 0x7faaf80a0a30 2023-09-30T22:36:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.385+0000 7faaef7fe700 1 -- 172.21.15.59:0/2573168743 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faae0013470 con 0x7faaf80a0a30 2023-09-30T22:36:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.385+0000 7faafd78e700 1 -- 172.21.15.59:0/2573168743 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf81201b0 con 0x7faaf80a0a30 2023-09-30T22:36:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.385+0000 7faaef7fe700 1 -- 172.21.15.59:0/2573168743 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faae003fb60 con 0x7faaf80a0a30 2023-09-30T22:36:10.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.390+0000 7faaef7fe700 1 -- 172.21.15.59:0/2573168743 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faae001b3b0 con 0x7faaf80a0a30 2023-09-30T22:36:10.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.558+0000 7f81e4f8c700 1 -- 172.21.15.59:0/1713918352 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f81e00a28e0 con 0x7f81e00a1340 2023-09-30T22:36:10.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.558+0000 7f81ceffd700 1 -- 172.21.15.59:0/1713918352 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81d402b090 con 0x7f81e00a1340 2023-09-30T22:36:10.559 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.560+0000 7f81e4f8c700 1 -- 172.21.15.59:0/1713918352 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e00a1340 msgr2=0x7f81e01205e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.560+0000 7f81e4f8c700 1 --2- 172.21.15.59:0/1713918352 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e00a1340 0x7f81e01205e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f81d400ebe0 tx=0x7f81d400eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.560+0000 7f81e4f8c700 1 -- 172.21.15.59:0/1713918352 shutdown_connections 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.560+0000 7f81e4f8c700 1 --2- 172.21.15.59:0/1713918352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e0133fa0 0x7f81e0120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.560+0000 7f81e4f8c700 1 --2- 172.21.15.59:0/1713918352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e00a0a30 0x7f81e01200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.560+0000 7f81e4f8c700 1 --2- 172.21.15.59:0/1713918352 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e00a1340 0x7f81e01205e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.560+0000 7f81e4f8c700 1 -- 172.21.15.59:0/1713918352 >> 172.21.15.59:0/1713918352 conn(0x7f81e00a6550 msgr2=0x7f81e01bae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.561+0000 7f81e4f8c700 1 -- 172.21.15.59:0/1713918352 shutdown_connections 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.561+0000 7f81e4f8c700 1 -- 172.21.15.59:0/1713918352 wait complete. 2023-09-30T22:36:10.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:10.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.600+0000 7faafd78e700 1 -- 172.21.15.59:0/2573168743 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faaf8122350 con 0x7faaf80a0a30 2023-09-30T22:36:10.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.600+0000 7faaef7fe700 1 -- 172.21.15.59:0/2573168743 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faae0017030 con 0x7faaf80a0a30 2023-09-30T22:36:10.600 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:10.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.602+0000 7faafd78e700 1 -- 172.21.15.59:0/2573168743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf80a0a30 msgr2=0x7faaf811fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:10.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.602+0000 7faafd78e700 1 --2- 172.21.15.59:0/2573168743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf80a0a30 0x7faaf811fc70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7faae000ebb0 tx=0x7faae000eec0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.602+0000 7faafd78e700 1 -- 172.21.15.59:0/2573168743 shutdown_connections 2023-09-30T22:36:10.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.602+0000 7faafd78e700 1 --2- 172.21.15.59:0/2573168743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf8133930 0x7faaf81c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.602+0000 7faafd78e700 1 --2- 172.21.15.59:0/2573168743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaf809d630 0x7faaf811f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.602+0000 7faafd78e700 1 --2- 172.21.15.59:0/2573168743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf80a0a30 0x7faaf811fc70 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:10.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.602+0000 7faafd78e700 1 -- 172.21.15.59:0/2573168743 >> 172.21.15.59:0/2573168743 conn(0x7faaf80a3050 msgr2=0x7faaf81bb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:10.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.602+0000 7faafd78e700 1 -- 172.21.15.59:0/2573168743 shutdown_connections 2023-09-30T22:36:10.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:10.602+0000 7faafd78e700 1 -- 172.21.15.59:0/2573168743 wait complete. 2023-09-30T22:36:10.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:11.117 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:11.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:11.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.266+0000 7f44d1fa6700 1 Processor -- start 2023-09-30T22:36:11.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.266+0000 7f44d1fa6700 1 -- start start 2023-09-30T22:36:11.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.266+0000 7f44d1fa6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44cc0a1510 0x7f44cc138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.266+0000 7f44d1fa6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f44cc139250 0x7f44cc13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.266+0000 7f44d1fa6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44cc09edd0 con 0x7f44cc0a0a30 2023-09-30T22:36:11.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.266+0000 7f44d1fa6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44cc0a18e0 con 0x7f44cc139250 2023-09-30T22:36:11.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.266+0000 7f44d1fa6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc09e1f0 con 0x7f44cc0a1510 2023-09-30T22:36:11.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.266+0000 7f44cbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f44cc139250 0x7f44cc13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.266+0000 7f44cbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f44cc139250 0x7f44cc13b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47504/0 (socket says 172.21.15.59:47504) 2023-09-30T22:36:11.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.266+0000 7f44cbfff700 1 -- 172.21.15.59:0/2763932107 learned_addr learned my addr 172.21.15.59:0/2763932107 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:11.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.266+0000 7f44caffd700 1 --2- 172.21.15.59:0/2763932107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44cc0a1510 0x7f44cc138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.267+0000 7f44cbfff700 1 -- 172.21.15.59:0/2763932107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44cc0a1510 msgr2=0x7f44cc138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:11.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.267+0000 7f44cbfff700 1 --2- 172.21.15.59:0/2763932107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44cc0a1510 0x7f44cc138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.267+0000 7f44cbfff700 1 -- 172.21.15.59:0/2763932107 >> v1:172.21.15.59:6789/0 conn(0x7f44cc0a0a30 legacy=0x7f44cc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.267+0000 7f44cbfff700 1 -- 172.21.15.59:0/2763932107 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc09dc50 con 0x7f44cc139250 2023-09-30T22:36:11.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.267+0000 7f44caffd700 1 --2- 172.21.15.59:0/2763932107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44cc0a1510 0x7f44cc138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:11.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.267+0000 7f44cbfff700 1 --2- 172.21.15.59:0/2763932107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44cc139250 0x7f44cc13b630 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f44c4009920 tx=0x7f44c4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f49d49a33239a71 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:11.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.267+0000 7f44ca7fc700 1 -- 172.21.15.59:0/2763932107 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c4011830 con 0x7f44cc139250 2023-09-30T22:36:11.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.267+0000 7f44ca7fc700 1 -- 172.21.15.59:0/2763932107 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c4011990 con 0x7f44cc139250 2023-09-30T22:36:11.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.267+0000 7f44ca7fc700 1 -- 172.21.15.59:0/2763932107 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c4011d20 con 0x7f44cc139250 2023-09-30T22:36:11.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.268+0000 7f44d1fa6700 1 -- 172.21.15.59:0/2763932107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44cc139250 msgr2=0x7f44cc13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.268+0000 7f44d1fa6700 1 --2- 172.21.15.59:0/2763932107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44cc139250 0x7f44cc13b630 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f44c4009920 tx=0x7f44c4009c30 comp rx=0 tx=0).stop 2023-09-30T22:36:11.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.268+0000 7f44d1fa6700 1 -- 172.21.15.59:0/2763932107 shutdown_connections 2023-09-30T22:36:11.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.268+0000 7f44d1fa6700 1 --2- 172.21.15.59:0/2763932107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44cc139250 0x7f44cc13b630 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.268+0000 7f44d1fa6700 1 --2- 172.21.15.59:0/2763932107 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44cc0a1510 0x7f44cc138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.268+0000 7f44d1fa6700 1 -- 172.21.15.59:0/2763932107 >> 172.21.15.59:0/2763932107 conn(0x7f44cc0a6550 msgr2=0x7f44cc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:11.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.268+0000 7f44d1fa6700 1 -- 172.21.15.59:0/2763932107 shutdown_connections 2023-09-30T22:36:11.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.268+0000 7f44d1fa6700 1 -- 172.21.15.59:0/2763932107 wait complete. 2023-09-30T22:36:11.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.269+0000 7f44d1fa6700 1 Processor -- start 2023-09-30T22:36:11.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.269+0000 7f44d1fa6700 1 -- start start 2023-09-30T22:36:11.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44d1fa6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44cc0a0a30 0x7f44cc123740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44d1fa6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44cc0a1510 0x7f44cc123c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44d1fa6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44cc139250 0x7f44cc1c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44d1fa6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc1241c0 con 0x7f44cc0a1510 2023-09-30T22:36:11.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44d1fa6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc123280 con 0x7f44cc0a0a30 2023-09-30T22:36:11.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44d1fa6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc1234b0 con 0x7f44cc139250 2023-09-30T22:36:11.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44caffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44cc0a1510 0x7f44cc123c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44caffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44cc0a1510 0x7f44cc123c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47520/0 (socket says 172.21.15.59:47520) 2023-09-30T22:36:11.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44caffd700 1 -- 172.21.15.59:0/3701663543 learned_addr learned my addr 172.21.15.59:0/3701663543 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:11.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44cbfff700 1 --2- 172.21.15.59:0/3701663543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44cc139250 0x7f44cc1c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44cb7fe700 1 --2- 172.21.15.59:0/3701663543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44cc0a0a30 0x7f44cc123740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44caffd700 1 -- 172.21.15.59:0/3701663543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44cc139250 msgr2=0x7f44cc1c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44caffd700 1 --2- 172.21.15.59:0/3701663543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44cc139250 0x7f44cc1c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44caffd700 1 -- 172.21.15.59:0/3701663543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44cc0a0a30 msgr2=0x7f44cc123740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44caffd700 1 --2- 172.21.15.59:0/3701663543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44cc0a0a30 0x7f44cc123740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44caffd700 1 -- 172.21.15.59:0/3701663543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c00094a0 con 0x7f44cc0a1510 2023-09-30T22:36:11.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44caffd700 1 --2- 172.21.15.59:0/3701663543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44cc0a1510 0x7f44cc123c80 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f44c000ebe0 tx=0x7f44c000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:11.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44b3fff700 1 -- 172.21.15.59:0/3701663543 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c000c850 con 0x7f44cc0a1510 2023-09-30T22:36:11.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44b3fff700 1 -- 172.21.15.59:0/3701663543 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c000c9b0 con 0x7f44cc0a1510 2023-09-30T22:36:11.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.270+0000 7f44d1fa6700 1 -- 172.21.15.59:0/3701663543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c4009550 con 0x7f44cc0a1510 2023-09-30T22:36:11.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.271+0000 7f44b3fff700 1 -- 172.21.15.59:0/3701663543 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c000cd40 con 0x7f44cc0a1510 2023-09-30T22:36:11.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.271+0000 7f44d1fa6700 1 -- 172.21.15.59:0/3701663543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44cc126e50 con 0x7f44cc0a1510 2023-09-30T22:36:11.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.272+0000 7f44d1fa6700 1 -- 172.21.15.59:0/3701663543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44cc074ea0 con 0x7f44cc0a1510 2023-09-30T22:36:11.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.272+0000 7f44b3fff700 1 -- 172.21.15.59:0/3701663543 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44c0013470 con 0x7f44cc0a1510 2023-09-30T22:36:11.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.272+0000 7f44b3fff700 1 -- 172.21.15.59:0/3701663543 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f44c003ff80 con 0x7f44cc0a1510 2023-09-30T22:36:11.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.277+0000 7f44b3fff700 1 -- 172.21.15.59:0/3701663543 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44c0013720 con 0x7f44cc0a1510 2023-09-30T22:36:11.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.303+0000 7f6158255700 1 Processor -- start 2023-09-30T22:36:11.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.303+0000 7f6158255700 1 -- start start 2023-09-30T22:36:11.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.304+0000 7f6158255700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f615009d630 0x7f61500a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.304+0000 7f6158255700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6150138d80 0x7f615013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.304+0000 7f6158255700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61500a2a70 con 0x7f61500a0a30 2023-09-30T22:36:11.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.304+0000 7f6158255700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61500a01d0 con 0x7f6150138d80 2023-09-30T22:36:11.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.304+0000 7f6158255700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f615009e2b0 con 0x7f615009d630 2023-09-30T22:36:11.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.304+0000 7f61567f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6150138d80 0x7f615013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.304+0000 7f61557f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f615009d630 0x7f61500a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.304+0000 7f61567f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6150138d80 0x7f615013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38358/0 (socket says 172.21.15.59:38358) 2023-09-30T22:36:11.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.304+0000 7f61567f2700 1 -- 172.21.15.59:0/1870458575 learned_addr learned my addr 172.21.15.59:0/1870458575 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:11.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.304+0000 7f61567f2700 1 -- 172.21.15.59:0/1870458575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f615009d630 msgr2=0x7f61500a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:11.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.304+0000 7f61567f2700 1 --2- 172.21.15.59:0/1870458575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f615009d630 0x7f61500a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.304+0000 7f61567f2700 1 -- 172.21.15.59:0/1870458575 >> v1:172.21.15.59:6789/0 conn(0x7f61500a0a30 legacy=0x7f61500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.304+0000 7f6154fef700 1 -- 172.21.15.59:0/1870458575 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094634903 0 0) 0x7f61500a2a70 con 0x7f61500a0a30 2023-09-30T22:36:11.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.304+0000 7f61567f2700 1 -- 172.21.15.59:0/1870458575 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615009dc50 con 0x7f6150138d80 2023-09-30T22:36:11.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.304+0000 7f61557f0700 1 --2- 172.21.15.59:0/1870458575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f615009d630 0x7f61500a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:11.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.305+0000 7f61567f2700 1 --2- 172.21.15.59:0/1870458575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6150138d80 0x7f615013b160 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6148009920 tx=0x7f6148009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d50e99188e93359d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:11.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.305+0000 7f6154fef700 1 -- 172.21.15.59:0/1870458575 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148011830 con 0x7f6150138d80 2023-09-30T22:36:11.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.305+0000 7f6154fef700 1 -- 172.21.15.59:0/1870458575 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6148011990 con 0x7f6150138d80 2023-09-30T22:36:11.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.305+0000 7f6154fef700 1 -- 172.21.15.59:0/1870458575 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148011d20 con 0x7f6150138d80 2023-09-30T22:36:11.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.305+0000 7f6158255700 1 -- 172.21.15.59:0/1870458575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6150138d80 msgr2=0x7f615013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.305+0000 7f6158255700 1 --2- 172.21.15.59:0/1870458575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6150138d80 0x7f615013b160 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6148009920 tx=0x7f6148009c30 comp rx=0 tx=0).stop 2023-09-30T22:36:11.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.305+0000 7f6158255700 1 -- 172.21.15.59:0/1870458575 shutdown_connections 2023-09-30T22:36:11.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.305+0000 7f6158255700 1 --2- 172.21.15.59:0/1870458575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6150138d80 0x7f615013b160 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.305+0000 7f6158255700 1 --2- 172.21.15.59:0/1870458575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f615009d630 0x7f61500a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.305+0000 7f6158255700 1 -- 172.21.15.59:0/1870458575 >> 172.21.15.59:0/1870458575 conn(0x7f61500a3050 msgr2=0x7f61500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:11.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.306+0000 7f6158255700 1 -- 172.21.15.59:0/1870458575 shutdown_connections 2023-09-30T22:36:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.306+0000 7f6158255700 1 -- 172.21.15.59:0/1870458575 wait complete. 2023-09-30T22:36:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.306+0000 7f6158255700 1 Processor -- start 2023-09-30T22:36:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f6158255700 1 -- start start 2023-09-30T22:36:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f6158255700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f615009d630 0x7f6150133690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f6158255700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61500a0a30 0x7f6150133bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f6158255700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6150138d80 0x7f6150134110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f6158255700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61501364d0 con 0x7f615009d630 2023-09-30T22:36:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f6158255700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6150136e40 con 0x7f6150138d80 2023-09-30T22:36:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f6158255700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61500a4ae0 con 0x7f61500a0a30 2023-09-30T22:36:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f61567f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6150138d80 0x7f6150134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f6155ff1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f615009d630 0x7f6150133690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f61557f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61500a0a30 0x7f6150133bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f61567f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6150138d80 0x7f6150134110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38364/0 (socket says 172.21.15.59:38364) 2023-09-30T22:36:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f61567f2700 1 -- 172.21.15.59:0/1463952043 learned_addr learned my addr 172.21.15.59:0/1463952043 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f6155ff1700 1 -- 172.21.15.59:0/1463952043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61500a0a30 msgr2=0x7f6150133bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f6155ff1700 1 --2- 172.21.15.59:0/1463952043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61500a0a30 0x7f6150133bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f6155ff1700 1 -- 172.21.15.59:0/1463952043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6150138d80 msgr2=0x7f6150134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.307+0000 7f6155ff1700 1 --2- 172.21.15.59:0/1463952043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6150138d80 0x7f6150134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.308+0000 7f6155ff1700 1 -- 172.21.15.59:0/1463952043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61400094a0 con 0x7f615009d630 2023-09-30T22:36:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.308+0000 7f61567f2700 1 --2- 172.21.15.59:0/1463952043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6150138d80 0x7f6150134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.308+0000 7f61557f0700 1 --2- 172.21.15.59:0/1463952043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61500a0a30 0x7f6150133bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.308+0000 7f6155ff1700 1 --2- 172.21.15.59:0/1463952043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f615009d630 0x7f6150133690 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f614c0012e0 tx=0x7f614c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.308+0000 7f61467fc700 1 -- 172.21.15.59:0/1463952043 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c003e30 con 0x7f615009d630 2023-09-30T22:36:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.308+0000 7f61467fc700 1 -- 172.21.15.59:0/1463952043 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c005070 con 0x7f615009d630 2023-09-30T22:36:11.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.308+0000 7f6158255700 1 -- 172.21.15.59:0/1463952043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6148009550 con 0x7f615009d630 2023-09-30T22:36:11.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.308+0000 7f61467fc700 1 -- 172.21.15.59:0/1463952043 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c0053e0 con 0x7f615009d630 2023-09-30T22:36:11.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.308+0000 7f6158255700 1 -- 172.21.15.59:0/1463952043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6150134a80 con 0x7f615009d630 2023-09-30T22:36:11.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.309+0000 7f61467fc700 1 -- 172.21.15.59:0/1463952043 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f614c005540 con 0x7f615009d630 2023-09-30T22:36:11.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.309+0000 7f61467fc700 1 -- 172.21.15.59:0/1463952043 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f614c03f1d0 con 0x7f615009d630 2023-09-30T22:36:11.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.309+0000 7f6158255700 1 -- 172.21.15.59:0/1463952043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61500747f0 con 0x7f615009d630 2023-09-30T22:36:11.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.314+0000 7f61467fc700 1 -- 172.21.15.59:0/1463952043 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f614c0057f0 con 0x7f615009d630 2023-09-30T22:36:11.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.484+0000 7f44d1fa6700 1 -- 172.21.15.59:0/3701663543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f44cc0a1d10 con 0x7f44cc0a1510 2023-09-30T22:36:11.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.484+0000 7f44b3fff700 1 -- 172.21.15.59:0/3701663543 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44c0021030 con 0x7f44cc0a1510 2023-09-30T22:36:11.485 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.487+0000 7f44d1fa6700 1 -- 172.21.15.59:0/3701663543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44cc0a1510 msgr2=0x7f44cc123c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.487+0000 7f44d1fa6700 1 --2- 172.21.15.59:0/3701663543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44cc0a1510 0x7f44cc123c80 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f44c000ebe0 tx=0x7f44c000eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.487+0000 7f44d1fa6700 1 -- 172.21.15.59:0/3701663543 shutdown_connections 2023-09-30T22:36:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.487+0000 7f44d1fa6700 1 --2- 172.21.15.59:0/3701663543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44cc139250 0x7f44cc1c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.487+0000 7f44d1fa6700 1 --2- 172.21.15.59:0/3701663543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44cc0a0a30 0x7f44cc123740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.487+0000 7f44d1fa6700 1 --2- 172.21.15.59:0/3701663543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44cc0a1510 0x7f44cc123c80 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.487+0000 7f44d1fa6700 1 -- 172.21.15.59:0/3701663543 >> 172.21.15.59:0/3701663543 conn(0x7f44cc0a6550 msgr2=0x7f44cc0a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:11.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.487+0000 7f44d1fa6700 1 -- 172.21.15.59:0/3701663543 shutdown_connections 2023-09-30T22:36:11.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.487+0000 7f44d1fa6700 1 -- 172.21.15.59:0/3701663543 wait complete. 2023-09-30T22:36:11.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:11.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.521+0000 7f6158255700 1 -- 172.21.15.59:0/1463952043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6150072980 con 0x7f615009d630 2023-09-30T22:36:11.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.522+0000 7f61467fc700 1 -- 172.21.15.59:0/1463952043 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f614c01a360 con 0x7f615009d630 2023-09-30T22:36:11.522 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:11.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.524+0000 7f6158255700 1 -- 172.21.15.59:0/1463952043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f615009d630 msgr2=0x7f6150133690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.524+0000 7f6158255700 1 --2- 172.21.15.59:0/1463952043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f615009d630 0x7f6150133690 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f614c0012e0 tx=0x7f614c00cac0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.524+0000 7f6158255700 1 -- 172.21.15.59:0/1463952043 shutdown_connections 2023-09-30T22:36:11.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.524+0000 7f6158255700 1 --2- 172.21.15.59:0/1463952043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6150138d80 0x7f6150134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.524+0000 7f6158255700 1 --2- 172.21.15.59:0/1463952043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f615009d630 0x7f6150133690 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.524+0000 7f6158255700 1 --2- 172.21.15.59:0/1463952043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61500a0a30 0x7f6150133bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.524+0000 7f6158255700 1 -- 172.21.15.59:0/1463952043 >> 172.21.15.59:0/1463952043 conn(0x7f61500a3050 msgr2=0x7f615009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:11.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.524+0000 7f6158255700 1 -- 172.21.15.59:0/1463952043 shutdown_connections 2023-09-30T22:36:11.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.524+0000 7f6158255700 1 -- 172.21.15.59:0/1463952043 wait complete. 2023-09-30T22:36:11.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:11.575 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:11.617 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:11.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.719+0000 7ff06e80a700 1 Processor -- start 2023-09-30T22:36:11.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.719+0000 7ff06e80a700 1 -- start start 2023-09-30T22:36:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.720+0000 7ff06e80a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0680a1510 0x7ff068138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.720+0000 7ff06e80a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff068139250 0x7ff06813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.720+0000 7ff06e80a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06809edd0 con 0x7ff0680a0a30 2023-09-30T22:36:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.720+0000 7ff06e80a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0680a18e0 con 0x7ff0680a1510 2023-09-30T22:36:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.720+0000 7ff06e80a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff06809e1f0 con 0x7ff068139250 2023-09-30T22:36:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.720+0000 7ff0677fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0680a1510 0x7ff068138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.720+0000 7ff0677fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0680a1510 0x7ff068138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47540/0 (socket says 172.21.15.59:47540) 2023-09-30T22:36:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.720+0000 7ff06cda7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff068139250 0x7ff06813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.720+0000 7ff0677fe700 1 -- 172.21.15.59:0/192648959 learned_addr learned my addr 172.21.15.59:0/192648959 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.720+0000 7ff06cda7700 1 -- 172.21.15.59:0/192648959 >> v2:172.21.15.59:3300/0 conn(0x7ff0680a1510 msgr2=0x7ff068138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.720+0000 7ff06cda7700 1 --2- 172.21.15.59:0/192648959 >> v2:172.21.15.59:3300/0 conn(0x7ff0680a1510 0x7ff068138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.720+0000 7ff06cda7700 1 -- 172.21.15.59:0/192648959 >> v1:172.21.15.59:6789/0 conn(0x7ff0680a0a30 legacy=0x7ff0680a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.720+0000 7ff06cda7700 1 -- 172.21.15.59:0/192648959 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06809dc50 con 0x7ff068139250 2023-09-30T22:36:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.720+0000 7ff0677fe700 1 --2- 172.21.15.59:0/192648959 >> v2:172.21.15.59:3300/0 conn(0x7ff0680a1510 0x7ff068138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.720+0000 7ff06cda7700 1 --2- 172.21.15.59:0/192648959 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff068139250 0x7ff06813b630 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff060009d90 tx=0x7ff06000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db327d8c32daa172 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.721+0000 7ff066ffd700 1 -- 172.21.15.59:0/192648959 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06000e070 con 0x7ff068139250 2023-09-30T22:36:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.721+0000 7ff066ffd700 1 -- 172.21.15.59:0/192648959 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06000bb20 con 0x7ff068139250 2023-09-30T22:36:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.721+0000 7ff066ffd700 1 -- 172.21.15.59:0/192648959 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060012430 con 0x7ff068139250 2023-09-30T22:36:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.721+0000 7ff06e80a700 1 -- 172.21.15.59:0/192648959 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff068139250 msgr2=0x7ff06813b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.721+0000 7ff06e80a700 1 --2- 172.21.15.59:0/192648959 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff068139250 0x7ff06813b630 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff060009d90 tx=0x7ff06000b330 comp rx=0 tx=0).stop 2023-09-30T22:36:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.721+0000 7ff06e80a700 1 -- 172.21.15.59:0/192648959 shutdown_connections 2023-09-30T22:36:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.721+0000 7ff06e80a700 1 --2- 172.21.15.59:0/192648959 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff068139250 0x7ff06813b630 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.721+0000 7ff06e80a700 1 --2- 172.21.15.59:0/192648959 >> v2:172.21.15.59:3300/0 conn(0x7ff0680a1510 0x7ff068138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.721+0000 7ff06e80a700 1 -- 172.21.15.59:0/192648959 >> 172.21.15.59:0/192648959 conn(0x7ff0680a6550 msgr2=0x7ff0680a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.722+0000 7ff06e80a700 1 -- 172.21.15.59:0/192648959 shutdown_connections 2023-09-30T22:36:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.722+0000 7ff06e80a700 1 -- 172.21.15.59:0/192648959 wait complete. 2023-09-30T22:36:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.722+0000 7ff06e80a700 1 Processor -- start 2023-09-30T22:36:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.723+0000 7ff06e80a700 1 -- start start 2023-09-30T22:36:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.723+0000 7ff06e80a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0680a0a30 0x7ff0681c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.723+0000 7ff06e80a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0680a1510 0x7ff0681c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.723+0000 7ff06e80a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff068139250 0x7ff0681c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.723+0000 7ff06e80a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff068124820 con 0x7ff068139250 2023-09-30T22:36:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.723+0000 7ff06e80a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff068125d40 con 0x7ff0680a1510 2023-09-30T22:36:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.723+0000 7ff06e80a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0681253a0 con 0x7ff0680a0a30 2023-09-30T22:36:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.723+0000 7ff06cda7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff068139250 0x7ff0681c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.723+0000 7ff0677fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0680a1510 0x7ff0681c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.723+0000 7ff06cda7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff068139250 0x7ff0681c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47544/0 (socket says 172.21.15.59:47544) 2023-09-30T22:36:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.723+0000 7ff0677fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0680a1510 0x7ff0681c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38378/0 (socket says 172.21.15.59:38378) 2023-09-30T22:36:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.723+0000 7ff06cda7700 1 -- 172.21.15.59:0/3510289729 learned_addr learned my addr 172.21.15.59:0/3510289729 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.723+0000 7ff067fff700 1 --2- 172.21.15.59:0/3510289729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0680a0a30 0x7ff0681c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.724+0000 7ff06cda7700 1 -- 172.21.15.59:0/3510289729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0680a0a30 msgr2=0x7ff0681c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.724+0000 7ff06cda7700 1 --2- 172.21.15.59:0/3510289729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0680a0a30 0x7ff0681c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.724+0000 7ff06cda7700 1 -- 172.21.15.59:0/3510289729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0680a1510 msgr2=0x7ff0681c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.724+0000 7ff06cda7700 1 --2- 172.21.15.59:0/3510289729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0680a1510 0x7ff0681c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.724+0000 7ff06cda7700 1 -- 172.21.15.59:0/3510289729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c009550 con 0x7ff068139250 2023-09-30T22:36:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.724+0000 7ff06cda7700 1 --2- 172.21.15.59:0/3510289729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff068139250 0x7ff0681c8fc0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7ff060014040 tx=0x7ff060004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.724+0000 7ff064ff9700 1 -- 172.21.15.59:0/3510289729 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060012430 con 0x7ff068139250 2023-09-30T22:36:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.724+0000 7ff064ff9700 1 -- 172.21.15.59:0/3510289729 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff060020070 con 0x7ff068139250 2023-09-30T22:36:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.724+0000 7ff06e80a700 1 -- 172.21.15.59:0/3510289729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff060009a70 con 0x7ff068139250 2023-09-30T22:36:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.724+0000 7ff064ff9700 1 -- 172.21.15.59:0/3510289729 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060003ea0 con 0x7ff068139250 2023-09-30T22:36:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.724+0000 7ff06e80a700 1 -- 172.21.15.59:0/3510289729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0681262d0 con 0x7ff068139250 2023-09-30T22:36:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.725+0000 7ff064ff9700 1 -- 172.21.15.59:0/3510289729 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff060004040 con 0x7ff068139250 2023-09-30T22:36:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.725+0000 7ff06e80a700 1 -- 172.21.15.59:0/3510289729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0681264c0 con 0x7ff068139250 2023-09-30T22:36:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.725+0000 7ff064ff9700 1 -- 172.21.15.59:0/3510289729 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff060022070 con 0x7ff068139250 2023-09-30T22:36:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.730+0000 7ff064ff9700 1 -- 172.21.15.59:0/3510289729 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff06002c070 con 0x7ff068139250 2023-09-30T22:36:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.760+0000 7f5fb9d2c700 1 Processor -- start 2023-09-30T22:36:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.760+0000 7f5fb9d2c700 1 -- start start 2023-09-30T22:36:11.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.760+0000 7f5fb9d2c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb4133a80 0x7f5fb4133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.760+0000 7f5fb9d2c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5fb412ff20 0x7f5fb4130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.761+0000 7f5fb9d2c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb406bc00 con 0x7f5fb4130870 2023-09-30T22:36:11.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.761+0000 7f5fb9d2c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb406c570 con 0x7f5fb412ff20 2023-09-30T22:36:11.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.761+0000 7f5fb9d2c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb40a0040 con 0x7f5fb4133a80 2023-09-30T22:36:11.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.761+0000 7f5fb37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb4133a80 0x7f5fb4133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.761+0000 7f5fb3fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5fb4130870 0x7f5fb413a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57644/0 (socket says 172.21.15.59:57644) 2023-09-30T22:36:11.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.761+0000 7f5fb2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5fb412ff20 0x7f5fb4130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.761+0000 7f5fb3fff700 1 -- 172.21.15.59:0/3524216812 learned_addr learned my addr 172.21.15.59:0/3524216812 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:11.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.761+0000 7f5fb2ffd700 1 -- 172.21.15.59:0/3524216812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb4133a80 msgr2=0x7f5fb4133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:11.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.761+0000 7f5fb2ffd700 1 --2- 172.21.15.59:0/3524216812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb4133a80 0x7f5fb4133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.761+0000 7f5fb2ffd700 1 -- 172.21.15.59:0/3524216812 >> v1:172.21.15.59:6789/0 conn(0x7f5fb4130870 legacy=0x7f5fb413a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.761+0000 7f5fb2ffd700 1 -- 172.21.15.59:0/3524216812 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb4133860 con 0x7f5fb412ff20 2023-09-30T22:36:11.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.761+0000 7f5fb27fc700 1 -- 172.21.15.59:0/3524216812 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278633785 0 0) 0x7f5fb406bc00 con 0x7f5fb4130870 2023-09-30T22:36:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.761+0000 7f5fb37fe700 1 --2- 172.21.15.59:0/3524216812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb4133a80 0x7f5fb4133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.761+0000 7f5fb2ffd700 1 --2- 172.21.15.59:0/3524216812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb412ff20 0x7f5fb4130330 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009840 tx=0x7f5f9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6069afaef374bf14 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.762+0000 7f5fb27fc700 1 -- 172.21.15.59:0/3524216812 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c011830 con 0x7f5fb412ff20 2023-09-30T22:36:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.762+0000 7f5fb27fc700 1 -- 172.21.15.59:0/3524216812 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9c011990 con 0x7f5fb412ff20 2023-09-30T22:36:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.762+0000 7f5fb27fc700 1 -- 172.21.15.59:0/3524216812 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c011d20 con 0x7f5fb412ff20 2023-09-30T22:36:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.762+0000 7f5fb9d2c700 1 -- 172.21.15.59:0/3524216812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb412ff20 msgr2=0x7f5fb4130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.762+0000 7f5fb9d2c700 1 --2- 172.21.15.59:0/3524216812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb412ff20 0x7f5fb4130330 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009840 tx=0x7f5f9c009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.762+0000 7f5fb9d2c700 1 -- 172.21.15.59:0/3524216812 shutdown_connections 2023-09-30T22:36:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.762+0000 7f5fb9d2c700 1 --2- 172.21.15.59:0/3524216812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb4133a80 0x7f5fb4133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.762+0000 7f5fb9d2c700 1 --2- 172.21.15.59:0/3524216812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb412ff20 0x7f5fb4130330 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.762+0000 7f5fb9d2c700 1 -- 172.21.15.59:0/3524216812 >> 172.21.15.59:0/3524216812 conn(0x7f5fb40a4210 msgr2=0x7f5fb40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:11.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.762+0000 7f5fb9d2c700 1 -- 172.21.15.59:0/3524216812 shutdown_connections 2023-09-30T22:36:11.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.762+0000 7f5fb9d2c700 1 -- 172.21.15.59:0/3524216812 wait complete. 2023-09-30T22:36:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.763+0000 7f5fb9d2c700 1 Processor -- start 2023-09-30T22:36:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.763+0000 7f5fb9d2c700 1 -- start start 2023-09-30T22:36:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb9d2c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb412ff20 0x7f5fb409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb9d2c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb4130870 0x7f5fb409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb9d2c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb4133a80 0x7f5fb409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb9d2c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb411ff90 con 0x7f5fb412ff20 2023-09-30T22:36:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb9d2c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb409de60 con 0x7f5fb4133a80 2023-09-30T22:36:11.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb9d2c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb41201e0 con 0x7f5fb4130870 2023-09-30T22:36:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb4130870 0x7f5fb409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb4130870 0x7f5fb409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60242/0 (socket says 172.21.15.59:60242) 2023-09-30T22:36:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb2ffd700 1 -- 172.21.15.59:0/3541520464 learned_addr learned my addr 172.21.15.59:0/3541520464 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb37fe700 1 --2- 172.21.15.59:0/3541520464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb412ff20 0x7f5fb409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb3fff700 1 --2- 172.21.15.59:0/3541520464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb4133a80 0x7f5fb409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb37fe700 1 -- 172.21.15.59:0/3541520464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb4130870 msgr2=0x7f5fb409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb37fe700 1 --2- 172.21.15.59:0/3541520464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb4130870 0x7f5fb409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb37fe700 1 -- 172.21.15.59:0/3541520464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb4133a80 msgr2=0x7f5fb409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb37fe700 1 --2- 172.21.15.59:0/3541520464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb4133a80 0x7f5fb409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb37fe700 1 -- 172.21.15.59:0/3541520464 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa40094a0 con 0x7f5fb412ff20 2023-09-30T22:36:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb3fff700 1 --2- 172.21.15.59:0/3541520464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb4133a80 0x7f5fb409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:11.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.764+0000 7f5fb2ffd700 1 --2- 172.21.15.59:0/3541520464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb4130870 0x7f5fb409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:11.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.765+0000 7f5fb37fe700 1 --2- 172.21.15.59:0/3541520464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb412ff20 0x7f5fb409c480 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400e9e0 tx=0x7f5fa400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:11.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.765+0000 7f5fabfff700 1 -- 172.21.15.59:0/3541520464 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400ee80 con 0x7f5fb412ff20 2023-09-30T22:36:11.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.765+0000 7f5fabfff700 1 -- 172.21.15.59:0/3541520464 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa400c850 con 0x7f5fb412ff20 2023-09-30T22:36:11.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.765+0000 7f5fb9d2c700 1 -- 172.21.15.59:0/3541520464 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9c0094a0 con 0x7f5fb412ff20 2023-09-30T22:36:11.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.765+0000 7f5fabfff700 1 -- 172.21.15.59:0/3541520464 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400cc00 con 0x7f5fb412ff20 2023-09-30T22:36:11.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.765+0000 7f5fb9d2c700 1 -- 172.21.15.59:0/3541520464 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb412db80 con 0x7f5fb412ff20 2023-09-30T22:36:11.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.766+0000 7f5fabfff700 1 -- 172.21.15.59:0/3541520464 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5fa400cd60 con 0x7f5fb412ff20 2023-09-30T22:36:11.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.766+0000 7f5fabfff700 1 -- 172.21.15.59:0/3541520464 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5fa403f860 con 0x7f5fb412ff20 2023-09-30T22:36:11.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.766+0000 7f5fb9d2c700 1 -- 172.21.15.59:0/3541520464 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb4074ea0 con 0x7f5fb412ff20 2023-09-30T22:36:11.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.771+0000 7f5fabfff700 1 -- 172.21.15.59:0/3541520464 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5fa4017080 con 0x7f5fb412ff20 2023-09-30T22:36:11.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.938+0000 7ff06e80a700 1 -- 172.21.15.59:0/3510289729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff068074ea0 con 0x7ff068139250 2023-09-30T22:36:11.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.938+0000 7ff064ff9700 1 -- 172.21.15.59:0/3510289729 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff06001a970 con 0x7ff068139250 2023-09-30T22:36:11.938 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.940+0000 7ff06e80a700 1 -- 172.21.15.59:0/3510289729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff068139250 msgr2=0x7ff0681c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.940+0000 7ff06e80a700 1 --2- 172.21.15.59:0/3510289729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff068139250 0x7ff0681c8fc0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7ff060014040 tx=0x7ff060004ad0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.940+0000 7ff06e80a700 1 -- 172.21.15.59:0/3510289729 shutdown_connections 2023-09-30T22:36:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.940+0000 7ff06e80a700 1 --2- 172.21.15.59:0/3510289729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0680a0a30 0x7ff0681c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.940+0000 7ff06e80a700 1 --2- 172.21.15.59:0/3510289729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff068139250 0x7ff0681c8fc0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.940+0000 7ff06e80a700 1 --2- 172.21.15.59:0/3510289729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0680a1510 0x7ff0681c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.940+0000 7ff06e80a700 1 -- 172.21.15.59:0/3510289729 >> 172.21.15.59:0/3510289729 conn(0x7ff0680a6550 msgr2=0x7ff0680a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.941+0000 7ff06e80a700 1 -- 172.21.15.59:0/3510289729 shutdown_connections 2023-09-30T22:36:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.941+0000 7ff06e80a700 1 -- 172.21.15.59:0/3510289729 wait complete. 2023-09-30T22:36:11.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.977+0000 7f5fb9d2c700 1 -- 172.21.15.59:0/3541520464 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5fb406b250 con 0x7f5fb412ff20 2023-09-30T22:36:11.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.977+0000 7f5fabfff700 1 -- 172.21.15.59:0/3541520464 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5fa401bde0 con 0x7f5fb412ff20 2023-09-30T22:36:11.978 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.979+0000 7f5fb9d2c700 1 -- 172.21.15.59:0/3541520464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb412ff20 msgr2=0x7f5fb409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.980+0000 7f5fb9d2c700 1 --2- 172.21.15.59:0/3541520464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb412ff20 0x7f5fb409c480 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400e9e0 tx=0x7f5fa400ecf0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.980+0000 7f5fb9d2c700 1 -- 172.21.15.59:0/3541520464 shutdown_connections 2023-09-30T22:36:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.980+0000 7f5fb9d2c700 1 --2- 172.21.15.59:0/3541520464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb4133a80 0x7f5fb409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.980+0000 7f5fb9d2c700 1 --2- 172.21.15.59:0/3541520464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb412ff20 0x7f5fb409c480 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.980+0000 7f5fb9d2c700 1 --2- 172.21.15.59:0/3541520464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb4130870 0x7f5fb409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.980+0000 7f5fb9d2c700 1 -- 172.21.15.59:0/3541520464 >> 172.21.15.59:0/3541520464 conn(0x7f5fb40a4210 msgr2=0x7f5fb409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.980+0000 7f5fb9d2c700 1 -- 172.21.15.59:0/3541520464 shutdown_connections 2023-09-30T22:36:11.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:11.980+0000 7f5fb9d2c700 1 -- 172.21.15.59:0/3541520464 wait complete. 2023-09-30T22:36:11.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:12.501 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:12.539 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:12.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.649+0000 7f1f684c3700 1 Processor -- start 2023-09-30T22:36:12.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.649+0000 7f1f684c3700 1 -- start start 2023-09-30T22:36:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.650+0000 7f1f684c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f600a0a30 0x7f1f600a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.650+0000 7f1f684c3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f6009d630 0x7f1f600a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.650+0000 7f1f684c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f60133930 0x7f1f60133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.650+0000 7f1f684c3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f600a2a70 con 0x7f1f6009d630 2023-09-30T22:36:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.650+0000 7f1f684c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600a01d0 con 0x7f1f60133930 2023-09-30T22:36:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.650+0000 7f1f684c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6009e2b0 con 0x7f1f600a0a30 2023-09-30T22:36:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.650+0000 7f1f6625f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f600a0a30 0x7f1f600a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.650+0000 7f1f66a60700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f60133930 0x7f1f60133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.650+0000 7f1f65a5e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f6009d630 0x7f1f600a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.650+0000 7f1f6625f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f600a0a30 0x7f1f600a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60256/0 (socket says 172.21.15.59:60256) 2023-09-30T22:36:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.650+0000 7f1f6625f700 1 -- 172.21.15.59:0/1176217478 learned_addr learned my addr 172.21.15.59:0/1176217478 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.651+0000 7f1f65a5e700 1 -- 172.21.15.59:0/1176217478 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f600a0a30 msgr2=0x7f1f600a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.651+0000 7f1f65a5e700 1 --2- 172.21.15.59:0/1176217478 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f600a0a30 0x7f1f600a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.651+0000 7f1f65a5e700 1 -- 172.21.15.59:0/1176217478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f60133930 msgr2=0x7f1f60133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.651+0000 7f1f65a5e700 1 --2- 172.21.15.59:0/1176217478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f60133930 0x7f1f60133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.651+0000 7f1f65a5e700 1 -- 172.21.15.59:0/1176217478 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6009dc50 con 0x7f1f6009d630 2023-09-30T22:36:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.651+0000 7f1f6625f700 1 --2- 172.21.15.59:0/1176217478 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f600a0a30 0x7f1f600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.651+0000 7f1f66a60700 1 --2- 172.21.15.59:0/1176217478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f60133930 0x7f1f60133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.651+0000 7f1f65a5e700 1 --2- 172.21.15.59:0/1176217478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f6009d630 0x7f1f600a1340 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009840 tx=0x7f1f54009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5320090bebe51d55 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.651+0000 7f1f6525d700 1 -- 172.21.15.59:0/1176217478 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54011830 con 0x7f1f6009d630 2023-09-30T22:36:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.651+0000 7f1f6525d700 1 -- 172.21.15.59:0/1176217478 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f54011990 con 0x7f1f6009d630 2023-09-30T22:36:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.651+0000 7f1f6525d700 1 -- 172.21.15.59:0/1176217478 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54011d20 con 0x7f1f6009d630 2023-09-30T22:36:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.652+0000 7f1f684c3700 1 -- 172.21.15.59:0/1176217478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f6009d630 msgr2=0x7f1f600a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.652+0000 7f1f684c3700 1 --2- 172.21.15.59:0/1176217478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f6009d630 0x7f1f600a1340 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009840 tx=0x7f1f54009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:12.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.652+0000 7f1f684c3700 1 -- 172.21.15.59:0/1176217478 shutdown_connections 2023-09-30T22:36:12.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.652+0000 7f1f684c3700 1 --2- 172.21.15.59:0/1176217478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f60133930 0x7f1f60133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.652+0000 7f1f684c3700 1 --2- 172.21.15.59:0/1176217478 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f600a0a30 0x7f1f600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.652+0000 7f1f684c3700 1 --2- 172.21.15.59:0/1176217478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f6009d630 0x7f1f600a1340 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.652+0000 7f1f684c3700 1 -- 172.21.15.59:0/1176217478 >> 172.21.15.59:0/1176217478 conn(0x7f1f600a3050 msgr2=0x7f1f600a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:12.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.652+0000 7f1f684c3700 1 -- 172.21.15.59:0/1176217478 shutdown_connections 2023-09-30T22:36:12.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.652+0000 7f1f684c3700 1 -- 172.21.15.59:0/1176217478 wait complete. 2023-09-30T22:36:12.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.653+0000 7f1f684c3700 1 Processor -- start 2023-09-30T22:36:12.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.653+0000 7f1f684c3700 1 -- start start 2023-09-30T22:36:12.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f684c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f6009d630 0x7f1f6011f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:12.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f684c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f600a0a30 0x7f1f6011fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f684c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f60133930 0x7f1f601c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f684c3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f601222e0 con 0x7f1f6009d630 2023-09-30T22:36:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f684c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f60122800 con 0x7f1f600a0a30 2023-09-30T22:36:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f684c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f60133430 con 0x7f1f60133930 2023-09-30T22:36:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f65a5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f600a0a30 0x7f1f6011fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f66a60700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f60133930 0x7f1f601c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f65a5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f600a0a30 0x7f1f6011fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38414/0 (socket says 172.21.15.59:38414) 2023-09-30T22:36:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f65a5e700 1 -- 172.21.15.59:0/1412169778 learned_addr learned my addr 172.21.15.59:0/1412169778 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f6625f700 1 --2- 172.21.15.59:0/1412169778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f6009d630 0x7f1f6011f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f66a60700 1 -- 172.21.15.59:0/1412169778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f600a0a30 msgr2=0x7f1f6011fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f66a60700 1 --2- 172.21.15.59:0/1412169778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f600a0a30 0x7f1f6011fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f66a60700 1 -- 172.21.15.59:0/1412169778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f6009d630 msgr2=0x7f1f6011f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f66a60700 1 --2- 172.21.15.59:0/1412169778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f6009d630 0x7f1f6011f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f66a60700 1 -- 172.21.15.59:0/1412169778 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f50009b30 con 0x7f1f60133930 2023-09-30T22:36:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f65a5e700 1 --2- 172.21.15.59:0/1412169778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f600a0a30 0x7f1f6011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f6625f700 1 --2- 172.21.15.59:0/1412169778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f6009d630 0x7f1f6011f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f66a60700 1 --2- 172.21.15.59:0/1412169778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f60133930 0x7f1f601c7ff0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800e940 tx=0x7f1f5800ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.654+0000 7f1f5effd700 1 -- 172.21.15.59:0/1412169778 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58004020 con 0x7f1f60133930 2023-09-30T22:36:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.655+0000 7f1f5effd700 1 -- 172.21.15.59:0/1412169778 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f580041a0 con 0x7f1f60133930 2023-09-30T22:36:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.655+0000 7f1f684c3700 1 -- 172.21.15.59:0/1412169778 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f580094a0 con 0x7f1f60133930 2023-09-30T22:36:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.655+0000 7f1f5effd700 1 -- 172.21.15.59:0/1412169778 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58004550 con 0x7f1f60133930 2023-09-30T22:36:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.655+0000 7f1f684c3700 1 -- 172.21.15.59:0/1412169778 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f540094a0 con 0x7f1f60133930 2023-09-30T22:36:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.655+0000 7f1f5effd700 1 -- 172.21.15.59:0/1412169778 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f580036a0 con 0x7f1f60133930 2023-09-30T22:36:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.656+0000 7f1f684c3700 1 -- 172.21.15.59:0/1412169778 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f60121f60 con 0x7f1f60133930 2023-09-30T22:36:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.656+0000 7f1f5effd700 1 -- 172.21.15.59:0/1412169778 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f5803f690 con 0x7f1f60133930 2023-09-30T22:36:12.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.661+0000 7f1f5effd700 1 -- 172.21.15.59:0/1412169778 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f60121f60 con 0x7f1f60133930 2023-09-30T22:36:12.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.688+0000 7faf8d287700 1 Processor -- start 2023-09-30T22:36:12.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.688+0000 7faf8d287700 1 -- start start 2023-09-30T22:36:12.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.688+0000 7faf8d287700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf8809c650 0x7faf8809ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:12.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf8d287700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf8809cf60 0x7faf88132080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:12.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf8d287700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8809ba70 con 0x7faf880a0090 2023-09-30T22:36:12.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf8d287700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8809e8f0 con 0x7faf8809cf60 2023-09-30T22:36:12.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf8d287700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf880a0760 con 0x7faf8809c650 2023-09-30T22:36:12.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf86ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf8809c650 0x7faf8809ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:12.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf877fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf8809cf60 0x7faf88132080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:12.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf877fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf8809cf60 0x7faf88132080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47604/0 (socket says 172.21.15.59:47604) 2023-09-30T22:36:12.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf86ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf8809c650 0x7faf8809ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60266/0 (socket says 172.21.15.59:60266) 2023-09-30T22:36:12.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf877fe700 1 -- 172.21.15.59:0/3547851955 learned_addr learned my addr 172.21.15.59:0/3547851955 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:12.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf877fe700 1 -- 172.21.15.59:0/3547851955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf8809c650 msgr2=0x7faf8809ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:12.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf877fe700 1 --2- 172.21.15.59:0/3547851955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf8809c650 0x7faf8809ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf877fe700 1 -- 172.21.15.59:0/3547851955 >> v1:172.21.15.59:6789/0 conn(0x7faf880a0090 legacy=0x7faf88131970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:12.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf877fe700 1 -- 172.21.15.59:0/3547851955 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8809a080 con 0x7faf8809cf60 2023-09-30T22:36:12.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf86ffd700 1 --2- 172.21.15.59:0/3547851955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf8809c650 0x7faf8809ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:12.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf877fe700 1 --2- 172.21.15.59:0/3547851955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf8809cf60 0x7faf88132080 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7faf80009e50 tx=0x7faf8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc91acaf8d8f81e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:12.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf867fc700 1 -- 172.21.15.59:0/3547851955 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8000e070 con 0x7faf8809cf60 2023-09-30T22:36:12.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf867fc700 1 -- 172.21.15.59:0/3547851955 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8000b910 con 0x7faf8809cf60 2023-09-30T22:36:12.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.689+0000 7faf867fc700 1 -- 172.21.15.59:0/3547851955 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8000bcc0 con 0x7faf8809cf60 2023-09-30T22:36:12.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.690+0000 7faf8d287700 1 -- 172.21.15.59:0/3547851955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf8809cf60 msgr2=0x7faf88132080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:12.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.690+0000 7faf8d287700 1 --2- 172.21.15.59:0/3547851955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf8809cf60 0x7faf88132080 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7faf80009e50 tx=0x7faf8000b330 comp rx=0 tx=0).stop 2023-09-30T22:36:12.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.690+0000 7faf8d287700 1 -- 172.21.15.59:0/3547851955 shutdown_connections 2023-09-30T22:36:12.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.690+0000 7faf8d287700 1 --2- 172.21.15.59:0/3547851955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf8809cf60 0x7faf88132080 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.690+0000 7faf8d287700 1 --2- 172.21.15.59:0/3547851955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf8809c650 0x7faf8809ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.690+0000 7faf8d287700 1 -- 172.21.15.59:0/3547851955 >> 172.21.15.59:0/3547851955 conn(0x7faf880a3f70 msgr2=0x7faf880a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:12.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.690+0000 7faf8d287700 1 -- 172.21.15.59:0/3547851955 shutdown_connections 2023-09-30T22:36:12.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.690+0000 7faf8d287700 1 -- 172.21.15.59:0/3547851955 wait complete. 2023-09-30T22:36:12.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.692+0000 7faf8d287700 1 Processor -- start 2023-09-30T22:36:12.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.692+0000 7faf8d287700 1 -- start start 2023-09-30T22:36:12.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf8d287700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf8809c650 0x7faf8806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:12.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf8d287700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf8809cf60 0x7faf8806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:12.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf8d287700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf880a0090 0x7faf8806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:12.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf8d287700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8806d3f0 con 0x7faf880a0090 2023-09-30T22:36:12.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf8d287700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf88121cc0 con 0x7faf8809cf60 2023-09-30T22:36:12.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf8d287700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf8809d980 con 0x7faf8809c650 2023-09-30T22:36:12.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf877fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf880a0090 0x7faf8806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:12.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf86ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf8809c650 0x7faf8806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:12.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf877fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf880a0090 0x7faf8806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47620/0 (socket says 172.21.15.59:47620) 2023-09-30T22:36:12.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf877fe700 1 -- 172.21.15.59:0/1005813431 learned_addr learned my addr 172.21.15.59:0/1005813431 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:12.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf86ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf8809c650 0x7faf8806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60280/0 (socket says 172.21.15.59:60280) 2023-09-30T22:36:12.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf86ffd700 1 -- 172.21.15.59:0/1005813431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf8809cf60 msgr2=0x7faf8806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:12.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf86ffd700 1 --2- 172.21.15.59:0/1005813431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf8809cf60 0x7faf8806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf86ffd700 1 -- 172.21.15.59:0/1005813431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf880a0090 msgr2=0x7faf8806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:12.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf86ffd700 1 --2- 172.21.15.59:0/1005813431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf880a0090 0x7faf8806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf86ffd700 1 -- 172.21.15.59:0/1005813431 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf780094a0 con 0x7faf8809c650 2023-09-30T22:36:12.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf877fe700 1 --2- 172.21.15.59:0/1005813431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf880a0090 0x7faf8806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:12.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.693+0000 7faf86ffd700 1 --2- 172.21.15.59:0/1005813431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf8809c650 0x7faf8806b8b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7faf7800e9b0 tx=0x7faf7800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:12.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.694+0000 7faf7ffff700 1 -- 172.21.15.59:0/1005813431 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7800c850 con 0x7faf8809c650 2023-09-30T22:36:12.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.694+0000 7faf7ffff700 1 -- 172.21.15.59:0/1005813431 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7800c9b0 con 0x7faf8809c650 2023-09-30T22:36:12.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.694+0000 7faf7ffff700 1 -- 172.21.15.59:0/1005813431 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7800cd60 con 0x7faf8809c650 2023-09-30T22:36:12.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.694+0000 7faf8d287700 1 -- 172.21.15.59:0/1005813431 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf80009b30 con 0x7faf8809c650 2023-09-30T22:36:12.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.694+0000 7faf8d287700 1 -- 172.21.15.59:0/1005813431 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf881215b0 con 0x7faf8809c650 2023-09-30T22:36:12.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.694+0000 7faf7ffff700 1 -- 172.21.15.59:0/1005813431 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf78013470 con 0x7faf8809c650 2023-09-30T22:36:12.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.695+0000 7faf7ffff700 1 -- 172.21.15.59:0/1005813431 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faf7803f7f0 con 0x7faf8809c650 2023-09-30T22:36:12.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.695+0000 7faf8d287700 1 -- 172.21.15.59:0/1005813431 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf88121e00 con 0x7faf8809c650 2023-09-30T22:36:12.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.700+0000 7faf7ffff700 1 -- 172.21.15.59:0/1005813431 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf780232f0 con 0x7faf8809c650 2023-09-30T22:36:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.869+0000 7f1f684c3700 1 -- 172.21.15.59:0/1412169778 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1f60121f60 con 0x7f1f60133930 2023-09-30T22:36:12.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.870+0000 7f1f5effd700 1 -- 172.21.15.59:0/1412169778 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f60121f60 con 0x7f1f60133930 2023-09-30T22:36:12.870 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.872+0000 7f1f684c3700 1 -- 172.21.15.59:0/1412169778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f60133930 msgr2=0x7f1f601c7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.872+0000 7f1f684c3700 1 --2- 172.21.15.59:0/1412169778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f60133930 0x7f1f601c7ff0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800e940 tx=0x7f1f5800ec50 comp rx=0 tx=0).stop 2023-09-30T22:36:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.872+0000 7f1f684c3700 1 -- 172.21.15.59:0/1412169778 shutdown_connections 2023-09-30T22:36:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.872+0000 7f1f684c3700 1 --2- 172.21.15.59:0/1412169778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f60133930 0x7f1f601c7ff0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.872+0000 7f1f684c3700 1 --2- 172.21.15.59:0/1412169778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f6009d630 0x7f1f6011f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.872+0000 7f1f684c3700 1 --2- 172.21.15.59:0/1412169778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f600a0a30 0x7f1f6011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.872+0000 7f1f684c3700 1 -- 172.21.15.59:0/1412169778 >> 172.21.15.59:0/1412169778 conn(0x7f1f600a3050 msgr2=0x7f1f601bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.872+0000 7f1f684c3700 1 -- 172.21.15.59:0/1412169778 shutdown_connections 2023-09-30T22:36:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.872+0000 7f1f684c3700 1 -- 172.21.15.59:0/1412169778 wait complete. 2023-09-30T22:36:12.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:12.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.904+0000 7faf8d287700 1 -- 172.21.15.59:0/1005813431 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faf8812ff10 con 0x7faf8809c650 2023-09-30T22:36:12.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.905+0000 7faf7ffff700 1 -- 172.21.15.59:0/1005813431 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf7802a090 con 0x7faf8809c650 2023-09-30T22:36:12.905 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.907+0000 7faf8d287700 1 -- 172.21.15.59:0/1005813431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf8809c650 msgr2=0x7faf8806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.907+0000 7faf8d287700 1 --2- 172.21.15.59:0/1005813431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf8809c650 0x7faf8806b8b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7faf7800e9b0 tx=0x7faf7800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.907+0000 7faf8d287700 1 -- 172.21.15.59:0/1005813431 shutdown_connections 2023-09-30T22:36:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.907+0000 7faf8d287700 1 --2- 172.21.15.59:0/1005813431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf8809c650 0x7faf8806b8b0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.907+0000 7faf8d287700 1 --2- 172.21.15.59:0/1005813431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf880a0090 0x7faf8806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.907+0000 7faf8d287700 1 --2- 172.21.15.59:0/1005813431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf8809cf60 0x7faf8806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:12.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.907+0000 7faf8d287700 1 -- 172.21.15.59:0/1005813431 >> 172.21.15.59:0/1005813431 conn(0x7faf880a3f70 msgr2=0x7faf880a1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:12.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.907+0000 7faf8d287700 1 -- 172.21.15.59:0/1005813431 shutdown_connections 2023-09-30T22:36:12.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:12.907+0000 7faf8d287700 1 -- 172.21.15.59:0/1005813431 wait complete. 2023-09-30T22:36:12.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:12.955 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:12.995 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:13.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.105+0000 7fa007019700 1 Processor -- start 2023-09-30T22:36:13.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.105+0000 7fa007019700 1 -- start start 2023-09-30T22:36:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7fa007019700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0001337f0 0x7fa000138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7fa007019700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa000138dc0 0x7fa00013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7fa007019700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00006b990 con 0x7fa000133420 2023-09-30T22:36:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7fa007019700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00009b0e0 con 0x7fa000138dc0 2023-09-30T22:36:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7fa007019700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa000133c20 con 0x7fa0001337f0 2023-09-30T22:36:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7fa0055b6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa000138dc0 0x7fa00013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7f9ffffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0001337f0 0x7fa000138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7fa0055b6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa000138dc0 0x7fa00013b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47634/0 (socket says 172.21.15.59:47634) 2023-09-30T22:36:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7f9ffffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0001337f0 0x7fa000138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60286/0 (socket says 172.21.15.59:60286) 2023-09-30T22:36:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7fa0055b6700 1 -- 172.21.15.59:0/1163498926 learned_addr learned my addr 172.21.15.59:0/1163498926 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:13.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7fa004db5700 1 --1- 172.21.15.59:0/1163498926 >> v1:172.21.15.59:6789/0 conn(0x7fa000133420 0x7fa000133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57654/0 (socket says 172.21.15.59:57654) 2023-09-30T22:36:13.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7fa0055b6700 1 -- 172.21.15.59:0/1163498926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0001337f0 msgr2=0x7fa000138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:13.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7fa0055b6700 1 --2- 172.21.15.59:0/1163498926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0001337f0 0x7fa000138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7fa0055b6700 1 -- 172.21.15.59:0/1163498926 >> v1:172.21.15.59:6789/0 conn(0x7fa000133420 legacy=0x7fa000133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:13.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7fa0055b6700 1 -- 172.21.15.59:0/1163498926 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0000a0590 con 0x7fa000138dc0 2023-09-30T22:36:13.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7f9ffffff700 1 --2- 172.21.15.59:0/1163498926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0001337f0 0x7fa000138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:13.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.106+0000 7fa0055b6700 1 --2- 172.21.15.59:0/1163498926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa000138dc0 0x7fa00013b1a0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009e50 tx=0x7f9ff800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e799c10ea04206a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:13.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.107+0000 7f9fff7fe700 1 -- 172.21.15.59:0/1163498926 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800e070 con 0x7fa000138dc0 2023-09-30T22:36:13.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.107+0000 7f9fff7fe700 1 -- 172.21.15.59:0/1163498926 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff800b910 con 0x7fa000138dc0 2023-09-30T22:36:13.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.107+0000 7f9fff7fe700 1 -- 172.21.15.59:0/1163498926 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800bcc0 con 0x7fa000138dc0 2023-09-30T22:36:13.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.107+0000 7fa007019700 1 -- 172.21.15.59:0/1163498926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa000138dc0 msgr2=0x7fa00013b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:13.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.107+0000 7fa007019700 1 --2- 172.21.15.59:0/1163498926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa000138dc0 0x7fa00013b1a0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009e50 tx=0x7f9ff800b330 comp rx=0 tx=0).stop 2023-09-30T22:36:13.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.107+0000 7fa007019700 1 -- 172.21.15.59:0/1163498926 shutdown_connections 2023-09-30T22:36:13.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.107+0000 7fa007019700 1 --2- 172.21.15.59:0/1163498926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa000138dc0 0x7fa00013b1a0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.107+0000 7fa007019700 1 --2- 172.21.15.59:0/1163498926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0001337f0 0x7fa000138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.107+0000 7fa007019700 1 -- 172.21.15.59:0/1163498926 >> 172.21.15.59:0/1163498926 conn(0x7fa0000a4210 msgr2=0x7fa0000a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:13.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.107+0000 7fa007019700 1 -- 172.21.15.59:0/1163498926 shutdown_connections 2023-09-30T22:36:13.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.107+0000 7fa007019700 1 -- 172.21.15.59:0/1163498926 wait complete. 2023-09-30T22:36:13.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.109+0000 7fa007019700 1 Processor -- start 2023-09-30T22:36:13.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.109+0000 7fa007019700 1 -- start start 2023-09-30T22:36:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7fa007019700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa000133420 0x7fa00012f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7fa007019700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0001337f0 0x7fa00012f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7fa007019700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa000138dc0 0x7fa00012fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7fa007019700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0001388a0 con 0x7fa000138dc0 2023-09-30T22:36:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7fa007019700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00009dc90 con 0x7fa0001337f0 2023-09-30T22:36:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7fa007019700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa00009ca70 con 0x7fa000133420 2023-09-30T22:36:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7f9ffffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0001337f0 0x7fa00012f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7fa004db5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa000133420 0x7fa00012f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7f9ffffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0001337f0 0x7fa00012f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38422/0 (socket says 172.21.15.59:38422) 2023-09-30T22:36:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7f9ffffff700 1 -- 172.21.15.59:0/2738751640 learned_addr learned my addr 172.21.15.59:0/2738751640 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7fa0055b6700 1 --2- 172.21.15.59:0/2738751640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa000138dc0 0x7fa00012fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7fa004db5700 1 -- 172.21.15.59:0/2738751640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0001337f0 msgr2=0x7fa00012f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7fa004db5700 1 --2- 172.21.15.59:0/2738751640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0001337f0 0x7fa00012f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7fa004db5700 1 -- 172.21.15.59:0/2738751640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa000138dc0 msgr2=0x7fa00012fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7fa004db5700 1 --2- 172.21.15.59:0/2738751640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa000138dc0 0x7fa00012fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7fa004db5700 1 -- 172.21.15.59:0/2738751640 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec0094a0 con 0x7fa000133420 2023-09-30T22:36:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7fa0055b6700 1 --2- 172.21.15.59:0/2738751640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa000138dc0 0x7fa00012fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.110+0000 7f9ffffff700 1 --2- 172.21.15.59:0/2738751640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0001337f0 0x7fa00012f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.111+0000 7fa004db5700 1 --2- 172.21.15.59:0/2738751640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa000133420 0x7fa00012f130 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400c450 tx=0x7f9ff400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.111+0000 7f9ffd7fa700 1 -- 172.21.15.59:0/2738751640 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4005cb0 con 0x7fa000133420 2023-09-30T22:36:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.111+0000 7f9ffd7fa700 1 -- 172.21.15.59:0/2738751640 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff4005e10 con 0x7fa000133420 2023-09-30T22:36:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.111+0000 7f9ffd7fa700 1 -- 172.21.15.59:0/2738751640 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40072d0 con 0x7fa000133420 2023-09-30T22:36:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.111+0000 7fa007019700 1 -- 172.21.15.59:0/2738751640 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff8009b30 con 0x7fa000133420 2023-09-30T22:36:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.111+0000 7fa007019700 1 -- 172.21.15.59:0/2738751640 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00009d510 con 0x7fa000133420 2023-09-30T22:36:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.112+0000 7f9ffd7fa700 1 -- 172.21.15.59:0/2738751640 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ff4007430 con 0x7fa000133420 2023-09-30T22:36:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.112+0000 7f9ffd7fa700 1 -- 172.21.15.59:0/2738751640 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9ff403e9b0 con 0x7fa000133420 2023-09-30T22:36:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.112+0000 7fa007019700 1 -- 172.21.15.59:0/2738751640 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00009f130 con 0x7fa000133420 2023-09-30T22:36:13.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.117+0000 7f9ffd7fa700 1 -- 172.21.15.59:0/2738751640 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ff4017080 con 0x7fa000133420 2023-09-30T22:36:13.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.147+0000 7fb040d6a700 1 Processor -- start 2023-09-30T22:36:13.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.147+0000 7fb040d6a700 1 -- start start 2023-09-30T22:36:13.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb040d6a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03c09f410 0x7fb03c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:13.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb040d6a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb03c136fe0 0x7fb03c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:13.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb040d6a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03c070940 con 0x7fb03c09e930 2023-09-30T22:36:13.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb040d6a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03c06fd60 con 0x7fb03c136fe0 2023-09-30T22:36:13.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb040d6a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c06fa80 con 0x7fb03c09f410 2023-09-30T22:36:13.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb039d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03c09f410 0x7fb03c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:13.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb03ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb03c136fe0 0x7fb03c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:13.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb03ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb03c136fe0 0x7fb03c1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47656/0 (socket says 172.21.15.59:47656) 2023-09-30T22:36:13.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb039d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03c09f410 0x7fb03c136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60308/0 (socket says 172.21.15.59:60308) 2023-09-30T22:36:13.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb03ad9d700 1 -- 172.21.15.59:0/1668939390 learned_addr learned my addr 172.21.15.59:0/1668939390 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb039d9b700 1 -- 172.21.15.59:0/1668939390 >> v2:172.21.15.59:3300/0 conn(0x7fb03c136fe0 msgr2=0x7fb03c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb039d9b700 1 --2- 172.21.15.59:0/1668939390 >> v2:172.21.15.59:3300/0 conn(0x7fb03c136fe0 0x7fb03c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb039d9b700 1 -- 172.21.15.59:0/1668939390 >> v1:172.21.15.59:6789/0 conn(0x7fb03c09e930 legacy=0x7fb03c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb039d9b700 1 -- 172.21.15.59:0/1668939390 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c09fb60 con 0x7fb03c09f410 2023-09-30T22:36:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb03ad9d700 1 --2- 172.21.15.59:0/1668939390 >> v2:172.21.15.59:3300/0 conn(0x7fb03c136fe0 0x7fb03c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.148+0000 7fb039d9b700 1 --2- 172.21.15.59:0/1668939390 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03c09f410 0x7fb03c136aa0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb030009840 tx=0x7fb030009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ce2b31a1b2f16ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.149+0000 7fb03959a700 1 -- 172.21.15.59:0/1668939390 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030011830 con 0x7fb03c09f410 2023-09-30T22:36:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.149+0000 7fb03959a700 1 -- 172.21.15.59:0/1668939390 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb030011990 con 0x7fb03c09f410 2023-09-30T22:36:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.149+0000 7fb03959a700 1 -- 172.21.15.59:0/1668939390 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030011d20 con 0x7fb03c09f410 2023-09-30T22:36:13.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.149+0000 7fb040d6a700 1 -- 172.21.15.59:0/1668939390 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03c09f410 msgr2=0x7fb03c136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:13.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.149+0000 7fb040d6a700 1 --2- 172.21.15.59:0/1668939390 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03c09f410 0x7fb03c136aa0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb030009840 tx=0x7fb030009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.149+0000 7fb040d6a700 1 -- 172.21.15.59:0/1668939390 shutdown_connections 2023-09-30T22:36:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.149+0000 7fb040d6a700 1 --2- 172.21.15.59:0/1668939390 >> v2:172.21.15.59:3300/0 conn(0x7fb03c136fe0 0x7fb03c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.149+0000 7fb040d6a700 1 --2- 172.21.15.59:0/1668939390 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03c09f410 0x7fb03c136aa0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.149+0000 7fb040d6a700 1 -- 172.21.15.59:0/1668939390 >> 172.21.15.59:0/1668939390 conn(0x7fb03c0a4210 msgr2=0x7fb03c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.149+0000 7fb040d6a700 1 -- 172.21.15.59:0/1668939390 shutdown_connections 2023-09-30T22:36:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.149+0000 7fb040d6a700 1 -- 172.21.15.59:0/1668939390 wait complete. 2023-09-30T22:36:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.151+0000 7fb040d6a700 1 Processor -- start 2023-09-30T22:36:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.151+0000 7fb040d6a700 1 -- start start 2023-09-30T22:36:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.151+0000 7fb040d6a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03c09e930 0x7fb03c11c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:13.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.151+0000 7fb040d6a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb03c09f410 0x7fb03c11cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:13.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.151+0000 7fb040d6a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03c136fe0 0x7fb03c11d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:13.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.151+0000 7fb040d6a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c11fe50 con 0x7fb03c09f410 2023-09-30T22:36:13.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.151+0000 7fb040d6a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c0a2f40 con 0x7fb03c09e930 2023-09-30T22:36:13.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.151+0000 7fb040d6a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c11f8a0 con 0x7fb03c136fe0 2023-09-30T22:36:13.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.151+0000 7fb039d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb03c09f410 0x7fb03c11cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:13.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.151+0000 7fb03ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03c136fe0 0x7fb03c11d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:13.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.151+0000 7fb039d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb03c09f410 0x7fb03c11cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47658/0 (socket says 172.21.15.59:47658) 2023-09-30T22:36:13.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.151+0000 7fb039d9b700 1 -- 172.21.15.59:0/2037702135 learned_addr learned my addr 172.21.15.59:0/2037702135 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:13.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.151+0000 7fb03a59c700 1 --2- 172.21.15.59:0/2037702135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03c09e930 0x7fb03c11c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:13.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.152+0000 7fb039d9b700 1 -- 172.21.15.59:0/2037702135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03c136fe0 msgr2=0x7fb03c11d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:13.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.152+0000 7fb039d9b700 1 --2- 172.21.15.59:0/2037702135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03c136fe0 0x7fb03c11d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.152+0000 7fb039d9b700 1 -- 172.21.15.59:0/2037702135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03c09e930 msgr2=0x7fb03c11c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:13.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.152+0000 7fb039d9b700 1 --2- 172.21.15.59:0/2037702135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03c09e930 0x7fb03c11c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.152+0000 7fb039d9b700 1 -- 172.21.15.59:0/2037702135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb034009b30 con 0x7fb03c09f410 2023-09-30T22:36:13.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.152+0000 7fb03a59c700 1 --2- 172.21.15.59:0/2037702135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03c09e930 0x7fb03c11c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:13.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.152+0000 7fb039d9b700 1 --2- 172.21.15.59:0/2037702135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb03c09f410 0x7fb03c11cba0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fb030009fd0 tx=0x7fb030004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:13.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.152+0000 7fb02affd700 1 -- 172.21.15.59:0/2037702135 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0300036a0 con 0x7fb03c09f410 2023-09-30T22:36:13.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.152+0000 7fb02affd700 1 -- 172.21.15.59:0/2037702135 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03001f070 con 0x7fb03c09f410 2023-09-30T22:36:13.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.152+0000 7fb02affd700 1 -- 172.21.15.59:0/2037702135 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030003a60 con 0x7fb03c09f410 2023-09-30T22:36:13.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.152+0000 7fb040d6a700 1 -- 172.21.15.59:0/2037702135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0300094a0 con 0x7fb03c09f410 2023-09-30T22:36:13.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.152+0000 7fb040d6a700 1 -- 172.21.15.59:0/2037702135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c11e330 con 0x7fb03c09f410 2023-09-30T22:36:13.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.153+0000 7fb02affd700 1 -- 172.21.15.59:0/2037702135 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb030003bc0 con 0x7fb03c09f410 2023-09-30T22:36:13.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.153+0000 7fb040d6a700 1 -- 172.21.15.59:0/2037702135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03c074ea0 con 0x7fb03c09f410 2023-09-30T22:36:13.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.153+0000 7fb02affd700 1 -- 172.21.15.59:0/2037702135 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb030021070 con 0x7fb03c09f410 2023-09-30T22:36:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.163+0000 7fb02affd700 1 -- 172.21.15.59:0/2037702135 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb030010380 con 0x7fb03c09f410 2023-09-30T22:36:13.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.328+0000 7fa007019700 1 -- 172.21.15.59:0/2738751640 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa000074ea0 con 0x7fa000133420 2023-09-30T22:36:13.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.329+0000 7f9ffd7fa700 1 -- 172.21.15.59:0/2738751640 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ff40076e0 con 0x7fa000133420 2023-09-30T22:36:13.329 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:13.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.331+0000 7fa007019700 1 -- 172.21.15.59:0/2738751640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa000133420 msgr2=0x7fa00012f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:13.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.331+0000 7fa007019700 1 --2- 172.21.15.59:0/2738751640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa000133420 0x7fa00012f130 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400c450 tx=0x7f9ff400c760 comp rx=0 tx=0).stop 2023-09-30T22:36:13.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.331+0000 7fa007019700 1 -- 172.21.15.59:0/2738751640 shutdown_connections 2023-09-30T22:36:13.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.331+0000 7fa007019700 1 --2- 172.21.15.59:0/2738751640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa000133420 0x7fa00012f130 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.331+0000 7fa007019700 1 --2- 172.21.15.59:0/2738751640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa000138dc0 0x7fa00012fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.331+0000 7fa007019700 1 --2- 172.21.15.59:0/2738751640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0001337f0 0x7fa00012f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.331+0000 7fa007019700 1 -- 172.21.15.59:0/2738751640 >> 172.21.15.59:0/2738751640 conn(0x7fa0000a4210 msgr2=0x7fa0000a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:13.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.331+0000 7fa007019700 1 -- 172.21.15.59:0/2738751640 shutdown_connections 2023-09-30T22:36:13.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.331+0000 7fa007019700 1 -- 172.21.15.59:0/2738751640 wait complete. 2023-09-30T22:36:13.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:13.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.373+0000 7fb040d6a700 1 -- 172.21.15.59:0/2037702135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb03c11e9d0 con 0x7fb03c09f410 2023-09-30T22:36:13.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.373+0000 7fb02affd700 1 -- 172.21.15.59:0/2037702135 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb03002b070 con 0x7fb03c09f410 2023-09-30T22:36:13.374 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.375+0000 7fb040d6a700 1 -- 172.21.15.59:0/2037702135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb03c09f410 msgr2=0x7fb03c11cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.375+0000 7fb040d6a700 1 --2- 172.21.15.59:0/2037702135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb03c09f410 0x7fb03c11cba0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fb030009fd0 tx=0x7fb030004750 comp rx=0 tx=0).stop 2023-09-30T22:36:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.376+0000 7fb040d6a700 1 -- 172.21.15.59:0/2037702135 shutdown_connections 2023-09-30T22:36:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.376+0000 7fb040d6a700 1 --2- 172.21.15.59:0/2037702135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb03c136fe0 0x7fb03c11d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.376+0000 7fb040d6a700 1 --2- 172.21.15.59:0/2037702135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb03c09e930 0x7fb03c11c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.376+0000 7fb040d6a700 1 --2- 172.21.15.59:0/2037702135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb03c09f410 0x7fb03c11cba0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.376+0000 7fb040d6a700 1 -- 172.21.15.59:0/2037702135 >> 172.21.15.59:0/2037702135 conn(0x7fb03c0a4210 msgr2=0x7fb03c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.376+0000 7fb040d6a700 1 -- 172.21.15.59:0/2037702135 shutdown_connections 2023-09-30T22:36:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:13.376+0000 7fb040d6a700 1 -- 172.21.15.59:0/2037702135 wait complete. 2023-09-30T22:36:13.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:13.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:13.922 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:14.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.036+0000 7fb3aecd6700 1 Processor -- start 2023-09-30T22:36:14.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.037+0000 7fb3aecd6700 1 -- start start 2023-09-30T22:36:14.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.037+0000 7fb3aecd6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb3a80a0a30 0x7fb3a80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.037+0000 7fb3aecd6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3a809d630 0x7fb3a80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.037+0000 7fb3aecd6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a80a2a70 con 0x7fb3a8133930 2023-09-30T22:36:14.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.037+0000 7fb3aecd6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a80a01d0 con 0x7fb3a80a0a30 2023-09-30T22:36:14.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.037+0000 7fb3aecd6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a809e2b0 con 0x7fb3a809d630 2023-09-30T22:36:14.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.037+0000 7fb3aca72700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb3a80a0a30 0x7fb3a80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.037+0000 7fb3a7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3a809d630 0x7fb3a80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.037+0000 7fb3aca72700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb3a80a0a30 0x7fb3a80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47672/0 (socket says 172.21.15.59:47672) 2023-09-30T22:36:14.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.037+0000 7fb3aca72700 1 -- 172.21.15.59:0/2446071078 learned_addr learned my addr 172.21.15.59:0/2446071078 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:14.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.038+0000 7fb3aca72700 1 -- 172.21.15.59:0/2446071078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3a809d630 msgr2=0x7fb3a80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:14.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.038+0000 7fb3aca72700 1 --2- 172.21.15.59:0/2446071078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3a809d630 0x7fb3a80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.038+0000 7fb3aca72700 1 -- 172.21.15.59:0/2446071078 >> v1:172.21.15.59:6789/0 conn(0x7fb3a8133930 legacy=0x7fb3a8133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.038+0000 7fb3aca72700 1 -- 172.21.15.59:0/2446071078 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a809dc50 con 0x7fb3a80a0a30 2023-09-30T22:36:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.038+0000 7fb3a7fff700 1 --2- 172.21.15.59:0/2446071078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3a809d630 0x7fb3a80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.038+0000 7fb3aca72700 1 --2- 172.21.15.59:0/2446071078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3a80a0a30 0x7fb3a80a0e00 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fb3980098f0 tx=0x7fb398009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507a5e5261a4d47f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.038+0000 7fb3a77fe700 1 -- 172.21.15.59:0/2446071078 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb398011830 con 0x7fb3a80a0a30 2023-09-30T22:36:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.038+0000 7fb3a77fe700 1 -- 172.21.15.59:0/2446071078 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb398011990 con 0x7fb3a80a0a30 2023-09-30T22:36:14.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.038+0000 7fb3a77fe700 1 -- 172.21.15.59:0/2446071078 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb398011d20 con 0x7fb3a80a0a30 2023-09-30T22:36:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.039+0000 7fb3aecd6700 1 -- 172.21.15.59:0/2446071078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3a80a0a30 msgr2=0x7fb3a80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.039+0000 7fb3aecd6700 1 --2- 172.21.15.59:0/2446071078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3a80a0a30 0x7fb3a80a0e00 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fb3980098f0 tx=0x7fb398009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.039+0000 7fb3aecd6700 1 -- 172.21.15.59:0/2446071078 shutdown_connections 2023-09-30T22:36:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.039+0000 7fb3aecd6700 1 --2- 172.21.15.59:0/2446071078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3a80a0a30 0x7fb3a80a0e00 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.039+0000 7fb3aecd6700 1 --2- 172.21.15.59:0/2446071078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3a809d630 0x7fb3a80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.039+0000 7fb3aecd6700 1 -- 172.21.15.59:0/2446071078 >> 172.21.15.59:0/2446071078 conn(0x7fb3a80a3050 msgr2=0x7fb3a80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.039+0000 7fb3aecd6700 1 -- 172.21.15.59:0/2446071078 shutdown_connections 2023-09-30T22:36:14.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.039+0000 7fb3aecd6700 1 -- 172.21.15.59:0/2446071078 wait complete. 2023-09-30T22:36:14.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.040+0000 7fb3aecd6700 1 Processor -- start 2023-09-30T22:36:14.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.040+0000 7fb3aecd6700 1 -- start start 2023-09-30T22:36:14.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.041+0000 7fb3aecd6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3a809d630 0x7fb3a81c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.041+0000 7fb3aecd6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3a80a0a30 0x7fb3a81c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.041+0000 7fb3aecd6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3a8133930 0x7fb3a81c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.041+0000 7fb3aecd6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a811eea0 con 0x7fb3a80a0a30 2023-09-30T22:36:14.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.041+0000 7fb3aecd6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a81207f0 con 0x7fb3a8133930 2023-09-30T22:36:14.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.041+0000 7fb3aecd6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a8120600 con 0x7fb3a809d630 2023-09-30T22:36:14.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.041+0000 7fb3a7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3a80a0a30 0x7fb3a81c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.041+0000 7fb3a7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3a80a0a30 0x7fb3a81c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47686/0 (socket says 172.21.15.59:47686) 2023-09-30T22:36:14.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.041+0000 7fb3a7fff700 1 -- 172.21.15.59:0/3730879800 learned_addr learned my addr 172.21.15.59:0/3730879800 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:14.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.041+0000 7fb3ad273700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3a8133930 0x7fb3a81c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.041+0000 7fb3aca72700 1 --2- 172.21.15.59:0/3730879800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3a809d630 0x7fb3a81c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.042+0000 7fb3a7fff700 1 -- 172.21.15.59:0/3730879800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3a809d630 msgr2=0x7fb3a81c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.042+0000 7fb3a7fff700 1 --2- 172.21.15.59:0/3730879800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3a809d630 0x7fb3a81c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.042+0000 7fb3a7fff700 1 -- 172.21.15.59:0/3730879800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3a8133930 msgr2=0x7fb3a81c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.042+0000 7fb3a7fff700 1 --2- 172.21.15.59:0/3730879800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3a8133930 0x7fb3a81c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.042+0000 7fb3a7fff700 1 -- 172.21.15.59:0/3730879800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c0094a0 con 0x7fb3a80a0a30 2023-09-30T22:36:14.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.042+0000 7fb3a7fff700 1 --2- 172.21.15.59:0/3730879800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3a80a0a30 0x7fb3a81c8660 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00ebe0 tx=0x7fb39c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:14.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.042+0000 7fb3a57fa700 1 -- 172.21.15.59:0/3730879800 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c00c850 con 0x7fb3a80a0a30 2023-09-30T22:36:14.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.042+0000 7fb3a57fa700 1 -- 172.21.15.59:0/3730879800 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c00c9b0 con 0x7fb3a80a0a30 2023-09-30T22:36:14.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.042+0000 7fb3aecd6700 1 -- 172.21.15.59:0/3730879800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb398009550 con 0x7fb3a80a0a30 2023-09-30T22:36:14.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.042+0000 7fb3a57fa700 1 -- 172.21.15.59:0/3730879800 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c00cd20 con 0x7fb3a80a0a30 2023-09-30T22:36:14.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.042+0000 7fb3aecd6700 1 -- 172.21.15.59:0/3730879800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a8122230 con 0x7fb3a80a0a30 2023-09-30T22:36:14.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.043+0000 7fb3a57fa700 1 -- 172.21.15.59:0/3730879800 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb39c013470 con 0x7fb3a80a0a30 2023-09-30T22:36:14.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.043+0000 7fb3a57fa700 1 -- 172.21.15.59:0/3730879800 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb39c03f7b0 con 0x7fb3a80a0a30 2023-09-30T22:36:14.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.043+0000 7fb3aecd6700 1 -- 172.21.15.59:0/3730879800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a8122420 con 0x7fb3a80a0a30 2023-09-30T22:36:14.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.048+0000 7fb3a57fa700 1 -- 172.21.15.59:0/3730879800 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb39c021080 con 0x7fb3a80a0a30 2023-09-30T22:36:14.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.085+0000 7f8e8e3b8700 1 Processor -- start 2023-09-30T22:36:14.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.085+0000 7f8e8e3b8700 1 -- start start 2023-09-30T22:36:14.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e8e3b8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e88133a80 0x7f8e88133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e8e3b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88130a70 0x7f8e8813b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e8e3b8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8806bc00 con 0x7f8e8812ff20 2023-09-30T22:36:14.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e8e3b8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8806c570 con 0x7f8e88133a80 2023-09-30T22:36:14.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e8e3b8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e880a0040 con 0x7f8e88130a70 2023-09-30T22:36:14.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e87fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e88133a80 0x7f8e88133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e8c955700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88130a70 0x7f8e8813b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e877fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8e8812ff20 0x7f8e88130360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57672/0 (socket says 172.21.15.59:57672) 2023-09-30T22:36:14.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e877fe700 1 -- 172.21.15.59:0/1674065419 learned_addr learned my addr 172.21.15.59:0/1674065419 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:14.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e8c955700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88130a70 0x7f8e8813b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38432/0 (socket says 172.21.15.59:38432) 2023-09-30T22:36:14.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e87fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e88133a80 0x7f8e88133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47698/0 (socket says 172.21.15.59:47698) 2023-09-30T22:36:14.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e8c955700 1 -- 172.21.15.59:0/1674065419 >> v2:172.21.15.59:3300/0 conn(0x7f8e88133a80 msgr2=0x7f8e88133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:14.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e8c955700 1 --2- 172.21.15.59:0/1674065419 >> v2:172.21.15.59:3300/0 conn(0x7f8e88133a80 0x7f8e88133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e8c955700 1 -- 172.21.15.59:0/1674065419 >> v1:172.21.15.59:6789/0 conn(0x7f8e8812ff20 legacy=0x7f8e88130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e86ffd700 1 -- 172.21.15.59:0/1674065419 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433442562 0 0) 0x7f8e8806bc00 con 0x7f8e8812ff20 2023-09-30T22:36:14.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e8c955700 1 -- 172.21.15.59:0/1674065419 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e88133860 con 0x7f8e88130a70 2023-09-30T22:36:14.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.086+0000 7f8e87fff700 1 --2- 172.21.15.59:0/1674065419 >> v2:172.21.15.59:3300/0 conn(0x7f8e88133a80 0x7f8e88133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:14.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.087+0000 7f8e8c955700 1 --2- 172.21.15.59:0/1674065419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88130a70 0x7f8e8813b850 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009d90 tx=0x7f8e8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21d76de085804a68 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:14.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.087+0000 7f8e86ffd700 1 -- 172.21.15.59:0/1674065419 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8000e070 con 0x7f8e88130a70 2023-09-30T22:36:14.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.087+0000 7f8e86ffd700 1 -- 172.21.15.59:0/1674065419 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8000bb20 con 0x7f8e88130a70 2023-09-30T22:36:14.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.087+0000 7f8e86ffd700 1 -- 172.21.15.59:0/1674065419 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e80012430 con 0x7f8e88130a70 2023-09-30T22:36:14.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.087+0000 7f8e8e3b8700 1 -- 172.21.15.59:0/1674065419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88130a70 msgr2=0x7f8e8813b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.087+0000 7f8e8e3b8700 1 --2- 172.21.15.59:0/1674065419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88130a70 0x7f8e8813b850 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009d90 tx=0x7f8e8000b330 comp rx=0 tx=0).stop 2023-09-30T22:36:14.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.088+0000 7f8e8e3b8700 1 -- 172.21.15.59:0/1674065419 shutdown_connections 2023-09-30T22:36:14.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.088+0000 7f8e8e3b8700 1 --2- 172.21.15.59:0/1674065419 >> v2:172.21.15.59:3300/0 conn(0x7f8e88133a80 0x7f8e88133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.088+0000 7f8e8e3b8700 1 --2- 172.21.15.59:0/1674065419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88130a70 0x7f8e8813b850 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.088+0000 7f8e8e3b8700 1 -- 172.21.15.59:0/1674065419 >> 172.21.15.59:0/1674065419 conn(0x7f8e880a4210 msgr2=0x7f8e880a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:14.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.088+0000 7f8e8e3b8700 1 -- 172.21.15.59:0/1674065419 shutdown_connections 2023-09-30T22:36:14.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.088+0000 7f8e8e3b8700 1 -- 172.21.15.59:0/1674065419 wait complete. 2023-09-30T22:36:14.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.089+0000 7f8e8e3b8700 1 Processor -- start 2023-09-30T22:36:14.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.089+0000 7f8e8e3b8700 1 -- start start 2023-09-30T22:36:14.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e8e3b8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8812ff20 0x7f8e8809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e8e3b8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e88130a70 0x7f8e8809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e8e3b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88133a80 0x7f8e8809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e8e3b8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8809ddb0 con 0x7f8e8812ff20 2023-09-30T22:36:14.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e8e3b8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8811ff00 con 0x7f8e88133a80 2023-09-30T22:36:14.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e8e3b8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8811fbd0 con 0x7f8e88130a70 2023-09-30T22:36:14.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e87fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8812ff20 0x7f8e8809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e87fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8812ff20 0x7f8e8809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47706/0 (socket says 172.21.15.59:47706) 2023-09-30T22:36:14.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e87fff700 1 -- 172.21.15.59:0/21090541 learned_addr learned my addr 172.21.15.59:0/21090541 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:14.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e8c955700 1 --2- 172.21.15.59:0/21090541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88133a80 0x7f8e8809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e877fe700 1 --2- 172.21.15.59:0/21090541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e88130a70 0x7f8e8809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e87fff700 1 -- 172.21.15.59:0/21090541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e88130a70 msgr2=0x7f8e8809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e87fff700 1 --2- 172.21.15.59:0/21090541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e88130a70 0x7f8e8809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e87fff700 1 -- 172.21.15.59:0/21090541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88133a80 msgr2=0x7f8e8809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e87fff700 1 --2- 172.21.15.59:0/21090541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88133a80 0x7f8e8809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e87fff700 1 -- 172.21.15.59:0/21090541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e780094a0 con 0x7f8e8812ff20 2023-09-30T22:36:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.090+0000 7f8e8c955700 1 --2- 172.21.15.59:0/21090541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88133a80 0x7f8e8809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.091+0000 7f8e87fff700 1 --2- 172.21.15.59:0/21090541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8812ff20 0x7f8e8809c480 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f8e7800ebe0 tx=0x7f8e7800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.091+0000 7f8e84ff9700 1 -- 172.21.15.59:0/21090541 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7800c850 con 0x7f8e8812ff20 2023-09-30T22:36:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.091+0000 7f8e84ff9700 1 -- 172.21.15.59:0/21090541 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7800c9b0 con 0x7f8e8812ff20 2023-09-30T22:36:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.091+0000 7f8e8e3b8700 1 -- 172.21.15.59:0/21090541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e80009a70 con 0x7f8e8812ff20 2023-09-30T22:36:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.091+0000 7f8e84ff9700 1 -- 172.21.15.59:0/21090541 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7800cd40 con 0x7f8e8812ff20 2023-09-30T22:36:14.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.091+0000 7f8e8e3b8700 1 -- 172.21.15.59:0/21090541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8811f010 con 0x7f8e8812ff20 2023-09-30T22:36:14.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.092+0000 7f8e8e3b8700 1 -- 172.21.15.59:0/21090541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e88074ea0 con 0x7f8e8812ff20 2023-09-30T22:36:14.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.092+0000 7f8e84ff9700 1 -- 172.21.15.59:0/21090541 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e78013470 con 0x7f8e8812ff20 2023-09-30T22:36:14.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.093+0000 7f8e84ff9700 1 -- 172.21.15.59:0/21090541 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e7803ffb0 con 0x7f8e8812ff20 2023-09-30T22:36:14.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.097+0000 7f8e84ff9700 1 -- 172.21.15.59:0/21090541 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e78013720 con 0x7f8e8812ff20 2023-09-30T22:36:14.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.282+0000 7fb3aecd6700 1 -- 172.21.15.59:0/3730879800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb3a8121eb0 con 0x7fb3a80a0a30 2023-09-30T22:36:14.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.282+0000 7fb3a57fa700 1 -- 172.21.15.59:0/3730879800 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb39c00ce80 con 0x7fb3a80a0a30 2023-09-30T22:36:14.283 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:14.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.285+0000 7fb3aecd6700 1 -- 172.21.15.59:0/3730879800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3a80a0a30 msgr2=0x7fb3a81c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.285+0000 7fb3aecd6700 1 --2- 172.21.15.59:0/3730879800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3a80a0a30 0x7fb3a81c8660 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00ebe0 tx=0x7fb39c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.285+0000 7fb3aecd6700 1 -- 172.21.15.59:0/3730879800 shutdown_connections 2023-09-30T22:36:14.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.285+0000 7fb3aecd6700 1 --2- 172.21.15.59:0/3730879800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb3a809d630 0x7fb3a81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.285+0000 7fb3aecd6700 1 --2- 172.21.15.59:0/3730879800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3a8133930 0x7fb3a81c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.285+0000 7fb3aecd6700 1 --2- 172.21.15.59:0/3730879800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3a80a0a30 0x7fb3a81c8660 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.285+0000 7fb3aecd6700 1 -- 172.21.15.59:0/3730879800 >> 172.21.15.59:0/3730879800 conn(0x7fb3a80a3050 msgr2=0x7fb3a809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:14.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.285+0000 7fb3aecd6700 1 -- 172.21.15.59:0/3730879800 shutdown_connections 2023-09-30T22:36:14.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.285+0000 7fb3aecd6700 1 -- 172.21.15.59:0/3730879800 wait complete. 2023-09-30T22:36:14.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:14.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.314+0000 7f8e8e3b8700 1 -- 172.21.15.59:0/21090541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8e8806b250 con 0x7f8e8812ff20 2023-09-30T22:36:14.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.315+0000 7f8e84ff9700 1 -- 172.21.15.59:0/21090541 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e78021070 con 0x7f8e8812ff20 2023-09-30T22:36:14.315 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.317+0000 7f8e8e3b8700 1 -- 172.21.15.59:0/21090541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8812ff20 msgr2=0x7f8e8809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.317+0000 7f8e8e3b8700 1 --2- 172.21.15.59:0/21090541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8812ff20 0x7f8e8809c480 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f8e7800ebe0 tx=0x7f8e7800eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.317+0000 7f8e8e3b8700 1 -- 172.21.15.59:0/21090541 shutdown_connections 2023-09-30T22:36:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.317+0000 7f8e8e3b8700 1 --2- 172.21.15.59:0/21090541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88133a80 0x7f8e8809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.317+0000 7f8e8e3b8700 1 --2- 172.21.15.59:0/21090541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8812ff20 0x7f8e8809c480 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.317+0000 7f8e8e3b8700 1 --2- 172.21.15.59:0/21090541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e88130a70 0x7f8e8809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.317+0000 7f8e8e3b8700 1 -- 172.21.15.59:0/21090541 >> 172.21.15.59:0/21090541 conn(0x7f8e880a4210 msgr2=0x7f8e8809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.317+0000 7f8e8e3b8700 1 -- 172.21.15.59:0/21090541 shutdown_connections 2023-09-30T22:36:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.317+0000 7f8e8e3b8700 1 -- 172.21.15.59:0/21090541 wait complete. 2023-09-30T22:36:14.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:14.346 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:14.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:14.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.518+0000 7f8ebea61700 1 Processor -- start 2023-09-30T22:36:14.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.518+0000 7f8ebea61700 1 -- start start 2023-09-30T22:36:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.518+0000 7f8ebea61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb809d760 0x7f8eb809db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.518+0000 7f8ebea61700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb8134130 0x7f8eb813bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.518+0000 7f8ebea61700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb806b0a0 con 0x7f8eb809e070 2023-09-30T22:36:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.518+0000 7f8ebea61700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb806b6d0 con 0x7f8eb809d760 2023-09-30T22:36:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.518+0000 7f8ebea61700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb809b1c0 con 0x7f8eb8134130 2023-09-30T22:36:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.518+0000 7f8eb77fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8eb809e070 0x7f8eb8133a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41194/0 (socket says 172.21.15.59:41194) 2023-09-30T22:36:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.518+0000 7f8eb77fe700 1 -- 172.21.15.59:0/3670191298 learned_addr learned my addr 172.21.15.59:0/3670191298 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.518+0000 7f8ebcffe700 1 --2- 172.21.15.59:0/3670191298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb8134130 0x7f8eb813bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.518+0000 7f8eb7fff700 1 --2- 172.21.15.59:0/3670191298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb809d760 0x7f8eb809db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.519+0000 7f8ebcffe700 1 -- 172.21.15.59:0/3670191298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb809d760 msgr2=0x7f8eb809db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.519+0000 7f8ebcffe700 1 --2- 172.21.15.59:0/3670191298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb809d760 0x7f8eb809db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.519+0000 7f8eb6ffd700 1 -- 172.21.15.59:0/3670191298 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067187329 0 0) 0x7f8eb806b0a0 con 0x7f8eb809e070 2023-09-30T22:36:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.519+0000 7f8ebcffe700 1 -- 172.21.15.59:0/3670191298 >> v1:172.21.15.59:6789/0 conn(0x7f8eb809e070 legacy=0x7f8eb8133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.519+0000 7f8ebcffe700 1 -- 172.21.15.59:0/3670191298 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb806b490 con 0x7f8eb8134130 2023-09-30T22:36:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.519+0000 7f8eb7fff700 1 --2- 172.21.15.59:0/3670191298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb809d760 0x7f8eb809db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.519+0000 7f8ebcffe700 1 --2- 172.21.15.59:0/3670191298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb8134130 0x7f8eb813bc80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0009dc0 tx=0x7f8eb000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79ad455c5696274b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.519+0000 7f8eb6ffd700 1 -- 172.21.15.59:0/3670191298 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb000e070 con 0x7f8eb8134130 2023-09-30T22:36:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.519+0000 7f8eb6ffd700 1 -- 172.21.15.59:0/3670191298 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb000bb20 con 0x7f8eb8134130 2023-09-30T22:36:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.519+0000 7f8eb6ffd700 1 -- 172.21.15.59:0/3670191298 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0012430 con 0x7f8eb8134130 2023-09-30T22:36:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.520+0000 7f8ebea61700 1 -- 172.21.15.59:0/3670191298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb8134130 msgr2=0x7f8eb813bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.520+0000 7f8ebea61700 1 --2- 172.21.15.59:0/3670191298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb8134130 0x7f8eb813bc80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0009dc0 tx=0x7f8eb000b330 comp rx=0 tx=0).stop 2023-09-30T22:36:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.520+0000 7f8ebea61700 1 -- 172.21.15.59:0/3670191298 shutdown_connections 2023-09-30T22:36:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.520+0000 7f8ebea61700 1 --2- 172.21.15.59:0/3670191298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb8134130 0x7f8eb813bc80 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.520+0000 7f8ebea61700 1 --2- 172.21.15.59:0/3670191298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb809d760 0x7f8eb809db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.520+0000 7f8ebea61700 1 -- 172.21.15.59:0/3670191298 >> 172.21.15.59:0/3670191298 conn(0x7f8eb8066f50 msgr2=0x7f8eb80a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.520+0000 7f8ebea61700 1 -- 172.21.15.59:0/3670191298 shutdown_connections 2023-09-30T22:36:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.520+0000 7f8ebea61700 1 -- 172.21.15.59:0/3670191298 wait complete. 2023-09-30T22:36:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.521+0000 7f8ebea61700 1 Processor -- start 2023-09-30T22:36:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.521+0000 7f8ebea61700 1 -- start start 2023-09-30T22:36:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.522+0000 7f8ebea61700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb809d760 0x7f8eb811e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.522+0000 7f8ebea61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb809e070 0x7f8eb811ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.522+0000 7f8ebea61700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eb8134130 0x7f8eb811f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.522+0000 7f8ebea61700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb81222a0 con 0x7f8eb8134130 2023-09-30T22:36:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.522+0000 7f8ebea61700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8121d00 con 0x7f8eb809e070 2023-09-30T22:36:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.522+0000 7f8ebea61700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8120390 con 0x7f8eb809d760 2023-09-30T22:36:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.522+0000 7f8eb77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb809e070 0x7f8eb811ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.522+0000 7f8eb7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb809d760 0x7f8eb811e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.522+0000 7f8eb77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb809e070 0x7f8eb811ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56266/0 (socket says 172.21.15.59:56266) 2023-09-30T22:36:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.522+0000 7f8eb77fe700 1 -- 172.21.15.59:0/4243172672 learned_addr learned my addr 172.21.15.59:0/4243172672 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.522+0000 7f8ebcffe700 1 --2- 172.21.15.59:0/4243172672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eb8134130 0x7f8eb811f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.522+0000 7f8eb7fff700 1 -- 172.21.15.59:0/4243172672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb809e070 msgr2=0x7f8eb811ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.523+0000 7f8eb7fff700 1 --2- 172.21.15.59:0/4243172672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb809e070 0x7f8eb811ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.523+0000 7f8eb7fff700 1 -- 172.21.15.59:0/4243172672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eb8134130 msgr2=0x7f8eb811f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.523+0000 7f8eb7fff700 1 --2- 172.21.15.59:0/4243172672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eb8134130 0x7f8eb811f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.523+0000 7f8eb7fff700 1 -- 172.21.15.59:0/4243172672 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea80094a0 con 0x7f8eb809d760 2023-09-30T22:36:14.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.523+0000 7f8eb77fe700 1 --2- 172.21.15.59:0/4243172672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb809e070 0x7f8eb811ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:14.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.523+0000 7f8ebcffe700 1 --2- 172.21.15.59:0/4243172672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eb8134130 0x7f8eb811f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:14.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.523+0000 7f8eb7fff700 1 --2- 172.21.15.59:0/4243172672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb809d760 0x7f8eb811e810 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8ea800e9b0 tx=0x7f8ea800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:14.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.523+0000 7f8eb4ff9700 1 -- 172.21.15.59:0/4243172672 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea800ee50 con 0x7f8eb809d760 2023-09-30T22:36:14.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.523+0000 7f8eb4ff9700 1 -- 172.21.15.59:0/4243172672 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea800c850 con 0x7f8eb809d760 2023-09-30T22:36:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.523+0000 7f8ebea61700 1 -- 172.21.15.59:0/4243172672 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb0009a70 con 0x7f8eb809d760 2023-09-30T22:36:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.523+0000 7f8eb4ff9700 1 -- 172.21.15.59:0/4243172672 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea800cc00 con 0x7f8eb809d760 2023-09-30T22:36:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.523+0000 7f8ebea61700 1 -- 172.21.15.59:0/4243172672 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb809a620 con 0x7f8eb809d760 2023-09-30T22:36:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.524+0000 7f8eb4ff9700 1 -- 172.21.15.59:0/4243172672 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ea8013470 con 0x7f8eb809d760 2023-09-30T22:36:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.524+0000 7f8eb4ff9700 1 -- 172.21.15.59:0/4243172672 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8ea803fa90 con 0x7f8eb809d760 2023-09-30T22:36:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.524+0000 7f8ebea61700 1 -- 172.21.15.59:0/4243172672 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb80729a0 con 0x7f8eb809d760 2023-09-30T22:36:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.530+0000 7f8eb4ff9700 1 -- 172.21.15.59:0/4243172672 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ea8013720 con 0x7f8eb809d760 2023-09-30T22:36:14.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.558+0000 7f91e711c700 1 Processor -- start 2023-09-30T22:36:14.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.558+0000 7f91e711c700 1 -- start start 2023-09-30T22:36:14.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.559+0000 7f91e711c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91e00a0a30 0x7f91e00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.559+0000 7f91e711c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91e0138d80 0x7f91e013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.559+0000 7f91e711c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e00a2a70 con 0x7f91e009d630 2023-09-30T22:36:14.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.559+0000 7f91e711c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00a01d0 con 0x7f91e0138d80 2023-09-30T22:36:14.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.559+0000 7f91e711c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91e009e2b0 con 0x7f91e00a0a30 2023-09-30T22:36:14.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.559+0000 7f91dffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f91e009d630 0x7f91e00a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41208/0 (socket says 172.21.15.59:41208) 2023-09-30T22:36:14.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.559+0000 7f91dffff700 1 -- 172.21.15.59:0/1055729928 learned_addr learned my addr 172.21.15.59:0/1055729928 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:14.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.559+0000 7f91e56b9700 1 --2- 172.21.15.59:0/1055729928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91e0138d80 0x7f91e013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.559+0000 7f91e4eb8700 1 --2- 172.21.15.59:0/1055729928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91e00a0a30 0x7f91e00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.560+0000 7f91df7fe700 1 -- 172.21.15.59:0/1055729928 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624483239 0 0) 0x7f91e00a2a70 con 0x7f91e009d630 2023-09-30T22:36:14.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.560+0000 7f91df7fe700 1 -- 172.21.15.59:0/1055729928 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91cc0035b0 con 0x7f91e009d630 2023-09-30T22:36:14.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.560+0000 7f91e56b9700 1 -- 172.21.15.59:0/1055729928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91e00a0a30 msgr2=0x7f91e00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:14.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.560+0000 7f91e56b9700 1 --2- 172.21.15.59:0/1055729928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91e00a0a30 0x7f91e00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.560+0000 7f91e56b9700 1 -- 172.21.15.59:0/1055729928 >> v1:172.21.15.59:6789/0 conn(0x7f91e009d630 legacy=0x7f91e00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.560+0000 7f91e56b9700 1 -- 172.21.15.59:0/1055729928 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e009dc50 con 0x7f91e0138d80 2023-09-30T22:36:14.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.560+0000 7f91e4eb8700 1 --2- 172.21.15.59:0/1055729928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91e00a0a30 0x7f91e00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:14.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.560+0000 7f91e56b9700 1 --2- 172.21.15.59:0/1055729928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91e0138d80 0x7f91e013b160 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009870 tx=0x7f91d0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea09fa57c200e5fe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:14.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.560+0000 7f91df7fe700 1 -- 172.21.15.59:0/1055729928 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0011830 con 0x7f91e0138d80 2023-09-30T22:36:14.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.560+0000 7f91df7fe700 1 -- 172.21.15.59:0/1055729928 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d0011990 con 0x7f91e0138d80 2023-09-30T22:36:14.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.560+0000 7f91df7fe700 1 -- 172.21.15.59:0/1055729928 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0011d20 con 0x7f91e0138d80 2023-09-30T22:36:14.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.561+0000 7f91e711c700 1 -- 172.21.15.59:0/1055729928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91e0138d80 msgr2=0x7f91e013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.561+0000 7f91e711c700 1 --2- 172.21.15.59:0/1055729928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91e0138d80 0x7f91e013b160 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009870 tx=0x7f91d0009b80 comp rx=0 tx=0).stop 2023-09-30T22:36:14.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.561+0000 7f91e711c700 1 -- 172.21.15.59:0/1055729928 shutdown_connections 2023-09-30T22:36:14.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.561+0000 7f91e711c700 1 --2- 172.21.15.59:0/1055729928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91e00a0a30 0x7f91e00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.561+0000 7f91e711c700 1 --2- 172.21.15.59:0/1055729928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91e0138d80 0x7f91e013b160 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.561+0000 7f91e711c700 1 -- 172.21.15.59:0/1055729928 >> 172.21.15.59:0/1055729928 conn(0x7f91e00a3050 msgr2=0x7f91e00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:14.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.561+0000 7f91e711c700 1 -- 172.21.15.59:0/1055729928 shutdown_connections 2023-09-30T22:36:14.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.561+0000 7f91e711c700 1 -- 172.21.15.59:0/1055729928 wait complete. 2023-09-30T22:36:14.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.562+0000 7f91e711c700 1 Processor -- start 2023-09-30T22:36:14.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.562+0000 7f91e711c700 1 -- start start 2023-09-30T22:36:14.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.562+0000 7f91e711c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91e009d630 0x7f91e011c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.562+0000 7f91e711c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e00a0a30 0x7f91e011cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.562+0000 7f91e711c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91e0138d80 0x7f91e011d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:14.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.562+0000 7f91e711c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e011f1f0 con 0x7f91e00a0a30 2023-09-30T22:36:14.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.562+0000 7f91e711c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e011e790 con 0x7f91e0138d80 2023-09-30T22:36:14.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.562+0000 7f91e711c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91e009d320 con 0x7f91e009d630 2023-09-30T22:36:14.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91dffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e00a0a30 0x7f91e011cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91e4eb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91e009d630 0x7f91e011c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91e56b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91e0138d80 0x7f91e011d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:14.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91dffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e00a0a30 0x7f91e011cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55290/0 (socket says 172.21.15.59:55290) 2023-09-30T22:36:14.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91e4eb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91e009d630 0x7f91e011c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60912/0 (socket says 172.21.15.59:60912) 2023-09-30T22:36:14.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91e56b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91e0138d80 0x7f91e011d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56288/0 (socket says 172.21.15.59:56288) 2023-09-30T22:36:14.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91dffff700 1 -- 172.21.15.59:0/184083774 learned_addr learned my addr 172.21.15.59:0/184083774 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:14.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91e56b9700 1 -- 172.21.15.59:0/184083774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91e009d630 msgr2=0x7f91e011c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91e56b9700 1 --2- 172.21.15.59:0/184083774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91e009d630 0x7f91e011c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91e56b9700 1 -- 172.21.15.59:0/184083774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e00a0a30 msgr2=0x7f91e011cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91e56b9700 1 --2- 172.21.15.59:0/184083774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e00a0a30 0x7f91e011cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91e56b9700 1 -- 172.21.15.59:0/184083774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d8009a70 con 0x7f91e0138d80 2023-09-30T22:36:14.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91e4eb8700 1 --2- 172.21.15.59:0/184083774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91e009d630 0x7f91e011c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:14.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91dffff700 1 --2- 172.21.15.59:0/184083774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e00a0a30 0x7f91e011cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:14.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91e56b9700 1 --2- 172.21.15.59:0/184083774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91e0138d80 0x7f91e011d240 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f91d0016000 tx=0x7f91d0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:14.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91dd7fa700 1 -- 172.21.15.59:0/184083774 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0026070 con 0x7f91e0138d80 2023-09-30T22:36:14.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91dd7fa700 1 -- 172.21.15.59:0/184083774 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d0011d10 con 0x7f91e0138d80 2023-09-30T22:36:14.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.563+0000 7f91e711c700 1 -- 172.21.15.59:0/184083774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d00094a0 con 0x7f91e0138d80 2023-09-30T22:36:14.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.564+0000 7f91dd7fa700 1 -- 172.21.15.59:0/184083774 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0004240 con 0x7f91e0138d80 2023-09-30T22:36:14.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.564+0000 7f91e711c700 1 -- 172.21.15.59:0/184083774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e011fee0 con 0x7f91e0138d80 2023-09-30T22:36:14.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.564+0000 7f91dd7fa700 1 -- 172.21.15.59:0/184083774 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91d00043a0 con 0x7f91e0138d80 2023-09-30T22:36:14.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.565+0000 7f91e711c700 1 -- 172.21.15.59:0/184083774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e00747f0 con 0x7f91e0138d80 2023-09-30T22:36:14.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.565+0000 7f91dd7fa700 1 -- 172.21.15.59:0/184083774 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f91d0048600 con 0x7f91e0138d80 2023-09-30T22:36:14.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.570+0000 7f91dd7fa700 1 -- 172.21.15.59:0/184083774 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91d0032be0 con 0x7f91e0138d80 2023-09-30T22:36:14.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.738+0000 7f8ebea61700 1 -- 172.21.15.59:0/4243172672 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8eb8120c00 con 0x7f8eb809d760 2023-09-30T22:36:14.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.738+0000 7f8eb4ff9700 1 -- 172.21.15.59:0/4243172672 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ea8021030 con 0x7f8eb809d760 2023-09-30T22:36:14.739 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:14.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.740+0000 7f8ebea61700 1 -- 172.21.15.59:0/4243172672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb809d760 msgr2=0x7f8eb811e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.740+0000 7f8ebea61700 1 --2- 172.21.15.59:0/4243172672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb809d760 0x7f8eb811e810 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8ea800e9b0 tx=0x7f8ea800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.740+0000 7f8ebea61700 1 -- 172.21.15.59:0/4243172672 shutdown_connections 2023-09-30T22:36:14.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.740+0000 7f8ebea61700 1 --2- 172.21.15.59:0/4243172672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eb809d760 0x7f8eb811e810 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.740+0000 7f8ebea61700 1 --2- 172.21.15.59:0/4243172672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eb8134130 0x7f8eb811f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.740+0000 7f8ebea61700 1 --2- 172.21.15.59:0/4243172672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eb809e070 0x7f8eb811ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.740+0000 7f8ebea61700 1 -- 172.21.15.59:0/4243172672 >> 172.21.15.59:0/4243172672 conn(0x7f8eb8066f50 msgr2=0x7f8eb80a0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:14.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.740+0000 7f8ebea61700 1 -- 172.21.15.59:0/4243172672 shutdown_connections 2023-09-30T22:36:14.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.740+0000 7f8ebea61700 1 -- 172.21.15.59:0/4243172672 wait complete. 2023-09-30T22:36:14.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:14.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.777+0000 7f91e711c700 1 -- 172.21.15.59:0/184083774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f91e013afd0 con 0x7f91e0138d80 2023-09-30T22:36:14.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.778+0000 7f91dd7fa700 1 -- 172.21.15.59:0/184083774 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91d002f030 con 0x7f91e0138d80 2023-09-30T22:36:14.778 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:14.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.780+0000 7f91e711c700 1 -- 172.21.15.59:0/184083774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91e0138d80 msgr2=0x7f91e011d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:14.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.780+0000 7f91e711c700 1 --2- 172.21.15.59:0/184083774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91e0138d80 0x7f91e011d240 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f91d0016000 tx=0x7f91d0004750 comp rx=0 tx=0).stop 2023-09-30T22:36:14.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.780+0000 7f91e711c700 1 -- 172.21.15.59:0/184083774 shutdown_connections 2023-09-30T22:36:14.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.780+0000 7f91e711c700 1 --2- 172.21.15.59:0/184083774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91e009d630 0x7f91e011c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.780+0000 7f91e711c700 1 --2- 172.21.15.59:0/184083774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91e0138d80 0x7f91e011d240 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.780+0000 7f91e711c700 1 --2- 172.21.15.59:0/184083774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e00a0a30 0x7f91e011cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:14.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.780+0000 7f91e711c700 1 -- 172.21.15.59:0/184083774 >> 172.21.15.59:0/184083774 conn(0x7f91e00a3050 msgr2=0x7f91e009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:14.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.780+0000 7f91e711c700 1 -- 172.21.15.59:0/184083774 shutdown_connections 2023-09-30T22:36:14.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:14.780+0000 7f91e711c700 1 -- 172.21.15.59:0/184083774 wait complete. 2023-09-30T22:36:14.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:15.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:15.332 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:15.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.449+0000 7f643bba2700 1 Processor -- start 2023-09-30T22:36:15.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.449+0000 7f643bba2700 1 -- start start 2023-09-30T22:36:15.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.450+0000 7f643bba2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64341337f0 0x7f6434138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.450+0000 7f643bba2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6434138dc0 0x7f643413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.450+0000 7f643bba2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643406b990 con 0x7f6434133420 2023-09-30T22:36:15.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.450+0000 7f643bba2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643409b0e0 con 0x7f6434138dc0 2023-09-30T22:36:15.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.450+0000 7f643bba2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6434133c20 con 0x7f64341337f0 2023-09-30T22:36:15.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.450+0000 7f643913d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64341337f0 0x7f6434138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.450+0000 7f643913d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64341337f0 0x7f6434138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56304/0 (socket says 172.21.15.59:56304) 2023-09-30T22:36:15.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.450+0000 7f643913d700 1 -- 172.21.15.59:0/1434386673 learned_addr learned my addr 172.21.15.59:0/1434386673 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:15.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.451+0000 7f643913d700 1 -- 172.21.15.59:0/1434386673 >> v2:172.21.15.59:3300/0 conn(0x7f6434138dc0 msgr2=0x7f643413b1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:36:15.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.451+0000 7f643913d700 1 --2- 172.21.15.59:0/1434386673 >> v2:172.21.15.59:3300/0 conn(0x7f6434138dc0 0x7f643413b1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.451+0000 7f643913d700 1 -- 172.21.15.59:0/1434386673 >> v1:172.21.15.59:6789/0 conn(0x7f6434133420 legacy=0x7f6434133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:15.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.451+0000 7f643913d700 1 -- 172.21.15.59:0/1434386673 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64340a0590 con 0x7f64341337f0 2023-09-30T22:36:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.451+0000 7f643913d700 1 --2- 172.21.15.59:0/1434386673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64341337f0 0x7f6434138880 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f64280098f0 tx=0x7f6428009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16ee8aed320c0a54 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.451+0000 7f643893c700 1 -- 172.21.15.59:0/1434386673 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428004230 con 0x7f64341337f0 2023-09-30T22:36:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.451+0000 7f643893c700 1 -- 172.21.15.59:0/1434386673 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6428004390 con 0x7f64341337f0 2023-09-30T22:36:15.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.451+0000 7f643893c700 1 -- 172.21.15.59:0/1434386673 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64280036a0 con 0x7f64341337f0 2023-09-30T22:36:15.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.452+0000 7f643bba2700 1 -- 172.21.15.59:0/1434386673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64341337f0 msgr2=0x7f6434138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.452+0000 7f643bba2700 1 --2- 172.21.15.59:0/1434386673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64341337f0 0x7f6434138880 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f64280098f0 tx=0x7f6428009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:15.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.452+0000 7f643bba2700 1 -- 172.21.15.59:0/1434386673 shutdown_connections 2023-09-30T22:36:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.452+0000 7f643bba2700 1 --2- 172.21.15.59:0/1434386673 >> v2:172.21.15.59:3300/0 conn(0x7f6434138dc0 0x7f643413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.452+0000 7f643bba2700 1 --2- 172.21.15.59:0/1434386673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64341337f0 0x7f6434138880 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.452+0000 7f643bba2700 1 -- 172.21.15.59:0/1434386673 >> 172.21.15.59:0/1434386673 conn(0x7f64340a4210 msgr2=0x7f64340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.452+0000 7f643bba2700 1 -- 172.21.15.59:0/1434386673 shutdown_connections 2023-09-30T22:36:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.452+0000 7f643bba2700 1 -- 172.21.15.59:0/1434386673 wait complete. 2023-09-30T22:36:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.453+0000 7f643bba2700 1 Processor -- start 2023-09-30T22:36:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.453+0000 7f643bba2700 1 -- start start 2023-09-30T22:36:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643bba2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6434133420 0x7f6434070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643bba2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64341337f0 0x7f6434071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643bba2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6434138dc0 0x7f6434071840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643bba2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643409dd70 con 0x7f6434138dc0 2023-09-30T22:36:15.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643bba2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643409df60 con 0x7f6434133420 2023-09-30T22:36:15.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643bba2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f643409cf20 con 0x7f64341337f0 2023-09-30T22:36:15.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643913d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64341337f0 0x7f6434071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643913d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64341337f0 0x7f6434071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60920/0 (socket says 172.21.15.59:60920) 2023-09-30T22:36:15.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643913d700 1 -- 172.21.15.59:0/3202341257 learned_addr learned my addr 172.21.15.59:0/3202341257 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:15.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643a13f700 1 --2- 172.21.15.59:0/3202341257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6434138dc0 0x7f6434071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643993e700 1 --2- 172.21.15.59:0/3202341257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6434133420 0x7f6434070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643993e700 1 -- 172.21.15.59:0/3202341257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64341337f0 msgr2=0x7f6434071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643993e700 1 --2- 172.21.15.59:0/3202341257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64341337f0 0x7f6434071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643993e700 1 -- 172.21.15.59:0/3202341257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6434138dc0 msgr2=0x7f6434071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643993e700 1 --2- 172.21.15.59:0/3202341257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6434138dc0 0x7f6434071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643993e700 1 -- 172.21.15.59:0/3202341257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6428009550 con 0x7f6434133420 2023-09-30T22:36:15.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.454+0000 7f643a13f700 1 --2- 172.21.15.59:0/3202341257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6434138dc0 0x7f6434071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:15.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.455+0000 7f643993e700 1 --2- 172.21.15.59:0/3202341257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6434133420 0x7f6434070dc0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f643000c410 tx=0x7f643000c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:15.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.455+0000 7f64267fc700 1 -- 172.21.15.59:0/3202341257 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64300052d0 con 0x7f6434133420 2023-09-30T22:36:15.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.455+0000 7f64267fc700 1 -- 172.21.15.59:0/3202341257 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6430005450 con 0x7f6434133420 2023-09-30T22:36:15.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.455+0000 7f643bba2700 1 -- 172.21.15.59:0/3202341257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64341389a0 con 0x7f6434133420 2023-09-30T22:36:15.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.455+0000 7f64267fc700 1 -- 172.21.15.59:0/3202341257 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64300038c0 con 0x7f6434133420 2023-09-30T22:36:15.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.455+0000 7f643bba2700 1 -- 172.21.15.59:0/3202341257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643409ba20 con 0x7f6434133420 2023-09-30T22:36:15.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.456+0000 7f64267fc700 1 -- 172.21.15.59:0/3202341257 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6430003c30 con 0x7f6434133420 2023-09-30T22:36:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.456+0000 7f643bba2700 1 -- 172.21.15.59:0/3202341257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643409f600 con 0x7f6434133420 2023-09-30T22:36:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.456+0000 7f64267fc700 1 -- 172.21.15.59:0/3202341257 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f643003e7c0 con 0x7f6434133420 2023-09-30T22:36:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.461+0000 7f64267fc700 1 -- 172.21.15.59:0/3202341257 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f643001ab10 con 0x7f6434133420 2023-09-30T22:36:15.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.488+0000 7f0d87c92700 1 Processor -- start 2023-09-30T22:36:15.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.488+0000 7f0d87c92700 1 -- start start 2023-09-30T22:36:15.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d87c92700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d800a0a30 0x7f0d800a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d87c92700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0d80134170 0x7f0d8013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d87c92700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8009edd0 con 0x7f0d800a1340 2023-09-30T22:36:15.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d87c92700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8009e1f0 con 0x7f0d80134170 2023-09-30T22:36:15.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d87c92700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8009dc50 con 0x7f0d800a0a30 2023-09-30T22:36:15.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d8622f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0d80134170 0x7f0d8013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d85a2e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d800a0a30 0x7f0d800a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d8622f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0d80134170 0x7f0d8013bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55316/0 (socket says 172.21.15.59:55316) 2023-09-30T22:36:15.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d8622f700 1 -- 172.21.15.59:0/2514839641 learned_addr learned my addr 172.21.15.59:0/2514839641 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:15.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d85a2e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d800a0a30 0x7f0d800a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60924/0 (socket says 172.21.15.59:60924) 2023-09-30T22:36:15.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d8622f700 1 -- 172.21.15.59:0/2514839641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d800a0a30 msgr2=0x7f0d800a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:15.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d8622f700 1 --2- 172.21.15.59:0/2514839641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d800a0a30 0x7f0d800a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d8622f700 1 -- 172.21.15.59:0/2514839641 >> v1:172.21.15.59:6789/0 conn(0x7f0d800a1340 legacy=0x7f0d80133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d8622f700 1 -- 172.21.15.59:0/2514839641 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d800a1fe0 con 0x7f0d80134170 2023-09-30T22:36:15.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d85a2e700 1 --2- 172.21.15.59:0/2514839641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d800a0a30 0x7f0d800a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:15.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.489+0000 7f0d8622f700 1 --2- 172.21.15.59:0/2514839641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d80134170 0x7f0d8013bd30 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009e50 tx=0x7f0d7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41581eeefb4e87b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:15.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.490+0000 7f0d84a2c700 1 -- 172.21.15.59:0/2514839641 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7800e070 con 0x7f0d80134170 2023-09-30T22:36:15.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.490+0000 7f0d84a2c700 1 -- 172.21.15.59:0/2514839641 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7800b910 con 0x7f0d80134170 2023-09-30T22:36:15.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.490+0000 7f0d84a2c700 1 -- 172.21.15.59:0/2514839641 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7800bcc0 con 0x7f0d80134170 2023-09-30T22:36:15.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.490+0000 7f0d87c92700 1 -- 172.21.15.59:0/2514839641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d80134170 msgr2=0x7f0d8013bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.490+0000 7f0d87c92700 1 --2- 172.21.15.59:0/2514839641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d80134170 0x7f0d8013bd30 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009e50 tx=0x7f0d7800b330 comp rx=0 tx=0).stop 2023-09-30T22:36:15.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.490+0000 7f0d87c92700 1 -- 172.21.15.59:0/2514839641 shutdown_connections 2023-09-30T22:36:15.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.490+0000 7f0d87c92700 1 --2- 172.21.15.59:0/2514839641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d80134170 0x7f0d8013bd30 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.490+0000 7f0d87c92700 1 --2- 172.21.15.59:0/2514839641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d800a0a30 0x7f0d800a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.490+0000 7f0d87c92700 1 -- 172.21.15.59:0/2514839641 >> 172.21.15.59:0/2514839641 conn(0x7f0d800a6550 msgr2=0x7f0d800a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.491+0000 7f0d87c92700 1 -- 172.21.15.59:0/2514839641 shutdown_connections 2023-09-30T22:36:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.491+0000 7f0d87c92700 1 -- 172.21.15.59:0/2514839641 wait complete. 2023-09-30T22:36:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.492+0000 7f0d87c92700 1 Processor -- start 2023-09-30T22:36:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.492+0000 7f0d87c92700 1 -- start start 2023-09-30T22:36:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.492+0000 7f0d87c92700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d800a0a30 0x7f0d8011e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.492+0000 7f0d87c92700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d800a1340 0x7f0d8011ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.492+0000 7f0d87c92700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d80134170 0x7f0d8011f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.492+0000 7f0d87c92700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d80122190 con 0x7f0d800a1340 2023-09-30T22:36:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.492+0000 7f0d87c92700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d80121bf0 con 0x7f0d80134170 2023-09-30T22:36:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.492+0000 7f0d87c92700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d80120280 con 0x7f0d800a0a30 2023-09-30T22:36:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.492+0000 7f0d8522d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d800a1340 0x7f0d8011ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.492+0000 7f0d8622f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d80134170 0x7f0d8011f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.492+0000 7f0d8522d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d800a1340 0x7f0d8011ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55320/0 (socket says 172.21.15.59:55320) 2023-09-30T22:36:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.492+0000 7f0d8622f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d80134170 0x7f0d8011f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56320/0 (socket says 172.21.15.59:56320) 2023-09-30T22:36:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.492+0000 7f0d8522d700 1 -- 172.21.15.59:0/1445288200 learned_addr learned my addr 172.21.15.59:0/1445288200 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.492+0000 7f0d85a2e700 1 --2- 172.21.15.59:0/1445288200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d800a0a30 0x7f0d8011e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.493+0000 7f0d8522d700 1 -- 172.21.15.59:0/1445288200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d800a0a30 msgr2=0x7f0d8011e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.493+0000 7f0d8522d700 1 --2- 172.21.15.59:0/1445288200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d800a0a30 0x7f0d8011e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.493+0000 7f0d8522d700 1 -- 172.21.15.59:0/1445288200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d80134170 msgr2=0x7f0d8011f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.493+0000 7f0d8522d700 1 --2- 172.21.15.59:0/1445288200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d80134170 0x7f0d8011f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.493+0000 7f0d8522d700 1 -- 172.21.15.59:0/1445288200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c0094a0 con 0x7f0d800a1340 2023-09-30T22:36:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.493+0000 7f0d8622f700 1 --2- 172.21.15.59:0/1445288200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d80134170 0x7f0d8011f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.493+0000 7f0d8522d700 1 --2- 172.21.15.59:0/1445288200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d800a1340 0x7f0d8011ec40 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c4e0 tx=0x7f0d7000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.493+0000 7f0d767fc700 1 -- 172.21.15.59:0/1445288200 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700052d0 con 0x7f0d800a1340 2023-09-30T22:36:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.493+0000 7f0d767fc700 1 -- 172.21.15.59:0/1445288200 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d70005430 con 0x7f0d800a1340 2023-09-30T22:36:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.493+0000 7f0d767fc700 1 -- 172.21.15.59:0/1445288200 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700038c0 con 0x7f0d800a1340 2023-09-30T22:36:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.493+0000 7f0d87c92700 1 -- 172.21.15.59:0/1445288200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d78009b30 con 0x7f0d800a1340 2023-09-30T22:36:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.493+0000 7f0d87c92700 1 -- 172.21.15.59:0/1445288200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d80120a30 con 0x7f0d800a1340 2023-09-30T22:36:15.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.494+0000 7f0d87c92700 1 -- 172.21.15.59:0/1445288200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d80074ea0 con 0x7f0d800a1340 2023-09-30T22:36:15.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.495+0000 7f0d767fc700 1 -- 172.21.15.59:0/1445288200 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d70003a20 con 0x7f0d800a1340 2023-09-30T22:36:15.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.495+0000 7f0d767fc700 1 -- 172.21.15.59:0/1445288200 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0d7003ec60 con 0x7f0d800a1340 2023-09-30T22:36:15.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.499+0000 7f0d767fc700 1 -- 172.21.15.59:0/1445288200 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d700192c0 con 0x7f0d800a1340 2023-09-30T22:36:15.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.671+0000 7f643bba2700 1 -- 172.21.15.59:0/3202341257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6434074ea0 con 0x7f6434133420 2023-09-30T22:36:15.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.672+0000 7f64267fc700 1 -- 172.21.15.59:0/3202341257 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6430017070 con 0x7f6434133420 2023-09-30T22:36:15.672 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:15.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.674+0000 7f643bba2700 1 -- 172.21.15.59:0/3202341257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6434133420 msgr2=0x7f6434070dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.674+0000 7f643bba2700 1 --2- 172.21.15.59:0/3202341257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6434133420 0x7f6434070dc0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f643000c410 tx=0x7f643000c720 comp rx=0 tx=0).stop 2023-09-30T22:36:15.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.674+0000 7f643bba2700 1 -- 172.21.15.59:0/3202341257 shutdown_connections 2023-09-30T22:36:15.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.674+0000 7f643bba2700 1 --2- 172.21.15.59:0/3202341257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6434138dc0 0x7f6434071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.674+0000 7f643bba2700 1 --2- 172.21.15.59:0/3202341257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6434133420 0x7f6434070dc0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.674+0000 7f643bba2700 1 --2- 172.21.15.59:0/3202341257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64341337f0 0x7f6434071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.674+0000 7f643bba2700 1 -- 172.21.15.59:0/3202341257 >> 172.21.15.59:0/3202341257 conn(0x7f64340a4210 msgr2=0x7f64340a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:15.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.674+0000 7f643bba2700 1 -- 172.21.15.59:0/3202341257 shutdown_connections 2023-09-30T22:36:15.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.674+0000 7f643bba2700 1 -- 172.21.15.59:0/3202341257 wait complete. 2023-09-30T22:36:15.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:15.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.707+0000 7f0d87c92700 1 -- 172.21.15.59:0/1445288200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d800a28e0 con 0x7f0d800a1340 2023-09-30T22:36:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.708+0000 7f0d767fc700 1 -- 172.21.15.59:0/1445288200 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d70017070 con 0x7f0d800a1340 2023-09-30T22:36:15.708 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.710+0000 7f0d87c92700 1 -- 172.21.15.59:0/1445288200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d800a1340 msgr2=0x7f0d8011ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.710+0000 7f0d87c92700 1 --2- 172.21.15.59:0/1445288200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d800a1340 0x7f0d8011ec40 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c4e0 tx=0x7f0d7000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.710+0000 7f0d87c92700 1 -- 172.21.15.59:0/1445288200 shutdown_connections 2023-09-30T22:36:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.710+0000 7f0d87c92700 1 --2- 172.21.15.59:0/1445288200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d800a0a30 0x7f0d8011e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.710+0000 7f0d87c92700 1 --2- 172.21.15.59:0/1445288200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d80134170 0x7f0d8011f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.710+0000 7f0d87c92700 1 --2- 172.21.15.59:0/1445288200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d800a1340 0x7f0d8011ec40 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.710+0000 7f0d87c92700 1 -- 172.21.15.59:0/1445288200 >> 172.21.15.59:0/1445288200 conn(0x7f0d800a6550 msgr2=0x7f0d8009c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.710+0000 7f0d87c92700 1 -- 172.21.15.59:0/1445288200 shutdown_connections 2023-09-30T22:36:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.710+0000 7f0d87c92700 1 -- 172.21.15.59:0/1445288200 wait complete. 2023-09-30T22:36:15.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:15.755 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:15.795 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:15.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.905+0000 7fe974b88700 1 Processor -- start 2023-09-30T22:36:15.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.905+0000 7fe974b88700 1 -- start start 2023-09-30T22:36:15.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.905+0000 7fe974b88700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9700a0a30 0x7fe9700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.905+0000 7fe974b88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9700a1340 0x7fe970133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.905+0000 7fe974b88700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97009edd0 con 0x7fe970133fa0 2023-09-30T22:36:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.905+0000 7fe974b88700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97009e1f0 con 0x7fe9700a0a30 2023-09-30T22:36:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.905+0000 7fe974b88700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe97009dc50 con 0x7fe9700a1340 2023-09-30T22:36:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.906+0000 7fe96dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9700a1340 0x7fe970133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.906+0000 7fe96e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9700a0a30 0x7fe9700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.906+0000 7fe96dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9700a1340 0x7fe970133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60954/0 (socket says 172.21.15.59:60954) 2023-09-30T22:36:15.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.906+0000 7fe96e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9700a0a30 0x7fe9700a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55322/0 (socket says 172.21.15.59:55322) 2023-09-30T22:36:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.906+0000 7fe96dd9b700 1 -- 172.21.15.59:0/3072836145 learned_addr learned my addr 172.21.15.59:0/3072836145 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.906+0000 7fe96e59c700 1 -- 172.21.15.59:0/3072836145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9700a1340 msgr2=0x7fe970133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.906+0000 7fe96e59c700 1 --2- 172.21.15.59:0/3072836145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9700a1340 0x7fe970133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.906+0000 7fe96e59c700 1 -- 172.21.15.59:0/3072836145 >> v1:172.21.15.59:6789/0 conn(0x7fe970133fa0 legacy=0x7fe97013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.906+0000 7fe96e59c700 1 -- 172.21.15.59:0/3072836145 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9700a1fe0 con 0x7fe9700a0a30 2023-09-30T22:36:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.906+0000 7fe96dd9b700 1 --2- 172.21.15.59:0/3072836145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9700a1340 0x7fe970133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.906+0000 7fe96e59c700 1 --2- 172.21.15.59:0/3072836145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9700a0a30 0x7fe9700a0e00 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fe960009840 tx=0x7fe960009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf9d3bed794b0d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:15.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.906+0000 7fe96d59a700 1 -- 172.21.15.59:0/3072836145 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960011830 con 0x7fe9700a0a30 2023-09-30T22:36:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.906+0000 7fe96d59a700 1 -- 172.21.15.59:0/3072836145 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe960011990 con 0x7fe9700a0a30 2023-09-30T22:36:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.906+0000 7fe96d59a700 1 -- 172.21.15.59:0/3072836145 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960011d20 con 0x7fe9700a0a30 2023-09-30T22:36:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.907+0000 7fe974b88700 1 -- 172.21.15.59:0/3072836145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9700a0a30 msgr2=0x7fe9700a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.907+0000 7fe974b88700 1 --2- 172.21.15.59:0/3072836145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9700a0a30 0x7fe9700a0e00 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fe960009840 tx=0x7fe960009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.907+0000 7fe974b88700 1 -- 172.21.15.59:0/3072836145 shutdown_connections 2023-09-30T22:36:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.907+0000 7fe974b88700 1 --2- 172.21.15.59:0/3072836145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9700a0a30 0x7fe9700a0e00 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.907+0000 7fe974b88700 1 --2- 172.21.15.59:0/3072836145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9700a1340 0x7fe970133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.907+0000 7fe974b88700 1 -- 172.21.15.59:0/3072836145 >> 172.21.15.59:0/3072836145 conn(0x7fe9700a6550 msgr2=0x7fe9700a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:15.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.907+0000 7fe974b88700 1 -- 172.21.15.59:0/3072836145 shutdown_connections 2023-09-30T22:36:15.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.907+0000 7fe974b88700 1 -- 172.21.15.59:0/3072836145 wait complete. 2023-09-30T22:36:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.909+0000 7fe974b88700 1 Processor -- start 2023-09-30T22:36:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.909+0000 7fe974b88700 1 -- start start 2023-09-30T22:36:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.909+0000 7fe974b88700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9700a0a30 0x7fe97011e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.909+0000 7fe974b88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9700a1340 0x7fe97011ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.909+0000 7fe974b88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe970133fa0 0x7fe97011f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.909+0000 7fe974b88700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe970121f50 con 0x7fe9700a0a30 2023-09-30T22:36:15.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.909+0000 7fe974b88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe970120430 con 0x7fe970133fa0 2023-09-30T22:36:15.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.909+0000 7fe974b88700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700a37e0 con 0x7fe9700a1340 2023-09-30T22:36:15.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.909+0000 7fe96dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9700a1340 0x7fe97011ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.909+0000 7fe96e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9700a0a30 0x7fe97011e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.909+0000 7fe96ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe970133fa0 0x7fe97011f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.909+0000 7fe96dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9700a1340 0x7fe97011ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:60966/0 (socket says 172.21.15.59:60966) 2023-09-30T22:36:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.909+0000 7fe96dd9b700 1 -- 172.21.15.59:0/1707907541 learned_addr learned my addr 172.21.15.59:0/1707907541 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.910+0000 7fe96dd9b700 1 -- 172.21.15.59:0/1707907541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe970133fa0 msgr2=0x7fe97011f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.910+0000 7fe96dd9b700 1 --2- 172.21.15.59:0/1707907541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe970133fa0 0x7fe97011f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.910+0000 7fe96dd9b700 1 -- 172.21.15.59:0/1707907541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9700a0a30 msgr2=0x7fe97011e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.910+0000 7fe96dd9b700 1 --2- 172.21.15.59:0/1707907541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9700a0a30 0x7fe97011e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.910+0000 7fe96dd9b700 1 -- 172.21.15.59:0/1707907541 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe964009550 con 0x7fe9700a1340 2023-09-30T22:36:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.910+0000 7fe96e59c700 1 --2- 172.21.15.59:0/1707907541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9700a0a30 0x7fe97011e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.910+0000 7fe96dd9b700 1 --2- 172.21.15.59:0/1707907541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9700a1340 0x7fe97011ece0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe96400ec10 tx=0x7fe96400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.910+0000 7fe95effd700 1 -- 172.21.15.59:0/1707907541 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400c850 con 0x7fe9700a1340 2023-09-30T22:36:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.910+0000 7fe95effd700 1 -- 172.21.15.59:0/1707907541 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96400c9b0 con 0x7fe9700a1340 2023-09-30T22:36:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.910+0000 7fe974b88700 1 -- 172.21.15.59:0/1707907541 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9600094a0 con 0x7fe9700a1340 2023-09-30T22:36:15.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.910+0000 7fe95effd700 1 -- 172.21.15.59:0/1707907541 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400cd40 con 0x7fe9700a1340 2023-09-30T22:36:15.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.910+0000 7fe974b88700 1 -- 172.21.15.59:0/1707907541 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9700a0270 con 0x7fe9700a1340 2023-09-30T22:36:15.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.911+0000 7fe95effd700 1 -- 172.21.15.59:0/1707907541 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe964013470 con 0x7fe9700a1340 2023-09-30T22:36:15.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.911+0000 7fe95effd700 1 -- 172.21.15.59:0/1707907541 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe96403fc20 con 0x7fe9700a1340 2023-09-30T22:36:15.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.911+0000 7fe974b88700 1 -- 172.21.15.59:0/1707907541 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe970122a80 con 0x7fe9700a1340 2023-09-30T22:36:15.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.916+0000 7fe95effd700 1 -- 172.21.15.59:0/1707907541 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe964017080 con 0x7fe9700a1340 2023-09-30T22:36:15.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.947+0000 7f65c2651700 1 Processor -- start 2023-09-30T22:36:15.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.947+0000 7f65c2651700 1 -- start start 2023-09-30T22:36:15.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.948+0000 7f65c2651700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc0a0a30 0x7f65bc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.948+0000 7f65c2651700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc0a1340 0x7f65bc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.948+0000 7f65c2651700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65bc09edd0 con 0x7f65bc133fa0 2023-09-30T22:36:15.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.948+0000 7f65c2651700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc09e1f0 con 0x7f65bc0a1340 2023-09-30T22:36:15.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.948+0000 7f65c2651700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc09dc50 con 0x7f65bc0a0a30 2023-09-30T22:36:15.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.948+0000 7f65bbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc0a0a30 0x7f65bc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.948+0000 7f65c0bee700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f65bc133fa0 0x7f65bc13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41230/0 (socket says 172.21.15.59:41230) 2023-09-30T22:36:15.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.948+0000 7f65c0bee700 1 -- 172.21.15.59:0/1747288574 learned_addr learned my addr 172.21.15.59:0/1747288574 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:15.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.948+0000 7f65bb7fe700 1 --2- 172.21.15.59:0/1747288574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc0a1340 0x7f65bc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.949+0000 7f65baffd700 1 -- 172.21.15.59:0/1747288574 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783021428 0 0) 0x7f65bc09edd0 con 0x7f65bc133fa0 2023-09-30T22:36:15.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.949+0000 7f65baffd700 1 -- 172.21.15.59:0/1747288574 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65a40035b0 con 0x7f65bc133fa0 2023-09-30T22:36:15.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.949+0000 7f65bbfff700 1 -- 172.21.15.59:0/1747288574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc0a1340 msgr2=0x7f65bc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:15.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.949+0000 7f65bbfff700 1 --2- 172.21.15.59:0/1747288574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc0a1340 0x7f65bc133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.949+0000 7f65bbfff700 1 -- 172.21.15.59:0/1747288574 >> v1:172.21.15.59:6789/0 conn(0x7f65bc133fa0 legacy=0x7f65bc13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.949+0000 7f65bbfff700 1 -- 172.21.15.59:0/1747288574 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc0a1fe0 con 0x7f65bc0a0a30 2023-09-30T22:36:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.949+0000 7f65bb7fe700 1 --2- 172.21.15.59:0/1747288574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc0a1340 0x7f65bc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.949+0000 7f65bbfff700 1 --2- 172.21.15.59:0/1747288574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc0a0a30 0x7f65bc0a0e00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009870 tx=0x7f65ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=940823587472e478 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.949+0000 7f65baffd700 1 -- 172.21.15.59:0/1747288574 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac011830 con 0x7f65bc0a0a30 2023-09-30T22:36:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.949+0000 7f65baffd700 1 -- 172.21.15.59:0/1747288574 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac011990 con 0x7f65bc0a0a30 2023-09-30T22:36:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.949+0000 7f65baffd700 1 -- 172.21.15.59:0/1747288574 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac011d20 con 0x7f65bc0a0a30 2023-09-30T22:36:15.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.950+0000 7f65c2651700 1 -- 172.21.15.59:0/1747288574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc0a0a30 msgr2=0x7f65bc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.950+0000 7f65c2651700 1 --2- 172.21.15.59:0/1747288574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc0a0a30 0x7f65bc0a0e00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009870 tx=0x7f65ac009b80 comp rx=0 tx=0).stop 2023-09-30T22:36:15.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.950+0000 7f65c2651700 1 -- 172.21.15.59:0/1747288574 shutdown_connections 2023-09-30T22:36:15.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.950+0000 7f65c2651700 1 --2- 172.21.15.59:0/1747288574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc0a0a30 0x7f65bc0a0e00 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.950+0000 7f65c2651700 1 --2- 172.21.15.59:0/1747288574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc0a1340 0x7f65bc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.950+0000 7f65c2651700 1 -- 172.21.15.59:0/1747288574 >> 172.21.15.59:0/1747288574 conn(0x7f65bc0a6550 msgr2=0x7f65bc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:15.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.950+0000 7f65c2651700 1 -- 172.21.15.59:0/1747288574 shutdown_connections 2023-09-30T22:36:15.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.950+0000 7f65c2651700 1 -- 172.21.15.59:0/1747288574 wait complete. 2023-09-30T22:36:15.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.951+0000 7f65c2651700 1 Processor -- start 2023-09-30T22:36:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.951+0000 7f65c2651700 1 -- start start 2023-09-30T22:36:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65c2651700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65bc0a0a30 0x7f65bc1c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65c2651700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc0a1340 0x7f65bc1c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65c2651700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc133fa0 0x7f65bc1c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65c2651700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc1263b0 con 0x7f65bc0a0a30 2023-09-30T22:36:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65c2651700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc1246a0 con 0x7f65bc0a1340 2023-09-30T22:36:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65c2651700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc124c50 con 0x7f65bc133fa0 2023-09-30T22:36:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65bb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc0a1340 0x7f65bc1c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65bb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc0a1340 0x7f65bc1c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56362/0 (socket says 172.21.15.59:56362) 2023-09-30T22:36:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65bb7fe700 1 -- 172.21.15.59:0/3560859013 learned_addr learned my addr 172.21.15.59:0/3560859013 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65bbfff700 1 --2- 172.21.15.59:0/3560859013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65bc0a0a30 0x7f65bc1c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65c0bee700 1 --2- 172.21.15.59:0/3560859013 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc133fa0 0x7f65bc1c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65bb7fe700 1 -- 172.21.15.59:0/3560859013 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc133fa0 msgr2=0x7f65bc1c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65bb7fe700 1 --2- 172.21.15.59:0/3560859013 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc133fa0 0x7f65bc1c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65bb7fe700 1 -- 172.21.15.59:0/3560859013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65bc0a0a30 msgr2=0x7f65bc1c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65bb7fe700 1 --2- 172.21.15.59:0/3560859013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65bc0a0a30 0x7f65bc1c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65bb7fe700 1 -- 172.21.15.59:0/3560859013 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b00094a0 con 0x7f65bc0a1340 2023-09-30T22:36:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65c0bee700 1 --2- 172.21.15.59:0/3560859013 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc133fa0 0x7f65bc1c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.952+0000 7f65bb7fe700 1 --2- 172.21.15.59:0/3560859013 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc0a1340 0x7f65bc1c8930 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f65b000ebe0 tx=0x7f65b000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.953+0000 7f65b8ff9700 1 -- 172.21.15.59:0/3560859013 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b000c850 con 0x7f65bc0a1340 2023-09-30T22:36:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.953+0000 7f65b8ff9700 1 -- 172.21.15.59:0/3560859013 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b000c9b0 con 0x7f65bc0a1340 2023-09-30T22:36:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.953+0000 7f65b8ff9700 1 -- 172.21.15.59:0/3560859013 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b000cd40 con 0x7f65bc0a1340 2023-09-30T22:36:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.953+0000 7f65c2651700 1 -- 172.21.15.59:0/3560859013 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac0094a0 con 0x7f65bc0a1340 2023-09-30T22:36:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.953+0000 7f65c2651700 1 -- 172.21.15.59:0/3560859013 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc0a25e0 con 0x7f65bc0a1340 2023-09-30T22:36:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.953+0000 7f65b8ff9700 1 -- 172.21.15.59:0/3560859013 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65b0013470 con 0x7f65bc0a1340 2023-09-30T22:36:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.954+0000 7f65b8ff9700 1 -- 172.21.15.59:0/3560859013 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f65b003fb00 con 0x7f65bc0a1340 2023-09-30T22:36:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.954+0000 7f65c2651700 1 -- 172.21.15.59:0/3560859013 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc0a1b00 con 0x7f65bc0a1340 2023-09-30T22:36:15.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:15.959+0000 7f65b8ff9700 1 -- 172.21.15.59:0/3560859013 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65b0013720 con 0x7f65bc0a1340 2023-09-30T22:36:16.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.122+0000 7fe974b88700 1 -- 172.21.15.59:0/1707907541 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe970074ea0 con 0x7fe9700a1340 2023-09-30T22:36:16.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.122+0000 7fe95effd700 1 -- 172.21.15.59:0/1707907541 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe964013720 con 0x7fe9700a1340 2023-09-30T22:36:16.123 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:16.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.124+0000 7fe974b88700 1 -- 172.21.15.59:0/1707907541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9700a1340 msgr2=0x7fe97011ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:16.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.124+0000 7fe974b88700 1 --2- 172.21.15.59:0/1707907541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9700a1340 0x7fe97011ece0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe96400ec10 tx=0x7fe96400ef20 comp rx=0 tx=0).stop 2023-09-30T22:36:16.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.124+0000 7fe974b88700 1 -- 172.21.15.59:0/1707907541 shutdown_connections 2023-09-30T22:36:16.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.124+0000 7fe974b88700 1 --2- 172.21.15.59:0/1707907541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe970133fa0 0x7fe97011f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.124+0000 7fe974b88700 1 --2- 172.21.15.59:0/1707907541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9700a0a30 0x7fe97011e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.124+0000 7fe974b88700 1 --2- 172.21.15.59:0/1707907541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9700a1340 0x7fe97011ece0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.124+0000 7fe974b88700 1 -- 172.21.15.59:0/1707907541 >> 172.21.15.59:0/1707907541 conn(0x7fe9700a6550 msgr2=0x7fe9701b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:16.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.124+0000 7fe974b88700 1 -- 172.21.15.59:0/1707907541 shutdown_connections 2023-09-30T22:36:16.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.124+0000 7fe974b88700 1 -- 172.21.15.59:0/1707907541 wait complete. 2023-09-30T22:36:16.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.166+0000 7f65c2651700 1 -- 172.21.15.59:0/3560859013 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f65bc074ea0 con 0x7f65bc0a1340 2023-09-30T22:36:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.166+0000 7f65b8ff9700 1 -- 172.21.15.59:0/3560859013 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65b0017020 con 0x7f65bc0a1340 2023-09-30T22:36:16.166 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.168+0000 7f65c2651700 1 -- 172.21.15.59:0/3560859013 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc0a1340 msgr2=0x7f65bc1c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.168+0000 7f65c2651700 1 --2- 172.21.15.59:0/3560859013 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc0a1340 0x7f65bc1c8930 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f65b000ebe0 tx=0x7f65b000eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.168+0000 7f65c2651700 1 -- 172.21.15.59:0/3560859013 shutdown_connections 2023-09-30T22:36:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.168+0000 7f65c2651700 1 --2- 172.21.15.59:0/3560859013 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc133fa0 0x7f65bc1c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.168+0000 7f65c2651700 1 --2- 172.21.15.59:0/3560859013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65bc0a0a30 0x7f65bc1c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.168+0000 7f65c2651700 1 --2- 172.21.15.59:0/3560859013 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc0a1340 0x7f65bc1c8930 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.168+0000 7f65c2651700 1 -- 172.21.15.59:0/3560859013 >> 172.21.15.59:0/3560859013 conn(0x7f65bc0a6550 msgr2=0x7f65bc11c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.169+0000 7f65c2651700 1 -- 172.21.15.59:0/3560859013 shutdown_connections 2023-09-30T22:36:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.169+0000 7f65c2651700 1 -- 172.21.15.59:0/3560859013 wait complete. 2023-09-30T22:36:16.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:16.690 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:16.725 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:16.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.843+0000 7fc4e2b26700 1 Processor -- start 2023-09-30T22:36:16.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.843+0000 7fc4e2b26700 1 -- start start 2023-09-30T22:36:16.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.844+0000 7fc4e2b26700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4dc0a0a30 0x7fc4dc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.844+0000 7fc4e2b26700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc4dc134170 0x7fc4dc13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.844+0000 7fc4e2b26700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4dc09edd0 con 0x7fc4dc0a1340 2023-09-30T22:36:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.844+0000 7fc4e2b26700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4dc09e1f0 con 0x7fc4dc134170 2023-09-30T22:36:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.844+0000 7fc4e2b26700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc09dc50 con 0x7fc4dc0a0a30 2023-09-30T22:36:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.844+0000 7fc4e10c3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc4dc134170 0x7fc4dc13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.844+0000 7fc4e10c3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc4dc134170 0x7fc4dc13bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55354/0 (socket says 172.21.15.59:55354) 2023-09-30T22:36:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.844+0000 7fc4e10c3700 1 -- 172.21.15.59:0/182622776 learned_addr learned my addr 172.21.15.59:0/182622776 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.844+0000 7fc4e08c2700 1 --2- 172.21.15.59:0/182622776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4dc0a0a30 0x7fc4dc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.844+0000 7fc4e10c3700 1 -- 172.21.15.59:0/182622776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4dc0a0a30 msgr2=0x7fc4dc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.844+0000 7fc4e10c3700 1 --2- 172.21.15.59:0/182622776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4dc0a0a30 0x7fc4dc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.844+0000 7fc4e10c3700 1 -- 172.21.15.59:0/182622776 >> v1:172.21.15.59:6789/0 conn(0x7fc4dc0a1340 legacy=0x7fc4dc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.844+0000 7fc4e10c3700 1 -- 172.21.15.59:0/182622776 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4dc0a1fe0 con 0x7fc4dc134170 2023-09-30T22:36:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.844+0000 7fc4e08c2700 1 --2- 172.21.15.59:0/182622776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4dc0a0a30 0x7fc4dc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.845+0000 7fc4e10c3700 1 --2- 172.21.15.59:0/182622776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4dc134170 0x7fc4dc13bd30 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009e50 tx=0x7fc4d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24960c215bd08bd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.845+0000 7fc4db7fe700 1 -- 172.21.15.59:0/182622776 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d400e070 con 0x7fc4dc134170 2023-09-30T22:36:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.845+0000 7fc4db7fe700 1 -- 172.21.15.59:0/182622776 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d400b910 con 0x7fc4dc134170 2023-09-30T22:36:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.845+0000 7fc4db7fe700 1 -- 172.21.15.59:0/182622776 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d400bcc0 con 0x7fc4dc134170 2023-09-30T22:36:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.845+0000 7fc4e2b26700 1 -- 172.21.15.59:0/182622776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4dc134170 msgr2=0x7fc4dc13bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.845+0000 7fc4e2b26700 1 --2- 172.21.15.59:0/182622776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4dc134170 0x7fc4dc13bd30 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009e50 tx=0x7fc4d400b330 comp rx=0 tx=0).stop 2023-09-30T22:36:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.845+0000 7fc4e2b26700 1 -- 172.21.15.59:0/182622776 shutdown_connections 2023-09-30T22:36:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.845+0000 7fc4e2b26700 1 --2- 172.21.15.59:0/182622776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4dc134170 0x7fc4dc13bd30 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.845+0000 7fc4e2b26700 1 --2- 172.21.15.59:0/182622776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4dc0a0a30 0x7fc4dc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.845+0000 7fc4e2b26700 1 -- 172.21.15.59:0/182622776 >> 172.21.15.59:0/182622776 conn(0x7fc4dc0a6550 msgr2=0x7fc4dc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:16.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.846+0000 7fc4e2b26700 1 -- 172.21.15.59:0/182622776 shutdown_connections 2023-09-30T22:36:16.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.846+0000 7fc4e2b26700 1 -- 172.21.15.59:0/182622776 wait complete. 2023-09-30T22:36:16.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.846+0000 7fc4e2b26700 1 Processor -- start 2023-09-30T22:36:16.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.847+0000 7fc4e2b26700 1 -- start start 2023-09-30T22:36:16.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.847+0000 7fc4e2b26700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4dc0a0a30 0x7fc4dc11e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:16.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.847+0000 7fc4e2b26700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4dc0a1340 0x7fc4dc11ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:16.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.847+0000 7fc4e2b26700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4dc134170 0x7fc4dc11f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:16.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.847+0000 7fc4e2b26700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc122190 con 0x7fc4dc0a1340 2023-09-30T22:36:16.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.847+0000 7fc4e2b26700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc121bf0 con 0x7fc4dc134170 2023-09-30T22:36:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.847+0000 7fc4e2b26700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc120280 con 0x7fc4dc0a0a30 2023-09-30T22:36:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.847+0000 7fc4e08c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4dc0a0a30 0x7fc4dc11e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.847+0000 7fc4e08c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4dc0a0a30 0x7fc4dc11e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32784/0 (socket says 172.21.15.59:32784) 2023-09-30T22:36:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.847+0000 7fc4e08c2700 1 -- 172.21.15.59:0/3600819392 learned_addr learned my addr 172.21.15.59:0/3600819392 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.847+0000 7fc4e10c3700 1 --2- 172.21.15.59:0/3600819392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4dc134170 0x7fc4dc11f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.847+0000 7fc4dbfff700 1 --2- 172.21.15.59:0/3600819392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4dc0a1340 0x7fc4dc11ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.848+0000 7fc4e08c2700 1 -- 172.21.15.59:0/3600819392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4dc134170 msgr2=0x7fc4dc11f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.848+0000 7fc4e08c2700 1 --2- 172.21.15.59:0/3600819392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4dc134170 0x7fc4dc11f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.848+0000 7fc4e08c2700 1 -- 172.21.15.59:0/3600819392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4dc0a1340 msgr2=0x7fc4dc11ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.848+0000 7fc4e08c2700 1 --2- 172.21.15.59:0/3600819392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4dc0a1340 0x7fc4dc11ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.848+0000 7fc4e08c2700 1 -- 172.21.15.59:0/3600819392 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc0094a0 con 0x7fc4dc0a0a30 2023-09-30T22:36:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.848+0000 7fc4e10c3700 1 --2- 172.21.15.59:0/3600819392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4dc134170 0x7fc4dc11f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:16.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.848+0000 7fc4dbfff700 1 --2- 172.21.15.59:0/3600819392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4dc0a1340 0x7fc4dc11ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:16.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.848+0000 7fc4e08c2700 1 --2- 172.21.15.59:0/3600819392 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4dc0a0a30 0x7fc4dc11e700 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00ebe0 tx=0x7fc4cc00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:16.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.848+0000 7fc4d97fa700 1 -- 172.21.15.59:0/3600819392 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc00c850 con 0x7fc4dc0a0a30 2023-09-30T22:36:16.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.848+0000 7fc4d97fa700 1 -- 172.21.15.59:0/3600819392 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc00c9b0 con 0x7fc4dc0a0a30 2023-09-30T22:36:16.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.848+0000 7fc4e2b26700 1 -- 172.21.15.59:0/3600819392 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d4009b30 con 0x7fc4dc0a0a30 2023-09-30T22:36:16.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.848+0000 7fc4d97fa700 1 -- 172.21.15.59:0/3600819392 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc00cd40 con 0x7fc4dc0a0a30 2023-09-30T22:36:16.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.848+0000 7fc4e2b26700 1 -- 172.21.15.59:0/3600819392 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4dc120a30 con 0x7fc4dc0a0a30 2023-09-30T22:36:16.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.849+0000 7fc4d97fa700 1 -- 172.21.15.59:0/3600819392 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc4cc013470 con 0x7fc4dc0a0a30 2023-09-30T22:36:16.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.849+0000 7fc4e2b26700 1 -- 172.21.15.59:0/3600819392 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4dc133600 con 0x7fc4dc0a0a30 2023-09-30T22:36:16.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.850+0000 7fc4d97fa700 1 -- 172.21.15.59:0/3600819392 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc4cc03fb50 con 0x7fc4dc0a0a30 2023-09-30T22:36:16.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.855+0000 7fc4d97fa700 1 -- 172.21.15.59:0/3600819392 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc4cc013720 con 0x7fc4dc0a0a30 2023-09-30T22:36:16.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.886+0000 7f7eb67a1700 1 Processor -- start 2023-09-30T22:36:16.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.886+0000 7f7eb67a1700 1 -- start start 2023-09-30T22:36:16.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.887+0000 7f7eb67a1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0870 0x7f7eb00a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:16.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.887+0000 7f7eb67a1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7eb00a1180 0x7f7eb0133790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:16.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.887+0000 7f7eb67a1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb009db90 con 0x7f7eb00a15b0 2023-09-30T22:36:16.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.887+0000 7f7eb67a1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb00a1ce0 con 0x7f7eb00a1180 2023-09-30T22:36:16.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.887+0000 7f7eb67a1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb00a24f0 con 0x7f7eb00a0870 2023-09-30T22:36:16.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.887+0000 7f7eb4f9e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7eb00a1180 0x7f7eb0133790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:16.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.887+0000 7f7eb579f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0870 0x7f7eb00a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:16.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.887+0000 7f7eb4f9e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7eb00a1180 0x7f7eb0133790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55362/0 (socket says 172.21.15.59:55362) 2023-09-30T22:36:16.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.887+0000 7f7eb4f9e700 1 -- 172.21.15.59:0/287352002 learned_addr learned my addr 172.21.15.59:0/287352002 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:16.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.887+0000 7f7eb579f700 1 -- 172.21.15.59:0/287352002 >> v2:172.21.15.59:3300/0 conn(0x7f7eb00a1180 msgr2=0x7f7eb0133790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:16.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.887+0000 7f7eb579f700 1 --2- 172.21.15.59:0/287352002 >> v2:172.21.15.59:3300/0 conn(0x7f7eb00a1180 0x7f7eb0133790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.887+0000 7f7eb579f700 1 -- 172.21.15.59:0/287352002 >> v1:172.21.15.59:6789/0 conn(0x7f7eb00a15b0 legacy=0x7f7eb0133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:16.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.887+0000 7f7eb579f700 1 -- 172.21.15.59:0/287352002 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb00a1aa0 con 0x7f7eb00a0870 2023-09-30T22:36:16.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.887+0000 7f7eb4f9e700 1 --2- 172.21.15.59:0/287352002 >> v2:172.21.15.59:3300/0 conn(0x7f7eb00a1180 0x7f7eb0133790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:16.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.887+0000 7f7eb579f700 1 --2- 172.21.15.59:0/287352002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0870 0x7f7eb00a0c40 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009840 tx=0x7f7ea0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fe884b71522610e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:16.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.888+0000 7f7eaffff700 1 -- 172.21.15.59:0/287352002 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0011830 con 0x7f7eb00a0870 2023-09-30T22:36:16.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.888+0000 7f7eaffff700 1 -- 172.21.15.59:0/287352002 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea0011990 con 0x7f7eb00a0870 2023-09-30T22:36:16.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.888+0000 7f7eaffff700 1 -- 172.21.15.59:0/287352002 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0011d20 con 0x7f7eb00a0870 2023-09-30T22:36:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.888+0000 7f7eb67a1700 1 -- 172.21.15.59:0/287352002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0870 msgr2=0x7f7eb00a0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.888+0000 7f7eb67a1700 1 --2- 172.21.15.59:0/287352002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0870 0x7f7eb00a0c40 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009840 tx=0x7f7ea0009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.888+0000 7f7eb67a1700 1 -- 172.21.15.59:0/287352002 shutdown_connections 2023-09-30T22:36:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.888+0000 7f7eb67a1700 1 --2- 172.21.15.59:0/287352002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0870 0x7f7eb00a0c40 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.888+0000 7f7eb67a1700 1 --2- 172.21.15.59:0/287352002 >> v2:172.21.15.59:3300/0 conn(0x7f7eb00a1180 0x7f7eb0133790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.888+0000 7f7eb67a1700 1 -- 172.21.15.59:0/287352002 >> 172.21.15.59:0/287352002 conn(0x7f7eb00a6390 msgr2=0x7f7eb00a6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.888+0000 7f7eb67a1700 1 -- 172.21.15.59:0/287352002 shutdown_connections 2023-09-30T22:36:16.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.888+0000 7f7eb67a1700 1 -- 172.21.15.59:0/287352002 wait complete. 2023-09-30T22:36:16.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.890+0000 7f7eb67a1700 1 Processor -- start 2023-09-30T22:36:16.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.890+0000 7f7eb67a1700 1 -- start start 2023-09-30T22:36:16.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb67a1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb00a0870 0x7f7eb0122010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:16.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb67a1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb00a1180 0x7f7eb0122550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:16.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb67a1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a15b0 0x7f7eb0122a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:16.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb67a1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0124a30 con 0x7f7eb00a1180 2023-09-30T22:36:16.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb67a1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0123d10 con 0x7f7eb00a15b0 2023-09-30T22:36:16.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb67a1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0125500 con 0x7f7eb00a0870 2023-09-30T22:36:16.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb4f9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb00a1180 0x7f7eb0122550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb579f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb00a0870 0x7f7eb0122010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb5fa0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a15b0 0x7f7eb0122a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb4f9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb00a1180 0x7f7eb0122550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55374/0 (socket says 172.21.15.59:55374) 2023-09-30T22:36:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb579f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb00a0870 0x7f7eb0122010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32792/0 (socket says 172.21.15.59:32792) 2023-09-30T22:36:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb4f9e700 1 -- 172.21.15.59:0/2693266482 learned_addr learned my addr 172.21.15.59:0/2693266482 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb5fa0700 1 -- 172.21.15.59:0/2693266482 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb00a0870 msgr2=0x7f7eb0122010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb5fa0700 1 --2- 172.21.15.59:0/2693266482 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb00a0870 0x7f7eb0122010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb5fa0700 1 -- 172.21.15.59:0/2693266482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb00a1180 msgr2=0x7f7eb0122550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb5fa0700 1 --2- 172.21.15.59:0/2693266482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb00a1180 0x7f7eb0122550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb5fa0700 1 -- 172.21.15.59:0/2693266482 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4009550 con 0x7f7eb00a15b0 2023-09-30T22:36:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb4f9e700 1 --2- 172.21.15.59:0/2693266482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb00a1180 0x7f7eb0122550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eb5fa0700 1 --2- 172.21.15.59:0/2693266482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a15b0 0x7f7eb0122a90 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7ea800cb90 tx=0x7f7ea800cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:16.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.891+0000 7f7eadffb700 1 -- 172.21.15.59:0/2693266482 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8003c00 con 0x7f7eb00a15b0 2023-09-30T22:36:16.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.892+0000 7f7eadffb700 1 -- 172.21.15.59:0/2693266482 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea8003d60 con 0x7f7eb00a15b0 2023-09-30T22:36:16.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.892+0000 7f7eb67a1700 1 -- 172.21.15.59:0/2693266482 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea00094a0 con 0x7f7eb00a15b0 2023-09-30T22:36:16.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.892+0000 7f7eadffb700 1 -- 172.21.15.59:0/2693266482 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea800aa80 con 0x7f7eb00a15b0 2023-09-30T22:36:16.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.892+0000 7f7eb67a1700 1 -- 172.21.15.59:0/2693266482 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb0125aa0 con 0x7f7eb00a15b0 2023-09-30T22:36:16.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.893+0000 7f7eadffb700 1 -- 172.21.15.59:0/2693266482 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ea800abe0 con 0x7f7eb00a15b0 2023-09-30T22:36:16.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.893+0000 7f7eb67a1700 1 -- 172.21.15.59:0/2693266482 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb011edd0 con 0x7f7eb00a15b0 2023-09-30T22:36:16.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.893+0000 7f7eadffb700 1 -- 172.21.15.59:0/2693266482 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7ea803f5e0 con 0x7f7eb00a15b0 2023-09-30T22:36:16.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:16.902+0000 7f7eadffb700 1 -- 172.21.15.59:0/2693266482 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ea80106f0 con 0x7f7eb00a15b0 2023-09-30T22:36:17.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.070+0000 7fc4e2b26700 1 -- 172.21.15.59:0/3600819392 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc4dc074ea0 con 0x7fc4dc0a0a30 2023-09-30T22:36:17.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.070+0000 7fc4d97fa700 1 -- 172.21.15.59:0/3600819392 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc4cc017020 con 0x7fc4dc0a0a30 2023-09-30T22:36:17.070 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:17.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.073+0000 7fc4e2b26700 1 -- 172.21.15.59:0/3600819392 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4dc0a0a30 msgr2=0x7fc4dc11e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.073+0000 7fc4e2b26700 1 --2- 172.21.15.59:0/3600819392 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4dc0a0a30 0x7fc4dc11e700 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00ebe0 tx=0x7fc4cc00eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.073+0000 7fc4e2b26700 1 -- 172.21.15.59:0/3600819392 shutdown_connections 2023-09-30T22:36:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.073+0000 7fc4e2b26700 1 --2- 172.21.15.59:0/3600819392 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4dc0a0a30 0x7fc4dc11e700 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.073+0000 7fc4e2b26700 1 --2- 172.21.15.59:0/3600819392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4dc134170 0x7fc4dc11f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.073+0000 7fc4e2b26700 1 --2- 172.21.15.59:0/3600819392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4dc0a1340 0x7fc4dc11ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.073+0000 7fc4e2b26700 1 -- 172.21.15.59:0/3600819392 >> 172.21.15.59:0/3600819392 conn(0x7fc4dc0a6550 msgr2=0x7fc4dc09c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.073+0000 7fc4e2b26700 1 -- 172.21.15.59:0/3600819392 shutdown_connections 2023-09-30T22:36:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.074+0000 7fc4e2b26700 1 -- 172.21.15.59:0/3600819392 wait complete. 2023-09-30T22:36:17.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:17.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.116+0000 7f7eb67a1700 1 -- 172.21.15.59:0/2693266482 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7eb0125700 con 0x7f7eb00a15b0 2023-09-30T22:36:17.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.116+0000 7f7eadffb700 1 -- 172.21.15.59:0/2693266482 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7eb0125700 con 0x7f7eb00a15b0 2023-09-30T22:36:17.116 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:17.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.118+0000 7f7eb67a1700 1 -- 172.21.15.59:0/2693266482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a15b0 msgr2=0x7f7eb0122a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:17.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.118+0000 7f7eb67a1700 1 --2- 172.21.15.59:0/2693266482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a15b0 0x7f7eb0122a90 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7ea800cb90 tx=0x7f7ea800cea0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.118+0000 7f7eb67a1700 1 -- 172.21.15.59:0/2693266482 shutdown_connections 2023-09-30T22:36:17.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.118+0000 7f7eb67a1700 1 --2- 172.21.15.59:0/2693266482 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb00a0870 0x7f7eb0122010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.118+0000 7f7eb67a1700 1 --2- 172.21.15.59:0/2693266482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a15b0 0x7f7eb0122a90 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.118+0000 7f7eb67a1700 1 --2- 172.21.15.59:0/2693266482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb00a1180 0x7f7eb0122550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.118+0000 7f7eb67a1700 1 -- 172.21.15.59:0/2693266482 >> 172.21.15.59:0/2693266482 conn(0x7f7eb00a6390 msgr2=0x7f7eb0133bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:17.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.119+0000 7f7eb67a1700 1 -- 172.21.15.59:0/2693266482 shutdown_connections 2023-09-30T22:36:17.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.119+0000 7f7eb67a1700 1 -- 172.21.15.59:0/2693266482 wait complete. 2023-09-30T22:36:17.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:17.139 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:17.183 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:17.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.314+0000 7f68bad8c700 1 Processor -- start 2023-09-30T22:36:17.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.314+0000 7f68bad8c700 1 -- start start 2023-09-30T22:36:17.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.315+0000 7f68bad8c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68b409e930 0x7f68b409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:17.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.315+0000 7f68bad8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b409f240 0x7f68b41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:17.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.315+0000 7f68bad8c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b409f650 0x7f68b4131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:17.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.315+0000 7f68bad8c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b4070940 con 0x7f68b409e930 2023-09-30T22:36:17.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.315+0000 7f68bad8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b406fd60 con 0x7f68b409f240 2023-09-30T22:36:17.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.315+0000 7f68bad8c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68b406fa80 con 0x7f68b409f650 2023-09-30T22:36:17.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.315+0000 7f68b8b28700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68b409e930 0x7f68b409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:17.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.315+0000 7f68b3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b409f240 0x7f68b41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:17.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.315+0000 7f68b8b28700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68b409e930 0x7f68b409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55386/0 (socket says 172.21.15.59:55386) 2023-09-30T22:36:17.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.315+0000 7f68b8b28700 1 -- 172.21.15.59:0/1585681170 learned_addr learned my addr 172.21.15.59:0/1585681170 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:17.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.315+0000 7f68b3fff700 1 --2- 172.21.15.59:0/1585681170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b409f240 0x7f68b41317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56392/0 (socket says 172.21.15.59:56392) 2023-09-30T22:36:17.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.315+0000 7f68b9329700 1 --2- 172.21.15.59:0/1585681170 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b409f650 0x7f68b4131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:17.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.316+0000 7f68b8b28700 1 -- 172.21.15.59:0/1585681170 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b409f650 msgr2=0x7f68b4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:17.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.316+0000 7f68b8b28700 1 --2- 172.21.15.59:0/1585681170 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b409f650 0x7f68b4131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.316+0000 7f68b8b28700 1 -- 172.21.15.59:0/1585681170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b409f240 msgr2=0x7f68b41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:17.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.316+0000 7f68b8b28700 1 --2- 172.21.15.59:0/1585681170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b409f240 0x7f68b41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.316+0000 7f68b8b28700 1 -- 172.21.15.59:0/1585681170 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b409fb60 con 0x7f68b409e930 2023-09-30T22:36:17.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.316+0000 7f68b8b28700 1 --2- 172.21.15.59:0/1585681170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b409e930 0x7f68b409ed00 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f68a40098f0 tx=0x7f68a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1d18b0fa0f89f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:17.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.316+0000 7f68b37fe700 1 -- 172.21.15.59:0/1585681170 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a4011830 con 0x7f68b409e930 2023-09-30T22:36:17.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.316+0000 7f68b37fe700 1 -- 172.21.15.59:0/1585681170 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a4011990 con 0x7f68b409e930 2023-09-30T22:36:17.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.316+0000 7f68b37fe700 1 -- 172.21.15.59:0/1585681170 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a4011d20 con 0x7f68b409e930 2023-09-30T22:36:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.317+0000 7f68bad8c700 1 -- 172.21.15.59:0/1585681170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b409e930 msgr2=0x7f68b409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.317+0000 7f68bad8c700 1 --2- 172.21.15.59:0/1585681170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b409e930 0x7f68b409ed00 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f68a40098f0 tx=0x7f68a4009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.317+0000 7f68bad8c700 1 -- 172.21.15.59:0/1585681170 shutdown_connections 2023-09-30T22:36:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.317+0000 7f68bad8c700 1 --2- 172.21.15.59:0/1585681170 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b409f650 0x7f68b4131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.317+0000 7f68bad8c700 1 --2- 172.21.15.59:0/1585681170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b409e930 0x7f68b409ed00 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.317+0000 7f68bad8c700 1 --2- 172.21.15.59:0/1585681170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b409f240 0x7f68b41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.317+0000 7f68bad8c700 1 -- 172.21.15.59:0/1585681170 >> 172.21.15.59:0/1585681170 conn(0x7f68b40a4210 msgr2=0x7f68b40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.317+0000 7f68bad8c700 1 -- 172.21.15.59:0/1585681170 shutdown_connections 2023-09-30T22:36:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.317+0000 7f68bad8c700 1 -- 172.21.15.59:0/1585681170 wait complete. 2023-09-30T22:36:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.318+0000 7f68bad8c700 1 Processor -- start 2023-09-30T22:36:17.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.318+0000 7f68bad8c700 1 -- start start 2023-09-30T22:36:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.319+0000 7f68bad8c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b409e930 0x7f68b406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.319+0000 7f68bad8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b409f240 0x7f68b406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.319+0000 7f68bad8c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b409f650 0x7f68b406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.319+0000 7f68bad8c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b406cd10 con 0x7f68b409e930 2023-09-30T22:36:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.319+0000 7f68bad8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40a3550 con 0x7f68b409f240 2023-09-30T22:36:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.319+0000 7f68bad8c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68b41a8fb0 con 0x7f68b409f650 2023-09-30T22:36:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.319+0000 7f68b9329700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b409f650 0x7f68b406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.319+0000 7f68b8b28700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b409e930 0x7f68b406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.319+0000 7f68b3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b409f240 0x7f68b406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.319+0000 7f68b9329700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b409f650 0x7f68b406c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32812/0 (socket says 172.21.15.59:32812) 2023-09-30T22:36:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.319+0000 7f68b8b28700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b409e930 0x7f68b406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55388/0 (socket says 172.21.15.59:55388) 2023-09-30T22:36:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.319+0000 7f68b9329700 1 -- 172.21.15.59:0/96183040 learned_addr learned my addr 172.21.15.59:0/96183040 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.320+0000 7f68b8b28700 1 -- 172.21.15.59:0/96183040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b409f650 msgr2=0x7f68b406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.320+0000 7f68b8b28700 1 --2- 172.21.15.59:0/96183040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b409f650 0x7f68b406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.320+0000 7f68b8b28700 1 -- 172.21.15.59:0/96183040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b409f240 msgr2=0x7f68b406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.320+0000 7f68b8b28700 1 --2- 172.21.15.59:0/96183040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b409f240 0x7f68b406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.320+0000 7f68b8b28700 1 -- 172.21.15.59:0/96183040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a4009550 con 0x7f68b409e930 2023-09-30T22:36:17.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.320+0000 7f68b8b28700 1 --2- 172.21.15.59:0/96183040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b409e930 0x7f68b406b8b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f68a4016000 tx=0x7f68a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:17.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.320+0000 7f68b17fa700 1 -- 172.21.15.59:0/96183040 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a4004240 con 0x7f68b409e930 2023-09-30T22:36:17.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.320+0000 7f68bad8c700 1 -- 172.21.15.59:0/96183040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b40a0190 con 0x7f68b409e930 2023-09-30T22:36:17.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.320+0000 7f68bad8c700 1 -- 172.21.15.59:0/96183040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b41a8b80 con 0x7f68b409e930 2023-09-30T22:36:17.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.320+0000 7f68b17fa700 1 -- 172.21.15.59:0/96183040 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a401f070 con 0x7f68b409e930 2023-09-30T22:36:17.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.320+0000 7f68b17fa700 1 -- 172.21.15.59:0/96183040 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a40045a0 con 0x7f68b409e930 2023-09-30T22:36:17.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.321+0000 7f68b17fa700 1 -- 172.21.15.59:0/96183040 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68a4021030 con 0x7f68b409e930 2023-09-30T22:36:17.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.321+0000 7f68b17fa700 1 -- 172.21.15.59:0/96183040 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f68a4040b30 con 0x7f68b409e930 2023-09-30T22:36:17.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.322+0000 7f68bad8c700 1 -- 172.21.15.59:0/96183040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68940052e0 con 0x7f68b409e930 2023-09-30T22:36:17.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.326+0000 7f68b17fa700 1 -- 172.21.15.59:0/96183040 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68a4015080 con 0x7f68b409e930 2023-09-30T22:36:17.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.356+0000 7f61b5e07700 1 Processor -- start 2023-09-30T22:36:17.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.356+0000 7f61b5e07700 1 -- start start 2023-09-30T22:36:17.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.356+0000 7f61b5e07700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b00a0a30 0x7f61b00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:17.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.356+0000 7f61b5e07700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b009d630 0x7f61b00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:17.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.356+0000 7f61b5e07700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b00a2a70 con 0x7f61b0133930 2023-09-30T22:36:17.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.356+0000 7f61b5e07700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b00a01d0 con 0x7f61b009d630 2023-09-30T22:36:17.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.356+0000 7f61b5e07700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61b009e2b0 con 0x7f61b00a0a30 2023-09-30T22:36:17.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.357+0000 7f61aeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b009d630 0x7f61b00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:17.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.357+0000 7f61affff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f61b0133930 0x7f61b0133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41258/0 (socket says 172.21.15.59:41258) 2023-09-30T22:36:17.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.357+0000 7f61affff700 1 -- 172.21.15.59:0/480488795 learned_addr learned my addr 172.21.15.59:0/480488795 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:17.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.357+0000 7f61af7fe700 1 --2- 172.21.15.59:0/480488795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b00a0a30 0x7f61b00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:17.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.357+0000 7f61ae7fc700 1 -- 172.21.15.59:0/480488795 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566948678 0 0) 0x7f61b00a2a70 con 0x7f61b0133930 2023-09-30T22:36:17.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.357+0000 7f61ae7fc700 1 -- 172.21.15.59:0/480488795 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61980035b0 con 0x7f61b0133930 2023-09-30T22:36:17.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.357+0000 7f61aeffd700 1 -- 172.21.15.59:0/480488795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b00a0a30 msgr2=0x7f61b00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:17.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.357+0000 7f61aeffd700 1 --2- 172.21.15.59:0/480488795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b00a0a30 0x7f61b00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.357+0000 7f61aeffd700 1 -- 172.21.15.59:0/480488795 >> v1:172.21.15.59:6789/0 conn(0x7f61b0133930 legacy=0x7f61b0133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:17.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.357+0000 7f61aeffd700 1 -- 172.21.15.59:0/480488795 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b009dc50 con 0x7f61b009d630 2023-09-30T22:36:17.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.357+0000 7f61af7fe700 1 --2- 172.21.15.59:0/480488795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b00a0a30 0x7f61b00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:17.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.357+0000 7f61aeffd700 1 --2- 172.21.15.59:0/480488795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b009d630 0x7f61b00a1340 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009870 tx=0x7f61a4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba3b660fba687cd8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:17.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.357+0000 7f61ae7fc700 1 -- 172.21.15.59:0/480488795 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4011830 con 0x7f61b009d630 2023-09-30T22:36:17.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.357+0000 7f61ae7fc700 1 -- 172.21.15.59:0/480488795 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a4011990 con 0x7f61b009d630 2023-09-30T22:36:17.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.357+0000 7f61ae7fc700 1 -- 172.21.15.59:0/480488795 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4011d20 con 0x7f61b009d630 2023-09-30T22:36:17.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.358+0000 7f61b5e07700 1 -- 172.21.15.59:0/480488795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b009d630 msgr2=0x7f61b00a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:17.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.358+0000 7f61b5e07700 1 --2- 172.21.15.59:0/480488795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b009d630 0x7f61b00a1340 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009870 tx=0x7f61a4009b80 comp rx=0 tx=0).stop 2023-09-30T22:36:17.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.358+0000 7f61b5e07700 1 -- 172.21.15.59:0/480488795 shutdown_connections 2023-09-30T22:36:17.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.358+0000 7f61b5e07700 1 --2- 172.21.15.59:0/480488795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b00a0a30 0x7f61b00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.358+0000 7f61b5e07700 1 --2- 172.21.15.59:0/480488795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b009d630 0x7f61b00a1340 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.358+0000 7f61b5e07700 1 -- 172.21.15.59:0/480488795 >> 172.21.15.59:0/480488795 conn(0x7f61b00a3050 msgr2=0x7f61b00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:17.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.358+0000 7f61b5e07700 1 -- 172.21.15.59:0/480488795 shutdown_connections 2023-09-30T22:36:17.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.358+0000 7f61b5e07700 1 -- 172.21.15.59:0/480488795 wait complete. 2023-09-30T22:36:17.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.359+0000 7f61b5e07700 1 Processor -- start 2023-09-30T22:36:17.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.359+0000 7f61b5e07700 1 -- start start 2023-09-30T22:36:17.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61b5e07700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b009d630 0x7f61b01c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:17.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61b5e07700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b00a0a30 0x7f61b01c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:17.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61b5e07700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b0133930 0x7f61b01c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:17.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61b5e07700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0121140 con 0x7f61b00a0a30 2023-09-30T22:36:17.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61b5e07700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b00a5410 con 0x7f61b009d630 2023-09-30T22:36:17.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61b5e07700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0120570 con 0x7f61b0133930 2023-09-30T22:36:17.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61af7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b009d630 0x7f61b01c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:17.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61af7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b009d630 0x7f61b01c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56412/0 (socket says 172.21.15.59:56412) 2023-09-30T22:36:17.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61affff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b0133930 0x7f61b01c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:17.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61af7fe700 1 -- 172.21.15.59:0/3152164587 learned_addr learned my addr 172.21.15.59:0/3152164587 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:17.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61aeffd700 1 --2- 172.21.15.59:0/3152164587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b00a0a30 0x7f61b01c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:17.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61af7fe700 1 -- 172.21.15.59:0/3152164587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b0133930 msgr2=0x7f61b01c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:17.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61af7fe700 1 --2- 172.21.15.59:0/3152164587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b0133930 0x7f61b01c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61af7fe700 1 -- 172.21.15.59:0/3152164587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b00a0a30 msgr2=0x7f61b01c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:17.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61af7fe700 1 --2- 172.21.15.59:0/3152164587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b00a0a30 0x7f61b01c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61af7fe700 1 -- 172.21.15.59:0/3152164587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a0009a70 con 0x7f61b009d630 2023-09-30T22:36:17.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61aeffd700 1 --2- 172.21.15.59:0/3152164587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b00a0a30 0x7f61b01c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:17.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.360+0000 7f61af7fe700 1 --2- 172.21.15.59:0/3152164587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b009d630 0x7f61b01c7e80 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f61a000efc0 tx=0x7f61a000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:17.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.361+0000 7f6197fff700 1 -- 172.21.15.59:0/3152164587 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a000cdd0 con 0x7f61b009d630 2023-09-30T22:36:17.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.361+0000 7f6197fff700 1 -- 172.21.15.59:0/3152164587 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a000f040 con 0x7f61b009d630 2023-09-30T22:36:17.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.361+0000 7f61b5e07700 1 -- 172.21.15.59:0/3152164587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a40094a0 con 0x7f61b009d630 2023-09-30T22:36:17.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.361+0000 7f6197fff700 1 -- 172.21.15.59:0/3152164587 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a00146a0 con 0x7f61b009d630 2023-09-30T22:36:17.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.361+0000 7f61b5e07700 1 -- 172.21.15.59:0/3152164587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b0133300 con 0x7f61b009d630 2023-09-30T22:36:17.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.362+0000 7f6197fff700 1 -- 172.21.15.59:0/3152164587 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61a0014800 con 0x7f61b009d630 2023-09-30T22:36:17.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.362+0000 7f6197fff700 1 -- 172.21.15.59:0/3152164587 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f61a00403a0 con 0x7f61b009d630 2023-09-30T22:36:17.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.362+0000 7f61b5e07700 1 -- 172.21.15.59:0/3152164587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b0121fd0 con 0x7f61b009d630 2023-09-30T22:36:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.367+0000 7f6197fff700 1 -- 172.21.15.59:0/3152164587 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61a001d400 con 0x7f61b009d630 2023-09-30T22:36:17.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.535+0000 7f68bad8c700 1 -- 172.21.15.59:0/96183040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6894005590 con 0x7f68b409e930 2023-09-30T22:36:17.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.535+0000 7f68b17fa700 1 -- 172.21.15.59:0/96183040 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68a40199a0 con 0x7f68b409e930 2023-09-30T22:36:17.536 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:17.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.538+0000 7f68bad8c700 1 -- 172.21.15.59:0/96183040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b409e930 msgr2=0x7f68b406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:17.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.538+0000 7f68bad8c700 1 --2- 172.21.15.59:0/96183040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b409e930 0x7f68b406b8b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f68a4016000 tx=0x7f68a4004750 comp rx=0 tx=0).stop 2023-09-30T22:36:17.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.538+0000 7f68bad8c700 1 -- 172.21.15.59:0/96183040 shutdown_connections 2023-09-30T22:36:17.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.538+0000 7f68bad8c700 1 --2- 172.21.15.59:0/96183040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b409f650 0x7f68b406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.538+0000 7f68bad8c700 1 --2- 172.21.15.59:0/96183040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b409e930 0x7f68b406b8b0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.538+0000 7f68bad8c700 1 --2- 172.21.15.59:0/96183040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b409f240 0x7f68b406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.538+0000 7f68bad8c700 1 -- 172.21.15.59:0/96183040 >> 172.21.15.59:0/96183040 conn(0x7f68b40a4210 msgr2=0x7f68b41b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:17.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.538+0000 7f68bad8c700 1 -- 172.21.15.59:0/96183040 shutdown_connections 2023-09-30T22:36:17.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.538+0000 7f68bad8c700 1 -- 172.21.15.59:0/96183040 wait complete. 2023-09-30T22:36:17.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:17.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.574+0000 7f61b5e07700 1 -- 172.21.15.59:0/3152164587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f61b00747f0 con 0x7f61b009d630 2023-09-30T22:36:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.574+0000 7f6197fff700 1 -- 172.21.15.59:0/3152164587 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61a002c090 con 0x7f61b009d630 2023-09-30T22:36:17.575 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.577+0000 7f61b5e07700 1 -- 172.21.15.59:0/3152164587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b009d630 msgr2=0x7f61b01c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.577+0000 7f61b5e07700 1 --2- 172.21.15.59:0/3152164587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b009d630 0x7f61b01c7e80 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f61a000efc0 tx=0x7f61a000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.577+0000 7f61b5e07700 1 -- 172.21.15.59:0/3152164587 shutdown_connections 2023-09-30T22:36:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.577+0000 7f61b5e07700 1 --2- 172.21.15.59:0/3152164587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b0133930 0x7f61b01c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.577+0000 7f61b5e07700 1 --2- 172.21.15.59:0/3152164587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b009d630 0x7f61b01c7e80 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.577+0000 7f61b5e07700 1 --2- 172.21.15.59:0/3152164587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b00a0a30 0x7f61b01c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.577+0000 7f61b5e07700 1 -- 172.21.15.59:0/3152164587 >> 172.21.15.59:0/3152164587 conn(0x7f61b00a3050 msgr2=0x7f61b01bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.577+0000 7f61b5e07700 1 -- 172.21.15.59:0/3152164587 shutdown_connections 2023-09-30T22:36:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:17.577+0000 7f61b5e07700 1 -- 172.21.15.59:0/3152164587 wait complete. 2023-09-30T22:36:17.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:18.093 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:18.133 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:18.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.242+0000 7f7ed498c700 1 Processor -- start 2023-09-30T22:36:18.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.242+0000 7f7ed498c700 1 -- start start 2023-09-30T22:36:18.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ed498c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ed00a0a30 0x7f7ed00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ed498c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7ed009d630 0x7f7ed00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ed498c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ed0133930 0x7f7ed0133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ed498c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed00a2a70 con 0x7f7ed009d630 2023-09-30T22:36:18.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ed498c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed00a01d0 con 0x7f7ed0133930 2023-09-30T22:36:18.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ed498c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed009e2b0 con 0x7f7ed00a0a30 2023-09-30T22:36:18.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ece59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ed00a0a30 0x7f7ed00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ece59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ed00a0a30 0x7f7ed00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32844/0 (socket says 172.21.15.59:32844) 2023-09-30T22:36:18.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ece59c700 1 -- 172.21.15.59:0/2928029312 learned_addr learned my addr 172.21.15.59:0/2928029312 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:18.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7eced9d700 1 --2- 172.21.15.59:0/2928029312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ed0133930 0x7f7ed0133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ecdd9b700 1 --2- 172.21.15.59:0/2928029312 >> v2:172.21.15.59:3300/0 conn(0x7f7ed009d630 0x7f7ed00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ece59c700 1 -- 172.21.15.59:0/2928029312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ed0133930 msgr2=0x7f7ed0133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:18.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ece59c700 1 --2- 172.21.15.59:0/2928029312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ed0133930 0x7f7ed0133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ece59c700 1 -- 172.21.15.59:0/2928029312 >> v2:172.21.15.59:3300/0 conn(0x7f7ed009d630 msgr2=0x7f7ed00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:18.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ece59c700 1 --2- 172.21.15.59:0/2928029312 >> v2:172.21.15.59:3300/0 conn(0x7f7ed009d630 0x7f7ed00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ece59c700 1 -- 172.21.15.59:0/2928029312 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed009dc50 con 0x7f7ed00a0a30 2023-09-30T22:36:18.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7eced9d700 1 --2- 172.21.15.59:0/2928029312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ed0133930 0x7f7ed0133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:18.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.243+0000 7f7ecdd9b700 1 --2- 172.21.15.59:0/2928029312 >> v2:172.21.15.59:3300/0 conn(0x7f7ed009d630 0x7f7ed00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:18.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.244+0000 7f7ece59c700 1 --2- 172.21.15.59:0/2928029312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ed00a0a30 0x7f7ed00a0e00 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009e50 tx=0x7f7ec000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdad9333a682f8c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:18.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.244+0000 7f7ecd59a700 1 -- 172.21.15.59:0/2928029312 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec000e070 con 0x7f7ed00a0a30 2023-09-30T22:36:18.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.244+0000 7f7ecd59a700 1 -- 172.21.15.59:0/2928029312 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec000b910 con 0x7f7ed00a0a30 2023-09-30T22:36:18.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.244+0000 7f7ecd59a700 1 -- 172.21.15.59:0/2928029312 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec000bcc0 con 0x7f7ed00a0a30 2023-09-30T22:36:18.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.244+0000 7f7ed498c700 1 -- 172.21.15.59:0/2928029312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ed00a0a30 msgr2=0x7f7ed00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.244+0000 7f7ed498c700 1 --2- 172.21.15.59:0/2928029312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ed00a0a30 0x7f7ed00a0e00 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009e50 tx=0x7f7ec000b330 comp rx=0 tx=0).stop 2023-09-30T22:36:18.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.245+0000 7f7ed498c700 1 -- 172.21.15.59:0/2928029312 shutdown_connections 2023-09-30T22:36:18.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.245+0000 7f7ed498c700 1 --2- 172.21.15.59:0/2928029312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ed0133930 0x7f7ed0133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.245+0000 7f7ed498c700 1 --2- 172.21.15.59:0/2928029312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ed00a0a30 0x7f7ed00a0e00 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.245+0000 7f7ed498c700 1 --2- 172.21.15.59:0/2928029312 >> v2:172.21.15.59:3300/0 conn(0x7f7ed009d630 0x7f7ed00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.245+0000 7f7ed498c700 1 -- 172.21.15.59:0/2928029312 >> 172.21.15.59:0/2928029312 conn(0x7f7ed00a3050 msgr2=0x7f7ed00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.245+0000 7f7ed498c700 1 -- 172.21.15.59:0/2928029312 shutdown_connections 2023-09-30T22:36:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.245+0000 7f7ed498c700 1 -- 172.21.15.59:0/2928029312 wait complete. 2023-09-30T22:36:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.246+0000 7f7ed498c700 1 Processor -- start 2023-09-30T22:36:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.246+0000 7f7ed498c700 1 -- start start 2023-09-30T22:36:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.246+0000 7f7ed498c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ed009d630 0x7f7ed011f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.246+0000 7f7ed498c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ed00a0a30 0x7f7ed011f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.246+0000 7f7ed498c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ed0133930 0x7f7ed01c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.246+0000 7f7ed498c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed0120940 con 0x7f7ed00a0a30 2023-09-30T22:36:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.246+0000 7f7ed498c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed0120750 con 0x7f7ed0133930 2023-09-30T22:36:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.246+0000 7f7ed498c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed01334d0 con 0x7f7ed009d630 2023-09-30T22:36:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.246+0000 7f7ecdd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ed00a0a30 0x7f7ed011f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.246+0000 7f7ecdd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ed00a0a30 0x7f7ed011f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55424/0 (socket says 172.21.15.59:55424) 2023-09-30T22:36:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.246+0000 7f7ecdd9b700 1 -- 172.21.15.59:0/4051708606 learned_addr learned my addr 172.21.15.59:0/4051708606 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.246+0000 7f7ece59c700 1 --2- 172.21.15.59:0/4051708606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ed009d630 0x7f7ed011f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.247+0000 7f7eced9d700 1 --2- 172.21.15.59:0/4051708606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ed0133930 0x7f7ed01c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.247+0000 7f7ece59c700 1 -- 172.21.15.59:0/4051708606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ed0133930 msgr2=0x7f7ed01c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.247+0000 7f7ece59c700 1 --2- 172.21.15.59:0/4051708606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ed0133930 0x7f7ed01c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.247+0000 7f7ece59c700 1 -- 172.21.15.59:0/4051708606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ed00a0a30 msgr2=0x7f7ed011f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.247+0000 7f7ece59c700 1 --2- 172.21.15.59:0/4051708606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ed00a0a30 0x7f7ed011f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.247+0000 7f7ece59c700 1 -- 172.21.15.59:0/4051708606 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec40094a0 con 0x7f7ed009d630 2023-09-30T22:36:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.247+0000 7f7ecdd9b700 1 --2- 172.21.15.59:0/4051708606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ed00a0a30 0x7f7ed011f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.247+0000 7f7ece59c700 1 --2- 172.21.15.59:0/4051708606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ed009d630 0x7f7ed011f480 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0015000 tx=0x7f7ec0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.247+0000 7f7ebeffd700 1 -- 172.21.15.59:0/4051708606 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec000cea0 con 0x7f7ed009d630 2023-09-30T22:36:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.247+0000 7f7ebeffd700 1 -- 172.21.15.59:0/4051708606 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec0004250 con 0x7f7ed009d630 2023-09-30T22:36:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.247+0000 7f7ed498c700 1 -- 172.21.15.59:0/4051708606 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec80094a0 con 0x7f7ed009d630 2023-09-30T22:36:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.247+0000 7f7ebeffd700 1 -- 172.21.15.59:0/4051708606 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0004600 con 0x7f7ed009d630 2023-09-30T22:36:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.247+0000 7f7ed498c700 1 -- 172.21.15.59:0/4051708606 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec0009b30 con 0x7f7ed009d630 2023-09-30T22:36:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.248+0000 7f7ed498c700 1 -- 172.21.15.59:0/4051708606 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed00a0470 con 0x7f7ed009d630 2023-09-30T22:36:18.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.249+0000 7f7ebeffd700 1 -- 172.21.15.59:0/4051708606 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ec0004760 con 0x7f7ed009d630 2023-09-30T22:36:18.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.249+0000 7f7ebeffd700 1 -- 172.21.15.59:0/4051708606 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7ec0040ed0 con 0x7f7ed009d630 2023-09-30T22:36:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.253+0000 7f7ebeffd700 1 -- 172.21.15.59:0/4051708606 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ec0011b40 con 0x7f7ed009d630 2023-09-30T22:36:18.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.281+0000 7fcd2f6fc700 1 Processor -- start 2023-09-30T22:36:18.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.281+0000 7fcd2f6fc700 1 -- start start 2023-09-30T22:36:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.282+0000 7fcd2f6fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809f410 0x7fcd28136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.282+0000 7fcd2f6fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd28136fe0 0x7fcd281393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.282+0000 7fcd2f6fc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd28070940 con 0x7fcd2809e930 2023-09-30T22:36:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.282+0000 7fcd2f6fc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2806fd60 con 0x7fcd28136fe0 2023-09-30T22:36:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.282+0000 7fcd2f6fc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2806fa80 con 0x7fcd2809f410 2023-09-30T22:36:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.282+0000 7fcd2cc97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809f410 0x7fcd28136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.282+0000 7fcd2cc97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809f410 0x7fcd28136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56440/0 (socket says 172.21.15.59:56440) 2023-09-30T22:36:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.282+0000 7fcd2cc97700 1 -- 172.21.15.59:0/1275233751 learned_addr learned my addr 172.21.15.59:0/1275233751 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.282+0000 7fcd2dc99700 1 --2- 172.21.15.59:0/1275233751 >> v2:172.21.15.59:3300/0 conn(0x7fcd28136fe0 0x7fcd281393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.282+0000 7fcd2dc99700 1 -- 172.21.15.59:0/1275233751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809f410 msgr2=0x7fcd28136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.282+0000 7fcd2dc99700 1 --2- 172.21.15.59:0/1275233751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809f410 0x7fcd28136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.282+0000 7fcd2dc99700 1 -- 172.21.15.59:0/1275233751 >> v1:172.21.15.59:6789/0 conn(0x7fcd2809e930 legacy=0x7fcd2809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.282+0000 7fcd2dc99700 1 -- 172.21.15.59:0/1275233751 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2809fb60 con 0x7fcd28136fe0 2023-09-30T22:36:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.282+0000 7fcd1bfff700 1 -- 172.21.15.59:0/1275233751 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321279927 0 0) 0x7fcd28070940 con 0x7fcd2809e930 2023-09-30T22:36:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.282+0000 7fcd2cc97700 1 --2- 172.21.15.59:0/1275233751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809f410 0x7fcd28136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.283+0000 7fcd2dc99700 1 --2- 172.21.15.59:0/1275233751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd28136fe0 0x7fcd281393c0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009d90 tx=0x7fcd2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13298981cb8a6e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.283+0000 7fcd1bfff700 1 -- 172.21.15.59:0/1275233751 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2000e070 con 0x7fcd28136fe0 2023-09-30T22:36:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.283+0000 7fcd1bfff700 1 -- 172.21.15.59:0/1275233751 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2000bb20 con 0x7fcd28136fe0 2023-09-30T22:36:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.283+0000 7fcd1bfff700 1 -- 172.21.15.59:0/1275233751 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20012430 con 0x7fcd28136fe0 2023-09-30T22:36:18.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.283+0000 7fcd2f6fc700 1 -- 172.21.15.59:0/1275233751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd28136fe0 msgr2=0x7fcd281393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.283+0000 7fcd2f6fc700 1 --2- 172.21.15.59:0/1275233751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd28136fe0 0x7fcd281393c0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009d90 tx=0x7fcd2000b330 comp rx=0 tx=0).stop 2023-09-30T22:36:18.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.283+0000 7fcd2f6fc700 1 -- 172.21.15.59:0/1275233751 shutdown_connections 2023-09-30T22:36:18.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.283+0000 7fcd2f6fc700 1 --2- 172.21.15.59:0/1275233751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd28136fe0 0x7fcd281393c0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.283+0000 7fcd2f6fc700 1 --2- 172.21.15.59:0/1275233751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809f410 0x7fcd28136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.283+0000 7fcd2f6fc700 1 -- 172.21.15.59:0/1275233751 >> 172.21.15.59:0/1275233751 conn(0x7fcd280a4210 msgr2=0x7fcd280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:18.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.283+0000 7fcd2f6fc700 1 -- 172.21.15.59:0/1275233751 shutdown_connections 2023-09-30T22:36:18.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.284+0000 7fcd2f6fc700 1 -- 172.21.15.59:0/1275233751 wait complete. 2023-09-30T22:36:18.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.284+0000 7fcd2f6fc700 1 Processor -- start 2023-09-30T22:36:18.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2f6fc700 1 -- start start 2023-09-30T22:36:18.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2f6fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809e930 0x7fcd2811e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2f6fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2809f410 0x7fcd2811ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2f6fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd28136fe0 0x7fcd2811f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2f6fc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd28120590 con 0x7fcd2809f410 2023-09-30T22:36:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2f6fc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd281346f0 con 0x7fcd2809e930 2023-09-30T22:36:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2f6fc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd28122320 con 0x7fcd28136fe0 2023-09-30T22:36:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2cc97700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2809f410 0x7fcd2811ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2cc97700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2809f410 0x7fcd2811ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55440/0 (socket says 172.21.15.59:55440) 2023-09-30T22:36:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2d498700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809e930 0x7fcd2811e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2cc97700 1 -- 172.21.15.59:0/2070723880 learned_addr learned my addr 172.21.15.59:0/2070723880 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2dc99700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd28136fe0 0x7fcd2811f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2cc97700 1 -- 172.21.15.59:0/2070723880 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd28136fe0 msgr2=0x7fcd2811f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2cc97700 1 --2- 172.21.15.59:0/2070723880 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd28136fe0 0x7fcd2811f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2cc97700 1 -- 172.21.15.59:0/2070723880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809e930 msgr2=0x7fcd2811e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2cc97700 1 --2- 172.21.15.59:0/2070723880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809e930 0x7fcd2811e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2cc97700 1 -- 172.21.15.59:0/2070723880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c009550 con 0x7fcd2809f410 2023-09-30T22:36:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.285+0000 7fcd2d498700 1 --2- 172.21.15.59:0/2070723880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809e930 0x7fcd2811e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.286+0000 7fcd2cc97700 1 --2- 172.21.15.59:0/2070723880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2809f410 0x7fcd2811ed90 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00ebe0 tx=0x7fcd1c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.286+0000 7fcd19ffb700 1 -- 172.21.15.59:0/2070723880 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c00c850 con 0x7fcd2809f410 2023-09-30T22:36:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.286+0000 7fcd19ffb700 1 -- 172.21.15.59:0/2070723880 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c00c9b0 con 0x7fcd2809f410 2023-09-30T22:36:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.286+0000 7fcd19ffb700 1 -- 172.21.15.59:0/2070723880 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c00cd40 con 0x7fcd2809f410 2023-09-30T22:36:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.286+0000 7fcd2f6fc700 1 -- 172.21.15.59:0/2070723880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd20009a70 con 0x7fcd2809f410 2023-09-30T22:36:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.286+0000 7fcd2f6fc700 1 -- 172.21.15.59:0/2070723880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd280a32a0 con 0x7fcd2809f410 2023-09-30T22:36:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.287+0000 7fcd19ffb700 1 -- 172.21.15.59:0/2070723880 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd1c013470 con 0x7fcd2809f410 2023-09-30T22:36:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.287+0000 7fcd19ffb700 1 -- 172.21.15.59:0/2070723880 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcd1c03fc20 con 0x7fcd2809f410 2023-09-30T22:36:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.287+0000 7fcd2f6fc700 1 -- 172.21.15.59:0/2070723880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd28074ea0 con 0x7fcd2809f410 2023-09-30T22:36:18.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.292+0000 7fcd19ffb700 1 -- 172.21.15.59:0/2070723880 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd1c01b3b0 con 0x7fcd2809f410 2023-09-30T22:36:18.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.463+0000 7f7ed498c700 1 -- 172.21.15.59:0/4051708606 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7ed00747f0 con 0x7f7ed009d630 2023-09-30T22:36:18.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.464+0000 7f7ebeffd700 1 -- 172.21.15.59:0/4051708606 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ec0032020 con 0x7f7ed009d630 2023-09-30T22:36:18.464 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:18.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.467+0000 7f7ed498c700 1 -- 172.21.15.59:0/4051708606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ed009d630 msgr2=0x7f7ed011f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.467+0000 7f7ed498c700 1 --2- 172.21.15.59:0/4051708606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ed009d630 0x7f7ed011f480 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0015000 tx=0x7f7ec0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.467+0000 7f7ed498c700 1 -- 172.21.15.59:0/4051708606 shutdown_connections 2023-09-30T22:36:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.467+0000 7f7ed498c700 1 --2- 172.21.15.59:0/4051708606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ed009d630 0x7f7ed011f480 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.467+0000 7f7ed498c700 1 --2- 172.21.15.59:0/4051708606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ed0133930 0x7f7ed01c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.467+0000 7f7ed498c700 1 --2- 172.21.15.59:0/4051708606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ed00a0a30 0x7f7ed011f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.467+0000 7f7ed498c700 1 -- 172.21.15.59:0/4051708606 >> 172.21.15.59:0/4051708606 conn(0x7f7ed00a3050 msgr2=0x7f7ed009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.467+0000 7f7ed498c700 1 -- 172.21.15.59:0/4051708606 shutdown_connections 2023-09-30T22:36:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.467+0000 7f7ed498c700 1 -- 172.21.15.59:0/4051708606 wait complete. 2023-09-30T22:36:18.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:18.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.508+0000 7fcd2f6fc700 1 -- 172.21.15.59:0/2070723880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd28122100 con 0x7fcd2809f410 2023-09-30T22:36:18.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.509+0000 7fcd19ffb700 1 -- 172.21.15.59:0/2070723880 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd1c024350 con 0x7fcd2809f410 2023-09-30T22:36:18.509 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:18.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.511+0000 7fcd2f6fc700 1 -- 172.21.15.59:0/2070723880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2809f410 msgr2=0x7fcd2811ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.511+0000 7fcd2f6fc700 1 --2- 172.21.15.59:0/2070723880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2809f410 0x7fcd2811ed90 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00ebe0 tx=0x7fcd1c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.511+0000 7fcd2f6fc700 1 -- 172.21.15.59:0/2070723880 shutdown_connections 2023-09-30T22:36:18.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.511+0000 7fcd2f6fc700 1 --2- 172.21.15.59:0/2070723880 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd28136fe0 0x7fcd2811f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.511+0000 7fcd2f6fc700 1 --2- 172.21.15.59:0/2070723880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809e930 0x7fcd2811e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.511+0000 7fcd2f6fc700 1 --2- 172.21.15.59:0/2070723880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2809f410 0x7fcd2811ed90 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.511+0000 7fcd2f6fc700 1 -- 172.21.15.59:0/2070723880 >> 172.21.15.59:0/2070723880 conn(0x7fcd280a4210 msgr2=0x7fcd28134900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:18.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.511+0000 7fcd2f6fc700 1 -- 172.21.15.59:0/2070723880 shutdown_connections 2023-09-30T22:36:18.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.511+0000 7fcd2f6fc700 1 -- 172.21.15.59:0/2070723880 wait complete. 2023-09-30T22:36:18.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:18.553 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:18.592 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:18.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.707+0000 7fa1e9d93700 1 Processor -- start 2023-09-30T22:36:18.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.707+0000 7fa1e9d93700 1 -- start start 2023-09-30T22:36:18.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e9d93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1e40a0a30 0x7fa1e40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e9d93700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1e409d630 0x7fa1e40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e9d93700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1e4133930 0x7fa1e4133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e9d93700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e40a2a70 con 0x7fa1e409d630 2023-09-30T22:36:18.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e9d93700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e40a01d0 con 0x7fa1e4133930 2023-09-30T22:36:18.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e9d93700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e409e2b0 con 0x7fa1e40a0a30 2023-09-30T22:36:18.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1e40a0a30 0x7fa1e40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1e4133930 0x7fa1e4133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1e409d630 0x7fa1e40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1e40a0a30 0x7fa1e40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32864/0 (socket says 172.21.15.59:32864) 2023-09-30T22:36:18.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e37fe700 1 -- 172.21.15.59:0/4194563121 learned_addr learned my addr 172.21.15.59:0/4194563121 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:18.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e37fe700 1 -- 172.21.15.59:0/4194563121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1e4133930 msgr2=0x7fa1e4133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:18.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e37fe700 1 --2- 172.21.15.59:0/4194563121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1e4133930 0x7fa1e4133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e37fe700 1 -- 172.21.15.59:0/4194563121 >> v2:172.21.15.59:3300/0 conn(0x7fa1e409d630 msgr2=0x7fa1e40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:18.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e37fe700 1 --2- 172.21.15.59:0/4194563121 >> v2:172.21.15.59:3300/0 conn(0x7fa1e409d630 0x7fa1e40a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e37fe700 1 -- 172.21.15.59:0/4194563121 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e409dc50 con 0x7fa1e40a0a30 2023-09-30T22:36:18.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.708+0000 7fa1e3fff700 1 --2- 172.21.15.59:0/4194563121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1e4133930 0x7fa1e4133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:18.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.709+0000 7fa1e37fe700 1 --2- 172.21.15.59:0/4194563121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1e40a0a30 0x7fa1e40a0e00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009e50 tx=0x7fa1dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dd17faf32e7d299 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:18.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.709+0000 7fa1e27fc700 1 -- 172.21.15.59:0/4194563121 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc00e070 con 0x7fa1e40a0a30 2023-09-30T22:36:18.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.709+0000 7fa1e27fc700 1 -- 172.21.15.59:0/4194563121 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1dc00b910 con 0x7fa1e40a0a30 2023-09-30T22:36:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.709+0000 7fa1e27fc700 1 -- 172.21.15.59:0/4194563121 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc00bcc0 con 0x7fa1e40a0a30 2023-09-30T22:36:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.710+0000 7fa1e9d93700 1 -- 172.21.15.59:0/4194563121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1e40a0a30 msgr2=0x7fa1e40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.710+0000 7fa1e9d93700 1 --2- 172.21.15.59:0/4194563121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1e40a0a30 0x7fa1e40a0e00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009e50 tx=0x7fa1dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.710+0000 7fa1e9d93700 1 -- 172.21.15.59:0/4194563121 shutdown_connections 2023-09-30T22:36:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.710+0000 7fa1e9d93700 1 --2- 172.21.15.59:0/4194563121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1e4133930 0x7fa1e4133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.710+0000 7fa1e9d93700 1 --2- 172.21.15.59:0/4194563121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1e40a0a30 0x7fa1e40a0e00 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.710+0000 7fa1e9d93700 1 --2- 172.21.15.59:0/4194563121 >> v2:172.21.15.59:3300/0 conn(0x7fa1e409d630 0x7fa1e40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.710+0000 7fa1e9d93700 1 -- 172.21.15.59:0/4194563121 >> 172.21.15.59:0/4194563121 conn(0x7fa1e40a3050 msgr2=0x7fa1e40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.710+0000 7fa1e9d93700 1 -- 172.21.15.59:0/4194563121 shutdown_connections 2023-09-30T22:36:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.710+0000 7fa1e9d93700 1 -- 172.21.15.59:0/4194563121 wait complete. 2023-09-30T22:36:18.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.711+0000 7fa1e9d93700 1 Processor -- start 2023-09-30T22:36:18.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.711+0000 7fa1e9d93700 1 -- start start 2023-09-30T22:36:18.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.712+0000 7fa1e9d93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1e409d630 0x7fa1e411f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.712+0000 7fa1e9d93700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1e40a0a30 0x7fa1e411f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.712+0000 7fa1e9d93700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1e4133930 0x7fa1e41c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.712+0000 7fa1e9d93700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e4120940 con 0x7fa1e4133930 2023-09-30T22:36:18.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.712+0000 7fa1e9d93700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e4120750 con 0x7fa1e40a0a30 2023-09-30T22:36:18.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.712+0000 7fa1e9d93700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e41334d0 con 0x7fa1e409d630 2023-09-30T22:36:18.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.712+0000 7fa1e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1e409d630 0x7fa1e411f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.712+0000 7fa1e2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1e40a0a30 0x7fa1e411f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.712+0000 7fa1e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1e409d630 0x7fa1e411f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32874/0 (socket says 172.21.15.59:32874) 2023-09-30T22:36:18.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.712+0000 7fa1e2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1e40a0a30 0x7fa1e411f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56470/0 (socket says 172.21.15.59:56470) 2023-09-30T22:36:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.712+0000 7fa1e37fe700 1 -- 172.21.15.59:0/952076749 learned_addr learned my addr 172.21.15.59:0/952076749 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.712+0000 7fa1e3fff700 1 --2- 172.21.15.59:0/952076749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1e4133930 0x7fa1e41c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.713+0000 7fa1e37fe700 1 -- 172.21.15.59:0/952076749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1e40a0a30 msgr2=0x7fa1e411f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.713+0000 7fa1e37fe700 1 --2- 172.21.15.59:0/952076749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1e40a0a30 0x7fa1e411f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.713+0000 7fa1e37fe700 1 -- 172.21.15.59:0/952076749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1e4133930 msgr2=0x7fa1e41c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.713+0000 7fa1e37fe700 1 --2- 172.21.15.59:0/952076749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1e4133930 0x7fa1e41c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.713+0000 7fa1e37fe700 1 -- 172.21.15.59:0/952076749 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d40094a0 con 0x7fa1e409d630 2023-09-30T22:36:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.713+0000 7fa1e3fff700 1 --2- 172.21.15.59:0/952076749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1e4133930 0x7fa1e41c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.713+0000 7fa1e37fe700 1 --2- 172.21.15.59:0/952076749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1e409d630 0x7fa1e411f480 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00b370 tx=0x7fa1dc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.713+0000 7fa1dbfff700 1 -- 172.21.15.59:0/952076749 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc00ce80 con 0x7fa1e409d630 2023-09-30T22:36:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.713+0000 7fa1dbfff700 1 -- 172.21.15.59:0/952076749 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1dc004250 con 0x7fa1e409d630 2023-09-30T22:36:18.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.713+0000 7fa1e9d93700 1 -- 172.21.15.59:0/952076749 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc009b30 con 0x7fa1e409d630 2023-09-30T22:36:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.713+0000 7fa1dbfff700 1 -- 172.21.15.59:0/952076749 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc004600 con 0x7fa1e409d630 2023-09-30T22:36:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.713+0000 7fa1e9d93700 1 -- 172.21.15.59:0/952076749 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e40a41b0 con 0x7fa1e409d630 2023-09-30T22:36:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.714+0000 7fa1dbfff700 1 -- 172.21.15.59:0/952076749 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1dc004760 con 0x7fa1e409d630 2023-09-30T22:36:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.714+0000 7fa1dbfff700 1 -- 172.21.15.59:0/952076749 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa1dc040910 con 0x7fa1e409d630 2023-09-30T22:36:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.714+0000 7fa1e9d93700 1 -- 172.21.15.59:0/952076749 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e41221e0 con 0x7fa1e409d630 2023-09-30T22:36:18.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.719+0000 7fa1dbfff700 1 -- 172.21.15.59:0/952076749 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1e41221e0 con 0x7fa1e409d630 2023-09-30T22:36:18.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.748+0000 7f25bc2db700 1 Processor -- start 2023-09-30T22:36:18.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.748+0000 7f25bc2db700 1 -- start start 2023-09-30T22:36:18.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.748+0000 7f25bc2db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25b40a0a30 0x7f25b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.748+0000 7f25bc2db700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25b409d630 0x7f25b40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.748+0000 7f25bc2db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25b4133930 0x7f25b4133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.748+0000 7f25bc2db700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b40a2a70 con 0x7f25b409d630 2023-09-30T22:36:18.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.748+0000 7f25bc2db700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b40a01d0 con 0x7f25b4133930 2023-09-30T22:36:18.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.748+0000 7f25bc2db700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25b409e2b0 con 0x7f25b40a0a30 2023-09-30T22:36:18.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.749+0000 7f25ba077700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25b40a0a30 0x7f25b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.749+0000 7f25b9876700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25b409d630 0x7f25b40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.749+0000 7f25ba878700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25b4133930 0x7f25b4133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.749+0000 7f25ba077700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25b40a0a30 0x7f25b40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32882/0 (socket says 172.21.15.59:32882) 2023-09-30T22:36:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.749+0000 7f25b9876700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25b409d630 0x7f25b40a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55456/0 (socket says 172.21.15.59:55456) 2023-09-30T22:36:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.749+0000 7f25ba077700 1 -- 172.21.15.59:0/2607021376 learned_addr learned my addr 172.21.15.59:0/2607021376 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.749+0000 7f25b9876700 1 -- 172.21.15.59:0/2607021376 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25b40a0a30 msgr2=0x7f25b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.749+0000 7f25b9876700 1 --2- 172.21.15.59:0/2607021376 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25b40a0a30 0x7f25b40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.749+0000 7f25b9876700 1 -- 172.21.15.59:0/2607021376 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25b4133930 msgr2=0x7f25b4133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:18.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.749+0000 7f25b9876700 1 --2- 172.21.15.59:0/2607021376 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25b4133930 0x7f25b4133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.749+0000 7f25b9876700 1 -- 172.21.15.59:0/2607021376 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b409dc50 con 0x7f25b409d630 2023-09-30T22:36:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.749+0000 7f25ba077700 1 --2- 172.21.15.59:0/2607021376 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25b40a0a30 0x7f25b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.749+0000 7f25ba878700 1 --2- 172.21.15.59:0/2607021376 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25b4133930 0x7f25b4133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.749+0000 7f25b9876700 1 --2- 172.21.15.59:0/2607021376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b409d630 0x7f25b40a1340 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009840 tx=0x7f25a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c7cca13d793c3c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.749+0000 7f25b9075700 1 -- 172.21.15.59:0/2607021376 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a4011830 con 0x7f25b409d630 2023-09-30T22:36:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.750+0000 7f25b9075700 1 -- 172.21.15.59:0/2607021376 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a4011990 con 0x7f25b409d630 2023-09-30T22:36:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.750+0000 7f25b9075700 1 -- 172.21.15.59:0/2607021376 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a4011d20 con 0x7f25b409d630 2023-09-30T22:36:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.750+0000 7f25bc2db700 1 -- 172.21.15.59:0/2607021376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b409d630 msgr2=0x7f25b40a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.750+0000 7f25bc2db700 1 --2- 172.21.15.59:0/2607021376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b409d630 0x7f25b40a1340 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009840 tx=0x7f25a4009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.750+0000 7f25bc2db700 1 -- 172.21.15.59:0/2607021376 shutdown_connections 2023-09-30T22:36:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.750+0000 7f25bc2db700 1 --2- 172.21.15.59:0/2607021376 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25b4133930 0x7f25b4133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.750+0000 7f25bc2db700 1 --2- 172.21.15.59:0/2607021376 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25b40a0a30 0x7f25b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.750+0000 7f25bc2db700 1 --2- 172.21.15.59:0/2607021376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b409d630 0x7f25b40a1340 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.750+0000 7f25bc2db700 1 -- 172.21.15.59:0/2607021376 >> 172.21.15.59:0/2607021376 conn(0x7f25b40a3050 msgr2=0x7f25b40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.750+0000 7f25bc2db700 1 -- 172.21.15.59:0/2607021376 shutdown_connections 2023-09-30T22:36:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.750+0000 7f25bc2db700 1 -- 172.21.15.59:0/2607021376 wait complete. 2023-09-30T22:36:18.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.752+0000 7f25bc2db700 1 Processor -- start 2023-09-30T22:36:18.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.752+0000 7f25bc2db700 1 -- start start 2023-09-30T22:36:18.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.752+0000 7f25bc2db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25b409d630 0x7f25b411f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.752+0000 7f25bc2db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25b40a0a30 0x7f25b411fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25bc2db700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b4133930 0x7f25b41c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25bc2db700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b41222e0 con 0x7f25b4133930 2023-09-30T22:36:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25bc2db700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4122800 con 0x7f25b40a0a30 2023-09-30T22:36:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25bc2db700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4133430 con 0x7f25b409d630 2023-09-30T22:36:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25b9876700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25b40a0a30 0x7f25b411fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25ba878700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b4133930 0x7f25b41c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25b9876700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25b40a0a30 0x7f25b411fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56482/0 (socket says 172.21.15.59:56482) 2023-09-30T22:36:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25b9876700 1 -- 172.21.15.59:0/436678687 learned_addr learned my addr 172.21.15.59:0/436678687 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25ba077700 1 --2- 172.21.15.59:0/436678687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25b409d630 0x7f25b411f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25ba878700 1 -- 172.21.15.59:0/436678687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25b409d630 msgr2=0x7f25b411f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25ba878700 1 --2- 172.21.15.59:0/436678687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25b409d630 0x7f25b411f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25ba878700 1 -- 172.21.15.59:0/436678687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25b40a0a30 msgr2=0x7f25b411fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25ba878700 1 --2- 172.21.15.59:0/436678687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25b40a0a30 0x7f25b411fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25ba878700 1 -- 172.21.15.59:0/436678687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b0009550 con 0x7f25b4133930 2023-09-30T22:36:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25ba878700 1 --2- 172.21.15.59:0/436678687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b4133930 0x7f25b41c7ff0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00efc0 tx=0x7f25ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25aaffd700 1 -- 172.21.15.59:0/436678687 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac00ca90 con 0x7f25b4133930 2023-09-30T22:36:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25aaffd700 1 -- 172.21.15.59:0/436678687 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac00f040 con 0x7f25b4133930 2023-09-30T22:36:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25bc2db700 1 -- 172.21.15.59:0/436678687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ac009a70 con 0x7f25b4133930 2023-09-30T22:36:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.753+0000 7f25aaffd700 1 -- 172.21.15.59:0/436678687 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac00ce30 con 0x7f25b4133930 2023-09-30T22:36:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.754+0000 7f25bc2db700 1 -- 172.21.15.59:0/436678687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a40094a0 con 0x7f25b4133930 2023-09-30T22:36:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.754+0000 7f25aaffd700 1 -- 172.21.15.59:0/436678687 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25ac014480 con 0x7f25b4133930 2023-09-30T22:36:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.754+0000 7f25aaffd700 1 -- 172.21.15.59:0/436678687 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25ac03fc00 con 0x7f25b4133930 2023-09-30T22:36:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.754+0000 7f25bc2db700 1 -- 172.21.15.59:0/436678687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b4121f60 con 0x7f25b4133930 2023-09-30T22:36:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.759+0000 7f25aaffd700 1 -- 172.21.15.59:0/436678687 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25b4121f60 con 0x7f25b4133930 2023-09-30T22:36:18.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.926+0000 7fa1e9d93700 1 -- 172.21.15.59:0/952076749 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa1e41221e0 con 0x7fa1e409d630 2023-09-30T22:36:18.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.926+0000 7fa1dbfff700 1 -- 172.21.15.59:0/952076749 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1e41221e0 con 0x7fa1e409d630 2023-09-30T22:36:18.927 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:18.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.928+0000 7fa1e9d93700 1 -- 172.21.15.59:0/952076749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1e409d630 msgr2=0x7fa1e411f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.929+0000 7fa1e9d93700 1 --2- 172.21.15.59:0/952076749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1e409d630 0x7fa1e411f480 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00b370 tx=0x7fa1dc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.929+0000 7fa1e9d93700 1 -- 172.21.15.59:0/952076749 shutdown_connections 2023-09-30T22:36:18.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.929+0000 7fa1e9d93700 1 --2- 172.21.15.59:0/952076749 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1e409d630 0x7fa1e411f480 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.929+0000 7fa1e9d93700 1 --2- 172.21.15.59:0/952076749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1e4133930 0x7fa1e41c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.929+0000 7fa1e9d93700 1 --2- 172.21.15.59:0/952076749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1e40a0a30 0x7fa1e411f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.929+0000 7fa1e9d93700 1 -- 172.21.15.59:0/952076749 >> 172.21.15.59:0/952076749 conn(0x7fa1e40a3050 msgr2=0x7fa1e409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:18.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.929+0000 7fa1e9d93700 1 -- 172.21.15.59:0/952076749 shutdown_connections 2023-09-30T22:36:18.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.929+0000 7fa1e9d93700 1 -- 172.21.15.59:0/952076749 wait complete. 2023-09-30T22:36:18.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.964+0000 7f25bc2db700 1 -- 172.21.15.59:0/436678687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f25b4121f60 con 0x7f25b4133930 2023-09-30T22:36:18.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.964+0000 7f25aaffd700 1 -- 172.21.15.59:0/436678687 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25b4121f60 con 0x7f25b4133930 2023-09-30T22:36:18.965 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:18.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.967+0000 7f25bc2db700 1 -- 172.21.15.59:0/436678687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b4133930 msgr2=0x7f25b41c7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:18.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.967+0000 7f25bc2db700 1 --2- 172.21.15.59:0/436678687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b4133930 0x7f25b41c7ff0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00efc0 tx=0x7f25ac00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.967+0000 7f25bc2db700 1 -- 172.21.15.59:0/436678687 shutdown_connections 2023-09-30T22:36:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.967+0000 7f25bc2db700 1 --2- 172.21.15.59:0/436678687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25b409d630 0x7f25b411f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.967+0000 7f25bc2db700 1 --2- 172.21.15.59:0/436678687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b4133930 0x7f25b41c7ff0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.967+0000 7f25bc2db700 1 --2- 172.21.15.59:0/436678687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25b40a0a30 0x7f25b411fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.967+0000 7f25bc2db700 1 -- 172.21.15.59:0/436678687 >> 172.21.15.59:0/436678687 conn(0x7f25b40a3050 msgr2=0x7f25b41bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.967+0000 7f25bc2db700 1 -- 172.21.15.59:0/436678687 shutdown_connections 2023-09-30T22:36:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:18.967+0000 7f25bc2db700 1 -- 172.21.15.59:0/436678687 wait complete. 2023-09-30T22:36:18.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:19.487 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:19.526 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:19.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.636+0000 7f3abfbf4700 1 Processor -- start 2023-09-30T22:36:19.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.636+0000 7f3abfbf4700 1 -- start start 2023-09-30T22:36:19.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.637+0000 7f3abfbf4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ab80a0a30 0x7f3ab80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:19.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.637+0000 7f3abfbf4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3ab809d630 0x7f3ab80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:19.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.637+0000 7f3abfbf4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ab8133930 0x7f3ab8133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:19.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.637+0000 7f3abfbf4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab80a2a70 con 0x7f3ab809d630 2023-09-30T22:36:19.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.637+0000 7f3abfbf4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80a01d0 con 0x7f3ab8133930 2023-09-30T22:36:19.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.637+0000 7f3abfbf4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab809e2b0 con 0x7f3ab80a0a30 2023-09-30T22:36:19.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.637+0000 7f3abd990700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ab80a0a30 0x7f3ab80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:19.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.637+0000 7f3abe191700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ab8133930 0x7f3ab8133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:19.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.638+0000 7f3abe191700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ab8133930 0x7f3ab8133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56496/0 (socket says 172.21.15.59:56496) 2023-09-30T22:36:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.638+0000 7f3abd990700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ab80a0a30 0x7f3ab80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32906/0 (socket says 172.21.15.59:32906) 2023-09-30T22:36:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.638+0000 7f3abe191700 1 -- 172.21.15.59:0/379011214 learned_addr learned my addr 172.21.15.59:0/379011214 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.638+0000 7f3abd18f700 1 --2- 172.21.15.59:0/379011214 >> v2:172.21.15.59:3300/0 conn(0x7f3ab809d630 0x7f3ab80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.638+0000 7f3abe191700 1 -- 172.21.15.59:0/379011214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ab80a0a30 msgr2=0x7f3ab80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.638+0000 7f3abe191700 1 --2- 172.21.15.59:0/379011214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ab80a0a30 0x7f3ab80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.638+0000 7f3abe191700 1 -- 172.21.15.59:0/379011214 >> v2:172.21.15.59:3300/0 conn(0x7f3ab809d630 msgr2=0x7f3ab80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.638+0000 7f3abe191700 1 --2- 172.21.15.59:0/379011214 >> v2:172.21.15.59:3300/0 conn(0x7f3ab809d630 0x7f3ab80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.638+0000 7f3abe191700 1 -- 172.21.15.59:0/379011214 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab809dc50 con 0x7f3ab8133930 2023-09-30T22:36:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.638+0000 7f3abd990700 1 --2- 172.21.15.59:0/379011214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ab80a0a30 0x7f3ab80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.638+0000 7f3abd18f700 1 --2- 172.21.15.59:0/379011214 >> v2:172.21.15.59:3300/0 conn(0x7f3ab809d630 0x7f3ab80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.638+0000 7f3abe191700 1 --2- 172.21.15.59:0/379011214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ab8133930 0x7f3ab8133dd0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009e50 tx=0x7f3aa800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9bbbe1a42905576 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.638+0000 7f3abc98e700 1 -- 172.21.15.59:0/379011214 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa800e070 con 0x7f3ab8133930 2023-09-30T22:36:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.638+0000 7f3abc98e700 1 -- 172.21.15.59:0/379011214 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa800b910 con 0x7f3ab8133930 2023-09-30T22:36:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.638+0000 7f3abc98e700 1 -- 172.21.15.59:0/379011214 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa800bcc0 con 0x7f3ab8133930 2023-09-30T22:36:19.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.639+0000 7f3abfbf4700 1 -- 172.21.15.59:0/379011214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ab8133930 msgr2=0x7f3ab8133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:19.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.639+0000 7f3abfbf4700 1 --2- 172.21.15.59:0/379011214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ab8133930 0x7f3ab8133dd0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009e50 tx=0x7f3aa800b330 comp rx=0 tx=0).stop 2023-09-30T22:36:19.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.639+0000 7f3abfbf4700 1 -- 172.21.15.59:0/379011214 shutdown_connections 2023-09-30T22:36:19.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.639+0000 7f3abfbf4700 1 --2- 172.21.15.59:0/379011214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ab8133930 0x7f3ab8133dd0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.639+0000 7f3abfbf4700 1 --2- 172.21.15.59:0/379011214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ab80a0a30 0x7f3ab80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.639+0000 7f3abfbf4700 1 --2- 172.21.15.59:0/379011214 >> v2:172.21.15.59:3300/0 conn(0x7f3ab809d630 0x7f3ab80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.639+0000 7f3abfbf4700 1 -- 172.21.15.59:0/379011214 >> 172.21.15.59:0/379011214 conn(0x7f3ab80a3050 msgr2=0x7f3ab80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.639+0000 7f3abfbf4700 1 -- 172.21.15.59:0/379011214 shutdown_connections 2023-09-30T22:36:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.639+0000 7f3abfbf4700 1 -- 172.21.15.59:0/379011214 wait complete. 2023-09-30T22:36:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.640+0000 7f3abfbf4700 1 Processor -- start 2023-09-30T22:36:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.640+0000 7f3abfbf4700 1 -- start start 2023-09-30T22:36:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abfbf4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ab809d630 0x7f3ab81c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abfbf4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ab80a0a30 0x7f3ab81c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abfbf4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ab8133930 0x7f3ab81c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abfbf4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80a0410 con 0x7f3ab8133930 2023-09-30T22:36:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abfbf4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab8120630 con 0x7f3ab809d630 2023-09-30T22:36:19.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abfbf4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80a4030 con 0x7f3ab80a0a30 2023-09-30T22:36:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abd18f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ab80a0a30 0x7f3ab81c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abd990700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ab809d630 0x7f3ab81c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abd18f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ab80a0a30 0x7f3ab81c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32918/0 (socket says 172.21.15.59:32918) 2023-09-30T22:36:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abd18f700 1 -- 172.21.15.59:0/1437853669 learned_addr learned my addr 172.21.15.59:0/1437853669 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abd990700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ab809d630 0x7f3ab81c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56500/0 (socket says 172.21.15.59:56500) 2023-09-30T22:36:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abe191700 1 --2- 172.21.15.59:0/1437853669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ab8133930 0x7f3ab81c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abd18f700 1 -- 172.21.15.59:0/1437853669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ab809d630 msgr2=0x7f3ab81c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abd18f700 1 --2- 172.21.15.59:0/1437853669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ab809d630 0x7f3ab81c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abd18f700 1 -- 172.21.15.59:0/1437853669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ab8133930 msgr2=0x7f3ab81c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abd18f700 1 --2- 172.21.15.59:0/1437853669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ab8133930 0x7f3ab81c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abd18f700 1 -- 172.21.15.59:0/1437853669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac0094a0 con 0x7f3ab80a0a30 2023-09-30T22:36:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abe191700 1 --2- 172.21.15.59:0/1437853669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ab8133930 0x7f3ab81c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abd990700 1 --2- 172.21.15.59:0/1437853669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ab809d630 0x7f3ab81c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.641+0000 7f3abd18f700 1 --2- 172.21.15.59:0/1437853669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ab80a0a30 0x7f3ab81c83c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3aac00ebb0 tx=0x7f3aac00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.642+0000 7f3ab67fc700 1 -- 172.21.15.59:0/1437853669 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac00c850 con 0x7f3ab80a0a30 2023-09-30T22:36:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.642+0000 7f3ab67fc700 1 -- 172.21.15.59:0/1437853669 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac00c9b0 con 0x7f3ab80a0a30 2023-09-30T22:36:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.642+0000 7f3abfbf4700 1 -- 172.21.15.59:0/1437853669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab00094a0 con 0x7f3ab80a0a30 2023-09-30T22:36:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.642+0000 7f3ab67fc700 1 -- 172.21.15.59:0/1437853669 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac00cd40 con 0x7f3ab80a0a30 2023-09-30T22:36:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.642+0000 7f3abfbf4700 1 -- 172.21.15.59:0/1437853669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa8009b30 con 0x7f3ab80a0a30 2023-09-30T22:36:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.643+0000 7f3ab67fc700 1 -- 172.21.15.59:0/1437853669 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3aac013470 con 0x7f3ab80a0a30 2023-09-30T22:36:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.643+0000 7f3ab67fc700 1 -- 172.21.15.59:0/1437853669 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3aac03f780 con 0x7f3ab80a0a30 2023-09-30T22:36:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.643+0000 7f3abfbf4700 1 -- 172.21.15.59:0/1437853669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab80747f0 con 0x7f3ab80a0a30 2023-09-30T22:36:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.648+0000 7f3ab67fc700 1 -- 172.21.15.59:0/1437853669 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3aac0232f0 con 0x7f3ab80a0a30 2023-09-30T22:36:19.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.673+0000 7f8691d6e700 1 Processor -- start 2023-09-30T22:36:19.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.673+0000 7f8691d6e700 1 -- start start 2023-09-30T22:36:19.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f8691d6e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f868c0a0a30 0x7f868c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:19.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f8691d6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c138d80 0x7f868c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:19.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f8691d6e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868c0a2a70 con 0x7f868c09d630 2023-09-30T22:36:19.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f8691d6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c0a01d0 con 0x7f868c138d80 2023-09-30T22:36:19.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f8691d6e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f868c09e2b0 con 0x7f868c0a0a30 2023-09-30T22:36:19.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f868b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f868c0a0a30 0x7f868c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:19.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f868bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c138d80 0x7f868c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:19.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f868bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c138d80 0x7f868c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56512/0 (socket says 172.21.15.59:56512) 2023-09-30T22:36:19.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f868b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f868c0a0a30 0x7f868c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32934/0 (socket says 172.21.15.59:32934) 2023-09-30T22:36:19.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f868bfff700 1 -- 172.21.15.59:0/1059289348 learned_addr learned my addr 172.21.15.59:0/1059289348 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:19.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f868bfff700 1 -- 172.21.15.59:0/1059289348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f868c0a0a30 msgr2=0x7f868c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:19.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f868bfff700 1 --2- 172.21.15.59:0/1059289348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f868c0a0a30 0x7f868c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f868bfff700 1 -- 172.21.15.59:0/1059289348 >> v1:172.21.15.59:6789/0 conn(0x7f868c09d630 legacy=0x7f868c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:19.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f868bfff700 1 -- 172.21.15.59:0/1059289348 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c09dc50 con 0x7f868c138d80 2023-09-30T22:36:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f868b7fe700 1 --2- 172.21.15.59:0/1059289348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f868c0a0a30 0x7f868c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f868a7fc700 1 -- 172.21.15.59:0/1059289348 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764623735 0 0) 0x7f868c0a2a70 con 0x7f868c09d630 2023-09-30T22:36:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.674+0000 7f868bfff700 1 --2- 172.21.15.59:0/1059289348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c138d80 0x7f868c13b160 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f867c009920 tx=0x7f867c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be896221e0f09476 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.675+0000 7f868a7fc700 1 -- 172.21.15.59:0/1059289348 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c011830 con 0x7f868c138d80 2023-09-30T22:36:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.675+0000 7f868a7fc700 1 -- 172.21.15.59:0/1059289348 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c011990 con 0x7f868c138d80 2023-09-30T22:36:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.675+0000 7f868a7fc700 1 -- 172.21.15.59:0/1059289348 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c011d20 con 0x7f868c138d80 2023-09-30T22:36:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.675+0000 7f8691d6e700 1 -- 172.21.15.59:0/1059289348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c138d80 msgr2=0x7f868c13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.675+0000 7f8691d6e700 1 --2- 172.21.15.59:0/1059289348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c138d80 0x7f868c13b160 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f867c009920 tx=0x7f867c009c30 comp rx=0 tx=0).stop 2023-09-30T22:36:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.675+0000 7f8691d6e700 1 -- 172.21.15.59:0/1059289348 shutdown_connections 2023-09-30T22:36:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.675+0000 7f8691d6e700 1 --2- 172.21.15.59:0/1059289348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f868c0a0a30 0x7f868c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.675+0000 7f8691d6e700 1 --2- 172.21.15.59:0/1059289348 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c138d80 0x7f868c13b160 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.675+0000 7f8691d6e700 1 -- 172.21.15.59:0/1059289348 >> 172.21.15.59:0/1059289348 conn(0x7f868c0a3050 msgr2=0x7f868c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:19.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.675+0000 7f8691d6e700 1 -- 172.21.15.59:0/1059289348 shutdown_connections 2023-09-30T22:36:19.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.675+0000 7f8691d6e700 1 -- 172.21.15.59:0/1059289348 wait complete. 2023-09-30T22:36:19.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.677+0000 7f8691d6e700 1 Processor -- start 2023-09-30T22:36:19.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.677+0000 7f8691d6e700 1 -- start start 2023-09-30T22:36:19.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f8691d6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c09d630 0x7f868c1336d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:19.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f8691d6e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f868c0a0a30 0x7f868c133c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:19.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f8691d6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c138d80 0x7f868c134150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:19.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f8691d6e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c136550 con 0x7f868c09d630 2023-09-30T22:36:19.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f8691d6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c136ec0 con 0x7f868c138d80 2023-09-30T22:36:19.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f8691d6e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f868c1361a0 con 0x7f868c0a0a30 2023-09-30T22:36:19.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f868bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c138d80 0x7f868c134150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:19.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f868affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f868c0a0a30 0x7f868c133c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:19.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f868bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c138d80 0x7f868c134150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56518/0 (socket says 172.21.15.59:56518) 2023-09-30T22:36:19.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f868bfff700 1 -- 172.21.15.59:0/1105593658 learned_addr learned my addr 172.21.15.59:0/1105593658 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:19.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f868b7fe700 1 --2- 172.21.15.59:0/1105593658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c09d630 0x7f868c1336d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:19.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f868bfff700 1 -- 172.21.15.59:0/1105593658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f868c0a0a30 msgr2=0x7f868c133c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:19.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f868bfff700 1 --2- 172.21.15.59:0/1105593658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f868c0a0a30 0x7f868c133c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f868bfff700 1 -- 172.21.15.59:0/1105593658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c09d630 msgr2=0x7f868c1336d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:19.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f868bfff700 1 --2- 172.21.15.59:0/1105593658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c09d630 0x7f868c1336d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f868bfff700 1 -- 172.21.15.59:0/1105593658 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8684009a70 con 0x7f868c138d80 2023-09-30T22:36:19.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f868affd700 1 --2- 172.21.15.59:0/1105593658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f868c0a0a30 0x7f868c133c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:19.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.678+0000 7f868bfff700 1 --2- 172.21.15.59:0/1105593658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c138d80 0x7f868c134150 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f867c0098f0 tx=0x7f867c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:19.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.679+0000 7f8673fff700 1 -- 172.21.15.59:0/1105593658 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c004450 con 0x7f868c138d80 2023-09-30T22:36:19.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.679+0000 7f8673fff700 1 -- 172.21.15.59:0/1105593658 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c0045b0 con 0x7f868c138d80 2023-09-30T22:36:19.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.679+0000 7f8691d6e700 1 -- 172.21.15.59:0/1105593658 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c009550 con 0x7f868c138d80 2023-09-30T22:36:19.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.679+0000 7f8673fff700 1 -- 172.21.15.59:0/1105593658 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0038e0 con 0x7f868c138d80 2023-09-30T22:36:19.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.679+0000 7f8691d6e700 1 -- 172.21.15.59:0/1105593658 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868c1371a0 con 0x7f868c138d80 2023-09-30T22:36:19.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.680+0000 7f8673fff700 1 -- 172.21.15.59:0/1105593658 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f867c003a40 con 0x7f868c138d80 2023-09-30T22:36:19.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.680+0000 7f8691d6e700 1 -- 172.21.15.59:0/1105593658 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868c137000 con 0x7f868c138d80 2023-09-30T22:36:19.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.680+0000 7f8673fff700 1 -- 172.21.15.59:0/1105593658 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f867c040960 con 0x7f868c138d80 2023-09-30T22:36:19.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.685+0000 7f8673fff700 1 -- 172.21.15.59:0/1105593658 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f868c137000 con 0x7f868c138d80 2023-09-30T22:36:19.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.854+0000 7f3abfbf4700 1 -- 172.21.15.59:0/1437853669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3ab8121eb0 con 0x7f3ab80a0a30 2023-09-30T22:36:19.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.855+0000 7f3ab67fc700 1 -- 172.21.15.59:0/1437853669 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3aac021030 con 0x7f3ab80a0a30 2023-09-30T22:36:19.855 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:19.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.857+0000 7f3abfbf4700 1 -- 172.21.15.59:0/1437853669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ab80a0a30 msgr2=0x7f3ab81c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:19.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.857+0000 7f3abfbf4700 1 --2- 172.21.15.59:0/1437853669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ab80a0a30 0x7f3ab81c83c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3aac00ebb0 tx=0x7f3aac00eec0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.857+0000 7f3abfbf4700 1 -- 172.21.15.59:0/1437853669 shutdown_connections 2023-09-30T22:36:19.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.857+0000 7f3abfbf4700 1 --2- 172.21.15.59:0/1437853669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ab8133930 0x7f3ab81c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.857+0000 7f3abfbf4700 1 --2- 172.21.15.59:0/1437853669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ab809d630 0x7f3ab81c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.857+0000 7f3abfbf4700 1 --2- 172.21.15.59:0/1437853669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ab80a0a30 0x7f3ab81c83c0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.857+0000 7f3abfbf4700 1 -- 172.21.15.59:0/1437853669 >> 172.21.15.59:0/1437853669 conn(0x7f3ab80a3050 msgr2=0x7f3ab809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:19.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.857+0000 7f3abfbf4700 1 -- 172.21.15.59:0/1437853669 shutdown_connections 2023-09-30T22:36:19.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.857+0000 7f3abfbf4700 1 -- 172.21.15.59:0/1437853669 wait complete. 2023-09-30T22:36:19.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:19.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.891+0000 7f8691d6e700 1 -- 172.21.15.59:0/1105593658 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f868c137000 con 0x7f868c138d80 2023-09-30T22:36:19.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.892+0000 7f8673fff700 1 -- 172.21.15.59:0/1105593658 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f868c137000 con 0x7f868c138d80 2023-09-30T22:36:19.892 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:19.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.894+0000 7f8691d6e700 1 -- 172.21.15.59:0/1105593658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c138d80 msgr2=0x7f868c134150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:19.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.894+0000 7f8691d6e700 1 --2- 172.21.15.59:0/1105593658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c138d80 0x7f868c134150 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f867c0098f0 tx=0x7f867c004750 comp rx=0 tx=0).stop 2023-09-30T22:36:19.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.894+0000 7f8691d6e700 1 -- 172.21.15.59:0/1105593658 shutdown_connections 2023-09-30T22:36:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.894+0000 7f8691d6e700 1 --2- 172.21.15.59:0/1105593658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c138d80 0x7f868c134150 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.894+0000 7f8691d6e700 1 --2- 172.21.15.59:0/1105593658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c09d630 0x7f868c1336d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.894+0000 7f8691d6e700 1 --2- 172.21.15.59:0/1105593658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f868c0a0a30 0x7f868c133c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.894+0000 7f8691d6e700 1 -- 172.21.15.59:0/1105593658 >> 172.21.15.59:0/1105593658 conn(0x7f868c0a3050 msgr2=0x7f868c13ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.894+0000 7f8691d6e700 1 -- 172.21.15.59:0/1105593658 shutdown_connections 2023-09-30T22:36:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:19.894+0000 7f8691d6e700 1 -- 172.21.15.59:0/1105593658 wait complete. 2023-09-30T22:36:19.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:19.944 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:19.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:20.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.091+0000 7fe9177d4700 1 Processor -- start 2023-09-30T22:36:20.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.091+0000 7fe9177d4700 1 -- start start 2023-09-30T22:36:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.091+0000 7fe9177d4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9100a0a30 0x7fe9100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.091+0000 7fe9177d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe91009d630 0x7fe9100a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.091+0000 7fe9177d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe910133930 0x7fe910133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.091+0000 7fe9177d4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9100a2a70 con 0x7fe9100a0a30 2023-09-30T22:36:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.091+0000 7fe9177d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100a01d0 con 0x7fe910133930 2023-09-30T22:36:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.091+0000 7fe9177d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe91009e2b0 con 0x7fe91009d630 2023-09-30T22:36:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe915570700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9100a0a30 0x7fe9100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe914d6f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe91009d630 0x7fe9100a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe915d71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe910133930 0x7fe910133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe915570700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9100a0a30 0x7fe9100a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55492/0 (socket says 172.21.15.59:55492) 2023-09-30T22:36:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe914d6f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe91009d630 0x7fe9100a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32952/0 (socket says 172.21.15.59:32952) 2023-09-30T22:36:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe915570700 1 -- 172.21.15.59:0/126851074 learned_addr learned my addr 172.21.15.59:0/126851074 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe914d6f700 1 -- 172.21.15.59:0/126851074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe910133930 msgr2=0x7fe910133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe914d6f700 1 --2- 172.21.15.59:0/126851074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe910133930 0x7fe910133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe914d6f700 1 -- 172.21.15.59:0/126851074 >> v2:172.21.15.59:3300/0 conn(0x7fe9100a0a30 msgr2=0x7fe9100a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe914d6f700 1 --2- 172.21.15.59:0/126851074 >> v2:172.21.15.59:3300/0 conn(0x7fe9100a0a30 0x7fe9100a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe914d6f700 1 -- 172.21.15.59:0/126851074 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91009dc50 con 0x7fe91009d630 2023-09-30T22:36:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe915d71700 1 --2- 172.21.15.59:0/126851074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe910133930 0x7fe910133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe915570700 1 --2- 172.21.15.59:0/126851074 >> v2:172.21.15.59:3300/0 conn(0x7fe9100a0a30 0x7fe9100a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe914d6f700 1 --2- 172.21.15.59:0/126851074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe91009d630 0x7fe9100a1340 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe904009840 tx=0x7fe904009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83b6aa1c8bdc1463 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe90ffff700 1 -- 172.21.15.59:0/126851074 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904011830 con 0x7fe91009d630 2023-09-30T22:36:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.092+0000 7fe90ffff700 1 -- 172.21.15.59:0/126851074 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe904011990 con 0x7fe91009d630 2023-09-30T22:36:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.093+0000 7fe90ffff700 1 -- 172.21.15.59:0/126851074 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904011d20 con 0x7fe91009d630 2023-09-30T22:36:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.093+0000 7fe9177d4700 1 -- 172.21.15.59:0/126851074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe91009d630 msgr2=0x7fe9100a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.093+0000 7fe9177d4700 1 --2- 172.21.15.59:0/126851074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe91009d630 0x7fe9100a1340 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe904009840 tx=0x7fe904009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.093+0000 7fe9177d4700 1 -- 172.21.15.59:0/126851074 shutdown_connections 2023-09-30T22:36:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.093+0000 7fe9177d4700 1 --2- 172.21.15.59:0/126851074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe910133930 0x7fe910133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.093+0000 7fe9177d4700 1 --2- 172.21.15.59:0/126851074 >> v2:172.21.15.59:3300/0 conn(0x7fe9100a0a30 0x7fe9100a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.093+0000 7fe9177d4700 1 --2- 172.21.15.59:0/126851074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe91009d630 0x7fe9100a1340 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.093+0000 7fe9177d4700 1 -- 172.21.15.59:0/126851074 >> 172.21.15.59:0/126851074 conn(0x7fe9100a3050 msgr2=0x7fe9100a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.093+0000 7fe9177d4700 1 -- 172.21.15.59:0/126851074 shutdown_connections 2023-09-30T22:36:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.093+0000 7fe9177d4700 1 -- 172.21.15.59:0/126851074 wait complete. 2023-09-30T22:36:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.094+0000 7fe9177d4700 1 Processor -- start 2023-09-30T22:36:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.094+0000 7fe9177d4700 1 -- start start 2023-09-30T22:36:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe9177d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe91009d630 0x7fe91011f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe9177d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9100a0a30 0x7fe91011f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe9177d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe910133930 0x7fe9101c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe9177d4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe910121f10 con 0x7fe910133930 2023-09-30T22:36:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe9177d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe910133290 con 0x7fe91009d630 2023-09-30T22:36:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe9177d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe91011edc0 con 0x7fe9100a0a30 2023-09-30T22:36:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe915d71700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe910133930 0x7fe9101c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe915570700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe91009d630 0x7fe91011f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe915d71700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe910133930 0x7fe9101c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55504/0 (socket says 172.21.15.59:55504) 2023-09-30T22:36:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe915570700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe91009d630 0x7fe91011f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56536/0 (socket says 172.21.15.59:56536) 2023-09-30T22:36:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe915d71700 1 -- 172.21.15.59:0/2425250694 learned_addr learned my addr 172.21.15.59:0/2425250694 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe914d6f700 1 --2- 172.21.15.59:0/2425250694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9100a0a30 0x7fe91011f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe915d71700 1 -- 172.21.15.59:0/2425250694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9100a0a30 msgr2=0x7fe91011f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe915d71700 1 --2- 172.21.15.59:0/2425250694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9100a0a30 0x7fe91011f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe915d71700 1 -- 172.21.15.59:0/2425250694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe91009d630 msgr2=0x7fe91011f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe915d71700 1 --2- 172.21.15.59:0/2425250694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe91009d630 0x7fe91011f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.095+0000 7fe915d71700 1 -- 172.21.15.59:0/2425250694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900009b30 con 0x7fe910133930 2023-09-30T22:36:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.096+0000 7fe914d6f700 1 --2- 172.21.15.59:0/2425250694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9100a0a30 0x7fe91011f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.096+0000 7fe915570700 1 --2- 172.21.15.59:0/2425250694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe91009d630 0x7fe91011f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.096+0000 7fe915d71700 1 --2- 172.21.15.59:0/2425250694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe910133930 0x7fe9101c8020 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fe90800eb90 tx=0x7fe90800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.096+0000 7fe90dffb700 1 -- 172.21.15.59:0/2425250694 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080097a0 con 0x7fe910133930 2023-09-30T22:36:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.096+0000 7fe90dffb700 1 -- 172.21.15.59:0/2425250694 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe908004020 con 0x7fe910133930 2023-09-30T22:36:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.096+0000 7fe9177d4700 1 -- 172.21.15.59:0/2425250694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9080094a0 con 0x7fe910133930 2023-09-30T22:36:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.096+0000 7fe90dffb700 1 -- 172.21.15.59:0/2425250694 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080043b0 con 0x7fe910133930 2023-09-30T22:36:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.096+0000 7fe9177d4700 1 -- 172.21.15.59:0/2425250694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9040094a0 con 0x7fe910133930 2023-09-30T22:36:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.097+0000 7fe90dffb700 1 -- 172.21.15.59:0/2425250694 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe90800c850 con 0x7fe910133930 2023-09-30T22:36:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.097+0000 7fe90dffb700 1 -- 172.21.15.59:0/2425250694 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe90803f370 con 0x7fe910133930 2023-09-30T22:36:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.097+0000 7fe9177d4700 1 -- 172.21.15.59:0/2425250694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe910120570 con 0x7fe910133930 2023-09-30T22:36:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.102+0000 7fe90dffb700 1 -- 172.21.15.59:0/2425250694 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe910120570 con 0x7fe910133930 2023-09-30T22:36:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.132+0000 7fb5bf5c4700 1 Processor -- start 2023-09-30T22:36:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.132+0000 7fb5bf5c4700 1 -- start start 2023-09-30T22:36:20.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.132+0000 7fb5bf5c4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5b809d630 0x7fb5b80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:20.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.132+0000 7fb5bf5c4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5b8138d80 0x7fb5b813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:20.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.132+0000 7fb5bf5c4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b80a2a70 con 0x7fb5b80a0a30 2023-09-30T22:36:20.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.132+0000 7fb5bf5c4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b80a01d0 con 0x7fb5b809d630 2023-09-30T22:36:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.132+0000 7fb5bf5c4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b809e2b0 con 0x7fb5b8138d80 2023-09-30T22:36:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.133+0000 7fb5bcb5f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5b809d630 0x7fb5b80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.133+0000 7fb5bd360700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb5b80a0a30 0x7fb5b80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41278/0 (socket says 172.21.15.59:41278) 2023-09-30T22:36:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.133+0000 7fb5bcb5f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5b809d630 0x7fb5b80a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55520/0 (socket says 172.21.15.59:55520) 2023-09-30T22:36:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.133+0000 7fb5bdb61700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5b8138d80 0x7fb5b813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:20.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.133+0000 7fb5bd360700 1 -- 172.21.15.59:0/2349744409 learned_addr learned my addr 172.21.15.59:0/2349744409 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:20.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.133+0000 7fb5bcb5f700 1 -- 172.21.15.59:0/2349744409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5b8138d80 msgr2=0x7fb5b813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:20.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.133+0000 7fb5bcb5f700 1 --2- 172.21.15.59:0/2349744409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5b8138d80 0x7fb5b813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.133+0000 7fb5bcb5f700 1 -- 172.21.15.59:0/2349744409 >> v1:172.21.15.59:6789/0 conn(0x7fb5b80a0a30 legacy=0x7fb5b80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:20.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.133+0000 7fb5bcb5f700 1 -- 172.21.15.59:0/2349744409 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b809dc50 con 0x7fb5b809d630 2023-09-30T22:36:20.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.133+0000 7fb5affff700 1 -- 172.21.15.59:0/2349744409 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231124828 0 0) 0x7fb5b80a2a70 con 0x7fb5b80a0a30 2023-09-30T22:36:20.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.133+0000 7fb5bdb61700 1 --2- 172.21.15.59:0/2349744409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5b8138d80 0x7fb5b813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:20.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.133+0000 7fb5bcb5f700 1 --2- 172.21.15.59:0/2349744409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5b809d630 0x7fb5b80a1510 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009840 tx=0x7fb5a8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf171f4091b01cfe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.133+0000 7fb5affff700 1 -- 172.21.15.59:0/2349744409 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8011830 con 0x7fb5b809d630 2023-09-30T22:36:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.133+0000 7fb5affff700 1 -- 172.21.15.59:0/2349744409 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a8011990 con 0x7fb5b809d630 2023-09-30T22:36:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.133+0000 7fb5affff700 1 -- 172.21.15.59:0/2349744409 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8011d20 con 0x7fb5b809d630 2023-09-30T22:36:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.134+0000 7fb5bf5c4700 1 -- 172.21.15.59:0/2349744409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5b809d630 msgr2=0x7fb5b80a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.134+0000 7fb5bf5c4700 1 --2- 172.21.15.59:0/2349744409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5b809d630 0x7fb5b80a1510 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009840 tx=0x7fb5a8009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.134+0000 7fb5bf5c4700 1 -- 172.21.15.59:0/2349744409 shutdown_connections 2023-09-30T22:36:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.134+0000 7fb5bf5c4700 1 --2- 172.21.15.59:0/2349744409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5b8138d80 0x7fb5b813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.134+0000 7fb5bf5c4700 1 --2- 172.21.15.59:0/2349744409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5b809d630 0x7fb5b80a1510 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.134+0000 7fb5bf5c4700 1 -- 172.21.15.59:0/2349744409 >> 172.21.15.59:0/2349744409 conn(0x7fb5b80a3050 msgr2=0x7fb5b80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.134+0000 7fb5bf5c4700 1 -- 172.21.15.59:0/2349744409 shutdown_connections 2023-09-30T22:36:20.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.134+0000 7fb5bf5c4700 1 -- 172.21.15.59:0/2349744409 wait complete. 2023-09-30T22:36:20.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.135+0000 7fb5bf5c4700 1 Processor -- start 2023-09-30T22:36:20.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.135+0000 7fb5bf5c4700 1 -- start start 2023-09-30T22:36:20.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.135+0000 7fb5bf5c4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5b809d630 0x7fb5b8133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:20.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.135+0000 7fb5bf5c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5b80a0a30 0x7fb5b8133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:20.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.135+0000 7fb5bf5c4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5b8138d80 0x7fb5b8134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:20.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5bf5c4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8136190 con 0x7fb5b8138d80 2023-09-30T22:36:20.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5bf5c4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8136eb0 con 0x7fb5b80a0a30 2023-09-30T22:36:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5bf5c4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b80a4ba0 con 0x7fb5b809d630 2023-09-30T22:36:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5bd360700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5b809d630 0x7fb5b8133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5bdb61700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5b8138d80 0x7fb5b8134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5bd360700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5b809d630 0x7fb5b8133700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:32992/0 (socket says 172.21.15.59:32992) 2023-09-30T22:36:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5bd360700 1 -- 172.21.15.59:0/1175061485 learned_addr learned my addr 172.21.15.59:0/1175061485 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5bd360700 1 -- 172.21.15.59:0/1175061485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5b80a0a30 msgr2=0x7fb5b8133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5bd360700 1 --2- 172.21.15.59:0/1175061485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5b80a0a30 0x7fb5b8133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5bd360700 1 -- 172.21.15.59:0/1175061485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5b8138d80 msgr2=0x7fb5b8134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5bd360700 1 --2- 172.21.15.59:0/1175061485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5b8138d80 0x7fb5b8134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5bd360700 1 -- 172.21.15.59:0/1175061485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b0009a70 con 0x7fb5b809d630 2023-09-30T22:36:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5bd360700 1 --2- 172.21.15.59:0/1175061485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5b809d630 0x7fb5b8133700 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400c550 tx=0x7fb5b400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:20.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5adffb700 1 -- 172.21.15.59:0/1175061485 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4004c80 con 0x7fb5b809d630 2023-09-30T22:36:20.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5adffb700 1 -- 172.21.15.59:0/1175061485 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b4004e00 con 0x7fb5b809d630 2023-09-30T22:36:20.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5adffb700 1 -- 172.21.15.59:0/1175061485 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4007310 con 0x7fb5b809d630 2023-09-30T22:36:20.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.136+0000 7fb5bf5c4700 1 -- 172.21.15.59:0/1175061485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a80094a0 con 0x7fb5b809d630 2023-09-30T22:36:20.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.137+0000 7fb5bf5c4700 1 -- 172.21.15.59:0/1175061485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b8136540 con 0x7fb5b809d630 2023-09-30T22:36:20.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.137+0000 7fb5adffb700 1 -- 172.21.15.59:0/1175061485 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5b4007470 con 0x7fb5b809d630 2023-09-30T22:36:20.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.138+0000 7fb5adffb700 1 -- 172.21.15.59:0/1175061485 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb5b403f390 con 0x7fb5b809d630 2023-09-30T22:36:20.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.138+0000 7fb5bf5c4700 1 -- 172.21.15.59:0/1175061485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b80747f0 con 0x7fb5b809d630 2023-09-30T22:36:20.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.143+0000 7fb5adffb700 1 -- 172.21.15.59:0/1175061485 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5b40123b0 con 0x7fb5b809d630 2023-09-30T22:36:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.307+0000 7fe9177d4700 1 -- 172.21.15.59:0/2425250694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe910120570 con 0x7fe910133930 2023-09-30T22:36:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.307+0000 7fe90dffb700 1 -- 172.21.15.59:0/2425250694 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe910120570 con 0x7fe910133930 2023-09-30T22:36:20.308 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:20.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.310+0000 7fe9177d4700 1 -- 172.21.15.59:0/2425250694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe910133930 msgr2=0x7fe9101c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:20.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.310+0000 7fe9177d4700 1 --2- 172.21.15.59:0/2425250694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe910133930 0x7fe9101c8020 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fe90800eb90 tx=0x7fe90800eea0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.310+0000 7fe9177d4700 1 -- 172.21.15.59:0/2425250694 shutdown_connections 2023-09-30T22:36:20.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.310+0000 7fe9177d4700 1 --2- 172.21.15.59:0/2425250694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe910133930 0x7fe9101c8020 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.310+0000 7fe9177d4700 1 --2- 172.21.15.59:0/2425250694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe91009d630 0x7fe91011f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.310+0000 7fe9177d4700 1 --2- 172.21.15.59:0/2425250694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9100a0a30 0x7fe91011f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.310+0000 7fe9177d4700 1 -- 172.21.15.59:0/2425250694 >> 172.21.15.59:0/2425250694 conn(0x7fe9100a3050 msgr2=0x7fe9100a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:20.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.310+0000 7fe9177d4700 1 -- 172.21.15.59:0/2425250694 shutdown_connections 2023-09-30T22:36:20.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.310+0000 7fe9177d4700 1 -- 172.21.15.59:0/2425250694 wait complete. 2023-09-30T22:36:20.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:20.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.348+0000 7fb5bf5c4700 1 -- 172.21.15.59:0/1175061485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb5b8137980 con 0x7fb5b809d630 2023-09-30T22:36:20.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.348+0000 7fb5adffb700 1 -- 172.21.15.59:0/1175061485 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5b4011360 con 0x7fb5b809d630 2023-09-30T22:36:20.349 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.350+0000 7fb5bf5c4700 1 -- 172.21.15.59:0/1175061485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5b809d630 msgr2=0x7fb5b8133700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.350+0000 7fb5bf5c4700 1 --2- 172.21.15.59:0/1175061485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5b809d630 0x7fb5b8133700 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400c550 tx=0x7fb5b400c860 comp rx=0 tx=0).stop 2023-09-30T22:36:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.350+0000 7fb5bf5c4700 1 -- 172.21.15.59:0/1175061485 shutdown_connections 2023-09-30T22:36:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.350+0000 7fb5bf5c4700 1 --2- 172.21.15.59:0/1175061485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5b809d630 0x7fb5b8133700 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.350+0000 7fb5bf5c4700 1 --2- 172.21.15.59:0/1175061485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5b8138d80 0x7fb5b8134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.350+0000 7fb5bf5c4700 1 --2- 172.21.15.59:0/1175061485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5b80a0a30 0x7fb5b8133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.350+0000 7fb5bf5c4700 1 -- 172.21.15.59:0/1175061485 >> 172.21.15.59:0/1175061485 conn(0x7fb5b80a3050 msgr2=0x7fb5b809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.350+0000 7fb5bf5c4700 1 -- 172.21.15.59:0/1175061485 shutdown_connections 2023-09-30T22:36:20.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:20.350+0000 7fb5bf5c4700 1 -- 172.21.15.59:0/1175061485 wait complete. 2023-09-30T22:36:20.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:20.873 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:20.910 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:21.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.021+0000 7fc058b2a700 1 Processor -- start 2023-09-30T22:36:21.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.021+0000 7fc058b2a700 1 -- start start 2023-09-30T22:36:21.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.022+0000 7fc058b2a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0540a0a30 0x7fc0540a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.022+0000 7fc058b2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0540a1340 0x7fc054133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.022+0000 7fc058b2a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05409edd0 con 0x7fc054133fa0 2023-09-30T22:36:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.022+0000 7fc058b2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05409e1f0 con 0x7fc0540a1340 2023-09-30T22:36:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.022+0000 7fc058b2a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc05409dc50 con 0x7fc0540a0a30 2023-09-30T22:36:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.022+0000 7fc051d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0540a1340 0x7fc054133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.022+0000 7fc05259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0540a0a30 0x7fc0540a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.022+0000 7fc05259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0540a0a30 0x7fc0540a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33006/0 (socket says 172.21.15.59:33006) 2023-09-30T22:36:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.022+0000 7fc051d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0540a1340 0x7fc054133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56560/0 (socket says 172.21.15.59:56560) 2023-09-30T22:36:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.022+0000 7fc05259c700 1 -- 172.21.15.59:0/1938526605 learned_addr learned my addr 172.21.15.59:0/1938526605 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.023+0000 7fc051d9b700 1 -- 172.21.15.59:0/1938526605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0540a0a30 msgr2=0x7fc0540a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.023+0000 7fc051d9b700 1 --2- 172.21.15.59:0/1938526605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0540a0a30 0x7fc0540a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.023+0000 7fc051d9b700 1 -- 172.21.15.59:0/1938526605 >> v1:172.21.15.59:6789/0 conn(0x7fc054133fa0 legacy=0x7fc05413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.023+0000 7fc051d9b700 1 -- 172.21.15.59:0/1938526605 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0540a1fe0 con 0x7fc0540a1340 2023-09-30T22:36:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.023+0000 7fc05159a700 1 -- 172.21.15.59:0/1938526605 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296419745 0 0) 0x7fc05409edd0 con 0x7fc054133fa0 2023-09-30T22:36:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.023+0000 7fc05259c700 1 --2- 172.21.15.59:0/1938526605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0540a0a30 0x7fc0540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.023+0000 7fc051d9b700 1 --2- 172.21.15.59:0/1938526605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0540a1340 0x7fc054133a60 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009870 tx=0x7fc03c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10c5fed2aaa1b334 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.023+0000 7fc05159a700 1 -- 172.21.15.59:0/1938526605 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c011830 con 0x7fc0540a1340 2023-09-30T22:36:21.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.023+0000 7fc05159a700 1 -- 172.21.15.59:0/1938526605 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c011990 con 0x7fc0540a1340 2023-09-30T22:36:21.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.023+0000 7fc05159a700 1 -- 172.21.15.59:0/1938526605 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c011d20 con 0x7fc0540a1340 2023-09-30T22:36:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.024+0000 7fc058b2a700 1 -- 172.21.15.59:0/1938526605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0540a1340 msgr2=0x7fc054133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.024+0000 7fc058b2a700 1 --2- 172.21.15.59:0/1938526605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0540a1340 0x7fc054133a60 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009870 tx=0x7fc03c009b80 comp rx=0 tx=0).stop 2023-09-30T22:36:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.024+0000 7fc058b2a700 1 -- 172.21.15.59:0/1938526605 shutdown_connections 2023-09-30T22:36:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.024+0000 7fc058b2a700 1 --2- 172.21.15.59:0/1938526605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0540a0a30 0x7fc0540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.024+0000 7fc058b2a700 1 --2- 172.21.15.59:0/1938526605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0540a1340 0x7fc054133a60 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.024+0000 7fc058b2a700 1 -- 172.21.15.59:0/1938526605 >> 172.21.15.59:0/1938526605 conn(0x7fc0540a6550 msgr2=0x7fc0540a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.024+0000 7fc058b2a700 1 -- 172.21.15.59:0/1938526605 shutdown_connections 2023-09-30T22:36:21.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.024+0000 7fc058b2a700 1 -- 172.21.15.59:0/1938526605 wait complete. 2023-09-30T22:36:21.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.025+0000 7fc058b2a700 1 Processor -- start 2023-09-30T22:36:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.026+0000 7fc058b2a700 1 -- start start 2023-09-30T22:36:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.026+0000 7fc058b2a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0540a0a30 0x7fc05411e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.026+0000 7fc058b2a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0540a1340 0x7fc05411ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.026+0000 7fc058b2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc054133fa0 0x7fc05411f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.026+0000 7fc058b2a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0541221d0 con 0x7fc0540a0a30 2023-09-30T22:36:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.026+0000 7fc058b2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0541202c0 con 0x7fc054133fa0 2023-09-30T22:36:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.026+0000 7fc058b2a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc05409bf90 con 0x7fc0540a1340 2023-09-30T22:36:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.026+0000 7fc051d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0540a1340 0x7fc05411ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.026+0000 7fc051d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0540a1340 0x7fc05411ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33012/0 (socket says 172.21.15.59:33012) 2023-09-30T22:36:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.026+0000 7fc051d9b700 1 -- 172.21.15.59:0/1332704900 learned_addr learned my addr 172.21.15.59:0/1332704900 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:21.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.026+0000 7fc05259c700 1 --2- 172.21.15.59:0/1332704900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0540a0a30 0x7fc05411e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.027+0000 7fc052d9d700 1 --2- 172.21.15.59:0/1332704900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc054133fa0 0x7fc05411f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.027+0000 7fc052d9d700 1 -- 172.21.15.59:0/1332704900 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0540a1340 msgr2=0x7fc05411ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.027+0000 7fc052d9d700 1 --2- 172.21.15.59:0/1332704900 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0540a1340 0x7fc05411ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.027+0000 7fc052d9d700 1 -- 172.21.15.59:0/1332704900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0540a0a30 msgr2=0x7fc05411e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.027+0000 7fc052d9d700 1 --2- 172.21.15.59:0/1332704900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0540a0a30 0x7fc05411e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.027+0000 7fc052d9d700 1 -- 172.21.15.59:0/1332704900 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c009550 con 0x7fc054133fa0 2023-09-30T22:36:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.027+0000 7fc051d9b700 1 --2- 172.21.15.59:0/1332704900 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0540a1340 0x7fc05411ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.027+0000 7fc05259c700 1 --2- 172.21.15.59:0/1332704900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0540a0a30 0x7fc05411e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.027+0000 7fc052d9d700 1 --2- 172.21.15.59:0/1332704900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc054133fa0 0x7fc05411f1c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc04400c7f0 tx=0x7fc04400cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.027+0000 7fc04affd700 1 -- 172.21.15.59:0/1332704900 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044003e30 con 0x7fc054133fa0 2023-09-30T22:36:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.027+0000 7fc04affd700 1 -- 172.21.15.59:0/1332704900 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc044005070 con 0x7fc054133fa0 2023-09-30T22:36:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.027+0000 7fc058b2a700 1 -- 172.21.15.59:0/1332704900 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03c0094a0 con 0x7fc054133fa0 2023-09-30T22:36:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.027+0000 7fc04affd700 1 -- 172.21.15.59:0/1332704900 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044005420 con 0x7fc054133fa0 2023-09-30T22:36:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.027+0000 7fc058b2a700 1 -- 172.21.15.59:0/1332704900 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0540a25e0 con 0x7fc054133fa0 2023-09-30T22:36:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.028+0000 7fc04affd700 1 -- 172.21.15.59:0/1332704900 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc044005580 con 0x7fc054133fa0 2023-09-30T22:36:21.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.028+0000 7fc04affd700 1 -- 172.21.15.59:0/1332704900 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc04403ec70 con 0x7fc054133fa0 2023-09-30T22:36:21.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.028+0000 7fc058b2a700 1 -- 172.21.15.59:0/1332704900 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc054074ea0 con 0x7fc054133fa0 2023-09-30T22:36:21.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.037+0000 7fc04affd700 1 -- 172.21.15.59:0/1332704900 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc044019b40 con 0x7fc054133fa0 2023-09-30T22:36:21.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.062+0000 7fd0268eb700 1 Processor -- start 2023-09-30T22:36:21.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.062+0000 7fd0268eb700 1 -- start start 2023-09-30T22:36:21.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd0268eb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd0200a0a30 0x7fd0200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd0268eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02009d630 0x7fd0200a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd0268eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd020133930 0x7fd020133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd0268eb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0200a2a70 con 0x7fd0200a0a30 2023-09-30T22:36:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd0268eb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200a01d0 con 0x7fd02009d630 2023-09-30T22:36:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd0268eb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd02009e2b0 con 0x7fd020133930 2023-09-30T22:36:21.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd024e88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd020133930 0x7fd020133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd024e88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd020133930 0x7fd020133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33024/0 (socket says 172.21.15.59:33024) 2023-09-30T22:36:21.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd01f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02009d630 0x7fd0200a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd024e88700 1 -- 172.21.15.59:0/22421453 learned_addr learned my addr 172.21.15.59:0/22421453 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:21.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd01ffff700 1 --2- 172.21.15.59:0/22421453 >> v2:172.21.15.59:3300/0 conn(0x7fd0200a0a30 0x7fd0200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd024e88700 1 -- 172.21.15.59:0/22421453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02009d630 msgr2=0x7fd0200a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd024e88700 1 --2- 172.21.15.59:0/22421453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02009d630 0x7fd0200a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd024e88700 1 -- 172.21.15.59:0/22421453 >> v2:172.21.15.59:3300/0 conn(0x7fd0200a0a30 msgr2=0x7fd0200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd024e88700 1 --2- 172.21.15.59:0/22421453 >> v2:172.21.15.59:3300/0 conn(0x7fd0200a0a30 0x7fd0200a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd024e88700 1 -- 172.21.15.59:0/22421453 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02009dc50 con 0x7fd020133930 2023-09-30T22:36:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd01f7fe700 1 --2- 172.21.15.59:0/22421453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02009d630 0x7fd0200a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.063+0000 7fd024e88700 1 --2- 172.21.15.59:0/22421453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd020133930 0x7fd020133db0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd018009e50 tx=0x7fd01800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=108e2add0907cd84 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.064+0000 7fd01effd700 1 -- 172.21.15.59:0/22421453 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01800e070 con 0x7fd020133930 2023-09-30T22:36:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.064+0000 7fd01effd700 1 -- 172.21.15.59:0/22421453 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01800b910 con 0x7fd020133930 2023-09-30T22:36:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.064+0000 7fd01effd700 1 -- 172.21.15.59:0/22421453 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01800bcc0 con 0x7fd020133930 2023-09-30T22:36:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.064+0000 7fd0268eb700 1 -- 172.21.15.59:0/22421453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd020133930 msgr2=0x7fd020133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.064+0000 7fd0268eb700 1 --2- 172.21.15.59:0/22421453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd020133930 0x7fd020133db0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd018009e50 tx=0x7fd01800b330 comp rx=0 tx=0).stop 2023-09-30T22:36:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.064+0000 7fd0268eb700 1 -- 172.21.15.59:0/22421453 shutdown_connections 2023-09-30T22:36:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.064+0000 7fd0268eb700 1 --2- 172.21.15.59:0/22421453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd020133930 0x7fd020133db0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.064+0000 7fd0268eb700 1 --2- 172.21.15.59:0/22421453 >> v2:172.21.15.59:3300/0 conn(0x7fd0200a0a30 0x7fd0200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.064+0000 7fd0268eb700 1 --2- 172.21.15.59:0/22421453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02009d630 0x7fd0200a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.064+0000 7fd0268eb700 1 -- 172.21.15.59:0/22421453 >> 172.21.15.59:0/22421453 conn(0x7fd0200a3050 msgr2=0x7fd0200a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.064+0000 7fd0268eb700 1 -- 172.21.15.59:0/22421453 shutdown_connections 2023-09-30T22:36:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.064+0000 7fd0268eb700 1 -- 172.21.15.59:0/22421453 wait complete. 2023-09-30T22:36:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.065+0000 7fd0268eb700 1 Processor -- start 2023-09-30T22:36:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.066+0000 7fd0268eb700 1 -- start start 2023-09-30T22:36:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.066+0000 7fd0268eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02009d630 0x7fd0201c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.066+0000 7fd0268eb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0200a0a30 0x7fd0201c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.066+0000 7fd0268eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd020133930 0x7fd0201c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.066+0000 7fd0268eb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd020122720 con 0x7fd0200a0a30 2023-09-30T22:36:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.066+0000 7fd0268eb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0201209b0 con 0x7fd02009d630 2023-09-30T22:36:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.066+0000 7fd0268eb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd020120780 con 0x7fd020133930 2023-09-30T22:36:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.066+0000 7fd01f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0200a0a30 0x7fd0201c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.066+0000 7fd024e88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd020133930 0x7fd0201c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.066+0000 7fd01ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02009d630 0x7fd0201c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.066+0000 7fd01f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0200a0a30 0x7fd0201c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55560/0 (socket says 172.21.15.59:55560) 2023-09-30T22:36:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.066+0000 7fd01f7fe700 1 -- 172.21.15.59:0/3617465984 learned_addr learned my addr 172.21.15.59:0/3617465984 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.067+0000 7fd01ffff700 1 -- 172.21.15.59:0/3617465984 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd020133930 msgr2=0x7fd0201c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.067+0000 7fd01ffff700 1 --2- 172.21.15.59:0/3617465984 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd020133930 0x7fd0201c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.067+0000 7fd01ffff700 1 -- 172.21.15.59:0/3617465984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0200a0a30 msgr2=0x7fd0201c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.067+0000 7fd01ffff700 1 --2- 172.21.15.59:0/3617465984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0200a0a30 0x7fd0201c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.067+0000 7fd01ffff700 1 -- 172.21.15.59:0/3617465984 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0140094a0 con 0x7fd02009d630 2023-09-30T22:36:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.067+0000 7fd01f7fe700 1 --2- 172.21.15.59:0/3617465984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0200a0a30 0x7fd0201c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.067+0000 7fd01ffff700 1 --2- 172.21.15.59:0/3617465984 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02009d630 0x7fd0201c8090 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd01000e900 tx=0x7fd01000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.067+0000 7fd01cff9700 1 -- 172.21.15.59:0/3617465984 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010013680 con 0x7fd02009d630 2023-09-30T22:36:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.067+0000 7fd01cff9700 1 -- 172.21.15.59:0/3617465984 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0100137e0 con 0x7fd02009d630 2023-09-30T22:36:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.067+0000 7fd0268eb700 1 -- 172.21.15.59:0/3617465984 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd018009b30 con 0x7fd02009d630 2023-09-30T22:36:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.067+0000 7fd01cff9700 1 -- 172.21.15.59:0/3617465984 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010013b50 con 0x7fd02009d630 2023-09-30T22:36:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.067+0000 7fd0268eb700 1 -- 172.21.15.59:0/3617465984 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd020121700 con 0x7fd02009d630 2023-09-30T22:36:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.068+0000 7fd01cff9700 1 -- 172.21.15.59:0/3617465984 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd010013cb0 con 0x7fd02009d630 2023-09-30T22:36:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.068+0000 7fd01cff9700 1 -- 172.21.15.59:0/3617465984 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd01003f840 con 0x7fd02009d630 2023-09-30T22:36:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.068+0000 7fd0268eb700 1 -- 172.21.15.59:0/3617465984 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0200747f0 con 0x7fd02009d630 2023-09-30T22:36:21.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.073+0000 7fd01cff9700 1 -- 172.21.15.59:0/3617465984 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd01001b590 con 0x7fd02009d630 2023-09-30T22:36:21.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.245+0000 7fc058b2a700 1 -- 172.21.15.59:0/1332704900 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc0540a28e0 con 0x7fc054133fa0 2023-09-30T22:36:21.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.245+0000 7fc04affd700 1 -- 172.21.15.59:0/1332704900 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc044017020 con 0x7fc054133fa0 2023-09-30T22:36:21.246 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.247+0000 7fc058b2a700 1 -- 172.21.15.59:0/1332704900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc054133fa0 msgr2=0x7fc05411f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.247+0000 7fc058b2a700 1 --2- 172.21.15.59:0/1332704900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc054133fa0 0x7fc05411f1c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc04400c7f0 tx=0x7fc04400cb00 comp rx=0 tx=0).stop 2023-09-30T22:36:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.247+0000 7fc058b2a700 1 -- 172.21.15.59:0/1332704900 shutdown_connections 2023-09-30T22:36:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.247+0000 7fc058b2a700 1 --2- 172.21.15.59:0/1332704900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc054133fa0 0x7fc05411f1c0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.247+0000 7fc058b2a700 1 --2- 172.21.15.59:0/1332704900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0540a0a30 0x7fc05411e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.247+0000 7fc058b2a700 1 --2- 172.21.15.59:0/1332704900 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0540a1340 0x7fc05411ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.247+0000 7fc058b2a700 1 -- 172.21.15.59:0/1332704900 >> 172.21.15.59:0/1332704900 conn(0x7fc0540a6550 msgr2=0x7fc0541b9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.247+0000 7fc058b2a700 1 -- 172.21.15.59:0/1332704900 shutdown_connections 2023-09-30T22:36:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.247+0000 7fc058b2a700 1 -- 172.21.15.59:0/1332704900 wait complete. 2023-09-30T22:36:21.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:21.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.276+0000 7fd0268eb700 1 -- 172.21.15.59:0/3617465984 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd020122580 con 0x7fd02009d630 2023-09-30T22:36:21.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.276+0000 7fd01cff9700 1 -- 172.21.15.59:0/3617465984 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd020122580 con 0x7fd02009d630 2023-09-30T22:36:21.277 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:21.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.278+0000 7fd0268eb700 1 -- 172.21.15.59:0/3617465984 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02009d630 msgr2=0x7fd0201c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.278+0000 7fd0268eb700 1 --2- 172.21.15.59:0/3617465984 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02009d630 0x7fd0201c8090 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd01000e900 tx=0x7fd01000ec10 comp rx=0 tx=0).stop 2023-09-30T22:36:21.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.278+0000 7fd0268eb700 1 -- 172.21.15.59:0/3617465984 shutdown_connections 2023-09-30T22:36:21.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.278+0000 7fd0268eb700 1 --2- 172.21.15.59:0/3617465984 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd020133930 0x7fd0201c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.278+0000 7fd0268eb700 1 --2- 172.21.15.59:0/3617465984 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd02009d630 0x7fd0201c8090 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.278+0000 7fd0268eb700 1 --2- 172.21.15.59:0/3617465984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0200a0a30 0x7fd0201c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.278+0000 7fd0268eb700 1 -- 172.21.15.59:0/3617465984 >> 172.21.15.59:0/3617465984 conn(0x7fd0200a3050 msgr2=0x7fd02009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:21.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.279+0000 7fd0268eb700 1 -- 172.21.15.59:0/3617465984 shutdown_connections 2023-09-30T22:36:21.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.279+0000 7fd0268eb700 1 -- 172.21.15.59:0/3617465984 wait complete. 2023-09-30T22:36:21.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:21.325 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:21.365 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:21.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.477+0000 7f6aa8cd7700 1 Processor -- start 2023-09-30T22:36:21.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.477+0000 7f6aa8cd7700 1 -- start start 2023-09-30T22:36:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.478+0000 7f6aa8cd7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6aa40a0a30 0x7f6aa40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.478+0000 7f6aa8cd7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4138d80 0x7f6aa413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.478+0000 7f6aa8cd7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa40a2a70 con 0x7f6aa409d630 2023-09-30T22:36:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.478+0000 7f6aa8cd7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa40a01d0 con 0x7f6aa40a0a30 2023-09-30T22:36:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.478+0000 7f6aa8cd7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa409e2b0 con 0x7f6aa4138d80 2023-09-30T22:36:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.478+0000 7f6aa2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4138d80 0x7f6aa413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.478+0000 7f6aa259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6aa40a0a30 0x7f6aa40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.478+0000 7f6aa2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4138d80 0x7f6aa413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56594/0 (socket says 172.21.15.59:56594) 2023-09-30T22:36:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.478+0000 7f6aa2d9d700 1 -- 172.21.15.59:0/4157208520 learned_addr learned my addr 172.21.15.59:0/4157208520 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.478+0000 7f6aa2d9d700 1 -- 172.21.15.59:0/4157208520 >> v2:172.21.15.59:3300/0 conn(0x7f6aa40a0a30 msgr2=0x7f6aa40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.478+0000 7f6aa2d9d700 1 --2- 172.21.15.59:0/4157208520 >> v2:172.21.15.59:3300/0 conn(0x7f6aa40a0a30 0x7f6aa40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.478+0000 7f6aa2d9d700 1 -- 172.21.15.59:0/4157208520 >> v1:172.21.15.59:6789/0 conn(0x7f6aa409d630 legacy=0x7f6aa40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.478+0000 7f6aa2d9d700 1 -- 172.21.15.59:0/4157208520 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa409dc50 con 0x7f6aa4138d80 2023-09-30T22:36:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.478+0000 7f6aa259c700 1 --2- 172.21.15.59:0/4157208520 >> v2:172.21.15.59:3300/0 conn(0x7f6aa40a0a30 0x7f6aa40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.479+0000 7f6aa2d9d700 1 --2- 172.21.15.59:0/4157208520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4138d80 0x7f6aa413b160 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c009e50 tx=0x7f6a9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd533b4d116b406b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.479+0000 7f6aa159a700 1 -- 172.21.15.59:0/4157208520 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00e070 con 0x7f6aa4138d80 2023-09-30T22:36:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.479+0000 7f6aa159a700 1 -- 172.21.15.59:0/4157208520 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c00b910 con 0x7f6aa4138d80 2023-09-30T22:36:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.479+0000 7f6aa159a700 1 -- 172.21.15.59:0/4157208520 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00bcc0 con 0x7f6aa4138d80 2023-09-30T22:36:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.480+0000 7f6aa8cd7700 1 -- 172.21.15.59:0/4157208520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4138d80 msgr2=0x7f6aa413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.480+0000 7f6aa8cd7700 1 --2- 172.21.15.59:0/4157208520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4138d80 0x7f6aa413b160 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c009e50 tx=0x7f6a9c00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.480+0000 7f6aa8cd7700 1 -- 172.21.15.59:0/4157208520 shutdown_connections 2023-09-30T22:36:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.480+0000 7f6aa8cd7700 1 --2- 172.21.15.59:0/4157208520 >> v2:172.21.15.59:3300/0 conn(0x7f6aa40a0a30 0x7f6aa40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.480+0000 7f6aa8cd7700 1 --2- 172.21.15.59:0/4157208520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4138d80 0x7f6aa413b160 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.480+0000 7f6aa8cd7700 1 -- 172.21.15.59:0/4157208520 >> 172.21.15.59:0/4157208520 conn(0x7f6aa40a3050 msgr2=0x7f6aa40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.480+0000 7f6aa8cd7700 1 -- 172.21.15.59:0/4157208520 shutdown_connections 2023-09-30T22:36:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.480+0000 7f6aa8cd7700 1 -- 172.21.15.59:0/4157208520 wait complete. 2023-09-30T22:36:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.482+0000 7f6aa8cd7700 1 Processor -- start 2023-09-30T22:36:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.482+0000 7f6aa8cd7700 1 -- start start 2023-09-30T22:36:21.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.482+0000 7f6aa8cd7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa409d630 0x7f6aa4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.482+0000 7f6aa8cd7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa40a0a30 0x7f6aa4133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.482+0000 7f6aa8cd7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4138d80 0x7f6aa41344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.482+0000 7f6aa8cd7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa4136b90 con 0x7f6aa40a0a30 2023-09-30T22:36:21.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.482+0000 7f6aa8cd7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa4138090 con 0x7f6aa4138d80 2023-09-30T22:36:21.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.482+0000 7f6aa8cd7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa41374b0 con 0x7f6aa409d630 2023-09-30T22:36:21.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6aa1d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa40a0a30 0x7f6aa4133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6aa2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4138d80 0x7f6aa41344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6aa1d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa40a0a30 0x7f6aa4133f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55570/0 (socket says 172.21.15.59:55570) 2023-09-30T22:36:21.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6aa259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa409d630 0x7f6aa4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6aa2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4138d80 0x7f6aa41344b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56604/0 (socket says 172.21.15.59:56604) 2023-09-30T22:36:21.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6aa1d9b700 1 -- 172.21.15.59:0/2758646200 learned_addr learned my addr 172.21.15.59:0/2758646200 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:21.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6aa1d9b700 1 -- 172.21.15.59:0/2758646200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa409d630 msgr2=0x7f6aa4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6aa1d9b700 1 --2- 172.21.15.59:0/2758646200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa409d630 0x7f6aa4133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6aa1d9b700 1 -- 172.21.15.59:0/2758646200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4138d80 msgr2=0x7f6aa41344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6aa1d9b700 1 --2- 172.21.15.59:0/2758646200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4138d80 0x7f6aa41344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6aa1d9b700 1 -- 172.21.15.59:0/2758646200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a940094a0 con 0x7f6aa40a0a30 2023-09-30T22:36:21.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6aa2d9d700 1 --2- 172.21.15.59:0/2758646200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4138d80 0x7f6aa41344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:21.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6aa259c700 1 --2- 172.21.15.59:0/2758646200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa409d630 0x7f6aa4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:21.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6aa1d9b700 1 --2- 172.21.15.59:0/2758646200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa40a0a30 0x7f6aa4133f70 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800c510 tx=0x7f6a9800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:21.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6a92ffd700 1 -- 172.21.15.59:0/2758646200 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a980052d0 con 0x7f6aa40a0a30 2023-09-30T22:36:21.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6a92ffd700 1 -- 172.21.15.59:0/2758646200 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a98005430 con 0x7f6aa40a0a30 2023-09-30T22:36:21.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.483+0000 7f6aa8cd7700 1 -- 172.21.15.59:0/2758646200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c009b30 con 0x7f6aa40a0a30 2023-09-30T22:36:21.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.484+0000 7f6a92ffd700 1 -- 172.21.15.59:0/2758646200 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a980038c0 con 0x7f6aa40a0a30 2023-09-30T22:36:21.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.484+0000 7f6aa8cd7700 1 -- 172.21.15.59:0/2758646200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa41371d0 con 0x7f6aa40a0a30 2023-09-30T22:36:21.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.484+0000 7f6a92ffd700 1 -- 172.21.15.59:0/2758646200 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a98003a20 con 0x7f6aa40a0a30 2023-09-30T22:36:21.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.484+0000 7f6a92ffd700 1 -- 172.21.15.59:0/2758646200 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6a9803ea80 con 0x7f6aa40a0a30 2023-09-30T22:36:21.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.485+0000 7f6aa8cd7700 1 -- 172.21.15.59:0/2758646200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa4137030 con 0x7f6aa40a0a30 2023-09-30T22:36:21.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.490+0000 7f6a92ffd700 1 -- 172.21.15.59:0/2758646200 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6aa4137030 con 0x7f6aa40a0a30 2023-09-30T22:36:21.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.526+0000 7f1193714700 1 Processor -- start 2023-09-30T22:36:21.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.526+0000 7f1193714700 1 -- start start 2023-09-30T22:36:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f1193714700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f118c06b250 0x7f118c136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f1193714700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f118c136d80 0x7f118c139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f1193714700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c09ece0 con 0x7f118c06a770 2023-09-30T22:36:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f1193714700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c06b640 con 0x7f118c136d80 2023-09-30T22:36:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f1193714700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c09e760 con 0x7f118c06b250 2023-09-30T22:36:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f1191cb1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f118c136d80 0x7f118c139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f11914b0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f118c06a770 0x7f118c06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41308/0 (socket says 172.21.15.59:41308) 2023-09-30T22:36:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f1191cb1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f118c136d80 0x7f118c139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55578/0 (socket says 172.21.15.59:55578) 2023-09-30T22:36:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f11914b0700 1 -- 172.21.15.59:0/3190888665 learned_addr learned my addr 172.21.15.59:0/3190888665 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f1190caf700 1 --2- 172.21.15.59:0/3190888665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f118c06b250 0x7f118c136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f1183fff700 1 -- 172.21.15.59:0/3190888665 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050016423 0 0) 0x7f118c09ece0 con 0x7f118c06a770 2023-09-30T22:36:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f1183fff700 1 -- 172.21.15.59:0/3190888665 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11780035b0 con 0x7f118c06a770 2023-09-30T22:36:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f1190caf700 1 -- 172.21.15.59:0/3190888665 >> v2:172.21.15.59:3300/0 conn(0x7f118c136d80 msgr2=0x7f118c139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f1190caf700 1 --2- 172.21.15.59:0/3190888665 >> v2:172.21.15.59:3300/0 conn(0x7f118c136d80 0x7f118c139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f1190caf700 1 -- 172.21.15.59:0/3190888665 >> v1:172.21.15.59:6789/0 conn(0x7f118c06a770 legacy=0x7f118c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f1190caf700 1 -- 172.21.15.59:0/3190888665 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c09e040 con 0x7f118c06b250 2023-09-30T22:36:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.527+0000 7f1191cb1700 1 --2- 172.21.15.59:0/3190888665 >> v2:172.21.15.59:3300/0 conn(0x7f118c136d80 0x7f118c139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.528+0000 7f1190caf700 1 --2- 172.21.15.59:0/3190888665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f118c06b250 0x7f118c136840 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f117c009840 tx=0x7f117c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6137bf502104e917 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.528+0000 7f1183fff700 1 -- 172.21.15.59:0/3190888665 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c011830 con 0x7f118c06b250 2023-09-30T22:36:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.528+0000 7f1183fff700 1 -- 172.21.15.59:0/3190888665 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c011990 con 0x7f118c06b250 2023-09-30T22:36:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.528+0000 7f1183fff700 1 -- 172.21.15.59:0/3190888665 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c011d20 con 0x7f118c06b250 2023-09-30T22:36:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.528+0000 7f1193714700 1 -- 172.21.15.59:0/3190888665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f118c06b250 msgr2=0x7f118c136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.528+0000 7f1193714700 1 --2- 172.21.15.59:0/3190888665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f118c06b250 0x7f118c136840 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f117c009840 tx=0x7f117c009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.528+0000 7f1193714700 1 -- 172.21.15.59:0/3190888665 shutdown_connections 2023-09-30T22:36:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.528+0000 7f1193714700 1 --2- 172.21.15.59:0/3190888665 >> v2:172.21.15.59:3300/0 conn(0x7f118c136d80 0x7f118c139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.528+0000 7f1193714700 1 --2- 172.21.15.59:0/3190888665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f118c06b250 0x7f118c136840 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.528+0000 7f1193714700 1 -- 172.21.15.59:0/3190888665 >> 172.21.15.59:0/3190888665 conn(0x7f118c066f50 msgr2=0x7f118c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.529+0000 7f1193714700 1 -- 172.21.15.59:0/3190888665 shutdown_connections 2023-09-30T22:36:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.529+0000 7f1193714700 1 -- 172.21.15.59:0/3190888665 wait complete. 2023-09-30T22:36:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.529+0000 7f1193714700 1 Processor -- start 2023-09-30T22:36:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.530+0000 7f1193714700 1 -- start start 2023-09-30T22:36:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.530+0000 7f1193714700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f118c06a770 0x7f118c1c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.530+0000 7f1193714700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f118c06b250 0x7f118c1c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.530+0000 7f1193714700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f118c136d80 0x7f118c1c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.530+0000 7f1193714700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c09c010 con 0x7f118c06b250 2023-09-30T22:36:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.530+0000 7f1193714700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c1222f0 con 0x7f118c136d80 2023-09-30T22:36:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.530+0000 7f1193714700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0a25a0 con 0x7f118c06a770 2023-09-30T22:36:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.530+0000 7f1191cb1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f118c136d80 0x7f118c1c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.530+0000 7f1191cb1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f118c136d80 0x7f118c1c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56616/0 (socket says 172.21.15.59:56616) 2023-09-30T22:36:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.530+0000 7f1191cb1700 1 -- 172.21.15.59:0/3304952599 learned_addr learned my addr 172.21.15.59:0/3304952599 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.530+0000 7f11914b0700 1 --2- 172.21.15.59:0/3304952599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f118c06a770 0x7f118c1c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.530+0000 7f1190caf700 1 --2- 172.21.15.59:0/3304952599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f118c06b250 0x7f118c1c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.531+0000 7f1191cb1700 1 -- 172.21.15.59:0/3304952599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f118c06a770 msgr2=0x7f118c1c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.531+0000 7f1191cb1700 1 --2- 172.21.15.59:0/3304952599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f118c06a770 0x7f118c1c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.531+0000 7f1191cb1700 1 -- 172.21.15.59:0/3304952599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f118c06b250 msgr2=0x7f118c1c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.531+0000 7f1191cb1700 1 --2- 172.21.15.59:0/3304952599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f118c06b250 0x7f118c1c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.531+0000 7f1191cb1700 1 -- 172.21.15.59:0/3304952599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1184009a70 con 0x7f118c136d80 2023-09-30T22:36:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.531+0000 7f1191cb1700 1 --2- 172.21.15.59:0/3304952599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f118c136d80 0x7f118c1c8b80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f118400ef90 tx=0x7f118400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.531+0000 7f1181ffb700 1 -- 172.21.15.59:0/3304952599 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118400cc90 con 0x7f118c136d80 2023-09-30T22:36:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.531+0000 7f1181ffb700 1 -- 172.21.15.59:0/3304952599 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118400f040 con 0x7f118c136d80 2023-09-30T22:36:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.531+0000 7f1193714700 1 -- 172.21.15.59:0/3304952599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117c0094a0 con 0x7f118c136d80 2023-09-30T22:36:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.531+0000 7f1181ffb700 1 -- 172.21.15.59:0/3304952599 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11840146c0 con 0x7f118c136d80 2023-09-30T22:36:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.531+0000 7f1193714700 1 -- 172.21.15.59:0/3304952599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c121c70 con 0x7f118c136d80 2023-09-30T22:36:21.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.532+0000 7f1181ffb700 1 -- 172.21.15.59:0/3304952599 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1184014820 con 0x7f118c136d80 2023-09-30T22:36:21.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.532+0000 7f1193714700 1 -- 172.21.15.59:0/3304952599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c074ea0 con 0x7f118c136d80 2023-09-30T22:36:21.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.532+0000 7f1181ffb700 1 -- 172.21.15.59:0/3304952599 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1184040440 con 0x7f118c136d80 2023-09-30T22:36:21.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.537+0000 7f1181ffb700 1 -- 172.21.15.59:0/3304952599 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1184012930 con 0x7f118c136d80 2023-09-30T22:36:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.706+0000 7f6aa8cd7700 1 -- 172.21.15.59:0/2758646200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6aa4137030 con 0x7f6aa40a0a30 2023-09-30T22:36:21.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.707+0000 7f6a92ffd700 1 -- 172.21.15.59:0/2758646200 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6aa4137030 con 0x7f6aa40a0a30 2023-09-30T22:36:21.707 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.709+0000 7f6aa8cd7700 1 -- 172.21.15.59:0/2758646200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa40a0a30 msgr2=0x7f6aa4133f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.709+0000 7f6aa8cd7700 1 --2- 172.21.15.59:0/2758646200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa40a0a30 0x7f6aa4133f70 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800c510 tx=0x7f6a9800c820 comp rx=0 tx=0).stop 2023-09-30T22:36:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.709+0000 7f6aa8cd7700 1 -- 172.21.15.59:0/2758646200 shutdown_connections 2023-09-30T22:36:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.709+0000 7f6aa8cd7700 1 --2- 172.21.15.59:0/2758646200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6aa409d630 0x7f6aa4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.709+0000 7f6aa8cd7700 1 --2- 172.21.15.59:0/2758646200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6aa4138d80 0x7f6aa41344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.709+0000 7f6aa8cd7700 1 --2- 172.21.15.59:0/2758646200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa40a0a30 0x7f6aa4133f70 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.709+0000 7f6aa8cd7700 1 -- 172.21.15.59:0/2758646200 >> 172.21.15.59:0/2758646200 conn(0x7f6aa40a3050 msgr2=0x7f6aa409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.709+0000 7f6aa8cd7700 1 -- 172.21.15.59:0/2758646200 shutdown_connections 2023-09-30T22:36:21.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.709+0000 7f6aa8cd7700 1 -- 172.21.15.59:0/2758646200 wait complete. 2023-09-30T22:36:21.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.742+0000 7f1193714700 1 -- 172.21.15.59:0/3304952599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f118c06c360 con 0x7f118c136d80 2023-09-30T22:36:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.743+0000 7f1181ffb700 1 -- 172.21.15.59:0/3304952599 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1184012340 con 0x7f118c136d80 2023-09-30T22:36:21.743 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.745+0000 7f1193714700 1 -- 172.21.15.59:0/3304952599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f118c136d80 msgr2=0x7f118c1c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.745+0000 7f1193714700 1 --2- 172.21.15.59:0/3304952599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f118c136d80 0x7f118c1c8b80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f118400ef90 tx=0x7f118400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.745+0000 7f1193714700 1 -- 172.21.15.59:0/3304952599 shutdown_connections 2023-09-30T22:36:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.745+0000 7f1193714700 1 --2- 172.21.15.59:0/3304952599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f118c06a770 0x7f118c1c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.745+0000 7f1193714700 1 --2- 172.21.15.59:0/3304952599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f118c136d80 0x7f118c1c8b80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.745+0000 7f1193714700 1 --2- 172.21.15.59:0/3304952599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f118c06b250 0x7f118c1c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.745+0000 7f1193714700 1 -- 172.21.15.59:0/3304952599 >> 172.21.15.59:0/3304952599 conn(0x7f118c066f50 msgr2=0x7f118c1347a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.745+0000 7f1193714700 1 -- 172.21.15.59:0/3304952599 shutdown_connections 2023-09-30T22:36:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:21.745+0000 7f1193714700 1 -- 172.21.15.59:0/3304952599 wait complete. 2023-09-30T22:36:21.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:22.263 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:22.294 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:22.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.412+0000 7fc749a3b700 1 Processor -- start 2023-09-30T22:36:22.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.412+0000 7fc749a3b700 1 -- start start 2023-09-30T22:36:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.413+0000 7fc749a3b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7440a0a30 0x7fc7440a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.413+0000 7fc749a3b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc744134170 0x7fc74413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.413+0000 7fc749a3b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74409edd0 con 0x7fc7440a1340 2023-09-30T22:36:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.413+0000 7fc749a3b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74409e1f0 con 0x7fc744134170 2023-09-30T22:36:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.413+0000 7fc749a3b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74409dc50 con 0x7fc7440a0a30 2023-09-30T22:36:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.413+0000 7fc742ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7440a0a30 0x7fc7440a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.413+0000 7fc7437fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc744134170 0x7fc74413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.413+0000 7fc742ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7440a0a30 0x7fc7440a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56620/0 (socket says 172.21.15.59:56620) 2023-09-30T22:36:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.413+0000 7fc742ffd700 1 -- 172.21.15.59:0/9803856 learned_addr learned my addr 172.21.15.59:0/9803856 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.413+0000 7fc742ffd700 1 -- 172.21.15.59:0/9803856 >> v2:172.21.15.59:3300/0 conn(0x7fc744134170 msgr2=0x7fc74413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.413+0000 7fc742ffd700 1 --2- 172.21.15.59:0/9803856 >> v2:172.21.15.59:3300/0 conn(0x7fc744134170 0x7fc74413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.413+0000 7fc742ffd700 1 -- 172.21.15.59:0/9803856 >> v1:172.21.15.59:6789/0 conn(0x7fc7440a1340 legacy=0x7fc744133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.413+0000 7fc742ffd700 1 -- 172.21.15.59:0/9803856 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7440a1fe0 con 0x7fc7440a0a30 2023-09-30T22:36:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.413+0000 7fc7437fe700 1 --2- 172.21.15.59:0/9803856 >> v2:172.21.15.59:3300/0 conn(0x7fc744134170 0x7fc74413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.414+0000 7fc742ffd700 1 --2- 172.21.15.59:0/9803856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7440a0a30 0x7fc7440a0e00 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009e50 tx=0x7fc73c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fca745b2a108527 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.414+0000 7fc741ffb700 1 -- 172.21.15.59:0/9803856 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00e070 con 0x7fc7440a0a30 2023-09-30T22:36:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.414+0000 7fc741ffb700 1 -- 172.21.15.59:0/9803856 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c00b910 con 0x7fc7440a0a30 2023-09-30T22:36:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.414+0000 7fc741ffb700 1 -- 172.21.15.59:0/9803856 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00bcc0 con 0x7fc7440a0a30 2023-09-30T22:36:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.414+0000 7fc749a3b700 1 -- 172.21.15.59:0/9803856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7440a0a30 msgr2=0x7fc7440a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.414+0000 7fc749a3b700 1 --2- 172.21.15.59:0/9803856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7440a0a30 0x7fc7440a0e00 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009e50 tx=0x7fc73c00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.415+0000 7fc749a3b700 1 -- 172.21.15.59:0/9803856 shutdown_connections 2023-09-30T22:36:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.415+0000 7fc749a3b700 1 --2- 172.21.15.59:0/9803856 >> v2:172.21.15.59:3300/0 conn(0x7fc744134170 0x7fc74413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.415+0000 7fc749a3b700 1 --2- 172.21.15.59:0/9803856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7440a0a30 0x7fc7440a0e00 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.415+0000 7fc749a3b700 1 -- 172.21.15.59:0/9803856 >> 172.21.15.59:0/9803856 conn(0x7fc7440a6550 msgr2=0x7fc7440a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.415+0000 7fc749a3b700 1 -- 172.21.15.59:0/9803856 shutdown_connections 2023-09-30T22:36:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.415+0000 7fc749a3b700 1 -- 172.21.15.59:0/9803856 wait complete. 2023-09-30T22:36:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.416+0000 7fc749a3b700 1 Processor -- start 2023-09-30T22:36:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.416+0000 7fc749a3b700 1 -- start start 2023-09-30T22:36:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.416+0000 7fc749a3b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7440a0a30 0x7fc744122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.416+0000 7fc749a3b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7440a1340 0x7fc744122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.416+0000 7fc749a3b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc744134170 0x7fc744123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.416+0000 7fc749a3b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc744124690 con 0x7fc7440a0a30 2023-09-30T22:36:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.416+0000 7fc749a3b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7440a4f40 con 0x7fc7440a1340 2023-09-30T22:36:22.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.416+0000 7fc749a3b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc744126420 con 0x7fc744134170 2023-09-30T22:36:22.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc742ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7440a0a30 0x7fc744122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc7427fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7440a1340 0x7fc744122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc7427fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7440a1340 0x7fc744122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56634/0 (socket says 172.21.15.59:56634) 2023-09-30T22:36:22.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc742ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7440a0a30 0x7fc744122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55616/0 (socket says 172.21.15.59:55616) 2023-09-30T22:36:22.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc7427fc700 1 -- 172.21.15.59:0/4233089308 learned_addr learned my addr 172.21.15.59:0/4233089308 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:22.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc7437fe700 1 --2- 172.21.15.59:0/4233089308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc744134170 0x7fc744123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc7427fc700 1 -- 172.21.15.59:0/4233089308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc744134170 msgr2=0x7fc744123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc7427fc700 1 --2- 172.21.15.59:0/4233089308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc744134170 0x7fc744123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc7427fc700 1 -- 172.21.15.59:0/4233089308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7440a0a30 msgr2=0x7fc744122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc7427fc700 1 --2- 172.21.15.59:0/4233089308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7440a0a30 0x7fc744122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc7427fc700 1 -- 172.21.15.59:0/4233089308 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7340094a0 con 0x7fc7440a1340 2023-09-30T22:36:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc7437fe700 1 --2- 172.21.15.59:0/4233089308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc744134170 0x7fc744123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc742ffd700 1 --2- 172.21.15.59:0/4233089308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7440a0a30 0x7fc744122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc7427fc700 1 --2- 172.21.15.59:0/4233089308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7440a1340 0x7fc744122e40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00c4e0 tx=0x7fc72c00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc73bfff700 1 -- 172.21.15.59:0/4233089308 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c0052d0 con 0x7fc7440a1340 2023-09-30T22:36:22.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc73bfff700 1 -- 172.21.15.59:0/4233089308 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c005430 con 0x7fc7440a1340 2023-09-30T22:36:22.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc749a3b700 1 -- 172.21.15.59:0/4233089308 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc73c009b30 con 0x7fc7440a1340 2023-09-30T22:36:22.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.417+0000 7fc73bfff700 1 -- 172.21.15.59:0/4233089308 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c0038c0 con 0x7fc7440a1340 2023-09-30T22:36:22.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.418+0000 7fc749a3b700 1 -- 172.21.15.59:0/4233089308 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc744133420 con 0x7fc7440a1340 2023-09-30T22:36:22.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.418+0000 7fc73bfff700 1 -- 172.21.15.59:0/4233089308 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc72c003a20 con 0x7fc7440a1340 2023-09-30T22:36:22.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.419+0000 7fc749a3b700 1 -- 172.21.15.59:0/4233089308 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7440a1d40 con 0x7fc7440a1340 2023-09-30T22:36:22.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.419+0000 7fc73bfff700 1 -- 172.21.15.59:0/4233089308 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc72c03ea20 con 0x7fc7440a1340 2023-09-30T22:36:22.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.424+0000 7fc73bfff700 1 -- 172.21.15.59:0/4233089308 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc72c017020 con 0x7fc7440a1340 2023-09-30T22:36:22.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.450+0000 7f1bc5895700 1 Processor -- start 2023-09-30T22:36:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.450+0000 7f1bc5895700 1 -- start start 2023-09-30T22:36:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.451+0000 7f1bc5895700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bc00a0a30 0x7f1bc00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.451+0000 7f1bc5895700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1bc009d630 0x7f1bc00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.451+0000 7f1bc5895700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc00a2a70 con 0x7f1bc0133930 2023-09-30T22:36:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.451+0000 7f1bc5895700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc00a01d0 con 0x7f1bc009d630 2023-09-30T22:36:22.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.451+0000 7f1bc5895700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc009e2b0 con 0x7f1bc00a0a30 2023-09-30T22:36:22.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.451+0000 7f1bbeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bc00a0a30 0x7f1bc00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.451+0000 7f1bbe7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1bc009d630 0x7f1bc00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.451+0000 7f1bbeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bc00a0a30 0x7f1bc00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33070/0 (socket says 172.21.15.59:33070) 2023-09-30T22:36:22.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.451+0000 7f1bbeffd700 1 -- 172.21.15.59:0/1234485463 learned_addr learned my addr 172.21.15.59:0/1234485463 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:22.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.451+0000 7f1bbeffd700 1 -- 172.21.15.59:0/1234485463 >> v2:172.21.15.59:3300/0 conn(0x7f1bc009d630 msgr2=0x7f1bc00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:22.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.451+0000 7f1bbeffd700 1 --2- 172.21.15.59:0/1234485463 >> v2:172.21.15.59:3300/0 conn(0x7f1bc009d630 0x7f1bc00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.451+0000 7f1bbeffd700 1 -- 172.21.15.59:0/1234485463 >> v1:172.21.15.59:6789/0 conn(0x7f1bc0133930 legacy=0x7f1bc0133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.451+0000 7f1bbeffd700 1 -- 172.21.15.59:0/1234485463 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc009dc50 con 0x7f1bc00a0a30 2023-09-30T22:36:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.451+0000 7f1bbe7fc700 1 --2- 172.21.15.59:0/1234485463 >> v2:172.21.15.59:3300/0 conn(0x7f1bc009d630 0x7f1bc00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.451+0000 7f1bbeffd700 1 --2- 172.21.15.59:0/1234485463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bc00a0a30 0x7f1bc00a0e00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009e50 tx=0x7f1bb000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5bd8dd70863d35a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.452+0000 7f1bbdffb700 1 -- 172.21.15.59:0/1234485463 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb000e070 con 0x7f1bc00a0a30 2023-09-30T22:36:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.452+0000 7f1bbdffb700 1 -- 172.21.15.59:0/1234485463 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb000b910 con 0x7f1bc00a0a30 2023-09-30T22:36:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.452+0000 7f1bbdffb700 1 -- 172.21.15.59:0/1234485463 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb000bcc0 con 0x7f1bc00a0a30 2023-09-30T22:36:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.452+0000 7f1bc5895700 1 -- 172.21.15.59:0/1234485463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bc00a0a30 msgr2=0x7f1bc00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.452+0000 7f1bc5895700 1 --2- 172.21.15.59:0/1234485463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bc00a0a30 0x7f1bc00a0e00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009e50 tx=0x7f1bb000b330 comp rx=0 tx=0).stop 2023-09-30T22:36:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.452+0000 7f1bc5895700 1 -- 172.21.15.59:0/1234485463 shutdown_connections 2023-09-30T22:36:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.452+0000 7f1bc5895700 1 --2- 172.21.15.59:0/1234485463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bc00a0a30 0x7f1bc00a0e00 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.452+0000 7f1bc5895700 1 --2- 172.21.15.59:0/1234485463 >> v2:172.21.15.59:3300/0 conn(0x7f1bc009d630 0x7f1bc00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.452+0000 7f1bc5895700 1 -- 172.21.15.59:0/1234485463 >> 172.21.15.59:0/1234485463 conn(0x7f1bc00a3050 msgr2=0x7f1bc00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.452+0000 7f1bc5895700 1 -- 172.21.15.59:0/1234485463 shutdown_connections 2023-09-30T22:36:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.452+0000 7f1bc5895700 1 -- 172.21.15.59:0/1234485463 wait complete. 2023-09-30T22:36:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.453+0000 7f1bc5895700 1 Processor -- start 2023-09-30T22:36:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.454+0000 7f1bc5895700 1 -- start start 2023-09-30T22:36:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.454+0000 7f1bc5895700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc009d630 0x7f1bc01c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.454+0000 7f1bc5895700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bc00a0a30 0x7f1bc01c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.454+0000 7f1bc5895700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bc0133930 0x7f1bc01c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.454+0000 7f1bc5895700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc0120670 con 0x7f1bc009d630 2023-09-30T22:36:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.454+0000 7f1bc5895700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc0121e60 con 0x7f1bc0133930 2023-09-30T22:36:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.454+0000 7f1bc5895700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00a0410 con 0x7f1bc00a0a30 2023-09-30T22:36:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.454+0000 7f1bbeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc009d630 0x7f1bc01c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.454+0000 7f1bbeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc009d630 0x7f1bc01c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55632/0 (socket says 172.21.15.59:55632) 2023-09-30T22:36:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.454+0000 7f1bbeffd700 1 -- 172.21.15.59:0/3706476279 learned_addr learned my addr 172.21.15.59:0/3706476279 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.454+0000 7f1bbe7fc700 1 --2- 172.21.15.59:0/3706476279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bc00a0a30 0x7f1bc01c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.454+0000 7f1bbf7fe700 1 --2- 172.21.15.59:0/3706476279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bc0133930 0x7f1bc01c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.455+0000 7f1bbeffd700 1 -- 172.21.15.59:0/3706476279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bc00a0a30 msgr2=0x7f1bc01c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.455+0000 7f1bbeffd700 1 --2- 172.21.15.59:0/3706476279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bc00a0a30 0x7f1bc01c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.455+0000 7f1bbeffd700 1 -- 172.21.15.59:0/3706476279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bc0133930 msgr2=0x7f1bc01c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.455+0000 7f1bbeffd700 1 --2- 172.21.15.59:0/3706476279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bc0133930 0x7f1bc01c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.455+0000 7f1bbeffd700 1 -- 172.21.15.59:0/3706476279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb40094a0 con 0x7f1bc009d630 2023-09-30T22:36:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.455+0000 7f1bbeffd700 1 --2- 172.21.15.59:0/3706476279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc009d630 0x7f1bc01c8170 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000b370 tx=0x7f1bb0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.455+0000 7f1ba7fff700 1 -- 172.21.15.59:0/3706476279 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0004800 con 0x7f1bc009d630 2023-09-30T22:36:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.455+0000 7f1ba7fff700 1 -- 172.21.15.59:0/3706476279 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb00092e0 con 0x7f1bc009d630 2023-09-30T22:36:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.455+0000 7f1bc5895700 1 -- 172.21.15.59:0/3706476279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb0009b30 con 0x7f1bc009d630 2023-09-30T22:36:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.455+0000 7f1ba7fff700 1 -- 172.21.15.59:0/3706476279 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb001c680 con 0x7f1bc009d630 2023-09-30T22:36:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.455+0000 7f1bc5895700 1 -- 172.21.15.59:0/3706476279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc0121160 con 0x7f1bc009d630 2023-09-30T22:36:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.456+0000 7f1bc5895700 1 -- 172.21.15.59:0/3706476279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc00747f0 con 0x7f1bc009d630 2023-09-30T22:36:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.458+0000 7f1ba7fff700 1 -- 172.21.15.59:0/3706476279 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1bb001c7e0 con 0x7f1bc009d630 2023-09-30T22:36:22.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.459+0000 7f1ba7fff700 1 -- 172.21.15.59:0/3706476279 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1bb0041960 con 0x7f1bc009d630 2023-09-30T22:36:22.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.463+0000 7f1ba7fff700 1 -- 172.21.15.59:0/3706476279 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1bb0025450 con 0x7f1bc009d630 2023-09-30T22:36:22.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.635+0000 7fc749a3b700 1 -- 172.21.15.59:0/4233089308 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc744074ea0 con 0x7fc7440a1340 2023-09-30T22:36:22.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.635+0000 7fc73bfff700 1 -- 172.21.15.59:0/4233089308 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc72c018260 con 0x7fc7440a1340 2023-09-30T22:36:22.636 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:22.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.638+0000 7fc749a3b700 1 -- 172.21.15.59:0/4233089308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7440a1340 msgr2=0x7fc744122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.638+0000 7fc749a3b700 1 --2- 172.21.15.59:0/4233089308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7440a1340 0x7fc744122e40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00c4e0 tx=0x7fc72c00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.638+0000 7fc749a3b700 1 -- 172.21.15.59:0/4233089308 shutdown_connections 2023-09-30T22:36:22.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.638+0000 7fc749a3b700 1 --2- 172.21.15.59:0/4233089308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc744134170 0x7fc744123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.638+0000 7fc749a3b700 1 --2- 172.21.15.59:0/4233089308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7440a0a30 0x7fc744122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.638+0000 7fc749a3b700 1 --2- 172.21.15.59:0/4233089308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7440a1340 0x7fc744122e40 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.638+0000 7fc749a3b700 1 -- 172.21.15.59:0/4233089308 >> 172.21.15.59:0/4233089308 conn(0x7fc7440a6550 msgr2=0x7fc74409ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:22.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.638+0000 7fc749a3b700 1 -- 172.21.15.59:0/4233089308 shutdown_connections 2023-09-30T22:36:22.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.638+0000 7fc749a3b700 1 -- 172.21.15.59:0/4233089308 wait complete. 2023-09-30T22:36:22.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.671+0000 7f1bc5895700 1 -- 172.21.15.59:0/3706476279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1bc0072980 con 0x7f1bc009d630 2023-09-30T22:36:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.671+0000 7f1ba7fff700 1 -- 172.21.15.59:0/3706476279 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1bb0033030 con 0x7f1bc009d630 2023-09-30T22:36:22.672 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.674+0000 7f1bc5895700 1 -- 172.21.15.59:0/3706476279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc009d630 msgr2=0x7f1bc01c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.674+0000 7f1bc5895700 1 --2- 172.21.15.59:0/3706476279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc009d630 0x7f1bc01c8170 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000b370 tx=0x7f1bb0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.674+0000 7f1bc5895700 1 -- 172.21.15.59:0/3706476279 shutdown_connections 2023-09-30T22:36:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.674+0000 7f1bc5895700 1 --2- 172.21.15.59:0/3706476279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bc0133930 0x7f1bc01c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.674+0000 7f1bc5895700 1 --2- 172.21.15.59:0/3706476279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc009d630 0x7f1bc01c8170 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.674+0000 7f1bc5895700 1 --2- 172.21.15.59:0/3706476279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bc00a0a30 0x7f1bc01c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.674+0000 7f1bc5895700 1 -- 172.21.15.59:0/3706476279 >> 172.21.15.59:0/3706476279 conn(0x7f1bc00a3050 msgr2=0x7f1bc00a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.674+0000 7f1bc5895700 1 -- 172.21.15.59:0/3706476279 shutdown_connections 2023-09-30T22:36:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.674+0000 7f1bc5895700 1 -- 172.21.15.59:0/3706476279 wait complete. 2023-09-30T22:36:22.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:22.724 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:22.760 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:22.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.870+0000 7fb8e3261700 1 Processor -- start 2023-09-30T22:36:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.870+0000 7fb8e3261700 1 -- start start 2023-09-30T22:36:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.870+0000 7fb8e3261700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc09e850 0x7fb8dc09ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.870+0000 7fb8e3261700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8dc09f160 0x7fb8dc131790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.870+0000 7fb8e3261700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8dc09b560 con 0x7fb8dc131cd0 2023-09-30T22:36:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.870+0000 7fb8e3261700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8dc0a0040 con 0x7fb8dc09f160 2023-09-30T22:36:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.870+0000 7fb8e3261700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0a02e0 con 0x7fb8dc09e850 2023-09-30T22:36:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.870+0000 7fb8e0ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc09e850 0x7fb8dc09ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.870+0000 7fb8dbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8dc09f160 0x7fb8dc131790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.870+0000 7fb8e0ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc09e850 0x7fb8dc09ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33082/0 (socket says 172.21.15.59:33082) 2023-09-30T22:36:22.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.870+0000 7fb8e0ffd700 1 -- 172.21.15.59:0/518676316 learned_addr learned my addr 172.21.15.59:0/518676316 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:22.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.871+0000 7fb8dbfff700 1 -- 172.21.15.59:0/518676316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc09e850 msgr2=0x7fb8dc09ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:22.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.871+0000 7fb8dbfff700 1 --2- 172.21.15.59:0/518676316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc09e850 0x7fb8dc09ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.871+0000 7fb8dbfff700 1 -- 172.21.15.59:0/518676316 >> v1:172.21.15.59:6789/0 conn(0x7fb8dc131cd0 legacy=0x7fb8dc138bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.871+0000 7fb8dbfff700 1 -- 172.21.15.59:0/518676316 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc09fab0 con 0x7fb8dc09f160 2023-09-30T22:36:22.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.871+0000 7fb8e0ffd700 1 --2- 172.21.15.59:0/518676316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc09e850 0x7fb8dc09ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:22.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.871+0000 7fb8dbfff700 1 --2- 172.21.15.59:0/518676316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc09f160 0x7fb8dc131790 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009840 tx=0x7fb8c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fc81aa6f5b29d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:22.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.871+0000 7fb8db7fe700 1 -- 172.21.15.59:0/518676316 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4011830 con 0x7fb8dc09f160 2023-09-30T22:36:22.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.871+0000 7fb8db7fe700 1 -- 172.21.15.59:0/518676316 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c4011990 con 0x7fb8dc09f160 2023-09-30T22:36:22.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.871+0000 7fb8db7fe700 1 -- 172.21.15.59:0/518676316 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4011d20 con 0x7fb8dc09f160 2023-09-30T22:36:22.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.872+0000 7fb8e3261700 1 -- 172.21.15.59:0/518676316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc09f160 msgr2=0x7fb8dc131790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.872+0000 7fb8e3261700 1 --2- 172.21.15.59:0/518676316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc09f160 0x7fb8dc131790 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009840 tx=0x7fb8c4009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:22.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.872+0000 7fb8e3261700 1 -- 172.21.15.59:0/518676316 shutdown_connections 2023-09-30T22:36:22.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.872+0000 7fb8e3261700 1 --2- 172.21.15.59:0/518676316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc09e850 0x7fb8dc09ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.872+0000 7fb8e3261700 1 --2- 172.21.15.59:0/518676316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc09f160 0x7fb8dc131790 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.872+0000 7fb8e3261700 1 -- 172.21.15.59:0/518676316 >> 172.21.15.59:0/518676316 conn(0x7fb8dc0a3f70 msgr2=0x7fb8dc0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:22.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.872+0000 7fb8e3261700 1 -- 172.21.15.59:0/518676316 shutdown_connections 2023-09-30T22:36:22.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.872+0000 7fb8e3261700 1 -- 172.21.15.59:0/518676316 wait complete. 2023-09-30T22:36:22.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.873+0000 7fb8e3261700 1 Processor -- start 2023-09-30T22:36:22.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.873+0000 7fb8e3261700 1 -- start start 2023-09-30T22:36:22.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.874+0000 7fb8e3261700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc09e850 0x7fb8dc06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.874+0000 7fb8e3261700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc09f160 0x7fb8dc06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.874+0000 7fb8e3261700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc131cd0 0x7fb8dc06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.874+0000 7fb8e3261700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc1257b0 con 0x7fb8dc09f160 2023-09-30T22:36:22.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.874+0000 7fb8e3261700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc124a00 con 0x7fb8dc131cd0 2023-09-30T22:36:22.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.874+0000 7fb8e3261700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc126040 con 0x7fb8dc09e850 2023-09-30T22:36:22.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8e0ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc09e850 0x7fb8dc06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8dbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc09f160 0x7fb8dc06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8e0ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc09e850 0x7fb8dc06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33088/0 (socket says 172.21.15.59:33088) 2023-09-30T22:36:22.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8dbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc09f160 0x7fb8dc06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55654/0 (socket says 172.21.15.59:55654) 2023-09-30T22:36:22.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8e0ffd700 1 -- 172.21.15.59:0/129852365 learned_addr learned my addr 172.21.15.59:0/129852365 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:22.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8e17fe700 1 --2- 172.21.15.59:0/129852365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc131cd0 0x7fb8dc06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8dbfff700 1 -- 172.21.15.59:0/129852365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc09e850 msgr2=0x7fb8dc06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8dbfff700 1 --2- 172.21.15.59:0/129852365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc09e850 0x7fb8dc06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8dbfff700 1 -- 172.21.15.59:0/129852365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc131cd0 msgr2=0x7fb8dc06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8dbfff700 1 --2- 172.21.15.59:0/129852365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc131cd0 0x7fb8dc06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8dbfff700 1 -- 172.21.15.59:0/129852365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc009550 con 0x7fb8dc09f160 2023-09-30T22:36:22.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8e17fe700 1 --2- 172.21.15.59:0/129852365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc131cd0 0x7fb8dc06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:22.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8dbfff700 1 --2- 172.21.15.59:0/129852365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc09f160 0x7fb8dc06bdf0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4016000 tx=0x7fb8c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:22.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8d97fa700 1 -- 172.21.15.59:0/129852365 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40036a0 con 0x7fb8dc09f160 2023-09-30T22:36:22.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8d97fa700 1 -- 172.21.15.59:0/129852365 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c401f070 con 0x7fb8dc09f160 2023-09-30T22:36:22.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8e3261700 1 -- 172.21.15.59:0/129852365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c40094a0 con 0x7fb8dc09f160 2023-09-30T22:36:22.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.875+0000 7fb8d97fa700 1 -- 172.21.15.59:0/129852365 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4003a60 con 0x7fb8dc09f160 2023-09-30T22:36:22.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.876+0000 7fb8e3261700 1 -- 172.21.15.59:0/129852365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8dc09d9a0 con 0x7fb8dc09f160 2023-09-30T22:36:22.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.876+0000 7fb8d97fa700 1 -- 172.21.15.59:0/129852365 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8c4003bc0 con 0x7fb8dc09f160 2023-09-30T22:36:22.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.876+0000 7fb8e3261700 1 -- 172.21.15.59:0/129852365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8dc0747f0 con 0x7fb8dc09f160 2023-09-30T22:36:22.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.877+0000 7fb8d97fa700 1 -- 172.21.15.59:0/129852365 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb8c4021070 con 0x7fb8dc09f160 2023-09-30T22:36:22.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.881+0000 7fb8d97fa700 1 -- 172.21.15.59:0/129852365 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8c4010790 con 0x7fb8dc09f160 2023-09-30T22:36:22.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.925+0000 7fa821da9700 1 Processor -- start 2023-09-30T22:36:22.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.925+0000 7fa821da9700 1 -- start start 2023-09-30T22:36:22.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa821da9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa81c09e930 0x7fa81c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa821da9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa81c09f240 0x7fa81c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa821da9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c070940 con 0x7fa81c09f650 2023-09-30T22:36:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa821da9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c06fd60 con 0x7fa81c09e930 2023-09-30T22:36:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa821da9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c06fa80 con 0x7fa81c09f240 2023-09-30T22:36:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa81affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa81c09f240 0x7fa81c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa81b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa81c09e930 0x7fa81c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa81affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa81c09f240 0x7fa81c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33096/0 (socket says 172.21.15.59:33096) 2023-09-30T22:36:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa81b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa81c09e930 0x7fa81c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55656/0 (socket says 172.21.15.59:55656) 2023-09-30T22:36:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa81bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa81c09f650 0x7fa81c131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41346/0 (socket says 172.21.15.59:41346) 2023-09-30T22:36:22.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa81affd700 1 -- 172.21.15.59:0/956164854 learned_addr learned my addr 172.21.15.59:0/956164854 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa81b7fe700 1 -- 172.21.15.59:0/956164854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa81c09f240 msgr2=0x7fa81c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa81b7fe700 1 --2- 172.21.15.59:0/956164854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa81c09f240 0x7fa81c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa81b7fe700 1 -- 172.21.15.59:0/956164854 >> v1:172.21.15.59:6789/0 conn(0x7fa81c09f650 legacy=0x7fa81c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa81b7fe700 1 -- 172.21.15.59:0/956164854 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c09fb60 con 0x7fa81c09e930 2023-09-30T22:36:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa81a7fc700 1 -- 172.21.15.59:0/956164854 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664926383 0 0) 0x7fa81c070940 con 0x7fa81c09f650 2023-09-30T22:36:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa81affd700 1 --2- 172.21.15.59:0/956164854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa81c09f240 0x7fa81c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.926+0000 7fa81b7fe700 1 --2- 172.21.15.59:0/956164854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa81c09e930 0x7fa81c09ed00 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009d90 tx=0x7fa80c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f25b7b76deab534 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.927+0000 7fa81a7fc700 1 -- 172.21.15.59:0/956164854 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00e070 con 0x7fa81c09e930 2023-09-30T22:36:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.927+0000 7fa81a7fc700 1 -- 172.21.15.59:0/956164854 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c00bb20 con 0x7fa81c09e930 2023-09-30T22:36:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.927+0000 7fa81a7fc700 1 -- 172.21.15.59:0/956164854 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c012430 con 0x7fa81c09e930 2023-09-30T22:36:22.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.927+0000 7fa821da9700 1 -- 172.21.15.59:0/956164854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa81c09e930 msgr2=0x7fa81c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.927+0000 7fa821da9700 1 --2- 172.21.15.59:0/956164854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa81c09e930 0x7fa81c09ed00 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009d90 tx=0x7fa80c00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:22.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.927+0000 7fa821da9700 1 -- 172.21.15.59:0/956164854 shutdown_connections 2023-09-30T22:36:22.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.927+0000 7fa821da9700 1 --2- 172.21.15.59:0/956164854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa81c09e930 0x7fa81c09ed00 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.927+0000 7fa821da9700 1 --2- 172.21.15.59:0/956164854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa81c09f240 0x7fa81c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.927+0000 7fa821da9700 1 -- 172.21.15.59:0/956164854 >> 172.21.15.59:0/956164854 conn(0x7fa81c0a4210 msgr2=0x7fa81c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:22.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.927+0000 7fa821da9700 1 -- 172.21.15.59:0/956164854 shutdown_connections 2023-09-30T22:36:22.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.927+0000 7fa821da9700 1 -- 172.21.15.59:0/956164854 wait complete. 2023-09-30T22:36:22.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.928+0000 7fa821da9700 1 Processor -- start 2023-09-30T22:36:22.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.929+0000 7fa821da9700 1 -- start start 2023-09-30T22:36:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.929+0000 7fa821da9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa81c09e930 0x7fa81c1c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.929+0000 7fa821da9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa81c09f240 0x7fa81c1c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.929+0000 7fa821da9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa81c09f650 0x7fa81c1c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.929+0000 7fa821da9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c1a6720 con 0x7fa81c09e930 2023-09-30T22:36:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.929+0000 7fa821da9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c1a6530 con 0x7fa81c09f240 2023-09-30T22:36:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.929+0000 7fa821da9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0a30d0 con 0x7fa81c09f650 2023-09-30T22:36:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.929+0000 7fa81bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa81c09f650 0x7fa81c1c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.929+0000 7fa81affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa81c09f240 0x7fa81c1c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.929+0000 7fa81bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa81c09f650 0x7fa81c1c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33100/0 (socket says 172.21.15.59:33100) 2023-09-30T22:36:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.929+0000 7fa81b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa81c09e930 0x7fa81c1c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.929+0000 7fa81bfff700 1 -- 172.21.15.59:0/572472681 learned_addr learned my addr 172.21.15.59:0/572472681 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.930+0000 7fa81bfff700 1 -- 172.21.15.59:0/572472681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa81c09f240 msgr2=0x7fa81c1c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.930+0000 7fa81bfff700 1 --2- 172.21.15.59:0/572472681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa81c09f240 0x7fa81c1c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.930+0000 7fa81bfff700 1 -- 172.21.15.59:0/572472681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa81c09e930 msgr2=0x7fa81c1c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.930+0000 7fa81bfff700 1 --2- 172.21.15.59:0/572472681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa81c09e930 0x7fa81c1c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.930+0000 7fa81bfff700 1 -- 172.21.15.59:0/572472681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa804009550 con 0x7fa81c09f650 2023-09-30T22:36:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.930+0000 7fa81b7fe700 1 --2- 172.21.15.59:0/572472681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa81c09e930 0x7fa81c1c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.930+0000 7fa81bfff700 1 --2- 172.21.15.59:0/572472681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa81c09f650 0x7fa81c1c8ab0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa81400c520 tx=0x7fa81400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.930+0000 7fa813fff700 1 -- 172.21.15.59:0/572472681 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814004c80 con 0x7fa81c09f650 2023-09-30T22:36:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.930+0000 7fa813fff700 1 -- 172.21.15.59:0/572472681 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa814004de0 con 0x7fa81c09f650 2023-09-30T22:36:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.930+0000 7fa813fff700 1 -- 172.21.15.59:0/572472681 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8140072d0 con 0x7fa81c09f650 2023-09-30T22:36:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.930+0000 7fa821da9700 1 -- 172.21.15.59:0/572472681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80c009a70 con 0x7fa81c09f650 2023-09-30T22:36:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.930+0000 7fa821da9700 1 -- 172.21.15.59:0/572472681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c0a0190 con 0x7fa81c09f650 2023-09-30T22:36:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.931+0000 7fa813fff700 1 -- 172.21.15.59:0/572472681 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa814007430 con 0x7fa81c09f650 2023-09-30T22:36:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.931+0000 7fa813fff700 1 -- 172.21.15.59:0/572472681 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa81403f290 con 0x7fa81c09f650 2023-09-30T22:36:22.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.931+0000 7fa821da9700 1 -- 172.21.15.59:0/572472681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c1a8510 con 0x7fa81c09f650 2023-09-30T22:36:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:22.936+0000 7fa813fff700 1 -- 172.21.15.59:0/572472681 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8140076e0 con 0x7fa81c09f650 2023-09-30T22:36:23.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.103+0000 7fb8e3261700 1 -- 172.21.15.59:0/129852365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb8dc06d4c0 con 0x7fb8dc09f160 2023-09-30T22:36:23.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.103+0000 7fb8d97fa700 1 -- 172.21.15.59:0/129852365 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8c4015030 con 0x7fb8dc09f160 2023-09-30T22:36:23.104 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.106+0000 7fb8e3261700 1 -- 172.21.15.59:0/129852365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc09f160 msgr2=0x7fb8dc06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.106+0000 7fb8e3261700 1 --2- 172.21.15.59:0/129852365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc09f160 0x7fb8dc06bdf0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4016000 tx=0x7fb8c4004750 comp rx=0 tx=0).stop 2023-09-30T22:36:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.106+0000 7fb8e3261700 1 -- 172.21.15.59:0/129852365 shutdown_connections 2023-09-30T22:36:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.106+0000 7fb8e3261700 1 --2- 172.21.15.59:0/129852365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc09e850 0x7fb8dc06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.106+0000 7fb8e3261700 1 --2- 172.21.15.59:0/129852365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc131cd0 0x7fb8dc06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.106+0000 7fb8e3261700 1 --2- 172.21.15.59:0/129852365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc09f160 0x7fb8dc06bdf0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.106+0000 7fb8e3261700 1 -- 172.21.15.59:0/129852365 >> 172.21.15.59:0/129852365 conn(0x7fb8dc0a3f70 msgr2=0x7fb8dc0a1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.106+0000 7fb8e3261700 1 -- 172.21.15.59:0/129852365 shutdown_connections 2023-09-30T22:36:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.106+0000 7fb8e3261700 1 -- 172.21.15.59:0/129852365 wait complete. 2023-09-30T22:36:23.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:23.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.142+0000 7fa821da9700 1 -- 172.21.15.59:0/572472681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa81c074ea0 con 0x7fa81c09f650 2023-09-30T22:36:23.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.142+0000 7fa813fff700 1 -- 172.21.15.59:0/572472681 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa814011360 con 0x7fa81c09f650 2023-09-30T22:36:23.144 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:23.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.145+0000 7fa821da9700 1 -- 172.21.15.59:0/572472681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa81c09f650 msgr2=0x7fa81c1c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:23.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.145+0000 7fa821da9700 1 --2- 172.21.15.59:0/572472681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa81c09f650 0x7fa81c1c8ab0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa81400c520 tx=0x7fa81400c830 comp rx=0 tx=0).stop 2023-09-30T22:36:23.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.145+0000 7fa821da9700 1 -- 172.21.15.59:0/572472681 shutdown_connections 2023-09-30T22:36:23.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.145+0000 7fa821da9700 1 --2- 172.21.15.59:0/572472681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa81c09f650 0x7fa81c1c8ab0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.145+0000 7fa821da9700 1 --2- 172.21.15.59:0/572472681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa81c09e930 0x7fa81c1c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.145+0000 7fa821da9700 1 --2- 172.21.15.59:0/572472681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa81c09f240 0x7fa81c1c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.145+0000 7fa821da9700 1 -- 172.21.15.59:0/572472681 >> 172.21.15.59:0/572472681 conn(0x7fa81c0a4210 msgr2=0x7fa81c06c320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.145+0000 7fa821da9700 1 -- 172.21.15.59:0/572472681 shutdown_connections 2023-09-30T22:36:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.145+0000 7fa821da9700 1 -- 172.21.15.59:0/572472681 wait complete. 2023-09-30T22:36:23.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:23.655 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:23.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:23.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.803+0000 7f8eac697700 1 Processor -- start 2023-09-30T22:36:23.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.803+0000 7f8eac697700 1 -- start start 2023-09-30T22:36:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eac697700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea40a0a30 0x7f8ea40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eac697700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ea40a1340 0x7f8ea4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eac697700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea4133fa0 0x7f8ea4134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eac697700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea409edd0 con 0x7f8ea40a1340 2023-09-30T22:36:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eac697700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea409e1f0 con 0x7f8ea4133fa0 2023-09-30T22:36:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eac697700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea409dc50 con 0x7f8ea40a0a30 2023-09-30T22:36:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eaac34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea4133fa0 0x7f8ea4134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:23.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eaa433700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea40a0a30 0x7f8ea40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eaac34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea4133fa0 0x7f8ea4134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56654/0 (socket says 172.21.15.59:56654) 2023-09-30T22:36:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eaac34700 1 -- 172.21.15.59:0/3964785950 learned_addr learned my addr 172.21.15.59:0/3964785950 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8ea9c32700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ea40a1340 0x7f8ea4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eaac34700 1 -- 172.21.15.59:0/3964785950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea40a0a30 msgr2=0x7f8ea40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eaac34700 1 --2- 172.21.15.59:0/3964785950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea40a0a30 0x7f8ea40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eaac34700 1 -- 172.21.15.59:0/3964785950 >> v2:172.21.15.59:3300/0 conn(0x7f8ea40a1340 msgr2=0x7f8ea4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eaac34700 1 --2- 172.21.15.59:0/3964785950 >> v2:172.21.15.59:3300/0 conn(0x7f8ea40a1340 0x7f8ea4133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eaac34700 1 -- 172.21.15.59:0/3964785950 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40a1fe0 con 0x7f8ea4133fa0 2023-09-30T22:36:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8ea9c32700 1 --2- 172.21.15.59:0/3964785950 >> v2:172.21.15.59:3300/0 conn(0x7f8ea40a1340 0x7f8ea4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:23.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.804+0000 7f8eaac34700 1 --2- 172.21.15.59:0/3964785950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea4133fa0 0x7f8ea4134410 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009e80 tx=0x7f8e9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b0019de9b455748 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.805+0000 7f8ea9431700 1 -- 172.21.15.59:0/3964785950 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c00e070 con 0x7f8ea4133fa0 2023-09-30T22:36:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.805+0000 7f8ea9431700 1 -- 172.21.15.59:0/3964785950 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c00b8d0 con 0x7f8ea4133fa0 2023-09-30T22:36:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.805+0000 7f8ea9431700 1 -- 172.21.15.59:0/3964785950 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c00bc80 con 0x7f8ea4133fa0 2023-09-30T22:36:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.805+0000 7f8eac697700 1 -- 172.21.15.59:0/3964785950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea4133fa0 msgr2=0x7f8ea4134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.805+0000 7f8eac697700 1 --2- 172.21.15.59:0/3964785950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea4133fa0 0x7f8ea4134410 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009e80 tx=0x7f8e9c00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.805+0000 7f8eac697700 1 -- 172.21.15.59:0/3964785950 shutdown_connections 2023-09-30T22:36:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.805+0000 7f8eac697700 1 --2- 172.21.15.59:0/3964785950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea4133fa0 0x7f8ea4134410 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.805+0000 7f8eac697700 1 --2- 172.21.15.59:0/3964785950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea40a0a30 0x7f8ea40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.805+0000 7f8eac697700 1 --2- 172.21.15.59:0/3964785950 >> v2:172.21.15.59:3300/0 conn(0x7f8ea40a1340 0x7f8ea4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.805+0000 7f8eac697700 1 -- 172.21.15.59:0/3964785950 >> 172.21.15.59:0/3964785950 conn(0x7f8ea40a6550 msgr2=0x7f8ea40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:23.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.805+0000 7f8eac697700 1 -- 172.21.15.59:0/3964785950 shutdown_connections 2023-09-30T22:36:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.805+0000 7f8eac697700 1 -- 172.21.15.59:0/3964785950 wait complete. 2023-09-30T22:36:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.806+0000 7f8eac697700 1 Processor -- start 2023-09-30T22:36:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.806+0000 7f8eac697700 1 -- start start 2023-09-30T22:36:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8eac697700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea40a0a30 0x7f8ea41200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8eac697700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea40a1340 0x7f8ea41205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8eac697700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea4133fa0 0x7f8ea4120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8eac697700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea41233e0 con 0x7f8ea40a1340 2023-09-30T22:36:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8eac697700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4122eb0 con 0x7f8ea4133fa0 2023-09-30T22:36:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8eac697700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4121d00 con 0x7f8ea40a0a30 2023-09-30T22:36:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8ea9c32700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea40a1340 0x7f8ea41205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8ea9c32700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea40a1340 0x7f8ea41205e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55690/0 (socket says 172.21.15.59:55690) 2023-09-30T22:36:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8eaac34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea4133fa0 0x7f8ea4120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8ea9c32700 1 -- 172.21.15.59:0/347182850 learned_addr learned my addr 172.21.15.59:0/347182850 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8eaa433700 1 --2- 172.21.15.59:0/347182850 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea40a0a30 0x7f8ea41200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8ea9c32700 1 -- 172.21.15.59:0/347182850 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea40a0a30 msgr2=0x7f8ea41200a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8ea9c32700 1 --2- 172.21.15.59:0/347182850 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea40a0a30 0x7f8ea41200a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8ea9c32700 1 -- 172.21.15.59:0/347182850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea4133fa0 msgr2=0x7f8ea4120b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8ea9c32700 1 --2- 172.21.15.59:0/347182850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea4133fa0 0x7f8ea4120b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8ea9c32700 1 -- 172.21.15.59:0/347182850 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e940094a0 con 0x7f8ea40a1340 2023-09-30T22:36:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8eaac34700 1 --2- 172.21.15.59:0/347182850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea4133fa0 0x7f8ea4120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.807+0000 7f8eaa433700 1 --2- 172.21.15.59:0/347182850 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea40a0a30 0x7f8ea41200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.808+0000 7f8ea9c32700 1 --2- 172.21.15.59:0/347182850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea40a1340 0x7f8ea41205e0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400ec10 tx=0x7f8e9400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.808+0000 7f8e9affd700 1 -- 172.21.15.59:0/347182850 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9400c850 con 0x7f8ea40a1340 2023-09-30T22:36:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.808+0000 7f8e9affd700 1 -- 172.21.15.59:0/347182850 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9400c9b0 con 0x7f8ea40a1340 2023-09-30T22:36:23.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.808+0000 7f8eac697700 1 -- 172.21.15.59:0/347182850 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9c009b30 con 0x7f8ea40a1340 2023-09-30T22:36:23.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.808+0000 7f8e9affd700 1 -- 172.21.15.59:0/347182850 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9400cd20 con 0x7f8ea40a1340 2023-09-30T22:36:23.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.808+0000 7f8eac697700 1 -- 172.21.15.59:0/347182850 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea41238e0 con 0x7f8ea40a1340 2023-09-30T22:36:23.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.809+0000 7f8e9affd700 1 -- 172.21.15.59:0/347182850 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e94013470 con 0x7f8ea40a1340 2023-09-30T22:36:23.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.809+0000 7f8e9affd700 1 -- 172.21.15.59:0/347182850 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e9403f930 con 0x7f8ea40a1340 2023-09-30T22:36:23.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.809+0000 7f8eac697700 1 -- 172.21.15.59:0/347182850 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea41238e0 con 0x7f8ea40a1340 2023-09-30T22:36:23.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.814+0000 7f8e9affd700 1 -- 172.21.15.59:0/347182850 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ea41238e0 con 0x7f8ea40a1340 2023-09-30T22:36:23.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.842+0000 7f7a4e8ca700 1 Processor -- start 2023-09-30T22:36:23.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.842+0000 7f7a4e8ca700 1 -- start start 2023-09-30T22:36:23.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.842+0000 7f7a4e8ca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a480a0a30 0x7f7a480a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:23.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.842+0000 7f7a4e8ca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a4809d630 0x7f7a480a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:23.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.842+0000 7f7a4e8ca700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a480a2a70 con 0x7f7a48133930 2023-09-30T22:36:23.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.842+0000 7f7a4e8ca700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a480a01d0 con 0x7f7a480a0a30 2023-09-30T22:36:23.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.842+0000 7f7a4e8ca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4809e2b0 con 0x7f7a4809d630 2023-09-30T22:36:23.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.842+0000 7f7a477fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a4809d630 0x7f7a480a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:23.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.842+0000 7f7a47fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a480a0a30 0x7f7a480a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.843+0000 7f7a477fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a4809d630 0x7f7a480a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56670/0 (socket says 172.21.15.59:56670) 2023-09-30T22:36:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.843+0000 7f7a477fe700 1 -- 172.21.15.59:0/3589408563 learned_addr learned my addr 172.21.15.59:0/3589408563 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.843+0000 7f7a47fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a480a0a30 0x7f7a480a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55704/0 (socket says 172.21.15.59:55704) 2023-09-30T22:36:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.843+0000 7f7a477fe700 1 -- 172.21.15.59:0/3589408563 >> v2:172.21.15.59:3300/0 conn(0x7f7a480a0a30 msgr2=0x7f7a480a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.843+0000 7f7a477fe700 1 --2- 172.21.15.59:0/3589408563 >> v2:172.21.15.59:3300/0 conn(0x7f7a480a0a30 0x7f7a480a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.843+0000 7f7a477fe700 1 -- 172.21.15.59:0/3589408563 >> v1:172.21.15.59:6789/0 conn(0x7f7a48133930 legacy=0x7f7a48133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.843+0000 7f7a477fe700 1 -- 172.21.15.59:0/3589408563 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4809dc50 con 0x7f7a4809d630 2023-09-30T22:36:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.843+0000 7f7a47fff700 1 --2- 172.21.15.59:0/3589408563 >> v2:172.21.15.59:3300/0 conn(0x7f7a480a0a30 0x7f7a480a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:23.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.843+0000 7f7a477fe700 1 --2- 172.21.15.59:0/3589408563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a4809d630 0x7f7a480a1340 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0098f0 tx=0x7f7a3c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=988cf682bae6b2e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.843+0000 7f7a46ffd700 1 -- 172.21.15.59:0/3589408563 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c011830 con 0x7f7a4809d630 2023-09-30T22:36:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.843+0000 7f7a46ffd700 1 -- 172.21.15.59:0/3589408563 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c011990 con 0x7f7a4809d630 2023-09-30T22:36:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.843+0000 7f7a46ffd700 1 -- 172.21.15.59:0/3589408563 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c011d20 con 0x7f7a4809d630 2023-09-30T22:36:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.844+0000 7f7a4e8ca700 1 -- 172.21.15.59:0/3589408563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a4809d630 msgr2=0x7f7a480a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.844+0000 7f7a4e8ca700 1 --2- 172.21.15.59:0/3589408563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a4809d630 0x7f7a480a1340 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0098f0 tx=0x7f7a3c009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.844+0000 7f7a4e8ca700 1 -- 172.21.15.59:0/3589408563 shutdown_connections 2023-09-30T22:36:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.844+0000 7f7a4e8ca700 1 --2- 172.21.15.59:0/3589408563 >> v2:172.21.15.59:3300/0 conn(0x7f7a480a0a30 0x7f7a480a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.844+0000 7f7a4e8ca700 1 --2- 172.21.15.59:0/3589408563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a4809d630 0x7f7a480a1340 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.844+0000 7f7a4e8ca700 1 -- 172.21.15.59:0/3589408563 >> 172.21.15.59:0/3589408563 conn(0x7f7a480a3050 msgr2=0x7f7a480a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.844+0000 7f7a4e8ca700 1 -- 172.21.15.59:0/3589408563 shutdown_connections 2023-09-30T22:36:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.844+0000 7f7a4e8ca700 1 -- 172.21.15.59:0/3589408563 wait complete. 2023-09-30T22:36:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.845+0000 7f7a4e8ca700 1 Processor -- start 2023-09-30T22:36:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.845+0000 7f7a4e8ca700 1 -- start start 2023-09-30T22:36:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a4e8ca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a4809d630 0x7f7a48121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a4e8ca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a480a0a30 0x7f7a48121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a4e8ca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a48133930 0x7f7a48121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a4e8ca700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a481225b0 con 0x7f7a48133930 2023-09-30T22:36:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a4e8ca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a48124bd0 con 0x7f7a4809d630 2023-09-30T22:36:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a4e8ca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a48124630 con 0x7f7a480a0a30 2023-09-30T22:36:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a47fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a4809d630 0x7f7a48121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a4ce67700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a48133930 0x7f7a48121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a47fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a4809d630 0x7f7a48121100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56686/0 (socket says 172.21.15.59:56686) 2023-09-30T22:36:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a47fff700 1 -- 172.21.15.59:0/3153387014 learned_addr learned my addr 172.21.15.59:0/3153387014 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a477fe700 1 --2- 172.21.15.59:0/3153387014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a480a0a30 0x7f7a48121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a4ce67700 1 -- 172.21.15.59:0/3153387014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a480a0a30 msgr2=0x7f7a48121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a4ce67700 1 --2- 172.21.15.59:0/3153387014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a480a0a30 0x7f7a48121640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a4ce67700 1 -- 172.21.15.59:0/3153387014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a4809d630 msgr2=0x7f7a48121100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a4ce67700 1 --2- 172.21.15.59:0/3153387014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a4809d630 0x7f7a48121100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a4ce67700 1 -- 172.21.15.59:0/3153387014 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a380094a0 con 0x7f7a48133930 2023-09-30T22:36:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a47fff700 1 --2- 172.21.15.59:0/3153387014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a4809d630 0x7f7a48121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.846+0000 7f7a4ce67700 1 --2- 172.21.15.59:0/3153387014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a48133930 0x7f7a48121b80 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000cb90 tx=0x7f7a4000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:23.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.847+0000 7f7a44ff9700 1 -- 172.21.15.59:0/3153387014 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a40003c00 con 0x7f7a48133930 2023-09-30T22:36:23.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.847+0000 7f7a44ff9700 1 -- 172.21.15.59:0/3153387014 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a40003d60 con 0x7f7a48133930 2023-09-30T22:36:23.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.847+0000 7f7a4e8ca700 1 -- 172.21.15.59:0/3153387014 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3c009550 con 0x7f7a48133930 2023-09-30T22:36:23.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.847+0000 7f7a44ff9700 1 -- 172.21.15.59:0/3153387014 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4000aa80 con 0x7f7a48133930 2023-09-30T22:36:23.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.847+0000 7f7a4e8ca700 1 -- 172.21.15.59:0/3153387014 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a480a0410 con 0x7f7a48133930 2023-09-30T22:36:23.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.848+0000 7f7a44ff9700 1 -- 172.21.15.59:0/3153387014 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a4000abe0 con 0x7f7a48133930 2023-09-30T22:36:23.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.848+0000 7f7a4e8ca700 1 -- 172.21.15.59:0/3153387014 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4811df60 con 0x7f7a48133930 2023-09-30T22:36:23.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.848+0000 7f7a44ff9700 1 -- 172.21.15.59:0/3153387014 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7a4003f550 con 0x7f7a48133930 2023-09-30T22:36:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:23.853+0000 7f7a44ff9700 1 -- 172.21.15.59:0/3153387014 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a400198f0 con 0x7f7a48133930 2023-09-30T22:36:24.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.022+0000 7f8eac697700 1 -- 172.21.15.59:0/347182850 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ea41238e0 con 0x7f8ea40a1340 2023-09-30T22:36:24.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.023+0000 7f8e9affd700 1 -- 172.21.15.59:0/347182850 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ea41238e0 con 0x7f8ea40a1340 2023-09-30T22:36:24.023 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:24.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.025+0000 7f8eac697700 1 -- 172.21.15.59:0/347182850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea40a1340 msgr2=0x7f8ea41205e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:24.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.025+0000 7f8eac697700 1 --2- 172.21.15.59:0/347182850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea40a1340 0x7f8ea41205e0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400ec10 tx=0x7f8e9400ef20 comp rx=0 tx=0).stop 2023-09-30T22:36:24.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.025+0000 7f8eac697700 1 -- 172.21.15.59:0/347182850 shutdown_connections 2023-09-30T22:36:24.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.025+0000 7f8eac697700 1 --2- 172.21.15.59:0/347182850 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ea40a0a30 0x7f8ea41200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.025+0000 7f8eac697700 1 --2- 172.21.15.59:0/347182850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea4133fa0 0x7f8ea4120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.025+0000 7f8eac697700 1 --2- 172.21.15.59:0/347182850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea40a1340 0x7f8ea41205e0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.025+0000 7f8eac697700 1 -- 172.21.15.59:0/347182850 >> 172.21.15.59:0/347182850 conn(0x7f8ea40a6550 msgr2=0x7f8ea41baff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:24.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.025+0000 7f8eac697700 1 -- 172.21.15.59:0/347182850 shutdown_connections 2023-09-30T22:36:24.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.025+0000 7f8eac697700 1 -- 172.21.15.59:0/347182850 wait complete. 2023-09-30T22:36:24.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:24.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.058+0000 7f7a4e8ca700 1 -- 172.21.15.59:0/3153387014 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7a48124850 con 0x7f7a48133930 2023-09-30T22:36:24.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.058+0000 7f7a44ff9700 1 -- 172.21.15.59:0/3153387014 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a48124850 con 0x7f7a48133930 2023-09-30T22:36:24.059 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:24.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.060+0000 7f7a4e8ca700 1 -- 172.21.15.59:0/3153387014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a48133930 msgr2=0x7f7a48121b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:24.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.060+0000 7f7a4e8ca700 1 --2- 172.21.15.59:0/3153387014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a48133930 0x7f7a48121b80 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000cb90 tx=0x7f7a4000cea0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.060+0000 7f7a4e8ca700 1 -- 172.21.15.59:0/3153387014 shutdown_connections 2023-09-30T22:36:24.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.060+0000 7f7a4e8ca700 1 --2- 172.21.15.59:0/3153387014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a48133930 0x7f7a48121b80 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.060+0000 7f7a4e8ca700 1 --2- 172.21.15.59:0/3153387014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a4809d630 0x7f7a48121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.060+0000 7f7a4e8ca700 1 --2- 172.21.15.59:0/3153387014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a480a0a30 0x7f7a48121640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.061+0000 7f7a4e8ca700 1 -- 172.21.15.59:0/3153387014 >> 172.21.15.59:0/3153387014 conn(0x7f7a480a3050 msgr2=0x7f7a48133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.061+0000 7f7a4e8ca700 1 -- 172.21.15.59:0/3153387014 shutdown_connections 2023-09-30T22:36:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.061+0000 7f7a4e8ca700 1 -- 172.21.15.59:0/3153387014 wait complete. 2023-09-30T22:36:24.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:24.121 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:24.160 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:24.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.266+0000 7fc69af02700 1 Processor -- start 2023-09-30T22:36:24.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.266+0000 7fc69af02700 1 -- start start 2023-09-30T22:36:24.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.267+0000 7fc69af02700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409d6f0 0x7fc69409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:24.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.267+0000 7fc69af02700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc69409e410 0x7fc694130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:24.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.267+0000 7fc69af02700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69409f130 con 0x7fc69409e000 2023-09-30T22:36:24.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.267+0000 7fc69af02700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69409f520 con 0x7fc69409e410 2023-09-30T22:36:24.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.267+0000 7fc69af02700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc69409e930 con 0x7fc69409d6f0 2023-09-30T22:36:24.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.267+0000 7fc698c9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409d6f0 0x7fc69409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:24.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.267+0000 7fc69949f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc69409e410 0x7fc694130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:24.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.267+0000 7fc698c9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409d6f0 0x7fc69409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33148/0 (socket says 172.21.15.59:33148) 2023-09-30T22:36:24.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.267+0000 7fc698c9e700 1 -- 172.21.15.59:0/864414482 learned_addr learned my addr 172.21.15.59:0/864414482 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:24.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.267+0000 7fc698c9e700 1 -- 172.21.15.59:0/864414482 >> v2:172.21.15.59:3300/0 conn(0x7fc69409e410 msgr2=0x7fc694130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:24.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.267+0000 7fc698c9e700 1 --2- 172.21.15.59:0/864414482 >> v2:172.21.15.59:3300/0 conn(0x7fc69409e410 0x7fc694130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.267+0000 7fc698c9e700 1 -- 172.21.15.59:0/864414482 >> v1:172.21.15.59:6789/0 conn(0x7fc69409e000 legacy=0x7fc694130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.267+0000 7fc698c9e700 1 -- 172.21.15.59:0/864414482 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69409b2d0 con 0x7fc69409d6f0 2023-09-30T22:36:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.268+0000 7fc698c9e700 1 --2- 172.21.15.59:0/864414482 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409d6f0 0x7fc69409dac0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00d150 tx=0x7fc68c00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e529e9ed30d5a2b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.268+0000 7fc6937fe700 1 -- 172.21.15.59:0/864414482 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c010070 con 0x7fc69409d6f0 2023-09-30T22:36:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.268+0000 7fc6937fe700 1 -- 172.21.15.59:0/864414482 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c00dd10 con 0x7fc69409d6f0 2023-09-30T22:36:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.268+0000 7fc6937fe700 1 -- 172.21.15.59:0/864414482 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c00b310 con 0x7fc69409d6f0 2023-09-30T22:36:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.268+0000 7fc69af02700 1 -- 172.21.15.59:0/864414482 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409d6f0 msgr2=0x7fc69409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.268+0000 7fc69af02700 1 --2- 172.21.15.59:0/864414482 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409d6f0 0x7fc69409dac0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00d150 tx=0x7fc68c00d460 comp rx=0 tx=0).stop 2023-09-30T22:36:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.269+0000 7fc69af02700 1 -- 172.21.15.59:0/864414482 shutdown_connections 2023-09-30T22:36:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.269+0000 7fc69af02700 1 --2- 172.21.15.59:0/864414482 >> v2:172.21.15.59:3300/0 conn(0x7fc69409e410 0x7fc694130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.269+0000 7fc69af02700 1 --2- 172.21.15.59:0/864414482 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409d6f0 0x7fc69409dac0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.269+0000 7fc69af02700 1 -- 172.21.15.59:0/864414482 >> 172.21.15.59:0/864414482 conn(0x7fc694066f50 msgr2=0x7fc69409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:24.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.269+0000 7fc69af02700 1 -- 172.21.15.59:0/864414482 shutdown_connections 2023-09-30T22:36:24.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.269+0000 7fc69af02700 1 -- 172.21.15.59:0/864414482 wait complete. 2023-09-30T22:36:24.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.270+0000 7fc69af02700 1 Processor -- start 2023-09-30T22:36:24.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.270+0000 7fc69af02700 1 -- start start 2023-09-30T22:36:24.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.270+0000 7fc69af02700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409d6f0 0x7fc694122470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:24.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.270+0000 7fc69af02700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409e000 0x7fc6941229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:24.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.270+0000 7fc69af02700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc69409e410 0x7fc694122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:24.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.270+0000 7fc69af02700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc694123fa0 con 0x7fc69409e000 2023-09-30T22:36:24.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.270+0000 7fc69af02700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc694125910 con 0x7fc69409e410 2023-09-30T22:36:24.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.270+0000 7fc69af02700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc694125eb0 con 0x7fc69409d6f0 2023-09-30T22:36:24.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.270+0000 7fc693fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409e000 0x7fc6941229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:24.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.270+0000 7fc698c9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409d6f0 0x7fc694122470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:24.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.270+0000 7fc693fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409e000 0x7fc6941229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55736/0 (socket says 172.21.15.59:55736) 2023-09-30T22:36:24.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.270+0000 7fc693fff700 1 -- 172.21.15.59:0/3442820537 learned_addr learned my addr 172.21.15.59:0/3442820537 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:24.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.270+0000 7fc698c9e700 1 --2- 172.21.15.59:0/3442820537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409d6f0 0x7fc694122470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33152/0 (socket says 172.21.15.59:33152) 2023-09-30T22:36:24.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.270+0000 7fc69949f700 1 --2- 172.21.15.59:0/3442820537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc69409e410 0x7fc694122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:24.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.271+0000 7fc693fff700 1 -- 172.21.15.59:0/3442820537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409d6f0 msgr2=0x7fc694122470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:24.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.271+0000 7fc693fff700 1 --2- 172.21.15.59:0/3442820537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409d6f0 0x7fc694122470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.271+0000 7fc693fff700 1 -- 172.21.15.59:0/3442820537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc69409e410 msgr2=0x7fc694122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:24.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.271+0000 7fc693fff700 1 --2- 172.21.15.59:0/3442820537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc69409e410 0x7fc694122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.271+0000 7fc693fff700 1 -- 172.21.15.59:0/3442820537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c00bd40 con 0x7fc69409e000 2023-09-30T22:36:24.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.271+0000 7fc698c9e700 1 --2- 172.21.15.59:0/3442820537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409d6f0 0x7fc694122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:24.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.271+0000 7fc693fff700 1 --2- 172.21.15.59:0/3442820537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409e000 0x7fc6941229b0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00c4e0 tx=0x7fc67c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:24.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.271+0000 7fc6917fa700 1 -- 172.21.15.59:0/3442820537 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c0052d0 con 0x7fc69409e000 2023-09-30T22:36:24.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.271+0000 7fc6917fa700 1 -- 172.21.15.59:0/3442820537 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c005430 con 0x7fc69409e000 2023-09-30T22:36:24.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.271+0000 7fc69af02700 1 -- 172.21.15.59:0/3442820537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6940a1d00 con 0x7fc69409e000 2023-09-30T22:36:24.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.271+0000 7fc6917fa700 1 -- 172.21.15.59:0/3442820537 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c0038c0 con 0x7fc69409e000 2023-09-30T22:36:24.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.271+0000 7fc69af02700 1 -- 172.21.15.59:0/3442820537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69409c750 con 0x7fc69409e000 2023-09-30T22:36:24.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.272+0000 7fc69af02700 1 -- 172.21.15.59:0/3442820537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc694074ea0 con 0x7fc69409e000 2023-09-30T22:36:24.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.273+0000 7fc6917fa700 1 -- 172.21.15.59:0/3442820537 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc67c003a20 con 0x7fc69409e000 2023-09-30T22:36:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.273+0000 7fc6917fa700 1 -- 172.21.15.59:0/3442820537 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc67c03eeb0 con 0x7fc69409e000 2023-09-30T22:36:24.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.277+0000 7fc6917fa700 1 -- 172.21.15.59:0/3442820537 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc67c003cd0 con 0x7fc69409e000 2023-09-30T22:36:24.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.305+0000 7f8e38be8700 1 Processor -- start 2023-09-30T22:36:24.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.305+0000 7f8e38be8700 1 -- start start 2023-09-30T22:36:24.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.306+0000 7f8e38be8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e3409e930 0x7f8e3409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:24.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.306+0000 7f8e38be8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3409f240 0x7f8e341317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:24.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.306+0000 7f8e38be8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e3409f650 0x7f8e34131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:24.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.306+0000 7f8e38be8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e34070940 con 0x7f8e3409e930 2023-09-30T22:36:24.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.306+0000 7f8e38be8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3406fd60 con 0x7f8e3409f240 2023-09-30T22:36:24.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.306+0000 7f8e38be8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3406fa80 con 0x7f8e3409f650 2023-09-30T22:36:24.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e32d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e3409f650 0x7f8e34131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:24.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e31d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3409f240 0x7f8e341317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:24.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e32d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e3409f650 0x7f8e34131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33158/0 (socket says 172.21.15.59:33158) 2023-09-30T22:36:24.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e3259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e3409e930 0x7f8e3409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:24.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e32d9d700 1 -- 172.21.15.59:0/1554974127 learned_addr learned my addr 172.21.15.59:0/1554974127 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:24.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e31d9b700 1 -- 172.21.15.59:0/1554974127 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e3409f650 msgr2=0x7f8e34131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:24.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e31d9b700 1 --2- 172.21.15.59:0/1554974127 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e3409f650 0x7f8e34131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e31d9b700 1 -- 172.21.15.59:0/1554974127 >> v2:172.21.15.59:3300/0 conn(0x7f8e3409e930 msgr2=0x7f8e3409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:24.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e31d9b700 1 --2- 172.21.15.59:0/1554974127 >> v2:172.21.15.59:3300/0 conn(0x7f8e3409e930 0x7f8e3409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e31d9b700 1 -- 172.21.15.59:0/1554974127 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3409fb60 con 0x7f8e3409f240 2023-09-30T22:36:24.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e32d9d700 1 --2- 172.21.15.59:0/1554974127 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e3409f650 0x7f8e34131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:24.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e3259c700 1 --2- 172.21.15.59:0/1554974127 >> v2:172.21.15.59:3300/0 conn(0x7f8e3409e930 0x7f8e3409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:24.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e31d9b700 1 --2- 172.21.15.59:0/1554974127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3409f240 0x7f8e341317f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009840 tx=0x7f8e1c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a5175f1eae79ca9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:24.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e3159a700 1 -- 172.21.15.59:0/1554974127 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c011830 con 0x7f8e3409f240 2023-09-30T22:36:24.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e3159a700 1 -- 172.21.15.59:0/1554974127 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c011990 con 0x7f8e3409f240 2023-09-30T22:36:24.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.307+0000 7f8e3159a700 1 -- 172.21.15.59:0/1554974127 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c011d20 con 0x7f8e3409f240 2023-09-30T22:36:24.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.308+0000 7f8e38be8700 1 -- 172.21.15.59:0/1554974127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3409f240 msgr2=0x7f8e341317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:24.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.308+0000 7f8e38be8700 1 --2- 172.21.15.59:0/1554974127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3409f240 0x7f8e341317f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009840 tx=0x7f8e1c009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:24.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.308+0000 7f8e38be8700 1 -- 172.21.15.59:0/1554974127 shutdown_connections 2023-09-30T22:36:24.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.308+0000 7f8e38be8700 1 --2- 172.21.15.59:0/1554974127 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e3409f650 0x7f8e34131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.308+0000 7f8e38be8700 1 --2- 172.21.15.59:0/1554974127 >> v2:172.21.15.59:3300/0 conn(0x7f8e3409e930 0x7f8e3409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.308+0000 7f8e38be8700 1 --2- 172.21.15.59:0/1554974127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3409f240 0x7f8e341317f0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.308+0000 7f8e38be8700 1 -- 172.21.15.59:0/1554974127 >> 172.21.15.59:0/1554974127 conn(0x7f8e340a4210 msgr2=0x7f8e340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:24.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.308+0000 7f8e38be8700 1 -- 172.21.15.59:0/1554974127 shutdown_connections 2023-09-30T22:36:24.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.308+0000 7f8e38be8700 1 -- 172.21.15.59:0/1554974127 wait complete. 2023-09-30T22:36:24.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.310+0000 7f8e38be8700 1 Processor -- start 2023-09-30T22:36:24.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.310+0000 7f8e38be8700 1 -- start start 2023-09-30T22:36:24.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.310+0000 7f8e38be8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e3409e930 0x7f8e3406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:24.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.310+0000 7f8e38be8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3409f240 0x7f8e3406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:24.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.310+0000 7f8e38be8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e3409f650 0x7f8e3406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:24.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.310+0000 7f8e38be8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3406cd80 con 0x7f8e3409f650 2023-09-30T22:36:24.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.310+0000 7f8e38be8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e341b72a0 con 0x7f8e3409f240 2023-09-30T22:36:24.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.310+0000 7f8e38be8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e341a9450 con 0x7f8e3409e930 2023-09-30T22:36:24.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.310+0000 7f8e31d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3409f240 0x7f8e3406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:24.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.310+0000 7f8e3259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e3409e930 0x7f8e3406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:24.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.310+0000 7f8e31d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3409f240 0x7f8e3406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56716/0 (socket says 172.21.15.59:56716) 2023-09-30T22:36:24.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.310+0000 7f8e3259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e3409e930 0x7f8e3406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33160/0 (socket says 172.21.15.59:33160) 2023-09-30T22:36:24.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.310+0000 7f8e31d9b700 1 -- 172.21.15.59:0/3561174295 learned_addr learned my addr 172.21.15.59:0/3561174295 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:24.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.310+0000 7f8e32d9d700 1 --2- 172.21.15.59:0/3561174295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e3409f650 0x7f8e3406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:24.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.311+0000 7f8e31d9b700 1 -- 172.21.15.59:0/3561174295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e3409e930 msgr2=0x7f8e3406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:24.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.311+0000 7f8e31d9b700 1 --2- 172.21.15.59:0/3561174295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e3409e930 0x7f8e3406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.311+0000 7f8e31d9b700 1 -- 172.21.15.59:0/3561174295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e3409f650 msgr2=0x7f8e3406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:24.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.311+0000 7f8e31d9b700 1 --2- 172.21.15.59:0/3561174295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e3409f650 0x7f8e3406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.311+0000 7f8e31d9b700 1 -- 172.21.15.59:0/3561174295 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c009a70 con 0x7f8e3409f240 2023-09-30T22:36:24.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.311+0000 7f8e3259c700 1 --2- 172.21.15.59:0/3561174295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e3409e930 0x7f8e3406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:24.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.311+0000 7f8e31d9b700 1 --2- 172.21.15.59:0/3561174295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3409f240 0x7f8e3406bdf0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0090b0 tx=0x7f8e1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:24.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.311+0000 7f8e2affd700 1 -- 172.21.15.59:0/3561174295 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c004450 con 0x7f8e3409f240 2023-09-30T22:36:24.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.311+0000 7f8e2affd700 1 -- 172.21.15.59:0/3561174295 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c01f070 con 0x7f8e3409f240 2023-09-30T22:36:24.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.311+0000 7f8e38be8700 1 -- 172.21.15.59:0/3561174295 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e24009550 con 0x7f8e3409f240 2023-09-30T22:36:24.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.311+0000 7f8e2affd700 1 -- 172.21.15.59:0/3561174295 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c0038e0 con 0x7f8e3409f240 2023-09-30T22:36:24.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.311+0000 7f8e38be8700 1 -- 172.21.15.59:0/3561174295 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1c0094a0 con 0x7f8e3409f240 2023-09-30T22:36:24.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.312+0000 7f8e2affd700 1 -- 172.21.15.59:0/3561174295 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e1c003a40 con 0x7f8e3409f240 2023-09-30T22:36:24.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.312+0000 7f8e2affd700 1 -- 172.21.15.59:0/3561174295 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e1c021070 con 0x7f8e3409f240 2023-09-30T22:36:24.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.312+0000 7f8e38be8700 1 -- 172.21.15.59:0/3561174295 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e341a0b30 con 0x7f8e3409f240 2023-09-30T22:36:24.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.317+0000 7f8e2affd700 1 -- 172.21.15.59:0/3561174295 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e1c015020 con 0x7f8e3409f240 2023-09-30T22:36:24.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.486+0000 7fc69af02700 1 -- 172.21.15.59:0/3442820537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc6941266a0 con 0x7fc69409e000 2023-09-30T22:36:24.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.486+0000 7fc6917fa700 1 -- 172.21.15.59:0/3442820537 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc67c017030 con 0x7fc69409e000 2023-09-30T22:36:24.487 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:24.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.489+0000 7fc69af02700 1 -- 172.21.15.59:0/3442820537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409e000 msgr2=0x7fc6941229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:24.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.489+0000 7fc69af02700 1 --2- 172.21.15.59:0/3442820537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409e000 0x7fc6941229b0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00c4e0 tx=0x7fc67c00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.489+0000 7fc69af02700 1 -- 172.21.15.59:0/3442820537 shutdown_connections 2023-09-30T22:36:24.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.489+0000 7fc69af02700 1 --2- 172.21.15.59:0/3442820537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409d6f0 0x7fc694122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.489+0000 7fc69af02700 1 --2- 172.21.15.59:0/3442820537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc69409e410 0x7fc694122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.489+0000 7fc69af02700 1 --2- 172.21.15.59:0/3442820537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409e000 0x7fc6941229b0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.489+0000 7fc69af02700 1 -- 172.21.15.59:0/3442820537 >> 172.21.15.59:0/3442820537 conn(0x7fc694066f50 msgr2=0x7fc69406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:24.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.489+0000 7fc69af02700 1 -- 172.21.15.59:0/3442820537 shutdown_connections 2023-09-30T22:36:24.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.489+0000 7fc69af02700 1 -- 172.21.15.59:0/3442820537 wait complete. 2023-09-30T22:36:24.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:24.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.524+0000 7f8e38be8700 1 -- 172.21.15.59:0/3561174295 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e34071d20 con 0x7f8e3409f240 2023-09-30T22:36:24.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.525+0000 7f8e2affd700 1 -- 172.21.15.59:0/3561174295 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e1c024380 con 0x7f8e3409f240 2023-09-30T22:36:24.525 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.527+0000 7f8e38be8700 1 -- 172.21.15.59:0/3561174295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3409f240 msgr2=0x7f8e3406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.527+0000 7f8e38be8700 1 --2- 172.21.15.59:0/3561174295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3409f240 0x7f8e3406bdf0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0090b0 tx=0x7f8e1c004750 comp rx=0 tx=0).stop 2023-09-30T22:36:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.527+0000 7f8e38be8700 1 -- 172.21.15.59:0/3561174295 shutdown_connections 2023-09-30T22:36:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.527+0000 7f8e38be8700 1 --2- 172.21.15.59:0/3561174295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e3409e930 0x7f8e3406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.527+0000 7f8e38be8700 1 --2- 172.21.15.59:0/3561174295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e3409f650 0x7f8e3406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.527+0000 7f8e38be8700 1 --2- 172.21.15.59:0/3561174295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3409f240 0x7f8e3406bdf0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:24.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.527+0000 7f8e38be8700 1 -- 172.21.15.59:0/3561174295 >> 172.21.15.59:0/3561174295 conn(0x7f8e340a4210 msgr2=0x7f8e341b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:24.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.527+0000 7f8e38be8700 1 -- 172.21.15.59:0/3561174295 shutdown_connections 2023-09-30T22:36:24.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:24.527+0000 7f8e38be8700 1 -- 172.21.15.59:0/3561174295 wait complete. 2023-09-30T22:36:24.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:25.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:25.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:25.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.189+0000 7ffac3c5f700 1 Processor -- start 2023-09-30T22:36:25.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.190+0000 7ffac3c5f700 1 -- start start 2023-09-30T22:36:25.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.190+0000 7ffac3c5f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc0a0a30 0x7ffabc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.190+0000 7ffac3c5f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc0a1340 0x7ffabc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.190+0000 7ffac3c5f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffabc09edd0 con 0x7ffabc133fa0 2023-09-30T22:36:25.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.190+0000 7ffac3c5f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc09e1f0 con 0x7ffabc0a0a30 2023-09-30T22:36:25.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.190+0000 7ffac3c5f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc09dc50 con 0x7ffabc0a1340 2023-09-30T22:36:25.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.190+0000 7ffac19fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc0a0a30 0x7ffabc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.190+0000 7ffac11fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc0a1340 0x7ffabc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.190+0000 7ffac21fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffabc133fa0 0x7ffabc13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59022/0 (socket says 172.21.15.59:59022) 2023-09-30T22:36:25.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.190+0000 7ffac21fc700 1 -- 172.21.15.59:0/74451267 learned_addr learned my addr 172.21.15.59:0/74451267 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:25.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.191+0000 7ffac09f9700 1 -- 172.21.15.59:0/74451267 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075855330 0 0) 0x7ffabc09edd0 con 0x7ffabc133fa0 2023-09-30T22:36:25.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.191+0000 7ffac09f9700 1 -- 172.21.15.59:0/74451267 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaa80035b0 con 0x7ffabc133fa0 2023-09-30T22:36:25.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.191+0000 7ffac11fa700 1 -- 172.21.15.59:0/74451267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc0a0a30 msgr2=0x7ffabc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:25.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.191+0000 7ffac11fa700 1 --2- 172.21.15.59:0/74451267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc0a0a30 0x7ffabc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.191+0000 7ffac11fa700 1 -- 172.21.15.59:0/74451267 >> v1:172.21.15.59:6789/0 conn(0x7ffabc133fa0 legacy=0x7ffabc13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.191+0000 7ffac11fa700 1 -- 172.21.15.59:0/74451267 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc0a1fe0 con 0x7ffabc0a1340 2023-09-30T22:36:25.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.191+0000 7ffac19fb700 1 --2- 172.21.15.59:0/74451267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc0a0a30 0x7ffabc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:25.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.191+0000 7ffac11fa700 1 --2- 172.21.15.59:0/74451267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc0a1340 0x7ffabc133a60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009870 tx=0x7ffaac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfae984a80699af7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:25.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.191+0000 7ffac09f9700 1 -- 172.21.15.59:0/74451267 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac011830 con 0x7ffabc0a1340 2023-09-30T22:36:25.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.191+0000 7ffac09f9700 1 -- 172.21.15.59:0/74451267 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac011990 con 0x7ffabc0a1340 2023-09-30T22:36:25.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.191+0000 7ffac09f9700 1 -- 172.21.15.59:0/74451267 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac011d00 con 0x7ffabc0a1340 2023-09-30T22:36:25.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.192+0000 7ffac3c5f700 1 -- 172.21.15.59:0/74451267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc0a1340 msgr2=0x7ffabc133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.192+0000 7ffac3c5f700 1 --2- 172.21.15.59:0/74451267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc0a1340 0x7ffabc133a60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009870 tx=0x7ffaac009b80 comp rx=0 tx=0).stop 2023-09-30T22:36:25.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.192+0000 7ffac3c5f700 1 -- 172.21.15.59:0/74451267 shutdown_connections 2023-09-30T22:36:25.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.192+0000 7ffac3c5f700 1 --2- 172.21.15.59:0/74451267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc0a0a30 0x7ffabc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.192+0000 7ffac3c5f700 1 --2- 172.21.15.59:0/74451267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc0a1340 0x7ffabc133a60 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.192+0000 7ffac3c5f700 1 -- 172.21.15.59:0/74451267 >> 172.21.15.59:0/74451267 conn(0x7ffabc0a6550 msgr2=0x7ffabc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:25.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.192+0000 7ffac3c5f700 1 -- 172.21.15.59:0/74451267 shutdown_connections 2023-09-30T22:36:25.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.192+0000 7ffac3c5f700 1 -- 172.21.15.59:0/74451267 wait complete. 2023-09-30T22:36:25.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.193+0000 7ffac3c5f700 1 Processor -- start 2023-09-30T22:36:25.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.193+0000 7ffac3c5f700 1 -- start start 2023-09-30T22:36:25.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.193+0000 7ffac3c5f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffabc0a0a30 0x7ffabc1c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.193+0000 7ffac3c5f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc0a1340 0x7ffabc1c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.193+0000 7ffac3c5f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc133fa0 0x7ffabc1c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.193+0000 7ffac3c5f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc1248d0 con 0x7ffabc0a0a30 2023-09-30T22:36:25.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.193+0000 7ffac3c5f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc124670 con 0x7ffabc133fa0 2023-09-30T22:36:25.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.193+0000 7ffac3c5f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc126310 con 0x7ffabc0a1340 2023-09-30T22:36:25.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffac11fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc0a1340 0x7ffabc1c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffac11fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc0a1340 0x7ffabc1c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:34798/0 (socket says 172.21.15.59:34798) 2023-09-30T22:36:25.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffac11fa700 1 -- 172.21.15.59:0/2170867457 learned_addr learned my addr 172.21.15.59:0/2170867457 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:25.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffac21fc700 1 --2- 172.21.15.59:0/2170867457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc133fa0 0x7ffabc1c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffac19fb700 1 --2- 172.21.15.59:0/2170867457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffabc0a0a30 0x7ffabc1c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffac11fa700 1 -- 172.21.15.59:0/2170867457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc133fa0 msgr2=0x7ffabc1c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffac11fa700 1 --2- 172.21.15.59:0/2170867457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc133fa0 0x7ffabc1c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffac11fa700 1 -- 172.21.15.59:0/2170867457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffabc0a0a30 msgr2=0x7ffabc1c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffac11fa700 1 --2- 172.21.15.59:0/2170867457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffabc0a0a30 0x7ffabc1c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffac11fa700 1 -- 172.21.15.59:0/2170867457 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab80094a0 con 0x7ffabc0a1340 2023-09-30T22:36:25.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffac11fa700 1 --2- 172.21.15.59:0/2170867457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc0a1340 0x7ffabc1c88c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009bc0 tx=0x7ffaac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:25.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffab27fc700 1 -- 172.21.15.59:0/2170867457 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac004550 con 0x7ffabc0a1340 2023-09-30T22:36:25.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffab27fc700 1 -- 172.21.15.59:0/2170867457 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac01f070 con 0x7ffabc0a1340 2023-09-30T22:36:25.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffac3c5f700 1 -- 172.21.15.59:0/2170867457 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac0094a0 con 0x7ffabc0a1340 2023-09-30T22:36:25.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffab27fc700 1 -- 172.21.15.59:0/2170867457 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0038e0 con 0x7ffabc0a1340 2023-09-30T22:36:25.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.194+0000 7ffac3c5f700 1 -- 172.21.15.59:0/2170867457 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc0a25e0 con 0x7ffabc0a1340 2023-09-30T22:36:25.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.195+0000 7ffab27fc700 1 -- 172.21.15.59:0/2170867457 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffaac003a40 con 0x7ffabc0a1340 2023-09-30T22:36:25.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.195+0000 7ffab27fc700 1 -- 172.21.15.59:0/2170867457 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffaac021070 con 0x7ffabc0a1340 2023-09-30T22:36:25.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.195+0000 7ffac3c5f700 1 -- 172.21.15.59:0/2170867457 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc126150 con 0x7ffabc0a1340 2023-09-30T22:36:25.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.201+0000 7ffab27fc700 1 -- 172.21.15.59:0/2170867457 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffaac02b080 con 0x7ffabc0a1340 2023-09-30T22:36:25.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.227+0000 7fa1d1bf6700 1 Processor -- start 2023-09-30T22:36:25.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.228+0000 7fa1d1bf6700 1 -- start start 2023-09-30T22:36:25.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.228+0000 7fa1d1bf6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0a0a30 0x7fa1cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.228+0000 7fa1d1bf6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1cc09d630 0x7fa1cc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.228+0000 7fa1d1bf6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1cc0a2a70 con 0x7fa1cc133930 2023-09-30T22:36:25.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.228+0000 7fa1d1bf6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1cc0a01d0 con 0x7fa1cc09d630 2023-09-30T22:36:25.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.228+0000 7fa1d1bf6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc09e2b0 con 0x7fa1cc0a0a30 2023-09-30T22:36:25.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.228+0000 7fa1cb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0a0a30 0x7fa1cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.228+0000 7fa1caffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1cc09d630 0x7fa1cc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.228+0000 7fa1cb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0a0a30 0x7fa1cc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40866/0 (socket says 172.21.15.59:40866) 2023-09-30T22:36:25.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.228+0000 7fa1caffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1cc09d630 0x7fa1cc0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40770/0 (socket says 172.21.15.59:40770) 2023-09-30T22:36:25.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.228+0000 7fa1cb7fe700 1 -- 172.21.15.59:0/4151379479 learned_addr learned my addr 172.21.15.59:0/4151379479 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:25.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.229+0000 7fa1caffd700 1 -- 172.21.15.59:0/4151379479 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0a0a30 msgr2=0x7fa1cc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:25.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.229+0000 7fa1caffd700 1 --2- 172.21.15.59:0/4151379479 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0a0a30 0x7fa1cc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.229+0000 7fa1caffd700 1 -- 172.21.15.59:0/4151379479 >> v1:172.21.15.59:6789/0 conn(0x7fa1cc133930 legacy=0x7fa1cc133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.229+0000 7fa1caffd700 1 -- 172.21.15.59:0/4151379479 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc09dc50 con 0x7fa1cc09d630 2023-09-30T22:36:25.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.229+0000 7fa1cb7fe700 1 --2- 172.21.15.59:0/4151379479 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0a0a30 0x7fa1cc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:25.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.229+0000 7fa1caffd700 1 --2- 172.21.15.59:0/4151379479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc09d630 0x7fa1cc0a1340 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4009840 tx=0x7fa1b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e23b62e3c8d79b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:25.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.229+0000 7fa1ca7fc700 1 -- 172.21.15.59:0/4151379479 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4011830 con 0x7fa1cc09d630 2023-09-30T22:36:25.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.229+0000 7fa1ca7fc700 1 -- 172.21.15.59:0/4151379479 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b4011990 con 0x7fa1cc09d630 2023-09-30T22:36:25.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.229+0000 7fa1ca7fc700 1 -- 172.21.15.59:0/4151379479 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4011d20 con 0x7fa1cc09d630 2023-09-30T22:36:25.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.230+0000 7fa1d1bf6700 1 -- 172.21.15.59:0/4151379479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc09d630 msgr2=0x7fa1cc0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.230+0000 7fa1d1bf6700 1 --2- 172.21.15.59:0/4151379479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc09d630 0x7fa1cc0a1340 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4009840 tx=0x7fa1b4009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:25.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.230+0000 7fa1d1bf6700 1 -- 172.21.15.59:0/4151379479 shutdown_connections 2023-09-30T22:36:25.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.230+0000 7fa1d1bf6700 1 --2- 172.21.15.59:0/4151379479 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0a0a30 0x7fa1cc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.230+0000 7fa1d1bf6700 1 --2- 172.21.15.59:0/4151379479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc09d630 0x7fa1cc0a1340 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.230+0000 7fa1d1bf6700 1 -- 172.21.15.59:0/4151379479 >> 172.21.15.59:0/4151379479 conn(0x7fa1cc0a3050 msgr2=0x7fa1cc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:25.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.230+0000 7fa1d1bf6700 1 -- 172.21.15.59:0/4151379479 shutdown_connections 2023-09-30T22:36:25.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.230+0000 7fa1d1bf6700 1 -- 172.21.15.59:0/4151379479 wait complete. 2023-09-30T22:36:25.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.231+0000 7fa1d1bf6700 1 Processor -- start 2023-09-30T22:36:25.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.231+0000 7fa1d1bf6700 1 -- start start 2023-09-30T22:36:25.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.232+0000 7fa1d1bf6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1cc09d630 0x7fa1cc1c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.232+0000 7fa1d1bf6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0a0a30 0x7fa1cc1c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.232+0000 7fa1d1bf6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc133930 0x7fa1cc1c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.232+0000 7fa1d1bf6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc120a70 con 0x7fa1cc133930 2023-09-30T22:36:25.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.232+0000 7fa1d1bf6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc120880 con 0x7fa1cc0a0a30 2023-09-30T22:36:25.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.232+0000 7fa1d1bf6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc121920 con 0x7fa1cc09d630 2023-09-30T22:36:25.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.232+0000 7fa1cbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc133930 0x7fa1cc1c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.232+0000 7fa1cb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1cc09d630 0x7fa1cc1c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.232+0000 7fa1cbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc133930 0x7fa1cc1c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40774/0 (socket says 172.21.15.59:40774) 2023-09-30T22:36:25.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.232+0000 7fa1cb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1cc09d630 0x7fa1cc1c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:34812/0 (socket says 172.21.15.59:34812) 2023-09-30T22:36:25.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.232+0000 7fa1cbfff700 1 -- 172.21.15.59:0/2596553655 learned_addr learned my addr 172.21.15.59:0/2596553655 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:25.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.232+0000 7fa1caffd700 1 --2- 172.21.15.59:0/2596553655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0a0a30 0x7fa1cc1c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.233+0000 7fa1cbfff700 1 -- 172.21.15.59:0/2596553655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1cc09d630 msgr2=0x7fa1cc1c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.233+0000 7fa1cbfff700 1 --2- 172.21.15.59:0/2596553655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1cc09d630 0x7fa1cc1c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.233+0000 7fa1cbfff700 1 -- 172.21.15.59:0/2596553655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0a0a30 msgr2=0x7fa1cc1c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.233+0000 7fa1cbfff700 1 --2- 172.21.15.59:0/2596553655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0a0a30 0x7fa1cc1c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.233+0000 7fa1cbfff700 1 -- 172.21.15.59:0/2596553655 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c4009b30 con 0x7fa1cc133930 2023-09-30T22:36:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.233+0000 7fa1caffd700 1 --2- 172.21.15.59:0/2596553655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0a0a30 0x7fa1cc1c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.233+0000 7fa1cbfff700 1 --2- 172.21.15.59:0/2596553655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc133930 0x7fa1cc1c8d90 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00c500 tx=0x7fa1bc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.233+0000 7fa1c3fff700 1 -- 172.21.15.59:0/2596553655 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc0052d0 con 0x7fa1cc133930 2023-09-30T22:36:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.233+0000 7fa1c3fff700 1 -- 172.21.15.59:0/2596553655 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1bc005430 con 0x7fa1cc133930 2023-09-30T22:36:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.233+0000 7fa1d1bf6700 1 -- 172.21.15.59:0/2596553655 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b40094a0 con 0x7fa1cc133930 2023-09-30T22:36:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.233+0000 7fa1c3fff700 1 -- 172.21.15.59:0/2596553655 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc0038c0 con 0x7fa1cc133930 2023-09-30T22:36:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.233+0000 7fa1d1bf6700 1 -- 172.21.15.59:0/2596553655 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1cc1224b0 con 0x7fa1cc133930 2023-09-30T22:36:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.234+0000 7fa1c3fff700 1 -- 172.21.15.59:0/2596553655 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1bc003a20 con 0x7fa1cc133930 2023-09-30T22:36:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.234+0000 7fa1c3fff700 1 -- 172.21.15.59:0/2596553655 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa1bc03e9e0 con 0x7fa1cc133930 2023-09-30T22:36:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.234+0000 7fa1d1bf6700 1 -- 172.21.15.59:0/2596553655 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1cc121e90 con 0x7fa1cc133930 2023-09-30T22:36:25.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.239+0000 7fa1c3fff700 1 -- 172.21.15.59:0/2596553655 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1bc018260 con 0x7fa1cc133930 2023-09-30T22:36:25.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.406+0000 7ffac3c5f700 1 -- 172.21.15.59:0/2170867457 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffabc125f40 con 0x7ffabc0a1340 2023-09-30T22:36:25.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.407+0000 7ffab27fc700 1 -- 172.21.15.59:0/2170867457 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffaac015020 con 0x7ffabc0a1340 2023-09-30T22:36:25.407 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:25.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.409+0000 7ffac3c5f700 1 -- 172.21.15.59:0/2170867457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc0a1340 msgr2=0x7ffabc1c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.409+0000 7ffac3c5f700 1 --2- 172.21.15.59:0/2170867457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc0a1340 0x7ffabc1c88c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009bc0 tx=0x7ffaac004750 comp rx=0 tx=0).stop 2023-09-30T22:36:25.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.409+0000 7ffac3c5f700 1 -- 172.21.15.59:0/2170867457 shutdown_connections 2023-09-30T22:36:25.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.409+0000 7ffac3c5f700 1 --2- 172.21.15.59:0/2170867457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffabc133fa0 0x7ffabc1c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.409+0000 7ffac3c5f700 1 --2- 172.21.15.59:0/2170867457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffabc0a0a30 0x7ffabc1c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.409+0000 7ffac3c5f700 1 --2- 172.21.15.59:0/2170867457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffabc0a1340 0x7ffabc1c88c0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.409+0000 7ffac3c5f700 1 -- 172.21.15.59:0/2170867457 >> 172.21.15.59:0/2170867457 conn(0x7ffabc0a6550 msgr2=0x7ffabc11c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:25.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.409+0000 7ffac3c5f700 1 -- 172.21.15.59:0/2170867457 shutdown_connections 2023-09-30T22:36:25.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.409+0000 7ffac3c5f700 1 -- 172.21.15.59:0/2170867457 wait complete. 2023-09-30T22:36:25.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:25.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.444+0000 7fa1d1bf6700 1 -- 172.21.15.59:0/2596553655 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa1cc074770 con 0x7fa1cc133930 2023-09-30T22:36:25.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.444+0000 7fa1c3fff700 1 -- 172.21.15.59:0/2596553655 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1bc017020 con 0x7fa1cc133930 2023-09-30T22:36:25.445 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:25.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.447+0000 7fa1d1bf6700 1 -- 172.21.15.59:0/2596553655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc133930 msgr2=0x7fa1cc1c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.447+0000 7fa1d1bf6700 1 --2- 172.21.15.59:0/2596553655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc133930 0x7fa1cc1c8d90 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00c500 tx=0x7fa1bc00c810 comp rx=0 tx=0).stop 2023-09-30T22:36:25.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.447+0000 7fa1d1bf6700 1 -- 172.21.15.59:0/2596553655 shutdown_connections 2023-09-30T22:36:25.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.447+0000 7fa1d1bf6700 1 --2- 172.21.15.59:0/2596553655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1cc09d630 0x7fa1cc1c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.447+0000 7fa1d1bf6700 1 --2- 172.21.15.59:0/2596553655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc133930 0x7fa1cc1c8d90 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.447+0000 7fa1d1bf6700 1 --2- 172.21.15.59:0/2596553655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0a0a30 0x7fa1cc1c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.447+0000 7fa1d1bf6700 1 -- 172.21.15.59:0/2596553655 >> 172.21.15.59:0/2596553655 conn(0x7fa1cc0a3050 msgr2=0x7fa1cc1bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:25.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.447+0000 7fa1d1bf6700 1 -- 172.21.15.59:0/2596553655 shutdown_connections 2023-09-30T22:36:25.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.447+0000 7fa1d1bf6700 1 -- 172.21.15.59:0/2596553655 wait complete. 2023-09-30T22:36:25.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:25.503 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:25.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:25.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.645+0000 7f3c75356700 1 Processor -- start 2023-09-30T22:36:25.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.645+0000 7f3c75356700 1 -- start start 2023-09-30T22:36:25.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.646+0000 7f3c75356700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c7009e1d0 0x7f3c70135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.646+0000 7f3c75356700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c70135e50 0x7f3c70138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.646+0000 7f3c75356700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7009f130 con 0x7f3c7009d6f0 2023-09-30T22:36:25.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.646+0000 7f3c75356700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7009f520 con 0x7f3c7009e1d0 2023-09-30T22:36:25.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.646+0000 7f3c75356700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7009e930 con 0x7f3c70135e50 2023-09-30T22:36:25.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.646+0000 7f3c6e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c7009e1d0 0x7f3c70135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.646+0000 7f3c6effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3c7009d6f0 0x7f3c7009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59050/0 (socket says 172.21.15.59:59050) 2023-09-30T22:36:25.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.646+0000 7f3c6effd700 1 -- 172.21.15.59:0/3776512603 learned_addr learned my addr 172.21.15.59:0/3776512603 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.646+0000 7f3c6f7fe700 1 --2- 172.21.15.59:0/3776512603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c70135e50 0x7f3c70138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.646+0000 7f3c6dffb700 1 -- 172.21.15.59:0/3776512603 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987497615 0 0) 0x7f3c7009f130 con 0x7f3c7009d6f0 2023-09-30T22:36:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.647+0000 7f3c6dffb700 1 -- 172.21.15.59:0/3776512603 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c580035b0 con 0x7f3c7009d6f0 2023-09-30T22:36:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.647+0000 7f3c6f7fe700 1 -- 172.21.15.59:0/3776512603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c7009e1d0 msgr2=0x7f3c70135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.647+0000 7f3c6f7fe700 1 --2- 172.21.15.59:0/3776512603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c7009e1d0 0x7f3c70135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.647+0000 7f3c6f7fe700 1 -- 172.21.15.59:0/3776512603 >> v1:172.21.15.59:6789/0 conn(0x7f3c7009d6f0 legacy=0x7f3c7009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.647+0000 7f3c6f7fe700 1 -- 172.21.15.59:0/3776512603 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7009b2d0 con 0x7f3c70135e50 2023-09-30T22:36:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.647+0000 7f3c6e7fc700 1 --2- 172.21.15.59:0/3776512603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c7009e1d0 0x7f3c70135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.647+0000 7f3c6f7fe700 1 --2- 172.21.15.59:0/3776512603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c70135e50 0x7f3c70138230 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009870 tx=0x7f3c68009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c5001d660120cab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.647+0000 7f3c6dffb700 1 -- 172.21.15.59:0/3776512603 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c68011830 con 0x7f3c70135e50 2023-09-30T22:36:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.647+0000 7f3c6dffb700 1 -- 172.21.15.59:0/3776512603 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c68011990 con 0x7f3c70135e50 2023-09-30T22:36:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.647+0000 7f3c6dffb700 1 -- 172.21.15.59:0/3776512603 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c68011d20 con 0x7f3c70135e50 2023-09-30T22:36:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.648+0000 7f3c75356700 1 -- 172.21.15.59:0/3776512603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c70135e50 msgr2=0x7f3c70138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.648+0000 7f3c75356700 1 --2- 172.21.15.59:0/3776512603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c70135e50 0x7f3c70138230 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009870 tx=0x7f3c68009b80 comp rx=0 tx=0).stop 2023-09-30T22:36:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.648+0000 7f3c75356700 1 -- 172.21.15.59:0/3776512603 shutdown_connections 2023-09-30T22:36:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.648+0000 7f3c75356700 1 --2- 172.21.15.59:0/3776512603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c70135e50 0x7f3c70138230 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.648+0000 7f3c75356700 1 --2- 172.21.15.59:0/3776512603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c7009e1d0 0x7f3c70135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.648+0000 7f3c75356700 1 -- 172.21.15.59:0/3776512603 >> 172.21.15.59:0/3776512603 conn(0x7f3c70066f50 msgr2=0x7f3c7009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.648+0000 7f3c75356700 1 -- 172.21.15.59:0/3776512603 shutdown_connections 2023-09-30T22:36:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.648+0000 7f3c75356700 1 -- 172.21.15.59:0/3776512603 wait complete. 2023-09-30T22:36:25.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.649+0000 7f3c75356700 1 Processor -- start 2023-09-30T22:36:25.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.649+0000 7f3c75356700 1 -- start start 2023-09-30T22:36:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.649+0000 7f3c75356700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c7009d6f0 0x7f3c7011d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.649+0000 7f3c75356700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c7009e1d0 0x7f3c7011d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.649+0000 7f3c75356700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c70135e50 0x7f3c7011de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.649+0000 7f3c75356700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7011e850 con 0x7f3c70135e50 2023-09-30T22:36:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.649+0000 7f3c75356700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c70120ea0 con 0x7f3c7009e1d0 2023-09-30T22:36:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.649+0000 7f3c75356700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7011ef90 con 0x7f3c7009d6f0 2023-09-30T22:36:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c6effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c7009d6f0 0x7f3c7011d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c6f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c70135e50 0x7f3c7011de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c6effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c7009d6f0 0x7f3c7011d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:34824/0 (socket says 172.21.15.59:34824) 2023-09-30T22:36:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c6effd700 1 -- 172.21.15.59:0/4024773815 learned_addr learned my addr 172.21.15.59:0/4024773815 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c6e7fc700 1 --2- 172.21.15.59:0/4024773815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c7009e1d0 0x7f3c7011d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c6e7fc700 1 -- 172.21.15.59:0/4024773815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c7009d6f0 msgr2=0x7f3c7011d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c6e7fc700 1 --2- 172.21.15.59:0/4024773815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c7009d6f0 0x7f3c7011d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c6e7fc700 1 -- 172.21.15.59:0/4024773815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c70135e50 msgr2=0x7f3c7011de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c6e7fc700 1 --2- 172.21.15.59:0/4024773815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c70135e50 0x7f3c7011de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c6e7fc700 1 -- 172.21.15.59:0/4024773815 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c640094a0 con 0x7f3c7009e1d0 2023-09-30T22:36:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c6f7fe700 1 --2- 172.21.15.59:0/4024773815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c70135e50 0x7f3c7011de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c6effd700 1 --2- 172.21.15.59:0/4024773815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c7009d6f0 0x7f3c7011d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c6e7fc700 1 --2- 172.21.15.59:0/4024773815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c7009e1d0 0x7f3c7011d8c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f3c64010cc0 tx=0x7f3c6400b140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c577fe700 1 -- 172.21.15.59:0/4024773815 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64015070 con 0x7f3c7009e1d0 2023-09-30T22:36:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c577fe700 1 -- 172.21.15.59:0/4024773815 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6400b9a0 con 0x7f3c7009e1d0 2023-09-30T22:36:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c75356700 1 -- 172.21.15.59:0/4024773815 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c680094a0 con 0x7f3c7009e1d0 2023-09-30T22:36:25.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.650+0000 7f3c577fe700 1 -- 172.21.15.59:0/4024773815 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400bd30 con 0x7f3c7009e1d0 2023-09-30T22:36:25.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.651+0000 7f3c75356700 1 -- 172.21.15.59:0/4024773815 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c70120900 con 0x7f3c7009e1d0 2023-09-30T22:36:25.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.651+0000 7f3c577fe700 1 -- 172.21.15.59:0/4024773815 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c64019410 con 0x7f3c7009e1d0 2023-09-30T22:36:25.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.651+0000 7f3c577fe700 1 -- 172.21.15.59:0/4024773815 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3c64043040 con 0x7f3c7009e1d0 2023-09-30T22:36:25.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.652+0000 7f3c75356700 1 -- 172.21.15.59:0/4024773815 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c70074ea0 con 0x7f3c7009e1d0 2023-09-30T22:36:25.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.661+0000 7f3c577fe700 1 -- 172.21.15.59:0/4024773815 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c6401e020 con 0x7f3c7009e1d0 2023-09-30T22:36:25.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.690+0000 7f2d7e5f5700 1 Processor -- start 2023-09-30T22:36:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.690+0000 7f2d7e5f5700 1 -- start start 2023-09-30T22:36:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d7e5f5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d780a0a30 0x7f2d780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d7e5f5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d78138d80 0x7f2d7813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d7e5f5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d780a2a70 con 0x7f2d7809d630 2023-09-30T22:36:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d7e5f5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d780a01d0 con 0x7f2d780a0a30 2023-09-30T22:36:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d7e5f5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7809e2b0 con 0x7f2d78138d80 2023-09-30T22:36:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d77fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d780a0a30 0x7f2d780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d7cb92700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d78138d80 0x7f2d7813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d77fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d780a0a30 0x7f2d780a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40798/0 (socket says 172.21.15.59:40798) 2023-09-30T22:36:25.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d77fff700 1 -- 172.21.15.59:0/4051793039 learned_addr learned my addr 172.21.15.59:0/4051793039 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:25.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d7cb92700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d78138d80 0x7f2d7813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:34838/0 (socket says 172.21.15.59:34838) 2023-09-30T22:36:25.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d7cb92700 1 -- 172.21.15.59:0/4051793039 >> v2:172.21.15.59:3300/0 conn(0x7f2d780a0a30 msgr2=0x7f2d780a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:25.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d7cb92700 1 --2- 172.21.15.59:0/4051793039 >> v2:172.21.15.59:3300/0 conn(0x7f2d780a0a30 0x7f2d780a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d7cb92700 1 -- 172.21.15.59:0/4051793039 >> v1:172.21.15.59:6789/0 conn(0x7f2d7809d630 legacy=0x7f2d780a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d7cb92700 1 -- 172.21.15.59:0/4051793039 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7809dc50 con 0x7f2d78138d80 2023-09-30T22:36:25.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d77fff700 1 --2- 172.21.15.59:0/4051793039 >> v2:172.21.15.59:3300/0 conn(0x7f2d780a0a30 0x7f2d780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:25.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.691+0000 7f2d7cb92700 1 --2- 172.21.15.59:0/4051793039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d78138d80 0x7f2d7813b160 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2d70009d90 tx=0x7f2d7000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6e8e83bae2cf038 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:25.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.692+0000 7f2d76ffd700 1 -- 172.21.15.59:0/4051793039 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7000e070 con 0x7f2d78138d80 2023-09-30T22:36:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.692+0000 7f2d76ffd700 1 -- 172.21.15.59:0/4051793039 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7000bb20 con 0x7f2d78138d80 2023-09-30T22:36:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.692+0000 7f2d76ffd700 1 -- 172.21.15.59:0/4051793039 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d70012430 con 0x7f2d78138d80 2023-09-30T22:36:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.692+0000 7f2d7e5f5700 1 -- 172.21.15.59:0/4051793039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d78138d80 msgr2=0x7f2d7813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.692+0000 7f2d7e5f5700 1 --2- 172.21.15.59:0/4051793039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d78138d80 0x7f2d7813b160 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2d70009d90 tx=0x7f2d7000b330 comp rx=0 tx=0).stop 2023-09-30T22:36:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.692+0000 7f2d7e5f5700 1 -- 172.21.15.59:0/4051793039 shutdown_connections 2023-09-30T22:36:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.692+0000 7f2d7e5f5700 1 --2- 172.21.15.59:0/4051793039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d78138d80 0x7f2d7813b160 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.692+0000 7f2d7e5f5700 1 --2- 172.21.15.59:0/4051793039 >> v2:172.21.15.59:3300/0 conn(0x7f2d780a0a30 0x7f2d780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.692+0000 7f2d7e5f5700 1 -- 172.21.15.59:0/4051793039 >> 172.21.15.59:0/4051793039 conn(0x7f2d780a3050 msgr2=0x7f2d780a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:25.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.692+0000 7f2d7e5f5700 1 -- 172.21.15.59:0/4051793039 shutdown_connections 2023-09-30T22:36:25.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.692+0000 7f2d7e5f5700 1 -- 172.21.15.59:0/4051793039 wait complete. 2023-09-30T22:36:25.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.693+0000 7f2d7e5f5700 1 Processor -- start 2023-09-30T22:36:25.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.694+0000 7f2d7e5f5700 1 -- start start 2023-09-30T22:36:25.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.694+0000 7f2d7e5f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7809d630 0x7f2d78133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.694+0000 7f2d7e5f5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d780a0a30 0x7f2d78133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.694+0000 7f2d7e5f5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d78138d80 0x7f2d781344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:25.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.694+0000 7f2d7e5f5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d78136b90 con 0x7f2d78138d80 2023-09-30T22:36:25.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.694+0000 7f2d7e5f5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d78138090 con 0x7f2d7809d630 2023-09-30T22:36:25.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.694+0000 7f2d7e5f5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d781374b0 con 0x7f2d780a0a30 2023-09-30T22:36:25.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.694+0000 7f2d7cb92700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d78138d80 0x7f2d781344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.694+0000 7f2d7cb92700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d78138d80 0x7f2d781344b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40802/0 (socket says 172.21.15.59:40802) 2023-09-30T22:36:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.694+0000 7f2d7cb92700 1 -- 172.21.15.59:0/3508825008 learned_addr learned my addr 172.21.15.59:0/3508825008 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.694+0000 7f2d777fe700 1 --2- 172.21.15.59:0/3508825008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d780a0a30 0x7f2d78133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.694+0000 7f2d77fff700 1 --2- 172.21.15.59:0/3508825008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7809d630 0x7f2d78133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.695+0000 7f2d7cb92700 1 -- 172.21.15.59:0/3508825008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d780a0a30 msgr2=0x7f2d78133f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.695+0000 7f2d7cb92700 1 --2- 172.21.15.59:0/3508825008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d780a0a30 0x7f2d78133f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.695+0000 7f2d7cb92700 1 -- 172.21.15.59:0/3508825008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7809d630 msgr2=0x7f2d78133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.695+0000 7f2d7cb92700 1 --2- 172.21.15.59:0/3508825008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7809d630 0x7f2d78133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.695+0000 7f2d7cb92700 1 -- 172.21.15.59:0/3508825008 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d68009550 con 0x7f2d78138d80 2023-09-30T22:36:25.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.695+0000 7f2d777fe700 1 --2- 172.21.15.59:0/3508825008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d780a0a30 0x7f2d78133f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:25.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.695+0000 7f2d77fff700 1 --2- 172.21.15.59:0/3508825008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7809d630 0x7f2d78133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:25.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.695+0000 7f2d7cb92700 1 --2- 172.21.15.59:0/3508825008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d78138d80 0x7f2d781344b0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f2d70013000 tx=0x7f2d70004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:25.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.695+0000 7f2d74ff9700 1 -- 172.21.15.59:0/3508825008 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d70012430 con 0x7f2d78138d80 2023-09-30T22:36:25.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.695+0000 7f2d74ff9700 1 -- 172.21.15.59:0/3508825008 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d70020070 con 0x7f2d78138d80 2023-09-30T22:36:25.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.695+0000 7f2d7e5f5700 1 -- 172.21.15.59:0/3508825008 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d70009a70 con 0x7f2d78138d80 2023-09-30T22:36:25.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.695+0000 7f2d74ff9700 1 -- 172.21.15.59:0/3508825008 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d70003ea0 con 0x7f2d78138d80 2023-09-30T22:36:25.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.695+0000 7f2d7e5f5700 1 -- 172.21.15.59:0/3508825008 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d781371d0 con 0x7f2d78138d80 2023-09-30T22:36:25.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.696+0000 7f2d74ff9700 1 -- 172.21.15.59:0/3508825008 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d70004280 con 0x7f2d78138d80 2023-09-30T22:36:25.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.696+0000 7f2d74ff9700 1 -- 172.21.15.59:0/3508825008 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d70022070 con 0x7f2d78138d80 2023-09-30T22:36:25.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.696+0000 7f2d7e5f5700 1 -- 172.21.15.59:0/3508825008 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d78136e70 con 0x7f2d78138d80 2023-09-30T22:36:25.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.701+0000 7f2d74ff9700 1 -- 172.21.15.59:0/3508825008 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d78136e70 con 0x7f2d78138d80 2023-09-30T22:36:25.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.872+0000 7f3c75356700 1 -- 172.21.15.59:0/4024773815 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3c7011f760 con 0x7f3c7009e1d0 2023-09-30T22:36:25.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.872+0000 7f3c577fe700 1 -- 172.21.15.59:0/4024773815 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c64017310 con 0x7f3c7009e1d0 2023-09-30T22:36:25.873 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:25.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.875+0000 7f3c75356700 1 -- 172.21.15.59:0/4024773815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c7009e1d0 msgr2=0x7f3c7011d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.875+0000 7f3c75356700 1 --2- 172.21.15.59:0/4024773815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c7009e1d0 0x7f3c7011d8c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f3c64010cc0 tx=0x7f3c6400b140 comp rx=0 tx=0).stop 2023-09-30T22:36:25.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.875+0000 7f3c75356700 1 -- 172.21.15.59:0/4024773815 shutdown_connections 2023-09-30T22:36:25.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.875+0000 7f3c75356700 1 --2- 172.21.15.59:0/4024773815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c7009d6f0 0x7f3c7011d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.875+0000 7f3c75356700 1 --2- 172.21.15.59:0/4024773815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c70135e50 0x7f3c7011de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.875+0000 7f3c75356700 1 --2- 172.21.15.59:0/4024773815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c7009e1d0 0x7f3c7011d8c0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.875+0000 7f3c75356700 1 -- 172.21.15.59:0/4024773815 >> 172.21.15.59:0/4024773815 conn(0x7f3c70066f50 msgr2=0x7f3c70071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.875+0000 7f3c75356700 1 -- 172.21.15.59:0/4024773815 shutdown_connections 2023-09-30T22:36:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.875+0000 7f3c75356700 1 -- 172.21.15.59:0/4024773815 wait complete. 2023-09-30T22:36:25.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.917+0000 7f2d7e5f5700 1 -- 172.21.15.59:0/3508825008 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2d78136e70 con 0x7f2d78138d80 2023-09-30T22:36:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.917+0000 7f2d74ff9700 1 -- 172.21.15.59:0/3508825008 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d78136e70 con 0x7f2d78138d80 2023-09-30T22:36:25.918 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.920+0000 7f2d7e5f5700 1 -- 172.21.15.59:0/3508825008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d78138d80 msgr2=0x7f2d781344b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.920+0000 7f2d7e5f5700 1 --2- 172.21.15.59:0/3508825008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d78138d80 0x7f2d781344b0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f2d70013000 tx=0x7f2d70004ad0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.920+0000 7f2d7e5f5700 1 -- 172.21.15.59:0/3508825008 shutdown_connections 2023-09-30T22:36:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.920+0000 7f2d7e5f5700 1 --2- 172.21.15.59:0/3508825008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d78138d80 0x7f2d781344b0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.920+0000 7f2d7e5f5700 1 --2- 172.21.15.59:0/3508825008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d7809d630 0x7f2d78133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.920+0000 7f2d7e5f5700 1 --2- 172.21.15.59:0/3508825008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d780a0a30 0x7f2d78133f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.920+0000 7f2d7e5f5700 1 -- 172.21.15.59:0/3508825008 >> 172.21.15.59:0/3508825008 conn(0x7f2d780a3050 msgr2=0x7f2d7809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.920+0000 7f2d7e5f5700 1 -- 172.21.15.59:0/3508825008 shutdown_connections 2023-09-30T22:36:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:25.920+0000 7f2d7e5f5700 1 -- 172.21.15.59:0/3508825008 wait complete. 2023-09-30T22:36:25.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:26.425 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:26.462 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:26.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.573+0000 7f69dfb29700 1 Processor -- start 2023-09-30T22:36:26.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.573+0000 7f69dfb29700 1 -- start start 2023-09-30T22:36:26.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69dfb29700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69d8136820 0x7f69d8138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:26.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69dfb29700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69d8139140 0x7f69d813b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:26.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69dfb29700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d806bc00 con 0x7f69d8133a80 2023-09-30T22:36:26.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69dfb29700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d806c570 con 0x7f69d8136820 2023-09-30T22:36:26.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69dfb29700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69d80a0040 con 0x7f69d8139140 2023-09-30T22:36:26.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69dd0c4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69d8136820 0x7f69d8138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:26.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69de0c6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69d8139140 0x7f69d813b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:26.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69de0c6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69d8139140 0x7f69d813b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:34856/0 (socket says 172.21.15.59:34856) 2023-09-30T22:36:26.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69dd0c4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69d8136820 0x7f69d8138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40814/0 (socket says 172.21.15.59:40814) 2023-09-30T22:36:26.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69de0c6700 1 -- 172.21.15.59:0/3815567772 learned_addr learned my addr 172.21.15.59:0/3815567772 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:26.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69de0c6700 1 -- 172.21.15.59:0/3815567772 >> v2:172.21.15.59:3300/0 conn(0x7f69d8136820 msgr2=0x7f69d8138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:26.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69de0c6700 1 --2- 172.21.15.59:0/3815567772 >> v2:172.21.15.59:3300/0 conn(0x7f69d8136820 0x7f69d8138c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69de0c6700 1 -- 172.21.15.59:0/3815567772 >> v1:172.21.15.59:6789/0 conn(0x7f69d8133a80 legacy=0x7f69d8133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:26.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69de0c6700 1 -- 172.21.15.59:0/3815567772 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d8133860 con 0x7f69d8139140 2023-09-30T22:36:26.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69dd0c4700 1 --2- 172.21.15.59:0/3815567772 >> v2:172.21.15.59:3300/0 conn(0x7f69d8136820 0x7f69d8138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:26.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69de0c6700 1 --2- 172.21.15.59:0/3815567772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69d8139140 0x7f69d813b520 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f69d0009e50 tx=0x7f69d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4e5b949383c2a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:26.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.574+0000 7f69dc8c3700 1 -- 172.21.15.59:0/3815567772 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d000e070 con 0x7f69d8139140 2023-09-30T22:36:26.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.575+0000 7f69dc8c3700 1 -- 172.21.15.59:0/3815567772 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d000b910 con 0x7f69d8139140 2023-09-30T22:36:26.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.575+0000 7f69dc8c3700 1 -- 172.21.15.59:0/3815567772 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d000bcc0 con 0x7f69d8139140 2023-09-30T22:36:26.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.575+0000 7f69dfb29700 1 -- 172.21.15.59:0/3815567772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69d8139140 msgr2=0x7f69d813b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:26.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.575+0000 7f69dfb29700 1 --2- 172.21.15.59:0/3815567772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69d8139140 0x7f69d813b520 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f69d0009e50 tx=0x7f69d000b330 comp rx=0 tx=0).stop 2023-09-30T22:36:26.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.575+0000 7f69dfb29700 1 -- 172.21.15.59:0/3815567772 shutdown_connections 2023-09-30T22:36:26.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.575+0000 7f69dfb29700 1 --2- 172.21.15.59:0/3815567772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69d8139140 0x7f69d813b520 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.575+0000 7f69dfb29700 1 --2- 172.21.15.59:0/3815567772 >> v2:172.21.15.59:3300/0 conn(0x7f69d8136820 0x7f69d8138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.575+0000 7f69dfb29700 1 -- 172.21.15.59:0/3815567772 >> 172.21.15.59:0/3815567772 conn(0x7f69d80a4210 msgr2=0x7f69d80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:26.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.575+0000 7f69dfb29700 1 -- 172.21.15.59:0/3815567772 shutdown_connections 2023-09-30T22:36:26.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.575+0000 7f69dfb29700 1 -- 172.21.15.59:0/3815567772 wait complete. 2023-09-30T22:36:26.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.576+0000 7f69dfb29700 1 Processor -- start 2023-09-30T22:36:26.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.576+0000 7f69dfb29700 1 -- start start 2023-09-30T22:36:26.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69dfb29700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69d8133a80 0x7f69d809b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:26.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69dfb29700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69d8136820 0x7f69d809b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:26.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69dfb29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69d8139140 0x7f69d809beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:26.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69dfb29700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d812e150 con 0x7f69d8136820 2023-09-30T22:36:26.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69dfb29700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d8136610 con 0x7f69d8139140 2023-09-30T22:36:26.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69dfb29700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69d809dcd0 con 0x7f69d8133a80 2023-09-30T22:36:26.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69dd8c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69d8133a80 0x7f69d809b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:26.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69de0c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69d8139140 0x7f69d809beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:26.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69dd8c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69d8133a80 0x7f69d809b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:34870/0 (socket says 172.21.15.59:34870) 2023-09-30T22:36:26.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69dd8c5700 1 -- 172.21.15.59:0/1447838851 learned_addr learned my addr 172.21.15.59:0/1447838851 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:26.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69dd0c4700 1 --2- 172.21.15.59:0/1447838851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69d8136820 0x7f69d809b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:26.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69dd8c5700 1 -- 172.21.15.59:0/1447838851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69d8139140 msgr2=0x7f69d809beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:26.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69dd8c5700 1 --2- 172.21.15.59:0/1447838851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69d8139140 0x7f69d809beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69dd8c5700 1 -- 172.21.15.59:0/1447838851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69d8136820 msgr2=0x7f69d809b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:26.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69dd8c5700 1 --2- 172.21.15.59:0/1447838851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69d8136820 0x7f69d809b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69dd8c5700 1 -- 172.21.15.59:0/1447838851 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c80094a0 con 0x7f69d8133a80 2023-09-30T22:36:26.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.577+0000 7f69de0c6700 1 --2- 172.21.15.59:0/1447838851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69d8139140 0x7f69d809beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:26.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.578+0000 7f69dd8c5700 1 --2- 172.21.15.59:0/1447838851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69d8133a80 0x7f69d809b430 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f69d400c4e0 tx=0x7f69d400c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:26.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.578+0000 7f69ce7fc700 1 -- 172.21.15.59:0/1447838851 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d40052d0 con 0x7f69d8133a80 2023-09-30T22:36:26.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.578+0000 7f69ce7fc700 1 -- 172.21.15.59:0/1447838851 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d4005430 con 0x7f69d8133a80 2023-09-30T22:36:26.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.578+0000 7f69ce7fc700 1 -- 172.21.15.59:0/1447838851 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d40038c0 con 0x7f69d8133a80 2023-09-30T22:36:26.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.578+0000 7f69dfb29700 1 -- 172.21.15.59:0/1447838851 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d0009b30 con 0x7f69d8133a80 2023-09-30T22:36:26.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.578+0000 7f69dfb29700 1 -- 172.21.15.59:0/1447838851 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d812e380 con 0x7f69d8133a80 2023-09-30T22:36:26.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.579+0000 7f69ce7fc700 1 -- 172.21.15.59:0/1447838851 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f69d4003a20 con 0x7f69d8133a80 2023-09-30T22:36:26.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.579+0000 7f69ce7fc700 1 -- 172.21.15.59:0/1447838851 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f69d403ea90 con 0x7f69d8133a80 2023-09-30T22:36:26.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.579+0000 7f69dfb29700 1 -- 172.21.15.59:0/1447838851 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d8074ea0 con 0x7f69d8133a80 2023-09-30T22:36:26.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.588+0000 7f69ce7fc700 1 -- 172.21.15.59:0/1447838851 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f69d4017020 con 0x7f69d8133a80 2023-09-30T22:36:26.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.613+0000 7f3a30cb2700 1 Processor -- start 2023-09-30T22:36:26.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.613+0000 7f3a30cb2700 1 -- start start 2023-09-30T22:36:26.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.614+0000 7f3a30cb2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a2c09d630 0x7f3a2c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:26.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.614+0000 7f3a30cb2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a2c138d80 0x7f3a2c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:26.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.614+0000 7f3a30cb2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2c0a2a70 con 0x7f3a2c0a0a30 2023-09-30T22:36:26.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.614+0000 7f3a30cb2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0a01d0 con 0x7f3a2c138d80 2023-09-30T22:36:26.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.614+0000 7f3a30cb2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c09e2b0 con 0x7f3a2c09d630 2023-09-30T22:36:26.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.614+0000 7f3a2ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a2c138d80 0x7f3a2c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:26.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.614+0000 7f3a2a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3a2c0a0a30 0x7f3a2c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59082/0 (socket says 172.21.15.59:59082) 2023-09-30T22:36:26.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.614+0000 7f3a2a59c700 1 -- 172.21.15.59:0/3226103649 learned_addr learned my addr 172.21.15.59:0/3226103649 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:26.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.614+0000 7f3a29d9b700 1 --2- 172.21.15.59:0/3226103649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a2c09d630 0x7f3a2c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:26.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.614+0000 7f3a2959a700 1 -- 172.21.15.59:0/3226103649 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411273459 0 0) 0x7f3a2c0a2a70 con 0x7f3a2c0a0a30 2023-09-30T22:36:26.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.614+0000 7f3a29d9b700 1 -- 172.21.15.59:0/3226103649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a2c138d80 msgr2=0x7f3a2c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:26.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.614+0000 7f3a29d9b700 1 --2- 172.21.15.59:0/3226103649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a2c138d80 0x7f3a2c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.614+0000 7f3a29d9b700 1 -- 172.21.15.59:0/3226103649 >> v1:172.21.15.59:6789/0 conn(0x7f3a2c0a0a30 legacy=0x7f3a2c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:26.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.614+0000 7f3a29d9b700 1 -- 172.21.15.59:0/3226103649 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c09dc50 con 0x7f3a2c09d630 2023-09-30T22:36:26.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.614+0000 7f3a29d9b700 1 --2- 172.21.15.59:0/3226103649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a2c09d630 0x7f3a2c0a1510 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009870 tx=0x7f3a14009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=145c18978334f8d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:26.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.615+0000 7f3a2959a700 1 -- 172.21.15.59:0/3226103649 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14011830 con 0x7f3a2c09d630 2023-09-30T22:36:26.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.615+0000 7f3a2959a700 1 -- 172.21.15.59:0/3226103649 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a14011990 con 0x7f3a2c09d630 2023-09-30T22:36:26.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.615+0000 7f3a2959a700 1 -- 172.21.15.59:0/3226103649 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14011d20 con 0x7f3a2c09d630 2023-09-30T22:36:26.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.615+0000 7f3a30cb2700 1 -- 172.21.15.59:0/3226103649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a2c09d630 msgr2=0x7f3a2c0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:26.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.615+0000 7f3a30cb2700 1 --2- 172.21.15.59:0/3226103649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a2c09d630 0x7f3a2c0a1510 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009870 tx=0x7f3a14009b80 comp rx=0 tx=0).stop 2023-09-30T22:36:26.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.615+0000 7f3a30cb2700 1 -- 172.21.15.59:0/3226103649 shutdown_connections 2023-09-30T22:36:26.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.615+0000 7f3a30cb2700 1 --2- 172.21.15.59:0/3226103649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a2c138d80 0x7f3a2c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.615+0000 7f3a30cb2700 1 --2- 172.21.15.59:0/3226103649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a2c09d630 0x7f3a2c0a1510 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.615+0000 7f3a30cb2700 1 -- 172.21.15.59:0/3226103649 >> 172.21.15.59:0/3226103649 conn(0x7f3a2c0a3050 msgr2=0x7f3a2c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:26.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.615+0000 7f3a30cb2700 1 -- 172.21.15.59:0/3226103649 shutdown_connections 2023-09-30T22:36:26.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.615+0000 7f3a30cb2700 1 -- 172.21.15.59:0/3226103649 wait complete. 2023-09-30T22:36:26.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.617+0000 7f3a30cb2700 1 Processor -- start 2023-09-30T22:36:26.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.617+0000 7f3a30cb2700 1 -- start start 2023-09-30T22:36:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.617+0000 7f3a30cb2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a2c09d630 0x7f3a2c133930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.617+0000 7f3a30cb2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a2c0a0a30 0x7f3a2c133e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.617+0000 7f3a30cb2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a2c138d80 0x7f3a2c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.617+0000 7f3a30cb2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c136d80 con 0x7f3a2c09d630 2023-09-30T22:36:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.617+0000 7f3a30cb2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c137040 con 0x7f3a2c0a0a30 2023-09-30T22:36:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.617+0000 7f3a30cb2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c13ad00 con 0x7f3a2c138d80 2023-09-30T22:36:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.617+0000 7f3a29d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a2c0a0a30 0x7f3a2c133e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.617+0000 7f3a29d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a2c0a0a30 0x7f3a2c133e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40928/0 (socket says 172.21.15.59:40928) 2023-09-30T22:36:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.617+0000 7f3a29d9b700 1 -- 172.21.15.59:0/1296189890 learned_addr learned my addr 172.21.15.59:0/1296189890 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:26.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.617+0000 7f3a2a59c700 1 --2- 172.21.15.59:0/1296189890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a2c09d630 0x7f3a2c133930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:26.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.617+0000 7f3a2ad9d700 1 --2- 172.21.15.59:0/1296189890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a2c138d80 0x7f3a2c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:26.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.618+0000 7f3a29d9b700 1 -- 172.21.15.59:0/1296189890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a2c138d80 msgr2=0x7f3a2c1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:26.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.618+0000 7f3a29d9b700 1 --2- 172.21.15.59:0/1296189890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a2c138d80 0x7f3a2c1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.618+0000 7f3a29d9b700 1 -- 172.21.15.59:0/1296189890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a2c09d630 msgr2=0x7f3a2c133930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.618+0000 7f3a29d9b700 1 --2- 172.21.15.59:0/1296189890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a2c09d630 0x7f3a2c133930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.618+0000 7f3a29d9b700 1 -- 172.21.15.59:0/1296189890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140094a0 con 0x7f3a2c0a0a30 2023-09-30T22:36:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.618+0000 7f3a2a59c700 1 --2- 172.21.15.59:0/1296189890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a2c09d630 0x7f3a2c133930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.618+0000 7f3a29d9b700 1 --2- 172.21.15.59:0/1296189890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a2c0a0a30 0x7f3a2c133e70 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f3a140090b0 tx=0x7f3a14004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.618+0000 7f3a22ffd700 1 -- 172.21.15.59:0/1296189890 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14004510 con 0x7f3a2c0a0a30 2023-09-30T22:36:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.618+0000 7f3a22ffd700 1 -- 172.21.15.59:0/1296189890 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1401f070 con 0x7f3a2c0a0a30 2023-09-30T22:36:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.618+0000 7f3a22ffd700 1 -- 172.21.15.59:0/1296189890 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a140038e0 con 0x7f3a2c0a0a30 2023-09-30T22:36:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.618+0000 7f3a30cb2700 1 -- 172.21.15.59:0/1296189890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c0a0410 con 0x7f3a2c0a0a30 2023-09-30T22:36:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.618+0000 7f3a30cb2700 1 -- 172.21.15.59:0/1296189890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c135b90 con 0x7f3a2c0a0a30 2023-09-30T22:36:26.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.619+0000 7f3a22ffd700 1 -- 172.21.15.59:0/1296189890 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a14003a40 con 0x7f3a2c0a0a30 2023-09-30T22:36:26.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.619+0000 7f3a22ffd700 1 -- 172.21.15.59:0/1296189890 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3a14021070 con 0x7f3a2c0a0a30 2023-09-30T22:36:26.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.619+0000 7f3a30cb2700 1 -- 172.21.15.59:0/1296189890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c13b620 con 0x7f3a2c0a0a30 2023-09-30T22:36:26.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.624+0000 7f3a22ffd700 1 -- 172.21.15.59:0/1296189890 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a14015080 con 0x7f3a2c0a0a30 2023-09-30T22:36:26.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.796+0000 7f69dfb29700 1 -- 172.21.15.59:0/1447838851 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f69d806b250 con 0x7f69d8133a80 2023-09-30T22:36:26.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.796+0000 7f69ce7fc700 1 -- 172.21.15.59:0/1447838851 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f69d4018260 con 0x7f69d8133a80 2023-09-30T22:36:26.797 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:26.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.799+0000 7f69dfb29700 1 -- 172.21.15.59:0/1447838851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69d8133a80 msgr2=0x7f69d809b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:26.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.799+0000 7f69dfb29700 1 --2- 172.21.15.59:0/1447838851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69d8133a80 0x7f69d809b430 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f69d400c4e0 tx=0x7f69d400c7f0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.799+0000 7f69dfb29700 1 -- 172.21.15.59:0/1447838851 shutdown_connections 2023-09-30T22:36:26.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.799+0000 7f69dfb29700 1 --2- 172.21.15.59:0/1447838851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f69d8133a80 0x7f69d809b430 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.799+0000 7f69dfb29700 1 --2- 172.21.15.59:0/1447838851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69d8139140 0x7f69d809beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.799+0000 7f69dfb29700 1 --2- 172.21.15.59:0/1447838851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69d8136820 0x7f69d809b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.799+0000 7f69dfb29700 1 -- 172.21.15.59:0/1447838851 >> 172.21.15.59:0/1447838851 conn(0x7f69d80a4210 msgr2=0x7f69d8134600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:26.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.799+0000 7f69dfb29700 1 -- 172.21.15.59:0/1447838851 shutdown_connections 2023-09-30T22:36:26.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.799+0000 7f69dfb29700 1 -- 172.21.15.59:0/1447838851 wait complete. 2023-09-30T22:36:26.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:26.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.830+0000 7f3a30cb2700 1 -- 172.21.15.59:0/1296189890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3a2c0747f0 con 0x7f3a2c0a0a30 2023-09-30T22:36:26.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.830+0000 7f3a22ffd700 1 -- 172.21.15.59:0/1296189890 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a1402b030 con 0x7f3a2c0a0a30 2023-09-30T22:36:26.831 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:26.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.833+0000 7f3a30cb2700 1 -- 172.21.15.59:0/1296189890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a2c0a0a30 msgr2=0x7f3a2c133e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:26.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.833+0000 7f3a30cb2700 1 --2- 172.21.15.59:0/1296189890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a2c0a0a30 0x7f3a2c133e70 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f3a140090b0 tx=0x7f3a14004750 comp rx=0 tx=0).stop 2023-09-30T22:36:26.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.833+0000 7f3a30cb2700 1 -- 172.21.15.59:0/1296189890 shutdown_connections 2023-09-30T22:36:26.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.833+0000 7f3a30cb2700 1 --2- 172.21.15.59:0/1296189890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a2c138d80 0x7f3a2c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.833+0000 7f3a30cb2700 1 --2- 172.21.15.59:0/1296189890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a2c09d630 0x7f3a2c133930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.833+0000 7f3a30cb2700 1 --2- 172.21.15.59:0/1296189890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a2c0a0a30 0x7f3a2c133e70 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:26.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.833+0000 7f3a30cb2700 1 -- 172.21.15.59:0/1296189890 >> 172.21.15.59:0/1296189890 conn(0x7f3a2c0a3050 msgr2=0x7f3a2c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:26.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.833+0000 7f3a30cb2700 1 -- 172.21.15.59:0/1296189890 shutdown_connections 2023-09-30T22:36:26.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:26.833+0000 7f3a30cb2700 1 -- 172.21.15.59:0/1296189890 wait complete. 2023-09-30T22:36:26.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:26.893 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:26.935 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:27.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.035+0000 7f43f45c1700 1 Processor -- start 2023-09-30T22:36:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.035+0000 7f43f45c1700 1 -- start start 2023-09-30T22:36:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f45c1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43ec0a0a30 0x7f43ec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f45c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43ec0a1340 0x7f43ec133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f45c1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43ec133fa0 0x7f43ec134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f45c1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ec09edd0 con 0x7f43ec0a0a30 2023-09-30T22:36:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f45c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec09e1f0 con 0x7f43ec0a1340 2023-09-30T22:36:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f45c1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec09dc50 con 0x7f43ec133fa0 2023-09-30T22:36:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f235d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43ec0a0a30 0x7f43ec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f1b5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43ec0a1340 0x7f43ec133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f2b5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43ec133fa0 0x7f43ec134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f235d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43ec0a0a30 0x7f43ec0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40836/0 (socket says 172.21.15.59:40836) 2023-09-30T22:36:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f235d700 1 -- 172.21.15.59:0/2259609241 learned_addr learned my addr 172.21.15.59:0/2259609241 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f235d700 1 -- 172.21.15.59:0/2259609241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43ec133fa0 msgr2=0x7f43ec134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f235d700 1 --2- 172.21.15.59:0/2259609241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43ec133fa0 0x7f43ec134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f235d700 1 -- 172.21.15.59:0/2259609241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43ec0a1340 msgr2=0x7f43ec133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f235d700 1 --2- 172.21.15.59:0/2259609241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43ec0a1340 0x7f43ec133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f235d700 1 -- 172.21.15.59:0/2259609241 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec0a1fe0 con 0x7f43ec0a0a30 2023-09-30T22:36:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.036+0000 7f43f235d700 1 --2- 172.21.15.59:0/2259609241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ec0a0a30 0x7f43ec0a0e00 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f43e80098f0 tx=0x7f43e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55247eb34963d852 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.037+0000 7f43f135b700 1 -- 172.21.15.59:0/2259609241 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8011830 con 0x7f43ec0a0a30 2023-09-30T22:36:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.037+0000 7f43f135b700 1 -- 172.21.15.59:0/2259609241 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e8011990 con 0x7f43ec0a0a30 2023-09-30T22:36:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.037+0000 7f43f135b700 1 -- 172.21.15.59:0/2259609241 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8011d20 con 0x7f43ec0a0a30 2023-09-30T22:36:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.037+0000 7f43f45c1700 1 -- 172.21.15.59:0/2259609241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ec0a0a30 msgr2=0x7f43ec0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.037+0000 7f43f45c1700 1 --2- 172.21.15.59:0/2259609241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ec0a0a30 0x7f43ec0a0e00 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f43e80098f0 tx=0x7f43e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.037+0000 7f43f45c1700 1 -- 172.21.15.59:0/2259609241 shutdown_connections 2023-09-30T22:36:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.037+0000 7f43f45c1700 1 --2- 172.21.15.59:0/2259609241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43ec133fa0 0x7f43ec134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.038+0000 7f43f45c1700 1 --2- 172.21.15.59:0/2259609241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ec0a0a30 0x7f43ec0a0e00 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.038+0000 7f43f45c1700 1 --2- 172.21.15.59:0/2259609241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43ec0a1340 0x7f43ec133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.038+0000 7f43f45c1700 1 -- 172.21.15.59:0/2259609241 >> 172.21.15.59:0/2259609241 conn(0x7f43ec0a6550 msgr2=0x7f43ec0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.038+0000 7f43f45c1700 1 -- 172.21.15.59:0/2259609241 shutdown_connections 2023-09-30T22:36:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.038+0000 7f43f45c1700 1 -- 172.21.15.59:0/2259609241 wait complete. 2023-09-30T22:36:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.039+0000 7f43f45c1700 1 Processor -- start 2023-09-30T22:36:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.039+0000 7f43f45c1700 1 -- start start 2023-09-30T22:36:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.039+0000 7f43f45c1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ec0a0a30 0x7f43ec11e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.039+0000 7f43f45c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43ec0a1340 0x7f43ec11e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.039+0000 7f43f45c1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43ec133fa0 0x7f43ec11ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.039+0000 7f43f45c1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec11f6c0 con 0x7f43ec0a0a30 2023-09-30T22:36:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.039+0000 7f43f45c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec121cc0 con 0x7f43ec0a1340 2023-09-30T22:36:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.039+0000 7f43f45c1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec121090 con 0x7f43ec133fa0 2023-09-30T22:36:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.039+0000 7f43f235d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ec0a0a30 0x7f43ec11e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.039+0000 7f43f1b5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43ec0a1340 0x7f43ec11e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.039+0000 7f43f2b5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43ec133fa0 0x7f43ec11ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.039+0000 7f43f2b5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43ec133fa0 0x7f43ec11ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:34910/0 (socket says 172.21.15.59:34910) 2023-09-30T22:36:27.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.039+0000 7f43f235d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ec0a0a30 0x7f43ec11e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40844/0 (socket says 172.21.15.59:40844) 2023-09-30T22:36:27.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.039+0000 7f43f2b5e700 1 -- 172.21.15.59:0/149183207 learned_addr learned my addr 172.21.15.59:0/149183207 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:27.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.039+0000 7f43f1b5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43ec0a1340 0x7f43ec11e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40956/0 (socket says 172.21.15.59:40956) 2023-09-30T22:36:27.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.040+0000 7f43f1b5c700 1 -- 172.21.15.59:0/149183207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43ec133fa0 msgr2=0x7f43ec11ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.040+0000 7f43f1b5c700 1 --2- 172.21.15.59:0/149183207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43ec133fa0 0x7f43ec11ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.040+0000 7f43f1b5c700 1 -- 172.21.15.59:0/149183207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ec0a0a30 msgr2=0x7f43ec11e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.040+0000 7f43f1b5c700 1 --2- 172.21.15.59:0/149183207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ec0a0a30 0x7f43ec11e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.040+0000 7f43f1b5c700 1 -- 172.21.15.59:0/149183207 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e8009550 con 0x7f43ec0a1340 2023-09-30T22:36:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.040+0000 7f43f2b5e700 1 --2- 172.21.15.59:0/149183207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43ec133fa0 0x7f43ec11ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.040+0000 7f43f235d700 1 --2- 172.21.15.59:0/149183207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ec0a0a30 0x7f43ec11e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.040+0000 7f43f1b5c700 1 --2- 172.21.15.59:0/149183207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43ec0a1340 0x7f43ec11e730 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00e900 tx=0x7f43dc00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.040+0000 7f43e2ffd700 1 -- 172.21.15.59:0/149183207 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc013680 con 0x7f43ec0a1340 2023-09-30T22:36:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.040+0000 7f43e2ffd700 1 -- 172.21.15.59:0/149183207 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc0137e0 con 0x7f43ec0a1340 2023-09-30T22:36:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.040+0000 7f43f45c1700 1 -- 172.21.15.59:0/149183207 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec0a3630 con 0x7f43ec0a1340 2023-09-30T22:36:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.040+0000 7f43e2ffd700 1 -- 172.21.15.59:0/149183207 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc013b50 con 0x7f43ec0a1340 2023-09-30T22:36:27.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.040+0000 7f43f45c1700 1 -- 172.21.15.59:0/149183207 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec0a0220 con 0x7f43ec0a1340 2023-09-30T22:36:27.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.041+0000 7f43e2ffd700 1 -- 172.21.15.59:0/149183207 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43dc013cb0 con 0x7f43ec0a1340 2023-09-30T22:36:27.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.041+0000 7f43f45c1700 1 -- 172.21.15.59:0/149183207 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ec121860 con 0x7f43ec0a1340 2023-09-30T22:36:27.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.041+0000 7f43e2ffd700 1 -- 172.21.15.59:0/149183207 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f43dc03f690 con 0x7f43ec0a1340 2023-09-30T22:36:27.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.046+0000 7f43e2ffd700 1 -- 172.21.15.59:0/149183207 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43dc01be10 con 0x7f43ec0a1340 2023-09-30T22:36:27.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.077+0000 7f4d73d6e700 1 Processor -- start 2023-09-30T22:36:27.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.077+0000 7f4d73d6e700 1 -- start start 2023-09-30T22:36:27.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d73d6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d6c09d6f0 0x7f4d6c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d73d6e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4d6c09e000 0x7f4d6c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d73d6e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d6c133f30 0x7f4d6c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d73d6e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6c09b0f0 con 0x7f4d6c09e000 2023-09-30T22:36:27.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d73d6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c09d2f0 con 0x7f4d6c09d6f0 2023-09-30T22:36:27.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d73d6e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c09a810 con 0x7f4d6c133f30 2023-09-30T22:36:27.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d71b0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d6c09d6f0 0x7f4d6c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d71309700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4d6c09e000 0x7f4d6c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d7230b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d6c133f30 0x7f4d6c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d71309700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4d6c09e000 0x7f4d6c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40856/0 (socket says 172.21.15.59:40856) 2023-09-30T22:36:27.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d71b0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d6c09d6f0 0x7f4d6c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40960/0 (socket says 172.21.15.59:40960) 2023-09-30T22:36:27.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d71309700 1 -- 172.21.15.59:0/975908577 learned_addr learned my addr 172.21.15.59:0/975908577 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:27.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d7230b700 1 -- 172.21.15.59:0/975908577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d6c09d6f0 msgr2=0x7f4d6c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:27.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d7230b700 1 --2- 172.21.15.59:0/975908577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d6c09d6f0 0x7f4d6c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d7230b700 1 -- 172.21.15.59:0/975908577 >> v2:172.21.15.59:3300/0 conn(0x7f4d6c09e000 msgr2=0x7f4d6c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:27.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d7230b700 1 --2- 172.21.15.59:0/975908577 >> v2:172.21.15.59:3300/0 conn(0x7f4d6c09e000 0x7f4d6c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d7230b700 1 -- 172.21.15.59:0/975908577 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c09a470 con 0x7f4d6c133f30 2023-09-30T22:36:27.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d71b0a700 1 --2- 172.21.15.59:0/975908577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d6c09d6f0 0x7f4d6c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:27.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.078+0000 7f4d71309700 1 --2- 172.21.15.59:0/975908577 >> v2:172.21.15.59:3300/0 conn(0x7f4d6c09e000 0x7f4d6c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:27.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.079+0000 7f4d7230b700 1 --2- 172.21.15.59:0/975908577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d6c133f30 0x7f4d6c1343b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009d90 tx=0x7f4d6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4783b0860f66e8b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:27.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.079+0000 7f4d70b08700 1 -- 172.21.15.59:0/975908577 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6400e070 con 0x7f4d6c133f30 2023-09-30T22:36:27.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.079+0000 7f4d70b08700 1 -- 172.21.15.59:0/975908577 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6400bb20 con 0x7f4d6c133f30 2023-09-30T22:36:27.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.079+0000 7f4d70b08700 1 -- 172.21.15.59:0/975908577 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64012430 con 0x7f4d6c133f30 2023-09-30T22:36:27.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.080+0000 7f4d73d6e700 1 -- 172.21.15.59:0/975908577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d6c133f30 msgr2=0x7f4d6c1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:27.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.080+0000 7f4d73d6e700 1 --2- 172.21.15.59:0/975908577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d6c133f30 0x7f4d6c1343b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009d90 tx=0x7f4d6400b330 comp rx=0 tx=0).stop 2023-09-30T22:36:27.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.080+0000 7f4d73d6e700 1 -- 172.21.15.59:0/975908577 shutdown_connections 2023-09-30T22:36:27.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.080+0000 7f4d73d6e700 1 --2- 172.21.15.59:0/975908577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d6c133f30 0x7f4d6c1343b0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.080+0000 7f4d73d6e700 1 --2- 172.21.15.59:0/975908577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d6c09d6f0 0x7f4d6c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.080+0000 7f4d73d6e700 1 --2- 172.21.15.59:0/975908577 >> v2:172.21.15.59:3300/0 conn(0x7f4d6c09e000 0x7f4d6c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.080+0000 7f4d73d6e700 1 -- 172.21.15.59:0/975908577 >> 172.21.15.59:0/975908577 conn(0x7f4d6c066f50 msgr2=0x7f4d6c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:27.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.080+0000 7f4d73d6e700 1 -- 172.21.15.59:0/975908577 shutdown_connections 2023-09-30T22:36:27.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.080+0000 7f4d73d6e700 1 -- 172.21.15.59:0/975908577 wait complete. 2023-09-30T22:36:27.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.081+0000 7f4d73d6e700 1 Processor -- start 2023-09-30T22:36:27.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.081+0000 7f4d73d6e700 1 -- start start 2023-09-30T22:36:27.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.081+0000 7f4d73d6e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d6c09d6f0 0x7f4d6c11e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.081+0000 7f4d73d6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d6c09e000 0x7f4d6c1c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.081+0000 7f4d73d6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d6c133f30 0x7f4d6c1c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.081+0000 7f4d73d6e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c132600 con 0x7f4d6c133f30 2023-09-30T22:36:27.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.081+0000 7f4d73d6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c121560 con 0x7f4d6c09e000 2023-09-30T22:36:27.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.081+0000 7f4d73d6e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c11e380 con 0x7f4d6c09d6f0 2023-09-30T22:36:27.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.081+0000 7f4d7230b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d6c133f30 0x7f4d6c1c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.081+0000 7f4d71309700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d6c09e000 0x7f4d6c1c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.081+0000 7f4d7230b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d6c133f30 0x7f4d6c1c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40860/0 (socket says 172.21.15.59:40860) 2023-09-30T22:36:27.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.081+0000 7f4d7230b700 1 -- 172.21.15.59:0/3151956541 learned_addr learned my addr 172.21.15.59:0/3151956541 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:27.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.082+0000 7f4d71b0a700 1 --2- 172.21.15.59:0/3151956541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d6c09d6f0 0x7f4d6c11e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.082+0000 7f4d71309700 1 -- 172.21.15.59:0/3151956541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d6c09d6f0 msgr2=0x7f4d6c11e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:27.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.082+0000 7f4d71309700 1 --2- 172.21.15.59:0/3151956541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d6c09d6f0 0x7f4d6c11e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.082+0000 7f4d71309700 1 -- 172.21.15.59:0/3151956541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d6c133f30 msgr2=0x7f4d6c1c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:27.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.082+0000 7f4d71309700 1 --2- 172.21.15.59:0/3151956541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d6c133f30 0x7f4d6c1c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.082+0000 7f4d71309700 1 -- 172.21.15.59:0/3151956541 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c0094a0 con 0x7f4d6c09e000 2023-09-30T22:36:27.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.082+0000 7f4d71309700 1 --2- 172.21.15.59:0/3151956541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d6c09e000 0x7f4d6c1c7e80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c06d650 tx=0x7f4d6800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:27.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.082+0000 7f4d627fc700 1 -- 172.21.15.59:0/3151956541 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68004240 con 0x7f4d6c09e000 2023-09-30T22:36:27.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.082+0000 7f4d627fc700 1 -- 172.21.15.59:0/3151956541 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d680043a0 con 0x7f4d6c09e000 2023-09-30T22:36:27.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.082+0000 7f4d627fc700 1 -- 172.21.15.59:0/3151956541 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d680036a0 con 0x7f4d6c09e000 2023-09-30T22:36:27.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.082+0000 7f4d73d6e700 1 -- 172.21.15.59:0/3151956541 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d68009550 con 0x7f4d6c09e000 2023-09-30T22:36:27.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.082+0000 7f4d73d6e700 1 -- 172.21.15.59:0/3151956541 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d64009a70 con 0x7f4d6c09e000 2023-09-30T22:36:27.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.083+0000 7f4d627fc700 1 -- 172.21.15.59:0/3151956541 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d68003800 con 0x7f4d6c09e000 2023-09-30T22:36:27.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.083+0000 7f4d627fc700 1 -- 172.21.15.59:0/3151956541 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4d6803f7f0 con 0x7f4d6c09e000 2023-09-30T22:36:27.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.083+0000 7f4d73d6e700 1 -- 172.21.15.59:0/3151956541 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c074ea0 con 0x7f4d6c09e000 2023-09-30T22:36:27.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.088+0000 7f4d627fc700 1 -- 172.21.15.59:0/3151956541 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d68013470 con 0x7f4d6c09e000 2023-09-30T22:36:27.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.256+0000 7f43f45c1700 1 -- 172.21.15.59:0/149183207 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f43ec120370 con 0x7f43ec0a1340 2023-09-30T22:36:27.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.257+0000 7f43e2ffd700 1 -- 172.21.15.59:0/149183207 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43dc021030 con 0x7f43ec0a1340 2023-09-30T22:36:27.258 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.260+0000 7f43f45c1700 1 -- 172.21.15.59:0/149183207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43ec0a1340 msgr2=0x7f43ec11e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.260+0000 7f43f45c1700 1 --2- 172.21.15.59:0/149183207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43ec0a1340 0x7f43ec11e730 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00e900 tx=0x7f43dc00ec10 comp rx=0 tx=0).stop 2023-09-30T22:36:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.260+0000 7f43f45c1700 1 -- 172.21.15.59:0/149183207 shutdown_connections 2023-09-30T22:36:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.260+0000 7f43f45c1700 1 --2- 172.21.15.59:0/149183207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43ec133fa0 0x7f43ec11ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.260+0000 7f43f45c1700 1 --2- 172.21.15.59:0/149183207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ec0a0a30 0x7f43ec11e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.260+0000 7f43f45c1700 1 --2- 172.21.15.59:0/149183207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43ec0a1340 0x7f43ec11e730 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.260+0000 7f43f45c1700 1 -- 172.21.15.59:0/149183207 >> 172.21.15.59:0/149183207 conn(0x7f43ec0a6550 msgr2=0x7f43ec133060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.260+0000 7f43f45c1700 1 -- 172.21.15.59:0/149183207 shutdown_connections 2023-09-30T22:36:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.260+0000 7f43f45c1700 1 -- 172.21.15.59:0/149183207 wait complete. 2023-09-30T22:36:27.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.297+0000 7f4d73d6e700 1 -- 172.21.15.59:0/3151956541 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4d6c1327c0 con 0x7f4d6c09e000 2023-09-30T22:36:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.297+0000 7f4d627fc700 1 -- 172.21.15.59:0/3151956541 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d6802a090 con 0x7f4d6c09e000 2023-09-30T22:36:27.298 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:27.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.299+0000 7f4d73d6e700 1 -- 172.21.15.59:0/3151956541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d6c09e000 msgr2=0x7f4d6c1c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:27.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.299+0000 7f4d73d6e700 1 --2- 172.21.15.59:0/3151956541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d6c09e000 0x7f4d6c1c7e80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c06d650 tx=0x7f4d6800ec80 comp rx=0 tx=0).stop 2023-09-30T22:36:27.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.299+0000 7f4d73d6e700 1 -- 172.21.15.59:0/3151956541 shutdown_connections 2023-09-30T22:36:27.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.299+0000 7f4d73d6e700 1 --2- 172.21.15.59:0/3151956541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d6c09d6f0 0x7f4d6c11e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.299+0000 7f4d73d6e700 1 --2- 172.21.15.59:0/3151956541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d6c133f30 0x7f4d6c1c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.299+0000 7f4d73d6e700 1 --2- 172.21.15.59:0/3151956541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d6c09e000 0x7f4d6c1c7e80 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.299+0000 7f4d73d6e700 1 -- 172.21.15.59:0/3151956541 >> 172.21.15.59:0/3151956541 conn(0x7f4d6c066f50 msgr2=0x7f4d6c132ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.299+0000 7f4d73d6e700 1 -- 172.21.15.59:0/3151956541 shutdown_connections 2023-09-30T22:36:27.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.299+0000 7f4d73d6e700 1 -- 172.21.15.59:0/3151956541 wait complete. 2023-09-30T22:36:27.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:27.813 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:27.848 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:27.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.961+0000 7fdd6a1bf700 1 Processor -- start 2023-09-30T22:36:27.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.961+0000 7fdd6a1bf700 1 -- start start 2023-09-30T22:36:27.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.961+0000 7fdd6a1bf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd6409e930 0x7fdd6409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.962+0000 7fdd6a1bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd6409f240 0x7fdd641317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.962+0000 7fdd6a1bf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd64070940 con 0x7fdd6409f650 2023-09-30T22:36:27.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.962+0000 7fdd6a1bf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd6406fd60 con 0x7fdd6409e930 2023-09-30T22:36:27.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.962+0000 7fdd6a1bf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6406fa80 con 0x7fdd6409f240 2023-09-30T22:36:27.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.962+0000 7fdd637fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd6409e930 0x7fdd6409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.962+0000 7fdd62ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd6409f240 0x7fdd641317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.962+0000 7fdd637fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd6409e930 0x7fdd6409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40862/0 (socket says 172.21.15.59:40862) 2023-09-30T22:36:27.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.962+0000 7fdd637fe700 1 -- 172.21.15.59:0/725267441 learned_addr learned my addr 172.21.15.59:0/725267441 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.962+0000 7fdd62ffd700 1 -- 172.21.15.59:0/725267441 >> v2:172.21.15.59:3300/0 conn(0x7fdd6409e930 msgr2=0x7fdd6409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.962+0000 7fdd62ffd700 1 --2- 172.21.15.59:0/725267441 >> v2:172.21.15.59:3300/0 conn(0x7fdd6409e930 0x7fdd6409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.962+0000 7fdd62ffd700 1 -- 172.21.15.59:0/725267441 >> v1:172.21.15.59:6789/0 conn(0x7fdd6409f650 legacy=0x7fdd64131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.962+0000 7fdd62ffd700 1 -- 172.21.15.59:0/725267441 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6409fb60 con 0x7fdd6409f240 2023-09-30T22:36:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.962+0000 7fdd62ffd700 1 --2- 172.21.15.59:0/725267441 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd6409f240 0x7fdd641317f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009840 tx=0x7fdd4c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed7512450c345ca7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.962+0000 7fdd627fc700 1 -- 172.21.15.59:0/725267441 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c011830 con 0x7fdd6409f240 2023-09-30T22:36:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.963+0000 7fdd627fc700 1 -- 172.21.15.59:0/725267441 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c011990 con 0x7fdd6409f240 2023-09-30T22:36:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.963+0000 7fdd627fc700 1 -- 172.21.15.59:0/725267441 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c011d20 con 0x7fdd6409f240 2023-09-30T22:36:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.963+0000 7fdd6a1bf700 1 -- 172.21.15.59:0/725267441 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd6409f240 msgr2=0x7fdd641317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:27.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.963+0000 7fdd6a1bf700 1 --2- 172.21.15.59:0/725267441 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd6409f240 0x7fdd641317f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009840 tx=0x7fdd4c009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:27.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.963+0000 7fdd6a1bf700 1 -- 172.21.15.59:0/725267441 shutdown_connections 2023-09-30T22:36:27.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.963+0000 7fdd6a1bf700 1 --2- 172.21.15.59:0/725267441 >> v2:172.21.15.59:3300/0 conn(0x7fdd6409e930 0x7fdd6409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.963+0000 7fdd6a1bf700 1 --2- 172.21.15.59:0/725267441 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd6409f240 0x7fdd641317f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.963+0000 7fdd6a1bf700 1 -- 172.21.15.59:0/725267441 >> 172.21.15.59:0/725267441 conn(0x7fdd640a4210 msgr2=0x7fdd640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:27.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.963+0000 7fdd6a1bf700 1 -- 172.21.15.59:0/725267441 shutdown_connections 2023-09-30T22:36:27.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.963+0000 7fdd6a1bf700 1 -- 172.21.15.59:0/725267441 wait complete. 2023-09-30T22:36:27.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.965+0000 7fdd6a1bf700 1 Processor -- start 2023-09-30T22:36:27.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.965+0000 7fdd6a1bf700 1 -- start start 2023-09-30T22:36:27.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd6a1bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd6409e930 0x7fdd641a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd6a1bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd6409f240 0x7fdd641a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd6a1bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd6409f650 0x7fdd641a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:27.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd6a1bf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd641a5e30 con 0x7fdd6409e930 2023-09-30T22:36:27.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd6a1bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd641a6ef0 con 0x7fdd6409f240 2023-09-30T22:36:27.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd637fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd6409e930 0x7fdd641a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd637fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd6409e930 0x7fdd641a3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40866/0 (socket says 172.21.15.59:40866) 2023-09-30T22:36:27.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd637fe700 1 -- 172.21.15.59:0/3556975185 learned_addr learned my addr 172.21.15.59:0/3556975185 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:27.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd6a1bf700 1 -- 172.21.15.59:0/3556975185 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64071d20 con 0x7fdd6409f650 2023-09-30T22:36:27.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd63fff700 1 --2- 172.21.15.59:0/3556975185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd6409f650 0x7fdd641a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd62ffd700 1 --2- 172.21.15.59:0/3556975185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd6409f240 0x7fdd641a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:27.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd637fe700 1 -- 172.21.15.59:0/3556975185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd6409f650 msgr2=0x7fdd641a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:27.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd637fe700 1 --2- 172.21.15.59:0/3556975185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd6409f650 0x7fdd641a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd637fe700 1 -- 172.21.15.59:0/3556975185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd6409f240 msgr2=0x7fdd641a4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:27.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd637fe700 1 --2- 172.21.15.59:0/3556975185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd6409f240 0x7fdd641a4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:27.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd637fe700 1 -- 172.21.15.59:0/3556975185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c0094a0 con 0x7fdd6409e930 2023-09-30T22:36:27.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.966+0000 7fdd637fe700 1 --2- 172.21.15.59:0/3556975185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd6409e930 0x7fdd641a3c40 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400efc0 tx=0x7fdd5400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:27.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.967+0000 7fdd5bfff700 1 -- 172.21.15.59:0/3556975185 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400cb00 con 0x7fdd6409e930 2023-09-30T22:36:27.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.967+0000 7fdd5bfff700 1 -- 172.21.15.59:0/3556975185 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5400f040 con 0x7fdd6409e930 2023-09-30T22:36:27.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.967+0000 7fdd6a1bf700 1 -- 172.21.15.59:0/3556975185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd640a0190 con 0x7fdd6409e930 2023-09-30T22:36:27.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.967+0000 7fdd5bfff700 1 -- 172.21.15.59:0/3556975185 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400ce60 con 0x7fdd6409e930 2023-09-30T22:36:27.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.967+0000 7fdd6a1bf700 1 -- 172.21.15.59:0/3556975185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd641a5850 con 0x7fdd6409e930 2023-09-30T22:36:27.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.967+0000 7fdd5bfff700 1 -- 172.21.15.59:0/3556975185 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd54014480 con 0x7fdd6409e930 2023-09-30T22:36:27.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.968+0000 7fdd5bfff700 1 -- 172.21.15.59:0/3556975185 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdd5403fac0 con 0x7fdd6409e930 2023-09-30T22:36:27.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.968+0000 7fdd6a1bf700 1 -- 172.21.15.59:0/3556975185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd641a0b30 con 0x7fdd6409e930 2023-09-30T22:36:27.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:27.973+0000 7fdd5bfff700 1 -- 172.21.15.59:0/3556975185 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd54009e60 con 0x7fdd6409e930 2023-09-30T22:36:28.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.000+0000 7f175f144700 1 Processor -- start 2023-09-30T22:36:28.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.000+0000 7f175f144700 1 -- start start 2023-09-30T22:36:28.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f175f144700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17580a0a30 0x7f17580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:28.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f175f144700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f175809d630 0x7f17580a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:28.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f175f144700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17580a2a70 con 0x7f1758133930 2023-09-30T22:36:28.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f175f144700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17580a01d0 con 0x7f17580a0a30 2023-09-30T22:36:28.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f175f144700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f175809e2b0 con 0x7f175809d630 2023-09-30T22:36:28.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f175cee0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17580a0a30 0x7f17580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:28.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f175cee0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17580a0a30 0x7f17580a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40982/0 (socket says 172.21.15.59:40982) 2023-09-30T22:36:28.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f175d6e1700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1758133930 0x7f1758133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59100/0 (socket says 172.21.15.59:59100) 2023-09-30T22:36:28.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f175cee0700 1 -- 172.21.15.59:0/3554730339 learned_addr learned my addr 172.21.15.59:0/3554730339 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:28.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f1757fff700 1 --2- 172.21.15.59:0/3554730339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f175809d630 0x7f17580a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:28.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f175cee0700 1 -- 172.21.15.59:0/3554730339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f175809d630 msgr2=0x7f17580a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:28.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f175cee0700 1 --2- 172.21.15.59:0/3554730339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f175809d630 0x7f17580a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f175cee0700 1 -- 172.21.15.59:0/3554730339 >> v1:172.21.15.59:6789/0 conn(0x7f1758133930 legacy=0x7f1758133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f17577fe700 1 -- 172.21.15.59:0/3554730339 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747025472 0 0) 0x7f17580a2a70 con 0x7f1758133930 2023-09-30T22:36:28.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f175cee0700 1 -- 172.21.15.59:0/3554730339 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175809dc50 con 0x7f17580a0a30 2023-09-30T22:36:28.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.001+0000 7f1757fff700 1 --2- 172.21.15.59:0/3554730339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f175809d630 0x7f17580a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:28.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.002+0000 7f175cee0700 1 --2- 172.21.15.59:0/3554730339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17580a0a30 0x7f17580a0e00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f174c009920 tx=0x7f174c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b7367047d13729c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:28.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.002+0000 7f17577fe700 1 -- 172.21.15.59:0/3554730339 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c011830 con 0x7f17580a0a30 2023-09-30T22:36:28.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.002+0000 7f17577fe700 1 -- 172.21.15.59:0/3554730339 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c011990 con 0x7f17580a0a30 2023-09-30T22:36:28.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.002+0000 7f17577fe700 1 -- 172.21.15.59:0/3554730339 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c011d20 con 0x7f17580a0a30 2023-09-30T22:36:28.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.002+0000 7f175f144700 1 -- 172.21.15.59:0/3554730339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17580a0a30 msgr2=0x7f17580a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.002+0000 7f175f144700 1 --2- 172.21.15.59:0/3554730339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17580a0a30 0x7f17580a0e00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f174c009920 tx=0x7f174c009c30 comp rx=0 tx=0).stop 2023-09-30T22:36:28.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.002+0000 7f175f144700 1 -- 172.21.15.59:0/3554730339 shutdown_connections 2023-09-30T22:36:28.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.002+0000 7f175f144700 1 --2- 172.21.15.59:0/3554730339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17580a0a30 0x7f17580a0e00 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.002+0000 7f175f144700 1 --2- 172.21.15.59:0/3554730339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f175809d630 0x7f17580a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.002+0000 7f175f144700 1 -- 172.21.15.59:0/3554730339 >> 172.21.15.59:0/3554730339 conn(0x7f17580a3050 msgr2=0x7f17580a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:28.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.002+0000 7f175f144700 1 -- 172.21.15.59:0/3554730339 shutdown_connections 2023-09-30T22:36:28.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.003+0000 7f175f144700 1 -- 172.21.15.59:0/3554730339 wait complete. 2023-09-30T22:36:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.003+0000 7f175f144700 1 Processor -- start 2023-09-30T22:36:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.003+0000 7f175f144700 1 -- start start 2023-09-30T22:36:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.004+0000 7f175f144700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f175809d630 0x7f175811f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.004+0000 7f175f144700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17580a0a30 0x7f175811fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.004+0000 7f175f144700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1758133930 0x7f17581c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.004+0000 7f175f144700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17581221d0 con 0x7f1758133930 2023-09-30T22:36:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.004+0000 7f175f144700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17581212a0 con 0x7f175809d630 2023-09-30T22:36:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.004+0000 7f175f144700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1758133320 con 0x7f17580a0a30 2023-09-30T22:36:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.004+0000 7f175d6e1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1758133930 0x7f17581c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.004+0000 7f175cee0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f175809d630 0x7f175811f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.004+0000 7f175cee0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f175809d630 0x7f175811f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40996/0 (socket says 172.21.15.59:40996) 2023-09-30T22:36:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.004+0000 7f175cee0700 1 -- 172.21.15.59:0/1800828081 learned_addr learned my addr 172.21.15.59:0/1800828081 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.004+0000 7f175d6e1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1758133930 0x7f17581c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40882/0 (socket says 172.21.15.59:40882) 2023-09-30T22:36:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.004+0000 7f1757fff700 1 --2- 172.21.15.59:0/1800828081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17580a0a30 0x7f175811fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.005+0000 7f175cee0700 1 -- 172.21.15.59:0/1800828081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17580a0a30 msgr2=0x7f175811fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.005+0000 7f175cee0700 1 --2- 172.21.15.59:0/1800828081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17580a0a30 0x7f175811fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.005+0000 7f175cee0700 1 -- 172.21.15.59:0/1800828081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1758133930 msgr2=0x7f17581c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.005+0000 7f175cee0700 1 --2- 172.21.15.59:0/1800828081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1758133930 0x7f17581c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.005+0000 7f175cee0700 1 -- 172.21.15.59:0/1800828081 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17440094a0 con 0x7f175809d630 2023-09-30T22:36:28.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.005+0000 7f175cee0700 1 --2- 172.21.15.59:0/1800828081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f175809d630 0x7f175811f4e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f174c000c00 tx=0x7f174c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:28.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.005+0000 7f17557fa700 1 -- 172.21.15.59:0/1800828081 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c004240 con 0x7f175809d630 2023-09-30T22:36:28.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.005+0000 7f17557fa700 1 -- 172.21.15.59:0/1800828081 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c01f070 con 0x7f175809d630 2023-09-30T22:36:28.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.005+0000 7f175f144700 1 -- 172.21.15.59:0/1800828081 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c009550 con 0x7f175809d630 2023-09-30T22:36:28.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.005+0000 7f17557fa700 1 -- 172.21.15.59:0/1800828081 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c0045c0 con 0x7f175809d630 2023-09-30T22:36:28.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.005+0000 7f175f144700 1 -- 172.21.15.59:0/1800828081 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175811f000 con 0x7f175809d630 2023-09-30T22:36:28.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.006+0000 7f17557fa700 1 -- 172.21.15.59:0/1800828081 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f174c021030 con 0x7f175809d630 2023-09-30T22:36:28.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.006+0000 7f175f144700 1 -- 172.21.15.59:0/1800828081 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17580747f0 con 0x7f175809d630 2023-09-30T22:36:28.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.006+0000 7f17557fa700 1 -- 172.21.15.59:0/1800828081 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f174c040650 con 0x7f175809d630 2023-09-30T22:36:28.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.011+0000 7f17557fa700 1 -- 172.21.15.59:0/1800828081 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f174c0237e0 con 0x7f175809d630 2023-09-30T22:36:28.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.182+0000 7fdd6a1bf700 1 -- 172.21.15.59:0/3556975185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdd64074ea0 con 0x7fdd6409e930 2023-09-30T22:36:28.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.182+0000 7fdd5bfff700 1 -- 172.21.15.59:0/3556975185 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd540133e0 con 0x7fdd6409e930 2023-09-30T22:36:28.183 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:28.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.184+0000 7fdd6a1bf700 1 -- 172.21.15.59:0/3556975185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd6409e930 msgr2=0x7fdd641a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.184+0000 7fdd6a1bf700 1 --2- 172.21.15.59:0/3556975185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd6409e930 0x7fdd641a3c40 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400efc0 tx=0x7fdd5400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.185+0000 7fdd6a1bf700 1 -- 172.21.15.59:0/3556975185 shutdown_connections 2023-09-30T22:36:28.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.185+0000 7fdd6a1bf700 1 --2- 172.21.15.59:0/3556975185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd6409f650 0x7fdd641a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.185+0000 7fdd6a1bf700 1 --2- 172.21.15.59:0/3556975185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd6409e930 0x7fdd641a3c40 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.185+0000 7fdd6a1bf700 1 --2- 172.21.15.59:0/3556975185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd6409f240 0x7fdd641a4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.185+0000 7fdd6a1bf700 1 -- 172.21.15.59:0/3556975185 >> 172.21.15.59:0/3556975185 conn(0x7fdd640a4210 msgr2=0x7fdd641b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:28.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.185+0000 7fdd6a1bf700 1 -- 172.21.15.59:0/3556975185 shutdown_connections 2023-09-30T22:36:28.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.185+0000 7fdd6a1bf700 1 -- 172.21.15.59:0/3556975185 wait complete. 2023-09-30T22:36:28.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:28.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.217+0000 7f175f144700 1 -- 172.21.15.59:0/1800828081 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1758133710 con 0x7f175809d630 2023-09-30T22:36:28.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.217+0000 7f17557fa700 1 -- 172.21.15.59:0/1800828081 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f174c00b420 con 0x7f175809d630 2023-09-30T22:36:28.218 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:28.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.220+0000 7f175f144700 1 -- 172.21.15.59:0/1800828081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f175809d630 msgr2=0x7f175811f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.220+0000 7f175f144700 1 --2- 172.21.15.59:0/1800828081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f175809d630 0x7f175811f4e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f174c000c00 tx=0x7f174c004750 comp rx=0 tx=0).stop 2023-09-30T22:36:28.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.220+0000 7f175f144700 1 -- 172.21.15.59:0/1800828081 shutdown_connections 2023-09-30T22:36:28.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.220+0000 7f175f144700 1 --2- 172.21.15.59:0/1800828081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1758133930 0x7f17581c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.220+0000 7f175f144700 1 --2- 172.21.15.59:0/1800828081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f175809d630 0x7f175811f4e0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.220+0000 7f175f144700 1 --2- 172.21.15.59:0/1800828081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17580a0a30 0x7f175811fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.220+0000 7f175f144700 1 -- 172.21.15.59:0/1800828081 >> 172.21.15.59:0/1800828081 conn(0x7f17580a3050 msgr2=0x7f17581bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.220+0000 7f175f144700 1 -- 172.21.15.59:0/1800828081 shutdown_connections 2023-09-30T22:36:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.220+0000 7f175f144700 1 -- 172.21.15.59:0/1800828081 wait complete. 2023-09-30T22:36:28.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:28.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:28.314 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.417+0000 7f85b78a6700 1 Processor -- start 2023-09-30T22:36:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.418+0000 7f85b78a6700 1 -- start start 2023-09-30T22:36:28.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.418+0000 7f85b78a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b01337f0 0x7f85b0138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:28.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.418+0000 7f85b78a6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f85b0138dc0 0x7f85b013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:28.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.418+0000 7f85b78a6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b006b990 con 0x7f85b0133420 2023-09-30T22:36:28.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.418+0000 7f85b78a6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b009b0e0 con 0x7f85b0138dc0 2023-09-30T22:36:28.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.418+0000 7f85b78a6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85b0133c20 con 0x7f85b01337f0 2023-09-30T22:36:28.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.418+0000 7f85b5e43700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f85b0138dc0 0x7f85b013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:28.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.418+0000 7f85b4e41700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b01337f0 0x7f85b0138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:28.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.418+0000 7f85b5e43700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f85b0138dc0 0x7f85b013b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40896/0 (socket says 172.21.15.59:40896) 2023-09-30T22:36:28.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.418+0000 7f85b5e43700 1 -- 172.21.15.59:0/3010615706 learned_addr learned my addr 172.21.15.59:0/3010615706 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:28.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.419+0000 7f85b5e43700 1 -- 172.21.15.59:0/3010615706 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b01337f0 msgr2=0x7f85b0138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:28.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.419+0000 7f85b5e43700 1 --2- 172.21.15.59:0/3010615706 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b01337f0 0x7f85b0138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.419+0000 7f85b5e43700 1 -- 172.21.15.59:0/3010615706 >> v1:172.21.15.59:6789/0 conn(0x7f85b0133420 legacy=0x7f85b0133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.419+0000 7f85b5e43700 1 -- 172.21.15.59:0/3010615706 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b00a0590 con 0x7f85b0138dc0 2023-09-30T22:36:28.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.419+0000 7f85affff700 1 -- 172.21.15.59:0/3010615706 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627676882 0 0) 0x7f85b006b990 con 0x7f85b0133420 2023-09-30T22:36:28.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.419+0000 7f85b4e41700 1 --2- 172.21.15.59:0/3010615706 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b01337f0 0x7f85b0138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:28.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.419+0000 7f85b5e43700 1 --2- 172.21.15.59:0/3010615706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b0138dc0 0x7f85b013b1a0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f85a80098f0 tx=0x7f85a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a6b0853c86ce04 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:28.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.419+0000 7f85affff700 1 -- 172.21.15.59:0/3010615706 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8011830 con 0x7f85b0138dc0 2023-09-30T22:36:28.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.419+0000 7f85affff700 1 -- 172.21.15.59:0/3010615706 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a8011990 con 0x7f85b0138dc0 2023-09-30T22:36:28.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.419+0000 7f85affff700 1 -- 172.21.15.59:0/3010615706 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8011d20 con 0x7f85b0138dc0 2023-09-30T22:36:28.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.420+0000 7f85b78a6700 1 -- 172.21.15.59:0/3010615706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b0138dc0 msgr2=0x7f85b013b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.420+0000 7f85b78a6700 1 --2- 172.21.15.59:0/3010615706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b0138dc0 0x7f85b013b1a0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f85a80098f0 tx=0x7f85a8009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:28.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.420+0000 7f85b78a6700 1 -- 172.21.15.59:0/3010615706 shutdown_connections 2023-09-30T22:36:28.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.420+0000 7f85b78a6700 1 --2- 172.21.15.59:0/3010615706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b0138dc0 0x7f85b013b1a0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.420+0000 7f85b78a6700 1 --2- 172.21.15.59:0/3010615706 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b01337f0 0x7f85b0138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.420+0000 7f85b78a6700 1 -- 172.21.15.59:0/3010615706 >> 172.21.15.59:0/3010615706 conn(0x7f85b00a4210 msgr2=0x7f85b00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:28.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.420+0000 7f85b78a6700 1 -- 172.21.15.59:0/3010615706 shutdown_connections 2023-09-30T22:36:28.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.420+0000 7f85b78a6700 1 -- 172.21.15.59:0/3010615706 wait complete. 2023-09-30T22:36:28.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.421+0000 7f85b78a6700 1 Processor -- start 2023-09-30T22:36:28.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.421+0000 7f85b78a6700 1 -- start start 2023-09-30T22:36:28.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.421+0000 7f85b78a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b0133420 0x7f85b012f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:28.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.421+0000 7f85b78a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b01337f0 0x7f85b012f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:28.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.421+0000 7f85b78a6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b0138dc0 0x7f85b012fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:28.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.421+0000 7f85b78a6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b009c4e0 con 0x7f85b0138dc0 2023-09-30T22:36:28.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.421+0000 7f85b78a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b009b430 con 0x7f85b0133420 2023-09-30T22:36:28.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.421+0000 7f85b78a6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85b009d600 con 0x7f85b01337f0 2023-09-30T22:36:28.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85b4e41700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b01337f0 0x7f85b012f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:28.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85b4e41700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b01337f0 0x7f85b012f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:34978/0 (socket says 172.21.15.59:34978) 2023-09-30T22:36:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85b4e41700 1 -- 172.21.15.59:0/581412873 learned_addr learned my addr 172.21.15.59:0/581412873 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85b5e43700 1 --2- 172.21.15.59:0/581412873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b0138dc0 0x7f85b012fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85b5642700 1 --2- 172.21.15.59:0/581412873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b0133420 0x7f85b012f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85b4e41700 1 -- 172.21.15.59:0/581412873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b0133420 msgr2=0x7f85b012f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85b4e41700 1 --2- 172.21.15.59:0/581412873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b0133420 0x7f85b012f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85b4e41700 1 -- 172.21.15.59:0/581412873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b0138dc0 msgr2=0x7f85b012fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85b4e41700 1 --2- 172.21.15.59:0/581412873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b0138dc0 0x7f85b012fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85b4e41700 1 -- 172.21.15.59:0/581412873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a40094a0 con 0x7f85b01337f0 2023-09-30T22:36:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85b5e43700 1 --2- 172.21.15.59:0/581412873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b0138dc0 0x7f85b012fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85b4e41700 1 --2- 172.21.15.59:0/581412873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b01337f0 0x7f85b012f5f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f85a400ebe0 tx=0x7f85a400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85adffb700 1 -- 172.21.15.59:0/581412873 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a400c850 con 0x7f85b01337f0 2023-09-30T22:36:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85adffb700 1 -- 172.21.15.59:0/581412873 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a400c9b0 con 0x7f85b01337f0 2023-09-30T22:36:28.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85b78a6700 1 -- 172.21.15.59:0/581412873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a8009550 con 0x7f85b01337f0 2023-09-30T22:36:28.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.422+0000 7f85adffb700 1 -- 172.21.15.59:0/581412873 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a400cd40 con 0x7f85b01337f0 2023-09-30T22:36:28.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.423+0000 7f85b78a6700 1 -- 172.21.15.59:0/581412873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b0130b10 con 0x7f85b01337f0 2023-09-30T22:36:28.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.424+0000 7f85adffb700 1 -- 172.21.15.59:0/581412873 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f85a4013470 con 0x7f85b01337f0 2023-09-30T22:36:28.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.424+0000 7f85adffb700 1 -- 172.21.15.59:0/581412873 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f85a403fb30 con 0x7f85b01337f0 2023-09-30T22:36:28.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.424+0000 7f85b78a6700 1 -- 172.21.15.59:0/581412873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b0074ea0 con 0x7f85b01337f0 2023-09-30T22:36:28.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.429+0000 7f85adffb700 1 -- 172.21.15.59:0/581412873 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85a4017080 con 0x7f85b01337f0 2023-09-30T22:36:28.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.459+0000 7f68d1c33700 1 Processor -- start 2023-09-30T22:36:28.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.459+0000 7f68d1c33700 1 -- start start 2023-09-30T22:36:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.459+0000 7f68d1c33700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68cc0a0a30 0x7f68cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.459+0000 7f68d1c33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68cc09d630 0x7f68cc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.459+0000 7f68d1c33700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68cc0a2a70 con 0x7f68cc133930 2023-09-30T22:36:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.459+0000 7f68d1c33700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68cc0a01d0 con 0x7f68cc0a0a30 2023-09-30T22:36:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.459+0000 7f68d1c33700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc09e2b0 con 0x7f68cc09d630 2023-09-30T22:36:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.460+0000 7f68cb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68cc0a0a30 0x7f68cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.460+0000 7f68caffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68cc09d630 0x7f68cc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.460+0000 7f68cb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68cc0a0a30 0x7f68cc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40910/0 (socket says 172.21.15.59:40910) 2023-09-30T22:36:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.460+0000 7f68caffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68cc09d630 0x7f68cc0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:34992/0 (socket says 172.21.15.59:34992) 2023-09-30T22:36:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.460+0000 7f68cb7fe700 1 -- 172.21.15.59:0/2748989651 learned_addr learned my addr 172.21.15.59:0/2748989651 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.460+0000 7f68cbfff700 1 --1- 172.21.15.59:0/2748989651 >> v1:172.21.15.59:6789/0 conn(0x7f68cc133930 0x7f68cc133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59106/0 (socket says 172.21.15.59:59106) 2023-09-30T22:36:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.460+0000 7f68caffd700 1 -- 172.21.15.59:0/2748989651 >> v2:172.21.15.59:3300/0 conn(0x7f68cc0a0a30 msgr2=0x7f68cc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.460+0000 7f68caffd700 1 --2- 172.21.15.59:0/2748989651 >> v2:172.21.15.59:3300/0 conn(0x7f68cc0a0a30 0x7f68cc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.460+0000 7f68caffd700 1 -- 172.21.15.59:0/2748989651 >> v1:172.21.15.59:6789/0 conn(0x7f68cc133930 legacy=0x7f68cc133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.460+0000 7f68caffd700 1 -- 172.21.15.59:0/2748989651 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc09dc50 con 0x7f68cc09d630 2023-09-30T22:36:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.460+0000 7f68cb7fe700 1 --2- 172.21.15.59:0/2748989651 >> v2:172.21.15.59:3300/0 conn(0x7f68cc0a0a30 0x7f68cc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.460+0000 7f68caffd700 1 --2- 172.21.15.59:0/2748989651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68cc09d630 0x7f68cc0a1340 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009840 tx=0x7f68c0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=353bac1dec53d493 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.460+0000 7f68ca7fc700 1 -- 172.21.15.59:0/2748989651 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0011830 con 0x7f68cc09d630 2023-09-30T22:36:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.460+0000 7f68ca7fc700 1 -- 172.21.15.59:0/2748989651 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c0011990 con 0x7f68cc09d630 2023-09-30T22:36:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.460+0000 7f68ca7fc700 1 -- 172.21.15.59:0/2748989651 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0011d20 con 0x7f68cc09d630 2023-09-30T22:36:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.461+0000 7f68d1c33700 1 -- 172.21.15.59:0/2748989651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68cc09d630 msgr2=0x7f68cc0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.461+0000 7f68d1c33700 1 --2- 172.21.15.59:0/2748989651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68cc09d630 0x7f68cc0a1340 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009840 tx=0x7f68c0009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.461+0000 7f68d1c33700 1 -- 172.21.15.59:0/2748989651 shutdown_connections 2023-09-30T22:36:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.461+0000 7f68d1c33700 1 --2- 172.21.15.59:0/2748989651 >> v2:172.21.15.59:3300/0 conn(0x7f68cc0a0a30 0x7f68cc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.461+0000 7f68d1c33700 1 --2- 172.21.15.59:0/2748989651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68cc09d630 0x7f68cc0a1340 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.461+0000 7f68d1c33700 1 -- 172.21.15.59:0/2748989651 >> 172.21.15.59:0/2748989651 conn(0x7f68cc0a3050 msgr2=0x7f68cc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.461+0000 7f68d1c33700 1 -- 172.21.15.59:0/2748989651 shutdown_connections 2023-09-30T22:36:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.461+0000 7f68d1c33700 1 -- 172.21.15.59:0/2748989651 wait complete. 2023-09-30T22:36:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.462+0000 7f68d1c33700 1 Processor -- start 2023-09-30T22:36:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.463+0000 7f68d1c33700 1 -- start start 2023-09-30T22:36:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.463+0000 7f68d1c33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68cc09d630 0x7f68cc121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.463+0000 7f68d1c33700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68cc0a0a30 0x7f68cc121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.463+0000 7f68d1c33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68cc133930 0x7f68cc121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.463+0000 7f68d1c33700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc1225b0 con 0x7f68cc0a0a30 2023-09-30T22:36:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.463+0000 7f68d1c33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc124bd0 con 0x7f68cc09d630 2023-09-30T22:36:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.463+0000 7f68d1c33700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc124630 con 0x7f68cc133930 2023-09-30T22:36:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.464+0000 7f68cbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68cc133930 0x7f68cc121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.464+0000 7f68cbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68cc133930 0x7f68cc121b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35004/0 (socket says 172.21.15.59:35004) 2023-09-30T22:36:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.464+0000 7f68cbfff700 1 -- 172.21.15.59:0/2088167437 learned_addr learned my addr 172.21.15.59:0/2088167437 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.464+0000 7f68cbfff700 1 -- 172.21.15.59:0/2088167437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68cc09d630 msgr2=0x7f68cc121100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.464+0000 7f68cbfff700 1 --2- 172.21.15.59:0/2088167437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68cc09d630 0x7f68cc121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.464+0000 7f68cbfff700 1 -- 172.21.15.59:0/2088167437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68cc0a0a30 msgr2=0x7f68cc121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.464+0000 7f68cbfff700 1 --2- 172.21.15.59:0/2088167437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68cc0a0a30 0x7f68cc121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.464+0000 7f68cbfff700 1 -- 172.21.15.59:0/2088167437 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc009550 con 0x7f68cc133930 2023-09-30T22:36:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.464+0000 7f68cbfff700 1 --2- 172.21.15.59:0/2088167437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68cc133930 0x7f68cc121b80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f68c400cbd0 tx=0x7f68c400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.464+0000 7f68b3fff700 1 -- 172.21.15.59:0/2088167437 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c400abb0 con 0x7f68cc133930 2023-09-30T22:36:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.464+0000 7f68b3fff700 1 -- 172.21.15.59:0/2088167437 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c400ad10 con 0x7f68cc133930 2023-09-30T22:36:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.464+0000 7f68d1c33700 1 -- 172.21.15.59:0/2088167437 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c00094a0 con 0x7f68cc133930 2023-09-30T22:36:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.464+0000 7f68b3fff700 1 -- 172.21.15.59:0/2088167437 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4007270 con 0x7f68cc133930 2023-09-30T22:36:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.465+0000 7f68d1c33700 1 -- 172.21.15.59:0/2088167437 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc0a0410 con 0x7f68cc133930 2023-09-30T22:36:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.465+0000 7f68b3fff700 1 -- 172.21.15.59:0/2088167437 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68c40073d0 con 0x7f68cc133930 2023-09-30T22:36:28.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.466+0000 7f68b3fff700 1 -- 172.21.15.59:0/2088167437 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f68c403f620 con 0x7f68cc133930 2023-09-30T22:36:28.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.466+0000 7f68d1c33700 1 -- 172.21.15.59:0/2088167437 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68cc11df60 con 0x7f68cc133930 2023-09-30T22:36:28.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.471+0000 7f68b3fff700 1 -- 172.21.15.59:0/2088167437 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68c4017020 con 0x7f68cc133930 2023-09-30T22:36:28.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.642+0000 7f85b78a6700 1 -- 172.21.15.59:0/581412873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f85b006b250 con 0x7f85b01337f0 2023-09-30T22:36:28.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.642+0000 7f85adffb700 1 -- 172.21.15.59:0/581412873 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f85a400cea0 con 0x7f85b01337f0 2023-09-30T22:36:28.642 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:28.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.644+0000 7f85b78a6700 1 -- 172.21.15.59:0/581412873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b01337f0 msgr2=0x7f85b012f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.644+0000 7f85b78a6700 1 --2- 172.21.15.59:0/581412873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b01337f0 0x7f85b012f5f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f85a400ebe0 tx=0x7f85a400eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.644+0000 7f85b78a6700 1 -- 172.21.15.59:0/581412873 shutdown_connections 2023-09-30T22:36:28.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.644+0000 7f85b78a6700 1 --2- 172.21.15.59:0/581412873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b0138dc0 0x7f85b012fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.644+0000 7f85b78a6700 1 --2- 172.21.15.59:0/581412873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b0133420 0x7f85b012f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.644+0000 7f85b78a6700 1 --2- 172.21.15.59:0/581412873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b01337f0 0x7f85b012f5f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.644+0000 7f85b78a6700 1 -- 172.21.15.59:0/581412873 >> 172.21.15.59:0/581412873 conn(0x7f85b00a4210 msgr2=0x7f85b00a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:28.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.644+0000 7f85b78a6700 1 -- 172.21.15.59:0/581412873 shutdown_connections 2023-09-30T22:36:28.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.645+0000 7f85b78a6700 1 -- 172.21.15.59:0/581412873 wait complete. 2023-09-30T22:36:28.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:28.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.679+0000 7f68d1c33700 1 -- 172.21.15.59:0/2088167437 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f68cc124850 con 0x7f68cc133930 2023-09-30T22:36:28.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.679+0000 7f68b3fff700 1 -- 172.21.15.59:0/2088167437 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68cc124850 con 0x7f68cc133930 2023-09-30T22:36:28.680 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:28.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.681+0000 7f68d1c33700 1 -- 172.21.15.59:0/2088167437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68cc133930 msgr2=0x7f68cc121b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:28.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.681+0000 7f68d1c33700 1 --2- 172.21.15.59:0/2088167437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68cc133930 0x7f68cc121b80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f68c400cbd0 tx=0x7f68c400cf90 comp rx=0 tx=0).stop 2023-09-30T22:36:28.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.682+0000 7f68d1c33700 1 -- 172.21.15.59:0/2088167437 shutdown_connections 2023-09-30T22:36:28.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.682+0000 7f68d1c33700 1 --2- 172.21.15.59:0/2088167437 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68cc133930 0x7f68cc121b80 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.682+0000 7f68d1c33700 1 --2- 172.21.15.59:0/2088167437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68cc09d630 0x7f68cc121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.682+0000 7f68d1c33700 1 --2- 172.21.15.59:0/2088167437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68cc0a0a30 0x7f68cc121640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:28.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.682+0000 7f68d1c33700 1 -- 172.21.15.59:0/2088167437 >> 172.21.15.59:0/2088167437 conn(0x7f68cc0a3050 msgr2=0x7f68cc133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:28.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.682+0000 7f68d1c33700 1 -- 172.21.15.59:0/2088167437 shutdown_connections 2023-09-30T22:36:28.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:28.682+0000 7f68d1c33700 1 -- 172.21.15.59:0/2088167437 wait complete. 2023-09-30T22:36:28.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:29.199 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:29.235 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:29.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.348+0000 7f8161b9f700 1 Processor -- start 2023-09-30T22:36:29.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.348+0000 7f8161b9f700 1 -- start start 2023-09-30T22:36:29.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.348+0000 7f8161b9f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f815c0a1510 0x7f815c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.348+0000 7f8161b9f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f815c139250 0x7f815c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.348+0000 7f8161b9f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f815c09edd0 con 0x7f815c0a0a30 2023-09-30T22:36:29.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.348+0000 7f8161b9f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815c0a18e0 con 0x7f815c139250 2023-09-30T22:36:29.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.348+0000 7f8161b9f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f815c09e1f0 con 0x7f815c0a1510 2023-09-30T22:36:29.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.348+0000 7f815bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f815c139250 0x7f815c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.348+0000 7f815affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f815c0a1510 0x7f815c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.348+0000 7f815bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f815c139250 0x7f815c13b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40936/0 (socket says 172.21.15.59:40936) 2023-09-30T22:36:29.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.348+0000 7f815bfff700 1 -- 172.21.15.59:0/888106765 learned_addr learned my addr 172.21.15.59:0/888106765 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:29.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.349+0000 7f815bfff700 1 -- 172.21.15.59:0/888106765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f815c0a1510 msgr2=0x7f815c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:29.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.349+0000 7f815bfff700 1 --2- 172.21.15.59:0/888106765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f815c0a1510 0x7f815c138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.349+0000 7f815bfff700 1 -- 172.21.15.59:0/888106765 >> v1:172.21.15.59:6789/0 conn(0x7f815c0a0a30 legacy=0x7f815c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.349+0000 7f815bfff700 1 -- 172.21.15.59:0/888106765 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c09dc50 con 0x7f815c139250 2023-09-30T22:36:29.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.349+0000 7f815affd700 1 --2- 172.21.15.59:0/888106765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f815c0a1510 0x7f815c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:29.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.349+0000 7f815bfff700 1 --2- 172.21.15.59:0/888106765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f815c139250 0x7f815c13b630 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f8154009e80 tx=0x7f815400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647b5f1b2d55fe1e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:29.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.349+0000 7f815a7fc700 1 -- 172.21.15.59:0/888106765 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815400e070 con 0x7f815c139250 2023-09-30T22:36:29.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.349+0000 7f815a7fc700 1 -- 172.21.15.59:0/888106765 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815400b8d0 con 0x7f815c139250 2023-09-30T22:36:29.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.349+0000 7f815a7fc700 1 -- 172.21.15.59:0/888106765 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815400bc80 con 0x7f815c139250 2023-09-30T22:36:29.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.350+0000 7f8161b9f700 1 -- 172.21.15.59:0/888106765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f815c139250 msgr2=0x7f815c13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.350+0000 7f8161b9f700 1 --2- 172.21.15.59:0/888106765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f815c139250 0x7f815c13b630 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f8154009e80 tx=0x7f815400b330 comp rx=0 tx=0).stop 2023-09-30T22:36:29.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.350+0000 7f8161b9f700 1 -- 172.21.15.59:0/888106765 shutdown_connections 2023-09-30T22:36:29.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.350+0000 7f8161b9f700 1 --2- 172.21.15.59:0/888106765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f815c139250 0x7f815c13b630 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.350+0000 7f8161b9f700 1 --2- 172.21.15.59:0/888106765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f815c0a1510 0x7f815c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.350+0000 7f8161b9f700 1 -- 172.21.15.59:0/888106765 >> 172.21.15.59:0/888106765 conn(0x7f815c0a6550 msgr2=0x7f815c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:29.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.350+0000 7f8161b9f700 1 -- 172.21.15.59:0/888106765 shutdown_connections 2023-09-30T22:36:29.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.350+0000 7f8161b9f700 1 -- 172.21.15.59:0/888106765 wait complete. 2023-09-30T22:36:29.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.351+0000 7f8161b9f700 1 Processor -- start 2023-09-30T22:36:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.351+0000 7f8161b9f700 1 -- start start 2023-09-30T22:36:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f8161b9f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f815c0a0a30 0x7f815c122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f8161b9f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f815c0a1510 0x7f815c122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f8161b9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f815c139250 0x7f815c1233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f8161b9f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c138250 con 0x7f815c139250 2023-09-30T22:36:29.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f8161b9f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815c138810 con 0x7f815c0a0a30 2023-09-30T22:36:29.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f8161b9f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f815c124640 con 0x7f815c0a1510 2023-09-30T22:36:29.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f815affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f815c0a1510 0x7f815c122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f815bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f815c139250 0x7f815c1233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f815affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f815c0a1510 0x7f815c122e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35012/0 (socket says 172.21.15.59:35012) 2023-09-30T22:36:29.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f815affd700 1 -- 172.21.15.59:0/3703550345 learned_addr learned my addr 172.21.15.59:0/3703550345 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:29.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f815b7fe700 1 --2- 172.21.15.59:0/3703550345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f815c0a0a30 0x7f815c122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f815affd700 1 -- 172.21.15.59:0/3703550345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f815c0a0a30 msgr2=0x7f815c122920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f815affd700 1 --2- 172.21.15.59:0/3703550345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f815c0a0a30 0x7f815c122920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f815affd700 1 -- 172.21.15.59:0/3703550345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f815c139250 msgr2=0x7f815c1233a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f815affd700 1 --2- 172.21.15.59:0/3703550345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f815c139250 0x7f815c1233a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f815affd700 1 -- 172.21.15.59:0/3703550345 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81500094a0 con 0x7f815c0a1510 2023-09-30T22:36:29.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f815bfff700 1 --2- 172.21.15.59:0/3703550345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f815c139250 0x7f815c1233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:29.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.352+0000 7f815affd700 1 --2- 172.21.15.59:0/3703550345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f815c0a1510 0x7f815c122e60 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f815000ebe0 tx=0x7f815000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:29.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.353+0000 7f8143fff700 1 -- 172.21.15.59:0/3703550345 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815000c850 con 0x7f815c0a1510 2023-09-30T22:36:29.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.353+0000 7f8143fff700 1 -- 172.21.15.59:0/3703550345 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815000c9b0 con 0x7f815c0a1510 2023-09-30T22:36:29.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.353+0000 7f8161b9f700 1 -- 172.21.15.59:0/3703550345 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8154009b30 con 0x7f815c0a1510 2023-09-30T22:36:29.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.353+0000 7f8143fff700 1 -- 172.21.15.59:0/3703550345 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815000cd40 con 0x7f815c0a1510 2023-09-30T22:36:29.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.353+0000 7f8161b9f700 1 -- 172.21.15.59:0/3703550345 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815c125ef0 con 0x7f815c0a1510 2023-09-30T22:36:29.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.354+0000 7f8143fff700 1 -- 172.21.15.59:0/3703550345 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8150013470 con 0x7f815c0a1510 2023-09-30T22:36:29.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.354+0000 7f8143fff700 1 -- 172.21.15.59:0/3703550345 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f815003fb50 con 0x7f815c0a1510 2023-09-30T22:36:29.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.354+0000 7f8161b9f700 1 -- 172.21.15.59:0/3703550345 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815c074ea0 con 0x7f815c0a1510 2023-09-30T22:36:29.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.359+0000 7f8143fff700 1 -- 172.21.15.59:0/3703550345 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8150017020 con 0x7f815c0a1510 2023-09-30T22:36:29.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.386+0000 7f9113ce9700 1 Processor -- start 2023-09-30T22:36:29.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.387+0000 7f9113ce9700 1 -- start start 2023-09-30T22:36:29.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.387+0000 7f9113ce9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910c0a0a30 0x7f910c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.387+0000 7f9113ce9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f910c09d630 0x7f910c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.387+0000 7f9113ce9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910c133930 0x7f910c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.387+0000 7f9113ce9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910c0a2a70 con 0x7f910c09d630 2023-09-30T22:36:29.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.387+0000 7f9113ce9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0a01d0 con 0x7f910c133930 2023-09-30T22:36:29.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.387+0000 7f9113ce9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f910c09e2b0 con 0x7f910c0a0a30 2023-09-30T22:36:29.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.387+0000 7f9111a85700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910c0a0a30 0x7f910c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.387+0000 7f9111a85700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910c0a0a30 0x7f910c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35028/0 (socket says 172.21.15.59:35028) 2023-09-30T22:36:29.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.387+0000 7f9111284700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f910c09d630 0x7f910c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.387+0000 7f9111a85700 1 -- 172.21.15.59:0/3318097250 learned_addr learned my addr 172.21.15.59:0/3318097250 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:29.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.387+0000 7f9112286700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910c133930 0x7f910c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.388+0000 7f9111a85700 1 -- 172.21.15.59:0/3318097250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910c133930 msgr2=0x7f910c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:29.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.388+0000 7f9111a85700 1 --2- 172.21.15.59:0/3318097250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910c133930 0x7f910c133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.388+0000 7f9111a85700 1 -- 172.21.15.59:0/3318097250 >> v2:172.21.15.59:3300/0 conn(0x7f910c09d630 msgr2=0x7f910c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:29.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.388+0000 7f9111a85700 1 --2- 172.21.15.59:0/3318097250 >> v2:172.21.15.59:3300/0 conn(0x7f910c09d630 0x7f910c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.388+0000 7f9111a85700 1 -- 172.21.15.59:0/3318097250 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c09dc50 con 0x7f910c0a0a30 2023-09-30T22:36:29.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.388+0000 7f9111284700 1 --2- 172.21.15.59:0/3318097250 >> v2:172.21.15.59:3300/0 conn(0x7f910c09d630 0x7f910c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.388+0000 7f9112286700 1 --2- 172.21.15.59:0/3318097250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910c133930 0x7f910c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.388+0000 7f9111a85700 1 --2- 172.21.15.59:0/3318097250 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910c0a0a30 0x7f910c0a0e00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f91040098f0 tx=0x7f9104009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27b45f2246d291da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.388+0000 7f9110a83700 1 -- 172.21.15.59:0/3318097250 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104011830 con 0x7f910c0a0a30 2023-09-30T22:36:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.388+0000 7f9110a83700 1 -- 172.21.15.59:0/3318097250 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9104011990 con 0x7f910c0a0a30 2023-09-30T22:36:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.388+0000 7f9110a83700 1 -- 172.21.15.59:0/3318097250 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104011d20 con 0x7f910c0a0a30 2023-09-30T22:36:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.389+0000 7f9113ce9700 1 -- 172.21.15.59:0/3318097250 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910c0a0a30 msgr2=0x7f910c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.389+0000 7f9113ce9700 1 --2- 172.21.15.59:0/3318097250 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910c0a0a30 0x7f910c0a0e00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f91040098f0 tx=0x7f9104009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:29.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.389+0000 7f9113ce9700 1 -- 172.21.15.59:0/3318097250 shutdown_connections 2023-09-30T22:36:29.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.389+0000 7f9113ce9700 1 --2- 172.21.15.59:0/3318097250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910c133930 0x7f910c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.389+0000 7f9113ce9700 1 --2- 172.21.15.59:0/3318097250 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910c0a0a30 0x7f910c0a0e00 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.389+0000 7f9113ce9700 1 --2- 172.21.15.59:0/3318097250 >> v2:172.21.15.59:3300/0 conn(0x7f910c09d630 0x7f910c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.389+0000 7f9113ce9700 1 -- 172.21.15.59:0/3318097250 >> 172.21.15.59:0/3318097250 conn(0x7f910c0a3050 msgr2=0x7f910c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:29.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.389+0000 7f9113ce9700 1 -- 172.21.15.59:0/3318097250 shutdown_connections 2023-09-30T22:36:29.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.389+0000 7f9113ce9700 1 -- 172.21.15.59:0/3318097250 wait complete. 2023-09-30T22:36:29.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.390+0000 7f9113ce9700 1 Processor -- start 2023-09-30T22:36:29.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.390+0000 7f9113ce9700 1 -- start start 2023-09-30T22:36:29.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.390+0000 7f9113ce9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910c09d630 0x7f910c11f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9113ce9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910c0a0a30 0x7f910c11f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9113ce9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910c133930 0x7f910c1c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9113ce9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c120940 con 0x7f910c0a0a30 2023-09-30T22:36:29.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9113ce9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c120750 con 0x7f910c09d630 2023-09-30T22:36:29.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9113ce9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f910c1334d0 con 0x7f910c133930 2023-09-30T22:36:29.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9112286700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910c133930 0x7f910c1c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9111284700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910c0a0a30 0x7f910c11f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9111a85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910c09d630 0x7f910c11f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9112286700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910c133930 0x7f910c1c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35034/0 (socket says 172.21.15.59:35034) 2023-09-30T22:36:29.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9112286700 1 -- 172.21.15.59:0/1226253020 learned_addr learned my addr 172.21.15.59:0/1226253020 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:29.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9111284700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910c0a0a30 0x7f910c11f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40954/0 (socket says 172.21.15.59:40954) 2023-09-30T22:36:29.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9111a85700 1 -- 172.21.15.59:0/1226253020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910c133930 msgr2=0x7f910c1c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9111a85700 1 --2- 172.21.15.59:0/1226253020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910c133930 0x7f910c1c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9111a85700 1 -- 172.21.15.59:0/1226253020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910c0a0a30 msgr2=0x7f910c11f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9111a85700 1 --2- 172.21.15.59:0/1226253020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910c0a0a30 0x7f910c11f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9111a85700 1 -- 172.21.15.59:0/1226253020 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91000094a0 con 0x7f910c09d630 2023-09-30T22:36:29.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9112286700 1 --2- 172.21.15.59:0/1226253020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910c133930 0x7f910c1c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:29.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9111a85700 1 --2- 172.21.15.59:0/1226253020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910c09d630 0x7f910c11f480 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f9104016000 tx=0x7f9104004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:29.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f910a7fc700 1 -- 172.21.15.59:0/1226253020 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104004240 con 0x7f910c09d630 2023-09-30T22:36:29.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f910a7fc700 1 -- 172.21.15.59:0/1226253020 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910401f070 con 0x7f910c09d630 2023-09-30T22:36:29.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f9113ce9700 1 -- 172.21.15.59:0/1226253020 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90fc009a70 con 0x7f910c09d630 2023-09-30T22:36:29.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.391+0000 7f910a7fc700 1 -- 172.21.15.59:0/1226253020 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91040045e0 con 0x7f910c09d630 2023-09-30T22:36:29.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.392+0000 7f9113ce9700 1 -- 172.21.15.59:0/1226253020 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9104009550 con 0x7f910c09d630 2023-09-30T22:36:29.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.392+0000 7f910a7fc700 1 -- 172.21.15.59:0/1226253020 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9104021030 con 0x7f910c09d630 2023-09-30T22:36:29.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.393+0000 7f910a7fc700 1 -- 172.21.15.59:0/1226253020 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f91040407e0 con 0x7f910c09d630 2023-09-30T22:36:29.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.393+0000 7f9113ce9700 1 -- 172.21.15.59:0/1226253020 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f910c0747f0 con 0x7f910c09d630 2023-09-30T22:36:29.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.402+0000 7f910a7fc700 1 -- 172.21.15.59:0/1226253020 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9104015020 con 0x7f910c09d630 2023-09-30T22:36:29.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.573+0000 7f8161b9f700 1 -- 172.21.15.59:0/3703550345 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f815c0a28e0 con 0x7f815c0a1510 2023-09-30T22:36:29.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.573+0000 7f8143fff700 1 -- 172.21.15.59:0/3703550345 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f815000cea0 con 0x7f815c0a1510 2023-09-30T22:36:29.573 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:29.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.575+0000 7f8161b9f700 1 -- 172.21.15.59:0/3703550345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f815c0a1510 msgr2=0x7f815c122e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.575+0000 7f8161b9f700 1 --2- 172.21.15.59:0/3703550345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f815c0a1510 0x7f815c122e60 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f815000ebe0 tx=0x7f815000eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.575+0000 7f8161b9f700 1 -- 172.21.15.59:0/3703550345 shutdown_connections 2023-09-30T22:36:29.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.575+0000 7f8161b9f700 1 --2- 172.21.15.59:0/3703550345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f815c139250 0x7f815c1233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.575+0000 7f8161b9f700 1 --2- 172.21.15.59:0/3703550345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f815c0a0a30 0x7f815c122920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.575+0000 7f8161b9f700 1 --2- 172.21.15.59:0/3703550345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f815c0a1510 0x7f815c122e60 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.575+0000 7f8161b9f700 1 -- 172.21.15.59:0/3703550345 >> 172.21.15.59:0/3703550345 conn(0x7f815c0a6550 msgr2=0x7f815c0a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:29.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.576+0000 7f8161b9f700 1 -- 172.21.15.59:0/3703550345 shutdown_connections 2023-09-30T22:36:29.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.576+0000 7f8161b9f700 1 -- 172.21.15.59:0/3703550345 wait complete. 2023-09-30T22:36:29.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:29.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.611+0000 7f9113ce9700 1 -- 172.21.15.59:0/1226253020 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f910c120f40 con 0x7f910c09d630 2023-09-30T22:36:29.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.611+0000 7f910a7fc700 1 -- 172.21.15.59:0/1226253020 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f910401a450 con 0x7f910c09d630 2023-09-30T22:36:29.612 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:29.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.614+0000 7f9113ce9700 1 -- 172.21.15.59:0/1226253020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910c09d630 msgr2=0x7f910c11f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.614+0000 7f9113ce9700 1 --2- 172.21.15.59:0/1226253020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910c09d630 0x7f910c11f480 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f9104016000 tx=0x7f9104004750 comp rx=0 tx=0).stop 2023-09-30T22:36:29.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.614+0000 7f9113ce9700 1 -- 172.21.15.59:0/1226253020 shutdown_connections 2023-09-30T22:36:29.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.614+0000 7f9113ce9700 1 --2- 172.21.15.59:0/1226253020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910c133930 0x7f910c1c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.614+0000 7f9113ce9700 1 --2- 172.21.15.59:0/1226253020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910c09d630 0x7f910c11f480 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.614+0000 7f9113ce9700 1 --2- 172.21.15.59:0/1226253020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910c0a0a30 0x7f910c11f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.614+0000 7f9113ce9700 1 -- 172.21.15.59:0/1226253020 >> 172.21.15.59:0/1226253020 conn(0x7f910c0a3050 msgr2=0x7f910c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:29.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.614+0000 7f9113ce9700 1 -- 172.21.15.59:0/1226253020 shutdown_connections 2023-09-30T22:36:29.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.614+0000 7f9113ce9700 1 -- 172.21.15.59:0/1226253020 wait complete. 2023-09-30T22:36:29.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:29.659 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:29.697 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:29.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.810+0000 7f16bba93700 1 Processor -- start 2023-09-30T22:36:29.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.810+0000 7f16bba93700 1 -- start start 2023-09-30T22:36:29.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.811+0000 7f16bba93700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b40a0a30 0x7f16b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.811+0000 7f16bba93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b409d630 0x7f16b40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.811+0000 7f16bba93700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b40a2a70 con 0x7f16b4133930 2023-09-30T22:36:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.811+0000 7f16bba93700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40a01d0 con 0x7f16b40a0a30 2023-09-30T22:36:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.811+0000 7f16bba93700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16b409e2b0 con 0x7f16b409d630 2023-09-30T22:36:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.811+0000 7f16b982f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b40a0a30 0x7f16b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.811+0000 7f16b902e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b409d630 0x7f16b40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.811+0000 7f16ba030700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f16b4133930 0x7f16b4133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59138/0 (socket says 172.21.15.59:59138) 2023-09-30T22:36:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.811+0000 7f16ba030700 1 -- 172.21.15.59:0/3682629705 learned_addr learned my addr 172.21.15.59:0/3682629705 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.811+0000 7f16b902e700 1 -- 172.21.15.59:0/3682629705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b40a0a30 msgr2=0x7f16b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.811+0000 7f16b902e700 1 --2- 172.21.15.59:0/3682629705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b40a0a30 0x7f16b40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.811+0000 7f16b902e700 1 -- 172.21.15.59:0/3682629705 >> v1:172.21.15.59:6789/0 conn(0x7f16b4133930 legacy=0x7f16b4133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.811+0000 7f16b882d700 1 -- 172.21.15.59:0/3682629705 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988607163 0 0) 0x7f16b40a2a70 con 0x7f16b4133930 2023-09-30T22:36:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.811+0000 7f16b902e700 1 -- 172.21.15.59:0/3682629705 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b409dc50 con 0x7f16b409d630 2023-09-30T22:36:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.811+0000 7f16b982f700 1 --2- 172.21.15.59:0/3682629705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b40a0a30 0x7f16b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.812+0000 7f16b902e700 1 --2- 172.21.15.59:0/3682629705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b409d630 0x7f16b40a1340 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009870 tx=0x7f16a4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5689ccd187a5c86c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.812+0000 7f16b882d700 1 -- 172.21.15.59:0/3682629705 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a4011830 con 0x7f16b409d630 2023-09-30T22:36:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.812+0000 7f16b882d700 1 -- 172.21.15.59:0/3682629705 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a4011990 con 0x7f16b409d630 2023-09-30T22:36:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.812+0000 7f16b882d700 1 -- 172.21.15.59:0/3682629705 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a4011d20 con 0x7f16b409d630 2023-09-30T22:36:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.813+0000 7f16bba93700 1 -- 172.21.15.59:0/3682629705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b409d630 msgr2=0x7f16b40a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.813+0000 7f16bba93700 1 --2- 172.21.15.59:0/3682629705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b409d630 0x7f16b40a1340 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009870 tx=0x7f16a4009b80 comp rx=0 tx=0).stop 2023-09-30T22:36:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.813+0000 7f16bba93700 1 -- 172.21.15.59:0/3682629705 shutdown_connections 2023-09-30T22:36:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.813+0000 7f16bba93700 1 --2- 172.21.15.59:0/3682629705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b40a0a30 0x7f16b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.813+0000 7f16bba93700 1 --2- 172.21.15.59:0/3682629705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b409d630 0x7f16b40a1340 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.813+0000 7f16bba93700 1 -- 172.21.15.59:0/3682629705 >> 172.21.15.59:0/3682629705 conn(0x7f16b40a3050 msgr2=0x7f16b40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.813+0000 7f16bba93700 1 -- 172.21.15.59:0/3682629705 shutdown_connections 2023-09-30T22:36:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.813+0000 7f16bba93700 1 -- 172.21.15.59:0/3682629705 wait complete. 2023-09-30T22:36:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.814+0000 7f16bba93700 1 Processor -- start 2023-09-30T22:36:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.814+0000 7f16bba93700 1 -- start start 2023-09-30T22:36:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.814+0000 7f16bba93700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b409d630 0x7f16b411f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.814+0000 7f16bba93700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b40a0a30 0x7f16b411f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.814+0000 7f16bba93700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b4133930 0x7f16b41c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.814+0000 7f16bba93700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b411ed60 con 0x7f16b409d630 2023-09-30T22:36:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.814+0000 7f16bba93700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b41224a0 con 0x7f16b4133930 2023-09-30T22:36:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.814+0000 7f16bba93700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16b4120490 con 0x7f16b40a0a30 2023-09-30T22:36:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.814+0000 7f16b902e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b40a0a30 0x7f16b411f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.814+0000 7f16b982f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b409d630 0x7f16b411f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.814+0000 7f16b902e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b40a0a30 0x7f16b411f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35044/0 (socket says 172.21.15.59:35044) 2023-09-30T22:36:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.814+0000 7f16b902e700 1 -- 172.21.15.59:0/177605062 learned_addr learned my addr 172.21.15.59:0/177605062 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.814+0000 7f16ba030700 1 --2- 172.21.15.59:0/177605062 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b4133930 0x7f16b41c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.815+0000 7f16b902e700 1 -- 172.21.15.59:0/177605062 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b4133930 msgr2=0x7f16b41c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.815+0000 7f16b902e700 1 --2- 172.21.15.59:0/177605062 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b4133930 0x7f16b41c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.815+0000 7f16b902e700 1 -- 172.21.15.59:0/177605062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b409d630 msgr2=0x7f16b411f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.815+0000 7f16b902e700 1 --2- 172.21.15.59:0/177605062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b409d630 0x7f16b411f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.815+0000 7f16b902e700 1 -- 172.21.15.59:0/177605062 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b00094a0 con 0x7f16b40a0a30 2023-09-30T22:36:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.815+0000 7f16b982f700 1 --2- 172.21.15.59:0/177605062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b409d630 0x7f16b411f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.815+0000 7f16b902e700 1 --2- 172.21.15.59:0/177605062 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b40a0a30 0x7f16b411f820 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f16a40090b0 tx=0x7f16a4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.815+0000 7f16aa7fc700 1 -- 172.21.15.59:0/177605062 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a4004300 con 0x7f16b40a0a30 2023-09-30T22:36:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.815+0000 7f16aa7fc700 1 -- 172.21.15.59:0/177605062 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a401f070 con 0x7f16b40a0a30 2023-09-30T22:36:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.815+0000 7f16bba93700 1 -- 172.21.15.59:0/177605062 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a40094a0 con 0x7f16b40a0a30 2023-09-30T22:36:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.815+0000 7f16aa7fc700 1 -- 172.21.15.59:0/177605062 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a40036a0 con 0x7f16b40a0a30 2023-09-30T22:36:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.815+0000 7f16bba93700 1 -- 172.21.15.59:0/177605062 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b40a0410 con 0x7f16b40a0a30 2023-09-30T22:36:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.816+0000 7f16aa7fc700 1 -- 172.21.15.59:0/177605062 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16a4021030 con 0x7f16b40a0a30 2023-09-30T22:36:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.816+0000 7f16aa7fc700 1 -- 172.21.15.59:0/177605062 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f16a4040610 con 0x7f16b40a0a30 2023-09-30T22:36:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.816+0000 7f16bba93700 1 -- 172.21.15.59:0/177605062 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b41222e0 con 0x7f16b40a0a30 2023-09-30T22:36:29.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.822+0000 7f16aa7fc700 1 -- 172.21.15.59:0/177605062 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16b41222e0 con 0x7f16b40a0a30 2023-09-30T22:36:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.851+0000 7f8583cb0700 1 Processor -- start 2023-09-30T22:36:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.852+0000 7f8583cb0700 1 -- start start 2023-09-30T22:36:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.852+0000 7f8583cb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857c0a0a30 0x7f857c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.852+0000 7f8583cb0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f857c09d630 0x7f857c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.852+0000 7f8583cb0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857c0a2a70 con 0x7f857c133930 2023-09-30T22:36:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.852+0000 7f8583cb0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857c0a01d0 con 0x7f857c09d630 2023-09-30T22:36:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.852+0000 7f8583cb0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c09e2b0 con 0x7f857c0a0a30 2023-09-30T22:36:29.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.852+0000 7f8581a4c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857c0a0a30 0x7f857c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.852+0000 7f858124b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f857c09d630 0x7f857c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.852+0000 7f8581a4c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857c0a0a30 0x7f857c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41062/0 (socket says 172.21.15.59:41062) 2023-09-30T22:36:29.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.852+0000 7f8581a4c700 1 -- 172.21.15.59:0/1043085016 learned_addr learned my addr 172.21.15.59:0/1043085016 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:29.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.853+0000 7f858124b700 1 -- 172.21.15.59:0/1043085016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857c0a0a30 msgr2=0x7f857c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:29.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.853+0000 7f858124b700 1 --2- 172.21.15.59:0/1043085016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857c0a0a30 0x7f857c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.853+0000 7f858124b700 1 -- 172.21.15.59:0/1043085016 >> v1:172.21.15.59:6789/0 conn(0x7f857c133930 legacy=0x7f857c133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.853+0000 7f858124b700 1 -- 172.21.15.59:0/1043085016 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c09dc50 con 0x7f857c09d630 2023-09-30T22:36:29.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.853+0000 7f8581a4c700 1 --2- 172.21.15.59:0/1043085016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857c0a0a30 0x7f857c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:29.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.853+0000 7f858124b700 1 --2- 172.21.15.59:0/1043085016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857c09d630 0x7f857c0a1340 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f8570009840 tx=0x7f8570009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8690cca87e97b7c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:29.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.853+0000 7f8580a4a700 1 -- 172.21.15.59:0/1043085016 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570011830 con 0x7f857c09d630 2023-09-30T22:36:29.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.853+0000 7f8580a4a700 1 -- 172.21.15.59:0/1043085016 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8570011990 con 0x7f857c09d630 2023-09-30T22:36:29.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.853+0000 7f8580a4a700 1 -- 172.21.15.59:0/1043085016 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570011d20 con 0x7f857c09d630 2023-09-30T22:36:29.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.854+0000 7f8583cb0700 1 -- 172.21.15.59:0/1043085016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857c09d630 msgr2=0x7f857c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.854+0000 7f8583cb0700 1 --2- 172.21.15.59:0/1043085016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857c09d630 0x7f857c0a1340 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f8570009840 tx=0x7f8570009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.854+0000 7f8583cb0700 1 -- 172.21.15.59:0/1043085016 shutdown_connections 2023-09-30T22:36:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.854+0000 7f8583cb0700 1 --2- 172.21.15.59:0/1043085016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857c0a0a30 0x7f857c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.854+0000 7f8583cb0700 1 --2- 172.21.15.59:0/1043085016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857c09d630 0x7f857c0a1340 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.854+0000 7f8583cb0700 1 -- 172.21.15.59:0/1043085016 >> 172.21.15.59:0/1043085016 conn(0x7f857c0a3050 msgr2=0x7f857c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.854+0000 7f8583cb0700 1 -- 172.21.15.59:0/1043085016 shutdown_connections 2023-09-30T22:36:29.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.854+0000 7f8583cb0700 1 -- 172.21.15.59:0/1043085016 wait complete. 2023-09-30T22:36:29.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.855+0000 7f8583cb0700 1 Processor -- start 2023-09-30T22:36:29.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.855+0000 7f8583cb0700 1 -- start start 2023-09-30T22:36:29.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.856+0000 7f8583cb0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857c09d630 0x7f857c11f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.856+0000 7f8583cb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857c0a0a30 0x7f857c11faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.856+0000 7f8583cb0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f857c133930 0x7f857c1c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:29.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.856+0000 7f8583cb0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c11f160 con 0x7f857c09d630 2023-09-30T22:36:29.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.856+0000 7f8583cb0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c120030 con 0x7f857c0a0a30 2023-09-30T22:36:29.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.856+0000 7f8583cb0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0a0410 con 0x7f857c133930 2023-09-30T22:36:29.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.856+0000 7f8581a4c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857c09d630 0x7f857c11f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.856+0000 7f8581a4c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857c09d630 0x7f857c11f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40980/0 (socket says 172.21.15.59:40980) 2023-09-30T22:36:29.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.856+0000 7f858224d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f857c133930 0x7f857c1c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.856+0000 7f8581a4c700 1 -- 172.21.15.59:0/2844718818 learned_addr learned my addr 172.21.15.59:0/2844718818 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:29.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.856+0000 7f858124b700 1 --2- 172.21.15.59:0/2844718818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857c0a0a30 0x7f857c11faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:29.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.856+0000 7f8581a4c700 1 -- 172.21.15.59:0/2844718818 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f857c133930 msgr2=0x7f857c1c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.856+0000 7f8581a4c700 1 --2- 172.21.15.59:0/2844718818 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f857c133930 0x7f857c1c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.857+0000 7f8581a4c700 1 -- 172.21.15.59:0/2844718818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857c0a0a30 msgr2=0x7f857c11faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:29.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.857+0000 7f8581a4c700 1 --2- 172.21.15.59:0/2844718818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857c0a0a30 0x7f857c11faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:29.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.857+0000 7f8581a4c700 1 -- 172.21.15.59:0/2844718818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8574009550 con 0x7f857c09d630 2023-09-30T22:36:29.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.857+0000 7f8581a4c700 1 --2- 172.21.15.59:0/2844718818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857c09d630 0x7f857c11f5b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f857400ebe0 tx=0x7f857400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:29.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.857+0000 7f857a7fc700 1 -- 172.21.15.59:0/2844718818 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857400c850 con 0x7f857c09d630 2023-09-30T22:36:29.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.857+0000 7f857a7fc700 1 -- 172.21.15.59:0/2844718818 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857400c9b0 con 0x7f857c09d630 2023-09-30T22:36:29.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.857+0000 7f8583cb0700 1 -- 172.21.15.59:0/2844718818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85700094a0 con 0x7f857c09d630 2023-09-30T22:36:29.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.857+0000 7f857a7fc700 1 -- 172.21.15.59:0/2844718818 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857400cd40 con 0x7f857c09d630 2023-09-30T22:36:29.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.857+0000 7f8583cb0700 1 -- 172.21.15.59:0/2844718818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857c122dd0 con 0x7f857c09d630 2023-09-30T22:36:29.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.858+0000 7f857a7fc700 1 -- 172.21.15.59:0/2844718818 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8574013470 con 0x7f857c09d630 2023-09-30T22:36:29.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.858+0000 7f8583cb0700 1 -- 172.21.15.59:0/2844718818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857c1221b0 con 0x7f857c09d630 2023-09-30T22:36:29.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.858+0000 7f857a7fc700 1 -- 172.21.15.59:0/2844718818 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f857403f840 con 0x7f857c09d630 2023-09-30T22:36:29.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:29.863+0000 7f857a7fc700 1 -- 172.21.15.59:0/2844718818 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8574017080 con 0x7f857c09d630 2023-09-30T22:36:30.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.029+0000 7f16bba93700 1 -- 172.21.15.59:0/177605062 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f16b41222e0 con 0x7f16b40a0a30 2023-09-30T22:36:30.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.029+0000 7f16aa7fc700 1 -- 172.21.15.59:0/177605062 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16b41222e0 con 0x7f16b40a0a30 2023-09-30T22:36:30.030 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:30.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.032+0000 7f16bba93700 1 -- 172.21.15.59:0/177605062 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b40a0a30 msgr2=0x7f16b411f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:30.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.032+0000 7f16bba93700 1 --2- 172.21.15.59:0/177605062 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b40a0a30 0x7f16b411f820 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f16a40090b0 tx=0x7f16a4004750 comp rx=0 tx=0).stop 2023-09-30T22:36:30.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.032+0000 7f16bba93700 1 -- 172.21.15.59:0/177605062 shutdown_connections 2023-09-30T22:36:30.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.032+0000 7f16bba93700 1 --2- 172.21.15.59:0/177605062 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b4133930 0x7f16b41c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.032+0000 7f16bba93700 1 --2- 172.21.15.59:0/177605062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b409d630 0x7f16b411f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.032+0000 7f16bba93700 1 --2- 172.21.15.59:0/177605062 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b40a0a30 0x7f16b411f820 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.032+0000 7f16bba93700 1 -- 172.21.15.59:0/177605062 >> 172.21.15.59:0/177605062 conn(0x7f16b40a3050 msgr2=0x7f16b41bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:30.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.032+0000 7f16bba93700 1 -- 172.21.15.59:0/177605062 shutdown_connections 2023-09-30T22:36:30.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.032+0000 7f16bba93700 1 -- 172.21.15.59:0/177605062 wait complete. 2023-09-30T22:36:30.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:30.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.074+0000 7f8583cb0700 1 -- 172.21.15.59:0/2844718818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f857c0747f0 con 0x7f857c09d630 2023-09-30T22:36:30.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.074+0000 7f857a7fc700 1 -- 172.21.15.59:0/2844718818 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8574021030 con 0x7f857c09d630 2023-09-30T22:36:30.074 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:30.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.077+0000 7f8583cb0700 1 -- 172.21.15.59:0/2844718818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857c09d630 msgr2=0x7f857c11f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:30.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.077+0000 7f8583cb0700 1 --2- 172.21.15.59:0/2844718818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857c09d630 0x7f857c11f5b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f857400ebe0 tx=0x7f857400eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.077+0000 7f8583cb0700 1 -- 172.21.15.59:0/2844718818 shutdown_connections 2023-09-30T22:36:30.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.077+0000 7f8583cb0700 1 --2- 172.21.15.59:0/2844718818 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f857c133930 0x7f857c1c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.077+0000 7f8583cb0700 1 --2- 172.21.15.59:0/2844718818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857c09d630 0x7f857c11f5b0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.077+0000 7f8583cb0700 1 --2- 172.21.15.59:0/2844718818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857c0a0a30 0x7f857c11faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.077+0000 7f8583cb0700 1 -- 172.21.15.59:0/2844718818 >> 172.21.15.59:0/2844718818 conn(0x7f857c0a3050 msgr2=0x7f857c1bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:30.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.077+0000 7f8583cb0700 1 -- 172.21.15.59:0/2844718818 shutdown_connections 2023-09-30T22:36:30.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.077+0000 7f8583cb0700 1 -- 172.21.15.59:0/2844718818 wait complete. 2023-09-30T22:36:30.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:30.590 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:30.628 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:30.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.739+0000 7f02c0672700 1 Processor -- start 2023-09-30T22:36:30.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.739+0000 7f02c0672700 1 -- start start 2023-09-30T22:36:30.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.740+0000 7f02c0672700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b80a0a30 0x7f02b80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:30.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.740+0000 7f02c0672700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02b809d630 0x7f02b80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:30.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.740+0000 7f02c0672700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02b8133930 0x7f02b8133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:30.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.740+0000 7f02c0672700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b80a2a70 con 0x7f02b8133930 2023-09-30T22:36:30.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.740+0000 7f02c0672700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b80a01d0 con 0x7f02b80a0a30 2023-09-30T22:36:30.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.740+0000 7f02c0672700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02b809e2b0 con 0x7f02b809d630 2023-09-30T22:36:30.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02be40e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b80a0a30 0x7f02b80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:30.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02bec0f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02b8133930 0x7f02b8133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:30.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02bdc0d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02b809d630 0x7f02b80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:30.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02bdc0d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02b809d630 0x7f02b80a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35068/0 (socket says 172.21.15.59:35068) 2023-09-30T22:36:30.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02bec0f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02b8133930 0x7f02b8133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40996/0 (socket says 172.21.15.59:40996) 2023-09-30T22:36:30.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02be40e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b80a0a30 0x7f02b80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41084/0 (socket says 172.21.15.59:41084) 2023-09-30T22:36:30.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02bdc0d700 1 -- 172.21.15.59:0/2675896928 learned_addr learned my addr 172.21.15.59:0/2675896928 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:30.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02be40e700 1 -- 172.21.15.59:0/2675896928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02b809d630 msgr2=0x7f02b80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:30.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02be40e700 1 --2- 172.21.15.59:0/2675896928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02b809d630 0x7f02b80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02be40e700 1 -- 172.21.15.59:0/2675896928 >> v2:172.21.15.59:3300/0 conn(0x7f02b8133930 msgr2=0x7f02b8133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:30.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02be40e700 1 --2- 172.21.15.59:0/2675896928 >> v2:172.21.15.59:3300/0 conn(0x7f02b8133930 0x7f02b8133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02be40e700 1 -- 172.21.15.59:0/2675896928 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b809dc50 con 0x7f02b80a0a30 2023-09-30T22:36:30.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02bec0f700 1 --2- 172.21.15.59:0/2675896928 >> v2:172.21.15.59:3300/0 conn(0x7f02b8133930 0x7f02b8133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:30.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02bdc0d700 1 --2- 172.21.15.59:0/2675896928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02b809d630 0x7f02b80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:30.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02be40e700 1 --2- 172.21.15.59:0/2675896928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b80a0a30 0x7f02b80a0e00 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009d90 tx=0x7f02b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c417b116ce7b0da2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:30.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02bd40c700 1 -- 172.21.15.59:0/2675896928 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b000e070 con 0x7f02b80a0a30 2023-09-30T22:36:30.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02bd40c700 1 -- 172.21.15.59:0/2675896928 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b000bb20 con 0x7f02b80a0a30 2023-09-30T22:36:30.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.741+0000 7f02bd40c700 1 -- 172.21.15.59:0/2675896928 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b0012430 con 0x7f02b80a0a30 2023-09-30T22:36:30.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.742+0000 7f02c0672700 1 -- 172.21.15.59:0/2675896928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b80a0a30 msgr2=0x7f02b80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:30.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.742+0000 7f02c0672700 1 --2- 172.21.15.59:0/2675896928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b80a0a30 0x7f02b80a0e00 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009d90 tx=0x7f02b000b330 comp rx=0 tx=0).stop 2023-09-30T22:36:30.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.742+0000 7f02c0672700 1 -- 172.21.15.59:0/2675896928 shutdown_connections 2023-09-30T22:36:30.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.742+0000 7f02c0672700 1 --2- 172.21.15.59:0/2675896928 >> v2:172.21.15.59:3300/0 conn(0x7f02b8133930 0x7f02b8133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.742+0000 7f02c0672700 1 --2- 172.21.15.59:0/2675896928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b80a0a30 0x7f02b80a0e00 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.742+0000 7f02c0672700 1 --2- 172.21.15.59:0/2675896928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02b809d630 0x7f02b80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.743+0000 7f02c0672700 1 -- 172.21.15.59:0/2675896928 >> 172.21.15.59:0/2675896928 conn(0x7f02b80a3050 msgr2=0x7f02b80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:30.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.743+0000 7f02c0672700 1 -- 172.21.15.59:0/2675896928 shutdown_connections 2023-09-30T22:36:30.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.743+0000 7f02c0672700 1 -- 172.21.15.59:0/2675896928 wait complete. 2023-09-30T22:36:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.744+0000 7f02c0672700 1 Processor -- start 2023-09-30T22:36:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.744+0000 7f02c0672700 1 -- start start 2023-09-30T22:36:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02c0672700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02b809d630 0x7f02b81c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02c0672700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b80a0a30 0x7f02b81c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02c0672700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02b8133930 0x7f02b81c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02c0672700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b8133260 con 0x7f02b8133930 2023-09-30T22:36:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02c0672700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b81206d0 con 0x7f02b80a0a30 2023-09-30T22:36:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02c0672700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02b80a40c0 con 0x7f02b809d630 2023-09-30T22:36:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02bdc0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b80a0a30 0x7f02b81c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02bec0f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02b8133930 0x7f02b81c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02bdc0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b80a0a30 0x7f02b81c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41088/0 (socket says 172.21.15.59:41088) 2023-09-30T22:36:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02bdc0d700 1 -- 172.21.15.59:0/901338288 learned_addr learned my addr 172.21.15.59:0/901338288 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:30.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02be40e700 1 --2- 172.21.15.59:0/901338288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02b809d630 0x7f02b81c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:30.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02bec0f700 1 -- 172.21.15.59:0/901338288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02b809d630 msgr2=0x7f02b81c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:30.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02bec0f700 1 --2- 172.21.15.59:0/901338288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02b809d630 0x7f02b81c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02bec0f700 1 -- 172.21.15.59:0/901338288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b80a0a30 msgr2=0x7f02b81c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:30.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02bec0f700 1 --2- 172.21.15.59:0/901338288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b80a0a30 0x7f02b81c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02bec0f700 1 -- 172.21.15.59:0/901338288 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac009550 con 0x7f02b8133930 2023-09-30T22:36:30.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02be40e700 1 --2- 172.21.15.59:0/901338288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02b809d630 0x7f02b81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:30.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02bdc0d700 1 --2- 172.21.15.59:0/901338288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b80a0a30 0x7f02b81c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:30.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.745+0000 7f02bec0f700 1 --2- 172.21.15.59:0/901338288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02b8133930 0x7f02b81c8ba0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f02a800e910 tx=0x7f02a800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:30.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.746+0000 7f02b6ffd700 1 -- 172.21.15.59:0/901338288 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a8004020 con 0x7f02b8133930 2023-09-30T22:36:30.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.746+0000 7f02b6ffd700 1 -- 172.21.15.59:0/901338288 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a80041a0 con 0x7f02b8133930 2023-09-30T22:36:30.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.746+0000 7f02c0672700 1 -- 172.21.15.59:0/901338288 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a80094a0 con 0x7f02b8133930 2023-09-30T22:36:30.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.746+0000 7f02b6ffd700 1 -- 172.21.15.59:0/901338288 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a8004550 con 0x7f02b8133930 2023-09-30T22:36:30.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.746+0000 7f02c0672700 1 -- 172.21.15.59:0/901338288 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b0009a70 con 0x7f02b8133930 2023-09-30T22:36:30.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.746+0000 7f02b6ffd700 1 -- 172.21.15.59:0/901338288 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f02a80036a0 con 0x7f02b8133930 2023-09-30T22:36:30.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.747+0000 7f02b6ffd700 1 -- 172.21.15.59:0/901338288 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f02a803f660 con 0x7f02b8133930 2023-09-30T22:36:30.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.747+0000 7f02c0672700 1 -- 172.21.15.59:0/901338288 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b80747f0 con 0x7f02b8133930 2023-09-30T22:36:30.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.752+0000 7f02b6ffd700 1 -- 172.21.15.59:0/901338288 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02a8013680 con 0x7f02b8133930 2023-09-30T22:36:30.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.778+0000 7fe46085a700 1 Processor -- start 2023-09-30T22:36:30.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.778+0000 7fe46085a700 1 -- start start 2023-09-30T22:36:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.778+0000 7fe46085a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe45c0a0a30 0x7fe45c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.778+0000 7fe46085a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe45c138d80 0x7fe45c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.778+0000 7fe46085a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45c0a2a70 con 0x7fe45c09d630 2023-09-30T22:36:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.778+0000 7fe46085a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45c0a01d0 con 0x7fe45c0a0a30 2023-09-30T22:36:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.778+0000 7fe46085a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c09e2b0 con 0x7fe45c138d80 2023-09-30T22:36:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.778+0000 7fe45ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe45c138d80 0x7fe45c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.779+0000 7fe45a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe45c0a0a30 0x7fe45c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.779+0000 7fe45ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe45c138d80 0x7fe45c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41104/0 (socket says 172.21.15.59:41104) 2023-09-30T22:36:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.779+0000 7fe45ad9d700 1 -- 172.21.15.59:0/1487151948 learned_addr learned my addr 172.21.15.59:0/1487151948 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:30.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.779+0000 7fe45959a700 1 -- 172.21.15.59:0/1487151948 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913916970 0 0) 0x7fe45c0a2a70 con 0x7fe45c09d630 2023-09-30T22:36:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.779+0000 7fe45959a700 1 -- 172.21.15.59:0/1487151948 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4480035b0 con 0x7fe45c09d630 2023-09-30T22:36:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.779+0000 7fe45a59c700 1 -- 172.21.15.59:0/1487151948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe45c138d80 msgr2=0x7fe45c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.779+0000 7fe45a59c700 1 --2- 172.21.15.59:0/1487151948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe45c138d80 0x7fe45c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.779+0000 7fe45a59c700 1 -- 172.21.15.59:0/1487151948 >> v1:172.21.15.59:6789/0 conn(0x7fe45c09d630 legacy=0x7fe45c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.779+0000 7fe45a59c700 1 -- 172.21.15.59:0/1487151948 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c09dc50 con 0x7fe45c0a0a30 2023-09-30T22:36:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.779+0000 7fe45ad9d700 1 --2- 172.21.15.59:0/1487151948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe45c138d80 0x7fe45c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.779+0000 7fe45a59c700 1 --2- 172.21.15.59:0/1487151948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45c0a0a30 0x7fe45c0a0e00 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fe454009d90 tx=0x7fe45400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d10632669a043d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.779+0000 7fe45959a700 1 -- 172.21.15.59:0/1487151948 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45400e070 con 0x7fe45c0a0a30 2023-09-30T22:36:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.779+0000 7fe45959a700 1 -- 172.21.15.59:0/1487151948 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45400bb20 con 0x7fe45c0a0a30 2023-09-30T22:36:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.779+0000 7fe45959a700 1 -- 172.21.15.59:0/1487151948 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe454012430 con 0x7fe45c0a0a30 2023-09-30T22:36:30.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.780+0000 7fe46085a700 1 -- 172.21.15.59:0/1487151948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45c0a0a30 msgr2=0x7fe45c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:30.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.780+0000 7fe46085a700 1 --2- 172.21.15.59:0/1487151948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45c0a0a30 0x7fe45c0a0e00 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fe454009d90 tx=0x7fe45400b330 comp rx=0 tx=0).stop 2023-09-30T22:36:30.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.780+0000 7fe46085a700 1 -- 172.21.15.59:0/1487151948 shutdown_connections 2023-09-30T22:36:30.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.780+0000 7fe46085a700 1 --2- 172.21.15.59:0/1487151948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45c0a0a30 0x7fe45c0a0e00 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.780+0000 7fe46085a700 1 --2- 172.21.15.59:0/1487151948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe45c138d80 0x7fe45c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.780+0000 7fe46085a700 1 -- 172.21.15.59:0/1487151948 >> 172.21.15.59:0/1487151948 conn(0x7fe45c0a3050 msgr2=0x7fe45c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:30.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.780+0000 7fe46085a700 1 -- 172.21.15.59:0/1487151948 shutdown_connections 2023-09-30T22:36:30.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.780+0000 7fe46085a700 1 -- 172.21.15.59:0/1487151948 wait complete. 2023-09-30T22:36:30.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.781+0000 7fe46085a700 1 Processor -- start 2023-09-30T22:36:30.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.781+0000 7fe46085a700 1 -- start start 2023-09-30T22:36:30.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe46085a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe45c09d630 0x7fe45c11c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:30.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe46085a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe45c0a0a30 0x7fe45c11cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:30.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe46085a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45c138d80 0x7fe45c11d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:30.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe46085a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c11fb60 con 0x7fe45c138d80 2023-09-30T22:36:30.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe46085a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c11fd60 con 0x7fe45c0a0a30 2023-09-30T22:36:30.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe46085a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c11ec50 con 0x7fe45c09d630 2023-09-30T22:36:30.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe459d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe45c0a0a30 0x7fe45c11cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:30.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe45a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe45c09d630 0x7fe45c11c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:30.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe45ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45c138d80 0x7fe45c11d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:30.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe459d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe45c0a0a30 0x7fe45c11cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41110/0 (socket says 172.21.15.59:41110) 2023-09-30T22:36:30.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe45a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe45c09d630 0x7fe45c11c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35078/0 (socket says 172.21.15.59:35078) 2023-09-30T22:36:30.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe459d9b700 1 -- 172.21.15.59:0/3290533455 learned_addr learned my addr 172.21.15.59:0/3290533455 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:30.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe459d9b700 1 -- 172.21.15.59:0/3290533455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe45c09d630 msgr2=0x7fe45c11c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:30.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe459d9b700 1 --2- 172.21.15.59:0/3290533455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe45c09d630 0x7fe45c11c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe459d9b700 1 -- 172.21.15.59:0/3290533455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45c138d80 msgr2=0x7fe45c11d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:30.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe459d9b700 1 --2- 172.21.15.59:0/3290533455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45c138d80 0x7fe45c11d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe459d9b700 1 -- 172.21.15.59:0/3290533455 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c009550 con 0x7fe45c0a0a30 2023-09-30T22:36:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe45a59c700 1 --2- 172.21.15.59:0/3290533455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe45c09d630 0x7fe45c11c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.782+0000 7fe45ad9d700 1 --2- 172.21.15.59:0/3290533455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45c138d80 0x7fe45c11d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.783+0000 7fe459d9b700 1 --2- 172.21.15.59:0/3290533455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe45c0a0a30 0x7fe45c11cd00 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe44400c520 tx=0x7fe44400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.783+0000 7fe452ffd700 1 -- 172.21.15.59:0/3290533455 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4440052d0 con 0x7fe45c0a0a30 2023-09-30T22:36:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.783+0000 7fe452ffd700 1 -- 172.21.15.59:0/3290533455 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe444005430 con 0x7fe45c0a0a30 2023-09-30T22:36:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.783+0000 7fe46085a700 1 -- 172.21.15.59:0/3290533455 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe454009a70 con 0x7fe45c0a0a30 2023-09-30T22:36:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.783+0000 7fe452ffd700 1 -- 172.21.15.59:0/3290533455 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4440038c0 con 0x7fe45c0a0a30 2023-09-30T22:36:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.783+0000 7fe46085a700 1 -- 172.21.15.59:0/3290533455 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45c09d320 con 0x7fe45c0a0a30 2023-09-30T22:36:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.784+0000 7fe452ffd700 1 -- 172.21.15.59:0/3290533455 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe444003a20 con 0x7fe45c0a0a30 2023-09-30T22:36:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.784+0000 7fe452ffd700 1 -- 172.21.15.59:0/3290533455 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe44403eb10 con 0x7fe45c0a0a30 2023-09-30T22:36:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.784+0000 7fe46085a700 1 -- 172.21.15.59:0/3290533455 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45c0a0470 con 0x7fe45c0a0a30 2023-09-30T22:36:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.789+0000 7fe452ffd700 1 -- 172.21.15.59:0/3290533455 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe444019e60 con 0x7fe45c0a0a30 2023-09-30T22:36:30.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.958+0000 7f02c0672700 1 -- 172.21.15.59:0/901338288 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f02b8072980 con 0x7f02b8133930 2023-09-30T22:36:30.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.959+0000 7f02b6ffd700 1 -- 172.21.15.59:0/901338288 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02a8017020 con 0x7f02b8133930 2023-09-30T22:36:30.959 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:30.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.962+0000 7f02c0672700 1 -- 172.21.15.59:0/901338288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02b8133930 msgr2=0x7f02b81c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.962+0000 7f02c0672700 1 --2- 172.21.15.59:0/901338288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02b8133930 0x7f02b81c8ba0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f02a800e910 tx=0x7f02a800ec20 comp rx=0 tx=0).stop 2023-09-30T22:36:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.962+0000 7f02c0672700 1 -- 172.21.15.59:0/901338288 shutdown_connections 2023-09-30T22:36:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.962+0000 7f02c0672700 1 --2- 172.21.15.59:0/901338288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02b809d630 0x7f02b81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.962+0000 7f02c0672700 1 --2- 172.21.15.59:0/901338288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02b8133930 0x7f02b81c8ba0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.962+0000 7f02c0672700 1 --2- 172.21.15.59:0/901338288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b80a0a30 0x7f02b81c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.962+0000 7f02c0672700 1 -- 172.21.15.59:0/901338288 >> 172.21.15.59:0/901338288 conn(0x7f02b80a3050 msgr2=0x7f02b809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.962+0000 7f02c0672700 1 -- 172.21.15.59:0/901338288 shutdown_connections 2023-09-30T22:36:30.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.962+0000 7f02c0672700 1 -- 172.21.15.59:0/901338288 wait complete. 2023-09-30T22:36:30.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:30.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.997+0000 7fe46085a700 1 -- 172.21.15.59:0/3290533455 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe45c0747f0 con 0x7fe45c0a0a30 2023-09-30T22:36:30.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:30.997+0000 7fe452ffd700 1 -- 172.21.15.59:0/3290533455 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe444019a70 con 0x7fe45c0a0a30 2023-09-30T22:36:30.998 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:31.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.000+0000 7fe46085a700 1 -- 172.21.15.59:0/3290533455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe45c0a0a30 msgr2=0x7fe45c11cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:31.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.000+0000 7fe46085a700 1 --2- 172.21.15.59:0/3290533455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe45c0a0a30 0x7fe45c11cd00 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe44400c520 tx=0x7fe44400c830 comp rx=0 tx=0).stop 2023-09-30T22:36:31.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.000+0000 7fe46085a700 1 -- 172.21.15.59:0/3290533455 shutdown_connections 2023-09-30T22:36:31.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.000+0000 7fe46085a700 1 --2- 172.21.15.59:0/3290533455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe45c09d630 0x7fe45c11c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.000+0000 7fe46085a700 1 --2- 172.21.15.59:0/3290533455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45c138d80 0x7fe45c11d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.000+0000 7fe46085a700 1 --2- 172.21.15.59:0/3290533455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe45c0a0a30 0x7fe45c11cd00 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.000+0000 7fe46085a700 1 -- 172.21.15.59:0/3290533455 >> 172.21.15.59:0/3290533455 conn(0x7fe45c0a3050 msgr2=0x7fe45c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:31.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.000+0000 7fe46085a700 1 -- 172.21.15.59:0/3290533455 shutdown_connections 2023-09-30T22:36:31.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.000+0000 7fe46085a700 1 -- 172.21.15.59:0/3290533455 wait complete. 2023-09-30T22:36:31.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:31.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:31.092 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:31.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.197+0000 7f3f38619700 1 Processor -- start 2023-09-30T22:36:31.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.197+0000 7f3f38619700 1 -- start start 2023-09-30T22:36:31.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.197+0000 7f3f38619700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f300a0a30 0x7f3f300a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:31.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.197+0000 7f3f38619700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f3009d630 0x7f3f300a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:31.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.197+0000 7f3f38619700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f30133930 0x7f3f30133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:31.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.197+0000 7f3f38619700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f300a2a70 con 0x7f3f3009d630 2023-09-30T22:36:31.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.197+0000 7f3f38619700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f300a01d0 con 0x7f3f300a0a30 2023-09-30T22:36:31.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.197+0000 7f3f38619700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3009e2b0 con 0x7f3f30133930 2023-09-30T22:36:31.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.198+0000 7f3f363b5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f300a0a30 0x7f3f300a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:31.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.198+0000 7f3f363b5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f300a0a30 0x7f3f300a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41122/0 (socket says 172.21.15.59:41122) 2023-09-30T22:36:31.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.198+0000 7f3f363b5700 1 -- 172.21.15.59:0/890970567 learned_addr learned my addr 172.21.15.59:0/890970567 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:31.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.198+0000 7f3f36bb6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f30133930 0x7f3f30133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:31.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.198+0000 7f3f35bb4700 1 --2- 172.21.15.59:0/890970567 >> v2:172.21.15.59:3300/0 conn(0x7f3f3009d630 0x7f3f300a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:31.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.198+0000 7f3f36bb6700 1 -- 172.21.15.59:0/890970567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f300a0a30 msgr2=0x7f3f300a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:31.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.198+0000 7f3f36bb6700 1 --2- 172.21.15.59:0/890970567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f300a0a30 0x7f3f300a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.198+0000 7f3f36bb6700 1 -- 172.21.15.59:0/890970567 >> v2:172.21.15.59:3300/0 conn(0x7f3f3009d630 msgr2=0x7f3f300a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:31.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.198+0000 7f3f36bb6700 1 --2- 172.21.15.59:0/890970567 >> v2:172.21.15.59:3300/0 conn(0x7f3f3009d630 0x7f3f300a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.198+0000 7f3f36bb6700 1 -- 172.21.15.59:0/890970567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3009dc50 con 0x7f3f30133930 2023-09-30T22:36:31.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.198+0000 7f3f35bb4700 1 --2- 172.21.15.59:0/890970567 >> v2:172.21.15.59:3300/0 conn(0x7f3f3009d630 0x7f3f300a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:31.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.198+0000 7f3f36bb6700 1 --2- 172.21.15.59:0/890970567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f30133930 0x7f3f30133dd0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009d90 tx=0x7f3f2800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c75093a1d8d9ae1e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:31.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.198+0000 7f3f353b3700 1 -- 172.21.15.59:0/890970567 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2800e070 con 0x7f3f30133930 2023-09-30T22:36:31.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.198+0000 7f3f353b3700 1 -- 172.21.15.59:0/890970567 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2800bb20 con 0x7f3f30133930 2023-09-30T22:36:31.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.198+0000 7f3f353b3700 1 -- 172.21.15.59:0/890970567 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28012430 con 0x7f3f30133930 2023-09-30T22:36:31.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.199+0000 7f3f38619700 1 -- 172.21.15.59:0/890970567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f30133930 msgr2=0x7f3f30133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:31.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.199+0000 7f3f38619700 1 --2- 172.21.15.59:0/890970567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f30133930 0x7f3f30133dd0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009d90 tx=0x7f3f2800b330 comp rx=0 tx=0).stop 2023-09-30T22:36:31.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.199+0000 7f3f38619700 1 -- 172.21.15.59:0/890970567 shutdown_connections 2023-09-30T22:36:31.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.199+0000 7f3f38619700 1 --2- 172.21.15.59:0/890970567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f30133930 0x7f3f30133dd0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.199+0000 7f3f38619700 1 --2- 172.21.15.59:0/890970567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f300a0a30 0x7f3f300a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.199+0000 7f3f38619700 1 --2- 172.21.15.59:0/890970567 >> v2:172.21.15.59:3300/0 conn(0x7f3f3009d630 0x7f3f300a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.199+0000 7f3f38619700 1 -- 172.21.15.59:0/890970567 >> 172.21.15.59:0/890970567 conn(0x7f3f300a3050 msgr2=0x7f3f300a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:31.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.199+0000 7f3f38619700 1 -- 172.21.15.59:0/890970567 shutdown_connections 2023-09-30T22:36:31.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.199+0000 7f3f38619700 1 -- 172.21.15.59:0/890970567 wait complete. 2023-09-30T22:36:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.200+0000 7f3f38619700 1 Processor -- start 2023-09-30T22:36:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.200+0000 7f3f38619700 1 -- start start 2023-09-30T22:36:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f38619700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009d630 0x7f3f30132b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f38619700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f300a0a30 0x7f3f30133040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f38619700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f30133930 0x7f3f301c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f38619700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f301225b0 con 0x7f3f30133930 2023-09-30T22:36:31.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f38619700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f300a0410 con 0x7f3f3009d630 2023-09-30T22:36:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f38619700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f301208a0 con 0x7f3f300a0a30 2023-09-30T22:36:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f363b5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009d630 0x7f3f30132b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f36bb6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f30133930 0x7f3f301c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f35bb4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f300a0a30 0x7f3f30133040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f363b5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009d630 0x7f3f30132b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41136/0 (socket says 172.21.15.59:41136) 2023-09-30T22:36:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f36bb6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f30133930 0x7f3f301c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41028/0 (socket says 172.21.15.59:41028) 2023-09-30T22:36:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f363b5700 1 -- 172.21.15.59:0/70153779 learned_addr learned my addr 172.21.15.59:0/70153779 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:31.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f35bb4700 1 -- 172.21.15.59:0/70153779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009d630 msgr2=0x7f3f30132b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:31.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f35bb4700 1 --2- 172.21.15.59:0/70153779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009d630 0x7f3f30132b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f35bb4700 1 -- 172.21.15.59:0/70153779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f30133930 msgr2=0x7f3f301c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:31.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f35bb4700 1 --2- 172.21.15.59:0/70153779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f30133930 0x7f3f301c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f35bb4700 1 -- 172.21.15.59:0/70153779 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f200094a0 con 0x7f3f300a0a30 2023-09-30T22:36:31.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f36bb6700 1 --2- 172.21.15.59:0/70153779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f30133930 0x7f3f301c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:31.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.201+0000 7f3f363b5700 1 --2- 172.21.15.59:0/70153779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009d630 0x7f3f30132b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:31.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.202+0000 7f3f35bb4700 1 --2- 172.21.15.59:0/70153779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f300a0a30 0x7f3f30133040 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000e9b0 tx=0x7f3f2000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:31.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.202+0000 7f3f26ffd700 1 -- 172.21.15.59:0/70153779 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2000ee50 con 0x7f3f300a0a30 2023-09-30T22:36:31.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.202+0000 7f3f26ffd700 1 -- 172.21.15.59:0/70153779 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2000c850 con 0x7f3f300a0a30 2023-09-30T22:36:31.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.202+0000 7f3f26ffd700 1 -- 172.21.15.59:0/70153779 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2000cbe0 con 0x7f3f300a0a30 2023-09-30T22:36:31.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.202+0000 7f3f38619700 1 -- 172.21.15.59:0/70153779 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f28009a70 con 0x7f3f300a0a30 2023-09-30T22:36:31.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.202+0000 7f3f38619700 1 -- 172.21.15.59:0/70153779 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f301218b0 con 0x7f3f300a0a30 2023-09-30T22:36:31.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.203+0000 7f3f38619700 1 -- 172.21.15.59:0/70153779 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f300747f0 con 0x7f3f300a0a30 2023-09-30T22:36:31.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.203+0000 7f3f26ffd700 1 -- 172.21.15.59:0/70153779 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f2000cd40 con 0x7f3f300a0a30 2023-09-30T22:36:31.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.203+0000 7f3f26ffd700 1 -- 172.21.15.59:0/70153779 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f2003f650 con 0x7f3f300a0a30 2023-09-30T22:36:31.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.212+0000 7f3f26ffd700 1 -- 172.21.15.59:0/70153779 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f200232f0 con 0x7f3f300a0a30 2023-09-30T22:36:31.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.241+0000 7f0261073700 1 Processor -- start 2023-09-30T22:36:31.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.241+0000 7f0261073700 1 -- start start 2023-09-30T22:36:31.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.242+0000 7f0261073700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f025c09d630 0x7f025c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:31.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.242+0000 7f0261073700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c138d80 0x7f025c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:31.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.242+0000 7f0261073700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f025c0a2a70 con 0x7f025c0a0a30 2023-09-30T22:36:31.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.242+0000 7f0261073700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c0a01d0 con 0x7f025c09d630 2023-09-30T22:36:31.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.242+0000 7f0261073700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c09e2b0 con 0x7f025c138d80 2023-09-30T22:36:31.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.242+0000 7f025b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c138d80 0x7f025c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.242+0000 7f025a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f025c09d630 0x7f025c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.242+0000 7f025a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f025c09d630 0x7f025c0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41042/0 (socket says 172.21.15.59:41042) 2023-09-30T22:36:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.242+0000 7f025b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c138d80 0x7f025c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41142/0 (socket says 172.21.15.59:41142) 2023-09-30T22:36:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.242+0000 7f025a59c700 1 -- 172.21.15.59:0/1700020868 learned_addr learned my addr 172.21.15.59:0/1700020868 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.242+0000 7f025b59e700 1 -- 172.21.15.59:0/1700020868 >> v2:172.21.15.59:3300/0 conn(0x7f025c09d630 msgr2=0x7f025c0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.242+0000 7f025b59e700 1 --2- 172.21.15.59:0/1700020868 >> v2:172.21.15.59:3300/0 conn(0x7f025c09d630 0x7f025c0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.242+0000 7f025b59e700 1 -- 172.21.15.59:0/1700020868 >> v1:172.21.15.59:6789/0 conn(0x7f025c0a0a30 legacy=0x7f025c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.242+0000 7f025b59e700 1 -- 172.21.15.59:0/1700020868 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c09dc50 con 0x7f025c138d80 2023-09-30T22:36:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.242+0000 7f025a59c700 1 --2- 172.21.15.59:0/1700020868 >> v2:172.21.15.59:3300/0 conn(0x7f025c09d630 0x7f025c0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.243+0000 7f025b59e700 1 --2- 172.21.15.59:0/1700020868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c138d80 0x7f025c13b160 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0254009d90 tx=0x7f025400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9200ccd79d0fde19 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.243+0000 7f0259d9b700 1 -- 172.21.15.59:0/1700020868 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025400e070 con 0x7f025c138d80 2023-09-30T22:36:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.243+0000 7f0259d9b700 1 -- 172.21.15.59:0/1700020868 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025400bb20 con 0x7f025c138d80 2023-09-30T22:36:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.243+0000 7f0259d9b700 1 -- 172.21.15.59:0/1700020868 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254012430 con 0x7f025c138d80 2023-09-30T22:36:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.243+0000 7f0261073700 1 -- 172.21.15.59:0/1700020868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c138d80 msgr2=0x7f025c13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.243+0000 7f0261073700 1 --2- 172.21.15.59:0/1700020868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c138d80 0x7f025c13b160 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0254009d90 tx=0x7f025400b330 comp rx=0 tx=0).stop 2023-09-30T22:36:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.243+0000 7f0261073700 1 -- 172.21.15.59:0/1700020868 shutdown_connections 2023-09-30T22:36:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.243+0000 7f0261073700 1 --2- 172.21.15.59:0/1700020868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c138d80 0x7f025c13b160 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.243+0000 7f0261073700 1 --2- 172.21.15.59:0/1700020868 >> v2:172.21.15.59:3300/0 conn(0x7f025c09d630 0x7f025c0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.243+0000 7f0261073700 1 -- 172.21.15.59:0/1700020868 >> 172.21.15.59:0/1700020868 conn(0x7f025c0a3050 msgr2=0x7f025c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.244+0000 7f0261073700 1 -- 172.21.15.59:0/1700020868 shutdown_connections 2023-09-30T22:36:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.244+0000 7f0261073700 1 -- 172.21.15.59:0/1700020868 wait complete. 2023-09-30T22:36:31.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.245+0000 7f0261073700 1 Processor -- start 2023-09-30T22:36:31.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.245+0000 7f0261073700 1 -- start start 2023-09-30T22:36:31.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.245+0000 7f0261073700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c09d630 0x7f025c120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:31.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.245+0000 7f0261073700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0a0a30 0x7f025c120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.245+0000 7f0261073700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c138d80 0x7f025c1210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.245+0000 7f0261073700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c124140 con 0x7f025c0a0a30 2023-09-30T22:36:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.245+0000 7f0261073700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c1234f0 con 0x7f025c09d630 2023-09-30T22:36:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.245+0000 7f0261073700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f025c138b20 con 0x7f025c138d80 2023-09-30T22:36:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f025a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0a0a30 0x7f025c120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f025ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c09d630 0x7f025c120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f025a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0a0a30 0x7f025c120b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41052/0 (socket says 172.21.15.59:41052) 2023-09-30T22:36:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f025a59c700 1 -- 172.21.15.59:0/1994275020 learned_addr learned my addr 172.21.15.59:0/1994275020 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f025b59e700 1 --2- 172.21.15.59:0/1994275020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c138d80 0x7f025c1210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f025a59c700 1 -- 172.21.15.59:0/1994275020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c138d80 msgr2=0x7f025c1210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f025a59c700 1 --2- 172.21.15.59:0/1994275020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c138d80 0x7f025c1210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f025a59c700 1 -- 172.21.15.59:0/1994275020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c09d630 msgr2=0x7f025c120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f025a59c700 1 --2- 172.21.15.59:0/1994275020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c09d630 0x7f025c120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f025a59c700 1 -- 172.21.15.59:0/1994275020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0250009550 con 0x7f025c0a0a30 2023-09-30T22:36:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f025ad9d700 1 --2- 172.21.15.59:0/1994275020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c09d630 0x7f025c120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f025a59c700 1 --2- 172.21.15.59:0/1994275020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0a0a30 0x7f025c120b60 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f025000ebe0 tx=0x7f025000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f02437fe700 1 -- 172.21.15.59:0/1994275020 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025000c850 con 0x7f025c0a0a30 2023-09-30T22:36:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f02437fe700 1 -- 172.21.15.59:0/1994275020 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025000c9b0 con 0x7f025c0a0a30 2023-09-30T22:36:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f0261073700 1 -- 172.21.15.59:0/1994275020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0254009a70 con 0x7f025c0a0a30 2023-09-30T22:36:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f02437fe700 1 -- 172.21.15.59:0/1994275020 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025000cd40 con 0x7f025c0a0a30 2023-09-30T22:36:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.246+0000 7f0261073700 1 -- 172.21.15.59:0/1994275020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c0a0460 con 0x7f025c0a0a30 2023-09-30T22:36:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.247+0000 7f02437fe700 1 -- 172.21.15.59:0/1994275020 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0250013470 con 0x7f025c0a0a30 2023-09-30T22:36:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.248+0000 7f02437fe700 1 -- 172.21.15.59:0/1994275020 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f025003fc20 con 0x7f025c0a0a30 2023-09-30T22:36:31.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.248+0000 7f0261073700 1 -- 172.21.15.59:0/1994275020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025c124990 con 0x7f025c0a0a30 2023-09-30T22:36:31.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.252+0000 7f02437fe700 1 -- 172.21.15.59:0/1994275020 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f025001b3b0 con 0x7f025c0a0a30 2023-09-30T22:36:31.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.420+0000 7f3f38619700 1 -- 172.21.15.59:0/70153779 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3f30133580 con 0x7f3f300a0a30 2023-09-30T22:36:31.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.420+0000 7f3f26ffd700 1 -- 172.21.15.59:0/70153779 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f20021020 con 0x7f3f300a0a30 2023-09-30T22:36:31.422 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:31.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.423+0000 7f3f38619700 1 -- 172.21.15.59:0/70153779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f300a0a30 msgr2=0x7f3f30133040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:31.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.423+0000 7f3f38619700 1 --2- 172.21.15.59:0/70153779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f300a0a30 0x7f3f30133040 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000e9b0 tx=0x7f3f2000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.423+0000 7f3f38619700 1 -- 172.21.15.59:0/70153779 shutdown_connections 2023-09-30T22:36:31.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.423+0000 7f3f38619700 1 --2- 172.21.15.59:0/70153779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f30133930 0x7f3f301c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.423+0000 7f3f38619700 1 --2- 172.21.15.59:0/70153779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f3009d630 0x7f3f30132b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.423+0000 7f3f38619700 1 --2- 172.21.15.59:0/70153779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f300a0a30 0x7f3f30133040 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.423+0000 7f3f38619700 1 -- 172.21.15.59:0/70153779 >> 172.21.15.59:0/70153779 conn(0x7f3f300a3050 msgr2=0x7f3f3009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:31.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.423+0000 7f3f38619700 1 -- 172.21.15.59:0/70153779 shutdown_connections 2023-09-30T22:36:31.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.423+0000 7f3f38619700 1 -- 172.21.15.59:0/70153779 wait complete. 2023-09-30T22:36:31.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:31.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.461+0000 7f0261073700 1 -- 172.21.15.59:0/1994275020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f025c13af90 con 0x7f025c0a0a30 2023-09-30T22:36:31.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.462+0000 7f02437fe700 1 -- 172.21.15.59:0/1994275020 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0250024350 con 0x7f025c0a0a30 2023-09-30T22:36:31.462 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:31.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.464+0000 7f0261073700 1 -- 172.21.15.59:0/1994275020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0a0a30 msgr2=0x7f025c120b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:31.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.464+0000 7f0261073700 1 --2- 172.21.15.59:0/1994275020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0a0a30 0x7f025c120b60 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f025000ebe0 tx=0x7f025000eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.464+0000 7f0261073700 1 -- 172.21.15.59:0/1994275020 shutdown_connections 2023-09-30T22:36:31.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.464+0000 7f0261073700 1 --2- 172.21.15.59:0/1994275020 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c138d80 0x7f025c1210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.464+0000 7f0261073700 1 --2- 172.21.15.59:0/1994275020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c09d630 0x7f025c120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.464+0000 7f0261073700 1 --2- 172.21.15.59:0/1994275020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0a0a30 0x7f025c120b60 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:31.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.464+0000 7f0261073700 1 -- 172.21.15.59:0/1994275020 >> 172.21.15.59:0/1994275020 conn(0x7f025c0a3050 msgr2=0x7f025c139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:31.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.464+0000 7f0261073700 1 -- 172.21.15.59:0/1994275020 shutdown_connections 2023-09-30T22:36:31.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:31.464+0000 7f0261073700 1 -- 172.21.15.59:0/1994275020 wait complete. 2023-09-30T22:36:31.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:31.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:32.015 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:32.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.128+0000 7f2d92c0d700 1 Processor -- start 2023-09-30T22:36:32.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.128+0000 7f2d92c0d700 1 -- start start 2023-09-30T22:36:32.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.128+0000 7f2d92c0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d8c0a0a30 0x7f2d8c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.128+0000 7f2d92c0d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d8c134170 0x7f2d8c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.128+0000 7f2d92c0d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8c09edd0 con 0x7f2d8c0a1340 2023-09-30T22:36:32.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.128+0000 7f2d92c0d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8c09e1f0 con 0x7f2d8c134170 2023-09-30T22:36:32.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.128+0000 7f2d92c0d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c09dc50 con 0x7f2d8c0a0a30 2023-09-30T22:36:32.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.128+0000 7f2d911aa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d8c134170 0x7f2d8c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.129+0000 7f2d911aa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d8c134170 0x7f2d8c13bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41054/0 (socket says 172.21.15.59:41054) 2023-09-30T22:36:32.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.128+0000 7f2d909a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d8c0a0a30 0x7f2d8c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.129+0000 7f2d911aa700 1 -- 172.21.15.59:0/2431977817 learned_addr learned my addr 172.21.15.59:0/2431977817 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:32.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.129+0000 7f2d911aa700 1 -- 172.21.15.59:0/2431977817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d8c0a0a30 msgr2=0x7f2d8c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:32.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.129+0000 7f2d911aa700 1 --2- 172.21.15.59:0/2431977817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d8c0a0a30 0x7f2d8c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.129+0000 7f2d911aa700 1 -- 172.21.15.59:0/2431977817 >> v1:172.21.15.59:6789/0 conn(0x7f2d8c0a1340 legacy=0x7f2d8c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.129+0000 7f2d911aa700 1 -- 172.21.15.59:0/2431977817 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c0a1fe0 con 0x7f2d8c134170 2023-09-30T22:36:32.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.129+0000 7f2d909a9700 1 --2- 172.21.15.59:0/2431977817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d8c0a0a30 0x7f2d8c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:32.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.129+0000 7f2d911aa700 1 --2- 172.21.15.59:0/2431977817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d8c134170 0x7f2d8c13bd30 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f2d84009e50 tx=0x7f2d8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592adff036fe2f15 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:32.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.129+0000 7f2d8b7fe700 1 -- 172.21.15.59:0/2431977817 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400e070 con 0x7f2d8c134170 2023-09-30T22:36:32.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.129+0000 7f2d8b7fe700 1 -- 172.21.15.59:0/2431977817 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8400b910 con 0x7f2d8c134170 2023-09-30T22:36:32.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.129+0000 7f2d8b7fe700 1 -- 172.21.15.59:0/2431977817 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400bcc0 con 0x7f2d8c134170 2023-09-30T22:36:32.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.130+0000 7f2d92c0d700 1 -- 172.21.15.59:0/2431977817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d8c134170 msgr2=0x7f2d8c13bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.130+0000 7f2d92c0d700 1 --2- 172.21.15.59:0/2431977817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d8c134170 0x7f2d8c13bd30 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f2d84009e50 tx=0x7f2d8400b330 comp rx=0 tx=0).stop 2023-09-30T22:36:32.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.130+0000 7f2d92c0d700 1 -- 172.21.15.59:0/2431977817 shutdown_connections 2023-09-30T22:36:32.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.130+0000 7f2d92c0d700 1 --2- 172.21.15.59:0/2431977817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d8c134170 0x7f2d8c13bd30 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.130+0000 7f2d92c0d700 1 --2- 172.21.15.59:0/2431977817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d8c0a0a30 0x7f2d8c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.130+0000 7f2d92c0d700 1 -- 172.21.15.59:0/2431977817 >> 172.21.15.59:0/2431977817 conn(0x7f2d8c0a6550 msgr2=0x7f2d8c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:32.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.130+0000 7f2d92c0d700 1 -- 172.21.15.59:0/2431977817 shutdown_connections 2023-09-30T22:36:32.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.130+0000 7f2d92c0d700 1 -- 172.21.15.59:0/2431977817 wait complete. 2023-09-30T22:36:32.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.131+0000 7f2d92c0d700 1 Processor -- start 2023-09-30T22:36:32.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.131+0000 7f2d92c0d700 1 -- start start 2023-09-30T22:36:32.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.132+0000 7f2d92c0d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d8c0a0a30 0x7f2d8c11e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.132+0000 7f2d92c0d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d8c0a1340 0x7f2d8c11ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.132+0000 7f2d92c0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d8c134170 0x7f2d8c11f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.132+0000 7f2d92c0d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c122190 con 0x7f2d8c0a0a30 2023-09-30T22:36:32.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.132+0000 7f2d92c0d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c121bf0 con 0x7f2d8c134170 2023-09-30T22:36:32.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.132+0000 7f2d92c0d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c120280 con 0x7f2d8c0a1340 2023-09-30T22:36:32.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.132+0000 7f2d911aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d8c134170 0x7f2d8c11f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.133+0000 7f2d909a9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d8c0a0a30 0x7f2d8c11e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.132+0000 7f2d911aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d8c134170 0x7f2d8c11f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41170/0 (socket says 172.21.15.59:41170) 2023-09-30T22:36:32.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.133+0000 7f2d911aa700 1 -- 172.21.15.59:0/3165923288 learned_addr learned my addr 172.21.15.59:0/3165923288 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:32.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.133+0000 7f2d8bfff700 1 --2- 172.21.15.59:0/3165923288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d8c0a1340 0x7f2d8c11ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.133+0000 7f2d911aa700 1 -- 172.21.15.59:0/3165923288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d8c0a1340 msgr2=0x7f2d8c11ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.133+0000 7f2d911aa700 1 --2- 172.21.15.59:0/3165923288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d8c0a1340 0x7f2d8c11ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.133+0000 7f2d911aa700 1 -- 172.21.15.59:0/3165923288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d8c0a0a30 msgr2=0x7f2d8c11e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.133+0000 7f2d911aa700 1 --2- 172.21.15.59:0/3165923288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d8c0a0a30 0x7f2d8c11e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.133+0000 7f2d911aa700 1 -- 172.21.15.59:0/3165923288 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c0094a0 con 0x7f2d8c134170 2023-09-30T22:36:32.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.133+0000 7f2d911aa700 1 --2- 172.21.15.59:0/3165923288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d8c134170 0x7f2d8c11f180 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c09e330 tx=0x7f2d84004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:32.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.133+0000 7f2d897fa700 1 -- 172.21.15.59:0/3165923288 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d84004800 con 0x7f2d8c134170 2023-09-30T22:36:32.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.133+0000 7f2d897fa700 1 -- 172.21.15.59:0/3165923288 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d84004960 con 0x7f2d8c134170 2023-09-30T22:36:32.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.133+0000 7f2d92c0d700 1 -- 172.21.15.59:0/3165923288 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d84009b30 con 0x7f2d8c134170 2023-09-30T22:36:32.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.133+0000 7f2d897fa700 1 -- 172.21.15.59:0/3165923288 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8401c680 con 0x7f2d8c134170 2023-09-30T22:36:32.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.133+0000 7f2d92c0d700 1 -- 172.21.15.59:0/3165923288 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8c120a30 con 0x7f2d8c134170 2023-09-30T22:36:32.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.134+0000 7f2d92c0d700 1 -- 172.21.15.59:0/3165923288 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8c074ea0 con 0x7f2d8c134170 2023-09-30T22:36:32.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.135+0000 7f2d897fa700 1 -- 172.21.15.59:0/3165923288 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d8401c7e0 con 0x7f2d8c134170 2023-09-30T22:36:32.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.135+0000 7f2d897fa700 1 -- 172.21.15.59:0/3165923288 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d84041880 con 0x7f2d8c134170 2023-09-30T22:36:32.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.139+0000 7f2d897fa700 1 -- 172.21.15.59:0/3165923288 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d84025450 con 0x7f2d8c134170 2023-09-30T22:36:32.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.166+0000 7fece83a9700 1 Processor -- start 2023-09-30T22:36:32.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.166+0000 7fece83a9700 1 -- start start 2023-09-30T22:36:32.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.166+0000 7fece83a9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fece009d630 0x7fece00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.166+0000 7fece83a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece0138d80 0x7fece013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.166+0000 7fece83a9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece00a2a70 con 0x7fece00a0a30 2023-09-30T22:36:32.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.166+0000 7fece83a9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece00a01d0 con 0x7fece009d630 2023-09-30T22:36:32.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.166+0000 7fece83a9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece009e2b0 con 0x7fece0138d80 2023-09-30T22:36:32.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.167+0000 7fece6946700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece0138d80 0x7fece013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.167+0000 7fece5944700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fece009d630 0x7fece00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.167+0000 7fece6946700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece0138d80 0x7fece013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41182/0 (socket says 172.21.15.59:41182) 2023-09-30T22:36:32.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.167+0000 7fece6946700 1 -- 172.21.15.59:0/3506865791 learned_addr learned my addr 172.21.15.59:0/3506865791 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:32.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.167+0000 7fece5944700 1 -- 172.21.15.59:0/3506865791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece0138d80 msgr2=0x7fece013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:32.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.167+0000 7fece5944700 1 --2- 172.21.15.59:0/3506865791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece0138d80 0x7fece013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.167+0000 7fece5944700 1 -- 172.21.15.59:0/3506865791 >> v1:172.21.15.59:6789/0 conn(0x7fece00a0a30 legacy=0x7fece00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.167+0000 7fece5944700 1 -- 172.21.15.59:0/3506865791 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece009dc50 con 0x7fece009d630 2023-09-30T22:36:32.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.167+0000 7fece6946700 1 --2- 172.21.15.59:0/3506865791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece0138d80 0x7fece013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:32.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.167+0000 7fece5944700 1 --2- 172.21.15.59:0/3506865791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece009d630 0x7fece00a1510 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009840 tx=0x7fecd4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d607a7c84915857d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:32.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.167+0000 7fece5143700 1 -- 172.21.15.59:0/3506865791 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4011830 con 0x7fece009d630 2023-09-30T22:36:32.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.167+0000 7fece5143700 1 -- 172.21.15.59:0/3506865791 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd4011990 con 0x7fece009d630 2023-09-30T22:36:32.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.167+0000 7fece5143700 1 -- 172.21.15.59:0/3506865791 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4011d20 con 0x7fece009d630 2023-09-30T22:36:32.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.168+0000 7fece83a9700 1 -- 172.21.15.59:0/3506865791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece009d630 msgr2=0x7fece00a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.168+0000 7fece83a9700 1 --2- 172.21.15.59:0/3506865791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece009d630 0x7fece00a1510 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009840 tx=0x7fecd4009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:32.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.168+0000 7fece83a9700 1 -- 172.21.15.59:0/3506865791 shutdown_connections 2023-09-30T22:36:32.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.168+0000 7fece83a9700 1 --2- 172.21.15.59:0/3506865791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece0138d80 0x7fece013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.168+0000 7fece83a9700 1 --2- 172.21.15.59:0/3506865791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece009d630 0x7fece00a1510 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.168+0000 7fece83a9700 1 -- 172.21.15.59:0/3506865791 >> 172.21.15.59:0/3506865791 conn(0x7fece00a3050 msgr2=0x7fece00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:32.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.168+0000 7fece83a9700 1 -- 172.21.15.59:0/3506865791 shutdown_connections 2023-09-30T22:36:32.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.168+0000 7fece83a9700 1 -- 172.21.15.59:0/3506865791 wait complete. 2023-09-30T22:36:32.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.169+0000 7fece83a9700 1 Processor -- start 2023-09-30T22:36:32.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.169+0000 7fece83a9700 1 -- start start 2023-09-30T22:36:32.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece83a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece009d630 0x7fece0120800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece83a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece00a0a30 0x7fece0120d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece83a9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece0138d80 0x7fece0121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece83a9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece0123fb0 con 0x7fece0138d80 2023-09-30T22:36:32.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece83a9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece00a4e00 con 0x7fece00a0a30 2023-09-30T22:36:32.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece83a9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece00a0410 con 0x7fece009d630 2023-09-30T22:36:32.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece5944700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece00a0a30 0x7fece0120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece6145700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece009d630 0x7fece0120800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece5944700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece00a0a30 0x7fece0120d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41188/0 (socket says 172.21.15.59:41188) 2023-09-30T22:36:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece5944700 1 -- 172.21.15.59:0/3466162737 learned_addr learned my addr 172.21.15.59:0/3466162737 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece6946700 1 --2- 172.21.15.59:0/3466162737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece0138d80 0x7fece0121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece5944700 1 -- 172.21.15.59:0/3466162737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece009d630 msgr2=0x7fece0120800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece5944700 1 --2- 172.21.15.59:0/3466162737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece009d630 0x7fece0120800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece5944700 1 -- 172.21.15.59:0/3466162737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece0138d80 msgr2=0x7fece0121280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece5944700 1 --2- 172.21.15.59:0/3466162737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece0138d80 0x7fece0121280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece5944700 1 -- 172.21.15.59:0/3466162737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd0009b30 con 0x7fece00a0a30 2023-09-30T22:36:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece5944700 1 --2- 172.21.15.59:0/3466162737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece00a0a30 0x7fece0120d40 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009fd0 tx=0x7fecd4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fecdeffd700 1 -- 172.21.15.59:0/3466162737 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4004400 con 0x7fece00a0a30 2023-09-30T22:36:32.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fecdeffd700 1 -- 172.21.15.59:0/3466162737 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd401f070 con 0x7fece00a0a30 2023-09-30T22:36:32.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fece83a9700 1 -- 172.21.15.59:0/3466162737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd40094a0 con 0x7fece00a0a30 2023-09-30T22:36:32.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.170+0000 7fecdeffd700 1 -- 172.21.15.59:0/3466162737 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40038e0 con 0x7fece00a0a30 2023-09-30T22:36:32.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.171+0000 7fece83a9700 1 -- 172.21.15.59:0/3466162737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece0124a20 con 0x7fece00a0a30 2023-09-30T22:36:32.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.171+0000 7fecdeffd700 1 -- 172.21.15.59:0/3466162737 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fecd4021030 con 0x7fece00a0a30 2023-09-30T22:36:32.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.172+0000 7fecdeffd700 1 -- 172.21.15.59:0/3466162737 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fecd4040870 con 0x7fece00a0a30 2023-09-30T22:36:32.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.172+0000 7fecdcff9700 1 -- 172.21.15.59:0/3466162737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc40052e0 con 0x7fece00a0a30 2023-09-30T22:36:32.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.177+0000 7fecdeffd700 1 -- 172.21.15.59:0/3466162737 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecd40239c0 con 0x7fece00a0a30 2023-09-30T22:36:32.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.345+0000 7f2d92c0d700 1 -- 172.21.15.59:0/3165923288 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2d8c0a28e0 con 0x7f2d8c134170 2023-09-30T22:36:32.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.345+0000 7f2d897fa700 1 -- 172.21.15.59:0/3165923288 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d84033030 con 0x7f2d8c134170 2023-09-30T22:36:32.346 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:32.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.348+0000 7f2d92c0d700 1 -- 172.21.15.59:0/3165923288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d8c134170 msgr2=0x7f2d8c11f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.348+0000 7f2d92c0d700 1 --2- 172.21.15.59:0/3165923288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d8c134170 0x7f2d8c11f180 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c09e330 tx=0x7f2d84004ad0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.348+0000 7f2d92c0d700 1 -- 172.21.15.59:0/3165923288 shutdown_connections 2023-09-30T22:36:32.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.348+0000 7f2d92c0d700 1 --2- 172.21.15.59:0/3165923288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d8c134170 0x7f2d8c11f180 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.348+0000 7f2d92c0d700 1 --2- 172.21.15.59:0/3165923288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d8c0a0a30 0x7f2d8c11e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.348+0000 7f2d92c0d700 1 --2- 172.21.15.59:0/3165923288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2d8c0a1340 0x7f2d8c11ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.348+0000 7f2d92c0d700 1 -- 172.21.15.59:0/3165923288 >> 172.21.15.59:0/3165923288 conn(0x7f2d8c0a6550 msgr2=0x7f2d8c09c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:32.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.348+0000 7f2d92c0d700 1 -- 172.21.15.59:0/3165923288 shutdown_connections 2023-09-30T22:36:32.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.348+0000 7f2d92c0d700 1 -- 172.21.15.59:0/3165923288 wait complete. 2023-09-30T22:36:32.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:32.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.379+0000 7fecdcff9700 1 -- 172.21.15.59:0/3466162737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fecc4005590 con 0x7fece00a0a30 2023-09-30T22:36:32.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.379+0000 7fecdeffd700 1 -- 172.21.15.59:0/3466162737 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fecd4015020 con 0x7fece00a0a30 2023-09-30T22:36:32.379 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:32.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.382+0000 7fecdcff9700 1 -- 172.21.15.59:0/3466162737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece00a0a30 msgr2=0x7fece0120d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.382+0000 7fecdcff9700 1 --2- 172.21.15.59:0/3466162737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece00a0a30 0x7fece0120d40 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009fd0 tx=0x7fecd4004750 comp rx=0 tx=0).stop 2023-09-30T22:36:32.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.382+0000 7fecdcff9700 1 -- 172.21.15.59:0/3466162737 shutdown_connections 2023-09-30T22:36:32.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.382+0000 7fecdcff9700 1 --2- 172.21.15.59:0/3466162737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece009d630 0x7fece0120800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.382+0000 7fecdcff9700 1 --2- 172.21.15.59:0/3466162737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece0138d80 0x7fece0121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.382+0000 7fecdcff9700 1 --2- 172.21.15.59:0/3466162737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece00a0a30 0x7fece0120d40 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.382+0000 7fecdcff9700 1 -- 172.21.15.59:0/3466162737 >> 172.21.15.59:0/3466162737 conn(0x7fece00a3050 msgr2=0x7fece009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:32.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.382+0000 7fecdcff9700 1 -- 172.21.15.59:0/3466162737 shutdown_connections 2023-09-30T22:36:32.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.382+0000 7fecdcff9700 1 -- 172.21.15.59:0/3466162737 wait complete. 2023-09-30T22:36:32.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:32.440 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:32.481 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:32.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.581+0000 7fc114423700 1 Processor -- start 2023-09-30T22:36:32.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.581+0000 7fc114423700 1 -- start start 2023-09-30T22:36:32.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.582+0000 7fc114423700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc10c09d630 0x7fc10c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.582+0000 7fc114423700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10c138d80 0x7fc10c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.582+0000 7fc114423700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10c0a2a70 con 0x7fc10c0a0a30 2023-09-30T22:36:32.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.582+0000 7fc114423700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c0a01d0 con 0x7fc10c09d630 2023-09-30T22:36:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.582+0000 7fc114423700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c09e2b0 con 0x7fc10c138d80 2023-09-30T22:36:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.582+0000 7fc1119be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc10c09d630 0x7fc10c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.582+0000 7fc1121bf700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc10c0a0a30 0x7fc10c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59204/0 (socket says 172.21.15.59:59204) 2023-09-30T22:36:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.582+0000 7fc1121bf700 1 -- 172.21.15.59:0/970136360 learned_addr learned my addr 172.21.15.59:0/970136360 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.582+0000 7fc1129c0700 1 --2- 172.21.15.59:0/970136360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10c138d80 0x7fc10c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.582+0000 7fc1119be700 1 -- 172.21.15.59:0/970136360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10c138d80 msgr2=0x7fc10c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.582+0000 7fc1119be700 1 --2- 172.21.15.59:0/970136360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10c138d80 0x7fc10c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.582+0000 7fc1119be700 1 -- 172.21.15.59:0/970136360 >> v1:172.21.15.59:6789/0 conn(0x7fc10c0a0a30 legacy=0x7fc10c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.582+0000 7fc1111bd700 1 -- 172.21.15.59:0/970136360 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219099869 0 0) 0x7fc10c0a2a70 con 0x7fc10c0a0a30 2023-09-30T22:36:32.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.582+0000 7fc1119be700 1 -- 172.21.15.59:0/970136360 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c09dc50 con 0x7fc10c09d630 2023-09-30T22:36:32.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.583+0000 7fc1119be700 1 --2- 172.21.15.59:0/970136360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc10c09d630 0x7fc10c0a1510 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009870 tx=0x7fc0fc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=222888b59dad0b4d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:32.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.583+0000 7fc1111bd700 1 -- 172.21.15.59:0/970136360 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc011830 con 0x7fc10c09d630 2023-09-30T22:36:32.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.583+0000 7fc1111bd700 1 -- 172.21.15.59:0/970136360 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc011990 con 0x7fc10c09d630 2023-09-30T22:36:32.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.583+0000 7fc1111bd700 1 -- 172.21.15.59:0/970136360 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc011d20 con 0x7fc10c09d630 2023-09-30T22:36:32.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.584+0000 7fc114423700 1 -- 172.21.15.59:0/970136360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc10c09d630 msgr2=0x7fc10c0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.584+0000 7fc114423700 1 --2- 172.21.15.59:0/970136360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc10c09d630 0x7fc10c0a1510 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009870 tx=0x7fc0fc009b80 comp rx=0 tx=0).stop 2023-09-30T22:36:32.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.584+0000 7fc114423700 1 -- 172.21.15.59:0/970136360 shutdown_connections 2023-09-30T22:36:32.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.584+0000 7fc114423700 1 --2- 172.21.15.59:0/970136360 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10c138d80 0x7fc10c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.584+0000 7fc114423700 1 --2- 172.21.15.59:0/970136360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc10c09d630 0x7fc10c0a1510 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.584+0000 7fc114423700 1 -- 172.21.15.59:0/970136360 >> 172.21.15.59:0/970136360 conn(0x7fc10c0a3050 msgr2=0x7fc10c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:32.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.584+0000 7fc114423700 1 -- 172.21.15.59:0/970136360 shutdown_connections 2023-09-30T22:36:32.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.584+0000 7fc114423700 1 -- 172.21.15.59:0/970136360 wait complete. 2023-09-30T22:36:32.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.585+0000 7fc114423700 1 Processor -- start 2023-09-30T22:36:32.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.585+0000 7fc114423700 1 -- start start 2023-09-30T22:36:32.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.585+0000 7fc114423700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc10c09d630 0x7fc10c133850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.585+0000 7fc114423700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10c0a0a30 0x7fc10c133d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.585+0000 7fc114423700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc10c138d80 0x7fc10c1342d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.585+0000 7fc114423700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c0a0480 con 0x7fc10c09d630 2023-09-30T22:36:32.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.585+0000 7fc114423700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c136a20 con 0x7fc10c138d80 2023-09-30T22:36:32.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.585+0000 7fc114423700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c138a80 con 0x7fc10c0a0a30 2023-09-30T22:36:32.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.585+0000 7fc1121bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc10c09d630 0x7fc10c133850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.585+0000 7fc1129c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc10c138d80 0x7fc10c1342d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.585+0000 7fc1121bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc10c09d630 0x7fc10c133850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41090/0 (socket says 172.21.15.59:41090) 2023-09-30T22:36:32.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.585+0000 7fc1121bf700 1 -- 172.21.15.59:0/3793447152 learned_addr learned my addr 172.21.15.59:0/3793447152 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:32.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.586+0000 7fc1119be700 1 --2- 172.21.15.59:0/3793447152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10c0a0a30 0x7fc10c133d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.586+0000 7fc1129c0700 1 -- 172.21.15.59:0/3793447152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10c0a0a30 msgr2=0x7fc10c133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.586+0000 7fc1129c0700 1 --2- 172.21.15.59:0/3793447152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10c0a0a30 0x7fc10c133d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.586+0000 7fc1129c0700 1 -- 172.21.15.59:0/3793447152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc10c09d630 msgr2=0x7fc10c133850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.586+0000 7fc1129c0700 1 --2- 172.21.15.59:0/3793447152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc10c09d630 0x7fc10c133850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.586+0000 7fc1129c0700 1 -- 172.21.15.59:0/3793447152 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0fc0094a0 con 0x7fc10c138d80 2023-09-30T22:36:32.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.586+0000 7fc1119be700 1 --2- 172.21.15.59:0/3793447152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10c0a0a30 0x7fc10c133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:36:32.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.586+0000 7fc1121bf700 1 --2- 172.21.15.59:0/3793447152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc10c09d630 0x7fc10c133850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:32.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.586+0000 7fc1129c0700 1 --2- 172.21.15.59:0/3793447152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc10c138d80 0x7fc10c1342d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc10c06d8e0 tx=0x7fc10400eb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:32.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.586+0000 7fc102ffd700 1 -- 172.21.15.59:0/3793447152 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104013680 con 0x7fc10c138d80 2023-09-30T22:36:32.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.586+0000 7fc102ffd700 1 -- 172.21.15.59:0/3793447152 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1040137e0 con 0x7fc10c138d80 2023-09-30T22:36:32.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.586+0000 7fc114423700 1 -- 172.21.15.59:0/3793447152 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10c136d50 con 0x7fc10c138d80 2023-09-30T22:36:32.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.586+0000 7fc102ffd700 1 -- 172.21.15.59:0/3793447152 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104013b90 con 0x7fc10c138d80 2023-09-30T22:36:32.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.586+0000 7fc114423700 1 -- 172.21.15.59:0/3793447152 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10c137e70 con 0x7fc10c138d80 2023-09-30T22:36:32.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.587+0000 7fc102ffd700 1 -- 172.21.15.59:0/3793447152 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc104013cf0 con 0x7fc10c138d80 2023-09-30T22:36:32.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.587+0000 7fc114423700 1 -- 172.21.15.59:0/3793447152 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10c135bc0 con 0x7fc10c138d80 2023-09-30T22:36:32.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.587+0000 7fc102ffd700 1 -- 172.21.15.59:0/3793447152 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc10403fb40 con 0x7fc10c138d80 2023-09-30T22:36:32.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.592+0000 7fc102ffd700 1 -- 172.21.15.59:0/3793447152 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc104011b80 con 0x7fc10c138d80 2023-09-30T22:36:32.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.624+0000 7fc55773a700 1 Processor -- start 2023-09-30T22:36:32.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.624+0000 7fc55773a700 1 -- start start 2023-09-30T22:36:32.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.625+0000 7fc55773a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5500a0a30 0x7fc5500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.625+0000 7fc55773a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc55009d630 0x7fc5500a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.625+0000 7fc55773a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5500a2a70 con 0x7fc550133930 2023-09-30T22:36:32.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.625+0000 7fc55773a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500a01d0 con 0x7fc5500a0a30 2023-09-30T22:36:32.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.625+0000 7fc55773a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc55009e2b0 con 0x7fc55009d630 2023-09-30T22:36:32.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.625+0000 7fc5554d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5500a0a30 0x7fc5500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.625+0000 7fc555cd7700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc550133930 0x7fc550133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59220/0 (socket says 172.21.15.59:59220) 2023-09-30T22:36:32.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.625+0000 7fc555cd7700 1 -- 172.21.15.59:0/665656761 learned_addr learned my addr 172.21.15.59:0/665656761 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:32.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.625+0000 7fc554cd5700 1 --2- 172.21.15.59:0/665656761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc55009d630 0x7fc5500a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.625+0000 7fc5554d6700 1 -- 172.21.15.59:0/665656761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc55009d630 msgr2=0x7fc5500a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:32.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.625+0000 7fc5554d6700 1 --2- 172.21.15.59:0/665656761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc55009d630 0x7fc5500a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.625+0000 7fc54ffff700 1 -- 172.21.15.59:0/665656761 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485786484 0 0) 0x7fc5500a2a70 con 0x7fc550133930 2023-09-30T22:36:32.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.625+0000 7fc5554d6700 1 -- 172.21.15.59:0/665656761 >> v1:172.21.15.59:6789/0 conn(0x7fc550133930 legacy=0x7fc550133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.625+0000 7fc5554d6700 1 -- 172.21.15.59:0/665656761 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55009dc50 con 0x7fc5500a0a30 2023-09-30T22:36:32.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.626+0000 7fc5554d6700 1 --2- 172.21.15.59:0/665656761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5500a0a30 0x7fc5500a0e00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc548009dc0 tx=0x7fc54800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df8aca9f23d1a665 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:32.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.626+0000 7fc54ffff700 1 -- 172.21.15.59:0/665656761 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54800e070 con 0x7fc5500a0a30 2023-09-30T22:36:32.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.626+0000 7fc54ffff700 1 -- 172.21.15.59:0/665656761 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54800bb20 con 0x7fc5500a0a30 2023-09-30T22:36:32.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.626+0000 7fc54ffff700 1 -- 172.21.15.59:0/665656761 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548012430 con 0x7fc5500a0a30 2023-09-30T22:36:32.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.626+0000 7fc55773a700 1 -- 172.21.15.59:0/665656761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5500a0a30 msgr2=0x7fc5500a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.626+0000 7fc55773a700 1 --2- 172.21.15.59:0/665656761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5500a0a30 0x7fc5500a0e00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc548009dc0 tx=0x7fc54800b330 comp rx=0 tx=0).stop 2023-09-30T22:36:32.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.626+0000 7fc55773a700 1 -- 172.21.15.59:0/665656761 shutdown_connections 2023-09-30T22:36:32.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.626+0000 7fc55773a700 1 --2- 172.21.15.59:0/665656761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5500a0a30 0x7fc5500a0e00 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.626+0000 7fc55773a700 1 --2- 172.21.15.59:0/665656761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc55009d630 0x7fc5500a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.626+0000 7fc55773a700 1 -- 172.21.15.59:0/665656761 >> 172.21.15.59:0/665656761 conn(0x7fc5500a3050 msgr2=0x7fc5500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:32.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.627+0000 7fc55773a700 1 -- 172.21.15.59:0/665656761 shutdown_connections 2023-09-30T22:36:32.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.627+0000 7fc55773a700 1 -- 172.21.15.59:0/665656761 wait complete. 2023-09-30T22:36:32.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.628+0000 7fc55773a700 1 Processor -- start 2023-09-30T22:36:32.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.628+0000 7fc55773a700 1 -- start start 2023-09-30T22:36:32.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc55773a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc55009d630 0x7fc55011f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc55773a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5500a0a30 0x7fc55011f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc55773a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc550133930 0x7fc5501c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:32.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc55773a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc550121ed0 con 0x7fc55009d630 2023-09-30T22:36:32.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc55773a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc550133250 con 0x7fc5500a0a30 2023-09-30T22:36:32.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc55773a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc55011ee20 con 0x7fc550133930 2023-09-30T22:36:32.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc555cd7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc550133930 0x7fc5501c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc5554d6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc55009d630 0x7fc55011f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc554cd5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5500a0a30 0x7fc55011f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:32.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc555cd7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc550133930 0x7fc5501c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35162/0 (socket says 172.21.15.59:35162) 2023-09-30T22:36:32.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc555cd7700 1 -- 172.21.15.59:0/1167883299 learned_addr learned my addr 172.21.15.59:0/1167883299 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:32.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc554cd5700 1 -- 172.21.15.59:0/1167883299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc550133930 msgr2=0x7fc5501c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc554cd5700 1 --2- 172.21.15.59:0/1167883299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc550133930 0x7fc5501c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc554cd5700 1 -- 172.21.15.59:0/1167883299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc55009d630 msgr2=0x7fc55011f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc554cd5700 1 --2- 172.21.15.59:0/1167883299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc55009d630 0x7fc55011f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc554cd5700 1 -- 172.21.15.59:0/1167883299 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc548009a70 con 0x7fc5500a0a30 2023-09-30T22:36:32.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.629+0000 7fc555cd7700 1 --2- 172.21.15.59:0/1167883299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc550133930 0x7fc5501c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:32.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.630+0000 7fc554cd5700 1 --2- 172.21.15.59:0/1167883299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5500a0a30 0x7fc55011f800 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc54400e900 tx=0x7fc54400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:32.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.630+0000 7fc54dffb700 1 -- 172.21.15.59:0/1167883299 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544013680 con 0x7fc5500a0a30 2023-09-30T22:36:32.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.630+0000 7fc54dffb700 1 -- 172.21.15.59:0/1167883299 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5440137e0 con 0x7fc5500a0a30 2023-09-30T22:36:32.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.630+0000 7fc54dffb700 1 -- 172.21.15.59:0/1167883299 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544013b50 con 0x7fc5500a0a30 2023-09-30T22:36:32.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.630+0000 7fc55773a700 1 -- 172.21.15.59:0/1167883299 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc550122160 con 0x7fc5500a0a30 2023-09-30T22:36:32.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.630+0000 7fc55773a700 1 -- 172.21.15.59:0/1167883299 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55011fd40 con 0x7fc5500a0a30 2023-09-30T22:36:32.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.631+0000 7fc54dffb700 1 -- 172.21.15.59:0/1167883299 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc544013cb0 con 0x7fc5500a0a30 2023-09-30T22:36:32.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.631+0000 7fc55773a700 1 -- 172.21.15.59:0/1167883299 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc550120aa0 con 0x7fc5500a0a30 2023-09-30T22:36:32.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.631+0000 7fc54dffb700 1 -- 172.21.15.59:0/1167883299 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc54403f9f0 con 0x7fc5500a0a30 2023-09-30T22:36:32.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.636+0000 7fc54dffb700 1 -- 172.21.15.59:0/1167883299 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc54401ab90 con 0x7fc5500a0a30 2023-09-30T22:36:32.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.801+0000 7fc114423700 1 -- 172.21.15.59:0/3793447152 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc10c0747f0 con 0x7fc10c138d80 2023-09-30T22:36:32.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.801+0000 7fc102ffd700 1 -- 172.21.15.59:0/3793447152 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc104017020 con 0x7fc10c138d80 2023-09-30T22:36:32.802 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:32.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.803+0000 7fc114423700 1 -- 172.21.15.59:0/3793447152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc10c138d80 msgr2=0x7fc10c1342d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.803+0000 7fc114423700 1 --2- 172.21.15.59:0/3793447152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc10c138d80 0x7fc10c1342d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc10c06d8e0 tx=0x7fc10400eb30 comp rx=0 tx=0).stop 2023-09-30T22:36:32.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.803+0000 7fc114423700 1 -- 172.21.15.59:0/3793447152 shutdown_connections 2023-09-30T22:36:32.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.803+0000 7fc114423700 1 --2- 172.21.15.59:0/3793447152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc10c138d80 0x7fc10c1342d0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.804+0000 7fc114423700 1 --2- 172.21.15.59:0/3793447152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc10c09d630 0x7fc10c133850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.804+0000 7fc114423700 1 --2- 172.21.15.59:0/3793447152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10c0a0a30 0x7fc10c133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.804+0000 7fc114423700 1 -- 172.21.15.59:0/3793447152 >> 172.21.15.59:0/3793447152 conn(0x7fc10c0a3050 msgr2=0x7fc10c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:32.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.804+0000 7fc114423700 1 -- 172.21.15.59:0/3793447152 shutdown_connections 2023-09-30T22:36:32.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.804+0000 7fc114423700 1 -- 172.21.15.59:0/3793447152 wait complete. 2023-09-30T22:36:32.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:32.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.842+0000 7fc55773a700 1 -- 172.21.15.59:0/1167883299 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc550120cc0 con 0x7fc5500a0a30 2023-09-30T22:36:32.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.843+0000 7fc54dffb700 1 -- 172.21.15.59:0/1167883299 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc544017030 con 0x7fc5500a0a30 2023-09-30T22:36:32.843 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:32.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.845+0000 7fc55773a700 1 -- 172.21.15.59:0/1167883299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5500a0a30 msgr2=0x7fc55011f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:32.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.845+0000 7fc55773a700 1 --2- 172.21.15.59:0/1167883299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5500a0a30 0x7fc55011f800 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc54400e900 tx=0x7fc54400ec10 comp rx=0 tx=0).stop 2023-09-30T22:36:32.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.845+0000 7fc55773a700 1 -- 172.21.15.59:0/1167883299 shutdown_connections 2023-09-30T22:36:32.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.845+0000 7fc55773a700 1 --2- 172.21.15.59:0/1167883299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc550133930 0x7fc5501c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.845+0000 7fc55773a700 1 --2- 172.21.15.59:0/1167883299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc55009d630 0x7fc55011f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.845+0000 7fc55773a700 1 --2- 172.21.15.59:0/1167883299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5500a0a30 0x7fc55011f800 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:32.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.845+0000 7fc55773a700 1 -- 172.21.15.59:0/1167883299 >> 172.21.15.59:0/1167883299 conn(0x7fc5500a3050 msgr2=0x7fc5501bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:32.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.845+0000 7fc55773a700 1 -- 172.21.15.59:0/1167883299 shutdown_connections 2023-09-30T22:36:32.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:32.845+0000 7fc55773a700 1 -- 172.21.15.59:0/1167883299 wait complete. 2023-09-30T22:36:32.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:33.363 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:33.397 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:33.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.513+0000 7f8bbb10d700 1 Processor -- start 2023-09-30T22:36:33.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.513+0000 7f8bbb10d700 1 -- start start 2023-09-30T22:36:33.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.513+0000 7f8bbb10d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bb409d9f0 0x7f8bb4136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.513+0000 7f8bbb10d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb4136a70 0x7f8bb4138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.513+0000 7f8bbb10d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb409e130 con 0x7f8bb41316c0 2023-09-30T22:36:33.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.513+0000 7f8bbb10d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb41321a0 con 0x7f8bb409d9f0 2023-09-30T22:36:33.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.513+0000 7f8bbb10d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41312b0 con 0x7f8bb4136a70 2023-09-30T22:36:33.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.514+0000 7f8bb3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bb409d9f0 0x7f8bb4136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.514+0000 7f8bb3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bb409d9f0 0x7f8bb4136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41110/0 (socket says 172.21.15.59:41110) 2023-09-30T22:36:33.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.514+0000 7f8bb3fff700 1 -- 172.21.15.59:0/1307570110 learned_addr learned my addr 172.21.15.59:0/1307570110 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:33.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.514+0000 7f8bb96aa700 1 --2- 172.21.15.59:0/1307570110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb4136a70 0x7f8bb4138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.514+0000 7f8bb96aa700 1 -- 172.21.15.59:0/1307570110 >> v2:172.21.15.59:3300/0 conn(0x7f8bb409d9f0 msgr2=0x7f8bb4136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:33.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.514+0000 7f8bb96aa700 1 --2- 172.21.15.59:0/1307570110 >> v2:172.21.15.59:3300/0 conn(0x7f8bb409d9f0 0x7f8bb4136530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.514+0000 7f8bb96aa700 1 -- 172.21.15.59:0/1307570110 >> v1:172.21.15.59:6789/0 conn(0x7f8bb41316c0 legacy=0x7f8bb4131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:33.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.514+0000 7f8bb96aa700 1 -- 172.21.15.59:0/1307570110 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb409f6e0 con 0x7f8bb4136a70 2023-09-30T22:36:33.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.514+0000 7f8bb3fff700 1 --2- 172.21.15.59:0/1307570110 >> v2:172.21.15.59:3300/0 conn(0x7f8bb409d9f0 0x7f8bb4136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:33.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.514+0000 7f8bb96aa700 1 --2- 172.21.15.59:0/1307570110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb4136a70 0x7f8bb4138e50 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009dc0 tx=0x7f8bac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3555ca6651bc43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:33.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.514+0000 7f8bb37fe700 1 -- 172.21.15.59:0/1307570110 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac00e070 con 0x7f8bb4136a70 2023-09-30T22:36:33.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.514+0000 7f8bb37fe700 1 -- 172.21.15.59:0/1307570110 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac00bae0 con 0x7f8bb4136a70 2023-09-30T22:36:33.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.514+0000 7f8bb37fe700 1 -- 172.21.15.59:0/1307570110 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac00be90 con 0x7f8bb4136a70 2023-09-30T22:36:33.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.515+0000 7f8bbb10d700 1 -- 172.21.15.59:0/1307570110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb4136a70 msgr2=0x7f8bb4138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:33.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.515+0000 7f8bbb10d700 1 --2- 172.21.15.59:0/1307570110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb4136a70 0x7f8bb4138e50 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009dc0 tx=0x7f8bac00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:33.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.515+0000 7f8bbb10d700 1 -- 172.21.15.59:0/1307570110 shutdown_connections 2023-09-30T22:36:33.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.515+0000 7f8bbb10d700 1 --2- 172.21.15.59:0/1307570110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb4136a70 0x7f8bb4138e50 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.515+0000 7f8bbb10d700 1 --2- 172.21.15.59:0/1307570110 >> v2:172.21.15.59:3300/0 conn(0x7f8bb409d9f0 0x7f8bb4136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.515+0000 7f8bbb10d700 1 -- 172.21.15.59:0/1307570110 >> 172.21.15.59:0/1307570110 conn(0x7f8bb4066f50 msgr2=0x7f8bb409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:33.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.515+0000 7f8bbb10d700 1 -- 172.21.15.59:0/1307570110 shutdown_connections 2023-09-30T22:36:33.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.515+0000 7f8bbb10d700 1 -- 172.21.15.59:0/1307570110 wait complete. 2023-09-30T22:36:33.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.516+0000 7f8bbb10d700 1 Processor -- start 2023-09-30T22:36:33.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.516+0000 7f8bbb10d700 1 -- start start 2023-09-30T22:36:33.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.517+0000 7f8bbb10d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb409d9f0 0x7f8bb4070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.517+0000 7f8bbb10d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bb41316c0 0x7f8bb4071410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.517+0000 7f8bbb10d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb4136a70 0x7f8bb4071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.517+0000 7f8bbb10d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb406fb50 con 0x7f8bb4136a70 2023-09-30T22:36:33.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.517+0000 7f8bbb10d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb412b990 con 0x7f8bb409d9f0 2023-09-30T22:36:33.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.517+0000 7f8bbb10d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb406f920 con 0x7f8bb41316c0 2023-09-30T22:36:33.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.517+0000 7f8bb3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bb41316c0 0x7f8bb4071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.517+0000 7f8bb8ea9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb409d9f0 0x7f8bb4070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.517+0000 7f8bb3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bb41316c0 0x7f8bb4071410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35174/0 (socket says 172.21.15.59:35174) 2023-09-30T22:36:33.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.517+0000 7f8bb3fff700 1 -- 172.21.15.59:0/2131010465 learned_addr learned my addr 172.21.15.59:0/2131010465 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:33.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.517+0000 7f8bb96aa700 1 --2- 172.21.15.59:0/2131010465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb4136a70 0x7f8bb4071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.517+0000 7f8bb8ea9700 1 -- 172.21.15.59:0/2131010465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bb41316c0 msgr2=0x7f8bb4071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:33.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.517+0000 7f8bb8ea9700 1 --2- 172.21.15.59:0/2131010465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bb41316c0 0x7f8bb4071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.518+0000 7f8bb8ea9700 1 -- 172.21.15.59:0/2131010465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb4136a70 msgr2=0x7f8bb4071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:33.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.518+0000 7f8bb8ea9700 1 --2- 172.21.15.59:0/2131010465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb4136a70 0x7f8bb4071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.518+0000 7f8bb8ea9700 1 -- 172.21.15.59:0/2131010465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba8009550 con 0x7f8bb409d9f0 2023-09-30T22:36:33.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.518+0000 7f8bb3fff700 1 --2- 172.21.15.59:0/2131010465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bb41316c0 0x7f8bb4071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:33.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.518+0000 7f8bb8ea9700 1 --2- 172.21.15.59:0/2131010465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb409d9f0 0x7f8bb4070ed0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400c450 tx=0x7f8ba400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:33.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.518+0000 7f8bb17fa700 1 -- 172.21.15.59:0/2131010465 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba40052d0 con 0x7f8bb409d9f0 2023-09-30T22:36:33.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.518+0000 7f8bb17fa700 1 -- 172.21.15.59:0/2131010465 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba4005430 con 0x7f8bb409d9f0 2023-09-30T22:36:33.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.518+0000 7f8bb17fa700 1 -- 172.21.15.59:0/2131010465 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba40038c0 con 0x7f8bb409d9f0 2023-09-30T22:36:33.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.518+0000 7f8bbb10d700 1 -- 172.21.15.59:0/2131010465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bac009a70 con 0x7f8bb409d9f0 2023-09-30T22:36:33.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.518+0000 7f8bbb10d700 1 -- 172.21.15.59:0/2131010465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb406fd50 con 0x7f8bb409d9f0 2023-09-30T22:36:33.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.519+0000 7f8bb17fa700 1 -- 172.21.15.59:0/2131010465 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ba4003a20 con 0x7f8bb409d9f0 2023-09-30T22:36:33.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.519+0000 7f8bbb10d700 1 -- 172.21.15.59:0/2131010465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb40723f0 con 0x7f8bb409d9f0 2023-09-30T22:36:33.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.519+0000 7f8bb17fa700 1 -- 172.21.15.59:0/2131010465 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8ba403e7c0 con 0x7f8bb409d9f0 2023-09-30T22:36:33.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.524+0000 7f8bb17fa700 1 -- 172.21.15.59:0/2131010465 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ba4003cd0 con 0x7f8bb409d9f0 2023-09-30T22:36:33.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.551+0000 7f0334ace700 1 Processor -- start 2023-09-30T22:36:33.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.552+0000 7f0334ace700 1 -- start start 2023-09-30T22:36:33.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.552+0000 7f0334ace700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f033009d6f0 0x7f033009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.552+0000 7f0334ace700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f033009e000 0x7f0330130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.552+0000 7f0334ace700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f033009e410 0x7f0330130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.552+0000 7f0334ace700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033009f520 con 0x7f033009e410 2023-09-30T22:36:33.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.552+0000 7f0334ace700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033009f130 con 0x7f033009d6f0 2023-09-30T22:36:33.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.552+0000 7f0334ace700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f033009e930 con 0x7f033009e000 2023-09-30T22:36:33.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.552+0000 7f032dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f033009e000 0x7f0330130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.552+0000 7f032dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f033009e000 0x7f0330130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35176/0 (socket says 172.21.15.59:35176) 2023-09-30T22:36:33.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.552+0000 7f032dd9b700 1 -- 172.21.15.59:0/1934630575 learned_addr learned my addr 172.21.15.59:0/1934630575 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:33.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.552+0000 7f032e59c700 1 --2- 172.21.15.59:0/1934630575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f033009d6f0 0x7f033009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.552+0000 7f032ed9d700 1 --2- 172.21.15.59:0/1934630575 >> v2:172.21.15.59:3300/0 conn(0x7f033009e410 0x7f0330130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.553+0000 7f032ed9d700 1 -- 172.21.15.59:0/1934630575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f033009e000 msgr2=0x7f0330130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:33.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.553+0000 7f032ed9d700 1 --2- 172.21.15.59:0/1934630575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f033009e000 0x7f0330130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.553+0000 7f032ed9d700 1 -- 172.21.15.59:0/1934630575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f033009d6f0 msgr2=0x7f033009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:33.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.553+0000 7f032ed9d700 1 --2- 172.21.15.59:0/1934630575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f033009d6f0 0x7f033009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.553+0000 7f032ed9d700 1 -- 172.21.15.59:0/1934630575 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033009b2d0 con 0x7f033009e410 2023-09-30T22:36:33.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.553+0000 7f032e59c700 1 --2- 172.21.15.59:0/1934630575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f033009d6f0 0x7f033009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:33.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.553+0000 7f032ed9d700 1 --2- 172.21.15.59:0/1934630575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f033009e410 0x7f0330130ba0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f032800bfa0 tx=0x7f032800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72389dc9fd1db7cc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:33.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.553+0000 7f032d59a700 1 -- 172.21.15.59:0/1934630575 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328010070 con 0x7f033009e410 2023-09-30T22:36:33.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.553+0000 7f032d59a700 1 -- 172.21.15.59:0/1934630575 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032800b2e0 con 0x7f033009e410 2023-09-30T22:36:33.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.553+0000 7f032d59a700 1 -- 172.21.15.59:0/1934630575 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032800dc40 con 0x7f033009e410 2023-09-30T22:36:33.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.554+0000 7f0334ace700 1 -- 172.21.15.59:0/1934630575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f033009e410 msgr2=0x7f0330130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:33.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.554+0000 7f0334ace700 1 --2- 172.21.15.59:0/1934630575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f033009e410 0x7f0330130ba0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f032800bfa0 tx=0x7f032800d330 comp rx=0 tx=0).stop 2023-09-30T22:36:33.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.554+0000 7f0334ace700 1 -- 172.21.15.59:0/1934630575 shutdown_connections 2023-09-30T22:36:33.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.554+0000 7f0334ace700 1 --2- 172.21.15.59:0/1934630575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f033009e410 0x7f0330130ba0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.554+0000 7f0334ace700 1 --2- 172.21.15.59:0/1934630575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f033009d6f0 0x7f033009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.554+0000 7f0334ace700 1 --2- 172.21.15.59:0/1934630575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f033009e000 0x7f0330130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.554+0000 7f0334ace700 1 -- 172.21.15.59:0/1934630575 >> 172.21.15.59:0/1934630575 conn(0x7f0330066f50 msgr2=0x7f033009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:33.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.554+0000 7f0334ace700 1 -- 172.21.15.59:0/1934630575 shutdown_connections 2023-09-30T22:36:33.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.554+0000 7f0334ace700 1 -- 172.21.15.59:0/1934630575 wait complete. 2023-09-30T22:36:33.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.555+0000 7f0334ace700 1 Processor -- start 2023-09-30T22:36:33.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.555+0000 7f0334ace700 1 -- start start 2023-09-30T22:36:33.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f0334ace700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f033009d6f0 0x7f033011df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f0334ace700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f033009e000 0x7f033011e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f0334ace700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f033009e410 0x7f033011e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f0334ace700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0330120110 con 0x7f033009e410 2023-09-30T22:36:33.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f0334ace700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0330120dd0 con 0x7f033009d6f0 2023-09-30T22:36:33.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f0334ace700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03300a1560 con 0x7f033009e000 2023-09-30T22:36:33.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f032e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f033009d6f0 0x7f033011df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f032ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f033009e410 0x7f033011e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f032e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f033009d6f0 0x7f033011df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41266/0 (socket says 172.21.15.59:41266) 2023-09-30T22:36:33.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f032e59c700 1 -- 172.21.15.59:0/3092433913 learned_addr learned my addr 172.21.15.59:0/3092433913 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:33.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f032dd9b700 1 --2- 172.21.15.59:0/3092433913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f033009e000 0x7f033011e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f032e59c700 1 -- 172.21.15.59:0/3092433913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f033009e000 msgr2=0x7f033011e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:33.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f032e59c700 1 --2- 172.21.15.59:0/3092433913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f033009e000 0x7f033011e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f032e59c700 1 -- 172.21.15.59:0/3092433913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f033009e410 msgr2=0x7f033011e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f032e59c700 1 --2- 172.21.15.59:0/3092433913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f033009e410 0x7f033011e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.556+0000 7f032e59c700 1 -- 172.21.15.59:0/3092433913 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03200094a0 con 0x7f033009d6f0 2023-09-30T22:36:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.557+0000 7f032e59c700 1 --2- 172.21.15.59:0/3092433913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f033009d6f0 0x7f033011df30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f032000ebe0 tx=0x7f032000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.557+0000 7f031effd700 1 -- 172.21.15.59:0/3092433913 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320009780 con 0x7f033009d6f0 2023-09-30T22:36:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.557+0000 7f031effd700 1 -- 172.21.15.59:0/3092433913 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032000c850 con 0x7f033009d6f0 2023-09-30T22:36:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.557+0000 7f0334ace700 1 -- 172.21.15.59:0/3092433913 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032800bc80 con 0x7f033009d6f0 2023-09-30T22:36:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.557+0000 7f031effd700 1 -- 172.21.15.59:0/3092433913 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032000cbe0 con 0x7f033009d6f0 2023-09-30T22:36:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.557+0000 7f0334ace700 1 -- 172.21.15.59:0/3092433913 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03301211e0 con 0x7f033009d6f0 2023-09-30T22:36:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.558+0000 7f031effd700 1 -- 172.21.15.59:0/3092433913 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f032000cd40 con 0x7f033009d6f0 2023-09-30T22:36:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.558+0000 7f031effd700 1 -- 172.21.15.59:0/3092433913 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f032003fae0 con 0x7f033009d6f0 2023-09-30T22:36:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.558+0000 7f0334ace700 1 -- 172.21.15.59:0/3092433913 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033011ac20 con 0x7f033009d6f0 2023-09-30T22:36:33.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.567+0000 7f031effd700 1 -- 172.21.15.59:0/3092433913 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0320021020 con 0x7f033009d6f0 2023-09-30T22:36:33.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.737+0000 7f8bbb10d700 1 -- 172.21.15.59:0/2131010465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8bb409e130 con 0x7f8bb409d9f0 2023-09-30T22:36:33.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.737+0000 7f8bb17fa700 1 -- 172.21.15.59:0/2131010465 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bb409e130 con 0x7f8bb409d9f0 2023-09-30T22:36:33.738 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:33.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.739+0000 7f8bbb10d700 1 -- 172.21.15.59:0/2131010465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb409d9f0 msgr2=0x7f8bb4070ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:33.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.739+0000 7f8bbb10d700 1 --2- 172.21.15.59:0/2131010465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb409d9f0 0x7f8bb4070ed0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400c450 tx=0x7f8ba400c760 comp rx=0 tx=0).stop 2023-09-30T22:36:33.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.740+0000 7f8bbb10d700 1 -- 172.21.15.59:0/2131010465 shutdown_connections 2023-09-30T22:36:33.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.740+0000 7f8bbb10d700 1 --2- 172.21.15.59:0/2131010465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb4136a70 0x7f8bb4071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.740+0000 7f8bbb10d700 1 --2- 172.21.15.59:0/2131010465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb409d9f0 0x7f8bb4070ed0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.740+0000 7f8bbb10d700 1 --2- 172.21.15.59:0/2131010465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bb41316c0 0x7f8bb4071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.740+0000 7f8bbb10d700 1 -- 172.21.15.59:0/2131010465 >> 172.21.15.59:0/2131010465 conn(0x7f8bb4066f50 msgr2=0x7f8bb4130ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:33.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.740+0000 7f8bbb10d700 1 -- 172.21.15.59:0/2131010465 shutdown_connections 2023-09-30T22:36:33.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.740+0000 7f8bbb10d700 1 -- 172.21.15.59:0/2131010465 wait complete. 2023-09-30T22:36:33.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:33.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.773+0000 7f0334ace700 1 -- 172.21.15.59:0/3092433913 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0330074ea0 con 0x7f033009d6f0 2023-09-30T22:36:33.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.773+0000 7f031effd700 1 -- 172.21.15.59:0/3092433913 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f032001b3b0 con 0x7f033009d6f0 2023-09-30T22:36:33.774 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.776+0000 7f0334ace700 1 -- 172.21.15.59:0/3092433913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f033009d6f0 msgr2=0x7f033011df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.776+0000 7f0334ace700 1 --2- 172.21.15.59:0/3092433913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f033009d6f0 0x7f033011df30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f032000ebe0 tx=0x7f032000eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.776+0000 7f0334ace700 1 -- 172.21.15.59:0/3092433913 shutdown_connections 2023-09-30T22:36:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.776+0000 7f0334ace700 1 --2- 172.21.15.59:0/3092433913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f033009e410 0x7f033011e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.776+0000 7f0334ace700 1 --2- 172.21.15.59:0/3092433913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f033009d6f0 0x7f033011df30 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.776+0000 7f0334ace700 1 --2- 172.21.15.59:0/3092433913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f033009e000 0x7f033011e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.776+0000 7f0334ace700 1 -- 172.21.15.59:0/3092433913 >> 172.21.15.59:0/3092433913 conn(0x7f0330066f50 msgr2=0x7f0330130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.776+0000 7f0334ace700 1 -- 172.21.15.59:0/3092433913 shutdown_connections 2023-09-30T22:36:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.776+0000 7f0334ace700 1 -- 172.21.15.59:0/3092433913 wait complete. 2023-09-30T22:36:33.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:33.818 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:33.860 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:33.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.972+0000 7f4cb6c94700 1 Processor -- start 2023-09-30T22:36:33.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.972+0000 7f4cb6c94700 1 -- start start 2023-09-30T22:36:33.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.972+0000 7f4cb6c94700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4cb00a0a30 0x7f4cb00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.972+0000 7f4cb6c94700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb0138d80 0x7f4cb013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.972+0000 7f4cb6c94700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb00a2a70 con 0x7f4cb009d630 2023-09-30T22:36:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.972+0000 7f4cb6c94700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb00a01d0 con 0x7f4cb00a0a30 2023-09-30T22:36:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.972+0000 7f4cb6c94700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb009e2b0 con 0x7f4cb0138d80 2023-09-30T22:36:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.972+0000 7f4cb4a30700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4cb00a0a30 0x7f4cb00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.972+0000 7f4cb5231700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb0138d80 0x7f4cb013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.972+0000 7f4cb4a30700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4cb00a0a30 0x7f4cb00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41144/0 (socket says 172.21.15.59:41144) 2023-09-30T22:36:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.972+0000 7f4cb4a30700 1 -- 172.21.15.59:0/1182404898 learned_addr learned my addr 172.21.15.59:0/1182404898 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.973+0000 7f4cb4a30700 1 -- 172.21.15.59:0/1182404898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb0138d80 msgr2=0x7f4cb013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.973+0000 7f4cb4a30700 1 --2- 172.21.15.59:0/1182404898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb0138d80 0x7f4cb013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.973+0000 7f4cb4a30700 1 -- 172.21.15.59:0/1182404898 >> v1:172.21.15.59:6789/0 conn(0x7f4cb009d630 legacy=0x7f4cb00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:33.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.973+0000 7f4cb4a30700 1 -- 172.21.15.59:0/1182404898 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb009dc50 con 0x7f4cb00a0a30 2023-09-30T22:36:33.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.973+0000 7f4cb5231700 1 --2- 172.21.15.59:0/1182404898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb0138d80 0x7f4cb013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:33.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.973+0000 7f4cb4a30700 1 --2- 172.21.15.59:0/1182404898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb00a0a30 0x7f4cb00a0e00 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009e50 tx=0x7f4ca800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e182db942633ee3c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:33.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.973+0000 7f4caf7fe700 1 -- 172.21.15.59:0/1182404898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca800e070 con 0x7f4cb00a0a30 2023-09-30T22:36:33.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.973+0000 7f4caf7fe700 1 -- 172.21.15.59:0/1182404898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca800b910 con 0x7f4cb00a0a30 2023-09-30T22:36:33.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.973+0000 7f4caf7fe700 1 -- 172.21.15.59:0/1182404898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca800bcc0 con 0x7f4cb00a0a30 2023-09-30T22:36:33.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.974+0000 7f4cb6c94700 1 -- 172.21.15.59:0/1182404898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb00a0a30 msgr2=0x7f4cb00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:33.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.974+0000 7f4cb6c94700 1 --2- 172.21.15.59:0/1182404898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb00a0a30 0x7f4cb00a0e00 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009e50 tx=0x7f4ca800b330 comp rx=0 tx=0).stop 2023-09-30T22:36:33.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.974+0000 7f4cb6c94700 1 -- 172.21.15.59:0/1182404898 shutdown_connections 2023-09-30T22:36:33.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.974+0000 7f4cb6c94700 1 --2- 172.21.15.59:0/1182404898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb0138d80 0x7f4cb013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.974+0000 7f4cb6c94700 1 --2- 172.21.15.59:0/1182404898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb00a0a30 0x7f4cb00a0e00 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.974+0000 7f4cb6c94700 1 -- 172.21.15.59:0/1182404898 >> 172.21.15.59:0/1182404898 conn(0x7f4cb00a3050 msgr2=0x7f4cb00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:33.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.974+0000 7f4cb6c94700 1 -- 172.21.15.59:0/1182404898 shutdown_connections 2023-09-30T22:36:33.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.974+0000 7f4cb6c94700 1 -- 172.21.15.59:0/1182404898 wait complete. 2023-09-30T22:36:33.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.975+0000 7f4cb6c94700 1 Processor -- start 2023-09-30T22:36:33.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.976+0000 7f4cb6c94700 1 -- start start 2023-09-30T22:36:33.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.976+0000 7f4cb6c94700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb009d630 0x7f4cb0120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.976+0000 7f4cb6c94700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb00a0a30 0x7f4cb0120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.976+0000 7f4cb6c94700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb0138d80 0x7f4cb0121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:33.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.976+0000 7f4cb6c94700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb00a0410 con 0x7f4cb00a0a30 2023-09-30T22:36:33.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.976+0000 7f4cb6c94700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb0123ed0 con 0x7f4cb009d630 2023-09-30T22:36:33.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.976+0000 7f4cb6c94700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb0121b60 con 0x7f4cb0138d80 2023-09-30T22:36:33.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4caffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb00a0a30 0x7f4cb0120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4cb4a30700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb009d630 0x7f4cb0120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4cb4a30700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb009d630 0x7f4cb0120700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41276/0 (socket says 172.21.15.59:41276) 2023-09-30T22:36:33.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4caffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb00a0a30 0x7f4cb0120c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41154/0 (socket says 172.21.15.59:41154) 2023-09-30T22:36:33.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4cb4a30700 1 -- 172.21.15.59:0/2973499215 learned_addr learned my addr 172.21.15.59:0/2973499215 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:33.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4cb5231700 1 --2- 172.21.15.59:0/2973499215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb0138d80 0x7f4cb0121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:33.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4caffff700 1 -- 172.21.15.59:0/2973499215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb0138d80 msgr2=0x7f4cb0121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:33.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4caffff700 1 --2- 172.21.15.59:0/2973499215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb0138d80 0x7f4cb0121180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4caffff700 1 -- 172.21.15.59:0/2973499215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb009d630 msgr2=0x7f4cb0120700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:33.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4caffff700 1 --2- 172.21.15.59:0/2973499215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb009d630 0x7f4cb0120700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:33.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4caffff700 1 -- 172.21.15.59:0/2973499215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca00094a0 con 0x7f4cb00a0a30 2023-09-30T22:36:33.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4cb4a30700 1 --2- 172.21.15.59:0/2973499215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb009d630 0x7f4cb0120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:33.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4caffff700 1 --2- 172.21.15.59:0/2973499215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb00a0a30 0x7f4cb0120c40 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800c450 tx=0x7f4c9800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:33.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4cad7fa700 1 -- 172.21.15.59:0/2973499215 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c980052d0 con 0x7f4cb00a0a30 2023-09-30T22:36:33.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4cad7fa700 1 -- 172.21.15.59:0/2973499215 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c98005430 con 0x7f4cb00a0a30 2023-09-30T22:36:33.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4cad7fa700 1 -- 172.21.15.59:0/2973499215 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c980038c0 con 0x7f4cb00a0a30 2023-09-30T22:36:33.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.977+0000 7f4cb6c94700 1 -- 172.21.15.59:0/2973499215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca8009b30 con 0x7f4cb00a0a30 2023-09-30T22:36:33.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.978+0000 7f4cb6c94700 1 -- 172.21.15.59:0/2973499215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb0122a90 con 0x7f4cb00a0a30 2023-09-30T22:36:33.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.978+0000 7f4cad7fa700 1 -- 172.21.15.59:0/2973499215 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c98003a20 con 0x7f4cb00a0a30 2023-09-30T22:36:33.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.979+0000 7f4cb6c94700 1 -- 172.21.15.59:0/2973499215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb0123b70 con 0x7f4cb00a0a30 2023-09-30T22:36:33.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.979+0000 7f4cad7fa700 1 -- 172.21.15.59:0/2973499215 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4c9803e9b0 con 0x7f4cb00a0a30 2023-09-30T22:36:33.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:33.984+0000 7f4cad7fa700 1 -- 172.21.15.59:0/2973499215 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c98011590 con 0x7f4cb00a0a30 2023-09-30T22:36:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.015+0000 7fcf36a87700 1 Processor -- start 2023-09-30T22:36:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.015+0000 7fcf36a87700 1 -- start start 2023-09-30T22:36:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.015+0000 7fcf36a87700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf300a0a30 0x7fcf300a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.015+0000 7fcf36a87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf3009d630 0x7fcf300a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.015+0000 7fcf36a87700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf300a2a70 con 0x7fcf30133930 2023-09-30T22:36:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf36a87700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf300a01d0 con 0x7fcf300a0a30 2023-09-30T22:36:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf36a87700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3009e2b0 con 0x7fcf3009d630 2023-09-30T22:36:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf34823700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf300a0a30 0x7fcf300a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf34823700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf300a0a30 0x7fcf300a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41166/0 (socket says 172.21.15.59:41166) 2023-09-30T22:36:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf35024700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcf30133930 0x7fcf30133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59242/0 (socket says 172.21.15.59:59242) 2023-09-30T22:36:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf34823700 1 -- 172.21.15.59:0/3161262197 learned_addr learned my addr 172.21.15.59:0/3161262197 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf2ffff700 1 --2- 172.21.15.59:0/3161262197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf3009d630 0x7fcf300a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf34823700 1 -- 172.21.15.59:0/3161262197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf3009d630 msgr2=0x7fcf300a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:34.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf34823700 1 --2- 172.21.15.59:0/3161262197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf3009d630 0x7fcf300a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf34823700 1 -- 172.21.15.59:0/3161262197 >> v1:172.21.15.59:6789/0 conn(0x7fcf30133930 legacy=0x7fcf30133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:34.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf34823700 1 -- 172.21.15.59:0/3161262197 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3009dc50 con 0x7fcf300a0a30 2023-09-30T22:36:34.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf2f7fe700 1 -- 172.21.15.59:0/3161262197 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594574982 0 0) 0x7fcf300a2a70 con 0x7fcf30133930 2023-09-30T22:36:34.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf2ffff700 1 --2- 172.21.15.59:0/3161262197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf3009d630 0x7fcf300a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:34.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf34823700 1 --2- 172.21.15.59:0/3161262197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf300a0a30 0x7fcf300a0e00 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fcf240098f0 tx=0x7fcf24009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b009728db866cac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:34.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf2f7fe700 1 -- 172.21.15.59:0/3161262197 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24011830 con 0x7fcf300a0a30 2023-09-30T22:36:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf2f7fe700 1 -- 172.21.15.59:0/3161262197 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf24011990 con 0x7fcf300a0a30 2023-09-30T22:36:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.016+0000 7fcf2f7fe700 1 -- 172.21.15.59:0/3161262197 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24011d20 con 0x7fcf300a0a30 2023-09-30T22:36:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.017+0000 7fcf36a87700 1 -- 172.21.15.59:0/3161262197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf300a0a30 msgr2=0x7fcf300a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.017+0000 7fcf36a87700 1 --2- 172.21.15.59:0/3161262197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf300a0a30 0x7fcf300a0e00 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fcf240098f0 tx=0x7fcf24009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.017+0000 7fcf36a87700 1 -- 172.21.15.59:0/3161262197 shutdown_connections 2023-09-30T22:36:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.017+0000 7fcf36a87700 1 --2- 172.21.15.59:0/3161262197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf300a0a30 0x7fcf300a0e00 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.017+0000 7fcf36a87700 1 --2- 172.21.15.59:0/3161262197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf3009d630 0x7fcf300a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.017+0000 7fcf36a87700 1 -- 172.21.15.59:0/3161262197 >> 172.21.15.59:0/3161262197 conn(0x7fcf300a3050 msgr2=0x7fcf300a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:34.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.017+0000 7fcf36a87700 1 -- 172.21.15.59:0/3161262197 shutdown_connections 2023-09-30T22:36:34.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.017+0000 7fcf36a87700 1 -- 172.21.15.59:0/3161262197 wait complete. 2023-09-30T22:36:34.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.018+0000 7fcf36a87700 1 Processor -- start 2023-09-30T22:36:34.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.018+0000 7fcf36a87700 1 -- start start 2023-09-30T22:36:34.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf36a87700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf3009d630 0x7fcf301c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf36a87700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf300a0a30 0x7fcf301c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf36a87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf30133930 0x7fcf301c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf36a87700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30120620 con 0x7fcf300a0a30 2023-09-30T22:36:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf36a87700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300a42c0 con 0x7fcf30133930 2023-09-30T22:36:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf36a87700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300a0410 con 0x7fcf3009d630 2023-09-30T22:36:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf2ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf300a0a30 0x7fcf301c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf35024700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf30133930 0x7fcf301c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf2ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf300a0a30 0x7fcf301c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41170/0 (socket says 172.21.15.59:41170) 2023-09-30T22:36:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf2ffff700 1 -- 172.21.15.59:0/1540044284 learned_addr learned my addr 172.21.15.59:0/1540044284 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf35024700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf30133930 0x7fcf301c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41296/0 (socket says 172.21.15.59:41296) 2023-09-30T22:36:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf34823700 1 --2- 172.21.15.59:0/1540044284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf3009d630 0x7fcf301c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf35024700 1 -- 172.21.15.59:0/1540044284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf3009d630 msgr2=0x7fcf301c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:34.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf35024700 1 --2- 172.21.15.59:0/1540044284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf3009d630 0x7fcf301c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf35024700 1 -- 172.21.15.59:0/1540044284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf300a0a30 msgr2=0x7fcf301c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:34.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf35024700 1 --2- 172.21.15.59:0/1540044284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf300a0a30 0x7fcf301c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf35024700 1 -- 172.21.15.59:0/1540044284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c0094a0 con 0x7fcf30133930 2023-09-30T22:36:34.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.019+0000 7fcf2ffff700 1 --2- 172.21.15.59:0/1540044284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf300a0a30 0x7fcf301c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:34.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.020+0000 7fcf35024700 1 --2- 172.21.15.59:0/1540044284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf30133930 0x7fcf301c8900 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800cc10 tx=0x7fcf2800cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:34.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.020+0000 7fcf2d7fa700 1 -- 172.21.15.59:0/1540044284 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2800aa00 con 0x7fcf30133930 2023-09-30T22:36:34.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.020+0000 7fcf2d7fa700 1 -- 172.21.15.59:0/1540044284 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2800ab80 con 0x7fcf30133930 2023-09-30T22:36:34.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.020+0000 7fcf36a87700 1 -- 172.21.15.59:0/1540044284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf24009550 con 0x7fcf30133930 2023-09-30T22:36:34.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.020+0000 7fcf2d7fa700 1 -- 172.21.15.59:0/1540044284 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf280070d0 con 0x7fcf30133930 2023-09-30T22:36:34.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.020+0000 7fcf36a87700 1 -- 172.21.15.59:0/1540044284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf301334c0 con 0x7fcf30133930 2023-09-30T22:36:34.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.021+0000 7fcf2d7fa700 1 -- 172.21.15.59:0/1540044284 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf28007230 con 0x7fcf30133930 2023-09-30T22:36:34.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.021+0000 7fcf2d7fa700 1 -- 172.21.15.59:0/1540044284 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcf2803f420 con 0x7fcf30133930 2023-09-30T22:36:34.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.021+0000 7fcf36a87700 1 -- 172.21.15.59:0/1540044284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf300747f0 con 0x7fcf30133930 2023-09-30T22:36:34.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.026+0000 7fcf2d7fa700 1 -- 172.21.15.59:0/1540044284 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf28018070 con 0x7fcf30133930 2023-09-30T22:36:34.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.193+0000 7f4cb6c94700 1 -- 172.21.15.59:0/2973499215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4cb0124a00 con 0x7f4cb00a0a30 2023-09-30T22:36:34.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.194+0000 7f4cad7fa700 1 -- 172.21.15.59:0/2973499215 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c98017030 con 0x7f4cb00a0a30 2023-09-30T22:36:34.195 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:34.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.196+0000 7f4cb6c94700 1 -- 172.21.15.59:0/2973499215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb00a0a30 msgr2=0x7f4cb0120c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:34.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.196+0000 7f4cb6c94700 1 --2- 172.21.15.59:0/2973499215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb00a0a30 0x7f4cb0120c40 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800c450 tx=0x7f4c9800c760 comp rx=0 tx=0).stop 2023-09-30T22:36:34.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.196+0000 7f4cb6c94700 1 -- 172.21.15.59:0/2973499215 shutdown_connections 2023-09-30T22:36:34.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.196+0000 7f4cb6c94700 1 --2- 172.21.15.59:0/2973499215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb0138d80 0x7f4cb0121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.196+0000 7f4cb6c94700 1 --2- 172.21.15.59:0/2973499215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb009d630 0x7f4cb0120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.196+0000 7f4cb6c94700 1 --2- 172.21.15.59:0/2973499215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb00a0a30 0x7f4cb0120c40 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.196+0000 7f4cb6c94700 1 -- 172.21.15.59:0/2973499215 >> 172.21.15.59:0/2973499215 conn(0x7f4cb00a3050 msgr2=0x7f4cb009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.196+0000 7f4cb6c94700 1 -- 172.21.15.59:0/2973499215 shutdown_connections 2023-09-30T22:36:34.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.196+0000 7f4cb6c94700 1 -- 172.21.15.59:0/2973499215 wait complete. 2023-09-30T22:36:34.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:34.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.231+0000 7fcf36a87700 1 -- 172.21.15.59:0/1540044284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcf30072980 con 0x7fcf30133930 2023-09-30T22:36:34.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.231+0000 7fcf2d7fa700 1 -- 172.21.15.59:0/1540044284 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf280074e0 con 0x7fcf30133930 2023-09-30T22:36:34.233 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:34.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.234+0000 7fcf36a87700 1 -- 172.21.15.59:0/1540044284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf30133930 msgr2=0x7fcf301c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:34.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.234+0000 7fcf36a87700 1 --2- 172.21.15.59:0/1540044284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf30133930 0x7fcf301c8900 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800cc10 tx=0x7fcf2800cf20 comp rx=0 tx=0).stop 2023-09-30T22:36:34.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.234+0000 7fcf36a87700 1 -- 172.21.15.59:0/1540044284 shutdown_connections 2023-09-30T22:36:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.234+0000 7fcf36a87700 1 --2- 172.21.15.59:0/1540044284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf3009d630 0x7fcf301c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.234+0000 7fcf36a87700 1 --2- 172.21.15.59:0/1540044284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf30133930 0x7fcf301c8900 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.234+0000 7fcf36a87700 1 --2- 172.21.15.59:0/1540044284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf300a0a30 0x7fcf301c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.234+0000 7fcf36a87700 1 -- 172.21.15.59:0/1540044284 >> 172.21.15.59:0/1540044284 conn(0x7fcf300a3050 msgr2=0x7fcf301bb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.234+0000 7fcf36a87700 1 -- 172.21.15.59:0/1540044284 shutdown_connections 2023-09-30T22:36:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.234+0000 7fcf36a87700 1 -- 172.21.15.59:0/1540044284 wait complete. 2023-09-30T22:36:34.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:34.755 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:34.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:34.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.901+0000 7fab5603a700 1 Processor -- start 2023-09-30T22:36:34.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.901+0000 7fab5603a700 1 -- start start 2023-09-30T22:36:34.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab5603a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab500a0a30 0x7fab500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab5603a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5009d630 0x7fab500a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab5603a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab50133930 0x7fab50133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab5603a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab500a2a70 con 0x7fab50133930 2023-09-30T22:36:34.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab5603a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab500a01d0 con 0x7fab5009d630 2023-09-30T22:36:34.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab5603a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab5009e2b0 con 0x7fab500a0a30 2023-09-30T22:36:34.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab4f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab500a0a30 0x7fab500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab4ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab50133930 0x7fab50133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab4effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5009d630 0x7fab500a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab4f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab500a0a30 0x7fab500a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44260/0 (socket says 172.21.15.59:44260) 2023-09-30T22:36:34.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab4ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab50133930 0x7fab50133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39240/0 (socket says 172.21.15.59:39240) 2023-09-30T22:36:34.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab4f7fe700 1 -- 172.21.15.59:0/4166889526 learned_addr learned my addr 172.21.15.59:0/4166889526 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:34.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab4effd700 1 -- 172.21.15.59:0/4166889526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab500a0a30 msgr2=0x7fab500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:34.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab4effd700 1 --2- 172.21.15.59:0/4166889526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab500a0a30 0x7fab500a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab4effd700 1 -- 172.21.15.59:0/4166889526 >> v2:172.21.15.59:3300/0 conn(0x7fab50133930 msgr2=0x7fab50133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:34.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab4effd700 1 --2- 172.21.15.59:0/4166889526 >> v2:172.21.15.59:3300/0 conn(0x7fab50133930 0x7fab50133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab4effd700 1 -- 172.21.15.59:0/4166889526 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5009dc50 con 0x7fab5009d630 2023-09-30T22:36:34.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab4f7fe700 1 --2- 172.21.15.59:0/4166889526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab500a0a30 0x7fab500a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:34.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.902+0000 7fab4ffff700 1 --2- 172.21.15.59:0/4166889526 >> v2:172.21.15.59:3300/0 conn(0x7fab50133930 0x7fab50133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:34.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.903+0000 7fab4effd700 1 --2- 172.21.15.59:0/4166889526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5009d630 0x7fab500a1340 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fab44009840 tx=0x7fab44009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=930567504370711f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:34.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.903+0000 7fab4e7fc700 1 -- 172.21.15.59:0/4166889526 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44011830 con 0x7fab5009d630 2023-09-30T22:36:34.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.903+0000 7fab4e7fc700 1 -- 172.21.15.59:0/4166889526 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab44011990 con 0x7fab5009d630 2023-09-30T22:36:34.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.903+0000 7fab4e7fc700 1 -- 172.21.15.59:0/4166889526 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44011d20 con 0x7fab5009d630 2023-09-30T22:36:34.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.903+0000 7fab5603a700 1 -- 172.21.15.59:0/4166889526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5009d630 msgr2=0x7fab500a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:34.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.903+0000 7fab5603a700 1 --2- 172.21.15.59:0/4166889526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5009d630 0x7fab500a1340 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fab44009840 tx=0x7fab44009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:34.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.904+0000 7fab5603a700 1 -- 172.21.15.59:0/4166889526 shutdown_connections 2023-09-30T22:36:34.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.904+0000 7fab5603a700 1 --2- 172.21.15.59:0/4166889526 >> v2:172.21.15.59:3300/0 conn(0x7fab50133930 0x7fab50133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.904+0000 7fab5603a700 1 --2- 172.21.15.59:0/4166889526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab500a0a30 0x7fab500a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.904+0000 7fab5603a700 1 --2- 172.21.15.59:0/4166889526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5009d630 0x7fab500a1340 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.904+0000 7fab5603a700 1 -- 172.21.15.59:0/4166889526 >> 172.21.15.59:0/4166889526 conn(0x7fab500a3050 msgr2=0x7fab500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:34.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.904+0000 7fab5603a700 1 -- 172.21.15.59:0/4166889526 shutdown_connections 2023-09-30T22:36:34.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.904+0000 7fab5603a700 1 -- 172.21.15.59:0/4166889526 wait complete. 2023-09-30T22:36:34.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.905+0000 7fab5603a700 1 Processor -- start 2023-09-30T22:36:34.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.905+0000 7fab5603a700 1 -- start start 2023-09-30T22:36:34.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.905+0000 7fab5603a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5009d630 0x7fab501c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.905+0000 7fab5603a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab500a0a30 0x7fab501c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.905+0000 7fab5603a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab50133930 0x7fab5011e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.905+0000 7fab5603a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab501bcf70 con 0x7fab5009d630 2023-09-30T22:36:34.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.905+0000 7fab5603a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab501c8f60 con 0x7fab500a0a30 2023-09-30T22:36:34.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.905+0000 7fab5603a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab50121db0 con 0x7fab50133930 2023-09-30T22:36:34.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.905+0000 7fab4f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5009d630 0x7fab501c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.905+0000 7fab4ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab50133930 0x7fab5011e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.906+0000 7fab4f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5009d630 0x7fab501c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39246/0 (socket says 172.21.15.59:39246) 2023-09-30T22:36:34.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.906+0000 7fab4effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab500a0a30 0x7fab501c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.906+0000 7fab4f7fe700 1 -- 172.21.15.59:0/391862248 learned_addr learned my addr 172.21.15.59:0/391862248 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:34.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.906+0000 7fab4ffff700 1 -- 172.21.15.59:0/391862248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab500a0a30 msgr2=0x7fab501c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:34.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.906+0000 7fab4ffff700 1 --2- 172.21.15.59:0/391862248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab500a0a30 0x7fab501c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.906+0000 7fab4ffff700 1 -- 172.21.15.59:0/391862248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5009d630 msgr2=0x7fab501c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:34.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.906+0000 7fab4ffff700 1 --2- 172.21.15.59:0/391862248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5009d630 0x7fab501c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.906+0000 7fab4ffff700 1 -- 172.21.15.59:0/391862248 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40009b30 con 0x7fab50133930 2023-09-30T22:36:34.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.906+0000 7fab4effd700 1 --2- 172.21.15.59:0/391862248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab500a0a30 0x7fab501c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:34.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.906+0000 7fab4ffff700 1 --2- 172.21.15.59:0/391862248 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab50133930 0x7fab5011e960 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fab4800e910 tx=0x7fab4800ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:34.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.906+0000 7fab37fff700 1 -- 172.21.15.59:0/391862248 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48004020 con 0x7fab50133930 2023-09-30T22:36:34.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.906+0000 7fab37fff700 1 -- 172.21.15.59:0/391862248 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab480041a0 con 0x7fab50133930 2023-09-30T22:36:34.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.906+0000 7fab37fff700 1 -- 172.21.15.59:0/391862248 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48004550 con 0x7fab50133930 2023-09-30T22:36:34.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.906+0000 7fab5603a700 1 -- 172.21.15.59:0/391862248 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab480094a0 con 0x7fab50133930 2023-09-30T22:36:34.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.906+0000 7fab5603a700 1 -- 172.21.15.59:0/391862248 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab440094a0 con 0x7fab50133930 2023-09-30T22:36:34.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.907+0000 7fab37fff700 1 -- 172.21.15.59:0/391862248 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab480036a0 con 0x7fab50133930 2023-09-30T22:36:34.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.907+0000 7fab37fff700 1 -- 172.21.15.59:0/391862248 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab4803f6f0 con 0x7fab50133930 2023-09-30T22:36:34.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.908+0000 7fab5603a700 1 -- 172.21.15.59:0/391862248 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab500a0410 con 0x7fab50133930 2023-09-30T22:36:34.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.917+0000 7fab37fff700 1 -- 172.21.15.59:0/391862248 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab48013680 con 0x7fab50133930 2023-09-30T22:36:34.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.943+0000 7f5356310700 1 Processor -- start 2023-09-30T22:36:34.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.943+0000 7f5356310700 1 -- start start 2023-09-30T22:36:34.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.944+0000 7f5356310700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53500a0a30 0x7f53500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.944+0000 7f5356310700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5350138d80 0x7f535013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.944+0000 7f5356310700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53500a2a70 con 0x7f535009d630 2023-09-30T22:36:34.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.944+0000 7f5356310700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53500a01d0 con 0x7f5350138d80 2023-09-30T22:36:34.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.944+0000 7f5356310700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f535009e2b0 con 0x7f53500a0a30 2023-09-30T22:36:34.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.944+0000 7f534ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53500a0a30 0x7f53500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.944+0000 7f53548ad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5350138d80 0x7f535013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.944+0000 7f534ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53500a0a30 0x7f53500a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44286/0 (socket says 172.21.15.59:44286) 2023-09-30T22:36:34.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.944+0000 7f53548ad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5350138d80 0x7f535013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39250/0 (socket says 172.21.15.59:39250) 2023-09-30T22:36:34.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.944+0000 7f534ffff700 1 -- 172.21.15.59:0/1170405262 learned_addr learned my addr 172.21.15.59:0/1170405262 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:34.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.944+0000 7f534ffff700 1 -- 172.21.15.59:0/1170405262 >> v2:172.21.15.59:3300/0 conn(0x7f5350138d80 msgr2=0x7f535013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:34.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.944+0000 7f534ffff700 1 --2- 172.21.15.59:0/1170405262 >> v2:172.21.15.59:3300/0 conn(0x7f5350138d80 0x7f535013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.944+0000 7f534ffff700 1 -- 172.21.15.59:0/1170405262 >> v1:172.21.15.59:6789/0 conn(0x7f535009d630 legacy=0x7f53500a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:34.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.944+0000 7f534ffff700 1 -- 172.21.15.59:0/1170405262 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535009dc50 con 0x7f53500a0a30 2023-09-30T22:36:34.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.944+0000 7f53548ad700 1 --2- 172.21.15.59:0/1170405262 >> v2:172.21.15.59:3300/0 conn(0x7f5350138d80 0x7f535013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:34.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.945+0000 7f534ffff700 1 --2- 172.21.15.59:0/1170405262 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53500a0a30 0x7f53500a0e00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f53400098f0 tx=0x7f5340009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12591a8f66597074 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:34.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.945+0000 7f534effd700 1 -- 172.21.15.59:0/1170405262 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340011830 con 0x7f53500a0a30 2023-09-30T22:36:34.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.945+0000 7f534effd700 1 -- 172.21.15.59:0/1170405262 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5340011990 con 0x7f53500a0a30 2023-09-30T22:36:34.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.945+0000 7f534effd700 1 -- 172.21.15.59:0/1170405262 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340011d20 con 0x7f53500a0a30 2023-09-30T22:36:34.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.945+0000 7f5356310700 1 -- 172.21.15.59:0/1170405262 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53500a0a30 msgr2=0x7f53500a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:34.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.945+0000 7f5356310700 1 --2- 172.21.15.59:0/1170405262 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53500a0a30 0x7f53500a0e00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f53400098f0 tx=0x7f5340009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:34.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.945+0000 7f5356310700 1 -- 172.21.15.59:0/1170405262 shutdown_connections 2023-09-30T22:36:34.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.945+0000 7f5356310700 1 --2- 172.21.15.59:0/1170405262 >> v2:172.21.15.59:3300/0 conn(0x7f5350138d80 0x7f535013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.945+0000 7f5356310700 1 --2- 172.21.15.59:0/1170405262 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53500a0a30 0x7f53500a0e00 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.945+0000 7f5356310700 1 -- 172.21.15.59:0/1170405262 >> 172.21.15.59:0/1170405262 conn(0x7f53500a3050 msgr2=0x7f53500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:34.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.945+0000 7f5356310700 1 -- 172.21.15.59:0/1170405262 shutdown_connections 2023-09-30T22:36:34.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.945+0000 7f5356310700 1 -- 172.21.15.59:0/1170405262 wait complete. 2023-09-30T22:36:34.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.946+0000 7f5356310700 1 Processor -- start 2023-09-30T22:36:34.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.947+0000 7f5356310700 1 -- start start 2023-09-30T22:36:34.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.947+0000 7f5356310700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f535009d630 0x7f53501208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.947+0000 7f5356310700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53500a0a30 0x7f5350120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.947+0000 7f5356310700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5350138d80 0x7f5350121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:34.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.947+0000 7f5356310700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5350122470 con 0x7f53500a0a30 2023-09-30T22:36:34.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.947+0000 7f5356310700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53501237c0 con 0x7f535009d630 2023-09-30T22:36:34.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.947+0000 7f5356310700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5350121d50 con 0x7f5350138d80 2023-09-30T22:36:34.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.947+0000 7f53548ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5350138d80 0x7f5350121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.947+0000 7f534f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53500a0a30 0x7f5350120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.947+0000 7f53548ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5350138d80 0x7f5350121370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44290/0 (socket says 172.21.15.59:44290) 2023-09-30T22:36:34.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.947+0000 7f53548ad700 1 -- 172.21.15.59:0/3299005319 learned_addr learned my addr 172.21.15.59:0/3299005319 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:34.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.947+0000 7f534ffff700 1 --2- 172.21.15.59:0/3299005319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f535009d630 0x7f53501208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:34.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.948+0000 7f53548ad700 1 -- 172.21.15.59:0/3299005319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f535009d630 msgr2=0x7f53501208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:34.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.948+0000 7f53548ad700 1 --2- 172.21.15.59:0/3299005319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f535009d630 0x7f53501208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.948+0000 7f53548ad700 1 -- 172.21.15.59:0/3299005319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53500a0a30 msgr2=0x7f5350120e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:34.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.948+0000 7f53548ad700 1 --2- 172.21.15.59:0/3299005319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53500a0a30 0x7f5350120e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:34.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.948+0000 7f53548ad700 1 -- 172.21.15.59:0/3299005319 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5348009a70 con 0x7f5350138d80 2023-09-30T22:36:34.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.948+0000 7f534f7fe700 1 --2- 172.21.15.59:0/3299005319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53500a0a30 0x7f5350120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:34.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.948+0000 7f53548ad700 1 --2- 172.21.15.59:0/3299005319 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5350138d80 0x7f5350121370 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f534800efc0 tx=0x7f534800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:34.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.948+0000 7f534cff9700 1 -- 172.21.15.59:0/3299005319 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800cc90 con 0x7f5350138d80 2023-09-30T22:36:34.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.948+0000 7f534cff9700 1 -- 172.21.15.59:0/3299005319 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534800f040 con 0x7f5350138d80 2023-09-30T22:36:34.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.948+0000 7f5356310700 1 -- 172.21.15.59:0/3299005319 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5340009550 con 0x7f5350138d80 2023-09-30T22:36:34.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.948+0000 7f534cff9700 1 -- 172.21.15.59:0/3299005319 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53480146c0 con 0x7f5350138d80 2023-09-30T22:36:34.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.948+0000 7f5356310700 1 -- 172.21.15.59:0/3299005319 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53501243d0 con 0x7f5350138d80 2023-09-30T22:36:34.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.949+0000 7f534cff9700 1 -- 172.21.15.59:0/3299005319 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5348014820 con 0x7f5350138d80 2023-09-30T22:36:34.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.949+0000 7f534cff9700 1 -- 172.21.15.59:0/3299005319 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f53480401c0 con 0x7f5350138d80 2023-09-30T22:36:34.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.949+0000 7f5356310700 1 -- 172.21.15.59:0/3299005319 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53501243d0 con 0x7f5350138d80 2023-09-30T22:36:34.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:34.954+0000 7f534cff9700 1 -- 172.21.15.59:0/3299005319 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53501243d0 con 0x7f5350138d80 2023-09-30T22:36:35.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.124+0000 7fab5603a700 1 -- 172.21.15.59:0/391862248 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fab500747f0 con 0x7fab50133930 2023-09-30T22:36:35.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.124+0000 7fab37fff700 1 -- 172.21.15.59:0/391862248 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab48020030 con 0x7fab50133930 2023-09-30T22:36:35.126 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:35.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.127+0000 7fab5603a700 1 -- 172.21.15.59:0/391862248 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab50133930 msgr2=0x7fab5011e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:35.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.127+0000 7fab5603a700 1 --2- 172.21.15.59:0/391862248 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab50133930 0x7fab5011e960 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fab4800e910 tx=0x7fab4800ec20 comp rx=0 tx=0).stop 2023-09-30T22:36:35.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.127+0000 7fab5603a700 1 -- 172.21.15.59:0/391862248 shutdown_connections 2023-09-30T22:36:35.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.127+0000 7fab5603a700 1 --2- 172.21.15.59:0/391862248 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab50133930 0x7fab5011e960 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.127+0000 7fab5603a700 1 --2- 172.21.15.59:0/391862248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5009d630 0x7fab501c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.127+0000 7fab5603a700 1 --2- 172.21.15.59:0/391862248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab500a0a30 0x7fab501c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.127+0000 7fab5603a700 1 -- 172.21.15.59:0/391862248 >> 172.21.15.59:0/391862248 conn(0x7fab500a3050 msgr2=0x7fab5009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:35.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.127+0000 7fab5603a700 1 -- 172.21.15.59:0/391862248 shutdown_connections 2023-09-30T22:36:35.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.127+0000 7fab5603a700 1 -- 172.21.15.59:0/391862248 wait complete. 2023-09-30T22:36:35.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:35.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.160+0000 7f5356310700 1 -- 172.21.15.59:0/3299005319 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f53501243d0 con 0x7f5350138d80 2023-09-30T22:36:35.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.161+0000 7f534cff9700 1 -- 172.21.15.59:0/3299005319 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53501243d0 con 0x7f5350138d80 2023-09-30T22:36:35.162 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.163+0000 7f5356310700 1 -- 172.21.15.59:0/3299005319 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5350138d80 msgr2=0x7f5350121370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:35.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.163+0000 7f5356310700 1 --2- 172.21.15.59:0/3299005319 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5350138d80 0x7f5350121370 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f534800efc0 tx=0x7f534800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.163+0000 7f5356310700 1 -- 172.21.15.59:0/3299005319 shutdown_connections 2023-09-30T22:36:35.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.163+0000 7f5356310700 1 --2- 172.21.15.59:0/3299005319 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5350138d80 0x7f5350121370 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.163+0000 7f5356310700 1 --2- 172.21.15.59:0/3299005319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f535009d630 0x7f53501208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.163+0000 7f5356310700 1 --2- 172.21.15.59:0/3299005319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53500a0a30 0x7f5350120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.163+0000 7f5356310700 1 -- 172.21.15.59:0/3299005319 >> 172.21.15.59:0/3299005319 conn(0x7f53500a3050 msgr2=0x7f5350139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:35.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.163+0000 7f5356310700 1 -- 172.21.15.59:0/3299005319 shutdown_connections 2023-09-30T22:36:35.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.163+0000 7f5356310700 1 -- 172.21.15.59:0/3299005319 wait complete. 2023-09-30T22:36:35.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:35.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:35.250 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:35.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.360+0000 7f30ceef3700 1 Processor -- start 2023-09-30T22:36:35.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.360+0000 7f30ceef3700 1 -- start start 2023-09-30T22:36:35.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.360+0000 7f30ceef3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c809d630 0x7f30c80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:35.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.360+0000 7f30ceef3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30c8138d80 0x7f30c813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:35.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30ceef3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c80a2a70 con 0x7f30c80a0a30 2023-09-30T22:36:35.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30ceef3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c80a01d0 con 0x7f30c8138d80 2023-09-30T22:36:35.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30ceef3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c809e2b0 con 0x7f30c809d630 2023-09-30T22:36:35.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30ccc8f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f30c80a0a30 0x7f30c80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33880/0 (socket says 172.21.15.59:33880) 2023-09-30T22:36:35.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30ccc8f700 1 -- 172.21.15.59:0/4214253843 learned_addr learned my addr 172.21.15.59:0/4214253843 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30c7fff700 1 --2- 172.21.15.59:0/4214253843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c809d630 0x7f30c80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30cd490700 1 --2- 172.21.15.59:0/4214253843 >> v2:172.21.15.59:3300/0 conn(0x7f30c8138d80 0x7f30c813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30c7fff700 1 -- 172.21.15.59:0/4214253843 >> v2:172.21.15.59:3300/0 conn(0x7f30c8138d80 msgr2=0x7f30c813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30c7fff700 1 --2- 172.21.15.59:0/4214253843 >> v2:172.21.15.59:3300/0 conn(0x7f30c8138d80 0x7f30c813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30c7fff700 1 -- 172.21.15.59:0/4214253843 >> v1:172.21.15.59:6789/0 conn(0x7f30c80a0a30 legacy=0x7f30c80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30c7fff700 1 -- 172.21.15.59:0/4214253843 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c809dc50 con 0x7f30c809d630 2023-09-30T22:36:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30cd490700 1 --2- 172.21.15.59:0/4214253843 >> v2:172.21.15.59:3300/0 conn(0x7f30c8138d80 0x7f30c813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30c7fff700 1 --2- 172.21.15.59:0/4214253843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c809d630 0x7f30c80a1510 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009840 tx=0x7f30b4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=333aa1facfd6fb67 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30c77fe700 1 -- 172.21.15.59:0/4214253843 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4011830 con 0x7f30c809d630 2023-09-30T22:36:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30c77fe700 1 -- 172.21.15.59:0/4214253843 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4011990 con 0x7f30c809d630 2023-09-30T22:36:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.361+0000 7f30c77fe700 1 -- 172.21.15.59:0/4214253843 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4011d20 con 0x7f30c809d630 2023-09-30T22:36:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.362+0000 7f30ceef3700 1 -- 172.21.15.59:0/4214253843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c809d630 msgr2=0x7f30c80a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.362+0000 7f30ceef3700 1 --2- 172.21.15.59:0/4214253843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c809d630 0x7f30c80a1510 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009840 tx=0x7f30b4009b50 comp rx=0 tx=0).stop 2023-09-30T22:36:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.362+0000 7f30ceef3700 1 -- 172.21.15.59:0/4214253843 shutdown_connections 2023-09-30T22:36:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.362+0000 7f30ceef3700 1 --2- 172.21.15.59:0/4214253843 >> v2:172.21.15.59:3300/0 conn(0x7f30c8138d80 0x7f30c813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.362+0000 7f30ceef3700 1 --2- 172.21.15.59:0/4214253843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c809d630 0x7f30c80a1510 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.362+0000 7f30ceef3700 1 -- 172.21.15.59:0/4214253843 >> 172.21.15.59:0/4214253843 conn(0x7f30c80a3050 msgr2=0x7f30c80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.362+0000 7f30ceef3700 1 -- 172.21.15.59:0/4214253843 shutdown_connections 2023-09-30T22:36:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.362+0000 7f30ceef3700 1 -- 172.21.15.59:0/4214253843 wait complete. 2023-09-30T22:36:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.363+0000 7f30ceef3700 1 Processor -- start 2023-09-30T22:36:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.363+0000 7f30ceef3700 1 -- start start 2023-09-30T22:36:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.364+0000 7f30ceef3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c809d630 0x7f30c8133b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.364+0000 7f30ceef3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c80a0a30 0x7f30c8134090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.364+0000 7f30ceef3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c8138d80 0x7f30c81345d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.364+0000 7f30ceef3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c8135010 con 0x7f30c80a0a30 2023-09-30T22:36:35.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.364+0000 7f30ceef3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c813afc0 con 0x7f30c809d630 2023-09-30T22:36:35.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.364+0000 7f30ceef3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30c8135c30 con 0x7f30c8138d80 2023-09-30T22:36:35.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.364+0000 7f30c7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c80a0a30 0x7f30c8134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:35.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.364+0000 7f30cd490700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c8138d80 0x7f30c81345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:35.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.364+0000 7f30c7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c80a0a30 0x7f30c8134090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39270/0 (socket says 172.21.15.59:39270) 2023-09-30T22:36:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.364+0000 7f30c7fff700 1 -- 172.21.15.59:0/1111520671 learned_addr learned my addr 172.21.15.59:0/1111520671 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.364+0000 7f30ccc8f700 1 --2- 172.21.15.59:0/1111520671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c809d630 0x7f30c8133b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.365+0000 7f30cd490700 1 -- 172.21.15.59:0/1111520671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c809d630 msgr2=0x7f30c8133b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.365+0000 7f30cd490700 1 --2- 172.21.15.59:0/1111520671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c809d630 0x7f30c8133b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.365+0000 7f30cd490700 1 -- 172.21.15.59:0/1111520671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c80a0a30 msgr2=0x7f30c8134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.365+0000 7f30cd490700 1 --2- 172.21.15.59:0/1111520671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c80a0a30 0x7f30c8134090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.365+0000 7f30cd490700 1 -- 172.21.15.59:0/1111520671 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c0009a70 con 0x7f30c8138d80 2023-09-30T22:36:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.365+0000 7f30c7fff700 1 --2- 172.21.15.59:0/1111520671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c80a0a30 0x7f30c8134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.365+0000 7f30cd490700 1 --2- 172.21.15.59:0/1111520671 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c8138d80 0x7f30c81345d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f30c000efc0 tx=0x7f30c000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:35.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.365+0000 7f30c57fa700 1 -- 172.21.15.59:0/1111520671 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c000ca90 con 0x7f30c8138d80 2023-09-30T22:36:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.365+0000 7f30c57fa700 1 -- 172.21.15.59:0/1111520671 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c000f040 con 0x7f30c8138d80 2023-09-30T22:36:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.365+0000 7f30ceef3700 1 -- 172.21.15.59:0/1111520671 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b40094a0 con 0x7f30c8138d80 2023-09-30T22:36:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.365+0000 7f30c57fa700 1 -- 172.21.15.59:0/1111520671 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c000ce30 con 0x7f30c8138d80 2023-09-30T22:36:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.365+0000 7f30ceef3700 1 -- 172.21.15.59:0/1111520671 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c8137590 con 0x7f30c8138d80 2023-09-30T22:36:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.366+0000 7f30c57fa700 1 -- 172.21.15.59:0/1111520671 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30c0014480 con 0x7f30c8138d80 2023-09-30T22:36:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.366+0000 7f30ceef3700 1 -- 172.21.15.59:0/1111520671 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c80747f0 con 0x7f30c8138d80 2023-09-30T22:36:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.366+0000 7f30c57fa700 1 -- 172.21.15.59:0/1111520671 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f30c003fd40 con 0x7f30c8138d80 2023-09-30T22:36:35.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.375+0000 7f30c57fa700 1 -- 172.21.15.59:0/1111520671 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30c0012700 con 0x7f30c8138d80 2023-09-30T22:36:35.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.404+0000 7fe0ba21b700 1 Processor -- start 2023-09-30T22:36:35.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.405+0000 7fe0ba21b700 1 -- start start 2023-09-30T22:36:35.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.405+0000 7fe0ba21b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0b40a0a30 0x7fe0b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:35.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.405+0000 7fe0ba21b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe0b4134170 0x7fe0b413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:35.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.405+0000 7fe0ba21b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b409edd0 con 0x7fe0b40a1340 2023-09-30T22:36:35.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.405+0000 7fe0ba21b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b409e1f0 con 0x7fe0b4134170 2023-09-30T22:36:35.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.405+0000 7fe0ba21b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b409dc50 con 0x7fe0b40a0a30 2023-09-30T22:36:35.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.405+0000 7fe0b37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0b40a0a30 0x7fe0b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:35.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.405+0000 7fe0b37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0b40a0a30 0x7fe0b40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44304/0 (socket says 172.21.15.59:44304) 2023-09-30T22:36:35.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.405+0000 7fe0b37fe700 1 -- 172.21.15.59:0/2012296508 learned_addr learned my addr 172.21.15.59:0/2012296508 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:35.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.405+0000 7fe0b3fff700 1 --2- 172.21.15.59:0/2012296508 >> v2:172.21.15.59:3300/0 conn(0x7fe0b4134170 0x7fe0b413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:35.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.406+0000 7fe0b3fff700 1 -- 172.21.15.59:0/2012296508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0b40a0a30 msgr2=0x7fe0b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:35.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.406+0000 7fe0b3fff700 1 --2- 172.21.15.59:0/2012296508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0b40a0a30 0x7fe0b40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.406+0000 7fe0b3fff700 1 -- 172.21.15.59:0/2012296508 >> v1:172.21.15.59:6789/0 conn(0x7fe0b40a1340 legacy=0x7fe0b4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:35.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.406+0000 7fe0b3fff700 1 -- 172.21.15.59:0/2012296508 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b40a1fe0 con 0x7fe0b4134170 2023-09-30T22:36:35.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.406+0000 7fe0b37fe700 1 --2- 172.21.15.59:0/2012296508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0b40a0a30 0x7fe0b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:35.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.406+0000 7fe0b3fff700 1 --2- 172.21.15.59:0/2012296508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b4134170 0x7fe0b413bd30 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009d90 tx=0x7fe0ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69a26bfaa674297 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:35.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.406+0000 7fe0b27fc700 1 -- 172.21.15.59:0/2012296508 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac00e070 con 0x7fe0b4134170 2023-09-30T22:36:35.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.406+0000 7fe0b27fc700 1 -- 172.21.15.59:0/2012296508 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac00bb20 con 0x7fe0b4134170 2023-09-30T22:36:35.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.406+0000 7fe0b27fc700 1 -- 172.21.15.59:0/2012296508 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac012430 con 0x7fe0b4134170 2023-09-30T22:36:35.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.407+0000 7fe0ba21b700 1 -- 172.21.15.59:0/2012296508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b4134170 msgr2=0x7fe0b413bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:35.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.407+0000 7fe0ba21b700 1 --2- 172.21.15.59:0/2012296508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b4134170 0x7fe0b413bd30 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009d90 tx=0x7fe0ac00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:35.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.407+0000 7fe0ba21b700 1 -- 172.21.15.59:0/2012296508 shutdown_connections 2023-09-30T22:36:35.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.407+0000 7fe0ba21b700 1 --2- 172.21.15.59:0/2012296508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b4134170 0x7fe0b413bd30 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.407+0000 7fe0ba21b700 1 --2- 172.21.15.59:0/2012296508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0b40a0a30 0x7fe0b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.407+0000 7fe0ba21b700 1 -- 172.21.15.59:0/2012296508 >> 172.21.15.59:0/2012296508 conn(0x7fe0b40a6550 msgr2=0x7fe0b40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:35.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.407+0000 7fe0ba21b700 1 -- 172.21.15.59:0/2012296508 shutdown_connections 2023-09-30T22:36:35.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.407+0000 7fe0ba21b700 1 -- 172.21.15.59:0/2012296508 wait complete. 2023-09-30T22:36:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.408+0000 7fe0ba21b700 1 Processor -- start 2023-09-30T22:36:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.408+0000 7fe0ba21b700 1 -- start start 2023-09-30T22:36:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0ba21b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0b40a0a30 0x7fe0b41228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0ba21b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0b40a1340 0x7fe0b4122de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0ba21b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b4134170 0x7fe0b4123320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0ba21b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4124650 con 0x7fe0b4134170 2023-09-30T22:36:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0ba21b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4124420 con 0x7fe0b40a1340 2023-09-30T22:36:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0ba21b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4125d90 con 0x7fe0b40a0a30 2023-09-30T22:36:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0b2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0b40a1340 0x7fe0b4122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0b2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0b40a1340 0x7fe0b4122de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47214/0 (socket says 172.21.15.59:47214) 2023-09-30T22:36:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0b2ffd700 1 -- 172.21.15.59:0/1286983307 learned_addr learned my addr 172.21.15.59:0/1286983307 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0b3fff700 1 --2- 172.21.15.59:0/1286983307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b4134170 0x7fe0b4123320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0b37fe700 1 --2- 172.21.15.59:0/1286983307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0b40a0a30 0x7fe0b41228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0b37fe700 1 -- 172.21.15.59:0/1286983307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0b40a1340 msgr2=0x7fe0b4122de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0b37fe700 1 --2- 172.21.15.59:0/1286983307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0b40a1340 0x7fe0b4122de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0b37fe700 1 -- 172.21.15.59:0/1286983307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b4134170 msgr2=0x7fe0b4123320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0b37fe700 1 --2- 172.21.15.59:0/1286983307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b4134170 0x7fe0b4123320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0b37fe700 1 -- 172.21.15.59:0/1286983307 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a4009550 con 0x7fe0b40a0a30 2023-09-30T22:36:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0b2ffd700 1 --2- 172.21.15.59:0/1286983307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0b40a1340 0x7fe0b4122de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe0b37fe700 1 --2- 172.21.15.59:0/1286983307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0b40a0a30 0x7fe0b41228a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400e9d0 tx=0x7fe0a400ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.409+0000 7fe09bfff700 1 -- 172.21.15.59:0/1286983307 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a400ee70 con 0x7fe0b40a0a30 2023-09-30T22:36:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.410+0000 7fe09bfff700 1 -- 172.21.15.59:0/1286983307 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a4004030 con 0x7fe0b40a0a30 2023-09-30T22:36:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.410+0000 7fe0ba21b700 1 -- 172.21.15.59:0/1286983307 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac009a70 con 0x7fe0b40a0a30 2023-09-30T22:36:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.410+0000 7fe09bfff700 1 -- 172.21.15.59:0/1286983307 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a40043c0 con 0x7fe0b40a0a30 2023-09-30T22:36:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.410+0000 7fe0ba21b700 1 -- 172.21.15.59:0/1286983307 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b40a0220 con 0x7fe0b40a0a30 2023-09-30T22:36:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.410+0000 7fe09bfff700 1 -- 172.21.15.59:0/1286983307 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe0a400c850 con 0x7fe0b40a0a30 2023-09-30T22:36:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.411+0000 7fe09bfff700 1 -- 172.21.15.59:0/1286983307 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe0a403f8b0 con 0x7fe0b40a0a30 2023-09-30T22:36:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.411+0000 7fe0ba21b700 1 -- 172.21.15.59:0/1286983307 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b40a1d00 con 0x7fe0b40a0a30 2023-09-30T22:36:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.416+0000 7fe09bfff700 1 -- 172.21.15.59:0/1286983307 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0a4020080 con 0x7fe0b40a0a30 2023-09-30T22:36:35.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.585+0000 7f30ceef3700 1 -- 172.21.15.59:0/1111520671 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f30c8072980 con 0x7f30c8138d80 2023-09-30T22:36:35.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.586+0000 7f30c57fa700 1 -- 172.21.15.59:0/1111520671 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30c000b0b0 con 0x7f30c8138d80 2023-09-30T22:36:35.587 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:35.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.588+0000 7f30ceef3700 1 -- 172.21.15.59:0/1111520671 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c8138d80 msgr2=0x7f30c81345d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:35.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.588+0000 7f30ceef3700 1 --2- 172.21.15.59:0/1111520671 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c8138d80 0x7f30c81345d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f30c000efc0 tx=0x7f30c000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.588+0000 7f30ceef3700 1 -- 172.21.15.59:0/1111520671 shutdown_connections 2023-09-30T22:36:35.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.588+0000 7f30ceef3700 1 --2- 172.21.15.59:0/1111520671 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c8138d80 0x7f30c81345d0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.588+0000 7f30ceef3700 1 --2- 172.21.15.59:0/1111520671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c809d630 0x7f30c8133b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.588+0000 7f30ceef3700 1 --2- 172.21.15.59:0/1111520671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c80a0a30 0x7f30c8134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.588+0000 7f30ceef3700 1 -- 172.21.15.59:0/1111520671 >> 172.21.15.59:0/1111520671 conn(0x7f30c80a3050 msgr2=0x7f30c809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:35.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.588+0000 7f30ceef3700 1 -- 172.21.15.59:0/1111520671 shutdown_connections 2023-09-30T22:36:35.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.588+0000 7f30ceef3700 1 -- 172.21.15.59:0/1111520671 wait complete. 2023-09-30T22:36:35.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.623+0000 7fe0ba21b700 1 -- 172.21.15.59:0/1286983307 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe0b4074ea0 con 0x7fe0b40a0a30 2023-09-30T22:36:35.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.624+0000 7fe09bfff700 1 -- 172.21.15.59:0/1286983307 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0a4011d90 con 0x7fe0b40a0a30 2023-09-30T22:36:35.625 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.626+0000 7fe0ba21b700 1 -- 172.21.15.59:0/1286983307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0b40a0a30 msgr2=0x7fe0b41228a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:35.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.626+0000 7fe0ba21b700 1 --2- 172.21.15.59:0/1286983307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0b40a0a30 0x7fe0b41228a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400e9d0 tx=0x7fe0a400ece0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.626+0000 7fe0ba21b700 1 -- 172.21.15.59:0/1286983307 shutdown_connections 2023-09-30T22:36:35.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.626+0000 7fe0ba21b700 1 --2- 172.21.15.59:0/1286983307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe0b40a0a30 0x7fe0b41228a0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.626+0000 7fe0ba21b700 1 --2- 172.21.15.59:0/1286983307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b4134170 0x7fe0b4123320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.626+0000 7fe0ba21b700 1 --2- 172.21.15.59:0/1286983307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0b40a1340 0x7fe0b4122de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:35.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.626+0000 7fe0ba21b700 1 -- 172.21.15.59:0/1286983307 >> 172.21.15.59:0/1286983307 conn(0x7fe0b40a6550 msgr2=0x7fe0b409ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:35.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.626+0000 7fe0ba21b700 1 -- 172.21.15.59:0/1286983307 shutdown_connections 2023-09-30T22:36:35.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:35.626+0000 7fe0ba21b700 1 -- 172.21.15.59:0/1286983307 wait complete. 2023-09-30T22:36:35.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:36.143 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:36.179 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:36.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.290+0000 7fc22575e700 1 Processor -- start 2023-09-30T22:36:36.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.290+0000 7fc22575e700 1 -- start start 2023-09-30T22:36:36.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.291+0000 7fc22575e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc22006a770 0x7fc22006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.291+0000 7fc22575e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc220131d10 0x7fc220139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.291+0000 7fc22575e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22009ece0 con 0x7fc22006b080 2023-09-30T22:36:36.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.291+0000 7fc22575e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22009e760 con 0x7fc220131d10 2023-09-30T22:36:36.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.291+0000 7fc22575e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc22009e040 con 0x7fc22006a770 2023-09-30T22:36:36.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.291+0000 7fc21effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc22006a770 0x7fc22006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.291+0000 7fc21f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc220131d10 0x7fc220139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.291+0000 7fc21effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc22006a770 0x7fc22006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44326/0 (socket says 172.21.15.59:44326) 2023-09-30T22:36:36.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.291+0000 7fc21effd700 1 -- 172.21.15.59:0/2006494970 learned_addr learned my addr 172.21.15.59:0/2006494970 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:36.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.291+0000 7fc21effd700 1 -- 172.21.15.59:0/2006494970 >> v2:172.21.15.59:3300/0 conn(0x7fc220131d10 msgr2=0x7fc220139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:36.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.291+0000 7fc21effd700 1 --2- 172.21.15.59:0/2006494970 >> v2:172.21.15.59:3300/0 conn(0x7fc220131d10 0x7fc220139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.291+0000 7fc21effd700 1 -- 172.21.15.59:0/2006494970 >> v1:172.21.15.59:6789/0 conn(0x7fc22006b080 legacy=0x7fc220131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.291+0000 7fc21effd700 1 -- 172.21.15.59:0/2006494970 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22009f630 con 0x7fc22006a770 2023-09-30T22:36:36.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.291+0000 7fc21f7fe700 1 --2- 172.21.15.59:0/2006494970 >> v2:172.21.15.59:3300/0 conn(0x7fc220131d10 0x7fc220139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:36.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.292+0000 7fc21effd700 1 --2- 172.21.15.59:0/2006494970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc22006a770 0x7fc22006ab40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc2100098f0 tx=0x7fc210009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6c1ac7a2f41f7b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.292+0000 7fc21dffb700 1 -- 172.21.15.59:0/2006494970 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc210011830 con 0x7fc22006a770 2023-09-30T22:36:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.292+0000 7fc21dffb700 1 -- 172.21.15.59:0/2006494970 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc210011990 con 0x7fc22006a770 2023-09-30T22:36:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.292+0000 7fc21dffb700 1 -- 172.21.15.59:0/2006494970 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc210011d20 con 0x7fc22006a770 2023-09-30T22:36:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.292+0000 7fc22575e700 1 -- 172.21.15.59:0/2006494970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc22006a770 msgr2=0x7fc22006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.292+0000 7fc22575e700 1 --2- 172.21.15.59:0/2006494970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc22006a770 0x7fc22006ab40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc2100098f0 tx=0x7fc210009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.292+0000 7fc22575e700 1 -- 172.21.15.59:0/2006494970 shutdown_connections 2023-09-30T22:36:36.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.292+0000 7fc22575e700 1 --2- 172.21.15.59:0/2006494970 >> v2:172.21.15.59:3300/0 conn(0x7fc220131d10 0x7fc220139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.292+0000 7fc22575e700 1 --2- 172.21.15.59:0/2006494970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc22006a770 0x7fc22006ab40 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.292+0000 7fc22575e700 1 -- 172.21.15.59:0/2006494970 >> 172.21.15.59:0/2006494970 conn(0x7fc220066f50 msgr2=0x7fc22009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:36.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.293+0000 7fc22575e700 1 -- 172.21.15.59:0/2006494970 shutdown_connections 2023-09-30T22:36:36.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.293+0000 7fc22575e700 1 -- 172.21.15.59:0/2006494970 wait complete. 2023-09-30T22:36:36.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.294+0000 7fc22575e700 1 Processor -- start 2023-09-30T22:36:36.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.294+0000 7fc22575e700 1 -- start start 2023-09-30T22:36:36.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc22575e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc22006a770 0x7fc220120fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc22575e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc22006b080 0x7fc220121500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc22575e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc220131d10 0x7fc2201c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc22575e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc220124030 con 0x7fc220131d10 2023-09-30T22:36:36.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc22575e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc220122bd0 con 0x7fc22006a770 2023-09-30T22:36:36.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc22575e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc220124210 con 0x7fc22006b080 2023-09-30T22:36:36.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc21e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc22006b080 0x7fc220121500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc21f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc220131d10 0x7fc2201c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc21f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc220131d10 0x7fc2201c60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39310/0 (socket says 172.21.15.59:39310) 2023-09-30T22:36:36.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc21f7fe700 1 -- 172.21.15.59:0/1547564730 learned_addr learned my addr 172.21.15.59:0/1547564730 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:36.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc21e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc22006b080 0x7fc220121500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44336/0 (socket says 172.21.15.59:44336) 2023-09-30T22:36:36.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc21effd700 1 --2- 172.21.15.59:0/1547564730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc22006a770 0x7fc220120fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc21f7fe700 1 -- 172.21.15.59:0/1547564730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc22006b080 msgr2=0x7fc220121500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc21f7fe700 1 --2- 172.21.15.59:0/1547564730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc22006b080 0x7fc220121500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc21f7fe700 1 -- 172.21.15.59:0/1547564730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc22006a770 msgr2=0x7fc220120fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc21f7fe700 1 --2- 172.21.15.59:0/1547564730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc22006a770 0x7fc220120fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc21f7fe700 1 -- 172.21.15.59:0/1547564730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc218009a70 con 0x7fc220131d10 2023-09-30T22:36:36.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.295+0000 7fc21e7fc700 1 --2- 172.21.15.59:0/1547564730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc22006b080 0x7fc220121500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:36.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.296+0000 7fc21f7fe700 1 --2- 172.21.15.59:0/1547564730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc220131d10 0x7fc2201c60b0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fc21800efc0 tx=0x7fc21800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:36.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.296+0000 7fc2077fe700 1 -- 172.21.15.59:0/1547564730 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21800ca90 con 0x7fc220131d10 2023-09-30T22:36:36.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.296+0000 7fc2077fe700 1 -- 172.21.15.59:0/1547564730 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21800f040 con 0x7fc220131d10 2023-09-30T22:36:36.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.296+0000 7fc2077fe700 1 -- 172.21.15.59:0/1547564730 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21800ce10 con 0x7fc220131d10 2023-09-30T22:36:36.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.296+0000 7fc22575e700 1 -- 172.21.15.59:0/1547564730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc210009550 con 0x7fc220131d10 2023-09-30T22:36:36.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.296+0000 7fc22575e700 1 -- 172.21.15.59:0/1547564730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc220122300 con 0x7fc220131d10 2023-09-30T22:36:36.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.297+0000 7fc2077fe700 1 -- 172.21.15.59:0/1547564730 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc218014480 con 0x7fc220131d10 2023-09-30T22:36:36.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.297+0000 7fc2077fe700 1 -- 172.21.15.59:0/1547564730 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc21803fce0 con 0x7fc220131d10 2023-09-30T22:36:36.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.297+0000 7fc22575e700 1 -- 172.21.15.59:0/1547564730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc220074ea0 con 0x7fc220131d10 2023-09-30T22:36:36.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.302+0000 7fc2077fe700 1 -- 172.21.15.59:0/1547564730 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc218012700 con 0x7fc220131d10 2023-09-30T22:36:36.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.339+0000 7f39fe716700 1 Processor -- start 2023-09-30T22:36:36.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.339+0000 7f39fe716700 1 -- start start 2023-09-30T22:36:36.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.339+0000 7f39fe716700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f39f809d6f0 0x7f39f809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.339+0000 7f39fe716700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f809e000 0x7f39f81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.339+0000 7f39fe716700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f809e410 0x7f39f8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.339+0000 7f39fe716700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f806b460 con 0x7f39f809d6f0 2023-09-30T22:36:36.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.339+0000 7f39fe716700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f809b120 con 0x7f39f809e410 2023-09-30T22:36:36.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.339+0000 7f39fe716700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39f809a7e0 con 0x7f39f809e000 2023-09-30T22:36:36.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39f7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f39f809d6f0 0x7f39f809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39f77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f809e000 0x7f39f81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39fccb3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f809e410 0x7f39f8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39f7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f39f809d6f0 0x7f39f809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39320/0 (socket says 172.21.15.59:39320) 2023-09-30T22:36:36.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39f7fff700 1 -- 172.21.15.59:0/212466725 learned_addr learned my addr 172.21.15.59:0/212466725 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:36.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39f77fe700 1 -- 172.21.15.59:0/212466725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f809e410 msgr2=0x7f39f8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:36.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39f77fe700 1 --2- 172.21.15.59:0/212466725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f809e410 0x7f39f8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39f77fe700 1 -- 172.21.15.59:0/212466725 >> v2:172.21.15.59:3300/0 conn(0x7f39f809d6f0 msgr2=0x7f39f809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:36.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39f77fe700 1 --2- 172.21.15.59:0/212466725 >> v2:172.21.15.59:3300/0 conn(0x7f39f809d6f0 0x7f39f809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39f77fe700 1 -- 172.21.15.59:0/212466725 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f809a500 con 0x7f39f809e000 2023-09-30T22:36:36.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39fccb3700 1 --2- 172.21.15.59:0/212466725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f809e410 0x7f39f8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:36.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39f7fff700 1 --2- 172.21.15.59:0/212466725 >> v2:172.21.15.59:3300/0 conn(0x7f39f809d6f0 0x7f39f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:36.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39f77fe700 1 --2- 172.21.15.59:0/212466725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f809e000 0x7f39f81339f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009870 tx=0x7f39ec009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcd66ed190b5751 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:36.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39f6ffd700 1 -- 172.21.15.59:0/212466725 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec011830 con 0x7f39f809e000 2023-09-30T22:36:36.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39f6ffd700 1 -- 172.21.15.59:0/212466725 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec011990 con 0x7f39f809e000 2023-09-30T22:36:36.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.340+0000 7f39f6ffd700 1 -- 172.21.15.59:0/212466725 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec011d20 con 0x7f39f809e000 2023-09-30T22:36:36.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.341+0000 7f39fe716700 1 -- 172.21.15.59:0/212466725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f809e000 msgr2=0x7f39f81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.341+0000 7f39fe716700 1 --2- 172.21.15.59:0/212466725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f809e000 0x7f39f81339f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009870 tx=0x7f39ec009b80 comp rx=0 tx=0).stop 2023-09-30T22:36:36.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.341+0000 7f39fe716700 1 -- 172.21.15.59:0/212466725 shutdown_connections 2023-09-30T22:36:36.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.341+0000 7f39fe716700 1 --2- 172.21.15.59:0/212466725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f809e410 0x7f39f8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.341+0000 7f39fe716700 1 --2- 172.21.15.59:0/212466725 >> v2:172.21.15.59:3300/0 conn(0x7f39f809d6f0 0x7f39f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.341+0000 7f39fe716700 1 --2- 172.21.15.59:0/212466725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f809e000 0x7f39f81339f0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.341+0000 7f39fe716700 1 -- 172.21.15.59:0/212466725 >> 172.21.15.59:0/212466725 conn(0x7f39f8066f50 msgr2=0x7f39f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:36.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.341+0000 7f39fe716700 1 -- 172.21.15.59:0/212466725 shutdown_connections 2023-09-30T22:36:36.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.341+0000 7f39fe716700 1 -- 172.21.15.59:0/212466725 wait complete. 2023-09-30T22:36:36.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.343+0000 7f39fe716700 1 Processor -- start 2023-09-30T22:36:36.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.343+0000 7f39fe716700 1 -- start start 2023-09-30T22:36:36.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39fe716700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f809d6f0 0x7f39f81a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39fe716700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f809e000 0x7f39f81a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39fe716700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f809e410 0x7f39f81a6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39fe716700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f81a8790 con 0x7f39f809e410 2023-09-30T22:36:36.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39fe716700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f81a9940 con 0x7f39f809d6f0 2023-09-30T22:36:36.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39fe716700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39f80a1f00 con 0x7f39f809e000 2023-09-30T22:36:36.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39f7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f809d6f0 0x7f39f81a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39f77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f809e000 0x7f39f81a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39f7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f809d6f0 0x7f39f81a5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47242/0 (socket says 172.21.15.59:47242) 2023-09-30T22:36:36.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39f7fff700 1 -- 172.21.15.59:0/1477764843 learned_addr learned my addr 172.21.15.59:0/1477764843 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:36.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39fccb3700 1 --2- 172.21.15.59:0/1477764843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f809e410 0x7f39f81a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39f77fe700 1 -- 172.21.15.59:0/1477764843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f809d6f0 msgr2=0x7f39f81a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39f77fe700 1 --2- 172.21.15.59:0/1477764843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f809d6f0 0x7f39f81a5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39f77fe700 1 -- 172.21.15.59:0/1477764843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f809e410 msgr2=0x7f39f81a6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39f77fe700 1 --2- 172.21.15.59:0/1477764843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f809e410 0x7f39f81a6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39f77fe700 1 -- 172.21.15.59:0/1477764843 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e8009550 con 0x7f39f809e000 2023-09-30T22:36:36.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.344+0000 7f39f7fff700 1 --2- 172.21.15.59:0/1477764843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f809d6f0 0x7f39f81a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:36.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.345+0000 7f39f77fe700 1 --2- 172.21.15.59:0/1477764843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f809e000 0x7f39f81a6430 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f39f806b640 tx=0x7f39ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:36.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.345+0000 7f39f4ff9700 1 -- 172.21.15.59:0/1477764843 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec004450 con 0x7f39f809e000 2023-09-30T22:36:36.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.345+0000 7f39f4ff9700 1 -- 172.21.15.59:0/1477764843 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec01f070 con 0x7f39f809e000 2023-09-30T22:36:36.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.345+0000 7f39fe716700 1 -- 172.21.15.59:0/1477764843 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f0009a70 con 0x7f39f809e000 2023-09-30T22:36:36.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.345+0000 7f39f4ff9700 1 -- 172.21.15.59:0/1477764843 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec0038c0 con 0x7f39f809e000 2023-09-30T22:36:36.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.345+0000 7f39fe716700 1 -- 172.21.15.59:0/1477764843 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ec0094a0 con 0x7f39f809e000 2023-09-30T22:36:36.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.346+0000 7f39f4ff9700 1 -- 172.21.15.59:0/1477764843 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f39ec003a20 con 0x7f39f809e000 2023-09-30T22:36:36.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.346+0000 7f39f4ff9700 1 -- 172.21.15.59:0/1477764843 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f39ec021070 con 0x7f39f809e000 2023-09-30T22:36:36.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.346+0000 7f39fe716700 1 -- 172.21.15.59:0/1477764843 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f8074ea0 con 0x7f39f809e000 2023-09-30T22:36:36.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.351+0000 7f39f4ff9700 1 -- 172.21.15.59:0/1477764843 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39ec02b080 con 0x7f39f809e000 2023-09-30T22:36:36.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.539+0000 7fc22575e700 1 -- 172.21.15.59:0/1547564730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc220122830 con 0x7fc220131d10 2023-09-30T22:36:36.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.540+0000 7fc2077fe700 1 -- 172.21.15.59:0/1547564730 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc21802a090 con 0x7fc220131d10 2023-09-30T22:36:36.541 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.542+0000 7fc22575e700 1 -- 172.21.15.59:0/1547564730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc220131d10 msgr2=0x7fc2201c60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.542+0000 7fc22575e700 1 --2- 172.21.15.59:0/1547564730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc220131d10 0x7fc2201c60b0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fc21800efc0 tx=0x7fc21800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.542+0000 7fc22575e700 1 -- 172.21.15.59:0/1547564730 shutdown_connections 2023-09-30T22:36:36.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.542+0000 7fc22575e700 1 --2- 172.21.15.59:0/1547564730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc220131d10 0x7fc2201c60b0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.542+0000 7fc22575e700 1 --2- 172.21.15.59:0/1547564730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc22006a770 0x7fc220120fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.542+0000 7fc22575e700 1 --2- 172.21.15.59:0/1547564730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc22006b080 0x7fc220121500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.542+0000 7fc22575e700 1 -- 172.21.15.59:0/1547564730 >> 172.21.15.59:0/1547564730 conn(0x7fc220066f50 msgr2=0x7fc2200a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:36.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.542+0000 7fc22575e700 1 -- 172.21.15.59:0/1547564730 shutdown_connections 2023-09-30T22:36:36.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.542+0000 7fc22575e700 1 -- 172.21.15.59:0/1547564730 wait complete. 2023-09-30T22:36:36.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:36.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.574+0000 7f39fe716700 1 -- 172.21.15.59:0/1477764843 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f39f806c360 con 0x7f39f809e000 2023-09-30T22:36:36.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.575+0000 7f39f4ff9700 1 -- 172.21.15.59:0/1477764843 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f39ec015020 con 0x7f39f809e000 2023-09-30T22:36:36.576 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:36.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.577+0000 7f39fe716700 1 -- 172.21.15.59:0/1477764843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f809e000 msgr2=0x7f39f81a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.577+0000 7f39fe716700 1 --2- 172.21.15.59:0/1477764843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f809e000 0x7f39f81a6430 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f39f806b640 tx=0x7f39ec004750 comp rx=0 tx=0).stop 2023-09-30T22:36:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.577+0000 7f39fe716700 1 -- 172.21.15.59:0/1477764843 shutdown_connections 2023-09-30T22:36:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.577+0000 7f39fe716700 1 --2- 172.21.15.59:0/1477764843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f809e410 0x7f39f81a6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.577+0000 7f39fe716700 1 --2- 172.21.15.59:0/1477764843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f809d6f0 0x7f39f81a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.577+0000 7f39fe716700 1 --2- 172.21.15.59:0/1477764843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f809e000 0x7f39f81a6430 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.577+0000 7f39fe716700 1 -- 172.21.15.59:0/1477764843 >> 172.21.15.59:0/1477764843 conn(0x7f39f8066f50 msgr2=0x7f39f81badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.577+0000 7f39fe716700 1 -- 172.21.15.59:0/1477764843 shutdown_connections 2023-09-30T22:36:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.577+0000 7f39fe716700 1 -- 172.21.15.59:0/1477764843 wait complete. 2023-09-30T22:36:36.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:36.604 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:36.642 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:36.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.776+0000 7f469263b700 1 Processor -- start 2023-09-30T22:36:36.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.776+0000 7f469263b700 1 -- start start 2023-09-30T22:36:36.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.776+0000 7f469263b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f468c0a0a30 0x7f468c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.776+0000 7f469263b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f468c0a1340 0x7f468c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.776+0000 7f469263b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f468c133fa0 0x7f468c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.776+0000 7f469263b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468c09edd0 con 0x7f468c0a1340 2023-09-30T22:36:36.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f469263b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468c09e1f0 con 0x7f468c133fa0 2023-09-30T22:36:36.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f469263b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f468c09dc50 con 0x7f468c0a0a30 2023-09-30T22:36:36.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f468b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f468c0a1340 0x7f468c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f4690bd8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f468c133fa0 0x7f468c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f468b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f468c0a1340 0x7f468c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39344/0 (socket says 172.21.15.59:39344) 2023-09-30T22:36:36.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f468b7fe700 1 -- 172.21.15.59:0/3657571114 learned_addr learned my addr 172.21.15.59:0/3657571114 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:36.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f468bfff700 1 --2- 172.21.15.59:0/3657571114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f468c0a0a30 0x7f468c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f468bfff700 1 -- 172.21.15.59:0/3657571114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f468c133fa0 msgr2=0x7f468c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:36.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f468bfff700 1 --2- 172.21.15.59:0/3657571114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f468c133fa0 0x7f468c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f468bfff700 1 -- 172.21.15.59:0/3657571114 >> v2:172.21.15.59:3300/0 conn(0x7f468c0a1340 msgr2=0x7f468c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:36.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f468bfff700 1 --2- 172.21.15.59:0/3657571114 >> v2:172.21.15.59:3300/0 conn(0x7f468c0a1340 0x7f468c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f468bfff700 1 -- 172.21.15.59:0/3657571114 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c0a1fe0 con 0x7f468c0a0a30 2023-09-30T22:36:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f468b7fe700 1 --2- 172.21.15.59:0/3657571114 >> v2:172.21.15.59:3300/0 conn(0x7f468c0a1340 0x7f468c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f4690bd8700 1 --2- 172.21.15.59:0/3657571114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f468c133fa0 0x7f468c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f468bfff700 1 --2- 172.21.15.59:0/3657571114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f468c0a0a30 0x7f468c0a0e00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f467c009870 tx=0x7f467c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b5c0961216808d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f468affd700 1 -- 172.21.15.59:0/3657571114 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c011830 con 0x7f468c0a0a30 2023-09-30T22:36:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.777+0000 7f468affd700 1 -- 172.21.15.59:0/3657571114 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c011990 con 0x7f468c0a0a30 2023-09-30T22:36:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.778+0000 7f468affd700 1 -- 172.21.15.59:0/3657571114 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c011d20 con 0x7f468c0a0a30 2023-09-30T22:36:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.778+0000 7f469263b700 1 -- 172.21.15.59:0/3657571114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f468c0a0a30 msgr2=0x7f468c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.778+0000 7f469263b700 1 --2- 172.21.15.59:0/3657571114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f468c0a0a30 0x7f468c0a0e00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f467c009870 tx=0x7f467c009b80 comp rx=0 tx=0).stop 2023-09-30T22:36:36.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.778+0000 7f469263b700 1 -- 172.21.15.59:0/3657571114 shutdown_connections 2023-09-30T22:36:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.778+0000 7f469263b700 1 --2- 172.21.15.59:0/3657571114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f468c133fa0 0x7f468c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.778+0000 7f469263b700 1 --2- 172.21.15.59:0/3657571114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f468c0a0a30 0x7f468c0a0e00 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.778+0000 7f469263b700 1 --2- 172.21.15.59:0/3657571114 >> v2:172.21.15.59:3300/0 conn(0x7f468c0a1340 0x7f468c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.778+0000 7f469263b700 1 -- 172.21.15.59:0/3657571114 >> 172.21.15.59:0/3657571114 conn(0x7f468c0a6550 msgr2=0x7f468c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.778+0000 7f469263b700 1 -- 172.21.15.59:0/3657571114 shutdown_connections 2023-09-30T22:36:36.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.778+0000 7f469263b700 1 -- 172.21.15.59:0/3657571114 wait complete. 2023-09-30T22:36:36.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.780+0000 7f469263b700 1 Processor -- start 2023-09-30T22:36:36.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.780+0000 7f469263b700 1 -- start start 2023-09-30T22:36:36.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f469263b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f468c0a0a30 0x7f468c11e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f469263b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f468c0a1340 0x7f468c11e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f469263b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f468c133fa0 0x7f468c11ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f469263b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c120f90 con 0x7f468c0a0a30 2023-09-30T22:36:36.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f469263b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468c0a0220 con 0x7f468c133fa0 2023-09-30T22:36:36.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f469263b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f468c120320 con 0x7f468c0a1340 2023-09-30T22:36:36.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f468b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f468c0a1340 0x7f468c11e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f468b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f468c0a1340 0x7f468c11e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44370/0 (socket says 172.21.15.59:44370) 2023-09-30T22:36:36.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f4690bd8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f468c133fa0 0x7f468c11ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f468b7fe700 1 -- 172.21.15.59:0/1527154601 learned_addr learned my addr 172.21.15.59:0/1527154601 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:36.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f468bfff700 1 --2- 172.21.15.59:0/1527154601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f468c0a0a30 0x7f468c11e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f468bfff700 1 -- 172.21.15.59:0/1527154601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f468c0a1340 msgr2=0x7f468c11e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f468bfff700 1 --2- 172.21.15.59:0/1527154601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f468c0a1340 0x7f468c11e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f468bfff700 1 -- 172.21.15.59:0/1527154601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f468c133fa0 msgr2=0x7f468c11ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f468bfff700 1 --2- 172.21.15.59:0/1527154601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f468c133fa0 0x7f468c11ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f468bfff700 1 -- 172.21.15.59:0/1527154601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4680009550 con 0x7f468c0a0a30 2023-09-30T22:36:36.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f4690bd8700 1 --2- 172.21.15.59:0/1527154601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f468c133fa0 0x7f468c11ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:36.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.781+0000 7f468bfff700 1 --2- 172.21.15.59:0/1527154601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f468c0a0a30 0x7f468c11e300 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f467c016000 tx=0x7f467c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:36.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.782+0000 7f4688ff9700 1 -- 172.21.15.59:0/1527154601 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c004450 con 0x7f468c0a0a30 2023-09-30T22:36:36.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.782+0000 7f4688ff9700 1 -- 172.21.15.59:0/1527154601 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c01f070 con 0x7f468c0a0a30 2023-09-30T22:36:36.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.782+0000 7f4688ff9700 1 -- 172.21.15.59:0/1527154601 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c0038c0 con 0x7f468c0a0a30 2023-09-30T22:36:36.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.782+0000 7f469263b700 1 -- 172.21.15.59:0/1527154601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4684009a70 con 0x7f468c0a0a30 2023-09-30T22:36:36.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.782+0000 7f469263b700 1 -- 172.21.15.59:0/1527154601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c0094a0 con 0x7f468c0a0a30 2023-09-30T22:36:36.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.782+0000 7f4688ff9700 1 -- 172.21.15.59:0/1527154601 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f467c003a20 con 0x7f468c0a0a30 2023-09-30T22:36:36.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.783+0000 7f4688ff9700 1 -- 172.21.15.59:0/1527154601 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f467c021070 con 0x7f468c0a0a30 2023-09-30T22:36:36.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.783+0000 7f469263b700 1 -- 172.21.15.59:0/1527154601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468c09b1e0 con 0x7f468c0a0a30 2023-09-30T22:36:36.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.788+0000 7f4688ff9700 1 -- 172.21.15.59:0/1527154601 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f467c02b080 con 0x7f468c0a0a30 2023-09-30T22:36:36.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.826+0000 7f6291264700 1 Processor -- start 2023-09-30T22:36:36.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.827+0000 7f6291264700 1 -- start start 2023-09-30T22:36:36.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.827+0000 7f6291264700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f628c09e850 0x7f628c09ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.827+0000 7f6291264700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f628c09f5e0 0x7f628c134370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.827+0000 7f6291264700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628c06bec0 con 0x7f628c09f160 2023-09-30T22:36:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.827+0000 7f6291264700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628c0a0030 con 0x7f628c09e850 2023-09-30T22:36:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.827+0000 7f6291264700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f628c0a0830 con 0x7f628c09f5e0 2023-09-30T22:36:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.827+0000 7f628affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f628c09e850 0x7f628c09ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.827+0000 7f628b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f628c09f5e0 0x7f628c134370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.827+0000 7f628affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f628c09e850 0x7f628c09ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39364/0 (socket says 172.21.15.59:39364) 2023-09-30T22:36:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.827+0000 7f628affd700 1 -- 172.21.15.59:0/3726386667 learned_addr learned my addr 172.21.15.59:0/3726386667 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.828+0000 7f628b7fe700 1 -- 172.21.15.59:0/3726386667 >> v2:172.21.15.59:3300/0 conn(0x7f628c09e850 msgr2=0x7f628c09ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.828+0000 7f628b7fe700 1 --2- 172.21.15.59:0/3726386667 >> v2:172.21.15.59:3300/0 conn(0x7f628c09e850 0x7f628c09ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.828+0000 7f628b7fe700 1 -- 172.21.15.59:0/3726386667 >> v1:172.21.15.59:6789/0 conn(0x7f628c09f160 legacy=0x7f628c133c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.828+0000 7f628b7fe700 1 -- 172.21.15.59:0/3726386667 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c06caa0 con 0x7f628c09f5e0 2023-09-30T22:36:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.828+0000 7f628affd700 1 --2- 172.21.15.59:0/3726386667 >> v2:172.21.15.59:3300/0 conn(0x7f628c09e850 0x7f628c09ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.828+0000 7f628b7fe700 1 --2- 172.21.15.59:0/3726386667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f628c09f5e0 0x7f628c134370 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6284009d90 tx=0x7f628400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e26acec01aafbde2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.828+0000 7f6289ffb700 1 -- 172.21.15.59:0/3726386667 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628400e070 con 0x7f628c09f5e0 2023-09-30T22:36:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.828+0000 7f6289ffb700 1 -- 172.21.15.59:0/3726386667 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628400bb20 con 0x7f628c09f5e0 2023-09-30T22:36:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.828+0000 7f6289ffb700 1 -- 172.21.15.59:0/3726386667 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6284012430 con 0x7f628c09f5e0 2023-09-30T22:36:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.829+0000 7f6291264700 1 -- 172.21.15.59:0/3726386667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f628c09f5e0 msgr2=0x7f628c134370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.829+0000 7f6291264700 1 --2- 172.21.15.59:0/3726386667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f628c09f5e0 0x7f628c134370 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6284009d90 tx=0x7f628400b330 comp rx=0 tx=0).stop 2023-09-30T22:36:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.829+0000 7f6291264700 1 -- 172.21.15.59:0/3726386667 shutdown_connections 2023-09-30T22:36:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.829+0000 7f6291264700 1 --2- 172.21.15.59:0/3726386667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f628c09f5e0 0x7f628c134370 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.829+0000 7f6291264700 1 --2- 172.21.15.59:0/3726386667 >> v2:172.21.15.59:3300/0 conn(0x7f628c09e850 0x7f628c09ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.829+0000 7f6291264700 1 -- 172.21.15.59:0/3726386667 >> 172.21.15.59:0/3726386667 conn(0x7f628c0a3f70 msgr2=0x7f628c0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:36.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.829+0000 7f6291264700 1 -- 172.21.15.59:0/3726386667 shutdown_connections 2023-09-30T22:36:36.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.829+0000 7f6291264700 1 -- 172.21.15.59:0/3726386667 wait complete. 2023-09-30T22:36:36.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.830+0000 7f6291264700 1 Processor -- start 2023-09-30T22:36:36.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.830+0000 7f6291264700 1 -- start start 2023-09-30T22:36:36.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f6291264700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f628c09e850 0x7f628c120480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f6291264700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f628c09f160 0x7f628c1209c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f6291264700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f628c09f5e0 0x7f628c120f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:36.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f6291264700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c123d60 con 0x7f628c09f160 2023-09-30T22:36:36.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f6291264700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628c133870 con 0x7f628c09f5e0 2023-09-30T22:36:36.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f6291264700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f628c1232e0 con 0x7f628c09e850 2023-09-30T22:36:36.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f628affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f628c09e850 0x7f628c120480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f628a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f628c09f160 0x7f628c1209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f628affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f628c09e850 0x7f628c120480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44380/0 (socket says 172.21.15.59:44380) 2023-09-30T22:36:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f628affd700 1 -- 172.21.15.59:0/1251671957 learned_addr learned my addr 172.21.15.59:0/1251671957 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f628a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f628c09f160 0x7f628c1209c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39370/0 (socket says 172.21.15.59:39370) 2023-09-30T22:36:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f628affd700 1 -- 172.21.15.59:0/1251671957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f628c09f5e0 msgr2=0x7f628c120f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f628affd700 1 --2- 172.21.15.59:0/1251671957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f628c09f5e0 0x7f628c120f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f628affd700 1 -- 172.21.15.59:0/1251671957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f628c09f160 msgr2=0x7f628c1209c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f628affd700 1 --2- 172.21.15.59:0/1251671957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f628c09f160 0x7f628c1209c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f628affd700 1 -- 172.21.15.59:0/1251671957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c009550 con 0x7f628c09e850 2023-09-30T22:36:36.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f628a7fc700 1 --2- 172.21.15.59:0/1251671957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f628c09f160 0x7f628c1209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:36.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f628affd700 1 --2- 172.21.15.59:0/1251671957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f628c09e850 0x7f628c120480 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f627c00e9e0 tx=0x7f627c00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:36.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f62837fe700 1 -- 172.21.15.59:0/1251671957 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c00c850 con 0x7f628c09e850 2023-09-30T22:36:36.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f62837fe700 1 -- 172.21.15.59:0/1251671957 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627c00c9b0 con 0x7f628c09e850 2023-09-30T22:36:36.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f6291264700 1 -- 172.21.15.59:0/1251671957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6284009a70 con 0x7f628c09e850 2023-09-30T22:36:36.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.831+0000 7f62837fe700 1 -- 172.21.15.59:0/1251671957 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c00cd20 con 0x7f628c09e850 2023-09-30T22:36:36.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.832+0000 7f6291264700 1 -- 172.21.15.59:0/1251671957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628c123780 con 0x7f628c09e850 2023-09-30T22:36:36.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.832+0000 7f62837fe700 1 -- 172.21.15.59:0/1251671957 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f627c013470 con 0x7f628c09e850 2023-09-30T22:36:36.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.832+0000 7f62837fe700 1 -- 172.21.15.59:0/1251671957 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f627c03fb50 con 0x7f628c09e850 2023-09-30T22:36:36.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.832+0000 7f6291264700 1 -- 172.21.15.59:0/1251671957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628c09caf0 con 0x7f628c09e850 2023-09-30T22:36:36.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:36.842+0000 7f62837fe700 1 -- 172.21.15.59:0/1251671957 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f627c021020 con 0x7f628c09e850 2023-09-30T22:36:37.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.010+0000 7f469263b700 1 -- 172.21.15.59:0/1527154601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f468c121680 con 0x7f468c0a0a30 2023-09-30T22:36:37.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.011+0000 7f4688ff9700 1 -- 172.21.15.59:0/1527154601 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f467c015020 con 0x7f468c0a0a30 2023-09-30T22:36:37.012 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:37.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.013+0000 7f469263b700 1 -- 172.21.15.59:0/1527154601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f468c0a0a30 msgr2=0x7f468c11e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:37.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.013+0000 7f469263b700 1 --2- 172.21.15.59:0/1527154601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f468c0a0a30 0x7f468c11e300 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f467c016000 tx=0x7f467c004750 comp rx=0 tx=0).stop 2023-09-30T22:36:37.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.013+0000 7f469263b700 1 -- 172.21.15.59:0/1527154601 shutdown_connections 2023-09-30T22:36:37.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.013+0000 7f469263b700 1 --2- 172.21.15.59:0/1527154601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f468c133fa0 0x7f468c11ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.013+0000 7f469263b700 1 --2- 172.21.15.59:0/1527154601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f468c0a0a30 0x7f468c11e300 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.013+0000 7f469263b700 1 --2- 172.21.15.59:0/1527154601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f468c0a1340 0x7f468c11e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.013+0000 7f469263b700 1 -- 172.21.15.59:0/1527154601 >> 172.21.15.59:0/1527154601 conn(0x7f468c0a6550 msgr2=0x7f468c1331f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:37.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.013+0000 7f469263b700 1 -- 172.21.15.59:0/1527154601 shutdown_connections 2023-09-30T22:36:37.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.013+0000 7f469263b700 1 -- 172.21.15.59:0/1527154601 wait complete. 2023-09-30T22:36:37.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:37.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.046+0000 7f6291264700 1 -- 172.21.15.59:0/1251671957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f628c122670 con 0x7f628c09e850 2023-09-30T22:36:37.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.046+0000 7f62837fe700 1 -- 172.21.15.59:0/1251671957 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f628c122670 con 0x7f628c09e850 2023-09-30T22:36:37.048 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:37.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.049+0000 7f6291264700 1 -- 172.21.15.59:0/1251671957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f628c09e850 msgr2=0x7f628c120480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:37.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.049+0000 7f6291264700 1 --2- 172.21.15.59:0/1251671957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f628c09e850 0x7f628c120480 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f627c00e9e0 tx=0x7f627c00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.049+0000 7f6291264700 1 -- 172.21.15.59:0/1251671957 shutdown_connections 2023-09-30T22:36:37.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.049+0000 7f6291264700 1 --2- 172.21.15.59:0/1251671957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f628c09e850 0x7f628c120480 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.049+0000 7f6291264700 1 --2- 172.21.15.59:0/1251671957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f628c09f5e0 0x7f628c120f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.049+0000 7f6291264700 1 --2- 172.21.15.59:0/1251671957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f628c09f160 0x7f628c1209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.049+0000 7f6291264700 1 -- 172.21.15.59:0/1251671957 >> 172.21.15.59:0/1251671957 conn(0x7f628c0a3f70 msgr2=0x7f628c1bb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:37.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.049+0000 7f6291264700 1 -- 172.21.15.59:0/1251671957 shutdown_connections 2023-09-30T22:36:37.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.049+0000 7f6291264700 1 -- 172.21.15.59:0/1251671957 wait complete. 2023-09-30T22:36:37.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:37.560 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:37.593 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:37.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.707+0000 7fe774529700 1 Processor -- start 2023-09-30T22:36:37.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.707+0000 7fe774529700 1 -- start start 2023-09-30T22:36:37.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe774529700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76c09f410 0x7fe76c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:37.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe774529700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76c136fe0 0x7fe76c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:37.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe774529700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76c070940 con 0x7fe76c09e930 2023-09-30T22:36:37.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe774529700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c06fd60 con 0x7fe76c136fe0 2023-09-30T22:36:37.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe774529700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c06fa80 con 0x7fe76c09f410 2023-09-30T22:36:37.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe772ac6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76c136fe0 0x7fe76c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:37.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe771ac4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76c09f410 0x7fe76c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:37.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe7722c5700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe76c09e930 0x7fe76c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33902/0 (socket says 172.21.15.59:33902) 2023-09-30T22:36:37.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe7722c5700 1 -- 172.21.15.59:0/1097840288 learned_addr learned my addr 172.21.15.59:0/1097840288 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:37.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe772ac6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76c136fe0 0x7fe76c1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47288/0 (socket says 172.21.15.59:47288) 2023-09-30T22:36:37.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe771ac4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76c09f410 0x7fe76c136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44396/0 (socket says 172.21.15.59:44396) 2023-09-30T22:36:37.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe771ac4700 1 -- 172.21.15.59:0/1097840288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76c136fe0 msgr2=0x7fe76c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:37.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe771ac4700 1 --2- 172.21.15.59:0/1097840288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76c136fe0 0x7fe76c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe771ac4700 1 -- 172.21.15.59:0/1097840288 >> v1:172.21.15.59:6789/0 conn(0x7fe76c09e930 legacy=0x7fe76c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:37.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe7712c3700 1 -- 172.21.15.59:0/1097840288 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890078741 0 0) 0x7fe76c070940 con 0x7fe76c09e930 2023-09-30T22:36:37.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe771ac4700 1 -- 172.21.15.59:0/1097840288 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c09fb60 con 0x7fe76c09f410 2023-09-30T22:36:37.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.708+0000 7fe772ac6700 1 --2- 172.21.15.59:0/1097840288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76c136fe0 0x7fe76c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:37.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.709+0000 7fe771ac4700 1 --2- 172.21.15.59:0/1097840288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76c09f410 0x7fe76c136aa0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009870 tx=0x7fe75c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2df92b7fcb74572 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:37.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.709+0000 7fe7712c3700 1 -- 172.21.15.59:0/1097840288 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c011830 con 0x7fe76c09f410 2023-09-30T22:36:37.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.709+0000 7fe7712c3700 1 -- 172.21.15.59:0/1097840288 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c011990 con 0x7fe76c09f410 2023-09-30T22:36:37.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.709+0000 7fe7712c3700 1 -- 172.21.15.59:0/1097840288 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c011d20 con 0x7fe76c09f410 2023-09-30T22:36:37.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.709+0000 7fe774529700 1 -- 172.21.15.59:0/1097840288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76c09f410 msgr2=0x7fe76c136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:37.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.709+0000 7fe774529700 1 --2- 172.21.15.59:0/1097840288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76c09f410 0x7fe76c136aa0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009870 tx=0x7fe75c009b80 comp rx=0 tx=0).stop 2023-09-30T22:36:37.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.710+0000 7fe774529700 1 -- 172.21.15.59:0/1097840288 shutdown_connections 2023-09-30T22:36:37.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.710+0000 7fe774529700 1 --2- 172.21.15.59:0/1097840288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76c136fe0 0x7fe76c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.710+0000 7fe774529700 1 --2- 172.21.15.59:0/1097840288 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76c09f410 0x7fe76c136aa0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.710+0000 7fe774529700 1 -- 172.21.15.59:0/1097840288 >> 172.21.15.59:0/1097840288 conn(0x7fe76c0a4210 msgr2=0x7fe76c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:37.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.710+0000 7fe774529700 1 -- 172.21.15.59:0/1097840288 shutdown_connections 2023-09-30T22:36:37.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.710+0000 7fe774529700 1 -- 172.21.15.59:0/1097840288 wait complete. 2023-09-30T22:36:37.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.711+0000 7fe774529700 1 Processor -- start 2023-09-30T22:36:37.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.711+0000 7fe774529700 1 -- start start 2023-09-30T22:36:37.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.711+0000 7fe774529700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76c09e930 0x7fe76c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:37.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.711+0000 7fe774529700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76c09f410 0x7fe76c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:37.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.711+0000 7fe774529700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76c136fe0 0x7fe76c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:37.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.711+0000 7fe774529700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c071d90 con 0x7fe76c09e930 2023-09-30T22:36:37.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.711+0000 7fe774529700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c06d640 con 0x7fe76c136fe0 2023-09-30T22:36:37.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.711+0000 7fe774529700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c134660 con 0x7fe76c09f410 2023-09-30T22:36:37.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.711+0000 7fe772ac6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76c136fe0 0x7fe76c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:37.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.711+0000 7fe771ac4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76c09f410 0x7fe76c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:37.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.711+0000 7fe7722c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76c09e930 0x7fe76c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:37.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.711+0000 7fe771ac4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76c09f410 0x7fe76c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44402/0 (socket says 172.21.15.59:44402) 2023-09-30T22:36:37.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.711+0000 7fe771ac4700 1 -- 172.21.15.59:0/2622656347 learned_addr learned my addr 172.21.15.59:0/2622656347 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:37.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.712+0000 7fe772ac6700 1 -- 172.21.15.59:0/2622656347 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76c09f410 msgr2=0x7fe76c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:37.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.712+0000 7fe772ac6700 1 --2- 172.21.15.59:0/2622656347 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76c09f410 0x7fe76c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.712+0000 7fe772ac6700 1 -- 172.21.15.59:0/2622656347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76c09e930 msgr2=0x7fe76c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:37.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.712+0000 7fe772ac6700 1 --2- 172.21.15.59:0/2622656347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76c09e930 0x7fe76c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.712+0000 7fe772ac6700 1 -- 172.21.15.59:0/2622656347 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe764009a70 con 0x7fe76c136fe0 2023-09-30T22:36:37.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.712+0000 7fe771ac4700 1 --2- 172.21.15.59:0/2622656347 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76c09f410 0x7fe76c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:37.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.712+0000 7fe7722c5700 1 --2- 172.21.15.59:0/2622656347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76c09e930 0x7fe76c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:37.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.712+0000 7fe772ac6700 1 --2- 172.21.15.59:0/2622656347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76c136fe0 0x7fe76c06c330 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0a07c0 tx=0x7fe76400ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:37.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.712+0000 7fe762ffd700 1 -- 172.21.15.59:0/2622656347 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76400cc20 con 0x7fe76c136fe0 2023-09-30T22:36:37.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.712+0000 7fe762ffd700 1 -- 172.21.15.59:0/2622656347 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76400f040 con 0x7fe76c136fe0 2023-09-30T22:36:37.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.712+0000 7fe774529700 1 -- 172.21.15.59:0/2622656347 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c0094a0 con 0x7fe76c136fe0 2023-09-30T22:36:37.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.712+0000 7fe762ffd700 1 -- 172.21.15.59:0/2622656347 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764014480 con 0x7fe76c136fe0 2023-09-30T22:36:37.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.712+0000 7fe774529700 1 -- 172.21.15.59:0/2622656347 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c1341f0 con 0x7fe76c136fe0 2023-09-30T22:36:37.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.713+0000 7fe762ffd700 1 -- 172.21.15.59:0/2622656347 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe764014600 con 0x7fe76c136fe0 2023-09-30T22:36:37.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.713+0000 7fe762ffd700 1 -- 172.21.15.59:0/2622656347 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe764040010 con 0x7fe76c136fe0 2023-09-30T22:36:37.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.713+0000 7fe774529700 1 -- 172.21.15.59:0/2622656347 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76c074ea0 con 0x7fe76c136fe0 2023-09-30T22:36:37.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.718+0000 7fe762ffd700 1 -- 172.21.15.59:0/2622656347 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7640248f0 con 0x7fe76c136fe0 2023-09-30T22:36:37.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.745+0000 7fc544893700 1 Processor -- start 2023-09-30T22:36:37.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.745+0000 7fc544893700 1 -- start start 2023-09-30T22:36:37.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.746+0000 7fc544893700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5400a0a30 0x7fc5400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:37.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.746+0000 7fc544893700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc540138d80 0x7fc54013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:37.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.746+0000 7fc544893700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5400a2a70 con 0x7fc54009d630 2023-09-30T22:36:37.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.746+0000 7fc544893700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5400a01d0 con 0x7fc540138d80 2023-09-30T22:36:37.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.746+0000 7fc544893700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc54009e2b0 con 0x7fc5400a0a30 2023-09-30T22:36:37.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.746+0000 7fc53dd9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc54009d630 0x7fc5400a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33906/0 (socket says 172.21.15.59:33906) 2023-09-30T22:36:37.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.746+0000 7fc53dd9b700 1 -- 172.21.15.59:0/3089888805 learned_addr learned my addr 172.21.15.59:0/3089888805 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:37.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.746+0000 7fc53e59c700 1 --2- 172.21.15.59:0/3089888805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5400a0a30 0x7fc5400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:37.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.746+0000 7fc53ed9d700 1 --2- 172.21.15.59:0/3089888805 >> v2:172.21.15.59:3300/0 conn(0x7fc540138d80 0x7fc54013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:37.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.746+0000 7fc53e59c700 1 -- 172.21.15.59:0/3089888805 >> v2:172.21.15.59:3300/0 conn(0x7fc540138d80 msgr2=0x7fc54013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:37.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.746+0000 7fc53e59c700 1 --2- 172.21.15.59:0/3089888805 >> v2:172.21.15.59:3300/0 conn(0x7fc540138d80 0x7fc54013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.746+0000 7fc53e59c700 1 -- 172.21.15.59:0/3089888805 >> v1:172.21.15.59:6789/0 conn(0x7fc54009d630 legacy=0x7fc5400a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:37.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.746+0000 7fc53e59c700 1 -- 172.21.15.59:0/3089888805 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54009dc50 con 0x7fc5400a0a30 2023-09-30T22:36:37.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.746+0000 7fc53e59c700 1 --2- 172.21.15.59:0/3089888805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5400a0a30 0x7fc5400a0e00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc530009d90 tx=0x7fc53000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4dcda856bac93dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:37.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.747+0000 7fc53d59a700 1 -- 172.21.15.59:0/3089888805 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53000e070 con 0x7fc5400a0a30 2023-09-30T22:36:37.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.747+0000 7fc53d59a700 1 -- 172.21.15.59:0/3089888805 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53000bb20 con 0x7fc5400a0a30 2023-09-30T22:36:37.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.747+0000 7fc53d59a700 1 -- 172.21.15.59:0/3089888805 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530012430 con 0x7fc5400a0a30 2023-09-30T22:36:37.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.747+0000 7fc544893700 1 -- 172.21.15.59:0/3089888805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5400a0a30 msgr2=0x7fc5400a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:37.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.747+0000 7fc544893700 1 --2- 172.21.15.59:0/3089888805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5400a0a30 0x7fc5400a0e00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc530009d90 tx=0x7fc53000b330 comp rx=0 tx=0).stop 2023-09-30T22:36:37.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.747+0000 7fc544893700 1 -- 172.21.15.59:0/3089888805 shutdown_connections 2023-09-30T22:36:37.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.747+0000 7fc544893700 1 --2- 172.21.15.59:0/3089888805 >> v2:172.21.15.59:3300/0 conn(0x7fc540138d80 0x7fc54013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.747+0000 7fc544893700 1 --2- 172.21.15.59:0/3089888805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5400a0a30 0x7fc5400a0e00 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.747+0000 7fc544893700 1 -- 172.21.15.59:0/3089888805 >> 172.21.15.59:0/3089888805 conn(0x7fc5400a3050 msgr2=0x7fc5400a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:37.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.747+0000 7fc544893700 1 -- 172.21.15.59:0/3089888805 shutdown_connections 2023-09-30T22:36:37.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.747+0000 7fc544893700 1 -- 172.21.15.59:0/3089888805 wait complete. 2023-09-30T22:36:37.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.749+0000 7fc544893700 1 Processor -- start 2023-09-30T22:36:37.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.749+0000 7fc544893700 1 -- start start 2023-09-30T22:36:37.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.749+0000 7fc544893700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54009d630 0x7fc5401208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:37.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.749+0000 7fc544893700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5400a0a30 0x7fc540120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:37.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.749+0000 7fc544893700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc540138d80 0x7fc540121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:37.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.749+0000 7fc544893700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc540122470 con 0x7fc540138d80 2023-09-30T22:36:37.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.749+0000 7fc544893700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5401237c0 con 0x7fc54009d630 2023-09-30T22:36:37.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.749+0000 7fc544893700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc540121d50 con 0x7fc5400a0a30 2023-09-30T22:36:37.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.749+0000 7fc53e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54009d630 0x7fc5401208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:37.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.749+0000 7fc53dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5400a0a30 0x7fc540120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:37.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.749+0000 7fc53dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5400a0a30 0x7fc540120e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44422/0 (socket says 172.21.15.59:44422) 2023-09-30T22:36:37.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.749+0000 7fc53e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54009d630 0x7fc5401208f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47308/0 (socket says 172.21.15.59:47308) 2023-09-30T22:36:37.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.749+0000 7fc53dd9b700 1 -- 172.21.15.59:0/4207277041 learned_addr learned my addr 172.21.15.59:0/4207277041 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:37.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.749+0000 7fc53ed9d700 1 --2- 172.21.15.59:0/4207277041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc540138d80 0x7fc540121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:37.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.750+0000 7fc53dd9b700 1 -- 172.21.15.59:0/4207277041 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54009d630 msgr2=0x7fc5401208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:37.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.750+0000 7fc53dd9b700 1 --2- 172.21.15.59:0/4207277041 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54009d630 0x7fc5401208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.750+0000 7fc53dd9b700 1 -- 172.21.15.59:0/4207277041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc540138d80 msgr2=0x7fc540121370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:37.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.750+0000 7fc53dd9b700 1 --2- 172.21.15.59:0/4207277041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc540138d80 0x7fc540121370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.750+0000 7fc53dd9b700 1 -- 172.21.15.59:0/4207277041 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc530009a70 con 0x7fc5400a0a30 2023-09-30T22:36:37.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.750+0000 7fc53dd9b700 1 --2- 172.21.15.59:0/4207277041 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5400a0a30 0x7fc540120e30 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc52800c500 tx=0x7fc52800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:37.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.750+0000 7fc536ffd700 1 -- 172.21.15.59:0/4207277041 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528005d70 con 0x7fc5400a0a30 2023-09-30T22:36:37.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.750+0000 7fc536ffd700 1 -- 172.21.15.59:0/4207277041 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5280070d0 con 0x7fc5400a0a30 2023-09-30T22:36:37.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.750+0000 7fc544893700 1 -- 172.21.15.59:0/4207277041 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc540124380 con 0x7fc5400a0a30 2023-09-30T22:36:37.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.750+0000 7fc536ffd700 1 -- 172.21.15.59:0/4207277041 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528007440 con 0x7fc5400a0a30 2023-09-30T22:36:37.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.750+0000 7fc544893700 1 -- 172.21.15.59:0/4207277041 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54013b0c0 con 0x7fc5400a0a30 2023-09-30T22:36:37.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.751+0000 7fc536ffd700 1 -- 172.21.15.59:0/4207277041 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5280075a0 con 0x7fc5400a0a30 2023-09-30T22:36:37.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.751+0000 7fc536ffd700 1 -- 172.21.15.59:0/4207277041 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc52803ea70 con 0x7fc5400a0a30 2023-09-30T22:36:37.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.751+0000 7fc544893700 1 -- 172.21.15.59:0/4207277041 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc540123d40 con 0x7fc5400a0a30 2023-09-30T22:36:37.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.756+0000 7fc536ffd700 1 -- 172.21.15.59:0/4207277041 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc540123d40 con 0x7fc5400a0a30 2023-09-30T22:36:37.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.927+0000 7fe774529700 1 -- 172.21.15.59:0/2622656347 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe76c122ae0 con 0x7fe76c136fe0 2023-09-30T22:36:37.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.927+0000 7fe762ffd700 1 -- 172.21.15.59:0/2622656347 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe764024300 con 0x7fe76c136fe0 2023-09-30T22:36:37.929 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:37.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.930+0000 7fe774529700 1 -- 172.21.15.59:0/2622656347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76c136fe0 msgr2=0x7fe76c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:37.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.930+0000 7fe774529700 1 --2- 172.21.15.59:0/2622656347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76c136fe0 0x7fe76c06c330 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0a07c0 tx=0x7fe76400ef90 comp rx=0 tx=0).stop 2023-09-30T22:36:37.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.930+0000 7fe774529700 1 -- 172.21.15.59:0/2622656347 shutdown_connections 2023-09-30T22:36:37.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.930+0000 7fe774529700 1 --2- 172.21.15.59:0/2622656347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76c136fe0 0x7fe76c06c330 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.930+0000 7fe774529700 1 --2- 172.21.15.59:0/2622656347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76c09e930 0x7fe76c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.930+0000 7fe774529700 1 --2- 172.21.15.59:0/2622656347 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76c09f410 0x7fe76c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.930+0000 7fe774529700 1 -- 172.21.15.59:0/2622656347 >> 172.21.15.59:0/2622656347 conn(0x7fe76c0a4210 msgr2=0x7fe76c134890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:37.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.930+0000 7fe774529700 1 -- 172.21.15.59:0/2622656347 shutdown_connections 2023-09-30T22:36:37.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.930+0000 7fe774529700 1 -- 172.21.15.59:0/2622656347 wait complete. 2023-09-30T22:36:37.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:37.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.962+0000 7fc544893700 1 -- 172.21.15.59:0/4207277041 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc540123f00 con 0x7fc5400a0a30 2023-09-30T22:36:37.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.963+0000 7fc536ffd700 1 -- 172.21.15.59:0/4207277041 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc540123f00 con 0x7fc5400a0a30 2023-09-30T22:36:37.964 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:37.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.965+0000 7fc544893700 1 -- 172.21.15.59:0/4207277041 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5400a0a30 msgr2=0x7fc540120e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:37.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.965+0000 7fc544893700 1 --2- 172.21.15.59:0/4207277041 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5400a0a30 0x7fc540120e30 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc52800c500 tx=0x7fc52800c810 comp rx=0 tx=0).stop 2023-09-30T22:36:37.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.965+0000 7fc544893700 1 -- 172.21.15.59:0/4207277041 shutdown_connections 2023-09-30T22:36:37.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.965+0000 7fc544893700 1 --2- 172.21.15.59:0/4207277041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc540138d80 0x7fc540121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.965+0000 7fc544893700 1 --2- 172.21.15.59:0/4207277041 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc54009d630 0x7fc5401208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.965+0000 7fc544893700 1 --2- 172.21.15.59:0/4207277041 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5400a0a30 0x7fc540120e30 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:37.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.965+0000 7fc544893700 1 -- 172.21.15.59:0/4207277041 >> 172.21.15.59:0/4207277041 conn(0x7fc5400a3050 msgr2=0x7fc540139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:37.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.965+0000 7fc544893700 1 -- 172.21.15.59:0/4207277041 shutdown_connections 2023-09-30T22:36:37.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:37.965+0000 7fc544893700 1 -- 172.21.15.59:0/4207277041 wait complete. 2023-09-30T22:36:37.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:38.029 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:38.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:38.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.171+0000 7fad95386700 1 Processor -- start 2023-09-30T22:36:38.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.171+0000 7fad95386700 1 -- start start 2023-09-30T22:36:38.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.171+0000 7fad95386700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad900a09c0 0x7fad900a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:38.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.171+0000 7fad95386700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad900a12d0 0x7fad90134030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:38.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.171+0000 7fad95386700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9009ea10 con 0x7fad9009d5c0 2023-09-30T22:36:38.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.171+0000 7fad95386700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9009e210 con 0x7fad900a09c0 2023-09-30T22:36:38.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.171+0000 7fad95386700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad900a26f0 con 0x7fad900a12d0 2023-09-30T22:36:38.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad900a09c0 0x7fad900a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:38.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad900a12d0 0x7fad90134030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:38.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad900a09c0 0x7fad900a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47322/0 (socket says 172.21.15.59:47322) 2023-09-30T22:36:38.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad900a12d0 0x7fad90134030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44432/0 (socket says 172.21.15.59:44432) 2023-09-30T22:36:38.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8e7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fad9009d5c0 0x7fad90133920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33916/0 (socket says 172.21.15.59:33916) 2023-09-30T22:36:38.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8f7fe700 1 -- 172.21.15.59:0/294553990 learned_addr learned my addr 172.21.15.59:0/294553990 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:38.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8f7fe700 1 -- 172.21.15.59:0/294553990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad900a09c0 msgr2=0x7fad900a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:38.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8f7fe700 1 --2- 172.21.15.59:0/294553990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad900a09c0 0x7fad900a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8f7fe700 1 -- 172.21.15.59:0/294553990 >> v1:172.21.15.59:6789/0 conn(0x7fad9009d5c0 legacy=0x7fad90133920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:38.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8dffb700 1 -- 172.21.15.59:0/294553990 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468635365 0 0) 0x7fad9009ea10 con 0x7fad9009d5c0 2023-09-30T22:36:38.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8f7fe700 1 -- 172.21.15.59:0/294553990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9009db70 con 0x7fad900a12d0 2023-09-30T22:36:38.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8effd700 1 --2- 172.21.15.59:0/294553990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad900a09c0 0x7fad900a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:38.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8f7fe700 1 --2- 172.21.15.59:0/294553990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad900a12d0 0x7fad90134030 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fad88009920 tx=0x7fad88009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7613c0863d8594 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:38.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8dffb700 1 -- 172.21.15.59:0/294553990 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88011830 con 0x7fad900a12d0 2023-09-30T22:36:38.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8dffb700 1 -- 172.21.15.59:0/294553990 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad88011990 con 0x7fad900a12d0 2023-09-30T22:36:38.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.172+0000 7fad8dffb700 1 -- 172.21.15.59:0/294553990 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88011d20 con 0x7fad900a12d0 2023-09-30T22:36:38.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.173+0000 7fad95386700 1 -- 172.21.15.59:0/294553990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad900a12d0 msgr2=0x7fad90134030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:38.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.173+0000 7fad95386700 1 --2- 172.21.15.59:0/294553990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad900a12d0 0x7fad90134030 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fad88009920 tx=0x7fad88009c30 comp rx=0 tx=0).stop 2023-09-30T22:36:38.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.173+0000 7fad95386700 1 -- 172.21.15.59:0/294553990 shutdown_connections 2023-09-30T22:36:38.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.173+0000 7fad95386700 1 --2- 172.21.15.59:0/294553990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad900a12d0 0x7fad90134030 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.173+0000 7fad95386700 1 --2- 172.21.15.59:0/294553990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad900a09c0 0x7fad900a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.173+0000 7fad95386700 1 -- 172.21.15.59:0/294553990 >> 172.21.15.59:0/294553990 conn(0x7fad900a2fe0 msgr2=0x7fad900a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:38.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.173+0000 7fad95386700 1 -- 172.21.15.59:0/294553990 shutdown_connections 2023-09-30T22:36:38.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.173+0000 7fad95386700 1 -- 172.21.15.59:0/294553990 wait complete. 2023-09-30T22:36:38.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.174+0000 7fad95386700 1 Processor -- start 2023-09-30T22:36:38.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.175+0000 7fad95386700 1 -- start start 2023-09-30T22:36:38.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.175+0000 7fad95386700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad9009d5c0 0x7fad90120610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:38.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.175+0000 7fad95386700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad900a09c0 0x7fad90120b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:38.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.175+0000 7fad95386700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad900a12d0 0x7fad901c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:38.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.175+0000 7fad95386700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad901217b0 con 0x7fad900a09c0 2023-09-30T22:36:38.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.175+0000 7fad95386700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad90121e00 con 0x7fad900a12d0 2023-09-30T22:36:38.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.175+0000 7fad95386700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad90121090 con 0x7fad9009d5c0 2023-09-30T22:36:38.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.175+0000 7fad8effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad9009d5c0 0x7fad90120610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:38.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.175+0000 7fad8e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad900a09c0 0x7fad90120b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:38.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.175+0000 7fad8effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad9009d5c0 0x7fad90120610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44438/0 (socket says 172.21.15.59:44438) 2023-09-30T22:36:38.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.175+0000 7fad8effd700 1 -- 172.21.15.59:0/1540464543 learned_addr learned my addr 172.21.15.59:0/1540464543 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:38.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.175+0000 7fad8f7fe700 1 --2- 172.21.15.59:0/1540464543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad900a12d0 0x7fad901c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:38.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.176+0000 7fad8effd700 1 -- 172.21.15.59:0/1540464543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad900a12d0 msgr2=0x7fad901c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:38.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.176+0000 7fad8effd700 1 --2- 172.21.15.59:0/1540464543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad900a12d0 0x7fad901c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.176+0000 7fad8effd700 1 -- 172.21.15.59:0/1540464543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad900a09c0 msgr2=0x7fad90120b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:38.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.176+0000 7fad8effd700 1 --2- 172.21.15.59:0/1540464543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad900a09c0 0x7fad90120b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.176+0000 7fad8effd700 1 -- 172.21.15.59:0/1540464543 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad80009a70 con 0x7fad9009d5c0 2023-09-30T22:36:38.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.176+0000 7fad8e7fc700 1 --2- 172.21.15.59:0/1540464543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad900a09c0 0x7fad90120b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:38.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.176+0000 7fad8effd700 1 --2- 172.21.15.59:0/1540464543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad9009d5c0 0x7fad90120610 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fad80009f60 tx=0x7fad80009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:38.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.176+0000 7fad877fe700 1 -- 172.21.15.59:0/1540464543 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8000cdc0 con 0x7fad9009d5c0 2023-09-30T22:36:38.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.176+0000 7fad877fe700 1 -- 172.21.15.59:0/1540464543 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8000f040 con 0x7fad9009d5c0 2023-09-30T22:36:38.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.176+0000 7fad95386700 1 -- 172.21.15.59:0/1540464543 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad88009550 con 0x7fad9009d5c0 2023-09-30T22:36:38.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.176+0000 7fad877fe700 1 -- 172.21.15.59:0/1540464543 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad800146a0 con 0x7fad9009d5c0 2023-09-30T22:36:38.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.176+0000 7fad95386700 1 -- 172.21.15.59:0/1540464543 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad901233e0 con 0x7fad9009d5c0 2023-09-30T22:36:38.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.177+0000 7fad95386700 1 -- 172.21.15.59:0/1540464543 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad90123240 con 0x7fad9009d5c0 2023-09-30T22:36:38.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.177+0000 7fad877fe700 1 -- 172.21.15.59:0/1540464543 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad80014800 con 0x7fad9009d5c0 2023-09-30T22:36:38.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.177+0000 7fad877fe700 1 -- 172.21.15.59:0/1540464543 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fad800403a0 con 0x7fad9009d5c0 2023-09-30T22:36:38.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.182+0000 7fad877fe700 1 -- 172.21.15.59:0/1540464543 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad90123240 con 0x7fad9009d5c0 2023-09-30T22:36:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.211+0000 7f0eaca84700 1 Processor -- start 2023-09-30T22:36:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.211+0000 7f0eaca84700 1 -- start start 2023-09-30T22:36:38.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0eaca84700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0ea80a0a30 0x7f0ea80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:38.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0eaca84700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea809d630 0x7f0ea80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:38.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0eaca84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea8133930 0x7f0ea8133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:38.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0eaca84700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea80a2a70 con 0x7f0ea80a0a30 2023-09-30T22:36:38.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0eaca84700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80a01d0 con 0x7f0ea8133930 2023-09-30T22:36:38.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0eaca84700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea809e2b0 con 0x7f0ea809d630 2023-09-30T22:36:38.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0ea5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea809d630 0x7f0ea80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0ea5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea809d630 0x7f0ea80a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44446/0 (socket says 172.21.15.59:44446) 2023-09-30T22:36:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0ea5d9b700 1 -- 172.21.15.59:0/3558080828 learned_addr learned my addr 172.21.15.59:0/3558080828 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0ea659c700 1 --2- 172.21.15.59:0/3558080828 >> v2:172.21.15.59:3300/0 conn(0x7f0ea80a0a30 0x7f0ea80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0ea6d9d700 1 --2- 172.21.15.59:0/3558080828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea8133930 0x7f0ea8133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0ea5d9b700 1 -- 172.21.15.59:0/3558080828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea8133930 msgr2=0x7f0ea8133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0ea5d9b700 1 --2- 172.21.15.59:0/3558080828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea8133930 0x7f0ea8133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0ea5d9b700 1 -- 172.21.15.59:0/3558080828 >> v2:172.21.15.59:3300/0 conn(0x7f0ea80a0a30 msgr2=0x7f0ea80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0ea5d9b700 1 --2- 172.21.15.59:0/3558080828 >> v2:172.21.15.59:3300/0 conn(0x7f0ea80a0a30 0x7f0ea80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0ea5d9b700 1 -- 172.21.15.59:0/3558080828 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea809dc50 con 0x7f0ea809d630 2023-09-30T22:36:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0ea659c700 1 --2- 172.21.15.59:0/3558080828 >> v2:172.21.15.59:3300/0 conn(0x7f0ea80a0a30 0x7f0ea80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0ea6d9d700 1 --2- 172.21.15.59:0/3558080828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea8133930 0x7f0ea8133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.212+0000 7f0ea5d9b700 1 --2- 172.21.15.59:0/3558080828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea809d630 0x7f0ea80a1340 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f0e900098f0 tx=0x7f0e90009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dba29e6fb4188e28 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.213+0000 7f0ea559a700 1 -- 172.21.15.59:0/3558080828 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90011830 con 0x7f0ea809d630 2023-09-30T22:36:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.213+0000 7f0ea559a700 1 -- 172.21.15.59:0/3558080828 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e90011990 con 0x7f0ea809d630 2023-09-30T22:36:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.213+0000 7f0ea559a700 1 -- 172.21.15.59:0/3558080828 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90011d20 con 0x7f0ea809d630 2023-09-30T22:36:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.213+0000 7f0eaca84700 1 -- 172.21.15.59:0/3558080828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea809d630 msgr2=0x7f0ea80a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.213+0000 7f0eaca84700 1 --2- 172.21.15.59:0/3558080828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea809d630 0x7f0ea80a1340 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f0e900098f0 tx=0x7f0e90009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.213+0000 7f0eaca84700 1 -- 172.21.15.59:0/3558080828 shutdown_connections 2023-09-30T22:36:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.213+0000 7f0eaca84700 1 --2- 172.21.15.59:0/3558080828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea8133930 0x7f0ea8133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.213+0000 7f0eaca84700 1 --2- 172.21.15.59:0/3558080828 >> v2:172.21.15.59:3300/0 conn(0x7f0ea80a0a30 0x7f0ea80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.213+0000 7f0eaca84700 1 --2- 172.21.15.59:0/3558080828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea809d630 0x7f0ea80a1340 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.213+0000 7f0eaca84700 1 -- 172.21.15.59:0/3558080828 >> 172.21.15.59:0/3558080828 conn(0x7f0ea80a3050 msgr2=0x7f0ea80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:38.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.213+0000 7f0eaca84700 1 -- 172.21.15.59:0/3558080828 shutdown_connections 2023-09-30T22:36:38.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.213+0000 7f0eaca84700 1 -- 172.21.15.59:0/3558080828 wait complete. 2023-09-30T22:36:38.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.215+0000 7f0eaca84700 1 Processor -- start 2023-09-30T22:36:38.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.215+0000 7f0eaca84700 1 -- start start 2023-09-30T22:36:38.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.215+0000 7f0eaca84700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea809d630 0x7f0ea81210c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:38.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.215+0000 7f0eaca84700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea80a0a30 0x7f0ea8121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:38.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.215+0000 7f0eaca84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea8133930 0x7f0ea8121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:38.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.215+0000 7f0eaca84700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8125510 con 0x7f0ea809d630 2023-09-30T22:36:38.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.215+0000 7f0eaca84700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8124b50 con 0x7f0ea8133930 2023-09-30T22:36:38.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.215+0000 7f0eaca84700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea81242e0 con 0x7f0ea80a0a30 2023-09-30T22:36:38.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.215+0000 7f0ea6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea8133930 0x7f0ea8121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:38.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.215+0000 7f0ea5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea80a0a30 0x7f0ea8121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:38.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.215+0000 7f0ea6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea8133930 0x7f0ea8121b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47346/0 (socket says 172.21.15.59:47346) 2023-09-30T22:36:38.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.215+0000 7f0ea6d9d700 1 -- 172.21.15.59:0/1059553353 learned_addr learned my addr 172.21.15.59:0/1059553353 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:38.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.215+0000 7f0ea659c700 1 --2- 172.21.15.59:0/1059553353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea809d630 0x7f0ea81210c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:38.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.216+0000 7f0ea5d9b700 1 -- 172.21.15.59:0/1059553353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea8133930 msgr2=0x7f0ea8121b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:38.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.216+0000 7f0ea5d9b700 1 --2- 172.21.15.59:0/1059553353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea8133930 0x7f0ea8121b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.216+0000 7f0ea5d9b700 1 -- 172.21.15.59:0/1059553353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea809d630 msgr2=0x7f0ea81210c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:38.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.216+0000 7f0ea5d9b700 1 --2- 172.21.15.59:0/1059553353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea809d630 0x7f0ea81210c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.216+0000 7f0ea5d9b700 1 -- 172.21.15.59:0/1059553353 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98009a70 con 0x7f0ea80a0a30 2023-09-30T22:36:38.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.216+0000 7f0ea6d9d700 1 --2- 172.21.15.59:0/1059553353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea8133930 0x7f0ea8121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:38.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.216+0000 7f0ea659c700 1 --2- 172.21.15.59:0/1059553353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea809d630 0x7f0ea81210c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:36:38.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.216+0000 7f0ea5d9b700 1 --2- 172.21.15.59:0/1059553353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea80a0a30 0x7f0ea8121600 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80a1fb0 tx=0x7f0e90004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.216+0000 7f0e9effd700 1 -- 172.21.15.59:0/1059553353 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90004240 con 0x7f0ea80a0a30 2023-09-30T22:36:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.216+0000 7f0e9effd700 1 -- 172.21.15.59:0/1059553353 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9001f070 con 0x7f0ea80a0a30 2023-09-30T22:36:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.216+0000 7f0eaca84700 1 -- 172.21.15.59:0/1059553353 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea00094a0 con 0x7f0ea80a0a30 2023-09-30T22:36:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.216+0000 7f0e9effd700 1 -- 172.21.15.59:0/1059553353 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e900036a0 con 0x7f0ea80a0a30 2023-09-30T22:36:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.216+0000 7f0eaca84700 1 -- 172.21.15.59:0/1059553353 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e90009550 con 0x7f0ea80a0a30 2023-09-30T22:36:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.217+0000 7f0e9effd700 1 -- 172.21.15.59:0/1059553353 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e90021030 con 0x7f0ea80a0a30 2023-09-30T22:36:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.217+0000 7f0e9effd700 1 -- 172.21.15.59:0/1059553353 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0e900406d0 con 0x7f0ea80a0a30 2023-09-30T22:36:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.217+0000 7f0eaca84700 1 -- 172.21.15.59:0/1059553353 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea811df60 con 0x7f0ea80a0a30 2023-09-30T22:36:38.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.222+0000 7f0e9effd700 1 -- 172.21.15.59:0/1059553353 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e900199a0 con 0x7f0ea80a0a30 2023-09-30T22:36:38.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.396+0000 7fad95386700 1 -- 172.21.15.59:0/1540464543 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fad90123240 con 0x7fad9009d5c0 2023-09-30T22:36:38.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.396+0000 7fad877fe700 1 -- 172.21.15.59:0/1540464543 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad90123240 con 0x7fad9009d5c0 2023-09-30T22:36:38.398 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.398+0000 7fad95386700 1 -- 172.21.15.59:0/1540464543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad9009d5c0 msgr2=0x7fad90120610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.398+0000 7fad95386700 1 --2- 172.21.15.59:0/1540464543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad9009d5c0 0x7fad90120610 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fad80009f60 tx=0x7fad80009f90 comp rx=0 tx=0).stop 2023-09-30T22:36:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.398+0000 7fad95386700 1 -- 172.21.15.59:0/1540464543 shutdown_connections 2023-09-30T22:36:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.398+0000 7fad95386700 1 --2- 172.21.15.59:0/1540464543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad9009d5c0 0x7fad90120610 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.398+0000 7fad95386700 1 --2- 172.21.15.59:0/1540464543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad900a12d0 0x7fad901c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.398+0000 7fad95386700 1 --2- 172.21.15.59:0/1540464543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad900a09c0 0x7fad90120b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.399+0000 7fad95386700 1 -- 172.21.15.59:0/1540464543 >> 172.21.15.59:0/1540464543 conn(0x7fad900a2fe0 msgr2=0x7fad900a4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.399+0000 7fad95386700 1 -- 172.21.15.59:0/1540464543 shutdown_connections 2023-09-30T22:36:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.399+0000 7fad95386700 1 -- 172.21.15.59:0/1540464543 wait complete. 2023-09-30T22:36:38.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.427+0000 7f0eaca84700 1 -- 172.21.15.59:0/1059553353 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0ea80a0410 con 0x7f0ea80a0a30 2023-09-30T22:36:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.427+0000 7f0e9effd700 1 -- 172.21.15.59:0/1059553353 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e90015020 con 0x7f0ea80a0a30 2023-09-30T22:36:38.428 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:38.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.429+0000 7f0eaca84700 1 -- 172.21.15.59:0/1059553353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea80a0a30 msgr2=0x7f0ea8121600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.429+0000 7f0eaca84700 1 --2- 172.21.15.59:0/1059553353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea80a0a30 0x7f0ea8121600 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80a1fb0 tx=0x7f0e90004750 comp rx=0 tx=0).stop 2023-09-30T22:36:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.429+0000 7f0eaca84700 1 -- 172.21.15.59:0/1059553353 shutdown_connections 2023-09-30T22:36:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.429+0000 7f0eaca84700 1 --2- 172.21.15.59:0/1059553353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea8133930 0x7f0ea8121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.429+0000 7f0eaca84700 1 --2- 172.21.15.59:0/1059553353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea809d630 0x7f0ea81210c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.429+0000 7f0eaca84700 1 --2- 172.21.15.59:0/1059553353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea80a0a30 0x7f0ea8121600 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.429+0000 7f0eaca84700 1 -- 172.21.15.59:0/1059553353 >> 172.21.15.59:0/1059553353 conn(0x7f0ea80a3050 msgr2=0x7f0ea81331f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.429+0000 7f0eaca84700 1 -- 172.21.15.59:0/1059553353 shutdown_connections 2023-09-30T22:36:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:38.429+0000 7f0eaca84700 1 -- 172.21.15.59:0/1059553353 wait complete. 2023-09-30T22:36:38.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:38.946 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:38.981 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:39.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.093+0000 7f10bbdd9700 1 Processor -- start 2023-09-30T22:36:39.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.093+0000 7f10bbdd9700 1 -- start start 2023-09-30T22:36:39.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.093+0000 7f10bbdd9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b40a0a30 0x7f10b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.093+0000 7f10bbdd9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b4138d80 0x7f10b413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.093+0000 7f10bbdd9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b40a2a70 con 0x7f10b409d630 2023-09-30T22:36:39.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.093+0000 7f10bbdd9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40a01d0 con 0x7f10b4138d80 2023-09-30T22:36:39.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.093+0000 7f10bbdd9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10b409e2b0 con 0x7f10b40a0a30 2023-09-30T22:36:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.094+0000 7f10b9b75700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b40a0a30 0x7f10b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.094+0000 7f10ba376700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b4138d80 0x7f10b413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.094+0000 7f10b9374700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f10b409d630 0x7f10b40a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33922/0 (socket says 172.21.15.59:33922) 2023-09-30T22:36:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.094+0000 7f10b9374700 1 -- 172.21.15.59:0/3567404321 learned_addr learned my addr 172.21.15.59:0/3567404321 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:36:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.094+0000 7f10b9b75700 1 -- 172.21.15.59:0/3567404321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b4138d80 msgr2=0x7f10b413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:39.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.094+0000 7f10b9b75700 1 --2- 172.21.15.59:0/3567404321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b4138d80 0x7f10b413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.094+0000 7f10b9b75700 1 -- 172.21.15.59:0/3567404321 >> v1:172.21.15.59:6789/0 conn(0x7f10b409d630 legacy=0x7f10b40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.094+0000 7f10b9b75700 1 -- 172.21.15.59:0/3567404321 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b409dc50 con 0x7f10b40a0a30 2023-09-30T22:36:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.094+0000 7f10b8b73700 1 -- 172.21.15.59:0/3567404321 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009893804 0 0) 0x7f10b40a2a70 con 0x7f10b409d630 2023-09-30T22:36:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.094+0000 7f10ba376700 1 --2- 172.21.15.59:0/3567404321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b4138d80 0x7f10b413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.094+0000 7f10b9b75700 1 --2- 172.21.15.59:0/3567404321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b40a0a30 0x7f10b40a0e00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009dc0 tx=0x7f10a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2f3a8b669c7f399 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.094+0000 7f10b8b73700 1 -- 172.21.15.59:0/3567404321 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a400e070 con 0x7f10b40a0a30 2023-09-30T22:36:39.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.094+0000 7f10b8b73700 1 -- 172.21.15.59:0/3567404321 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a400bb20 con 0x7f10b40a0a30 2023-09-30T22:36:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.094+0000 7f10b8b73700 1 -- 172.21.15.59:0/3567404321 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a4012430 con 0x7f10b40a0a30 2023-09-30T22:36:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.095+0000 7f10bbdd9700 1 -- 172.21.15.59:0/3567404321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b40a0a30 msgr2=0x7f10b40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.095+0000 7f10bbdd9700 1 --2- 172.21.15.59:0/3567404321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b40a0a30 0x7f10b40a0e00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009dc0 tx=0x7f10a400b330 comp rx=0 tx=0).stop 2023-09-30T22:36:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.095+0000 7f10bbdd9700 1 -- 172.21.15.59:0/3567404321 shutdown_connections 2023-09-30T22:36:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.095+0000 7f10bbdd9700 1 --2- 172.21.15.59:0/3567404321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b40a0a30 0x7f10b40a0e00 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.095+0000 7f10bbdd9700 1 --2- 172.21.15.59:0/3567404321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b4138d80 0x7f10b413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.095+0000 7f10bbdd9700 1 -- 172.21.15.59:0/3567404321 >> 172.21.15.59:0/3567404321 conn(0x7f10b40a3050 msgr2=0x7f10b40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:39.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.096+0000 7f10bbdd9700 1 -- 172.21.15.59:0/3567404321 shutdown_connections 2023-09-30T22:36:39.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.096+0000 7f10bbdd9700 1 -- 172.21.15.59:0/3567404321 wait complete. 2023-09-30T22:36:39.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.097+0000 7f10bbdd9700 1 Processor -- start 2023-09-30T22:36:39.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.097+0000 7f10bbdd9700 1 -- start start 2023-09-30T22:36:39.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.097+0000 7f10bbdd9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b409d630 0x7f10b41337e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.097+0000 7f10bbdd9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b40a0a30 0x7f10b4133d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.097+0000 7f10bbdd9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b4138d80 0x7f10b4134260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.097+0000 7f10bbdd9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b4136f80 con 0x7f10b4138d80 2023-09-30T22:36:39.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.097+0000 7f10bbdd9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b4135970 con 0x7f10b40a0a30 2023-09-30T22:36:39.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.097+0000 7f10bbdd9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40a0480 con 0x7f10b409d630 2023-09-30T22:36:39.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.097+0000 7f10b9374700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b40a0a30 0x7f10b4133d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.097+0000 7f10ba376700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b4138d80 0x7f10b4134260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.097+0000 7f10ba376700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b4138d80 0x7f10b4134260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39442/0 (socket says 172.21.15.59:39442) 2023-09-30T22:36:39.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.097+0000 7f10b9374700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b40a0a30 0x7f10b4133d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47374/0 (socket says 172.21.15.59:47374) 2023-09-30T22:36:39.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.097+0000 7f10ba376700 1 -- 172.21.15.59:0/1842429518 learned_addr learned my addr 172.21.15.59:0/1842429518 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:39.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.097+0000 7f10b9b75700 1 --2- 172.21.15.59:0/1842429518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b409d630 0x7f10b41337e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.098+0000 7f10b9374700 1 -- 172.21.15.59:0/1842429518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b409d630 msgr2=0x7f10b41337e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.098+0000 7f10b9374700 1 --2- 172.21.15.59:0/1842429518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b409d630 0x7f10b41337e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.098+0000 7f10b9374700 1 -- 172.21.15.59:0/1842429518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b4138d80 msgr2=0x7f10b4134260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.098+0000 7f10b9374700 1 --2- 172.21.15.59:0/1842429518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b4138d80 0x7f10b4134260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.098+0000 7f10b9374700 1 -- 172.21.15.59:0/1842429518 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac0094a0 con 0x7f10b40a0a30 2023-09-30T22:36:39.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.098+0000 7f10ba376700 1 --2- 172.21.15.59:0/1842429518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b4138d80 0x7f10b4134260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:39.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.098+0000 7f10b9374700 1 --2- 172.21.15.59:0/1842429518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b40a0a30 0x7f10b4133d20 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f10a800c4a0 tx=0x7f10a800c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:39.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.098+0000 7f10b27fc700 1 -- 172.21.15.59:0/1842429518 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a8004a70 con 0x7f10b40a0a30 2023-09-30T22:36:39.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.098+0000 7f10b27fc700 1 -- 172.21.15.59:0/1842429518 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a8004bd0 con 0x7f10b40a0a30 2023-09-30T22:36:39.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.098+0000 7f10bbdd9700 1 -- 172.21.15.59:0/1842429518 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a4009a70 con 0x7f10b40a0a30 2023-09-30T22:36:39.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.098+0000 7f10b27fc700 1 -- 172.21.15.59:0/1842429518 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a80070d0 con 0x7f10b40a0a30 2023-09-30T22:36:39.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.098+0000 7f10bbdd9700 1 -- 172.21.15.59:0/1842429518 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b4137e40 con 0x7f10b40a0a30 2023-09-30T22:36:39.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.099+0000 7f10b27fc700 1 -- 172.21.15.59:0/1842429518 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10a8007230 con 0x7f10b40a0a30 2023-09-30T22:36:39.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.099+0000 7f10bbdd9700 1 -- 172.21.15.59:0/1842429518 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b413b620 con 0x7f10b40a0a30 2023-09-30T22:36:39.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.099+0000 7f10b27fc700 1 -- 172.21.15.59:0/1842429518 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f10a803f210 con 0x7f10b40a0a30 2023-09-30T22:36:39.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.108+0000 7f10b27fc700 1 -- 172.21.15.59:0/1842429518 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10a80074e0 con 0x7f10b40a0a30 2023-09-30T22:36:39.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.135+0000 7f6783bc6700 1 Processor -- start 2023-09-30T22:36:39.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.135+0000 7f6783bc6700 1 -- start start 2023-09-30T22:36:39.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6783bc6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677c0a0a30 0x7f677c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6783bc6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f677c09d630 0x7f677c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6783bc6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677c0a2a70 con 0x7f677c133930 2023-09-30T22:36:39.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6783bc6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c0a01d0 con 0x7f677c0a0a30 2023-09-30T22:36:39.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6783bc6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f677c09e2b0 con 0x7f677c09d630 2023-09-30T22:36:39.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6781962700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677c0a0a30 0x7f677c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6781161700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f677c09d630 0x7f677c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6781962700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677c0a0a30 0x7f677c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47376/0 (socket says 172.21.15.59:47376) 2023-09-30T22:36:39.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6781161700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f677c09d630 0x7f677c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44480/0 (socket says 172.21.15.59:44480) 2023-09-30T22:36:39.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6781962700 1 -- 172.21.15.59:0/32690758 learned_addr learned my addr 172.21.15.59:0/32690758 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:39.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6781962700 1 -- 172.21.15.59:0/32690758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f677c09d630 msgr2=0x7f677c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:39.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6781962700 1 --2- 172.21.15.59:0/32690758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f677c09d630 0x7f677c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6781962700 1 -- 172.21.15.59:0/32690758 >> v1:172.21.15.59:6789/0 conn(0x7f677c133930 legacy=0x7f677c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6780960700 1 -- 172.21.15.59:0/32690758 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752800103 0 0) 0x7f677c0a2a70 con 0x7f677c133930 2023-09-30T22:36:39.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6781962700 1 -- 172.21.15.59:0/32690758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c09dc50 con 0x7f677c0a0a30 2023-09-30T22:36:39.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6781161700 1 --2- 172.21.15.59:0/32690758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f677c09d630 0x7f677c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:39.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.136+0000 7f6781962700 1 --2- 172.21.15.59:0/32690758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677c0a0a30 0x7f677c0a0e00 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f676c009e80 tx=0x7f676c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83483aaa68e84558 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:39.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.137+0000 7f6780960700 1 -- 172.21.15.59:0/32690758 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c00e070 con 0x7f677c0a0a30 2023-09-30T22:36:39.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.137+0000 7f6780960700 1 -- 172.21.15.59:0/32690758 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c00b910 con 0x7f677c0a0a30 2023-09-30T22:36:39.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.137+0000 7f6780960700 1 -- 172.21.15.59:0/32690758 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c00bcc0 con 0x7f677c0a0a30 2023-09-30T22:36:39.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.137+0000 7f6783bc6700 1 -- 172.21.15.59:0/32690758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677c0a0a30 msgr2=0x7f677c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.137+0000 7f6783bc6700 1 --2- 172.21.15.59:0/32690758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677c0a0a30 0x7f677c0a0e00 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f676c009e80 tx=0x7f676c00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:39.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.137+0000 7f6783bc6700 1 -- 172.21.15.59:0/32690758 shutdown_connections 2023-09-30T22:36:39.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.137+0000 7f6783bc6700 1 --2- 172.21.15.59:0/32690758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677c0a0a30 0x7f677c0a0e00 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.137+0000 7f6783bc6700 1 --2- 172.21.15.59:0/32690758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f677c09d630 0x7f677c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.137+0000 7f6783bc6700 1 -- 172.21.15.59:0/32690758 >> 172.21.15.59:0/32690758 conn(0x7f677c0a3050 msgr2=0x7f677c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:39.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.137+0000 7f6783bc6700 1 -- 172.21.15.59:0/32690758 shutdown_connections 2023-09-30T22:36:39.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.137+0000 7f6783bc6700 1 -- 172.21.15.59:0/32690758 wait complete. 2023-09-30T22:36:39.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.138+0000 7f6783bc6700 1 Processor -- start 2023-09-30T22:36:39.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.138+0000 7f6783bc6700 1 -- start start 2023-09-30T22:36:39.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6783bc6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f677c09d630 0x7f677c11f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6783bc6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f677c0a0a30 0x7f677c11f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6783bc6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677c133930 0x7f677c1c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6783bc6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c121ed0 con 0x7f677c0a0a30 2023-09-30T22:36:39.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6783bc6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c133250 con 0x7f677c133930 2023-09-30T22:36:39.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6783bc6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f677c11ee20 con 0x7f677c09d630 2023-09-30T22:36:39.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6781161700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f677c0a0a30 0x7f677c11f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6781962700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f677c09d630 0x7f677c11f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6782163700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677c133930 0x7f677c1c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6781161700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f677c0a0a30 0x7f677c11f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39446/0 (socket says 172.21.15.59:39446) 2023-09-30T22:36:39.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6781161700 1 -- 172.21.15.59:0/4098516935 learned_addr learned my addr 172.21.15.59:0/4098516935 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:39.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6781962700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f677c09d630 0x7f677c11f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44482/0 (socket says 172.21.15.59:44482) 2023-09-30T22:36:39.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6781161700 1 -- 172.21.15.59:0/4098516935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f677c09d630 msgr2=0x7f677c11f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6781161700 1 --2- 172.21.15.59:0/4098516935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f677c09d630 0x7f677c11f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6781161700 1 -- 172.21.15.59:0/4098516935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677c133930 msgr2=0x7f677c1c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6781161700 1 --2- 172.21.15.59:0/4098516935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677c133930 0x7f677c1c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6781161700 1 -- 172.21.15.59:0/4098516935 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67700094a0 con 0x7f677c0a0a30 2023-09-30T22:36:39.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6782163700 1 --2- 172.21.15.59:0/4098516935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677c133930 0x7f677c1c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:39.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6781962700 1 --2- 172.21.15.59:0/4098516935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f677c09d630 0x7f677c11f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:39.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.139+0000 7f6781161700 1 --2- 172.21.15.59:0/4098516935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f677c0a0a30 0x7f677c11f800 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f677000ebe0 tx=0x7f677000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:39.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.140+0000 7f677a7fc700 1 -- 172.21.15.59:0/4098516935 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677000c7f0 con 0x7f677c0a0a30 2023-09-30T22:36:39.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.140+0000 7f677a7fc700 1 -- 172.21.15.59:0/4098516935 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677000c950 con 0x7f677c0a0a30 2023-09-30T22:36:39.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.140+0000 7f677a7fc700 1 -- 172.21.15.59:0/4098516935 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677000cce0 con 0x7f677c0a0a30 2023-09-30T22:36:39.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.140+0000 7f6783bc6700 1 -- 172.21.15.59:0/4098516935 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676c009b30 con 0x7f677c0a0a30 2023-09-30T22:36:39.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.140+0000 7f6783bc6700 1 -- 172.21.15.59:0/4098516935 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677c0a4250 con 0x7f677c0a0a30 2023-09-30T22:36:39.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.141+0000 7f677a7fc700 1 -- 172.21.15.59:0/4098516935 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6770013470 con 0x7f677c0a0a30 2023-09-30T22:36:39.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.141+0000 7f677a7fc700 1 -- 172.21.15.59:0/4098516935 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f677003fb30 con 0x7f677c0a0a30 2023-09-30T22:36:39.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.141+0000 7f6783bc6700 1 -- 172.21.15.59:0/4098516935 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677c120a40 con 0x7f677c0a0a30 2023-09-30T22:36:39.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.146+0000 7f677a7fc700 1 -- 172.21.15.59:0/4098516935 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6770013720 con 0x7f677c0a0a30 2023-09-30T22:36:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.320+0000 7f10bbdd9700 1 -- 172.21.15.59:0/1842429518 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f10b40747f0 con 0x7f10b40a0a30 2023-09-30T22:36:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.320+0000 7f10b27fc700 1 -- 172.21.15.59:0/1842429518 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10a801ce50 con 0x7f10b40a0a30 2023-09-30T22:36:39.322 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.322+0000 7f10bbdd9700 1 -- 172.21.15.59:0/1842429518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b40a0a30 msgr2=0x7f10b4133d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.322+0000 7f10bbdd9700 1 --2- 172.21.15.59:0/1842429518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b40a0a30 0x7f10b4133d20 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f10a800c4a0 tx=0x7f10a800c7b0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.323+0000 7f10bbdd9700 1 -- 172.21.15.59:0/1842429518 shutdown_connections 2023-09-30T22:36:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.323+0000 7f10bbdd9700 1 --2- 172.21.15.59:0/1842429518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10b409d630 0x7f10b41337e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.323+0000 7f10bbdd9700 1 --2- 172.21.15.59:0/1842429518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b4138d80 0x7f10b4134260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.323+0000 7f10bbdd9700 1 --2- 172.21.15.59:0/1842429518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10b40a0a30 0x7f10b4133d20 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.323+0000 7f10bbdd9700 1 -- 172.21.15.59:0/1842429518 >> 172.21.15.59:0/1842429518 conn(0x7f10b40a3050 msgr2=0x7f10b40a6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.323+0000 7f10bbdd9700 1 -- 172.21.15.59:0/1842429518 shutdown_connections 2023-09-30T22:36:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.323+0000 7f10bbdd9700 1 -- 172.21.15.59:0/1842429518 wait complete. 2023-09-30T22:36:39.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:39.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.359+0000 7f6783bc6700 1 -- 172.21.15.59:0/4098516935 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f677c120cc0 con 0x7f677c0a0a30 2023-09-30T22:36:39.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.359+0000 7f677a7fc700 1 -- 172.21.15.59:0/4098516935 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6770021030 con 0x7f677c0a0a30 2023-09-30T22:36:39.361 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:39.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.362+0000 7f6783bc6700 1 -- 172.21.15.59:0/4098516935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f677c0a0a30 msgr2=0x7f677c11f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.362+0000 7f6783bc6700 1 --2- 172.21.15.59:0/4098516935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f677c0a0a30 0x7f677c11f800 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f677000ebe0 tx=0x7f677000eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.362+0000 7f6783bc6700 1 -- 172.21.15.59:0/4098516935 shutdown_connections 2023-09-30T22:36:39.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.362+0000 7f6783bc6700 1 --2- 172.21.15.59:0/4098516935 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f677c09d630 0x7f677c11f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.362+0000 7f6783bc6700 1 --2- 172.21.15.59:0/4098516935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677c133930 0x7f677c1c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.362+0000 7f6783bc6700 1 --2- 172.21.15.59:0/4098516935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f677c0a0a30 0x7f677c11f800 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.362+0000 7f6783bc6700 1 -- 172.21.15.59:0/4098516935 >> 172.21.15.59:0/4098516935 conn(0x7f677c0a3050 msgr2=0x7f677c1bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:39.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.362+0000 7f6783bc6700 1 -- 172.21.15.59:0/4098516935 shutdown_connections 2023-09-30T22:36:39.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.362+0000 7f6783bc6700 1 -- 172.21.15.59:0/4098516935 wait complete. 2023-09-30T22:36:39.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:39.414 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:36:39.445 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:39.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.559+0000 7fc743c83700 1 Processor -- start 2023-09-30T22:36:39.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.559+0000 7fc743c83700 1 -- start start 2023-09-30T22:36:39.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc743c83700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc73c0a0a30 0x7fc73c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc743c83700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc73c09d630 0x7fc73c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc743c83700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc73c133930 0x7fc73c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc743c83700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc73c0a2a70 con 0x7fc73c133930 2023-09-30T22:36:39.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc743c83700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c0a01d0 con 0x7fc73c0a0a30 2023-09-30T22:36:39.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc743c83700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c09e2b0 con 0x7fc73c09d630 2023-09-30T22:36:39.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc741a1f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc73c0a0a30 0x7fc73c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc742220700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc73c133930 0x7fc73c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc741a1f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc73c0a0a30 0x7fc73c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47392/0 (socket says 172.21.15.59:47392) 2023-09-30T22:36:39.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc741a1f700 1 -- 172.21.15.59:0/2372373993 learned_addr learned my addr 172.21.15.59:0/2372373993 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:39.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc74121e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc73c09d630 0x7fc73c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc742220700 1 -- 172.21.15.59:0/2372373993 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc73c09d630 msgr2=0x7fc73c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:39.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc742220700 1 --2- 172.21.15.59:0/2372373993 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc73c09d630 0x7fc73c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc742220700 1 -- 172.21.15.59:0/2372373993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc73c0a0a30 msgr2=0x7fc73c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:39.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc742220700 1 --2- 172.21.15.59:0/2372373993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc73c0a0a30 0x7fc73c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc742220700 1 -- 172.21.15.59:0/2372373993 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c09dc50 con 0x7fc73c133930 2023-09-30T22:36:39.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc74121e700 1 --2- 172.21.15.59:0/2372373993 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc73c09d630 0x7fc73c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:39.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc741a1f700 1 --2- 172.21.15.59:0/2372373993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc73c0a0a30 0x7fc73c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:39.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.560+0000 7fc742220700 1 --2- 172.21.15.59:0/2372373993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc73c133930 0x7fc73c133dd0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009d90 tx=0x7fc72c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f80d9ed2ac50020 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:39.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.561+0000 7fc740a1d700 1 -- 172.21.15.59:0/2372373993 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c00e070 con 0x7fc73c133930 2023-09-30T22:36:39.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.561+0000 7fc740a1d700 1 -- 172.21.15.59:0/2372373993 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c00bb20 con 0x7fc73c133930 2023-09-30T22:36:39.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.561+0000 7fc740a1d700 1 -- 172.21.15.59:0/2372373993 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c012430 con 0x7fc73c133930 2023-09-30T22:36:39.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.561+0000 7fc743c83700 1 -- 172.21.15.59:0/2372373993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc73c133930 msgr2=0x7fc73c133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.561+0000 7fc743c83700 1 --2- 172.21.15.59:0/2372373993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc73c133930 0x7fc73c133dd0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009d90 tx=0x7fc72c00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:39.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.561+0000 7fc743c83700 1 -- 172.21.15.59:0/2372373993 shutdown_connections 2023-09-30T22:36:39.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.561+0000 7fc743c83700 1 --2- 172.21.15.59:0/2372373993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc73c133930 0x7fc73c133dd0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.561+0000 7fc743c83700 1 --2- 172.21.15.59:0/2372373993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc73c0a0a30 0x7fc73c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.561+0000 7fc743c83700 1 --2- 172.21.15.59:0/2372373993 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc73c09d630 0x7fc73c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.561+0000 7fc743c83700 1 -- 172.21.15.59:0/2372373993 >> 172.21.15.59:0/2372373993 conn(0x7fc73c0a3050 msgr2=0x7fc73c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:39.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.561+0000 7fc743c83700 1 -- 172.21.15.59:0/2372373993 shutdown_connections 2023-09-30T22:36:39.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.562+0000 7fc743c83700 1 -- 172.21.15.59:0/2372373993 wait complete. 2023-09-30T22:36:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.563+0000 7fc743c83700 1 Processor -- start 2023-09-30T22:36:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.563+0000 7fc743c83700 1 -- start start 2023-09-30T22:36:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.563+0000 7fc743c83700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc73c09d630 0x7fc73c1c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.563+0000 7fc743c83700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc73c0a0a30 0x7fc73c1c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.563+0000 7fc743c83700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc73c133930 0x7fc73c1c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.563+0000 7fc743c83700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c122100 con 0x7fc73c0a0a30 2023-09-30T22:36:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.563+0000 7fc743c83700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c1205e0 con 0x7fc73c09d630 2023-09-30T22:36:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.563+0000 7fc743c83700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c133420 con 0x7fc73c133930 2023-09-30T22:36:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.563+0000 7fc74121e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc73c0a0a30 0x7fc73c1c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.563+0000 7fc742220700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc73c133930 0x7fc73c1c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.563+0000 7fc741a1f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc73c09d630 0x7fc73c1c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.563+0000 7fc74121e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc73c0a0a30 0x7fc73c1c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39468/0 (socket says 172.21.15.59:39468) 2023-09-30T22:36:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.563+0000 7fc74121e700 1 -- 172.21.15.59:0/2273423369 learned_addr learned my addr 172.21.15.59:0/2273423369 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.564+0000 7fc741a1f700 1 -- 172.21.15.59:0/2273423369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc73c133930 msgr2=0x7fc73c1c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.564+0000 7fc741a1f700 1 --2- 172.21.15.59:0/2273423369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc73c133930 0x7fc73c1c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.564+0000 7fc741a1f700 1 -- 172.21.15.59:0/2273423369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc73c0a0a30 msgr2=0x7fc73c1c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.564+0000 7fc741a1f700 1 --2- 172.21.15.59:0/2273423369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc73c0a0a30 0x7fc73c1c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.564+0000 7fc741a1f700 1 -- 172.21.15.59:0/2273423369 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300094a0 con 0x7fc73c09d630 2023-09-30T22:36:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.564+0000 7fc74121e700 1 --2- 172.21.15.59:0/2273423369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc73c0a0a30 0x7fc73c1c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.564+0000 7fc741a1f700 1 --2- 172.21.15.59:0/2273423369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc73c09d630 0x7fc73c1c7fb0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc73400e9a0 tx=0x7fc73400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.564+0000 7fc73a7fc700 1 -- 172.21.15.59:0/2273423369 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734004030 con 0x7fc73c09d630 2023-09-30T22:36:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.564+0000 7fc73a7fc700 1 -- 172.21.15.59:0/2273423369 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc734004190 con 0x7fc73c09d630 2023-09-30T22:36:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.564+0000 7fc73a7fc700 1 -- 172.21.15.59:0/2273423369 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734004520 con 0x7fc73c09d630 2023-09-30T22:36:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.564+0000 7fc743c83700 1 -- 172.21.15.59:0/2273423369 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc734009550 con 0x7fc73c09d630 2023-09-30T22:36:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.564+0000 7fc743c83700 1 -- 172.21.15.59:0/2273423369 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72c009a70 con 0x7fc73c09d630 2023-09-30T22:36:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.565+0000 7fc73a7fc700 1 -- 172.21.15.59:0/2273423369 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7340036a0 con 0x7fc73c09d630 2023-09-30T22:36:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.565+0000 7fc73a7fc700 1 -- 172.21.15.59:0/2273423369 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc73403f810 con 0x7fc73c09d630 2023-09-30T22:36:39.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.565+0000 7fc743c83700 1 -- 172.21.15.59:0/2273423369 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc73c120aa0 con 0x7fc73c09d630 2023-09-30T22:36:39.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.570+0000 7fc73a7fc700 1 -- 172.21.15.59:0/2273423369 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc734011db0 con 0x7fc73c09d630 2023-09-30T22:36:39.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.604+0000 7f6911a52700 1 Processor -- start 2023-09-30T22:36:39.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.604+0000 7f6911a52700 1 -- start start 2023-09-30T22:36:39.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.605+0000 7f6911a52700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c0a09c0 0x7f690c0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.605+0000 7f6911a52700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c09d5c0 0x7f690c0a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.605+0000 7f6911a52700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f690c133920 0x7f690c133d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.605+0000 7f6911a52700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690c0a1810 con 0x7f690c133920 2023-09-30T22:36:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.605+0000 7f6911a52700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c09ea10 con 0x7f690c09d5c0 2023-09-30T22:36:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.605+0000 7f6911a52700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f690c09e210 con 0x7f690c0a09c0 2023-09-30T22:36:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.605+0000 7f690a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c09d5c0 0x7f690c0a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.605+0000 7f690b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f690c133920 0x7f690c133d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.605+0000 7f690a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c09d5c0 0x7f690c0a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47408/0 (socket says 172.21.15.59:47408) 2023-09-30T22:36:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.605+0000 7f690affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c0a09c0 0x7f690c0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.605+0000 7f690a7fc700 1 -- 172.21.15.59:0/1123031630 learned_addr learned my addr 172.21.15.59:0/1123031630 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.606+0000 7f690affd700 1 -- 172.21.15.59:0/1123031630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c09d5c0 msgr2=0x7f690c0a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:39.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.606+0000 7f690affd700 1 --2- 172.21.15.59:0/1123031630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c09d5c0 0x7f690c0a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.606+0000 7f690affd700 1 -- 172.21.15.59:0/1123031630 >> v2:172.21.15.59:3300/0 conn(0x7f690c133920 msgr2=0x7f690c133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:39.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.606+0000 7f690affd700 1 --2- 172.21.15.59:0/1123031630 >> v2:172.21.15.59:3300/0 conn(0x7f690c133920 0x7f690c133d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.606+0000 7f690affd700 1 -- 172.21.15.59:0/1123031630 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c0a26f0 con 0x7f690c0a09c0 2023-09-30T22:36:39.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.606+0000 7f690b7fe700 1 --2- 172.21.15.59:0/1123031630 >> v2:172.21.15.59:3300/0 conn(0x7f690c133920 0x7f690c133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:39.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.606+0000 7f690a7fc700 1 --2- 172.21.15.59:0/1123031630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c09d5c0 0x7f690c0a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:39.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.606+0000 7f690affd700 1 --2- 172.21.15.59:0/1123031630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c0a09c0 0x7f690c0a0d90 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6904009d90 tx=0x7f690400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e7b487645b9b1cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:39.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.606+0000 7f6909ffb700 1 -- 172.21.15.59:0/1123031630 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690400e070 con 0x7f690c0a09c0 2023-09-30T22:36:39.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.606+0000 7f6909ffb700 1 -- 172.21.15.59:0/1123031630 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690400bb20 con 0x7f690c0a09c0 2023-09-30T22:36:39.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.606+0000 7f6909ffb700 1 -- 172.21.15.59:0/1123031630 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904012430 con 0x7f690c0a09c0 2023-09-30T22:36:39.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.607+0000 7f6911a52700 1 -- 172.21.15.59:0/1123031630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c0a09c0 msgr2=0x7f690c0a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.607+0000 7f6911a52700 1 --2- 172.21.15.59:0/1123031630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c0a09c0 0x7f690c0a0d90 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6904009d90 tx=0x7f690400b330 comp rx=0 tx=0).stop 2023-09-30T22:36:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.607+0000 7f6911a52700 1 -- 172.21.15.59:0/1123031630 shutdown_connections 2023-09-30T22:36:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.607+0000 7f6911a52700 1 --2- 172.21.15.59:0/1123031630 >> v2:172.21.15.59:3300/0 conn(0x7f690c133920 0x7f690c133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.607+0000 7f6911a52700 1 --2- 172.21.15.59:0/1123031630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c0a09c0 0x7f690c0a0d90 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.607+0000 7f6911a52700 1 --2- 172.21.15.59:0/1123031630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c09d5c0 0x7f690c0a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.607+0000 7f6911a52700 1 -- 172.21.15.59:0/1123031630 >> 172.21.15.59:0/1123031630 conn(0x7f690c0a2fe0 msgr2=0x7f690c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.607+0000 7f6911a52700 1 -- 172.21.15.59:0/1123031630 shutdown_connections 2023-09-30T22:36:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.607+0000 7f6911a52700 1 -- 172.21.15.59:0/1123031630 wait complete. 2023-09-30T22:36:39.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.608+0000 7f6911a52700 1 Processor -- start 2023-09-30T22:36:39.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.609+0000 7f6911a52700 1 -- start start 2023-09-30T22:36:39.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.609+0000 7f6911a52700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09d5c0 0x7f690c121190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.609+0000 7f6911a52700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c0a09c0 0x7f690c1216d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.609+0000 7f6911a52700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c133920 0x7f690c121c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:39.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.609+0000 7f6911a52700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c124ab0 con 0x7f690c0a09c0 2023-09-30T22:36:39.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.609+0000 7f6911a52700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c124710 con 0x7f690c133920 2023-09-30T22:36:39.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.609+0000 7f6911a52700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f690c124cb0 con 0x7f690c09d5c0 2023-09-30T22:36:39.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.610+0000 7f690affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09d5c0 0x7f690c121190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.610+0000 7f690affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09d5c0 0x7f690c121190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44518/0 (socket says 172.21.15.59:44518) 2023-09-30T22:36:39.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.610+0000 7f690affd700 1 -- 172.21.15.59:0/140252431 learned_addr learned my addr 172.21.15.59:0/140252431 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:39.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.610+0000 7f690b7fe700 1 --2- 172.21.15.59:0/140252431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c133920 0x7f690c121c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.610+0000 7f690a7fc700 1 --2- 172.21.15.59:0/140252431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c0a09c0 0x7f690c1216d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:39.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.610+0000 7f690b7fe700 1 -- 172.21.15.59:0/140252431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09d5c0 msgr2=0x7f690c121190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.610+0000 7f690b7fe700 1 --2- 172.21.15.59:0/140252431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09d5c0 0x7f690c121190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.610+0000 7f690b7fe700 1 -- 172.21.15.59:0/140252431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c0a09c0 msgr2=0x7f690c1216d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.610+0000 7f690b7fe700 1 --2- 172.21.15.59:0/140252431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c0a09c0 0x7f690c1216d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.610+0000 7f690b7fe700 1 -- 172.21.15.59:0/140252431 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f4009550 con 0x7f690c133920 2023-09-30T22:36:39.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.610+0000 7f690b7fe700 1 --2- 172.21.15.59:0/140252431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c133920 0x7f690c121c10 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00e940 tx=0x7f68fc00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:39.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.610+0000 7f6903fff700 1 -- 172.21.15.59:0/140252431 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc004020 con 0x7f690c133920 2023-09-30T22:36:39.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.610+0000 7f6903fff700 1 -- 172.21.15.59:0/140252431 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc0041a0 con 0x7f690c133920 2023-09-30T22:36:39.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.610+0000 7f6903fff700 1 -- 172.21.15.59:0/140252431 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc004550 con 0x7f690c133920 2023-09-30T22:36:39.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.610+0000 7f6911a52700 1 -- 172.21.15.59:0/140252431 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68fc0094a0 con 0x7f690c133920 2023-09-30T22:36:39.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.611+0000 7f6911a52700 1 -- 172.21.15.59:0/140252431 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6904009a70 con 0x7f690c133920 2023-09-30T22:36:39.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.611+0000 7f6903fff700 1 -- 172.21.15.59:0/140252431 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68fc0036a0 con 0x7f690c133920 2023-09-30T22:36:39.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.612+0000 7f6903fff700 1 -- 172.21.15.59:0/140252431 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f68fc03f740 con 0x7f690c133920 2023-09-30T22:36:39.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.612+0000 7f6911a52700 1 -- 172.21.15.59:0/140252431 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690c11df50 con 0x7f690c133920 2023-09-30T22:36:39.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.617+0000 7f6903fff700 1 -- 172.21.15.59:0/140252431 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68fc013680 con 0x7f690c133920 2023-09-30T22:36:39.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.779+0000 7fc743c83700 1 -- 172.21.15.59:0/2273423369 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc73c0747f0 con 0x7fc73c09d630 2023-09-30T22:36:39.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.780+0000 7fc73a7fc700 1 -- 172.21.15.59:0/2273423369 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc734020020 con 0x7fc73c09d630 2023-09-30T22:36:39.781 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:39.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.782+0000 7fc743c83700 1 -- 172.21.15.59:0/2273423369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc73c09d630 msgr2=0x7fc73c1c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.782+0000 7fc743c83700 1 --2- 172.21.15.59:0/2273423369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc73c09d630 0x7fc73c1c7fb0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc73400e9a0 tx=0x7fc73400ecb0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.782+0000 7fc743c83700 1 -- 172.21.15.59:0/2273423369 shutdown_connections 2023-09-30T22:36:39.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.782+0000 7fc743c83700 1 --2- 172.21.15.59:0/2273423369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc73c133930 0x7fc73c1c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.782+0000 7fc743c83700 1 --2- 172.21.15.59:0/2273423369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc73c09d630 0x7fc73c1c7fb0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.782+0000 7fc743c83700 1 --2- 172.21.15.59:0/2273423369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc73c0a0a30 0x7fc73c1c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.782+0000 7fc743c83700 1 -- 172.21.15.59:0/2273423369 >> 172.21.15.59:0/2273423369 conn(0x7fc73c0a3050 msgr2=0x7fc73c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:39.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.782+0000 7fc743c83700 1 -- 172.21.15.59:0/2273423369 shutdown_connections 2023-09-30T22:36:39.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.782+0000 7fc743c83700 1 -- 172.21.15.59:0/2273423369 wait complete. 2023-09-30T22:36:39.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.1 2023-09-30T22:36:39.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.821+0000 7f6911a52700 1 -- 172.21.15.59:0/140252431 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f690c0a4000 con 0x7f690c133920 2023-09-30T22:36:39.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.822+0000 7f6903fff700 1 -- 172.21.15.59:0/140252431 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68fc017020 con 0x7f690c133920 2023-09-30T22:36:39.823 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:39.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.824+0000 7f6911a52700 1 -- 172.21.15.59:0/140252431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c133920 msgr2=0x7f690c121c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:39.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.824+0000 7f6911a52700 1 --2- 172.21.15.59:0/140252431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c133920 0x7f690c121c10 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00e940 tx=0x7f68fc00ec50 comp rx=0 tx=0).stop 2023-09-30T22:36:39.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.824+0000 7f6911a52700 1 -- 172.21.15.59:0/140252431 shutdown_connections 2023-09-30T22:36:39.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.824+0000 7f6911a52700 1 --2- 172.21.15.59:0/140252431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f690c09d5c0 0x7f690c121190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.824+0000 7f6911a52700 1 --2- 172.21.15.59:0/140252431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f690c133920 0x7f690c121c10 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.824+0000 7f6911a52700 1 --2- 172.21.15.59:0/140252431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c0a09c0 0x7f690c1216d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:39.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.824+0000 7f6911a52700 1 -- 172.21.15.59:0/140252431 >> 172.21.15.59:0/140252431 conn(0x7f690c0a2fe0 msgr2=0x7f690c133130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:39.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.824+0000 7f6911a52700 1 -- 172.21.15.59:0/140252431 shutdown_connections 2023-09-30T22:36:39.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:39.824+0000 7f6911a52700 1 -- 172.21.15.59:0/140252431 wait complete. 2023-09-30T22:36:39.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:36:40.339 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:36:40.378 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:36:40.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.488+0000 7ffbb47b7700 1 Processor -- start 2023-09-30T22:36:40.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.488+0000 7ffbb47b7700 1 -- start start 2023-09-30T22:36:40.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.489+0000 7ffbb47b7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffbac09d630 0x7ffbac0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:40.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.489+0000 7ffbb47b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbac138d80 0x7ffbac13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:40.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.489+0000 7ffbb47b7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbac0a2a70 con 0x7ffbac0a0a30 2023-09-30T22:36:40.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.489+0000 7ffbb47b7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbac0a01d0 con 0x7ffbac09d630 2023-09-30T22:36:40.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.489+0000 7ffbb47b7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac09e2b0 con 0x7ffbac138d80 2023-09-30T22:36:40.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.489+0000 7ffbb1d52700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffbac09d630 0x7ffbac0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:40.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.489+0000 7ffbb2d54700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbac138d80 0x7ffbac13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:40.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.489+0000 7ffbb1d52700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffbac09d630 0x7ffbac0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39512/0 (socket says 172.21.15.59:39512) 2023-09-30T22:36:40.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.489+0000 7ffbb2d54700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbac138d80 0x7ffbac13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44526/0 (socket says 172.21.15.59:44526) 2023-09-30T22:36:40.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.489+0000 7ffbb1d52700 1 -- 172.21.15.59:0/2581553827 learned_addr learned my addr 172.21.15.59:0/2581553827 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:40.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.489+0000 7ffbb1d52700 1 -- 172.21.15.59:0/2581553827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbac138d80 msgr2=0x7ffbac13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:40.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.489+0000 7ffbb1d52700 1 --2- 172.21.15.59:0/2581553827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbac138d80 0x7ffbac13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.489+0000 7ffbb1d52700 1 -- 172.21.15.59:0/2581553827 >> v1:172.21.15.59:6789/0 conn(0x7ffbac0a0a30 legacy=0x7ffbac0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:40.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.489+0000 7ffbb1d52700 1 -- 172.21.15.59:0/2581553827 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac09dc50 con 0x7ffbac09d630 2023-09-30T22:36:40.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.489+0000 7ffbb2d54700 1 --2- 172.21.15.59:0/2581553827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbac138d80 0x7ffbac13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:40.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.490+0000 7ffbb1d52700 1 --2- 172.21.15.59:0/2581553827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbac09d630 0x7ffbac0a1510 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7ffba00098f0 tx=0x7ffba0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c5d4583cdc15d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:40.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.490+0000 7ffbb1551700 1 -- 172.21.15.59:0/2581553827 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba0011830 con 0x7ffbac09d630 2023-09-30T22:36:40.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.490+0000 7ffbb1551700 1 -- 172.21.15.59:0/2581553827 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba0011990 con 0x7ffbac09d630 2023-09-30T22:36:40.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.490+0000 7ffbb1551700 1 -- 172.21.15.59:0/2581553827 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba0011d20 con 0x7ffbac09d630 2023-09-30T22:36:40.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.490+0000 7ffbb47b7700 1 -- 172.21.15.59:0/2581553827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbac09d630 msgr2=0x7ffbac0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:40.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.490+0000 7ffbb47b7700 1 --2- 172.21.15.59:0/2581553827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbac09d630 0x7ffbac0a1510 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7ffba00098f0 tx=0x7ffba0009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:40.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.490+0000 7ffbb47b7700 1 -- 172.21.15.59:0/2581553827 shutdown_connections 2023-09-30T22:36:40.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.490+0000 7ffbb47b7700 1 --2- 172.21.15.59:0/2581553827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbac138d80 0x7ffbac13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.490+0000 7ffbb47b7700 1 --2- 172.21.15.59:0/2581553827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbac09d630 0x7ffbac0a1510 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.490+0000 7ffbb47b7700 1 -- 172.21.15.59:0/2581553827 >> 172.21.15.59:0/2581553827 conn(0x7ffbac0a3050 msgr2=0x7ffbac0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:40.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.491+0000 7ffbb47b7700 1 -- 172.21.15.59:0/2581553827 shutdown_connections 2023-09-30T22:36:40.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.491+0000 7ffbb47b7700 1 -- 172.21.15.59:0/2581553827 wait complete. 2023-09-30T22:36:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.492+0000 7ffbb47b7700 1 Processor -- start 2023-09-30T22:36:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.492+0000 7ffbb47b7700 1 -- start start 2023-09-30T22:36:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.492+0000 7ffbb47b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbac09d630 0x7ffbac120800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.492+0000 7ffbb47b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbac0a0a30 0x7ffbac120d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.492+0000 7ffbb47b7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbac138d80 0x7ffbac121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.492+0000 7ffbb47b7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac123fb0 con 0x7ffbac138d80 2023-09-30T22:36:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.492+0000 7ffbb47b7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac0a4e00 con 0x7ffbac09d630 2023-09-30T22:36:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.492+0000 7ffbb47b7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac0a0410 con 0x7ffbac0a0a30 2023-09-30T22:36:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.492+0000 7ffbb1d52700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbac0a0a30 0x7ffbac120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.492+0000 7ffbb2d54700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbac138d80 0x7ffbac121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.492+0000 7ffbb1d52700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbac0a0a30 0x7ffbac120d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44532/0 (socket says 172.21.15.59:44532) 2023-09-30T22:36:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.492+0000 7ffbb1d52700 1 -- 172.21.15.59:0/2821644603 learned_addr learned my addr 172.21.15.59:0/2821644603 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.492+0000 7ffbb2553700 1 --2- 172.21.15.59:0/2821644603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbac09d630 0x7ffbac120800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.493+0000 7ffbb2d54700 1 -- 172.21.15.59:0/2821644603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbac0a0a30 msgr2=0x7ffbac120d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:40.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.493+0000 7ffbb2d54700 1 --2- 172.21.15.59:0/2821644603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbac0a0a30 0x7ffbac120d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.493+0000 7ffbb2d54700 1 -- 172.21.15.59:0/2821644603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbac09d630 msgr2=0x7ffbac120800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:40.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.493+0000 7ffbb2d54700 1 --2- 172.21.15.59:0/2821644603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbac09d630 0x7ffbac120800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.493+0000 7ffbb2d54700 1 -- 172.21.15.59:0/2821644603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c009a70 con 0x7ffbac138d80 2023-09-30T22:36:40.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.493+0000 7ffbb2d54700 1 --2- 172.21.15.59:0/2821644603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbac138d80 0x7ffbac121280 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c00ef90 tx=0x7ffb9c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:40.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.493+0000 7ffbaaffd700 1 -- 172.21.15.59:0/2821644603 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c00cc90 con 0x7ffbac138d80 2023-09-30T22:36:40.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.493+0000 7ffbaaffd700 1 -- 172.21.15.59:0/2821644603 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9c00f040 con 0x7ffbac138d80 2023-09-30T22:36:40.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.493+0000 7ffbb47b7700 1 -- 172.21.15.59:0/2821644603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba0009550 con 0x7ffbac138d80 2023-09-30T22:36:40.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.493+0000 7ffbaaffd700 1 -- 172.21.15.59:0/2821644603 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c0146c0 con 0x7ffbac138d80 2023-09-30T22:36:40.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.493+0000 7ffbb47b7700 1 -- 172.21.15.59:0/2821644603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbac124a20 con 0x7ffbac138d80 2023-09-30T22:36:40.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.494+0000 7ffbaaffd700 1 -- 172.21.15.59:0/2821644603 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb9c014820 con 0x7ffbac138d80 2023-09-30T22:36:40.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.494+0000 7ffbaaffd700 1 -- 172.21.15.59:0/2821644603 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffb9c040290 con 0x7ffbac138d80 2023-09-30T22:36:40.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.494+0000 7ffbb47b7700 1 -- 172.21.15.59:0/2821644603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbac0747f0 con 0x7ffbac138d80 2023-09-30T22:36:40.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.499+0000 7ffbaaffd700 1 -- 172.21.15.59:0/2821644603 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb9c007920 con 0x7ffbac138d80 2023-09-30T22:36:40.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.526+0000 7f11a3609700 1 Processor -- start 2023-09-30T22:36:40.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.526+0000 7f11a3609700 1 -- start start 2023-09-30T22:36:40.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.526+0000 7f11a3609700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f119c09d6f0 0x7f119c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:40.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.526+0000 7f11a3609700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f119c09e000 0x7f119c13bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.526+0000 7f11a3609700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c0992c0 con 0x7f119c13c470 2023-09-30T22:36:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.526+0000 7f11a3609700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119c099520 con 0x7f119c09e000 2023-09-30T22:36:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.526+0000 7f11a3609700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119c0997e0 con 0x7f119c09d6f0 2023-09-30T22:36:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.527+0000 7f11a0ba4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f119c09e000 0x7f119c13bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.527+0000 7f11a13a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f119c09d6f0 0x7f119c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.527+0000 7f11a0ba4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f119c09e000 0x7f119c13bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39516/0 (socket says 172.21.15.59:39516) 2023-09-30T22:36:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.527+0000 7f11a1ba6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f119c13c470 0x7f119c13e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33936/0 (socket says 172.21.15.59:33936) 2023-09-30T22:36:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.527+0000 7f11a0ba4700 1 -- 172.21.15.59:0/1471019584 learned_addr learned my addr 172.21.15.59:0/1471019584 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.527+0000 7f11a13a5700 1 -- 172.21.15.59:0/1471019584 >> v2:172.21.15.59:3300/0 conn(0x7f119c09e000 msgr2=0x7f119c13bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.527+0000 7f11a13a5700 1 --2- 172.21.15.59:0/1471019584 >> v2:172.21.15.59:3300/0 conn(0x7f119c09e000 0x7f119c13bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.527+0000 7f11a13a5700 1 -- 172.21.15.59:0/1471019584 >> v1:172.21.15.59:6789/0 conn(0x7f119c13c470 legacy=0x7f119c13e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.527+0000 7f11a13a5700 1 -- 172.21.15.59:0/1471019584 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c099b30 con 0x7f119c09d6f0 2023-09-30T22:36:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.527+0000 7f119bfff700 1 -- 172.21.15.59:0/1471019584 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253260978 0 0) 0x7f119c0992c0 con 0x7f119c13c470 2023-09-30T22:36:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.527+0000 7f11a0ba4700 1 --2- 172.21.15.59:0/1471019584 >> v2:172.21.15.59:3300/0 conn(0x7f119c09e000 0x7f119c13bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.527+0000 7f11a13a5700 1 --2- 172.21.15.59:0/1471019584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f119c09d6f0 0x7f119c09dac0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f118c009d90 tx=0x7f118c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f28016afa4a8b8a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.527+0000 7f119bfff700 1 -- 172.21.15.59:0/1471019584 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c00e070 con 0x7f119c09d6f0 2023-09-30T22:36:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.528+0000 7f119bfff700 1 -- 172.21.15.59:0/1471019584 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118c00bb20 con 0x7f119c09d6f0 2023-09-30T22:36:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.528+0000 7f119bfff700 1 -- 172.21.15.59:0/1471019584 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c012430 con 0x7f119c09d6f0 2023-09-30T22:36:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.528+0000 7f11a3609700 1 -- 172.21.15.59:0/1471019584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f119c09d6f0 msgr2=0x7f119c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.528+0000 7f11a3609700 1 --2- 172.21.15.59:0/1471019584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f119c09d6f0 0x7f119c09dac0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f118c009d90 tx=0x7f118c00b330 comp rx=0 tx=0).stop 2023-09-30T22:36:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.528+0000 7f11a3609700 1 -- 172.21.15.59:0/1471019584 shutdown_connections 2023-09-30T22:36:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.528+0000 7f11a3609700 1 --2- 172.21.15.59:0/1471019584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f119c09d6f0 0x7f119c09dac0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.528+0000 7f11a3609700 1 --2- 172.21.15.59:0/1471019584 >> v2:172.21.15.59:3300/0 conn(0x7f119c09e000 0x7f119c13bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.528+0000 7f11a3609700 1 -- 172.21.15.59:0/1471019584 >> 172.21.15.59:0/1471019584 conn(0x7f119c09f470 msgr2=0x7f119c0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.528+0000 7f11a3609700 1 -- 172.21.15.59:0/1471019584 shutdown_connections 2023-09-30T22:36:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.528+0000 7f11a3609700 1 -- 172.21.15.59:0/1471019584 wait complete. 2023-09-30T22:36:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.529+0000 7f11a3609700 1 Processor -- start 2023-09-30T22:36:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.529+0000 7f11a3609700 1 -- start start 2023-09-30T22:36:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a3609700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f119c09d6f0 0x7f119c138380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a3609700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f119c09e000 0x7f119c1388c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a3609700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f119c13c470 0x7f119c138e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a3609700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c13c290 con 0x7f119c09e000 2023-09-30T22:36:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a3609700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119c072600 con 0x7f119c13c470 2023-09-30T22:36:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a3609700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f119c098c70 con 0x7f119c09d6f0 2023-09-30T22:36:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a1ba6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f119c13c470 0x7f119c138e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a13a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f119c09d6f0 0x7f119c138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a0ba4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f119c09e000 0x7f119c1388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a13a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f119c09d6f0 0x7f119c138380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44540/0 (socket says 172.21.15.59:44540) 2023-09-30T22:36:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a0ba4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f119c09e000 0x7f119c1388c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39526/0 (socket says 172.21.15.59:39526) 2023-09-30T22:36:40.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a1ba6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f119c13c470 0x7f119c138e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47432/0 (socket says 172.21.15.59:47432) 2023-09-30T22:36:40.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a13a5700 1 -- 172.21.15.59:0/4129773940 learned_addr learned my addr 172.21.15.59:0/4129773940 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:40.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a0ba4700 1 -- 172.21.15.59:0/4129773940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f119c09d6f0 msgr2=0x7f119c138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:40.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a0ba4700 1 --2- 172.21.15.59:0/4129773940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f119c09d6f0 0x7f119c138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a0ba4700 1 -- 172.21.15.59:0/4129773940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f119c13c470 msgr2=0x7f119c138e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:40.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a0ba4700 1 --2- 172.21.15.59:0/4129773940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f119c13c470 0x7f119c138e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a0ba4700 1 -- 172.21.15.59:0/4129773940 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1190009550 con 0x7f119c09e000 2023-09-30T22:36:40.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a13a5700 1 --2- 172.21.15.59:0/4129773940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f119c09d6f0 0x7f119c138380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:40.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a1ba6700 1 --2- 172.21.15.59:0/4129773940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f119c13c470 0x7f119c138e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:40.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.530+0000 7f11a0ba4700 1 --2- 172.21.15.59:0/4129773940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f119c09e000 0x7f119c1388c0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f119c0a2de0 tx=0x7f119000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:40.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.531+0000 7f1199ffb700 1 -- 172.21.15.59:0/4129773940 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190004240 con 0x7f119c09e000 2023-09-30T22:36:40.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.531+0000 7f1199ffb700 1 -- 172.21.15.59:0/4129773940 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11900043a0 con 0x7f119c09e000 2023-09-30T22:36:40.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.531+0000 7f11a3609700 1 -- 172.21.15.59:0/4129773940 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c009a70 con 0x7f119c09e000 2023-09-30T22:36:40.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.531+0000 7f1199ffb700 1 -- 172.21.15.59:0/4129773940 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11900036a0 con 0x7f119c09e000 2023-09-30T22:36:40.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.531+0000 7f11a3609700 1 -- 172.21.15.59:0/4129773940 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c13b8f0 con 0x7f119c09e000 2023-09-30T22:36:40.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.532+0000 7f1199ffb700 1 -- 172.21.15.59:0/4129773940 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1190003800 con 0x7f119c09e000 2023-09-30T22:36:40.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.532+0000 7f1199ffb700 1 -- 172.21.15.59:0/4129773940 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f119003fbb0 con 0x7f119c09e000 2023-09-30T22:36:40.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.532+0000 7f11a3609700 1 -- 172.21.15.59:0/4129773940 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119c08c770 con 0x7f119c09e000 2023-09-30T22:36:40.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.537+0000 7f1199ffb700 1 -- 172.21.15.59:0/4129773940 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1190013470 con 0x7f119c09e000 2023-09-30T22:36:40.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.722+0000 7ffbb47b7700 1 -- 172.21.15.59:0/2821644603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffbac072980 con 0x7ffbac138d80 2023-09-30T22:36:40.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.723+0000 7ffbaaffd700 1 -- 172.21.15.59:0/2821644603 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb9c007330 con 0x7ffbac138d80 2023-09-30T22:36:40.724 INFO:teuthology.orchestra.run.smithi059.stdout:128849018883 2023-09-30T22:36:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.725+0000 7ffbb47b7700 1 -- 172.21.15.59:0/2821644603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbac138d80 msgr2=0x7ffbac121280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.725+0000 7ffbb47b7700 1 --2- 172.21.15.59:0/2821644603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbac138d80 0x7ffbac121280 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c00ef90 tx=0x7ffb9c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.725+0000 7ffbb47b7700 1 -- 172.21.15.59:0/2821644603 shutdown_connections 2023-09-30T22:36:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.725+0000 7ffbb47b7700 1 --2- 172.21.15.59:0/2821644603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbac138d80 0x7ffbac121280 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.725+0000 7ffbb47b7700 1 --2- 172.21.15.59:0/2821644603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbac09d630 0x7ffbac120800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.725+0000 7ffbb47b7700 1 --2- 172.21.15.59:0/2821644603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbac0a0a30 0x7ffbac120d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.725+0000 7ffbb47b7700 1 -- 172.21.15.59:0/2821644603 >> 172.21.15.59:0/2821644603 conn(0x7ffbac0a3050 msgr2=0x7ffbac09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:40.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.725+0000 7ffbb47b7700 1 -- 172.21.15.59:0/2821644603 shutdown_connections 2023-09-30T22:36:40.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.725+0000 7ffbb47b7700 1 -- 172.21.15.59:0/2821644603 wait complete. 2023-09-30T22:36:40.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.0 2023-09-30T22:36:40.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.757+0000 7f11a3609700 1 -- 172.21.15.59:0/4129773940 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f119c0747f0 con 0x7f119c09e000 2023-09-30T22:36:40.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.757+0000 7f1199ffb700 1 -- 172.21.15.59:0/4129773940 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f119002a070 con 0x7f119c09e000 2023-09-30T22:36:40.758 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-09-30T22:36:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.759+0000 7f11a3609700 1 -- 172.21.15.59:0/4129773940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f119c09e000 msgr2=0x7f119c1388c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.759+0000 7f11a3609700 1 --2- 172.21.15.59:0/4129773940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f119c09e000 0x7f119c1388c0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f119c0a2de0 tx=0x7f119000ec80 comp rx=0 tx=0).stop 2023-09-30T22:36:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.759+0000 7f11a3609700 1 -- 172.21.15.59:0/4129773940 shutdown_connections 2023-09-30T22:36:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.759+0000 7f11a3609700 1 --2- 172.21.15.59:0/4129773940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f119c09d6f0 0x7f119c138380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.759+0000 7f11a3609700 1 --2- 172.21.15.59:0/4129773940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f119c13c470 0x7f119c138e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.759+0000 7f11a3609700 1 --2- 172.21.15.59:0/4129773940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f119c09e000 0x7f119c1388c0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.759+0000 7f11a3609700 1 -- 172.21.15.59:0/4129773940 >> 172.21.15.59:0/4129773940 conn(0x7f119c09f470 msgr2=0x7f119c13f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.759+0000 7f11a3609700 1 -- 172.21.15.59:0/4129773940 shutdown_connections 2023-09-30T22:36:40.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.759+0000 7f11a3609700 1 -- 172.21.15.59:0/4129773940 wait complete. 2023-09-30T22:36:40.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.2 2023-09-30T22:36:40.798 INFO:tasks.ceph:ignoring flush pg stats error, probably testing upgrade: timed out waiting for mon to be updated with osd.1: 137438953475 < 137438953476 2023-09-30T22:36:40.799 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:36:40.799 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:36:40.840 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:36:40.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.953+0000 7f25fcb29700 1 Processor -- start 2023-09-30T22:36:40.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.953+0000 7f25fcb29700 1 -- start start 2023-09-30T22:36:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25fcb29700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25f80a0a30 0x7f25f80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25fcb29700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25f809d630 0x7f25f80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25fcb29700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f80a2a70 con 0x7f25f8133930 2023-09-30T22:36:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25fcb29700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f80a01d0 con 0x7f25f809d630 2023-09-30T22:36:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25fcb29700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f809e2b0 con 0x7f25f80a0a30 2023-09-30T22:36:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25f5d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25f809d630 0x7f25f80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25f659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25f80a0a30 0x7f25f80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25f5d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25f809d630 0x7f25f80a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39540/0 (socket says 172.21.15.59:39540) 2023-09-30T22:36:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25f659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25f80a0a30 0x7f25f80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44542/0 (socket says 172.21.15.59:44542) 2023-09-30T22:36:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25f5d9b700 1 -- 172.21.15.59:0/2511050233 learned_addr learned my addr 172.21.15.59:0/2511050233 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25f5d9b700 1 -- 172.21.15.59:0/2511050233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25f80a0a30 msgr2=0x7f25f80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25f5d9b700 1 --2- 172.21.15.59:0/2511050233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25f80a0a30 0x7f25f80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25f5d9b700 1 -- 172.21.15.59:0/2511050233 >> v1:172.21.15.59:6789/0 conn(0x7f25f8133930 legacy=0x7f25f8133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25f5d9b700 1 -- 172.21.15.59:0/2511050233 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f809dc50 con 0x7f25f809d630 2023-09-30T22:36:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25f659c700 1 --2- 172.21.15.59:0/2511050233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25f80a0a30 0x7f25f80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.954+0000 7f25f5d9b700 1 --2- 172.21.15.59:0/2511050233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f809d630 0x7f25f80a1340 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f25e00098f0 tx=0x7f25e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122ba84d97bea331 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.955+0000 7f25f559a700 1 -- 172.21.15.59:0/2511050233 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0011830 con 0x7f25f809d630 2023-09-30T22:36:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.955+0000 7f25f559a700 1 -- 172.21.15.59:0/2511050233 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e0011990 con 0x7f25f809d630 2023-09-30T22:36:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.955+0000 7f25f559a700 1 -- 172.21.15.59:0/2511050233 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0011d20 con 0x7f25f809d630 2023-09-30T22:36:40.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.955+0000 7f25fcb29700 1 -- 172.21.15.59:0/2511050233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f809d630 msgr2=0x7f25f80a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:40.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.955+0000 7f25fcb29700 1 --2- 172.21.15.59:0/2511050233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f809d630 0x7f25f80a1340 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f25e00098f0 tx=0x7f25e0009c00 comp rx=0 tx=0).stop 2023-09-30T22:36:40.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.955+0000 7f25fcb29700 1 -- 172.21.15.59:0/2511050233 shutdown_connections 2023-09-30T22:36:40.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.955+0000 7f25fcb29700 1 --2- 172.21.15.59:0/2511050233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25f80a0a30 0x7f25f80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.955+0000 7f25fcb29700 1 --2- 172.21.15.59:0/2511050233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f809d630 0x7f25f80a1340 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.955+0000 7f25fcb29700 1 -- 172.21.15.59:0/2511050233 >> 172.21.15.59:0/2511050233 conn(0x7f25f80a3050 msgr2=0x7f25f80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:40.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.955+0000 7f25fcb29700 1 -- 172.21.15.59:0/2511050233 shutdown_connections 2023-09-30T22:36:40.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.955+0000 7f25fcb29700 1 -- 172.21.15.59:0/2511050233 wait complete. 2023-09-30T22:36:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.957+0000 7f25fcb29700 1 Processor -- start 2023-09-30T22:36:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.957+0000 7f25fcb29700 1 -- start start 2023-09-30T22:36:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25fcb29700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f809d630 0x7f25f81c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25fcb29700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25f80a0a30 0x7f25f81c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25fcb29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25f8133930 0x7f25f81c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25fcb29700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f8120a70 con 0x7f25f809d630 2023-09-30T22:36:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25fcb29700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f8120880 con 0x7f25f8133930 2023-09-30T22:36:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25fcb29700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f8121920 con 0x7f25f80a0a30 2023-09-30T22:36:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25f5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25f80a0a30 0x7f25f81c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25f659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f809d630 0x7f25f81c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25f5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25f80a0a30 0x7f25f81c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44554/0 (socket says 172.21.15.59:44554) 2023-09-30T22:36:40.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25f5d9b700 1 -- 172.21.15.59:0/667698762 learned_addr learned my addr 172.21.15.59:0/667698762 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25f6d9d700 1 --2- 172.21.15.59:0/667698762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25f8133930 0x7f25f81c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25f659c700 1 -- 172.21.15.59:0/667698762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25f80a0a30 msgr2=0x7f25f81c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25f659c700 1 --2- 172.21.15.59:0/667698762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25f80a0a30 0x7f25f81c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25f659c700 1 -- 172.21.15.59:0/667698762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25f8133930 msgr2=0x7f25f81c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25f659c700 1 --2- 172.21.15.59:0/667698762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25f8133930 0x7f25f81c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25f659c700 1 -- 172.21.15.59:0/667698762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e8009a70 con 0x7f25f809d630 2023-09-30T22:36:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25f5d9b700 1 --2- 172.21.15.59:0/667698762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25f80a0a30 0x7f25f81c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.958+0000 7f25f6d9d700 1 --2- 172.21.15.59:0/667698762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25f8133930 0x7f25f81c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.959+0000 7f25f659c700 1 --2- 172.21.15.59:0/667698762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f809d630 0x7f25f81c8310 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f25e800efc0 tx=0x7f25e800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.959+0000 7f25eeffd700 1 -- 172.21.15.59:0/667698762 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e800cd10 con 0x7f25f809d630 2023-09-30T22:36:40.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.959+0000 7f25eeffd700 1 -- 172.21.15.59:0/667698762 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e800f040 con 0x7f25f809d630 2023-09-30T22:36:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.959+0000 7f25fcb29700 1 -- 172.21.15.59:0/667698762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e0009550 con 0x7f25f809d630 2023-09-30T22:36:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.959+0000 7f25eeffd700 1 -- 172.21.15.59:0/667698762 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e80146a0 con 0x7f25f809d630 2023-09-30T22:36:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.959+0000 7f25fcb29700 1 -- 172.21.15.59:0/667698762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f81224b0 con 0x7f25f809d630 2023-09-30T22:36:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.960+0000 7f25eeffd700 1 -- 172.21.15.59:0/667698762 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25e8014800 con 0x7f25f809d630 2023-09-30T22:36:40.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.960+0000 7f25fcb29700 1 -- 172.21.15.59:0/667698762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f8121e90 con 0x7f25f809d630 2023-09-30T22:36:40.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.960+0000 7f25eeffd700 1 -- 172.21.15.59:0/667698762 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25e8040290 con 0x7f25f809d630 2023-09-30T22:36:40.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.965+0000 7f25eeffd700 1 -- 172.21.15.59:0/667698762 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25e8007920 con 0x7f25f809d630 2023-09-30T22:36:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.996+0000 7f4966a2a700 1 Processor -- start 2023-09-30T22:36:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.996+0000 7f4966a2a700 1 -- start start 2023-09-30T22:36:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.997+0000 7f4966a2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f496009d6f0 0x7f496009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.997+0000 7f4966a2a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f496009e000 0x7f4960130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.997+0000 7f4966a2a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f496009e410 0x7f4960130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.997+0000 7f4966a2a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496009f520 con 0x7f496009e000 2023-09-30T22:36:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.997+0000 7f4966a2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496009f130 con 0x7f496009d6f0 2023-09-30T22:36:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.997+0000 7f4966a2a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f496009e930 con 0x7f496009e410 2023-09-30T22:36:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.997+0000 7f4964fc7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f496009e410 0x7f4960130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.997+0000 7f495f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f496009e000 0x7f4960130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.997+0000 7f495ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f496009d6f0 0x7f496009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.997+0000 7f495f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f496009e000 0x7f4960130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39554/0 (socket says 172.21.15.59:39554) 2023-09-30T22:36:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.997+0000 7f4964fc7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f496009e410 0x7f4960130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44568/0 (socket says 172.21.15.59:44568) 2023-09-30T22:36:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.997+0000 7f495f7fe700 1 -- 172.21.15.59:0/3945338980 learned_addr learned my addr 172.21.15.59:0/3945338980 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.998+0000 7f4964fc7700 1 -- 172.21.15.59:0/3945338980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f496009d6f0 msgr2=0x7f496009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.998+0000 7f4964fc7700 1 --2- 172.21.15.59:0/3945338980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f496009d6f0 0x7f496009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.998+0000 7f4964fc7700 1 -- 172.21.15.59:0/3945338980 >> v2:172.21.15.59:3300/0 conn(0x7f496009e000 msgr2=0x7f4960130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:36:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.998+0000 7f4964fc7700 1 --2- 172.21.15.59:0/3945338980 >> v2:172.21.15.59:3300/0 conn(0x7f496009e000 0x7f4960130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.998+0000 7f4964fc7700 1 -- 172.21.15.59:0/3945338980 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496009b2d0 con 0x7f496009e410 2023-09-30T22:36:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.998+0000 7f495f7fe700 1 --2- 172.21.15.59:0/3945338980 >> v2:172.21.15.59:3300/0 conn(0x7f496009e000 0x7f4960130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.998+0000 7f495ffff700 1 --2- 172.21.15.59:0/3945338980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f496009d6f0 0x7f496009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.998+0000 7f4964fc7700 1 --2- 172.21.15.59:0/3945338980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f496009e410 0x7f4960130ba0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f495800bfd0 tx=0x7f495800d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f76345344f1fae92 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.998+0000 7f495effd700 1 -- 172.21.15.59:0/3945338980 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958010070 con 0x7f496009e410 2023-09-30T22:36:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.998+0000 7f495effd700 1 -- 172.21.15.59:0/3945338980 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495800b2e0 con 0x7f496009e410 2023-09-30T22:36:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.998+0000 7f495effd700 1 -- 172.21.15.59:0/3945338980 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495800dc30 con 0x7f496009e410 2023-09-30T22:36:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.999+0000 7f4966a2a700 1 -- 172.21.15.59:0/3945338980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f496009e410 msgr2=0x7f4960130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.999+0000 7f4966a2a700 1 --2- 172.21.15.59:0/3945338980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f496009e410 0x7f4960130ba0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f495800bfd0 tx=0x7f495800d330 comp rx=0 tx=0).stop 2023-09-30T22:36:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.999+0000 7f4966a2a700 1 -- 172.21.15.59:0/3945338980 shutdown_connections 2023-09-30T22:36:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.999+0000 7f4966a2a700 1 --2- 172.21.15.59:0/3945338980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f496009e410 0x7f4960130ba0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.999+0000 7f4966a2a700 1 --2- 172.21.15.59:0/3945338980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f496009d6f0 0x7f496009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.999+0000 7f4966a2a700 1 --2- 172.21.15.59:0/3945338980 >> v2:172.21.15.59:3300/0 conn(0x7f496009e000 0x7f4960130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.999+0000 7f4966a2a700 1 -- 172.21.15.59:0/3945338980 >> 172.21.15.59:0/3945338980 conn(0x7f4960066f50 msgr2=0x7f496009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.999+0000 7f4966a2a700 1 -- 172.21.15.59:0/3945338980 shutdown_connections 2023-09-30T22:36:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:40.999+0000 7f4966a2a700 1 -- 172.21.15.59:0/3945338980 wait complete. 2023-09-30T22:36:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.000+0000 7f4966a2a700 1 Processor -- start 2023-09-30T22:36:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.000+0000 7f4966a2a700 1 -- start start 2023-09-30T22:36:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.000+0000 7f4966a2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f496009d6f0 0x7f4960122180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.000+0000 7f4966a2a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f496009e000 0x7f49601226c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.000+0000 7f4966a2a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f496009e410 0x7f4960122c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:36:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.000+0000 7f4966a2a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49601243b0 con 0x7f496009e000 2023-09-30T22:36:41.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.000+0000 7f4966a2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496009c700 con 0x7f496009d6f0 2023-09-30T22:36:41.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.000+0000 7f4966a2a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49600a16b0 con 0x7f496009e410 2023-09-30T22:36:41.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f495f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f496009e000 0x7f49601226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:41.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f4964fc7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f496009e410 0x7f4960122c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:41.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f495f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f496009e000 0x7f49601226c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39558/0 (socket says 172.21.15.59:39558) 2023-09-30T22:36:41.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f4964fc7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f496009e410 0x7f4960122c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:44574/0 (socket says 172.21.15.59:44574) 2023-09-30T22:36:41.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f495f7fe700 1 -- 172.21.15.59:0/4076088477 learned_addr learned my addr 172.21.15.59:0/4076088477 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:36:41.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f495ffff700 1 --2- 172.21.15.59:0/4076088477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f496009d6f0 0x7f4960122180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:36:41.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f495f7fe700 1 -- 172.21.15.59:0/4076088477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f496009e410 msgr2=0x7f4960122c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f495f7fe700 1 --2- 172.21.15.59:0/4076088477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f496009e410 0x7f4960122c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f495f7fe700 1 -- 172.21.15.59:0/4076088477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f496009d6f0 msgr2=0x7f4960122180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f495f7fe700 1 --2- 172.21.15.59:0/4076088477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f496009d6f0 0x7f4960122180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f495f7fe700 1 -- 172.21.15.59:0/4076088477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49500094a0 con 0x7f496009e000 2023-09-30T22:36:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f4964fc7700 1 --2- 172.21.15.59:0/4076088477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f496009e410 0x7f4960122c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f495ffff700 1 --2- 172.21.15.59:0/4076088477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f496009d6f0 0x7f4960122180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:36:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f495f7fe700 1 --2- 172.21.15.59:0/4076088477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f496009e000 0x7f49601226c0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f495400ebe0 tx=0x7f495400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:36:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f495cff9700 1 -- 172.21.15.59:0/4076088477 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495400c850 con 0x7f496009e000 2023-09-30T22:36:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f495cff9700 1 -- 172.21.15.59:0/4076088477 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495400c9b0 con 0x7f496009e000 2023-09-30T22:36:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f4966a2a700 1 -- 172.21.15.59:0/4076088477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4954009550 con 0x7f496009e000 2023-09-30T22:36:41.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f495cff9700 1 -- 172.21.15.59:0/4076088477 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495400cd60 con 0x7f496009e000 2023-09-30T22:36:41.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.001+0000 7f4966a2a700 1 -- 172.21.15.59:0/4076088477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f495800bc80 con 0x7f496009e000 2023-09-30T22:36:41.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.002+0000 7f4966a2a700 1 -- 172.21.15.59:0/4076088477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496011ac20 con 0x7f496009e000 2023-09-30T22:36:41.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.003+0000 7f495cff9700 1 -- 172.21.15.59:0/4076088477 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4954013470 con 0x7f496009e000 2023-09-30T22:36:41.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.003+0000 7f495cff9700 1 -- 172.21.15.59:0/4076088477 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4954040040 con 0x7f496009e000 2023-09-30T22:36:41.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.007+0000 7f495cff9700 1 -- 172.21.15.59:0/4076088477 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4954024760 con 0x7f496009e000 2023-09-30T22:36:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.212+0000 7f4966a2a700 1 -- 172.21.15.59:0/4076088477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4960074ea0 con 0x7f496009e000 2023-09-30T22:36:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.213+0000 7f495cff9700 1 -- 172.21.15.59:0/4076088477 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4954017020 con 0x7f496009e000 2023-09-30T22:36:41.214 INFO:teuthology.orchestra.run.smithi059.stdout:146028888067 2023-09-30T22:36:41.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.215+0000 7f4966a2a700 1 -- 172.21.15.59:0/4076088477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f496009e000 msgr2=0x7f49601226c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:36:41.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.215+0000 7f4966a2a700 1 --2- 172.21.15.59:0/4076088477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f496009e000 0x7f49601226c0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f495400ebe0 tx=0x7f495400eef0 comp rx=0 tx=0).stop 2023-09-30T22:36:41.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.215+0000 7f4966a2a700 1 -- 172.21.15.59:0/4076088477 shutdown_connections 2023-09-30T22:36:41.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.215+0000 7f4966a2a700 1 --2- 172.21.15.59:0/4076088477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f496009e410 0x7f4960122c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:41.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.215+0000 7f4966a2a700 1 --2- 172.21.15.59:0/4076088477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f496009d6f0 0x7f4960122180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:41.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.215+0000 7f4966a2a700 1 --2- 172.21.15.59:0/4076088477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f496009e000 0x7f49601226c0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:36:41.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.215+0000 7f4966a2a700 1 -- 172.21.15.59:0/4076088477 >> 172.21.15.59:0/4076088477 conn(0x7f4960066f50 msgr2=0x7f4960130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:36:41.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.215+0000 7f4966a2a700 1 -- 172.21.15.59:0/4076088477 shutdown_connections 2023-09-30T22:36:41.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:36:41.215+0000 7f4966a2a700 1 -- 172.21.15.59:0/4076088477 wait complete. 2023-09-30T22:36:41.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888067 for osd.3 2023-09-30T22:38:40.852 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-09-30T22:38:40.853 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:38:40.930 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=afdd0374ba3f45c7ac7635a585a46259 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:38:40.934 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-09-30T22:38:40.950 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2023-09-30T22:38:40.963 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-09-30T22:38:40.976 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-09-30T22:38:40.993 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2023-09-30T22:38:41.008 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-09-30T22:38:41.026 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-09-30T22:38:41.027 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-09-30T22:38:41.027 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T22:38:41.058 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-09-30T22:38:41.058 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T22:38:41.124 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:38:41.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.272+0000 7fbb5eab9700 1 Processor -- start 2023-09-30T22:38:41.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.272+0000 7fbb5eab9700 1 -- start start 2023-09-30T22:38:41.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.272+0000 7fbb5eab9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb5809d6f0 0x7fbb5809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:41.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.272+0000 7fbb5eab9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb5809e000 0x7fbb58130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:41.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.272+0000 7fbb5eab9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809e410 0x7fbb58130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:41.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.272+0000 7fbb5eab9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5809f520 con 0x7fbb5809e000 2023-09-30T22:38:41.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.272+0000 7fbb5eab9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5809f130 con 0x7fbb5809d6f0 2023-09-30T22:38:41.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.272+0000 7fbb5eab9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5809e930 con 0x7fbb5809e410 2023-09-30T22:38:41.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.273+0000 7fbb57fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb5809e000 0x7fbb58130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:41.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.273+0000 7fbb5d056700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809e410 0x7fbb58130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.273+0000 7fbb5d056700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809e410 0x7fbb58130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41580/0 (socket says 172.21.15.59:41580) 2023-09-30T22:38:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.273+0000 7fbb57fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb5809e000 0x7fbb58130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47444/0 (socket says 172.21.15.59:47444) 2023-09-30T22:38:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.273+0000 7fbb5d056700 1 -- 172.21.15.59:0/3750786696 learned_addr learned my addr 172.21.15.59:0/3750786696 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.273+0000 7fbb5c855700 1 --2- 172.21.15.59:0/3750786696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb5809d6f0 0x7fbb5809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.273+0000 7fbb57fff700 1 -- 172.21.15.59:0/3750786696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809e410 msgr2=0x7fbb58130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:41.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.273+0000 7fbb57fff700 1 --2- 172.21.15.59:0/3750786696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809e410 0x7fbb58130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.273+0000 7fbb57fff700 1 -- 172.21.15.59:0/3750786696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb5809d6f0 msgr2=0x7fbb5809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:41.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.273+0000 7fbb57fff700 1 --2- 172.21.15.59:0/3750786696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb5809d6f0 0x7fbb5809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.273+0000 7fbb57fff700 1 -- 172.21.15.59:0/3750786696 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5809b2d0 con 0x7fbb5809e000 2023-09-30T22:38:41.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.273+0000 7fbb57fff700 1 --2- 172.21.15.59:0/3750786696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809e000 0x7fbb58130660 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009870 tx=0x7fbb40009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9addabd23340586 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:41.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.273+0000 7fbb577fe700 1 -- 172.21.15.59:0/3750786696 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40011830 con 0x7fbb5809e000 2023-09-30T22:38:41.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.273+0000 7fbb577fe700 1 -- 172.21.15.59:0/3750786696 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb40011990 con 0x7fbb5809e000 2023-09-30T22:38:41.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.273+0000 7fbb577fe700 1 -- 172.21.15.59:0/3750786696 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40011d20 con 0x7fbb5809e000 2023-09-30T22:38:41.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.274+0000 7fbb5eab9700 1 -- 172.21.15.59:0/3750786696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809e000 msgr2=0x7fbb58130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:41.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.274+0000 7fbb5eab9700 1 --2- 172.21.15.59:0/3750786696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809e000 0x7fbb58130660 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009870 tx=0x7fbb40009b80 comp rx=0 tx=0).stop 2023-09-30T22:38:41.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.274+0000 7fbb5eab9700 1 -- 172.21.15.59:0/3750786696 shutdown_connections 2023-09-30T22:38:41.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.274+0000 7fbb5eab9700 1 --2- 172.21.15.59:0/3750786696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809e410 0x7fbb58130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.274+0000 7fbb5eab9700 1 --2- 172.21.15.59:0/3750786696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb5809d6f0 0x7fbb5809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.274+0000 7fbb5eab9700 1 --2- 172.21.15.59:0/3750786696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809e000 0x7fbb58130660 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.274+0000 7fbb5eab9700 1 -- 172.21.15.59:0/3750786696 >> 172.21.15.59:0/3750786696 conn(0x7fbb58066f50 msgr2=0x7fbb5809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:41.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.274+0000 7fbb5eab9700 1 -- 172.21.15.59:0/3750786696 shutdown_connections 2023-09-30T22:38:41.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.274+0000 7fbb5eab9700 1 -- 172.21.15.59:0/3750786696 wait complete. 2023-09-30T22:38:41.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.275+0000 7fbb5eab9700 1 Processor -- start 2023-09-30T22:38:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.275+0000 7fbb5eab9700 1 -- start start 2023-09-30T22:38:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5eab9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809d6f0 0x7fbb58120200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5eab9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb5809e000 0x7fbb58120740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5eab9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809e410 0x7fbb58120c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5eab9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58121660 con 0x7fbb5809e410 2023-09-30T22:38:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5eab9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580715c0 con 0x7fbb5809e000 2023-09-30T22:38:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5eab9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58121f20 con 0x7fbb5809d6f0 2023-09-30T22:38:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb57fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb5809e000 0x7fbb58120740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5c855700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809d6f0 0x7fbb58120200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5c855700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809d6f0 0x7fbb58120200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41588/0 (socket says 172.21.15.59:41588) 2023-09-30T22:38:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb57fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb5809e000 0x7fbb58120740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49816/0 (socket says 172.21.15.59:49816) 2023-09-30T22:38:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5c855700 1 -- 172.21.15.59:0/3969967727 learned_addr learned my addr 172.21.15.59:0/3969967727 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:41.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5d056700 1 --2- 172.21.15.59:0/3969967727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809e410 0x7fbb58120c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:41.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5d056700 1 -- 172.21.15.59:0/3969967727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809d6f0 msgr2=0x7fbb58120200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:41.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5d056700 1 --2- 172.21.15.59:0/3969967727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809d6f0 0x7fbb58120200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5d056700 1 -- 172.21.15.59:0/3969967727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb5809e000 msgr2=0x7fbb58120740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5d056700 1 --2- 172.21.15.59:0/3969967727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb5809e000 0x7fbb58120740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5d056700 1 -- 172.21.15.59:0/3969967727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb400094a0 con 0x7fbb5809e410 2023-09-30T22:38:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb57fff700 1 --2- 172.21.15.59:0/3969967727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb5809e000 0x7fbb58120740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5c855700 1 --2- 172.21.15.59:0/3969967727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809d6f0 0x7fbb58120200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5d056700 1 --2- 172.21.15.59:0/3969967727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809e410 0x7fbb58120c80 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009d90 tx=0x7fbb5000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb557fa700 1 -- 172.21.15.59:0/3969967727 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50003c20 con 0x7fbb5809e410 2023-09-30T22:38:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb557fa700 1 -- 172.21.15.59:0/3969967727 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5000f040 con 0x7fbb5809e410 2023-09-30T22:38:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.276+0000 7fbb5eab9700 1 -- 172.21.15.59:0/3969967727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5809c700 con 0x7fbb5809e410 2023-09-30T22:38:41.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.277+0000 7fbb557fa700 1 -- 172.21.15.59:0/3969967727 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5000c880 con 0x7fbb5809e410 2023-09-30T22:38:41.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.277+0000 7fbb5eab9700 1 -- 172.21.15.59:0/3969967727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb581244b0 con 0x7fbb5809e410 2023-09-30T22:38:41.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.277+0000 7fbb557fa700 1 -- 172.21.15.59:0/3969967727 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb5000c9e0 con 0x7fbb5809e410 2023-09-30T22:38:41.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.277+0000 7fbb5eab9700 1 -- 172.21.15.59:0/3969967727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb58074ea0 con 0x7fbb5809e410 2023-09-30T22:38:41.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.278+0000 7fbb557fa700 1 -- 172.21.15.59:0/3969967727 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbb5003f920 con 0x7fbb5809e410 2023-09-30T22:38:41.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.282+0000 7fbb557fa700 1 -- 172.21.15.59:0/3969967727 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb5001c360 con 0x7fbb5809e410 2023-09-30T22:38:41.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.489+0000 7fbb5eab9700 1 -- 172.21.15.59:0/3969967727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb5806c360 con 0x7fbb5809e410 2023-09-30T22:38:41.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.490+0000 7fbb557fa700 1 -- 172.21.15.59:0/3969967727 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+13451 (secure 0 0 0) 0x7fbb50014e00 con 0x7fbb5809e410 2023-09-30T22:38:41.491 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:38:41.491 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":42,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:30:03.294044+0000","last_up_change":"2023-09-30T22:29:20.757654+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":9,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":34,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":129489}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":129489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":129489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":129489}]},"public_addr":"172.21.15.59:6800/129489","cluster_addr":"172.21.15.59:6801/129489","heartbeat_back_addr":"172.21.15.59:6803/129489","heartbeat_front_addr":"172.21.15.59:6802/129489","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":32,"up_thru":34,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":129609}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":129609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":129609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":129609}]},"public_addr":"172.21.15.59:6804/129609","cluster_addr":"172.21.15.59:6805/129609","heartbeat_back_addr":"172.21.15.59:6807/129609","heartbeat_front_addr":"172.21.15.59:6806/129609","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":34,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":129719}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":129719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":129719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":129719}]},"public_addr":"172.21.15.59:6808/129719","cluster_addr":"172.21.15.59:6809/129719","heartbeat_back_addr":"172.21.15.59:6811/129719","heartbeat_front_addr":"172.21.15.59:6810/129719","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":34,"up_thru":34,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":130037}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":130037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":130037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":130037}]},"public_addr":"172.21.15.59:6812/130037","cluster_addr":"172.21.15.59:6813/130037","heartbeat_back_addr":"172.21.15.59:6815/130037","heartbeat_front_addr":"172.21.15.59:6814/130037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-09-30T22:29:13.318877+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/3454906108":"2023-10-01T22:30:03.294004+0000","172.21.15.59:0/978898929":"2023-10-01T22:30:03.294004+0000","172.21.15.59:0/1645378737":"2023-10-01T22:30:03.294004+0000","172.21.15.59:0/2628012448":"2023-10-01T22:30:03.294004+0000","172.21.15.59:0/1346763106":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/3882222550":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/2365211568":"2023-10-01T22:30:03.294004+0000","172.21.15.59:6817/2103029646":"2023-10-01T22:29:28.838274+0000","172.21.15.59:6816/118188":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/3534779696":"2023-10-01T22:30:03.294004+0000","172.21.15.59:6816/126772":"2023-10-01T22:30:03.294004+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:38:41.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.492+0000 7fbb5eab9700 1 -- 172.21.15.59:0/3969967727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809e410 msgr2=0x7fbb58120c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:41.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.492+0000 7fbb5eab9700 1 --2- 172.21.15.59:0/3969967727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809e410 0x7fbb58120c80 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009d90 tx=0x7fbb5000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.492+0000 7fbb5eab9700 1 -- 172.21.15.59:0/3969967727 shutdown_connections 2023-09-30T22:38:41.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.492+0000 7fbb5eab9700 1 --2- 172.21.15.59:0/3969967727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb5809d6f0 0x7fbb58120200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.492+0000 7fbb5eab9700 1 --2- 172.21.15.59:0/3969967727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb5809e410 0x7fbb58120c80 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.492+0000 7fbb5eab9700 1 --2- 172.21.15.59:0/3969967727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb5809e000 0x7fbb58120740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.492+0000 7fbb5eab9700 1 -- 172.21.15.59:0/3969967727 >> 172.21.15.59:0/3969967727 conn(0x7fbb58066f50 msgr2=0x7fbb5806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:41.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.492+0000 7fbb5eab9700 1 -- 172.21.15.59:0/3969967727 shutdown_connections 2023-09-30T22:38:41.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.492+0000 7fbb5eab9700 1 -- 172.21.15.59:0/3969967727 wait complete. 2023-09-30T22:38:41.507 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:26:26.893716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:26:28.448775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:26:32.964075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:26:33.390842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T22:38:41.509 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:38:41.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.648+0000 7f4a010e9700 1 Processor -- start 2023-09-30T22:38:41.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.648+0000 7f4a010e9700 1 -- start start 2023-09-30T22:38:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f4a010e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc136b80 0x7f49fc138f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f4a010e9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49fc1394a0 0x7f49fc13b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f4a010e9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49fc0a0280 con 0x7f49fc071d60 2023-09-30T22:38:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f4a010e9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49fc0a0020 con 0x7f49fc1394a0 2023-09-30T22:38:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f4a010e9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc09f860 con 0x7f49fc136b80 2023-09-30T22:38:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f49fb59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49fc1394a0 0x7f49fc13b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f49fa59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc136b80 0x7f49fc138f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f49fa59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc136b80 0x7f49fc138f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41590/0 (socket says 172.21.15.59:41590) 2023-09-30T22:38:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f49fb59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49fc1394a0 0x7f49fc13b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47460/0 (socket says 172.21.15.59:47460) 2023-09-30T22:38:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f49fa59c700 1 -- 172.21.15.59:0/1562909819 learned_addr learned my addr 172.21.15.59:0/1562909819 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f49fad9d700 1 --1- 172.21.15.59:0/1562909819 >> v1:172.21.15.59:6789/0 conn(0x7f49fc071d60 0x7f49fc072130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44560/0 (socket says 172.21.15.59:44560) 2023-09-30T22:38:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f49fa59c700 1 -- 172.21.15.59:0/1562909819 >> v2:172.21.15.59:3300/0 conn(0x7f49fc1394a0 msgr2=0x7f49fc13b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f49fa59c700 1 --2- 172.21.15.59:0/1562909819 >> v2:172.21.15.59:3300/0 conn(0x7f49fc1394a0 0x7f49fc13b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f49fa59c700 1 -- 172.21.15.59:0/1562909819 >> v1:172.21.15.59:6789/0 conn(0x7f49fc071d60 legacy=0x7f49fc072130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f49fa59c700 1 -- 172.21.15.59:0/1562909819 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc06ba00 con 0x7f49fc136b80 2023-09-30T22:38:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.649+0000 7f49fa59c700 1 --2- 172.21.15.59:0/1562909819 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc136b80 0x7f49fc138f60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f49e40098f0 tx=0x7f49e4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d60ad59f6a75caa6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.650+0000 7f49f9d9b700 1 -- 172.21.15.59:0/1562909819 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4011830 con 0x7f49fc136b80 2023-09-30T22:38:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.650+0000 7f49f9d9b700 1 -- 172.21.15.59:0/1562909819 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e4011990 con 0x7f49fc136b80 2023-09-30T22:38:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.650+0000 7f49f9d9b700 1 -- 172.21.15.59:0/1562909819 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4011d20 con 0x7f49fc136b80 2023-09-30T22:38:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.650+0000 7f4a010e9700 1 -- 172.21.15.59:0/1562909819 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc136b80 msgr2=0x7f49fc138f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.650+0000 7f4a010e9700 1 --2- 172.21.15.59:0/1562909819 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc136b80 0x7f49fc138f60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f49e40098f0 tx=0x7f49e4009c00 comp rx=0 tx=0).stop 2023-09-30T22:38:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.650+0000 7f4a010e9700 1 -- 172.21.15.59:0/1562909819 shutdown_connections 2023-09-30T22:38:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.650+0000 7f4a010e9700 1 --2- 172.21.15.59:0/1562909819 >> v2:172.21.15.59:3300/0 conn(0x7f49fc1394a0 0x7f49fc13b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.650+0000 7f4a010e9700 1 --2- 172.21.15.59:0/1562909819 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc136b80 0x7f49fc138f60 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.650+0000 7f4a010e9700 1 -- 172.21.15.59:0/1562909819 >> 172.21.15.59:0/1562909819 conn(0x7f49fc0a4130 msgr2=0x7f49fc0a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.650+0000 7f4a010e9700 1 -- 172.21.15.59:0/1562909819 shutdown_connections 2023-09-30T22:38:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.650+0000 7f4a010e9700 1 -- 172.21.15.59:0/1562909819 wait complete. 2023-09-30T22:38:41.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.652+0000 7f4a010e9700 1 Processor -- start 2023-09-30T22:38:41.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.652+0000 7f4a010e9700 1 -- start start 2023-09-30T22:38:41.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.652+0000 7f4a010e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc071d60 0x7f49fc11ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.652+0000 7f4a010e9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49fc136b80 0x7f49fc11ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.652+0000 7f4a010e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc1394a0 0x7f49fc11f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.652+0000 7f4a010e9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc122120 con 0x7f49fc136b80 2023-09-30T22:38:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.652+0000 7f4a010e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc1207a0 con 0x7f49fc071d60 2023-09-30T22:38:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.652+0000 7f4a010e9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc06cda0 con 0x7f49fc1394a0 2023-09-30T22:38:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.652+0000 7f49fad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc071d60 0x7f49fc11ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.652+0000 7f49fb59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc1394a0 0x7f49fc11f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.652+0000 7f49fa59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49fc136b80 0x7f49fc11ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.652+0000 7f49fb59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc1394a0 0x7f49fc11f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41598/0 (socket says 172.21.15.59:41598) 2023-09-30T22:38:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.652+0000 7f49fad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc071d60 0x7f49fc11ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49828/0 (socket says 172.21.15.59:49828) 2023-09-30T22:38:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.652+0000 7f49fb59e700 1 -- 172.21.15.59:0/2272121042 learned_addr learned my addr 172.21.15.59:0/2272121042 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.653+0000 7f49fa59c700 1 -- 172.21.15.59:0/2272121042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc1394a0 msgr2=0x7f49fc11f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.653+0000 7f49fa59c700 1 --2- 172.21.15.59:0/2272121042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc1394a0 0x7f49fc11f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.653+0000 7f49fa59c700 1 -- 172.21.15.59:0/2272121042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc071d60 msgr2=0x7f49fc11ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.653+0000 7f49fa59c700 1 --2- 172.21.15.59:0/2272121042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc071d60 0x7f49fc11ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.653+0000 7f49fa59c700 1 -- 172.21.15.59:0/2272121042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4009550 con 0x7f49fc136b80 2023-09-30T22:38:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.653+0000 7f49fad9d700 1 --2- 172.21.15.59:0/2272121042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc071d60 0x7f49fc11ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.653+0000 7f49fa59c700 1 --2- 172.21.15.59:0/2272121042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49fc136b80 0x7f49fc11ef50 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0a09b0 tx=0x7f49e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:41.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.653+0000 7f49f37fe700 1 -- 172.21.15.59:0/2272121042 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4004510 con 0x7f49fc136b80 2023-09-30T22:38:41.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.653+0000 7f49f37fe700 1 -- 172.21.15.59:0/2272121042 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e401e070 con 0x7f49fc136b80 2023-09-30T22:38:41.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.653+0000 7f4a010e9700 1 -- 172.21.15.59:0/2272121042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49fc138f70 con 0x7f49fc136b80 2023-09-30T22:38:41.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.653+0000 7f49f37fe700 1 -- 172.21.15.59:0/2272121042 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e40038c0 con 0x7f49fc136b80 2023-09-30T22:38:41.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.653+0000 7f4a010e9700 1 -- 172.21.15.59:0/2272121042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49fc121da0 con 0x7f49fc136b80 2023-09-30T22:38:41.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.654+0000 7f49f37fe700 1 -- 172.21.15.59:0/2272121042 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49e4003a20 con 0x7f49fc136b80 2023-09-30T22:38:41.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.654+0000 7f49f37fe700 1 -- 172.21.15.59:0/2272121042 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f49e4040410 con 0x7f49fc136b80 2023-09-30T22:38:41.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.654+0000 7f4a010e9700 1 -- 172.21.15.59:0/2272121042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49fc121be0 con 0x7f49fc136b80 2023-09-30T22:38:41.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.659+0000 7f49f37fe700 1 -- 172.21.15.59:0/2272121042 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49e4015020 con 0x7f49fc136b80 2023-09-30T22:38:41.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.863+0000 7f4a010e9700 1 -- 172.21.15.59:0/2272121042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49fc04f2a0 con 0x7f49fc136b80 2023-09-30T22:38:41.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.864+0000 7f49f37fe700 1 -- 172.21.15.59:0/2272121042 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f49e402d450 con 0x7f49fc136b80 2023-09-30T22:38:41.864 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-30T22:38:41.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.866+0000 7f4a010e9700 1 -- 172.21.15.59:0/2272121042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49fc136b80 msgr2=0x7f49fc11ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:41.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.866+0000 7f4a010e9700 1 --2- 172.21.15.59:0/2272121042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49fc136b80 0x7f49fc11ef50 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0a09b0 tx=0x7f49e4004750 comp rx=0 tx=0).stop 2023-09-30T22:38:41.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.866+0000 7f4a010e9700 1 -- 172.21.15.59:0/2272121042 shutdown_connections 2023-09-30T22:38:41.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.866+0000 7f4a010e9700 1 --2- 172.21.15.59:0/2272121042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49fc1394a0 0x7f49fc11f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.866+0000 7f4a010e9700 1 --2- 172.21.15.59:0/2272121042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49fc071d60 0x7f49fc11ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.866+0000 7f4a010e9700 1 --2- 172.21.15.59:0/2272121042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49fc136b80 0x7f49fc11ef50 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:41.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.866+0000 7f4a010e9700 1 -- 172.21.15.59:0/2272121042 >> 172.21.15.59:0/2272121042 conn(0x7f49fc0a4130 msgr2=0x7f49fc136f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:41.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.866+0000 7f4a010e9700 1 -- 172.21.15.59:0/2272121042 shutdown_connections 2023-09-30T22:38:41.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:41.866+0000 7f4a010e9700 1 -- 172.21.15.59:0/2272121042 wait complete. 2023-09-30T22:38:41.880 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:38:42.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.019+0000 7f6c06de9700 1 Processor -- start 2023-09-30T22:38:42.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.019+0000 7f6c06de9700 1 -- start start 2023-09-30T22:38:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.019+0000 7f6c06de9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c0009d7d0 0x7f6c0009dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6c06de9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c00130e80 0x7f6c00138a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6c06de9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0009b800 con 0x7f6c0009e0e0 2023-09-30T22:38:42.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6c06de9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0009b620 con 0x7f6c0009d7d0 2023-09-30T22:38:42.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6c06de9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0009f370 con 0x7f6c00130e80 2023-09-30T22:38:42.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6c04b85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c0009d7d0 0x7f6c0009dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:42.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6c04b85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c0009d7d0 0x7f6c0009dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49834/0 (socket says 172.21.15.59:49834) 2023-09-30T22:38:42.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6c04b85700 1 -- 172.21.15.59:0/2555083361 learned_addr learned my addr 172.21.15.59:0/2555083361 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:42.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6c05386700 1 --2- 172.21.15.59:0/2555083361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c00130e80 0x7f6c00138a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:42.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6c04b85700 1 -- 172.21.15.59:0/2555083361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c00130e80 msgr2=0x7f6c00138a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:42.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6c04b85700 1 --2- 172.21.15.59:0/2555083361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c00130e80 0x7f6c00138a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6c04b85700 1 -- 172.21.15.59:0/2555083361 >> v1:172.21.15.59:6789/0 conn(0x7f6c0009e0e0 legacy=0x7f6c00130770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:42.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6bff7fe700 1 -- 172.21.15.59:0/2555083361 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565642809 0 0) 0x7f6c0009b800 con 0x7f6c0009e0e0 2023-09-30T22:38:42.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6c04b85700 1 -- 172.21.15.59:0/2555083361 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0009ef80 con 0x7f6c0009d7d0 2023-09-30T22:38:42.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6c05386700 1 --2- 172.21.15.59:0/2555083361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c00130e80 0x7f6c00138a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:42.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6c04b85700 1 --2- 172.21.15.59:0/2555083361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c0009d7d0 0x7f6c0009dba0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009920 tx=0x7f6bf0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bdba111f0eb309e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:42.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6bff7fe700 1 -- 172.21.15.59:0/2555083361 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0011830 con 0x7f6c0009d7d0 2023-09-30T22:38:42.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6bff7fe700 1 -- 172.21.15.59:0/2555083361 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf0011990 con 0x7f6c0009d7d0 2023-09-30T22:38:42.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.020+0000 7f6bff7fe700 1 -- 172.21.15.59:0/2555083361 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0011d20 con 0x7f6c0009d7d0 2023-09-30T22:38:42.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.021+0000 7f6c06de9700 1 -- 172.21.15.59:0/2555083361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c0009d7d0 msgr2=0x7f6c0009dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:42.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.021+0000 7f6c06de9700 1 --2- 172.21.15.59:0/2555083361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c0009d7d0 0x7f6c0009dba0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009920 tx=0x7f6bf0009c30 comp rx=0 tx=0).stop 2023-09-30T22:38:42.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.021+0000 7f6c06de9700 1 -- 172.21.15.59:0/2555083361 shutdown_connections 2023-09-30T22:38:42.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.021+0000 7f6c06de9700 1 --2- 172.21.15.59:0/2555083361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c00130e80 0x7f6c00138a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.021+0000 7f6c06de9700 1 --2- 172.21.15.59:0/2555083361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c0009d7d0 0x7f6c0009dba0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.021+0000 7f6c06de9700 1 -- 172.21.15.59:0/2555083361 >> 172.21.15.59:0/2555083361 conn(0x7f6c00066d70 msgr2=0x7f6c000a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:42.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.021+0000 7f6c06de9700 1 -- 172.21.15.59:0/2555083361 shutdown_connections 2023-09-30T22:38:42.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.021+0000 7f6c06de9700 1 -- 172.21.15.59:0/2555083361 wait complete. 2023-09-30T22:38:42.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.022+0000 7f6c06de9700 1 Processor -- start 2023-09-30T22:38:42.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.022+0000 7f6c06de9700 1 -- start start 2023-09-30T22:38:42.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c06de9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c0009d7d0 0x7f6c001c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:42.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c06de9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c0009e0e0 0x7f6c001c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:42.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c06de9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c00130e80 0x7f6c001c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:42.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c06de9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c001235f0 con 0x7f6c0009e0e0 2023-09-30T22:38:42.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c06de9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c00123400 con 0x7f6c0009d7d0 2023-09-30T22:38:42.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c06de9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c00125310 con 0x7f6c00130e80 2023-09-30T22:38:42.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6bfffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c0009e0e0 0x7f6c001c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:42.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c04b85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c0009d7d0 0x7f6c001c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:42.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c05386700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c00130e80 0x7f6c001c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:42.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c04b85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c0009d7d0 0x7f6c001c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49848/0 (socket says 172.21.15.59:49848) 2023-09-30T22:38:42.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c05386700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c00130e80 0x7f6c001c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41608/0 (socket says 172.21.15.59:41608) 2023-09-30T22:38:42.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6bfffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c0009e0e0 0x7f6c001c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47476/0 (socket says 172.21.15.59:47476) 2023-09-30T22:38:42.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c04b85700 1 -- 172.21.15.59:0/3008982903 learned_addr learned my addr 172.21.15.59:0/3008982903 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:42.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c05386700 1 -- 172.21.15.59:0/3008982903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c0009d7d0 msgr2=0x7f6c001c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:42.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c05386700 1 --2- 172.21.15.59:0/3008982903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c0009d7d0 0x7f6c001c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c05386700 1 -- 172.21.15.59:0/3008982903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c0009e0e0 msgr2=0x7f6c001c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:42.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c05386700 1 --2- 172.21.15.59:0/3008982903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c0009e0e0 0x7f6c001c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c05386700 1 -- 172.21.15.59:0/3008982903 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf8009a70 con 0x7f6c00130e80 2023-09-30T22:38:42.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c04b85700 1 --2- 172.21.15.59:0/3008982903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c0009d7d0 0x7f6c001c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:42.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.023+0000 7f6c05386700 1 --2- 172.21.15.59:0/3008982903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c00130e80 0x7f6c001c8d40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800efc0 tx=0x7f6bf800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:42.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.024+0000 7f6bfd7fa700 1 -- 172.21.15.59:0/3008982903 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf800ca90 con 0x7f6c00130e80 2023-09-30T22:38:42.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.024+0000 7f6bfd7fa700 1 -- 172.21.15.59:0/3008982903 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf800f040 con 0x7f6c00130e80 2023-09-30T22:38:42.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.024+0000 7f6c06de9700 1 -- 172.21.15.59:0/3008982903 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf0009550 con 0x7f6c00130e80 2023-09-30T22:38:42.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.024+0000 7f6bfd7fa700 1 -- 172.21.15.59:0/3008982903 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf800ce30 con 0x7f6c00130e80 2023-09-30T22:38:42.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.024+0000 7f6c06de9700 1 -- 172.21.15.59:0/3008982903 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0009c720 con 0x7f6c00130e80 2023-09-30T22:38:42.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.025+0000 7f6bfd7fa700 1 -- 172.21.15.59:0/3008982903 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bf8014480 con 0x7f6c00130e80 2023-09-30T22:38:42.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.025+0000 7f6c06de9700 1 -- 172.21.15.59:0/3008982903 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c00124cd0 con 0x7f6c00130e80 2023-09-30T22:38:42.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.025+0000 7f6bfd7fa700 1 -- 172.21.15.59:0/3008982903 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6bf803fc80 con 0x7f6c00130e80 2023-09-30T22:38:42.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.030+0000 7f6bfd7fa700 1 -- 172.21.15.59:0/3008982903 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c00124cd0 con 0x7f6c00130e80 2023-09-30T22:38:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.231+0000 7f6c06de9700 1 -- 172.21.15.59:0/3008982903 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6c00124cd0 con 0x7f6c00130e80 2023-09-30T22:38:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.231+0000 7f6bfd7fa700 1 -- 172.21.15.59:0/3008982903 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6c00124cd0 con 0x7f6c00130e80 2023-09-30T22:38:42.232 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-09-30T22:38:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.233+0000 7f6c06de9700 1 -- 172.21.15.59:0/3008982903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c00130e80 msgr2=0x7f6c001c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.233+0000 7f6c06de9700 1 --2- 172.21.15.59:0/3008982903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c00130e80 0x7f6c001c8d40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800efc0 tx=0x7f6bf800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.234+0000 7f6c06de9700 1 -- 172.21.15.59:0/3008982903 shutdown_connections 2023-09-30T22:38:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.234+0000 7f6c06de9700 1 --2- 172.21.15.59:0/3008982903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c00130e80 0x7f6c001c8d40 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.234+0000 7f6c06de9700 1 --2- 172.21.15.59:0/3008982903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c0009d7d0 0x7f6c001c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.234+0000 7f6c06de9700 1 --2- 172.21.15.59:0/3008982903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c0009e0e0 0x7f6c001c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.234+0000 7f6c06de9700 1 -- 172.21.15.59:0/3008982903 >> 172.21.15.59:0/3008982903 conn(0x7f6c00066d70 msgr2=0x7f6c0006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.234+0000 7f6c06de9700 1 -- 172.21.15.59:0/3008982903 shutdown_connections 2023-09-30T22:38:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.234+0000 7f6c06de9700 1 -- 172.21.15.59:0/3008982903 wait complete. 2023-09-30T22:38:42.247 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:38:42.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.387+0000 7f7e37ce2700 1 Processor -- start 2023-09-30T22:38:42.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.387+0000 7f7e37ce2700 1 -- start start 2023-09-30T22:38:42.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e37ce2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e301303c0 0x7f7e30130790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:42.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e37ce2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3006b290 0x7f7e3013b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:42.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e37ce2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e301301c0 con 0x7f7e3006a770 2023-09-30T22:38:42.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e37ce2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3009f620 con 0x7f7e301303c0 2023-09-30T22:38:42.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e37ce2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3009e1b0 con 0x7f7e3006b290 2023-09-30T22:38:42.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e35a7e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e301303c0 0x7f7e30130790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:42.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e3627f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3006b290 0x7f7e3013b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:42.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e3627f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3006b290 0x7f7e3013b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41620/0 (socket says 172.21.15.59:41620) 2023-09-30T22:38:42.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e35a7e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e301303c0 0x7f7e30130790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47488/0 (socket says 172.21.15.59:47488) 2023-09-30T22:38:42.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e3627f700 1 -- 172.21.15.59:0/1468020350 learned_addr learned my addr 172.21.15.59:0/1468020350 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:42.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e3527d700 1 --1- 172.21.15.59:0/1468020350 >> v1:172.21.15.59:6789/0 conn(0x7f7e3006a770 0x7f7e3006ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44566/0 (socket says 172.21.15.59:44566) 2023-09-30T22:38:42.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e3627f700 1 -- 172.21.15.59:0/1468020350 >> v2:172.21.15.59:3300/0 conn(0x7f7e301303c0 msgr2=0x7f7e30130790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:42.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e3627f700 1 --2- 172.21.15.59:0/1468020350 >> v2:172.21.15.59:3300/0 conn(0x7f7e301303c0 0x7f7e30130790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e3627f700 1 -- 172.21.15.59:0/1468020350 >> v1:172.21.15.59:6789/0 conn(0x7f7e3006a770 legacy=0x7f7e3006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:42.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e3627f700 1 -- 172.21.15.59:0/1468020350 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e30130cd0 con 0x7f7e3006b290 2023-09-30T22:38:42.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e34a7c700 1 -- 172.21.15.59:0/1468020350 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764201213 0 0) 0x7f7e301301c0 con 0x7f7e3006a770 2023-09-30T22:38:42.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.388+0000 7f7e35a7e700 1 --2- 172.21.15.59:0/1468020350 >> v2:172.21.15.59:3300/0 conn(0x7f7e301303c0 0x7f7e30130790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:42.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.389+0000 7f7e3627f700 1 --2- 172.21.15.59:0/1468020350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3006b290 0x7f7e3013b7b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009e50 tx=0x7f7e2800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d63239661de735af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:42.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.389+0000 7f7e34a7c700 1 -- 172.21.15.59:0/1468020350 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2800e070 con 0x7f7e3006b290 2023-09-30T22:38:42.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.389+0000 7f7e34a7c700 1 -- 172.21.15.59:0/1468020350 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2800b910 con 0x7f7e3006b290 2023-09-30T22:38:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.389+0000 7f7e34a7c700 1 -- 172.21.15.59:0/1468020350 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2800bcc0 con 0x7f7e3006b290 2023-09-30T22:38:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.389+0000 7f7e37ce2700 1 -- 172.21.15.59:0/1468020350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3006b290 msgr2=0x7f7e3013b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.389+0000 7f7e37ce2700 1 --2- 172.21.15.59:0/1468020350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3006b290 0x7f7e3013b7b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009e50 tx=0x7f7e2800b330 comp rx=0 tx=0).stop 2023-09-30T22:38:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.389+0000 7f7e37ce2700 1 -- 172.21.15.59:0/1468020350 shutdown_connections 2023-09-30T22:38:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.389+0000 7f7e37ce2700 1 --2- 172.21.15.59:0/1468020350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3006b290 0x7f7e3013b7b0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.389+0000 7f7e37ce2700 1 --2- 172.21.15.59:0/1468020350 >> v2:172.21.15.59:3300/0 conn(0x7f7e301303c0 0x7f7e30130790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.389+0000 7f7e37ce2700 1 -- 172.21.15.59:0/1468020350 >> 172.21.15.59:0/1468020350 conn(0x7f7e30066d70 msgr2=0x7f7e300a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.389+0000 7f7e37ce2700 1 -- 172.21.15.59:0/1468020350 shutdown_connections 2023-09-30T22:38:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.389+0000 7f7e37ce2700 1 -- 172.21.15.59:0/1468020350 wait complete. 2023-09-30T22:38:42.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.390+0000 7f7e37ce2700 1 Processor -- start 2023-09-30T22:38:42.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.390+0000 7f7e37ce2700 1 -- start start 2023-09-30T22:38:42.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e37ce2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3006a770 0x7f7e3011d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:42.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e37ce2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e3006b290 0x7f7e3011de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:42.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e37ce2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e301303c0 0x7f7e3011e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:42.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e37ce2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3012d220 con 0x7f7e3006b290 2023-09-30T22:38:42.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e37ce2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e30072670 con 0x7f7e301303c0 2023-09-30T22:38:42.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e37ce2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3009a0c0 con 0x7f7e3006a770 2023-09-30T22:38:42.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e35a7e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3006a770 0x7f7e3011d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:42.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e35a7e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3006a770 0x7f7e3011d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41630/0 (socket says 172.21.15.59:41630) 2023-09-30T22:38:42.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e35a7e700 1 -- 172.21.15.59:0/3587391990 learned_addr learned my addr 172.21.15.59:0/3587391990 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:42.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e3627f700 1 --2- 172.21.15.59:0/3587391990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e301303c0 0x7f7e3011e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:42.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e3527d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e3006b290 0x7f7e3011de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:42.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e35a7e700 1 -- 172.21.15.59:0/3587391990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e301303c0 msgr2=0x7f7e3011e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:42.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e35a7e700 1 --2- 172.21.15.59:0/3587391990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e301303c0 0x7f7e3011e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e35a7e700 1 -- 172.21.15.59:0/3587391990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e3006b290 msgr2=0x7f7e3011de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:42.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e35a7e700 1 --2- 172.21.15.59:0/3587391990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e3006b290 0x7f7e3011de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e35a7e700 1 -- 172.21.15.59:0/3587391990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0094a0 con 0x7f7e3006a770 2023-09-30T22:38:42.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.391+0000 7f7e3527d700 1 --2- 172.21.15.59:0/3587391990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e3006b290 0x7f7e3011de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:38:42.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.392+0000 7f7e35a7e700 1 --2- 172.21.15.59:0/3587391990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3006a770 0x7f7e3011d930 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00ebe0 tx=0x7f7e2c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:42.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.392+0000 7f7e227fc700 1 -- 172.21.15.59:0/3587391990 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c009800 con 0x7f7e3006a770 2023-09-30T22:38:42.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.392+0000 7f7e227fc700 1 -- 172.21.15.59:0/3587391990 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2c00c910 con 0x7f7e3006a770 2023-09-30T22:38:42.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.392+0000 7f7e37ce2700 1 -- 172.21.15.59:0/3587391990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e28009b30 con 0x7f7e3006a770 2023-09-30T22:38:42.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.392+0000 7f7e227fc700 1 -- 172.21.15.59:0/3587391990 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c00cc80 con 0x7f7e3006a770 2023-09-30T22:38:42.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.392+0000 7f7e37ce2700 1 -- 172.21.15.59:0/3587391990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3012da30 con 0x7f7e3006a770 2023-09-30T22:38:42.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.393+0000 7f7e227fc700 1 -- 172.21.15.59:0/3587391990 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e2c013470 con 0x7f7e3006a770 2023-09-30T22:38:42.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.393+0000 7f7e227fc700 1 -- 172.21.15.59:0/3587391990 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7e2c03fbd0 con 0x7f7e3006a770 2023-09-30T22:38:42.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.393+0000 7f7e37ce2700 1 -- 172.21.15.59:0/3587391990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e30071dc0 con 0x7f7e3006a770 2023-09-30T22:38:42.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.398+0000 7f7e227fc700 1 -- 172.21.15.59:0/3587391990 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e2c017020 con 0x7f7e3006a770 2023-09-30T22:38:42.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.601+0000 7f7e37ce2700 1 -- 172.21.15.59:0/3587391990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e3004f2a0 con 0x7f7e3006a770 2023-09-30T22:38:42.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.601+0000 7f7e227fc700 1 -- 172.21.15.59:0/3587391990 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e2c017020 con 0x7f7e3006a770 2023-09-30T22:38:42.602 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-30T22:38:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.604+0000 7f7e37ce2700 1 -- 172.21.15.59:0/3587391990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3006a770 msgr2=0x7f7e3011d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.604+0000 7f7e37ce2700 1 --2- 172.21.15.59:0/3587391990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3006a770 0x7f7e3011d930 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00ebe0 tx=0x7f7e2c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.604+0000 7f7e37ce2700 1 -- 172.21.15.59:0/3587391990 shutdown_connections 2023-09-30T22:38:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.604+0000 7f7e37ce2700 1 --2- 172.21.15.59:0/3587391990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3006a770 0x7f7e3011d930 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.604+0000 7f7e37ce2700 1 --2- 172.21.15.59:0/3587391990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e301303c0 0x7f7e3011e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.604+0000 7f7e37ce2700 1 --2- 172.21.15.59:0/3587391990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e3006b290 0x7f7e3011de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.604+0000 7f7e37ce2700 1 -- 172.21.15.59:0/3587391990 >> 172.21.15.59:0/3587391990 conn(0x7f7e30066d70 msgr2=0x7f7e3012eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.604+0000 7f7e37ce2700 1 -- 172.21.15.59:0/3587391990 shutdown_connections 2023-09-30T22:38:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.604+0000 7f7e37ce2700 1 -- 172.21.15.59:0/3587391990 wait complete. 2023-09-30T22:38:42.618 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:38:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.757+0000 7f0abe450700 1 Processor -- start 2023-09-30T22:38:42.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.757+0000 7f0abe450700 1 -- start start 2023-09-30T22:38:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.758+0000 7f0abe450700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ab8071cd0 0x7f0ab80720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.758+0000 7f0abe450700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0ab809f350 0x7f0ab813bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.758+0000 7f0abe450700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab806bcc0 con 0x7f0ab809e850 2023-09-30T22:38:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.758+0000 7f0abe450700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab806ba00 con 0x7f0ab809f350 2023-09-30T22:38:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.758+0000 7f0abe450700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab809f7f0 con 0x7f0ab8071cd0 2023-09-30T22:38:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.758+0000 7f0ab7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ab8071cd0 0x7f0ab80720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.758+0000 7f0abc9ed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0ab809f350 0x7f0ab813bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.758+0000 7f0ab7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ab8071cd0 0x7f0ab80720a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49862/0 (socket says 172.21.15.59:49862) 2023-09-30T22:38:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.758+0000 7f0abc9ed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0ab809f350 0x7f0ab813bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47510/0 (socket says 172.21.15.59:47510) 2023-09-30T22:38:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.758+0000 7f0ab7fff700 1 -- 172.21.15.59:0/743556743 learned_addr learned my addr 172.21.15.59:0/743556743 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.758+0000 7f0ab7fff700 1 -- 172.21.15.59:0/743556743 >> v2:172.21.15.59:3300/0 conn(0x7f0ab809f350 msgr2=0x7f0ab813bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.758+0000 7f0ab7fff700 1 --2- 172.21.15.59:0/743556743 >> v2:172.21.15.59:3300/0 conn(0x7f0ab809f350 0x7f0ab813bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.758+0000 7f0ab7fff700 1 -- 172.21.15.59:0/743556743 >> v1:172.21.15.59:6789/0 conn(0x7f0ab809e850 legacy=0x7f0ab809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.758+0000 7f0ab7fff700 1 -- 172.21.15.59:0/743556743 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab806c0f0 con 0x7f0ab8071cd0 2023-09-30T22:38:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.758+0000 7f0abc9ed700 1 --2- 172.21.15.59:0/743556743 >> v2:172.21.15.59:3300/0 conn(0x7f0ab809f350 0x7f0ab813bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.759+0000 7f0ab7fff700 1 --2- 172.21.15.59:0/743556743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ab8071cd0 0x7f0ab80720a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80098f0 tx=0x7f0aa8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf9a5f6e6177f32b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.759+0000 7f0ab6ffd700 1 -- 172.21.15.59:0/743556743 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8011830 con 0x7f0ab8071cd0 2023-09-30T22:38:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.759+0000 7f0ab6ffd700 1 -- 172.21.15.59:0/743556743 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa8011990 con 0x7f0ab8071cd0 2023-09-30T22:38:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.759+0000 7f0ab6ffd700 1 -- 172.21.15.59:0/743556743 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8011d20 con 0x7f0ab8071cd0 2023-09-30T22:38:42.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.759+0000 7f0abe450700 1 -- 172.21.15.59:0/743556743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ab8071cd0 msgr2=0x7f0ab80720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:42.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.759+0000 7f0abe450700 1 --2- 172.21.15.59:0/743556743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ab8071cd0 0x7f0ab80720a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80098f0 tx=0x7f0aa8009c00 comp rx=0 tx=0).stop 2023-09-30T22:38:42.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.759+0000 7f0abe450700 1 -- 172.21.15.59:0/743556743 shutdown_connections 2023-09-30T22:38:42.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.759+0000 7f0abe450700 1 --2- 172.21.15.59:0/743556743 >> v2:172.21.15.59:3300/0 conn(0x7f0ab809f350 0x7f0ab813bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.759+0000 7f0abe450700 1 --2- 172.21.15.59:0/743556743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ab8071cd0 0x7f0ab80720a0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.759+0000 7f0abe450700 1 -- 172.21.15.59:0/743556743 >> 172.21.15.59:0/743556743 conn(0x7f0ab80a4130 msgr2=0x7f0ab80a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.759+0000 7f0abe450700 1 -- 172.21.15.59:0/743556743 shutdown_connections 2023-09-30T22:38:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.759+0000 7f0abe450700 1 -- 172.21.15.59:0/743556743 wait complete. 2023-09-30T22:38:42.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.760+0000 7f0abe450700 1 Processor -- start 2023-09-30T22:38:42.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.761+0000 7f0abe450700 1 -- start start 2023-09-30T22:38:42.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.761+0000 7f0abe450700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ab8071cd0 0x7f0ab81c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:42.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.761+0000 7f0abe450700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ab809e850 0x7f0ab81c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:42.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.761+0000 7f0abe450700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ab809f350 0x7f0ab81c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.761+0000 7f0abe450700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab81ab2b0 con 0x7f0ab809f350 2023-09-30T22:38:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.761+0000 7f0abe450700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab8070e90 con 0x7f0ab809e850 2023-09-30T22:38:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.761+0000 7f0abe450700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab806cda0 con 0x7f0ab8071cd0 2023-09-30T22:38:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.761+0000 7f0ab7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ab8071cd0 0x7f0ab81c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.761+0000 7f0ab77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ab809e850 0x7f0ab81c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.761+0000 7f0ab7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ab8071cd0 0x7f0ab81c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41646/0 (socket says 172.21.15.59:41646) 2023-09-30T22:38:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.761+0000 7f0ab7fff700 1 -- 172.21.15.59:0/3407579616 learned_addr learned my addr 172.21.15.59:0/3407579616 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:42.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.761+0000 7f0abc9ed700 1 --2- 172.21.15.59:0/3407579616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ab809f350 0x7f0ab81c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:42.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.762+0000 7f0ab7fff700 1 -- 172.21.15.59:0/3407579616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ab809e850 msgr2=0x7f0ab81c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:42.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.762+0000 7f0ab7fff700 1 --2- 172.21.15.59:0/3407579616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ab809e850 0x7f0ab81c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.762+0000 7f0ab7fff700 1 -- 172.21.15.59:0/3407579616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ab809f350 msgr2=0x7f0ab81c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:42.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.762+0000 7f0ab7fff700 1 --2- 172.21.15.59:0/3407579616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ab809f350 0x7f0ab81c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.762+0000 7f0ab7fff700 1 -- 172.21.15.59:0/3407579616 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab0009a70 con 0x7f0ab8071cd0 2023-09-30T22:38:42.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.762+0000 7f0abc9ed700 1 --2- 172.21.15.59:0/3407579616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ab809f350 0x7f0ab81c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.762+0000 7f0ab77fe700 1 --2- 172.21.15.59:0/3407579616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ab809e850 0x7f0ab81c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.762+0000 7f0ab7fff700 1 --2- 172.21.15.59:0/3407579616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ab8071cd0 0x7f0ab81c8fb0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8009c40 tx=0x7f0aa8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.762+0000 7f0ab4ff9700 1 -- 172.21.15.59:0/3407579616 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa80044d0 con 0x7f0ab8071cd0 2023-09-30T22:38:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.762+0000 7f0ab4ff9700 1 -- 172.21.15.59:0/3407579616 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa801e070 con 0x7f0ab8071cd0 2023-09-30T22:38:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.762+0000 7f0ab4ff9700 1 -- 172.21.15.59:0/3407579616 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa80038e0 con 0x7f0ab8071cd0 2023-09-30T22:38:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.762+0000 7f0abe450700 1 -- 172.21.15.59:0/3407579616 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa8009550 con 0x7f0ab8071cd0 2023-09-30T22:38:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.762+0000 7f0abe450700 1 -- 172.21.15.59:0/3407579616 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab81aa670 con 0x7f0ab8071cd0 2023-09-30T22:38:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.763+0000 7f0ab4ff9700 1 -- 172.21.15.59:0/3407579616 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0aa8003a40 con 0x7f0ab8071cd0 2023-09-30T22:38:42.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.763+0000 7f0ab4ff9700 1 -- 172.21.15.59:0/3407579616 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0aa8040260 con 0x7f0ab8071cd0 2023-09-30T22:38:42.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.763+0000 7f0abe450700 1 -- 172.21.15.59:0/3407579616 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab81aa670 con 0x7f0ab8071cd0 2023-09-30T22:38:42.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.768+0000 7f0ab4ff9700 1 -- 172.21.15.59:0/3407579616 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ab81aa670 con 0x7f0ab8071cd0 2023-09-30T22:38:42.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.970+0000 7f0abe450700 1 -- 172.21.15.59:0/3407579616 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ab81aa670 con 0x7f0ab8071cd0 2023-09-30T22:38:42.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.971+0000 7f0ab4ff9700 1 -- 172.21.15.59:0/3407579616 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ab81aa670 con 0x7f0ab8071cd0 2023-09-30T22:38:42.971 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-30T22:38:42.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.973+0000 7f0abe450700 1 -- 172.21.15.59:0/3407579616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ab8071cd0 msgr2=0x7f0ab81c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:42.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.973+0000 7f0abe450700 1 --2- 172.21.15.59:0/3407579616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ab8071cd0 0x7f0ab81c8fb0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8009c40 tx=0x7f0aa8004750 comp rx=0 tx=0).stop 2023-09-30T22:38:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.973+0000 7f0abe450700 1 -- 172.21.15.59:0/3407579616 shutdown_connections 2023-09-30T22:38:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.973+0000 7f0abe450700 1 --2- 172.21.15.59:0/3407579616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ab8071cd0 0x7f0ab81c8fb0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.973+0000 7f0abe450700 1 --2- 172.21.15.59:0/3407579616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ab809f350 0x7f0ab81c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.973+0000 7f0abe450700 1 --2- 172.21.15.59:0/3407579616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ab809e850 0x7f0ab81c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.973+0000 7f0abe450700 1 -- 172.21.15.59:0/3407579616 >> 172.21.15.59:0/3407579616 conn(0x7f0ab80a4130 msgr2=0x7f0ab809d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.973+0000 7f0abe450700 1 -- 172.21.15.59:0/3407579616 shutdown_connections 2023-09-30T22:38:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:42.973+0000 7f0abe450700 1 -- 172.21.15.59:0/3407579616 wait complete. 2023-09-30T22:38:42.987 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T22:38:43.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.124+0000 7f1aaec1b700 1 Processor -- start 2023-09-30T22:38:43.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.124+0000 7f1aaec1b700 1 -- start start 2023-09-30T22:38:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aaec1b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1aa809d6f0 0x7f1aa809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aaec1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aa809e000 0x7f1aa81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aaec1b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1aa809e410 0x7f1aa8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aaec1b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa806b460 con 0x7f1aa809d6f0 2023-09-30T22:38:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aaec1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa809b120 con 0x7f1aa809e000 2023-09-30T22:38:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aaec1b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa809a7e0 con 0x7f1aa809e410 2023-09-30T22:38:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aac9b7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1aa809d6f0 0x7f1aa809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aac9b7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1aa809d6f0 0x7f1aa809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47524/0 (socket says 172.21.15.59:47524) 2023-09-30T22:38:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aa7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aa809e000 0x7f1aa81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aac9b7700 1 -- 172.21.15.59:0/2227743264 learned_addr learned my addr 172.21.15.59:0/2227743264 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aad1b8700 1 --2- 172.21.15.59:0/2227743264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1aa809e410 0x7f1aa8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aac9b7700 1 -- 172.21.15.59:0/2227743264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1aa809e410 msgr2=0x7f1aa8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aac9b7700 1 --2- 172.21.15.59:0/2227743264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1aa809e410 0x7f1aa8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aac9b7700 1 -- 172.21.15.59:0/2227743264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aa809e000 msgr2=0x7f1aa81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aac9b7700 1 --2- 172.21.15.59:0/2227743264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aa809e000 0x7f1aa81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aac9b7700 1 -- 172.21.15.59:0/2227743264 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa809a500 con 0x7f1aa809d6f0 2023-09-30T22:38:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aa7fff700 1 --2- 172.21.15.59:0/2227743264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aa809e000 0x7f1aa81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aac9b7700 1 --2- 172.21.15.59:0/2227743264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aa809d6f0 0x7f1aa809dac0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0098f0 tx=0x7f1a9c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b837aa5abc469975 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:43.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.125+0000 7f1aa77fe700 1 -- 172.21.15.59:0/2227743264 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c011830 con 0x7f1aa809d6f0 2023-09-30T22:38:43.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.126+0000 7f1aa77fe700 1 -- 172.21.15.59:0/2227743264 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c011990 con 0x7f1aa809d6f0 2023-09-30T22:38:43.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.126+0000 7f1aa77fe700 1 -- 172.21.15.59:0/2227743264 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c011d20 con 0x7f1aa809d6f0 2023-09-30T22:38:43.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.126+0000 7f1aaec1b700 1 -- 172.21.15.59:0/2227743264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aa809d6f0 msgr2=0x7f1aa809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:43.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.126+0000 7f1aaec1b700 1 --2- 172.21.15.59:0/2227743264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aa809d6f0 0x7f1aa809dac0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0098f0 tx=0x7f1a9c009c00 comp rx=0 tx=0).stop 2023-09-30T22:38:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.126+0000 7f1aaec1b700 1 -- 172.21.15.59:0/2227743264 shutdown_connections 2023-09-30T22:38:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.126+0000 7f1aaec1b700 1 --2- 172.21.15.59:0/2227743264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1aa809e410 0x7f1aa8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.126+0000 7f1aaec1b700 1 --2- 172.21.15.59:0/2227743264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aa809d6f0 0x7f1aa809dac0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.126+0000 7f1aaec1b700 1 --2- 172.21.15.59:0/2227743264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aa809e000 0x7f1aa81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.126+0000 7f1aaec1b700 1 -- 172.21.15.59:0/2227743264 >> 172.21.15.59:0/2227743264 conn(0x7f1aa8066f50 msgr2=0x7f1aa809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:43.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.126+0000 7f1aaec1b700 1 -- 172.21.15.59:0/2227743264 shutdown_connections 2023-09-30T22:38:43.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.126+0000 7f1aaec1b700 1 -- 172.21.15.59:0/2227743264 wait complete. 2023-09-30T22:38:43.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.127+0000 7f1aaec1b700 1 Processor -- start 2023-09-30T22:38:43.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.127+0000 7f1aaec1b700 1 -- start start 2023-09-30T22:38:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aaec1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aa809d6f0 0x7f1aa81a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aaec1b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1aa809e000 0x7f1aa81a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aaec1b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aa809e410 0x7f1aa81c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aaec1b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa80a1f20 con 0x7f1aa809e410 2023-09-30T22:38:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aaec1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa81a80a0 con 0x7f1aa809d6f0 2023-09-30T22:38:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aaec1b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa81b91f0 con 0x7f1aa809e000 2023-09-30T22:38:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aac9b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aa809d6f0 0x7f1aa81a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aa7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1aa809e000 0x7f1aa81a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aac9b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aa809d6f0 0x7f1aa81a5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49888/0 (socket says 172.21.15.59:49888) 2023-09-30T22:38:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aac9b7700 1 -- 172.21.15.59:0/2639049178 learned_addr learned my addr 172.21.15.59:0/2639049178 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aad1b8700 1 --2- 172.21.15.59:0/2639049178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aa809e410 0x7f1aa81c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aa7fff700 1 -- 172.21.15.59:0/2639049178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aa809d6f0 msgr2=0x7f1aa81a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aa7fff700 1 --2- 172.21.15.59:0/2639049178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aa809d6f0 0x7f1aa81a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aa7fff700 1 -- 172.21.15.59:0/2639049178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aa809e410 msgr2=0x7f1aa81c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aa7fff700 1 --2- 172.21.15.59:0/2639049178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aa809e410 0x7f1aa81c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aa7fff700 1 -- 172.21.15.59:0/2639049178 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a940094a0 con 0x7f1aa809e000 2023-09-30T22:38:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.128+0000 7f1aad1b8700 1 --2- 172.21.15.59:0/2639049178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aa809e410 0x7f1aa81c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.129+0000 7f1aa7fff700 1 --2- 172.21.15.59:0/2639049178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1aa809e000 0x7f1aa81a5670 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400e9e0 tx=0x7f1a9400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.129+0000 7f1aa57fa700 1 -- 172.21.15.59:0/2639049178 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9400ee80 con 0x7f1aa809e000 2023-09-30T22:38:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.129+0000 7f1aa57fa700 1 -- 172.21.15.59:0/2639049178 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9400c850 con 0x7f1aa809e000 2023-09-30T22:38:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.129+0000 7f1aaec1b700 1 -- 172.21.15.59:0/2639049178 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c009550 con 0x7f1aa809e000 2023-09-30T22:38:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.129+0000 7f1aa57fa700 1 -- 172.21.15.59:0/2639049178 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9400cc00 con 0x7f1aa809e000 2023-09-30T22:38:43.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.129+0000 7f1aaec1b700 1 -- 172.21.15.59:0/2639049178 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa81a6c60 con 0x7f1aa809e000 2023-09-30T22:38:43.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.130+0000 7f1aa57fa700 1 -- 172.21.15.59:0/2639049178 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a9400cd60 con 0x7f1aa809e000 2023-09-30T22:38:43.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.130+0000 7f1aa57fa700 1 -- 172.21.15.59:0/2639049178 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1a9403fa90 con 0x7f1aa809e000 2023-09-30T22:38:43.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.130+0000 7f1aaec1b700 1 -- 172.21.15.59:0/2639049178 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa81a6530 con 0x7f1aa809e000 2023-09-30T22:38:43.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.135+0000 7f1aa57fa700 1 -- 172.21.15.59:0/2639049178 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a94021070 con 0x7f1aa809e000 2023-09-30T22:38:43.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.360+0000 7f1aaec1b700 1 -- 172.21.15.59:0/2639049178 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1aa81a81e0 con 0x7f1aa809e000 2023-09-30T22:38:43.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.361+0000 7f1aa57fa700 1 -- 172.21.15.59:0/2639049178 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v42) v1 ==== 81+0+638 (secure 0 0 0) 0x7f1aa81a81e0 con 0x7f1aa809e000 2023-09-30T22:38:43.361 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3454906108 2023-10-01T22:30:03.294004+0000 2023-09-30T22:38:43.361 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/978898929 2023-10-01T22:30:03.294004+0000 2023-09-30T22:38:43.362 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/1645378737 2023-10-01T22:30:03.294004+0000 2023-09-30T22:38:43.362 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/2628012448 2023-10-01T22:30:03.294004+0000 2023-09-30T22:38:43.363 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/1346763106 2023-10-01T22:28:59.561079+0000 2023-09-30T22:38:43.363 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3882222550 2023-10-01T22:28:59.561079+0000 2023-09-30T22:38:43.363 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/2365211568 2023-10-01T22:30:03.294004+0000 2023-09-30T22:38:43.365 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6817/2103029646 2023-10-01T22:29:28.838274+0000 2023-09-30T22:38:43.365 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6816/118188 2023-10-01T22:28:59.561079+0000 2023-09-30T22:38:43.365 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3534779696 2023-10-01T22:30:03.294004+0000 2023-09-30T22:38:43.365 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6816/126772 2023-10-01T22:30:03.294004+0000 2023-09-30T22:38:43.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.363+0000 7f1aaec1b700 1 -- 172.21.15.59:0/2639049178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1aa809e000 msgr2=0x7f1aa81a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:43.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.363+0000 7f1aaec1b700 1 --2- 172.21.15.59:0/2639049178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1aa809e000 0x7f1aa81a5670 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400e9e0 tx=0x7f1a9400ecf0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.363+0000 7f1aaec1b700 1 -- 172.21.15.59:0/2639049178 shutdown_connections 2023-09-30T22:38:43.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.363+0000 7f1aaec1b700 1 --2- 172.21.15.59:0/2639049178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aa809e410 0x7f1aa81c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.363+0000 7f1aaec1b700 1 --2- 172.21.15.59:0/2639049178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aa809d6f0 0x7f1aa81a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.363+0000 7f1aaec1b700 1 --2- 172.21.15.59:0/2639049178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1aa809e000 0x7f1aa81a5670 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.363+0000 7f1aaec1b700 1 -- 172.21.15.59:0/2639049178 >> 172.21.15.59:0/2639049178 conn(0x7f1aa8066f50 msgr2=0x7f1aa81bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.363+0000 7f1aaec1b700 1 -- 172.21.15.59:0/2639049178 shutdown_connections 2023-09-30T22:38:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.363+0000 7f1aaec1b700 1 -- 172.21.15.59:0/2639049178 wait complete. 2023-09-30T22:38:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:listed 11 entries 2023-09-30T22:38:43.377 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-09-30T22:38:43.377 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T22:38:43.400 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:38:43.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.537+0000 7f23c9ac9700 1 Processor -- start 2023-09-30T22:38:43.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.537+0000 7f23c9ac9700 1 -- start start 2023-09-30T22:38:43.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.537+0000 7f23c9ac9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23c406a770 0x7f23c406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.537+0000 7f23c9ac9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23c4131d10 0x7f23c4139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.537+0000 7f23c9ac9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c409ece0 con 0x7f23c406b080 2023-09-30T22:38:43.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.537+0000 7f23c9ac9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c409e760 con 0x7f23c406a770 2023-09-30T22:38:43.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.537+0000 7f23c9ac9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c409e040 con 0x7f23c4131d10 2023-09-30T22:38:43.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.537+0000 7f23c37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23c406a770 0x7f23c406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.537+0000 7f23c3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23c4131d10 0x7f23c4139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.537+0000 7f23c37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23c406a770 0x7f23c406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47542/0 (socket says 172.21.15.59:47542) 2023-09-30T22:38:43.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.537+0000 7f23c3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23c4131d10 0x7f23c4139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49904/0 (socket says 172.21.15.59:49904) 2023-09-30T22:38:43.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.537+0000 7f23c37fe700 1 -- 172.21.15.59:0/3059347540 learned_addr learned my addr 172.21.15.59:0/3059347540 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:43.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.538+0000 7f23c3fff700 1 -- 172.21.15.59:0/3059347540 >> v2:172.21.15.59:3300/0 conn(0x7f23c406a770 msgr2=0x7f23c406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:43.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.538+0000 7f23c3fff700 1 --2- 172.21.15.59:0/3059347540 >> v2:172.21.15.59:3300/0 conn(0x7f23c406a770 0x7f23c406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.538+0000 7f23c3fff700 1 -- 172.21.15.59:0/3059347540 >> v1:172.21.15.59:6789/0 conn(0x7f23c406b080 legacy=0x7f23c4131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:43.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.538+0000 7f23c3fff700 1 -- 172.21.15.59:0/3059347540 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c409f630 con 0x7f23c4131d10 2023-09-30T22:38:43.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.538+0000 7f23c37fe700 1 --2- 172.21.15.59:0/3059347540 >> v2:172.21.15.59:3300/0 conn(0x7f23c406a770 0x7f23c406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:43.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.538+0000 7f23c3fff700 1 --2- 172.21.15.59:0/3059347540 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23c4131d10 0x7f23c4139860 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009d90 tx=0x7f23bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e09148a742302dc2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:43.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.538+0000 7f23c27fc700 1 -- 172.21.15.59:0/3059347540 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc00e070 con 0x7f23c4131d10 2023-09-30T22:38:43.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.538+0000 7f23c27fc700 1 -- 172.21.15.59:0/3059347540 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc00bb20 con 0x7f23c4131d10 2023-09-30T22:38:43.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.538+0000 7f23c27fc700 1 -- 172.21.15.59:0/3059347540 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc012430 con 0x7f23c4131d10 2023-09-30T22:38:43.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.539+0000 7f23c9ac9700 1 -- 172.21.15.59:0/3059347540 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23c4131d10 msgr2=0x7f23c4139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:43.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.539+0000 7f23c9ac9700 1 --2- 172.21.15.59:0/3059347540 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23c4131d10 0x7f23c4139860 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009d90 tx=0x7f23bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:38:43.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.539+0000 7f23c9ac9700 1 -- 172.21.15.59:0/3059347540 shutdown_connections 2023-09-30T22:38:43.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.539+0000 7f23c9ac9700 1 --2- 172.21.15.59:0/3059347540 >> v2:172.21.15.59:3300/0 conn(0x7f23c406a770 0x7f23c406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.539+0000 7f23c9ac9700 1 --2- 172.21.15.59:0/3059347540 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23c4131d10 0x7f23c4139860 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.539+0000 7f23c9ac9700 1 -- 172.21.15.59:0/3059347540 >> 172.21.15.59:0/3059347540 conn(0x7f23c4066f50 msgr2=0x7f23c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:43.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.539+0000 7f23c9ac9700 1 -- 172.21.15.59:0/3059347540 shutdown_connections 2023-09-30T22:38:43.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.539+0000 7f23c9ac9700 1 -- 172.21.15.59:0/3059347540 wait complete. 2023-09-30T22:38:43.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.540+0000 7f23c9ac9700 1 Processor -- start 2023-09-30T22:38:43.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.540+0000 7f23c9ac9700 1 -- start start 2023-09-30T22:38:43.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.540+0000 7f23c9ac9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23c406a770 0x7f23c41c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.540+0000 7f23c9ac9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23c406b080 0x7f23c41c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.540+0000 7f23c9ac9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23c4131d10 0x7f23c41c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.540+0000 7f23c9ac9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c411e1c0 con 0x7f23c406a770 2023-09-30T22:38:43.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.540+0000 7f23c9ac9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c411e7e0 con 0x7f23c4131d10 2023-09-30T22:38:43.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.540+0000 7f23c9ac9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23c4071e60 con 0x7f23c406b080 2023-09-30T22:38:43.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23c3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23c4131d10 0x7f23c41c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23c37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23c406a770 0x7f23c41c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23c2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23c406b080 0x7f23c41c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23c3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23c4131d10 0x7f23c41c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49916/0 (socket says 172.21.15.59:49916) 2023-09-30T22:38:43.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23c3fff700 1 -- 172.21.15.59:0/2388493768 learned_addr learned my addr 172.21.15.59:0/2388493768 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:43.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23c3fff700 1 -- 172.21.15.59:0/2388493768 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23c406b080 msgr2=0x7f23c41c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:43.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23c3fff700 1 --2- 172.21.15.59:0/2388493768 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23c406b080 0x7f23c41c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23c3fff700 1 -- 172.21.15.59:0/2388493768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23c406a770 msgr2=0x7f23c41c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:43.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23c3fff700 1 --2- 172.21.15.59:0/2388493768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23c406a770 0x7f23c41c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23c3fff700 1 -- 172.21.15.59:0/2388493768 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b4009550 con 0x7f23c4131d10 2023-09-30T22:38:43.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23c3fff700 1 --2- 172.21.15.59:0/2388493768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23c4131d10 0x7f23c41c6c10 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f23bc014040 tx=0x7f23bc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:43.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23abfff700 1 -- 172.21.15.59:0/2388493768 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc012430 con 0x7f23c4131d10 2023-09-30T22:38:43.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23abfff700 1 -- 172.21.15.59:0/2388493768 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc020070 con 0x7f23c4131d10 2023-09-30T22:38:43.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23c9ac9700 1 -- 172.21.15.59:0/2388493768 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23bc009a70 con 0x7f23c4131d10 2023-09-30T22:38:43.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23abfff700 1 -- 172.21.15.59:0/2388493768 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc003ea0 con 0x7f23c4131d10 2023-09-30T22:38:43.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.541+0000 7f23c9ac9700 1 -- 172.21.15.59:0/2388493768 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c411fdf0 con 0x7f23c4131d10 2023-09-30T22:38:43.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.542+0000 7f23c9ac9700 1 -- 172.21.15.59:0/2388493768 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c411fa90 con 0x7f23c4131d10 2023-09-30T22:38:43.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.543+0000 7f23abfff700 1 -- 172.21.15.59:0/2388493768 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23bc004040 con 0x7f23c4131d10 2023-09-30T22:38:43.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.543+0000 7f23abfff700 1 -- 172.21.15.59:0/2388493768 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f23bc022070 con 0x7f23c4131d10 2023-09-30T22:38:43.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.547+0000 7f23abfff700 1 -- 172.21.15.59:0/2388493768 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23bc031430 con 0x7f23c4131d10 2023-09-30T22:38:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.754+0000 7f23c9ac9700 1 -- 172.21.15.59:0/2388493768 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23c411fa90 con 0x7f23c4131d10 2023-09-30T22:38:43.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.756+0000 7f23abfff700 1 -- 172.21.15.59:0/2388493768 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+13451 (secure 0 0 0) 0x7f23c411fa90 con 0x7f23c4131d10 2023-09-30T22:38:43.756 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-30T22:38:43.756 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":42,"fsid":"4ab45aad-c596-4cc8-9318-aa2f9d41daac","created":"2023-09-30T22:26:18.889102+0000","modified":"2023-09-30T22:30:03.294044+0000","last_up_change":"2023-09-30T22:29:20.757654+0000","last_in_change":"2023-09-30T22:26:20.441845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":9,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:26:26.893716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:26:28.448775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:26:32.964075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:26:33.390842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d0b434cc-ff57-487c-b74e-732daf83db21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":34,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":129489}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":129489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":129489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":129489}]},"public_addr":"172.21.15.59:6800/129489","cluster_addr":"172.21.15.59:6801/129489","heartbeat_back_addr":"172.21.15.59:6803/129489","heartbeat_front_addr":"172.21.15.59:6802/129489","state":["exists","up"]},{"osd":1,"uuid":"be6a19ee-8eef-4d1a-aa98-0a9665822d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":32,"up_thru":34,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":129609}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":129609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":129609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":129609}]},"public_addr":"172.21.15.59:6804/129609","cluster_addr":"172.21.15.59:6805/129609","heartbeat_back_addr":"172.21.15.59:6807/129609","heartbeat_front_addr":"172.21.15.59:6806/129609","state":["exists","up"]},{"osd":2,"uuid":"e23ec521-1072-4f90-9c51-51470aa9b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":34,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":129719}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":129719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":129719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":129719}]},"public_addr":"172.21.15.59:6808/129719","cluster_addr":"172.21.15.59:6809/129719","heartbeat_back_addr":"172.21.15.59:6811/129719","heartbeat_front_addr":"172.21.15.59:6810/129719","state":["exists","up"]},{"osd":3,"uuid":"287c081f-a40d-4dd9-8484-0262965ca8bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":34,"up_thru":34,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":130037}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":130037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":130037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":130037}]},"public_addr":"172.21.15.59:6812/130037","cluster_addr":"172.21.15.59:6813/130037","heartbeat_back_addr":"172.21.15.59:6815/130037","heartbeat_front_addr":"172.21.15.59:6814/130037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.880134+0000","dead_epoch":25},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.840132+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.908133+0000","dead_epoch":27},{"osd":3,"down_stamp":"2023-09-30T22:29:13.318877+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:26:25.619080+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":0}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/3454906108":"2023-10-01T22:30:03.294004+0000","172.21.15.59:0/978898929":"2023-10-01T22:30:03.294004+0000","172.21.15.59:0/1645378737":"2023-10-01T22:30:03.294004+0000","172.21.15.59:0/2628012448":"2023-10-01T22:30:03.294004+0000","172.21.15.59:0/1346763106":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/3882222550":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/2365211568":"2023-10-01T22:30:03.294004+0000","172.21.15.59:6817/2103029646":"2023-10-01T22:29:28.838274+0000","172.21.15.59:6816/118188":"2023-10-01T22:28:59.561079+0000","172.21.15.59:0/3534779696":"2023-10-01T22:30:03.294004+0000","172.21.15.59:6816/126772":"2023-10-01T22:30:03.294004+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:38:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.758+0000 7f23c9ac9700 1 -- 172.21.15.59:0/2388493768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23c4131d10 msgr2=0x7f23c41c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.758+0000 7f23c9ac9700 1 --2- 172.21.15.59:0/2388493768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23c4131d10 0x7f23c41c6c10 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f23bc014040 tx=0x7f23bc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.758+0000 7f23c9ac9700 1 -- 172.21.15.59:0/2388493768 shutdown_connections 2023-09-30T22:38:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.758+0000 7f23c9ac9700 1 --2- 172.21.15.59:0/2388493768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23c4131d10 0x7f23c41c6c10 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.758+0000 7f23c9ac9700 1 --2- 172.21.15.59:0/2388493768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23c406a770 0x7f23c41c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.758+0000 7f23c9ac9700 1 --2- 172.21.15.59:0/2388493768 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23c406b080 0x7f23c41c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.758+0000 7f23c9ac9700 1 -- 172.21.15.59:0/2388493768 >> 172.21.15.59:0/2388493768 conn(0x7f23c4066f50 msgr2=0x7f23c40700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.758+0000 7f23c9ac9700 1 -- 172.21.15.59:0/2388493768 shutdown_connections 2023-09-30T22:38:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.758+0000 7f23c9ac9700 1 -- 172.21.15.59:0/2388493768 wait complete. 2023-09-30T22:38:43.773 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:26:26.893716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:26:28.448775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:26:32.964075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:26:33.390842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T22:38:43.774 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:38:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.913+0000 7fdfe2980700 1 Processor -- start 2023-09-30T22:38:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.913+0000 7fdfe2980700 1 -- start start 2023-09-30T22:38:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfe2980700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfdc1339a0 0x7fdfdc133d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfe2980700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc06a770 0x7fdfdc06ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfe2980700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdfdc06b0c0 0x7fdfdc13a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfe2980700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfdc09e770 con 0x7fdfdc06b0c0 2023-09-30T22:38:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfe2980700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc09e900 con 0x7fdfdc06a770 2023-09-30T22:38:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfe2980700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc1337a0 con 0x7fdfdc1339a0 2023-09-30T22:38:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfdbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfdc1339a0 0x7fdfdc133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfe0f1d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdfdc06b0c0 0x7fdfdc13a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfdb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc06a770 0x7fdfdc06ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfe0f1d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdfdc06b0c0 0x7fdfdc13a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47562/0 (socket says 172.21.15.59:47562) 2023-09-30T22:38:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfdbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfdc1339a0 0x7fdfdc133d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41684/0 (socket says 172.21.15.59:41684) 2023-09-30T22:38:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfe0f1d700 1 -- 172.21.15.59:0/2914016805 learned_addr learned my addr 172.21.15.59:0/2914016805 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfdb7fe700 1 -- 172.21.15.59:0/2914016805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfdc1339a0 msgr2=0x7fdfdc133d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfdb7fe700 1 --2- 172.21.15.59:0/2914016805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfdc1339a0 0x7fdfdc133d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfdb7fe700 1 -- 172.21.15.59:0/2914016805 >> v2:172.21.15.59:3300/0 conn(0x7fdfdc06b0c0 msgr2=0x7fdfdc13a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:43.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfdb7fe700 1 --2- 172.21.15.59:0/2914016805 >> v2:172.21.15.59:3300/0 conn(0x7fdfdc06b0c0 0x7fdfdc13a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfdb7fe700 1 -- 172.21.15.59:0/2914016805 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc09f670 con 0x7fdfdc06a770 2023-09-30T22:38:43.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfdbfff700 1 --2- 172.21.15.59:0/2914016805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfdc1339a0 0x7fdfdc133d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:43.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.914+0000 7fdfe0f1d700 1 --2- 172.21.15.59:0/2914016805 >> v2:172.21.15.59:3300/0 conn(0x7fdfdc06b0c0 0x7fdfdc13a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:43.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.915+0000 7fdfdb7fe700 1 --2- 172.21.15.59:0/2914016805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc06a770 0x7fdfdc06ab80 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009840 tx=0x7fdfd0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc6ac7ddbb2a52e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:43.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.915+0000 7fdfdaffd700 1 -- 172.21.15.59:0/2914016805 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0011830 con 0x7fdfdc06a770 2023-09-30T22:38:43.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.915+0000 7fdfdaffd700 1 -- 172.21.15.59:0/2914016805 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd0011990 con 0x7fdfdc06a770 2023-09-30T22:38:43.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.915+0000 7fdfdaffd700 1 -- 172.21.15.59:0/2914016805 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0011d20 con 0x7fdfdc06a770 2023-09-30T22:38:43.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.915+0000 7fdfe2980700 1 -- 172.21.15.59:0/2914016805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc06a770 msgr2=0x7fdfdc06ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:43.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.915+0000 7fdfe2980700 1 --2- 172.21.15.59:0/2914016805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc06a770 0x7fdfdc06ab80 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009840 tx=0x7fdfd0009b50 comp rx=0 tx=0).stop 2023-09-30T22:38:43.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.915+0000 7fdfe2980700 1 -- 172.21.15.59:0/2914016805 shutdown_connections 2023-09-30T22:38:43.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.915+0000 7fdfe2980700 1 --2- 172.21.15.59:0/2914016805 >> v2:172.21.15.59:3300/0 conn(0x7fdfdc06b0c0 0x7fdfdc13a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.915+0000 7fdfe2980700 1 --2- 172.21.15.59:0/2914016805 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfdc1339a0 0x7fdfdc133d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.915+0000 7fdfe2980700 1 --2- 172.21.15.59:0/2914016805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc06a770 0x7fdfdc06ab80 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.915+0000 7fdfe2980700 1 -- 172.21.15.59:0/2914016805 >> 172.21.15.59:0/2914016805 conn(0x7fdfdc066d70 msgr2=0x7fdfdc0a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:43.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.916+0000 7fdfe2980700 1 -- 172.21.15.59:0/2914016805 shutdown_connections 2023-09-30T22:38:43.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.916+0000 7fdfe2980700 1 -- 172.21.15.59:0/2914016805 wait complete. 2023-09-30T22:38:43.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.916+0000 7fdfe2980700 1 Processor -- start 2023-09-30T22:38:43.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.917+0000 7fdfe2980700 1 -- start start 2023-09-30T22:38:43.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.917+0000 7fdfe2980700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc06a770 0x7fdfdc11d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.917+0000 7fdfe2980700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc06b0c0 0x7fdfdc11de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.917+0000 7fdfe2980700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfdc1339a0 0x7fdfdc11e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:43.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.917+0000 7fdfe2980700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc11fc10 con 0x7fdfdc06a770 2023-09-30T22:38:43.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.917+0000 7fdfe2980700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc072430 con 0x7fdfdc06b0c0 2023-09-30T22:38:43.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.917+0000 7fdfe2980700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc12d220 con 0x7fdfdc1339a0 2023-09-30T22:38:43.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.917+0000 7fdfdb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc06b0c0 0x7fdfdc11de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.917+0000 7fdfdbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc06a770 0x7fdfdc11d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.917+0000 7fdfdb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc06b0c0 0x7fdfdc11de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49930/0 (socket says 172.21.15.59:49930) 2023-09-30T22:38:43.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.917+0000 7fdfe0f1d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfdc1339a0 0x7fdfdc11e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:43.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.917+0000 7fdfdb7fe700 1 -- 172.21.15.59:0/623058843 learned_addr learned my addr 172.21.15.59:0/623058843 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:43.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.918+0000 7fdfdbfff700 1 -- 172.21.15.59:0/623058843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfdc1339a0 msgr2=0x7fdfdc11e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:43.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.918+0000 7fdfdbfff700 1 --2- 172.21.15.59:0/623058843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfdc1339a0 0x7fdfdc11e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.918+0000 7fdfdbfff700 1 -- 172.21.15.59:0/623058843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc06b0c0 msgr2=0x7fdfdc11de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:43.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.918+0000 7fdfdbfff700 1 --2- 172.21.15.59:0/623058843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc06b0c0 0x7fdfdc11de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:43.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.918+0000 7fdfdbfff700 1 -- 172.21.15.59:0/623058843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd4009b30 con 0x7fdfdc06a770 2023-09-30T22:38:43.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.918+0000 7fdfdb7fe700 1 --2- 172.21.15.59:0/623058843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc06b0c0 0x7fdfdc11de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:43.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.918+0000 7fdfdbfff700 1 --2- 172.21.15.59:0/623058843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc06a770 0x7fdfdc11d930 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00e9e0 tx=0x7fdfcc00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:43.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.918+0000 7fdfd8ff9700 1 -- 172.21.15.59:0/623058843 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00ee80 con 0x7fdfdc06a770 2023-09-30T22:38:43.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.918+0000 7fdfd8ff9700 1 -- 172.21.15.59:0/623058843 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc00c850 con 0x7fdfdc06a770 2023-09-30T22:38:43.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.918+0000 7fdfe2980700 1 -- 172.21.15.59:0/623058843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc0094a0 con 0x7fdfdc06a770 2023-09-30T22:38:43.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.918+0000 7fdfd8ff9700 1 -- 172.21.15.59:0/623058843 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00cc00 con 0x7fdfdc06a770 2023-09-30T22:38:43.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.918+0000 7fdfe2980700 1 -- 172.21.15.59:0/623058843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd00094a0 con 0x7fdfdc06a770 2023-09-30T22:38:43.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.919+0000 7fdfd8ff9700 1 -- 172.21.15.59:0/623058843 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdfcc00cd60 con 0x7fdfdc06a770 2023-09-30T22:38:43.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.919+0000 7fdfd8ff9700 1 -- 172.21.15.59:0/623058843 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdfcc03fa10 con 0x7fdfdc06a770 2023-09-30T22:38:43.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.919+0000 7fdfe2980700 1 -- 172.21.15.59:0/623058843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc12d5e0 con 0x7fdfdc06a770 2023-09-30T22:38:43.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:43.924+0000 7fdfd8ff9700 1 -- 172.21.15.59:0/623058843 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdfcc021080 con 0x7fdfdc06a770 2023-09-30T22:38:44.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.124+0000 7fdfe2980700 1 -- 172.21.15.59:0/623058843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdfdc12dbe0 con 0x7fdfdc06a770 2023-09-30T22:38:44.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.125+0000 7fdfd8ff9700 1 -- 172.21.15.59:0/623058843 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdfcc017020 con 0x7fdfdc06a770 2023-09-30T22:38:44.125 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-30T22:38:44.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.127+0000 7fdfe2980700 1 -- 172.21.15.59:0/623058843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc06a770 msgr2=0x7fdfdc11d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.127+0000 7fdfe2980700 1 --2- 172.21.15.59:0/623058843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc06a770 0x7fdfdc11d930 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00e9e0 tx=0x7fdfcc00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.127+0000 7fdfe2980700 1 -- 172.21.15.59:0/623058843 shutdown_connections 2023-09-30T22:38:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.127+0000 7fdfe2980700 1 --2- 172.21.15.59:0/623058843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfdc1339a0 0x7fdfdc11e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.127+0000 7fdfe2980700 1 --2- 172.21.15.59:0/623058843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc06a770 0x7fdfdc11d930 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.127+0000 7fdfe2980700 1 --2- 172.21.15.59:0/623058843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc06b0c0 0x7fdfdc11de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.127+0000 7fdfe2980700 1 -- 172.21.15.59:0/623058843 >> 172.21.15.59:0/623058843 conn(0x7fdfdc066d70 msgr2=0x7fdfdc0a26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.127+0000 7fdfe2980700 1 -- 172.21.15.59:0/623058843 shutdown_connections 2023-09-30T22:38:44.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.127+0000 7fdfe2980700 1 -- 172.21.15.59:0/623058843 wait complete. 2023-09-30T22:38:44.141 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:38:44.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.280+0000 7f6e4c911700 1 Processor -- start 2023-09-30T22:38:44.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.281+0000 7f6e4c911700 1 -- start start 2023-09-30T22:38:44.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.281+0000 7f6e4c911700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6e48136b80 0x7f6e48138f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:44.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.281+0000 7f6e4c911700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e481394a0 0x7f6e4813b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:44.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.281+0000 7f6e4c911700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4809f860 con 0x7f6e48071cd0 2023-09-30T22:38:44.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.281+0000 7f6e4c911700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e480a0680 con 0x7f6e48136b80 2023-09-30T22:38:44.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.281+0000 7f6e4c911700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4806cb80 con 0x7f6e481394a0 2023-09-30T22:38:44.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.281+0000 7f6e45d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6e48136b80 0x7f6e48138f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:44.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.281+0000 7f6e46d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e481394a0 0x7f6e4813b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:44.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.281+0000 7f6e45d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6e48136b80 0x7f6e48138f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47574/0 (socket says 172.21.15.59:47574) 2023-09-30T22:38:44.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.281+0000 7f6e45d9b700 1 -- 172.21.15.59:0/2711319558 learned_addr learned my addr 172.21.15.59:0/2711319558 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:44.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.282+0000 7f6e45d9b700 1 -- 172.21.15.59:0/2711319558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e481394a0 msgr2=0x7f6e4813b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.282+0000 7f6e45d9b700 1 --2- 172.21.15.59:0/2711319558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e481394a0 0x7f6e4813b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.282+0000 7f6e45d9b700 1 -- 172.21.15.59:0/2711319558 >> v1:172.21.15.59:6789/0 conn(0x7f6e48071cd0 legacy=0x7f6e480720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.282+0000 7f6e45d9b700 1 -- 172.21.15.59:0/2711319558 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4806c0a0 con 0x7f6e48136b80 2023-09-30T22:38:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.282+0000 7f6e46d9d700 1 --2- 172.21.15.59:0/2711319558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e481394a0 0x7f6e4813b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.282+0000 7f6e45d9b700 1 --2- 172.21.15.59:0/2711319558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e48136b80 0x7f6e48138f60 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f6e300098f0 tx=0x7f6e30009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a791fcd624b1fc6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.282+0000 7f6e4559a700 1 -- 172.21.15.59:0/2711319558 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30011830 con 0x7f6e48136b80 2023-09-30T22:38:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.282+0000 7f6e4559a700 1 -- 172.21.15.59:0/2711319558 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e30011990 con 0x7f6e48136b80 2023-09-30T22:38:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.282+0000 7f6e4559a700 1 -- 172.21.15.59:0/2711319558 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30011d20 con 0x7f6e48136b80 2023-09-30T22:38:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.283+0000 7f6e4c911700 1 -- 172.21.15.59:0/2711319558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e48136b80 msgr2=0x7f6e48138f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.283+0000 7f6e4c911700 1 --2- 172.21.15.59:0/2711319558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e48136b80 0x7f6e48138f60 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f6e300098f0 tx=0x7f6e30009c00 comp rx=0 tx=0).stop 2023-09-30T22:38:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.283+0000 7f6e4c911700 1 -- 172.21.15.59:0/2711319558 shutdown_connections 2023-09-30T22:38:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.283+0000 7f6e4c911700 1 --2- 172.21.15.59:0/2711319558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e481394a0 0x7f6e4813b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.283+0000 7f6e4c911700 1 --2- 172.21.15.59:0/2711319558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e48136b80 0x7f6e48138f60 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.283+0000 7f6e4c911700 1 -- 172.21.15.59:0/2711319558 >> 172.21.15.59:0/2711319558 conn(0x7f6e480a4130 msgr2=0x7f6e480a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.283+0000 7f6e4c911700 1 -- 172.21.15.59:0/2711319558 shutdown_connections 2023-09-30T22:38:44.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.283+0000 7f6e4c911700 1 -- 172.21.15.59:0/2711319558 wait complete. 2023-09-30T22:38:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.284+0000 7f6e4c911700 1 Processor -- start 2023-09-30T22:38:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.284+0000 7f6e4c911700 1 -- start start 2023-09-30T22:38:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.284+0000 7f6e4c911700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e48071cd0 0x7f6e4811ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.284+0000 7f6e4c911700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e48136b80 0x7f6e4811ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.284+0000 7f6e4c911700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e481394a0 0x7f6e4811f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.284+0000 7f6e4c911700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e48120800 con 0x7f6e481394a0 2023-09-30T22:38:44.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.284+0000 7f6e4c911700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4806cda0 con 0x7f6e48136b80 2023-09-30T22:38:44.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.284+0000 7f6e4c911700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4813bbb0 con 0x7f6e48071cd0 2023-09-30T22:38:44.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e4659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e48071cd0 0x7f6e4811ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:44.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e46d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e481394a0 0x7f6e4811f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:44.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e45d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e48136b80 0x7f6e4811ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:44.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e4659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e48071cd0 0x7f6e4811ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41722/0 (socket says 172.21.15.59:41722) 2023-09-30T22:38:44.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e46d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e481394a0 0x7f6e4811f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47582/0 (socket says 172.21.15.59:47582) 2023-09-30T22:38:44.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e4659c700 1 -- 172.21.15.59:0/3618669796 learned_addr learned my addr 172.21.15.59:0/3618669796 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:44.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e46d9d700 1 -- 172.21.15.59:0/3618669796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e48071cd0 msgr2=0x7f6e4811ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:44.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e46d9d700 1 --2- 172.21.15.59:0/3618669796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e48071cd0 0x7f6e4811ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e46d9d700 1 -- 172.21.15.59:0/3618669796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e48136b80 msgr2=0x7f6e4811ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:44.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e46d9d700 1 --2- 172.21.15.59:0/3618669796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e48136b80 0x7f6e4811ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e46d9d700 1 -- 172.21.15.59:0/3618669796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e40009a70 con 0x7f6e481394a0 2023-09-30T22:38:44.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e4659c700 1 --2- 172.21.15.59:0/3618669796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e48071cd0 0x7f6e4811ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:44.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e46d9d700 1 --2- 172.21.15.59:0/3618669796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e481394a0 0x7f6e4811f490 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f6e4806f170 tx=0x7f6e4000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:44.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e3effd700 1 -- 172.21.15.59:0/3618669796 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40003a20 con 0x7f6e481394a0 2023-09-30T22:38:44.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e3effd700 1 -- 172.21.15.59:0/3618669796 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4000f040 con 0x7f6e481394a0 2023-09-30T22:38:44.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e4c911700 1 -- 172.21.15.59:0/3618669796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e30009550 con 0x7f6e481394a0 2023-09-30T22:38:44.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e3effd700 1 -- 172.21.15.59:0/3618669796 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40003dc0 con 0x7f6e481394a0 2023-09-30T22:38:44.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.285+0000 7f6e4c911700 1 -- 172.21.15.59:0/3618669796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e48121e00 con 0x7f6e481394a0 2023-09-30T22:38:44.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.286+0000 7f6e3effd700 1 -- 172.21.15.59:0/3618669796 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e4000ca20 con 0x7f6e481394a0 2023-09-30T22:38:44.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.287+0000 7f6e3effd700 1 -- 172.21.15.59:0/3618669796 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6e4003fe70 con 0x7f6e481394a0 2023-09-30T22:38:44.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.287+0000 7f6e4c911700 1 -- 172.21.15.59:0/3618669796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e48121a50 con 0x7f6e481394a0 2023-09-30T22:38:44.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.291+0000 7f6e3effd700 1 -- 172.21.15.59:0/3618669796 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e4001b360 con 0x7f6e481394a0 2023-09-30T22:38:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.493+0000 7f6e4c911700 1 -- 172.21.15.59:0/3618669796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6e4804f2a0 con 0x7f6e481394a0 2023-09-30T22:38:44.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.494+0000 7f6e3effd700 1 -- 172.21.15.59:0/3618669796 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6e4001cba0 con 0x7f6e481394a0 2023-09-30T22:38:44.495 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-09-30T22:38:44.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.496+0000 7f6e4c911700 1 -- 172.21.15.59:0/3618669796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e481394a0 msgr2=0x7f6e4811f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.496+0000 7f6e4c911700 1 --2- 172.21.15.59:0/3618669796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e481394a0 0x7f6e4811f490 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f6e4806f170 tx=0x7f6e4000ef90 comp rx=0 tx=0).stop 2023-09-30T22:38:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.496+0000 7f6e4c911700 1 -- 172.21.15.59:0/3618669796 shutdown_connections 2023-09-30T22:38:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.496+0000 7f6e4c911700 1 --2- 172.21.15.59:0/3618669796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e48071cd0 0x7f6e4811ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.496+0000 7f6e4c911700 1 --2- 172.21.15.59:0/3618669796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e481394a0 0x7f6e4811f490 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.496+0000 7f6e4c911700 1 --2- 172.21.15.59:0/3618669796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e48136b80 0x7f6e4811ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.496+0000 7f6e4c911700 1 -- 172.21.15.59:0/3618669796 >> 172.21.15.59:0/3618669796 conn(0x7f6e480a4130 msgr2=0x7f6e48070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:44.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.496+0000 7f6e4c911700 1 -- 172.21.15.59:0/3618669796 shutdown_connections 2023-09-30T22:38:44.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.496+0000 7f6e4c911700 1 -- 172.21.15.59:0/3618669796 wait complete. 2023-09-30T22:38:44.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:38:44.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.650+0000 7ff540144700 1 Processor -- start 2023-09-30T22:38:44.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.650+0000 7ff540144700 1 -- start start 2023-09-30T22:38:44.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff540144700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5380a37f0 0x7ff5381338b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:44.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff540144700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53806ae80 0x7ff53813b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:44.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff540144700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53809e900 con 0x7ff538133df0 2023-09-30T22:38:44.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff540144700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53809dec0 con 0x7ff53806ae80 2023-09-30T22:38:44.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff540144700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff53809f600 con 0x7ff5380a37f0 2023-09-30T22:38:44.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff53dee0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5380a37f0 0x7ff5381338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:44.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff53e6e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53806ae80 0x7ff53813b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:44.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff53e6e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53806ae80 0x7ff53813b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42464/0 (socket says 172.21.15.59:42464) 2023-09-30T22:38:44.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff53dee0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5380a37f0 0x7ff5381338b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40216/0 (socket says 172.21.15.59:40216) 2023-09-30T22:38:44.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff53e6e1700 1 -- 172.21.15.59:0/895312115 learned_addr learned my addr 172.21.15.59:0/895312115 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:44.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff53d6df700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff538133df0 0x7ff53806a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46224/0 (socket says 172.21.15.59:46224) 2023-09-30T22:38:44.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff53cede700 1 -- 172.21.15.59:0/895312115 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167838591 0 0) 0x7ff53809e900 con 0x7ff538133df0 2023-09-30T22:38:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff53dee0700 1 -- 172.21.15.59:0/895312115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53806ae80 msgr2=0x7ff53813b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff53dee0700 1 --2- 172.21.15.59:0/895312115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53806ae80 0x7ff53813b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff53dee0700 1 -- 172.21.15.59:0/895312115 >> v1:172.21.15.59:6789/0 conn(0x7ff538133df0 legacy=0x7ff53806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff53dee0700 1 -- 172.21.15.59:0/895312115 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53809e680 con 0x7ff5380a37f0 2023-09-30T22:38:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff53e6e1700 1 --2- 172.21.15.59:0/895312115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53806ae80 0x7ff53813b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.651+0000 7ff53dee0700 1 --2- 172.21.15.59:0/895312115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5380a37f0 0x7ff5381338b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009870 tx=0x7ff52c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=422fbea4905c938a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.652+0000 7ff53cede700 1 -- 172.21.15.59:0/895312115 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c011830 con 0x7ff5380a37f0 2023-09-30T22:38:44.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.652+0000 7ff53cede700 1 -- 172.21.15.59:0/895312115 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c011990 con 0x7ff5380a37f0 2023-09-30T22:38:44.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.652+0000 7ff53cede700 1 -- 172.21.15.59:0/895312115 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c011d20 con 0x7ff5380a37f0 2023-09-30T22:38:44.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.652+0000 7ff540144700 1 -- 172.21.15.59:0/895312115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5380a37f0 msgr2=0x7ff5381338b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:44.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.652+0000 7ff540144700 1 --2- 172.21.15.59:0/895312115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5380a37f0 0x7ff5381338b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009870 tx=0x7ff52c009b80 comp rx=0 tx=0).stop 2023-09-30T22:38:44.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.652+0000 7ff540144700 1 -- 172.21.15.59:0/895312115 shutdown_connections 2023-09-30T22:38:44.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.652+0000 7ff540144700 1 --2- 172.21.15.59:0/895312115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5380a37f0 0x7ff5381338b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.652+0000 7ff540144700 1 --2- 172.21.15.59:0/895312115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53806ae80 0x7ff53813b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.652+0000 7ff540144700 1 -- 172.21.15.59:0/895312115 >> 172.21.15.59:0/895312115 conn(0x7ff538066d70 msgr2=0x7ff5380a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:44.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.652+0000 7ff540144700 1 -- 172.21.15.59:0/895312115 shutdown_connections 2023-09-30T22:38:44.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.652+0000 7ff540144700 1 -- 172.21.15.59:0/895312115 wait complete. 2023-09-30T22:38:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.653+0000 7ff540144700 1 Processor -- start 2023-09-30T22:38:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.653+0000 7ff540144700 1 -- start start 2023-09-30T22:38:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff540144700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53806ae80 0x7ff53811d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff540144700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5380a37f0 0x7ff53811de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:44.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff540144700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff538133df0 0x7ff53811e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:44.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff540144700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53811fed0 con 0x7ff5380a37f0 2023-09-30T22:38:44.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff540144700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53812dbf0 con 0x7ff53806ae80 2023-09-30T22:38:44.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff540144700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff53811f660 con 0x7ff538133df0 2023-09-30T22:38:44.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff53dee0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53806ae80 0x7ff53811d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:44.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff53e6e1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff538133df0 0x7ff53811e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:44.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff53dee0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53806ae80 0x7ff53811d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42472/0 (socket says 172.21.15.59:42472) 2023-09-30T22:38:44.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff53dee0700 1 -- 172.21.15.59:0/685570723 learned_addr learned my addr 172.21.15.59:0/685570723 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff53d6df700 1 --2- 172.21.15.59:0/685570723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5380a37f0 0x7ff53811de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff53dee0700 1 -- 172.21.15.59:0/685570723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff538133df0 msgr2=0x7ff53811e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff53dee0700 1 --2- 172.21.15.59:0/685570723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff538133df0 0x7ff53811e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff53dee0700 1 -- 172.21.15.59:0/685570723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5380a37f0 msgr2=0x7ff53811de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff53dee0700 1 --2- 172.21.15.59:0/685570723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5380a37f0 0x7ff53811de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff53dee0700 1 -- 172.21.15.59:0/685570723 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff530009b30 con 0x7ff53806ae80 2023-09-30T22:38:44.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff53e6e1700 1 --2- 172.21.15.59:0/685570723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff538133df0 0x7ff53811e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.654+0000 7ff53dee0700 1 --2- 172.21.15.59:0/685570723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53806ae80 0x7ff53811d930 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0090b0 tx=0x7ff52c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.655+0000 7ff52a7fc700 1 -- 172.21.15.59:0/685570723 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c004510 con 0x7ff53806ae80 2023-09-30T22:38:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.655+0000 7ff52a7fc700 1 -- 172.21.15.59:0/685570723 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c01f070 con 0x7ff53806ae80 2023-09-30T22:38:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.655+0000 7ff540144700 1 -- 172.21.15.59:0/685570723 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52c0094a0 con 0x7ff53806ae80 2023-09-30T22:38:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.655+0000 7ff52a7fc700 1 -- 172.21.15.59:0/685570723 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0038e0 con 0x7ff53806ae80 2023-09-30T22:38:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.655+0000 7ff540144700 1 -- 172.21.15.59:0/685570723 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff538120820 con 0x7ff53806ae80 2023-09-30T22:38:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.656+0000 7ff540144700 1 -- 172.21.15.59:0/685570723 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53812d7e0 con 0x7ff53806ae80 2023-09-30T22:38:44.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.656+0000 7ff52a7fc700 1 -- 172.21.15.59:0/685570723 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff52c003a40 con 0x7ff53806ae80 2023-09-30T22:38:44.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.656+0000 7ff52a7fc700 1 -- 172.21.15.59:0/685570723 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff52c021070 con 0x7ff53806ae80 2023-09-30T22:38:44.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.661+0000 7ff52a7fc700 1 -- 172.21.15.59:0/685570723 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff52c010380 con 0x7ff53806ae80 2023-09-30T22:38:44.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.867+0000 7ff540144700 1 -- 172.21.15.59:0/685570723 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff53804f2a0 con 0x7ff53806ae80 2023-09-30T22:38:44.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.868+0000 7ff52a7fc700 1 -- 172.21.15.59:0/685570723 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff52c015070 con 0x7ff53806ae80 2023-09-30T22:38:44.868 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-30T22:38:44.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.870+0000 7ff540144700 1 -- 172.21.15.59:0/685570723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53806ae80 msgr2=0x7ff53811d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:44.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.870+0000 7ff540144700 1 --2- 172.21.15.59:0/685570723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53806ae80 0x7ff53811d930 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0090b0 tx=0x7ff52c004750 comp rx=0 tx=0).stop 2023-09-30T22:38:44.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.870+0000 7ff540144700 1 -- 172.21.15.59:0/685570723 shutdown_connections 2023-09-30T22:38:44.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.870+0000 7ff540144700 1 --2- 172.21.15.59:0/685570723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff538133df0 0x7ff53811e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.870+0000 7ff540144700 1 --2- 172.21.15.59:0/685570723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53806ae80 0x7ff53811d930 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.870+0000 7ff540144700 1 --2- 172.21.15.59:0/685570723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5380a37f0 0x7ff53811de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:44.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.870+0000 7ff540144700 1 -- 172.21.15.59:0/685570723 >> 172.21.15.59:0/685570723 conn(0x7ff538066d70 msgr2=0x7ff5380a2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:44.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.870+0000 7ff540144700 1 -- 172.21.15.59:0/685570723 shutdown_connections 2023-09-30T22:38:44.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:44.870+0000 7ff540144700 1 -- 172.21.15.59:0/685570723 wait complete. 2023-09-30T22:38:44.884 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:38:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.023+0000 7f775279e700 1 Processor -- start 2023-09-30T22:38:45.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.023+0000 7f775279e700 1 -- start start 2023-09-30T22:38:45.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.023+0000 7f775279e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f774c09d7d0 0x7f774c09dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:45.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.023+0000 7f775279e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f774c130e80 0x7f774c138a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:45.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.023+0000 7f775279e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f774c09b800 con 0x7f774c09e0e0 2023-09-30T22:38:45.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.023+0000 7f775279e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774c09b620 con 0x7f774c130e80 2023-09-30T22:38:45.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.023+0000 7f775279e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f774c09f370 con 0x7f774c09d7d0 2023-09-30T22:38:45.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.024+0000 7f7750d3b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f774c130e80 0x7f774c138a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:45.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.024+0000 7f774bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f774c09d7d0 0x7f774c09dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:45.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.024+0000 7f774b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f774c09e0e0 0x7f774c130770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46238/0 (socket says 172.21.15.59:46238) 2023-09-30T22:38:45.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.024+0000 7f774b7fe700 1 -- 172.21.15.59:0/666620601 learned_addr learned my addr 172.21.15.59:0/666620601 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-30T22:38:45.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.024+0000 7f7750d3b700 1 -- 172.21.15.59:0/666620601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f774c09d7d0 msgr2=0x7f774c09dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:45.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.024+0000 7f774affd700 1 -- 172.21.15.59:0/666620601 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185388820 0 0) 0x7f774c09b800 con 0x7f774c09e0e0 2023-09-30T22:38:45.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.024+0000 7f7750d3b700 1 --2- 172.21.15.59:0/666620601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f774c09d7d0 0x7f774c09dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.024+0000 7f7750d3b700 1 -- 172.21.15.59:0/666620601 >> v1:172.21.15.59:6789/0 conn(0x7f774c09e0e0 legacy=0x7f774c130770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:45.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.024+0000 7f7750d3b700 1 -- 172.21.15.59:0/666620601 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774c09ef80 con 0x7f774c130e80 2023-09-30T22:38:45.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.024+0000 7f774bfff700 1 --2- 172.21.15.59:0/666620601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f774c09d7d0 0x7f774c09dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:45.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.024+0000 7f7750d3b700 1 --2- 172.21.15.59:0/666620601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f774c130e80 0x7f774c138a40 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7744009dc0 tx=0x7f774400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50b342208ea91845 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:45.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.024+0000 7f774affd700 1 -- 172.21.15.59:0/666620601 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774400e070 con 0x7f774c130e80 2023-09-30T22:38:45.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.024+0000 7f774affd700 1 -- 172.21.15.59:0/666620601 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774400bb20 con 0x7f774c130e80 2023-09-30T22:38:45.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.024+0000 7f774affd700 1 -- 172.21.15.59:0/666620601 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744012430 con 0x7f774c130e80 2023-09-30T22:38:45.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.025+0000 7f775279e700 1 -- 172.21.15.59:0/666620601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f774c130e80 msgr2=0x7f774c138a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:45.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.025+0000 7f775279e700 1 --2- 172.21.15.59:0/666620601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f774c130e80 0x7f774c138a40 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7744009dc0 tx=0x7f774400b330 comp rx=0 tx=0).stop 2023-09-30T22:38:45.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.025+0000 7f775279e700 1 -- 172.21.15.59:0/666620601 shutdown_connections 2023-09-30T22:38:45.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.025+0000 7f775279e700 1 --2- 172.21.15.59:0/666620601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f774c09d7d0 0x7f774c09dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.025+0000 7f775279e700 1 --2- 172.21.15.59:0/666620601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f774c130e80 0x7f774c138a40 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.025+0000 7f775279e700 1 -- 172.21.15.59:0/666620601 >> 172.21.15.59:0/666620601 conn(0x7f774c066d70 msgr2=0x7f774c0a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:45.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.025+0000 7f775279e700 1 -- 172.21.15.59:0/666620601 shutdown_connections 2023-09-30T22:38:45.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.025+0000 7f775279e700 1 -- 172.21.15.59:0/666620601 wait complete. 2023-09-30T22:38:45.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.026+0000 7f775279e700 1 Processor -- start 2023-09-30T22:38:45.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.026+0000 7f775279e700 1 -- start start 2023-09-30T22:38:45.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f775279e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f774c09d7d0 0x7f774c1360c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:45.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f775279e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f774c09e0e0 0x7f774c138fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:45.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f775279e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f774c130e80 0x7f774c1394f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:45.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f775279e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774c09c7b0 con 0x7f774c09e0e0 2023-09-30T22:38:45.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f775279e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774c0a1e50 con 0x7f774c09d7d0 2023-09-30T22:38:45.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f775279e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f774c13ac90 con 0x7f774c130e80 2023-09-30T22:38:45.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f774bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f774c09d7d0 0x7f774c1360c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:45.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f774b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f774c09e0e0 0x7f774c138fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:45.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f7750d3b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f774c130e80 0x7f774c1394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:45.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f774bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f774c09d7d0 0x7f774c1360c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42488/0 (socket says 172.21.15.59:42488) 2023-09-30T22:38:45.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f774bfff700 1 -- 172.21.15.59:0/3101822098 learned_addr learned my addr 172.21.15.59:0/3101822098 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:45.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f774bfff700 1 -- 172.21.15.59:0/3101822098 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f774c130e80 msgr2=0x7f774c1394f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:45.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f774bfff700 1 --2- 172.21.15.59:0/3101822098 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f774c130e80 0x7f774c1394f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f774bfff700 1 -- 172.21.15.59:0/3101822098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f774c09e0e0 msgr2=0x7f774c138fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:45.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f774bfff700 1 --2- 172.21.15.59:0/3101822098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f774c09e0e0 0x7f774c138fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f774bfff700 1 -- 172.21.15.59:0/3101822098 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c0094a0 con 0x7f774c09d7d0 2023-09-30T22:38:45.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f774b7fe700 1 --2- 172.21.15.59:0/3101822098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f774c09e0e0 0x7f774c138fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:45.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f774bfff700 1 --2- 172.21.15.59:0/3101822098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f774c09d7d0 0x7f774c1360c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f773c00ec10 tx=0x7f773c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:45.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.027+0000 7f7748ff9700 1 -- 172.21.15.59:0/3101822098 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c00c850 con 0x7f774c09d7d0 2023-09-30T22:38:45.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.028+0000 7f7748ff9700 1 -- 172.21.15.59:0/3101822098 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773c00c9b0 con 0x7f774c09d7d0 2023-09-30T22:38:45.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.028+0000 7f775279e700 1 -- 172.21.15.59:0/3101822098 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7744009a70 con 0x7f774c09d7d0 2023-09-30T22:38:45.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.028+0000 7f7748ff9700 1 -- 172.21.15.59:0/3101822098 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c00cd20 con 0x7f774c09d7d0 2023-09-30T22:38:45.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.028+0000 7f775279e700 1 -- 172.21.15.59:0/3101822098 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f774c11d6a0 con 0x7f774c09d7d0 2023-09-30T22:38:45.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.029+0000 7f775279e700 1 -- 172.21.15.59:0/3101822098 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774c04f2a0 con 0x7f774c09d7d0 2023-09-30T22:38:45.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.029+0000 7f7748ff9700 1 -- 172.21.15.59:0/3101822098 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f773c013470 con 0x7f774c09d7d0 2023-09-30T22:38:45.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.029+0000 7f7748ff9700 1 -- 172.21.15.59:0/3101822098 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f773c03ffa0 con 0x7f774c09d7d0 2023-09-30T22:38:45.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.034+0000 7f7748ff9700 1 -- 172.21.15.59:0/3101822098 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f773c013720 con 0x7f774c09d7d0 2023-09-30T22:38:45.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.240+0000 7f775279e700 1 -- 172.21.15.59:0/3101822098 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f774c137480 con 0x7f774c09d7d0 2023-09-30T22:38:45.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.240+0000 7f7748ff9700 1 -- 172.21.15.59:0/3101822098 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f773c017070 con 0x7f774c09d7d0 2023-09-30T22:38:45.241 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-30T22:38:45.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.243+0000 7f775279e700 1 -- 172.21.15.59:0/3101822098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f774c09d7d0 msgr2=0x7f774c1360c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:45.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.243+0000 7f775279e700 1 --2- 172.21.15.59:0/3101822098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f774c09d7d0 0x7f774c1360c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f773c00ec10 tx=0x7f773c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:38:45.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.243+0000 7f775279e700 1 -- 172.21.15.59:0/3101822098 shutdown_connections 2023-09-30T22:38:45.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.243+0000 7f775279e700 1 --2- 172.21.15.59:0/3101822098 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f774c130e80 0x7f774c1394f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.243+0000 7f775279e700 1 --2- 172.21.15.59:0/3101822098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f774c09d7d0 0x7f774c1360c0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.243+0000 7f775279e700 1 --2- 172.21.15.59:0/3101822098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f774c09e0e0 0x7f774c138fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.243+0000 7f775279e700 1 -- 172.21.15.59:0/3101822098 >> 172.21.15.59:0/3101822098 conn(0x7f774c066d70 msgr2=0x7f774c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:45.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.243+0000 7f775279e700 1 -- 172.21.15.59:0/3101822098 shutdown_connections 2023-09-30T22:38:45.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.243+0000 7f775279e700 1 -- 172.21.15.59:0/3101822098 wait complete. 2023-09-30T22:38:45.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T22:38:45.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.394+0000 7fade10b4700 1 Processor -- start 2023-09-30T22:38:45.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.394+0000 7fade10b4700 1 -- start start 2023-09-30T22:38:45.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.394+0000 7fade10b4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faddc09e930 0x7faddc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:45.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.394+0000 7fade10b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc09f240 0x7faddc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:45.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.394+0000 7fade10b4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faddc070940 con 0x7faddc09f650 2023-09-30T22:38:45.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.394+0000 7fade10b4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faddc06fd60 con 0x7faddc09e930 2023-09-30T22:38:45.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.394+0000 7fade10b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc06fa80 con 0x7faddc09f240 2023-09-30T22:38:45.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.394+0000 7faddad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faddc09e930 0x7faddc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:45.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.394+0000 7fadda59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc09f240 0x7faddc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:45.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.395+0000 7fadda59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc09f240 0x7faddc1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42504/0 (socket says 172.21.15.59:42504) 2023-09-30T22:38:45.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.395+0000 7fadda59c700 1 -- 172.21.15.59:0/952472424 learned_addr learned my addr 172.21.15.59:0/952472424 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:45.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.395+0000 7faddad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faddc09e930 0x7faddc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47516/0 (socket says 172.21.15.59:47516) 2023-09-30T22:38:45.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.395+0000 7fadda59c700 1 -- 172.21.15.59:0/952472424 >> v2:172.21.15.59:3300/0 conn(0x7faddc09e930 msgr2=0x7faddc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:45.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.395+0000 7fadda59c700 1 --2- 172.21.15.59:0/952472424 >> v2:172.21.15.59:3300/0 conn(0x7faddc09e930 0x7faddc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.395+0000 7fadda59c700 1 -- 172.21.15.59:0/952472424 >> v1:172.21.15.59:6789/0 conn(0x7faddc09f650 legacy=0x7faddc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:45.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.395+0000 7fadda59c700 1 -- 172.21.15.59:0/952472424 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc09fb60 con 0x7faddc09f240 2023-09-30T22:38:45.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.395+0000 7fadda59c700 1 --2- 172.21.15.59:0/952472424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc09f240 0x7faddc1317f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fadd00098f0 tx=0x7fadd0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=897c9ac40139613a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:45.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.395+0000 7fadd9d9b700 1 -- 172.21.15.59:0/952472424 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0011830 con 0x7faddc09f240 2023-09-30T22:38:45.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.395+0000 7fadd9d9b700 1 -- 172.21.15.59:0/952472424 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd0011990 con 0x7faddc09f240 2023-09-30T22:38:45.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.395+0000 7fadd9d9b700 1 -- 172.21.15.59:0/952472424 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0011d20 con 0x7faddc09f240 2023-09-30T22:38:45.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.396+0000 7fade10b4700 1 -- 172.21.15.59:0/952472424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc09f240 msgr2=0x7faddc1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:45.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.396+0000 7fade10b4700 1 --2- 172.21.15.59:0/952472424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc09f240 0x7faddc1317f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fadd00098f0 tx=0x7fadd0009c00 comp rx=0 tx=0).stop 2023-09-30T22:38:45.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.396+0000 7fade10b4700 1 -- 172.21.15.59:0/952472424 shutdown_connections 2023-09-30T22:38:45.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.396+0000 7fade10b4700 1 --2- 172.21.15.59:0/952472424 >> v2:172.21.15.59:3300/0 conn(0x7faddc09e930 0x7faddc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.396+0000 7fade10b4700 1 --2- 172.21.15.59:0/952472424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc09f240 0x7faddc1317f0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.396+0000 7fade10b4700 1 -- 172.21.15.59:0/952472424 >> 172.21.15.59:0/952472424 conn(0x7faddc0a4210 msgr2=0x7faddc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:45.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.396+0000 7fade10b4700 1 -- 172.21.15.59:0/952472424 shutdown_connections 2023-09-30T22:38:45.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.396+0000 7fade10b4700 1 -- 172.21.15.59:0/952472424 wait complete. 2023-09-30T22:38:45.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.397+0000 7fade10b4700 1 Processor -- start 2023-09-30T22:38:45.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.397+0000 7fade10b4700 1 -- start start 2023-09-30T22:38:45.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7fade10b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc09e930 0x7faddc1c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:45.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7fade10b4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc09f240 0x7faddc1c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:45.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7fade10b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faddc09f650 0x7faddc1c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:45.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7fade10b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc1a8350 con 0x7faddc09f650 2023-09-30T22:38:45.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7fade10b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc1a6640 con 0x7faddc09e930 2023-09-30T22:38:45.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7fade10b4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0a3340 con 0x7faddc09f240 2023-09-30T22:38:45.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7faddad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc09e930 0x7faddc1c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:45.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7faddad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc09e930 0x7faddc1c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42508/0 (socket says 172.21.15.59:42508) 2023-09-30T22:38:45.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7faddad9d700 1 -- 172.21.15.59:0/611544012 learned_addr learned my addr 172.21.15.59:0/611544012 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:45.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7faddb59e700 1 --2- 172.21.15.59:0/611544012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faddc09f650 0x7faddc1c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:45.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7fadda59c700 1 --2- 172.21.15.59:0/611544012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc09f240 0x7faddc1c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:45.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7faddad9d700 1 -- 172.21.15.59:0/611544012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc09f240 msgr2=0x7faddc1c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:45.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7faddad9d700 1 --2- 172.21.15.59:0/611544012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc09f240 0x7faddc1c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7faddad9d700 1 -- 172.21.15.59:0/611544012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faddc09f650 msgr2=0x7faddc1c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:45.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7faddad9d700 1 --2- 172.21.15.59:0/611544012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faddc09f650 0x7faddc1c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7faddad9d700 1 -- 172.21.15.59:0/611544012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0009550 con 0x7faddc09e930 2023-09-30T22:38:45.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7faddb59e700 1 --2- 172.21.15.59:0/611544012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faddc09f650 0x7faddc1c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:45.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.398+0000 7faddad9d700 1 --2- 172.21.15.59:0/611544012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc09e930 0x7faddc1c81a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00e9b0 tx=0x7fadcc00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:45.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.399+0000 7fadc37fe700 1 -- 172.21.15.59:0/611544012 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc009710 con 0x7faddc09e930 2023-09-30T22:38:45.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.399+0000 7fadc37fe700 1 -- 172.21.15.59:0/611544012 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc00ee50 con 0x7faddc09e930 2023-09-30T22:38:45.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.399+0000 7fade10b4700 1 -- 172.21.15.59:0/611544012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc0a0190 con 0x7faddc09e930 2023-09-30T22:38:45.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.399+0000 7fadc37fe700 1 -- 172.21.15.59:0/611544012 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00ca50 con 0x7faddc09e930 2023-09-30T22:38:45.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.399+0000 7fade10b4700 1 -- 172.21.15.59:0/611544012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc1a8ce0 con 0x7faddc09e930 2023-09-30T22:38:45.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.399+0000 7fadc37fe700 1 -- 172.21.15.59:0/611544012 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fadcc00cbb0 con 0x7faddc09e930 2023-09-30T22:38:45.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.400+0000 7fadc37fe700 1 -- 172.21.15.59:0/611544012 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fadcc03f7d0 con 0x7faddc09e930 2023-09-30T22:38:45.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.400+0000 7fade10b4700 1 -- 172.21.15.59:0/611544012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc074ea0 con 0x7faddc09e930 2023-09-30T22:38:45.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.404+0000 7fadc37fe700 1 -- 172.21.15.59:0/611544012 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadcc0232f0 con 0x7faddc09e930 2023-09-30T22:38:45.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.627+0000 7fade10b4700 1 -- 172.21.15.59:0/611544012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faddc06b250 con 0x7faddc09e930 2023-09-30T22:38:45.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.627+0000 7fadc37fe700 1 -- 172.21.15.59:0/611544012 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v42) v1 ==== 81+0+638 (secure 0 0 0) 0x7fadcc01ae80 con 0x7faddc09e930 2023-09-30T22:38:45.628 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3454906108 2023-10-01T22:30:03.294004+0000 2023-09-30T22:38:45.628 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/978898929 2023-10-01T22:30:03.294004+0000 2023-09-30T22:38:45.628 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/1645378737 2023-10-01T22:30:03.294004+0000 2023-09-30T22:38:45.628 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/2628012448 2023-10-01T22:30:03.294004+0000 2023-09-30T22:38:45.628 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/1346763106 2023-10-01T22:28:59.561079+0000 2023-09-30T22:38:45.628 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3882222550 2023-10-01T22:28:59.561079+0000 2023-09-30T22:38:45.628 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/2365211568 2023-10-01T22:30:03.294004+0000 2023-09-30T22:38:45.629 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6817/2103029646 2023-10-01T22:29:28.838274+0000 2023-09-30T22:38:45.629 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6816/118188 2023-10-01T22:28:59.561079+0000 2023-09-30T22:38:45.629 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3534779696 2023-10-01T22:30:03.294004+0000 2023-09-30T22:38:45.629 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6816/126772 2023-10-01T22:30:03.294004+0000 2023-09-30T22:38:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.629+0000 7fade10b4700 1 -- 172.21.15.59:0/611544012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc09e930 msgr2=0x7faddc1c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.629+0000 7fade10b4700 1 --2- 172.21.15.59:0/611544012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc09e930 0x7faddc1c81a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00e9b0 tx=0x7fadcc00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.629+0000 7fade10b4700 1 -- 172.21.15.59:0/611544012 shutdown_connections 2023-09-30T22:38:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.629+0000 7fade10b4700 1 --2- 172.21.15.59:0/611544012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faddc09f650 0x7faddc1c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.629+0000 7fade10b4700 1 --2- 172.21.15.59:0/611544012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc09e930 0x7faddc1c81a0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.629+0000 7fade10b4700 1 --2- 172.21.15.59:0/611544012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc09f240 0x7faddc1c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.630+0000 7fade10b4700 1 -- 172.21.15.59:0/611544012 >> 172.21.15.59:0/611544012 conn(0x7faddc0a4210 msgr2=0x7faddc06c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.630+0000 7fade10b4700 1 -- 172.21.15.59:0/611544012 shutdown_connections 2023-09-30T22:38:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:45.630+0000 7fade10b4700 1 -- 172.21.15.59:0/611544012 wait complete. 2023-09-30T22:38:45.632 INFO:teuthology.orchestra.run.smithi059.stderr:listed 11 entries 2023-09-30T22:38:45.643 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi191.front.sepia.ceph.com... 2023-09-30T22:38:45.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:38:45.644 DEBUG:teuthology.orchestra.run.smithi191:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-09-30T22:38:45.696 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi191.stderr:ceph-fuse[112276]: fuse finished with error 0 and tester_r 0 2023-09-30T22:38:45.697 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:38:45.749 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2023-09-30T22:38:45.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:38:45.750 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T22:38:45.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:38:45.788 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2023-09-30T22:38:45.847 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T22:38:45.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:38:45.848 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:38:45.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:38:45.928 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2023-09-30T22:38:46.027 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-30T22:38:46.038 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:38:46.038 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:38:46.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.182+0000 7f0815b12700 1 Processor -- start 2023-09-30T22:38:46.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.182+0000 7f0815b12700 1 -- start start 2023-09-30T22:38:46.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.182+0000 7f0815b12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08100a0a30 0x7f08100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:46.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.182+0000 7f0815b12700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0810134170 0x7f081013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:46.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.182+0000 7f0815b12700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081009edd0 con 0x7f08100a1340 2023-09-30T22:38:46.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.182+0000 7f0815b12700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081009e1f0 con 0x7f0810134170 2023-09-30T22:38:46.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.182+0000 7f0815b12700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f081009dc50 con 0x7f08100a0a30 2023-09-30T22:38:46.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.182+0000 7f080f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08100a0a30 0x7f08100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:46.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.182+0000 7f080ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0810134170 0x7f081013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:46.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.182+0000 7f080f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08100a0a30 0x7f08100a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40254/0 (socket says 172.21.15.59:40254) 2023-09-30T22:38:46.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.182+0000 7f080f7fe700 1 -- 172.21.15.59:0/3772070750 learned_addr learned my addr 172.21.15.59:0/3772070750 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:46.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.183+0000 7f080f7fe700 1 -- 172.21.15.59:0/3772070750 >> v2:172.21.15.59:3300/0 conn(0x7f0810134170 msgr2=0x7f081013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:38:46.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.183+0000 7f080f7fe700 1 --2- 172.21.15.59:0/3772070750 >> v2:172.21.15.59:3300/0 conn(0x7f0810134170 0x7f081013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:46.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.183+0000 7f080f7fe700 1 -- 172.21.15.59:0/3772070750 >> v1:172.21.15.59:6789/0 conn(0x7f08100a1340 legacy=0x7f0810133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:46.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.183+0000 7f080f7fe700 1 -- 172.21.15.59:0/3772070750 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08100a1fe0 con 0x7f08100a0a30 2023-09-30T22:38:46.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.183+0000 7f080ffff700 1 --2- 172.21.15.59:0/3772070750 >> v2:172.21.15.59:3300/0 conn(0x7f0810134170 0x7f081013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:46.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.183+0000 7f080f7fe700 1 --2- 172.21.15.59:0/3772070750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08100a0a30 0x7f08100a0e00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f08000098f0 tx=0x7f0800009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a0c92e5f6ce84db server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:46.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.183+0000 7f080e7fc700 1 -- 172.21.15.59:0/3772070750 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800011830 con 0x7f08100a0a30 2023-09-30T22:38:46.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.183+0000 7f080e7fc700 1 -- 172.21.15.59:0/3772070750 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0800011990 con 0x7f08100a0a30 2023-09-30T22:38:46.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.183+0000 7f080e7fc700 1 -- 172.21.15.59:0/3772070750 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800011d20 con 0x7f08100a0a30 2023-09-30T22:38:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.184+0000 7f0815b12700 1 -- 172.21.15.59:0/3772070750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08100a0a30 msgr2=0x7f08100a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.184+0000 7f0815b12700 1 --2- 172.21.15.59:0/3772070750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08100a0a30 0x7f08100a0e00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f08000098f0 tx=0x7f0800009c00 comp rx=0 tx=0).stop 2023-09-30T22:38:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.184+0000 7f0815b12700 1 -- 172.21.15.59:0/3772070750 shutdown_connections 2023-09-30T22:38:46.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.184+0000 7f0815b12700 1 --2- 172.21.15.59:0/3772070750 >> v2:172.21.15.59:3300/0 conn(0x7f0810134170 0x7f081013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:46.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.184+0000 7f0815b12700 1 --2- 172.21.15.59:0/3772070750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08100a0a30 0x7f08100a0e00 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:46.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.184+0000 7f0815b12700 1 -- 172.21.15.59:0/3772070750 >> 172.21.15.59:0/3772070750 conn(0x7f08100a6550 msgr2=0x7f08100a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:38:46.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.184+0000 7f0815b12700 1 -- 172.21.15.59:0/3772070750 shutdown_connections 2023-09-30T22:38:46.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.184+0000 7f0815b12700 1 -- 172.21.15.59:0/3772070750 wait complete. 2023-09-30T22:38:46.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.185+0000 7f0815b12700 1 Processor -- start 2023-09-30T22:38:46.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.186+0000 7f0815b12700 1 -- start start 2023-09-30T22:38:46.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.186+0000 7f0815b12700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08100a0a30 0x7f0810122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:46.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.186+0000 7f0815b12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08100a1340 0x7f0810122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.186+0000 7f0815b12700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0810134170 0x7f0810123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:38:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.186+0000 7f0815b12700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0810124690 con 0x7f08100a0a30 2023-09-30T22:38:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.186+0000 7f0815b12700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08100a4f40 con 0x7f0810134170 2023-09-30T22:38:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.186+0000 7f0815b12700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0810126420 con 0x7f08100a1340 2023-09-30T22:38:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.186+0000 7f080f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08100a0a30 0x7f0810122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.186+0000 7f080f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08100a0a30 0x7f0810122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47536/0 (socket says 172.21.15.59:47536) 2023-09-30T22:38:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.186+0000 7f080effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08100a1340 0x7f0810122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:46.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.186+0000 7f080f7fe700 1 -- 172.21.15.59:0/3951707957 learned_addr learned my addr 172.21.15.59:0/3951707957 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-30T22:38:46.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.186+0000 7f080ffff700 1 --2- 172.21.15.59:0/3951707957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0810134170 0x7f0810123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:38:46.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.187+0000 7f080f7fe700 1 -- 172.21.15.59:0/3951707957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08100a1340 msgr2=0x7f0810122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:46.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.187+0000 7f080f7fe700 1 --2- 172.21.15.59:0/3951707957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08100a1340 0x7f0810122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:46.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.187+0000 7f080f7fe700 1 -- 172.21.15.59:0/3951707957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0810134170 msgr2=0x7f0810123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:38:46.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.187+0000 7f080f7fe700 1 --2- 172.21.15.59:0/3951707957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0810134170 0x7f0810123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:38:46.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.187+0000 7f080f7fe700 1 -- 172.21.15.59:0/3951707957 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0808009a70 con 0x7f08100a0a30 2023-09-30T22:38:46.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.187+0000 7f080effd700 1 --2- 172.21.15.59:0/3951707957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f08100a1340 0x7f0810122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:38:46.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.187+0000 7f080f7fe700 1 --2- 172.21.15.59:0/3951707957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08100a0a30 0x7f0810122900 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f0800000c00 tx=0x7f0800004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:38:46.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.187+0000 7f07f7fff700 1 -- 172.21.15.59:0/3951707957 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000043c0 con 0x7f08100a0a30 2023-09-30T22:38:46.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.187+0000 7f07f7fff700 1 -- 172.21.15.59:0/3951707957 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080001f070 con 0x7f08100a0a30 2023-09-30T22:38:46.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.187+0000 7f0815b12700 1 -- 172.21.15.59:0/3951707957 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0800009550 con 0x7f08100a0a30 2023-09-30T22:38:46.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.187+0000 7f07f7fff700 1 -- 172.21.15.59:0/3951707957 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000038c0 con 0x7f08100a0a30 2023-09-30T22:38:46.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.187+0000 7f0815b12700 1 -- 172.21.15.59:0/3951707957 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0810133420 con 0x7f08100a0a30 2023-09-30T22:38:46.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.188+0000 7f07f7fff700 1 -- 172.21.15.59:0/3951707957 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0800021030 con 0x7f08100a0a30 2023-09-30T22:38:46.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.188+0000 7f07f7fff700 1 -- 172.21.15.59:0/3951707957 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f08000408e0 con 0x7f08100a0a30 2023-09-30T22:38:46.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.188+0000 7f0815b12700 1 -- 172.21.15.59:0/3951707957 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08100a1d40 con 0x7f08100a0a30 2023-09-30T22:38:46.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-30T22:38:46.193+0000 7f07f7fff700 1 -- 172.21.15.59:0/3951707957 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0800015080 con 0x7f08100a0a30 2023-09-30T22:40:46.079 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-09-30T22:40:46.080 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:40:46.089 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-30T22:40:46.089 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:40:46.089 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:40:46.103 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:40:46.103 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-30T22:40:46.103 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-30T22:40:46.103 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:40:46.173 INFO:tasks.ceph.osd.0:Stopped 2023-09-30T22:40:46.173 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-30T22:40:46.174 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:40:46.254 INFO:tasks.ceph.osd.1:Stopped 2023-09-30T22:40:46.254 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-30T22:40:46.255 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:40:46.324 INFO:tasks.ceph.osd.2:Stopped 2023-09-30T22:40:46.324 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-30T22:40:46.324 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:40:46.395 INFO:tasks.ceph.osd.3:Stopped 2023-09-30T22:40:46.395 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-30T22:40:46.395 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-30T22:40:46.395 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:40:46.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:40:46.396 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-09-30T22:40:46.406 INFO:tasks.ceph.mgr.x:Stopped 2023-09-30T22:40:46.407 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-30T22:40:46.407 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-30T22:40:46.407 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:40:46.448 INFO:tasks.ceph.mon.a:Stopped 2023-09-30T22:40:46.449 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-30T22:40:46.449 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:40:46.503 INFO:tasks.ceph.mon.b:Stopped 2023-09-30T22:40:46.503 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-30T22:40:46.503 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:40:46.556 INFO:tasks.ceph.mon.c:Stopped 2023-09-30T22:40:46.557 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-30T22:40:46.557 DEBUG:teuthology.orchestra.run.smithi059:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | head -n 1 2023-09-30T22:40:46.646 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi059.front.sepia.ceph.com 2023-09-30T22:40:46.647 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-30T22:40:46.863 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi059.front.sepia.ceph.com 2023-09-30T22:40:46.863 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-30T22:40:46.989 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi059.front.sepia.ceph.com 2023-09-30T22:40:46.990 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-30T22:40:47.062 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi059.front.sepia.ceph.com 2023-09-30T22:40:47.063 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-09-30T22:40:47.142 INFO:tasks.ceph:Archiving mon data... 2023-09-30T22:40:47.143 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047/data/mon.a.tgz 2023-09-30T22:40:47.144 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2023-09-30T22:40:47.167 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.1sH6hK4HjX 2023-09-30T22:40:47.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.1sH6hK4HjX 2023-09-30T22:40:47.320 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.1sH6hK4HjX 2023-09-30T22:40:47.417 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.1sH6hK4HjX is 334KB 2023-09-30T22:40:47.514 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.1sH6hK4HjX 2023-09-30T22:40:47.536 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047/data/mon.b.tgz 2023-09-30T22:40:47.536 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2023-09-30T22:40:47.599 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.zDb4rMDFlb 2023-09-30T22:40:47.599 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.zDb4rMDFlb 2023-09-30T22:40:47.740 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.zDb4rMDFlb 2023-09-30T22:40:47.836 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.zDb4rMDFlb is 336KB 2023-09-30T22:40:47.933 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.zDb4rMDFlb 2023-09-30T22:40:47.956 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047/data/mon.c.tgz 2023-09-30T22:40:47.956 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2023-09-30T22:40:48.018 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.hkF1tyWkBV 2023-09-30T22:40:48.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.hkF1tyWkBV 2023-09-30T22:40:48.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.hkF1tyWkBV 2023-09-30T22:40:48.258 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.hkF1tyWkBV is 336KB 2023-09-30T22:40:48.333 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.hkF1tyWkBV 2023-09-30T22:40:48.355 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-30T22:40:48.356 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T22:40:48.397 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T22:40:48.433 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-30T22:40:48.433 DEBUG:teuthology.orchestra.run.smithi059:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T22:40:48.473 DEBUG:teuthology.orchestra.run.smithi191:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T22:40:48.507 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T22:40:48.507 INFO:teuthology.orchestra.run.smithi191.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T22:40:48.514 INFO:tasks.ceph:Archiving crash dumps... 2023-09-30T22:40:48.516 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047/remote/smithi059/crash 2023-09-30T22:40:48.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T22:40:48.594 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047/remote/smithi191/crash 2023-09-30T22:40:48.595 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T22:40:48.643 INFO:tasks.ceph:Compressing logs... 2023-09-30T22:40:48.643 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-30T22:40:48.646 DEBUG:teuthology.orchestra.run.smithi191:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-30T22:40:48.675 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112276.log 2023-09-30T22:40:48.679 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176459.log 2023-09-30T22:40:48.680 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186071.log 2023-09-30T22:40:48.681 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176629.log 2023-09-30T22:40:48.682 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.176459.log.gz 2023-09-30T22:40:48.682 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192524.log 2023-09-30T22:40:48.682 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.186071.log.gz 2023-09-30T22:40:48.682 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160591.log 2023-09-30T22:40:48.682 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176629.log.gz 2023-09-30T22:40:48.682 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125353.log 2023-09-30T22:40:48.682 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160591.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192524.log.gz 2023-09-30T22:40:48.683 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164145.log 2023-09-30T22:40:48.683 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.160591.log.gz 2023-09-30T22:40:48.684 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.0.112276.log: 96.6% -- replaced with /var/log/ceph/ceph-client.0.112276.log.gz 2023-09-30T22:40:48.685 INFO:teuthology.orchestra.run.smithi191.stderr: 2023-09-30T22:40:48.685 INFO:teuthology.orchestra.run.smithi191.stderr:real 0m0.019s 2023-09-30T22:40:48.685 INFO:teuthology.orchestra.run.smithi191.stderr:user 0m0.012s 2023-09-30T22:40:48.685 INFO:teuthology.orchestra.run.smithi191.stderr:sys 0m0.016s 2023-09-30T22:40:48.695 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171223.log /var/log/ceph/ceph-client.admin.125353.log: 2023-09-30T22:40:48.695 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125353.log.gz 2023-09-30T22:40:48.696 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139299.log 2023-09-30T22:40:48.696 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171223.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.164145.log.gz 2023-09-30T22:40:48.696 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138610.log 2023-09-30T22:40:48.696 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171223.log.gz 2023-09-30T22:40:48.696 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170204.log 2023-09-30T22:40:48.696 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139299.log.gz 2023-09-30T22:40:48.696 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153476.log 2023-09-30T22:40:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170204.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.138610.log.gz 2023-09-30T22:40:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152131.log 2023-09-30T22:40:48.697 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.170204.log.gz 2023-09-30T22:40:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127205.log 2023-09-30T22:40:48.697 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153476.log.gz 2023-09-30T22:40:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162774.log 2023-09-30T22:40:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127205.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152131.log.gz 2023-09-30T22:40:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147444.log 2023-09-30T22:40:48.698 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127205.log.gz 2023-09-30T22:40:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186561.log 2023-09-30T22:40:48.698 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162774.log.gz 2023-09-30T22:40:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170962.log 2023-09-30T22:40:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186561.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147444.log.gz 2023-09-30T22:40:48.699 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175087.log 2023-09-30T22:40:48.699 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186561.log.gz 2023-09-30T22:40:48.699 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177120.log 2023-09-30T22:40:48.699 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170962.log: /var/log/ceph/ceph-client.admin.175087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137557.log 2023-09-30T22:40:48.699 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170962.log.gz 2023-09-30T22:40:48.699 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175087.log.gz 2023-09-30T22:40:48.699 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163337.log 2023-09-30T22:40:48.699 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177120.log.gz 2023-09-30T22:40:48.700 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127565.log 2023-09-30T22:40:48.700 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137557.log.gz 2023-09-30T22:40:48.700 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174864.log 2023-09-30T22:40:48.700 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.163337.log.gz 2023-09-30T22:40:48.700 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143106.log 2023-09-30T22:40:48.700 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127565.log.gz 2023-09-30T22:40:48.700 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150000.log 2023-09-30T22:40:48.700 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174864.log.gz 2023-09-30T22:40:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136015.log 2023-09-30T22:40:48.701 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143106.log.gz 2023-09-30T22:40:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152765.log 2023-09-30T22:40:48.701 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150000.log.gz 2023-09-30T22:40:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152719.log 2023-09-30T22:40:48.701 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.136015.log.gz 2023-09-30T22:40:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169812.log 2023-09-30T22:40:48.701 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.152765.log.gz 2023-09-30T22:40:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158827.log 2023-09-30T22:40:48.702 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.152719.log.gz 2023-09-30T22:40:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143328.log 2023-09-30T22:40:48.702 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169812.log.gz 2023-09-30T22:40:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165440.log 2023-09-30T22:40:48.702 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.158827.log.gz 2023-09-30T22:40:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148815.log 2023-09-30T22:40:48.702 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143328.log.gz 2023-09-30T22:40:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186858.log 2023-09-30T22:40:48.703 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.165440.log.gz 2023-09-30T22:40:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159415.log 2023-09-30T22:40:48.703 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.148815.log.gz 2023-09-30T22:40:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173170.log 2023-09-30T22:40:48.703 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.186858.log.gz 2023-09-30T22:40:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147147.log 2023-09-30T22:40:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173170.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159415.log.gz 2023-09-30T22:40:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124351.log 2023-09-30T22:40:48.704 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.173170.log.gz 2023-09-30T22:40:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143498.log 2023-09-30T22:40:48.704 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147147.log.gz 2023-09-30T22:40:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181653.log 2023-09-30T22:40:48.704 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124351.log.gz 2023-09-30T22:40:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125598.log 2023-09-30T22:40:48.704 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143498.log.gz 2023-09-30T22:40:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154652.log 2023-09-30T22:40:48.705 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181653.log.gz 2023-09-30T22:40:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166454.log 2023-09-30T22:40:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154652.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125598.log.gz 2023-09-30T22:40:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172164.log 2023-09-30T22:40:48.705 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154652.log.gz 2023-09-30T22:40:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161963.log 2023-09-30T22:40:48.705 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166454.log.gz 2023-09-30T22:40:48.706 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142639.log 2023-09-30T22:40:48.760 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.172164.log.gz 2023-09-30T22:40:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137531.log 2023-09-30T22:40:48.761 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161963.log.gz 2023-09-30T22:40:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179007.log 2023-09-30T22:40:48.761 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.142639.log.gz 2023-09-30T22:40:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154947.log 2023-09-30T22:40:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179007.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137531.log.gz 2023-09-30T22:40:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155701.log 2023-09-30T22:40:48.761 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.179007.log.gz 2023-09-30T22:40:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136747.log 2023-09-30T22:40:48.762 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.154947.log.gz 2023-09-30T22:40:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154743.log 2023-09-30T22:40:48.762 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155701.log.gz 2023-09-30T22:40:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161206.log 2023-09-30T22:40:48.763 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136747.log.gz 2023-09-30T22:40:48.763 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118480.log 2023-09-30T22:40:48.763 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161206.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154743.log.gz 2023-09-30T22:40:48.763 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176263.log 2023-09-30T22:40:48.763 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161206.log.gz 2023-09-30T22:40:48.763 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.118480.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.111901.log 2023-09-30T22:40:48.763 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118480.log.gz 2023-09-30T22:40:48.764 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159952.log 2023-09-30T22:40:48.764 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176263.log.gz 2023-09-30T22:40:48.764 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.tmp-client.admin.111901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136433.log 2023-09-30T22:40:48.764 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.111901.log.gz 2023-09-30T22:40:48.764 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166284.log 2023-09-30T22:40:48.764 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159952.log.gz 2023-09-30T22:40:48.764 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169956.log 2023-09-30T22:40:48.765 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136433.log.gz/var/log/ceph/ceph-client.admin.166284.log: 2023-09-30T22:40:48.765 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189896.log 2023-09-30T22:40:48.765 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166284.log.gz 2023-09-30T22:40:48.765 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145040.log 2023-09-30T22:40:48.765 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.169956.log.gz 2023-09-30T22:40:48.765 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141659.log 2023-09-30T22:40:48.765 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145040.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.189896.log.gz 2023-09-30T22:40:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129723.log 2023-09-30T22:40:48.766 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.145040.log.gz 2023-09-30T22:40:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125647.log 2023-09-30T22:40:48.766 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141659.log.gz 2023-09-30T22:40:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.129723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165832.log 2023-09-30T22:40:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125647.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.129723.log.gz 2023-09-30T22:40:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154848.log 2023-09-30T22:40:48.767 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125647.log.gz 2023-09-30T22:40:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139691.log 2023-09-30T22:40:48.767 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.165832.log.gz 2023-09-30T22:40:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137021.log 2023-09-30T22:40:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139691.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154848.log.gz 2023-09-30T22:40:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162304.log 2023-09-30T22:40:48.768 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139691.log.gz 2023-09-30T22:40:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192060.log 2023-09-30T22:40:48.768 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137021.log.gz 2023-09-30T22:40:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139372.log 2023-09-30T22:40:48.768 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.162304.log.gz 2023-09-30T22:40:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122917.log 2023-09-30T22:40:48.768 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.192060.log.gz 2023-09-30T22:40:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128631.log 2023-09-30T22:40:48.769 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139372.log.gz 2023-09-30T22:40:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180575.log 2023-09-30T22:40:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128631.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122917.log.gz 2023-09-30T22:40:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180183.log 2023-09-30T22:40:48.770 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128631.log.gz 2023-09-30T22:40:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173562.log 2023-09-30T22:40:48.770 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180575.log.gz 2023-09-30T22:40:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188988.log 2023-09-30T22:40:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173562.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180183.log.gz 2023-09-30T22:40:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123714.log 2023-09-30T22:40:48.770 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173562.log.gz 2023-09-30T22:40:48.771 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147980.log 2023-09-30T22:40:48.771 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.188988.log.gz 2023-09-30T22:40:48.771 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175897.log 2023-09-30T22:40:48.771 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147980.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123714.log.gz 2023-09-30T22:40:48.771 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175944.log 2023-09-30T22:40:48.771 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147980.log.gz 2023-09-30T22:40:48.771 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153159.log 2023-09-30T22:40:48.771 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175897.log.gz 2023-09-30T22:40:48.772 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184111.log 2023-09-30T22:40:48.772 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175944.log.gz 2023-09-30T22:40:48.772 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194288.log 2023-09-30T22:40:48.772 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153159.log.gz 2023-09-30T22:40:48.772 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180941.log 2023-09-30T22:40:48.772 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.184111.log.gz 2023-09-30T22:40:48.772 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145383.log 2023-09-30T22:40:48.773 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180941.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.194288.log.gz 2023-09-30T22:40:48.773 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158018.log 2023-09-30T22:40:48.773 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180941.log.gz 2023-09-30T22:40:48.773 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167800.log 2023-09-30T22:40:48.773 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145383.log.gz 2023-09-30T22:40:48.773 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177705.log 2023-09-30T22:40:48.773 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167800.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158018.log.gz 2023-09-30T22:40:48.773 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189380.log 2023-09-30T22:40:48.774 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.167800.log.gz 2023-09-30T22:40:48.774 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172973.log 2023-09-30T22:40:48.774 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177705.log.gz 2023-09-30T22:40:48.774 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191936.log 2023-09-30T22:40:48.774 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172973.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.189380.log.gz 2023-09-30T22:40:48.774 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150588.log 2023-09-30T22:40:48.774 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172973.log.gz 2023-09-30T22:40:48.775 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192648.log 2023-09-30T22:40:48.775 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.191936.log.gz 2023-09-30T22:40:48.775 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156860.log 2023-09-30T22:40:48.775 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150588.log.gz 2023-09-30T22:40:48.775 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194695.log 2023-09-30T22:40:48.775 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192648.log.gz 2023-09-30T22:40:48.775 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139398.log 2023-09-30T22:40:48.775 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156860.log.gz 2023-09-30T22:40:48.776 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181137.log 2023-09-30T22:40:48.776 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.194695.log.gz 2023-09-30T22:40:48.776 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151589.log 2023-09-30T22:40:48.776 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139398.log.gz 2023-09-30T22:40:48.776 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145701.log 2023-09-30T22:40:48.776 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.181137.log.gz 2023-09-30T22:40:48.776 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182339.log 2023-09-30T22:40:48.777 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151589.log.gz 2023-09-30T22:40:48.777 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143619.log 2023-09-30T22:40:48.777 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182339.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145701.log.gz 2023-09-30T22:40:48.777 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171576.log 2023-09-30T22:40:48.777 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.182339.log.gz 2023-09-30T22:40:48.777 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182607.log 2023-09-30T22:40:48.777 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143619.log.gz 2023-09-30T22:40:48.777 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135453.log 2023-09-30T22:40:48.778 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182607.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171576.log.gz 2023-09-30T22:40:48.778 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194020.log 2023-09-30T22:40:48.778 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.182607.log.gz 2023-09-30T22:40:48.778 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158776.log 2023-09-30T22:40:48.778 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135453.log.gz 2023-09-30T22:40:48.778 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172778.log 2023-09-30T22:40:48.778 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158776.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.194020.log.gz 2023-09-30T22:40:48.779 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146071.log 2023-09-30T22:40:48.779 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.158776.log.gz 2023-09-30T22:40:48.779 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128294.log 2023-09-30T22:40:48.779 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.172778.log.gz 2023-09-30T22:40:48.779 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186832.log 2023-09-30T22:40:48.779 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128294.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146071.log.gz 2023-09-30T22:40:48.779 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127197.log 2023-09-30T22:40:48.779 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128294.log.gz 2023-09-30T22:40:48.780 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147641.log 2023-09-30T22:40:48.780 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186832.log.gz 2023-09-30T22:40:48.780 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136969.log 2023-09-30T22:40:48.780 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127197.log.gz 2023-09-30T22:40:48.780 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167238.log 2023-09-30T22:40:48.780 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147641.log.gz 2023-09-30T22:40:48.780 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178419.log 2023-09-30T22:40:48.780 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136969.log.gz 2023-09-30T22:40:48.781 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150340.log 2023-09-30T22:40:48.781 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178419.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167238.log.gz 2023-09-30T22:40:48.781 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170399.log 2023-09-30T22:40:48.781 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178419.log.gz 2023-09-30T22:40:48.781 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138733.log 2023-09-30T22:40:48.781 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.150340.log.gz 2023-09-30T22:40:48.781 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187446.log 2023-09-30T22:40:48.781 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138733.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170399.log.gz 2023-09-30T22:40:48.782 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184601.log 2023-09-30T22:40:48.782 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138733.log.gz 2023-09-30T22:40:48.782 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194891.log 2023-09-30T22:40:48.782 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187446.log.gz 2023-09-30T22:40:48.782 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194597.log 2023-09-30T22:40:48.782 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194891.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.184601.log.gz 2023-09-30T22:40:48.782 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140154.log 2023-09-30T22:40:48.782 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.194891.log.gz 2023-09-30T22:40:48.783 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179987.log 2023-09-30T22:40:48.783 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.194597.log.gz 2023-09-30T22:40:48.783 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176336.log 2023-09-30T22:40:48.783 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140154.log.gz 2023-09-30T22:40:48.783 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167528.log 2023-09-30T22:40:48.783 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176336.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.179987.log.gz 2023-09-30T22:40:48.783 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162773.log 2023-09-30T22:40:48.783 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176336.log.gz 2023-09-30T22:40:48.784 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146464.log 2023-09-30T22:40:48.784 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.167528.log.gz 2023-09-30T22:40:48.784 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161793.log 2023-09-30T22:40:48.784 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.162773.log.gz 2023-09-30T22:40:48.784 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164538.log 2023-09-30T22:40:48.784 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146464.log.gz 2023-09-30T22:40:48.784 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170348.log 2023-09-30T22:40:48.784 INFO:teuthology.orchestra.run.smithi059.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.161793.log.gz 2023-09-30T22:40:48.785 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141165.log 2023-09-30T22:40:48.785 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164538.log.gz 2023-09-30T22:40:48.785 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157278.log 2023-09-30T22:40:48.785 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170348.log.gz 2023-09-30T22:40:48.785 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184307.log 2023-09-30T22:40:48.785 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141165.log.gz 2023-09-30T22:40:48.785 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122817.log 2023-09-30T22:40:48.786 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184307.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157278.log.gz 2023-09-30T22:40:48.786 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147249.log 2023-09-30T22:40:48.786 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.184307.log.gz 2023-09-30T22:40:48.786 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142936.log 2023-09-30T22:40:48.786 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122817.log.gz 2023-09-30T22:40:48.786 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138930.log 2023-09-30T22:40:48.786 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142936.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147249.log.gz 2023-09-30T22:40:48.786 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139327.log 2023-09-30T22:40:48.787 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142936.log.gz 2023-09-30T22:40:48.787 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164264.log 2023-09-30T22:40:48.787 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.138930.log.gz 2023-09-30T22:40:48.787 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188890.log 2023-09-30T22:40:48.787 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164264.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.139327.log.gz 2023-09-30T22:40:48.787 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169002.log 2023-09-30T22:40:48.787 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164264.log.gz 2023-09-30T22:40:48.788 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185777.log 2023-09-30T22:40:48.788 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.188890.log.gz 2023-09-30T22:40:48.788 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186633.log 2023-09-30T22:40:48.788 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185777.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169002.log.gz 2023-09-30T22:40:48.788 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147052.log 2023-09-30T22:40:48.788 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.185777.log.gz 2023-09-30T22:40:48.789 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187812.log 2023-09-30T22:40:48.789 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186633.log.gz 2023-09-30T22:40:48.789 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176533.log 2023-09-30T22:40:48.789 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187812.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147052.log.gz 2023-09-30T22:40:48.789 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185189.log 2023-09-30T22:40:48.789 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187812.log.gz 2023-09-30T22:40:48.789 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124155.log 2023-09-30T22:40:48.790 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176533.log.gz 2023-09-30T22:40:48.790 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128680.log 2023-09-30T22:40:48.790 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124155.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185189.log.gz 2023-09-30T22:40:48.790 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148619.log 2023-09-30T22:40:48.790 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124155.log.gz 2023-09-30T22:40:48.790 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158091.log 2023-09-30T22:40:48.790 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.128680.log.gz 2023-09-30T22:40:48.790 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170627.log 2023-09-30T22:40:48.791 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158091.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148619.log.gz 2023-09-30T22:40:48.791 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187518.log 2023-09-30T22:40:48.791 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.158091.log.gz 2023-09-30T22:40:48.791 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144452.log 2023-09-30T22:40:48.791 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.170627.log.gz 2023-09-30T22:40:48.791 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168487.log 2023-09-30T22:40:48.791 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144452.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.187518.log.gz 2023-09-30T22:40:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124400.log 2023-09-30T22:40:48.792 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144452.log.gz 2023-09-30T22:40:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155240.log 2023-09-30T22:40:48.792 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168487.log.gz 2023-09-30T22:40:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190654.log 2023-09-30T22:40:48.792 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124400.log: /var/log/ceph/ceph-client.admin.155240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175871.log 2023-09-30T22:40:48.792 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.155240.log.gz 2023-09-30T22:40:48.792 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.124400.log.gz 2023-09-30T22:40:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180477.log 2023-09-30T22:40:48.793 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190654.log.gz 2023-09-30T22:40:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137020.log 2023-09-30T22:40:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180477.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.175871.log.gz 2023-09-30T22:40:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140720.log 2023-09-30T22:40:48.793 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.180477.log.gz 2023-09-30T22:40:48.793 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137727.log 2023-09-30T22:40:48.793 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.137020.log.gz 2023-09-30T22:40:48.794 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137335.log 2023-09-30T22:40:48.794 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137727.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140720.log.gz 2023-09-30T22:40:48.794 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157422.log 2023-09-30T22:40:48.794 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137727.log.gz 2023-09-30T22:40:48.794 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161964.log 2023-09-30T22:40:48.794 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.137335.log.gz 2023-09-30T22:40:48.794 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143302.log 2023-09-30T22:40:48.795 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161964.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157422.log.gz 2023-09-30T22:40:48.795 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157866.log 2023-09-30T22:40:48.795 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161964.log.gz 2023-09-30T22:40:48.795 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185947.log 2023-09-30T22:40:48.795 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143302.log.gz 2023-09-30T22:40:48.795 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155339.log 2023-09-30T22:40:48.795 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185947.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157866.log.gz 2023-09-30T22:40:48.796 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127358.log 2023-09-30T22:40:48.796 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.185947.log.gz 2023-09-30T22:40:48.796 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173876.log 2023-09-30T22:40:48.796 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.155339.log.gz 2023-09-30T22:40:48.796 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186930.log 2023-09-30T22:40:48.796 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127358.log.gz 2023-09-30T22:40:48.796 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194744.log 2023-09-30T22:40:48.796 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.173876.log.gz 2023-09-30T22:40:48.797 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188106.log 2023-09-30T22:40:48.797 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.186930.log.gz 2023-09-30T22:40:48.797 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182656.log 2023-09-30T22:40:48.797 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.194744.log.gz 2023-09-30T22:40:48.797 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181457.log 2023-09-30T22:40:48.797 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.188106.log.gz 2023-09-30T22:40:48.797 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159808.log 2023-09-30T22:40:48.797 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182656.log.gz 2023-09-30T22:40:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158287.log 2023-09-30T22:40:48.798 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181457.log.gz 2023-09-30T22:40:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163480.log 2023-09-30T22:40:48.798 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.159808.log.gz 2023-09-30T22:40:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153183.log 2023-09-30T22:40:48.798 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.158287.log.gz 2023-09-30T22:40:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127032.log 2023-09-30T22:40:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153183.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.163480.log.gz 2023-09-30T22:40:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181359.log 2023-09-30T22:40:48.799 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.153183.log.gz 2023-09-30T22:40:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136551.log 2023-09-30T22:40:48.799 INFO:teuthology.orchestra.run.smithi059.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.127032.log.gz 2023-09-30T22:40:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142688.log 2023-09-30T22:40:48.799 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8%/var/log/ceph/ceph-client.admin.136551.log: -- replaced with /var/log/ceph/ceph-client.admin.181359.log.gz 2023-09-30T22:40:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141316.log 2023-09-30T22:40:48.799 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136551.log.gz 2023-09-30T22:40:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124792.log 2023-09-30T22:40:48.800 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142688.log.gz 2023-09-30T22:40:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157396.log 2023-09-30T22:40:48.800 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141316.log.gz 2023-09-30T22:40:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168780.log 2023-09-30T22:40:48.800 INFO:teuthology.orchestra.run.smithi059.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.124792.log.gz 2023-09-30T22:40:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144478.log 2023-09-30T22:40:48.801 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157396.log.gz 2023-09-30T22:40:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165147.log 2023-09-30T22:40:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144478.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168780.log.gz 2023-09-30T22:40:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187642.log 2023-09-30T22:40:48.801 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144478.log.gz 2023-09-30T22:40:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175675.log 2023-09-30T22:40:48.801 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165147.log.gz 2023-09-30T22:40:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159560.log 2023-09-30T22:40:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175675.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187642.log.gz 2023-09-30T22:40:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154090.log 2023-09-30T22:40:48.802 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175675.log.gz 2023-09-30T22:40:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124231.log 2023-09-30T22:40:48.802 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.159560.log.gz 2023-09-30T22:40:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128324.log 2023-09-30T22:40:48.802 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154090.log.gz 2023-09-30T22:40:48.802 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177609.log 2023-09-30T22:40:48.803 INFO:teuthology.orchestra.run.smithi059.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.124231.log.gz 2023-09-30T22:40:48.803 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184503.log 2023-09-30T22:40:48.803 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128324.log.gz 2023-09-30T22:40:48.803 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140475.log 2023-09-30T22:40:48.803 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191838.log 2023-09-30T22:40:48.803 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.177609.log.gz 2023-09-30T22:40:48.804 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.184503.log.gz/var/log/ceph/ceph-client.admin.140475.log: 2023-09-30T22:40:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183621.log 2023-09-30T22:40:48.804 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140475.log.gz 2023-09-30T22:40:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124449.log 2023-09-30T22:40:48.804 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.191838.log.gz 2023-09-30T22:40:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140328.log 2023-09-30T22:40:48.805 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.183621.log.gz 2023-09-30T22:40:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162696.log 2023-09-30T22:40:48.805 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124449.log.gz 2023-09-30T22:40:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144674.log 2023-09-30T22:40:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162696.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140328.log.gz 2023-09-30T22:40:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129220.log 2023-09-30T22:40:48.806 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162696.log.gz 2023-09-30T22:40:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154360.log 2023-09-30T22:40:48.806 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.144674.log.gz 2023-09-30T22:40:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.129220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136577.log 2023-09-30T22:40:48.806 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129220.log.gz 2023-09-30T22:40:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185287.log 2023-09-30T22:40:48.807 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136577.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.154360.log.gz 2023-09-30T22:40:48.807 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145262.log 2023-09-30T22:40:48.807 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136577.log.gz 2023-09-30T22:40:48.807 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185287.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-09-30T22:40:48.807 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145262.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.185287.log.gz 2023-09-30T22:40:48.807 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142714.log 2023-09-30T22:40:48.807 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145262.log.gz 2023-09-30T22:40:48.808 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159168.log 2023-09-30T22:40:48.808 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166939.log 2023-09-30T22:40:48.808 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142714.log.gz 2023-09-30T22:40:48.808 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123838.log 2023-09-30T22:40:48.808 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159168.log.gz 2023-09-30T22:40:48.808 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159659.log 2023-09-30T22:40:48.809 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.166939.log.gz 2023-09-30T22:40:48.809 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162108.log 2023-09-30T22:40:48.809 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123838.log.gz 2023-09-30T22:40:48.809 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189308.log 2023-09-30T22:40:48.809 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7%/var/log/ceph/ceph-client.admin.162108.log: -- replaced with /var/log/ceph/ceph-client.admin.159659.log.gz 2023-09-30T22:40:48.809 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160736.log 2023-09-30T22:40:48.810 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.162108.log.gz 2023-09-30T22:40:48.810 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182045.log 2023-09-30T22:40:48.810 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.189308.log.gz 2023-09-30T22:40:48.810 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149499.log 2023-09-30T22:40:48.810 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160736.log.gz 2023-09-30T22:40:48.810 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141708.log 2023-09-30T22:40:48.811 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.182045.log.gz 2023-09-30T22:40:48.811 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145876.log 2023-09-30T22:40:48.811 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149499.log.gz 2023-09-30T22:40:48.811 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156087.log 2023-09-30T22:40:48.811 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141708.log.gz 2023-09-30T22:40:48.811 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142100.log 2023-09-30T22:40:48.812 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145876.log.gz 2023-09-30T22:40:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125451.log 2023-09-30T22:40:48.812 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.156087.log.gz 2023-09-30T22:40:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161716.log 2023-09-30T22:40:48.812 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.142100.log.gz 2023-09-30T22:40:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193602.log 2023-09-30T22:40:48.813 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125451.log.gz 2023-09-30T22:40:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162356.log 2023-09-30T22:40:48.813 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161716.log.gz 2023-09-30T22:40:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168679.log 2023-09-30T22:40:48.813 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.193602.log.gz 2023-09-30T22:40:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151785.log 2023-09-30T22:40:48.813 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.162356.log.gz 2023-09-30T22:40:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157788.log 2023-09-30T22:40:48.814 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168679.log.gz 2023-09-30T22:40:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140773.log 2023-09-30T22:40:48.814 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151785.log.gz 2023-09-30T22:40:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182935.log 2023-09-30T22:40:48.814 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157788.log.gz 2023-09-30T22:40:48.815 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193530.log 2023-09-30T22:40:48.815 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140773.log.gz 2023-09-30T22:40:48.815 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150784.log 2023-09-30T22:40:48.815 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.182935.log.gz 2023-09-30T22:40:48.815 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124890.log 2023-09-30T22:40:48.816 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.193530.log.gz 2023-09-30T22:40:48.816 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134787.log 2023-09-30T22:40:48.816 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124890.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.150784.log.gz 2023-09-30T22:40:48.816 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180869.log 2023-09-30T22:40:48.816 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124890.log.gz 2023-09-30T22:40:48.816 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.134787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139176.log 2023-09-30T22:40:48.817 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134787.log.gz 2023-09-30T22:40:48.817 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122572.log 2023-09-30T22:40:48.817 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139176.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.180869.log.gz 2023-09-30T22:40:48.817 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172700.log 2023-09-30T22:40:48.955 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139176.log.gz 2023-09-30T22:40:48.956 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154260.log 2023-09-30T22:40:48.956 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122572.log.gz 2023-09-30T22:40:48.956 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127029.log 2023-09-30T22:40:48.956 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172700.log.gz 2023-09-30T22:40:48.956 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144599.log 2023-09-30T22:40:48.956 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154260.log.gz 2023-09-30T22:40:48.957 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164460.log 2023-09-30T22:40:48.957 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.127029.log.gz 2023-09-30T22:40:48.957 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185457.log 2023-09-30T22:40:48.957 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144599.log.gz 2023-09-30T22:40:48.957 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179471.log 2023-09-30T22:40:48.957 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164460.log.gz 2023-09-30T22:40:48.957 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185457.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.185457.log.gz 2023-09-30T22:40:48.958 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135058.log 2023-09-30T22:40:48.958 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168219.log 2023-09-30T22:40:48.958 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.179471.log.gz 2023-09-30T22:40:48.958 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179595.log 2023-09-30T22:40:48.958 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.135058.log.gz 2023-09-30T22:40:48.958 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170427.log 2023-09-30T22:40:48.958 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168219.log: /var/log/ceph/ceph-client.admin.179595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148176.log 2023-09-30T22:40:48.958 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168219.log.gz 2023-09-30T22:40:48.959 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170427.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179595.log.gz 2023-09-30T22:40:48.959 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160394.log 2023-09-30T22:40:48.959 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.170427.log.gz 2023-09-30T22:40:48.959 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147418.log 2023-09-30T22:40:48.959 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148176.log: /var/log/ceph/ceph-client.admin.160394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160932.log 2023-09-30T22:40:48.959 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148176.log.gz 2023-09-30T22:40:48.959 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.160394.log.gz 2023-09-30T22:40:48.960 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164734.log 2023-09-30T22:40:48.960 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147418.log.gz 2023-09-30T22:40:48.960 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164878.log 2023-09-30T22:40:48.960 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160932.log: /var/log/ceph/ceph-client.admin.164734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122866.log 2023-09-30T22:40:48.960 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160932.log.gz 2023-09-30T22:40:48.960 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.164734.log.gz 2023-09-30T22:40:48.960 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142152.log 2023-09-30T22:40:48.961 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164878.log.gz 2023-09-30T22:40:48.961 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151124.log 2023-09-30T22:40:48.961 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122866.log.gz 2023-09-30T22:40:48.961 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172921.log 2023-09-30T22:40:48.961 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142152.log.gz 2023-09-30T22:40:48.961 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187322.log 2023-09-30T22:40:48.961 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151124.log.gz 2023-09-30T22:40:48.961 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140942.log 2023-09-30T22:40:48.962 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172921.log.gz 2023-09-30T22:40:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182535.log 2023-09-30T22:40:48.962 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187322.log.gz 2023-09-30T22:40:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149156.log 2023-09-30T22:40:48.962 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140942.log.gz 2023-09-30T22:40:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185261.log 2023-09-30T22:40:48.962 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.182535.log.gz 2023-09-30T22:40:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175649.log 2023-09-30T22:40:48.963 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149156.log.gz 2023-09-30T22:40:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169663.log 2023-09-30T22:40:48.963 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.185261.log.gz 2023-09-30T22:40:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143815.log 2023-09-30T22:40:48.963 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175649.log.gz 2023-09-30T22:40:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146216.log 2023-09-30T22:40:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170057.log 2023-09-30T22:40:48.964 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.169663.log.gz 2023-09-30T22:40:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146216.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143815.log.gz 2023-09-30T22:40:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188818.log 2023-09-30T22:40:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181947.log 2023-09-30T22:40:48.964 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146216.log.gz 2023-09-30T22:40:48.964 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.170057.log.gz 2023-09-30T22:40:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148568.log 2023-09-30T22:40:48.964 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188818.log.gz 2023-09-30T22:40:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162970.log 2023-09-30T22:40:48.965 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.181947.log.gz 2023-09-30T22:40:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152549.log 2023-09-30T22:40:48.965 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.148568.log.gz 2023-09-30T22:40:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183497.log 2023-09-30T22:40:48.965 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162970.log.gz 2023-09-30T22:40:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136824.log 2023-09-30T22:40:48.965 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152549.log: /var/log/ceph/ceph-client.admin.183497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156416.log 2023-09-30T22:40:48.966 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.152549.log.gz 2023-09-30T22:40:48.966 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.183497.log.gz 2023-09-30T22:40:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136824.log: /var/log/ceph/ceph-client.admin.157056.log 2023-09-30T22:40:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193406.log 2023-09-30T22:40:48.966 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.136824.log.gz 2023-09-30T22:40:48.966 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156416.log.gz 2023-09-30T22:40:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160395.log 2023-09-30T22:40:48.967 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157056.log.gz 2023-09-30T22:40:48.967 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125500.log 2023-09-30T22:40:48.967 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.193406.log.gz 2023-09-30T22:40:48.967 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146804.log 2023-09-30T22:40:48.967 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160395.log.gz 2023-09-30T22:40:48.967 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147392.log 2023-09-30T22:40:48.967 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136773.log 2023-09-30T22:40:48.967 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125500.log.gz 2023-09-30T22:40:48.968 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146804.log.gz 2023-09-30T22:40:48.968 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154751.log 2023-09-30T22:40:48.968 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147392.log.gz 2023-09-30T22:40:48.968 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182313.log 2023-09-30T22:40:48.968 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154751.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.136773.log.gz 2023-09-30T22:40:48.968 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178095.log 2023-09-30T22:40:48.968 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.154751.log.gz 2023-09-30T22:40:48.969 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150536.log 2023-09-30T22:40:48.969 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178095.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182313.log.gz 2023-09-30T22:40:48.969 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187224.log 2023-09-30T22:40:48.969 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150536.log: 87.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.178095.log.gz--verbose 2023-09-30T22:40:48.969 INFO:teuthology.orchestra.run.smithi059.stderr:-- /var/log/ceph/ceph-client.admin.178317.log 2023-09-30T22:40:48.969 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187224.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150536.log.gz 2023-09-30T22:40:48.970 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145971.log 2023-09-30T22:40:48.970 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.187224.log.gz 2023-09-30T22:40:48.970 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137607.log 2023-09-30T22:40:48.970 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128404.log 2023-09-30T22:40:48.970 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178317.log.gz 2023-09-30T22:40:48.970 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145971.log.gz 2023-09-30T22:40:48.970 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170400.log 2023-09-30T22:40:48.971 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.137607.log.gz/var/log/ceph/ceph-client.admin.128404.log: 2023-09-30T22:40:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148127.log 2023-09-30T22:40:48.971 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128404.log.gz 2023-09-30T22:40:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150954.log 2023-09-30T22:40:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148127.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170400.log.gz 2023-09-30T22:40:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169861.log 2023-09-30T22:40:48.971 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148127.log.gz 2023-09-30T22:40:48.972 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151712.log 2023-09-30T22:40:48.972 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150954.log.gz 2023-09-30T22:40:48.972 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177243.log 2023-09-30T22:40:48.972 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169861.log.gz 2023-09-30T22:40:48.972 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170570.log 2023-09-30T22:40:48.972 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151712.log.gz 2023-09-30T22:40:48.972 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162382.log 2023-09-30T22:40:48.972 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170570.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177243.log.gz 2023-09-30T22:40:48.973 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143031.log 2023-09-30T22:40:48.973 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162382.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170570.log.gz 2023-09-30T22:40:48.973 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183007.log 2023-09-30T22:40:48.973 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162382.log.gz 2023-09-30T22:40:48.973 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173949.log 2023-09-30T22:40:48.973 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.143031.log.gz 2023-09-30T22:40:48.973 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182705.log 2023-09-30T22:40:48.974 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183007.log: /var/log/ceph/ceph-client.admin.173949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135228.log 2023-09-30T22:40:48.974 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.183007.log.gz 2023-09-30T22:40:48.974 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182705.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173949.log.gz 2023-09-30T22:40:48.974 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142247.log 2023-09-30T22:40:48.974 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.182705.log.gz 2023-09-30T22:40:48.974 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139015.log 2023-09-30T22:40:48.974 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135228.log.gz 2023-09-30T22:40:48.975 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180281.log 2023-09-30T22:40:48.975 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125696.log 2023-09-30T22:40:48.975 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142247.log.gz 2023-09-30T22:40:48.975 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180281.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139015.log.gz 2023-09-30T22:40:48.975 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175505.log 2023-09-30T22:40:48.975 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180281.log.gz/var/log/ceph/ceph-client.admin.125696.log: 2023-09-30T22:40:48.975 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144207.log 2023-09-30T22:40:48.976 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.125696.log.gz 2023-09-30T22:40:48.976 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177021.log 2023-09-30T22:40:48.976 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175505.log: /var/log/ceph/ceph-client.admin.144207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179497.log 2023-09-30T22:40:48.976 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.175505.log.gz 2023-09-30T22:40:48.976 INFO:teuthology.orchestra.run.smithi059.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.144207.log.gz 2023-09-30T22:40:48.976 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174388.log 2023-09-30T22:40:48.976 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177021.log.gz 2023-09-30T22:40:48.976 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150095.log 2023-09-30T22:40:48.977 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179497.log.gz 2023-09-30T22:40:48.977 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127663.log 2023-09-30T22:40:48.977 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174388.log.gz 2023-09-30T22:40:48.977 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160958.log 2023-09-30T22:40:48.977 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150095.log: /var/log/ceph/ceph-client.admin.127663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173561.log 2023-09-30T22:40:48.977 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150095.log.gz 2023-09-30T22:40:48.977 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.127663.log.gz 2023-09-30T22:40:48.977 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193334.log 2023-09-30T22:40:48.978 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173561.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160958.log.gz 2023-09-30T22:40:48.978 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160004.log 2023-09-30T22:40:48.978 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173561.log.gz 2023-09-30T22:40:48.978 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146608.log 2023-09-30T22:40:48.978 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.193334.log.gz 2023-09-30T22:40:48.978 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141368.log 2023-09-30T22:40:48.978 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160004.log.gz 2023-09-30T22:40:48.979 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176237.log 2023-09-30T22:40:48.979 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146608.log: /var/log/ceph/ceph-client.admin.141368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146167.log 2023-09-30T22:40:48.979 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146608.log.gz 2023-09-30T22:40:48.979 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.141368.log.gz 2023-09-30T22:40:48.979 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146856.log 2023-09-30T22:40:48.979 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.176237.log.gz 2023-09-30T22:40:48.979 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160148.log 2023-09-30T22:40:48.979 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146167.log: /var/log/ceph/ceph-client.admin.146856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153672.log 2023-09-30T22:40:48.980 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146167.log.gz 2023-09-30T22:40:48.980 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146856.log.gz 2023-09-30T22:40:48.980 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150196.log 2023-09-30T22:40:48.980 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.160148.log.gz 2023-09-30T22:40:48.980 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158631.log 2023-09-30T22:40:48.980 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153672.log.gz 2023-09-30T22:40:48.980 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159756.log 2023-09-30T22:40:48.981 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.150196.log.gz 2023-09-30T22:40:48.981 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124988.log 2023-09-30T22:40:48.981 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159756.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158631.log.gz 2023-09-30T22:40:48.981 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178487.log 2023-09-30T22:40:48.981 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.159756.log.gz 2023-09-30T22:40:48.981 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192818.log 2023-09-30T22:40:48.981 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124988.log.gz 2023-09-30T22:40:48.982 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191668.log 2023-09-30T22:40:48.982 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192818.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178487.log.gz 2023-09-30T22:40:48.982 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168876.log 2023-09-30T22:40:48.982 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.192818.log.gz 2023-09-30T22:40:48.982 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163676.log 2023-09-30T22:40:48.982 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.191668.log.gz 2023-09-30T22:40:48.982 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139887.log 2023-09-30T22:40:48.983 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168876.log.gz 2023-09-30T22:40:48.983 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159220.log 2023-09-30T22:40:48.983 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163676.log.gz 2023-09-30T22:40:48.983 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150928.log 2023-09-30T22:40:48.983 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159220.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139887.log.gz 2023-09-30T22:40:48.983 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170626.log 2023-09-30T22:40:48.983 INFO:teuthology.orchestra.run.smithi059.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.159220.log.gz 2023-09-30T22:40:48.983 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175845.log 2023-09-30T22:40:48.984 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150928.log.gz 2023-09-30T22:40:48.984 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134938.log 2023-09-30T22:40:48.984 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170626.log.gz 2023-09-30T22:40:48.984 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137780.log 2023-09-30T22:40:48.984 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175845.log.gz 2023-09-30T22:40:48.984 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.134938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153379.log 2023-09-30T22:40:48.984 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137780.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.134938.log.gz 2023-09-30T22:40:48.985 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162159.log 2023-09-30T22:40:48.985 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137780.log.gz 2023-09-30T22:40:48.985 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185163.log 2023-09-30T22:40:48.985 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162159.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153379.log.gz 2023-09-30T22:40:48.985 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142518.log 2023-09-30T22:40:48.985 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.162159.log.gz 2023-09-30T22:40:48.985 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177512.log 2023-09-30T22:40:48.986 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.185163.log.gz 2023-09-30T22:40:48.986 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175453.log 2023-09-30T22:40:48.986 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142518.log.gz 2023-09-30T22:40:48.986 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169172.log 2023-09-30T22:40:48.986 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177512.log.gz 2023-09-30T22:40:48.986 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175257.log 2023-09-30T22:40:48.986 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175453.log.gz 2023-09-30T22:40:48.987 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192622.log 2023-09-30T22:40:48.987 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169172.log.gz 2023-09-30T22:40:48.987 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160592.log 2023-09-30T22:40:48.987 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175257.log.gz 2023-09-30T22:40:48.987 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178709.log 2023-09-30T22:40:48.987 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192622.log.gz 2023-09-30T22:40:48.987 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174668.log 2023-09-30T22:40:48.987 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160592.log.gz 2023-09-30T22:40:48.988 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138217.log 2023-09-30T22:40:48.988 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178709.log: /var/log/ceph/ceph-client.admin.174668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192746.log 2023-09-30T22:40:48.988 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.178709.log.gz 2023-09-30T22:40:48.988 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138217.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.174668.log.gz 2023-09-30T22:40:48.988 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186143.log 2023-09-30T22:40:48.988 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138217.log.gz 2023-09-30T22:40:48.988 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129122.log 2023-09-30T22:40:48.989 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.192746.log.gz 2023-09-30T22:40:48.989 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124596.log 2023-09-30T22:40:48.989 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.186143.log.gz 2023-09-30T22:40:48.989 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.129122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147784.log 2023-09-30T22:40:48.989 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129122.log.gz 2023-09-30T22:40:48.989 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161376.log 2023-09-30T22:40:48.989 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124596.log.gz 2023-09-30T22:40:48.989 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145289.log 2023-09-30T22:40:48.990 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.147784.log.gz 2023-09-30T22:40:48.990 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172386.log 2023-09-30T22:40:48.990 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145289.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161376.log.gz 2023-09-30T22:40:48.990 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-09-30T22:40:48.990 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.145289.log.gz 2023-09-30T22:40:48.990 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142492.log 2023-09-30T22:40:48.990 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172386.log.gz 2023-09-30T22:40:48.991 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183817.log 2023-09-30T22:40:48.991 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182909.log 2023-09-30T22:40:48.991 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183817.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.142492.log.gz 2023-09-30T22:40:48.991 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192230.log 2023-09-30T22:40:48.991 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.183817.log.gz 2023-09-30T22:40:48.991 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129440.log 2023-09-30T22:40:48.991 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157448.log 2023-09-30T22:40:48.992 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182909.log.gz 2023-09-30T22:40:48.992 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192230.log: /var/log/ceph/ceph-client.admin.129440.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192230.log.gz 2023-09-30T22:40:48.992 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180085.log 2023-09-30T22:40:48.992 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.129440.log.gz 2023-09-30T22:40:48.992 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163775.log 2023-09-30T22:40:48.992 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157448.log.gz 2023-09-30T22:40:48.992 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144506.log 2023-09-30T22:40:48.992 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180085.log: /var/log/ceph/ceph-client.admin.163775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192550.log 2023-09-30T22:40:48.993 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.180085.log.gz 2023-09-30T22:40:48.993 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144506.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163775.log.gz 2023-09-30T22:40:48.993 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172582.log 2023-09-30T22:40:48.993 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.144506.log.gz 2023-09-30T22:40:48.993 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157644.log 2023-09-30T22:40:48.993 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192550.log.gz 2023-09-30T22:40:48.993 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181163.log 2023-09-30T22:40:48.994 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172582.log: /var/log/ceph/ceph-client.admin.157644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139790.log 2023-09-30T22:40:48.994 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.172582.log.gz 2023-09-30T22:40:48.994 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157644.log.gz 2023-09-30T22:40:48.994 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155463.log 2023-09-30T22:40:48.994 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.181163.log.gz 2023-09-30T22:40:48.994 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161375.log 2023-09-30T22:40:48.994 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158828.log 2023-09-30T22:40:48.995 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139790.log.gz 2023-09-30T22:40:48.995 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.155463.log.gz 2023-09-30T22:40:48.995 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193628.log 2023-09-30T22:40:48.995 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161375.log.gz 2023-09-30T22:40:48.995 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158580.log 2023-09-30T22:40:48.995 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158828.log: /var/log/ceph/ceph-client.admin.193628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167826.log 2023-09-30T22:40:48.995 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.158828.log.gz 2023-09-30T22:40:48.996 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193628.log.gz 2023-09-30T22:40:48.996 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129318.log 2023-09-30T22:40:48.996 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167826.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.158580.log.gz 2023-09-30T22:40:48.996 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118185.log 2023-09-30T22:40:48.996 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167826.log.gz 2023-09-30T22:40:48.996 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.129318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123839.log 2023-09-30T22:40:48.996 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129318.log.gz 2023-09-30T22:40:48.996 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175701.log 2023-09-30T22:40:48.997 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.118185.log: /var/log/ceph/ceph-client.admin.123839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173288.log 2023-09-30T22:40:48.997 INFO:teuthology.orchestra.run.smithi059.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.118185.log.gz 2023-09-30T22:40:48.997 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175701.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123839.log.gz 2023-09-30T22:40:48.997 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138315.log 2023-09-30T22:40:48.997 INFO:teuthology.orchestra.run.smithi059.stderr: 95.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-09-30T22:40:48.997 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175701.log.gz 2023-09-30T22:40:48.997 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128354.log 2023-09-30T22:40:48.997 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173288.log.gz 2023-09-30T22:40:48.998 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147735.log 2023-09-30T22:40:48.998 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138315.log: /var/log/ceph/ceph-client.admin.128354.log: gzip 88.7%-5 -- replaced with /var/log/ceph/ceph-client.admin.138315.log.gz--verbose 2023-09-30T22:40:48.998 INFO:teuthology.orchestra.run.smithi059.stderr:-- /var/log/ceph/ceph-client.admin.152104.log 2023-09-30T22:40:48.998 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147735.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128354.log.gz 2023-09-30T22:40:48.998 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180745.log 2023-09-30T22:40:48.998 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147735.log.gz 2023-09-30T22:40:48.998 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152049.log 2023-09-30T22:40:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180745.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.152104.log.gz 2023-09-30T22:40:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191276.log 2023-09-30T22:40:48.999 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180745.log.gz 2023-09-30T22:40:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189086.log 2023-09-30T22:40:48.999 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152049.log.gz 2023-09-30T22:40:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166505.log 2023-09-30T22:40:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189086.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.191276.log.gz 2023-09-30T22:40:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138119.log 2023-09-30T22:40:49.000 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.189086.log.gz 2023-09-30T22:40:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167212.log 2023-09-30T22:40:49.000 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.166505.log.gz 2023-09-30T22:40:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165908.log 2023-09-30T22:40:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167212.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138119.log.gz 2023-09-30T22:40:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156442.log 2023-09-30T22:40:49.000 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.167212.log.gz 2023-09-30T22:40:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174788.log 2023-09-30T22:40:49.001 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165908.log.gz 2023-09-30T22:40:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161794.log 2023-09-30T22:40:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174788.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156442.log.gz 2023-09-30T22:40:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173706.log 2023-09-30T22:40:49.001 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174788.log.gz 2023-09-30T22:40:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170009.log 2023-09-30T22:40:49.001 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161794.log.gz 2023-09-30T22:40:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184797.log 2023-09-30T22:40:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170009.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.173706.log.gz 2023-09-30T22:40:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165909.log 2023-09-30T22:40:49.002 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170009.log.gz 2023-09-30T22:40:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184085.log 2023-09-30T22:40:49.002 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.184797.log.gz 2023-09-30T22:40:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152569.log 2023-09-30T22:40:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184085.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165909.log.gz 2023-09-30T22:40:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190582.log 2023-09-30T22:40:49.003 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.184085.log.gz 2023-09-30T22:40:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156024.log 2023-09-30T22:40:49.003 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.152569.log.gz 2023-09-30T22:40:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151543.log 2023-09-30T22:40:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156024.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190582.log.gz 2023-09-30T22:40:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177831.log 2023-09-30T22:40:49.004 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156024.log.gz 2023-09-30T22:40:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189870.log 2023-09-30T22:40:49.004 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.151543.log.gz 2023-09-30T22:40:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140158.log 2023-09-30T22:40:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189870.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177831.log.gz 2023-09-30T22:40:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188204.log 2023-09-30T22:40:49.004 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.189870.log.gz 2023-09-30T22:40:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165466.log 2023-09-30T22:40:49.005 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140158.log.gz 2023-09-30T22:40:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125037.log 2023-09-30T22:40:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165466.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.188204.log.gz 2023-09-30T22:40:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149548.log 2023-09-30T22:40:49.005 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.165466.log.gz 2023-09-30T22:40:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183301.log 2023-09-30T22:40:49.005 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.125037.log.gz 2023-09-30T22:40:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135326.log 2023-09-30T22:40:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183301.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149548.log.gz 2023-09-30T22:40:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177701.log 2023-09-30T22:40:49.006 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.183301.log.gz 2023-09-30T22:40:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166845.log 2023-09-30T22:40:49.006 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135326.log.gz 2023-09-30T22:40:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182241.log 2023-09-30T22:40:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166845.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177701.log.gz 2023-09-30T22:40:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153280.log 2023-09-30T22:40:49.007 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166845.log.gz 2023-09-30T22:40:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140671.log 2023-09-30T22:40:49.007 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.182241.log.gz 2023-09-30T22:40:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155302.log 2023-09-30T22:40:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140671.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153280.log.gz 2023-09-30T22:40:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127413.log 2023-09-30T22:40:49.008 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140671.log.gz 2023-09-30T22:40:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171916.log 2023-09-30T22:40:49.008 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.155302.log.gz 2023-09-30T22:40:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123840.log 2023-09-30T22:40:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171916.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127413.log.gz 2023-09-30T22:40:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152177.log 2023-09-30T22:40:49.009 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171916.log.gz 2023-09-30T22:40:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193700.log 2023-09-30T22:40:49.009 INFO:teuthology.orchestra.run.smithi059.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.123840.log.gz 2023-09-30T22:40:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128073.log 2023-09-30T22:40:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193700.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.152177.log.gz 2023-09-30T22:40:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137609.log 2023-09-30T22:40:49.009 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.193700.log.gz 2023-09-30T22:40:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168683.log 2023-09-30T22:40:49.010 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128073.log.gz 2023-09-30T22:40:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193040.log 2023-09-30T22:40:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168683.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137609.log.gz 2023-09-30T22:40:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184575.log 2023-09-30T22:40:49.010 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168683.log.gz 2023-09-30T22:40:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140916.log 2023-09-30T22:40:49.010 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.193040.log.gz 2023-09-30T22:40:49.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166846.log 2023-09-30T22:40:49.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140916.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.184575.log.gz 2023-09-30T22:40:49.011 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189798.log 2023-09-30T22:40:49.011 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140916.log.gz 2023-09-30T22:40:49.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148519.log 2023-09-30T22:40:49.011 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.166846.log.gz 2023-09-30T22:40:49.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124939.log 2023-09-30T22:40:49.012 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148519.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.189798.log.gz 2023-09-30T22:40:49.012 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179203.log 2023-09-30T22:40:49.012 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.148519.log.gz 2023-09-30T22:40:49.012 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163284.log 2023-09-30T22:40:49.012 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124939.log.gz 2023-09-30T22:40:49.012 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141957.log 2023-09-30T22:40:49.012 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179203.log.gz 2023-09-30T22:40:49.013 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177511.log 2023-09-30T22:40:49.013 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.163284.log.gz 2023-09-30T22:40:49.013 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187348.log 2023-09-30T22:40:49.013 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141957.log.gz 2023-09-30T22:40:49.013 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183424.log 2023-09-30T22:40:49.013 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187348.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.177511.log.gz 2023-09-30T22:40:49.013 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143276.log 2023-09-30T22:40:49.013 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187348.log.gz 2023-09-30T22:40:49.014 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191374.log 2023-09-30T22:40:49.014 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.183424.log.gz 2023-09-30T22:40:49.014 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127234.log 2023-09-30T22:40:49.014 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191374.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143276.log.gz 2023-09-30T22:40:49.014 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183620.log 2023-09-30T22:40:49.014 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.191374.log.gz 2023-09-30T22:40:49.014 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122523.log 2023-09-30T22:40:49.015 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127234.log.gz 2023-09-30T22:40:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175283.log 2023-09-30T22:40:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122523.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183620.log.gz 2023-09-30T22:40:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125402.log 2023-09-30T22:40:49.015 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122523.log.gz 2023-09-30T22:40:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150562.log 2023-09-30T22:40:49.015 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175283.log.gz 2023-09-30T22:40:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166283.log 2023-09-30T22:40:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150562.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.125402.log.gz 2023-09-30T22:40:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161792.log 2023-09-30T22:40:49.016 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150562.log.gz 2023-09-30T22:40:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194412.log 2023-09-30T22:40:49.016 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.166283.log.gz 2023-09-30T22:40:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129367.log 2023-09-30T22:40:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194412.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161792.log.gz 2023-09-30T22:40:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181235.log 2023-09-30T22:40:49.017 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.194412.log.gz 2023-09-30T22:40:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.129367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191766.log 2023-09-30T22:40:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159024.log 2023-09-30T22:40:49.017 INFO:teuthology.orchestra.run.smithi059.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.129367.log.gz 2023-09-30T22:40:49.017 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181235.log.gz 2023-09-30T22:40:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135277.log 2023-09-30T22:40:49.017 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191766.log.gz 2023-09-30T22:40:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190556.log 2023-09-30T22:40:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159024.log: /var/log/ceph/ceph-client.admin.135277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174174.log 87.4% 2023-09-30T22:40:49.018 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.159024.log.gz 2023-09-30T22:40:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190556.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.135277.log.gz 2023-09-30T22:40:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175748.log 2023-09-30T22:40:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174174.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190556.log.gz 2023-09-30T22:40:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172112.log 2023-09-30T22:40:49.018 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174174.log.gz 2023-09-30T22:40:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188596.log 2023-09-30T22:40:49.019 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175748.log.gz 2023-09-30T22:40:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177217.log 2023-09-30T22:40:49.019 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172112.log.gz 2023-09-30T22:40:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175162.log 2023-09-30T22:40:49.019 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.188596.log.gz 2023-09-30T22:40:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181627.log 2023-09-30T22:40:49.020 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.177217.log.gz 2023-09-30T22:40:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150487.log 2023-09-30T22:40:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181627.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.175162.log.gz 2023-09-30T22:40:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140279.log 2023-09-30T22:40:49.020 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.181627.log.gz 2023-09-30T22:40:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155123.log 2023-09-30T22:40:49.020 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.150487.log.gz 2023-09-30T22:40:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136434.log 2023-09-30T22:40:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155123.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140279.log.gz 2023-09-30T22:40:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143694.log 2023-09-30T22:40:49.021 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.155123.log.gz 2023-09-30T22:40:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168022.log 2023-09-30T22:40:49.021 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136434.log.gz 2023-09-30T22:40:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163310.log 2023-09-30T22:40:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143694.log: /var/log/ceph/ceph-client.admin.168022.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143694.log.gz 2023-09-30T22:40:49.022 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168461.log 2023-09-30T22:40:49.022 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.168022.log.gz 2023-09-30T22:40:49.022 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156274.log 2023-09-30T22:40:49.022 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163310.log.gz 2023-09-30T22:40:49.022 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123322.log 2023-09-30T22:40:49.022 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156274.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168461.log.gz 2023-09-30T22:40:49.022 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164512.log 2023-09-30T22:40:49.023 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156274.log.gz 2023-09-30T22:40:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123322.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-09-30T22:40:49.023 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123322.log.gz 2023-09-30T22:40:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188328.log 2023-09-30T22:40:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.3.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164512.log.gz 2023-09-30T22:40:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193432.log 2023-09-30T22:40:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135451.log 2023-09-30T22:40:49.024 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188328.log.gz 2023-09-30T22:40:49.024 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191864.log 2023-09-30T22:40:49.024 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193432.log.gz 2023-09-30T22:40:49.024 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145577.log 2023-09-30T22:40:49.024 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122454.log 2023-09-30T22:40:49.024 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.135451.log.gz 2023-09-30T22:40:49.024 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145577.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.191864.log.gz 2023-09-30T22:40:49.024 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144011.log 2023-09-30T22:40:49.025 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145577.log.gz 2023-09-30T22:40:49.025 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151461.log 2023-09-30T22:40:49.025 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122454.log.gz 2023-09-30T22:40:49.025 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144060.log 2023-09-30T22:40:49.025 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144011.log: /var/log/ceph/ceph-client.admin.151461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169786.log 2023-09-30T22:40:49.025 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144011.log.gz 2023-09-30T22:40:49.025 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144060.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151461.log.gz 2023-09-30T22:40:49.026 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153967.log 2023-09-30T22:40:49.026 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144060.log.gz 2023-09-30T22:40:49.026 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166105.log 2023-09-30T22:40:49.026 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169786.log.gz 2023-09-30T22:40:49.026 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122331.log 2023-09-30T22:40:49.026 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153967.log: /var/log/ceph/ceph-client.admin.166105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181555.log 2023-09-30T22:40:49.027 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153967.log.gz 2023-09-30T22:40:49.027 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122331.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.166105.log.gz 2023-09-30T22:40:49.027 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164290.log 2023-09-30T22:40:49.027 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122331.log.gz 2023-09-30T22:40:49.027 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155632.log 2023-09-30T22:40:49.028 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.181555.log.gz 2023-09-30T22:40:49.028 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191544.log 2023-09-30T22:40:49.028 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164290.log: /var/log/ceph/ceph-client.admin.155632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135648.log 2023-09-30T22:40:49.028 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164290.log.gz 2023-09-30T22:40:49.028 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155632.log.gz 2023-09-30T22:40:49.028 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191544.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.191544.log.gz/var/log/ceph/ceph-client.admin.135648.log: 2023-09-30T22:40:49.028 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135648.log.gz 2023-09-30T22:40:49.029 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170152.log 2023-09-30T22:40:49.029 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192354.log 2023-09-30T22:40:49.029 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139594.log 2023-09-30T22:40:49.029 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.170152.log.gz 2023-09-30T22:40:49.029 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135108.log 2023-09-30T22:40:49.029 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- 87.8%/var/log/ceph/ceph-client.admin.146755.log 2023-09-30T22:40:49.029 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.192354.log.gz 2023-09-30T22:40:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139594.log: /var/log/ceph/ceph-client.admin.135108.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139594.log.gz 2023-09-30T22:40:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128974.log 2023-09-30T22:40:49.030 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135108.log.gz 2023-09-30T22:40:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155070.log 2023-09-30T22:40:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146755.log: /var/log/ceph/ceph-client.admin.128974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186734.log 2023-09-30T22:40:49.030 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146755.log.gz 2023-09-30T22:40:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155070.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.128974.log.gz 2023-09-30T22:40:49.031 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146463.log 2023-09-30T22:40:49.031 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155070.log.gz 2023-09-30T22:40:49.031 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184208.log 2023-09-30T22:40:49.031 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.186734.log.gz 2023-09-30T22:40:49.031 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140184.log 2023-09-30T22:40:49.031 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.146463.log.gz 2023-09-30T22:40:49.031 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140354.log 2023-09-30T22:40:49.032 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.184208.log.gz 2023-09-30T22:40:49.032 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129269.log 2023-09-30T22:40:49.032 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140184.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140184.log.gz 2023-09-30T22:40:49.032 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150980.log 2023-09-30T22:40:49.032 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170839.log 2023-09-30T22:40:49.032 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4%/var/log/ceph/ceph-client.admin.129269.log: -- replaced with /var/log/ceph/ceph-client.admin.140354.log.gz 2023-09-30T22:40:49.032 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150980.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129269.log.gz 2023-09-30T22:40:49.032 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175312.log 2023-09-30T22:40:49.033 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150980.log.gz 2023-09-30T22:40:49.033 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175506.log 2023-09-30T22:40:49.033 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170839.log: /var/log/ceph/ceph-client.admin.175312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127592.log 2023-09-30T22:40:49.033 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170839.log.gz 2023-09-30T22:40:49.033 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175312.log.gz 2023-09-30T22:40:49.033 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148228.log 2023-09-30T22:40:49.034 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.175506.log.gz 2023-09-30T22:40:49.034 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180353.log 2023-09-30T22:40:49.034 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127592.log: /var/log/ceph/ceph-client.admin.148228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124233.log 2023-09-30T22:40:49.034 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127592.log.gz 2023-09-30T22:40:49.034 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148228.log.gz 2023-09-30T22:40:49.034 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158409.log 2023-09-30T22:40:49.034 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180353.log.gz 2023-09-30T22:40:49.035 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145187.log 2023-09-30T22:40:49.035 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124233.log.gz 2023-09-30T22:40:49.035 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141564.log 2023-09-30T22:40:49.035 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158409.log.gz 2023-09-30T22:40:49.035 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154456.log 2023-09-30T22:40:49.035 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145187.log.gz 2023-09-30T22:40:49.035 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168807.log 2023-09-30T22:40:49.036 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141564.log: /var/log/ceph/ceph-client.admin.154456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154339.log 2023-09-30T22:40:49.036 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.141564.log.gz 2023-09-30T22:40:49.036 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.154456.log.gz 2023-09-30T22:40:49.036 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152245.log 2023-09-30T22:40:49.036 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.168807.log.gz 2023-09-30T22:40:49.036 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137753.log 2023-09-30T22:40:49.036 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154339.log: /var/log/ceph/ceph-client.admin.152245.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-09-30T22:40:49.036 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154339.log.gz 2023-09-30T22:40:49.037 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152245.log.gz 2023-09-30T22:40:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129171.log 2023-09-30T22:40:49.037 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.137753.log.gz-5 2023-09-30T22:40:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:--verbose -- /var/log/ceph/ceph-client.admin.158410.log 2023-09-30T22:40:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.129171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193824.log 2023-09-30T22:40:49.037 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129171.log.gz 2023-09-30T22:40:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118529.log 2023-09-30T22:40:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193824.log: gzip -5 --verbose -- 88.2%/var/log/ceph/ceph-client.admin.194118.log 2023-09-30T22:40:49.038 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.158410.log.gz 2023-09-30T22:40:49.038 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193824.log.gz 2023-09-30T22:40:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.118529.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118529.log.gz 2023-09-30T22:40:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194118.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.194118.log.gz 2023-09-30T22:40:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128778.log 2023-09-30T22:40:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122969.log 2023-09-30T22:40:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156808.log 2023-09-30T22:40:49.039 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.128778.log.gz 2023-09-30T22:40:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122969.log: /var/log/ceph/ceph-client.admin.156808.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122969.log.gz 2023-09-30T22:40:49.039 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.156808.log.gz 2023-09-30T22:40:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124547.log 2023-09-30T22:40:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149804.log 2023-09-30T22:40:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192158.log 2023-09-30T22:40:49.039 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.124547.log.gz 2023-09-30T22:40:49.040 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193308.log 2023-09-30T22:40:49.040 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.149804.log.gz 2023-09-30T22:40:49.040 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186760.log 2023-09-30T22:40:49.040 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.192158.log.gz 2023-09-30T22:40:49.040 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147539.log 2023-09-30T22:40:49.040 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.193308.log.gz 2023-09-30T22:40:49.040 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136159.log 2023-09-30T22:40:49.040 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.186760.log.gz 2023-09-30T22:40:49.041 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139986.log 2023-09-30T22:40:49.041 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165101.log 2023-09-30T22:40:49.041 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.147539.log.gz 2023-09-30T22:40:49.041 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136159.log: /var/log/ceph/ceph-client.admin.139986.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136159.log.gz 2023-09-30T22:40:49.041 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181333.log 2023-09-30T22:40:49.041 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139986.log.gz 2023-09-30T22:40:49.041 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178027.log 2023-09-30T22:40:49.042 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165101.log.gz 2023-09-30T22:40:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165687.log 2023-09-30T22:40:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167041.log 2023-09-30T22:40:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178027.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181333.log.gz 2023-09-30T22:40:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165687.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.178027.log.gz 2023-09-30T22:40:49.042 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165687.log.gz 2023-09-30T22:40:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183816.log 2023-09-30T22:40:49.042 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167041.log.gz 2023-09-30T22:40:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165321.log 2023-09-30T22:40:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123371.log 2023-09-30T22:40:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183816.log: /var/log/ceph/ceph-client.admin.165321.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.183816.log.gz 2023-09-30T22:40:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138146.log 2023-09-30T22:40:49.043 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.165321.log.gz 2023-09-30T22:40:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169271.log 2023-09-30T22:40:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172580.log 2023-09-30T22:40:49.044 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123371.log.gz 2023-09-30T22:40:49.044 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.138146.log.gz 2023-09-30T22:40:49.044 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159586.log 2023-09-30T22:40:49.044 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172580.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169271.log.gz 2023-09-30T22:40:49.044 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186241.log 2023-09-30T22:40:49.044 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.172580.log.gz 2023-09-30T22:40:49.044 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169982.log 2023-09-30T22:40:49.044 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186241.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159586.log.gz 2023-09-30T22:40:49.045 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.186241.log.gz 2023-09-30T22:40:49.045 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169982.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169982.log.gz 2023-09-30T22:40:49.045 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168292.log 2023-09-30T22:40:49.045 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150366.log 2023-09-30T22:40:49.045 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153306.log 2023-09-30T22:40:49.045 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168292.log.gz 2023-09-30T22:40:49.045 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138022.log 2023-09-30T22:40:49.046 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150366.log.gz 2023-09-30T22:40:49.046 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153306.log: /var/log/ceph/ceph-client.admin.138022.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153306.log.gz 2023-09-30T22:40:49.046 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138022.log.gz 2023-09-30T22:40:49.046 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129073.log 2023-09-30T22:40:49.046 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175061.log 2023-09-30T22:40:49.046 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.129073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143227.log 2023-09-30T22:40:49.046 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.129073.log.gz 2023-09-30T22:40:49.047 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159023.log 2023-09-30T22:40:49.047 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161597.log 2023-09-30T22:40:49.047 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143227.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175061.log.gz 2023-09-30T22:40:49.047 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159023.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143227.log.gzgzip 2023-09-30T22:40:49.047 INFO:teuthology.orchestra.run.smithi059.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.191072.log 2023-09-30T22:40:49.047 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.159023.log.gz 2023-09-30T22:40:49.047 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181849.log 2023-09-30T22:40:49.047 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161597.log.gz 2023-09-30T22:40:49.048 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154064.log 2023-09-30T22:40:49.048 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191072.log.gz 2023-09-30T22:40:49.048 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181849.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181849.log.gz 2023-09-30T22:40:49.048 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154064.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154064.log.gz 2023-09-30T22:40:49.048 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124645.log 2023-09-30T22:40:49.048 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138511.log 2023-09-30T22:40:49.048 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147343.log 2023-09-30T22:40:49.049 INFO:teuthology.orchestra.run.smithi059.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.124645.log.gz 2023-09-30T22:40:49.049 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163506.log 2023-09-30T22:40:49.049 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147343.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138511.log.gz 2023-09-30T22:40:49.049 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180647.log 2023-09-30T22:40:49.049 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.147343.log.gz 2023-09-30T22:40:49.049 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163506.log: /var/log/ceph/ceph-client.admin.180647.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.163506.log.gz 2023-09-30T22:40:49.049 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.180647.log.gz 2023-09-30T22:40:49.050 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190680.log 2023-09-30T22:40:49.050 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156907.log 2023-09-30T22:40:49.050 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165518.log 2023-09-30T22:40:49.050 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156907.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190680.log.gz 2023-09-30T22:40:49.050 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165518.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.156907.log.gz 2023-09-30T22:40:49.050 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.165518.log.gz 2023-09-30T22:40:49.050 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151908.log 2023-09-30T22:40:49.050 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175356.log 2023-09-30T22:40:49.051 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148960.log 2023-09-30T22:40:49.051 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151908.log.gz 2023-09-30T22:40:49.051 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136236.log 2023-09-30T22:40:49.051 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.175356.log.gz 2023-09-30T22:40:49.051 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161128.log 2023-09-30T22:40:49.051 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147614.log 2023-09-30T22:40:49.051 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136236.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.148960.log.gz 2023-09-30T22:40:49.052 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161128.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136236.log.gz 2023-09-30T22:40:49.052 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153771.log 2023-09-30T22:40:49.052 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.161128.log.gz 2023-09-30T22:40:49.052 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190288.log 2023-09-30T22:40:49.052 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147614.log.gz 2023-09-30T22:40:49.052 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153771.log: /var/log/ceph/ceph-client.admin.190288.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153771.log.gz 2023-09-30T22:40:49.052 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190288.log.gz 2023-09-30T22:40:49.052 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178785.log 2023-09-30T22:40:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159978.log 2023-09-30T22:40:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147810.log 2023-09-30T22:40:49.053 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178785.log.gz 2023-09-30T22:40:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187544.log 2023-09-30T22:40:49.053 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159978.log.gz 2023-09-30T22:40:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147810.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147810.log.gz 2023-09-30T22:40:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187544.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.187544.log.gz 2023-09-30T22:40:49.054 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145066.log 2023-09-30T22:40:49.054 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151373.log 2023-09-30T22:40:49.054 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188132.log 2023-09-30T22:40:49.054 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151373.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145066.log.gz 2023-09-30T22:40:49.054 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136381.log 2023-09-30T22:40:49.054 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151373.log.gz 2023-09-30T22:40:49.054 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141063.log 2023-09-30T22:40:49.054 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.188132.log.gz 2023-09-30T22:40:49.055 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168435.log 2023-09-30T22:40:49.055 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136381.log.gz 2023-09-30T22:40:49.055 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169618.log 2023-09-30T22:40:49.055 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141063.log.gz 2023-09-30T22:40:49.055 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176139.log 2023-09-30T22:40:49.055 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168435.log: /var/log/ceph/ceph-client.admin.169618.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.168435.log.gz 2023-09-30T22:40:49.055 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169618.log.gz 2023-09-30T22:40:49.056 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176139.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176139.log.gz 2023-09-30T22:40:49.056 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169445.log 2023-09-30T22:40:49.056 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171971.log 2023-09-30T22:40:49.056 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192942.log 2023-09-30T22:40:49.056 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169445.log.gz 2023-09-30T22:40:49.056 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167331.log 2023-09-30T22:40:49.056 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171971.log.gz 2023-09-30T22:40:49.056 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192942.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.192942.log.gz 2023-09-30T22:40:49.057 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165322.log 2023-09-30T22:40:49.057 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.167331.log.gz 2023-09-30T22:40:49.057 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174098.log 2023-09-30T22:40:49.057 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173365.log 2023-09-30T22:40:49.057 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.165322.log.gz 2023-09-30T22:40:49.057 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174098.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174098.log.gz 2023-09-30T22:40:49.057 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173365.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.173365.log.gz 2023-09-30T22:40:49.057 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135034.log 2023-09-30T22:40:49.058 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194092.log 2023-09-30T22:40:49.058 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169064.log 2023-09-30T22:40:49.058 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194092.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.135034.log.gz 2023-09-30T22:40:49.058 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144870.log 2023-09-30T22:40:49.058 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.194092.log.gz 2023-09-30T22:40:49.058 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184209.log 2023-09-30T22:40:49.058 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169064.log.gz 2023-09-30T22:40:49.059 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122670.log 2023-09-30T22:40:49.059 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144870.log.gz 2023-09-30T22:40:49.059 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154482.log 2023-09-30T22:40:49.059 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.184209.log.gz 2023-09-30T22:40:49.059 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150732.log 2023-09-30T22:40:49.059 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122670.log.gz 2023-09-30T22:40:49.059 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182509.log 2023-09-30T22:40:49.059 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154482.log.gz 2023-09-30T22:40:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166104.log 2023-09-30T22:40:49.060 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150732.log.gz 2023-09-30T22:40:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182509.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182509.log.gz 2023-09-30T22:40:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166104.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.166104.log.gz 2023-09-30T22:40:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160835.log 2023-09-30T22:40:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180059.log 2023-09-30T22:40:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155044.log 2023-09-30T22:40:49.060 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160835.log.gz 2023-09-30T22:40:49.061 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151981.log 2023-09-30T22:40:49.061 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.180059.log.gz 2023-09-30T22:40:49.061 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129613.log 2023-09-30T22:40:49.061 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155044.log.gz 2023-09-30T22:40:49.061 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158240.log 2023-09-30T22:40:49.061 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.129613.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151981.log.gz 2023-09-30T22:40:49.061 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138566.log 2023-09-30T22:40:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158464.log 2023-09-30T22:40:49.062 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129613.log.gz 2023-09-30T22:40:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158240.log: /var/log/ceph/ceph-client.admin.138566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137139.log 2023-09-30T22:40:49.062 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158240.log.gz 2023-09-30T22:40:49.062 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138566.log.gz 2023-09-30T22:40:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136237.log 2023-09-30T22:40:49.062 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158464.log.gz 2023-09-30T22:40:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181725.log 2023-09-30T22:40:49.063 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137139.log.gz 2023-09-30T22:40:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142835.log 2023-09-30T22:40:49.063 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136237.log.gz 2023-09-30T22:40:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179961.log 2023-09-30T22:40:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181725.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181725.log.gz 2023-09-30T22:40:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142835.log: 88.7%/var/log/ceph/ceph-client.admin.179961.log: -- replaced with /var/log/ceph/ceph-client.admin.142835.log.gz 2023-09-30T22:40:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193210.log 2023-09-30T22:40:49.063 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179961.log.gz 2023-09-30T22:40:49.064 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157226.log 2023-09-30T22:40:49.064 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144991.log 2023-09-30T22:40:49.064 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157226.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193210.log.gz 2023-09-30T22:40:49.064 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157226.log.gz 2023-09-30T22:40:49.064 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144991.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.144991.log.gz 2023-09-30T22:40:49.064 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144256.log 2023-09-30T22:40:49.064 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146559.log 2023-09-30T22:40:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153361.log 2023-09-30T22:40:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146559.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144256.log.gz 2023-09-30T22:40:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144795.log 2023-09-30T22:40:49.065 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.146559.log.gz 2023-09-30T22:40:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160200.log 2023-09-30T22:40:49.065 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.153361.log.gz 2023-09-30T22:40:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118632.log 2023-09-30T22:40:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:gzip 89.6%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.144795.log.gz-- 2023-09-30T22:40:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156319.log 2023-09-30T22:40:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160200.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160200.log.gz 2023-09-30T22:40:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.118632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155535.log 2023-09-30T22:40:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 87.4%--verbose -- /var/log/ceph/ceph-client.admin.123567.log -- replaced with /var/log/ceph/ceph-client.admin.118632.log.gz 2023-09-30T22:40:49.066 INFO:teuthology.orchestra.run.smithi059.stderr: 2023-09-30T22:40:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156319.log: /var/log/ceph/ceph-client.admin.155535.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.156319.log.gz 2023-09-30T22:40:49.066 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155535.log.gz 2023-09-30T22:40:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173168.log 2023-09-30T22:40:49.067 INFO:teuthology.orchestra.run.smithi059.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.123567.log.gz 2023-09-30T22:40:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150758.log 2023-09-30T22:40:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186365.log 2023-09-30T22:40:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150758.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173168.log.gz 2023-09-30T22:40:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186365.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150758.log.gz 2023-09-30T22:40:49.067 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186365.log.gz 2023-09-30T22:40:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135845.log 2023-09-30T22:40:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193994.log 2023-09-30T22:40:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166506.log 2023-09-30T22:40:49.068 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135845.log.gz 2023-09-30T22:40:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168584.log 2023-09-30T22:40:49.068 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.193994.log.gz 2023-09-30T22:40:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.125745.log 2023-09-30T22:40:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166506.log: /var/log/ceph/ceph-client.admin.168584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137826.log 2023-09-30T22:40:49.068 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166506.log.gz 2023-09-30T22:40:49.069 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.168584.log.gz 2023-09-30T22:40:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179301.log 2023-09-30T22:40:49.069 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125745.log.gz 2023-09-30T22:40:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137826.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137826.log.gz 2023-09-30T22:40:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179301.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179301.log.gz 2023-09-30T22:40:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137949.log 2023-09-30T22:40:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156638.log 2023-09-30T22:40:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187152.log 2023-09-30T22:40:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156638.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137949.log.gz 2023-09-30T22:40:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164094.log 2023-09-30T22:40:49.070 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.156638.log.gz 2023-09-30T22:40:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153575.log 2023-09-30T22:40:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181261.log 2023-09-30T22:40:49.070 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187152.log.gz 2023-09-30T22:40:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164094.log: /var/log/ceph/ceph-client.admin.153575.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.164094.log.gz 2023-09-30T22:40:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161180.log 2023-09-30T22:40:49.071 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.153575.log.gz 2023-09-30T22:40:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123841.log 2023-09-30T22:40:49.071 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.181261.log.gz 2023-09-30T22:40:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177925.log 2023-09-30T22:40:49.071 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.161180.log.gz-5 2023-09-30T22:40:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:--verbose -- /var/log/ceph/ceph-client.admin.128876.log 2023-09-30T22:40:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123841.log: /var/log/ceph/ceph-client.admin.177925.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123841.log.gz 2023-09-30T22:40:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128925.log 2023-09-30T22:40:49.072 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177925.log.gz 2023-09-30T22:40:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179104.log 2023-09-30T22:40:49.072 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128876.log.gz 2023-09-30T22:40:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184699.log 2023-09-30T22:40:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174268.log 2023-09-30T22:40:49.072 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128925.log.gz 2023-09-30T22:40:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179104.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179104.log.gz 2023-09-30T22:40:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169446.log 2023-09-30T22:40:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185679.log 2023-09-30T22:40:49.073 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.184699.log.gz 2023-09-30T22:40:49.073 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.174268.log.gz 2023-09-30T22:40:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169446.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.169446.log.gz 2023-09-30T22:40:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185679.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.185679.log.gz 2023-09-30T22:40:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174741.log 2023-09-30T22:40:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188720.log 2023-09-30T22:40:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189602.log 2023-09-30T22:40:49.074 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174741.log.gz 2023-09-30T22:40:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124037.log 2023-09-30T22:40:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152597.log 2023-09-30T22:40:49.074 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188720.log.gz 2023-09-30T22:40:49.074 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.189602.log.gz 2023-09-30T22:40:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124037.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124037.log.gz 2023-09-30T22:40:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152597.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.152597.log.gz 2023-09-30T22:40:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179373.log 2023-09-30T22:40:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139987.log 2023-09-30T22:40:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171720.log 2023-09-30T22:40:49.075 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.179373.log.gz 2023-09-30T22:40:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175134.log 2023-09-30T22:40:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171720.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139987.log.gz 2023-09-30T22:40:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142296.log 2023-09-30T22:40:49.075 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171720.log.gz 2023-09-30T22:40:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177635.log 2023-09-30T22:40:49.076 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175134.log.gz 2023-09-30T22:40:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184379.log 2023-09-30T22:40:49.076 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142296.log.gz 2023-09-30T22:40:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135179.log 2023-09-30T22:40:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177635.log: /var/log/ceph/ceph-client.admin.184379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188524.log 2023-09-30T22:40:49.076 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177635.log.gz 2023-09-30T22:40:49.076 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.184379.log.gz 2023-09-30T22:40:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187616.log 2023-09-30T22:40:49.077 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.135179.log.gz 2023-09-30T22:40:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188524.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.188524.log.gz 2023-09-30T22:40:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187616.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.187616.log.gz 2023-09-30T22:40:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188302.log 2023-09-30T22:40:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129023.log 2023-09-30T22:40:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141855.log 2023-09-30T22:40:49.077 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.188302.log.gz 2023-09-30T22:40:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.129023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172776.log 2023-09-30T22:40:49.078 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129023.log.gz 2023-09-30T22:40:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123075.log 2023-09-30T22:40:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152692.log 2023-09-30T22:40:49.078 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141855.log.gz 2023-09-30T22:40:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172776.log: /var/log/ceph/ceph-client.admin.123075.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.172776.log.gz 2023-09-30T22:40:49.078 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123075.log.gz 2023-09-30T22:40:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152692.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152692.log.gz 2023-09-30T22:40:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124841.log 2023-09-30T22:40:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180255.log 2023-09-30T22:40:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177047.log 2023-09-30T22:40:49.079 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124841.log.gz 2023-09-30T22:40:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188792.log 2023-09-30T22:40:49.079 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180255.log.gz 2023-09-30T22:40:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177047.log: /var/log/ceph/ceph-client.admin.188792.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177047.log.gz 2023-09-30T22:40:49.080 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.188792.log.gz 2023-09-30T22:40:49.080 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158188.log 2023-09-30T22:40:49.080 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162552.log 2023-09-30T22:40:49.080 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150170.log 2023-09-30T22:40:49.080 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162552.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158188.log.gz 2023-09-30T22:40:49.080 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162552.log.gz 2023-09-30T22:40:49.080 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150170.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.150170.log.gz 2023-09-30T22:40:49.081 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178513.log 2023-09-30T22:40:49.081 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185973.log 2023-09-30T22:40:49.081 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129529.log 2023-09-30T22:40:49.081 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185973.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178513.log.gz 2023-09-30T22:40:49.081 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.185973.log.gz/var/log/ceph/ceph-client.admin.129529.log: 2023-09-30T22:40:49.081 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129529.log.gz 2023-09-30T22:40:49.081 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136041.log 2023-09-30T22:40:49.081 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156612.log 2023-09-30T22:40:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157277.log 2023-09-30T22:40:49.082 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136041.log.gz 2023-09-30T22:40:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162892.log 2023-09-30T22:40:49.082 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156612.log.gz 2023-09-30T22:40:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151935.log 2023-09-30T22:40:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157277.log: /var/log/ceph/ceph-client.admin.162892.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157277.log.gz 2023-09-30T22:40:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151935.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.162892.log.gz 2023-09-30T22:40:49.083 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167920.log 2023-09-30T22:40:49.083 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.151935.log.gz 2023-09-30T22:40:49.083 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145628.log 2023-09-30T22:40:49.083 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171354.log 2023-09-30T22:40:49.083 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167920.log: /var/log/ceph/ceph-client.admin.145628.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.167920.log.gz 2023-09-30T22:40:49.083 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171354.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145628.log.gz 2023-09-30T22:40:49.083 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171354.log.gz 2023-09-30T22:40:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190752.log 2023-09-30T22:40:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182019.log 2023-09-30T22:40:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158854.log 2023-09-30T22:40:49.084 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190752.log.gz 2023-09-30T22:40:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137923.log 2023-09-30T22:40:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155705.log 2023-09-30T22:40:49.084 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182019.log.gz 2023-09-30T22:40:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158854.log: /var/log/ceph/ceph-client.admin.137923.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158854.log.gz 2023-09-30T22:40:49.085 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158972.log 2023-09-30T22:40:49.085 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137923.log.gz 2023-09-30T22:40:49.085 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162500.log 2023-09-30T22:40:49.085 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155705.log.gz 2023-09-30T22:40:49.085 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139495.log 2023-09-30T22:40:49.085 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.158972.log.gz 2023-09-30T22:40:49.085 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162500.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.162500.log.gz 2023-09-30T22:40:49.086 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139495.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.139495.log.gz 2023-09-30T22:40:49.086 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148372.log 2023-09-30T22:40:49.086 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166028.log 2023-09-30T22:40:49.086 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173314.log 2023-09-30T22:40:49.086 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148372.log.gz 2023-09-30T22:40:49.086 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156711.log 2023-09-30T22:40:49.086 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.166028.log.gz--verbose 2023-09-30T22:40:49.086 INFO:teuthology.orchestra.run.smithi059.stderr:-- /var/log/ceph/ceph-client.admin.177921.log 2023-09-30T22:40:49.087 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173314.log: /var/log/ceph/ceph-client.admin.156711.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173314.log.gz 2023-09-30T22:40:49.087 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177921.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.156711.log.gz 2023-09-30T22:40:49.087 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177921.log.gz 2023-09-30T22:40:49.087 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173092.log 2023-09-30T22:40:49.087 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190876.log 2023-09-30T22:40:49.087 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128136.log 2023-09-30T22:40:49.087 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173092.log.gz 2023-09-30T22:40:49.087 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152300.log 2023-09-30T22:40:49.088 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139025.log 2023-09-30T22:40:49.088 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.190876.log.gz 2023-09-30T22:40:49.088 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128136.log: /var/log/ceph/ceph-client.admin.152300.log: gzip 88.3%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.128136.log.gz-- 2023-09-30T22:40:49.088 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163088.log 2023-09-30T22:40:49.088 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152300.log.gz 2023-09-30T22:40:49.088 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139025.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139025.log.gz 2023-09-30T22:40:49.088 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163088.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163088.log.gz 2023-09-30T22:40:49.089 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136014.log 2023-09-30T22:40:49.089 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192034.log 2023-09-30T22:40:49.089 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183105.log 2023-09-30T22:40:49.089 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192034.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136014.log.gz 2023-09-30T22:40:49.089 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193014.log 2023-09-30T22:40:49.089 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192034.log.gz 2023-09-30T22:40:49.089 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184405.log 2023-09-30T22:40:49.089 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183105.log.gz 2023-09-30T22:40:49.090 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165270.log 2023-09-30T22:40:49.090 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.193014.log.gz 2023-09-30T22:40:49.090 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184673.log 2023-09-30T22:40:49.090 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181065.log 2023-09-30T22:40:49.090 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.184405.log.gz 2023-09-30T22:40:49.090 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165270.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.165270.log.gz 2023-09-30T22:40:49.090 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189576.log 2023-09-30T22:40:49.091 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.184673.log.gz 2023-09-30T22:40:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191170.log 2023-09-30T22:40:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181065.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.181065.log.gz 2023-09-30T22:40:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189576.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189576.log.gz 2023-09-30T22:40:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191170.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191170.log.gz 2023-09-30T22:40:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139568.log 2023-09-30T22:40:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139764.log 2023-09-30T22:40:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183693.log 2023-09-30T22:40:49.092 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139568.log.gz 2023-09-30T22:40:49.092 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172384.log 2023-09-30T22:40:49.092 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3%/var/log/ceph/ceph-client.admin.183693.log: -- replaced with /var/log/ceph/ceph-client.admin.139764.log.gz 2023-09-30T22:40:49.092 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183425.log 2023-09-30T22:40:49.092 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.183693.log.gz 2023-09-30T22:40:49.092 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172384.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172384.log.gz 2023-09-30T22:40:49.092 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183425.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.183425.log.gz 2023-09-30T22:40:49.093 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180379.log 2023-09-30T22:40:49.093 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174592.log 2023-09-30T22:40:49.093 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180379.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180379.log.gz 2023-09-30T22:40:49.093 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174592.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174592.log.gz 2023-09-30T22:40:49.093 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194216.log 2023-09-30T22:40:49.093 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123124.log 2023-09-30T22:40:49.093 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126905.log 2023-09-30T22:40:49.094 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123124.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.194216.log.gz 2023-09-30T22:40:49.094 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155906.log 2023-09-30T22:40:49.094 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123124.log.gz 2023-09-30T22:40:49.094 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.126905.log: /var/log/ceph/ceph-client.admin.155906.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.126905.log.gz 2023-09-30T22:40:49.094 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.155906.log.gz 2023-09-30T22:40:49.094 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122262.log 2023-09-30T22:40:49.095 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194793.log 2023-09-30T22:40:49.095 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194190.log 2023-09-30T22:40:49.095 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122262.log.gz 2023-09-30T22:40:49.095 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155927.log 2023-09-30T22:40:49.095 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- 88.5%/var/log/ceph/ceph-client.admin.189406.log 2023-09-30T22:40:49.095 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.194793.log.gz 2023-09-30T22:40:49.095 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194190.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.194190.log.gz 2023-09-30T22:40:49.096 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128533.log 2023-09-30T22:40:49.096 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164341.log 2023-09-30T22:40:49.096 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.155927.log.gz/var/log/ceph/ceph-client.admin.189406.log: 2023-09-30T22:40:49.096 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189406.log.gz 2023-09-30T22:40:49.096 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139749.log 2023-09-30T22:40:49.096 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150392.log 2023-09-30T22:40:49.096 INFO:teuthology.orchestra.run.smithi059.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.128533.log.gz/var/log/ceph/ceph-client.admin.164341.log: 2023-09-30T22:40:49.097 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164341.log.gz 2023-09-30T22:40:49.097 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156664.log 2023-09-30T22:40:49.097 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 88.1%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.139749.log.gz/var/log/ceph/ceph-client.admin.118893.log 2023-09-30T22:40:49.097 INFO:teuthology.orchestra.run.smithi059.stderr: 2023-09-30T22:40:49.097 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150392.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150392.log.gz 2023-09-30T22:40:49.097 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190778.log 2023-09-30T22:40:49.097 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.118893.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.156664.log.gz 2023-09-30T22:40:49.097 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118893.log.gz 2023-09-30T22:40:49.098 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190778.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.190778.log.gz 2023-09-30T22:40:49.098 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-09-30T22:40:49.163 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178001.log 2023-09-30T22:40:49.164 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.178001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140746.log 2023-09-30T22:40:49.164 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178001.log.gz 2023-09-30T22:40:49.164 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189968.log 2023-09-30T22:40:49.164 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185751.log 2023-09-30T22:40:49.164 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140746.log.gz 2023-09-30T22:40:49.164 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172922.log 2023-09-30T22:40:49.164 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.189968.log.gz 2023-09-30T22:40:49.165 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185751.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.185751.log.gz 2023-09-30T22:40:49.165 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189282.log 2023-09-30T22:40:49.165 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.172922.log.gz 2023-09-30T22:40:49.165 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160042.log 2023-09-30T22:40:49.165 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167521.log 2023-09-30T22:40:49.165 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.189282.log.gz 2023-09-30T22:40:49.165 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160042.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160042.log.gz 2023-09-30T22:40:49.166 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167521.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167521.log.gz 2023-09-30T22:40:49.166 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160422.log 2023-09-30T22:40:49.166 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165910.log 2023-09-30T22:40:49.166 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160422.log: 88.0%/var/log/ceph/ceph-client.admin.165910.log: -- replaced with /var/log/ceph/ceph-client.admin.160422.log.gz 2023-09-30T22:40:49.166 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165910.log.gz 2023-09-30T22:40:49.166 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183915.log 2023-09-30T22:40:49.166 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127842.log 2023-09-30T22:40:49.167 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157691.log 2023-09-30T22:40:49.167 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.183915.log.gz 2023-09-30T22:40:49.167 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127842.log: /var/log/ceph/ceph-client.admin.157691.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.127842.log.gz 2023-09-30T22:40:49.167 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157691.log.gz 2023-09-30T22:40:49.167 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123224.log 2023-09-30T22:40:49.167 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160247.log 2023-09-30T22:40:49.167 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142443.log 2023-09-30T22:40:49.167 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123224.log.gz 2023-09-30T22:40:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141734.log 2023-09-30T22:40:49.168 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.160247.log.gz 2023-09-30T22:40:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145095.log 2023-09-30T22:40:49.168 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142443.log.gz 2023-09-30T22:40:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183327.log 2023-09-30T22:40:49.168 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141734.log.gz 2023-09-30T22:40:49.168 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145095.log: /var/log/ceph/ceph-client.admin.183327.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145095.log.gz 2023-09-30T22:40:49.168 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.183327.log.gz 2023-09-30T22:40:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146267.log 2023-09-30T22:40:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176851.log 2023-09-30T22:40:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167996.log 2023-09-30T22:40:49.169 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146267.log.gz 2023-09-30T22:40:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185483.log 2023-09-30T22:40:49.169 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176851.log.gz 2023-09-30T22:40:49.169 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167996.log: gzip 88.1%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.167996.log.gz/var/log/ceph/ceph-client.admin.179693.log 2023-09-30T22:40:49.170 INFO:teuthology.orchestra.run.smithi059.stderr: 2023-09-30T22:40:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143524.log 2023-09-30T22:40:49.170 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185483.log.gz 2023-09-30T22:40:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186463.log 2023-09-30T22:40:49.170 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.179693.log.gz 2023-09-30T22:40:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185555.log 2023-09-30T22:40:49.170 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143524.log.gz 2023-09-30T22:40:49.170 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186463.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.186463.log.gz 2023-09-30T22:40:49.171 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185555.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.185555.log.gz 2023-09-30T22:40:49.171 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163568.log 2023-09-30T22:40:49.171 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151657.log 2023-09-30T22:40:49.171 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161179.log 2023-09-30T22:40:49.171 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163568.log.gz 2023-09-30T22:40:49.171 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151657.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151657.log.gz 2023-09-30T22:40:49.171 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161179.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.161179.log.gz 2023-09-30T22:40:49.171 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153759.log 2023-09-30T22:40:49.172 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161324.log 2023-09-30T22:40:49.172 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181823.log 2023-09-30T22:40:49.172 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153759.log.gz/var/log/ceph/ceph-client.admin.161324.log: 2023-09-30T22:40:49.172 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161324.log.gz 2023-09-30T22:40:49.172 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181823.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.181823.log.gz 2023-09-30T22:40:49.172 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149574.log 2023-09-30T22:40:49.172 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184895.log 2023-09-30T22:40:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159050.log 2023-09-30T22:40:49.173 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149574.log.gz 2023-09-30T22:40:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184895.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.184895.log.gz 2023-09-30T22:40:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159050.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159050.log.gz 2023-09-30T22:40:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134738.log 2023-09-30T22:40:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173510.log 2023-09-30T22:40:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.134738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170766.log 2023-09-30T22:40:49.173 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173510.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.134738.log.gz 2023-09-30T22:40:49.174 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.173510.log.gz 2023-09-30T22:40:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170766.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170766.log.gz 2023-09-30T22:40:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123665.log 2023-09-30T22:40:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141538.log 2023-09-30T22:40:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123665.log: /var/log/ceph/ceph-client.admin.141538.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.123665.log.gz 2023-09-30T22:40:49.174 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141538.log.gz 2023-09-30T22:40:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186045.log 2023-09-30T22:40:49.174 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154286.log 2023-09-30T22:40:49.175 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153698.log 2023-09-30T22:40:49.175 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.186045.log.gz 2023-09-30T22:40:49.175 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154286.log: /var/log/ceph/ceph-client.admin.153698.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154286.log.gz 2023-09-30T22:40:49.175 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.153698.log.gz 2023-09-30T22:40:49.175 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167630.log 2023-09-30T22:40:49.175 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146072.log 2023-09-30T22:40:49.175 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159855.log 2023-09-30T22:40:49.176 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167630.log.gz 2023-09-30T22:40:49.176 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168111.log 2023-09-30T22:40:49.176 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146072.log.gz 2023-09-30T22:40:49.176 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169394.log 2023-09-30T22:40:49.176 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.159855.log.gz 2023-09-30T22:40:49.176 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178615.log 2023-09-30T22:40:49.176 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168111.log.gz 2023-09-30T22:40:49.176 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128827.log 2023-09-30T22:40:49.177 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.169394.log.gz 2023-09-30T22:40:49.177 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133720.log 2023-09-30T22:40:49.177 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178615.log.gz 2023-09-30T22:40:49.177 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128827.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.128827.log.gz 2023-09-30T22:40:49.177 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.133720.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.133720.log.gz 2023-09-30T22:40:49.177 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160396.log 2023-09-30T22:40:49.177 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171328.log 2023-09-30T22:40:49.177 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160396.log: /var/log/ceph/ceph-client.admin.171328.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.160396.log.gz 2023-09-30T22:40:49.178 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.171328.log.gz 2023-09-30T22:40:49.178 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164940.log 2023-09-30T22:40:49.178 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127033.log 2023-09-30T22:40:49.178 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157103.log 2023-09-30T22:40:49.178 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164940.log.gz 2023-09-30T22:40:49.178 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127033.log: /var/log/ceph/ceph-client.admin.157103.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.127033.log.gz 2023-09-30T22:40:49.179 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157103.log.gz 2023-09-30T22:40:49.179 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187838.log 2023-09-30T22:40:49.179 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165688.log 2023-09-30T22:40:49.179 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185091.log 2023-09-30T22:40:49.179 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.187838.log.gz 2023-09-30T22:40:49.179 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165688.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165688.log.gz 2023-09-30T22:40:49.179 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185091.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.185091.log.gz 2023-09-30T22:40:49.179 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169198.log 2023-09-30T22:40:49.180 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168388.log 2023-09-30T22:40:49.180 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144086.log 2023-09-30T22:40:49.180 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4%/var/log/ceph/ceph-client.admin.168388.log: -- replaced with /var/log/ceph/ceph-client.admin.169198.log.gz 2023-09-30T22:40:49.180 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.168388.log.gz 2023-09-30T22:40:49.180 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144086.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.144086.log.gz 2023-09-30T22:40:49.180 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158632.log 2023-09-30T22:40:49.180 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172385.log 2023-09-30T22:40:49.180 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158632.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158632.log.gz 2023-09-30T22:40:49.181 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172385.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.172385.log.gz 2023-09-30T22:40:49.181 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142910.log 2023-09-30T22:40:49.181 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136825.log 2023-09-30T22:40:49.181 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189184.log 2023-09-30T22:40:49.181 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.142910.log.gz 2023-09-30T22:40:49.181 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136825.log: /var/log/ceph/ceph-client.admin.189184.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136825.log.gz 2023-09-30T22:40:49.181 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189184.log.gz 2023-09-30T22:40:49.181 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183131.log 2023-09-30T22:40:49.182 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145432.log 2023-09-30T22:40:49.182 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151267.log 2023-09-30T22:40:49.182 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183131.log.gz 2023-09-30T22:40:49.182 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127768.log 2023-09-30T22:40:49.182 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.145432.log.gz 2023-09-30T22:40:49.182 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151267.log: /var/log/ceph/ceph-client.admin.127768.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151267.log.gz 2023-09-30T22:40:49.182 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127768.log.gz 2023-09-30T22:40:49.183 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171158.log 2023-09-30T22:40:49.183 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173763.log 2023-09-30T22:40:49.183 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177439.log 2023-09-30T22:40:49.183 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.171158.log.gz 2023-09-30T22:40:49.183 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173763.log: /var/log/ceph/ceph-client.admin.177439.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173763.log.gz 2023-09-30T22:40:49.183 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177439.log.gz 2023-09-30T22:40:49.183 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138759.log 2023-09-30T22:40:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152987.log 2023-09-30T22:40:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170544.log 2023-09-30T22:40:49.184 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.138759.log.gz 2023-09-30T22:40:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152987.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152987.log.gz 2023-09-30T22:40:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170544.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.170544.log.gz 2023-09-30T22:40:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176433.log 2023-09-30T22:40:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122768.log 2023-09-30T22:40:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146020.log 2023-09-30T22:40:49.185 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176433.log.gz 2023-09-30T22:40:49.185 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122768.log: 90.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-09-30T22:40:49.185 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146020.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122768.log.gz 2023-09-30T22:40:49.185 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186659.log 2023-09-30T22:40:49.185 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146020.log.gz 2023-09-30T22:40:49.185 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156468.log 2023-09-30T22:40:49.185 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182117.log 2023-09-30T22:40:49.185 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.186659.log.gz 2023-09-30T22:40:49.186 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138806.log 2023-09-30T22:40:49.186 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156468.log.gzgzip 2023-09-30T22:40:49.186 INFO:teuthology.orchestra.run.smithi059.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.127459.log 2023-09-30T22:40:49.186 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182117.log: /var/log/ceph/ceph-client.admin.138806.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182117.log.gz 2023-09-30T22:40:49.186 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127459.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138806.log.gz 2023-09-30T22:40:49.186 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127459.log.gz 2023-09-30T22:40:49.186 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147196.log 2023-09-30T22:40:49.186 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159612.log 2023-09-30T22:40:49.187 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137413.log 2023-09-30T22:40:49.187 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147196.log.gz 2023-09-30T22:40:49.187 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163950.log 2023-09-30T22:40:49.187 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159612.log.gz 2023-09-30T22:40:49.187 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142884.log 2023-09-30T22:40:49.187 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137413.log: /var/log/ceph/ceph-client.admin.163950.log: gzip -5 --verbose 87.5%-- /var/log/ceph/ceph-client.admin.179791.log -- replaced with /var/log/ceph/ceph-client.admin.137413.log.gz 2023-09-30T22:40:49.187 INFO:teuthology.orchestra.run.smithi059.stderr: 2023-09-30T22:40:49.187 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163950.log.gz 2023-09-30T22:40:49.188 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148620.log 2023-09-30T22:40:49.188 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.142884.log.gz 2023-09-30T22:40:49.188 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143668.log 2023-09-30T22:40:49.188 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179791.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179791.log.gz 2023-09-30T22:40:49.188 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183889.log 2023-09-30T22:40:49.188 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185385.log 2023-09-30T22:40:49.188 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9%/var/log/ceph/ceph-client.admin.143668.log: -- replaced with /var/log/ceph/ceph-client.admin.148620.log.gz 2023-09-30T22:40:49.189 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183889.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.143668.log.gz 2023-09-30T22:40:49.189 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125794.log 2023-09-30T22:40:49.189 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171611.log 2023-09-30T22:40:49.189 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.183889.log.gz 2023-09-30T22:40:49.189 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185385.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.185385.log.gz 2023-09-30T22:40:49.190 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125794.log: /var/log/ceph/ceph-client.admin.171611.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.125794.log.gz 2023-09-30T22:40:49.190 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138931.log 2023-09-30T22:40:49.190 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.171611.log.gz 2023-09-30T22:40:49.190 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152441.log 2023-09-30T22:40:49.190 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194499.log 2023-09-30T22:40:49.190 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152441.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138931.log.gz 2023-09-30T22:40:49.190 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.152441.log.gz 2023-09-30T22:40:49.191 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194499.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.194499.log.gz 2023-09-30T22:40:49.191 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180771.log 2023-09-30T22:40:49.191 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164852.log 2023-09-30T22:40:49.191 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172015.log 2023-09-30T22:40:49.191 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180771.log.gz 2023-09-30T22:40:49.191 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178393.log 2023-09-30T22:40:49.191 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164852.log.gz 2023-09-30T22:40:49.191 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195038.log 2023-09-30T22:40:49.192 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172015.log: /var/log/ceph/ceph-client.admin.178393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143890.log 2023-09-30T22:40:49.192 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172015.log.gz 2023-09-30T22:40:49.192 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.195038.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.178393.log.gz 2023-09-30T22:40:49.192 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.195038.log.gz 2023-09-30T22:40:49.192 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143890.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143890.log.gz 2023-09-30T22:40:49.192 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194940.log 2023-09-30T22:40:49.192 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141904.log 2023-09-30T22:40:49.193 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139157.log 2023-09-30T22:40:49.193 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141904.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194940.log.gz 2023-09-30T22:40:49.193 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127178.log 2023-09-30T22:40:49.193 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141904.log.gz 2023-09-30T22:40:49.193 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139157.log: /var/log/ceph/ceph-client.admin.127178.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139157.log.gz 2023-09-30T22:40:49.193 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127178.log.gz 2023-09-30T22:40:49.193 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140550.log 2023-09-30T22:40:49.193 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178981.log 2023-09-30T22:40:49.194 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182860.log 2023-09-30T22:40:49.194 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140550.log: /var/log/ceph/ceph-client.admin.178981.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140550.log.gz 2023-09-30T22:40:49.194 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.178981.log.gz 2023-09-30T22:40:49.194 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182860.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182860.log.gz 2023-09-30T22:40:49.194 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118785.log 2023-09-30T22:40:49.194 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143080.log 2023-09-30T22:40:49.194 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.118785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170203.log 2023-09-30T22:40:49.194 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118785.log.gz 2023-09-30T22:40:49.195 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171034.log 2023-09-30T22:40:49.195 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163114.log 2023-09-30T22:40:49.195 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2%/var/log/ceph/ceph-client.admin.170203.log: -- replaced with /var/log/ceph/ceph-client.admin.143080.log.gz 2023-09-30T22:40:49.195 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171034.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170203.log.gz 2023-09-30T22:40:49.195 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171034.log.gz 2023-09-30T22:40:49.195 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163114.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163114.log.gz 2023-09-30T22:40:49.195 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145654.log 2023-09-30T22:40:49.196 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162355.log 2023-09-30T22:40:49.196 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173902.log 2023-09-30T22:40:49.196 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.145654.log.gz 2023-09-30T22:40:49.196 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123985.log 2023-09-30T22:40:49.196 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.162355.log.gz 2023-09-30T22:40:49.196 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149600.log 2023-09-30T22:40:49.196 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173902.log.gz 2023-09-30T22:40:49.196 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140381.log 2023-09-30T22:40:49.197 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123985.log.gz 2023-09-30T22:40:49.197 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149600.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149600.log.gz 2023-09-30T22:40:49.197 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140381.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140381.log.gz 2023-09-30T22:40:49.197 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164093.log 2023-09-30T22:40:49.197 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165244.log 2023-09-30T22:40:49.197 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185653.log 2023-09-30T22:40:49.197 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164093.log: /var/log/ceph/ceph-client.admin.165244.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164093.log.gz 2023-09-30T22:40:49.198 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165244.log.gz 2023-09-30T22:40:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185653.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.185653.log.gz 2023-09-30T22:40:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137165.log 2023-09-30T22:40:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141463.log 2023-09-30T22:40:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152915.log 2023-09-30T22:40:49.198 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137165.log.gz 2023-09-30T22:40:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141463.log: /var/log/ceph/ceph-client.admin.152915.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141463.log.gz 2023-09-30T22:40:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170740.log 2023-09-30T22:40:49.199 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.152915.log.gz 2023-09-30T22:40:49.199 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177413.log 2023-09-30T22:40:49.199 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156273.log 2023-09-30T22:40:49.199 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170740.log: /var/log/ceph/ceph-client.admin.177413.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.170740.log.gz 2023-09-30T22:40:49.199 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156273.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.177413.log.gz 2023-09-30T22:40:49.199 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156273.log.gz 2023-09-30T22:40:49.199 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123616.log 2023-09-30T22:40:49.200 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141761.log 2023-09-30T22:40:49.200 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135132.log 2023-09-30T22:40:49.200 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123616.log.gz 2023-09-30T22:40:49.200 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167604.log 2023-09-30T22:40:49.200 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- 89.3%/var/log/ceph/ceph-client.admin.188400.log 2023-09-30T22:40:49.200 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.141761.log.gz 2023-09-30T22:40:49.200 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135132.log: /var/log/ceph/ceph-client.admin.167604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185359.log 2023-09-30T22:40:49.200 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.135132.log.gz 2023-09-30T22:40:49.201 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167604.log.gz 2023-09-30T22:40:49.201 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136629.log 2023-09-30T22:40:49.201 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.188400.log.gz 2023-09-30T22:40:49.201 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123518.log 2023-09-30T22:40:49.201 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185359.log.gz 2023-09-30T22:40:49.201 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171818.log 2023-09-30T22:40:49.201 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-09-30T22:40:49.202 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123518.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136629.log.gz 2023-09-30T22:40:49.202 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171818.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.123518.log.gz 2023-09-30T22:40:49.202 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171818.log.gz 2023-09-30T22:40:49.202 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189674.log 2023-09-30T22:40:49.202 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158661.log 2023-09-30T22:40:49.202 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143472.log 2023-09-30T22:40:49.202 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158661.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.189674.log.gz 2023-09-30T22:40:49.202 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158661.log.gz 2023-09-30T22:40:49.203 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143472.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.143472.log.gz 2023-09-30T22:40:49.203 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162160.log 2023-09-30T22:40:49.203 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153084.log 2023-09-30T22:40:49.203 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162160.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162160.log.gz 2023-09-30T22:40:49.203 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153084.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.153084.log.gz 2023-09-30T22:40:49.203 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166702.log 2023-09-30T22:40:49.203 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157814.log 2023-09-30T22:40:49.204 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166702.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166702.log.gz 2023-09-30T22:40:49.204 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157814.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157814.log.gz 2023-09-30T22:40:49.204 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189478.log 2023-09-30T22:40:49.204 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191046.log 2023-09-30T22:40:49.204 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189478.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.189478.log.gz 2023-09-30T22:40:49.204 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191046.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.191046.log.gz 2023-09-30T22:40:49.204 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146268.log 2023-09-30T22:40:49.205 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-09-30T22:40:49.205 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146268.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146268.log.gz 2023-09-30T22:40:49.205 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192844.log 2023-09-30T22:40:49.205 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169368.log 2023-09-30T22:40:49.205 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192844.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192844.log.gz 2023-09-30T22:40:49.205 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169368.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169368.log.gz 2023-09-30T22:40:49.205 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149012.log 2023-09-30T22:40:49.205 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-09-30T22:40:49.206 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149012.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149012.log.gz 2023-09-30T22:40:49.206 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136185.log 2023-09-30T22:40:49.206 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166106.log 2023-09-30T22:40:49.206 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136185.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.136185.log.gz 2023-09-30T22:40:49.206 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193504.log 2023-09-30T22:40:49.206 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166106.log.gz 2023-09-30T22:40:49.206 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192132.log 2023-09-30T22:40:49.207 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193504.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.193504.log.gz 2023-09-30T22:40:49.207 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172138.log 2023-09-30T22:40:49.207 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.192132.log.gz 2023-09-30T22:40:49.207 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152792.log 2023-09-30T22:40:49.207 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172138.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172138.log.gz 2023-09-30T22:40:49.207 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163532.log 2023-09-30T22:40:49.207 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152792.log.gz 2023-09-30T22:40:49.208 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194386.log 2023-09-30T22:40:49.208 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163532.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163532.log.gz 2023-09-30T22:40:49.208 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185875.log 2023-09-30T22:40:49.208 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.194386.log.gz 2023-09-30T22:40:49.208 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179177.log 2023-09-30T22:40:49.208 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185875.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.185875.log.gz 2023-09-30T22:40:49.208 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174937.log 2023-09-30T22:40:49.209 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.179177.log.gz 2023-09-30T22:40:49.209 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169224.log 2023-09-30T22:40:49.209 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174937.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.174937.log.gz 2023-09-30T22:40:49.209 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182411.log 2023-09-30T22:40:49.209 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169224.log.gz 2023-09-30T22:40:49.209 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126847.log 2023-09-30T22:40:49.209 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182411.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182411.log.gz 2023-09-30T22:40:49.209 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.126847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174694.log 2023-09-30T22:40:49.210 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.126847.log.gz 2023-09-30T22:40:49.210 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193896.log 2023-09-30T22:40:49.210 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174694.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174694.log.gz 2023-09-30T22:40:49.210 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178197.log 2023-09-30T22:40:49.210 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193896.log.gz 2023-09-30T22:40:49.210 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160174.log 2023-09-30T22:40:49.210 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178197.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178197.log.gz 2023-09-30T22:40:49.210 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123420.log 2023-09-30T22:40:49.211 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.160174.log.gz 2023-09-30T22:40:49.211 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156086.log 2023-09-30T22:40:49.211 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123420.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.123420.log.gz 2023-09-30T22:40:49.211 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174984.log 2023-09-30T22:40:49.211 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156086.log.gz 2023-09-30T22:40:49.211 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151073.log 2023-09-30T22:40:49.211 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174984.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174984.log.gz 2023-09-30T22:40:49.212 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151176.log 2023-09-30T22:40:49.212 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151073.log.gz 2023-09-30T22:40:49.212 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180843.log 2023-09-30T22:40:49.212 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151176.log: /var/log/ceph/ceph-client.admin.180843.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151176.log.gz 2023-09-30T22:40:49.212 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.180843.log.gz 2023-09-30T22:40:49.212 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123273.log 2023-09-30T22:40:49.212 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149378.log 2023-09-30T22:40:49.212 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123273.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123273.log.gz 2023-09-30T22:40:49.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145775.log 2023-09-30T22:40:49.213 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149378.log.gz 2023-09-30T22:40:49.213 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171231.log 2023-09-30T22:40:49.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145775.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145775.log.gz 2023-09-30T22:40:49.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163383.log 2023-09-30T22:40:49.213 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171231.log.gz 2023-09-30T22:40:49.213 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149974.log 2023-09-30T22:40:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163383.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.163383.log.gz 2023-09-30T22:40:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160788.log 2023-09-30T22:40:49.214 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149974.log.gz 2023-09-30T22:40:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167408.log 2023-09-30T22:40:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160788.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160788.log.gz 2023-09-30T22:40:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152888.log 2023-09-30T22:40:49.214 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167408.log.gz 2023-09-30T22:40:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164656.log 2023-09-30T22:40:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152888.log: /var/log/ceph/ceph-client.admin.164656.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.152888.log.gz 2023-09-30T22:40:49.215 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164656.log.gz 2023-09-30T22:40:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188622.log 2023-09-30T22:40:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188622.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.188622.log.gz 2023-09-30T22:40:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173705.log 2023-09-30T22:40:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173705.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173705.log.gz 2023-09-30T22:40:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178589.log 2023-09-30T22:40:49.216 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178589.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178589.log.gz 2023-09-30T22:40:49.216 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193922.log 2023-09-30T22:40:49.216 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193922.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193922.log.gz 2023-09-30T22:40:49.216 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155122.log 2023-09-30T22:40:49.216 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155122.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155122.log.gz 2023-09-30T22:40:49.216 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194646.log 2023-09-30T22:40:49.216 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194646.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.194646.log.gz 2023-09-30T22:40:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154678.log 2023-09-30T22:40:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154678.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.154678.log.gz 2023-09-30T22:40:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191570.log 2023-09-30T22:40:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191570.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.191570.log.gz 2023-09-30T22:40:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161598.log 2023-09-30T22:40:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161598.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161598.log.gz 2023-09-30T22:40:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171746.log 2023-09-30T22:40:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171746.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171746.log.gz 2023-09-30T22:40:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144701.log 2023-09-30T22:40:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144701.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144701.log.gz 2023-09-30T22:40:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146363.log 2023-09-30T22:40:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146363.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.146363.log.gz 2023-09-30T22:40:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190164.log 2023-09-30T22:40:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190164.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190164.log.gz 2023-09-30T22:40:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160623.log 2023-09-30T22:40:49.219 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160623.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160623.log.gz 2023-09-30T22:40:49.219 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190850.log 2023-09-30T22:40:49.219 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190850.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190850.log.gz 2023-09-30T22:40:49.219 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142348.log 2023-09-30T22:40:49.219 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142348.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142348.log.gz 2023-09-30T22:40:49.219 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171550.log 2023-09-30T22:40:49.219 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171550.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171550.log.gz 2023-09-30T22:40:49.219 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140969.log 2023-09-30T22:40:49.220 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140969.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140969.log.gz 2023-09-30T22:40:49.220 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191348.log 2023-09-30T22:40:49.220 INFO:teuthology.orchestra.run.smithi059.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-09-30T22:40:49.220 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149778.log 2023-09-30T22:40:49.220 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.191348.log.gz 2023-09-30T22:40:49.220 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154932.log 2023-09-30T22:40:49.220 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149778.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149778.log.gz 2023-09-30T22:40:49.221 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154932.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154932.log.gz 2023-09-30T22:40:49.221 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155891.log 2023-09-30T22:40:49.221 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179765.log 2023-09-30T22:40:49.221 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155891.log: /var/log/ceph/ceph-client.admin.179765.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.155891.log.gz 2023-09-30T22:40:49.221 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.179765.log.gz 2023-09-30T22:40:49.221 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139562.log 2023-09-30T22:40:49.221 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155534.log 2023-09-30T22:40:49.221 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139562.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139562.log.gz 2023-09-30T22:40:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155534.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155534.log.gz 2023-09-30T22:40:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192452.log 2023-09-30T22:40:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-09-30T22:40:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192452.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.192452.log.gz 2023-09-30T22:40:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151150.log 2023-09-30T22:40:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192720.log 2023-09-30T22:40:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151150.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151150.log.gz 2023-09-30T22:40:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148816.log 2023-09-30T22:40:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192720.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192720.log.gz 2023-09-30T22:40:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128729.log 2023-09-30T22:40:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148816.log: /var/log/ceph/ceph-client.admin.128729.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148816.log.gz 2023-09-30T22:40:49.223 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128729.log.gz 2023-09-30T22:40:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183229.log 2023-09-30T22:40:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166282.log 2023-09-30T22:40:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183229.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.183229.log.gz 2023-09-30T22:40:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181431.log 2023-09-30T22:40:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166282.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.166282.log.gz 2023-09-30T22:40:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154555.log 2023-09-30T22:40:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181431.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181431.log.gz 2023-09-30T22:40:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189112.log 2023-09-30T22:40:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154555.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.154555.log.gz 2023-09-30T22:40:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142051.log 2023-09-30T22:40:49.225 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189112.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189112.log.gz 2023-09-30T22:40:49.225 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142322.log 2023-09-30T22:40:49.225 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142051.log: /var/log/ceph/ceph-client.admin.142322.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142051.log.gz 2023-09-30T22:40:49.225 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142322.log.gz 2023-09-30T22:40:49.225 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148032.log 2023-09-30T22:40:49.225 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149404.log 2023-09-30T22:40:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148032.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148032.log.gz 2023-09-30T22:40:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127664.log 2023-09-30T22:40:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149404.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149404.log.gz 2023-09-30T22:40:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142126.log 2023-09-30T22:40:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127664.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127664.log.gz 2023-09-30T22:40:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193798.log 2023-09-30T22:40:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142126.log: 89.3%/var/log/ceph/ceph-client.admin.193798.log: -- replaced with /var/log/ceph/ceph-client.admin.142126.log.gz 2023-09-30T22:40:49.227 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.193798.log.gz 2023-09-30T22:40:49.227 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135649.log 2023-09-30T22:40:49.227 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140577.log 2023-09-30T22:40:49.227 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135649.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135649.log.gz 2023-09-30T22:40:49.227 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187028.log 2023-09-30T22:40:49.227 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140577.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140577.log.gz 2023-09-30T22:40:49.227 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187028.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187028.log.gz 2023-09-30T22:40:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150683.log 2023-09-30T22:40:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150683.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150683.log.gz 2023-09-30T22:40:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182143.log 2023-09-30T22:40:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182143.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.182143.log.gz 2023-09-30T22:40:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172974.log 2023-09-30T22:40:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172974.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172974.log.gz 2023-09-30T22:40:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171772.log 2023-09-30T22:40:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171772.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171772.log.gz 2023-09-30T22:40:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168094.log 2023-09-30T22:40:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168094.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.168094.log.gz 2023-09-30T22:40:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158214.log 2023-09-30T22:40:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158214.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.158214.log.gz 2023-09-30T22:40:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158436.log 2023-09-30T22:40:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158436.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158436.log.gz 2023-09-30T22:40:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184869.log 2023-09-30T22:40:49.230 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184869.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.184869.log.gz 2023-09-30T22:40:49.230 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190974.log 2023-09-30T22:40:49.230 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190974.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190974.log.gz 2023-09-30T22:40:49.230 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167136.log 2023-09-30T22:40:49.230 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167136.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.167136.log.gz 2023-09-30T22:40:49.230 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185581.log 2023-09-30T22:40:49.230 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185581.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185581.log.gz 2023-09-30T22:40:49.230 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194314.log 2023-09-30T22:40:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153868.log 2023-09-30T22:40:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194314.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194314.log.gz 2023-09-30T22:40:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153868.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153868.log.gz 2023-09-30T22:40:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148031.log 2023-09-30T22:40:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148031.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148031.log.gz 2023-09-30T22:40:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178811.log 2023-09-30T22:40:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178811.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178811.log.gz 2023-09-30T22:40:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135450.log 2023-09-30T22:40:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135450.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.135450.log.gz 2023-09-30T22:40:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144309.log 2023-09-30T22:40:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144309.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.144309.log.gz 2023-09-30T22:40:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186339.log 2023-09-30T22:40:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186339.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.186339.log.gz 2023-09-30T22:40:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148423.log 2023-09-30T22:40:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162918.log 2023-09-30T22:40:49.233 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148423.log.gz 2023-09-30T22:40:49.233 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162918.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.162918.log.gz 2023-09-30T22:40:49.233 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193138.log 2023-09-30T22:40:49.233 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193138.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193138.log.gz 2023-09-30T22:40:49.233 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147836.log 2023-09-30T22:40:49.233 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147836.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147836.log.gz 2023-09-30T22:40:49.233 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148911.log 2023-09-30T22:40:49.233 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148911.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.148911.log.gz 2023-09-30T22:40:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179667.log 2023-09-30T22:40:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179667.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.179667.log.gz 2023-09-30T22:40:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151516.log 2023-09-30T22:40:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151516.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151516.log.gz 2023-09-30T22:40:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176318.log 2023-09-30T22:40:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176318.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176318.log.gz 2023-09-30T22:40:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148424.log 2023-09-30T22:40:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148424.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148424.log.gz 2023-09-30T22:40:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144403.log 2023-09-30T22:40:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144403.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144403.log.gz 2023-09-30T22:40:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147931.log 2023-09-30T22:40:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147931.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.147931.log.gz 2023-09-30T22:40:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163948.log 2023-09-30T22:40:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163948.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.163948.log.gz 2023-09-30T22:40:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190458.log 2023-09-30T22:40:49.236 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190458.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190458.log.gz 2023-09-30T22:40:49.236 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192426.log 2023-09-30T22:40:49.236 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192426.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.192426.log.gz 2023-09-30T22:40:49.236 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184967.log 2023-09-30T22:40:49.236 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184967.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.184967.log.gz 2023-09-30T22:40:49.236 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127870.log 2023-09-30T22:40:49.267 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127870.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127870.log.gz 2023-09-30T22:40:49.267 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157030.log 2023-09-30T22:40:49.267 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157030.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157030.log.gz 2023-09-30T22:40:49.267 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186535.log 2023-09-30T22:40:49.267 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186535.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.186535.log.gz 2023-09-30T22:40:49.268 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173366.log 2023-09-30T22:40:49.268 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173366.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173366.log.gz 2023-09-30T22:40:49.268 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191250.log 2023-09-30T22:40:49.268 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191250.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.191250.log.gz 2023-09-30T22:40:49.268 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190360.log 2023-09-30T22:40:49.268 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193236.log 2023-09-30T22:40:49.268 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190360.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.190360.log.gz 2023-09-30T22:40:49.268 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193236.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193236.log.gz 2023-09-30T22:40:49.269 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-09-30T22:40:49.269 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180451.log 2023-09-30T22:40:49.269 INFO:teuthology.orchestra.run.smithi059.stderr: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-09-30T22:40:49.269 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173732.log 2023-09-30T22:40:49.269 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180451.log.gz 2023-09-30T22:40:49.269 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173732.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173732.log.gz 2023-09-30T22:40:49.269 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127384.log 2023-09-30T22:40:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127384.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.127384.log.gz 2023-09-30T22:40:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180549.log 2023-09-30T22:40:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180549.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.180549.log.gz 2023-09-30T22:40:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127795.log 2023-09-30T22:40:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127795.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127795.log.gz 2023-09-30T22:40:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153110.log 2023-09-30T22:40:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153110.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.153110.log.gz 2023-09-30T22:40:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141138.log 2023-09-30T22:40:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141138.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.141138.log.gz 2023-09-30T22:40:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134861.log 2023-09-30T22:40:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.134861.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.134861.log.gz 2023-09-30T22:40:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186169.log 2023-09-30T22:40:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186169.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.186169.log.gz 2023-09-30T22:40:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193112.log 2023-09-30T22:40:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193112.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193112.log.gz 2023-09-30T22:40:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144896.log 2023-09-30T22:40:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144896.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144896.log.gz 2023-09-30T22:40:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146830.log 2023-09-30T22:40:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146830.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.146830.log.gz 2023-09-30T22:40:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187910.log 2023-09-30T22:40:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187910.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.187910.log.gz 2023-09-30T22:40:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141112.log 2023-09-30T22:40:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141112.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141112.log.gz 2023-09-30T22:40:49.273 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148986.log 2023-09-30T22:40:49.273 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148986.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148986.log.gz 2023-09-30T22:40:49.273 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183719.log 2023-09-30T22:40:49.273 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183719.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.183719.log.gz 2023-09-30T22:40:49.273 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185849.log 2023-09-30T22:40:49.273 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185849.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.185849.log.gz 2023-09-30T22:40:49.274 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172504.log 2023-09-30T22:40:49.274 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172504.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172504.log.gz 2023-09-30T22:40:49.274 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147000.log 2023-09-30T22:40:49.274 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147000.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147000.log.gz 2023-09-30T22:40:49.274 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157004.log 2023-09-30T22:40:49.274 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125843.log 2023-09-30T22:40:49.274 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157004.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157004.log.gz 2023-09-30T22:40:49.275 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125843.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.125843.log.gz 2023-09-30T22:40:49.275 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163141.log 2023-09-30T22:40:49.275 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163141.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163141.log.gz 2023-09-30T22:40:49.275 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135819.log 2023-09-30T22:40:49.275 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135819.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.135819.log.gz 2023-09-30T22:40:49.275 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149948.log 2023-09-30T22:40:49.275 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149948.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149948.log.gz 2023-09-30T22:40:49.275 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187054.log 2023-09-30T22:40:49.276 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190092.log 2023-09-30T22:40:49.276 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187054.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187054.log.gz 2023-09-30T22:40:49.276 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190092.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190092.log.gz 2023-09-30T22:40:49.276 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135571.log 2023-09-30T22:40:49.276 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175552.log 2023-09-30T22:40:49.276 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135571.log.gz 2023-09-30T22:40:49.276 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175552.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.175552.log.gz 2023-09-30T22:40:49.277 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149182.log 2023-09-30T22:40:49.277 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135452.log 2023-09-30T22:40:49.277 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.149182.log.gz 2023-09-30T22:40:49.277 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135452.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135452.log.gz 2023-09-30T22:40:49.277 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165517.log 2023-09-30T22:40:49.277 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165517.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.165517.log.gz 2023-09-30T22:40:49.278 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187936.log 2023-09-30T22:40:49.278 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187936.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.187936.log.gz 2023-09-30T22:40:49.278 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153565.log 2023-09-30T22:40:49.278 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153565.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.153565.log.gz 2023-09-30T22:40:49.278 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167042.log 2023-09-30T22:40:49.278 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167042.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167042.log.gz 2023-09-30T22:40:49.278 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155266.log 2023-09-30T22:40:49.279 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155266.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155266.log.gz 2023-09-30T22:40:49.279 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137218.log 2023-09-30T22:40:49.279 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137218.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.137218.log.gz 2023-09-30T22:40:49.279 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162578.log 2023-09-30T22:40:49.279 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162578.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162578.log.gz 2023-09-30T22:40:49.279 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137412.log 2023-09-30T22:40:49.279 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137412.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137412.log.gz 2023-09-30T22:40:49.280 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176140.log 2023-09-30T22:40:49.280 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176140.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.176140.log.gz 2023-09-30T22:40:49.280 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159219.log 2023-09-30T22:40:49.280 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159219.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159219.log.gz 2023-09-30T22:40:49.280 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151853.log 2023-09-30T22:40:49.280 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151853.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151853.log.gz 2023-09-30T22:40:49.281 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148764.log 2023-09-30T22:40:49.281 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148764.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148764.log.gz 2023-09-30T22:40:49.281 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124743.log 2023-09-30T22:40:49.281 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124743.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124743.log.gz 2023-09-30T22:40:49.281 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153502.log 2023-09-30T22:40:49.281 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153502.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153502.log.gz 2023-09-30T22:40:49.281 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145485.log 2023-09-30T22:40:49.282 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145485.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145485.log.gz 2023-09-30T22:40:49.282 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138707.log 2023-09-30T22:40:49.282 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138707.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138707.log.gz 2023-09-30T22:40:49.282 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159416.log 2023-09-30T22:40:49.282 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159416.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.159416.log.gz 2023-09-30T22:40:49.282 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184993.log 2023-09-30T22:40:49.282 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122719.log 2023-09-30T22:40:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184993.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.184993.log.gz 2023-09-30T22:40:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122719.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122719.log.gz 2023-09-30T22:40:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145236.log 2023-09-30T22:40:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173975.log 2023-09-30T22:40:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145236.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145236.log.gz 2023-09-30T22:40:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173975.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.173975.log.gz 2023-09-30T22:40:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164146.log 2023-09-30T22:40:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179569.log 2023-09-30T22:40:49.284 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.164146.log.gz 2023-09-30T22:40:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179569.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179569.log.gz 2023-09-30T22:40:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149352.log 2023-09-30T22:40:49.284 INFO:teuthology.orchestra.run.smithi059.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-09-30T22:40:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171427.log 2023-09-30T22:40:49.284 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149352.log.gz 2023-09-30T22:40:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146951.log 2023-09-30T22:40:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171427.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171427.log.gz 2023-09-30T22:40:49.285 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146951.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146951.log.gz 2023-09-30T22:40:49.285 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159442.log 2023-09-30T22:40:49.285 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137217.log 2023-09-30T22:40:49.285 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159442.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159442.log.gz 2023-09-30T22:40:49.285 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172581.log 2023-09-30T22:40:49.285 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137217.log.gz 2023-09-30T22:40:49.285 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169760.log 2023-09-30T22:40:49.285 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172581.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172581.log.gz 2023-09-30T22:40:49.286 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169760.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169760.log.gz 2023-09-30T22:40:49.286 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157618.log 2023-09-30T22:40:49.286 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173484.log 2023-09-30T22:40:49.286 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157618.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157618.log.gz 2023-09-30T22:40:49.286 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173484.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173484.log.gz 2023-09-30T22:40:49.286 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163949.log 2023-09-30T22:40:49.286 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176067.log 2023-09-30T22:40:49.287 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163949.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.163949.log.gz 2023-09-30T22:40:49.287 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195087.log 2023-09-30T22:40:49.287 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.176067.log.gz 2023-09-30T22:40:49.287 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164708.log 2023-09-30T22:40:49.287 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.195087.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.195087.log.gz 2023-09-30T22:40:49.287 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164708.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164708.log.gz 2023-09-30T22:40:49.287 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157592.log 2023-09-30T22:40:49.287 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161520.log 2023-09-30T22:40:49.288 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157592.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.157592.log.gz 2023-09-30T22:40:49.288 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161520.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161520.log.gz 2023-09-30T22:40:49.288 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144844.log 2023-09-30T22:40:49.288 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173169.log 2023-09-30T22:40:49.288 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144844.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.144844.log.gz 2023-09-30T22:40:49.288 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173169.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.173169.log.gz 2023-09-30T22:40:49.288 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178121.log 2023-09-30T22:40:49.288 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174294.log 2023-09-30T22:40:49.289 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178121.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.178121.log.gz 2023-09-30T22:40:49.289 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174294.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.174294.log.gz 2023-09-30T22:40:49.289 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171030.log 2023-09-30T22:40:49.289 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178291.log 2023-09-30T22:40:49.289 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171030.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.171030.log.gz 2023-09-30T22:40:49.289 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178291.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.178291.log.gz 2023-09-30T22:40:49.289 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159782.log 2023-09-30T22:40:49.289 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122380.log 2023-09-30T22:40:49.290 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159782.log: 88.3%/var/log/ceph/ceph-client.admin.122380.log: -- replaced with /var/log/ceph/ceph-client.admin.159782.log.gz 2023-09-30T22:40:49.290 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167724.log 2023-09-30T22:40:49.290 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122380.log.gz 2023-09-30T22:40:49.290 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166650.log 2023-09-30T22:40:49.290 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167724.log: /var/log/ceph/ceph-client.admin.166650.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167724.log.gz 2023-09-30T22:40:49.290 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.166650.log.gz 2023-09-30T22:40:49.290 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161031.log 2023-09-30T22:40:49.291 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143720.log 2023-09-30T22:40:49.291 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161031.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161031.log.gz 2023-09-30T22:40:49.291 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143720.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143720.log.gz 2023-09-30T22:40:49.291 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183056.log 2023-09-30T22:40:49.291 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156834.log 2023-09-30T22:40:49.291 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183056.log: /var/log/ceph/ceph-client.admin.156834.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183056.log.gz 2023-09-30T22:40:49.291 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156834.log.gz 2023-09-30T22:40:49.291 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174072.log 2023-09-30T22:40:49.292 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149208.log 2023-09-30T22:40:49.292 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174072.log: 88.3%/var/log/ceph/ceph-client.admin.149208.log: -- replaced with /var/log/ceph/ceph-client.admin.174072.log.gz 2023-09-30T22:40:49.292 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.149208.log.gz 2023-09-30T22:40:49.292 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150144.log 2023-09-30T22:40:49.292 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125086.log 2023-09-30T22:40:49.292 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150144.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.150144.log.gz 2023-09-30T22:40:49.292 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125086.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125086.log.gz 2023-09-30T22:40:49.292 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176728.log 2023-09-30T22:40:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191472.log 2023-09-30T22:40:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176728.log: /var/log/ceph/ceph-client.admin.191472.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.176728.log.gz 2023-09-30T22:40:49.293 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.191472.log.gz 2023-09-30T22:40:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189014.log 2023-09-30T22:40:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168265.log 2023-09-30T22:40:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189014.log: /var/log/ceph/ceph-client.admin.168265.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.189014.log.gz 2023-09-30T22:40:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123026.log 2023-09-30T22:40:49.293 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168265.log.gz 2023-09-30T22:40:49.294 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125549.log 2023-09-30T22:40:49.294 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123026.log: /var/log/ceph/ceph-client.admin.125549.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123026.log.gz 2023-09-30T22:40:49.294 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125549.log.gz 2023-09-30T22:40:49.294 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178908.log 2023-09-30T22:40:49.294 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125304.log 2023-09-30T22:40:49.294 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178908.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.178908.log.gz 2023-09-30T22:40:49.294 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125304.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125304.log.gz 2023-09-30T22:40:49.294 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123175.log 2023-09-30T22:40:49.295 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163728.log 2023-09-30T22:40:49.295 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123175.log: /var/log/ceph/ceph-client.admin.163728.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123175.log.gz 2023-09-30T22:40:49.295 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163728.log.gz 2023-09-30T22:40:49.295 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179889.log 2023-09-30T22:40:49.295 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157495.log 2023-09-30T22:40:49.295 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179889.log: /var/log/ceph/ceph-client.admin.157495.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179889.log.gz 2023-09-30T22:40:49.295 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157495.log.gz 2023-09-30T22:40:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190386.log 2023-09-30T22:40:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189994.log 2023-09-30T22:40:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190386.log: /var/log/ceph/ceph-client.admin.189994.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.190386.log.gz 2023-09-30T22:40:49.296 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.189994.log.gz 2023-09-30T22:40:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146412.log 2023-09-30T22:40:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166310.log 2023-09-30T22:40:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146412.log: /var/log/ceph/ceph-client.admin.166310.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146412.log.gz 2023-09-30T22:40:49.296 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.166310.log.gz 2023-09-30T22:40:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186956.log 2023-09-30T22:40:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188426.log 2023-09-30T22:40:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186956.log: /var/log/ceph/ceph-client.admin.188426.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.186956.log.gz 2023-09-30T22:40:49.297 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188426.log.gz 2023-09-30T22:40:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181921.log 2023-09-30T22:40:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162551.log 2023-09-30T22:40:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181921.log: /var/log/ceph/ceph-client.admin.162551.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.181921.log.gz 2023-09-30T22:40:49.297 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162551.log.gz 2023-09-30T22:40:49.298 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144282.log 2023-09-30T22:40:49.298 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136355.log 2023-09-30T22:40:49.298 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144282.log: /var/log/ceph/ceph-client.admin.136355.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144282.log.gz 2023-09-30T22:40:49.298 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136355.log.gz 2023-09-30T22:40:49.298 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156123.log 2023-09-30T22:40:49.298 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183523.log 2023-09-30T22:40:49.298 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156123.log: 88.2%/var/log/ceph/ceph-client.admin.183523.log: -- replaced with /var/log/ceph/ceph-client.admin.156123.log.gz 2023-09-30T22:40:49.299 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183523.log.gz 2023-09-30T22:40:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178909.log 2023-09-30T22:40:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176486.log 2023-09-30T22:40:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178909.log: /var/log/ceph/ceph-client.admin.176486.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.178909.log.gz 2023-09-30T22:40:49.299 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176486.log.gz 2023-09-30T22:40:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162969.log 2023-09-30T22:40:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194548.log 2023-09-30T22:40:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162969.log: /var/log/ceph/ceph-client.admin.194548.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.162969.log.gz 2023-09-30T22:40:49.300 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194548.log.gz 2023-09-30T22:40:49.300 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172193.log 2023-09-30T22:40:49.300 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174498.log 2023-09-30T22:40:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172193.log: /var/log/ceph/ceph-client.admin.174498.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172193.log.gz 2023-09-30T22:40:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118577.log 2023-09-30T22:40:49.320 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174498.log.gz 2023-09-30T22:40:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152373.log 2023-09-30T22:40:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.118577.log: 87.5%/var/log/ceph/ceph-client.admin.152373.log: -- replaced with /var/log/ceph/ceph-client.admin.118577.log.gz 2023-09-30T22:40:49.321 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.152373.log.gz 2023-09-30T22:40:49.321 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137361.log 2023-09-30T22:40:49.321 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189504.log 2023-09-30T22:40:49.321 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137361.log: /var/log/ceph/ceph-client.admin.189504.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137361.log.gz 2023-09-30T22:40:49.321 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.189504.log.gz 2023-09-30T22:40:49.321 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151739.log 2023-09-30T22:40:49.321 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161990.log 2023-09-30T22:40:49.321 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151739.log: /var/log/ceph/ceph-client.admin.161990.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151739.log.gz 2023-09-30T22:40:49.322 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.161990.log.gz 2023-09-30T22:40:49.322 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147588.log 2023-09-30T22:40:49.322 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139203.log 2023-09-30T22:40:49.322 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147588.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147588.log.gz/var/log/ceph/ceph-client.admin.139203.log: 2023-09-30T22:40:49.322 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139203.log.gz 2023-09-30T22:40:49.322 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192328.log 2023-09-30T22:40:49.322 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135647.log 2023-09-30T22:40:49.323 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192328.log: /var/log/ceph/ceph-client.admin.135647.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.192328.log.gz 2023-09-30T22:40:49.323 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135647.log.gz 2023-09-30T22:40:49.323 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191144.log 2023-09-30T22:40:49.323 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178223.log 2023-09-30T22:40:49.323 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191144.log: /var/log/ceph/ceph-client.admin.178223.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.191144.log.gz 2023-09-30T22:40:49.323 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178223.log.gz 2023-09-30T22:40:49.323 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160984.log 2023-09-30T22:40:49.323 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142544.log 2023-09-30T22:40:49.324 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160984.log: /var/log/ceph/ceph-client.admin.142544.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.160984.log.gz 2023-09-30T22:40:49.324 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184012.log 2023-09-30T22:40:49.324 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142544.log.gz 2023-09-30T22:40:49.324 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164511.log 2023-09-30T22:40:49.324 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184012.log: /var/log/ceph/ceph-client.admin.164511.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.184012.log.gz 2023-09-30T22:40:49.324 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164511.log.gz 2023-09-30T22:40:49.324 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188498.log 2023-09-30T22:40:49.324 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160540.log 2023-09-30T22:40:49.325 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188498.log: /var/log/ceph/ceph-client.admin.160540.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.188498.log.gz 2023-09-30T22:40:49.325 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160540.log.gz 2023-09-30T22:40:49.325 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157865.log 2023-09-30T22:40:49.325 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154551.log 2023-09-30T22:40:49.325 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157865.log: /var/log/ceph/ceph-client.admin.154551.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157865.log.gz 2023-09-30T22:40:49.325 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154551.log.gz 2023-09-30T22:40:49.325 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128582.log 2023-09-30T22:40:49.326 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184281.log 2023-09-30T22:40:49.326 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128582.log: /var/log/ceph/ceph-client.admin.184281.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128582.log.gz 2023-09-30T22:40:49.326 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184281.log.gz 2023-09-30T22:40:49.326 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147026.log 2023-09-30T22:40:49.326 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172383.log 2023-09-30T22:40:49.326 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147026.log: /var/log/ceph/ceph-client.admin.172383.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.147026.log.gz 2023-09-30T22:40:49.326 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172383.log.gz 2023-09-30T22:40:49.326 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138414.log 2023-09-30T22:40:49.327 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164707.log 2023-09-30T22:40:49.327 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146634.log 2023-09-30T22:40:49.327 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138414.log.gz 2023-09-30T22:40:49.327 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164707.log: /var/log/ceph/ceph-client.admin.146634.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164707.log.gz 2023-09-30T22:40:49.327 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157992.log 2023-09-30T22:40:49.327 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146634.log.gz 2023-09-30T22:40:49.327 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163947.log 2023-09-30T22:40:49.328 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157992.log: /var/log/ceph/ceph-client.admin.163947.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157992.log.gz 2023-09-30T22:40:49.328 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163947.log.gz 2023-09-30T22:40:49.328 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146660.log 2023-09-30T22:40:49.328 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138341.log 2023-09-30T22:40:49.328 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146660.log: 88.4%/var/log/ceph/ceph-client.admin.138341.log: -- replaced with /var/log/ceph/ceph-client.admin.146660.log.gz 2023-09-30T22:40:49.328 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138341.log.gz 2023-09-30T22:40:49.328 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140083.log 2023-09-30T22:40:49.328 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138397.log 2023-09-30T22:40:49.329 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140083.log: /var/log/ceph/ceph-client.admin.138397.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.140083.log.gz 2023-09-30T22:40:49.329 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.138397.log.gz 2023-09-30T22:40:49.329 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144648.log 2023-09-30T22:40:49.329 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168611.log 2023-09-30T22:40:49.329 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144648.log: /var/log/ceph/ceph-client.admin.168611.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144648.log.gz 2023-09-30T22:40:49.329 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168611.log.gz 2023-09-30T22:40:49.329 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149303.log 2023-09-30T22:40:49.330 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135767.log 2023-09-30T22:40:49.330 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149303.log: /var/log/ceph/ceph-client.admin.135767.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.149303.log.gz 2023-09-30T22:40:49.330 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135767.log.gz 2023-09-30T22:40:49.330 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182811.log 2023-09-30T22:40:49.330 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149752.log 2023-09-30T22:40:49.330 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182811.log: /var/log/ceph/ceph-client.admin.149752.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182811.log.gz 2023-09-30T22:40:49.330 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149752.log.gz 2023-09-30T22:40:49.331 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176878.log 2023-09-30T22:40:49.331 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138537.log 2023-09-30T22:40:49.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176878.log: /var/log/ceph/ceph-client.admin.138537.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176878.log.gz 2023-09-30T22:40:49.331 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138537.log.gz 2023-09-30T22:40:49.331 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187740.log 2023-09-30T22:40:49.331 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194989.log 2023-09-30T22:40:49.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187740.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.187740.log.gz 2023-09-30T22:40:49.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194989.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.194989.log.gz 2023-09-30T22:40:49.332 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141267.log 2023-09-30T22:40:49.332 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154163.log 2023-09-30T22:40:49.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141267.log: /var/log/ceph/ceph-client.admin.154163.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141267.log.gz 2023-09-30T22:40:49.332 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.154163.log.gz 2023-09-30T22:40:49.332 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190484.log 2023-09-30T22:40:49.332 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176825.log 2023-09-30T22:40:49.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190484.log: /var/log/ceph/ceph-client.admin.176825.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190484.log.gz 2023-09-30T22:40:49.333 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176825.log.gz 2023-09-30T22:40:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158044.log 2023-09-30T22:40:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190948.log 2023-09-30T22:40:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158044.log: /var/log/ceph/ceph-client.admin.190948.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158044.log.gz 2023-09-30T22:40:49.333 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.190948.log.gz 2023-09-30T22:40:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176041.log 2023-09-30T22:40:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142740.log 2023-09-30T22:40:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176041.log: /var/log/ceph/ceph-client.admin.142740.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176041.log.gz 2023-09-30T22:40:49.334 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142740.log.gz 2023-09-30T22:40:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164342.log 2023-09-30T22:40:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166453.log 2023-09-30T22:40:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164342.log: 88.1%/var/log/ceph/ceph-client.admin.166453.log: -- replaced with /var/log/ceph/ceph-client.admin.164342.log.gz 2023-09-30T22:40:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190190.log 2023-09-30T22:40:49.334 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.166453.log.gz 2023-09-30T22:40:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186267.log 2023-09-30T22:40:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190190.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190190.log.gz 2023-09-30T22:40:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186267.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186267.log.gz 2023-09-30T22:40:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143132.log 2023-09-30T22:40:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176682.log 2023-09-30T22:40:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143132.log: /var/log/ceph/ceph-client.admin.176682.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143132.log.gz 2023-09-30T22:40:49.335 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176682.log.gz 2023-09-30T22:40:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160762.log 2023-09-30T22:40:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125184.log 2023-09-30T22:40:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160762.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160762.log.gz 2023-09-30T22:40:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184771.log 2023-09-30T22:40:49.336 INFO:teuthology.orchestra.run.smithi059.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.125184.log.gz 2023-09-30T22:40:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151320.log 2023-09-30T22:40:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184771.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.184771.log.gz 2023-09-30T22:40:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151320.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151320.log.gz 2023-09-30T22:40:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171970.log 2023-09-30T22:40:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188008.log 2023-09-30T22:40:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171970.log: /var/log/ceph/ceph-client.admin.188008.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.171970.log.gz 2023-09-30T22:40:49.337 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.188008.log.gz 2023-09-30T22:40:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156220.log 2023-09-30T22:40:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194842.log 2023-09-30T22:40:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156220.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156220.log.gz 2023-09-30T22:40:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194842.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.194842.log.gz 2023-09-30T22:40:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172777.log 2023-09-30T22:40:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139102.log 2023-09-30T22:40:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172777.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172777.log.gz 2023-09-30T22:40:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139102.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139102.log.gz 2023-09-30T22:40:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174145.log 2023-09-30T22:40:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179105.log 2023-09-30T22:40:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174145.log: /var/log/ceph/ceph-client.admin.179105.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174145.log.gz 2023-09-30T22:40:49.338 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.179105.log.gz 2023-09-30T22:40:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169065.log 2023-09-30T22:40:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177805.log 2023-09-30T22:40:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169065.log: /var/log/ceph/ceph-client.admin.177805.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169065.log.gz 2023-09-30T22:40:49.339 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177805.log.gz 2023-09-30T22:40:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192256.log 2023-09-30T22:40:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159364.log 2023-09-30T22:40:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192256.log: /var/log/ceph/ceph-client.admin.159364.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.192256.log.gz 2023-09-30T22:40:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180673.log 2023-09-30T22:40:49.340 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159364.log.gz 2023-09-30T22:40:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148715.log 2023-09-30T22:40:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190066.log 2023-09-30T22:40:49.340 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.180673.log.gz 2023-09-30T22:40:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148715.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148715.log.gz 2023-09-30T22:40:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190262.log 2023-09-30T22:40:49.340 INFO:teuthology.orchestra.run.smithi059.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.190066.log.gz 2023-09-30T22:40:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156515.log 2023-09-30T22:40:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190262.log: 88.4%/var/log/ceph/ceph-client.admin.156515.log: -- replaced with /var/log/ceph/ceph-client.admin.190262.log.gz 2023-09-30T22:40:49.341 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156515.log.gz 2023-09-30T22:40:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191740.log 2023-09-30T22:40:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128099.log 2023-09-30T22:40:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191740.log: /var/log/ceph/ceph-client.admin.128099.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.191740.log.gz 2023-09-30T22:40:49.341 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128099.log.gz 2023-09-30T22:40:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184477.log 2023-09-30T22:40:49.342 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174472.log 2023-09-30T22:40:49.359 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184477.log: /var/log/ceph/ceph-client.admin.174472.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.184477.log.gz 2023-09-30T22:40:49.359 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174472.log.gz 2023-09-30T22:40:49.360 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165074.log 2023-09-30T22:40:49.360 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187250.log 2023-09-30T22:40:49.360 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165074.log: /var/log/ceph/ceph-client.admin.187250.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.165074.log.gz 2023-09-30T22:40:49.360 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155731.log 2023-09-30T22:40:49.360 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.187250.log.gz 2023-09-30T22:40:49.360 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155731.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.155731.log.gz 2023-09-30T22:40:49.360 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124498.log 2023-09-30T22:40:49.361 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167895.log 2023-09-30T22:40:49.361 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124498.log: /var/log/ceph/ceph-client.admin.167895.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124498.log.gz 2023-09-30T22:40:49.361 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167895.log.gz 2023-09-30T22:40:49.361 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181529.log 2023-09-30T22:40:49.361 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159246.log 2023-09-30T22:40:49.361 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181529.log: /var/log/ceph/ceph-client.admin.159246.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.181529.log.gz 2023-09-30T22:40:49.361 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159246.log.gz 2023-09-30T22:40:49.361 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152961.log 2023-09-30T22:40:49.362 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136628.log 2023-09-30T22:40:49.362 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174890.log 2023-09-30T22:40:49.362 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152961.log.gz 2023-09-30T22:40:49.362 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136628.log: /var/log/ceph/ceph-client.admin.174890.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136628.log.gz 2023-09-30T22:40:49.362 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145458.log 2023-09-30T22:40:49.362 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174890.log.gz 2023-09-30T22:40:49.362 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187714.log 2023-09-30T22:40:49.362 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145458.log: /var/log/ceph/ceph-client.admin.187714.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145458.log.gz 2023-09-30T22:40:49.363 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187714.log.gz 2023-09-30T22:40:49.363 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188034.log 2023-09-30T22:40:49.363 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143917.log 2023-09-30T22:40:49.363 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188034.log: /var/log/ceph/ceph-client.admin.143917.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188034.log.gz 2023-09-30T22:40:49.363 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143917.log.gz 2023-09-30T22:40:49.363 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135818.log 2023-09-30T22:40:49.363 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122621.log 2023-09-30T22:40:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135818.log: /var/log/ceph/ceph-client.admin.122621.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.135818.log.gz 2023-09-30T22:40:49.364 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122621.log.gz 2023-09-30T22:40:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150291.log 2023-09-30T22:40:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181751.log 2023-09-30T22:40:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150291.log: /var/log/ceph/ceph-client.admin.181751.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.150291.log.gz 2023-09-30T22:40:49.364 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181751.log.gz 2023-09-30T22:40:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188694.log 2023-09-30T22:40:49.364 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155436.log 2023-09-30T22:40:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188694.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188694.log.gz 2023-09-30T22:40:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155436.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155436.log.gz 2023-09-30T22:40:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128172.log 2023-09-30T22:40:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161912.log 2023-09-30T22:40:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128172.log: /var/log/ceph/ceph-client.admin.161912.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128172.log.gz 2023-09-30T22:40:49.365 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161912.log.gz 2023-09-30T22:40:49.365 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174351.log 2023-09-30T22:40:49.366 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152496.log 2023-09-30T22:40:49.366 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174351.log: 89.3%/var/log/ceph/ceph-client.admin.152496.log: -- replaced with /var/log/ceph/ceph-client.admin.174351.log.gz 2023-09-30T22:40:49.366 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147222.log 2023-09-30T22:40:49.366 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152496.log.gz 2023-09-30T22:40:49.366 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167434.log 2023-09-30T22:40:49.366 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147222.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147222.log.gz 2023-09-30T22:40:49.366 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167434.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167434.log.gz 2023-09-30T22:40:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166701.log 2023-09-30T22:40:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180967.log 2023-09-30T22:40:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166701.log: /var/log/ceph/ceph-client.admin.180967.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.166701.log.gz 2023-09-30T22:40:49.367 INFO:teuthology.orchestra.run.smithi059.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.180967.log.gz 2023-09-30T22:40:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150878.log 2023-09-30T22:40:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189700.log 2023-09-30T22:40:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150878.log: /var/log/ceph/ceph-client.admin.189700.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.150878.log.gz 2023-09-30T22:40:49.367 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.189700.log.gz 2023-09-30T22:40:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145875.log 2023-09-30T22:40:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143423.log 2023-09-30T22:40:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145875.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.145875.log.gz 2023-09-30T22:40:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153894.log 2023-09-30T22:40:49.368 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143423.log.gz 2023-09-30T22:40:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181039.log 2023-09-30T22:40:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153894.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153894.log.gz 2023-09-30T22:40:49.368 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187420.log 2023-09-30T22:40:49.369 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.181039.log.gz 2023-09-30T22:40:49.369 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151346.log 2023-09-30T22:40:49.369 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187420.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187420.log.gz 2023-09-30T22:40:49.369 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191642.log 2023-09-30T22:40:49.369 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151346.log.gz 2023-09-30T22:40:49.369 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171524.log 2023-09-30T22:40:49.369 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191642.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.191642.log.gz 2023-09-30T22:40:49.370 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155828.log 2023-09-30T22:40:49.370 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171524.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171524.log.gz 2023-09-30T22:40:49.370 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155828.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.155828.log.gz 2023-09-30T22:40:49.370 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168976.log 2023-09-30T22:40:49.370 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188916.log 2023-09-30T22:40:49.370 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168976.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168976.log.gz/var/log/ceph/ceph-client.admin.188916.log: 2023-09-30T22:40:49.370 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188916.log.gz 2023-09-30T22:40:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149107.log 2023-09-30T22:40:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124036.log 2023-09-30T22:40:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149107.log: /var/log/ceph/ceph-client.admin.124036.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149107.log.gz 2023-09-30T22:40:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170793.log 2023-09-30T22:40:49.371 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124036.log.gz 2023-09-30T22:40:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127031.log 2023-09-30T22:40:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170793.log: /var/log/ceph/ceph-client.admin.127031.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.170793.log.gz 2023-09-30T22:40:49.372 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.127031.log.gz 2023-09-30T22:40:49.372 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161402.log 2023-09-30T22:40:49.372 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168192.log 2023-09-30T22:40:49.372 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161402.log: /var/log/ceph/ceph-client.admin.168192.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161402.log.gz 2023-09-30T22:40:49.372 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168192.log.gz 2023-09-30T22:40:49.372 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141512.log 2023-09-30T22:40:49.372 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135082.log 2023-09-30T22:40:49.372 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141512.log: /var/log/ceph/ceph-client.admin.135082.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141512.log.gz 2023-09-30T22:40:49.373 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135082.log.gz 2023-09-30T22:40:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193726.log 2023-09-30T22:40:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140524.log 2023-09-30T22:40:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193726.log: /var/log/ceph/ceph-client.admin.140524.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.193726.log.gz 2023-09-30T22:40:49.373 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140524.log.gz 2023-09-30T22:40:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148323.log 2023-09-30T22:40:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162722.log 2023-09-30T22:40:49.374 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148323.log: /var/log/ceph/ceph-client.admin.162722.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.148323.log.gz 2023-09-30T22:40:49.374 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162722.log.gz 2023-09-30T22:40:49.374 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167135.log 2023-09-30T22:40:49.374 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176924.log 2023-09-30T22:40:49.374 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167135.log: /var/log/ceph/ceph-client.admin.176924.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.167135.log.gz 2023-09-30T22:40:49.374 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.176924.log.gz 2023-09-30T22:40:49.374 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185065.log 2023-09-30T22:40:49.375 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126754.log 2023-09-30T22:40:49.375 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185065.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185065.log.gz 2023-09-30T22:40:49.375 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.126754.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.126754.log.gz 2023-09-30T22:40:49.375 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141342.log 2023-09-30T22:40:49.375 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-09-30T22:40:49.375 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141342.log: /var/log/ceph/ceph-osd.1.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.141342.log.gz 2023-09-30T22:40:49.380 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164941.log 2023-09-30T22:40:49.380 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124232.log 2023-09-30T22:40:49.380 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164941.log: /var/log/ceph/ceph-client.admin.124232.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.164941.log.gz 2023-09-30T22:40:49.381 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124232.log.gz 2023-09-30T22:40:49.381 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170232.log 2023-09-30T22:40:49.381 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170232.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.170232.log.gz 2023-09-30T22:40:49.381 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169564.log 2023-09-30T22:40:49.381 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169564.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.169564.log.gz 2023-09-30T22:40:49.381 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178683.log 2023-09-30T22:40:49.381 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178683.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.178683.log.gz 2023-09-30T22:40:49.381 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182215.log 2023-09-30T22:40:49.382 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182215.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182215.log.gz 2023-09-30T22:40:49.382 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177295.log 2023-09-30T22:40:49.382 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177295.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177295.log.gz 2023-09-30T22:40:49.382 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124694.log 2023-09-30T22:40:49.382 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124694.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124694.log.gz 2023-09-30T22:40:49.382 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184013.log 2023-09-30T22:40:49.382 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184013.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.184013.log.gz 2023-09-30T22:40:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183228.log 2023-09-30T22:40:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183228.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.183228.log.gz 2023-09-30T22:40:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125135.log 2023-09-30T22:40:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125135.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125135.log.gz 2023-09-30T22:40:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165714.log 2023-09-30T22:40:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165714.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.165714.log.gz 2023-09-30T22:40:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189772.log 2023-09-30T22:40:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189772.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189772.log.gz 2023-09-30T22:40:49.384 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144113.log 2023-09-30T22:40:49.384 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144113.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144113.log.gz 2023-09-30T22:40:49.384 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148227.log 2023-09-30T22:40:49.384 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148227.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148227.log.gz 2023-09-30T22:40:49.384 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139988.log 2023-09-30T22:40:49.384 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139988.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139988.log.gz 2023-09-30T22:40:49.384 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166649.log 2023-09-30T22:40:49.385 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166649.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166649.log.gz 2023-09-30T22:40:49.385 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123981.log 2023-09-30T22:40:49.385 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123981.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.123981.log.gz 2023-09-30T22:40:49.385 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165048.log 2023-09-30T22:40:49.387 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165048.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165048.log.gz 2023-09-30T22:40:49.387 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167332.log 2023-09-30T22:40:49.387 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167332.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167332.log.gz 2023-09-30T22:40:49.387 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179275.log 2023-09-30T22:40:49.387 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179275.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.179275.log.gz 2023-09-30T22:40:49.387 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171132.log 2023-09-30T22:40:49.387 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171132.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.171132.log.gz 2023-09-30T22:40:49.388 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177103.log 2023-09-30T22:40:49.388 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135963.log 2023-09-30T22:40:49.388 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177103.log: /var/log/ceph/ceph-client.admin.135963.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.177103.log.gz 2023-09-30T22:40:49.388 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135963.log.gz 2023-09-30T22:40:49.388 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163702.log 2023-09-30T22:40:49.389 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163702.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163702.log.gz 2023-09-30T22:40:49.389 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182731.log 2023-09-30T22:40:49.389 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182731.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182731.log.gz 2023-09-30T22:40:49.390 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186437.log 2023-09-30T22:40:49.390 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186437.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.186437.log.gz 2023-09-30T22:40:49.390 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169590.log 2023-09-30T22:40:49.391 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169590.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169590.log.gz 2023-09-30T22:40:49.391 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129852.log 2023-09-30T22:40:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.129852.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129852.log.gz 2023-09-30T22:40:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125255.log 2023-09-30T22:40:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125255.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.125255.log.gz 2023-09-30T22:40:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123469.log 2023-09-30T22:40:49.394 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123469.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123469.log.gz 2023-09-30T22:40:49.394 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179399.log 2023-09-30T22:40:49.395 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179399.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179399.log.gz 2023-09-30T22:40:49.395 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141930.log 2023-09-30T22:40:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157200.log 2023-09-30T22:40:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141930.log: /var/log/ceph/ceph-client.admin.157200.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141930.log.gz 2023-09-30T22:40:49.397 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157200.log.gz 2023-09-30T22:40:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191962.log 2023-09-30T22:40:49.400 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191962.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.191962.log.gz 2023-09-30T22:40:49.400 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174546.log 2023-09-30T22:40:49.402 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174546.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174546.log.gz 2023-09-30T22:40:49.402 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149703.log 2023-09-30T22:40:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149703.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149703.log.gz 2023-09-30T22:40:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140867.log 2023-09-30T22:40:49.404 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140867.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.140867.log.gz 2023-09-30T22:40:49.404 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165636.log 2023-09-30T22:40:49.405 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165636.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.165636.log.gz 2023-09-30T22:40:49.405 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138218.log 2023-09-30T22:40:49.406 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138218.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.138218.log.gz 2023-09-30T22:40:49.406 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180157.log 2023-09-30T22:40:49.407 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180157.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.180157.log.gz 2023-09-30T22:40:49.407 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145874.log 2023-09-30T22:40:49.408 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145874.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145874.log.gz 2023-09-30T22:40:49.408 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154874.log 2023-09-30T22:40:49.409 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154874.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.154874.log.gz 2023-09-30T22:40:49.409 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192916.log 2023-09-30T22:40:49.410 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192916.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.192916.log.gz 2023-09-30T22:40:49.410 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191446.log 2023-09-30T22:40:49.411 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191446.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.191446.log.gz 2023-09-30T22:40:49.412 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161593.log 2023-09-30T22:40:49.412 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161593.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161593.log.gz 2023-09-30T22:40:49.413 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167703.log 2023-09-30T22:40:49.414 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167703.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167703.log.gz 2023-09-30T22:40:49.414 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162186.log 2023-09-30T22:40:49.415 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162186.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162186.log.gz 2023-09-30T22:40:49.415 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182460.log 2023-09-30T22:40:49.416 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182460.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.182460.log.gz 2023-09-30T22:40:49.416 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136943.log 2023-09-30T22:40:49.417 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136943.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136943.log.gz 2023-09-30T22:40:49.417 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153962.log 2023-09-30T22:40:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153962.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.153962.log.gz 2023-09-30T22:40:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168879.log 2023-09-30T22:40:49.419 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168879.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.168879.log.gz 2023-09-30T22:40:49.419 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171380.log 2023-09-30T22:40:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171380.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171380.log.gz 2023-09-30T22:40:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189210.log 2023-09-30T22:40:49.421 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189210.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.189210.log.gz 2023-09-30T22:40:49.422 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177296.log 2023-09-30T22:40:49.422 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177296.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177296.log.gz 2023-09-30T22:40:49.423 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166940.log 2023-09-30T22:40:49.424 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166940.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.166940.log.gz 2023-09-30T22:40:49.424 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149899.log 2023-09-30T22:40:49.425 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149899.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149899.log.gz 2023-09-30T22:40:49.425 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154144.log 2023-09-30T22:40:49.426 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154144.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.154144.log.gz 2023-09-30T22:40:49.426 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134985.log 2023-09-30T22:40:49.427 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.134985.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.134985.log.gz 2023-09-30T22:40:49.427 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137975.log 2023-09-30T22:40:49.428 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137975.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.137975.log.gz 2023-09-30T22:40:49.428 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179863.log 2023-09-30T22:40:49.429 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179863.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179863.log.gz 2023-09-30T22:40:49.429 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170936.log 2023-09-30T22:40:49.430 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187126.log 2023-09-30T22:40:49.431 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170936.log: /var/log/ceph/ceph-client.admin.187126.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.170936.log.gz 2023-09-30T22:40:49.431 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187126.log.gz 2023-09-30T22:40:49.431 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143864.log 2023-09-30T22:40:49.432 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143864.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.143864.log.gz 2023-09-30T22:40:49.432 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188230.log 2023-09-30T22:40:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188230.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.188230.log.gz 2023-09-30T22:40:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152327.log 2023-09-30T22:40:49.434 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152327.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152327.log.gz 2023-09-30T22:40:49.434 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163187.log 2023-09-30T22:40:49.435 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163187.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163187.log.gz 2023-09-30T22:40:49.435 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176655.log 2023-09-30T22:40:49.436 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176655.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176655.log.gz 2023-09-30T22:40:49.481 INFO:teuthology.orchestra.run.smithi059.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-09-30T22:40:49.493 INFO:teuthology.orchestra.run.smithi059.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-09-30T22:40:49.558 INFO:teuthology.orchestra.run.smithi059.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-09-30T22:40:49.559 INFO:teuthology.orchestra.run.smithi059.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-09-30T22:40:49.662 INFO:teuthology.orchestra.run.smithi059.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-09-30T22:40:49.821 INFO:teuthology.orchestra.run.smithi059.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-09-30T22:40:49.823 INFO:teuthology.orchestra.run.smithi059.stderr: 2023-09-30T22:40:49.823 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m1.157s 2023-09-30T22:40:49.823 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m4.358s 2023-09-30T22:40:49.823 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m0.978s 2023-09-30T22:40:49.823 INFO:tasks.ceph:Archiving logs... 2023-09-30T22:40:49.823 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047/remote/smithi059/log 2023-09-30T22:40:49.864 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T22:40:51.473 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047/remote/smithi191/log 2023-09-30T22:40:51.474 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T22:40:51.508 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:40:51.518 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-30T22:40:51.535 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:40:51.539 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-30T22:40:51.539 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T22:40:51.545 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T22:40:51.656 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-30T22:40:51.667 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-30T22:40:51.668 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:40:51.671 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:40:51.690 INFO:teuthology.orchestra.run.smithi191.stderr:bash: ntpq: command not found 2023-09-30T22:40:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:bash: ntpq: command not found 2023-09-30T22:40:51.694 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:40:51.695 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2023-09-30T22:40:51.695 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 58 -71us[ -71us] +/- 80ms 2023-09-30T22:40:51.695 INFO:teuthology.orchestra.run.smithi191.stdout:^* hv02.front.sepia.ceph.com 3 6 377 60 -492us[ -491us] +/- 60ms 2023-09-30T22:40:51.695 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +643us[ +645us] +/- 63ms 2023-09-30T22:40:51.695 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:40:51.697 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:40:51.697 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2023-09-30T22:40:51.697 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 59 -76us[ -64us] +/- 80ms 2023-09-30T22:40:51.697 INFO:teuthology.orchestra.run.smithi059.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 -482us[ -470us] +/- 60ms 2023-09-30T22:40:51.697 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 +663us[ +675us] +/- 63ms 2023-09-30T22:40:51.697 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:40:51.698 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-30T22:40:51.712 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-30T22:40:51.712 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-30T22:40:51.726 DEBUG:teuthology.orchestra.run.smithi059:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T22:40:51.795 DEBUG:teuthology.orchestra.run.smithi191:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T22:40:51.886 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:40:51.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:40:51.923 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:40:51.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:40:51.956 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-30T22:40:51.968 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-30T22:40:52.050 INFO:teuthology.task.internal:Duration was 1524.705874 seconds 2023-09-30T22:40:52.051 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-30T22:40:52.064 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-30T22:40:52.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T22:40:52.068 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T22:40:52.116 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:40:52.125 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:40:52.576 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-30T22:40:52.577 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2023-09-30T22:40:52.577 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T22:40:52.608 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2023-09-30T22:40:52.608 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T22:40:52.632 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-30T22:40:52.632 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T22:40:52.650 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T22:40:52.711 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-30T22:40:52.712 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:40:52.714 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:40:52.839 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-30T22:40:52.851 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-30T22:40:52.852 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T22:40:52.883 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T22:40:52.911 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-30T22:40:52.927 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:40:52.929 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:40:52.959 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2023-09-30T22:40:52.978 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2023-09-30T22:40:53.011 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:40:53.073 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi059.front.sepia.ceph.com, flagging run as failed 2023-09-30T22:40:53.074 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:40:53.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:40:53.091 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-30T22:40:53.103 INFO:teuthology.task.internal:Transferring archived files... 2023-09-30T22:40:53.104 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047/remote/smithi059 2023-09-30T22:40:53.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-30T22:42:21.369 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-09-30T22:42:21.382 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047/remote/smithi059/coredump/1696112970.126772.core.gz: gzip compressed data, was "1696112970.126772.core", last modified: Sat Sep 30 22:40:53 2023, max compression, original size modulo 2^32 1376182272 2023-09-30T22:42:21.382 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-09-30T22:42:27.286 INFO:teuthology.task.internal: core looks like: /tmp/tmpmedadeom: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mgr -f --cluster ceph -i x', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mgr', platform: 'x86_64' 2023-09-30T22:42:27.427 INFO:teuthology.task.internal: dump_program: ceph-mgr -f --cluster ceph -i x 2023-09-30T22:42:27.428 DEBUG:teuthology.orchestra.run.smithi059:> which 'ceph-mgr -f --cluster ceph -i x' 2023-09-30T22:42:27.452 INFO:teuthology.orchestra.run.smithi059.stderr:/usr/bin/which: invalid option -- 'f' 2023-09-30T22:42:27.452 INFO:teuthology.orchestra.run.smithi059.stderr:/usr/bin/which: unrecognized option '--cluster' 2023-09-30T22:42:27.453 INFO:teuthology.orchestra.run.smithi059.stderr:/usr/bin/which: no x in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2023-09-30T22:42:27.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:42:27.454 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph-mgr 2023-09-30T22:42:27.455 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph 2023-09-30T22:42:27.455 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: "which 'ceph-mgr -f --cluster ceph -i x'" 2023-09-30T22:42:27.471 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-30T22:42:27.485 INFO:teuthology.task.internal:Not uploading archives. 2023-09-30T22:42:27.485 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-30T22:42:27.498 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-30T22:42:27.498 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T22:42:27.522 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T22:42:27.535 INFO:teuthology.orchestra.run.smithi059.stdout: 525835 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 30 22:40 /home/ubuntu/cephtest 2023-09-30T22:42:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: 525837 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Sep 30 22:40 /home/ubuntu/cephtest/archive 2023-09-30T22:42:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: 525838 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 22:29 /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:42:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: 525596 371492 -rw------- 1 root root 1376182272 Sep 30 22:29 /home/ubuntu/cephtest/archive/coredump/1696112970.126772.core 2023-09-30T22:42:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: 655784 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Sep 30 22:40 /home/ubuntu/cephtest/archive/audit 2023-09-30T22:42:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: 655822 28 -rw------- 1 ubuntu ubuntu 26267 Sep 30 22:40 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-09-30T22:42:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: 525950 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 22:40 /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:42:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: 525479 4 -rw-rw-rw- 1 ubuntu ubuntu 779 Sep 30 22:40 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-09-30T22:42:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: 525524 112 -rw-rw-r-- 1 ubuntu ubuntu 114031 Sep 30 22:40 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:42:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: 525480 132 -rw-rw-rw- 1 ubuntu ubuntu 134076 Sep 30 22:40 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-09-30T22:42:27.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:42:27.538 INFO:teuthology.orchestra.run.smithi059.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-09-30T22:42:27.538 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-30T22:42:27.551 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-30T22:42:27.565 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-30T22:42:27.579 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:42:27.580 INFO:teuthology.nuke:Checking targets against current locks 2023-09-30T22:42:27.589 INFO:teuthology.orchestra.run.smithi191.stdout: 526080 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 30 22:40 /home/ubuntu/cephtest 2023-09-30T22:42:27.589 INFO:teuthology.orchestra.run.smithi191.stdout: 526081 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Sep 30 22:40 /home/ubuntu/cephtest/archive 2023-09-30T22:42:27.590 INFO:teuthology.orchestra.run.smithi191.stdout: 655784 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Sep 30 22:40 /home/ubuntu/cephtest/archive/audit 2023-09-30T22:42:27.590 INFO:teuthology.orchestra.run.smithi191.stdout: 655786 220 -rw------- 1 ubuntu ubuntu 223400 Sep 30 22:40 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-09-30T22:42:27.590 INFO:teuthology.orchestra.run.smithi191.stdout: 526083 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 22:40 /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:42:27.590 INFO:teuthology.orchestra.run.smithi191.stdout: 525481 4 -rw-rw-rw- 1 ubuntu ubuntu 889 Sep 30 22:38 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-09-30T22:42:27.590 INFO:teuthology.orchestra.run.smithi191.stdout: 525366 92 -rw-rw-r-- 1 ubuntu ubuntu 92156 Sep 30 22:40 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:42:27.590 INFO:teuthology.orchestra.run.smithi191.stdout: 525364 88 -rw-rw-rw- 1 ubuntu ubuntu 86630 Sep 30 22:40 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-09-30T22:42:27.591 INFO:teuthology.orchestra.run.smithi191.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-09-30T22:42:27.618 DEBUG:teuthology.nuke:shortname: smithi059 2023-09-30T22:42:27.619 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T22:42:27.645 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 22:07:16.538453', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIMwVFfiBhlkzOu4g+g0RWhCOo1THv7YOS3ipFvq4AFSMFuLm6CNt7BJUsep0edEsgkOCT3cbPkShu/9VMlr3Cc='} 2023-09-30T22:42:27.649 DEBUG:teuthology.nuke:shortname: smithi191 2023-09-30T22:42:27.649 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T22:42:27.673 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408047', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 22:07:16.540206', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNQ3uQNH5jbGJ/ypFNhMzqTxPsHHQZ7d+koYJTzU5lZ+41WZj39huXoH4smYp2oD/153Z1NXXCDG3Qje4x6bWDQ='} 2023-09-30T22:42:27.707 INFO:teuthology.orchestra.console.smithi059:Power off 2023-09-30T22:42:27.708 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T22:42:27.730 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-09-30T22:42:27.731 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:42:27.748 INFO:teuthology.orchestra.console.smithi191:Power off 2023-09-30T22:42:27.749 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T22:42:27.758 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-09-30T22:42:27.777 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-09-30T22:42:27.777 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:42:27.806 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-09-30T22:42:31.760 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:42:31.807 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:42:31.872 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-09-30T22:42:31.917 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-09-30T22:42:35.876 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:42:35.919 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:42:35.986 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-09-30T22:42:36.029 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-09-30T22:42:36.088 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-09-30T22:42:36.131 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-09-30T22:42:36.236 INFO:teuthology.run:Summary data: description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}} duration: 1524.7058744430542 failure_reason: 'Command failed on smithi059 with status 124: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json''' flavor: default owner: scheduled_dparmar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=afdd0374ba3f45c7ac7635a585a46259 status: fail success: false 2023-09-30T22:42:36.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T22:42:36.312 INFO:teuthology.run:FAIL